2024-09-22T08:26:07.224 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-22T08:26:07.242 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-22T08:26:07.321 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/soumyakoduri-2024-09-22_06:37:27-rgw-wip-skoduri-cloud-restore-distro-default-smithi/7915065 branch: wip-skoduri-cloud-restore description: rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/replicated supported-random-distro$/{centos_latest}} email: null first_in_suite: false job_id: '7915065' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi name: soumyakoduri-2024-09-22_06:37:27-rgw-wip-skoduri-cloud-restore-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 3 size: 10 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-skoduri-cloud-restore ceph: conf: client: debug rgw: 20 setgroup: ceph setuser: ceph mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(PG_AVAILABILITY\) - \(PG_DEGRADED\) - \(POOL_APP_NOT_ENABLED\) - not have an application enabled sha1: 8852379c050c686f4605f33f0129009b2029ca9d ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 8852379c050c686f4605f33f0129009b2029ca9d rgw: ec-data-pool: false frontend: beast thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-skoduri-cloud-restore sha1: 8852379c050c686f4605f33f0129009b2029ca9d owner: scheduled_soumyakoduri@teuthology priority: 100 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - osd.0 - - mgr.x - client.0 - osd.1 - osd.2 - osd.3 sha1: 8852379c050c686f4605f33f0129009b2029ca9d sleep_before_teardown: 0 suite: rgw suite_branch: wip-skoduri-cloud-restore suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_8852379c050c686f4605f33f0129009b2029ca9d/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 8852379c050c686f4605f33f0129009b2029ca9d targets: smithi031.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMOYvQ+739vXT4f5ys9bx0XPvVo3JVF1b2OFICxt6Qb0X7nlT90F4Qv6s30QC8SJSk4kIBu50VP3GJh6SIGMKjQ= smithi142.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGtjEJ/fLpO4tfW/9b084U168n9CyIyhj4L0KdVAfLPT/mSMKNHNzfpHW6J60Sf4He0wDI4jiajX16KHb8d6uAw= tasks: - install: null - ceph: conf: client: debug ms: 1 rgw gc obj min wait: 15 osd: debug ms: 1 debug objclass: 20 - rgw: client.0: null - radosgw-admin: null - radosgw-admin-rest: null teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-22_06:37:27 tube: smithi user: soumyakoduri verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2902 2024-09-22T08:26:07.321 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_8852379c050c686f4605f33f0129009b2029ca9d/qa; will attempt to use it 2024-09-22T08:26:07.322 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_8852379c050c686f4605f33f0129009b2029ca9d/qa/tasks 2024-09-22T08:26:07.322 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-22T08:26:07.323 INFO:teuthology.task.internal:Checking packages... 2024-09-22T08:26:07.344 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '8852379c050c686f4605f33f0129009b2029ca9d' 2024-09-22T08:26:07.344 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-22T08:26:07.344 INFO:teuthology.packaging:ref: None 2024-09-22T08:26:07.344 INFO:teuthology.packaging:tag: None 2024-09-22T08:26:07.344 INFO:teuthology.packaging:branch: wip-skoduri-cloud-restore 2024-09-22T08:26:07.344 INFO:teuthology.packaging:sha1: 8852379c050c686f4605f33f0129009b2029ca9d 2024-09-22T08:26:07.345 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-skoduri-cloud-restore 2024-09-22T08:26:07.487 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-5106.g8852379c 2024-09-22T08:26:07.488 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-22T08:26:07.497 INFO:teuthology.task.internal:no buildpackages task found 2024-09-22T08:26:07.497 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-22T08:26:07.519 INFO:teuthology.task.internal:Saving configuration 2024-09-22T08:26:07.529 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-22T08:26:07.541 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-22T08:26:07.564 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi031.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/soumyakoduri-2024-09-22_06:37:27-rgw-wip-skoduri-cloud-restore-distro-default-smithi/7915065', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-22 08:21:09.720553', 'locked_by': 'scheduled_soumyakoduri@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMOYvQ+739vXT4f5ys9bx0XPvVo3JVF1b2OFICxt6Qb0X7nlT90F4Qv6s30QC8SJSk4kIBu50VP3GJh6SIGMKjQ='} 2024-09-22T08:26:07.591 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi142.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/soumyakoduri-2024-09-22_06:37:27-rgw-wip-skoduri-cloud-restore-distro-default-smithi/7915065', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-22 08:21:09.718599', 'locked_by': 'scheduled_soumyakoduri@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGtjEJ/fLpO4tfW/9b084U168n9CyIyhj4L0KdVAfLPT/mSMKNHNzfpHW6J60Sf4He0wDI4jiajX16KHb8d6uAw='} 2024-09-22T08:26:07.591 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-22T08:26:07.602 INFO:teuthology.task.internal:roles: ubuntu@smithi031.front.sepia.ceph.com - ['mon.a', 'osd.0'] 2024-09-22T08:26:07.602 INFO:teuthology.task.internal:roles: ubuntu@smithi142.front.sepia.ceph.com - ['mgr.x', 'client.0', 'osd.1', 'osd.2', 'osd.3'] 2024-09-22T08:26:07.602 INFO:teuthology.run_tasks:Running task console_log... 2024-09-22T08:26:07.665 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f260d394280>, signals=[15]) 2024-09-22T08:26:07.665 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-22T08:26:07.681 INFO:teuthology.task.internal:Opening connections... 2024-09-22T08:26:07.681 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi031.front.sepia.ceph.com 2024-09-22T08:26:07.682 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-22T08:26:07.759 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi142.front.sepia.ceph.com 2024-09-22T08:26:07.760 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-22T08:26:07.834 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-22T08:26:07.843 DEBUG:teuthology.orchestra.run.smithi031:> uname -m 2024-09-22T08:26:07.861 INFO:teuthology.orchestra.run.smithi031.stdout:x86_64 2024-09-22T08:26:07.861 DEBUG:teuthology.orchestra.run.smithi031:> cat /etc/os-release 2024-09-22T08:26:07.918 INFO:teuthology.orchestra.run.smithi031.stdout:NAME="CentOS Stream" 2024-09-22T08:26:07.918 INFO:teuthology.orchestra.run.smithi031.stdout:VERSION="9" 2024-09-22T08:26:07.918 INFO:teuthology.orchestra.run.smithi031.stdout:ID="centos" 2024-09-22T08:26:07.919 INFO:teuthology.orchestra.run.smithi031.stdout:ID_LIKE="rhel fedora" 2024-09-22T08:26:07.919 INFO:teuthology.orchestra.run.smithi031.stdout:VERSION_ID="9" 2024-09-22T08:26:07.919 INFO:teuthology.orchestra.run.smithi031.stdout:PLATFORM_ID="platform:el9" 2024-09-22T08:26:07.919 INFO:teuthology.orchestra.run.smithi031.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-22T08:26:07.919 INFO:teuthology.orchestra.run.smithi031.stdout:ANSI_COLOR="0;31" 2024-09-22T08:26:07.919 INFO:teuthology.orchestra.run.smithi031.stdout:LOGO="fedora-logo-icon" 2024-09-22T08:26:07.919 INFO:teuthology.orchestra.run.smithi031.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-22T08:26:07.919 INFO:teuthology.orchestra.run.smithi031.stdout:HOME_URL="https://centos.org/" 2024-09-22T08:26:07.919 INFO:teuthology.orchestra.run.smithi031.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-22T08:26:07.919 INFO:teuthology.orchestra.run.smithi031.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-22T08:26:07.919 INFO:teuthology.orchestra.run.smithi031.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-22T08:26:07.920 INFO:teuthology.lock.ops:Updating smithi031.front.sepia.ceph.com on lock server 2024-09-22T08:26:07.942 DEBUG:teuthology.orchestra.run.smithi142:> uname -m 2024-09-22T08:26:07.960 INFO:teuthology.orchestra.run.smithi142.stdout:x86_64 2024-09-22T08:26:07.960 DEBUG:teuthology.orchestra.run.smithi142:> cat /etc/os-release 2024-09-22T08:26:08.018 INFO:teuthology.orchestra.run.smithi142.stdout:NAME="CentOS Stream" 2024-09-22T08:26:08.018 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION="9" 2024-09-22T08:26:08.018 INFO:teuthology.orchestra.run.smithi142.stdout:ID="centos" 2024-09-22T08:26:08.018 INFO:teuthology.orchestra.run.smithi142.stdout:ID_LIKE="rhel fedora" 2024-09-22T08:26:08.018 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION_ID="9" 2024-09-22T08:26:08.018 INFO:teuthology.orchestra.run.smithi142.stdout:PLATFORM_ID="platform:el9" 2024-09-22T08:26:08.018 INFO:teuthology.orchestra.run.smithi142.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-22T08:26:08.018 INFO:teuthology.orchestra.run.smithi142.stdout:ANSI_COLOR="0;31" 2024-09-22T08:26:08.018 INFO:teuthology.orchestra.run.smithi142.stdout:LOGO="fedora-logo-icon" 2024-09-22T08:26:08.019 INFO:teuthology.orchestra.run.smithi142.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-22T08:26:08.019 INFO:teuthology.orchestra.run.smithi142.stdout:HOME_URL="https://centos.org/" 2024-09-22T08:26:08.019 INFO:teuthology.orchestra.run.smithi142.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-22T08:26:08.019 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-22T08:26:08.019 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-22T08:26:08.019 INFO:teuthology.lock.ops:Updating smithi142.front.sepia.ceph.com on lock server 2024-09-22T08:26:08.041 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-22T08:26:08.050 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-22T08:26:08.061 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-22T08:26:08.061 DEBUG:teuthology.orchestra.run.smithi031:> test '!' -e /home/ubuntu/cephtest 2024-09-22T08:26:08.064 DEBUG:teuthology.orchestra.run.smithi142:> test '!' -e /home/ubuntu/cephtest 2024-09-22T08:26:08.081 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-22T08:26:08.091 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-22T08:26:08.091 DEBUG:teuthology.orchestra.run.smithi031:> test -z $(ls -A /var/lib/ceph) 2024-09-22T08:26:08.121 DEBUG:teuthology.orchestra.run.smithi142:> test -z $(ls -A /var/lib/ceph) 2024-09-22T08:26:08.271 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-22T08:26:08.330 INFO:teuthology.run_tasks:Running task kernel... 2024-09-22T08:26:08.349 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2024-09-22T08:26:08.349 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mgr.x': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2024-09-22T08:26:08.349 DEBUG:teuthology.orchestra.run.smithi031:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-22T08:26:08.349 DEBUG:teuthology.orchestra.run.smithi142:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-22T08:26:08.366 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-22T08:26:08.366 DEBUG:teuthology.orchestra.run.smithi031:> uname -r 2024-09-22T08:26:08.367 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-22T08:26:08.367 DEBUG:teuthology.orchestra.run.smithi142:> uname -r 2024-09-22T08:26:08.424 INFO:teuthology.orchestra.run.smithi031.stdout:5.14.0-503.el9.x86_64 2024-09-22T08:26:08.424 INFO:teuthology.task.kernel:Running kernel on smithi031: 5.14.0-503.el9.x86_64 2024-09-22T08:26:08.424 DEBUG:teuthology.orchestra.run.smithi031:> sudo yum install -y kernel 2024-09-22T08:26:08.426 INFO:teuthology.orchestra.run.smithi142.stdout:5.14.0-503.el9.x86_64 2024-09-22T08:26:08.426 INFO:teuthology.task.kernel:Running kernel on smithi142: 5.14.0-503.el9.x86_64 2024-09-22T08:26:08.426 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum install -y kernel 2024-09-22T08:26:10.755 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS Stream 9 - BaseOS 13 MB/s | 8.3 MB 00:00 2024-09-22T08:26:10.961 INFO:teuthology.orchestra.run.smithi031.stdout:CentOS Stream 9 - BaseOS 9.7 MB/s | 8.3 MB 00:00 2024-09-22T08:26:12.398 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS Stream 9 - AppStream 36 MB/s | 20 MB 00:00 2024-09-22T08:26:13.378 INFO:teuthology.orchestra.run.smithi031.stdout:CentOS Stream 9 - AppStream 16 MB/s | 20 MB 00:01 2024-09-22T08:26:19.078 INFO:teuthology.orchestra.run.smithi031.stdout:CentOS Stream 9 - CRB 3.7 MB/s | 6.5 MB 00:01 2024-09-22T08:26:20.256 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS Stream 9 - CRB 1.6 MB/s | 6.5 MB 00:04 2024-09-22T08:26:21.704 INFO:teuthology.orchestra.run.smithi031.stdout:CentOS Stream 9 - Extras packages 14 kB/s | 19 kB 00:01 2024-09-22T08:26:21.981 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS Stream 9 - Extras packages 37 kB/s | 19 kB 00:00 2024-09-22T08:26:23.069 INFO:teuthology.orchestra.run.smithi142.stdout:Extra Packages for Enterprise Linux 23 MB/s | 23 MB 00:00 2024-09-22T08:26:23.074 INFO:teuthology.orchestra.run.smithi031.stdout:Extra Packages for Enterprise Linux 18 MB/s | 23 MB 00:01 2024-09-22T08:26:28.533 INFO:teuthology.orchestra.run.smithi142.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-09-22T08:26:28.780 INFO:teuthology.orchestra.run.smithi031.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-09-22T08:26:30.439 INFO:teuthology.orchestra.run.smithi142.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-22T08:26:30.439 INFO:teuthology.orchestra.run.smithi142.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-22T08:26:30.535 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-09-22T08:26:30.539 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-22T08:26:30.539 INFO:teuthology.orchestra.run.smithi142.stdout: Package Architecture Version Repository Size 2024-09-22T08:26:30.539 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-22T08:26:30.539 INFO:teuthology.orchestra.run.smithi142.stdout:Installing: 2024-09-22T08:26:30.540 INFO:teuthology.orchestra.run.smithi142.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-22T08:26:30.540 INFO:teuthology.orchestra.run.smithi142.stdout:Installing dependencies: 2024-09-22T08:26:30.540 INFO:teuthology.orchestra.run.smithi142.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-22T08:26:30.540 INFO:teuthology.orchestra.run.smithi142.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-22T08:26:30.540 INFO:teuthology.orchestra.run.smithi142.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-22T08:26:30.540 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-22T08:26:30.540 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2024-09-22T08:26:30.540 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-22T08:26:30.540 INFO:teuthology.orchestra.run.smithi142.stdout:Install 4 Packages 2024-09-22T08:26:30.540 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-22T08:26:30.541 INFO:teuthology.orchestra.run.smithi142.stdout:Total download size: 79 M 2024-09-22T08:26:30.541 INFO:teuthology.orchestra.run.smithi142.stdout:Installed size: 126 M 2024-09-22T08:26:30.541 INFO:teuthology.orchestra.run.smithi142.stdout:Downloading Packages: 2024-09-22T08:26:30.745 INFO:teuthology.orchestra.run.smithi031.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-22T08:26:30.745 INFO:teuthology.orchestra.run.smithi031.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-22T08:26:30.826 INFO:teuthology.orchestra.run.smithi142.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 295 kB/s | 36 kB 00:00 2024-09-22T08:26:30.839 INFO:teuthology.orchestra.run.smithi031.stdout:Dependencies resolved. 2024-09-22T08:26:30.854 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2024-09-22T08:26:30.855 INFO:teuthology.orchestra.run.smithi031.stdout: Package Architecture Version Repository Size 2024-09-22T08:26:30.855 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2024-09-22T08:26:30.855 INFO:teuthology.orchestra.run.smithi031.stdout:Installing: 2024-09-22T08:26:30.855 INFO:teuthology.orchestra.run.smithi031.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-22T08:26:30.855 INFO:teuthology.orchestra.run.smithi031.stdout:Installing dependencies: 2024-09-22T08:26:30.855 INFO:teuthology.orchestra.run.smithi031.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-22T08:26:30.855 INFO:teuthology.orchestra.run.smithi031.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-22T08:26:30.855 INFO:teuthology.orchestra.run.smithi031.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-22T08:26:30.855 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-22T08:26:30.855 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction Summary 2024-09-22T08:26:30.855 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2024-09-22T08:26:30.855 INFO:teuthology.orchestra.run.smithi031.stdout:Install 4 Packages 2024-09-22T08:26:30.855 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-22T08:26:30.856 INFO:teuthology.orchestra.run.smithi031.stdout:Total download size: 79 M 2024-09-22T08:26:30.856 INFO:teuthology.orchestra.run.smithi031.stdout:Installed size: 126 M 2024-09-22T08:26:30.856 INFO:teuthology.orchestra.run.smithi031.stdout:Downloading Packages: 2024-09-22T08:26:31.064 INFO:teuthology.orchestra.run.smithi031.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 352 kB/s | 36 kB 00:00 2024-09-22T08:26:31.323 INFO:teuthology.orchestra.run.smithi031.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 43 MB/s | 16 MB 00:00 2024-09-22T08:26:31.673 INFO:teuthology.orchestra.run.smithi031.stdout:(3/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 49 MB/s | 35 MB 00:00 2024-09-22T08:26:32.074 INFO:teuthology.orchestra.run.smithi031.stdout:(4/4): kernel-modules-core-5.14.0-508.el9.x86_6 28 MB/s | 29 MB 00:01 2024-09-22T08:26:32.074 INFO:teuthology.orchestra.run.smithi031.stdout:-------------------------------------------------------------------------------- 2024-09-22T08:26:32.074 INFO:teuthology.orchestra.run.smithi031.stdout:Total 65 MB/s | 79 MB 00:01 2024-09-22T08:26:32.784 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction check 2024-09-22T08:26:33.187 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction check succeeded. 2024-09-22T08:26:33.187 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction test 2024-09-22T08:26:34.159 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction test succeeded. 2024-09-22T08:26:34.159 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction 2024-09-22T08:26:36.718 INFO:teuthology.orchestra.run.smithi031.stdout: Preparing : 1/1 2024-09-22T08:26:37.404 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-22T08:26:37.485 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-22T08:26:39.459 INFO:teuthology.orchestra.run.smithi142.stdout:(2/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 3.9 MB/s | 35 MB 00:08 2024-09-22T08:26:40.235 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-22T08:26:40.363 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-22T08:26:40.409 INFO:teuthology.orchestra.run.smithi142.stdout:(3/4): kernel-core-5.14.0-508.el9.x86_64.rpm 1.6 MB/s | 16 MB 00:09 2024-09-22T08:26:42.117 INFO:teuthology.orchestra.run.smithi142.stdout:(4/4): kernel-modules-core-5.14.0-508.el9.x86_6 2.5 MB/s | 29 MB 00:11 2024-09-22T08:26:42.117 INFO:teuthology.orchestra.run.smithi142.stdout:-------------------------------------------------------------------------------- 2024-09-22T08:26:42.117 INFO:teuthology.orchestra.run.smithi142.stdout:Total 6.8 MB/s | 79 MB 00:11 2024-09-22T08:26:42.796 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction check 2024-09-22T08:26:43.138 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction check succeeded. 2024-09-22T08:26:43.138 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction test 2024-09-22T08:26:44.078 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction test succeeded. 2024-09-22T08:26:44.078 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction 2024-09-22T08:26:45.487 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-22T08:26:45.530 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-22T08:26:46.517 INFO:teuthology.orchestra.run.smithi142.stdout: Preparing : 1/1 2024-09-22T08:26:47.170 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-22T08:26:47.250 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-22T08:26:50.016 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-22T08:26:50.150 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-22T08:26:50.681 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-22T08:26:54.972 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-22T08:26:55.016 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-22T08:26:59.927 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-22T08:27:29.938 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-22T08:27:29.980 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-22T08:27:30.327 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-22T08:27:30.327 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-22T08:27:30.327 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-22T08:27:30.328 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-22T08:27:31.148 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-22T08:27:31.148 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-22T08:27:31.149 INFO:teuthology.orchestra.run.smithi031.stdout:Installed: 2024-09-22T08:27:31.149 INFO:teuthology.orchestra.run.smithi031.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-22T08:27:31.149 INFO:teuthology.orchestra.run.smithi031.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-22T08:27:31.149 INFO:teuthology.orchestra.run.smithi031.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-22T08:27:31.149 INFO:teuthology.orchestra.run.smithi031.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-22T08:27:31.149 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-22T08:27:31.149 INFO:teuthology.orchestra.run.smithi031.stdout:Complete! 2024-09-22T08:27:31.490 DEBUG:teuthology.orchestra.run.smithi031:> rpm -q kernel | sort -rV | head -n 1 2024-09-22T08:27:31.580 INFO:teuthology.orchestra.run.smithi031.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-22T08:27:31.580 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-22T08:27:31.580 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-22T08:27:31.580 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-22T08:27:31.580 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-22T08:27:31.581 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-22T08:27:31.581 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi031.front.sepia.ceph.com, path=None, version=distro) 2024-09-22T08:27:31.581 DEBUG:teuthology.orchestra.run.smithi031:> rpm -q kernel | sort -rV | head -n 1 2024-09-22T08:27:31.638 INFO:teuthology.orchestra.run.smithi031.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-22T08:27:31.639 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-22T08:27:31.639 DEBUG:teuthology.orchestra.run.smithi031:> sudo rpm -qi grub2-tools 2024-09-22T08:27:31.676 INFO:teuthology.orchestra.run.smithi031.stdout:Name : grub2-tools 2024-09-22T08:27:31.677 INFO:teuthology.orchestra.run.smithi031.stdout:Epoch : 1 2024-09-22T08:27:31.677 INFO:teuthology.orchestra.run.smithi031.stdout:Version : 2.06 2024-09-22T08:27:31.677 INFO:teuthology.orchestra.run.smithi031.stdout:Release : 82.el9 2024-09-22T08:27:31.677 INFO:teuthology.orchestra.run.smithi031.stdout:Architecture: x86_64 2024-09-22T08:27:31.677 INFO:teuthology.orchestra.run.smithi031.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-22T08:27:31.677 INFO:teuthology.orchestra.run.smithi031.stdout:Group : Unspecified 2024-09-22T08:27:31.677 INFO:teuthology.orchestra.run.smithi031.stdout:Size : 8274670 2024-09-22T08:27:31.677 INFO:teuthology.orchestra.run.smithi031.stdout:License : GPLv3+ 2024-09-22T08:27:31.677 INFO:teuthology.orchestra.run.smithi031.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-22T08:27:31.677 INFO:teuthology.orchestra.run.smithi031.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-22T08:27:31.677 INFO:teuthology.orchestra.run.smithi031.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-22T08:27:31.677 INFO:teuthology.orchestra.run.smithi031.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-22T08:27:31.677 INFO:teuthology.orchestra.run.smithi031.stdout:Packager : builder@centos.org 2024-09-22T08:27:31.677 INFO:teuthology.orchestra.run.smithi031.stdout:Vendor : CentOS 2024-09-22T08:27:31.678 INFO:teuthology.orchestra.run.smithi031.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-22T08:27:31.678 INFO:teuthology.orchestra.run.smithi031.stdout:Summary : Support tools for GRUB. 2024-09-22T08:27:31.678 INFO:teuthology.orchestra.run.smithi031.stdout:Description : 2024-09-22T08:27:31.678 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-22T08:27:31.678 INFO:teuthology.orchestra.run.smithi031.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-22T08:27:31.678 INFO:teuthology.orchestra.run.smithi031.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-22T08:27:31.678 INFO:teuthology.orchestra.run.smithi031.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-22T08:27:31.678 INFO:teuthology.orchestra.run.smithi031.stdout:hardware devices. 2024-09-22T08:27:31.678 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-22T08:27:31.678 INFO:teuthology.orchestra.run.smithi031.stdout:This subpackage provides tools for support of all platforms. 2024-09-22T08:27:31.679 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-22T08:27:31.679 INFO:teuthology.task.kernel:Updating grub on smithi031 to boot 5.14.0-508.el9.x86_64 2024-09-22T08:27:31.679 DEBUG:teuthology.orchestra.run.smithi031:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-22T08:27:32.340 INFO:teuthology.orchestra.run.smithi031.stderr:Generating grub configuration file ... 2024-09-22T08:27:33.665 INFO:teuthology.orchestra.run.smithi031.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-22T08:27:33.696 INFO:teuthology.orchestra.run.smithi031.stderr:done 2024-09-22T08:27:33.698 DEBUG:teuthology.orchestra.run.smithi031:> mktemp 2024-09-22T08:27:33.713 INFO:teuthology.orchestra.run.smithi031.stdout:/tmp/tmp.NaYQMEjSOA 2024-09-22T08:27:33.713 DEBUG:teuthology.orchestra.run.smithi031:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.NaYQMEjSOA 2024-09-22T08:27:33.779 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod 0666 /tmp/tmp.NaYQMEjSOA 2024-09-22T08:27:33.915 DEBUG:teuthology.orchestra.remote:smithi031:/tmp/tmp.NaYQMEjSOA is 6KB 2024-09-22T08:27:33.963 DEBUG:teuthology.orchestra.run.smithi031:> rm -fr /tmp/tmp.NaYQMEjSOA 2024-09-22T08:27:33.978 DEBUG:teuthology.orchestra.run.smithi031:> sudo /bin/ls /boot/loader/entries || true 2024-09-22T08:27:34.044 INFO:teuthology.orchestra.run.smithi031.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-22T08:27:34.044 INFO:teuthology.orchestra.run.smithi031.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-22T08:27:34.045 INFO:teuthology.orchestra.run.smithi031.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-22T08:27:34.045 INFO:teuthology.orchestra.run.smithi031.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-22T08:27:34.046 DEBUG:teuthology.orchestra.run.smithi031:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-22T08:27:34.207 DEBUG:teuthology.orchestra.run.smithi031:> sudo shutdown -r now 2024-09-22T08:27:37.886 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-22T08:27:37.924 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-22T08:27:38.320 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-22T08:27:38.320 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-22T08:27:38.321 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-22T08:27:38.321 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-22T08:27:39.178 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-22T08:27:39.178 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-22T08:27:39.178 INFO:teuthology.orchestra.run.smithi142.stdout:Installed: 2024-09-22T08:27:39.178 INFO:teuthology.orchestra.run.smithi142.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-22T08:27:39.178 INFO:teuthology.orchestra.run.smithi142.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-22T08:27:39.178 INFO:teuthology.orchestra.run.smithi142.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-22T08:27:39.178 INFO:teuthology.orchestra.run.smithi142.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-22T08:27:39.179 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-22T08:27:39.179 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-09-22T08:27:39.555 DEBUG:teuthology.orchestra.run.smithi142:> rpm -q kernel | sort -rV | head -n 1 2024-09-22T08:27:39.654 INFO:teuthology.orchestra.run.smithi142.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-22T08:27:39.654 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-22T08:27:39.654 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-22T08:27:39.655 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-22T08:27:39.655 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-22T08:27:39.655 INFO:teuthology.task.kernel:Installing distro kernel on mgr.x... 2024-09-22T08:27:39.655 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi142.front.sepia.ceph.com, path=None, version=distro) 2024-09-22T08:27:39.655 DEBUG:teuthology.orchestra.run.smithi142:> rpm -q kernel | sort -rV | head -n 1 2024-09-22T08:27:39.713 INFO:teuthology.orchestra.run.smithi142.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-22T08:27:39.714 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-22T08:27:39.714 DEBUG:teuthology.orchestra.run.smithi142:> sudo rpm -qi grub2-tools 2024-09-22T08:27:39.746 INFO:teuthology.orchestra.run.smithi142.stdout:Name : grub2-tools 2024-09-22T08:27:39.746 INFO:teuthology.orchestra.run.smithi142.stdout:Epoch : 1 2024-09-22T08:27:39.746 INFO:teuthology.orchestra.run.smithi142.stdout:Version : 2.06 2024-09-22T08:27:39.746 INFO:teuthology.orchestra.run.smithi142.stdout:Release : 82.el9 2024-09-22T08:27:39.746 INFO:teuthology.orchestra.run.smithi142.stdout:Architecture: x86_64 2024-09-22T08:27:39.746 INFO:teuthology.orchestra.run.smithi142.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-22T08:27:39.746 INFO:teuthology.orchestra.run.smithi142.stdout:Group : Unspecified 2024-09-22T08:27:39.746 INFO:teuthology.orchestra.run.smithi142.stdout:Size : 8274670 2024-09-22T08:27:39.746 INFO:teuthology.orchestra.run.smithi142.stdout:License : GPLv3+ 2024-09-22T08:27:39.747 INFO:teuthology.orchestra.run.smithi142.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-22T08:27:39.747 INFO:teuthology.orchestra.run.smithi142.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-22T08:27:39.747 INFO:teuthology.orchestra.run.smithi142.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-22T08:27:39.747 INFO:teuthology.orchestra.run.smithi142.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-22T08:27:39.747 INFO:teuthology.orchestra.run.smithi142.stdout:Packager : builder@centos.org 2024-09-22T08:27:39.747 INFO:teuthology.orchestra.run.smithi142.stdout:Vendor : CentOS 2024-09-22T08:27:39.747 INFO:teuthology.orchestra.run.smithi142.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-22T08:27:39.747 INFO:teuthology.orchestra.run.smithi142.stdout:Summary : Support tools for GRUB. 2024-09-22T08:27:39.747 INFO:teuthology.orchestra.run.smithi142.stdout:Description : 2024-09-22T08:27:39.747 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-22T08:27:39.747 INFO:teuthology.orchestra.run.smithi142.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-22T08:27:39.747 INFO:teuthology.orchestra.run.smithi142.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-22T08:27:39.747 INFO:teuthology.orchestra.run.smithi142.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-22T08:27:39.747 INFO:teuthology.orchestra.run.smithi142.stdout:hardware devices. 2024-09-22T08:27:39.748 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-22T08:27:39.748 INFO:teuthology.orchestra.run.smithi142.stdout:This subpackage provides tools for support of all platforms. 2024-09-22T08:27:39.748 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-22T08:27:39.749 INFO:teuthology.task.kernel:Updating grub on smithi142 to boot 5.14.0-508.el9.x86_64 2024-09-22T08:27:39.749 DEBUG:teuthology.orchestra.run.smithi142:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-22T08:27:40.416 INFO:teuthology.orchestra.run.smithi142.stderr:Generating grub configuration file ... 2024-09-22T08:27:41.773 INFO:teuthology.orchestra.run.smithi142.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-22T08:27:41.799 INFO:teuthology.orchestra.run.smithi142.stderr:done 2024-09-22T08:27:41.802 DEBUG:teuthology.orchestra.run.smithi142:> mktemp 2024-09-22T08:27:41.817 INFO:teuthology.orchestra.run.smithi142.stdout:/tmp/tmp.X02IBs9uTT 2024-09-22T08:27:41.818 DEBUG:teuthology.orchestra.run.smithi142:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.X02IBs9uTT 2024-09-22T08:27:41.885 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 0666 /tmp/tmp.X02IBs9uTT 2024-09-22T08:27:42.022 DEBUG:teuthology.orchestra.remote:smithi142:/tmp/tmp.X02IBs9uTT is 6KB 2024-09-22T08:27:42.072 DEBUG:teuthology.orchestra.run.smithi142:> rm -fr /tmp/tmp.X02IBs9uTT 2024-09-22T08:27:42.087 DEBUG:teuthology.orchestra.run.smithi142:> sudo /bin/ls /boot/loader/entries || true 2024-09-22T08:27:42.155 INFO:teuthology.orchestra.run.smithi142.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-22T08:27:42.155 INFO:teuthology.orchestra.run.smithi142.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-22T08:27:42.155 INFO:teuthology.orchestra.run.smithi142.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-22T08:27:42.155 INFO:teuthology.orchestra.run.smithi142.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-22T08:27:42.157 DEBUG:teuthology.orchestra.run.smithi142:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-22T08:27:42.316 DEBUG:teuthology.orchestra.run.smithi142:> sudo shutdown -r now 2024-09-22T08:28:04.230 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-22T08:28:04.231 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi031.front.sepia.ceph.com' 2024-09-22T08:28:04.231 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-22T08:28:12.325 INFO:teuthology.task.kernel:Checking client mgr.x for new kernel version... 2024-09-22T08:28:12.325 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi142.front.sepia.ceph.com' 2024-09-22T08:28:12.326 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-22T08:28:22.639 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.31 2024-09-22T08:28:30.835 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.142 2024-09-22T08:28:31.641 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi031.front.sepia.ceph.com' 2024-09-22T08:28:31.642 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-22T08:28:39.838 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi142.front.sepia.ceph.com' 2024-09-22T08:28:39.838 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-22T08:28:42.895 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.142 2024-09-22T08:28:50.035 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.31 2024-09-22T08:28:54.897 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi142.front.sepia.ceph.com' 2024-09-22T08:28:54.898 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-22T08:29:02.035 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi031.front.sepia.ceph.com' 2024-09-22T08:29:02.036 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-22T08:29:05.107 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.31 2024-09-22T08:29:13.327 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.142 2024-09-22T08:29:20.114 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi031.front.sepia.ceph.com' 2024-09-22T08:29:20.115 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-22T08:29:20.423 DEBUG:teuthology.orchestra.run.smithi031:> true 2024-09-22T08:29:20.777 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi031.front.sepia.ceph.com' 2024-09-22T08:29:20.777 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-508.el9.x86_64"... 2024-09-22T08:29:20.777 DEBUG:teuthology.orchestra.run.smithi031:> uname -r 2024-09-22T08:29:20.794 INFO:teuthology.orchestra.run.smithi031.stdout:5.14.0-508.el9.x86_64 2024-09-22T08:29:20.795 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-22T08:29:20.795 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-22T08:29:20.795 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-22T08:29:21.796 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-22T08:29:21.796 DEBUG:teuthology.orchestra.run.smithi031:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-22T08:29:21.864 INFO:teuthology.orchestra.run.smithi031.stdout:ttyS1 2024-09-22T08:29:21.896 DEBUG:teuthology.parallel:result is None 2024-09-22T08:29:28.327 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi142.front.sepia.ceph.com' 2024-09-22T08:29:28.328 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-22T08:29:28.638 DEBUG:teuthology.orchestra.run.smithi142:> true 2024-09-22T08:29:29.045 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi142.front.sepia.ceph.com' 2024-09-22T08:29:29.045 INFO:teuthology.task.kernel:Checking kernel version of mgr.x, want "5.14.0-508.el9.x86_64"... 2024-09-22T08:29:29.046 DEBUG:teuthology.orchestra.run.smithi142:> uname -r 2024-09-22T08:29:29.060 INFO:teuthology.orchestra.run.smithi142.stdout:5.14.0-508.el9.x86_64 2024-09-22T08:29:29.060 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-22T08:29:29.060 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-22T08:29:29.060 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-22T08:29:30.061 INFO:teuthology.task.kernel:Enabling kdb on mgr.x... 2024-09-22T08:29:30.062 DEBUG:teuthology.orchestra.run.smithi142:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-22T08:29:30.138 INFO:teuthology.orchestra.run.smithi142.stdout:ttyS1 2024-09-22T08:29:30.167 DEBUG:teuthology.parallel:result is None 2024-09-22T08:29:30.167 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-22T08:29:30.174 INFO:teuthology.task.internal:Creating test directory... 2024-09-22T08:29:30.174 DEBUG:teuthology.orchestra.run.smithi031:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-22T08:29:30.176 DEBUG:teuthology.orchestra.run.smithi142:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-22T08:29:30.194 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-22T08:29:30.200 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-22T08:29:30.210 INFO:teuthology.task.internal:Creating archive directory... 2024-09-22T08:29:30.210 DEBUG:teuthology.orchestra.run.smithi031:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-22T08:29:30.236 DEBUG:teuthology.orchestra.run.smithi142:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-22T08:29:30.260 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-22T08:29:30.266 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-22T08:29:30.266 DEBUG:teuthology.orchestra.run.smithi031:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-22T08:29:30.299 DEBUG:teuthology.orchestra.run.smithi142:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-22T08:29:30.331 INFO:teuthology.orchestra.run.smithi142.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-22T08:29:30.340 INFO:teuthology.orchestra.run.smithi031.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-22T08:29:30.341 INFO:teuthology.orchestra.run.smithi142.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-22T08:29:30.351 INFO:teuthology.orchestra.run.smithi031.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-22T08:29:30.353 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-22T08:29:30.361 INFO:teuthology.task.internal:Configuring sudo... 2024-09-22T08:29:30.361 DEBUG:teuthology.orchestra.run.smithi031:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-22T08:29:30.396 DEBUG:teuthology.orchestra.run.smithi142:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-22T08:29:30.424 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-22T08:29:30.432 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-22T08:29:30.433 DEBUG:teuthology.orchestra.run.smithi031:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-22T08:29:30.466 DEBUG:teuthology.orchestra.run.smithi142:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-22T08:29:30.482 DEBUG:teuthology.orchestra.run.smithi031:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-22T08:29:30.571 DEBUG:teuthology.orchestra.run.smithi031:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-22T08:29:30.614 DEBUG:teuthology.orchestra.run.smithi031:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-22T08:29:30.698 DEBUG:teuthology.orchestra.run.smithi031:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-22T08:29:30.741 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-22T08:29:30.790 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-22T08:29:30.818 DEBUG:teuthology.orchestra.run.smithi142:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-22T08:29:30.862 DEBUG:teuthology.orchestra.run.smithi142:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-22T08:29:30.915 DEBUG:teuthology.orchestra.run.smithi142:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-22T08:29:30.999 DEBUG:teuthology.orchestra.run.smithi142:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-22T08:29:31.044 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-09-22T08:29:31.044 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-22T08:29:31.114 DEBUG:teuthology.orchestra.run.smithi031:> sudo service rsyslog restart 2024-09-22T08:29:31.116 DEBUG:teuthology.orchestra.run.smithi142:> sudo service rsyslog restart 2024-09-22T08:29:31.165 INFO:teuthology.orchestra.run.smithi031.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-22T08:29:31.217 INFO:teuthology.orchestra.run.smithi142.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-22T08:29:31.677 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-22T08:29:31.688 INFO:teuthology.task.internal:Starting timer... 2024-09-22T08:29:31.688 INFO:teuthology.run_tasks:Running task pcp... 2024-09-22T08:29:31.697 INFO:teuthology.run_tasks:Running task selinux... 2024-09-22T08:29:31.706 DEBUG:teuthology.orchestra.run.smithi031:> sudo service auditd rotate 2024-09-22T08:29:31.763 INFO:teuthology.orchestra.run.smithi031.stdout:Rotating logs: 2024-09-22T08:29:31.765 DEBUG:teuthology.orchestra.run.smithi142:> sudo service auditd rotate 2024-09-22T08:29:31.911 INFO:teuthology.orchestra.run.smithi142.stdout:Rotating logs: 2024-09-22T08:29:31.914 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-22T08:29:31.915 DEBUG:teuthology.orchestra.run.smithi031:> /usr/sbin/getenforce 2024-09-22T08:29:31.941 INFO:teuthology.orchestra.run.smithi031.stdout:Permissive 2024-09-22T08:29:31.941 DEBUG:teuthology.orchestra.run.smithi142:> /usr/sbin/getenforce 2024-09-22T08:29:31.989 INFO:teuthology.orchestra.run.smithi142.stdout:Permissive 2024-09-22T08:29:31.989 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi031.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi142.front.sepia.ceph.com': 'permissive'} 2024-09-22T08:29:31.989 DEBUG:teuthology.orchestra.run.smithi031:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-22T08:29:32.020 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-22T08:29:32.021 DEBUG:teuthology.orchestra.run.smithi142:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-22T08:29:32.090 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-22T08:29:32.091 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-22T08:29:32.091 DEBUG:teuthology.orchestra.run.smithi031:> sudo /usr/sbin/setenforce permissive 2024-09-22T08:29:32.138 DEBUG:teuthology.orchestra.run.smithi142:> sudo /usr/sbin/setenforce permissive 2024-09-22T08:29:32.306 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-22T08:29:32.315 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-22T08:29:32.325 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-22T08:29:32.326 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi031.front.sepia.ceph.com,smithi142.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-22T08:33:17.870 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi031.front.sepia.ceph.com'), Remote(name='ubuntu@smithi142.front.sepia.ceph.com')] 2024-09-22T08:33:17.871 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi031.front.sepia.ceph.com' 2024-09-22T08:33:17.872 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-22T08:33:17.947 DEBUG:teuthology.orchestra.run.smithi031:> true 2024-09-22T08:33:18.034 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi031.front.sepia.ceph.com' 2024-09-22T08:33:18.035 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi142.front.sepia.ceph.com' 2024-09-22T08:33:18.035 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-22T08:33:18.111 DEBUG:teuthology.orchestra.run.smithi142:> true 2024-09-22T08:33:18.202 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi142.front.sepia.ceph.com' 2024-09-22T08:33:18.202 INFO:teuthology.run_tasks:Running task clock... 2024-09-22T08:33:18.211 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-22T08:33:18.212 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-22T08:33:18.212 DEBUG:teuthology.orchestra.run.smithi031:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-22T08:33:18.214 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-22T08:33:18.214 DEBUG:teuthology.orchestra.run.smithi142:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-22T08:33:18.243 INFO:teuthology.orchestra.run.smithi031.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-22T08:33:18.259 INFO:teuthology.orchestra.run.smithi031.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-22T08:33:18.271 INFO:teuthology.orchestra.run.smithi142.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-22T08:33:18.285 INFO:teuthology.orchestra.run.smithi031.stderr:sudo: ntpd: command not found 2024-09-22T08:33:18.286 INFO:teuthology.orchestra.run.smithi142.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-22T08:33:18.297 INFO:teuthology.orchestra.run.smithi031.stdout:506 Cannot talk to daemon 2024-09-22T08:33:18.310 INFO:teuthology.orchestra.run.smithi142.stderr:sudo: ntpd: command not found 2024-09-22T08:33:18.312 INFO:teuthology.orchestra.run.smithi031.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-22T08:33:18.321 INFO:teuthology.orchestra.run.smithi142.stdout:506 Cannot talk to daemon 2024-09-22T08:33:18.327 INFO:teuthology.orchestra.run.smithi031.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-22T08:33:18.335 INFO:teuthology.orchestra.run.smithi142.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-22T08:33:18.349 INFO:teuthology.orchestra.run.smithi142.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-22T08:33:18.387 INFO:teuthology.orchestra.run.smithi031.stderr:bash: line 1: ntpq: command not found 2024-09-22T08:33:18.391 INFO:teuthology.orchestra.run.smithi031.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-22T08:33:18.391 INFO:teuthology.orchestra.run.smithi031.stdout:=============================================================================== 2024-09-22T08:33:18.391 INFO:teuthology.orchestra.run.smithi031.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-22T08:33:18.391 INFO:teuthology.orchestra.run.smithi031.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-22T08:33:18.391 INFO:teuthology.orchestra.run.smithi031.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-22T08:33:18.391 INFO:teuthology.orchestra.run.smithi031.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-22T08:33:18.406 INFO:teuthology.orchestra.run.smithi142.stderr:bash: line 1: ntpq: command not found 2024-09-22T08:33:18.409 INFO:teuthology.orchestra.run.smithi142.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-22T08:33:18.409 INFO:teuthology.orchestra.run.smithi142.stdout:=============================================================================== 2024-09-22T08:33:18.409 INFO:teuthology.orchestra.run.smithi142.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-22T08:33:18.409 INFO:teuthology.orchestra.run.smithi142.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-22T08:33:18.409 INFO:teuthology.orchestra.run.smithi142.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-22T08:33:18.409 INFO:teuthology.orchestra.run.smithi142.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-22T08:33:18.410 INFO:teuthology.run_tasks:Running task install... 2024-09-22T08:33:18.421 DEBUG:teuthology.task.install:project ceph 2024-09-22T08:33:18.421 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '8852379c050c686f4605f33f0129009b2029ca9d'}} 2024-09-22T08:33:18.421 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': '8852379c050c686f4605f33f0129009b2029ca9d'} 2024-09-22T08:33:18.421 INFO:teuthology.task.install:Using flavor: default 2024-09-22T08:33:18.426 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-22T08:33:18.427 INFO:teuthology.task.install:extra packages: [] 2024-09-22T08:33:18.427 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '8852379c050c686f4605f33f0129009b2029ca9d', 'tag': None, 'wait_for_package': False} 2024-09-22T08:33:18.427 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8852379c050c686f4605f33f0129009b2029ca9d 2024-09-22T08:33:18.429 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '8852379c050c686f4605f33f0129009b2029ca9d', 'tag': None, 'wait_for_package': False} 2024-09-22T08:33:18.429 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8852379c050c686f4605f33f0129009b2029ca9d 2024-09-22T08:33:18.570 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-skoduri-cloud-restore/8852379c050c686f4605f33f0129009b2029ca9d/centos/9/flavors/default/ 2024-09-22T08:33:18.570 INFO:teuthology.task.install.rpm:Package version is 19.3.0-5106.g8852379c 2024-09-22T08:33:18.575 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-skoduri-cloud-restore/8852379c050c686f4605f33f0129009b2029ca9d/centos/9/flavors/default/ 2024-09-22T08:33:18.575 INFO:teuthology.task.install.rpm:Package version is 19.3.0-5106.g8852379c 2024-09-22T08:33:18.677 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-skoduri-cloud-restore/8852379c050c686f4605f33f0129009b2029ca9d/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-skoduri-cloud-restore/8852379c050c686f4605f33f0129009b2029ca9d/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-skoduri-cloud-restore/8852379c050c686f4605f33f0129009b2029ca9d/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-22T08:33:18.677 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-22T08:33:18.678 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-22T08:33:18.694 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-skoduri-cloud-restore/8852379c050c686f4605f33f0129009b2029ca9d/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-skoduri-cloud-restore/8852379c050c686f4605f33f0129009b2029ca9d/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-skoduri-cloud-restore/8852379c050c686f4605f33f0129009b2029ca9d/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-22T08:33:18.694 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-09-22T08:33:18.694 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-22T08:33:18.704 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-22T08:33:18.705 DEBUG:teuthology.orchestra.run.smithi031:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/8852379c050c686f4605f33f0129009b2029ca9d/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-22T08:33:18.720 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-22T08:33:18.720 DEBUG:teuthology.orchestra.run.smithi142:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/8852379c050c686f4605f33f0129009b2029ca9d/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-22T08:33:18.771 DEBUG:teuthology.orchestra.run.smithi031:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-22T08:33:18.786 DEBUG:teuthology.orchestra.run.smithi142:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-22T08:33:18.848 DEBUG:teuthology.orchestra.run.smithi031:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-22T08:33:18.861 DEBUG:teuthology.orchestra.run.smithi142:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-22T08:33:18.914 INFO:teuthology.orchestra.run.smithi031.stdout:check_obsoletes = 1 2024-09-22T08:33:18.915 DEBUG:teuthology.orchestra.run.smithi031:> sudo yum clean all 2024-09-22T08:33:18.926 INFO:teuthology.orchestra.run.smithi142.stdout:check_obsoletes = 1 2024-09-22T08:33:18.928 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum clean all 2024-09-22T08:33:19.159 INFO:teuthology.orchestra.run.smithi031.stdout:45 files removed 2024-09-22T08:33:19.161 INFO:teuthology.orchestra.run.smithi142.stdout:45 files removed 2024-09-22T08:33:19.187 DEBUG:teuthology.orchestra.run.smithi031:> sudo yum -y install ceph-radosgw 2024-09-22T08:33:19.188 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install ceph-radosgw 2024-09-22T08:33:19.738 INFO:teuthology.orchestra.run.smithi142.stdout:ceph packages for x86_64 317 kB/s | 84 kB 00:00 2024-09-22T08:33:19.749 INFO:teuthology.orchestra.run.smithi031.stdout:ceph packages for x86_64 324 kB/s | 84 kB 00:00 2024-09-22T08:33:20.024 INFO:teuthology.orchestra.run.smithi031.stdout:ceph noarch packages 106 kB/s | 24 kB 00:00 2024-09-22T08:33:20.030 INFO:teuthology.orchestra.run.smithi142.stdout:ceph noarch packages 97 kB/s | 24 kB 00:00 2024-09-22T08:33:20.300 INFO:teuthology.orchestra.run.smithi031.stdout:ceph source packages 8.2 kB/s | 1.9 kB 00:00 2024-09-22T08:33:20.306 INFO:teuthology.orchestra.run.smithi142.stdout:ceph source packages 8.1 kB/s | 1.9 kB 00:00 2024-09-22T08:33:20.814 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS Stream 9 - BaseOS 17 MB/s | 8.3 MB 00:00 2024-09-22T08:33:21.016 INFO:teuthology.orchestra.run.smithi031.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 8.3 MB 00:00 2024-09-22T08:33:22.715 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS Stream 9 - AppStream 25 MB/s | 20 MB 00:00 2024-09-22T08:33:23.418 INFO:teuthology.orchestra.run.smithi031.stdout:CentOS Stream 9 - AppStream 16 MB/s | 20 MB 00:01 2024-09-22T08:33:27.341 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS Stream 9 - CRB 8.2 MB/s | 6.5 MB 00:00 2024-09-22T08:33:28.702 INFO:teuthology.orchestra.run.smithi031.stdout:CentOS Stream 9 - CRB 5.5 MB/s | 6.5 MB 00:01 2024-09-22T08:33:28.884 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS Stream 9 - Extras packages 101 kB/s | 19 kB 00:00 2024-09-22T08:33:30.038 INFO:teuthology.orchestra.run.smithi142.stdout:Extra Packages for Enterprise Linux 22 MB/s | 23 MB 00:01 2024-09-22T08:33:31.252 INFO:teuthology.orchestra.run.smithi031.stdout:CentOS Stream 9 - Extras packages 15 kB/s | 19 kB 00:01 2024-09-22T08:33:32.131 INFO:teuthology.orchestra.run.smithi031.stdout:Extra Packages for Enterprise Linux 30 MB/s | 23 MB 00:00 2024-09-22T08:33:35.460 INFO:teuthology.orchestra.run.smithi142.stdout:lab-extras 28 kB/s | 1.7 kB 00:00 2024-09-22T08:33:37.686 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-09-22T08:33:37.690 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-22T08:33:37.690 INFO:teuthology.orchestra.run.smithi142.stdout: Package Arch Version Repository Size 2024-09-22T08:33:37.690 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-22T08:33:37.690 INFO:teuthology.orchestra.run.smithi142.stdout:Installing: 2024-09-22T08:33:37.690 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-radosgw x86_64 2:19.3.0-5106.g8852379c.el9 ceph 11 M 2024-09-22T08:33:37.690 INFO:teuthology.orchestra.run.smithi142.stdout:Upgrading: 2024-09-22T08:33:37.690 INFO:teuthology.orchestra.run.smithi142.stdout: librados2 x86_64 2:19.3.0-5106.g8852379c.el9 ceph 3.5 M 2024-09-22T08:33:37.690 INFO:teuthology.orchestra.run.smithi142.stdout: librbd1 x86_64 2:19.3.0-5106.g8852379c.el9 ceph 3.2 M 2024-09-22T08:33:37.690 INFO:teuthology.orchestra.run.smithi142.stdout:Installing dependencies: 2024-09-22T08:33:37.690 INFO:teuthology.orchestra.run.smithi142.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-22T08:33:37.690 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-base x86_64 2:19.3.0-5106.g8852379c.el9 ceph 5.5 M 2024-09-22T08:33:37.691 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-common x86_64 2:19.3.0-5106.g8852379c.el9 ceph 22 M 2024-09-22T08:33:37.691 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-selinux x86_64 2:19.3.0-5106.g8852379c.el9 ceph 25 k 2024-09-22T08:33:37.691 INFO:teuthology.orchestra.run.smithi142.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-22T08:33:37.691 INFO:teuthology.orchestra.run.smithi142.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-22T08:33:37.691 INFO:teuthology.orchestra.run.smithi142.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-22T08:33:37.691 INFO:teuthology.orchestra.run.smithi142.stdout: libcephfs2 x86_64 2:19.3.0-5106.g8852379c.el9 ceph 755 k 2024-09-22T08:33:37.691 INFO:teuthology.orchestra.run.smithi142.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-22T08:33:37.691 INFO:teuthology.orchestra.run.smithi142.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-22T08:33:37.691 INFO:teuthology.orchestra.run.smithi142.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-22T08:33:37.691 INFO:teuthology.orchestra.run.smithi142.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-22T08:33:37.691 INFO:teuthology.orchestra.run.smithi142.stdout: libradosstriper1 x86_64 2:19.3.0-5106.g8852379c.el9 ceph 508 k 2024-09-22T08:33:37.691 INFO:teuthology.orchestra.run.smithi142.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-22T08:33:37.691 INFO:teuthology.orchestra.run.smithi142.stdout: librgw2 x86_64 2:19.3.0-5106.g8852379c.el9 ceph 5.5 M 2024-09-22T08:33:37.691 INFO:teuthology.orchestra.run.smithi142.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-22T08:33:37.692 INFO:teuthology.orchestra.run.smithi142.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-22T08:33:37.692 INFO:teuthology.orchestra.run.smithi142.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-22T08:33:37.692 INFO:teuthology.orchestra.run.smithi142.stdout: python3-ceph-argparse x86_64 2:19.3.0-5106.g8852379c.el9 ceph 45 k 2024-09-22T08:33:37.692 INFO:teuthology.orchestra.run.smithi142.stdout: python3-ceph-common x86_64 2:19.3.0-5106.g8852379c.el9 ceph 148 k 2024-09-22T08:33:37.692 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cephfs x86_64 2:19.3.0-5106.g8852379c.el9 ceph 162 k 2024-09-22T08:33:37.692 INFO:teuthology.orchestra.run.smithi142.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-22T08:33:37.692 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rados x86_64 2:19.3.0-5106.g8852379c.el9 ceph 320 k 2024-09-22T08:33:37.692 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rbd x86_64 2:19.3.0-5106.g8852379c.el9 ceph 307 k 2024-09-22T08:33:37.692 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rgw x86_64 2:19.3.0-5106.g8852379c.el9 ceph 99 k 2024-09-22T08:33:37.692 INFO:teuthology.orchestra.run.smithi142.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-22T08:33:37.692 INFO:teuthology.orchestra.run.smithi142.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-22T08:33:37.692 INFO:teuthology.orchestra.run.smithi142.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-22T08:33:37.692 INFO:teuthology.orchestra.run.smithi142.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-22T08:33:37.693 INFO:teuthology.orchestra.run.smithi142.stdout:Installing weak dependencies: 2024-09-22T08:33:37.693 INFO:teuthology.orchestra.run.smithi142.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-22T08:33:37.693 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-22T08:33:37.693 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2024-09-22T08:33:37.693 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-22T08:33:37.693 INFO:teuthology.orchestra.run.smithi142.stdout:Install 31 Packages 2024-09-22T08:33:37.693 INFO:teuthology.orchestra.run.smithi142.stdout:Upgrade 2 Packages 2024-09-22T08:33:37.693 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-22T08:33:37.693 INFO:teuthology.orchestra.run.smithi142.stdout:Total download size: 62 M 2024-09-22T08:33:37.694 INFO:teuthology.orchestra.run.smithi142.stdout:Downloading Packages: 2024-09-22T08:33:37.870 INFO:teuthology.orchestra.run.smithi031.stdout:lab-extras 41 kB/s | 1.7 kB 00:00 2024-09-22T08:33:38.628 INFO:teuthology.orchestra.run.smithi142.stdout:(1/33): ceph-base-19.3.0-5106.g8852379c.el9.x86 11 MB/s | 5.5 MB 00:00 2024-09-22T08:33:38.712 INFO:teuthology.orchestra.run.smithi142.stdout:(2/33): ceph-selinux-19.3.0-5106.g8852379c.el9. 299 kB/s | 25 kB 00:00 2024-09-22T08:33:38.804 INFO:teuthology.orchestra.run.smithi142.stdout:(3/33): libcephfs2-19.3.0-5106.g8852379c.el9.x8 8.1 MB/s | 755 kB 00:00 2024-09-22T08:33:38.929 INFO:teuthology.orchestra.run.smithi142.stdout:(4/33): ceph-radosgw-19.3.0-5106.g8852379c.el9. 13 MB/s | 11 MB 00:00 2024-09-22T08:33:38.962 INFO:teuthology.orchestra.run.smithi142.stdout:(5/33): libradosstriper1-19.3.0-5106.g8852379c. 3.1 MB/s | 508 kB 00:00 2024-09-22T08:33:39.013 INFO:teuthology.orchestra.run.smithi142.stdout:(6/33): python3-ceph-argparse-19.3.0-5106.g8852 902 kB/s | 45 kB 00:00 2024-09-22T08:33:39.104 INFO:teuthology.orchestra.run.smithi142.stdout:(7/33): python3-ceph-common-19.3.0-5106.g885237 1.6 MB/s | 148 kB 00:00 2024-09-22T08:33:39.180 INFO:teuthology.orchestra.run.smithi142.stdout:(8/33): librgw2-19.3.0-5106.g8852379c.el9.x86_6 22 MB/s | 5.5 MB 00:00 2024-09-22T08:33:39.205 INFO:teuthology.orchestra.run.smithi142.stdout:(9/33): python3-cephfs-19.3.0-5106.g8852379c.el 1.6 MB/s | 162 kB 00:00 2024-09-22T08:33:39.230 INFO:teuthology.orchestra.run.smithi142.stdout:(10/33): python3-rados-19.3.0-5106.g8852379c.el 6.2 MB/s | 320 kB 00:00 2024-09-22T08:33:39.256 INFO:teuthology.orchestra.run.smithi142.stdout:(11/33): python3-rbd-19.3.0-5106.g8852379c.el9. 6.0 MB/s | 307 kB 00:00 2024-09-22T08:33:39.281 INFO:teuthology.orchestra.run.smithi142.stdout:(12/33): python3-rgw-19.3.0-5106.g8852379c.el9. 1.9 MB/s | 99 kB 00:00 2024-09-22T08:33:39.490 INFO:teuthology.orchestra.run.smithi142.stdout:(13/33): ceph-common-19.3.0-5106.g8852379c.el9. 16 MB/s | 22 MB 00:01 2024-09-22T08:33:39.582 INFO:teuthology.orchestra.run.smithi142.stdout:(14/33): boost-program-options-1.75.0-8.el9.x86 328 kB/s | 107 kB 00:00 2024-09-22T08:33:39.606 INFO:teuthology.orchestra.run.smithi142.stdout:(15/33): libnbd-1.20.2-2.el9.x86_64.rpm 524 kB/s | 171 kB 00:00 2024-09-22T08:33:39.632 INFO:teuthology.orchestra.run.smithi142.stdout:(16/33): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.1 MB/s | 160 kB 00:00 2024-09-22T08:33:39.649 INFO:teuthology.orchestra.run.smithi142.stdout:(17/33): librabbitmq-0.11.0-7.el9.x86_64.rpm 676 kB/s | 45 kB 00:00 2024-09-22T08:33:39.707 INFO:teuthology.orchestra.run.smithi142.stdout:(18/33): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.8 MB/s | 292 kB 00:00 2024-09-22T08:33:39.724 INFO:teuthology.orchestra.run.smithi142.stdout:(19/33): python3-prettytable-0.7.2-27.el9.noarc 562 kB/s | 42 kB 00:00 2024-09-22T08:33:39.750 INFO:teuthology.orchestra.run.smithi142.stdout:(20/33): librdkafka-1.6.1-102.el9.x86_64.rpm 5.5 MB/s | 662 kB 00:00 2024-09-22T08:33:39.775 INFO:teuthology.orchestra.run.smithi142.stdout:(21/33): qatlib-24.02.0-1.el9.x86_64.rpm 3.2 MB/s | 221 kB 00:00 2024-09-22T08:33:39.800 INFO:teuthology.orchestra.run.smithi142.stdout:(22/33): qatlib-service-24.02.0-1.el9.x86_64.rp 473 kB/s | 36 kB 00:00 2024-09-22T08:33:39.826 INFO:teuthology.orchestra.run.smithi142.stdout:(23/33): qatzip-libs-1.2.0-1.el9.x86_64.rpm 627 kB/s | 47 kB 00:00 2024-09-22T08:33:39.884 INFO:teuthology.orchestra.run.smithi142.stdout:(24/33): gperftools-libs-2.9.1-3.el9.x86_64.rpm 2.8 MB/s | 308 kB 00:00 2024-09-22T08:33:39.909 INFO:teuthology.orchestra.run.smithi142.stdout:(25/33): libarrow-doc-9.0.0-11.el9.noarch.rpm 379 kB/s | 26 kB 00:00 2024-09-22T08:33:39.934 INFO:teuthology.orchestra.run.smithi142.stdout:(26/33): liboath-2.6.7-2.el9.x86_64.rpm 971 kB/s | 49 kB 00:00 2024-09-22T08:33:39.968 INFO:teuthology.orchestra.run.smithi142.stdout:(27/33): libunwind-1.6.2-1.el9.x86_64.rpm 1.1 MB/s | 67 kB 00:00 2024-09-22T08:33:40.002 INFO:teuthology.orchestra.run.smithi142.stdout:(28/33): re2-20211101-20.el9.x86_64.rpm 5.6 MB/s | 191 kB 00:00 2024-09-22T08:33:40.044 INFO:teuthology.orchestra.run.smithi142.stdout:(29/33): parquet-libs-9.0.0-11.el9.x86_64.rpm 7.5 MB/s | 839 kB 00:00 2024-09-22T08:33:40.102 INFO:teuthology.orchestra.run.smithi142.stdout:(30/33): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-22T08:33:40.200 INFO:teuthology.orchestra.run.smithi031.stdout:Dependencies resolved. 2024-09-22T08:33:40.203 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2024-09-22T08:33:40.203 INFO:teuthology.orchestra.run.smithi031.stdout: Package Arch Version Repository Size 2024-09-22T08:33:40.204 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2024-09-22T08:33:40.204 INFO:teuthology.orchestra.run.smithi031.stdout:Installing: 2024-09-22T08:33:40.204 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-radosgw x86_64 2:19.3.0-5106.g8852379c.el9 ceph 11 M 2024-09-22T08:33:40.204 INFO:teuthology.orchestra.run.smithi031.stdout:Upgrading: 2024-09-22T08:33:40.204 INFO:teuthology.orchestra.run.smithi031.stdout: librados2 x86_64 2:19.3.0-5106.g8852379c.el9 ceph 3.5 M 2024-09-22T08:33:40.204 INFO:teuthology.orchestra.run.smithi031.stdout: librbd1 x86_64 2:19.3.0-5106.g8852379c.el9 ceph 3.2 M 2024-09-22T08:33:40.204 INFO:teuthology.orchestra.run.smithi031.stdout:Installing dependencies: 2024-09-22T08:33:40.204 INFO:teuthology.orchestra.run.smithi031.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-22T08:33:40.204 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-base x86_64 2:19.3.0-5106.g8852379c.el9 ceph 5.5 M 2024-09-22T08:33:40.204 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-common x86_64 2:19.3.0-5106.g8852379c.el9 ceph 22 M 2024-09-22T08:33:40.204 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-selinux x86_64 2:19.3.0-5106.g8852379c.el9 ceph 25 k 2024-09-22T08:33:40.204 INFO:teuthology.orchestra.run.smithi031.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-22T08:33:40.204 INFO:teuthology.orchestra.run.smithi031.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-22T08:33:40.205 INFO:teuthology.orchestra.run.smithi031.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-22T08:33:40.205 INFO:teuthology.orchestra.run.smithi031.stdout: libcephfs2 x86_64 2:19.3.0-5106.g8852379c.el9 ceph 755 k 2024-09-22T08:33:40.205 INFO:teuthology.orchestra.run.smithi031.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-22T08:33:40.205 INFO:teuthology.orchestra.run.smithi031.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-22T08:33:40.205 INFO:teuthology.orchestra.run.smithi031.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-22T08:33:40.205 INFO:teuthology.orchestra.run.smithi031.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-22T08:33:40.205 INFO:teuthology.orchestra.run.smithi031.stdout: libradosstriper1 x86_64 2:19.3.0-5106.g8852379c.el9 ceph 508 k 2024-09-22T08:33:40.205 INFO:teuthology.orchestra.run.smithi031.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-22T08:33:40.205 INFO:teuthology.orchestra.run.smithi031.stdout: librgw2 x86_64 2:19.3.0-5106.g8852379c.el9 ceph 5.5 M 2024-09-22T08:33:40.205 INFO:teuthology.orchestra.run.smithi031.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-22T08:33:40.205 INFO:teuthology.orchestra.run.smithi031.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-22T08:33:40.205 INFO:teuthology.orchestra.run.smithi031.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-22T08:33:40.205 INFO:teuthology.orchestra.run.smithi031.stdout: python3-ceph-argparse x86_64 2:19.3.0-5106.g8852379c.el9 ceph 45 k 2024-09-22T08:33:40.205 INFO:teuthology.orchestra.run.smithi031.stdout: python3-ceph-common x86_64 2:19.3.0-5106.g8852379c.el9 ceph 148 k 2024-09-22T08:33:40.206 INFO:teuthology.orchestra.run.smithi031.stdout: python3-cephfs x86_64 2:19.3.0-5106.g8852379c.el9 ceph 162 k 2024-09-22T08:33:40.206 INFO:teuthology.orchestra.run.smithi031.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-22T08:33:40.206 INFO:teuthology.orchestra.run.smithi031.stdout: python3-rados x86_64 2:19.3.0-5106.g8852379c.el9 ceph 320 k 2024-09-22T08:33:40.206 INFO:teuthology.orchestra.run.smithi031.stdout: python3-rbd x86_64 2:19.3.0-5106.g8852379c.el9 ceph 307 k 2024-09-22T08:33:40.206 INFO:teuthology.orchestra.run.smithi031.stdout: python3-rgw x86_64 2:19.3.0-5106.g8852379c.el9 ceph 99 k 2024-09-22T08:33:40.206 INFO:teuthology.orchestra.run.smithi031.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-22T08:33:40.206 INFO:teuthology.orchestra.run.smithi031.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-22T08:33:40.206 INFO:teuthology.orchestra.run.smithi031.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-22T08:33:40.206 INFO:teuthology.orchestra.run.smithi031.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-22T08:33:40.206 INFO:teuthology.orchestra.run.smithi031.stdout:Installing weak dependencies: 2024-09-22T08:33:40.206 INFO:teuthology.orchestra.run.smithi031.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-22T08:33:40.206 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-22T08:33:40.206 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction Summary 2024-09-22T08:33:40.206 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2024-09-22T08:33:40.207 INFO:teuthology.orchestra.run.smithi031.stdout:Install 31 Packages 2024-09-22T08:33:40.207 INFO:teuthology.orchestra.run.smithi031.stdout:Upgrade 2 Packages 2024-09-22T08:33:40.207 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-22T08:33:40.207 INFO:teuthology.orchestra.run.smithi031.stdout:Total download size: 62 M 2024-09-22T08:33:40.207 INFO:teuthology.orchestra.run.smithi031.stdout:Downloading Packages: 2024-09-22T08:33:40.219 INFO:teuthology.orchestra.run.smithi142.stdout:(31/33): libarrow-9.0.0-11.el9.x86_64.rpm 11 MB/s | 4.4 MB 00:00 2024-09-22T08:33:40.286 INFO:teuthology.orchestra.run.smithi142.stdout:(32/33): librados2-19.3.0-5106.g8852379c.el9.x8 14 MB/s | 3.5 MB 00:00 2024-09-22T08:33:40.345 INFO:teuthology.orchestra.run.smithi142.stdout:(33/33): librbd1-19.3.0-5106.g8852379c.el9.x86_ 13 MB/s | 3.2 MB 00:00 2024-09-22T08:33:40.349 INFO:teuthology.orchestra.run.smithi142.stdout:-------------------------------------------------------------------------------- 2024-09-22T08:33:40.350 INFO:teuthology.orchestra.run.smithi142.stdout:Total 23 MB/s | 62 MB 00:02 2024-09-22T08:33:40.463 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction check 2024-09-22T08:33:40.501 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction check succeeded. 2024-09-22T08:33:40.501 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction test 2024-09-22T08:33:40.930 INFO:teuthology.orchestra.run.smithi031.stdout:(1/33): ceph-base-19.3.0-5106.g8852379c.el9.x86 10 MB/s | 5.5 MB 00:00 2024-09-22T08:33:40.980 INFO:teuthology.orchestra.run.smithi031.stdout:(2/33): ceph-selinux-19.3.0-5106.g8852379c.el9. 507 kB/s | 25 kB 00:00 2024-09-22T08:33:41.080 INFO:teuthology.orchestra.run.smithi031.stdout:(3/33): libcephfs2-19.3.0-5106.g8852379c.el9.x8 7.4 MB/s | 755 kB 00:00 2024-09-22T08:33:41.180 INFO:teuthology.orchestra.run.smithi031.stdout:(4/33): libradosstriper1-19.3.0-5106.g8852379c. 5.0 MB/s | 508 kB 00:00 2024-09-22T08:33:41.240 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction test succeeded. 2024-09-22T08:33:41.240 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction 2024-09-22T08:33:41.306 INFO:teuthology.orchestra.run.smithi031.stdout:(5/33): ceph-radosgw-19.3.0-5106.g8852379c.el9. 12 MB/s | 11 MB 00:00 2024-09-22T08:33:41.348 INFO:teuthology.orchestra.run.smithi031.stdout:(6/33): python3-ceph-argparse-19.3.0-5106.g8852 1.1 MB/s | 45 kB 00:00 2024-09-22T08:33:41.573 INFO:teuthology.orchestra.run.smithi031.stdout:(7/33): ceph-common-19.3.0-5106.g8852379c.el9.x 19 MB/s | 22 MB 00:01 2024-09-22T08:33:41.598 INFO:teuthology.orchestra.run.smithi031.stdout:(8/33): python3-ceph-common-19.3.0-5106.g885237 593 kB/s | 148 kB 00:00 2024-09-22T08:33:41.623 INFO:teuthology.orchestra.run.smithi031.stdout:(9/33): python3-cephfs-19.3.0-5106.g8852379c.el 3.2 MB/s | 162 kB 00:00 2024-09-22T08:33:41.699 INFO:teuthology.orchestra.run.smithi031.stdout:(10/33): librgw2-19.3.0-5106.g8852379c.el9.x86_ 11 MB/s | 5.5 MB 00:00 2024-09-22T08:33:41.724 INFO:teuthology.orchestra.run.smithi031.stdout:(11/33): python3-rados-19.3.0-5106.g8852379c.el 2.5 MB/s | 320 kB 00:00 2024-09-22T08:33:41.749 INFO:teuthology.orchestra.run.smithi031.stdout:(12/33): python3-rbd-19.3.0-5106.g8852379c.el9. 2.4 MB/s | 307 kB 00:00 2024-09-22T08:33:41.775 INFO:teuthology.orchestra.run.smithi031.stdout:(13/33): python3-rgw-19.3.0-5106.g8852379c.el9. 1.3 MB/s | 99 kB 00:00 2024-09-22T08:33:41.917 INFO:teuthology.orchestra.run.smithi031.stdout:(14/33): boost-program-options-1.75.0-8.el9.x86 557 kB/s | 107 kB 00:00 2024-09-22T08:33:41.942 INFO:teuthology.orchestra.run.smithi031.stdout:(15/33): libnbd-1.20.2-2.el9.x86_64.rpm 886 kB/s | 171 kB 00:00 2024-09-22T08:33:41.967 INFO:teuthology.orchestra.run.smithi031.stdout:(16/33): libpmemobj-1.12.1-1.el9.x86_64.rpm 832 kB/s | 160 kB 00:00 2024-09-22T08:33:41.992 INFO:teuthology.orchestra.run.smithi031.stdout:(17/33): librabbitmq-0.11.0-7.el9.x86_64.rpm 599 kB/s | 45 kB 00:00 2024-09-22T08:33:42.051 INFO:teuthology.orchestra.run.smithi031.stdout:(18/33): python3-prettytable-0.7.2-27.el9.noarc 728 kB/s | 42 kB 00:00 2024-09-22T08:33:42.109 INFO:teuthology.orchestra.run.smithi031.stdout:(19/33): librdkafka-1.6.1-102.el9.x86_64.rpm 3.9 MB/s | 662 kB 00:00 2024-09-22T08:33:42.135 INFO:teuthology.orchestra.run.smithi031.stdout:(20/33): qatlib-24.02.0-1.el9.x86_64.rpm 2.6 MB/s | 221 kB 00:00 2024-09-22T08:33:42.160 INFO:teuthology.orchestra.run.smithi031.stdout:(21/33): lttng-ust-2.12.0-6.el9.x86_64.rpm 1.7 MB/s | 292 kB 00:00 2024-09-22T08:33:42.185 INFO:teuthology.orchestra.run.smithi031.stdout:(22/33): qatlib-service-24.02.0-1.el9.x86_64.rp 475 kB/s | 36 kB 00:00 2024-09-22T08:33:42.210 INFO:teuthology.orchestra.run.smithi031.stdout:(23/33): qatzip-libs-1.2.0-1.el9.x86_64.rpm 629 kB/s | 47 kB 00:00 2024-09-22T08:33:42.269 INFO:teuthology.orchestra.run.smithi031.stdout:(24/33): gperftools-libs-2.9.1-3.el9.x86_64.rpm 2.8 MB/s | 308 kB 00:00 2024-09-22T08:33:42.294 INFO:teuthology.orchestra.run.smithi031.stdout:(25/33): liboath-2.6.7-2.el9.x86_64.rpm 2.1 MB/s | 49 kB 00:00 2024-09-22T08:33:42.320 INFO:teuthology.orchestra.run.smithi031.stdout:(26/33): libarrow-doc-9.0.0-11.el9.noarch.rpm 279 kB/s | 26 kB 00:00 2024-09-22T08:33:42.345 INFO:teuthology.orchestra.run.smithi031.stdout:(27/33): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-09-22T08:33:42.370 INFO:teuthology.orchestra.run.smithi031.stdout:(28/33): re2-20211101-20.el9.x86_64.rpm 7.5 MB/s | 191 kB 00:00 2024-09-22T08:33:42.412 INFO:teuthology.orchestra.run.smithi031.stdout:(29/33): parquet-libs-9.0.0-11.el9.x86_64.rpm 8.9 MB/s | 839 kB 00:00 2024-09-22T08:33:42.479 INFO:teuthology.orchestra.run.smithi031.stdout:(30/33): thrift-0.15.0-2.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-09-22T08:33:42.579 INFO:teuthology.orchestra.run.smithi031.stdout:(31/33): libarrow-9.0.0-11.el9.x86_64.rpm 11 MB/s | 4.4 MB 00:00 2024-09-22T08:33:42.646 INFO:teuthology.orchestra.run.smithi031.stdout:(32/33): librados2-19.3.0-5106.g8852379c.el9.x8 15 MB/s | 3.5 MB 00:00 2024-09-22T08:33:42.738 INFO:teuthology.orchestra.run.smithi031.stdout:(33/33): librbd1-19.3.0-5106.g8852379c.el9.x86_ 13 MB/s | 3.2 MB 00:00 2024-09-22T08:33:42.743 INFO:teuthology.orchestra.run.smithi031.stdout:-------------------------------------------------------------------------------- 2024-09-22T08:33:42.743 INFO:teuthology.orchestra.run.smithi031.stdout:Total 24 MB/s | 62 MB 00:02 2024-09-22T08:33:42.833 INFO:teuthology.orchestra.run.smithi142.stdout: Preparing : 1/1 2024-09-22T08:33:42.861 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction check 2024-09-22T08:33:42.903 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction check succeeded. 2024-09-22T08:33:42.903 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction test 2024-09-22T08:33:42.920 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/35 2024-09-22T08:33:42.949 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/35 2024-09-22T08:33:42.975 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/35 2024-09-22T08:33:42.997 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 4/35 2024-09-22T08:33:43.018 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 4/35 2024-09-22T08:33:43.216 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 5/35 2024-09-22T08:33:43.270 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 5/35 2024-09-22T08:33:43.612 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction test succeeded. 2024-09-22T08:33:43.613 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction 2024-09-22T08:33:43.669 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/35 2024-09-22T08:33:43.726 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : librados2-2:19.3.0-5106.g8852379c.el9.x86_64 7/35 2024-09-22T08:33:43.810 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: librados2-2:19.3.0-5106.g8852379c.el9.x86_64 7/35 2024-09-22T08:33:43.901 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-rados-2:19.3.0-5106.g8852379c.el9.x86_64 8/35 2024-09-22T08:33:43.927 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libcephfs2-2:19.3.0-5106.g8852379c.el9.x86_64 9/35 2024-09-22T08:33:43.991 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: libcephfs2-2:19.3.0-5106.g8852379c.el9.x86_64 9/35 2024-09-22T08:33:44.027 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : liboath-2.6.7-2.el9.x86_64 10/35 2024-09-22T08:33:44.071 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-ceph-argparse-2:19.3.0-5106.g8852379c.el9. 11/35 2024-09-22T08:33:44.142 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-cephfs-2:19.3.0-5106.g8852379c.el9.x86_64 12/35 2024-09-22T08:33:44.171 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libradosstriper1-2:19.3.0-5106.g8852379c.el9.x86_6 13/35 2024-09-22T08:33:44.235 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: libradosstriper1-2:19.3.0-5106.g8852379c.el9.x86_6 13/35 2024-09-22T08:33:44.278 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 14/35 2024-09-22T08:33:44.388 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : re2-1:20211101-20.el9.x86_64 15/35 2024-09-22T08:33:44.420 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 16/35 2024-09-22T08:33:44.462 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/35 2024-09-22T08:33:44.494 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 18/35 2024-09-22T08:33:44.523 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 19/35 2024-09-22T08:33:44.563 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 20/35 2024-09-22T08:33:44.604 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 21/35 2024-09-22T08:33:44.920 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 22/35 2024-09-22T08:33:44.961 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : librbd1-2:19.3.0-5106.g8852379c.el9.x86_64 23/35 2024-09-22T08:33:45.052 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: librbd1-2:19.3.0-5106.g8852379c.el9.x86_64 23/35 2024-09-22T08:33:45.083 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-rbd-2:19.3.0-5106.g8852379c.el9.x86_64 24/35 2024-09-22T08:33:45.118 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 25/35 2024-09-22T08:33:45.174 INFO:teuthology.orchestra.run.smithi031.stdout: Preparing : 1/1 2024-09-22T08:33:45.255 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/35 2024-09-22T08:33:45.285 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/35 2024-09-22T08:33:45.310 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/35 2024-09-22T08:33:45.332 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 4/35 2024-09-22T08:33:45.361 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 4/35 2024-09-22T08:33:45.570 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 5/35 2024-09-22T08:33:45.617 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 26/35 2024-09-22T08:33:45.623 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 5/35 2024-09-22T08:33:45.647 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : librgw2-2:19.3.0-5106.g8852379c.el9.x86_64 27/35 2024-09-22T08:33:45.718 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: librgw2-2:19.3.0-5106.g8852379c.el9.x86_64 27/35 2024-09-22T08:33:45.798 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-rgw-2:19.3.0-5106.g8852379c.el9.x86_64 28/35 2024-09-22T08:33:45.841 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-ceph-common-2:19.3.0-5106.g8852379c.el9.x8 29/35 2024-09-22T08:33:45.995 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/35 2024-09-22T08:33:46.094 INFO:teuthology.orchestra.run.smithi031.stdout: Upgrading : librados2-2:19.3.0-5106.g8852379c.el9.x86_64 7/35 2024-09-22T08:33:46.187 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: librados2-2:19.3.0-5106.g8852379c.el9.x86_64 7/35 2024-09-22T08:33:46.278 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-rados-2:19.3.0-5106.g8852379c.el9.x86_64 8/35 2024-09-22T08:33:46.323 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : libcephfs2-2:19.3.0-5106.g8852379c.el9.x86_64 9/35 2024-09-22T08:33:46.392 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: libcephfs2-2:19.3.0-5106.g8852379c.el9.x86_64 9/35 2024-09-22T08:33:46.429 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : liboath-2.6.7-2.el9.x86_64 10/35 2024-09-22T08:33:46.474 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-ceph-argparse-2:19.3.0-5106.g8852379c.el9. 11/35 2024-09-22T08:33:46.552 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-cephfs-2:19.3.0-5106.g8852379c.el9.x86_64 12/35 2024-09-22T08:33:46.581 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : libradosstriper1-2:19.3.0-5106.g8852379c.el9.x86_6 13/35 2024-09-22T08:33:46.629 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: libradosstriper1-2:19.3.0-5106.g8852379c.el9.x86_6 13/35 2024-09-22T08:33:46.663 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 14/35 2024-09-22T08:33:46.775 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : re2-1:20211101-20.el9.x86_64 15/35 2024-09-22T08:33:46.806 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 16/35 2024-09-22T08:33:46.847 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/35 2024-09-22T08:33:46.887 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 18/35 2024-09-22T08:33:46.917 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 19/35 2024-09-22T08:33:46.954 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 20/35 2024-09-22T08:33:46.987 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 21/35 2024-09-22T08:33:47.323 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 22/35 2024-09-22T08:33:47.371 INFO:teuthology.orchestra.run.smithi031.stdout: Upgrading : librbd1-2:19.3.0-5106.g8852379c.el9.x86_64 23/35 2024-09-22T08:33:47.471 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: librbd1-2:19.3.0-5106.g8852379c.el9.x86_64 23/35 2024-09-22T08:33:47.501 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-rbd-2:19.3.0-5106.g8852379c.el9.x86_64 24/35 2024-09-22T08:33:47.546 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 25/35 2024-09-22T08:33:48.066 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 26/35 2024-09-22T08:33:48.090 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : librgw2-2:19.3.0-5106.g8852379c.el9.x86_64 27/35 2024-09-22T08:33:48.125 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-common-2:19.3.0-5106.g8852379c.el9.x86_64 30/35 2024-09-22T08:33:48.154 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: librgw2-2:19.3.0-5106.g8852379c.el9.x86_64 27/35 2024-09-22T08:33:48.172 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-common-2:19.3.0-5106.g8852379c.el9.x86_64 30/35 2024-09-22T08:33:48.239 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-rgw-2:19.3.0-5106.g8852379c.el9.x86_64 28/35 2024-09-22T08:33:48.276 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-ceph-common-2:19.3.0-5106.g8852379c.el9.x8 29/35 2024-09-22T08:33:48.745 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-common-2:19.3.0-5106.g8852379c.el9.x86_64 30/35 2024-09-22T08:33:48.784 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-base-2:19.3.0-5106.g8852379c.el9.x86_64 31/35 2024-09-22T08:33:48.875 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-base-2:19.3.0-5106.g8852379c.el9.x86_64 31/35 2024-09-22T08:33:48.876 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-22T08:33:48.876 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-22T08:33:48.876 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-22T08:33:48.919 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-selinux-2:19.3.0-5106.g8852379c.el9.x86_64 32/35 2024-09-22T08:33:50.908 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-common-2:19.3.0-5106.g8852379c.el9.x86_64 30/35 2024-09-22T08:33:50.938 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-common-2:19.3.0-5106.g8852379c.el9.x86_64 30/35 2024-09-22T08:33:51.545 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-common-2:19.3.0-5106.g8852379c.el9.x86_64 30/35 2024-09-22T08:33:51.583 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-base-2:19.3.0-5106.g8852379c.el9.x86_64 31/35 2024-09-22T08:33:51.691 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-base-2:19.3.0-5106.g8852379c.el9.x86_64 31/35 2024-09-22T08:33:51.691 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-22T08:33:51.691 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-22T08:33:51.691 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-22T08:33:51.718 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-selinux-2:19.3.0-5106.g8852379c.el9.x86_64 32/35 2024-09-22T08:33:59.100 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-selinux-2:19.3.0-5106.g8852379c.el9.x86_64 32/35 2024-09-22T08:33:59.100 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /sys 2024-09-22T08:33:59.100 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /proc 2024-09-22T08:33:59.100 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /mnt 2024-09-22T08:33:59.100 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /var/tmp 2024-09-22T08:33:59.100 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /home 2024-09-22T08:33:59.100 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /root 2024-09-22T08:33:59.100 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /tmp 2024-09-22T08:33:59.100 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-22T08:34:00.127 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-radosgw-2:19.3.0-5106.g8852379c.el9.x86_64 33/35 2024-09-22T08:34:00.153 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-5106.g8852379c.el9.x86_64 33/35 2024-09-22T08:34:00.153 INFO:teuthology.orchestra.run.smithi142.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-22T08:34:00.153 INFO:teuthology.orchestra.run.smithi142.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-22T08:34:00.153 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-22T08:34:00.153 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-22T08:34:00.153 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-22T08:34:00.154 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 34/35 2024-09-22T08:34:00.237 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 34/35 2024-09-22T08:34:00.238 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 35/35 2024-09-22T08:34:01.320 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 35/35 2024-09-22T08:34:01.320 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-base-2:19.3.0-5106.g8852379c.el9.x86_64 1/35 2024-09-22T08:34:01.320 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-common-2:19.3.0-5106.g8852379c.el9.x86_64 2/35 2024-09-22T08:34:01.320 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-radosgw-2:19.3.0-5106.g8852379c.el9.x86_64 3/35 2024-09-22T08:34:01.320 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-selinux-2:19.3.0-5106.g8852379c.el9.x86_64 4/35 2024-09-22T08:34:01.320 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libcephfs2-2:19.3.0-5106.g8852379c.el9.x86_64 5/35 2024-09-22T08:34:01.321 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libradosstriper1-2:19.3.0-5106.g8852379c.el9.x86_6 6/35 2024-09-22T08:34:01.321 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librgw2-2:19.3.0-5106.g8852379c.el9.x86_64 7/35 2024-09-22T08:34:01.321 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-ceph-argparse-2:19.3.0-5106.g8852379c.el9. 8/35 2024-09-22T08:34:01.321 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-ceph-common-2:19.3.0-5106.g8852379c.el9.x8 9/35 2024-09-22T08:34:01.321 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-cephfs-2:19.3.0-5106.g8852379c.el9.x86_64 10/35 2024-09-22T08:34:01.321 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-rados-2:19.3.0-5106.g8852379c.el9.x86_64 11/35 2024-09-22T08:34:01.321 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-rbd-2:19.3.0-5106.g8852379c.el9.x86_64 12/35 2024-09-22T08:34:01.321 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-rgw-2:19.3.0-5106.g8852379c.el9.x86_64 13/35 2024-09-22T08:34:01.321 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/35 2024-09-22T08:34:01.321 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 15/35 2024-09-22T08:34:01.321 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 16/35 2024-09-22T08:34:01.321 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 17/35 2024-09-22T08:34:01.321 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 18/35 2024-09-22T08:34:01.321 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 19/35 2024-09-22T08:34:01.322 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 20/35 2024-09-22T08:34:01.322 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 21/35 2024-09-22T08:34:01.322 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 22/35 2024-09-22T08:34:01.322 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 23/35 2024-09-22T08:34:01.322 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 24/35 2024-09-22T08:34:01.322 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 25/35 2024-09-22T08:34:01.322 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 26/35 2024-09-22T08:34:01.322 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 27/35 2024-09-22T08:34:01.322 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 28/35 2024-09-22T08:34:01.323 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 29/35 2024-09-22T08:34:01.323 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : re2-1:20211101-20.el9.x86_64 30/35 2024-09-22T08:34:01.323 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 31/35 2024-09-22T08:34:01.323 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librados2-2:19.3.0-5106.g8852379c.el9.x86_64 32/35 2024-09-22T08:34:01.323 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 33/35 2024-09-22T08:34:01.323 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librbd1-2:19.3.0-5106.g8852379c.el9.x86_64 34/35 2024-09-22T08:34:02.169 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 35/35 2024-09-22T08:34:02.169 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-22T08:34:02.169 INFO:teuthology.orchestra.run.smithi142.stdout:Upgraded: 2024-09-22T08:34:02.169 INFO:teuthology.orchestra.run.smithi142.stdout: librados2-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:34:02.169 INFO:teuthology.orchestra.run.smithi142.stdout: librbd1-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:34:02.169 INFO:teuthology.orchestra.run.smithi142.stdout:Installed: 2024-09-22T08:34:02.169 INFO:teuthology.orchestra.run.smithi142.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-22T08:34:02.169 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-base-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:34:02.169 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-common-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:34:02.169 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-radosgw-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:34:02.169 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-selinux-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:34:02.170 INFO:teuthology.orchestra.run.smithi142.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-22T08:34:02.170 INFO:teuthology.orchestra.run.smithi142.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-22T08:34:02.170 INFO:teuthology.orchestra.run.smithi142.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-22T08:34:02.170 INFO:teuthology.orchestra.run.smithi142.stdout: libcephfs2-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:34:02.170 INFO:teuthology.orchestra.run.smithi142.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-22T08:34:02.170 INFO:teuthology.orchestra.run.smithi142.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-22T08:34:02.170 INFO:teuthology.orchestra.run.smithi142.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-22T08:34:02.170 INFO:teuthology.orchestra.run.smithi142.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-22T08:34:02.170 INFO:teuthology.orchestra.run.smithi142.stdout: libradosstriper1-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:34:02.170 INFO:teuthology.orchestra.run.smithi142.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-22T08:34:02.170 INFO:teuthology.orchestra.run.smithi142.stdout: librgw2-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:34:02.170 INFO:teuthology.orchestra.run.smithi142.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-22T08:34:02.170 INFO:teuthology.orchestra.run.smithi142.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-22T08:34:02.170 INFO:teuthology.orchestra.run.smithi142.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-22T08:34:02.171 INFO:teuthology.orchestra.run.smithi142.stdout: python3-ceph-argparse-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:34:02.171 INFO:teuthology.orchestra.run.smithi142.stdout: python3-ceph-common-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:34:02.171 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cephfs-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:34:02.171 INFO:teuthology.orchestra.run.smithi142.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-22T08:34:02.171 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rados-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:34:02.171 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rbd-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:34:02.171 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rgw-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:34:02.171 INFO:teuthology.orchestra.run.smithi142.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-22T08:34:02.171 INFO:teuthology.orchestra.run.smithi142.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-22T08:34:02.171 INFO:teuthology.orchestra.run.smithi142.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-22T08:34:02.171 INFO:teuthology.orchestra.run.smithi142.stdout: re2-1:20211101-20.el9.x86_64 2024-09-22T08:34:02.171 INFO:teuthology.orchestra.run.smithi142.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-22T08:34:02.171 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-22T08:34:02.171 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-09-22T08:34:02.515 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-selinux-2:19.3.0-5106.g8852379c.el9.x86_64 32/35 2024-09-22T08:34:02.515 INFO:teuthology.orchestra.run.smithi031.stdout:skipping the directory /sys 2024-09-22T08:34:02.515 INFO:teuthology.orchestra.run.smithi031.stdout:skipping the directory /proc 2024-09-22T08:34:02.515 INFO:teuthology.orchestra.run.smithi031.stdout:skipping the directory /mnt 2024-09-22T08:34:02.515 INFO:teuthology.orchestra.run.smithi031.stdout:skipping the directory /var/tmp 2024-09-22T08:34:02.515 INFO:teuthology.orchestra.run.smithi031.stdout:skipping the directory /home 2024-09-22T08:34:02.515 INFO:teuthology.orchestra.run.smithi031.stdout:skipping the directory /root 2024-09-22T08:34:02.516 INFO:teuthology.orchestra.run.smithi031.stdout:skipping the directory /tmp 2024-09-22T08:34:02.516 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-22T08:34:02.609 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install ceph-test 2024-09-22T08:34:03.202 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:00:28 ago on Sun 22 Sep 2024 08:33:35 AM UTC. 2024-09-22T08:34:03.333 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-09-22T08:34:03.333 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-22T08:34:03.333 INFO:teuthology.orchestra.run.smithi142.stdout: Package Arch Version Repository Size 2024-09-22T08:34:03.333 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-22T08:34:03.333 INFO:teuthology.orchestra.run.smithi142.stdout:Installing: 2024-09-22T08:34:03.333 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-test x86_64 2:19.3.0-5106.g8852379c.el9 ceph 46 M 2024-09-22T08:34:03.333 INFO:teuthology.orchestra.run.smithi142.stdout:Installing dependencies: 2024-09-22T08:34:03.334 INFO:teuthology.orchestra.run.smithi142.stdout: libcephsqlite x86_64 2:19.3.0-5106.g8852379c.el9 ceph 161 k 2024-09-22T08:34:03.334 INFO:teuthology.orchestra.run.smithi142.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-22T08:34:03.334 INFO:teuthology.orchestra.run.smithi142.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-22T08:34:03.334 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-22T08:34:03.334 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2024-09-22T08:34:03.334 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-22T08:34:03.334 INFO:teuthology.orchestra.run.smithi142.stdout:Install 4 Packages 2024-09-22T08:34:03.334 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-22T08:34:03.335 INFO:teuthology.orchestra.run.smithi142.stdout:Total download size: 46 M 2024-09-22T08:34:03.335 INFO:teuthology.orchestra.run.smithi142.stdout:Installed size: 201 M 2024-09-22T08:34:03.335 INFO:teuthology.orchestra.run.smithi142.stdout:Downloading Packages: 2024-09-22T08:34:03.549 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-radosgw-2:19.3.0-5106.g8852379c.el9.x86_64 33/35 2024-09-22T08:34:03.576 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-5106.g8852379c.el9.x86_64 33/35 2024-09-22T08:34:03.576 INFO:teuthology.orchestra.run.smithi031.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-22T08:34:03.576 INFO:teuthology.orchestra.run.smithi031.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-22T08:34:03.576 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-22T08:34:03.576 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-22T08:34:03.576 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-22T08:34:03.578 INFO:teuthology.orchestra.run.smithi031.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 34/35 2024-09-22T08:34:03.591 INFO:teuthology.orchestra.run.smithi142.stdout:(1/4): socat-1.7.4.1-6.el9.x86_64.rpm 1.5 MB/s | 304 kB 00:00 2024-09-22T08:34:03.617 INFO:teuthology.orchestra.run.smithi142.stdout:(2/4): libcephsqlite-19.3.0-5106.g8852379c.el9. 715 kB/s | 161 kB 00:00 2024-09-22T08:34:03.642 INFO:teuthology.orchestra.run.smithi142.stdout:(3/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-22T08:34:03.668 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 34/35 2024-09-22T08:34:03.668 INFO:teuthology.orchestra.run.smithi031.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 35/35 2024-09-22T08:34:04.876 INFO:teuthology.orchestra.run.smithi142.stdout:(4/4): ceph-test-19.3.0-5106.g8852379c.el9.x86_ 31 MB/s | 46 MB 00:01 2024-09-22T08:34:04.878 INFO:teuthology.orchestra.run.smithi142.stdout:-------------------------------------------------------------------------------- 2024-09-22T08:34:04.878 INFO:teuthology.orchestra.run.smithi142.stdout:Total 30 MB/s | 46 MB 00:01 2024-09-22T08:34:04.905 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction check 2024-09-22T08:34:04.926 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction check succeeded. 2024-09-22T08:34:04.926 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction test 2024-09-22T08:34:04.960 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 35/35 2024-09-22T08:34:04.960 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-base-2:19.3.0-5106.g8852379c.el9.x86_64 1/35 2024-09-22T08:34:04.960 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-common-2:19.3.0-5106.g8852379c.el9.x86_64 2/35 2024-09-22T08:34:04.960 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-radosgw-2:19.3.0-5106.g8852379c.el9.x86_64 3/35 2024-09-22T08:34:04.960 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-selinux-2:19.3.0-5106.g8852379c.el9.x86_64 4/35 2024-09-22T08:34:04.960 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libcephfs2-2:19.3.0-5106.g8852379c.el9.x86_64 5/35 2024-09-22T08:34:04.960 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libradosstriper1-2:19.3.0-5106.g8852379c.el9.x86_6 6/35 2024-09-22T08:34:04.960 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : librgw2-2:19.3.0-5106.g8852379c.el9.x86_64 7/35 2024-09-22T08:34:04.960 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-ceph-argparse-2:19.3.0-5106.g8852379c.el9. 8/35 2024-09-22T08:34:04.960 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-ceph-common-2:19.3.0-5106.g8852379c.el9.x8 9/35 2024-09-22T08:34:04.961 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-cephfs-2:19.3.0-5106.g8852379c.el9.x86_64 10/35 2024-09-22T08:34:04.961 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-rados-2:19.3.0-5106.g8852379c.el9.x86_64 11/35 2024-09-22T08:34:04.961 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-rbd-2:19.3.0-5106.g8852379c.el9.x86_64 12/35 2024-09-22T08:34:04.961 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-rgw-2:19.3.0-5106.g8852379c.el9.x86_64 13/35 2024-09-22T08:34:04.961 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/35 2024-09-22T08:34:04.961 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 15/35 2024-09-22T08:34:04.961 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 16/35 2024-09-22T08:34:04.961 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 17/35 2024-09-22T08:34:04.961 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 18/35 2024-09-22T08:34:04.961 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 19/35 2024-09-22T08:34:04.961 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 20/35 2024-09-22T08:34:04.961 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 21/35 2024-09-22T08:34:04.961 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 22/35 2024-09-22T08:34:04.961 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 23/35 2024-09-22T08:34:04.962 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 24/35 2024-09-22T08:34:04.962 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 25/35 2024-09-22T08:34:04.962 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 26/35 2024-09-22T08:34:04.962 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 27/35 2024-09-22T08:34:04.962 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 28/35 2024-09-22T08:34:04.962 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 29/35 2024-09-22T08:34:04.962 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : re2-1:20211101-20.el9.x86_64 30/35 2024-09-22T08:34:04.962 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 31/35 2024-09-22T08:34:04.962 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : librados2-2:19.3.0-5106.g8852379c.el9.x86_64 32/35 2024-09-22T08:34:04.962 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 33/35 2024-09-22T08:34:04.962 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : librbd1-2:19.3.0-5106.g8852379c.el9.x86_64 34/35 2024-09-22T08:34:05.281 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction test succeeded. 2024-09-22T08:34:05.281 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction 2024-09-22T08:34:05.802 INFO:teuthology.orchestra.run.smithi142.stdout: Preparing : 1/1 2024-09-22T08:34:05.876 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 35/35 2024-09-22T08:34:05.876 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-22T08:34:05.876 INFO:teuthology.orchestra.run.smithi031.stdout:Upgraded: 2024-09-22T08:34:05.876 INFO:teuthology.orchestra.run.smithi031.stdout: librados2-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:34:05.876 INFO:teuthology.orchestra.run.smithi031.stdout: librbd1-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:34:05.876 INFO:teuthology.orchestra.run.smithi031.stdout:Installed: 2024-09-22T08:34:05.877 INFO:teuthology.orchestra.run.smithi031.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-22T08:34:05.877 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-base-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:34:05.877 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-common-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:34:05.877 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-radosgw-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:34:05.877 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-selinux-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:34:05.877 INFO:teuthology.orchestra.run.smithi031.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-22T08:34:05.877 INFO:teuthology.orchestra.run.smithi031.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-22T08:34:05.877 INFO:teuthology.orchestra.run.smithi031.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-22T08:34:05.877 INFO:teuthology.orchestra.run.smithi031.stdout: libcephfs2-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:34:05.877 INFO:teuthology.orchestra.run.smithi031.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-22T08:34:05.877 INFO:teuthology.orchestra.run.smithi031.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-22T08:34:05.877 INFO:teuthology.orchestra.run.smithi031.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-22T08:34:05.877 INFO:teuthology.orchestra.run.smithi031.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-22T08:34:05.877 INFO:teuthology.orchestra.run.smithi031.stdout: libradosstriper1-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:34:05.877 INFO:teuthology.orchestra.run.smithi031.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-22T08:34:05.878 INFO:teuthology.orchestra.run.smithi031.stdout: librgw2-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:34:05.878 INFO:teuthology.orchestra.run.smithi031.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-22T08:34:05.878 INFO:teuthology.orchestra.run.smithi031.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-22T08:34:05.878 INFO:teuthology.orchestra.run.smithi031.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-22T08:34:05.878 INFO:teuthology.orchestra.run.smithi031.stdout: python3-ceph-argparse-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:34:05.878 INFO:teuthology.orchestra.run.smithi031.stdout: python3-ceph-common-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:34:05.878 INFO:teuthology.orchestra.run.smithi031.stdout: python3-cephfs-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:34:05.878 INFO:teuthology.orchestra.run.smithi031.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-22T08:34:05.878 INFO:teuthology.orchestra.run.smithi031.stdout: python3-rados-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:34:05.878 INFO:teuthology.orchestra.run.smithi031.stdout: python3-rbd-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:34:05.878 INFO:teuthology.orchestra.run.smithi031.stdout: python3-rgw-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:34:05.878 INFO:teuthology.orchestra.run.smithi031.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-22T08:34:05.878 INFO:teuthology.orchestra.run.smithi031.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-22T08:34:05.879 INFO:teuthology.orchestra.run.smithi031.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-22T08:34:05.879 INFO:teuthology.orchestra.run.smithi031.stdout: re2-1:20211101-20.el9.x86_64 2024-09-22T08:34:05.879 INFO:teuthology.orchestra.run.smithi031.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-22T08:34:05.879 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-22T08:34:05.879 INFO:teuthology.orchestra.run.smithi031.stdout:Complete! 2024-09-22T08:34:05.883 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-09-22T08:34:05.924 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 2/4 2024-09-22T08:34:05.952 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libcephsqlite-2:19.3.0-5106.g8852379c.el9.x86_64 3/4 2024-09-22T08:34:06.231 DEBUG:teuthology.orchestra.run.smithi031:> sudo yum -y install ceph-test 2024-09-22T08:34:06.831 INFO:teuthology.orchestra.run.smithi031.stdout:Last metadata expiration check: 0:00:29 ago on Sun 22 Sep 2024 08:33:37 AM UTC. 2024-09-22T08:34:06.966 INFO:teuthology.orchestra.run.smithi031.stdout:Dependencies resolved. 2024-09-22T08:34:06.967 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2024-09-22T08:34:06.967 INFO:teuthology.orchestra.run.smithi031.stdout: Package Arch Version Repository Size 2024-09-22T08:34:06.967 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2024-09-22T08:34:06.967 INFO:teuthology.orchestra.run.smithi031.stdout:Installing: 2024-09-22T08:34:06.967 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-test x86_64 2:19.3.0-5106.g8852379c.el9 ceph 46 M 2024-09-22T08:34:06.967 INFO:teuthology.orchestra.run.smithi031.stdout:Installing dependencies: 2024-09-22T08:34:06.967 INFO:teuthology.orchestra.run.smithi031.stdout: libcephsqlite x86_64 2:19.3.0-5106.g8852379c.el9 ceph 161 k 2024-09-22T08:34:06.968 INFO:teuthology.orchestra.run.smithi031.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-22T08:34:06.968 INFO:teuthology.orchestra.run.smithi031.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-22T08:34:06.968 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-22T08:34:06.968 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction Summary 2024-09-22T08:34:06.968 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2024-09-22T08:34:06.968 INFO:teuthology.orchestra.run.smithi031.stdout:Install 4 Packages 2024-09-22T08:34:06.968 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-22T08:34:06.968 INFO:teuthology.orchestra.run.smithi031.stdout:Total download size: 46 M 2024-09-22T08:34:06.969 INFO:teuthology.orchestra.run.smithi031.stdout:Installed size: 201 M 2024-09-22T08:34:06.969 INFO:teuthology.orchestra.run.smithi031.stdout:Downloading Packages: 2024-09-22T08:34:07.414 INFO:teuthology.orchestra.run.smithi031.stdout:(1/4): libcephsqlite-19.3.0-5106.g8852379c.el9. 529 kB/s | 161 kB 00:00 2024-09-22T08:34:07.897 INFO:teuthology.orchestra.run.smithi031.stdout:(2/4): socat-1.7.4.1-6.el9.x86_64.rpm 386 kB/s | 304 kB 00:00 2024-09-22T08:34:08.072 INFO:teuthology.orchestra.run.smithi031.stdout:(3/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 97 kB/s | 64 kB 00:00 2024-09-22T08:34:10.331 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: libcephsqlite-2:19.3.0-5106.g8852379c.el9.x86_64 3/4 2024-09-22T08:34:10.410 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-test-2:19.3.0-5106.g8852379c.el9.x86_64 4/4 2024-09-22T08:34:12.860 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-test-2:19.3.0-5106.g8852379c.el9.x86_64 4/4 2024-09-22T08:34:12.860 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-test-2:19.3.0-5106.g8852379c.el9.x86_64 1/4 2024-09-22T08:34:12.860 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libcephsqlite-2:19.3.0-5106.g8852379c.el9.x86_64 2/4 2024-09-22T08:34:12.860 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 3/4 2024-09-22T08:34:13.200 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-09-22T08:34:13.200 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-22T08:34:13.200 INFO:teuthology.orchestra.run.smithi142.stdout:Installed: 2024-09-22T08:34:13.200 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-test-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:34:13.201 INFO:teuthology.orchestra.run.smithi142.stdout: libcephsqlite-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:34:13.201 INFO:teuthology.orchestra.run.smithi142.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-22T08:34:13.201 INFO:teuthology.orchestra.run.smithi142.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-22T08:34:13.201 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-22T08:34:13.201 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-09-22T08:34:13.502 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install ceph 2024-09-22T08:34:14.120 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:00:39 ago on Sun 22 Sep 2024 08:33:35 AM UTC. 2024-09-22T08:34:14.273 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-09-22T08:34:14.276 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-22T08:34:14.276 INFO:teuthology.orchestra.run.smithi142.stdout: Package Arch Version Repository Size 2024-09-22T08:34:14.276 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-22T08:34:14.276 INFO:teuthology.orchestra.run.smithi142.stdout:Installing: 2024-09-22T08:34:14.276 INFO:teuthology.orchestra.run.smithi142.stdout: ceph x86_64 2:19.3.0-5106.g8852379c.el9 ceph 6.6 k 2024-09-22T08:34:14.276 INFO:teuthology.orchestra.run.smithi142.stdout:Installing dependencies: 2024-09-22T08:34:14.276 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mds x86_64 2:19.3.0-5106.g8852379c.el9 ceph 2.4 M 2024-09-22T08:34:14.276 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr x86_64 2:19.3.0-5106.g8852379c.el9 ceph 1.5 M 2024-09-22T08:34:14.277 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-modules-core noarch 2:19.3.0-5106.g8852379c.el9 ceph-noarch 292 k 2024-09-22T08:34:14.277 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mon x86_64 2:19.3.0-5106.g8852379c.el9 ceph 4.8 M 2024-09-22T08:34:14.277 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-osd x86_64 2:19.3.0-5106.g8852379c.el9 ceph 17 M 2024-09-22T08:34:14.277 INFO:teuthology.orchestra.run.smithi142.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-22T08:34:14.277 INFO:teuthology.orchestra.run.smithi142.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-22T08:34:14.277 INFO:teuthology.orchestra.run.smithi142.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-22T08:34:14.277 INFO:teuthology.orchestra.run.smithi142.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-22T08:34:14.277 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-22T08:34:14.277 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-22T08:34:14.277 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-22T08:34:14.277 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-22T08:34:14.277 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-22T08:34:14.278 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-22T08:34:14.278 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-collections 2024-09-22T08:34:14.278 INFO:teuthology.orchestra.run.smithi142.stdout: noarch 3.0.0-8.el9 epel 23 k 2024-09-22T08:34:14.278 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-22T08:34:14.278 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-22T08:34:14.278 INFO:teuthology.orchestra.run.smithi142.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-22T08:34:14.278 INFO:teuthology.orchestra.run.smithi142.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-22T08:34:14.278 INFO:teuthology.orchestra.run.smithi142.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-22T08:34:14.278 INFO:teuthology.orchestra.run.smithi142.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-22T08:34:14.278 INFO:teuthology.orchestra.run.smithi142.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-22T08:34:14.278 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-22T08:34:14.278 INFO:teuthology.orchestra.run.smithi142.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-22T08:34:14.278 INFO:teuthology.orchestra.run.smithi142.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-22T08:34:14.278 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-22T08:34:14.279 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-22T08:34:14.279 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-22T08:34:14.279 INFO:teuthology.orchestra.run.smithi142.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-22T08:34:14.279 INFO:teuthology.orchestra.run.smithi142.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-22T08:34:14.279 INFO:teuthology.orchestra.run.smithi142.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-22T08:34:14.279 INFO:teuthology.orchestra.run.smithi142.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-22T08:34:14.279 INFO:teuthology.orchestra.run.smithi142.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-22T08:34:14.279 INFO:teuthology.orchestra.run.smithi142.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-22T08:34:14.279 INFO:teuthology.orchestra.run.smithi142.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-22T08:34:14.279 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-22T08:34:14.279 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2024-09-22T08:34:14.279 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-22T08:34:14.279 INFO:teuthology.orchestra.run.smithi142.stdout:Install 37 Packages 2024-09-22T08:34:14.279 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-22T08:34:14.280 INFO:teuthology.orchestra.run.smithi142.stdout:Total download size: 31 M 2024-09-22T08:34:14.280 INFO:teuthology.orchestra.run.smithi142.stdout:Installed size: 109 M 2024-09-22T08:34:14.280 INFO:teuthology.orchestra.run.smithi142.stdout:Downloading Packages: 2024-09-22T08:34:14.747 INFO:teuthology.orchestra.run.smithi031.stdout:(4/4): ceph-test-19.3.0-5106.g8852379c.el9.x86_ 6.0 MB/s | 46 MB 00:07 2024-09-22T08:34:14.749 INFO:teuthology.orchestra.run.smithi031.stdout:-------------------------------------------------------------------------------- 2024-09-22T08:34:14.749 INFO:teuthology.orchestra.run.smithi031.stdout:Total 5.9 MB/s | 46 MB 00:07 2024-09-22T08:34:14.751 INFO:teuthology.orchestra.run.smithi142.stdout:(1/37): ceph-19.3.0-5106.g8852379c.el9.x86_64.r 47 kB/s | 6.6 kB 00:00 2024-09-22T08:34:14.776 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction check 2024-09-22T08:34:14.799 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction check succeeded. 2024-09-22T08:34:14.799 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction test 2024-09-22T08:34:15.144 INFO:teuthology.orchestra.run.smithi142.stdout:(2/37): ceph-mgr-19.3.0-5106.g8852379c.el9.x86_ 2.9 MB/s | 1.5 MB 00:00 2024-09-22T08:34:15.171 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction test succeeded. 2024-09-22T08:34:15.172 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction 2024-09-22T08:34:15.294 INFO:teuthology.orchestra.run.smithi142.stdout:(3/37): ceph-mds-19.3.0-5106.g8852379c.el9.x86_ 3.5 MB/s | 2.4 MB 00:00 2024-09-22T08:34:15.369 INFO:teuthology.orchestra.run.smithi142.stdout:(4/37): ceph-mgr-modules-core-19.3.0-5106.g8852 3.8 MB/s | 292 kB 00:00 2024-09-22T08:34:15.545 INFO:teuthology.orchestra.run.smithi142.stdout:(5/37): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.4 MB/s | 253 kB 00:00 2024-09-22T08:34:15.628 INFO:teuthology.orchestra.run.smithi142.stdout:(6/37): ceph-mon-19.3.0-5106.g8852379c.el9.x86_ 5.5 MB/s | 4.8 MB 00:00 2024-09-22T08:34:15.703 INFO:teuthology.orchestra.run.smithi142.stdout:(7/37): python3-cryptography-36.0.1-4.el9.x86_6 7.7 MB/s | 1.2 MB 00:00 2024-09-22T08:34:15.733 INFO:teuthology.orchestra.run.smithi031.stdout: Preparing : 1/1 2024-09-22T08:34:15.754 INFO:teuthology.orchestra.run.smithi142.stdout:(8/37): python3-pycparser-2.20-6.el9.noarch.rpm 2.6 MB/s | 135 kB 00:00 2024-09-22T08:34:15.779 INFO:teuthology.orchestra.run.smithi142.stdout:(9/37): python3-ply-3.11-14.el9.noarch.rpm 708 kB/s | 106 kB 00:00 2024-09-22T08:34:15.799 INFO:teuthology.orchestra.run.smithi142.stdout:(10/37): python3-requests-2.25.1-8.el9.noarch.r 2.7 MB/s | 125 kB 00:00 2024-09-22T08:34:15.824 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-09-22T08:34:15.858 INFO:teuthology.orchestra.run.smithi142.stdout:(11/37): python3-urllib3-1.26.5-6.el9.noarch.rp 2.7 MB/s | 215 kB 00:00 2024-09-22T08:34:15.863 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 2/4 2024-09-22T08:34:15.891 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : libcephsqlite-2:19.3.0-5106.g8852379c.el9.x86_64 3/4 2024-09-22T08:34:15.933 INFO:teuthology.orchestra.run.smithi142.stdout:(12/37): lua-5.4.4-4.el9.x86_64.rpm 1.4 MB/s | 188 kB 00:00 2024-09-22T08:34:15.975 INFO:teuthology.orchestra.run.smithi142.stdout:(13/37): python3-markupsafe-1.1.1-12.el9.x86_64 835 kB/s | 35 kB 00:00 2024-09-22T08:34:16.000 INFO:teuthology.orchestra.run.smithi142.stdout:(14/37): python3-mako-1.1.4-6.el9.noarch.rpm 1.2 MB/s | 172 kB 00:00 2024-09-22T08:34:16.026 INFO:teuthology.orchestra.run.smithi142.stdout:(15/37): python3-packaging-20.9-5.el9.noarch.rp 1.5 MB/s | 77 kB 00:00 2024-09-22T08:34:16.059 INFO:teuthology.orchestra.run.smithi142.stdout:(16/37): python3-pytz-2021.1-5.el9.noarch.rpm 868 kB/s | 51 kB 00:00 2024-09-22T08:34:16.085 INFO:teuthology.orchestra.run.smithi142.stdout:(17/37): python3-toml-0.10.2-6.el9.noarch.rpm 711 kB/s | 42 kB 00:00 2024-09-22T08:34:16.127 INFO:teuthology.orchestra.run.smithi142.stdout:(18/37): luarocks-3.9.2-5.el9.noarch.rpm 3.6 MB/s | 151 kB 00:00 2024-09-22T08:34:16.152 INFO:teuthology.orchestra.run.smithi142.stdout:(19/37): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 1.7 MB/s | 43 kB 00:00 2024-09-22T08:34:16.177 INFO:teuthology.orchestra.run.smithi142.stdout:(20/37): lua-devel-5.4.4-4.el9.x86_64.rpm 190 kB/s | 22 kB 00:00 2024-09-22T08:34:16.211 INFO:teuthology.orchestra.run.smithi142.stdout:(21/37): python3-cheroot-8.6.0-4.el9.noarch.rpm 2.9 MB/s | 172 kB 00:00 2024-09-22T08:34:16.236 INFO:teuthology.orchestra.run.smithi142.stdout:(22/37): python3-jaraco-8.2.1-3.el9.noarch.rpm 458 kB/s | 11 kB 00:00 2024-09-22T08:34:16.262 INFO:teuthology.orchestra.run.smithi142.stdout:(23/37): python3-jaraco-classes-3.2.1-5.el9.noa 703 kB/s | 18 kB 00:00 2024-09-22T08:34:16.287 INFO:teuthology.orchestra.run.smithi142.stdout:(24/37): python3-jaraco-collections-3.0.0-8.el9 931 kB/s | 23 kB 00:00 2024-09-22T08:34:16.312 INFO:teuthology.orchestra.run.smithi142.stdout:(25/37): python3-jaraco-functools-3.5.0-2.el9.n 778 kB/s | 19 kB 00:00 2024-09-22T08:34:16.346 INFO:teuthology.orchestra.run.smithi142.stdout:(26/37): python3-cherrypy-18.6.1-2.el9.noarch.r 2.1 MB/s | 358 kB 00:00 2024-09-22T08:34:16.371 INFO:teuthology.orchestra.run.smithi142.stdout:(27/37): python3-jaraco-text-3.2.0-6.el9.noarch 335 kB/s | 20 kB 00:00 2024-09-22T08:34:16.396 INFO:teuthology.orchestra.run.smithi142.stdout:(28/37): python3-logutils-0.3.5-21.el9.noarch.r 920 kB/s | 46 kB 00:00 2024-09-22T08:34:16.421 INFO:teuthology.orchestra.run.smithi142.stdout:(29/37): python3-more-itertools-8.12.0-2.el9.no 1.5 MB/s | 79 kB 00:00 2024-09-22T08:34:16.447 INFO:teuthology.orchestra.run.smithi142.stdout:(30/37): python3-portend-3.1.0-2.el9.noarch.rpm 653 kB/s | 16 kB 00:00 2024-09-22T08:34:16.481 INFO:teuthology.orchestra.run.smithi142.stdout:(31/37): python3-pecan-1.4.2-3.el9.noarch.rpm 3.2 MB/s | 272 kB 00:00 2024-09-22T08:34:16.506 INFO:teuthology.orchestra.run.smithi142.stdout:(32/37): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.5 MB/s | 90 kB 00:00 2024-09-22T08:34:16.531 INFO:teuthology.orchestra.run.smithi142.stdout:(33/37): python3-tempora-5.0.0-2.el9.noarch.rpm 714 kB/s | 36 kB 00:00 2024-09-22T08:34:16.556 INFO:teuthology.orchestra.run.smithi142.stdout:(34/37): python3-webob-1.8.8-2.el9.noarch.rpm 4.5 MB/s | 230 kB 00:00 2024-09-22T08:34:16.582 INFO:teuthology.orchestra.run.smithi142.stdout:(35/37): python3-zc-lockfile-2.0-10.el9.noarch. 794 kB/s | 20 kB 00:00 2024-09-22T08:34:16.607 INFO:teuthology.orchestra.run.smithi142.stdout:(36/37): python3-werkzeug-2.0.3-3.el9.1.noarch. 5.5 MB/s | 427 kB 00:00 2024-09-22T08:34:16.774 INFO:teuthology.orchestra.run.smithi142.stdout:(37/37): ceph-osd-19.3.0-5106.g8852379c.el9.x86 11 MB/s | 17 MB 00:01 2024-09-22T08:34:16.777 INFO:teuthology.orchestra.run.smithi142.stdout:-------------------------------------------------------------------------------- 2024-09-22T08:34:16.777 INFO:teuthology.orchestra.run.smithi142.stdout:Total 12 MB/s | 31 MB 00:02 2024-09-22T08:34:16.922 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction check 2024-09-22T08:34:16.962 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction check succeeded. 2024-09-22T08:34:16.962 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction test 2024-09-22T08:34:17.445 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction test succeeded. 2024-09-22T08:34:17.445 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction 2024-09-22T08:34:18.825 INFO:teuthology.orchestra.run.smithi142.stdout: Preparing : 1/1 2024-09-22T08:34:18.910 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/37 2024-09-22T08:34:18.943 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/37 2024-09-22T08:34:18.971 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/37 2024-09-22T08:34:19.042 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/37 2024-09-22T08:34:19.086 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : luarocks-3.9.2-5.el9.noarch 5/37 2024-09-22T08:34:19.119 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/37 2024-09-22T08:34:19.211 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/37 2024-09-22T08:34:19.297 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/37 2024-09-22T08:34:19.347 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 9/37 2024-09-22T08:34:19.382 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/37 2024-09-22T08:34:19.412 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/37 2024-09-22T08:34:19.446 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/37 2024-09-22T08:34:19.479 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/37 2024-09-22T08:34:19.520 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/37 2024-09-22T08:34:19.572 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/37 2024-09-22T08:34:19.606 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/37 2024-09-22T08:34:19.663 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/37 2024-09-22T08:34:19.695 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-packaging-20.9-5.el9.noarch 18/37 2024-09-22T08:34:19.767 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 19/37 2024-09-22T08:34:19.915 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 20/37 2024-09-22T08:34:20.003 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 21/37 2024-09-22T08:34:20.056 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 22/37 2024-09-22T08:34:20.095 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 23/37 2024-09-22T08:34:20.143 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-ply-3.11-14.el9.noarch 24/37 2024-09-22T08:34:20.198 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 25/37 2024-09-22T08:34:20.394 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 26/37 2024-09-22T08:34:20.440 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 27/37 2024-09-22T08:34:20.510 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 28/37 2024-09-22T08:34:20.529 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: libcephsqlite-2:19.3.0-5106.g8852379c.el9.x86_64 3/4 2024-09-22T08:34:20.598 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 29/37 2024-09-22T08:34:20.607 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-test-2:19.3.0-5106.g8852379c.el9.x86_64 4/4 2024-09-22T08:34:20.640 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 30/37 2024-09-22T08:34:20.767 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 31/37 2024-09-22T08:34:20.929 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-5106.g8852379c.el9. 32/37 2024-09-22T08:34:20.958 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mgr-2:19.3.0-5106.g8852379c.el9.x86_64 33/37 2024-09-22T08:34:20.984 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mgr-2:19.3.0-5106.g8852379c.el9.x86_64 33/37 2024-09-22T08:34:20.984 INFO:teuthology.orchestra.run.smithi142.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-22T08:34:20.984 INFO:teuthology.orchestra.run.smithi142.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-22T08:34:20.984 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-22T08:34:20.984 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-22T08:34:20.985 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-22T08:34:22.467 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-osd-2:19.3.0-5106.g8852379c.el9.x86_64 34/37 2024-09-22T08:34:22.494 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-osd-2:19.3.0-5106.g8852379c.el9.x86_64 34/37 2024-09-22T08:34:22.494 INFO:teuthology.orchestra.run.smithi142.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-22T08:34:22.494 INFO:teuthology.orchestra.run.smithi142.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-22T08:34:22.494 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-22T08:34:22.495 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-22T08:34:22.495 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-22T08:34:22.878 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-test-2:19.3.0-5106.g8852379c.el9.x86_64 4/4 2024-09-22T08:34:22.878 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-test-2:19.3.0-5106.g8852379c.el9.x86_64 1/4 2024-09-22T08:34:22.878 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libcephsqlite-2:19.3.0-5106.g8852379c.el9.x86_64 2/4 2024-09-22T08:34:22.878 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 3/4 2024-09-22T08:34:22.943 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mon-2:19.3.0-5106.g8852379c.el9.x86_64 35/37 2024-09-22T08:34:22.967 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mon-2:19.3.0-5106.g8852379c.el9.x86_64 35/37 2024-09-22T08:34:22.967 INFO:teuthology.orchestra.run.smithi142.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-22T08:34:22.967 INFO:teuthology.orchestra.run.smithi142.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-22T08:34:22.967 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-22T08:34:22.967 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-22T08:34:22.967 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-22T08:34:23.210 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mds-2:19.3.0-5106.g8852379c.el9.x86_64 36/37 2024-09-22T08:34:23.234 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mds-2:19.3.0-5106.g8852379c.el9.x86_64 36/37 2024-09-22T08:34:23.234 INFO:teuthology.orchestra.run.smithi142.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-22T08:34:23.234 INFO:teuthology.orchestra.run.smithi142.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-22T08:34:23.234 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-22T08:34:23.234 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-22T08:34:23.234 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-22T08:34:23.296 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-09-22T08:34:23.296 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-22T08:34:23.296 INFO:teuthology.orchestra.run.smithi031.stdout:Installed: 2024-09-22T08:34:23.296 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-test-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:34:23.296 INFO:teuthology.orchestra.run.smithi031.stdout: libcephsqlite-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:34:23.297 INFO:teuthology.orchestra.run.smithi031.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-22T08:34:23.297 INFO:teuthology.orchestra.run.smithi031.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-22T08:34:23.297 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-22T08:34:23.297 INFO:teuthology.orchestra.run.smithi031.stdout:Complete! 2024-09-22T08:34:23.299 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-2:19.3.0-5106.g8852379c.el9.x86_64 37/37 2024-09-22T08:34:23.583 DEBUG:teuthology.orchestra.run.smithi031:> sudo yum -y install ceph 2024-09-22T08:34:24.186 INFO:teuthology.orchestra.run.smithi031.stdout:Last metadata expiration check: 0:00:47 ago on Sun 22 Sep 2024 08:33:37 AM UTC. 2024-09-22T08:34:24.331 INFO:teuthology.orchestra.run.smithi031.stdout:Dependencies resolved. 2024-09-22T08:34:24.333 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2024-09-22T08:34:24.334 INFO:teuthology.orchestra.run.smithi031.stdout: Package Arch Version Repository Size 2024-09-22T08:34:24.334 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2024-09-22T08:34:24.334 INFO:teuthology.orchestra.run.smithi031.stdout:Installing: 2024-09-22T08:34:24.334 INFO:teuthology.orchestra.run.smithi031.stdout: ceph x86_64 2:19.3.0-5106.g8852379c.el9 ceph 6.6 k 2024-09-22T08:34:24.334 INFO:teuthology.orchestra.run.smithi031.stdout:Installing dependencies: 2024-09-22T08:34:24.334 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mds x86_64 2:19.3.0-5106.g8852379c.el9 ceph 2.4 M 2024-09-22T08:34:24.334 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mgr x86_64 2:19.3.0-5106.g8852379c.el9 ceph 1.5 M 2024-09-22T08:34:24.334 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mgr-modules-core noarch 2:19.3.0-5106.g8852379c.el9 ceph-noarch 292 k 2024-09-22T08:34:24.334 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mon x86_64 2:19.3.0-5106.g8852379c.el9 ceph 4.8 M 2024-09-22T08:34:24.334 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-osd x86_64 2:19.3.0-5106.g8852379c.el9 ceph 17 M 2024-09-22T08:34:24.334 INFO:teuthology.orchestra.run.smithi031.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-22T08:34:24.334 INFO:teuthology.orchestra.run.smithi031.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-22T08:34:24.335 INFO:teuthology.orchestra.run.smithi031.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-22T08:34:24.335 INFO:teuthology.orchestra.run.smithi031.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-22T08:34:24.335 INFO:teuthology.orchestra.run.smithi031.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-22T08:34:24.335 INFO:teuthology.orchestra.run.smithi031.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-22T08:34:24.335 INFO:teuthology.orchestra.run.smithi031.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-22T08:34:24.335 INFO:teuthology.orchestra.run.smithi031.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-22T08:34:24.335 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-22T08:34:24.335 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-22T08:34:24.335 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jaraco-collections 2024-09-22T08:34:24.335 INFO:teuthology.orchestra.run.smithi031.stdout: noarch 3.0.0-8.el9 epel 23 k 2024-09-22T08:34:24.335 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-22T08:34:24.335 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-22T08:34:24.335 INFO:teuthology.orchestra.run.smithi031.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-22T08:34:24.335 INFO:teuthology.orchestra.run.smithi031.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-22T08:34:24.336 INFO:teuthology.orchestra.run.smithi031.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-22T08:34:24.336 INFO:teuthology.orchestra.run.smithi031.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-22T08:34:24.336 INFO:teuthology.orchestra.run.smithi031.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-22T08:34:24.336 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-22T08:34:24.336 INFO:teuthology.orchestra.run.smithi031.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-22T08:34:24.336 INFO:teuthology.orchestra.run.smithi031.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-22T08:34:24.336 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-22T08:34:24.336 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-22T08:34:24.336 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-22T08:34:24.336 INFO:teuthology.orchestra.run.smithi031.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-22T08:34:24.336 INFO:teuthology.orchestra.run.smithi031.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-22T08:34:24.336 INFO:teuthology.orchestra.run.smithi031.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-22T08:34:24.336 INFO:teuthology.orchestra.run.smithi031.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-22T08:34:24.336 INFO:teuthology.orchestra.run.smithi031.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-22T08:34:24.336 INFO:teuthology.orchestra.run.smithi031.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-22T08:34:24.337 INFO:teuthology.orchestra.run.smithi031.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-22T08:34:24.337 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-22T08:34:24.337 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction Summary 2024-09-22T08:34:24.337 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2024-09-22T08:34:24.337 INFO:teuthology.orchestra.run.smithi031.stdout:Install 37 Packages 2024-09-22T08:34:24.337 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-22T08:34:24.337 INFO:teuthology.orchestra.run.smithi031.stdout:Total download size: 31 M 2024-09-22T08:34:24.338 INFO:teuthology.orchestra.run.smithi031.stdout:Installed size: 109 M 2024-09-22T08:34:24.338 INFO:teuthology.orchestra.run.smithi031.stdout:Downloading Packages: 2024-09-22T08:34:24.764 INFO:teuthology.orchestra.run.smithi031.stdout:(1/37): ceph-19.3.0-5106.g8852379c.el9.x86_64.r 55 kB/s | 6.6 kB 00:00 2024-09-22T08:34:24.981 INFO:teuthology.orchestra.run.smithi031.stdout:(2/37): ceph-mgr-19.3.0-5106.g8852379c.el9.x86_ 4.5 MB/s | 1.5 MB 00:00 2024-09-22T08:34:25.001 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-2:19.3.0-5106.g8852379c.el9.x86_64 37/37 2024-09-22T08:34:25.002 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-2:19.3.0-5106.g8852379c.el9.x86_64 1/37 2024-09-22T08:34:25.002 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mds-2:19.3.0-5106.g8852379c.el9.x86_64 2/37 2024-09-22T08:34:25.002 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mgr-2:19.3.0-5106.g8852379c.el9.x86_64 3/37 2024-09-22T08:34:25.002 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mon-2:19.3.0-5106.g8852379c.el9.x86_64 4/37 2024-09-22T08:34:25.002 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-osd-2:19.3.0-5106.g8852379c.el9.x86_64 5/37 2024-09-22T08:34:25.002 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-5106.g8852379c.el9. 6/37 2024-09-22T08:34:25.002 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/37 2024-09-22T08:34:25.002 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/37 2024-09-22T08:34:25.002 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/37 2024-09-22T08:34:25.002 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/37 2024-09-22T08:34:25.002 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/37 2024-09-22T08:34:25.002 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/37 2024-09-22T08:34:25.002 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/37 2024-09-22T08:34:25.003 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/37 2024-09-22T08:34:25.003 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/37 2024-09-22T08:34:25.003 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 16/37 2024-09-22T08:34:25.003 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 17/37 2024-09-22T08:34:25.003 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 18/37 2024-09-22T08:34:25.003 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 19/37 2024-09-22T08:34:25.003 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 20/37 2024-09-22T08:34:25.003 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 21/37 2024-09-22T08:34:25.003 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 22/37 2024-09-22T08:34:25.003 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 23/37 2024-09-22T08:34:25.003 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 24/37 2024-09-22T08:34:25.003 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 25/37 2024-09-22T08:34:25.003 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 26/37 2024-09-22T08:34:25.003 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 27/37 2024-09-22T08:34:25.004 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 28/37 2024-09-22T08:34:25.004 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 29/37 2024-09-22T08:34:25.004 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 30/37 2024-09-22T08:34:25.004 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 31/37 2024-09-22T08:34:25.004 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 32/37 2024-09-22T08:34:25.004 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 33/37 2024-09-22T08:34:25.004 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 34/37 2024-09-22T08:34:25.004 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 35/37 2024-09-22T08:34:25.004 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 36/37 2024-09-22T08:34:25.022 INFO:teuthology.orchestra.run.smithi031.stdout:(3/37): ceph-mds-19.3.0-5106.g8852379c.el9.x86_ 6.3 MB/s | 2.4 MB 00:00 2024-09-22T08:34:25.115 INFO:teuthology.orchestra.run.smithi031.stdout:(4/37): ceph-mon-19.3.0-5106.g8852379c.el9.x86_ 14 MB/s | 4.8 MB 00:00 2024-09-22T08:34:25.140 INFO:teuthology.orchestra.run.smithi031.stdout:(5/37): ceph-mgr-modules-core-19.3.0-5106.g8852 2.4 MB/s | 292 kB 00:00 2024-09-22T08:34:25.540 INFO:teuthology.orchestra.run.smithi031.stdout:(6/37): ceph-osd-19.3.0-5106.g8852379c.el9.x86_ 31 MB/s | 17 MB 00:00 2024-09-22T08:34:25.970 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 37/37 2024-09-22T08:34:25.971 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-22T08:34:25.971 INFO:teuthology.orchestra.run.smithi142.stdout:Installed: 2024-09-22T08:34:25.971 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:34:25.971 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mds-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:34:25.971 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:34:25.971 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-modules-core-2:19.3.0-5106.g8852379c.el9.noarch 2024-09-22T08:34:25.971 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mon-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:34:25.971 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-osd-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:34:25.971 INFO:teuthology.orchestra.run.smithi142.stdout: lua-5.4.4-4.el9.x86_64 2024-09-22T08:34:25.971 INFO:teuthology.orchestra.run.smithi142.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-22T08:34:25.971 INFO:teuthology.orchestra.run.smithi142.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-22T08:34:25.971 INFO:teuthology.orchestra.run.smithi142.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-22T08:34:25.971 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-22T08:34:25.972 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-22T08:34:25.972 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-22T08:34:25.972 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-22T08:34:25.972 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-22T08:34:25.972 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-22T08:34:25.972 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-22T08:34:25.972 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-22T08:34:25.972 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-22T08:34:25.972 INFO:teuthology.orchestra.run.smithi142.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-22T08:34:25.972 INFO:teuthology.orchestra.run.smithi142.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-22T08:34:25.972 INFO:teuthology.orchestra.run.smithi142.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-22T08:34:25.972 INFO:teuthology.orchestra.run.smithi142.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-22T08:34:25.972 INFO:teuthology.orchestra.run.smithi142.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-22T08:34:25.973 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-22T08:34:25.973 INFO:teuthology.orchestra.run.smithi142.stdout: python3-ply-3.11-14.el9.noarch 2024-09-22T08:34:25.973 INFO:teuthology.orchestra.run.smithi142.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-22T08:34:25.973 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-22T08:34:25.973 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-22T08:34:25.973 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-22T08:34:25.973 INFO:teuthology.orchestra.run.smithi142.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-22T08:34:25.973 INFO:teuthology.orchestra.run.smithi142.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-22T08:34:25.973 INFO:teuthology.orchestra.run.smithi142.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-22T08:34:25.973 INFO:teuthology.orchestra.run.smithi142.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-22T08:34:25.973 INFO:teuthology.orchestra.run.smithi142.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-22T08:34:25.973 INFO:teuthology.orchestra.run.smithi142.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-22T08:34:25.973 INFO:teuthology.orchestra.run.smithi142.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-22T08:34:25.973 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-22T08:34:25.973 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-09-22T08:34:26.007 INFO:teuthology.orchestra.run.smithi031.stdout:(7/37): python3-cffi-1.14.5-5.el9.x86_64.rpm 284 kB/s | 253 kB 00:00 2024-09-22T08:34:26.174 INFO:teuthology.orchestra.run.smithi031.stdout:(8/37): python3-cryptography-36.0.1-4.el9.x86_6 1.2 MB/s | 1.2 MB 00:01 2024-09-22T08:34:26.199 INFO:teuthology.orchestra.run.smithi031.stdout:(9/37): python3-ply-3.11-14.el9.noarch.rpm 162 kB/s | 106 kB 00:00 2024-09-22T08:34:26.364 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install ceph-base 2024-09-22T08:34:26.724 INFO:teuthology.orchestra.run.smithi031.stdout:(10/37): python3-pycparser-2.20-6.el9.noarch.rp 189 kB/s | 135 kB 00:00 2024-09-22T08:34:26.866 INFO:teuthology.orchestra.run.smithi031.stdout:(11/37): python3-requests-2.25.1-8.el9.noarch.r 180 kB/s | 125 kB 00:00 2024-09-22T08:34:26.940 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:00:51 ago on Sun 22 Sep 2024 08:33:35 AM UTC. 2024-09-22T08:34:26.950 INFO:teuthology.orchestra.run.smithi031.stdout:(12/37): python3-urllib3-1.26.5-6.el9.noarch.rp 286 kB/s | 215 kB 00:00 2024-09-22T08:34:27.028 INFO:teuthology.orchestra.run.smithi142.stdout:Package ceph-base-2:19.3.0-5106.g8852379c.el9.x86_64 is already installed. 2024-09-22T08:34:27.070 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-09-22T08:34:27.071 INFO:teuthology.orchestra.run.smithi142.stdout:Nothing to do. 2024-09-22T08:34:27.071 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-09-22T08:34:27.148 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install cephadm 2024-09-22T08:34:27.242 INFO:teuthology.orchestra.run.smithi031.stdout:(13/37): python3-markupsafe-1.1.1-12.el9.x86_64 119 kB/s | 35 kB 00:00 2024-09-22T08:34:27.300 INFO:teuthology.orchestra.run.smithi031.stdout:(14/37): lua-5.4.4-4.el9.x86_64.rpm 328 kB/s | 188 kB 00:00 2024-09-22T08:34:27.417 INFO:teuthology.orchestra.run.smithi031.stdout:(15/37): python3-pytz-2021.1-5.el9.noarch.rpm 437 kB/s | 51 kB 00:00 2024-09-22T08:34:27.442 INFO:teuthology.orchestra.run.smithi031.stdout:(16/37): python3-mako-1.1.4-6.el9.noarch.rpm 299 kB/s | 172 kB 00:00 2024-09-22T08:34:27.509 INFO:teuthology.orchestra.run.smithi031.stdout:(17/37): lua-devel-5.4.4-4.el9.x86_64.rpm 335 kB/s | 22 kB 00:00 2024-09-22T08:34:27.535 INFO:teuthology.orchestra.run.smithi031.stdout:(18/37): python3-packaging-20.9-5.el9.noarch.rp 264 kB/s | 77 kB 00:00 2024-09-22T08:34:27.560 INFO:teuthology.orchestra.run.smithi031.stdout:(19/37): python3-toml-0.10.2-6.el9.noarch.rpm 292 kB/s | 42 kB 00:00 2024-09-22T08:34:27.619 INFO:teuthology.orchestra.run.smithi031.stdout:(20/37): luarocks-3.9.2-5.el9.noarch.rpm 1.4 MB/s | 151 kB 00:00 2024-09-22T08:34:27.652 INFO:teuthology.orchestra.run.smithi031.stdout:(21/37): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 371 kB/s | 43 kB 00:00 2024-09-22T08:34:27.677 INFO:teuthology.orchestra.run.smithi031.stdout:(22/37): python3-jaraco-8.2.1-3.el9.noarch.rpm 432 kB/s | 11 kB 00:00 2024-09-22T08:34:27.702 INFO:teuthology.orchestra.run.smithi031.stdout:(23/37): python3-jaraco-classes-3.2.1-5.el9.noa 710 kB/s | 18 kB 00:00 2024-09-22T08:34:27.728 INFO:teuthology.orchestra.run.smithi031.stdout:(24/37): python3-cheroot-8.6.0-4.el9.noarch.rpm 1.1 MB/s | 172 kB 00:00 2024-09-22T08:34:27.729 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:00:52 ago on Sun 22 Sep 2024 08:33:35 AM UTC. 2024-09-22T08:34:27.753 INFO:teuthology.orchestra.run.smithi031.stdout:(25/37): python3-jaraco-collections-3.0.0-8.el9 462 kB/s | 23 kB 00:00 2024-09-22T08:34:27.778 INFO:teuthology.orchestra.run.smithi031.stdout:(26/37): python3-jaraco-functools-3.5.0-2.el9.n 386 kB/s | 19 kB 00:00 2024-09-22T08:34:27.803 INFO:teuthology.orchestra.run.smithi031.stdout:(27/37): python3-jaraco-text-3.2.0-6.el9.noarch 392 kB/s | 20 kB 00:00 2024-09-22T08:34:27.824 INFO:teuthology.orchestra.run.smithi031.stdout:(28/37): python3-logutils-0.3.5-21.el9.noarch.r 1.0 MB/s | 46 kB 00:00 2024-09-22T08:34:27.849 INFO:teuthology.orchestra.run.smithi031.stdout:(29/37): python3-cherrypy-18.6.1-2.el9.noarch.r 1.5 MB/s | 358 kB 00:00 2024-09-22T08:34:27.860 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-09-22T08:34:27.861 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-22T08:34:27.861 INFO:teuthology.orchestra.run.smithi142.stdout: Package Arch Version Repository Size 2024-09-22T08:34:27.861 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-22T08:34:27.861 INFO:teuthology.orchestra.run.smithi142.stdout:Installing: 2024-09-22T08:34:27.861 INFO:teuthology.orchestra.run.smithi142.stdout: cephadm noarch 2:19.3.0-5106.g8852379c.el9 ceph-noarch 784 k 2024-09-22T08:34:27.861 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-22T08:34:27.861 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2024-09-22T08:34:27.862 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-22T08:34:27.862 INFO:teuthology.orchestra.run.smithi142.stdout:Install 1 Package 2024-09-22T08:34:27.862 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-22T08:34:27.862 INFO:teuthology.orchestra.run.smithi142.stdout:Total download size: 784 k 2024-09-22T08:34:27.862 INFO:teuthology.orchestra.run.smithi142.stdout:Installed size: 791 k 2024-09-22T08:34:27.862 INFO:teuthology.orchestra.run.smithi142.stdout:Downloading Packages: 2024-09-22T08:34:27.874 INFO:teuthology.orchestra.run.smithi031.stdout:(30/37): python3-more-itertools-8.12.0-2.el9.no 1.1 MB/s | 79 kB 00:00 2024-09-22T08:34:27.900 INFO:teuthology.orchestra.run.smithi031.stdout:(31/37): python3-portend-3.1.0-2.el9.noarch.rpm 327 kB/s | 16 kB 00:00 2024-09-22T08:34:27.941 INFO:teuthology.orchestra.run.smithi031.stdout:(32/37): python3-tempora-5.0.0-2.el9.noarch.rpm 865 kB/s | 36 kB 00:00 2024-09-22T08:34:27.967 INFO:teuthology.orchestra.run.smithi031.stdout:(33/37): python3-pyOpenSSL-21.0.0-1.el9.noarch. 978 kB/s | 90 kB 00:00 2024-09-22T08:34:27.992 INFO:teuthology.orchestra.run.smithi031.stdout:(34/37): python3-pecan-1.4.2-3.el9.noarch.rpm 1.6 MB/s | 272 kB 00:00 2024-09-22T08:34:28.017 INFO:teuthology.orchestra.run.smithi031.stdout:(35/37): python3-zc-lockfile-2.0-10.el9.noarch. 803 kB/s | 20 kB 00:00 2024-09-22T08:34:28.042 INFO:teuthology.orchestra.run.smithi031.stdout:(36/37): python3-webob-1.8.8-2.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-09-22T08:34:28.068 INFO:teuthology.orchestra.run.smithi031.stdout:(37/37): python3-werkzeug-2.0.3-3.el9.1.noarch. 4.2 MB/s | 427 kB 00:00 2024-09-22T08:34:28.072 INFO:teuthology.orchestra.run.smithi031.stdout:-------------------------------------------------------------------------------- 2024-09-22T08:34:28.073 INFO:teuthology.orchestra.run.smithi031.stdout:Total 8.2 MB/s | 31 MB 00:03 2024-09-22T08:34:28.142 INFO:teuthology.orchestra.run.smithi142.stdout:cephadm-19.3.0-5106.g8852379c.el9.noarch.rpm 2.7 MB/s | 784 kB 00:00 2024-09-22T08:34:28.143 INFO:teuthology.orchestra.run.smithi142.stdout:-------------------------------------------------------------------------------- 2024-09-22T08:34:28.143 INFO:teuthology.orchestra.run.smithi142.stdout:Total 2.7 MB/s | 784 kB 00:00 2024-09-22T08:34:28.143 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction check 2024-09-22T08:34:28.148 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction check succeeded. 2024-09-22T08:34:28.148 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction test 2024-09-22T08:34:28.154 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction test succeeded. 2024-09-22T08:34:28.155 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction 2024-09-22T08:34:28.232 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction check 2024-09-22T08:34:28.237 INFO:teuthology.orchestra.run.smithi142.stdout: Preparing : 1/1 2024-09-22T08:34:28.276 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction check succeeded. 2024-09-22T08:34:28.276 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction test 2024-09-22T08:34:28.737 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: cephadm-2:19.3.0-5106.g8852379c.el9.noarch 1/1 2024-09-22T08:34:28.808 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction test succeeded. 2024-09-22T08:34:28.808 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction 2024-09-22T08:34:28.837 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : cephadm-2:19.3.0-5106.g8852379c.el9.noarch 1/1 2024-09-22T08:34:29.238 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: cephadm-2:19.3.0-5106.g8852379c.el9.noarch 1/1 2024-09-22T08:34:29.477 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : cephadm-2:19.3.0-5106.g8852379c.el9.noarch 1/1 2024-09-22T08:34:29.477 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-22T08:34:29.477 INFO:teuthology.orchestra.run.smithi142.stdout:Installed: 2024-09-22T08:34:29.477 INFO:teuthology.orchestra.run.smithi142.stdout: cephadm-2:19.3.0-5106.g8852379c.el9.noarch 2024-09-22T08:34:29.477 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-22T08:34:29.477 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-09-22T08:34:29.732 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install ceph-immutable-object-cache 2024-09-22T08:34:30.308 INFO:teuthology.orchestra.run.smithi031.stdout: Preparing : 1/1 2024-09-22T08:34:30.319 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:00:55 ago on Sun 22 Sep 2024 08:33:35 AM UTC. 2024-09-22T08:34:30.371 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/37 2024-09-22T08:34:30.421 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/37 2024-09-22T08:34:30.448 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/37 2024-09-22T08:34:30.455 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-09-22T08:34:30.456 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-22T08:34:30.456 INFO:teuthology.orchestra.run.smithi142.stdout: Package Arch Version Repo Size 2024-09-22T08:34:30.456 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-22T08:34:30.456 INFO:teuthology.orchestra.run.smithi142.stdout:Installing: 2024-09-22T08:34:30.456 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-5106.g8852379c.el9 ceph 145 k 2024-09-22T08:34:30.456 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-22T08:34:30.456 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2024-09-22T08:34:30.456 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-22T08:34:30.456 INFO:teuthology.orchestra.run.smithi142.stdout:Install 1 Package 2024-09-22T08:34:30.456 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-22T08:34:30.457 INFO:teuthology.orchestra.run.smithi142.stdout:Total download size: 145 k 2024-09-22T08:34:30.457 INFO:teuthology.orchestra.run.smithi142.stdout:Installed size: 432 k 2024-09-22T08:34:30.457 INFO:teuthology.orchestra.run.smithi142.stdout:Downloading Packages: 2024-09-22T08:34:30.525 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/37 2024-09-22T08:34:30.564 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : luarocks-3.9.2-5.el9.noarch 5/37 2024-09-22T08:34:30.597 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/37 2024-09-22T08:34:30.682 INFO:teuthology.orchestra.run.smithi142.stdout:ceph-immutable-object-cache-19.3.0-5106.g885237 645 kB/s | 145 kB 00:00 2024-09-22T08:34:30.682 INFO:teuthology.orchestra.run.smithi142.stdout:-------------------------------------------------------------------------------- 2024-09-22T08:34:30.682 INFO:teuthology.orchestra.run.smithi142.stdout:Total 640 kB/s | 145 kB 00:00 2024-09-22T08:34:30.682 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction check 2024-09-22T08:34:30.690 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction check succeeded. 2024-09-22T08:34:30.690 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction test 2024-09-22T08:34:30.702 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/37 2024-09-22T08:34:30.747 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction test succeeded. 2024-09-22T08:34:30.747 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction 2024-09-22T08:34:30.778 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/37 2024-09-22T08:34:30.825 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 9/37 2024-09-22T08:34:30.859 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/37 2024-09-22T08:34:30.887 INFO:teuthology.orchestra.run.smithi142.stdout: Preparing : 1/1 2024-09-22T08:34:30.889 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/37 2024-09-22T08:34:30.923 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/37 2024-09-22T08:34:30.949 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-5106.g8852379c. 1/1 2024-09-22T08:34:30.957 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/37 2024-09-22T08:34:30.974 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-5106.g8852379c. 1/1 2024-09-22T08:34:30.975 INFO:teuthology.orchestra.run.smithi142.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-22T08:34:30.975 INFO:teuthology.orchestra.run.smithi142.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-22T08:34:30.975 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-22T08:34:30.997 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/37 2024-09-22T08:34:31.041 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/37 2024-09-22T08:34:31.075 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/37 2024-09-22T08:34:31.124 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/37 2024-09-22T08:34:31.164 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-packaging-20.9-5.el9.noarch 18/37 2024-09-22T08:34:31.240 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 19/37 2024-09-22T08:34:31.393 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 20/37 2024-09-22T08:34:31.474 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 21/37 2024-09-22T08:34:31.526 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 22/37 2024-09-22T08:34:31.564 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 23/37 2024-09-22T08:34:31.623 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-ply-3.11-14.el9.noarch 24/37 2024-09-22T08:34:31.686 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 25/37 2024-09-22T08:34:31.885 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 26/37 2024-09-22T08:34:31.899 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-5106.g8852379c. 1/1 2024-09-22T08:34:31.899 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-22T08:34:31.900 INFO:teuthology.orchestra.run.smithi142.stdout:Installed: 2024-09-22T08:34:31.900 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-immutable-object-cache-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:34:31.900 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-22T08:34:31.900 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-09-22T08:34:31.934 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 27/37 2024-09-22T08:34:32.017 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 28/37 2024-09-22T08:34:32.114 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 29/37 2024-09-22T08:34:32.150 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 30/37 2024-09-22T08:34:32.183 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install ceph-mgr 2024-09-22T08:34:32.286 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 31/37 2024-09-22T08:34:32.455 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-5106.g8852379c.el9. 32/37 2024-09-22T08:34:32.485 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-mgr-2:19.3.0-5106.g8852379c.el9.x86_64 33/37 2024-09-22T08:34:32.512 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-mgr-2:19.3.0-5106.g8852379c.el9.x86_64 33/37 2024-09-22T08:34:32.512 INFO:teuthology.orchestra.run.smithi031.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-22T08:34:32.512 INFO:teuthology.orchestra.run.smithi031.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-22T08:34:32.512 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-22T08:34:32.512 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-22T08:34:32.512 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-22T08:34:32.778 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:00:57 ago on Sun 22 Sep 2024 08:33:35 AM UTC. 2024-09-22T08:34:32.869 INFO:teuthology.orchestra.run.smithi142.stdout:Package ceph-mgr-2:19.3.0-5106.g8852379c.el9.x86_64 is already installed. 2024-09-22T08:34:32.911 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-09-22T08:34:32.912 INFO:teuthology.orchestra.run.smithi142.stdout:Nothing to do. 2024-09-22T08:34:32.912 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-09-22T08:34:32.988 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install ceph-mgr-dashboard 2024-09-22T08:34:33.570 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:00:58 ago on Sun 22 Sep 2024 08:33:35 AM UTC. 2024-09-22T08:34:33.701 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-09-22T08:34:33.702 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-22T08:34:33.702 INFO:teuthology.orchestra.run.smithi142.stdout: Package Arch Version Repository Size 2024-09-22T08:34:33.702 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-22T08:34:33.702 INFO:teuthology.orchestra.run.smithi142.stdout:Installing: 2024-09-22T08:34:33.702 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-dashboard noarch 2:19.3.0-5106.g8852379c.el9 ceph-noarch 14 M 2024-09-22T08:34:33.702 INFO:teuthology.orchestra.run.smithi142.stdout:Installing dependencies: 2024-09-22T08:34:33.702 INFO:teuthology.orchestra.run.smithi142.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-22T08:34:33.703 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-grafana-dashboards noarch 2:19.3.0-5106.g8852379c.el9 ceph-noarch 34 k 2024-09-22T08:34:33.703 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-prometheus-alerts noarch 2:19.3.0-5106.g8852379c.el9 ceph-noarch 16 k 2024-09-22T08:34:33.703 INFO:teuthology.orchestra.run.smithi142.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-22T08:34:33.703 INFO:teuthology.orchestra.run.smithi142.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-22T08:34:33.703 INFO:teuthology.orchestra.run.smithi142.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-22T08:34:33.703 INFO:teuthology.orchestra.run.smithi142.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-22T08:34:33.703 INFO:teuthology.orchestra.run.smithi142.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-22T08:34:33.703 INFO:teuthology.orchestra.run.smithi142.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-22T08:34:33.703 INFO:teuthology.orchestra.run.smithi142.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-22T08:34:33.703 INFO:teuthology.orchestra.run.smithi142.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-22T08:34:33.703 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-22T08:34:33.703 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2024-09-22T08:34:33.704 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-22T08:34:33.704 INFO:teuthology.orchestra.run.smithi142.stdout:Install 12 Packages 2024-09-22T08:34:33.704 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-22T08:34:33.704 INFO:teuthology.orchestra.run.smithi142.stdout:Total download size: 19 M 2024-09-22T08:34:33.704 INFO:teuthology.orchestra.run.smithi142.stdout:Installed size: 159 M 2024-09-22T08:34:33.705 INFO:teuthology.orchestra.run.smithi142.stdout:Downloading Packages: 2024-09-22T08:34:33.993 INFO:teuthology.orchestra.run.smithi142.stdout:(1/12): ceph-prometheus-alerts-19.3.0-5106.g885 101 kB/s | 16 kB 00:00 2024-09-22T08:34:34.018 INFO:teuthology.orchestra.run.smithi142.stdout:(2/12): ceph-grafana-dashboards-19.3.0-5106.g88 182 kB/s | 34 kB 00:00 2024-09-22T08:34:34.077 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-osd-2:19.3.0-5106.g8852379c.el9.x86_64 34/37 2024-09-22T08:34:34.107 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-osd-2:19.3.0-5106.g8852379c.el9.x86_64 34/37 2024-09-22T08:34:34.107 INFO:teuthology.orchestra.run.smithi031.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-22T08:34:34.107 INFO:teuthology.orchestra.run.smithi031.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-22T08:34:34.107 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-22T08:34:34.108 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-22T08:34:34.108 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-22T08:34:34.219 INFO:teuthology.orchestra.run.smithi142.stdout:(3/12): python3-protobuf-3.14.0-13.el9.noarch.r 1.3 MB/s | 269 kB 00:00 2024-09-22T08:34:34.319 INFO:teuthology.orchestra.run.smithi142.stdout:(4/12): protobuf-3.14.0-13.el9.x86_64.rpm 3.1 MB/s | 1.0 MB 00:00 2024-09-22T08:34:34.370 INFO:teuthology.orchestra.run.smithi142.stdout:(5/12): abseil-cpp-20211102.0-3.el9.x86_64.rpm 11 MB/s | 548 kB 00:00 2024-09-22T08:34:34.395 INFO:teuthology.orchestra.run.smithi142.stdout:(6/12): grpc-data-1.46.7-10.el9.noarch.rpm 780 kB/s | 19 kB 00:00 2024-09-22T08:34:34.461 INFO:teuthology.orchestra.run.smithi142.stdout:(7/12): python3-grpcio-1.46.7-10.el9.x86_64.rpm 31 MB/s | 2.0 MB 00:00 2024-09-22T08:34:34.586 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-mon-2:19.3.0-5106.g8852379c.el9.x86_64 35/37 2024-09-22T08:34:34.612 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-mon-2:19.3.0-5106.g8852379c.el9.x86_64 35/37 2024-09-22T08:34:34.612 INFO:teuthology.orchestra.run.smithi031.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-22T08:34:34.612 INFO:teuthology.orchestra.run.smithi031.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-22T08:34:34.612 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-22T08:34:34.612 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-22T08:34:34.612 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-22T08:34:34.670 INFO:teuthology.orchestra.run.smithi142.stdout:(8/12): ceph-mgr-dashboard-19.3.0-5106.g8852379 17 MB/s | 14 MB 00:00 2024-09-22T08:34:34.704 INFO:teuthology.orchestra.run.smithi142.stdout:(9/12): protobuf-compiler-3.14.0-13.el9.x86_64. 1.7 MB/s | 863 kB 00:00 2024-09-22T08:34:34.729 INFO:teuthology.orchestra.run.smithi142.stdout:(10/12): python3-repoze-lru-0.7-16.el9.noarch.r 526 kB/s | 31 kB 00:00 2024-09-22T08:34:34.763 INFO:teuthology.orchestra.run.smithi142.stdout:(11/12): python3-grpcio-tools-1.46.7-10.el9.x86 480 kB/s | 144 kB 00:00 2024-09-22T08:34:34.788 INFO:teuthology.orchestra.run.smithi142.stdout:(12/12): python3-routes-2.5.1-5.el9.noarch.rpm 2.2 MB/s | 188 kB 00:00 2024-09-22T08:34:34.791 INFO:teuthology.orchestra.run.smithi142.stdout:-------------------------------------------------------------------------------- 2024-09-22T08:34:34.791 INFO:teuthology.orchestra.run.smithi142.stdout:Total 18 MB/s | 19 MB 00:01 2024-09-22T08:34:34.840 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction check 2024-09-22T08:34:34.845 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-mds-2:19.3.0-5106.g8852379c.el9.x86_64 36/37 2024-09-22T08:34:34.859 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction check succeeded. 2024-09-22T08:34:34.859 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction test 2024-09-22T08:34:34.870 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-mds-2:19.3.0-5106.g8852379c.el9.x86_64 36/37 2024-09-22T08:34:34.871 INFO:teuthology.orchestra.run.smithi031.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-22T08:34:34.871 INFO:teuthology.orchestra.run.smithi031.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-22T08:34:34.871 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-22T08:34:34.871 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-22T08:34:34.871 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-22T08:34:34.938 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-2:19.3.0-5106.g8852379c.el9.x86_64 37/37 2024-09-22T08:34:35.132 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction test succeeded. 2024-09-22T08:34:35.132 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction 2024-09-22T08:34:35.726 INFO:teuthology.orchestra.run.smithi142.stdout: Preparing : 1/1 2024-09-22T08:34:35.805 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 1/12 2024-09-22T08:34:35.840 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 2/12 2024-09-22T08:34:35.888 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/12 2024-09-22T08:34:35.926 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/12 2024-09-22T08:34:36.041 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 5/12 2024-09-22T08:34:36.170 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 6/12 2024-09-22T08:34:36.263 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 7/12 2024-09-22T08:34:36.305 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 8/12 2024-09-22T08:34:36.342 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/12 2024-09-22T08:34:36.374 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-5106.g8852379c.el9 10/12 2024-09-22T08:34:36.678 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-2:19.3.0-5106.g8852379c.el9.x86_64 37/37 2024-09-22T08:34:36.678 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-2:19.3.0-5106.g8852379c.el9.x86_64 1/37 2024-09-22T08:34:36.678 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-mds-2:19.3.0-5106.g8852379c.el9.x86_64 2/37 2024-09-22T08:34:36.678 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-mgr-2:19.3.0-5106.g8852379c.el9.x86_64 3/37 2024-09-22T08:34:36.679 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-mon-2:19.3.0-5106.g8852379c.el9.x86_64 4/37 2024-09-22T08:34:36.679 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-osd-2:19.3.0-5106.g8852379c.el9.x86_64 5/37 2024-09-22T08:34:36.679 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-5106.g8852379c.el9. 6/37 2024-09-22T08:34:36.679 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/37 2024-09-22T08:34:36.679 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/37 2024-09-22T08:34:36.679 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/37 2024-09-22T08:34:36.679 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/37 2024-09-22T08:34:36.679 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/37 2024-09-22T08:34:36.679 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/37 2024-09-22T08:34:36.679 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/37 2024-09-22T08:34:36.679 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/37 2024-09-22T08:34:36.679 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/37 2024-09-22T08:34:36.679 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 16/37 2024-09-22T08:34:36.679 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 17/37 2024-09-22T08:34:36.680 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 18/37 2024-09-22T08:34:36.680 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 19/37 2024-09-22T08:34:36.680 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 20/37 2024-09-22T08:34:36.680 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 21/37 2024-09-22T08:34:36.680 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 22/37 2024-09-22T08:34:36.680 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 23/37 2024-09-22T08:34:36.680 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 24/37 2024-09-22T08:34:36.680 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 25/37 2024-09-22T08:34:36.680 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 26/37 2024-09-22T08:34:36.680 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 27/37 2024-09-22T08:34:36.681 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 28/37 2024-09-22T08:34:36.681 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 29/37 2024-09-22T08:34:36.681 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 30/37 2024-09-22T08:34:36.681 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 31/37 2024-09-22T08:34:36.682 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 32/37 2024-09-22T08:34:36.682 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 33/37 2024-09-22T08:34:36.682 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 34/37 2024-09-22T08:34:36.682 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 35/37 2024-09-22T08:34:36.682 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 36/37 2024-09-22T08:34:37.808 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 37/37 2024-09-22T08:34:37.808 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-22T08:34:37.808 INFO:teuthology.orchestra.run.smithi031.stdout:Installed: 2024-09-22T08:34:37.808 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:34:37.809 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mds-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:34:37.809 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mgr-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:34:37.809 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mgr-modules-core-2:19.3.0-5106.g8852379c.el9.noarch 2024-09-22T08:34:37.809 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mon-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:34:37.809 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-osd-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:34:37.809 INFO:teuthology.orchestra.run.smithi031.stdout: lua-5.4.4-4.el9.x86_64 2024-09-22T08:34:37.809 INFO:teuthology.orchestra.run.smithi031.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-22T08:34:37.809 INFO:teuthology.orchestra.run.smithi031.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-22T08:34:37.809 INFO:teuthology.orchestra.run.smithi031.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-22T08:34:37.809 INFO:teuthology.orchestra.run.smithi031.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-22T08:34:37.809 INFO:teuthology.orchestra.run.smithi031.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-22T08:34:37.809 INFO:teuthology.orchestra.run.smithi031.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-22T08:34:37.809 INFO:teuthology.orchestra.run.smithi031.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-22T08:34:37.810 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-22T08:34:37.810 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-22T08:34:37.810 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-22T08:34:37.810 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-22T08:34:37.810 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-22T08:34:37.810 INFO:teuthology.orchestra.run.smithi031.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-22T08:34:37.810 INFO:teuthology.orchestra.run.smithi031.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-22T08:34:37.810 INFO:teuthology.orchestra.run.smithi031.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-22T08:34:37.810 INFO:teuthology.orchestra.run.smithi031.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-22T08:34:37.810 INFO:teuthology.orchestra.run.smithi031.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-22T08:34:37.810 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-22T08:34:37.810 INFO:teuthology.orchestra.run.smithi031.stdout: python3-ply-3.11-14.el9.noarch 2024-09-22T08:34:37.810 INFO:teuthology.orchestra.run.smithi031.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-22T08:34:37.811 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-22T08:34:37.811 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-22T08:34:37.811 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-22T08:34:37.811 INFO:teuthology.orchestra.run.smithi031.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-22T08:34:37.811 INFO:teuthology.orchestra.run.smithi031.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-22T08:34:37.811 INFO:teuthology.orchestra.run.smithi031.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-22T08:34:37.811 INFO:teuthology.orchestra.run.smithi031.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-22T08:34:37.811 INFO:teuthology.orchestra.run.smithi031.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-22T08:34:37.811 INFO:teuthology.orchestra.run.smithi031.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-22T08:34:37.811 INFO:teuthology.orchestra.run.smithi031.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-22T08:34:37.811 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-22T08:34:37.811 INFO:teuthology.orchestra.run.smithi031.stdout:Complete! 2024-09-22T08:34:38.207 DEBUG:teuthology.orchestra.run.smithi031:> sudo yum -y install ceph-base 2024-09-22T08:34:38.809 INFO:teuthology.orchestra.run.smithi031.stdout:Last metadata expiration check: 0:01:01 ago on Sun 22 Sep 2024 08:33:37 AM UTC. 2024-09-22T08:34:38.902 INFO:teuthology.orchestra.run.smithi031.stdout:Package ceph-base-2:19.3.0-5106.g8852379c.el9.x86_64 is already installed. 2024-09-22T08:34:38.946 INFO:teuthology.orchestra.run.smithi031.stdout:Dependencies resolved. 2024-09-22T08:34:38.947 INFO:teuthology.orchestra.run.smithi031.stdout:Nothing to do. 2024-09-22T08:34:38.948 INFO:teuthology.orchestra.run.smithi031.stdout:Complete! 2024-09-22T08:34:39.017 DEBUG:teuthology.orchestra.run.smithi031:> sudo yum -y install cephadm 2024-09-22T08:34:39.606 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-5106.g8852379c.el 11/12 2024-09-22T08:34:39.631 INFO:teuthology.orchestra.run.smithi031.stdout:Last metadata expiration check: 0:01:02 ago on Sun 22 Sep 2024 08:33:37 AM UTC. 2024-09-22T08:34:39.670 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-5106.g8852379c.el9.noa 12/12 2024-09-22T08:34:39.779 INFO:teuthology.orchestra.run.smithi031.stdout:Dependencies resolved. 2024-09-22T08:34:39.780 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2024-09-22T08:34:39.780 INFO:teuthology.orchestra.run.smithi031.stdout: Package Arch Version Repository Size 2024-09-22T08:34:39.780 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2024-09-22T08:34:39.780 INFO:teuthology.orchestra.run.smithi031.stdout:Installing: 2024-09-22T08:34:39.780 INFO:teuthology.orchestra.run.smithi031.stdout: cephadm noarch 2:19.3.0-5106.g8852379c.el9 ceph-noarch 784 k 2024-09-22T08:34:39.780 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-22T08:34:39.780 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction Summary 2024-09-22T08:34:39.781 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2024-09-22T08:34:39.781 INFO:teuthology.orchestra.run.smithi031.stdout:Install 1 Package 2024-09-22T08:34:39.781 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-22T08:34:39.781 INFO:teuthology.orchestra.run.smithi031.stdout:Total download size: 784 k 2024-09-22T08:34:39.781 INFO:teuthology.orchestra.run.smithi031.stdout:Installed size: 791 k 2024-09-22T08:34:39.781 INFO:teuthology.orchestra.run.smithi031.stdout:Downloading Packages: 2024-09-22T08:34:40.043 INFO:teuthology.orchestra.run.smithi031.stdout:cephadm-19.3.0-5106.g8852379c.el9.noarch.rpm 2.9 MB/s | 784 kB 00:00 2024-09-22T08:34:40.043 INFO:teuthology.orchestra.run.smithi031.stdout:-------------------------------------------------------------------------------- 2024-09-22T08:34:40.044 INFO:teuthology.orchestra.run.smithi031.stdout:Total 2.9 MB/s | 784 kB 00:00 2024-09-22T08:34:40.044 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction check 2024-09-22T08:34:40.050 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction check succeeded. 2024-09-22T08:34:40.050 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction test 2024-09-22T08:34:40.056 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction test succeeded. 2024-09-22T08:34:40.056 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction 2024-09-22T08:34:40.129 INFO:teuthology.orchestra.run.smithi031.stdout: Preparing : 1/1 2024-09-22T08:34:40.582 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: cephadm-2:19.3.0-5106.g8852379c.el9.noarch 1/1 2024-09-22T08:34:40.682 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : cephadm-2:19.3.0-5106.g8852379c.el9.noarch 1/1 2024-09-22T08:34:41.051 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: cephadm-2:19.3.0-5106.g8852379c.el9.noarch 1/1 2024-09-22T08:34:41.302 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : cephadm-2:19.3.0-5106.g8852379c.el9.noarch 1/1 2024-09-22T08:34:41.303 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-22T08:34:41.303 INFO:teuthology.orchestra.run.smithi031.stdout:Installed: 2024-09-22T08:34:41.303 INFO:teuthology.orchestra.run.smithi031.stdout: cephadm-2:19.3.0-5106.g8852379c.el9.noarch 2024-09-22T08:34:41.303 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-22T08:34:41.303 INFO:teuthology.orchestra.run.smithi031.stdout:Complete! 2024-09-22T08:34:41.548 DEBUG:teuthology.orchestra.run.smithi031:> sudo yum -y install ceph-immutable-object-cache 2024-09-22T08:34:41.689 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-5106.g8852379c.el9.noa 12/12 2024-09-22T08:34:41.689 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-5106.g8852379c.el 1/12 2024-09-22T08:34:41.689 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-5106.g8852379c.el9.noa 2/12 2024-09-22T08:34:41.689 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-5106.g8852379c.el9 3/12 2024-09-22T08:34:41.689 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 4/12 2024-09-22T08:34:41.689 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 5/12 2024-09-22T08:34:41.690 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 6/12 2024-09-22T08:34:41.690 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 7/12 2024-09-22T08:34:41.690 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 8/12 2024-09-22T08:34:41.690 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 9/12 2024-09-22T08:34:41.690 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/12 2024-09-22T08:34:41.690 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 11/12 2024-09-22T08:34:42.013 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 12/12 2024-09-22T08:34:42.014 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-22T08:34:42.014 INFO:teuthology.orchestra.run.smithi142.stdout:Installed: 2024-09-22T08:34:42.014 INFO:teuthology.orchestra.run.smithi142.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-22T08:34:42.014 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-grafana-dashboards-2:19.3.0-5106.g8852379c.el9.noarch 2024-09-22T08:34:42.014 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-dashboard-2:19.3.0-5106.g8852379c.el9.noarch 2024-09-22T08:34:42.014 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-prometheus-alerts-2:19.3.0-5106.g8852379c.el9.noarch 2024-09-22T08:34:42.014 INFO:teuthology.orchestra.run.smithi142.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-22T08:34:42.014 INFO:teuthology.orchestra.run.smithi142.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-22T08:34:42.014 INFO:teuthology.orchestra.run.smithi142.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-22T08:34:42.014 INFO:teuthology.orchestra.run.smithi142.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-22T08:34:42.014 INFO:teuthology.orchestra.run.smithi142.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-22T08:34:42.014 INFO:teuthology.orchestra.run.smithi142.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-22T08:34:42.015 INFO:teuthology.orchestra.run.smithi142.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-22T08:34:42.015 INFO:teuthology.orchestra.run.smithi142.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-22T08:34:42.015 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-22T08:34:42.015 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-09-22T08:34:42.159 INFO:teuthology.orchestra.run.smithi031.stdout:Last metadata expiration check: 0:01:05 ago on Sun 22 Sep 2024 08:33:37 AM UTC. 2024-09-22T08:34:42.281 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-22T08:34:42.297 INFO:teuthology.orchestra.run.smithi031.stdout:Dependencies resolved. 2024-09-22T08:34:42.298 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2024-09-22T08:34:42.298 INFO:teuthology.orchestra.run.smithi031.stdout: Package Arch Version Repo Size 2024-09-22T08:34:42.298 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2024-09-22T08:34:42.298 INFO:teuthology.orchestra.run.smithi031.stdout:Installing: 2024-09-22T08:34:42.298 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-5106.g8852379c.el9 ceph 145 k 2024-09-22T08:34:42.298 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-22T08:34:42.299 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction Summary 2024-09-22T08:34:42.299 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2024-09-22T08:34:42.299 INFO:teuthology.orchestra.run.smithi031.stdout:Install 1 Package 2024-09-22T08:34:42.299 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-22T08:34:42.299 INFO:teuthology.orchestra.run.smithi031.stdout:Total download size: 145 k 2024-09-22T08:34:42.299 INFO:teuthology.orchestra.run.smithi031.stdout:Installed size: 432 k 2024-09-22T08:34:42.299 INFO:teuthology.orchestra.run.smithi031.stdout:Downloading Packages: 2024-09-22T08:34:42.507 INFO:teuthology.orchestra.run.smithi031.stdout:ceph-immutable-object-cache-19.3.0-5106.g885237 699 kB/s | 145 kB 00:00 2024-09-22T08:34:42.507 INFO:teuthology.orchestra.run.smithi031.stdout:-------------------------------------------------------------------------------- 2024-09-22T08:34:42.507 INFO:teuthology.orchestra.run.smithi031.stdout:Total 694 kB/s | 145 kB 00:00 2024-09-22T08:34:42.508 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction check 2024-09-22T08:34:42.516 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction check succeeded. 2024-09-22T08:34:42.516 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction test 2024-09-22T08:34:42.577 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction test succeeded. 2024-09-22T08:34:42.577 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction 2024-09-22T08:34:42.728 INFO:teuthology.orchestra.run.smithi031.stdout: Preparing : 1/1 2024-09-22T08:34:42.799 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-5106.g8852379c. 1/1 2024-09-22T08:34:42.826 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-5106.g8852379c. 1/1 2024-09-22T08:34:42.826 INFO:teuthology.orchestra.run.smithi031.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-22T08:34:42.826 INFO:teuthology.orchestra.run.smithi031.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-22T08:34:42.826 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-22T08:34:42.867 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:01:07 ago on Sun 22 Sep 2024 08:33:35 AM UTC. 2024-09-22T08:34:43.000 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-09-22T08:34:43.001 INFO:teuthology.orchestra.run.smithi142.stdout:======================================================================================= 2024-09-22T08:34:43.001 INFO:teuthology.orchestra.run.smithi142.stdout: Package Arch Version Repository Size 2024-09-22T08:34:43.001 INFO:teuthology.orchestra.run.smithi142.stdout:======================================================================================= 2024-09-22T08:34:43.001 INFO:teuthology.orchestra.run.smithi142.stdout:Installing: 2024-09-22T08:34:43.001 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-5106.g8852379c.el9 ceph-noarch 7.4 M 2024-09-22T08:34:43.001 INFO:teuthology.orchestra.run.smithi142.stdout:Installing dependencies: 2024-09-22T08:34:43.001 INFO:teuthology.orchestra.run.smithi142.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-22T08:34:43.001 INFO:teuthology.orchestra.run.smithi142.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-22T08:34:43.001 INFO:teuthology.orchestra.run.smithi142.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-22T08:34:43.001 INFO:teuthology.orchestra.run.smithi142.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-22T08:34:43.002 INFO:teuthology.orchestra.run.smithi142.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-22T08:34:43.002 INFO:teuthology.orchestra.run.smithi142.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-22T08:34:43.002 INFO:teuthology.orchestra.run.smithi142.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-22T08:34:43.002 INFO:teuthology.orchestra.run.smithi142.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-22T08:34:43.002 INFO:teuthology.orchestra.run.smithi142.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-22T08:34:43.002 INFO:teuthology.orchestra.run.smithi142.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-22T08:34:43.002 INFO:teuthology.orchestra.run.smithi142.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-22T08:34:43.002 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-22T08:34:43.002 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2024-09-22T08:34:43.002 INFO:teuthology.orchestra.run.smithi142.stdout:======================================================================================= 2024-09-22T08:34:43.002 INFO:teuthology.orchestra.run.smithi142.stdout:Install 12 Packages 2024-09-22T08:34:43.002 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-22T08:34:43.003 INFO:teuthology.orchestra.run.smithi142.stdout:Total download size: 38 M 2024-09-22T08:34:43.003 INFO:teuthology.orchestra.run.smithi142.stdout:Installed size: 212 M 2024-09-22T08:34:43.003 INFO:teuthology.orchestra.run.smithi142.stdout:Downloading Packages: 2024-09-22T08:34:43.278 INFO:teuthology.orchestra.run.smithi142.stdout:(1/12): libquadmath-11.5.0-2.el9.x86_64.rpm 1.0 MB/s | 191 kB 00:00 2024-09-22T08:34:43.345 INFO:teuthology.orchestra.run.smithi142.stdout:(2/12): flexiblas-3.0.4-8.el9.x86_64.rpm 491 kB/s | 33 kB 00:00 2024-09-22T08:34:43.379 INFO:teuthology.orchestra.run.smithi142.stdout:(3/12): libgfortran-11.5.0-2.el9.x86_64.rpm 2.8 MB/s | 801 kB 00:00 2024-09-22T08:34:43.446 INFO:teuthology.orchestra.run.smithi142.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 273 kB/s | 18 kB 00:00 2024-09-22T08:34:43.563 INFO:teuthology.orchestra.run.smithi142.stdout:(5/12): ceph-mgr-diskprediction-local-19.3.0-51 16 MB/s | 7.4 MB 00:00 2024-09-22T08:34:43.588 INFO:teuthology.orchestra.run.smithi142.stdout:(6/12): openblas-0.3.26-2.el9.x86_64.rpm 271 kB/s | 38 kB 00:00 2024-09-22T08:34:43.655 INFO:teuthology.orchestra.run.smithi142.stdout:(7/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 9.7 MB/s | 3.0 MB 00:00 2024-09-22T08:34:43.743 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-5106.g8852379c. 1/1 2024-09-22T08:34:43.743 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-22T08:34:43.743 INFO:teuthology.orchestra.run.smithi031.stdout:Installed: 2024-09-22T08:34:43.744 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-immutable-object-cache-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:34:43.744 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-22T08:34:43.744 INFO:teuthology.orchestra.run.smithi031.stdout:Complete! 2024-09-22T08:34:43.772 INFO:teuthology.orchestra.run.smithi142.stdout:(8/12): python3-devel-3.9.19-8.el9.x86_64.rpm 1.3 MB/s | 245 kB 00:00 2024-09-22T08:34:43.830 INFO:teuthology.orchestra.run.smithi142.stdout:(9/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 4.2 MB/s | 250 kB 00:00 2024-09-22T08:34:43.914 INFO:teuthology.orchestra.run.smithi142.stdout:(10/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 20 MB/s | 5.1 MB 00:00 2024-09-22T08:34:43.961 DEBUG:teuthology.orchestra.run.smithi031:> sudo yum -y install ceph-mgr 2024-09-22T08:34:44.569 INFO:teuthology.orchestra.run.smithi031.stdout:Last metadata expiration check: 0:01:07 ago on Sun 22 Sep 2024 08:33:37 AM UTC. 2024-09-22T08:34:44.662 INFO:teuthology.orchestra.run.smithi031.stdout:Package ceph-mgr-2:19.3.0-5106.g8852379c.el9.x86_64 is already installed. 2024-09-22T08:34:44.673 INFO:teuthology.orchestra.run.smithi142.stdout:(11/12): openblas-openmp-0.3.26-2.el9.x86_64.rp 4.5 MB/s | 4.9 MB 00:01 2024-09-22T08:34:44.707 INFO:teuthology.orchestra.run.smithi031.stdout:Dependencies resolved. 2024-09-22T08:34:44.708 INFO:teuthology.orchestra.run.smithi031.stdout:Nothing to do. 2024-09-22T08:34:44.708 INFO:teuthology.orchestra.run.smithi031.stdout:Complete! 2024-09-22T08:34:44.774 DEBUG:teuthology.orchestra.run.smithi031:> sudo yum -y install ceph-mgr-dashboard 2024-09-22T08:34:45.376 INFO:teuthology.orchestra.run.smithi031.stdout:Last metadata expiration check: 0:01:08 ago on Sun 22 Sep 2024 08:33:37 AM UTC. 2024-09-22T08:34:45.516 INFO:teuthology.orchestra.run.smithi031.stdout:Dependencies resolved. 2024-09-22T08:34:45.517 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2024-09-22T08:34:45.517 INFO:teuthology.orchestra.run.smithi031.stdout: Package Arch Version Repository Size 2024-09-22T08:34:45.517 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2024-09-22T08:34:45.517 INFO:teuthology.orchestra.run.smithi031.stdout:Installing: 2024-09-22T08:34:45.517 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mgr-dashboard noarch 2:19.3.0-5106.g8852379c.el9 ceph-noarch 14 M 2024-09-22T08:34:45.518 INFO:teuthology.orchestra.run.smithi031.stdout:Installing dependencies: 2024-09-22T08:34:45.518 INFO:teuthology.orchestra.run.smithi031.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-22T08:34:45.518 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-grafana-dashboards noarch 2:19.3.0-5106.g8852379c.el9 ceph-noarch 34 k 2024-09-22T08:34:45.518 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-prometheus-alerts noarch 2:19.3.0-5106.g8852379c.el9 ceph-noarch 16 k 2024-09-22T08:34:45.518 INFO:teuthology.orchestra.run.smithi031.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-22T08:34:45.518 INFO:teuthology.orchestra.run.smithi031.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-22T08:34:45.518 INFO:teuthology.orchestra.run.smithi031.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-22T08:34:45.518 INFO:teuthology.orchestra.run.smithi031.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-22T08:34:45.518 INFO:teuthology.orchestra.run.smithi031.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-22T08:34:45.518 INFO:teuthology.orchestra.run.smithi031.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-22T08:34:45.518 INFO:teuthology.orchestra.run.smithi031.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-22T08:34:45.518 INFO:teuthology.orchestra.run.smithi031.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-22T08:34:45.518 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-22T08:34:45.519 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction Summary 2024-09-22T08:34:45.519 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2024-09-22T08:34:45.519 INFO:teuthology.orchestra.run.smithi031.stdout:Install 12 Packages 2024-09-22T08:34:45.519 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-22T08:34:45.519 INFO:teuthology.orchestra.run.smithi031.stdout:Total download size: 19 M 2024-09-22T08:34:45.519 INFO:teuthology.orchestra.run.smithi031.stdout:Installed size: 159 M 2024-09-22T08:34:45.519 INFO:teuthology.orchestra.run.smithi031.stdout:Downloading Packages: 2024-09-22T08:34:46.126 INFO:teuthology.orchestra.run.smithi031.stdout:(1/12): ceph-prometheus-alerts-19.3.0-5106.g885 101 kB/s | 16 kB 00:00 2024-09-22T08:34:46.151 INFO:teuthology.orchestra.run.smithi031.stdout:(2/12): ceph-grafana-dashboards-19.3.0-5106.g88 182 kB/s | 34 kB 00:00 2024-09-22T08:34:46.281 INFO:teuthology.orchestra.run.smithi142.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 6.6 MB/s | 16 MB 00:02 2024-09-22T08:34:46.282 INFO:teuthology.orchestra.run.smithi142.stdout:-------------------------------------------------------------------------------- 2024-09-22T08:34:46.282 INFO:teuthology.orchestra.run.smithi142.stdout:Total 12 MB/s | 38 MB 00:03 2024-09-22T08:34:46.319 INFO:teuthology.orchestra.run.smithi031.stdout:(3/12): python3-protobuf-3.14.0-13.el9.noarch.r 1.6 MB/s | 269 kB 00:00 2024-09-22T08:34:46.461 INFO:teuthology.orchestra.run.smithi031.stdout:(4/12): protobuf-3.14.0-13.el9.x86_64.rpm 3.0 MB/s | 1.0 MB 00:00 2024-09-22T08:34:46.502 INFO:teuthology.orchestra.run.smithi031.stdout:(5/12): protobuf-compiler-3.14.0-13.el9.x86_64. 4.6 MB/s | 863 kB 00:00 2024-09-22T08:34:46.638 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction check 2024-09-22T08:34:46.653 INFO:teuthology.orchestra.run.smithi031.stdout:(6/12): ceph-mgr-dashboard-19.3.0-5106.g8852379 21 MB/s | 14 MB 00:00 2024-09-22T08:34:46.664 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction check succeeded. 2024-09-22T08:34:46.664 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction test 2024-09-22T08:34:46.686 INFO:teuthology.orchestra.run.smithi031.stdout:(7/12): abseil-cpp-20211102.0-3.el9.x86_64.rpm 2.4 MB/s | 548 kB 00:00 2024-09-22T08:34:46.720 INFO:teuthology.orchestra.run.smithi031.stdout:(8/12): grpc-data-1.46.7-10.el9.noarch.rpm 90 kB/s | 19 kB 00:00 2024-09-22T08:34:46.745 INFO:teuthology.orchestra.run.smithi031.stdout:(9/12): python3-repoze-lru-0.7-16.el9.noarch.rp 1.3 MB/s | 31 kB 00:00 2024-09-22T08:34:46.770 INFO:teuthology.orchestra.run.smithi031.stdout:(10/12): python3-grpcio-tools-1.46.7-10.el9.x86 1.8 MB/s | 144 kB 00:00 2024-09-22T08:34:46.796 INFO:teuthology.orchestra.run.smithi031.stdout:(11/12): python3-routes-2.5.1-5.el9.noarch.rpm 3.7 MB/s | 188 kB 00:00 2024-09-22T08:34:46.871 INFO:teuthology.orchestra.run.smithi031.stdout:(12/12): python3-grpcio-1.46.7-10.el9.x86_64.rp 9.5 MB/s | 2.0 MB 00:00 2024-09-22T08:34:46.874 INFO:teuthology.orchestra.run.smithi031.stdout:-------------------------------------------------------------------------------- 2024-09-22T08:34:46.875 INFO:teuthology.orchestra.run.smithi031.stdout:Total 14 MB/s | 19 MB 00:01 2024-09-22T08:34:46.923 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction check 2024-09-22T08:34:46.943 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction check succeeded. 2024-09-22T08:34:46.944 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction test 2024-09-22T08:34:47.097 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction test succeeded. 2024-09-22T08:34:47.098 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction 2024-09-22T08:34:47.228 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction test succeeded. 2024-09-22T08:34:47.228 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction 2024-09-22T08:34:47.839 INFO:teuthology.orchestra.run.smithi031.stdout: Preparing : 1/1 2024-09-22T08:34:47.870 INFO:teuthology.orchestra.run.smithi142.stdout: Preparing : 1/1 2024-09-22T08:34:47.914 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 1/12 2024-09-22T08:34:47.939 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-22T08:34:47.957 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 2/12 2024-09-22T08:34:47.979 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-22T08:34:48.005 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/12 2024-09-22T08:34:48.042 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/12 2024-09-22T08:34:48.081 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-22T08:34:48.122 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-22T08:34:48.155 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 5/12 2024-09-22T08:34:48.299 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 6/12 2024-09-22T08:34:48.307 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-22T08:34:48.337 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-22T08:34:48.399 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 7/12 2024-09-22T08:34:48.423 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-22T08:34:48.458 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 8/12 2024-09-22T08:34:48.491 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/12 2024-09-22T08:34:48.524 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-5106.g8852379c.el9 10/12 2024-09-22T08:34:49.082 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-22T08:34:49.217 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-22T08:34:50.462 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-22T08:34:51.500 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-22T08:34:51.537 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-5106.g88523 12/12 2024-09-22T08:34:51.919 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-5106.g8852379c.el 11/12 2024-09-22T08:34:51.969 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-5106.g8852379c.el9.noa 12/12 2024-09-22T08:34:53.864 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-5106.g8852379c.el9.noa 12/12 2024-09-22T08:34:53.865 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-5106.g8852379c.el 1/12 2024-09-22T08:34:53.865 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-5106.g8852379c.el9.noa 2/12 2024-09-22T08:34:53.865 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-5106.g8852379c.el9 3/12 2024-09-22T08:34:53.865 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 4/12 2024-09-22T08:34:53.865 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 5/12 2024-09-22T08:34:53.865 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 6/12 2024-09-22T08:34:53.865 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 7/12 2024-09-22T08:34:53.865 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 8/12 2024-09-22T08:34:53.865 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 9/12 2024-09-22T08:34:53.865 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/12 2024-09-22T08:34:53.866 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 11/12 2024-09-22T08:34:54.059 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-5106.g88523 12/12 2024-09-22T08:34:54.059 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-5106.g88523 1/12 2024-09-22T08:34:54.059 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-22T08:34:54.059 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-22T08:34:54.059 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-22T08:34:54.059 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-22T08:34:54.059 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-22T08:34:54.060 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-22T08:34:54.060 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-22T08:34:54.060 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-22T08:34:54.060 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-22T08:34:54.060 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-22T08:34:54.184 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 12/12 2024-09-22T08:34:54.184 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-22T08:34:54.184 INFO:teuthology.orchestra.run.smithi031.stdout:Installed: 2024-09-22T08:34:54.184 INFO:teuthology.orchestra.run.smithi031.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-22T08:34:54.185 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-grafana-dashboards-2:19.3.0-5106.g8852379c.el9.noarch 2024-09-22T08:34:54.185 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mgr-dashboard-2:19.3.0-5106.g8852379c.el9.noarch 2024-09-22T08:34:54.185 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-prometheus-alerts-2:19.3.0-5106.g8852379c.el9.noarch 2024-09-22T08:34:54.185 INFO:teuthology.orchestra.run.smithi031.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-22T08:34:54.185 INFO:teuthology.orchestra.run.smithi031.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-22T08:34:54.185 INFO:teuthology.orchestra.run.smithi031.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-22T08:34:54.185 INFO:teuthology.orchestra.run.smithi031.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-22T08:34:54.185 INFO:teuthology.orchestra.run.smithi031.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-22T08:34:54.185 INFO:teuthology.orchestra.run.smithi031.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-22T08:34:54.185 INFO:teuthology.orchestra.run.smithi031.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-22T08:34:54.185 INFO:teuthology.orchestra.run.smithi031.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-22T08:34:54.185 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-22T08:34:54.185 INFO:teuthology.orchestra.run.smithi031.stdout:Complete! 2024-09-22T08:34:54.431 DEBUG:teuthology.orchestra.run.smithi031:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-22T08:34:54.482 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-22T08:34:54.482 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-22T08:34:54.482 INFO:teuthology.orchestra.run.smithi142.stdout:Installed: 2024-09-22T08:34:54.482 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-diskprediction-local-2:19.3.0-5106.g8852379c.el9.noarch 2024-09-22T08:34:54.482 INFO:teuthology.orchestra.run.smithi142.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-22T08:34:54.482 INFO:teuthology.orchestra.run.smithi142.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-22T08:34:54.483 INFO:teuthology.orchestra.run.smithi142.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-22T08:34:54.483 INFO:teuthology.orchestra.run.smithi142.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-22T08:34:54.483 INFO:teuthology.orchestra.run.smithi142.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-22T08:34:54.483 INFO:teuthology.orchestra.run.smithi142.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-22T08:34:54.483 INFO:teuthology.orchestra.run.smithi142.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-22T08:34:54.483 INFO:teuthology.orchestra.run.smithi142.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-22T08:34:54.483 INFO:teuthology.orchestra.run.smithi142.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-22T08:34:54.483 INFO:teuthology.orchestra.run.smithi142.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-22T08:34:54.483 INFO:teuthology.orchestra.run.smithi142.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-22T08:34:54.483 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-22T08:34:54.483 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-09-22T08:34:54.893 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install ceph-mgr-rook 2024-09-22T08:34:55.036 INFO:teuthology.orchestra.run.smithi031.stdout:Last metadata expiration check: 0:01:18 ago on Sun 22 Sep 2024 08:33:37 AM UTC. 2024-09-22T08:34:55.176 INFO:teuthology.orchestra.run.smithi031.stdout:Dependencies resolved. 2024-09-22T08:34:55.177 INFO:teuthology.orchestra.run.smithi031.stdout:======================================================================================= 2024-09-22T08:34:55.177 INFO:teuthology.orchestra.run.smithi031.stdout: Package Arch Version Repository Size 2024-09-22T08:34:55.177 INFO:teuthology.orchestra.run.smithi031.stdout:======================================================================================= 2024-09-22T08:34:55.177 INFO:teuthology.orchestra.run.smithi031.stdout:Installing: 2024-09-22T08:34:55.177 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-5106.g8852379c.el9 ceph-noarch 7.4 M 2024-09-22T08:34:55.177 INFO:teuthology.orchestra.run.smithi031.stdout:Installing dependencies: 2024-09-22T08:34:55.177 INFO:teuthology.orchestra.run.smithi031.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-22T08:34:55.178 INFO:teuthology.orchestra.run.smithi031.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-22T08:34:55.178 INFO:teuthology.orchestra.run.smithi031.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-22T08:34:55.178 INFO:teuthology.orchestra.run.smithi031.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-22T08:34:55.178 INFO:teuthology.orchestra.run.smithi031.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-22T08:34:55.178 INFO:teuthology.orchestra.run.smithi031.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-22T08:34:55.178 INFO:teuthology.orchestra.run.smithi031.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-22T08:34:55.178 INFO:teuthology.orchestra.run.smithi031.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-22T08:34:55.178 INFO:teuthology.orchestra.run.smithi031.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-22T08:34:55.178 INFO:teuthology.orchestra.run.smithi031.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-22T08:34:55.178 INFO:teuthology.orchestra.run.smithi031.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-22T08:34:55.178 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-22T08:34:55.178 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction Summary 2024-09-22T08:34:55.178 INFO:teuthology.orchestra.run.smithi031.stdout:======================================================================================= 2024-09-22T08:34:55.178 INFO:teuthology.orchestra.run.smithi031.stdout:Install 12 Packages 2024-09-22T08:34:55.179 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-22T08:34:55.179 INFO:teuthology.orchestra.run.smithi031.stdout:Total download size: 38 M 2024-09-22T08:34:55.179 INFO:teuthology.orchestra.run.smithi031.stdout:Installed size: 212 M 2024-09-22T08:34:55.179 INFO:teuthology.orchestra.run.smithi031.stdout:Downloading Packages: 2024-09-22T08:34:55.486 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:01:20 ago on Sun 22 Sep 2024 08:33:35 AM UTC. 2024-09-22T08:34:55.618 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-09-22T08:34:55.620 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-22T08:34:55.620 INFO:teuthology.orchestra.run.smithi142.stdout: Package Arch Version Repository Size 2024-09-22T08:34:55.620 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-22T08:34:55.620 INFO:teuthology.orchestra.run.smithi142.stdout:Installing: 2024-09-22T08:34:55.620 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-rook noarch 2:19.3.0-5106.g8852379c.el9 ceph-noarch 49 k 2024-09-22T08:34:55.620 INFO:teuthology.orchestra.run.smithi142.stdout:Installing dependencies: 2024-09-22T08:34:55.620 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-22T08:34:55.620 INFO:teuthology.orchestra.run.smithi142.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-22T08:34:55.620 INFO:teuthology.orchestra.run.smithi142.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-22T08:34:55.620 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-22T08:34:55.621 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-22T08:34:55.621 INFO:teuthology.orchestra.run.smithi142.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-22T08:34:55.621 INFO:teuthology.orchestra.run.smithi142.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-22T08:34:55.621 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-22T08:34:55.621 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-22T08:34:55.621 INFO:teuthology.orchestra.run.smithi142.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-22T08:34:55.621 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-22T08:34:55.621 INFO:teuthology.orchestra.run.smithi142.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-22T08:34:55.621 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-22T08:34:55.621 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2024-09-22T08:34:55.621 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-22T08:34:55.621 INFO:teuthology.orchestra.run.smithi142.stdout:Install 13 Packages 2024-09-22T08:34:55.621 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-22T08:34:55.622 INFO:teuthology.orchestra.run.smithi142.stdout:Total download size: 2.2 M 2024-09-22T08:34:55.622 INFO:teuthology.orchestra.run.smithi142.stdout:Installed size: 26 M 2024-09-22T08:34:55.622 INFO:teuthology.orchestra.run.smithi142.stdout:Downloading Packages: 2024-09-22T08:34:55.727 INFO:teuthology.orchestra.run.smithi031.stdout:(1/12): ceph-mgr-diskprediction-local-19.3.0-51 16 MB/s | 7.4 MB 00:00 2024-09-22T08:34:55.794 INFO:teuthology.orchestra.run.smithi031.stdout:(2/12): flexiblas-3.0.4-8.el9.x86_64.rpm 492 kB/s | 33 kB 00:00 2024-09-22T08:34:55.819 INFO:teuthology.orchestra.run.smithi031.stdout:(3/12): libquadmath-11.5.0-2.el9.x86_64.rpm 349 kB/s | 191 kB 00:00 2024-09-22T08:34:55.886 INFO:teuthology.orchestra.run.smithi031.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 272 kB/s | 18 kB 00:00 2024-09-22T08:34:55.887 INFO:teuthology.orchestra.run.smithi142.stdout:(1/13): python3-jsonpointer-2.0-4.el9.noarch.rp 242 kB/s | 19 kB 00:00 2024-09-22T08:34:55.912 INFO:teuthology.orchestra.run.smithi142.stdout:(2/13): python3-jsonpatch-1.21-16.el9.noarch.rp 245 kB/s | 26 kB 00:00 2024-09-22T08:34:55.977 INFO:teuthology.orchestra.run.smithi031.stdout:(5/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 16 MB/s | 3.0 MB 00:00 2024-09-22T08:34:55.979 INFO:teuthology.orchestra.run.smithi142.stdout:(3/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 2.4 MB/s | 222 kB 00:00 2024-09-22T08:34:56.002 INFO:teuthology.orchestra.run.smithi031.stdout:(6/12): openblas-0.3.26-2.el9.x86_64.rpm 330 kB/s | 38 kB 00:00 2024-09-22T08:34:56.005 INFO:teuthology.orchestra.run.smithi142.stdout:(4/13): ceph-mgr-rook-19.3.0-5106.g8852379c.el9 250 kB/s | 49 kB 00:00 2024-09-22T08:34:56.030 INFO:teuthology.orchestra.run.smithi142.stdout:(5/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.3 MB/s | 159 kB 00:00 2024-09-22T08:34:56.072 INFO:teuthology.orchestra.run.smithi142.stdout:(6/13): python3-cachetools-4.2.4-1.el9.noarch.r 772 kB/s | 32 kB 00:00 2024-09-22T08:34:56.098 INFO:teuthology.orchestra.run.smithi142.stdout:(7/13): python3-pyasn1-modules-0.4.8-6.el9.noar 2.3 MB/s | 279 kB 00:00 2024-09-22T08:34:56.111 INFO:teuthology.orchestra.run.smithi031.stdout:(7/12): openblas-openmp-0.3.26-2.el9.x86_64.rpm 37 MB/s | 4.9 MB 00:00 2024-09-22T08:34:56.122 INFO:teuthology.orchestra.run.smithi142.stdout:(8/13): python3-requests-oauthlib-1.3.0-12.el9. 457 kB/s | 54 kB 00:00 2024-09-22T08:34:56.137 INFO:teuthology.orchestra.run.smithi031.stdout:(8/12): python3-devel-3.9.19-8.el9.x86_64.rpm 1.8 MB/s | 245 kB 00:00 2024-09-22T08:34:56.156 INFO:teuthology.orchestra.run.smithi142.stdout:(9/13): python3-certifi-2023.05.07-4.el9.noarch 168 kB/s | 14 kB 00:00 2024-09-22T08:34:56.162 INFO:teuthology.orchestra.run.smithi031.stdout:(9/12): libgfortran-11.5.0-2.el9.x86_64.rpm 900 kB/s | 801 kB 00:00 2024-09-22T08:34:56.206 INFO:teuthology.orchestra.run.smithi142.stdout:(10/13): python3-kubernetes-26.1.0-2.el9.noarch 13 MB/s | 1.0 MB 00:00 2024-09-22T08:34:56.231 INFO:teuthology.orchestra.run.smithi142.stdout:(11/13): python3-google-auth-2.34.0-1.el9.noarc 1.6 MB/s | 220 kB 00:00 2024-09-22T08:34:56.254 INFO:teuthology.orchestra.run.smithi031.stdout:(10/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 36 MB/s | 5.1 MB 00:00 2024-09-22T08:34:56.256 INFO:teuthology.orchestra.run.smithi142.stdout:(12/13): python3-rsa-4.9-2.el9.noarch.rpm 600 kB/s | 59 kB 00:00 2024-09-22T08:34:56.279 INFO:teuthology.orchestra.run.smithi031.stdout:(11/12): python3-numpy-f2py-1.20.1-5.el9.x86_64 1.7 MB/s | 250 kB 00:00 2024-09-22T08:34:56.282 INFO:teuthology.orchestra.run.smithi142.stdout:(13/13): python3-websocket-client-1.2.3-2.el9.n 1.2 MB/s | 90 kB 00:00 2024-09-22T08:34:56.285 INFO:teuthology.orchestra.run.smithi142.stdout:-------------------------------------------------------------------------------- 2024-09-22T08:34:56.285 INFO:teuthology.orchestra.run.smithi142.stdout:Total 3.3 MB/s | 2.2 MB 00:00 2024-09-22T08:34:56.348 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction check 2024-09-22T08:34:56.362 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction check succeeded. 2024-09-22T08:34:56.363 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction test 2024-09-22T08:34:56.452 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction test succeeded. 2024-09-22T08:34:56.453 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction 2024-09-22T08:34:56.671 INFO:teuthology.orchestra.run.smithi031.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 32 MB/s | 16 MB 00:00 2024-09-22T08:34:56.671 INFO:teuthology.orchestra.run.smithi031.stdout:-------------------------------------------------------------------------------- 2024-09-22T08:34:56.671 INFO:teuthology.orchestra.run.smithi031.stdout:Total 26 MB/s | 38 MB 00:01 2024-09-22T08:34:56.955 INFO:teuthology.orchestra.run.smithi142.stdout: Preparing : 1/1 2024-09-22T08:34:57.032 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction check 2024-09-22T08:34:57.060 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction check succeeded. 2024-09-22T08:34:57.060 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction test 2024-09-22T08:34:57.135 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-22T08:34:57.183 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-22T08:34:57.239 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-22T08:34:57.276 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-22T08:34:57.333 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-22T08:34:57.445 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-22T08:34:57.524 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction test succeeded. 2024-09-22T08:34:57.524 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction 2024-09-22T08:34:57.545 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-22T08:34:57.602 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-22T08:34:58.310 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-22T08:34:58.357 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-22T08:34:58.391 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-22T08:34:58.439 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-22T08:34:58.441 INFO:teuthology.orchestra.run.smithi031.stdout: Preparing : 1/1 2024-09-22T08:34:58.469 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mgr-rook-2:19.3.0-5106.g8852379c.el9.noarch 13/13 2024-09-22T08:34:58.495 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-22T08:34:58.536 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-22T08:34:58.639 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-22T08:34:58.679 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-22T08:34:58.872 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-22T08:34:58.903 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-22T08:34:58.982 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-22T08:34:59.138 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-5106.g8852379c.el9.noarch 13/13 2024-09-22T08:34:59.139 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mgr-rook-2:19.3.0-5106.g8852379c.el9.noarch 1/13 2024-09-22T08:34:59.139 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-22T08:34:59.139 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-22T08:34:59.139 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-22T08:34:59.139 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-22T08:34:59.139 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-22T08:34:59.139 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-22T08:34:59.139 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-22T08:34:59.139 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-22T08:34:59.139 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-22T08:34:59.139 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-22T08:34:59.139 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-22T08:34:59.487 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-22T08:34:59.487 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-22T08:34:59.487 INFO:teuthology.orchestra.run.smithi142.stdout:Installed: 2024-09-22T08:34:59.487 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-rook-2:19.3.0-5106.g8852379c.el9.noarch 2024-09-22T08:34:59.487 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-22T08:34:59.487 INFO:teuthology.orchestra.run.smithi142.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-22T08:34:59.488 INFO:teuthology.orchestra.run.smithi142.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-22T08:34:59.488 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-22T08:34:59.488 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-22T08:34:59.488 INFO:teuthology.orchestra.run.smithi142.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-22T08:34:59.488 INFO:teuthology.orchestra.run.smithi142.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-22T08:34:59.488 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-22T08:34:59.488 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-22T08:34:59.488 INFO:teuthology.orchestra.run.smithi142.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-22T08:34:59.488 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-22T08:34:59.488 INFO:teuthology.orchestra.run.smithi142.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-22T08:34:59.488 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-22T08:34:59.488 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-09-22T08:34:59.667 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-22T08:34:59.786 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-22T08:34:59.787 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install ceph-mgr-cephadm 2024-09-22T08:35:00.365 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:01:25 ago on Sun 22 Sep 2024 08:33:35 AM UTC. 2024-09-22T08:35:00.500 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-09-22T08:35:00.501 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-22T08:35:00.501 INFO:teuthology.orchestra.run.smithi142.stdout: Package Arch Version Repository Size 2024-09-22T08:35:00.501 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-22T08:35:00.501 INFO:teuthology.orchestra.run.smithi142.stdout:Installing: 2024-09-22T08:35:00.501 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-cephadm noarch 2:19.3.0-5106.g8852379c.el9 ceph-noarch 154 k 2024-09-22T08:35:00.501 INFO:teuthology.orchestra.run.smithi142.stdout:Installing dependencies: 2024-09-22T08:35:00.501 INFO:teuthology.orchestra.run.smithi142.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-22T08:35:00.501 INFO:teuthology.orchestra.run.smithi142.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-22T08:35:00.501 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-22T08:35:00.501 INFO:teuthology.orchestra.run.smithi142.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-22T08:35:00.501 INFO:teuthology.orchestra.run.smithi142.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-22T08:35:00.502 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-22T08:35:00.502 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2024-09-22T08:35:00.502 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-22T08:35:00.502 INFO:teuthology.orchestra.run.smithi142.stdout:Install 6 Packages 2024-09-22T08:35:00.502 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-22T08:35:00.502 INFO:teuthology.orchestra.run.smithi142.stdout:Total download size: 7.0 M 2024-09-22T08:35:00.502 INFO:teuthology.orchestra.run.smithi142.stdout:Installed size: 33 M 2024-09-22T08:35:00.503 INFO:teuthology.orchestra.run.smithi142.stdout:Downloading Packages: 2024-09-22T08:35:01.087 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-22T08:35:01.142 INFO:teuthology.orchestra.run.smithi142.stdout:(1/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 1.1 MB/s | 248 kB 00:00 2024-09-22T08:35:01.167 INFO:teuthology.orchestra.run.smithi142.stdout:(2/6): ceph-mgr-cephadm-19.3.0-5106.g8852379c.e 634 kB/s | 154 kB 00:00 2024-09-22T08:35:01.226 INFO:teuthology.orchestra.run.smithi142.stdout:(3/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 6.4 MB/s | 548 kB 00:00 2024-09-22T08:35:01.251 INFO:teuthology.orchestra.run.smithi142.stdout:(4/6): python3-natsort-7.1.1-5.el9.noarch.rpm 689 kB/s | 58 kB 00:00 2024-09-22T08:35:01.277 INFO:teuthology.orchestra.run.smithi142.stdout:(5/6): python3-typing-extensions-4.12.2-2.el9.n 1.5 MB/s | 74 kB 00:00 2024-09-22T08:35:01.394 INFO:teuthology.orchestra.run.smithi142.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 13 MB/s | 6.0 MB 00:00 2024-09-22T08:35:01.396 INFO:teuthology.orchestra.run.smithi142.stdout:-------------------------------------------------------------------------------- 2024-09-22T08:35:01.396 INFO:teuthology.orchestra.run.smithi142.stdout:Total 7.8 MB/s | 7.0 MB 00:00 2024-09-22T08:35:01.468 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction check 2024-09-22T08:35:01.479 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction check succeeded. 2024-09-22T08:35:01.479 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction test 2024-09-22T08:35:01.579 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction test succeeded. 2024-09-22T08:35:01.579 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction 2024-09-22T08:35:01.890 INFO:teuthology.orchestra.run.smithi142.stdout: Preparing : 1/1 2024-09-22T08:35:02.059 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-22T08:35:02.112 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-22T08:35:02.179 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-22T08:35:02.209 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-5106.g88523 12/12 2024-09-22T08:35:02.646 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-22T08:35:02.740 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-22T08:35:02.807 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-22T08:35:02.833 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-5106.g8852379c.el9.noarch 6/6 2024-09-22T08:35:03.616 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-5106.g8852379c.el9.noarch 6/6 2024-09-22T08:35:03.629 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-5106.g8852379c.el9.noarch 1/6 2024-09-22T08:35:03.629 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-22T08:35:03.629 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-22T08:35:03.629 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-22T08:35:03.629 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-22T08:35:03.878 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-22T08:35:03.878 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-22T08:35:03.878 INFO:teuthology.orchestra.run.smithi142.stdout:Installed: 2024-09-22T08:35:03.878 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-cephadm-2:19.3.0-5106.g8852379c.el9.noarch 2024-09-22T08:35:03.878 INFO:teuthology.orchestra.run.smithi142.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-22T08:35:03.878 INFO:teuthology.orchestra.run.smithi142.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-22T08:35:03.878 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-22T08:35:03.879 INFO:teuthology.orchestra.run.smithi142.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-22T08:35:03.879 INFO:teuthology.orchestra.run.smithi142.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-22T08:35:03.879 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-22T08:35:03.879 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-09-22T08:35:04.177 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install ceph-fuse 2024-09-22T08:35:04.679 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-5106.g88523 12/12 2024-09-22T08:35:04.679 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-5106.g88523 1/12 2024-09-22T08:35:04.679 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-22T08:35:04.679 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-22T08:35:04.679 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-22T08:35:04.679 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-22T08:35:04.679 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-22T08:35:04.679 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-22T08:35:04.679 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-22T08:35:04.679 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-22T08:35:04.680 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-22T08:35:04.680 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-22T08:35:04.758 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:01:29 ago on Sun 22 Sep 2024 08:33:35 AM UTC. 2024-09-22T08:35:04.891 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-09-22T08:35:04.891 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-22T08:35:04.891 INFO:teuthology.orchestra.run.smithi142.stdout: Package Arch Version Repository Size 2024-09-22T08:35:04.891 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-22T08:35:04.892 INFO:teuthology.orchestra.run.smithi142.stdout:Installing: 2024-09-22T08:35:04.892 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-fuse x86_64 2:19.3.0-5106.g8852379c.el9 ceph 900 k 2024-09-22T08:35:04.892 INFO:teuthology.orchestra.run.smithi142.stdout:Installing dependencies: 2024-09-22T08:35:04.892 INFO:teuthology.orchestra.run.smithi142.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-22T08:35:04.892 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-22T08:35:04.892 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2024-09-22T08:35:04.892 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-22T08:35:04.892 INFO:teuthology.orchestra.run.smithi142.stdout:Install 2 Packages 2024-09-22T08:35:04.892 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-22T08:35:04.893 INFO:teuthology.orchestra.run.smithi142.stdout:Total download size: 980 k 2024-09-22T08:35:04.893 INFO:teuthology.orchestra.run.smithi142.stdout:Installed size: 2.9 M 2024-09-22T08:35:04.893 INFO:teuthology.orchestra.run.smithi142.stdout:Downloading Packages: 2024-09-22T08:35:05.029 INFO:teuthology.orchestra.run.smithi142.stdout:(1/2): fuse-2.9.9-16.el9.x86_64.rpm 702 kB/s | 80 kB 00:00 2024-09-22T08:35:05.060 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-22T08:35:05.060 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-22T08:35:05.060 INFO:teuthology.orchestra.run.smithi031.stdout:Installed: 2024-09-22T08:35:05.060 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mgr-diskprediction-local-2:19.3.0-5106.g8852379c.el9.noarch 2024-09-22T08:35:05.060 INFO:teuthology.orchestra.run.smithi031.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-22T08:35:05.060 INFO:teuthology.orchestra.run.smithi031.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-22T08:35:05.060 INFO:teuthology.orchestra.run.smithi031.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-22T08:35:05.060 INFO:teuthology.orchestra.run.smithi031.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-22T08:35:05.060 INFO:teuthology.orchestra.run.smithi031.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-22T08:35:05.060 INFO:teuthology.orchestra.run.smithi031.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-22T08:35:05.060 INFO:teuthology.orchestra.run.smithi031.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-22T08:35:05.060 INFO:teuthology.orchestra.run.smithi031.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-22T08:35:05.061 INFO:teuthology.orchestra.run.smithi031.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-22T08:35:05.061 INFO:teuthology.orchestra.run.smithi031.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-22T08:35:05.061 INFO:teuthology.orchestra.run.smithi031.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-22T08:35:05.061 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-22T08:35:05.061 INFO:teuthology.orchestra.run.smithi031.stdout:Complete! 2024-09-22T08:35:05.212 INFO:teuthology.orchestra.run.smithi142.stdout:(2/2): ceph-fuse-19.3.0-5106.g8852379c.el9.x86_ 3.0 MB/s | 900 kB 00:00 2024-09-22T08:35:05.213 INFO:teuthology.orchestra.run.smithi142.stdout:-------------------------------------------------------------------------------- 2024-09-22T08:35:05.213 INFO:teuthology.orchestra.run.smithi142.stdout:Total 3.0 MB/s | 980 kB 00:00 2024-09-22T08:35:05.224 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction check 2024-09-22T08:35:05.245 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction check succeeded. 2024-09-22T08:35:05.245 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction test 2024-09-22T08:35:05.325 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction test succeeded. 2024-09-22T08:35:05.326 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction 2024-09-22T08:35:05.423 DEBUG:teuthology.orchestra.run.smithi031:> sudo yum -y install ceph-mgr-rook 2024-09-22T08:35:05.510 INFO:teuthology.orchestra.run.smithi142.stdout: Preparing : 1/1 2024-09-22T08:35:05.639 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-22T08:35:05.703 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-fuse-2:19.3.0-5106.g8852379c.el9.x86_64 2/2 2024-09-22T08:35:06.031 INFO:teuthology.orchestra.run.smithi031.stdout:Last metadata expiration check: 0:01:29 ago on Sun 22 Sep 2024 08:33:37 AM UTC. 2024-09-22T08:35:06.170 INFO:teuthology.orchestra.run.smithi031.stdout:Dependencies resolved. 2024-09-22T08:35:06.171 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2024-09-22T08:35:06.171 INFO:teuthology.orchestra.run.smithi031.stdout: Package Arch Version Repository Size 2024-09-22T08:35:06.171 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2024-09-22T08:35:06.171 INFO:teuthology.orchestra.run.smithi031.stdout:Installing: 2024-09-22T08:35:06.171 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mgr-rook noarch 2:19.3.0-5106.g8852379c.el9 ceph-noarch 49 k 2024-09-22T08:35:06.171 INFO:teuthology.orchestra.run.smithi031.stdout:Installing dependencies: 2024-09-22T08:35:06.171 INFO:teuthology.orchestra.run.smithi031.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-22T08:35:06.171 INFO:teuthology.orchestra.run.smithi031.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-22T08:35:06.171 INFO:teuthology.orchestra.run.smithi031.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-22T08:35:06.171 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-22T08:35:06.172 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-22T08:35:06.172 INFO:teuthology.orchestra.run.smithi031.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-22T08:35:06.172 INFO:teuthology.orchestra.run.smithi031.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-22T08:35:06.172 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-22T08:35:06.172 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-22T08:35:06.172 INFO:teuthology.orchestra.run.smithi031.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-22T08:35:06.172 INFO:teuthology.orchestra.run.smithi031.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-22T08:35:06.172 INFO:teuthology.orchestra.run.smithi031.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-22T08:35:06.172 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-22T08:35:06.172 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction Summary 2024-09-22T08:35:06.172 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2024-09-22T08:35:06.172 INFO:teuthology.orchestra.run.smithi031.stdout:Install 13 Packages 2024-09-22T08:35:06.172 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-22T08:35:06.173 INFO:teuthology.orchestra.run.smithi031.stdout:Total download size: 2.2 M 2024-09-22T08:35:06.173 INFO:teuthology.orchestra.run.smithi031.stdout:Installed size: 26 M 2024-09-22T08:35:06.173 INFO:teuthology.orchestra.run.smithi031.stdout:Downloading Packages: 2024-09-22T08:35:06.383 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-fuse-2:19.3.0-5106.g8852379c.el9.x86_64 2/2 2024-09-22T08:35:06.383 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-fuse-2:19.3.0-5106.g8852379c.el9.x86_64 1/2 2024-09-22T08:35:06.641 INFO:teuthology.orchestra.run.smithi031.stdout:(1/13): python3-jsonpointer-2.0-4.el9.noarch.rp 211 kB/s | 19 kB 00:00 2024-09-22T08:35:06.667 INFO:teuthology.orchestra.run.smithi031.stdout:(2/13): python3-jsonpatch-1.21-16.el9.noarch.rp 220 kB/s | 26 kB 00:00 2024-09-22T08:35:06.686 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-22T08:35:06.686 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-22T08:35:06.686 INFO:teuthology.orchestra.run.smithi142.stdout:Installed: 2024-09-22T08:35:06.686 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-fuse-2:19.3.0-5106.g8852379c.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-22T08:35:06.686 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-22T08:35:06.687 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-09-22T08:35:06.750 INFO:teuthology.orchestra.run.smithi031.stdout:(3/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.9 MB/s | 159 kB 00:00 2024-09-22T08:35:06.775 INFO:teuthology.orchestra.run.smithi031.stdout:(4/13): ceph-mgr-rook-19.3.0-5106.g8852379c.el9 219 kB/s | 49 kB 00:00 2024-09-22T08:35:06.801 INFO:teuthology.orchestra.run.smithi031.stdout:(5/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 1.4 MB/s | 222 kB 00:00 2024-09-22T08:35:06.826 INFO:teuthology.orchestra.run.smithi031.stdout:(6/13): python3-pyasn1-modules-0.4.8-6.el9.noar 3.6 MB/s | 279 kB 00:00 2024-09-22T08:35:06.860 INFO:teuthology.orchestra.run.smithi031.stdout:(7/13): python3-requests-oauthlib-1.3.0-12.el9. 919 kB/s | 54 kB 00:00 2024-09-22T08:35:06.893 INFO:teuthology.orchestra.run.smithi031.stdout:(8/13): python3-cachetools-4.2.4-1.el9.noarch.r 350 kB/s | 32 kB 00:00 2024-09-22T08:35:06.927 INFO:teuthology.orchestra.run.smithi031.stdout:(9/13): python3-certifi-2023.05.07-4.el9.noarch 152 kB/s | 14 kB 00:00 2024-09-22T08:35:06.952 INFO:teuthology.orchestra.run.smithi031.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 2.5 MB/s | 59 kB 00:00 2024-09-22T08:35:06.975 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install ceph-volume 2024-09-22T08:35:06.977 INFO:teuthology.orchestra.run.smithi031.stdout:(11/13): python3-websocket-client-1.2.3-2.el9.n 3.5 MB/s | 90 kB 00:00 2024-09-22T08:35:07.003 INFO:teuthology.orchestra.run.smithi031.stdout:(12/13): python3-google-auth-2.34.0-1.el9.noarc 1.6 MB/s | 220 kB 00:00 2024-09-22T08:35:07.036 INFO:teuthology.orchestra.run.smithi031.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 7.7 MB/s | 1.0 MB 00:00 2024-09-22T08:35:07.038 INFO:teuthology.orchestra.run.smithi031.stdout:-------------------------------------------------------------------------------- 2024-09-22T08:35:07.039 INFO:teuthology.orchestra.run.smithi031.stdout:Total 2.6 MB/s | 2.2 MB 00:00 2024-09-22T08:35:07.106 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction check 2024-09-22T08:35:07.122 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction check succeeded. 2024-09-22T08:35:07.122 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction test 2024-09-22T08:35:07.220 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction test succeeded. 2024-09-22T08:35:07.221 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction 2024-09-22T08:35:07.563 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:01:32 ago on Sun 22 Sep 2024 08:33:35 AM UTC. 2024-09-22T08:35:07.699 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-09-22T08:35:07.700 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-22T08:35:07.700 INFO:teuthology.orchestra.run.smithi142.stdout: Package Arch Version Repository Size 2024-09-22T08:35:07.700 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-22T08:35:07.700 INFO:teuthology.orchestra.run.smithi142.stdout:Installing: 2024-09-22T08:35:07.700 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-volume noarch 2:19.3.0-5106.g8852379c.el9 ceph-noarch 285 k 2024-09-22T08:35:07.701 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-22T08:35:07.701 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2024-09-22T08:35:07.701 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-22T08:35:07.701 INFO:teuthology.orchestra.run.smithi142.stdout:Install 1 Package 2024-09-22T08:35:07.701 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-22T08:35:07.701 INFO:teuthology.orchestra.run.smithi142.stdout:Total download size: 285 k 2024-09-22T08:35:07.701 INFO:teuthology.orchestra.run.smithi142.stdout:Installed size: 1.3 M 2024-09-22T08:35:07.702 INFO:teuthology.orchestra.run.smithi142.stdout:Downloading Packages: 2024-09-22T08:35:07.870 INFO:teuthology.orchestra.run.smithi031.stdout: Preparing : 1/1 2024-09-22T08:35:07.933 INFO:teuthology.orchestra.run.smithi142.stdout:ceph-volume-19.3.0-5106.g8852379c.el9.noarch.rp 1.2 MB/s | 285 kB 00:00 2024-09-22T08:35:07.933 INFO:teuthology.orchestra.run.smithi142.stdout:-------------------------------------------------------------------------------- 2024-09-22T08:35:07.934 INFO:teuthology.orchestra.run.smithi142.stdout:Total 1.2 MB/s | 285 kB 00:00 2024-09-22T08:35:07.934 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction check 2024-09-22T08:35:07.943 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction check succeeded. 2024-09-22T08:35:07.943 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction test 2024-09-22T08:35:07.969 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction test succeeded. 2024-09-22T08:35:07.969 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction 2024-09-22T08:35:08.040 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-22T08:35:08.172 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-22T08:35:08.185 INFO:teuthology.orchestra.run.smithi142.stdout: Preparing : 1/1 2024-09-22T08:35:08.227 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-22T08:35:08.252 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-volume-2:19.3.0-5106.g8852379c.el9.noarch 1/1 2024-09-22T08:35:08.263 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-22T08:35:08.269 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-volume-2:19.3.0-5106.g8852379c.el9.noarch 1/1 2024-09-22T08:35:08.269 INFO:teuthology.orchestra.run.smithi142.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-22T08:35:08.269 INFO:teuthology.orchestra.run.smithi142.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-22T08:35:08.269 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-22T08:35:08.323 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-22T08:35:08.429 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-22T08:35:08.539 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-22T08:35:08.599 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-22T08:35:09.273 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-volume-2:19.3.0-5106.g8852379c.el9.noarch 1/1 2024-09-22T08:35:09.273 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-22T08:35:09.274 INFO:teuthology.orchestra.run.smithi142.stdout:Installed: 2024-09-22T08:35:09.274 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-volume-2:19.3.0-5106.g8852379c.el9.noarch 2024-09-22T08:35:09.274 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-22T08:35:09.274 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-09-22T08:35:09.360 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-22T08:35:09.420 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-22T08:35:09.453 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-22T08:35:09.503 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-22T08:35:09.531 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-mgr-rook-2:19.3.0-5106.g8852379c.el9.noarch 13/13 2024-09-22T08:35:09.610 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install librados-devel 2024-09-22T08:35:10.210 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:01:35 ago on Sun 22 Sep 2024 08:33:35 AM UTC. 2024-09-22T08:35:10.247 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-5106.g8852379c.el9.noarch 13/13 2024-09-22T08:35:10.247 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-mgr-rook-2:19.3.0-5106.g8852379c.el9.noarch 1/13 2024-09-22T08:35:10.247 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-22T08:35:10.247 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-22T08:35:10.247 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-22T08:35:10.247 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-22T08:35:10.247 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-22T08:35:10.247 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-22T08:35:10.247 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-22T08:35:10.247 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-22T08:35:10.247 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-22T08:35:10.247 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-22T08:35:10.248 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-22T08:35:10.344 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-09-22T08:35:10.345 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-22T08:35:10.345 INFO:teuthology.orchestra.run.smithi142.stdout: Package Arch Version Repo Size 2024-09-22T08:35:10.345 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-22T08:35:10.345 INFO:teuthology.orchestra.run.smithi142.stdout:Installing: 2024-09-22T08:35:10.345 INFO:teuthology.orchestra.run.smithi142.stdout: librados-devel x86_64 2:19.3.0-5106.g8852379c.el9 ceph 127 k 2024-09-22T08:35:10.345 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-22T08:35:10.345 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2024-09-22T08:35:10.345 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-22T08:35:10.345 INFO:teuthology.orchestra.run.smithi142.stdout:Install 1 Package 2024-09-22T08:35:10.345 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-22T08:35:10.346 INFO:teuthology.orchestra.run.smithi142.stdout:Total download size: 127 k 2024-09-22T08:35:10.346 INFO:teuthology.orchestra.run.smithi142.stdout:Installed size: 456 k 2024-09-22T08:35:10.346 INFO:teuthology.orchestra.run.smithi142.stdout:Downloading Packages: 2024-09-22T08:35:10.538 INFO:teuthology.orchestra.run.smithi142.stdout:librados-devel-19.3.0-5106.g8852379c.el9.x86_64 658 kB/s | 127 kB 00:00 2024-09-22T08:35:10.539 INFO:teuthology.orchestra.run.smithi142.stdout:-------------------------------------------------------------------------------- 2024-09-22T08:35:10.539 INFO:teuthology.orchestra.run.smithi142.stdout:Total 654 kB/s | 127 kB 00:00 2024-09-22T08:35:10.539 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction check 2024-09-22T08:35:10.545 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction check succeeded. 2024-09-22T08:35:10.545 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction test 2024-09-22T08:35:10.598 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-22T08:35:10.599 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-22T08:35:10.599 INFO:teuthology.orchestra.run.smithi031.stdout:Installed: 2024-09-22T08:35:10.599 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mgr-rook-2:19.3.0-5106.g8852379c.el9.noarch 2024-09-22T08:35:10.599 INFO:teuthology.orchestra.run.smithi031.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-22T08:35:10.599 INFO:teuthology.orchestra.run.smithi031.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-22T08:35:10.599 INFO:teuthology.orchestra.run.smithi031.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-22T08:35:10.599 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-22T08:35:10.599 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-22T08:35:10.599 INFO:teuthology.orchestra.run.smithi031.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-22T08:35:10.599 INFO:teuthology.orchestra.run.smithi031.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-22T08:35:10.599 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-22T08:35:10.599 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-22T08:35:10.599 INFO:teuthology.orchestra.run.smithi031.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-22T08:35:10.599 INFO:teuthology.orchestra.run.smithi031.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-22T08:35:10.600 INFO:teuthology.orchestra.run.smithi031.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-22T08:35:10.600 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-22T08:35:10.600 INFO:teuthology.orchestra.run.smithi031.stdout:Complete! 2024-09-22T08:35:10.609 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction test succeeded. 2024-09-22T08:35:10.609 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction 2024-09-22T08:35:10.758 INFO:teuthology.orchestra.run.smithi142.stdout: Preparing : 1/1 2024-09-22T08:35:10.859 DEBUG:teuthology.orchestra.run.smithi031:> sudo yum -y install ceph-mgr-cephadm 2024-09-22T08:35:10.870 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : librados-devel-2:19.3.0-5106.g8852379c.el9.x86_64 1/1 2024-09-22T08:35:11.355 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: librados-devel-2:19.3.0-5106.g8852379c.el9.x86_64 1/1 2024-09-22T08:35:11.467 INFO:teuthology.orchestra.run.smithi031.stdout:Last metadata expiration check: 0:01:34 ago on Sun 22 Sep 2024 08:33:37 AM UTC. 2024-09-22T08:35:11.605 INFO:teuthology.orchestra.run.smithi031.stdout:Dependencies resolved. 2024-09-22T08:35:11.605 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2024-09-22T08:35:11.605 INFO:teuthology.orchestra.run.smithi031.stdout: Package Arch Version Repository Size 2024-09-22T08:35:11.606 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2024-09-22T08:35:11.606 INFO:teuthology.orchestra.run.smithi031.stdout:Installing: 2024-09-22T08:35:11.606 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mgr-cephadm noarch 2:19.3.0-5106.g8852379c.el9 ceph-noarch 154 k 2024-09-22T08:35:11.606 INFO:teuthology.orchestra.run.smithi031.stdout:Installing dependencies: 2024-09-22T08:35:11.606 INFO:teuthology.orchestra.run.smithi031.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-22T08:35:11.606 INFO:teuthology.orchestra.run.smithi031.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-22T08:35:11.606 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-22T08:35:11.606 INFO:teuthology.orchestra.run.smithi031.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-22T08:35:11.606 INFO:teuthology.orchestra.run.smithi031.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-22T08:35:11.606 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-22T08:35:11.606 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction Summary 2024-09-22T08:35:11.607 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2024-09-22T08:35:11.607 INFO:teuthology.orchestra.run.smithi031.stdout:Install 6 Packages 2024-09-22T08:35:11.607 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-22T08:35:11.607 INFO:teuthology.orchestra.run.smithi031.stdout:Total download size: 7.0 M 2024-09-22T08:35:11.607 INFO:teuthology.orchestra.run.smithi031.stdout:Installed size: 33 M 2024-09-22T08:35:11.607 INFO:teuthology.orchestra.run.smithi031.stdout:Downloading Packages: 2024-09-22T08:35:11.628 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librados-devel-2:19.3.0-5106.g8852379c.el9.x86_64 1/1 2024-09-22T08:35:11.628 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-22T08:35:11.628 INFO:teuthology.orchestra.run.smithi142.stdout:Installed: 2024-09-22T08:35:11.628 INFO:teuthology.orchestra.run.smithi142.stdout: librados-devel-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:35:11.629 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-22T08:35:11.629 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-09-22T08:35:11.899 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install libcephfs2 2024-09-22T08:35:11.920 INFO:teuthology.orchestra.run.smithi031.stdout:(1/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 1.7 MB/s | 248 kB 00:00 2024-09-22T08:35:11.970 INFO:teuthology.orchestra.run.smithi031.stdout:(2/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 11 MB/s | 548 kB 00:00 2024-09-22T08:35:11.995 INFO:teuthology.orchestra.run.smithi031.stdout:(3/6): ceph-mgr-cephadm-19.3.0-5106.g8852379c.e 718 kB/s | 154 kB 00:00 2024-09-22T08:35:12.020 INFO:teuthology.orchestra.run.smithi031.stdout:(4/6): python3-natsort-7.1.1-5.el9.noarch.rpm 1.1 MB/s | 58 kB 00:00 2024-09-22T08:35:12.079 INFO:teuthology.orchestra.run.smithi031.stdout:(5/6): python3-typing-extensions-4.12.2-2.el9.n 891 kB/s | 74 kB 00:00 2024-09-22T08:35:12.154 INFO:teuthology.orchestra.run.smithi031.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 16 MB/s | 6.0 MB 00:00 2024-09-22T08:35:12.157 INFO:teuthology.orchestra.run.smithi031.stdout:-------------------------------------------------------------------------------- 2024-09-22T08:35:12.157 INFO:teuthology.orchestra.run.smithi031.stdout:Total 13 MB/s | 7.0 MB 00:00 2024-09-22T08:35:12.231 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction check 2024-09-22T08:35:12.243 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction check succeeded. 2024-09-22T08:35:12.243 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction test 2024-09-22T08:35:12.351 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction test succeeded. 2024-09-22T08:35:12.352 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction 2024-09-22T08:35:12.485 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:01:37 ago on Sun 22 Sep 2024 08:33:35 AM UTC. 2024-09-22T08:35:12.575 INFO:teuthology.orchestra.run.smithi142.stdout:Package libcephfs2-2:19.3.0-5106.g8852379c.el9.x86_64 is already installed. 2024-09-22T08:35:12.620 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-09-22T08:35:12.621 INFO:teuthology.orchestra.run.smithi142.stdout:Nothing to do. 2024-09-22T08:35:12.621 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-09-22T08:35:12.668 INFO:teuthology.orchestra.run.smithi031.stdout: Preparing : 1/1 2024-09-22T08:35:12.699 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install libcephfs-devel 2024-09-22T08:35:12.854 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-22T08:35:12.908 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-22T08:35:13.279 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:01:38 ago on Sun 22 Sep 2024 08:33:35 AM UTC. 2024-09-22T08:35:13.411 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-09-22T08:35:13.412 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-22T08:35:13.412 INFO:teuthology.orchestra.run.smithi142.stdout: Package Arch Version Repo Size 2024-09-22T08:35:13.412 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-22T08:35:13.412 INFO:teuthology.orchestra.run.smithi142.stdout:Installing: 2024-09-22T08:35:13.412 INFO:teuthology.orchestra.run.smithi142.stdout: libcephfs-devel x86_64 2:19.3.0-5106.g8852379c.el9 ceph 32 k 2024-09-22T08:35:13.412 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-22T08:35:13.412 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2024-09-22T08:35:13.412 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-22T08:35:13.412 INFO:teuthology.orchestra.run.smithi142.stdout:Install 1 Package 2024-09-22T08:35:13.412 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-22T08:35:13.413 INFO:teuthology.orchestra.run.smithi142.stdout:Total download size: 32 k 2024-09-22T08:35:13.413 INFO:teuthology.orchestra.run.smithi142.stdout:Installed size: 142 k 2024-09-22T08:35:13.413 INFO:teuthology.orchestra.run.smithi142.stdout:Downloading Packages: 2024-09-22T08:35:13.469 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-22T08:35:13.562 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-22T08:35:13.566 INFO:teuthology.orchestra.run.smithi142.stdout:libcephfs-devel-19.3.0-5106.g8852379c.el9.x86_6 207 kB/s | 32 kB 00:00 2024-09-22T08:35:13.567 INFO:teuthology.orchestra.run.smithi142.stdout:-------------------------------------------------------------------------------- 2024-09-22T08:35:13.567 INFO:teuthology.orchestra.run.smithi142.stdout:Total 205 kB/s | 32 kB 00:00 2024-09-22T08:35:13.570 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction check 2024-09-22T08:35:13.571 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction check succeeded. 2024-09-22T08:35:13.571 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction test 2024-09-22T08:35:13.589 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction test succeeded. 2024-09-22T08:35:13.589 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction 2024-09-22T08:35:13.638 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-22T08:35:13.668 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-5106.g8852379c.el9.noarch 6/6 2024-09-22T08:35:13.682 INFO:teuthology.orchestra.run.smithi142.stdout: Preparing : 1/1 2024-09-22T08:35:13.815 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libcephfs-devel-2:19.3.0-5106.g8852379c.el9.x86_64 1/1 2024-09-22T08:35:14.212 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: libcephfs-devel-2:19.3.0-5106.g8852379c.el9.x86_64 1/1 2024-09-22T08:35:14.407 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-5106.g8852379c.el9.noarch 6/6 2024-09-22T08:35:14.407 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-5106.g8852379c.el9.noarch 1/6 2024-09-22T08:35:14.407 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-22T08:35:14.407 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-22T08:35:14.407 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-22T08:35:14.407 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-22T08:35:14.432 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libcephfs-devel-2:19.3.0-5106.g8852379c.el9.x86_64 1/1 2024-09-22T08:35:14.432 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-22T08:35:14.432 INFO:teuthology.orchestra.run.smithi142.stdout:Installed: 2024-09-22T08:35:14.432 INFO:teuthology.orchestra.run.smithi142.stdout: libcephfs-devel-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:35:14.432 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-22T08:35:14.432 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-09-22T08:35:14.630 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install librados2 2024-09-22T08:35:14.690 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-22T08:35:14.690 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-22T08:35:14.690 INFO:teuthology.orchestra.run.smithi031.stdout:Installed: 2024-09-22T08:35:14.690 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mgr-cephadm-2:19.3.0-5106.g8852379c.el9.noarch 2024-09-22T08:35:14.690 INFO:teuthology.orchestra.run.smithi031.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-22T08:35:14.690 INFO:teuthology.orchestra.run.smithi031.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-22T08:35:14.690 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-22T08:35:14.690 INFO:teuthology.orchestra.run.smithi031.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-22T08:35:14.691 INFO:teuthology.orchestra.run.smithi031.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-22T08:35:14.691 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-22T08:35:14.691 INFO:teuthology.orchestra.run.smithi031.stdout:Complete! 2024-09-22T08:35:14.912 DEBUG:teuthology.orchestra.run.smithi031:> sudo yum -y install ceph-fuse 2024-09-22T08:35:15.207 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:01:40 ago on Sun 22 Sep 2024 08:33:35 AM UTC. 2024-09-22T08:35:15.298 INFO:teuthology.orchestra.run.smithi142.stdout:Package librados2-2:19.3.0-5106.g8852379c.el9.x86_64 is already installed. 2024-09-22T08:35:15.341 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-09-22T08:35:15.342 INFO:teuthology.orchestra.run.smithi142.stdout:Nothing to do. 2024-09-22T08:35:15.342 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-09-22T08:35:15.417 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install librbd1 2024-09-22T08:35:15.513 INFO:teuthology.orchestra.run.smithi031.stdout:Last metadata expiration check: 0:01:38 ago on Sun 22 Sep 2024 08:33:37 AM UTC. 2024-09-22T08:35:15.652 INFO:teuthology.orchestra.run.smithi031.stdout:Dependencies resolved. 2024-09-22T08:35:15.653 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2024-09-22T08:35:15.653 INFO:teuthology.orchestra.run.smithi031.stdout: Package Arch Version Repository Size 2024-09-22T08:35:15.653 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2024-09-22T08:35:15.653 INFO:teuthology.orchestra.run.smithi031.stdout:Installing: 2024-09-22T08:35:15.653 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-fuse x86_64 2:19.3.0-5106.g8852379c.el9 ceph 900 k 2024-09-22T08:35:15.653 INFO:teuthology.orchestra.run.smithi031.stdout:Installing dependencies: 2024-09-22T08:35:15.653 INFO:teuthology.orchestra.run.smithi031.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-22T08:35:15.653 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-22T08:35:15.653 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction Summary 2024-09-22T08:35:15.653 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2024-09-22T08:35:15.654 INFO:teuthology.orchestra.run.smithi031.stdout:Install 2 Packages 2024-09-22T08:35:15.654 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-22T08:35:15.654 INFO:teuthology.orchestra.run.smithi031.stdout:Total download size: 980 k 2024-09-22T08:35:15.654 INFO:teuthology.orchestra.run.smithi031.stdout:Installed size: 2.9 M 2024-09-22T08:35:15.654 INFO:teuthology.orchestra.run.smithi031.stdout:Downloading Packages: 2024-09-22T08:35:15.931 INFO:teuthology.orchestra.run.smithi031.stdout:(1/2): fuse-2.9.9-16.el9.x86_64.rpm 537 kB/s | 80 kB 00:00 2024-09-22T08:35:16.004 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:01:41 ago on Sun 22 Sep 2024 08:33:35 AM UTC. 2024-09-22T08:35:16.064 INFO:teuthology.orchestra.run.smithi031.stdout:(2/2): ceph-fuse-19.3.0-5106.g8852379c.el9.x86_ 3.1 MB/s | 900 kB 00:00 2024-09-22T08:35:16.065 INFO:teuthology.orchestra.run.smithi031.stdout:-------------------------------------------------------------------------------- 2024-09-22T08:35:16.065 INFO:teuthology.orchestra.run.smithi031.stdout:Total 2.3 MB/s | 980 kB 00:00 2024-09-22T08:35:16.077 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction check 2024-09-22T08:35:16.094 INFO:teuthology.orchestra.run.smithi142.stdout:Package librbd1-2:19.3.0-5106.g8852379c.el9.x86_64 is already installed. 2024-09-22T08:35:16.099 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction check succeeded. 2024-09-22T08:35:16.099 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction test 2024-09-22T08:35:16.137 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-09-22T08:35:16.138 INFO:teuthology.orchestra.run.smithi142.stdout:Nothing to do. 2024-09-22T08:35:16.138 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-09-22T08:35:16.185 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction test succeeded. 2024-09-22T08:35:16.185 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction 2024-09-22T08:35:16.218 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install python3-rados 2024-09-22T08:35:16.384 INFO:teuthology.orchestra.run.smithi031.stdout: Preparing : 1/1 2024-09-22T08:35:16.530 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-22T08:35:16.601 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-fuse-2:19.3.0-5106.g8852379c.el9.x86_64 2/2 2024-09-22T08:35:16.796 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:01:41 ago on Sun 22 Sep 2024 08:33:35 AM UTC. 2024-09-22T08:35:16.886 INFO:teuthology.orchestra.run.smithi142.stdout:Package python3-rados-2:19.3.0-5106.g8852379c.el9.x86_64 is already installed. 2024-09-22T08:35:16.928 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-09-22T08:35:16.929 INFO:teuthology.orchestra.run.smithi142.stdout:Nothing to do. 2024-09-22T08:35:16.929 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-09-22T08:35:17.009 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install python3-rgw 2024-09-22T08:35:17.277 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-fuse-2:19.3.0-5106.g8852379c.el9.x86_64 2/2 2024-09-22T08:35:17.277 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-fuse-2:19.3.0-5106.g8852379c.el9.x86_64 1/2 2024-09-22T08:35:17.564 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-22T08:35:17.564 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-22T08:35:17.564 INFO:teuthology.orchestra.run.smithi031.stdout:Installed: 2024-09-22T08:35:17.564 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-fuse-2:19.3.0-5106.g8852379c.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-22T08:35:17.565 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-22T08:35:17.565 INFO:teuthology.orchestra.run.smithi031.stdout:Complete! 2024-09-22T08:35:17.593 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:01:42 ago on Sun 22 Sep 2024 08:33:35 AM UTC. 2024-09-22T08:35:17.683 INFO:teuthology.orchestra.run.smithi142.stdout:Package python3-rgw-2:19.3.0-5106.g8852379c.el9.x86_64 is already installed. 2024-09-22T08:35:17.727 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-09-22T08:35:17.728 INFO:teuthology.orchestra.run.smithi142.stdout:Nothing to do. 2024-09-22T08:35:17.728 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-09-22T08:35:17.810 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install python3-cephfs 2024-09-22T08:35:17.868 DEBUG:teuthology.orchestra.run.smithi031:> sudo yum -y install ceph-volume 2024-09-22T08:35:18.386 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:01:43 ago on Sun 22 Sep 2024 08:33:35 AM UTC. 2024-09-22T08:35:18.476 INFO:teuthology.orchestra.run.smithi142.stdout:Package python3-cephfs-2:19.3.0-5106.g8852379c.el9.x86_64 is already installed. 2024-09-22T08:35:18.485 INFO:teuthology.orchestra.run.smithi031.stdout:Last metadata expiration check: 0:01:41 ago on Sun 22 Sep 2024 08:33:37 AM UTC. 2024-09-22T08:35:18.519 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-09-22T08:35:18.520 INFO:teuthology.orchestra.run.smithi142.stdout:Nothing to do. 2024-09-22T08:35:18.520 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-09-22T08:35:18.601 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install python3-rbd 2024-09-22T08:35:18.624 INFO:teuthology.orchestra.run.smithi031.stdout:Dependencies resolved. 2024-09-22T08:35:18.625 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2024-09-22T08:35:18.625 INFO:teuthology.orchestra.run.smithi031.stdout: Package Arch Version Repository Size 2024-09-22T08:35:18.625 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2024-09-22T08:35:18.625 INFO:teuthology.orchestra.run.smithi031.stdout:Installing: 2024-09-22T08:35:18.625 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-volume noarch 2:19.3.0-5106.g8852379c.el9 ceph-noarch 285 k 2024-09-22T08:35:18.626 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-22T08:35:18.626 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction Summary 2024-09-22T08:35:18.626 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2024-09-22T08:35:18.626 INFO:teuthology.orchestra.run.smithi031.stdout:Install 1 Package 2024-09-22T08:35:18.626 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-22T08:35:18.626 INFO:teuthology.orchestra.run.smithi031.stdout:Total download size: 285 k 2024-09-22T08:35:18.626 INFO:teuthology.orchestra.run.smithi031.stdout:Installed size: 1.3 M 2024-09-22T08:35:18.626 INFO:teuthology.orchestra.run.smithi031.stdout:Downloading Packages: 2024-09-22T08:35:18.851 INFO:teuthology.orchestra.run.smithi031.stdout:ceph-volume-19.3.0-5106.g8852379c.el9.noarch.rp 1.2 MB/s | 285 kB 00:00 2024-09-22T08:35:18.851 INFO:teuthology.orchestra.run.smithi031.stdout:-------------------------------------------------------------------------------- 2024-09-22T08:35:18.852 INFO:teuthology.orchestra.run.smithi031.stdout:Total 1.2 MB/s | 285 kB 00:00 2024-09-22T08:35:18.852 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction check 2024-09-22T08:35:18.862 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction check succeeded. 2024-09-22T08:35:18.862 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction test 2024-09-22T08:35:18.895 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction test succeeded. 2024-09-22T08:35:18.895 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction 2024-09-22T08:35:19.132 INFO:teuthology.orchestra.run.smithi031.stdout: Preparing : 1/1 2024-09-22T08:35:19.181 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:01:44 ago on Sun 22 Sep 2024 08:33:35 AM UTC. 2024-09-22T08:35:19.194 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-volume-2:19.3.0-5106.g8852379c.el9.noarch 1/1 2024-09-22T08:35:19.212 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-volume-2:19.3.0-5106.g8852379c.el9.noarch 1/1 2024-09-22T08:35:19.212 INFO:teuthology.orchestra.run.smithi031.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-22T08:35:19.212 INFO:teuthology.orchestra.run.smithi031.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-22T08:35:19.212 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-22T08:35:19.272 INFO:teuthology.orchestra.run.smithi142.stdout:Package python3-rbd-2:19.3.0-5106.g8852379c.el9.x86_64 is already installed. 2024-09-22T08:35:19.315 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-09-22T08:35:19.316 INFO:teuthology.orchestra.run.smithi142.stdout:Nothing to do. 2024-09-22T08:35:19.317 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-09-22T08:35:19.402 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install rbd-fuse 2024-09-22T08:35:19.976 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:01:44 ago on Sun 22 Sep 2024 08:33:35 AM UTC. 2024-09-22T08:35:20.108 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-09-22T08:35:20.110 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-22T08:35:20.110 INFO:teuthology.orchestra.run.smithi142.stdout: Package Architecture Version Repository Size 2024-09-22T08:35:20.110 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-22T08:35:20.110 INFO:teuthology.orchestra.run.smithi142.stdout:Installing: 2024-09-22T08:35:20.110 INFO:teuthology.orchestra.run.smithi142.stdout: rbd-fuse x86_64 2:19.3.0-5106.g8852379c.el9 ceph 85 k 2024-09-22T08:35:20.110 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-22T08:35:20.110 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2024-09-22T08:35:20.110 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-22T08:35:20.110 INFO:teuthology.orchestra.run.smithi142.stdout:Install 1 Package 2024-09-22T08:35:20.111 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-22T08:35:20.111 INFO:teuthology.orchestra.run.smithi142.stdout:Total download size: 85 k 2024-09-22T08:35:20.111 INFO:teuthology.orchestra.run.smithi142.stdout:Installed size: 231 k 2024-09-22T08:35:20.111 INFO:teuthology.orchestra.run.smithi142.stdout:Downloading Packages: 2024-09-22T08:35:20.242 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-volume-2:19.3.0-5106.g8852379c.el9.noarch 1/1 2024-09-22T08:35:20.242 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-22T08:35:20.243 INFO:teuthology.orchestra.run.smithi031.stdout:Installed: 2024-09-22T08:35:20.243 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-volume-2:19.3.0-5106.g8852379c.el9.noarch 2024-09-22T08:35:20.243 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-22T08:35:20.243 INFO:teuthology.orchestra.run.smithi031.stdout:Complete! 2024-09-22T08:35:20.312 INFO:teuthology.orchestra.run.smithi142.stdout:rbd-fuse-19.3.0-5106.g8852379c.el9.x86_64.rpm 422 kB/s | 85 kB 00:00 2024-09-22T08:35:20.312 INFO:teuthology.orchestra.run.smithi142.stdout:-------------------------------------------------------------------------------- 2024-09-22T08:35:20.312 INFO:teuthology.orchestra.run.smithi142.stdout:Total 420 kB/s | 85 kB 00:00 2024-09-22T08:35:20.312 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction check 2024-09-22T08:35:20.319 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction check succeeded. 2024-09-22T08:35:20.319 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction test 2024-09-22T08:35:20.382 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction test succeeded. 2024-09-22T08:35:20.383 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction 2024-09-22T08:35:20.525 DEBUG:teuthology.orchestra.run.smithi031:> sudo yum -y install librados-devel 2024-09-22T08:35:20.526 INFO:teuthology.orchestra.run.smithi142.stdout: Preparing : 1/1 2024-09-22T08:35:20.633 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : rbd-fuse-2:19.3.0-5106.g8852379c.el9.x86_64 1/1 2024-09-22T08:35:21.010 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: rbd-fuse-2:19.3.0-5106.g8852379c.el9.x86_64 1/1 2024-09-22T08:35:21.141 INFO:teuthology.orchestra.run.smithi031.stdout:Last metadata expiration check: 0:01:44 ago on Sun 22 Sep 2024 08:33:37 AM UTC. 2024-09-22T08:35:21.242 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : rbd-fuse-2:19.3.0-5106.g8852379c.el9.x86_64 1/1 2024-09-22T08:35:21.242 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-22T08:35:21.242 INFO:teuthology.orchestra.run.smithi142.stdout:Installed: 2024-09-22T08:35:21.242 INFO:teuthology.orchestra.run.smithi142.stdout: rbd-fuse-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:35:21.242 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-22T08:35:21.242 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-09-22T08:35:21.282 INFO:teuthology.orchestra.run.smithi031.stdout:Dependencies resolved. 2024-09-22T08:35:21.282 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2024-09-22T08:35:21.282 INFO:teuthology.orchestra.run.smithi031.stdout: Package Arch Version Repo Size 2024-09-22T08:35:21.282 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2024-09-22T08:35:21.282 INFO:teuthology.orchestra.run.smithi031.stdout:Installing: 2024-09-22T08:35:21.282 INFO:teuthology.orchestra.run.smithi031.stdout: librados-devel x86_64 2:19.3.0-5106.g8852379c.el9 ceph 127 k 2024-09-22T08:35:21.283 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-22T08:35:21.283 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction Summary 2024-09-22T08:35:21.283 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2024-09-22T08:35:21.283 INFO:teuthology.orchestra.run.smithi031.stdout:Install 1 Package 2024-09-22T08:35:21.283 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-22T08:35:21.283 INFO:teuthology.orchestra.run.smithi031.stdout:Total download size: 127 k 2024-09-22T08:35:21.283 INFO:teuthology.orchestra.run.smithi031.stdout:Installed size: 456 k 2024-09-22T08:35:21.283 INFO:teuthology.orchestra.run.smithi031.stdout:Downloading Packages: 2024-09-22T08:35:21.506 INFO:teuthology.orchestra.run.smithi031.stdout:librados-devel-19.3.0-5106.g8852379c.el9.x86_64 570 kB/s | 127 kB 00:00 2024-09-22T08:35:21.506 INFO:teuthology.orchestra.run.smithi031.stdout:-------------------------------------------------------------------------------- 2024-09-22T08:35:21.506 INFO:teuthology.orchestra.run.smithi031.stdout:Total 566 kB/s | 127 kB 00:00 2024-09-22T08:35:21.507 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction check 2024-09-22T08:35:21.512 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction check succeeded. 2024-09-22T08:35:21.513 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction test 2024-09-22T08:35:21.530 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install rbd-mirror 2024-09-22T08:35:21.581 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction test succeeded. 2024-09-22T08:35:21.582 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction 2024-09-22T08:35:21.741 INFO:teuthology.orchestra.run.smithi031.stdout: Preparing : 1/1 2024-09-22T08:35:21.831 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : librados-devel-2:19.3.0-5106.g8852379c.el9.x86_64 1/1 2024-09-22T08:35:22.124 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:01:47 ago on Sun 22 Sep 2024 08:33:35 AM UTC. 2024-09-22T08:35:22.265 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-09-22T08:35:22.266 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-22T08:35:22.266 INFO:teuthology.orchestra.run.smithi142.stdout: Package Arch Version Repo Size 2024-09-22T08:35:22.266 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-22T08:35:22.266 INFO:teuthology.orchestra.run.smithi142.stdout:Installing: 2024-09-22T08:35:22.266 INFO:teuthology.orchestra.run.smithi142.stdout: rbd-mirror x86_64 2:19.3.0-5106.g8852379c.el9 ceph 3.2 M 2024-09-22T08:35:22.266 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-22T08:35:22.266 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2024-09-22T08:35:22.266 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-22T08:35:22.266 INFO:teuthology.orchestra.run.smithi142.stdout:Install 1 Package 2024-09-22T08:35:22.266 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-22T08:35:22.266 INFO:teuthology.orchestra.run.smithi142.stdout:Total download size: 3.2 M 2024-09-22T08:35:22.266 INFO:teuthology.orchestra.run.smithi142.stdout:Installed size: 14 M 2024-09-22T08:35:22.267 INFO:teuthology.orchestra.run.smithi142.stdout:Downloading Packages: 2024-09-22T08:35:22.275 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: librados-devel-2:19.3.0-5106.g8852379c.el9.x86_64 1/1 2024-09-22T08:35:22.523 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : librados-devel-2:19.3.0-5106.g8852379c.el9.x86_64 1/1 2024-09-22T08:35:22.523 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-22T08:35:22.523 INFO:teuthology.orchestra.run.smithi031.stdout:Installed: 2024-09-22T08:35:22.523 INFO:teuthology.orchestra.run.smithi031.stdout: librados-devel-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:35:22.523 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-22T08:35:22.523 INFO:teuthology.orchestra.run.smithi031.stdout:Complete! 2024-09-22T08:35:22.615 INFO:teuthology.orchestra.run.smithi142.stdout:rbd-mirror-19.3.0-5106.g8852379c.el9.x86_64.rpm 9.2 MB/s | 3.2 MB 00:00 2024-09-22T08:35:22.615 INFO:teuthology.orchestra.run.smithi142.stdout:-------------------------------------------------------------------------------- 2024-09-22T08:35:22.616 INFO:teuthology.orchestra.run.smithi142.stdout:Total 9.1 MB/s | 3.2 MB 00:00 2024-09-22T08:35:22.616 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction check 2024-09-22T08:35:22.626 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction check succeeded. 2024-09-22T08:35:22.626 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction test 2024-09-22T08:35:22.710 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction test succeeded. 2024-09-22T08:35:22.711 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction 2024-09-22T08:35:22.789 DEBUG:teuthology.orchestra.run.smithi031:> sudo yum -y install libcephfs2 2024-09-22T08:35:23.163 INFO:teuthology.orchestra.run.smithi142.stdout: Preparing : 1/1 2024-09-22T08:35:23.232 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : rbd-mirror-2:19.3.0-5106.g8852379c.el9.x86_64 1/1 2024-09-22T08:35:23.258 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: rbd-mirror-2:19.3.0-5106.g8852379c.el9.x86_64 1/1 2024-09-22T08:35:23.259 INFO:teuthology.orchestra.run.smithi142.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-22T08:35:23.259 INFO:teuthology.orchestra.run.smithi142.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-22T08:35:23.259 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-22T08:35:23.259 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-22T08:35:23.259 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-22T08:35:23.418 INFO:teuthology.orchestra.run.smithi031.stdout:Last metadata expiration check: 0:01:46 ago on Sun 22 Sep 2024 08:33:37 AM UTC. 2024-09-22T08:35:23.512 INFO:teuthology.orchestra.run.smithi031.stdout:Package libcephfs2-2:19.3.0-5106.g8852379c.el9.x86_64 is already installed. 2024-09-22T08:35:23.558 INFO:teuthology.orchestra.run.smithi031.stdout:Dependencies resolved. 2024-09-22T08:35:23.559 INFO:teuthology.orchestra.run.smithi031.stdout:Nothing to do. 2024-09-22T08:35:23.559 INFO:teuthology.orchestra.run.smithi031.stdout:Complete! 2024-09-22T08:35:23.630 DEBUG:teuthology.orchestra.run.smithi031:> sudo yum -y install libcephfs-devel 2024-09-22T08:35:24.236 INFO:teuthology.orchestra.run.smithi031.stdout:Last metadata expiration check: 0:01:47 ago on Sun 22 Sep 2024 08:33:37 AM UTC. 2024-09-22T08:35:24.374 INFO:teuthology.orchestra.run.smithi031.stdout:Dependencies resolved. 2024-09-22T08:35:24.375 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2024-09-22T08:35:24.375 INFO:teuthology.orchestra.run.smithi031.stdout: Package Arch Version Repo Size 2024-09-22T08:35:24.375 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2024-09-22T08:35:24.375 INFO:teuthology.orchestra.run.smithi031.stdout:Installing: 2024-09-22T08:35:24.375 INFO:teuthology.orchestra.run.smithi031.stdout: libcephfs-devel x86_64 2:19.3.0-5106.g8852379c.el9 ceph 32 k 2024-09-22T08:35:24.375 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-22T08:35:24.375 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction Summary 2024-09-22T08:35:24.376 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2024-09-22T08:35:24.376 INFO:teuthology.orchestra.run.smithi031.stdout:Install 1 Package 2024-09-22T08:35:24.376 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-22T08:35:24.376 INFO:teuthology.orchestra.run.smithi031.stdout:Total download size: 32 k 2024-09-22T08:35:24.376 INFO:teuthology.orchestra.run.smithi031.stdout:Installed size: 142 k 2024-09-22T08:35:24.376 INFO:teuthology.orchestra.run.smithi031.stdout:Downloading Packages: 2024-09-22T08:35:24.432 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : rbd-mirror-2:19.3.0-5106.g8852379c.el9.x86_64 1/1 2024-09-22T08:35:24.432 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-22T08:35:24.433 INFO:teuthology.orchestra.run.smithi142.stdout:Installed: 2024-09-22T08:35:24.433 INFO:teuthology.orchestra.run.smithi142.stdout: rbd-mirror-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:35:24.433 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-22T08:35:24.433 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-09-22T08:35:24.535 INFO:teuthology.orchestra.run.smithi031.stdout:libcephfs-devel-19.3.0-5106.g8852379c.el9.x86_6 199 kB/s | 32 kB 00:00 2024-09-22T08:35:24.535 INFO:teuthology.orchestra.run.smithi031.stdout:-------------------------------------------------------------------------------- 2024-09-22T08:35:24.536 INFO:teuthology.orchestra.run.smithi031.stdout:Total 198 kB/s | 32 kB 00:00 2024-09-22T08:35:24.536 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction check 2024-09-22T08:35:24.539 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction check succeeded. 2024-09-22T08:35:24.539 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction test 2024-09-22T08:35:24.556 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction test succeeded. 2024-09-22T08:35:24.556 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction 2024-09-22T08:35:24.649 INFO:teuthology.orchestra.run.smithi031.stdout: Preparing : 1/1 2024-09-22T08:35:24.683 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install rbd-nbd 2024-09-22T08:35:24.760 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : libcephfs-devel-2:19.3.0-5106.g8852379c.el9.x86_64 1/1 2024-09-22T08:35:25.139 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: libcephfs-devel-2:19.3.0-5106.g8852379c.el9.x86_64 1/1 2024-09-22T08:35:25.291 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:01:50 ago on Sun 22 Sep 2024 08:33:35 AM UTC. 2024-09-22T08:35:25.386 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libcephfs-devel-2:19.3.0-5106.g8852379c.el9.x86_64 1/1 2024-09-22T08:35:25.386 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-22T08:35:25.386 INFO:teuthology.orchestra.run.smithi031.stdout:Installed: 2024-09-22T08:35:25.386 INFO:teuthology.orchestra.run.smithi031.stdout: libcephfs-devel-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:35:25.386 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-22T08:35:25.386 INFO:teuthology.orchestra.run.smithi031.stdout:Complete! 2024-09-22T08:35:25.430 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-09-22T08:35:25.430 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-22T08:35:25.430 INFO:teuthology.orchestra.run.smithi142.stdout: Package Architecture Version Repository Size 2024-09-22T08:35:25.430 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-22T08:35:25.430 INFO:teuthology.orchestra.run.smithi142.stdout:Installing: 2024-09-22T08:35:25.430 INFO:teuthology.orchestra.run.smithi142.stdout: rbd-nbd x86_64 2:19.3.0-5106.g8852379c.el9 ceph 170 k 2024-09-22T08:35:25.430 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-22T08:35:25.431 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2024-09-22T08:35:25.431 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-22T08:35:25.431 INFO:teuthology.orchestra.run.smithi142.stdout:Install 1 Package 2024-09-22T08:35:25.431 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-22T08:35:25.431 INFO:teuthology.orchestra.run.smithi142.stdout:Total download size: 170 k 2024-09-22T08:35:25.431 INFO:teuthology.orchestra.run.smithi142.stdout:Installed size: 490 k 2024-09-22T08:35:25.431 INFO:teuthology.orchestra.run.smithi142.stdout:Downloading Packages: 2024-09-22T08:35:25.574 DEBUG:teuthology.orchestra.run.smithi031:> sudo yum -y install librados2 2024-09-22T08:35:25.668 INFO:teuthology.orchestra.run.smithi142.stdout:rbd-nbd-19.3.0-5106.g8852379c.el9.x86_64.rpm 713 kB/s | 170 kB 00:00 2024-09-22T08:35:25.668 INFO:teuthology.orchestra.run.smithi142.stdout:-------------------------------------------------------------------------------- 2024-09-22T08:35:25.669 INFO:teuthology.orchestra.run.smithi142.stdout:Total 708 kB/s | 170 kB 00:00 2024-09-22T08:35:25.669 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction check 2024-09-22T08:35:25.677 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction check succeeded. 2024-09-22T08:35:25.677 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction test 2024-09-22T08:35:25.741 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction test succeeded. 2024-09-22T08:35:25.741 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction 2024-09-22T08:35:25.892 INFO:teuthology.orchestra.run.smithi142.stdout: Preparing : 1/1 2024-09-22T08:35:25.998 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : rbd-nbd-2:19.3.0-5106.g8852379c.el9.x86_64 1/1 2024-09-22T08:35:26.179 INFO:teuthology.orchestra.run.smithi031.stdout:Last metadata expiration check: 0:01:49 ago on Sun 22 Sep 2024 08:33:37 AM UTC. 2024-09-22T08:35:26.271 INFO:teuthology.orchestra.run.smithi031.stdout:Package librados2-2:19.3.0-5106.g8852379c.el9.x86_64 is already installed. 2024-09-22T08:35:26.317 INFO:teuthology.orchestra.run.smithi031.stdout:Dependencies resolved. 2024-09-22T08:35:26.319 INFO:teuthology.orchestra.run.smithi031.stdout:Nothing to do. 2024-09-22T08:35:26.319 INFO:teuthology.orchestra.run.smithi031.stdout:Complete! 2024-09-22T08:35:26.394 DEBUG:teuthology.orchestra.run.smithi031:> sudo yum -y install librbd1 2024-09-22T08:35:26.450 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: rbd-nbd-2:19.3.0-5106.g8852379c.el9.x86_64 1/1 2024-09-22T08:35:26.725 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : rbd-nbd-2:19.3.0-5106.g8852379c.el9.x86_64 1/1 2024-09-22T08:35:26.725 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-22T08:35:26.725 INFO:teuthology.orchestra.run.smithi142.stdout:Installed: 2024-09-22T08:35:26.725 INFO:teuthology.orchestra.run.smithi142.stdout: rbd-nbd-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:35:26.725 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-22T08:35:26.725 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-09-22T08:35:26.996 DEBUG:teuthology.parallel:result is None 2024-09-22T08:35:26.996 INFO:teuthology.orchestra.run.smithi031.stdout:Last metadata expiration check: 0:01:49 ago on Sun 22 Sep 2024 08:33:37 AM UTC. 2024-09-22T08:35:27.089 INFO:teuthology.orchestra.run.smithi031.stdout:Package librbd1-2:19.3.0-5106.g8852379c.el9.x86_64 is already installed. 2024-09-22T08:35:27.135 INFO:teuthology.orchestra.run.smithi031.stdout:Dependencies resolved. 2024-09-22T08:35:27.137 INFO:teuthology.orchestra.run.smithi031.stdout:Nothing to do. 2024-09-22T08:35:27.137 INFO:teuthology.orchestra.run.smithi031.stdout:Complete! 2024-09-22T08:35:27.219 DEBUG:teuthology.orchestra.run.smithi031:> sudo yum -y install python3-rados 2024-09-22T08:35:27.826 INFO:teuthology.orchestra.run.smithi031.stdout:Last metadata expiration check: 0:01:50 ago on Sun 22 Sep 2024 08:33:37 AM UTC. 2024-09-22T08:35:27.918 INFO:teuthology.orchestra.run.smithi031.stdout:Package python3-rados-2:19.3.0-5106.g8852379c.el9.x86_64 is already installed. 2024-09-22T08:35:27.964 INFO:teuthology.orchestra.run.smithi031.stdout:Dependencies resolved. 2024-09-22T08:35:27.965 INFO:teuthology.orchestra.run.smithi031.stdout:Nothing to do. 2024-09-22T08:35:27.965 INFO:teuthology.orchestra.run.smithi031.stdout:Complete! 2024-09-22T08:35:28.036 DEBUG:teuthology.orchestra.run.smithi031:> sudo yum -y install python3-rgw 2024-09-22T08:35:28.638 INFO:teuthology.orchestra.run.smithi031.stdout:Last metadata expiration check: 0:01:51 ago on Sun 22 Sep 2024 08:33:37 AM UTC. 2024-09-22T08:35:28.730 INFO:teuthology.orchestra.run.smithi031.stdout:Package python3-rgw-2:19.3.0-5106.g8852379c.el9.x86_64 is already installed. 2024-09-22T08:35:28.777 INFO:teuthology.orchestra.run.smithi031.stdout:Dependencies resolved. 2024-09-22T08:35:28.778 INFO:teuthology.orchestra.run.smithi031.stdout:Nothing to do. 2024-09-22T08:35:28.778 INFO:teuthology.orchestra.run.smithi031.stdout:Complete! 2024-09-22T08:35:28.852 DEBUG:teuthology.orchestra.run.smithi031:> sudo yum -y install python3-cephfs 2024-09-22T08:35:29.459 INFO:teuthology.orchestra.run.smithi031.stdout:Last metadata expiration check: 0:01:52 ago on Sun 22 Sep 2024 08:33:37 AM UTC. 2024-09-22T08:35:29.552 INFO:teuthology.orchestra.run.smithi031.stdout:Package python3-cephfs-2:19.3.0-5106.g8852379c.el9.x86_64 is already installed. 2024-09-22T08:35:29.599 INFO:teuthology.orchestra.run.smithi031.stdout:Dependencies resolved. 2024-09-22T08:35:29.601 INFO:teuthology.orchestra.run.smithi031.stdout:Nothing to do. 2024-09-22T08:35:29.601 INFO:teuthology.orchestra.run.smithi031.stdout:Complete! 2024-09-22T08:35:29.663 DEBUG:teuthology.orchestra.run.smithi031:> sudo yum -y install python3-rbd 2024-09-22T08:35:30.266 INFO:teuthology.orchestra.run.smithi031.stdout:Last metadata expiration check: 0:01:53 ago on Sun 22 Sep 2024 08:33:37 AM UTC. 2024-09-22T08:35:30.359 INFO:teuthology.orchestra.run.smithi031.stdout:Package python3-rbd-2:19.3.0-5106.g8852379c.el9.x86_64 is already installed. 2024-09-22T08:35:30.406 INFO:teuthology.orchestra.run.smithi031.stdout:Dependencies resolved. 2024-09-22T08:35:30.407 INFO:teuthology.orchestra.run.smithi031.stdout:Nothing to do. 2024-09-22T08:35:30.407 INFO:teuthology.orchestra.run.smithi031.stdout:Complete! 2024-09-22T08:35:30.476 DEBUG:teuthology.orchestra.run.smithi031:> sudo yum -y install rbd-fuse 2024-09-22T08:35:31.081 INFO:teuthology.orchestra.run.smithi031.stdout:Last metadata expiration check: 0:01:54 ago on Sun 22 Sep 2024 08:33:37 AM UTC. 2024-09-22T08:35:31.221 INFO:teuthology.orchestra.run.smithi031.stdout:Dependencies resolved. 2024-09-22T08:35:31.222 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2024-09-22T08:35:31.222 INFO:teuthology.orchestra.run.smithi031.stdout: Package Architecture Version Repository Size 2024-09-22T08:35:31.222 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2024-09-22T08:35:31.222 INFO:teuthology.orchestra.run.smithi031.stdout:Installing: 2024-09-22T08:35:31.222 INFO:teuthology.orchestra.run.smithi031.stdout: rbd-fuse x86_64 2:19.3.0-5106.g8852379c.el9 ceph 85 k 2024-09-22T08:35:31.223 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-22T08:35:31.223 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction Summary 2024-09-22T08:35:31.223 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2024-09-22T08:35:31.223 INFO:teuthology.orchestra.run.smithi031.stdout:Install 1 Package 2024-09-22T08:35:31.223 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-22T08:35:31.223 INFO:teuthology.orchestra.run.smithi031.stdout:Total download size: 85 k 2024-09-22T08:35:31.223 INFO:teuthology.orchestra.run.smithi031.stdout:Installed size: 231 k 2024-09-22T08:35:31.223 INFO:teuthology.orchestra.run.smithi031.stdout:Downloading Packages: 2024-09-22T08:35:31.412 INFO:teuthology.orchestra.run.smithi031.stdout:rbd-fuse-19.3.0-5106.g8852379c.el9.x86_64.rpm 450 kB/s | 85 kB 00:00 2024-09-22T08:35:31.412 INFO:teuthology.orchestra.run.smithi031.stdout:-------------------------------------------------------------------------------- 2024-09-22T08:35:31.413 INFO:teuthology.orchestra.run.smithi031.stdout:Total 447 kB/s | 85 kB 00:00 2024-09-22T08:35:31.413 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction check 2024-09-22T08:35:31.420 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction check succeeded. 2024-09-22T08:35:31.421 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction test 2024-09-22T08:35:31.488 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction test succeeded. 2024-09-22T08:35:31.489 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction 2024-09-22T08:35:31.647 INFO:teuthology.orchestra.run.smithi031.stdout: Preparing : 1/1 2024-09-22T08:35:31.763 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : rbd-fuse-2:19.3.0-5106.g8852379c.el9.x86_64 1/1 2024-09-22T08:35:32.133 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: rbd-fuse-2:19.3.0-5106.g8852379c.el9.x86_64 1/1 2024-09-22T08:35:32.377 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : rbd-fuse-2:19.3.0-5106.g8852379c.el9.x86_64 1/1 2024-09-22T08:35:32.378 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-22T08:35:32.378 INFO:teuthology.orchestra.run.smithi031.stdout:Installed: 2024-09-22T08:35:32.378 INFO:teuthology.orchestra.run.smithi031.stdout: rbd-fuse-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:35:32.378 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-22T08:35:32.378 INFO:teuthology.orchestra.run.smithi031.stdout:Complete! 2024-09-22T08:35:32.626 DEBUG:teuthology.orchestra.run.smithi031:> sudo yum -y install rbd-mirror 2024-09-22T08:35:33.246 INFO:teuthology.orchestra.run.smithi031.stdout:Last metadata expiration check: 0:01:56 ago on Sun 22 Sep 2024 08:33:37 AM UTC. 2024-09-22T08:35:33.387 INFO:teuthology.orchestra.run.smithi031.stdout:Dependencies resolved. 2024-09-22T08:35:33.387 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2024-09-22T08:35:33.387 INFO:teuthology.orchestra.run.smithi031.stdout: Package Arch Version Repo Size 2024-09-22T08:35:33.388 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2024-09-22T08:35:33.388 INFO:teuthology.orchestra.run.smithi031.stdout:Installing: 2024-09-22T08:35:33.388 INFO:teuthology.orchestra.run.smithi031.stdout: rbd-mirror x86_64 2:19.3.0-5106.g8852379c.el9 ceph 3.2 M 2024-09-22T08:35:33.388 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-22T08:35:33.388 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction Summary 2024-09-22T08:35:33.388 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2024-09-22T08:35:33.388 INFO:teuthology.orchestra.run.smithi031.stdout:Install 1 Package 2024-09-22T08:35:33.388 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-22T08:35:33.388 INFO:teuthology.orchestra.run.smithi031.stdout:Total download size: 3.2 M 2024-09-22T08:35:33.388 INFO:teuthology.orchestra.run.smithi031.stdout:Installed size: 14 M 2024-09-22T08:35:33.388 INFO:teuthology.orchestra.run.smithi031.stdout:Downloading Packages: 2024-09-22T08:35:33.757 INFO:teuthology.orchestra.run.smithi031.stdout:rbd-mirror-19.3.0-5106.g8852379c.el9.x86_64.rpm 8.7 MB/s | 3.2 MB 00:00 2024-09-22T08:35:33.757 INFO:teuthology.orchestra.run.smithi031.stdout:-------------------------------------------------------------------------------- 2024-09-22T08:35:33.758 INFO:teuthology.orchestra.run.smithi031.stdout:Total 8.6 MB/s | 3.2 MB 00:00 2024-09-22T08:35:33.758 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction check 2024-09-22T08:35:33.768 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction check succeeded. 2024-09-22T08:35:33.768 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction test 2024-09-22T08:35:33.853 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction test succeeded. 2024-09-22T08:35:33.854 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction 2024-09-22T08:35:34.319 INFO:teuthology.orchestra.run.smithi031.stdout: Preparing : 1/1 2024-09-22T08:35:34.391 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : rbd-mirror-2:19.3.0-5106.g8852379c.el9.x86_64 1/1 2024-09-22T08:35:34.418 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: rbd-mirror-2:19.3.0-5106.g8852379c.el9.x86_64 1/1 2024-09-22T08:35:34.418 INFO:teuthology.orchestra.run.smithi031.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-22T08:35:34.418 INFO:teuthology.orchestra.run.smithi031.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-22T08:35:34.418 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-22T08:35:34.418 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-22T08:35:34.418 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-22T08:35:35.526 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : rbd-mirror-2:19.3.0-5106.g8852379c.el9.x86_64 1/1 2024-09-22T08:35:35.527 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-22T08:35:35.527 INFO:teuthology.orchestra.run.smithi031.stdout:Installed: 2024-09-22T08:35:35.527 INFO:teuthology.orchestra.run.smithi031.stdout: rbd-mirror-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:35:35.527 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-22T08:35:35.527 INFO:teuthology.orchestra.run.smithi031.stdout:Complete! 2024-09-22T08:35:35.761 DEBUG:teuthology.orchestra.run.smithi031:> sudo yum -y install rbd-nbd 2024-09-22T08:35:36.373 INFO:teuthology.orchestra.run.smithi031.stdout:Last metadata expiration check: 0:01:59 ago on Sun 22 Sep 2024 08:33:37 AM UTC. 2024-09-22T08:35:36.511 INFO:teuthology.orchestra.run.smithi031.stdout:Dependencies resolved. 2024-09-22T08:35:36.512 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2024-09-22T08:35:36.512 INFO:teuthology.orchestra.run.smithi031.stdout: Package Architecture Version Repository Size 2024-09-22T08:35:36.512 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2024-09-22T08:35:36.512 INFO:teuthology.orchestra.run.smithi031.stdout:Installing: 2024-09-22T08:35:36.512 INFO:teuthology.orchestra.run.smithi031.stdout: rbd-nbd x86_64 2:19.3.0-5106.g8852379c.el9 ceph 170 k 2024-09-22T08:35:36.512 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-22T08:35:36.512 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction Summary 2024-09-22T08:35:36.513 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2024-09-22T08:35:36.513 INFO:teuthology.orchestra.run.smithi031.stdout:Install 1 Package 2024-09-22T08:35:36.513 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-22T08:35:36.513 INFO:teuthology.orchestra.run.smithi031.stdout:Total download size: 170 k 2024-09-22T08:35:36.513 INFO:teuthology.orchestra.run.smithi031.stdout:Installed size: 490 k 2024-09-22T08:35:36.513 INFO:teuthology.orchestra.run.smithi031.stdout:Downloading Packages: 2024-09-22T08:35:36.718 INFO:teuthology.orchestra.run.smithi031.stdout:rbd-nbd-19.3.0-5106.g8852379c.el9.x86_64.rpm 834 kB/s | 170 kB 00:00 2024-09-22T08:35:36.718 INFO:teuthology.orchestra.run.smithi031.stdout:-------------------------------------------------------------------------------- 2024-09-22T08:35:36.718 INFO:teuthology.orchestra.run.smithi031.stdout:Total 828 kB/s | 170 kB 00:00 2024-09-22T08:35:36.719 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction check 2024-09-22T08:35:36.727 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction check succeeded. 2024-09-22T08:35:36.727 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction test 2024-09-22T08:35:36.795 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction test succeeded. 2024-09-22T08:35:36.795 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction 2024-09-22T08:35:36.956 INFO:teuthology.orchestra.run.smithi031.stdout: Preparing : 1/1 2024-09-22T08:35:37.069 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : rbd-nbd-2:19.3.0-5106.g8852379c.el9.x86_64 1/1 2024-09-22T08:35:37.493 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: rbd-nbd-2:19.3.0-5106.g8852379c.el9.x86_64 1/1 2024-09-22T08:35:37.759 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : rbd-nbd-2:19.3.0-5106.g8852379c.el9.x86_64 1/1 2024-09-22T08:35:37.759 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-22T08:35:37.759 INFO:teuthology.orchestra.run.smithi031.stdout:Installed: 2024-09-22T08:35:37.759 INFO:teuthology.orchestra.run.smithi031.stdout: rbd-nbd-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:35:37.759 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-22T08:35:37.759 INFO:teuthology.orchestra.run.smithi031.stdout:Complete! 2024-09-22T08:35:38.033 DEBUG:teuthology.parallel:result is None 2024-09-22T08:35:38.033 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8852379c050c686f4605f33f0129009b2029ca9d 2024-09-22T08:35:38.185 DEBUG:teuthology.orchestra.run.smithi031:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-22T08:35:38.207 INFO:teuthology.orchestra.run.smithi031.stdout:19.3.0-5106.g8852379c.el9 2024-09-22T08:35:38.208 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-5106.g8852379c.el9 2024-09-22T08:35:38.208 INFO:teuthology.task.install:The correct ceph version 19.3.0-5106.g8852379c is installed. 2024-09-22T08:35:38.209 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8852379c050c686f4605f33f0129009b2029ca9d 2024-09-22T08:35:38.367 DEBUG:teuthology.orchestra.run.smithi142:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-22T08:35:38.393 INFO:teuthology.orchestra.run.smithi142.stdout:19.3.0-5106.g8852379c.el9 2024-09-22T08:35:38.393 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-5106.g8852379c.el9 2024-09-22T08:35:38.393 INFO:teuthology.task.install:The correct ceph version 19.3.0-5106.g8852379c is installed. 2024-09-22T08:35:38.395 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-22T08:35:38.395 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-22T08:35:38.395 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-22T08:35:38.423 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-09-22T08:35:38.423 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-22T08:35:38.464 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-22T08:35:38.464 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-22T08:35:38.464 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd of=/usr/bin/daemon-helper 2024-09-22T08:35:38.490 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-22T08:35:38.557 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-09-22T08:35:38.557 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/usr/bin/daemon-helper 2024-09-22T08:35:38.587 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-22T08:35:38.655 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-22T08:35:38.655 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-22T08:35:38.655 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-22T08:35:38.681 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-22T08:35:38.748 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-09-22T08:35:38.748 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-22T08:35:38.776 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-22T08:35:38.842 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-22T08:35:38.843 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-22T08:35:38.843 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd of=/usr/bin/stdin-killer 2024-09-22T08:35:38.868 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-22T08:35:38.934 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-09-22T08:35:38.935 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/usr/bin/stdin-killer 2024-09-22T08:35:38.961 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-22T08:35:39.027 INFO:teuthology.run_tasks:Running task ceph... 2024-09-22T08:35:39.099 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-22T08:35:39.099 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod 777 /var/log/ceph 2024-09-22T08:35:39.102 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 777 /var/log/ceph 2024-09-22T08:35:39.127 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-22T08:35:39.127 DEBUG:teuthology.orchestra.run.smithi031:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-22T08:35:39.168 DEBUG:teuthology.orchestra.run.smithi142:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-22T08:35:39.193 INFO:tasks.ceph:Creating extra log directories... 2024-09-22T08:35:39.193 DEBUG:teuthology.orchestra.run.smithi031:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-22T08:35:39.233 DEBUG:teuthology.orchestra.run.smithi142:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-22T08:35:39.266 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-22T08:35:39.267 INFO:tasks.ceph:config {'conf': {'client': {'debug ms': 1, 'rgw gc obj min wait': 15, 'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'osd': {'debug ms': 1, 'debug objclass': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-22T08:35:39.267 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/soumyakoduri-2024-09-22_06:37:27-rgw-wip-skoduri-cloud-restore-distro-default-smithi/7915065', 'branch': 'wip-skoduri-cloud-restore', 'description': 'rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/replicated supported-random-distro$/{centos_latest}}', 'email': None, 'first_in_suite': False, 'job_id': '7915065', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'soumyakoduri-2024-09-22_06:37:27-rgw-wip-skoduri-cloud-restore-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 3, 'size': 10}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-skoduri-cloud-restore'}, 'ceph': {'conf': {'client': {'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'sha1': '8852379c050c686f4605f33f0129009b2029ca9d'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '8852379c050c686f4605f33f0129009b2029ca9d'}}, 'rgw': {'ec-data-pool': False, 'frontend': 'beast'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-skoduri-cloud-restore', 'sha1': '8852379c050c686f4605f33f0129009b2029ca9d'}}, 'owner': 'scheduled_soumyakoduri@teuthology', 'priority': 100, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'osd.0'], ['mgr.x', 'client.0', 'osd.1', 'osd.2', 'osd.3']], 'sha1': '8852379c050c686f4605f33f0129009b2029ca9d', 'sleep_before_teardown': 0, 'suite': 'rgw', 'suite_branch': 'wip-skoduri-cloud-restore', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_8852379c050c686f4605f33f0129009b2029ca9d/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '8852379c050c686f4605f33f0129009b2029ca9d', 'targets': {'smithi031.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMOYvQ+739vXT4f5ys9bx0XPvVo3JVF1b2OFICxt6Qb0X7nlT90F4Qv6s30QC8SJSk4kIBu50VP3GJh6SIGMKjQ=', 'smithi142.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGtjEJ/fLpO4tfW/9b084U168n9CyIyhj4L0KdVAfLPT/mSMKNHNzfpHW6J60Sf4He0wDI4jiajX16KHb8d6uAw='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': {'conf': {'client': {'debug ms': 1, 'rgw gc obj min wait': 15, 'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'osd': {'debug ms': 1, 'debug objclass': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'sha1': '8852379c050c686f4605f33f0129009b2029ca9d', 'cluster': 'ceph'}}, {'rgw': {'client.0': None}}, {'radosgw-admin': None}, {'radosgw-admin-rest': None}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-22_06:37:27', 'tube': 'smithi', 'user': 'soumyakoduri', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2902'} 2024-09-22T08:35:39.267 DEBUG:teuthology.orchestra.run.smithi031:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-22T08:35:39.299 DEBUG:teuthology.orchestra.run.smithi142:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-22T08:35:39.315 DEBUG:teuthology.orchestra.run.smithi031:> sudo install -d -m0777 -- /var/run/ceph 2024-09-22T08:35:39.356 DEBUG:teuthology.orchestra.run.smithi142:> sudo install -d -m0777 -- /var/run/ceph 2024-09-22T08:35:39.380 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-22T08:35:39.380 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/scratch_devs of=/dev/stdout 2024-09-22T08:35:39.436 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-22T08:35:39.436 DEBUG:teuthology.orchestra.run.smithi031:> stat /dev/vg_nvme/lv_1 2024-09-22T08:35:39.492 INFO:teuthology.orchestra.run.smithi031.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-22T08:35:39.492 INFO:teuthology.orchestra.run.smithi031.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-22T08:35:39.492 INFO:teuthology.orchestra.run.smithi031.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-09-22T08:35:39.492 INFO:teuthology.orchestra.run.smithi031.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-22T08:35:39.492 INFO:teuthology.orchestra.run.smithi031.stdout:Context: system_u:object_r:device_t:s0 2024-09-22T08:35:39.492 INFO:teuthology.orchestra.run.smithi031.stdout:Access: 2024-09-22 08:35:34.700036730 +0000 2024-09-22T08:35:39.492 INFO:teuthology.orchestra.run.smithi031.stdout:Modify: 2024-09-22 08:32:59.524787464 +0000 2024-09-22T08:35:39.493 INFO:teuthology.orchestra.run.smithi031.stdout:Change: 2024-09-22 08:32:59.524787464 +0000 2024-09-22T08:35:39.493 INFO:teuthology.orchestra.run.smithi031.stdout: Birth: 2024-09-22 08:32:59.524787464 +0000 2024-09-22T08:35:39.493 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-22T08:35:39.556 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records in 2024-09-22T08:35:39.556 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records out 2024-09-22T08:35:39.556 INFO:teuthology.orchestra.run.smithi031.stderr:512 bytes copied, 0.000256589 s, 2.0 MB/s 2024-09-22T08:35:39.557 DEBUG:teuthology.orchestra.run.smithi031:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-22T08:35:39.615 DEBUG:teuthology.orchestra.run.smithi031:> stat /dev/vg_nvme/lv_2 2024-09-22T08:35:39.670 INFO:teuthology.orchestra.run.smithi031.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-22T08:35:39.671 INFO:teuthology.orchestra.run.smithi031.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-22T08:35:39.671 INFO:teuthology.orchestra.run.smithi031.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-09-22T08:35:39.671 INFO:teuthology.orchestra.run.smithi031.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-22T08:35:39.671 INFO:teuthology.orchestra.run.smithi031.stdout:Context: system_u:object_r:device_t:s0 2024-09-22T08:35:39.671 INFO:teuthology.orchestra.run.smithi031.stdout:Access: 2024-09-22 08:35:34.700036730 +0000 2024-09-22T08:35:39.671 INFO:teuthology.orchestra.run.smithi031.stdout:Modify: 2024-09-22 08:32:59.898780989 +0000 2024-09-22T08:35:39.671 INFO:teuthology.orchestra.run.smithi031.stdout:Change: 2024-09-22 08:32:59.898780989 +0000 2024-09-22T08:35:39.671 INFO:teuthology.orchestra.run.smithi031.stdout: Birth: 2024-09-22 08:32:59.898780989 +0000 2024-09-22T08:35:39.671 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-22T08:35:39.735 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records in 2024-09-22T08:35:39.735 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records out 2024-09-22T08:35:39.735 INFO:teuthology.orchestra.run.smithi031.stderr:512 bytes copied, 0.000190303 s, 2.7 MB/s 2024-09-22T08:35:39.736 DEBUG:teuthology.orchestra.run.smithi031:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-22T08:35:39.792 DEBUG:teuthology.orchestra.run.smithi031:> stat /dev/vg_nvme/lv_3 2024-09-22T08:35:39.848 INFO:teuthology.orchestra.run.smithi031.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-22T08:35:39.849 INFO:teuthology.orchestra.run.smithi031.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-22T08:35:39.849 INFO:teuthology.orchestra.run.smithi031.stdout:Device: 5h/5d Inode: 706 Links: 1 2024-09-22T08:35:39.849 INFO:teuthology.orchestra.run.smithi031.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-22T08:35:39.849 INFO:teuthology.orchestra.run.smithi031.stdout:Context: system_u:object_r:device_t:s0 2024-09-22T08:35:39.849 INFO:teuthology.orchestra.run.smithi031.stdout:Access: 2024-09-22 08:35:34.700036730 +0000 2024-09-22T08:35:39.849 INFO:teuthology.orchestra.run.smithi031.stdout:Modify: 2024-09-22 08:33:00.242775032 +0000 2024-09-22T08:35:39.849 INFO:teuthology.orchestra.run.smithi031.stdout:Change: 2024-09-22 08:33:00.242775032 +0000 2024-09-22T08:35:39.849 INFO:teuthology.orchestra.run.smithi031.stdout: Birth: 2024-09-22 08:33:00.242775032 +0000 2024-09-22T08:35:39.849 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-22T08:35:39.913 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records in 2024-09-22T08:35:39.913 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records out 2024-09-22T08:35:39.913 INFO:teuthology.orchestra.run.smithi031.stderr:512 bytes copied, 0.000209486 s, 2.4 MB/s 2024-09-22T08:35:39.914 DEBUG:teuthology.orchestra.run.smithi031:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-22T08:35:39.970 DEBUG:teuthology.orchestra.run.smithi031:> stat /dev/vg_nvme/lv_4 2024-09-22T08:35:40.027 INFO:teuthology.orchestra.run.smithi031.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-22T08:35:40.027 INFO:teuthology.orchestra.run.smithi031.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-22T08:35:40.027 INFO:teuthology.orchestra.run.smithi031.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-09-22T08:35:40.027 INFO:teuthology.orchestra.run.smithi031.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-22T08:35:40.027 INFO:teuthology.orchestra.run.smithi031.stdout:Context: system_u:object_r:device_t:s0 2024-09-22T08:35:40.027 INFO:teuthology.orchestra.run.smithi031.stdout:Access: 2024-09-22 08:35:34.701036713 +0000 2024-09-22T08:35:40.028 INFO:teuthology.orchestra.run.smithi031.stdout:Modify: 2024-09-22 08:33:00.572769318 +0000 2024-09-22T08:35:40.028 INFO:teuthology.orchestra.run.smithi031.stdout:Change: 2024-09-22 08:33:00.572769318 +0000 2024-09-22T08:35:40.028 INFO:teuthology.orchestra.run.smithi031.stdout: Birth: 2024-09-22 08:33:00.572769318 +0000 2024-09-22T08:35:40.028 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-22T08:35:40.091 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records in 2024-09-22T08:35:40.091 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records out 2024-09-22T08:35:40.091 INFO:teuthology.orchestra.run.smithi031.stderr:512 bytes copied, 0.000195786 s, 2.6 MB/s 2024-09-22T08:35:40.093 DEBUG:teuthology.orchestra.run.smithi031:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-22T08:35:40.151 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1'} 2024-09-22T08:35:40.151 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-09-22T08:35:40.151 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/scratch_devs of=/dev/stdout 2024-09-22T08:35:40.169 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-22T08:35:40.169 DEBUG:teuthology.orchestra.run.smithi142:> stat /dev/vg_nvme/lv_1 2024-09-22T08:35:40.225 INFO:teuthology.orchestra.run.smithi142.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-22T08:35:40.226 INFO:teuthology.orchestra.run.smithi142.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-22T08:35:40.226 INFO:teuthology.orchestra.run.smithi142.stdout:Device: 5h/5d Inode: 668 Links: 1 2024-09-22T08:35:40.226 INFO:teuthology.orchestra.run.smithi142.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-22T08:35:40.226 INFO:teuthology.orchestra.run.smithi142.stdout:Context: system_u:object_r:device_t:s0 2024-09-22T08:35:40.226 INFO:teuthology.orchestra.run.smithi142.stdout:Access: 2024-09-22 08:35:23.502332540 +0000 2024-09-22T08:35:40.226 INFO:teuthology.orchestra.run.smithi142.stdout:Modify: 2024-09-22 08:32:55.764898475 +0000 2024-09-22T08:35:40.226 INFO:teuthology.orchestra.run.smithi142.stdout:Change: 2024-09-22 08:32:55.764898475 +0000 2024-09-22T08:35:40.226 INFO:teuthology.orchestra.run.smithi142.stdout: Birth: 2024-09-22 08:32:55.764898475 +0000 2024-09-22T08:35:40.227 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-22T08:35:40.291 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records in 2024-09-22T08:35:40.291 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records out 2024-09-22T08:35:40.291 INFO:teuthology.orchestra.run.smithi142.stderr:512 bytes copied, 0.000267783 s, 1.9 MB/s 2024-09-22T08:35:40.292 DEBUG:teuthology.orchestra.run.smithi142:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-22T08:35:40.349 DEBUG:teuthology.orchestra.run.smithi142:> stat /dev/vg_nvme/lv_2 2024-09-22T08:35:40.405 INFO:teuthology.orchestra.run.smithi142.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-22T08:35:40.406 INFO:teuthology.orchestra.run.smithi142.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-22T08:35:40.406 INFO:teuthology.orchestra.run.smithi142.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-09-22T08:35:40.406 INFO:teuthology.orchestra.run.smithi142.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-22T08:35:40.406 INFO:teuthology.orchestra.run.smithi142.stdout:Context: system_u:object_r:device_t:s0 2024-09-22T08:35:40.406 INFO:teuthology.orchestra.run.smithi142.stdout:Access: 2024-09-22 08:35:23.502332540 +0000 2024-09-22T08:35:40.406 INFO:teuthology.orchestra.run.smithi142.stdout:Modify: 2024-09-22 08:32:56.093892306 +0000 2024-09-22T08:35:40.406 INFO:teuthology.orchestra.run.smithi142.stdout:Change: 2024-09-22 08:32:56.093892306 +0000 2024-09-22T08:35:40.407 INFO:teuthology.orchestra.run.smithi142.stdout: Birth: 2024-09-22 08:32:56.093892306 +0000 2024-09-22T08:35:40.407 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-22T08:35:40.470 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records in 2024-09-22T08:35:40.470 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records out 2024-09-22T08:35:40.470 INFO:teuthology.orchestra.run.smithi142.stderr:512 bytes copied, 0.000206351 s, 2.5 MB/s 2024-09-22T08:35:40.472 DEBUG:teuthology.orchestra.run.smithi142:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-22T08:35:40.528 DEBUG:teuthology.orchestra.run.smithi142:> stat /dev/vg_nvme/lv_3 2024-09-22T08:35:40.587 INFO:teuthology.orchestra.run.smithi142.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-22T08:35:40.587 INFO:teuthology.orchestra.run.smithi142.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-22T08:35:40.587 INFO:teuthology.orchestra.run.smithi142.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-09-22T08:35:40.587 INFO:teuthology.orchestra.run.smithi142.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-22T08:35:40.587 INFO:teuthology.orchestra.run.smithi142.stdout:Context: system_u:object_r:device_t:s0 2024-09-22T08:35:40.587 INFO:teuthology.orchestra.run.smithi142.stdout:Access: 2024-09-22 08:35:23.502332540 +0000 2024-09-22T08:35:40.588 INFO:teuthology.orchestra.run.smithi142.stdout:Modify: 2024-09-22 08:32:56.424886101 +0000 2024-09-22T08:35:40.588 INFO:teuthology.orchestra.run.smithi142.stdout:Change: 2024-09-22 08:32:56.424886101 +0000 2024-09-22T08:35:40.588 INFO:teuthology.orchestra.run.smithi142.stdout: Birth: 2024-09-22 08:32:56.424886101 +0000 2024-09-22T08:35:40.588 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-22T08:35:40.650 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records in 2024-09-22T08:35:40.650 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records out 2024-09-22T08:35:40.650 INFO:teuthology.orchestra.run.smithi142.stderr:512 bytes copied, 0.000267452 s, 1.9 MB/s 2024-09-22T08:35:40.652 DEBUG:teuthology.orchestra.run.smithi142:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-22T08:35:40.708 DEBUG:teuthology.orchestra.run.smithi142:> stat /dev/vg_nvme/lv_4 2024-09-22T08:35:40.763 INFO:teuthology.orchestra.run.smithi142.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-22T08:35:40.763 INFO:teuthology.orchestra.run.smithi142.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-22T08:35:40.763 INFO:teuthology.orchestra.run.smithi142.stdout:Device: 5h/5d Inode: 725 Links: 1 2024-09-22T08:35:40.763 INFO:teuthology.orchestra.run.smithi142.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-22T08:35:40.763 INFO:teuthology.orchestra.run.smithi142.stdout:Context: system_u:object_r:device_t:s0 2024-09-22T08:35:40.763 INFO:teuthology.orchestra.run.smithi142.stdout:Access: 2024-09-22 08:35:23.503332522 +0000 2024-09-22T08:35:40.763 INFO:teuthology.orchestra.run.smithi142.stdout:Modify: 2024-09-22 08:32:56.742880138 +0000 2024-09-22T08:35:40.763 INFO:teuthology.orchestra.run.smithi142.stdout:Change: 2024-09-22 08:32:56.742880138 +0000 2024-09-22T08:35:40.763 INFO:teuthology.orchestra.run.smithi142.stdout: Birth: 2024-09-22 08:32:56.742880138 +0000 2024-09-22T08:35:40.764 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-22T08:35:40.826 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records in 2024-09-22T08:35:40.826 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records out 2024-09-22T08:35:40.826 INFO:teuthology.orchestra.run.smithi142.stderr:512 bytes copied, 0.000194839 s, 2.6 MB/s 2024-09-22T08:35:40.827 DEBUG:teuthology.orchestra.run.smithi142:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-22T08:35:40.883 INFO:tasks.ceph:osd dev map: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-09-22T08:35:40.883 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi031.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi142.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'}} 2024-09-22T08:35:40.883 INFO:tasks.ceph:Generating config... 2024-09-22T08:35:40.884 INFO:tasks.ceph:[client] debug ms = 1 2024-09-22T08:35:40.885 INFO:tasks.ceph:[client] rgw gc obj min wait = 15 2024-09-22T08:35:40.885 INFO:tasks.ceph:[client] debug rgw = 20 2024-09-22T08:35:40.885 INFO:tasks.ceph:[client] setgroup = ceph 2024-09-22T08:35:40.885 INFO:tasks.ceph:[client] setuser = ceph 2024-09-22T08:35:40.885 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-22T08:35:40.885 INFO:tasks.ceph:[osd] debug objclass = 20 2024-09-22T08:35:40.885 INFO:tasks.ceph:[osd] bdev async discard = True 2024-09-22T08:35:40.885 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-09-22T08:35:40.885 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-09-22T08:35:40.885 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-22T08:35:40.885 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-22T08:35:40.885 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-09-22T08:35:40.885 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-09-22T08:35:40.885 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-22T08:35:40.886 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-09-22T08:35:40.886 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-22T08:35:40.886 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-22T08:35:40.886 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-22T08:35:40.886 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-22T08:35:40.886 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-22T08:35:40.886 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-22T08:35:40.886 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-22T08:35:40.886 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-22T08:35:40.886 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-22T08:35:40.886 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-22T08:35:40.886 INFO:tasks.ceph:Setting up mon.a... 2024-09-22T08:35:40.887 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-22T08:35:40.939 INFO:teuthology.orchestra.run.smithi031.stdout:creating /etc/ceph/ceph.keyring 2024-09-22T08:35:40.943 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-22T08:35:40.990 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-22T08:35:41.016 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.31')] 2024-09-22T08:35:41.016 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.31'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'debug ms': 1, 'debug objclass': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug ms': 1, 'rgw gc obj min wait': 15, 'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mon.a': {}} 2024-09-22T08:35:41.017 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-22T08:35:41.017 DEBUG:teuthology.orchestra.run.smithi031:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-22T08:35:41.072 DEBUG:teuthology.orchestra.run.smithi031:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.31 --print /home/ubuntu/cephtest/ceph.monmap 2024-09-22T08:35:41.153 INFO:teuthology.orchestra.run.smithi031.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:35:41.153 INFO:teuthology.orchestra.run.smithi031.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:35:41.154 INFO:teuthology.orchestra.run.smithi031.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-22T08:35:41.154 INFO:teuthology.orchestra.run.smithi031.stdout:monmaptool: generated fsid d3faaa46-a06c-404a-b783-532e7c90ea63 2024-09-22T08:35:41.154 INFO:teuthology.orchestra.run.smithi031.stdout:setting min_mon_release = quincy 2024-09-22T08:35:41.154 INFO:teuthology.orchestra.run.smithi031.stdout:epoch 0 2024-09-22T08:35:41.154 INFO:teuthology.orchestra.run.smithi031.stdout:fsid d3faaa46-a06c-404a-b783-532e7c90ea63 2024-09-22T08:35:41.154 INFO:teuthology.orchestra.run.smithi031.stdout:last_changed 2024-09-22T08:35:41.153531+0000 2024-09-22T08:35:41.154 INFO:teuthology.orchestra.run.smithi031.stdout:created 2024-09-22T08:35:41.153531+0000 2024-09-22T08:35:41.154 INFO:teuthology.orchestra.run.smithi031.stdout:min_mon_release 17 (quincy) 2024-09-22T08:35:41.154 INFO:teuthology.orchestra.run.smithi031.stdout:election_strategy: 1 2024-09-22T08:35:41.154 INFO:teuthology.orchestra.run.smithi031.stdout:0: [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] mon.a 2024-09-22T08:35:41.154 INFO:teuthology.orchestra.run.smithi031.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (1 monitors) 2024-09-22T08:35:41.155 DEBUG:teuthology.orchestra.run.smithi031:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-22T08:35:41.210 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID d3faaa46-a06c-404a-b783-532e7c90ea63... 2024-09-22T08:35:41.211 DEBUG:teuthology.orchestra.run.smithi031:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-22T08:35:41.253 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-22T08:35:41.295 INFO:teuthology.orchestra.run.smithi031.stdout:[global] 2024-09-22T08:35:41.295 INFO:teuthology.orchestra.run.smithi031.stdout: chdir = "" 2024-09-22T08:35:41.295 INFO:teuthology.orchestra.run.smithi031.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-22T08:35:41.295 INFO:teuthology.orchestra.run.smithi031.stdout: auth supported = cephx 2024-09-22T08:35:41.295 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-22T08:35:41.295 INFO:teuthology.orchestra.run.smithi031.stdout: filestore xattr use omap = true 2024-09-22T08:35:41.295 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-22T08:35:41.295 INFO:teuthology.orchestra.run.smithi031.stdout: mon clock drift allowed = 1.000 2024-09-22T08:35:41.296 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-22T08:35:41.296 INFO:teuthology.orchestra.run.smithi031.stdout: osd crush chooseleaf type = 0 2024-09-22T08:35:41.296 INFO:teuthology.orchestra.run.smithi031.stdout: auth debug = true 2024-09-22T08:35:41.296 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-22T08:35:41.296 INFO:teuthology.orchestra.run.smithi031.stdout: ms die on old message = true 2024-09-22T08:35:41.296 INFO:teuthology.orchestra.run.smithi031.stdout: ms die on bug = true 2024-09-22T08:35:41.296 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-22T08:35:41.296 INFO:teuthology.orchestra.run.smithi031.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-22T08:35:41.296 INFO:teuthology.orchestra.run.smithi031.stdout: mon pg warn max object skew = 0 2024-09-22T08:35:41.296 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-22T08:35:41.296 INFO:teuthology.orchestra.run.smithi031.stdout: # disable pg_autoscaler by default for new pools 2024-09-22T08:35:41.296 INFO:teuthology.orchestra.run.smithi031.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-22T08:35:41.296 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-22T08:35:41.297 INFO:teuthology.orchestra.run.smithi031.stdout: osd pool default size = 2 2024-09-22T08:35:41.297 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-22T08:35:41.297 INFO:teuthology.orchestra.run.smithi031.stdout: mon osd allow primary affinity = true 2024-09-22T08:35:41.297 INFO:teuthology.orchestra.run.smithi031.stdout: mon osd allow pg remap = true 2024-09-22T08:35:41.297 INFO:teuthology.orchestra.run.smithi031.stdout: mon warn on legacy crush tunables = false 2024-09-22T08:35:41.297 INFO:teuthology.orchestra.run.smithi031.stdout: mon warn on crush straw calc version zero = false 2024-09-22T08:35:41.297 INFO:teuthology.orchestra.run.smithi031.stdout: mon warn on no sortbitwise = false 2024-09-22T08:35:41.297 INFO:teuthology.orchestra.run.smithi031.stdout: mon warn on osd down out interval zero = false 2024-09-22T08:35:41.297 INFO:teuthology.orchestra.run.smithi031.stdout: mon warn on too few osds = false 2024-09-22T08:35:41.297 INFO:teuthology.orchestra.run.smithi031.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-22T08:35:41.297 INFO:teuthology.orchestra.run.smithi031.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-22T08:35:41.297 INFO:teuthology.orchestra.run.smithi031.stdout: mon_allow_pool_size_one = true 2024-09-22T08:35:41.297 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-22T08:35:41.298 INFO:teuthology.orchestra.run.smithi031.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-22T08:35:41.298 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-22T08:35:41.298 INFO:teuthology.orchestra.run.smithi031.stdout: osd default data pool replay window = 5 2024-09-22T08:35:41.298 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-22T08:35:41.298 INFO:teuthology.orchestra.run.smithi031.stdout: mon allow pool delete = true 2024-09-22T08:35:41.298 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-22T08:35:41.298 INFO:teuthology.orchestra.run.smithi031.stdout: mon cluster log file level = debug 2024-09-22T08:35:41.298 INFO:teuthology.orchestra.run.smithi031.stdout: debug asserts on shutdown = true 2024-09-22T08:35:41.298 INFO:teuthology.orchestra.run.smithi031.stdout: mon health detail to clog = false 2024-09-22T08:35:41.298 INFO:teuthology.orchestra.run.smithi031.stdout: mon host = 172.21.15.31 2024-09-22T08:35:41.298 INFO:teuthology.orchestra.run.smithi031.stdout: fsid = d3faaa46-a06c-404a-b783-532e7c90ea63 2024-09-22T08:35:41.298 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-22T08:35:41.298 INFO:teuthology.orchestra.run.smithi031.stdout:[osd] 2024-09-22T08:35:41.298 INFO:teuthology.orchestra.run.smithi031.stdout: osd journal size = 100 2024-09-22T08:35:41.299 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-22T08:35:41.299 INFO:teuthology.orchestra.run.smithi031.stdout: osd scrub load threshold = 5.0 2024-09-22T08:35:41.299 INFO:teuthology.orchestra.run.smithi031.stdout: osd scrub max interval = 600 2024-09-22T08:35:41.299 INFO:teuthology.orchestra.run.smithi031.stdout: osd mclock profile = high_recovery_ops 2024-09-22T08:35:41.299 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-22T08:35:41.299 INFO:teuthology.orchestra.run.smithi031.stdout: osd recover clone overlap = true 2024-09-22T08:35:41.299 INFO:teuthology.orchestra.run.smithi031.stdout: osd recovery max chunk = 1048576 2024-09-22T08:35:41.299 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-22T08:35:41.299 INFO:teuthology.orchestra.run.smithi031.stdout: osd debug shutdown = true 2024-09-22T08:35:41.299 INFO:teuthology.orchestra.run.smithi031.stdout: osd debug op order = true 2024-09-22T08:35:41.299 INFO:teuthology.orchestra.run.smithi031.stdout: osd debug verify stray on activate = true 2024-09-22T08:35:41.299 INFO:teuthology.orchestra.run.smithi031.stdout: osd debug trim objects = true 2024-09-22T08:35:41.299 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-22T08:35:41.299 INFO:teuthology.orchestra.run.smithi031.stdout: osd open classes on start = true 2024-09-22T08:35:41.300 INFO:teuthology.orchestra.run.smithi031.stdout: osd debug pg log writeout = true 2024-09-22T08:35:41.300 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-22T08:35:41.300 INFO:teuthology.orchestra.run.smithi031.stdout: osd deep scrub update digest min age = 30 2024-09-22T08:35:41.300 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-22T08:35:41.300 INFO:teuthology.orchestra.run.smithi031.stdout: osd map max advance = 10 2024-09-22T08:35:41.300 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-22T08:35:41.300 INFO:teuthology.orchestra.run.smithi031.stdout: journal zero on create = true 2024-09-22T08:35:41.300 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-22T08:35:41.300 INFO:teuthology.orchestra.run.smithi031.stdout: filestore ondisk finisher threads = 3 2024-09-22T08:35:41.300 INFO:teuthology.orchestra.run.smithi031.stdout: filestore apply finisher threads = 3 2024-09-22T08:35:41.300 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-22T08:35:41.300 INFO:teuthology.orchestra.run.smithi031.stdout: bdev debug aio = true 2024-09-22T08:35:41.300 INFO:teuthology.orchestra.run.smithi031.stdout: osd debug misdirected ops = true 2024-09-22T08:35:41.300 INFO:teuthology.orchestra.run.smithi031.stdout: debug ms = 1 2024-09-22T08:35:41.301 INFO:teuthology.orchestra.run.smithi031.stdout: debug objclass = 20 2024-09-22T08:35:41.301 INFO:teuthology.orchestra.run.smithi031.stdout: bdev async discard = True 2024-09-22T08:35:41.301 INFO:teuthology.orchestra.run.smithi031.stdout: bdev enable discard = True 2024-09-22T08:35:41.301 INFO:teuthology.orchestra.run.smithi031.stdout: bluestore allocator = bitmap 2024-09-22T08:35:41.301 INFO:teuthology.orchestra.run.smithi031.stdout: bluestore block size = 96636764160 2024-09-22T08:35:41.301 INFO:teuthology.orchestra.run.smithi031.stdout: bluestore fsck on mount = True 2024-09-22T08:35:41.301 INFO:teuthology.orchestra.run.smithi031.stdout: debug bluefs = 1/20 2024-09-22T08:35:41.301 INFO:teuthology.orchestra.run.smithi031.stdout: debug bluestore = 1/20 2024-09-22T08:35:41.301 INFO:teuthology.orchestra.run.smithi031.stdout: debug osd = 20 2024-09-22T08:35:41.301 INFO:teuthology.orchestra.run.smithi031.stdout: debug rocksdb = 4/10 2024-09-22T08:35:41.301 INFO:teuthology.orchestra.run.smithi031.stdout: mon osd backfillfull_ratio = 0.85 2024-09-22T08:35:41.301 INFO:teuthology.orchestra.run.smithi031.stdout: mon osd full ratio = 0.9 2024-09-22T08:35:41.301 INFO:teuthology.orchestra.run.smithi031.stdout: mon osd nearfull ratio = 0.8 2024-09-22T08:35:41.301 INFO:teuthology.orchestra.run.smithi031.stdout: osd failsafe full ratio = 0.95 2024-09-22T08:35:41.301 INFO:teuthology.orchestra.run.smithi031.stdout: osd objectstore = bluestore 2024-09-22T08:35:41.302 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-22T08:35:41.302 INFO:teuthology.orchestra.run.smithi031.stdout:[mgr] 2024-09-22T08:35:41.302 INFO:teuthology.orchestra.run.smithi031.stdout: debug ms = 1 2024-09-22T08:35:41.302 INFO:teuthology.orchestra.run.smithi031.stdout: debug mgr = 20 2024-09-22T08:35:41.302 INFO:teuthology.orchestra.run.smithi031.stdout: debug mon = 20 2024-09-22T08:35:41.302 INFO:teuthology.orchestra.run.smithi031.stdout: debug auth = 20 2024-09-22T08:35:41.302 INFO:teuthology.orchestra.run.smithi031.stdout: mon reweight min pgs per osd = 4 2024-09-22T08:35:41.302 INFO:teuthology.orchestra.run.smithi031.stdout: mon reweight min bytes per osd = 10 2024-09-22T08:35:41.302 INFO:teuthology.orchestra.run.smithi031.stdout: mgr/telemetry/nag = false 2024-09-22T08:35:41.302 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-22T08:35:41.302 INFO:teuthology.orchestra.run.smithi031.stdout:[mon] 2024-09-22T08:35:41.302 INFO:teuthology.orchestra.run.smithi031.stdout: debug ms = 1 2024-09-22T08:35:41.302 INFO:teuthology.orchestra.run.smithi031.stdout: debug mon = 20 2024-09-22T08:35:41.302 INFO:teuthology.orchestra.run.smithi031.stdout: debug paxos = 20 2024-09-22T08:35:41.303 INFO:teuthology.orchestra.run.smithi031.stdout: debug auth = 20 2024-09-22T08:35:41.303 INFO:teuthology.orchestra.run.smithi031.stdout: mon data avail warn = 5 2024-09-22T08:35:41.303 INFO:teuthology.orchestra.run.smithi031.stdout: mon mgr mkfs grace = 240 2024-09-22T08:35:41.303 INFO:teuthology.orchestra.run.smithi031.stdout: mon reweight min pgs per osd = 4 2024-09-22T08:35:41.303 INFO:teuthology.orchestra.run.smithi031.stdout: mon osd reporter subtree level = osd 2024-09-22T08:35:41.303 INFO:teuthology.orchestra.run.smithi031.stdout: mon osd prime pg temp = true 2024-09-22T08:35:41.303 INFO:teuthology.orchestra.run.smithi031.stdout: mon reweight min bytes per osd = 10 2024-09-22T08:35:41.303 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-22T08:35:41.303 INFO:teuthology.orchestra.run.smithi031.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-22T08:35:41.303 INFO:teuthology.orchestra.run.smithi031.stdout: auth mon ticket ttl = 660 # 11m 2024-09-22T08:35:41.303 INFO:teuthology.orchestra.run.smithi031.stdout: auth service ticket ttl = 240 # 4m 2024-09-22T08:35:41.303 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-22T08:35:41.303 INFO:teuthology.orchestra.run.smithi031.stdout: # don't complain about insecure global_id in the test suite 2024-09-22T08:35:41.303 INFO:teuthology.orchestra.run.smithi031.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-22T08:35:41.304 INFO:teuthology.orchestra.run.smithi031.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-22T08:35:41.304 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-22T08:35:41.304 INFO:teuthology.orchestra.run.smithi031.stdout: # 1m isn't quite enough 2024-09-22T08:35:41.304 INFO:teuthology.orchestra.run.smithi031.stdout: mon_down_mkfs_grace = 2m 2024-09-22T08:35:41.304 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-22T08:35:41.304 INFO:teuthology.orchestra.run.smithi031.stdout: mon_warn_on_filestore_osds = false 2024-09-22T08:35:41.304 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-22T08:35:41.304 INFO:teuthology.orchestra.run.smithi031.stdout:[client] 2024-09-22T08:35:41.304 INFO:teuthology.orchestra.run.smithi031.stdout: rgw cache enabled = true 2024-09-22T08:35:41.304 INFO:teuthology.orchestra.run.smithi031.stdout: rgw enable ops log = true 2024-09-22T08:35:41.304 INFO:teuthology.orchestra.run.smithi031.stdout: rgw enable usage log = true 2024-09-22T08:35:41.304 INFO:teuthology.orchestra.run.smithi031.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-22T08:35:41.304 INFO:teuthology.orchestra.run.smithi031.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-22T08:35:41.304 INFO:teuthology.orchestra.run.smithi031.stdout: debug ms = 1 2024-09-22T08:35:41.304 INFO:teuthology.orchestra.run.smithi031.stdout: rgw gc obj min wait = 15 2024-09-22T08:35:41.304 INFO:teuthology.orchestra.run.smithi031.stdout: debug rgw = 20 2024-09-22T08:35:41.305 INFO:teuthology.orchestra.run.smithi031.stdout: setgroup = ceph 2024-09-22T08:35:41.305 INFO:teuthology.orchestra.run.smithi031.stdout: setuser = ceph 2024-09-22T08:35:41.305 INFO:teuthology.orchestra.run.smithi031.stdout:[mon.a] 2024-09-22T08:35:41.305 INFO:teuthology.orchestra.run.smithi142.stdout:[global] 2024-09-22T08:35:41.305 INFO:teuthology.orchestra.run.smithi142.stdout: chdir = "" 2024-09-22T08:35:41.305 INFO:teuthology.orchestra.run.smithi142.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-22T08:35:41.305 INFO:teuthology.orchestra.run.smithi142.stdout: auth supported = cephx 2024-09-22T08:35:41.305 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-22T08:35:41.305 INFO:teuthology.orchestra.run.smithi142.stdout: filestore xattr use omap = true 2024-09-22T08:35:41.305 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-22T08:35:41.306 INFO:teuthology.orchestra.run.smithi142.stdout: mon clock drift allowed = 1.000 2024-09-22T08:35:41.306 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-22T08:35:41.306 INFO:teuthology.orchestra.run.smithi142.stdout: osd crush chooseleaf type = 0 2024-09-22T08:35:41.306 INFO:teuthology.orchestra.run.smithi142.stdout: auth debug = true 2024-09-22T08:35:41.306 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-22T08:35:41.306 INFO:teuthology.orchestra.run.smithi142.stdout: ms die on old message = true 2024-09-22T08:35:41.306 INFO:teuthology.orchestra.run.smithi142.stdout: ms die on bug = true 2024-09-22T08:35:41.306 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-22T08:35:41.306 INFO:teuthology.orchestra.run.smithi142.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-22T08:35:41.306 INFO:teuthology.orchestra.run.smithi142.stdout: mon pg warn max object skew = 0 2024-09-22T08:35:41.306 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-22T08:35:41.306 INFO:teuthology.orchestra.run.smithi142.stdout: # disable pg_autoscaler by default for new pools 2024-09-22T08:35:41.306 INFO:teuthology.orchestra.run.smithi142.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-22T08:35:41.306 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-22T08:35:41.307 INFO:teuthology.orchestra.run.smithi142.stdout: osd pool default size = 2 2024-09-22T08:35:41.307 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-22T08:35:41.307 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd allow primary affinity = true 2024-09-22T08:35:41.307 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd allow pg remap = true 2024-09-22T08:35:41.307 INFO:teuthology.orchestra.run.smithi142.stdout: mon warn on legacy crush tunables = false 2024-09-22T08:35:41.307 INFO:teuthology.orchestra.run.smithi142.stdout: mon warn on crush straw calc version zero = false 2024-09-22T08:35:41.307 INFO:teuthology.orchestra.run.smithi142.stdout: mon warn on no sortbitwise = false 2024-09-22T08:35:41.307 INFO:teuthology.orchestra.run.smithi142.stdout: mon warn on osd down out interval zero = false 2024-09-22T08:35:41.307 INFO:teuthology.orchestra.run.smithi142.stdout: mon warn on too few osds = false 2024-09-22T08:35:41.307 INFO:teuthology.orchestra.run.smithi142.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-22T08:35:41.307 INFO:teuthology.orchestra.run.smithi142.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-22T08:35:41.307 INFO:teuthology.orchestra.run.smithi142.stdout: mon_allow_pool_size_one = true 2024-09-22T08:35:41.307 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-22T08:35:41.307 INFO:teuthology.orchestra.run.smithi142.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-22T08:35:41.307 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-22T08:35:41.308 INFO:teuthology.orchestra.run.smithi142.stdout: osd default data pool replay window = 5 2024-09-22T08:35:41.308 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-22T08:35:41.308 INFO:teuthology.orchestra.run.smithi142.stdout: mon allow pool delete = true 2024-09-22T08:35:41.308 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-22T08:35:41.308 INFO:teuthology.orchestra.run.smithi142.stdout: mon cluster log file level = debug 2024-09-22T08:35:41.308 INFO:teuthology.orchestra.run.smithi142.stdout: debug asserts on shutdown = true 2024-09-22T08:35:41.308 INFO:teuthology.orchestra.run.smithi142.stdout: mon health detail to clog = false 2024-09-22T08:35:41.308 INFO:teuthology.orchestra.run.smithi142.stdout: mon host = 172.21.15.31 2024-09-22T08:35:41.308 INFO:teuthology.orchestra.run.smithi142.stdout: fsid = d3faaa46-a06c-404a-b783-532e7c90ea63 2024-09-22T08:35:41.308 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-22T08:35:41.308 INFO:teuthology.orchestra.run.smithi142.stdout:[osd] 2024-09-22T08:35:41.308 INFO:teuthology.orchestra.run.smithi142.stdout: osd journal size = 100 2024-09-22T08:35:41.308 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-22T08:35:41.308 INFO:teuthology.orchestra.run.smithi142.stdout: osd scrub load threshold = 5.0 2024-09-22T08:35:41.309 INFO:teuthology.orchestra.run.smithi142.stdout: osd scrub max interval = 600 2024-09-22T08:35:41.309 INFO:teuthology.orchestra.run.smithi142.stdout: osd mclock profile = high_recovery_ops 2024-09-22T08:35:41.309 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-22T08:35:41.309 INFO:teuthology.orchestra.run.smithi142.stdout: osd recover clone overlap = true 2024-09-22T08:35:41.309 INFO:teuthology.orchestra.run.smithi142.stdout: osd recovery max chunk = 1048576 2024-09-22T08:35:41.309 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-22T08:35:41.309 INFO:teuthology.orchestra.run.smithi142.stdout: osd debug shutdown = true 2024-09-22T08:35:41.309 INFO:teuthology.orchestra.run.smithi142.stdout: osd debug op order = true 2024-09-22T08:35:41.309 INFO:teuthology.orchestra.run.smithi142.stdout: osd debug verify stray on activate = true 2024-09-22T08:35:41.309 INFO:teuthology.orchestra.run.smithi142.stdout: osd debug trim objects = true 2024-09-22T08:35:41.309 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-22T08:35:41.309 INFO:teuthology.orchestra.run.smithi142.stdout: osd open classes on start = true 2024-09-22T08:35:41.309 INFO:teuthology.orchestra.run.smithi142.stdout: osd debug pg log writeout = true 2024-09-22T08:35:41.309 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-22T08:35:41.309 INFO:teuthology.orchestra.run.smithi142.stdout: osd deep scrub update digest min age = 30 2024-09-22T08:35:41.310 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-22T08:35:41.310 INFO:teuthology.orchestra.run.smithi142.stdout: osd map max advance = 10 2024-09-22T08:35:41.310 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-22T08:35:41.310 INFO:teuthology.orchestra.run.smithi142.stdout: journal zero on create = true 2024-09-22T08:35:41.310 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-22T08:35:41.310 INFO:teuthology.orchestra.run.smithi142.stdout: filestore ondisk finisher threads = 3 2024-09-22T08:35:41.310 INFO:teuthology.orchestra.run.smithi142.stdout: filestore apply finisher threads = 3 2024-09-22T08:35:41.310 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-22T08:35:41.310 INFO:teuthology.orchestra.run.smithi142.stdout: bdev debug aio = true 2024-09-22T08:35:41.310 INFO:teuthology.orchestra.run.smithi142.stdout: osd debug misdirected ops = true 2024-09-22T08:35:41.310 INFO:teuthology.orchestra.run.smithi142.stdout: debug ms = 1 2024-09-22T08:35:41.310 INFO:teuthology.orchestra.run.smithi142.stdout: debug objclass = 20 2024-09-22T08:35:41.310 INFO:teuthology.orchestra.run.smithi142.stdout: bdev async discard = True 2024-09-22T08:35:41.310 INFO:teuthology.orchestra.run.smithi142.stdout: bdev enable discard = True 2024-09-22T08:35:41.311 INFO:teuthology.orchestra.run.smithi142.stdout: bluestore allocator = bitmap 2024-09-22T08:35:41.311 INFO:teuthology.orchestra.run.smithi142.stdout: bluestore block size = 96636764160 2024-09-22T08:35:41.311 INFO:teuthology.orchestra.run.smithi142.stdout: bluestore fsck on mount = True 2024-09-22T08:35:41.311 INFO:teuthology.orchestra.run.smithi142.stdout: debug bluefs = 1/20 2024-09-22T08:35:41.311 INFO:teuthology.orchestra.run.smithi142.stdout: debug bluestore = 1/20 2024-09-22T08:35:41.311 INFO:teuthology.orchestra.run.smithi142.stdout: debug osd = 20 2024-09-22T08:35:41.311 INFO:teuthology.orchestra.run.smithi142.stdout: debug rocksdb = 4/10 2024-09-22T08:35:41.311 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd backfillfull_ratio = 0.85 2024-09-22T08:35:41.311 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd full ratio = 0.9 2024-09-22T08:35:41.311 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd nearfull ratio = 0.8 2024-09-22T08:35:41.311 INFO:teuthology.orchestra.run.smithi142.stdout: osd failsafe full ratio = 0.95 2024-09-22T08:35:41.311 INFO:teuthology.orchestra.run.smithi142.stdout: osd objectstore = bluestore 2024-09-22T08:35:41.311 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-22T08:35:41.311 INFO:teuthology.orchestra.run.smithi142.stdout:[mgr] 2024-09-22T08:35:41.312 INFO:teuthology.orchestra.run.smithi142.stdout: debug ms = 1 2024-09-22T08:35:41.312 INFO:teuthology.orchestra.run.smithi142.stdout: debug mgr = 20 2024-09-22T08:35:41.312 INFO:teuthology.orchestra.run.smithi142.stdout: debug mon = 20 2024-09-22T08:35:41.312 INFO:teuthology.orchestra.run.smithi142.stdout: debug auth = 20 2024-09-22T08:35:41.312 INFO:teuthology.orchestra.run.smithi142.stdout: mon reweight min pgs per osd = 4 2024-09-22T08:35:41.312 INFO:teuthology.orchestra.run.smithi142.stdout: mon reweight min bytes per osd = 10 2024-09-22T08:35:41.312 INFO:teuthology.orchestra.run.smithi142.stdout: mgr/telemetry/nag = false 2024-09-22T08:35:41.312 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-22T08:35:41.312 INFO:teuthology.orchestra.run.smithi142.stdout:[mon] 2024-09-22T08:35:41.312 INFO:teuthology.orchestra.run.smithi142.stdout: debug ms = 1 2024-09-22T08:35:41.312 INFO:teuthology.orchestra.run.smithi142.stdout: debug mon = 20 2024-09-22T08:35:41.312 INFO:teuthology.orchestra.run.smithi142.stdout: debug paxos = 20 2024-09-22T08:35:41.312 INFO:teuthology.orchestra.run.smithi142.stdout: debug auth = 20 2024-09-22T08:35:41.312 INFO:teuthology.orchestra.run.smithi142.stdout: mon data avail warn = 5 2024-09-22T08:35:41.312 INFO:teuthology.orchestra.run.smithi142.stdout: mon mgr mkfs grace = 240 2024-09-22T08:35:41.313 INFO:teuthology.orchestra.run.smithi142.stdout: mon reweight min pgs per osd = 4 2024-09-22T08:35:41.313 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd reporter subtree level = osd 2024-09-22T08:35:41.313 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd prime pg temp = true 2024-09-22T08:35:41.313 INFO:teuthology.orchestra.run.smithi142.stdout: mon reweight min bytes per osd = 10 2024-09-22T08:35:41.313 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-22T08:35:41.313 INFO:teuthology.orchestra.run.smithi142.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-22T08:35:41.313 INFO:teuthology.orchestra.run.smithi142.stdout: auth mon ticket ttl = 660 # 11m 2024-09-22T08:35:41.313 INFO:teuthology.orchestra.run.smithi142.stdout: auth service ticket ttl = 240 # 4m 2024-09-22T08:35:41.313 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-22T08:35:41.313 INFO:teuthology.orchestra.run.smithi142.stdout: # don't complain about insecure global_id in the test suite 2024-09-22T08:35:41.313 INFO:teuthology.orchestra.run.smithi142.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-22T08:35:41.313 INFO:teuthology.orchestra.run.smithi142.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-22T08:35:41.313 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-22T08:35:41.313 INFO:teuthology.orchestra.run.smithi142.stdout: # 1m isn't quite enough 2024-09-22T08:35:41.313 INFO:teuthology.orchestra.run.smithi142.stdout: mon_down_mkfs_grace = 2m 2024-09-22T08:35:41.313 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-22T08:35:41.314 INFO:teuthology.orchestra.run.smithi142.stdout: mon_warn_on_filestore_osds = false 2024-09-22T08:35:41.314 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-22T08:35:41.314 INFO:teuthology.orchestra.run.smithi142.stdout:[client] 2024-09-22T08:35:41.314 INFO:teuthology.orchestra.run.smithi142.stdout: rgw cache enabled = true 2024-09-22T08:35:41.314 INFO:teuthology.orchestra.run.smithi142.stdout: rgw enable ops log = true 2024-09-22T08:35:41.314 INFO:teuthology.orchestra.run.smithi142.stdout: rgw enable usage log = true 2024-09-22T08:35:41.314 INFO:teuthology.orchestra.run.smithi142.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-22T08:35:41.314 INFO:teuthology.orchestra.run.smithi142.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-22T08:35:41.314 INFO:teuthology.orchestra.run.smithi142.stdout: debug ms = 1 2024-09-22T08:35:41.314 INFO:teuthology.orchestra.run.smithi142.stdout: rgw gc obj min wait = 15 2024-09-22T08:35:41.314 INFO:teuthology.orchestra.run.smithi142.stdout: debug rgw = 20 2024-09-22T08:35:41.314 INFO:teuthology.orchestra.run.smithi142.stdout: setgroup = ceph 2024-09-22T08:35:41.314 INFO:teuthology.orchestra.run.smithi142.stdout: setuser = ceph 2024-09-22T08:35:41.314 INFO:teuthology.orchestra.run.smithi142.stdout:[mon.a] 2024-09-22T08:35:41.316 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-22T08:35:41.316 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-22T08:35:41.412 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-22T08:35:41.412 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-22T08:35:41.412 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-22T08:35:41.428 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-22T08:35:41.428 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-22T08:35:41.483 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi031.front.sepia.ceph.com 2024-09-22T08:35:41.483 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-22T08:35:41.483 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-22T08:35:41.484 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-22T08:35:41.560 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-22T08:35:41.560 DEBUG:teuthology.orchestra.run.smithi031:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-22T08:35:41.616 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi142.front.sepia.ceph.com 2024-09-22T08:35:41.616 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-09-22T08:35:41.616 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-22T08:35:41.616 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-22T08:35:41.651 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-09-22T08:35:41.651 DEBUG:teuthology.orchestra.run.smithi142:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-22T08:35:41.706 INFO:tasks.ceph:Setting up mon nodes... 2024-09-22T08:35:41.706 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-22T08:35:41.707 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-22T08:35:41.832 INFO:teuthology.orchestra.run.smithi142.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-22T08:35:41.834 INFO:tasks.ceph:Setting up mds nodes... 2024-09-22T08:35:41.834 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-22T08:35:41.835 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-22T08:35:41.875 INFO:teuthology.orchestra.run.smithi142.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-22T08:35:41.888 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-22T08:35:41.888 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi031.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi142.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'}} 2024-09-22T08:35:41.888 DEBUG:teuthology.orchestra.run.smithi031:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-22T08:35:41.915 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1'} 2024-09-22T08:35:41.915 INFO:tasks.ceph:role: osd.0 2024-09-22T08:35:41.915 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi031.front.sepia.ceph.com 2024-09-22T08:35:41.915 DEBUG:teuthology.orchestra.run.smithi031:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-22T08:35:41.988 INFO:teuthology.orchestra.run.smithi031.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-22T08:35:41.988 INFO:teuthology.orchestra.run.smithi031.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-22T08:35:41.988 INFO:teuthology.orchestra.run.smithi031.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-22T08:35:41.988 INFO:teuthology.orchestra.run.smithi031.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-22T08:35:41.989 INFO:teuthology.orchestra.run.smithi031.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-22T08:35:41.989 INFO:teuthology.orchestra.run.smithi031.stdout: = sunit=0 swidth=0 blks 2024-09-22T08:35:41.989 INFO:teuthology.orchestra.run.smithi031.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-22T08:35:41.989 INFO:teuthology.orchestra.run.smithi031.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-22T08:35:41.989 INFO:teuthology.orchestra.run.smithi031.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-22T08:35:41.989 INFO:teuthology.orchestra.run.smithi031.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-22T08:35:42.493 INFO:teuthology.orchestra.run.smithi031.stdout:Discarding blocks...Done. 2024-09-22T08:35:42.495 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi031.front.sepia.ceph.com -o noatime 2024-09-22T08:35:42.496 DEBUG:teuthology.orchestra.run.smithi031:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-22T08:35:42.621 DEBUG:teuthology.orchestra.run.smithi031:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-22T08:35:42.655 DEBUG:teuthology.orchestra.run.smithi031:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-22T08:35:42.756 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:35:42.754+0000 7f451d214640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-22T08:35:42.760 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:35:42.758+0000 7f451d214640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-22T08:35:42.760 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:35:42.758+0000 7f451d214640 -1 bdev(0x5601666af800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-22T08:35:42.760 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:35:42.758+0000 7f451d214640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-22T08:35:45.935 DEBUG:teuthology.orchestra.run.smithi031:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-22T08:35:45.966 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-22T08:35:45.997 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-09-22T08:35:45.997 INFO:tasks.ceph:role: osd.1 2024-09-22T08:35:45.997 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi142.front.sepia.ceph.com 2024-09-22T08:35:45.997 DEBUG:teuthology.orchestra.run.smithi142:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-22T08:35:46.074 INFO:teuthology.orchestra.run.smithi142.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-22T08:35:46.074 INFO:teuthology.orchestra.run.smithi142.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-22T08:35:46.074 INFO:teuthology.orchestra.run.smithi142.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-22T08:35:46.074 INFO:teuthology.orchestra.run.smithi142.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-22T08:35:46.074 INFO:teuthology.orchestra.run.smithi142.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-22T08:35:46.074 INFO:teuthology.orchestra.run.smithi142.stdout: = sunit=0 swidth=0 blks 2024-09-22T08:35:46.074 INFO:teuthology.orchestra.run.smithi142.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-22T08:35:46.074 INFO:teuthology.orchestra.run.smithi142.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-22T08:35:46.074 INFO:teuthology.orchestra.run.smithi142.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-22T08:35:46.075 INFO:teuthology.orchestra.run.smithi142.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-22T08:35:46.590 INFO:teuthology.orchestra.run.smithi142.stdout:Discarding blocks...Done. 2024-09-22T08:35:46.592 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi142.front.sepia.ceph.com -o noatime 2024-09-22T08:35:46.592 DEBUG:teuthology.orchestra.run.smithi142:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-1 2024-09-22T08:35:46.715 DEBUG:teuthology.orchestra.run.smithi142:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-22T08:35:46.750 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-22T08:35:46.817 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-09-22T08:35:46.818 INFO:tasks.ceph:role: osd.2 2024-09-22T08:35:46.818 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi142.front.sepia.ceph.com 2024-09-22T08:35:46.818 DEBUG:teuthology.orchestra.run.smithi142:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-22T08:35:46.894 INFO:teuthology.orchestra.run.smithi142.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-22T08:35:46.894 INFO:teuthology.orchestra.run.smithi142.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-22T08:35:46.894 INFO:teuthology.orchestra.run.smithi142.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-22T08:35:46.895 INFO:teuthology.orchestra.run.smithi142.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-22T08:35:46.895 INFO:teuthology.orchestra.run.smithi142.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-22T08:35:46.895 INFO:teuthology.orchestra.run.smithi142.stdout: = sunit=0 swidth=0 blks 2024-09-22T08:35:46.895 INFO:teuthology.orchestra.run.smithi142.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-22T08:35:46.895 INFO:teuthology.orchestra.run.smithi142.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-22T08:35:46.895 INFO:teuthology.orchestra.run.smithi142.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-22T08:35:46.895 INFO:teuthology.orchestra.run.smithi142.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-22T08:35:47.360 INFO:teuthology.orchestra.run.smithi142.stdout:Discarding blocks...Done. 2024-09-22T08:35:47.362 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi142.front.sepia.ceph.com -o noatime 2024-09-22T08:35:47.362 DEBUG:teuthology.orchestra.run.smithi142:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-2 2024-09-22T08:35:47.457 DEBUG:teuthology.orchestra.run.smithi142:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-22T08:35:47.486 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-22T08:35:47.552 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-09-22T08:35:47.552 INFO:tasks.ceph:role: osd.3 2024-09-22T08:35:47.552 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi142.front.sepia.ceph.com 2024-09-22T08:35:47.552 DEBUG:teuthology.orchestra.run.smithi142:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-22T08:35:47.624 INFO:teuthology.orchestra.run.smithi142.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-22T08:35:47.624 INFO:teuthology.orchestra.run.smithi142.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-22T08:35:47.624 INFO:teuthology.orchestra.run.smithi142.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-22T08:35:47.624 INFO:teuthology.orchestra.run.smithi142.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-22T08:35:47.625 INFO:teuthology.orchestra.run.smithi142.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-22T08:35:47.625 INFO:teuthology.orchestra.run.smithi142.stdout: = sunit=0 swidth=0 blks 2024-09-22T08:35:47.625 INFO:teuthology.orchestra.run.smithi142.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-22T08:35:47.625 INFO:teuthology.orchestra.run.smithi142.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-22T08:35:47.625 INFO:teuthology.orchestra.run.smithi142.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-22T08:35:47.625 INFO:teuthology.orchestra.run.smithi142.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-22T08:35:48.103 INFO:teuthology.orchestra.run.smithi142.stdout:Discarding blocks...Done. 2024-09-22T08:35:48.105 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi142.front.sepia.ceph.com -o noatime 2024-09-22T08:35:48.105 DEBUG:teuthology.orchestra.run.smithi142:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-3 2024-09-22T08:35:48.255 DEBUG:teuthology.orchestra.run.smithi142:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-22T08:35:48.285 DEBUG:teuthology.orchestra.run.smithi142:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-22T08:35:48.401 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:48.399+0000 7fae8c62c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-22T08:35:48.405 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:48.404+0000 7fae8c62c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-22T08:35:48.406 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:48.404+0000 7fae8c62c640 -1 bdev(0x55db89d77800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-22T08:35:48.406 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:48.404+0000 7fae8c62c640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-22T08:35:51.566 DEBUG:teuthology.orchestra.run.smithi142:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-22T08:35:51.595 DEBUG:teuthology.orchestra.run.smithi142:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-22T08:35:51.683 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:51.681+0000 7f969ca10640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-22T08:35:51.683 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:51.682+0000 7f969ca10640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-22T08:35:51.683 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:51.682+0000 7f969ca10640 -1 bdev(0x5576b450d800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-22T08:35:51.683 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:51.682+0000 7f969ca10640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-22T08:35:54.592 DEBUG:teuthology.orchestra.run.smithi142:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-22T08:35:54.620 DEBUG:teuthology.orchestra.run.smithi142:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-22T08:35:54.708 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:54.707+0000 7f0534818640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-22T08:35:54.709 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:54.707+0000 7f0534818640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-22T08:35:54.709 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:54.707+0000 7f0534818640 -1 bdev(0x561dc1103800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2024-09-22T08:35:54.709 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:54.707+0000 7f0534818640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-22T08:35:57.863 DEBUG:teuthology.orchestra.run.smithi142:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-22T08:35:57.893 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-22T08:35:57.893 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-22T08:35:57.893 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-22T08:35:57.925 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-09-22T08:35:57.925 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-22T08:35:57.961 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-09-22T08:35:57.961 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-22T08:35:58.027 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-09-22T08:35:58.028 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-22T08:35:58.094 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-09-22T08:35:58.094 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-22T08:35:58.159 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-09-22T08:35:58.160 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-22T08:35:58.218 INFO:tasks.ceph:Adding keys to all mons... 2024-09-22T08:35:58.218 DEBUG:teuthology.orchestra.run.smithi031:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-22T08:35:58.247 INFO:teuthology.orchestra.run.smithi031.stdout:[osd.0] 2024-09-22T08:35:58.247 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQDe1u9m46IPLRAAMshaEZhFKKpp4UbpPaf/pA== 2024-09-22T08:35:58.248 INFO:teuthology.orchestra.run.smithi031.stdout:[mgr.x] 2024-09-22T08:35:58.248 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQDd1u9mTnOVMRAAwYMNxQRvN1+MrCP5kX95kg== 2024-09-22T08:35:58.248 INFO:teuthology.orchestra.run.smithi031.stdout:[osd.1] 2024-09-22T08:35:58.248 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQDk1u9mgjrnFxAA321GdN3O5c7lsA/Ruw0LYw== 2024-09-22T08:35:58.248 INFO:teuthology.orchestra.run.smithi031.stdout:[osd.2] 2024-09-22T08:35:58.248 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQDn1u9mEdawKBAAEDAOaMchFkZZ+QKwJAVomA== 2024-09-22T08:35:58.248 INFO:teuthology.orchestra.run.smithi031.stdout:[osd.3] 2024-09-22T08:35:58.248 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQDq1u9mNxw0KhAATU6lzEwTj8qbbFxKgp1p2A== 2024-09-22T08:35:58.248 INFO:teuthology.orchestra.run.smithi031.stdout:[client.0] 2024-09-22T08:35:58.248 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQDd1u9mujMvNBAAo00muSuEswgqE7R5gAtQIQ== 2024-09-22T08:35:58.249 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-22T08:35:58.350 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-22T08:35:58.406 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-22T08:35:58.460 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-22T08:35:58.513 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-22T08:35:58.565 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-22T08:35:58.620 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-22T08:35:58.620 DEBUG:teuthology.orchestra.run.smithi031:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-22T08:35:58.646 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-22T08:35:58.747 DEBUG:teuthology.orchestra.run.smithi031:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-22T08:35:58.772 DEBUG:teuthology.orchestra.run.smithi031:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-22T08:35:58.828 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-22T08:35:58.829 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-22T08:35:58.829 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-22T08:35:58.871 INFO:tasks.ceph.mon.a:Started 2024-09-22T08:35:58.871 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-22T08:35:58.871 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-22T08:35:58.872 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-22T08:35:58.874 INFO:tasks.ceph.mgr.x:Started 2024-09-22T08:35:58.874 DEBUG:tasks.ceph:set 0 configs 2024-09-22T08:35:58.874 INFO:tasks.ceph:Setting crush tunables to default 2024-09-22T08:35:58.874 DEBUG:teuthology.orchestra.run.smithi031:> sudo ceph --cluster ceph osd crush tunables default 2024-09-22T08:35:58.975 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:35:58.973+0000 7f4fd182a640 1 Processor -- start 2024-09-22T08:35:58.975 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:35:58.973+0000 7f4fd182a640 1 -- start start 2024-09-22T08:35:58.975 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:35:58.973+0000 7f4fd182a640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f4fcc098290 0x7f4fcc098670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:35:58.975 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:35:58.973+0000 7f4fd182a640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4fcc099610 con 0x7f4fcc098bb0 2024-09-22T08:35:58.975 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:35:58.974+0000 7f4fd182a640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f4fcc09d1f0 con 0x7f4fcc098290 2024-09-22T08:35:58.975 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:35:58.974+0000 7f4fcaffd640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f4fcc098290 0x7f4fcc098670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:35:58.976 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:35:58.974+0000 7f4fcaffd640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f4fcc098290 0x7f4fcc098670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:37824/0 (socket says 172.21.15.31:37824) 2024-09-22T08:35:58.976 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:35:58.974+0000 7f4fcaffd640 1 -- 172.21.15.31:0/315208239 learned_addr learned my addr 172.21.15.31:0/315208239 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-22T08:35:58.976 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:35:58.974+0000 7f4fcaffd640 1 -- 172.21.15.31:0/315208239 >> v2:172.21.15.31:3300/0 conn(0x7f4fcc098290 msgr2=0x7f4fcc098670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-22T08:35:58.976 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:35:58.974+0000 7f4fcaffd640 1 -- 172.21.15.31:0/315208239 >> v2:172.21.15.31:3300/0 conn(0x7f4fcc098290 msgr2=0x7f4fcc098670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-22T08:35:58.976 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:35:58.974+0000 7f4fcaffd640 1 --2- 172.21.15.31:0/315208239 >> v2:172.21.15.31:3300/0 conn(0x7f4fcc098290 0x7f4fcc098670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-22T08:35:58.976 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:35:58.974+0000 7f4fcaffd640 1 --2- 172.21.15.31:0/315208239 >> v2:172.21.15.31:3300/0 conn(0x7f4fcc098290 0x7f4fcc098670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-22T08:35:58.980 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:35:58.978+0000 7f4fc9ffb640 1 -- 172.21.15.31:0/315208239 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 662972484 0 0) 0x7f4fcc099610 con 0x7f4fcc098bb0 2024-09-22T08:35:58.980 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:35:58.978+0000 7f4fc9ffb640 1 -- 172.21.15.31:0/315208239 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4fb4003520 con 0x7f4fcc098bb0 2024-09-22T08:35:58.980 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:35:58.978+0000 7f4fc9ffb640 1 -- 172.21.15.31:0/315208239 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 639863981 0 0) 0x7f4fb4003520 con 0x7f4fcc098bb0 2024-09-22T08:35:58.980 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:35:58.978+0000 7f4fc9ffb640 1 -- 172.21.15.31:0/315208239 >> v2:172.21.15.31:3300/0 conn(0x7f4fcc098290 msgr2=0x7f4fcc098670 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-22T08:35:58.980 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:35:58.978+0000 7f4fc9ffb640 1 --2- 172.21.15.31:0/315208239 >> v2:172.21.15.31:3300/0 conn(0x7f4fcc098290 0x7f4fcc098670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:35:58.980 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:35:58.978+0000 7f4fc9ffb640 1 -- 172.21.15.31:0/315208239 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fcc096e30 con 0x7f4fcc098bb0 2024-09-22T08:35:58.980 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:35:58.978+0000 7f4fc9ffb640 1 -- 172.21.15.31:0/315208239 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 ==== 205+0+0 (unknown 3935057234 0 0) 0x7f4fc0001620 con 0x7f4fcc098bb0 2024-09-22T08:35:58.980 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:35:58.978+0000 7f4fc9ffb640 1 -- 172.21.15.31:0/315208239 >> v1:172.21.15.31:6789/0 conn(0x7f4fcc098bb0 legacy=0x7f4fcc131e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:35:58.980 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:35:58.978+0000 7f4fc9ffb640 1 --2- 172.21.15.31:0/315208239 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4fb4003a50 0x7f4fb4003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:35:58.980 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:35:58.978+0000 7f4fc9ffb640 1 -- 172.21.15.31:0/315208239 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f4fcc09d1f0 con 0x7f4fb4003a50 2024-09-22T08:35:58.980 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:35:58.978+0000 7f4fcaffd640 1 --2- 172.21.15.31:0/315208239 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4fb4003a50 0x7f4fb4003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:35:58.980 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:35:58.978+0000 7f4fcaffd640 1 -- 172.21.15.31:0/315208239 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fb4003520 con 0x7f4fb4003a50 2024-09-22T08:35:58.982 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:35:58.981+0000 7f4fcaffd640 1 --2- 172.21.15.31:0/315208239 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4fb4003a50 0x7f4fb4003e50 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f4fbc009810 tx=0x7f4fb4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3808f7f0c9a2c9d server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:35:58.982 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:35:58.981+0000 7f4fc9ffb640 1 -- 172.21.15.31:0/315208239 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4fbc037070 con 0x7f4fb4003a50 2024-09-22T08:35:58.982 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:35:58.981+0000 7f4fc9ffb640 1 -- 172.21.15.31:0/315208239 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4fbc02add0 con 0x7f4fb4003a50 2024-09-22T08:35:58.982 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:35:58.981+0000 7f4fc9ffb640 1 -- 172.21.15.31:0/315208239 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4fbc00f040 con 0x7f4fb4003a50 2024-09-22T08:35:58.983 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:35:58.981+0000 7f4fd182a640 1 -- 172.21.15.31:0/315208239 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4fb4003a50 msgr2=0x7f4fb4003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:35:58.983 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:35:58.981+0000 7f4fd182a640 1 --2- 172.21.15.31:0/315208239 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4fb4003a50 0x7f4fb4003e50 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f4fbc009810 tx=0x7f4fb4005830 comp rx=0 tx=0).stop 2024-09-22T08:35:58.983 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:35:58.981+0000 7f4fd182a640 1 -- 172.21.15.31:0/315208239 shutdown_connections 2024-09-22T08:35:58.983 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:35:58.981+0000 7f4fd182a640 1 --2- 172.21.15.31:0/315208239 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4fb4003a50 0x7f4fb4003e50 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:35:58.983 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:35:58.981+0000 7f4fd182a640 1 --2- 172.21.15.31:0/315208239 >> v2:172.21.15.31:3300/0 conn(0x7f4fcc098290 0x7f4fcc098670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:35:58.983 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:35:58.981+0000 7f4fd182a640 1 -- 172.21.15.31:0/315208239 >> 172.21.15.31:0/315208239 conn(0x7f4fcc0a0340 msgr2=0x7f4fcc09c810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:35:58.983 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:35:58.982+0000 7f4fd182a640 1 -- 172.21.15.31:0/315208239 shutdown_connections 2024-09-22T08:35:58.983 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:35:58.982+0000 7f4fd182a640 1 -- 172.21.15.31:0/315208239 wait complete. 2024-09-22T08:35:58.985 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:35:58.982+0000 7f4fd182a640 1 Processor -- start 2024-09-22T08:35:58.985 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:35:58.983+0000 7f4fd182a640 1 -- start start 2024-09-22T08:35:58.985 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:35:58.983+0000 7f4fd182a640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4fb4003a50 0x7f4fcc06e450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:35:58.985 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:35:58.983+0000 7f4fd182a640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f4fcc133720 con 0x7f4fb4003a50 2024-09-22T08:35:58.985 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:35:58.983+0000 7f4fcaffd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4fb4003a50 0x7f4fcc06e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:35:58.986 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:35:58.983+0000 7f4fcaffd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4fb4003a50 0x7f4fcc06e450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:37838/0 (socket says 172.21.15.31:37838) 2024-09-22T08:35:58.986 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:35:58.983+0000 7f4fcaffd640 1 -- 172.21.15.31:0/3075348674 learned_addr learned my addr 172.21.15.31:0/3075348674 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-22T08:35:58.986 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:35:58.983+0000 7f4fcaffd640 1 -- 172.21.15.31:0/3075348674 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fcc0701c0 con 0x7f4fb4003a50 2024-09-22T08:35:58.986 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:35:58.983+0000 7f4fcaffd640 1 --2- 172.21.15.31:0/3075348674 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4fb4003a50 0x7f4fcc06e450 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f4fbc000c00 tx=0x7f4fbc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:35:58.986 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:35:58.984+0000 7f4fb3fff640 1 -- 172.21.15.31:0/3075348674 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4fbc037040 con 0x7f4fb4003a50 2024-09-22T08:35:58.986 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:35:58.984+0000 7f4fb3fff640 1 -- 172.21.15.31:0/3075348674 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4fbc00f000 con 0x7f4fb4003a50 2024-09-22T08:35:58.986 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:35:58.984+0000 7f4fd182a640 1 -- 172.21.15.31:0/3075348674 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4fcc0938d0 con 0x7f4fb4003a50 2024-09-22T08:35:58.986 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:35:58.984+0000 7f4fb3fff640 1 -- 172.21.15.31:0/3075348674 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4fbc03e590 con 0x7f4fb4003a50 2024-09-22T08:35:58.986 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:35:58.984+0000 7f4fd182a640 1 -- 172.21.15.31:0/3075348674 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4fcc06e990 con 0x7f4fb4003a50 2024-09-22T08:35:58.986 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:35:58.984+0000 7f4fb3fff640 1 -- 172.21.15.31:0/3075348674 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f4fbc045020 con 0x7f4fb4003a50 2024-09-22T08:35:58.986 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:35:58.984+0000 7f4fb3fff640 1 -- 172.21.15.31:0/3075348674 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f4fbc043020 con 0x7f4fb4003a50 2024-09-22T08:35:58.987 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:35:58.985+0000 7f4fd182a640 1 -- 172.21.15.31:0/3075348674 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4fcc06f5d0 con 0x7f4fb4003a50 2024-09-22T08:35:58.988 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:35:58.987+0000 7f4fb3fff640 1 -- 172.21.15.31:0/3075348674 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f4fbc04c020 con 0x7f4fb4003a50 2024-09-22T08:35:59.053 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:35:59.052+0000 7f4fd182a640 1 -- 172.21.15.31:0/3075348674 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f4fcc051e60 con 0x7f4fb4003a50 2024-09-22T08:35:59.054 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:35:59.053+0000 7f4fb3fff640 1 -- 172.21.15.31:0/3075348674 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7f4fbc047410 con 0x7f4fb4003a50 2024-09-22T08:35:59.054 INFO:teuthology.orchestra.run.smithi031.stderr:adjusted tunables profile to default 2024-09-22T08:35:59.055 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:35:59.054+0000 7f4fd182a640 1 -- 172.21.15.31:0/3075348674 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4fb4003a50 msgr2=0x7f4fcc06e450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:35:59.055 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:35:59.054+0000 7f4fd182a640 1 --2- 172.21.15.31:0/3075348674 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4fb4003a50 0x7f4fcc06e450 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f4fbc000c00 tx=0x7f4fbc004730 comp rx=0 tx=0).stop 2024-09-22T08:35:59.056 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:35:59.054+0000 7f4fd182a640 1 -- 172.21.15.31:0/3075348674 shutdown_connections 2024-09-22T08:35:59.056 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:35:59.054+0000 7f4fd182a640 1 --2- 172.21.15.31:0/3075348674 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4fb4003a50 0x7f4fcc06e450 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:35:59.056 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:35:59.054+0000 7f4fd182a640 1 -- 172.21.15.31:0/3075348674 >> 172.21.15.31:0/3075348674 conn(0x7f4fcc0a0340 msgr2=0x7f4fcc08bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:35:59.056 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:35:59.054+0000 7f4fd182a640 1 -- 172.21.15.31:0/3075348674 shutdown_connections 2024-09-22T08:35:59.056 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:35:59.054+0000 7f4fd182a640 1 -- 172.21.15.31:0/3075348674 wait complete. 2024-09-22T08:35:59.065 INFO:tasks.ceph:check_enable_crimson: False 2024-09-22T08:35:59.065 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-22T08:35:59.066 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-22T08:35:59.066 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-22T08:35:59.091 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-09-22T08:35:59.092 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-22T08:35:59.117 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-09-22T08:35:59.117 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-22T08:35:59.182 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-09-22T08:35:59.182 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-22T08:35:59.247 DEBUG:teuthology.orchestra.run.smithi142:> sudo ceph --cluster ceph osd new b564b56d-77a0-4258-b683-62460f71da28 0 2024-09-22T08:35:59.385 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:59.383+0000 7f2b2adad640 1 Processor -- start 2024-09-22T08:35:59.385 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:59.383+0000 7f2b2adad640 1 -- start start 2024-09-22T08:35:59.385 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:59.383+0000 7f2b2adad640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f2b24114960 0x7f2b24114d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:35:59.385 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:59.383+0000 7f2b2adad640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b24115460 con 0x7f2b24110d90 2024-09-22T08:35:59.385 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:59.383+0000 7f2b2adad640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f2b24111930 con 0x7f2b24114960 2024-09-22T08:35:59.385 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:59.383+0000 7f2b28b49640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f2b24114960 0x7f2b24114d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:35:59.385 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:59.383+0000 7f2b23fff640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f2b24110d90 0x7f2b24111220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.142:56528/0 (socket says 172.21.15.142:56528) 2024-09-22T08:35:59.385 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:59.383+0000 7f2b23fff640 1 -- 172.21.15.142:0/241996828 learned_addr learned my addr 172.21.15.142:0/241996828 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-09-22T08:35:59.385 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:59.384+0000 7f2b28b49640 1 -- 172.21.15.142:0/241996828 >> v1:172.21.15.31:6789/0 conn(0x7f2b24110d90 legacy=0x7f2b24111220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:35:59.386 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:59.384+0000 7f2b28b49640 1 -- 172.21.15.142:0/241996828 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b24111ae0 con 0x7f2b24114960 2024-09-22T08:35:59.388 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:59.385+0000 7f2b28b49640 1 --2- 172.21.15.142:0/241996828 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2b24114960 0x7f2b24114d40 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f2b18009720 tx=0x7f2b1802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=119da6b8c3e33033 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:35:59.388 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:59.385+0000 7f2b237fe640 1 -- 172.21.15.142:0/241996828 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b18037070 con 0x7f2b24114960 2024-09-22T08:35:59.388 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:59.385+0000 7f2b237fe640 1 -- 172.21.15.142:0/241996828 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b1802ad90 con 0x7f2b24114960 2024-09-22T08:35:59.388 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:59.385+0000 7f2b237fe640 1 -- 172.21.15.142:0/241996828 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b18032590 con 0x7f2b24114960 2024-09-22T08:35:59.388 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:59.385+0000 7f2b2adad640 1 -- 172.21.15.142:0/241996828 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2b24114960 msgr2=0x7f2b24114d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:35:59.388 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:59.385+0000 7f2b2adad640 1 --2- 172.21.15.142:0/241996828 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2b24114960 0x7f2b24114d40 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f2b18009720 tx=0x7f2b1802a110 comp rx=0 tx=0).stop 2024-09-22T08:35:59.388 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:59.385+0000 7f2b2adad640 1 -- 172.21.15.142:0/241996828 shutdown_connections 2024-09-22T08:35:59.388 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:59.385+0000 7f2b2adad640 1 --2- 172.21.15.142:0/241996828 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2b24114960 0x7f2b24114d40 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:35:59.388 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:59.385+0000 7f2b2adad640 1 -- 172.21.15.142:0/241996828 >> 172.21.15.142:0/241996828 conn(0x7f2b240721c0 msgr2=0x7f2b240745e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:35:59.388 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:59.385+0000 7f2b2adad640 1 -- 172.21.15.142:0/241996828 shutdown_connections 2024-09-22T08:35:59.388 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:59.385+0000 7f2b2adad640 1 -- 172.21.15.142:0/241996828 wait complete. 2024-09-22T08:35:59.388 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:59.386+0000 7f2b2adad640 1 Processor -- start 2024-09-22T08:35:59.388 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:59.386+0000 7f2b2adad640 1 -- start start 2024-09-22T08:35:59.389 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:59.386+0000 7f2b2adad640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2b24110d90 0x7f2b241a5820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:35:59.389 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:59.386+0000 7f2b2adad640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f2b2411cd50 con 0x7f2b24110d90 2024-09-22T08:35:59.389 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:59.387+0000 7f2b28b49640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2b24110d90 0x7f2b241a5820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:35:59.389 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:59.387+0000 7f2b28b49640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2b24110d90 0x7f2b241a5820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:40350/0 (socket says 172.21.15.142:40350) 2024-09-22T08:35:59.389 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:59.387+0000 7f2b28b49640 1 -- 172.21.15.142:0/1315637665 learned_addr learned my addr 172.21.15.142:0/1315637665 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:35:59.390 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:59.387+0000 7f2b28b49640 1 -- 172.21.15.142:0/1315637665 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b241a5df0 con 0x7f2b24110d90 2024-09-22T08:35:59.391 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:59.387+0000 7f2b28b49640 1 --2- 172.21.15.142:0/1315637665 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2b24110d90 0x7f2b241a5820 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f2b18009720 tx=0x7f2b180046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:35:59.391 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:59.387+0000 7f2b217fa640 1 -- 172.21.15.142:0/1315637665 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b18041070 con 0x7f2b24110d90 2024-09-22T08:35:59.391 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:59.388+0000 7f2b217fa640 1 -- 172.21.15.142:0/1315637665 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b1803c460 con 0x7f2b24110d90 2024-09-22T08:35:59.391 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:59.388+0000 7f2b217fa640 1 -- 172.21.15.142:0/1315637665 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b18037040 con 0x7f2b24110d90 2024-09-22T08:35:59.391 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:59.388+0000 7f2b2adad640 1 -- 172.21.15.142:0/1315637665 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b241a6080 con 0x7f2b24110d90 2024-09-22T08:35:59.391 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:59.388+0000 7f2b2adad640 1 -- 172.21.15.142:0/1315637665 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b241ab050 con 0x7f2b24110d90 2024-09-22T08:35:59.391 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:59.388+0000 7f2b217fa640 1 -- 172.21.15.142:0/1315637665 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f2b18044070 con 0x7f2b24110d90 2024-09-22T08:35:59.391 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:59.388+0000 7f2b217fa640 1 -- 172.21.15.142:0/1315637665 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7f2b18046c80 con 0x7f2b24110d90 2024-09-22T08:35:59.392 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:59.388+0000 7f2b2adad640 1 -- 172.21.15.142:0/1315637665 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b24114dc0 con 0x7f2b24110d90 2024-09-22T08:35:59.392 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:59.391+0000 7f2b217fa640 1 -- 172.21.15.142:0/1315637665 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f2b18046450 con 0x7f2b24110d90 2024-09-22T08:35:59.460 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:59.459+0000 7f2b2adad640 1 -- 172.21.15.142:0/1315637665 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd new", "uuid": "b564b56d-77a0-4258-b683-62460f71da28", "id": 0} v 0) -- 0x7f2b240769e0 con 0x7f2b24110d90 2024-09-22T08:35:59.462 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:59.461+0000 7f2b217fa640 1 -- 172.21.15.142:0/1315637665 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b564b56d-77a0-4258-b683-62460f71da28", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7f2b1803c950 con 0x7f2b24110d90 2024-09-22T08:35:59.462 INFO:teuthology.orchestra.run.smithi142.stdout:0 2024-09-22T08:35:59.464 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:59.462+0000 7f2b2adad640 1 -- 172.21.15.142:0/1315637665 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2b24110d90 msgr2=0x7f2b241a5820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:35:59.464 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:59.462+0000 7f2b2adad640 1 --2- 172.21.15.142:0/1315637665 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2b24110d90 0x7f2b241a5820 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f2b18009720 tx=0x7f2b180046c0 comp rx=0 tx=0).stop 2024-09-22T08:35:59.464 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:59.462+0000 7f2b2adad640 1 -- 172.21.15.142:0/1315637665 shutdown_connections 2024-09-22T08:35:59.464 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:59.462+0000 7f2b2adad640 1 --2- 172.21.15.142:0/1315637665 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2b24110d90 0x7f2b241a5820 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:35:59.464 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:59.462+0000 7f2b2adad640 1 -- 172.21.15.142:0/1315637665 >> 172.21.15.142:0/1315637665 conn(0x7f2b240721c0 msgr2=0x7f2b24115800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:35:59.464 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:59.462+0000 7f2b2adad640 1 -- 172.21.15.142:0/1315637665 shutdown_connections 2024-09-22T08:35:59.464 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:59.462+0000 7f2b2adad640 1 -- 172.21.15.142:0/1315637665 wait complete. 2024-09-22T08:35:59.473 DEBUG:teuthology.orchestra.run.smithi142:> sudo ceph --cluster ceph osd new 8f501a52-02aa-4ddf-ae21-83fc468e2e35 1 2024-09-22T08:35:59.571 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:59.570+0000 7f8efc8ed640 1 Processor -- start 2024-09-22T08:35:59.572 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:59.570+0000 7f8efc8ed640 1 -- start start 2024-09-22T08:35:59.572 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:59.570+0000 7f8efc8ed640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f8ef811bb70 0x7f8ef811df60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:35:59.572 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:59.570+0000 7f8efc8ed640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ef811e530 con 0x7f8ef8116bf0 2024-09-22T08:35:59.572 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:59.570+0000 7f8efc8ed640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f8ef811f710 con 0x7f8ef811bb70 2024-09-22T08:35:59.573 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:59.571+0000 7f8eeffff640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f8ef811bb70 0x7f8ef811df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:35:59.573 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:59.571+0000 7f8eeffff640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f8ef811bb70 0x7f8ef811df60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:40352/0 (socket says 172.21.15.142:40352) 2024-09-22T08:35:59.573 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:59.571+0000 7f8eeffff640 1 -- 172.21.15.142:0/1696747196 learned_addr learned my addr 172.21.15.142:0/1696747196 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:35:59.573 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:59.571+0000 7f8eeffff640 1 -- 172.21.15.142:0/1696747196 >> v1:172.21.15.31:6789/0 conn(0x7f8ef8116bf0 legacy=0x7f8ef8116fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:35:59.573 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:59.571+0000 7f8eeffff640 1 -- 172.21.15.142:0/1696747196 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ef811f890 con 0x7f8ef811bb70 2024-09-22T08:35:59.573 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:59.572+0000 7f8eeffff640 1 --2- 172.21.15.142:0/1696747196 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8ef811bb70 0x7f8ef811df60 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f8ee00097f0 tx=0x7f8ee002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9037f1de512775a server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:35:59.573 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:59.572+0000 7f8ef5d9b640 1 -- 172.21.15.142:0/1696747196 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ee0037070 con 0x7f8ef811bb70 2024-09-22T08:35:59.574 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:59.572+0000 7f8ef5d9b640 1 -- 172.21.15.142:0/1696747196 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ee0032440 con 0x7f8ef811bb70 2024-09-22T08:35:59.574 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:59.572+0000 7f8ef5d9b640 1 -- 172.21.15.142:0/1696747196 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ee002ae60 con 0x7f8ef811bb70 2024-09-22T08:35:59.575 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:59.572+0000 7f8efc8ed640 1 -- 172.21.15.142:0/1696747196 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8ef811bb70 msgr2=0x7f8ef811df60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:35:59.575 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:59.573+0000 7f8efc8ed640 1 --2- 172.21.15.142:0/1696747196 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8ef811bb70 0x7f8ef811df60 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f8ee00097f0 tx=0x7f8ee002a1e0 comp rx=0 tx=0).stop 2024-09-22T08:35:59.575 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:59.573+0000 7f8efc8ed640 1 -- 172.21.15.142:0/1696747196 shutdown_connections 2024-09-22T08:35:59.575 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:59.573+0000 7f8efc8ed640 1 --2- 172.21.15.142:0/1696747196 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8ef811bb70 0x7f8ef811df60 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:35:59.575 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:59.573+0000 7f8efc8ed640 1 -- 172.21.15.142:0/1696747196 >> 172.21.15.142:0/1696747196 conn(0x7f8ef806f820 msgr2=0x7f8ef806fc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:35:59.575 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:59.573+0000 7f8efc8ed640 1 -- 172.21.15.142:0/1696747196 shutdown_connections 2024-09-22T08:35:59.575 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:59.573+0000 7f8efc8ed640 1 -- 172.21.15.142:0/1696747196 wait complete. 2024-09-22T08:35:59.575 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:59.573+0000 7f8efc8ed640 1 Processor -- start 2024-09-22T08:35:59.576 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:59.573+0000 7f8efc8ed640 1 -- start start 2024-09-22T08:35:59.576 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:59.574+0000 7f8efc8ed640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8ef8116bf0 0x7f8ef81a7a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:35:59.576 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:59.574+0000 7f8efc8ed640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f8ef811ebe0 con 0x7f8ef8116bf0 2024-09-22T08:35:59.576 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:59.574+0000 7f8ef659c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8ef8116bf0 0x7f8ef81a7a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:35:59.576 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:59.574+0000 7f8ef659c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8ef8116bf0 0x7f8ef81a7a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:40366/0 (socket says 172.21.15.142:40366) 2024-09-22T08:35:59.576 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:59.574+0000 7f8ef659c640 1 -- 172.21.15.142:0/822527822 learned_addr learned my addr 172.21.15.142:0/822527822 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:35:59.576 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:59.574+0000 7f8ef659c640 1 -- 172.21.15.142:0/822527822 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ef81a7fd0 con 0x7f8ef8116bf0 2024-09-22T08:35:59.577 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:59.574+0000 7f8ef659c640 1 --2- 172.21.15.142:0/822527822 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8ef8116bf0 0x7f8ef81a7a00 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f8ee800c480 tx=0x7f8ee800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:35:59.577 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:59.574+0000 7f8eeeffd640 1 -- 172.21.15.142:0/822527822 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ee8017070 con 0x7f8ef8116bf0 2024-09-22T08:35:59.577 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:59.574+0000 7f8eeeffd640 1 -- 172.21.15.142:0/822527822 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ee8005200 con 0x7f8ef8116bf0 2024-09-22T08:35:59.577 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:59.574+0000 7f8efc8ed640 1 -- 172.21.15.142:0/822527822 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ef81a82c0 con 0x7f8ef8116bf0 2024-09-22T08:35:59.577 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:59.574+0000 7f8eeeffd640 1 -- 172.21.15.142:0/822527822 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ee80035f0 con 0x7f8ef8116bf0 2024-09-22T08:35:59.577 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:59.575+0000 7f8efc8ed640 1 -- 172.21.15.142:0/822527822 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ef81ad490 con 0x7f8ef8116bf0 2024-09-22T08:35:59.577 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:59.575+0000 7f8eeeffd640 1 -- 172.21.15.142:0/822527822 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f8ee801a070 con 0x7f8ef8116bf0 2024-09-22T08:35:59.578 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:59.575+0000 7f8eeeffd640 1 -- 172.21.15.142:0/822527822 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7f8ee8011bb0 con 0x7f8ef8116bf0 2024-09-22T08:35:59.578 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:59.575+0000 7f8efc8ed640 1 -- 172.21.15.142:0/822527822 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ef81a8600 con 0x7f8ef8116bf0 2024-09-22T08:35:59.579 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:59.578+0000 7f8eeeffd640 1 -- 172.21.15.142:0/822527822 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f8ee8021070 con 0x7f8ef8116bf0 2024-09-22T08:35:59.647 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:59.646+0000 7f8efc8ed640 1 -- 172.21.15.142:0/822527822 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd new", "uuid": "8f501a52-02aa-4ddf-ae21-83fc468e2e35", "id": 1} v 0) -- 0x7f8ef811f1c0 con 0x7f8ef8116bf0 2024-09-22T08:35:59.648 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:59.647+0000 7f8eeeffd640 1 -- 172.21.15.142:0/822527822 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8f501a52-02aa-4ddf-ae21-83fc468e2e35", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7f8ee8011590 con 0x7f8ef8116bf0 2024-09-22T08:35:59.648 INFO:teuthology.orchestra.run.smithi142.stdout:1 2024-09-22T08:35:59.649 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:59.648+0000 7f8efc8ed640 1 -- 172.21.15.142:0/822527822 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8ef8116bf0 msgr2=0x7f8ef81a7a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:35:59.650 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:59.648+0000 7f8efc8ed640 1 --2- 172.21.15.142:0/822527822 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8ef8116bf0 0x7f8ef81a7a00 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f8ee800c480 tx=0x7f8ee800c940 comp rx=0 tx=0).stop 2024-09-22T08:35:59.650 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:59.648+0000 7f8efc8ed640 1 -- 172.21.15.142:0/822527822 shutdown_connections 2024-09-22T08:35:59.650 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:59.648+0000 7f8efc8ed640 1 --2- 172.21.15.142:0/822527822 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8ef8116bf0 0x7f8ef81a7a00 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:35:59.650 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:59.648+0000 7f8efc8ed640 1 -- 172.21.15.142:0/822527822 >> 172.21.15.142:0/822527822 conn(0x7f8ef806f820 msgr2=0x7f8ef811bf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:35:59.650 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:59.648+0000 7f8efc8ed640 1 -- 172.21.15.142:0/822527822 shutdown_connections 2024-09-22T08:35:59.650 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:59.648+0000 7f8efc8ed640 1 -- 172.21.15.142:0/822527822 wait complete. 2024-09-22T08:35:59.660 DEBUG:teuthology.orchestra.run.smithi142:> sudo ceph --cluster ceph osd new 3dad5d00-e406-4917-9476-7f79fdf2e276 2 2024-09-22T08:35:59.758 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:59.756+0000 7f14ff616640 1 Processor -- start 2024-09-22T08:35:59.758 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:59.756+0000 7f14ff616640 1 -- start start 2024-09-22T08:35:59.758 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:59.757+0000 7f14ff616640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f14f81199d0 0x7f14f811bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:35:59.758 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:59.757+0000 7f14ff616640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14f811c300 con 0x7f14f8111060 2024-09-22T08:35:59.758 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:59.757+0000 7f14ff616640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f14f811d500 con 0x7f14f81199d0 2024-09-22T08:35:59.759 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:59.757+0000 7f14fcbb1640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f14f81199d0 0x7f14f811bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:35:59.759 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:59.757+0000 7f14fcbb1640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f14f81199d0 0x7f14f811bdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:40382/0 (socket says 172.21.15.142:40382) 2024-09-22T08:35:59.759 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:59.757+0000 7f14fcbb1640 1 -- 172.21.15.142:0/3495881126 learned_addr learned my addr 172.21.15.142:0/3495881126 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:35:59.759 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:59.757+0000 7f14fcbb1640 1 -- 172.21.15.142:0/3495881126 >> v1:172.21.15.31:6789/0 conn(0x7f14f8111060 legacy=0x7f14f8111440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:35:59.759 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:59.757+0000 7f14fcbb1640 1 -- 172.21.15.142:0/3495881126 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14f811d6b0 con 0x7f14f81199d0 2024-09-22T08:35:59.759 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:59.758+0000 7f14fcbb1640 1 --2- 172.21.15.142:0/3495881126 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f14f81199d0 0x7f14f811bdc0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f14f40097f0 tx=0x7f14f402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9b357ddb3d4008 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:35:59.761 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:59.758+0000 7f14ebfff640 1 -- 172.21.15.142:0/3495881126 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f14f4037070 con 0x7f14f81199d0 2024-09-22T08:35:59.761 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:59.758+0000 7f14ebfff640 1 -- 172.21.15.142:0/3495881126 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14f4032440 con 0x7f14f81199d0 2024-09-22T08:35:59.761 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:59.758+0000 7f14ebfff640 1 -- 172.21.15.142:0/3495881126 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f14f402ae60 con 0x7f14f81199d0 2024-09-22T08:35:59.761 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:59.759+0000 7f14ff616640 1 -- 172.21.15.142:0/3495881126 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f14f81199d0 msgr2=0x7f14f811bdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:35:59.761 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:59.759+0000 7f14ff616640 1 --2- 172.21.15.142:0/3495881126 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f14f81199d0 0x7f14f811bdc0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f14f40097f0 tx=0x7f14f402a1e0 comp rx=0 tx=0).stop 2024-09-22T08:35:59.761 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:59.759+0000 7f14ff616640 1 -- 172.21.15.142:0/3495881126 shutdown_connections 2024-09-22T08:35:59.761 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:59.759+0000 7f14ff616640 1 --2- 172.21.15.142:0/3495881126 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f14f81199d0 0x7f14f811bdc0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:35:59.761 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:59.759+0000 7f14ff616640 1 -- 172.21.15.142:0/3495881126 >> 172.21.15.142:0/3495881126 conn(0x7f14f8072200 msgr2=0x7f14f8074620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:35:59.761 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:59.759+0000 7f14ff616640 1 -- 172.21.15.142:0/3495881126 shutdown_connections 2024-09-22T08:35:59.761 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:59.759+0000 7f14ff616640 1 -- 172.21.15.142:0/3495881126 wait complete. 2024-09-22T08:35:59.762 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:59.760+0000 7f14ff616640 1 Processor -- start 2024-09-22T08:35:59.762 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:59.760+0000 7f14ff616640 1 -- start start 2024-09-22T08:35:59.762 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:59.760+0000 7f14ff616640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f14f8111060 0x7f14f81a57a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:35:59.762 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:59.760+0000 7f14ff616640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f14f811c9b0 con 0x7f14f8111060 2024-09-22T08:35:59.763 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:59.760+0000 7f14fd3b2640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f14f8111060 0x7f14f81a57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:35:59.763 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:59.760+0000 7f14fd3b2640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f14f8111060 0x7f14f81a57a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:40392/0 (socket says 172.21.15.142:40392) 2024-09-22T08:35:59.763 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:59.760+0000 7f14fd3b2640 1 -- 172.21.15.142:0/3172006007 learned_addr learned my addr 172.21.15.142:0/3172006007 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:35:59.763 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:59.760+0000 7f14fd3b2640 1 -- 172.21.15.142:0/3172006007 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14f81a5d70 con 0x7f14f8111060 2024-09-22T08:35:59.764 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:59.761+0000 7f14fd3b2640 1 --2- 172.21.15.142:0/3172006007 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f14f8111060 0x7f14f81a57a0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f14ec00c3d0 tx=0x7f14ec00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:35:59.764 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:59.761+0000 7f14e9ffb640 1 -- 172.21.15.142:0/3172006007 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f14ec017070 con 0x7f14f8111060 2024-09-22T08:35:59.764 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:59.761+0000 7f14e9ffb640 1 -- 172.21.15.142:0/3172006007 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14ec005240 con 0x7f14f8111060 2024-09-22T08:35:59.764 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:59.761+0000 7f14e9ffb640 1 -- 172.21.15.142:0/3172006007 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f14ec0035f0 con 0x7f14f8111060 2024-09-22T08:35:59.764 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:59.761+0000 7f14ff616640 1 -- 172.21.15.142:0/3172006007 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14f81a6060 con 0x7f14f8111060 2024-09-22T08:35:59.764 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:59.761+0000 7f14e9ffb640 1 -- 172.21.15.142:0/3172006007 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f14ec01a070 con 0x7f14f8111060 2024-09-22T08:35:59.764 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:59.761+0000 7f14ff616640 1 -- 172.21.15.142:0/3172006007 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14f81ab230 con 0x7f14f8111060 2024-09-22T08:35:59.764 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:59.761+0000 7f14e9ffb640 1 -- 172.21.15.142:0/3172006007 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7f14ec011590 con 0x7f14f8111060 2024-09-22T08:35:59.764 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:59.762+0000 7f14ff616640 1 -- 172.21.15.142:0/3172006007 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14f811cf40 con 0x7f14f8111060 2024-09-22T08:35:59.765 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:59.764+0000 7f14e9ffb640 1 -- 172.21.15.142:0/3172006007 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f14ec022020 con 0x7f14f8111060 2024-09-22T08:35:59.836 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:59.835+0000 7f14ff616640 1 -- 172.21.15.142:0/3172006007 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd new", "uuid": "3dad5d00-e406-4917-9476-7f79fdf2e276", "id": 2} v 0) -- 0x7f14f80769e0 con 0x7f14f8111060 2024-09-22T08:35:59.837 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:59.836+0000 7f14e9ffb640 1 -- 172.21.15.142:0/3172006007 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "3dad5d00-e406-4917-9476-7f79fdf2e276", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7f14ec011bc0 con 0x7f14f8111060 2024-09-22T08:35:59.837 INFO:teuthology.orchestra.run.smithi142.stdout:2 2024-09-22T08:35:59.838 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:59.837+0000 7f14ff616640 1 -- 172.21.15.142:0/3172006007 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f14f8111060 msgr2=0x7f14f81a57a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:35:59.839 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:59.837+0000 7f14ff616640 1 --2- 172.21.15.142:0/3172006007 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f14f8111060 0x7f14f81a57a0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f14ec00c3d0 tx=0x7f14ec00c890 comp rx=0 tx=0).stop 2024-09-22T08:35:59.839 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:59.837+0000 7f14ff616640 1 -- 172.21.15.142:0/3172006007 shutdown_connections 2024-09-22T08:35:59.839 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:59.837+0000 7f14ff616640 1 --2- 172.21.15.142:0/3172006007 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f14f8111060 0x7f14f81a57a0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:35:59.839 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:59.837+0000 7f14ff616640 1 -- 172.21.15.142:0/3172006007 >> 172.21.15.142:0/3172006007 conn(0x7f14f8072200 msgr2=0x7f14f8115e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:35:59.839 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:59.837+0000 7f14ff616640 1 -- 172.21.15.142:0/3172006007 shutdown_connections 2024-09-22T08:35:59.839 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:59.837+0000 7f14ff616640 1 -- 172.21.15.142:0/3172006007 wait complete. 2024-09-22T08:35:59.848 DEBUG:teuthology.orchestra.run.smithi142:> sudo ceph --cluster ceph osd new 3eea2de4-b487-4110-b798-495fa09ef2d1 3 2024-09-22T08:35:59.949 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:59.944+0000 7fba6225a640 1 Processor -- start 2024-09-22T08:35:59.949 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:59.944+0000 7fba6225a640 1 -- start start 2024-09-22T08:35:59.949 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:59.945+0000 7fba6225a640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fba5c116bf0 0x7fba5c116fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:35:59.949 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:59.945+0000 7fba6225a640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba5c1176f0 con 0x7fba5c112da0 2024-09-22T08:35:59.949 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:59.945+0000 7fba6225a640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7fba5c113940 con 0x7fba5c116bf0 2024-09-22T08:35:59.949 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:59.945+0000 7fba5b7fe640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fba5c116bf0 0x7fba5c116fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:35:59.949 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:59.945+0000 7fba5b7fe640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fba5c116bf0 0x7fba5c116fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:40406/0 (socket says 172.21.15.142:40406) 2024-09-22T08:35:59.950 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:59.945+0000 7fba5b7fe640 1 -- 172.21.15.142:0/4190074914 learned_addr learned my addr 172.21.15.142:0/4190074914 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:35:59.950 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:59.945+0000 7fba5b7fe640 1 -- 172.21.15.142:0/4190074914 >> v1:172.21.15.31:6789/0 conn(0x7fba5c112da0 legacy=0x7fba5c113230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:35:59.950 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:59.945+0000 7fba5b7fe640 1 -- 172.21.15.142:0/4190074914 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba5c113af0 con 0x7fba5c116bf0 2024-09-22T08:35:59.950 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:59.946+0000 7fba5b7fe640 1 --2- 172.21.15.142:0/4190074914 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fba5c116bf0 0x7fba5c116fd0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fba4c0097f0 tx=0x7fba4c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b43e93a91fa8efed server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:35:59.950 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:59.946+0000 7fba5affd640 1 -- 172.21.15.142:0/4190074914 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fba4c037070 con 0x7fba5c116bf0 2024-09-22T08:35:59.950 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:59.946+0000 7fba5affd640 1 -- 172.21.15.142:0/4190074914 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba4c032440 con 0x7fba5c116bf0 2024-09-22T08:35:59.950 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:59.946+0000 7fba5affd640 1 -- 172.21.15.142:0/4190074914 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fba4c02ae60 con 0x7fba5c116bf0 2024-09-22T08:35:59.950 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:59.947+0000 7fba6225a640 1 -- 172.21.15.142:0/4190074914 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fba5c116bf0 msgr2=0x7fba5c116fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:35:59.950 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:59.947+0000 7fba6225a640 1 --2- 172.21.15.142:0/4190074914 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fba5c116bf0 0x7fba5c116fd0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fba4c0097f0 tx=0x7fba4c02a1e0 comp rx=0 tx=0).stop 2024-09-22T08:35:59.950 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:59.947+0000 7fba6225a640 1 -- 172.21.15.142:0/4190074914 shutdown_connections 2024-09-22T08:35:59.950 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:59.947+0000 7fba6225a640 1 --2- 172.21.15.142:0/4190074914 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fba5c116bf0 0x7fba5c116fd0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:35:59.950 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:59.947+0000 7fba6225a640 1 -- 172.21.15.142:0/4190074914 >> 172.21.15.142:0/4190074914 conn(0x7fba5c06f820 msgr2=0x7fba5c06fc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:35:59.950 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:59.947+0000 7fba6225a640 1 -- 172.21.15.142:0/4190074914 shutdown_connections 2024-09-22T08:35:59.950 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:59.947+0000 7fba6225a640 1 -- 172.21.15.142:0/4190074914 wait complete. 2024-09-22T08:35:59.951 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:59.948+0000 7fba6225a640 1 Processor -- start 2024-09-22T08:35:59.951 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:59.948+0000 7fba6225a640 1 -- start start 2024-09-22T08:35:59.951 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:59.948+0000 7fba6225a640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fba5c112da0 0x7fba5c1a79f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:35:59.951 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:59.948+0000 7fba6225a640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fba5c11f040 con 0x7fba5c112da0 2024-09-22T08:35:59.952 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:59.948+0000 7fba5b7fe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fba5c112da0 0x7fba5c1a79f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:35:59.952 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:59.948+0000 7fba5b7fe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fba5c112da0 0x7fba5c1a79f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:40416/0 (socket says 172.21.15.142:40416) 2024-09-22T08:35:59.952 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:59.948+0000 7fba5b7fe640 1 -- 172.21.15.142:0/2416045569 learned_addr learned my addr 172.21.15.142:0/2416045569 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:35:59.953 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:59.949+0000 7fba5b7fe640 1 -- 172.21.15.142:0/2416045569 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba5c1a7fc0 con 0x7fba5c112da0 2024-09-22T08:35:59.953 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:59.949+0000 7fba5b7fe640 1 --2- 172.21.15.142:0/2416045569 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fba5c112da0 0x7fba5c1a79f0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fba4c035040 tx=0x7fba4c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:35:59.953 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:59.949+0000 7fba58ff9640 1 -- 172.21.15.142:0/2416045569 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fba4c041070 con 0x7fba5c112da0 2024-09-22T08:35:59.953 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:59.949+0000 7fba58ff9640 1 -- 172.21.15.142:0/2416045569 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba4c03c7a0 con 0x7fba5c112da0 2024-09-22T08:35:59.953 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:59.949+0000 7fba6225a640 1 -- 172.21.15.142:0/2416045569 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba5c1a8250 con 0x7fba5c112da0 2024-09-22T08:35:59.953 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:59.949+0000 7fba58ff9640 1 -- 172.21.15.142:0/2416045569 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fba4c037040 con 0x7fba5c112da0 2024-09-22T08:35:59.953 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:59.949+0000 7fba6225a640 1 -- 172.21.15.142:0/2416045569 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba5c1ad220 con 0x7fba5c112da0 2024-09-22T08:35:59.953 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:59.949+0000 7fba58ff9640 1 -- 172.21.15.142:0/2416045569 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fba4c044070 con 0x7fba5c112da0 2024-09-22T08:35:59.953 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:59.949+0000 7fba58ff9640 1 -- 172.21.15.142:0/2416045569 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7fba4c03d3f0 con 0x7fba5c112da0 2024-09-22T08:35:59.953 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:59.950+0000 7fba6225a640 1 -- 172.21.15.142:0/2416045569 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba5c0769e0 con 0x7fba5c112da0 2024-09-22T08:35:59.954 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:35:59.952+0000 7fba58ff9640 1 -- 172.21.15.142:0/2416045569 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fba4c046450 con 0x7fba5c112da0 2024-09-22T08:36:00.022 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:00.021+0000 7fba6225a640 1 -- 172.21.15.142:0/2416045569 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd new", "uuid": "3eea2de4-b487-4110-b798-495fa09ef2d1", "id": 3} v 0) -- 0x7fba5c116bf0 con 0x7fba5c112da0 2024-09-22T08:36:00.023 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:00.022+0000 7fba58ff9640 1 -- 172.21.15.142:0/2416045569 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "3eea2de4-b487-4110-b798-495fa09ef2d1", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7fba4c046670 con 0x7fba5c112da0 2024-09-22T08:36:00.024 INFO:teuthology.orchestra.run.smithi142.stdout:3 2024-09-22T08:36:00.025 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:00.023+0000 7fba6225a640 1 -- 172.21.15.142:0/2416045569 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fba5c112da0 msgr2=0x7fba5c1a79f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:00.025 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:00.023+0000 7fba6225a640 1 --2- 172.21.15.142:0/2416045569 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fba5c112da0 0x7fba5c1a79f0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fba4c035040 tx=0x7fba4c0046c0 comp rx=0 tx=0).stop 2024-09-22T08:36:00.025 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:00.023+0000 7fba6225a640 1 -- 172.21.15.142:0/2416045569 shutdown_connections 2024-09-22T08:36:00.025 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:00.023+0000 7fba6225a640 1 --2- 172.21.15.142:0/2416045569 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fba5c112da0 0x7fba5c1a79f0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:00.025 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:00.023+0000 7fba6225a640 1 -- 172.21.15.142:0/2416045569 >> 172.21.15.142:0/2416045569 conn(0x7fba5c06f820 msgr2=0x7fba5c111dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:00.025 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:00.023+0000 7fba6225a640 1 -- 172.21.15.142:0/2416045569 shutdown_connections 2024-09-22T08:36:00.025 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:00.024+0000 7fba6225a640 1 -- 172.21.15.142:0/2416045569 wait complete. 2024-09-22T08:36:00.037 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-22T08:36:00.038 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-22T08:36:00.040 INFO:tasks.ceph.osd.0:Started 2024-09-22T08:36:00.041 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-22T08:36:00.041 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-22T08:36:00.043 INFO:tasks.ceph.osd.1:Started 2024-09-22T08:36:00.043 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-22T08:36:00.043 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-22T08:36:00.045 INFO:tasks.ceph.osd.2:Started 2024-09-22T08:36:00.045 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-22T08:36:00.045 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-22T08:36:00.047 INFO:tasks.ceph.osd.3:Started 2024-09-22T08:36:00.047 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-22T08:36:00.162 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:00.160+0000 7f6b12591640 1 Processor -- start 2024-09-22T08:36:00.162 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:00.160+0000 7f6b12591640 1 -- start start 2024-09-22T08:36:00.163 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:00.160+0000 7f6b12591640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f6b0c06fd70 0x7f6b0c131660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:00.163 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:00.160+0000 7f6b12591640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b0c099ee0 con 0x7f6b0c06f280 2024-09-22T08:36:00.163 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:00.160+0000 7f6b12591640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f6b0c070d00 con 0x7f6b0c06fd70 2024-09-22T08:36:00.163 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:00.161+0000 7f6b0b7fe640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f6b0c06fd70 0x7f6b0c131660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:00.163 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:00.161+0000 7f6b0bfff640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f6b0c06f280 0x7f6b0c06f660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:49052/0 (socket says 172.21.15.31:49052) 2024-09-22T08:36:00.163 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:00.161+0000 7f6b0bfff640 1 -- 172.21.15.31:0/2113662068 learned_addr learned my addr 172.21.15.31:0/2113662068 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-22T08:36:00.163 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:00.161+0000 7f6b0b7fe640 1 -- 172.21.15.31:0/2113662068 >> v1:172.21.15.31:6789/0 conn(0x7f6b0c06f280 legacy=0x7f6b0c06f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:00.163 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:00.161+0000 7f6b0b7fe640 1 -- 172.21.15.31:0/2113662068 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b0c070f40 con 0x7f6b0c06fd70 2024-09-22T08:36:00.163 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:00.161+0000 7f6b0affd640 1 -- 172.21.15.31:0/2113662068 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1942928939 0 0) 0x7f6b0c099ee0 con 0x7f6b0c06f280 2024-09-22T08:36:00.165 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:00.162+0000 7f6b0b7fe640 1 --2- 172.21.15.31:0/2113662068 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6b0c06fd70 0x7f6b0c131660 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f6af4009720 tx=0x7f6af402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67ad5652ab48ddf0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:00.165 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:00.162+0000 7f6b0affd640 1 -- 172.21.15.31:0/2113662068 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6af4037070 con 0x7f6b0c06fd70 2024-09-22T08:36:00.165 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:00.162+0000 7f6b0affd640 1 -- 172.21.15.31:0/2113662068 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6af402ad90 con 0x7f6b0c06fd70 2024-09-22T08:36:00.165 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:00.162+0000 7f6b0affd640 1 -- 172.21.15.31:0/2113662068 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6af4032590 con 0x7f6b0c06fd70 2024-09-22T08:36:00.165 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:00.162+0000 7f6b12591640 1 -- 172.21.15.31:0/2113662068 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6b0c06fd70 msgr2=0x7f6b0c131660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:00.165 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:00.162+0000 7f6b12591640 1 --2- 172.21.15.31:0/2113662068 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6b0c06fd70 0x7f6b0c131660 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f6af4009720 tx=0x7f6af402a110 comp rx=0 tx=0).stop 2024-09-22T08:36:00.165 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:00.162+0000 7f6b12591640 1 -- 172.21.15.31:0/2113662068 shutdown_connections 2024-09-22T08:36:00.165 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:00.162+0000 7f6b12591640 1 --2- 172.21.15.31:0/2113662068 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6b0c06fd70 0x7f6b0c131660 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:00.165 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:00.162+0000 7f6b12591640 1 -- 172.21.15.31:0/2113662068 >> 172.21.15.31:0/2113662068 conn(0x7f6b0c09ac80 msgr2=0x7f6b0c098550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:00.165 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:00.163+0000 7f6b12591640 1 -- 172.21.15.31:0/2113662068 shutdown_connections 2024-09-22T08:36:00.165 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:00.163+0000 7f6b12591640 1 -- 172.21.15.31:0/2113662068 wait complete. 2024-09-22T08:36:00.165 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:00.163+0000 7f6b12591640 1 Processor -- start 2024-09-22T08:36:00.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:00.164+0000 7f6b12591640 1 -- start start 2024-09-22T08:36:00.167 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:00.164+0000 7f6b12591640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6b0c06f280 0x7f6b0c0976b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:00.167 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:00.164+0000 7f6b12591640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f6b0c131d20 con 0x7f6b0c06f280 2024-09-22T08:36:00.167 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:00.164+0000 7f6b0bfff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6b0c06f280 0x7f6b0c0976b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:00.167 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:00.164+0000 7f6b0bfff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6b0c06f280 0x7f6b0c0976b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:37870/0 (socket says 172.21.15.31:37870) 2024-09-22T08:36:00.167 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:00.164+0000 7f6b0bfff640 1 -- 172.21.15.31:0/1268951722 learned_addr learned my addr 172.21.15.31:0/1268951722 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-22T08:36:00.167 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:00.164+0000 7f6b0bfff640 1 -- 172.21.15.31:0/1268951722 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b0c12ee20 con 0x7f6b0c06f280 2024-09-22T08:36:00.168 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:00.165+0000 7f6b0bfff640 1 --2- 172.21.15.31:0/1268951722 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6b0c06f280 0x7f6b0c0976b0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f6afc00c3d0 tx=0x7f6afc00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:00.168 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:00.165+0000 7f6b08ff9640 1 -- 172.21.15.31:0/1268951722 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6afc0074d0 con 0x7f6b0c06f280 2024-09-22T08:36:00.168 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:00.165+0000 7f6b08ff9640 1 -- 172.21.15.31:0/1268951722 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6afc0047e0 con 0x7f6b0c06f280 2024-09-22T08:36:00.168 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:00.165+0000 7f6b08ff9640 1 -- 172.21.15.31:0/1268951722 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6afc007670 con 0x7f6b0c06f280 2024-09-22T08:36:00.168 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:00.165+0000 7f6b12591640 1 -- 172.21.15.31:0/1268951722 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b0c1260e0 con 0x7f6b0c06f280 2024-09-22T08:36:00.168 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:00.165+0000 7f6b12591640 1 -- 172.21.15.31:0/1268951722 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b0c097dd0 con 0x7f6b0c06f280 2024-09-22T08:36:00.168 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:00.165+0000 7f6b08ff9640 1 -- 172.21.15.31:0/1268951722 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f6afc011070 con 0x7f6b0c06f280 2024-09-22T08:36:00.168 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:00.165+0000 7f6b08ff9640 1 -- 172.21.15.31:0/1268951722 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f6afc0138d0 con 0x7f6b0c06f280 2024-09-22T08:36:00.168 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:00.166+0000 7f6b12591640 1 -- 172.21.15.31:0/1268951722 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b0c06f660 con 0x7f6b0c06f280 2024-09-22T08:36:00.169 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:00.168+0000 7f6b08ff9640 1 -- 172.21.15.31:0/1268951722 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f6afc013ca0 con 0x7f6b0c06f280 2024-09-22T08:36:00.230 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:00.229+0000 7f6b12591640 1 -- 172.21.15.31:0/1268951722 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6b0c125bd0 con 0x7f6b0c06f280 2024-09-22T08:36:00.231 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:00.229+0000 7f6b08ff9640 1 -- 172.21.15.31:0/1268951722 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v6) ==== 74+0+4153 (secure 0 0 0) 0x7f6afc0133c0 con 0x7f6b0c06f280 2024-09-22T08:36:00.231 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-22T08:36:00.231 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":6,"fsid":"d3faaa46-a06c-404a-b783-532e7c90ea63","created":"2024-09-22T08:35:58.970523+0000","modified":"2024-09-22T08:36:00.023066+0000","last_up_change":"0.000000","last_in_change":"2024-09-22T08:36:00.023066+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"b564b56d-77a0-4258-b683-62460f71da28","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"8f501a52-02aa-4ddf-ae21-83fc468e2e35","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"3dad5d00-e406-4917-9476-7f79fdf2e276","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"3eea2de4-b487-4110-b798-495fa09ef2d1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-22T08:36:00.232 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:00.230+0000 7f6b12591640 1 -- 172.21.15.31:0/1268951722 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6b0c06f280 msgr2=0x7f6b0c0976b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:00.232 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:00.230+0000 7f6b12591640 1 --2- 172.21.15.31:0/1268951722 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6b0c06f280 0x7f6b0c0976b0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f6afc00c3d0 tx=0x7f6afc00c890 comp rx=0 tx=0).stop 2024-09-22T08:36:00.232 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:00.230+0000 7f6b12591640 1 -- 172.21.15.31:0/1268951722 shutdown_connections 2024-09-22T08:36:00.232 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:00.230+0000 7f6b12591640 1 --2- 172.21.15.31:0/1268951722 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6b0c06f280 0x7f6b0c0976b0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:00.232 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:00.230+0000 7f6b12591640 1 -- 172.21.15.31:0/1268951722 >> 172.21.15.31:0/1268951722 conn(0x7f6b0c09ac80 msgr2=0x7f6b0c071bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:00.232 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:00.230+0000 7f6b12591640 1 -- 172.21.15.31:0/1268951722 shutdown_connections 2024-09-22T08:36:00.232 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:00.230+0000 7f6b12591640 1 -- 172.21.15.31:0/1268951722 wait complete. 2024-09-22T08:36:00.243 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-22T08:36:00.243 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-22T08:36:00.646 DEBUG:teuthology.orchestra.run.smithi031:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-22T08:36:00.745 INFO:teuthology.misc.health.smithi031.stderr:2024-09-22T08:36:00.743+0000 7f87914a3640 1 Processor -- start 2024-09-22T08:36:00.745 INFO:teuthology.misc.health.smithi031.stderr:2024-09-22T08:36:00.743+0000 7f87914a3640 1 -- start start 2024-09-22T08:36:00.745 INFO:teuthology.misc.health.smithi031.stderr:2024-09-22T08:36:00.743+0000 7f87914a3640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f878c0721a0 0x7f878c132690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:00.745 INFO:teuthology.misc.health.smithi031.stderr:2024-09-22T08:36:00.743+0000 7f87914a3640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f878c06f940 con 0x7f878c073240 2024-09-22T08:36:00.745 INFO:teuthology.misc.health.smithi031.stderr:2024-09-22T08:36:00.743+0000 7f87914a3640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f878c074180 con 0x7f878c0721a0 2024-09-22T08:36:00.745 INFO:teuthology.misc.health.smithi031.stderr:2024-09-22T08:36:00.743+0000 7f878affd640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f878c073240 0x7f878c073620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:49060/0 (socket says 172.21.15.31:49060) 2024-09-22T08:36:00.746 INFO:teuthology.misc.health.smithi031.stderr:2024-09-22T08:36:00.743+0000 7f878affd640 1 -- 172.21.15.31:0/1754843816 learned_addr learned my addr 172.21.15.31:0/1754843816 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-22T08:36:00.746 INFO:teuthology.misc.health.smithi031.stderr:2024-09-22T08:36:00.743+0000 7f87827fc640 1 --2- 172.21.15.31:0/1754843816 >> v2:172.21.15.31:3300/0 conn(0x7f878c0721a0 0x7f878c132690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:00.746 INFO:teuthology.misc.health.smithi031.stderr:2024-09-22T08:36:00.744+0000 7f878a7fc640 1 -- 172.21.15.31:0/1754843816 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3278113159 0 0) 0x7f878c06f940 con 0x7f878c073240 2024-09-22T08:36:00.746 INFO:teuthology.misc.health.smithi031.stderr:2024-09-22T08:36:00.744+0000 7f878a7fc640 1 -- 172.21.15.31:0/1754843816 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8778003520 con 0x7f878c073240 2024-09-22T08:36:00.746 INFO:teuthology.misc.health.smithi031.stderr:2024-09-22T08:36:00.744+0000 7f87827fc640 1 -- 172.21.15.31:0/1754843816 >> v1:172.21.15.31:6789/0 conn(0x7f878c073240 legacy=0x7f878c073620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:00.746 INFO:teuthology.misc.health.smithi031.stderr:2024-09-22T08:36:00.744+0000 7f87827fc640 1 -- 172.21.15.31:0/1754843816 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f878c072910 con 0x7f878c0721a0 2024-09-22T08:36:00.747 INFO:teuthology.misc.health.smithi031.stderr:2024-09-22T08:36:00.744+0000 7f87827fc640 1 --2- 172.21.15.31:0/1754843816 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f878c0721a0 0x7f878c132690 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f8774009720 tx=0x7f877402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1eaa3ef2fb6cec59 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:00.747 INFO:teuthology.misc.health.smithi031.stderr:2024-09-22T08:36:00.745+0000 7f878a7fc640 1 -- 172.21.15.31:0/1754843816 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8774037070 con 0x7f878c0721a0 2024-09-22T08:36:00.747 INFO:teuthology.misc.health.smithi031.stderr:2024-09-22T08:36:00.745+0000 7f878a7fc640 1 -- 172.21.15.31:0/1754843816 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f877402ad90 con 0x7f878c0721a0 2024-09-22T08:36:00.747 INFO:teuthology.misc.health.smithi031.stderr:2024-09-22T08:36:00.745+0000 7f878a7fc640 1 -- 172.21.15.31:0/1754843816 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8774032590 con 0x7f878c0721a0 2024-09-22T08:36:00.748 INFO:teuthology.misc.health.smithi031.stderr:2024-09-22T08:36:00.745+0000 7f87914a3640 1 -- 172.21.15.31:0/1754843816 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f878c0721a0 msgr2=0x7f878c132690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:00.748 INFO:teuthology.misc.health.smithi031.stderr:2024-09-22T08:36:00.745+0000 7f87914a3640 1 --2- 172.21.15.31:0/1754843816 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f878c0721a0 0x7f878c132690 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f8774009720 tx=0x7f877402a110 comp rx=0 tx=0).stop 2024-09-22T08:36:00.748 INFO:teuthology.misc.health.smithi031.stderr:2024-09-22T08:36:00.745+0000 7f87914a3640 1 -- 172.21.15.31:0/1754843816 shutdown_connections 2024-09-22T08:36:00.748 INFO:teuthology.misc.health.smithi031.stderr:2024-09-22T08:36:00.745+0000 7f87914a3640 1 --2- 172.21.15.31:0/1754843816 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f878c0721a0 0x7f878c132690 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:00.748 INFO:teuthology.misc.health.smithi031.stderr:2024-09-22T08:36:00.745+0000 7f87914a3640 1 -- 172.21.15.31:0/1754843816 >> 172.21.15.31:0/1754843816 conn(0x7f878c09ba10 msgr2=0x7f878c09be20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:00.748 INFO:teuthology.misc.health.smithi031.stderr:2024-09-22T08:36:00.745+0000 7f87914a3640 1 -- 172.21.15.31:0/1754843816 shutdown_connections 2024-09-22T08:36:00.748 INFO:teuthology.misc.health.smithi031.stderr:2024-09-22T08:36:00.745+0000 7f87914a3640 1 -- 172.21.15.31:0/1754843816 wait complete. 2024-09-22T08:36:00.748 INFO:teuthology.misc.health.smithi031.stderr:2024-09-22T08:36:00.746+0000 7f87914a3640 1 Processor -- start 2024-09-22T08:36:00.748 INFO:teuthology.misc.health.smithi031.stderr:2024-09-22T08:36:00.746+0000 7f87914a3640 1 -- start start 2024-09-22T08:36:00.750 INFO:teuthology.misc.health.smithi031.stderr:2024-09-22T08:36:00.747+0000 7f87914a3640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f878c0721a0 0x7f878c06fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:00.751 INFO:teuthology.misc.health.smithi031.stderr:2024-09-22T08:36:00.747+0000 7f87914a3640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f878c132bd0 con 0x7f878c0721a0 2024-09-22T08:36:00.751 INFO:teuthology.misc.health.smithi031.stderr:2024-09-22T08:36:00.747+0000 7f878affd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f878c0721a0 0x7f878c06fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:00.751 INFO:teuthology.misc.health.smithi031.stderr:2024-09-22T08:36:00.747+0000 7f878affd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f878c0721a0 0x7f878c06fb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:37900/0 (socket says 172.21.15.31:37900) 2024-09-22T08:36:00.751 INFO:teuthology.misc.health.smithi031.stderr:2024-09-22T08:36:00.747+0000 7f878affd640 1 -- 172.21.15.31:0/360288534 learned_addr learned my addr 172.21.15.31:0/360288534 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-22T08:36:00.751 INFO:teuthology.misc.health.smithi031.stderr:2024-09-22T08:36:00.747+0000 7f878affd640 1 -- 172.21.15.31:0/360288534 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f878c127250 con 0x7f878c0721a0 2024-09-22T08:36:00.751 INFO:teuthology.misc.health.smithi031.stderr:2024-09-22T08:36:00.747+0000 7f878affd640 1 --2- 172.21.15.31:0/360288534 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f878c0721a0 0x7f878c06fb50 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f877c00c450 tx=0x7f877c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:00.751 INFO:teuthology.misc.health.smithi031.stderr:2024-09-22T08:36:00.747+0000 7f8783fff640 1 -- 172.21.15.31:0/360288534 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f877c017070 con 0x7f878c0721a0 2024-09-22T08:36:00.751 INFO:teuthology.misc.health.smithi031.stderr:2024-09-22T08:36:00.747+0000 7f8783fff640 1 -- 172.21.15.31:0/360288534 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f877c005cd0 con 0x7f878c0721a0 2024-09-22T08:36:00.751 INFO:teuthology.misc.health.smithi031.stderr:2024-09-22T08:36:00.747+0000 7f87914a3640 1 -- 172.21.15.31:0/360288534 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f878c070d60 con 0x7f878c0721a0 2024-09-22T08:36:00.751 INFO:teuthology.misc.health.smithi031.stderr:2024-09-22T08:36:00.747+0000 7f8783fff640 1 -- 172.21.15.31:0/360288534 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f877c0070d0 con 0x7f878c0721a0 2024-09-22T08:36:00.751 INFO:teuthology.misc.health.smithi031.stderr:2024-09-22T08:36:00.747+0000 7f87914a3640 1 -- 172.21.15.31:0/360288534 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f878c0717d0 con 0x7f878c0721a0 2024-09-22T08:36:00.752 INFO:teuthology.misc.health.smithi031.stderr:2024-09-22T08:36:00.747+0000 7f8783fff640 1 -- 172.21.15.31:0/360288534 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f877c01a070 con 0x7f878c0721a0 2024-09-22T08:36:00.752 INFO:teuthology.misc.health.smithi031.stderr:2024-09-22T08:36:00.747+0000 7f8783fff640 1 -- 172.21.15.31:0/360288534 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f877c01cc40 con 0x7f878c0721a0 2024-09-22T08:36:00.752 INFO:teuthology.misc.health.smithi031.stderr:2024-09-22T08:36:00.748+0000 7f87914a3640 1 -- 172.21.15.31:0/360288534 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f878c08c4c0 con 0x7f878c0721a0 2024-09-22T08:36:00.752 INFO:teuthology.misc.health.smithi031.stderr:2024-09-22T08:36:00.750+0000 7f8783fff640 1 -- 172.21.15.31:0/360288534 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f877c01c440 con 0x7f878c0721a0 2024-09-22T08:36:00.812 INFO:teuthology.misc.health.smithi031.stderr:2024-09-22T08:36:00.811+0000 7f87914a3640 1 -- 172.21.15.31:0/360288534 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f878c0765d0 con 0x7f878c0721a0 2024-09-22T08:36:00.813 INFO:teuthology.misc.health.smithi031.stderr:2024-09-22T08:36:00.811+0000 7f8783fff640 1 -- 172.21.15.31:0/360288534 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v6) ==== 74+0+4153 (secure 0 0 0) 0x7f877c01c620 con 0x7f878c0721a0 2024-09-22T08:36:00.813 INFO:teuthology.misc.health.smithi031.stdout: 2024-09-22T08:36:00.813 INFO:teuthology.misc.health.smithi031.stdout:{"epoch":6,"fsid":"d3faaa46-a06c-404a-b783-532e7c90ea63","created":"2024-09-22T08:35:58.970523+0000","modified":"2024-09-22T08:36:00.023066+0000","last_up_change":"0.000000","last_in_change":"2024-09-22T08:36:00.023066+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"b564b56d-77a0-4258-b683-62460f71da28","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"8f501a52-02aa-4ddf-ae21-83fc468e2e35","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"3dad5d00-e406-4917-9476-7f79fdf2e276","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"3eea2de4-b487-4110-b798-495fa09ef2d1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-22T08:36:00.814 INFO:teuthology.misc.health.smithi031.stderr:2024-09-22T08:36:00.812+0000 7f87914a3640 1 -- 172.21.15.31:0/360288534 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f878c0721a0 msgr2=0x7f878c06fb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:00.814 INFO:teuthology.misc.health.smithi031.stderr:2024-09-22T08:36:00.812+0000 7f87914a3640 1 --2- 172.21.15.31:0/360288534 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f878c0721a0 0x7f878c06fb50 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f877c00c450 tx=0x7f877c00c910 comp rx=0 tx=0).stop 2024-09-22T08:36:00.814 INFO:teuthology.misc.health.smithi031.stderr:2024-09-22T08:36:00.812+0000 7f87914a3640 1 -- 172.21.15.31:0/360288534 shutdown_connections 2024-09-22T08:36:00.814 INFO:teuthology.misc.health.smithi031.stderr:2024-09-22T08:36:00.812+0000 7f87914a3640 1 --2- 172.21.15.31:0/360288534 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f878c0721a0 0x7f878c06fb50 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:00.814 INFO:teuthology.misc.health.smithi031.stderr:2024-09-22T08:36:00.812+0000 7f87914a3640 1 -- 172.21.15.31:0/360288534 >> 172.21.15.31:0/360288534 conn(0x7f878c09ba10 msgr2=0x7f878c12b150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:00.814 INFO:teuthology.misc.health.smithi031.stderr:2024-09-22T08:36:00.812+0000 7f87914a3640 1 -- 172.21.15.31:0/360288534 shutdown_connections 2024-09-22T08:36:00.814 INFO:teuthology.misc.health.smithi031.stderr:2024-09-22T08:36:00.812+0000 7f87914a3640 1 -- 172.21.15.31:0/360288534 wait complete. 2024-09-22T08:36:00.822 DEBUG:teuthology.misc:0 of 4 OSDs are up 2024-09-22T08:36:00.969 INFO:tasks.ceph.osd.0.smithi031.stderr:2024-09-22T08:36:00.968+0000 7fa27ca17640 -1 Falling back to public interface 2024-09-22T08:36:01.250 INFO:tasks.ceph.osd.3.smithi142.stderr:2024-09-22T08:36:01.249+0000 7f2ca0016640 -1 Falling back to public interface 2024-09-22T08:36:01.525 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-09-22T08:36:01.524+0000 7f465b8b6640 -1 Falling back to public interface 2024-09-22T08:36:01.742 INFO:tasks.ceph.osd.1.smithi142.stderr:2024-09-22T08:36:01.741+0000 7faa3d69c640 -1 Falling back to public interface 2024-09-22T08:36:04.146 INFO:tasks.ceph.mgr.x.smithi142.stderr:2024-09-22T08:36:04.145+0000 7fb666c17640 -1 mgr.server handle_report got status from non-daemon mon.a 2024-09-22T08:36:04.893 INFO:tasks.ceph.osd.3.smithi142.stderr:2024-09-22T08:36:04.892+0000 7f2ca0016640 -1 osd.3 0 log_to_monitors true 2024-09-22T08:36:04.980 INFO:tasks.ceph.osd.0.smithi031.stderr:2024-09-22T08:36:04.979+0000 7fa27ca17640 -1 osd.0 0 log_to_monitors true 2024-09-22T08:36:05.379 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-09-22T08:36:05.378+0000 7f465b8b6640 -1 osd.2 0 log_to_monitors true 2024-09-22T08:36:06.031 INFO:tasks.ceph.osd.1.smithi142.stderr:2024-09-22T08:36:06.030+0000 7faa3d69c640 -1 osd.1 0 log_to_monitors true 2024-09-22T08:36:07.005 INFO:tasks.ceph.osd.3.smithi142.stderr:2024-09-22T08:36:07.003+0000 7f2c9b99a640 -1 osd.3 0 waiting for initial osdmap 2024-09-22T08:36:07.018 INFO:tasks.ceph.osd.3.smithi142.stderr:2024-09-22T08:36:07.017+0000 7f2c937b9640 -1 osd.3 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-22T08:36:07.116 INFO:tasks.ceph.osd.0.smithi031.stderr:2024-09-22T08:36:07.115+0000 7fa278306640 -1 osd.0 0 waiting for initial osdmap 2024-09-22T08:36:07.139 INFO:tasks.ceph.osd.0.smithi031.stderr:2024-09-22T08:36:07.138+0000 7fa270125640 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-22T08:36:07.227 DEBUG:teuthology.orchestra.run.smithi031:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-22T08:36:07.319 INFO:teuthology.misc.health.smithi031.stderr:2024-09-22T08:36:07.318+0000 7f72e30ed640 1 Processor -- start 2024-09-22T08:36:07.319 INFO:teuthology.misc.health.smithi031.stderr:2024-09-22T08:36:07.318+0000 7f72e30ed640 1 -- start start 2024-09-22T08:36:07.320 INFO:teuthology.misc.health.smithi031.stderr:2024-09-22T08:36:07.318+0000 7f72e30ed640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f72dc0721a0 0x7f72dc132690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:07.320 INFO:teuthology.misc.health.smithi031.stderr:2024-09-22T08:36:07.318+0000 7f72e30ed640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72dc06f940 con 0x7f72dc073240 2024-09-22T08:36:07.320 INFO:teuthology.misc.health.smithi031.stderr:2024-09-22T08:36:07.318+0000 7f72e30ed640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f72dc074180 con 0x7f72dc0721a0 2024-09-22T08:36:07.320 INFO:teuthology.misc.health.smithi031.stderr:2024-09-22T08:36:07.318+0000 7f72dbfff640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f72dc0721a0 0x7f72dc132690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:07.320 INFO:teuthology.misc.health.smithi031.stderr:2024-09-22T08:36:07.318+0000 7f72e0e89640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f72dc073240 0x7f72dc073620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:46784/0 (socket says 172.21.15.31:46784) 2024-09-22T08:36:07.320 INFO:teuthology.misc.health.smithi031.stderr:2024-09-22T08:36:07.318+0000 7f72dbfff640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f72dc0721a0 0x7f72dc132690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:37268/0 (socket says 172.21.15.31:37268) 2024-09-22T08:36:07.320 INFO:teuthology.misc.health.smithi031.stderr:2024-09-22T08:36:07.318+0000 7f72e0e89640 1 -- 172.21.15.31:0/2016275893 learned_addr learned my addr 172.21.15.31:0/2016275893 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-22T08:36:07.320 INFO:teuthology.misc.health.smithi031.stderr:2024-09-22T08:36:07.319+0000 7f72dbfff640 1 -- 172.21.15.31:0/2016275893 >> v1:172.21.15.31:6789/0 conn(0x7f72dc073240 legacy=0x7f72dc073620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:07.321 INFO:teuthology.misc.health.smithi031.stderr:2024-09-22T08:36:07.319+0000 7f72dbfff640 1 -- 172.21.15.31:0/2016275893 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72dc072910 con 0x7f72dc0721a0 2024-09-22T08:36:07.322 INFO:teuthology.misc.health.smithi031.stderr:2024-09-22T08:36:07.319+0000 7f72dbfff640 1 --2- 172.21.15.31:0/2016275893 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f72dc0721a0 0x7f72dc132690 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f72c8009720 tx=0x7f72c802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69a33b2990770b19 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:07.322 INFO:teuthology.misc.health.smithi031.stderr:2024-09-22T08:36:07.319+0000 7f72db7fe640 1 -- 172.21.15.31:0/2016275893 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72c8037070 con 0x7f72dc0721a0 2024-09-22T08:36:07.322 INFO:teuthology.misc.health.smithi031.stderr:2024-09-22T08:36:07.319+0000 7f72db7fe640 1 -- 172.21.15.31:0/2016275893 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72c802ad90 con 0x7f72dc0721a0 2024-09-22T08:36:07.322 INFO:teuthology.misc.health.smithi031.stderr:2024-09-22T08:36:07.319+0000 7f72db7fe640 1 -- 172.21.15.31:0/2016275893 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72c8032590 con 0x7f72dc0721a0 2024-09-22T08:36:07.322 INFO:teuthology.misc.health.smithi031.stderr:2024-09-22T08:36:07.320+0000 7f72e30ed640 1 -- 172.21.15.31:0/2016275893 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f72dc0721a0 msgr2=0x7f72dc132690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:07.322 INFO:teuthology.misc.health.smithi031.stderr:2024-09-22T08:36:07.320+0000 7f72e30ed640 1 --2- 172.21.15.31:0/2016275893 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f72dc0721a0 0x7f72dc132690 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f72c8009720 tx=0x7f72c802a110 comp rx=0 tx=0).stop 2024-09-22T08:36:07.322 INFO:teuthology.misc.health.smithi031.stderr:2024-09-22T08:36:07.320+0000 7f72e30ed640 1 -- 172.21.15.31:0/2016275893 shutdown_connections 2024-09-22T08:36:07.322 INFO:teuthology.misc.health.smithi031.stderr:2024-09-22T08:36:07.320+0000 7f72e30ed640 1 --2- 172.21.15.31:0/2016275893 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f72dc0721a0 0x7f72dc132690 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:07.322 INFO:teuthology.misc.health.smithi031.stderr:2024-09-22T08:36:07.320+0000 7f72e30ed640 1 -- 172.21.15.31:0/2016275893 >> 172.21.15.31:0/2016275893 conn(0x7f72dc09ba10 msgr2=0x7f72dc09be20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:07.323 INFO:teuthology.misc.health.smithi031.stderr:2024-09-22T08:36:07.320+0000 7f72e30ed640 1 -- 172.21.15.31:0/2016275893 shutdown_connections 2024-09-22T08:36:07.323 INFO:teuthology.misc.health.smithi031.stderr:2024-09-22T08:36:07.320+0000 7f72e30ed640 1 -- 172.21.15.31:0/2016275893 wait complete. 2024-09-22T08:36:07.323 INFO:teuthology.misc.health.smithi031.stderr:2024-09-22T08:36:07.321+0000 7f72e30ed640 1 Processor -- start 2024-09-22T08:36:07.323 INFO:teuthology.misc.health.smithi031.stderr:2024-09-22T08:36:07.321+0000 7f72e30ed640 1 -- start start 2024-09-22T08:36:07.324 INFO:teuthology.misc.health.smithi031.stderr:2024-09-22T08:36:07.321+0000 7f72e30ed640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f72dc0721a0 0x7f72dc122e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:07.324 INFO:teuthology.misc.health.smithi031.stderr:2024-09-22T08:36:07.321+0000 7f72e30ed640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f72dc132bd0 con 0x7f72dc0721a0 2024-09-22T08:36:07.325 INFO:teuthology.misc.health.smithi031.stderr:2024-09-22T08:36:07.322+0000 7f72e0e89640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f72dc0721a0 0x7f72dc122e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:07.325 INFO:teuthology.misc.health.smithi031.stderr:2024-09-22T08:36:07.322+0000 7f72e0e89640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f72dc0721a0 0x7f72dc122e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:37278/0 (socket says 172.21.15.31:37278) 2024-09-22T08:36:07.325 INFO:teuthology.misc.health.smithi031.stderr:2024-09-22T08:36:07.322+0000 7f72e0e89640 1 -- 172.21.15.31:0/2642932624 learned_addr learned my addr 172.21.15.31:0/2642932624 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-22T08:36:07.325 INFO:teuthology.misc.health.smithi031.stderr:2024-09-22T08:36:07.322+0000 7f72e0e89640 1 -- 172.21.15.31:0/2642932624 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72dc125bb0 con 0x7f72dc0721a0 2024-09-22T08:36:07.325 INFO:teuthology.misc.health.smithi031.stderr:2024-09-22T08:36:07.322+0000 7f72e0e89640 1 --2- 172.21.15.31:0/2642932624 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f72dc0721a0 0x7f72dc122e40 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f72d000c480 tx=0x7f72d000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:07.325 INFO:teuthology.misc.health.smithi031.stderr:2024-09-22T08:36:07.322+0000 7f72d97fa640 1 -- 172.21.15.31:0/2642932624 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72d0017070 con 0x7f72dc0721a0 2024-09-22T08:36:07.325 INFO:teuthology.misc.health.smithi031.stderr:2024-09-22T08:36:07.322+0000 7f72d97fa640 1 -- 172.21.15.31:0/2642932624 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72d0005c10 con 0x7f72dc0721a0 2024-09-22T08:36:07.325 INFO:teuthology.misc.health.smithi031.stderr:2024-09-22T08:36:07.322+0000 7f72e30ed640 1 -- 172.21.15.31:0/2642932624 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72dc124f10 con 0x7f72dc0721a0 2024-09-22T08:36:07.325 INFO:teuthology.misc.health.smithi031.stderr:2024-09-22T08:36:07.322+0000 7f72d97fa640 1 -- 172.21.15.31:0/2642932624 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72d00070d0 con 0x7f72dc0721a0 2024-09-22T08:36:07.325 INFO:teuthology.misc.health.smithi031.stderr:2024-09-22T08:36:07.322+0000 7f72e30ed640 1 -- 172.21.15.31:0/2642932624 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72dc125620 con 0x7f72dc0721a0 2024-09-22T08:36:07.325 INFO:teuthology.misc.health.smithi031.stderr:2024-09-22T08:36:07.323+0000 7f72d97fa640 1 -- 172.21.15.31:0/2642932624 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) ==== 50975+0+0 (secure 0 0 0) 0x7f72d001a070 con 0x7f72dc0721a0 2024-09-22T08:36:07.325 INFO:teuthology.misc.health.smithi031.stderr:2024-09-22T08:36:07.323+0000 7f72e30ed640 1 -- 172.21.15.31:0/2642932624 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72dc0008d0 con 0x7f72dc0721a0 2024-09-22T08:36:07.325 INFO:teuthology.misc.health.smithi031.stderr:2024-09-22T08:36:07.323+0000 7f72d97fa640 1 --2- 172.21.15.31:0/2642932624 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f72c003e680 0x7f72c0040b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:07.325 INFO:teuthology.misc.health.smithi031.stderr:2024-09-22T08:36:07.323+0000 7f72d97fa640 1 -- 172.21.15.31:0/2642932624 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 2183+0+0 (secure 0 0 0) 0x7f72d0051b40 con 0x7f72dc0721a0 2024-09-22T08:36:07.326 INFO:teuthology.misc.health.smithi031.stderr:2024-09-22T08:36:07.323+0000 7f72dbfff640 1 --2- 172.21.15.31:0/2642932624 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f72c003e680 0x7f72c0040b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:07.326 INFO:teuthology.misc.health.smithi031.stderr:2024-09-22T08:36:07.324+0000 7f72dbfff640 1 --2- 172.21.15.31:0/2642932624 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f72c003e680 0x7f72c0040b40 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f72c8034000 tx=0x7f72c802e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:07.329 INFO:teuthology.misc.health.smithi031.stderr:2024-09-22T08:36:07.328+0000 7f72d97fa640 1 -- 172.21.15.31:0/2642932624 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f72d001ad70 con 0x7f72dc0721a0 2024-09-22T08:36:07.517 INFO:teuthology.misc.health.smithi031.stderr:2024-09-22T08:36:07.515+0000 7f72e30ed640 1 -- 172.21.15.31:0/2642932624 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f72dc073240 con 0x7f72dc0721a0 2024-09-22T08:36:07.517 INFO:teuthology.misc.health.smithi031.stderr:2024-09-22T08:36:07.516+0000 7f72d97fa640 1 -- 172.21.15.31:0/2642932624 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v9) ==== 74+0+5122 (secure 0 0 0) 0x7f72d001b8d0 con 0x7f72dc0721a0 2024-09-22T08:36:07.517 INFO:teuthology.misc.health.smithi031.stdout: 2024-09-22T08:36:07.517 INFO:teuthology.misc.health.smithi031.stdout:{"epoch":9,"fsid":"d3faaa46-a06c-404a-b783-532e7c90ea63","created":"2024-09-22T08:35:58.970523+0000","modified":"2024-09-22T08:36:07.149676+0000","last_up_change":"2024-09-22T08:36:07.149676+0000","last_in_change":"2024-09-22T08:36:00.023066+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"b564b56d-77a0-4258-b683-62460f71da28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":168281188},{"type":"v1","addr":"172.21.15.31:6801","nonce":168281188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":168281188},{"type":"v1","addr":"172.21.15.31:6803","nonce":168281188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":168281188},{"type":"v1","addr":"172.21.15.31:6807","nonce":168281188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":168281188},{"type":"v1","addr":"172.21.15.31:6805","nonce":168281188}]},"public_addr":"172.21.15.31:6801/168281188","cluster_addr":"172.21.15.31:6803/168281188","heartbeat_back_addr":"172.21.15.31:6807/168281188","heartbeat_front_addr":"172.21.15.31:6805/168281188","state":["exists","up"]},{"osd":1,"uuid":"8f501a52-02aa-4ddf-ae21-83fc468e2e35","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"3dad5d00-e406-4917-9476-7f79fdf2e276","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"3eea2de4-b487-4110-b798-495fa09ef2d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":1064901393},{"type":"v1","addr":"172.21.15.142:6801","nonce":1064901393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":1064901393},{"type":"v1","addr":"172.21.15.142:6803","nonce":1064901393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":1064901393},{"type":"v1","addr":"172.21.15.142:6807","nonce":1064901393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":1064901393},{"type":"v1","addr":"172.21.15.142:6805","nonce":1064901393}]},"public_addr":"172.21.15.142:6801/1064901393","cluster_addr":"172.21.15.142:6803/1064901393","heartbeat_back_addr":"172.21.15.142:6807/1064901393","heartbeat_front_addr":"172.21.15.142:6805/1064901393","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-22T08:36:07.520 INFO:teuthology.misc.health.smithi031.stderr:2024-09-22T08:36:07.518+0000 7f72e30ed640 1 -- 172.21.15.31:0/2642932624 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f72c003e680 msgr2=0x7f72c0040b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:07.520 INFO:teuthology.misc.health.smithi031.stderr:2024-09-22T08:36:07.518+0000 7f72e30ed640 1 --2- 172.21.15.31:0/2642932624 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f72c003e680 0x7f72c0040b40 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f72c8034000 tx=0x7f72c802e000 comp rx=0 tx=0).stop 2024-09-22T08:36:07.520 INFO:teuthology.misc.health.smithi031.stderr:2024-09-22T08:36:07.518+0000 7f72e30ed640 1 -- 172.21.15.31:0/2642932624 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f72dc0721a0 msgr2=0x7f72dc122e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:07.520 INFO:teuthology.misc.health.smithi031.stderr:2024-09-22T08:36:07.518+0000 7f72e30ed640 1 --2- 172.21.15.31:0/2642932624 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f72dc0721a0 0x7f72dc122e40 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f72d000c480 tx=0x7f72d000c940 comp rx=0 tx=0).stop 2024-09-22T08:36:07.520 INFO:teuthology.misc.health.smithi031.stderr:2024-09-22T08:36:07.519+0000 7f72e30ed640 1 -- 172.21.15.31:0/2642932624 shutdown_connections 2024-09-22T08:36:07.520 INFO:teuthology.misc.health.smithi031.stderr:2024-09-22T08:36:07.519+0000 7f72e30ed640 1 --2- 172.21.15.31:0/2642932624 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f72c003e680 0x7f72c0040b40 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:07.520 INFO:teuthology.misc.health.smithi031.stderr:2024-09-22T08:36:07.519+0000 7f72e30ed640 1 --2- 172.21.15.31:0/2642932624 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f72dc0721a0 0x7f72dc122e40 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:07.520 INFO:teuthology.misc.health.smithi031.stderr:2024-09-22T08:36:07.519+0000 7f72e30ed640 1 -- 172.21.15.31:0/2642932624 >> 172.21.15.31:0/2642932624 conn(0x7f72dc09ba10 msgr2=0x7f72dc12d160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:07.521 INFO:teuthology.misc.health.smithi031.stderr:2024-09-22T08:36:07.519+0000 7f72e30ed640 1 -- 172.21.15.31:0/2642932624 shutdown_connections 2024-09-22T08:36:07.521 INFO:teuthology.misc.health.smithi031.stderr:2024-09-22T08:36:07.519+0000 7f72e30ed640 1 -- 172.21.15.31:0/2642932624 wait complete. 2024-09-22T08:36:07.529 DEBUG:teuthology.misc:2 of 4 OSDs are up 2024-09-22T08:36:08.400 INFO:tasks.ceph.osd.1.smithi142.stderr:2024-09-22T08:36:08.399+0000 7faa3962b640 -1 osd.1 0 waiting for initial osdmap 2024-09-22T08:36:08.410 INFO:tasks.ceph.osd.1.smithi142.stderr:2024-09-22T08:36:08.409+0000 7faa3144a640 -1 osd.1 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-22T08:36:08.456 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-09-22T08:36:08.455+0000 7f4657845640 -1 osd.2 0 waiting for initial osdmap 2024-09-22T08:36:08.470 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-09-22T08:36:08.469+0000 7f464f664640 -1 osd.2 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-22T08:36:13.933 DEBUG:teuthology.orchestra.run.smithi031:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-22T08:36:14.038 INFO:teuthology.misc.health.smithi031.stderr:2024-09-22T08:36:14.037+0000 7fafdafda640 1 Processor -- start 2024-09-22T08:36:14.038 INFO:teuthology.misc.health.smithi031.stderr:2024-09-22T08:36:14.037+0000 7fafdafda640 1 -- start start 2024-09-22T08:36:14.039 INFO:teuthology.misc.health.smithi031.stderr:2024-09-22T08:36:14.037+0000 7fafdafda640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fafd40721a0 0x7fafd4132690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:14.039 INFO:teuthology.misc.health.smithi031.stderr:2024-09-22T08:36:14.037+0000 7fafdafda640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fafd406f940 con 0x7fafd4073240 2024-09-22T08:36:14.039 INFO:teuthology.misc.health.smithi031.stderr:2024-09-22T08:36:14.037+0000 7fafdafda640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7fafd4074180 con 0x7fafd40721a0 2024-09-22T08:36:14.040 INFO:teuthology.misc.health.smithi031.stderr:2024-09-22T08:36:14.038+0000 7fafd8d76640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fafd4073240 0x7fafd4073620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:46790/0 (socket says 172.21.15.31:46790) 2024-09-22T08:36:14.040 INFO:teuthology.misc.health.smithi031.stderr:2024-09-22T08:36:14.038+0000 7fafd8d76640 1 -- 172.21.15.31:0/1822176557 learned_addr learned my addr 172.21.15.31:0/1822176557 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-22T08:36:14.040 INFO:teuthology.misc.health.smithi031.stderr:2024-09-22T08:36:14.038+0000 7fafd3fff640 1 --2- 172.21.15.31:0/1822176557 >> v2:172.21.15.31:3300/0 conn(0x7fafd40721a0 0x7fafd4132690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:14.040 INFO:teuthology.misc.health.smithi031.stderr:2024-09-22T08:36:14.038+0000 7fafd37fe640 1 -- 172.21.15.31:0/1822176557 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 231518066 0 0) 0x7fafd406f940 con 0x7fafd4073240 2024-09-22T08:36:14.040 INFO:teuthology.misc.health.smithi031.stderr:2024-09-22T08:36:14.038+0000 7fafd37fe640 1 -- 172.21.15.31:0/1822176557 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fafbc003520 con 0x7fafd4073240 2024-09-22T08:36:14.040 INFO:teuthology.misc.health.smithi031.stderr:2024-09-22T08:36:14.038+0000 7fafd3fff640 1 -- 172.21.15.31:0/1822176557 >> v1:172.21.15.31:6789/0 conn(0x7fafd4073240 legacy=0x7fafd4073620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:14.040 INFO:teuthology.misc.health.smithi031.stderr:2024-09-22T08:36:14.038+0000 7fafd3fff640 1 -- 172.21.15.31:0/1822176557 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafd4072910 con 0x7fafd40721a0 2024-09-22T08:36:14.041 INFO:teuthology.misc.health.smithi031.stderr:2024-09-22T08:36:14.039+0000 7fafd3fff640 1 --2- 172.21.15.31:0/1822176557 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fafd40721a0 0x7fafd4132690 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fafc8009720 tx=0x7fafc802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc9598cd30727499 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:14.041 INFO:teuthology.misc.health.smithi031.stderr:2024-09-22T08:36:14.039+0000 7fafd37fe640 1 -- 172.21.15.31:0/1822176557 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fafc8037070 con 0x7fafd40721a0 2024-09-22T08:36:14.041 INFO:teuthology.misc.health.smithi031.stderr:2024-09-22T08:36:14.039+0000 7fafd37fe640 1 -- 172.21.15.31:0/1822176557 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafc802ad90 con 0x7fafd40721a0 2024-09-22T08:36:14.041 INFO:teuthology.misc.health.smithi031.stderr:2024-09-22T08:36:14.039+0000 7fafd37fe640 1 -- 172.21.15.31:0/1822176557 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fafc8032570 con 0x7fafd40721a0 2024-09-22T08:36:14.042 INFO:teuthology.misc.health.smithi031.stderr:2024-09-22T08:36:14.039+0000 7fafdafda640 1 -- 172.21.15.31:0/1822176557 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fafd40721a0 msgr2=0x7fafd4132690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:14.042 INFO:teuthology.misc.health.smithi031.stderr:2024-09-22T08:36:14.039+0000 7fafdafda640 1 --2- 172.21.15.31:0/1822176557 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fafd40721a0 0x7fafd4132690 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fafc8009720 tx=0x7fafc802a110 comp rx=0 tx=0).stop 2024-09-22T08:36:14.042 INFO:teuthology.misc.health.smithi031.stderr:2024-09-22T08:36:14.039+0000 7fafdafda640 1 -- 172.21.15.31:0/1822176557 shutdown_connections 2024-09-22T08:36:14.042 INFO:teuthology.misc.health.smithi031.stderr:2024-09-22T08:36:14.039+0000 7fafdafda640 1 --2- 172.21.15.31:0/1822176557 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fafd40721a0 0x7fafd4132690 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:14.042 INFO:teuthology.misc.health.smithi031.stderr:2024-09-22T08:36:14.039+0000 7fafdafda640 1 -- 172.21.15.31:0/1822176557 >> 172.21.15.31:0/1822176557 conn(0x7fafd409ba10 msgr2=0x7fafd409be20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:14.042 INFO:teuthology.misc.health.smithi031.stderr:2024-09-22T08:36:14.039+0000 7fafdafda640 1 -- 172.21.15.31:0/1822176557 shutdown_connections 2024-09-22T08:36:14.042 INFO:teuthology.misc.health.smithi031.stderr:2024-09-22T08:36:14.040+0000 7fafdafda640 1 -- 172.21.15.31:0/1822176557 wait complete. 2024-09-22T08:36:14.042 INFO:teuthology.misc.health.smithi031.stderr:2024-09-22T08:36:14.040+0000 7fafdafda640 1 Processor -- start 2024-09-22T08:36:14.042 INFO:teuthology.misc.health.smithi031.stderr:2024-09-22T08:36:14.040+0000 7fafdafda640 1 -- start start 2024-09-22T08:36:14.043 INFO:teuthology.misc.health.smithi031.stderr:2024-09-22T08:36:14.041+0000 7fafdafda640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fafd40721a0 0x7fafd4122e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:14.043 INFO:teuthology.misc.health.smithi031.stderr:2024-09-22T08:36:14.041+0000 7fafdafda640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fafd4132bd0 con 0x7fafd40721a0 2024-09-22T08:36:14.044 INFO:teuthology.misc.health.smithi031.stderr:2024-09-22T08:36:14.041+0000 7fafd8d76640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fafd40721a0 0x7fafd4122e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:14.044 INFO:teuthology.misc.health.smithi031.stderr:2024-09-22T08:36:14.041+0000 7fafd8d76640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fafd40721a0 0x7fafd4122e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:37294/0 (socket says 172.21.15.31:37294) 2024-09-22T08:36:14.044 INFO:teuthology.misc.health.smithi031.stderr:2024-09-22T08:36:14.041+0000 7fafd8d76640 1 -- 172.21.15.31:0/4015250718 learned_addr learned my addr 172.21.15.31:0/4015250718 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-22T08:36:14.044 INFO:teuthology.misc.health.smithi031.stderr:2024-09-22T08:36:14.041+0000 7fafd8d76640 1 -- 172.21.15.31:0/4015250718 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafd4125ae0 con 0x7fafd40721a0 2024-09-22T08:36:14.044 INFO:teuthology.misc.health.smithi031.stderr:2024-09-22T08:36:14.041+0000 7fafd8d76640 1 --2- 172.21.15.31:0/4015250718 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fafd40721a0 0x7fafd4122e40 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fafc400cb50 tx=0x7fafc400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:14.044 INFO:teuthology.misc.health.smithi031.stderr:2024-09-22T08:36:14.042+0000 7fafd17fa640 1 -- 172.21.15.31:0/4015250718 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fafc4017070 con 0x7fafd40721a0 2024-09-22T08:36:14.044 INFO:teuthology.misc.health.smithi031.stderr:2024-09-22T08:36:14.042+0000 7fafd17fa640 1 -- 172.21.15.31:0/4015250718 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafc400abf0 con 0x7fafd40721a0 2024-09-22T08:36:14.044 INFO:teuthology.misc.health.smithi031.stderr:2024-09-22T08:36:14.042+0000 7fafdafda640 1 -- 172.21.15.31:0/4015250718 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fafd4124e40 con 0x7fafd40721a0 2024-09-22T08:36:14.044 INFO:teuthology.misc.health.smithi031.stderr:2024-09-22T08:36:14.042+0000 7fafd17fa640 1 -- 172.21.15.31:0/4015250718 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fafc4012400 con 0x7fafd40721a0 2024-09-22T08:36:14.044 INFO:teuthology.misc.health.smithi031.stderr:2024-09-22T08:36:14.042+0000 7fafdafda640 1 -- 172.21.15.31:0/4015250718 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fafd4125550 con 0x7fafd40721a0 2024-09-22T08:36:14.045 INFO:teuthology.misc.health.smithi031.stderr:2024-09-22T08:36:14.043+0000 7fafd17fa640 1 -- 172.21.15.31:0/4015250718 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fafc401a070 con 0x7fafd40721a0 2024-09-22T08:36:14.045 INFO:teuthology.misc.health.smithi031.stderr:2024-09-22T08:36:14.043+0000 7fafdafda640 1 -- 172.21.15.31:0/4015250718 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fafd4127210 con 0x7fafd40721a0 2024-09-22T08:36:14.045 INFO:teuthology.misc.health.smithi031.stderr:2024-09-22T08:36:14.043+0000 7fafd17fa640 1 --2- 172.21.15.31:0/4015250718 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fafc003e710 0x7fafc0040bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:14.045 INFO:teuthology.misc.health.smithi031.stderr:2024-09-22T08:36:14.043+0000 7fafd17fa640 1 -- 172.21.15.31:0/4015250718 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(13..13 src has 1..13) ==== 3129+0+0 (secure 0 0 0) 0x7fafc40528b0 con 0x7fafd40721a0 2024-09-22T08:36:14.045 INFO:teuthology.misc.health.smithi031.stderr:2024-09-22T08:36:14.044+0000 7fafd3fff640 1 --2- 172.21.15.31:0/4015250718 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fafc003e710 0x7fafc0040bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:14.045 INFO:teuthology.misc.health.smithi031.stderr:2024-09-22T08:36:14.044+0000 7fafd3fff640 1 --2- 172.21.15.31:0/4015250718 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fafc003e710 0x7fafc0040bd0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fafc8034000 tx=0x7fafc802e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:14.049 INFO:teuthology.misc.health.smithi031.stderr:2024-09-22T08:36:14.048+0000 7fafd17fa640 1 -- 172.21.15.31:0/4015250718 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fafc40078c0 con 0x7fafd40721a0 2024-09-22T08:36:14.238 INFO:teuthology.misc.health.smithi031.stderr:2024-09-22T08:36:14.237+0000 7fafdafda640 1 -- 172.21.15.31:0/4015250718 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fafd40765d0 con 0x7fafd40721a0 2024-09-22T08:36:14.239 INFO:teuthology.misc.health.smithi031.stderr:2024-09-22T08:36:14.237+0000 7fafd17fa640 1 -- 172.21.15.31:0/4015250718 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) ==== 74+0+7989 (secure 0 0 0) 0x7fafc401a360 con 0x7fafd40721a0 2024-09-22T08:36:14.239 INFO:teuthology.misc.health.smithi031.stdout: 2024-09-22T08:36:14.239 INFO:teuthology.misc.health.smithi031.stdout:{"epoch":13,"fsid":"d3faaa46-a06c-404a-b783-532e7c90ea63","created":"2024-09-22T08:35:58.970523+0000","modified":"2024-09-22T08:36:11.404170+0000","last_up_change":"2024-09-22T08:36:09.401562+0000","last_in_change":"2024-09-22T08:36:00.023066+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-22T08:36:09.158554+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b564b56d-77a0-4258-b683-62460f71da28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":168281188},{"type":"v1","addr":"172.21.15.31:6801","nonce":168281188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":168281188},{"type":"v1","addr":"172.21.15.31:6803","nonce":168281188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":168281188},{"type":"v1","addr":"172.21.15.31:6807","nonce":168281188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":168281188},{"type":"v1","addr":"172.21.15.31:6805","nonce":168281188}]},"public_addr":"172.21.15.31:6801/168281188","cluster_addr":"172.21.15.31:6803/168281188","heartbeat_back_addr":"172.21.15.31:6807/168281188","heartbeat_front_addr":"172.21.15.31:6805/168281188","state":["exists","up"]},{"osd":1,"uuid":"8f501a52-02aa-4ddf-ae21-83fc468e2e35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3192108003},{"type":"v1","addr":"172.21.15.142:6817","nonce":3192108003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":3192108003},{"type":"v1","addr":"172.21.15.142:6819","nonce":3192108003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":3192108003},{"type":"v1","addr":"172.21.15.142:6823","nonce":3192108003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":3192108003},{"type":"v1","addr":"172.21.15.142:6821","nonce":3192108003}]},"public_addr":"172.21.15.142:6817/3192108003","cluster_addr":"172.21.15.142:6819/3192108003","heartbeat_back_addr":"172.21.15.142:6823/3192108003","heartbeat_front_addr":"172.21.15.142:6821/3192108003","state":["exists","up"]},{"osd":2,"uuid":"3dad5d00-e406-4917-9476-7f79fdf2e276","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":279438927},{"type":"v1","addr":"172.21.15.142:6809","nonce":279438927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":279438927},{"type":"v1","addr":"172.21.15.142:6811","nonce":279438927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":279438927},{"type":"v1","addr":"172.21.15.142:6815","nonce":279438927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":279438927},{"type":"v1","addr":"172.21.15.142:6813","nonce":279438927}]},"public_addr":"172.21.15.142:6809/279438927","cluster_addr":"172.21.15.142:6811/279438927","heartbeat_back_addr":"172.21.15.142:6815/279438927","heartbeat_front_addr":"172.21.15.142:6813/279438927","state":["exists","up"]},{"osd":3,"uuid":"3eea2de4-b487-4110-b798-495fa09ef2d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":1064901393},{"type":"v1","addr":"172.21.15.142:6801","nonce":1064901393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":1064901393},{"type":"v1","addr":"172.21.15.142:6803","nonce":1064901393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":1064901393},{"type":"v1","addr":"172.21.15.142:6807","nonce":1064901393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":1064901393},{"type":"v1","addr":"172.21.15.142:6805","nonce":1064901393}]},"public_addr":"172.21.15.142:6801/1064901393","cluster_addr":"172.21.15.142:6803/1064901393","heartbeat_back_addr":"172.21.15.142:6807/1064901393","heartbeat_front_addr":"172.21.15.142:6805/1064901393","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-22T08:36:06.000852+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-22T08:36:06.991262+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-22T08:36:06.415953+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-22T08:36:05.868062+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-22T08:36:14.241 INFO:teuthology.misc.health.smithi031.stderr:2024-09-22T08:36:14.240+0000 7fafdafda640 1 -- 172.21.15.31:0/4015250718 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fafc003e710 msgr2=0x7fafc0040bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:14.241 INFO:teuthology.misc.health.smithi031.stderr:2024-09-22T08:36:14.240+0000 7fafdafda640 1 --2- 172.21.15.31:0/4015250718 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fafc003e710 0x7fafc0040bd0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fafc8034000 tx=0x7fafc802e000 comp rx=0 tx=0).stop 2024-09-22T08:36:14.241 INFO:teuthology.misc.health.smithi031.stderr:2024-09-22T08:36:14.240+0000 7fafdafda640 1 -- 172.21.15.31:0/4015250718 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fafd40721a0 msgr2=0x7fafd4122e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:14.241 INFO:teuthology.misc.health.smithi031.stderr:2024-09-22T08:36:14.240+0000 7fafdafda640 1 --2- 172.21.15.31:0/4015250718 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fafd40721a0 0x7fafd4122e40 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fafc400cb50 tx=0x7fafc400a430 comp rx=0 tx=0).stop 2024-09-22T08:36:14.241 INFO:teuthology.misc.health.smithi031.stderr:2024-09-22T08:36:14.240+0000 7fafdafda640 1 -- 172.21.15.31:0/4015250718 shutdown_connections 2024-09-22T08:36:14.242 INFO:teuthology.misc.health.smithi031.stderr:2024-09-22T08:36:14.240+0000 7fafdafda640 1 --2- 172.21.15.31:0/4015250718 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fafc003e710 0x7fafc0040bd0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:14.242 INFO:teuthology.misc.health.smithi031.stderr:2024-09-22T08:36:14.240+0000 7fafdafda640 1 --2- 172.21.15.31:0/4015250718 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fafd40721a0 0x7fafd4122e40 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:14.242 INFO:teuthology.misc.health.smithi031.stderr:2024-09-22T08:36:14.240+0000 7fafdafda640 1 -- 172.21.15.31:0/4015250718 >> 172.21.15.31:0/4015250718 conn(0x7fafd409ba10 msgr2=0x7fafd412b150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:14.242 INFO:teuthology.misc.health.smithi031.stderr:2024-09-22T08:36:14.240+0000 7fafdafda640 1 -- 172.21.15.31:0/4015250718 shutdown_connections 2024-09-22T08:36:14.242 INFO:teuthology.misc.health.smithi031.stderr:2024-09-22T08:36:14.240+0000 7fafdafda640 1 -- 172.21.15.31:0/4015250718 wait complete. 2024-09-22T08:36:14.251 DEBUG:teuthology.misc:4 of 4 OSDs are up 2024-09-22T08:36:14.251 INFO:tasks.ceph:Creating RBD pool 2024-09-22T08:36:14.251 DEBUG:teuthology.orchestra.run.smithi031:> sudo ceph --cluster ceph osd pool create rbd 8 2024-09-22T08:36:14.352 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:14.350+0000 7f4fe7d5d640 1 Processor -- start 2024-09-22T08:36:14.352 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:14.351+0000 7f4fe7d5d640 1 -- start start 2024-09-22T08:36:14.353 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:14.351+0000 7f4fe7d5d640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f4fe006ec60 0x7f4fe0132690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:14.353 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:14.351+0000 7f4fe7d5d640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4fe0099ee0 con 0x7f4fe006e170 2024-09-22T08:36:14.353 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:14.351+0000 7f4fe7d5d640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f4fe0072bb0 con 0x7f4fe006ec60 2024-09-22T08:36:14.353 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:14.351+0000 7f4fe52f8640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f4fe006ec60 0x7f4fe0132690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:14.353 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:14.351+0000 7f4fe5af9640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f4fe006e170 0x7f4fe006e550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:46800/0 (socket says 172.21.15.31:46800) 2024-09-22T08:36:14.354 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:14.351+0000 7f4fe5af9640 1 -- 172.21.15.31:0/2529730283 learned_addr learned my addr 172.21.15.31:0/2529730283 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-22T08:36:14.354 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:14.351+0000 7f4fe52f8640 1 -- 172.21.15.31:0/2529730283 >> v1:172.21.15.31:6789/0 conn(0x7f4fe006e170 legacy=0x7f4fe006e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:14.354 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:14.351+0000 7f4fe52f8640 1 -- 172.21.15.31:0/2529730283 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fe0063770 con 0x7f4fe006ec60 2024-09-22T08:36:14.356 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:14.352+0000 7f4fe52f8640 1 --2- 172.21.15.31:0/2529730283 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4fe006ec60 0x7f4fe0132690 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f4fd0009720 tx=0x7f4fd002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5980094063c0108c server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:14.356 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:14.352+0000 7f4fe4af7640 1 -- 172.21.15.31:0/2529730283 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4fd0037070 con 0x7f4fe006ec60 2024-09-22T08:36:14.356 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:14.352+0000 7f4fe4af7640 1 -- 172.21.15.31:0/2529730283 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4fd002ad90 con 0x7f4fe006ec60 2024-09-22T08:36:14.356 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:14.352+0000 7f4fe4af7640 1 -- 172.21.15.31:0/2529730283 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4fd0032590 con 0x7f4fe006ec60 2024-09-22T08:36:14.357 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:14.353+0000 7f4fe7d5d640 1 -- 172.21.15.31:0/2529730283 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4fe006ec60 msgr2=0x7f4fe0132690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:14.357 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:14.353+0000 7f4fe7d5d640 1 --2- 172.21.15.31:0/2529730283 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4fe006ec60 0x7f4fe0132690 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f4fd0009720 tx=0x7f4fd002a110 comp rx=0 tx=0).stop 2024-09-22T08:36:14.357 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:14.353+0000 7f4fe7d5d640 1 -- 172.21.15.31:0/2529730283 shutdown_connections 2024-09-22T08:36:14.357 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:14.353+0000 7f4fe7d5d640 1 --2- 172.21.15.31:0/2529730283 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4fe006ec60 0x7f4fe0132690 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:14.357 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:14.353+0000 7f4fe7d5d640 1 -- 172.21.15.31:0/2529730283 >> 172.21.15.31:0/2529730283 conn(0x7f4fe009ad00 msgr2=0x7f4fe0098550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:14.357 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:14.353+0000 7f4fe7d5d640 1 -- 172.21.15.31:0/2529730283 shutdown_connections 2024-09-22T08:36:14.357 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:14.353+0000 7f4fe7d5d640 1 -- 172.21.15.31:0/2529730283 wait complete. 2024-09-22T08:36:14.357 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:14.354+0000 7f4fe7d5d640 1 Processor -- start 2024-09-22T08:36:14.357 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:14.354+0000 7f4fe7d5d640 1 -- start start 2024-09-22T08:36:14.358 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:14.354+0000 7f4fe7d5d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4fe006e170 0x7f4fe0124360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:14.358 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:14.354+0000 7f4fe7d5d640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f4fe00716f0 con 0x7f4fe006e170 2024-09-22T08:36:14.358 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:14.354+0000 7f4fe5af9640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4fe006e170 0x7f4fe0124360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:14.358 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:14.354+0000 7f4fe5af9640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4fe006e170 0x7f4fe0124360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:37312/0 (socket says 172.21.15.31:37312) 2024-09-22T08:36:14.358 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:14.354+0000 7f4fe5af9640 1 -- 172.21.15.31:0/565884129 learned_addr learned my addr 172.21.15.31:0/565884129 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-22T08:36:14.358 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:14.354+0000 7f4fe5af9640 1 -- 172.21.15.31:0/565884129 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fe0126610 con 0x7f4fe006e170 2024-09-22T08:36:14.358 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:14.355+0000 7f4fe5af9640 1 --2- 172.21.15.31:0/565884129 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4fe006e170 0x7f4fe0124360 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f4fdc00c480 tx=0x7f4fdc00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:14.358 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:14.355+0000 7f4fd67fc640 1 -- 172.21.15.31:0/565884129 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4fdc017070 con 0x7f4fe006e170 2024-09-22T08:36:14.358 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:14.355+0000 7f4fd67fc640 1 -- 172.21.15.31:0/565884129 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4fdc005c10 con 0x7f4fe006e170 2024-09-22T08:36:14.358 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:14.355+0000 7f4fe7d5d640 1 -- 172.21.15.31:0/565884129 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4fe0127680 con 0x7f4fe006e170 2024-09-22T08:36:14.358 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:14.355+0000 7f4fd67fc640 1 -- 172.21.15.31:0/565884129 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4fdc007070 con 0x7f4fe006e170 2024-09-22T08:36:14.358 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:14.355+0000 7f4fe7d5d640 1 -- 172.21.15.31:0/565884129 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4fe0124a80 con 0x7f4fe006e170 2024-09-22T08:36:14.359 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:14.356+0000 7f4fd67fc640 1 -- 172.21.15.31:0/565884129 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f4fdc01a070 con 0x7f4fe006e170 2024-09-22T08:36:14.359 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:14.356+0000 7f4fe7d5d640 1 -- 172.21.15.31:0/565884129 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4fe006e550 con 0x7f4fe006e170 2024-09-22T08:36:14.359 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:14.356+0000 7f4fd67fc640 1 --2- 172.21.15.31:0/565884129 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f4fc403e710 0x7f4fc4040bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:14.360 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:14.356+0000 7f4fd67fc640 1 -- 172.21.15.31:0/565884129 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(13..13 src has 1..13) ==== 3129+0+0 (secure 0 0 0) 0x7f4fdc051e10 con 0x7f4fe006e170 2024-09-22T08:36:14.360 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:14.356+0000 7f4fe52f8640 1 --2- 172.21.15.31:0/565884129 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f4fc403e710 0x7f4fc4040bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:14.360 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:14.357+0000 7f4fe52f8640 1 --2- 172.21.15.31:0/565884129 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f4fc403e710 0x7f4fc4040bd0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f4fd0034000 tx=0x7f4fd002e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:14.361 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:14.361+0000 7f4fd67fc640 1 -- 172.21.15.31:0/565884129 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f4fdc019cd0 con 0x7f4fe006e170 2024-09-22T08:36:14.548 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:14.547+0000 7f4fe7d5d640 1 -- 172.21.15.31:0/565884129 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) -- 0x7f4fe0127190 con 0x7f4fe006e170 2024-09-22T08:36:15.418 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:15.417+0000 7f4fd67fc640 1 -- 172.21.15.31:0/565884129 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v14) ==== 109+0+0 (secure 0 0 0) 0x7f4fdc01b3b0 con 0x7f4fe006e170 2024-09-22T08:36:15.418 INFO:teuthology.orchestra.run.smithi031.stderr:pool 'rbd' created 2024-09-22T08:36:15.421 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:15.420+0000 7f4fe7d5d640 1 -- 172.21.15.31:0/565884129 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f4fc403e710 msgr2=0x7f4fc4040bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:15.421 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:15.420+0000 7f4fe7d5d640 1 --2- 172.21.15.31:0/565884129 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f4fc403e710 0x7f4fc4040bd0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f4fd0034000 tx=0x7f4fd002e000 comp rx=0 tx=0).stop 2024-09-22T08:36:15.422 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:15.420+0000 7f4fe7d5d640 1 -- 172.21.15.31:0/565884129 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4fe006e170 msgr2=0x7f4fe0124360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:15.422 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:15.420+0000 7f4fe7d5d640 1 --2- 172.21.15.31:0/565884129 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4fe006e170 0x7f4fe0124360 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f4fdc00c480 tx=0x7f4fdc00c940 comp rx=0 tx=0).stop 2024-09-22T08:36:15.422 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:15.420+0000 7f4fe7d5d640 1 -- 172.21.15.31:0/565884129 shutdown_connections 2024-09-22T08:36:15.422 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:15.420+0000 7f4fe7d5d640 1 --2- 172.21.15.31:0/565884129 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f4fc403e710 0x7f4fc4040bd0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:15.422 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:15.420+0000 7f4fe7d5d640 1 --2- 172.21.15.31:0/565884129 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4fe006e170 0x7f4fe0124360 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:15.422 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:15.420+0000 7f4fe7d5d640 1 -- 172.21.15.31:0/565884129 >> 172.21.15.31:0/565884129 conn(0x7f4fe009ad00 msgr2=0x7f4fe00968c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:15.422 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:15.420+0000 7f4fe7d5d640 1 -- 172.21.15.31:0/565884129 shutdown_connections 2024-09-22T08:36:15.422 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:15.420+0000 7f4fe7d5d640 1 -- 172.21.15.31:0/565884129 wait complete. 2024-09-22T08:36:15.435 DEBUG:teuthology.orchestra.run.smithi031:> rbd --cluster ceph pool init rbd 2024-09-22T08:36:15.498 INFO:teuthology.orchestra.run.smithi031.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:36:15.498 INFO:teuthology.orchestra.run.smithi031.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:36:15.499 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:15.498+0000 7fed38a1e140 1 Processor -- start 2024-09-22T08:36:15.499 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:15.498+0000 7fed38a1e140 1 -- start start 2024-09-22T08:36:15.500 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:15.498+0000 7fed38a1e140 1 --2- >> v2:172.21.15.31:3300/0 conn(0x560242209a00 0x560242209de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:15.500 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:15.498+0000 7fed38a1e140 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x560241fe67d0 con 0x56024217cb60 2024-09-22T08:36:15.500 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:15.498+0000 7fed38a1e140 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x56024204d0c0 con 0x560242209a00 2024-09-22T08:36:15.500 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:15.498+0000 7fed37509640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x560242209a00 0x560242209de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:15.500 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:15.499+0000 7fed36d08640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x56024217cb60 0x560242206840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:46804/0 (socket says 172.21.15.31:46804) 2024-09-22T08:36:15.500 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:15.499+0000 7fed36d08640 1 -- 172.21.15.31:0/4003294155 learned_addr learned my addr 172.21.15.31:0/4003294155 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-22T08:36:15.500 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:15.499+0000 7fed37509640 1 -- 172.21.15.31:0/4003294155 >> v1:172.21.15.31:6789/0 conn(0x56024217cb60 legacy=0x560242206840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:15.500 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:15.499+0000 7fed37509640 1 -- 172.21.15.31:0/4003294155 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x560242014410 con 0x560242209a00 2024-09-22T08:36:15.502 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:15.501+0000 7fed37509640 1 --2- 172.21.15.31:0/4003294155 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560242209a00 0x560242209de0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fed28005fd0 tx=0x7fed28045c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ddd83b0fc6c0473 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:15.502 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:15.501+0000 7fed36507640 1 -- 172.21.15.31:0/4003294155 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fed28058530 con 0x560242209a00 2024-09-22T08:36:15.502 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:15.501+0000 7fed36507640 1 -- 172.21.15.31:0/4003294155 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed280586d0 con 0x560242209a00 2024-09-22T08:36:15.502 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:15.501+0000 7fed36507640 1 -- 172.21.15.31:0/4003294155 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fed280589d0 con 0x560242209a00 2024-09-22T08:36:15.503 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:15.501+0000 7fed38a1e140 1 -- 172.21.15.31:0/4003294155 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560242209a00 msgr2=0x560242209de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:15.503 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:15.501+0000 7fed38a1e140 1 --2- 172.21.15.31:0/4003294155 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560242209a00 0x560242209de0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fed28005fd0 tx=0x7fed28045c30 comp rx=0 tx=0).stop 2024-09-22T08:36:15.503 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:15.501+0000 7fed38a1e140 1 -- 172.21.15.31:0/4003294155 shutdown_connections 2024-09-22T08:36:15.503 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:15.501+0000 7fed38a1e140 1 --2- 172.21.15.31:0/4003294155 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560242209a00 0x560242209de0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:15.503 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:15.502+0000 7fed38a1e140 1 -- 172.21.15.31:0/4003294155 >> 172.21.15.31:0/4003294155 conn(0x560242179210 msgr2=0x56024217c050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:15.503 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:15.502+0000 7fed38a1e140 1 -- 172.21.15.31:0/4003294155 shutdown_connections 2024-09-22T08:36:15.503 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:15.502+0000 7fed38a1e140 1 -- 172.21.15.31:0/4003294155 wait complete. 2024-09-22T08:36:15.504 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:15.502+0000 7fed38a1e140 1 Processor -- start 2024-09-22T08:36:15.505 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:15.503+0000 7fed38a1e140 1 -- start start 2024-09-22T08:36:15.505 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:15.503+0000 7fed38a1e140 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56024217cb60 0x560242218420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:15.505 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:15.503+0000 7fed38a1e140 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x560242051100 con 0x56024217cb60 2024-09-22T08:36:15.505 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:15.503+0000 7fed37509640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56024217cb60 0x560242218420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:15.505 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:15.503+0000 7fed37509640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56024217cb60 0x560242218420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:37322/0 (socket says 172.21.15.31:37322) 2024-09-22T08:36:15.505 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:15.503+0000 7fed37509640 1 -- 172.21.15.31:0/1065556609 learned_addr learned my addr 172.21.15.31:0/1065556609 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-22T08:36:15.505 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:15.503+0000 7fed37509640 1 -- 172.21.15.31:0/1065556609 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560241fcb720 con 0x56024217cb60 2024-09-22T08:36:15.505 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:15.504+0000 7fed37509640 1 --2- 172.21.15.31:0/1065556609 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56024217cb60 0x560242218420 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fed28025a60 tx=0x7fed28003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:15.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:15.504+0000 7fed277fe640 1 -- 172.21.15.31:0/1065556609 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fed28058530 con 0x56024217cb60 2024-09-22T08:36:15.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:15.504+0000 7fed277fe640 1 -- 172.21.15.31:0/1065556609 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed28068070 con 0x56024217cb60 2024-09-22T08:36:15.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:15.504+0000 7fed38a1e140 1 -- 172.21.15.31:0/1065556609 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560242202000 con 0x56024217cb60 2024-09-22T08:36:15.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:15.504+0000 7fed277fe640 1 -- 172.21.15.31:0/1065556609 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fed28063570 con 0x56024217cb60 2024-09-22T08:36:15.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:15.504+0000 7fed38a1e140 1 -- 172.21.15.31:0/1065556609 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560242201300 con 0x56024217cb60 2024-09-22T08:36:15.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:15.505+0000 7fed277fe640 1 -- 172.21.15.31:0/1065556609 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fed28063710 con 0x56024217cb60 2024-09-22T08:36:15.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:15.505+0000 7fed277fe640 1 --2- 172.21.15.31:0/1065556609 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fed1c03d000 0x7fed1c03f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:15.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:15.505+0000 7fed277fe640 1 -- 172.21.15.31:0/1065556609 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 3471+0+0 (secure 0 0 0) 0x7fed28095e00 con 0x56024217cb60 2024-09-22T08:36:15.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:15.505+0000 7fed38a1e140 1 -- 172.21.15.31:0/1065556609 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool application enable","pool": "rbd","app": "rbd"} v 0) -- 0x560242218960 con 0x56024217cb60 2024-09-22T08:36:15.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:15.506+0000 7fed36d08640 1 --2- 172.21.15.31:0/1065556609 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fed1c03d000 0x7fed1c03f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:15.508 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:15.506+0000 7fed36d08640 1 --2- 172.21.15.31:0/1065556609 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fed1c03d000 0x7fed1c03f4c0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fed2c001d70 tx=0x7fed2c0012d0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:16.419 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:16.418+0000 7fed277fe640 1 -- 172.21.15.31:0/1065556609 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "osd pool application enable","pool": "rbd","app": "rbd"}]=0 enabled application 'rbd' on pool 'rbd' v15) ==== 141+0+0 (secure 0 0 0) 0x560242202000 con 0x56024217cb60 2024-09-22T08:36:16.419 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:16.418+0000 7fed38a1e140 1 -- 172.21.15.31:0/1065556609 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fed280586d0 con 0x56024217cb60 2024-09-22T08:36:16.422 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:16.421+0000 7fed277fe640 1 -- 172.21.15.31:0/1065556609 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (secure 0 0 0) 0x7fed2804ed80 con 0x56024217cb60 2024-09-22T08:36:16.422 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:16.421+0000 7fed35d06640 1 -- 172.21.15.31:0/1065556609 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=15}) -- 0x7fed14002ae0 con 0x56024217cb60 2024-09-22T08:36:16.427 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:16.423+0000 7fed277fe640 1 -- 172.21.15.31:0/1065556609 <== mon.0 v2:172.21.15.31:3300/0 8 ==== osd_map(15..15 src has 1..15) ==== 650+0+0 (secure 0 0 0) 0x7fed2806dd10 con 0x56024217cb60 2024-09-22T08:36:16.427 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:16.423+0000 7fed38a1e140 1 --2- 172.21.15.31:0/1065556609 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x560242209a00 0x56024221c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:16.427 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:16.423+0000 7fed38a1e140 1 -- 172.21.15.31:0/1065556609 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15) -- 0x560242220a60 con 0x560242209a00 2024-09-22T08:36:16.427 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:16.424+0000 7fed3876b640 1 --2- 172.21.15.31:0/1065556609 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x560242209a00 0x56024221c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:16.427 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:16.425+0000 7fed3876b640 1 --2- 172.21.15.31:0/1065556609 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x560242209a00 0x56024221c0a0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:16.428 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:16.427+0000 7fed3876b640 1 -- 172.21.15.31:0/1065556609 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(1 rbd_trash [create] v15'1 uv1 ondisk = 0) ==== 153+0+0 (crc 0 0 0) 0x7fed3000c430 con 0x560242209a00 2024-09-22T08:36:16.430 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:16.430+0000 7fed38a1e140 1 -- 172.21.15.31:0/1065556609 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:2 2.2 2:5cea7035:::rbd_info:head [call rbd.metadata_list in=33b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e15) -- 0x560242273100 con 0x560242209a00 2024-09-22T08:36:16.431 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:16.430+0000 7fed3876b640 1 -- 172.21.15.31:0/1065556609 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(2 rbd_info [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fed3000c430 con 0x560242209a00 2024-09-22T08:36:16.431 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:16.430+0000 7fed38a1e140 1 -- 172.21.15.31:0/1065556609 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:3 2.2 2:5cea7035:::rbd_info:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e15) -- 0x560242272210 con 0x560242209a00 2024-09-22T08:36:16.431 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:16.430+0000 7fed3876b640 1 -- 172.21.15.31:0/1065556609 <== osd.3 v2:172.21.15.142:6800/1064901393 3 ==== osd_op_reply(3 rbd_info [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fed3000c430 con 0x560242209a00 2024-09-22T08:36:16.432 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:16.430+0000 7fed35505640 1 -- 172.21.15.31:0/1065556609 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- pool_op(create unmanaged snap pool 2 tid 4 name v0) -- 0x7fed18001f00 con 0x56024217cb60 2024-09-22T08:36:17.427 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:17.425+0000 7fed277fe640 1 -- 172.21.15.31:0/1065556609 <== mon.0 v2:172.21.15.31:3300/0 9 ==== pool_op_reply(tid 4 (0) Success v16) ==== 55+0+0 (secure 0 0 0) 0x7fed28086020 con 0x56024217cb60 2024-09-22T08:36:17.427 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:17.425+0000 7fed277fe640 1 -- 172.21.15.31:0/1065556609 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=16}) -- 0x7fed1c042c60 con 0x56024217cb60 2024-09-22T08:36:17.427 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:17.426+0000 7fed277fe640 1 -- 172.21.15.31:0/1065556609 <== mon.0 v2:172.21.15.31:3300/0 10 ==== osd_map(16..16 src has 1..16) ==== 626+0+0 (secure 0 0 0) 0x7fed2806d980 con 0x56024217cb60 2024-09-22T08:36:17.427 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:17.426+0000 7fed35d06640 1 -- 172.21.15.31:0/1065556609 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 2.2 2:5cea7035:::rbd_info:head [create,write 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16) -- 0x7fed14005780 con 0x560242209a00 2024-09-22T08:36:17.431 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:17.429+0000 7fed3876b640 1 -- 172.21.15.31:0/1065556609 <== osd.3 v2:172.21.15.142:6800/1064901393 4 ==== osd_op_reply(5 rbd_info [create,write 0~8] v16'1 uv1 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fed3000c430 con 0x560242209a00 2024-09-22T08:36:17.431 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:17.429+0000 7fed35505640 1 -- 172.21.15.31:0/1065556609 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- pool_op(delete unmanaged snap pool 2 tid 6 name v16) -- 0x7fed18003350 con 0x56024217cb60 2024-09-22T08:36:18.429 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:18.428+0000 7fed277fe640 1 -- 172.21.15.31:0/1065556609 <== mon.0 v2:172.21.15.31:3300/0 11 ==== pool_op_reply(tid 6 (0) Success v17) ==== 43+0+0 (secure 0 0 0) 0x7fed2808f020 con 0x56024217cb60 2024-09-22T08:36:18.430 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:18.428+0000 7fed277fe640 1 -- 172.21.15.31:0/1065556609 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=17}) -- 0x7fed1c042ee0 con 0x56024217cb60 2024-09-22T08:36:18.430 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:18.428+0000 7fed277fe640 1 -- 172.21.15.31:0/1065556609 <== mon.0 v2:172.21.15.31:3300/0 12 ==== osd_map(17..17 src has 1..17) ==== 654+0+0 (secure 0 0 0) 0x7fed28063a00 con 0x56024217cb60 2024-09-22T08:36:18.430 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:18.428+0000 7fed35d06640 1 -- 172.21.15.31:0/1065556609 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19 in=19b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17) -- 0x7fed14005b40 con 0x560242209a00 2024-09-22T08:36:18.435 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:18.434+0000 7fed3876b640 1 -- 172.21.15.31:0/1065556609 <== osd.3 v2:172.21.15.142:6800/1064901393 5 ==== osd_op_reply(7 rbd_info [write 0~19] v17'2 uv2 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fed3000c430 con 0x560242209a00 2024-09-22T08:36:18.436 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:18.434+0000 7fed38a1e140 1 -- 172.21.15.31:0/1065556609 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x560242209a00 msgr2=0x56024221c0a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:18.436 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:18.434+0000 7fed38a1e140 1 --2- 172.21.15.31:0/1065556609 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x560242209a00 0x56024221c0a0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:18.436 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:18.434+0000 7fed38a1e140 1 -- 172.21.15.31:0/1065556609 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fed1c03d000 msgr2=0x7fed1c03f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:18.436 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:18.434+0000 7fed38a1e140 1 --2- 172.21.15.31:0/1065556609 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fed1c03d000 0x7fed1c03f4c0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fed2c001d70 tx=0x7fed2c0012d0 comp rx=0 tx=0).stop 2024-09-22T08:36:18.436 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:18.434+0000 7fed38a1e140 1 -- 172.21.15.31:0/1065556609 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56024217cb60 msgr2=0x560242218420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:18.436 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:18.434+0000 7fed38a1e140 1 --2- 172.21.15.31:0/1065556609 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56024217cb60 0x560242218420 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fed28025a60 tx=0x7fed28003330 comp rx=0 tx=0).stop 2024-09-22T08:36:18.436 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:18.434+0000 7fed38a1e140 1 -- 172.21.15.31:0/1065556609 shutdown_connections 2024-09-22T08:36:18.436 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:18.434+0000 7fed38a1e140 1 --2- 172.21.15.31:0/1065556609 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x560242209a00 0x56024221c0a0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:18.436 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:18.434+0000 7fed38a1e140 1 --2- 172.21.15.31:0/1065556609 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fed1c03d000 0x7fed1c03f4c0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:18.436 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:18.434+0000 7fed38a1e140 1 --2- 172.21.15.31:0/1065556609 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56024217cb60 0x560242218420 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:18.437 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:18.434+0000 7fed38a1e140 1 -- 172.21.15.31:0/1065556609 >> 172.21.15.31:0/1065556609 conn(0x560242179210 msgr2=0x5602421f4710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:18.437 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:18.434+0000 7fed38a1e140 1 -- 172.21.15.31:0/1065556609 shutdown_connections 2024-09-22T08:36:18.437 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:18.434+0000 7fed38a1e140 1 -- 172.21.15.31:0/1065556609 wait complete. 2024-09-22T08:36:18.441 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-22T08:36:18.441 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2024-09-22T08:36:18.442 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-22T08:36:18.556 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:18.554+0000 7fb221364640 1 Processor -- start 2024-09-22T08:36:18.557 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:18.554+0000 7fb221364640 1 -- start start 2024-09-22T08:36:18.557 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:18.555+0000 7fb221364640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fb21c096b90 0x7fb21c0973f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:18.557 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:18.555+0000 7fb221364640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb21c0994f0 con 0x7fb21c097930 2024-09-22T08:36:18.557 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:18.555+0000 7fb221364640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7fb21c099790 con 0x7fb21c096b90 2024-09-22T08:36:18.557 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:18.555+0000 7fb21affd640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fb21c096b90 0x7fb21c0973f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:18.557 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:18.555+0000 7fb21a7fc640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fb21c097930 0x7fb21c133e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:60226/0 (socket says 172.21.15.31:60226) 2024-09-22T08:36:18.558 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:18.555+0000 7fb21a7fc640 1 -- 172.21.15.31:0/2656709665 learned_addr learned my addr 172.21.15.31:0/2656709665 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-22T08:36:18.558 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:18.555+0000 7fb219ffb640 1 -- 172.21.15.31:0/2656709665 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3098223396 0 0) 0x7fb210001110 con 0x7fb21c097930 2024-09-22T08:36:18.558 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:18.555+0000 7fb219ffb640 1 -- 172.21.15.31:0/2656709665 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb204003520 con 0x7fb21c097930 2024-09-22T08:36:18.558 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:18.555+0000 7fb21affd640 1 -- 172.21.15.31:0/2656709665 >> v1:172.21.15.31:6789/0 conn(0x7fb21c097930 legacy=0x7fb21c133e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:18.558 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:18.555+0000 7fb21affd640 1 -- 172.21.15.31:0/2656709665 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb21c098dc0 con 0x7fb21c096b90 2024-09-22T08:36:18.559 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:18.556+0000 7fb21affd640 1 --2- 172.21.15.31:0/2656709665 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb21c096b90 0x7fb21c0973f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb20c009720 tx=0x7fb20c02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24e97e172704e0cf server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:18.560 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:18.556+0000 7fb219ffb640 1 -- 172.21.15.31:0/2656709665 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb20c037070 con 0x7fb21c096b90 2024-09-22T08:36:18.560 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:18.556+0000 7fb219ffb640 1 -- 172.21.15.31:0/2656709665 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb20c02ad90 con 0x7fb21c096b90 2024-09-22T08:36:18.560 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:18.556+0000 7fb219ffb640 1 -- 172.21.15.31:0/2656709665 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb20c032590 con 0x7fb21c096b90 2024-09-22T08:36:18.560 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:18.556+0000 7fb221364640 1 -- 172.21.15.31:0/2656709665 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb21c096b90 msgr2=0x7fb21c0973f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:18.560 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:18.556+0000 7fb221364640 1 --2- 172.21.15.31:0/2656709665 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb21c096b90 0x7fb21c0973f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb20c009720 tx=0x7fb20c02a110 comp rx=0 tx=0).stop 2024-09-22T08:36:18.560 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:18.557+0000 7fb221364640 1 -- 172.21.15.31:0/2656709665 shutdown_connections 2024-09-22T08:36:18.560 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:18.557+0000 7fb221364640 1 --2- 172.21.15.31:0/2656709665 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb21c096b90 0x7fb21c0973f0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:18.560 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:18.557+0000 7fb221364640 1 -- 172.21.15.31:0/2656709665 >> 172.21.15.31:0/2656709665 conn(0x7fb21c09ddc0 msgr2=0x7fb21c09e1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:18.560 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:18.557+0000 7fb221364640 1 -- 172.21.15.31:0/2656709665 shutdown_connections 2024-09-22T08:36:18.560 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:18.557+0000 7fb221364640 1 -- 172.21.15.31:0/2656709665 wait complete. 2024-09-22T08:36:18.560 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:18.558+0000 7fb221364640 1 Processor -- start 2024-09-22T08:36:18.560 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:18.558+0000 7fb221364640 1 -- start start 2024-09-22T08:36:18.560 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:18.558+0000 7fb221364640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb21c096b90 0x7fb21c0716d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:18.560 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:18.558+0000 7fb221364640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fb21c0980f0 con 0x7fb21c096b90 2024-09-22T08:36:18.561 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:18.558+0000 7fb21affd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb21c096b90 0x7fb21c0716d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:18.561 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:18.558+0000 7fb21affd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb21c096b90 0x7fb21c0716d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:48280/0 (socket says 172.21.15.31:48280) 2024-09-22T08:36:18.561 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:18.558+0000 7fb21affd640 1 -- 172.21.15.31:0/239973864 learned_addr learned my addr 172.21.15.31:0/239973864 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-22T08:36:18.561 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:18.559+0000 7fb21affd640 1 -- 172.21.15.31:0/239973864 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb21c1b58c0 con 0x7fb21c096b90 2024-09-22T08:36:18.562 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:18.559+0000 7fb21affd640 1 --2- 172.21.15.31:0/239973864 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb21c096b90 0x7fb21c0716d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb20c009720 tx=0x7fb20c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:18.562 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:18.559+0000 7fb2037fe640 1 -- 172.21.15.31:0/239973864 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb20c041070 con 0x7fb21c096b90 2024-09-22T08:36:18.562 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:18.559+0000 7fb2037fe640 1 -- 172.21.15.31:0/239973864 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb20c03c460 con 0x7fb21c096b90 2024-09-22T08:36:18.562 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:18.559+0000 7fb221364640 1 -- 172.21.15.31:0/239973864 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb21c073c30 con 0x7fb21c096b90 2024-09-22T08:36:18.562 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:18.559+0000 7fb2037fe640 1 -- 172.21.15.31:0/239973864 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb20c037040 con 0x7fb21c096b90 2024-09-22T08:36:18.562 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:18.559+0000 7fb221364640 1 -- 172.21.15.31:0/239973864 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb21c1a9f00 con 0x7fb21c096b90 2024-09-22T08:36:18.563 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:18.560+0000 7fb2037fe640 1 -- 172.21.15.31:0/239973864 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fb20c044070 con 0x7fb21c096b90 2024-09-22T08:36:18.563 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:18.560+0000 7fb221364640 1 -- 172.21.15.31:0/239973864 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb21c0973f0 con 0x7fb21c096b90 2024-09-22T08:36:18.563 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:18.560+0000 7fb2037fe640 1 --2- 172.21.15.31:0/239973864 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fb20803e710 0x7fb208040bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:18.563 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:18.560+0000 7fb2037fe640 1 -- 172.21.15.31:0/239973864 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7fb20c073400 con 0x7fb21c096b90 2024-09-22T08:36:18.563 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:18.561+0000 7fb21a7fc640 1 --2- 172.21.15.31:0/239973864 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fb20803e710 0x7fb208040bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:18.563 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:18.561+0000 7fb21a7fc640 1 --2- 172.21.15.31:0/239973864 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fb20803e710 0x7fb208040bd0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fb210005880 tx=0x7fb210001270 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:18.566 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:18.565+0000 7fb2037fe640 1 -- 172.21.15.31:0/239973864 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fb20c03c760 con 0x7fb21c096b90 2024-09-22T08:36:18.752 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:18.751+0000 7fb221364640 1 -- 172.21.15.31:0/239973864 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) -- 0x7fb21c072890 con 0x7fb21c096b90 2024-09-22T08:36:18.753 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:18.752+0000 7fb2037fe640 1 -- 172.21.15.31:0/239973864 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v5) ==== 86+0+159 (secure 0 0 0) 0x7fb21c072890 con 0x7fb21c096b90 2024-09-22T08:36:18.753 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-22T08:36:18.755 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:18.754+0000 7fb221364640 1 -- 172.21.15.31:0/239973864 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fb20803e710 msgr2=0x7fb208040bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:18.756 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:18.754+0000 7fb221364640 1 --2- 172.21.15.31:0/239973864 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fb20803e710 0x7fb208040bd0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fb210005880 tx=0x7fb210001270 comp rx=0 tx=0).stop 2024-09-22T08:36:18.756 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:18.754+0000 7fb221364640 1 -- 172.21.15.31:0/239973864 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb21c096b90 msgr2=0x7fb21c0716d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:18.756 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:18.754+0000 7fb221364640 1 --2- 172.21.15.31:0/239973864 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb21c096b90 0x7fb21c0716d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb20c009720 tx=0x7fb20c0046c0 comp rx=0 tx=0).stop 2024-09-22T08:36:18.756 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:18.754+0000 7fb221364640 1 -- 172.21.15.31:0/239973864 shutdown_connections 2024-09-22T08:36:18.756 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:18.754+0000 7fb221364640 1 --2- 172.21.15.31:0/239973864 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fb20803e710 0x7fb208040bd0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:18.756 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:18.754+0000 7fb221364640 1 --2- 172.21.15.31:0/239973864 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb21c096b90 0x7fb21c0716d0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:18.756 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:18.754+0000 7fb221364640 1 -- 172.21.15.31:0/239973864 >> 172.21.15.31:0/239973864 conn(0x7fb21c09ddc0 msgr2=0x7fb21c09af60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:18.756 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:18.754+0000 7fb221364640 1 -- 172.21.15.31:0/239973864 shutdown_connections 2024-09-22T08:36:18.756 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:18.754+0000 7fb221364640 1 -- 172.21.15.31:0/239973864 wait complete. 2024-09-22T08:36:18.766 INFO:teuthology.orchestra.run.smithi031.stdout:[{"version":5,"timestamp":"2024-09-22T08:36:08.457107+0000","name":"","changes":[{"name":"osd.2/osd_mclock_max_capacity_iops_ssd","new_value":"5978.161167"}]}] 2024-09-22T08:36:18.766 INFO:tasks.ceph_manager:config epoch is 5 2024-09-22T08:36:18.766 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-22T08:36:18.767 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-22T08:36:18.767 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-22T08:36:18.868 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:18.867+0000 7f417d9f8640 1 Processor -- start 2024-09-22T08:36:18.869 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:18.867+0000 7f417d9f8640 1 -- start start 2024-09-22T08:36:18.869 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:18.867+0000 7f417d9f8640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f4178071e30 0x7f4178132790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:18.869 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:18.867+0000 7f417d9f8640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4178071770 con 0x7f417806e170 2024-09-22T08:36:18.869 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:18.867+0000 7f417d9f8640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f4178099ee0 con 0x7f4178071e30 2024-09-22T08:36:18.869 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:18.867+0000 7f41767fc640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f4178071e30 0x7f4178132790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:18.869 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:18.867+0000 7f4176ffd640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f417806e170 0x7f417806e550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:60242/0 (socket says 172.21.15.31:60242) 2024-09-22T08:36:18.869 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:18.867+0000 7f4176ffd640 1 -- 172.21.15.31:0/2423969353 learned_addr learned my addr 172.21.15.31:0/2423969353 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-22T08:36:18.869 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:18.868+0000 7f41767fc640 1 -- 172.21.15.31:0/2423969353 >> v1:172.21.15.31:6789/0 conn(0x7f417806e170 legacy=0x7f417806e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:18.869 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:18.868+0000 7f41767fc640 1 -- 172.21.15.31:0/2423969353 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4178072530 con 0x7f4178071e30 2024-09-22T08:36:18.869 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:18.868+0000 7f4175ffb640 1 -- 172.21.15.31:0/2423969353 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2567609797 0 0) 0x7f4178071770 con 0x7f417806e170 2024-09-22T08:36:18.870 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:18.868+0000 7f41767fc640 1 --2- 172.21.15.31:0/2423969353 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4178071e30 0x7f4178132790 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f416c009750 tx=0x7f416c02a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5df7d680fc696b46 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:18.871 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:18.868+0000 7f4175ffb640 1 -- 172.21.15.31:0/2423969353 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f416c037070 con 0x7f4178071e30 2024-09-22T08:36:18.871 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:18.868+0000 7f4175ffb640 1 -- 172.21.15.31:0/2423969353 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f416c02ad80 con 0x7f4178071e30 2024-09-22T08:36:18.871 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:18.869+0000 7f4175ffb640 1 -- 172.21.15.31:0/2423969353 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f416c032590 con 0x7f4178071e30 2024-09-22T08:36:18.871 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:18.869+0000 7f417d9f8640 1 -- 172.21.15.31:0/2423969353 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4178071e30 msgr2=0x7f4178132790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:18.871 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:18.869+0000 7f417d9f8640 1 --2- 172.21.15.31:0/2423969353 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4178071e30 0x7f4178132790 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f416c009750 tx=0x7f416c02a140 comp rx=0 tx=0).stop 2024-09-22T08:36:18.871 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:18.869+0000 7f417d9f8640 1 -- 172.21.15.31:0/2423969353 shutdown_connections 2024-09-22T08:36:18.871 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:18.869+0000 7f417d9f8640 1 --2- 172.21.15.31:0/2423969353 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4178071e30 0x7f4178132790 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:18.871 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:18.869+0000 7f417d9f8640 1 -- 172.21.15.31:0/2423969353 >> 172.21.15.31:0/2423969353 conn(0x7f417809ac80 msgr2=0x7f4178098550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:18.871 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:18.869+0000 7f417d9f8640 1 -- 172.21.15.31:0/2423969353 shutdown_connections 2024-09-22T08:36:18.871 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:18.869+0000 7f417d9f8640 1 -- 172.21.15.31:0/2423969353 wait complete. 2024-09-22T08:36:18.872 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:18.870+0000 7f417d9f8640 1 Processor -- start 2024-09-22T08:36:18.873 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:18.870+0000 7f417d9f8640 1 -- start start 2024-09-22T08:36:18.873 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:18.870+0000 7f417d9f8640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f417806e170 0x7f4178097400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:18.873 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:18.870+0000 7f417d9f8640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f417806ee70 con 0x7f417806e170 2024-09-22T08:36:18.873 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:18.871+0000 7f4176ffd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f417806e170 0x7f4178097400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:18.873 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:18.871+0000 7f4176ffd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f417806e170 0x7f4178097400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:48292/0 (socket says 172.21.15.31:48292) 2024-09-22T08:36:18.873 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:18.871+0000 7f4176ffd640 1 -- 172.21.15.31:0/3645643981 learned_addr learned my addr 172.21.15.31:0/3645643981 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-22T08:36:18.873 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:18.871+0000 7f4176ffd640 1 -- 172.21.15.31:0/3645643981 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f417812a490 con 0x7f417806e170 2024-09-22T08:36:18.873 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:18.871+0000 7f4176ffd640 1 --2- 172.21.15.31:0/3645643981 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f417806e170 0x7f4178097400 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f416800c3d0 tx=0x7f416800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:18.873 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:18.871+0000 7f415ffff640 1 -- 172.21.15.31:0/3645643981 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f41680074d0 con 0x7f417806e170 2024-09-22T08:36:18.873 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:18.871+0000 7f415ffff640 1 -- 172.21.15.31:0/3645643981 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41680047e0 con 0x7f417806e170 2024-09-22T08:36:18.873 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:18.871+0000 7f415ffff640 1 -- 172.21.15.31:0/3645643981 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4168007670 con 0x7f417806e170 2024-09-22T08:36:18.873 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:18.871+0000 7f417d9f8640 1 -- 172.21.15.31:0/3645643981 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f417806f390 con 0x7f417806e170 2024-09-22T08:36:18.873 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:18.871+0000 7f417d9f8640 1 -- 172.21.15.31:0/3645643981 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f417808c4f0 con 0x7f417806e170 2024-09-22T08:36:18.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:18.872+0000 7f415ffff640 1 -- 172.21.15.31:0/3645643981 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f4168011070 con 0x7f417806e170 2024-09-22T08:36:18.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:18.872+0000 7f417d9f8640 1 -- 172.21.15.31:0/3645643981 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f417806e550 con 0x7f417806e170 2024-09-22T08:36:18.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:18.872+0000 7f415ffff640 1 --2- 172.21.15.31:0/3645643981 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f416403e710 0x7f4164040bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:18.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:18.873+0000 7f415ffff640 1 -- 172.21.15.31:0/3645643981 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7f4168052a00 con 0x7f417806e170 2024-09-22T08:36:18.875 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:18.873+0000 7f41767fc640 1 --2- 172.21.15.31:0/3645643981 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f416403e710 0x7f4164040bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:18.875 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:18.873+0000 7f41767fc640 1 --2- 172.21.15.31:0/3645643981 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f416403e710 0x7f4164040bd0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f416c034000 tx=0x7f416c02e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:18.878 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:18.877+0000 7f415ffff640 1 -- 172.21.15.31:0/3645643981 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f4168012dd0 con 0x7f417806e170 2024-09-22T08:36:19.116 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.115+0000 7f417d9f8640 1 -- 172.21.15.31:0/3645643981 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f4178076560 con 0x7f417806e170 2024-09-22T08:36:19.118 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.116+0000 7f415ffff640 1 -- 172.21.15.31:0/3645643981 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+98088 (secure 0 0 0) 0x7f416801cdc0 con 0x7f417806e170 2024-09-22T08:36:19.119 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-22T08:36:19.120 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.119+0000 7f417d9f8640 1 -- 172.21.15.31:0/3645643981 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f416403e710 msgr2=0x7f4164040bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:19.121 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.119+0000 7f417d9f8640 1 --2- 172.21.15.31:0/3645643981 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f416403e710 0x7f4164040bd0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f416c034000 tx=0x7f416c02e000 comp rx=0 tx=0).stop 2024-09-22T08:36:19.121 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.119+0000 7f417d9f8640 1 -- 172.21.15.31:0/3645643981 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f417806e170 msgr2=0x7f4178097400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:19.121 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.119+0000 7f417d9f8640 1 --2- 172.21.15.31:0/3645643981 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f417806e170 0x7f4178097400 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f416800c3d0 tx=0x7f416800c890 comp rx=0 tx=0).stop 2024-09-22T08:36:19.121 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.119+0000 7f417d9f8640 1 -- 172.21.15.31:0/3645643981 shutdown_connections 2024-09-22T08:36:19.121 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.119+0000 7f417d9f8640 1 --2- 172.21.15.31:0/3645643981 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f416403e710 0x7f4164040bd0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:19.121 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.119+0000 7f417d9f8640 1 --2- 172.21.15.31:0/3645643981 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f417806e170 0x7f4178097400 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:19.121 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.119+0000 7f417d9f8640 1 -- 172.21.15.31:0/3645643981 >> 172.21.15.31:0/3645643981 conn(0x7f417809ac80 msgr2=0x7f417812e770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:19.121 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.119+0000 7f417d9f8640 1 -- 172.21.15.31:0/3645643981 shutdown_connections 2024-09-22T08:36:19.121 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.119+0000 7f417d9f8640 1 -- 172.21.15.31:0/3645643981 wait complete. 2024-09-22T08:36:19.131 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":5,"flags":0,"active_gid":4099,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":99931088},{"type":"v1","addr":"172.21.15.142:6825","nonce":99931088}]},"active_addr":"172.21.15.142:6825/99931088","active_change":"2024-09-22T08:36:03.138489+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.8","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.142:0","nonce":1305873074}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.142:0","nonce":2010520900}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.142:0","nonce":1605653415}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.142:0","nonce":916653737}]}]} 2024-09-22T08:36:19.135 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-22T08:36:19.135 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-22T08:36:19.135 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-22T08:36:19.236 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.234+0000 7f52a37e2640 1 Processor -- start 2024-09-22T08:36:19.236 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.235+0000 7f52a37e2640 1 -- start start 2024-09-22T08:36:19.237 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.235+0000 7f52a37e2640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f529c06fd70 0x7f529c131660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:19.237 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.235+0000 7f52a37e2640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f529c099ee0 con 0x7f529c06f280 2024-09-22T08:36:19.237 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.235+0000 7f52a37e2640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f529c070d00 con 0x7f529c06fd70 2024-09-22T08:36:19.237 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.235+0000 7f52a0d7d640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f529c06fd70 0x7f529c131660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:19.237 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.235+0000 7f52a157e640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f529c06f280 0x7f529c06f660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:60254/0 (socket says 172.21.15.31:60254) 2024-09-22T08:36:19.237 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.235+0000 7f52a157e640 1 -- 172.21.15.31:0/2152106278 learned_addr learned my addr 172.21.15.31:0/2152106278 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-22T08:36:19.237 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.235+0000 7f52a0d7d640 1 -- 172.21.15.31:0/2152106278 >> v1:172.21.15.31:6789/0 conn(0x7f529c06f280 legacy=0x7f529c06f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:19.237 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.235+0000 7f52a0d7d640 1 -- 172.21.15.31:0/2152106278 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f529c070f40 con 0x7f529c06fd70 2024-09-22T08:36:19.238 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.236+0000 7f52a0d7d640 1 --2- 172.21.15.31:0/2152106278 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f529c06fd70 0x7f529c131660 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f5290009720 tx=0x7f529002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74779ad6ded086dc server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:19.238 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.236+0000 7f528ffff640 1 -- 172.21.15.31:0/2152106278 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5290037070 con 0x7f529c06fd70 2024-09-22T08:36:19.238 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.236+0000 7f528ffff640 1 -- 172.21.15.31:0/2152106278 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f529002ad90 con 0x7f529c06fd70 2024-09-22T08:36:19.239 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.236+0000 7f528ffff640 1 -- 172.21.15.31:0/2152106278 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5290032590 con 0x7f529c06fd70 2024-09-22T08:36:19.239 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.237+0000 7f52a37e2640 1 -- 172.21.15.31:0/2152106278 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f529c06fd70 msgr2=0x7f529c131660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:19.239 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.237+0000 7f52a37e2640 1 --2- 172.21.15.31:0/2152106278 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f529c06fd70 0x7f529c131660 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f5290009720 tx=0x7f529002a110 comp rx=0 tx=0).stop 2024-09-22T08:36:19.239 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.237+0000 7f52a37e2640 1 -- 172.21.15.31:0/2152106278 shutdown_connections 2024-09-22T08:36:19.239 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.237+0000 7f52a37e2640 1 --2- 172.21.15.31:0/2152106278 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f529c06fd70 0x7f529c131660 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:19.239 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.237+0000 7f52a37e2640 1 -- 172.21.15.31:0/2152106278 >> 172.21.15.31:0/2152106278 conn(0x7f529c09ac80 msgr2=0x7f529c098550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:19.239 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.237+0000 7f52a37e2640 1 -- 172.21.15.31:0/2152106278 shutdown_connections 2024-09-22T08:36:19.239 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.237+0000 7f52a37e2640 1 -- 172.21.15.31:0/2152106278 wait complete. 2024-09-22T08:36:19.241 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.238+0000 7f52a37e2640 1 Processor -- start 2024-09-22T08:36:19.241 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.238+0000 7f52a37e2640 1 -- start start 2024-09-22T08:36:19.241 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.238+0000 7f52a37e2640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f529c06f280 0x7f529c1c2050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:19.241 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.238+0000 7f52a37e2640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f529c131d20 con 0x7f529c06f280 2024-09-22T08:36:19.241 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.238+0000 7f52a157e640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f529c06f280 0x7f529c1c2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:19.241 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.238+0000 7f52a157e640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f529c06f280 0x7f529c1c2050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:48314/0 (socket says 172.21.15.31:48314) 2024-09-22T08:36:19.241 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.238+0000 7f52a157e640 1 -- 172.21.15.31:0/637601852 learned_addr learned my addr 172.21.15.31:0/637601852 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-22T08:36:19.241 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.239+0000 7f52a157e640 1 -- 172.21.15.31:0/637601852 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f529c127f70 con 0x7f529c06f280 2024-09-22T08:36:19.241 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.239+0000 7f52a157e640 1 --2- 172.21.15.31:0/637601852 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f529c06f280 0x7f529c1c2050 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f529800c450 tx=0x7f529800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:19.242 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.239+0000 7f528dffb640 1 -- 172.21.15.31:0/637601852 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5298017070 con 0x7f529c06f280 2024-09-22T08:36:19.242 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.239+0000 7f528dffb640 1 -- 172.21.15.31:0/637601852 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5298005c10 con 0x7f529c06f280 2024-09-22T08:36:19.242 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.239+0000 7f52a37e2640 1 -- 172.21.15.31:0/637601852 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f529c128600 con 0x7f529c06f280 2024-09-22T08:36:19.242 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.239+0000 7f528dffb640 1 -- 172.21.15.31:0/637601852 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f52980070d0 con 0x7f529c06f280 2024-09-22T08:36:19.242 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.239+0000 7f52a37e2640 1 -- 172.21.15.31:0/637601852 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f529c1c2770 con 0x7f529c06f280 2024-09-22T08:36:19.243 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.240+0000 7f528dffb640 1 -- 172.21.15.31:0/637601852 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f529801a070 con 0x7f529c06f280 2024-09-22T08:36:19.243 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.240+0000 7f52a37e2640 1 -- 172.21.15.31:0/637601852 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f529c06f660 con 0x7f529c06f280 2024-09-22T08:36:19.243 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.241+0000 7f528dffb640 1 --2- 172.21.15.31:0/637601852 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f528003e740 0x7f5280040c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:19.243 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.241+0000 7f528dffb640 1 -- 172.21.15.31:0/637601852 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7f5298052040 con 0x7f529c06f280 2024-09-22T08:36:19.243 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.241+0000 7f52a0d7d640 1 --2- 172.21.15.31:0/637601852 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f528003e740 0x7f5280040c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:19.243 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.242+0000 7f52a0d7d640 1 --2- 172.21.15.31:0/637601852 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f528003e740 0x7f5280040c00 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f5290009720 tx=0x7f529002e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:19.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.245+0000 7f528dffb640 1 -- 172.21.15.31:0/637601852 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f529801bdd0 con 0x7f529c06f280 2024-09-22T08:36:19.437 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.436+0000 7f52a37e2640 1 -- 172.21.15.31:0/637601852 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f529c073fb0 con 0x7f529c06f280 2024-09-22T08:36:19.438 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.437+0000 7f528dffb640 1 -- 172.21.15.31:0/637601852 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) ==== 74+0+9889 (secure 0 0 0) 0x7f529801a880 con 0x7f529c06f280 2024-09-22T08:36:19.438 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-22T08:36:19.438 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":17,"fsid":"d3faaa46-a06c-404a-b783-532e7c90ea63","created":"2024-09-22T08:35:58.970523+0000","modified":"2024-09-22T08:36:18.425308+0000","last_up_change":"2024-09-22T08:36:09.401562+0000","last_in_change":"2024-09-22T08:36:00.023066+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-22T08:36:09.158554+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-22T08:36:14.551376+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":17,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b564b56d-77a0-4258-b683-62460f71da28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":168281188},{"type":"v1","addr":"172.21.15.31:6801","nonce":168281188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":168281188},{"type":"v1","addr":"172.21.15.31:6803","nonce":168281188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":168281188},{"type":"v1","addr":"172.21.15.31:6807","nonce":168281188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":168281188},{"type":"v1","addr":"172.21.15.31:6805","nonce":168281188}]},"public_addr":"172.21.15.31:6801/168281188","cluster_addr":"172.21.15.31:6803/168281188","heartbeat_back_addr":"172.21.15.31:6807/168281188","heartbeat_front_addr":"172.21.15.31:6805/168281188","state":["exists","up"]},{"osd":1,"uuid":"8f501a52-02aa-4ddf-ae21-83fc468e2e35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3192108003},{"type":"v1","addr":"172.21.15.142:6817","nonce":3192108003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":3192108003},{"type":"v1","addr":"172.21.15.142:6819","nonce":3192108003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":3192108003},{"type":"v1","addr":"172.21.15.142:6823","nonce":3192108003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":3192108003},{"type":"v1","addr":"172.21.15.142:6821","nonce":3192108003}]},"public_addr":"172.21.15.142:6817/3192108003","cluster_addr":"172.21.15.142:6819/3192108003","heartbeat_back_addr":"172.21.15.142:6823/3192108003","heartbeat_front_addr":"172.21.15.142:6821/3192108003","state":["exists","up"]},{"osd":2,"uuid":"3dad5d00-e406-4917-9476-7f79fdf2e276","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":279438927},{"type":"v1","addr":"172.21.15.142:6809","nonce":279438927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":279438927},{"type":"v1","addr":"172.21.15.142:6811","nonce":279438927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":279438927},{"type":"v1","addr":"172.21.15.142:6815","nonce":279438927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":279438927},{"type":"v1","addr":"172.21.15.142:6813","nonce":279438927}]},"public_addr":"172.21.15.142:6809/279438927","cluster_addr":"172.21.15.142:6811/279438927","heartbeat_back_addr":"172.21.15.142:6815/279438927","heartbeat_front_addr":"172.21.15.142:6813/279438927","state":["exists","up"]},{"osd":3,"uuid":"3eea2de4-b487-4110-b798-495fa09ef2d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":1064901393},{"type":"v1","addr":"172.21.15.142:6801","nonce":1064901393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":1064901393},{"type":"v1","addr":"172.21.15.142:6803","nonce":1064901393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":1064901393},{"type":"v1","addr":"172.21.15.142:6807","nonce":1064901393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":1064901393},{"type":"v1","addr":"172.21.15.142:6805","nonce":1064901393}]},"public_addr":"172.21.15.142:6801/1064901393","cluster_addr":"172.21.15.142:6803/1064901393","heartbeat_back_addr":"172.21.15.142:6807/1064901393","heartbeat_front_addr":"172.21.15.142:6805/1064901393","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-22T08:36:06.000852+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-22T08:36:06.991262+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-22T08:36:06.415953+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-22T08:36:05.868062+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-22T08:36:19.440 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.439+0000 7f52a37e2640 1 -- 172.21.15.31:0/637601852 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f528003e740 msgr2=0x7f5280040c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:19.440 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.439+0000 7f52a37e2640 1 --2- 172.21.15.31:0/637601852 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f528003e740 0x7f5280040c00 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f5290009720 tx=0x7f529002e000 comp rx=0 tx=0).stop 2024-09-22T08:36:19.440 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.439+0000 7f52a37e2640 1 -- 172.21.15.31:0/637601852 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f529c06f280 msgr2=0x7f529c1c2050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:19.441 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.439+0000 7f52a37e2640 1 --2- 172.21.15.31:0/637601852 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f529c06f280 0x7f529c1c2050 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f529800c450 tx=0x7f529800c910 comp rx=0 tx=0).stop 2024-09-22T08:36:19.441 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.439+0000 7f52a37e2640 1 -- 172.21.15.31:0/637601852 shutdown_connections 2024-09-22T08:36:19.441 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.439+0000 7f52a37e2640 1 --2- 172.21.15.31:0/637601852 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f528003e740 0x7f5280040c00 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:19.441 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.439+0000 7f52a37e2640 1 --2- 172.21.15.31:0/637601852 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f529c06f280 0x7f529c1c2050 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:19.441 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.439+0000 7f52a37e2640 1 -- 172.21.15.31:0/637601852 >> 172.21.15.31:0/637601852 conn(0x7f529c09ac80 msgr2=0x7f529c12f850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:19.441 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.439+0000 7f52a37e2640 1 -- 172.21.15.31:0/637601852 shutdown_connections 2024-09-22T08:36:19.441 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.439+0000 7f52a37e2640 1 -- 172.21.15.31:0/637601852 wait complete. 2024-09-22T08:36:19.451 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-22T08:36:19.451 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-22T08:36:19.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.551+0000 7ff8641f8640 1 Processor -- start 2024-09-22T08:36:19.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.551+0000 7ff8641f8640 1 -- start start 2024-09-22T08:36:19.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.551+0000 7ff8641f8640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ff85c071e30 0x7ff85c132790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:19.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.551+0000 7ff8641f8640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff85c071770 con 0x7ff85c06e170 2024-09-22T08:36:19.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.551+0000 7ff8641f8640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7ff85c099ee0 con 0x7ff85c071e30 2024-09-22T08:36:19.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.551+0000 7ff861793640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ff85c071e30 0x7ff85c132790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:19.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.551+0000 7ff861f94640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7ff85c06e170 0x7ff85c06e550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:60262/0 (socket says 172.21.15.31:60262) 2024-09-22T08:36:19.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.551+0000 7ff861f94640 1 -- 172.21.15.31:0/3674398511 learned_addr learned my addr 172.21.15.31:0/3674398511 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-22T08:36:19.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.552+0000 7ff861793640 1 -- 172.21.15.31:0/3674398511 >> v1:172.21.15.31:6789/0 conn(0x7ff85c06e170 legacy=0x7ff85c06e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:19.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.552+0000 7ff861793640 1 -- 172.21.15.31:0/3674398511 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff85c072530 con 0x7ff85c071e30 2024-09-22T08:36:19.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.552+0000 7ff860f92640 1 -- 172.21.15.31:0/3674398511 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1713165870 0 0) 0x7ff85c071770 con 0x7ff85c06e170 2024-09-22T08:36:19.556 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.552+0000 7ff861793640 1 --2- 172.21.15.31:0/3674398511 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff85c071e30 0x7ff85c132790 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff84c009750 tx=0x7ff84c02a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4626c43e1dc8bd1 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:19.556 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.553+0000 7ff860f92640 1 -- 172.21.15.31:0/3674398511 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff84c037070 con 0x7ff85c071e30 2024-09-22T08:36:19.556 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.553+0000 7ff860f92640 1 -- 172.21.15.31:0/3674398511 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff84c02ad80 con 0x7ff85c071e30 2024-09-22T08:36:19.556 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.553+0000 7ff860f92640 1 -- 172.21.15.31:0/3674398511 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff84c032590 con 0x7ff85c071e30 2024-09-22T08:36:19.556 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.553+0000 7ff8641f8640 1 -- 172.21.15.31:0/3674398511 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff85c071e30 msgr2=0x7ff85c132790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:19.556 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.553+0000 7ff8641f8640 1 --2- 172.21.15.31:0/3674398511 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff85c071e30 0x7ff85c132790 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff84c009750 tx=0x7ff84c02a140 comp rx=0 tx=0).stop 2024-09-22T08:36:19.557 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.553+0000 7ff8641f8640 1 -- 172.21.15.31:0/3674398511 shutdown_connections 2024-09-22T08:36:19.557 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.553+0000 7ff8641f8640 1 --2- 172.21.15.31:0/3674398511 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff85c071e30 0x7ff85c132790 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:19.557 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.553+0000 7ff8641f8640 1 -- 172.21.15.31:0/3674398511 >> 172.21.15.31:0/3674398511 conn(0x7ff85c09ac80 msgr2=0x7ff85c098550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:19.557 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.553+0000 7ff8641f8640 1 -- 172.21.15.31:0/3674398511 shutdown_connections 2024-09-22T08:36:19.557 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.553+0000 7ff8641f8640 1 -- 172.21.15.31:0/3674398511 wait complete. 2024-09-22T08:36:19.557 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.554+0000 7ff8641f8640 1 Processor -- start 2024-09-22T08:36:19.557 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.554+0000 7ff8641f8640 1 -- start start 2024-09-22T08:36:19.557 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.554+0000 7ff8641f8640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff85c06e170 0x7ff85c129c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:19.557 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.554+0000 7ff8641f8640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7ff85c06ee70 con 0x7ff85c06e170 2024-09-22T08:36:19.557 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.554+0000 7ff861f94640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff85c06e170 0x7ff85c129c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:19.557 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.555+0000 7ff861f94640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff85c06e170 0x7ff85c129c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:48328/0 (socket says 172.21.15.31:48328) 2024-09-22T08:36:19.558 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.555+0000 7ff861f94640 1 -- 172.21.15.31:0/3623707268 learned_addr learned my addr 172.21.15.31:0/3623707268 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-22T08:36:19.558 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.555+0000 7ff861f94640 1 -- 172.21.15.31:0/3623707268 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff85c1276b0 con 0x7ff85c06e170 2024-09-22T08:36:19.558 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.555+0000 7ff861f94640 1 --2- 172.21.15.31:0/3623707268 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff85c06e170 0x7ff85c129c00 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff85800c3d0 tx=0x7ff85800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:19.558 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.555+0000 7ff8527fc640 1 -- 172.21.15.31:0/3623707268 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff8580074d0 con 0x7ff85c06e170 2024-09-22T08:36:19.558 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.555+0000 7ff8527fc640 1 -- 172.21.15.31:0/3623707268 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8580047e0 con 0x7ff85c06e170 2024-09-22T08:36:19.558 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.555+0000 7ff8527fc640 1 -- 172.21.15.31:0/3623707268 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff858007670 con 0x7ff85c06e170 2024-09-22T08:36:19.558 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.555+0000 7ff8641f8640 1 -- 172.21.15.31:0/3623707268 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff85c1297c0 con 0x7ff85c06e170 2024-09-22T08:36:19.558 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.555+0000 7ff8641f8640 1 -- 172.21.15.31:0/3623707268 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff85c128160 con 0x7ff85c06e170 2024-09-22T08:36:19.559 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.556+0000 7ff8527fc640 1 -- 172.21.15.31:0/3623707268 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7ff858011070 con 0x7ff85c06e170 2024-09-22T08:36:19.559 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.556+0000 7ff8641f8640 1 -- 172.21.15.31:0/3623707268 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff85c06e550 con 0x7ff85c06e170 2024-09-22T08:36:19.559 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.556+0000 7ff8527fc640 1 --2- 172.21.15.31:0/3623707268 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7ff84003e710 0x7ff840040bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:19.559 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.556+0000 7ff8527fc640 1 -- 172.21.15.31:0/3623707268 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7ff858052940 con 0x7ff85c06e170 2024-09-22T08:36:19.559 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.557+0000 7ff861793640 1 --2- 172.21.15.31:0/3623707268 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7ff84003e710 0x7ff840040bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:19.559 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.557+0000 7ff861793640 1 --2- 172.21.15.31:0/3623707268 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7ff84003e710 0x7ff840040bd0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7ff84c034000 tx=0x7ff84c02e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:19.562 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.561+0000 7ff8527fc640 1 -- 172.21.15.31:0/3623707268 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7ff85c1276b0 con 0x7ff85c06e170 2024-09-22T08:36:19.749 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.747+0000 7ff8641f8640 1 -- 172.21.15.31:0/3623707268 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff85c127200 con 0x7ff85c06e170 2024-09-22T08:36:19.749 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.748+0000 7ff8527fc640 1 -- 172.21.15.31:0/3623707268 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) ==== 74+0+9889 (secure 0 0 0) 0x7ff858012dd0 con 0x7ff85c06e170 2024-09-22T08:36:19.749 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-22T08:36:19.750 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":17,"fsid":"d3faaa46-a06c-404a-b783-532e7c90ea63","created":"2024-09-22T08:35:58.970523+0000","modified":"2024-09-22T08:36:18.425308+0000","last_up_change":"2024-09-22T08:36:09.401562+0000","last_in_change":"2024-09-22T08:36:00.023066+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-22T08:36:09.158554+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-22T08:36:14.551376+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":17,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b564b56d-77a0-4258-b683-62460f71da28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":168281188},{"type":"v1","addr":"172.21.15.31:6801","nonce":168281188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":168281188},{"type":"v1","addr":"172.21.15.31:6803","nonce":168281188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":168281188},{"type":"v1","addr":"172.21.15.31:6807","nonce":168281188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":168281188},{"type":"v1","addr":"172.21.15.31:6805","nonce":168281188}]},"public_addr":"172.21.15.31:6801/168281188","cluster_addr":"172.21.15.31:6803/168281188","heartbeat_back_addr":"172.21.15.31:6807/168281188","heartbeat_front_addr":"172.21.15.31:6805/168281188","state":["exists","up"]},{"osd":1,"uuid":"8f501a52-02aa-4ddf-ae21-83fc468e2e35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3192108003},{"type":"v1","addr":"172.21.15.142:6817","nonce":3192108003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":3192108003},{"type":"v1","addr":"172.21.15.142:6819","nonce":3192108003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":3192108003},{"type":"v1","addr":"172.21.15.142:6823","nonce":3192108003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":3192108003},{"type":"v1","addr":"172.21.15.142:6821","nonce":3192108003}]},"public_addr":"172.21.15.142:6817/3192108003","cluster_addr":"172.21.15.142:6819/3192108003","heartbeat_back_addr":"172.21.15.142:6823/3192108003","heartbeat_front_addr":"172.21.15.142:6821/3192108003","state":["exists","up"]},{"osd":2,"uuid":"3dad5d00-e406-4917-9476-7f79fdf2e276","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":279438927},{"type":"v1","addr":"172.21.15.142:6809","nonce":279438927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":279438927},{"type":"v1","addr":"172.21.15.142:6811","nonce":279438927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":279438927},{"type":"v1","addr":"172.21.15.142:6815","nonce":279438927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":279438927},{"type":"v1","addr":"172.21.15.142:6813","nonce":279438927}]},"public_addr":"172.21.15.142:6809/279438927","cluster_addr":"172.21.15.142:6811/279438927","heartbeat_back_addr":"172.21.15.142:6815/279438927","heartbeat_front_addr":"172.21.15.142:6813/279438927","state":["exists","up"]},{"osd":3,"uuid":"3eea2de4-b487-4110-b798-495fa09ef2d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":1064901393},{"type":"v1","addr":"172.21.15.142:6801","nonce":1064901393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":1064901393},{"type":"v1","addr":"172.21.15.142:6803","nonce":1064901393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":1064901393},{"type":"v1","addr":"172.21.15.142:6807","nonce":1064901393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":1064901393},{"type":"v1","addr":"172.21.15.142:6805","nonce":1064901393}]},"public_addr":"172.21.15.142:6801/1064901393","cluster_addr":"172.21.15.142:6803/1064901393","heartbeat_back_addr":"172.21.15.142:6807/1064901393","heartbeat_front_addr":"172.21.15.142:6805/1064901393","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-22T08:36:06.000852+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-22T08:36:06.991262+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-22T08:36:06.415953+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-22T08:36:05.868062+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-22T08:36:19.752 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.750+0000 7ff8641f8640 1 -- 172.21.15.31:0/3623707268 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7ff84003e710 msgr2=0x7ff840040bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:19.752 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.750+0000 7ff8641f8640 1 --2- 172.21.15.31:0/3623707268 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7ff84003e710 0x7ff840040bd0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7ff84c034000 tx=0x7ff84c02e000 comp rx=0 tx=0).stop 2024-09-22T08:36:19.752 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.750+0000 7ff8641f8640 1 -- 172.21.15.31:0/3623707268 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff85c06e170 msgr2=0x7ff85c129c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:19.752 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.750+0000 7ff8641f8640 1 --2- 172.21.15.31:0/3623707268 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff85c06e170 0x7ff85c129c00 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff85800c3d0 tx=0x7ff85800c890 comp rx=0 tx=0).stop 2024-09-22T08:36:19.752 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.750+0000 7ff8641f8640 1 -- 172.21.15.31:0/3623707268 shutdown_connections 2024-09-22T08:36:19.752 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.750+0000 7ff8641f8640 1 --2- 172.21.15.31:0/3623707268 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7ff84003e710 0x7ff840040bd0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:19.752 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.750+0000 7ff8641f8640 1 --2- 172.21.15.31:0/3623707268 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff85c06e170 0x7ff85c129c00 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:19.752 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.750+0000 7ff8641f8640 1 -- 172.21.15.31:0/3623707268 >> 172.21.15.31:0/3623707268 conn(0x7ff85c09ac80 msgr2=0x7ff85c12e770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:19.752 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.750+0000 7ff8641f8640 1 -- 172.21.15.31:0/3623707268 shutdown_connections 2024-09-22T08:36:19.752 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.750+0000 7ff8641f8640 1 -- 172.21.15.31:0/3623707268 wait complete. 2024-09-22T08:36:19.762 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-22T08:36:19.763 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-22T08:36:19.763 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-22T08:36:19.763 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-22T08:36:19.870 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.869+0000 7f9b2fed6640 1 Processor -- start 2024-09-22T08:36:19.870 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.869+0000 7f46e8033640 1 Processor -- start 2024-09-22T08:36:19.870 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.869+0000 7f389cb5d640 1 Processor -- start 2024-09-22T08:36:19.871 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.869+0000 7f389cb5d640 1 -- start start 2024-09-22T08:36:19.871 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.869+0000 7eff3ecf7640 1 Processor -- start 2024-09-22T08:36:19.871 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.869+0000 7eff3ecf7640 1 -- start start 2024-09-22T08:36:19.871 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.869+0000 7f9b2fed6640 1 -- start start 2024-09-22T08:36:19.872 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.869+0000 7f46e8033640 1 -- start start 2024-09-22T08:36:19.872 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.869+0000 7f9b2fed6640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f9b2806e8e0 0x7f9b2806ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:19.872 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.869+0000 7f9b2fed6640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b2806ff50 con 0x7f9b2806f200 2024-09-22T08:36:19.873 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.869+0000 7eff3ecf7640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7eff3806fd70 0x7eff38131660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:19.873 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.869+0000 7eff3ecf7640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff38099ee0 con 0x7eff3806f280 2024-09-22T08:36:19.873 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.869+0000 7eff3ecf7640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7eff38070d00 con 0x7eff3806fd70 2024-09-22T08:36:19.873 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.869+0000 7f9b2fed6640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f9b28099c10 con 0x7f9b2806e8e0 2024-09-22T08:36:19.873 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.870+0000 7f9b2d471640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f9b2806f200 0x7f9b2812f650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:60280/0 (socket says 172.21.15.31:60280) 2024-09-22T08:36:19.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.870+0000 7f46e8033640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f46e006ec60 0x7f46e0132780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:19.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.870+0000 7f46e8033640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46e0099ee0 con 0x7f46e006e170 2024-09-22T08:36:19.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.870+0000 7f46e8033640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f46e0072780 con 0x7f46e006ec60 2024-09-22T08:36:19.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.870+0000 7f389cb5d640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f389806f280 0x7f389806f660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:19.875 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.870+0000 7f389cb5d640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3898099ee0 con 0x7f389806fba0 2024-09-22T08:36:19.875 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.870+0000 7f389cb5d640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f3898070d00 con 0x7f389806f280 2024-09-22T08:36:19.875 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.870+0000 7f9b2dc72640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f9b2806e8e0 0x7f9b2806ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:19.875 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.870+0000 7f9b2d471640 1 -- 172.21.15.31:0/3835259702 learned_addr learned my addr 172.21.15.31:0/3835259702 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-22T08:36:19.875 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.869+0000 7eff3ca93640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7eff3806f280 0x7eff3806f660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:60274/0 (socket says 172.21.15.31:60274) 2024-09-22T08:36:19.876 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.870+0000 7eff3ca93640 1 -- 172.21.15.31:0/3906302491 learned_addr learned my addr 172.21.15.31:0/3906302491 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-22T08:36:19.876 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.870+0000 7eff37fff640 1 --2- 172.21.15.31:0/3906302491 >> v2:172.21.15.31:3300/0 conn(0x7eff3806fd70 0x7eff38131660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:19.876 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.870+0000 7f46e5dcf640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f46e006e170 0x7f46e006e550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:60286/0 (socket says 172.21.15.31:60286) 2024-09-22T08:36:19.876 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.870+0000 7f389659c640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f389806f280 0x7f389806f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:19.876 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.870+0000 7f3895d9b640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f389806fba0 0x7f3898097070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:60292/0 (socket says 172.21.15.31:60292) 2024-09-22T08:36:19.877 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.870+0000 7f389659c640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f389806f280 0x7f389806f660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:48370/0 (socket says 172.21.15.31:48370) 2024-09-22T08:36:19.877 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.870+0000 7f3895d9b640 1 -- 172.21.15.31:0/1948232343 learned_addr learned my addr 172.21.15.31:0/1948232343 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-22T08:36:19.877 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.870+0000 7f46e5dcf640 1 -- 172.21.15.31:0/3881409870 learned_addr learned my addr 172.21.15.31:0/3881409870 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-22T08:36:19.877 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.870+0000 7eff377fe640 1 -- 172.21.15.31:0/3906302491 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 65113266 0 0) 0x7eff38099ee0 con 0x7eff3806f280 2024-09-22T08:36:19.877 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.870+0000 7eff377fe640 1 -- 172.21.15.31:0/3906302491 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7eff28005730 con 0x7eff3806f280 2024-09-22T08:36:19.877 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.870+0000 7f46e55ce640 1 --2- 172.21.15.31:0/3881409870 >> v2:172.21.15.31:3300/0 conn(0x7f46e006ec60 0x7f46e0132780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:19.878 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.870+0000 7f9b2dc72640 1 -- 172.21.15.31:0/3835259702 >> v1:172.21.15.31:6789/0 conn(0x7f9b2806f200 legacy=0x7f9b2812f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:19.878 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.870+0000 7f9b2dc72640 1 -- 172.21.15.31:0/3835259702 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b28099710 con 0x7f9b2806e8e0 2024-09-22T08:36:19.878 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.870+0000 7eff37fff640 1 -- 172.21.15.31:0/3906302491 >> v1:172.21.15.31:6789/0 conn(0x7eff3806f280 legacy=0x7eff3806f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:19.878 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.870+0000 7eff37fff640 1 -- 172.21.15.31:0/3906302491 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff38070f40 con 0x7eff3806fd70 2024-09-22T08:36:19.879 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.870+0000 7f46e4dcd640 1 -- 172.21.15.31:0/3881409870 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 83487822 0 0) 0x7f46e0099ee0 con 0x7f46e006e170 2024-09-22T08:36:19.879 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.870+0000 7f46e4dcd640 1 -- 172.21.15.31:0/3881409870 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f46cc003520 con 0x7f46e006e170 2024-09-22T08:36:19.879 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.871+0000 7f46e55ce640 1 -- 172.21.15.31:0/3881409870 >> v1:172.21.15.31:6789/0 conn(0x7f46e006e170 legacy=0x7f46e006e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:19.879 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.871+0000 7f46e55ce640 1 -- 172.21.15.31:0/3881409870 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46e0071490 con 0x7f46e006ec60 2024-09-22T08:36:19.879 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.871+0000 7f389659c640 1 -- 172.21.15.31:0/1948232343 >> v1:172.21.15.31:6789/0 conn(0x7f389806fba0 legacy=0x7f3898097070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:19.880 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.871+0000 7f389659c640 1 -- 172.21.15.31:0/1948232343 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3898070f40 con 0x7f389806f280 2024-09-22T08:36:19.880 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.871+0000 7eff37fff640 1 --2- 172.21.15.31:0/3906302491 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7eff3806fd70 0x7eff38131660 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7eff24009720 tx=0x7eff2402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef12e093c463a94 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:19.880 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.871+0000 7eff377fe640 1 -- 172.21.15.31:0/3906302491 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff24037070 con 0x7eff3806fd70 2024-09-22T08:36:19.880 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.871+0000 7eff377fe640 1 -- 172.21.15.31:0/3906302491 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff2402ad90 con 0x7eff3806fd70 2024-09-22T08:36:19.880 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.871+0000 7eff377fe640 1 -- 172.21.15.31:0/3906302491 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff24037070 con 0x7eff3806fd70 2024-09-22T08:36:19.881 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.871+0000 7f9b2dc72640 1 --2- 172.21.15.31:0/3835259702 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9b2806e8e0 0x7f9b2806ecc0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f9b24009720 tx=0x7f9b2402a0a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d82c27fb1547b65 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:19.881 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.872+0000 7f9b2cc70640 1 -- 172.21.15.31:0/3835259702 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b24037070 con 0x7f9b2806e8e0 2024-09-22T08:36:19.881 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.872+0000 7f9b2cc70640 1 -- 172.21.15.31:0/3835259702 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b2402ac60 con 0x7f9b2806e8e0 2024-09-22T08:36:19.881 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.872+0000 7f9b2cc70640 1 -- 172.21.15.31:0/3835259702 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b24032440 con 0x7f9b2806e8e0 2024-09-22T08:36:19.881 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.872+0000 7f46e55ce640 1 --2- 172.21.15.31:0/3881409870 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f46e006ec60 0x7f46e0132780 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f46d0009750 tx=0x7f46d002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54d7530f35c04e9b server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:19.882 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.872+0000 7f46e4dcd640 1 -- 172.21.15.31:0/3881409870 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f46d0037070 con 0x7f46e006ec60 2024-09-22T08:36:19.882 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.872+0000 7f389659c640 1 --2- 172.21.15.31:0/1948232343 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f389806f280 0x7f389806f660 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f3888009720 tx=0x7f388802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=668f575f7f26d18d server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:19.882 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.872+0000 7f46e4dcd640 1 -- 172.21.15.31:0/3881409870 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46d002ad80 con 0x7f46e006ec60 2024-09-22T08:36:19.882 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.872+0000 7f46e4dcd640 1 -- 172.21.15.31:0/3881409870 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f46d0032590 con 0x7f46e006ec60 2024-09-22T08:36:19.883 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.872+0000 7f389559a640 1 -- 172.21.15.31:0/1948232343 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3888037070 con 0x7f389806f280 2024-09-22T08:36:19.883 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.872+0000 7f389559a640 1 -- 172.21.15.31:0/1948232343 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f388802ad90 con 0x7f389806f280 2024-09-22T08:36:19.883 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.872+0000 7f389559a640 1 -- 172.21.15.31:0/1948232343 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3888032590 con 0x7f389806f280 2024-09-22T08:36:19.883 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.872+0000 7eff3ecf7640 1 -- 172.21.15.31:0/3906302491 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7eff3806fd70 msgr2=0x7eff38131660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:19.883 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.872+0000 7eff3ecf7640 1 --2- 172.21.15.31:0/3906302491 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7eff3806fd70 0x7eff38131660 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7eff24009720 tx=0x7eff2402a110 comp rx=0 tx=0).stop 2024-09-22T08:36:19.883 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.872+0000 7f9b2fed6640 1 -- 172.21.15.31:0/3835259702 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9b2806e8e0 msgr2=0x7f9b2806ecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:19.884 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.872+0000 7f9b2fed6640 1 --2- 172.21.15.31:0/3835259702 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9b2806e8e0 0x7f9b2806ecc0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f9b24009720 tx=0x7f9b2402a0a0 comp rx=0 tx=0).stop 2024-09-22T08:36:19.884 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.872+0000 7eff3ecf7640 1 -- 172.21.15.31:0/3906302491 shutdown_connections 2024-09-22T08:36:19.884 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.872+0000 7eff3ecf7640 1 --2- 172.21.15.31:0/3906302491 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7eff3806fd70 0x7eff38131660 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:19.884 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.872+0000 7eff3ecf7640 1 -- 172.21.15.31:0/3906302491 >> 172.21.15.31:0/3906302491 conn(0x7eff3809ac80 msgr2=0x7eff38098550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:19.884 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.873+0000 7f9b2fed6640 1 -- 172.21.15.31:0/3835259702 shutdown_connections 2024-09-22T08:36:19.885 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.873+0000 7f9b2fed6640 1 --2- 172.21.15.31:0/3835259702 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9b2806e8e0 0x7f9b2806ecc0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:19.885 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.873+0000 7f9b2fed6640 1 -- 172.21.15.31:0/3835259702 >> 172.21.15.31:0/3835259702 conn(0x7f9b280a01c0 msgr2=0x7f9b280a05d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:19.885 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.873+0000 7eff3ecf7640 1 -- 172.21.15.31:0/3906302491 shutdown_connections 2024-09-22T08:36:19.885 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.873+0000 7eff3ecf7640 1 -- 172.21.15.31:0/3906302491 wait complete. 2024-09-22T08:36:19.885 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.873+0000 7f9b2fed6640 1 -- 172.21.15.31:0/3835259702 shutdown_connections 2024-09-22T08:36:19.886 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.873+0000 7f46e8033640 1 -- 172.21.15.31:0/3881409870 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f46e006ec60 msgr2=0x7f46e0132780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:19.886 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.873+0000 7f46e8033640 1 --2- 172.21.15.31:0/3881409870 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f46e006ec60 0x7f46e0132780 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f46d0009750 tx=0x7f46d002a140 comp rx=0 tx=0).stop 2024-09-22T08:36:19.886 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.873+0000 7f9b2fed6640 1 -- 172.21.15.31:0/3835259702 wait complete. 2024-09-22T08:36:19.886 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.873+0000 7f46e8033640 1 -- 172.21.15.31:0/3881409870 shutdown_connections 2024-09-22T08:36:19.887 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.873+0000 7f46e8033640 1 --2- 172.21.15.31:0/3881409870 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f46e006ec60 0x7f46e0132780 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:19.887 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.873+0000 7f46e8033640 1 -- 172.21.15.31:0/3881409870 >> 172.21.15.31:0/3881409870 conn(0x7f46e009ac80 msgr2=0x7f46e0098550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:19.887 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.873+0000 7f389cb5d640 1 -- 172.21.15.31:0/1948232343 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f389806f280 msgr2=0x7f389806f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:19.887 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.873+0000 7f389cb5d640 1 --2- 172.21.15.31:0/1948232343 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f389806f280 0x7f389806f660 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f3888009720 tx=0x7f388802a110 comp rx=0 tx=0).stop 2024-09-22T08:36:19.888 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.873+0000 7f46e8033640 1 -- 172.21.15.31:0/3881409870 shutdown_connections 2024-09-22T08:36:19.888 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.873+0000 7f46e8033640 1 -- 172.21.15.31:0/3881409870 wait complete. 2024-09-22T08:36:19.888 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.873+0000 7f389cb5d640 1 -- 172.21.15.31:0/1948232343 shutdown_connections 2024-09-22T08:36:19.888 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.873+0000 7f389cb5d640 1 --2- 172.21.15.31:0/1948232343 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f389806f280 0x7f389806f660 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:19.888 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.873+0000 7f389cb5d640 1 -- 172.21.15.31:0/1948232343 >> 172.21.15.31:0/1948232343 conn(0x7f389809ac80 msgr2=0x7f3898098550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:19.888 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.873+0000 7f389cb5d640 1 -- 172.21.15.31:0/1948232343 shutdown_connections 2024-09-22T08:36:19.888 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.873+0000 7f389cb5d640 1 -- 172.21.15.31:0/1948232343 wait complete. 2024-09-22T08:36:19.889 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.874+0000 7f9b2fed6640 1 Processor -- start 2024-09-22T08:36:19.889 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.874+0000 7f9b2fed6640 1 -- start start 2024-09-22T08:36:19.889 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.874+0000 7eff3ecf7640 1 Processor -- start 2024-09-22T08:36:19.889 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.874+0000 7eff3ecf7640 1 -- start start 2024-09-22T08:36:19.890 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.874+0000 7f46e8033640 1 Processor -- start 2024-09-22T08:36:19.890 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.874+0000 7f9b2fed6640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9b2806e8e0 0x7f9b281c4780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:19.890 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.874+0000 7f9b2fed6640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f9b281300f0 con 0x7f9b2806e8e0 2024-09-22T08:36:19.890 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.874+0000 7f46e8033640 1 -- start start 2024-09-22T08:36:19.891 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.874+0000 7f389cb5d640 1 Processor -- start 2024-09-22T08:36:19.891 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.874+0000 7f9b2dc72640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9b2806e8e0 0x7f9b281c4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:19.891 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.874+0000 7f9b2dc72640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9b2806e8e0 0x7f9b281c4780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:48382/0 (socket says 172.21.15.31:48382) 2024-09-22T08:36:19.891 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.874+0000 7f9b2dc72640 1 -- 172.21.15.31:0/1737133527 learned_addr learned my addr 172.21.15.31:0/1737133527 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-22T08:36:19.891 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.874+0000 7f389cb5d640 1 -- start start 2024-09-22T08:36:19.892 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.875+0000 7eff3ecf7640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7eff3806f280 0x7eff381bf9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:19.892 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.875+0000 7f9b2dc72640 1 -- 172.21.15.31:0/1737133527 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b28129f90 con 0x7f9b2806e8e0 2024-09-22T08:36:19.892 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.875+0000 7f46e8033640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f46e006e170 0x7f46e0125f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:19.892 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.875+0000 7f46e8033640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f46e0072060 con 0x7f46e006e170 2024-09-22T08:36:19.892 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.875+0000 7f9b2dc72640 1 --2- 172.21.15.31:0/1737133527 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9b2806e8e0 0x7f9b281c4780 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f9b2402ac30 tx=0x7f9b240046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:19.893 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.875+0000 7eff3ecf7640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7eff3806e2f0 con 0x7eff3806f280 2024-09-22T08:36:19.893 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.875+0000 7eff3ca93640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7eff3806f280 0x7eff381bf9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:19.893 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.875+0000 7f389cb5d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f389806f280 0x7f3898123430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:19.893 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.875+0000 7f389cb5d640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f3898097780 con 0x7f389806f280 2024-09-22T08:36:19.893 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.875+0000 7eff3ca93640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7eff3806f280 0x7eff381bf9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:48386/0 (socket says 172.21.15.31:48386) 2024-09-22T08:36:19.894 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.875+0000 7eff3ca93640 1 -- 172.21.15.31:0/3704068645 learned_addr learned my addr 172.21.15.31:0/3704068645 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-22T08:36:19.894 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.875+0000 7f46e5dcf640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f46e006e170 0x7f46e0125f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:19.894 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.875+0000 7f46e5dcf640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f46e006e170 0x7f46e0125f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:48396/0 (socket says 172.21.15.31:48396) 2024-09-22T08:36:19.894 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.875+0000 7f46e5dcf640 1 -- 172.21.15.31:0/2272579296 learned_addr learned my addr 172.21.15.31:0/2272579296 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-22T08:36:19.894 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.875+0000 7f389659c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f389806f280 0x7f3898123430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:19.895 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.875+0000 7f389659c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f389806f280 0x7f3898123430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:48412/0 (socket says 172.21.15.31:48412) 2024-09-22T08:36:19.895 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.875+0000 7f389659c640 1 -- 172.21.15.31:0/4148167352 learned_addr learned my addr 172.21.15.31:0/4148167352 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-22T08:36:19.895 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.875+0000 7eff3ca93640 1 -- 172.21.15.31:0/3704068645 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff3808db60 con 0x7eff3806f280 2024-09-22T08:36:19.895 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.875+0000 7f46e5dcf640 1 -- 172.21.15.31:0/2272579296 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46e0128080 con 0x7f46e006e170 2024-09-22T08:36:19.895 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.876+0000 7f46e5dcf640 1 --2- 172.21.15.31:0/2272579296 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f46e006e170 0x7f46e0125f70 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f46dc00c480 tx=0x7f46dc00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:19.896 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.876+0000 7eff3ca93640 1 --2- 172.21.15.31:0/3704068645 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7eff3806f280 0x7eff381bf9e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7eff2c0018e0 tx=0x7eff2c001da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:19.896 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.876+0000 7f46d67fc640 1 -- 172.21.15.31:0/2272579296 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f46dc017070 con 0x7f46e006e170 2024-09-22T08:36:19.896 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.876+0000 7f389659c640 1 -- 172.21.15.31:0/4148167352 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3898124c90 con 0x7f389806f280 2024-09-22T08:36:19.896 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.876+0000 7f46d67fc640 1 -- 172.21.15.31:0/2272579296 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46dc005cd0 con 0x7f46e006e170 2024-09-22T08:36:19.897 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.876+0000 7f46d67fc640 1 -- 172.21.15.31:0/2272579296 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f46dc007200 con 0x7f46e006e170 2024-09-22T08:36:19.897 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.876+0000 7f46e8033640 1 -- 172.21.15.31:0/2272579296 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46e0128d20 con 0x7f46e006e170 2024-09-22T08:36:19.897 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.876+0000 7eff357fa640 1 -- 172.21.15.31:0/3704068645 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff2c0058b0 con 0x7eff3806f280 2024-09-22T08:36:19.897 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.876+0000 7eff357fa640 1 -- 172.21.15.31:0/3704068645 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff2c005a50 con 0x7eff3806f280 2024-09-22T08:36:19.897 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.876+0000 7eff357fa640 1 -- 172.21.15.31:0/3704068645 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff2c005d70 con 0x7eff3806f280 2024-09-22T08:36:19.897 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.876+0000 7f9b1a7fc640 1 -- 172.21.15.31:0/1737133527 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b24037040 con 0x7f9b2806e8e0 2024-09-22T08:36:19.898 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.876+0000 7f46e8033640 1 -- 172.21.15.31:0/2272579296 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46e0128790 con 0x7f46e006e170 2024-09-22T08:36:19.898 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.876+0000 7eff3ecf7640 1 -- 172.21.15.31:0/3704068645 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff38073fb0 con 0x7eff3806f280 2024-09-22T08:36:19.898 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.876+0000 7f9b2fed6640 1 -- 172.21.15.31:0/1737133527 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b2808e9d0 con 0x7f9b2806e8e0 2024-09-22T08:36:19.898 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.876+0000 7f9b2fed6640 1 -- 172.21.15.31:0/1737133527 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b2808f420 con 0x7f9b2806e8e0 2024-09-22T08:36:19.898 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.876+0000 7f9b1a7fc640 1 -- 172.21.15.31:0/1737133527 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b24004190 con 0x7f9b2806e8e0 2024-09-22T08:36:19.899 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.876+0000 7f389659c640 1 --2- 172.21.15.31:0/4148167352 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f389806f280 0x7f3898123430 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f3888009840 tx=0x7f38880046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:19.899 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.876+0000 7f9b1a7fc640 1 -- 172.21.15.31:0/1737133527 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b240044b0 con 0x7f9b2806e8e0 2024-09-22T08:36:19.899 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.876+0000 7f3886ffd640 1 -- 172.21.15.31:0/4148167352 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3888041070 con 0x7f389806f280 2024-09-22T08:36:19.899 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.876+0000 7f3886ffd640 1 -- 172.21.15.31:0/4148167352 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f388803c460 con 0x7f389806f280 2024-09-22T08:36:19.900 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.876+0000 7f3886ffd640 1 -- 172.21.15.31:0/4148167352 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3888037040 con 0x7f389806f280 2024-09-22T08:36:19.900 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.876+0000 7f389cb5d640 1 -- 172.21.15.31:0/4148167352 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3898126970 con 0x7f389806f280 2024-09-22T08:36:19.900 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.877+0000 7f389cb5d640 1 -- 172.21.15.31:0/4148167352 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3898129950 con 0x7f389806f280 2024-09-22T08:36:19.900 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.877+0000 7f9b2fed6640 1 -- 172.21.15.31:0/1737133527 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9b10000f80 con 0x7f9b2806e8e0 2024-09-22T08:36:19.900 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.877+0000 7f46e8033640 1 -- 172.21.15.31:0/2272579296 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f46e0128fb0 con 0x7f46e006e170 2024-09-22T08:36:19.900 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.877+0000 7eff3ecf7640 1 -- 172.21.15.31:0/3704068645 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff3808ccd0 con 0x7eff3806f280 2024-09-22T08:36:19.901 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.877+0000 7f389cb5d640 1 -- 172.21.15.31:0/4148167352 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3898073fb0 con 0x7f389806f280 2024-09-22T08:36:19.901 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.878+0000 7f46d67fc640 1 -- 172.21.15.31:0/2272579296 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f46dc01a070 con 0x7f46e006e170 2024-09-22T08:36:19.901 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.878+0000 7eff3ecf7640 1 -- 172.21.15.31:0/3704068645 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7eff3806f660 con 0x7eff3806f280 2024-09-22T08:36:19.901 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.878+0000 7f9b1a7fc640 1 -- 172.21.15.31:0/1737133527 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f9b2403a070 con 0x7f9b2806e8e0 2024-09-22T08:36:19.902 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.878+0000 7f46d67fc640 1 --2- 172.21.15.31:0/2272579296 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f46c403e710 0x7f46c4040bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:19.902 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.878+0000 7f3886ffd640 1 -- 172.21.15.31:0/4148167352 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f3888044070 con 0x7f389806f280 2024-09-22T08:36:19.902 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.878+0000 7f46d67fc640 1 -- 172.21.15.31:0/2272579296 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7f46dc051ff0 con 0x7f46e006e170 2024-09-22T08:36:19.902 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.879+0000 7f46d67fc640 1 --2- 172.21.15.31:0/2272579296 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f46c4043e90 0x7f46c4046310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:19.903 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.879+0000 7f46d67fc640 1 -- 172.21.15.31:0/2272579296 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f46c40469e0 con 0x7f46c4043e90 2024-09-22T08:36:19.903 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.879+0000 7f46d67fc640 1 -- 172.21.15.31:0/2272579296 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f46dc059050 con 0x7f46e006e170 2024-09-22T08:36:19.903 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.879+0000 7f3886ffd640 1 --2- 172.21.15.31:0/4148167352 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f387803e710 0x7f3878040bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:19.903 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.879+0000 7f9b1a7fc640 1 --2- 172.21.15.31:0/1737133527 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f9b0c03e760 0x7f9b0c040c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:19.903 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.879+0000 7f9b1a7fc640 1 -- 172.21.15.31:0/1737133527 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7f9b24073a30 con 0x7f9b2806e8e0 2024-09-22T08:36:19.904 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.879+0000 7f3886ffd640 1 -- 172.21.15.31:0/4148167352 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7f3888074110 con 0x7f389806f280 2024-09-22T08:36:19.904 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.879+0000 7f46e65d0640 1 --2- 172.21.15.31:0/2272579296 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f46c4043e90 0x7f46c4046310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:19.904 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.879+0000 7f46e55ce640 1 --2- 172.21.15.31:0/2272579296 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f46c403e710 0x7f46c4040bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:19.904 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.879+0000 7f3886ffd640 1 --2- 172.21.15.31:0/4148167352 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f3878043e90 0x7f3878046310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:19.904 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.879+0000 7f3886ffd640 1 -- 172.21.15.31:0/4148167352 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f388802ad90 con 0x7f3878043e90 2024-09-22T08:36:19.905 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.879+0000 7f3886ffd640 1 -- 172.21.15.31:0/4148167352 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f38880744d0 con 0x7f389806f280 2024-09-22T08:36:19.905 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.879+0000 7f9b1a7fc640 1 --2- 172.21.15.31:0/1737133527 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x7f9b0c043ee0 0x7f9b0c046360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:19.905 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.879+0000 7f9b1a7fc640 1 -- 172.21.15.31:0/1737133527 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9b2402ac60 con 0x7f9b0c043ee0 2024-09-22T08:36:19.905 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.879+0000 7f9b1a7fc640 1 -- 172.21.15.31:0/1737133527 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f9b24073da0 con 0x7f9b2806e8e0 2024-09-22T08:36:19.905 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.879+0000 7f9b2d471640 1 --2- 172.21.15.31:0/1737133527 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f9b0c03e760 0x7f9b0c040c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:19.905 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.879+0000 7f3895d9b640 1 --2- 172.21.15.31:0/4148167352 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f387803e710 0x7f3878040bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:19.906 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.879+0000 7f3896d9d640 1 --2- 172.21.15.31:0/4148167352 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f3878043e90 0x7f3878046310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:19.906 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.879+0000 7eff357fa640 1 -- 172.21.15.31:0/3704068645 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7eff2c007070 con 0x7eff3806f280 2024-09-22T08:36:19.906 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.879+0000 7f9b2e473640 1 --2- 172.21.15.31:0/1737133527 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x7f9b0c043ee0 0x7f9b0c046360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:19.906 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.879+0000 7f46e65d0640 1 --2- 172.21.15.31:0/2272579296 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f46c4043e90 0x7f46c4046310 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:19.907 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.879+0000 7f3895d9b640 1 --2- 172.21.15.31:0/4148167352 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f387803e710 0x7f3878040bd0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f388c007fd0 tx=0x7f388c007aa0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:19.907 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.879+0000 7f9b2d471640 1 --2- 172.21.15.31:0/1737133527 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f9b0c03e760 0x7f9b0c040c20 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f9b1c0017a0 tx=0x7f9b1c007a20 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:19.907 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.880+0000 7eff357fa640 1 --2- 172.21.15.31:0/3704068645 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7eff1c03e710 0x7eff1c040bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:19.907 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.880+0000 7f46e55ce640 1 --2- 172.21.15.31:0/2272579296 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f46c403e710 0x7f46c4040bd0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f46d0034000 tx=0x7f46d002e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:19.908 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.880+0000 7eff357fa640 1 -- 172.21.15.31:0/3704068645 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7eff2c014070 con 0x7eff3806f280 2024-09-22T08:36:19.908 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.880+0000 7f9b2e473640 1 --2- 172.21.15.31:0/1737133527 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x7f9b0c043ee0 0x7f9b0c046360 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:19.908 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.880+0000 7f3896d9d640 1 --2- 172.21.15.31:0/4148167352 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f3878043e90 0x7f3878046310 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:19.909 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.880+0000 7eff357fa640 1 --2- 172.21.15.31:0/3704068645 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x7eff1c043e90 0x7eff1c046310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:19.909 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.880+0000 7eff357fa640 1 -- 172.21.15.31:0/3704068645 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7eff1c0469e0 con 0x7eff1c043e90 2024-09-22T08:36:19.909 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.880+0000 7eff357fa640 1 -- 172.21.15.31:0/3704068645 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7eff2c05b2a0 con 0x7eff3806f280 2024-09-22T08:36:19.909 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.880+0000 7eff37fff640 1 --2- 172.21.15.31:0/3704068645 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7eff1c03e710 0x7eff1c040bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:19.909 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.880+0000 7eff3d294640 1 --2- 172.21.15.31:0/3704068645 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x7eff1c043e90 0x7eff1c046310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:19.909 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.880+0000 7f46d67fc640 1 -- 172.21.15.31:0/2272579296 <== osd.0 v2:172.21.15.31:6800/168281188 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f46c40469e0 con 0x7f46c4043e90 2024-09-22T08:36:19.910 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.881+0000 7eff37fff640 1 --2- 172.21.15.31:0/3704068645 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7eff1c03e710 0x7eff1c040bd0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7eff24009720 tx=0x7eff2402e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:19.910 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.881+0000 7f3886ffd640 1 -- 172.21.15.31:0/4148167352 <== osd.2 v2:172.21.15.142:6808/279438927 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f388802ad90 con 0x7f3878043e90 2024-09-22T08:36:19.910 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.881+0000 7eff3d294640 1 --2- 172.21.15.31:0/3704068645 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x7eff1c043e90 0x7eff1c046310 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:19.911 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.881+0000 7f9b1a7fc640 1 -- 172.21.15.31:0/1737133527 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9b2402ac60 con 0x7f9b0c043ee0 2024-09-22T08:36:19.911 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.881+0000 7eff357fa640 1 -- 172.21.15.31:0/3704068645 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7eff1c0469e0 con 0x7eff1c043e90 2024-09-22T08:36:19.911 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.894+0000 7f46e8033640 1 -- 172.21.15.31:0/2272579296 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f46e0127500 con 0x7f46c4043e90 2024-09-22T08:36:19.911 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.894+0000 7f389cb5d640 1 -- 172.21.15.31:0/4148167352 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f3898097cb0 con 0x7f3878043e90 2024-09-22T08:36:19.912 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.894+0000 7f46d67fc640 1 -- 172.21.15.31:0/2272579296 <== osd.0 v2:172.21.15.31:6800/168281188 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f46e0127500 con 0x7f46c4043e90 2024-09-22T08:36:19.912 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.894+0000 7f9b2fed6640 1 -- 172.21.15.31:0/1737133527 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f9b10002c70 con 0x7f9b0c043ee0 2024-09-22T08:36:19.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.895+0000 7f46e8033640 1 -- 172.21.15.31:0/2272579296 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f46c4043e90 msgr2=0x7f46c4046310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:19.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.895+0000 7f46e8033640 1 --2- 172.21.15.31:0/2272579296 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f46c4043e90 0x7f46c4046310 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:19.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.895+0000 7f46e8033640 1 -- 172.21.15.31:0/2272579296 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f46c403e710 msgr2=0x7f46c4040bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:19.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.895+0000 7f46e8033640 1 --2- 172.21.15.31:0/2272579296 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f46c403e710 0x7f46c4040bd0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f46d0034000 tx=0x7f46d002e000 comp rx=0 tx=0).stop 2024-09-22T08:36:19.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.895+0000 7f46e8033640 1 -- 172.21.15.31:0/2272579296 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f46e006e170 msgr2=0x7f46e0125f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:19.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.895+0000 7f46e8033640 1 --2- 172.21.15.31:0/2272579296 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f46e006e170 0x7f46e0125f70 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f46dc00c480 tx=0x7f46dc00c940 comp rx=0 tx=0).stop 2024-09-22T08:36:19.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.895+0000 7f46e8033640 1 -- 172.21.15.31:0/2272579296 shutdown_connections 2024-09-22T08:36:19.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.895+0000 7f46e8033640 1 --2- 172.21.15.31:0/2272579296 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f46c4043e90 0x7f46c4046310 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:19.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.895+0000 7f46e8033640 1 --2- 172.21.15.31:0/2272579296 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f46c403e710 0x7f46c4040bd0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:19.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.895+0000 7f46e8033640 1 --2- 172.21.15.31:0/2272579296 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f46e006e170 0x7f46e0125f70 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:19.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.895+0000 7f46e8033640 1 -- 172.21.15.31:0/2272579296 >> 172.21.15.31:0/2272579296 conn(0x7f46e009ac80 msgr2=0x7f46e012e760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:19.914 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.895+0000 7f9b1a7fc640 1 -- 172.21.15.31:0/1737133527 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f9b10002c70 con 0x7f9b0c043ee0 2024-09-22T08:36:19.914 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.895+0000 7f3886ffd640 1 -- 172.21.15.31:0/4148167352 <== osd.2 v2:172.21.15.142:6808/279438927 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f3898097cb0 con 0x7f3878043e90 2024-09-22T08:36:19.914 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.895+0000 7f46e8033640 1 -- 172.21.15.31:0/2272579296 shutdown_connections 2024-09-22T08:36:19.914 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.895+0000 7f46e8033640 1 -- 172.21.15.31:0/2272579296 wait complete. 2024-09-22T08:36:19.915 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.895+0000 7f389cb5d640 1 -- 172.21.15.31:0/4148167352 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f3878043e90 msgr2=0x7f3878046310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:19.915 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.895+0000 7f389cb5d640 1 --2- 172.21.15.31:0/4148167352 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f3878043e90 0x7f3878046310 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:19.915 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.895+0000 7f9b2fed6640 1 -- 172.21.15.31:0/1737133527 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x7f9b0c043ee0 msgr2=0x7f9b0c046360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:19.915 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.895+0000 7f9b2fed6640 1 --2- 172.21.15.31:0/1737133527 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x7f9b0c043ee0 0x7f9b0c046360 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:19.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.895+0000 7f389cb5d640 1 -- 172.21.15.31:0/4148167352 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f387803e710 msgr2=0x7f3878040bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:19.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.895+0000 7eff3ecf7640 1 -- 172.21.15.31:0/3704068645 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7eff3808cea0 con 0x7eff1c043e90 2024-09-22T08:36:19.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.895+0000 7f389cb5d640 1 --2- 172.21.15.31:0/4148167352 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f387803e710 0x7f3878040bd0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f388c007fd0 tx=0x7f388c007aa0 comp rx=0 tx=0).stop 2024-09-22T08:36:19.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.895+0000 7f389cb5d640 1 -- 172.21.15.31:0/4148167352 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f389806f280 msgr2=0x7f3898123430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:19.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.895+0000 7f389cb5d640 1 --2- 172.21.15.31:0/4148167352 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f389806f280 0x7f3898123430 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f3888009840 tx=0x7f38880046c0 comp rx=0 tx=0).stop 2024-09-22T08:36:19.917 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.895+0000 7f9b2fed6640 1 -- 172.21.15.31:0/1737133527 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f9b0c03e760 msgr2=0x7f9b0c040c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:19.917 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.895+0000 7f9b2fed6640 1 --2- 172.21.15.31:0/1737133527 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f9b0c03e760 0x7f9b0c040c20 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f9b1c0017a0 tx=0x7f9b1c007a20 comp rx=0 tx=0).stop 2024-09-22T08:36:19.917 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.895+0000 7f9b2fed6640 1 -- 172.21.15.31:0/1737133527 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9b2806e8e0 msgr2=0x7f9b281c4780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:19.917 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.896+0000 7f9b2fed6640 1 --2- 172.21.15.31:0/1737133527 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9b2806e8e0 0x7f9b281c4780 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f9b2402ac30 tx=0x7f9b240046c0 comp rx=0 tx=0).stop 2024-09-22T08:36:19.917 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.896+0000 7f389cb5d640 1 -- 172.21.15.31:0/4148167352 shutdown_connections 2024-09-22T08:36:19.918 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.896+0000 7f9b2fed6640 1 -- 172.21.15.31:0/1737133527 shutdown_connections 2024-09-22T08:36:19.918 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.896+0000 7f9b2fed6640 1 --2- 172.21.15.31:0/1737133527 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x7f9b0c043ee0 0x7f9b0c046360 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:19.918 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.896+0000 7f9b2fed6640 1 --2- 172.21.15.31:0/1737133527 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f9b0c03e760 0x7f9b0c040c20 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:19.918 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.896+0000 7f389cb5d640 1 --2- 172.21.15.31:0/4148167352 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f3878043e90 0x7f3878046310 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:19.918 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.896+0000 7f9b2fed6640 1 --2- 172.21.15.31:0/1737133527 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9b2806e8e0 0x7f9b281c4780 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:19.919 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.896+0000 7f9b2fed6640 1 -- 172.21.15.31:0/1737133527 >> 172.21.15.31:0/1737133527 conn(0x7f9b280a01c0 msgr2=0x7f9b2809dca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:19.919 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.896+0000 7f389cb5d640 1 --2- 172.21.15.31:0/4148167352 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f387803e710 0x7f3878040bd0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:19.919 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.896+0000 7f389cb5d640 1 --2- 172.21.15.31:0/4148167352 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f389806f280 0x7f3898123430 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:19.919 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.896+0000 7f389cb5d640 1 -- 172.21.15.31:0/4148167352 >> 172.21.15.31:0/4148167352 conn(0x7f389809ac80 msgr2=0x7f3898099150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:19.919 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.896+0000 7f9b2fed6640 1 -- 172.21.15.31:0/1737133527 shutdown_connections 2024-09-22T08:36:19.920 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.896+0000 7eff357fa640 1 -- 172.21.15.31:0/3704068645 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7eff3808cea0 con 0x7eff1c043e90 2024-09-22T08:36:19.920 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.896+0000 7f389cb5d640 1 -- 172.21.15.31:0/4148167352 shutdown_connections 2024-09-22T08:36:19.920 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.896+0000 7f9b2fed6640 1 -- 172.21.15.31:0/1737133527 wait complete. 2024-09-22T08:36:19.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.896+0000 7f389cb5d640 1 -- 172.21.15.31:0/4148167352 wait complete. 2024-09-22T08:36:19.922 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.896+0000 7eff3ecf7640 1 -- 172.21.15.31:0/3704068645 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x7eff1c043e90 msgr2=0x7eff1c046310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:19.922 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.896+0000 7eff3ecf7640 1 --2- 172.21.15.31:0/3704068645 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x7eff1c043e90 0x7eff1c046310 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:19.922 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.896+0000 7eff3ecf7640 1 -- 172.21.15.31:0/3704068645 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7eff1c03e710 msgr2=0x7eff1c040bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:19.922 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.896+0000 7eff3ecf7640 1 --2- 172.21.15.31:0/3704068645 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7eff1c03e710 0x7eff1c040bd0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7eff24009720 tx=0x7eff2402e000 comp rx=0 tx=0).stop 2024-09-22T08:36:19.922 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.896+0000 7eff3ecf7640 1 -- 172.21.15.31:0/3704068645 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7eff3806f280 msgr2=0x7eff381bf9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:19.922 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.896+0000 7eff3ecf7640 1 --2- 172.21.15.31:0/3704068645 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7eff3806f280 0x7eff381bf9e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7eff2c0018e0 tx=0x7eff2c001da0 comp rx=0 tx=0).stop 2024-09-22T08:36:19.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.896+0000 7eff3ecf7640 1 -- 172.21.15.31:0/3704068645 shutdown_connections 2024-09-22T08:36:19.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.896+0000 7eff3ecf7640 1 --2- 172.21.15.31:0/3704068645 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x7eff1c043e90 0x7eff1c046310 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:19.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.896+0000 7eff3ecf7640 1 --2- 172.21.15.31:0/3704068645 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7eff1c03e710 0x7eff1c040bd0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:19.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.896+0000 7eff3ecf7640 1 --2- 172.21.15.31:0/3704068645 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7eff3806f280 0x7eff381bf9e0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:19.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.896+0000 7eff3ecf7640 1 -- 172.21.15.31:0/3704068645 >> 172.21.15.31:0/3704068645 conn(0x7eff3809ac80 msgr2=0x7eff380723e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:19.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.897+0000 7eff3ecf7640 1 -- 172.21.15.31:0/3704068645 shutdown_connections 2024-09-22T08:36:19.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:19.897+0000 7eff3ecf7640 1 -- 172.21.15.31:0/3704068645 wait complete. 2024-09-22T08:36:19.924 INFO:teuthology.orchestra.run.smithi031.stdout:38654705669 2024-09-22T08:36:19.924 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-22T08:36:19.925 INFO:teuthology.orchestra.run.smithi031.stdout:47244640262 2024-09-22T08:36:19.925 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-22T08:36:19.926 INFO:teuthology.orchestra.run.smithi031.stdout:38654705669 2024-09-22T08:36:19.926 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-22T08:36:19.927 INFO:teuthology.orchestra.run.smithi031.stdout:47244640262 2024-09-22T08:36:19.927 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-22T08:36:20.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.071+0000 7feaa4d82640 1 Processor -- start 2024-09-22T08:36:20.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.071+0000 7fd6e00ed640 1 Processor -- start 2024-09-22T08:36:20.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.071+0000 7f419f3ec640 1 Processor -- start 2024-09-22T08:36:20.073 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.071+0000 7feaa4d82640 1 -- start start 2024-09-22T08:36:20.073 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.071+0000 7ffb623e2640 1 Processor -- start 2024-09-22T08:36:20.073 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.071+0000 7fd6e00ed640 1 -- start start 2024-09-22T08:36:20.073 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.071+0000 7ffb623e2640 1 -- start start 2024-09-22T08:36:20.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.071+0000 7f419f3ec640 1 -- start start 2024-09-22T08:36:20.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.071+0000 7feaa4d82640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7feaa0132960 0x7feaa0134d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:20.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.072+0000 7feaa4d82640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feaa006ff50 con 0x7feaa006e8e0 2024-09-22T08:36:20.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.072+0000 7fd6e00ed640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fd6d806fd70 0x7fd6d8131660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:20.075 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.072+0000 7feaa4d82640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7feaa0099c10 con 0x7feaa0132960 2024-09-22T08:36:20.075 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.072+0000 7fea9e59c640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7feaa006e8e0 0x7feaa006ecc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:60302/0 (socket says 172.21.15.31:60302) 2024-09-22T08:36:20.075 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.072+0000 7fd6e00ed640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6d8099ee0 con 0x7fd6d806f280 2024-09-22T08:36:20.075 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.072+0000 7fea9e59c640 1 -- 172.21.15.31:0/4234327830 learned_addr learned my addr 172.21.15.31:0/4234327830 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-22T08:36:20.076 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.072+0000 7fd6dde89640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fd6d806f280 0x7fd6d806f660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:60310/0 (socket says 172.21.15.31:60310) 2024-09-22T08:36:20.076 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.072+0000 7fd6dde89640 1 -- 172.21.15.31:0/1006107499 learned_addr learned my addr 172.21.15.31:0/1006107499 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-22T08:36:20.076 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.072+0000 7ffb623e2640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ffb5c06e8e0 0x7ffb5c06ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:20.076 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.072+0000 7fd6e00ed640 1 -- 172.21.15.31:0/1006107499 --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7fd6d8070d00 con 0x7fd6d806fd70 2024-09-22T08:36:20.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.072+0000 7fea9dd9b640 1 --2- 172.21.15.31:0/4234327830 >> v2:172.21.15.31:3300/0 conn(0x7feaa0132960 0x7feaa0134d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:20.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.072+0000 7f419f3ec640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f4198132960 0x7f4198134d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:20.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.072+0000 7f419f3ec640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f419806ff50 con 0x7f419806e8e0 2024-09-22T08:36:20.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.072+0000 7f419f3ec640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f4198099c10 con 0x7f4198132960 2024-09-22T08:36:20.078 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.072+0000 7ffb623e2640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffb5c06ff50 con 0x7ffb5c06f200 2024-09-22T08:36:20.078 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.072+0000 7ffb623e2640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7ffb5c099c10 con 0x7ffb5c06e8e0 2024-09-22T08:36:20.078 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.072+0000 7ffb5bfff640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ffb5c06e8e0 0x7ffb5c06ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:20.078 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.072+0000 7f419c987640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f4198132960 0x7f4198134d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:20.078 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.072+0000 7f419d188640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f419806e8e0 0x7f419806ecc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:60320/0 (socket says 172.21.15.31:60320) 2024-09-22T08:36:20.078 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.072+0000 7f419d188640 1 -- 172.21.15.31:0/1934362573 learned_addr learned my addr 172.21.15.31:0/1934362573 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-22T08:36:20.079 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.072+0000 7fea9d59a640 1 -- 172.21.15.31:0/4234327830 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1196524709 0 0) 0x7feaa006ff50 con 0x7feaa006e8e0 2024-09-22T08:36:20.079 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.072+0000 7fd6dd688640 1 --2- 172.21.15.31:0/1006107499 >> v2:172.21.15.31:3300/0 conn(0x7fd6d806fd70 0x7fd6d8131660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:20.079 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.072+0000 7ffb5bfff640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ffb5c06e8e0 0x7ffb5c06ecc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:48442/0 (socket says 172.21.15.31:48442) 2024-09-22T08:36:20.079 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.072+0000 7fea9d59a640 1 -- 172.21.15.31:0/4234327830 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fea88003520 con 0x7feaa006e8e0 2024-09-22T08:36:20.080 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.072+0000 7fd6dce87640 1 -- 172.21.15.31:0/1006107499 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3319947543 0 0) 0x7fd6d8099ee0 con 0x7fd6d806f280 2024-09-22T08:36:20.080 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.072+0000 7fd6dce87640 1 -- 172.21.15.31:0/1006107499 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd6c4003520 con 0x7fd6d806f280 2024-09-22T08:36:20.080 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.072+0000 7ffb5bfff640 1 -- 172.21.15.31:0/1067796036 learned_addr learned my addr 172.21.15.31:0/1067796036 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-22T08:36:20.080 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.073+0000 7fea9dd9b640 1 -- 172.21.15.31:0/4234327830 >> v1:172.21.15.31:6789/0 conn(0x7feaa006e8e0 legacy=0x7feaa006ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:20.080 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.073+0000 7fea9dd9b640 1 -- 172.21.15.31:0/4234327830 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feaa006f3d0 con 0x7feaa0132960 2024-09-22T08:36:20.081 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.073+0000 7f418ffff640 1 -- 172.21.15.31:0/1934362573 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3769548088 0 0) 0x7f419806ff50 con 0x7f419806e8e0 2024-09-22T08:36:20.081 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.073+0000 7f418ffff640 1 -- 172.21.15.31:0/1934362573 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4184003520 con 0x7f419806e8e0 2024-09-22T08:36:20.081 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.073+0000 7f419c987640 1 -- 172.21.15.31:0/1934362573 >> v1:172.21.15.31:6789/0 conn(0x7f419806e8e0 legacy=0x7f419806ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:20.081 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.073+0000 7f419c987640 1 -- 172.21.15.31:0/1934362573 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f419806f3d0 con 0x7f4198132960 2024-09-22T08:36:20.081 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.073+0000 7fd6dd688640 1 -- 172.21.15.31:0/1006107499 >> v1:172.21.15.31:6789/0 conn(0x7fd6d806f280 legacy=0x7fd6d806f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:20.081 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.073+0000 7fd6dd688640 1 -- 172.21.15.31:0/1006107499 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6d8070f40 con 0x7fd6d806fd70 2024-09-22T08:36:20.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.073+0000 7ffb5affd640 1 -- 172.21.15.31:0/1067796036 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 353087540 0 0) 0x7ffb5c06ff50 con 0x7ffb5c06f200 2024-09-22T08:36:20.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.073+0000 7ffb5affd640 1 -- 172.21.15.31:0/1067796036 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffb44003520 con 0x7ffb5c06f200 2024-09-22T08:36:20.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.074+0000 7fea9dd9b640 1 --2- 172.21.15.31:0/4234327830 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feaa0132960 0x7feaa0134d50 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fea94009720 tx=0x7fea9402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b7c9fb337bf623c server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:20.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.073+0000 7ffb5bfff640 1 -- 172.21.15.31:0/1067796036 >> v1:172.21.15.31:6789/0 conn(0x7ffb5c06f200 legacy=0x7ffb5c12f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:20.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.073+0000 7ffb5bfff640 1 -- 172.21.15.31:0/1067796036 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb5c099710 con 0x7ffb5c06e8e0 2024-09-22T08:36:20.083 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.074+0000 7fea9d59a640 1 -- 172.21.15.31:0/4234327830 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea94037070 con 0x7feaa0132960 2024-09-22T08:36:20.083 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.074+0000 7fd6dd688640 1 --2- 172.21.15.31:0/1006107499 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd6d806fd70 0x7fd6d8131660 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fd6c8009720 tx=0x7fd6c802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd83c360f51490bf server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:20.083 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.074+0000 7fea9d59a640 1 -- 172.21.15.31:0/4234327830 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea9402ad90 con 0x7feaa0132960 2024-09-22T08:36:20.083 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.074+0000 7fea9d59a640 1 -- 172.21.15.31:0/4234327830 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea94032590 con 0x7feaa0132960 2024-09-22T08:36:20.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.074+0000 7fd6dce87640 1 -- 172.21.15.31:0/1006107499 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd6c8037070 con 0x7fd6d806fd70 2024-09-22T08:36:20.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.074+0000 7fd6dce87640 1 -- 172.21.15.31:0/1006107499 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6c802ad90 con 0x7fd6d806fd70 2024-09-22T08:36:20.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.074+0000 7fd6dce87640 1 -- 172.21.15.31:0/1006107499 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd6c8032590 con 0x7fd6d806fd70 2024-09-22T08:36:20.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.074+0000 7f419c987640 1 --2- 172.21.15.31:0/1934362573 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4198132960 0x7f4198134d50 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f4188009720 tx=0x7f418802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b26b763e909eee1 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:20.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.074+0000 7ffb5bfff640 1 --2- 172.21.15.31:0/1067796036 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffb5c06e8e0 0x7ffb5c06ecc0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ffb4c0097f0 tx=0x7ffb4c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe8619ebb20b196f server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:20.085 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.074+0000 7f418ffff640 1 -- 172.21.15.31:0/1934362573 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4188037070 con 0x7f4198132960 2024-09-22T08:36:20.085 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.074+0000 7f418ffff640 1 -- 172.21.15.31:0/1934362573 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f418802ad90 con 0x7f4198132960 2024-09-22T08:36:20.085 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.074+0000 7f418ffff640 1 -- 172.21.15.31:0/1934362573 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4188032590 con 0x7f4198132960 2024-09-22T08:36:20.085 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.074+0000 7ffb5affd640 1 -- 172.21.15.31:0/1067796036 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb4c037070 con 0x7ffb5c06e8e0 2024-09-22T08:36:20.085 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.075+0000 7ffb5affd640 1 -- 172.21.15.31:0/1067796036 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb4c032440 con 0x7ffb5c06e8e0 2024-09-22T08:36:20.085 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.075+0000 7ffb5affd640 1 -- 172.21.15.31:0/1067796036 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb4c032740 con 0x7ffb5c06e8e0 2024-09-22T08:36:20.086 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.075+0000 7feaa4d82640 1 -- 172.21.15.31:0/4234327830 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feaa0132960 msgr2=0x7feaa0134d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:20.086 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.075+0000 7feaa4d82640 1 --2- 172.21.15.31:0/4234327830 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feaa0132960 0x7feaa0134d50 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fea94009720 tx=0x7fea9402a110 comp rx=0 tx=0).stop 2024-09-22T08:36:20.086 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.075+0000 7feaa4d82640 1 -- 172.21.15.31:0/4234327830 shutdown_connections 2024-09-22T08:36:20.086 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.075+0000 7feaa4d82640 1 --2- 172.21.15.31:0/4234327830 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feaa0132960 0x7feaa0134d50 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:20.086 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.075+0000 7feaa4d82640 1 -- 172.21.15.31:0/4234327830 >> 172.21.15.31:0/4234327830 conn(0x7feaa00a01c0 msgr2=0x7feaa00a05d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:20.086 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.075+0000 7feaa4d82640 1 -- 172.21.15.31:0/4234327830 shutdown_connections 2024-09-22T08:36:20.087 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.075+0000 7feaa4d82640 1 -- 172.21.15.31:0/4234327830 wait complete. 2024-09-22T08:36:20.087 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.075+0000 7fd6e00ed640 1 -- 172.21.15.31:0/1006107499 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd6d806fd70 msgr2=0x7fd6d8131660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:20.087 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.075+0000 7fd6e00ed640 1 --2- 172.21.15.31:0/1006107499 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd6d806fd70 0x7fd6d8131660 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fd6c8009720 tx=0x7fd6c802a110 comp rx=0 tx=0).stop 2024-09-22T08:36:20.087 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.075+0000 7fd6e00ed640 1 -- 172.21.15.31:0/1006107499 shutdown_connections 2024-09-22T08:36:20.087 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.075+0000 7fd6e00ed640 1 --2- 172.21.15.31:0/1006107499 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd6d806fd70 0x7fd6d8131660 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:20.087 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.075+0000 7fd6e00ed640 1 -- 172.21.15.31:0/1006107499 >> 172.21.15.31:0/1006107499 conn(0x7fd6d809ac80 msgr2=0x7fd6d8098550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:20.088 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.075+0000 7fd6e00ed640 1 -- 172.21.15.31:0/1006107499 shutdown_connections 2024-09-22T08:36:20.088 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.075+0000 7fd6e00ed640 1 -- 172.21.15.31:0/1006107499 wait complete. 2024-09-22T08:36:20.088 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.075+0000 7f419f3ec640 1 -- 172.21.15.31:0/1934362573 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4198132960 msgr2=0x7f4198134d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:20.088 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.075+0000 7f419f3ec640 1 --2- 172.21.15.31:0/1934362573 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4198132960 0x7f4198134d50 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f4188009720 tx=0x7f418802a110 comp rx=0 tx=0).stop 2024-09-22T08:36:20.088 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.075+0000 7f419f3ec640 1 -- 172.21.15.31:0/1934362573 shutdown_connections 2024-09-22T08:36:20.088 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.075+0000 7f419f3ec640 1 --2- 172.21.15.31:0/1934362573 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4198132960 0x7f4198134d50 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:20.088 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.075+0000 7f419f3ec640 1 -- 172.21.15.31:0/1934362573 >> 172.21.15.31:0/1934362573 conn(0x7f41980a01c0 msgr2=0x7f41980a05d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:20.089 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.075+0000 7ffb623e2640 1 -- 172.21.15.31:0/1067796036 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffb5c06e8e0 msgr2=0x7ffb5c06ecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:20.089 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.075+0000 7ffb623e2640 1 --2- 172.21.15.31:0/1067796036 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffb5c06e8e0 0x7ffb5c06ecc0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ffb4c0097f0 tx=0x7ffb4c02a270 comp rx=0 tx=0).stop 2024-09-22T08:36:20.089 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.075+0000 7f419f3ec640 1 -- 172.21.15.31:0/1934362573 shutdown_connections 2024-09-22T08:36:20.089 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.076+0000 7f419f3ec640 1 -- 172.21.15.31:0/1934362573 wait complete. 2024-09-22T08:36:20.090 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.076+0000 7ffb623e2640 1 -- 172.21.15.31:0/1067796036 shutdown_connections 2024-09-22T08:36:20.090 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.076+0000 7ffb623e2640 1 --2- 172.21.15.31:0/1067796036 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffb5c06e8e0 0x7ffb5c06ecc0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:20.090 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.076+0000 7ffb623e2640 1 -- 172.21.15.31:0/1067796036 >> 172.21.15.31:0/1067796036 conn(0x7ffb5c0a01c0 msgr2=0x7ffb5c0a05d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:20.090 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.076+0000 7ffb623e2640 1 -- 172.21.15.31:0/1067796036 shutdown_connections 2024-09-22T08:36:20.090 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.076+0000 7ffb623e2640 1 -- 172.21.15.31:0/1067796036 wait complete. 2024-09-22T08:36:20.090 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.076+0000 7feaa4d82640 1 Processor -- start 2024-09-22T08:36:20.090 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.076+0000 7feaa4d82640 1 -- start start 2024-09-22T08:36:20.091 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.077+0000 7fd6e00ed640 1 Processor -- start 2024-09-22T08:36:20.091 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.077+0000 7fd6e00ed640 1 -- start start 2024-09-22T08:36:20.091 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.077+0000 7feaa4d82640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feaa006e8e0 0x7feaa012d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:20.091 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.077+0000 7feaa4d82640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7feaa0135410 con 0x7feaa006e8e0 2024-09-22T08:36:20.091 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.077+0000 7f419f3ec640 1 Processor -- start 2024-09-22T08:36:20.092 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.077+0000 7fea9e59c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feaa006e8e0 0x7feaa012d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:20.092 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.077+0000 7f419f3ec640 1 -- start start 2024-09-22T08:36:20.092 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.077+0000 7fea9e59c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feaa006e8e0 0x7feaa012d450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:48452/0 (socket says 172.21.15.31:48452) 2024-09-22T08:36:20.092 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.077+0000 7fea9e59c640 1 -- 172.21.15.31:0/2527289179 learned_addr learned my addr 172.21.15.31:0/2527289179 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-22T08:36:20.093 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.077+0000 7ffb623e2640 1 Processor -- start 2024-09-22T08:36:20.093 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.077+0000 7ffb623e2640 1 -- start start 2024-09-22T08:36:20.093 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.077+0000 7fea9e59c640 1 -- 172.21.15.31:0/2527289179 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feaa012c0e0 con 0x7feaa006e8e0 2024-09-22T08:36:20.093 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.078+0000 7fd6e00ed640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd6d806f280 0x7fd6d81c0430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:20.093 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.078+0000 7fd6e00ed640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fd6d806e2f0 con 0x7fd6d806f280 2024-09-22T08:36:20.094 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.078+0000 7fea9e59c640 1 --2- 172.21.15.31:0/2527289179 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feaa006e8e0 0x7feaa012d450 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fea9000c390 tx=0x7fea9000c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:20.094 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.078+0000 7f419f3ec640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f419806e8e0 0x7f419812d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:20.094 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.078+0000 7fd6dde89640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd6d806f280 0x7fd6d81c0430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:20.094 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.078+0000 7f419f3ec640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f4198135410 con 0x7f419806e8e0 2024-09-22T08:36:20.095 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.078+0000 7fd6dde89640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd6d806f280 0x7fd6d81c0430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:48468/0 (socket says 172.21.15.31:48468) 2024-09-22T08:36:20.095 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.078+0000 7fd6dde89640 1 -- 172.21.15.31:0/3030318767 learned_addr learned my addr 172.21.15.31:0/3030318767 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-22T08:36:20.095 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.078+0000 7f419d188640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f419806e8e0 0x7f419812d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:20.095 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.078+0000 7f419d188640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f419806e8e0 0x7f419812d450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:48478/0 (socket says 172.21.15.31:48478) 2024-09-22T08:36:20.095 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.078+0000 7f419d188640 1 -- 172.21.15.31:0/3559723152 learned_addr learned my addr 172.21.15.31:0/3559723152 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-22T08:36:20.096 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.078+0000 7fea8effd640 1 -- 172.21.15.31:0/2527289179 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea90017070 con 0x7feaa006e8e0 2024-09-22T08:36:20.096 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.078+0000 7fea8effd640 1 -- 172.21.15.31:0/2527289179 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea90005cd0 con 0x7feaa006e8e0 2024-09-22T08:36:20.096 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.078+0000 7fea8effd640 1 -- 172.21.15.31:0/2527289179 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea90007200 con 0x7feaa006e8e0 2024-09-22T08:36:20.096 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.078+0000 7fd6dde89640 1 -- 172.21.15.31:0/3030318767 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6d808caa0 con 0x7fd6d806f280 2024-09-22T08:36:20.096 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.078+0000 7ffb623e2640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffb5c06e8e0 0x7ffb5c08ca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:20.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.078+0000 7ffb623e2640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7ffb5c1300f0 con 0x7ffb5c06e8e0 2024-09-22T08:36:20.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.078+0000 7feaa4d82640 1 -- 172.21.15.31:0/2527289179 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feaa0129f90 con 0x7feaa006e8e0 2024-09-22T08:36:20.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.078+0000 7feaa4d82640 1 -- 172.21.15.31:0/2527289179 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feaa012eab0 con 0x7feaa006e8e0 2024-09-22T08:36:20.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.078+0000 7fd6dde89640 1 --2- 172.21.15.31:0/3030318767 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd6d806f280 0x7fd6d81c0430 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fd6d4001eb0 tx=0x7fd6d400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:20.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.078+0000 7f419d188640 1 -- 172.21.15.31:0/3559723152 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f419812c0e0 con 0x7f419806e8e0 2024-09-22T08:36:20.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.079+0000 7ffb5bfff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffb5c06e8e0 0x7ffb5c08ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:20.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.079+0000 7ffb5bfff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffb5c06e8e0 0x7ffb5c08ca50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:48484/0 (socket says 172.21.15.31:48484) 2024-09-22T08:36:20.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.079+0000 7ffb5bfff640 1 -- 172.21.15.31:0/2666927288 learned_addr learned my addr 172.21.15.31:0/2666927288 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-22T08:36:20.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.079+0000 7f419d188640 1 --2- 172.21.15.31:0/3559723152 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f419806e8e0 0x7f419812d450 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f419400c390 tx=0x7f419400c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:20.099 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.079+0000 7fd6ce7fc640 1 -- 172.21.15.31:0/3030318767 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd6d4007410 con 0x7fd6d806f280 2024-09-22T08:36:20.099 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.079+0000 7fd6ce7fc640 1 -- 172.21.15.31:0/3030318767 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6d40075d0 con 0x7fd6d806f280 2024-09-22T08:36:20.099 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.079+0000 7fd6ce7fc640 1 -- 172.21.15.31:0/3030318767 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd6d4004950 con 0x7fd6d806f280 2024-09-22T08:36:20.099 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.079+0000 7fd6e00ed640 1 -- 172.21.15.31:0/3030318767 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6d808d480 con 0x7fd6d806f280 2024-09-22T08:36:20.099 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.079+0000 7fd6e00ed640 1 -- 172.21.15.31:0/3030318767 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6d81c0970 con 0x7fd6d806f280 2024-09-22T08:36:20.099 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.079+0000 7f418dffb640 1 -- 172.21.15.31:0/3559723152 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4194017070 con 0x7f419806e8e0 2024-09-22T08:36:20.100 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.079+0000 7f418dffb640 1 -- 172.21.15.31:0/3559723152 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4194005cd0 con 0x7f419806e8e0 2024-09-22T08:36:20.100 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.079+0000 7f418dffb640 1 -- 172.21.15.31:0/3559723152 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4194007200 con 0x7f419806e8e0 2024-09-22T08:36:20.100 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.079+0000 7ffb5bfff640 1 -- 172.21.15.31:0/2666927288 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb5c08e8d0 con 0x7ffb5c06e8e0 2024-09-22T08:36:20.100 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.080+0000 7feaa4d82640 1 -- 172.21.15.31:0/2527289179 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feaa006ecc0 con 0x7feaa006e8e0 2024-09-22T08:36:20.100 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.080+0000 7ffb5bfff640 1 --2- 172.21.15.31:0/2666927288 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffb5c06e8e0 0x7ffb5c08ca50 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7ffb4c0097f0 tx=0x7ffb4c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:20.101 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.080+0000 7f419f3ec640 1 -- 172.21.15.31:0/3559723152 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4198129f90 con 0x7f419806e8e0 2024-09-22T08:36:20.101 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.080+0000 7fea8effd640 1 -- 172.21.15.31:0/2527289179 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fea9001a070 con 0x7feaa006e8e0 2024-09-22T08:36:20.101 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.080+0000 7fd6e00ed640 1 -- 172.21.15.31:0/3030318767 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6d8098590 con 0x7fd6d806f280 2024-09-22T08:36:20.101 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.080+0000 7fea8effd640 1 --2- 172.21.15.31:0/2527289179 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fea8003e760 0x7fea80040c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:20.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.080+0000 7fd6ce7fc640 1 -- 172.21.15.31:0/3030318767 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fd6d4011070 con 0x7fd6d806f280 2024-09-22T08:36:20.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.080+0000 7fea8effd640 1 -- 172.21.15.31:0/2527289179 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7fea90052000 con 0x7feaa006e8e0 2024-09-22T08:36:20.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.081+0000 7ffb58ff9640 1 -- 172.21.15.31:0/2666927288 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb4c041070 con 0x7ffb5c06e8e0 2024-09-22T08:36:20.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.081+0000 7f419f3ec640 1 -- 172.21.15.31:0/3559723152 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f419812eab0 con 0x7f419806e8e0 2024-09-22T08:36:20.103 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.081+0000 7fd6ce7fc640 1 --2- 172.21.15.31:0/3030318767 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fd6bc03e760 0x7fd6bc040c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:20.103 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.081+0000 7fd6ce7fc640 1 -- 172.21.15.31:0/3030318767 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7fd6d40529b0 con 0x7fd6d806f280 2024-09-22T08:36:20.103 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.081+0000 7fea9dd9b640 1 --2- 172.21.15.31:0/2527289179 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fea8003e760 0x7fea80040c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:20.103 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.081+0000 7f418dffb640 1 -- 172.21.15.31:0/3559723152 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f419401a070 con 0x7f419806e8e0 2024-09-22T08:36:20.104 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.081+0000 7ffb623e2640 1 -- 172.21.15.31:0/2666927288 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb5c08f2b0 con 0x7ffb5c06e8e0 2024-09-22T08:36:20.104 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.081+0000 7ffb623e2640 1 -- 172.21.15.31:0/2666927288 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb5c08f580 con 0x7ffb5c06e8e0 2024-09-22T08:36:20.104 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.081+0000 7fd6dd688640 1 --2- 172.21.15.31:0/3030318767 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fd6bc03e760 0x7fd6bc040c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:20.104 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.081+0000 7fea9dd9b640 1 --2- 172.21.15.31:0/2527289179 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fea8003e760 0x7fea80040c20 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fea94034000 tx=0x7fea9402e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:20.105 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.081+0000 7f418dffb640 1 --2- 172.21.15.31:0/3559723152 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f417c03e760 0x7f417c040c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:20.105 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.082+0000 7f417b7fe640 1 -- 172.21.15.31:0/3559723152 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4174005080 con 0x7f419806e8e0 2024-09-22T08:36:20.105 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.082+0000 7f419c987640 1 --2- 172.21.15.31:0/3559723152 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f417c03e760 0x7f417c040c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:20.105 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.082+0000 7fd6dd688640 1 --2- 172.21.15.31:0/3030318767 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fd6bc03e760 0x7fd6bc040c20 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fd6c8009720 tx=0x7fd6c802e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:20.105 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.082+0000 7f419c987640 1 --2- 172.21.15.31:0/3559723152 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f417c03e760 0x7f417c040c20 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f4188034000 tx=0x7f418802e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:20.105 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.082+0000 7ffb623e2640 1 -- 172.21.15.31:0/2666927288 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb5c06ecc0 con 0x7ffb5c06e8e0 2024-09-22T08:36:20.106 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.086+0000 7fea8effd640 1 -- 172.21.15.31:0/2527289179 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fea9001b3b0 con 0x7feaa006e8e0 2024-09-22T08:36:20.106 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.090+0000 7ffb58ff9640 1 -- 172.21.15.31:0/2666927288 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb4c032440 con 0x7ffb5c06e8e0 2024-09-22T08:36:20.106 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.090+0000 7ffb58ff9640 1 -- 172.21.15.31:0/2666927288 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb4c04b060 con 0x7ffb5c06e8e0 2024-09-22T08:36:20.106 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.090+0000 7f418dffb640 1 -- 172.21.15.31:0/3559723152 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7f4194050ce0 con 0x7f419806e8e0 2024-09-22T08:36:20.107 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.090+0000 7fd6ce7fc640 1 -- 172.21.15.31:0/3030318767 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fd6d8098590 con 0x7fd6d806f280 2024-09-22T08:36:20.107 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.095+0000 7f418dffb640 1 -- 172.21.15.31:0/3559723152 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f4194011360 con 0x7f419806e8e0 2024-09-22T08:36:20.107 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.096+0000 7ffb58ff9640 1 -- 172.21.15.31:0/2666927288 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7ffb4c044070 con 0x7ffb5c06e8e0 2024-09-22T08:36:20.107 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.096+0000 7ffb58ff9640 1 --2- 172.21.15.31:0/2666927288 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7ffb4803e710 0x7ffb48040bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:20.107 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.096+0000 7ffb58ff9640 1 -- 172.21.15.31:0/2666927288 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7ffb4c073d20 con 0x7ffb5c06e8e0 2024-09-22T08:36:20.108 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.096+0000 7ffb5b7fe640 1 --2- 172.21.15.31:0/2666927288 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7ffb4803e710 0x7ffb48040bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:20.108 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.097+0000 7ffb5b7fe640 1 --2- 172.21.15.31:0/2666927288 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7ffb4803e710 0x7ffb48040bd0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7ffb50007fd0 tx=0x7ffb500078e0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:20.108 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.099+0000 7ffb58ff9640 1 -- 172.21.15.31:0/2666927288 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7ffb4c04ce50 con 0x7ffb5c06e8e0 2024-09-22T08:36:20.283 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.282+0000 7fd6e00ed640 1 -- 172.21.15.31:0/3030318767 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fd6d808c350 con 0x7fd6d806f280 2024-09-22T08:36:20.284 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.282+0000 7fd6ce7fc640 1 -- 172.21.15.31:0/3030318767 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fd6d4011c60 con 0x7fd6d806f280 2024-09-22T08:36:20.284 INFO:teuthology.orchestra.run.smithi031.stdout:47244640261 2024-09-22T08:36:20.287 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.285+0000 7fd6e00ed640 1 -- 172.21.15.31:0/3030318767 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fd6bc03e760 msgr2=0x7fd6bc040c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:20.287 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.286+0000 7fd6e00ed640 1 --2- 172.21.15.31:0/3030318767 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fd6bc03e760 0x7fd6bc040c20 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fd6c8009720 tx=0x7fd6c802e000 comp rx=0 tx=0).stop 2024-09-22T08:36:20.287 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.286+0000 7fd6e00ed640 1 -- 172.21.15.31:0/3030318767 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd6d806f280 msgr2=0x7fd6d81c0430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:20.287 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.286+0000 7fd6e00ed640 1 --2- 172.21.15.31:0/3030318767 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd6d806f280 0x7fd6d81c0430 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fd6d4001eb0 tx=0x7fd6d400c8e0 comp rx=0 tx=0).stop 2024-09-22T08:36:20.287 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.286+0000 7fd6e00ed640 1 -- 172.21.15.31:0/3030318767 shutdown_connections 2024-09-22T08:36:20.287 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.286+0000 7fd6e00ed640 1 --2- 172.21.15.31:0/3030318767 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fd6bc03e760 0x7fd6bc040c20 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:20.287 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.286+0000 7fd6e00ed640 1 --2- 172.21.15.31:0/3030318767 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd6d806f280 0x7fd6d81c0430 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:20.288 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.286+0000 7fd6e00ed640 1 -- 172.21.15.31:0/3030318767 >> 172.21.15.31:0/3030318767 conn(0x7fd6d809ac80 msgr2=0x7fd6d809c270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:20.288 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.286+0000 7fd6e00ed640 1 -- 172.21.15.31:0/3030318767 shutdown_connections 2024-09-22T08:36:20.288 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.286+0000 7fd6e00ed640 1 -- 172.21.15.31:0/3030318767 wait complete. 2024-09-22T08:36:20.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.290+0000 7ffb623e2640 1 -- 172.21.15.31:0/2666927288 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7ffb5c08e180 con 0x7ffb5c06e8e0 2024-09-22T08:36:20.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.290+0000 7ffb58ff9640 1 -- 172.21.15.31:0/2666927288 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ffb4c050480 con 0x7ffb5c06e8e0 2024-09-22T08:36:20.292 INFO:teuthology.orchestra.run.smithi031.stdout:47244640261 2024-09-22T08:36:20.294 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.293+0000 7ffb623e2640 1 -- 172.21.15.31:0/2666927288 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7ffb4803e710 msgr2=0x7ffb48040bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:20.294 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.293+0000 7ffb623e2640 1 --2- 172.21.15.31:0/2666927288 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7ffb4803e710 0x7ffb48040bd0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7ffb50007fd0 tx=0x7ffb500078e0 comp rx=0 tx=0).stop 2024-09-22T08:36:20.294 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.293+0000 7ffb623e2640 1 -- 172.21.15.31:0/2666927288 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffb5c06e8e0 msgr2=0x7ffb5c08ca50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:20.294 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.293+0000 7ffb623e2640 1 --2- 172.21.15.31:0/2666927288 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffb5c06e8e0 0x7ffb5c08ca50 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7ffb4c0097f0 tx=0x7ffb4c0046c0 comp rx=0 tx=0).stop 2024-09-22T08:36:20.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.293+0000 7ffb623e2640 1 -- 172.21.15.31:0/2666927288 shutdown_connections 2024-09-22T08:36:20.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.293+0000 7ffb623e2640 1 --2- 172.21.15.31:0/2666927288 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7ffb4803e710 0x7ffb48040bd0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:20.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.293+0000 7ffb623e2640 1 --2- 172.21.15.31:0/2666927288 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffb5c06e8e0 0x7ffb5c08ca50 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:20.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.293+0000 7ffb623e2640 1 -- 172.21.15.31:0/2666927288 >> 172.21.15.31:0/2666927288 conn(0x7ffb5c0a01c0 msgr2=0x7ffb5c09dab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:20.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.293+0000 7ffb623e2640 1 -- 172.21.15.31:0/2666927288 shutdown_connections 2024-09-22T08:36:20.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.293+0000 7ffb623e2640 1 -- 172.21.15.31:0/2666927288 wait complete. 2024-09-22T08:36:20.302 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640262 got 47244640261 for osd.1 2024-09-22T08:36:20.305 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640262 got 47244640261 for osd.2 2024-09-22T08:36:20.306 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.305+0000 7feaa4d82640 1 -- 172.21.15.31:0/2527289179 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7feaa012ed40 con 0x7feaa006e8e0 2024-09-22T08:36:20.307 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.306+0000 7fea8effd640 1 -- 172.21.15.31:0/2527289179 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fea9001b730 con 0x7feaa006e8e0 2024-09-22T08:36:20.307 INFO:teuthology.orchestra.run.smithi031.stdout:38654705668 2024-09-22T08:36:20.308 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.307+0000 7f417b7fe640 1 -- 172.21.15.31:0/3559723152 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f4174005640 con 0x7f419806e8e0 2024-09-22T08:36:20.308 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.307+0000 7f418dffb640 1 -- 172.21.15.31:0/3559723152 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f419401bdd0 con 0x7f419806e8e0 2024-09-22T08:36:20.308 INFO:teuthology.orchestra.run.smithi031.stdout:38654705668 2024-09-22T08:36:20.309 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.308+0000 7feaa4d82640 1 -- 172.21.15.31:0/2527289179 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fea8003e760 msgr2=0x7fea80040c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:20.309 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.308+0000 7feaa4d82640 1 --2- 172.21.15.31:0/2527289179 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fea8003e760 0x7fea80040c20 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fea94034000 tx=0x7fea9402e000 comp rx=0 tx=0).stop 2024-09-22T08:36:20.310 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.308+0000 7feaa4d82640 1 -- 172.21.15.31:0/2527289179 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feaa006e8e0 msgr2=0x7feaa012d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:20.310 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.308+0000 7feaa4d82640 1 --2- 172.21.15.31:0/2527289179 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feaa006e8e0 0x7feaa012d450 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fea9000c390 tx=0x7fea9000c850 comp rx=0 tx=0).stop 2024-09-22T08:36:20.310 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.308+0000 7feaa4d82640 1 -- 172.21.15.31:0/2527289179 shutdown_connections 2024-09-22T08:36:20.310 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.308+0000 7feaa4d82640 1 --2- 172.21.15.31:0/2527289179 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fea8003e760 0x7fea80040c20 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:20.310 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.308+0000 7feaa4d82640 1 --2- 172.21.15.31:0/2527289179 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feaa006e8e0 0x7feaa012d450 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:20.310 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.308+0000 7feaa4d82640 1 -- 172.21.15.31:0/2527289179 >> 172.21.15.31:0/2527289179 conn(0x7feaa00a01c0 msgr2=0x7feaa0134310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:20.310 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.308+0000 7feaa4d82640 1 -- 172.21.15.31:0/2527289179 shutdown_connections 2024-09-22T08:36:20.310 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.308+0000 7feaa4d82640 1 -- 172.21.15.31:0/2527289179 wait complete. 2024-09-22T08:36:20.311 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.309+0000 7f417b7fe640 1 -- 172.21.15.31:0/3559723152 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f417c03e760 msgr2=0x7f417c040c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:20.311 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.309+0000 7f417b7fe640 1 --2- 172.21.15.31:0/3559723152 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f417c03e760 0x7f417c040c20 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f4188034000 tx=0x7f418802e000 comp rx=0 tx=0).stop 2024-09-22T08:36:20.311 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.309+0000 7f417b7fe640 1 -- 172.21.15.31:0/3559723152 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f419806e8e0 msgr2=0x7f419812d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:20.311 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.309+0000 7f417b7fe640 1 --2- 172.21.15.31:0/3559723152 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f419806e8e0 0x7f419812d450 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f419400c390 tx=0x7f419400c850 comp rx=0 tx=0).stop 2024-09-22T08:36:20.311 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.309+0000 7f417b7fe640 1 -- 172.21.15.31:0/3559723152 shutdown_connections 2024-09-22T08:36:20.311 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.309+0000 7f417b7fe640 1 --2- 172.21.15.31:0/3559723152 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f417c03e760 0x7f417c040c20 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:20.311 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.309+0000 7f417b7fe640 1 --2- 172.21.15.31:0/3559723152 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f419806e8e0 0x7f419812d450 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:20.311 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.309+0000 7f417b7fe640 1 -- 172.21.15.31:0/3559723152 >> 172.21.15.31:0/3559723152 conn(0x7f41980a01c0 msgr2=0x7f4198134310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:20.311 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.310+0000 7f417b7fe640 1 -- 172.21.15.31:0/3559723152 shutdown_connections 2024-09-22T08:36:20.312 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:20.310+0000 7f417b7fe640 1 -- 172.21.15.31:0/3559723152 wait complete. 2024-09-22T08:36:20.321 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705668 for osd.3 2024-09-22T08:36:20.322 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705668 for osd.0 2024-09-22T08:36:21.303 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-22T08:36:21.305 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-22T08:36:21.322 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-22T08:36:21.322 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-22T08:36:21.423 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.421+0000 7f8133b2b640 1 Processor -- start 2024-09-22T08:36:21.423 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.422+0000 7f93c22d6640 1 Processor -- start 2024-09-22T08:36:21.423 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.422+0000 7f8133b2b640 1 -- start start 2024-09-22T08:36:21.423 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.422+0000 7f93c22d6640 1 -- start start 2024-09-22T08:36:21.424 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.422+0000 7f8133b2b640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f812c132960 0x7f812c134d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:21.424 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.422+0000 7f8133b2b640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f812c06ff50 con 0x7f812c06e8e0 2024-09-22T08:36:21.424 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.422+0000 7f8133b2b640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f812c099c10 con 0x7f812c132960 2024-09-22T08:36:21.424 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.422+0000 7f93c22d6640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f93bc130160 0x7f93bc130540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:21.424 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.422+0000 7f93c22d6640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f93bc098e80 con 0x7f93bc130a80 2024-09-22T08:36:21.425 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.422+0000 7f93c22d6640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f93bc099450 con 0x7f93bc130160 2024-09-22T08:36:21.425 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.422+0000 7f81318c7640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f812c06e8e0 0x7f812c06ecc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:60352/0 (socket says 172.21.15.31:60352) 2024-09-22T08:36:21.425 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.422+0000 7f81310c6640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f812c132960 0x7f812c134d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:21.425 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.422+0000 7f81318c7640 1 -- 172.21.15.31:0/2464538028 learned_addr learned my addr 172.21.15.31:0/2464538028 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-22T08:36:21.426 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.422+0000 7f93bbfff640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f93bc130160 0x7f93bc130540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:21.426 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.422+0000 7f93bb7fe640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f93bc130a80 0x7f93bc097280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:60360/0 (socket says 172.21.15.31:60360) 2024-09-22T08:36:21.426 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.422+0000 7f93bb7fe640 1 -- 172.21.15.31:0/2895693338 learned_addr learned my addr 172.21.15.31:0/2895693338 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-22T08:36:21.426 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.423+0000 7f81310c6640 1 -- 172.21.15.31:0/2464538028 >> v1:172.21.15.31:6789/0 conn(0x7f812c06e8e0 legacy=0x7f812c06ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:21.426 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.423+0000 7f81310c6640 1 -- 172.21.15.31:0/2464538028 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f812c06f3d0 con 0x7f812c132960 2024-09-22T08:36:21.426 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.423+0000 7f93baffd640 1 -- 172.21.15.31:0/2895693338 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4161127092 0 0) 0x7f93bc098e80 con 0x7f93bc130a80 2024-09-22T08:36:21.426 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.423+0000 7f93bbfff640 1 -- 172.21.15.31:0/2895693338 >> v1:172.21.15.31:6789/0 conn(0x7f93bc130a80 legacy=0x7f93bc097280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:21.426 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.423+0000 7f93bbfff640 1 -- 172.21.15.31:0/2895693338 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93bc097990 con 0x7f93bc130160 2024-09-22T08:36:21.427 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.424+0000 7f81310c6640 1 --2- 172.21.15.31:0/2464538028 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f812c132960 0x7f812c134d50 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f811c009720 tx=0x7f811c02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6a4985c058eedb9 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:21.427 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.424+0000 7f93bbfff640 1 --2- 172.21.15.31:0/2895693338 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f93bc130160 0x7f93bc130540 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f93ac009720 tx=0x7f93ac02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=556c818b37a9330c server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:21.427 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.424+0000 7f81308c5640 1 -- 172.21.15.31:0/2464538028 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f811c037070 con 0x7f812c132960 2024-09-22T08:36:21.427 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.424+0000 7f81308c5640 1 -- 172.21.15.31:0/2464538028 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f811c02ad90 con 0x7f812c132960 2024-09-22T08:36:21.428 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.424+0000 7f81308c5640 1 -- 172.21.15.31:0/2464538028 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f811c032590 con 0x7f812c132960 2024-09-22T08:36:21.428 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.424+0000 7f93baffd640 1 -- 172.21.15.31:0/2895693338 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f93ac037070 con 0x7f93bc130160 2024-09-22T08:36:21.428 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.424+0000 7f93baffd640 1 -- 172.21.15.31:0/2895693338 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93ac02ad90 con 0x7f93bc130160 2024-09-22T08:36:21.428 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.424+0000 7f93baffd640 1 -- 172.21.15.31:0/2895693338 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f93ac032590 con 0x7f93bc130160 2024-09-22T08:36:21.428 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.425+0000 7f93c22d6640 1 -- 172.21.15.31:0/2895693338 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f93bc130160 msgr2=0x7f93bc130540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:21.429 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.425+0000 7f93c22d6640 1 --2- 172.21.15.31:0/2895693338 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f93bc130160 0x7f93bc130540 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f93ac009720 tx=0x7f93ac02a110 comp rx=0 tx=0).stop 2024-09-22T08:36:21.429 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.425+0000 7f93c22d6640 1 -- 172.21.15.31:0/2895693338 shutdown_connections 2024-09-22T08:36:21.429 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.425+0000 7f93c22d6640 1 --2- 172.21.15.31:0/2895693338 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f93bc130160 0x7f93bc130540 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:21.429 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.425+0000 7f93c22d6640 1 -- 172.21.15.31:0/2895693338 >> 172.21.15.31:0/2895693338 conn(0x7f93bc09ff60 msgr2=0x7f93bc0a0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:21.429 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.425+0000 7f8133b2b640 1 -- 172.21.15.31:0/2464538028 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f812c132960 msgr2=0x7f812c134d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:21.429 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.425+0000 7f8133b2b640 1 --2- 172.21.15.31:0/2464538028 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f812c132960 0x7f812c134d50 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f811c009720 tx=0x7f811c02a110 comp rx=0 tx=0).stop 2024-09-22T08:36:21.430 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.425+0000 7f93c22d6640 1 -- 172.21.15.31:0/2895693338 shutdown_connections 2024-09-22T08:36:21.430 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.425+0000 7f93c22d6640 1 -- 172.21.15.31:0/2895693338 wait complete. 2024-09-22T08:36:21.430 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.425+0000 7f8133b2b640 1 -- 172.21.15.31:0/2464538028 shutdown_connections 2024-09-22T08:36:21.430 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.425+0000 7f8133b2b640 1 --2- 172.21.15.31:0/2464538028 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f812c132960 0x7f812c134d50 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:21.430 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.425+0000 7f8133b2b640 1 -- 172.21.15.31:0/2464538028 >> 172.21.15.31:0/2464538028 conn(0x7f812c0a01c0 msgr2=0x7f812c0a05d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:21.430 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.425+0000 7f8133b2b640 1 -- 172.21.15.31:0/2464538028 shutdown_connections 2024-09-22T08:36:21.430 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.425+0000 7f8133b2b640 1 -- 172.21.15.31:0/2464538028 wait complete. 2024-09-22T08:36:21.431 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.427+0000 7f93c22d6640 1 Processor -- start 2024-09-22T08:36:21.431 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.427+0000 7f8133b2b640 1 Processor -- start 2024-09-22T08:36:21.431 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.427+0000 7f8133b2b640 1 -- start start 2024-09-22T08:36:21.431 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.427+0000 7f93c22d6640 1 -- start start 2024-09-22T08:36:21.432 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.427+0000 7f8133b2b640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f812c06e8e0 0x7f812c12be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:21.432 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.427+0000 7f8133b2b640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f812c135410 con 0x7f812c06e8e0 2024-09-22T08:36:21.432 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.428+0000 7f93c22d6640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f93bc130160 0x7f93bc0926c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:21.432 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.428+0000 7f93c22d6640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f93bc0980a0 con 0x7f93bc130160 2024-09-22T08:36:21.433 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.428+0000 7f81318c7640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f812c06e8e0 0x7f812c12be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:21.433 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.428+0000 7f81318c7640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f812c06e8e0 0x7f812c12be90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:48496/0 (socket says 172.21.15.31:48496) 2024-09-22T08:36:21.433 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.428+0000 7f81318c7640 1 -- 172.21.15.31:0/949264779 learned_addr learned my addr 172.21.15.31:0/949264779 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-22T08:36:21.433 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.428+0000 7f93bbfff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f93bc130160 0x7f93bc0926c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:21.433 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.428+0000 7f93bbfff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f93bc130160 0x7f93bc0926c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:48498/0 (socket says 172.21.15.31:48498) 2024-09-22T08:36:21.433 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.428+0000 7f93bbfff640 1 -- 172.21.15.31:0/651592550 learned_addr learned my addr 172.21.15.31:0/651592550 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-22T08:36:21.434 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.428+0000 7f81318c7640 1 -- 172.21.15.31:0/949264779 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f812c129f90 con 0x7f812c06e8e0 2024-09-22T08:36:21.434 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.428+0000 7f93bbfff640 1 -- 172.21.15.31:0/651592550 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93bc094d90 con 0x7f93bc130160 2024-09-22T08:36:21.434 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.428+0000 7f81318c7640 1 --2- 172.21.15.31:0/949264779 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f812c06e8e0 0x7f812c12be90 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f8128001eb0 tx=0x7f812800c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:21.434 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.428+0000 7f93bbfff640 1 --2- 172.21.15.31:0/651592550 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f93bc130160 0x7f93bc0926c0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f93ac009720 tx=0x7f93ac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:21.435 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.429+0000 7f81227fc640 1 -- 172.21.15.31:0/949264779 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8128017070 con 0x7f812c06e8e0 2024-09-22T08:36:21.435 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.429+0000 7f81227fc640 1 -- 172.21.15.31:0/949264779 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8128005c10 con 0x7f812c06e8e0 2024-09-22T08:36:21.435 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.429+0000 7f8133b2b640 1 -- 172.21.15.31:0/949264779 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f812c12e950 con 0x7f812c06e8e0 2024-09-22T08:36:21.435 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.429+0000 7f93b8ff9640 1 -- 172.21.15.31:0/651592550 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f93ac041070 con 0x7f93bc130160 2024-09-22T08:36:21.436 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.429+0000 7f8133b2b640 1 -- 172.21.15.31:0/949264779 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f812c12c5b0 con 0x7f812c06e8e0 2024-09-22T08:36:21.436 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.429+0000 7f93b8ff9640 1 -- 172.21.15.31:0/651592550 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93ac03c460 con 0x7f93bc130160 2024-09-22T08:36:21.436 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.429+0000 7f81227fc640 1 -- 172.21.15.31:0/949264779 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f81280070d0 con 0x7f812c06e8e0 2024-09-22T08:36:21.437 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.429+0000 7f93b8ff9640 1 -- 172.21.15.31:0/651592550 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f93ac037040 con 0x7f93bc130160 2024-09-22T08:36:21.437 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.429+0000 7f93c22d6640 1 -- 172.21.15.31:0/651592550 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93bc095cc0 con 0x7f93bc130160 2024-09-22T08:36:21.437 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.429+0000 7f93c22d6640 1 -- 172.21.15.31:0/651592550 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93bc095fd0 con 0x7f93bc130160 2024-09-22T08:36:21.437 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.430+0000 7f8133b2b640 1 -- 172.21.15.31:0/949264779 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f812c12f460 con 0x7f812c06e8e0 2024-09-22T08:36:21.438 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.430+0000 7f93b8ff9640 1 -- 172.21.15.31:0/651592550 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f93ac044070 con 0x7f93bc130160 2024-09-22T08:36:21.438 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.431+0000 7f93b8ff9640 1 --2- 172.21.15.31:0/651592550 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f93a803e760 0x7f93a8040c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:21.438 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.431+0000 7f93b8ff9640 1 -- 172.21.15.31:0/651592550 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7f93ac073820 con 0x7f93bc130160 2024-09-22T08:36:21.438 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.431+0000 7f93c22d6640 1 -- 172.21.15.31:0/651592550 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f93bc130540 con 0x7f93bc130160 2024-09-22T08:36:21.438 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.431+0000 7f93bb7fe640 1 --2- 172.21.15.31:0/651592550 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f93a803e760 0x7f93a8040c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:21.438 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.431+0000 7f81227fc640 1 -- 172.21.15.31:0/949264779 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f812801a070 con 0x7f812c06e8e0 2024-09-22T08:36:21.438 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.432+0000 7f81227fc640 1 --2- 172.21.15.31:0/949264779 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f811003e760 0x7f8110040c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:21.439 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.432+0000 7f93bb7fe640 1 --2- 172.21.15.31:0/651592550 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f93a803e760 0x7f93a8040c20 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f93b0000c00 tx=0x7f93b00078f0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:21.439 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.432+0000 7f81227fc640 1 -- 172.21.15.31:0/949264779 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7f8128052040 con 0x7f812c06e8e0 2024-09-22T08:36:21.439 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.432+0000 7f81310c6640 1 --2- 172.21.15.31:0/949264779 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f811003e760 0x7f8110040c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:21.439 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.432+0000 7f81310c6640 1 --2- 172.21.15.31:0/949264779 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f811003e760 0x7f8110040c20 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f811c034000 tx=0x7f811c02e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:21.440 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.438+0000 7f93b8ff9640 1 -- 172.21.15.31:0/651592550 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f93ac03ce70 con 0x7f93bc130160 2024-09-22T08:36:21.443 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.442+0000 7f81227fc640 1 -- 172.21.15.31:0/949264779 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f812801b3b0 con 0x7f812c06e8e0 2024-09-22T08:36:21.464 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.463+0000 7f08967f4640 1 Processor -- start 2024-09-22T08:36:21.464 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.463+0000 7fd31a2a9640 1 Processor -- start 2024-09-22T08:36:21.465 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.463+0000 7fd31a2a9640 1 -- start start 2024-09-22T08:36:21.465 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.463+0000 7f08967f4640 1 -- start start 2024-09-22T08:36:21.465 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.464+0000 7fd31a2a9640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fd31406e8e0 0x7fd31406ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:21.465 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.464+0000 7f08967f4640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f08900975c0 0x7f08900979a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:21.466 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.464+0000 7fd31a2a9640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd31406ff50 con 0x7fd31406f200 2024-09-22T08:36:21.466 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.464+0000 7f08967f4640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0890099ee0 con 0x7f089006e170 2024-09-22T08:36:21.466 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.464+0000 7f08967f4640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f0890070960 con 0x7f08900975c0 2024-09-22T08:36:21.466 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.464+0000 7f088f7fe640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f089006e170 0x7f089006e5c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:60374/0 (socket says 172.21.15.31:60374) 2024-09-22T08:36:21.466 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.464+0000 7f088f7fe640 1 -- 172.21.15.31:0/2072867724 learned_addr learned my addr 172.21.15.31:0/2072867724 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-22T08:36:21.466 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.464+0000 7f088ffff640 1 --2- 172.21.15.31:0/2072867724 >> v2:172.21.15.31:3300/0 conn(0x7f08900975c0 0x7f08900979a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:21.466 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.464+0000 7fd31a2a9640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7fd314099c10 con 0x7fd31406e8e0 2024-09-22T08:36:21.467 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.464+0000 7fd313fff640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fd31406e8e0 0x7fd31406ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:21.467 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.464+0000 7fd313fff640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fd31406e8e0 0x7fd31406ecc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:48522/0 (socket says 172.21.15.31:48522) 2024-09-22T08:36:21.467 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.464+0000 7fd313fff640 1 -- 172.21.15.31:0/4138657775 learned_addr learned my addr 172.21.15.31:0/4138657775 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-22T08:36:21.467 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.464+0000 7fd313fff640 1 -- 172.21.15.31:0/4138657775 >> v1:172.21.15.31:6789/0 conn(0x7fd31406f200 legacy=0x7fd31412f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-22T08:36:21.467 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.464+0000 7fd313fff640 1 -- 172.21.15.31:0/4138657775 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd314099710 con 0x7fd31406e8e0 2024-09-22T08:36:21.468 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.464+0000 7f088effd640 1 -- 172.21.15.31:0/2072867724 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 106130619 0 0) 0x7f0890099ee0 con 0x7f089006e170 2024-09-22T08:36:21.468 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.464+0000 7f088effd640 1 -- 172.21.15.31:0/2072867724 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0878003520 con 0x7f089006e170 2024-09-22T08:36:21.468 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.465+0000 7f088ffff640 1 -- 172.21.15.31:0/2072867724 >> v1:172.21.15.31:6789/0 conn(0x7f089006e170 legacy=0x7f089006e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:21.468 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.465+0000 7f088effd640 1 -- 172.21.15.31:0/2072867724 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 360230808 0 0) 0x7f0878003520 con 0x7f089006e170 2024-09-22T08:36:21.468 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.465+0000 7f088ffff640 1 -- 172.21.15.31:0/2072867724 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0890097ee0 con 0x7f08900975c0 2024-09-22T08:36:21.468 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.465+0000 7fd313fff640 1 --2- 172.21.15.31:0/4138657775 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd31406e8e0 0x7fd31406ecc0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fd3040097f0 tx=0x7fd30402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f94a463d1176503 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:21.468 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.465+0000 7fd312ffd640 1 -- 172.21.15.31:0/4138657775 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd304037070 con 0x7fd31406e8e0 2024-09-22T08:36:21.469 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.465+0000 7fd312ffd640 1 -- 172.21.15.31:0/4138657775 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd304032440 con 0x7fd31406e8e0 2024-09-22T08:36:21.469 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.465+0000 7fd312ffd640 1 -- 172.21.15.31:0/4138657775 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd30402ae60 con 0x7fd31406e8e0 2024-09-22T08:36:21.469 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.466+0000 7f088ffff640 1 --2- 172.21.15.31:0/2072867724 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f08900975c0 0x7f08900979a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f0880009720 tx=0x7f088002a0a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=361db7e0d9b004d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:21.469 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.466+0000 7f088effd640 1 -- 172.21.15.31:0/2072867724 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0880037070 con 0x7f08900975c0 2024-09-22T08:36:21.469 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.466+0000 7f088effd640 1 -- 172.21.15.31:0/2072867724 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f088002ab30 con 0x7f08900975c0 2024-09-22T08:36:21.469 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.466+0000 7f088effd640 1 -- 172.21.15.31:0/2072867724 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0884001620 con 0x7f08900975c0 2024-09-22T08:36:21.470 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.466+0000 7fd31a2a9640 1 -- 172.21.15.31:0/4138657775 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd31406e8e0 msgr2=0x7fd31406ecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:21.470 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.466+0000 7fd31a2a9640 1 --2- 172.21.15.31:0/4138657775 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd31406e8e0 0x7fd31406ecc0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fd3040097f0 tx=0x7fd30402a1e0 comp rx=0 tx=0).stop 2024-09-22T08:36:21.470 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.466+0000 7fd31a2a9640 1 -- 172.21.15.31:0/4138657775 shutdown_connections 2024-09-22T08:36:21.470 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.466+0000 7fd31a2a9640 1 --2- 172.21.15.31:0/4138657775 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd31406e8e0 0x7fd31406ecc0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:21.470 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.466+0000 7fd31a2a9640 1 -- 172.21.15.31:0/4138657775 >> 172.21.15.31:0/4138657775 conn(0x7fd3140a01c0 msgr2=0x7fd3140a05d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:21.470 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.467+0000 7fd31a2a9640 1 -- 172.21.15.31:0/4138657775 shutdown_connections 2024-09-22T08:36:21.471 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.467+0000 7fd31a2a9640 1 -- 172.21.15.31:0/4138657775 wait complete. 2024-09-22T08:36:21.471 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.467+0000 7f08967f4640 1 -- 172.21.15.31:0/2072867724 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f08900975c0 msgr2=0x7f08900979a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:21.471 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.467+0000 7f08967f4640 1 --2- 172.21.15.31:0/2072867724 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f08900975c0 0x7f08900979a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f0880009720 tx=0x7f088002a0a0 comp rx=0 tx=0).stop 2024-09-22T08:36:21.471 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.467+0000 7f08967f4640 1 -- 172.21.15.31:0/2072867724 shutdown_connections 2024-09-22T08:36:21.472 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.467+0000 7f08967f4640 1 --2- 172.21.15.31:0/2072867724 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f08900975c0 0x7f08900979a0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:21.472 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.467+0000 7f08967f4640 1 -- 172.21.15.31:0/2072867724 >> 172.21.15.31:0/2072867724 conn(0x7f089009ac80 msgr2=0x7f0890098550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:21.472 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.467+0000 7f08967f4640 1 -- 172.21.15.31:0/2072867724 shutdown_connections 2024-09-22T08:36:21.472 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.467+0000 7f08967f4640 1 -- 172.21.15.31:0/2072867724 wait complete. 2024-09-22T08:36:21.472 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.468+0000 7fd31a2a9640 1 Processor -- start 2024-09-22T08:36:21.472 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.468+0000 7fd31a2a9640 1 -- start start 2024-09-22T08:36:21.472 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.469+0000 7fd31a2a9640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd31406e8e0 0x7fd3141c4780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:21.473 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.469+0000 7fd31a2a9640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fd3141300f0 con 0x7fd31406e8e0 2024-09-22T08:36:21.473 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.469+0000 7f08967f4640 1 Processor -- start 2024-09-22T08:36:21.473 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.469+0000 7fd313fff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd31406e8e0 0x7fd3141c4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:21.473 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.469+0000 7fd313fff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd31406e8e0 0x7fd3141c4780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:48528/0 (socket says 172.21.15.31:48528) 2024-09-22T08:36:21.473 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.469+0000 7fd313fff640 1 -- 172.21.15.31:0/2720944180 learned_addr learned my addr 172.21.15.31:0/2720944180 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-22T08:36:21.474 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.469+0000 7f08967f4640 1 -- start start 2024-09-22T08:36:21.474 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.469+0000 7fd313fff640 1 -- 172.21.15.31:0/2720944180 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3140901b0 con 0x7fd31406e8e0 2024-09-22T08:36:21.474 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.469+0000 7fd313fff640 1 --2- 172.21.15.31:0/2720944180 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd31406e8e0 0x7fd3141c4780 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd304035040 tx=0x7fd3040046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:21.474 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.470+0000 7fd310ff9640 1 -- 172.21.15.31:0/2720944180 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd304041070 con 0x7fd31406e8e0 2024-09-22T08:36:21.475 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.470+0000 7fd310ff9640 1 -- 172.21.15.31:0/2720944180 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd30403c7a0 con 0x7fd31406e8e0 2024-09-22T08:36:21.475 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.470+0000 7fd310ff9640 1 -- 172.21.15.31:0/2720944180 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd304037040 con 0x7fd31406e8e0 2024-09-22T08:36:21.475 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.470+0000 7f08967f4640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f089006e170 0x7f0890070ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:21.475 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.470+0000 7fd31a2a9640 1 -- 172.21.15.31:0/2720944180 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd31408ebb0 con 0x7fd31406e8e0 2024-09-22T08:36:21.475 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.470+0000 7fd31a2a9640 1 -- 172.21.15.31:0/2720944180 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3141c4ea0 con 0x7fd31406e8e0 2024-09-22T08:36:21.476 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.470+0000 7f08967f4640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f089006f740 con 0x7f089006e170 2024-09-22T08:36:21.476 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.470+0000 7f088ffff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f089006e170 0x7f0890070ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:21.476 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.470+0000 7f088ffff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f089006e170 0x7f0890070ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:48540/0 (socket says 172.21.15.31:48540) 2024-09-22T08:36:21.476 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.470+0000 7f088ffff640 1 -- 172.21.15.31:0/2563857628 learned_addr learned my addr 172.21.15.31:0/2563857628 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-22T08:36:21.476 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.470+0000 7f088ffff640 1 -- 172.21.15.31:0/2563857628 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08901280b0 con 0x7f089006e170 2024-09-22T08:36:21.476 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.471+0000 7f088ffff640 1 --2- 172.21.15.31:0/2563857628 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f089006e170 0x7f0890070ec0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f088002a0e0 tx=0x7f08800046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:21.476 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.471+0000 7f088cff9640 1 -- 172.21.15.31:0/2563857628 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f088004a070 con 0x7f089006e170 2024-09-22T08:36:21.476 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.471+0000 7f088cff9640 1 -- 172.21.15.31:0/2563857628 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0880032700 con 0x7f089006e170 2024-09-22T08:36:21.477 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.471+0000 7f088cff9640 1 -- 172.21.15.31:0/2563857628 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0880037040 con 0x7f089006e170 2024-09-22T08:36:21.477 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.471+0000 7f08967f4640 1 -- 172.21.15.31:0/2563857628 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0890125c40 con 0x7f089006e170 2024-09-22T08:36:21.477 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.471+0000 7fd31a2a9640 1 -- 172.21.15.31:0/2720944180 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd31406ecc0 con 0x7fd31406e8e0 2024-09-22T08:36:21.477 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.471+0000 7fd310ff9640 1 -- 172.21.15.31:0/2720944180 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fd304044070 con 0x7fd31406e8e0 2024-09-22T08:36:21.477 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.471+0000 7f08967f4640 1 -- 172.21.15.31:0/2563857628 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0890072720 con 0x7f089006e170 2024-09-22T08:36:21.478 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.471+0000 7fd310ff9640 1 --2- 172.21.15.31:0/2720944180 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fd30003e710 0x7fd300040bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:21.478 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.471+0000 7fd310ff9640 1 -- 172.21.15.31:0/2720944180 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7fd3040737a0 con 0x7fd31406e8e0 2024-09-22T08:36:21.478 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.472+0000 7fd3137fe640 1 --2- 172.21.15.31:0/2720944180 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fd30003e710 0x7fd300040bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:21.478 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.473+0000 7f088cff9640 1 -- 172.21.15.31:0/2563857628 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f088004d070 con 0x7f089006e170 2024-09-22T08:36:21.479 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.473+0000 7f08967f4640 1 -- 172.21.15.31:0/2563857628 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0890073540 con 0x7f089006e170 2024-09-22T08:36:21.479 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.473+0000 7f088cff9640 1 --2- 172.21.15.31:0/2563857628 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f087c03e710 0x7f087c040bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:21.479 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.473+0000 7f088f7fe640 1 --2- 172.21.15.31:0/2563857628 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f087c03e710 0x7f087c040bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:21.479 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.473+0000 7fd3137fe640 1 --2- 172.21.15.31:0/2720944180 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fd30003e710 0x7fd300040bd0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fd308003cd0 tx=0x7fd308007a30 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:21.479 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.474+0000 7f088f7fe640 1 --2- 172.21.15.31:0/2563857628 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f087c03e710 0x7f087c040bd0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f0884005880 tx=0x7f08840019a0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:21.479 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.476+0000 7f088cff9640 1 -- 172.21.15.31:0/2563857628 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7f0880075dc0 con 0x7f089006e170 2024-09-22T08:36:21.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.477+0000 7fd310ff9640 1 -- 172.21.15.31:0/2720944180 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fd304045dc0 con 0x7fd31406e8e0 2024-09-22T08:36:21.482 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.481+0000 7f088cff9640 1 -- 172.21.15.31:0/2563857628 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f0880040070 con 0x7f089006e170 2024-09-22T08:36:21.636 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.635+0000 7f8133b2b640 1 -- 172.21.15.31:0/949264779 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f812c06ecc0 con 0x7f812c06e8e0 2024-09-22T08:36:21.636 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.635+0000 7f81227fc640 1 -- 172.21.15.31:0/949264779 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f812801b730 con 0x7f812c06e8e0 2024-09-22T08:36:21.636 INFO:teuthology.orchestra.run.smithi031.stdout:47244640263 2024-09-22T08:36:21.639 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.637+0000 7f8133b2b640 1 -- 172.21.15.31:0/949264779 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f811003e760 msgr2=0x7f8110040c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:21.639 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.637+0000 7f8133b2b640 1 --2- 172.21.15.31:0/949264779 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f811003e760 0x7f8110040c20 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f811c034000 tx=0x7f811c02e000 comp rx=0 tx=0).stop 2024-09-22T08:36:21.639 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.637+0000 7f8133b2b640 1 -- 172.21.15.31:0/949264779 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f812c06e8e0 msgr2=0x7f812c12be90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:21.639 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.637+0000 7f8133b2b640 1 --2- 172.21.15.31:0/949264779 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f812c06e8e0 0x7f812c12be90 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f8128001eb0 tx=0x7f812800c810 comp rx=0 tx=0).stop 2024-09-22T08:36:21.639 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.637+0000 7f8133b2b640 1 -- 172.21.15.31:0/949264779 shutdown_connections 2024-09-22T08:36:21.639 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.637+0000 7f8133b2b640 1 --2- 172.21.15.31:0/949264779 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f811003e760 0x7f8110040c20 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:21.639 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.637+0000 7f8133b2b640 1 --2- 172.21.15.31:0/949264779 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f812c06e8e0 0x7f812c12be90 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:21.639 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.637+0000 7f8133b2b640 1 -- 172.21.15.31:0/949264779 >> 172.21.15.31:0/949264779 conn(0x7f812c0a01c0 msgr2=0x7f812c132d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:21.640 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.637+0000 7f8133b2b640 1 -- 172.21.15.31:0/949264779 shutdown_connections 2024-09-22T08:36:21.640 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.637+0000 7f8133b2b640 1 -- 172.21.15.31:0/949264779 wait complete. 2024-09-22T08:36:21.650 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640262 got 47244640263 for osd.1 2024-09-22T08:36:21.650 DEBUG:teuthology.parallel:result is None 2024-09-22T08:36:21.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.651+0000 7f93c22d6640 1 -- 172.21.15.31:0/651592550 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f93bc098710 con 0x7f93bc130160 2024-09-22T08:36:21.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.651+0000 7f93b8ff9640 1 -- 172.21.15.31:0/651592550 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f93ac03d3f0 con 0x7f93bc130160 2024-09-22T08:36:21.652 INFO:teuthology.orchestra.run.smithi031.stdout:47244640263 2024-09-22T08:36:21.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.653+0000 7f93c22d6640 1 -- 172.21.15.31:0/651592550 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f93a803e760 msgr2=0x7f93a8040c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:21.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.653+0000 7f93c22d6640 1 --2- 172.21.15.31:0/651592550 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f93a803e760 0x7f93a8040c20 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f93b0000c00 tx=0x7f93b00078f0 comp rx=0 tx=0).stop 2024-09-22T08:36:21.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.653+0000 7f93c22d6640 1 -- 172.21.15.31:0/651592550 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f93bc130160 msgr2=0x7f93bc0926c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:21.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.653+0000 7f93c22d6640 1 --2- 172.21.15.31:0/651592550 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f93bc130160 0x7f93bc0926c0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f93ac009720 tx=0x7f93ac0046c0 comp rx=0 tx=0).stop 2024-09-22T08:36:21.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.653+0000 7f93c22d6640 1 -- 172.21.15.31:0/651592550 shutdown_connections 2024-09-22T08:36:21.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.653+0000 7f93c22d6640 1 --2- 172.21.15.31:0/651592550 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f93a803e760 0x7f93a8040c20 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:21.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.653+0000 7f93c22d6640 1 --2- 172.21.15.31:0/651592550 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f93bc130160 0x7f93bc0926c0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:21.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.653+0000 7f93c22d6640 1 -- 172.21.15.31:0/651592550 >> 172.21.15.31:0/651592550 conn(0x7f93bc09ff60 msgr2=0x7f93bc06ecf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:21.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.653+0000 7f93c22d6640 1 -- 172.21.15.31:0/651592550 shutdown_connections 2024-09-22T08:36:21.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.654+0000 7f93c22d6640 1 -- 172.21.15.31:0/651592550 wait complete. 2024-09-22T08:36:21.665 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640262 got 47244640263 for osd.2 2024-09-22T08:36:21.666 DEBUG:teuthology.parallel:result is None 2024-09-22T08:36:21.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.665+0000 7fd31a2a9640 1 -- 172.21.15.31:0/2720944180 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fd314129f90 con 0x7fd31406e8e0 2024-09-22T08:36:21.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.666+0000 7fd310ff9640 1 -- 172.21.15.31:0/2720944180 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fd304045dc0 con 0x7fd31406e8e0 2024-09-22T08:36:21.667 INFO:teuthology.orchestra.run.smithi031.stdout:38654705669 2024-09-22T08:36:21.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.668+0000 7fd31a2a9640 1 -- 172.21.15.31:0/2720944180 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fd30003e710 msgr2=0x7fd300040bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:21.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.668+0000 7fd31a2a9640 1 --2- 172.21.15.31:0/2720944180 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fd30003e710 0x7fd300040bd0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fd308003cd0 tx=0x7fd308007a30 comp rx=0 tx=0).stop 2024-09-22T08:36:21.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.668+0000 7fd31a2a9640 1 -- 172.21.15.31:0/2720944180 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd31406e8e0 msgr2=0x7fd3141c4780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:21.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.668+0000 7fd31a2a9640 1 --2- 172.21.15.31:0/2720944180 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd31406e8e0 0x7fd3141c4780 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd304035040 tx=0x7fd3040046c0 comp rx=0 tx=0).stop 2024-09-22T08:36:21.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.668+0000 7fd31a2a9640 1 -- 172.21.15.31:0/2720944180 shutdown_connections 2024-09-22T08:36:21.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.668+0000 7fd31a2a9640 1 --2- 172.21.15.31:0/2720944180 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fd30003e710 0x7fd300040bd0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:21.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.668+0000 7fd31a2a9640 1 --2- 172.21.15.31:0/2720944180 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd31406e8e0 0x7fd3141c4780 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:21.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.668+0000 7fd31a2a9640 1 -- 172.21.15.31:0/2720944180 >> 172.21.15.31:0/2720944180 conn(0x7fd3140a01c0 msgr2=0x7fd31409dd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:21.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.668+0000 7fd31a2a9640 1 -- 172.21.15.31:0/2720944180 shutdown_connections 2024-09-22T08:36:21.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.668+0000 7fd31a2a9640 1 -- 172.21.15.31:0/2720944180 wait complete. 2024-09-22T08:36:21.679 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705669 for osd.0 2024-09-22T08:36:21.680 DEBUG:teuthology.parallel:result is None 2024-09-22T08:36:21.692 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.691+0000 7f08967f4640 1 -- 172.21.15.31:0/2563857628 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f0890072a00 con 0x7f089006e170 2024-09-22T08:36:21.693 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.692+0000 7f088cff9640 1 -- 172.21.15.31:0/2563857628 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f0880054090 con 0x7f089006e170 2024-09-22T08:36:21.693 INFO:teuthology.orchestra.run.smithi031.stdout:38654705669 2024-09-22T08:36:21.695 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.694+0000 7f08967f4640 1 -- 172.21.15.31:0/2563857628 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f087c03e710 msgr2=0x7f087c040bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:21.695 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.694+0000 7f08967f4640 1 --2- 172.21.15.31:0/2563857628 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f087c03e710 0x7f087c040bd0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f0884005880 tx=0x7f08840019a0 comp rx=0 tx=0).stop 2024-09-22T08:36:21.696 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.694+0000 7f08967f4640 1 -- 172.21.15.31:0/2563857628 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f089006e170 msgr2=0x7f0890070ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:21.696 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.694+0000 7f08967f4640 1 --2- 172.21.15.31:0/2563857628 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f089006e170 0x7f0890070ec0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f088002a0e0 tx=0x7f08800046c0 comp rx=0 tx=0).stop 2024-09-22T08:36:21.696 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.694+0000 7f08967f4640 1 -- 172.21.15.31:0/2563857628 shutdown_connections 2024-09-22T08:36:21.696 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.694+0000 7f08967f4640 1 --2- 172.21.15.31:0/2563857628 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f087c03e710 0x7f087c040bd0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:21.696 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.694+0000 7f08967f4640 1 --2- 172.21.15.31:0/2563857628 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f089006e170 0x7f0890070ec0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:21.696 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.694+0000 7f08967f4640 1 -- 172.21.15.31:0/2563857628 >> 172.21.15.31:0/2563857628 conn(0x7f089009ac80 msgr2=0x7f089012b1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:21.696 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.694+0000 7f08967f4640 1 -- 172.21.15.31:0/2563857628 shutdown_connections 2024-09-22T08:36:21.696 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.694+0000 7f08967f4640 1 -- 172.21.15.31:0/2563857628 wait complete. 2024-09-22T08:36:21.706 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705669 for osd.3 2024-09-22T08:36:21.706 DEBUG:teuthology.parallel:result is None 2024-09-22T08:36:21.706 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-22T08:36:21.707 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T08:36:21.848 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.846+0000 7f9feb36b640 1 Processor -- start 2024-09-22T08:36:21.848 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.846+0000 7f9feb36b640 1 -- start start 2024-09-22T08:36:21.848 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.846+0000 7f9feb36b640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f9fe406fd70 0x7f9fe4131660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:21.848 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.847+0000 7f9feb36b640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9fe4099ee0 con 0x7f9fe406f280 2024-09-22T08:36:21.848 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.847+0000 7f9feb36b640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f9fe4070d00 con 0x7f9fe406fd70 2024-09-22T08:36:21.848 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.847+0000 7f9fe9107640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f9fe406f280 0x7f9fe406f660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:60390/0 (socket says 172.21.15.31:60390) 2024-09-22T08:36:21.848 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.847+0000 7f9fe9107640 1 -- 172.21.15.31:0/580424791 learned_addr learned my addr 172.21.15.31:0/580424791 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-22T08:36:21.849 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.847+0000 7f9fe8906640 1 --2- 172.21.15.31:0/580424791 >> v2:172.21.15.31:3300/0 conn(0x7f9fe406fd70 0x7f9fe4131660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:21.849 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.847+0000 7f9fdbfff640 1 -- 172.21.15.31:0/580424791 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2713544768 0 0) 0x7f9fe4099ee0 con 0x7f9fe406f280 2024-09-22T08:36:21.849 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.847+0000 7f9fdbfff640 1 -- 172.21.15.31:0/580424791 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9fd0003520 con 0x7f9fe406f280 2024-09-22T08:36:21.849 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.847+0000 7f9fe8906640 1 -- 172.21.15.31:0/580424791 >> v1:172.21.15.31:6789/0 conn(0x7f9fe406f280 legacy=0x7f9fe406f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:21.849 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.847+0000 7f9fe8906640 1 -- 172.21.15.31:0/580424791 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fe4070f40 con 0x7f9fe406fd70 2024-09-22T08:36:21.850 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.848+0000 7f9fe8906640 1 --2- 172.21.15.31:0/580424791 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9fe406fd70 0x7f9fe4131660 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f9fd4009720 tx=0x7f9fd402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=593cb218daafa85c server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:21.850 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.848+0000 7f9fdbfff640 1 -- 172.21.15.31:0/580424791 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9fd4037070 con 0x7f9fe406fd70 2024-09-22T08:36:21.850 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.848+0000 7f9fdbfff640 1 -- 172.21.15.31:0/580424791 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9fd402ad90 con 0x7f9fe406fd70 2024-09-22T08:36:21.850 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.848+0000 7f9fdbfff640 1 -- 172.21.15.31:0/580424791 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9fd4032590 con 0x7f9fe406fd70 2024-09-22T08:36:21.850 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.848+0000 7f9feb36b640 1 -- 172.21.15.31:0/580424791 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9fe406fd70 msgr2=0x7f9fe4131660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:21.850 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.848+0000 7f9feb36b640 1 --2- 172.21.15.31:0/580424791 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9fe406fd70 0x7f9fe4131660 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f9fd4009720 tx=0x7f9fd402a110 comp rx=0 tx=0).stop 2024-09-22T08:36:21.850 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.848+0000 7f9feb36b640 1 -- 172.21.15.31:0/580424791 shutdown_connections 2024-09-22T08:36:21.850 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.848+0000 7f9feb36b640 1 --2- 172.21.15.31:0/580424791 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9fe406fd70 0x7f9fe4131660 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:21.851 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.848+0000 7f9feb36b640 1 -- 172.21.15.31:0/580424791 >> 172.21.15.31:0/580424791 conn(0x7f9fe409ac80 msgr2=0x7f9fe4098550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:21.851 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.848+0000 7f9feb36b640 1 -- 172.21.15.31:0/580424791 shutdown_connections 2024-09-22T08:36:21.851 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.849+0000 7f9feb36b640 1 -- 172.21.15.31:0/580424791 wait complete. 2024-09-22T08:36:21.852 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.849+0000 7f9feb36b640 1 Processor -- start 2024-09-22T08:36:21.852 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.849+0000 7f9feb36b640 1 -- start start 2024-09-22T08:36:21.852 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.850+0000 7f9feb36b640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9fe406f280 0x7f9fe41c2050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:21.852 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.850+0000 7f9feb36b640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f9fe4131d20 con 0x7f9fe406f280 2024-09-22T08:36:21.853 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.850+0000 7f9fe9107640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9fe406f280 0x7f9fe41c2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:21.853 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.850+0000 7f9fe9107640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9fe406f280 0x7f9fe41c2050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:48550/0 (socket says 172.21.15.31:48550) 2024-09-22T08:36:21.853 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.850+0000 7f9fe9107640 1 -- 172.21.15.31:0/3655724086 learned_addr learned my addr 172.21.15.31:0/3655724086 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-22T08:36:21.853 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.850+0000 7f9fe9107640 1 -- 172.21.15.31:0/3655724086 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fe4073fb0 con 0x7f9fe406f280 2024-09-22T08:36:21.853 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.850+0000 7f9fe9107640 1 --2- 172.21.15.31:0/3655724086 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9fe406f280 0x7f9fe41c2050 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f9fe000c480 tx=0x7f9fe000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:21.853 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.850+0000 7f9fd9ffb640 1 -- 172.21.15.31:0/3655724086 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9fe0017070 con 0x7f9fe406f280 2024-09-22T08:36:21.853 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.850+0000 7f9fd9ffb640 1 -- 172.21.15.31:0/3655724086 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9fe0005cd0 con 0x7f9fe406f280 2024-09-22T08:36:21.853 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.850+0000 7f9feb36b640 1 -- 172.21.15.31:0/3655724086 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9fe4127840 con 0x7f9fe406f280 2024-09-22T08:36:21.853 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.850+0000 7f9fd9ffb640 1 -- 172.21.15.31:0/3655724086 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9fe0007200 con 0x7f9fe406f280 2024-09-22T08:36:21.853 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.851+0000 7f9feb36b640 1 -- 172.21.15.31:0/3655724086 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9fe4128470 con 0x7f9fe406f280 2024-09-22T08:36:21.853 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.851+0000 7f9fd9ffb640 1 -- 172.21.15.31:0/3655724086 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f9fe001a070 con 0x7f9fe406f280 2024-09-22T08:36:21.854 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.852+0000 7f9fd9ffb640 1 --2- 172.21.15.31:0/3655724086 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f9fc803e710 0x7f9fc8040bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:21.854 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.852+0000 7f9feb36b640 1 -- 172.21.15.31:0/3655724086 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9fe406f660 con 0x7f9fe406f280 2024-09-22T08:36:21.854 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.852+0000 7f9fd9ffb640 1 -- 172.21.15.31:0/3655724086 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7f9fe00520c0 con 0x7f9fe406f280 2024-09-22T08:36:21.854 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.852+0000 7f9fe8906640 1 --2- 172.21.15.31:0/3655724086 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f9fc803e710 0x7f9fc8040bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:21.854 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.852+0000 7f9fe8906640 1 --2- 172.21.15.31:0/3655724086 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f9fc803e710 0x7f9fc8040bd0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f9fd4009720 tx=0x7f9fd402e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:21.857 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:21.856+0000 7f9fd9ffb640 1 -- 172.21.15.31:0/3655724086 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f9fe4073fb0 con 0x7f9fe406f280 2024-09-22T08:36:22.041 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:22.040+0000 7f9feb36b640 1 -- 172.21.15.31:0/3655724086 --> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f9fe4127e10 con 0x7f9fc803e710 2024-09-22T08:36:22.042 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:22.041+0000 7f9fd9ffb640 1 -- 172.21.15.31:0/3655724086 <== mgr.4099 v2:172.21.15.142:6824/99931088 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+32204 (secure 0 0 0) 0x7f9fe4127e10 con 0x7f9fc803e710 2024-09-22T08:36:22.043 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-22T08:36:22.043 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2024-09-22T08:36:22.044 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:22.043+0000 7f9feb36b640 1 -- 172.21.15.31:0/3655724086 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f9fc803e710 msgr2=0x7f9fc8040bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:22.044 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:22.043+0000 7f9feb36b640 1 --2- 172.21.15.31:0/3655724086 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f9fc803e710 0x7f9fc8040bd0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f9fd4009720 tx=0x7f9fd402e000 comp rx=0 tx=0).stop 2024-09-22T08:36:22.044 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:22.043+0000 7f9feb36b640 1 -- 172.21.15.31:0/3655724086 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9fe406f280 msgr2=0x7f9fe41c2050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:22.044 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:22.043+0000 7f9feb36b640 1 --2- 172.21.15.31:0/3655724086 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9fe406f280 0x7f9fe41c2050 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f9fe000c480 tx=0x7f9fe000c940 comp rx=0 tx=0).stop 2024-09-22T08:36:22.045 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:22.043+0000 7f9feb36b640 1 -- 172.21.15.31:0/3655724086 shutdown_connections 2024-09-22T08:36:22.045 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:22.043+0000 7f9feb36b640 1 --2- 172.21.15.31:0/3655724086 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f9fc803e710 0x7f9fc8040bd0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:22.045 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:22.043+0000 7f9feb36b640 1 --2- 172.21.15.31:0/3655724086 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9fe406f280 0x7f9fe41c2050 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:22.045 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:22.043+0000 7f9feb36b640 1 -- 172.21.15.31:0/3655724086 >> 172.21.15.31:0/3655724086 conn(0x7f9fe409ac80 msgr2=0x7f9fe4071bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:22.045 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:22.043+0000 7f9feb36b640 1 -- 172.21.15.31:0/3655724086 shutdown_connections 2024-09-22T08:36:22.045 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:22.043+0000 7f9feb36b640 1 -- 172.21.15.31:0/3655724086 wait complete. 2024-09-22T08:36:22.055 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-09-22T08:36:21.145031+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":17,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":109876,"kb_used_data":1744,"kb_used_omap":6,"kb_used_meta":108025,"kb_avail":377377484,"statfs":{"total":386547056640,"available":386434543616,"internally_reserved":0,"allocated":1785856,"data_stored":1371234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":110618390},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.726445"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T08:36:18.432305+0000","last_change":"2024-09-22T08:36:18.432491+0000","last_active":"2024-09-22T08:36:18.432305+0000","last_peered":"2024-09-22T08:36:18.432305+0000","last_clean":"2024-09-22T08:36:18.432305+0000","last_became_active":"2024-09-22T08:36:16.638610+0000","last_became_peered":"2024-09-22T08:36:16.638610+0000","last_unstale":"2024-09-22T08:36:18.432305+0000","last_undegraded":"2024-09-22T08:36:18.432305+0000","last_fullsized":"2024-09-22T08:36:18.432305+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:15.415268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:15.415268+0000","last_clean_scrub_stamp":"2024-09-22T08:36:15.415268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:36:49.729872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001119264,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T08:36:18.434184+0000","last_change":"2024-09-22T08:36:18.434431+0000","last_active":"2024-09-22T08:36:18.434184+0000","last_peered":"2024-09-22T08:36:18.434184+0000","last_clean":"2024-09-22T08:36:18.434184+0000","last_became_active":"2024-09-22T08:36:16.425549+0000","last_became_peered":"2024-09-22T08:36:16.425549+0000","last_unstale":"2024-09-22T08:36:18.434184+0000","last_undegraded":"2024-09-22T08:36:18.434184+0000","last_fullsized":"2024-09-22T08:36:18.434184+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:15.415268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:15.415268+0000","last_clean_scrub_stamp":"2024-09-22T08:36:15.415268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:59:01.714308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045809600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T08:36:18.431898+0000","last_change":"2024-09-22T08:36:18.432154+0000","last_active":"2024-09-22T08:36:18.431898+0000","last_peered":"2024-09-22T08:36:18.431898+0000","last_clean":"2024-09-22T08:36:18.431898+0000","last_became_active":"2024-09-22T08:36:16.427154+0000","last_became_peered":"2024-09-22T08:36:16.427154+0000","last_unstale":"2024-09-22T08:36:18.431898+0000","last_undegraded":"2024-09-22T08:36:18.431898+0000","last_fullsized":"2024-09-22T08:36:18.431898+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:15.415268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:15.415268+0000","last_clean_scrub_stamp":"2024-09-22T08:36:15.415268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:44:41.260462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081028899999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T08:36:18.434134+0000","last_change":"2024-09-22T08:36:18.434398+0000","last_active":"2024-09-22T08:36:18.434134+0000","last_peered":"2024-09-22T08:36:18.434134+0000","last_clean":"2024-09-22T08:36:18.434134+0000","last_became_active":"2024-09-22T08:36:16.424946+0000","last_became_peered":"2024-09-22T08:36:16.424946+0000","last_unstale":"2024-09-22T08:36:18.434134+0000","last_undegraded":"2024-09-22T08:36:18.434134+0000","last_fullsized":"2024-09-22T08:36:18.434134+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:15.415268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:15.415268+0000","last_clean_scrub_stamp":"2024-09-22T08:36:15.415268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:29:12.209070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045979400000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"17'2","reported_seq":22,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T08:36:18.432421+0000","last_change":"2024-09-22T08:36:18.432421+0000","last_active":"2024-09-22T08:36:18.432421+0000","last_peered":"2024-09-22T08:36:18.432421+0000","last_clean":"2024-09-22T08:36:18.432421+0000","last_became_active":"2024-09-22T08:36:16.427358+0000","last_became_peered":"2024-09-22T08:36:16.427358+0000","last_unstale":"2024-09-22T08:36:18.432421+0000","last_undegraded":"2024-09-22T08:36:18.432421+0000","last_fullsized":"2024-09-22T08:36:18.432421+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:15.415268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:15.415268+0000","last_clean_scrub_stamp":"2024-09-22T08:36:15.415268+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:16:15.903021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001068835,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T08:36:18.520219+0000","last_change":"2024-09-22T08:36:18.520219+0000","last_active":"2024-09-22T08:36:18.520219+0000","last_peered":"2024-09-22T08:36:18.520219+0000","last_clean":"2024-09-22T08:36:18.520219+0000","last_became_active":"2024-09-22T08:36:16.427121+0000","last_became_peered":"2024-09-22T08:36:16.427121+0000","last_unstale":"2024-09-22T08:36:18.520219+0000","last_undegraded":"2024-09-22T08:36:18.520219+0000","last_fullsized":"2024-09-22T08:36:18.520219+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:15.415268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:15.415268+0000","last_clean_scrub_stamp":"2024-09-22T08:36:15.415268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:47:57.246114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041194099999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T08:36:18.431662+0000","last_change":"2024-09-22T08:36:18.431890+0000","last_active":"2024-09-22T08:36:18.431662+0000","last_peered":"2024-09-22T08:36:18.431662+0000","last_clean":"2024-09-22T08:36:18.431662+0000","last_became_active":"2024-09-22T08:36:16.427252+0000","last_became_peered":"2024-09-22T08:36:16.427252+0000","last_unstale":"2024-09-22T08:36:18.431662+0000","last_undegraded":"2024-09-22T08:36:18.431662+0000","last_fullsized":"2024-09-22T08:36:18.431662+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:15.415268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:15.415268+0000","last_clean_scrub_stamp":"2024-09-22T08:36:15.415268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:11:12.623975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055484200000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"15'1","reported_seq":21,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T08:36:18.431612+0000","last_change":"2024-09-22T08:36:18.431832+0000","last_active":"2024-09-22T08:36:18.431612+0000","last_peered":"2024-09-22T08:36:18.431612+0000","last_clean":"2024-09-22T08:36:18.431612+0000","last_became_active":"2024-09-22T08:36:16.425465+0000","last_became_peered":"2024-09-22T08:36:16.425465+0000","last_unstale":"2024-09-22T08:36:18.431612+0000","last_undegraded":"2024-09-22T08:36:18.431612+0000","last_fullsized":"2024-09-22T08:36:18.431612+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:15.415268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:15.415268+0000","last_clean_scrub_stamp":"2024-09-22T08:36:15.415268+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:34:11.990226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049376300000000004,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"12'72","reported_seq":111,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T08:36:18.429512+0000","last_change":"2024-09-22T08:36:10.737141+0000","last_active":"2024-09-22T08:36:18.429512+0000","last_peered":"2024-09-22T08:36:18.429512+0000","last_clean":"2024-09-22T08:36:18.429512+0000","last_became_active":"2024-09-22T08:36:10.736221+0000","last_became_peered":"2024-09-22T08:36:10.736221+0000","last_unstale":"2024-09-22T08:36:18.429512+0000","last_undegraded":"2024-09-22T08:36:18.429512+0000","last_fullsized":"2024-09-22T08:36:18.429512+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:09.401562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:09.401562+0000","last_clean_scrub_stamp":"2024-09-22T08:36:09.401562+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:14:13.135964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":11,"seq":47244640263,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27756,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344084,"statfs":{"total":96636764160,"available":96608342016,"internally_reserved":0,"allocated":741376,"data_stored":637983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640263,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27752,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344088,"statfs":{"total":96636764160,"available":96608346112,"internally_reserved":0,"allocated":741376,"data_stored":637983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":9,"seq":38654705669,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27184,"kb_used_data":148,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":151552,"data_stored":47634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705669,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27184,"kb_used_data":148,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":151552,"data_stored":47634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T08:36:22.056 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T08:36:22.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:22.156+0000 7f1f4cd9f640 1 Processor -- start 2024-09-22T08:36:22.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:22.156+0000 7f1f4cd9f640 1 -- start start 2024-09-22T08:36:22.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:22.156+0000 7f1f4cd9f640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f1f48063e80 0x7f1f4806f840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:22.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:22.156+0000 7f1f4cd9f640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f48063890 con 0x7f1f48098ce0 2024-09-22T08:36:22.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:22.156+0000 7f1f4cd9f640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f1f480704f0 con 0x7f1f48063e80 2024-09-22T08:36:22.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:22.157+0000 7f1f46ffd640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f1f48063e80 0x7f1f4806f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:22.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:22.157+0000 7f1f477fe640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f1f48098ce0 0x7f1f4806f130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:60406/0 (socket says 172.21.15.31:60406) 2024-09-22T08:36:22.159 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:22.157+0000 7f1f477fe640 1 -- 172.21.15.31:0/2053693325 learned_addr learned my addr 172.21.15.31:0/2053693325 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-22T08:36:22.159 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:22.157+0000 7f1f46ffd640 1 -- 172.21.15.31:0/2053693325 >> v1:172.21.15.31:6789/0 conn(0x7f1f48098ce0 legacy=0x7f1f4806f130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:22.159 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:22.157+0000 7f1f46ffd640 1 -- 172.21.15.31:0/2053693325 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f4806fd80 con 0x7f1f48063e80 2024-09-22T08:36:22.159 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:22.157+0000 7f1f467fc640 1 -- 172.21.15.31:0/2053693325 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3847302167 0 0) 0x7f1f48063890 con 0x7f1f48098ce0 2024-09-22T08:36:22.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:22.157+0000 7f1f46ffd640 1 --2- 172.21.15.31:0/2053693325 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1f48063e80 0x7f1f4806f840 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f1f30009720 tx=0x7f1f3002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cf978cba8eec559 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:22.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:22.158+0000 7f1f467fc640 1 -- 172.21.15.31:0/2053693325 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f30037070 con 0x7f1f48063e80 2024-09-22T08:36:22.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:22.158+0000 7f1f467fc640 1 -- 172.21.15.31:0/2053693325 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f3002ad90 con 0x7f1f48063e80 2024-09-22T08:36:22.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:22.158+0000 7f1f467fc640 1 -- 172.21.15.31:0/2053693325 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f30032590 con 0x7f1f48063e80 2024-09-22T08:36:22.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:22.158+0000 7f1f4cd9f640 1 -- 172.21.15.31:0/2053693325 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1f48063e80 msgr2=0x7f1f4806f840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:22.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:22.158+0000 7f1f4cd9f640 1 --2- 172.21.15.31:0/2053693325 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1f48063e80 0x7f1f4806f840 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f1f30009720 tx=0x7f1f3002a110 comp rx=0 tx=0).stop 2024-09-22T08:36:22.161 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:22.158+0000 7f1f4cd9f640 1 -- 172.21.15.31:0/2053693325 shutdown_connections 2024-09-22T08:36:22.161 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:22.158+0000 7f1f4cd9f640 1 --2- 172.21.15.31:0/2053693325 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1f48063e80 0x7f1f4806f840 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:22.161 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:22.158+0000 7f1f4cd9f640 1 -- 172.21.15.31:0/2053693325 >> 172.21.15.31:0/2053693325 conn(0x7f1f4809b7d0 msgr2=0x7f1f4809bbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:22.161 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:22.158+0000 7f1f4cd9f640 1 -- 172.21.15.31:0/2053693325 shutdown_connections 2024-09-22T08:36:22.161 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:22.158+0000 7f1f4cd9f640 1 -- 172.21.15.31:0/2053693325 wait complete. 2024-09-22T08:36:22.161 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:22.159+0000 7f1f4cd9f640 1 Processor -- start 2024-09-22T08:36:22.161 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:22.159+0000 7f1f4cd9f640 1 -- start start 2024-09-22T08:36:22.163 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:22.160+0000 7f1f4cd9f640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1f48063e80 0x7f1f48092d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:22.163 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:22.160+0000 7f1f4cd9f640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f1f48135030 con 0x7f1f48063e80 2024-09-22T08:36:22.163 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:22.160+0000 7f1f477fe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1f48063e80 0x7f1f48092d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:22.163 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:22.160+0000 7f1f477fe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1f48063e80 0x7f1f48092d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:48574/0 (socket says 172.21.15.31:48574) 2024-09-22T08:36:22.163 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:22.160+0000 7f1f477fe640 1 -- 172.21.15.31:0/4231317739 learned_addr learned my addr 172.21.15.31:0/4231317739 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-22T08:36:22.163 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:22.160+0000 7f1f477fe640 1 -- 172.21.15.31:0/4231317739 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f48095850 con 0x7f1f48063e80 2024-09-22T08:36:22.164 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:22.160+0000 7f1f477fe640 1 --2- 172.21.15.31:0/4231317739 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1f48063e80 0x7f1f48092d90 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f1f3800cb30 tx=0x7f1f3800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:22.164 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:22.160+0000 7f1f3ffff640 1 -- 172.21.15.31:0/4231317739 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f3800abf0 con 0x7f1f48063e80 2024-09-22T08:36:22.164 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:22.160+0000 7f1f3ffff640 1 -- 172.21.15.31:0/4231317739 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f3800ad90 con 0x7f1f48063e80 2024-09-22T08:36:22.164 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:22.160+0000 7f1f4cd9f640 1 -- 172.21.15.31:0/4231317739 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f480932d0 con 0x7f1f48063e80 2024-09-22T08:36:22.164 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:22.160+0000 7f1f3ffff640 1 -- 172.21.15.31:0/4231317739 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f38012570 con 0x7f1f48063e80 2024-09-22T08:36:22.164 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:22.160+0000 7f1f4cd9f640 1 -- 172.21.15.31:0/4231317739 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f48093840 con 0x7f1f48063e80 2024-09-22T08:36:22.164 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:22.161+0000 7f1f3ffff640 1 -- 172.21.15.31:0/4231317739 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f1f38012710 con 0x7f1f48063e80 2024-09-22T08:36:22.164 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:22.161+0000 7f1f4cd9f640 1 -- 172.21.15.31:0/4231317739 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f4806f130 con 0x7f1f48063e80 2024-09-22T08:36:22.164 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:22.161+0000 7f1f3ffff640 1 --2- 172.21.15.31:0/4231317739 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f1f2803e740 0x7f1f28040c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:22.164 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:22.161+0000 7f1f3ffff640 1 -- 172.21.15.31:0/4231317739 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7f1f38053410 con 0x7f1f48063e80 2024-09-22T08:36:22.164 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:22.162+0000 7f1f46ffd640 1 --2- 172.21.15.31:0/4231317739 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f1f2803e740 0x7f1f28040c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:22.165 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:22.162+0000 7f1f46ffd640 1 --2- 172.21.15.31:0/4231317739 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f1f2803e740 0x7f1f28040c00 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f1f30034000 tx=0x7f1f3002e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:22.167 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:22.166+0000 7f1f3ffff640 1 -- 172.21.15.31:0/4231317739 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f1f38007a90 con 0x7f1f48063e80 2024-09-22T08:36:22.349 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:22.348+0000 7f1f4cd9f640 1 -- 172.21.15.31:0/4231317739 --> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1f48094d20 con 0x7f1f2803e740 2024-09-22T08:36:22.350 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:22.349+0000 7f1f3ffff640 1 -- 172.21.15.31:0/4231317739 <== mgr.4099 v2:172.21.15.142:6824/99931088 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+32204 (secure 0 0 0) 0x7f1f48094d20 con 0x7f1f2803e740 2024-09-22T08:36:22.351 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-22T08:36:22.351 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2024-09-22T08:36:22.353 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:22.351+0000 7f1f4cd9f640 1 -- 172.21.15.31:0/4231317739 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f1f2803e740 msgr2=0x7f1f28040c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:22.353 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:22.351+0000 7f1f4cd9f640 1 --2- 172.21.15.31:0/4231317739 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f1f2803e740 0x7f1f28040c00 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f1f30034000 tx=0x7f1f3002e000 comp rx=0 tx=0).stop 2024-09-22T08:36:22.353 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:22.351+0000 7f1f4cd9f640 1 -- 172.21.15.31:0/4231317739 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1f48063e80 msgr2=0x7f1f48092d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:22.353 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:22.351+0000 7f1f4cd9f640 1 --2- 172.21.15.31:0/4231317739 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1f48063e80 0x7f1f48092d90 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f1f3800cb30 tx=0x7f1f3800a060 comp rx=0 tx=0).stop 2024-09-22T08:36:22.353 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:22.351+0000 7f1f4cd9f640 1 -- 172.21.15.31:0/4231317739 shutdown_connections 2024-09-22T08:36:22.353 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:22.351+0000 7f1f4cd9f640 1 --2- 172.21.15.31:0/4231317739 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f1f2803e740 0x7f1f28040c00 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:22.354 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:22.351+0000 7f1f4cd9f640 1 --2- 172.21.15.31:0/4231317739 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1f48063e80 0x7f1f48092d90 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:22.354 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:22.351+0000 7f1f4cd9f640 1 -- 172.21.15.31:0/4231317739 >> 172.21.15.31:0/4231317739 conn(0x7f1f4809b7d0 msgr2=0x7f1f480994f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:22.354 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:22.352+0000 7f1f4cd9f640 1 -- 172.21.15.31:0/4231317739 shutdown_connections 2024-09-22T08:36:22.354 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:22.352+0000 7f1f4cd9f640 1 -- 172.21.15.31:0/4231317739 wait complete. 2024-09-22T08:36:22.363 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-09-22T08:36:21.145031+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":17,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":109876,"kb_used_data":1744,"kb_used_omap":6,"kb_used_meta":108025,"kb_avail":377377484,"statfs":{"total":386547056640,"available":386434543616,"internally_reserved":0,"allocated":1785856,"data_stored":1371234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":110618390},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.726445"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T08:36:18.432305+0000","last_change":"2024-09-22T08:36:18.432491+0000","last_active":"2024-09-22T08:36:18.432305+0000","last_peered":"2024-09-22T08:36:18.432305+0000","last_clean":"2024-09-22T08:36:18.432305+0000","last_became_active":"2024-09-22T08:36:16.638610+0000","last_became_peered":"2024-09-22T08:36:16.638610+0000","last_unstale":"2024-09-22T08:36:18.432305+0000","last_undegraded":"2024-09-22T08:36:18.432305+0000","last_fullsized":"2024-09-22T08:36:18.432305+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:15.415268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:15.415268+0000","last_clean_scrub_stamp":"2024-09-22T08:36:15.415268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:36:49.729872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001119264,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T08:36:18.434184+0000","last_change":"2024-09-22T08:36:18.434431+0000","last_active":"2024-09-22T08:36:18.434184+0000","last_peered":"2024-09-22T08:36:18.434184+0000","last_clean":"2024-09-22T08:36:18.434184+0000","last_became_active":"2024-09-22T08:36:16.425549+0000","last_became_peered":"2024-09-22T08:36:16.425549+0000","last_unstale":"2024-09-22T08:36:18.434184+0000","last_undegraded":"2024-09-22T08:36:18.434184+0000","last_fullsized":"2024-09-22T08:36:18.434184+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:15.415268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:15.415268+0000","last_clean_scrub_stamp":"2024-09-22T08:36:15.415268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:59:01.714308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045809600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T08:36:18.431898+0000","last_change":"2024-09-22T08:36:18.432154+0000","last_active":"2024-09-22T08:36:18.431898+0000","last_peered":"2024-09-22T08:36:18.431898+0000","last_clean":"2024-09-22T08:36:18.431898+0000","last_became_active":"2024-09-22T08:36:16.427154+0000","last_became_peered":"2024-09-22T08:36:16.427154+0000","last_unstale":"2024-09-22T08:36:18.431898+0000","last_undegraded":"2024-09-22T08:36:18.431898+0000","last_fullsized":"2024-09-22T08:36:18.431898+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:15.415268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:15.415268+0000","last_clean_scrub_stamp":"2024-09-22T08:36:15.415268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:44:41.260462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081028899999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T08:36:18.434134+0000","last_change":"2024-09-22T08:36:18.434398+0000","last_active":"2024-09-22T08:36:18.434134+0000","last_peered":"2024-09-22T08:36:18.434134+0000","last_clean":"2024-09-22T08:36:18.434134+0000","last_became_active":"2024-09-22T08:36:16.424946+0000","last_became_peered":"2024-09-22T08:36:16.424946+0000","last_unstale":"2024-09-22T08:36:18.434134+0000","last_undegraded":"2024-09-22T08:36:18.434134+0000","last_fullsized":"2024-09-22T08:36:18.434134+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:15.415268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:15.415268+0000","last_clean_scrub_stamp":"2024-09-22T08:36:15.415268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:29:12.209070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045979400000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"17'2","reported_seq":22,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T08:36:18.432421+0000","last_change":"2024-09-22T08:36:18.432421+0000","last_active":"2024-09-22T08:36:18.432421+0000","last_peered":"2024-09-22T08:36:18.432421+0000","last_clean":"2024-09-22T08:36:18.432421+0000","last_became_active":"2024-09-22T08:36:16.427358+0000","last_became_peered":"2024-09-22T08:36:16.427358+0000","last_unstale":"2024-09-22T08:36:18.432421+0000","last_undegraded":"2024-09-22T08:36:18.432421+0000","last_fullsized":"2024-09-22T08:36:18.432421+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:15.415268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:15.415268+0000","last_clean_scrub_stamp":"2024-09-22T08:36:15.415268+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:16:15.903021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001068835,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T08:36:18.520219+0000","last_change":"2024-09-22T08:36:18.520219+0000","last_active":"2024-09-22T08:36:18.520219+0000","last_peered":"2024-09-22T08:36:18.520219+0000","last_clean":"2024-09-22T08:36:18.520219+0000","last_became_active":"2024-09-22T08:36:16.427121+0000","last_became_peered":"2024-09-22T08:36:16.427121+0000","last_unstale":"2024-09-22T08:36:18.520219+0000","last_undegraded":"2024-09-22T08:36:18.520219+0000","last_fullsized":"2024-09-22T08:36:18.520219+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:15.415268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:15.415268+0000","last_clean_scrub_stamp":"2024-09-22T08:36:15.415268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:47:57.246114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041194099999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T08:36:18.431662+0000","last_change":"2024-09-22T08:36:18.431890+0000","last_active":"2024-09-22T08:36:18.431662+0000","last_peered":"2024-09-22T08:36:18.431662+0000","last_clean":"2024-09-22T08:36:18.431662+0000","last_became_active":"2024-09-22T08:36:16.427252+0000","last_became_peered":"2024-09-22T08:36:16.427252+0000","last_unstale":"2024-09-22T08:36:18.431662+0000","last_undegraded":"2024-09-22T08:36:18.431662+0000","last_fullsized":"2024-09-22T08:36:18.431662+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:15.415268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:15.415268+0000","last_clean_scrub_stamp":"2024-09-22T08:36:15.415268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:11:12.623975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055484200000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"15'1","reported_seq":21,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T08:36:18.431612+0000","last_change":"2024-09-22T08:36:18.431832+0000","last_active":"2024-09-22T08:36:18.431612+0000","last_peered":"2024-09-22T08:36:18.431612+0000","last_clean":"2024-09-22T08:36:18.431612+0000","last_became_active":"2024-09-22T08:36:16.425465+0000","last_became_peered":"2024-09-22T08:36:16.425465+0000","last_unstale":"2024-09-22T08:36:18.431612+0000","last_undegraded":"2024-09-22T08:36:18.431612+0000","last_fullsized":"2024-09-22T08:36:18.431612+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:15.415268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:15.415268+0000","last_clean_scrub_stamp":"2024-09-22T08:36:15.415268+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:34:11.990226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049376300000000004,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"12'72","reported_seq":111,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T08:36:18.429512+0000","last_change":"2024-09-22T08:36:10.737141+0000","last_active":"2024-09-22T08:36:18.429512+0000","last_peered":"2024-09-22T08:36:18.429512+0000","last_clean":"2024-09-22T08:36:18.429512+0000","last_became_active":"2024-09-22T08:36:10.736221+0000","last_became_peered":"2024-09-22T08:36:10.736221+0000","last_unstale":"2024-09-22T08:36:18.429512+0000","last_undegraded":"2024-09-22T08:36:18.429512+0000","last_fullsized":"2024-09-22T08:36:18.429512+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:09.401562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:09.401562+0000","last_clean_scrub_stamp":"2024-09-22T08:36:09.401562+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:14:13.135964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":11,"seq":47244640263,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27756,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344084,"statfs":{"total":96636764160,"available":96608342016,"internally_reserved":0,"allocated":741376,"data_stored":637983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640263,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27752,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344088,"statfs":{"total":96636764160,"available":96608346112,"internally_reserved":0,"allocated":741376,"data_stored":637983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":9,"seq":38654705669,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27184,"kb_used_data":148,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":151552,"data_stored":47634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705669,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27184,"kb_used_data":148,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":151552,"data_stored":47634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T08:36:22.364 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-22T08:36:22.364 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-22T08:36:22.364 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-22T08:36:22.364 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-22T08:36:22.465 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:22.463+0000 7f93e8439640 1 Processor -- start 2024-09-22T08:36:22.465 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:22.463+0000 7f93e8439640 1 -- start start 2024-09-22T08:36:22.465 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:22.463+0000 7f93e8439640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f93e0071e30 0x7f93e0132790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:22.465 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:22.463+0000 7f93e8439640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f93e0071770 con 0x7f93e006e170 2024-09-22T08:36:22.465 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:22.463+0000 7f93e8439640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f93e0099ee0 con 0x7f93e0071e30 2024-09-22T08:36:22.465 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:22.464+0000 7f93e59d4640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f93e0071e30 0x7f93e0132790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:22.465 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:22.464+0000 7f93e61d5640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f93e006e170 0x7f93e006e550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:60416/0 (socket says 172.21.15.31:60416) 2024-09-22T08:36:22.465 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:22.464+0000 7f93e61d5640 1 -- 172.21.15.31:0/2340086909 learned_addr learned my addr 172.21.15.31:0/2340086909 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-22T08:36:22.466 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:22.464+0000 7f93e59d4640 1 -- 172.21.15.31:0/2340086909 >> v1:172.21.15.31:6789/0 conn(0x7f93e006e170 legacy=0x7f93e006e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:22.466 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:22.464+0000 7f93e59d4640 1 -- 172.21.15.31:0/2340086909 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93e0072530 con 0x7f93e0071e30 2024-09-22T08:36:22.467 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:22.464+0000 7f93e59d4640 1 --2- 172.21.15.31:0/2340086909 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f93e0071e30 0x7f93e0132790 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f93d0009750 tx=0x7f93d002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9e9c5125d6f4155 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:22.467 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:22.465+0000 7f93e51d3640 1 -- 172.21.15.31:0/2340086909 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f93d0037070 con 0x7f93e0071e30 2024-09-22T08:36:22.467 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:22.465+0000 7f93e51d3640 1 -- 172.21.15.31:0/2340086909 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93d002ad80 con 0x7f93e0071e30 2024-09-22T08:36:22.467 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:22.465+0000 7f93e51d3640 1 -- 172.21.15.31:0/2340086909 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f93d0032590 con 0x7f93e0071e30 2024-09-22T08:36:22.467 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:22.465+0000 7f93e8439640 1 -- 172.21.15.31:0/2340086909 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f93e0071e30 msgr2=0x7f93e0132790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:22.467 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:22.465+0000 7f93e8439640 1 --2- 172.21.15.31:0/2340086909 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f93e0071e30 0x7f93e0132790 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f93d0009750 tx=0x7f93d002a140 comp rx=0 tx=0).stop 2024-09-22T08:36:22.468 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:22.465+0000 7f93e8439640 1 -- 172.21.15.31:0/2340086909 shutdown_connections 2024-09-22T08:36:22.468 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:22.465+0000 7f93e8439640 1 --2- 172.21.15.31:0/2340086909 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f93e0071e30 0x7f93e0132790 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:22.468 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:22.465+0000 7f93e8439640 1 -- 172.21.15.31:0/2340086909 >> 172.21.15.31:0/2340086909 conn(0x7f93e009ac80 msgr2=0x7f93e0098550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:22.468 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:22.465+0000 7f93e8439640 1 -- 172.21.15.31:0/2340086909 shutdown_connections 2024-09-22T08:36:22.468 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:22.465+0000 7f93e8439640 1 -- 172.21.15.31:0/2340086909 wait complete. 2024-09-22T08:36:22.468 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:22.466+0000 7f93e8439640 1 Processor -- start 2024-09-22T08:36:22.468 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:22.466+0000 7f93e8439640 1 -- start start 2024-09-22T08:36:22.470 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:22.467+0000 7f93e8439640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f93e006e170 0x7f93e0129b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:22.470 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:22.467+0000 7f93e8439640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f93e006ee70 con 0x7f93e006e170 2024-09-22T08:36:22.470 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:22.467+0000 7f93e61d5640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f93e006e170 0x7f93e0129b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:22.470 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:22.467+0000 7f93e61d5640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f93e006e170 0x7f93e0129b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:48596/0 (socket says 172.21.15.31:48596) 2024-09-22T08:36:22.470 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:22.467+0000 7f93e61d5640 1 -- 172.21.15.31:0/2755803875 learned_addr learned my addr 172.21.15.31:0/2755803875 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-22T08:36:22.470 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:22.467+0000 7f93e61d5640 1 -- 172.21.15.31:0/2755803875 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93e01278b0 con 0x7f93e006e170 2024-09-22T08:36:22.470 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:22.467+0000 7f93e61d5640 1 --2- 172.21.15.31:0/2755803875 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f93e006e170 0x7f93e0129b10 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f93dc00c480 tx=0x7f93dc00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:22.470 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:22.467+0000 7f93d6ffd640 1 -- 172.21.15.31:0/2755803875 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f93dc017070 con 0x7f93e006e170 2024-09-22T08:36:22.470 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:22.467+0000 7f93d6ffd640 1 -- 172.21.15.31:0/2755803875 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93dc005c10 con 0x7f93e006e170 2024-09-22T08:36:22.470 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:22.467+0000 7f93e8439640 1 -- 172.21.15.31:0/2755803875 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93e0129590 con 0x7f93e006e170 2024-09-22T08:36:22.470 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:22.467+0000 7f93d6ffd640 1 -- 172.21.15.31:0/2755803875 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f93dc007070 con 0x7f93e006e170 2024-09-22T08:36:22.470 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:22.467+0000 7f93e8439640 1 -- 172.21.15.31:0/2755803875 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93e01289e0 con 0x7f93e006e170 2024-09-22T08:36:22.471 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:22.468+0000 7f93d6ffd640 1 -- 172.21.15.31:0/2755803875 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f93dc01a070 con 0x7f93e006e170 2024-09-22T08:36:22.471 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:22.468+0000 7f93e8439640 1 -- 172.21.15.31:0/2755803875 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f93e0128c70 con 0x7f93e006e170 2024-09-22T08:36:22.471 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:22.468+0000 7f93d6ffd640 1 --2- 172.21.15.31:0/2755803875 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f93c403e710 0x7f93c4040bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:22.471 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:22.468+0000 7f93d6ffd640 1 -- 172.21.15.31:0/2755803875 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7f93dc051f80 con 0x7f93e006e170 2024-09-22T08:36:22.471 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:22.469+0000 7f93e59d4640 1 --2- 172.21.15.31:0/2755803875 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f93c403e710 0x7f93c4040bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:22.471 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:22.469+0000 7f93e59d4640 1 --2- 172.21.15.31:0/2755803875 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f93c403e710 0x7f93c4040bd0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f93d0034000 tx=0x7f93d002e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:22.474 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:22.473+0000 7f93d6ffd640 1 -- 172.21.15.31:0/2755803875 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f93dc01ac60 con 0x7f93e006e170 2024-09-22T08:36:22.697 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:22.696+0000 7f93e8439640 1 -- 172.21.15.31:0/2755803875 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f93e006e550 con 0x7f93e006e170 2024-09-22T08:36:22.698 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:22.696+0000 7f93d6ffd640 1 -- 172.21.15.31:0/2755803875 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f93dc019cd0 con 0x7f93e006e170 2024-09-22T08:36:22.698 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-22T08:36:22.698 INFO:teuthology.orchestra.run.smithi031.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-22T08:36:22.700 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:22.698+0000 7f93e8439640 1 -- 172.21.15.31:0/2755803875 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f93c403e710 msgr2=0x7f93c4040bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:22.700 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:22.698+0000 7f93e8439640 1 --2- 172.21.15.31:0/2755803875 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f93c403e710 0x7f93c4040bd0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f93d0034000 tx=0x7f93d002e000 comp rx=0 tx=0).stop 2024-09-22T08:36:22.700 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:22.698+0000 7f93e8439640 1 -- 172.21.15.31:0/2755803875 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f93e006e170 msgr2=0x7f93e0129b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:22.700 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:22.698+0000 7f93e8439640 1 --2- 172.21.15.31:0/2755803875 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f93e006e170 0x7f93e0129b10 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f93dc00c480 tx=0x7f93dc00c940 comp rx=0 tx=0).stop 2024-09-22T08:36:22.700 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:22.698+0000 7f93e8439640 1 -- 172.21.15.31:0/2755803875 shutdown_connections 2024-09-22T08:36:22.700 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:22.698+0000 7f93e8439640 1 --2- 172.21.15.31:0/2755803875 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f93c403e710 0x7f93c4040bd0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:22.700 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:22.698+0000 7f93e8439640 1 --2- 172.21.15.31:0/2755803875 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f93e006e170 0x7f93e0129b10 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:22.701 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:22.699+0000 7f93e8439640 1 -- 172.21.15.31:0/2755803875 >> 172.21.15.31:0/2755803875 conn(0x7f93e009ac80 msgr2=0x7f93e012b1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:22.701 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:22.699+0000 7f93e8439640 1 -- 172.21.15.31:0/2755803875 shutdown_connections 2024-09-22T08:36:22.701 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:36:22.699+0000 7f93e8439640 1 -- 172.21.15.31:0/2755803875 wait complete. 2024-09-22T08:36:22.710 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-22T08:36:22.710 INFO:teuthology.run_tasks:Running task rgw... 2024-09-22T08:36:22.724 DEBUG:tasks.rgw:config is {'client.0': None} 2024-09-22T08:36:22.724 DEBUG:tasks.rgw:client list is dict_keys(['client.0']) 2024-09-22T08:36:22.724 INFO:tasks.rgw:Creating data pools 2024-09-22T08:36:22.725 DEBUG:tasks.rgw:Obtaining remote for client client.0 2024-09-22T08:36:22.725 DEBUG:teuthology.orchestra.run.smithi142:> sudo ceph osd pool create default.rgw.buckets.data 64 64 --cluster ceph 2024-09-22T08:36:22.835 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:22.833+0000 7ff3c8c60640 1 Processor -- start 2024-09-22T08:36:22.835 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:22.833+0000 7ff3c8c60640 1 -- start start 2024-09-22T08:36:22.835 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:22.833+0000 7ff3c8c60640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ff3c4074ef0 0x7ff3c410fd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:22.835 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:22.833+0000 7ff3c8c60640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff3c41107e0 con 0x7ff3c41102c0 2024-09-22T08:36:22.835 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:22.833+0000 7ff3c8c60640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7ff3c41109b0 con 0x7ff3c4074ef0 2024-09-22T08:36:22.835 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:22.834+0000 7ff3c259c640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ff3c4074ef0 0x7ff3c410fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:22.835 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:22.834+0000 7ff3c1d9b640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7ff3c41102c0 0x7ff3c411b100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.142:41244/0 (socket says 172.21.15.142:41244) 2024-09-22T08:36:22.835 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:22.834+0000 7ff3c1d9b640 1 -- 172.21.15.142:0/3020769224 learned_addr learned my addr 172.21.15.142:0/3020769224 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-09-22T08:36:22.839 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:22.834+0000 7ff3c259c640 1 -- 172.21.15.142:0/3020769224 >> v1:172.21.15.31:6789/0 conn(0x7ff3c41102c0 legacy=0x7ff3c411b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:22.839 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:22.834+0000 7ff3c259c640 1 -- 172.21.15.142:0/3020769224 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3c4110b60 con 0x7ff3c4074ef0 2024-09-22T08:36:22.839 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:22.835+0000 7ff3c259c640 1 --2- 172.21.15.142:0/3020769224 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff3c4074ef0 0x7ff3c410fd80 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ff3b4009720 tx=0x7ff3b402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbc6b0a073d5044a server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:22.839 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:22.835+0000 7ff3c159a640 1 -- 172.21.15.142:0/3020769224 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff3b4037070 con 0x7ff3c4074ef0 2024-09-22T08:36:22.839 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:22.835+0000 7ff3c159a640 1 -- 172.21.15.142:0/3020769224 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3b402ad90 con 0x7ff3c4074ef0 2024-09-22T08:36:22.839 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:22.835+0000 7ff3c159a640 1 -- 172.21.15.142:0/3020769224 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff3b4032590 con 0x7ff3c4074ef0 2024-09-22T08:36:22.839 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:22.835+0000 7ff3c8c60640 1 -- 172.21.15.142:0/3020769224 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff3c4074ef0 msgr2=0x7ff3c410fd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:22.839 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:22.835+0000 7ff3c8c60640 1 --2- 172.21.15.142:0/3020769224 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff3c4074ef0 0x7ff3c410fd80 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ff3b4009720 tx=0x7ff3b402a110 comp rx=0 tx=0).stop 2024-09-22T08:36:22.839 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:22.835+0000 7ff3c8c60640 1 -- 172.21.15.142:0/3020769224 shutdown_connections 2024-09-22T08:36:22.840 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:22.835+0000 7ff3c8c60640 1 --2- 172.21.15.142:0/3020769224 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff3c4074ef0 0x7ff3c410fd80 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:22.840 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:22.835+0000 7ff3c8c60640 1 -- 172.21.15.142:0/3020769224 >> 172.21.15.142:0/3020769224 conn(0x7ff3c40702b0 msgr2=0x7ff3c40726d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:22.840 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:22.835+0000 7ff3c8c60640 1 -- 172.21.15.142:0/3020769224 shutdown_connections 2024-09-22T08:36:22.840 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:22.835+0000 7ff3c8c60640 1 -- 172.21.15.142:0/3020769224 wait complete. 2024-09-22T08:36:22.840 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:22.836+0000 7ff3c8c60640 1 Processor -- start 2024-09-22T08:36:22.840 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:22.836+0000 7ff3c8c60640 1 -- start start 2024-09-22T08:36:22.840 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:22.837+0000 7ff3c8c60640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff3c4074ef0 0x7ff3c4110fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:22.840 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:22.837+0000 7ff3c8c60640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7ff3c411cd00 con 0x7ff3c4074ef0 2024-09-22T08:36:22.840 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:22.837+0000 7ff3c259c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff3c4074ef0 0x7ff3c4110fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:22.840 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:22.837+0000 7ff3c259c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff3c4074ef0 0x7ff3c4110fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:34208/0 (socket says 172.21.15.142:34208) 2024-09-22T08:36:22.841 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:22.837+0000 7ff3c259c640 1 -- 172.21.15.142:0/3195720337 learned_addr learned my addr 172.21.15.142:0/3195720337 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:22.841 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:22.837+0000 7ff3c259c640 1 -- 172.21.15.142:0/3195720337 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3c4112eb0 con 0x7ff3c4074ef0 2024-09-22T08:36:22.841 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:22.837+0000 7ff3c259c640 1 --2- 172.21.15.142:0/3195720337 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff3c4074ef0 0x7ff3c4110fb0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ff3b4009720 tx=0x7ff3b40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:22.841 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:22.837+0000 7ff3b2ffd640 1 -- 172.21.15.142:0/3195720337 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff3b4041070 con 0x7ff3c4074ef0 2024-09-22T08:36:22.841 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:22.837+0000 7ff3b2ffd640 1 -- 172.21.15.142:0/3195720337 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3b403c590 con 0x7ff3c4074ef0 2024-09-22T08:36:22.841 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:22.837+0000 7ff3c8c60640 1 -- 172.21.15.142:0/3195720337 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3c4111550 con 0x7ff3c4074ef0 2024-09-22T08:36:22.841 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:22.837+0000 7ff3b2ffd640 1 -- 172.21.15.142:0/3195720337 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff3b4037040 con 0x7ff3c4074ef0 2024-09-22T08:36:22.841 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:22.838+0000 7ff3c8c60640 1 -- 172.21.15.142:0/3195720337 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3c4111af0 con 0x7ff3c4074ef0 2024-09-22T08:36:22.842 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:22.838+0000 7ff3b2ffd640 1 -- 172.21.15.142:0/3195720337 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7ff3b4044070 con 0x7ff3c4074ef0 2024-09-22T08:36:22.842 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:22.838+0000 7ff3c8c60640 1 -- 172.21.15.142:0/3195720337 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3c410fe00 con 0x7ff3c4074ef0 2024-09-22T08:36:22.842 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:22.839+0000 7ff3b2ffd640 1 --2- 172.21.15.142:0/3195720337 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7ff3a403e6c0 0x7ff3a4040b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:22.842 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:22.839+0000 7ff3b2ffd640 1 -- 172.21.15.142:0/3195720337 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7ff3b4073940 con 0x7ff3c4074ef0 2024-09-22T08:36:22.842 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:22.839+0000 7ff3c1d9b640 1 --2- 172.21.15.142:0/3195720337 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7ff3a403e6c0 0x7ff3a4040b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:22.843 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:22.839+0000 7ff3c1d9b640 1 --2- 172.21.15.142:0/3195720337 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7ff3a403e6c0 0x7ff3a4040b80 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7ff3b8007fd0 tx=0x7ff3b8007aa0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:22.844 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:22.843+0000 7ff3b2ffd640 1 -- 172.21.15.142:0/3195720337 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7ff3b4045dc0 con 0x7ff3c4074ef0 2024-09-22T08:36:23.019 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:23.018+0000 7ff3c8c60640 1 -- 172.21.15.142:0/3195720337 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "default.rgw.buckets.data", "pg_num": 64, "pgp_num": 64} v 0) -- 0x7ff3c4111d70 con 0x7ff3c4074ef0 2024-09-22T08:36:23.436 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:23.435+0000 7ff3b2ffd640 1 -- 172.21.15.142:0/3195720337 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "default.rgw.buckets.data", "pg_num": 64, "pgp_num": 64}]=0 pool 'default.rgw.buckets.data' created v18) ==== 167+0+0 (secure 0 0 0) 0x7ff3b403d3f0 con 0x7ff3c4074ef0 2024-09-22T08:36:23.436 INFO:teuthology.orchestra.run.smithi142.stderr:pool 'default.rgw.buckets.data' created 2024-09-22T08:36:23.440 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:23.438+0000 7ff3c8c60640 1 -- 172.21.15.142:0/3195720337 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7ff3a403e6c0 msgr2=0x7ff3a4040b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:23.440 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:23.438+0000 7ff3c8c60640 1 --2- 172.21.15.142:0/3195720337 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7ff3a403e6c0 0x7ff3a4040b80 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7ff3b8007fd0 tx=0x7ff3b8007aa0 comp rx=0 tx=0).stop 2024-09-22T08:36:23.440 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:23.438+0000 7ff3c8c60640 1 -- 172.21.15.142:0/3195720337 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff3c4074ef0 msgr2=0x7ff3c4110fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:23.440 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:23.438+0000 7ff3c8c60640 1 --2- 172.21.15.142:0/3195720337 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff3c4074ef0 0x7ff3c4110fb0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ff3b4009720 tx=0x7ff3b40046c0 comp rx=0 tx=0).stop 2024-09-22T08:36:23.440 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:23.438+0000 7ff3c8c60640 1 -- 172.21.15.142:0/3195720337 shutdown_connections 2024-09-22T08:36:23.440 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:23.438+0000 7ff3c8c60640 1 --2- 172.21.15.142:0/3195720337 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7ff3a403e6c0 0x7ff3a4040b80 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:23.440 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:23.439+0000 7ff3c8c60640 1 --2- 172.21.15.142:0/3195720337 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff3c4074ef0 0x7ff3c4110fb0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:23.440 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:23.439+0000 7ff3c8c60640 1 -- 172.21.15.142:0/3195720337 >> 172.21.15.142:0/3195720337 conn(0x7ff3c40702b0 msgr2=0x7ff3c41181a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:23.441 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:23.439+0000 7ff3c8c60640 1 -- 172.21.15.142:0/3195720337 shutdown_connections 2024-09-22T08:36:23.441 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:23.439+0000 7ff3c8c60640 1 -- 172.21.15.142:0/3195720337 wait complete. 2024-09-22T08:36:23.457 DEBUG:teuthology.orchestra.run.smithi142:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster ceph 2024-09-22T08:36:23.559 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:23.556+0000 7f5ce51a0640 1 Processor -- start 2024-09-22T08:36:23.560 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:23.557+0000 7f5ce51a0640 1 -- start start 2024-09-22T08:36:23.560 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:23.557+0000 7f5ce51a0640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f5ce0074ef0 0x7f5ce010fd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:23.560 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:23.557+0000 7f5ce51a0640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ce01107e0 con 0x7f5ce01102c0 2024-09-22T08:36:23.560 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:23.557+0000 7f5ce51a0640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f5ce01109b0 con 0x7f5ce0074ef0 2024-09-22T08:36:23.560 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:23.557+0000 7f5cded9d640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f5ce0074ef0 0x7f5ce010fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:23.560 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:23.557+0000 7f5cded9d640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f5ce0074ef0 0x7f5ce010fd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:34212/0 (socket says 172.21.15.142:34212) 2024-09-22T08:36:23.560 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:23.557+0000 7f5cded9d640 1 -- 172.21.15.142:0/2924764357 learned_addr learned my addr 172.21.15.142:0/2924764357 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:23.560 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:23.557+0000 7f5cd7fff640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f5ce01102c0 0x7f5ce011b100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.142:41246/0 (socket says 172.21.15.142:41246) 2024-09-22T08:36:23.560 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:23.557+0000 7f5cded9d640 1 -- 172.21.15.142:0/2924764357 >> v1:172.21.15.31:6789/0 conn(0x7f5ce01102c0 legacy=0x7f5ce011b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:23.560 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:23.557+0000 7f5cded9d640 1 -- 172.21.15.142:0/2924764357 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ce0110b60 con 0x7f5ce0074ef0 2024-09-22T08:36:23.560 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:23.558+0000 7f5cded9d640 1 --2- 172.21.15.142:0/2924764357 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5ce0074ef0 0x7f5ce010fd80 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f5cd00097f0 tx=0x7f5cd002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecca46ae74a77ef7 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:23.560 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:23.558+0000 7f5cde59c640 1 -- 172.21.15.142:0/2924764357 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5cd0037070 con 0x7f5ce0074ef0 2024-09-22T08:36:23.560 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:23.558+0000 7f5cde59c640 1 -- 172.21.15.142:0/2924764357 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5cd0032440 con 0x7f5ce0074ef0 2024-09-22T08:36:23.560 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:23.558+0000 7f5cde59c640 1 -- 172.21.15.142:0/2924764357 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5cd002ae60 con 0x7f5ce0074ef0 2024-09-22T08:36:23.564 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:23.559+0000 7f5ce51a0640 1 -- 172.21.15.142:0/2924764357 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5ce0074ef0 msgr2=0x7f5ce010fd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:23.564 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:23.559+0000 7f5ce51a0640 1 --2- 172.21.15.142:0/2924764357 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5ce0074ef0 0x7f5ce010fd80 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f5cd00097f0 tx=0x7f5cd002a1e0 comp rx=0 tx=0).stop 2024-09-22T08:36:23.564 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:23.559+0000 7f5ce51a0640 1 -- 172.21.15.142:0/2924764357 shutdown_connections 2024-09-22T08:36:23.564 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:23.559+0000 7f5ce51a0640 1 --2- 172.21.15.142:0/2924764357 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5ce0074ef0 0x7f5ce010fd80 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:23.564 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:23.559+0000 7f5ce51a0640 1 -- 172.21.15.142:0/2924764357 >> 172.21.15.142:0/2924764357 conn(0x7f5ce00702b0 msgr2=0x7f5ce00726d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:23.564 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:23.559+0000 7f5ce51a0640 1 -- 172.21.15.142:0/2924764357 shutdown_connections 2024-09-22T08:36:23.564 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:23.559+0000 7f5ce51a0640 1 -- 172.21.15.142:0/2924764357 wait complete. 2024-09-22T08:36:23.564 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:23.560+0000 7f5ce51a0640 1 Processor -- start 2024-09-22T08:36:23.564 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:23.560+0000 7f5ce51a0640 1 -- start start 2024-09-22T08:36:23.564 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:23.560+0000 7f5ce51a0640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5ce0074ef0 0x7f5ce0110fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:23.564 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:23.560+0000 7f5ce51a0640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f5ce011cd00 con 0x7f5ce0074ef0 2024-09-22T08:36:23.564 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:23.560+0000 7f5cded9d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5ce0074ef0 0x7f5ce0110fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:23.565 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:23.560+0000 7f5cded9d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5ce0074ef0 0x7f5ce0110fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:34214/0 (socket says 172.21.15.142:34214) 2024-09-22T08:36:23.565 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:23.560+0000 7f5cded9d640 1 -- 172.21.15.142:0/2203955884 learned_addr learned my addr 172.21.15.142:0/2203955884 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:23.565 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:23.561+0000 7f5cded9d640 1 -- 172.21.15.142:0/2203955884 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ce0112eb0 con 0x7f5ce0074ef0 2024-09-22T08:36:23.565 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:23.561+0000 7f5cded9d640 1 --2- 172.21.15.142:0/2203955884 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5ce0074ef0 0x7f5ce0110fb0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f5cd0035040 tx=0x7f5cd00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:23.565 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:23.561+0000 7f5cd77fe640 1 -- 172.21.15.142:0/2203955884 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5cd0041070 con 0x7f5ce0074ef0 2024-09-22T08:36:23.565 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:23.561+0000 7f5cd77fe640 1 -- 172.21.15.142:0/2203955884 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5cd003c7a0 con 0x7f5ce0074ef0 2024-09-22T08:36:23.565 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:23.561+0000 7f5ce51a0640 1 -- 172.21.15.142:0/2203955884 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ce0111550 con 0x7f5ce0074ef0 2024-09-22T08:36:23.565 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:23.561+0000 7f5cd77fe640 1 -- 172.21.15.142:0/2203955884 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5cd0037040 con 0x7f5ce0074ef0 2024-09-22T08:36:23.565 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:23.561+0000 7f5ce51a0640 1 -- 172.21.15.142:0/2203955884 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ce0111af0 con 0x7f5ce0074ef0 2024-09-22T08:36:23.565 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:23.562+0000 7f5ce51a0640 1 -- 172.21.15.142:0/2203955884 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ce010fe00 con 0x7f5ce0074ef0 2024-09-22T08:36:23.565 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:23.562+0000 7f5cd77fe640 1 -- 172.21.15.142:0/2203955884 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f5cd0044070 con 0x7f5ce0074ef0 2024-09-22T08:36:23.565 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:23.562+0000 7f5cd77fe640 1 --2- 172.21.15.142:0/2203955884 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f5cc003e6f0 0x7f5cc0040bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:23.565 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:23.562+0000 7f5cd77fe640 1 -- 172.21.15.142:0/2203955884 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3873+0+0 (secure 0 0 0) 0x7f5cd0073ac0 con 0x7f5ce0074ef0 2024-09-22T08:36:23.565 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:23.562+0000 7f5cd7fff640 1 --2- 172.21.15.142:0/2203955884 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f5cc003e6f0 0x7f5cc0040bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:23.566 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:23.563+0000 7f5cd7fff640 1 --2- 172.21.15.142:0/2203955884 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f5cc003e6f0 0x7f5cc0040bb0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f5cc8001630 tx=0x7f5cc8007a20 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:23.568 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:23.567+0000 7f5cd77fe640 1 -- 172.21.15.142:0/2203955884 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f5cd003d3f0 con 0x7f5ce0074ef0 2024-09-22T08:36:23.744 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:23.743+0000 7f5ce51a0640 1 -- 172.21.15.142:0/2203955884 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "default.rgw.buckets.data", "app": "rgw"} v 0) -- 0x7f5ce0111d70 con 0x7f5ce0074ef0 2024-09-22T08:36:23.957 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:23.956+0000 7f5cd77fe640 1 -- 172.21.15.142:0/2203955884 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "default.rgw.buckets.data", "app": "rgw"}]=0 enabled application 'rgw' on pool 'default.rgw.buckets.data' v19) ==== 185+0+0 (secure 0 0 0) 0x7f5cd003cac0 con 0x7f5ce0074ef0 2024-09-22T08:36:23.957 INFO:teuthology.orchestra.run.smithi142.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2024-09-22T08:36:23.961 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:23.959+0000 7f5ce51a0640 1 -- 172.21.15.142:0/2203955884 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f5cc003e6f0 msgr2=0x7f5cc0040bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:23.961 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:23.959+0000 7f5ce51a0640 1 --2- 172.21.15.142:0/2203955884 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f5cc003e6f0 0x7f5cc0040bb0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f5cc8001630 tx=0x7f5cc8007a20 comp rx=0 tx=0).stop 2024-09-22T08:36:23.961 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:23.959+0000 7f5ce51a0640 1 -- 172.21.15.142:0/2203955884 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5ce0074ef0 msgr2=0x7f5ce0110fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:23.961 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:23.959+0000 7f5ce51a0640 1 --2- 172.21.15.142:0/2203955884 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5ce0074ef0 0x7f5ce0110fb0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f5cd0035040 tx=0x7f5cd00046c0 comp rx=0 tx=0).stop 2024-09-22T08:36:23.961 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:23.959+0000 7f5ce51a0640 1 -- 172.21.15.142:0/2203955884 shutdown_connections 2024-09-22T08:36:23.961 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:23.959+0000 7f5ce51a0640 1 --2- 172.21.15.142:0/2203955884 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f5cc003e6f0 0x7f5cc0040bb0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:23.961 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:23.959+0000 7f5ce51a0640 1 --2- 172.21.15.142:0/2203955884 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5ce0074ef0 0x7f5ce0110fb0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:23.961 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:23.959+0000 7f5ce51a0640 1 -- 172.21.15.142:0/2203955884 >> 172.21.15.142:0/2203955884 conn(0x7f5ce00702b0 msgr2=0x7f5ce01181a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:23.961 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:23.959+0000 7f5ce51a0640 1 -- 172.21.15.142:0/2203955884 shutdown_connections 2024-09-22T08:36:23.961 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:23.959+0000 7f5ce51a0640 1 -- 172.21.15.142:0/2203955884 wait complete. 2024-09-22T08:36:23.977 DEBUG:teuthology.orchestra.run.smithi142:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster ceph 2024-09-22T08:36:24.077 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:24.076+0000 7f362bc5a640 1 Processor -- start 2024-09-22T08:36:24.077 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:24.076+0000 7f362bc5a640 1 -- start start 2024-09-22T08:36:24.077 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:24.076+0000 7f362bc5a640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f36241148a0 0x7f3624114c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:24.077 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:24.076+0000 7f362bc5a640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36241153a0 con 0x7f36240741e0 2024-09-22T08:36:24.077 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:24.076+0000 7f362bc5a640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f3624074d80 con 0x7f36241148a0 2024-09-22T08:36:24.078 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:24.076+0000 7f36299f6640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f36241148a0 0x7f3624114c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:24.078 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:24.076+0000 7f36299f6640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f36241148a0 0x7f3624114c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:34222/0 (socket says 172.21.15.142:34222) 2024-09-22T08:36:24.078 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:24.076+0000 7f36299f6640 1 -- 172.21.15.142:0/3816723511 learned_addr learned my addr 172.21.15.142:0/3816723511 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:24.078 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:24.076+0000 7f36291f5640 1 --1- 172.21.15.142:0/3816723511 >> v1:172.21.15.31:6789/0 conn(0x7f36240741e0 0x7f3624074670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.142:41250/0 (socket says 172.21.15.142:41250) 2024-09-22T08:36:24.078 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:24.077+0000 7f36299f6640 1 -- 172.21.15.142:0/3816723511 >> v1:172.21.15.31:6789/0 conn(0x7f36240741e0 legacy=0x7f3624074670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:24.078 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:24.077+0000 7f36299f6640 1 -- 172.21.15.142:0/3816723511 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3624074f30 con 0x7f36241148a0 2024-09-22T08:36:24.080 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:24.077+0000 7f36299f6640 1 --2- 172.21.15.142:0/3816723511 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f36241148a0 0x7f3624114c80 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f36200097f0 tx=0x7f362002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29dda0400311c0be server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:24.080 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:24.078+0000 7f36289f4640 1 -- 172.21.15.142:0/3816723511 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3620037070 con 0x7f36241148a0 2024-09-22T08:36:24.080 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:24.078+0000 7f36289f4640 1 -- 172.21.15.142:0/3816723511 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3620032440 con 0x7f36241148a0 2024-09-22T08:36:24.080 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:24.078+0000 7f36289f4640 1 -- 172.21.15.142:0/3816723511 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f362002ae60 con 0x7f36241148a0 2024-09-22T08:36:24.080 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:24.078+0000 7f362bc5a640 1 -- 172.21.15.142:0/3816723511 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f36241148a0 msgr2=0x7f3624114c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:24.080 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:24.078+0000 7f362bc5a640 1 --2- 172.21.15.142:0/3816723511 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f36241148a0 0x7f3624114c80 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f36200097f0 tx=0x7f362002a1e0 comp rx=0 tx=0).stop 2024-09-22T08:36:24.080 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:24.078+0000 7f362bc5a640 1 -- 172.21.15.142:0/3816723511 shutdown_connections 2024-09-22T08:36:24.080 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:24.078+0000 7f362bc5a640 1 --2- 172.21.15.142:0/3816723511 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f36241148a0 0x7f3624114c80 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:24.080 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:24.078+0000 7f362bc5a640 1 -- 172.21.15.142:0/3816723511 >> 172.21.15.142:0/3816723511 conn(0x7f36240702b0 msgr2=0x7f36240726d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:24.080 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:24.078+0000 7f362bc5a640 1 -- 172.21.15.142:0/3816723511 shutdown_connections 2024-09-22T08:36:24.080 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:24.078+0000 7f362bc5a640 1 -- 172.21.15.142:0/3816723511 wait complete. 2024-09-22T08:36:24.082 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:24.079+0000 7f362bc5a640 1 Processor -- start 2024-09-22T08:36:24.082 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:24.079+0000 7f362bc5a640 1 -- start start 2024-09-22T08:36:24.082 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:24.079+0000 7f362bc5a640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f36240741e0 0x7f36241a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:24.082 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:24.079+0000 7f362bc5a640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f362411bca0 con 0x7f36240741e0 2024-09-22T08:36:24.082 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:24.080+0000 7f36299f6640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f36240741e0 0x7f36241a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:24.082 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:24.080+0000 7f36299f6640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f36240741e0 0x7f36241a5780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:34232/0 (socket says 172.21.15.142:34232) 2024-09-22T08:36:24.082 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:24.080+0000 7f36299f6640 1 -- 172.21.15.142:0/4277137774 learned_addr learned my addr 172.21.15.142:0/4277137774 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:24.083 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:24.080+0000 7f36299f6640 1 -- 172.21.15.142:0/4277137774 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36241a5d50 con 0x7f36240741e0 2024-09-22T08:36:24.083 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:24.080+0000 7f36299f6640 1 --2- 172.21.15.142:0/4277137774 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f36240741e0 0x7f36241a5780 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f3620035040 tx=0x7f36200046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:24.083 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:24.080+0000 7f361a7fc640 1 -- 172.21.15.142:0/4277137774 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3620041070 con 0x7f36240741e0 2024-09-22T08:36:24.083 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:24.080+0000 7f361a7fc640 1 -- 172.21.15.142:0/4277137774 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f362003c7a0 con 0x7f36240741e0 2024-09-22T08:36:24.083 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:24.080+0000 7f362bc5a640 1 -- 172.21.15.142:0/4277137774 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36241a5fe0 con 0x7f36240741e0 2024-09-22T08:36:24.083 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:24.080+0000 7f361a7fc640 1 -- 172.21.15.142:0/4277137774 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3620037040 con 0x7f36240741e0 2024-09-22T08:36:24.084 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:24.080+0000 7f362bc5a640 1 -- 172.21.15.142:0/4277137774 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36241aafb0 con 0x7f36240741e0 2024-09-22T08:36:24.085 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:24.081+0000 7f362bc5a640 1 -- 172.21.15.142:0/4277137774 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3624114d00 con 0x7f36240741e0 2024-09-22T08:36:24.085 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:24.081+0000 7f361a7fc640 1 -- 172.21.15.142:0/4277137774 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f3620044070 con 0x7f36240741e0 2024-09-22T08:36:24.085 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:24.082+0000 7f361a7fc640 1 --2- 172.21.15.142:0/4277137774 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f360803e6f0 0x7f3608040bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:24.085 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:24.082+0000 7f361a7fc640 1 -- 172.21.15.142:0/4277137774 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 3884+0+0 (secure 0 0 0) 0x7f3620073af0 con 0x7f36240741e0 2024-09-22T08:36:24.085 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:24.082+0000 7f36291f5640 1 --2- 172.21.15.142:0/4277137774 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f360803e6f0 0x7f3608040bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:24.085 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:24.082+0000 7f36291f5640 1 --2- 172.21.15.142:0/4277137774 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f360803e6f0 0x7f3608040bb0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f3614001630 tx=0x7f3614007a20 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:24.088 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:24.087+0000 7f361a7fc640 1 -- 172.21.15.142:0/4277137774 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f362003d3f0 con 0x7f36240741e0 2024-09-22T08:36:24.263 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:24.262+0000 7f362bc5a640 1 -- 172.21.15.142:0/4277137774 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "default.rgw.buckets.index", "pg_num": 64, "pgp_num": 64} v 0) -- 0x7f36241148a0 con 0x7f36240741e0 2024-09-22T08:36:24.958 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:24.958+0000 7f361a7fc640 1 -- 172.21.15.142:0/4277137774 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "default.rgw.buckets.index", "pg_num": 64, "pgp_num": 64}]=0 pool 'default.rgw.buckets.index' created v20) ==== 169+0+0 (secure 0 0 0) 0x7f362003ac80 con 0x7f36240741e0 2024-09-22T08:36:24.959 INFO:teuthology.orchestra.run.smithi142.stderr:pool 'default.rgw.buckets.index' created 2024-09-22T08:36:24.962 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:24.961+0000 7f362bc5a640 1 -- 172.21.15.142:0/4277137774 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f360803e6f0 msgr2=0x7f3608040bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:24.962 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:24.961+0000 7f362bc5a640 1 --2- 172.21.15.142:0/4277137774 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f360803e6f0 0x7f3608040bb0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f3614001630 tx=0x7f3614007a20 comp rx=0 tx=0).stop 2024-09-22T08:36:24.963 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:24.961+0000 7f362bc5a640 1 -- 172.21.15.142:0/4277137774 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f36240741e0 msgr2=0x7f36241a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:24.963 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:24.961+0000 7f362bc5a640 1 --2- 172.21.15.142:0/4277137774 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f36240741e0 0x7f36241a5780 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f3620035040 tx=0x7f36200046c0 comp rx=0 tx=0).stop 2024-09-22T08:36:24.963 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:24.962+0000 7f362bc5a640 1 -- 172.21.15.142:0/4277137774 shutdown_connections 2024-09-22T08:36:24.963 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:24.962+0000 7f362bc5a640 1 --2- 172.21.15.142:0/4277137774 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f360803e6f0 0x7f3608040bb0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:24.963 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:24.962+0000 7f362bc5a640 1 --2- 172.21.15.142:0/4277137774 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f36240741e0 0x7f36241a5780 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:24.963 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:24.962+0000 7f362bc5a640 1 -- 172.21.15.142:0/4277137774 >> 172.21.15.142:0/4277137774 conn(0x7f36240702b0 msgr2=0x7f362410fec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:24.966 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:24.965+0000 7f362bc5a640 1 -- 172.21.15.142:0/4277137774 shutdown_connections 2024-09-22T08:36:24.967 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:24.965+0000 7f362bc5a640 1 -- 172.21.15.142:0/4277137774 wait complete. 2024-09-22T08:36:24.984 DEBUG:teuthology.orchestra.run.smithi142:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster ceph 2024-09-22T08:36:25.085 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:25.083+0000 7f4bbec8c640 1 Processor -- start 2024-09-22T08:36:25.085 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:25.083+0000 7f4bbec8c640 1 -- start start 2024-09-22T08:36:25.086 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:25.084+0000 7f4bbec8c640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f4bb81187d0 0x7f4bb811abc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:25.086 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:25.084+0000 7f4bbec8c640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4bb811b190 con 0x7f4bb81148a0 2024-09-22T08:36:25.086 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:25.084+0000 7f4bbec8c640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f4bb811c370 con 0x7f4bb81187d0 2024-09-22T08:36:25.086 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:25.084+0000 7f4bb7fff640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f4bb81187d0 0x7f4bb811abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:25.086 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:25.084+0000 7f4bb7fff640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f4bb81187d0 0x7f4bb811abc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:34238/0 (socket says 172.21.15.142:34238) 2024-09-22T08:36:25.086 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:25.084+0000 7f4bb7fff640 1 -- 172.21.15.142:0/3708514197 learned_addr learned my addr 172.21.15.142:0/3708514197 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:25.087 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:25.085+0000 7f4bb7fff640 1 -- 172.21.15.142:0/3708514197 >> v1:172.21.15.31:6789/0 conn(0x7f4bb81148a0 legacy=0x7f4bb8114c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:25.088 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:25.085+0000 7f4bb7fff640 1 -- 172.21.15.142:0/3708514197 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bb811c4f0 con 0x7f4bb81187d0 2024-09-22T08:36:25.088 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:25.085+0000 7f4bb7fff640 1 --2- 172.21.15.142:0/3708514197 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4bb81187d0 0x7f4bb811abc0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f4ba40097f0 tx=0x7f4ba402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea8b9efdbebb707f server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:25.088 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:25.085+0000 7f4bb77fe640 1 -- 172.21.15.142:0/3708514197 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ba4037070 con 0x7f4bb81187d0 2024-09-22T08:36:25.088 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:25.086+0000 7f4bb77fe640 1 -- 172.21.15.142:0/3708514197 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ba4032440 con 0x7f4bb81187d0 2024-09-22T08:36:25.088 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:25.086+0000 7f4bb77fe640 1 -- 172.21.15.142:0/3708514197 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ba402ae60 con 0x7f4bb81187d0 2024-09-22T08:36:25.088 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:25.086+0000 7f4bbec8c640 1 -- 172.21.15.142:0/3708514197 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4bb81187d0 msgr2=0x7f4bb811abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:25.088 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:25.086+0000 7f4bbec8c640 1 --2- 172.21.15.142:0/3708514197 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4bb81187d0 0x7f4bb811abc0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f4ba40097f0 tx=0x7f4ba402a1e0 comp rx=0 tx=0).stop 2024-09-22T08:36:25.088 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:25.086+0000 7f4bbec8c640 1 -- 172.21.15.142:0/3708514197 shutdown_connections 2024-09-22T08:36:25.088 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:25.086+0000 7f4bbec8c640 1 --2- 172.21.15.142:0/3708514197 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4bb81187d0 0x7f4bb811abc0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:25.088 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:25.086+0000 7f4bbec8c640 1 -- 172.21.15.142:0/3708514197 >> 172.21.15.142:0/3708514197 conn(0x7f4bb80702b0 msgr2=0x7f4bb80726d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:25.088 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:25.086+0000 7f4bbec8c640 1 -- 172.21.15.142:0/3708514197 shutdown_connections 2024-09-22T08:36:25.088 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:25.086+0000 7f4bbec8c640 1 -- 172.21.15.142:0/3708514197 wait complete. 2024-09-22T08:36:25.090 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:25.087+0000 7f4bbec8c640 1 Processor -- start 2024-09-22T08:36:25.090 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:25.087+0000 7f4bbec8c640 1 -- start start 2024-09-22T08:36:25.090 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:25.087+0000 7f4bbec8c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4bb81148a0 0x7f4bb81a57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:25.091 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:25.087+0000 7f4bbec8c640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f4bb811b840 con 0x7f4bb81148a0 2024-09-22T08:36:25.091 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:25.087+0000 7f4bbca28640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4bb81148a0 0x7f4bb81a57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:25.091 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:25.088+0000 7f4bbca28640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4bb81148a0 0x7f4bb81a57c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:34240/0 (socket says 172.21.15.142:34240) 2024-09-22T08:36:25.091 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:25.088+0000 7f4bbca28640 1 -- 172.21.15.142:0/2957903999 learned_addr learned my addr 172.21.15.142:0/2957903999 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:25.091 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:25.088+0000 7f4bbca28640 1 -- 172.21.15.142:0/2957903999 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bb81a5d90 con 0x7f4bb81148a0 2024-09-22T08:36:25.091 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:25.088+0000 7f4bbca28640 1 --2- 172.21.15.142:0/2957903999 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4bb81148a0 0x7f4bb81a57c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f4bac00c480 tx=0x7f4bac00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:25.091 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:25.088+0000 7f4bb57fa640 1 -- 172.21.15.142:0/2957903999 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4bac017070 con 0x7f4bb81148a0 2024-09-22T08:36:25.091 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:25.088+0000 7f4bb57fa640 1 -- 172.21.15.142:0/2957903999 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4bac005200 con 0x7f4bb81148a0 2024-09-22T08:36:25.091 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:25.088+0000 7f4bbec8c640 1 -- 172.21.15.142:0/2957903999 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4bb81a6080 con 0x7f4bb81148a0 2024-09-22T08:36:25.091 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:25.088+0000 7f4bb57fa640 1 -- 172.21.15.142:0/2957903999 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4bac0035f0 con 0x7f4bb81148a0 2024-09-22T08:36:25.091 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:25.088+0000 7f4bbec8c640 1 -- 172.21.15.142:0/2957903999 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4bb81ab1d0 con 0x7f4bb81148a0 2024-09-22T08:36:25.091 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:25.089+0000 7f4bbec8c640 1 -- 172.21.15.142:0/2957903999 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4bb81a63c0 con 0x7f4bb81148a0 2024-09-22T08:36:25.091 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:25.089+0000 7f4bb57fa640 1 -- 172.21.15.142:0/2957903999 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f4bac01a070 con 0x7f4bb81148a0 2024-09-22T08:36:25.092 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:25.090+0000 7f4bb57fa640 1 --2- 172.21.15.142:0/2957903999 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f4b9c03e6f0 0x7f4b9c040bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:25.092 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:25.090+0000 7f4bb57fa640 1 -- 172.21.15.142:0/2957903999 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 4220+0+0 (secure 0 0 0) 0x7f4bac052480 con 0x7f4bb81148a0 2024-09-22T08:36:25.092 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:25.090+0000 7f4bb7fff640 1 --2- 172.21.15.142:0/2957903999 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f4b9c03e6f0 0x7f4b9c040bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:25.092 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:25.090+0000 7f4bb7fff640 1 --2- 172.21.15.142:0/2957903999 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f4b9c03e6f0 0x7f4b9c040bb0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f4ba4034000 tx=0x7f4ba402e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:25.096 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:25.095+0000 7f4bb57fa640 1 -- 172.21.15.142:0/2957903999 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f4bac011590 con 0x7f4bb81148a0 2024-09-22T08:36:25.275 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:25.274+0000 7f4bbec8c640 1 -- 172.21.15.142:0/2957903999 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "default.rgw.buckets.index", "app": "rgw"} v 0) -- 0x7f4bb811bea0 con 0x7f4bb81148a0 2024-09-22T08:36:25.962 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:25.961+0000 7f4bb57fa640 1 -- 172.21.15.142:0/2957903999 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "default.rgw.buckets.index", "app": "rgw"}]=0 enabled application 'rgw' on pool 'default.rgw.buckets.index' v21) ==== 187+0+0 (secure 0 0 0) 0x7f4bac01bdd0 con 0x7f4bb81148a0 2024-09-22T08:36:25.962 INFO:teuthology.orchestra.run.smithi142.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2024-09-22T08:36:25.966 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:25.965+0000 7f4bbec8c640 1 -- 172.21.15.142:0/2957903999 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f4b9c03e6f0 msgr2=0x7f4b9c040bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:25.966 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:25.965+0000 7f4bbec8c640 1 --2- 172.21.15.142:0/2957903999 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f4b9c03e6f0 0x7f4b9c040bb0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f4ba4034000 tx=0x7f4ba402e000 comp rx=0 tx=0).stop 2024-09-22T08:36:25.966 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:25.965+0000 7f4bbec8c640 1 -- 172.21.15.142:0/2957903999 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4bb81148a0 msgr2=0x7f4bb81a57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:25.966 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:25.965+0000 7f4bbec8c640 1 --2- 172.21.15.142:0/2957903999 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4bb81148a0 0x7f4bb81a57c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f4bac00c480 tx=0x7f4bac00c940 comp rx=0 tx=0).stop 2024-09-22T08:36:25.967 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:25.965+0000 7f4bbec8c640 1 -- 172.21.15.142:0/2957903999 shutdown_connections 2024-09-22T08:36:25.967 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:25.965+0000 7f4bbec8c640 1 --2- 172.21.15.142:0/2957903999 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f4b9c03e6f0 0x7f4b9c040bb0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:25.967 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:25.965+0000 7f4bbec8c640 1 --2- 172.21.15.142:0/2957903999 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4bb81148a0 0x7f4bb81a57c0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:25.967 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:25.965+0000 7f4bbec8c640 1 -- 172.21.15.142:0/2957903999 >> 172.21.15.142:0/2957903999 conn(0x7f4bb80702b0 msgr2=0x7f4bb81105a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:25.967 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:25.965+0000 7f4bbec8c640 1 -- 172.21.15.142:0/2957903999 shutdown_connections 2024-09-22T08:36:25.968 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:25.967+0000 7f4bbec8c640 1 -- 172.21.15.142:0/2957903999 wait complete. 2024-09-22T08:36:25.991 DEBUG:tasks.rgw:Pools created 2024-09-22T08:36:25.991 INFO:tasks.rgw:Starting rgw... 2024-09-22T08:36:25.991 INFO:tasks.rgw:rgw client.0 config is {} 2024-09-22T08:36:25.991 INFO:tasks.rgw:Using beast as radosgw frontend 2024-09-22T08:36:25.992 DEBUG:teuthology.orchestra.run.smithi142:> sudo echo -n http://smithi142.front.sepia.ceph.com:80 | sudo tee /home/ubuntu/cephtest/url_file 2024-09-22T08:36:26.020 INFO:teuthology.orchestra.run.smithi142.stdout:http://smithi142.front.sepia.ceph.com:80 2024-09-22T08:36:26.020 DEBUG:teuthology.orchestra.run.smithi142:> sudo chown ceph /home/ubuntu/cephtest/url_file 2024-09-22T08:36:26.086 INFO:tasks.rgw.client.0:Restarting daemon 2024-09-22T08:36:26.086 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=80' -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground | sudo tee /var/log/ceph/rgw.ceph.client.0.stdout 2>&1 2024-09-22T08:36:26.128 INFO:tasks.rgw.client.0:Started 2024-09-22T08:36:26.129 INFO:tasks.rgw:Polling client.0 until it starts accepting connections on http://smithi142.front.sepia.ceph.com:80/ 2024-09-22T08:36:26.129 DEBUG:teuthology.orchestra.run.smithi142:> curl http://smithi142.front.sepia.ceph.com:80/ 2024-09-22T08:36:26.159 INFO:teuthology.orchestra.run.smithi142.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-22T08:36:26.159 INFO:teuthology.orchestra.run.smithi142.stderr: Dload Upload Total Spent Left Speed 2024-09-22T08:36:26.159 INFO:teuthology.orchestra.run.smithi142.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-22T08:36:26.160 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-22T08:36:26.161 INFO:teuthology.orchestra.run.smithi142.stderr:curl: (7) Failed to connect to smithi142.front.sepia.ceph.com port 80: Connection refused 2024-09-22T08:36:27.161 DEBUG:teuthology.orchestra.run.smithi142:> curl http://smithi142.front.sepia.ceph.com:80/ 2024-09-22T08:36:27.183 INFO:teuthology.orchestra.run.smithi142.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-22T08:36:27.184 INFO:teuthology.orchestra.run.smithi142.stderr: Dload Upload Total Spent Left Speed 2024-09-22T08:36:27.185 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-22T08:36:27.185 INFO:teuthology.orchestra.run.smithi142.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-22T08:36:27.185 INFO:teuthology.orchestra.run.smithi142.stderr:curl: (7) Failed to connect to smithi142.front.sepia.ceph.com port 80: Connection refused 2024-09-22T08:36:29.187 DEBUG:teuthology.orchestra.run.smithi142:> curl http://smithi142.front.sepia.ceph.com:80/ 2024-09-22T08:36:29.210 INFO:teuthology.orchestra.run.smithi142.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-22T08:36:29.210 INFO:teuthology.orchestra.run.smithi142.stderr: Dload Upload Total Spent Left Speed 2024-09-22T08:36:29.211 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-22T08:36:29.211 INFO:teuthology.orchestra.run.smithi142.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-22T08:36:29.212 INFO:teuthology.orchestra.run.smithi142.stderr:curl: (7) Failed to connect to smithi142.front.sepia.ceph.com port 80: Connection refused 2024-09-22T08:36:33.212 DEBUG:teuthology.orchestra.run.smithi142:> curl http://smithi142.front.sepia.ceph.com:80/ 2024-09-22T08:36:33.236 INFO:teuthology.orchestra.run.smithi142.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-22T08:36:33.236 INFO:teuthology.orchestra.run.smithi142.stderr: Dload Upload Total Spent Left Speed 2024-09-22T08:36:33.236 INFO:teuthology.orchestra.run.smithi142.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-22T08:36:33.237 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-22T08:36:33.237 INFO:teuthology.orchestra.run.smithi142.stderr:curl: (7) Failed to connect to smithi142.front.sepia.ceph.com port 80: Connection refused 2024-09-22T08:36:41.239 DEBUG:teuthology.orchestra.run.smithi142:> curl http://smithi142.front.sepia.ceph.com:80/ 2024-09-22T08:36:41.262 INFO:teuthology.orchestra.run.smithi142.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-22T08:36:41.262 INFO:teuthology.orchestra.run.smithi142.stderr: Dload Upload Total Spent Left Speed 2024-09-22T08:36:41.264 INFO:teuthology.orchestra.run.smithi142.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 187 0 187 0 0 93500 0 --:--:-- --:--:-- --:--:-- 93500 2024-09-22T08:36:41.264 INFO:teuthology.orchestra.run.smithi142.stdout:anonymous 2024-09-22T08:36:41.264 INFO:teuthology.run_tasks:Running task radosgw-admin... 2024-09-22T08:36:41.346 DEBUG:tasks.radosgw_admin:config is: {'client.0': None} 2024-09-22T08:36:41.346 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list'] 2024-09-22T08:36:41.346 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list'] 2024-09-22T08:36:41.346 DEBUG:teuthology.orchestra.run.smithi142:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list 2024-09-22T08:36:41.396 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:36:41.396 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:36:41.398 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.394+0000 7fd140b1f800 1 Processor -- start 2024-09-22T08:36:41.398 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.395+0000 7fd140b1f800 1 -- start start 2024-09-22T08:36:41.398 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.395+0000 7fd140b1f800 1 --2- >> v2:172.21.15.31:3300/0 conn(0x564617abaaf0 0x564617abcee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:41.398 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.395+0000 7fd140b1f800 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x564617941a20 con 0x564617ab6fe0 2024-09-22T08:36:41.399 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.395+0000 7fd140b1f800 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x5646179417d0 con 0x564617abaaf0 2024-09-22T08:36:41.399 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.395+0000 7fd133f8a640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x564617abaaf0 0x564617abcee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:41.399 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.395+0000 7fd133f8a640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x564617abaaf0 0x564617abcee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:37378/0 (socket says 172.21.15.142:37378) 2024-09-22T08:36:41.399 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.395+0000 7fd13c78b640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x564617ab6fe0 0x564617ab93d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.142:42218/0 (socket says 172.21.15.142:42218) 2024-09-22T08:36:41.399 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.395+0000 7fd133f8a640 1 -- 172.21.15.142:0/776486332 learned_addr learned my addr 172.21.15.142:0/776486332 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:41.399 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.396+0000 7fd133f8a640 1 -- 172.21.15.142:0/776486332 >> v1:172.21.15.31:6789/0 conn(0x564617ab6fe0 legacy=0x564617ab93d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:41.400 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.396+0000 7fd13bf8a640 1 -- 172.21.15.142:0/776486332 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3117747658 0 0) 0x564617941a20 con 0x564617ab6fe0 2024-09-22T08:36:41.400 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.396+0000 7fd133f8a640 1 -- 172.21.15.142:0/776486332 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x564617abe570 con 0x564617abaaf0 2024-09-22T08:36:41.402 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.398+0000 7fd133f8a640 1 --2- 172.21.15.142:0/776486332 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564617abaaf0 0x564617abcee0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fd12400a520 tx=0x7fd124045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a098f08b2f4f5b1a server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:41.402 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.398+0000 7fd13bf8a640 1 -- 172.21.15.142:0/776486332 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd124055070 con 0x564617abaaf0 2024-09-22T08:36:41.402 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.398+0000 7fd13bf8a640 1 -- 172.21.15.142:0/776486332 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1240515b0 con 0x564617abaaf0 2024-09-22T08:36:41.402 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.398+0000 7fd13bf8a640 1 -- 172.21.15.142:0/776486332 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd1240518d0 con 0x564617abaaf0 2024-09-22T08:36:41.402 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.398+0000 7fd140b1f800 1 -- 172.21.15.142:0/776486332 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564617abaaf0 msgr2=0x564617abcee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:41.403 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.398+0000 7fd140b1f800 1 --2- 172.21.15.142:0/776486332 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564617abaaf0 0x564617abcee0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fd12400a520 tx=0x7fd124045ba0 comp rx=0 tx=0).stop 2024-09-22T08:36:41.403 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.398+0000 7fd140b1f800 1 -- 172.21.15.142:0/776486332 shutdown_connections 2024-09-22T08:36:41.403 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.398+0000 7fd140b1f800 1 --2- 172.21.15.142:0/776486332 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564617abaaf0 0x564617abcee0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:41.403 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.398+0000 7fd140b1f800 1 -- 172.21.15.142:0/776486332 >> 172.21.15.142:0/776486332 conn(0x564617ab0ba0 msgr2=0x564617ab3000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:41.403 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.398+0000 7fd140b1f800 1 -- 172.21.15.142:0/776486332 shutdown_connections 2024-09-22T08:36:41.403 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.398+0000 7fd140b1f800 1 -- 172.21.15.142:0/776486332 wait complete. 2024-09-22T08:36:41.417 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.414+0000 7fd140b1f800 1 Processor -- start 2024-09-22T08:36:41.417 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.414+0000 7fd140b1f800 1 -- start start 2024-09-22T08:36:41.417 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.414+0000 7fd140b1f800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564617ab6fe0 0x564617ba5e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:41.417 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.414+0000 7fd140b1f800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x56461794edd0 con 0x564617ab6fe0 2024-09-22T08:36:41.417 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.415+0000 7fd13c78b640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564617ab6fe0 0x564617ba5e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:41.417 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.415+0000 7fd13c78b640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564617ab6fe0 0x564617ba5e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:37384/0 (socket says 172.21.15.142:37384) 2024-09-22T08:36:41.417 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.415+0000 7fd13c78b640 1 -- 172.21.15.142:0/3349406407 learned_addr learned my addr 172.21.15.142:0/3349406407 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:41.419 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.415+0000 7fd13c78b640 1 -- 172.21.15.142:0/3349406407 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564617ba6470 con 0x564617ab6fe0 2024-09-22T08:36:41.419 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.415+0000 7fd13c78b640 1 --2- 172.21.15.142:0/3349406407 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564617ab6fe0 0x564617ba5e80 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fd12c001ea0 tx=0x7fd12c00b6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f17a7f577c965fa0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:41.419 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.415+0000 7fd02a60c640 1 -- 172.21.15.142:0/3349406407 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd12c008070 con 0x564617ab6fe0 2024-09-22T08:36:41.419 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.415+0000 7fd02a60c640 1 -- 172.21.15.142:0/3349406407 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd12c00d500 con 0x564617ab6fe0 2024-09-22T08:36:41.419 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.415+0000 7fd02a60c640 1 -- 172.21.15.142:0/3349406407 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd12c00d880 con 0x564617ab6fe0 2024-09-22T08:36:41.419 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.416+0000 7fd140b1f800 1 -- 172.21.15.142:0/3349406407 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564617ab6fe0 msgr2=0x564617ba5e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:41.419 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.416+0000 7fd140b1f800 1 --2- 172.21.15.142:0/3349406407 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564617ab6fe0 0x564617ba5e80 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fd12c001ea0 tx=0x7fd12c00b6a0 comp rx=0 tx=0).stop 2024-09-22T08:36:41.419 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.416+0000 7fd140b1f800 1 -- 172.21.15.142:0/3349406407 shutdown_connections 2024-09-22T08:36:41.420 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.416+0000 7fd140b1f800 1 --2- 172.21.15.142:0/3349406407 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564617ab6fe0 0x564617ba5e80 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:41.420 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.416+0000 7fd140b1f800 1 -- 172.21.15.142:0/3349406407 >> 172.21.15.142:0/3349406407 conn(0x564617ab0ba0 msgr2=0x564617ba1800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:41.420 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.416+0000 7fd140b1f800 1 -- 172.21.15.142:0/3349406407 shutdown_connections 2024-09-22T08:36:41.420 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.416+0000 7fd140b1f800 1 -- 172.21.15.142:0/3349406407 wait complete. 2024-09-22T08:36:41.420 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.417+0000 7fd140b1f800 1 Processor -- start 2024-09-22T08:36:41.420 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.417+0000 7fd140b1f800 1 -- start start 2024-09-22T08:36:41.420 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.417+0000 7fd140b1f800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564617ab6fe0 0x564617bad980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:41.420 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.417+0000 7fd140b1f800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x564617abd810 con 0x564617ab6fe0 2024-09-22T08:36:41.422 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.417+0000 7fd13c78b640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564617ab6fe0 0x564617bad980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:41.422 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.417+0000 7fd13c78b640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564617ab6fe0 0x564617bad980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:37386/0 (socket says 172.21.15.142:37386) 2024-09-22T08:36:41.422 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.417+0000 7fd13c78b640 1 -- 172.21.15.142:0/3366331119 learned_addr learned my addr 172.21.15.142:0/3366331119 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:41.423 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.418+0000 7fd13c78b640 1 -- 172.21.15.142:0/3366331119 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564617badee0 con 0x564617ab6fe0 2024-09-22T08:36:41.423 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.418+0000 7fd13c78b640 1 --2- 172.21.15.142:0/3366331119 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564617ab6fe0 0x564617bad980 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fd12c0012f0 tx=0x7fd12c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:41.423 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.418+0000 7fd028e09640 1 -- 172.21.15.142:0/3366331119 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd12c00f9d0 con 0x564617ab6fe0 2024-09-22T08:36:41.423 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.418+0000 7fd028e09640 1 -- 172.21.15.142:0/3366331119 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd12c00fb70 con 0x564617ab6fe0 2024-09-22T08:36:41.423 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.418+0000 7fd140b1f800 1 -- 172.21.15.142:0/3366331119 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564617bae170 con 0x564617ab6fe0 2024-09-22T08:36:41.423 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.418+0000 7fd028e09640 1 -- 172.21.15.142:0/3366331119 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd12c00fe50 con 0x564617ab6fe0 2024-09-22T08:36:41.423 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.418+0000 7fd140b1f800 1 -- 172.21.15.142:0/3366331119 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564617baeb70 con 0x564617ab6fe0 2024-09-22T08:36:41.423 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.419+0000 7fd028e09640 1 -- 172.21.15.142:0/3366331119 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fd12c017040 con 0x564617ab6fe0 2024-09-22T08:36:41.423 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.419+0000 7fd028e09640 1 --2- 172.21.15.142:0/3366331119 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fd02403d1a0 0x7fd02403f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:41.423 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.419+0000 7fd028e09640 1 -- 172.21.15.142:0/3366331119 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fd12c015020 con 0x564617ab6fe0 2024-09-22T08:36:41.423 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.419+0000 7fd133f8a640 1 --2- 172.21.15.142:0/3366331119 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fd02403d1a0 0x7fd02403f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:41.423 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.420+0000 7fd140b1f800 1 --2- 172.21.15.142:0/3366331119 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x564617abaaf0 0x564617bb4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:41.424 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.420+0000 7fd140b1f800 1 -- 172.21.15.142:0/3366331119 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564617bb5510 con 0x564617abaaf0 2024-09-22T08:36:41.424 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.420+0000 7fd13cf8c640 1 --2- 172.21.15.142:0/3366331119 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x564617abaaf0 0x564617bb4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:41.424 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.420+0000 7fd133f8a640 1 --2- 172.21.15.142:0/3366331119 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fd02403d1a0 0x7fd02403f660 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd124057000 tx=0x7fd124052000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:41.424 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.420+0000 7fd13cf8c640 1 --2- 172.21.15.142:0/3366331119 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x564617abaaf0 0x564617bb4fd0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:41.424 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.420+0000 7fd13cf8c640 1 -- 172.21.15.142:0/3366331119 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd13400a4d0 con 0x564617abaaf0 2024-09-22T08:36:41.424 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.420+0000 7fd140b1f800 1 -- 172.21.15.142:0/3366331119 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564617bb58b0 con 0x564617abaaf0 2024-09-22T08:36:41.427 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.421+0000 7fd13cf8c640 1 -- 172.21.15.142:0/3366331119 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd13400a4d0 con 0x564617abaaf0 2024-09-22T08:36:41.427 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.421+0000 7fd140b1f800 1 --2- 172.21.15.142:0/3366331119 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x564617bb73b0 0x564617bb9830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:41.427 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.421+0000 7fd140b1f800 1 -- 172.21.15.142:0/3366331119 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:3 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564617bb9fc0 con 0x564617bb73b0 2024-09-22T08:36:41.427 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.421+0000 7fd13c78b640 1 --2- 172.21.15.142:0/3366331119 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x564617bb73b0 0x564617bb9830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:41.427 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.421+0000 7fd13c78b640 1 --2- 172.21.15.142:0/3366331119 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x564617bb73b0 0x564617bb9830 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:41.427 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.421+0000 7fd13c78b640 1 -- 172.21.15.142:0/3366331119 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(3 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fd12c02d070 con 0x564617bb73b0 2024-09-22T08:36:41.427 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.421+0000 7fd140b1f800 1 -- 172.21.15.142:0/3366331119 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564617bb6100 con 0x564617abaaf0 2024-09-22T08:36:41.427 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.422+0000 7fd13cf8c640 1 -- 172.21.15.142:0/3366331119 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd13400a4d0 con 0x564617abaaf0 2024-09-22T08:36:41.428 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.422+0000 7fd140b1f800 1 -- 172.21.15.142:0/3366331119 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564617bb6550 con 0x564617bb73b0 2024-09-22T08:36:41.428 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.422+0000 7fd13c78b640 1 -- 172.21.15.142:0/3366331119 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(5 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fd12c02d070 con 0x564617bb73b0 2024-09-22T08:36:41.428 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.422+0000 7fd140b1f800 1 Processor -- start 2024-09-22T08:36:41.428 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.422+0000 7fd140b1f800 1 -- start start 2024-09-22T08:36:41.428 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.423+0000 7fd140b1f800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564617bc8970 0x564617bc8d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:41.428 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.423+0000 7fd140b1f800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5646179add50 con 0x564617bc8970 2024-09-22T08:36:41.428 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.423+0000 7fd13cf8c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564617bc8970 0x564617bc8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:41.428 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.423+0000 7fd13cf8c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564617bc8970 0x564617bc8d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:37390/0 (socket says 172.21.15.142:37390) 2024-09-22T08:36:41.428 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.423+0000 7fd13cf8c640 1 -- 172.21.15.142:0/1497819575 learned_addr learned my addr 172.21.15.142:0/1497819575 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:41.428 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.423+0000 7fd13cf8c640 1 -- 172.21.15.142:0/1497819575 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564617bc93d0 con 0x564617bc8970 2024-09-22T08:36:41.428 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.423+0000 7fd13cf8c640 1 --2- 172.21.15.142:0/1497819575 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564617bc8970 0x564617bc8d90 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x564617bae980 tx=0x7fd1340167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:41.428 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.424+0000 7fd021ffb640 1 -- 172.21.15.142:0/1497819575 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd134013640 con 0x564617bc8970 2024-09-22T08:36:41.428 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.424+0000 7fd021ffb640 1 -- 172.21.15.142:0/1497819575 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1340137e0 con 0x564617bc8970 2024-09-22T08:36:41.428 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.424+0000 7fd140b1f800 1 -- 172.21.15.142:0/1497819575 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564617bc9c00 con 0x564617bc8970 2024-09-22T08:36:41.429 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.424+0000 7fd021ffb640 1 -- 172.21.15.142:0/1497819575 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd134013ae0 con 0x564617bc8970 2024-09-22T08:36:41.429 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.424+0000 7fd140b1f800 1 -- 172.21.15.142:0/1497819575 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564617bca1a0 con 0x564617bc8970 2024-09-22T08:36:41.429 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.425+0000 7fd021ffb640 1 -- 172.21.15.142:0/1497819575 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fd134011040 con 0x564617bc8970 2024-09-22T08:36:41.429 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.425+0000 7fd021ffb640 1 --2- 172.21.15.142:0/1497819575 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fd01403d020 0x7fd01403f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:41.429 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.425+0000 7fd021ffb640 1 -- 172.21.15.142:0/1497819575 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fd13400e040 con 0x564617bc8970 2024-09-22T08:36:41.429 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.425+0000 7fd13c78b640 1 --2- 172.21.15.142:0/1497819575 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fd01403d020 0x7fd01403f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:41.436 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.425+0000 7fd140b1f800 1 Processor -- start 2024-09-22T08:36:41.437 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.425+0000 7fd13c78b640 1 --2- 172.21.15.142:0/1497819575 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fd01403d020 0x7fd01403f4e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd12c0531e0 tx=0x7fd12c0011b0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:41.437 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.425+0000 7fd140b1f800 1 -- start start 2024-09-22T08:36:41.437 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.426+0000 7fd140b1f800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564617bd5410 0x564617bd5810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:41.438 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.426+0000 7fd140b1f800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x564617ba68a0 con 0x564617bd5410 2024-09-22T08:36:41.438 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.426+0000 7fd13cf8c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564617bd5410 0x564617bd5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:41.438 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.426+0000 7fd13cf8c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564617bd5410 0x564617bd5810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:37404/0 (socket says 172.21.15.142:37404) 2024-09-22T08:36:41.438 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.426+0000 7fd13cf8c640 1 -- 172.21.15.142:0/480656029 learned_addr learned my addr 172.21.15.142:0/480656029 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:41.438 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.426+0000 7fd13cf8c640 1 -- 172.21.15.142:0/480656029 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564617bd5e00 con 0x564617bd5410 2024-09-22T08:36:41.438 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.426+0000 7fd13cf8c640 1 --2- 172.21.15.142:0/480656029 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564617bd5410 0x564617bd5810 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fd134054770 tx=0x7fd134014480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94fbe8dcf8fccb3f server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:41.438 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.426+0000 7fd01b7fe640 1 -- 172.21.15.142:0/480656029 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd134021e20 con 0x564617bd5410 2024-09-22T08:36:41.438 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.427+0000 7fd01b7fe640 1 -- 172.21.15.142:0/480656029 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd134052070 con 0x564617bd5410 2024-09-22T08:36:41.438 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.427+0000 7fd01b7fe640 1 -- 172.21.15.142:0/480656029 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd134021ad0 con 0x564617bd5410 2024-09-22T08:36:41.438 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.427+0000 7fd140b1f800 1 -- 172.21.15.142:0/480656029 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564617bd5410 msgr2=0x564617bd5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:41.438 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.427+0000 7fd140b1f800 1 --2- 172.21.15.142:0/480656029 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564617bd5410 0x564617bd5810 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fd134054770 tx=0x7fd134014480 comp rx=0 tx=0).stop 2024-09-22T08:36:41.438 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.427+0000 7fd140b1f800 1 -- 172.21.15.142:0/480656029 shutdown_connections 2024-09-22T08:36:41.439 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.427+0000 7fd140b1f800 1 --2- 172.21.15.142:0/480656029 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564617bd5410 0x564617bd5810 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:41.439 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.427+0000 7fd140b1f800 1 -- 172.21.15.142:0/480656029 >> 172.21.15.142:0/480656029 conn(0x564617bd1830 msgr2=0x564617bcfa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:41.439 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.427+0000 7fd140b1f800 1 -- 172.21.15.142:0/480656029 shutdown_connections 2024-09-22T08:36:41.439 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.427+0000 7fd140b1f800 1 -- 172.21.15.142:0/480656029 wait complete. 2024-09-22T08:36:41.439 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.427+0000 7fd140b1f800 1 Processor -- start 2024-09-22T08:36:41.439 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.427+0000 7fd140b1f800 1 -- start start 2024-09-22T08:36:41.439 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.428+0000 7fd140b1f800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564617bd5410 0x564617bdca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:41.439 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.428+0000 7fd140b1f800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x564617bd6420 con 0x564617bd5410 2024-09-22T08:36:41.439 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.428+0000 7fd13cf8c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564617bd5410 0x564617bdca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:41.439 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.428+0000 7fd13cf8c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564617bd5410 0x564617bdca30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:37406/0 (socket says 172.21.15.142:37406) 2024-09-22T08:36:41.439 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.428+0000 7fd13cf8c640 1 -- 172.21.15.142:0/266069577 learned_addr learned my addr 172.21.15.142:0/266069577 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:41.439 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.428+0000 7fd13cf8c640 1 -- 172.21.15.142:0/266069577 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564617bdcf90 con 0x564617bd5410 2024-09-22T08:36:41.439 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.428+0000 7fd13cf8c640 1 --2- 172.21.15.142:0/266069577 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564617bd5410 0x564617bdca30 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fd134054bb0 tx=0x7fd1340547a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:41.439 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.428+0000 7fd019ffb640 1 -- 172.21.15.142:0/266069577 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd134021570 con 0x564617bd5410 2024-09-22T08:36:41.440 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.428+0000 7fd019ffb640 1 -- 172.21.15.142:0/266069577 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1340459e0 con 0x564617bd5410 2024-09-22T08:36:41.440 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.428+0000 7fd140b1f800 1 -- 172.21.15.142:0/266069577 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564617bdd220 con 0x564617bd5410 2024-09-22T08:36:41.440 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.428+0000 7fd019ffb640 1 -- 172.21.15.142:0/266069577 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd134045d00 con 0x564617bd5410 2024-09-22T08:36:41.440 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.429+0000 7fd140b1f800 1 -- 172.21.15.142:0/266069577 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564617bdddb0 con 0x564617bd5410 2024-09-22T08:36:41.440 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.429+0000 7fd019ffb640 1 -- 172.21.15.142:0/266069577 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fd134054050 con 0x564617bd5410 2024-09-22T08:36:41.440 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.430+0000 7fd019ffb640 1 --2- 172.21.15.142:0/266069577 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fd00c03cfb0 0x7fd00c03f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:41.440 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.430+0000 7fd019ffb640 1 -- 172.21.15.142:0/266069577 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fd13404d070 con 0x564617bd5410 2024-09-22T08:36:41.440 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.430+0000 7fd13c78b640 1 --2- 172.21.15.142:0/266069577 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fd00c03cfb0 0x7fd00c03f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:41.440 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.430+0000 7fd140b1f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:41.440 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.430+0000 7fd140b1f800 1 --2- 172.21.15.142:0/266069577 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x564617be8380 0x564617bea840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:41.440 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.430+0000 7fd140b1f800 1 -- 172.21.15.142:0/266069577 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564617beaf90 con 0x564617be8380 2024-09-22T08:36:41.440 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.430+0000 7fd133f8a640 1 --2- 172.21.15.142:0/266069577 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x564617be8380 0x564617bea840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:41.440 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.430+0000 7fd13c78b640 1 --2- 172.21.15.142:0/266069577 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fd00c03cfb0 0x7fd00c03f470 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fd12c00efd0 tx=0x7fd12c041000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:41.440 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.430+0000 7fd133f8a640 1 --2- 172.21.15.142:0/266069577 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x564617be8380 0x564617bea840 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:41.441 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.431+0000 7fd133f8a640 1 -- 172.21.15.142:0/266069577 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd124057030 con 0x564617be8380 2024-09-22T08:36:41.441 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.431+0000 7fd140b1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:41.441 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.431+0000 7fd140b1f800 20 realm 2024-09-22T08:36:41.441 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.431+0000 7fd140b1f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:41.441 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.431+0000 7fd140b1f800 1 -- 172.21.15.142:0/266069577 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564617beb3c0 con 0x564617be8380 2024-09-22T08:36:41.441 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.431+0000 7fd133f8a640 1 -- 172.21.15.142:0/266069577 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd124057030 con 0x564617be8380 2024-09-22T08:36:41.441 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.431+0000 7fd140b1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:41.441 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.431+0000 7fd140b1f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:36:41.441 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.431+0000 7fd140b1f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:41.441 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.431+0000 7fd140b1f800 1 -- 172.21.15.142:0/266069577 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564617bebc90 con 0x564617be8380 2024-09-22T08:36:41.441 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.431+0000 7fd133f8a640 1 -- 172.21.15.142:0/266069577 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd124057030 con 0x564617be8380 2024-09-22T08:36:41.442 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.431+0000 7fd140b1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:41.442 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.431+0000 7fd140b1f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:41.442 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.431+0000 7fd140b1f800 1 -- 172.21.15.142:0/266069577 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564617bec030 con 0x564617be8380 2024-09-22T08:36:41.442 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.432+0000 7fd133f8a640 1 -- 172.21.15.142:0/266069577 <== osd.1 v2:172.21.15.142:6816/3192108003 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd124057030 con 0x564617be8380 2024-09-22T08:36:41.442 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.432+0000 7fd140b1f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:36:41.442 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.432+0000 7fd140b1f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:41.442 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.432+0000 7fd140b1f800 1 --2- 172.21.15.142:0/266069577 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x564617becd90 0x564617bef180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:41.442 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.432+0000 7fd140b1f800 1 -- 172.21.15.142:0/266069577 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564617bef6c0 con 0x564617becd90 2024-09-22T08:36:41.442 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.432+0000 7fd13cf8c640 1 --2- 172.21.15.142:0/266069577 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x564617becd90 0x564617bef180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:41.442 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.432+0000 7fd13cf8c640 1 --2- 172.21.15.142:0/266069577 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x564617becd90 0x564617bef180 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:41.442 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.432+0000 7fd13cf8c640 1 -- 172.21.15.142:0/266069577 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(5 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fd13403a070 con 0x564617becd90 2024-09-22T08:36:41.442 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.432+0000 7fd140b1f800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:36:41.443 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.432+0000 7fd140b1f800 20 searching for the correct realm 2024-09-22T08:36:41.443 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.432+0000 7fd140b1f800 1 -- 172.21.15.142:0/266069577 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564617bf1030 con 0x564617becd90 2024-09-22T08:36:41.443 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.433+0000 7fd13cf8c640 1 -- 172.21.15.142:0/266069577 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd13403a070 con 0x564617becd90 2024-09-22T08:36:41.443 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.433+0000 7fd13cf8c640 1 --2- 172.21.15.142:0/266069577 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7fd134054c20 0x7fd134022040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:41.443 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.433+0000 7fd13cf8c640 1 -- 172.21.15.142:0/266069577 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564617bf1030 con 0x7fd134054c20 2024-09-22T08:36:41.443 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.433+0000 7fd13c78b640 1 --2- 172.21.15.142:0/266069577 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7fd134054c20 0x7fd134022040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:41.443 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.433+0000 7fd13c78b640 1 --2- 172.21.15.142:0/266069577 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7fd134054c20 0x7fd134022040 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:41.443 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.433+0000 7fd13c78b640 1 -- 172.21.15.142:0/266069577 <== osd.2 v2:172.21.15.142:6808/279438927 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd12c039070 con 0x7fd134054c20 2024-09-22T08:36:41.443 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.433+0000 7fd13c78b640 1 --2- 172.21.15.142:0/266069577 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7fd12c0541f0 0x7fd12c054610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:41.443 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.433+0000 7fd13c78b640 1 -- 172.21.15.142:0/266069577 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564617bf1030 con 0x7fd12c0541f0 2024-09-22T08:36:41.444 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.434+0000 7fd133f8a640 1 --2- 172.21.15.142:0/266069577 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7fd12c0541f0 0x7fd12c054610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:41.444 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.434+0000 7fd133f8a640 1 --2- 172.21.15.142:0/266069577 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7fd12c0541f0 0x7fd12c054610 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:41.454 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.434+0000 7fd133f8a640 1 -- 172.21.15.142:0/266069577 <== osd.0 v2:172.21.15.31:6800/168281188 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd124057030 con 0x7fd12c0541f0 2024-09-22T08:36:41.454 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.434+0000 7fd133f8a640 1 -- 172.21.15.142:0/266069577 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564617bf1030 con 0x564617be8380 2024-09-22T08:36:41.454 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.435+0000 7fd133f8a640 1 -- 172.21.15.142:0/266069577 <== osd.1 v2:172.21.15.142:6816/3192108003 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd124057030 con 0x564617be8380 2024-09-22T08:36:41.454 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.435+0000 7fd133f8a640 1 -- 172.21.15.142:0/266069577 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564617bf1030 con 0x564617be8380 2024-09-22T08:36:41.455 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.435+0000 7fd133f8a640 1 -- 172.21.15.142:0/266069577 <== osd.1 v2:172.21.15.142:6816/3192108003 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd124057030 con 0x564617be8380 2024-09-22T08:36:41.455 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.435+0000 7fd133f8a640 1 -- 172.21.15.142:0/266069577 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564617bf1030 con 0x7fd12c0541f0 2024-09-22T08:36:41.455 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.435+0000 7fd133f8a640 1 -- 172.21.15.142:0/266069577 <== osd.0 v2:172.21.15.31:6800/168281188 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd124057030 con 0x7fd12c0541f0 2024-09-22T08:36:41.455 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.435+0000 7fd133f8a640 1 -- 172.21.15.142:0/266069577 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564617bf1030 con 0x7fd12c0541f0 2024-09-22T08:36:41.455 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.436+0000 7fd133f8a640 1 -- 172.21.15.142:0/266069577 <== osd.0 v2:172.21.15.31:6800/168281188 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd124057030 con 0x7fd12c0541f0 2024-09-22T08:36:41.455 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.436+0000 7fd133f8a640 1 -- 172.21.15.142:0/266069577 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564617bf1030 con 0x7fd134054c20 2024-09-22T08:36:41.455 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.436+0000 7fd13c78b640 1 -- 172.21.15.142:0/266069577 <== osd.2 v2:172.21.15.142:6808/279438927 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd12c039070 con 0x7fd134054c20 2024-09-22T08:36:41.455 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.436+0000 7fd13c78b640 1 -- 172.21.15.142:0/266069577 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564617bf1030 con 0x564617becd90 2024-09-22T08:36:41.455 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.436+0000 7fd13cf8c640 1 -- 172.21.15.142:0/266069577 <== osd.3 v2:172.21.15.142:6800/1064901393 3 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd13403a070 con 0x564617becd90 2024-09-22T08:36:41.455 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.436+0000 7fd13cf8c640 1 -- 172.21.15.142:0/266069577 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564617bf1030 con 0x564617be8380 2024-09-22T08:36:41.455 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.436+0000 7fd133f8a640 1 -- 172.21.15.142:0/266069577 <== osd.1 v2:172.21.15.142:6816/3192108003 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd124057030 con 0x564617be8380 2024-09-22T08:36:41.455 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.436+0000 7fd133f8a640 1 -- 172.21.15.142:0/266069577 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564617bf1030 con 0x7fd12c0541f0 2024-09-22T08:36:41.456 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.437+0000 7fd133f8a640 1 -- 172.21.15.142:0/266069577 <== osd.0 v2:172.21.15.31:6800/168281188 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd124057030 con 0x7fd12c0541f0 2024-09-22T08:36:41.456 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.437+0000 7fd133f8a640 1 -- 172.21.15.142:0/266069577 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564617bf1030 con 0x564617be8380 2024-09-22T08:36:41.456 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.437+0000 7fd133f8a640 1 -- 172.21.15.142:0/266069577 <== osd.1 v2:172.21.15.142:6816/3192108003 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd124057030 con 0x564617be8380 2024-09-22T08:36:41.456 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.437+0000 7fd133f8a640 1 -- 172.21.15.142:0/266069577 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564617bf1030 con 0x7fd134054c20 2024-09-22T08:36:41.456 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.437+0000 7fd13c78b640 1 -- 172.21.15.142:0/266069577 <== osd.2 v2:172.21.15.142:6808/279438927 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fd12c039070 con 0x7fd134054c20 2024-09-22T08:36:41.456 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.437+0000 7fd13c78b640 1 -- 172.21.15.142:0/266069577 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564617bf1030 con 0x564617becd90 2024-09-22T08:36:41.456 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.438+0000 7fd13cf8c640 1 -- 172.21.15.142:0/266069577 <== osd.3 v2:172.21.15.142:6800/1064901393 4 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd13403a070 con 0x564617becd90 2024-09-22T08:36:41.456 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.438+0000 7fd13cf8c640 1 -- 172.21.15.142:0/266069577 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564617bf1030 con 0x564617becd90 2024-09-22T08:36:41.456 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.438+0000 7fd13cf8c640 1 -- 172.21.15.142:0/266069577 <== osd.3 v2:172.21.15.142:6800/1064901393 5 ==== osd_op_reply(20 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fd13403a070 con 0x564617becd90 2024-09-22T08:36:41.456 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.438+0000 7fd13cf8c640 1 -- 172.21.15.142:0/266069577 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564617bf1030 con 0x7fd12c0541f0 2024-09-22T08:36:41.456 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.438+0000 7fd133f8a640 1 -- 172.21.15.142:0/266069577 <== osd.0 v2:172.21.15.31:6800/168281188 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd124057030 con 0x7fd12c0541f0 2024-09-22T08:36:41.457 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.438+0000 7fd133f8a640 1 -- 172.21.15.142:0/266069577 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564617bf1030 con 0x564617becd90 2024-09-22T08:36:41.457 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.438+0000 7fd13cf8c640 1 -- 172.21.15.142:0/266069577 <== osd.3 v2:172.21.15.142:6800/1064901393 6 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd13403a070 con 0x564617becd90 2024-09-22T08:36:41.457 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.438+0000 7fd13cf8c640 1 -- 172.21.15.142:0/266069577 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564617bf1030 con 0x564617becd90 2024-09-22T08:36:41.457 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.439+0000 7fd13cf8c640 1 -- 172.21.15.142:0/266069577 <== osd.3 v2:172.21.15.142:6800/1064901393 7 ==== osd_op_reply(23 [pgnls start_epoch 30 out=107b] v23'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fd13403a070 con 0x564617becd90 2024-09-22T08:36:41.457 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.439+0000 7fd13cf8c640 1 -- 172.21.15.142:0/266069577 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564617bf1030 con 0x564617be8380 2024-09-22T08:36:41.457 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.439+0000 7fd133f8a640 1 -- 172.21.15.142:0/266069577 <== osd.1 v2:172.21.15.142:6816/3192108003 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd124057030 con 0x564617be8380 2024-09-22T08:36:41.457 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.439+0000 7fd133f8a640 1 -- 172.21.15.142:0/266069577 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564617bf1030 con 0x564617be8380 2024-09-22T08:36:41.457 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.439+0000 7fd133f8a640 1 -- 172.21.15.142:0/266069577 <== osd.1 v2:172.21.15.142:6816/3192108003 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fd124057030 con 0x564617be8380 2024-09-22T08:36:41.458 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.439+0000 7fd133f8a640 1 -- 172.21.15.142:0/266069577 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564617bf1030 con 0x7fd12c0541f0 2024-09-22T08:36:41.458 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.439+0000 7fd133f8a640 1 -- 172.21.15.142:0/266069577 <== osd.0 v2:172.21.15.31:6800/168281188 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd124057030 con 0x7fd12c0541f0 2024-09-22T08:36:41.458 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.439+0000 7fd133f8a640 1 -- 172.21.15.142:0/266069577 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564617bf1030 con 0x564617becd90 2024-09-22T08:36:41.458 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.440+0000 7fd13cf8c640 1 -- 172.21.15.142:0/266069577 <== osd.3 v2:172.21.15.142:6800/1064901393 8 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd13403a070 con 0x564617becd90 2024-09-22T08:36:41.458 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.440+0000 7fd13cf8c640 1 -- 172.21.15.142:0/266069577 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564617bf1030 con 0x7fd134054c20 2024-09-22T08:36:41.458 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.440+0000 7fd13c78b640 1 -- 172.21.15.142:0/266069577 <== osd.2 v2:172.21.15.142:6808/279438927 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd12c039070 con 0x7fd134054c20 2024-09-22T08:36:41.458 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.440+0000 7fd13c78b640 1 -- 172.21.15.142:0/266069577 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564617bf1030 con 0x564617be8380 2024-09-22T08:36:41.458 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.440+0000 7fd133f8a640 1 -- 172.21.15.142:0/266069577 <== osd.1 v2:172.21.15.142:6816/3192108003 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd124057030 con 0x564617be8380 2024-09-22T08:36:41.458 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.440+0000 7fd133f8a640 1 -- 172.21.15.142:0/266069577 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564617bf1030 con 0x7fd12c0541f0 2024-09-22T08:36:41.458 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.440+0000 7fd133f8a640 1 -- 172.21.15.142:0/266069577 <== osd.0 v2:172.21.15.31:6800/168281188 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd124057030 con 0x7fd12c0541f0 2024-09-22T08:36:41.458 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.440+0000 7fd133f8a640 1 -- 172.21.15.142:0/266069577 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564617bf1030 con 0x564617becd90 2024-09-22T08:36:41.458 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.441+0000 7fd13cf8c640 1 -- 172.21.15.142:0/266069577 <== osd.3 v2:172.21.15.142:6800/1064901393 9 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd13403a070 con 0x564617becd90 2024-09-22T08:36:41.459 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.441+0000 7fd13cf8c640 1 -- 172.21.15.142:0/266069577 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564617bf1030 con 0x7fd12c0541f0 2024-09-22T08:36:41.459 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.441+0000 7fd133f8a640 1 -- 172.21.15.142:0/266069577 <== osd.0 v2:172.21.15.31:6800/168281188 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd124057030 con 0x7fd12c0541f0 2024-09-22T08:36:41.459 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.441+0000 7fd133f8a640 1 -- 172.21.15.142:0/266069577 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564617bf1030 con 0x7fd134054c20 2024-09-22T08:36:41.459 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.441+0000 7fd13c78b640 1 -- 172.21.15.142:0/266069577 <== osd.2 v2:172.21.15.142:6808/279438927 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd12c039070 con 0x7fd134054c20 2024-09-22T08:36:41.459 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.441+0000 7fd13c78b640 1 -- 172.21.15.142:0/266069577 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564617bf1030 con 0x564617becd90 2024-09-22T08:36:41.459 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.441+0000 7fd13cf8c640 1 -- 172.21.15.142:0/266069577 <== osd.3 v2:172.21.15.142:6800/1064901393 10 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd13403a070 con 0x564617becd90 2024-09-22T08:36:41.459 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.441+0000 7fd13cf8c640 1 -- 172.21.15.142:0/266069577 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564617bf1030 con 0x7fd12c0541f0 2024-09-22T08:36:41.459 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.442+0000 7fd133f8a640 1 -- 172.21.15.142:0/266069577 <== osd.0 v2:172.21.15.31:6800/168281188 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd124057030 con 0x7fd12c0541f0 2024-09-22T08:36:41.459 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.442+0000 7fd133f8a640 1 -- 172.21.15.142:0/266069577 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564617bf1030 con 0x564617be8380 2024-09-22T08:36:41.459 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.442+0000 7fd133f8a640 1 -- 172.21.15.142:0/266069577 <== osd.1 v2:172.21.15.142:6816/3192108003 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fd124057030 con 0x564617be8380 2024-09-22T08:36:41.459 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.442+0000 7fd133f8a640 1 -- 172.21.15.142:0/266069577 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564617bf1030 con 0x7fd134054c20 2024-09-22T08:36:41.459 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.442+0000 7fd13c78b640 1 -- 172.21.15.142:0/266069577 <== osd.2 v2:172.21.15.142:6808/279438927 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd12c039070 con 0x7fd134054c20 2024-09-22T08:36:41.459 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.442+0000 7fd140b1f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:36:41.459 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.442+0000 7fd140b1f800 20 RGWRados::pool_iterate: got zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec 2024-09-22T08:36:41.460 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.442+0000 7fd140b1f800 20 RGWRados::pool_iterate: got zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f 2024-09-22T08:36:41.460 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.442+0000 7fd140b1f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:36:41.460 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.442+0000 7fd140b1f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:36:41.460 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.442+0000 7fd140b1f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:36:41.460 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.442+0000 7fd140b1f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:41.460 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.442+0000 7fd140b1f800 1 -- 172.21.15.142:0/266069577 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564617bf0100 con 0x564617be8380 2024-09-22T08:36:41.460 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.443+0000 7fd133f8a640 1 -- 172.21.15.142:0/266069577 <== osd.1 v2:172.21.15.142:6816/3192108003 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd124057030 con 0x564617be8380 2024-09-22T08:36:41.460 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.443+0000 7fd140b1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:41.460 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.443+0000 7fd140b1f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:41.460 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.443+0000 7fd140b1f800 1 -- 172.21.15.142:0/266069577 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564617bf09a0 con 0x564617be8380 2024-09-22T08:36:41.460 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.443+0000 7fd133f8a640 1 -- 172.21.15.142:0/266069577 <== osd.1 v2:172.21.15.142:6816/3192108003 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd124057030 con 0x564617be8380 2024-09-22T08:36:41.460 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.443+0000 7fd140b1f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:36:41.460 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.443+0000 7fd140b1f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:41.460 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.443+0000 7fd140b1f800 1 -- 172.21.15.142:0/266069577 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:40 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564617befd40 con 0x564617becd90 2024-09-22T08:36:41.461 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.443+0000 7fd13cf8c640 1 -- 172.21.15.142:0/266069577 <== osd.3 v2:172.21.15.142:6800/1064901393 11 ==== osd_op_reply(40 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fd13403a070 con 0x564617becd90 2024-09-22T08:36:41.461 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.443+0000 7fd140b1f800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:36:41.461 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.443+0000 7fd140b1f800 20 zone default found 2024-09-22T08:36:41.461 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.443+0000 7fd140b1f800 4 Realm: () 2024-09-22T08:36:41.461 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.443+0000 7fd140b1f800 4 ZoneGroup: default (d89f6f57-1007-47dd-9065-f486c7b01aec) 2024-09-22T08:36:41.461 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.443+0000 7fd140b1f800 4 Zone: default (e239248c-0bee-4e41-803a-24b288d3eb8f) 2024-09-22T08:36:41.461 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.443+0000 7fd140b1f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:36:41.461 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.443+0000 7fd140b1f800 20 zonegroup default 2024-09-22T08:36:41.461 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.443+0000 7fd140b1f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:41.461 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.443+0000 7fd140b1f800 1 -- 172.21.15.142:0/266069577 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564617bf05e0 con 0x7fd12c0541f0 2024-09-22T08:36:41.461 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.444+0000 7fd133f8a640 1 -- 172.21.15.142:0/266069577 <== osd.0 v2:172.21.15.31:6800/168281188 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fd124057030 con 0x7fd12c0541f0 2024-09-22T08:36:41.461 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.444+0000 7fd140b1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:41.461 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.444+0000 7fd140b1f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:41.462 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.444+0000 7fd140b1f800 1 -- 172.21.15.142:0/266069577 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564617bf38d0 con 0x564617becd90 2024-09-22T08:36:41.462 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.444+0000 7fd13cf8c640 1 -- 172.21.15.142:0/266069577 <== osd.3 v2:172.21.15.142:6800/1064901393 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd13403a070 con 0x564617becd90 2024-09-22T08:36:41.462 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.444+0000 7fd140b1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:41.462 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.444+0000 7fd140b1f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:41.462 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.444+0000 7fd140b1f800 1 -- 172.21.15.142:0/266069577 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564617bf3ca0 con 0x564617becd90 2024-09-22T08:36:41.462 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.444+0000 7fd13cf8c640 1 -- 172.21.15.142:0/266069577 <== osd.3 v2:172.21.15.142:6800/1064901393 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd13403a070 con 0x564617becd90 2024-09-22T08:36:41.462 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.444+0000 7fd140b1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:41.462 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.444+0000 7fd140b1f800 20 started sync module instance, tier type = 2024-09-22T08:36:41.462 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.444+0000 7fd140b1f800 20 started zone id=e239248c-0bee-4e41-803a-24b288d3eb8f (name=default) with tier type = 2024-09-22T08:36:41.462 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.444+0000 7fd140b1f800 1 -- 172.21.15.142:0/266069577 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564617bf2d60 con 0x7fd134054c20 2024-09-22T08:36:41.462 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.445+0000 7fd13c78b640 1 -- 172.21.15.142:0/266069577 <== osd.2 v2:172.21.15.142:6808/279438927 7 ==== osd_op_reply(44 notify.0 [create] v30'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd12c039070 con 0x7fd134054c20 2024-09-22T08:36:41.462 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.445+0000 7fd140b1f800 1 -- 172.21.15.142:0/266069577 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94859046105424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564617bf29c0 con 0x7fd134054c20 2024-09-22T08:36:41.462 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.445+0000 7fd140b1f800 1 -- 172.21.15.142:0/266069577 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564617bf4bd0 con 0x564617be8380 2024-09-22T08:36:41.463 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.447+0000 7fd13c78b640 1 -- 172.21.15.142:0/266069577 <== osd.2 v2:172.21.15.142:6808/279438927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94859046105424] v30'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd12c039070 con 0x7fd134054c20 2024-09-22T08:36:41.463 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.447+0000 7fd133f8a640 1 -- 172.21.15.142:0/266069577 <== osd.1 v2:172.21.15.142:6816/3192108003 15 ==== osd_op_reply(46 notify.1 [create] v30'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd124057030 con 0x564617be8380 2024-09-22T08:36:41.463 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.447+0000 7fd140b1f800 1 -- 172.21.15.142:0/266069577 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94859046111008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564617bf4ff0 con 0x564617be8380 2024-09-22T08:36:41.463 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.447+0000 7fd140b1f800 1 -- 172.21.15.142:0/266069577 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564617bf59b0 con 0x564617becd90 2024-09-22T08:36:41.463 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.448+0000 7fd133f8a640 1 -- 172.21.15.142:0/266069577 <== osd.1 v2:172.21.15.142:6816/3192108003 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94859046111008] v30'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd124057030 con 0x564617be8380 2024-09-22T08:36:41.463 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.449+0000 7fd13cf8c640 1 -- 172.21.15.142:0/266069577 <== osd.3 v2:172.21.15.142:6800/1064901393 14 ==== osd_op_reply(48 notify.2 [create] v30'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd13403a070 con 0x564617becd90 2024-09-22T08:36:41.463 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.449+0000 7fd140b1f800 1 -- 172.21.15.142:0/266069577 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94859046115040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564617bf4ff0 con 0x564617becd90 2024-09-22T08:36:41.463 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.449+0000 7fd140b1f800 1 -- 172.21.15.142:0/266069577 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564617bf6450 con 0x7fd134054c20 2024-09-22T08:36:41.463 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.450+0000 7fd13c78b640 1 -- 172.21.15.142:0/266069577 <== osd.2 v2:172.21.15.142:6808/279438927 9 ==== osd_op_reply(50 notify.3 [create] v30'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd12c039070 con 0x7fd134054c20 2024-09-22T08:36:41.463 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.450+0000 7fd13cf8c640 1 -- 172.21.15.142:0/266069577 <== osd.3 v2:172.21.15.142:6800/1064901393 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94859046115040] v30'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd13403a070 con 0x564617becd90 2024-09-22T08:36:41.463 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.450+0000 7fd140b1f800 1 -- 172.21.15.142:0/266069577 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94859046117184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564617bf6cf0 con 0x7fd134054c20 2024-09-22T08:36:41.463 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.450+0000 7fd140b1f800 1 -- 172.21.15.142:0/266069577 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564617bf4b60 con 0x564617be8380 2024-09-22T08:36:41.464 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.452+0000 7fd133f8a640 1 -- 172.21.15.142:0/266069577 <== osd.1 v2:172.21.15.142:6816/3192108003 17 ==== osd_op_reply(52 notify.4 [create] v30'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd124057030 con 0x564617be8380 2024-09-22T08:36:41.464 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.452+0000 7fd140b1f800 1 -- 172.21.15.142:0/266069577 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94859046122208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564617bf7bb0 con 0x564617be8380 2024-09-22T08:36:41.464 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.452+0000 7fd140b1f800 1 -- 172.21.15.142:0/266069577 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564617bf85d0 con 0x7fd12c0541f0 2024-09-22T08:36:41.464 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.452+0000 7fd13c78b640 1 -- 172.21.15.142:0/266069577 <== osd.2 v2:172.21.15.142:6808/279438927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94859046117184] v30'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd12c039070 con 0x7fd134054c20 2024-09-22T08:36:41.465 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.453+0000 7fd133f8a640 1 -- 172.21.15.142:0/266069577 <== osd.0 v2:172.21.15.31:6800/168281188 11 ==== osd_op_reply(54 notify.5 [create] v30'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd124057030 con 0x7fd12c0541f0 2024-09-22T08:36:41.465 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.453+0000 7fd140b1f800 1 -- 172.21.15.142:0/266069577 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94859046125760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564617bf8590 con 0x7fd12c0541f0 2024-09-22T08:36:41.465 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.453+0000 7fd140b1f800 1 -- 172.21.15.142:0/266069577 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564617bf9050 con 0x7fd12c0541f0 2024-09-22T08:36:41.465 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.455+0000 7fd133f8a640 1 -- 172.21.15.142:0/266069577 <== osd.1 v2:172.21.15.142:6816/3192108003 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94859046122208] v30'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd124057030 con 0x564617be8380 2024-09-22T08:36:41.465 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.458+0000 7fd133f8a640 1 -- 172.21.15.142:0/266069577 <== osd.0 v2:172.21.15.31:6800/168281188 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94859046125760] v30'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd124057030 con 0x7fd12c0541f0 2024-09-22T08:36:41.466 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.458+0000 7fd133f8a640 1 -- 172.21.15.142:0/266069577 <== osd.0 v2:172.21.15.31:6800/168281188 13 ==== osd_op_reply(56 notify.6 [create] v30'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd124057030 con 0x7fd12c0541f0 2024-09-22T08:36:41.466 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.458+0000 7fd140b1f800 1 -- 172.21.15.142:0/266069577 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94859046119488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564617bf8b60 con 0x7fd12c0541f0 2024-09-22T08:36:41.466 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.458+0000 7fd140b1f800 1 -- 172.21.15.142:0/266069577 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564617bf9520 con 0x7fd12c0541f0 2024-09-22T08:36:41.466 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.460+0000 7fd133f8a640 1 -- 172.21.15.142:0/266069577 <== osd.0 v2:172.21.15.31:6800/168281188 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94859046119488] v30'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd124057030 con 0x7fd12c0541f0 2024-09-22T08:36:41.466 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.462+0000 7fd133f8a640 1 -- 172.21.15.142:0/266069577 <== osd.0 v2:172.21.15.31:6800/168281188 15 ==== osd_op_reply(58 notify.7 [create] v30'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd124057030 con 0x7fd12c0541f0 2024-09-22T08:36:41.466 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.462+0000 7fd140b1f800 1 -- 172.21.15.142:0/266069577 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94859046123264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564617bf9520 con 0x7fd12c0541f0 2024-09-22T08:36:41.466 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.462+0000 7fd140b1f800 20 add_watcher() i=0 2024-09-22T08:36:41.466 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.462+0000 7fd140b1f800 20 add_watcher() i=1 2024-09-22T08:36:41.466 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.462+0000 7fd140b1f800 20 add_watcher() i=2 2024-09-22T08:36:41.466 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.462+0000 7fd140b1f800 20 add_watcher() i=3 2024-09-22T08:36:41.466 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.462+0000 7fd140b1f800 20 add_watcher() i=4 2024-09-22T08:36:41.466 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.462+0000 7fd140b1f800 20 add_watcher() i=5 2024-09-22T08:36:41.467 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.462+0000 7fd140b1f800 20 add_watcher() i=6 2024-09-22T08:36:41.468 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.464+0000 7fd133f8a640 1 -- 172.21.15.142:0/266069577 <== osd.0 v2:172.21.15.31:6800/168281188 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94859046123264] v30'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd124057030 con 0x7fd12c0541f0 2024-09-22T08:36:41.468 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.464+0000 7fd140b1f800 20 add_watcher() i=7 2024-09-22T08:36:41.468 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.464+0000 7fd140b1f800 2 all 8 watchers are set, enabling cache 2024-09-22T08:36:41.468 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.464+0000 7fd140b1f800 1 -- 172.21.15.142:0/266069577 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564617bfc9c0 con 0x564617be8380 2024-09-22T08:36:41.468 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.464+0000 7fd133f8a640 1 -- 172.21.15.142:0/266069577 <== osd.1 v2:172.21.15.142:6816/3192108003 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fd124057030 con 0x564617be8380 2024-09-22T08:36:41.469 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.464+0000 7fd140b1f800 1 -- 172.21.15.142:0/266069577 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94859046142832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564617bf9690 con 0x564617be8380 2024-09-22T08:36:41.469 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.465+0000 7fd133f8a640 1 -- 172.21.15.142:0/266069577 <== osd.1 v2:172.21.15.142:6816/3192108003 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94859046142832] v30'24 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd12407f040 con 0x564617be8380 2024-09-22T08:36:41.469 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.465+0000 7fcff27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:36:41.469 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.465+0000 7fd140b1f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:36:41.469 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.465+0000 7fd140b1f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:36:41.469 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.465+0000 7fd140b1f800 5 note: GC not initialized 2024-09-22T08:36:41.469 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.466+0000 7fcff17e2640 20 reqs_thread_entry: start 2024-09-22T08:36:41.469 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.466+0000 7fd140b1f800 20 init_complete bucket index max shards: 11 2024-09-22T08:36:41.469 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.466+0000 7fd140b1f800 20 Filter name: none 2024-09-22T08:36:41.469 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.466+0000 7fcf62ffd640 20 reqs_thread_entry: start 2024-09-22T08:36:41.469 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.466+0000 7fd140b1f800 1 -- 172.21.15.142:0/266069577 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:62 8.0 8:00000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564617c2f4b0 con 0x564617becd90 2024-09-22T08:36:41.475 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.466+0000 7fd13cf8c640 1 -- 172.21.15.142:0/266069577 <== osd.3 v2:172.21.15.142:6800/1064901393 16 ==== osd_op_reply(62 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd13403a070 con 0x564617becd90 2024-09-22T08:36:41.475 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.466+0000 7fd13cf8c640 1 -- 172.21.15.142:0/266069577 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:63 8.10 8:08000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564617bf3ca0 con 0x564617becd90 2024-09-22T08:36:41.475 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.467+0000 7fd13cf8c640 1 -- 172.21.15.142:0/266069577 <== osd.3 v2:172.21.15.142:6800/1064901393 17 ==== osd_op_reply(63 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd13403a070 con 0x564617becd90 2024-09-22T08:36:41.475 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.467+0000 7fd13cf8c640 1 -- 172.21.15.142:0/266069577 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:64 8.8 8:10000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564617bf3ca0 con 0x564617be8380 2024-09-22T08:36:41.475 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.467+0000 7fd133f8a640 1 -- 172.21.15.142:0/266069577 <== osd.1 v2:172.21.15.142:6816/3192108003 21 ==== osd_op_reply(64 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd12407f040 con 0x564617be8380 2024-09-22T08:36:41.475 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.467+0000 7fd133f8a640 1 -- 172.21.15.142:0/266069577 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:65 8.18 8:18000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564617bf05e0 con 0x564617be8380 2024-09-22T08:36:41.475 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.467+0000 7fd133f8a640 1 -- 172.21.15.142:0/266069577 <== osd.1 v2:172.21.15.142:6816/3192108003 22 ==== osd_op_reply(65 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd12407f040 con 0x564617be8380 2024-09-22T08:36:41.476 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.467+0000 7fd133f8a640 1 -- 172.21.15.142:0/266069577 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:66 8.4 8:20000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564617bf05e0 con 0x7fd134054c20 2024-09-22T08:36:41.476 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.467+0000 7fd13c78b640 1 -- 172.21.15.142:0/266069577 <== osd.2 v2:172.21.15.142:6808/279438927 11 ==== osd_op_reply(66 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd12c039070 con 0x7fd134054c20 2024-09-22T08:36:41.476 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.467+0000 7fd13c78b640 1 -- 172.21.15.142:0/266069577 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:67 8.14 8:28000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564617bf6cf0 con 0x564617becd90 2024-09-22T08:36:41.476 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.468+0000 7fd13cf8c640 1 -- 172.21.15.142:0/266069577 <== osd.3 v2:172.21.15.142:6800/1064901393 18 ==== osd_op_reply(67 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd13403a070 con 0x564617becd90 2024-09-22T08:36:41.476 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.468+0000 7fd13cf8c640 1 -- 172.21.15.142:0/266069577 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:68 8.c 8:30000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564617bf6cf0 con 0x564617be8380 2024-09-22T08:36:41.476 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.468+0000 7fd133f8a640 1 -- 172.21.15.142:0/266069577 <== osd.1 v2:172.21.15.142:6816/3192108003 23 ==== osd_op_reply(68 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd12407f040 con 0x564617be8380 2024-09-22T08:36:41.476 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.468+0000 7fd133f8a640 1 -- 172.21.15.142:0/266069577 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:69 8.1c 8:38000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564617bf6cf0 con 0x564617becd90 2024-09-22T08:36:41.476 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.468+0000 7fd13cf8c640 1 -- 172.21.15.142:0/266069577 <== osd.3 v2:172.21.15.142:6800/1064901393 19 ==== osd_op_reply(69 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd13403a070 con 0x564617becd90 2024-09-22T08:36:41.476 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.468+0000 7fd13cf8c640 1 -- 172.21.15.142:0/266069577 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:70 8.2 8:40000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564617bf6cf0 con 0x7fd134054c20 2024-09-22T08:36:41.477 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.468+0000 7fd13c78b640 1 -- 172.21.15.142:0/266069577 <== osd.2 v2:172.21.15.142:6808/279438927 12 ==== osd_op_reply(70 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd12c039070 con 0x7fd134054c20 2024-09-22T08:36:41.477 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.468+0000 7fd13c78b640 1 -- 172.21.15.142:0/266069577 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:71 8.12 8:48000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564617bf6cf0 con 0x564617becd90 2024-09-22T08:36:41.477 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.469+0000 7fd13cf8c640 1 -- 172.21.15.142:0/266069577 <== osd.3 v2:172.21.15.142:6800/1064901393 20 ==== osd_op_reply(71 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd13403a070 con 0x564617becd90 2024-09-22T08:36:41.477 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.469+0000 7fd13cf8c640 1 -- 172.21.15.142:0/266069577 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:72 8.a 8:50000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564617bf6cf0 con 0x564617be8380 2024-09-22T08:36:41.477 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.469+0000 7fd133f8a640 1 -- 172.21.15.142:0/266069577 <== osd.1 v2:172.21.15.142:6816/3192108003 24 ==== osd_op_reply(72 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd12407f040 con 0x564617be8380 2024-09-22T08:36:41.477 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.469+0000 7fd133f8a640 1 -- 172.21.15.142:0/266069577 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:73 8.1a 8:58000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564617bf6cf0 con 0x7fd12c0541f0 2024-09-22T08:36:41.477 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.469+0000 7fd133f8a640 1 -- 172.21.15.142:0/266069577 <== osd.0 v2:172.21.15.31:6800/168281188 17 ==== osd_op_reply(73 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd12407f040 con 0x7fd12c0541f0 2024-09-22T08:36:41.477 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.469+0000 7fd133f8a640 1 -- 172.21.15.142:0/266069577 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:74 8.6 8:60000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564617bf6cf0 con 0x7fd12c0541f0 2024-09-22T08:36:41.477 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.469+0000 7fd133f8a640 1 -- 172.21.15.142:0/266069577 <== osd.0 v2:172.21.15.31:6800/168281188 18 ==== osd_op_reply(74 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd12407f040 con 0x7fd12c0541f0 2024-09-22T08:36:41.477 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.469+0000 7fd133f8a640 1 -- 172.21.15.142:0/266069577 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:75 8.16 8:68000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564617bf6cf0 con 0x564617becd90 2024-09-22T08:36:41.477 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.470+0000 7fd13cf8c640 1 -- 172.21.15.142:0/266069577 <== osd.3 v2:172.21.15.142:6800/1064901393 21 ==== osd_op_reply(75 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd13403a070 con 0x564617becd90 2024-09-22T08:36:41.477 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.470+0000 7fd13cf8c640 1 -- 172.21.15.142:0/266069577 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:76 8.e 8:70000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564617bf6cf0 con 0x7fd12c0541f0 2024-09-22T08:36:41.477 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.470+0000 7fd133f8a640 1 -- 172.21.15.142:0/266069577 <== osd.0 v2:172.21.15.31:6800/168281188 19 ==== osd_op_reply(76 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd12407f040 con 0x7fd12c0541f0 2024-09-22T08:36:41.478 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.470+0000 7fd133f8a640 1 -- 172.21.15.142:0/266069577 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:77 8.1e 8:78000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564617bf6cf0 con 0x7fd12c0541f0 2024-09-22T08:36:41.478 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.470+0000 7fd133f8a640 1 -- 172.21.15.142:0/266069577 <== osd.0 v2:172.21.15.31:6800/168281188 20 ==== osd_op_reply(77 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd12407f040 con 0x7fd12c0541f0 2024-09-22T08:36:41.478 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.470+0000 7fd133f8a640 1 -- 172.21.15.142:0/266069577 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:78 8.1 8:80000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564617bf6cf0 con 0x7fd12c0541f0 2024-09-22T08:36:41.478 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.470+0000 7fd133f8a640 1 -- 172.21.15.142:0/266069577 <== osd.0 v2:172.21.15.31:6800/168281188 21 ==== osd_op_reply(78 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd12407f040 con 0x7fd12c0541f0 2024-09-22T08:36:41.478 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.470+0000 7fd133f8a640 1 -- 172.21.15.142:0/266069577 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:79 8.11 8:88000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564617bf6cf0 con 0x564617becd90 2024-09-22T08:36:41.478 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.471+0000 7fd13cf8c640 1 -- 172.21.15.142:0/266069577 <== osd.3 v2:172.21.15.142:6800/1064901393 22 ==== osd_op_reply(79 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd13403a070 con 0x564617becd90 2024-09-22T08:36:41.478 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.471+0000 7fd13cf8c640 1 -- 172.21.15.142:0/266069577 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:80 8.9 8:90000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564617bf6cf0 con 0x7fd134054c20 2024-09-22T08:36:41.478 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.471+0000 7fd13c78b640 1 -- 172.21.15.142:0/266069577 <== osd.2 v2:172.21.15.142:6808/279438927 13 ==== osd_op_reply(80 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd12c039070 con 0x7fd134054c20 2024-09-22T08:36:41.478 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.471+0000 7fd13c78b640 1 -- 172.21.15.142:0/266069577 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:81 8.19 8:98000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564617bf6cf0 con 0x564617be8380 2024-09-22T08:36:41.478 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.471+0000 7fd133f8a640 1 -- 172.21.15.142:0/266069577 <== osd.1 v2:172.21.15.142:6816/3192108003 25 ==== osd_op_reply(81 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd12407f040 con 0x564617be8380 2024-09-22T08:36:41.478 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.471+0000 7fd133f8a640 1 -- 172.21.15.142:0/266069577 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:82 8.5 8:a0000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564617bf6cf0 con 0x564617be8380 2024-09-22T08:36:41.478 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.471+0000 7fd133f8a640 1 -- 172.21.15.142:0/266069577 <== osd.1 v2:172.21.15.142:6816/3192108003 26 ==== osd_op_reply(82 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd12407f040 con 0x564617be8380 2024-09-22T08:36:41.478 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.471+0000 7fd133f8a640 1 -- 172.21.15.142:0/266069577 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:83 8.15 8:a8000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564617bf6cf0 con 0x564617becd90 2024-09-22T08:36:41.478 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.472+0000 7fd13cf8c640 1 -- 172.21.15.142:0/266069577 <== osd.3 v2:172.21.15.142:6800/1064901393 23 ==== osd_op_reply(83 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd13403a070 con 0x564617becd90 2024-09-22T08:36:41.479 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.472+0000 7fd13cf8c640 1 -- 172.21.15.142:0/266069577 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:84 8.d 8:b0000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564617bf6cf0 con 0x7fd134054c20 2024-09-22T08:36:41.479 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.472+0000 7fd13c78b640 1 -- 172.21.15.142:0/266069577 <== osd.2 v2:172.21.15.142:6808/279438927 14 ==== osd_op_reply(84 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd12c039070 con 0x7fd134054c20 2024-09-22T08:36:41.479 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.472+0000 7fd13c78b640 1 -- 172.21.15.142:0/266069577 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:85 8.1d 8:b8000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564617bf6cf0 con 0x7fd12c0541f0 2024-09-22T08:36:41.479 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.472+0000 7fd133f8a640 1 -- 172.21.15.142:0/266069577 <== osd.0 v2:172.21.15.31:6800/168281188 22 ==== osd_op_reply(85 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd12407f040 con 0x7fd12c0541f0 2024-09-22T08:36:41.479 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.472+0000 7fd133f8a640 1 -- 172.21.15.142:0/266069577 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:86 8.3 8:c0000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564617bf6cf0 con 0x564617be8380 2024-09-22T08:36:41.479 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.473+0000 7fd133f8a640 1 -- 172.21.15.142:0/266069577 <== osd.1 v2:172.21.15.142:6816/3192108003 27 ==== osd_op_reply(86 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd12407f040 con 0x564617be8380 2024-09-22T08:36:41.479 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.473+0000 7fd133f8a640 1 -- 172.21.15.142:0/266069577 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:87 8.13 8:c8000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564617bf6cf0 con 0x7fd12c0541f0 2024-09-22T08:36:41.479 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.473+0000 7fd133f8a640 1 -- 172.21.15.142:0/266069577 <== osd.0 v2:172.21.15.31:6800/168281188 23 ==== osd_op_reply(87 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd12407f040 con 0x7fd12c0541f0 2024-09-22T08:36:41.479 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.473+0000 7fd133f8a640 1 -- 172.21.15.142:0/266069577 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:88 8.b 8:d0000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564617bf6cf0 con 0x564617becd90 2024-09-22T08:36:41.479 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.473+0000 7fd13cf8c640 1 -- 172.21.15.142:0/266069577 <== osd.3 v2:172.21.15.142:6800/1064901393 24 ==== osd_op_reply(88 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd13403a070 con 0x564617becd90 2024-09-22T08:36:41.480 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.473+0000 7fd13cf8c640 1 -- 172.21.15.142:0/266069577 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:89 8.1b 8:d8000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564617bf6cf0 con 0x7fd134054c20 2024-09-22T08:36:41.482 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.473+0000 7fd13c78b640 1 -- 172.21.15.142:0/266069577 <== osd.2 v2:172.21.15.142:6808/279438927 15 ==== osd_op_reply(89 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd12c039070 con 0x7fd134054c20 2024-09-22T08:36:41.482 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.473+0000 7fd13c78b640 1 -- 172.21.15.142:0/266069577 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:90 8.7 8:e0000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564617bf6cf0 con 0x7fd12c0541f0 2024-09-22T08:36:41.482 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.474+0000 7fd133f8a640 1 -- 172.21.15.142:0/266069577 <== osd.0 v2:172.21.15.31:6800/168281188 24 ==== osd_op_reply(90 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd12407f040 con 0x7fd12c0541f0 2024-09-22T08:36:41.483 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.474+0000 7fd133f8a640 1 -- 172.21.15.142:0/266069577 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:91 8.17 8:e8000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564617bf6cf0 con 0x564617be8380 2024-09-22T08:36:41.483 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.474+0000 7fd133f8a640 1 -- 172.21.15.142:0/266069577 <== osd.1 v2:172.21.15.142:6816/3192108003 28 ==== osd_op_reply(91 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd12407f040 con 0x564617be8380 2024-09-22T08:36:41.483 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.474+0000 7fd133f8a640 1 -- 172.21.15.142:0/266069577 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:92 8.f 8:f0000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564617bf6cf0 con 0x564617becd90 2024-09-22T08:36:41.483 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.474+0000 7fd13cf8c640 1 -- 172.21.15.142:0/266069577 <== osd.3 v2:172.21.15.142:6800/1064901393 25 ==== osd_op_reply(92 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd13403a070 con 0x564617becd90 2024-09-22T08:36:41.483 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.474+0000 7fd13cf8c640 1 -- 172.21.15.142:0/266069577 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:93 8.1f 8:f8000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564617bf6cf0 con 0x7fd134054c20 2024-09-22T08:36:41.483 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.474+0000 7fd13c78b640 1 -- 172.21.15.142:0/266069577 <== osd.2 v2:172.21.15.142:6808/279438927 16 ==== osd_op_reply(93 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd12c039070 con 0x7fd134054c20 2024-09-22T08:36:41.483 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.475+0000 7fcff27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:36:41.483 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.475+0000 7fd140b1f800 1 -- 172.21.15.142:0/266069577 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94859046142832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564617bf3ca0 con 0x564617be8380 2024-09-22T08:36:41.483 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.476+0000 7fd133f8a640 1 -- 172.21.15.142:0/266069577 <== osd.1 v2:172.21.15.142:6816/3192108003 29 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94859046142832] v30'25 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd12407f040 con 0x564617be8380 2024-09-22T08:36:41.483 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.476+0000 7fd140b1f800 1 -- 172.21.15.142:0/266069577 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94859046105424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564617bf05e0 con 0x7fd134054c20 2024-09-22T08:36:41.483 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.479+0000 7fd13c78b640 1 -- 172.21.15.142:0/266069577 <== osd.2 v2:172.21.15.142:6808/279438927 17 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94859046105424] v30'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd12c039070 con 0x7fd134054c20 2024-09-22T08:36:41.483 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.479+0000 7fd140b1f800 20 remove_watcher() i=0 2024-09-22T08:36:41.483 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.479+0000 7fd140b1f800 2 removed watcher, disabling cache 2024-09-22T08:36:41.484 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.479+0000 7fd140b1f800 1 -- 172.21.15.142:0/266069577 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94859046111008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564617bf05e0 con 0x564617be8380 2024-09-22T08:36:41.484 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.480+0000 7fd133f8a640 1 -- 172.21.15.142:0/266069577 <== osd.1 v2:172.21.15.142:6816/3192108003 30 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94859046111008] v30'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd12407f040 con 0x564617be8380 2024-09-22T08:36:41.484 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.480+0000 7fd140b1f800 20 remove_watcher() i=1 2024-09-22T08:36:41.484 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.480+0000 7fd140b1f800 1 -- 172.21.15.142:0/266069577 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94859046115040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564617bf05e0 con 0x564617becd90 2024-09-22T08:36:41.485 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.483+0000 7fd13cf8c640 1 -- 172.21.15.142:0/266069577 <== osd.3 v2:172.21.15.142:6800/1064901393 26 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94859046115040] v30'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd13403a070 con 0x564617becd90 2024-09-22T08:36:41.485 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.483+0000 7fd140b1f800 20 remove_watcher() i=2 2024-09-22T08:36:41.485 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.483+0000 7fd140b1f800 1 -- 172.21.15.142:0/266069577 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94859046117184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564617bf4720 con 0x7fd134054c20 2024-09-22T08:36:41.486 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.484+0000 7fd13c78b640 1 -- 172.21.15.142:0/266069577 <== osd.2 v2:172.21.15.142:6808/279438927 18 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94859046117184] v30'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd12c039070 con 0x7fd134054c20 2024-09-22T08:36:41.486 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.484+0000 7fd140b1f800 20 remove_watcher() i=3 2024-09-22T08:36:41.486 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.484+0000 7fd140b1f800 1 -- 172.21.15.142:0/266069577 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94859046122208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564617bf56e0 con 0x564617be8380 2024-09-22T08:36:41.487 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.485+0000 7fd133f8a640 1 -- 172.21.15.142:0/266069577 <== osd.1 v2:172.21.15.142:6816/3192108003 31 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94859046122208] v30'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd12407f040 con 0x564617be8380 2024-09-22T08:36:41.487 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.485+0000 7fd140b1f800 20 remove_watcher() i=4 2024-09-22T08:36:41.487 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.485+0000 7fd140b1f800 1 -- 172.21.15.142:0/266069577 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94859046125760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564617bf4720 con 0x7fd12c0541f0 2024-09-22T08:36:41.490 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.487+0000 7fd133f8a640 1 -- 172.21.15.142:0/266069577 <== osd.0 v2:172.21.15.31:6800/168281188 25 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94859046125760] v30'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd12407f040 con 0x7fd12c0541f0 2024-09-22T08:36:41.490 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.489+0000 7fd140b1f800 20 remove_watcher() i=5 2024-09-22T08:36:41.490 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.489+0000 7fd140b1f800 1 -- 172.21.15.142:0/266069577 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94859046119488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564617bf72e0 con 0x7fd12c0541f0 2024-09-22T08:36:41.492 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.490+0000 7fd133f8a640 1 -- 172.21.15.142:0/266069577 <== osd.0 v2:172.21.15.31:6800/168281188 26 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94859046119488] v30'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd12407f040 con 0x7fd12c0541f0 2024-09-22T08:36:41.492 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.490+0000 7fd140b1f800 20 remove_watcher() i=6 2024-09-22T08:36:41.492 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.490+0000 7fd140b1f800 1 -- 172.21.15.142:0/266069577 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94859046123264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564617bf56e0 con 0x7fd12c0541f0 2024-09-22T08:36:41.496 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.491+0000 7fd133f8a640 1 -- 172.21.15.142:0/266069577 <== osd.0 v2:172.21.15.31:6800/168281188 27 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94859046123264] v30'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd12407f040 con 0x7fd12c0541f0 2024-09-22T08:36:41.496 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.491+0000 7fd140b1f800 20 remove_watcher() i=7 2024-09-22T08:36:41.496 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.491+0000 7fd140b1f800 1 -- 172.21.15.142:0/266069577 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7fd12c0541f0 msgr2=0x7fd12c054610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:41.496 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.491+0000 7fd140b1f800 1 --2- 172.21.15.142:0/266069577 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7fd12c0541f0 0x7fd12c054610 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:41.496 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.491+0000 7fd140b1f800 1 -- 172.21.15.142:0/266069577 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x564617be8380 msgr2=0x564617bea840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:41.496 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.491+0000 7fd140b1f800 1 --2- 172.21.15.142:0/266069577 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x564617be8380 0x564617bea840 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:41.496 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.491+0000 7fd140b1f800 1 -- 172.21.15.142:0/266069577 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7fd134054c20 msgr2=0x7fd134022040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:41.496 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.491+0000 7fd140b1f800 1 --2- 172.21.15.142:0/266069577 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7fd134054c20 0x7fd134022040 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:41.496 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.491+0000 7fd140b1f800 1 -- 172.21.15.142:0/266069577 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x564617becd90 msgr2=0x564617bef180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:41.496 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.491+0000 7fd140b1f800 1 --2- 172.21.15.142:0/266069577 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x564617becd90 0x564617bef180 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:41.496 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.492+0000 7fd140b1f800 1 -- 172.21.15.142:0/266069577 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fd00c03cfb0 msgr2=0x7fd00c03f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:41.496 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.492+0000 7fd140b1f800 1 --2- 172.21.15.142:0/266069577 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fd00c03cfb0 0x7fd00c03f470 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fd12c00efd0 tx=0x7fd12c041000 comp rx=0 tx=0).stop 2024-09-22T08:36:41.497 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.492+0000 7fd140b1f800 1 -- 172.21.15.142:0/266069577 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564617bd5410 msgr2=0x564617bdca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:41.497 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.492+0000 7fd140b1f800 1 --2- 172.21.15.142:0/266069577 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564617bd5410 0x564617bdca30 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fd134054bb0 tx=0x7fd1340547a0 comp rx=0 tx=0).stop 2024-09-22T08:36:41.497 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.492+0000 7fd133f8a640 1 -- 172.21.15.142:0/266069577 reap_dead start 2024-09-22T08:36:41.497 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.492+0000 7fd133f8a640 1 -- 172.21.15.142:0/266069577 reap_dead start 2024-09-22T08:36:41.497 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.492+0000 7fd140b1f800 1 -- 172.21.15.142:0/266069577 shutdown_connections 2024-09-22T08:36:41.497 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.492+0000 7fd140b1f800 1 -- 172.21.15.142:0/266069577 >> 172.21.15.142:0/266069577 conn(0x564617bd1830 msgr2=0x564617bcfa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:41.497 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.492+0000 7fd140b1f800 1 -- 172.21.15.142:0/266069577 shutdown_connections 2024-09-22T08:36:41.497 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.492+0000 7fd140b1f800 1 -- 172.21.15.142:0/266069577 wait complete. 2024-09-22T08:36:41.497 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.492+0000 7fd140b1f800 1 -- 172.21.15.142:0/1497819575 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fd01403d020 msgr2=0x7fd01403f4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:41.497 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.492+0000 7fd140b1f800 1 --2- 172.21.15.142:0/1497819575 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fd01403d020 0x7fd01403f4e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd12c0531e0 tx=0x7fd12c0011b0 comp rx=0 tx=0).stop 2024-09-22T08:36:41.497 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.492+0000 7fd140b1f800 1 -- 172.21.15.142:0/1497819575 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564617bc8970 msgr2=0x564617bc8d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:41.497 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.492+0000 7fd140b1f800 1 --2- 172.21.15.142:0/1497819575 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564617bc8970 0x564617bc8d90 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x564617bae980 tx=0x7fd1340167b0 comp rx=0 tx=0).stop 2024-09-22T08:36:41.497 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.492+0000 7fd140b1f800 1 -- 172.21.15.142:0/1497819575 shutdown_connections 2024-09-22T08:36:41.497 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.492+0000 7fd140b1f800 1 --2- 172.21.15.142:0/1497819575 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fd01403d020 0x7fd01403f4e0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:41.498 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.492+0000 7fd140b1f800 1 --2- 172.21.15.142:0/1497819575 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564617bc8970 0x564617bc8d90 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:41.498 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.492+0000 7fd140b1f800 1 -- 172.21.15.142:0/1497819575 >> 172.21.15.142:0/1497819575 conn(0x564617bbcd20 msgr2=0x564617bbd100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:41.498 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.492+0000 7fd140b1f800 1 -- 172.21.15.142:0/1497819575 shutdown_connections 2024-09-22T08:36:41.498 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.492+0000 7fd140b1f800 1 -- 172.21.15.142:0/1497819575 wait complete. 2024-09-22T08:36:41.498 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.492+0000 7fd140b1f800 1 -- 172.21.15.142:0/3366331119 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x564617abaaf0 msgr2=0x564617bb4fd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:41.498 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.492+0000 7fd140b1f800 1 --2- 172.21.15.142:0/3366331119 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x564617abaaf0 0x564617bb4fd0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:41.498 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.492+0000 7fd140b1f800 1 -- 172.21.15.142:0/3366331119 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x564617bb73b0 msgr2=0x564617bb9830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:41.498 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.492+0000 7fd140b1f800 1 --2- 172.21.15.142:0/3366331119 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x564617bb73b0 0x564617bb9830 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:41.498 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.492+0000 7fd140b1f800 1 -- 172.21.15.142:0/3366331119 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fd02403d1a0 msgr2=0x7fd02403f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:41.498 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.492+0000 7fd140b1f800 1 --2- 172.21.15.142:0/3366331119 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fd02403d1a0 0x7fd02403f660 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd124057000 tx=0x7fd124052000 comp rx=0 tx=0).stop 2024-09-22T08:36:41.498 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.493+0000 7fd140b1f800 1 -- 172.21.15.142:0/3366331119 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564617ab6fe0 msgr2=0x564617bad980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:41.498 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.493+0000 7fd140b1f800 1 --2- 172.21.15.142:0/3366331119 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564617ab6fe0 0x564617bad980 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fd12c0012f0 tx=0x7fd12c000ed0 comp rx=0 tx=0).stop 2024-09-22T08:36:41.498 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.493+0000 7fd140b1f800 1 -- 172.21.15.142:0/3366331119 shutdown_connections 2024-09-22T08:36:41.499 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.493+0000 7fd140b1f800 1 --2- 172.21.15.142:0/3366331119 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x564617bb73b0 0x564617bb9830 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:41.499 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.493+0000 7fd140b1f800 1 --2- 172.21.15.142:0/3366331119 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x564617abaaf0 0x564617bb4fd0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:41.499 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.493+0000 7fd140b1f800 1 --2- 172.21.15.142:0/3366331119 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fd02403d1a0 0x7fd02403f660 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:41.499 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.493+0000 7fd140b1f800 1 --2- 172.21.15.142:0/3366331119 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564617ab6fe0 0x564617bad980 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:41.499 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.493+0000 7fd140b1f800 1 -- 172.21.15.142:0/3366331119 >> 172.21.15.142:0/3366331119 conn(0x564617ab0ba0 msgr2=0x564617ba7370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:41.499 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.493+0000 7fd140b1f800 1 -- 172.21.15.142:0/3366331119 shutdown_connections 2024-09-22T08:36:41.499 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.493+0000 7fd140b1f800 1 -- 172.21.15.142:0/3366331119 wait complete. 2024-09-22T08:36:41.504 INFO:teuthology.orchestra.run.smithi142.stdout:[] 2024-09-22T08:36:41.505 DEBUG:tasks.util.rgw: json result: [] 2024-09-22T08:36:41.505 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'bud'] 2024-09-22T08:36:41.505 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'bud'] 2024-09-22T08:36:41.505 DEBUG:teuthology.orchestra.run.smithi142:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid bud 2024-09-22T08:36:41.550 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:36:41.550 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:36:41.551 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.548+0000 7f751c72e800 1 Processor -- start 2024-09-22T08:36:41.551 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.549+0000 7f751c72e800 1 -- start start 2024-09-22T08:36:41.551 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.549+0000 7f751c72e800 1 --2- >> v2:172.21.15.31:3300/0 conn(0x555dd9b149d0 0x555dd9b16e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:41.551 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.549+0000 7f751c72e800 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x555dd999ba20 con 0x555dd9a83d30 2024-09-22T08:36:41.551 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.549+0000 7f751c72e800 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x555dd999b7d0 con 0x555dd9b149d0 2024-09-22T08:36:41.552 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.549+0000 7f750fcdc640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x555dd9b149d0 0x555dd9b16e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:41.552 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.549+0000 7f75184dd640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x555dd9a83d30 0x555dd9b13140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.142:42234/0 (socket says 172.21.15.142:42234) 2024-09-22T08:36:41.552 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.549+0000 7f75184dd640 1 -- 172.21.15.142:0/755832468 learned_addr learned my addr 172.21.15.142:0/755832468 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-09-22T08:36:41.552 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.549+0000 7f750fcdc640 1 -- 172.21.15.142:0/755832468 >> v1:172.21.15.31:6789/0 conn(0x555dd9a83d30 legacy=0x555dd9b13140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:41.552 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.549+0000 7f750fcdc640 1 -- 172.21.15.142:0/755832468 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x555dd9b18570 con 0x555dd9b149d0 2024-09-22T08:36:41.553 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.551+0000 7f750fcdc640 1 --2- 172.21.15.142:0/755832468 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555dd9b149d0 0x555dd9b16e90 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f750000a470 tx=0x7f7500045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8246a46fce92e7e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:41.554 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.551+0000 7f7517cdc640 1 -- 172.21.15.142:0/755832468 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7500053570 con 0x555dd9b149d0 2024-09-22T08:36:41.554 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.551+0000 7f7517cdc640 1 -- 172.21.15.142:0/755832468 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7500058070 con 0x555dd9b149d0 2024-09-22T08:36:41.554 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.551+0000 7f7517cdc640 1 -- 172.21.15.142:0/755832468 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7500053880 con 0x555dd9b149d0 2024-09-22T08:36:41.554 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.552+0000 7f751c72e800 1 -- 172.21.15.142:0/755832468 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555dd9b149d0 msgr2=0x555dd9b16e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:41.555 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.552+0000 7f751c72e800 1 --2- 172.21.15.142:0/755832468 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555dd9b149d0 0x555dd9b16e90 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f750000a470 tx=0x7f7500045a20 comp rx=0 tx=0).stop 2024-09-22T08:36:41.555 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.552+0000 7f751c72e800 1 -- 172.21.15.142:0/755832468 shutdown_connections 2024-09-22T08:36:41.555 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.552+0000 7f751c72e800 1 --2- 172.21.15.142:0/755832468 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555dd9b149d0 0x555dd9b16e90 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:41.555 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.552+0000 7f751c72e800 1 -- 172.21.15.142:0/755832468 >> 172.21.15.142:0/755832468 conn(0x555dd9b0abb0 msgr2=0x555dd9b0d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:41.555 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.552+0000 7f751c72e800 1 -- 172.21.15.142:0/755832468 shutdown_connections 2024-09-22T08:36:41.555 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.552+0000 7f751c72e800 1 -- 172.21.15.142:0/755832468 wait complete. 2024-09-22T08:36:41.568 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.565+0000 7f751c72e800 1 Processor -- start 2024-09-22T08:36:41.569 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.565+0000 7f751c72e800 1 -- start start 2024-09-22T08:36:41.569 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.566+0000 7f751c72e800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555dd9a83d30 0x555dd9c00010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:41.569 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.566+0000 7f751c72e800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x555dd99a8dd0 con 0x555dd9a83d30 2024-09-22T08:36:41.569 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.566+0000 7f75184dd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555dd9a83d30 0x555dd9c00010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:41.569 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.566+0000 7f75184dd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555dd9a83d30 0x555dd9c00010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:37416/0 (socket says 172.21.15.142:37416) 2024-09-22T08:36:41.569 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.566+0000 7f75184dd640 1 -- 172.21.15.142:0/519242597 learned_addr learned my addr 172.21.15.142:0/519242597 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:41.569 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.566+0000 7f75184dd640 1 -- 172.21.15.142:0/519242597 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555dd9c00600 con 0x555dd9a83d30 2024-09-22T08:36:41.569 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.566+0000 7f75184dd640 1 --2- 172.21.15.142:0/519242597 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555dd9a83d30 0x555dd9c00010 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f7508001e40 tx=0x7f7508001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0e5d8043ffe880a server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:41.569 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.566+0000 7f740660c640 1 -- 172.21.15.142:0/519242597 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7508012020 con 0x555dd9a83d30 2024-09-22T08:36:41.569 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.566+0000 7f740660c640 1 -- 172.21.15.142:0/519242597 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f750800e5a0 con 0x555dd9a83d30 2024-09-22T08:36:41.569 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.566+0000 7f740660c640 1 -- 172.21.15.142:0/519242597 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f750800e8a0 con 0x555dd9a83d30 2024-09-22T08:36:41.571 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.567+0000 7f751c72e800 1 -- 172.21.15.142:0/519242597 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555dd9a83d30 msgr2=0x555dd9c00010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:41.571 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.567+0000 7f751c72e800 1 --2- 172.21.15.142:0/519242597 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555dd9a83d30 0x555dd9c00010 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f7508001e40 tx=0x7f7508001e70 comp rx=0 tx=0).stop 2024-09-22T08:36:41.572 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.567+0000 7f751c72e800 1 -- 172.21.15.142:0/519242597 shutdown_connections 2024-09-22T08:36:41.572 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.567+0000 7f751c72e800 1 --2- 172.21.15.142:0/519242597 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555dd9a83d30 0x555dd9c00010 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:41.572 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.567+0000 7f751c72e800 1 -- 172.21.15.142:0/519242597 >> 172.21.15.142:0/519242597 conn(0x555dd9b0abb0 msgr2=0x555dd9bfb990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:41.572 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.567+0000 7f751c72e800 1 -- 172.21.15.142:0/519242597 shutdown_connections 2024-09-22T08:36:41.572 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.567+0000 7f751c72e800 1 -- 172.21.15.142:0/519242597 wait complete. 2024-09-22T08:36:41.572 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.567+0000 7f751c72e800 1 Processor -- start 2024-09-22T08:36:41.572 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.568+0000 7f751c72e800 1 -- start start 2024-09-22T08:36:41.572 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.568+0000 7f751c72e800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555dd9a83d30 0x555dd9b10830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:41.572 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.568+0000 7f751c72e800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x555dd9b17810 con 0x555dd9a83d30 2024-09-22T08:36:41.572 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.568+0000 7f75184dd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555dd9a83d30 0x555dd9b10830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:41.572 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.568+0000 7f75184dd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555dd9a83d30 0x555dd9b10830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:37430/0 (socket says 172.21.15.142:37430) 2024-09-22T08:36:41.572 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.568+0000 7f75184dd640 1 -- 172.21.15.142:0/1152672228 learned_addr learned my addr 172.21.15.142:0/1152672228 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:41.572 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.568+0000 7f75184dd640 1 -- 172.21.15.142:0/1152672228 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555dd9b10d90 con 0x555dd9a83d30 2024-09-22T08:36:41.573 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.569+0000 7f75184dd640 1 --2- 172.21.15.142:0/1152672228 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555dd9a83d30 0x555dd9b10830 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f75080012b0 tx=0x7f7508000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:41.573 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.569+0000 7f7404e09640 1 -- 172.21.15.142:0/1152672228 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7508012030 con 0x555dd9a83d30 2024-09-22T08:36:41.573 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.569+0000 7f7404e09640 1 -- 172.21.15.142:0/1152672228 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f750801a750 con 0x555dd9a83d30 2024-09-22T08:36:41.573 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.569+0000 7f751c72e800 1 -- 172.21.15.142:0/1152672228 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555dd9b0f140 con 0x555dd9a83d30 2024-09-22T08:36:41.573 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.569+0000 7f7404e09640 1 -- 172.21.15.142:0/1152672228 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f750801aa70 con 0x555dd9a83d30 2024-09-22T08:36:41.573 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.569+0000 7f751c72e800 1 -- 172.21.15.142:0/1152672228 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555dd9b0f700 con 0x555dd9a83d30 2024-09-22T08:36:41.576 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.570+0000 7f7404e09640 1 -- 172.21.15.142:0/1152672228 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f7508015020 con 0x555dd9a83d30 2024-09-22T08:36:41.576 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.570+0000 7f7404e09640 1 --2- 172.21.15.142:0/1152672228 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f740003cfb0 0x7f740003f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:41.576 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.570+0000 7f7404e09640 1 -- 172.21.15.142:0/1152672228 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f7508020030 con 0x555dd9a83d30 2024-09-22T08:36:41.576 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.570+0000 7f750fcdc640 1 --2- 172.21.15.142:0/1152672228 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f740003cfb0 0x7f740003f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:41.577 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.570+0000 7f751c72e800 1 --2- 172.21.15.142:0/1152672228 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x555dd9b149d0 0x555dd9c11040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:41.577 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.570+0000 7f751c72e800 1 -- 172.21.15.142:0/1152672228 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x555dd9c11580 con 0x555dd9b149d0 2024-09-22T08:36:41.577 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.570+0000 7f7518cde640 1 --2- 172.21.15.142:0/1152672228 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x555dd9b149d0 0x555dd9c11040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:41.577 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.570+0000 7f750fcdc640 1 --2- 172.21.15.142:0/1152672228 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f740003cfb0 0x7f740003f470 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f7500057000 tx=0x7f7500052000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:41.577 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.571+0000 7f7518cde640 1 --2- 172.21.15.142:0/1152672228 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x555dd9b149d0 0x555dd9c11040 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:41.577 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.571+0000 7f7518cde640 1 -- 172.21.15.142:0/1152672228 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f751000a4d0 con 0x555dd9b149d0 2024-09-22T08:36:41.577 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.571+0000 7f751c72e800 1 -- 172.21.15.142:0/1152672228 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x555dd9b0fc00 con 0x555dd9b149d0 2024-09-22T08:36:41.577 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.571+0000 7f7518cde640 1 -- 172.21.15.142:0/1152672228 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f751000a4d0 con 0x555dd9b149d0 2024-09-22T08:36:41.577 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.571+0000 7f751c72e800 1 --2- 172.21.15.142:0/1152672228 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x555dd9c138b0 0x555dd9c15ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:41.577 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.571+0000 7f751c72e800 1 -- 172.21.15.142:0/1152672228 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:3 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x555dd9c16370 con 0x555dd9c138b0 2024-09-22T08:36:41.577 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.571+0000 7f75184dd640 1 --2- 172.21.15.142:0/1152672228 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x555dd9c138b0 0x555dd9c15ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:41.577 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.572+0000 7f75184dd640 1 --2- 172.21.15.142:0/1152672228 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x555dd9c138b0 0x555dd9c15ca0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:41.577 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.572+0000 7f75184dd640 1 -- 172.21.15.142:0/1152672228 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(3 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f7508018ce0 con 0x555dd9c138b0 2024-09-22T08:36:41.578 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.572+0000 7f751c72e800 1 -- 172.21.15.142:0/1152672228 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x555dd9c12750 con 0x555dd9b149d0 2024-09-22T08:36:41.578 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.572+0000 7f7518cde640 1 -- 172.21.15.142:0/1152672228 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f751000a4d0 con 0x555dd9b149d0 2024-09-22T08:36:41.578 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.572+0000 7f751c72e800 1 -- 172.21.15.142:0/1152672228 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x555dd9c12bf0 con 0x555dd9c138b0 2024-09-22T08:36:41.578 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.572+0000 7f75184dd640 1 -- 172.21.15.142:0/1152672228 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(5 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f7508018ce0 con 0x555dd9c138b0 2024-09-22T08:36:41.578 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.573+0000 7f751c72e800 1 Processor -- start 2024-09-22T08:36:41.578 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.573+0000 7f751c72e800 1 -- start start 2024-09-22T08:36:41.578 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.573+0000 7f751c72e800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555dd9c24d10 0x555dd9c25130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:41.578 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.573+0000 7f751c72e800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x555dd9a07d50 con 0x555dd9c24d10 2024-09-22T08:36:41.578 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.573+0000 7f7518cde640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555dd9c24d10 0x555dd9c25130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:41.578 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.573+0000 7f7518cde640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555dd9c24d10 0x555dd9c25130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:37442/0 (socket says 172.21.15.142:37442) 2024-09-22T08:36:41.578 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.573+0000 7f7518cde640 1 -- 172.21.15.142:0/1206416571 learned_addr learned my addr 172.21.15.142:0/1206416571 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:41.578 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.573+0000 7f7518cde640 1 -- 172.21.15.142:0/1206416571 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555dd9c25770 con 0x555dd9c24d10 2024-09-22T08:36:41.579 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.574+0000 7f7518cde640 1 --2- 172.21.15.142:0/1206416571 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555dd9c24d10 0x555dd9c25130 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x555dd9b10260 tx=0x7f75100167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:41.579 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.574+0000 7f73fdffb640 1 -- 172.21.15.142:0/1206416571 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7510013640 con 0x555dd9c24d10 2024-09-22T08:36:41.579 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.574+0000 7f73fdffb640 1 -- 172.21.15.142:0/1206416571 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75100137e0 con 0x555dd9c24d10 2024-09-22T08:36:41.579 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.574+0000 7f751c72e800 1 -- 172.21.15.142:0/1206416571 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555dd9c25fa0 con 0x555dd9c24d10 2024-09-22T08:36:41.579 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.574+0000 7f73fdffb640 1 -- 172.21.15.142:0/1206416571 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7510013ac0 con 0x555dd9c24d10 2024-09-22T08:36:41.579 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.574+0000 7f751c72e800 1 -- 172.21.15.142:0/1206416571 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555dd9c26540 con 0x555dd9c24d10 2024-09-22T08:36:41.597 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.575+0000 7f73fdffb640 1 -- 172.21.15.142:0/1206416571 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f7510011040 con 0x555dd9c24d10 2024-09-22T08:36:41.598 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.575+0000 7f73fdffb640 1 --2- 172.21.15.142:0/1206416571 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f73f003cfb0 0x7f73f003f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:41.598 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.575+0000 7f73fdffb640 1 -- 172.21.15.142:0/1206416571 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f751000e040 con 0x555dd9c24d10 2024-09-22T08:36:41.598 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.575+0000 7f75184dd640 1 --2- 172.21.15.142:0/1206416571 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f73f003cfb0 0x7f73f003f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:41.598 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.575+0000 7f751c72e800 1 Processor -- start 2024-09-22T08:36:41.598 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.576+0000 7f75184dd640 1 --2- 172.21.15.142:0/1206416571 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f73f003cfb0 0x7f73f003f470 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x555dd9c11a30 tx=0x7f7508052a40 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:41.598 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.576+0000 7f751c72e800 1 -- start start 2024-09-22T08:36:41.598 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.576+0000 7f751c72e800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555dd9c317d0 0x555dd9c31bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:41.598 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.576+0000 7f751c72e800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x555dd9c00a30 con 0x555dd9c317d0 2024-09-22T08:36:41.598 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.576+0000 7f7518cde640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555dd9c317d0 0x555dd9c31bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:41.598 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.576+0000 7f7518cde640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555dd9c317d0 0x555dd9c31bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:37448/0 (socket says 172.21.15.142:37448) 2024-09-22T08:36:41.599 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.576+0000 7f7518cde640 1 -- 172.21.15.142:0/128850254 learned_addr learned my addr 172.21.15.142:0/128850254 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:41.599 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.576+0000 7f7518cde640 1 -- 172.21.15.142:0/128850254 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555dd9c321c0 con 0x555dd9c317d0 2024-09-22T08:36:41.599 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.576+0000 7f7518cde640 1 --2- 172.21.15.142:0/128850254 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555dd9c317d0 0x555dd9c31bd0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f7510020000 tx=0x7f75100204d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dbac9db4d4a5e28 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:41.599 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.577+0000 7f73f77fe640 1 -- 172.21.15.142:0/128850254 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7510021e20 con 0x555dd9c317d0 2024-09-22T08:36:41.599 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.577+0000 7f73f77fe640 1 -- 172.21.15.142:0/128850254 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7510052070 con 0x555dd9c317d0 2024-09-22T08:36:41.599 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.577+0000 7f73f77fe640 1 -- 172.21.15.142:0/128850254 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7510021a90 con 0x555dd9c317d0 2024-09-22T08:36:41.599 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.577+0000 7f751c72e800 1 -- 172.21.15.142:0/128850254 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555dd9c317d0 msgr2=0x555dd9c31bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:41.599 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.577+0000 7f751c72e800 1 --2- 172.21.15.142:0/128850254 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555dd9c317d0 0x555dd9c31bd0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f7510020000 tx=0x7f75100204d0 comp rx=0 tx=0).stop 2024-09-22T08:36:41.599 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.577+0000 7f751c72e800 1 -- 172.21.15.142:0/128850254 shutdown_connections 2024-09-22T08:36:41.599 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.577+0000 7f751c72e800 1 --2- 172.21.15.142:0/128850254 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555dd9c317d0 0x555dd9c31bd0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:41.599 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.577+0000 7f751c72e800 1 -- 172.21.15.142:0/128850254 >> 172.21.15.142:0/128850254 conn(0x555dd9c2dbd0 msgr2=0x555dd9c2be10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:41.599 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.577+0000 7f751c72e800 1 -- 172.21.15.142:0/128850254 shutdown_connections 2024-09-22T08:36:41.600 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.577+0000 7f751c72e800 1 -- 172.21.15.142:0/128850254 wait complete. 2024-09-22T08:36:41.600 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.577+0000 7f751c72e800 1 Processor -- start 2024-09-22T08:36:41.600 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.577+0000 7f751c72e800 1 -- start start 2024-09-22T08:36:41.600 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.577+0000 7f751c72e800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555dd9c317d0 0x555dd9c38d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:41.600 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.577+0000 7f751c72e800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x555dd9c327b0 con 0x555dd9c317d0 2024-09-22T08:36:41.600 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.578+0000 7f7518cde640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555dd9c317d0 0x555dd9c38d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:41.600 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.578+0000 7f7518cde640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555dd9c317d0 0x555dd9c38d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:37464/0 (socket says 172.21.15.142:37464) 2024-09-22T08:36:41.600 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.578+0000 7f7518cde640 1 -- 172.21.15.142:0/1713481147 learned_addr learned my addr 172.21.15.142:0/1713481147 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:41.600 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.578+0000 7f7518cde640 1 -- 172.21.15.142:0/1713481147 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555dd9c392b0 con 0x555dd9c317d0 2024-09-22T08:36:41.600 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.578+0000 7f7518cde640 1 --2- 172.21.15.142:0/1713481147 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555dd9c317d0 0x555dd9c38d50 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f75100147b0 tx=0x7f7510054840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:41.600 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.578+0000 7f73f5ffb640 1 -- 172.21.15.142:0/1713481147 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7510020bd0 con 0x555dd9c317d0 2024-09-22T08:36:41.600 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.578+0000 7f73f5ffb640 1 -- 172.21.15.142:0/1713481147 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7510020d70 con 0x555dd9c317d0 2024-09-22T08:36:41.601 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.578+0000 7f751c72e800 1 -- 172.21.15.142:0/1713481147 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555dd9c39540 con 0x555dd9c317d0 2024-09-22T08:36:41.601 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.578+0000 7f73f5ffb640 1 -- 172.21.15.142:0/1713481147 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f751001fa90 con 0x555dd9c317d0 2024-09-22T08:36:41.601 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.578+0000 7f751c72e800 1 -- 172.21.15.142:0/1713481147 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555dd9c3a0d0 con 0x555dd9c317d0 2024-09-22T08:36:41.601 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.579+0000 7f73f5ffb640 1 -- 172.21.15.142:0/1713481147 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f751001fc30 con 0x555dd9c317d0 2024-09-22T08:36:41.601 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.579+0000 7f73f5ffb640 1 --2- 172.21.15.142:0/1713481147 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f73e803cfb0 0x7f73e803f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:41.601 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.579+0000 7f73f5ffb640 1 -- 172.21.15.142:0/1713481147 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f7510053ef0 con 0x555dd9c317d0 2024-09-22T08:36:41.601 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.579+0000 7f75184dd640 1 --2- 172.21.15.142:0/1713481147 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f73e803cfb0 0x7f73e803f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:41.601 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.580+0000 7f75184dd640 1 --2- 172.21.15.142:0/1713481147 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f73e803cfb0 0x7f73e803f470 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f7508052a10 tx=0x7f7508046000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:41.601 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.580+0000 7f751c72e800 20 rados->read ofs=0 len=0 2024-09-22T08:36:41.601 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.580+0000 7f751c72e800 1 --2- 172.21.15.142:0/1713481147 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x555dd9c446b0 0x555dd9c46b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:41.601 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.580+0000 7f751c72e800 1 -- 172.21.15.142:0/1713481147 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x555dd9c472c0 con 0x555dd9c446b0 2024-09-22T08:36:41.601 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.580+0000 7f750fcdc640 1 --2- 172.21.15.142:0/1713481147 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x555dd9c446b0 0x555dd9c46b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:41.602 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.580+0000 7f750fcdc640 1 --2- 172.21.15.142:0/1713481147 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x555dd9c446b0 0x555dd9c46b70 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:41.602 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.581+0000 7f750fcdc640 1 -- 172.21.15.142:0/1713481147 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7500051070 con 0x555dd9c446b0 2024-09-22T08:36:41.602 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.581+0000 7f751c72e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:41.602 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.581+0000 7f751c72e800 20 realm 2024-09-22T08:36:41.602 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.581+0000 7f751c72e800 20 rados->read ofs=0 len=0 2024-09-22T08:36:41.602 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.581+0000 7f751c72e800 1 -- 172.21.15.142:0/1713481147 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x555dd9c476f0 con 0x555dd9c446b0 2024-09-22T08:36:41.602 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.581+0000 7f750fcdc640 1 -- 172.21.15.142:0/1713481147 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7500051070 con 0x555dd9c446b0 2024-09-22T08:36:41.602 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.581+0000 7f751c72e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:41.602 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.581+0000 7f751c72e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:36:41.602 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.581+0000 7f751c72e800 20 rados->read ofs=0 len=0 2024-09-22T08:36:41.602 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.581+0000 7f751c72e800 1 -- 172.21.15.142:0/1713481147 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x555dd9c47fc0 con 0x555dd9c446b0 2024-09-22T08:36:41.602 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.581+0000 7f750fcdc640 1 -- 172.21.15.142:0/1713481147 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7500051070 con 0x555dd9c446b0 2024-09-22T08:36:41.602 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.581+0000 7f751c72e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:41.603 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.581+0000 7f751c72e800 20 rados->read ofs=0 len=0 2024-09-22T08:36:41.603 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.581+0000 7f751c72e800 1 -- 172.21.15.142:0/1713481147 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x555dd9c48360 con 0x555dd9c446b0 2024-09-22T08:36:41.603 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.581+0000 7f750fcdc640 1 -- 172.21.15.142:0/1713481147 <== osd.1 v2:172.21.15.142:6816/3192108003 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7500051070 con 0x555dd9c446b0 2024-09-22T08:36:41.603 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.581+0000 7f751c72e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:36:41.603 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.581+0000 7f751c72e800 20 rados->read ofs=0 len=0 2024-09-22T08:36:41.603 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.581+0000 7f751c72e800 1 --2- 172.21.15.142:0/1713481147 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x555dd9c490c0 0x555dd9c4b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:41.603 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.581+0000 7f751c72e800 1 -- 172.21.15.142:0/1713481147 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x555dd9c4bac0 con 0x555dd9c490c0 2024-09-22T08:36:41.603 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.581+0000 7f7518cde640 1 --2- 172.21.15.142:0/1713481147 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x555dd9c490c0 0x555dd9c4b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:41.603 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.582+0000 7f7518cde640 1 --2- 172.21.15.142:0/1713481147 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x555dd9c490c0 0x555dd9c4b4b0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:41.603 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.582+0000 7f7518cde640 1 -- 172.21.15.142:0/1713481147 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(5 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f751000a4d0 con 0x555dd9c490c0 2024-09-22T08:36:41.603 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.582+0000 7f751c72e800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:36:41.603 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.582+0000 7f751c72e800 20 searching for the correct realm 2024-09-22T08:36:41.603 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.582+0000 7f751c72e800 1 -- 172.21.15.142:0/1713481147 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555dd9c4d3f0 con 0x555dd9c490c0 2024-09-22T08:36:41.603 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.582+0000 7f7518cde640 1 -- 172.21.15.142:0/1713481147 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f751000a4d0 con 0x555dd9c490c0 2024-09-22T08:36:41.604 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.582+0000 7f7518cde640 1 --2- 172.21.15.142:0/1713481147 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f7510012c00 0x7f7510054210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:41.604 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.582+0000 7f7518cde640 1 -- 172.21.15.142:0/1713481147 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555dd9c4d3f0 con 0x7f7510012c00 2024-09-22T08:36:41.604 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.582+0000 7f75184dd640 1 --2- 172.21.15.142:0/1713481147 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f7510012c00 0x7f7510054210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:41.604 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.583+0000 7f75184dd640 1 --2- 172.21.15.142:0/1713481147 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f7510012c00 0x7f7510054210 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:41.604 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.583+0000 7f75184dd640 1 -- 172.21.15.142:0/1713481147 <== osd.2 v2:172.21.15.142:6808/279438927 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7508018ce0 con 0x7f7510012c00 2024-09-22T08:36:41.604 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.583+0000 7f75184dd640 1 --2- 172.21.15.142:0/1713481147 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f7508017050 0x7f75080167e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:41.604 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.583+0000 7f75184dd640 1 -- 172.21.15.142:0/1713481147 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555dd9c4d3f0 con 0x7f7508017050 2024-09-22T08:36:41.604 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.583+0000 7f750fcdc640 1 --2- 172.21.15.142:0/1713481147 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f7508017050 0x7f75080167e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:41.604 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.583+0000 7f750fcdc640 1 --2- 172.21.15.142:0/1713481147 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f7508017050 0x7f75080167e0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:41.604 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.584+0000 7f750fcdc640 1 -- 172.21.15.142:0/1713481147 <== osd.0 v2:172.21.15.31:6800/168281188 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7500051070 con 0x7f7508017050 2024-09-22T08:36:41.604 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.584+0000 7f750fcdc640 1 -- 172.21.15.142:0/1713481147 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555dd9c4d3f0 con 0x555dd9c446b0 2024-09-22T08:36:41.604 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.584+0000 7f750fcdc640 1 -- 172.21.15.142:0/1713481147 <== osd.1 v2:172.21.15.142:6816/3192108003 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7500051070 con 0x555dd9c446b0 2024-09-22T08:36:41.604 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.584+0000 7f750fcdc640 1 -- 172.21.15.142:0/1713481147 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555dd9c4d3f0 con 0x555dd9c446b0 2024-09-22T08:36:41.605 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.584+0000 7f750fcdc640 1 -- 172.21.15.142:0/1713481147 <== osd.1 v2:172.21.15.142:6816/3192108003 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7500051070 con 0x555dd9c446b0 2024-09-22T08:36:41.605 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.584+0000 7f750fcdc640 1 -- 172.21.15.142:0/1713481147 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555dd9c4d3f0 con 0x7f7508017050 2024-09-22T08:36:41.605 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.584+0000 7f750fcdc640 1 -- 172.21.15.142:0/1713481147 <== osd.0 v2:172.21.15.31:6800/168281188 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7500051070 con 0x7f7508017050 2024-09-22T08:36:41.605 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.584+0000 7f750fcdc640 1 -- 172.21.15.142:0/1713481147 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555dd9c4d3f0 con 0x7f7508017050 2024-09-22T08:36:41.605 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.585+0000 7f750fcdc640 1 -- 172.21.15.142:0/1713481147 <== osd.0 v2:172.21.15.31:6800/168281188 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7500051070 con 0x7f7508017050 2024-09-22T08:36:41.605 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.585+0000 7f750fcdc640 1 -- 172.21.15.142:0/1713481147 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555dd9c4d3f0 con 0x7f7510012c00 2024-09-22T08:36:41.605 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.585+0000 7f75184dd640 1 -- 172.21.15.142:0/1713481147 <== osd.2 v2:172.21.15.142:6808/279438927 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7508018ce0 con 0x7f7510012c00 2024-09-22T08:36:41.605 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.585+0000 7f75184dd640 1 -- 172.21.15.142:0/1713481147 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555dd9c4d3f0 con 0x555dd9c490c0 2024-09-22T08:36:41.605 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.585+0000 7f7518cde640 1 -- 172.21.15.142:0/1713481147 <== osd.3 v2:172.21.15.142:6800/1064901393 3 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f751000a4d0 con 0x555dd9c490c0 2024-09-22T08:36:41.605 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.585+0000 7f7518cde640 1 -- 172.21.15.142:0/1713481147 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555dd9c4d3f0 con 0x555dd9c446b0 2024-09-22T08:36:41.605 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.585+0000 7f750fcdc640 1 -- 172.21.15.142:0/1713481147 <== osd.1 v2:172.21.15.142:6816/3192108003 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7500051070 con 0x555dd9c446b0 2024-09-22T08:36:41.605 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.585+0000 7f750fcdc640 1 -- 172.21.15.142:0/1713481147 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555dd9c4d3f0 con 0x7f7508017050 2024-09-22T08:36:41.605 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.586+0000 7f750fcdc640 1 -- 172.21.15.142:0/1713481147 <== osd.0 v2:172.21.15.31:6800/168281188 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7500051070 con 0x7f7508017050 2024-09-22T08:36:41.605 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.586+0000 7f750fcdc640 1 -- 172.21.15.142:0/1713481147 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555dd9c4d3f0 con 0x555dd9c446b0 2024-09-22T08:36:41.605 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.586+0000 7f750fcdc640 1 -- 172.21.15.142:0/1713481147 <== osd.1 v2:172.21.15.142:6816/3192108003 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7500051070 con 0x555dd9c446b0 2024-09-22T08:36:41.606 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.586+0000 7f750fcdc640 1 -- 172.21.15.142:0/1713481147 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555dd9c4d3f0 con 0x7f7510012c00 2024-09-22T08:36:41.606 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.586+0000 7f75184dd640 1 -- 172.21.15.142:0/1713481147 <== osd.2 v2:172.21.15.142:6808/279438927 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f7508018ce0 con 0x7f7510012c00 2024-09-22T08:36:41.606 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.586+0000 7f75184dd640 1 -- 172.21.15.142:0/1713481147 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555dd9c4d3f0 con 0x555dd9c490c0 2024-09-22T08:36:41.606 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.586+0000 7f7518cde640 1 -- 172.21.15.142:0/1713481147 <== osd.3 v2:172.21.15.142:6800/1064901393 4 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f751000a4d0 con 0x555dd9c490c0 2024-09-22T08:36:41.606 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.586+0000 7f7518cde640 1 -- 172.21.15.142:0/1713481147 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555dd9c4d3f0 con 0x555dd9c490c0 2024-09-22T08:36:41.606 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.587+0000 7f7518cde640 1 -- 172.21.15.142:0/1713481147 <== osd.3 v2:172.21.15.142:6800/1064901393 5 ==== osd_op_reply(20 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f751000a4d0 con 0x555dd9c490c0 2024-09-22T08:36:41.606 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.587+0000 7f7518cde640 1 -- 172.21.15.142:0/1713481147 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555dd9c4d3f0 con 0x7f7508017050 2024-09-22T08:36:41.606 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.587+0000 7f750fcdc640 1 -- 172.21.15.142:0/1713481147 <== osd.0 v2:172.21.15.31:6800/168281188 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7500051070 con 0x7f7508017050 2024-09-22T08:36:41.606 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.587+0000 7f750fcdc640 1 -- 172.21.15.142:0/1713481147 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555dd9c4d3f0 con 0x555dd9c490c0 2024-09-22T08:36:41.606 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.587+0000 7f7518cde640 1 -- 172.21.15.142:0/1713481147 <== osd.3 v2:172.21.15.142:6800/1064901393 6 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f751000a4d0 con 0x555dd9c490c0 2024-09-22T08:36:41.606 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.587+0000 7f7518cde640 1 -- 172.21.15.142:0/1713481147 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555dd9c4d3f0 con 0x555dd9c490c0 2024-09-22T08:36:41.606 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.587+0000 7f7518cde640 1 -- 172.21.15.142:0/1713481147 <== osd.3 v2:172.21.15.142:6800/1064901393 7 ==== osd_op_reply(23 [pgnls start_epoch 30 out=107b] v23'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f751000a4d0 con 0x555dd9c490c0 2024-09-22T08:36:41.606 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.587+0000 7f7518cde640 1 -- 172.21.15.142:0/1713481147 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555dd9c4d3f0 con 0x555dd9c446b0 2024-09-22T08:36:41.607 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.588+0000 7f750fcdc640 1 -- 172.21.15.142:0/1713481147 <== osd.1 v2:172.21.15.142:6816/3192108003 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7500051070 con 0x555dd9c446b0 2024-09-22T08:36:41.607 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.588+0000 7f750fcdc640 1 -- 172.21.15.142:0/1713481147 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555dd9c4d3f0 con 0x555dd9c446b0 2024-09-22T08:36:41.607 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.588+0000 7f750fcdc640 1 -- 172.21.15.142:0/1713481147 <== osd.1 v2:172.21.15.142:6816/3192108003 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f7500051070 con 0x555dd9c446b0 2024-09-22T08:36:41.607 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.588+0000 7f750fcdc640 1 -- 172.21.15.142:0/1713481147 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555dd9c4d3f0 con 0x7f7508017050 2024-09-22T08:36:41.607 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.588+0000 7f750fcdc640 1 -- 172.21.15.142:0/1713481147 <== osd.0 v2:172.21.15.31:6800/168281188 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7500051070 con 0x7f7508017050 2024-09-22T08:36:41.607 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.588+0000 7f750fcdc640 1 -- 172.21.15.142:0/1713481147 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555dd9c4d3f0 con 0x555dd9c490c0 2024-09-22T08:36:41.607 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.588+0000 7f7518cde640 1 -- 172.21.15.142:0/1713481147 <== osd.3 v2:172.21.15.142:6800/1064901393 8 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f751000a4d0 con 0x555dd9c490c0 2024-09-22T08:36:41.607 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.588+0000 7f7518cde640 1 -- 172.21.15.142:0/1713481147 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555dd9c4d3f0 con 0x7f7510012c00 2024-09-22T08:36:41.607 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.589+0000 7f75184dd640 1 -- 172.21.15.142:0/1713481147 <== osd.2 v2:172.21.15.142:6808/279438927 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7508018ce0 con 0x7f7510012c00 2024-09-22T08:36:41.607 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.589+0000 7f75184dd640 1 -- 172.21.15.142:0/1713481147 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555dd9c4d3f0 con 0x555dd9c446b0 2024-09-22T08:36:41.607 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.589+0000 7f750fcdc640 1 -- 172.21.15.142:0/1713481147 <== osd.1 v2:172.21.15.142:6816/3192108003 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7500051070 con 0x555dd9c446b0 2024-09-22T08:36:41.607 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.589+0000 7f750fcdc640 1 -- 172.21.15.142:0/1713481147 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555dd9c4d3f0 con 0x7f7508017050 2024-09-22T08:36:41.607 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.589+0000 7f750fcdc640 1 -- 172.21.15.142:0/1713481147 <== osd.0 v2:172.21.15.31:6800/168281188 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7500051070 con 0x7f7508017050 2024-09-22T08:36:41.608 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.589+0000 7f750fcdc640 1 -- 172.21.15.142:0/1713481147 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555dd9c4d3f0 con 0x555dd9c490c0 2024-09-22T08:36:41.608 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.589+0000 7f7518cde640 1 -- 172.21.15.142:0/1713481147 <== osd.3 v2:172.21.15.142:6800/1064901393 9 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f751000a4d0 con 0x555dd9c490c0 2024-09-22T08:36:41.608 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.589+0000 7f7518cde640 1 -- 172.21.15.142:0/1713481147 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555dd9c4d3f0 con 0x7f7508017050 2024-09-22T08:36:41.608 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.590+0000 7f750fcdc640 1 -- 172.21.15.142:0/1713481147 <== osd.0 v2:172.21.15.31:6800/168281188 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7500051070 con 0x7f7508017050 2024-09-22T08:36:41.608 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.590+0000 7f750fcdc640 1 -- 172.21.15.142:0/1713481147 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555dd9c4d3f0 con 0x7f7510012c00 2024-09-22T08:36:41.608 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.590+0000 7f75184dd640 1 -- 172.21.15.142:0/1713481147 <== osd.2 v2:172.21.15.142:6808/279438927 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7508018ce0 con 0x7f7510012c00 2024-09-22T08:36:41.608 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.590+0000 7f75184dd640 1 -- 172.21.15.142:0/1713481147 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555dd9c4d3f0 con 0x555dd9c490c0 2024-09-22T08:36:41.608 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.590+0000 7f7518cde640 1 -- 172.21.15.142:0/1713481147 <== osd.3 v2:172.21.15.142:6800/1064901393 10 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f751000a4d0 con 0x555dd9c490c0 2024-09-22T08:36:41.608 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.590+0000 7f7518cde640 1 -- 172.21.15.142:0/1713481147 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555dd9c4d3f0 con 0x7f7508017050 2024-09-22T08:36:41.608 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.590+0000 7f750fcdc640 1 -- 172.21.15.142:0/1713481147 <== osd.0 v2:172.21.15.31:6800/168281188 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7500051070 con 0x7f7508017050 2024-09-22T08:36:41.608 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.590+0000 7f750fcdc640 1 -- 172.21.15.142:0/1713481147 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555dd9c4d3f0 con 0x555dd9c446b0 2024-09-22T08:36:41.608 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.591+0000 7f750fcdc640 1 -- 172.21.15.142:0/1713481147 <== osd.1 v2:172.21.15.142:6816/3192108003 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f7500051070 con 0x555dd9c446b0 2024-09-22T08:36:41.608 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.591+0000 7f750fcdc640 1 -- 172.21.15.142:0/1713481147 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555dd9c4d3f0 con 0x7f7510012c00 2024-09-22T08:36:41.608 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.591+0000 7f75184dd640 1 -- 172.21.15.142:0/1713481147 <== osd.2 v2:172.21.15.142:6808/279438927 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7508018ce0 con 0x7f7510012c00 2024-09-22T08:36:41.609 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.591+0000 7f751c72e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:36:41.609 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.591+0000 7f751c72e800 20 RGWRados::pool_iterate: got zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec 2024-09-22T08:36:41.609 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.591+0000 7f751c72e800 20 RGWRados::pool_iterate: got zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f 2024-09-22T08:36:41.609 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.591+0000 7f751c72e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:36:41.609 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.591+0000 7f751c72e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:36:41.609 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.591+0000 7f751c72e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:36:41.609 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.591+0000 7f751c72e800 20 rados->read ofs=0 len=0 2024-09-22T08:36:41.609 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.591+0000 7f751c72e800 1 -- 172.21.15.142:0/1713481147 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x555dd9c4c480 con 0x555dd9c446b0 2024-09-22T08:36:41.609 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.591+0000 7f750fcdc640 1 -- 172.21.15.142:0/1713481147 <== osd.1 v2:172.21.15.142:6816/3192108003 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7500051070 con 0x555dd9c446b0 2024-09-22T08:36:41.609 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.591+0000 7f751c72e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:41.609 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.591+0000 7f751c72e800 20 rados->read ofs=0 len=0 2024-09-22T08:36:41.609 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.591+0000 7f751c72e800 1 -- 172.21.15.142:0/1713481147 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x555dd9c4ccd0 con 0x555dd9c446b0 2024-09-22T08:36:41.609 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.591+0000 7f750fcdc640 1 -- 172.21.15.142:0/1713481147 <== osd.1 v2:172.21.15.142:6816/3192108003 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7500051070 con 0x555dd9c446b0 2024-09-22T08:36:41.610 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.591+0000 7f751c72e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:36:41.610 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.591+0000 7f751c72e800 20 rados->read ofs=0 len=0 2024-09-22T08:36:41.610 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.592+0000 7f751c72e800 1 -- 172.21.15.142:0/1713481147 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:40 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x555dd9c4d870 con 0x555dd9c490c0 2024-09-22T08:36:41.610 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.592+0000 7f7518cde640 1 -- 172.21.15.142:0/1713481147 <== osd.3 v2:172.21.15.142:6800/1064901393 11 ==== osd_op_reply(40 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f751000a4d0 con 0x555dd9c490c0 2024-09-22T08:36:41.610 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.592+0000 7f751c72e800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:36:41.610 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.592+0000 7f751c72e800 20 zone default found 2024-09-22T08:36:41.610 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.592+0000 7f751c72e800 4 Realm: () 2024-09-22T08:36:41.610 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.592+0000 7f751c72e800 4 ZoneGroup: default (d89f6f57-1007-47dd-9065-f486c7b01aec) 2024-09-22T08:36:41.610 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.592+0000 7f751c72e800 4 Zone: default (e239248c-0bee-4e41-803a-24b288d3eb8f) 2024-09-22T08:36:41.610 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.592+0000 7f751c72e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:36:41.610 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.592+0000 7f751c72e800 20 zonegroup default 2024-09-22T08:36:41.610 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.592+0000 7f751c72e800 20 rados->read ofs=0 len=0 2024-09-22T08:36:41.610 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.592+0000 7f751c72e800 1 -- 172.21.15.142:0/1713481147 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x555dd9c4dc50 con 0x7f7508017050 2024-09-22T08:36:41.611 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.592+0000 7f750fcdc640 1 -- 172.21.15.142:0/1713481147 <== osd.0 v2:172.21.15.31:6800/168281188 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f7500051070 con 0x7f7508017050 2024-09-22T08:36:41.611 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.592+0000 7f751c72e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:41.611 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.592+0000 7f751c72e800 20 rados->read ofs=0 len=0 2024-09-22T08:36:41.611 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.592+0000 7f751c72e800 1 -- 172.21.15.142:0/1713481147 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x555dd9c4ff30 con 0x555dd9c490c0 2024-09-22T08:36:41.611 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.592+0000 7f7518cde640 1 -- 172.21.15.142:0/1713481147 <== osd.3 v2:172.21.15.142:6800/1064901393 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f751000a4d0 con 0x555dd9c490c0 2024-09-22T08:36:41.611 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.592+0000 7f751c72e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:41.611 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.592+0000 7f751c72e800 20 rados->read ofs=0 len=0 2024-09-22T08:36:41.611 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.592+0000 7f751c72e800 1 -- 172.21.15.142:0/1713481147 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x555dd9c50320 con 0x555dd9c490c0 2024-09-22T08:36:41.611 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.593+0000 7f7518cde640 1 -- 172.21.15.142:0/1713481147 <== osd.3 v2:172.21.15.142:6800/1064901393 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f751000a4d0 con 0x555dd9c490c0 2024-09-22T08:36:41.611 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.593+0000 7f751c72e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:41.611 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.593+0000 7f751c72e800 20 started sync module instance, tier type = 2024-09-22T08:36:41.611 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.593+0000 7f751c72e800 20 started zone id=e239248c-0bee-4e41-803a-24b288d3eb8f (name=default) with tier type = 2024-09-22T08:36:41.611 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.593+0000 7f751c72e800 1 -- 172.21.15.142:0/1713481147 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555dd9c4f3c0 con 0x7f7510012c00 2024-09-22T08:36:41.612 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.594+0000 7f75184dd640 1 -- 172.21.15.142:0/1713481147 <== osd.2 v2:172.21.15.142:6808/279438927 7 ==== osd_op_reply(44 notify.0 [create] v30'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7508018ce0 con 0x7f7510012c00 2024-09-22T08:36:41.612 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.594+0000 7f751c72e800 1 -- 172.21.15.142:0/1713481147 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93861573883824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555dd9c50c30 con 0x7f7510012c00 2024-09-22T08:36:41.612 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.594+0000 7f751c72e800 1 -- 172.21.15.142:0/1713481147 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555dd9c51480 con 0x555dd9c446b0 2024-09-22T08:36:41.612 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.595+0000 7f75184dd640 1 -- 172.21.15.142:0/1713481147 <== osd.2 v2:172.21.15.142:6808/279438927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93861573883824] v30'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7508018ce0 con 0x7f7510012c00 2024-09-22T08:36:41.612 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.595+0000 7f750fcdc640 1 -- 172.21.15.142:0/1713481147 <== osd.1 v2:172.21.15.142:6816/3192108003 15 ==== osd_op_reply(46 notify.1 [create] v30'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7500051070 con 0x555dd9c446b0 2024-09-22T08:36:41.612 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.595+0000 7f751c72e800 1 -- 172.21.15.142:0/1713481147 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93861573887872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555dd9c51480 con 0x555dd9c446b0 2024-09-22T08:36:41.612 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.595+0000 7f751c72e800 1 -- 172.21.15.142:0/1713481147 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555dd9c51f40 con 0x555dd9c490c0 2024-09-22T08:36:41.616 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.597+0000 7f750fcdc640 1 -- 172.21.15.142:0/1713481147 <== osd.1 v2:172.21.15.142:6816/3192108003 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93861573887872] v30'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7500051070 con 0x555dd9c446b0 2024-09-22T08:36:41.617 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.597+0000 7f7518cde640 1 -- 172.21.15.142:0/1713481147 <== osd.3 v2:172.21.15.142:6800/1064901393 14 ==== osd_op_reply(48 notify.2 [create] v30'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f751000a4d0 con 0x555dd9c490c0 2024-09-22T08:36:41.617 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.597+0000 7f751c72e800 1 -- 172.21.15.142:0/1713481147 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93861573892624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555dd9c51480 con 0x555dd9c490c0 2024-09-22T08:36:41.617 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.597+0000 7f751c72e800 1 -- 172.21.15.142:0/1713481147 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555dd9c529d0 con 0x7f7510012c00 2024-09-22T08:36:41.617 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.598+0000 7f7518cde640 1 -- 172.21.15.142:0/1713481147 <== osd.3 v2:172.21.15.142:6800/1064901393 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 93861573892624] v30'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f751000a4d0 con 0x555dd9c490c0 2024-09-22T08:36:41.617 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.598+0000 7f75184dd640 1 -- 172.21.15.142:0/1713481147 <== osd.2 v2:172.21.15.142:6808/279438927 9 ==== osd_op_reply(50 notify.3 [create] v30'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7508018ce0 con 0x7f7510012c00 2024-09-22T08:36:41.617 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.598+0000 7f751c72e800 1 -- 172.21.15.142:0/1713481147 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93861573890000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555dd9c513f0 con 0x7f7510012c00 2024-09-22T08:36:41.617 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.598+0000 7f751c72e800 1 -- 172.21.15.142:0/1713481147 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555dd9c53890 con 0x555dd9c446b0 2024-09-22T08:36:41.617 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.599+0000 7f750fcdc640 1 -- 172.21.15.142:0/1713481147 <== osd.1 v2:172.21.15.142:6816/3192108003 17 ==== osd_op_reply(52 notify.4 [create] v30'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7500051070 con 0x555dd9c446b0 2024-09-22T08:36:41.617 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.599+0000 7f751c72e800 1 -- 172.21.15.142:0/1713481147 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93861573899232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555dd9c53840 con 0x555dd9c446b0 2024-09-22T08:36:41.617 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.600+0000 7f751c72e800 1 -- 172.21.15.142:0/1713481147 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555dd9c54800 con 0x7f7508017050 2024-09-22T08:36:41.617 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.600+0000 7f75184dd640 1 -- 172.21.15.142:0/1713481147 <== osd.2 v2:172.21.15.142:6808/279438927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93861573890000] v30'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7508018ce0 con 0x7f7510012c00 2024-09-22T08:36:41.617 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.601+0000 7f750fcdc640 1 -- 172.21.15.142:0/1713481147 <== osd.0 v2:172.21.15.31:6800/168281188 11 ==== osd_op_reply(54 notify.5 [create] v30'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7500051070 con 0x7f7508017050 2024-09-22T08:36:41.617 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.601+0000 7f751c72e800 1 -- 172.21.15.142:0/1713481147 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93861573903056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555dd9c547c0 con 0x7f7508017050 2024-09-22T08:36:41.618 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.601+0000 7f751c72e800 1 -- 172.21.15.142:0/1713481147 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555dd9c55290 con 0x7f7508017050 2024-09-22T08:36:41.618 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.601+0000 7f750fcdc640 1 -- 172.21.15.142:0/1713481147 <== osd.1 v2:172.21.15.142:6816/3192108003 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93861573899232] v30'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7500051070 con 0x555dd9c446b0 2024-09-22T08:36:41.618 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.602+0000 7f750fcdc640 1 -- 172.21.15.142:0/1713481147 <== osd.0 v2:172.21.15.31:6800/168281188 12 ==== osd_op_reply(56 notify.6 [create] v30'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7500051070 con 0x7f7508017050 2024-09-22T08:36:41.618 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.602+0000 7f751c72e800 1 -- 172.21.15.142:0/1713481147 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93861573901440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555dd9c55290 con 0x7f7508017050 2024-09-22T08:36:41.618 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.602+0000 7f751c72e800 1 -- 172.21.15.142:0/1713481147 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555dd9c55c90 con 0x7f7508017050 2024-09-22T08:36:41.618 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.603+0000 7f750fcdc640 1 -- 172.21.15.142:0/1713481147 <== osd.0 v2:172.21.15.31:6800/168281188 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93861573903056] v30'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7500051070 con 0x7f7508017050 2024-09-22T08:36:41.618 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.603+0000 7f750fcdc640 1 -- 172.21.15.142:0/1713481147 <== osd.0 v2:172.21.15.31:6800/168281188 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93861573901440] v30'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7500051070 con 0x7f7508017050 2024-09-22T08:36:41.618 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.603+0000 7f750fcdc640 1 -- 172.21.15.142:0/1713481147 <== osd.0 v2:172.21.15.31:6800/168281188 15 ==== osd_op_reply(58 notify.7 [create] v30'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7500051070 con 0x7f7508017050 2024-09-22T08:36:41.618 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.603+0000 7f751c72e800 1 -- 172.21.15.142:0/1713481147 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93861573897664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555dd9c557a0 con 0x7f7508017050 2024-09-22T08:36:41.618 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.603+0000 7f751c72e800 20 add_watcher() i=0 2024-09-22T08:36:41.618 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.603+0000 7f751c72e800 20 add_watcher() i=1 2024-09-22T08:36:41.618 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.603+0000 7f751c72e800 20 add_watcher() i=2 2024-09-22T08:36:41.618 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.603+0000 7f751c72e800 20 add_watcher() i=3 2024-09-22T08:36:41.619 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.603+0000 7f751c72e800 20 add_watcher() i=4 2024-09-22T08:36:41.619 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.603+0000 7f751c72e800 20 add_watcher() i=5 2024-09-22T08:36:41.619 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.603+0000 7f751c72e800 20 add_watcher() i=6 2024-09-22T08:36:41.619 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.604+0000 7f750fcdc640 1 -- 172.21.15.142:0/1713481147 <== osd.0 v2:172.21.15.31:6800/168281188 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93861573897664] v30'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7500051070 con 0x7f7508017050 2024-09-22T08:36:41.619 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.604+0000 7f751c72e800 20 add_watcher() i=7 2024-09-22T08:36:41.619 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.604+0000 7f751c72e800 2 all 8 watchers are set, enabling cache 2024-09-22T08:36:41.619 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.604+0000 7f751c72e800 1 -- 172.21.15.142:0/1713481147 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x555dd9c58c80 con 0x555dd9c446b0 2024-09-22T08:36:41.619 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.604+0000 7f750fcdc640 1 -- 172.21.15.142:0/1713481147 <== osd.1 v2:172.21.15.142:6816/3192108003 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f7500051070 con 0x555dd9c446b0 2024-09-22T08:36:41.619 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.604+0000 7f751c72e800 1 -- 172.21.15.142:0/1713481147 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93861573908384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555dd9c561c0 con 0x555dd9c446b0 2024-09-22T08:36:41.619 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.605+0000 7f750fcdc640 1 -- 172.21.15.142:0/1713481147 <== osd.1 v2:172.21.15.142:6816/3192108003 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93861573908384] v30'26 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7500051070 con 0x555dd9c446b0 2024-09-22T08:36:41.619 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.605+0000 7f73ce7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:36:41.619 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.606+0000 7f751c72e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:36:41.619 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.606+0000 7f751c72e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:36:41.619 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.606+0000 7f751c72e800 1 -- 172.21.15.142:0/1713481147 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555dd9c61720 con 0x555dd9c446b0 2024-09-22T08:36:41.620 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.607+0000 7f750fcdc640 1 -- 172.21.15.142:0/1713481147 <== osd.1 v2:172.21.15.142:6816/3192108003 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v30'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7500051070 con 0x555dd9c446b0 2024-09-22T08:36:41.620 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.607+0000 7f751c72e800 1 -- 172.21.15.142:0/1713481147 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555dd9c61db0 con 0x7f7508017050 2024-09-22T08:36:41.620 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.608+0000 7f750fcdc640 1 -- 172.21.15.142:0/1713481147 <== osd.0 v2:172.21.15.31:6800/168281188 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v30'10 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7500051070 con 0x7f7508017050 2024-09-22T08:36:41.620 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.608+0000 7f751c72e800 1 -- 172.21.15.142:0/1713481147 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555dd9c62320 con 0x555dd9c490c0 2024-09-22T08:36:41.620 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.609+0000 7f7518cde640 1 -- 172.21.15.142:0/1713481147 <== osd.3 v2:172.21.15.142:6800/1064901393 16 ==== osd_op_reply(64 gc.2 [create,call,call,call] v30'10 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f751000a4d0 con 0x555dd9c490c0 2024-09-22T08:36:41.620 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.609+0000 7f751c72e800 1 -- 172.21.15.142:0/1713481147 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555dd9c62320 con 0x555dd9c446b0 2024-09-22T08:36:41.620 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.610+0000 7f750fcdc640 1 -- 172.21.15.142:0/1713481147 <== osd.1 v2:172.21.15.142:6816/3192108003 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v30'27 uv15 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7500051070 con 0x555dd9c446b0 2024-09-22T08:36:41.620 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.610+0000 7f751c72e800 1 -- 172.21.15.142:0/1713481147 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555dd9c62320 con 0x7f7510012c00 2024-09-22T08:36:41.620 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.611+0000 7f75184dd640 1 -- 172.21.15.142:0/1713481147 <== osd.2 v2:172.21.15.142:6808/279438927 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v30'20 uv13 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7508018ce0 con 0x7f7510012c00 2024-09-22T08:36:41.620 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.611+0000 7f751c72e800 1 -- 172.21.15.142:0/1713481147 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555dd9c62970 con 0x555dd9c490c0 2024-09-22T08:36:41.620 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.612+0000 7f7518cde640 1 -- 172.21.15.142:0/1713481147 <== osd.3 v2:172.21.15.142:6800/1064901393 17 ==== osd_op_reply(67 gc.5 [create,call,call,call] v30'13 uv10 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f751000a4d0 con 0x555dd9c490c0 2024-09-22T08:36:41.620 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.612+0000 7f751c72e800 1 -- 172.21.15.142:0/1713481147 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555dd9c62930 con 0x555dd9c446b0 2024-09-22T08:36:41.620 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.613+0000 7f750fcdc640 1 -- 172.21.15.142:0/1713481147 <== osd.1 v2:172.21.15.142:6816/3192108003 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v30'12 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7500051070 con 0x555dd9c446b0 2024-09-22T08:36:41.621 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.613+0000 7f751c72e800 1 -- 172.21.15.142:0/1713481147 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555dd9c62900 con 0x7f7508017050 2024-09-22T08:36:41.621 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.614+0000 7f750fcdc640 1 -- 172.21.15.142:0/1713481147 <== osd.0 v2:172.21.15.31:6800/168281188 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v30'13 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7500051070 con 0x7f7508017050 2024-09-22T08:36:41.621 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.614+0000 7f751c72e800 1 -- 172.21.15.142:0/1713481147 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555dd9c62990 con 0x7f7510012c00 2024-09-22T08:36:41.622 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.615+0000 7f75184dd640 1 -- 172.21.15.142:0/1713481147 <== osd.2 v2:172.21.15.142:6808/279438927 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v30'10 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7508018ce0 con 0x7f7510012c00 2024-09-22T08:36:41.622 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.615+0000 7f751c72e800 1 -- 172.21.15.142:0/1713481147 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555dd9c62f40 con 0x555dd9c490c0 2024-09-22T08:36:41.622 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.616+0000 7f7518cde640 1 -- 172.21.15.142:0/1713481147 <== osd.3 v2:172.21.15.142:6800/1064901393 18 ==== osd_op_reply(71 gc.9 [create,call,call,call] v30'16 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f751000a4d0 con 0x555dd9c490c0 2024-09-22T08:36:41.622 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.616+0000 7f751c72e800 1 -- 172.21.15.142:0/1713481147 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555dd9c62f20 con 0x7f7510012c00 2024-09-22T08:36:41.622 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.617+0000 7f75184dd640 1 -- 172.21.15.142:0/1713481147 <== osd.2 v2:172.21.15.142:6808/279438927 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v30'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7508018ce0 con 0x7f7510012c00 2024-09-22T08:36:41.622 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.617+0000 7f751c72e800 1 -- 172.21.15.142:0/1713481147 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555dd9c62f20 con 0x7f7508017050 2024-09-22T08:36:41.622 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.618+0000 7f750fcdc640 1 -- 172.21.15.142:0/1713481147 <== osd.0 v2:172.21.15.31:6800/168281188 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v30'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7500051070 con 0x7f7508017050 2024-09-22T08:36:41.623 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.618+0000 7f751c72e800 1 -- 172.21.15.142:0/1713481147 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555dd9c62f20 con 0x7f7510012c00 2024-09-22T08:36:41.623 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.619+0000 7f75184dd640 1 -- 172.21.15.142:0/1713481147 <== osd.2 v2:172.21.15.142:6808/279438927 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v30'10 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7508018ce0 con 0x7f7510012c00 2024-09-22T08:36:41.623 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.619+0000 7f751c72e800 1 -- 172.21.15.142:0/1713481147 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555dd9c62f20 con 0x7f7508017050 2024-09-22T08:36:41.623 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.621+0000 7f750fcdc640 1 -- 172.21.15.142:0/1713481147 <== osd.0 v2:172.21.15.31:6800/168281188 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v30'19 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7500051070 con 0x7f7508017050 2024-09-22T08:36:41.624 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.621+0000 7f751c72e800 1 -- 172.21.15.142:0/1713481147 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555dd9c62f20 con 0x555dd9c446b0 2024-09-22T08:36:41.624 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.621+0000 7f750fcdc640 1 -- 172.21.15.142:0/1713481147 <== osd.1 v2:172.21.15.142:6816/3192108003 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v30'28 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7500051070 con 0x555dd9c446b0 2024-09-22T08:36:41.624 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.621+0000 7f751c72e800 1 -- 172.21.15.142:0/1713481147 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555dd9c62f20 con 0x555dd9c490c0 2024-09-22T08:36:41.625 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.623+0000 7f7518cde640 1 -- 172.21.15.142:0/1713481147 <== osd.3 v2:172.21.15.142:6800/1064901393 19 ==== osd_op_reply(77 gc.15 [create,call,call,call] v30'14 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f751000a4d0 con 0x555dd9c490c0 2024-09-22T08:36:41.625 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.623+0000 7f751c72e800 1 -- 172.21.15.142:0/1713481147 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555dd9c62ed0 con 0x7f7510012c00 2024-09-22T08:36:41.626 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.624+0000 7f75184dd640 1 -- 172.21.15.142:0/1713481147 <== osd.2 v2:172.21.15.142:6808/279438927 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v30'22 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7508018ce0 con 0x7f7510012c00 2024-09-22T08:36:41.626 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.624+0000 7f751c72e800 1 -- 172.21.15.142:0/1713481147 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555dd9c62ed0 con 0x555dd9c490c0 2024-09-22T08:36:41.627 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.624+0000 7f7518cde640 1 -- 172.21.15.142:0/1713481147 <== osd.3 v2:172.21.15.142:6800/1064901393 20 ==== osd_op_reply(79 gc.17 [create,call,call,call] v30'10 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f751000a4d0 con 0x555dd9c490c0 2024-09-22T08:36:41.627 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.625+0000 7f751c72e800 1 -- 172.21.15.142:0/1713481147 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555dd9c62ed0 con 0x555dd9c446b0 2024-09-22T08:36:41.628 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.626+0000 7f750fcdc640 1 -- 172.21.15.142:0/1713481147 <== osd.1 v2:172.21.15.142:6816/3192108003 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v30'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7500051070 con 0x555dd9c446b0 2024-09-22T08:36:41.628 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.626+0000 7f751c72e800 1 -- 172.21.15.142:0/1713481147 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555dd9c62ed0 con 0x555dd9c446b0 2024-09-22T08:36:41.629 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.627+0000 7f750fcdc640 1 -- 172.21.15.142:0/1713481147 <== osd.1 v2:172.21.15.142:6816/3192108003 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v30'29 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7500051070 con 0x555dd9c446b0 2024-09-22T08:36:41.629 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.627+0000 7f751c72e800 1 -- 172.21.15.142:0/1713481147 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555dd9c62ed0 con 0x555dd9c490c0 2024-09-22T08:36:41.630 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.628+0000 7f7518cde640 1 -- 172.21.15.142:0/1713481147 <== osd.3 v2:172.21.15.142:6800/1064901393 21 ==== osd_op_reply(82 gc.20 [create,call,call,call] v30'15 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f751000a4d0 con 0x555dd9c490c0 2024-09-22T08:36:41.630 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.628+0000 7f751c72e800 1 -- 172.21.15.142:0/1713481147 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555dd9c62ed0 con 0x7f7510012c00 2024-09-22T08:36:41.631 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.629+0000 7f75184dd640 1 -- 172.21.15.142:0/1713481147 <== osd.2 v2:172.21.15.142:6808/279438927 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v30'20 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7508018ce0 con 0x7f7510012c00 2024-09-22T08:36:41.631 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.629+0000 7f751c72e800 1 -- 172.21.15.142:0/1713481147 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555dd9c62ed0 con 0x555dd9c490c0 2024-09-22T08:36:41.632 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.630+0000 7f7518cde640 1 -- 172.21.15.142:0/1713481147 <== osd.3 v2:172.21.15.142:6800/1064901393 22 ==== osd_op_reply(84 gc.22 [create,call,call,call] v30'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f751000a4d0 con 0x555dd9c490c0 2024-09-22T08:36:41.632 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.630+0000 7f751c72e800 1 -- 172.21.15.142:0/1713481147 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555dd9c62f10 con 0x555dd9c490c0 2024-09-22T08:36:41.632 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.630+0000 7f7518cde640 1 -- 172.21.15.142:0/1713481147 <== osd.3 v2:172.21.15.142:6800/1064901393 23 ==== osd_op_reply(85 gc.23 [create,call,call,call] v30'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f751000a4d0 con 0x555dd9c490c0 2024-09-22T08:36:41.633 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.630+0000 7f751c72e800 1 -- 172.21.15.142:0/1713481147 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555dd9c63670 con 0x555dd9c490c0 2024-09-22T08:36:41.633 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.631+0000 7f7518cde640 1 -- 172.21.15.142:0/1713481147 <== osd.3 v2:172.21.15.142:6800/1064901393 24 ==== osd_op_reply(86 gc.24 [create,call,call,call] v30'6 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f751000a4d0 con 0x555dd9c490c0 2024-09-22T08:36:41.633 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.631+0000 7f751c72e800 1 -- 172.21.15.142:0/1713481147 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555dd9c633c0 con 0x555dd9c490c0 2024-09-22T08:36:41.634 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.632+0000 7f7518cde640 1 -- 172.21.15.142:0/1713481147 <== osd.3 v2:172.21.15.142:6800/1064901393 25 ==== osd_op_reply(87 gc.25 [create,call,call,call] v30'14 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f751000a4d0 con 0x555dd9c490c0 2024-09-22T08:36:41.634 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.632+0000 7f751c72e800 1 -- 172.21.15.142:0/1713481147 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555dd9c633e0 con 0x7f7508017050 2024-09-22T08:36:41.635 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.633+0000 7f750fcdc640 1 -- 172.21.15.142:0/1713481147 <== osd.0 v2:172.21.15.31:6800/168281188 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v30'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7500051070 con 0x7f7508017050 2024-09-22T08:36:41.635 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.633+0000 7f751c72e800 1 -- 172.21.15.142:0/1713481147 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555dd9c63420 con 0x555dd9c490c0 2024-09-22T08:36:41.636 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.634+0000 7f7518cde640 1 -- 172.21.15.142:0/1713481147 <== osd.3 v2:172.21.15.142:6800/1064901393 26 ==== osd_op_reply(89 gc.27 [create,call,call,call] v30'10 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f751000a4d0 con 0x555dd9c490c0 2024-09-22T08:36:41.636 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.634+0000 7f751c72e800 1 -- 172.21.15.142:0/1713481147 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555dd9c63420 con 0x7f7508017050 2024-09-22T08:36:41.637 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.635+0000 7f750fcdc640 1 -- 172.21.15.142:0/1713481147 <== osd.0 v2:172.21.15.31:6800/168281188 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v30'14 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7500051070 con 0x7f7508017050 2024-09-22T08:36:41.638 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.636+0000 7f751c72e800 1 -- 172.21.15.142:0/1713481147 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555dd9c63420 con 0x555dd9c490c0 2024-09-22T08:36:41.639 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.637+0000 7f7518cde640 1 -- 172.21.15.142:0/1713481147 <== osd.3 v2:172.21.15.142:6800/1064901393 27 ==== osd_op_reply(91 gc.29 [create,call,call,call] v30'16 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f751000a4d0 con 0x555dd9c490c0 2024-09-22T08:36:41.639 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.637+0000 7f751c72e800 1 -- 172.21.15.142:0/1713481147 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555dd9c63420 con 0x7f7508017050 2024-09-22T08:36:41.640 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.638+0000 7f750fcdc640 1 -- 172.21.15.142:0/1713481147 <== osd.0 v2:172.21.15.31:6800/168281188 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v30'20 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7500051070 con 0x7f7508017050 2024-09-22T08:36:41.640 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.638+0000 7f751c72e800 1 -- 172.21.15.142:0/1713481147 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555dd9c63460 con 0x7f7510012c00 2024-09-22T08:36:41.643 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.639+0000 7f75184dd640 1 -- 172.21.15.142:0/1713481147 <== osd.2 v2:172.21.15.142:6808/279438927 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v30'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7508018ce0 con 0x7f7510012c00 2024-09-22T08:36:41.643 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.639+0000 7f73cd7e2640 20 reqs_thread_entry: start 2024-09-22T08:36:41.643 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.639+0000 7f751c72e800 20 init_complete bucket index max shards: 11 2024-09-22T08:36:41.644 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.639+0000 7f751c72e800 20 Filter name: none 2024-09-22T08:36:41.644 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.639+0000 7f733effd640 20 reqs_thread_entry: start 2024-09-22T08:36:41.644 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.639+0000 7f751c72e800 10 cache get: name=default.rgw.meta+users.uid+bud : miss 2024-09-22T08:36:41.644 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.639+0000 7f751c72e800 20 rados->read ofs=0 len=0 2024-09-22T08:36:41.644 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.639+0000 7f751c72e800 1 -- 172.21.15.142:0/1713481147 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:94 8.4 8:267425a8:users.uid::bud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x555dd9c8e380 con 0x7f7510012c00 2024-09-22T08:36:41.644 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.640+0000 7f75184dd640 1 -- 172.21.15.142:0/1713481147 <== osd.2 v2:172.21.15.142:6808/279438927 18 ==== osd_op_reply(94 bud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f7508018ce0 con 0x7f7510012c00 2024-09-22T08:36:41.644 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.640+0000 7f751c72e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:41.644 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.640+0000 7f751c72e800 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x0 2024-09-22T08:36:41.644 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.640+0000 7f751c72e800 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-09-22T08:36:41.644 INFO:teuthology.orchestra.run.smithi142.stderr:could not remove user: unable to remove user, user does not exist 2024-09-22T08:36:41.644 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.640+0000 7f73ce7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:36:41.644 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.640+0000 7f751c72e800 1 -- 172.21.15.142:0/1713481147 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93861573908384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555dd9c57d10 con 0x555dd9c446b0 2024-09-22T08:36:41.645 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.641+0000 7f750fcdc640 1 -- 172.21.15.142:0/1713481147 <== osd.1 v2:172.21.15.142:6816/3192108003 27 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 93861573908384] v30'30 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7500051070 con 0x555dd9c446b0 2024-09-22T08:36:41.645 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.641+0000 7f751c72e800 1 -- 172.21.15.142:0/1713481147 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93861573883824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555dd9c557a0 con 0x7f7510012c00 2024-09-22T08:36:41.645 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.642+0000 7f75184dd640 1 -- 172.21.15.142:0/1713481147 <== osd.2 v2:172.21.15.142:6808/279438927 19 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 93861573883824] v30'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7508018ce0 con 0x7f7510012c00 2024-09-22T08:36:41.646 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.642+0000 7f751c72e800 20 remove_watcher() i=0 2024-09-22T08:36:41.646 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.642+0000 7f751c72e800 2 removed watcher, disabling cache 2024-09-22T08:36:41.646 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.642+0000 7f751c72e800 1 -- 172.21.15.142:0/1713481147 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93861573887872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555dd9c4f7b0 con 0x555dd9c446b0 2024-09-22T08:36:41.646 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.643+0000 7f750fcdc640 1 -- 172.21.15.142:0/1713481147 <== osd.1 v2:172.21.15.142:6816/3192108003 28 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 93861573887872] v30'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7500051070 con 0x555dd9c446b0 2024-09-22T08:36:41.646 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.643+0000 7f751c72e800 20 remove_watcher() i=1 2024-09-22T08:36:41.646 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.643+0000 7f751c72e800 1 -- 172.21.15.142:0/1713481147 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93861573892624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555dd9c4f7b0 con 0x555dd9c490c0 2024-09-22T08:36:41.647 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.645+0000 7f7518cde640 1 -- 172.21.15.142:0/1713481147 <== osd.3 v2:172.21.15.142:6800/1064901393 28 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 93861573892624] v30'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f751000a4d0 con 0x555dd9c490c0 2024-09-22T08:36:41.647 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.645+0000 7f751c72e800 20 remove_watcher() i=2 2024-09-22T08:36:41.647 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.645+0000 7f751c72e800 1 -- 172.21.15.142:0/1713481147 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93861573890000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555dd9c51a10 con 0x7f7510012c00 2024-09-22T08:36:41.648 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.646+0000 7f75184dd640 1 -- 172.21.15.142:0/1713481147 <== osd.2 v2:172.21.15.142:6808/279438927 20 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 93861573890000] v30'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7508018ce0 con 0x7f7510012c00 2024-09-22T08:36:41.648 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.646+0000 7f751c72e800 20 remove_watcher() i=3 2024-09-22T08:36:41.648 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.646+0000 7f751c72e800 1 -- 172.21.15.142:0/1713481147 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93861573899232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555dd9c4f7b0 con 0x555dd9c446b0 2024-09-22T08:36:41.649 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.647+0000 7f750fcdc640 1 -- 172.21.15.142:0/1713481147 <== osd.1 v2:172.21.15.142:6816/3192108003 29 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 93861573899232] v30'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7500051070 con 0x555dd9c446b0 2024-09-22T08:36:41.649 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.647+0000 7f751c72e800 20 remove_watcher() i=4 2024-09-22T08:36:41.649 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.647+0000 7f751c72e800 1 -- 172.21.15.142:0/1713481147 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93861573903056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555dd9c50fd0 con 0x7f7508017050 2024-09-22T08:36:41.650 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.648+0000 7f750fcdc640 1 -- 172.21.15.142:0/1713481147 <== osd.0 v2:172.21.15.31:6800/168281188 24 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 93861573903056] v30'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7500051070 con 0x7f7508017050 2024-09-22T08:36:41.650 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.648+0000 7f751c72e800 20 remove_watcher() i=5 2024-09-22T08:36:41.650 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.648+0000 7f751c72e800 1 -- 172.21.15.142:0/1713481147 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93861573901440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555dd9c51a10 con 0x7f7508017050 2024-09-22T08:36:41.651 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.649+0000 7f750fcdc640 1 -- 172.21.15.142:0/1713481147 <== osd.0 v2:172.21.15.31:6800/168281188 25 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 93861573901440] v30'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7500051070 con 0x7f7508017050 2024-09-22T08:36:41.651 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.649+0000 7f751c72e800 20 remove_watcher() i=6 2024-09-22T08:36:41.651 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.649+0000 7f751c72e800 1 -- 172.21.15.142:0/1713481147 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93861573897664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555dd9c4f7b0 con 0x7f7508017050 2024-09-22T08:36:41.655 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.650+0000 7f750fcdc640 1 -- 172.21.15.142:0/1713481147 <== osd.0 v2:172.21.15.31:6800/168281188 26 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 93861573897664] v30'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7500051070 con 0x7f7508017050 2024-09-22T08:36:41.656 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.650+0000 7f751c72e800 20 remove_watcher() i=7 2024-09-22T08:36:41.656 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.650+0000 7f751c72e800 1 -- 172.21.15.142:0/1713481147 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f7508017050 msgr2=0x7f75080167e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:41.656 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.650+0000 7f751c72e800 1 --2- 172.21.15.142:0/1713481147 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f7508017050 0x7f75080167e0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:41.656 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.650+0000 7f751c72e800 1 -- 172.21.15.142:0/1713481147 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x555dd9c446b0 msgr2=0x555dd9c46b70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:41.656 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.650+0000 7f751c72e800 1 --2- 172.21.15.142:0/1713481147 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x555dd9c446b0 0x555dd9c46b70 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:41.656 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.650+0000 7f751c72e800 1 -- 172.21.15.142:0/1713481147 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f7510012c00 msgr2=0x7f7510054210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:41.657 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.650+0000 7f751c72e800 1 --2- 172.21.15.142:0/1713481147 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f7510012c00 0x7f7510054210 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:41.657 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.650+0000 7f751c72e800 1 -- 172.21.15.142:0/1713481147 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x555dd9c490c0 msgr2=0x555dd9c4b4b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:41.657 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.650+0000 7f751c72e800 1 --2- 172.21.15.142:0/1713481147 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x555dd9c490c0 0x555dd9c4b4b0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:41.657 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.650+0000 7f751c72e800 1 -- 172.21.15.142:0/1713481147 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f73e803cfb0 msgr2=0x7f73e803f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:41.657 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.650+0000 7f751c72e800 1 --2- 172.21.15.142:0/1713481147 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f73e803cfb0 0x7f73e803f470 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f7508052a10 tx=0x7f7508046000 comp rx=0 tx=0).stop 2024-09-22T08:36:41.657 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.650+0000 7f751c72e800 1 -- 172.21.15.142:0/1713481147 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555dd9c317d0 msgr2=0x555dd9c38d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:41.657 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.650+0000 7f750fcdc640 1 -- 172.21.15.142:0/1713481147 reap_dead start 2024-09-22T08:36:41.658 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.650+0000 7f751c72e800 1 --2- 172.21.15.142:0/1713481147 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555dd9c317d0 0x555dd9c38d50 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f75100147b0 tx=0x7f7510054840 comp rx=0 tx=0).stop 2024-09-22T08:36:41.658 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.650+0000 7f751c72e800 1 -- 172.21.15.142:0/1713481147 shutdown_connections 2024-09-22T08:36:41.658 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.650+0000 7f751c72e800 1 --2- 172.21.15.142:0/1713481147 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555dd9c317d0 0x555dd9c38d50 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:41.658 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.650+0000 7f751c72e800 1 -- 172.21.15.142:0/1713481147 >> 172.21.15.142:0/1713481147 conn(0x555dd9c2dbd0 msgr2=0x555dd9c2bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:41.658 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.650+0000 7f751c72e800 1 -- 172.21.15.142:0/1713481147 shutdown_connections 2024-09-22T08:36:41.658 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.650+0000 7f751c72e800 1 -- 172.21.15.142:0/1713481147 wait complete. 2024-09-22T08:36:41.658 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.650+0000 7f751c72e800 1 -- 172.21.15.142:0/1206416571 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f73f003cfb0 msgr2=0x7f73f003f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:41.658 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.650+0000 7f751c72e800 1 --2- 172.21.15.142:0/1206416571 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f73f003cfb0 0x7f73f003f470 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x555dd9c11a30 tx=0x7f7508052a40 comp rx=0 tx=0).stop 2024-09-22T08:36:41.658 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.650+0000 7f751c72e800 1 -- 172.21.15.142:0/1206416571 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555dd9c24d10 msgr2=0x555dd9c25130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:41.659 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.650+0000 7f751c72e800 1 --2- 172.21.15.142:0/1206416571 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555dd9c24d10 0x555dd9c25130 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x555dd9b10260 tx=0x7f75100167b0 comp rx=0 tx=0).stop 2024-09-22T08:36:41.659 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.650+0000 7f751c72e800 1 -- 172.21.15.142:0/1206416571 shutdown_connections 2024-09-22T08:36:41.659 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.650+0000 7f751c72e800 1 --2- 172.21.15.142:0/1206416571 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f73f003cfb0 0x7f73f003f470 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:41.659 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.650+0000 7f751c72e800 1 --2- 172.21.15.142:0/1206416571 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555dd9c24d10 0x555dd9c25130 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:41.659 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.650+0000 7f751c72e800 1 -- 172.21.15.142:0/1206416571 >> 172.21.15.142:0/1206416571 conn(0x555dd9c190c0 msgr2=0x555dd9c194a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:41.659 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.650+0000 7f751c72e800 1 -- 172.21.15.142:0/1206416571 shutdown_connections 2024-09-22T08:36:41.659 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.650+0000 7f751c72e800 1 -- 172.21.15.142:0/1206416571 wait complete. 2024-09-22T08:36:41.659 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.651+0000 7f751c72e800 1 -- 172.21.15.142:0/1152672228 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x555dd9b149d0 msgr2=0x555dd9c11040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:41.659 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.651+0000 7f751c72e800 1 --2- 172.21.15.142:0/1152672228 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x555dd9b149d0 0x555dd9c11040 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:41.660 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.651+0000 7f751c72e800 1 -- 172.21.15.142:0/1152672228 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x555dd9c138b0 msgr2=0x555dd9c15ca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:41.660 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.651+0000 7f751c72e800 1 --2- 172.21.15.142:0/1152672228 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x555dd9c138b0 0x555dd9c15ca0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:41.660 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.651+0000 7f751c72e800 1 -- 172.21.15.142:0/1152672228 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f740003cfb0 msgr2=0x7f740003f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:41.660 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.651+0000 7f751c72e800 1 --2- 172.21.15.142:0/1152672228 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f740003cfb0 0x7f740003f470 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f7500057000 tx=0x7f7500052000 comp rx=0 tx=0).stop 2024-09-22T08:36:41.660 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.651+0000 7f751c72e800 1 -- 172.21.15.142:0/1152672228 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555dd9a83d30 msgr2=0x555dd9b10830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:41.660 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.651+0000 7f751c72e800 1 --2- 172.21.15.142:0/1152672228 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555dd9a83d30 0x555dd9b10830 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f75080012b0 tx=0x7f7508000ed0 comp rx=0 tx=0).stop 2024-09-22T08:36:41.660 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.651+0000 7f751c72e800 1 -- 172.21.15.142:0/1152672228 shutdown_connections 2024-09-22T08:36:41.660 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.651+0000 7f751c72e800 1 --2- 172.21.15.142:0/1152672228 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x555dd9c138b0 0x555dd9c15ca0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:41.660 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.651+0000 7f751c72e800 1 --2- 172.21.15.142:0/1152672228 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x555dd9b149d0 0x555dd9c11040 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:41.660 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.651+0000 7f751c72e800 1 --2- 172.21.15.142:0/1152672228 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f740003cfb0 0x7f740003f470 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:41.660 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.651+0000 7f751c72e800 1 --2- 172.21.15.142:0/1152672228 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555dd9a83d30 0x555dd9b10830 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:41.660 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.651+0000 7f751c72e800 1 -- 172.21.15.142:0/1152672228 >> 172.21.15.142:0/1152672228 conn(0x555dd9b0abb0 msgr2=0x555dd9c01500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:41.660 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.651+0000 7f751c72e800 1 -- 172.21.15.142:0/1152672228 shutdown_connections 2024-09-22T08:36:41.661 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.651+0000 7f751c72e800 1 -- 172.21.15.142:0/1152672228 wait complete. 2024-09-22T08:36:41.661 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-22T08:36:41.662 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'bar'] 2024-09-22T08:36:41.662 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'bar'] 2024-09-22T08:36:41.662 DEBUG:teuthology.orchestra.run.smithi142:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid bar 2024-09-22T08:36:41.706 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:36:41.706 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:36:41.708 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.705+0000 7f88b420f800 1 Processor -- start 2024-09-22T08:36:41.708 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.705+0000 7f88b420f800 1 -- start start 2024-09-22T08:36:41.708 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.705+0000 7f88b420f800 1 --2- >> v2:172.21.15.31:3300/0 conn(0x561a6da3f8e0 0x561a6da41da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:41.708 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.705+0000 7f88b420f800 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x561a6d8c7a20 con 0x561a6da3bc60 2024-09-22T08:36:41.708 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.705+0000 7f88b420f800 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x561a6d8c77d0 con 0x561a6da3f8e0 2024-09-22T08:36:41.708 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.705+0000 7f88abfff640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x561a6da3f8e0 0x561a6da41da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:41.708 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.705+0000 7f88b1cf9640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x561a6da3bc60 0x561a6da3e050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.142:42246/0 (socket says 172.21.15.142:42246) 2024-09-22T08:36:41.708 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.705+0000 7f88b1cf9640 1 -- 172.21.15.142:0/2420765875 learned_addr learned my addr 172.21.15.142:0/2420765875 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-09-22T08:36:41.708 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.706+0000 7f88abfff640 1 -- 172.21.15.142:0/2420765875 >> v1:172.21.15.31:6789/0 conn(0x561a6da3bc60 legacy=0x561a6da3e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:41.708 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.706+0000 7f88abfff640 1 -- 172.21.15.142:0/2420765875 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x561a6da43480 con 0x561a6da3f8e0 2024-09-22T08:36:41.710 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.708+0000 7f88abfff640 1 --2- 172.21.15.142:0/2420765875 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561a6da3f8e0 0x561a6da41da0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f889c00a470 tx=0x7f889c045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3aef333b70952a8 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:41.710 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.708+0000 7f88b14f8640 1 -- 172.21.15.142:0/2420765875 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f889c053570 con 0x561a6da3f8e0 2024-09-22T08:36:41.710 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.708+0000 7f88b14f8640 1 -- 172.21.15.142:0/2420765875 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f889c058070 con 0x561a6da3f8e0 2024-09-22T08:36:41.710 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.708+0000 7f88b14f8640 1 -- 172.21.15.142:0/2420765875 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f889c053880 con 0x561a6da3f8e0 2024-09-22T08:36:41.711 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.708+0000 7f88b420f800 1 -- 172.21.15.142:0/2420765875 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561a6da3f8e0 msgr2=0x561a6da41da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:41.711 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.708+0000 7f88b420f800 1 --2- 172.21.15.142:0/2420765875 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561a6da3f8e0 0x561a6da41da0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f889c00a470 tx=0x7f889c045a20 comp rx=0 tx=0).stop 2024-09-22T08:36:41.711 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.708+0000 7f88b420f800 1 -- 172.21.15.142:0/2420765875 shutdown_connections 2024-09-22T08:36:41.711 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.708+0000 7f88b420f800 1 --2- 172.21.15.142:0/2420765875 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561a6da3f8e0 0x561a6da41da0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:41.711 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.708+0000 7f88b420f800 1 -- 172.21.15.142:0/2420765875 >> 172.21.15.142:0/2420765875 conn(0x561a6da36310 msgr2=0x561a6da38790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:41.711 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.708+0000 7f88b420f800 1 -- 172.21.15.142:0/2420765875 shutdown_connections 2024-09-22T08:36:41.711 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.708+0000 7f88b420f800 1 -- 172.21.15.142:0/2420765875 wait complete. 2024-09-22T08:36:41.725 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.722+0000 7f88b420f800 1 Processor -- start 2024-09-22T08:36:41.725 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.722+0000 7f88b420f800 1 -- start start 2024-09-22T08:36:41.725 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.722+0000 7f88b420f800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561a6da3bc60 0x561a6db2af60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:41.725 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.722+0000 7f88b420f800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x561a6d8d4dd0 con 0x561a6da3bc60 2024-09-22T08:36:41.725 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.722+0000 7f88b1cf9640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561a6da3bc60 0x561a6db2af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:41.725 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.722+0000 7f88b1cf9640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561a6da3bc60 0x561a6db2af60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:37474/0 (socket says 172.21.15.142:37474) 2024-09-22T08:36:41.725 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.722+0000 7f88b1cf9640 1 -- 172.21.15.142:0/1441606986 learned_addr learned my addr 172.21.15.142:0/1441606986 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:41.725 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.723+0000 7f88b1cf9640 1 -- 172.21.15.142:0/1441606986 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561a6db2b550 con 0x561a6da3bc60 2024-09-22T08:36:41.725 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.723+0000 7f88b1cf9640 1 --2- 172.21.15.142:0/1441606986 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561a6da3bc60 0x561a6db2af60 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f88a4001e10 tx=0x7f88a400b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d5c0cccb7290a70 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:41.728 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.723+0000 7f879fe07640 1 -- 172.21.15.142:0/1441606986 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f88a4012020 con 0x561a6da3bc60 2024-09-22T08:36:41.728 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.723+0000 7f879fe07640 1 -- 172.21.15.142:0/1441606986 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88a400e5a0 con 0x561a6da3bc60 2024-09-22T08:36:41.728 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.723+0000 7f879fe07640 1 -- 172.21.15.142:0/1441606986 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f88a400e8a0 con 0x561a6da3bc60 2024-09-22T08:36:41.729 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.724+0000 7f88b420f800 1 -- 172.21.15.142:0/1441606986 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561a6da3bc60 msgr2=0x561a6db2af60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:41.729 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.724+0000 7f88b420f800 1 --2- 172.21.15.142:0/1441606986 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561a6da3bc60 0x561a6db2af60 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f88a4001e10 tx=0x7f88a400b780 comp rx=0 tx=0).stop 2024-09-22T08:36:41.729 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.724+0000 7f88b420f800 1 -- 172.21.15.142:0/1441606986 shutdown_connections 2024-09-22T08:36:41.729 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.724+0000 7f88b420f800 1 --2- 172.21.15.142:0/1441606986 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561a6da3bc60 0x561a6db2af60 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:41.729 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.724+0000 7f88b420f800 1 -- 172.21.15.142:0/1441606986 >> 172.21.15.142:0/1441606986 conn(0x561a6da36310 msgr2=0x561a6db268e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:41.729 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.724+0000 7f88b420f800 1 -- 172.21.15.142:0/1441606986 shutdown_connections 2024-09-22T08:36:41.729 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.724+0000 7f88b420f800 1 -- 172.21.15.142:0/1441606986 wait complete. 2024-09-22T08:36:41.729 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.724+0000 7f88b420f800 1 Processor -- start 2024-09-22T08:36:41.729 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.724+0000 7f88b420f800 1 -- start start 2024-09-22T08:36:41.729 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.724+0000 7f88b420f800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561a6da3bc60 0x561a6db2ea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:41.729 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.724+0000 7f88b420f800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x561a6da42720 con 0x561a6da3bc60 2024-09-22T08:36:41.729 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.724+0000 7f88b1cf9640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561a6da3bc60 0x561a6db2ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:41.730 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.724+0000 7f88b1cf9640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561a6da3bc60 0x561a6db2ea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:37488/0 (socket says 172.21.15.142:37488) 2024-09-22T08:36:41.730 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.724+0000 7f88b1cf9640 1 -- 172.21.15.142:0/3487363371 learned_addr learned my addr 172.21.15.142:0/3487363371 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:41.730 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.725+0000 7f88b1cf9640 1 -- 172.21.15.142:0/3487363371 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561a6db2ef60 con 0x561a6da3bc60 2024-09-22T08:36:41.730 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.725+0000 7f88b1cf9640 1 --2- 172.21.15.142:0/3487363371 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561a6da3bc60 0x561a6db2ea00 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x561a6db2bef0 tx=0x7f88a4000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:41.730 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.725+0000 7f879e604640 1 -- 172.21.15.142:0/3487363371 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f88a4012030 con 0x561a6da3bc60 2024-09-22T08:36:41.730 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.725+0000 7f879e604640 1 -- 172.21.15.142:0/3487363371 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88a4001470 con 0x561a6da3bc60 2024-09-22T08:36:41.730 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.725+0000 7f879e604640 1 -- 172.21.15.142:0/3487363371 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f88a401a7a0 con 0x561a6da3bc60 2024-09-22T08:36:41.730 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.725+0000 7f88b420f800 1 -- 172.21.15.142:0/3487363371 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561a6db2d310 con 0x561a6da3bc60 2024-09-22T08:36:41.730 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.725+0000 7f88b420f800 1 -- 172.21.15.142:0/3487363371 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561a6db2d8d0 con 0x561a6da3bc60 2024-09-22T08:36:41.730 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.726+0000 7f879e604640 1 -- 172.21.15.142:0/3487363371 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f88a4015020 con 0x561a6da3bc60 2024-09-22T08:36:41.730 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.726+0000 7f879e604640 1 --2- 172.21.15.142:0/3487363371 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f879803cfb0 0x7f879803f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:41.730 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.726+0000 7f879e604640 1 -- 172.21.15.142:0/3487363371 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f88a4020030 con 0x561a6da3bc60 2024-09-22T08:36:41.730 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.726+0000 7f88abfff640 1 --2- 172.21.15.142:0/3487363371 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f879803cfb0 0x7f879803f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:41.731 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.726+0000 7f88b420f800 1 --2- 172.21.15.142:0/3487363371 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x561a6da3f8e0 0x561a6db3d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:41.731 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.726+0000 7f88b420f800 1 -- 172.21.15.142:0/3487363371 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561a6db3d600 con 0x561a6da3f8e0 2024-09-22T08:36:41.731 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.726+0000 7f88b24fa640 1 --2- 172.21.15.142:0/3487363371 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x561a6da3f8e0 0x561a6db3d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:41.751 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.727+0000 7f88abfff640 1 --2- 172.21.15.142:0/3487363371 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f879803cfb0 0x7f879803f470 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f889c057000 tx=0x7f889c052000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:41.752 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.727+0000 7f88b24fa640 1 --2- 172.21.15.142:0/3487363371 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x561a6da3f8e0 0x561a6db3d0c0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:41.752 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.727+0000 7f88b24fa640 1 -- 172.21.15.142:0/3487363371 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f88ac00a4d0 con 0x561a6da3f8e0 2024-09-22T08:36:41.752 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.727+0000 7f88b420f800 1 -- 172.21.15.142:0/3487363371 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561a6db2ddb0 con 0x561a6da3f8e0 2024-09-22T08:36:41.752 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.727+0000 7f88b24fa640 1 -- 172.21.15.142:0/3487363371 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f88ac00a4d0 con 0x561a6da3f8e0 2024-09-22T08:36:41.752 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.727+0000 7f88b420f800 1 --2- 172.21.15.142:0/3487363371 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x561a6db3f910 0x561a6db41d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:41.752 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.727+0000 7f88b420f800 1 -- 172.21.15.142:0/3487363371 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:3 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561a6db423d0 con 0x561a6db3f910 2024-09-22T08:36:41.752 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.727+0000 7f88b1cf9640 1 --2- 172.21.15.142:0/3487363371 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x561a6db3f910 0x561a6db41d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:41.752 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.728+0000 7f88b1cf9640 1 --2- 172.21.15.142:0/3487363371 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x561a6db3f910 0x561a6db41d00 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:41.752 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.728+0000 7f88b1cf9640 1 -- 172.21.15.142:0/3487363371 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(3 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f88a401ab20 con 0x561a6db3f910 2024-09-22T08:36:41.752 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.728+0000 7f88b420f800 1 -- 172.21.15.142:0/3487363371 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561a6db3e7b0 con 0x561a6da3f8e0 2024-09-22T08:36:41.752 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.728+0000 7f88b24fa640 1 -- 172.21.15.142:0/3487363371 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f88ac00a4d0 con 0x561a6da3f8e0 2024-09-22T08:36:41.752 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.728+0000 7f88b420f800 1 -- 172.21.15.142:0/3487363371 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561a6db3ec50 con 0x561a6db3f910 2024-09-22T08:36:41.753 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.729+0000 7f88b1cf9640 1 -- 172.21.15.142:0/3487363371 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(5 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f88a401ab20 con 0x561a6db3f910 2024-09-22T08:36:41.753 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.729+0000 7f88b420f800 1 Processor -- start 2024-09-22T08:36:41.753 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.729+0000 7f88b420f800 1 -- start start 2024-09-22T08:36:41.753 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.729+0000 7f88b420f800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561a6db50d70 0x561a6db51190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:41.753 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.729+0000 7f88b420f800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x561a6d933d50 con 0x561a6db50d70 2024-09-22T08:36:41.753 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.729+0000 7f88b24fa640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561a6db50d70 0x561a6db51190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:41.753 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.729+0000 7f88b24fa640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561a6db50d70 0x561a6db51190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:37504/0 (socket says 172.21.15.142:37504) 2024-09-22T08:36:41.753 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.729+0000 7f88b24fa640 1 -- 172.21.15.142:0/2623220782 learned_addr learned my addr 172.21.15.142:0/2623220782 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:41.753 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.730+0000 7f88b24fa640 1 -- 172.21.15.142:0/2623220782 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561a6db517d0 con 0x561a6db50d70 2024-09-22T08:36:41.753 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.730+0000 7f88b24fa640 1 --2- 172.21.15.142:0/2623220782 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561a6db50d70 0x561a6db51190 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x561a6db2e5a0 tx=0x7f88ac0167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:41.753 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.730+0000 7f87977fe640 1 -- 172.21.15.142:0/2623220782 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f88ac013640 con 0x561a6db50d70 2024-09-22T08:36:41.753 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.730+0000 7f87977fe640 1 -- 172.21.15.142:0/2623220782 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88ac0137e0 con 0x561a6db50d70 2024-09-22T08:36:41.753 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.730+0000 7f88b420f800 1 -- 172.21.15.142:0/2623220782 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561a6db52000 con 0x561a6db50d70 2024-09-22T08:36:41.753 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.730+0000 7f87977fe640 1 -- 172.21.15.142:0/2623220782 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f88ac013ae0 con 0x561a6db50d70 2024-09-22T08:36:41.754 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.730+0000 7f88b420f800 1 -- 172.21.15.142:0/2623220782 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561a6db525a0 con 0x561a6db50d70 2024-09-22T08:36:41.754 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.731+0000 7f87977fe640 1 -- 172.21.15.142:0/2623220782 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f88ac011040 con 0x561a6db50d70 2024-09-22T08:36:41.754 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.731+0000 7f87977fe640 1 --2- 172.21.15.142:0/2623220782 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f878c03cfb0 0x7f878c03f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:41.754 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.731+0000 7f87977fe640 1 -- 172.21.15.142:0/2623220782 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f88ac00e040 con 0x561a6db50d70 2024-09-22T08:36:41.754 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.731+0000 7f88b1cf9640 1 --2- 172.21.15.142:0/2623220782 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f878c03cfb0 0x7f878c03f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:41.754 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.731+0000 7f88b420f800 1 Processor -- start 2024-09-22T08:36:41.754 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.731+0000 7f88b420f800 1 -- start start 2024-09-22T08:36:41.754 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.731+0000 7f88b1cf9640 1 --2- 172.21.15.142:0/2623220782 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f878c03cfb0 0x7f878c03f470 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f88a4052b00 tx=0x7f88a40529d0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:41.754 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.732+0000 7f88b420f800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561a6db5d830 0x561a6db5dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:41.754 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.732+0000 7f88b420f800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x561a6db2b980 con 0x561a6db5d830 2024-09-22T08:36:41.754 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.732+0000 7f88b24fa640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561a6db5d830 0x561a6db5dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:41.754 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.732+0000 7f88b24fa640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561a6db5d830 0x561a6db5dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:37518/0 (socket says 172.21.15.142:37518) 2024-09-22T08:36:41.754 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.732+0000 7f88b24fa640 1 -- 172.21.15.142:0/1847176268 learned_addr learned my addr 172.21.15.142:0/1847176268 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:41.755 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.732+0000 7f88b24fa640 1 -- 172.21.15.142:0/1847176268 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561a6db5e220 con 0x561a6db5d830 2024-09-22T08:36:41.755 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.732+0000 7f88b24fa640 1 --2- 172.21.15.142:0/1847176268 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561a6db5d830 0x561a6db5dc30 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f88ac054840 tx=0x7f88ac056110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a52ffc774e15269 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:41.755 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.732+0000 7f87957fa640 1 -- 172.21.15.142:0/1847176268 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f88ac051020 con 0x561a6db5d830 2024-09-22T08:36:41.755 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.732+0000 7f87957fa640 1 -- 172.21.15.142:0/1847176268 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88ac021a40 con 0x561a6db5d830 2024-09-22T08:36:41.755 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.732+0000 7f87957fa640 1 -- 172.21.15.142:0/1847176268 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f88ac0215b0 con 0x561a6db5d830 2024-09-22T08:36:41.755 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.733+0000 7f88b420f800 1 -- 172.21.15.142:0/1847176268 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561a6db5d830 msgr2=0x561a6db5dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:41.755 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.733+0000 7f88b420f800 1 --2- 172.21.15.142:0/1847176268 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561a6db5d830 0x561a6db5dc30 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f88ac054840 tx=0x7f88ac056110 comp rx=0 tx=0).stop 2024-09-22T08:36:41.755 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.733+0000 7f88b420f800 1 -- 172.21.15.142:0/1847176268 shutdown_connections 2024-09-22T08:36:41.755 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.733+0000 7f88b420f800 1 --2- 172.21.15.142:0/1847176268 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561a6db5d830 0x561a6db5dc30 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:41.755 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.733+0000 7f88b420f800 1 -- 172.21.15.142:0/1847176268 >> 172.21.15.142:0/1847176268 conn(0x561a6db59c30 msgr2=0x561a6db57e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:41.755 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.733+0000 7f88b420f800 1 -- 172.21.15.142:0/1847176268 shutdown_connections 2024-09-22T08:36:41.756 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.733+0000 7f88b420f800 1 -- 172.21.15.142:0/1847176268 wait complete. 2024-09-22T08:36:41.756 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.733+0000 7f88b420f800 1 Processor -- start 2024-09-22T08:36:41.756 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.733+0000 7f88b420f800 1 -- start start 2024-09-22T08:36:41.756 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.733+0000 7f88b420f800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561a6db5d830 0x561a6db64e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:41.756 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.733+0000 7f88b420f800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x561a6db5e840 con 0x561a6db5d830 2024-09-22T08:36:41.756 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.733+0000 7f88b24fa640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561a6db5d830 0x561a6db64e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:41.756 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.733+0000 7f88b24fa640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561a6db5d830 0x561a6db64e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:37532/0 (socket says 172.21.15.142:37532) 2024-09-22T08:36:41.756 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.733+0000 7f88b24fa640 1 -- 172.21.15.142:0/3386808967 learned_addr learned my addr 172.21.15.142:0/3386808967 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:41.756 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.734+0000 7f88b24fa640 1 -- 172.21.15.142:0/3386808967 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561a6db65390 con 0x561a6db5d830 2024-09-22T08:36:41.756 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.734+0000 7f88b24fa640 1 --2- 172.21.15.142:0/3386808967 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561a6db5d830 0x561a6db64e30 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f88ac054740 tx=0x7f88ac0547a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:41.756 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.734+0000 7f87837fe640 1 -- 172.21.15.142:0/3386808967 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f88ac013c80 con 0x561a6db5d830 2024-09-22T08:36:41.756 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.734+0000 7f87837fe640 1 -- 172.21.15.142:0/3386808967 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88ac054950 con 0x561a6db5d830 2024-09-22T08:36:41.756 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.734+0000 7f88b420f800 1 -- 172.21.15.142:0/3386808967 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561a6db65620 con 0x561a6db5d830 2024-09-22T08:36:41.756 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.734+0000 7f87837fe640 1 -- 172.21.15.142:0/3386808967 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f88ac013e60 con 0x561a6db5d830 2024-09-22T08:36:41.757 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.734+0000 7f88b420f800 1 -- 172.21.15.142:0/3386808967 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561a6db661b0 con 0x561a6db5d830 2024-09-22T08:36:41.757 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.735+0000 7f87837fe640 1 -- 172.21.15.142:0/3386808967 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f88ac054c70 con 0x561a6db5d830 2024-09-22T08:36:41.757 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.735+0000 7f87837fe640 1 --2- 172.21.15.142:0/3386808967 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f877c03cfb0 0x7f877c03f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:41.757 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.735+0000 7f87837fe640 1 -- 172.21.15.142:0/3386808967 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f88ac034af0 con 0x561a6db5d830 2024-09-22T08:36:41.757 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.735+0000 7f88b1cf9640 1 --2- 172.21.15.142:0/3386808967 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f877c03cfb0 0x7f877c03f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:41.757 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.735+0000 7f88b1cf9640 1 --2- 172.21.15.142:0/3386808967 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f877c03cfb0 0x7f877c03f470 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f88a40544d0 tx=0x7f88a4047000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:41.757 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.736+0000 7f88b420f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:41.757 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.736+0000 7f88b420f800 1 --2- 172.21.15.142:0/3386808967 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x561a6db70760 0x561a6db72c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:41.757 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.736+0000 7f88b420f800 1 -- 172.21.15.142:0/3386808967 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561a6db73370 con 0x561a6db70760 2024-09-22T08:36:41.757 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.736+0000 7f88abfff640 1 --2- 172.21.15.142:0/3386808967 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x561a6db70760 0x561a6db72c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:41.757 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.736+0000 7f88abfff640 1 --2- 172.21.15.142:0/3386808967 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x561a6db70760 0x561a6db72c20 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:41.757 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.736+0000 7f88abfff640 1 -- 172.21.15.142:0/3386808967 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f889c051070 con 0x561a6db70760 2024-09-22T08:36:41.758 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.737+0000 7f88b420f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:41.758 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.737+0000 7f88b420f800 20 realm 2024-09-22T08:36:41.758 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.737+0000 7f88b420f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:41.758 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.737+0000 7f88b420f800 1 -- 172.21.15.142:0/3386808967 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561a6db737a0 con 0x561a6db70760 2024-09-22T08:36:41.758 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.737+0000 7f88abfff640 1 -- 172.21.15.142:0/3386808967 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f889c051070 con 0x561a6db70760 2024-09-22T08:36:41.758 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.737+0000 7f88b420f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:41.758 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.737+0000 7f88b420f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:36:41.758 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.737+0000 7f88b420f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:41.758 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.737+0000 7f88b420f800 1 -- 172.21.15.142:0/3386808967 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561a6db74070 con 0x561a6db70760 2024-09-22T08:36:41.758 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.737+0000 7f88abfff640 1 -- 172.21.15.142:0/3386808967 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f889c051070 con 0x561a6db70760 2024-09-22T08:36:41.758 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.737+0000 7f88b420f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:41.758 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.737+0000 7f88b420f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:41.759 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.737+0000 7f88b420f800 1 -- 172.21.15.142:0/3386808967 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561a6db74410 con 0x561a6db70760 2024-09-22T08:36:41.759 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.737+0000 7f88abfff640 1 -- 172.21.15.142:0/3386808967 <== osd.1 v2:172.21.15.142:6816/3192108003 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f889c051070 con 0x561a6db70760 2024-09-22T08:36:41.759 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.737+0000 7f88b420f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:36:41.759 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.737+0000 7f88b420f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:41.759 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.737+0000 7f88b420f800 1 --2- 172.21.15.142:0/3386808967 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x561a6db75170 0x561a6db77560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:41.759 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.737+0000 7f88b420f800 1 -- 172.21.15.142:0/3386808967 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561a6db77b70 con 0x561a6db75170 2024-09-22T08:36:41.759 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.737+0000 7f88b24fa640 1 --2- 172.21.15.142:0/3386808967 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x561a6db75170 0x561a6db77560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:41.759 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.738+0000 7f88b24fa640 1 --2- 172.21.15.142:0/3386808967 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x561a6db75170 0x561a6db77560 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:41.759 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.738+0000 7f88b24fa640 1 -- 172.21.15.142:0/3386808967 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(5 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f88ac00a4d0 con 0x561a6db75170 2024-09-22T08:36:41.759 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.738+0000 7f88b420f800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:36:41.759 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.738+0000 7f88b420f800 20 searching for the correct realm 2024-09-22T08:36:41.759 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.738+0000 7f88b420f800 1 -- 172.21.15.142:0/3386808967 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561a6db794a0 con 0x561a6db75170 2024-09-22T08:36:41.759 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.738+0000 7f88b24fa640 1 -- 172.21.15.142:0/3386808967 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88ac00a4d0 con 0x561a6db75170 2024-09-22T08:36:41.760 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.738+0000 7f88b24fa640 1 --2- 172.21.15.142:0/3386808967 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f88ac03c3f0 0x7f88ac034040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:41.760 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.738+0000 7f88b24fa640 1 -- 172.21.15.142:0/3386808967 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561a6db794a0 con 0x7f88ac03c3f0 2024-09-22T08:36:41.760 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.738+0000 7f88b1cf9640 1 --2- 172.21.15.142:0/3386808967 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f88ac03c3f0 0x7f88ac034040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:41.760 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.738+0000 7f88b1cf9640 1 --2- 172.21.15.142:0/3386808967 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f88ac03c3f0 0x7f88ac034040 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:41.760 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.739+0000 7f88b1cf9640 1 -- 172.21.15.142:0/3386808967 <== osd.2 v2:172.21.15.142:6808/279438927 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88a401ab20 con 0x7f88ac03c3f0 2024-09-22T08:36:41.760 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.739+0000 7f88b1cf9640 1 --2- 172.21.15.142:0/3386808967 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f88a4017050 0x7f88a4042130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:41.760 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.739+0000 7f88b1cf9640 1 -- 172.21.15.142:0/3386808967 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561a6db794a0 con 0x7f88a4017050 2024-09-22T08:36:41.760 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.739+0000 7f88abfff640 1 --2- 172.21.15.142:0/3386808967 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f88a4017050 0x7f88a4042130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:41.760 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.740+0000 7f88abfff640 1 --2- 172.21.15.142:0/3386808967 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f88a4017050 0x7f88a4042130 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:41.760 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.740+0000 7f88abfff640 1 -- 172.21.15.142:0/3386808967 <== osd.0 v2:172.21.15.31:6800/168281188 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f889c051070 con 0x7f88a4017050 2024-09-22T08:36:41.760 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.740+0000 7f88abfff640 1 -- 172.21.15.142:0/3386808967 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561a6db794a0 con 0x561a6db70760 2024-09-22T08:36:41.760 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.740+0000 7f88abfff640 1 -- 172.21.15.142:0/3386808967 <== osd.1 v2:172.21.15.142:6816/3192108003 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f889c051070 con 0x561a6db70760 2024-09-22T08:36:41.760 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.740+0000 7f88abfff640 1 -- 172.21.15.142:0/3386808967 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561a6db794a0 con 0x561a6db70760 2024-09-22T08:36:41.760 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.740+0000 7f88abfff640 1 -- 172.21.15.142:0/3386808967 <== osd.1 v2:172.21.15.142:6816/3192108003 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f889c051070 con 0x561a6db70760 2024-09-22T08:36:41.761 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.740+0000 7f88abfff640 1 -- 172.21.15.142:0/3386808967 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561a6db794a0 con 0x7f88a4017050 2024-09-22T08:36:41.761 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.741+0000 7f88abfff640 1 -- 172.21.15.142:0/3386808967 <== osd.0 v2:172.21.15.31:6800/168281188 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f889c051070 con 0x7f88a4017050 2024-09-22T08:36:41.761 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.741+0000 7f88abfff640 1 -- 172.21.15.142:0/3386808967 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561a6db794a0 con 0x7f88a4017050 2024-09-22T08:36:41.761 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.741+0000 7f88abfff640 1 -- 172.21.15.142:0/3386808967 <== osd.0 v2:172.21.15.31:6800/168281188 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f889c051070 con 0x7f88a4017050 2024-09-22T08:36:41.761 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.741+0000 7f88abfff640 1 -- 172.21.15.142:0/3386808967 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561a6db794a0 con 0x7f88ac03c3f0 2024-09-22T08:36:41.761 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.741+0000 7f88b1cf9640 1 -- 172.21.15.142:0/3386808967 <== osd.2 v2:172.21.15.142:6808/279438927 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88a401ab20 con 0x7f88ac03c3f0 2024-09-22T08:36:41.761 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.741+0000 7f88b1cf9640 1 -- 172.21.15.142:0/3386808967 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561a6db794a0 con 0x561a6db75170 2024-09-22T08:36:41.761 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.741+0000 7f88b24fa640 1 -- 172.21.15.142:0/3386808967 <== osd.3 v2:172.21.15.142:6800/1064901393 3 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88ac00a4d0 con 0x561a6db75170 2024-09-22T08:36:41.761 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.741+0000 7f88b24fa640 1 -- 172.21.15.142:0/3386808967 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561a6db794a0 con 0x561a6db70760 2024-09-22T08:36:41.761 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.741+0000 7f88abfff640 1 -- 172.21.15.142:0/3386808967 <== osd.1 v2:172.21.15.142:6816/3192108003 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f889c051070 con 0x561a6db70760 2024-09-22T08:36:41.762 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.741+0000 7f88abfff640 1 -- 172.21.15.142:0/3386808967 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561a6db794a0 con 0x7f88a4017050 2024-09-22T08:36:41.762 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.742+0000 7f88abfff640 1 -- 172.21.15.142:0/3386808967 <== osd.0 v2:172.21.15.31:6800/168281188 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f889c051070 con 0x7f88a4017050 2024-09-22T08:36:41.762 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.742+0000 7f88abfff640 1 -- 172.21.15.142:0/3386808967 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561a6db794a0 con 0x561a6db70760 2024-09-22T08:36:41.762 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.742+0000 7f88abfff640 1 -- 172.21.15.142:0/3386808967 <== osd.1 v2:172.21.15.142:6816/3192108003 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f889c051070 con 0x561a6db70760 2024-09-22T08:36:41.762 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.742+0000 7f88abfff640 1 -- 172.21.15.142:0/3386808967 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561a6db794a0 con 0x7f88ac03c3f0 2024-09-22T08:36:41.762 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.742+0000 7f88b1cf9640 1 -- 172.21.15.142:0/3386808967 <== osd.2 v2:172.21.15.142:6808/279438927 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f88a401ab20 con 0x7f88ac03c3f0 2024-09-22T08:36:41.762 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.742+0000 7f88b1cf9640 1 -- 172.21.15.142:0/3386808967 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561a6db794a0 con 0x561a6db75170 2024-09-22T08:36:41.762 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.742+0000 7f88b24fa640 1 -- 172.21.15.142:0/3386808967 <== osd.3 v2:172.21.15.142:6800/1064901393 4 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88ac00a4d0 con 0x561a6db75170 2024-09-22T08:36:41.762 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.742+0000 7f88b24fa640 1 -- 172.21.15.142:0/3386808967 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561a6db794a0 con 0x561a6db75170 2024-09-22T08:36:41.762 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.743+0000 7f88b24fa640 1 -- 172.21.15.142:0/3386808967 <== osd.3 v2:172.21.15.142:6800/1064901393 5 ==== osd_op_reply(20 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f88ac00a4d0 con 0x561a6db75170 2024-09-22T08:36:41.762 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.743+0000 7f88b24fa640 1 -- 172.21.15.142:0/3386808967 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561a6db794a0 con 0x7f88a4017050 2024-09-22T08:36:41.762 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.743+0000 7f88abfff640 1 -- 172.21.15.142:0/3386808967 <== osd.0 v2:172.21.15.31:6800/168281188 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f889c051070 con 0x7f88a4017050 2024-09-22T08:36:41.762 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.743+0000 7f88abfff640 1 -- 172.21.15.142:0/3386808967 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561a6db794a0 con 0x561a6db75170 2024-09-22T08:36:41.763 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.743+0000 7f88b24fa640 1 -- 172.21.15.142:0/3386808967 <== osd.3 v2:172.21.15.142:6800/1064901393 6 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88ac00a4d0 con 0x561a6db75170 2024-09-22T08:36:41.763 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.743+0000 7f88b24fa640 1 -- 172.21.15.142:0/3386808967 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561a6db794a0 con 0x561a6db75170 2024-09-22T08:36:41.763 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.743+0000 7f88b24fa640 1 -- 172.21.15.142:0/3386808967 <== osd.3 v2:172.21.15.142:6800/1064901393 7 ==== osd_op_reply(23 [pgnls start_epoch 30 out=107b] v23'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f88ac00a4d0 con 0x561a6db75170 2024-09-22T08:36:41.763 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.743+0000 7f88b24fa640 1 -- 172.21.15.142:0/3386808967 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561a6db794a0 con 0x561a6db70760 2024-09-22T08:36:41.763 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.744+0000 7f88abfff640 1 -- 172.21.15.142:0/3386808967 <== osd.1 v2:172.21.15.142:6816/3192108003 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f889c051070 con 0x561a6db70760 2024-09-22T08:36:41.763 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.744+0000 7f88abfff640 1 -- 172.21.15.142:0/3386808967 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561a6db794a0 con 0x561a6db70760 2024-09-22T08:36:41.763 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.744+0000 7f88abfff640 1 -- 172.21.15.142:0/3386808967 <== osd.1 v2:172.21.15.142:6816/3192108003 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f889c051070 con 0x561a6db70760 2024-09-22T08:36:41.763 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.744+0000 7f88abfff640 1 -- 172.21.15.142:0/3386808967 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561a6db794a0 con 0x7f88a4017050 2024-09-22T08:36:41.763 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.744+0000 7f88abfff640 1 -- 172.21.15.142:0/3386808967 <== osd.0 v2:172.21.15.31:6800/168281188 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f889c051070 con 0x7f88a4017050 2024-09-22T08:36:41.763 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.744+0000 7f88abfff640 1 -- 172.21.15.142:0/3386808967 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561a6db794a0 con 0x561a6db75170 2024-09-22T08:36:41.763 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.744+0000 7f88b24fa640 1 -- 172.21.15.142:0/3386808967 <== osd.3 v2:172.21.15.142:6800/1064901393 8 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88ac00a4d0 con 0x561a6db75170 2024-09-22T08:36:41.763 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.744+0000 7f88b24fa640 1 -- 172.21.15.142:0/3386808967 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561a6db794a0 con 0x7f88ac03c3f0 2024-09-22T08:36:41.763 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.745+0000 7f88b1cf9640 1 -- 172.21.15.142:0/3386808967 <== osd.2 v2:172.21.15.142:6808/279438927 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88a401ab20 con 0x7f88ac03c3f0 2024-09-22T08:36:41.763 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.745+0000 7f88b1cf9640 1 -- 172.21.15.142:0/3386808967 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561a6db794a0 con 0x561a6db70760 2024-09-22T08:36:41.764 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.745+0000 7f88abfff640 1 -- 172.21.15.142:0/3386808967 <== osd.1 v2:172.21.15.142:6816/3192108003 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f889c051070 con 0x561a6db70760 2024-09-22T08:36:41.764 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.745+0000 7f88abfff640 1 -- 172.21.15.142:0/3386808967 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561a6db794a0 con 0x7f88a4017050 2024-09-22T08:36:41.764 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.745+0000 7f88abfff640 1 -- 172.21.15.142:0/3386808967 <== osd.0 v2:172.21.15.31:6800/168281188 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f889c051070 con 0x7f88a4017050 2024-09-22T08:36:41.764 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.745+0000 7f88abfff640 1 -- 172.21.15.142:0/3386808967 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561a6db794a0 con 0x561a6db75170 2024-09-22T08:36:41.764 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.745+0000 7f88b24fa640 1 -- 172.21.15.142:0/3386808967 <== osd.3 v2:172.21.15.142:6800/1064901393 9 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88ac00a4d0 con 0x561a6db75170 2024-09-22T08:36:41.764 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.745+0000 7f88b24fa640 1 -- 172.21.15.142:0/3386808967 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561a6db794a0 con 0x7f88a4017050 2024-09-22T08:36:41.764 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.746+0000 7f88abfff640 1 -- 172.21.15.142:0/3386808967 <== osd.0 v2:172.21.15.31:6800/168281188 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f889c051070 con 0x7f88a4017050 2024-09-22T08:36:41.764 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.746+0000 7f88abfff640 1 -- 172.21.15.142:0/3386808967 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561a6db794a0 con 0x7f88ac03c3f0 2024-09-22T08:36:41.764 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.746+0000 7f88b1cf9640 1 -- 172.21.15.142:0/3386808967 <== osd.2 v2:172.21.15.142:6808/279438927 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88a401ab20 con 0x7f88ac03c3f0 2024-09-22T08:36:41.764 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.746+0000 7f88b1cf9640 1 -- 172.21.15.142:0/3386808967 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561a6db794a0 con 0x561a6db75170 2024-09-22T08:36:41.764 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.746+0000 7f88b24fa640 1 -- 172.21.15.142:0/3386808967 <== osd.3 v2:172.21.15.142:6800/1064901393 10 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88ac00a4d0 con 0x561a6db75170 2024-09-22T08:36:41.764 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.746+0000 7f88b24fa640 1 -- 172.21.15.142:0/3386808967 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561a6db794a0 con 0x7f88a4017050 2024-09-22T08:36:41.764 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.746+0000 7f88abfff640 1 -- 172.21.15.142:0/3386808967 <== osd.0 v2:172.21.15.31:6800/168281188 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f889c051070 con 0x7f88a4017050 2024-09-22T08:36:41.764 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.746+0000 7f88abfff640 1 -- 172.21.15.142:0/3386808967 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561a6db794a0 con 0x561a6db70760 2024-09-22T08:36:41.765 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.747+0000 7f88abfff640 1 -- 172.21.15.142:0/3386808967 <== osd.1 v2:172.21.15.142:6816/3192108003 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f889c051070 con 0x561a6db70760 2024-09-22T08:36:41.765 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.747+0000 7f88abfff640 1 -- 172.21.15.142:0/3386808967 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561a6db794a0 con 0x7f88ac03c3f0 2024-09-22T08:36:41.765 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.747+0000 7f88b1cf9640 1 -- 172.21.15.142:0/3386808967 <== osd.2 v2:172.21.15.142:6808/279438927 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88a401ab20 con 0x7f88ac03c3f0 2024-09-22T08:36:41.765 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.747+0000 7f88b420f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:36:41.765 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.747+0000 7f88b420f800 20 RGWRados::pool_iterate: got zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec 2024-09-22T08:36:41.765 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.747+0000 7f88b420f800 20 RGWRados::pool_iterate: got zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f 2024-09-22T08:36:41.765 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.747+0000 7f88b420f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:36:41.765 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.747+0000 7f88b420f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:36:41.765 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.747+0000 7f88b420f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:36:41.765 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.747+0000 7f88b420f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:41.765 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.747+0000 7f88b420f800 1 -- 172.21.15.142:0/3386808967 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561a6db78530 con 0x561a6db70760 2024-09-22T08:36:41.765 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.747+0000 7f88abfff640 1 -- 172.21.15.142:0/3386808967 <== osd.1 v2:172.21.15.142:6816/3192108003 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f889c051070 con 0x561a6db70760 2024-09-22T08:36:41.765 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.747+0000 7f88b420f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:41.765 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.747+0000 7f88b420f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:41.766 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.747+0000 7f88b420f800 1 -- 172.21.15.142:0/3386808967 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561a6db78d80 con 0x561a6db70760 2024-09-22T08:36:41.766 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.747+0000 7f88abfff640 1 -- 172.21.15.142:0/3386808967 <== osd.1 v2:172.21.15.142:6816/3192108003 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f889c051070 con 0x561a6db70760 2024-09-22T08:36:41.766 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.747+0000 7f88b420f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:36:41.766 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.747+0000 7f88b420f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:41.766 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.747+0000 7f88b420f800 1 -- 172.21.15.142:0/3386808967 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:40 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561a6db79920 con 0x561a6db75170 2024-09-22T08:36:41.766 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.748+0000 7f88b24fa640 1 -- 172.21.15.142:0/3386808967 <== osd.3 v2:172.21.15.142:6800/1064901393 11 ==== osd_op_reply(40 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f88ac00a4d0 con 0x561a6db75170 2024-09-22T08:36:41.766 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.748+0000 7f88b420f800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:36:41.766 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.748+0000 7f88b420f800 20 zone default found 2024-09-22T08:36:41.766 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.748+0000 7f88b420f800 4 Realm: () 2024-09-22T08:36:41.766 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.748+0000 7f88b420f800 4 ZoneGroup: default (d89f6f57-1007-47dd-9065-f486c7b01aec) 2024-09-22T08:36:41.766 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.748+0000 7f88b420f800 4 Zone: default (e239248c-0bee-4e41-803a-24b288d3eb8f) 2024-09-22T08:36:41.766 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.748+0000 7f88b420f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:36:41.766 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.748+0000 7f88b420f800 20 zonegroup default 2024-09-22T08:36:41.767 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.748+0000 7f88b420f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:41.767 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.748+0000 7f88b420f800 1 -- 172.21.15.142:0/3386808967 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561a6db79d00 con 0x7f88a4017050 2024-09-22T08:36:41.767 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.748+0000 7f88abfff640 1 -- 172.21.15.142:0/3386808967 <== osd.0 v2:172.21.15.31:6800/168281188 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f889c051070 con 0x7f88a4017050 2024-09-22T08:36:41.767 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.748+0000 7f88b420f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:41.767 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.748+0000 7f88b420f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:41.767 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.748+0000 7f88b420f800 1 -- 172.21.15.142:0/3386808967 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561a6db7bfe0 con 0x561a6db75170 2024-09-22T08:36:41.767 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.748+0000 7f88b24fa640 1 -- 172.21.15.142:0/3386808967 <== osd.3 v2:172.21.15.142:6800/1064901393 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f88ac00a4d0 con 0x561a6db75170 2024-09-22T08:36:41.767 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.748+0000 7f88b420f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:41.767 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.748+0000 7f88b420f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:41.767 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.748+0000 7f88b420f800 1 -- 172.21.15.142:0/3386808967 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561a6db7c380 con 0x561a6db75170 2024-09-22T08:36:41.767 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.748+0000 7f88b24fa640 1 -- 172.21.15.142:0/3386808967 <== osd.3 v2:172.21.15.142:6800/1064901393 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f88ac00a4d0 con 0x561a6db75170 2024-09-22T08:36:41.768 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.748+0000 7f88b420f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:41.768 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.748+0000 7f88b420f800 20 started sync module instance, tier type = 2024-09-22T08:36:41.768 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.748+0000 7f88b420f800 20 started zone id=e239248c-0bee-4e41-803a-24b288d3eb8f (name=default) with tier type = 2024-09-22T08:36:41.768 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.748+0000 7f88b420f800 1 -- 172.21.15.142:0/3386808967 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561a6db7b420 con 0x7f88ac03c3f0 2024-09-22T08:36:41.768 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.750+0000 7f88b1cf9640 1 -- 172.21.15.142:0/3386808967 <== osd.2 v2:172.21.15.142:6808/279438927 7 ==== osd_op_reply(44 notify.0 [create] v30'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88a401ab20 con 0x7f88ac03c3f0 2024-09-22T08:36:41.768 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.750+0000 7f88b420f800 1 -- 172.21.15.142:0/3386808967 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94671509892976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561a6db7c7b0 con 0x7f88ac03c3f0 2024-09-22T08:36:41.768 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.750+0000 7f88b420f800 1 -- 172.21.15.142:0/3386808967 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561a6db7d000 con 0x561a6db70760 2024-09-22T08:36:41.774 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.751+0000 7f88b1cf9640 1 -- 172.21.15.142:0/3386808967 <== osd.2 v2:172.21.15.142:6808/279438927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94671509892976] v30'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88a401ab20 con 0x7f88ac03c3f0 2024-09-22T08:36:41.774 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.751+0000 7f88abfff640 1 -- 172.21.15.142:0/3386808967 <== osd.1 v2:172.21.15.142:6816/3192108003 15 ==== osd_op_reply(46 notify.1 [create] v30'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f889c051070 con 0x561a6db70760 2024-09-22T08:36:41.774 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.751+0000 7f88b420f800 1 -- 172.21.15.142:0/3386808967 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94671509900112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561a6db7d420 con 0x561a6db70760 2024-09-22T08:36:41.774 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.751+0000 7f88b420f800 1 -- 172.21.15.142:0/3386808967 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561a6db7dc70 con 0x561a6db75170 2024-09-22T08:36:41.774 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.752+0000 7f88b24fa640 1 -- 172.21.15.142:0/3386808967 <== osd.3 v2:172.21.15.142:6800/1064901393 14 ==== osd_op_reply(48 notify.2 [create] v30'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88ac00a4d0 con 0x561a6db75170 2024-09-22T08:36:41.774 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.752+0000 7f88b420f800 1 -- 172.21.15.142:0/3386808967 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94671509902848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561a6db7e0d0 con 0x561a6db75170 2024-09-22T08:36:41.774 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.752+0000 7f88b420f800 1 -- 172.21.15.142:0/3386808967 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561a6db7ebf0 con 0x7f88ac03c3f0 2024-09-22T08:36:41.774 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.752+0000 7f88abfff640 1 -- 172.21.15.142:0/3386808967 <== osd.1 v2:172.21.15.142:6816/3192108003 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94671509900112] v30'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f889c051070 con 0x561a6db70760 2024-09-22T08:36:41.774 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.753+0000 7f88b1cf9640 1 -- 172.21.15.142:0/3386808967 <== osd.2 v2:172.21.15.142:6808/279438927 9 ==== osd_op_reply(50 notify.3 [create] v30'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88a401ab20 con 0x7f88ac03c3f0 2024-09-22T08:36:41.774 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.753+0000 7f88b24fa640 1 -- 172.21.15.142:0/3386808967 <== osd.3 v2:172.21.15.142:6800/1064901393 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94671509902848] v30'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88ac00a4d0 con 0x561a6db75170 2024-09-22T08:36:41.774 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.753+0000 7f88b420f800 1 -- 172.21.15.142:0/3386808967 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94671509907136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561a6db7efe0 con 0x7f88ac03c3f0 2024-09-22T08:36:41.774 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.753+0000 7f88b420f800 1 -- 172.21.15.142:0/3386808967 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561a6db7db80 con 0x561a6db70760 2024-09-22T08:36:41.775 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.754+0000 7f88b1cf9640 1 -- 172.21.15.142:0/3386808967 <== osd.2 v2:172.21.15.142:6808/279438927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94671509907136] v30'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88a401ab20 con 0x7f88ac03c3f0 2024-09-22T08:36:41.775 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.754+0000 7f88abfff640 1 -- 172.21.15.142:0/3386808967 <== osd.1 v2:172.21.15.142:6816/3192108003 17 ==== osd_op_reply(52 notify.4 [create] v30'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f889c051070 con 0x561a6db70760 2024-09-22T08:36:41.775 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.754+0000 7f88b420f800 1 -- 172.21.15.142:0/3386808967 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94671509901168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561a6db7db80 con 0x561a6db70760 2024-09-22T08:36:41.775 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.754+0000 7f88b420f800 1 -- 172.21.15.142:0/3386808967 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561a6db7fff0 con 0x7f88a4017050 2024-09-22T08:36:41.775 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.755+0000 7f88abfff640 1 -- 172.21.15.142:0/3386808967 <== osd.1 v2:172.21.15.142:6816/3192108003 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94671509901168] v30'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f889c051070 con 0x561a6db70760 2024-09-22T08:36:41.775 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.756+0000 7f88abfff640 1 -- 172.21.15.142:0/3386808967 <== osd.0 v2:172.21.15.31:6800/168281188 11 ==== osd_op_reply(54 notify.5 [create] v30'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f889c051070 con 0x7f88a4017050 2024-09-22T08:36:41.775 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.756+0000 7f88b420f800 1 -- 172.21.15.142:0/3386808967 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94671509910816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561a6db7fff0 con 0x7f88a4017050 2024-09-22T08:36:41.775 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.756+0000 7f88b420f800 1 -- 172.21.15.142:0/3386808967 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561a6db809b0 con 0x7f88a4017050 2024-09-22T08:36:41.775 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.757+0000 7f88abfff640 1 -- 172.21.15.142:0/3386808967 <== osd.0 v2:172.21.15.31:6800/168281188 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94671509910816] v30'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f889c051070 con 0x7f88a4017050 2024-09-22T08:36:41.775 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.757+0000 7f88abfff640 1 -- 172.21.15.142:0/3386808967 <== osd.0 v2:172.21.15.31:6800/168281188 13 ==== osd_op_reply(56 notify.6 [create] v30'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f889c051070 con 0x7f88a4017050 2024-09-22T08:36:41.775 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.757+0000 7f88b420f800 1 -- 172.21.15.142:0/3386808967 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94671509912384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561a6db80b90 con 0x7f88a4017050 2024-09-22T08:36:41.775 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.757+0000 7f88b420f800 1 -- 172.21.15.142:0/3386808967 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561a6db813e0 con 0x7f88a4017050 2024-09-22T08:36:41.775 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.758+0000 7f88abfff640 1 -- 172.21.15.142:0/3386808967 <== osd.0 v2:172.21.15.31:6800/168281188 14 ==== osd_op_reply(58 notify.7 [create] v30'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f889c051070 con 0x7f88a4017050 2024-09-22T08:36:41.775 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.758+0000 7f88abfff640 1 -- 172.21.15.142:0/3386808967 <== osd.0 v2:172.21.15.31:6800/168281188 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94671509912384] v30'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f889c051070 con 0x7f88a4017050 2024-09-22T08:36:41.776 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.758+0000 7f88b420f800 1 -- 172.21.15.142:0/3386808967 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94671509917040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561a6db81800 con 0x7f88a4017050 2024-09-22T08:36:41.776 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.758+0000 7f88b420f800 20 add_watcher() i=0 2024-09-22T08:36:41.776 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.758+0000 7f88b420f800 20 add_watcher() i=1 2024-09-22T08:36:41.776 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.758+0000 7f88b420f800 20 add_watcher() i=2 2024-09-22T08:36:41.776 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.758+0000 7f88b420f800 20 add_watcher() i=3 2024-09-22T08:36:41.776 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.758+0000 7f88b420f800 20 add_watcher() i=4 2024-09-22T08:36:41.776 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.758+0000 7f88b420f800 20 add_watcher() i=5 2024-09-22T08:36:41.776 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.758+0000 7f88b420f800 20 add_watcher() i=6 2024-09-22T08:36:41.776 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.759+0000 7f88abfff640 1 -- 172.21.15.142:0/3386808967 <== osd.0 v2:172.21.15.31:6800/168281188 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94671509917040] v30'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f889c051070 con 0x7f88a4017050 2024-09-22T08:36:41.776 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.759+0000 7f88b420f800 20 add_watcher() i=7 2024-09-22T08:36:41.776 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.759+0000 7f88b420f800 2 all 8 watchers are set, enabling cache 2024-09-22T08:36:41.776 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.759+0000 7f88b420f800 1 -- 172.21.15.142:0/3386808967 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561a6db84c80 con 0x561a6db70760 2024-09-22T08:36:41.776 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.760+0000 7f88abfff640 1 -- 172.21.15.142:0/3386808967 <== osd.1 v2:172.21.15.142:6816/3192108003 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f889c051070 con 0x561a6db70760 2024-09-22T08:36:41.776 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.760+0000 7f88b420f800 1 -- 172.21.15.142:0/3386808967 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94671509918352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561a6db82100 con 0x561a6db70760 2024-09-22T08:36:41.777 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.761+0000 7f88abfff640 1 -- 172.21.15.142:0/3386808967 <== osd.1 v2:172.21.15.142:6816/3192108003 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94671509918352] v30'31 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f889c051070 con 0x561a6db70760 2024-09-22T08:36:41.777 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.761+0000 7f8767fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:36:41.777 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.761+0000 7f88b420f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:36:41.777 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.761+0000 7f88b420f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:36:41.777 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.761+0000 7f88b420f800 1 -- 172.21.15.142:0/3386808967 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561a6db8d4f0 con 0x561a6db70760 2024-09-22T08:36:41.777 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.762+0000 7f88abfff640 1 -- 172.21.15.142:0/3386808967 <== osd.1 v2:172.21.15.142:6816/3192108003 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v30'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f889c07f040 con 0x561a6db70760 2024-09-22T08:36:41.777 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.762+0000 7f88b420f800 1 -- 172.21.15.142:0/3386808967 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561a6db8d4f0 con 0x7f88a4017050 2024-09-22T08:36:41.777 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.763+0000 7f88abfff640 1 -- 172.21.15.142:0/3386808967 <== osd.0 v2:172.21.15.31:6800/168281188 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v30'11 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f889c07f040 con 0x7f88a4017050 2024-09-22T08:36:41.777 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.763+0000 7f88b420f800 1 -- 172.21.15.142:0/3386808967 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561a6db8e030 con 0x561a6db75170 2024-09-22T08:36:41.777 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.764+0000 7f88b24fa640 1 -- 172.21.15.142:0/3386808967 <== osd.3 v2:172.21.15.142:6800/1064901393 16 ==== osd_op_reply(64 gc.2 [create,call,call,call] v30'11 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f88ac00a4d0 con 0x561a6db75170 2024-09-22T08:36:41.777 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.764+0000 7f88b420f800 1 -- 172.21.15.142:0/3386808967 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561a6db8e0c0 con 0x561a6db70760 2024-09-22T08:36:41.777 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.765+0000 7f88abfff640 1 -- 172.21.15.142:0/3386808967 <== osd.1 v2:172.21.15.142:6816/3192108003 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v30'32 uv15 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f889c07f040 con 0x561a6db70760 2024-09-22T08:36:41.777 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.765+0000 7f88b420f800 1 -- 172.21.15.142:0/3386808967 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561a6db8e570 con 0x7f88ac03c3f0 2024-09-22T08:36:41.777 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.766+0000 7f88b1cf9640 1 -- 172.21.15.142:0/3386808967 <== osd.2 v2:172.21.15.142:6808/279438927 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v30'23 uv13 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f88a401ab20 con 0x7f88ac03c3f0 2024-09-22T08:36:41.778 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.766+0000 7f88b420f800 1 -- 172.21.15.142:0/3386808967 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561a6db8bb50 con 0x561a6db75170 2024-09-22T08:36:41.778 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.767+0000 7f88b24fa640 1 -- 172.21.15.142:0/3386808967 <== osd.3 v2:172.21.15.142:6800/1064901393 17 ==== osd_op_reply(67 gc.5 [create,call,call,call] v30'15 uv10 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f88ac00a4d0 con 0x561a6db75170 2024-09-22T08:36:41.778 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.767+0000 7f88b420f800 1 -- 172.21.15.142:0/3386808967 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561a6db8bb50 con 0x561a6db70760 2024-09-22T08:36:41.778 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.768+0000 7f88abfff640 1 -- 172.21.15.142:0/3386808967 <== osd.1 v2:172.21.15.142:6816/3192108003 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v30'13 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f889c07f040 con 0x561a6db70760 2024-09-22T08:36:41.778 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.768+0000 7f88b420f800 1 -- 172.21.15.142:0/3386808967 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561a6db8bb50 con 0x7f88a4017050 2024-09-22T08:36:41.778 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.769+0000 7f88abfff640 1 -- 172.21.15.142:0/3386808967 <== osd.0 v2:172.21.15.31:6800/168281188 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v30'15 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f889c07f040 con 0x7f88a4017050 2024-09-22T08:36:41.778 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.769+0000 7f88b420f800 1 -- 172.21.15.142:0/3386808967 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561a6db8bb50 con 0x7f88ac03c3f0 2024-09-22T08:36:41.778 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.770+0000 7f88b1cf9640 1 -- 172.21.15.142:0/3386808967 <== osd.2 v2:172.21.15.142:6808/279438927 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v30'11 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f88a401ab20 con 0x7f88ac03c3f0 2024-09-22T08:36:41.778 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.770+0000 7f88b420f800 1 -- 172.21.15.142:0/3386808967 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561a6db8bb50 con 0x561a6db75170 2024-09-22T08:36:41.778 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.771+0000 7f88b24fa640 1 -- 172.21.15.142:0/3386808967 <== osd.3 v2:172.21.15.142:6800/1064901393 18 ==== osd_op_reply(71 gc.9 [create,call,call,call] v30'17 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f88ac00a4d0 con 0x561a6db75170 2024-09-22T08:36:41.778 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.771+0000 7f88b420f800 1 -- 172.21.15.142:0/3386808967 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561a6db8bbe0 con 0x7f88ac03c3f0 2024-09-22T08:36:41.779 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.772+0000 7f88b1cf9640 1 -- 172.21.15.142:0/3386808967 <== osd.2 v2:172.21.15.142:6808/279438927 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v30'24 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f88a401ab20 con 0x7f88ac03c3f0 2024-09-22T08:36:41.779 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.772+0000 7f88b420f800 1 -- 172.21.15.142:0/3386808967 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561a6db8bd00 con 0x7f88a4017050 2024-09-22T08:36:41.779 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.774+0000 7f88abfff640 1 -- 172.21.15.142:0/3386808967 <== osd.0 v2:172.21.15.31:6800/168281188 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v30'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f889c07f040 con 0x7f88a4017050 2024-09-22T08:36:41.780 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.774+0000 7f88b420f800 1 -- 172.21.15.142:0/3386808967 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561a6db8bd00 con 0x7f88ac03c3f0 2024-09-22T08:36:41.780 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.775+0000 7f88b1cf9640 1 -- 172.21.15.142:0/3386808967 <== osd.2 v2:172.21.15.142:6808/279438927 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v30'11 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f88a401ab20 con 0x7f88ac03c3f0 2024-09-22T08:36:41.780 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.775+0000 7f88b420f800 1 -- 172.21.15.142:0/3386808967 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561a6db8bd00 con 0x7f88a4017050 2024-09-22T08:36:41.780 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.776+0000 7f88abfff640 1 -- 172.21.15.142:0/3386808967 <== osd.0 v2:172.21.15.31:6800/168281188 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v30'21 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f889c07f040 con 0x7f88a4017050 2024-09-22T08:36:41.780 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.776+0000 7f88b420f800 1 -- 172.21.15.142:0/3386808967 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561a6db8bd00 con 0x561a6db70760 2024-09-22T08:36:41.780 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.778+0000 7f88abfff640 1 -- 172.21.15.142:0/3386808967 <== osd.1 v2:172.21.15.142:6816/3192108003 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v30'33 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f889c07f040 con 0x561a6db70760 2024-09-22T08:36:41.780 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.778+0000 7f88b420f800 1 -- 172.21.15.142:0/3386808967 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561a6db8bd00 con 0x561a6db75170 2024-09-22T08:36:41.781 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.779+0000 7f88b24fa640 1 -- 172.21.15.142:0/3386808967 <== osd.3 v2:172.21.15.142:6800/1064901393 19 ==== osd_op_reply(77 gc.15 [create,call,call,call] v30'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f88ac00a4d0 con 0x561a6db75170 2024-09-22T08:36:41.781 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.779+0000 7f88b420f800 1 -- 172.21.15.142:0/3386808967 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561a6db8bd00 con 0x7f88ac03c3f0 2024-09-22T08:36:41.782 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.780+0000 7f88b1cf9640 1 -- 172.21.15.142:0/3386808967 <== osd.2 v2:172.21.15.142:6808/279438927 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v30'25 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f88a401ab20 con 0x7f88ac03c3f0 2024-09-22T08:36:41.782 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.780+0000 7f88b420f800 1 -- 172.21.15.142:0/3386808967 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561a6db8bd00 con 0x561a6db75170 2024-09-22T08:36:41.783 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.781+0000 7f88b24fa640 1 -- 172.21.15.142:0/3386808967 <== osd.3 v2:172.21.15.142:6800/1064901393 20 ==== osd_op_reply(79 gc.17 [create,call,call,call] v30'11 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f88ac00a4d0 con 0x561a6db75170 2024-09-22T08:36:41.783 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.781+0000 7f88b420f800 1 -- 172.21.15.142:0/3386808967 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561a6db8b4d0 con 0x561a6db70760 2024-09-22T08:36:41.784 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.782+0000 7f88abfff640 1 -- 172.21.15.142:0/3386808967 <== osd.1 v2:172.21.15.142:6816/3192108003 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v30'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f889c07f040 con 0x561a6db70760 2024-09-22T08:36:41.784 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.782+0000 7f88b420f800 1 -- 172.21.15.142:0/3386808967 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561a6db8f360 con 0x561a6db70760 2024-09-22T08:36:41.787 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.785+0000 7f88abfff640 1 -- 172.21.15.142:0/3386808967 <== osd.1 v2:172.21.15.142:6816/3192108003 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v30'34 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f889c07f040 con 0x561a6db70760 2024-09-22T08:36:41.787 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.785+0000 7f88b420f800 1 -- 172.21.15.142:0/3386808967 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561a6db8f360 con 0x561a6db75170 2024-09-22T08:36:41.789 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.787+0000 7f88b24fa640 1 -- 172.21.15.142:0/3386808967 <== osd.3 v2:172.21.15.142:6800/1064901393 21 ==== osd_op_reply(82 gc.20 [create,call,call,call] v30'18 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f88ac00a4d0 con 0x561a6db75170 2024-09-22T08:36:41.789 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.787+0000 7f88b420f800 1 -- 172.21.15.142:0/3386808967 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561a6db8f360 con 0x7f88ac03c3f0 2024-09-22T08:36:41.790 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.788+0000 7f88b1cf9640 1 -- 172.21.15.142:0/3386808967 <== osd.2 v2:172.21.15.142:6808/279438927 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v30'21 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f88a401ab20 con 0x7f88ac03c3f0 2024-09-22T08:36:41.790 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.788+0000 7f88b420f800 1 -- 172.21.15.142:0/3386808967 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561a6db8f360 con 0x561a6db75170 2024-09-22T08:36:41.792 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.790+0000 7f88b24fa640 1 -- 172.21.15.142:0/3386808967 <== osd.3 v2:172.21.15.142:6800/1064901393 22 ==== osd_op_reply(84 gc.22 [create,call,call,call] v30'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f88ac00a4d0 con 0x561a6db75170 2024-09-22T08:36:41.792 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.790+0000 7f88b420f800 1 -- 172.21.15.142:0/3386808967 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561a6db8f360 con 0x561a6db75170 2024-09-22T08:36:41.793 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.791+0000 7f88b24fa640 1 -- 172.21.15.142:0/3386808967 <== osd.3 v2:172.21.15.142:6800/1064901393 23 ==== osd_op_reply(85 gc.23 [create,call,call,call] v30'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f88ac00a4d0 con 0x561a6db75170 2024-09-22T08:36:41.793 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.791+0000 7f88b420f800 1 -- 172.21.15.142:0/3386808967 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561a6db8f360 con 0x561a6db75170 2024-09-22T08:36:41.794 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.792+0000 7f88b24fa640 1 -- 172.21.15.142:0/3386808967 <== osd.3 v2:172.21.15.142:6800/1064901393 24 ==== osd_op_reply(86 gc.24 [create,call,call,call] v30'7 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f88ac00a4d0 con 0x561a6db75170 2024-09-22T08:36:41.794 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.792+0000 7f88b420f800 1 -- 172.21.15.142:0/3386808967 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561a6db8f360 con 0x561a6db75170 2024-09-22T08:36:41.795 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.793+0000 7f88b24fa640 1 -- 172.21.15.142:0/3386808967 <== osd.3 v2:172.21.15.142:6800/1064901393 25 ==== osd_op_reply(87 gc.25 [create,call,call,call] v30'16 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f88ac00a4d0 con 0x561a6db75170 2024-09-22T08:36:41.795 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.793+0000 7f88b420f800 1 -- 172.21.15.142:0/3386808967 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561a6db8f360 con 0x7f88a4017050 2024-09-22T08:36:41.796 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.794+0000 7f88abfff640 1 -- 172.21.15.142:0/3386808967 <== osd.0 v2:172.21.15.31:6800/168281188 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v30'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f889c07f040 con 0x7f88a4017050 2024-09-22T08:36:41.796 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.794+0000 7f88b420f800 1 -- 172.21.15.142:0/3386808967 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561a6db8f360 con 0x561a6db75170 2024-09-22T08:36:41.797 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.795+0000 7f88b24fa640 1 -- 172.21.15.142:0/3386808967 <== osd.3 v2:172.21.15.142:6800/1064901393 26 ==== osd_op_reply(89 gc.27 [create,call,call,call] v30'11 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f88ac00a4d0 con 0x561a6db75170 2024-09-22T08:36:41.797 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.795+0000 7f88b420f800 1 -- 172.21.15.142:0/3386808967 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561a6db8f360 con 0x7f88a4017050 2024-09-22T08:36:41.800 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.799+0000 7f88abfff640 1 -- 172.21.15.142:0/3386808967 <== osd.0 v2:172.21.15.31:6800/168281188 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v30'16 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f889c07f040 con 0x7f88a4017050 2024-09-22T08:36:41.800 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.799+0000 7f88b420f800 1 -- 172.21.15.142:0/3386808967 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561a6db8f360 con 0x561a6db75170 2024-09-22T08:36:41.801 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.799+0000 7f88b24fa640 1 -- 172.21.15.142:0/3386808967 <== osd.3 v2:172.21.15.142:6800/1064901393 27 ==== osd_op_reply(91 gc.29 [create,call,call,call] v30'19 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f88ac00a4d0 con 0x561a6db75170 2024-09-22T08:36:41.801 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.799+0000 7f88b420f800 1 -- 172.21.15.142:0/3386808967 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561a6db8f360 con 0x7f88a4017050 2024-09-22T08:36:41.802 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.800+0000 7f88abfff640 1 -- 172.21.15.142:0/3386808967 <== osd.0 v2:172.21.15.31:6800/168281188 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v30'22 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f889c07f040 con 0x7f88a4017050 2024-09-22T08:36:41.802 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.800+0000 7f88b420f800 1 -- 172.21.15.142:0/3386808967 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561a6db8f360 con 0x7f88ac03c3f0 2024-09-22T08:36:41.805 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.801+0000 7f88b1cf9640 1 -- 172.21.15.142:0/3386808967 <== osd.2 v2:172.21.15.142:6808/279438927 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v30'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f88a401ab20 con 0x7f88ac03c3f0 2024-09-22T08:36:41.805 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.801+0000 7f8766fe5640 20 reqs_thread_entry: start 2024-09-22T08:36:41.805 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.801+0000 7f88b420f800 20 init_complete bucket index max shards: 11 2024-09-22T08:36:41.806 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.801+0000 7f88b420f800 20 Filter name: none 2024-09-22T08:36:41.806 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.801+0000 7f8764fe1640 20 reqs_thread_entry: start 2024-09-22T08:36:41.806 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.801+0000 7f88b420f800 10 cache get: name=default.rgw.meta+users.uid+bar : miss 2024-09-22T08:36:41.806 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.801+0000 7f88b420f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:41.806 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.802+0000 7f88b420f800 1 -- 172.21.15.142:0/3386808967 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:94 8.e 8:718f6a54:users.uid::bar:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561a6dbb9ff0 con 0x7f88a4017050 2024-09-22T08:36:41.806 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.802+0000 7f88abfff640 1 -- 172.21.15.142:0/3386808967 <== osd.0 v2:172.21.15.31:6800/168281188 24 ==== osd_op_reply(94 bar [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f889c07f040 con 0x7f88a4017050 2024-09-22T08:36:41.806 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.802+0000 7f88b420f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:41.806 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.802+0000 7f88b420f800 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x0 2024-09-22T08:36:41.806 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.802+0000 7f88b420f800 10 adding default.rgw.meta+users.uid+bar to cache LRU end 2024-09-22T08:36:41.807 INFO:teuthology.orchestra.run.smithi142.stderr:could not remove user: unable to remove user, user does not exist 2024-09-22T08:36:41.807 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.803+0000 7f8767fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:36:41.807 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.803+0000 7f88b420f800 1 -- 172.21.15.142:0/3386808967 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94671509918352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561a6db8aa70 con 0x561a6db70760 2024-09-22T08:36:41.807 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.804+0000 7f88abfff640 1 -- 172.21.15.142:0/3386808967 <== osd.1 v2:172.21.15.142:6816/3192108003 27 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 94671509918352] v30'35 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f889c07f040 con 0x561a6db70760 2024-09-22T08:36:41.807 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.804+0000 7f88b420f800 1 -- 172.21.15.142:0/3386808967 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94671509892976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561a6db8aa70 con 0x7f88ac03c3f0 2024-09-22T08:36:41.808 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.806+0000 7f88b1cf9640 1 -- 172.21.15.142:0/3386808967 <== osd.2 v2:172.21.15.142:6808/279438927 18 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 94671509892976] v30'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88a401ab20 con 0x7f88ac03c3f0 2024-09-22T08:36:41.809 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.806+0000 7f88b420f800 20 remove_watcher() i=0 2024-09-22T08:36:41.809 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.806+0000 7f88b420f800 2 removed watcher, disabling cache 2024-09-22T08:36:41.809 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.806+0000 7f88b420f800 1 -- 172.21.15.142:0/3386808967 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94671509900112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561a6db7af70 con 0x561a6db70760 2024-09-22T08:36:41.810 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.808+0000 7f88abfff640 1 -- 172.21.15.142:0/3386808967 <== osd.1 v2:172.21.15.142:6816/3192108003 28 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 94671509900112] v30'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f889c07f040 con 0x561a6db70760 2024-09-22T08:36:41.810 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.808+0000 7f88b420f800 20 remove_watcher() i=1 2024-09-22T08:36:41.810 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.808+0000 7f88b420f800 1 -- 172.21.15.142:0/3386808967 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94671509902848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561a6db7af70 con 0x561a6db75170 2024-09-22T08:36:41.811 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.809+0000 7f88b24fa640 1 -- 172.21.15.142:0/3386808967 <== osd.3 v2:172.21.15.142:6800/1064901393 28 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 94671509902848] v30'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88ac00a4d0 con 0x561a6db75170 2024-09-22T08:36:41.811 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.809+0000 7f88b420f800 20 remove_watcher() i=2 2024-09-22T08:36:41.811 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.809+0000 7f88b420f800 1 -- 172.21.15.142:0/3386808967 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94671509907136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561a6db7af70 con 0x7f88ac03c3f0 2024-09-22T08:36:41.812 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.810+0000 7f88b1cf9640 1 -- 172.21.15.142:0/3386808967 <== osd.2 v2:172.21.15.142:6808/279438927 19 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 94671509907136] v30'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88a401ab20 con 0x7f88ac03c3f0 2024-09-22T08:36:41.812 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.810+0000 7f88b420f800 20 remove_watcher() i=3 2024-09-22T08:36:41.812 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.810+0000 7f88b420f800 1 -- 172.21.15.142:0/3386808967 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94671509901168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561a6db7e6c0 con 0x561a6db70760 2024-09-22T08:36:41.813 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.811+0000 7f88abfff640 1 -- 172.21.15.142:0/3386808967 <== osd.1 v2:172.21.15.142:6816/3192108003 29 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 94671509901168] v30'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f889c07f040 con 0x561a6db70760 2024-09-22T08:36:41.813 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.811+0000 7f88b420f800 20 remove_watcher() i=4 2024-09-22T08:36:41.813 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.811+0000 7f88b420f800 1 -- 172.21.15.142:0/3386808967 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94671509910816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561a6db7e6c0 con 0x7f88a4017050 2024-09-22T08:36:41.814 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.812+0000 7f88abfff640 1 -- 172.21.15.142:0/3386808967 <== osd.0 v2:172.21.15.31:6800/168281188 25 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 94671509910816] v30'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f889c07f040 con 0x7f88a4017050 2024-09-22T08:36:41.814 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.812+0000 7f88b420f800 20 remove_watcher() i=5 2024-09-22T08:36:41.814 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.812+0000 7f88b420f800 1 -- 172.21.15.142:0/3386808967 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94671509912384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561a6db7f520 con 0x7f88a4017050 2024-09-22T08:36:41.815 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.813+0000 7f88abfff640 1 -- 172.21.15.142:0/3386808967 <== osd.0 v2:172.21.15.31:6800/168281188 26 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 94671509912384] v30'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f889c07f040 con 0x7f88a4017050 2024-09-22T08:36:41.815 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.813+0000 7f88b420f800 20 remove_watcher() i=6 2024-09-22T08:36:41.815 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.813+0000 7f88b420f800 1 -- 172.21.15.142:0/3386808967 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94671509917040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561a6db7e6c0 con 0x7f88a4017050 2024-09-22T08:36:41.818 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.814+0000 7f88abfff640 1 -- 172.21.15.142:0/3386808967 <== osd.0 v2:172.21.15.31:6800/168281188 27 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 94671509917040] v30'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f889c07f040 con 0x7f88a4017050 2024-09-22T08:36:41.818 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.814+0000 7f88b420f800 20 remove_watcher() i=7 2024-09-22T08:36:41.818 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.814+0000 7f88b420f800 1 -- 172.21.15.142:0/3386808967 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f88a4017050 msgr2=0x7f88a4042130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:41.818 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.814+0000 7f88b420f800 1 --2- 172.21.15.142:0/3386808967 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f88a4017050 0x7f88a4042130 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:41.818 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.814+0000 7f88b420f800 1 -- 172.21.15.142:0/3386808967 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x561a6db70760 msgr2=0x561a6db72c20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:41.819 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.814+0000 7f88b420f800 1 --2- 172.21.15.142:0/3386808967 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x561a6db70760 0x561a6db72c20 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:41.819 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.814+0000 7f88b420f800 1 -- 172.21.15.142:0/3386808967 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f88ac03c3f0 msgr2=0x7f88ac034040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:41.819 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.814+0000 7f88b420f800 1 --2- 172.21.15.142:0/3386808967 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f88ac03c3f0 0x7f88ac034040 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:41.819 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.814+0000 7f88b420f800 1 -- 172.21.15.142:0/3386808967 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x561a6db75170 msgr2=0x561a6db77560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:41.819 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.814+0000 7f88b420f800 1 --2- 172.21.15.142:0/3386808967 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x561a6db75170 0x561a6db77560 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:41.819 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.814+0000 7f88b420f800 1 -- 172.21.15.142:0/3386808967 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f877c03cfb0 msgr2=0x7f877c03f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:41.819 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.814+0000 7f88b420f800 1 --2- 172.21.15.142:0/3386808967 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f877c03cfb0 0x7f877c03f470 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f88a40544d0 tx=0x7f88a4047000 comp rx=0 tx=0).stop 2024-09-22T08:36:41.819 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.814+0000 7f88b420f800 1 -- 172.21.15.142:0/3386808967 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561a6db5d830 msgr2=0x561a6db64e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:41.820 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.814+0000 7f88abfff640 1 -- 172.21.15.142:0/3386808967 reap_dead start 2024-09-22T08:36:41.820 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.814+0000 7f88b420f800 1 --2- 172.21.15.142:0/3386808967 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561a6db5d830 0x561a6db64e30 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f88ac054740 tx=0x7f88ac0547a0 comp rx=0 tx=0).stop 2024-09-22T08:36:41.820 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.814+0000 7f88b420f800 1 -- 172.21.15.142:0/3386808967 shutdown_connections 2024-09-22T08:36:41.820 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.814+0000 7f88b420f800 1 --2- 172.21.15.142:0/3386808967 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561a6db5d830 0x561a6db64e30 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:41.820 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.814+0000 7f88b420f800 1 -- 172.21.15.142:0/3386808967 >> 172.21.15.142:0/3386808967 conn(0x561a6db59c30 msgr2=0x561a6db57e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:41.820 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.814+0000 7f88b420f800 1 -- 172.21.15.142:0/3386808967 shutdown_connections 2024-09-22T08:36:41.821 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.814+0000 7f88b420f800 1 -- 172.21.15.142:0/3386808967 wait complete. 2024-09-22T08:36:41.821 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.814+0000 7f88b420f800 1 -- 172.21.15.142:0/2623220782 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f878c03cfb0 msgr2=0x7f878c03f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:41.821 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.814+0000 7f88b420f800 1 --2- 172.21.15.142:0/2623220782 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f878c03cfb0 0x7f878c03f470 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f88a4052b00 tx=0x7f88a40529d0 comp rx=0 tx=0).stop 2024-09-22T08:36:41.821 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.814+0000 7f88b420f800 1 -- 172.21.15.142:0/2623220782 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561a6db50d70 msgr2=0x561a6db51190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:41.821 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.814+0000 7f88b420f800 1 --2- 172.21.15.142:0/2623220782 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561a6db50d70 0x561a6db51190 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x561a6db2e5a0 tx=0x7f88ac0167b0 comp rx=0 tx=0).stop 2024-09-22T08:36:41.821 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.814+0000 7f88b420f800 1 -- 172.21.15.142:0/2623220782 shutdown_connections 2024-09-22T08:36:41.821 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.814+0000 7f88b420f800 1 --2- 172.21.15.142:0/2623220782 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f878c03cfb0 0x7f878c03f470 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:41.821 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.814+0000 7f88b420f800 1 --2- 172.21.15.142:0/2623220782 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561a6db50d70 0x561a6db51190 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:41.821 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.814+0000 7f88b420f800 1 -- 172.21.15.142:0/2623220782 >> 172.21.15.142:0/2623220782 conn(0x561a6db45120 msgr2=0x561a6db45500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:41.821 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.814+0000 7f88b420f800 1 -- 172.21.15.142:0/2623220782 shutdown_connections 2024-09-22T08:36:41.821 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.814+0000 7f88b420f800 1 -- 172.21.15.142:0/2623220782 wait complete. 2024-09-22T08:36:41.821 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.815+0000 7f88b420f800 1 -- 172.21.15.142:0/3487363371 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x561a6da3f8e0 msgr2=0x561a6db3d0c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:41.822 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.815+0000 7f88b420f800 1 --2- 172.21.15.142:0/3487363371 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x561a6da3f8e0 0x561a6db3d0c0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:41.822 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.815+0000 7f88b420f800 1 -- 172.21.15.142:0/3487363371 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x561a6db3f910 msgr2=0x561a6db41d00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:41.822 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.815+0000 7f88b420f800 1 --2- 172.21.15.142:0/3487363371 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x561a6db3f910 0x561a6db41d00 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:41.822 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.815+0000 7f88b420f800 1 -- 172.21.15.142:0/3487363371 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f879803cfb0 msgr2=0x7f879803f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:41.822 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.815+0000 7f88b420f800 1 --2- 172.21.15.142:0/3487363371 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f879803cfb0 0x7f879803f470 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f889c057000 tx=0x7f889c052000 comp rx=0 tx=0).stop 2024-09-22T08:36:41.822 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.815+0000 7f88b420f800 1 -- 172.21.15.142:0/3487363371 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561a6da3bc60 msgr2=0x561a6db2ea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:41.822 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.815+0000 7f88b420f800 1 --2- 172.21.15.142:0/3487363371 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561a6da3bc60 0x561a6db2ea00 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x561a6db2bef0 tx=0x7f88a4000ed0 comp rx=0 tx=0).stop 2024-09-22T08:36:41.822 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.815+0000 7f88b420f800 1 -- 172.21.15.142:0/3487363371 shutdown_connections 2024-09-22T08:36:41.822 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.815+0000 7f88b420f800 1 --2- 172.21.15.142:0/3487363371 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x561a6db3f910 0x561a6db41d00 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:41.822 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.815+0000 7f88b420f800 1 --2- 172.21.15.142:0/3487363371 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x561a6da3f8e0 0x561a6db3d0c0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:41.823 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.815+0000 7f88b420f800 1 --2- 172.21.15.142:0/3487363371 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f879803cfb0 0x7f879803f470 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:41.823 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.815+0000 7f88b420f800 1 --2- 172.21.15.142:0/3487363371 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561a6da3bc60 0x561a6db2ea00 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:41.823 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.815+0000 7f88b420f800 1 -- 172.21.15.142:0/3487363371 >> 172.21.15.142:0/3487363371 conn(0x561a6da36310 msgr2=0x561a6db2c450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:41.823 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.815+0000 7f88b420f800 1 -- 172.21.15.142:0/3487363371 shutdown_connections 2024-09-22T08:36:41.823 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.815+0000 7f88b420f800 1 -- 172.21.15.142:0/3487363371 wait complete. 2024-09-22T08:36:41.825 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-22T08:36:41.826 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud'] 2024-09-22T08:36:41.826 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud'] 2024-09-22T08:36:41.826 DEBUG:teuthology.orchestra.run.smithi142:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud 2024-09-22T08:36:41.870 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:36:41.870 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:36:41.871 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.869+0000 7fe03e040800 1 Processor -- start 2024-09-22T08:36:41.872 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.869+0000 7fe03e040800 1 -- start start 2024-09-22T08:36:41.872 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.869+0000 7fe03e040800 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55655171f9e0 0x5565517205a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:41.872 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.869+0000 7fe03e040800 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5565515aaa20 con 0x556551720ae0 2024-09-22T08:36:41.872 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.869+0000 7fe03e040800 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x5565515aa7d0 con 0x55655171f9e0 2024-09-22T08:36:41.872 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.869+0000 7fe03bb2a640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55655171f9e0 0x5565517205a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:41.872 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.869+0000 7fe033329640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x556551720ae0 0x556551725630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.142:42254/0 (socket says 172.21.15.142:42254) 2024-09-22T08:36:41.872 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.869+0000 7fe03bb2a640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55655171f9e0 0x5565517205a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:37534/0 (socket says 172.21.15.142:37534) 2024-09-22T08:36:41.872 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.869+0000 7fe033329640 1 -- 172.21.15.142:0/3641778581 learned_addr learned my addr 172.21.15.142:0/3641778581 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-09-22T08:36:41.872 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.869+0000 7fe03bb2a640 1 -- 172.21.15.142:0/3641778581 >> v1:172.21.15.31:6789/0 conn(0x556551720ae0 legacy=0x556551725630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:41.872 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.869+0000 7fe03bb2a640 1 -- 172.21.15.142:0/3641778581 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5565517200e0 con 0x55655171f9e0 2024-09-22T08:36:41.873 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.871+0000 7fe03bb2a640 1 --2- 172.21.15.142:0/3641778581 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55655171f9e0 0x5565517205a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fe02c00a470 tx=0x7fe02c045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34f30ba52d37c7f4 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:41.873 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.871+0000 7fe03b329640 1 -- 172.21.15.142:0/3641778581 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe02c053570 con 0x55655171f9e0 2024-09-22T08:36:41.874 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.871+0000 7fe03b329640 1 -- 172.21.15.142:0/3641778581 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe02c058070 con 0x55655171f9e0 2024-09-22T08:36:41.874 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.871+0000 7fe03b329640 1 -- 172.21.15.142:0/3641778581 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe02c053880 con 0x55655171f9e0 2024-09-22T08:36:41.874 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.872+0000 7fe03e040800 1 -- 172.21.15.142:0/3641778581 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55655171f9e0 msgr2=0x5565517205a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:41.875 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.872+0000 7fe03e040800 1 --2- 172.21.15.142:0/3641778581 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55655171f9e0 0x5565517205a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fe02c00a470 tx=0x7fe02c045a20 comp rx=0 tx=0).stop 2024-09-22T08:36:41.875 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.872+0000 7fe03e040800 1 -- 172.21.15.142:0/3641778581 shutdown_connections 2024-09-22T08:36:41.875 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.872+0000 7fe03e040800 1 --2- 172.21.15.142:0/3641778581 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55655171f9e0 0x5565517205a0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:41.875 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.872+0000 7fe03e040800 1 -- 172.21.15.142:0/3641778581 >> 172.21.15.142:0/3641778581 conn(0x55655171adb0 msgr2=0x55655171d210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:41.875 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.872+0000 7fe03e040800 1 -- 172.21.15.142:0/3641778581 shutdown_connections 2024-09-22T08:36:41.875 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.872+0000 7fe03e040800 1 -- 172.21.15.142:0/3641778581 wait complete. 2024-09-22T08:36:41.888 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.886+0000 7fe03e040800 1 Processor -- start 2024-09-22T08:36:41.888 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.886+0000 7fe03e040800 1 -- start start 2024-09-22T08:36:41.888 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.886+0000 7fe03e040800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55655171f9e0 0x5565516952b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:41.888 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.886+0000 7fe03e040800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5565515b7dd0 con 0x55655171f9e0 2024-09-22T08:36:41.889 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.886+0000 7fe03bb2a640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55655171f9e0 0x5565516952b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:41.889 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.886+0000 7fe03bb2a640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55655171f9e0 0x5565516952b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:37546/0 (socket says 172.21.15.142:37546) 2024-09-22T08:36:41.889 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.886+0000 7fe03bb2a640 1 -- 172.21.15.142:0/2130759155 learned_addr learned my addr 172.21.15.142:0/2130759155 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:41.889 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.886+0000 7fe03bb2a640 1 -- 172.21.15.142:0/2130759155 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5565516958a0 con 0x55655171f9e0 2024-09-22T08:36:41.891 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.887+0000 7fe03bb2a640 1 --2- 172.21.15.142:0/2130759155 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55655171f9e0 0x5565516952b0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fe02c025c20 tx=0x7fe02c051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd4be37ecd5d3332 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:41.891 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.887+0000 7fdf29e0b640 1 -- 172.21.15.142:0/2130759155 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe02c053570 con 0x55655171f9e0 2024-09-22T08:36:41.891 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.887+0000 7fdf29e0b640 1 -- 172.21.15.142:0/2130759155 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe02c063070 con 0x55655171f9e0 2024-09-22T08:36:41.892 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.887+0000 7fdf29e0b640 1 -- 172.21.15.142:0/2130759155 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe02c053840 con 0x55655171f9e0 2024-09-22T08:36:41.892 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.887+0000 7fe03e040800 1 -- 172.21.15.142:0/2130759155 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55655171f9e0 msgr2=0x5565516952b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:41.892 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.887+0000 7fe03e040800 1 --2- 172.21.15.142:0/2130759155 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55655171f9e0 0x5565516952b0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fe02c025c20 tx=0x7fe02c051000 comp rx=0 tx=0).stop 2024-09-22T08:36:41.892 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.888+0000 7fe03e040800 1 -- 172.21.15.142:0/2130759155 shutdown_connections 2024-09-22T08:36:41.892 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.888+0000 7fe03e040800 1 --2- 172.21.15.142:0/2130759155 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55655171f9e0 0x5565516952b0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:41.892 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.888+0000 7fe03e040800 1 -- 172.21.15.142:0/2130759155 >> 172.21.15.142:0/2130759155 conn(0x55655171adb0 msgr2=0x55655180a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:41.892 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.888+0000 7fe03e040800 1 -- 172.21.15.142:0/2130759155 shutdown_connections 2024-09-22T08:36:41.892 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.888+0000 7fe03e040800 1 -- 172.21.15.142:0/2130759155 wait complete. 2024-09-22T08:36:41.892 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.888+0000 7fe03e040800 1 Processor -- start 2024-09-22T08:36:41.892 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.888+0000 7fe03e040800 1 -- start start 2024-09-22T08:36:41.892 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.888+0000 7fe03e040800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55655171f9e0 0x556551818c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:41.892 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.888+0000 7fe03e040800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x556551721350 con 0x55655171f9e0 2024-09-22T08:36:41.892 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.888+0000 7fe03bb2a640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55655171f9e0 0x556551818c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:41.893 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.888+0000 7fe03bb2a640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55655171f9e0 0x556551818c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:37554/0 (socket says 172.21.15.142:37554) 2024-09-22T08:36:41.893 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.888+0000 7fe03bb2a640 1 -- 172.21.15.142:0/2695773234 learned_addr learned my addr 172.21.15.142:0/2695773234 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:41.893 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.889+0000 7fe03bb2a640 1 -- 172.21.15.142:0/2695773234 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556551819180 con 0x55655171f9e0 2024-09-22T08:36:41.893 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.889+0000 7fe03bb2a640 1 --2- 172.21.15.142:0/2695773234 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55655171f9e0 0x556551818c20 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fe02c025c20 tx=0x7fe02c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:41.893 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.889+0000 7fdf23fff640 1 -- 172.21.15.142:0/2695773234 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe02c074480 con 0x55655171f9e0 2024-09-22T08:36:41.893 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.889+0000 7fdf23fff640 1 -- 172.21.15.142:0/2695773234 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe02c074620 con 0x55655171f9e0 2024-09-22T08:36:41.893 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.889+0000 7fdf23fff640 1 -- 172.21.15.142:0/2695773234 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe02c074900 con 0x55655171f9e0 2024-09-22T08:36:41.893 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.889+0000 7fe03e040800 1 -- 172.21.15.142:0/2695773234 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556551819410 con 0x55655171f9e0 2024-09-22T08:36:41.893 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.889+0000 7fe03e040800 1 -- 172.21.15.142:0/2695773234 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55655181a020 con 0x55655171f9e0 2024-09-22T08:36:41.916 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.890+0000 7fdf23fff640 1 -- 172.21.15.142:0/2695773234 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fe02c074aa0 con 0x55655171f9e0 2024-09-22T08:36:41.916 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.890+0000 7fdf23fff640 1 --2- 172.21.15.142:0/2695773234 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fdf2403d000 0x7fdf2403f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:41.916 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.890+0000 7fdf23fff640 1 -- 172.21.15.142:0/2695773234 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fe02c098920 con 0x55655171f9e0 2024-09-22T08:36:41.916 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.890+0000 7fe033329640 1 --2- 172.21.15.142:0/2695773234 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fdf2403d000 0x7fdf2403f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:41.916 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.890+0000 7fe03e040800 1 --2- 172.21.15.142:0/2695773234 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x556551720ae0 0x556551820270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:41.916 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.890+0000 7fe03e040800 1 -- 172.21.15.142:0/2695773234 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55655181a9e0 con 0x556551720ae0 2024-09-22T08:36:41.916 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.890+0000 7fe03c32b640 1 --2- 172.21.15.142:0/2695773234 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x556551720ae0 0x556551820270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:41.917 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.891+0000 7fe033329640 1 --2- 172.21.15.142:0/2695773234 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fdf2403d000 0x7fdf2403f4c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe024004170 tx=0x7fe024001330 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:41.917 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.891+0000 7fe03c32b640 1 --2- 172.21.15.142:0/2695773234 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x556551720ae0 0x556551820270 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:41.917 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.891+0000 7fe03c32b640 1 -- 172.21.15.142:0/2695773234 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe03400a4d0 con 0x556551720ae0 2024-09-22T08:36:41.917 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.891+0000 7fe03e040800 1 -- 172.21.15.142:0/2695773234 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556551820cd0 con 0x556551720ae0 2024-09-22T08:36:41.917 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.891+0000 7fe03c32b640 1 -- 172.21.15.142:0/2695773234 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe03400a4d0 con 0x556551720ae0 2024-09-22T08:36:41.917 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.891+0000 7fe03e040800 1 --2- 172.21.15.142:0/2695773234 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5565518225e0 0x556551824a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:41.917 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.891+0000 7fe03e040800 1 -- 172.21.15.142:0/2695773234 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:3 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556551825210 con 0x5565518225e0 2024-09-22T08:36:41.917 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.891+0000 7fe03bb2a640 1 --2- 172.21.15.142:0/2695773234 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5565518225e0 0x556551824a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:41.917 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.892+0000 7fe03bb2a640 1 --2- 172.21.15.142:0/2695773234 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5565518225e0 0x556551824a80 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:41.917 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.892+0000 7fe03bb2a640 1 -- 172.21.15.142:0/2695773234 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(3 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fe02c051070 con 0x5565518225e0 2024-09-22T08:36:41.917 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.892+0000 7fe03e040800 1 -- 172.21.15.142:0/2695773234 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556551821520 con 0x556551720ae0 2024-09-22T08:36:41.917 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.892+0000 7fe03c32b640 1 -- 172.21.15.142:0/2695773234 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe03400a4d0 con 0x556551720ae0 2024-09-22T08:36:41.917 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.892+0000 7fe03e040800 1 -- 172.21.15.142:0/2695773234 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5565518218c0 con 0x5565518225e0 2024-09-22T08:36:41.918 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.893+0000 7fe03bb2a640 1 -- 172.21.15.142:0/2695773234 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(5 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fe02c051070 con 0x5565518225e0 2024-09-22T08:36:41.918 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.893+0000 7fe03e040800 1 Processor -- start 2024-09-22T08:36:41.918 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.893+0000 7fe03e040800 1 -- start start 2024-09-22T08:36:41.918 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.893+0000 7fe03e040800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556551833ac0 0x556551833ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:41.918 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.893+0000 7fe03e040800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x556551616d50 con 0x556551833ac0 2024-09-22T08:36:41.918 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.893+0000 7fe03c32b640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556551833ac0 0x556551833ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:41.918 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.893+0000 7fe03c32b640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556551833ac0 0x556551833ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:37558/0 (socket says 172.21.15.142:37558) 2024-09-22T08:36:41.918 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.893+0000 7fe03c32b640 1 -- 172.21.15.142:0/4229571053 learned_addr learned my addr 172.21.15.142:0/4229571053 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:41.918 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.894+0000 7fe03c32b640 1 -- 172.21.15.142:0/4229571053 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556551834520 con 0x556551833ac0 2024-09-22T08:36:41.918 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.894+0000 7fe03c32b640 1 --2- 172.21.15.142:0/4229571053 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556551833ac0 0x556551833ee0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x556551819c20 tx=0x7fe0340167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:41.919 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.894+0000 7fdf217fa640 1 -- 172.21.15.142:0/4229571053 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe034021570 con 0x556551833ac0 2024-09-22T08:36:41.919 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.894+0000 7fdf217fa640 1 -- 172.21.15.142:0/4229571053 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe034021710 con 0x556551833ac0 2024-09-22T08:36:41.919 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.894+0000 7fe03e040800 1 -- 172.21.15.142:0/4229571053 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556551834d50 con 0x556551833ac0 2024-09-22T08:36:41.919 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.894+0000 7fdf217fa640 1 -- 172.21.15.142:0/4229571053 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe0340219f0 con 0x556551833ac0 2024-09-22T08:36:41.919 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.894+0000 7fe03e040800 1 -- 172.21.15.142:0/4229571053 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5565518352f0 con 0x556551833ac0 2024-09-22T08:36:41.919 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.895+0000 7fdf217fa640 1 -- 172.21.15.142:0/4229571053 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fe034011040 con 0x556551833ac0 2024-09-22T08:36:41.919 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.895+0000 7fdf217fa640 1 --2- 172.21.15.142:0/4229571053 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fdf1403cfb0 0x7fdf1403f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:41.919 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.895+0000 7fdf217fa640 1 -- 172.21.15.142:0/4229571053 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fe03400e040 con 0x556551833ac0 2024-09-22T08:36:41.919 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.895+0000 7fe03bb2a640 1 --2- 172.21.15.142:0/4229571053 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fdf1403cfb0 0x7fdf1403f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:41.919 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.895+0000 7fe03e040800 1 Processor -- start 2024-09-22T08:36:41.919 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.895+0000 7fe03e040800 1 -- start start 2024-09-22T08:36:41.919 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.895+0000 7fe03bb2a640 1 --2- 172.21.15.142:0/4229571053 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fdf1403cfb0 0x7fdf1403f470 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe02c074fd0 tx=0x7fe02c05f520 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:41.920 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.895+0000 7fe03e040800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5565518405a0 0x5565518409a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:41.920 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.895+0000 7fe03e040800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x556551693cf0 con 0x5565518405a0 2024-09-22T08:36:41.920 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.896+0000 7fe03c32b640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5565518405a0 0x5565518409a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:41.920 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.896+0000 7fe03c32b640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5565518405a0 0x5565518409a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:37566/0 (socket says 172.21.15.142:37566) 2024-09-22T08:36:41.920 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.896+0000 7fe03c32b640 1 -- 172.21.15.142:0/438104675 learned_addr learned my addr 172.21.15.142:0/438104675 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:41.920 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.896+0000 7fe03c32b640 1 -- 172.21.15.142:0/438104675 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556551840f90 con 0x5565518405a0 2024-09-22T08:36:41.920 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.896+0000 7fe03c32b640 1 --2- 172.21.15.142:0/438104675 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5565518405a0 0x5565518409a0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fe034054990 tx=0x7fe034014b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d23900c1f00344 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:41.920 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.896+0000 7fdf1affd640 1 -- 172.21.15.142:0/438104675 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe0340560d0 con 0x5565518405a0 2024-09-22T08:36:41.920 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.896+0000 7fdf1affd640 1 -- 172.21.15.142:0/438104675 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe034056270 con 0x5565518405a0 2024-09-22T08:36:41.920 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.896+0000 7fdf1affd640 1 -- 172.21.15.142:0/438104675 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe03401fa30 con 0x5565518405a0 2024-09-22T08:36:41.920 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.897+0000 7fe03e040800 1 -- 172.21.15.142:0/438104675 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5565518405a0 msgr2=0x5565518409a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:41.920 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.897+0000 7fe03e040800 1 --2- 172.21.15.142:0/438104675 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5565518405a0 0x5565518409a0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fe034054990 tx=0x7fe034014b90 comp rx=0 tx=0).stop 2024-09-22T08:36:41.920 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.897+0000 7fe03e040800 1 -- 172.21.15.142:0/438104675 shutdown_connections 2024-09-22T08:36:41.921 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.897+0000 7fe03e040800 1 --2- 172.21.15.142:0/438104675 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5565518405a0 0x5565518409a0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:41.921 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.897+0000 7fe03e040800 1 -- 172.21.15.142:0/438104675 >> 172.21.15.142:0/438104675 conn(0x55655183c9a0 msgr2=0x55655183abe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:41.921 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.897+0000 7fe03e040800 1 -- 172.21.15.142:0/438104675 shutdown_connections 2024-09-22T08:36:41.921 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.897+0000 7fe03e040800 1 -- 172.21.15.142:0/438104675 wait complete. 2024-09-22T08:36:41.921 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.897+0000 7fe03e040800 1 Processor -- start 2024-09-22T08:36:41.921 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.897+0000 7fe03e040800 1 -- start start 2024-09-22T08:36:41.921 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.897+0000 7fe03e040800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5565518405a0 0x556551847b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:41.921 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.897+0000 7fe03e040800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5565518415b0 con 0x5565518405a0 2024-09-22T08:36:41.921 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.897+0000 7fe03c32b640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5565518405a0 0x556551847b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:41.921 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.897+0000 7fe03c32b640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5565518405a0 0x556551847b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:37574/0 (socket says 172.21.15.142:37574) 2024-09-22T08:36:41.921 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.897+0000 7fe03c32b640 1 -- 172.21.15.142:0/3285759096 learned_addr learned my addr 172.21.15.142:0/3285759096 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:41.921 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.898+0000 7fe03c32b640 1 -- 172.21.15.142:0/3285759096 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5565518480d0 con 0x5565518405a0 2024-09-22T08:36:41.921 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.898+0000 7fe03c32b640 1 --2- 172.21.15.142:0/3285759096 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5565518405a0 0x556551847b70 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fe03402a700 tx=0x7fe0340548f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:41.922 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.898+0000 7fdf197fa640 1 -- 172.21.15.142:0/3285759096 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe0340560d0 con 0x5565518405a0 2024-09-22T08:36:41.922 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.898+0000 7fdf197fa640 1 -- 172.21.15.142:0/3285759096 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe034045d40 con 0x5565518405a0 2024-09-22T08:36:41.922 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.898+0000 7fe03e040800 1 -- 172.21.15.142:0/3285759096 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556551848360 con 0x5565518405a0 2024-09-22T08:36:41.922 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.898+0000 7fdf197fa640 1 -- 172.21.15.142:0/3285759096 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe03401f340 con 0x5565518405a0 2024-09-22T08:36:41.922 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.898+0000 7fe03e040800 1 -- 172.21.15.142:0/3285759096 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556551848ef0 con 0x5565518405a0 2024-09-22T08:36:41.922 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.899+0000 7fdf197fa640 1 -- 172.21.15.142:0/3285759096 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fe03401f4e0 con 0x5565518405a0 2024-09-22T08:36:41.922 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.899+0000 7fdf197fa640 1 --2- 172.21.15.142:0/3285759096 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fdf0403d000 0x7fdf0403f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:41.922 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.899+0000 7fdf197fa640 1 -- 172.21.15.142:0/3285759096 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fe034033a50 con 0x5565518405a0 2024-09-22T08:36:41.922 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.899+0000 7fe03bb2a640 1 --2- 172.21.15.142:0/3285759096 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fdf0403d000 0x7fdf0403f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:41.922 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.899+0000 7fe03bb2a640 1 --2- 172.21.15.142:0/3285759096 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fdf0403d000 0x7fdf0403f4c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe02c05db40 tx=0x7fe02c08a000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:41.922 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.900+0000 7fe03e040800 20 rados->read ofs=0 len=0 2024-09-22T08:36:41.922 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.900+0000 7fe03e040800 1 --2- 172.21.15.142:0/3285759096 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5565518534a0 0x556551855960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:41.923 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.900+0000 7fe03e040800 1 -- 172.21.15.142:0/3285759096 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5565518560b0 con 0x5565518534a0 2024-09-22T08:36:41.923 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.900+0000 7fe033329640 1 --2- 172.21.15.142:0/3285759096 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5565518534a0 0x556551855960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:41.923 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.900+0000 7fe033329640 1 --2- 172.21.15.142:0/3285759096 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5565518534a0 0x556551855960 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:41.923 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.900+0000 7fe033329640 1 -- 172.21.15.142:0/3285759096 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe024009050 con 0x5565518534a0 2024-09-22T08:36:41.923 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.900+0000 7fe03e040800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:41.923 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.900+0000 7fe03e040800 20 realm 2024-09-22T08:36:41.923 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.900+0000 7fe03e040800 20 rados->read ofs=0 len=0 2024-09-22T08:36:41.923 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.900+0000 7fe03e040800 1 -- 172.21.15.142:0/3285759096 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5565518527f0 con 0x5565518534a0 2024-09-22T08:36:41.923 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.900+0000 7fe033329640 1 -- 172.21.15.142:0/3285759096 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe024009050 con 0x5565518534a0 2024-09-22T08:36:41.923 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.901+0000 7fe03e040800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:41.923 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.901+0000 7fe03e040800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:36:41.923 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.901+0000 7fe03e040800 20 rados->read ofs=0 len=0 2024-09-22T08:36:41.923 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.901+0000 7fe03e040800 1 -- 172.21.15.142:0/3285759096 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556551856ba0 con 0x5565518534a0 2024-09-22T08:36:41.923 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.901+0000 7fe033329640 1 -- 172.21.15.142:0/3285759096 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe024009050 con 0x5565518534a0 2024-09-22T08:36:41.923 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.901+0000 7fe03e040800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:41.924 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.901+0000 7fe03e040800 20 rados->read ofs=0 len=0 2024-09-22T08:36:41.924 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.901+0000 7fe03e040800 1 -- 172.21.15.142:0/3285759096 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556551857470 con 0x5565518534a0 2024-09-22T08:36:41.924 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.901+0000 7fe033329640 1 -- 172.21.15.142:0/3285759096 <== osd.1 v2:172.21.15.142:6816/3192108003 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe024009050 con 0x5565518534a0 2024-09-22T08:36:41.924 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.901+0000 7fe03e040800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:36:41.924 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.901+0000 7fe03e040800 20 rados->read ofs=0 len=0 2024-09-22T08:36:41.924 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.901+0000 7fe03e040800 1 --2- 172.21.15.142:0/3285759096 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x556551857e90 0x55655185a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:41.924 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.901+0000 7fe03e040800 1 -- 172.21.15.142:0/3285759096 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55655185a950 con 0x556551857e90 2024-09-22T08:36:41.924 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.901+0000 7fe03c32b640 1 --2- 172.21.15.142:0/3285759096 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x556551857e90 0x55655185a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:41.924 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.901+0000 7fe03c32b640 1 --2- 172.21.15.142:0/3285759096 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x556551857e90 0x55655185a280 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:41.924 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.902+0000 7fe03c32b640 1 -- 172.21.15.142:0/3285759096 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(5 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fe03403a070 con 0x556551857e90 2024-09-22T08:36:41.924 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.902+0000 7fe03e040800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:36:41.924 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.902+0000 7fe03e040800 20 searching for the correct realm 2024-09-22T08:36:41.924 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.902+0000 7fe03e040800 1 -- 172.21.15.142:0/3285759096 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55655185c2a0 con 0x556551857e90 2024-09-22T08:36:41.925 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.902+0000 7fe03c32b640 1 -- 172.21.15.142:0/3285759096 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe03403a070 con 0x556551857e90 2024-09-22T08:36:41.925 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.902+0000 7fe03c32b640 1 --2- 172.21.15.142:0/3285759096 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7fe034029ab0 0x7fe034055030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:41.925 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.902+0000 7fe03c32b640 1 -- 172.21.15.142:0/3285759096 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55655185c2a0 con 0x7fe034029ab0 2024-09-22T08:36:41.925 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.902+0000 7fe03bb2a640 1 --2- 172.21.15.142:0/3285759096 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7fe034029ab0 0x7fe034055030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:41.925 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.902+0000 7fe03bb2a640 1 --2- 172.21.15.142:0/3285759096 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7fe034029ab0 0x7fe034055030 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:41.925 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.903+0000 7fe03bb2a640 1 -- 172.21.15.142:0/3285759096 <== osd.2 v2:172.21.15.142:6808/279438927 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe02c051070 con 0x7fe034029ab0 2024-09-22T08:36:41.925 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.903+0000 7fe03bb2a640 1 --2- 172.21.15.142:0/3285759096 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7fe02c0a5040 0x7fe02c05e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:41.925 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.903+0000 7fe03bb2a640 1 -- 172.21.15.142:0/3285759096 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55655185c2a0 con 0x7fe02c0a5040 2024-09-22T08:36:41.925 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.903+0000 7fe033329640 1 --2- 172.21.15.142:0/3285759096 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7fe02c0a5040 0x7fe02c05e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:41.925 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.903+0000 7fe033329640 1 --2- 172.21.15.142:0/3285759096 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7fe02c0a5040 0x7fe02c05e8a0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:41.925 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.903+0000 7fe033329640 1 -- 172.21.15.142:0/3285759096 <== osd.0 v2:172.21.15.31:6800/168281188 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe024009050 con 0x7fe02c0a5040 2024-09-22T08:36:41.925 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.903+0000 7fe033329640 1 -- 172.21.15.142:0/3285759096 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55655185c2a0 con 0x5565518534a0 2024-09-22T08:36:41.925 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.904+0000 7fe033329640 1 -- 172.21.15.142:0/3285759096 <== osd.1 v2:172.21.15.142:6816/3192108003 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe024009050 con 0x5565518534a0 2024-09-22T08:36:41.926 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.904+0000 7fe033329640 1 -- 172.21.15.142:0/3285759096 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55655185c2a0 con 0x5565518534a0 2024-09-22T08:36:41.926 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.904+0000 7fe033329640 1 -- 172.21.15.142:0/3285759096 <== osd.1 v2:172.21.15.142:6816/3192108003 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe024029040 con 0x5565518534a0 2024-09-22T08:36:41.926 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.904+0000 7fe033329640 1 -- 172.21.15.142:0/3285759096 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55655185c2a0 con 0x7fe02c0a5040 2024-09-22T08:36:41.926 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.904+0000 7fe033329640 1 -- 172.21.15.142:0/3285759096 <== osd.0 v2:172.21.15.31:6800/168281188 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe024029040 con 0x7fe02c0a5040 2024-09-22T08:36:41.926 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.904+0000 7fe033329640 1 -- 172.21.15.142:0/3285759096 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55655185c2a0 con 0x7fe02c0a5040 2024-09-22T08:36:41.926 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.904+0000 7fe033329640 1 -- 172.21.15.142:0/3285759096 <== osd.0 v2:172.21.15.31:6800/168281188 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe024029040 con 0x7fe02c0a5040 2024-09-22T08:36:41.926 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.904+0000 7fe033329640 1 -- 172.21.15.142:0/3285759096 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55655185c2a0 con 0x7fe034029ab0 2024-09-22T08:36:41.926 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.905+0000 7fe03bb2a640 1 -- 172.21.15.142:0/3285759096 <== osd.2 v2:172.21.15.142:6808/279438927 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe02c051070 con 0x7fe034029ab0 2024-09-22T08:36:41.926 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.905+0000 7fe03bb2a640 1 -- 172.21.15.142:0/3285759096 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55655185c2a0 con 0x556551857e90 2024-09-22T08:36:41.926 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.905+0000 7fe03c32b640 1 -- 172.21.15.142:0/3285759096 <== osd.3 v2:172.21.15.142:6800/1064901393 3 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe03403a070 con 0x556551857e90 2024-09-22T08:36:41.926 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.905+0000 7fe03c32b640 1 -- 172.21.15.142:0/3285759096 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55655185c2a0 con 0x5565518534a0 2024-09-22T08:36:41.926 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.905+0000 7fe033329640 1 -- 172.21.15.142:0/3285759096 <== osd.1 v2:172.21.15.142:6816/3192108003 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe024029040 con 0x5565518534a0 2024-09-22T08:36:41.926 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.905+0000 7fe033329640 1 -- 172.21.15.142:0/3285759096 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55655185c2a0 con 0x7fe02c0a5040 2024-09-22T08:36:41.927 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.905+0000 7fe033329640 1 -- 172.21.15.142:0/3285759096 <== osd.0 v2:172.21.15.31:6800/168281188 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe024029040 con 0x7fe02c0a5040 2024-09-22T08:36:41.927 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.905+0000 7fe033329640 1 -- 172.21.15.142:0/3285759096 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55655185c2a0 con 0x5565518534a0 2024-09-22T08:36:41.927 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.906+0000 7fe033329640 1 -- 172.21.15.142:0/3285759096 <== osd.1 v2:172.21.15.142:6816/3192108003 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe024029040 con 0x5565518534a0 2024-09-22T08:36:41.927 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.906+0000 7fe033329640 1 -- 172.21.15.142:0/3285759096 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55655185c2a0 con 0x7fe034029ab0 2024-09-22T08:36:41.927 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.906+0000 7fe03bb2a640 1 -- 172.21.15.142:0/3285759096 <== osd.2 v2:172.21.15.142:6808/279438927 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fe02c051070 con 0x7fe034029ab0 2024-09-22T08:36:41.927 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.906+0000 7fe03bb2a640 1 -- 172.21.15.142:0/3285759096 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55655185c2a0 con 0x556551857e90 2024-09-22T08:36:41.927 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.906+0000 7fe03c32b640 1 -- 172.21.15.142:0/3285759096 <== osd.3 v2:172.21.15.142:6800/1064901393 4 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe03403a070 con 0x556551857e90 2024-09-22T08:36:41.927 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.906+0000 7fe03c32b640 1 -- 172.21.15.142:0/3285759096 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55655185c2a0 con 0x556551857e90 2024-09-22T08:36:41.927 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.906+0000 7fe03c32b640 1 -- 172.21.15.142:0/3285759096 <== osd.3 v2:172.21.15.142:6800/1064901393 5 ==== osd_op_reply(20 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fe03403a070 con 0x556551857e90 2024-09-22T08:36:41.927 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.906+0000 7fe03c32b640 1 -- 172.21.15.142:0/3285759096 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55655185c2a0 con 0x7fe02c0a5040 2024-09-22T08:36:41.927 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.907+0000 7fe033329640 1 -- 172.21.15.142:0/3285759096 <== osd.0 v2:172.21.15.31:6800/168281188 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe024029040 con 0x7fe02c0a5040 2024-09-22T08:36:41.927 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.907+0000 7fe033329640 1 -- 172.21.15.142:0/3285759096 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55655185c2a0 con 0x556551857e90 2024-09-22T08:36:41.928 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.907+0000 7fe03c32b640 1 -- 172.21.15.142:0/3285759096 <== osd.3 v2:172.21.15.142:6800/1064901393 6 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe03403a070 con 0x556551857e90 2024-09-22T08:36:41.928 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.907+0000 7fe03c32b640 1 -- 172.21.15.142:0/3285759096 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55655185c2a0 con 0x556551857e90 2024-09-22T08:36:41.928 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.907+0000 7fe03c32b640 1 -- 172.21.15.142:0/3285759096 <== osd.3 v2:172.21.15.142:6800/1064901393 7 ==== osd_op_reply(23 [pgnls start_epoch 30 out=107b] v23'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fe03403a070 con 0x556551857e90 2024-09-22T08:36:41.928 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.907+0000 7fe03c32b640 1 -- 172.21.15.142:0/3285759096 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55655185c2a0 con 0x5565518534a0 2024-09-22T08:36:41.928 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.907+0000 7fe033329640 1 -- 172.21.15.142:0/3285759096 <== osd.1 v2:172.21.15.142:6816/3192108003 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe024029040 con 0x5565518534a0 2024-09-22T08:36:41.928 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.907+0000 7fe033329640 1 -- 172.21.15.142:0/3285759096 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55655185c2a0 con 0x5565518534a0 2024-09-22T08:36:41.928 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.907+0000 7fe033329640 1 -- 172.21.15.142:0/3285759096 <== osd.1 v2:172.21.15.142:6816/3192108003 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fe024029040 con 0x5565518534a0 2024-09-22T08:36:41.928 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.907+0000 7fe033329640 1 -- 172.21.15.142:0/3285759096 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55655185c2a0 con 0x7fe02c0a5040 2024-09-22T08:36:41.928 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.908+0000 7fe033329640 1 -- 172.21.15.142:0/3285759096 <== osd.0 v2:172.21.15.31:6800/168281188 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe024029040 con 0x7fe02c0a5040 2024-09-22T08:36:41.928 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.908+0000 7fe033329640 1 -- 172.21.15.142:0/3285759096 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55655185c2a0 con 0x556551857e90 2024-09-22T08:36:41.928 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.908+0000 7fe03c32b640 1 -- 172.21.15.142:0/3285759096 <== osd.3 v2:172.21.15.142:6800/1064901393 8 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe03403a070 con 0x556551857e90 2024-09-22T08:36:41.928 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.908+0000 7fe03c32b640 1 -- 172.21.15.142:0/3285759096 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55655185c2a0 con 0x7fe034029ab0 2024-09-22T08:36:41.929 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.908+0000 7fe03bb2a640 1 -- 172.21.15.142:0/3285759096 <== osd.2 v2:172.21.15.142:6808/279438927 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe02c051070 con 0x7fe034029ab0 2024-09-22T08:36:41.929 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.908+0000 7fe03bb2a640 1 -- 172.21.15.142:0/3285759096 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55655185c2a0 con 0x5565518534a0 2024-09-22T08:36:41.929 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.908+0000 7fe033329640 1 -- 172.21.15.142:0/3285759096 <== osd.1 v2:172.21.15.142:6816/3192108003 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe024029040 con 0x5565518534a0 2024-09-22T08:36:41.929 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.908+0000 7fe033329640 1 -- 172.21.15.142:0/3285759096 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55655185c2a0 con 0x7fe02c0a5040 2024-09-22T08:36:41.929 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.909+0000 7fe033329640 1 -- 172.21.15.142:0/3285759096 <== osd.0 v2:172.21.15.31:6800/168281188 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe024029040 con 0x7fe02c0a5040 2024-09-22T08:36:41.929 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.909+0000 7fe033329640 1 -- 172.21.15.142:0/3285759096 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55655185c2a0 con 0x556551857e90 2024-09-22T08:36:41.929 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.909+0000 7fe03c32b640 1 -- 172.21.15.142:0/3285759096 <== osd.3 v2:172.21.15.142:6800/1064901393 9 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe03403a070 con 0x556551857e90 2024-09-22T08:36:41.929 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.909+0000 7fe03c32b640 1 -- 172.21.15.142:0/3285759096 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55655185c2a0 con 0x7fe02c0a5040 2024-09-22T08:36:41.929 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.909+0000 7fe033329640 1 -- 172.21.15.142:0/3285759096 <== osd.0 v2:172.21.15.31:6800/168281188 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe024029040 con 0x7fe02c0a5040 2024-09-22T08:36:41.929 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.909+0000 7fe033329640 1 -- 172.21.15.142:0/3285759096 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55655185c2a0 con 0x7fe034029ab0 2024-09-22T08:36:41.930 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.909+0000 7fe03bb2a640 1 -- 172.21.15.142:0/3285759096 <== osd.2 v2:172.21.15.142:6808/279438927 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe02c051070 con 0x7fe034029ab0 2024-09-22T08:36:41.930 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.909+0000 7fe03bb2a640 1 -- 172.21.15.142:0/3285759096 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55655185c2a0 con 0x556551857e90 2024-09-22T08:36:41.930 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.910+0000 7fe03c32b640 1 -- 172.21.15.142:0/3285759096 <== osd.3 v2:172.21.15.142:6800/1064901393 10 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe03403a070 con 0x556551857e90 2024-09-22T08:36:41.930 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.910+0000 7fe03c32b640 1 -- 172.21.15.142:0/3285759096 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55655185c2a0 con 0x7fe02c0a5040 2024-09-22T08:36:41.930 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.910+0000 7fe033329640 1 -- 172.21.15.142:0/3285759096 <== osd.0 v2:172.21.15.31:6800/168281188 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe024029040 con 0x7fe02c0a5040 2024-09-22T08:36:41.930 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.910+0000 7fe033329640 1 -- 172.21.15.142:0/3285759096 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55655185c2a0 con 0x5565518534a0 2024-09-22T08:36:41.930 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.910+0000 7fe033329640 1 -- 172.21.15.142:0/3285759096 <== osd.1 v2:172.21.15.142:6816/3192108003 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fe024029040 con 0x5565518534a0 2024-09-22T08:36:41.930 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.910+0000 7fe033329640 1 -- 172.21.15.142:0/3285759096 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55655185c2a0 con 0x7fe034029ab0 2024-09-22T08:36:41.930 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.910+0000 7fe03bb2a640 1 -- 172.21.15.142:0/3285759096 <== osd.2 v2:172.21.15.142:6808/279438927 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe02c051070 con 0x7fe034029ab0 2024-09-22T08:36:41.930 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.910+0000 7fe03e040800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:36:41.930 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.910+0000 7fe03e040800 20 RGWRados::pool_iterate: got zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec 2024-09-22T08:36:41.930 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.910+0000 7fe03e040800 20 RGWRados::pool_iterate: got zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f 2024-09-22T08:36:41.931 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.910+0000 7fe03e040800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:36:41.931 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.910+0000 7fe03e040800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:36:41.931 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.910+0000 7fe03e040800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:36:41.931 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.910+0000 7fe03e040800 20 rados->read ofs=0 len=0 2024-09-22T08:36:41.931 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.910+0000 7fe03e040800 1 -- 172.21.15.142:0/3285759096 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55655185b310 con 0x5565518534a0 2024-09-22T08:36:41.931 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.911+0000 7fe033329640 1 -- 172.21.15.142:0/3285759096 <== osd.1 v2:172.21.15.142:6816/3192108003 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe024029040 con 0x5565518534a0 2024-09-22T08:36:41.931 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.911+0000 7fe03e040800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:41.931 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.911+0000 7fe03e040800 20 rados->read ofs=0 len=0 2024-09-22T08:36:41.931 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.911+0000 7fe03e040800 1 -- 172.21.15.142:0/3285759096 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55655185bbb0 con 0x5565518534a0 2024-09-22T08:36:41.931 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.911+0000 7fe033329640 1 -- 172.21.15.142:0/3285759096 <== osd.1 v2:172.21.15.142:6816/3192108003 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe024029040 con 0x5565518534a0 2024-09-22T08:36:41.931 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.911+0000 7fe03e040800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:36:41.931 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.911+0000 7fe03e040800 20 rados->read ofs=0 len=0 2024-09-22T08:36:41.931 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.911+0000 7fe03e040800 1 -- 172.21.15.142:0/3285759096 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:40 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55655185c720 con 0x556551857e90 2024-09-22T08:36:41.932 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.911+0000 7fe03c32b640 1 -- 172.21.15.142:0/3285759096 <== osd.3 v2:172.21.15.142:6800/1064901393 11 ==== osd_op_reply(40 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fe03403a070 con 0x556551857e90 2024-09-22T08:36:41.932 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.911+0000 7fe03e040800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:36:41.932 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.911+0000 7fe03e040800 20 zone default found 2024-09-22T08:36:41.932 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.911+0000 7fe03e040800 4 Realm: () 2024-09-22T08:36:41.932 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.911+0000 7fe03e040800 4 ZoneGroup: default (d89f6f57-1007-47dd-9065-f486c7b01aec) 2024-09-22T08:36:41.932 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.911+0000 7fe03e040800 4 Zone: default (e239248c-0bee-4e41-803a-24b288d3eb8f) 2024-09-22T08:36:41.932 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.911+0000 7fe03e040800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:36:41.932 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.911+0000 7fe03e040800 20 zonegroup default 2024-09-22T08:36:41.932 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.911+0000 7fe03e040800 20 rados->read ofs=0 len=0 2024-09-22T08:36:41.932 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.911+0000 7fe03e040800 1 -- 172.21.15.142:0/3285759096 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55655185cac0 con 0x7fe02c0a5040 2024-09-22T08:36:41.932 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.911+0000 7fe033329640 1 -- 172.21.15.142:0/3285759096 <== osd.0 v2:172.21.15.31:6800/168281188 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fe024029040 con 0x7fe02c0a5040 2024-09-22T08:36:41.932 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.911+0000 7fe03e040800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:41.932 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.911+0000 7fe03e040800 20 rados->read ofs=0 len=0 2024-09-22T08:36:41.932 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.911+0000 7fe03e040800 1 -- 172.21.15.142:0/3285759096 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55655185ed80 con 0x556551857e90 2024-09-22T08:36:41.933 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.912+0000 7fe03c32b640 1 -- 172.21.15.142:0/3285759096 <== osd.3 v2:172.21.15.142:6800/1064901393 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe03403a070 con 0x556551857e90 2024-09-22T08:36:41.933 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.912+0000 7fe03e040800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:41.933 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.912+0000 7fe03e040800 20 rados->read ofs=0 len=0 2024-09-22T08:36:41.933 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.912+0000 7fe03e040800 1 -- 172.21.15.142:0/3285759096 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55655185f120 con 0x556551857e90 2024-09-22T08:36:41.933 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.912+0000 7fe03c32b640 1 -- 172.21.15.142:0/3285759096 <== osd.3 v2:172.21.15.142:6800/1064901393 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe03403a070 con 0x556551857e90 2024-09-22T08:36:41.933 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.912+0000 7fe03e040800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:41.933 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.912+0000 7fe03e040800 20 started sync module instance, tier type = 2024-09-22T08:36:41.933 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.912+0000 7fe03e040800 20 started zone id=e239248c-0bee-4e41-803a-24b288d3eb8f (name=default) with tier type = 2024-09-22T08:36:41.933 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.912+0000 7fe03e040800 1 -- 172.21.15.142:0/3285759096 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55655185e1c0 con 0x7fe034029ab0 2024-09-22T08:36:41.933 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.913+0000 7fe03bb2a640 1 -- 172.21.15.142:0/3285759096 <== osd.2 v2:172.21.15.142:6808/279438927 7 ==== osd_op_reply(44 notify.0 [create] v30'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe02c051070 con 0x7fe034029ab0 2024-09-22T08:36:41.933 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.913+0000 7fe03e040800 1 -- 172.21.15.142:0/3285759096 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93893647785232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55655185f550 con 0x7fe034029ab0 2024-09-22T08:36:41.933 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.913+0000 7fe03e040800 1 -- 172.21.15.142:0/3285759096 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55655185fda0 con 0x5565518534a0 2024-09-22T08:36:41.933 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.914+0000 7fe03bb2a640 1 -- 172.21.15.142:0/3285759096 <== osd.2 v2:172.21.15.142:6808/279438927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93893647785232] v30'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe02c051070 con 0x7fe034029ab0 2024-09-22T08:36:41.934 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.914+0000 7fe033329640 1 -- 172.21.15.142:0/3285759096 <== osd.1 v2:172.21.15.142:6816/3192108003 15 ==== osd_op_reply(46 notify.1 [create] v30'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe024029040 con 0x5565518534a0 2024-09-22T08:36:41.934 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.914+0000 7fe03e040800 1 -- 172.21.15.142:0/3285759096 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93893647792368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5565518601c0 con 0x5565518534a0 2024-09-22T08:36:41.934 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.914+0000 7fe03e040800 1 -- 172.21.15.142:0/3285759096 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556551860a10 con 0x556551857e90 2024-09-22T08:36:41.938 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.917+0000 7fe033329640 1 -- 172.21.15.142:0/3285759096 <== osd.1 v2:172.21.15.142:6816/3192108003 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93893647792368] v30'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe024029040 con 0x5565518534a0 2024-09-22T08:36:41.938 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.917+0000 7fe03c32b640 1 -- 172.21.15.142:0/3285759096 <== osd.3 v2:172.21.15.142:6800/1064901393 14 ==== osd_op_reply(48 notify.2 [create] v30'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe03403a070 con 0x556551857e90 2024-09-22T08:36:41.938 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.917+0000 7fe03e040800 1 -- 172.21.15.142:0/3285759096 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93893647793904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5565518608c0 con 0x556551857e90 2024-09-22T08:36:41.938 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.917+0000 7fe03e040800 1 -- 172.21.15.142:0/3285759096 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556551861460 con 0x7fe034029ab0 2024-09-22T08:36:41.938 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.919+0000 7fe03c32b640 1 -- 172.21.15.142:0/3285759096 <== osd.3 v2:172.21.15.142:6800/1064901393 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 93893647793904] v30'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe03403a070 con 0x556551857e90 2024-09-22T08:36:41.938 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.919+0000 7fe03bb2a640 1 -- 172.21.15.142:0/3285759096 <== osd.2 v2:172.21.15.142:6808/279438927 9 ==== osd_op_reply(50 notify.3 [create] v30'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe02c051070 con 0x7fe034029ab0 2024-09-22T08:36:41.938 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.919+0000 7fe03e040800 1 -- 172.21.15.142:0/3285759096 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93893647795024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556551861420 con 0x7fe034029ab0 2024-09-22T08:36:41.938 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.919+0000 7fe03e040800 1 -- 172.21.15.142:0/3285759096 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556551861ec0 con 0x5565518534a0 2024-09-22T08:36:41.938 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.920+0000 7fe033329640 1 -- 172.21.15.142:0/3285759096 <== osd.1 v2:172.21.15.142:6816/3192108003 17 ==== osd_op_reply(52 notify.4 [create] v30'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe024029040 con 0x5565518534a0 2024-09-22T08:36:41.939 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.920+0000 7fe03e040800 1 -- 172.21.15.142:0/3285759096 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93893647800816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556551861ec0 con 0x5565518534a0 2024-09-22T08:36:41.939 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.920+0000 7fe03e040800 1 -- 172.21.15.142:0/3285759096 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556551862ea0 con 0x7fe02c0a5040 2024-09-22T08:36:41.939 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.920+0000 7fe03bb2a640 1 -- 172.21.15.142:0/3285759096 <== osd.2 v2:172.21.15.142:6808/279438927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93893647795024] v30'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe02c051070 con 0x7fe034029ab0 2024-09-22T08:36:41.939 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.921+0000 7fe033329640 1 -- 172.21.15.142:0/3285759096 <== osd.0 v2:172.21.15.31:6800/168281188 11 ==== osd_op_reply(54 notify.5 [create] v30'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe024029040 con 0x7fe02c0a5040 2024-09-22T08:36:41.939 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.921+0000 7fe033329640 1 -- 172.21.15.142:0/3285759096 <== osd.1 v2:172.21.15.142:6816/3192108003 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93893647800816] v30'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe024029040 con 0x5565518534a0 2024-09-22T08:36:41.939 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.921+0000 7fe03e040800 1 -- 172.21.15.142:0/3285759096 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93893647804848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556551862ea0 con 0x7fe02c0a5040 2024-09-22T08:36:41.939 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.921+0000 7fe03e040800 1 -- 172.21.15.142:0/3285759096 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556551862280 con 0x7fe02c0a5040 2024-09-22T08:36:41.939 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.922+0000 7fe033329640 1 -- 172.21.15.142:0/3285759096 <== osd.0 v2:172.21.15.31:6800/168281188 12 ==== osd_op_reply(56 notify.6 [create] v30'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe024029040 con 0x7fe02c0a5040 2024-09-22T08:36:41.939 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.922+0000 7fe03e040800 1 -- 172.21.15.142:0/3285759096 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93893647807488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556551862280 con 0x7fe02c0a5040 2024-09-22T08:36:41.939 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.922+0000 7fe03e040800 1 -- 172.21.15.142:0/3285759096 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5565518642f0 con 0x7fe02c0a5040 2024-09-22T08:36:41.939 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.923+0000 7fe033329640 1 -- 172.21.15.142:0/3285759096 <== osd.0 v2:172.21.15.31:6800/168281188 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93893647804848] v30'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe024029040 con 0x7fe02c0a5040 2024-09-22T08:36:41.940 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.923+0000 7fe033329640 1 -- 172.21.15.142:0/3285759096 <== osd.0 v2:172.21.15.31:6800/168281188 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93893647807488] v30'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe024029040 con 0x7fe02c0a5040 2024-09-22T08:36:41.940 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.923+0000 7fe033329640 1 -- 172.21.15.142:0/3285759096 <== osd.0 v2:172.21.15.31:6800/168281188 15 ==== osd_op_reply(58 notify.7 [create] v30'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe024029040 con 0x7fe02c0a5040 2024-09-22T08:36:41.940 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.923+0000 7fe03e040800 1 -- 172.21.15.142:0/3285759096 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93893647808544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556551863e40 con 0x7fe02c0a5040 2024-09-22T08:36:41.940 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.923+0000 7fe03e040800 20 add_watcher() i=0 2024-09-22T08:36:41.940 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.923+0000 7fe03e040800 20 add_watcher() i=1 2024-09-22T08:36:41.940 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.923+0000 7fe03e040800 20 add_watcher() i=2 2024-09-22T08:36:41.940 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.923+0000 7fe03e040800 20 add_watcher() i=3 2024-09-22T08:36:41.940 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.923+0000 7fe03e040800 20 add_watcher() i=4 2024-09-22T08:36:41.940 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.923+0000 7fe03e040800 20 add_watcher() i=5 2024-09-22T08:36:41.940 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.923+0000 7fe03e040800 20 add_watcher() i=6 2024-09-22T08:36:41.940 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.925+0000 7fe033329640 1 -- 172.21.15.142:0/3285759096 <== osd.0 v2:172.21.15.31:6800/168281188 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93893647808544] v30'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe024029040 con 0x7fe02c0a5040 2024-09-22T08:36:41.940 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.925+0000 7fe03e040800 20 add_watcher() i=7 2024-09-22T08:36:41.940 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.925+0000 7fe03e040800 2 all 8 watchers are set, enabling cache 2024-09-22T08:36:41.941 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.925+0000 7fe03e040800 1 -- 172.21.15.142:0/3285759096 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556551867320 con 0x5565518534a0 2024-09-22T08:36:41.941 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.925+0000 7fe033329640 1 -- 172.21.15.142:0/3285759096 <== osd.1 v2:172.21.15.142:6816/3192108003 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fe024029040 con 0x5565518534a0 2024-09-22T08:36:41.941 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.925+0000 7fe03e040800 1 -- 172.21.15.142:0/3285759096 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93893647810112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5565518647e0 con 0x5565518534a0 2024-09-22T08:36:41.941 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.926+0000 7fe033329640 1 -- 172.21.15.142:0/3285759096 <== osd.1 v2:172.21.15.142:6816/3192108003 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93893647810112] v30'36 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe024029040 con 0x5565518534a0 2024-09-22T08:36:41.941 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.926+0000 7fdef1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:36:41.941 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.927+0000 7fe03e040800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:36:41.941 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.927+0000 7fe03e040800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:36:41.941 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.927+0000 7fe03e040800 1 -- 172.21.15.142:0/3285759096 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55655186fdd0 con 0x5565518534a0 2024-09-22T08:36:41.941 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.928+0000 7fe033329640 1 -- 172.21.15.142:0/3285759096 <== osd.1 v2:172.21.15.142:6816/3192108003 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v30'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe024029040 con 0x5565518534a0 2024-09-22T08:36:41.941 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.928+0000 7fe03e040800 1 -- 172.21.15.142:0/3285759096 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5565518703e0 con 0x7fe02c0a5040 2024-09-22T08:36:41.941 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.929+0000 7fe033329640 1 -- 172.21.15.142:0/3285759096 <== osd.0 v2:172.21.15.31:6800/168281188 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v30'12 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe024029040 con 0x7fe02c0a5040 2024-09-22T08:36:41.941 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.929+0000 7fe03e040800 1 -- 172.21.15.142:0/3285759096 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556551870950 con 0x556551857e90 2024-09-22T08:36:41.942 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.930+0000 7fe03c32b640 1 -- 172.21.15.142:0/3285759096 <== osd.3 v2:172.21.15.142:6800/1064901393 16 ==== osd_op_reply(64 gc.2 [create,call,call,call] v30'12 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe03403a070 con 0x556551857e90 2024-09-22T08:36:41.942 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.930+0000 7fe03e040800 1 -- 172.21.15.142:0/3285759096 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556551870950 con 0x5565518534a0 2024-09-22T08:36:41.942 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.933+0000 7fe033329640 1 -- 172.21.15.142:0/3285759096 <== osd.1 v2:172.21.15.142:6816/3192108003 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v30'37 uv15 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe024029040 con 0x5565518534a0 2024-09-22T08:36:41.942 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.933+0000 7fe03e040800 1 -- 172.21.15.142:0/3285759096 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556551870ec0 con 0x7fe034029ab0 2024-09-22T08:36:41.942 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.934+0000 7fe03bb2a640 1 -- 172.21.15.142:0/3285759096 <== osd.2 v2:172.21.15.142:6808/279438927 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v30'26 uv13 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe02c051070 con 0x7fe034029ab0 2024-09-22T08:36:41.942 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.934+0000 7fe03e040800 1 -- 172.21.15.142:0/3285759096 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556551870f50 con 0x556551857e90 2024-09-22T08:36:41.942 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.935+0000 7fe03c32b640 1 -- 172.21.15.142:0/3285759096 <== osd.3 v2:172.21.15.142:6800/1064901393 17 ==== osd_op_reply(67 gc.5 [create,call,call,call] v30'17 uv10 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe03403a070 con 0x556551857e90 2024-09-22T08:36:41.942 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.935+0000 7fe03e040800 1 -- 172.21.15.142:0/3285759096 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5565518710a0 con 0x5565518534a0 2024-09-22T08:36:41.943 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.938+0000 7fe033329640 1 -- 172.21.15.142:0/3285759096 <== osd.1 v2:172.21.15.142:6816/3192108003 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v30'14 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe024029040 con 0x5565518534a0 2024-09-22T08:36:41.943 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.938+0000 7fe03e040800 1 -- 172.21.15.142:0/3285759096 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556551871510 con 0x7fe02c0a5040 2024-09-22T08:36:41.943 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.940+0000 7fe033329640 1 -- 172.21.15.142:0/3285759096 <== osd.0 v2:172.21.15.31:6800/168281188 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v30'17 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe024029040 con 0x7fe02c0a5040 2024-09-22T08:36:41.943 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.940+0000 7fe03e040800 1 -- 172.21.15.142:0/3285759096 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556551871510 con 0x7fe034029ab0 2024-09-22T08:36:41.943 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.941+0000 7fe03bb2a640 1 -- 172.21.15.142:0/3285759096 <== osd.2 v2:172.21.15.142:6808/279438927 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v30'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe02c051070 con 0x7fe034029ab0 2024-09-22T08:36:41.943 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.941+0000 7fe03e040800 1 -- 172.21.15.142:0/3285759096 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556551871510 con 0x556551857e90 2024-09-22T08:36:41.944 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.942+0000 7fe03c32b640 1 -- 172.21.15.142:0/3285759096 <== osd.3 v2:172.21.15.142:6800/1064901393 18 ==== osd_op_reply(71 gc.9 [create,call,call,call] v30'18 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe03403a070 con 0x556551857e90 2024-09-22T08:36:41.944 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.942+0000 7fe03e040800 1 -- 172.21.15.142:0/3285759096 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556551871510 con 0x7fe034029ab0 2024-09-22T08:36:41.945 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.943+0000 7fe03bb2a640 1 -- 172.21.15.142:0/3285759096 <== osd.2 v2:172.21.15.142:6808/279438927 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v30'27 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe02c051070 con 0x7fe034029ab0 2024-09-22T08:36:41.945 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.943+0000 7fe03e040800 1 -- 172.21.15.142:0/3285759096 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556551871510 con 0x7fe02c0a5040 2024-09-22T08:36:41.946 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.944+0000 7fe033329640 1 -- 172.21.15.142:0/3285759096 <== osd.0 v2:172.21.15.31:6800/168281188 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v30'14 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe024029040 con 0x7fe02c0a5040 2024-09-22T08:36:41.946 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.944+0000 7fe03e040800 1 -- 172.21.15.142:0/3285759096 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556551871510 con 0x7fe034029ab0 2024-09-22T08:36:41.947 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.945+0000 7fe03bb2a640 1 -- 172.21.15.142:0/3285759096 <== osd.2 v2:172.21.15.142:6808/279438927 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v30'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe02c051070 con 0x7fe034029ab0 2024-09-22T08:36:41.947 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.945+0000 7fe03e040800 1 -- 172.21.15.142:0/3285759096 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5565518715a0 con 0x7fe02c0a5040 2024-09-22T08:36:41.948 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.946+0000 7fe033329640 1 -- 172.21.15.142:0/3285759096 <== osd.0 v2:172.21.15.31:6800/168281188 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v30'23 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe024029040 con 0x7fe02c0a5040 2024-09-22T08:36:41.948 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.946+0000 7fe03e040800 1 -- 172.21.15.142:0/3285759096 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5565518715a0 con 0x5565518534a0 2024-09-22T08:36:41.949 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.947+0000 7fe033329640 1 -- 172.21.15.142:0/3285759096 <== osd.1 v2:172.21.15.142:6816/3192108003 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v30'38 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe024029040 con 0x5565518534a0 2024-09-22T08:36:41.949 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.947+0000 7fe03e040800 1 -- 172.21.15.142:0/3285759096 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5565518715a0 con 0x556551857e90 2024-09-22T08:36:41.950 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.948+0000 7fe03c32b640 1 -- 172.21.15.142:0/3285759096 <== osd.3 v2:172.21.15.142:6800/1064901393 19 ==== osd_op_reply(77 gc.15 [create,call,call,call] v30'20 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe03403a070 con 0x556551857e90 2024-09-22T08:36:41.950 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.948+0000 7fe03e040800 1 -- 172.21.15.142:0/3285759096 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5565518715a0 con 0x7fe034029ab0 2024-09-22T08:36:41.951 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.949+0000 7fe03bb2a640 1 -- 172.21.15.142:0/3285759096 <== osd.2 v2:172.21.15.142:6808/279438927 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v30'28 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe02c051070 con 0x7fe034029ab0 2024-09-22T08:36:41.951 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.949+0000 7fe03e040800 1 -- 172.21.15.142:0/3285759096 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5565518715a0 con 0x556551857e90 2024-09-22T08:36:41.952 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.950+0000 7fe03c32b640 1 -- 172.21.15.142:0/3285759096 <== osd.3 v2:172.21.15.142:6800/1064901393 20 ==== osd_op_reply(79 gc.17 [create,call,call,call] v30'12 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe03403a070 con 0x556551857e90 2024-09-22T08:36:41.952 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.950+0000 7fe03e040800 1 -- 172.21.15.142:0/3285759096 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5565518715a0 con 0x5565518534a0 2024-09-22T08:36:41.953 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.951+0000 7fe033329640 1 -- 172.21.15.142:0/3285759096 <== osd.1 v2:172.21.15.142:6816/3192108003 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v30'20 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe024029040 con 0x5565518534a0 2024-09-22T08:36:41.953 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.951+0000 7fe03e040800 1 -- 172.21.15.142:0/3285759096 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5565518715a0 con 0x5565518534a0 2024-09-22T08:36:41.955 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.953+0000 7fe033329640 1 -- 172.21.15.142:0/3285759096 <== osd.1 v2:172.21.15.142:6816/3192108003 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v30'39 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe024029040 con 0x5565518534a0 2024-09-22T08:36:41.955 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.953+0000 7fe03e040800 1 -- 172.21.15.142:0/3285759096 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5565518715a0 con 0x556551857e90 2024-09-22T08:36:41.956 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.954+0000 7fe03c32b640 1 -- 172.21.15.142:0/3285759096 <== osd.3 v2:172.21.15.142:6800/1064901393 21 ==== osd_op_reply(82 gc.20 [create,call,call,call] v30'21 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe03403a070 con 0x556551857e90 2024-09-22T08:36:41.956 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.954+0000 7fe03e040800 1 -- 172.21.15.142:0/3285759096 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5565518715a0 con 0x7fe034029ab0 2024-09-22T08:36:41.958 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.956+0000 7fe03bb2a640 1 -- 172.21.15.142:0/3285759096 <== osd.2 v2:172.21.15.142:6808/279438927 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v30'22 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe02c051070 con 0x7fe034029ab0 2024-09-22T08:36:41.958 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.956+0000 7fe03e040800 1 -- 172.21.15.142:0/3285759096 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5565518715a0 con 0x556551857e90 2024-09-22T08:36:41.961 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.959+0000 7fe03c32b640 1 -- 172.21.15.142:0/3285759096 <== osd.3 v2:172.21.15.142:6800/1064901393 22 ==== osd_op_reply(84 gc.22 [create,call,call,call] v30'14 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe03403a070 con 0x556551857e90 2024-09-22T08:36:41.961 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.959+0000 7fe03e040800 1 -- 172.21.15.142:0/3285759096 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556551871620 con 0x556551857e90 2024-09-22T08:36:41.962 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.959+0000 7fe03c32b640 1 -- 172.21.15.142:0/3285759096 <== osd.3 v2:172.21.15.142:6800/1064901393 23 ==== osd_op_reply(85 gc.23 [create,call,call,call] v30'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe03403a070 con 0x556551857e90 2024-09-22T08:36:41.962 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.960+0000 7fe03e040800 1 -- 172.21.15.142:0/3285759096 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556551871620 con 0x556551857e90 2024-09-22T08:36:41.962 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.960+0000 7fe03c32b640 1 -- 172.21.15.142:0/3285759096 <== osd.3 v2:172.21.15.142:6800/1064901393 24 ==== osd_op_reply(86 gc.24 [create,call,call,call] v30'8 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe03403a070 con 0x556551857e90 2024-09-22T08:36:41.963 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.960+0000 7fe03e040800 1 -- 172.21.15.142:0/3285759096 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556551871610 con 0x556551857e90 2024-09-22T08:36:41.964 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.962+0000 7fe03c32b640 1 -- 172.21.15.142:0/3285759096 <== osd.3 v2:172.21.15.142:6800/1064901393 25 ==== osd_op_reply(87 gc.25 [create,call,call,call] v30'18 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe03403a070 con 0x556551857e90 2024-09-22T08:36:41.964 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.962+0000 7fe03e040800 1 -- 172.21.15.142:0/3285759096 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556551871650 con 0x7fe02c0a5040 2024-09-22T08:36:41.965 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.963+0000 7fe033329640 1 -- 172.21.15.142:0/3285759096 <== osd.0 v2:172.21.15.31:6800/168281188 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v30'14 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe024029040 con 0x7fe02c0a5040 2024-09-22T08:36:41.965 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.963+0000 7fe03e040800 1 -- 172.21.15.142:0/3285759096 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556551871690 con 0x556551857e90 2024-09-22T08:36:41.965 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.963+0000 7fe03c32b640 1 -- 172.21.15.142:0/3285759096 <== osd.3 v2:172.21.15.142:6800/1064901393 26 ==== osd_op_reply(89 gc.27 [create,call,call,call] v30'12 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe03403a070 con 0x556551857e90 2024-09-22T08:36:41.966 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.963+0000 7fe03e040800 1 -- 172.21.15.142:0/3285759096 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556551871690 con 0x7fe02c0a5040 2024-09-22T08:36:41.967 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.964+0000 7fe033329640 1 -- 172.21.15.142:0/3285759096 <== osd.0 v2:172.21.15.31:6800/168281188 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v30'18 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe024029040 con 0x7fe02c0a5040 2024-09-22T08:36:41.967 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.965+0000 7fe03e040800 1 -- 172.21.15.142:0/3285759096 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556551871690 con 0x556551857e90 2024-09-22T08:36:41.967 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.965+0000 7fe03c32b640 1 -- 172.21.15.142:0/3285759096 <== osd.3 v2:172.21.15.142:6800/1064901393 27 ==== osd_op_reply(91 gc.29 [create,call,call,call] v30'22 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe03403a070 con 0x556551857e90 2024-09-22T08:36:41.968 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.965+0000 7fe03e040800 1 -- 172.21.15.142:0/3285759096 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556551871690 con 0x7fe02c0a5040 2024-09-22T08:36:41.971 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.967+0000 7fe033329640 1 -- 172.21.15.142:0/3285759096 <== osd.0 v2:172.21.15.31:6800/168281188 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v30'24 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe024029040 con 0x7fe02c0a5040 2024-09-22T08:36:41.971 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.967+0000 7fe03e040800 1 -- 172.21.15.142:0/3285759096 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5565518716d0 con 0x7fe034029ab0 2024-09-22T08:36:41.971 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.968+0000 7fe03bb2a640 1 -- 172.21.15.142:0/3285759096 <== osd.2 v2:172.21.15.142:6808/279438927 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v30'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe02c051070 con 0x7fe034029ab0 2024-09-22T08:36:41.971 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.968+0000 7fdef0fe1640 20 reqs_thread_entry: start 2024-09-22T08:36:41.971 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.968+0000 7fe03e040800 20 init_complete bucket index max shards: 11 2024-09-22T08:36:41.971 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.968+0000 7fe03e040800 20 Filter name: none 2024-09-22T08:36:41.971 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.968+0000 7fde6a7fc640 20 reqs_thread_entry: start 2024-09-22T08:36:41.971 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.968+0000 7fe03e040800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-22T08:36:41.971 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.968+0000 7fe03e040800 20 rados->read ofs=0 len=0 2024-09-22T08:36:41.972 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.968+0000 7fe03e040800 1 -- 172.21.15.142:0/3285759096 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55655189c5f0 con 0x7fe02c0a5040 2024-09-22T08:36:41.972 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.968+0000 7fe033329640 1 -- 172.21.15.142:0/3285759096 <== osd.0 v2:172.21.15.31:6800/168281188 24 ==== osd_op_reply(94 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7fe024029040 con 0x7fe02c0a5040 2024-09-22T08:36:41.972 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.968+0000 7fe03e040800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:41.972 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.968+0000 7fe03e040800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-09-22T08:36:41.972 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.968+0000 7fe03e040800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-22T08:36:41.972 INFO:teuthology.orchestra.run.smithi142.stderr:could not remove user: unable to remove user, user does not exist 2024-09-22T08:36:41.973 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.969+0000 7fdef1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:36:41.973 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.969+0000 7fe03e040800 1 -- 172.21.15.142:0/3285759096 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93893647810112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556551866460 con 0x5565518534a0 2024-09-22T08:36:41.973 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.970+0000 7fe033329640 1 -- 172.21.15.142:0/3285759096 <== osd.1 v2:172.21.15.142:6816/3192108003 27 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 93893647810112] v30'40 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe024029040 con 0x5565518534a0 2024-09-22T08:36:41.973 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.970+0000 7fe03e040800 1 -- 172.21.15.142:0/3285759096 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93893647785232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556551863e40 con 0x7fe034029ab0 2024-09-22T08:36:41.974 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.971+0000 7fe03bb2a640 1 -- 172.21.15.142:0/3285759096 <== osd.2 v2:172.21.15.142:6808/279438927 18 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 93893647785232] v30'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe02c051070 con 0x7fe034029ab0 2024-09-22T08:36:41.974 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.971+0000 7fe03e040800 20 remove_watcher() i=0 2024-09-22T08:36:41.974 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.971+0000 7fe03e040800 2 removed watcher, disabling cache 2024-09-22T08:36:41.974 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.971+0000 7fe03e040800 1 -- 172.21.15.142:0/3285759096 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93893647792368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556551863e40 con 0x5565518534a0 2024-09-22T08:36:41.975 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.973+0000 7fe033329640 1 -- 172.21.15.142:0/3285759096 <== osd.1 v2:172.21.15.142:6816/3192108003 28 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 93893647792368] v30'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe024029040 con 0x5565518534a0 2024-09-22T08:36:41.975 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.973+0000 7fe03e040800 20 remove_watcher() i=1 2024-09-22T08:36:41.975 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.973+0000 7fe03e040800 1 -- 172.21.15.142:0/3285759096 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93893647793904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55655185f8f0 con 0x556551857e90 2024-09-22T08:36:41.976 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.974+0000 7fe03c32b640 1 -- 172.21.15.142:0/3285759096 <== osd.3 v2:172.21.15.142:6800/1064901393 28 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 93893647793904] v30'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe03403a070 con 0x556551857e90 2024-09-22T08:36:41.976 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.974+0000 7fe03e040800 20 remove_watcher() i=2 2024-09-22T08:36:41.976 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.974+0000 7fe03e040800 1 -- 172.21.15.142:0/3285759096 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93893647795024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556551863e40 con 0x7fe034029ab0 2024-09-22T08:36:41.977 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.975+0000 7fe03bb2a640 1 -- 172.21.15.142:0/3285759096 <== osd.2 v2:172.21.15.142:6808/279438927 19 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 93893647795024] v30'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe02c051070 con 0x7fe034029ab0 2024-09-22T08:36:41.977 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.975+0000 7fe03e040800 20 remove_watcher() i=3 2024-09-22T08:36:41.977 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.975+0000 7fe03e040800 1 -- 172.21.15.142:0/3285759096 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93893647800816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55655185f8f0 con 0x5565518534a0 2024-09-22T08:36:41.978 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.976+0000 7fe033329640 1 -- 172.21.15.142:0/3285759096 <== osd.1 v2:172.21.15.142:6816/3192108003 29 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 93893647800816] v30'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe024029040 con 0x5565518534a0 2024-09-22T08:36:41.978 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.976+0000 7fe03e040800 20 remove_watcher() i=4 2024-09-22T08:36:41.978 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.976+0000 7fe03e040800 1 -- 172.21.15.142:0/3285759096 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93893647804848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556551863e40 con 0x7fe02c0a5040 2024-09-22T08:36:41.979 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.977+0000 7fe033329640 1 -- 172.21.15.142:0/3285759096 <== osd.0 v2:172.21.15.31:6800/168281188 25 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 93893647804848] v30'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe024029040 con 0x7fe02c0a5040 2024-09-22T08:36:41.979 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.977+0000 7fe03e040800 20 remove_watcher() i=5 2024-09-22T08:36:41.979 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.977+0000 7fe03e040800 1 -- 172.21.15.142:0/3285759096 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93893647807488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5565518619f0 con 0x7fe02c0a5040 2024-09-22T08:36:41.980 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.978+0000 7fe033329640 1 -- 172.21.15.142:0/3285759096 <== osd.0 v2:172.21.15.31:6800/168281188 26 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 93893647807488] v30'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe024029040 con 0x7fe02c0a5040 2024-09-22T08:36:41.980 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.978+0000 7fe03e040800 20 remove_watcher() i=6 2024-09-22T08:36:41.981 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.978+0000 7fe03e040800 1 -- 172.21.15.142:0/3285759096 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93893647808544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55655185f8f0 con 0x7fe02c0a5040 2024-09-22T08:36:41.985 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.979+0000 7fe033329640 1 -- 172.21.15.142:0/3285759096 <== osd.0 v2:172.21.15.31:6800/168281188 27 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 93893647808544] v30'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe024029040 con 0x7fe02c0a5040 2024-09-22T08:36:41.986 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.979+0000 7fe03e040800 20 remove_watcher() i=7 2024-09-22T08:36:41.986 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.979+0000 7fe03e040800 1 -- 172.21.15.142:0/3285759096 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7fe02c0a5040 msgr2=0x7fe02c05e8a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:41.986 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.979+0000 7fe03e040800 1 --2- 172.21.15.142:0/3285759096 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7fe02c0a5040 0x7fe02c05e8a0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:41.986 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.979+0000 7fe03e040800 1 -- 172.21.15.142:0/3285759096 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5565518534a0 msgr2=0x556551855960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:41.986 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.979+0000 7fe03e040800 1 --2- 172.21.15.142:0/3285759096 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5565518534a0 0x556551855960 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:41.986 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.979+0000 7fe03e040800 1 -- 172.21.15.142:0/3285759096 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7fe034029ab0 msgr2=0x7fe034055030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:41.987 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.979+0000 7fe03e040800 1 --2- 172.21.15.142:0/3285759096 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7fe034029ab0 0x7fe034055030 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:41.987 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.979+0000 7fe03e040800 1 -- 172.21.15.142:0/3285759096 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x556551857e90 msgr2=0x55655185a280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:41.987 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.979+0000 7fe03e040800 1 --2- 172.21.15.142:0/3285759096 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x556551857e90 0x55655185a280 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:41.987 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.979+0000 7fe03e040800 1 -- 172.21.15.142:0/3285759096 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fdf0403d000 msgr2=0x7fdf0403f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:41.987 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.979+0000 7fe03e040800 1 --2- 172.21.15.142:0/3285759096 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fdf0403d000 0x7fdf0403f4c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe02c05db40 tx=0x7fe02c08a000 comp rx=0 tx=0).stop 2024-09-22T08:36:41.987 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.979+0000 7fe03e040800 1 -- 172.21.15.142:0/3285759096 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5565518405a0 msgr2=0x556551847b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:41.987 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.979+0000 7fe033329640 1 -- 172.21.15.142:0/3285759096 reap_dead start 2024-09-22T08:36:41.987 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.979+0000 7fe03e040800 1 --2- 172.21.15.142:0/3285759096 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5565518405a0 0x556551847b70 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fe03402a700 tx=0x7fe0340548f0 comp rx=0 tx=0).stop 2024-09-22T08:36:41.987 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.979+0000 7fe03e040800 1 -- 172.21.15.142:0/3285759096 shutdown_connections 2024-09-22T08:36:41.988 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.979+0000 7fe03e040800 1 --2- 172.21.15.142:0/3285759096 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5565518405a0 0x556551847b70 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:41.988 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.979+0000 7fe03e040800 1 -- 172.21.15.142:0/3285759096 >> 172.21.15.142:0/3285759096 conn(0x55655183c9a0 msgr2=0x55655183abb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:41.988 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.979+0000 7fe03e040800 1 -- 172.21.15.142:0/3285759096 shutdown_connections 2024-09-22T08:36:41.988 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.979+0000 7fe03e040800 1 -- 172.21.15.142:0/3285759096 wait complete. 2024-09-22T08:36:41.988 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.979+0000 7fe03e040800 1 -- 172.21.15.142:0/4229571053 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fdf1403cfb0 msgr2=0x7fdf1403f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:41.988 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.979+0000 7fe03e040800 1 --2- 172.21.15.142:0/4229571053 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fdf1403cfb0 0x7fdf1403f470 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe02c074fd0 tx=0x7fe02c05f520 comp rx=0 tx=0).stop 2024-09-22T08:36:41.988 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.979+0000 7fe03e040800 1 -- 172.21.15.142:0/4229571053 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556551833ac0 msgr2=0x556551833ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:41.988 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.979+0000 7fe03e040800 1 --2- 172.21.15.142:0/4229571053 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556551833ac0 0x556551833ee0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x556551819c20 tx=0x7fe0340167b0 comp rx=0 tx=0).stop 2024-09-22T08:36:41.988 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.980+0000 7fe03e040800 1 -- 172.21.15.142:0/4229571053 shutdown_connections 2024-09-22T08:36:41.988 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.980+0000 7fe03e040800 1 --2- 172.21.15.142:0/4229571053 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fdf1403cfb0 0x7fdf1403f470 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:41.988 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.980+0000 7fe03e040800 1 --2- 172.21.15.142:0/4229571053 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556551833ac0 0x556551833ee0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:41.988 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.980+0000 7fe03e040800 1 -- 172.21.15.142:0/4229571053 >> 172.21.15.142:0/4229571053 conn(0x556551827e70 msgr2=0x556551828250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:41.988 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.980+0000 7fe03e040800 1 -- 172.21.15.142:0/4229571053 shutdown_connections 2024-09-22T08:36:41.989 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.980+0000 7fe03e040800 1 -- 172.21.15.142:0/4229571053 wait complete. 2024-09-22T08:36:41.989 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.980+0000 7fe03e040800 1 -- 172.21.15.142:0/2695773234 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x556551720ae0 msgr2=0x556551820270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:41.989 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.980+0000 7fe03e040800 1 --2- 172.21.15.142:0/2695773234 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x556551720ae0 0x556551820270 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:41.989 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.980+0000 7fe03e040800 1 -- 172.21.15.142:0/2695773234 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5565518225e0 msgr2=0x556551824a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:41.989 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.980+0000 7fe03e040800 1 --2- 172.21.15.142:0/2695773234 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5565518225e0 0x556551824a80 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:41.989 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.980+0000 7fe03e040800 1 -- 172.21.15.142:0/2695773234 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fdf2403d000 msgr2=0x7fdf2403f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:41.989 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.980+0000 7fe03e040800 1 --2- 172.21.15.142:0/2695773234 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fdf2403d000 0x7fdf2403f4c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe024004170 tx=0x7fe024001330 comp rx=0 tx=0).stop 2024-09-22T08:36:41.989 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.980+0000 7fe03e040800 1 -- 172.21.15.142:0/2695773234 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55655171f9e0 msgr2=0x556551818c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:41.989 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.980+0000 7fe03e040800 1 --2- 172.21.15.142:0/2695773234 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55655171f9e0 0x556551818c20 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fe02c025c20 tx=0x7fe02c002fb0 comp rx=0 tx=0).stop 2024-09-22T08:36:41.989 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.980+0000 7fe03e040800 1 -- 172.21.15.142:0/2695773234 shutdown_connections 2024-09-22T08:36:41.989 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.980+0000 7fe03e040800 1 --2- 172.21.15.142:0/2695773234 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5565518225e0 0x556551824a80 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:41.989 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.980+0000 7fe03e040800 1 --2- 172.21.15.142:0/2695773234 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x556551720ae0 0x556551820270 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:41.989 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.980+0000 7fe03e040800 1 --2- 172.21.15.142:0/2695773234 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fdf2403d000 0x7fdf2403f4c0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:41.989 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.980+0000 7fe03e040800 1 --2- 172.21.15.142:0/2695773234 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55655171f9e0 0x556551818c20 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:41.990 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.980+0000 7fe03e040800 1 -- 172.21.15.142:0/2695773234 >> 172.21.15.142:0/2695773234 conn(0x55655171adb0 msgr2=0x55655180a430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:41.990 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.980+0000 7fe03e040800 1 -- 172.21.15.142:0/2695773234 shutdown_connections 2024-09-22T08:36:41.990 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:41.980+0000 7fe03e040800 1 -- 172.21.15.142:0/2695773234 wait complete. 2024-09-22T08:36:41.992 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-22T08:36:41.993 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo'] 2024-09-22T08:36:41.993 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo'] 2024-09-22T08:36:41.993 DEBUG:teuthology.orchestra.run.smithi142:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo 2024-09-22T08:36:42.038 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:36:42.038 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:36:42.039 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.036+0000 7fd169546800 1 Processor -- start 2024-09-22T08:36:42.039 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.037+0000 7fd169546800 1 -- start start 2024-09-22T08:36:42.039 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.037+0000 7fd169546800 1 --2- >> v2:172.21.15.31:3300/0 conn(0x5618e0314510 0x5618e03a54b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:42.039 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.037+0000 7fd169546800 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5618e022ba20 con 0x5618e03a59f0 2024-09-22T08:36:42.039 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.037+0000 7fd169546800 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x5618e022b7d0 con 0x5618e0314510 2024-09-22T08:36:42.040 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.037+0000 7fd167037640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x5618e0314510 0x5618e03a54b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:42.040 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.037+0000 7fd166836640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x5618e03a59f0 0x5618e03a7eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.142:42256/0 (socket says 172.21.15.142:42256) 2024-09-22T08:36:42.040 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.037+0000 7fd166836640 1 -- 172.21.15.142:0/3011576920 learned_addr learned my addr 172.21.15.142:0/3011576920 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-09-22T08:36:42.040 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.037+0000 7fd167037640 1 -- 172.21.15.142:0/3011576920 >> v1:172.21.15.31:6789/0 conn(0x5618e03a59f0 legacy=0x5618e03a7eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:42.040 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.037+0000 7fd167037640 1 -- 172.21.15.142:0/3011576920 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5618e03aa770 con 0x5618e0314510 2024-09-22T08:36:42.042 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.039+0000 7fd167037640 1 --2- 172.21.15.142:0/3011576920 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5618e0314510 0x5618e03a54b0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fd15800a470 tx=0x7fd158045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57d98a1c368fe273 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:42.043 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.039+0000 7fd166035640 1 -- 172.21.15.142:0/3011576920 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd158053570 con 0x5618e0314510 2024-09-22T08:36:42.043 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.039+0000 7fd166035640 1 -- 172.21.15.142:0/3011576920 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd158058070 con 0x5618e0314510 2024-09-22T08:36:42.043 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.039+0000 7fd166035640 1 -- 172.21.15.142:0/3011576920 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd158053880 con 0x5618e0314510 2024-09-22T08:36:42.043 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.040+0000 7fd169546800 1 -- 172.21.15.142:0/3011576920 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5618e0314510 msgr2=0x5618e03a54b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:42.043 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.040+0000 7fd169546800 1 --2- 172.21.15.142:0/3011576920 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5618e0314510 0x5618e03a54b0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fd15800a470 tx=0x7fd158045a20 comp rx=0 tx=0).stop 2024-09-22T08:36:42.043 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.040+0000 7fd169546800 1 -- 172.21.15.142:0/3011576920 shutdown_connections 2024-09-22T08:36:42.043 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.040+0000 7fd169546800 1 --2- 172.21.15.142:0/3011576920 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5618e0314510 0x5618e03a54b0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:42.043 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.040+0000 7fd169546800 1 -- 172.21.15.142:0/3011576920 >> 172.21.15.142:0/3011576920 conn(0x5618e039aba0 msgr2=0x5618e039d000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:42.043 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.040+0000 7fd169546800 1 -- 172.21.15.142:0/3011576920 shutdown_connections 2024-09-22T08:36:42.044 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.040+0000 7fd169546800 1 -- 172.21.15.142:0/3011576920 wait complete. 2024-09-22T08:36:42.056 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.053+0000 7fd169546800 1 Processor -- start 2024-09-22T08:36:42.056 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.053+0000 7fd169546800 1 -- start start 2024-09-22T08:36:42.056 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.053+0000 7fd169546800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5618e0314510 0x5618e0492250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:42.056 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.053+0000 7fd169546800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5618e0238dd0 con 0x5618e0314510 2024-09-22T08:36:42.056 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.054+0000 7fd167037640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5618e0314510 0x5618e0492250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:42.056 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.054+0000 7fd167037640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5618e0314510 0x5618e0492250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:37598/0 (socket says 172.21.15.142:37598) 2024-09-22T08:36:42.057 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.054+0000 7fd167037640 1 -- 172.21.15.142:0/849700406 learned_addr learned my addr 172.21.15.142:0/849700406 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:42.057 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.054+0000 7fd167037640 1 -- 172.21.15.142:0/849700406 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5618e0492840 con 0x5618e0314510 2024-09-22T08:36:42.059 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.054+0000 7fd167037640 1 --2- 172.21.15.142:0/849700406 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5618e0314510 0x5618e0492250 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fd158025c20 tx=0x7fd158051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47852b62d1b341ee server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:42.059 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.055+0000 7fd05560a640 1 -- 172.21.15.142:0/849700406 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd158053a20 con 0x5618e0314510 2024-09-22T08:36:42.059 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.055+0000 7fd05560a640 1 -- 172.21.15.142:0/849700406 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd158063070 con 0x5618e0314510 2024-09-22T08:36:42.059 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.055+0000 7fd05560a640 1 -- 172.21.15.142:0/849700406 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd158053cf0 con 0x5618e0314510 2024-09-22T08:36:42.059 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.055+0000 7fd169546800 1 -- 172.21.15.142:0/849700406 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5618e0314510 msgr2=0x5618e0492250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:42.060 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.055+0000 7fd169546800 1 --2- 172.21.15.142:0/849700406 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5618e0314510 0x5618e0492250 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fd158025c20 tx=0x7fd158051000 comp rx=0 tx=0).stop 2024-09-22T08:36:42.060 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.055+0000 7fd169546800 1 -- 172.21.15.142:0/849700406 shutdown_connections 2024-09-22T08:36:42.060 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.055+0000 7fd169546800 1 --2- 172.21.15.142:0/849700406 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5618e0314510 0x5618e0492250 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:42.060 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.055+0000 7fd169546800 1 -- 172.21.15.142:0/849700406 >> 172.21.15.142:0/849700406 conn(0x5618e039aba0 msgr2=0x5618e048dbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:42.060 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.055+0000 7fd169546800 1 -- 172.21.15.142:0/849700406 shutdown_connections 2024-09-22T08:36:42.060 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.055+0000 7fd169546800 1 -- 172.21.15.142:0/849700406 wait complete. 2024-09-22T08:36:42.060 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.056+0000 7fd169546800 1 Processor -- start 2024-09-22T08:36:42.060 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.056+0000 7fd169546800 1 -- start start 2024-09-22T08:36:42.060 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.056+0000 7fd169546800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5618e0314510 0x5618e0499d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:42.060 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.056+0000 7fd169546800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5618e03a9a10 con 0x5618e0314510 2024-09-22T08:36:42.060 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.056+0000 7fd167037640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5618e0314510 0x5618e0499d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:42.060 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.056+0000 7fd167037640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5618e0314510 0x5618e0499d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:37610/0 (socket says 172.21.15.142:37610) 2024-09-22T08:36:42.061 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.056+0000 7fd167037640 1 -- 172.21.15.142:0/3818364611 learned_addr learned my addr 172.21.15.142:0/3818364611 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:42.061 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.056+0000 7fd167037640 1 -- 172.21.15.142:0/3818364611 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5618e049a260 con 0x5618e0314510 2024-09-22T08:36:42.061 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.057+0000 7fd167037640 1 --2- 172.21.15.142:0/3818364611 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5618e0314510 0x5618e0499d00 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fd158025c20 tx=0x7fd158002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:42.061 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.057+0000 7fd053e07640 1 -- 172.21.15.142:0/3818364611 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd158068660 con 0x5618e0314510 2024-09-22T08:36:42.061 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.057+0000 7fd053e07640 1 -- 172.21.15.142:0/3818364611 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd158068800 con 0x5618e0314510 2024-09-22T08:36:42.061 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.057+0000 7fd169546800 1 -- 172.21.15.142:0/3818364611 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5618e049a4f0 con 0x5618e0314510 2024-09-22T08:36:42.061 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.057+0000 7fd053e07640 1 -- 172.21.15.142:0/3818364611 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd158068ae0 con 0x5618e0314510 2024-09-22T08:36:42.061 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.057+0000 7fd169546800 1 -- 172.21.15.142:0/3818364611 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5618e049b100 con 0x5618e0314510 2024-09-22T08:36:42.066 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.058+0000 7fd053e07640 1 -- 172.21.15.142:0/3818364611 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fd158068c80 con 0x5618e0314510 2024-09-22T08:36:42.066 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.058+0000 7fd053e07640 1 --2- 172.21.15.142:0/3818364611 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fd04c03cfb0 0x7fd04c03f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:42.067 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.058+0000 7fd053e07640 1 -- 172.21.15.142:0/3818364611 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fd158098c30 con 0x5618e0314510 2024-09-22T08:36:42.067 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.058+0000 7fd166836640 1 --2- 172.21.15.142:0/3818364611 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fd04c03cfb0 0x7fd04c03f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:42.067 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.058+0000 7fd169546800 1 --2- 172.21.15.142:0/3818364611 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5618e03a59f0 0x5618e04a1350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:42.067 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.058+0000 7fd169546800 1 -- 172.21.15.142:0/3818364611 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5618e04a1890 con 0x5618e03a59f0 2024-09-22T08:36:42.067 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.058+0000 7fd167838640 1 --2- 172.21.15.142:0/3818364611 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5618e03a59f0 0x5618e04a1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:42.067 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.059+0000 7fd166836640 1 --2- 172.21.15.142:0/3818364611 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fd04c03cfb0 0x7fd04c03f470 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd15c001d70 tx=0x7fd15c0012d0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:42.067 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.059+0000 7fd167838640 1 --2- 172.21.15.142:0/3818364611 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5618e03a59f0 0x5618e04a1350 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:42.067 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.059+0000 7fd167838640 1 -- 172.21.15.142:0/3818364611 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd16000a4d0 con 0x5618e03a59f0 2024-09-22T08:36:42.067 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.059+0000 7fd169546800 1 -- 172.21.15.142:0/3818364611 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5618e04a1c30 con 0x5618e03a59f0 2024-09-22T08:36:42.067 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.059+0000 7fd167838640 1 -- 172.21.15.142:0/3818364611 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd16000a4d0 con 0x5618e03a59f0 2024-09-22T08:36:42.067 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.059+0000 7fd169546800 1 --2- 172.21.15.142:0/3818364611 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5618e04a36f0 0x5618e04a5b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:42.067 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.059+0000 7fd169546800 1 -- 172.21.15.142:0/3818364611 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:3 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5618e04a6320 con 0x5618e04a36f0 2024-09-22T08:36:42.067 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.059+0000 7fd167037640 1 --2- 172.21.15.142:0/3818364611 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5618e04a36f0 0x5618e04a5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:42.068 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.060+0000 7fd167037640 1 --2- 172.21.15.142:0/3818364611 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5618e04a36f0 0x5618e04a5b90 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:42.068 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.060+0000 7fd167037640 1 -- 172.21.15.142:0/3818364611 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(3 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fd158051070 con 0x5618e04a36f0 2024-09-22T08:36:42.068 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.060+0000 7fd169546800 1 -- 172.21.15.142:0/3818364611 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5618e04a2480 con 0x5618e03a59f0 2024-09-22T08:36:42.068 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.060+0000 7fd167838640 1 -- 172.21.15.142:0/3818364611 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd16000a4d0 con 0x5618e03a59f0 2024-09-22T08:36:42.068 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.060+0000 7fd169546800 1 -- 172.21.15.142:0/3818364611 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5618e04a2860 con 0x5618e04a36f0 2024-09-22T08:36:42.068 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.060+0000 7fd167037640 1 -- 172.21.15.142:0/3818364611 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(5 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fd158051070 con 0x5618e04a36f0 2024-09-22T08:36:42.068 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.061+0000 7fd169546800 1 Processor -- start 2024-09-22T08:36:42.068 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.061+0000 7fd169546800 1 -- start start 2024-09-22T08:36:42.068 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.061+0000 7fd169546800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5618e04b4ce0 0x5618e04b5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:42.068 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.061+0000 7fd169546800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5618e0297d50 con 0x5618e04b4ce0 2024-09-22T08:36:42.069 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.061+0000 7fd167838640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5618e04b4ce0 0x5618e04b5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:42.069 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.061+0000 7fd167838640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5618e04b4ce0 0x5618e04b5100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:37620/0 (socket says 172.21.15.142:37620) 2024-09-22T08:36:42.069 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.061+0000 7fd167838640 1 -- 172.21.15.142:0/4001901191 learned_addr learned my addr 172.21.15.142:0/4001901191 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:42.069 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.062+0000 7fd167838640 1 -- 172.21.15.142:0/4001901191 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5618e04b5740 con 0x5618e04b4ce0 2024-09-22T08:36:42.069 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.062+0000 7fd167838640 1 --2- 172.21.15.142:0/4001901191 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5618e04b4ce0 0x5618e04b5100 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x5618e049ad00 tx=0x7fd1600167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:42.069 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.062+0000 7fd051602640 1 -- 172.21.15.142:0/4001901191 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd160013640 con 0x5618e04b4ce0 2024-09-22T08:36:42.069 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.062+0000 7fd051602640 1 -- 172.21.15.142:0/4001901191 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1600137e0 con 0x5618e04b4ce0 2024-09-22T08:36:42.069 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.062+0000 7fd169546800 1 -- 172.21.15.142:0/4001901191 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5618e04b5f70 con 0x5618e04b4ce0 2024-09-22T08:36:42.069 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.062+0000 7fd051602640 1 -- 172.21.15.142:0/4001901191 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd160013ae0 con 0x5618e04b4ce0 2024-09-22T08:36:42.070 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.062+0000 7fd169546800 1 -- 172.21.15.142:0/4001901191 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5618e04b6510 con 0x5618e04b4ce0 2024-09-22T08:36:42.070 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.063+0000 7fd051602640 1 -- 172.21.15.142:0/4001901191 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fd160011040 con 0x5618e04b4ce0 2024-09-22T08:36:42.070 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.063+0000 7fd051602640 1 --2- 172.21.15.142:0/4001901191 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fd04003cfb0 0x7fd04003f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:42.070 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.063+0000 7fd051602640 1 -- 172.21.15.142:0/4001901191 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fd16000e040 con 0x5618e04b4ce0 2024-09-22T08:36:42.070 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.063+0000 7fd167037640 1 --2- 172.21.15.142:0/4001901191 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fd04003cfb0 0x7fd04003f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:42.070 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.063+0000 7fd169546800 1 Processor -- start 2024-09-22T08:36:42.070 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.063+0000 7fd169546800 1 -- start start 2024-09-22T08:36:42.070 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.063+0000 7fd167037640 1 --2- 172.21.15.142:0/4001901191 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fd04003cfb0 0x7fd04003f470 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x5618e049be00 tx=0x7fd15805da60 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:42.070 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.063+0000 7fd169546800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5618e04c17a0 0x5618e04c1ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:42.070 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.063+0000 7fd169546800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5618e0492c10 con 0x5618e04c17a0 2024-09-22T08:36:42.070 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.064+0000 7fd167838640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5618e04c17a0 0x5618e04c1ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:42.070 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.064+0000 7fd167838640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5618e04c17a0 0x5618e04c1ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:37636/0 (socket says 172.21.15.142:37636) 2024-09-22T08:36:42.071 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.064+0000 7fd167838640 1 -- 172.21.15.142:0/3853596730 learned_addr learned my addr 172.21.15.142:0/3853596730 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:42.071 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.064+0000 7fd167838640 1 -- 172.21.15.142:0/3853596730 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5618e04c2190 con 0x5618e04c17a0 2024-09-22T08:36:42.071 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.064+0000 7fd167838640 1 --2- 172.21.15.142:0/3853596730 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5618e04c17a0 0x5618e04c1ba0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fd160054840 tx=0x7fd160020460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=113441c6b6c3ea2d server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:42.071 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.064+0000 7fd04affd640 1 -- 172.21.15.142:0/3853596730 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd1600143c0 con 0x5618e04c17a0 2024-09-22T08:36:42.071 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.064+0000 7fd04affd640 1 -- 172.21.15.142:0/3853596730 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd160052070 con 0x5618e04c17a0 2024-09-22T08:36:42.071 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.064+0000 7fd04affd640 1 -- 172.21.15.142:0/3853596730 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd160021910 con 0x5618e04c17a0 2024-09-22T08:36:42.086 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.065+0000 7fd169546800 1 -- 172.21.15.142:0/3853596730 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5618e04c17a0 msgr2=0x5618e04c1ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:42.086 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.065+0000 7fd169546800 1 --2- 172.21.15.142:0/3853596730 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5618e04c17a0 0x5618e04c1ba0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fd160054840 tx=0x7fd160020460 comp rx=0 tx=0).stop 2024-09-22T08:36:42.086 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.065+0000 7fd169546800 1 -- 172.21.15.142:0/3853596730 shutdown_connections 2024-09-22T08:36:42.086 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.065+0000 7fd169546800 1 --2- 172.21.15.142:0/3853596730 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5618e04c17a0 0x5618e04c1ba0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:42.086 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.065+0000 7fd169546800 1 -- 172.21.15.142:0/3853596730 >> 172.21.15.142:0/3853596730 conn(0x5618e04bdba0 msgr2=0x5618e04bbde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:42.086 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.065+0000 7fd169546800 1 -- 172.21.15.142:0/3853596730 shutdown_connections 2024-09-22T08:36:42.087 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.065+0000 7fd169546800 1 -- 172.21.15.142:0/3853596730 wait complete. 2024-09-22T08:36:42.087 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.065+0000 7fd169546800 1 Processor -- start 2024-09-22T08:36:42.087 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.065+0000 7fd169546800 1 -- start start 2024-09-22T08:36:42.087 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.065+0000 7fd169546800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5618e04c17a0 0x5618e04c8d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:42.087 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.065+0000 7fd169546800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5618e04c27b0 con 0x5618e04c17a0 2024-09-22T08:36:42.087 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.065+0000 7fd167838640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5618e04c17a0 0x5618e04c8d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:42.087 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.065+0000 7fd167838640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5618e04c17a0 0x5618e04c8d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:37648/0 (socket says 172.21.15.142:37648) 2024-09-22T08:36:42.087 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.065+0000 7fd167838640 1 -- 172.21.15.142:0/532027348 learned_addr learned my addr 172.21.15.142:0/532027348 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:42.087 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.066+0000 7fd167838640 1 -- 172.21.15.142:0/532027348 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5618e04c92e0 con 0x5618e04c17a0 2024-09-22T08:36:42.087 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.066+0000 7fd167838640 1 --2- 172.21.15.142:0/532027348 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5618e04c17a0 0x5618e04c8d80 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fd16001ff70 tx=0x7fd1600547d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:42.087 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.066+0000 7fd0497fa640 1 -- 172.21.15.142:0/532027348 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd1600143c0 con 0x5618e04c17a0 2024-09-22T08:36:42.087 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.066+0000 7fd0497fa640 1 -- 172.21.15.142:0/532027348 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1600560d0 con 0x5618e04c17a0 2024-09-22T08:36:42.087 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.066+0000 7fd0497fa640 1 -- 172.21.15.142:0/532027348 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd160045b60 con 0x5618e04c17a0 2024-09-22T08:36:42.088 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.066+0000 7fd169546800 1 -- 172.21.15.142:0/532027348 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5618e04c9570 con 0x5618e04c17a0 2024-09-22T08:36:42.088 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.066+0000 7fd169546800 1 -- 172.21.15.142:0/532027348 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5618e04c9ef0 con 0x5618e04c17a0 2024-09-22T08:36:42.088 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.067+0000 7fd0497fa640 1 -- 172.21.15.142:0/532027348 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fd160054040 con 0x5618e04c17a0 2024-09-22T08:36:42.088 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.067+0000 7fd0497fa640 1 --2- 172.21.15.142:0/532027348 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fd03003cfb0 0x7fd03003f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:42.088 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.067+0000 7fd0497fa640 1 -- 172.21.15.142:0/532027348 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fd16004d050 con 0x5618e04c17a0 2024-09-22T08:36:42.088 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.067+0000 7fd167037640 1 --2- 172.21.15.142:0/532027348 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fd03003cfb0 0x7fd03003f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:42.088 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.067+0000 7fd167037640 1 --2- 172.21.15.142:0/532027348 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fd03003cfb0 0x7fd03003f470 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd158097430 tx=0x7fd158089000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:42.088 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.067+0000 7fd169546800 20 rados->read ofs=0 len=0 2024-09-22T08:36:42.088 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.067+0000 7fd169546800 1 --2- 172.21.15.142:0/532027348 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5618e04d46d0 0x5618e04d6b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:42.088 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.067+0000 7fd169546800 1 -- 172.21.15.142:0/532027348 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5618e04d72e0 con 0x5618e04d46d0 2024-09-22T08:36:42.088 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.067+0000 7fd166836640 1 --2- 172.21.15.142:0/532027348 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5618e04d46d0 0x5618e04d6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:42.088 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.068+0000 7fd166836640 1 --2- 172.21.15.142:0/532027348 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5618e04d46d0 0x5618e04d6b90 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:42.088 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.068+0000 7fd166836640 1 -- 172.21.15.142:0/532027348 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd15c009050 con 0x5618e04d46d0 2024-09-22T08:36:42.089 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.068+0000 7fd169546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:42.089 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.068+0000 7fd169546800 20 realm 2024-09-22T08:36:42.089 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.068+0000 7fd169546800 20 rados->read ofs=0 len=0 2024-09-22T08:36:42.089 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.068+0000 7fd169546800 1 -- 172.21.15.142:0/532027348 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5618e04d3a20 con 0x5618e04d46d0 2024-09-22T08:36:42.089 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.068+0000 7fd166836640 1 -- 172.21.15.142:0/532027348 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd15c009050 con 0x5618e04d46d0 2024-09-22T08:36:42.089 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.068+0000 7fd169546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:42.089 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.068+0000 7fd169546800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:36:42.089 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.068+0000 7fd169546800 20 rados->read ofs=0 len=0 2024-09-22T08:36:42.089 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.068+0000 7fd169546800 1 -- 172.21.15.142:0/532027348 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5618e04d7dd0 con 0x5618e04d46d0 2024-09-22T08:36:42.089 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.068+0000 7fd166836640 1 -- 172.21.15.142:0/532027348 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd15c009050 con 0x5618e04d46d0 2024-09-22T08:36:42.089 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.068+0000 7fd169546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:42.089 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.068+0000 7fd169546800 20 rados->read ofs=0 len=0 2024-09-22T08:36:42.089 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.068+0000 7fd169546800 1 -- 172.21.15.142:0/532027348 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5618e04d86a0 con 0x5618e04d46d0 2024-09-22T08:36:42.090 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.069+0000 7fd166836640 1 -- 172.21.15.142:0/532027348 <== osd.1 v2:172.21.15.142:6816/3192108003 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd15c009050 con 0x5618e04d46d0 2024-09-22T08:36:42.090 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.069+0000 7fd169546800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:36:42.090 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.069+0000 7fd169546800 20 rados->read ofs=0 len=0 2024-09-22T08:36:42.090 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.069+0000 7fd169546800 1 --2- 172.21.15.142:0/532027348 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5618e04d90c0 0x5618e04db4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:42.090 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.069+0000 7fd169546800 1 -- 172.21.15.142:0/532027348 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5618e04dbbf0 con 0x5618e04d90c0 2024-09-22T08:36:42.090 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.069+0000 7fd167838640 1 --2- 172.21.15.142:0/532027348 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5618e04d90c0 0x5618e04db4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:42.090 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.069+0000 7fd167838640 1 --2- 172.21.15.142:0/532027348 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5618e04d90c0 0x5618e04db4b0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:42.090 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.069+0000 7fd167838640 1 -- 172.21.15.142:0/532027348 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(5 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fd16003a070 con 0x5618e04d90c0 2024-09-22T08:36:42.090 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.069+0000 7fd169546800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:36:42.090 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.069+0000 7fd169546800 20 searching for the correct realm 2024-09-22T08:36:42.090 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.070+0000 7fd169546800 1 -- 172.21.15.142:0/532027348 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5618e04dd520 con 0x5618e04d90c0 2024-09-22T08:36:42.090 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.070+0000 7fd167838640 1 -- 172.21.15.142:0/532027348 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd16003a070 con 0x5618e04d90c0 2024-09-22T08:36:42.090 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.070+0000 7fd167838640 1 --2- 172.21.15.142:0/532027348 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7fd160012ab0 0x7fd160008970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:42.091 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.070+0000 7fd167838640 1 -- 172.21.15.142:0/532027348 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5618e04dd520 con 0x7fd160012ab0 2024-09-22T08:36:42.091 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.070+0000 7fd167037640 1 --2- 172.21.15.142:0/532027348 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7fd160012ab0 0x7fd160008970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:42.091 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.070+0000 7fd167037640 1 --2- 172.21.15.142:0/532027348 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7fd160012ab0 0x7fd160008970 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:42.091 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.070+0000 7fd167037640 1 -- 172.21.15.142:0/532027348 <== osd.2 v2:172.21.15.142:6808/279438927 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd158051070 con 0x7fd160012ab0 2024-09-22T08:36:42.091 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.070+0000 7fd167037640 1 --2- 172.21.15.142:0/532027348 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7fd1580a5040 0x7fd158074480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:42.091 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.070+0000 7fd167037640 1 -- 172.21.15.142:0/532027348 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5618e04dd520 con 0x7fd1580a5040 2024-09-22T08:36:42.091 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.071+0000 7fd166836640 1 --2- 172.21.15.142:0/532027348 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7fd1580a5040 0x7fd158074480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:42.091 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.071+0000 7fd166836640 1 --2- 172.21.15.142:0/532027348 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7fd1580a5040 0x7fd158074480 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:42.091 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.071+0000 7fd166836640 1 -- 172.21.15.142:0/532027348 <== osd.0 v2:172.21.15.31:6800/168281188 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd15c009050 con 0x7fd1580a5040 2024-09-22T08:36:42.091 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.071+0000 7fd166836640 1 -- 172.21.15.142:0/532027348 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5618e04dd520 con 0x5618e04d46d0 2024-09-22T08:36:42.091 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.072+0000 7fd166836640 1 -- 172.21.15.142:0/532027348 <== osd.1 v2:172.21.15.142:6816/3192108003 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd15c009050 con 0x5618e04d46d0 2024-09-22T08:36:42.092 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.072+0000 7fd166836640 1 -- 172.21.15.142:0/532027348 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5618e04dd520 con 0x5618e04d46d0 2024-09-22T08:36:42.092 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.072+0000 7fd166836640 1 -- 172.21.15.142:0/532027348 <== osd.1 v2:172.21.15.142:6816/3192108003 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd15c029040 con 0x5618e04d46d0 2024-09-22T08:36:42.092 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.072+0000 7fd166836640 1 -- 172.21.15.142:0/532027348 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5618e04dd520 con 0x7fd1580a5040 2024-09-22T08:36:42.092 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.072+0000 7fd166836640 1 -- 172.21.15.142:0/532027348 <== osd.0 v2:172.21.15.31:6800/168281188 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd15c029040 con 0x7fd1580a5040 2024-09-22T08:36:42.092 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.072+0000 7fd166836640 1 -- 172.21.15.142:0/532027348 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5618e04dd520 con 0x7fd1580a5040 2024-09-22T08:36:42.092 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.072+0000 7fd166836640 1 -- 172.21.15.142:0/532027348 <== osd.0 v2:172.21.15.31:6800/168281188 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd15c029040 con 0x7fd1580a5040 2024-09-22T08:36:42.092 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.072+0000 7fd166836640 1 -- 172.21.15.142:0/532027348 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5618e04dd520 con 0x7fd160012ab0 2024-09-22T08:36:42.092 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.072+0000 7fd167037640 1 -- 172.21.15.142:0/532027348 <== osd.2 v2:172.21.15.142:6808/279438927 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd158051070 con 0x7fd160012ab0 2024-09-22T08:36:42.092 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.073+0000 7fd167037640 1 -- 172.21.15.142:0/532027348 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5618e04dd520 con 0x5618e04d90c0 2024-09-22T08:36:42.092 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.073+0000 7fd167838640 1 -- 172.21.15.142:0/532027348 <== osd.3 v2:172.21.15.142:6800/1064901393 3 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd16003a070 con 0x5618e04d90c0 2024-09-22T08:36:42.092 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.073+0000 7fd167838640 1 -- 172.21.15.142:0/532027348 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5618e04dd520 con 0x5618e04d46d0 2024-09-22T08:36:42.092 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.073+0000 7fd166836640 1 -- 172.21.15.142:0/532027348 <== osd.1 v2:172.21.15.142:6816/3192108003 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd15c029040 con 0x5618e04d46d0 2024-09-22T08:36:42.092 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.073+0000 7fd166836640 1 -- 172.21.15.142:0/532027348 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5618e04dd520 con 0x7fd1580a5040 2024-09-22T08:36:42.093 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.073+0000 7fd166836640 1 -- 172.21.15.142:0/532027348 <== osd.0 v2:172.21.15.31:6800/168281188 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd15c029040 con 0x7fd1580a5040 2024-09-22T08:36:42.093 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.073+0000 7fd166836640 1 -- 172.21.15.142:0/532027348 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5618e04dd520 con 0x5618e04d46d0 2024-09-22T08:36:42.093 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.074+0000 7fd166836640 1 -- 172.21.15.142:0/532027348 <== osd.1 v2:172.21.15.142:6816/3192108003 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd15c029040 con 0x5618e04d46d0 2024-09-22T08:36:42.093 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.074+0000 7fd166836640 1 -- 172.21.15.142:0/532027348 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5618e04dd520 con 0x7fd160012ab0 2024-09-22T08:36:42.093 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.074+0000 7fd167037640 1 -- 172.21.15.142:0/532027348 <== osd.2 v2:172.21.15.142:6808/279438927 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fd158051070 con 0x7fd160012ab0 2024-09-22T08:36:42.093 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.074+0000 7fd167037640 1 -- 172.21.15.142:0/532027348 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5618e04dd520 con 0x5618e04d90c0 2024-09-22T08:36:42.093 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.074+0000 7fd167838640 1 -- 172.21.15.142:0/532027348 <== osd.3 v2:172.21.15.142:6800/1064901393 4 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd16003a070 con 0x5618e04d90c0 2024-09-22T08:36:42.093 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.074+0000 7fd167838640 1 -- 172.21.15.142:0/532027348 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5618e04dd520 con 0x5618e04d90c0 2024-09-22T08:36:42.093 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.074+0000 7fd167838640 1 -- 172.21.15.142:0/532027348 <== osd.3 v2:172.21.15.142:6800/1064901393 5 ==== osd_op_reply(20 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fd16003a070 con 0x5618e04d90c0 2024-09-22T08:36:42.093 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.074+0000 7fd167838640 1 -- 172.21.15.142:0/532027348 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5618e04dd520 con 0x7fd1580a5040 2024-09-22T08:36:42.093 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.075+0000 7fd166836640 1 -- 172.21.15.142:0/532027348 <== osd.0 v2:172.21.15.31:6800/168281188 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd15c029040 con 0x7fd1580a5040 2024-09-22T08:36:42.093 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.075+0000 7fd166836640 1 -- 172.21.15.142:0/532027348 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5618e04dd520 con 0x5618e04d90c0 2024-09-22T08:36:42.093 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.075+0000 7fd167838640 1 -- 172.21.15.142:0/532027348 <== osd.3 v2:172.21.15.142:6800/1064901393 6 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd16003a070 con 0x5618e04d90c0 2024-09-22T08:36:42.094 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.075+0000 7fd167838640 1 -- 172.21.15.142:0/532027348 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5618e04dd520 con 0x5618e04d90c0 2024-09-22T08:36:42.094 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.075+0000 7fd167838640 1 -- 172.21.15.142:0/532027348 <== osd.3 v2:172.21.15.142:6800/1064901393 7 ==== osd_op_reply(23 [pgnls start_epoch 30 out=107b] v23'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fd16003a070 con 0x5618e04d90c0 2024-09-22T08:36:42.094 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.075+0000 7fd167838640 1 -- 172.21.15.142:0/532027348 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5618e04dd520 con 0x5618e04d46d0 2024-09-22T08:36:42.094 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.075+0000 7fd166836640 1 -- 172.21.15.142:0/532027348 <== osd.1 v2:172.21.15.142:6816/3192108003 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd15c029040 con 0x5618e04d46d0 2024-09-22T08:36:42.094 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.075+0000 7fd166836640 1 -- 172.21.15.142:0/532027348 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5618e04dd520 con 0x5618e04d46d0 2024-09-22T08:36:42.094 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.075+0000 7fd166836640 1 -- 172.21.15.142:0/532027348 <== osd.1 v2:172.21.15.142:6816/3192108003 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fd15c029040 con 0x5618e04d46d0 2024-09-22T08:36:42.094 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.075+0000 7fd166836640 1 -- 172.21.15.142:0/532027348 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5618e04dd520 con 0x7fd1580a5040 2024-09-22T08:36:42.094 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.076+0000 7fd166836640 1 -- 172.21.15.142:0/532027348 <== osd.0 v2:172.21.15.31:6800/168281188 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd15c029040 con 0x7fd1580a5040 2024-09-22T08:36:42.094 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.076+0000 7fd166836640 1 -- 172.21.15.142:0/532027348 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5618e04dd520 con 0x5618e04d90c0 2024-09-22T08:36:42.094 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.076+0000 7fd167838640 1 -- 172.21.15.142:0/532027348 <== osd.3 v2:172.21.15.142:6800/1064901393 8 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd16003a070 con 0x5618e04d90c0 2024-09-22T08:36:42.094 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.076+0000 7fd167838640 1 -- 172.21.15.142:0/532027348 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5618e04dd520 con 0x7fd160012ab0 2024-09-22T08:36:42.094 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.076+0000 7fd167037640 1 -- 172.21.15.142:0/532027348 <== osd.2 v2:172.21.15.142:6808/279438927 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd158051070 con 0x7fd160012ab0 2024-09-22T08:36:42.094 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.076+0000 7fd167037640 1 -- 172.21.15.142:0/532027348 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5618e04dd520 con 0x5618e04d46d0 2024-09-22T08:36:42.094 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.076+0000 7fd166836640 1 -- 172.21.15.142:0/532027348 <== osd.1 v2:172.21.15.142:6816/3192108003 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd15c029040 con 0x5618e04d46d0 2024-09-22T08:36:42.095 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.076+0000 7fd166836640 1 -- 172.21.15.142:0/532027348 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5618e04dd520 con 0x7fd1580a5040 2024-09-22T08:36:42.095 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.077+0000 7fd166836640 1 -- 172.21.15.142:0/532027348 <== osd.0 v2:172.21.15.31:6800/168281188 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd15c029040 con 0x7fd1580a5040 2024-09-22T08:36:42.095 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.077+0000 7fd166836640 1 -- 172.21.15.142:0/532027348 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5618e04dd520 con 0x5618e04d90c0 2024-09-22T08:36:42.095 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.077+0000 7fd167838640 1 -- 172.21.15.142:0/532027348 <== osd.3 v2:172.21.15.142:6800/1064901393 9 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd16003a070 con 0x5618e04d90c0 2024-09-22T08:36:42.095 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.077+0000 7fd167838640 1 -- 172.21.15.142:0/532027348 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5618e04dd520 con 0x7fd1580a5040 2024-09-22T08:36:42.095 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.077+0000 7fd166836640 1 -- 172.21.15.142:0/532027348 <== osd.0 v2:172.21.15.31:6800/168281188 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd15c029040 con 0x7fd1580a5040 2024-09-22T08:36:42.095 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.077+0000 7fd166836640 1 -- 172.21.15.142:0/532027348 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5618e04dd520 con 0x7fd160012ab0 2024-09-22T08:36:42.095 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.077+0000 7fd167037640 1 -- 172.21.15.142:0/532027348 <== osd.2 v2:172.21.15.142:6808/279438927 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd158051070 con 0x7fd160012ab0 2024-09-22T08:36:42.095 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.077+0000 7fd167037640 1 -- 172.21.15.142:0/532027348 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5618e04dd520 con 0x5618e04d90c0 2024-09-22T08:36:42.096 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.078+0000 7fd167838640 1 -- 172.21.15.142:0/532027348 <== osd.3 v2:172.21.15.142:6800/1064901393 10 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd16003a070 con 0x5618e04d90c0 2024-09-22T08:36:42.096 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.078+0000 7fd167838640 1 -- 172.21.15.142:0/532027348 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5618e04dd520 con 0x7fd1580a5040 2024-09-22T08:36:42.096 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.078+0000 7fd166836640 1 -- 172.21.15.142:0/532027348 <== osd.0 v2:172.21.15.31:6800/168281188 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd15c029040 con 0x7fd1580a5040 2024-09-22T08:36:42.096 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.078+0000 7fd166836640 1 -- 172.21.15.142:0/532027348 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5618e04dd520 con 0x5618e04d46d0 2024-09-22T08:36:42.096 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.078+0000 7fd166836640 1 -- 172.21.15.142:0/532027348 <== osd.1 v2:172.21.15.142:6816/3192108003 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fd15c029040 con 0x5618e04d46d0 2024-09-22T08:36:42.096 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.078+0000 7fd166836640 1 -- 172.21.15.142:0/532027348 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5618e04dd520 con 0x7fd160012ab0 2024-09-22T08:36:42.096 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.078+0000 7fd167037640 1 -- 172.21.15.142:0/532027348 <== osd.2 v2:172.21.15.142:6808/279438927 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd158051070 con 0x7fd160012ab0 2024-09-22T08:36:42.096 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.078+0000 7fd169546800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:36:42.096 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.078+0000 7fd169546800 20 RGWRados::pool_iterate: got zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec 2024-09-22T08:36:42.096 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.078+0000 7fd169546800 20 RGWRados::pool_iterate: got zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f 2024-09-22T08:36:42.096 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.078+0000 7fd169546800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:36:42.096 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.078+0000 7fd169546800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:36:42.096 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.078+0000 7fd169546800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:36:42.097 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.078+0000 7fd169546800 20 rados->read ofs=0 len=0 2024-09-22T08:36:42.097 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.078+0000 7fd169546800 1 -- 172.21.15.142:0/532027348 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5618e04dc5b0 con 0x5618e04d46d0 2024-09-22T08:36:42.097 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.079+0000 7fd166836640 1 -- 172.21.15.142:0/532027348 <== osd.1 v2:172.21.15.142:6816/3192108003 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd15c029040 con 0x5618e04d46d0 2024-09-22T08:36:42.097 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.079+0000 7fd169546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:42.097 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.079+0000 7fd169546800 20 rados->read ofs=0 len=0 2024-09-22T08:36:42.097 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.079+0000 7fd169546800 1 -- 172.21.15.142:0/532027348 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5618e04dce00 con 0x5618e04d46d0 2024-09-22T08:36:42.097 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.079+0000 7fd166836640 1 -- 172.21.15.142:0/532027348 <== osd.1 v2:172.21.15.142:6816/3192108003 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd15c029040 con 0x5618e04d46d0 2024-09-22T08:36:42.097 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.079+0000 7fd169546800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:36:42.097 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.079+0000 7fd169546800 20 rados->read ofs=0 len=0 2024-09-22T08:36:42.097 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.079+0000 7fd169546800 1 -- 172.21.15.142:0/532027348 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:40 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5618e04dd9a0 con 0x5618e04d90c0 2024-09-22T08:36:42.097 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.079+0000 7fd167838640 1 -- 172.21.15.142:0/532027348 <== osd.3 v2:172.21.15.142:6800/1064901393 11 ==== osd_op_reply(40 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fd16003a070 con 0x5618e04d90c0 2024-09-22T08:36:42.097 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.079+0000 7fd169546800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:36:42.098 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.079+0000 7fd169546800 20 zone default found 2024-09-22T08:36:42.098 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.079+0000 7fd169546800 4 Realm: () 2024-09-22T08:36:42.098 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.079+0000 7fd169546800 4 ZoneGroup: default (d89f6f57-1007-47dd-9065-f486c7b01aec) 2024-09-22T08:36:42.098 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.079+0000 7fd169546800 4 Zone: default (e239248c-0bee-4e41-803a-24b288d3eb8f) 2024-09-22T08:36:42.098 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.079+0000 7fd169546800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:36:42.098 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.079+0000 7fd169546800 20 zonegroup default 2024-09-22T08:36:42.098 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.079+0000 7fd169546800 20 rados->read ofs=0 len=0 2024-09-22T08:36:42.098 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.079+0000 7fd169546800 1 -- 172.21.15.142:0/532027348 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5618e04ddd60 con 0x7fd1580a5040 2024-09-22T08:36:42.098 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.080+0000 7fd166836640 1 -- 172.21.15.142:0/532027348 <== osd.0 v2:172.21.15.31:6800/168281188 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fd15c029040 con 0x7fd1580a5040 2024-09-22T08:36:42.098 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.080+0000 7fd169546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:42.098 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.080+0000 7fd169546800 20 rados->read ofs=0 len=0 2024-09-22T08:36:42.098 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.080+0000 7fd169546800 1 -- 172.21.15.142:0/532027348 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5618e04e0040 con 0x5618e04d90c0 2024-09-22T08:36:42.099 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.080+0000 7fd167838640 1 -- 172.21.15.142:0/532027348 <== osd.3 v2:172.21.15.142:6800/1064901393 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd16003a070 con 0x5618e04d90c0 2024-09-22T08:36:42.099 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.080+0000 7fd169546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:42.099 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.080+0000 7fd169546800 20 rados->read ofs=0 len=0 2024-09-22T08:36:42.099 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.080+0000 7fd169546800 1 -- 172.21.15.142:0/532027348 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5618e04e03e0 con 0x5618e04d90c0 2024-09-22T08:36:42.099 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.080+0000 7fd167838640 1 -- 172.21.15.142:0/532027348 <== osd.3 v2:172.21.15.142:6800/1064901393 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd16003a070 con 0x5618e04d90c0 2024-09-22T08:36:42.099 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.080+0000 7fd169546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:42.099 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.080+0000 7fd169546800 20 started sync module instance, tier type = 2024-09-22T08:36:42.099 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.080+0000 7fd169546800 20 started zone id=e239248c-0bee-4e41-803a-24b288d3eb8f (name=default) with tier type = 2024-09-22T08:36:42.099 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.080+0000 7fd169546800 1 -- 172.21.15.142:0/532027348 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5618e04df4d0 con 0x7fd160012ab0 2024-09-22T08:36:42.099 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.081+0000 7fd167037640 1 -- 172.21.15.142:0/532027348 <== osd.2 v2:172.21.15.142:6808/279438927 7 ==== osd_op_reply(44 notify.0 [create] v30'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd158051070 con 0x7fd160012ab0 2024-09-22T08:36:42.099 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.081+0000 7fd169546800 1 -- 172.21.15.142:0/532027348 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94664842410224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5618e04e0ca0 con 0x7fd160012ab0 2024-09-22T08:36:42.099 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.081+0000 7fd169546800 1 -- 172.21.15.142:0/532027348 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5618e04e14f0 con 0x5618e04d46d0 2024-09-22T08:36:42.099 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.082+0000 7fd167037640 1 -- 172.21.15.142:0/532027348 <== osd.2 v2:172.21.15.142:6808/279438927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94664842410224] v30'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd158051070 con 0x7fd160012ab0 2024-09-22T08:36:42.100 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.082+0000 7fd166836640 1 -- 172.21.15.142:0/532027348 <== osd.1 v2:172.21.15.142:6816/3192108003 15 ==== osd_op_reply(46 notify.1 [create] v30'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd15c029040 con 0x5618e04d46d0 2024-09-22T08:36:42.100 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.082+0000 7fd169546800 1 -- 172.21.15.142:0/532027348 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94664842414064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5618e04e1530 con 0x5618e04d46d0 2024-09-22T08:36:42.100 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.082+0000 7fd169546800 1 -- 172.21.15.142:0/532027348 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5618e04e1ff0 con 0x5618e04d90c0 2024-09-22T08:36:42.100 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.083+0000 7fd166836640 1 -- 172.21.15.142:0/532027348 <== osd.1 v2:172.21.15.142:6816/3192108003 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94664842414064] v30'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd15c029040 con 0x5618e04d46d0 2024-09-22T08:36:42.100 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.083+0000 7fd167838640 1 -- 172.21.15.142:0/532027348 <== osd.3 v2:172.21.15.142:6800/1064901393 14 ==== osd_op_reply(48 notify.2 [create] v30'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd16003a070 con 0x5618e04d90c0 2024-09-22T08:36:42.100 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.084+0000 7fd169546800 1 -- 172.21.15.142:0/532027348 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94664842418880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5618e04e1fb0 con 0x5618e04d90c0 2024-09-22T08:36:42.100 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.084+0000 7fd169546800 1 -- 172.21.15.142:0/532027348 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5618e04e2a70 con 0x7fd160012ab0 2024-09-22T08:36:42.104 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.084+0000 7fd167838640 1 -- 172.21.15.142:0/532027348 <== osd.3 v2:172.21.15.142:6800/1064901393 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94664842418880] v30'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd16003a070 con 0x5618e04d90c0 2024-09-22T08:36:42.104 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.085+0000 7fd167037640 1 -- 172.21.15.142:0/532027348 <== osd.2 v2:172.21.15.142:6808/279438927 9 ==== osd_op_reply(50 notify.3 [create] v30'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd158051070 con 0x7fd160012ab0 2024-09-22T08:36:42.104 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.085+0000 7fd169546800 1 -- 172.21.15.142:0/532027348 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94664842416192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5618e04e2a30 con 0x7fd160012ab0 2024-09-22T08:36:42.104 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.085+0000 7fd169546800 1 -- 172.21.15.142:0/532027348 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5618e04e3500 con 0x5618e04d46d0 2024-09-22T08:36:42.104 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.086+0000 7fd167037640 1 -- 172.21.15.142:0/532027348 <== osd.2 v2:172.21.15.142:6808/279438927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94664842416192] v30'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd158051070 con 0x7fd160012ab0 2024-09-22T08:36:42.105 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.086+0000 7fd166836640 1 -- 172.21.15.142:0/532027348 <== osd.1 v2:172.21.15.142:6816/3192108003 17 ==== osd_op_reply(52 notify.4 [create] v30'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd15c029040 con 0x5618e04d46d0 2024-09-22T08:36:42.105 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.086+0000 7fd169546800 1 -- 172.21.15.142:0/532027348 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94664842424368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5618e04e2a30 con 0x5618e04d46d0 2024-09-22T08:36:42.105 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.086+0000 7fd169546800 1 -- 172.21.15.142:0/532027348 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5618e04e3f80 con 0x7fd1580a5040 2024-09-22T08:36:42.105 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.089+0000 7fd166836640 1 -- 172.21.15.142:0/532027348 <== osd.1 v2:172.21.15.142:6816/3192108003 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94664842424368] v30'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd15c029040 con 0x5618e04d46d0 2024-09-22T08:36:42.105 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.090+0000 7fd166836640 1 -- 172.21.15.142:0/532027348 <== osd.0 v2:172.21.15.31:6800/168281188 11 ==== osd_op_reply(54 notify.5 [create] v30'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd15c029040 con 0x7fd1580a5040 2024-09-22T08:36:42.105 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.090+0000 7fd169546800 1 -- 172.21.15.142:0/532027348 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94664842427024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5618e04e3f80 con 0x7fd1580a5040 2024-09-22T08:36:42.105 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.090+0000 7fd169546800 1 -- 172.21.15.142:0/532027348 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5618e04e4a00 con 0x7fd1580a5040 2024-09-22T08:36:42.105 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.090+0000 7fd166836640 1 -- 172.21.15.142:0/532027348 <== osd.0 v2:172.21.15.31:6800/168281188 12 ==== osd_op_reply(56 notify.6 [create] v30'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd15c029040 con 0x7fd1580a5040 2024-09-22T08:36:42.105 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.091+0000 7fd169546800 1 -- 172.21.15.142:0/532027348 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94664842429680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5618e04e4e70 con 0x7fd1580a5040 2024-09-22T08:36:42.105 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.091+0000 7fd169546800 1 -- 172.21.15.142:0/532027348 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5618e04e5940 con 0x7fd1580a5040 2024-09-22T08:36:42.105 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.091+0000 7fd166836640 1 -- 172.21.15.142:0/532027348 <== osd.0 v2:172.21.15.31:6800/168281188 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94664842427024] v30'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd15c029040 con 0x7fd1580a5040 2024-09-22T08:36:42.105 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.091+0000 7fd166836640 1 -- 172.21.15.142:0/532027348 <== osd.0 v2:172.21.15.31:6800/168281188 14 ==== osd_op_reply(58 notify.7 [create] v30'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd15c029040 con 0x7fd1580a5040 2024-09-22T08:36:42.105 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.091+0000 7fd169546800 1 -- 172.21.15.142:0/532027348 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94664842433584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5618e04e5900 con 0x7fd1580a5040 2024-09-22T08:36:42.105 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.091+0000 7fd169546800 20 add_watcher() i=0 2024-09-22T08:36:42.106 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.091+0000 7fd169546800 20 add_watcher() i=1 2024-09-22T08:36:42.106 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.091+0000 7fd169546800 20 add_watcher() i=2 2024-09-22T08:36:42.106 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.091+0000 7fd169546800 20 add_watcher() i=3 2024-09-22T08:36:42.106 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.091+0000 7fd169546800 20 add_watcher() i=4 2024-09-22T08:36:42.106 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.091+0000 7fd169546800 20 add_watcher() i=5 2024-09-22T08:36:42.106 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.091+0000 7fd166836640 1 -- 172.21.15.142:0/532027348 <== osd.0 v2:172.21.15.31:6800/168281188 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94664842429680] v30'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd15c029040 con 0x7fd1580a5040 2024-09-22T08:36:42.106 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.091+0000 7fd169546800 20 add_watcher() i=6 2024-09-22T08:36:42.106 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.092+0000 7fd166836640 1 -- 172.21.15.142:0/532027348 <== osd.0 v2:172.21.15.31:6800/168281188 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94664842433584] v30'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd15c029040 con 0x7fd1580a5040 2024-09-22T08:36:42.106 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.092+0000 7fd169546800 20 add_watcher() i=7 2024-09-22T08:36:42.107 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.092+0000 7fd169546800 2 all 8 watchers are set, enabling cache 2024-09-22T08:36:42.107 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.092+0000 7fd169546800 1 -- 172.21.15.142:0/532027348 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5618e04e4a10 con 0x5618e04d46d0 2024-09-22T08:36:42.107 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.093+0000 7fd166836640 1 -- 172.21.15.142:0/532027348 <== osd.1 v2:172.21.15.142:6816/3192108003 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fd15c029040 con 0x5618e04d46d0 2024-09-22T08:36:42.107 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.093+0000 7fd169546800 1 -- 172.21.15.142:0/532027348 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94664842421632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5618e04e4a10 con 0x5618e04d46d0 2024-09-22T08:36:42.107 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.094+0000 7fd166836640 1 -- 172.21.15.142:0/532027348 <== osd.1 v2:172.21.15.142:6816/3192108003 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94664842421632] v30'41 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd15c029040 con 0x5618e04d46d0 2024-09-22T08:36:42.107 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.094+0000 7fd01dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:36:42.107 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.094+0000 7fd169546800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:36:42.107 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.094+0000 7fd169546800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:36:42.107 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.094+0000 7fd169546800 1 -- 172.21.15.142:0/532027348 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5618e04f1450 con 0x5618e04d46d0 2024-09-22T08:36:42.107 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.095+0000 7fd166836640 1 -- 172.21.15.142:0/532027348 <== osd.1 v2:172.21.15.142:6816/3192108003 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v30'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd15c029040 con 0x5618e04d46d0 2024-09-22T08:36:42.107 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.095+0000 7fd169546800 1 -- 172.21.15.142:0/532027348 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5618e04f1aa0 con 0x7fd1580a5040 2024-09-22T08:36:42.107 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.096+0000 7fd166836640 1 -- 172.21.15.142:0/532027348 <== osd.0 v2:172.21.15.31:6800/168281188 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v30'13 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd15c029040 con 0x7fd1580a5040 2024-09-22T08:36:42.107 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.096+0000 7fd169546800 1 -- 172.21.15.142:0/532027348 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5618e04f1ee0 con 0x5618e04d90c0 2024-09-22T08:36:42.107 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.097+0000 7fd167838640 1 -- 172.21.15.142:0/532027348 <== osd.3 v2:172.21.15.142:6800/1064901393 16 ==== osd_op_reply(64 gc.2 [create,call,call,call] v30'13 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd16003a070 con 0x5618e04d90c0 2024-09-22T08:36:42.108 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.097+0000 7fd169546800 1 -- 172.21.15.142:0/532027348 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5618e04f1e30 con 0x5618e04d46d0 2024-09-22T08:36:42.108 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.099+0000 7fd166836640 1 -- 172.21.15.142:0/532027348 <== osd.1 v2:172.21.15.142:6816/3192108003 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v30'42 uv15 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd15c029040 con 0x5618e04d46d0 2024-09-22T08:36:42.108 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.099+0000 7fd169546800 1 -- 172.21.15.142:0/532027348 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5618e04f23c0 con 0x7fd160012ab0 2024-09-22T08:36:42.108 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.102+0000 7fd167037640 1 -- 172.21.15.142:0/532027348 <== osd.2 v2:172.21.15.142:6808/279438927 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v30'29 uv13 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd158051070 con 0x7fd160012ab0 2024-09-22T08:36:42.108 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.102+0000 7fd169546800 1 -- 172.21.15.142:0/532027348 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5618e04f2850 con 0x5618e04d90c0 2024-09-22T08:36:42.109 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.103+0000 7fd167838640 1 -- 172.21.15.142:0/532027348 <== osd.3 v2:172.21.15.142:6800/1064901393 17 ==== osd_op_reply(67 gc.5 [create,call,call,call] v30'19 uv10 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd16003a070 con 0x5618e04d90c0 2024-09-22T08:36:42.109 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.103+0000 7fd169546800 1 -- 172.21.15.142:0/532027348 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5618e04f2850 con 0x5618e04d46d0 2024-09-22T08:36:42.109 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.104+0000 7fd166836640 1 -- 172.21.15.142:0/532027348 <== osd.1 v2:172.21.15.142:6816/3192108003 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v30'15 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd15c029040 con 0x5618e04d46d0 2024-09-22T08:36:42.109 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.104+0000 7fd169546800 1 -- 172.21.15.142:0/532027348 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5618e04f2680 con 0x7fd1580a5040 2024-09-22T08:36:42.109 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.105+0000 7fd166836640 1 -- 172.21.15.142:0/532027348 <== osd.0 v2:172.21.15.31:6800/168281188 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v30'19 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd15c029040 con 0x7fd1580a5040 2024-09-22T08:36:42.109 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.105+0000 7fd169546800 1 -- 172.21.15.142:0/532027348 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5618e04f2740 con 0x7fd160012ab0 2024-09-22T08:36:42.110 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.106+0000 7fd167037640 1 -- 172.21.15.142:0/532027348 <== osd.2 v2:172.21.15.142:6808/279438927 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v30'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd158051070 con 0x7fd160012ab0 2024-09-22T08:36:42.110 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.106+0000 7fd169546800 1 -- 172.21.15.142:0/532027348 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5618e04f2c40 con 0x5618e04d90c0 2024-09-22T08:36:42.110 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.107+0000 7fd167838640 1 -- 172.21.15.142:0/532027348 <== osd.3 v2:172.21.15.142:6800/1064901393 18 ==== osd_op_reply(71 gc.9 [create,call,call,call] v30'19 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd16003a070 con 0x5618e04d90c0 2024-09-22T08:36:42.110 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.107+0000 7fd169546800 1 -- 172.21.15.142:0/532027348 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5618e04f2c40 con 0x7fd160012ab0 2024-09-22T08:36:42.110 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.108+0000 7fd167037640 1 -- 172.21.15.142:0/532027348 <== osd.2 v2:172.21.15.142:6808/279438927 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v30'30 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd158051070 con 0x7fd160012ab0 2024-09-22T08:36:42.110 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.108+0000 7fd169546800 1 -- 172.21.15.142:0/532027348 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5618e04f2c40 con 0x7fd1580a5040 2024-09-22T08:36:42.112 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.110+0000 7fd166836640 1 -- 172.21.15.142:0/532027348 <== osd.0 v2:172.21.15.31:6800/168281188 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v30'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd15c029040 con 0x7fd1580a5040 2024-09-22T08:36:42.112 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.110+0000 7fd169546800 1 -- 172.21.15.142:0/532027348 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5618e04f2c40 con 0x7fd160012ab0 2024-09-22T08:36:42.113 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.111+0000 7fd167037640 1 -- 172.21.15.142:0/532027348 <== osd.2 v2:172.21.15.142:6808/279438927 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v30'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd158051070 con 0x7fd160012ab0 2024-09-22T08:36:42.113 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.111+0000 7fd169546800 1 -- 172.21.15.142:0/532027348 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5618e04f2c40 con 0x7fd1580a5040 2024-09-22T08:36:42.114 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.112+0000 7fd166836640 1 -- 172.21.15.142:0/532027348 <== osd.0 v2:172.21.15.31:6800/168281188 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v30'25 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd15c029040 con 0x7fd1580a5040 2024-09-22T08:36:42.114 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.112+0000 7fd169546800 1 -- 172.21.15.142:0/532027348 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5618e04f2c40 con 0x5618e04d46d0 2024-09-22T08:36:42.115 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.113+0000 7fd166836640 1 -- 172.21.15.142:0/532027348 <== osd.1 v2:172.21.15.142:6816/3192108003 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v30'43 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd15c029040 con 0x5618e04d46d0 2024-09-22T08:36:42.115 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.113+0000 7fd169546800 1 -- 172.21.15.142:0/532027348 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5618e04f2c40 con 0x5618e04d90c0 2024-09-22T08:36:42.117 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.115+0000 7fd167838640 1 -- 172.21.15.142:0/532027348 <== osd.3 v2:172.21.15.142:6800/1064901393 19 ==== osd_op_reply(77 gc.15 [create,call,call,call] v30'23 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd16003a070 con 0x5618e04d90c0 2024-09-22T08:36:42.117 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.115+0000 7fd169546800 1 -- 172.21.15.142:0/532027348 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5618e04f2c40 con 0x7fd160012ab0 2024-09-22T08:36:42.118 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.116+0000 7fd167037640 1 -- 172.21.15.142:0/532027348 <== osd.2 v2:172.21.15.142:6808/279438927 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v30'31 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd158051070 con 0x7fd160012ab0 2024-09-22T08:36:42.118 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.116+0000 7fd169546800 1 -- 172.21.15.142:0/532027348 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5618e04f2c40 con 0x5618e04d90c0 2024-09-22T08:36:42.119 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.117+0000 7fd167838640 1 -- 172.21.15.142:0/532027348 <== osd.3 v2:172.21.15.142:6800/1064901393 20 ==== osd_op_reply(79 gc.17 [create,call,call,call] v30'13 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd16003a070 con 0x5618e04d90c0 2024-09-22T08:36:42.119 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.117+0000 7fd169546800 1 -- 172.21.15.142:0/532027348 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5618e04f2c40 con 0x5618e04d46d0 2024-09-22T08:36:42.120 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.118+0000 7fd166836640 1 -- 172.21.15.142:0/532027348 <== osd.1 v2:172.21.15.142:6816/3192108003 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v30'21 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd15c029040 con 0x5618e04d46d0 2024-09-22T08:36:42.120 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.118+0000 7fd169546800 1 -- 172.21.15.142:0/532027348 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5618e04f2c40 con 0x5618e04d46d0 2024-09-22T08:36:42.122 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.121+0000 7fd166836640 1 -- 172.21.15.142:0/532027348 <== osd.1 v2:172.21.15.142:6816/3192108003 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v30'44 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd15c029040 con 0x5618e04d46d0 2024-09-22T08:36:42.122 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.121+0000 7fd169546800 1 -- 172.21.15.142:0/532027348 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5618e04f2c40 con 0x5618e04d90c0 2024-09-22T08:36:42.124 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.122+0000 7fd167838640 1 -- 172.21.15.142:0/532027348 <== osd.3 v2:172.21.15.142:6800/1064901393 21 ==== osd_op_reply(82 gc.20 [create,call,call,call] v30'24 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd16003a070 con 0x5618e04d90c0 2024-09-22T08:36:42.124 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.122+0000 7fd169546800 1 -- 172.21.15.142:0/532027348 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5618e04f2c40 con 0x7fd160012ab0 2024-09-22T08:36:42.125 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.123+0000 7fd167037640 1 -- 172.21.15.142:0/532027348 <== osd.2 v2:172.21.15.142:6808/279438927 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v30'23 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd158051070 con 0x7fd160012ab0 2024-09-22T08:36:42.125 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.123+0000 7fd169546800 1 -- 172.21.15.142:0/532027348 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5618e04f2c40 con 0x5618e04d90c0 2024-09-22T08:36:42.126 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.124+0000 7fd167838640 1 -- 172.21.15.142:0/532027348 <== osd.3 v2:172.21.15.142:6800/1064901393 22 ==== osd_op_reply(84 gc.22 [create,call,call,call] v30'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd16003a070 con 0x5618e04d90c0 2024-09-22T08:36:42.126 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.124+0000 7fd169546800 1 -- 172.21.15.142:0/532027348 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5618e04f2c60 con 0x5618e04d90c0 2024-09-22T08:36:42.128 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.126+0000 7fd167838640 1 -- 172.21.15.142:0/532027348 <== osd.3 v2:172.21.15.142:6800/1064901393 23 ==== osd_op_reply(85 gc.23 [create,call,call,call] v30'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd16003a070 con 0x5618e04d90c0 2024-09-22T08:36:42.129 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.126+0000 7fd169546800 1 -- 172.21.15.142:0/532027348 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5618e04f2ca0 con 0x5618e04d90c0 2024-09-22T08:36:42.129 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.127+0000 7fd167838640 1 -- 172.21.15.142:0/532027348 <== osd.3 v2:172.21.15.142:6800/1064901393 24 ==== osd_op_reply(86 gc.24 [create,call,call,call] v30'9 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd16003a070 con 0x5618e04d90c0 2024-09-22T08:36:42.130 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.127+0000 7fd169546800 1 -- 172.21.15.142:0/532027348 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5618e04f2ca0 con 0x5618e04d90c0 2024-09-22T08:36:42.130 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.128+0000 7fd167838640 1 -- 172.21.15.142:0/532027348 <== osd.3 v2:172.21.15.142:6800/1064901393 25 ==== osd_op_reply(87 gc.25 [create,call,call,call] v30'20 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd16003a070 con 0x5618e04d90c0 2024-09-22T08:36:42.131 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.128+0000 7fd169546800 1 -- 172.21.15.142:0/532027348 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5618e04f2ce0 con 0x7fd1580a5040 2024-09-22T08:36:42.132 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.129+0000 7fd166836640 1 -- 172.21.15.142:0/532027348 <== osd.0 v2:172.21.15.31:6800/168281188 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v30'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd15c029040 con 0x7fd1580a5040 2024-09-22T08:36:42.132 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.129+0000 7fd169546800 1 -- 172.21.15.142:0/532027348 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5618e04f2ca0 con 0x5618e04d90c0 2024-09-22T08:36:42.133 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.130+0000 7fd167838640 1 -- 172.21.15.142:0/532027348 <== osd.3 v2:172.21.15.142:6800/1064901393 26 ==== osd_op_reply(89 gc.27 [create,call,call,call] v30'13 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd16003a070 con 0x5618e04d90c0 2024-09-22T08:36:42.133 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.131+0000 7fd169546800 1 -- 172.21.15.142:0/532027348 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5618e04f2ca0 con 0x7fd1580a5040 2024-09-22T08:36:42.134 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.132+0000 7fd166836640 1 -- 172.21.15.142:0/532027348 <== osd.0 v2:172.21.15.31:6800/168281188 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v30'20 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd15c029040 con 0x7fd1580a5040 2024-09-22T08:36:42.134 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.132+0000 7fd169546800 1 -- 172.21.15.142:0/532027348 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5618e04f2cc0 con 0x5618e04d90c0 2024-09-22T08:36:42.135 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.133+0000 7fd167838640 1 -- 172.21.15.142:0/532027348 <== osd.3 v2:172.21.15.142:6800/1064901393 27 ==== osd_op_reply(91 gc.29 [create,call,call,call] v30'25 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd16003a070 con 0x5618e04d90c0 2024-09-22T08:36:42.135 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.133+0000 7fd169546800 1 -- 172.21.15.142:0/532027348 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5618e04f2cc0 con 0x7fd1580a5040 2024-09-22T08:36:42.136 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.134+0000 7fd166836640 1 -- 172.21.15.142:0/532027348 <== osd.0 v2:172.21.15.31:6800/168281188 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v30'26 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd15c029040 con 0x7fd1580a5040 2024-09-22T08:36:42.136 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.134+0000 7fd169546800 1 -- 172.21.15.142:0/532027348 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5618e04f2d50 con 0x7fd160012ab0 2024-09-22T08:36:42.138 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.135+0000 7fd167037640 1 -- 172.21.15.142:0/532027348 <== osd.2 v2:172.21.15.142:6808/279438927 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v30'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd158051070 con 0x7fd160012ab0 2024-09-22T08:36:42.138 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.135+0000 7fd01cfe1640 20 reqs_thread_entry: start 2024-09-22T08:36:42.138 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.136+0000 7fd169546800 20 init_complete bucket index max shards: 11 2024-09-22T08:36:42.138 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.136+0000 7fd169546800 20 Filter name: none 2024-09-22T08:36:42.138 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.136+0000 7fcf967fc640 20 reqs_thread_entry: start 2024-09-22T08:36:42.139 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.136+0000 7fd169546800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-22T08:36:42.139 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.136+0000 7fd169546800 20 rados->read ofs=0 len=0 2024-09-22T08:36:42.139 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.136+0000 7fd169546800 1 -- 172.21.15.142:0/532027348 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5618e051dc80 con 0x5618e04d46d0 2024-09-22T08:36:42.139 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.136+0000 7fd166836640 1 -- 172.21.15.142:0/532027348 <== osd.1 v2:172.21.15.142:6816/3192108003 27 ==== osd_op_reply(94 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7fd15c029040 con 0x5618e04d46d0 2024-09-22T08:36:42.139 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.136+0000 7fd169546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:42.139 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.136+0000 7fd169546800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x0 2024-09-22T08:36:42.139 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.136+0000 7fd169546800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-22T08:36:42.139 INFO:teuthology.orchestra.run.smithi142.stderr:could not remove user: unable to remove user, user does not exist 2024-09-22T08:36:42.140 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.137+0000 7fd01dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:36:42.140 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.137+0000 7fd169546800 1 -- 172.21.15.142:0/532027348 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94664842421632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5618e04eedd0 con 0x5618e04d46d0 2024-09-22T08:36:42.140 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.138+0000 7fd166836640 1 -- 172.21.15.142:0/532027348 <== osd.1 v2:172.21.15.142:6816/3192108003 28 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 94664842421632] v30'45 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd15c029040 con 0x5618e04d46d0 2024-09-22T08:36:42.140 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.138+0000 7fd169546800 1 -- 172.21.15.142:0/532027348 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94664842410224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5618e04e2580 con 0x7fd160012ab0 2024-09-22T08:36:42.143 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.140+0000 7fd167037640 1 -- 172.21.15.142:0/532027348 <== osd.2 v2:172.21.15.142:6808/279438927 18 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 94664842410224] v30'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd158051070 con 0x7fd160012ab0 2024-09-22T08:36:42.143 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.140+0000 7fd169546800 20 remove_watcher() i=0 2024-09-22T08:36:42.143 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.140+0000 7fd169546800 2 removed watcher, disabling cache 2024-09-22T08:36:42.143 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.140+0000 7fd169546800 1 -- 172.21.15.142:0/532027348 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94664842414064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5618e04e2580 con 0x5618e04d46d0 2024-09-22T08:36:42.144 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.141+0000 7fd166836640 1 -- 172.21.15.142:0/532027348 <== osd.1 v2:172.21.15.142:6816/3192108003 29 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 94664842414064] v30'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd15c029040 con 0x5618e04d46d0 2024-09-22T08:36:42.144 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.142+0000 7fd169546800 20 remove_watcher() i=1 2024-09-22T08:36:42.144 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.142+0000 7fd169546800 1 -- 172.21.15.142:0/532027348 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94664842418880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5618e04e2580 con 0x5618e04d90c0 2024-09-22T08:36:42.145 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.143+0000 7fd167838640 1 -- 172.21.15.142:0/532027348 <== osd.3 v2:172.21.15.142:6800/1064901393 28 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 94664842418880] v30'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd16003a070 con 0x5618e04d90c0 2024-09-22T08:36:42.145 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.143+0000 7fd169546800 20 remove_watcher() i=2 2024-09-22T08:36:42.145 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.143+0000 7fd169546800 1 -- 172.21.15.142:0/532027348 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94664842416192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5618e04e2580 con 0x7fd160012ab0 2024-09-22T08:36:42.146 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.143+0000 7fd167037640 1 -- 172.21.15.142:0/532027348 <== osd.2 v2:172.21.15.142:6808/279438927 19 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 94664842416192] v30'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd158051070 con 0x7fd160012ab0 2024-09-22T08:36:42.146 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.143+0000 7fd169546800 20 remove_watcher() i=3 2024-09-22T08:36:42.146 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.144+0000 7fd169546800 1 -- 172.21.15.142:0/532027348 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94664842424368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5618e04e1040 con 0x5618e04d46d0 2024-09-22T08:36:42.147 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.145+0000 7fd166836640 1 -- 172.21.15.142:0/532027348 <== osd.1 v2:172.21.15.142:6816/3192108003 30 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 94664842424368] v30'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd15c029040 con 0x5618e04d46d0 2024-09-22T08:36:42.147 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.145+0000 7fd169546800 20 remove_watcher() i=4 2024-09-22T08:36:42.147 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.145+0000 7fd169546800 1 -- 172.21.15.142:0/532027348 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94664842427024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5618e04e2580 con 0x7fd1580a5040 2024-09-22T08:36:42.148 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.145+0000 7fd166836640 1 -- 172.21.15.142:0/532027348 <== osd.0 v2:172.21.15.31:6800/168281188 24 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 94664842427024] v30'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd15c029040 con 0x7fd1580a5040 2024-09-22T08:36:42.148 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.145+0000 7fd169546800 20 remove_watcher() i=5 2024-09-22T08:36:42.148 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.145+0000 7fd169546800 1 -- 172.21.15.142:0/532027348 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94664842429680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5618e04e3030 con 0x7fd1580a5040 2024-09-22T08:36:42.149 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.146+0000 7fd166836640 1 -- 172.21.15.142:0/532027348 <== osd.0 v2:172.21.15.31:6800/168281188 25 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 94664842429680] v30'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd15c029040 con 0x7fd1580a5040 2024-09-22T08:36:42.149 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.146+0000 7fd169546800 20 remove_watcher() i=6 2024-09-22T08:36:42.149 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.146+0000 7fd169546800 1 -- 172.21.15.142:0/532027348 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94664842433584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5618e04e1040 con 0x7fd1580a5040 2024-09-22T08:36:42.152 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.147+0000 7fd166836640 1 -- 172.21.15.142:0/532027348 <== osd.0 v2:172.21.15.31:6800/168281188 26 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 94664842433584] v30'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd15c029040 con 0x7fd1580a5040 2024-09-22T08:36:42.152 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.147+0000 7fd169546800 20 remove_watcher() i=7 2024-09-22T08:36:42.152 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.148+0000 7fd169546800 1 -- 172.21.15.142:0/532027348 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7fd1580a5040 msgr2=0x7fd158074480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:42.152 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.148+0000 7fd169546800 1 --2- 172.21.15.142:0/532027348 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7fd1580a5040 0x7fd158074480 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:42.152 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.148+0000 7fd169546800 1 -- 172.21.15.142:0/532027348 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5618e04d46d0 msgr2=0x5618e04d6b90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:42.152 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.148+0000 7fd169546800 1 --2- 172.21.15.142:0/532027348 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5618e04d46d0 0x5618e04d6b90 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:42.152 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.148+0000 7fd169546800 1 -- 172.21.15.142:0/532027348 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7fd160012ab0 msgr2=0x7fd160008970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:42.152 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.148+0000 7fd169546800 1 --2- 172.21.15.142:0/532027348 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7fd160012ab0 0x7fd160008970 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:42.152 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.148+0000 7fd169546800 1 -- 172.21.15.142:0/532027348 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5618e04d90c0 msgr2=0x5618e04db4b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:42.152 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.148+0000 7fd169546800 1 --2- 172.21.15.142:0/532027348 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5618e04d90c0 0x5618e04db4b0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:42.153 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.148+0000 7fd169546800 1 -- 172.21.15.142:0/532027348 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fd03003cfb0 msgr2=0x7fd03003f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:42.153 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.148+0000 7fd169546800 1 --2- 172.21.15.142:0/532027348 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fd03003cfb0 0x7fd03003f470 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd158097430 tx=0x7fd158089000 comp rx=0 tx=0).stop 2024-09-22T08:36:42.153 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.148+0000 7fd169546800 1 -- 172.21.15.142:0/532027348 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5618e04c17a0 msgr2=0x5618e04c8d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:42.153 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.148+0000 7fd166836640 1 -- 172.21.15.142:0/532027348 reap_dead start 2024-09-22T08:36:42.153 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.148+0000 7fd169546800 1 --2- 172.21.15.142:0/532027348 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5618e04c17a0 0x5618e04c8d80 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fd16001ff70 tx=0x7fd1600547d0 comp rx=0 tx=0).stop 2024-09-22T08:36:42.153 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.148+0000 7fd169546800 1 -- 172.21.15.142:0/532027348 shutdown_connections 2024-09-22T08:36:42.153 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.148+0000 7fd169546800 1 --2- 172.21.15.142:0/532027348 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5618e04c17a0 0x5618e04c8d80 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:42.153 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.148+0000 7fd169546800 1 -- 172.21.15.142:0/532027348 >> 172.21.15.142:0/532027348 conn(0x5618e04bdba0 msgr2=0x5618e04bbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:42.153 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.148+0000 7fd169546800 1 -- 172.21.15.142:0/532027348 shutdown_connections 2024-09-22T08:36:42.153 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.148+0000 7fd169546800 1 -- 172.21.15.142:0/532027348 wait complete. 2024-09-22T08:36:42.153 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.148+0000 7fd169546800 1 -- 172.21.15.142:0/4001901191 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fd04003cfb0 msgr2=0x7fd04003f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:42.153 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.148+0000 7fd169546800 1 --2- 172.21.15.142:0/4001901191 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fd04003cfb0 0x7fd04003f470 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x5618e049be00 tx=0x7fd15805da60 comp rx=0 tx=0).stop 2024-09-22T08:36:42.153 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.148+0000 7fd169546800 1 -- 172.21.15.142:0/4001901191 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5618e04b4ce0 msgr2=0x5618e04b5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:42.153 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.148+0000 7fd169546800 1 --2- 172.21.15.142:0/4001901191 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5618e04b4ce0 0x5618e04b5100 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x5618e049ad00 tx=0x7fd1600167b0 comp rx=0 tx=0).stop 2024-09-22T08:36:42.154 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.148+0000 7fd169546800 1 -- 172.21.15.142:0/4001901191 shutdown_connections 2024-09-22T08:36:42.154 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.148+0000 7fd169546800 1 --2- 172.21.15.142:0/4001901191 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fd04003cfb0 0x7fd04003f470 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:42.154 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.148+0000 7fd169546800 1 --2- 172.21.15.142:0/4001901191 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5618e04b4ce0 0x5618e04b5100 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:42.154 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.148+0000 7fd169546800 1 -- 172.21.15.142:0/4001901191 >> 172.21.15.142:0/4001901191 conn(0x5618e04a9090 msgr2=0x5618e04a9470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:42.154 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.148+0000 7fd169546800 1 -- 172.21.15.142:0/4001901191 shutdown_connections 2024-09-22T08:36:42.154 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.148+0000 7fd169546800 1 -- 172.21.15.142:0/4001901191 wait complete. 2024-09-22T08:36:42.154 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.149+0000 7fd169546800 1 -- 172.21.15.142:0/3818364611 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5618e03a59f0 msgr2=0x5618e04a1350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:42.154 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.149+0000 7fd169546800 1 --2- 172.21.15.142:0/3818364611 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5618e03a59f0 0x5618e04a1350 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:42.154 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.149+0000 7fd169546800 1 -- 172.21.15.142:0/3818364611 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5618e04a36f0 msgr2=0x5618e04a5b90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:42.154 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.149+0000 7fd169546800 1 --2- 172.21.15.142:0/3818364611 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5618e04a36f0 0x5618e04a5b90 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:42.154 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.149+0000 7fd169546800 1 -- 172.21.15.142:0/3818364611 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fd04c03cfb0 msgr2=0x7fd04c03f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:42.154 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.149+0000 7fd169546800 1 --2- 172.21.15.142:0/3818364611 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fd04c03cfb0 0x7fd04c03f470 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd15c001d70 tx=0x7fd15c0012d0 comp rx=0 tx=0).stop 2024-09-22T08:36:42.154 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.149+0000 7fd169546800 1 -- 172.21.15.142:0/3818364611 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5618e0314510 msgr2=0x5618e0499d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:42.155 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.149+0000 7fd169546800 1 --2- 172.21.15.142:0/3818364611 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5618e0314510 0x5618e0499d00 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fd158025c20 tx=0x7fd158002fb0 comp rx=0 tx=0).stop 2024-09-22T08:36:42.155 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.149+0000 7fd169546800 1 -- 172.21.15.142:0/3818364611 shutdown_connections 2024-09-22T08:36:42.155 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.149+0000 7fd169546800 1 --2- 172.21.15.142:0/3818364611 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5618e04a36f0 0x5618e04a5b90 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:42.155 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.149+0000 7fd169546800 1 --2- 172.21.15.142:0/3818364611 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5618e03a59f0 0x5618e04a1350 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:42.155 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.149+0000 7fd169546800 1 --2- 172.21.15.142:0/3818364611 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fd04c03cfb0 0x7fd04c03f470 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:42.155 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.149+0000 7fd169546800 1 --2- 172.21.15.142:0/3818364611 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5618e0314510 0x5618e0499d00 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:42.155 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.149+0000 7fd169546800 1 -- 172.21.15.142:0/3818364611 >> 172.21.15.142:0/3818364611 conn(0x5618e039aba0 msgr2=0x5618e048c3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:42.155 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.149+0000 7fd169546800 1 -- 172.21.15.142:0/3818364611 shutdown_connections 2024-09-22T08:36:42.155 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.149+0000 7fd169546800 1 -- 172.21.15.142:0/3818364611 wait complete. 2024-09-22T08:36:42.159 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-22T08:36:42.160 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-09-22T08:36:42.160 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-09-22T08:36:42.160 DEBUG:teuthology.orchestra.run.smithi142:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement rm --rgw-zone default --placement-id new-placement 2024-09-22T08:36:42.206 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:36:42.206 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:36:42.208 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.205+0000 7fc195040800 1 Processor -- start 2024-09-22T08:36:42.208 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.205+0000 7fc195040800 1 -- start start 2024-09-22T08:36:42.208 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.205+0000 7fc195040800 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55ee840cc1d0 0x55ee840ce5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:42.208 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.205+0000 7fc195040800 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55ee83f56a20 con 0x55ee840ceb00 2024-09-22T08:36:42.208 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.205+0000 7fc195040800 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x55ee83f567d0 con 0x55ee840cc1d0 2024-09-22T08:36:42.208 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.205+0000 7fc192b2a640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55ee840cc1d0 0x55ee840ce5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:42.208 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.205+0000 7fc192329640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x55ee840ceb00 0x55ee840d0ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.142:42266/0 (socket says 172.21.15.142:42266) 2024-09-22T08:36:42.208 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.205+0000 7fc192329640 1 -- 172.21.15.142:0/3348359638 learned_addr learned my addr 172.21.15.142:0/3348359638 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-09-22T08:36:42.208 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.206+0000 7fc192b2a640 1 -- 172.21.15.142:0/3348359638 >> v1:172.21.15.31:6789/0 conn(0x55ee840ceb00 legacy=0x55ee840d0ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:42.208 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.206+0000 7fc191b28640 1 -- 172.21.15.142:0/3348359638 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3776868994 0 0) 0x55ee83f56a20 con 0x55ee840ceb00 2024-09-22T08:36:42.208 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.206+0000 7fc192b2a640 1 -- 172.21.15.142:0/3348359638 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee840d36b0 con 0x55ee840cc1d0 2024-09-22T08:36:42.210 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.207+0000 7fc192b2a640 1 --2- 172.21.15.142:0/3348359638 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ee840cc1d0 0x55ee840ce5c0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fc184005fd0 tx=0x7fc184045c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8025429e1c09c14 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:42.210 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.208+0000 7fc191b28640 1 -- 172.21.15.142:0/3348359638 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc184058530 con 0x55ee840cc1d0 2024-09-22T08:36:42.210 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.208+0000 7fc191b28640 1 -- 172.21.15.142:0/3348359638 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1840586d0 con 0x55ee840cc1d0 2024-09-22T08:36:42.210 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.208+0000 7fc191b28640 1 -- 172.21.15.142:0/3348359638 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc1840589d0 con 0x55ee840cc1d0 2024-09-22T08:36:42.211 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.208+0000 7fc195040800 1 -- 172.21.15.142:0/3348359638 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ee840cc1d0 msgr2=0x55ee840ce5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:42.211 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.208+0000 7fc195040800 1 --2- 172.21.15.142:0/3348359638 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ee840cc1d0 0x55ee840ce5c0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fc184005fd0 tx=0x7fc184045c30 comp rx=0 tx=0).stop 2024-09-22T08:36:42.211 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.208+0000 7fc195040800 1 -- 172.21.15.142:0/3348359638 shutdown_connections 2024-09-22T08:36:42.211 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.208+0000 7fc195040800 1 --2- 172.21.15.142:0/3348359638 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ee840cc1d0 0x55ee840ce5c0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:42.211 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.208+0000 7fc195040800 1 -- 172.21.15.142:0/3348359638 >> 172.21.15.142:0/3348359638 conn(0x55ee840c5d10 msgr2=0x55ee840c8150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:42.211 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.208+0000 7fc195040800 1 -- 172.21.15.142:0/3348359638 shutdown_connections 2024-09-22T08:36:42.211 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.208+0000 7fc195040800 1 -- 172.21.15.142:0/3348359638 wait complete. 2024-09-22T08:36:42.224 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.222+0000 7fc195040800 1 Processor -- start 2024-09-22T08:36:42.224 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.222+0000 7fc195040800 1 -- start start 2024-09-22T08:36:42.224 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.222+0000 7fc195040800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ee840cc1d0 0x55ee841baf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:42.225 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.222+0000 7fc195040800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55ee83f63dd0 con 0x55ee840cc1d0 2024-09-22T08:36:42.225 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.222+0000 7fc192b2a640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ee840cc1d0 0x55ee841baf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:42.225 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.222+0000 7fc192b2a640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ee840cc1d0 0x55ee841baf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:37670/0 (socket says 172.21.15.142:37670) 2024-09-22T08:36:42.225 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.222+0000 7fc192b2a640 1 -- 172.21.15.142:0/1111022809 learned_addr learned my addr 172.21.15.142:0/1111022809 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:42.225 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.222+0000 7fc192b2a640 1 -- 172.21.15.142:0/1111022809 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee841bb4f0 con 0x55ee840cc1d0 2024-09-22T08:36:42.226 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.223+0000 7fc192b2a640 1 --2- 172.21.15.142:0/1111022809 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ee840cc1d0 0x55ee841baf00 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fc184025a60 tx=0x7fc184051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66df4cf680f01485 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:42.226 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.223+0000 7fc080e09640 1 -- 172.21.15.142:0/1111022809 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc184058a30 con 0x55ee840cc1d0 2024-09-22T08:36:42.226 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.223+0000 7fc080e09640 1 -- 172.21.15.142:0/1111022809 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc184068070 con 0x55ee840cc1d0 2024-09-22T08:36:42.227 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.223+0000 7fc080e09640 1 -- 172.21.15.142:0/1111022809 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc184058d00 con 0x55ee840cc1d0 2024-09-22T08:36:42.227 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.224+0000 7fc195040800 1 -- 172.21.15.142:0/1111022809 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ee840cc1d0 msgr2=0x55ee841baf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:42.227 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.224+0000 7fc195040800 1 --2- 172.21.15.142:0/1111022809 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ee840cc1d0 0x55ee841baf00 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fc184025a60 tx=0x7fc184051000 comp rx=0 tx=0).stop 2024-09-22T08:36:42.227 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.224+0000 7fc195040800 1 -- 172.21.15.142:0/1111022809 shutdown_connections 2024-09-22T08:36:42.227 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.224+0000 7fc195040800 1 --2- 172.21.15.142:0/1111022809 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ee840cc1d0 0x55ee841baf00 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:42.227 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.224+0000 7fc195040800 1 -- 172.21.15.142:0/1111022809 >> 172.21.15.142:0/1111022809 conn(0x55ee840c5d10 msgr2=0x55ee841b6880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:42.227 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.224+0000 7fc195040800 1 -- 172.21.15.142:0/1111022809 shutdown_connections 2024-09-22T08:36:42.227 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.224+0000 7fc195040800 1 -- 172.21.15.142:0/1111022809 wait complete. 2024-09-22T08:36:42.227 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.224+0000 7fc195040800 1 Processor -- start 2024-09-22T08:36:42.227 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.224+0000 7fc195040800 1 -- start start 2024-09-22T08:36:42.227 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.224+0000 7fc195040800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ee840cc1d0 0x55ee840cb8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:42.227 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.224+0000 7fc195040800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55ee840d29a0 con 0x55ee840cc1d0 2024-09-22T08:36:42.234 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.225+0000 7fc192b2a640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ee840cc1d0 0x55ee840cb8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:42.234 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.225+0000 7fc192b2a640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ee840cc1d0 0x55ee840cb8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:37678/0 (socket says 172.21.15.142:37678) 2024-09-22T08:36:42.234 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.225+0000 7fc192b2a640 1 -- 172.21.15.142:0/3452940480 learned_addr learned my addr 172.21.15.142:0/3452940480 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:42.234 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.225+0000 7fc192b2a640 1 -- 172.21.15.142:0/3452940480 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee840cbe50 con 0x55ee840cc1d0 2024-09-22T08:36:42.234 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.225+0000 7fc192b2a640 1 --2- 172.21.15.142:0/3452940480 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ee840cc1d0 0x55ee840cb8f0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fc184025a60 tx=0x7fc184003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:42.234 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.225+0000 7fc07f606640 1 -- 172.21.15.142:0/3452940480 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc184063650 con 0x55ee840cc1d0 2024-09-22T08:36:42.234 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.225+0000 7fc07f606640 1 -- 172.21.15.142:0/3452940480 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1840637f0 con 0x55ee840cc1d0 2024-09-22T08:36:42.234 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.225+0000 7fc195040800 1 -- 172.21.15.142:0/3452940480 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ee840ca200 con 0x55ee840cc1d0 2024-09-22T08:36:42.234 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.225+0000 7fc07f606640 1 -- 172.21.15.142:0/3452940480 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc184063b10 con 0x55ee840cc1d0 2024-09-22T08:36:42.234 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.225+0000 7fc195040800 1 -- 172.21.15.142:0/3452940480 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ee840ca7c0 con 0x55ee840cc1d0 2024-09-22T08:36:42.235 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.226+0000 7fc195040800 1 Processor -- start 2024-09-22T08:36:42.235 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.226+0000 7fc195040800 1 -- start start 2024-09-22T08:36:42.235 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.226+0000 7fc195040800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ee841d2090 0x55ee841d4480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:42.235 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.226+0000 7fc195040800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55ee83fc2d50 con 0x55ee841d2090 2024-09-22T08:36:42.235 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.226+0000 7fc07f606640 1 -- 172.21.15.142:0/3452940480 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fc184075020 con 0x55ee840cc1d0 2024-09-22T08:36:42.235 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.226+0000 7fc19332b640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ee841d2090 0x55ee841d4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:42.235 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.226+0000 7fc07f606640 1 --2- 172.21.15.142:0/3452940480 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fc07803cfb0 0x7fc07803f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:42.235 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.226+0000 7fc19332b640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ee841d2090 0x55ee841d4480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:37690/0 (socket says 172.21.15.142:37690) 2024-09-22T08:36:42.235 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.226+0000 7fc19332b640 1 -- 172.21.15.142:0/4006839655 learned_addr learned my addr 172.21.15.142:0/4006839655 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:42.235 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.227+0000 7fc07f606640 1 -- 172.21.15.142:0/3452940480 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fc184098860 con 0x55ee840cc1d0 2024-09-22T08:36:42.235 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.227+0000 7fc192b2a640 1 --2- 172.21.15.142:0/3452940480 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fc07803cfb0 0x7fc07803f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:42.235 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.227+0000 7fc19332b640 1 -- 172.21.15.142:0/4006839655 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee841d4a50 con 0x55ee841d2090 2024-09-22T08:36:42.235 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.227+0000 7fc192b2a640 1 --2- 172.21.15.142:0/3452940480 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fc07803cfb0 0x7fc07803f470 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fc1840460b0 tx=0x7fc184077f10 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:42.236 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.227+0000 7fc19332b640 1 --2- 172.21.15.142:0/4006839655 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ee841d2090 0x55ee841d4480 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fc18c00a430 tx=0x7fc18c00a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7175b99e0a4181b server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:42.236 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.227+0000 7fc07d602640 1 -- 172.21.15.142:0/4006839655 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc18c008840 con 0x55ee841d2090 2024-09-22T08:36:42.236 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.227+0000 7fc07d602640 1 -- 172.21.15.142:0/4006839655 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc18c008a00 con 0x55ee841d2090 2024-09-22T08:36:42.236 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.227+0000 7fc07d602640 1 -- 172.21.15.142:0/4006839655 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc18c008d20 con 0x55ee841d2090 2024-09-22T08:36:42.236 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.228+0000 7fc195040800 1 -- 172.21.15.142:0/4006839655 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ee841d2090 msgr2=0x55ee841d4480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:42.236 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.228+0000 7fc195040800 1 --2- 172.21.15.142:0/4006839655 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ee841d2090 0x55ee841d4480 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fc18c00a430 tx=0x7fc18c00a8f0 comp rx=0 tx=0).stop 2024-09-22T08:36:42.236 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.228+0000 7fc195040800 1 -- 172.21.15.142:0/4006839655 shutdown_connections 2024-09-22T08:36:42.236 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.228+0000 7fc195040800 1 --2- 172.21.15.142:0/4006839655 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ee841d2090 0x55ee841d4480 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:42.236 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.228+0000 7fc195040800 1 -- 172.21.15.142:0/4006839655 >> 172.21.15.142:0/4006839655 conn(0x55ee840ceb00 msgr2=0x55ee841cc9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:42.236 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.228+0000 7fc195040800 1 -- 172.21.15.142:0/4006839655 shutdown_connections 2024-09-22T08:36:42.236 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.228+0000 7fc195040800 1 -- 172.21.15.142:0/4006839655 wait complete. 2024-09-22T08:36:42.236 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.228+0000 7fc195040800 1 Processor -- start 2024-09-22T08:36:42.236 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.228+0000 7fc195040800 1 -- start start 2024-09-22T08:36:42.236 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.228+0000 7fc195040800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ee841d2090 0x55ee841d8ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:42.237 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.228+0000 7fc195040800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55ee841d4d40 con 0x55ee841d2090 2024-09-22T08:36:42.237 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.228+0000 7fc19332b640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ee841d2090 0x55ee841d8ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:42.237 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.228+0000 7fc19332b640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ee841d2090 0x55ee841d8ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:37706/0 (socket says 172.21.15.142:37706) 2024-09-22T08:36:42.237 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.228+0000 7fc19332b640 1 -- 172.21.15.142:0/1905762034 learned_addr learned my addr 172.21.15.142:0/1905762034 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:42.237 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.229+0000 7fc19332b640 1 -- 172.21.15.142:0/1905762034 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee841d9440 con 0x55ee841d2090 2024-09-22T08:36:42.237 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.229+0000 7fc19332b640 1 --2- 172.21.15.142:0/1905762034 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ee841d2090 0x55ee841d8ee0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x55ee841cd390 tx=0x7fc18c002ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:42.237 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.229+0000 7fc0777fe640 1 -- 172.21.15.142:0/1905762034 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc18c022030 con 0x55ee841d2090 2024-09-22T08:36:42.237 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.229+0000 7fc0777fe640 1 -- 172.21.15.142:0/1905762034 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc18c019040 con 0x55ee841d2090 2024-09-22T08:36:42.237 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.229+0000 7fc195040800 1 -- 172.21.15.142:0/1905762034 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ee841d96d0 con 0x55ee841d2090 2024-09-22T08:36:42.237 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.229+0000 7fc0777fe640 1 -- 172.21.15.142:0/1905762034 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc18c013930 con 0x55ee841d2090 2024-09-22T08:36:42.237 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.229+0000 7fc195040800 1 -- 172.21.15.142:0/1905762034 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ee841da050 con 0x55ee841d2090 2024-09-22T08:36:42.237 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.230+0000 7fc0777fe640 1 -- 172.21.15.142:0/1905762034 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fc18c025070 con 0x55ee841d2090 2024-09-22T08:36:42.237 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.230+0000 7fc0777fe640 1 --2- 172.21.15.142:0/1905762034 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fc06c03d000 0x7fc06c03f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:42.238 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.230+0000 7fc195040800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:36:42.238 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.230+0000 7fc195040800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:36:42.238 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.230+0000 7fc0777fe640 1 -- 172.21.15.142:0/1905762034 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fc18c023070 con 0x55ee841d2090 2024-09-22T08:36:42.238 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.230+0000 7fc192329640 1 --2- 172.21.15.142:0/1905762034 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fc06c03d000 0x7fc06c03f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:42.238 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.230+0000 7fc195040800 1 Processor -- start 2024-09-22T08:36:42.238 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.231+0000 7fc195040800 1 -- start start 2024-09-22T08:36:42.238 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.231+0000 7fc192329640 1 --2- 172.21.15.142:0/1905762034 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fc06c03d000 0x7fc06c03f4c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc17c000c00 tx=0x7fc17c001330 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:42.238 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.231+0000 7fc195040800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ee841f2ce0 0x55ee841f3100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:42.238 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.231+0000 7fc195040800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55ee841bb860 con 0x55ee841f2ce0 2024-09-22T08:36:42.238 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.231+0000 7fc192b2a640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ee841f2ce0 0x55ee841f3100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:42.238 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.231+0000 7fc192b2a640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ee841f2ce0 0x55ee841f3100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:37716/0 (socket says 172.21.15.142:37716) 2024-09-22T08:36:42.238 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.231+0000 7fc192b2a640 1 -- 172.21.15.142:0/989594626 learned_addr learned my addr 172.21.15.142:0/989594626 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:42.238 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.231+0000 7fc192b2a640 1 -- 172.21.15.142:0/989594626 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee841f3740 con 0x55ee841f2ce0 2024-09-22T08:36:42.239 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.231+0000 7fc192b2a640 1 --2- 172.21.15.142:0/989594626 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ee841f2ce0 0x55ee841f3100 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fc184096db0 tx=0x7fc184098480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:42.239 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.232+0000 7fc0577e6640 1 -- 172.21.15.142:0/989594626 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc184077ab0 con 0x55ee841f2ce0 2024-09-22T08:36:42.239 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.232+0000 7fc0577e6640 1 -- 172.21.15.142:0/989594626 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc18404fb80 con 0x55ee841f2ce0 2024-09-22T08:36:42.239 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.232+0000 7fc195040800 1 -- 172.21.15.142:0/989594626 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ee841f3f70 con 0x55ee841f2ce0 2024-09-22T08:36:42.239 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.232+0000 7fc0577e6640 1 -- 172.21.15.142:0/989594626 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc184080840 con 0x55ee841f2ce0 2024-09-22T08:36:42.239 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.232+0000 7fc195040800 1 -- 172.21.15.142:0/989594626 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ee841f4510 con 0x55ee841f2ce0 2024-09-22T08:36:42.243 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.232+0000 7fc0577e6640 1 -- 172.21.15.142:0/989594626 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fc18406c390 con 0x55ee841f2ce0 2024-09-22T08:36:42.243 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.233+0000 7fc0577e6640 1 --2- 172.21.15.142:0/989594626 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fbfd403cfb0 0x7fbfd403f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:42.243 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.233+0000 7fc0577e6640 1 -- 172.21.15.142:0/989594626 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fc184091070 con 0x55ee841f2ce0 2024-09-22T08:36:42.243 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.233+0000 7fc192329640 1 --2- 172.21.15.142:0/989594626 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fbfd403cfb0 0x7fbfd403f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:42.243 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.233+0000 7fc0557e2640 20 reqs_thread_entry: start 2024-09-22T08:36:42.243 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.233+0000 7fc192329640 1 --2- 172.21.15.142:0/989594626 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fbfd403cfb0 0x7fbfd403f470 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc17c000f60 tx=0x7fc17c006000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:42.243 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.233+0000 7fc195040800 1 --2- 172.21.15.142:0/3452940480 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55ee84200650 0x55ee84202ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:42.243 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.233+0000 7fc195040800 1 -- 172.21.15.142:0/3452940480 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ee842031b0 con 0x55ee84200650 2024-09-22T08:36:42.243 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.233+0000 7fc19332b640 1 --2- 172.21.15.142:0/3452940480 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55ee84200650 0x55ee84202ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:42.243 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.233+0000 7fc19332b640 1 --2- 172.21.15.142:0/3452940480 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55ee84200650 0x55ee84202ae0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:42.243 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.234+0000 7fc19332b640 1 -- 172.21.15.142:0/3452940480 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc18c013cb0 con 0x55ee84200650 2024-09-22T08:36:42.243 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.234+0000 7fc195040800 1 --2- 172.21.15.142:0/3452940480 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55ee84204f80 0x55ee84207370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:42.243 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.234+0000 7fc195040800 1 -- 172.21.15.142:0/3452940480 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:2 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ee84207a60 con 0x55ee84204f80 2024-09-22T08:36:42.244 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.234+0000 7fc192b2a640 1 --2- 172.21.15.142:0/3452940480 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55ee84204f80 0x55ee84207370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:42.244 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.234+0000 7fc192b2a640 1 --2- 172.21.15.142:0/3452940480 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55ee84204f80 0x55ee84207370 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:42.244 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.234+0000 7fc192b2a640 1 -- 172.21.15.142:0/3452940480 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(2 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fc18409e020 con 0x55ee84204f80 2024-09-22T08:36:42.244 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.234+0000 7fc195040800 1 -- 172.21.15.142:0/3452940480 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:3 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [stat,call version.check_conds in=122b,call version.inc in=38b,writefull 0~993 in=993b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ee842045e0 con 0x55ee84204f80 2024-09-22T08:36:42.244 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.236+0000 7fc192b2a640 1 -- 172.21.15.142:0/3452940480 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(3 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [stat,call,call,writefull 0~993] v30'2 uv2 ondisk = 0) ==== 316+0+0 (crc 0 0 0) 0x7fc18409e020 con 0x55ee84204f80 2024-09-22T08:36:42.244 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.236+0000 7fc195040800 1 -- 172.21.15.142:0/1905762034 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fc06c03d000 msgr2=0x7fc06c03f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:42.244 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.236+0000 7fc195040800 1 --2- 172.21.15.142:0/1905762034 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fc06c03d000 0x7fc06c03f4c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc17c000c00 tx=0x7fc17c001330 comp rx=0 tx=0).stop 2024-09-22T08:36:42.244 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.236+0000 7fc195040800 1 -- 172.21.15.142:0/1905762034 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ee841d2090 msgr2=0x55ee841d8ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:42.244 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.236+0000 7fc195040800 1 --2- 172.21.15.142:0/1905762034 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ee841d2090 0x55ee841d8ee0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x55ee841cd390 tx=0x7fc18c002ff0 comp rx=0 tx=0).stop 2024-09-22T08:36:42.244 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.236+0000 7fc195040800 1 -- 172.21.15.142:0/1905762034 shutdown_connections 2024-09-22T08:36:42.244 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.236+0000 7fc195040800 1 --2- 172.21.15.142:0/1905762034 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fc06c03d000 0x7fc06c03f4c0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:42.244 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.236+0000 7fc195040800 1 --2- 172.21.15.142:0/1905762034 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ee841d2090 0x55ee841d8ee0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:42.244 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.236+0000 7fc195040800 1 -- 172.21.15.142:0/1905762034 >> 172.21.15.142:0/1905762034 conn(0x55ee840ceb00 msgr2=0x55ee841cc980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:42.244 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.236+0000 7fc195040800 1 -- 172.21.15.142:0/1905762034 shutdown_connections 2024-09-22T08:36:42.245 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.236+0000 7fc195040800 1 -- 172.21.15.142:0/1905762034 wait complete. 2024-09-22T08:36:42.245 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.237+0000 7fc195040800 1 -- 172.21.15.142:0/989594626 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fbfd403cfb0 msgr2=0x7fbfd403f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:42.245 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.237+0000 7fc195040800 1 --2- 172.21.15.142:0/989594626 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fbfd403cfb0 0x7fbfd403f470 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc17c000f60 tx=0x7fc17c006000 comp rx=0 tx=0).stop 2024-09-22T08:36:42.245 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.237+0000 7fc195040800 1 -- 172.21.15.142:0/989594626 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ee841f2ce0 msgr2=0x55ee841f3100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:42.245 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.237+0000 7fc195040800 1 --2- 172.21.15.142:0/989594626 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ee841f2ce0 0x55ee841f3100 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fc184096db0 tx=0x7fc184098480 comp rx=0 tx=0).stop 2024-09-22T08:36:42.245 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.237+0000 7fc195040800 1 -- 172.21.15.142:0/989594626 shutdown_connections 2024-09-22T08:36:42.245 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.237+0000 7fc195040800 1 --2- 172.21.15.142:0/989594626 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fbfd403cfb0 0x7fbfd403f470 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:42.245 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.237+0000 7fc195040800 1 --2- 172.21.15.142:0/989594626 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ee841f2ce0 0x55ee841f3100 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:42.245 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.237+0000 7fc195040800 1 -- 172.21.15.142:0/989594626 >> 172.21.15.142:0/989594626 conn(0x55ee841e82a0 msgr2=0x55ee841e8680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:42.245 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.237+0000 7fc195040800 1 -- 172.21.15.142:0/989594626 shutdown_connections 2024-09-22T08:36:42.245 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.237+0000 7fc195040800 1 -- 172.21.15.142:0/989594626 wait complete. 2024-09-22T08:36:42.245 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.237+0000 7fc195040800 1 -- 172.21.15.142:0/3452940480 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55ee84200650 msgr2=0x55ee84202ae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:42.245 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.237+0000 7fc195040800 1 --2- 172.21.15.142:0/3452940480 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55ee84200650 0x55ee84202ae0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:42.245 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.237+0000 7fc195040800 1 -- 172.21.15.142:0/3452940480 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55ee84204f80 msgr2=0x55ee84207370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:42.245 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.237+0000 7fc195040800 1 --2- 172.21.15.142:0/3452940480 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55ee84204f80 0x55ee84207370 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:42.246 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.237+0000 7fc195040800 1 -- 172.21.15.142:0/3452940480 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fc07803cfb0 msgr2=0x7fc07803f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:42.246 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.237+0000 7fc195040800 1 --2- 172.21.15.142:0/3452940480 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fc07803cfb0 0x7fc07803f470 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fc1840460b0 tx=0x7fc184077f10 comp rx=0 tx=0).stop 2024-09-22T08:36:42.246 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.237+0000 7fc195040800 1 -- 172.21.15.142:0/3452940480 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ee840cc1d0 msgr2=0x55ee840cb8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:42.246 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.237+0000 7fc195040800 1 --2- 172.21.15.142:0/3452940480 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ee840cc1d0 0x55ee840cb8f0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fc184025a60 tx=0x7fc184003330 comp rx=0 tx=0).stop 2024-09-22T08:36:42.246 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.237+0000 7fc195040800 1 -- 172.21.15.142:0/3452940480 shutdown_connections 2024-09-22T08:36:42.246 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.237+0000 7fc195040800 1 --2- 172.21.15.142:0/3452940480 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55ee84204f80 0x55ee84207370 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:42.246 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.237+0000 7fc195040800 1 --2- 172.21.15.142:0/3452940480 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55ee84200650 0x55ee84202ae0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:42.246 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.237+0000 7fc195040800 1 --2- 172.21.15.142:0/3452940480 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fc07803cfb0 0x7fc07803f470 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:42.246 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.237+0000 7fc195040800 1 --2- 172.21.15.142:0/3452940480 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ee840cc1d0 0x55ee840cb8f0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:42.246 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.237+0000 7fc195040800 1 -- 172.21.15.142:0/3452940480 >> 172.21.15.142:0/3452940480 conn(0x55ee840c5d10 msgr2=0x55ee841bc2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:42.246 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.237+0000 7fc195040800 1 -- 172.21.15.142:0/3452940480 shutdown_connections 2024-09-22T08:36:42.246 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.237+0000 7fc195040800 1 -- 172.21.15.142:0/3452940480 wait complete. 2024-09-22T08:36:42.248 INFO:teuthology.orchestra.run.smithi142.stdout:{"id":"e239248c-0bee-4e41-803a-24b288d3eb8f","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-09-22T08:36:42.248 DEBUG:tasks.util.rgw: json result: {'id': 'e239248c-0bee-4e41-803a-24b288d3eb8f', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-09-22T08:36:42.249 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show'] 2024-09-22T08:36:42.249 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show'] 2024-09-22T08:36:42.250 DEBUG:teuthology.orchestra.run.smithi142:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show 2024-09-22T08:36:42.292 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:36:42.292 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:36:42.293 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.290+0000 7f29ecc94800 1 Processor -- start 2024-09-22T08:36:42.293 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.290+0000 7f29ecc94800 1 -- start start 2024-09-22T08:36:42.293 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.291+0000 7f29ecc94800 1 --2- >> v2:172.21.15.31:3300/0 conn(0x560c8a97dd90 0x560c8a980180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:42.293 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.291+0000 7f29ecc94800 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x560c8a809a20 con 0x560c8a9806f0 2024-09-22T08:36:42.294 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.291+0000 7f29ecc94800 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x560c8a8097d0 con 0x560c8a97dd90 2024-09-22T08:36:42.294 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.291+0000 7f29ea77e640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x560c8a97dd90 0x560c8a980180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:42.294 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.291+0000 7f29e1f7d640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x560c8a9806f0 0x560c8a982bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.142:42278/0 (socket says 172.21.15.142:42278) 2024-09-22T08:36:42.294 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.291+0000 7f29e1f7d640 1 -- 172.21.15.142:0/3211967847 learned_addr learned my addr 172.21.15.142:0/3211967847 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-09-22T08:36:42.294 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.291+0000 7f29ea77e640 1 -- 172.21.15.142:0/3211967847 >> v1:172.21.15.31:6789/0 conn(0x560c8a9806f0 legacy=0x560c8a982bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:42.294 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.291+0000 7f29ea77e640 1 -- 172.21.15.142:0/3211967847 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c8a9854a0 con 0x560c8a97dd90 2024-09-22T08:36:42.295 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.293+0000 7f29ea77e640 1 --2- 172.21.15.142:0/3211967847 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560c8a97dd90 0x560c8a980180 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f29dc00a470 tx=0x7f29dc045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff3f7d8d459d8b5c server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:42.295 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.293+0000 7f29e9f7d640 1 -- 172.21.15.142:0/3211967847 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f29dc053570 con 0x560c8a97dd90 2024-09-22T08:36:42.295 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.293+0000 7f29e9f7d640 1 -- 172.21.15.142:0/3211967847 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29dc058070 con 0x560c8a97dd90 2024-09-22T08:36:42.295 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.293+0000 7f29e9f7d640 1 -- 172.21.15.142:0/3211967847 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f29dc053880 con 0x560c8a97dd90 2024-09-22T08:36:42.296 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.294+0000 7f29ecc94800 1 -- 172.21.15.142:0/3211967847 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560c8a97dd90 msgr2=0x560c8a980180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:42.296 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.294+0000 7f29ecc94800 1 --2- 172.21.15.142:0/3211967847 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560c8a97dd90 0x560c8a980180 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f29dc00a470 tx=0x7f29dc045a20 comp rx=0 tx=0).stop 2024-09-22T08:36:42.296 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.294+0000 7f29ecc94800 1 -- 172.21.15.142:0/3211967847 shutdown_connections 2024-09-22T08:36:42.297 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.294+0000 7f29ecc94800 1 --2- 172.21.15.142:0/3211967847 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560c8a97dd90 0x560c8a980180 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:42.297 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.294+0000 7f29ecc94800 1 -- 172.21.15.142:0/3211967847 >> 172.21.15.142:0/3211967847 conn(0x560c8a978300 msgr2=0x560c8a97a780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:42.297 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.294+0000 7f29ecc94800 1 -- 172.21.15.142:0/3211967847 shutdown_connections 2024-09-22T08:36:42.297 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.294+0000 7f29ecc94800 1 -- 172.21.15.142:0/3211967847 wait complete. 2024-09-22T08:36:42.310 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.307+0000 7f29ecc94800 1 Processor -- start 2024-09-22T08:36:42.310 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.307+0000 7f29ecc94800 1 -- start start 2024-09-22T08:36:42.310 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.307+0000 7f29ecc94800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560c8a97dd90 0x560c8aa6cf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:42.311 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.307+0000 7f29ecc94800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x560c8a816dd0 con 0x560c8a97dd90 2024-09-22T08:36:42.311 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.308+0000 7f29ea77e640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560c8a97dd90 0x560c8aa6cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:42.311 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.308+0000 7f29ea77e640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560c8a97dd90 0x560c8aa6cf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:37734/0 (socket says 172.21.15.142:37734) 2024-09-22T08:36:42.311 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.308+0000 7f29ea77e640 1 -- 172.21.15.142:0/1815178428 learned_addr learned my addr 172.21.15.142:0/1815178428 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:42.311 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.308+0000 7f29ea77e640 1 -- 172.21.15.142:0/1815178428 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c8aa6d530 con 0x560c8a97dd90 2024-09-22T08:36:42.311 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.308+0000 7f29ea77e640 1 --2- 172.21.15.142:0/1815178428 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560c8a97dd90 0x560c8aa6cf40 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f29dc025c20 tx=0x7f29dc051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=202f26bcee744c4c server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:42.311 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.308+0000 7f28d8608640 1 -- 172.21.15.142:0/1815178428 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f29dc053a20 con 0x560c8a97dd90 2024-09-22T08:36:42.311 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.308+0000 7f28d8608640 1 -- 172.21.15.142:0/1815178428 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29dc063070 con 0x560c8a97dd90 2024-09-22T08:36:42.311 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.308+0000 7f28d8608640 1 -- 172.21.15.142:0/1815178428 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f29dc053cf0 con 0x560c8a97dd90 2024-09-22T08:36:42.315 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.309+0000 7f29ecc94800 1 -- 172.21.15.142:0/1815178428 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560c8a97dd90 msgr2=0x560c8aa6cf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:42.315 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.309+0000 7f29ecc94800 1 --2- 172.21.15.142:0/1815178428 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560c8a97dd90 0x560c8aa6cf40 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f29dc025c20 tx=0x7f29dc051000 comp rx=0 tx=0).stop 2024-09-22T08:36:42.315 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.309+0000 7f29ecc94800 1 -- 172.21.15.142:0/1815178428 shutdown_connections 2024-09-22T08:36:42.315 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.309+0000 7f29ecc94800 1 --2- 172.21.15.142:0/1815178428 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560c8a97dd90 0x560c8aa6cf40 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:42.316 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.309+0000 7f29ecc94800 1 -- 172.21.15.142:0/1815178428 >> 172.21.15.142:0/1815178428 conn(0x560c8a978300 msgr2=0x560c8aa688c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:42.316 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.309+0000 7f29ecc94800 1 -- 172.21.15.142:0/1815178428 shutdown_connections 2024-09-22T08:36:42.316 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.309+0000 7f29ecc94800 1 -- 172.21.15.142:0/1815178428 wait complete. 2024-09-22T08:36:42.316 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.309+0000 7f29ecc94800 1 Processor -- start 2024-09-22T08:36:42.316 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.309+0000 7f29ecc94800 1 -- start start 2024-09-22T08:36:42.316 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.310+0000 7f29ecc94800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560c8a97dd90 0x560c8a97cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:42.316 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.310+0000 7f29ecc94800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x560c8a984740 con 0x560c8a97dd90 2024-09-22T08:36:42.316 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.310+0000 7f29ea77e640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560c8a97dd90 0x560c8a97cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:42.316 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.310+0000 7f29ea77e640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560c8a97dd90 0x560c8a97cfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:37740/0 (socket says 172.21.15.142:37740) 2024-09-22T08:36:42.316 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.310+0000 7f29ea77e640 1 -- 172.21.15.142:0/3572549414 learned_addr learned my addr 172.21.15.142:0/3572549414 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:42.316 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.310+0000 7f29ea77e640 1 -- 172.21.15.142:0/3572549414 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c8a97d510 con 0x560c8a97dd90 2024-09-22T08:36:42.316 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.310+0000 7f29ea77e640 1 --2- 172.21.15.142:0/3572549414 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560c8a97dd90 0x560c8a97cfb0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f29dc025c20 tx=0x7f29dc002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:42.317 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.310+0000 7f28d6e05640 1 -- 172.21.15.142:0/3572549414 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f29dc06c030 con 0x560c8a97dd90 2024-09-22T08:36:42.317 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.310+0000 7f28d6e05640 1 -- 172.21.15.142:0/3572549414 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29dc068660 con 0x560c8a97dd90 2024-09-22T08:36:42.317 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.310+0000 7f29ecc94800 1 -- 172.21.15.142:0/3572549414 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560c8aa786a0 con 0x560c8a97dd90 2024-09-22T08:36:42.317 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.310+0000 7f28d6e05640 1 -- 172.21.15.142:0/3572549414 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f29dc068940 con 0x560c8a97dd90 2024-09-22T08:36:42.317 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.311+0000 7f29ecc94800 1 -- 172.21.15.142:0/3572549414 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560c8aa78c60 con 0x560c8a97dd90 2024-09-22T08:36:42.317 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.311+0000 7f28d6e05640 1 -- 172.21.15.142:0/3572549414 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f29dc068ae0 con 0x560c8a97dd90 2024-09-22T08:36:42.317 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.311+0000 7f28d6e05640 1 --2- 172.21.15.142:0/3572549414 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f28d003d000 0x7f28d003f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:42.317 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.311+0000 7f28d6e05640 1 -- 172.21.15.142:0/3572549414 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f29dc098950 con 0x560c8a97dd90 2024-09-22T08:36:42.317 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.312+0000 7f29e1f7d640 1 --2- 172.21.15.142:0/3572549414 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f28d003d000 0x7f28d003f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:42.317 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.312+0000 7f29ecc94800 1 --2- 172.21.15.142:0/3572549414 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x560c8a9806f0 0x560c8aa7cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:42.317 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.312+0000 7f29ecc94800 1 -- 172.21.15.142:0/3572549414 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560c8aa7d240 con 0x560c8a9806f0 2024-09-22T08:36:42.317 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.312+0000 7f29eaf7f640 1 --2- 172.21.15.142:0/3572549414 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x560c8a9806f0 0x560c8aa7cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:42.317 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.312+0000 7f29e1f7d640 1 --2- 172.21.15.142:0/3572549414 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f28d003d000 0x7f28d003f4c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f29d4001d70 tx=0x7f29d40012d0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:42.318 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.312+0000 7f29eaf7f640 1 --2- 172.21.15.142:0/3572549414 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x560c8a9806f0 0x560c8aa7cbf0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:42.318 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.312+0000 7f29eaf7f640 1 -- 172.21.15.142:0/3572549414 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f29e400a4d0 con 0x560c8a9806f0 2024-09-22T08:36:42.318 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.312+0000 7f29ecc94800 1 -- 172.21.15.142:0/3572549414 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560c8aa7a0a0 con 0x560c8a9806f0 2024-09-22T08:36:42.318 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.313+0000 7f29eaf7f640 1 -- 172.21.15.142:0/3572549414 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f29e400a4d0 con 0x560c8a9806f0 2024-09-22T08:36:42.318 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.313+0000 7f29ecc94800 1 --2- 172.21.15.142:0/3572549414 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x560c8aa7f570 0x560c8aa81960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:42.318 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.313+0000 7f29ecc94800 1 -- 172.21.15.142:0/3572549414 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:3 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560c8aa82050 con 0x560c8aa7f570 2024-09-22T08:36:42.318 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.313+0000 7f29ea77e640 1 --2- 172.21.15.142:0/3572549414 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x560c8aa7f570 0x560c8aa81960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:42.318 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.313+0000 7f29ea77e640 1 --2- 172.21.15.142:0/3572549414 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x560c8aa7f570 0x560c8aa81960 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:42.318 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.313+0000 7f29ea77e640 1 -- 172.21.15.142:0/3572549414 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(3 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f29dc051070 con 0x560c8aa7f570 2024-09-22T08:36:42.318 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.313+0000 7f29ecc94800 1 -- 172.21.15.142:0/3572549414 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560c8aa7e3e0 con 0x560c8a9806f0 2024-09-22T08:36:42.330 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.314+0000 7f29eaf7f640 1 -- 172.21.15.142:0/3572549414 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f29e400a4d0 con 0x560c8a9806f0 2024-09-22T08:36:42.330 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.314+0000 7f29ecc94800 1 -- 172.21.15.142:0/3572549414 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560c8aa7e8c0 con 0x560c8aa7f570 2024-09-22T08:36:42.330 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.314+0000 7f29ea77e640 1 -- 172.21.15.142:0/3572549414 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(5 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f29dc051070 con 0x560c8aa7f570 2024-09-22T08:36:42.330 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.314+0000 7f29ecc94800 1 Processor -- start 2024-09-22T08:36:42.330 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.314+0000 7f29ecc94800 1 -- start start 2024-09-22T08:36:42.331 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.314+0000 7f29ecc94800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560c8aa909d0 0x560c8aa90df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:42.331 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.314+0000 7f29ecc94800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x560c8a875d50 con 0x560c8aa909d0 2024-09-22T08:36:42.331 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.315+0000 7f29eaf7f640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560c8aa909d0 0x560c8aa90df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:42.331 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.315+0000 7f29eaf7f640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560c8aa909d0 0x560c8aa90df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:37754/0 (socket says 172.21.15.142:37754) 2024-09-22T08:36:42.331 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.315+0000 7f29eaf7f640 1 -- 172.21.15.142:0/2100893077 learned_addr learned my addr 172.21.15.142:0/2100893077 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:42.331 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.315+0000 7f29eaf7f640 1 -- 172.21.15.142:0/2100893077 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c8aa91430 con 0x560c8aa909d0 2024-09-22T08:36:42.331 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.315+0000 7f29eaf7f640 1 --2- 172.21.15.142:0/2100893077 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560c8aa909d0 0x560c8aa90df0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x560c8a97ca30 tx=0x7f29e40167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:42.331 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.315+0000 7f28cffff640 1 -- 172.21.15.142:0/2100893077 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f29e4013640 con 0x560c8aa909d0 2024-09-22T08:36:42.331 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.315+0000 7f28cffff640 1 -- 172.21.15.142:0/2100893077 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29e40137e0 con 0x560c8aa909d0 2024-09-22T08:36:42.332 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.315+0000 7f29ecc94800 1 -- 172.21.15.142:0/2100893077 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560c8aa91c60 con 0x560c8aa909d0 2024-09-22T08:36:42.332 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.315+0000 7f28cffff640 1 -- 172.21.15.142:0/2100893077 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f29e4013b00 con 0x560c8aa909d0 2024-09-22T08:36:42.332 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.315+0000 7f29ecc94800 1 -- 172.21.15.142:0/2100893077 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560c8aa92200 con 0x560c8aa909d0 2024-09-22T08:36:42.332 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.316+0000 7f28cffff640 1 -- 172.21.15.142:0/2100893077 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f29e4011040 con 0x560c8aa909d0 2024-09-22T08:36:42.332 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.316+0000 7f28cffff640 1 --2- 172.21.15.142:0/2100893077 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f28c403d000 0x7f28c403f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:42.332 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.316+0000 7f28cffff640 1 -- 172.21.15.142:0/2100893077 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f29e400e040 con 0x560c8aa909d0 2024-09-22T08:36:42.332 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.316+0000 7f29ea77e640 1 --2- 172.21.15.142:0/2100893077 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f28c403d000 0x7f28c403f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:42.332 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.317+0000 7f29ecc94800 1 Processor -- start 2024-09-22T08:36:42.332 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.317+0000 7f29ecc94800 1 -- start start 2024-09-22T08:36:42.333 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.317+0000 7f29ea77e640 1 --2- 172.21.15.142:0/2100893077 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f28c403d000 0x7f28c403f4c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f29dc06c000 tx=0x7f29dc005390 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:42.333 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.317+0000 7f29ecc94800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560c8aa9d490 0x560c8aa9d890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:42.333 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.317+0000 7f29ecc94800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x560c8aa6d900 con 0x560c8aa9d490 2024-09-22T08:36:42.333 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.317+0000 7f29eaf7f640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560c8aa9d490 0x560c8aa9d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:42.333 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.317+0000 7f29eaf7f640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560c8aa9d490 0x560c8aa9d890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:37762/0 (socket says 172.21.15.142:37762) 2024-09-22T08:36:42.333 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.317+0000 7f29eaf7f640 1 -- 172.21.15.142:0/117386828 learned_addr learned my addr 172.21.15.142:0/117386828 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:42.333 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.318+0000 7f29eaf7f640 1 -- 172.21.15.142:0/117386828 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c8aa9de80 con 0x560c8aa9d490 2024-09-22T08:36:42.333 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.318+0000 7f29eaf7f640 1 --2- 172.21.15.142:0/117386828 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560c8aa9d490 0x560c8aa9d890 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f29e4012540 tx=0x7f29e4013dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddf9c2b278d71347 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:42.333 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.318+0000 7f28cdffb640 1 -- 172.21.15.142:0/117386828 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f29e402ac40 con 0x560c8aa9d490 2024-09-22T08:36:42.333 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.318+0000 7f28cdffb640 1 -- 172.21.15.142:0/117386828 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29e4051070 con 0x560c8aa9d490 2024-09-22T08:36:42.333 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.318+0000 7f28cdffb640 1 -- 172.21.15.142:0/117386828 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f29e4056070 con 0x560c8aa9d490 2024-09-22T08:36:42.333 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.318+0000 7f29ecc94800 1 -- 172.21.15.142:0/117386828 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560c8aa9d490 msgr2=0x560c8aa9d890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:42.334 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.318+0000 7f29ecc94800 1 --2- 172.21.15.142:0/117386828 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560c8aa9d490 0x560c8aa9d890 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f29e4012540 tx=0x7f29e4013dc0 comp rx=0 tx=0).stop 2024-09-22T08:36:42.334 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.318+0000 7f29ecc94800 1 -- 172.21.15.142:0/117386828 shutdown_connections 2024-09-22T08:36:42.334 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.318+0000 7f29ecc94800 1 --2- 172.21.15.142:0/117386828 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560c8aa9d490 0x560c8aa9d890 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:42.334 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.318+0000 7f29ecc94800 1 -- 172.21.15.142:0/117386828 >> 172.21.15.142:0/117386828 conn(0x560c8aa99890 msgr2=0x560c8aa97ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:42.334 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.318+0000 7f29ecc94800 1 -- 172.21.15.142:0/117386828 shutdown_connections 2024-09-22T08:36:42.334 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.318+0000 7f29ecc94800 1 -- 172.21.15.142:0/117386828 wait complete. 2024-09-22T08:36:42.334 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.319+0000 7f29ecc94800 1 Processor -- start 2024-09-22T08:36:42.334 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.319+0000 7f29ecc94800 1 -- start start 2024-09-22T08:36:42.335 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.319+0000 7f29ecc94800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560c8aa9d490 0x560c8aaa4a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:42.335 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.319+0000 7f29ecc94800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x560c8aa9e4a0 con 0x560c8aa9d490 2024-09-22T08:36:42.335 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.319+0000 7f29eaf7f640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560c8aa9d490 0x560c8aaa4a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:42.335 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.319+0000 7f29eaf7f640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560c8aa9d490 0x560c8aaa4a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:37778/0 (socket says 172.21.15.142:37778) 2024-09-22T08:36:42.335 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.319+0000 7f29eaf7f640 1 -- 172.21.15.142:0/2511533159 learned_addr learned my addr 172.21.15.142:0/2511533159 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:42.335 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.319+0000 7f29eaf7f640 1 -- 172.21.15.142:0/2511533159 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c8aaa4fd0 con 0x560c8aa9d490 2024-09-22T08:36:42.335 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.319+0000 7f29eaf7f640 1 --2- 172.21.15.142:0/2511533159 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560c8aa9d490 0x560c8aaa4a70 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f29e402afd0 tx=0x7f29e40548c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:42.335 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.320+0000 7f28bbfff640 1 -- 172.21.15.142:0/2511533159 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f29e4053310 con 0x560c8aa9d490 2024-09-22T08:36:42.335 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.320+0000 7f28bbfff640 1 -- 172.21.15.142:0/2511533159 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29e404c040 con 0x560c8aa9d490 2024-09-22T08:36:42.335 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.320+0000 7f29ecc94800 1 -- 172.21.15.142:0/2511533159 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560c8aaa5260 con 0x560c8aa9d490 2024-09-22T08:36:42.335 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.320+0000 7f28bbfff640 1 -- 172.21.15.142:0/2511533159 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f29e4020bd0 con 0x560c8aa9d490 2024-09-22T08:36:42.335 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.320+0000 7f29ecc94800 1 -- 172.21.15.142:0/2511533159 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560c8aaa5be0 con 0x560c8aa9d490 2024-09-22T08:36:42.335 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.321+0000 7f28bbfff640 1 -- 172.21.15.142:0/2511533159 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f29e4053020 con 0x560c8aa9d490 2024-09-22T08:36:42.335 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.321+0000 7f28bbfff640 1 --2- 172.21.15.142:0/2511533159 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f28b403d000 0x7f28b403f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:42.336 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.321+0000 7f28bbfff640 1 -- 172.21.15.142:0/2511533159 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f29e4042a00 con 0x560c8aa9d490 2024-09-22T08:36:42.336 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.321+0000 7f29ea77e640 1 --2- 172.21.15.142:0/2511533159 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f28b403d000 0x7f28b403f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:42.336 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.321+0000 7f29ecc94800 20 rados->read ofs=0 len=0 2024-09-22T08:36:42.336 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.321+0000 7f29ecc94800 1 --2- 172.21.15.142:0/2511533159 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x560c8aab0330 0x560c8aab27f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:42.336 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.321+0000 7f29ecc94800 1 -- 172.21.15.142:0/2511533159 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560c8aab2ef0 con 0x560c8aab0330 2024-09-22T08:36:42.336 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.321+0000 7f29e1f7d640 1 --2- 172.21.15.142:0/2511533159 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x560c8aab0330 0x560c8aab27f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:42.336 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.321+0000 7f29ea77e640 1 --2- 172.21.15.142:0/2511533159 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f28b403d000 0x7f28b403f4c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f29dc097150 tx=0x7f29dc088000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:42.336 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.321+0000 7f29e1f7d640 1 --2- 172.21.15.142:0/2511533159 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x560c8aab0330 0x560c8aab27f0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:42.336 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.322+0000 7f29e1f7d640 1 -- 172.21.15.142:0/2511533159 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f29d4009050 con 0x560c8aab0330 2024-09-22T08:36:42.336 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.322+0000 7f29ecc94800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:42.336 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.322+0000 7f29ecc94800 20 realm 2024-09-22T08:36:42.336 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.322+0000 7f29ecc94800 20 rados->read ofs=0 len=0 2024-09-22T08:36:42.336 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.322+0000 7f29ecc94800 1 -- 172.21.15.142:0/2511533159 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560c8aaaf6d0 con 0x560c8aab0330 2024-09-22T08:36:42.336 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.322+0000 7f29e1f7d640 1 -- 172.21.15.142:0/2511533159 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f29d4009050 con 0x560c8aab0330 2024-09-22T08:36:42.337 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.322+0000 7f29ecc94800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:42.337 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.322+0000 7f29ecc94800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:36:42.337 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.322+0000 7f29ecc94800 20 rados->read ofs=0 len=0 2024-09-22T08:36:42.337 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.322+0000 7f29ecc94800 1 -- 172.21.15.142:0/2511533159 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560c8aab39d0 con 0x560c8aab0330 2024-09-22T08:36:42.337 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.322+0000 7f29e1f7d640 1 -- 172.21.15.142:0/2511533159 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f29d4009050 con 0x560c8aab0330 2024-09-22T08:36:42.337 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.322+0000 7f29ecc94800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:42.337 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.322+0000 7f29ecc94800 20 rados->read ofs=0 len=0 2024-09-22T08:36:42.337 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.322+0000 7f29ecc94800 1 -- 172.21.15.142:0/2511533159 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560c8aab42a0 con 0x560c8aab0330 2024-09-22T08:36:42.337 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.322+0000 7f29e1f7d640 1 -- 172.21.15.142:0/2511533159 <== osd.1 v2:172.21.15.142:6816/3192108003 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f29d4009050 con 0x560c8aab0330 2024-09-22T08:36:42.337 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.322+0000 7f29ecc94800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:36:42.337 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.322+0000 7f29ecc94800 20 rados->read ofs=0 len=0 2024-09-22T08:36:42.337 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.322+0000 7f29ecc94800 1 --2- 172.21.15.142:0/2511533159 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x560c8aab4be0 0x560c8aab6fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:42.337 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.322+0000 7f29ecc94800 1 -- 172.21.15.142:0/2511533159 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560c8aab7710 con 0x560c8aab4be0 2024-09-22T08:36:42.337 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.323+0000 7f29eaf7f640 1 --2- 172.21.15.142:0/2511533159 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x560c8aab4be0 0x560c8aab6fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:42.338 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.323+0000 7f29eaf7f640 1 --2- 172.21.15.142:0/2511533159 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x560c8aab4be0 0x560c8aab6fd0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:42.338 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.323+0000 7f29eaf7f640 1 -- 172.21.15.142:0/2511533159 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(5 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f29e400a4d0 con 0x560c8aab4be0 2024-09-22T08:36:42.338 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.323+0000 7f29ecc94800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:36:42.338 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.323+0000 7f29ecc94800 20 searching for the correct realm 2024-09-22T08:36:42.338 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.323+0000 7f29ecc94800 1 -- 172.21.15.142:0/2511533159 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560c8aab90c0 con 0x560c8aab4be0 2024-09-22T08:36:42.338 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.323+0000 7f29eaf7f640 1 -- 172.21.15.142:0/2511533159 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29e400a4d0 con 0x560c8aab4be0 2024-09-22T08:36:42.338 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.323+0000 7f29eaf7f640 1 --2- 172.21.15.142:0/2511533159 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f29e4014590 0x7f29e403dab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:42.338 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.323+0000 7f29eaf7f640 1 -- 172.21.15.142:0/2511533159 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560c8aab90c0 con 0x7f29e4014590 2024-09-22T08:36:42.338 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.324+0000 7f29ea77e640 1 --2- 172.21.15.142:0/2511533159 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f29e4014590 0x7f29e403dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:42.338 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.324+0000 7f29ea77e640 1 --2- 172.21.15.142:0/2511533159 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f29e4014590 0x7f29e403dab0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:42.338 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.324+0000 7f29ea77e640 1 -- 172.21.15.142:0/2511533159 <== osd.2 v2:172.21.15.142:6808/279438927 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29dc0a2040 con 0x7f29e4014590 2024-09-22T08:36:42.338 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.324+0000 7f29ea77e640 1 --2- 172.21.15.142:0/2511533159 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f29dc0a5040 0x7f29dc098250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:42.338 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.324+0000 7f29ea77e640 1 -- 172.21.15.142:0/2511533159 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560c8aab90c0 con 0x7f29dc0a5040 2024-09-22T08:36:42.339 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.324+0000 7f29e1f7d640 1 --2- 172.21.15.142:0/2511533159 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f29dc0a5040 0x7f29dc098250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:42.339 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.325+0000 7f29e1f7d640 1 --2- 172.21.15.142:0/2511533159 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f29dc0a5040 0x7f29dc098250 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:42.339 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.325+0000 7f29e1f7d640 1 -- 172.21.15.142:0/2511533159 <== osd.0 v2:172.21.15.31:6800/168281188 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29d4009050 con 0x7f29dc0a5040 2024-09-22T08:36:42.339 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.325+0000 7f29e1f7d640 1 -- 172.21.15.142:0/2511533159 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560c8aab90c0 con 0x560c8aab0330 2024-09-22T08:36:42.339 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.325+0000 7f29e1f7d640 1 -- 172.21.15.142:0/2511533159 <== osd.1 v2:172.21.15.142:6816/3192108003 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29d4009050 con 0x560c8aab0330 2024-09-22T08:36:42.339 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.325+0000 7f29e1f7d640 1 -- 172.21.15.142:0/2511533159 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560c8aab90c0 con 0x560c8aab0330 2024-09-22T08:36:42.339 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.325+0000 7f29e1f7d640 1 -- 172.21.15.142:0/2511533159 <== osd.1 v2:172.21.15.142:6816/3192108003 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29d4029040 con 0x560c8aab0330 2024-09-22T08:36:42.339 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.325+0000 7f29e1f7d640 1 -- 172.21.15.142:0/2511533159 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560c8aab90c0 con 0x7f29dc0a5040 2024-09-22T08:36:42.339 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.326+0000 7f29e1f7d640 1 -- 172.21.15.142:0/2511533159 <== osd.0 v2:172.21.15.31:6800/168281188 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29d4029040 con 0x7f29dc0a5040 2024-09-22T08:36:42.339 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.326+0000 7f29e1f7d640 1 -- 172.21.15.142:0/2511533159 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560c8aab90c0 con 0x7f29dc0a5040 2024-09-22T08:36:42.339 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.326+0000 7f29e1f7d640 1 -- 172.21.15.142:0/2511533159 <== osd.0 v2:172.21.15.31:6800/168281188 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29d4029040 con 0x7f29dc0a5040 2024-09-22T08:36:42.339 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.326+0000 7f29e1f7d640 1 -- 172.21.15.142:0/2511533159 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560c8aab90c0 con 0x7f29e4014590 2024-09-22T08:36:42.339 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.326+0000 7f29ea77e640 1 -- 172.21.15.142:0/2511533159 <== osd.2 v2:172.21.15.142:6808/279438927 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29dc0a2040 con 0x7f29e4014590 2024-09-22T08:36:42.339 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.326+0000 7f29ea77e640 1 -- 172.21.15.142:0/2511533159 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560c8aab90c0 con 0x560c8aab4be0 2024-09-22T08:36:42.340 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.326+0000 7f29eaf7f640 1 -- 172.21.15.142:0/2511533159 <== osd.3 v2:172.21.15.142:6800/1064901393 3 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29e400a4d0 con 0x560c8aab4be0 2024-09-22T08:36:42.340 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.326+0000 7f29eaf7f640 1 -- 172.21.15.142:0/2511533159 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560c8aab90c0 con 0x560c8aab0330 2024-09-22T08:36:42.340 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.327+0000 7f29e1f7d640 1 -- 172.21.15.142:0/2511533159 <== osd.1 v2:172.21.15.142:6816/3192108003 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29d4029040 con 0x560c8aab0330 2024-09-22T08:36:42.340 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.327+0000 7f29e1f7d640 1 -- 172.21.15.142:0/2511533159 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560c8aab90c0 con 0x7f29dc0a5040 2024-09-22T08:36:42.340 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.327+0000 7f29e1f7d640 1 -- 172.21.15.142:0/2511533159 <== osd.0 v2:172.21.15.31:6800/168281188 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29d4029040 con 0x7f29dc0a5040 2024-09-22T08:36:42.340 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.327+0000 7f29e1f7d640 1 -- 172.21.15.142:0/2511533159 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560c8aab90c0 con 0x560c8aab0330 2024-09-22T08:36:42.340 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.327+0000 7f29e1f7d640 1 -- 172.21.15.142:0/2511533159 <== osd.1 v2:172.21.15.142:6816/3192108003 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29d4029040 con 0x560c8aab0330 2024-09-22T08:36:42.340 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.327+0000 7f29e1f7d640 1 -- 172.21.15.142:0/2511533159 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560c8aab90c0 con 0x7f29e4014590 2024-09-22T08:36:42.340 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.327+0000 7f29ea77e640 1 -- 172.21.15.142:0/2511533159 <== osd.2 v2:172.21.15.142:6808/279438927 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f29dc0a2040 con 0x7f29e4014590 2024-09-22T08:36:42.340 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.327+0000 7f29ea77e640 1 -- 172.21.15.142:0/2511533159 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560c8aab90c0 con 0x560c8aab4be0 2024-09-22T08:36:42.340 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.328+0000 7f29eaf7f640 1 -- 172.21.15.142:0/2511533159 <== osd.3 v2:172.21.15.142:6800/1064901393 4 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29e400a4d0 con 0x560c8aab4be0 2024-09-22T08:36:42.340 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.328+0000 7f29eaf7f640 1 -- 172.21.15.142:0/2511533159 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560c8aab90c0 con 0x560c8aab4be0 2024-09-22T08:36:42.340 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.328+0000 7f29eaf7f640 1 -- 172.21.15.142:0/2511533159 <== osd.3 v2:172.21.15.142:6800/1064901393 5 ==== osd_op_reply(20 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f29e400a4d0 con 0x560c8aab4be0 2024-09-22T08:36:42.340 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.328+0000 7f29eaf7f640 1 -- 172.21.15.142:0/2511533159 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560c8aab90c0 con 0x7f29dc0a5040 2024-09-22T08:36:42.356 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.328+0000 7f29e1f7d640 1 -- 172.21.15.142:0/2511533159 <== osd.0 v2:172.21.15.31:6800/168281188 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29d4029040 con 0x7f29dc0a5040 2024-09-22T08:36:42.356 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.328+0000 7f29e1f7d640 1 -- 172.21.15.142:0/2511533159 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560c8aab90c0 con 0x560c8aab4be0 2024-09-22T08:36:42.357 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.328+0000 7f29eaf7f640 1 -- 172.21.15.142:0/2511533159 <== osd.3 v2:172.21.15.142:6800/1064901393 6 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29e400a4d0 con 0x560c8aab4be0 2024-09-22T08:36:42.357 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.328+0000 7f29eaf7f640 1 -- 172.21.15.142:0/2511533159 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560c8aab90c0 con 0x560c8aab4be0 2024-09-22T08:36:42.357 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.329+0000 7f29eaf7f640 1 -- 172.21.15.142:0/2511533159 <== osd.3 v2:172.21.15.142:6800/1064901393 7 ==== osd_op_reply(23 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f29e400a4d0 con 0x560c8aab4be0 2024-09-22T08:36:42.357 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.329+0000 7f29eaf7f640 1 -- 172.21.15.142:0/2511533159 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560c8aab90c0 con 0x560c8aab0330 2024-09-22T08:36:42.357 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.329+0000 7f29e1f7d640 1 -- 172.21.15.142:0/2511533159 <== osd.1 v2:172.21.15.142:6816/3192108003 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29d4029040 con 0x560c8aab0330 2024-09-22T08:36:42.357 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.329+0000 7f29e1f7d640 1 -- 172.21.15.142:0/2511533159 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560c8aab90c0 con 0x560c8aab0330 2024-09-22T08:36:42.357 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.329+0000 7f29e1f7d640 1 -- 172.21.15.142:0/2511533159 <== osd.1 v2:172.21.15.142:6816/3192108003 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f29d4029040 con 0x560c8aab0330 2024-09-22T08:36:42.357 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.329+0000 7f29e1f7d640 1 -- 172.21.15.142:0/2511533159 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560c8aab90c0 con 0x7f29dc0a5040 2024-09-22T08:36:42.357 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.329+0000 7f29e1f7d640 1 -- 172.21.15.142:0/2511533159 <== osd.0 v2:172.21.15.31:6800/168281188 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29d4029040 con 0x7f29dc0a5040 2024-09-22T08:36:42.357 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.329+0000 7f29e1f7d640 1 -- 172.21.15.142:0/2511533159 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560c8aab90c0 con 0x560c8aab4be0 2024-09-22T08:36:42.357 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.329+0000 7f29eaf7f640 1 -- 172.21.15.142:0/2511533159 <== osd.3 v2:172.21.15.142:6800/1064901393 8 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29e400a4d0 con 0x560c8aab4be0 2024-09-22T08:36:42.357 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.330+0000 7f29eaf7f640 1 -- 172.21.15.142:0/2511533159 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560c8aab90c0 con 0x7f29e4014590 2024-09-22T08:36:42.357 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.330+0000 7f29ea77e640 1 -- 172.21.15.142:0/2511533159 <== osd.2 v2:172.21.15.142:6808/279438927 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29dc0a2040 con 0x7f29e4014590 2024-09-22T08:36:42.358 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.330+0000 7f29ea77e640 1 -- 172.21.15.142:0/2511533159 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560c8aab90c0 con 0x560c8aab0330 2024-09-22T08:36:42.358 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.330+0000 7f29e1f7d640 1 -- 172.21.15.142:0/2511533159 <== osd.1 v2:172.21.15.142:6816/3192108003 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29d4029040 con 0x560c8aab0330 2024-09-22T08:36:42.358 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.330+0000 7f29e1f7d640 1 -- 172.21.15.142:0/2511533159 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560c8aab90c0 con 0x7f29dc0a5040 2024-09-22T08:36:42.358 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.330+0000 7f29e1f7d640 1 -- 172.21.15.142:0/2511533159 <== osd.0 v2:172.21.15.31:6800/168281188 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29d4029040 con 0x7f29dc0a5040 2024-09-22T08:36:42.358 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.330+0000 7f29e1f7d640 1 -- 172.21.15.142:0/2511533159 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560c8aab90c0 con 0x560c8aab4be0 2024-09-22T08:36:42.358 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.331+0000 7f29eaf7f640 1 -- 172.21.15.142:0/2511533159 <== osd.3 v2:172.21.15.142:6800/1064901393 9 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29e400a4d0 con 0x560c8aab4be0 2024-09-22T08:36:42.358 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.331+0000 7f29eaf7f640 1 -- 172.21.15.142:0/2511533159 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560c8aab90c0 con 0x7f29dc0a5040 2024-09-22T08:36:42.358 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.331+0000 7f29e1f7d640 1 -- 172.21.15.142:0/2511533159 <== osd.0 v2:172.21.15.31:6800/168281188 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29d4029040 con 0x7f29dc0a5040 2024-09-22T08:36:42.358 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.331+0000 7f29e1f7d640 1 -- 172.21.15.142:0/2511533159 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560c8aab90c0 con 0x7f29e4014590 2024-09-22T08:36:42.358 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.331+0000 7f29ea77e640 1 -- 172.21.15.142:0/2511533159 <== osd.2 v2:172.21.15.142:6808/279438927 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29dc0a2040 con 0x7f29e4014590 2024-09-22T08:36:42.358 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.331+0000 7f29ea77e640 1 -- 172.21.15.142:0/2511533159 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560c8aab90c0 con 0x560c8aab4be0 2024-09-22T08:36:42.358 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.331+0000 7f29eaf7f640 1 -- 172.21.15.142:0/2511533159 <== osd.3 v2:172.21.15.142:6800/1064901393 10 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29e400a4d0 con 0x560c8aab4be0 2024-09-22T08:36:42.359 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.331+0000 7f29eaf7f640 1 -- 172.21.15.142:0/2511533159 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560c8aab90c0 con 0x7f29dc0a5040 2024-09-22T08:36:42.359 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.332+0000 7f29e1f7d640 1 -- 172.21.15.142:0/2511533159 <== osd.0 v2:172.21.15.31:6800/168281188 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29d4029040 con 0x7f29dc0a5040 2024-09-22T08:36:42.359 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.332+0000 7f29e1f7d640 1 -- 172.21.15.142:0/2511533159 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560c8aab90c0 con 0x560c8aab0330 2024-09-22T08:36:42.359 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.332+0000 7f29e1f7d640 1 -- 172.21.15.142:0/2511533159 <== osd.1 v2:172.21.15.142:6816/3192108003 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f29d4029040 con 0x560c8aab0330 2024-09-22T08:36:42.359 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.332+0000 7f29e1f7d640 1 -- 172.21.15.142:0/2511533159 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560c8aab90c0 con 0x7f29e4014590 2024-09-22T08:36:42.359 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.332+0000 7f29ea77e640 1 -- 172.21.15.142:0/2511533159 <== osd.2 v2:172.21.15.142:6808/279438927 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29dc0a2040 con 0x7f29e4014590 2024-09-22T08:36:42.359 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.332+0000 7f29ecc94800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:36:42.359 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.332+0000 7f29ecc94800 20 RGWRados::pool_iterate: got zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec 2024-09-22T08:36:42.359 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.332+0000 7f29ecc94800 20 RGWRados::pool_iterate: got zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f 2024-09-22T08:36:42.359 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.332+0000 7f29ecc94800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:36:42.359 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.332+0000 7f29ecc94800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:36:42.359 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.332+0000 7f29ecc94800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:36:42.359 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.332+0000 7f29ecc94800 20 rados->read ofs=0 len=0 2024-09-22T08:36:42.360 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.332+0000 7f29ecc94800 1 -- 172.21.15.142:0/2511533159 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560c8aab8190 con 0x560c8aab0330 2024-09-22T08:36:42.360 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.332+0000 7f29e1f7d640 1 -- 172.21.15.142:0/2511533159 <== osd.1 v2:172.21.15.142:6816/3192108003 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f29d4029040 con 0x560c8aab0330 2024-09-22T08:36:42.360 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.332+0000 7f29ecc94800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:42.360 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.332+0000 7f29ecc94800 20 rados->read ofs=0 len=0 2024-09-22T08:36:42.360 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.332+0000 7f29ecc94800 1 -- 172.21.15.142:0/2511533159 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560c8aab7dd0 con 0x560c8aab0330 2024-09-22T08:36:42.360 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.332+0000 7f29e1f7d640 1 -- 172.21.15.142:0/2511533159 <== osd.1 v2:172.21.15.142:6816/3192108003 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f29d4029040 con 0x560c8aab0330 2024-09-22T08:36:42.360 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.333+0000 7f29ecc94800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:36:42.360 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.333+0000 7f29ecc94800 20 rados->read ofs=0 len=0 2024-09-22T08:36:42.360 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.333+0000 7f29ecc94800 1 -- 172.21.15.142:0/2511533159 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:40 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560c8aab8af0 con 0x560c8aab4be0 2024-09-22T08:36:42.360 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.333+0000 7f29eaf7f640 1 -- 172.21.15.142:0/2511533159 <== osd.3 v2:172.21.15.142:6800/1064901393 11 ==== osd_op_reply(40 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f29e400a4d0 con 0x560c8aab4be0 2024-09-22T08:36:42.360 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.333+0000 7f29ecc94800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:36:42.360 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.333+0000 7f29ecc94800 20 zone default found 2024-09-22T08:36:42.361 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.333+0000 7f29ecc94800 4 Realm: () 2024-09-22T08:36:42.361 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.333+0000 7f29ecc94800 4 ZoneGroup: default (d89f6f57-1007-47dd-9065-f486c7b01aec) 2024-09-22T08:36:42.361 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.333+0000 7f29ecc94800 4 Zone: default (e239248c-0bee-4e41-803a-24b288d3eb8f) 2024-09-22T08:36:42.361 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.333+0000 7f29ecc94800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:36:42.361 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.333+0000 7f29ecc94800 20 zonegroup default 2024-09-22T08:36:42.361 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.333+0000 7f29ecc94800 20 rados->read ofs=0 len=0 2024-09-22T08:36:42.361 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.333+0000 7f29ecc94800 1 -- 172.21.15.142:0/2511533159 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560c8aab8660 con 0x7f29dc0a5040 2024-09-22T08:36:42.361 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.333+0000 7f29e1f7d640 1 -- 172.21.15.142:0/2511533159 <== osd.0 v2:172.21.15.31:6800/168281188 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f29d4029040 con 0x7f29dc0a5040 2024-09-22T08:36:42.361 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.333+0000 7f29ecc94800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:42.361 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.333+0000 7f29ecc94800 20 rados->read ofs=0 len=0 2024-09-22T08:36:42.361 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.333+0000 7f29ecc94800 1 -- 172.21.15.142:0/2511533159 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560c8aabb930 con 0x560c8aab4be0 2024-09-22T08:36:42.361 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.333+0000 7f29eaf7f640 1 -- 172.21.15.142:0/2511533159 <== osd.3 v2:172.21.15.142:6800/1064901393 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f29e400a4d0 con 0x560c8aab4be0 2024-09-22T08:36:42.361 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.333+0000 7f29ecc94800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:42.361 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.333+0000 7f29ecc94800 20 rados->read ofs=0 len=0 2024-09-22T08:36:42.362 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.333+0000 7f29ecc94800 1 -- 172.21.15.142:0/2511533159 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560c8aabbcd0 con 0x560c8aab4be0 2024-09-22T08:36:42.362 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.334+0000 7f29eaf7f640 1 -- 172.21.15.142:0/2511533159 <== osd.3 v2:172.21.15.142:6800/1064901393 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f29e400a4d0 con 0x560c8aab4be0 2024-09-22T08:36:42.362 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.334+0000 7f29ecc94800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:42.362 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.334+0000 7f29ecc94800 20 started sync module instance, tier type = 2024-09-22T08:36:42.362 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.334+0000 7f29ecc94800 20 started zone id=e239248c-0bee-4e41-803a-24b288d3eb8f (name=default) with tier type = 2024-09-22T08:36:42.362 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.334+0000 7f29ecc94800 1 -- 172.21.15.142:0/2511533159 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560c8aabadc0 con 0x7f29e4014590 2024-09-22T08:36:42.362 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.335+0000 7f29ea77e640 1 -- 172.21.15.142:0/2511533159 <== osd.2 v2:172.21.15.142:6808/279438927 7 ==== osd_op_reply(44 notify.0 [create] v30'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f29dc0a2040 con 0x7f29e4014590 2024-09-22T08:36:42.362 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.335+0000 7f29ecc94800 1 -- 172.21.15.142:0/2511533159 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94611866104288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560c8aabc5b0 con 0x7f29e4014590 2024-09-22T08:36:42.362 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.335+0000 7f29ecc94800 1 -- 172.21.15.142:0/2511533159 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560c8aabce00 con 0x560c8aab0330 2024-09-22T08:36:42.362 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.336+0000 7f29ea77e640 1 -- 172.21.15.142:0/2511533159 <== osd.2 v2:172.21.15.142:6808/279438927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94611866104288] v30'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f29dc0a2040 con 0x7f29e4014590 2024-09-22T08:36:42.362 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.336+0000 7f29e1f7d640 1 -- 172.21.15.142:0/2511533159 <== osd.1 v2:172.21.15.142:6816/3192108003 15 ==== osd_op_reply(46 notify.1 [create] v30'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f29d4029040 con 0x560c8aab0330 2024-09-22T08:36:42.362 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.336+0000 7f29ecc94800 1 -- 172.21.15.142:0/2511533159 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94611866108160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560c8aabcea0 con 0x560c8aab0330 2024-09-22T08:36:42.362 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.336+0000 7f29ecc94800 1 -- 172.21.15.142:0/2511533159 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560c8aabd9c0 con 0x560c8aab4be0 2024-09-22T08:36:42.363 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.337+0000 7f29eaf7f640 1 -- 172.21.15.142:0/2511533159 <== osd.3 v2:172.21.15.142:6800/1064901393 14 ==== osd_op_reply(48 notify.2 [create] v30'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f29e400a4d0 con 0x560c8aab4be0 2024-09-22T08:36:42.363 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.337+0000 7f29ecc94800 1 -- 172.21.15.142:0/2511533159 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94611866113168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560c8aabcea0 con 0x560c8aab4be0 2024-09-22T08:36:42.363 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.337+0000 7f29ecc94800 1 -- 172.21.15.142:0/2511533159 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560c8aabe9b0 con 0x7f29e4014590 2024-09-22T08:36:42.363 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.337+0000 7f29e1f7d640 1 -- 172.21.15.142:0/2511533159 <== osd.1 v2:172.21.15.142:6816/3192108003 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94611866108160] v30'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f29d4029040 con 0x560c8aab0330 2024-09-22T08:36:42.363 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.338+0000 7f29ea77e640 1 -- 172.21.15.142:0/2511533159 <== osd.2 v2:172.21.15.142:6808/279438927 9 ==== osd_op_reply(50 notify.3 [create] v30'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f29dc0a2040 con 0x7f29e4014590 2024-09-22T08:36:42.363 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.338+0000 7f29ecc94800 1 -- 172.21.15.142:0/2511533159 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94611866117248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560c8aabe970 con 0x7f29e4014590 2024-09-22T08:36:42.363 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.338+0000 7f29ecc94800 1 -- 172.21.15.142:0/2511533159 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560c8aabf430 con 0x560c8aab0330 2024-09-22T08:36:42.363 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.338+0000 7f29eaf7f640 1 -- 172.21.15.142:0/2511533159 <== osd.3 v2:172.21.15.142:6800/1064901393 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94611866113168] v30'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f29e400a4d0 con 0x560c8aab4be0 2024-09-22T08:36:42.363 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.339+0000 7f29e1f7d640 1 -- 172.21.15.142:0/2511533159 <== osd.1 v2:172.21.15.142:6816/3192108003 17 ==== osd_op_reply(52 notify.4 [create] v30'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f29d4029040 con 0x560c8aab0330 2024-09-22T08:36:42.363 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.339+0000 7f29ecc94800 1 -- 172.21.15.142:0/2511533159 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94611866120000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560c8aabf430 con 0x560c8aab0330 2024-09-22T08:36:42.363 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.339+0000 7f29ecc94800 1 -- 172.21.15.142:0/2511533159 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560c8aabfe80 con 0x7f29dc0a5040 2024-09-22T08:36:42.363 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.340+0000 7f29ea77e640 1 -- 172.21.15.142:0/2511533159 <== osd.2 v2:172.21.15.142:6808/279438927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94611866117248] v30'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f29dc0a2040 con 0x7f29e4014590 2024-09-22T08:36:42.363 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.340+0000 7f29e1f7d640 1 -- 172.21.15.142:0/2511533159 <== osd.1 v2:172.21.15.142:6816/3192108003 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94611866120000] v30'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f29d4029040 con 0x560c8aab0330 2024-09-22T08:36:42.363 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.340+0000 7f29e1f7d640 1 -- 172.21.15.142:0/2511533159 <== osd.0 v2:172.21.15.31:6800/168281188 11 ==== osd_op_reply(54 notify.5 [create] v30'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f29d4029040 con 0x7f29dc0a5040 2024-09-22T08:36:42.364 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.341+0000 7f29ecc94800 1 -- 172.21.15.142:0/2511533159 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94611866115504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560c8aabf990 con 0x7f29dc0a5040 2024-09-22T08:36:42.364 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.341+0000 7f29ecc94800 1 -- 172.21.15.142:0/2511533159 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560c8aac0720 con 0x7f29dc0a5040 2024-09-22T08:36:42.364 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.342+0000 7f29e1f7d640 1 -- 172.21.15.142:0/2511533159 <== osd.0 v2:172.21.15.31:6800/168281188 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94611866115504] v30'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f29d4029040 con 0x7f29dc0a5040 2024-09-22T08:36:42.364 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.342+0000 7f29e1f7d640 1 -- 172.21.15.142:0/2511533159 <== osd.0 v2:172.21.15.31:6800/168281188 13 ==== osd_op_reply(56 notify.6 [create] v30'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f29d4029040 con 0x7f29dc0a5040 2024-09-22T08:36:42.364 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.342+0000 7f29ecc94800 1 -- 172.21.15.142:0/2511533159 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94611866110288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560c8aabf990 con 0x7f29dc0a5040 2024-09-22T08:36:42.364 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.342+0000 7f29ecc94800 1 -- 172.21.15.142:0/2511533159 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560c8aac0d40 con 0x7f29dc0a5040 2024-09-22T08:36:42.364 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.343+0000 7f29e1f7d640 1 -- 172.21.15.142:0/2511533159 <== osd.0 v2:172.21.15.31:6800/168281188 14 ==== osd_op_reply(58 notify.7 [create] v30'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f29d4029040 con 0x7f29dc0a5040 2024-09-22T08:36:42.364 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.343+0000 7f29ecc94800 1 -- 172.21.15.142:0/2511533159 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94611866126480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560c8aac11a0 con 0x7f29dc0a5040 2024-09-22T08:36:42.364 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.343+0000 7f29ecc94800 20 add_watcher() i=0 2024-09-22T08:36:42.364 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.343+0000 7f29ecc94800 20 add_watcher() i=1 2024-09-22T08:36:42.364 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.343+0000 7f29ecc94800 20 add_watcher() i=2 2024-09-22T08:36:42.364 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.343+0000 7f29ecc94800 20 add_watcher() i=3 2024-09-22T08:36:42.364 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.343+0000 7f29ecc94800 20 add_watcher() i=4 2024-09-22T08:36:42.365 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.343+0000 7f29ecc94800 20 add_watcher() i=5 2024-09-22T08:36:42.365 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.343+0000 7f29e1f7d640 1 -- 172.21.15.142:0/2511533159 <== osd.0 v2:172.21.15.31:6800/168281188 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94611866110288] v30'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f29d4029040 con 0x7f29dc0a5040 2024-09-22T08:36:42.365 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.343+0000 7f29ecc94800 20 add_watcher() i=6 2024-09-22T08:36:42.365 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.344+0000 7f29e1f7d640 1 -- 172.21.15.142:0/2511533159 <== osd.0 v2:172.21.15.31:6800/168281188 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94611866126480] v30'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f29d4029040 con 0x7f29dc0a5040 2024-09-22T08:36:42.365 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.344+0000 7f29ecc94800 20 add_watcher() i=7 2024-09-22T08:36:42.365 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.344+0000 7f29ecc94800 2 all 8 watchers are set, enabling cache 2024-09-22T08:36:42.365 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.344+0000 7f29ecc94800 1 -- 172.21.15.142:0/2511533159 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560c8aac02a0 con 0x560c8aab0330 2024-09-22T08:36:42.365 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.344+0000 7f29e1f7d640 1 -- 172.21.15.142:0/2511533159 <== osd.1 v2:172.21.15.142:6816/3192108003 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f29d4029040 con 0x560c8aab0330 2024-09-22T08:36:42.365 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.344+0000 7f29ecc94800 1 -- 172.21.15.142:0/2511533159 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94611866127536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560c8aac1b90 con 0x560c8aab0330 2024-09-22T08:36:42.365 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.345+0000 7f29e1f7d640 1 -- 172.21.15.142:0/2511533159 <== osd.1 v2:172.21.15.142:6816/3192108003 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94611866127536] v30'46 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f29d4029040 con 0x560c8aab0330 2024-09-22T08:36:42.365 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.345+0000 7f28a0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:36:42.365 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.345+0000 7f29ecc94800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:36:42.366 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.345+0000 7f29ecc94800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:36:42.366 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.345+0000 7f29ecc94800 5 note: GC not initialized 2024-09-22T08:36:42.366 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.345+0000 7f281b7fe640 20 reqs_thread_entry: start 2024-09-22T08:36:42.366 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.345+0000 7f29ecc94800 20 init_complete bucket index max shards: 11 2024-09-22T08:36:42.366 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.345+0000 7f29ecc94800 20 Filter name: none 2024-09-22T08:36:42.366 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.346+0000 7f28197fa640 20 reqs_thread_entry: start 2024-09-22T08:36:42.366 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.346+0000 7f29ecc94800 1 -- 172.21.15.142:0/2511533159 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:62 6.e 6:74cd889a:usage::usage.0:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560c8aaf7b60 con 0x560c8aab0330 2024-09-22T08:36:42.366 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.346+0000 7f29e1f7d640 1 -- 172.21.15.142:0/2511533159 <== osd.1 v2:172.21.15.142:6816/3192108003 21 ==== osd_op_reply(62 usage.0 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f29d4029040 con 0x560c8aab0330 2024-09-22T08:36:42.366 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.346+0000 7f29ecc94800 1 -- 172.21.15.142:0/2511533159 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:63 6.3 6:c0e78a64:usage::usage.1:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560c8aaf7b20 con 0x7f29e4014590 2024-09-22T08:36:42.366 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.346+0000 7f29ea77e640 1 -- 172.21.15.142:0/2511533159 <== osd.2 v2:172.21.15.142:6808/279438927 11 ==== osd_op_reply(63 usage.1 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f29dc0a2040 con 0x7f29e4014590 2024-09-22T08:36:42.366 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.346+0000 7f29ecc94800 1 -- 172.21.15.142:0/2511533159 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:64 6.d 6:b564efa4:usage::usage.2:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560c8aaf7b20 con 0x560c8aab0330 2024-09-22T08:36:42.366 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.346+0000 7f29e1f7d640 1 -- 172.21.15.142:0/2511533159 <== osd.1 v2:172.21.15.142:6816/3192108003 22 ==== osd_op_reply(64 usage.2 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f29d4029040 con 0x560c8aab0330 2024-09-22T08:36:42.366 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.346+0000 7f29ecc94800 1 -- 172.21.15.142:0/2511533159 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:65 6.2 6:42d64401:usage::usage.3:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560c8aaf7b20 con 0x560c8aab4be0 2024-09-22T08:36:42.367 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.347+0000 7f29eaf7f640 1 -- 172.21.15.142:0/2511533159 <== osd.3 v2:172.21.15.142:6800/1064901393 16 ==== osd_op_reply(65 usage.3 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f29e400a4d0 con 0x560c8aab4be0 2024-09-22T08:36:42.367 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.347+0000 7f29ecc94800 1 -- 172.21.15.142:0/2511533159 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:66 6.7 6:e09b6f01:usage::usage.4:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560c8aaf7b20 con 0x560c8aab4be0 2024-09-22T08:36:42.367 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.347+0000 7f29eaf7f640 1 -- 172.21.15.142:0/2511533159 <== osd.3 v2:172.21.15.142:6800/1064901393 17 ==== osd_op_reply(66 usage.4 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f29e400a4d0 con 0x560c8aab4be0 2024-09-22T08:36:42.367 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.347+0000 7f29ecc94800 1 -- 172.21.15.142:0/2511533159 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:67 6.6 6:672810f1:usage::usage.5:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560c8aaf7b20 con 0x560c8aab4be0 2024-09-22T08:36:42.367 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.347+0000 7f29eaf7f640 1 -- 172.21.15.142:0/2511533159 <== osd.3 v2:172.21.15.142:6800/1064901393 18 ==== osd_op_reply(67 usage.5 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f29e400a4d0 con 0x560c8aab4be0 2024-09-22T08:36:42.367 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.347+0000 7f29ecc94800 1 -- 172.21.15.142:0/2511533159 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:68 6.4 6:25a86931:usage::usage.6:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560c8aaf7b20 con 0x560c8aab0330 2024-09-22T08:36:42.368 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.347+0000 7f29e1f7d640 1 -- 172.21.15.142:0/2511533159 <== osd.1 v2:172.21.15.142:6816/3192108003 23 ==== osd_op_reply(68 usage.6 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f29d4029040 con 0x560c8aab0330 2024-09-22T08:36:42.368 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.347+0000 7f29ecc94800 1 -- 172.21.15.142:0/2511533159 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:69 6.17 6:ebbe7322:usage::usage.7:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560c8aaf7b20 con 0x560c8aab0330 2024-09-22T08:36:42.368 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.347+0000 7f29e1f7d640 1 -- 172.21.15.142:0/2511533159 <== osd.1 v2:172.21.15.142:6816/3192108003 24 ==== osd_op_reply(69 usage.7 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f29d4029040 con 0x560c8aab0330 2024-09-22T08:36:42.368 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.347+0000 7f29ecc94800 1 -- 172.21.15.142:0/2511533159 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:70 6.6 6:607e1922:usage::usage.8:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560c8aaf7b20 con 0x560c8aab4be0 2024-09-22T08:36:42.368 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.348+0000 7f29eaf7f640 1 -- 172.21.15.142:0/2511533159 <== osd.3 v2:172.21.15.142:6800/1064901393 19 ==== osd_op_reply(70 usage.8 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f29e400a4d0 con 0x560c8aab4be0 2024-09-22T08:36:42.368 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.348+0000 7f29ecc94800 1 -- 172.21.15.142:0/2511533159 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:71 6.b 6:d7809252:usage::usage.9:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560c8aaf7b20 con 0x560c8aab4be0 2024-09-22T08:36:42.368 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.348+0000 7f29eaf7f640 1 -- 172.21.15.142:0/2511533159 <== osd.3 v2:172.21.15.142:6800/1064901393 20 ==== osd_op_reply(71 usage.9 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f29e400a4d0 con 0x560c8aab4be0 2024-09-22T08:36:42.369 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.348+0000 7f29ecc94800 1 -- 172.21.15.142:0/2511533159 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:72 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560c8aaf7b20 con 0x7f29dc0a5040 2024-09-22T08:36:42.369 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.348+0000 7f29e1f7d640 1 -- 172.21.15.142:0/2511533159 <== osd.0 v2:172.21.15.31:6800/168281188 17 ==== osd_op_reply(72 usage.10 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f29d4029040 con 0x7f29dc0a5040 2024-09-22T08:36:42.369 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.348+0000 7f29ecc94800 1 -- 172.21.15.142:0/2511533159 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:73 6.4 6:21f845ae:usage::usage.11:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560c8aaf7b20 con 0x560c8aab0330 2024-09-22T08:36:42.369 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.348+0000 7f29e1f7d640 1 -- 172.21.15.142:0/2511533159 <== osd.1 v2:172.21.15.142:6816/3192108003 25 ==== osd_op_reply(73 usage.11 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f29d4029040 con 0x560c8aab0330 2024-09-22T08:36:42.369 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.348+0000 7f29ecc94800 1 -- 172.21.15.142:0/2511533159 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:74 6.f 6:f0386354:usage::usage.12:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560c8aaf7b20 con 0x7f29e4014590 2024-09-22T08:36:42.370 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.348+0000 7f29ea77e640 1 -- 172.21.15.142:0/2511533159 <== osd.2 v2:172.21.15.142:6808/279438927 12 ==== osd_op_reply(74 usage.12 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f29dc0a2040 con 0x7f29e4014590 2024-09-22T08:36:42.370 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.348+0000 7f29ecc94800 1 -- 172.21.15.142:0/2511533159 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:75 6.c 6:3735eec4:usage::usage.13:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560c8aaf7b20 con 0x560c8aab4be0 2024-09-22T08:36:42.370 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.349+0000 7f29eaf7f640 1 -- 172.21.15.142:0/2511533159 <== osd.3 v2:172.21.15.142:6800/1064901393 21 ==== osd_op_reply(75 usage.13 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f29e400a4d0 con 0x560c8aab4be0 2024-09-22T08:36:42.370 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.349+0000 7f29ecc94800 1 -- 172.21.15.142:0/2511533159 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:76 6.18 6:1f520d0a:usage::usage.14:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560c8aaf7b20 con 0x7f29dc0a5040 2024-09-22T08:36:42.370 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.349+0000 7f29e1f7d640 1 -- 172.21.15.142:0/2511533159 <== osd.0 v2:172.21.15.31:6800/168281188 18 ==== osd_op_reply(76 usage.14 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f29d4029040 con 0x7f29dc0a5040 2024-09-22T08:36:42.370 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.349+0000 7f29ecc94800 1 -- 172.21.15.142:0/2511533159 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:77 6.0 6:029cee12:usage::usage.15:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560c8aaf7b20 con 0x7f29dc0a5040 2024-09-22T08:36:42.370 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.349+0000 7f29e1f7d640 1 -- 172.21.15.142:0/2511533159 <== osd.0 v2:172.21.15.31:6800/168281188 19 ==== osd_op_reply(77 usage.15 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f29d4029040 con 0x7f29dc0a5040 2024-09-22T08:36:42.371 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.349+0000 7f29ecc94800 1 -- 172.21.15.142:0/2511533159 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:78 6.1e 6:7f3e030e:usage::usage.16:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560c8aaf7b20 con 0x560c8aab4be0 2024-09-22T08:36:42.371 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.350+0000 7f29eaf7f640 1 -- 172.21.15.142:0/2511533159 <== osd.3 v2:172.21.15.142:6800/1064901393 22 ==== osd_op_reply(78 usage.16 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f29e400a4d0 con 0x560c8aab4be0 2024-09-22T08:36:42.371 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.350+0000 7f29ecc94800 1 -- 172.21.15.142:0/2511533159 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:79 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560c8aaf7b20 con 0x7f29dc0a5040 2024-09-22T08:36:42.371 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.350+0000 7f29e1f7d640 1 -- 172.21.15.142:0/2511533159 <== osd.0 v2:172.21.15.31:6800/168281188 20 ==== osd_op_reply(79 usage.17 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f29d4029040 con 0x7f29dc0a5040 2024-09-22T08:36:42.371 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.350+0000 7f29ecc94800 1 -- 172.21.15.142:0/2511533159 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:80 6.19 6:993b03e9:usage::usage.18:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560c8aaf7b20 con 0x560c8aab0330 2024-09-22T08:36:42.371 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.350+0000 7f29e1f7d640 1 -- 172.21.15.142:0/2511533159 <== osd.1 v2:172.21.15.142:6816/3192108003 26 ==== osd_op_reply(80 usage.18 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f29d4029040 con 0x560c8aab0330 2024-09-22T08:36:42.371 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.350+0000 7f29ecc94800 1 -- 172.21.15.142:0/2511533159 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:81 6.1a 6:58fcd270:usage::usage.19:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560c8aaf7b20 con 0x560c8aab4be0 2024-09-22T08:36:42.371 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.350+0000 7f29eaf7f640 1 -- 172.21.15.142:0/2511533159 <== osd.3 v2:172.21.15.142:6800/1064901393 23 ==== osd_op_reply(81 usage.19 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f29e400a4d0 con 0x560c8aab4be0 2024-09-22T08:36:42.372 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.350+0000 7f29ecc94800 1 -- 172.21.15.142:0/2511533159 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:82 6.1f 6:fcd63d49:usage::usage.20:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560c8aaf7b20 con 0x7f29dc0a5040 2024-09-22T08:36:42.372 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.351+0000 7f29e1f7d640 1 -- 172.21.15.142:0/2511533159 <== osd.0 v2:172.21.15.31:6800/168281188 21 ==== osd_op_reply(82 usage.20 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f29d4029040 con 0x7f29dc0a5040 2024-09-22T08:36:42.372 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.351+0000 7f29ecc94800 1 -- 172.21.15.142:0/2511533159 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:83 6.5 6:a2c1a412:usage::usage.21:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560c8aaf7b20 con 0x7f29e4014590 2024-09-22T08:36:42.372 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.351+0000 7f29ea77e640 1 -- 172.21.15.142:0/2511533159 <== osd.2 v2:172.21.15.142:6808/279438927 13 ==== osd_op_reply(83 usage.21 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f29dc0a2040 con 0x7f29e4014590 2024-09-22T08:36:42.372 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.351+0000 7f29ecc94800 1 -- 172.21.15.142:0/2511533159 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:84 6.13 6:cdb71d68:usage::usage.22:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560c8aaf7b20 con 0x7f29dc0a5040 2024-09-22T08:36:42.372 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.351+0000 7f29e1f7d640 1 -- 172.21.15.142:0/2511533159 <== osd.0 v2:172.21.15.31:6800/168281188 22 ==== osd_op_reply(84 usage.22 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f29d4029040 con 0x7f29dc0a5040 2024-09-22T08:36:42.372 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.351+0000 7f29ecc94800 1 -- 172.21.15.142:0/2511533159 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:85 6.17 6:ef3bca03:usage::usage.23:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560c8aaf7b20 con 0x560c8aab0330 2024-09-22T08:36:42.373 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.351+0000 7f29e1f7d640 1 -- 172.21.15.142:0/2511533159 <== osd.1 v2:172.21.15.142:6816/3192108003 27 ==== osd_op_reply(85 usage.23 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f29d4029040 con 0x560c8aab0330 2024-09-22T08:36:42.373 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.351+0000 7f29ecc94800 1 -- 172.21.15.142:0/2511533159 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:86 6.e 6:7412960a:usage::usage.24:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560c8aaf7b20 con 0x560c8aab0330 2024-09-22T08:36:42.373 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.352+0000 7f29e1f7d640 1 -- 172.21.15.142:0/2511533159 <== osd.1 v2:172.21.15.142:6816/3192108003 28 ==== osd_op_reply(86 usage.24 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f29d4029040 con 0x560c8aab0330 2024-09-22T08:36:42.373 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.352+0000 7f29ecc94800 1 -- 172.21.15.142:0/2511533159 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:87 6.7 6:e62d1024:usage::usage.25:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560c8aaf7b20 con 0x560c8aab4be0 2024-09-22T08:36:42.373 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.352+0000 7f29eaf7f640 1 -- 172.21.15.142:0/2511533159 <== osd.3 v2:172.21.15.142:6800/1064901393 24 ==== osd_op_reply(87 usage.25 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f29e400a4d0 con 0x560c8aab4be0 2024-09-22T08:36:42.373 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.352+0000 7f29ecc94800 1 -- 172.21.15.142:0/2511533159 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:88 6.d 6:b172cd59:usage::usage.26:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560c8aaf7b20 con 0x560c8aab0330 2024-09-22T08:36:42.374 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.352+0000 7f29e1f7d640 1 -- 172.21.15.142:0/2511533159 <== osd.1 v2:172.21.15.142:6816/3192108003 29 ==== osd_op_reply(88 usage.26 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f29d4029040 con 0x560c8aab0330 2024-09-22T08:36:42.374 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.352+0000 7f29ecc94800 1 -- 172.21.15.142:0/2511533159 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:89 6.1 6:83912023:usage::usage.27:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560c8aaf7b20 con 0x560c8aab0330 2024-09-22T08:36:42.374 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.352+0000 7f29e1f7d640 1 -- 172.21.15.142:0/2511533159 <== osd.1 v2:172.21.15.142:6816/3192108003 30 ==== osd_op_reply(89 usage.27 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f29d4029040 con 0x560c8aab0330 2024-09-22T08:36:42.374 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.352+0000 7f29ecc94800 1 -- 172.21.15.142:0/2511533159 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:90 6.1e 6:7c73bdb3:usage::usage.28:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560c8aaf7b20 con 0x560c8aab4be0 2024-09-22T08:36:42.374 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.352+0000 7f29eaf7f640 1 -- 172.21.15.142:0/2511533159 <== osd.3 v2:172.21.15.142:6800/1064901393 25 ==== osd_op_reply(90 usage.28 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f29e400a4d0 con 0x560c8aab4be0 2024-09-22T08:36:42.374 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.352+0000 7f29ecc94800 1 -- 172.21.15.142:0/2511533159 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:91 6.16 6:6e59fa35:usage::usage.29:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560c8aaf7b20 con 0x560c8aab4be0 2024-09-22T08:36:42.374 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.352+0000 7f29eaf7f640 1 -- 172.21.15.142:0/2511533159 <== osd.3 v2:172.21.15.142:6800/1064901393 26 ==== osd_op_reply(91 usage.29 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f29e400a4d0 con 0x560c8aab4be0 2024-09-22T08:36:42.374 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.353+0000 7f29ecc94800 1 -- 172.21.15.142:0/2511533159 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:92 6.1c 6:38fe6885:usage::usage.30:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560c8aaf7b20 con 0x560c8aab4be0 2024-09-22T08:36:42.375 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.353+0000 7f29eaf7f640 1 -- 172.21.15.142:0/2511533159 <== osd.3 v2:172.21.15.142:6800/1064901393 27 ==== osd_op_reply(92 usage.30 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f29e400a4d0 con 0x560c8aab4be0 2024-09-22T08:36:42.375 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.353+0000 7f29ecc94800 1 -- 172.21.15.142:0/2511533159 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:93 6.1d 6:bb28dff0:usage::usage.31:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560c8aaf7b20 con 0x7f29dc0a5040 2024-09-22T08:36:42.375 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.353+0000 7f29e1f7d640 1 -- 172.21.15.142:0/2511533159 <== osd.0 v2:172.21.15.31:6800/168281188 23 ==== osd_op_reply(93 usage.31 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f29d4029040 con 0x7f29dc0a5040 2024-09-22T08:36:42.375 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.354+0000 7f28a0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:36:42.375 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.354+0000 7f29ecc94800 1 -- 172.21.15.142:0/2511533159 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94611866127536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560c8aaf7b20 con 0x560c8aab0330 2024-09-22T08:36:42.380 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.355+0000 7f29e1f7d640 1 -- 172.21.15.142:0/2511533159 <== osd.1 v2:172.21.15.142:6816/3192108003 31 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94611866127536] v30'47 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f29d4029040 con 0x560c8aab0330 2024-09-22T08:36:42.380 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.355+0000 7f29ecc94800 1 -- 172.21.15.142:0/2511533159 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94611866104288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560c8aaf7b20 con 0x7f29e4014590 2024-09-22T08:36:42.380 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.356+0000 7f29ea77e640 1 -- 172.21.15.142:0/2511533159 <== osd.2 v2:172.21.15.142:6808/279438927 14 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94611866104288] v30'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f29dc0a2040 con 0x7f29e4014590 2024-09-22T08:36:42.380 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.356+0000 7f29ecc94800 20 remove_watcher() i=0 2024-09-22T08:36:42.380 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.356+0000 7f29ecc94800 2 removed watcher, disabling cache 2024-09-22T08:36:42.380 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.356+0000 7f29ecc94800 1 -- 172.21.15.142:0/2511533159 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94611866108160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560c8aaf7b20 con 0x560c8aab0330 2024-09-22T08:36:42.380 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.357+0000 7f29e1f7d640 1 -- 172.21.15.142:0/2511533159 <== osd.1 v2:172.21.15.142:6816/3192108003 32 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94611866108160] v30'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f29d4029040 con 0x560c8aab0330 2024-09-22T08:36:42.380 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.357+0000 7f29ecc94800 20 remove_watcher() i=1 2024-09-22T08:36:42.381 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.357+0000 7f29ecc94800 1 -- 172.21.15.142:0/2511533159 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94611866113168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560c8aaf7b20 con 0x560c8aab4be0 2024-09-22T08:36:42.381 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.358+0000 7f29eaf7f640 1 -- 172.21.15.142:0/2511533159 <== osd.3 v2:172.21.15.142:6800/1064901393 28 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94611866113168] v30'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f29e400a4d0 con 0x560c8aab4be0 2024-09-22T08:36:42.381 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.358+0000 7f29ecc94800 20 remove_watcher() i=2 2024-09-22T08:36:42.381 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.358+0000 7f29ecc94800 1 -- 172.21.15.142:0/2511533159 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94611866117248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560c8aaf7b20 con 0x7f29e4014590 2024-09-22T08:36:42.381 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.359+0000 7f29ea77e640 1 -- 172.21.15.142:0/2511533159 <== osd.2 v2:172.21.15.142:6808/279438927 15 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94611866117248] v30'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f29dc0a2040 con 0x7f29e4014590 2024-09-22T08:36:42.381 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.359+0000 7f29ecc94800 20 remove_watcher() i=3 2024-09-22T08:36:42.381 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.359+0000 7f29ecc94800 1 -- 172.21.15.142:0/2511533159 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94611866120000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560c8aaf7b20 con 0x560c8aab0330 2024-09-22T08:36:42.381 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.360+0000 7f29e1f7d640 1 -- 172.21.15.142:0/2511533159 <== osd.1 v2:172.21.15.142:6816/3192108003 33 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94611866120000] v30'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f29d4029040 con 0x560c8aab0330 2024-09-22T08:36:42.381 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.360+0000 7f29ecc94800 20 remove_watcher() i=4 2024-09-22T08:36:42.381 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.360+0000 7f29ecc94800 1 -- 172.21.15.142:0/2511533159 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94611866115504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560c8aaf7b20 con 0x7f29dc0a5040 2024-09-22T08:36:42.381 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.361+0000 7f29e1f7d640 1 -- 172.21.15.142:0/2511533159 <== osd.0 v2:172.21.15.31:6800/168281188 24 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94611866115504] v30'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f29d4029040 con 0x7f29dc0a5040 2024-09-22T08:36:42.381 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.361+0000 7f29ecc94800 20 remove_watcher() i=5 2024-09-22T08:36:42.381 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.361+0000 7f29ecc94800 1 -- 172.21.15.142:0/2511533159 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94611866110288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560c8aaf7b20 con 0x7f29dc0a5040 2024-09-22T08:36:42.381 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.361+0000 7f29e1f7d640 1 -- 172.21.15.142:0/2511533159 <== osd.0 v2:172.21.15.31:6800/168281188 25 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94611866110288] v30'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f29d4029040 con 0x7f29dc0a5040 2024-09-22T08:36:42.382 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.362+0000 7f29ecc94800 20 remove_watcher() i=6 2024-09-22T08:36:42.382 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.362+0000 7f29ecc94800 1 -- 172.21.15.142:0/2511533159 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94611866126480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560c8aaf7b20 con 0x7f29dc0a5040 2024-09-22T08:36:42.382 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.362+0000 7f29e1f7d640 1 -- 172.21.15.142:0/2511533159 <== osd.0 v2:172.21.15.31:6800/168281188 26 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94611866126480] v30'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f29d4029040 con 0x7f29dc0a5040 2024-09-22T08:36:42.382 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.362+0000 7f29ecc94800 20 remove_watcher() i=7 2024-09-22T08:36:42.382 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.363+0000 7f29ecc94800 1 -- 172.21.15.142:0/2511533159 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f29dc0a5040 msgr2=0x7f29dc098250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:42.382 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.363+0000 7f29ecc94800 1 --2- 172.21.15.142:0/2511533159 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f29dc0a5040 0x7f29dc098250 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:42.382 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.363+0000 7f29ecc94800 1 -- 172.21.15.142:0/2511533159 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x560c8aab0330 msgr2=0x560c8aab27f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:42.382 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.363+0000 7f29ecc94800 1 --2- 172.21.15.142:0/2511533159 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x560c8aab0330 0x560c8aab27f0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:42.382 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.363+0000 7f29ecc94800 1 -- 172.21.15.142:0/2511533159 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f29e4014590 msgr2=0x7f29e403dab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:42.382 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.363+0000 7f29ecc94800 1 --2- 172.21.15.142:0/2511533159 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f29e4014590 0x7f29e403dab0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:42.382 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.363+0000 7f29ecc94800 1 -- 172.21.15.142:0/2511533159 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x560c8aab4be0 msgr2=0x560c8aab6fd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:42.382 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.363+0000 7f29ecc94800 1 --2- 172.21.15.142:0/2511533159 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x560c8aab4be0 0x560c8aab6fd0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:42.382 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.363+0000 7f29ecc94800 1 -- 172.21.15.142:0/2511533159 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f28b403d000 msgr2=0x7f28b403f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:42.383 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.363+0000 7f29ecc94800 1 --2- 172.21.15.142:0/2511533159 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f28b403d000 0x7f28b403f4c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f29dc097150 tx=0x7f29dc088000 comp rx=0 tx=0).stop 2024-09-22T08:36:42.383 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.363+0000 7f29ecc94800 1 -- 172.21.15.142:0/2511533159 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560c8aa9d490 msgr2=0x560c8aaa4a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:42.383 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.363+0000 7f29e1f7d640 1 -- 172.21.15.142:0/2511533159 reap_dead start 2024-09-22T08:36:42.383 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.363+0000 7f29ecc94800 1 --2- 172.21.15.142:0/2511533159 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560c8aa9d490 0x560c8aaa4a70 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f29e402afd0 tx=0x7f29e40548c0 comp rx=0 tx=0).stop 2024-09-22T08:36:42.383 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.363+0000 7f29ecc94800 1 -- 172.21.15.142:0/2511533159 shutdown_connections 2024-09-22T08:36:42.383 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.363+0000 7f29ecc94800 1 --2- 172.21.15.142:0/2511533159 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560c8aa9d490 0x560c8aaa4a70 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:42.383 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.363+0000 7f29ecc94800 1 -- 172.21.15.142:0/2511533159 >> 172.21.15.142:0/2511533159 conn(0x560c8aa99890 msgr2=0x560c8aa97aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:42.383 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.363+0000 7f29ecc94800 1 -- 172.21.15.142:0/2511533159 shutdown_connections 2024-09-22T08:36:42.383 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.363+0000 7f29ecc94800 1 -- 172.21.15.142:0/2511533159 wait complete. 2024-09-22T08:36:42.383 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.363+0000 7f29ecc94800 1 -- 172.21.15.142:0/2100893077 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f28c403d000 msgr2=0x7f28c403f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:42.383 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.363+0000 7f29ecc94800 1 --2- 172.21.15.142:0/2100893077 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f28c403d000 0x7f28c403f4c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f29dc06c000 tx=0x7f29dc005390 comp rx=0 tx=0).stop 2024-09-22T08:36:42.383 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.363+0000 7f29ecc94800 1 -- 172.21.15.142:0/2100893077 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560c8aa909d0 msgr2=0x560c8aa90df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:42.383 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.363+0000 7f29ecc94800 1 --2- 172.21.15.142:0/2100893077 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560c8aa909d0 0x560c8aa90df0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x560c8a97ca30 tx=0x7f29e40167b0 comp rx=0 tx=0).stop 2024-09-22T08:36:42.383 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.363+0000 7f29ecc94800 1 -- 172.21.15.142:0/2100893077 shutdown_connections 2024-09-22T08:36:42.384 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.363+0000 7f29ecc94800 1 --2- 172.21.15.142:0/2100893077 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f28c403d000 0x7f28c403f4c0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:42.384 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.363+0000 7f29ecc94800 1 --2- 172.21.15.142:0/2100893077 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560c8aa909d0 0x560c8aa90df0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:42.384 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.363+0000 7f29ecc94800 1 -- 172.21.15.142:0/2100893077 >> 172.21.15.142:0/2100893077 conn(0x560c8aa84d80 msgr2=0x560c8aa85160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:42.384 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.363+0000 7f29ecc94800 1 -- 172.21.15.142:0/2100893077 shutdown_connections 2024-09-22T08:36:42.384 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.363+0000 7f29ecc94800 1 -- 172.21.15.142:0/2100893077 wait complete. 2024-09-22T08:36:42.384 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.364+0000 7f29ecc94800 1 -- 172.21.15.142:0/3572549414 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x560c8a9806f0 msgr2=0x560c8aa7cbf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:42.384 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.364+0000 7f29ecc94800 1 --2- 172.21.15.142:0/3572549414 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x560c8a9806f0 0x560c8aa7cbf0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:42.384 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.364+0000 7f29ecc94800 1 -- 172.21.15.142:0/3572549414 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x560c8aa7f570 msgr2=0x560c8aa81960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:42.384 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.364+0000 7f29ecc94800 1 --2- 172.21.15.142:0/3572549414 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x560c8aa7f570 0x560c8aa81960 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:42.384 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.364+0000 7f29ecc94800 1 -- 172.21.15.142:0/3572549414 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f28d003d000 msgr2=0x7f28d003f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:42.384 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.364+0000 7f29ecc94800 1 --2- 172.21.15.142:0/3572549414 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f28d003d000 0x7f28d003f4c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f29d4001d70 tx=0x7f29d40012d0 comp rx=0 tx=0).stop 2024-09-22T08:36:42.384 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.364+0000 7f29ecc94800 1 -- 172.21.15.142:0/3572549414 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560c8a97dd90 msgr2=0x560c8a97cfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:42.384 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.364+0000 7f29ecc94800 1 --2- 172.21.15.142:0/3572549414 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560c8a97dd90 0x560c8a97cfb0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f29dc025c20 tx=0x7f29dc002fb0 comp rx=0 tx=0).stop 2024-09-22T08:36:42.384 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.364+0000 7f29ecc94800 1 -- 172.21.15.142:0/3572549414 shutdown_connections 2024-09-22T08:36:42.385 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.364+0000 7f29ecc94800 1 --2- 172.21.15.142:0/3572549414 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x560c8aa7f570 0x560c8aa81960 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:42.385 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.364+0000 7f29ecc94800 1 --2- 172.21.15.142:0/3572549414 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x560c8a9806f0 0x560c8aa7cbf0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:42.385 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.364+0000 7f29ecc94800 1 --2- 172.21.15.142:0/3572549414 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f28d003d000 0x7f28d003f4c0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:42.385 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.364+0000 7f29ecc94800 1 --2- 172.21.15.142:0/3572549414 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560c8a97dd90 0x560c8a97cfb0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:42.385 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.364+0000 7f29ecc94800 1 -- 172.21.15.142:0/3572549414 >> 172.21.15.142:0/3572549414 conn(0x560c8a978300 msgr2=0x560c8aa670b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:42.385 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.364+0000 7f29ecc94800 1 -- 172.21.15.142:0/3572549414 shutdown_connections 2024-09-22T08:36:42.385 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.364+0000 7f29ecc94800 1 -- 172.21.15.142:0/3572549414 wait complete. 2024-09-22T08:36:42.386 INFO:teuthology.orchestra.run.smithi142.stdout:{"entries":[],"summary":[]} 2024-09-22T08:36:42.386 DEBUG:tasks.util.rgw: json result: {'entries': [], 'summary': []} 2024-09-22T08:36:42.386 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-22T08:36:42.386 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-22T08:36:42.387 DEBUG:teuthology.orchestra.run.smithi142:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-22T08:36:42.470 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:36:42.470 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:36:42.472 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.469+0000 7fdc0a91f800 1 Processor -- start 2024-09-22T08:36:42.472 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.469+0000 7fdc0a91f800 1 -- start start 2024-09-22T08:36:42.472 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.469+0000 7fdc0a91f800 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55f37b672c00 0x55f37b678590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:42.472 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.469+0000 7fdc0a91f800 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55f37b4fda20 con 0x55f37b6717f0 2024-09-22T08:36:42.472 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.469+0000 7fdc0a91f800 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x55f37b4fd7d0 con 0x55f37b672c00 2024-09-22T08:36:42.472 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.469+0000 7fdc05d91640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55f37b672c00 0x55f37b678590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:42.472 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.469+0000 7fdc05d91640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55f37b672c00 0x55f37b678590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:37790/0 (socket says 172.21.15.142:37790) 2024-09-22T08:36:42.472 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.469+0000 7fdc05d91640 1 -- 172.21.15.142:0/983449100 learned_addr learned my addr 172.21.15.142:0/983449100 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:42.472 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.469+0000 7fdc06592640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x55f37b6717f0 0x55f37b6724f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.142:42284/0 (socket says 172.21.15.142:42284) 2024-09-22T08:36:42.472 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.470+0000 7fdc05d91640 1 -- 172.21.15.142:0/983449100 >> v1:172.21.15.31:6789/0 conn(0x55f37b6717f0 legacy=0x55f37b6724f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:42.472 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.470+0000 7fdc05d91640 1 -- 172.21.15.142:0/983449100 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f37b671ef0 con 0x55f37b672c00 2024-09-22T08:36:42.472 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.470+0000 7fdc05590640 1 -- 172.21.15.142:0/983449100 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3340905838 0 0) 0x55f37b4fda20 con 0x55f37b6717f0 2024-09-22T08:36:42.474 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.471+0000 7fdc05d91640 1 --2- 172.21.15.142:0/983449100 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f37b672c00 0x55f37b678590 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fdbf000a520 tx=0x7fdbf0045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f39432633ea34740 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:42.474 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.472+0000 7fdc05590640 1 -- 172.21.15.142:0/983449100 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdbf0055070 con 0x55f37b672c00 2024-09-22T08:36:42.474 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.472+0000 7fdc05590640 1 -- 172.21.15.142:0/983449100 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdbf00515b0 con 0x55f37b672c00 2024-09-22T08:36:42.474 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.472+0000 7fdc05590640 1 -- 172.21.15.142:0/983449100 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdbf00518d0 con 0x55f37b672c00 2024-09-22T08:36:42.475 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.472+0000 7fdc0a91f800 1 -- 172.21.15.142:0/983449100 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f37b672c00 msgr2=0x55f37b678590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:42.475 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.472+0000 7fdc0a91f800 1 --2- 172.21.15.142:0/983449100 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f37b672c00 0x55f37b678590 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fdbf000a520 tx=0x7fdbf0045ba0 comp rx=0 tx=0).stop 2024-09-22T08:36:42.475 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.472+0000 7fdc0a91f800 1 -- 172.21.15.142:0/983449100 shutdown_connections 2024-09-22T08:36:42.475 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.472+0000 7fdc0a91f800 1 --2- 172.21.15.142:0/983449100 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f37b672c00 0x55f37b678590 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:42.475 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.472+0000 7fdc0a91f800 1 -- 172.21.15.142:0/983449100 >> 172.21.15.142:0/983449100 conn(0x55f37b66cbe0 msgr2=0x55f37b66f020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:42.475 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.472+0000 7fdc0a91f800 1 -- 172.21.15.142:0/983449100 shutdown_connections 2024-09-22T08:36:42.475 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.472+0000 7fdc0a91f800 1 -- 172.21.15.142:0/983449100 wait complete. 2024-09-22T08:36:42.488 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.486+0000 7fdc0a91f800 1 Processor -- start 2024-09-22T08:36:42.489 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.486+0000 7fdc0a91f800 1 -- start start 2024-09-22T08:36:42.489 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.486+0000 7fdc0a91f800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f37b6717f0 0x55f37b760d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:42.489 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.486+0000 7fdc0a91f800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55f37b50add0 con 0x55f37b6717f0 2024-09-22T08:36:42.489 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.486+0000 7fdc06592640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f37b6717f0 0x55f37b760d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:42.489 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.486+0000 7fdc06592640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f37b6717f0 0x55f37b760d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:37800/0 (socket says 172.21.15.142:37800) 2024-09-22T08:36:42.489 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.486+0000 7fdc06592640 1 -- 172.21.15.142:0/1672198696 learned_addr learned my addr 172.21.15.142:0/1672198696 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:42.489 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.487+0000 7fdc06592640 1 -- 172.21.15.142:0/1672198696 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f37b761310 con 0x55f37b6717f0 2024-09-22T08:36:42.492 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.487+0000 7fdc06592640 1 --2- 172.21.15.142:0/1672198696 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f37b6717f0 0x55f37b760d20 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fdbf8001ea0 tx=0x7fdbf800b6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f998b8cdccbaa7b5 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:42.492 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.487+0000 7fdaf4608640 1 -- 172.21.15.142:0/1672198696 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdbf8008070 con 0x55f37b6717f0 2024-09-22T08:36:42.492 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.487+0000 7fdaf4608640 1 -- 172.21.15.142:0/1672198696 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdbf800d500 con 0x55f37b6717f0 2024-09-22T08:36:42.492 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.487+0000 7fdaf4608640 1 -- 172.21.15.142:0/1672198696 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdbf800d880 con 0x55f37b6717f0 2024-09-22T08:36:42.492 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.488+0000 7fdc0a91f800 1 -- 172.21.15.142:0/1672198696 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f37b6717f0 msgr2=0x55f37b760d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:42.492 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.488+0000 7fdc0a91f800 1 --2- 172.21.15.142:0/1672198696 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f37b6717f0 0x55f37b760d20 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fdbf8001ea0 tx=0x7fdbf800b6a0 comp rx=0 tx=0).stop 2024-09-22T08:36:42.492 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.488+0000 7fdc0a91f800 1 -- 172.21.15.142:0/1672198696 shutdown_connections 2024-09-22T08:36:42.492 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.488+0000 7fdc0a91f800 1 --2- 172.21.15.142:0/1672198696 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f37b6717f0 0x55f37b760d20 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:42.492 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.488+0000 7fdc0a91f800 1 -- 172.21.15.142:0/1672198696 >> 172.21.15.142:0/1672198696 conn(0x55f37b66cbe0 msgr2=0x55f37b75c6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:42.492 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.488+0000 7fdc0a91f800 1 -- 172.21.15.142:0/1672198696 shutdown_connections 2024-09-22T08:36:42.492 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.488+0000 7fdc0a91f800 1 -- 172.21.15.142:0/1672198696 wait complete. 2024-09-22T08:36:42.492 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.488+0000 7fdc0a91f800 1 Processor -- start 2024-09-22T08:36:42.493 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.488+0000 7fdc0a91f800 1 -- start start 2024-09-22T08:36:42.493 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.488+0000 7fdc0a91f800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f37b6717f0 0x55f37b5e6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:42.493 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.488+0000 7fdc0a91f800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55f37b678ad0 con 0x55f37b6717f0 2024-09-22T08:36:42.493 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.488+0000 7fdc06592640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f37b6717f0 0x55f37b5e6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:42.493 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.488+0000 7fdc06592640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f37b6717f0 0x55f37b5e6100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:37816/0 (socket says 172.21.15.142:37816) 2024-09-22T08:36:42.493 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.488+0000 7fdc06592640 1 -- 172.21.15.142:0/426014490 learned_addr learned my addr 172.21.15.142:0/426014490 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:42.493 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.489+0000 7fdc06592640 1 -- 172.21.15.142:0/426014490 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f37b5e6660 con 0x55f37b6717f0 2024-09-22T08:36:42.493 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.489+0000 7fdc06592640 1 --2- 172.21.15.142:0/426014490 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f37b6717f0 0x55f37b5e6100 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fdbf80012f0 tx=0x7fdbf8000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:42.493 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.489+0000 7fdaf2e05640 1 -- 172.21.15.142:0/426014490 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdbf800f9d0 con 0x55f37b6717f0 2024-09-22T08:36:42.493 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.489+0000 7fdaf2e05640 1 -- 172.21.15.142:0/426014490 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdbf800fb70 con 0x55f37b6717f0 2024-09-22T08:36:42.493 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.489+0000 7fdc0a91f800 1 -- 172.21.15.142:0/426014490 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f37b76c570 con 0x55f37b6717f0 2024-09-22T08:36:42.493 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.489+0000 7fdaf2e05640 1 -- 172.21.15.142:0/426014490 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdbf800fe50 con 0x55f37b6717f0 2024-09-22T08:36:42.493 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.489+0000 7fdc0a91f800 1 -- 172.21.15.142:0/426014490 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f37b76cb30 con 0x55f37b6717f0 2024-09-22T08:36:42.493 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.490+0000 7fdaf2e05640 1 -- 172.21.15.142:0/426014490 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fdbf8017040 con 0x55f37b6717f0 2024-09-22T08:36:42.497 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.490+0000 7fdaf2e05640 1 --2- 172.21.15.142:0/426014490 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fdaec03d1a0 0x7fdaec03f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:42.497 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.490+0000 7fdaf2e05640 1 -- 172.21.15.142:0/426014490 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fdbf8015020 con 0x55f37b6717f0 2024-09-22T08:36:42.497 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.490+0000 7fdc05d91640 1 --2- 172.21.15.142:0/426014490 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fdaec03d1a0 0x7fdaec03f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:42.497 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.490+0000 7fdc0a91f800 1 --2- 172.21.15.142:0/426014490 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55f37b672c00 0x55f37b770b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:42.497 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.490+0000 7fdc0a91f800 1 -- 172.21.15.142:0/426014490 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f37b771140 con 0x55f37b672c00 2024-09-22T08:36:42.497 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.490+0000 7fdc06d93640 1 --2- 172.21.15.142:0/426014490 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55f37b672c00 0x55f37b770b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:42.497 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.490+0000 7fdc05d91640 1 --2- 172.21.15.142:0/426014490 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fdaec03d1a0 0x7fdaec03f660 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fdbf0057000 tx=0x7fdbf0052000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:42.497 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.491+0000 7fdc06d93640 1 --2- 172.21.15.142:0/426014490 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55f37b672c00 0x55f37b770b20 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:42.497 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.491+0000 7fdc06d93640 1 -- 172.21.15.142:0/426014490 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdc0000a4d0 con 0x55f37b672c00 2024-09-22T08:36:42.497 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.491+0000 7fdc0a91f800 1 -- 172.21.15.142:0/426014490 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f37b76df70 con 0x55f37b672c00 2024-09-22T08:36:42.497 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.491+0000 7fdc06d93640 1 -- 172.21.15.142:0/426014490 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fdc0000a4d0 con 0x55f37b672c00 2024-09-22T08:36:42.497 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.491+0000 7fdc0a91f800 1 --2- 172.21.15.142:0/426014490 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55f37b773490 0x55f37b775880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:42.498 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.491+0000 7fdc0a91f800 1 -- 172.21.15.142:0/426014490 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:3 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f37b775f50 con 0x55f37b773490 2024-09-22T08:36:42.498 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.491+0000 7fdc06592640 1 --2- 172.21.15.142:0/426014490 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55f37b773490 0x55f37b775880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:42.498 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.492+0000 7fdc06592640 1 --2- 172.21.15.142:0/426014490 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55f37b773490 0x55f37b775880 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:42.498 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.492+0000 7fdc06592640 1 -- 172.21.15.142:0/426014490 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(3 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fdbf802d070 con 0x55f37b773490 2024-09-22T08:36:42.498 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.492+0000 7fdc0a91f800 1 -- 172.21.15.142:0/426014490 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f37b772330 con 0x55f37b672c00 2024-09-22T08:36:42.498 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.492+0000 7fdc06d93640 1 -- 172.21.15.142:0/426014490 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fdc0000a4d0 con 0x55f37b672c00 2024-09-22T08:36:42.498 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.492+0000 7fdc0a91f800 1 -- 172.21.15.142:0/426014490 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f37b7727d0 con 0x55f37b773490 2024-09-22T08:36:42.498 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.492+0000 7fdc06592640 1 -- 172.21.15.142:0/426014490 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(5 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fdbf802d070 con 0x55f37b773490 2024-09-22T08:36:42.498 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.493+0000 7fdc0a91f800 1 Processor -- start 2024-09-22T08:36:42.498 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.493+0000 7fdc0a91f800 1 -- start start 2024-09-22T08:36:42.498 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.493+0000 7fdc0a91f800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f37b7848c0 0x55f37b784ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:42.498 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.493+0000 7fdc0a91f800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55f37b569d50 con 0x55f37b7848c0 2024-09-22T08:36:42.498 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.493+0000 7fdc06d93640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f37b7848c0 0x55f37b784ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:42.498 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.493+0000 7fdc06d93640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f37b7848c0 0x55f37b784ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:37832/0 (socket says 172.21.15.142:37832) 2024-09-22T08:36:42.499 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.493+0000 7fdc06d93640 1 -- 172.21.15.142:0/2573063703 learned_addr learned my addr 172.21.15.142:0/2573063703 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:42.499 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.494+0000 7fdc06d93640 1 -- 172.21.15.142:0/2573063703 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f37b785320 con 0x55f37b7848c0 2024-09-22T08:36:42.499 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.494+0000 7fdc06d93640 1 --2- 172.21.15.142:0/2573063703 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f37b7848c0 0x55f37b784ce0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x55f37b5e5ca0 tx=0x7fdc000167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:42.499 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.494+0000 7fdaebfff640 1 -- 172.21.15.142:0/2573063703 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc00013640 con 0x55f37b7848c0 2024-09-22T08:36:42.499 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.494+0000 7fdaebfff640 1 -- 172.21.15.142:0/2573063703 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc000137e0 con 0x55f37b7848c0 2024-09-22T08:36:42.499 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.494+0000 7fdc0a91f800 1 -- 172.21.15.142:0/2573063703 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f37b785b50 con 0x55f37b7848c0 2024-09-22T08:36:42.499 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.494+0000 7fdaebfff640 1 -- 172.21.15.142:0/2573063703 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc00013ae0 con 0x55f37b7848c0 2024-09-22T08:36:42.499 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.494+0000 7fdc0a91f800 1 -- 172.21.15.142:0/2573063703 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f37b7860f0 con 0x55f37b7848c0 2024-09-22T08:36:42.499 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.495+0000 7fdaebfff640 1 -- 172.21.15.142:0/2573063703 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fdc00011040 con 0x55f37b7848c0 2024-09-22T08:36:42.509 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.495+0000 7fdaebfff640 1 --2- 172.21.15.142:0/2573063703 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fdae003cfb0 0x7fdae003f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:42.509 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.495+0000 7fdaebfff640 1 -- 172.21.15.142:0/2573063703 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fdc0000e040 con 0x55f37b7848c0 2024-09-22T08:36:42.509 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.495+0000 7fdc06592640 1 --2- 172.21.15.142:0/2573063703 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fdae003cfb0 0x7fdae003f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:42.509 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.495+0000 7fdc0a91f800 1 Processor -- start 2024-09-22T08:36:42.509 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.495+0000 7fdc06592640 1 --2- 172.21.15.142:0/2573063703 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fdae003cfb0 0x7fdae003f470 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fdbf80531e0 tx=0x7fdbf80011b0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:42.509 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.495+0000 7fdc0a91f800 1 -- start start 2024-09-22T08:36:42.509 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.496+0000 7fdc0a91f800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f37b791380 0x55f37b791780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:42.509 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.496+0000 7fdc0a91f800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55f37b761740 con 0x55f37b791380 2024-09-22T08:36:42.510 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.496+0000 7fdc06d93640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f37b791380 0x55f37b791780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:42.510 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.496+0000 7fdc06d93640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f37b791380 0x55f37b791780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:37844/0 (socket says 172.21.15.142:37844) 2024-09-22T08:36:42.510 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.496+0000 7fdc06d93640 1 -- 172.21.15.142:0/4294066330 learned_addr learned my addr 172.21.15.142:0/4294066330 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:42.510 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.496+0000 7fdc06d93640 1 -- 172.21.15.142:0/4294066330 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f37b791d70 con 0x55f37b791380 2024-09-22T08:36:42.510 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.496+0000 7fdc06d93640 1 --2- 172.21.15.142:0/4294066330 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f37b791380 0x55f37b791780 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fdc00054840 tx=0x7fdc00014480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1daef7031cfa919d server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:42.510 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.496+0000 7fdae9ffb640 1 -- 172.21.15.142:0/4294066330 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc00021910 con 0x55f37b791380 2024-09-22T08:36:42.510 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.496+0000 7fdae9ffb640 1 -- 172.21.15.142:0/4294066330 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc00052070 con 0x55f37b791380 2024-09-22T08:36:42.510 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.496+0000 7fdae9ffb640 1 -- 172.21.15.142:0/4294066330 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc00021440 con 0x55f37b791380 2024-09-22T08:36:42.510 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.497+0000 7fdc0a91f800 1 -- 172.21.15.142:0/4294066330 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f37b791380 msgr2=0x55f37b791780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:42.510 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.497+0000 7fdc0a91f800 1 --2- 172.21.15.142:0/4294066330 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f37b791380 0x55f37b791780 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fdc00054840 tx=0x7fdc00014480 comp rx=0 tx=0).stop 2024-09-22T08:36:42.510 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.497+0000 7fdc0a91f800 1 -- 172.21.15.142:0/4294066330 shutdown_connections 2024-09-22T08:36:42.510 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.497+0000 7fdc0a91f800 1 --2- 172.21.15.142:0/4294066330 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f37b791380 0x55f37b791780 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:42.510 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.497+0000 7fdc0a91f800 1 -- 172.21.15.142:0/4294066330 >> 172.21.15.142:0/4294066330 conn(0x55f37b78d780 msgr2=0x55f37b78b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:42.511 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.497+0000 7fdc0a91f800 1 -- 172.21.15.142:0/4294066330 shutdown_connections 2024-09-22T08:36:42.511 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.497+0000 7fdc0a91f800 1 -- 172.21.15.142:0/4294066330 wait complete. 2024-09-22T08:36:42.511 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.497+0000 7fdc0a91f800 1 Processor -- start 2024-09-22T08:36:42.511 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.497+0000 7fdc0a91f800 1 -- start start 2024-09-22T08:36:42.511 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.497+0000 7fdc0a91f800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f37b791380 0x55f37b769c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:42.511 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.497+0000 7fdc0a91f800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55f37b792360 con 0x55f37b791380 2024-09-22T08:36:42.511 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.497+0000 7fdc06d93640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f37b791380 0x55f37b769c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:42.511 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.497+0000 7fdc06d93640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f37b791380 0x55f37b769c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:37860/0 (socket says 172.21.15.142:37860) 2024-09-22T08:36:42.511 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.497+0000 7fdc06d93640 1 -- 172.21.15.142:0/1062650793 learned_addr learned my addr 172.21.15.142:0/1062650793 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:42.511 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.498+0000 7fdc06d93640 1 -- 172.21.15.142:0/1062650793 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f37b76a1e0 con 0x55f37b791380 2024-09-22T08:36:42.511 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.498+0000 7fdc06d93640 1 --2- 172.21.15.142:0/1062650793 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f37b791380 0x55f37b769c80 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fdc00054740 tx=0x7fdc000547a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:42.511 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.498+0000 7fdad7fff640 1 -- 172.21.15.142:0/1062650793 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc00013c80 con 0x55f37b791380 2024-09-22T08:36:42.511 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.498+0000 7fdad7fff640 1 -- 172.21.15.142:0/1062650793 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc00013e40 con 0x55f37b791380 2024-09-22T08:36:42.512 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.498+0000 7fdc0a91f800 1 -- 172.21.15.142:0/1062650793 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f37b768590 con 0x55f37b791380 2024-09-22T08:36:42.512 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.498+0000 7fdad7fff640 1 -- 172.21.15.142:0/1062650793 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc00045b50 con 0x55f37b791380 2024-09-22T08:36:42.512 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.498+0000 7fdc0a91f800 1 -- 172.21.15.142:0/1062650793 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f37b768b30 con 0x55f37b791380 2024-09-22T08:36:42.512 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.499+0000 7fdad7fff640 1 -- 172.21.15.142:0/1062650793 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fdc00045cf0 con 0x55f37b791380 2024-09-22T08:36:42.512 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.499+0000 7fdad7fff640 1 --2- 172.21.15.142:0/1062650793 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fdad003d000 0x7fdad003f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:42.512 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.499+0000 7fdad7fff640 1 -- 172.21.15.142:0/1062650793 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fdc00022000 con 0x55f37b791380 2024-09-22T08:36:42.512 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.499+0000 7fdc06592640 1 --2- 172.21.15.142:0/1062650793 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fdad003d000 0x7fdad003f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:42.512 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.499+0000 7fdc0a91f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:42.512 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.499+0000 7fdc0a91f800 1 --2- 172.21.15.142:0/1062650793 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55f37b7a63d0 0x55f37b7a8890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:42.512 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.499+0000 7fdc0a91f800 1 -- 172.21.15.142:0/1062650793 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f37b7a8fe0 con 0x55f37b7a63d0 2024-09-22T08:36:42.512 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.499+0000 7fdc05d91640 1 --2- 172.21.15.142:0/1062650793 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55f37b7a63d0 0x55f37b7a8890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:42.512 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.499+0000 7fdc06592640 1 --2- 172.21.15.142:0/1062650793 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fdad003d000 0x7fdad003f4c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fdbf800efd0 tx=0x7fdbf8041000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:42.512 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.500+0000 7fdc05d91640 1 --2- 172.21.15.142:0/1062650793 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55f37b7a63d0 0x55f37b7a8890 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:42.513 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.500+0000 7fdc05d91640 1 -- 172.21.15.142:0/1062650793 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdbf0057030 con 0x55f37b7a63d0 2024-09-22T08:36:42.513 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.500+0000 7fdc0a91f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:42.513 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.500+0000 7fdc0a91f800 20 realm 2024-09-22T08:36:42.513 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.500+0000 7fdc0a91f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:42.513 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.500+0000 7fdc0a91f800 1 -- 172.21.15.142:0/1062650793 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f37b7a9410 con 0x55f37b7a63d0 2024-09-22T08:36:42.513 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.500+0000 7fdc05d91640 1 -- 172.21.15.142:0/1062650793 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdbf0057030 con 0x55f37b7a63d0 2024-09-22T08:36:42.513 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.500+0000 7fdc0a91f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:42.513 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.500+0000 7fdc0a91f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:36:42.513 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.500+0000 7fdc0a91f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:42.513 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.500+0000 7fdc0a91f800 1 -- 172.21.15.142:0/1062650793 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f37b7a9ce0 con 0x55f37b7a63d0 2024-09-22T08:36:42.513 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.500+0000 7fdc05d91640 1 -- 172.21.15.142:0/1062650793 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdbf0057030 con 0x55f37b7a63d0 2024-09-22T08:36:42.513 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.500+0000 7fdc0a91f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:42.513 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.500+0000 7fdc0a91f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:42.514 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.500+0000 7fdc0a91f800 1 -- 172.21.15.142:0/1062650793 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f37b7aa080 con 0x55f37b7a63d0 2024-09-22T08:36:42.514 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.501+0000 7fdc05d91640 1 -- 172.21.15.142:0/1062650793 <== osd.1 v2:172.21.15.142:6816/3192108003 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fdbf0057030 con 0x55f37b7a63d0 2024-09-22T08:36:42.514 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.501+0000 7fdc0a91f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:36:42.514 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.501+0000 7fdc0a91f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:42.514 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.501+0000 7fdc0a91f800 1 --2- 172.21.15.142:0/1062650793 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55f37b7aade0 0x55f37b7ad1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:42.514 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.501+0000 7fdc0a91f800 1 -- 172.21.15.142:0/1062650793 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f37b7ad710 con 0x55f37b7aade0 2024-09-22T08:36:42.514 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.501+0000 7fdc06d93640 1 --2- 172.21.15.142:0/1062650793 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55f37b7aade0 0x55f37b7ad1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:42.514 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.501+0000 7fdc06d93640 1 --2- 172.21.15.142:0/1062650793 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55f37b7aade0 0x55f37b7ad1d0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:42.514 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.501+0000 7fdc06d93640 1 -- 172.21.15.142:0/1062650793 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(5 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fdc0000a4d0 con 0x55f37b7aade0 2024-09-22T08:36:42.514 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.501+0000 7fdc0a91f800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:36:42.514 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.501+0000 7fdc0a91f800 20 searching for the correct realm 2024-09-22T08:36:42.514 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.501+0000 7fdc0a91f800 1 -- 172.21.15.142:0/1062650793 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f37b7af080 con 0x55f37b7aade0 2024-09-22T08:36:42.514 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.501+0000 7fdc06d93640 1 -- 172.21.15.142:0/1062650793 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc0000a4d0 con 0x55f37b7aade0 2024-09-22T08:36:42.514 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.501+0000 7fdc06d93640 1 --2- 172.21.15.142:0/1062650793 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7fdc00054c20 0x7fdc0004d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:42.515 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.501+0000 7fdc06d93640 1 -- 172.21.15.142:0/1062650793 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f37b7af080 con 0x7fdc00054c20 2024-09-22T08:36:42.515 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.502+0000 7fdc06592640 1 --2- 172.21.15.142:0/1062650793 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7fdc00054c20 0x7fdc0004d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:42.515 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.502+0000 7fdc06592640 1 --2- 172.21.15.142:0/1062650793 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7fdc00054c20 0x7fdc0004d7b0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:42.515 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.502+0000 7fdc06592640 1 -- 172.21.15.142:0/1062650793 <== osd.2 v2:172.21.15.142:6808/279438927 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdbf8039070 con 0x7fdc00054c20 2024-09-22T08:36:42.515 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.502+0000 7fdc06592640 1 --2- 172.21.15.142:0/1062650793 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7fdbf80541f0 0x7fdbf8054610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:42.515 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.502+0000 7fdc06592640 1 -- 172.21.15.142:0/1062650793 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f37b7af080 con 0x7fdbf80541f0 2024-09-22T08:36:42.515 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.502+0000 7fdc05d91640 1 --2- 172.21.15.142:0/1062650793 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7fdbf80541f0 0x7fdbf8054610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:42.515 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.503+0000 7fdc05d91640 1 --2- 172.21.15.142:0/1062650793 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7fdbf80541f0 0x7fdbf8054610 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:42.515 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.503+0000 7fdc05d91640 1 -- 172.21.15.142:0/1062650793 <== osd.0 v2:172.21.15.31:6800/168281188 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdbf0057030 con 0x7fdbf80541f0 2024-09-22T08:36:42.515 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.503+0000 7fdc05d91640 1 -- 172.21.15.142:0/1062650793 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f37b7af080 con 0x55f37b7a63d0 2024-09-22T08:36:42.515 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.503+0000 7fdc05d91640 1 -- 172.21.15.142:0/1062650793 <== osd.1 v2:172.21.15.142:6816/3192108003 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdbf0057030 con 0x55f37b7a63d0 2024-09-22T08:36:42.515 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.503+0000 7fdc05d91640 1 -- 172.21.15.142:0/1062650793 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f37b7af080 con 0x55f37b7a63d0 2024-09-22T08:36:42.515 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.504+0000 7fdc05d91640 1 -- 172.21.15.142:0/1062650793 <== osd.1 v2:172.21.15.142:6816/3192108003 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdbf0057030 con 0x55f37b7a63d0 2024-09-22T08:36:42.516 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.504+0000 7fdc05d91640 1 -- 172.21.15.142:0/1062650793 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f37b7af080 con 0x7fdbf80541f0 2024-09-22T08:36:42.516 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.504+0000 7fdc05d91640 1 -- 172.21.15.142:0/1062650793 <== osd.0 v2:172.21.15.31:6800/168281188 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdbf0057030 con 0x7fdbf80541f0 2024-09-22T08:36:42.516 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.504+0000 7fdc05d91640 1 -- 172.21.15.142:0/1062650793 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f37b7af080 con 0x7fdbf80541f0 2024-09-22T08:36:42.516 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.504+0000 7fdc05d91640 1 -- 172.21.15.142:0/1062650793 <== osd.0 v2:172.21.15.31:6800/168281188 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdbf0057030 con 0x7fdbf80541f0 2024-09-22T08:36:42.516 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.504+0000 7fdc05d91640 1 -- 172.21.15.142:0/1062650793 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f37b7af080 con 0x7fdc00054c20 2024-09-22T08:36:42.516 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.504+0000 7fdc06592640 1 -- 172.21.15.142:0/1062650793 <== osd.2 v2:172.21.15.142:6808/279438927 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdbf8039070 con 0x7fdc00054c20 2024-09-22T08:36:42.516 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.504+0000 7fdc06592640 1 -- 172.21.15.142:0/1062650793 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f37b7af080 con 0x55f37b7aade0 2024-09-22T08:36:42.516 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.505+0000 7fdc06d93640 1 -- 172.21.15.142:0/1062650793 <== osd.3 v2:172.21.15.142:6800/1064901393 3 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc0000a4d0 con 0x55f37b7aade0 2024-09-22T08:36:42.516 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.505+0000 7fdc06d93640 1 -- 172.21.15.142:0/1062650793 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f37b7af080 con 0x55f37b7a63d0 2024-09-22T08:36:42.516 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.505+0000 7fdc05d91640 1 -- 172.21.15.142:0/1062650793 <== osd.1 v2:172.21.15.142:6816/3192108003 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdbf0057030 con 0x55f37b7a63d0 2024-09-22T08:36:42.516 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.505+0000 7fdc05d91640 1 -- 172.21.15.142:0/1062650793 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f37b7af080 con 0x7fdbf80541f0 2024-09-22T08:36:42.516 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.505+0000 7fdc05d91640 1 -- 172.21.15.142:0/1062650793 <== osd.0 v2:172.21.15.31:6800/168281188 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdbf0057030 con 0x7fdbf80541f0 2024-09-22T08:36:42.516 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.505+0000 7fdc05d91640 1 -- 172.21.15.142:0/1062650793 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f37b7af080 con 0x55f37b7a63d0 2024-09-22T08:36:42.516 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.505+0000 7fdc05d91640 1 -- 172.21.15.142:0/1062650793 <== osd.1 v2:172.21.15.142:6816/3192108003 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdbf0057030 con 0x55f37b7a63d0 2024-09-22T08:36:42.517 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.505+0000 7fdc05d91640 1 -- 172.21.15.142:0/1062650793 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f37b7af080 con 0x7fdc00054c20 2024-09-22T08:36:42.517 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.505+0000 7fdc06592640 1 -- 172.21.15.142:0/1062650793 <== osd.2 v2:172.21.15.142:6808/279438927 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fdbf8039070 con 0x7fdc00054c20 2024-09-22T08:36:42.517 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.505+0000 7fdc06592640 1 -- 172.21.15.142:0/1062650793 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f37b7af080 con 0x55f37b7aade0 2024-09-22T08:36:42.517 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.506+0000 7fdc06d93640 1 -- 172.21.15.142:0/1062650793 <== osd.3 v2:172.21.15.142:6800/1064901393 4 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc0000a4d0 con 0x55f37b7aade0 2024-09-22T08:36:42.517 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.506+0000 7fdc06d93640 1 -- 172.21.15.142:0/1062650793 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f37b7af080 con 0x55f37b7aade0 2024-09-22T08:36:42.517 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.506+0000 7fdc06d93640 1 -- 172.21.15.142:0/1062650793 <== osd.3 v2:172.21.15.142:6800/1064901393 5 ==== osd_op_reply(20 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fdc0000a4d0 con 0x55f37b7aade0 2024-09-22T08:36:42.517 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.506+0000 7fdc06d93640 1 -- 172.21.15.142:0/1062650793 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f37b7af080 con 0x7fdbf80541f0 2024-09-22T08:36:42.517 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.506+0000 7fdc05d91640 1 -- 172.21.15.142:0/1062650793 <== osd.0 v2:172.21.15.31:6800/168281188 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdbf0057030 con 0x7fdbf80541f0 2024-09-22T08:36:42.517 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.506+0000 7fdc05d91640 1 -- 172.21.15.142:0/1062650793 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f37b7af080 con 0x55f37b7aade0 2024-09-22T08:36:42.517 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.506+0000 7fdc06d93640 1 -- 172.21.15.142:0/1062650793 <== osd.3 v2:172.21.15.142:6800/1064901393 6 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc0000a4d0 con 0x55f37b7aade0 2024-09-22T08:36:42.517 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.506+0000 7fdc06d93640 1 -- 172.21.15.142:0/1062650793 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f37b7af080 con 0x55f37b7aade0 2024-09-22T08:36:42.517 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.507+0000 7fdc06d93640 1 -- 172.21.15.142:0/1062650793 <== osd.3 v2:172.21.15.142:6800/1064901393 7 ==== osd_op_reply(23 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fdc0000a4d0 con 0x55f37b7aade0 2024-09-22T08:36:42.517 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.507+0000 7fdc06d93640 1 -- 172.21.15.142:0/1062650793 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f37b7af080 con 0x55f37b7a63d0 2024-09-22T08:36:42.518 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.507+0000 7fdc05d91640 1 -- 172.21.15.142:0/1062650793 <== osd.1 v2:172.21.15.142:6816/3192108003 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdbf0057030 con 0x55f37b7a63d0 2024-09-22T08:36:42.518 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.507+0000 7fdc05d91640 1 -- 172.21.15.142:0/1062650793 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f37b7af080 con 0x55f37b7a63d0 2024-09-22T08:36:42.518 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.507+0000 7fdc05d91640 1 -- 172.21.15.142:0/1062650793 <== osd.1 v2:172.21.15.142:6816/3192108003 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fdbf0057030 con 0x55f37b7a63d0 2024-09-22T08:36:42.518 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.507+0000 7fdc05d91640 1 -- 172.21.15.142:0/1062650793 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f37b7af080 con 0x7fdbf80541f0 2024-09-22T08:36:42.525 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.507+0000 7fdc05d91640 1 -- 172.21.15.142:0/1062650793 <== osd.0 v2:172.21.15.31:6800/168281188 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdbf0057030 con 0x7fdbf80541f0 2024-09-22T08:36:42.525 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.507+0000 7fdc05d91640 1 -- 172.21.15.142:0/1062650793 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f37b7af080 con 0x55f37b7aade0 2024-09-22T08:36:42.525 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.508+0000 7fdc06d93640 1 -- 172.21.15.142:0/1062650793 <== osd.3 v2:172.21.15.142:6800/1064901393 8 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc0000a4d0 con 0x55f37b7aade0 2024-09-22T08:36:42.525 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.508+0000 7fdc06d93640 1 -- 172.21.15.142:0/1062650793 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f37b7af080 con 0x7fdc00054c20 2024-09-22T08:36:42.525 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.508+0000 7fdc06592640 1 -- 172.21.15.142:0/1062650793 <== osd.2 v2:172.21.15.142:6808/279438927 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdbf8039070 con 0x7fdc00054c20 2024-09-22T08:36:42.525 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.508+0000 7fdc06592640 1 -- 172.21.15.142:0/1062650793 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f37b7af080 con 0x55f37b7a63d0 2024-09-22T08:36:42.525 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.508+0000 7fdc05d91640 1 -- 172.21.15.142:0/1062650793 <== osd.1 v2:172.21.15.142:6816/3192108003 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdbf0057030 con 0x55f37b7a63d0 2024-09-22T08:36:42.525 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.508+0000 7fdc05d91640 1 -- 172.21.15.142:0/1062650793 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f37b7af080 con 0x7fdbf80541f0 2024-09-22T08:36:42.525 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.508+0000 7fdc05d91640 1 -- 172.21.15.142:0/1062650793 <== osd.0 v2:172.21.15.31:6800/168281188 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdbf0057030 con 0x7fdbf80541f0 2024-09-22T08:36:42.526 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.508+0000 7fdc05d91640 1 -- 172.21.15.142:0/1062650793 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f37b7af080 con 0x55f37b7aade0 2024-09-22T08:36:42.526 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.508+0000 7fdc06d93640 1 -- 172.21.15.142:0/1062650793 <== osd.3 v2:172.21.15.142:6800/1064901393 9 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc0000a4d0 con 0x55f37b7aade0 2024-09-22T08:36:42.526 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.509+0000 7fdc06d93640 1 -- 172.21.15.142:0/1062650793 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f37b7af080 con 0x7fdbf80541f0 2024-09-22T08:36:42.526 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.509+0000 7fdc05d91640 1 -- 172.21.15.142:0/1062650793 <== osd.0 v2:172.21.15.31:6800/168281188 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdbf0057030 con 0x7fdbf80541f0 2024-09-22T08:36:42.526 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.509+0000 7fdc05d91640 1 -- 172.21.15.142:0/1062650793 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f37b7af080 con 0x7fdc00054c20 2024-09-22T08:36:42.526 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.509+0000 7fdc06592640 1 -- 172.21.15.142:0/1062650793 <== osd.2 v2:172.21.15.142:6808/279438927 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdbf8039070 con 0x7fdc00054c20 2024-09-22T08:36:42.526 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.509+0000 7fdc06592640 1 -- 172.21.15.142:0/1062650793 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f37b7af080 con 0x55f37b7aade0 2024-09-22T08:36:42.526 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.509+0000 7fdc06d93640 1 -- 172.21.15.142:0/1062650793 <== osd.3 v2:172.21.15.142:6800/1064901393 10 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc0000a4d0 con 0x55f37b7aade0 2024-09-22T08:36:42.526 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.509+0000 7fdc06d93640 1 -- 172.21.15.142:0/1062650793 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f37b7af080 con 0x7fdbf80541f0 2024-09-22T08:36:42.526 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.509+0000 7fdc05d91640 1 -- 172.21.15.142:0/1062650793 <== osd.0 v2:172.21.15.31:6800/168281188 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdbf0057030 con 0x7fdbf80541f0 2024-09-22T08:36:42.526 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.510+0000 7fdc05d91640 1 -- 172.21.15.142:0/1062650793 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f37b7af080 con 0x55f37b7a63d0 2024-09-22T08:36:42.526 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.510+0000 7fdc05d91640 1 -- 172.21.15.142:0/1062650793 <== osd.1 v2:172.21.15.142:6816/3192108003 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fdbf0057030 con 0x55f37b7a63d0 2024-09-22T08:36:42.526 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.510+0000 7fdc05d91640 1 -- 172.21.15.142:0/1062650793 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f37b7af080 con 0x7fdc00054c20 2024-09-22T08:36:42.527 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.510+0000 7fdc06592640 1 -- 172.21.15.142:0/1062650793 <== osd.2 v2:172.21.15.142:6808/279438927 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdbf8039070 con 0x7fdc00054c20 2024-09-22T08:36:42.527 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.510+0000 7fdc0a91f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:36:42.527 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.510+0000 7fdc0a91f800 20 RGWRados::pool_iterate: got zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec 2024-09-22T08:36:42.527 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.510+0000 7fdc0a91f800 20 RGWRados::pool_iterate: got zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f 2024-09-22T08:36:42.527 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.510+0000 7fdc0a91f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:36:42.527 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.510+0000 7fdc0a91f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:36:42.527 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.510+0000 7fdc0a91f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:36:42.527 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.510+0000 7fdc0a91f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:42.527 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.510+0000 7fdc0a91f800 1 -- 172.21.15.142:0/1062650793 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f37b7ae150 con 0x55f37b7a63d0 2024-09-22T08:36:42.527 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.510+0000 7fdc05d91640 1 -- 172.21.15.142:0/1062650793 <== osd.1 v2:172.21.15.142:6816/3192108003 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdbf0057030 con 0x55f37b7a63d0 2024-09-22T08:36:42.527 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.510+0000 7fdc0a91f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:42.527 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.510+0000 7fdc0a91f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:42.527 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.510+0000 7fdc0a91f800 1 -- 172.21.15.142:0/1062650793 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f37b7ae9f0 con 0x55f37b7a63d0 2024-09-22T08:36:42.528 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.510+0000 7fdc05d91640 1 -- 172.21.15.142:0/1062650793 <== osd.1 v2:172.21.15.142:6816/3192108003 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fdbf0057030 con 0x55f37b7a63d0 2024-09-22T08:36:42.528 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.510+0000 7fdc0a91f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:36:42.528 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.510+0000 7fdc0a91f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:42.528 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.510+0000 7fdc0a91f800 1 -- 172.21.15.142:0/1062650793 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:40 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f37b7add90 con 0x55f37b7aade0 2024-09-22T08:36:42.528 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.511+0000 7fdc06d93640 1 -- 172.21.15.142:0/1062650793 <== osd.3 v2:172.21.15.142:6800/1064901393 11 ==== osd_op_reply(40 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fdc0000a4d0 con 0x55f37b7aade0 2024-09-22T08:36:42.528 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.511+0000 7fdc0a91f800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:36:42.528 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.511+0000 7fdc0a91f800 20 zone default found 2024-09-22T08:36:42.528 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.511+0000 7fdc0a91f800 4 Realm: () 2024-09-22T08:36:42.528 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.511+0000 7fdc0a91f800 4 ZoneGroup: default (d89f6f57-1007-47dd-9065-f486c7b01aec) 2024-09-22T08:36:42.528 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.511+0000 7fdc0a91f800 4 Zone: default (e239248c-0bee-4e41-803a-24b288d3eb8f) 2024-09-22T08:36:42.528 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.511+0000 7fdc0a91f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:36:42.528 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.511+0000 7fdc0a91f800 20 zonegroup default 2024-09-22T08:36:42.528 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.511+0000 7fdc0a91f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:42.528 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.511+0000 7fdc0a91f800 1 -- 172.21.15.142:0/1062650793 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f37b7ae630 con 0x7fdbf80541f0 2024-09-22T08:36:42.529 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.511+0000 7fdc05d91640 1 -- 172.21.15.142:0/1062650793 <== osd.0 v2:172.21.15.31:6800/168281188 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fdbf0057030 con 0x7fdbf80541f0 2024-09-22T08:36:42.529 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.511+0000 7fdc0a91f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:42.529 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.511+0000 7fdc0a91f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:42.529 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.511+0000 7fdc0a91f800 1 -- 172.21.15.142:0/1062650793 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f37b7b1920 con 0x55f37b7aade0 2024-09-22T08:36:42.529 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.511+0000 7fdc06d93640 1 -- 172.21.15.142:0/1062650793 <== osd.3 v2:172.21.15.142:6800/1064901393 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fdc0000a4d0 con 0x55f37b7aade0 2024-09-22T08:36:42.529 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.511+0000 7fdc0a91f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:42.529 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.511+0000 7fdc0a91f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:42.529 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.511+0000 7fdc0a91f800 1 -- 172.21.15.142:0/1062650793 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f37b7b1cf0 con 0x55f37b7aade0 2024-09-22T08:36:42.529 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.512+0000 7fdc06d93640 1 -- 172.21.15.142:0/1062650793 <== osd.3 v2:172.21.15.142:6800/1064901393 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fdc0000a4d0 con 0x55f37b7aade0 2024-09-22T08:36:42.529 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.512+0000 7fdc0a91f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:42.529 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.512+0000 7fdc0a91f800 20 started sync module instance, tier type = 2024-09-22T08:36:42.529 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.512+0000 7fdc0a91f800 20 started zone id=e239248c-0bee-4e41-803a-24b288d3eb8f (name=default) with tier type = 2024-09-22T08:36:42.529 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.512+0000 7fdc0a91f800 1 -- 172.21.15.142:0/1062650793 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f37b7b0d60 con 0x7fdc00054c20 2024-09-22T08:36:42.529 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.513+0000 7fdc06592640 1 -- 172.21.15.142:0/1062650793 <== osd.2 v2:172.21.15.142:6808/279438927 7 ==== osd_op_reply(44 notify.0 [create] v30'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdbf8039070 con 0x7fdc00054c20 2024-09-22T08:36:42.530 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.513+0000 7fdc0a91f800 1 -- 172.21.15.142:0/1062650793 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94504237074608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f37b7b2150 con 0x7fdc00054c20 2024-09-22T08:36:42.530 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.513+0000 7fdc0a91f800 1 -- 172.21.15.142:0/1062650793 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f37b7b29a0 con 0x55f37b7a63d0 2024-09-22T08:36:42.530 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.514+0000 7fdc06592640 1 -- 172.21.15.142:0/1062650793 <== osd.2 v2:172.21.15.142:6808/279438927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94504237074608] v30'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdbf8039070 con 0x7fdc00054c20 2024-09-22T08:36:42.530 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.514+0000 7fdc05d91640 1 -- 172.21.15.142:0/1062650793 <== osd.1 v2:172.21.15.142:6816/3192108003 15 ==== osd_op_reply(46 notify.1 [create] v30'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdbf0057030 con 0x55f37b7a63d0 2024-09-22T08:36:42.530 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.514+0000 7fdc0a91f800 1 -- 172.21.15.142:0/1062650793 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94504237081840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f37b7b2dc0 con 0x55f37b7a63d0 2024-09-22T08:36:42.530 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.514+0000 7fdc0a91f800 1 -- 172.21.15.142:0/1062650793 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f37b7b3670 con 0x55f37b7aade0 2024-09-22T08:36:42.530 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.515+0000 7fdc05d91640 1 -- 172.21.15.142:0/1062650793 <== osd.1 v2:172.21.15.142:6816/3192108003 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94504237081840] v30'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdbf0057030 con 0x55f37b7a63d0 2024-09-22T08:36:42.530 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.515+0000 7fdc06d93640 1 -- 172.21.15.142:0/1062650793 <== osd.3 v2:172.21.15.142:6800/1064901393 14 ==== osd_op_reply(48 notify.2 [create] v30'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc0000a4d0 con 0x55f37b7aade0 2024-09-22T08:36:42.530 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.515+0000 7fdc0a91f800 1 -- 172.21.15.142:0/1062650793 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94504237082896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f37b7b31e0 con 0x55f37b7aade0 2024-09-22T08:36:42.530 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.515+0000 7fdc0a91f800 1 -- 172.21.15.142:0/1062650793 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f37b7b4160 con 0x7fdc00054c20 2024-09-22T08:36:42.530 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.516+0000 7fdc06592640 1 -- 172.21.15.142:0/1062650793 <== osd.2 v2:172.21.15.142:6808/279438927 9 ==== osd_op_reply(50 notify.3 [create] v30'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdbf8039070 con 0x7fdc00054c20 2024-09-22T08:36:42.530 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.516+0000 7fdc0a91f800 1 -- 172.21.15.142:0/1062650793 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94504237087792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f37b7b4a00 con 0x7fdc00054c20 2024-09-22T08:36:42.530 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.516+0000 7fdc0a91f800 1 -- 172.21.15.142:0/1062650793 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f37b7b54f0 con 0x55f37b7a63d0 2024-09-22T08:36:42.531 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.517+0000 7fdc06d93640 1 -- 172.21.15.142:0/1062650793 <== osd.3 v2:172.21.15.142:6800/1064901393 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94504237082896] v30'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc0000a4d0 con 0x55f37b7aade0 2024-09-22T08:36:42.531 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.517+0000 7fdc05d91640 1 -- 172.21.15.142:0/1062650793 <== osd.1 v2:172.21.15.142:6816/3192108003 17 ==== osd_op_reply(52 notify.4 [create] v30'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdbf0057030 con 0x55f37b7a63d0 2024-09-22T08:36:42.531 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.517+0000 7fdc0a91f800 1 -- 172.21.15.142:0/1062650793 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94504237092800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f37b7b58e0 con 0x55f37b7a63d0 2024-09-22T08:36:42.531 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.518+0000 7fdc0a91f800 1 -- 172.21.15.142:0/1062650793 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f37b7b6340 con 0x7fdbf80541f0 2024-09-22T08:36:42.531 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.518+0000 7fdc06592640 1 -- 172.21.15.142:0/1062650793 <== osd.2 v2:172.21.15.142:6808/279438927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94504237087792] v30'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdbf8039070 con 0x7fdc00054c20 2024-09-22T08:36:42.531 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.518+0000 7fdc05d91640 1 -- 172.21.15.142:0/1062650793 <== osd.0 v2:172.21.15.31:6800/168281188 11 ==== osd_op_reply(54 notify.5 [create] v30'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdbf0057030 con 0x7fdbf80541f0 2024-09-22T08:36:42.531 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.518+0000 7fdc0a91f800 1 -- 172.21.15.142:0/1062650793 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94504237090128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f37b7b6340 con 0x7fdbf80541f0 2024-09-22T08:36:42.531 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.518+0000 7fdc0a91f800 1 -- 172.21.15.142:0/1062650793 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f37b7b6d90 con 0x7fdbf80541f0 2024-09-22T08:36:42.531 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.519+0000 7fdc05d91640 1 -- 172.21.15.142:0/1062650793 <== osd.1 v2:172.21.15.142:6816/3192108003 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94504237092800] v30'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdbf0057030 con 0x55f37b7a63d0 2024-09-22T08:36:42.531 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.519+0000 7fdc05d91640 1 -- 172.21.15.142:0/1062650793 <== osd.0 v2:172.21.15.31:6800/168281188 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94504237090128] v30'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdbf0057030 con 0x7fdbf80541f0 2024-09-22T08:36:42.531 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.519+0000 7fdc05d91640 1 -- 172.21.15.142:0/1062650793 <== osd.0 v2:172.21.15.31:6800/168281188 13 ==== osd_op_reply(56 notify.6 [create] v30'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdbf0057030 con 0x7fdbf80541f0 2024-09-22T08:36:42.531 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.520+0000 7fdc0a91f800 1 -- 172.21.15.142:0/1062650793 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94504237083952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f37b7b68a0 con 0x7fdbf80541f0 2024-09-22T08:36:42.531 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.520+0000 7fdc0a91f800 1 -- 172.21.15.142:0/1062650793 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f37b7b7260 con 0x7fdbf80541f0 2024-09-22T08:36:42.531 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.520+0000 7fdc05d91640 1 -- 172.21.15.142:0/1062650793 <== osd.0 v2:172.21.15.31:6800/168281188 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94504237083952] v30'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdbf0057030 con 0x7fdbf80541f0 2024-09-22T08:36:42.532 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.523+0000 7fdc05d91640 1 -- 172.21.15.142:0/1062650793 <== osd.0 v2:172.21.15.31:6800/168281188 15 ==== osd_op_reply(58 notify.7 [create] v30'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdbf0057030 con 0x7fdbf80541f0 2024-09-22T08:36:42.532 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.523+0000 7fdc0a91f800 1 -- 172.21.15.142:0/1062650793 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94504237096480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f37b7b7260 con 0x7fdbf80541f0 2024-09-22T08:36:42.532 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.523+0000 7fdc0a91f800 20 add_watcher() i=0 2024-09-22T08:36:42.532 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.523+0000 7fdc0a91f800 20 add_watcher() i=1 2024-09-22T08:36:42.532 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.523+0000 7fdc0a91f800 20 add_watcher() i=2 2024-09-22T08:36:42.532 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.523+0000 7fdc0a91f800 20 add_watcher() i=3 2024-09-22T08:36:42.532 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.523+0000 7fdc0a91f800 20 add_watcher() i=4 2024-09-22T08:36:42.532 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.523+0000 7fdc0a91f800 20 add_watcher() i=5 2024-09-22T08:36:42.532 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.523+0000 7fdc0a91f800 20 add_watcher() i=6 2024-09-22T08:36:42.536 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.524+0000 7fdc05d91640 1 -- 172.21.15.142:0/1062650793 <== osd.0 v2:172.21.15.31:6800/168281188 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94504237096480] v30'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdbf0057030 con 0x7fdbf80541f0 2024-09-22T08:36:42.536 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.524+0000 7fdc0a91f800 20 add_watcher() i=7 2024-09-22T08:36:42.536 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.524+0000 7fdc0a91f800 2 all 8 watchers are set, enabling cache 2024-09-22T08:36:42.536 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.524+0000 7fdc0a91f800 1 -- 172.21.15.142:0/1062650793 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f37b7ba740 con 0x55f37b7a63d0 2024-09-22T08:36:42.536 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.524+0000 7fdc05d91640 1 -- 172.21.15.142:0/1062650793 <== osd.1 v2:172.21.15.142:6816/3192108003 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fdbf0057030 con 0x55f37b7a63d0 2024-09-22T08:36:42.536 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.524+0000 7fdc0a91f800 1 -- 172.21.15.142:0/1062650793 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94504237113632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f37b7b73d0 con 0x55f37b7a63d0 2024-09-22T08:36:42.536 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.525+0000 7fdc05d91640 1 -- 172.21.15.142:0/1062650793 <== osd.1 v2:172.21.15.142:6816/3192108003 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94504237113632] v30'48 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fdbf007f040 con 0x55f37b7a63d0 2024-09-22T08:36:42.536 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.525+0000 7fdabcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:36:42.537 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.525+0000 7fdc0a91f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:36:42.537 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.525+0000 7fdc0a91f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:36:42.537 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.525+0000 7fdc0a91f800 5 note: GC not initialized 2024-09-22T08:36:42.537 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.526+0000 7fda377fe640 20 reqs_thread_entry: start 2024-09-22T08:36:42.537 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.526+0000 7fdc0a91f800 20 init_complete bucket index max shards: 11 2024-09-22T08:36:42.537 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.526+0000 7fdc0a91f800 20 Filter name: none 2024-09-22T08:36:42.537 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.526+0000 7fda357fa640 20 reqs_thread_entry: start 2024-09-22T08:36:42.537 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.526+0000 7fdc0a91f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:42.537 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.526+0000 7fdc0a91f800 1 -- 172.21.15.142:0/1062650793 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f37b7ed5c0 con 0x55f37b7a63d0 2024-09-22T08:36:42.537 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.526+0000 7fdc05d91640 1 -- 172.21.15.142:0/1062650793 <== osd.1 v2:172.21.15.142:6816/3192108003 21 ==== osd_op_reply(62 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7fdbf007f040 con 0x55f37b7a63d0 2024-09-22T08:36:42.537 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.526+0000 7fdc0a91f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:42.537 INFO:teuthology.orchestra.run.smithi142.stderr:could not fetch user info: no user info saved 2024-09-22T08:36:42.537 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.527+0000 7fdabcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:36:42.537 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.527+0000 7fdc0a91f800 1 -- 172.21.15.142:0/1062650793 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94504237113632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f37b7ed580 con 0x55f37b7a63d0 2024-09-22T08:36:42.538 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.528+0000 7fdc05d91640 1 -- 172.21.15.142:0/1062650793 <== osd.1 v2:172.21.15.142:6816/3192108003 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94504237113632] v30'49 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fdbf007f040 con 0x55f37b7a63d0 2024-09-22T08:36:42.538 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.528+0000 7fdc0a91f800 1 -- 172.21.15.142:0/1062650793 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94504237074608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f37b7ed580 con 0x7fdc00054c20 2024-09-22T08:36:42.538 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.529+0000 7fdc06592640 1 -- 172.21.15.142:0/1062650793 <== osd.2 v2:172.21.15.142:6808/279438927 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94504237074608] v30'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdbf8039070 con 0x7fdc00054c20 2024-09-22T08:36:42.538 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.529+0000 7fdc0a91f800 20 remove_watcher() i=0 2024-09-22T08:36:42.538 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.529+0000 7fdc0a91f800 2 removed watcher, disabling cache 2024-09-22T08:36:42.538 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.529+0000 7fdc0a91f800 1 -- 172.21.15.142:0/1062650793 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94504237081840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f37b7ed580 con 0x55f37b7a63d0 2024-09-22T08:36:42.538 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.530+0000 7fdc05d91640 1 -- 172.21.15.142:0/1062650793 <== osd.1 v2:172.21.15.142:6816/3192108003 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94504237081840] v30'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdbf007f040 con 0x55f37b7a63d0 2024-09-22T08:36:42.538 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.530+0000 7fdc0a91f800 20 remove_watcher() i=1 2024-09-22T08:36:42.538 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.530+0000 7fdc0a91f800 1 -- 172.21.15.142:0/1062650793 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94504237082896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f37b7ed580 con 0x55f37b7aade0 2024-09-22T08:36:42.538 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.531+0000 7fdc06d93640 1 -- 172.21.15.142:0/1062650793 <== osd.3 v2:172.21.15.142:6800/1064901393 16 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94504237082896] v30'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc0000a4d0 con 0x55f37b7aade0 2024-09-22T08:36:42.538 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.531+0000 7fdc0a91f800 20 remove_watcher() i=2 2024-09-22T08:36:42.538 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.531+0000 7fdc0a91f800 1 -- 172.21.15.142:0/1062650793 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94504237087792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f37b7ed580 con 0x7fdc00054c20 2024-09-22T08:36:42.539 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.532+0000 7fdc06592640 1 -- 172.21.15.142:0/1062650793 <== osd.2 v2:172.21.15.142:6808/279438927 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94504237087792] v30'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdbf8039070 con 0x7fdc00054c20 2024-09-22T08:36:42.539 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.532+0000 7fdc0a91f800 20 remove_watcher() i=3 2024-09-22T08:36:42.539 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.532+0000 7fdc0a91f800 1 -- 172.21.15.142:0/1062650793 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94504237092800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f37b7ed580 con 0x55f37b7a63d0 2024-09-22T08:36:42.539 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.533+0000 7fdc05d91640 1 -- 172.21.15.142:0/1062650793 <== osd.1 v2:172.21.15.142:6816/3192108003 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94504237092800] v30'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdbf007f040 con 0x55f37b7a63d0 2024-09-22T08:36:42.539 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.533+0000 7fdc0a91f800 20 remove_watcher() i=4 2024-09-22T08:36:42.539 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.533+0000 7fdc0a91f800 1 -- 172.21.15.142:0/1062650793 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94504237090128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f37b7ed580 con 0x7fdbf80541f0 2024-09-22T08:36:42.539 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.534+0000 7fdc05d91640 1 -- 172.21.15.142:0/1062650793 <== osd.0 v2:172.21.15.31:6800/168281188 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94504237090128] v30'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdbf007f040 con 0x7fdbf80541f0 2024-09-22T08:36:42.539 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.534+0000 7fdc0a91f800 20 remove_watcher() i=5 2024-09-22T08:36:42.539 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.534+0000 7fdc0a91f800 1 -- 172.21.15.142:0/1062650793 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94504237083952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f37b7ed580 con 0x7fdbf80541f0 2024-09-22T08:36:42.542 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.535+0000 7fdc05d91640 1 -- 172.21.15.142:0/1062650793 <== osd.0 v2:172.21.15.31:6800/168281188 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94504237083952] v30'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdbf007f040 con 0x7fdbf80541f0 2024-09-22T08:36:42.542 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.535+0000 7fdc0a91f800 20 remove_watcher() i=6 2024-09-22T08:36:42.542 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.535+0000 7fdc0a91f800 1 -- 172.21.15.142:0/1062650793 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94504237096480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f37b7ed580 con 0x7fdbf80541f0 2024-09-22T08:36:42.542 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.536+0000 7fdc05d91640 1 -- 172.21.15.142:0/1062650793 <== osd.0 v2:172.21.15.31:6800/168281188 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94504237096480] v30'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdbf007f040 con 0x7fdbf80541f0 2024-09-22T08:36:42.542 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.536+0000 7fdc0a91f800 20 remove_watcher() i=7 2024-09-22T08:36:42.542 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.536+0000 7fdc0a91f800 1 -- 172.21.15.142:0/1062650793 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7fdbf80541f0 msgr2=0x7fdbf8054610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:42.542 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.536+0000 7fdc0a91f800 1 --2- 172.21.15.142:0/1062650793 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7fdbf80541f0 0x7fdbf8054610 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:42.542 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.536+0000 7fdc0a91f800 1 -- 172.21.15.142:0/1062650793 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55f37b7a63d0 msgr2=0x55f37b7a8890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:42.542 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.536+0000 7fdc0a91f800 1 --2- 172.21.15.142:0/1062650793 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55f37b7a63d0 0x55f37b7a8890 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:42.542 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.536+0000 7fdc0a91f800 1 -- 172.21.15.142:0/1062650793 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7fdc00054c20 msgr2=0x7fdc0004d7b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:42.543 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.536+0000 7fdc0a91f800 1 --2- 172.21.15.142:0/1062650793 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7fdc00054c20 0x7fdc0004d7b0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:42.543 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.536+0000 7fdc0a91f800 1 -- 172.21.15.142:0/1062650793 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55f37b7aade0 msgr2=0x55f37b7ad1d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:42.543 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.536+0000 7fdc0a91f800 1 --2- 172.21.15.142:0/1062650793 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55f37b7aade0 0x55f37b7ad1d0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:42.543 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.536+0000 7fdc0a91f800 1 -- 172.21.15.142:0/1062650793 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fdad003d000 msgr2=0x7fdad003f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:42.543 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.536+0000 7fdc0a91f800 1 --2- 172.21.15.142:0/1062650793 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fdad003d000 0x7fdad003f4c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fdbf800efd0 tx=0x7fdbf8041000 comp rx=0 tx=0).stop 2024-09-22T08:36:42.543 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.536+0000 7fdc0a91f800 1 -- 172.21.15.142:0/1062650793 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f37b791380 msgr2=0x55f37b769c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:42.543 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.536+0000 7fdc0a91f800 1 --2- 172.21.15.142:0/1062650793 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f37b791380 0x55f37b769c80 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fdc00054740 tx=0x7fdc000547a0 comp rx=0 tx=0).stop 2024-09-22T08:36:42.543 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.536+0000 7fdc05d91640 1 -- 172.21.15.142:0/1062650793 reap_dead start 2024-09-22T08:36:42.543 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.536+0000 7fdc05d91640 1 -- 172.21.15.142:0/1062650793 reap_dead start 2024-09-22T08:36:42.543 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.536+0000 7fdc0a91f800 1 -- 172.21.15.142:0/1062650793 shutdown_connections 2024-09-22T08:36:42.543 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.536+0000 7fdc0a91f800 1 -- 172.21.15.142:0/1062650793 >> 172.21.15.142:0/1062650793 conn(0x55f37b78d780 msgr2=0x55f37b78b990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:42.543 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.536+0000 7fdc0a91f800 1 -- 172.21.15.142:0/1062650793 shutdown_connections 2024-09-22T08:36:42.543 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.536+0000 7fdc0a91f800 1 -- 172.21.15.142:0/1062650793 wait complete. 2024-09-22T08:36:42.544 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.537+0000 7fdc0a91f800 1 -- 172.21.15.142:0/2573063703 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fdae003cfb0 msgr2=0x7fdae003f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:42.544 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.537+0000 7fdc0a91f800 1 --2- 172.21.15.142:0/2573063703 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fdae003cfb0 0x7fdae003f470 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fdbf80531e0 tx=0x7fdbf80011b0 comp rx=0 tx=0).stop 2024-09-22T08:36:42.544 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.537+0000 7fdc0a91f800 1 -- 172.21.15.142:0/2573063703 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f37b7848c0 msgr2=0x55f37b784ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:42.544 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.537+0000 7fdc0a91f800 1 --2- 172.21.15.142:0/2573063703 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f37b7848c0 0x55f37b784ce0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x55f37b5e5ca0 tx=0x7fdc000167b0 comp rx=0 tx=0).stop 2024-09-22T08:36:42.544 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.537+0000 7fdc0a91f800 1 -- 172.21.15.142:0/2573063703 shutdown_connections 2024-09-22T08:36:42.544 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.537+0000 7fdc0a91f800 1 --2- 172.21.15.142:0/2573063703 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fdae003cfb0 0x7fdae003f470 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:42.544 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.537+0000 7fdc0a91f800 1 --2- 172.21.15.142:0/2573063703 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f37b7848c0 0x55f37b784ce0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:42.544 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.537+0000 7fdc0a91f800 1 -- 172.21.15.142:0/2573063703 >> 172.21.15.142:0/2573063703 conn(0x55f37b778c70 msgr2=0x55f37b779050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:42.544 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.537+0000 7fdc0a91f800 1 -- 172.21.15.142:0/2573063703 shutdown_connections 2024-09-22T08:36:42.544 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.537+0000 7fdc0a91f800 1 -- 172.21.15.142:0/2573063703 wait complete. 2024-09-22T08:36:42.544 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.537+0000 7fdc0a91f800 1 -- 172.21.15.142:0/426014490 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55f37b672c00 msgr2=0x55f37b770b20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:42.544 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.537+0000 7fdc0a91f800 1 --2- 172.21.15.142:0/426014490 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55f37b672c00 0x55f37b770b20 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:42.544 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.537+0000 7fdc0a91f800 1 -- 172.21.15.142:0/426014490 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55f37b773490 msgr2=0x55f37b775880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:42.545 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.537+0000 7fdc0a91f800 1 --2- 172.21.15.142:0/426014490 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55f37b773490 0x55f37b775880 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:42.545 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.537+0000 7fdc0a91f800 1 -- 172.21.15.142:0/426014490 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fdaec03d1a0 msgr2=0x7fdaec03f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:42.545 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.537+0000 7fdc0a91f800 1 --2- 172.21.15.142:0/426014490 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fdaec03d1a0 0x7fdaec03f660 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fdbf0057000 tx=0x7fdbf0052000 comp rx=0 tx=0).stop 2024-09-22T08:36:42.545 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.537+0000 7fdc0a91f800 1 -- 172.21.15.142:0/426014490 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f37b6717f0 msgr2=0x55f37b5e6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:42.545 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.537+0000 7fdc0a91f800 1 --2- 172.21.15.142:0/426014490 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f37b6717f0 0x55f37b5e6100 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fdbf80012f0 tx=0x7fdbf8000ed0 comp rx=0 tx=0).stop 2024-09-22T08:36:42.545 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.537+0000 7fdc0a91f800 1 -- 172.21.15.142:0/426014490 shutdown_connections 2024-09-22T08:36:42.545 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.537+0000 7fdc0a91f800 1 --2- 172.21.15.142:0/426014490 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55f37b773490 0x55f37b775880 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:42.545 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.537+0000 7fdc0a91f800 1 --2- 172.21.15.142:0/426014490 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55f37b672c00 0x55f37b770b20 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:42.545 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.537+0000 7fdc0a91f800 1 --2- 172.21.15.142:0/426014490 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fdaec03d1a0 0x7fdaec03f660 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:42.545 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.537+0000 7fdc0a91f800 1 --2- 172.21.15.142:0/426014490 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f37b6717f0 0x55f37b5e6100 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:42.545 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.537+0000 7fdc0a91f800 1 -- 172.21.15.142:0/426014490 >> 172.21.15.142:0/426014490 conn(0x55f37b66cbe0 msgr2=0x55f37b762210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:42.545 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.537+0000 7fdc0a91f800 1 -- 172.21.15.142:0/426014490 shutdown_connections 2024-09-22T08:36:42.545 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.537+0000 7fdc0a91f800 1 -- 172.21.15.142:0/426014490 wait complete. 2024-09-22T08:36:42.548 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T08:36:42.548 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'foo', '--display-name', 'Foo', '--email', 'foo@foo.com', '--access-key', '9te6NH5mcdcq0Tc5i8i1', '--secret', 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', '--max-buckets', '4'] 2024-09-22T08:36:42.548 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'foo', '--display-name', 'Foo', '--email', 'foo@foo.com', '--access-key', '9te6NH5mcdcq0Tc5i8i1', '--secret', 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', '--max-buckets', '4'] 2024-09-22T08:36:42.548 DEBUG:teuthology.orchestra.run.smithi142:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid foo --display-name Foo --email foo@foo.com --access-key 9te6NH5mcdcq0Tc5i8i1 --secret Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu --max-buckets 4 2024-09-22T08:36:42.603 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:36:42.604 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:36:42.605 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.602+0000 7fda839af800 1 Processor -- start 2024-09-22T08:36:42.605 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.602+0000 7fda839af800 1 -- start start 2024-09-22T08:36:42.605 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.602+0000 7fda839af800 1 --2- >> v2:172.21.15.31:3300/0 conn(0x5641cd30a140 0x5641cd30c530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:42.605 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.602+0000 7fda839af800 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5641cd194a20 con 0x5641cd30ca70 2024-09-22T08:36:42.605 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.602+0000 7fda839af800 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x5641cd1947d0 con 0x5641cd30a140 2024-09-22T08:36:42.605 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.603+0000 7fda81499640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x5641cd30a140 0x5641cd30c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:42.605 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.603+0000 7fda80c98640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x5641cd30ca70 0x5641cd30ee60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.142:42292/0 (socket says 172.21.15.142:42292) 2024-09-22T08:36:42.605 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.603+0000 7fda80c98640 1 -- 172.21.15.142:0/3822415186 learned_addr learned my addr 172.21.15.142:0/3822415186 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-09-22T08:36:42.606 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.603+0000 7fda81499640 1 -- 172.21.15.142:0/3822415186 >> v1:172.21.15.31:6789/0 conn(0x5641cd30ca70 legacy=0x5641cd30ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:42.606 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.603+0000 7fda73fff640 1 -- 172.21.15.142:0/3822415186 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2481497014 0 0) 0x5641cd194a20 con 0x5641cd30ca70 2024-09-22T08:36:42.606 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.603+0000 7fda81499640 1 -- 172.21.15.142:0/3822415186 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5641cd3115c0 con 0x5641cd30a140 2024-09-22T08:36:42.607 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.605+0000 7fda81499640 1 --2- 172.21.15.142:0/3822415186 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5641cd30a140 0x5641cd30c530 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fda74005fd0 tx=0x7fda74045c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3a8f4bca415d8b server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:42.607 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.605+0000 7fda73fff640 1 -- 172.21.15.142:0/3822415186 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda74058530 con 0x5641cd30a140 2024-09-22T08:36:42.607 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.605+0000 7fda73fff640 1 -- 172.21.15.142:0/3822415186 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda740586d0 con 0x5641cd30a140 2024-09-22T08:36:42.607 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.605+0000 7fda73fff640 1 -- 172.21.15.142:0/3822415186 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda740589d0 con 0x5641cd30a140 2024-09-22T08:36:42.608 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.605+0000 7fda839af800 1 -- 172.21.15.142:0/3822415186 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5641cd30a140 msgr2=0x5641cd30c530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:42.608 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.605+0000 7fda839af800 1 --2- 172.21.15.142:0/3822415186 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5641cd30a140 0x5641cd30c530 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fda74005fd0 tx=0x7fda74045c30 comp rx=0 tx=0).stop 2024-09-22T08:36:42.608 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.605+0000 7fda839af800 1 -- 172.21.15.142:0/3822415186 shutdown_connections 2024-09-22T08:36:42.608 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.605+0000 7fda839af800 1 --2- 172.21.15.142:0/3822415186 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5641cd30a140 0x5641cd30c530 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:42.608 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.605+0000 7fda839af800 1 -- 172.21.15.142:0/3822415186 >> 172.21.15.142:0/3822415186 conn(0x5641cd303c00 msgr2=0x5641cd306060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:42.608 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.605+0000 7fda839af800 1 -- 172.21.15.142:0/3822415186 shutdown_connections 2024-09-22T08:36:42.608 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.605+0000 7fda839af800 1 -- 172.21.15.142:0/3822415186 wait complete. 2024-09-22T08:36:42.621 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.619+0000 7fda839af800 1 Processor -- start 2024-09-22T08:36:42.621 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.619+0000 7fda839af800 1 -- start start 2024-09-22T08:36:42.621 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.619+0000 7fda839af800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5641cd30a140 0x5641cd3098d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:42.622 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.619+0000 7fda839af800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5641cd1a1dd0 con 0x5641cd30a140 2024-09-22T08:36:42.623 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.620+0000 7fda81499640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5641cd30a140 0x5641cd3098d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:42.623 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.620+0000 7fda81499640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5641cd30a140 0x5641cd3098d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:37892/0 (socket says 172.21.15.142:37892) 2024-09-22T08:36:42.623 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.620+0000 7fda81499640 1 -- 172.21.15.142:0/4071702898 learned_addr learned my addr 172.21.15.142:0/4071702898 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:42.623 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.620+0000 7fda81499640 1 -- 172.21.15.142:0/4071702898 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5641cd309ec0 con 0x5641cd30a140 2024-09-22T08:36:42.623 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.620+0000 7fda81499640 1 --2- 172.21.15.142:0/4071702898 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5641cd30a140 0x5641cd3098d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fda74025a60 tx=0x7fda74051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11e7ae8d3b4b316c server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:42.623 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.620+0000 7fd96f606640 1 -- 172.21.15.142:0/4071702898 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda74058a30 con 0x5641cd30a140 2024-09-22T08:36:42.623 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.620+0000 7fd96f606640 1 -- 172.21.15.142:0/4071702898 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda74068070 con 0x5641cd30a140 2024-09-22T08:36:42.623 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.620+0000 7fd96f606640 1 -- 172.21.15.142:0/4071702898 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda74058d00 con 0x5641cd30a140 2024-09-22T08:36:42.625 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.621+0000 7fda839af800 1 -- 172.21.15.142:0/4071702898 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5641cd30a140 msgr2=0x5641cd3098d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:42.625 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.621+0000 7fda839af800 1 --2- 172.21.15.142:0/4071702898 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5641cd30a140 0x5641cd3098d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fda74025a60 tx=0x7fda74051000 comp rx=0 tx=0).stop 2024-09-22T08:36:42.625 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.621+0000 7fda839af800 1 -- 172.21.15.142:0/4071702898 shutdown_connections 2024-09-22T08:36:42.625 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.621+0000 7fda839af800 1 --2- 172.21.15.142:0/4071702898 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5641cd30a140 0x5641cd3098d0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:42.625 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.621+0000 7fda839af800 1 -- 172.21.15.142:0/4071702898 >> 172.21.15.142:0/4071702898 conn(0x5641cd303c00 msgr2=0x5641cd3f48c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:42.625 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.621+0000 7fda839af800 1 -- 172.21.15.142:0/4071702898 shutdown_connections 2024-09-22T08:36:42.625 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.621+0000 7fda839af800 1 -- 172.21.15.142:0/4071702898 wait complete. 2024-09-22T08:36:42.625 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.621+0000 7fda839af800 1 Processor -- start 2024-09-22T08:36:42.626 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.621+0000 7fda839af800 1 -- start start 2024-09-22T08:36:42.626 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.622+0000 7fda839af800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5641cd30a140 0x5641cd402b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:42.626 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.622+0000 7fda839af800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5641cd310880 con 0x5641cd30a140 2024-09-22T08:36:42.626 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.622+0000 7fda81499640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5641cd30a140 0x5641cd402b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:42.626 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.622+0000 7fda81499640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5641cd30a140 0x5641cd402b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:37894/0 (socket says 172.21.15.142:37894) 2024-09-22T08:36:42.626 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.622+0000 7fda81499640 1 -- 172.21.15.142:0/3895711368 learned_addr learned my addr 172.21.15.142:0/3895711368 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:42.626 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.622+0000 7fda81499640 1 -- 172.21.15.142:0/3895711368 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5641cd4030f0 con 0x5641cd30a140 2024-09-22T08:36:42.626 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.623+0000 7fda81499640 1 --2- 172.21.15.142:0/3895711368 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5641cd30a140 0x5641cd402b90 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fda74005bf0 tx=0x7fda74003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:42.626 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.623+0000 7fd96de03640 1 -- 172.21.15.142:0/3895711368 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda74063710 con 0x5641cd30a140 2024-09-22T08:36:42.626 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.623+0000 7fd96de03640 1 -- 172.21.15.142:0/3895711368 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda740638d0 con 0x5641cd30a140 2024-09-22T08:36:42.626 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.623+0000 7fda839af800 1 -- 172.21.15.142:0/3895711368 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5641cd403380 con 0x5641cd30a140 2024-09-22T08:36:42.626 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.623+0000 7fd96de03640 1 -- 172.21.15.142:0/3895711368 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda74063bf0 con 0x5641cd30a140 2024-09-22T08:36:42.626 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.623+0000 7fda839af800 1 -- 172.21.15.142:0/3895711368 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5641cd403d80 con 0x5641cd30a140 2024-09-22T08:36:42.629 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.624+0000 7fd96de03640 1 -- 172.21.15.142:0/3895711368 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fda7404f3f0 con 0x5641cd30a140 2024-09-22T08:36:42.629 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.624+0000 7fd96de03640 1 --2- 172.21.15.142:0/3895711368 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fd96803cfb0 0x7fd96803f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:42.629 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.624+0000 7fd96de03640 1 -- 172.21.15.142:0/3895711368 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fda740987a0 con 0x5641cd30a140 2024-09-22T08:36:42.629 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.624+0000 7fda80c98640 1 --2- 172.21.15.142:0/3895711368 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fd96803cfb0 0x7fd96803f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:42.629 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.624+0000 7fda839af800 1 --2- 172.21.15.142:0/3895711368 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5641cd30ca70 0x5641cd40a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:42.629 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.624+0000 7fda839af800 1 -- 172.21.15.142:0/3895711368 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5641cd404930 con 0x5641cd30ca70 2024-09-22T08:36:42.629 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.624+0000 7fda81c9a640 1 --2- 172.21.15.142:0/3895711368 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5641cd30ca70 0x5641cd40a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:42.629 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.624+0000 7fda80c98640 1 --2- 172.21.15.142:0/3895711368 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fd96803cfb0 0x7fd96803f470 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fda78000c00 tx=0x7fda780013b0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:42.630 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.624+0000 7fda81c9a640 1 --2- 172.21.15.142:0/3895711368 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5641cd30ca70 0x5641cd40a1e0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:42.630 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.625+0000 7fda81c9a640 1 -- 172.21.15.142:0/3895711368 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fda7c0083e0 con 0x5641cd30ca70 2024-09-22T08:36:42.630 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.625+0000 7fda839af800 1 -- 172.21.15.142:0/3895711368 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5641cd404210 con 0x5641cd30ca70 2024-09-22T08:36:42.630 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.625+0000 7fda81c9a640 1 -- 172.21.15.142:0/3895711368 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fda7c0083e0 con 0x5641cd30ca70 2024-09-22T08:36:42.630 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.625+0000 7fda839af800 1 --2- 172.21.15.142:0/3895711368 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5641cd40c670 0x5641cd40ea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:42.630 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.625+0000 7fda839af800 1 -- 172.21.15.142:0/3895711368 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:3 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5641cd40f130 con 0x5641cd40c670 2024-09-22T08:36:42.630 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.625+0000 7fda81499640 1 --2- 172.21.15.142:0/3895711368 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5641cd40c670 0x5641cd40ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:42.630 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.625+0000 7fda81499640 1 --2- 172.21.15.142:0/3895711368 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5641cd40c670 0x5641cd40ea60 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:42.630 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.626+0000 7fda81499640 1 -- 172.21.15.142:0/3895711368 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(3 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fda7407dca0 con 0x5641cd40c670 2024-09-22T08:36:42.630 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.626+0000 7fda839af800 1 -- 172.21.15.142:0/3895711368 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5641cd40b510 con 0x5641cd30ca70 2024-09-22T08:36:42.630 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.626+0000 7fda81c9a640 1 -- 172.21.15.142:0/3895711368 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fda7c0083e0 con 0x5641cd30ca70 2024-09-22T08:36:42.630 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.626+0000 7fda839af800 1 -- 172.21.15.142:0/3895711368 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5641cd40ba00 con 0x5641cd40c670 2024-09-22T08:36:42.630 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.626+0000 7fda81499640 1 -- 172.21.15.142:0/3895711368 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(5 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fda7407dca0 con 0x5641cd40c670 2024-09-22T08:36:42.630 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.626+0000 7fda839af800 1 Processor -- start 2024-09-22T08:36:42.631 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.627+0000 7fda839af800 1 -- start start 2024-09-22T08:36:42.631 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.627+0000 7fda839af800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5641cd41db10 0x5641cd41df30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:42.631 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.627+0000 7fda839af800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5641cd200d50 con 0x5641cd41db10 2024-09-22T08:36:42.631 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.627+0000 7fda81c9a640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5641cd41db10 0x5641cd41df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:42.631 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.627+0000 7fda81c9a640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5641cd41db10 0x5641cd41df30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:37898/0 (socket says 172.21.15.142:37898) 2024-09-22T08:36:42.631 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.627+0000 7fda81c9a640 1 -- 172.21.15.142:0/230331369 learned_addr learned my addr 172.21.15.142:0/230331369 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:42.631 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.627+0000 7fda81c9a640 1 -- 172.21.15.142:0/230331369 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5641cd41e570 con 0x5641cd41db10 2024-09-22T08:36:42.635 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.627+0000 7fda81c9a640 1 --2- 172.21.15.142:0/230331369 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5641cd41db10 0x5641cd41df30 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x5641cd403a20 tx=0x7fda7c00bf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:42.635 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.627+0000 7fd966ffd640 1 -- 172.21.15.142:0/230331369 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda7c01c020 con 0x5641cd41db10 2024-09-22T08:36:42.635 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.627+0000 7fd966ffd640 1 -- 172.21.15.142:0/230331369 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda7c007c90 con 0x5641cd41db10 2024-09-22T08:36:42.635 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.629+0000 7fda839af800 1 -- 172.21.15.142:0/230331369 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5641cd41eda0 con 0x5641cd41db10 2024-09-22T08:36:42.635 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.629+0000 7fd966ffd640 1 -- 172.21.15.142:0/230331369 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda7c018440 con 0x5641cd41db10 2024-09-22T08:36:42.635 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.629+0000 7fda839af800 1 -- 172.21.15.142:0/230331369 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5641cd41f340 con 0x5641cd41db10 2024-09-22T08:36:42.635 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.629+0000 7fd966ffd640 1 -- 172.21.15.142:0/230331369 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fda7c01f020 con 0x5641cd41db10 2024-09-22T08:36:42.635 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.629+0000 7fd966ffd640 1 --2- 172.21.15.142:0/230331369 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fd95803cfb0 0x7fd95803f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:42.635 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.629+0000 7fd966ffd640 1 -- 172.21.15.142:0/230331369 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fda7c0558e0 con 0x5641cd41db10 2024-09-22T08:36:42.636 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.629+0000 7fda81499640 1 --2- 172.21.15.142:0/230331369 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fd95803cfb0 0x7fd95803f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:42.636 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.629+0000 7fda839af800 1 Processor -- start 2024-09-22T08:36:42.636 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.629+0000 7fda839af800 1 -- start start 2024-09-22T08:36:42.636 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.629+0000 7fda81499640 1 --2- 172.21.15.142:0/230331369 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fd95803cfb0 0x7fd95803f470 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x5641cd40a860 tx=0x7fda74096cd0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:42.636 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.629+0000 7fda839af800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5641cd42a570 0x5641cd42a970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:42.636 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.629+0000 7fda839af800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5641cd308260 con 0x5641cd42a570 2024-09-22T08:36:42.636 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.629+0000 7fda81c9a640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5641cd42a570 0x5641cd42a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:42.636 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.630+0000 7fda81c9a640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5641cd42a570 0x5641cd42a970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:37904/0 (socket says 172.21.15.142:37904) 2024-09-22T08:36:42.636 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.630+0000 7fda81c9a640 1 -- 172.21.15.142:0/3808900372 learned_addr learned my addr 172.21.15.142:0/3808900372 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:42.636 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.630+0000 7fda81c9a640 1 -- 172.21.15.142:0/3808900372 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5641cd42af60 con 0x5641cd42a570 2024-09-22T08:36:42.636 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.630+0000 7fda81c9a640 1 --2- 172.21.15.142:0/3808900372 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5641cd42a570 0x5641cd42a970 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fda7c053df0 tx=0x7fda7c0158b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43e4ee74c633d76a server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:42.636 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.630+0000 7fd964ff9640 1 -- 172.21.15.142:0/3808900372 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda7c04a070 con 0x5641cd42a570 2024-09-22T08:36:42.636 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.630+0000 7fd964ff9640 1 -- 172.21.15.142:0/3808900372 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda7c015e70 con 0x5641cd42a570 2024-09-22T08:36:42.636 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.630+0000 7fd964ff9640 1 -- 172.21.15.142:0/3808900372 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda7c0174d0 con 0x5641cd42a570 2024-09-22T08:36:42.637 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.630+0000 7fda839af800 1 -- 172.21.15.142:0/3808900372 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5641cd42a570 msgr2=0x5641cd42a970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:42.637 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.630+0000 7fda839af800 1 --2- 172.21.15.142:0/3808900372 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5641cd42a570 0x5641cd42a970 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fda7c053df0 tx=0x7fda7c0158b0 comp rx=0 tx=0).stop 2024-09-22T08:36:42.637 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.630+0000 7fda839af800 1 -- 172.21.15.142:0/3808900372 shutdown_connections 2024-09-22T08:36:42.637 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.630+0000 7fda839af800 1 --2- 172.21.15.142:0/3808900372 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5641cd42a570 0x5641cd42a970 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:42.637 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.630+0000 7fda839af800 1 -- 172.21.15.142:0/3808900372 >> 172.21.15.142:0/3808900372 conn(0x5641cd426970 msgr2=0x5641cd424bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:42.637 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.631+0000 7fda839af800 1 -- 172.21.15.142:0/3808900372 shutdown_connections 2024-09-22T08:36:42.637 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.631+0000 7fda839af800 1 -- 172.21.15.142:0/3808900372 wait complete. 2024-09-22T08:36:42.637 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.631+0000 7fda839af800 1 Processor -- start 2024-09-22T08:36:42.637 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.631+0000 7fda839af800 1 -- start start 2024-09-22T08:36:42.637 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.631+0000 7fda839af800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5641cd42a570 0x5641cd431ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:42.637 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.631+0000 7fda839af800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5641cd42b580 con 0x5641cd42a570 2024-09-22T08:36:42.637 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.631+0000 7fda81c9a640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5641cd42a570 0x5641cd431ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:42.637 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.631+0000 7fda81c9a640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5641cd42a570 0x5641cd431ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:37908/0 (socket says 172.21.15.142:37908) 2024-09-22T08:36:42.637 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.631+0000 7fda81c9a640 1 -- 172.21.15.142:0/1512165137 learned_addr learned my addr 172.21.15.142:0/1512165137 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:42.638 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.631+0000 7fda81c9a640 1 -- 172.21.15.142:0/1512165137 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5641cd432040 con 0x5641cd42a570 2024-09-22T08:36:42.638 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.632+0000 7fda81c9a640 1 --2- 172.21.15.142:0/1512165137 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5641cd42a570 0x5641cd431ae0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fda7c0154a0 tx=0x7fda7c053d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:42.638 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.632+0000 7fd956ffd640 1 -- 172.21.15.142:0/1512165137 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda7c02e070 con 0x5641cd42a570 2024-09-22T08:36:42.638 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.632+0000 7fd956ffd640 1 -- 172.21.15.142:0/1512165137 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda7c04b040 con 0x5641cd42a570 2024-09-22T08:36:42.638 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.632+0000 7fda839af800 1 -- 172.21.15.142:0/1512165137 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5641cd4322d0 con 0x5641cd42a570 2024-09-22T08:36:42.638 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.632+0000 7fd956ffd640 1 -- 172.21.15.142:0/1512165137 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda7c04a070 con 0x5641cd42a570 2024-09-22T08:36:42.638 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.632+0000 7fda839af800 1 -- 172.21.15.142:0/1512165137 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5641cd432e60 con 0x5641cd42a570 2024-09-22T08:36:42.638 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.633+0000 7fd956ffd640 1 -- 172.21.15.142:0/1512165137 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fda7c016040 con 0x5641cd42a570 2024-09-22T08:36:42.638 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.633+0000 7fd956ffd640 1 --2- 172.21.15.142:0/1512165137 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fd94c03d000 0x7fd94c03f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:42.638 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.633+0000 7fd956ffd640 1 -- 172.21.15.142:0/1512165137 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fda7c055040 con 0x5641cd42a570 2024-09-22T08:36:42.638 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.633+0000 7fda81499640 1 --2- 172.21.15.142:0/1512165137 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fd94c03d000 0x7fd94c03f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:42.649 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.633+0000 7fda81499640 1 --2- 172.21.15.142:0/1512165137 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fd94c03d000 0x7fd94c03f4c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fda740943f0 tx=0x7fda74085000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:42.649 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.633+0000 7fda839af800 20 rados->read ofs=0 len=0 2024-09-22T08:36:42.649 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.633+0000 7fda839af800 1 --2- 172.21.15.142:0/1512165137 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5641cd43d4a0 0x5641cd43f960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:42.649 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.633+0000 7fda839af800 1 -- 172.21.15.142:0/1512165137 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5641cd4400b0 con 0x5641cd43d4a0 2024-09-22T08:36:42.649 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.634+0000 7fda80c98640 1 --2- 172.21.15.142:0/1512165137 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5641cd43d4a0 0x5641cd43f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:42.649 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.634+0000 7fda80c98640 1 --2- 172.21.15.142:0/1512165137 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5641cd43d4a0 0x5641cd43f960 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:42.649 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.634+0000 7fda80c98640 1 -- 172.21.15.142:0/1512165137 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fda7800f5f0 con 0x5641cd43d4a0 2024-09-22T08:36:42.649 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.634+0000 7fda839af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:42.650 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.634+0000 7fda839af800 20 realm 2024-09-22T08:36:42.650 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.634+0000 7fda839af800 20 rados->read ofs=0 len=0 2024-09-22T08:36:42.650 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.634+0000 7fda839af800 1 -- 172.21.15.142:0/1512165137 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5641cd43c7f0 con 0x5641cd43d4a0 2024-09-22T08:36:42.650 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.634+0000 7fda80c98640 1 -- 172.21.15.142:0/1512165137 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fda7800f5f0 con 0x5641cd43d4a0 2024-09-22T08:36:42.650 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.634+0000 7fda839af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:42.650 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.634+0000 7fda839af800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:36:42.650 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.634+0000 7fda839af800 20 rados->read ofs=0 len=0 2024-09-22T08:36:42.650 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.634+0000 7fda839af800 1 -- 172.21.15.142:0/1512165137 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5641cd440ba0 con 0x5641cd43d4a0 2024-09-22T08:36:42.650 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.634+0000 7fda80c98640 1 -- 172.21.15.142:0/1512165137 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fda7800f5f0 con 0x5641cd43d4a0 2024-09-22T08:36:42.650 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.635+0000 7fda839af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:42.651 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.635+0000 7fda839af800 20 rados->read ofs=0 len=0 2024-09-22T08:36:42.651 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.635+0000 7fda839af800 1 -- 172.21.15.142:0/1512165137 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5641cd441470 con 0x5641cd43d4a0 2024-09-22T08:36:42.651 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.635+0000 7fda80c98640 1 -- 172.21.15.142:0/1512165137 <== osd.1 v2:172.21.15.142:6816/3192108003 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fda7800f5f0 con 0x5641cd43d4a0 2024-09-22T08:36:42.651 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.635+0000 7fda839af800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:36:42.651 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.635+0000 7fda839af800 20 rados->read ofs=0 len=0 2024-09-22T08:36:42.651 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.635+0000 7fda839af800 1 --2- 172.21.15.142:0/1512165137 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5641cd441e90 0x5641cd444280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:42.651 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.635+0000 7fda839af800 1 -- 172.21.15.142:0/1512165137 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5641cd4449f0 con 0x5641cd441e90 2024-09-22T08:36:42.651 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.635+0000 7fda81c9a640 1 --2- 172.21.15.142:0/1512165137 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5641cd441e90 0x5641cd444280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:42.651 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.635+0000 7fda81c9a640 1 --2- 172.21.15.142:0/1512165137 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5641cd441e90 0x5641cd444280 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:42.651 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.635+0000 7fda81c9a640 1 -- 172.21.15.142:0/1512165137 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(5 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fda7c0083e0 con 0x5641cd441e90 2024-09-22T08:36:42.651 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.635+0000 7fda839af800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:36:42.651 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.635+0000 7fda839af800 20 searching for the correct realm 2024-09-22T08:36:42.651 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.635+0000 7fda839af800 1 -- 172.21.15.142:0/1512165137 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5641cd446320 con 0x5641cd441e90 2024-09-22T08:36:42.651 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.636+0000 7fda81c9a640 1 -- 172.21.15.142:0/1512165137 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda7c0083e0 con 0x5641cd441e90 2024-09-22T08:36:42.652 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.636+0000 7fda81c9a640 1 --2- 172.21.15.142:0/1512165137 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7fda7c032020 0x7fda7c03ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:42.652 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.636+0000 7fda81c9a640 1 -- 172.21.15.142:0/1512165137 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5641cd446320 con 0x7fda7c032020 2024-09-22T08:36:42.652 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.636+0000 7fda81499640 1 --2- 172.21.15.142:0/1512165137 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7fda7c032020 0x7fda7c03ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:42.652 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.636+0000 7fda81499640 1 --2- 172.21.15.142:0/1512165137 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7fda7c032020 0x7fda7c03ca00 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:42.652 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.636+0000 7fda81499640 1 -- 172.21.15.142:0/1512165137 <== osd.2 v2:172.21.15.142:6808/279438927 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda7407dca0 con 0x7fda7c032020 2024-09-22T08:36:42.652 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.636+0000 7fda81499640 1 --2- 172.21.15.142:0/1512165137 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7fda7406bb50 0x7fda7406b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:42.652 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.636+0000 7fda81499640 1 -- 172.21.15.142:0/1512165137 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5641cd446320 con 0x7fda7406bb50 2024-09-22T08:36:42.652 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.637+0000 7fda80c98640 1 --2- 172.21.15.142:0/1512165137 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7fda7406bb50 0x7fda7406b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:42.652 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.637+0000 7fda80c98640 1 --2- 172.21.15.142:0/1512165137 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7fda7406bb50 0x7fda7406b380 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:42.652 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.637+0000 7fda80c98640 1 -- 172.21.15.142:0/1512165137 <== osd.0 v2:172.21.15.31:6800/168281188 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda7800f5f0 con 0x7fda7406bb50 2024-09-22T08:36:42.652 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.637+0000 7fda80c98640 1 -- 172.21.15.142:0/1512165137 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5641cd446320 con 0x5641cd43d4a0 2024-09-22T08:36:42.652 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.637+0000 7fda80c98640 1 -- 172.21.15.142:0/1512165137 <== osd.1 v2:172.21.15.142:6816/3192108003 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda7800f5f0 con 0x5641cd43d4a0 2024-09-22T08:36:42.652 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.637+0000 7fda80c98640 1 -- 172.21.15.142:0/1512165137 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5641cd446320 con 0x5641cd43d4a0 2024-09-22T08:36:42.652 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.638+0000 7fda80c98640 1 -- 172.21.15.142:0/1512165137 <== osd.1 v2:172.21.15.142:6816/3192108003 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda7802b040 con 0x5641cd43d4a0 2024-09-22T08:36:42.653 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.638+0000 7fda80c98640 1 -- 172.21.15.142:0/1512165137 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5641cd446320 con 0x7fda7406bb50 2024-09-22T08:36:42.653 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.638+0000 7fda80c98640 1 -- 172.21.15.142:0/1512165137 <== osd.0 v2:172.21.15.31:6800/168281188 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda7802b040 con 0x7fda7406bb50 2024-09-22T08:36:42.653 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.638+0000 7fda80c98640 1 -- 172.21.15.142:0/1512165137 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5641cd446320 con 0x7fda7406bb50 2024-09-22T08:36:42.653 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.638+0000 7fda80c98640 1 -- 172.21.15.142:0/1512165137 <== osd.0 v2:172.21.15.31:6800/168281188 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda7802b040 con 0x7fda7406bb50 2024-09-22T08:36:42.653 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.638+0000 7fda80c98640 1 -- 172.21.15.142:0/1512165137 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5641cd446320 con 0x7fda7c032020 2024-09-22T08:36:42.653 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.638+0000 7fda81499640 1 -- 172.21.15.142:0/1512165137 <== osd.2 v2:172.21.15.142:6808/279438927 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda7407dca0 con 0x7fda7c032020 2024-09-22T08:36:42.653 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.638+0000 7fda81499640 1 -- 172.21.15.142:0/1512165137 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5641cd446320 con 0x5641cd441e90 2024-09-22T08:36:42.653 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.639+0000 7fda81c9a640 1 -- 172.21.15.142:0/1512165137 <== osd.3 v2:172.21.15.142:6800/1064901393 3 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda7c0083e0 con 0x5641cd441e90 2024-09-22T08:36:42.653 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.639+0000 7fda81c9a640 1 -- 172.21.15.142:0/1512165137 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5641cd446320 con 0x5641cd43d4a0 2024-09-22T08:36:42.653 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.639+0000 7fda80c98640 1 -- 172.21.15.142:0/1512165137 <== osd.1 v2:172.21.15.142:6816/3192108003 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda7802b040 con 0x5641cd43d4a0 2024-09-22T08:36:42.653 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.639+0000 7fda80c98640 1 -- 172.21.15.142:0/1512165137 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5641cd446320 con 0x7fda7406bb50 2024-09-22T08:36:42.653 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.639+0000 7fda80c98640 1 -- 172.21.15.142:0/1512165137 <== osd.0 v2:172.21.15.31:6800/168281188 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda7802b040 con 0x7fda7406bb50 2024-09-22T08:36:42.653 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.639+0000 7fda80c98640 1 -- 172.21.15.142:0/1512165137 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5641cd446320 con 0x5641cd43d4a0 2024-09-22T08:36:42.653 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.639+0000 7fda80c98640 1 -- 172.21.15.142:0/1512165137 <== osd.1 v2:172.21.15.142:6816/3192108003 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda7802b040 con 0x5641cd43d4a0 2024-09-22T08:36:42.654 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.639+0000 7fda80c98640 1 -- 172.21.15.142:0/1512165137 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5641cd446320 con 0x7fda7c032020 2024-09-22T08:36:42.654 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.640+0000 7fda81499640 1 -- 172.21.15.142:0/1512165137 <== osd.2 v2:172.21.15.142:6808/279438927 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fda7407dca0 con 0x7fda7c032020 2024-09-22T08:36:42.654 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.640+0000 7fda81499640 1 -- 172.21.15.142:0/1512165137 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5641cd446320 con 0x5641cd441e90 2024-09-22T08:36:42.654 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.640+0000 7fda81c9a640 1 -- 172.21.15.142:0/1512165137 <== osd.3 v2:172.21.15.142:6800/1064901393 4 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda7c0083e0 con 0x5641cd441e90 2024-09-22T08:36:42.654 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.640+0000 7fda81c9a640 1 -- 172.21.15.142:0/1512165137 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5641cd446320 con 0x5641cd441e90 2024-09-22T08:36:42.654 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.640+0000 7fda81c9a640 1 -- 172.21.15.142:0/1512165137 <== osd.3 v2:172.21.15.142:6800/1064901393 5 ==== osd_op_reply(20 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fda7c0083e0 con 0x5641cd441e90 2024-09-22T08:36:42.654 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.640+0000 7fda81c9a640 1 -- 172.21.15.142:0/1512165137 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5641cd446320 con 0x7fda7406bb50 2024-09-22T08:36:42.654 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.640+0000 7fda80c98640 1 -- 172.21.15.142:0/1512165137 <== osd.0 v2:172.21.15.31:6800/168281188 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda7802b040 con 0x7fda7406bb50 2024-09-22T08:36:42.654 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.640+0000 7fda80c98640 1 -- 172.21.15.142:0/1512165137 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5641cd446320 con 0x5641cd441e90 2024-09-22T08:36:42.654 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.641+0000 7fda81c9a640 1 -- 172.21.15.142:0/1512165137 <== osd.3 v2:172.21.15.142:6800/1064901393 6 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda7c0083e0 con 0x5641cd441e90 2024-09-22T08:36:42.654 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.641+0000 7fda81c9a640 1 -- 172.21.15.142:0/1512165137 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5641cd446320 con 0x5641cd441e90 2024-09-22T08:36:42.654 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.641+0000 7fda81c9a640 1 -- 172.21.15.142:0/1512165137 <== osd.3 v2:172.21.15.142:6800/1064901393 7 ==== osd_op_reply(23 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fda7c0083e0 con 0x5641cd441e90 2024-09-22T08:36:42.654 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.641+0000 7fda81c9a640 1 -- 172.21.15.142:0/1512165137 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5641cd446320 con 0x5641cd43d4a0 2024-09-22T08:36:42.654 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.641+0000 7fda80c98640 1 -- 172.21.15.142:0/1512165137 <== osd.1 v2:172.21.15.142:6816/3192108003 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda7802b040 con 0x5641cd43d4a0 2024-09-22T08:36:42.655 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.641+0000 7fda80c98640 1 -- 172.21.15.142:0/1512165137 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5641cd446320 con 0x5641cd43d4a0 2024-09-22T08:36:42.655 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.641+0000 7fda80c98640 1 -- 172.21.15.142:0/1512165137 <== osd.1 v2:172.21.15.142:6816/3192108003 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fda7802b040 con 0x5641cd43d4a0 2024-09-22T08:36:42.655 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.641+0000 7fda80c98640 1 -- 172.21.15.142:0/1512165137 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5641cd446320 con 0x7fda7406bb50 2024-09-22T08:36:42.655 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.641+0000 7fda80c98640 1 -- 172.21.15.142:0/1512165137 <== osd.0 v2:172.21.15.31:6800/168281188 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda7802b040 con 0x7fda7406bb50 2024-09-22T08:36:42.655 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.641+0000 7fda80c98640 1 -- 172.21.15.142:0/1512165137 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5641cd446320 con 0x5641cd441e90 2024-09-22T08:36:42.655 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.642+0000 7fda81c9a640 1 -- 172.21.15.142:0/1512165137 <== osd.3 v2:172.21.15.142:6800/1064901393 8 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda7c0083e0 con 0x5641cd441e90 2024-09-22T08:36:42.655 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.642+0000 7fda81c9a640 1 -- 172.21.15.142:0/1512165137 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5641cd446320 con 0x7fda7c032020 2024-09-22T08:36:42.655 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.642+0000 7fda81499640 1 -- 172.21.15.142:0/1512165137 <== osd.2 v2:172.21.15.142:6808/279438927 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda7407dca0 con 0x7fda7c032020 2024-09-22T08:36:42.655 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.642+0000 7fda81499640 1 -- 172.21.15.142:0/1512165137 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5641cd446320 con 0x5641cd43d4a0 2024-09-22T08:36:42.655 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.642+0000 7fda80c98640 1 -- 172.21.15.142:0/1512165137 <== osd.1 v2:172.21.15.142:6816/3192108003 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda7802b040 con 0x5641cd43d4a0 2024-09-22T08:36:42.655 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.642+0000 7fda80c98640 1 -- 172.21.15.142:0/1512165137 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5641cd446320 con 0x7fda7406bb50 2024-09-22T08:36:42.655 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.642+0000 7fda80c98640 1 -- 172.21.15.142:0/1512165137 <== osd.0 v2:172.21.15.31:6800/168281188 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda7803b040 con 0x7fda7406bb50 2024-09-22T08:36:42.655 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.642+0000 7fda80c98640 1 -- 172.21.15.142:0/1512165137 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5641cd446320 con 0x5641cd441e90 2024-09-22T08:36:42.655 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.643+0000 7fda81c9a640 1 -- 172.21.15.142:0/1512165137 <== osd.3 v2:172.21.15.142:6800/1064901393 9 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda7c0083e0 con 0x5641cd441e90 2024-09-22T08:36:42.656 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.643+0000 7fda81c9a640 1 -- 172.21.15.142:0/1512165137 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5641cd446320 con 0x7fda7406bb50 2024-09-22T08:36:42.656 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.643+0000 7fda80c98640 1 -- 172.21.15.142:0/1512165137 <== osd.0 v2:172.21.15.31:6800/168281188 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda7803b040 con 0x7fda7406bb50 2024-09-22T08:36:42.656 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.643+0000 7fda80c98640 1 -- 172.21.15.142:0/1512165137 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5641cd446320 con 0x7fda7c032020 2024-09-22T08:36:42.656 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.643+0000 7fda81499640 1 -- 172.21.15.142:0/1512165137 <== osd.2 v2:172.21.15.142:6808/279438927 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda7407dca0 con 0x7fda7c032020 2024-09-22T08:36:42.656 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.643+0000 7fda81499640 1 -- 172.21.15.142:0/1512165137 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5641cd446320 con 0x5641cd441e90 2024-09-22T08:36:42.656 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.643+0000 7fda81c9a640 1 -- 172.21.15.142:0/1512165137 <== osd.3 v2:172.21.15.142:6800/1064901393 10 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda7c0083e0 con 0x5641cd441e90 2024-09-22T08:36:42.656 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.643+0000 7fda81c9a640 1 -- 172.21.15.142:0/1512165137 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5641cd446320 con 0x7fda7406bb50 2024-09-22T08:36:42.656 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.644+0000 7fda80c98640 1 -- 172.21.15.142:0/1512165137 <== osd.0 v2:172.21.15.31:6800/168281188 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda7803b040 con 0x7fda7406bb50 2024-09-22T08:36:42.656 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.644+0000 7fda80c98640 1 -- 172.21.15.142:0/1512165137 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5641cd446320 con 0x5641cd43d4a0 2024-09-22T08:36:42.656 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.644+0000 7fda80c98640 1 -- 172.21.15.142:0/1512165137 <== osd.1 v2:172.21.15.142:6816/3192108003 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fda7803b040 con 0x5641cd43d4a0 2024-09-22T08:36:42.656 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.644+0000 7fda80c98640 1 -- 172.21.15.142:0/1512165137 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5641cd446320 con 0x7fda7c032020 2024-09-22T08:36:42.656 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.644+0000 7fda81499640 1 -- 172.21.15.142:0/1512165137 <== osd.2 v2:172.21.15.142:6808/279438927 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda7407dca0 con 0x7fda7c032020 2024-09-22T08:36:42.656 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.644+0000 7fda839af800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:36:42.656 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.644+0000 7fda839af800 20 RGWRados::pool_iterate: got zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec 2024-09-22T08:36:42.657 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.644+0000 7fda839af800 20 RGWRados::pool_iterate: got zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f 2024-09-22T08:36:42.657 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.644+0000 7fda839af800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:36:42.657 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.644+0000 7fda839af800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:36:42.657 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.644+0000 7fda839af800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:36:42.657 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.644+0000 7fda839af800 20 rados->read ofs=0 len=0 2024-09-22T08:36:42.657 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.644+0000 7fda839af800 1 -- 172.21.15.142:0/1512165137 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5641cd4453b0 con 0x5641cd43d4a0 2024-09-22T08:36:42.657 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.644+0000 7fda80c98640 1 -- 172.21.15.142:0/1512165137 <== osd.1 v2:172.21.15.142:6816/3192108003 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fda7803b040 con 0x5641cd43d4a0 2024-09-22T08:36:42.657 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.644+0000 7fda839af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:42.657 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.644+0000 7fda839af800 20 rados->read ofs=0 len=0 2024-09-22T08:36:42.657 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.644+0000 7fda839af800 1 -- 172.21.15.142:0/1512165137 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5641cd445c50 con 0x5641cd43d4a0 2024-09-22T08:36:42.657 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.645+0000 7fda80c98640 1 -- 172.21.15.142:0/1512165137 <== osd.1 v2:172.21.15.142:6816/3192108003 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fda7803b040 con 0x5641cd43d4a0 2024-09-22T08:36:42.657 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.645+0000 7fda839af800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:36:42.657 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.645+0000 7fda839af800 20 rados->read ofs=0 len=0 2024-09-22T08:36:42.657 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.645+0000 7fda839af800 1 -- 172.21.15.142:0/1512165137 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:40 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5641cd4467a0 con 0x5641cd441e90 2024-09-22T08:36:42.657 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.645+0000 7fda81c9a640 1 -- 172.21.15.142:0/1512165137 <== osd.3 v2:172.21.15.142:6800/1064901393 11 ==== osd_op_reply(40 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fda7c0083e0 con 0x5641cd441e90 2024-09-22T08:36:42.658 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.645+0000 7fda839af800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:36:42.658 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.645+0000 7fda839af800 20 zone default found 2024-09-22T08:36:42.658 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.645+0000 7fda839af800 4 Realm: () 2024-09-22T08:36:42.658 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.645+0000 7fda839af800 4 ZoneGroup: default (d89f6f57-1007-47dd-9065-f486c7b01aec) 2024-09-22T08:36:42.658 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.645+0000 7fda839af800 4 Zone: default (e239248c-0bee-4e41-803a-24b288d3eb8f) 2024-09-22T08:36:42.658 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.645+0000 7fda839af800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:36:42.658 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.645+0000 7fda839af800 20 zonegroup default 2024-09-22T08:36:42.658 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.645+0000 7fda839af800 20 rados->read ofs=0 len=0 2024-09-22T08:36:42.658 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.645+0000 7fda839af800 1 -- 172.21.15.142:0/1512165137 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5641cd446ba0 con 0x7fda7406bb50 2024-09-22T08:36:42.658 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.645+0000 7fda80c98640 1 -- 172.21.15.142:0/1512165137 <== osd.0 v2:172.21.15.31:6800/168281188 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fda7803b040 con 0x7fda7406bb50 2024-09-22T08:36:42.658 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.645+0000 7fda839af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:42.658 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.645+0000 7fda839af800 20 rados->read ofs=0 len=0 2024-09-22T08:36:42.658 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.645+0000 7fda839af800 1 -- 172.21.15.142:0/1512165137 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5641cd4489d0 con 0x5641cd441e90 2024-09-22T08:36:42.658 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.645+0000 7fda81c9a640 1 -- 172.21.15.142:0/1512165137 <== osd.3 v2:172.21.15.142:6800/1064901393 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fda7c0083e0 con 0x5641cd441e90 2024-09-22T08:36:42.659 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.645+0000 7fda839af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:42.659 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.645+0000 7fda839af800 20 rados->read ofs=0 len=0 2024-09-22T08:36:42.659 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.645+0000 7fda839af800 1 -- 172.21.15.142:0/1512165137 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5641cd448e20 con 0x5641cd441e90 2024-09-22T08:36:42.659 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.646+0000 7fda81c9a640 1 -- 172.21.15.142:0/1512165137 <== osd.3 v2:172.21.15.142:6800/1064901393 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fda7c0083e0 con 0x5641cd441e90 2024-09-22T08:36:42.659 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.646+0000 7fda839af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:42.659 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.646+0000 7fda839af800 20 started sync module instance, tier type = 2024-09-22T08:36:42.659 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.646+0000 7fda839af800 20 started zone id=e239248c-0bee-4e41-803a-24b288d3eb8f (name=default) with tier type = 2024-09-22T08:36:42.659 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.646+0000 7fda839af800 1 -- 172.21.15.142:0/1512165137 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5641cd447e70 con 0x7fda7c032020 2024-09-22T08:36:42.659 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.647+0000 7fda81499640 1 -- 172.21.15.142:0/1512165137 <== osd.2 v2:172.21.15.142:6808/279438927 7 ==== osd_op_reply(44 notify.0 [create] v30'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda7407dca0 con 0x7fda7c032020 2024-09-22T08:36:42.659 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.647+0000 7fda839af800 1 -- 172.21.15.142:0/1512165137 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94840616679872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5641cd449280 con 0x7fda7c032020 2024-09-22T08:36:42.659 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.647+0000 7fda839af800 1 -- 172.21.15.142:0/1512165137 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5641cd449ad0 con 0x5641cd43d4a0 2024-09-22T08:36:42.666 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.648+0000 7fda81499640 1 -- 172.21.15.142:0/1512165137 <== osd.2 v2:172.21.15.142:6808/279438927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94840616679872] v30'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda7407dca0 con 0x7fda7c032020 2024-09-22T08:36:42.666 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.648+0000 7fda80c98640 1 -- 172.21.15.142:0/1512165137 <== osd.1 v2:172.21.15.142:6816/3192108003 15 ==== osd_op_reply(46 notify.1 [create] v30'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda7803b040 con 0x5641cd43d4a0 2024-09-22T08:36:42.666 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.648+0000 7fda839af800 1 -- 172.21.15.142:0/1512165137 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94840616682128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5641cd449c10 con 0x5641cd43d4a0 2024-09-22T08:36:42.666 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.648+0000 7fda839af800 1 -- 172.21.15.142:0/1512165137 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5641cd44a730 con 0x5641cd441e90 2024-09-22T08:36:42.666 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.649+0000 7fda80c98640 1 -- 172.21.15.142:0/1512165137 <== osd.1 v2:172.21.15.142:6816/3192108003 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94840616682128] v30'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda7803b040 con 0x5641cd43d4a0 2024-09-22T08:36:42.666 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.649+0000 7fda81c9a640 1 -- 172.21.15.142:0/1512165137 <== osd.3 v2:172.21.15.142:6800/1064901393 14 ==== osd_op_reply(48 notify.2 [create] v30'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda7c0083e0 con 0x5641cd441e90 2024-09-22T08:36:42.666 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.649+0000 7fda839af800 1 -- 172.21.15.142:0/1512165137 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94840616690176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5641cd44a6f0 con 0x5641cd441e90 2024-09-22T08:36:42.666 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.649+0000 7fda839af800 1 -- 172.21.15.142:0/1512165137 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5641cd44b1b0 con 0x7fda7c032020 2024-09-22T08:36:42.666 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.650+0000 7fda81499640 1 -- 172.21.15.142:0/1512165137 <== osd.2 v2:172.21.15.142:6808/279438927 9 ==== osd_op_reply(50 notify.3 [create] v30'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda7407dca0 con 0x7fda7c032020 2024-09-22T08:36:42.666 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.650+0000 7fda839af800 1 -- 172.21.15.142:0/1512165137 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94840616692928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5641cd44ba50 con 0x7fda7c032020 2024-09-22T08:36:42.667 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.650+0000 7fda839af800 1 -- 172.21.15.142:0/1512165137 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5641cd44c510 con 0x5641cd43d4a0 2024-09-22T08:36:42.667 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.650+0000 7fda81c9a640 1 -- 172.21.15.142:0/1512165137 <== osd.3 v2:172.21.15.142:6800/1064901393 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94840616690176] v30'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda7c0083e0 con 0x5641cd441e90 2024-09-22T08:36:42.667 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.651+0000 7fda80c98640 1 -- 172.21.15.142:0/1512165137 <== osd.1 v2:172.21.15.142:6816/3192108003 17 ==== osd_op_reply(52 notify.4 [create] v30'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda7803b040 con 0x5641cd43d4a0 2024-09-22T08:36:42.667 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.651+0000 7fda839af800 1 -- 172.21.15.142:0/1512165137 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94840616697920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5641cd44c930 con 0x5641cd43d4a0 2024-09-22T08:36:42.667 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.651+0000 7fda839af800 1 -- 172.21.15.142:0/1512165137 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5641cd44d330 con 0x7fda7406bb50 2024-09-22T08:36:42.667 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.651+0000 7fda81499640 1 -- 172.21.15.142:0/1512165137 <== osd.2 v2:172.21.15.142:6808/279438927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94840616692928] v30'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda7407dca0 con 0x7fda7c032020 2024-09-22T08:36:42.667 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.653+0000 7fda80c98640 1 -- 172.21.15.142:0/1512165137 <== osd.0 v2:172.21.15.31:6800/168281188 11 ==== osd_op_reply(54 notify.5 [create] v30'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda7803b040 con 0x7fda7406bb50 2024-09-22T08:36:42.667 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.653+0000 7fda839af800 1 -- 172.21.15.142:0/1512165137 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94840616695200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5641cd44d2f0 con 0x7fda7406bb50 2024-09-22T08:36:42.667 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.653+0000 7fda839af800 1 -- 172.21.15.142:0/1512165137 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5641cd44dd90 con 0x7fda7406bb50 2024-09-22T08:36:42.667 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.653+0000 7fda80c98640 1 -- 172.21.15.142:0/1512165137 <== osd.1 v2:172.21.15.142:6816/3192108003 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94840616697920] v30'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda7803b040 con 0x5641cd43d4a0 2024-09-22T08:36:42.667 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.653+0000 7fda80c98640 1 -- 172.21.15.142:0/1512165137 <== osd.0 v2:172.21.15.31:6800/168281188 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94840616695200] v30'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda7803b040 con 0x7fda7406bb50 2024-09-22T08:36:42.667 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.654+0000 7fda80c98640 1 -- 172.21.15.142:0/1512165137 <== osd.0 v2:172.21.15.31:6800/168281188 13 ==== osd_op_reply(56 notify.6 [create] v30'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda7803b040 con 0x7fda7406bb50 2024-09-22T08:36:42.667 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.654+0000 7fda839af800 1 -- 172.21.15.142:0/1512165137 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94840616704096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5641cd44ce40 con 0x7fda7406bb50 2024-09-22T08:36:42.667 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.654+0000 7fda839af800 1 -- 172.21.15.142:0/1512165137 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5641cd44e630 con 0x7fda7406bb50 2024-09-22T08:36:42.668 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.655+0000 7fda80c98640 1 -- 172.21.15.142:0/1512165137 <== osd.0 v2:172.21.15.31:6800/168281188 14 ==== osd_op_reply(58 notify.7 [create] v30'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda7803b040 con 0x7fda7406bb50 2024-09-22T08:36:42.668 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.655+0000 7fda80c98640 1 -- 172.21.15.142:0/1512165137 <== osd.0 v2:172.21.15.31:6800/168281188 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94840616704096] v30'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda7803b040 con 0x7fda7406bb50 2024-09-22T08:36:42.668 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.655+0000 7fda839af800 1 -- 172.21.15.142:0/1512165137 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94840616706432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5641cd44ce40 con 0x7fda7406bb50 2024-09-22T08:36:42.668 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.655+0000 7fda839af800 20 add_watcher() i=0 2024-09-22T08:36:42.668 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.655+0000 7fda839af800 20 add_watcher() i=1 2024-09-22T08:36:42.668 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.655+0000 7fda839af800 20 add_watcher() i=2 2024-09-22T08:36:42.668 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.655+0000 7fda839af800 20 add_watcher() i=3 2024-09-22T08:36:42.668 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.655+0000 7fda839af800 20 add_watcher() i=4 2024-09-22T08:36:42.668 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.655+0000 7fda839af800 20 add_watcher() i=5 2024-09-22T08:36:42.668 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.655+0000 7fda839af800 20 add_watcher() i=6 2024-09-22T08:36:42.668 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.656+0000 7fda80c98640 1 -- 172.21.15.142:0/1512165137 <== osd.0 v2:172.21.15.31:6800/168281188 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94840616706432] v30'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda7803b040 con 0x7fda7406bb50 2024-09-22T08:36:42.668 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.656+0000 7fda839af800 20 add_watcher() i=7 2024-09-22T08:36:42.668 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.656+0000 7fda839af800 2 all 8 watchers are set, enabling cache 2024-09-22T08:36:42.668 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.656+0000 7fda839af800 1 -- 172.21.15.142:0/1512165137 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5641cd451b00 con 0x5641cd43d4a0 2024-09-22T08:36:42.669 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.656+0000 7fda80c98640 1 -- 172.21.15.142:0/1512165137 <== osd.1 v2:172.21.15.142:6816/3192108003 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fda7803b040 con 0x5641cd43d4a0 2024-09-22T08:36:42.669 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.656+0000 7fda839af800 1 -- 172.21.15.142:0/1512165137 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94840616707488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5641cd44ef80 con 0x5641cd43d4a0 2024-09-22T08:36:42.669 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.657+0000 7fda80c98640 1 -- 172.21.15.142:0/1512165137 <== osd.1 v2:172.21.15.142:6816/3192108003 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94840616707488] v30'50 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fda7803b040 con 0x5641cd43d4a0 2024-09-22T08:36:42.669 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.657+0000 7fd9377e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:36:42.669 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.657+0000 7fda839af800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:36:42.669 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.657+0000 7fda839af800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:36:42.669 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.657+0000 7fda839af800 5 note: GC not initialized 2024-09-22T08:36:42.669 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.658+0000 7fd9367e4640 20 reqs_thread_entry: start 2024-09-22T08:36:42.669 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.658+0000 7fda839af800 20 init_complete bucket index max shards: 11 2024-09-22T08:36:42.669 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.658+0000 7fda839af800 20 Filter name: none 2024-09-22T08:36:42.669 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.658+0000 7fd8a7fff640 20 reqs_thread_entry: start 2024-09-22T08:36:42.669 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.658+0000 7fda839af800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-22T08:36:42.669 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.658+0000 7fda839af800 20 rados->read ofs=0 len=0 2024-09-22T08:36:42.669 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.658+0000 7fda839af800 1 -- 172.21.15.142:0/1512165137 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5641cd484bc0 con 0x5641cd43d4a0 2024-09-22T08:36:42.670 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.658+0000 7fda80c98640 1 -- 172.21.15.142:0/1512165137 <== osd.1 v2:172.21.15.142:6816/3192108003 21 ==== osd_op_reply(62 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7fda7803b040 con 0x5641cd43d4a0 2024-09-22T08:36:42.670 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.658+0000 7fda839af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:42.670 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.658+0000 7fda839af800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x0 2024-09-22T08:36:42.670 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.658+0000 7fda839af800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-22T08:36:42.670 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.658+0000 7fda839af800 10 cache get: name=default.rgw.meta+users.email+foo@foo.com : miss 2024-09-22T08:36:42.670 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.658+0000 7fda839af800 20 rados->read ofs=0 len=0 2024-09-22T08:36:42.670 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.658+0000 7fda839af800 1 -- 172.21.15.142:0/1512165137 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:63 8.3 8:c162d5d1:users.email::foo@foo.com:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5641cd483100 con 0x5641cd43d4a0 2024-09-22T08:36:42.670 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.660+0000 7fda80c98640 1 -- 172.21.15.142:0/1512165137 <== osd.1 v2:172.21.15.142:6816/3192108003 22 ==== osd_op_reply(63 foo@foo.com [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 197+0+0 (crc 0 0 0) 0x7fda7803b040 con 0x5641cd43d4a0 2024-09-22T08:36:42.670 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.660+0000 7fda839af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:42.670 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.660+0000 7fda839af800 10 cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x0 2024-09-22T08:36:42.670 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.660+0000 7fda839af800 10 adding default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-09-22T08:36:42.670 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.660+0000 7fda839af800 10 cache get: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 : miss 2024-09-22T08:36:42.670 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.660+0000 7fda839af800 20 rados->read ofs=0 len=0 2024-09-22T08:36:42.670 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.660+0000 7fda839af800 1 -- 172.21.15.142:0/1512165137 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:64 8.7 8:e4e0e270:users.keys::9te6NH5mcdcq0Tc5i8i1:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5641cd483100 con 0x7fda7406bb50 2024-09-22T08:36:42.671 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.660+0000 7fda80c98640 1 -- 172.21.15.142:0/1512165137 <== osd.0 v2:172.21.15.31:6800/168281188 17 ==== osd_op_reply(64 9te6NH5mcdcq0Tc5i8i1 [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7fda7803b040 con 0x7fda7406bb50 2024-09-22T08:36:42.671 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.660+0000 7fda839af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:42.671 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.660+0000 7fda839af800 10 cache put: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 info.flags=0x0 2024-09-22T08:36:42.671 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.660+0000 7fda839af800 10 adding default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 to cache LRU end 2024-09-22T08:36:42.671 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.660+0000 7fda839af800 10 cache get: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 : hit (negative entry) 2024-09-22T08:36:42.671 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.660+0000 7fda839af800 10 cache get: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 : hit (negative entry) 2024-09-22T08:36:42.671 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.660+0000 7fda839af800 1 -- 172.21.15.142:0/1512165137 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:65 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5641cd483b30 con 0x5641cd43d4a0 2024-09-22T08:36:42.671 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.660+0000 7fda80c98640 1 -- 172.21.15.142:0/1512165137 <== osd.1 v2:172.21.15.142:6816/3192108003 23 ==== osd_op_reply(65 foo [delete,create,call,writefull 0~391] v30'1 uv1 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7fda7803b040 con 0x5641cd43d4a0 2024-09-22T08:36:42.671 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.660+0000 7fda839af800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-22T08:36:42.671 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.660+0000 7fda839af800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-22T08:36:42.671 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.660+0000 7fda839af800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-22T08:36:42.671 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.660+0000 7fda839af800 1 -- 172.21.15.142:0/1512165137 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify cookie 94840616924560 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5641cd488610 con 0x5641cd43d4a0 2024-09-22T08:36:42.671 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.660+0000 7fda80c98640 1 -- 172.21.15.142:0/1512165137 <== osd.1 v2:172.21.15.142:6816/3192108003 24 ==== watch-notify(notify (1) cookie 94840616697920 notify 128849018880 ret 0) ==== 609+0+0 (crc 0 0 0) 0x5641cd483ed0 con 0x5641cd43d4a0 2024-09-22T08:36:42.671 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.660+0000 7fd964ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018880 cookie 94840616697920 notifier 4289 bl.length()=567 2024-09-22T08:36:42.672 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.660+0000 7fda80c98640 1 -- 172.21.15.142:0/1512165137 <== osd.1 v2:172.21.15.142:6816/3192108003 25 ==== osd_op_reply(66 notify.4 [notify cookie 94840616924560 out=8b] v0'0 uv24 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fda7803b040 con 0x5641cd43d4a0 2024-09-22T08:36:42.672 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.660+0000 7fd964ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-22T08:36:42.672 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.660+0000 7fd964ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-22T08:36:42.672 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.660+0000 7fd964ff9640 1 -- 172.21.15.142:0/1512165137 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:67 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7fd944003ea0 con 0x5641cd43d4a0 2024-09-22T08:36:42.672 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.662+0000 7fda80c98640 1 -- 172.21.15.142:0/1512165137 <== osd.1 v2:172.21.15.142:6816/3192108003 26 ==== osd_op_reply(67 notify.4 [notify-ack] v0'0 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda7803b040 con 0x5641cd43d4a0 2024-09-22T08:36:42.672 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.662+0000 7fda80c98640 1 -- 172.21.15.142:0/1512165137 <== osd.1 v2:172.21.15.142:6816/3192108003 27 ==== watch-notify(notify_complete (2) cookie 94840616924560 notify 128849018880 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5641cd484700 con 0x5641cd43d4a0 2024-09-22T08:36:42.672 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.662+0000 7fda839af800 1 -- 172.21.15.142:0/1512165137 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:68 8.3 8:c162d5d1:users.email::foo@foo.com:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5641cd483520 con 0x5641cd43d4a0 2024-09-22T08:36:42.672 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.662+0000 7fda80c98640 1 -- 172.21.15.142:0/1512165137 <== osd.1 v2:172.21.15.142:6816/3192108003 28 ==== osd_op_reply(68 foo@foo.com [delete,create,writefull 0~7] v30'1 uv1 ondisk = 0) ==== 239+0+0 (crc 0 0 0) 0x7fda7803b040 con 0x5641cd43d4a0 2024-09-22T08:36:42.672 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.662+0000 7fda839af800 10 cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x7 2024-09-22T08:36:42.672 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.662+0000 7fda839af800 10 moving default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-09-22T08:36:42.672 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.662+0000 7fda839af800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:foo@foo.com, ofs0, ns] 2024-09-22T08:36:42.672 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.662+0000 7fda839af800 1 -- 172.21.15.142:0/1512165137 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [notify cookie 94840616924448 in=181b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5641cd488a40 con 0x7fda7c032020 2024-09-22T08:36:42.672 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.663+0000 7fda81499640 1 -- 172.21.15.142:0/1512165137 <== osd.2 v2:172.21.15.142:6808/279438927 11 ==== watch-notify(notify (1) cookie 94840616692928 notify 128849018880 ret 0) ==== 211+0+0 (crc 0 0 0) 0x7fda740aa060 con 0x7fda7c032020 2024-09-22T08:36:42.672 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.663+0000 7fd964ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018880 cookie 94840616692928 notifier 4289 bl.length()=169 2024-09-22T08:36:42.673 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.663+0000 7fd964ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x7 2024-09-22T08:36:42.673 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.663+0000 7fd964ff9640 10 rgw watcher librados: moving default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-09-22T08:36:42.673 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.663+0000 7fda81499640 1 -- 172.21.15.142:0/1512165137 <== osd.2 v2:172.21.15.142:6808/279438927 12 ==== osd_op_reply(69 notify.3 [notify cookie 94840616924448 out=8b] v0'0 uv24 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fda7407dca0 con 0x7fda7c032020 2024-09-22T08:36:42.673 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.663+0000 7fd964ff9640 1 -- 172.21.15.142:0/1512165137 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7fd944003ea0 con 0x7fda7c032020 2024-09-22T08:36:42.673 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.663+0000 7fda81499640 1 -- 172.21.15.142:0/1512165137 <== osd.2 v2:172.21.15.142:6808/279438927 13 ==== osd_op_reply(70 notify.3 [notify-ack] v0'0 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda7407dca0 con 0x7fda7c032020 2024-09-22T08:36:42.673 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.663+0000 7fda81499640 1 -- 172.21.15.142:0/1512165137 <== osd.2 v2:172.21.15.142:6808/279438927 14 ==== watch-notify(notify_complete (2) cookie 94840616924448 notify 128849018880 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5641cd403d80 con 0x7fda7c032020 2024-09-22T08:36:42.673 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.663+0000 7fda839af800 1 -- 172.21.15.142:0/1512165137 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:71 8.7 8:e4e0e270:users.keys::9te6NH5mcdcq0Tc5i8i1:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5641cd483520 con 0x7fda7406bb50 2024-09-22T08:36:42.675 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.665+0000 7fda80c98640 1 -- 172.21.15.142:0/1512165137 <== osd.0 v2:172.21.15.31:6800/168281188 18 ==== osd_op_reply(71 9te6NH5mcdcq0Tc5i8i1 [delete,create,writefull 0~7] v30'1 uv1 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7fda7803b040 con 0x7fda7406bb50 2024-09-22T08:36:42.675 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.665+0000 7fda839af800 10 cache put: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 info.flags=0x7 2024-09-22T08:36:42.675 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.665+0000 7fda839af800 10 moving default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 to cache LRU end 2024-09-22T08:36:42.675 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.665+0000 7fda839af800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.keys:9te6NH5mcdcq0Tc5i8i1, ofs0, ns] 2024-09-22T08:36:42.675 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.665+0000 7fda839af800 1 -- 172.21.15.142:0/1512165137 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:72 7.e 7:7759931f:::notify.3:head [notify cookie 94840616924448 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5641cd488a40 con 0x7fda7c032020 2024-09-22T08:36:42.675 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.665+0000 7fda81499640 1 -- 172.21.15.142:0/1512165137 <== osd.2 v2:172.21.15.142:6808/279438927 15 ==== watch-notify(notify (1) cookie 94840616692928 notify 128849018881 ret 0) ==== 219+0+0 (crc 0 0 0) 0x5641cd403d80 con 0x7fda7c032020 2024-09-22T08:36:42.675 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.665+0000 7fda81499640 1 -- 172.21.15.142:0/1512165137 <== osd.2 v2:172.21.15.142:6808/279438927 16 ==== osd_op_reply(72 notify.3 [notify cookie 94840616924448 out=8b] v0'0 uv24 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fda7407dca0 con 0x7fda7c032020 2024-09-22T08:36:42.675 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.665+0000 7fd964ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018881 cookie 94840616692928 notifier 4289 bl.length()=177 2024-09-22T08:36:42.675 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.665+0000 7fd964ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 info.flags=0x7 2024-09-22T08:36:42.675 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.665+0000 7fd964ff9640 10 rgw watcher librados: moving default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 to cache LRU end 2024-09-22T08:36:42.676 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.665+0000 7fd964ff9640 1 -- 172.21.15.142:0/1512165137 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7fd944003ea0 con 0x7fda7c032020 2024-09-22T08:36:42.676 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.665+0000 7fda81499640 1 -- 172.21.15.142:0/1512165137 <== osd.2 v2:172.21.15.142:6808/279438927 17 ==== watch-notify(notify_complete (2) cookie 94840616924448 notify 128849018881 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5641cd403380 con 0x7fda7c032020 2024-09-22T08:36:42.676 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.665+0000 7fda81499640 1 -- 172.21.15.142:0/1512165137 <== osd.2 v2:172.21.15.142:6808/279438927 18 ==== osd_op_reply(73 notify.3 [notify-ack] v0'0 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda7407dca0 con 0x7fda7c032020 2024-09-22T08:36:42.676 INFO:teuthology.orchestra.run.smithi142.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-22T08:36:42.661297Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-22T08:36:42.661288Z","tags":[],"group_ids":[]} 2024-09-22T08:36:42.680 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.666+0000 7fd9377e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:36:42.681 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.666+0000 7fda839af800 1 -- 172.21.15.142:0/1512165137 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:74 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94840616707488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5641cd482830 con 0x5641cd43d4a0 2024-09-22T08:36:42.681 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.667+0000 7fda80c98640 1 -- 172.21.15.142:0/1512165137 <== osd.1 v2:172.21.15.142:6816/3192108003 29 ==== osd_op_reply(74 data_loggenerations_metadata [watch unwatch cookie 94840616707488] v30'51 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fda7803b040 con 0x5641cd43d4a0 2024-09-22T08:36:42.681 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.667+0000 7fda839af800 1 -- 172.21.15.142:0/1512165137 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:75 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94840616679872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5641cd482830 con 0x7fda7c032020 2024-09-22T08:36:42.681 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.669+0000 7fda81499640 1 -- 172.21.15.142:0/1512165137 <== osd.2 v2:172.21.15.142:6808/279438927 19 ==== osd_op_reply(75 notify.0 [watch unwatch cookie 94840616679872] v30'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda7407dca0 con 0x7fda7c032020 2024-09-22T08:36:42.681 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.669+0000 7fda839af800 20 remove_watcher() i=0 2024-09-22T08:36:42.681 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.669+0000 7fda839af800 2 removed watcher, disabling cache 2024-09-22T08:36:42.681 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.669+0000 7fda839af800 1 -- 172.21.15.142:0/1512165137 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:76 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94840616682128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5641cd482830 con 0x5641cd43d4a0 2024-09-22T08:36:42.681 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.670+0000 7fda80c98640 1 -- 172.21.15.142:0/1512165137 <== osd.1 v2:172.21.15.142:6816/3192108003 30 ==== osd_op_reply(76 notify.1 [watch unwatch cookie 94840616682128] v30'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda7803b040 con 0x5641cd43d4a0 2024-09-22T08:36:42.681 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.670+0000 7fda839af800 20 remove_watcher() i=1 2024-09-22T08:36:42.681 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.670+0000 7fda839af800 1 -- 172.21.15.142:0/1512165137 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:77 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94840616690176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5641cd482830 con 0x5641cd441e90 2024-09-22T08:36:42.681 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.671+0000 7fda81c9a640 1 -- 172.21.15.142:0/1512165137 <== osd.3 v2:172.21.15.142:6800/1064901393 16 ==== osd_op_reply(77 notify.2 [watch unwatch cookie 94840616690176] v30'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda7c0083e0 con 0x5641cd441e90 2024-09-22T08:36:42.681 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.671+0000 7fda839af800 20 remove_watcher() i=2 2024-09-22T08:36:42.682 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.671+0000 7fda839af800 1 -- 172.21.15.142:0/1512165137 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:78 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94840616692928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5641cd482830 con 0x7fda7c032020 2024-09-22T08:36:42.682 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.671+0000 7fda81499640 1 -- 172.21.15.142:0/1512165137 <== osd.2 v2:172.21.15.142:6808/279438927 20 ==== osd_op_reply(78 notify.3 [watch unwatch cookie 94840616692928] v30'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda7407dca0 con 0x7fda7c032020 2024-09-22T08:36:42.682 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.671+0000 7fda839af800 20 remove_watcher() i=3 2024-09-22T08:36:42.682 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.671+0000 7fda839af800 1 -- 172.21.15.142:0/1512165137 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:79 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94840616697920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5641cd482830 con 0x5641cd43d4a0 2024-09-22T08:36:42.682 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.674+0000 7fda80c98640 1 -- 172.21.15.142:0/1512165137 <== osd.1 v2:172.21.15.142:6816/3192108003 31 ==== osd_op_reply(79 notify.4 [watch unwatch cookie 94840616697920] v30'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda7803b040 con 0x5641cd43d4a0 2024-09-22T08:36:42.682 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.674+0000 7fda839af800 20 remove_watcher() i=4 2024-09-22T08:36:42.682 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.674+0000 7fda839af800 1 -- 172.21.15.142:0/1512165137 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:80 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94840616695200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5641cd482830 con 0x7fda7406bb50 2024-09-22T08:36:42.682 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.674+0000 7fda80c98640 1 -- 172.21.15.142:0/1512165137 <== osd.0 v2:172.21.15.31:6800/168281188 19 ==== osd_op_reply(80 notify.5 [watch unwatch cookie 94840616695200] v30'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda7803b040 con 0x7fda7406bb50 2024-09-22T08:36:42.682 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.674+0000 7fda839af800 20 remove_watcher() i=5 2024-09-22T08:36:42.682 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.674+0000 7fda839af800 1 -- 172.21.15.142:0/1512165137 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:81 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94840616704096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5641cd482830 con 0x7fda7406bb50 2024-09-22T08:36:42.682 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.675+0000 7fda80c98640 1 -- 172.21.15.142:0/1512165137 <== osd.0 v2:172.21.15.31:6800/168281188 20 ==== osd_op_reply(81 notify.6 [watch unwatch cookie 94840616704096] v30'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda7803b040 con 0x7fda7406bb50 2024-09-22T08:36:42.682 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.675+0000 7fda839af800 20 remove_watcher() i=6 2024-09-22T08:36:42.682 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.675+0000 7fda839af800 1 -- 172.21.15.142:0/1512165137 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:82 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94840616706432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5641cd482830 con 0x7fda7406bb50 2024-09-22T08:36:42.682 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.676+0000 7fda80c98640 1 -- 172.21.15.142:0/1512165137 <== osd.0 v2:172.21.15.31:6800/168281188 21 ==== osd_op_reply(82 notify.7 [watch unwatch cookie 94840616706432] v30'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda7803b040 con 0x7fda7406bb50 2024-09-22T08:36:42.683 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.676+0000 7fda839af800 20 remove_watcher() i=7 2024-09-22T08:36:42.683 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.676+0000 7fda839af800 1 -- 172.21.15.142:0/1512165137 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7fda7406bb50 msgr2=0x7fda7406b380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:42.683 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.676+0000 7fda839af800 1 --2- 172.21.15.142:0/1512165137 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7fda7406bb50 0x7fda7406b380 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:42.683 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.676+0000 7fda839af800 1 -- 172.21.15.142:0/1512165137 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5641cd43d4a0 msgr2=0x5641cd43f960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:42.683 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.676+0000 7fda839af800 1 --2- 172.21.15.142:0/1512165137 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5641cd43d4a0 0x5641cd43f960 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:42.683 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.676+0000 7fda839af800 1 -- 172.21.15.142:0/1512165137 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7fda7c032020 msgr2=0x7fda7c03ca00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:42.683 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.676+0000 7fda839af800 1 --2- 172.21.15.142:0/1512165137 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7fda7c032020 0x7fda7c03ca00 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:42.683 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.676+0000 7fda839af800 1 -- 172.21.15.142:0/1512165137 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5641cd441e90 msgr2=0x5641cd444280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:42.683 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.676+0000 7fda839af800 1 --2- 172.21.15.142:0/1512165137 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5641cd441e90 0x5641cd444280 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:42.683 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.676+0000 7fda839af800 1 -- 172.21.15.142:0/1512165137 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fd94c03d000 msgr2=0x7fd94c03f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:42.683 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.676+0000 7fda839af800 1 --2- 172.21.15.142:0/1512165137 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fd94c03d000 0x7fd94c03f4c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fda740943f0 tx=0x7fda74085000 comp rx=0 tx=0).stop 2024-09-22T08:36:42.683 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.676+0000 7fda839af800 1 -- 172.21.15.142:0/1512165137 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5641cd42a570 msgr2=0x5641cd431ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:42.683 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.676+0000 7fda80c98640 1 -- 172.21.15.142:0/1512165137 reap_dead start 2024-09-22T08:36:42.683 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.676+0000 7fda839af800 1 --2- 172.21.15.142:0/1512165137 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5641cd42a570 0x5641cd431ae0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fda7c0154a0 tx=0x7fda7c053d50 comp rx=0 tx=0).stop 2024-09-22T08:36:42.684 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.676+0000 7fda839af800 1 -- 172.21.15.142:0/1512165137 shutdown_connections 2024-09-22T08:36:42.684 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.676+0000 7fda839af800 1 --2- 172.21.15.142:0/1512165137 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5641cd42a570 0x5641cd431ae0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:42.684 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.676+0000 7fda839af800 1 -- 172.21.15.142:0/1512165137 >> 172.21.15.142:0/1512165137 conn(0x5641cd426970 msgr2=0x5641cd424b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:42.684 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.676+0000 7fda839af800 1 -- 172.21.15.142:0/1512165137 shutdown_connections 2024-09-22T08:36:42.684 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.676+0000 7fda839af800 1 -- 172.21.15.142:0/1512165137 wait complete. 2024-09-22T08:36:42.684 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.676+0000 7fda839af800 1 -- 172.21.15.142:0/230331369 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fd95803cfb0 msgr2=0x7fd95803f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:42.684 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.676+0000 7fda839af800 1 --2- 172.21.15.142:0/230331369 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fd95803cfb0 0x7fd95803f470 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x5641cd40a860 tx=0x7fda74096cd0 comp rx=0 tx=0).stop 2024-09-22T08:36:42.684 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.676+0000 7fda839af800 1 -- 172.21.15.142:0/230331369 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5641cd41db10 msgr2=0x5641cd41df30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:42.684 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.676+0000 7fda839af800 1 --2- 172.21.15.142:0/230331369 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5641cd41db10 0x5641cd41df30 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x5641cd403a20 tx=0x7fda7c00bf30 comp rx=0 tx=0).stop 2024-09-22T08:36:42.684 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.676+0000 7fda839af800 1 -- 172.21.15.142:0/230331369 shutdown_connections 2024-09-22T08:36:42.684 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.676+0000 7fda839af800 1 --2- 172.21.15.142:0/230331369 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fd95803cfb0 0x7fd95803f470 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:42.684 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.676+0000 7fda839af800 1 --2- 172.21.15.142:0/230331369 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5641cd41db10 0x5641cd41df30 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:42.684 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.676+0000 7fda839af800 1 -- 172.21.15.142:0/230331369 >> 172.21.15.142:0/230331369 conn(0x5641cd411ec0 msgr2=0x5641cd4122a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:42.684 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.677+0000 7fda839af800 1 -- 172.21.15.142:0/230331369 shutdown_connections 2024-09-22T08:36:42.685 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.677+0000 7fda839af800 1 -- 172.21.15.142:0/230331369 wait complete. 2024-09-22T08:36:42.685 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.677+0000 7fda839af800 1 -- 172.21.15.142:0/3895711368 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5641cd30ca70 msgr2=0x5641cd40a1e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:42.685 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.677+0000 7fda839af800 1 --2- 172.21.15.142:0/3895711368 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5641cd30ca70 0x5641cd40a1e0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:42.685 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.677+0000 7fda839af800 1 -- 172.21.15.142:0/3895711368 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5641cd40c670 msgr2=0x5641cd40ea60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:42.685 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.677+0000 7fda839af800 1 --2- 172.21.15.142:0/3895711368 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5641cd40c670 0x5641cd40ea60 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:42.685 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.677+0000 7fda839af800 1 -- 172.21.15.142:0/3895711368 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fd96803cfb0 msgr2=0x7fd96803f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:42.685 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.677+0000 7fda839af800 1 --2- 172.21.15.142:0/3895711368 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fd96803cfb0 0x7fd96803f470 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fda78000c00 tx=0x7fda780013b0 comp rx=0 tx=0).stop 2024-09-22T08:36:42.685 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.677+0000 7fda839af800 1 -- 172.21.15.142:0/3895711368 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5641cd30a140 msgr2=0x5641cd402b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:42.685 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.677+0000 7fda839af800 1 --2- 172.21.15.142:0/3895711368 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5641cd30a140 0x5641cd402b90 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fda74005bf0 tx=0x7fda74003330 comp rx=0 tx=0).stop 2024-09-22T08:36:42.685 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.677+0000 7fda839af800 1 -- 172.21.15.142:0/3895711368 shutdown_connections 2024-09-22T08:36:42.685 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.677+0000 7fda839af800 1 --2- 172.21.15.142:0/3895711368 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5641cd40c670 0x5641cd40ea60 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:42.685 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.677+0000 7fda839af800 1 --2- 172.21.15.142:0/3895711368 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5641cd30ca70 0x5641cd40a1e0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:42.685 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.677+0000 7fda839af800 1 --2- 172.21.15.142:0/3895711368 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fd96803cfb0 0x7fd96803f470 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:42.685 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.677+0000 7fda839af800 1 --2- 172.21.15.142:0/3895711368 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5641cd30a140 0x5641cd402b90 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:42.686 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.677+0000 7fda839af800 1 -- 172.21.15.142:0/3895711368 >> 172.21.15.142:0/3895711368 conn(0x5641cd303c00 msgr2=0x5641cd3f4410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:42.686 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.677+0000 7fda839af800 1 -- 172.21.15.142:0/3895711368 shutdown_connections 2024-09-22T08:36:42.686 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.677+0000 7fda839af800 1 -- 172.21.15.142:0/3895711368 wait complete. 2024-09-22T08:36:42.687 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-22T08:36:42.661297Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-22T08:36:42.661288Z', 'tags': [], 'group_ids': []} 2024-09-22T08:36:42.688 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--email', 'foo@foo.com'] 2024-09-22T08:36:42.688 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--email', 'foo@foo.com'] 2024-09-22T08:36:42.688 DEBUG:teuthology.orchestra.run.smithi142:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid fud --display-name Fud --email foo@foo.com 2024-09-22T08:36:42.736 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:36:42.736 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:36:42.737 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.735+0000 7f1d4d5a7800 1 Processor -- start 2024-09-22T08:36:42.737 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.735+0000 7f1d4d5a7800 1 -- start start 2024-09-22T08:36:42.737 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.736+0000 7f1d4d5a7800 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55fd9adc1280 0x55fd9ae55520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:42.737 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.736+0000 7f1d4d5a7800 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55fd9acd7a20 con 0x55fd9adc2590 2024-09-22T08:36:42.737 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.736+0000 7f1d4d5a7800 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x55fd9acd77d0 con 0x55fd9adc1280 2024-09-22T08:36:42.738 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.736+0000 7f1d4a890640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55fd9adc1280 0x55fd9ae55520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:42.738 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.736+0000 7f1d4b091640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x55fd9adc2590 0x55fd9adc0b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.142:42298/0 (socket says 172.21.15.142:42298) 2024-09-22T08:36:42.738 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.736+0000 7f1d4b091640 1 -- 172.21.15.142:0/2966860589 learned_addr learned my addr 172.21.15.142:0/2966860589 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-09-22T08:36:42.738 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.736+0000 7f1d4a890640 1 -- 172.21.15.142:0/2966860589 >> v1:172.21.15.31:6789/0 conn(0x55fd9adc2590 legacy=0x55fd9adc0b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:42.738 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.736+0000 7f1d4a890640 1 -- 172.21.15.142:0/2966860589 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fd9adc1870 con 0x55fd9adc1280 2024-09-22T08:36:42.739 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.738+0000 7f1d4a890640 1 --2- 172.21.15.142:0/2966860589 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fd9adc1280 0x55fd9ae55520 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f1d4000a470 tx=0x7f1d40045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef20ed0cf8d5f42e server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:42.739 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.738+0000 7f1d4a08f640 1 -- 172.21.15.142:0/2966860589 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d40053570 con 0x55fd9adc1280 2024-09-22T08:36:42.740 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.738+0000 7f1d4a08f640 1 -- 172.21.15.142:0/2966860589 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d40058070 con 0x55fd9adc1280 2024-09-22T08:36:42.740 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.738+0000 7f1d4a08f640 1 -- 172.21.15.142:0/2966860589 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d40053880 con 0x55fd9adc1280 2024-09-22T08:36:42.740 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.739+0000 7f1d4d5a7800 1 -- 172.21.15.142:0/2966860589 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fd9adc1280 msgr2=0x55fd9ae55520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:42.740 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.739+0000 7f1d4d5a7800 1 --2- 172.21.15.142:0/2966860589 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fd9adc1280 0x55fd9ae55520 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f1d4000a470 tx=0x7f1d40045a20 comp rx=0 tx=0).stop 2024-09-22T08:36:42.740 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.739+0000 7f1d4d5a7800 1 -- 172.21.15.142:0/2966860589 shutdown_connections 2024-09-22T08:36:42.741 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.739+0000 7f1d4d5a7800 1 --2- 172.21.15.142:0/2966860589 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fd9adc1280 0x55fd9ae55520 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:42.741 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.739+0000 7f1d4d5a7800 1 -- 172.21.15.142:0/2966860589 >> 172.21.15.142:0/2966860589 conn(0x55fd9ae47dd0 msgr2=0x55fd9ae4a230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:42.741 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.739+0000 7f1d4d5a7800 1 -- 172.21.15.142:0/2966860589 shutdown_connections 2024-09-22T08:36:42.741 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.739+0000 7f1d4d5a7800 1 -- 172.21.15.142:0/2966860589 wait complete. 2024-09-22T08:36:42.754 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.753+0000 7f1d4d5a7800 1 Processor -- start 2024-09-22T08:36:42.754 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.753+0000 7f1d4d5a7800 1 -- start start 2024-09-22T08:36:42.754 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.753+0000 7f1d4d5a7800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fd9adc1280 0x55fd9af3e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:42.755 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.753+0000 7f1d4d5a7800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55fd9ace4dd0 con 0x55fd9adc1280 2024-09-22T08:36:42.755 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.753+0000 7f1d4b091640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fd9adc1280 0x55fd9af3e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:42.755 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.753+0000 7f1d4b091640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fd9adc1280 0x55fd9af3e1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:37930/0 (socket says 172.21.15.142:37930) 2024-09-22T08:36:42.755 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.753+0000 7f1d4b091640 1 -- 172.21.15.142:0/4182079478 learned_addr learned my addr 172.21.15.142:0/4182079478 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:42.755 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.753+0000 7f1d4b091640 1 -- 172.21.15.142:0/4182079478 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fd9af3e7b0 con 0x55fd9adc1280 2024-09-22T08:36:42.757 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.754+0000 7f1d4b091640 1 --2- 172.21.15.142:0/4182079478 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fd9adc1280 0x55fd9af3e1c0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f1d3c001e40 tx=0x7f1d3c001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d5d4a0699da0f55 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:42.757 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.754+0000 7f1c3960a640 1 -- 172.21.15.142:0/4182079478 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d3c012020 con 0x55fd9adc1280 2024-09-22T08:36:42.757 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.754+0000 7f1c3960a640 1 -- 172.21.15.142:0/4182079478 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d3c00e5a0 con 0x55fd9adc1280 2024-09-22T08:36:42.757 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.754+0000 7f1c3960a640 1 -- 172.21.15.142:0/4182079478 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d3c00e8a0 con 0x55fd9adc1280 2024-09-22T08:36:42.757 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.754+0000 7f1d4d5a7800 1 -- 172.21.15.142:0/4182079478 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fd9adc1280 msgr2=0x55fd9af3e1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:42.757 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.754+0000 7f1d4d5a7800 1 --2- 172.21.15.142:0/4182079478 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fd9adc1280 0x55fd9af3e1c0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f1d3c001e40 tx=0x7f1d3c001e70 comp rx=0 tx=0).stop 2024-09-22T08:36:42.757 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.754+0000 7f1d4d5a7800 1 -- 172.21.15.142:0/4182079478 shutdown_connections 2024-09-22T08:36:42.757 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.754+0000 7f1d4d5a7800 1 --2- 172.21.15.142:0/4182079478 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fd9adc1280 0x55fd9af3e1c0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:42.758 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.754+0000 7f1d4d5a7800 1 -- 172.21.15.142:0/4182079478 >> 172.21.15.142:0/4182079478 conn(0x55fd9ae47dd0 msgr2=0x55fd9af39b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:42.758 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.755+0000 7f1d4d5a7800 1 -- 172.21.15.142:0/4182079478 shutdown_connections 2024-09-22T08:36:42.758 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.755+0000 7f1d4d5a7800 1 -- 172.21.15.142:0/4182079478 wait complete. 2024-09-22T08:36:42.758 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.755+0000 7f1d4d5a7800 1 Processor -- start 2024-09-22T08:36:42.758 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.755+0000 7f1d4d5a7800 1 -- start start 2024-09-22T08:36:42.758 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.755+0000 7f1d4d5a7800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fd9adc1280 0x55fd9af45ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:42.758 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.755+0000 7f1d4d5a7800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55fd9ae55d00 con 0x55fd9adc1280 2024-09-22T08:36:42.758 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.755+0000 7f1d4b091640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fd9adc1280 0x55fd9af45ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:42.758 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.755+0000 7f1d4b091640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fd9adc1280 0x55fd9af45ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:37934/0 (socket says 172.21.15.142:37934) 2024-09-22T08:36:42.758 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.755+0000 7f1d4b091640 1 -- 172.21.15.142:0/3228736724 learned_addr learned my addr 172.21.15.142:0/3228736724 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:42.758 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.755+0000 7f1d4b091640 1 -- 172.21.15.142:0/3228736724 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fd9af46240 con 0x55fd9adc1280 2024-09-22T08:36:42.758 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.756+0000 7f1d4b091640 1 --2- 172.21.15.142:0/3228736724 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fd9adc1280 0x55fd9af45ce0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f1d3c0012b0 tx=0x7f1d3c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:42.758 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.756+0000 7f1c37e07640 1 -- 172.21.15.142:0/3228736724 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d3c012030 con 0x55fd9adc1280 2024-09-22T08:36:42.758 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.756+0000 7f1c37e07640 1 -- 172.21.15.142:0/3228736724 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d3c01a750 con 0x55fd9adc1280 2024-09-22T08:36:42.759 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.756+0000 7f1d4d5a7800 1 -- 172.21.15.142:0/3228736724 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fd9af464d0 con 0x55fd9adc1280 2024-09-22T08:36:42.759 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.756+0000 7f1c37e07640 1 -- 172.21.15.142:0/3228736724 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d3c01aa70 con 0x55fd9adc1280 2024-09-22T08:36:42.759 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.756+0000 7f1d4d5a7800 1 -- 172.21.15.142:0/3228736724 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fd9af46ed0 con 0x55fd9adc1280 2024-09-22T08:36:42.761 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.757+0000 7f1c37e07640 1 -- 172.21.15.142:0/3228736724 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f1d3c015020 con 0x55fd9adc1280 2024-09-22T08:36:42.761 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.757+0000 7f1c37e07640 1 --2- 172.21.15.142:0/3228736724 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f1c3003cfb0 0x7f1c3003f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:42.761 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.757+0000 7f1c37e07640 1 -- 172.21.15.142:0/3228736724 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f1d3c020030 con 0x55fd9adc1280 2024-09-22T08:36:42.761 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.757+0000 7f1d4a890640 1 --2- 172.21.15.142:0/3228736724 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f1c3003cfb0 0x7f1c3003f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:42.761 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.757+0000 7f1d4d5a7800 1 --2- 172.21.15.142:0/3228736724 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55fd9adc2590 0x55fd9af4d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:42.761 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.757+0000 7f1d4d5a7800 1 -- 172.21.15.142:0/3228736724 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fd9af4d870 con 0x55fd9adc2590 2024-09-22T08:36:42.762 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.757+0000 7f1d4b892640 1 --2- 172.21.15.142:0/3228736724 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55fd9adc2590 0x55fd9af4d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:42.762 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.758+0000 7f1d4a890640 1 --2- 172.21.15.142:0/3228736724 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f1c3003cfb0 0x7f1c3003f470 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f1d40057000 tx=0x7f1d40052000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:42.762 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.758+0000 7f1d4b892640 1 --2- 172.21.15.142:0/3228736724 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55fd9adc2590 0x55fd9af4d330 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:42.762 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.758+0000 7f1d4b892640 1 -- 172.21.15.142:0/3228736724 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1d4400a4d0 con 0x55fd9adc2590 2024-09-22T08:36:42.762 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.758+0000 7f1d4d5a7800 1 -- 172.21.15.142:0/3228736724 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fd9af4dc10 con 0x55fd9adc2590 2024-09-22T08:36:42.762 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.758+0000 7f1d4b892640 1 -- 172.21.15.142:0/3228736724 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1d4400a4d0 con 0x55fd9adc2590 2024-09-22T08:36:42.762 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.758+0000 7f1d4d5a7800 1 --2- 172.21.15.142:0/3228736724 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55fd9af4f6d0 0x55fd9af51b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:42.762 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.758+0000 7f1d4d5a7800 1 -- 172.21.15.142:0/3228736724 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:3 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fd9af52300 con 0x55fd9af4f6d0 2024-09-22T08:36:42.762 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.758+0000 7f1d4b091640 1 --2- 172.21.15.142:0/3228736724 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55fd9af4f6d0 0x55fd9af51b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:42.762 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.758+0000 7f1d4b091640 1 --2- 172.21.15.142:0/3228736724 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55fd9af4f6d0 0x55fd9af51b70 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:42.762 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.759+0000 7f1d4b091640 1 -- 172.21.15.142:0/3228736724 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(3 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f1d3c018ce0 con 0x55fd9af4f6d0 2024-09-22T08:36:42.762 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.759+0000 7f1d4d5a7800 1 -- 172.21.15.142:0/3228736724 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fd9af4e460 con 0x55fd9adc2590 2024-09-22T08:36:42.762 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.759+0000 7f1d4b892640 1 -- 172.21.15.142:0/3228736724 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1d4400a4d0 con 0x55fd9adc2590 2024-09-22T08:36:42.762 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.759+0000 7f1d4d5a7800 1 -- 172.21.15.142:0/3228736724 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fd9af4e840 con 0x55fd9af4f6d0 2024-09-22T08:36:42.763 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.759+0000 7f1d4b091640 1 -- 172.21.15.142:0/3228736724 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(5 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f1d3c018ce0 con 0x55fd9af4f6d0 2024-09-22T08:36:42.763 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.760+0000 7f1d4d5a7800 1 Processor -- start 2024-09-22T08:36:42.763 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.760+0000 7f1d4d5a7800 1 -- start start 2024-09-22T08:36:42.763 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.760+0000 7f1d4d5a7800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fd9af60cc0 0x55fd9af610e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:42.763 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.760+0000 7f1d4d5a7800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55fd9ad43d50 con 0x55fd9af60cc0 2024-09-22T08:36:42.763 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.760+0000 7f1d4b892640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fd9af60cc0 0x55fd9af610e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:42.763 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.760+0000 7f1d4b892640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fd9af60cc0 0x55fd9af610e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:37946/0 (socket says 172.21.15.142:37946) 2024-09-22T08:36:42.763 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.760+0000 7f1d4b892640 1 -- 172.21.15.142:0/2286861457 learned_addr learned my addr 172.21.15.142:0/2286861457 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:42.767 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.760+0000 7f1d4b892640 1 -- 172.21.15.142:0/2286861457 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fd9af61720 con 0x55fd9af60cc0 2024-09-22T08:36:42.767 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.761+0000 7f1d4b892640 1 --2- 172.21.15.142:0/2286861457 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fd9af60cc0 0x55fd9af610e0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x55fd9af46b70 tx=0x7f1d440167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:42.767 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.761+0000 7f1c35602640 1 -- 172.21.15.142:0/2286861457 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d44013640 con 0x55fd9af60cc0 2024-09-22T08:36:42.767 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.761+0000 7f1c35602640 1 -- 172.21.15.142:0/2286861457 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d440137e0 con 0x55fd9af60cc0 2024-09-22T08:36:42.767 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.761+0000 7f1d4d5a7800 1 -- 172.21.15.142:0/2286861457 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fd9af61f50 con 0x55fd9af60cc0 2024-09-22T08:36:42.767 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.761+0000 7f1c35602640 1 -- 172.21.15.142:0/2286861457 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d44013ae0 con 0x55fd9af60cc0 2024-09-22T08:36:42.767 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.761+0000 7f1d4d5a7800 1 -- 172.21.15.142:0/2286861457 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fd9af624f0 con 0x55fd9af60cc0 2024-09-22T08:36:42.768 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.762+0000 7f1c35602640 1 -- 172.21.15.142:0/2286861457 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f1d44011040 con 0x55fd9af60cc0 2024-09-22T08:36:42.768 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.762+0000 7f1c35602640 1 --2- 172.21.15.142:0/2286861457 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f1c2403cfb0 0x7f1c2403f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:42.768 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.762+0000 7f1c35602640 1 -- 172.21.15.142:0/2286861457 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f1d4400e040 con 0x55fd9af60cc0 2024-09-22T08:36:42.768 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.762+0000 7f1d4b091640 1 --2- 172.21.15.142:0/2286861457 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f1c2403cfb0 0x7f1c2403f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:42.768 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.762+0000 7f1d4d5a7800 1 Processor -- start 2024-09-22T08:36:42.768 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.762+0000 7f1d4d5a7800 1 -- start start 2024-09-22T08:36:42.768 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.762+0000 7f1d4b091640 1 --2- 172.21.15.142:0/2286861457 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f1c2403cfb0 0x7f1c2403f470 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x55fd9af47de0 tx=0x7f1d3c052a40 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:42.768 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.763+0000 7f1d4d5a7800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fd9af6d800 0x55fd9af6dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:42.768 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.763+0000 7f1d4d5a7800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55fd9af3ebe0 con 0x55fd9af6d800 2024-09-22T08:36:42.768 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.763+0000 7f1d4b892640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fd9af6d800 0x55fd9af6dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:42.768 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.763+0000 7f1d4b892640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fd9af6d800 0x55fd9af6dbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:37948/0 (socket says 172.21.15.142:37948) 2024-09-22T08:36:42.768 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.763+0000 7f1d4b892640 1 -- 172.21.15.142:0/1642979960 learned_addr learned my addr 172.21.15.142:0/1642979960 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:42.768 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.763+0000 7f1d4b892640 1 -- 172.21.15.142:0/1642979960 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fd9af6e1d0 con 0x55fd9af6d800 2024-09-22T08:36:42.768 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.763+0000 7f1d4b892640 1 --2- 172.21.15.142:0/1642979960 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fd9af6d800 0x55fd9af6dbe0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f1d44020000 tx=0x7f1d4401f400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f53c8807dd1f3800 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:42.769 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.763+0000 7f1c2effd640 1 -- 172.21.15.142:0/1642979960 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d44021cf0 con 0x55fd9af6d800 2024-09-22T08:36:42.769 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.763+0000 7f1c2effd640 1 -- 172.21.15.142:0/1642979960 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d44052070 con 0x55fd9af6d800 2024-09-22T08:36:42.769 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.763+0000 7f1c2effd640 1 -- 172.21.15.142:0/1642979960 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d44021960 con 0x55fd9af6d800 2024-09-22T08:36:42.769 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.764+0000 7f1d4d5a7800 1 -- 172.21.15.142:0/1642979960 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fd9af6d800 msgr2=0x55fd9af6dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:42.769 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.764+0000 7f1d4d5a7800 1 --2- 172.21.15.142:0/1642979960 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fd9af6d800 0x55fd9af6dbe0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f1d44020000 tx=0x7f1d4401f400 comp rx=0 tx=0).stop 2024-09-22T08:36:42.769 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.764+0000 7f1d4d5a7800 1 -- 172.21.15.142:0/1642979960 shutdown_connections 2024-09-22T08:36:42.769 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.764+0000 7f1d4d5a7800 1 --2- 172.21.15.142:0/1642979960 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fd9af6d800 0x55fd9af6dbe0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:42.769 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.764+0000 7f1d4d5a7800 1 -- 172.21.15.142:0/1642979960 >> 172.21.15.142:0/1642979960 conn(0x55fd9af69c00 msgr2=0x55fd9af67e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:42.769 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.764+0000 7f1d4d5a7800 1 -- 172.21.15.142:0/1642979960 shutdown_connections 2024-09-22T08:36:42.769 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.764+0000 7f1d4d5a7800 1 -- 172.21.15.142:0/1642979960 wait complete. 2024-09-22T08:36:42.769 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.764+0000 7f1d4d5a7800 1 Processor -- start 2024-09-22T08:36:42.769 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.764+0000 7f1d4d5a7800 1 -- start start 2024-09-22T08:36:42.769 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.764+0000 7f1d4d5a7800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fd9af6d800 0x55fd9af74d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:42.769 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.764+0000 7f1d4d5a7800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55fd9af6e810 con 0x55fd9af6d800 2024-09-22T08:36:42.770 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.764+0000 7f1d4b892640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fd9af6d800 0x55fd9af74d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:42.770 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.764+0000 7f1d4b892640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fd9af6d800 0x55fd9af74d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:37960/0 (socket says 172.21.15.142:37960) 2024-09-22T08:36:42.770 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.764+0000 7f1d4b892640 1 -- 172.21.15.142:0/2604712161 learned_addr learned my addr 172.21.15.142:0/2604712161 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:42.770 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.765+0000 7f1d4b892640 1 -- 172.21.15.142:0/2604712161 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fd9af752c0 con 0x55fd9af6d800 2024-09-22T08:36:42.770 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.765+0000 7f1d4b892640 1 --2- 172.21.15.142:0/2604712161 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fd9af6d800 0x55fd9af74d60 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f1d440208e0 tx=0x7f1d44054860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:42.770 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.765+0000 7f1c2d7fa640 1 -- 172.21.15.142:0/2604712161 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d44020de0 con 0x55fd9af6d800 2024-09-22T08:36:42.770 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.765+0000 7f1c2d7fa640 1 -- 172.21.15.142:0/2604712161 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d4401fa90 con 0x55fd9af6d800 2024-09-22T08:36:42.770 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.765+0000 7f1c2d7fa640 1 -- 172.21.15.142:0/2604712161 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d4401fdb0 con 0x55fd9af6d800 2024-09-22T08:36:42.770 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.765+0000 7f1d4d5a7800 1 -- 172.21.15.142:0/2604712161 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fd9af75550 con 0x55fd9af6d800 2024-09-22T08:36:42.770 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.765+0000 7f1d4d5a7800 1 -- 172.21.15.142:0/2604712161 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fd9af75ed0 con 0x55fd9af6d800 2024-09-22T08:36:42.770 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.766+0000 7f1c2d7fa640 1 -- 172.21.15.142:0/2604712161 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f1d4401f500 con 0x55fd9af6d800 2024-09-22T08:36:42.770 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.766+0000 7f1c2d7fa640 1 --2- 172.21.15.142:0/2604712161 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f1c1403d150 0x7f1c1403f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:42.770 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.766+0000 7f1c2d7fa640 1 -- 172.21.15.142:0/2604712161 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f1d4404d050 con 0x55fd9af6d800 2024-09-22T08:36:42.770 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.766+0000 7f1d4b091640 1 --2- 172.21.15.142:0/2604712161 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f1c1403d150 0x7f1c1403f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:42.778 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.766+0000 7f1d4b091640 1 --2- 172.21.15.142:0/2604712161 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f1c1403d150 0x7f1c1403f610 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f1d3c018f90 tx=0x7f1d3c046000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:42.778 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.767+0000 7f1d4d5a7800 20 rados->read ofs=0 len=0 2024-09-22T08:36:42.778 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.767+0000 7f1d4d5a7800 1 --2- 172.21.15.142:0/2604712161 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55fd9af80720 0x55fd9af82be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:42.778 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.767+0000 7f1d4d5a7800 1 -- 172.21.15.142:0/2604712161 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fd9af83330 con 0x55fd9af80720 2024-09-22T08:36:42.778 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.767+0000 7f1d4a890640 1 --2- 172.21.15.142:0/2604712161 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55fd9af80720 0x55fd9af82be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:42.778 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.767+0000 7f1d4a890640 1 --2- 172.21.15.142:0/2604712161 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55fd9af80720 0x55fd9af82be0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:42.778 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.767+0000 7f1d4a890640 1 -- 172.21.15.142:0/2604712161 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1d40051070 con 0x55fd9af80720 2024-09-22T08:36:42.778 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.767+0000 7f1d4d5a7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:42.779 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.767+0000 7f1d4d5a7800 20 realm 2024-09-22T08:36:42.779 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.767+0000 7f1d4d5a7800 20 rados->read ofs=0 len=0 2024-09-22T08:36:42.779 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.767+0000 7f1d4d5a7800 1 -- 172.21.15.142:0/2604712161 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fd9af83760 con 0x55fd9af80720 2024-09-22T08:36:42.779 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.768+0000 7f1d4a890640 1 -- 172.21.15.142:0/2604712161 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1d40051070 con 0x55fd9af80720 2024-09-22T08:36:42.779 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.768+0000 7f1d4d5a7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:42.779 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.768+0000 7f1d4d5a7800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:36:42.779 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.768+0000 7f1d4d5a7800 20 rados->read ofs=0 len=0 2024-09-22T08:36:42.779 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.768+0000 7f1d4d5a7800 1 -- 172.21.15.142:0/2604712161 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fd9af84030 con 0x55fd9af80720 2024-09-22T08:36:42.779 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.768+0000 7f1d4a890640 1 -- 172.21.15.142:0/2604712161 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1d40051070 con 0x55fd9af80720 2024-09-22T08:36:42.779 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.768+0000 7f1d4d5a7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:42.779 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.768+0000 7f1d4d5a7800 20 rados->read ofs=0 len=0 2024-09-22T08:36:42.779 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.768+0000 7f1d4d5a7800 1 -- 172.21.15.142:0/2604712161 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fd9af843d0 con 0x55fd9af80720 2024-09-22T08:36:42.779 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.768+0000 7f1d4a890640 1 -- 172.21.15.142:0/2604712161 <== osd.1 v2:172.21.15.142:6816/3192108003 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1d40051070 con 0x55fd9af80720 2024-09-22T08:36:42.779 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.768+0000 7f1d4d5a7800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:36:42.780 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.768+0000 7f1d4d5a7800 20 rados->read ofs=0 len=0 2024-09-22T08:36:42.780 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.768+0000 7f1d4d5a7800 1 --2- 172.21.15.142:0/2604712161 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55fd9af85130 0x55fd9af87520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:42.780 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.768+0000 7f1d4d5a7800 1 -- 172.21.15.142:0/2604712161 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fd9af87b30 con 0x55fd9af85130 2024-09-22T08:36:42.780 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.768+0000 7f1d4b892640 1 --2- 172.21.15.142:0/2604712161 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55fd9af85130 0x55fd9af87520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:42.780 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.768+0000 7f1d4b892640 1 --2- 172.21.15.142:0/2604712161 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55fd9af85130 0x55fd9af87520 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:42.780 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.769+0000 7f1d4b892640 1 -- 172.21.15.142:0/2604712161 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(5 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f1d4403a070 con 0x55fd9af85130 2024-09-22T08:36:42.780 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.769+0000 7f1d4d5a7800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:36:42.780 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.769+0000 7f1d4d5a7800 20 searching for the correct realm 2024-09-22T08:36:42.780 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.769+0000 7f1d4d5a7800 1 -- 172.21.15.142:0/2604712161 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55fd9af89460 con 0x55fd9af85130 2024-09-22T08:36:42.780 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.769+0000 7f1d4b892640 1 -- 172.21.15.142:0/2604712161 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d4403a070 con 0x55fd9af85130 2024-09-22T08:36:42.780 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.769+0000 7f1d4b892640 1 --2- 172.21.15.142:0/2604712161 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f1d4403b350 0x7f1d4403b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:42.780 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.769+0000 7f1d4b892640 1 -- 172.21.15.142:0/2604712161 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55fd9af89460 con 0x7f1d4403b350 2024-09-22T08:36:42.780 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.769+0000 7f1d4b091640 1 --2- 172.21.15.142:0/2604712161 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f1d4403b350 0x7f1d4403b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:42.781 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.769+0000 7f1d4b091640 1 --2- 172.21.15.142:0/2604712161 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f1d4403b350 0x7f1d4403b7b0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:42.781 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.769+0000 7f1d4b091640 1 -- 172.21.15.142:0/2604712161 <== osd.2 v2:172.21.15.142:6808/279438927 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d3c018ce0 con 0x7f1d4403b350 2024-09-22T08:36:42.781 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.770+0000 7f1d4b091640 1 --2- 172.21.15.142:0/2604712161 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f1d3c017050 0x7f1d3c0167e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:42.781 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.770+0000 7f1d4b091640 1 -- 172.21.15.142:0/2604712161 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55fd9af89460 con 0x7f1d3c017050 2024-09-22T08:36:42.781 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.770+0000 7f1d4a890640 1 --2- 172.21.15.142:0/2604712161 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f1d3c017050 0x7f1d3c0167e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:42.781 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.770+0000 7f1d4a890640 1 --2- 172.21.15.142:0/2604712161 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f1d3c017050 0x7f1d3c0167e0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:42.781 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.771+0000 7f1d4a890640 1 -- 172.21.15.142:0/2604712161 <== osd.0 v2:172.21.15.31:6800/168281188 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d40051070 con 0x7f1d3c017050 2024-09-22T08:36:42.781 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.771+0000 7f1d4a890640 1 -- 172.21.15.142:0/2604712161 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55fd9af89460 con 0x55fd9af80720 2024-09-22T08:36:42.781 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.771+0000 7f1d4a890640 1 -- 172.21.15.142:0/2604712161 <== osd.1 v2:172.21.15.142:6816/3192108003 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d40051070 con 0x55fd9af80720 2024-09-22T08:36:42.781 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.771+0000 7f1d4a890640 1 -- 172.21.15.142:0/2604712161 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55fd9af89460 con 0x55fd9af80720 2024-09-22T08:36:42.781 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.771+0000 7f1d4a890640 1 -- 172.21.15.142:0/2604712161 <== osd.1 v2:172.21.15.142:6816/3192108003 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d40051070 con 0x55fd9af80720 2024-09-22T08:36:42.781 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.771+0000 7f1d4a890640 1 -- 172.21.15.142:0/2604712161 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55fd9af89460 con 0x7f1d3c017050 2024-09-22T08:36:42.781 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.771+0000 7f1d4a890640 1 -- 172.21.15.142:0/2604712161 <== osd.0 v2:172.21.15.31:6800/168281188 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d40051070 con 0x7f1d3c017050 2024-09-22T08:36:42.781 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.771+0000 7f1d4a890640 1 -- 172.21.15.142:0/2604712161 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55fd9af89460 con 0x7f1d3c017050 2024-09-22T08:36:42.782 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.772+0000 7f1d4a890640 1 -- 172.21.15.142:0/2604712161 <== osd.0 v2:172.21.15.31:6800/168281188 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d40051070 con 0x7f1d3c017050 2024-09-22T08:36:42.782 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.772+0000 7f1d4a890640 1 -- 172.21.15.142:0/2604712161 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55fd9af89460 con 0x7f1d4403b350 2024-09-22T08:36:42.782 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.772+0000 7f1d4b091640 1 -- 172.21.15.142:0/2604712161 <== osd.2 v2:172.21.15.142:6808/279438927 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d3c018ce0 con 0x7f1d4403b350 2024-09-22T08:36:42.782 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.772+0000 7f1d4b091640 1 -- 172.21.15.142:0/2604712161 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55fd9af89460 con 0x55fd9af85130 2024-09-22T08:36:42.782 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.772+0000 7f1d4b892640 1 -- 172.21.15.142:0/2604712161 <== osd.3 v2:172.21.15.142:6800/1064901393 3 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d4403a070 con 0x55fd9af85130 2024-09-22T08:36:42.782 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.772+0000 7f1d4b892640 1 -- 172.21.15.142:0/2604712161 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55fd9af89460 con 0x55fd9af80720 2024-09-22T08:36:42.782 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.772+0000 7f1d4a890640 1 -- 172.21.15.142:0/2604712161 <== osd.1 v2:172.21.15.142:6816/3192108003 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d40051070 con 0x55fd9af80720 2024-09-22T08:36:42.782 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.772+0000 7f1d4a890640 1 -- 172.21.15.142:0/2604712161 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55fd9af89460 con 0x7f1d3c017050 2024-09-22T08:36:42.782 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.773+0000 7f1d4a890640 1 -- 172.21.15.142:0/2604712161 <== osd.0 v2:172.21.15.31:6800/168281188 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d40051070 con 0x7f1d3c017050 2024-09-22T08:36:42.782 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.773+0000 7f1d4a890640 1 -- 172.21.15.142:0/2604712161 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55fd9af89460 con 0x55fd9af80720 2024-09-22T08:36:42.782 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.773+0000 7f1d4a890640 1 -- 172.21.15.142:0/2604712161 <== osd.1 v2:172.21.15.142:6816/3192108003 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d40051070 con 0x55fd9af80720 2024-09-22T08:36:42.782 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.773+0000 7f1d4a890640 1 -- 172.21.15.142:0/2604712161 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55fd9af89460 con 0x7f1d4403b350 2024-09-22T08:36:42.782 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.773+0000 7f1d4b091640 1 -- 172.21.15.142:0/2604712161 <== osd.2 v2:172.21.15.142:6808/279438927 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f1d3c018ce0 con 0x7f1d4403b350 2024-09-22T08:36:42.783 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.773+0000 7f1d4b091640 1 -- 172.21.15.142:0/2604712161 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55fd9af89460 con 0x55fd9af85130 2024-09-22T08:36:42.783 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.773+0000 7f1d4b892640 1 -- 172.21.15.142:0/2604712161 <== osd.3 v2:172.21.15.142:6800/1064901393 4 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d4403a070 con 0x55fd9af85130 2024-09-22T08:36:42.783 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.773+0000 7f1d4b892640 1 -- 172.21.15.142:0/2604712161 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55fd9af89460 con 0x55fd9af85130 2024-09-22T08:36:42.783 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.774+0000 7f1d4b892640 1 -- 172.21.15.142:0/2604712161 <== osd.3 v2:172.21.15.142:6800/1064901393 5 ==== osd_op_reply(20 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f1d4403a070 con 0x55fd9af85130 2024-09-22T08:36:42.783 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.774+0000 7f1d4b892640 1 -- 172.21.15.142:0/2604712161 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55fd9af89460 con 0x7f1d3c017050 2024-09-22T08:36:42.783 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.774+0000 7f1d4a890640 1 -- 172.21.15.142:0/2604712161 <== osd.0 v2:172.21.15.31:6800/168281188 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d40051070 con 0x7f1d3c017050 2024-09-22T08:36:42.783 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.774+0000 7f1d4a890640 1 -- 172.21.15.142:0/2604712161 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55fd9af89460 con 0x55fd9af85130 2024-09-22T08:36:42.783 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.774+0000 7f1d4b892640 1 -- 172.21.15.142:0/2604712161 <== osd.3 v2:172.21.15.142:6800/1064901393 6 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d4403a070 con 0x55fd9af85130 2024-09-22T08:36:42.783 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.774+0000 7f1d4b892640 1 -- 172.21.15.142:0/2604712161 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55fd9af89460 con 0x55fd9af85130 2024-09-22T08:36:42.783 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.774+0000 7f1d4b892640 1 -- 172.21.15.142:0/2604712161 <== osd.3 v2:172.21.15.142:6800/1064901393 7 ==== osd_op_reply(23 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f1d4403a070 con 0x55fd9af85130 2024-09-22T08:36:42.783 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.774+0000 7f1d4b892640 1 -- 172.21.15.142:0/2604712161 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55fd9af89460 con 0x55fd9af80720 2024-09-22T08:36:42.783 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.774+0000 7f1d4a890640 1 -- 172.21.15.142:0/2604712161 <== osd.1 v2:172.21.15.142:6816/3192108003 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d40051070 con 0x55fd9af80720 2024-09-22T08:36:42.783 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.774+0000 7f1d4a890640 1 -- 172.21.15.142:0/2604712161 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55fd9af89460 con 0x55fd9af80720 2024-09-22T08:36:42.783 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.775+0000 7f1d4a890640 1 -- 172.21.15.142:0/2604712161 <== osd.1 v2:172.21.15.142:6816/3192108003 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f1d40051070 con 0x55fd9af80720 2024-09-22T08:36:42.784 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.775+0000 7f1d4a890640 1 -- 172.21.15.142:0/2604712161 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55fd9af89460 con 0x7f1d3c017050 2024-09-22T08:36:42.784 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.775+0000 7f1d4a890640 1 -- 172.21.15.142:0/2604712161 <== osd.0 v2:172.21.15.31:6800/168281188 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d40051070 con 0x7f1d3c017050 2024-09-22T08:36:42.784 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.775+0000 7f1d4a890640 1 -- 172.21.15.142:0/2604712161 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55fd9af89460 con 0x55fd9af85130 2024-09-22T08:36:42.784 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.775+0000 7f1d4b892640 1 -- 172.21.15.142:0/2604712161 <== osd.3 v2:172.21.15.142:6800/1064901393 8 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d4403a070 con 0x55fd9af85130 2024-09-22T08:36:42.784 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.775+0000 7f1d4b892640 1 -- 172.21.15.142:0/2604712161 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55fd9af89460 con 0x7f1d4403b350 2024-09-22T08:36:42.784 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.775+0000 7f1d4b091640 1 -- 172.21.15.142:0/2604712161 <== osd.2 v2:172.21.15.142:6808/279438927 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d3c018ce0 con 0x7f1d4403b350 2024-09-22T08:36:42.784 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.775+0000 7f1d4b091640 1 -- 172.21.15.142:0/2604712161 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55fd9af89460 con 0x55fd9af80720 2024-09-22T08:36:42.784 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.776+0000 7f1d4a890640 1 -- 172.21.15.142:0/2604712161 <== osd.1 v2:172.21.15.142:6816/3192108003 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d40051070 con 0x55fd9af80720 2024-09-22T08:36:42.784 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.776+0000 7f1d4a890640 1 -- 172.21.15.142:0/2604712161 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55fd9af89460 con 0x7f1d3c017050 2024-09-22T08:36:42.784 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.776+0000 7f1d4a890640 1 -- 172.21.15.142:0/2604712161 <== osd.0 v2:172.21.15.31:6800/168281188 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d40051070 con 0x7f1d3c017050 2024-09-22T08:36:42.784 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.776+0000 7f1d4a890640 1 -- 172.21.15.142:0/2604712161 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55fd9af89460 con 0x55fd9af85130 2024-09-22T08:36:42.784 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.776+0000 7f1d4b892640 1 -- 172.21.15.142:0/2604712161 <== osd.3 v2:172.21.15.142:6800/1064901393 9 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d4403a070 con 0x55fd9af85130 2024-09-22T08:36:42.784 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.776+0000 7f1d4b892640 1 -- 172.21.15.142:0/2604712161 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55fd9af89460 con 0x7f1d3c017050 2024-09-22T08:36:42.784 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.776+0000 7f1d4a890640 1 -- 172.21.15.142:0/2604712161 <== osd.0 v2:172.21.15.31:6800/168281188 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d40051070 con 0x7f1d3c017050 2024-09-22T08:36:42.784 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.776+0000 7f1d4a890640 1 -- 172.21.15.142:0/2604712161 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55fd9af89460 con 0x7f1d4403b350 2024-09-22T08:36:42.785 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.777+0000 7f1d4b091640 1 -- 172.21.15.142:0/2604712161 <== osd.2 v2:172.21.15.142:6808/279438927 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d3c018ce0 con 0x7f1d4403b350 2024-09-22T08:36:42.785 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.777+0000 7f1d4b091640 1 -- 172.21.15.142:0/2604712161 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55fd9af89460 con 0x55fd9af85130 2024-09-22T08:36:42.785 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.777+0000 7f1d4b892640 1 -- 172.21.15.142:0/2604712161 <== osd.3 v2:172.21.15.142:6800/1064901393 10 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d4403a070 con 0x55fd9af85130 2024-09-22T08:36:42.785 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.777+0000 7f1d4b892640 1 -- 172.21.15.142:0/2604712161 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55fd9af89460 con 0x7f1d3c017050 2024-09-22T08:36:42.790 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.777+0000 7f1d4a890640 1 -- 172.21.15.142:0/2604712161 <== osd.0 v2:172.21.15.31:6800/168281188 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d40051070 con 0x7f1d3c017050 2024-09-22T08:36:42.790 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.777+0000 7f1d4a890640 1 -- 172.21.15.142:0/2604712161 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55fd9af89460 con 0x55fd9af80720 2024-09-22T08:36:42.790 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.778+0000 7f1d4a890640 1 -- 172.21.15.142:0/2604712161 <== osd.1 v2:172.21.15.142:6816/3192108003 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f1d40051070 con 0x55fd9af80720 2024-09-22T08:36:42.790 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.778+0000 7f1d4a890640 1 -- 172.21.15.142:0/2604712161 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55fd9af89460 con 0x7f1d4403b350 2024-09-22T08:36:42.790 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.778+0000 7f1d4b091640 1 -- 172.21.15.142:0/2604712161 <== osd.2 v2:172.21.15.142:6808/279438927 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d3c018ce0 con 0x7f1d4403b350 2024-09-22T08:36:42.790 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.778+0000 7f1d4d5a7800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:36:42.790 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.778+0000 7f1d4d5a7800 20 RGWRados::pool_iterate: got zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec 2024-09-22T08:36:42.790 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.778+0000 7f1d4d5a7800 20 RGWRados::pool_iterate: got zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f 2024-09-22T08:36:42.790 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.778+0000 7f1d4d5a7800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:36:42.791 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.778+0000 7f1d4d5a7800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:36:42.791 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.778+0000 7f1d4d5a7800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:36:42.791 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.778+0000 7f1d4d5a7800 20 rados->read ofs=0 len=0 2024-09-22T08:36:42.791 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.778+0000 7f1d4d5a7800 1 -- 172.21.15.142:0/2604712161 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fd9af88520 con 0x55fd9af80720 2024-09-22T08:36:42.791 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.778+0000 7f1d4a890640 1 -- 172.21.15.142:0/2604712161 <== osd.1 v2:172.21.15.142:6816/3192108003 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1d40051070 con 0x55fd9af80720 2024-09-22T08:36:42.791 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.778+0000 7f1d4d5a7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:42.791 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.778+0000 7f1d4d5a7800 20 rados->read ofs=0 len=0 2024-09-22T08:36:42.791 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.778+0000 7f1d4d5a7800 1 -- 172.21.15.142:0/2604712161 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fd9af88d70 con 0x55fd9af80720 2024-09-22T08:36:42.791 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.778+0000 7f1d4a890640 1 -- 172.21.15.142:0/2604712161 <== osd.1 v2:172.21.15.142:6816/3192108003 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1d40051070 con 0x55fd9af80720 2024-09-22T08:36:42.791 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.778+0000 7f1d4d5a7800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:36:42.791 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.778+0000 7f1d4d5a7800 20 rados->read ofs=0 len=0 2024-09-22T08:36:42.791 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.778+0000 7f1d4d5a7800 1 -- 172.21.15.142:0/2604712161 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:40 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fd9af898e0 con 0x55fd9af85130 2024-09-22T08:36:42.791 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.779+0000 7f1d4b892640 1 -- 172.21.15.142:0/2604712161 <== osd.3 v2:172.21.15.142:6800/1064901393 11 ==== osd_op_reply(40 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f1d4403a070 con 0x55fd9af85130 2024-09-22T08:36:42.791 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.779+0000 7f1d4d5a7800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:36:42.792 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.779+0000 7f1d4d5a7800 20 zone default found 2024-09-22T08:36:42.792 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.779+0000 7f1d4d5a7800 4 Realm: () 2024-09-22T08:36:42.792 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.779+0000 7f1d4d5a7800 4 ZoneGroup: default (d89f6f57-1007-47dd-9065-f486c7b01aec) 2024-09-22T08:36:42.792 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.779+0000 7f1d4d5a7800 4 Zone: default (e239248c-0bee-4e41-803a-24b288d3eb8f) 2024-09-22T08:36:42.792 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.779+0000 7f1d4d5a7800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:36:42.792 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.779+0000 7f1d4d5a7800 20 zonegroup default 2024-09-22T08:36:42.792 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.779+0000 7f1d4d5a7800 20 rados->read ofs=0 len=0 2024-09-22T08:36:42.792 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.779+0000 7f1d4d5a7800 1 -- 172.21.15.142:0/2604712161 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fd9af89cf0 con 0x7f1d3c017050 2024-09-22T08:36:42.792 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.779+0000 7f1d4a890640 1 -- 172.21.15.142:0/2604712161 <== osd.0 v2:172.21.15.31:6800/168281188 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f1d40051070 con 0x7f1d3c017050 2024-09-22T08:36:42.792 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.779+0000 7f1d4d5a7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:42.792 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.779+0000 7f1d4d5a7800 20 rados->read ofs=0 len=0 2024-09-22T08:36:42.792 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.779+0000 7f1d4d5a7800 1 -- 172.21.15.142:0/2604712161 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fd9af8bfd0 con 0x55fd9af85130 2024-09-22T08:36:42.792 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.779+0000 7f1d4b892640 1 -- 172.21.15.142:0/2604712161 <== osd.3 v2:172.21.15.142:6800/1064901393 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1d4403a070 con 0x55fd9af85130 2024-09-22T08:36:42.793 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.779+0000 7f1d4d5a7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:42.793 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.779+0000 7f1d4d5a7800 20 rados->read ofs=0 len=0 2024-09-22T08:36:42.793 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.779+0000 7f1d4d5a7800 1 -- 172.21.15.142:0/2604712161 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fd9af8c3c0 con 0x55fd9af85130 2024-09-22T08:36:42.793 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.780+0000 7f1d4b892640 1 -- 172.21.15.142:0/2604712161 <== osd.3 v2:172.21.15.142:6800/1064901393 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1d4403a070 con 0x55fd9af85130 2024-09-22T08:36:42.793 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.780+0000 7f1d4d5a7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:42.793 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.780+0000 7f1d4d5a7800 20 started sync module instance, tier type = 2024-09-22T08:36:42.793 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.780+0000 7f1d4d5a7800 20 started zone id=e239248c-0bee-4e41-803a-24b288d3eb8f (name=default) with tier type = 2024-09-22T08:36:42.793 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.780+0000 7f1d4d5a7800 1 -- 172.21.15.142:0/2604712161 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fd9af8b460 con 0x7f1d4403b350 2024-09-22T08:36:42.793 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.781+0000 7f1d4b091640 1 -- 172.21.15.142:0/2604712161 <== osd.2 v2:172.21.15.142:6808/279438927 7 ==== osd_op_reply(44 notify.0 [create] v30'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d3c018ce0 con 0x7f1d4403b350 2024-09-22T08:36:42.793 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.781+0000 7f1d4d5a7800 1 -- 172.21.15.142:0/2604712161 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94547715078224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fd9af8b0c0 con 0x7f1d4403b350 2024-09-22T08:36:42.793 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.781+0000 7f1d4d5a7800 1 -- 172.21.15.142:0/2604712161 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fd9af8d2f0 con 0x55fd9af80720 2024-09-22T08:36:42.793 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.781+0000 7f1d4b091640 1 -- 172.21.15.142:0/2604712161 <== osd.2 v2:172.21.15.142:6808/279438927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94547715078224] v30'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d3c018ce0 con 0x7f1d4403b350 2024-09-22T08:36:42.793 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.782+0000 7f1d4a890640 1 -- 172.21.15.142:0/2604712161 <== osd.1 v2:172.21.15.142:6816/3192108003 15 ==== osd_op_reply(46 notify.1 [create] v30'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d40051070 con 0x55fd9af80720 2024-09-22T08:36:42.794 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.782+0000 7f1d4d5a7800 1 -- 172.21.15.142:0/2604712161 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94547715083840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fd9af8d710 con 0x55fd9af80720 2024-09-22T08:36:42.794 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.782+0000 7f1d4d5a7800 1 -- 172.21.15.142:0/2604712161 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fd9af8e0d0 con 0x55fd9af85130 2024-09-22T08:36:42.794 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.783+0000 7f1d4a890640 1 -- 172.21.15.142:0/2604712161 <== osd.1 v2:172.21.15.142:6816/3192108003 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94547715083840] v30'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d40051070 con 0x55fd9af80720 2024-09-22T08:36:42.794 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.783+0000 7f1d4b892640 1 -- 172.21.15.142:0/2604712161 <== osd.3 v2:172.21.15.142:6800/1064901393 14 ==== osd_op_reply(48 notify.2 [create] v30'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d4403a070 con 0x55fd9af85130 2024-09-22T08:36:42.794 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.783+0000 7f1d4d5a7800 1 -- 172.21.15.142:0/2604712161 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94547715085376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fd9af8e0d0 con 0x55fd9af85130 2024-09-22T08:36:42.794 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.783+0000 7f1d4d5a7800 1 -- 172.21.15.142:0/2604712161 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fd9af8ea90 con 0x7f1d4403b350 2024-09-22T08:36:42.794 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.785+0000 7f1d4b892640 1 -- 172.21.15.142:0/2604712161 <== osd.3 v2:172.21.15.142:6800/1064901393 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94547715085376] v30'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d4403a070 con 0x55fd9af85130 2024-09-22T08:36:42.794 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.785+0000 7f1d4b091640 1 -- 172.21.15.142:0/2604712161 <== osd.2 v2:172.21.15.142:6808/279438927 9 ==== osd_op_reply(50 notify.3 [create] v30'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d3c018ce0 con 0x7f1d4403b350 2024-09-22T08:36:42.794 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.785+0000 7f1d4d5a7800 1 -- 172.21.15.142:0/2604712161 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94547715087392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fd9af8e040 con 0x7f1d4403b350 2024-09-22T08:36:42.794 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.785+0000 7f1d4d5a7800 1 -- 172.21.15.142:0/2604712161 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fd9af8f950 con 0x55fd9af80720 2024-09-22T08:36:42.794 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.787+0000 7f1d4a890640 1 -- 172.21.15.142:0/2604712161 <== osd.1 v2:172.21.15.142:6816/3192108003 17 ==== osd_op_reply(52 notify.4 [create] v30'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d40051070 con 0x55fd9af80720 2024-09-22T08:36:42.794 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.787+0000 7f1d4d5a7800 1 -- 172.21.15.142:0/2604712161 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94547715093664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fd9af8f900 con 0x55fd9af80720 2024-09-22T08:36:42.794 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.787+0000 7f1d4d5a7800 1 -- 172.21.15.142:0/2604712161 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fd9af908f0 con 0x7f1d3c017050 2024-09-22T08:36:42.794 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.787+0000 7f1d4b091640 1 -- 172.21.15.142:0/2604712161 <== osd.2 v2:172.21.15.142:6808/279438927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94547715087392] v30'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d3c018ce0 con 0x7f1d4403b350 2024-09-22T08:36:42.795 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.788+0000 7f1d4a890640 1 -- 172.21.15.142:0/2604712161 <== osd.1 v2:172.21.15.142:6816/3192108003 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94547715093664] v30'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d40051070 con 0x55fd9af80720 2024-09-22T08:36:42.795 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.788+0000 7f1d4a890640 1 -- 172.21.15.142:0/2604712161 <== osd.0 v2:172.21.15.31:6800/168281188 11 ==== osd_op_reply(54 notify.5 [create] v30'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d40051070 con 0x7f1d3c017050 2024-09-22T08:36:42.795 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.788+0000 7f1d4d5a7800 1 -- 172.21.15.142:0/2604712161 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94547715097536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fd9af908b0 con 0x7f1d3c017050 2024-09-22T08:36:42.795 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.788+0000 7f1d4d5a7800 1 -- 172.21.15.142:0/2604712161 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fd9af908b0 con 0x7f1d3c017050 2024-09-22T08:36:42.795 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.789+0000 7f1d4a890640 1 -- 172.21.15.142:0/2604712161 <== osd.0 v2:172.21.15.31:6800/168281188 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94547715097536] v30'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d40051070 con 0x7f1d3c017050 2024-09-22T08:36:42.795 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.789+0000 7f1d4a890640 1 -- 172.21.15.142:0/2604712161 <== osd.0 v2:172.21.15.31:6800/168281188 13 ==== osd_op_reply(56 notify.6 [create] v30'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d40051070 con 0x7f1d3c017050 2024-09-22T08:36:42.795 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.789+0000 7f1d4d5a7800 1 -- 172.21.15.142:0/2604712161 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94547715092096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fd9af90d60 con 0x7f1d3c017050 2024-09-22T08:36:42.795 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.789+0000 7f1d4d5a7800 1 -- 172.21.15.142:0/2604712161 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fd9af91790 con 0x7f1d3c017050 2024-09-22T08:36:42.799 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.790+0000 7f1d4a890640 1 -- 172.21.15.142:0/2604712161 <== osd.0 v2:172.21.15.31:6800/168281188 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94547715092096] v30'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d40051070 con 0x7f1d3c017050 2024-09-22T08:36:42.799 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.790+0000 7f1d4a890640 1 -- 172.21.15.142:0/2604712161 <== osd.0 v2:172.21.15.31:6800/168281188 15 ==== osd_op_reply(58 notify.7 [create] v30'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d40051070 con 0x7f1d3c017050 2024-09-22T08:36:42.799 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.790+0000 7f1d4d5a7800 1 -- 172.21.15.142:0/2604712161 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94547715101344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fd9af91790 con 0x7f1d3c017050 2024-09-22T08:36:42.799 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.790+0000 7f1d4d5a7800 20 add_watcher() i=0 2024-09-22T08:36:42.799 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.790+0000 7f1d4d5a7800 20 add_watcher() i=1 2024-09-22T08:36:42.799 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.790+0000 7f1d4d5a7800 20 add_watcher() i=2 2024-09-22T08:36:42.799 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.790+0000 7f1d4d5a7800 20 add_watcher() i=3 2024-09-22T08:36:42.799 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.790+0000 7f1d4d5a7800 20 add_watcher() i=4 2024-09-22T08:36:42.799 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.790+0000 7f1d4d5a7800 20 add_watcher() i=5 2024-09-22T08:36:42.799 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.790+0000 7f1d4d5a7800 20 add_watcher() i=6 2024-09-22T08:36:42.799 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.791+0000 7f1d4a890640 1 -- 172.21.15.142:0/2604712161 <== osd.0 v2:172.21.15.31:6800/168281188 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94547715101344] v30'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d40051070 con 0x7f1d3c017050 2024-09-22T08:36:42.799 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.791+0000 7f1d4d5a7800 20 add_watcher() i=7 2024-09-22T08:36:42.799 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.791+0000 7f1d4d5a7800 2 all 8 watchers are set, enabling cache 2024-09-22T08:36:42.800 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.791+0000 7f1d4d5a7800 1 -- 172.21.15.142:0/2604712161 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fd9af94d10 con 0x55fd9af80720 2024-09-22T08:36:42.800 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.791+0000 7f1d4a890640 1 -- 172.21.15.142:0/2604712161 <== osd.1 v2:172.21.15.142:6816/3192108003 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f1d40051070 con 0x55fd9af80720 2024-09-22T08:36:42.800 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.791+0000 7f1d4d5a7800 1 -- 172.21.15.142:0/2604712161 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94547715098800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fd9af92070 con 0x55fd9af80720 2024-09-22T08:36:42.800 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.793+0000 7f1d4a890640 1 -- 172.21.15.142:0/2604712161 <== osd.1 v2:172.21.15.142:6816/3192108003 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94547715098800] v30'52 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1d40051070 con 0x55fd9af80720 2024-09-22T08:36:42.800 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.793+0000 7f1c01fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:36:42.800 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.793+0000 7f1d4d5a7800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:36:42.800 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.793+0000 7f1d4d5a7800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:36:42.800 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.793+0000 7f1d4d5a7800 5 note: GC not initialized 2024-09-22T08:36:42.800 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.794+0000 7f1c00fe1640 20 reqs_thread_entry: start 2024-09-22T08:36:42.800 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.794+0000 7f1d4d5a7800 20 init_complete bucket index max shards: 11 2024-09-22T08:36:42.800 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.794+0000 7f1d4d5a7800 20 Filter name: none 2024-09-22T08:36:42.800 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.794+0000 7f1b7a7fc640 20 reqs_thread_entry: start 2024-09-22T08:36:42.800 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.794+0000 7f1d4d5a7800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-22T08:36:42.800 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.794+0000 7f1d4d5a7800 20 rados->read ofs=0 len=0 2024-09-22T08:36:42.801 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.794+0000 7f1d4d5a7800 1 -- 172.21.15.142:0/2604712161 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fd9afc8070 con 0x7f1d3c017050 2024-09-22T08:36:42.801 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.794+0000 7f1d4a890640 1 -- 172.21.15.142:0/2604712161 <== osd.0 v2:172.21.15.31:6800/168281188 17 ==== osd_op_reply(62 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f1d40051070 con 0x7f1d3c017050 2024-09-22T08:36:42.801 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.795+0000 7f1d4d5a7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:42.801 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.795+0000 7f1d4d5a7800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-09-22T08:36:42.801 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.795+0000 7f1d4d5a7800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-22T08:36:42.801 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.795+0000 7f1d4d5a7800 10 cache get: name=default.rgw.meta+users.email+foo@foo.com : miss 2024-09-22T08:36:42.801 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.795+0000 7f1d4d5a7800 20 rados->read ofs=0 len=0 2024-09-22T08:36:42.801 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.795+0000 7f1d4d5a7800 1 -- 172.21.15.142:0/2604712161 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:63 8.3 8:c162d5d1:users.email::foo@foo.com:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fd9afc65d0 con 0x55fd9af80720 2024-09-22T08:36:42.801 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.795+0000 7f1d4a890640 1 -- 172.21.15.142:0/2604712161 <== osd.1 v2:172.21.15.142:6816/3192108003 21 ==== osd_op_reply(63 foo@foo.com [stat out=16b,read 0~7 out=7b] v0'0 uv1 ondisk = 0) ==== 197+0+23 (crc 0 0 0) 0x7f1d40051070 con 0x55fd9af80720 2024-09-22T08:36:42.801 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.795+0000 7f1d4d5a7800 20 rados_obj.operate() r=0 bl.length=7 2024-09-22T08:36:42.801 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.795+0000 7f1d4d5a7800 10 cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x5 2024-09-22T08:36:42.801 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.795+0000 7f1d4d5a7800 10 adding default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-09-22T08:36:42.801 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.795+0000 7f1d4d5a7800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-22T08:36:42.801 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.795+0000 7f1d4d5a7800 20 rados->read ofs=0 len=0 2024-09-22T08:36:42.802 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.795+0000 7f1d4d5a7800 1 -- 172.21.15.142:0/2604712161 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fd9afc69c0 con 0x55fd9af80720 2024-09-22T08:36:42.802 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.795+0000 7f1d4a890640 1 -- 172.21.15.142:0/2604712161 <== osd.1 v2:172.21.15.142:6816/3192108003 22 ==== osd_op_reply(64 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f1d40051070 con 0x55fd9af80720 2024-09-22T08:36:42.802 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.795+0000 7f1d4d5a7800 20 rados_obj.operate() r=0 bl.length=391 2024-09-22T08:36:42.802 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.795+0000 7f1d4d5a7800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-22T08:36:42.802 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.795+0000 7f1d4d5a7800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-22T08:36:42.802 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.795+0000 7f1d4d5a7800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:36:42.802 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.795+0000 7f1d4d5a7800 10 chain_cache_entry: cache_locator=default.rgw.meta+users.uid+foo 2024-09-22T08:36:42.802 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.795+0000 7f1d4d5a7800 20 get_user_info_from_index found 0 xattrs 2024-09-22T08:36:42.802 INFO:teuthology.orchestra.run.smithi142.stderr:could not create user: unable to parse parameters, email: foo@foo.com is the email address of an existing user 2024-09-22T08:36:42.802 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.796+0000 7f1c01fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:36:42.802 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.796+0000 7f1d4d5a7800 1 -- 172.21.15.142:0/2604712161 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94547715098800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fd9af7c5d0 con 0x55fd9af80720 2024-09-22T08:36:42.802 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.797+0000 7f1d4a890640 1 -- 172.21.15.142:0/2604712161 <== osd.1 v2:172.21.15.142:6816/3192108003 23 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94547715098800] v30'53 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1d40051070 con 0x55fd9af80720 2024-09-22T08:36:42.802 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.797+0000 7f1d4d5a7800 1 -- 172.21.15.142:0/2604712161 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94547715078224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fd9af908b0 con 0x7f1d4403b350 2024-09-22T08:36:42.804 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.798+0000 7f1d4b091640 1 -- 172.21.15.142:0/2604712161 <== osd.2 v2:172.21.15.142:6808/279438927 11 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94547715078224] v30'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d3c018ce0 con 0x7f1d4403b350 2024-09-22T08:36:42.804 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.798+0000 7f1d4d5a7800 20 remove_watcher() i=0 2024-09-22T08:36:42.804 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.798+0000 7f1d4d5a7800 2 removed watcher, disabling cache 2024-09-22T08:36:42.804 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.798+0000 7f1d4d5a7800 1 -- 172.21.15.142:0/2604712161 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94547715083840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fd9af8b850 con 0x55fd9af80720 2024-09-22T08:36:42.804 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.799+0000 7f1d4a890640 1 -- 172.21.15.142:0/2604712161 <== osd.1 v2:172.21.15.142:6816/3192108003 24 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94547715083840] v30'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d40051070 con 0x55fd9af80720 2024-09-22T08:36:42.804 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.799+0000 7f1d4d5a7800 20 remove_watcher() i=1 2024-09-22T08:36:42.804 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.799+0000 7f1d4d5a7800 1 -- 172.21.15.142:0/2604712161 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94547715085376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fd9af8b850 con 0x55fd9af85130 2024-09-22T08:36:42.804 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.801+0000 7f1d4b892640 1 -- 172.21.15.142:0/2604712161 <== osd.3 v2:172.21.15.142:6800/1064901393 16 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94547715085376] v30'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d4403a070 con 0x55fd9af85130 2024-09-22T08:36:42.805 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.801+0000 7f1d4d5a7800 20 remove_watcher() i=2 2024-09-22T08:36:42.805 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.801+0000 7f1d4d5a7800 1 -- 172.21.15.142:0/2604712161 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94547715087392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fd9af8d440 con 0x7f1d4403b350 2024-09-22T08:36:42.805 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.801+0000 7f1d4b091640 1 -- 172.21.15.142:0/2604712161 <== osd.2 v2:172.21.15.142:6808/279438927 12 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94547715087392] v30'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d3c018ce0 con 0x7f1d4403b350 2024-09-22T08:36:42.805 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.801+0000 7f1d4d5a7800 20 remove_watcher() i=3 2024-09-22T08:36:42.805 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.801+0000 7f1d4d5a7800 1 -- 172.21.15.142:0/2604712161 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94547715093664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fd9af8b850 con 0x55fd9af80720 2024-09-22T08:36:42.805 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.802+0000 7f1d4a890640 1 -- 172.21.15.142:0/2604712161 <== osd.1 v2:172.21.15.142:6816/3192108003 25 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94547715093664] v30'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d40051070 con 0x55fd9af80720 2024-09-22T08:36:42.805 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.803+0000 7f1d4d5a7800 20 remove_watcher() i=4 2024-09-22T08:36:42.805 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.803+0000 7f1d4d5a7800 1 -- 172.21.15.142:0/2604712161 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94547715097536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fd9af8dc20 con 0x7f1d3c017050 2024-09-22T08:36:42.806 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.803+0000 7f1d4a890640 1 -- 172.21.15.142:0/2604712161 <== osd.0 v2:172.21.15.31:6800/168281188 18 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94547715097536] v30'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d40051070 con 0x7f1d3c017050 2024-09-22T08:36:42.806 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.803+0000 7f1d4d5a7800 20 remove_watcher() i=5 2024-09-22T08:36:42.806 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.803+0000 7f1d4d5a7800 1 -- 172.21.15.142:0/2604712161 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94547715092096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fd9af8dc20 con 0x7f1d3c017050 2024-09-22T08:36:42.806 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.804+0000 7f1d4a890640 1 -- 172.21.15.142:0/2604712161 <== osd.0 v2:172.21.15.31:6800/168281188 19 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94547715092096] v30'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d40051070 con 0x7f1d3c017050 2024-09-22T08:36:42.806 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.804+0000 7f1d4d5a7800 20 remove_watcher() i=6 2024-09-22T08:36:42.806 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.804+0000 7f1d4d5a7800 1 -- 172.21.15.142:0/2604712161 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94547715101344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fd9af8dc20 con 0x7f1d3c017050 2024-09-22T08:36:42.809 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.805+0000 7f1d4a890640 1 -- 172.21.15.142:0/2604712161 <== osd.0 v2:172.21.15.31:6800/168281188 20 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94547715101344] v30'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d40051070 con 0x7f1d3c017050 2024-09-22T08:36:42.809 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.805+0000 7f1d4d5a7800 20 remove_watcher() i=7 2024-09-22T08:36:42.809 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.805+0000 7f1d4d5a7800 1 -- 172.21.15.142:0/2604712161 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f1d3c017050 msgr2=0x7f1d3c0167e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:42.809 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.805+0000 7f1d4d5a7800 1 --2- 172.21.15.142:0/2604712161 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f1d3c017050 0x7f1d3c0167e0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:42.809 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.805+0000 7f1d4d5a7800 1 -- 172.21.15.142:0/2604712161 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55fd9af80720 msgr2=0x55fd9af82be0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:42.809 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.805+0000 7f1d4d5a7800 1 --2- 172.21.15.142:0/2604712161 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55fd9af80720 0x55fd9af82be0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:42.809 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.805+0000 7f1d4d5a7800 1 -- 172.21.15.142:0/2604712161 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f1d4403b350 msgr2=0x7f1d4403b7b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:42.809 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.805+0000 7f1d4d5a7800 1 --2- 172.21.15.142:0/2604712161 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f1d4403b350 0x7f1d4403b7b0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:42.809 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.805+0000 7f1d4d5a7800 1 -- 172.21.15.142:0/2604712161 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55fd9af85130 msgr2=0x55fd9af87520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:42.810 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.806+0000 7f1d4d5a7800 1 --2- 172.21.15.142:0/2604712161 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55fd9af85130 0x55fd9af87520 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:42.810 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.806+0000 7f1d4d5a7800 1 -- 172.21.15.142:0/2604712161 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f1c1403d150 msgr2=0x7f1c1403f610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:42.810 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.806+0000 7f1d4d5a7800 1 --2- 172.21.15.142:0/2604712161 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f1c1403d150 0x7f1c1403f610 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f1d3c018f90 tx=0x7f1d3c046000 comp rx=0 tx=0).stop 2024-09-22T08:36:42.810 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.806+0000 7f1d4d5a7800 1 -- 172.21.15.142:0/2604712161 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fd9af6d800 msgr2=0x55fd9af74d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:42.810 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.806+0000 7f1d4d5a7800 1 --2- 172.21.15.142:0/2604712161 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fd9af6d800 0x55fd9af74d60 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f1d440208e0 tx=0x7f1d44054860 comp rx=0 tx=0).stop 2024-09-22T08:36:42.810 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.806+0000 7f1d4a890640 1 -- 172.21.15.142:0/2604712161 reap_dead start 2024-09-22T08:36:42.810 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.806+0000 7f1d4a890640 1 -- 172.21.15.142:0/2604712161 reap_dead start 2024-09-22T08:36:42.810 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.806+0000 7f1d4d5a7800 1 -- 172.21.15.142:0/2604712161 shutdown_connections 2024-09-22T08:36:42.810 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.806+0000 7f1d4d5a7800 1 -- 172.21.15.142:0/2604712161 >> 172.21.15.142:0/2604712161 conn(0x55fd9af69c00 msgr2=0x55fd9af67e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:42.810 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.806+0000 7f1d4d5a7800 1 -- 172.21.15.142:0/2604712161 shutdown_connections 2024-09-22T08:36:42.810 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.806+0000 7f1d4d5a7800 1 -- 172.21.15.142:0/2604712161 wait complete. 2024-09-22T08:36:42.810 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.806+0000 7f1d4d5a7800 1 -- 172.21.15.142:0/2286861457 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f1c2403cfb0 msgr2=0x7f1c2403f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:42.810 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.806+0000 7f1d4d5a7800 1 --2- 172.21.15.142:0/2286861457 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f1c2403cfb0 0x7f1c2403f470 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x55fd9af47de0 tx=0x7f1d3c052a40 comp rx=0 tx=0).stop 2024-09-22T08:36:42.810 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.806+0000 7f1d4d5a7800 1 -- 172.21.15.142:0/2286861457 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fd9af60cc0 msgr2=0x55fd9af610e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:42.811 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.806+0000 7f1d4d5a7800 1 --2- 172.21.15.142:0/2286861457 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fd9af60cc0 0x55fd9af610e0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x55fd9af46b70 tx=0x7f1d440167b0 comp rx=0 tx=0).stop 2024-09-22T08:36:42.811 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.806+0000 7f1d4d5a7800 1 -- 172.21.15.142:0/2286861457 shutdown_connections 2024-09-22T08:36:42.811 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.806+0000 7f1d4d5a7800 1 --2- 172.21.15.142:0/2286861457 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f1c2403cfb0 0x7f1c2403f470 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:42.811 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.806+0000 7f1d4d5a7800 1 --2- 172.21.15.142:0/2286861457 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fd9af60cc0 0x55fd9af610e0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:42.811 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.806+0000 7f1d4d5a7800 1 -- 172.21.15.142:0/2286861457 >> 172.21.15.142:0/2286861457 conn(0x55fd9af55070 msgr2=0x55fd9af55450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:42.811 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.806+0000 7f1d4d5a7800 1 -- 172.21.15.142:0/2286861457 shutdown_connections 2024-09-22T08:36:42.811 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.806+0000 7f1d4d5a7800 1 -- 172.21.15.142:0/2286861457 wait complete. 2024-09-22T08:36:42.811 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.807+0000 7f1d4d5a7800 1 -- 172.21.15.142:0/3228736724 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55fd9adc2590 msgr2=0x55fd9af4d330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:42.811 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.807+0000 7f1d4d5a7800 1 --2- 172.21.15.142:0/3228736724 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55fd9adc2590 0x55fd9af4d330 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:42.811 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.807+0000 7f1d4d5a7800 1 -- 172.21.15.142:0/3228736724 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55fd9af4f6d0 msgr2=0x55fd9af51b70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:42.811 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.807+0000 7f1d4d5a7800 1 --2- 172.21.15.142:0/3228736724 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55fd9af4f6d0 0x55fd9af51b70 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:42.811 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.807+0000 7f1d4d5a7800 1 -- 172.21.15.142:0/3228736724 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f1c3003cfb0 msgr2=0x7f1c3003f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:42.811 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.807+0000 7f1d4d5a7800 1 --2- 172.21.15.142:0/3228736724 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f1c3003cfb0 0x7f1c3003f470 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f1d40057000 tx=0x7f1d40052000 comp rx=0 tx=0).stop 2024-09-22T08:36:42.811 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.807+0000 7f1d4d5a7800 1 -- 172.21.15.142:0/3228736724 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fd9adc1280 msgr2=0x55fd9af45ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:42.812 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.807+0000 7f1d4d5a7800 1 --2- 172.21.15.142:0/3228736724 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fd9adc1280 0x55fd9af45ce0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f1d3c0012b0 tx=0x7f1d3c000ed0 comp rx=0 tx=0).stop 2024-09-22T08:36:42.812 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.807+0000 7f1d4d5a7800 1 -- 172.21.15.142:0/3228736724 shutdown_connections 2024-09-22T08:36:42.812 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.807+0000 7f1d4d5a7800 1 --2- 172.21.15.142:0/3228736724 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55fd9af4f6d0 0x55fd9af51b70 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:42.812 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.807+0000 7f1d4d5a7800 1 --2- 172.21.15.142:0/3228736724 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55fd9adc2590 0x55fd9af4d330 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:42.812 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.807+0000 7f1d4d5a7800 1 --2- 172.21.15.142:0/3228736724 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f1c3003cfb0 0x7f1c3003f470 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:42.812 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.807+0000 7f1d4d5a7800 1 --2- 172.21.15.142:0/3228736724 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fd9adc1280 0x55fd9af45ce0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:42.812 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.807+0000 7f1d4d5a7800 1 -- 172.21.15.142:0/3228736724 >> 172.21.15.142:0/3228736724 conn(0x55fd9ae47dd0 msgr2=0x55fd9af3f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:42.812 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.807+0000 7f1d4d5a7800 1 -- 172.21.15.142:0/3228736724 shutdown_connections 2024-09-22T08:36:42.812 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.807+0000 7f1d4d5a7800 1 -- 172.21.15.142:0/3228736724 wait complete. 2024-09-22T08:36:42.816 DEBUG:teuthology.orchestra.run:got remote process result: 240 2024-09-22T08:36:42.817 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-22T08:36:42.817 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-22T08:36:42.817 DEBUG:teuthology.orchestra.run.smithi142:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-22T08:36:42.861 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:36:42.861 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:36:42.862 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.861+0000 7f3461746800 1 Processor -- start 2024-09-22T08:36:42.862 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.861+0000 7f3461746800 1 -- start start 2024-09-22T08:36:42.862 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.861+0000 7f3461746800 1 --2- >> v2:172.21.15.31:3300/0 conn(0x564d52b899c0 0x564d52b8be80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:42.862 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.861+0000 7f3461746800 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x564d52a10a20 con 0x564d52af9550 2024-09-22T08:36:42.863 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.861+0000 7f3461746800 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x564d52a107d0 con 0x564d52b899c0 2024-09-22T08:36:42.863 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.862+0000 7f345ea2f640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x564d52b899c0 0x564d52b8be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:42.863 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.862+0000 7f345f230640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x564d52af9550 0x564d52b88130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.142:42304/0 (socket says 172.21.15.142:42304) 2024-09-22T08:36:42.863 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.862+0000 7f345f230640 1 -- 172.21.15.142:0/2076822293 learned_addr learned my addr 172.21.15.142:0/2076822293 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-09-22T08:36:42.864 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.862+0000 7f345ea2f640 1 -- 172.21.15.142:0/2076822293 >> v1:172.21.15.31:6789/0 conn(0x564d52af9550 legacy=0x564d52b88130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:42.864 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.862+0000 7f345ea2f640 1 -- 172.21.15.142:0/2076822293 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x564d52b8d560 con 0x564d52b899c0 2024-09-22T08:36:42.865 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.864+0000 7f345ea2f640 1 --2- 172.21.15.142:0/2076822293 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564d52b899c0 0x564d52b8be80 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f345400a470 tx=0x7f3454045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc1e35a91634b1c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:42.865 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.864+0000 7f345e22e640 1 -- 172.21.15.142:0/2076822293 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3454053570 con 0x564d52b899c0 2024-09-22T08:36:42.865 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.864+0000 7f345e22e640 1 -- 172.21.15.142:0/2076822293 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3454058070 con 0x564d52b899c0 2024-09-22T08:36:42.865 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.864+0000 7f345e22e640 1 -- 172.21.15.142:0/2076822293 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3454053880 con 0x564d52b899c0 2024-09-22T08:36:42.866 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.864+0000 7f3461746800 1 -- 172.21.15.142:0/2076822293 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564d52b899c0 msgr2=0x564d52b8be80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:42.866 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.864+0000 7f3461746800 1 --2- 172.21.15.142:0/2076822293 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564d52b899c0 0x564d52b8be80 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f345400a470 tx=0x7f3454045a20 comp rx=0 tx=0).stop 2024-09-22T08:36:42.866 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.864+0000 7f3461746800 1 -- 172.21.15.142:0/2076822293 shutdown_connections 2024-09-22T08:36:42.866 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.864+0000 7f3461746800 1 --2- 172.21.15.142:0/2076822293 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564d52b899c0 0x564d52b8be80 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:42.867 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.864+0000 7f3461746800 1 -- 172.21.15.142:0/2076822293 >> 172.21.15.142:0/2076822293 conn(0x564d52b7fba0 msgr2=0x564d52b82000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:42.867 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.864+0000 7f3461746800 1 -- 172.21.15.142:0/2076822293 shutdown_connections 2024-09-22T08:36:42.867 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.864+0000 7f3461746800 1 -- 172.21.15.142:0/2076822293 wait complete. 2024-09-22T08:36:42.880 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.878+0000 7f3461746800 1 Processor -- start 2024-09-22T08:36:42.880 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.878+0000 7f3461746800 1 -- start start 2024-09-22T08:36:42.880 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.878+0000 7f3461746800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564d52af9550 0x564d52b85870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:42.880 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.878+0000 7f3461746800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x564d52a1ddd0 con 0x564d52af9550 2024-09-22T08:36:42.880 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.879+0000 7f345f230640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564d52af9550 0x564d52b85870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:42.880 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.879+0000 7f345f230640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564d52af9550 0x564d52b85870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:37982/0 (socket says 172.21.15.142:37982) 2024-09-22T08:36:42.880 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.879+0000 7f345f230640 1 -- 172.21.15.142:0/2932170327 learned_addr learned my addr 172.21.15.142:0/2932170327 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:42.880 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.879+0000 7f345f230640 1 -- 172.21.15.142:0/2932170327 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564d52b85e60 con 0x564d52af9550 2024-09-22T08:36:42.882 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.879+0000 7f345f230640 1 --2- 172.21.15.142:0/2932170327 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564d52af9550 0x564d52b85870 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f3450001800 tx=0x7f3450001cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f3c823a5e22ec49 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:42.882 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.879+0000 7f334d60a640 1 -- 172.21.15.142:0/2932170327 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3450004520 con 0x564d52af9550 2024-09-22T08:36:42.882 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.879+0000 7f334d60a640 1 -- 172.21.15.142:0/2932170327 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34500046c0 con 0x564d52af9550 2024-09-22T08:36:42.882 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.879+0000 7f334d60a640 1 -- 172.21.15.142:0/2932170327 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34500049e0 con 0x564d52af9550 2024-09-22T08:36:42.882 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.880+0000 7f3461746800 1 -- 172.21.15.142:0/2932170327 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564d52af9550 msgr2=0x564d52b85870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:42.882 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.880+0000 7f3461746800 1 --2- 172.21.15.142:0/2932170327 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564d52af9550 0x564d52b85870 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f3450001800 tx=0x7f3450001cc0 comp rx=0 tx=0).stop 2024-09-22T08:36:42.882 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.880+0000 7f3461746800 1 -- 172.21.15.142:0/2932170327 shutdown_connections 2024-09-22T08:36:42.882 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.880+0000 7f3461746800 1 --2- 172.21.15.142:0/2932170327 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564d52af9550 0x564d52b85870 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:42.883 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.880+0000 7f3461746800 1 -- 172.21.15.142:0/2932170327 >> 172.21.15.142:0/2932170327 conn(0x564d52b7fba0 msgr2=0x564d52c709c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:42.883 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.880+0000 7f3461746800 1 -- 172.21.15.142:0/2932170327 shutdown_connections 2024-09-22T08:36:42.883 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.880+0000 7f3461746800 1 -- 172.21.15.142:0/2932170327 wait complete. 2024-09-22T08:36:42.883 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.880+0000 7f3461746800 1 Processor -- start 2024-09-22T08:36:42.883 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.880+0000 7f3461746800 1 -- start start 2024-09-22T08:36:42.883 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.880+0000 7f3461746800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564d52af9550 0x564d52c7ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:42.883 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.880+0000 7f3461746800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x564d52b8c800 con 0x564d52af9550 2024-09-22T08:36:42.883 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.881+0000 7f345f230640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564d52af9550 0x564d52c7ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:42.883 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.881+0000 7f345f230640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564d52af9550 0x564d52c7ed30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:37998/0 (socket says 172.21.15.142:37998) 2024-09-22T08:36:42.883 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.881+0000 7f345f230640 1 -- 172.21.15.142:0/3028068951 learned_addr learned my addr 172.21.15.142:0/3028068951 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:42.883 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.881+0000 7f345f230640 1 -- 172.21.15.142:0/3028068951 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564d52c7f290 con 0x564d52af9550 2024-09-22T08:36:42.885 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.881+0000 7f345f230640 1 --2- 172.21.15.142:0/3028068951 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564d52af9550 0x564d52c7ed30 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f3450000f80 tx=0x7f3450001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:42.886 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.881+0000 7f334be07640 1 -- 172.21.15.142:0/3028068951 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3450022020 con 0x564d52af9550 2024-09-22T08:36:42.886 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.881+0000 7f334be07640 1 -- 172.21.15.142:0/3028068951 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3450014890 con 0x564d52af9550 2024-09-22T08:36:42.886 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.881+0000 7f3461746800 1 -- 172.21.15.142:0/3028068951 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564d52c7f580 con 0x564d52af9550 2024-09-22T08:36:42.886 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.882+0000 7f334be07640 1 -- 172.21.15.142:0/3028068951 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3450014bb0 con 0x564d52af9550 2024-09-22T08:36:42.886 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.882+0000 7f3461746800 1 -- 172.21.15.142:0/3028068951 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564d52c80130 con 0x564d52af9550 2024-09-22T08:36:42.886 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.882+0000 7f334be07640 1 -- 172.21.15.142:0/3028068951 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f3450025020 con 0x564d52af9550 2024-09-22T08:36:42.886 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.883+0000 7f334be07640 1 --2- 172.21.15.142:0/3028068951 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f334403cfb0 0x7f334403f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:42.886 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.883+0000 7f334be07640 1 -- 172.21.15.142:0/3028068951 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f3450018030 con 0x564d52af9550 2024-09-22T08:36:42.886 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.883+0000 7f345ea2f640 1 --2- 172.21.15.142:0/3028068951 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f334403cfb0 0x7f334403f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:42.886 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.883+0000 7f3461746800 1 --2- 172.21.15.142:0/3028068951 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x564d52b899c0 0x564d52c86380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:42.886 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.883+0000 7f3461746800 1 -- 172.21.15.142:0/3028068951 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564d52c868c0 con 0x564d52b899c0 2024-09-22T08:36:42.887 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.883+0000 7f345fa31640 1 --2- 172.21.15.142:0/3028068951 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x564d52b899c0 0x564d52c86380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:42.887 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.883+0000 7f345ea2f640 1 --2- 172.21.15.142:0/3028068951 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f334403cfb0 0x7f334403f470 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f3454057000 tx=0x7f3454052000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:42.887 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.883+0000 7f345fa31640 1 --2- 172.21.15.142:0/3028068951 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x564d52b899c0 0x564d52c86380 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:42.887 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.884+0000 7f345fa31640 1 -- 172.21.15.142:0/3028068951 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f34580083e0 con 0x564d52b899c0 2024-09-22T08:36:42.887 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.884+0000 7f3461746800 1 -- 172.21.15.142:0/3028068951 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564d52c86c60 con 0x564d52b899c0 2024-09-22T08:36:42.887 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.884+0000 7f345fa31640 1 -- 172.21.15.142:0/3028068951 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f34580083e0 con 0x564d52b899c0 2024-09-22T08:36:42.887 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.884+0000 7f3461746800 1 --2- 172.21.15.142:0/3028068951 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x564d52c887a0 0x564d52c8ac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:42.887 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.884+0000 7f3461746800 1 -- 172.21.15.142:0/3028068951 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:3 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564d52c8b3d0 con 0x564d52c887a0 2024-09-22T08:36:42.887 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.884+0000 7f345f230640 1 --2- 172.21.15.142:0/3028068951 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x564d52c887a0 0x564d52c8ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:42.887 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.884+0000 7f345f230640 1 --2- 172.21.15.142:0/3028068951 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x564d52c887a0 0x564d52c8ac40 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:42.887 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.885+0000 7f345f230640 1 -- 172.21.15.142:0/3028068951 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(3 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f345001b070 con 0x564d52c887a0 2024-09-22T08:36:42.887 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.885+0000 7f3461746800 1 -- 172.21.15.142:0/3028068951 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564d52c874b0 con 0x564d52b899c0 2024-09-22T08:36:42.892 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.885+0000 7f345fa31640 1 -- 172.21.15.142:0/3028068951 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f34580083e0 con 0x564d52b899c0 2024-09-22T08:36:42.892 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.885+0000 7f3461746800 1 -- 172.21.15.142:0/3028068951 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564d52c87950 con 0x564d52c887a0 2024-09-22T08:36:42.892 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.885+0000 7f345f230640 1 -- 172.21.15.142:0/3028068951 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(5 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f345001b070 con 0x564d52c887a0 2024-09-22T08:36:42.892 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.885+0000 7f3461746800 1 Processor -- start 2024-09-22T08:36:42.892 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.885+0000 7f3461746800 1 -- start start 2024-09-22T08:36:42.892 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.886+0000 7f3461746800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564d52c99dd0 0x564d52c9a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:42.893 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.886+0000 7f3461746800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x564d52a7cd50 con 0x564d52c99dd0 2024-09-22T08:36:42.893 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.886+0000 7f345fa31640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564d52c99dd0 0x564d52c9a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:42.893 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.886+0000 7f345fa31640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564d52c99dd0 0x564d52c9a1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:38012/0 (socket says 172.21.15.142:38012) 2024-09-22T08:36:42.893 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.886+0000 7f345fa31640 1 -- 172.21.15.142:0/2276105099 learned_addr learned my addr 172.21.15.142:0/2276105099 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:42.893 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.886+0000 7f345fa31640 1 -- 172.21.15.142:0/2276105099 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564d52c9a830 con 0x564d52c99dd0 2024-09-22T08:36:42.893 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.886+0000 7f345fa31640 1 --2- 172.21.15.142:0/2276105099 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564d52c99dd0 0x564d52c9a1f0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x564d52c80cc0 tx=0x7f345800bf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:42.893 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.886+0000 7f3349602640 1 -- 172.21.15.142:0/2276105099 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f345801c020 con 0x564d52c99dd0 2024-09-22T08:36:42.893 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.887+0000 7f3349602640 1 -- 172.21.15.142:0/2276105099 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3458007c90 con 0x564d52c99dd0 2024-09-22T08:36:42.893 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.887+0000 7f3461746800 1 -- 172.21.15.142:0/2276105099 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564d52c9b060 con 0x564d52c99dd0 2024-09-22T08:36:42.893 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.887+0000 7f3349602640 1 -- 172.21.15.142:0/2276105099 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3458018440 con 0x564d52c99dd0 2024-09-22T08:36:42.893 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.887+0000 7f3461746800 1 -- 172.21.15.142:0/2276105099 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564d52c9b600 con 0x564d52c99dd0 2024-09-22T08:36:42.893 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.887+0000 7f3349602640 1 -- 172.21.15.142:0/2276105099 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f345801f020 con 0x564d52c99dd0 2024-09-22T08:36:42.893 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.888+0000 7f3349602640 1 --2- 172.21.15.142:0/2276105099 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f333803cfb0 0x7f333803f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:42.894 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.888+0000 7f3349602640 1 -- 172.21.15.142:0/2276105099 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f3458055930 con 0x564d52c99dd0 2024-09-22T08:36:42.894 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.888+0000 7f345f230640 1 --2- 172.21.15.142:0/2276105099 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f333803cfb0 0x7f333803f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:42.894 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.888+0000 7f3461746800 1 Processor -- start 2024-09-22T08:36:42.894 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.888+0000 7f3461746800 1 -- start start 2024-09-22T08:36:42.894 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.888+0000 7f345f230640 1 --2- 172.21.15.142:0/2276105099 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f333803cfb0 0x7f333803f470 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f3450052b50 tx=0x7f3450011f40 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:42.894 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.888+0000 7f3461746800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564d52ca6830 0x564d52ca6c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:42.894 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.888+0000 7f3461746800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x564d52b842b0 con 0x564d52ca6830 2024-09-22T08:36:42.894 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.888+0000 7f345fa31640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564d52ca6830 0x564d52ca6c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:42.894 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.888+0000 7f345fa31640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564d52ca6830 0x564d52ca6c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:38022/0 (socket says 172.21.15.142:38022) 2024-09-22T08:36:42.894 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.888+0000 7f345fa31640 1 -- 172.21.15.142:0/265428513 learned_addr learned my addr 172.21.15.142:0/265428513 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:42.894 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.889+0000 7f345fa31640 1 -- 172.21.15.142:0/265428513 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564d52ca7220 con 0x564d52ca6830 2024-09-22T08:36:42.894 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.889+0000 7f345fa31640 1 --2- 172.21.15.142:0/265428513 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564d52ca6830 0x564d52ca6c30 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f3458053e40 tx=0x7f3458015f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a0ce368c01c39a server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:42.894 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.889+0000 7f3342ffd640 1 -- 172.21.15.142:0/265428513 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3458017520 con 0x564d52ca6830 2024-09-22T08:36:42.894 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.889+0000 7f3342ffd640 1 -- 172.21.15.142:0/265428513 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f345804a070 con 0x564d52ca6830 2024-09-22T08:36:42.895 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.889+0000 7f3342ffd640 1 -- 172.21.15.142:0/265428513 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3458015820 con 0x564d52ca6830 2024-09-22T08:36:42.895 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.889+0000 7f3461746800 1 -- 172.21.15.142:0/265428513 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564d52ca6830 msgr2=0x564d52ca6c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:42.895 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.889+0000 7f3461746800 1 --2- 172.21.15.142:0/265428513 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564d52ca6830 0x564d52ca6c30 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f3458053e40 tx=0x7f3458015f20 comp rx=0 tx=0).stop 2024-09-22T08:36:42.895 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.889+0000 7f3461746800 1 -- 172.21.15.142:0/265428513 shutdown_connections 2024-09-22T08:36:42.895 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.889+0000 7f3461746800 1 --2- 172.21.15.142:0/265428513 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564d52ca6830 0x564d52ca6c30 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:42.895 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.889+0000 7f3461746800 1 -- 172.21.15.142:0/265428513 >> 172.21.15.142:0/265428513 conn(0x564d52ca2c30 msgr2=0x564d52ca0e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:42.895 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.889+0000 7f3461746800 1 -- 172.21.15.142:0/265428513 shutdown_connections 2024-09-22T08:36:42.895 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.889+0000 7f3461746800 1 -- 172.21.15.142:0/265428513 wait complete. 2024-09-22T08:36:42.895 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.890+0000 7f3461746800 1 Processor -- start 2024-09-22T08:36:42.895 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.890+0000 7f3461746800 1 -- start start 2024-09-22T08:36:42.895 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.890+0000 7f3461746800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564d52ca6830 0x564d52cade10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:42.895 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.890+0000 7f3461746800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x564d52ca7840 con 0x564d52ca6830 2024-09-22T08:36:42.895 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.890+0000 7f345fa31640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564d52ca6830 0x564d52cade10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:42.895 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.890+0000 7f345fa31640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564d52ca6830 0x564d52cade10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:38028/0 (socket says 172.21.15.142:38028) 2024-09-22T08:36:42.896 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.890+0000 7f345fa31640 1 -- 172.21.15.142:0/2758798520 learned_addr learned my addr 172.21.15.142:0/2758798520 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:42.896 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.890+0000 7f345fa31640 1 -- 172.21.15.142:0/2758798520 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564d52cae370 con 0x564d52ca6830 2024-09-22T08:36:42.896 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.890+0000 7f345fa31640 1 --2- 172.21.15.142:0/2758798520 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564d52ca6830 0x564d52cade10 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f3458028fd0 tx=0x7f3458053da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:42.896 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.891+0000 7f33417fa640 1 -- 172.21.15.142:0/2758798520 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f345800b230 con 0x564d52ca6830 2024-09-22T08:36:42.896 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.891+0000 7f33417fa640 1 -- 172.21.15.142:0/2758798520 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3458013320 con 0x564d52ca6830 2024-09-22T08:36:42.896 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.891+0000 7f33417fa640 1 -- 172.21.15.142:0/2758798520 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f345800b3d0 con 0x564d52ca6830 2024-09-22T08:36:42.896 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.891+0000 7f3461746800 1 -- 172.21.15.142:0/2758798520 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564d52cae600 con 0x564d52ca6830 2024-09-22T08:36:42.896 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.891+0000 7f3461746800 1 -- 172.21.15.142:0/2758798520 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564d52caf190 con 0x564d52ca6830 2024-09-22T08:36:42.907 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.891+0000 7f33417fa640 1 -- 172.21.15.142:0/2758798520 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f3458016040 con 0x564d52ca6830 2024-09-22T08:36:42.907 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.892+0000 7f33417fa640 1 --2- 172.21.15.142:0/2758798520 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f332803d000 0x7f332803f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:42.907 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.892+0000 7f33417fa640 1 -- 172.21.15.142:0/2758798520 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f3458004d90 con 0x564d52ca6830 2024-09-22T08:36:42.907 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.892+0000 7f345f230640 1 --2- 172.21.15.142:0/2758798520 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f332803d000 0x7f332803f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:42.907 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.892+0000 7f3461746800 20 rados->read ofs=0 len=0 2024-09-22T08:36:42.907 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.892+0000 7f3461746800 1 --2- 172.21.15.142:0/2758798520 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x564d52cb96e0 0x564d52cbbba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:42.907 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.892+0000 7f3461746800 1 -- 172.21.15.142:0/2758798520 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564d52cbc2f0 con 0x564d52cb96e0 2024-09-22T08:36:42.907 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.892+0000 7f345ea2f640 1 --2- 172.21.15.142:0/2758798520 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x564d52cb96e0 0x564d52cbbba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:42.908 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.892+0000 7f345f230640 1 --2- 172.21.15.142:0/2758798520 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f332803d000 0x7f332803f4c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f3450052db0 tx=0x7f3450046000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:42.908 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.892+0000 7f345ea2f640 1 --2- 172.21.15.142:0/2758798520 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x564d52cb96e0 0x564d52cbbba0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:42.908 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.893+0000 7f345ea2f640 1 -- 172.21.15.142:0/2758798520 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3454051070 con 0x564d52cb96e0 2024-09-22T08:36:42.908 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.893+0000 7f3461746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:42.908 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.893+0000 7f3461746800 20 realm 2024-09-22T08:36:42.908 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.893+0000 7f3461746800 20 rados->read ofs=0 len=0 2024-09-22T08:36:42.908 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.893+0000 7f3461746800 1 -- 172.21.15.142:0/2758798520 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564d52cbc720 con 0x564d52cb96e0 2024-09-22T08:36:42.908 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.893+0000 7f345ea2f640 1 -- 172.21.15.142:0/2758798520 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3454051070 con 0x564d52cb96e0 2024-09-22T08:36:42.908 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.893+0000 7f3461746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:42.908 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.893+0000 7f3461746800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:36:42.908 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.893+0000 7f3461746800 20 rados->read ofs=0 len=0 2024-09-22T08:36:42.908 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.893+0000 7f3461746800 1 -- 172.21.15.142:0/2758798520 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564d52cbcff0 con 0x564d52cb96e0 2024-09-22T08:36:42.908 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.893+0000 7f345ea2f640 1 -- 172.21.15.142:0/2758798520 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3454051070 con 0x564d52cb96e0 2024-09-22T08:36:42.908 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.893+0000 7f3461746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:42.908 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.893+0000 7f3461746800 20 rados->read ofs=0 len=0 2024-09-22T08:36:42.908 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.893+0000 7f3461746800 1 -- 172.21.15.142:0/2758798520 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564d52cbd390 con 0x564d52cb96e0 2024-09-22T08:36:42.909 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.893+0000 7f345ea2f640 1 -- 172.21.15.142:0/2758798520 <== osd.1 v2:172.21.15.142:6816/3192108003 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3454051070 con 0x564d52cb96e0 2024-09-22T08:36:42.909 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.893+0000 7f3461746800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:36:42.909 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.893+0000 7f3461746800 20 rados->read ofs=0 len=0 2024-09-22T08:36:42.909 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.893+0000 7f3461746800 1 --2- 172.21.15.142:0/2758798520 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x564d52cbe0f0 0x564d52cc04e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:42.909 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.893+0000 7f3461746800 1 -- 172.21.15.142:0/2758798520 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564d52cc0a20 con 0x564d52cbe0f0 2024-09-22T08:36:42.909 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.893+0000 7f345fa31640 1 --2- 172.21.15.142:0/2758798520 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x564d52cbe0f0 0x564d52cc04e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:42.909 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.894+0000 7f345fa31640 1 --2- 172.21.15.142:0/2758798520 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x564d52cbe0f0 0x564d52cc04e0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:42.909 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.894+0000 7f345fa31640 1 -- 172.21.15.142:0/2758798520 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(5 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f345803b070 con 0x564d52cbe0f0 2024-09-22T08:36:42.909 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.894+0000 7f3461746800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:36:42.909 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.894+0000 7f3461746800 20 searching for the correct realm 2024-09-22T08:36:42.909 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.894+0000 7f3461746800 1 -- 172.21.15.142:0/2758798520 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564d52cc2390 con 0x564d52cbe0f0 2024-09-22T08:36:42.909 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.894+0000 7f345fa31640 1 -- 172.21.15.142:0/2758798520 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f345803b070 con 0x564d52cbe0f0 2024-09-22T08:36:42.909 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.894+0000 7f345fa31640 1 --2- 172.21.15.142:0/2758798520 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f3458021020 0x7f3458016330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:42.909 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.894+0000 7f345fa31640 1 -- 172.21.15.142:0/2758798520 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564d52cc2390 con 0x7f3458021020 2024-09-22T08:36:42.910 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.894+0000 7f345f230640 1 --2- 172.21.15.142:0/2758798520 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f3458021020 0x7f3458016330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:42.910 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.895+0000 7f345f230640 1 --2- 172.21.15.142:0/2758798520 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f3458021020 0x7f3458016330 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:42.910 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.895+0000 7f345f230640 1 -- 172.21.15.142:0/2758798520 <== osd.2 v2:172.21.15.142:6808/279438927 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f345001b070 con 0x7f3458021020 2024-09-22T08:36:42.910 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.895+0000 7f345f230640 1 --2- 172.21.15.142:0/2758798520 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f3450027020 0x7f345001e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:42.910 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.895+0000 7f345f230640 1 -- 172.21.15.142:0/2758798520 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564d52cc2390 con 0x7f3450027020 2024-09-22T08:36:42.910 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.895+0000 7f345ea2f640 1 --2- 172.21.15.142:0/2758798520 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f3450027020 0x7f345001e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:42.910 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.895+0000 7f345ea2f640 1 --2- 172.21.15.142:0/2758798520 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f3450027020 0x7f345001e3f0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:42.910 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.896+0000 7f345ea2f640 1 -- 172.21.15.142:0/2758798520 <== osd.0 v2:172.21.15.31:6800/168281188 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3454051070 con 0x7f3450027020 2024-09-22T08:36:42.910 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.896+0000 7f345ea2f640 1 -- 172.21.15.142:0/2758798520 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564d52cc2390 con 0x564d52cb96e0 2024-09-22T08:36:42.910 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.896+0000 7f345ea2f640 1 -- 172.21.15.142:0/2758798520 <== osd.1 v2:172.21.15.142:6816/3192108003 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3454051070 con 0x564d52cb96e0 2024-09-22T08:36:42.910 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.896+0000 7f345ea2f640 1 -- 172.21.15.142:0/2758798520 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564d52cc2390 con 0x564d52cb96e0 2024-09-22T08:36:42.910 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.896+0000 7f345ea2f640 1 -- 172.21.15.142:0/2758798520 <== osd.1 v2:172.21.15.142:6816/3192108003 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3454051070 con 0x564d52cb96e0 2024-09-22T08:36:42.910 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.896+0000 7f345ea2f640 1 -- 172.21.15.142:0/2758798520 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564d52cc2390 con 0x7f3450027020 2024-09-22T08:36:42.911 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.896+0000 7f345ea2f640 1 -- 172.21.15.142:0/2758798520 <== osd.0 v2:172.21.15.31:6800/168281188 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3454051070 con 0x7f3450027020 2024-09-22T08:36:42.911 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.896+0000 7f345ea2f640 1 -- 172.21.15.142:0/2758798520 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564d52cc2390 con 0x7f3450027020 2024-09-22T08:36:42.911 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.897+0000 7f345ea2f640 1 -- 172.21.15.142:0/2758798520 <== osd.0 v2:172.21.15.31:6800/168281188 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3454051070 con 0x7f3450027020 2024-09-22T08:36:42.911 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.897+0000 7f345ea2f640 1 -- 172.21.15.142:0/2758798520 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564d52cc2390 con 0x7f3458021020 2024-09-22T08:36:42.911 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.897+0000 7f345f230640 1 -- 172.21.15.142:0/2758798520 <== osd.2 v2:172.21.15.142:6808/279438927 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f345001b070 con 0x7f3458021020 2024-09-22T08:36:42.911 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.897+0000 7f345f230640 1 -- 172.21.15.142:0/2758798520 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564d52cc2390 con 0x564d52cbe0f0 2024-09-22T08:36:42.911 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.897+0000 7f345fa31640 1 -- 172.21.15.142:0/2758798520 <== osd.3 v2:172.21.15.142:6800/1064901393 3 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f345803b070 con 0x564d52cbe0f0 2024-09-22T08:36:42.911 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.897+0000 7f345fa31640 1 -- 172.21.15.142:0/2758798520 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564d52cc2390 con 0x564d52cb96e0 2024-09-22T08:36:42.911 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.897+0000 7f345ea2f640 1 -- 172.21.15.142:0/2758798520 <== osd.1 v2:172.21.15.142:6816/3192108003 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3454051070 con 0x564d52cb96e0 2024-09-22T08:36:42.911 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.897+0000 7f345ea2f640 1 -- 172.21.15.142:0/2758798520 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564d52cc2390 con 0x7f3450027020 2024-09-22T08:36:42.911 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.898+0000 7f345ea2f640 1 -- 172.21.15.142:0/2758798520 <== osd.0 v2:172.21.15.31:6800/168281188 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3454051070 con 0x7f3450027020 2024-09-22T08:36:42.911 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.898+0000 7f345ea2f640 1 -- 172.21.15.142:0/2758798520 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564d52cc2390 con 0x564d52cb96e0 2024-09-22T08:36:42.911 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.898+0000 7f345ea2f640 1 -- 172.21.15.142:0/2758798520 <== osd.1 v2:172.21.15.142:6816/3192108003 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3454051070 con 0x564d52cb96e0 2024-09-22T08:36:42.912 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.898+0000 7f345ea2f640 1 -- 172.21.15.142:0/2758798520 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564d52cc2390 con 0x7f3458021020 2024-09-22T08:36:42.912 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.898+0000 7f345f230640 1 -- 172.21.15.142:0/2758798520 <== osd.2 v2:172.21.15.142:6808/279438927 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f345001b070 con 0x7f3458021020 2024-09-22T08:36:42.912 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.898+0000 7f345f230640 1 -- 172.21.15.142:0/2758798520 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564d52cc2390 con 0x564d52cbe0f0 2024-09-22T08:36:42.912 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.898+0000 7f345fa31640 1 -- 172.21.15.142:0/2758798520 <== osd.3 v2:172.21.15.142:6800/1064901393 4 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f345803b070 con 0x564d52cbe0f0 2024-09-22T08:36:42.912 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.898+0000 7f345fa31640 1 -- 172.21.15.142:0/2758798520 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564d52cc2390 con 0x564d52cbe0f0 2024-09-22T08:36:42.912 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.899+0000 7f345fa31640 1 -- 172.21.15.142:0/2758798520 <== osd.3 v2:172.21.15.142:6800/1064901393 5 ==== osd_op_reply(20 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f345803b070 con 0x564d52cbe0f0 2024-09-22T08:36:42.912 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.899+0000 7f345fa31640 1 -- 172.21.15.142:0/2758798520 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564d52cc2390 con 0x7f3450027020 2024-09-22T08:36:42.912 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.899+0000 7f345ea2f640 1 -- 172.21.15.142:0/2758798520 <== osd.0 v2:172.21.15.31:6800/168281188 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3454051070 con 0x7f3450027020 2024-09-22T08:36:42.912 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.899+0000 7f345ea2f640 1 -- 172.21.15.142:0/2758798520 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564d52cc2390 con 0x564d52cbe0f0 2024-09-22T08:36:42.912 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.899+0000 7f345fa31640 1 -- 172.21.15.142:0/2758798520 <== osd.3 v2:172.21.15.142:6800/1064901393 6 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f345803b070 con 0x564d52cbe0f0 2024-09-22T08:36:42.912 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.899+0000 7f345fa31640 1 -- 172.21.15.142:0/2758798520 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564d52cc2390 con 0x564d52cbe0f0 2024-09-22T08:36:42.912 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.899+0000 7f345fa31640 1 -- 172.21.15.142:0/2758798520 <== osd.3 v2:172.21.15.142:6800/1064901393 7 ==== osd_op_reply(23 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f345803b070 con 0x564d52cbe0f0 2024-09-22T08:36:42.912 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.899+0000 7f345fa31640 1 -- 172.21.15.142:0/2758798520 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564d52cc2390 con 0x564d52cb96e0 2024-09-22T08:36:42.913 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.899+0000 7f345ea2f640 1 -- 172.21.15.142:0/2758798520 <== osd.1 v2:172.21.15.142:6816/3192108003 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3454051070 con 0x564d52cb96e0 2024-09-22T08:36:42.913 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.899+0000 7f345ea2f640 1 -- 172.21.15.142:0/2758798520 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564d52cc2390 con 0x564d52cb96e0 2024-09-22T08:36:42.913 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.900+0000 7f345ea2f640 1 -- 172.21.15.142:0/2758798520 <== osd.1 v2:172.21.15.142:6816/3192108003 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f3454051070 con 0x564d52cb96e0 2024-09-22T08:36:42.913 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.900+0000 7f345ea2f640 1 -- 172.21.15.142:0/2758798520 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564d52cc2390 con 0x7f3450027020 2024-09-22T08:36:42.913 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.900+0000 7f345ea2f640 1 -- 172.21.15.142:0/2758798520 <== osd.0 v2:172.21.15.31:6800/168281188 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3454051070 con 0x7f3450027020 2024-09-22T08:36:42.913 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.900+0000 7f345ea2f640 1 -- 172.21.15.142:0/2758798520 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564d52cc2390 con 0x564d52cbe0f0 2024-09-22T08:36:42.913 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.900+0000 7f345fa31640 1 -- 172.21.15.142:0/2758798520 <== osd.3 v2:172.21.15.142:6800/1064901393 8 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f345803b070 con 0x564d52cbe0f0 2024-09-22T08:36:42.913 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.900+0000 7f345fa31640 1 -- 172.21.15.142:0/2758798520 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f3458064040 con 0x7f3458021020 2024-09-22T08:36:42.913 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.900+0000 7f345f230640 1 -- 172.21.15.142:0/2758798520 <== osd.2 v2:172.21.15.142:6808/279438927 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f345001b070 con 0x7f3458021020 2024-09-22T08:36:42.913 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.900+0000 7f345f230640 1 -- 172.21.15.142:0/2758798520 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f3458064040 con 0x564d52cb96e0 2024-09-22T08:36:42.913 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.901+0000 7f345ea2f640 1 -- 172.21.15.142:0/2758798520 <== osd.1 v2:172.21.15.142:6816/3192108003 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3454051070 con 0x564d52cb96e0 2024-09-22T08:36:42.913 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.901+0000 7f345ea2f640 1 -- 172.21.15.142:0/2758798520 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f3458064040 con 0x7f3450027020 2024-09-22T08:36:42.913 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.901+0000 7f345ea2f640 1 -- 172.21.15.142:0/2758798520 <== osd.0 v2:172.21.15.31:6800/168281188 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3454051070 con 0x7f3450027020 2024-09-22T08:36:42.913 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.901+0000 7f345ea2f640 1 -- 172.21.15.142:0/2758798520 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f3458064040 con 0x564d52cbe0f0 2024-09-22T08:36:42.914 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.901+0000 7f345fa31640 1 -- 172.21.15.142:0/2758798520 <== osd.3 v2:172.21.15.142:6800/1064901393 9 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f345803b070 con 0x564d52cbe0f0 2024-09-22T08:36:42.914 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.901+0000 7f345fa31640 1 -- 172.21.15.142:0/2758798520 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f3458064040 con 0x7f3450027020 2024-09-22T08:36:42.914 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.901+0000 7f345ea2f640 1 -- 172.21.15.142:0/2758798520 <== osd.0 v2:172.21.15.31:6800/168281188 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3454051070 con 0x7f3450027020 2024-09-22T08:36:42.914 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.901+0000 7f345ea2f640 1 -- 172.21.15.142:0/2758798520 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f3458064040 con 0x7f3458021020 2024-09-22T08:36:42.914 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.902+0000 7f345f230640 1 -- 172.21.15.142:0/2758798520 <== osd.2 v2:172.21.15.142:6808/279438927 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f345001b070 con 0x7f3458021020 2024-09-22T08:36:42.914 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.902+0000 7f345f230640 1 -- 172.21.15.142:0/2758798520 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f3458064040 con 0x564d52cbe0f0 2024-09-22T08:36:42.914 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.902+0000 7f345fa31640 1 -- 172.21.15.142:0/2758798520 <== osd.3 v2:172.21.15.142:6800/1064901393 10 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f345803b070 con 0x564d52cbe0f0 2024-09-22T08:36:42.914 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.902+0000 7f345fa31640 1 -- 172.21.15.142:0/2758798520 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f3458064040 con 0x7f3450027020 2024-09-22T08:36:42.914 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.902+0000 7f345ea2f640 1 -- 172.21.15.142:0/2758798520 <== osd.0 v2:172.21.15.31:6800/168281188 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3454051070 con 0x7f3450027020 2024-09-22T08:36:42.914 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.902+0000 7f345ea2f640 1 -- 172.21.15.142:0/2758798520 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f3458064040 con 0x564d52cb96e0 2024-09-22T08:36:42.914 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.902+0000 7f345ea2f640 1 -- 172.21.15.142:0/2758798520 <== osd.1 v2:172.21.15.142:6816/3192108003 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f3454051070 con 0x564d52cb96e0 2024-09-22T08:36:42.914 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.902+0000 7f345ea2f640 1 -- 172.21.15.142:0/2758798520 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f3458064040 con 0x7f3458021020 2024-09-22T08:36:42.914 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.903+0000 7f345f230640 1 -- 172.21.15.142:0/2758798520 <== osd.2 v2:172.21.15.142:6808/279438927 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f345001b070 con 0x7f3458021020 2024-09-22T08:36:42.915 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.903+0000 7f3461746800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:36:42.915 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.903+0000 7f3461746800 20 RGWRados::pool_iterate: got zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec 2024-09-22T08:36:42.915 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.903+0000 7f3461746800 20 RGWRados::pool_iterate: got zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f 2024-09-22T08:36:42.915 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.903+0000 7f3461746800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:36:42.915 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.903+0000 7f3461746800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:36:42.915 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.903+0000 7f3461746800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:36:42.915 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.903+0000 7f3461746800 20 rados->read ofs=0 len=0 2024-09-22T08:36:42.915 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.903+0000 7f3461746800 1 -- 172.21.15.142:0/2758798520 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564d52cc1360 con 0x564d52cb96e0 2024-09-22T08:36:42.915 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.903+0000 7f345ea2f640 1 -- 172.21.15.142:0/2758798520 <== osd.1 v2:172.21.15.142:6816/3192108003 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3454051070 con 0x564d52cb96e0 2024-09-22T08:36:42.915 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.903+0000 7f3461746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:42.915 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.903+0000 7f3461746800 20 rados->read ofs=0 len=0 2024-09-22T08:36:42.915 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.903+0000 7f3461746800 1 -- 172.21.15.142:0/2758798520 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564d52cc1750 con 0x564d52cb96e0 2024-09-22T08:36:42.915 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.903+0000 7f345ea2f640 1 -- 172.21.15.142:0/2758798520 <== osd.1 v2:172.21.15.142:6816/3192108003 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3454051070 con 0x564d52cb96e0 2024-09-22T08:36:42.915 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.903+0000 7f3461746800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:36:42.916 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.903+0000 7f3461746800 20 rados->read ofs=0 len=0 2024-09-22T08:36:42.916 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.903+0000 7f3461746800 1 -- 172.21.15.142:0/2758798520 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:40 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564d52cc1b70 con 0x564d52cbe0f0 2024-09-22T08:36:42.916 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.903+0000 7f345fa31640 1 -- 172.21.15.142:0/2758798520 <== osd.3 v2:172.21.15.142:6800/1064901393 11 ==== osd_op_reply(40 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f345803b070 con 0x564d52cbe0f0 2024-09-22T08:36:42.916 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.903+0000 7f3461746800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:36:42.916 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.903+0000 7f3461746800 20 zone default found 2024-09-22T08:36:42.916 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.903+0000 7f3461746800 4 Realm: () 2024-09-22T08:36:42.916 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.903+0000 7f3461746800 4 ZoneGroup: default (d89f6f57-1007-47dd-9065-f486c7b01aec) 2024-09-22T08:36:42.916 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.903+0000 7f3461746800 4 Zone: default (e239248c-0bee-4e41-803a-24b288d3eb8f) 2024-09-22T08:36:42.916 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.903+0000 7f3461746800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:36:42.916 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.903+0000 7f3461746800 20 zonegroup default 2024-09-22T08:36:42.916 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.903+0000 7f3461746800 20 rados->read ofs=0 len=0 2024-09-22T08:36:42.916 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.903+0000 7f3461746800 1 -- 172.21.15.142:0/2758798520 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564d52cc2860 con 0x7f3450027020 2024-09-22T08:36:42.916 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.904+0000 7f345ea2f640 1 -- 172.21.15.142:0/2758798520 <== osd.0 v2:172.21.15.31:6800/168281188 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f3454051070 con 0x7f3450027020 2024-09-22T08:36:42.916 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.904+0000 7f3461746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:42.917 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.904+0000 7f3461746800 20 rados->read ofs=0 len=0 2024-09-22T08:36:42.917 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.904+0000 7f3461746800 1 -- 172.21.15.142:0/2758798520 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564d52cc4aa0 con 0x564d52cbe0f0 2024-09-22T08:36:42.917 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.904+0000 7f345fa31640 1 -- 172.21.15.142:0/2758798520 <== osd.3 v2:172.21.15.142:6800/1064901393 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f345803b070 con 0x564d52cbe0f0 2024-09-22T08:36:42.917 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.904+0000 7f3461746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:42.917 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.904+0000 7f3461746800 20 rados->read ofs=0 len=0 2024-09-22T08:36:42.917 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.904+0000 7f3461746800 1 -- 172.21.15.142:0/2758798520 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564d52cc4aa0 con 0x564d52cbe0f0 2024-09-22T08:36:42.917 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.904+0000 7f345fa31640 1 -- 172.21.15.142:0/2758798520 <== osd.3 v2:172.21.15.142:6800/1064901393 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f345803b070 con 0x564d52cbe0f0 2024-09-22T08:36:42.917 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.904+0000 7f3461746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:42.917 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.904+0000 7f3461746800 20 started sync module instance, tier type = 2024-09-22T08:36:42.917 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.904+0000 7f3461746800 20 started zone id=e239248c-0bee-4e41-803a-24b288d3eb8f (name=default) with tier type = 2024-09-22T08:36:42.917 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.904+0000 7f3461746800 1 -- 172.21.15.142:0/2758798520 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564d52cc3ee0 con 0x7f3458021020 2024-09-22T08:36:42.917 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.905+0000 7f345f230640 1 -- 172.21.15.142:0/2758798520 <== osd.2 v2:172.21.15.142:6808/279438927 7 ==== osd_op_reply(44 notify.0 [create] v30'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f345001b070 con 0x7f3458021020 2024-09-22T08:36:42.917 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.905+0000 7f3461746800 1 -- 172.21.15.142:0/2758798520 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94890101586480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564d52cc48d0 con 0x7f3458021020 2024-09-22T08:36:42.917 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.905+0000 7f3461746800 1 -- 172.21.15.142:0/2758798520 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564d52cc53f0 con 0x564d52cb96e0 2024-09-22T08:36:42.922 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.906+0000 7f345f230640 1 -- 172.21.15.142:0/2758798520 <== osd.2 v2:172.21.15.142:6808/279438927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94890101586480] v30'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f345001b070 con 0x7f3458021020 2024-09-22T08:36:42.922 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.907+0000 7f345ea2f640 1 -- 172.21.15.142:0/2758798520 <== osd.1 v2:172.21.15.142:6816/3192108003 15 ==== osd_op_reply(46 notify.1 [create] v30'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3454051070 con 0x564d52cb96e0 2024-09-22T08:36:42.922 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.907+0000 7f3461746800 1 -- 172.21.15.142:0/2758798520 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94890101591744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564d52cc57e0 con 0x564d52cb96e0 2024-09-22T08:36:42.922 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.907+0000 7f3461746800 1 -- 172.21.15.142:0/2758798520 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564d52cc6240 con 0x564d52cbe0f0 2024-09-22T08:36:42.922 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.908+0000 7f345fa31640 1 -- 172.21.15.142:0/2758798520 <== osd.3 v2:172.21.15.142:6800/1064901393 14 ==== osd_op_reply(48 notify.2 [create] v30'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f345803b070 con 0x564d52cbe0f0 2024-09-22T08:36:42.922 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.908+0000 7f3461746800 1 -- 172.21.15.142:0/2758798520 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94890101595424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564d52cc6240 con 0x564d52cbe0f0 2024-09-22T08:36:42.922 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.908+0000 7f345ea2f640 1 -- 172.21.15.142:0/2758798520 <== osd.1 v2:172.21.15.142:6816/3192108003 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94890101591744] v30'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3454051070 con 0x564d52cb96e0 2024-09-22T08:36:42.922 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.908+0000 7f3461746800 1 -- 172.21.15.142:0/2758798520 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564d52cc7220 con 0x7f3458021020 2024-09-22T08:36:42.922 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.910+0000 7f345fa31640 1 -- 172.21.15.142:0/2758798520 <== osd.3 v2:172.21.15.142:6800/1064901393 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94890101595424] v30'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f345803b070 con 0x564d52cbe0f0 2024-09-22T08:36:42.923 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.910+0000 7f345f230640 1 -- 172.21.15.142:0/2758798520 <== osd.2 v2:172.21.15.142:6808/279438927 9 ==== osd_op_reply(50 notify.3 [create] v30'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f345001b070 con 0x7f3458021020 2024-09-22T08:36:42.923 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.910+0000 7f3461746800 1 -- 172.21.15.142:0/2758798520 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94890101597744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564d52cc4320 con 0x7f3458021020 2024-09-22T08:36:42.923 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.910+0000 7f3461746800 1 -- 172.21.15.142:0/2758798520 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564d52cc7b00 con 0x564d52cb96e0 2024-09-22T08:36:42.923 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.911+0000 7f345f230640 1 -- 172.21.15.142:0/2758798520 <== osd.2 v2:172.21.15.142:6808/279438927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94890101597744] v30'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f345001b070 con 0x7f3458021020 2024-09-22T08:36:42.923 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.912+0000 7f345ea2f640 1 -- 172.21.15.142:0/2758798520 <== osd.1 v2:172.21.15.142:6816/3192108003 17 ==== osd_op_reply(52 notify.4 [create] v30'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3454051070 con 0x564d52cb96e0 2024-09-22T08:36:42.923 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.912+0000 7f3461746800 1 -- 172.21.15.142:0/2758798520 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94890101599536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564d52cc7ac0 con 0x564d52cb96e0 2024-09-22T08:36:42.923 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.912+0000 7f3461746800 1 -- 172.21.15.142:0/2758798520 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564d52cc8590 con 0x7f3450027020 2024-09-22T08:36:42.923 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.912+0000 7f345ea2f640 1 -- 172.21.15.142:0/2758798520 <== osd.0 v2:172.21.15.31:6800/168281188 11 ==== osd_op_reply(54 notify.5 [create] v30'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3454051070 con 0x7f3450027020 2024-09-22T08:36:42.923 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.913+0000 7f3461746800 1 -- 172.21.15.142:0/2758798520 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94890101604544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564d52cc8590 con 0x7f3450027020 2024-09-22T08:36:42.923 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.913+0000 7f3461746800 1 -- 172.21.15.142:0/2758798520 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564d52cc9530 con 0x7f3450027020 2024-09-22T08:36:42.923 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.913+0000 7f345ea2f640 1 -- 172.21.15.142:0/2758798520 <== osd.1 v2:172.21.15.142:6816/3192108003 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94890101599536] v30'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3454051070 con 0x564d52cb96e0 2024-09-22T08:36:42.923 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.915+0000 7f345ea2f640 1 -- 172.21.15.142:0/2758798520 <== osd.0 v2:172.21.15.31:6800/168281188 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94890101604544] v30'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3454051070 con 0x7f3450027020 2024-09-22T08:36:42.923 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.916+0000 7f345ea2f640 1 -- 172.21.15.142:0/2758798520 <== osd.0 v2:172.21.15.31:6800/168281188 13 ==== osd_op_reply(56 notify.6 [create] v30'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3454051070 con 0x7f3450027020 2024-09-22T08:36:42.924 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.916+0000 7f3461746800 1 -- 172.21.15.142:0/2758798520 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94890101608448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564d52cc9530 con 0x7f3450027020 2024-09-22T08:36:42.924 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.916+0000 7f3461746800 1 -- 172.21.15.142:0/2758798520 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564d52cc9980 con 0x7f3450027020 2024-09-22T08:36:42.924 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.917+0000 7f345ea2f640 1 -- 172.21.15.142:0/2758798520 <== osd.0 v2:172.21.15.31:6800/168281188 14 ==== osd_op_reply(58 notify.7 [create] v30'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3454051070 con 0x7f3450027020 2024-09-22T08:36:42.924 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.917+0000 7f3461746800 1 -- 172.21.15.142:0/2758798520 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94890101606752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564d52cc9df0 con 0x7f3450027020 2024-09-22T08:36:42.924 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.917+0000 7f3461746800 20 add_watcher() i=0 2024-09-22T08:36:42.924 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.917+0000 7f3461746800 20 add_watcher() i=1 2024-09-22T08:36:42.924 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.917+0000 7f3461746800 20 add_watcher() i=2 2024-09-22T08:36:42.924 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.917+0000 7f3461746800 20 add_watcher() i=3 2024-09-22T08:36:42.924 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.917+0000 7f3461746800 20 add_watcher() i=4 2024-09-22T08:36:42.924 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.917+0000 7f3461746800 20 add_watcher() i=5 2024-09-22T08:36:42.924 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.917+0000 7f345ea2f640 1 -- 172.21.15.142:0/2758798520 <== osd.0 v2:172.21.15.31:6800/168281188 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94890101608448] v30'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3454051070 con 0x7f3450027020 2024-09-22T08:36:42.924 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.917+0000 7f3461746800 20 add_watcher() i=6 2024-09-22T08:36:42.924 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.917+0000 7f345ea2f640 1 -- 172.21.15.142:0/2758798520 <== osd.0 v2:172.21.15.31:6800/168281188 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94890101606752] v30'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3454051070 con 0x7f3450027020 2024-09-22T08:36:42.924 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.917+0000 7f3461746800 20 add_watcher() i=7 2024-09-22T08:36:42.925 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.917+0000 7f3461746800 2 all 8 watchers are set, enabling cache 2024-09-22T08:36:42.925 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.917+0000 7f3461746800 1 -- 172.21.15.142:0/2758798520 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564d52cc7720 con 0x564d52cb96e0 2024-09-22T08:36:42.925 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.918+0000 7f345ea2f640 1 -- 172.21.15.142:0/2758798520 <== osd.1 v2:172.21.15.142:6816/3192108003 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f3454051070 con 0x564d52cb96e0 2024-09-22T08:36:42.925 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.918+0000 7f3461746800 1 -- 172.21.15.142:0/2758798520 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94890101610816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564d52cc7720 con 0x564d52cb96e0 2024-09-22T08:36:42.925 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.919+0000 7f345ea2f640 1 -- 172.21.15.142:0/2758798520 <== osd.1 v2:172.21.15.142:6816/3192108003 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94890101610816] v30'54 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3454051070 con 0x564d52cb96e0 2024-09-22T08:36:42.925 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.919+0000 7f3315fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:36:42.925 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.919+0000 7f3461746800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:36:42.925 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.919+0000 7f3461746800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:36:42.925 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.919+0000 7f3461746800 5 note: GC not initialized 2024-09-22T08:36:42.925 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.919+0000 7f3314fe1640 20 reqs_thread_entry: start 2024-09-22T08:36:42.925 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.919+0000 7f3461746800 20 init_complete bucket index max shards: 11 2024-09-22T08:36:42.925 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.919+0000 7f3461746800 20 Filter name: none 2024-09-22T08:36:42.925 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.919+0000 7f328e7fc640 20 reqs_thread_entry: start 2024-09-22T08:36:42.926 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.919+0000 7f3461746800 20 rados->read ofs=0 len=0 2024-09-22T08:36:42.926 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.919+0000 7f3461746800 1 -- 172.21.15.142:0/2758798520 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564d52cffdb0 con 0x564d52cb96e0 2024-09-22T08:36:42.926 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.920+0000 7f345ea2f640 1 -- 172.21.15.142:0/2758798520 <== osd.1 v2:172.21.15.142:6816/3192108003 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f3454051070 con 0x564d52cb96e0 2024-09-22T08:36:42.926 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.920+0000 7f3461746800 20 rados_obj.operate() r=0 bl.length=391 2024-09-22T08:36:42.926 INFO:teuthology.orchestra.run.smithi142.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-22T08:36:42.661297Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-22T08:36:42.661288Z","tags":[],"group_ids":[]} 2024-09-22T08:36:42.928 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.921+0000 7f3315fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:36:42.928 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.921+0000 7f3461746800 1 -- 172.21.15.142:0/2758798520 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94890101610816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564d52cfeaa0 con 0x564d52cb96e0 2024-09-22T08:36:42.928 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.922+0000 7f345ea2f640 1 -- 172.21.15.142:0/2758798520 <== osd.1 v2:172.21.15.142:6816/3192108003 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94890101610816] v30'55 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3454051070 con 0x564d52cb96e0 2024-09-22T08:36:42.928 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.922+0000 7f3461746800 1 -- 172.21.15.142:0/2758798520 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94890101586480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564d52cc9940 con 0x7f3458021020 2024-09-22T08:36:42.928 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.923+0000 7f345f230640 1 -- 172.21.15.142:0/2758798520 <== osd.2 v2:172.21.15.142:6808/279438927 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94890101586480] v30'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f345001b070 con 0x7f3458021020 2024-09-22T08:36:42.928 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.923+0000 7f3461746800 20 remove_watcher() i=0 2024-09-22T08:36:42.928 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.923+0000 7f3461746800 2 removed watcher, disabling cache 2024-09-22T08:36:42.928 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.923+0000 7f3461746800 1 -- 172.21.15.142:0/2758798520 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94890101591744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564d52cc9940 con 0x564d52cb96e0 2024-09-22T08:36:42.928 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.924+0000 7f345ea2f640 1 -- 172.21.15.142:0/2758798520 <== osd.1 v2:172.21.15.142:6816/3192108003 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94890101591744] v30'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3454051070 con 0x564d52cb96e0 2024-09-22T08:36:42.928 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.924+0000 7f3461746800 20 remove_watcher() i=1 2024-09-22T08:36:42.929 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.924+0000 7f3461746800 1 -- 172.21.15.142:0/2758798520 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94890101595424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564d52cc4ec0 con 0x564d52cbe0f0 2024-09-22T08:36:42.929 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.925+0000 7f345fa31640 1 -- 172.21.15.142:0/2758798520 <== osd.3 v2:172.21.15.142:6800/1064901393 16 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94890101595424] v30'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f345803b070 con 0x564d52cbe0f0 2024-09-22T08:36:42.929 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.925+0000 7f3461746800 20 remove_watcher() i=2 2024-09-22T08:36:42.929 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.925+0000 7f3461746800 1 -- 172.21.15.142:0/2758798520 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94890101597744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564d52cc9940 con 0x7f3458021020 2024-09-22T08:36:42.929 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.926+0000 7f345f230640 1 -- 172.21.15.142:0/2758798520 <== osd.2 v2:172.21.15.142:6808/279438927 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94890101597744] v30'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f345001b070 con 0x7f3458021020 2024-09-22T08:36:42.929 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.926+0000 7f3461746800 20 remove_watcher() i=3 2024-09-22T08:36:42.929 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.926+0000 7f3461746800 1 -- 172.21.15.142:0/2758798520 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94890101599536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564d52cc5d20 con 0x564d52cb96e0 2024-09-22T08:36:42.929 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.927+0000 7f345ea2f640 1 -- 172.21.15.142:0/2758798520 <== osd.1 v2:172.21.15.142:6816/3192108003 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94890101599536] v30'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3454051070 con 0x564d52cb96e0 2024-09-22T08:36:42.929 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.927+0000 7f3461746800 20 remove_watcher() i=4 2024-09-22T08:36:42.929 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.927+0000 7f3461746800 1 -- 172.21.15.142:0/2758798520 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94890101604544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564d52cc4ec0 con 0x7f3450027020 2024-09-22T08:36:42.930 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.928+0000 7f345ea2f640 1 -- 172.21.15.142:0/2758798520 <== osd.0 v2:172.21.15.31:6800/168281188 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94890101604544] v30'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3454051070 con 0x7f3450027020 2024-09-22T08:36:42.930 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.928+0000 7f3461746800 20 remove_watcher() i=5 2024-09-22T08:36:42.930 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.928+0000 7f3461746800 1 -- 172.21.15.142:0/2758798520 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94890101608448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564d52cc9940 con 0x7f3450027020 2024-09-22T08:36:42.931 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.929+0000 7f345ea2f640 1 -- 172.21.15.142:0/2758798520 <== osd.0 v2:172.21.15.31:6800/168281188 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94890101608448] v30'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3454051070 con 0x7f3450027020 2024-09-22T08:36:42.931 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.930+0000 7f3461746800 20 remove_watcher() i=6 2024-09-22T08:36:42.931 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.930+0000 7f3461746800 1 -- 172.21.15.142:0/2758798520 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94890101606752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564d52cc6d30 con 0x7f3450027020 2024-09-22T08:36:42.934 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.930+0000 7f345ea2f640 1 -- 172.21.15.142:0/2758798520 <== osd.0 v2:172.21.15.31:6800/168281188 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94890101606752] v30'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3454051070 con 0x7f3450027020 2024-09-22T08:36:42.934 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.930+0000 7f3461746800 20 remove_watcher() i=7 2024-09-22T08:36:42.934 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.931+0000 7f3461746800 1 -- 172.21.15.142:0/2758798520 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f3450027020 msgr2=0x7f345001e3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:42.934 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.931+0000 7f3461746800 1 --2- 172.21.15.142:0/2758798520 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f3450027020 0x7f345001e3f0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:42.934 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.931+0000 7f3461746800 1 -- 172.21.15.142:0/2758798520 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x564d52cb96e0 msgr2=0x564d52cbbba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:42.934 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.931+0000 7f3461746800 1 --2- 172.21.15.142:0/2758798520 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x564d52cb96e0 0x564d52cbbba0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:42.934 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.931+0000 7f3461746800 1 -- 172.21.15.142:0/2758798520 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f3458021020 msgr2=0x7f3458016330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:42.934 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.931+0000 7f3461746800 1 --2- 172.21.15.142:0/2758798520 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f3458021020 0x7f3458016330 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:42.934 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.931+0000 7f3461746800 1 -- 172.21.15.142:0/2758798520 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x564d52cbe0f0 msgr2=0x564d52cc04e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:42.934 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.931+0000 7f3461746800 1 --2- 172.21.15.142:0/2758798520 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x564d52cbe0f0 0x564d52cc04e0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:42.934 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.931+0000 7f3461746800 1 -- 172.21.15.142:0/2758798520 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f332803d000 msgr2=0x7f332803f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:42.935 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.931+0000 7f3461746800 1 --2- 172.21.15.142:0/2758798520 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f332803d000 0x7f332803f4c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f3450052db0 tx=0x7f3450046000 comp rx=0 tx=0).stop 2024-09-22T08:36:42.935 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.931+0000 7f3461746800 1 -- 172.21.15.142:0/2758798520 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564d52ca6830 msgr2=0x564d52cade10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:42.935 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.931+0000 7f3461746800 1 --2- 172.21.15.142:0/2758798520 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564d52ca6830 0x564d52cade10 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f3458028fd0 tx=0x7f3458053da0 comp rx=0 tx=0).stop 2024-09-22T08:36:42.935 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.931+0000 7f345ea2f640 1 -- 172.21.15.142:0/2758798520 reap_dead start 2024-09-22T08:36:42.935 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.931+0000 7f345ea2f640 1 -- 172.21.15.142:0/2758798520 reap_dead start 2024-09-22T08:36:42.935 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.931+0000 7f3461746800 1 -- 172.21.15.142:0/2758798520 shutdown_connections 2024-09-22T08:36:42.935 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.931+0000 7f3461746800 1 -- 172.21.15.142:0/2758798520 >> 172.21.15.142:0/2758798520 conn(0x564d52ca2c30 msgr2=0x564d52ca0e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:42.935 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.931+0000 7f3461746800 1 -- 172.21.15.142:0/2758798520 shutdown_connections 2024-09-22T08:36:42.935 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.931+0000 7f3461746800 1 -- 172.21.15.142:0/2758798520 wait complete. 2024-09-22T08:36:42.935 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.931+0000 7f3461746800 1 -- 172.21.15.142:0/2276105099 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f333803cfb0 msgr2=0x7f333803f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:42.935 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.931+0000 7f3461746800 1 --2- 172.21.15.142:0/2276105099 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f333803cfb0 0x7f333803f470 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f3450052b50 tx=0x7f3450011f40 comp rx=0 tx=0).stop 2024-09-22T08:36:42.935 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.931+0000 7f3461746800 1 -- 172.21.15.142:0/2276105099 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564d52c99dd0 msgr2=0x564d52c9a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:42.935 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.931+0000 7f3461746800 1 --2- 172.21.15.142:0/2276105099 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564d52c99dd0 0x564d52c9a1f0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x564d52c80cc0 tx=0x7f345800bf30 comp rx=0 tx=0).stop 2024-09-22T08:36:42.936 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.931+0000 7f3461746800 1 -- 172.21.15.142:0/2276105099 shutdown_connections 2024-09-22T08:36:42.936 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.931+0000 7f3461746800 1 --2- 172.21.15.142:0/2276105099 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f333803cfb0 0x7f333803f470 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:42.936 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.931+0000 7f3461746800 1 --2- 172.21.15.142:0/2276105099 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564d52c99dd0 0x564d52c9a1f0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:42.936 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.931+0000 7f3461746800 1 -- 172.21.15.142:0/2276105099 >> 172.21.15.142:0/2276105099 conn(0x564d52c8e180 msgr2=0x564d52c8e560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:42.936 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.931+0000 7f3461746800 1 -- 172.21.15.142:0/2276105099 shutdown_connections 2024-09-22T08:36:42.936 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.931+0000 7f3461746800 1 -- 172.21.15.142:0/2276105099 wait complete. 2024-09-22T08:36:42.936 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.932+0000 7f3461746800 1 -- 172.21.15.142:0/3028068951 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x564d52b899c0 msgr2=0x564d52c86380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:42.936 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.932+0000 7f3461746800 1 --2- 172.21.15.142:0/3028068951 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x564d52b899c0 0x564d52c86380 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:42.936 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.932+0000 7f3461746800 1 -- 172.21.15.142:0/3028068951 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x564d52c887a0 msgr2=0x564d52c8ac40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:42.936 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.932+0000 7f3461746800 1 --2- 172.21.15.142:0/3028068951 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x564d52c887a0 0x564d52c8ac40 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:42.936 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.932+0000 7f3461746800 1 -- 172.21.15.142:0/3028068951 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f334403cfb0 msgr2=0x7f334403f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:42.936 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.932+0000 7f3461746800 1 --2- 172.21.15.142:0/3028068951 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f334403cfb0 0x7f334403f470 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f3454057000 tx=0x7f3454052000 comp rx=0 tx=0).stop 2024-09-22T08:36:42.936 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.932+0000 7f3461746800 1 -- 172.21.15.142:0/3028068951 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564d52af9550 msgr2=0x564d52c7ed30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:42.936 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.932+0000 7f3461746800 1 --2- 172.21.15.142:0/3028068951 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564d52af9550 0x564d52c7ed30 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f3450000f80 tx=0x7f3450001250 comp rx=0 tx=0).stop 2024-09-22T08:36:42.937 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.932+0000 7f3461746800 1 -- 172.21.15.142:0/3028068951 shutdown_connections 2024-09-22T08:36:42.937 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.932+0000 7f3461746800 1 --2- 172.21.15.142:0/3028068951 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x564d52c887a0 0x564d52c8ac40 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:42.937 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.932+0000 7f3461746800 1 --2- 172.21.15.142:0/3028068951 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x564d52b899c0 0x564d52c86380 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:42.937 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.932+0000 7f3461746800 1 --2- 172.21.15.142:0/3028068951 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f334403cfb0 0x7f334403f470 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:42.937 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.932+0000 7f3461746800 1 --2- 172.21.15.142:0/3028068951 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564d52af9550 0x564d52c7ed30 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:42.937 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.932+0000 7f3461746800 1 -- 172.21.15.142:0/3028068951 >> 172.21.15.142:0/3028068951 conn(0x564d52b7fba0 msgr2=0x564d52c70510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:42.937 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.932+0000 7f3461746800 1 -- 172.21.15.142:0/3028068951 shutdown_connections 2024-09-22T08:36:42.937 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.932+0000 7f3461746800 1 -- 172.21.15.142:0/3028068951 wait complete. 2024-09-22T08:36:42.942 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-22T08:36:42.661297Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-22T08:36:42.661288Z', 'tags': [], 'group_ids': []} 2024-09-22T08:36:42.942 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'suspend', '--uid', 'foo'] 2024-09-22T08:36:42.942 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'suspend', '--uid', 'foo'] 2024-09-22T08:36:42.942 DEBUG:teuthology.orchestra.run.smithi142:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user suspend --uid foo 2024-09-22T08:36:42.987 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:36:42.987 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:36:42.987 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.986+0000 7f96c2d22800 1 Processor -- start 2024-09-22T08:36:42.987 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.986+0000 7f96c2d22800 1 -- start start 2024-09-22T08:36:42.988 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.986+0000 7f96c2d22800 1 --2- >> v2:172.21.15.31:3300/0 conn(0x5625e492b080 0x5625e492d470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:42.988 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.986+0000 7f96c2d22800 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5625e47b5a20 con 0x5625e492d9b0 2024-09-22T08:36:42.988 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.986+0000 7f96c2d22800 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x5625e47b57d0 con 0x5625e492b080 2024-09-22T08:36:42.988 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.987+0000 7f96be902640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x5625e492b080 0x5625e492d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:42.989 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.987+0000 7f96be101640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x5625e492d9b0 0x5625e492fda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.142:42312/0 (socket says 172.21.15.142:42312) 2024-09-22T08:36:42.989 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.987+0000 7f96be902640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x5625e492b080 0x5625e492d470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:38030/0 (socket says 172.21.15.142:38030) 2024-09-22T08:36:42.989 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.987+0000 7f96be101640 1 -- 172.21.15.142:0/433146538 learned_addr learned my addr 172.21.15.142:0/433146538 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-09-22T08:36:42.989 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.987+0000 7f96be902640 1 -- 172.21.15.142:0/433146538 >> v1:172.21.15.31:6789/0 conn(0x5625e492d9b0 legacy=0x5625e492fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:42.989 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.987+0000 7f96be902640 1 -- 172.21.15.142:0/433146538 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5625e4932560 con 0x5625e492b080 2024-09-22T08:36:42.990 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.989+0000 7f96be902640 1 --2- 172.21.15.142:0/433146538 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5625e492b080 0x5625e492d470 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f96b800a470 tx=0x7f96b8045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdd6b6d6bfa4b5a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:42.990 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.989+0000 7f96bd900640 1 -- 172.21.15.142:0/433146538 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f96b8053570 con 0x5625e492b080 2024-09-22T08:36:42.990 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.989+0000 7f96bd900640 1 -- 172.21.15.142:0/433146538 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96b8058070 con 0x5625e492b080 2024-09-22T08:36:42.990 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.989+0000 7f96bd900640 1 -- 172.21.15.142:0/433146538 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f96b8053880 con 0x5625e492b080 2024-09-22T08:36:42.991 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.989+0000 7f96c2d22800 1 -- 172.21.15.142:0/433146538 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5625e492b080 msgr2=0x5625e492d470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:42.991 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.989+0000 7f96c2d22800 1 --2- 172.21.15.142:0/433146538 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5625e492b080 0x5625e492d470 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f96b800a470 tx=0x7f96b8045a20 comp rx=0 tx=0).stop 2024-09-22T08:36:42.991 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.990+0000 7f96c2d22800 1 -- 172.21.15.142:0/433146538 shutdown_connections 2024-09-22T08:36:42.991 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.990+0000 7f96c2d22800 1 --2- 172.21.15.142:0/433146538 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5625e492b080 0x5625e492d470 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:42.991 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.990+0000 7f96c2d22800 1 -- 172.21.15.142:0/433146538 >> 172.21.15.142:0/433146538 conn(0x5625e4924be0 msgr2=0x5625e4927020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:42.991 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.990+0000 7f96c2d22800 1 -- 172.21.15.142:0/433146538 shutdown_connections 2024-09-22T08:36:42.992 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:42.990+0000 7f96c2d22800 1 -- 172.21.15.142:0/433146538 wait complete. 2024-09-22T08:36:43.005 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.003+0000 7f96c2d22800 1 Processor -- start 2024-09-22T08:36:43.005 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.003+0000 7f96c2d22800 1 -- start start 2024-09-22T08:36:43.005 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.003+0000 7f96c2d22800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5625e492b080 0x5625e4a19fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:43.005 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.003+0000 7f96c2d22800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5625e47c2dd0 con 0x5625e492b080 2024-09-22T08:36:43.005 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.004+0000 7f96be902640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5625e492b080 0x5625e4a19fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:43.005 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.004+0000 7f96be902640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5625e492b080 0x5625e4a19fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:38036/0 (socket says 172.21.15.142:38036) 2024-09-22T08:36:43.005 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.004+0000 7f96be902640 1 -- 172.21.15.142:0/4014766359 learned_addr learned my addr 172.21.15.142:0/4014766359 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:43.007 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.004+0000 7f96be902640 1 -- 172.21.15.142:0/4014766359 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5625e4a1a5d0 con 0x5625e492b080 2024-09-22T08:36:43.007 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.004+0000 7f96be902640 1 --2- 172.21.15.142:0/4014766359 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5625e492b080 0x5625e4a19fe0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f96b8025c20 tx=0x7f96b8051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a082814f2e01a7d server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:43.007 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.004+0000 7f95ace09640 1 -- 172.21.15.142:0/4014766359 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f96b8053a20 con 0x5625e492b080 2024-09-22T08:36:43.007 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.004+0000 7f95ace09640 1 -- 172.21.15.142:0/4014766359 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96b8063070 con 0x5625e492b080 2024-09-22T08:36:43.007 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.004+0000 7f95ace09640 1 -- 172.21.15.142:0/4014766359 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f96b8053cf0 con 0x5625e492b080 2024-09-22T08:36:43.007 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.005+0000 7f96c2d22800 1 -- 172.21.15.142:0/4014766359 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5625e492b080 msgr2=0x5625e4a19fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:43.007 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.005+0000 7f96c2d22800 1 --2- 172.21.15.142:0/4014766359 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5625e492b080 0x5625e4a19fe0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f96b8025c20 tx=0x7f96b8051000 comp rx=0 tx=0).stop 2024-09-22T08:36:43.008 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.005+0000 7f96c2d22800 1 -- 172.21.15.142:0/4014766359 shutdown_connections 2024-09-22T08:36:43.008 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.005+0000 7f96c2d22800 1 --2- 172.21.15.142:0/4014766359 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5625e492b080 0x5625e4a19fe0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:43.008 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.005+0000 7f96c2d22800 1 -- 172.21.15.142:0/4014766359 >> 172.21.15.142:0/4014766359 conn(0x5625e4924be0 msgr2=0x5625e4a15960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:43.008 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.005+0000 7f96c2d22800 1 -- 172.21.15.142:0/4014766359 shutdown_connections 2024-09-22T08:36:43.008 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.005+0000 7f96c2d22800 1 -- 172.21.15.142:0/4014766359 wait complete. 2024-09-22T08:36:43.008 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.006+0000 7f96c2d22800 1 Processor -- start 2024-09-22T08:36:43.008 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.006+0000 7f96c2d22800 1 -- start start 2024-09-22T08:36:43.008 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.006+0000 7f96c2d22800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5625e492b080 0x5625e492a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:43.008 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.006+0000 7f96c2d22800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5625e4931850 con 0x5625e492b080 2024-09-22T08:36:43.008 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.006+0000 7f96be902640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5625e492b080 0x5625e492a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:43.008 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.006+0000 7f96be902640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5625e492b080 0x5625e492a7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:38048/0 (socket says 172.21.15.142:38048) 2024-09-22T08:36:43.008 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.006+0000 7f96be902640 1 -- 172.21.15.142:0/3884098395 learned_addr learned my addr 172.21.15.142:0/3884098395 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:43.008 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.006+0000 7f96be902640 1 -- 172.21.15.142:0/3884098395 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5625e492ad00 con 0x5625e492b080 2024-09-22T08:36:43.011 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.006+0000 7f96be902640 1 --2- 172.21.15.142:0/3884098395 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5625e492b080 0x5625e492a7a0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f96b8025c20 tx=0x7f96b8002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:43.011 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.007+0000 7f95ab606640 1 -- 172.21.15.142:0/3884098395 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f96b806c030 con 0x5625e492b080 2024-09-22T08:36:43.011 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.007+0000 7f95ab606640 1 -- 172.21.15.142:0/3884098395 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96b8068660 con 0x5625e492b080 2024-09-22T08:36:43.011 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.007+0000 7f96c2d22800 1 -- 172.21.15.142:0/3884098395 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5625e49290b0 con 0x5625e492b080 2024-09-22T08:36:43.011 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.007+0000 7f95ab606640 1 -- 172.21.15.142:0/3884098395 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f96b8068940 con 0x5625e492b080 2024-09-22T08:36:43.012 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.007+0000 7f96c2d22800 1 -- 172.21.15.142:0/3884098395 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5625e4929670 con 0x5625e492b080 2024-09-22T08:36:43.012 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.007+0000 7f95ab606640 1 -- 172.21.15.142:0/3884098395 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f96b8068ae0 con 0x5625e492b080 2024-09-22T08:36:43.012 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.008+0000 7f95ab606640 1 --2- 172.21.15.142:0/3884098395 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f95a403cfb0 0x7f95a403f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:43.012 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.008+0000 7f95ab606640 1 -- 172.21.15.142:0/3884098395 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f96b8098980 con 0x5625e492b080 2024-09-22T08:36:43.012 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.008+0000 7f96be101640 1 --2- 172.21.15.142:0/3884098395 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f95a403cfb0 0x7f95a403f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:43.012 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.008+0000 7f96c2d22800 1 --2- 172.21.15.142:0/3884098395 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5625e492d9b0 0x5625e4a2aed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:43.012 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.008+0000 7f96c2d22800 1 -- 172.21.15.142:0/3884098395 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5625e4a2b410 con 0x5625e492d9b0 2024-09-22T08:36:43.012 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.008+0000 7f96bf103640 1 --2- 172.21.15.142:0/3884098395 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5625e492d9b0 0x5625e4a2aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:43.012 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.008+0000 7f96be101640 1 --2- 172.21.15.142:0/3884098395 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f95a403cfb0 0x7f95a403f470 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f96a8001d70 tx=0x7f96a80012d0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:43.012 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.008+0000 7f96bf103640 1 --2- 172.21.15.142:0/3884098395 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5625e492d9b0 0x5625e4a2aed0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:43.012 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.009+0000 7f96bf103640 1 -- 172.21.15.142:0/3884098395 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f96b000a4d0 con 0x5625e492d9b0 2024-09-22T08:36:43.012 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.009+0000 7f96c2d22800 1 -- 172.21.15.142:0/3884098395 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5625e4a2bcd0 con 0x5625e492d9b0 2024-09-22T08:36:43.012 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.009+0000 7f96bf103640 1 -- 172.21.15.142:0/3884098395 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f96b000a4d0 con 0x5625e492d9b0 2024-09-22T08:36:43.013 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.009+0000 7f96c2d22800 1 --2- 172.21.15.142:0/3884098395 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5625e4a2d5e0 0x5625e4a2fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:43.013 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.009+0000 7f96c2d22800 1 -- 172.21.15.142:0/3884098395 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:3 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5625e4a30210 con 0x5625e4a2d5e0 2024-09-22T08:36:43.013 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.009+0000 7f96be902640 1 --2- 172.21.15.142:0/3884098395 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5625e4a2d5e0 0x5625e4a2fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:43.013 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.009+0000 7f96be902640 1 --2- 172.21.15.142:0/3884098395 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5625e4a2d5e0 0x5625e4a2fa80 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:43.013 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.010+0000 7f96be902640 1 -- 172.21.15.142:0/3884098395 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(3 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f96b8051070 con 0x5625e4a2d5e0 2024-09-22T08:36:43.013 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.010+0000 7f96c2d22800 1 -- 172.21.15.142:0/3884098395 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5625e4a2c520 con 0x5625e492d9b0 2024-09-22T08:36:43.013 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.010+0000 7f96bf103640 1 -- 172.21.15.142:0/3884098395 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f96b000a4d0 con 0x5625e492d9b0 2024-09-22T08:36:43.013 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.010+0000 7f96c2d22800 1 -- 172.21.15.142:0/3884098395 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5625e4a2c900 con 0x5625e4a2d5e0 2024-09-22T08:36:43.013 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.010+0000 7f96be902640 1 -- 172.21.15.142:0/3884098395 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(5 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f96b8051070 con 0x5625e4a2d5e0 2024-09-22T08:36:43.017 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.010+0000 7f96c2d22800 1 Processor -- start 2024-09-22T08:36:43.017 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.011+0000 7f96c2d22800 1 -- start start 2024-09-22T08:36:43.017 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.011+0000 7f96c2d22800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5625e4a3eba0 0x5625e4a3efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:43.017 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.011+0000 7f96c2d22800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5625e4821d50 con 0x5625e4a3eba0 2024-09-22T08:36:43.017 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.011+0000 7f96bf103640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5625e4a3eba0 0x5625e4a3efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:43.018 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.011+0000 7f96bf103640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5625e4a3eba0 0x5625e4a3efc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:38050/0 (socket says 172.21.15.142:38050) 2024-09-22T08:36:43.018 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.011+0000 7f96bf103640 1 -- 172.21.15.142:0/1888771764 learned_addr learned my addr 172.21.15.142:0/1888771764 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:43.018 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.011+0000 7f96bf103640 1 -- 172.21.15.142:0/1888771764 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5625e4a3f600 con 0x5625e4a3eba0 2024-09-22T08:36:43.018 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.011+0000 7f96bf103640 1 --2- 172.21.15.142:0/1888771764 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5625e4a3eba0 0x5625e4a3efc0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x5625e492a340 tx=0x7f96b00167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:43.018 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.012+0000 7f95a8e01640 1 -- 172.21.15.142:0/1888771764 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f96b0013640 con 0x5625e4a3eba0 2024-09-22T08:36:43.018 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.012+0000 7f95a8e01640 1 -- 172.21.15.142:0/1888771764 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96b00137e0 con 0x5625e4a3eba0 2024-09-22T08:36:43.018 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.012+0000 7f96c2d22800 1 -- 172.21.15.142:0/1888771764 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5625e4a3fe30 con 0x5625e4a3eba0 2024-09-22T08:36:43.018 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.012+0000 7f95a8e01640 1 -- 172.21.15.142:0/1888771764 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f96b0013ae0 con 0x5625e4a3eba0 2024-09-22T08:36:43.018 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.012+0000 7f96c2d22800 1 -- 172.21.15.142:0/1888771764 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5625e4a403d0 con 0x5625e4a3eba0 2024-09-22T08:36:43.018 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.012+0000 7f95a8e01640 1 -- 172.21.15.142:0/1888771764 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f96b0011040 con 0x5625e4a3eba0 2024-09-22T08:36:43.018 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.013+0000 7f95a8e01640 1 --2- 172.21.15.142:0/1888771764 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f959803cfb0 0x7f959803f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:43.018 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.013+0000 7f95a8e01640 1 -- 172.21.15.142:0/1888771764 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f96b000e040 con 0x5625e4a3eba0 2024-09-22T08:36:43.018 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.013+0000 7f96be902640 1 --2- 172.21.15.142:0/1888771764 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f959803cfb0 0x7f959803f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:43.019 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.013+0000 7f96c2d22800 1 Processor -- start 2024-09-22T08:36:43.019 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.013+0000 7f96be902640 1 --2- 172.21.15.142:0/1888771764 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f959803cfb0 0x7f959803f470 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f96b807bb60 tx=0x7f96b807b9a0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:43.019 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.013+0000 7f96c2d22800 1 -- start start 2024-09-22T08:36:43.019 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.013+0000 7f96c2d22800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5625e4a4b640 0x5625e4a4ba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:43.019 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.013+0000 7f96c2d22800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5625e4a1a9a0 con 0x5625e4a4b640 2024-09-22T08:36:43.019 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.013+0000 7f96bf103640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5625e4a4b640 0x5625e4a4ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:43.019 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.013+0000 7f96bf103640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5625e4a4b640 0x5625e4a4ba40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:38064/0 (socket says 172.21.15.142:38064) 2024-09-22T08:36:43.019 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.013+0000 7f96bf103640 1 -- 172.21.15.142:0/3820138523 learned_addr learned my addr 172.21.15.142:0/3820138523 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:43.019 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.014+0000 7f96bf103640 1 -- 172.21.15.142:0/3820138523 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5625e4a4c030 con 0x5625e4a4b640 2024-09-22T08:36:43.019 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.014+0000 7f96bf103640 1 --2- 172.21.15.142:0/3820138523 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5625e4a4b640 0x5625e4a4ba40 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f96b0054870 tx=0x7f96b0020460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b64c2552291ec988 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:43.019 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.014+0000 7f95a27fc640 1 -- 172.21.15.142:0/3820138523 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f96b00143c0 con 0x5625e4a4b640 2024-09-22T08:36:43.019 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.014+0000 7f95a27fc640 1 -- 172.21.15.142:0/3820138523 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96b0052070 con 0x5625e4a4b640 2024-09-22T08:36:43.019 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.014+0000 7f95a27fc640 1 -- 172.21.15.142:0/3820138523 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f96b0021910 con 0x5625e4a4b640 2024-09-22T08:36:43.019 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.015+0000 7f96c2d22800 1 -- 172.21.15.142:0/3820138523 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5625e4a4b640 msgr2=0x5625e4a4ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:43.020 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.015+0000 7f96c2d22800 1 --2- 172.21.15.142:0/3820138523 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5625e4a4b640 0x5625e4a4ba40 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f96b0054870 tx=0x7f96b0020460 comp rx=0 tx=0).stop 2024-09-22T08:36:43.020 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.015+0000 7f96c2d22800 1 -- 172.21.15.142:0/3820138523 shutdown_connections 2024-09-22T08:36:43.020 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.015+0000 7f96c2d22800 1 --2- 172.21.15.142:0/3820138523 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5625e4a4b640 0x5625e4a4ba40 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:43.020 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.015+0000 7f96c2d22800 1 -- 172.21.15.142:0/3820138523 >> 172.21.15.142:0/3820138523 conn(0x5625e4a47a60 msgr2=0x5625e4a45ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:43.020 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.015+0000 7f96c2d22800 1 -- 172.21.15.142:0/3820138523 shutdown_connections 2024-09-22T08:36:43.020 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.015+0000 7f96c2d22800 1 -- 172.21.15.142:0/3820138523 wait complete. 2024-09-22T08:36:43.020 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.015+0000 7f96c2d22800 1 Processor -- start 2024-09-22T08:36:43.020 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.015+0000 7f96c2d22800 1 -- start start 2024-09-22T08:36:43.020 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.015+0000 7f96c2d22800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5625e4a4b640 0x5625e4a52c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:43.020 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.015+0000 7f96c2d22800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5625e4a4c650 con 0x5625e4a4b640 2024-09-22T08:36:43.020 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.015+0000 7f96bf103640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5625e4a4b640 0x5625e4a52c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:43.020 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.015+0000 7f96bf103640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5625e4a4b640 0x5625e4a52c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:38080/0 (socket says 172.21.15.142:38080) 2024-09-22T08:36:43.020 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.015+0000 7f96bf103640 1 -- 172.21.15.142:0/2506099497 learned_addr learned my addr 172.21.15.142:0/2506099497 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:43.020 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.016+0000 7f96bf103640 1 -- 172.21.15.142:0/2506099497 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5625e4a53180 con 0x5625e4a4b640 2024-09-22T08:36:43.021 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.016+0000 7f96bf103640 1 --2- 172.21.15.142:0/2506099497 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5625e4a4b640 0x5625e4a52c20 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f96b0020790 tx=0x7f96b00547d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:43.021 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.016+0000 7f95a0ff9640 1 -- 172.21.15.142:0/2506099497 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f96b0021910 con 0x5625e4a4b640 2024-09-22T08:36:43.021 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.016+0000 7f95a0ff9640 1 -- 172.21.15.142:0/2506099497 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96b0053270 con 0x5625e4a4b640 2024-09-22T08:36:43.021 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.016+0000 7f95a0ff9640 1 -- 172.21.15.142:0/2506099497 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f96b0021ab0 con 0x5625e4a4b640 2024-09-22T08:36:43.021 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.016+0000 7f96c2d22800 1 -- 172.21.15.142:0/2506099497 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5625e4a53410 con 0x5625e4a4b640 2024-09-22T08:36:43.021 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.016+0000 7f96c2d22800 1 -- 172.21.15.142:0/2506099497 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5625e4a53d90 con 0x5625e4a4b640 2024-09-22T08:36:43.032 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.017+0000 7f95a0ff9640 1 -- 172.21.15.142:0/2506099497 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f96b0045a10 con 0x5625e4a4b640 2024-09-22T08:36:43.032 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.017+0000 7f95a0ff9640 1 --2- 172.21.15.142:0/2506099497 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f958803d000 0x7f958803f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:43.032 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.017+0000 7f95a0ff9640 1 -- 172.21.15.142:0/2506099497 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f96b004c070 con 0x5625e4a4b640 2024-09-22T08:36:43.032 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.017+0000 7f96be902640 1 --2- 172.21.15.142:0/2506099497 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f958803d000 0x7f958803f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:43.032 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.017+0000 7f96be902640 1 --2- 172.21.15.142:0/2506099497 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f958803d000 0x7f958803f4c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f96b80075e0 tx=0x7f96b8081000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:43.032 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.018+0000 7f96c2d22800 20 rados->read ofs=0 len=0 2024-09-22T08:36:43.032 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.018+0000 7f96c2d22800 1 --2- 172.21.15.142:0/2506099497 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5625e4a5e560 0x5625e4a60a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:43.032 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.018+0000 7f96c2d22800 1 -- 172.21.15.142:0/2506099497 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5625e4a61170 con 0x5625e4a5e560 2024-09-22T08:36:43.032 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.018+0000 7f96be101640 1 --2- 172.21.15.142:0/2506099497 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5625e4a5e560 0x5625e4a60a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:43.033 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.018+0000 7f96be101640 1 --2- 172.21.15.142:0/2506099497 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5625e4a5e560 0x5625e4a60a20 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:43.033 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.018+0000 7f96be101640 1 -- 172.21.15.142:0/2506099497 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f96a8009050 con 0x5625e4a5e560 2024-09-22T08:36:43.033 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.018+0000 7f96c2d22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:43.033 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.018+0000 7f96c2d22800 20 realm 2024-09-22T08:36:43.033 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.018+0000 7f96c2d22800 20 rados->read ofs=0 len=0 2024-09-22T08:36:43.033 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.018+0000 7f96c2d22800 1 -- 172.21.15.142:0/2506099497 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5625e4a5d8b0 con 0x5625e4a5e560 2024-09-22T08:36:43.033 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.018+0000 7f96be101640 1 -- 172.21.15.142:0/2506099497 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f96a8009050 con 0x5625e4a5e560 2024-09-22T08:36:43.033 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.018+0000 7f96c2d22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:43.033 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.018+0000 7f96c2d22800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:36:43.033 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.018+0000 7f96c2d22800 20 rados->read ofs=0 len=0 2024-09-22T08:36:43.033 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.018+0000 7f96c2d22800 1 -- 172.21.15.142:0/2506099497 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5625e4a61c60 con 0x5625e4a5e560 2024-09-22T08:36:43.033 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.019+0000 7f96be101640 1 -- 172.21.15.142:0/2506099497 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f96a8009050 con 0x5625e4a5e560 2024-09-22T08:36:43.033 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.019+0000 7f96c2d22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:43.033 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.019+0000 7f96c2d22800 20 rados->read ofs=0 len=0 2024-09-22T08:36:43.033 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.019+0000 7f96c2d22800 1 -- 172.21.15.142:0/2506099497 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5625e4a62530 con 0x5625e4a5e560 2024-09-22T08:36:43.034 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.019+0000 7f96be101640 1 -- 172.21.15.142:0/2506099497 <== osd.1 v2:172.21.15.142:6816/3192108003 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f96a8009050 con 0x5625e4a5e560 2024-09-22T08:36:43.034 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.019+0000 7f96c2d22800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:36:43.034 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.019+0000 7f96c2d22800 20 rados->read ofs=0 len=0 2024-09-22T08:36:43.034 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.019+0000 7f96c2d22800 1 --2- 172.21.15.142:0/2506099497 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5625e4a62f50 0x5625e4a65340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:43.034 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.019+0000 7f96c2d22800 1 -- 172.21.15.142:0/2506099497 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5625e4a65a80 con 0x5625e4a62f50 2024-09-22T08:36:43.034 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.019+0000 7f96bf103640 1 --2- 172.21.15.142:0/2506099497 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5625e4a62f50 0x5625e4a65340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:43.034 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.019+0000 7f96bf103640 1 --2- 172.21.15.142:0/2506099497 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5625e4a62f50 0x5625e4a65340 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:43.034 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.020+0000 7f96bf103640 1 -- 172.21.15.142:0/2506099497 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(5 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f96b003a070 con 0x5625e4a62f50 2024-09-22T08:36:43.034 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.020+0000 7f96c2d22800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:36:43.034 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.020+0000 7f96c2d22800 20 searching for the correct realm 2024-09-22T08:36:43.034 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.020+0000 7f96c2d22800 1 -- 172.21.15.142:0/2506099497 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5625e4a673b0 con 0x5625e4a62f50 2024-09-22T08:36:43.034 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.020+0000 7f96bf103640 1 -- 172.21.15.142:0/2506099497 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f96b003a070 con 0x5625e4a62f50 2024-09-22T08:36:43.035 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.020+0000 7f96bf103640 1 --2- 172.21.15.142:0/2506099497 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f96b003b6d0 0x7f96b00435c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:43.035 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.020+0000 7f96bf103640 1 -- 172.21.15.142:0/2506099497 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5625e4a673b0 con 0x7f96b003b6d0 2024-09-22T08:36:43.035 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.020+0000 7f96be902640 1 --2- 172.21.15.142:0/2506099497 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f96b003b6d0 0x7f96b00435c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:43.035 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.020+0000 7f96be902640 1 --2- 172.21.15.142:0/2506099497 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f96b003b6d0 0x7f96b00435c0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:43.035 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.020+0000 7f96be902640 1 -- 172.21.15.142:0/2506099497 <== osd.2 v2:172.21.15.142:6808/279438927 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f96b8051070 con 0x7f96b003b6d0 2024-09-22T08:36:43.035 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.021+0000 7f96be902640 1 --2- 172.21.15.142:0/2506099497 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f96b805f040 0x7f96b80982e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:43.035 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.021+0000 7f96be902640 1 -- 172.21.15.142:0/2506099497 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5625e4a673b0 con 0x7f96b805f040 2024-09-22T08:36:43.035 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.021+0000 7f96be101640 1 --2- 172.21.15.142:0/2506099497 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f96b805f040 0x7f96b80982e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:43.035 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.021+0000 7f96be101640 1 --2- 172.21.15.142:0/2506099497 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f96b805f040 0x7f96b80982e0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:43.035 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.021+0000 7f96be101640 1 -- 172.21.15.142:0/2506099497 <== osd.0 v2:172.21.15.31:6800/168281188 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f96a8009050 con 0x7f96b805f040 2024-09-22T08:36:43.035 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.021+0000 7f96be101640 1 -- 172.21.15.142:0/2506099497 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5625e4a673b0 con 0x5625e4a5e560 2024-09-22T08:36:43.035 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.022+0000 7f96be101640 1 -- 172.21.15.142:0/2506099497 <== osd.1 v2:172.21.15.142:6816/3192108003 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f96a8009050 con 0x5625e4a5e560 2024-09-22T08:36:43.035 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.022+0000 7f96be101640 1 -- 172.21.15.142:0/2506099497 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5625e4a673b0 con 0x5625e4a5e560 2024-09-22T08:36:43.036 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.022+0000 7f96be101640 1 -- 172.21.15.142:0/2506099497 <== osd.1 v2:172.21.15.142:6816/3192108003 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f96a8029040 con 0x5625e4a5e560 2024-09-22T08:36:43.036 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.022+0000 7f96be101640 1 -- 172.21.15.142:0/2506099497 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5625e4a673b0 con 0x7f96b805f040 2024-09-22T08:36:43.036 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.022+0000 7f96be101640 1 -- 172.21.15.142:0/2506099497 <== osd.0 v2:172.21.15.31:6800/168281188 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f96a8029040 con 0x7f96b805f040 2024-09-22T08:36:43.036 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.022+0000 7f96be101640 1 -- 172.21.15.142:0/2506099497 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5625e4a673b0 con 0x7f96b805f040 2024-09-22T08:36:43.036 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.022+0000 7f96be101640 1 -- 172.21.15.142:0/2506099497 <== osd.0 v2:172.21.15.31:6800/168281188 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f96a8029040 con 0x7f96b805f040 2024-09-22T08:36:43.036 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.022+0000 7f96be101640 1 -- 172.21.15.142:0/2506099497 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5625e4a673b0 con 0x7f96b003b6d0 2024-09-22T08:36:43.036 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.022+0000 7f96be902640 1 -- 172.21.15.142:0/2506099497 <== osd.2 v2:172.21.15.142:6808/279438927 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f96b8051070 con 0x7f96b003b6d0 2024-09-22T08:36:43.036 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.022+0000 7f96be902640 1 -- 172.21.15.142:0/2506099497 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5625e4a673b0 con 0x5625e4a62f50 2024-09-22T08:36:43.036 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.023+0000 7f96bf103640 1 -- 172.21.15.142:0/2506099497 <== osd.3 v2:172.21.15.142:6800/1064901393 3 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f96b003a070 con 0x5625e4a62f50 2024-09-22T08:36:43.036 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.023+0000 7f96bf103640 1 -- 172.21.15.142:0/2506099497 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5625e4a673b0 con 0x5625e4a5e560 2024-09-22T08:36:43.036 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.023+0000 7f96be101640 1 -- 172.21.15.142:0/2506099497 <== osd.1 v2:172.21.15.142:6816/3192108003 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f96a8029040 con 0x5625e4a5e560 2024-09-22T08:36:43.036 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.023+0000 7f96be101640 1 -- 172.21.15.142:0/2506099497 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5625e4a673b0 con 0x7f96b805f040 2024-09-22T08:36:43.036 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.023+0000 7f96be101640 1 -- 172.21.15.142:0/2506099497 <== osd.0 v2:172.21.15.31:6800/168281188 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f96a8029040 con 0x7f96b805f040 2024-09-22T08:36:43.037 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.023+0000 7f96be101640 1 -- 172.21.15.142:0/2506099497 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5625e4a673b0 con 0x5625e4a5e560 2024-09-22T08:36:43.037 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.023+0000 7f96be101640 1 -- 172.21.15.142:0/2506099497 <== osd.1 v2:172.21.15.142:6816/3192108003 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f96a8029040 con 0x5625e4a5e560 2024-09-22T08:36:43.037 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.023+0000 7f96be101640 1 -- 172.21.15.142:0/2506099497 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5625e4a673b0 con 0x7f96b003b6d0 2024-09-22T08:36:43.037 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.024+0000 7f96be902640 1 -- 172.21.15.142:0/2506099497 <== osd.2 v2:172.21.15.142:6808/279438927 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f96b8051070 con 0x7f96b003b6d0 2024-09-22T08:36:43.037 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.024+0000 7f96be902640 1 -- 172.21.15.142:0/2506099497 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5625e4a673b0 con 0x5625e4a62f50 2024-09-22T08:36:43.037 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.024+0000 7f96bf103640 1 -- 172.21.15.142:0/2506099497 <== osd.3 v2:172.21.15.142:6800/1064901393 4 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f96b003a070 con 0x5625e4a62f50 2024-09-22T08:36:43.037 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.024+0000 7f96bf103640 1 -- 172.21.15.142:0/2506099497 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5625e4a673b0 con 0x5625e4a62f50 2024-09-22T08:36:43.037 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.024+0000 7f96bf103640 1 -- 172.21.15.142:0/2506099497 <== osd.3 v2:172.21.15.142:6800/1064901393 5 ==== osd_op_reply(20 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f96b003a070 con 0x5625e4a62f50 2024-09-22T08:36:43.037 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.024+0000 7f96bf103640 1 -- 172.21.15.142:0/2506099497 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5625e4a673b0 con 0x7f96b805f040 2024-09-22T08:36:43.037 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.024+0000 7f96be101640 1 -- 172.21.15.142:0/2506099497 <== osd.0 v2:172.21.15.31:6800/168281188 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f96a8029040 con 0x7f96b805f040 2024-09-22T08:36:43.037 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.024+0000 7f96be101640 1 -- 172.21.15.142:0/2506099497 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5625e4a673b0 con 0x5625e4a62f50 2024-09-22T08:36:43.037 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.024+0000 7f96bf103640 1 -- 172.21.15.142:0/2506099497 <== osd.3 v2:172.21.15.142:6800/1064901393 6 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f96b003a070 con 0x5625e4a62f50 2024-09-22T08:36:43.037 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.024+0000 7f96bf103640 1 -- 172.21.15.142:0/2506099497 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5625e4a673b0 con 0x5625e4a62f50 2024-09-22T08:36:43.037 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.025+0000 7f96bf103640 1 -- 172.21.15.142:0/2506099497 <== osd.3 v2:172.21.15.142:6800/1064901393 7 ==== osd_op_reply(23 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f96b003a070 con 0x5625e4a62f50 2024-09-22T08:36:43.038 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.025+0000 7f96bf103640 1 -- 172.21.15.142:0/2506099497 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5625e4a673b0 con 0x5625e4a5e560 2024-09-22T08:36:43.038 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.025+0000 7f96be101640 1 -- 172.21.15.142:0/2506099497 <== osd.1 v2:172.21.15.142:6816/3192108003 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f96a8029040 con 0x5625e4a5e560 2024-09-22T08:36:43.038 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.025+0000 7f96be101640 1 -- 172.21.15.142:0/2506099497 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5625e4a673b0 con 0x5625e4a5e560 2024-09-22T08:36:43.038 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.025+0000 7f96be101640 1 -- 172.21.15.142:0/2506099497 <== osd.1 v2:172.21.15.142:6816/3192108003 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f96a8029040 con 0x5625e4a5e560 2024-09-22T08:36:43.038 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.025+0000 7f96be101640 1 -- 172.21.15.142:0/2506099497 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5625e4a673b0 con 0x7f96b805f040 2024-09-22T08:36:43.038 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.025+0000 7f96be101640 1 -- 172.21.15.142:0/2506099497 <== osd.0 v2:172.21.15.31:6800/168281188 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f96a8029040 con 0x7f96b805f040 2024-09-22T08:36:43.038 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.025+0000 7f96be101640 1 -- 172.21.15.142:0/2506099497 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5625e4a673b0 con 0x5625e4a62f50 2024-09-22T08:36:43.038 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.026+0000 7f96bf103640 1 -- 172.21.15.142:0/2506099497 <== osd.3 v2:172.21.15.142:6800/1064901393 8 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f96b003a070 con 0x5625e4a62f50 2024-09-22T08:36:43.038 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.026+0000 7f96bf103640 1 -- 172.21.15.142:0/2506099497 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5625e4a673b0 con 0x7f96b003b6d0 2024-09-22T08:36:43.038 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.026+0000 7f96be902640 1 -- 172.21.15.142:0/2506099497 <== osd.2 v2:172.21.15.142:6808/279438927 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f96b8051070 con 0x7f96b003b6d0 2024-09-22T08:36:43.038 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.026+0000 7f96be902640 1 -- 172.21.15.142:0/2506099497 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5625e4a673b0 con 0x5625e4a5e560 2024-09-22T08:36:43.038 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.026+0000 7f96be101640 1 -- 172.21.15.142:0/2506099497 <== osd.1 v2:172.21.15.142:6816/3192108003 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f96a8029040 con 0x5625e4a5e560 2024-09-22T08:36:43.039 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.026+0000 7f96be101640 1 -- 172.21.15.142:0/2506099497 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5625e4a673b0 con 0x7f96b805f040 2024-09-22T08:36:43.039 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.026+0000 7f96be101640 1 -- 172.21.15.142:0/2506099497 <== osd.0 v2:172.21.15.31:6800/168281188 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f96a8029040 con 0x7f96b805f040 2024-09-22T08:36:43.039 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.026+0000 7f96be101640 1 -- 172.21.15.142:0/2506099497 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5625e4a673b0 con 0x5625e4a62f50 2024-09-22T08:36:43.039 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.027+0000 7f96bf103640 1 -- 172.21.15.142:0/2506099497 <== osd.3 v2:172.21.15.142:6800/1064901393 9 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f96b003a070 con 0x5625e4a62f50 2024-09-22T08:36:43.039 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.027+0000 7f96bf103640 1 -- 172.21.15.142:0/2506099497 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5625e4a673b0 con 0x7f96b805f040 2024-09-22T08:36:43.039 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.027+0000 7f96be101640 1 -- 172.21.15.142:0/2506099497 <== osd.0 v2:172.21.15.31:6800/168281188 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f96a8029040 con 0x7f96b805f040 2024-09-22T08:36:43.039 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.027+0000 7f96be101640 1 -- 172.21.15.142:0/2506099497 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5625e4a673b0 con 0x7f96b003b6d0 2024-09-22T08:36:43.039 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.027+0000 7f96be902640 1 -- 172.21.15.142:0/2506099497 <== osd.2 v2:172.21.15.142:6808/279438927 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f96b8051070 con 0x7f96b003b6d0 2024-09-22T08:36:43.039 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.027+0000 7f96be902640 1 -- 172.21.15.142:0/2506099497 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5625e4a673b0 con 0x5625e4a62f50 2024-09-22T08:36:43.039 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.027+0000 7f96bf103640 1 -- 172.21.15.142:0/2506099497 <== osd.3 v2:172.21.15.142:6800/1064901393 10 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f96b003a070 con 0x5625e4a62f50 2024-09-22T08:36:43.039 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.027+0000 7f96bf103640 1 -- 172.21.15.142:0/2506099497 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5625e4a673b0 con 0x7f96b805f040 2024-09-22T08:36:43.039 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.027+0000 7f96be101640 1 -- 172.21.15.142:0/2506099497 <== osd.0 v2:172.21.15.31:6800/168281188 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f96a8029040 con 0x7f96b805f040 2024-09-22T08:36:43.040 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.027+0000 7f96be101640 1 -- 172.21.15.142:0/2506099497 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5625e4a673b0 con 0x5625e4a5e560 2024-09-22T08:36:43.040 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.028+0000 7f96be101640 1 -- 172.21.15.142:0/2506099497 <== osd.1 v2:172.21.15.142:6816/3192108003 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f96a8029040 con 0x5625e4a5e560 2024-09-22T08:36:43.040 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.028+0000 7f96be101640 1 -- 172.21.15.142:0/2506099497 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5625e4a673b0 con 0x7f96b003b6d0 2024-09-22T08:36:43.040 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.028+0000 7f96be902640 1 -- 172.21.15.142:0/2506099497 <== osd.2 v2:172.21.15.142:6808/279438927 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f96b8051070 con 0x7f96b003b6d0 2024-09-22T08:36:43.040 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.028+0000 7f96c2d22800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:36:43.040 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.028+0000 7f96c2d22800 20 RGWRados::pool_iterate: got zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec 2024-09-22T08:36:43.040 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.028+0000 7f96c2d22800 20 RGWRados::pool_iterate: got zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f 2024-09-22T08:36:43.040 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.028+0000 7f96c2d22800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:36:43.040 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.028+0000 7f96c2d22800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:36:43.040 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.028+0000 7f96c2d22800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:36:43.040 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.028+0000 7f96c2d22800 20 rados->read ofs=0 len=0 2024-09-22T08:36:43.040 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.028+0000 7f96c2d22800 1 -- 172.21.15.142:0/2506099497 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5625e4a66440 con 0x5625e4a5e560 2024-09-22T08:36:43.040 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.028+0000 7f96be101640 1 -- 172.21.15.142:0/2506099497 <== osd.1 v2:172.21.15.142:6816/3192108003 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f96a8029040 con 0x5625e4a5e560 2024-09-22T08:36:43.041 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.028+0000 7f96c2d22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:43.041 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.028+0000 7f96c2d22800 20 rados->read ofs=0 len=0 2024-09-22T08:36:43.041 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.028+0000 7f96c2d22800 1 -- 172.21.15.142:0/2506099497 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5625e4a66c90 con 0x5625e4a5e560 2024-09-22T08:36:43.041 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.028+0000 7f96be101640 1 -- 172.21.15.142:0/2506099497 <== osd.1 v2:172.21.15.142:6816/3192108003 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f96a8029040 con 0x5625e4a5e560 2024-09-22T08:36:43.041 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.028+0000 7f96c2d22800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:36:43.041 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.028+0000 7f96c2d22800 20 rados->read ofs=0 len=0 2024-09-22T08:36:43.041 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.028+0000 7f96c2d22800 1 -- 172.21.15.142:0/2506099497 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:40 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5625e4a67830 con 0x5625e4a62f50 2024-09-22T08:36:43.041 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.029+0000 7f96bf103640 1 -- 172.21.15.142:0/2506099497 <== osd.3 v2:172.21.15.142:6800/1064901393 11 ==== osd_op_reply(40 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f96b003a070 con 0x5625e4a62f50 2024-09-22T08:36:43.041 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.029+0000 7f96c2d22800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:36:43.041 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.029+0000 7f96c2d22800 20 zone default found 2024-09-22T08:36:43.041 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.029+0000 7f96c2d22800 4 Realm: () 2024-09-22T08:36:43.041 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.029+0000 7f96c2d22800 4 ZoneGroup: default (d89f6f57-1007-47dd-9065-f486c7b01aec) 2024-09-22T08:36:43.041 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.029+0000 7f96c2d22800 4 Zone: default (e239248c-0bee-4e41-803a-24b288d3eb8f) 2024-09-22T08:36:43.041 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.029+0000 7f96c2d22800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:36:43.041 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.029+0000 7f96c2d22800 20 zonegroup default 2024-09-22T08:36:43.042 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.029+0000 7f96c2d22800 20 rados->read ofs=0 len=0 2024-09-22T08:36:43.042 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.029+0000 7f96c2d22800 1 -- 172.21.15.142:0/2506099497 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5625e4a67bd0 con 0x7f96b805f040 2024-09-22T08:36:43.042 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.029+0000 7f96be101640 1 -- 172.21.15.142:0/2506099497 <== osd.0 v2:172.21.15.31:6800/168281188 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f96a8029040 con 0x7f96b805f040 2024-09-22T08:36:43.042 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.029+0000 7f96c2d22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:43.042 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.029+0000 7f96c2d22800 20 rados->read ofs=0 len=0 2024-09-22T08:36:43.042 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.029+0000 7f96c2d22800 1 -- 172.21.15.142:0/2506099497 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5625e4a69eb0 con 0x5625e4a62f50 2024-09-22T08:36:43.042 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.029+0000 7f96bf103640 1 -- 172.21.15.142:0/2506099497 <== osd.3 v2:172.21.15.142:6800/1064901393 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f96b003a070 con 0x5625e4a62f50 2024-09-22T08:36:43.042 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.029+0000 7f96c2d22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:43.042 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.029+0000 7f96c2d22800 20 rados->read ofs=0 len=0 2024-09-22T08:36:43.042 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.029+0000 7f96c2d22800 1 -- 172.21.15.142:0/2506099497 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5625e4a6a250 con 0x5625e4a62f50 2024-09-22T08:36:43.042 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.030+0000 7f96bf103640 1 -- 172.21.15.142:0/2506099497 <== osd.3 v2:172.21.15.142:6800/1064901393 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f96b003a070 con 0x5625e4a62f50 2024-09-22T08:36:43.042 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.030+0000 7f96c2d22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:43.043 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.030+0000 7f96c2d22800 20 started sync module instance, tier type = 2024-09-22T08:36:43.043 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.030+0000 7f96c2d22800 20 started zone id=e239248c-0bee-4e41-803a-24b288d3eb8f (name=default) with tier type = 2024-09-22T08:36:43.043 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.030+0000 7f96c2d22800 1 -- 172.21.15.142:0/2506099497 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5625e4a692f0 con 0x7f96b003b6d0 2024-09-22T08:36:43.043 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.031+0000 7f96be902640 1 -- 172.21.15.142:0/2506099497 <== osd.2 v2:172.21.15.142:6808/279438927 7 ==== osd_op_reply(44 notify.0 [create] v30'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f96b8051070 con 0x7f96b003b6d0 2024-09-22T08:36:43.043 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.031+0000 7f96c2d22800 1 -- 172.21.15.142:0/2506099497 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94720749899328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5625e4a6a6b0 con 0x7f96b003b6d0 2024-09-22T08:36:43.043 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.031+0000 7f96c2d22800 1 -- 172.21.15.142:0/2506099497 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5625e4a6af00 con 0x5625e4a5e560 2024-09-22T08:36:43.048 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.032+0000 7f96be902640 1 -- 172.21.15.142:0/2506099497 <== osd.2 v2:172.21.15.142:6808/279438927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94720749899328] v30'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f96b8051070 con 0x7f96b003b6d0 2024-09-22T08:36:43.048 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.032+0000 7f96be101640 1 -- 172.21.15.142:0/2506099497 <== osd.1 v2:172.21.15.142:6816/3192108003 15 ==== osd_op_reply(46 notify.1 [create] v30'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f96a8029040 con 0x5625e4a5e560 2024-09-22T08:36:43.048 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.032+0000 7f96c2d22800 1 -- 172.21.15.142:0/2506099497 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94720749901536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5625e4a6b060 con 0x5625e4a5e560 2024-09-22T08:36:43.048 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.032+0000 7f96c2d22800 1 -- 172.21.15.142:0/2506099497 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5625e4a6bb60 con 0x5625e4a62f50 2024-09-22T08:36:43.048 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.033+0000 7f96be101640 1 -- 172.21.15.142:0/2506099497 <== osd.1 v2:172.21.15.142:6816/3192108003 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94720749901536] v30'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f96a8029040 con 0x5625e4a5e560 2024-09-22T08:36:43.048 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.033+0000 7f96bf103640 1 -- 172.21.15.142:0/2506099497 <== osd.3 v2:172.21.15.142:6800/1064901393 14 ==== osd_op_reply(48 notify.2 [create] v30'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f96b003a070 con 0x5625e4a62f50 2024-09-22T08:36:43.048 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.033+0000 7f96c2d22800 1 -- 172.21.15.142:0/2506099497 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94720749909584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5625e4a6bb20 con 0x5625e4a62f50 2024-09-22T08:36:43.048 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.033+0000 7f96c2d22800 1 -- 172.21.15.142:0/2506099497 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5625e4a6c5f0 con 0x7f96b003b6d0 2024-09-22T08:36:43.048 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.034+0000 7f96be902640 1 -- 172.21.15.142:0/2506099497 <== osd.2 v2:172.21.15.142:6808/279438927 9 ==== osd_op_reply(50 notify.3 [create] v30'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f96b8051070 con 0x7f96b003b6d0 2024-09-22T08:36:43.048 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.034+0000 7f96c2d22800 1 -- 172.21.15.142:0/2506099497 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94720749912352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5625e4a6cb00 con 0x7f96b003b6d0 2024-09-22T08:36:43.048 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.034+0000 7f96bf103640 1 -- 172.21.15.142:0/2506099497 <== osd.3 v2:172.21.15.142:6800/1064901393 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94720749909584] v30'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f96b003a070 con 0x5625e4a62f50 2024-09-22T08:36:43.049 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.034+0000 7f96c2d22800 1 -- 172.21.15.142:0/2506099497 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5625e4a6ab10 con 0x5625e4a5e560 2024-09-22T08:36:43.049 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.037+0000 7f96be902640 1 -- 172.21.15.142:0/2506099497 <== osd.2 v2:172.21.15.142:6808/279438927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94720749912352] v30'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f96b8051070 con 0x7f96b003b6d0 2024-09-22T08:36:43.049 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.037+0000 7f96be101640 1 -- 172.21.15.142:0/2506099497 <== osd.1 v2:172.21.15.142:6816/3192108003 17 ==== osd_op_reply(52 notify.4 [create] v30'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f96a8029040 con 0x5625e4a5e560 2024-09-22T08:36:43.049 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.037+0000 7f96c2d22800 1 -- 172.21.15.142:0/2506099497 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94720749913584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5625e4a6ab10 con 0x5625e4a5e560 2024-09-22T08:36:43.049 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.037+0000 7f96c2d22800 1 -- 172.21.15.142:0/2506099497 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5625e4a6db90 con 0x7f96b805f040 2024-09-22T08:36:43.049 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.038+0000 7f96be101640 1 -- 172.21.15.142:0/2506099497 <== osd.0 v2:172.21.15.31:6800/168281188 11 ==== osd_op_reply(54 notify.5 [create] v30'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f96a8029040 con 0x7f96b805f040 2024-09-22T08:36:43.049 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.038+0000 7f96c2d22800 1 -- 172.21.15.142:0/2506099497 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94720749917920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5625e4a6dfb0 con 0x7f96b805f040 2024-09-22T08:36:43.049 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.038+0000 7f96be101640 1 -- 172.21.15.142:0/2506099497 <== osd.1 v2:172.21.15.142:6816/3192108003 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94720749913584] v30'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f96a8029040 con 0x5625e4a5e560 2024-09-22T08:36:43.049 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.038+0000 7f96c2d22800 1 -- 172.21.15.142:0/2506099497 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5625e4a6e880 con 0x7f96b805f040 2024-09-22T08:36:43.049 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.039+0000 7f96be101640 1 -- 172.21.15.142:0/2506099497 <== osd.0 v2:172.21.15.31:6800/168281188 12 ==== osd_op_reply(56 notify.6 [create] v30'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f96a8029040 con 0x7f96b805f040 2024-09-22T08:36:43.049 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.039+0000 7f96be101640 1 -- 172.21.15.142:0/2506099497 <== osd.0 v2:172.21.15.31:6800/168281188 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94720749917920] v30'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f96a8029040 con 0x7f96b805f040 2024-09-22T08:36:43.049 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.039+0000 7f96c2d22800 1 -- 172.21.15.142:0/2506099497 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94720749921232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5625e4a6eca0 con 0x7f96b805f040 2024-09-22T08:36:43.049 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.039+0000 7f96c2d22800 1 -- 172.21.15.142:0/2506099497 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5625e4a6db00 con 0x7f96b805f040 2024-09-22T08:36:43.049 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.040+0000 7f96be101640 1 -- 172.21.15.142:0/2506099497 <== osd.0 v2:172.21.15.31:6800/168281188 14 ==== osd_op_reply(58 notify.7 [create] v30'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f96a8029040 con 0x7f96b805f040 2024-09-22T08:36:43.049 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.040+0000 7f96c2d22800 1 -- 172.21.15.142:0/2506099497 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94720749923488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5625e4a6f570 con 0x7f96b805f040 2024-09-22T08:36:43.050 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.040+0000 7f96c2d22800 20 add_watcher() i=0 2024-09-22T08:36:43.050 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.040+0000 7f96c2d22800 20 add_watcher() i=1 2024-09-22T08:36:43.050 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.040+0000 7f96c2d22800 20 add_watcher() i=2 2024-09-22T08:36:43.050 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.040+0000 7f96c2d22800 20 add_watcher() i=3 2024-09-22T08:36:43.050 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.040+0000 7f96c2d22800 20 add_watcher() i=4 2024-09-22T08:36:43.050 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.040+0000 7f96c2d22800 20 add_watcher() i=5 2024-09-22T08:36:43.050 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.040+0000 7f96be101640 1 -- 172.21.15.142:0/2506099497 <== osd.0 v2:172.21.15.31:6800/168281188 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94720749921232] v30'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f96a8029040 con 0x7f96b805f040 2024-09-22T08:36:43.050 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.040+0000 7f96c2d22800 20 add_watcher() i=6 2024-09-22T08:36:43.050 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.041+0000 7f96be101640 1 -- 172.21.15.142:0/2506099497 <== osd.0 v2:172.21.15.31:6800/168281188 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94720749923488] v30'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f96a8029040 con 0x7f96b805f040 2024-09-22T08:36:43.050 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.041+0000 7f96c2d22800 20 add_watcher() i=7 2024-09-22T08:36:43.050 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.041+0000 7f96c2d22800 2 all 8 watchers are set, enabling cache 2024-09-22T08:36:43.050 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.041+0000 7f96c2d22800 1 -- 172.21.15.142:0/2506099497 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5625e4a725a0 con 0x5625e4a5e560 2024-09-22T08:36:43.050 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.041+0000 7f96be101640 1 -- 172.21.15.142:0/2506099497 <== osd.1 v2:172.21.15.142:6816/3192108003 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f96a8029040 con 0x5625e4a5e560 2024-09-22T08:36:43.050 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.041+0000 7f96c2d22800 1 -- 172.21.15.142:0/2506099497 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94720749924544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5625e4a6f9c0 con 0x5625e4a5e560 2024-09-22T08:36:43.051 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.042+0000 7f96be101640 1 -- 172.21.15.142:0/2506099497 <== osd.1 v2:172.21.15.142:6816/3192108003 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94720749924544] v30'56 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f96a8029040 con 0x5625e4a5e560 2024-09-22T08:36:43.051 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.042+0000 7f95757e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:36:43.051 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.042+0000 7f96c2d22800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:36:43.051 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.042+0000 7f96c2d22800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:36:43.051 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.042+0000 7f96c2d22800 5 note: GC not initialized 2024-09-22T08:36:43.051 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.043+0000 7f94effff640 20 reqs_thread_entry: start 2024-09-22T08:36:43.051 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.043+0000 7f96c2d22800 20 init_complete bucket index max shards: 11 2024-09-22T08:36:43.051 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.043+0000 7f96c2d22800 20 Filter name: none 2024-09-22T08:36:43.051 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.043+0000 7f94edffb640 20 reqs_thread_entry: start 2024-09-22T08:36:43.051 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.043+0000 7f96c2d22800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-22T08:36:43.051 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.043+0000 7f96c2d22800 20 rados->read ofs=0 len=0 2024-09-22T08:36:43.051 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.043+0000 7f96c2d22800 1 -- 172.21.15.142:0/2506099497 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5625e4aa57c0 con 0x5625e4a5e560 2024-09-22T08:36:43.051 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.043+0000 7f96be101640 1 -- 172.21.15.142:0/2506099497 <== osd.1 v2:172.21.15.142:6816/3192108003 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f96a8029040 con 0x5625e4a5e560 2024-09-22T08:36:43.051 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.043+0000 7f96c2d22800 20 rados_obj.operate() r=0 bl.length=391 2024-09-22T08:36:43.052 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.043+0000 7f96c2d22800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-22T08:36:43.052 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.043+0000 7f96c2d22800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-22T08:36:43.052 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.043+0000 7f96c2d22800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:36:43.052 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.043+0000 7f96c2d22800 1 -- 172.21.15.142:0/2506099497 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5625e4aa8250 con 0x7f96b003b6d0 2024-09-22T08:36:43.052 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.043+0000 7f96be902640 1 -- 172.21.15.142:0/2506099497 <== osd.2 v2:172.21.15.142:6808/279438927 11 ==== osd_op_reply(63 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 155+0+0 (crc 0 0 0) 0x7f96b8051070 con 0x7f96b003b6d0 2024-09-22T08:36:43.052 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.044+0000 7f96c2d22800 1 -- 172.21.15.142:0/2506099497 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5625e4aaba30 con 0x5625e4a5e560 2024-09-22T08:36:43.052 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.045+0000 7f96be101640 1 -- 172.21.15.142:0/2506099497 <== osd.1 v2:172.21.15.142:6816/3192108003 22 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~391] v30'2 uv2 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f96a8029040 con 0x5625e4a5e560 2024-09-22T08:36:43.052 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.045+0000 7f96c2d22800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-22T08:36:43.052 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.045+0000 7f96c2d22800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-22T08:36:43.052 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.045+0000 7f96c2d22800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-22T08:36:43.052 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.045+0000 7f96c2d22800 1 -- 172.21.15.142:0/2506099497 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94720750171120 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5625e4aa7240 con 0x5625e4a5e560 2024-09-22T08:36:43.052 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.045+0000 7f96be101640 1 -- 172.21.15.142:0/2506099497 <== osd.1 v2:172.21.15.142:6816/3192108003 23 ==== watch-notify(notify (1) cookie 94720749913584 notify 128849018881 ret 0) ==== 609+0+0 (crc 0 0 0) 0x5625e47b5a20 con 0x5625e4a5e560 2024-09-22T08:36:43.052 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.045+0000 7f95a27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018881 cookie 94720749913584 notifier 4310 bl.length()=567 2024-09-22T08:36:43.052 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.045+0000 7f95a27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-22T08:36:43.052 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.045+0000 7f95a27fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-22T08:36:43.053 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.045+0000 7f95a27fc640 1 -- 172.21.15.142:0/2506099497 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f9584003ea0 con 0x5625e4a5e560 2024-09-22T08:36:43.053 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.045+0000 7f96be101640 1 -- 172.21.15.142:0/2506099497 <== osd.1 v2:172.21.15.142:6816/3192108003 24 ==== osd_op_reply(65 notify.4 [notify cookie 94720750171120 out=8b] v0'0 uv33 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f96a8029040 con 0x5625e4a5e560 2024-09-22T08:36:43.053 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.045+0000 7f96be101640 1 -- 172.21.15.142:0/2506099497 <== osd.1 v2:172.21.15.142:6816/3192108003 25 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f96a8029040 con 0x5625e4a5e560 2024-09-22T08:36:43.053 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.045+0000 7f96be101640 1 -- 172.21.15.142:0/2506099497 <== osd.1 v2:172.21.15.142:6816/3192108003 26 ==== watch-notify(notify_complete (2) cookie 94720750171120 notify 128849018881 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f96a802d8a0 con 0x5625e4a5e560 2024-09-22T08:36:43.053 INFO:teuthology.orchestra.run.smithi142.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":1,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-22T08:36:42.661297Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-22T08:36:42.661288Z","tags":[],"group_ids":[]} 2024-09-22T08:36:43.055 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.046+0000 7f95757e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:36:43.055 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.046+0000 7f96c2d22800 1 -- 172.21.15.142:0/2506099497 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:67 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94720749924544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5625e4aa3500 con 0x5625e4a5e560 2024-09-22T08:36:43.055 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.047+0000 7f96be101640 1 -- 172.21.15.142:0/2506099497 <== osd.1 v2:172.21.15.142:6816/3192108003 27 ==== osd_op_reply(67 data_loggenerations_metadata [watch unwatch cookie 94720749924544] v30'57 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f96a8029040 con 0x5625e4a5e560 2024-09-22T08:36:43.055 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.047+0000 7f96c2d22800 1 -- 172.21.15.142:0/2506099497 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94720749899328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5625e4aa3500 con 0x7f96b003b6d0 2024-09-22T08:36:43.056 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.048+0000 7f96be902640 1 -- 172.21.15.142:0/2506099497 <== osd.2 v2:172.21.15.142:6808/279438927 12 ==== osd_op_reply(68 notify.0 [watch unwatch cookie 94720749899328] v30'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f96b8051070 con 0x7f96b003b6d0 2024-09-22T08:36:43.056 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.048+0000 7f96c2d22800 20 remove_watcher() i=0 2024-09-22T08:36:43.056 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.048+0000 7f96c2d22800 2 removed watcher, disabling cache 2024-09-22T08:36:43.056 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.048+0000 7f96c2d22800 1 -- 172.21.15.142:0/2506099497 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:69 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94720749901536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5625e4aa3500 con 0x5625e4a5e560 2024-09-22T08:36:43.056 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.049+0000 7f96be101640 1 -- 172.21.15.142:0/2506099497 <== osd.1 v2:172.21.15.142:6816/3192108003 28 ==== osd_op_reply(69 notify.1 [watch unwatch cookie 94720749901536] v30'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f96a8029040 con 0x5625e4a5e560 2024-09-22T08:36:43.056 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.049+0000 7f96c2d22800 20 remove_watcher() i=1 2024-09-22T08:36:43.056 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.049+0000 7f96c2d22800 1 -- 172.21.15.142:0/2506099497 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:70 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94720749909584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5625e4aa3500 con 0x5625e4a62f50 2024-09-22T08:36:43.056 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.050+0000 7f96bf103640 1 -- 172.21.15.142:0/2506099497 <== osd.3 v2:172.21.15.142:6800/1064901393 16 ==== osd_op_reply(70 notify.2 [watch unwatch cookie 94720749909584] v30'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f96b003a070 con 0x5625e4a62f50 2024-09-22T08:36:43.056 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.050+0000 7f96c2d22800 20 remove_watcher() i=2 2024-09-22T08:36:43.056 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.050+0000 7f96c2d22800 1 -- 172.21.15.142:0/2506099497 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:71 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94720749912352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5625e4aa3500 con 0x7f96b003b6d0 2024-09-22T08:36:43.056 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.051+0000 7f96be902640 1 -- 172.21.15.142:0/2506099497 <== osd.2 v2:172.21.15.142:6808/279438927 13 ==== osd_op_reply(71 notify.3 [watch unwatch cookie 94720749912352] v30'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f96b8051070 con 0x7f96b003b6d0 2024-09-22T08:36:43.056 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.051+0000 7f96c2d22800 20 remove_watcher() i=3 2024-09-22T08:36:43.056 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.051+0000 7f96c2d22800 1 -- 172.21.15.142:0/2506099497 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:72 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94720749913584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5625e4aa3500 con 0x5625e4a5e560 2024-09-22T08:36:43.057 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.052+0000 7f96be101640 1 -- 172.21.15.142:0/2506099497 <== osd.1 v2:172.21.15.142:6816/3192108003 29 ==== osd_op_reply(72 notify.4 [watch unwatch cookie 94720749913584] v30'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f96a8029040 con 0x5625e4a5e560 2024-09-22T08:36:43.057 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.052+0000 7f96c2d22800 20 remove_watcher() i=4 2024-09-22T08:36:43.057 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.052+0000 7f96c2d22800 1 -- 172.21.15.142:0/2506099497 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:73 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94720749917920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5625e4aa3500 con 0x7f96b805f040 2024-09-22T08:36:43.057 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.053+0000 7f96be101640 1 -- 172.21.15.142:0/2506099497 <== osd.0 v2:172.21.15.31:6800/168281188 17 ==== osd_op_reply(73 notify.5 [watch unwatch cookie 94720749917920] v30'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f96a8029040 con 0x7f96b805f040 2024-09-22T08:36:43.057 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.053+0000 7f96c2d22800 20 remove_watcher() i=5 2024-09-22T08:36:43.057 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.053+0000 7f96c2d22800 1 -- 172.21.15.142:0/2506099497 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:74 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94720749921232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5625e4aa3500 con 0x7f96b805f040 2024-09-22T08:36:43.057 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.054+0000 7f96be101640 1 -- 172.21.15.142:0/2506099497 <== osd.0 v2:172.21.15.31:6800/168281188 18 ==== osd_op_reply(74 notify.6 [watch unwatch cookie 94720749921232] v30'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f96a8029040 con 0x7f96b805f040 2024-09-22T08:36:43.057 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.054+0000 7f96c2d22800 20 remove_watcher() i=6 2024-09-22T08:36:43.057 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.054+0000 7f96c2d22800 1 -- 172.21.15.142:0/2506099497 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:75 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94720749923488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5625e4aa3500 con 0x7f96b805f040 2024-09-22T08:36:43.060 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.055+0000 7f96be101640 1 -- 172.21.15.142:0/2506099497 <== osd.0 v2:172.21.15.31:6800/168281188 19 ==== osd_op_reply(75 notify.7 [watch unwatch cookie 94720749923488] v30'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f96a8029040 con 0x7f96b805f040 2024-09-22T08:36:43.060 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.055+0000 7f96c2d22800 20 remove_watcher() i=7 2024-09-22T08:36:43.060 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.055+0000 7f96c2d22800 1 -- 172.21.15.142:0/2506099497 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f96b805f040 msgr2=0x7f96b80982e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:43.060 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.055+0000 7f96c2d22800 1 --2- 172.21.15.142:0/2506099497 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f96b805f040 0x7f96b80982e0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:43.060 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.055+0000 7f96c2d22800 1 -- 172.21.15.142:0/2506099497 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5625e4a5e560 msgr2=0x5625e4a60a20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:43.060 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.055+0000 7f96c2d22800 1 --2- 172.21.15.142:0/2506099497 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5625e4a5e560 0x5625e4a60a20 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:43.060 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.055+0000 7f96c2d22800 1 -- 172.21.15.142:0/2506099497 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f96b003b6d0 msgr2=0x7f96b00435c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:43.060 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.055+0000 7f96c2d22800 1 --2- 172.21.15.142:0/2506099497 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f96b003b6d0 0x7f96b00435c0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:43.060 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.055+0000 7f96c2d22800 1 -- 172.21.15.142:0/2506099497 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5625e4a62f50 msgr2=0x5625e4a65340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:43.060 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.055+0000 7f96c2d22800 1 --2- 172.21.15.142:0/2506099497 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5625e4a62f50 0x5625e4a65340 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:43.060 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.055+0000 7f96c2d22800 1 -- 172.21.15.142:0/2506099497 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f958803d000 msgr2=0x7f958803f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:43.060 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.055+0000 7f96c2d22800 1 --2- 172.21.15.142:0/2506099497 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f958803d000 0x7f958803f4c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f96b80075e0 tx=0x7f96b8081000 comp rx=0 tx=0).stop 2024-09-22T08:36:43.061 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.055+0000 7f96c2d22800 1 -- 172.21.15.142:0/2506099497 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5625e4a4b640 msgr2=0x5625e4a52c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:43.061 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.055+0000 7f96be101640 1 -- 172.21.15.142:0/2506099497 reap_dead start 2024-09-22T08:36:43.061 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.055+0000 7f96c2d22800 1 --2- 172.21.15.142:0/2506099497 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5625e4a4b640 0x5625e4a52c20 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f96b0020790 tx=0x7f96b00547d0 comp rx=0 tx=0).stop 2024-09-22T08:36:43.061 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.055+0000 7f96c2d22800 1 -- 172.21.15.142:0/2506099497 shutdown_connections 2024-09-22T08:36:43.061 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.055+0000 7f96c2d22800 1 --2- 172.21.15.142:0/2506099497 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5625e4a4b640 0x5625e4a52c20 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:43.061 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.055+0000 7f96c2d22800 1 -- 172.21.15.142:0/2506099497 >> 172.21.15.142:0/2506099497 conn(0x5625e4a47a60 msgr2=0x5625e4a45c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:43.061 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.055+0000 7f96c2d22800 1 -- 172.21.15.142:0/2506099497 shutdown_connections 2024-09-22T08:36:43.061 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.055+0000 7f96c2d22800 1 -- 172.21.15.142:0/2506099497 wait complete. 2024-09-22T08:36:43.061 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.056+0000 7f96c2d22800 1 -- 172.21.15.142:0/1888771764 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f959803cfb0 msgr2=0x7f959803f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:43.061 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.056+0000 7f96c2d22800 1 --2- 172.21.15.142:0/1888771764 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f959803cfb0 0x7f959803f470 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f96b807bb60 tx=0x7f96b807b9a0 comp rx=0 tx=0).stop 2024-09-22T08:36:43.061 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.056+0000 7f96c2d22800 1 -- 172.21.15.142:0/1888771764 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5625e4a3eba0 msgr2=0x5625e4a3efc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:43.061 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.056+0000 7f96c2d22800 1 --2- 172.21.15.142:0/1888771764 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5625e4a3eba0 0x5625e4a3efc0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x5625e492a340 tx=0x7f96b00167b0 comp rx=0 tx=0).stop 2024-09-22T08:36:43.061 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.056+0000 7f96c2d22800 1 -- 172.21.15.142:0/1888771764 shutdown_connections 2024-09-22T08:36:43.061 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.056+0000 7f96c2d22800 1 --2- 172.21.15.142:0/1888771764 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f959803cfb0 0x7f959803f470 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:43.061 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.056+0000 7f96c2d22800 1 --2- 172.21.15.142:0/1888771764 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5625e4a3eba0 0x5625e4a3efc0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:43.062 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.056+0000 7f96c2d22800 1 -- 172.21.15.142:0/1888771764 >> 172.21.15.142:0/1888771764 conn(0x5625e4a32f50 msgr2=0x5625e4a33330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:43.062 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.056+0000 7f96c2d22800 1 -- 172.21.15.142:0/1888771764 shutdown_connections 2024-09-22T08:36:43.062 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.056+0000 7f96c2d22800 1 -- 172.21.15.142:0/1888771764 wait complete. 2024-09-22T08:36:43.062 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.056+0000 7f96c2d22800 1 -- 172.21.15.142:0/3884098395 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5625e492d9b0 msgr2=0x5625e4a2aed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:43.062 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.056+0000 7f96c2d22800 1 --2- 172.21.15.142:0/3884098395 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5625e492d9b0 0x5625e4a2aed0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:43.062 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.056+0000 7f96c2d22800 1 -- 172.21.15.142:0/3884098395 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5625e4a2d5e0 msgr2=0x5625e4a2fa80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:43.062 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.056+0000 7f96c2d22800 1 --2- 172.21.15.142:0/3884098395 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5625e4a2d5e0 0x5625e4a2fa80 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:43.062 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.056+0000 7f96c2d22800 1 -- 172.21.15.142:0/3884098395 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f95a403cfb0 msgr2=0x7f95a403f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:43.062 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.056+0000 7f96c2d22800 1 --2- 172.21.15.142:0/3884098395 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f95a403cfb0 0x7f95a403f470 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f96a8001d70 tx=0x7f96a80012d0 comp rx=0 tx=0).stop 2024-09-22T08:36:43.062 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.056+0000 7f96c2d22800 1 -- 172.21.15.142:0/3884098395 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5625e492b080 msgr2=0x5625e492a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:43.062 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.056+0000 7f96c2d22800 1 --2- 172.21.15.142:0/3884098395 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5625e492b080 0x5625e492a7a0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f96b8025c20 tx=0x7f96b8002fb0 comp rx=0 tx=0).stop 2024-09-22T08:36:43.062 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.056+0000 7f96c2d22800 1 -- 172.21.15.142:0/3884098395 shutdown_connections 2024-09-22T08:36:43.062 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.056+0000 7f96c2d22800 1 --2- 172.21.15.142:0/3884098395 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5625e4a2d5e0 0x5625e4a2fa80 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:43.062 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.056+0000 7f96c2d22800 1 --2- 172.21.15.142:0/3884098395 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5625e492d9b0 0x5625e4a2aed0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:43.063 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.056+0000 7f96c2d22800 1 --2- 172.21.15.142:0/3884098395 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f95a403cfb0 0x7f95a403f470 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:43.063 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.056+0000 7f96c2d22800 1 --2- 172.21.15.142:0/3884098395 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5625e492b080 0x5625e492a7a0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:43.063 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.056+0000 7f96c2d22800 1 -- 172.21.15.142:0/3884098395 >> 172.21.15.142:0/3884098395 conn(0x5625e4924be0 msgr2=0x5625e4a14150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:43.063 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.056+0000 7f96c2d22800 1 -- 172.21.15.142:0/3884098395 shutdown_connections 2024-09-22T08:36:43.063 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.056+0000 7f96c2d22800 1 -- 172.21.15.142:0/3884098395 wait complete. 2024-09-22T08:36:43.066 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-22T08:36:42.661297Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-22T08:36:42.661288Z', 'tags': [], 'group_ids': []} 2024-09-22T08:36:43.066 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-22T08:36:43.066 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-22T08:36:43.067 DEBUG:teuthology.orchestra.run.smithi142:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-22T08:36:43.111 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:36:43.111 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:36:43.112 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.110+0000 7ff4a21ad800 1 Processor -- start 2024-09-22T08:36:43.112 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.111+0000 7ff4a21ad800 1 -- start start 2024-09-22T08:36:43.112 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.111+0000 7ff4a21ad800 1 --2- >> v2:172.21.15.31:3300/0 conn(0x5560f95509f0 0x5560f9552e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:43.112 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.111+0000 7ff4a21ad800 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5560f93d7a20 con 0x5560f954aa40 2024-09-22T08:36:43.112 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.111+0000 7ff4a21ad800 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x5560f93d77d0 con 0x5560f95509f0 2024-09-22T08:36:43.113 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.111+0000 7ff497496640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x5560f95509f0 0x5560f9552e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:43.113 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.111+0000 7ff49fc97640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x5560f954aa40 0x5560f954ae20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.142:42322/0 (socket says 172.21.15.142:42322) 2024-09-22T08:36:43.113 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.111+0000 7ff49fc97640 1 -- 172.21.15.142:0/2843576573 learned_addr learned my addr 172.21.15.142:0/2843576573 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-09-22T08:36:43.113 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.111+0000 7ff497496640 1 -- 172.21.15.142:0/2843576573 >> v1:172.21.15.31:6789/0 conn(0x5560f954aa40 legacy=0x5560f954ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:43.113 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.111+0000 7ff497496640 1 -- 172.21.15.142:0/2843576573 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5560f9554570 con 0x5560f95509f0 2024-09-22T08:36:43.114 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.113+0000 7ff497496640 1 --2- 172.21.15.142:0/2843576573 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5560f95509f0 0x5560f9552e90 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7ff48800a470 tx=0x7ff488045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99c2d83026f5b8c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:43.114 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.113+0000 7ff49f496640 1 -- 172.21.15.142:0/2843576573 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff488053570 con 0x5560f95509f0 2024-09-22T08:36:43.114 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.113+0000 7ff49f496640 1 -- 172.21.15.142:0/2843576573 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff488058070 con 0x5560f95509f0 2024-09-22T08:36:43.115 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.113+0000 7ff49f496640 1 -- 172.21.15.142:0/2843576573 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff488053880 con 0x5560f95509f0 2024-09-22T08:36:43.115 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.114+0000 7ff4a21ad800 1 -- 172.21.15.142:0/2843576573 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5560f95509f0 msgr2=0x5560f9552e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:43.115 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.114+0000 7ff4a21ad800 1 --2- 172.21.15.142:0/2843576573 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5560f95509f0 0x5560f9552e90 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7ff48800a470 tx=0x7ff488045a20 comp rx=0 tx=0).stop 2024-09-22T08:36:43.116 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.114+0000 7ff4a21ad800 1 -- 172.21.15.142:0/2843576573 shutdown_connections 2024-09-22T08:36:43.116 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.114+0000 7ff4a21ad800 1 --2- 172.21.15.142:0/2843576573 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5560f95509f0 0x5560f9552e90 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:43.116 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.114+0000 7ff4a21ad800 1 -- 172.21.15.142:0/2843576573 >> 172.21.15.142:0/2843576573 conn(0x5560f9546310 msgr2=0x5560f9548790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:43.116 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.114+0000 7ff4a21ad800 1 -- 172.21.15.142:0/2843576573 shutdown_connections 2024-09-22T08:36:43.116 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.114+0000 7ff4a21ad800 1 -- 172.21.15.142:0/2843576573 wait complete. 2024-09-22T08:36:43.129 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.127+0000 7ff4a21ad800 1 Processor -- start 2024-09-22T08:36:43.129 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.127+0000 7ff4a21ad800 1 -- start start 2024-09-22T08:36:43.129 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.128+0000 7ff4a21ad800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5560f954aa40 0x5560f963c030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:43.129 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.128+0000 7ff4a21ad800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5560f93e4dd0 con 0x5560f954aa40 2024-09-22T08:36:43.129 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.128+0000 7ff49fc97640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5560f954aa40 0x5560f963c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:43.129 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.128+0000 7ff49fc97640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5560f954aa40 0x5560f963c030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:38108/0 (socket says 172.21.15.142:38108) 2024-09-22T08:36:43.129 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.128+0000 7ff49fc97640 1 -- 172.21.15.142:0/2874785178 learned_addr learned my addr 172.21.15.142:0/2874785178 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:43.130 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.128+0000 7ff49fc97640 1 -- 172.21.15.142:0/2874785178 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5560f963c620 con 0x5560f954aa40 2024-09-22T08:36:43.131 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.128+0000 7ff49fc97640 1 --2- 172.21.15.142:0/2874785178 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5560f954aa40 0x5560f963c030 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7ff490001e40 tx=0x7ff490001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1391edd254e1cc13 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:43.131 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.128+0000 7ff38de0b640 1 -- 172.21.15.142:0/2874785178 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff490012020 con 0x5560f954aa40 2024-09-22T08:36:43.131 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.128+0000 7ff38de0b640 1 -- 172.21.15.142:0/2874785178 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff49000e5a0 con 0x5560f954aa40 2024-09-22T08:36:43.132 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.128+0000 7ff38de0b640 1 -- 172.21.15.142:0/2874785178 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff49000e8a0 con 0x5560f954aa40 2024-09-22T08:36:43.132 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.129+0000 7ff4a21ad800 1 -- 172.21.15.142:0/2874785178 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5560f954aa40 msgr2=0x5560f963c030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:43.132 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.129+0000 7ff4a21ad800 1 --2- 172.21.15.142:0/2874785178 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5560f954aa40 0x5560f963c030 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7ff490001e40 tx=0x7ff490001e70 comp rx=0 tx=0).stop 2024-09-22T08:36:43.132 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.129+0000 7ff4a21ad800 1 -- 172.21.15.142:0/2874785178 shutdown_connections 2024-09-22T08:36:43.132 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.129+0000 7ff4a21ad800 1 --2- 172.21.15.142:0/2874785178 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5560f954aa40 0x5560f963c030 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:43.132 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.129+0000 7ff4a21ad800 1 -- 172.21.15.142:0/2874785178 >> 172.21.15.142:0/2874785178 conn(0x5560f9546310 msgr2=0x5560f96379b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:43.132 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.129+0000 7ff4a21ad800 1 -- 172.21.15.142:0/2874785178 shutdown_connections 2024-09-22T08:36:43.132 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.129+0000 7ff4a21ad800 1 -- 172.21.15.142:0/2874785178 wait complete. 2024-09-22T08:36:43.132 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.129+0000 7ff4a21ad800 1 Processor -- start 2024-09-22T08:36:43.132 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.130+0000 7ff4a21ad800 1 -- start start 2024-09-22T08:36:43.132 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.130+0000 7ff4a21ad800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5560f954aa40 0x5560f9643b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:43.132 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.130+0000 7ff4a21ad800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5560f9553810 con 0x5560f954aa40 2024-09-22T08:36:43.132 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.130+0000 7ff49fc97640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5560f954aa40 0x5560f9643b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:43.133 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.130+0000 7ff49fc97640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5560f954aa40 0x5560f9643b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:38124/0 (socket says 172.21.15.142:38124) 2024-09-22T08:36:43.133 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.130+0000 7ff49fc97640 1 -- 172.21.15.142:0/2476017085 learned_addr learned my addr 172.21.15.142:0/2476017085 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:43.133 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.130+0000 7ff49fc97640 1 -- 172.21.15.142:0/2476017085 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5560f96440b0 con 0x5560f954aa40 2024-09-22T08:36:43.133 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.130+0000 7ff49fc97640 1 --2- 172.21.15.142:0/2476017085 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5560f954aa40 0x5560f9643b50 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7ff4900012b0 tx=0x7ff490000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:43.135 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.131+0000 7ff387fff640 1 -- 172.21.15.142:0/2476017085 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff490012030 con 0x5560f954aa40 2024-09-22T08:36:43.135 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.131+0000 7ff387fff640 1 -- 172.21.15.142:0/2476017085 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff49001a750 con 0x5560f954aa40 2024-09-22T08:36:43.135 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.131+0000 7ff4a21ad800 1 -- 172.21.15.142:0/2476017085 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5560f9644340 con 0x5560f954aa40 2024-09-22T08:36:43.136 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.131+0000 7ff387fff640 1 -- 172.21.15.142:0/2476017085 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff49001aa70 con 0x5560f954aa40 2024-09-22T08:36:43.136 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.131+0000 7ff4a21ad800 1 -- 172.21.15.142:0/2476017085 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5560f9644d40 con 0x5560f954aa40 2024-09-22T08:36:43.136 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.132+0000 7ff387fff640 1 -- 172.21.15.142:0/2476017085 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7ff490015020 con 0x5560f954aa40 2024-09-22T08:36:43.136 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.132+0000 7ff387fff640 1 --2- 172.21.15.142:0/2476017085 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7ff38803d000 0x7ff38803f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:43.136 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.132+0000 7ff387fff640 1 -- 172.21.15.142:0/2476017085 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7ff490020030 con 0x5560f954aa40 2024-09-22T08:36:43.136 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.132+0000 7ff497496640 1 --2- 172.21.15.142:0/2476017085 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7ff38803d000 0x7ff38803f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:43.136 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.132+0000 7ff4a21ad800 1 --2- 172.21.15.142:0/2476017085 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5560f95509f0 0x5560f964b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:43.136 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.132+0000 7ff4a21ad800 1 -- 172.21.15.142:0/2476017085 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5560f9645920 con 0x5560f95509f0 2024-09-22T08:36:43.136 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.132+0000 7ff4a0498640 1 --2- 172.21.15.142:0/2476017085 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5560f95509f0 0x5560f964b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:43.136 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.132+0000 7ff497496640 1 --2- 172.21.15.142:0/2476017085 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7ff38803d000 0x7ff38803f4c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff488057000 tx=0x7ff488052000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:43.136 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.132+0000 7ff4a0498640 1 --2- 172.21.15.142:0/2476017085 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5560f95509f0 0x5560f964b1a0 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:43.136 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.133+0000 7ff4a0498640 1 -- 172.21.15.142:0/2476017085 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff49800a4d0 con 0x5560f95509f0 2024-09-22T08:36:43.136 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.133+0000 7ff4a21ad800 1 -- 172.21.15.142:0/2476017085 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5560f96451f0 con 0x5560f95509f0 2024-09-22T08:36:43.137 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.133+0000 7ff4a0498640 1 -- 172.21.15.142:0/2476017085 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff49800a4d0 con 0x5560f95509f0 2024-09-22T08:36:43.137 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.133+0000 7ff4a21ad800 1 --2- 172.21.15.142:0/2476017085 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5560f964d690 0x5560f964fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:43.137 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.133+0000 7ff4a21ad800 1 -- 172.21.15.142:0/2476017085 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:3 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5560f9650150 con 0x5560f964d690 2024-09-22T08:36:43.137 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.133+0000 7ff49fc97640 1 --2- 172.21.15.142:0/2476017085 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5560f964d690 0x5560f964fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:43.137 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.133+0000 7ff49fc97640 1 --2- 172.21.15.142:0/2476017085 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5560f964d690 0x5560f964fa80 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:43.137 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.134+0000 7ff49fc97640 1 -- 172.21.15.142:0/2476017085 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(3 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7ff490018ce0 con 0x5560f964d690 2024-09-22T08:36:43.137 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.134+0000 7ff4a21ad800 1 -- 172.21.15.142:0/2476017085 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5560f964c530 con 0x5560f95509f0 2024-09-22T08:36:43.137 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.134+0000 7ff4a0498640 1 -- 172.21.15.142:0/2476017085 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff49800a4d0 con 0x5560f95509f0 2024-09-22T08:36:43.137 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.134+0000 7ff4a21ad800 1 -- 172.21.15.142:0/2476017085 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5560f964c9d0 con 0x5560f964d690 2024-09-22T08:36:43.137 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.134+0000 7ff49fc97640 1 -- 172.21.15.142:0/2476017085 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(5 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7ff490018ce0 con 0x5560f964d690 2024-09-22T08:36:43.141 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.135+0000 7ff4a21ad800 1 Processor -- start 2024-09-22T08:36:43.142 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.135+0000 7ff4a21ad800 1 -- start start 2024-09-22T08:36:43.142 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.135+0000 7ff4a21ad800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5560f954d0e0 0x5560f954b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:43.142 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.135+0000 7ff4a21ad800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5560f9443d50 con 0x5560f954d0e0 2024-09-22T08:36:43.142 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.135+0000 7ff4a0498640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5560f954d0e0 0x5560f954b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:43.142 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.135+0000 7ff4a0498640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5560f954d0e0 0x5560f954b950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:38136/0 (socket says 172.21.15.142:38136) 2024-09-22T08:36:43.142 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.135+0000 7ff4a0498640 1 -- 172.21.15.142:0/10771797 learned_addr learned my addr 172.21.15.142:0/10771797 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:43.142 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.135+0000 7ff4a0498640 1 -- 172.21.15.142:0/10771797 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5560f954d600 con 0x5560f954d0e0 2024-09-22T08:36:43.142 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.136+0000 7ff4a0498640 1 --2- 172.21.15.142:0/10771797 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5560f954d0e0 0x5560f954b950 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x5560f96449e0 tx=0x7ff498018c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:43.142 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.136+0000 7ff3857fa640 1 -- 172.21.15.142:0/10771797 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff498016b70 con 0x5560f954d0e0 2024-09-22T08:36:43.142 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.136+0000 7ff3857fa640 1 -- 172.21.15.142:0/10771797 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff498016d10 con 0x5560f954d0e0 2024-09-22T08:36:43.142 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.136+0000 7ff4a21ad800 1 -- 172.21.15.142:0/10771797 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5560f954be90 con 0x5560f954d0e0 2024-09-22T08:36:43.142 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.136+0000 7ff3857fa640 1 -- 172.21.15.142:0/10771797 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff498021440 con 0x5560f954d0e0 2024-09-22T08:36:43.142 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.136+0000 7ff4a21ad800 1 -- 172.21.15.142:0/10771797 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5560f954c3e0 con 0x5560f954d0e0 2024-09-22T08:36:43.143 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.137+0000 7ff3857fa640 1 -- 172.21.15.142:0/10771797 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7ff498011040 con 0x5560f954d0e0 2024-09-22T08:36:43.143 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.137+0000 7ff3857fa640 1 --2- 172.21.15.142:0/10771797 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7ff37803cfb0 0x7ff37803f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:43.143 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.137+0000 7ff3857fa640 1 -- 172.21.15.142:0/10771797 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7ff49800e040 con 0x5560f954d0e0 2024-09-22T08:36:43.143 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.137+0000 7ff49fc97640 1 --2- 172.21.15.142:0/10771797 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7ff37803cfb0 0x7ff37803f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:43.143 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.137+0000 7ff4a21ad800 1 Processor -- start 2024-09-22T08:36:43.143 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.137+0000 7ff49fc97640 1 --2- 172.21.15.142:0/10771797 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7ff37803cfb0 0x7ff37803f470 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x5560f964b810 tx=0x7ff490052a20 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:43.143 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.137+0000 7ff4a21ad800 1 -- start start 2024-09-22T08:36:43.143 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.137+0000 7ff4a21ad800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5560f966d800 0x5560f966dc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:43.143 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.137+0000 7ff4a21ad800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5560f963ca50 con 0x5560f966d800 2024-09-22T08:36:43.143 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.138+0000 7ff4a0498640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5560f966d800 0x5560f966dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:43.143 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.138+0000 7ff4a0498640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5560f966d800 0x5560f966dc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:38138/0 (socket says 172.21.15.142:38138) 2024-09-22T08:36:43.143 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.138+0000 7ff4a0498640 1 -- 172.21.15.142:0/3455671760 learned_addr learned my addr 172.21.15.142:0/3455671760 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:43.143 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.138+0000 7ff4a0498640 1 -- 172.21.15.142:0/3455671760 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5560f966e1f0 con 0x5560f966d800 2024-09-22T08:36:43.143 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.138+0000 7ff4a0498640 1 --2- 172.21.15.142:0/3455671760 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5560f966d800 0x5560f966dc00 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7ff4980542e0 tx=0x7ff498020f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a501511fdee7480c server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:43.144 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.138+0000 7ff37effd640 1 -- 172.21.15.142:0/3455671760 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff498013430 con 0x5560f966d800 2024-09-22T08:36:43.144 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.138+0000 7ff37effd640 1 -- 172.21.15.142:0/3455671760 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff498014ad0 con 0x5560f966d800 2024-09-22T08:36:43.144 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.138+0000 7ff37effd640 1 -- 172.21.15.142:0/3455671760 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff4980135d0 con 0x5560f966d800 2024-09-22T08:36:43.144 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.139+0000 7ff4a21ad800 1 -- 172.21.15.142:0/3455671760 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5560f966d800 msgr2=0x5560f966dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:43.144 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.139+0000 7ff4a21ad800 1 --2- 172.21.15.142:0/3455671760 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5560f966d800 0x5560f966dc00 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7ff4980542e0 tx=0x7ff498020f20 comp rx=0 tx=0).stop 2024-09-22T08:36:43.144 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.139+0000 7ff4a21ad800 1 -- 172.21.15.142:0/3455671760 shutdown_connections 2024-09-22T08:36:43.144 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.139+0000 7ff4a21ad800 1 --2- 172.21.15.142:0/3455671760 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5560f966d800 0x5560f966dc00 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:43.144 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.139+0000 7ff4a21ad800 1 -- 172.21.15.142:0/3455671760 >> 172.21.15.142:0/3455671760 conn(0x5560f9669c00 msgr2=0x5560f9667e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:43.144 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.139+0000 7ff4a21ad800 1 -- 172.21.15.142:0/3455671760 shutdown_connections 2024-09-22T08:36:43.144 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.139+0000 7ff4a21ad800 1 -- 172.21.15.142:0/3455671760 wait complete. 2024-09-22T08:36:43.144 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.139+0000 7ff4a21ad800 1 Processor -- start 2024-09-22T08:36:43.144 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.139+0000 7ff4a21ad800 1 -- start start 2024-09-22T08:36:43.144 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.139+0000 7ff4a21ad800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5560f966d800 0x5560f9674dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:43.145 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.139+0000 7ff4a21ad800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5560f966e810 con 0x5560f966d800 2024-09-22T08:36:43.145 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.139+0000 7ff4a0498640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5560f966d800 0x5560f9674dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:43.145 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.139+0000 7ff4a0498640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5560f966d800 0x5560f9674dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:38142/0 (socket says 172.21.15.142:38142) 2024-09-22T08:36:43.145 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.139+0000 7ff4a0498640 1 -- 172.21.15.142:0/1819734076 learned_addr learned my addr 172.21.15.142:0/1819734076 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:43.145 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.139+0000 7ff4a0498640 1 -- 172.21.15.142:0/1819734076 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5560f9675330 con 0x5560f966d800 2024-09-22T08:36:43.145 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.140+0000 7ff4a0498640 1 --2- 172.21.15.142:0/1819734076 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5560f966d800 0x5560f9674dd0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7ff498020f60 tx=0x7ff498054240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:43.145 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.140+0000 7ff37d7fa640 1 -- 172.21.15.142:0/1819734076 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff4980544b0 con 0x5560f966d800 2024-09-22T08:36:43.145 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.140+0000 7ff37d7fa640 1 -- 172.21.15.142:0/1819734076 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff49802ab00 con 0x5560f966d800 2024-09-22T08:36:43.145 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.140+0000 7ff4a21ad800 1 -- 172.21.15.142:0/1819734076 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5560f96755c0 con 0x5560f966d800 2024-09-22T08:36:43.145 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.140+0000 7ff37d7fa640 1 -- 172.21.15.142:0/1819734076 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff49802ade0 con 0x5560f966d800 2024-09-22T08:36:43.145 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.140+0000 7ff4a21ad800 1 -- 172.21.15.142:0/1819734076 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5560f9675f40 con 0x5560f966d800 2024-09-22T08:36:43.145 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.140+0000 7ff37d7fa640 1 -- 172.21.15.142:0/1819734076 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7ff4980205b0 con 0x5560f966d800 2024-09-22T08:36:43.161 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.141+0000 7ff37d7fa640 1 --2- 172.21.15.142:0/1819734076 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7ff36803d000 0x7ff36803f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:43.161 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.141+0000 7ff37d7fa640 1 -- 172.21.15.142:0/1819734076 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7ff498034af0 con 0x5560f966d800 2024-09-22T08:36:43.161 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.141+0000 7ff49fc97640 1 --2- 172.21.15.142:0/1819734076 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7ff36803d000 0x7ff36803f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:43.161 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.141+0000 7ff4a21ad800 20 rados->read ofs=0 len=0 2024-09-22T08:36:43.161 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.141+0000 7ff4a21ad800 1 --2- 172.21.15.142:0/1819734076 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5560f96807f0 0x5560f9682cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:43.161 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.141+0000 7ff4a21ad800 1 -- 172.21.15.142:0/1819734076 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5560f9683400 con 0x5560f96807f0 2024-09-22T08:36:43.162 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.141+0000 7ff49fc97640 1 --2- 172.21.15.142:0/1819734076 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7ff36803d000 0x7ff36803f4c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff49000e550 tx=0x7ff490016f90 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:43.162 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.141+0000 7ff497496640 1 --2- 172.21.15.142:0/1819734076 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5560f96807f0 0x5560f9682cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:43.162 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.142+0000 7ff497496640 1 --2- 172.21.15.142:0/1819734076 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5560f96807f0 0x5560f9682cb0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:43.162 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.142+0000 7ff497496640 1 -- 172.21.15.142:0/1819734076 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff488051070 con 0x5560f96807f0 2024-09-22T08:36:43.162 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.142+0000 7ff4a21ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:43.162 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.142+0000 7ff4a21ad800 20 realm 2024-09-22T08:36:43.162 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.142+0000 7ff4a21ad800 20 rados->read ofs=0 len=0 2024-09-22T08:36:43.162 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.142+0000 7ff4a21ad800 1 -- 172.21.15.142:0/1819734076 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5560f9683830 con 0x5560f96807f0 2024-09-22T08:36:43.162 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.142+0000 7ff497496640 1 -- 172.21.15.142:0/1819734076 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff488051070 con 0x5560f96807f0 2024-09-22T08:36:43.162 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.142+0000 7ff4a21ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:43.163 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.142+0000 7ff4a21ad800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:36:43.163 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.142+0000 7ff4a21ad800 20 rados->read ofs=0 len=0 2024-09-22T08:36:43.163 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.142+0000 7ff4a21ad800 1 -- 172.21.15.142:0/1819734076 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5560f9684100 con 0x5560f96807f0 2024-09-22T08:36:43.163 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.142+0000 7ff497496640 1 -- 172.21.15.142:0/1819734076 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff488051070 con 0x5560f96807f0 2024-09-22T08:36:43.163 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.142+0000 7ff4a21ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:43.163 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.142+0000 7ff4a21ad800 20 rados->read ofs=0 len=0 2024-09-22T08:36:43.163 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.142+0000 7ff4a21ad800 1 -- 172.21.15.142:0/1819734076 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5560f96844a0 con 0x5560f96807f0 2024-09-22T08:36:43.164 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.142+0000 7ff497496640 1 -- 172.21.15.142:0/1819734076 <== osd.1 v2:172.21.15.142:6816/3192108003 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff488051070 con 0x5560f96807f0 2024-09-22T08:36:43.164 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.142+0000 7ff4a21ad800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:36:43.164 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.142+0000 7ff4a21ad800 20 rados->read ofs=0 len=0 2024-09-22T08:36:43.164 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.142+0000 7ff4a21ad800 1 --2- 172.21.15.142:0/1819734076 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5560f9685200 0x5560f96875f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:43.164 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.142+0000 7ff4a21ad800 1 -- 172.21.15.142:0/1819734076 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5560f9687b30 con 0x5560f9685200 2024-09-22T08:36:43.164 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.143+0000 7ff4a0498640 1 --2- 172.21.15.142:0/1819734076 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5560f9685200 0x5560f96875f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:43.164 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.143+0000 7ff4a0498640 1 --2- 172.21.15.142:0/1819734076 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5560f9685200 0x5560f96875f0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:43.164 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.143+0000 7ff4a0498640 1 -- 172.21.15.142:0/1819734076 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(5 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7ff49800a4d0 con 0x5560f9685200 2024-09-22T08:36:43.164 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.143+0000 7ff4a21ad800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:36:43.165 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.143+0000 7ff4a21ad800 20 searching for the correct realm 2024-09-22T08:36:43.165 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.143+0000 7ff4a21ad800 1 -- 172.21.15.142:0/1819734076 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5560f96894a0 con 0x5560f9685200 2024-09-22T08:36:43.165 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.143+0000 7ff4a0498640 1 -- 172.21.15.142:0/1819734076 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff49800a4d0 con 0x5560f9685200 2024-09-22T08:36:43.165 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.143+0000 7ff4a0498640 1 --2- 172.21.15.142:0/1819734076 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7ff4980208a0 0x7ff498045980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:43.165 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.143+0000 7ff4a0498640 1 -- 172.21.15.142:0/1819734076 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5560f96894a0 con 0x7ff4980208a0 2024-09-22T08:36:43.165 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.143+0000 7ff49fc97640 1 --2- 172.21.15.142:0/1819734076 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7ff4980208a0 0x7ff498045980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:43.165 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.144+0000 7ff49fc97640 1 --2- 172.21.15.142:0/1819734076 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7ff4980208a0 0x7ff498045980 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:43.165 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.144+0000 7ff49fc97640 1 -- 172.21.15.142:0/1819734076 <== osd.2 v2:172.21.15.142:6808/279438927 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff490018ce0 con 0x7ff4980208a0 2024-09-22T08:36:43.165 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.144+0000 7ff49fc97640 1 --2- 172.21.15.142:0/1819734076 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7ff49003a040 0x7ff490051230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:43.165 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.144+0000 7ff49fc97640 1 -- 172.21.15.142:0/1819734076 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5560f96894a0 con 0x7ff49003a040 2024-09-22T08:36:43.165 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.144+0000 7ff497496640 1 --2- 172.21.15.142:0/1819734076 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7ff49003a040 0x7ff490051230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:43.165 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.144+0000 7ff497496640 1 --2- 172.21.15.142:0/1819734076 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7ff49003a040 0x7ff490051230 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:43.165 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.145+0000 7ff497496640 1 -- 172.21.15.142:0/1819734076 <== osd.0 v2:172.21.15.31:6800/168281188 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff488051070 con 0x7ff49003a040 2024-09-22T08:36:43.166 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.145+0000 7ff497496640 1 -- 172.21.15.142:0/1819734076 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5560f96894a0 con 0x5560f96807f0 2024-09-22T08:36:43.166 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.145+0000 7ff497496640 1 -- 172.21.15.142:0/1819734076 <== osd.1 v2:172.21.15.142:6816/3192108003 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff488051070 con 0x5560f96807f0 2024-09-22T08:36:43.166 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.145+0000 7ff497496640 1 -- 172.21.15.142:0/1819734076 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5560f96894a0 con 0x5560f96807f0 2024-09-22T08:36:43.166 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.145+0000 7ff497496640 1 -- 172.21.15.142:0/1819734076 <== osd.1 v2:172.21.15.142:6816/3192108003 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff488051070 con 0x5560f96807f0 2024-09-22T08:36:43.166 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.145+0000 7ff497496640 1 -- 172.21.15.142:0/1819734076 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5560f96894a0 con 0x7ff49003a040 2024-09-22T08:36:43.166 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.145+0000 7ff497496640 1 -- 172.21.15.142:0/1819734076 <== osd.0 v2:172.21.15.31:6800/168281188 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff488051070 con 0x7ff49003a040 2024-09-22T08:36:43.166 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.145+0000 7ff497496640 1 -- 172.21.15.142:0/1819734076 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5560f96894a0 con 0x7ff49003a040 2024-09-22T08:36:43.166 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.146+0000 7ff497496640 1 -- 172.21.15.142:0/1819734076 <== osd.0 v2:172.21.15.31:6800/168281188 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff488051070 con 0x7ff49003a040 2024-09-22T08:36:43.166 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.146+0000 7ff497496640 1 -- 172.21.15.142:0/1819734076 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5560f96894a0 con 0x7ff4980208a0 2024-09-22T08:36:43.166 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.146+0000 7ff49fc97640 1 -- 172.21.15.142:0/1819734076 <== osd.2 v2:172.21.15.142:6808/279438927 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff490018ce0 con 0x7ff4980208a0 2024-09-22T08:36:43.166 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.146+0000 7ff49fc97640 1 -- 172.21.15.142:0/1819734076 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5560f96894a0 con 0x5560f9685200 2024-09-22T08:36:43.166 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.146+0000 7ff4a0498640 1 -- 172.21.15.142:0/1819734076 <== osd.3 v2:172.21.15.142:6800/1064901393 3 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff49800a4d0 con 0x5560f9685200 2024-09-22T08:36:43.166 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.146+0000 7ff4a0498640 1 -- 172.21.15.142:0/1819734076 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5560f96894a0 con 0x5560f96807f0 2024-09-22T08:36:43.166 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.146+0000 7ff497496640 1 -- 172.21.15.142:0/1819734076 <== osd.1 v2:172.21.15.142:6816/3192108003 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff488051070 con 0x5560f96807f0 2024-09-22T08:36:43.167 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.146+0000 7ff497496640 1 -- 172.21.15.142:0/1819734076 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5560f96894a0 con 0x7ff49003a040 2024-09-22T08:36:43.167 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.147+0000 7ff497496640 1 -- 172.21.15.142:0/1819734076 <== osd.0 v2:172.21.15.31:6800/168281188 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff488051070 con 0x7ff49003a040 2024-09-22T08:36:43.167 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.147+0000 7ff497496640 1 -- 172.21.15.142:0/1819734076 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5560f96894a0 con 0x5560f96807f0 2024-09-22T08:36:43.167 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.147+0000 7ff497496640 1 -- 172.21.15.142:0/1819734076 <== osd.1 v2:172.21.15.142:6816/3192108003 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff488051070 con 0x5560f96807f0 2024-09-22T08:36:43.167 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.147+0000 7ff497496640 1 -- 172.21.15.142:0/1819734076 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5560f96894a0 con 0x7ff4980208a0 2024-09-22T08:36:43.167 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.147+0000 7ff49fc97640 1 -- 172.21.15.142:0/1819734076 <== osd.2 v2:172.21.15.142:6808/279438927 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7ff490018ce0 con 0x7ff4980208a0 2024-09-22T08:36:43.167 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.147+0000 7ff49fc97640 1 -- 172.21.15.142:0/1819734076 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5560f96894a0 con 0x5560f9685200 2024-09-22T08:36:43.167 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.147+0000 7ff4a0498640 1 -- 172.21.15.142:0/1819734076 <== osd.3 v2:172.21.15.142:6800/1064901393 4 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff49800a4d0 con 0x5560f9685200 2024-09-22T08:36:43.167 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.147+0000 7ff4a0498640 1 -- 172.21.15.142:0/1819734076 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5560f96894a0 con 0x5560f9685200 2024-09-22T08:36:43.167 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.147+0000 7ff4a0498640 1 -- 172.21.15.142:0/1819734076 <== osd.3 v2:172.21.15.142:6800/1064901393 5 ==== osd_op_reply(20 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7ff49800a4d0 con 0x5560f9685200 2024-09-22T08:36:43.167 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.147+0000 7ff4a0498640 1 -- 172.21.15.142:0/1819734076 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5560f96894a0 con 0x7ff49003a040 2024-09-22T08:36:43.167 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.148+0000 7ff497496640 1 -- 172.21.15.142:0/1819734076 <== osd.0 v2:172.21.15.31:6800/168281188 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff488051070 con 0x7ff49003a040 2024-09-22T08:36:43.167 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.148+0000 7ff497496640 1 -- 172.21.15.142:0/1819734076 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5560f96894a0 con 0x5560f9685200 2024-09-22T08:36:43.167 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.148+0000 7ff4a0498640 1 -- 172.21.15.142:0/1819734076 <== osd.3 v2:172.21.15.142:6800/1064901393 6 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff49800a4d0 con 0x5560f9685200 2024-09-22T08:36:43.168 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.148+0000 7ff4a0498640 1 -- 172.21.15.142:0/1819734076 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5560f96894a0 con 0x5560f9685200 2024-09-22T08:36:43.168 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.148+0000 7ff4a0498640 1 -- 172.21.15.142:0/1819734076 <== osd.3 v2:172.21.15.142:6800/1064901393 7 ==== osd_op_reply(23 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7ff49800a4d0 con 0x5560f9685200 2024-09-22T08:36:43.168 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.148+0000 7ff4a0498640 1 -- 172.21.15.142:0/1819734076 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5560f96894a0 con 0x5560f96807f0 2024-09-22T08:36:43.168 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.148+0000 7ff497496640 1 -- 172.21.15.142:0/1819734076 <== osd.1 v2:172.21.15.142:6816/3192108003 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff488051070 con 0x5560f96807f0 2024-09-22T08:36:43.168 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.148+0000 7ff497496640 1 -- 172.21.15.142:0/1819734076 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5560f96894a0 con 0x5560f96807f0 2024-09-22T08:36:43.168 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.149+0000 7ff497496640 1 -- 172.21.15.142:0/1819734076 <== osd.1 v2:172.21.15.142:6816/3192108003 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7ff488051070 con 0x5560f96807f0 2024-09-22T08:36:43.168 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.149+0000 7ff497496640 1 -- 172.21.15.142:0/1819734076 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5560f96894a0 con 0x7ff49003a040 2024-09-22T08:36:43.168 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.149+0000 7ff497496640 1 -- 172.21.15.142:0/1819734076 <== osd.0 v2:172.21.15.31:6800/168281188 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff488051070 con 0x7ff49003a040 2024-09-22T08:36:43.168 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.149+0000 7ff497496640 1 -- 172.21.15.142:0/1819734076 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5560f96894a0 con 0x5560f9685200 2024-09-22T08:36:43.168 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.149+0000 7ff4a0498640 1 -- 172.21.15.142:0/1819734076 <== osd.3 v2:172.21.15.142:6800/1064901393 8 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff49800a4d0 con 0x5560f9685200 2024-09-22T08:36:43.168 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.149+0000 7ff4a0498640 1 -- 172.21.15.142:0/1819734076 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5560f96894a0 con 0x7ff4980208a0 2024-09-22T08:36:43.168 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.149+0000 7ff49fc97640 1 -- 172.21.15.142:0/1819734076 <== osd.2 v2:172.21.15.142:6808/279438927 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff490018ce0 con 0x7ff4980208a0 2024-09-22T08:36:43.168 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.149+0000 7ff49fc97640 1 -- 172.21.15.142:0/1819734076 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5560f96894a0 con 0x5560f96807f0 2024-09-22T08:36:43.168 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.150+0000 7ff497496640 1 -- 172.21.15.142:0/1819734076 <== osd.1 v2:172.21.15.142:6816/3192108003 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff488051070 con 0x5560f96807f0 2024-09-22T08:36:43.168 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.150+0000 7ff497496640 1 -- 172.21.15.142:0/1819734076 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5560f96894a0 con 0x7ff49003a040 2024-09-22T08:36:43.169 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.150+0000 7ff497496640 1 -- 172.21.15.142:0/1819734076 <== osd.0 v2:172.21.15.31:6800/168281188 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff488051070 con 0x7ff49003a040 2024-09-22T08:36:43.169 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.150+0000 7ff497496640 1 -- 172.21.15.142:0/1819734076 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5560f96894a0 con 0x5560f9685200 2024-09-22T08:36:43.169 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.150+0000 7ff4a0498640 1 -- 172.21.15.142:0/1819734076 <== osd.3 v2:172.21.15.142:6800/1064901393 9 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff49800a4d0 con 0x5560f9685200 2024-09-22T08:36:43.169 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.150+0000 7ff4a0498640 1 -- 172.21.15.142:0/1819734076 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5560f96894a0 con 0x7ff49003a040 2024-09-22T08:36:43.169 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.150+0000 7ff497496640 1 -- 172.21.15.142:0/1819734076 <== osd.0 v2:172.21.15.31:6800/168281188 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff488051070 con 0x7ff49003a040 2024-09-22T08:36:43.169 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.150+0000 7ff497496640 1 -- 172.21.15.142:0/1819734076 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5560f96894a0 con 0x7ff4980208a0 2024-09-22T08:36:43.169 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.151+0000 7ff49fc97640 1 -- 172.21.15.142:0/1819734076 <== osd.2 v2:172.21.15.142:6808/279438927 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff490018ce0 con 0x7ff4980208a0 2024-09-22T08:36:43.169 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.151+0000 7ff49fc97640 1 -- 172.21.15.142:0/1819734076 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5560f96894a0 con 0x5560f9685200 2024-09-22T08:36:43.169 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.151+0000 7ff4a0498640 1 -- 172.21.15.142:0/1819734076 <== osd.3 v2:172.21.15.142:6800/1064901393 10 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff49800a4d0 con 0x5560f9685200 2024-09-22T08:36:43.169 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.151+0000 7ff4a0498640 1 -- 172.21.15.142:0/1819734076 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5560f96894a0 con 0x7ff49003a040 2024-09-22T08:36:43.169 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.151+0000 7ff497496640 1 -- 172.21.15.142:0/1819734076 <== osd.0 v2:172.21.15.31:6800/168281188 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff488051070 con 0x7ff49003a040 2024-09-22T08:36:43.169 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.151+0000 7ff497496640 1 -- 172.21.15.142:0/1819734076 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5560f96894a0 con 0x5560f96807f0 2024-09-22T08:36:43.169 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.151+0000 7ff497496640 1 -- 172.21.15.142:0/1819734076 <== osd.1 v2:172.21.15.142:6816/3192108003 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7ff488051070 con 0x5560f96807f0 2024-09-22T08:36:43.169 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.151+0000 7ff497496640 1 -- 172.21.15.142:0/1819734076 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5560f96894a0 con 0x7ff4980208a0 2024-09-22T08:36:43.170 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.152+0000 7ff49fc97640 1 -- 172.21.15.142:0/1819734076 <== osd.2 v2:172.21.15.142:6808/279438927 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff490018ce0 con 0x7ff4980208a0 2024-09-22T08:36:43.170 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.152+0000 7ff4a21ad800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:36:43.170 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.152+0000 7ff4a21ad800 20 RGWRados::pool_iterate: got zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec 2024-09-22T08:36:43.170 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.152+0000 7ff4a21ad800 20 RGWRados::pool_iterate: got zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f 2024-09-22T08:36:43.170 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.152+0000 7ff4a21ad800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:36:43.170 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.152+0000 7ff4a21ad800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:36:43.170 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.152+0000 7ff4a21ad800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:36:43.170 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.152+0000 7ff4a21ad800 20 rados->read ofs=0 len=0 2024-09-22T08:36:43.170 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.152+0000 7ff4a21ad800 1 -- 172.21.15.142:0/1819734076 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5560f96885a0 con 0x5560f96807f0 2024-09-22T08:36:43.170 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.152+0000 7ff497496640 1 -- 172.21.15.142:0/1819734076 <== osd.1 v2:172.21.15.142:6816/3192108003 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff488051070 con 0x5560f96807f0 2024-09-22T08:36:43.170 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.152+0000 7ff4a21ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:43.170 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.152+0000 7ff4a21ad800 20 rados->read ofs=0 len=0 2024-09-22T08:36:43.170 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.152+0000 7ff4a21ad800 1 -- 172.21.15.142:0/1819734076 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5560f9688e40 con 0x5560f96807f0 2024-09-22T08:36:43.171 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.152+0000 7ff497496640 1 -- 172.21.15.142:0/1819734076 <== osd.1 v2:172.21.15.142:6816/3192108003 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff488051070 con 0x5560f96807f0 2024-09-22T08:36:43.171 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.152+0000 7ff4a21ad800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:36:43.171 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.152+0000 7ff4a21ad800 20 rados->read ofs=0 len=0 2024-09-22T08:36:43.171 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.152+0000 7ff4a21ad800 1 -- 172.21.15.142:0/1819734076 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:40 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5560f96881e0 con 0x5560f9685200 2024-09-22T08:36:43.171 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.152+0000 7ff4a0498640 1 -- 172.21.15.142:0/1819734076 <== osd.3 v2:172.21.15.142:6800/1064901393 11 ==== osd_op_reply(40 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7ff49800a4d0 con 0x5560f9685200 2024-09-22T08:36:43.171 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.152+0000 7ff4a21ad800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:36:43.171 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.152+0000 7ff4a21ad800 20 zone default found 2024-09-22T08:36:43.171 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.152+0000 7ff4a21ad800 4 Realm: () 2024-09-22T08:36:43.171 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.152+0000 7ff4a21ad800 4 ZoneGroup: default (d89f6f57-1007-47dd-9065-f486c7b01aec) 2024-09-22T08:36:43.171 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.152+0000 7ff4a21ad800 4 Zone: default (e239248c-0bee-4e41-803a-24b288d3eb8f) 2024-09-22T08:36:43.171 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.152+0000 7ff4a21ad800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:36:43.171 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.152+0000 7ff4a21ad800 20 zonegroup default 2024-09-22T08:36:43.171 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.152+0000 7ff4a21ad800 20 rados->read ofs=0 len=0 2024-09-22T08:36:43.171 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.152+0000 7ff4a21ad800 1 -- 172.21.15.142:0/1819734076 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5560f9688a90 con 0x7ff49003a040 2024-09-22T08:36:43.172 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.153+0000 7ff497496640 1 -- 172.21.15.142:0/1819734076 <== osd.0 v2:172.21.15.31:6800/168281188 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7ff488051070 con 0x7ff49003a040 2024-09-22T08:36:43.172 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.153+0000 7ff4a21ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:43.172 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.153+0000 7ff4a21ad800 20 rados->read ofs=0 len=0 2024-09-22T08:36:43.172 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.153+0000 7ff4a21ad800 1 -- 172.21.15.142:0/1819734076 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5560f968bd60 con 0x5560f9685200 2024-09-22T08:36:43.172 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.153+0000 7ff4a0498640 1 -- 172.21.15.142:0/1819734076 <== osd.3 v2:172.21.15.142:6800/1064901393 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff49800a4d0 con 0x5560f9685200 2024-09-22T08:36:43.172 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.153+0000 7ff4a21ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:43.172 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.153+0000 7ff4a21ad800 20 rados->read ofs=0 len=0 2024-09-22T08:36:43.172 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.153+0000 7ff4a21ad800 1 -- 172.21.15.142:0/1819734076 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5560f968c100 con 0x5560f9685200 2024-09-22T08:36:43.172 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.153+0000 7ff4a0498640 1 -- 172.21.15.142:0/1819734076 <== osd.3 v2:172.21.15.142:6800/1064901393 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff49800a4d0 con 0x5560f9685200 2024-09-22T08:36:43.172 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.153+0000 7ff4a21ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:43.172 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.153+0000 7ff4a21ad800 20 started sync module instance, tier type = 2024-09-22T08:36:43.172 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.153+0000 7ff4a21ad800 20 started zone id=e239248c-0bee-4e41-803a-24b288d3eb8f (name=default) with tier type = 2024-09-22T08:36:43.172 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.153+0000 7ff4a21ad800 1 -- 172.21.15.142:0/1819734076 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5560f968b1f0 con 0x7ff4980208a0 2024-09-22T08:36:43.173 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.154+0000 7ff49fc97640 1 -- 172.21.15.142:0/1819734076 <== osd.2 v2:172.21.15.142:6808/279438927 7 ==== osd_op_reply(44 notify.0 [create] v30'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff490018ce0 con 0x7ff4980208a0 2024-09-22T08:36:43.173 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.154+0000 7ff4a21ad800 1 -- 172.21.15.142:0/1819734076 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93874989610512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5560f968ca10 con 0x7ff4980208a0 2024-09-22T08:36:43.173 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.154+0000 7ff4a21ad800 1 -- 172.21.15.142:0/1819734076 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5560f968d260 con 0x5560f96807f0 2024-09-22T08:36:43.173 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.155+0000 7ff49fc97640 1 -- 172.21.15.142:0/1819734076 <== osd.2 v2:172.21.15.142:6808/279438927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93874989610512] v30'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff490018ce0 con 0x7ff4980208a0 2024-09-22T08:36:43.173 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.155+0000 7ff497496640 1 -- 172.21.15.142:0/1819734076 <== osd.1 v2:172.21.15.142:6816/3192108003 15 ==== osd_op_reply(46 notify.1 [create] v30'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff488051070 con 0x5560f96807f0 2024-09-22T08:36:43.173 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.155+0000 7ff4a21ad800 1 -- 172.21.15.142:0/1819734076 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93874989616560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5560f968d6c0 con 0x5560f96807f0 2024-09-22T08:36:43.173 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.155+0000 7ff4a21ad800 1 -- 172.21.15.142:0/1819734076 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5560f968e190 con 0x5560f9685200 2024-09-22T08:36:43.173 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.156+0000 7ff497496640 1 -- 172.21.15.142:0/1819734076 <== osd.1 v2:172.21.15.142:6816/3192108003 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93874989616560] v30'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff488051070 con 0x5560f96807f0 2024-09-22T08:36:43.173 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.156+0000 7ff4a0498640 1 -- 172.21.15.142:0/1819734076 <== osd.3 v2:172.21.15.142:6800/1064901393 14 ==== osd_op_reply(48 notify.2 [create] v30'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff49800a4d0 con 0x5560f9685200 2024-09-22T08:36:43.173 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.156+0000 7ff4a21ad800 1 -- 172.21.15.142:0/1819734076 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93874989620352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5560f968e530 con 0x5560f9685200 2024-09-22T08:36:43.173 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.156+0000 7ff4a21ad800 1 -- 172.21.15.142:0/1819734076 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5560f968efd0 con 0x7ff4980208a0 2024-09-22T08:36:43.173 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.157+0000 7ff49fc97640 1 -- 172.21.15.142:0/1819734076 <== osd.2 v2:172.21.15.142:6808/279438927 9 ==== osd_op_reply(50 notify.3 [create] v30'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff490018ce0 con 0x7ff4980208a0 2024-09-22T08:36:43.173 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.157+0000 7ff4a21ad800 1 -- 172.21.15.142:0/1819734076 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93874989624000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5560f968f860 con 0x7ff4980208a0 2024-09-22T08:36:43.173 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.158+0000 7ff4a0498640 1 -- 172.21.15.142:0/1819734076 <== osd.3 v2:172.21.15.142:6800/1064901393 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 93874989620352] v30'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff49800a4d0 con 0x5560f9685200 2024-09-22T08:36:43.174 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.158+0000 7ff4a21ad800 1 -- 172.21.15.142:0/1819734076 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5560f9690340 con 0x5560f96807f0 2024-09-22T08:36:43.174 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.158+0000 7ff497496640 1 -- 172.21.15.142:0/1819734076 <== osd.1 v2:172.21.15.142:6816/3192108003 17 ==== osd_op_reply(52 notify.4 [create] v30'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff488051070 con 0x5560f96807f0 2024-09-22T08:36:43.174 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.158+0000 7ff4a21ad800 1 -- 172.21.15.142:0/1819734076 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93874989614432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5560f9690760 con 0x5560f96807f0 2024-09-22T08:36:43.174 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.159+0000 7ff4a21ad800 1 -- 172.21.15.142:0/1819734076 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5560f96911b0 con 0x7ff49003a040 2024-09-22T08:36:43.174 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.159+0000 7ff49fc97640 1 -- 172.21.15.142:0/1819734076 <== osd.2 v2:172.21.15.142:6808/279438927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93874989624000] v30'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff490018ce0 con 0x7ff4980208a0 2024-09-22T08:36:43.174 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.159+0000 7ff497496640 1 -- 172.21.15.142:0/1819734076 <== osd.0 v2:172.21.15.31:6800/168281188 11 ==== osd_op_reply(54 notify.5 [create] v30'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff488051070 con 0x7ff49003a040 2024-09-22T08:36:43.174 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.159+0000 7ff4a21ad800 1 -- 172.21.15.142:0/1819734076 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93874989632672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5560f9691170 con 0x7ff49003a040 2024-09-22T08:36:43.174 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.159+0000 7ff4a21ad800 1 -- 172.21.15.142:0/1819734076 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5560f9691bf0 con 0x7ff49003a040 2024-09-22T08:36:43.174 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.160+0000 7ff497496640 1 -- 172.21.15.142:0/1819734076 <== osd.1 v2:172.21.15.142:6816/3192108003 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93874989614432] v30'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff488051070 con 0x5560f96807f0 2024-09-22T08:36:43.177 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.160+0000 7ff497496640 1 -- 172.21.15.142:0/1819734076 <== osd.0 v2:172.21.15.31:6800/168281188 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93874989632672] v30'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff488051070 con 0x7ff49003a040 2024-09-22T08:36:43.177 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.160+0000 7ff497496640 1 -- 172.21.15.142:0/1819734076 <== osd.0 v2:172.21.15.31:6800/168281188 13 ==== osd_op_reply(56 notify.6 [create] v30'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff488051070 con 0x7ff49003a040 2024-09-22T08:36:43.177 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.160+0000 7ff4a21ad800 1 -- 172.21.15.142:0/1819734076 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93874989626224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5560f968fe50 con 0x7ff49003a040 2024-09-22T08:36:43.177 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.160+0000 7ff4a21ad800 1 -- 172.21.15.142:0/1819734076 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5560f96920a0 con 0x7ff49003a040 2024-09-22T08:36:43.177 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.161+0000 7ff497496640 1 -- 172.21.15.142:0/1819734076 <== osd.0 v2:172.21.15.31:6800/168281188 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93874989626224] v30'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff488051070 con 0x7ff49003a040 2024-09-22T08:36:43.177 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.162+0000 7ff497496640 1 -- 172.21.15.142:0/1819734076 <== osd.0 v2:172.21.15.31:6800/168281188 15 ==== osd_op_reply(58 notify.7 [create] v30'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff488051070 con 0x7ff49003a040 2024-09-22T08:36:43.177 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.162+0000 7ff4a21ad800 1 -- 172.21.15.142:0/1819734076 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93874989635328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5560f96920a0 con 0x7ff49003a040 2024-09-22T08:36:43.177 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.162+0000 7ff4a21ad800 20 add_watcher() i=0 2024-09-22T08:36:43.177 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.162+0000 7ff4a21ad800 20 add_watcher() i=1 2024-09-22T08:36:43.177 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.162+0000 7ff4a21ad800 20 add_watcher() i=2 2024-09-22T08:36:43.177 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.162+0000 7ff4a21ad800 20 add_watcher() i=3 2024-09-22T08:36:43.178 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.162+0000 7ff4a21ad800 20 add_watcher() i=4 2024-09-22T08:36:43.178 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.162+0000 7ff4a21ad800 20 add_watcher() i=5 2024-09-22T08:36:43.178 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.162+0000 7ff4a21ad800 20 add_watcher() i=6 2024-09-22T08:36:43.178 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.163+0000 7ff497496640 1 -- 172.21.15.142:0/1819734076 <== osd.0 v2:172.21.15.31:6800/168281188 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93874989635328] v30'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff488051070 con 0x7ff49003a040 2024-09-22T08:36:43.178 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.163+0000 7ff4a21ad800 20 add_watcher() i=7 2024-09-22T08:36:43.178 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.163+0000 7ff4a21ad800 2 all 8 watchers are set, enabling cache 2024-09-22T08:36:43.178 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.163+0000 7ff4a21ad800 1 -- 172.21.15.142:0/1819734076 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5560f9695580 con 0x5560f96807f0 2024-09-22T08:36:43.178 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.164+0000 7ff497496640 1 -- 172.21.15.142:0/1819734076 <== osd.1 v2:172.21.15.142:6816/3192108003 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7ff488051070 con 0x5560f96807f0 2024-09-22T08:36:43.178 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.164+0000 7ff4a21ad800 1 -- 172.21.15.142:0/1819734076 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93874989637520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5560f9692860 con 0x5560f96807f0 2024-09-22T08:36:43.178 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.165+0000 7ff497496640 1 -- 172.21.15.142:0/1819734076 <== osd.1 v2:172.21.15.142:6816/3192108003 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93874989637520] v30'58 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff488051070 con 0x5560f96807f0 2024-09-22T08:36:43.178 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.165+0000 7ff355fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:36:43.178 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.165+0000 7ff4a21ad800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:36:43.178 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.165+0000 7ff4a21ad800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:36:43.178 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.165+0000 7ff4a21ad800 5 note: GC not initialized 2024-09-22T08:36:43.179 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.165+0000 7ff354fe1640 20 reqs_thread_entry: start 2024-09-22T08:36:43.179 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.165+0000 7ff4a21ad800 20 init_complete bucket index max shards: 11 2024-09-22T08:36:43.179 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.165+0000 7ff4a21ad800 20 Filter name: none 2024-09-22T08:36:43.179 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.165+0000 7ff2ce7fc640 20 reqs_thread_entry: start 2024-09-22T08:36:43.179 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.166+0000 7ff4a21ad800 20 rados->read ofs=0 len=0 2024-09-22T08:36:43.179 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.166+0000 7ff4a21ad800 1 -- 172.21.15.142:0/1819734076 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5560f96c84b0 con 0x5560f96807f0 2024-09-22T08:36:43.179 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.166+0000 7ff497496640 1 -- 172.21.15.142:0/1819734076 <== osd.1 v2:172.21.15.142:6816/3192108003 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv2 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7ff488051070 con 0x5560f96807f0 2024-09-22T08:36:43.179 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.166+0000 7ff4a21ad800 20 rados_obj.operate() r=0 bl.length=391 2024-09-22T08:36:43.179 INFO:teuthology.orchestra.run.smithi142.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":1,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-22T08:36:42.661297Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-22T08:36:42.661288Z","tags":[],"group_ids":[]} 2024-09-22T08:36:43.184 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.167+0000 7ff355fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:36:43.184 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.167+0000 7ff4a21ad800 1 -- 172.21.15.142:0/1819734076 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93874989637520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5560f9694250 con 0x5560f96807f0 2024-09-22T08:36:43.184 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.168+0000 7ff497496640 1 -- 172.21.15.142:0/1819734076 <== osd.1 v2:172.21.15.142:6816/3192108003 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 93874989637520] v30'59 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff488051070 con 0x5560f96807f0 2024-09-22T08:36:43.184 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.168+0000 7ff4a21ad800 1 -- 172.21.15.142:0/1819734076 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93874989610512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5560f9691f90 con 0x7ff4980208a0 2024-09-22T08:36:43.184 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.169+0000 7ff49fc97640 1 -- 172.21.15.142:0/1819734076 <== osd.2 v2:172.21.15.142:6808/279438927 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 93874989610512] v30'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff490018ce0 con 0x7ff4980208a0 2024-09-22T08:36:43.184 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.169+0000 7ff4a21ad800 20 remove_watcher() i=0 2024-09-22T08:36:43.184 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.169+0000 7ff4a21ad800 2 removed watcher, disabling cache 2024-09-22T08:36:43.184 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.169+0000 7ff4a21ad800 1 -- 172.21.15.142:0/1819734076 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93874989616560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5560f9691f90 con 0x5560f96807f0 2024-09-22T08:36:43.184 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.170+0000 7ff497496640 1 -- 172.21.15.142:0/1819734076 <== osd.1 v2:172.21.15.142:6816/3192108003 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 93874989616560] v30'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff488051070 con 0x5560f96807f0 2024-09-22T08:36:43.185 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.170+0000 7ff4a21ad800 20 remove_watcher() i=1 2024-09-22T08:36:43.185 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.170+0000 7ff4a21ad800 1 -- 172.21.15.142:0/1819734076 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93874989620352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5560f968cdb0 con 0x5560f9685200 2024-09-22T08:36:43.185 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.171+0000 7ff4a0498640 1 -- 172.21.15.142:0/1819734076 <== osd.3 v2:172.21.15.142:6800/1064901393 16 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 93874989620352] v30'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff49800a4d0 con 0x5560f9685200 2024-09-22T08:36:43.185 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.171+0000 7ff4a21ad800 20 remove_watcher() i=2 2024-09-22T08:36:43.185 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.171+0000 7ff4a21ad800 1 -- 172.21.15.142:0/1819734076 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93874989624000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5560f9691f90 con 0x7ff4980208a0 2024-09-22T08:36:43.185 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.172+0000 7ff49fc97640 1 -- 172.21.15.142:0/1819734076 <== osd.2 v2:172.21.15.142:6808/279438927 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 93874989624000] v30'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff490018ce0 con 0x7ff4980208a0 2024-09-22T08:36:43.185 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.172+0000 7ff4a21ad800 20 remove_watcher() i=3 2024-09-22T08:36:43.185 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.172+0000 7ff4a21ad800 1 -- 172.21.15.142:0/1819734076 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93874989614432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5560f968dc80 con 0x5560f96807f0 2024-09-22T08:36:43.185 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.173+0000 7ff497496640 1 -- 172.21.15.142:0/1819734076 <== osd.1 v2:172.21.15.142:6816/3192108003 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 93874989614432] v30'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff488051070 con 0x5560f96807f0 2024-09-22T08:36:43.185 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.173+0000 7ff4a21ad800 20 remove_watcher() i=4 2024-09-22T08:36:43.185 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.173+0000 7ff4a21ad800 1 -- 172.21.15.142:0/1819734076 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93874989632672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5560f968eac0 con 0x7ff49003a040 2024-09-22T08:36:43.185 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.174+0000 7ff497496640 1 -- 172.21.15.142:0/1819734076 <== osd.0 v2:172.21.15.31:6800/168281188 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 93874989632672] v30'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff488051070 con 0x7ff49003a040 2024-09-22T08:36:43.185 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.174+0000 7ff4a21ad800 20 remove_watcher() i=5 2024-09-22T08:36:43.186 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.174+0000 7ff4a21ad800 1 -- 172.21.15.142:0/1819734076 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93874989626224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5560f9691f90 con 0x7ff49003a040 2024-09-22T08:36:43.186 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.175+0000 7ff497496640 1 -- 172.21.15.142:0/1819734076 <== osd.0 v2:172.21.15.31:6800/168281188 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 93874989626224] v30'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff488051070 con 0x7ff49003a040 2024-09-22T08:36:43.186 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.175+0000 7ff4a21ad800 20 remove_watcher() i=6 2024-09-22T08:36:43.186 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.175+0000 7ff4a21ad800 1 -- 172.21.15.142:0/1819734076 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93874989635328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5560f968c560 con 0x7ff49003a040 2024-09-22T08:36:43.186 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.176+0000 7ff497496640 1 -- 172.21.15.142:0/1819734076 <== osd.0 v2:172.21.15.31:6800/168281188 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 93874989635328] v30'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff488051070 con 0x7ff49003a040 2024-09-22T08:36:43.186 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.176+0000 7ff4a21ad800 20 remove_watcher() i=7 2024-09-22T08:36:43.186 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.176+0000 7ff4a21ad800 1 -- 172.21.15.142:0/1819734076 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7ff49003a040 msgr2=0x7ff490051230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:43.186 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.176+0000 7ff4a21ad800 1 --2- 172.21.15.142:0/1819734076 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7ff49003a040 0x7ff490051230 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:43.186 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.176+0000 7ff4a21ad800 1 -- 172.21.15.142:0/1819734076 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5560f96807f0 msgr2=0x5560f9682cb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:43.186 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.176+0000 7ff4a21ad800 1 --2- 172.21.15.142:0/1819734076 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5560f96807f0 0x5560f9682cb0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:43.186 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.176+0000 7ff4a21ad800 1 -- 172.21.15.142:0/1819734076 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7ff4980208a0 msgr2=0x7ff498045980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:43.186 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.176+0000 7ff4a21ad800 1 --2- 172.21.15.142:0/1819734076 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7ff4980208a0 0x7ff498045980 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:43.186 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.176+0000 7ff4a21ad800 1 -- 172.21.15.142:0/1819734076 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5560f9685200 msgr2=0x5560f96875f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:43.187 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.176+0000 7ff4a21ad800 1 --2- 172.21.15.142:0/1819734076 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5560f9685200 0x5560f96875f0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:43.187 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.176+0000 7ff4a21ad800 1 -- 172.21.15.142:0/1819734076 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7ff36803d000 msgr2=0x7ff36803f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:43.187 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.176+0000 7ff4a21ad800 1 --2- 172.21.15.142:0/1819734076 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7ff36803d000 0x7ff36803f4c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff49000e550 tx=0x7ff490016f90 comp rx=0 tx=0).stop 2024-09-22T08:36:43.187 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.176+0000 7ff4a21ad800 1 -- 172.21.15.142:0/1819734076 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5560f966d800 msgr2=0x5560f9674dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:43.187 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.176+0000 7ff497496640 1 -- 172.21.15.142:0/1819734076 reap_dead start 2024-09-22T08:36:43.187 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.176+0000 7ff4a21ad800 1 --2- 172.21.15.142:0/1819734076 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5560f966d800 0x5560f9674dd0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7ff498020f60 tx=0x7ff498054240 comp rx=0 tx=0).stop 2024-09-22T08:36:43.187 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.176+0000 7ff4a21ad800 1 -- 172.21.15.142:0/1819734076 shutdown_connections 2024-09-22T08:36:43.187 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.176+0000 7ff4a21ad800 1 --2- 172.21.15.142:0/1819734076 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5560f966d800 0x5560f9674dd0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:43.187 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.176+0000 7ff4a21ad800 1 -- 172.21.15.142:0/1819734076 >> 172.21.15.142:0/1819734076 conn(0x5560f9669c00 msgr2=0x5560f9667e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:43.187 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.176+0000 7ff4a21ad800 1 -- 172.21.15.142:0/1819734076 shutdown_connections 2024-09-22T08:36:43.187 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.176+0000 7ff4a21ad800 1 -- 172.21.15.142:0/1819734076 wait complete. 2024-09-22T08:36:43.187 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.176+0000 7ff4a21ad800 1 -- 172.21.15.142:0/10771797 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7ff37803cfb0 msgr2=0x7ff37803f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:43.187 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.176+0000 7ff4a21ad800 1 --2- 172.21.15.142:0/10771797 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7ff37803cfb0 0x7ff37803f470 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x5560f964b810 tx=0x7ff490052a20 comp rx=0 tx=0).stop 2024-09-22T08:36:43.187 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.176+0000 7ff4a21ad800 1 -- 172.21.15.142:0/10771797 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5560f954d0e0 msgr2=0x5560f954b950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:43.188 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.176+0000 7ff4a21ad800 1 --2- 172.21.15.142:0/10771797 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5560f954d0e0 0x5560f954b950 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x5560f96449e0 tx=0x7ff498018c80 comp rx=0 tx=0).stop 2024-09-22T08:36:43.188 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.177+0000 7ff4a21ad800 1 -- 172.21.15.142:0/10771797 shutdown_connections 2024-09-22T08:36:43.188 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.177+0000 7ff4a21ad800 1 --2- 172.21.15.142:0/10771797 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7ff37803cfb0 0x7ff37803f470 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:43.188 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.177+0000 7ff4a21ad800 1 --2- 172.21.15.142:0/10771797 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5560f954d0e0 0x5560f954b950 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:43.188 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.177+0000 7ff4a21ad800 1 -- 172.21.15.142:0/10771797 >> 172.21.15.142:0/10771797 conn(0x5560f9652ea0 msgr2=0x5560f9653280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:43.188 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.177+0000 7ff4a21ad800 1 -- 172.21.15.142:0/10771797 shutdown_connections 2024-09-22T08:36:43.188 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.177+0000 7ff4a21ad800 1 -- 172.21.15.142:0/10771797 wait complete. 2024-09-22T08:36:43.188 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.177+0000 7ff4a21ad800 1 -- 172.21.15.142:0/2476017085 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5560f95509f0 msgr2=0x5560f964b1a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:43.188 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.177+0000 7ff4a21ad800 1 --2- 172.21.15.142:0/2476017085 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5560f95509f0 0x5560f964b1a0 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:43.188 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.177+0000 7ff4a21ad800 1 -- 172.21.15.142:0/2476017085 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5560f964d690 msgr2=0x5560f964fa80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:43.188 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.177+0000 7ff4a21ad800 1 --2- 172.21.15.142:0/2476017085 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5560f964d690 0x5560f964fa80 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:43.188 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.177+0000 7ff4a21ad800 1 -- 172.21.15.142:0/2476017085 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7ff38803d000 msgr2=0x7ff38803f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:43.188 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.177+0000 7ff4a21ad800 1 --2- 172.21.15.142:0/2476017085 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7ff38803d000 0x7ff38803f4c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff488057000 tx=0x7ff488052000 comp rx=0 tx=0).stop 2024-09-22T08:36:43.188 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.177+0000 7ff4a21ad800 1 -- 172.21.15.142:0/2476017085 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5560f954aa40 msgr2=0x5560f9643b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:43.189 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.177+0000 7ff4a21ad800 1 --2- 172.21.15.142:0/2476017085 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5560f954aa40 0x5560f9643b50 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7ff4900012b0 tx=0x7ff490000ed0 comp rx=0 tx=0).stop 2024-09-22T08:36:43.189 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.177+0000 7ff4a21ad800 1 -- 172.21.15.142:0/2476017085 shutdown_connections 2024-09-22T08:36:43.189 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.177+0000 7ff4a21ad800 1 --2- 172.21.15.142:0/2476017085 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5560f964d690 0x5560f964fa80 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:43.189 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.177+0000 7ff4a21ad800 1 --2- 172.21.15.142:0/2476017085 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5560f95509f0 0x5560f964b1a0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:43.189 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.177+0000 7ff4a21ad800 1 --2- 172.21.15.142:0/2476017085 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7ff38803d000 0x7ff38803f4c0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:43.189 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.177+0000 7ff4a21ad800 1 --2- 172.21.15.142:0/2476017085 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5560f954aa40 0x5560f9643b50 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:43.189 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.177+0000 7ff4a21ad800 1 -- 172.21.15.142:0/2476017085 >> 172.21.15.142:0/2476017085 conn(0x5560f9546310 msgr2=0x5560f963d520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:43.189 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.177+0000 7ff4a21ad800 1 -- 172.21.15.142:0/2476017085 shutdown_connections 2024-09-22T08:36:43.189 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.177+0000 7ff4a21ad800 1 -- 172.21.15.142:0/2476017085 wait complete. 2024-09-22T08:36:43.190 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-22T08:36:42.661297Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-22T08:36:42.661288Z', 'tags': [], 'group_ids': []} 2024-09-22T08:36:43.190 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'enable', '--uid', 'foo'] 2024-09-22T08:36:43.190 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'enable', '--uid', 'foo'] 2024-09-22T08:36:43.190 DEBUG:teuthology.orchestra.run.smithi142:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user enable --uid foo 2024-09-22T08:36:43.235 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:36:43.235 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:36:43.236 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.234+0000 7fc29551f800 1 Processor -- start 2024-09-22T08:36:43.237 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.234+0000 7fc29551f800 1 -- start start 2024-09-22T08:36:43.237 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.234+0000 7fc29551f800 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55d96dd92c00 0x55d96dd950a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:43.237 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.234+0000 7fc29551f800 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55d96dc17a20 con 0x55d96dcffd30 2024-09-22T08:36:43.237 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.234+0000 7fc29551f800 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x55d96dc177d0 con 0x55d96dd92c00 2024-09-22T08:36:43.237 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.235+0000 7fc290aa1640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55d96dd92c00 0x55d96dd950a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:43.237 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.235+0000 7fc2912a2640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x55d96dcffd30 0x55d96dd91480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.142:42336/0 (socket says 172.21.15.142:42336) 2024-09-22T08:36:43.237 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.235+0000 7fc2912a2640 1 -- 172.21.15.142:0/679337525 learned_addr learned my addr 172.21.15.142:0/679337525 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-09-22T08:36:43.237 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.235+0000 7fc290aa1640 1 -- 172.21.15.142:0/679337525 >> v1:172.21.15.31:6789/0 conn(0x55d96dcffd30 legacy=0x55d96dd91480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:43.237 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.235+0000 7fc290aa1640 1 -- 172.21.15.142:0/679337525 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d96dd96780 con 0x55d96dd92c00 2024-09-22T08:36:43.238 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.237+0000 7fc290aa1640 1 --2- 172.21.15.142:0/679337525 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d96dd92c00 0x55d96dd950a0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fc27c00a470 tx=0x7fc27c045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8cfe4016dc80b68 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:43.238 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.237+0000 7fc28bfff640 1 -- 172.21.15.142:0/679337525 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc27c053570 con 0x55d96dd92c00 2024-09-22T08:36:43.238 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.237+0000 7fc28bfff640 1 -- 172.21.15.142:0/679337525 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc27c058070 con 0x55d96dd92c00 2024-09-22T08:36:43.238 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.237+0000 7fc28bfff640 1 -- 172.21.15.142:0/679337525 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc27c053880 con 0x55d96dd92c00 2024-09-22T08:36:43.239 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.237+0000 7fc29551f800 1 -- 172.21.15.142:0/679337525 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d96dd92c00 msgr2=0x55d96dd950a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:43.239 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.237+0000 7fc29551f800 1 --2- 172.21.15.142:0/679337525 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d96dd92c00 0x55d96dd950a0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fc27c00a470 tx=0x7fc27c045a20 comp rx=0 tx=0).stop 2024-09-22T08:36:43.239 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.237+0000 7fc29551f800 1 -- 172.21.15.142:0/679337525 shutdown_connections 2024-09-22T08:36:43.239 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.237+0000 7fc29551f800 1 --2- 172.21.15.142:0/679337525 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d96dd92c00 0x55d96dd950a0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:43.239 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.237+0000 7fc29551f800 1 -- 172.21.15.142:0/679337525 >> 172.21.15.142:0/679337525 conn(0x55d96dd86bb0 msgr2=0x55d96dd89010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:43.239 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.237+0000 7fc29551f800 1 -- 172.21.15.142:0/679337525 shutdown_connections 2024-09-22T08:36:43.240 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.237+0000 7fc29551f800 1 -- 172.21.15.142:0/679337525 wait complete. 2024-09-22T08:36:43.252 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.251+0000 7fc29551f800 1 Processor -- start 2024-09-22T08:36:43.253 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.251+0000 7fc29551f800 1 -- start start 2024-09-22T08:36:43.253 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.251+0000 7fc29551f800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d96dcffd30 0x55d96de7e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:43.253 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.251+0000 7fc29551f800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55d96dc24dd0 con 0x55d96dcffd30 2024-09-22T08:36:43.253 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.252+0000 7fc2912a2640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d96dcffd30 0x55d96de7e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:43.253 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.252+0000 7fc2912a2640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d96dcffd30 0x55d96de7e220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:38158/0 (socket says 172.21.15.142:38158) 2024-09-22T08:36:43.253 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.252+0000 7fc2912a2640 1 -- 172.21.15.142:0/1886192722 learned_addr learned my addr 172.21.15.142:0/1886192722 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:43.255 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.252+0000 7fc2912a2640 1 -- 172.21.15.142:0/1886192722 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d96de7e810 con 0x55d96dcffd30 2024-09-22T08:36:43.256 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.252+0000 7fc2912a2640 1 --2- 172.21.15.142:0/1886192722 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d96dcffd30 0x55d96de7e220 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fc284001800 tx=0x7fc284001cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc110b5255bbef92 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:43.256 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.252+0000 7fc17f606640 1 -- 172.21.15.142:0/1886192722 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc284004520 con 0x55d96dcffd30 2024-09-22T08:36:43.256 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.252+0000 7fc17f606640 1 -- 172.21.15.142:0/1886192722 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2840046c0 con 0x55d96dcffd30 2024-09-22T08:36:43.256 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.252+0000 7fc17f606640 1 -- 172.21.15.142:0/1886192722 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2840049e0 con 0x55d96dcffd30 2024-09-22T08:36:43.256 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.253+0000 7fc29551f800 1 -- 172.21.15.142:0/1886192722 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d96dcffd30 msgr2=0x55d96de7e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:43.256 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.253+0000 7fc29551f800 1 --2- 172.21.15.142:0/1886192722 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d96dcffd30 0x55d96de7e220 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fc284001800 tx=0x7fc284001cc0 comp rx=0 tx=0).stop 2024-09-22T08:36:43.256 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.253+0000 7fc29551f800 1 -- 172.21.15.142:0/1886192722 shutdown_connections 2024-09-22T08:36:43.256 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.253+0000 7fc29551f800 1 --2- 172.21.15.142:0/1886192722 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d96dcffd30 0x55d96de7e220 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:43.256 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.253+0000 7fc29551f800 1 -- 172.21.15.142:0/1886192722 >> 172.21.15.142:0/1886192722 conn(0x55d96dd86bb0 msgr2=0x55d96de79ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:43.256 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.253+0000 7fc29551f800 1 -- 172.21.15.142:0/1886192722 shutdown_connections 2024-09-22T08:36:43.256 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.253+0000 7fc29551f800 1 -- 172.21.15.142:0/1886192722 wait complete. 2024-09-22T08:36:43.256 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.253+0000 7fc29551f800 1 Processor -- start 2024-09-22T08:36:43.257 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.253+0000 7fc29551f800 1 -- start start 2024-09-22T08:36:43.257 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.253+0000 7fc29551f800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d96dcffd30 0x55d96de85d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:43.257 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.253+0000 7fc29551f800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55d96dd95a20 con 0x55d96dcffd30 2024-09-22T08:36:43.257 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.254+0000 7fc2912a2640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d96dcffd30 0x55d96de85d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:43.257 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.254+0000 7fc2912a2640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d96dcffd30 0x55d96de85d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:38162/0 (socket says 172.21.15.142:38162) 2024-09-22T08:36:43.257 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.254+0000 7fc2912a2640 1 -- 172.21.15.142:0/1397389357 learned_addr learned my addr 172.21.15.142:0/1397389357 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:43.257 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.254+0000 7fc2912a2640 1 -- 172.21.15.142:0/1397389357 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d96de862f0 con 0x55d96dcffd30 2024-09-22T08:36:43.257 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.254+0000 7fc2912a2640 1 --2- 172.21.15.142:0/1397389357 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d96dcffd30 0x55d96de85d90 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fc284000f80 tx=0x7fc284001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:43.257 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.254+0000 7fc17de03640 1 -- 172.21.15.142:0/1397389357 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc284022020 con 0x55d96dcffd30 2024-09-22T08:36:43.257 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.254+0000 7fc17de03640 1 -- 172.21.15.142:0/1397389357 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc284014890 con 0x55d96dcffd30 2024-09-22T08:36:43.257 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.254+0000 7fc29551f800 1 -- 172.21.15.142:0/1397389357 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d96de86580 con 0x55d96dcffd30 2024-09-22T08:36:43.257 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.254+0000 7fc17de03640 1 -- 172.21.15.142:0/1397389357 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc284014bb0 con 0x55d96dcffd30 2024-09-22T08:36:43.257 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.254+0000 7fc29551f800 1 -- 172.21.15.142:0/1397389357 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d96de86f80 con 0x55d96dcffd30 2024-09-22T08:36:43.261 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.255+0000 7fc17de03640 1 -- 172.21.15.142:0/1397389357 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fc284025020 con 0x55d96dcffd30 2024-09-22T08:36:43.261 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.255+0000 7fc17de03640 1 --2- 172.21.15.142:0/1397389357 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fc17803cfb0 0x7fc17803f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:43.261 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.255+0000 7fc17de03640 1 -- 172.21.15.142:0/1397389357 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fc284018030 con 0x55d96dcffd30 2024-09-22T08:36:43.261 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.255+0000 7fc290aa1640 1 --2- 172.21.15.142:0/1397389357 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fc17803cfb0 0x7fc17803f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:43.261 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.255+0000 7fc29551f800 1 --2- 172.21.15.142:0/1397389357 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55d96dd92c00 0x55d96de8d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:43.261 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.255+0000 7fc29551f800 1 -- 172.21.15.142:0/1397389357 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d96de8d920 con 0x55d96dd92c00 2024-09-22T08:36:43.261 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.256+0000 7fc291aa3640 1 --2- 172.21.15.142:0/1397389357 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55d96dd92c00 0x55d96de8d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:43.262 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.256+0000 7fc290aa1640 1 --2- 172.21.15.142:0/1397389357 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fc17803cfb0 0x7fc17803f470 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fc27c057000 tx=0x7fc27c052000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:43.262 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.256+0000 7fc291aa3640 1 --2- 172.21.15.142:0/1397389357 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55d96dd92c00 0x55d96de8d3e0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:43.262 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.256+0000 7fc291aa3640 1 -- 172.21.15.142:0/1397389357 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc28c0083e0 con 0x55d96dd92c00 2024-09-22T08:36:43.262 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.256+0000 7fc29551f800 1 -- 172.21.15.142:0/1397389357 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d96de8dcc0 con 0x55d96dd92c00 2024-09-22T08:36:43.262 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.256+0000 7fc291aa3640 1 -- 172.21.15.142:0/1397389357 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc28c0083e0 con 0x55d96dd92c00 2024-09-22T08:36:43.262 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.256+0000 7fc29551f800 1 --2- 172.21.15.142:0/1397389357 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55d96de8f7c0 0x55d96de91c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:43.262 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.256+0000 7fc29551f800 1 -- 172.21.15.142:0/1397389357 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:3 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d96de923d0 con 0x55d96de8f7c0 2024-09-22T08:36:43.262 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.257+0000 7fc2912a2640 1 --2- 172.21.15.142:0/1397389357 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55d96de8f7c0 0x55d96de91c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:43.262 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.257+0000 7fc2912a2640 1 --2- 172.21.15.142:0/1397389357 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55d96de8f7c0 0x55d96de91c40 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:43.262 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.257+0000 7fc2912a2640 1 -- 172.21.15.142:0/1397389357 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(3 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fc28401b070 con 0x55d96de8f7c0 2024-09-22T08:36:43.262 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.257+0000 7fc29551f800 1 -- 172.21.15.142:0/1397389357 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d96de8e510 con 0x55d96dd92c00 2024-09-22T08:36:43.262 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.257+0000 7fc291aa3640 1 -- 172.21.15.142:0/1397389357 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc28c0083e0 con 0x55d96dd92c00 2024-09-22T08:36:43.263 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.257+0000 7fc29551f800 1 -- 172.21.15.142:0/1397389357 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d96de8e960 con 0x55d96de8f7c0 2024-09-22T08:36:43.263 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.258+0000 7fc2912a2640 1 -- 172.21.15.142:0/1397389357 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(5 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fc28401b070 con 0x55d96de8f7c0 2024-09-22T08:36:43.263 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.258+0000 7fc29551f800 1 Processor -- start 2024-09-22T08:36:43.263 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.258+0000 7fc29551f800 1 -- start start 2024-09-22T08:36:43.263 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.258+0000 7fc29551f800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d96dea0dd0 0x55d96dea11f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:43.263 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.258+0000 7fc29551f800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55d96dc83d50 con 0x55d96dea0dd0 2024-09-22T08:36:43.263 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.259+0000 7fc291aa3640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d96dea0dd0 0x55d96dea11f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:43.263 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.259+0000 7fc291aa3640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d96dea0dd0 0x55d96dea11f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:38174/0 (socket says 172.21.15.142:38174) 2024-09-22T08:36:43.263 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.259+0000 7fc291aa3640 1 -- 172.21.15.142:0/3833881636 learned_addr learned my addr 172.21.15.142:0/3833881636 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:43.263 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.259+0000 7fc291aa3640 1 -- 172.21.15.142:0/3833881636 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d96dea1830 con 0x55d96dea0dd0 2024-09-22T08:36:43.263 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.259+0000 7fc291aa3640 1 --2- 172.21.15.142:0/3833881636 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d96dea0dd0 0x55d96dea11f0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x55d96de86d90 tx=0x7fc28c00bf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:43.263 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.259+0000 7fc176ffd640 1 -- 172.21.15.142:0/3833881636 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc28c01c020 con 0x55d96dea0dd0 2024-09-22T08:36:43.264 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.259+0000 7fc176ffd640 1 -- 172.21.15.142:0/3833881636 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc28c007c90 con 0x55d96dea0dd0 2024-09-22T08:36:43.264 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.259+0000 7fc29551f800 1 -- 172.21.15.142:0/3833881636 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d96dea2060 con 0x55d96dea0dd0 2024-09-22T08:36:43.264 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.259+0000 7fc176ffd640 1 -- 172.21.15.142:0/3833881636 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc28c018440 con 0x55d96dea0dd0 2024-09-22T08:36:43.264 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.259+0000 7fc29551f800 1 -- 172.21.15.142:0/3833881636 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d96dea2600 con 0x55d96dea0dd0 2024-09-22T08:36:43.264 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.260+0000 7fc176ffd640 1 -- 172.21.15.142:0/3833881636 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fc28c01f020 con 0x55d96dea0dd0 2024-09-22T08:36:43.276 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.260+0000 7fc176ffd640 1 --2- 172.21.15.142:0/3833881636 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fc16803cfb0 0x7fc16803f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:43.277 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.260+0000 7fc176ffd640 1 -- 172.21.15.142:0/3833881636 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fc28c0558e0 con 0x55d96dea0dd0 2024-09-22T08:36:43.277 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.260+0000 7fc2912a2640 1 --2- 172.21.15.142:0/3833881636 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fc16803cfb0 0x7fc16803f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:43.277 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.261+0000 7fc29551f800 1 Processor -- start 2024-09-22T08:36:43.277 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.261+0000 7fc2912a2640 1 --2- 172.21.15.142:0/3833881636 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fc16803cfb0 0x7fc16803f470 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fc284052b50 tx=0x7fc284011f40 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:43.277 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.261+0000 7fc29551f800 1 -- start start 2024-09-22T08:36:43.277 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.261+0000 7fc29551f800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d96dead810 0x55d96deadc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:43.277 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.261+0000 7fc29551f800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55d96de7ec40 con 0x55d96dead810 2024-09-22T08:36:43.277 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.261+0000 7fc291aa3640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d96dead810 0x55d96deadc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:43.277 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.261+0000 7fc291aa3640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d96dead810 0x55d96deadc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:38180/0 (socket says 172.21.15.142:38180) 2024-09-22T08:36:43.277 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.261+0000 7fc291aa3640 1 -- 172.21.15.142:0/1107548711 learned_addr learned my addr 172.21.15.142:0/1107548711 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:43.278 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.261+0000 7fc291aa3640 1 -- 172.21.15.142:0/1107548711 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d96deae200 con 0x55d96dead810 2024-09-22T08:36:43.278 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.261+0000 7fc291aa3640 1 --2- 172.21.15.142:0/1107548711 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d96dead810 0x55d96deadc10 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fc28c053df0 tx=0x7fc28c015970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81b73342be322952 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:43.278 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.262+0000 7fc174ff9640 1 -- 172.21.15.142:0/1107548711 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc28c04a070 con 0x55d96dead810 2024-09-22T08:36:43.278 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.262+0000 7fc174ff9640 1 -- 172.21.15.142:0/1107548711 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc28c015e70 con 0x55d96dead810 2024-09-22T08:36:43.278 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.262+0000 7fc174ff9640 1 -- 172.21.15.142:0/1107548711 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc28c0174d0 con 0x55d96dead810 2024-09-22T08:36:43.278 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.262+0000 7fc29551f800 1 -- 172.21.15.142:0/1107548711 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d96dead810 msgr2=0x55d96deadc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:43.278 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.262+0000 7fc29551f800 1 --2- 172.21.15.142:0/1107548711 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d96dead810 0x55d96deadc10 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fc28c053df0 tx=0x7fc28c015970 comp rx=0 tx=0).stop 2024-09-22T08:36:43.278 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.262+0000 7fc29551f800 1 -- 172.21.15.142:0/1107548711 shutdown_connections 2024-09-22T08:36:43.278 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.262+0000 7fc29551f800 1 --2- 172.21.15.142:0/1107548711 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d96dead810 0x55d96deadc10 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:43.278 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.262+0000 7fc29551f800 1 -- 172.21.15.142:0/1107548711 >> 172.21.15.142:0/1107548711 conn(0x55d96dea9c30 msgr2=0x55d96dea7e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:43.278 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.262+0000 7fc29551f800 1 -- 172.21.15.142:0/1107548711 shutdown_connections 2024-09-22T08:36:43.278 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.262+0000 7fc29551f800 1 -- 172.21.15.142:0/1107548711 wait complete. 2024-09-22T08:36:43.279 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.262+0000 7fc29551f800 1 Processor -- start 2024-09-22T08:36:43.279 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.262+0000 7fc29551f800 1 -- start start 2024-09-22T08:36:43.279 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.263+0000 7fc29551f800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d96dead810 0x55d96deb4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:43.279 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.263+0000 7fc29551f800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55d96deae820 con 0x55d96dead810 2024-09-22T08:36:43.279 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.263+0000 7fc291aa3640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d96dead810 0x55d96deb4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:43.279 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.263+0000 7fc291aa3640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d96dead810 0x55d96deb4e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:38194/0 (socket says 172.21.15.142:38194) 2024-09-22T08:36:43.279 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.263+0000 7fc291aa3640 1 -- 172.21.15.142:0/1851722695 learned_addr learned my addr 172.21.15.142:0/1851722695 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:43.279 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.263+0000 7fc291aa3640 1 -- 172.21.15.142:0/1851722695 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d96deb5370 con 0x55d96dead810 2024-09-22T08:36:43.279 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.263+0000 7fc291aa3640 1 --2- 172.21.15.142:0/1851722695 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d96dead810 0x55d96deb4e10 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fc28c0206f0 tx=0x7fc28c053d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:43.279 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.263+0000 7fc166ffd640 1 -- 172.21.15.142:0/1851722695 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc28c04a070 con 0x55d96dead810 2024-09-22T08:36:43.279 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.263+0000 7fc166ffd640 1 -- 172.21.15.142:0/1851722695 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc28c04b040 con 0x55d96dead810 2024-09-22T08:36:43.279 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.263+0000 7fc166ffd640 1 -- 172.21.15.142:0/1851722695 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc28c017730 con 0x55d96dead810 2024-09-22T08:36:43.280 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.263+0000 7fc29551f800 1 -- 172.21.15.142:0/1851722695 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d96deb5600 con 0x55d96dead810 2024-09-22T08:36:43.280 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.264+0000 7fc29551f800 1 -- 172.21.15.142:0/1851722695 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d96deb6190 con 0x55d96dead810 2024-09-22T08:36:43.280 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.264+0000 7fc166ffd640 1 -- 172.21.15.142:0/1851722695 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fc28c016040 con 0x55d96dead810 2024-09-22T08:36:43.280 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.264+0000 7fc166ffd640 1 --2- 172.21.15.142:0/1851722695 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fc15c03cfb0 0x7fc15c03f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:43.280 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.265+0000 7fc166ffd640 1 -- 172.21.15.142:0/1851722695 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fc28c055040 con 0x55d96dead810 2024-09-22T08:36:43.280 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.265+0000 7fc2912a2640 1 --2- 172.21.15.142:0/1851722695 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fc15c03cfb0 0x7fc15c03f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:43.280 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.265+0000 7fc2912a2640 1 --2- 172.21.15.142:0/1851722695 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fc15c03cfb0 0x7fc15c03f470 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fc284052db0 tx=0x7fc28401df90 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:43.280 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.265+0000 7fc29551f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:43.280 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.265+0000 7fc29551f800 1 --2- 172.21.15.142:0/1851722695 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55d96dec06d0 0x55d96dec2b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:43.280 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.265+0000 7fc29551f800 1 -- 172.21.15.142:0/1851722695 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d96dec32e0 con 0x55d96dec06d0 2024-09-22T08:36:43.280 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.265+0000 7fc290aa1640 1 --2- 172.21.15.142:0/1851722695 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55d96dec06d0 0x55d96dec2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:43.281 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.265+0000 7fc290aa1640 1 --2- 172.21.15.142:0/1851722695 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55d96dec06d0 0x55d96dec2b90 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:43.281 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.266+0000 7fc290aa1640 1 -- 172.21.15.142:0/1851722695 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc27c051070 con 0x55d96dec06d0 2024-09-22T08:36:43.281 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.266+0000 7fc29551f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:43.281 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.266+0000 7fc29551f800 20 realm 2024-09-22T08:36:43.281 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.266+0000 7fc29551f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:43.281 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.266+0000 7fc29551f800 1 -- 172.21.15.142:0/1851722695 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d96dec3710 con 0x55d96dec06d0 2024-09-22T08:36:43.281 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.266+0000 7fc290aa1640 1 -- 172.21.15.142:0/1851722695 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc27c051070 con 0x55d96dec06d0 2024-09-22T08:36:43.281 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.266+0000 7fc29551f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:43.281 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.266+0000 7fc29551f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:36:43.281 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.266+0000 7fc29551f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:43.281 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.266+0000 7fc29551f800 1 -- 172.21.15.142:0/1851722695 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d96dec3fe0 con 0x55d96dec06d0 2024-09-22T08:36:43.281 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.266+0000 7fc290aa1640 1 -- 172.21.15.142:0/1851722695 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc27c051070 con 0x55d96dec06d0 2024-09-22T08:36:43.281 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.266+0000 7fc29551f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:43.282 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.266+0000 7fc29551f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:43.282 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.266+0000 7fc29551f800 1 -- 172.21.15.142:0/1851722695 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d96dec4380 con 0x55d96dec06d0 2024-09-22T08:36:43.282 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.266+0000 7fc290aa1640 1 -- 172.21.15.142:0/1851722695 <== osd.1 v2:172.21.15.142:6816/3192108003 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc27c051070 con 0x55d96dec06d0 2024-09-22T08:36:43.282 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.266+0000 7fc29551f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:36:43.282 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.266+0000 7fc29551f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:43.282 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.266+0000 7fc29551f800 1 --2- 172.21.15.142:0/1851722695 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55d96dec50e0 0x55d96dec74d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:43.282 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.266+0000 7fc29551f800 1 -- 172.21.15.142:0/1851722695 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d96dec7ae0 con 0x55d96dec50e0 2024-09-22T08:36:43.282 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.267+0000 7fc291aa3640 1 --2- 172.21.15.142:0/1851722695 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55d96dec50e0 0x55d96dec74d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:43.282 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.267+0000 7fc291aa3640 1 --2- 172.21.15.142:0/1851722695 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55d96dec50e0 0x55d96dec74d0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:43.282 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.267+0000 7fc291aa3640 1 -- 172.21.15.142:0/1851722695 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(5 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fc28c0083e0 con 0x55d96dec50e0 2024-09-22T08:36:43.282 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.267+0000 7fc29551f800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:36:43.282 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.267+0000 7fc29551f800 20 searching for the correct realm 2024-09-22T08:36:43.283 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.267+0000 7fc29551f800 1 -- 172.21.15.142:0/1851722695 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d96dec9410 con 0x55d96dec50e0 2024-09-22T08:36:43.283 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.267+0000 7fc291aa3640 1 -- 172.21.15.142:0/1851722695 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc28c0083e0 con 0x55d96dec50e0 2024-09-22T08:36:43.283 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.267+0000 7fc291aa3640 1 --2- 172.21.15.142:0/1851722695 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7fc28c021020 0x7fc28c03ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:43.283 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.267+0000 7fc291aa3640 1 -- 172.21.15.142:0/1851722695 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d96dec9410 con 0x7fc28c021020 2024-09-22T08:36:43.283 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.267+0000 7fc2912a2640 1 --2- 172.21.15.142:0/1851722695 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7fc28c021020 0x7fc28c03ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:43.283 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.268+0000 7fc2912a2640 1 --2- 172.21.15.142:0/1851722695 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7fc28c021020 0x7fc28c03ba80 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:43.283 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.268+0000 7fc2912a2640 1 -- 172.21.15.142:0/1851722695 <== osd.2 v2:172.21.15.142:6808/279438927 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc28401b070 con 0x7fc28c021020 2024-09-22T08:36:43.283 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.268+0000 7fc2912a2640 1 --2- 172.21.15.142:0/1851722695 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7fc284027020 0x7fc28401e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:43.283 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.268+0000 7fc2912a2640 1 -- 172.21.15.142:0/1851722695 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d96dec9410 con 0x7fc284027020 2024-09-22T08:36:43.283 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.268+0000 7fc290aa1640 1 --2- 172.21.15.142:0/1851722695 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7fc284027020 0x7fc28401e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:43.283 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.269+0000 7fc290aa1640 1 --2- 172.21.15.142:0/1851722695 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7fc284027020 0x7fc28401e3f0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:43.284 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.269+0000 7fc290aa1640 1 -- 172.21.15.142:0/1851722695 <== osd.0 v2:172.21.15.31:6800/168281188 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc27c051070 con 0x7fc284027020 2024-09-22T08:36:43.284 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.269+0000 7fc290aa1640 1 -- 172.21.15.142:0/1851722695 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d96dec9410 con 0x55d96dec06d0 2024-09-22T08:36:43.284 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.269+0000 7fc290aa1640 1 -- 172.21.15.142:0/1851722695 <== osd.1 v2:172.21.15.142:6816/3192108003 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc27c051070 con 0x55d96dec06d0 2024-09-22T08:36:43.284 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.269+0000 7fc290aa1640 1 -- 172.21.15.142:0/1851722695 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d96dec9410 con 0x55d96dec06d0 2024-09-22T08:36:43.284 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.269+0000 7fc290aa1640 1 -- 172.21.15.142:0/1851722695 <== osd.1 v2:172.21.15.142:6816/3192108003 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc27c051070 con 0x55d96dec06d0 2024-09-22T08:36:43.284 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.269+0000 7fc290aa1640 1 -- 172.21.15.142:0/1851722695 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d96dec9410 con 0x7fc284027020 2024-09-22T08:36:43.284 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.269+0000 7fc290aa1640 1 -- 172.21.15.142:0/1851722695 <== osd.0 v2:172.21.15.31:6800/168281188 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc27c051070 con 0x7fc284027020 2024-09-22T08:36:43.284 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.269+0000 7fc290aa1640 1 -- 172.21.15.142:0/1851722695 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d96dec9410 con 0x7fc284027020 2024-09-22T08:36:43.284 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.270+0000 7fc290aa1640 1 -- 172.21.15.142:0/1851722695 <== osd.0 v2:172.21.15.31:6800/168281188 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc27c051070 con 0x7fc284027020 2024-09-22T08:36:43.284 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.270+0000 7fc290aa1640 1 -- 172.21.15.142:0/1851722695 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d96dec9410 con 0x7fc28c021020 2024-09-22T08:36:43.284 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.270+0000 7fc2912a2640 1 -- 172.21.15.142:0/1851722695 <== osd.2 v2:172.21.15.142:6808/279438927 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc28401b070 con 0x7fc28c021020 2024-09-22T08:36:43.284 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.270+0000 7fc2912a2640 1 -- 172.21.15.142:0/1851722695 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d96dec9410 con 0x55d96dec50e0 2024-09-22T08:36:43.285 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.270+0000 7fc291aa3640 1 -- 172.21.15.142:0/1851722695 <== osd.3 v2:172.21.15.142:6800/1064901393 3 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc28c0083e0 con 0x55d96dec50e0 2024-09-22T08:36:43.285 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.270+0000 7fc291aa3640 1 -- 172.21.15.142:0/1851722695 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d96dec9410 con 0x55d96dec06d0 2024-09-22T08:36:43.285 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.270+0000 7fc290aa1640 1 -- 172.21.15.142:0/1851722695 <== osd.1 v2:172.21.15.142:6816/3192108003 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc27c051070 con 0x55d96dec06d0 2024-09-22T08:36:43.285 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.270+0000 7fc290aa1640 1 -- 172.21.15.142:0/1851722695 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d96dec9410 con 0x7fc284027020 2024-09-22T08:36:43.285 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.271+0000 7fc290aa1640 1 -- 172.21.15.142:0/1851722695 <== osd.0 v2:172.21.15.31:6800/168281188 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc27c051070 con 0x7fc284027020 2024-09-22T08:36:43.285 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.271+0000 7fc290aa1640 1 -- 172.21.15.142:0/1851722695 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d96dec9410 con 0x55d96dec06d0 2024-09-22T08:36:43.285 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.271+0000 7fc290aa1640 1 -- 172.21.15.142:0/1851722695 <== osd.1 v2:172.21.15.142:6816/3192108003 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc27c051070 con 0x55d96dec06d0 2024-09-22T08:36:43.285 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.271+0000 7fc290aa1640 1 -- 172.21.15.142:0/1851722695 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d96dec9410 con 0x7fc28c021020 2024-09-22T08:36:43.285 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.271+0000 7fc2912a2640 1 -- 172.21.15.142:0/1851722695 <== osd.2 v2:172.21.15.142:6808/279438927 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fc28401b070 con 0x7fc28c021020 2024-09-22T08:36:43.285 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.271+0000 7fc2912a2640 1 -- 172.21.15.142:0/1851722695 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d96dec9410 con 0x55d96dec50e0 2024-09-22T08:36:43.285 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.271+0000 7fc291aa3640 1 -- 172.21.15.142:0/1851722695 <== osd.3 v2:172.21.15.142:6800/1064901393 4 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc28c0083e0 con 0x55d96dec50e0 2024-09-22T08:36:43.285 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.271+0000 7fc291aa3640 1 -- 172.21.15.142:0/1851722695 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d96dec9410 con 0x55d96dec50e0 2024-09-22T08:36:43.286 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.272+0000 7fc291aa3640 1 -- 172.21.15.142:0/1851722695 <== osd.3 v2:172.21.15.142:6800/1064901393 5 ==== osd_op_reply(20 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fc28c062040 con 0x55d96dec50e0 2024-09-22T08:36:43.286 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.272+0000 7fc291aa3640 1 -- 172.21.15.142:0/1851722695 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d96dec9410 con 0x7fc284027020 2024-09-22T08:36:43.286 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.272+0000 7fc290aa1640 1 -- 172.21.15.142:0/1851722695 <== osd.0 v2:172.21.15.31:6800/168281188 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc27c051070 con 0x7fc284027020 2024-09-22T08:36:43.286 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.272+0000 7fc290aa1640 1 -- 172.21.15.142:0/1851722695 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d96dec9410 con 0x55d96dec50e0 2024-09-22T08:36:43.286 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.272+0000 7fc291aa3640 1 -- 172.21.15.142:0/1851722695 <== osd.3 v2:172.21.15.142:6800/1064901393 6 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc28c062040 con 0x55d96dec50e0 2024-09-22T08:36:43.286 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.272+0000 7fc291aa3640 1 -- 172.21.15.142:0/1851722695 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d96dec9410 con 0x55d96dec50e0 2024-09-22T08:36:43.286 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.272+0000 7fc291aa3640 1 -- 172.21.15.142:0/1851722695 <== osd.3 v2:172.21.15.142:6800/1064901393 7 ==== osd_op_reply(23 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fc28c062040 con 0x55d96dec50e0 2024-09-22T08:36:43.286 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.272+0000 7fc291aa3640 1 -- 172.21.15.142:0/1851722695 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d96dec9410 con 0x55d96dec06d0 2024-09-22T08:36:43.286 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.273+0000 7fc290aa1640 1 -- 172.21.15.142:0/1851722695 <== osd.1 v2:172.21.15.142:6816/3192108003 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc27c051070 con 0x55d96dec06d0 2024-09-22T08:36:43.286 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.273+0000 7fc290aa1640 1 -- 172.21.15.142:0/1851722695 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d96dec9410 con 0x55d96dec06d0 2024-09-22T08:36:43.286 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.273+0000 7fc290aa1640 1 -- 172.21.15.142:0/1851722695 <== osd.1 v2:172.21.15.142:6816/3192108003 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fc27c051070 con 0x55d96dec06d0 2024-09-22T08:36:43.286 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.273+0000 7fc290aa1640 1 -- 172.21.15.142:0/1851722695 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d96dec9410 con 0x7fc284027020 2024-09-22T08:36:43.287 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.273+0000 7fc290aa1640 1 -- 172.21.15.142:0/1851722695 <== osd.0 v2:172.21.15.31:6800/168281188 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc27c051070 con 0x7fc284027020 2024-09-22T08:36:43.287 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.273+0000 7fc290aa1640 1 -- 172.21.15.142:0/1851722695 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d96dec9410 con 0x55d96dec50e0 2024-09-22T08:36:43.287 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.273+0000 7fc291aa3640 1 -- 172.21.15.142:0/1851722695 <== osd.3 v2:172.21.15.142:6800/1064901393 8 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc28c062040 con 0x55d96dec50e0 2024-09-22T08:36:43.287 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.273+0000 7fc291aa3640 1 -- 172.21.15.142:0/1851722695 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d96dec9410 con 0x7fc28c021020 2024-09-22T08:36:43.287 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.273+0000 7fc2912a2640 1 -- 172.21.15.142:0/1851722695 <== osd.2 v2:172.21.15.142:6808/279438927 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc28401b070 con 0x7fc28c021020 2024-09-22T08:36:43.287 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.274+0000 7fc2912a2640 1 -- 172.21.15.142:0/1851722695 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d96dec9410 con 0x55d96dec06d0 2024-09-22T08:36:43.287 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.274+0000 7fc290aa1640 1 -- 172.21.15.142:0/1851722695 <== osd.1 v2:172.21.15.142:6816/3192108003 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc27c051070 con 0x55d96dec06d0 2024-09-22T08:36:43.287 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.274+0000 7fc290aa1640 1 -- 172.21.15.142:0/1851722695 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d96dec9410 con 0x7fc284027020 2024-09-22T08:36:43.287 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.274+0000 7fc290aa1640 1 -- 172.21.15.142:0/1851722695 <== osd.0 v2:172.21.15.31:6800/168281188 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc27c051070 con 0x7fc284027020 2024-09-22T08:36:43.287 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.274+0000 7fc290aa1640 1 -- 172.21.15.142:0/1851722695 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d96dec9410 con 0x55d96dec50e0 2024-09-22T08:36:43.287 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.274+0000 7fc291aa3640 1 -- 172.21.15.142:0/1851722695 <== osd.3 v2:172.21.15.142:6800/1064901393 9 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc28c062040 con 0x55d96dec50e0 2024-09-22T08:36:43.287 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.274+0000 7fc291aa3640 1 -- 172.21.15.142:0/1851722695 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d96dec9410 con 0x7fc284027020 2024-09-22T08:36:43.287 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.274+0000 7fc290aa1640 1 -- 172.21.15.142:0/1851722695 <== osd.0 v2:172.21.15.31:6800/168281188 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc27c051070 con 0x7fc284027020 2024-09-22T08:36:43.288 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.274+0000 7fc290aa1640 1 -- 172.21.15.142:0/1851722695 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d96dec9410 con 0x7fc28c021020 2024-09-22T08:36:43.288 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.275+0000 7fc2912a2640 1 -- 172.21.15.142:0/1851722695 <== osd.2 v2:172.21.15.142:6808/279438927 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc28401b070 con 0x7fc28c021020 2024-09-22T08:36:43.288 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.275+0000 7fc2912a2640 1 -- 172.21.15.142:0/1851722695 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d96dec9410 con 0x55d96dec50e0 2024-09-22T08:36:43.288 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.275+0000 7fc291aa3640 1 -- 172.21.15.142:0/1851722695 <== osd.3 v2:172.21.15.142:6800/1064901393 10 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc28c062040 con 0x55d96dec50e0 2024-09-22T08:36:43.288 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.275+0000 7fc291aa3640 1 -- 172.21.15.142:0/1851722695 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d96dec9410 con 0x7fc284027020 2024-09-22T08:36:43.289 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.275+0000 7fc290aa1640 1 -- 172.21.15.142:0/1851722695 <== osd.0 v2:172.21.15.31:6800/168281188 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc27c051070 con 0x7fc284027020 2024-09-22T08:36:43.289 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.275+0000 7fc290aa1640 1 -- 172.21.15.142:0/1851722695 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d96dec9410 con 0x55d96dec06d0 2024-09-22T08:36:43.289 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.276+0000 7fc290aa1640 1 -- 172.21.15.142:0/1851722695 <== osd.1 v2:172.21.15.142:6816/3192108003 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fc27c051070 con 0x55d96dec06d0 2024-09-22T08:36:43.290 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.276+0000 7fc290aa1640 1 -- 172.21.15.142:0/1851722695 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d96dec9410 con 0x7fc28c021020 2024-09-22T08:36:43.298 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.276+0000 7fc2912a2640 1 -- 172.21.15.142:0/1851722695 <== osd.2 v2:172.21.15.142:6808/279438927 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc28401b070 con 0x7fc28c021020 2024-09-22T08:36:43.298 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.276+0000 7fc29551f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:36:43.298 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.276+0000 7fc29551f800 20 RGWRados::pool_iterate: got zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec 2024-09-22T08:36:43.298 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.276+0000 7fc29551f800 20 RGWRados::pool_iterate: got zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f 2024-09-22T08:36:43.299 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.276+0000 7fc29551f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:36:43.299 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.276+0000 7fc29551f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:36:43.299 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.276+0000 7fc29551f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:36:43.299 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.276+0000 7fc29551f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:43.299 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.276+0000 7fc29551f800 1 -- 172.21.15.142:0/1851722695 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d96dec84a0 con 0x55d96dec06d0 2024-09-22T08:36:43.299 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.276+0000 7fc290aa1640 1 -- 172.21.15.142:0/1851722695 <== osd.1 v2:172.21.15.142:6816/3192108003 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc27c051070 con 0x55d96dec06d0 2024-09-22T08:36:43.299 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.276+0000 7fc29551f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:43.299 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.276+0000 7fc29551f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:43.299 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.276+0000 7fc29551f800 1 -- 172.21.15.142:0/1851722695 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d96dec8cf0 con 0x55d96dec06d0 2024-09-22T08:36:43.299 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.276+0000 7fc290aa1640 1 -- 172.21.15.142:0/1851722695 <== osd.1 v2:172.21.15.142:6816/3192108003 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc27c051070 con 0x55d96dec06d0 2024-09-22T08:36:43.299 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.276+0000 7fc29551f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:36:43.299 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.276+0000 7fc29551f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:43.299 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.276+0000 7fc29551f800 1 -- 172.21.15.142:0/1851722695 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:40 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d96dec9890 con 0x55d96dec50e0 2024-09-22T08:36:43.299 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.277+0000 7fc291aa3640 1 -- 172.21.15.142:0/1851722695 <== osd.3 v2:172.21.15.142:6800/1064901393 11 ==== osd_op_reply(40 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fc28c062040 con 0x55d96dec50e0 2024-09-22T08:36:43.300 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.277+0000 7fc29551f800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:36:43.300 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.277+0000 7fc29551f800 20 zone default found 2024-09-22T08:36:43.300 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.277+0000 7fc29551f800 4 Realm: () 2024-09-22T08:36:43.300 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.277+0000 7fc29551f800 4 ZoneGroup: default (d89f6f57-1007-47dd-9065-f486c7b01aec) 2024-09-22T08:36:43.300 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.277+0000 7fc29551f800 4 Zone: default (e239248c-0bee-4e41-803a-24b288d3eb8f) 2024-09-22T08:36:43.300 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.277+0000 7fc29551f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:36:43.300 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.277+0000 7fc29551f800 20 zonegroup default 2024-09-22T08:36:43.300 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.277+0000 7fc29551f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:43.300 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.277+0000 7fc29551f800 1 -- 172.21.15.142:0/1851722695 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d96dec9c30 con 0x7fc284027020 2024-09-22T08:36:43.300 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.277+0000 7fc290aa1640 1 -- 172.21.15.142:0/1851722695 <== osd.0 v2:172.21.15.31:6800/168281188 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fc27c051070 con 0x7fc284027020 2024-09-22T08:36:43.300 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.277+0000 7fc29551f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:43.300 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.277+0000 7fc29551f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:43.300 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.277+0000 7fc29551f800 1 -- 172.21.15.142:0/1851722695 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d96decbf10 con 0x55d96dec50e0 2024-09-22T08:36:43.301 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.277+0000 7fc291aa3640 1 -- 172.21.15.142:0/1851722695 <== osd.3 v2:172.21.15.142:6800/1064901393 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc28c062040 con 0x55d96dec50e0 2024-09-22T08:36:43.301 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.277+0000 7fc29551f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:43.301 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.277+0000 7fc29551f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:43.301 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.277+0000 7fc29551f800 1 -- 172.21.15.142:0/1851722695 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d96decc2b0 con 0x55d96dec50e0 2024-09-22T08:36:43.301 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.277+0000 7fc291aa3640 1 -- 172.21.15.142:0/1851722695 <== osd.3 v2:172.21.15.142:6800/1064901393 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc28c062040 con 0x55d96dec50e0 2024-09-22T08:36:43.301 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.277+0000 7fc29551f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:43.301 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.277+0000 7fc29551f800 20 started sync module instance, tier type = 2024-09-22T08:36:43.301 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.277+0000 7fc29551f800 20 started zone id=e239248c-0bee-4e41-803a-24b288d3eb8f (name=default) with tier type = 2024-09-22T08:36:43.301 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.277+0000 7fc29551f800 1 -- 172.21.15.142:0/1851722695 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d96decb350 con 0x7fc28c021020 2024-09-22T08:36:43.301 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.278+0000 7fc2912a2640 1 -- 172.21.15.142:0/1851722695 <== osd.2 v2:172.21.15.142:6808/279438927 7 ==== osd_op_reply(44 notify.0 [create] v30'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc28401b070 con 0x7fc28c021020 2024-09-22T08:36:43.301 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.279+0000 7fc29551f800 1 -- 172.21.15.142:0/1851722695 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94392340491936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d96decc710 con 0x7fc28c021020 2024-09-22T08:36:43.301 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.279+0000 7fc29551f800 1 -- 172.21.15.142:0/1851722695 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d96deccf60 con 0x55d96dec06d0 2024-09-22T08:36:43.301 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.279+0000 7fc2912a2640 1 -- 172.21.15.142:0/1851722695 <== osd.2 v2:172.21.15.142:6808/279438927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94392340491936] v30'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc28401b070 con 0x7fc28c021020 2024-09-22T08:36:43.301 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.280+0000 7fc290aa1640 1 -- 172.21.15.142:0/1851722695 <== osd.1 v2:172.21.15.142:6816/3192108003 15 ==== osd_op_reply(46 notify.1 [create] v30'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc27c051070 con 0x55d96dec06d0 2024-09-22T08:36:43.302 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.280+0000 7fc29551f800 1 -- 172.21.15.142:0/1851722695 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94392340499120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d96decd380 con 0x55d96dec06d0 2024-09-22T08:36:43.302 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.280+0000 7fc29551f800 1 -- 172.21.15.142:0/1851722695 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d96decdbd0 con 0x55d96dec50e0 2024-09-22T08:36:43.302 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.281+0000 7fc290aa1640 1 -- 172.21.15.142:0/1851722695 <== osd.1 v2:172.21.15.142:6816/3192108003 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94392340499120] v30'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc27c051070 con 0x55d96dec06d0 2024-09-22T08:36:43.302 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.281+0000 7fc291aa3640 1 -- 172.21.15.142:0/1851722695 <== osd.3 v2:172.21.15.142:6800/1064901393 14 ==== osd_op_reply(48 notify.2 [create] v30'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc28c062040 con 0x55d96dec50e0 2024-09-22T08:36:43.302 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.281+0000 7fc29551f800 1 -- 172.21.15.142:0/1851722695 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94392340500656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d96decdae0 con 0x55d96dec50e0 2024-09-22T08:36:43.302 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.281+0000 7fc29551f800 1 -- 172.21.15.142:0/1851722695 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d96dece5b0 con 0x7fc28c021020 2024-09-22T08:36:43.302 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.282+0000 7fc2912a2640 1 -- 172.21.15.142:0/1851722695 <== osd.2 v2:172.21.15.142:6808/279438927 9 ==== osd_op_reply(50 notify.3 [create] v30'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc28401b070 con 0x7fc28c021020 2024-09-22T08:36:43.302 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.282+0000 7fc29551f800 1 -- 172.21.15.142:0/1851722695 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94392340504736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d96decee80 con 0x7fc28c021020 2024-09-22T08:36:43.302 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.282+0000 7fc29551f800 1 -- 172.21.15.142:0/1851722695 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d96decf980 con 0x55d96dec06d0 2024-09-22T08:36:43.302 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.282+0000 7fc291aa3640 1 -- 172.21.15.142:0/1851722695 <== osd.3 v2:172.21.15.142:6800/1064901393 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94392340500656] v30'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc28c062040 con 0x55d96dec50e0 2024-09-22T08:36:43.302 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.283+0000 7fc290aa1640 1 -- 172.21.15.142:0/1851722695 <== osd.1 v2:172.21.15.142:6816/3192108003 17 ==== osd_op_reply(52 notify.4 [create] v30'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc27c051070 con 0x55d96dec06d0 2024-09-22T08:36:43.302 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.283+0000 7fc29551f800 1 -- 172.21.15.142:0/1851722695 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94392340509808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d96decf940 con 0x55d96dec06d0 2024-09-22T08:36:43.302 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.283+0000 7fc29551f800 1 -- 172.21.15.142:0/1851722695 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d96ded0430 con 0x7fc284027020 2024-09-22T08:36:43.303 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.284+0000 7fc2912a2640 1 -- 172.21.15.142:0/1851722695 <== osd.2 v2:172.21.15.142:6808/279438927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94392340504736] v30'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc28401b070 con 0x7fc28c021020 2024-09-22T08:36:43.303 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.284+0000 7fc290aa1640 1 -- 172.21.15.142:0/1851722695 <== osd.1 v2:172.21.15.142:6816/3192108003 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94392340509808] v30'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc27c051070 con 0x55d96dec06d0 2024-09-22T08:36:43.303 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.284+0000 7fc290aa1640 1 -- 172.21.15.142:0/1851722695 <== osd.0 v2:172.21.15.31:6800/168281188 11 ==== osd_op_reply(54 notify.5 [create] v30'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc27c051070 con 0x7fc284027020 2024-09-22T08:36:43.303 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.284+0000 7fc29551f800 1 -- 172.21.15.142:0/1851722695 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94392340501808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d96ded0430 con 0x7fc284027020 2024-09-22T08:36:43.303 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.285+0000 7fc29551f800 1 -- 172.21.15.142:0/1851722695 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d96ded08f0 con 0x7fc284027020 2024-09-22T08:36:43.303 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.285+0000 7fc290aa1640 1 -- 172.21.15.142:0/1851722695 <== osd.0 v2:172.21.15.31:6800/168281188 12 ==== osd_op_reply(56 notify.6 [create] v30'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc27c051070 con 0x7fc284027020 2024-09-22T08:36:43.303 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.285+0000 7fc29551f800 1 -- 172.21.15.142:0/1851722695 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94392340507088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d96ded0d60 con 0x7fc284027020 2024-09-22T08:36:43.303 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.285+0000 7fc29551f800 1 -- 172.21.15.142:0/1851722695 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d96ded17e0 con 0x7fc284027020 2024-09-22T08:36:43.303 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.286+0000 7fc290aa1640 1 -- 172.21.15.142:0/1851722695 <== osd.0 v2:172.21.15.31:6800/168281188 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94392340501808] v30'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc27c051070 con 0x7fc284027020 2024-09-22T08:36:43.303 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.286+0000 7fc290aa1640 1 -- 172.21.15.142:0/1851722695 <== osd.0 v2:172.21.15.31:6800/168281188 14 ==== osd_op_reply(58 notify.7 [create] v30'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc27c051070 con 0x7fc284027020 2024-09-22T08:36:43.303 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.286+0000 7fc290aa1640 1 -- 172.21.15.142:0/1851722695 <== osd.0 v2:172.21.15.31:6800/168281188 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94392340507088] v30'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc27c051070 con 0x7fc284027020 2024-09-22T08:36:43.303 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.286+0000 7fc29551f800 1 -- 172.21.15.142:0/1851722695 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94392340517616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d96decff40 con 0x7fc284027020 2024-09-22T08:36:43.304 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.286+0000 7fc29551f800 20 add_watcher() i=0 2024-09-22T08:36:43.304 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.286+0000 7fc29551f800 20 add_watcher() i=1 2024-09-22T08:36:43.304 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.286+0000 7fc29551f800 20 add_watcher() i=2 2024-09-22T08:36:43.304 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.286+0000 7fc29551f800 20 add_watcher() i=3 2024-09-22T08:36:43.304 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.286+0000 7fc29551f800 20 add_watcher() i=4 2024-09-22T08:36:43.304 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.286+0000 7fc29551f800 20 add_watcher() i=5 2024-09-22T08:36:43.304 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.286+0000 7fc29551f800 20 add_watcher() i=6 2024-09-22T08:36:43.304 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.288+0000 7fc290aa1640 1 -- 172.21.15.142:0/1851722695 <== osd.0 v2:172.21.15.31:6800/168281188 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94392340517616] v30'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc27c051070 con 0x7fc284027020 2024-09-22T08:36:43.304 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.288+0000 7fc29551f800 20 add_watcher() i=7 2024-09-22T08:36:43.304 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.288+0000 7fc29551f800 2 all 8 watchers are set, enabling cache 2024-09-22T08:36:43.304 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.288+0000 7fc29551f800 1 -- 172.21.15.142:0/1851722695 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d96ded4810 con 0x55d96dec06d0 2024-09-22T08:36:43.304 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.289+0000 7fc290aa1640 1 -- 172.21.15.142:0/1851722695 <== osd.1 v2:172.21.15.142:6816/3192108003 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fc27c051070 con 0x55d96dec06d0 2024-09-22T08:36:43.305 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.289+0000 7fc29551f800 1 -- 172.21.15.142:0/1851722695 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94392340514992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d96ded1cc0 con 0x55d96dec06d0 2024-09-22T08:36:43.305 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.290+0000 7fc290aa1640 1 -- 172.21.15.142:0/1851722695 <== osd.1 v2:172.21.15.142:6816/3192108003 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94392340514992] v30'60 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc27c051070 con 0x55d96dec06d0 2024-09-22T08:36:43.305 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.290+0000 7fc147fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:36:43.305 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.290+0000 7fc29551f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:36:43.305 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.290+0000 7fc29551f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:36:43.305 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.290+0000 7fc29551f800 5 note: GC not initialized 2024-09-22T08:36:43.305 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.290+0000 7fc146fe5640 20 reqs_thread_entry: start 2024-09-22T08:36:43.305 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.290+0000 7fc29551f800 20 init_complete bucket index max shards: 11 2024-09-22T08:36:43.305 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.290+0000 7fc29551f800 20 Filter name: none 2024-09-22T08:36:43.305 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.290+0000 7fc144fe1640 20 reqs_thread_entry: start 2024-09-22T08:36:43.305 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.290+0000 7fc29551f800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-22T08:36:43.305 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.290+0000 7fc29551f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:43.305 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.290+0000 7fc29551f800 1 -- 172.21.15.142:0/1851722695 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d96df07bd0 con 0x55d96dec06d0 2024-09-22T08:36:43.306 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.291+0000 7fc290aa1640 1 -- 172.21.15.142:0/1851722695 <== osd.1 v2:172.21.15.142:6816/3192108003 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv2 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fc27c051070 con 0x55d96dec06d0 2024-09-22T08:36:43.306 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.291+0000 7fc29551f800 20 rados_obj.operate() r=0 bl.length=391 2024-09-22T08:36:43.306 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.291+0000 7fc29551f800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-22T08:36:43.306 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.291+0000 7fc29551f800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-22T08:36:43.306 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.291+0000 7fc29551f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:36:43.306 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.291+0000 7fc29551f800 1 -- 172.21.15.142:0/1851722695 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d96df0a660 con 0x7fc28c021020 2024-09-22T08:36:43.306 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.291+0000 7fc2912a2640 1 -- 172.21.15.142:0/1851722695 <== osd.2 v2:172.21.15.142:6808/279438927 11 ==== osd_op_reply(63 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 155+0+0 (crc 0 0 0) 0x7fc28401b070 con 0x7fc28c021020 2024-09-22T08:36:43.306 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.291+0000 7fc29551f800 1 -- 172.21.15.142:0/1851722695 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d96df0dde0 con 0x55d96dec06d0 2024-09-22T08:36:43.306 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.292+0000 7fc290aa1640 1 -- 172.21.15.142:0/1851722695 <== osd.1 v2:172.21.15.142:6816/3192108003 22 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~391] v30'3 uv3 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fc27c051070 con 0x55d96dec06d0 2024-09-22T08:36:43.306 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.292+0000 7fc29551f800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-22T08:36:43.306 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.292+0000 7fc29551f800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-22T08:36:43.306 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.292+0000 7fc29551f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-22T08:36:43.306 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.292+0000 7fc29551f800 1 -- 172.21.15.142:0/1851722695 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94392340764608 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d96df09650 con 0x55d96dec06d0 2024-09-22T08:36:43.307 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.293+0000 7fc290aa1640 1 -- 172.21.15.142:0/1851722695 <== osd.1 v2:172.21.15.142:6816/3192108003 23 ==== watch-notify(notify (1) cookie 94392340509808 notify 128849018882 ret 0) ==== 609+0+0 (crc 0 0 0) 0x7fc27c081040 con 0x55d96dec06d0 2024-09-22T08:36:43.307 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.293+0000 7fc174ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018882 cookie 94392340509808 notifier 4324 bl.length()=567 2024-09-22T08:36:43.307 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.293+0000 7fc174ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-22T08:36:43.307 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.293+0000 7fc174ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-22T08:36:43.307 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.293+0000 7fc290aa1640 1 -- 172.21.15.142:0/1851722695 <== osd.1 v2:172.21.15.142:6816/3192108003 24 ==== osd_op_reply(65 notify.4 [notify cookie 94392340764608 out=8b] v0'0 uv39 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fc27c051070 con 0x55d96dec06d0 2024-09-22T08:36:43.307 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.293+0000 7fc174ff9640 1 -- 172.21.15.142:0/1851722695 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7fc154003ea0 con 0x55d96dec06d0 2024-09-22T08:36:43.307 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.293+0000 7fc290aa1640 1 -- 172.21.15.142:0/1851722695 <== osd.1 v2:172.21.15.142:6816/3192108003 25 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc27c051070 con 0x55d96dec06d0 2024-09-22T08:36:43.307 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.293+0000 7fc290aa1640 1 -- 172.21.15.142:0/1851722695 <== osd.1 v2:172.21.15.142:6816/3192108003 26 ==== watch-notify(notify_complete (2) cookie 94392340764608 notify 128849018882 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55d96dd96780 con 0x55d96dec06d0 2024-09-22T08:36:43.307 INFO:teuthology.orchestra.run.smithi142.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-22T08:36:42.661297Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-22T08:36:42.661288Z","tags":[],"group_ids":[]} 2024-09-22T08:36:43.312 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.294+0000 7fc147fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:36:43.312 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.294+0000 7fc29551f800 1 -- 172.21.15.142:0/1851722695 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:67 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94392340514992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d96df058d0 con 0x55d96dec06d0 2024-09-22T08:36:43.312 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.295+0000 7fc290aa1640 1 -- 172.21.15.142:0/1851722695 <== osd.1 v2:172.21.15.142:6816/3192108003 27 ==== osd_op_reply(67 data_loggenerations_metadata [watch unwatch cookie 94392340514992] v30'61 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc27c051070 con 0x55d96dec06d0 2024-09-22T08:36:43.312 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.295+0000 7fc29551f800 1 -- 172.21.15.142:0/1851722695 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94392340491936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d96df058d0 con 0x7fc28c021020 2024-09-22T08:36:43.312 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.296+0000 7fc2912a2640 1 -- 172.21.15.142:0/1851722695 <== osd.2 v2:172.21.15.142:6808/279438927 12 ==== osd_op_reply(68 notify.0 [watch unwatch cookie 94392340491936] v30'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc28401b070 con 0x7fc28c021020 2024-09-22T08:36:43.312 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.296+0000 7fc29551f800 20 remove_watcher() i=0 2024-09-22T08:36:43.313 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.296+0000 7fc29551f800 2 removed watcher, disabling cache 2024-09-22T08:36:43.313 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.296+0000 7fc29551f800 1 -- 172.21.15.142:0/1851722695 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:69 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94392340499120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d96df058d0 con 0x55d96dec06d0 2024-09-22T08:36:43.313 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.297+0000 7fc290aa1640 1 -- 172.21.15.142:0/1851722695 <== osd.1 v2:172.21.15.142:6816/3192108003 28 ==== osd_op_reply(69 notify.1 [watch unwatch cookie 94392340499120] v30'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc27c051070 con 0x55d96dec06d0 2024-09-22T08:36:43.313 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.297+0000 7fc29551f800 20 remove_watcher() i=1 2024-09-22T08:36:43.313 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.297+0000 7fc29551f800 1 -- 172.21.15.142:0/1851722695 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:70 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94392340500656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d96df058d0 con 0x55d96dec50e0 2024-09-22T08:36:43.313 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.298+0000 7fc291aa3640 1 -- 172.21.15.142:0/1851722695 <== osd.3 v2:172.21.15.142:6800/1064901393 16 ==== osd_op_reply(70 notify.2 [watch unwatch cookie 94392340500656] v30'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc28c062040 con 0x55d96dec50e0 2024-09-22T08:36:43.313 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.298+0000 7fc29551f800 20 remove_watcher() i=2 2024-09-22T08:36:43.313 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.298+0000 7fc29551f800 1 -- 172.21.15.142:0/1851722695 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:71 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94392340504736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d96df058d0 con 0x7fc28c021020 2024-09-22T08:36:43.313 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.299+0000 7fc2912a2640 1 -- 172.21.15.142:0/1851722695 <== osd.2 v2:172.21.15.142:6808/279438927 13 ==== osd_op_reply(71 notify.3 [watch unwatch cookie 94392340504736] v30'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc28401b070 con 0x7fc28c021020 2024-09-22T08:36:43.313 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.299+0000 7fc29551f800 20 remove_watcher() i=3 2024-09-22T08:36:43.313 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.299+0000 7fc29551f800 1 -- 172.21.15.142:0/1851722695 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:72 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94392340509808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d96df058d0 con 0x55d96dec06d0 2024-09-22T08:36:43.313 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.300+0000 7fc290aa1640 1 -- 172.21.15.142:0/1851722695 <== osd.1 v2:172.21.15.142:6816/3192108003 29 ==== osd_op_reply(72 notify.4 [watch unwatch cookie 94392340509808] v30'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc27c051070 con 0x55d96dec06d0 2024-09-22T08:36:43.314 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.300+0000 7fc29551f800 20 remove_watcher() i=4 2024-09-22T08:36:43.314 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.300+0000 7fc29551f800 1 -- 172.21.15.142:0/1851722695 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:73 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94392340501808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d96df058d0 con 0x7fc284027020 2024-09-22T08:36:43.314 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.301+0000 7fc290aa1640 1 -- 172.21.15.142:0/1851722695 <== osd.0 v2:172.21.15.31:6800/168281188 17 ==== osd_op_reply(73 notify.5 [watch unwatch cookie 94392340501808] v30'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc27c051070 con 0x7fc284027020 2024-09-22T08:36:43.314 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.301+0000 7fc29551f800 20 remove_watcher() i=5 2024-09-22T08:36:43.314 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.301+0000 7fc29551f800 1 -- 172.21.15.142:0/1851722695 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:74 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94392340507088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d96df058d0 con 0x7fc284027020 2024-09-22T08:36:43.314 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.302+0000 7fc290aa1640 1 -- 172.21.15.142:0/1851722695 <== osd.0 v2:172.21.15.31:6800/168281188 18 ==== osd_op_reply(74 notify.6 [watch unwatch cookie 94392340507088] v30'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc27c051070 con 0x7fc284027020 2024-09-22T08:36:43.314 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.302+0000 7fc29551f800 20 remove_watcher() i=6 2024-09-22T08:36:43.314 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.302+0000 7fc29551f800 1 -- 172.21.15.142:0/1851722695 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:75 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94392340517616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d96df058d0 con 0x7fc284027020 2024-09-22T08:36:43.314 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.303+0000 7fc290aa1640 1 -- 172.21.15.142:0/1851722695 <== osd.0 v2:172.21.15.31:6800/168281188 19 ==== osd_op_reply(75 notify.7 [watch unwatch cookie 94392340517616] v30'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc27c051070 con 0x7fc284027020 2024-09-22T08:36:43.314 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.303+0000 7fc29551f800 20 remove_watcher() i=7 2024-09-22T08:36:43.314 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.303+0000 7fc29551f800 1 -- 172.21.15.142:0/1851722695 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7fc284027020 msgr2=0x7fc28401e3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:43.314 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.303+0000 7fc29551f800 1 --2- 172.21.15.142:0/1851722695 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7fc284027020 0x7fc28401e3f0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:43.314 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.303+0000 7fc29551f800 1 -- 172.21.15.142:0/1851722695 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55d96dec06d0 msgr2=0x55d96dec2b90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:43.314 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.303+0000 7fc29551f800 1 --2- 172.21.15.142:0/1851722695 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55d96dec06d0 0x55d96dec2b90 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:43.315 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.303+0000 7fc29551f800 1 -- 172.21.15.142:0/1851722695 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7fc28c021020 msgr2=0x7fc28c03ba80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:43.315 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.303+0000 7fc29551f800 1 --2- 172.21.15.142:0/1851722695 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7fc28c021020 0x7fc28c03ba80 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:43.315 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.303+0000 7fc29551f800 1 -- 172.21.15.142:0/1851722695 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55d96dec50e0 msgr2=0x55d96dec74d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:43.315 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.303+0000 7fc29551f800 1 --2- 172.21.15.142:0/1851722695 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55d96dec50e0 0x55d96dec74d0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:43.315 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.304+0000 7fc29551f800 1 -- 172.21.15.142:0/1851722695 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fc15c03cfb0 msgr2=0x7fc15c03f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:43.315 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.304+0000 7fc29551f800 1 --2- 172.21.15.142:0/1851722695 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fc15c03cfb0 0x7fc15c03f470 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fc284052db0 tx=0x7fc28401df90 comp rx=0 tx=0).stop 2024-09-22T08:36:43.315 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.304+0000 7fc29551f800 1 -- 172.21.15.142:0/1851722695 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d96dead810 msgr2=0x55d96deb4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:43.315 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.304+0000 7fc290aa1640 1 -- 172.21.15.142:0/1851722695 reap_dead start 2024-09-22T08:36:43.315 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.304+0000 7fc29551f800 1 --2- 172.21.15.142:0/1851722695 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d96dead810 0x55d96deb4e10 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fc28c0206f0 tx=0x7fc28c053d50 comp rx=0 tx=0).stop 2024-09-22T08:36:43.315 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.304+0000 7fc29551f800 1 -- 172.21.15.142:0/1851722695 shutdown_connections 2024-09-22T08:36:43.315 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.304+0000 7fc29551f800 1 --2- 172.21.15.142:0/1851722695 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d96dead810 0x55d96deb4e10 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:43.315 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.304+0000 7fc29551f800 1 -- 172.21.15.142:0/1851722695 >> 172.21.15.142:0/1851722695 conn(0x55d96dea9c30 msgr2=0x55d96dea7e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:43.315 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.304+0000 7fc29551f800 1 -- 172.21.15.142:0/1851722695 shutdown_connections 2024-09-22T08:36:43.315 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.304+0000 7fc29551f800 1 -- 172.21.15.142:0/1851722695 wait complete. 2024-09-22T08:36:43.316 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.304+0000 7fc29551f800 1 -- 172.21.15.142:0/3833881636 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fc16803cfb0 msgr2=0x7fc16803f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:43.316 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.304+0000 7fc29551f800 1 --2- 172.21.15.142:0/3833881636 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fc16803cfb0 0x7fc16803f470 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fc284052b50 tx=0x7fc284011f40 comp rx=0 tx=0).stop 2024-09-22T08:36:43.316 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.304+0000 7fc29551f800 1 -- 172.21.15.142:0/3833881636 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d96dea0dd0 msgr2=0x55d96dea11f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:43.316 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.304+0000 7fc29551f800 1 --2- 172.21.15.142:0/3833881636 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d96dea0dd0 0x55d96dea11f0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x55d96de86d90 tx=0x7fc28c00bf30 comp rx=0 tx=0).stop 2024-09-22T08:36:43.316 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.304+0000 7fc29551f800 1 -- 172.21.15.142:0/3833881636 shutdown_connections 2024-09-22T08:36:43.316 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.304+0000 7fc29551f800 1 --2- 172.21.15.142:0/3833881636 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fc16803cfb0 0x7fc16803f470 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:43.316 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.304+0000 7fc29551f800 1 --2- 172.21.15.142:0/3833881636 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d96dea0dd0 0x55d96dea11f0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:43.316 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.304+0000 7fc29551f800 1 -- 172.21.15.142:0/3833881636 >> 172.21.15.142:0/3833881636 conn(0x55d96de95180 msgr2=0x55d96de95560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:43.316 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.304+0000 7fc29551f800 1 -- 172.21.15.142:0/3833881636 shutdown_connections 2024-09-22T08:36:43.316 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.304+0000 7fc29551f800 1 -- 172.21.15.142:0/3833881636 wait complete. 2024-09-22T08:36:43.316 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.304+0000 7fc29551f800 1 -- 172.21.15.142:0/1397389357 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55d96dd92c00 msgr2=0x55d96de8d3e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:43.316 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.304+0000 7fc29551f800 1 --2- 172.21.15.142:0/1397389357 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55d96dd92c00 0x55d96de8d3e0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:43.316 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.304+0000 7fc29551f800 1 -- 172.21.15.142:0/1397389357 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55d96de8f7c0 msgr2=0x55d96de91c40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:43.316 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.304+0000 7fc29551f800 1 --2- 172.21.15.142:0/1397389357 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55d96de8f7c0 0x55d96de91c40 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:43.317 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.305+0000 7fc29551f800 1 -- 172.21.15.142:0/1397389357 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fc17803cfb0 msgr2=0x7fc17803f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:43.317 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.305+0000 7fc29551f800 1 --2- 172.21.15.142:0/1397389357 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fc17803cfb0 0x7fc17803f470 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fc27c057000 tx=0x7fc27c052000 comp rx=0 tx=0).stop 2024-09-22T08:36:43.317 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.305+0000 7fc29551f800 1 -- 172.21.15.142:0/1397389357 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d96dcffd30 msgr2=0x55d96de85d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:43.317 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.305+0000 7fc29551f800 1 --2- 172.21.15.142:0/1397389357 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d96dcffd30 0x55d96de85d90 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fc284000f80 tx=0x7fc284001250 comp rx=0 tx=0).stop 2024-09-22T08:36:43.317 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.305+0000 7fc29551f800 1 -- 172.21.15.142:0/1397389357 shutdown_connections 2024-09-22T08:36:43.317 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.305+0000 7fc29551f800 1 --2- 172.21.15.142:0/1397389357 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55d96de8f7c0 0x55d96de91c40 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:43.317 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.305+0000 7fc29551f800 1 --2- 172.21.15.142:0/1397389357 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55d96dd92c00 0x55d96de8d3e0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:43.317 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.305+0000 7fc29551f800 1 --2- 172.21.15.142:0/1397389357 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fc17803cfb0 0x7fc17803f470 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:43.317 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.305+0000 7fc29551f800 1 --2- 172.21.15.142:0/1397389357 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d96dcffd30 0x55d96de85d90 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:43.317 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.305+0000 7fc29551f800 1 -- 172.21.15.142:0/1397389357 >> 172.21.15.142:0/1397389357 conn(0x55d96dd86bb0 msgr2=0x55d96de7f710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:43.317 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.305+0000 7fc29551f800 1 -- 172.21.15.142:0/1397389357 shutdown_connections 2024-09-22T08:36:43.317 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.305+0000 7fc29551f800 1 -- 172.21.15.142:0/1397389357 wait complete. 2024-09-22T08:36:43.318 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-22T08:36:42.661297Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-22T08:36:42.661288Z', 'tags': [], 'group_ids': []} 2024-09-22T08:36:43.318 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-22T08:36:43.318 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-22T08:36:43.319 DEBUG:teuthology.orchestra.run.smithi142:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-22T08:36:43.404 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:36:43.405 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:36:43.406 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.404+0000 7f9ce300f800 1 Processor -- start 2024-09-22T08:36:43.406 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.404+0000 7f9ce300f800 1 -- start start 2024-09-22T08:36:43.406 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.404+0000 7f9ce300f800 1 --2- >> v2:172.21.15.31:3300/0 conn(0x56506ab5a9e0 0x56506ab5b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:43.406 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.404+0000 7f9ce300f800 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56506a9e5a20 con 0x56506ab5bae0 2024-09-22T08:36:43.406 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.404+0000 7f9ce300f800 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x56506a9e57d0 con 0x56506ab5a9e0 2024-09-22T08:36:43.406 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.404+0000 7f9cde792640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x56506ab5a9e0 0x56506ab5b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:43.406 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.404+0000 7f9cde792640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x56506ab5a9e0 0x56506ab5b5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:38206/0 (socket says 172.21.15.142:38206) 2024-09-22T08:36:43.406 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.404+0000 7f9cd7fff640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x56506ab5bae0 0x56506ab60630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.142:42342/0 (socket says 172.21.15.142:42342) 2024-09-22T08:36:43.406 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.404+0000 7f9cde792640 1 -- 172.21.15.142:0/1898506100 learned_addr learned my addr 172.21.15.142:0/1898506100 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:43.406 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.405+0000 7f9cde792640 1 -- 172.21.15.142:0/1898506100 >> v1:172.21.15.31:6789/0 conn(0x56506ab5bae0 legacy=0x56506ab60630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:43.406 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.405+0000 7f9cde792640 1 -- 172.21.15.142:0/1898506100 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56506ab5b0e0 con 0x56506ab5a9e0 2024-09-22T08:36:43.407 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.405+0000 7f9cddf91640 1 -- 172.21.15.142:0/1898506100 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2910080265 0 0) 0x56506a9e5a20 con 0x56506ab5bae0 2024-09-22T08:36:43.408 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.407+0000 7f9cde792640 1 --2- 172.21.15.142:0/1898506100 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56506ab5a9e0 0x56506ab5b5a0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f9cd000a520 tx=0x7f9cd0045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cb157050acc1c1f server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:43.408 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.407+0000 7f9cddf91640 1 -- 172.21.15.142:0/1898506100 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9cd0055070 con 0x56506ab5a9e0 2024-09-22T08:36:43.408 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.407+0000 7f9cddf91640 1 -- 172.21.15.142:0/1898506100 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9cd00515b0 con 0x56506ab5a9e0 2024-09-22T08:36:43.408 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.407+0000 7f9cddf91640 1 -- 172.21.15.142:0/1898506100 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9cd00518d0 con 0x56506ab5a9e0 2024-09-22T08:36:43.409 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.407+0000 7f9ce300f800 1 -- 172.21.15.142:0/1898506100 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56506ab5a9e0 msgr2=0x56506ab5b5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:43.409 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.407+0000 7f9ce300f800 1 --2- 172.21.15.142:0/1898506100 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56506ab5a9e0 0x56506ab5b5a0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f9cd000a520 tx=0x7f9cd0045ba0 comp rx=0 tx=0).stop 2024-09-22T08:36:43.409 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.407+0000 7f9ce300f800 1 -- 172.21.15.142:0/1898506100 shutdown_connections 2024-09-22T08:36:43.409 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.407+0000 7f9ce300f800 1 --2- 172.21.15.142:0/1898506100 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56506ab5a9e0 0x56506ab5b5a0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:43.409 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.407+0000 7f9ce300f800 1 -- 172.21.15.142:0/1898506100 >> 172.21.15.142:0/1898506100 conn(0x56506ab55db0 msgr2=0x56506ab58210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:43.409 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.407+0000 7f9ce300f800 1 -- 172.21.15.142:0/1898506100 shutdown_connections 2024-09-22T08:36:43.409 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.407+0000 7f9ce300f800 1 -- 172.21.15.142:0/1898506100 wait complete. 2024-09-22T08:36:43.422 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.421+0000 7f9ce300f800 1 Processor -- start 2024-09-22T08:36:43.422 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.421+0000 7f9ce300f800 1 -- start start 2024-09-22T08:36:43.422 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.421+0000 7f9ce300f800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56506ab5a9e0 0x56506ac49e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:43.423 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.421+0000 7f9ce300f800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x56506a9f2dd0 con 0x56506ab5a9e0 2024-09-22T08:36:43.423 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.421+0000 7f9cde792640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56506ab5a9e0 0x56506ac49e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:43.423 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.421+0000 7f9cde792640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56506ab5a9e0 0x56506ac49e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:38214/0 (socket says 172.21.15.142:38214) 2024-09-22T08:36:43.423 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.421+0000 7f9cde792640 1 -- 172.21.15.142:0/4012627587 learned_addr learned my addr 172.21.15.142:0/4012627587 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:43.425 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.422+0000 7f9cde792640 1 -- 172.21.15.142:0/4012627587 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56506ac4a3f0 con 0x56506ab5a9e0 2024-09-22T08:36:43.425 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.422+0000 7f9cde792640 1 --2- 172.21.15.142:0/4012627587 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56506ab5a9e0 0x56506ac49e00 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f9cd0025da0 tx=0x7f9cd0051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=511db53e265677b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:43.425 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.422+0000 7f9bcc608640 1 -- 172.21.15.142:0/4012627587 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9cd0051950 con 0x56506ab5a9e0 2024-09-22T08:36:43.425 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.422+0000 7f9bcc608640 1 -- 172.21.15.142:0/4012627587 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9cd0051af0 con 0x56506ab5a9e0 2024-09-22T08:36:43.425 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.422+0000 7f9bcc608640 1 -- 172.21.15.142:0/4012627587 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9cd0051dd0 con 0x56506ab5a9e0 2024-09-22T08:36:43.425 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.423+0000 7f9ce300f800 1 -- 172.21.15.142:0/4012627587 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56506ab5a9e0 msgr2=0x56506ac49e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:43.425 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.423+0000 7f9ce300f800 1 --2- 172.21.15.142:0/4012627587 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56506ab5a9e0 0x56506ac49e00 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f9cd0025da0 tx=0x7f9cd0051000 comp rx=0 tx=0).stop 2024-09-22T08:36:43.425 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.423+0000 7f9ce300f800 1 -- 172.21.15.142:0/4012627587 shutdown_connections 2024-09-22T08:36:43.426 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.423+0000 7f9ce300f800 1 --2- 172.21.15.142:0/4012627587 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56506ab5a9e0 0x56506ac49e00 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:43.426 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.423+0000 7f9ce300f800 1 -- 172.21.15.142:0/4012627587 >> 172.21.15.142:0/4012627587 conn(0x56506ab55db0 msgr2=0x56506ac45780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:43.426 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.423+0000 7f9ce300f800 1 -- 172.21.15.142:0/4012627587 shutdown_connections 2024-09-22T08:36:43.426 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.423+0000 7f9ce300f800 1 -- 172.21.15.142:0/4012627587 wait complete. 2024-09-22T08:36:43.426 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.423+0000 7f9ce300f800 1 Processor -- start 2024-09-22T08:36:43.426 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.423+0000 7f9ce300f800 1 -- start start 2024-09-22T08:36:43.426 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.423+0000 7f9ce300f800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56506ab5bae0 0x56506ac519a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:43.426 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.423+0000 7f9ce300f800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x56506ab5c350 con 0x56506ab5bae0 2024-09-22T08:36:43.426 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.423+0000 7f9cde792640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56506ab5bae0 0x56506ac519a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:43.426 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.423+0000 7f9cde792640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56506ab5bae0 0x56506ac519a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:38220/0 (socket says 172.21.15.142:38220) 2024-09-22T08:36:43.426 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.423+0000 7f9cde792640 1 -- 172.21.15.142:0/981395207 learned_addr learned my addr 172.21.15.142:0/981395207 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:43.426 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.424+0000 7f9cde792640 1 -- 172.21.15.142:0/981395207 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56506ac51f00 con 0x56506ab5bae0 2024-09-22T08:36:43.426 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.424+0000 7f9cde792640 1 --2- 172.21.15.142:0/981395207 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56506ab5bae0 0x56506ac519a0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f9cd0025da0 tx=0x7f9cd0002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:43.430 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.424+0000 7f9bcae05640 1 -- 172.21.15.142:0/981395207 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9cd0073070 con 0x56506ab5bae0 2024-09-22T08:36:43.430 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.424+0000 7f9ce300f800 1 -- 172.21.15.142:0/981395207 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56506ac52190 con 0x56506ab5bae0 2024-09-22T08:36:43.430 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.424+0000 7f9bcae05640 1 -- 172.21.15.142:0/981395207 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9cd005a580 con 0x56506ab5bae0 2024-09-22T08:36:43.430 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.424+0000 7f9bcae05640 1 -- 172.21.15.142:0/981395207 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9cd005a880 con 0x56506ab5bae0 2024-09-22T08:36:43.430 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.424+0000 7f9ce300f800 1 -- 172.21.15.142:0/981395207 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56506ac52da0 con 0x56506ab5bae0 2024-09-22T08:36:43.430 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.425+0000 7f9bcae05640 1 -- 172.21.15.142:0/981395207 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f9cd0076070 con 0x56506ab5bae0 2024-09-22T08:36:43.430 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.425+0000 7f9bcae05640 1 --2- 172.21.15.142:0/981395207 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f9bc403cfb0 0x7f9bc403f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:43.430 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.425+0000 7f9bcae05640 1 -- 172.21.15.142:0/981395207 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f9cd006b040 con 0x56506ab5bae0 2024-09-22T08:36:43.430 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.425+0000 7f9cd7fff640 1 --2- 172.21.15.142:0/981395207 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f9bc403cfb0 0x7f9bc403f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:43.430 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.425+0000 7f9ce300f800 1 --2- 172.21.15.142:0/981395207 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x56506ac56fe0 0x56506ac593d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:43.430 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.425+0000 7f9ce300f800 1 -- 172.21.15.142:0/981395207 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56506ac59910 con 0x56506ac56fe0 2024-09-22T08:36:43.431 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.426+0000 7f9cdef93640 1 --2- 172.21.15.142:0/981395207 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x56506ac56fe0 0x56506ac593d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:43.431 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.426+0000 7f9cd7fff640 1 --2- 172.21.15.142:0/981395207 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f9bc403cfb0 0x7f9bc403f470 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f9cc8000c00 tx=0x7f9cc80013b0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:43.431 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.426+0000 7f9cdef93640 1 --2- 172.21.15.142:0/981395207 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x56506ac56fe0 0x56506ac593d0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:43.431 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.426+0000 7f9cdef93640 1 -- 172.21.15.142:0/981395207 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9cd800a4d0 con 0x56506ac56fe0 2024-09-22T08:36:43.431 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.426+0000 7f9ce300f800 1 -- 172.21.15.142:0/981395207 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56506ac59cb0 con 0x56506ac56fe0 2024-09-22T08:36:43.431 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.426+0000 7f9cdef93640 1 -- 172.21.15.142:0/981395207 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9cd800a4d0 con 0x56506ac56fe0 2024-09-22T08:36:43.431 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.426+0000 7f9ce300f800 1 --2- 172.21.15.142:0/981395207 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x56506ac5b7b0 0x56506ac5dc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:43.431 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.426+0000 7f9ce300f800 1 -- 172.21.15.142:0/981395207 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:3 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56506ac5e3e0 con 0x56506ac5b7b0 2024-09-22T08:36:43.431 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.427+0000 7f9cde792640 1 --2- 172.21.15.142:0/981395207 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x56506ac5b7b0 0x56506ac5dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:43.431 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.427+0000 7f9cde792640 1 --2- 172.21.15.142:0/981395207 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x56506ac5b7b0 0x56506ac5dc50 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:43.431 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.427+0000 7f9cde792640 1 -- 172.21.15.142:0/981395207 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(3 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f9cd0075030 con 0x56506ac5b7b0 2024-09-22T08:36:43.431 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.427+0000 7f9ce300f800 1 -- 172.21.15.142:0/981395207 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56506ac5a500 con 0x56506ac56fe0 2024-09-22T08:36:43.432 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.427+0000 7f9cdef93640 1 -- 172.21.15.142:0/981395207 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9cd800a4d0 con 0x56506ac56fe0 2024-09-22T08:36:43.432 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.427+0000 7f9ce300f800 1 -- 172.21.15.142:0/981395207 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56506ac5a8f0 con 0x56506ac5b7b0 2024-09-22T08:36:43.432 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.428+0000 7f9cde792640 1 -- 172.21.15.142:0/981395207 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(5 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f9cd0075030 con 0x56506ac5b7b0 2024-09-22T08:36:43.432 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.428+0000 7f9ce300f800 1 Processor -- start 2024-09-22T08:36:43.432 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.428+0000 7f9ce300f800 1 -- start start 2024-09-22T08:36:43.432 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.428+0000 7f9ce300f800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56506ac6cd70 0x56506ac6d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:43.432 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.428+0000 7f9ce300f800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x56506aa51d50 con 0x56506ac6cd70 2024-09-22T08:36:43.432 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.429+0000 7f9cdef93640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56506ac6cd70 0x56506ac6d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:43.432 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.429+0000 7f9cdef93640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56506ac6cd70 0x56506ac6d190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:38222/0 (socket says 172.21.15.142:38222) 2024-09-22T08:36:43.432 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.429+0000 7f9cdef93640 1 -- 172.21.15.142:0/3930520012 learned_addr learned my addr 172.21.15.142:0/3930520012 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:43.432 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.429+0000 7f9cdef93640 1 -- 172.21.15.142:0/3930520012 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56506ac6d7d0 con 0x56506ac6cd70 2024-09-22T08:36:43.441 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.429+0000 7f9cdef93640 1 --2- 172.21.15.142:0/3930520012 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56506ac6cd70 0x56506ac6d190 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x56506ac529a0 tx=0x7f9cd80167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:43.441 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.429+0000 7f9bc3fff640 1 -- 172.21.15.142:0/3930520012 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9cd8013640 con 0x56506ac6cd70 2024-09-22T08:36:43.441 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.429+0000 7f9bc3fff640 1 -- 172.21.15.142:0/3930520012 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9cd80137e0 con 0x56506ac6cd70 2024-09-22T08:36:43.441 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.429+0000 7f9ce300f800 1 -- 172.21.15.142:0/3930520012 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56506ac6e000 con 0x56506ac6cd70 2024-09-22T08:36:43.441 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.429+0000 7f9bc3fff640 1 -- 172.21.15.142:0/3930520012 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9cd8013ae0 con 0x56506ac6cd70 2024-09-22T08:36:43.441 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.429+0000 7f9ce300f800 1 -- 172.21.15.142:0/3930520012 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56506ac6e5a0 con 0x56506ac6cd70 2024-09-22T08:36:43.441 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.430+0000 7f9bc3fff640 1 -- 172.21.15.142:0/3930520012 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f9cd8011040 con 0x56506ac6cd70 2024-09-22T08:36:43.441 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.430+0000 7f9bc3fff640 1 --2- 172.21.15.142:0/3930520012 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f9bb803cfb0 0x7f9bb803f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:43.442 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.430+0000 7f9bc3fff640 1 -- 172.21.15.142:0/3930520012 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f9cd800e040 con 0x56506ac6cd70 2024-09-22T08:36:43.442 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.430+0000 7f9cde792640 1 --2- 172.21.15.142:0/3930520012 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f9bb803cfb0 0x7f9bb803f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:43.442 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.431+0000 7f9ce300f800 1 Processor -- start 2024-09-22T08:36:43.442 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.431+0000 7f9cde792640 1 --2- 172.21.15.142:0/3930520012 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f9bb803cfb0 0x7f9bb803f470 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f9cd0077bd0 tx=0x7f9cd0095f70 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:43.442 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.431+0000 7f9ce300f800 1 -- start start 2024-09-22T08:36:43.442 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.431+0000 7f9ce300f800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56506ac79830 0x56506ac79c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:43.442 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.431+0000 7f9ce300f800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x56506ac4a760 con 0x56506ac79830 2024-09-22T08:36:43.442 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.431+0000 7f9cdef93640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56506ac79830 0x56506ac79c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:43.442 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.431+0000 7f9cdef93640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56506ac79830 0x56506ac79c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:38224/0 (socket says 172.21.15.142:38224) 2024-09-22T08:36:43.442 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.431+0000 7f9cdef93640 1 -- 172.21.15.142:0/1411144903 learned_addr learned my addr 172.21.15.142:0/1411144903 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:43.442 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.431+0000 7f9cdef93640 1 -- 172.21.15.142:0/1411144903 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56506ac7a220 con 0x56506ac79830 2024-09-22T08:36:43.442 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.432+0000 7f9cdef93640 1 --2- 172.21.15.142:0/1411144903 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56506ac79830 0x56506ac79c30 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f9cd8054840 tx=0x7f9cd80204d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3046f1b9c234c296 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:43.442 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.432+0000 7f9bc1ffb640 1 -- 172.21.15.142:0/1411144903 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9cd8051020 con 0x56506ac79830 2024-09-22T08:36:43.443 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.432+0000 7f9bc1ffb640 1 -- 172.21.15.142:0/1411144903 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9cd8021a40 con 0x56506ac79830 2024-09-22T08:36:43.443 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.432+0000 7f9bc1ffb640 1 -- 172.21.15.142:0/1411144903 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9cd80215b0 con 0x56506ac79830 2024-09-22T08:36:43.443 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.432+0000 7f9ce300f800 1 -- 172.21.15.142:0/1411144903 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56506ac79830 msgr2=0x56506ac79c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:43.443 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.432+0000 7f9ce300f800 1 --2- 172.21.15.142:0/1411144903 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56506ac79830 0x56506ac79c30 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f9cd8054840 tx=0x7f9cd80204d0 comp rx=0 tx=0).stop 2024-09-22T08:36:43.443 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.432+0000 7f9ce300f800 1 -- 172.21.15.142:0/1411144903 shutdown_connections 2024-09-22T08:36:43.443 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.432+0000 7f9ce300f800 1 --2- 172.21.15.142:0/1411144903 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56506ac79830 0x56506ac79c30 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:43.443 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.432+0000 7f9ce300f800 1 -- 172.21.15.142:0/1411144903 >> 172.21.15.142:0/1411144903 conn(0x56506ac75c30 msgr2=0x56506ac73e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:43.443 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.432+0000 7f9ce300f800 1 -- 172.21.15.142:0/1411144903 shutdown_connections 2024-09-22T08:36:43.443 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.432+0000 7f9ce300f800 1 -- 172.21.15.142:0/1411144903 wait complete. 2024-09-22T08:36:43.443 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.432+0000 7f9ce300f800 1 Processor -- start 2024-09-22T08:36:43.443 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.433+0000 7f9ce300f800 1 -- start start 2024-09-22T08:36:43.443 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.433+0000 7f9ce300f800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56506ac79830 0x56506aad0240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:43.443 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.433+0000 7f9ce300f800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x56506ac7a840 con 0x56506ac79830 2024-09-22T08:36:43.443 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.433+0000 7f9cdef93640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56506ac79830 0x56506aad0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:43.444 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.433+0000 7f9cdef93640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56506ac79830 0x56506aad0240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:38234/0 (socket says 172.21.15.142:38234) 2024-09-22T08:36:43.444 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.433+0000 7f9cdef93640 1 -- 172.21.15.142:0/2205049680 learned_addr learned my addr 172.21.15.142:0/2205049680 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:43.444 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.433+0000 7f9cdef93640 1 -- 172.21.15.142:0/2205049680 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56506aad07a0 con 0x56506ac79830 2024-09-22T08:36:43.444 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.433+0000 7f9cdef93640 1 --2- 172.21.15.142:0/2205049680 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56506ac79830 0x56506aad0240 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f9cd8020510 tx=0x7f9cd80547a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:43.444 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.433+0000 7f9baffff640 1 -- 172.21.15.142:0/2205049680 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9cd8045d20 con 0x56506ac79830 2024-09-22T08:36:43.444 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.433+0000 7f9baffff640 1 -- 172.21.15.142:0/2205049680 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9cd8054950 con 0x56506ac79830 2024-09-22T08:36:43.444 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.433+0000 7f9baffff640 1 -- 172.21.15.142:0/2205049680 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9cd8054c50 con 0x56506ac79830 2024-09-22T08:36:43.444 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.433+0000 7f9ce300f800 1 -- 172.21.15.142:0/2205049680 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56506aaceb50 con 0x56506ac79830 2024-09-22T08:36:43.444 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.434+0000 7f9ce300f800 1 -- 172.21.15.142:0/2205049680 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56506aacf0f0 con 0x56506ac79830 2024-09-22T08:36:43.445 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.434+0000 7f9baffff640 1 -- 172.21.15.142:0/2205049680 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f9cd80451d0 con 0x56506ac79830 2024-09-22T08:36:43.445 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.434+0000 7f9baffff640 1 --2- 172.21.15.142:0/2205049680 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f9ba803d000 0x7f9ba803f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:43.445 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.435+0000 7f9baffff640 1 -- 172.21.15.142:0/2205049680 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f9cd8034d80 con 0x56506ac79830 2024-09-22T08:36:43.445 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.435+0000 7f9cde792640 1 --2- 172.21.15.142:0/2205049680 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f9ba803d000 0x7f9ba803f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:43.445 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.435+0000 7f9ce300f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:43.445 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.435+0000 7f9ce300f800 1 --2- 172.21.15.142:0/2205049680 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x56506ac8e8d0 0x56506ac90d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:43.446 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.435+0000 7f9ce300f800 1 -- 172.21.15.142:0/2205049680 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56506ac914b0 con 0x56506ac8e8d0 2024-09-22T08:36:43.446 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.435+0000 7f9cd7fff640 1 --2- 172.21.15.142:0/2205049680 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x56506ac8e8d0 0x56506ac90d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:43.446 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.435+0000 7f9cde792640 1 --2- 172.21.15.142:0/2205049680 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f9ba803d000 0x7f9ba803f4c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f9cd0078030 tx=0x7f9cd008d000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:43.446 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.435+0000 7f9cd7fff640 1 --2- 172.21.15.142:0/2205049680 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x56506ac8e8d0 0x56506ac90d60 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:43.446 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.435+0000 7f9cd7fff640 1 -- 172.21.15.142:0/2205049680 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9cc800f5f0 con 0x56506ac8e8d0 2024-09-22T08:36:43.446 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.435+0000 7f9ce300f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:43.446 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.435+0000 7f9ce300f800 20 realm 2024-09-22T08:36:43.447 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.435+0000 7f9ce300f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:43.447 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.435+0000 7f9ce300f800 1 -- 172.21.15.142:0/2205049680 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56506ac8dc40 con 0x56506ac8e8d0 2024-09-22T08:36:43.447 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.436+0000 7f9cd7fff640 1 -- 172.21.15.142:0/2205049680 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9cc800f5f0 con 0x56506ac8e8d0 2024-09-22T08:36:43.447 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.436+0000 7f9ce300f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:43.447 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.436+0000 7f9ce300f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:36:43.447 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.436+0000 7f9ce300f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:43.447 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.436+0000 7f9ce300f800 1 -- 172.21.15.142:0/2205049680 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56506ac91f90 con 0x56506ac8e8d0 2024-09-22T08:36:43.447 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.436+0000 7f9cd7fff640 1 -- 172.21.15.142:0/2205049680 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9cc800f5f0 con 0x56506ac8e8d0 2024-09-22T08:36:43.448 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.436+0000 7f9ce300f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:43.448 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.436+0000 7f9ce300f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:43.448 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.436+0000 7f9ce300f800 1 -- 172.21.15.142:0/2205049680 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56506ac92860 con 0x56506ac8e8d0 2024-09-22T08:36:43.448 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.436+0000 7f9cd7fff640 1 -- 172.21.15.142:0/2205049680 <== osd.1 v2:172.21.15.142:6816/3192108003 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9cc800f5f0 con 0x56506ac8e8d0 2024-09-22T08:36:43.448 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.436+0000 7f9ce300f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:36:43.448 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.436+0000 7f9ce300f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:43.448 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.436+0000 7f9ce300f800 1 --2- 172.21.15.142:0/2205049680 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x56506ac93160 0x56506ac95570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:43.448 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.436+0000 7f9ce300f800 1 -- 172.21.15.142:0/2205049680 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56506ac95cd0 con 0x56506ac93160 2024-09-22T08:36:43.449 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.436+0000 7f9cdef93640 1 --2- 172.21.15.142:0/2205049680 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x56506ac93160 0x56506ac95570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:43.449 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.436+0000 7f9cdef93640 1 --2- 172.21.15.142:0/2205049680 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x56506ac93160 0x56506ac95570 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:43.449 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.437+0000 7f9cdef93640 1 -- 172.21.15.142:0/2205049680 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(5 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f9cd800a4d0 con 0x56506ac93160 2024-09-22T08:36:43.449 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.437+0000 7f9ce300f800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:36:43.449 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.437+0000 7f9ce300f800 20 searching for the correct realm 2024-09-22T08:36:43.449 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.437+0000 7f9ce300f800 1 -- 172.21.15.142:0/2205049680 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56506ac976b0 con 0x56506ac93160 2024-09-22T08:36:43.449 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.437+0000 7f9cdef93640 1 -- 172.21.15.142:0/2205049680 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9cd800a4d0 con 0x56506ac93160 2024-09-22T08:36:43.450 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.437+0000 7f9cdef93640 1 --2- 172.21.15.142:0/2205049680 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f9cd80454c0 0x7f9cd8023a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:43.450 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.437+0000 7f9cdef93640 1 -- 172.21.15.142:0/2205049680 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56506ac976b0 con 0x7f9cd80454c0 2024-09-22T08:36:43.450 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.437+0000 7f9cde792640 1 --2- 172.21.15.142:0/2205049680 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f9cd80454c0 0x7f9cd8023a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:43.450 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.437+0000 7f9cde792640 1 --2- 172.21.15.142:0/2205049680 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f9cd80454c0 0x7f9cd8023a80 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:43.450 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.438+0000 7f9cde792640 1 -- 172.21.15.142:0/2205049680 <== osd.2 v2:172.21.15.142:6808/279438927 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9cd0085050 con 0x7f9cd80454c0 2024-09-22T08:36:43.450 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.438+0000 7f9cde792640 1 --2- 172.21.15.142:0/2205049680 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f9cd00a4040 0x7f9cd0095300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:43.450 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.438+0000 7f9cde792640 1 -- 172.21.15.142:0/2205049680 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56506ac976b0 con 0x7f9cd00a4040 2024-09-22T08:36:43.451 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.438+0000 7f9cd7fff640 1 --2- 172.21.15.142:0/2205049680 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f9cd00a4040 0x7f9cd0095300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:43.451 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.438+0000 7f9cd7fff640 1 --2- 172.21.15.142:0/2205049680 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f9cd00a4040 0x7f9cd0095300 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:43.451 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.438+0000 7f9cd7fff640 1 -- 172.21.15.142:0/2205049680 <== osd.0 v2:172.21.15.31:6800/168281188 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9cc800f5f0 con 0x7f9cd00a4040 2024-09-22T08:36:43.451 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.438+0000 7f9cd7fff640 1 -- 172.21.15.142:0/2205049680 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56506ac976b0 con 0x56506ac8e8d0 2024-09-22T08:36:43.451 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.439+0000 7f9cd7fff640 1 -- 172.21.15.142:0/2205049680 <== osd.1 v2:172.21.15.142:6816/3192108003 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9cc800f5f0 con 0x56506ac8e8d0 2024-09-22T08:36:43.451 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.439+0000 7f9cd7fff640 1 -- 172.21.15.142:0/2205049680 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56506ac976b0 con 0x56506ac8e8d0 2024-09-22T08:36:43.451 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.439+0000 7f9cd7fff640 1 -- 172.21.15.142:0/2205049680 <== osd.1 v2:172.21.15.142:6816/3192108003 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9cc802b040 con 0x56506ac8e8d0 2024-09-22T08:36:43.452 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.439+0000 7f9cd7fff640 1 -- 172.21.15.142:0/2205049680 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56506ac976b0 con 0x7f9cd00a4040 2024-09-22T08:36:43.452 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.439+0000 7f9cd7fff640 1 -- 172.21.15.142:0/2205049680 <== osd.0 v2:172.21.15.31:6800/168281188 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9cc802b040 con 0x7f9cd00a4040 2024-09-22T08:36:43.452 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.439+0000 7f9cd7fff640 1 -- 172.21.15.142:0/2205049680 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56506ac976b0 con 0x7f9cd00a4040 2024-09-22T08:36:43.452 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.439+0000 7f9cd7fff640 1 -- 172.21.15.142:0/2205049680 <== osd.0 v2:172.21.15.31:6800/168281188 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9cc802b040 con 0x7f9cd00a4040 2024-09-22T08:36:43.452 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.439+0000 7f9cd7fff640 1 -- 172.21.15.142:0/2205049680 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56506ac976b0 con 0x7f9cd80454c0 2024-09-22T08:36:43.452 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.440+0000 7f9cde792640 1 -- 172.21.15.142:0/2205049680 <== osd.2 v2:172.21.15.142:6808/279438927 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9cd0085050 con 0x7f9cd80454c0 2024-09-22T08:36:43.452 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.440+0000 7f9cde792640 1 -- 172.21.15.142:0/2205049680 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56506ac976b0 con 0x56506ac93160 2024-09-22T08:36:43.452 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.440+0000 7f9cdef93640 1 -- 172.21.15.142:0/2205049680 <== osd.3 v2:172.21.15.142:6800/1064901393 3 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9cd800a4d0 con 0x56506ac93160 2024-09-22T08:36:43.452 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.440+0000 7f9cdef93640 1 -- 172.21.15.142:0/2205049680 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56506ac976b0 con 0x56506ac8e8d0 2024-09-22T08:36:43.452 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.440+0000 7f9cd7fff640 1 -- 172.21.15.142:0/2205049680 <== osd.1 v2:172.21.15.142:6816/3192108003 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9cc802b040 con 0x56506ac8e8d0 2024-09-22T08:36:43.452 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.440+0000 7f9cd7fff640 1 -- 172.21.15.142:0/2205049680 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56506ac976b0 con 0x7f9cd00a4040 2024-09-22T08:36:43.461 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.440+0000 7f9cd7fff640 1 -- 172.21.15.142:0/2205049680 <== osd.0 v2:172.21.15.31:6800/168281188 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9cc802b040 con 0x7f9cd00a4040 2024-09-22T08:36:43.462 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.440+0000 7f9cd7fff640 1 -- 172.21.15.142:0/2205049680 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56506ac976b0 con 0x56506ac8e8d0 2024-09-22T08:36:43.462 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.440+0000 7f9cd7fff640 1 -- 172.21.15.142:0/2205049680 <== osd.1 v2:172.21.15.142:6816/3192108003 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9cc802b040 con 0x56506ac8e8d0 2024-09-22T08:36:43.462 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.441+0000 7f9cd7fff640 1 -- 172.21.15.142:0/2205049680 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56506ac976b0 con 0x7f9cd80454c0 2024-09-22T08:36:43.462 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.441+0000 7f9cde792640 1 -- 172.21.15.142:0/2205049680 <== osd.2 v2:172.21.15.142:6808/279438927 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f9cd0085050 con 0x7f9cd80454c0 2024-09-22T08:36:43.462 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.441+0000 7f9cde792640 1 -- 172.21.15.142:0/2205049680 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56506ac976b0 con 0x56506ac93160 2024-09-22T08:36:43.462 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.441+0000 7f9cdef93640 1 -- 172.21.15.142:0/2205049680 <== osd.3 v2:172.21.15.142:6800/1064901393 4 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9cd800a4d0 con 0x56506ac93160 2024-09-22T08:36:43.462 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.441+0000 7f9cdef93640 1 -- 172.21.15.142:0/2205049680 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56506ac976b0 con 0x56506ac93160 2024-09-22T08:36:43.462 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.441+0000 7f9cdef93640 1 -- 172.21.15.142:0/2205049680 <== osd.3 v2:172.21.15.142:6800/1064901393 5 ==== osd_op_reply(20 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f9cd800a4d0 con 0x56506ac93160 2024-09-22T08:36:43.462 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.441+0000 7f9cdef93640 1 -- 172.21.15.142:0/2205049680 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56506ac976b0 con 0x7f9cd00a4040 2024-09-22T08:36:43.462 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.442+0000 7f9cd7fff640 1 -- 172.21.15.142:0/2205049680 <== osd.0 v2:172.21.15.31:6800/168281188 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9cc802b040 con 0x7f9cd00a4040 2024-09-22T08:36:43.462 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.442+0000 7f9cd7fff640 1 -- 172.21.15.142:0/2205049680 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56506ac976b0 con 0x56506ac93160 2024-09-22T08:36:43.462 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.442+0000 7f9cdef93640 1 -- 172.21.15.142:0/2205049680 <== osd.3 v2:172.21.15.142:6800/1064901393 6 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9cd800a4d0 con 0x56506ac93160 2024-09-22T08:36:43.463 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.442+0000 7f9cdef93640 1 -- 172.21.15.142:0/2205049680 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56506ac976b0 con 0x56506ac93160 2024-09-22T08:36:43.463 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.442+0000 7f9cdef93640 1 -- 172.21.15.142:0/2205049680 <== osd.3 v2:172.21.15.142:6800/1064901393 7 ==== osd_op_reply(23 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f9cd800a4d0 con 0x56506ac93160 2024-09-22T08:36:43.463 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.442+0000 7f9cdef93640 1 -- 172.21.15.142:0/2205049680 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56506ac976b0 con 0x56506ac8e8d0 2024-09-22T08:36:43.463 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.443+0000 7f9cd7fff640 1 -- 172.21.15.142:0/2205049680 <== osd.1 v2:172.21.15.142:6816/3192108003 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9cc802b040 con 0x56506ac8e8d0 2024-09-22T08:36:43.463 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.443+0000 7f9cd7fff640 1 -- 172.21.15.142:0/2205049680 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56506ac976b0 con 0x56506ac8e8d0 2024-09-22T08:36:43.463 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.443+0000 7f9cd7fff640 1 -- 172.21.15.142:0/2205049680 <== osd.1 v2:172.21.15.142:6816/3192108003 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f9cc802b040 con 0x56506ac8e8d0 2024-09-22T08:36:43.463 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.443+0000 7f9cd7fff640 1 -- 172.21.15.142:0/2205049680 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56506ac976b0 con 0x7f9cd00a4040 2024-09-22T08:36:43.463 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.443+0000 7f9cd7fff640 1 -- 172.21.15.142:0/2205049680 <== osd.0 v2:172.21.15.31:6800/168281188 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9cc802b040 con 0x7f9cd00a4040 2024-09-22T08:36:43.463 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.443+0000 7f9cd7fff640 1 -- 172.21.15.142:0/2205049680 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56506ac976b0 con 0x56506ac93160 2024-09-22T08:36:43.463 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.443+0000 7f9cdef93640 1 -- 172.21.15.142:0/2205049680 <== osd.3 v2:172.21.15.142:6800/1064901393 8 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9cd800a4d0 con 0x56506ac93160 2024-09-22T08:36:43.463 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.443+0000 7f9cdef93640 1 -- 172.21.15.142:0/2205049680 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56506ac976b0 con 0x7f9cd80454c0 2024-09-22T08:36:43.463 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.444+0000 7f9cde792640 1 -- 172.21.15.142:0/2205049680 <== osd.2 v2:172.21.15.142:6808/279438927 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9cd0085050 con 0x7f9cd80454c0 2024-09-22T08:36:43.463 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.444+0000 7f9cde792640 1 -- 172.21.15.142:0/2205049680 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56506ac976b0 con 0x56506ac8e8d0 2024-09-22T08:36:43.464 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.444+0000 7f9cd7fff640 1 -- 172.21.15.142:0/2205049680 <== osd.1 v2:172.21.15.142:6816/3192108003 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9cc802b040 con 0x56506ac8e8d0 2024-09-22T08:36:43.464 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.444+0000 7f9cd7fff640 1 -- 172.21.15.142:0/2205049680 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56506ac976b0 con 0x7f9cd00a4040 2024-09-22T08:36:43.464 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.444+0000 7f9cd7fff640 1 -- 172.21.15.142:0/2205049680 <== osd.0 v2:172.21.15.31:6800/168281188 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9cc803b040 con 0x7f9cd00a4040 2024-09-22T08:36:43.464 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.444+0000 7f9cd7fff640 1 -- 172.21.15.142:0/2205049680 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56506ac976b0 con 0x56506ac93160 2024-09-22T08:36:43.464 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.444+0000 7f9cdef93640 1 -- 172.21.15.142:0/2205049680 <== osd.3 v2:172.21.15.142:6800/1064901393 9 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9cd800a4d0 con 0x56506ac93160 2024-09-22T08:36:43.464 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.444+0000 7f9cdef93640 1 -- 172.21.15.142:0/2205049680 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56506ac976b0 con 0x7f9cd00a4040 2024-09-22T08:36:43.464 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.445+0000 7f9cd7fff640 1 -- 172.21.15.142:0/2205049680 <== osd.0 v2:172.21.15.31:6800/168281188 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9cc803b040 con 0x7f9cd00a4040 2024-09-22T08:36:43.464 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.445+0000 7f9cd7fff640 1 -- 172.21.15.142:0/2205049680 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56506ac976b0 con 0x7f9cd80454c0 2024-09-22T08:36:43.464 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.445+0000 7f9cde792640 1 -- 172.21.15.142:0/2205049680 <== osd.2 v2:172.21.15.142:6808/279438927 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9cd0085050 con 0x7f9cd80454c0 2024-09-22T08:36:43.464 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.445+0000 7f9cde792640 1 -- 172.21.15.142:0/2205049680 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56506ac976b0 con 0x56506ac93160 2024-09-22T08:36:43.464 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.445+0000 7f9cdef93640 1 -- 172.21.15.142:0/2205049680 <== osd.3 v2:172.21.15.142:6800/1064901393 10 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9cd800a4d0 con 0x56506ac93160 2024-09-22T08:36:43.464 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.445+0000 7f9cdef93640 1 -- 172.21.15.142:0/2205049680 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56506ac976b0 con 0x7f9cd00a4040 2024-09-22T08:36:43.465 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.445+0000 7f9cd7fff640 1 -- 172.21.15.142:0/2205049680 <== osd.0 v2:172.21.15.31:6800/168281188 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9cc803b040 con 0x7f9cd00a4040 2024-09-22T08:36:43.465 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.445+0000 7f9cd7fff640 1 -- 172.21.15.142:0/2205049680 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56506ac976b0 con 0x56506ac8e8d0 2024-09-22T08:36:43.465 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.446+0000 7f9cd7fff640 1 -- 172.21.15.142:0/2205049680 <== osd.1 v2:172.21.15.142:6816/3192108003 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f9cc803b040 con 0x56506ac8e8d0 2024-09-22T08:36:43.465 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.446+0000 7f9cd7fff640 1 -- 172.21.15.142:0/2205049680 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56506ac976b0 con 0x7f9cd80454c0 2024-09-22T08:36:43.465 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.446+0000 7f9cde792640 1 -- 172.21.15.142:0/2205049680 <== osd.2 v2:172.21.15.142:6808/279438927 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9cd0085050 con 0x7f9cd80454c0 2024-09-22T08:36:43.465 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.446+0000 7f9ce300f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:36:43.465 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.446+0000 7f9ce300f800 20 RGWRados::pool_iterate: got zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec 2024-09-22T08:36:43.465 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.446+0000 7f9ce300f800 20 RGWRados::pool_iterate: got zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f 2024-09-22T08:36:43.465 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.446+0000 7f9ce300f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:36:43.465 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.446+0000 7f9ce300f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:36:43.465 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.446+0000 7f9ce300f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:36:43.465 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.446+0000 7f9ce300f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:43.465 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.446+0000 7f9ce300f800 1 -- 172.21.15.142:0/2205049680 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56506ac96780 con 0x56506ac8e8d0 2024-09-22T08:36:43.465 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.446+0000 7f9cd7fff640 1 -- 172.21.15.142:0/2205049680 <== osd.1 v2:172.21.15.142:6816/3192108003 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9cc803b040 con 0x56506ac8e8d0 2024-09-22T08:36:43.466 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.446+0000 7f9ce300f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:43.466 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.446+0000 7f9ce300f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:43.466 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.446+0000 7f9ce300f800 1 -- 172.21.15.142:0/2205049680 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56506ac963c0 con 0x56506ac8e8d0 2024-09-22T08:36:43.466 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.446+0000 7f9cd7fff640 1 -- 172.21.15.142:0/2205049680 <== osd.1 v2:172.21.15.142:6816/3192108003 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9cc803b040 con 0x56506ac8e8d0 2024-09-22T08:36:43.466 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.446+0000 7f9ce300f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:36:43.466 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.446+0000 7f9ce300f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:43.466 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.446+0000 7f9ce300f800 1 -- 172.21.15.142:0/2205049680 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:40 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56506ac970e0 con 0x56506ac93160 2024-09-22T08:36:43.466 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.447+0000 7f9cdef93640 1 -- 172.21.15.142:0/2205049680 <== osd.3 v2:172.21.15.142:6800/1064901393 11 ==== osd_op_reply(40 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f9cd800a4d0 con 0x56506ac93160 2024-09-22T08:36:43.466 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.447+0000 7f9ce300f800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:36:43.466 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.447+0000 7f9ce300f800 20 zone default found 2024-09-22T08:36:43.466 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.447+0000 7f9ce300f800 4 Realm: () 2024-09-22T08:36:43.466 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.447+0000 7f9ce300f800 4 ZoneGroup: default (d89f6f57-1007-47dd-9065-f486c7b01aec) 2024-09-22T08:36:43.467 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.447+0000 7f9ce300f800 4 Zone: default (e239248c-0bee-4e41-803a-24b288d3eb8f) 2024-09-22T08:36:43.467 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.447+0000 7f9ce300f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:36:43.467 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.447+0000 7f9ce300f800 20 zonegroup default 2024-09-22T08:36:43.467 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.447+0000 7f9ce300f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:43.467 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.447+0000 7f9ce300f800 1 -- 172.21.15.142:0/2205049680 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56506ac96c50 con 0x7f9cd00a4040 2024-09-22T08:36:43.467 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.447+0000 7f9cd7fff640 1 -- 172.21.15.142:0/2205049680 <== osd.0 v2:172.21.15.31:6800/168281188 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f9cc803b040 con 0x7f9cd00a4040 2024-09-22T08:36:43.467 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.447+0000 7f9ce300f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:43.467 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.447+0000 7f9ce300f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:43.467 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.447+0000 7f9ce300f800 1 -- 172.21.15.142:0/2205049680 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56506ac99ad0 con 0x56506ac93160 2024-09-22T08:36:43.467 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.447+0000 7f9cdef93640 1 -- 172.21.15.142:0/2205049680 <== osd.3 v2:172.21.15.142:6800/1064901393 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9cd800a4d0 con 0x56506ac93160 2024-09-22T08:36:43.467 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.447+0000 7f9ce300f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:43.467 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.447+0000 7f9ce300f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:43.467 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.447+0000 7f9ce300f800 1 -- 172.21.15.142:0/2205049680 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56506ac99f30 con 0x56506ac93160 2024-09-22T08:36:43.468 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.447+0000 7f9cdef93640 1 -- 172.21.15.142:0/2205049680 <== osd.3 v2:172.21.15.142:6800/1064901393 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9cd800a4d0 con 0x56506ac93160 2024-09-22T08:36:43.468 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.447+0000 7f9ce300f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:43.468 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.447+0000 7f9ce300f800 20 started sync module instance, tier type = 2024-09-22T08:36:43.468 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.447+0000 7f9ce300f800 20 started zone id=e239248c-0bee-4e41-803a-24b288d3eb8f (name=default) with tier type = 2024-09-22T08:36:43.468 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.447+0000 7f9ce300f800 1 -- 172.21.15.142:0/2205049680 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56506ac98f40 con 0x7f9cd80454c0 2024-09-22T08:36:43.468 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.448+0000 7f9cde792640 1 -- 172.21.15.142:0/2205049680 <== osd.2 v2:172.21.15.142:6808/279438927 7 ==== osd_op_reply(44 notify.0 [create] v30'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9cd0085050 con 0x7f9cd80454c0 2024-09-22T08:36:43.468 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.449+0000 7f9ce300f800 1 -- 172.21.15.142:0/2205049680 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94903388967728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56506ac9a840 con 0x7f9cd80454c0 2024-09-22T08:36:43.468 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.449+0000 7f9ce300f800 1 -- 172.21.15.142:0/2205049680 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56506ac9b090 con 0x56506ac8e8d0 2024-09-22T08:36:43.468 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.449+0000 7f9cde792640 1 -- 172.21.15.142:0/2205049680 <== osd.2 v2:172.21.15.142:6808/279438927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94903388967728] v30'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9cd0085050 con 0x7f9cd80454c0 2024-09-22T08:36:43.468 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.450+0000 7f9cd7fff640 1 -- 172.21.15.142:0/2205049680 <== osd.1 v2:172.21.15.142:6816/3192108003 15 ==== osd_op_reply(46 notify.1 [create] v30'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9cc803b040 con 0x56506ac8e8d0 2024-09-22T08:36:43.468 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.450+0000 7f9ce300f800 1 -- 172.21.15.142:0/2205049680 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94903388971920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56506ac9b0f0 con 0x56506ac8e8d0 2024-09-22T08:36:43.468 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.450+0000 7f9ce300f800 1 -- 172.21.15.142:0/2205049680 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56506ac9bc00 con 0x56506ac93160 2024-09-22T08:36:43.468 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.451+0000 7f9cd7fff640 1 -- 172.21.15.142:0/2205049680 <== osd.1 v2:172.21.15.142:6816/3192108003 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94903388971920] v30'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9cc803b040 con 0x56506ac8e8d0 2024-09-22T08:36:43.469 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.451+0000 7f9cdef93640 1 -- 172.21.15.142:0/2205049680 <== osd.3 v2:172.21.15.142:6800/1064901393 14 ==== osd_op_reply(48 notify.2 [create] v30'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9cd800a4d0 con 0x56506ac93160 2024-09-22T08:36:43.469 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.451+0000 7f9ce300f800 1 -- 172.21.15.142:0/2205049680 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94903388976816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56506ac9bbc0 con 0x56506ac93160 2024-09-22T08:36:43.469 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.451+0000 7f9ce300f800 1 -- 172.21.15.142:0/2205049680 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56506ac9c690 con 0x7f9cd80454c0 2024-09-22T08:36:43.469 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.453+0000 7f9cdef93640 1 -- 172.21.15.142:0/2205049680 <== osd.3 v2:172.21.15.142:6800/1064901393 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94903388976816] v30'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9cd800a4d0 con 0x56506ac93160 2024-09-22T08:36:43.469 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.453+0000 7f9cde792640 1 -- 172.21.15.142:0/2205049680 <== osd.2 v2:172.21.15.142:6808/279438927 9 ==== osd_op_reply(50 notify.3 [create] v30'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9cd0085050 con 0x7f9cd80454c0 2024-09-22T08:36:43.469 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.453+0000 7f9ce300f800 1 -- 172.21.15.142:0/2205049680 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94903388979648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56506ac9cab0 con 0x7f9cd80454c0 2024-09-22T08:36:43.469 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.453+0000 7f9ce300f800 1 -- 172.21.15.142:0/2205049680 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56506ac9d4b0 con 0x56506ac8e8d0 2024-09-22T08:36:43.469 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.454+0000 7f9cde792640 1 -- 172.21.15.142:0/2205049680 <== osd.2 v2:172.21.15.142:6808/279438927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94903388979648] v30'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9cd0085050 con 0x7f9cd80454c0 2024-09-22T08:36:43.469 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.455+0000 7f9cd7fff640 1 -- 172.21.15.142:0/2205049680 <== osd.1 v2:172.21.15.142:6816/3192108003 17 ==== osd_op_reply(52 notify.4 [create] v30'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9cc803b040 con 0x56506ac8e8d0 2024-09-22T08:36:43.469 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.455+0000 7f9ce300f800 1 -- 172.21.15.142:0/2205049680 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94903388974048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56506ac9d8a0 con 0x56506ac8e8d0 2024-09-22T08:36:43.469 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.455+0000 7f9ce300f800 1 -- 172.21.15.142:0/2205049680 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56506ac9e2d0 con 0x7f9cd00a4040 2024-09-22T08:36:43.469 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.456+0000 7f9cd7fff640 1 -- 172.21.15.142:0/2205049680 <== osd.1 v2:172.21.15.142:6816/3192108003 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94903388974048] v30'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9cc803b040 con 0x56506ac8e8d0 2024-09-22T08:36:43.469 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.456+0000 7f9cd7fff640 1 -- 172.21.15.142:0/2205049680 <== osd.0 v2:172.21.15.31:6800/168281188 11 ==== osd_op_reply(54 notify.5 [create] v30'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9cc803b040 con 0x7f9cd00a4040 2024-09-22T08:36:43.469 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.456+0000 7f9ce300f800 1 -- 172.21.15.142:0/2205049680 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94903388986848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56506ac9e2d0 con 0x7f9cd00a4040 2024-09-22T08:36:43.470 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.456+0000 7f9ce300f800 1 -- 172.21.15.142:0/2205049680 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56506ac9ed30 con 0x7f9cd00a4040 2024-09-22T08:36:43.470 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.457+0000 7f9cd7fff640 1 -- 172.21.15.142:0/2205049680 <== osd.0 v2:172.21.15.31:6800/168281188 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94903388986848] v30'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9cc803b040 con 0x7f9cd00a4040 2024-09-22T08:36:43.470 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.457+0000 7f9cd7fff640 1 -- 172.21.15.142:0/2205049680 <== osd.0 v2:172.21.15.31:6800/168281188 13 ==== osd_op_reply(56 notify.6 [create] v30'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9cc803b040 con 0x7f9cd00a4040 2024-09-22T08:36:43.470 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.457+0000 7f9ce300f800 1 -- 172.21.15.142:0/2205049680 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94903388983232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56506ac9ed30 con 0x7f9cd00a4040 2024-09-22T08:36:43.470 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.457+0000 7f9ce300f800 1 -- 172.21.15.142:0/2205049680 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56506ac9f6f0 con 0x7f9cd00a4040 2024-09-22T08:36:43.470 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.458+0000 7f9cd7fff640 1 -- 172.21.15.142:0/2205049680 <== osd.0 v2:172.21.15.31:6800/168281188 14 ==== osd_op_reply(58 notify.7 [create] v30'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9cc803b040 con 0x7f9cd00a4040 2024-09-22T08:36:43.470 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.458+0000 7f9cd7fff640 1 -- 172.21.15.142:0/2205049680 <== osd.0 v2:172.21.15.31:6800/168281188 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94903388983232] v30'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9cc803b040 con 0x7f9cd00a4040 2024-09-22T08:36:43.470 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.458+0000 7f9ce300f800 1 -- 172.21.15.142:0/2205049680 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94903388992064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56506ac9fb50 con 0x7f9cd00a4040 2024-09-22T08:36:43.470 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.458+0000 7f9ce300f800 20 add_watcher() i=0 2024-09-22T08:36:43.470 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.458+0000 7f9ce300f800 20 add_watcher() i=1 2024-09-22T08:36:43.470 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.458+0000 7f9ce300f800 20 add_watcher() i=2 2024-09-22T08:36:43.470 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.458+0000 7f9ce300f800 20 add_watcher() i=3 2024-09-22T08:36:43.470 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.458+0000 7f9ce300f800 20 add_watcher() i=4 2024-09-22T08:36:43.471 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.458+0000 7f9ce300f800 20 add_watcher() i=5 2024-09-22T08:36:43.471 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.458+0000 7f9ce300f800 20 add_watcher() i=6 2024-09-22T08:36:43.471 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.459+0000 7f9cd7fff640 1 -- 172.21.15.142:0/2205049680 <== osd.0 v2:172.21.15.31:6800/168281188 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94903388992064] v30'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9cc803b040 con 0x7f9cd00a4040 2024-09-22T08:36:43.471 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.459+0000 7f9ce300f800 20 add_watcher() i=7 2024-09-22T08:36:43.471 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.459+0000 7f9ce300f800 2 all 8 watchers are set, enabling cache 2024-09-22T08:36:43.471 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.459+0000 7f9ce300f800 1 -- 172.21.15.142:0/2205049680 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56506aca2f70 con 0x56506ac8e8d0 2024-09-22T08:36:43.471 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.459+0000 7f9cd7fff640 1 -- 172.21.15.142:0/2205049680 <== osd.1 v2:172.21.15.142:6816/3192108003 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f9cc803b040 con 0x56506ac8e8d0 2024-09-22T08:36:43.471 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.459+0000 7f9ce300f800 1 -- 172.21.15.142:0/2205049680 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94903388993120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56506aca03f0 con 0x56506ac8e8d0 2024-09-22T08:36:43.473 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.462+0000 7f9cd7fff640 1 -- 172.21.15.142:0/2205049680 <== osd.1 v2:172.21.15.142:6816/3192108003 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94903388993120] v30'62 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9cc803b040 con 0x56506ac8e8d0 2024-09-22T08:36:43.473 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.462+0000 7f9b94fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:36:43.473 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.462+0000 7f9ce300f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:36:43.473 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.462+0000 7f9ce300f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:36:43.473 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.462+0000 7f9ce300f800 5 note: GC not initialized 2024-09-22T08:36:43.473 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.462+0000 7f9b0f7fe640 20 reqs_thread_entry: start 2024-09-22T08:36:43.473 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.462+0000 7f9ce300f800 20 init_complete bucket index max shards: 11 2024-09-22T08:36:43.473 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.462+0000 7f9ce300f800 20 Filter name: none 2024-09-22T08:36:43.473 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.462+0000 7f9b0d7fa640 20 reqs_thread_entry: start 2024-09-22T08:36:43.473 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.463+0000 7f9ce300f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:43.474 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.463+0000 7f9ce300f800 1 -- 172.21.15.142:0/2205049680 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56506acd5b10 con 0x56506ac8e8d0 2024-09-22T08:36:43.474 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.463+0000 7f9cd7fff640 1 -- 172.21.15.142:0/2205049680 <== osd.1 v2:172.21.15.142:6816/3192108003 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f9cc803b040 con 0x56506ac8e8d0 2024-09-22T08:36:43.474 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.463+0000 7f9ce300f800 20 rados_obj.operate() r=0 bl.length=391 2024-09-22T08:36:43.474 INFO:teuthology.orchestra.run.smithi142.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-22T08:36:42.661297Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-22T08:36:42.661288Z","tags":[],"group_ids":[]} 2024-09-22T08:36:43.478 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.464+0000 7f9b94fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:36:43.479 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.464+0000 7f9ce300f800 1 -- 172.21.15.142:0/2205049680 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94903388993120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56506acd4800 con 0x56506ac8e8d0 2024-09-22T08:36:43.479 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.465+0000 7f9cd7fff640 1 -- 172.21.15.142:0/2205049680 <== osd.1 v2:172.21.15.142:6816/3192108003 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94903388993120] v30'63 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9cc803b040 con 0x56506ac8e8d0 2024-09-22T08:36:43.479 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.465+0000 7f9ce300f800 1 -- 172.21.15.142:0/2205049680 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94903388967728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56506ac9f660 con 0x7f9cd80454c0 2024-09-22T08:36:43.479 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.466+0000 7f9cde792640 1 -- 172.21.15.142:0/2205049680 <== osd.2 v2:172.21.15.142:6808/279438927 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94903388967728] v30'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9cd0085050 con 0x7f9cd80454c0 2024-09-22T08:36:43.479 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.466+0000 7f9ce300f800 20 remove_watcher() i=0 2024-09-22T08:36:43.479 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.466+0000 7f9ce300f800 2 removed watcher, disabling cache 2024-09-22T08:36:43.479 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.466+0000 7f9ce300f800 1 -- 172.21.15.142:0/2205049680 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94903388971920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56506ac9f660 con 0x56506ac8e8d0 2024-09-22T08:36:43.479 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.467+0000 7f9cd7fff640 1 -- 172.21.15.142:0/2205049680 <== osd.1 v2:172.21.15.142:6816/3192108003 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94903388971920] v30'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9cc803b040 con 0x56506ac8e8d0 2024-09-22T08:36:43.479 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.467+0000 7f9ce300f800 20 remove_watcher() i=1 2024-09-22T08:36:43.479 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.467+0000 7f9ce300f800 1 -- 172.21.15.142:0/2205049680 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94903388976816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56506ac9a390 con 0x56506ac93160 2024-09-22T08:36:43.479 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.468+0000 7f9cdef93640 1 -- 172.21.15.142:0/2205049680 <== osd.3 v2:172.21.15.142:6800/1064901393 16 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94903388976816] v30'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9cd800a4d0 con 0x56506ac93160 2024-09-22T08:36:43.479 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.468+0000 7f9ce300f800 20 remove_watcher() i=2 2024-09-22T08:36:43.479 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.468+0000 7f9ce300f800 1 -- 172.21.15.142:0/2205049680 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94903388979648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56506ac9f660 con 0x7f9cd80454c0 2024-09-22T08:36:43.480 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.469+0000 7f9cde792640 1 -- 172.21.15.142:0/2205049680 <== osd.2 v2:172.21.15.142:6808/279438927 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94903388979648] v30'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9cd0085050 con 0x7f9cd80454c0 2024-09-22T08:36:43.480 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.469+0000 7f9ce300f800 20 remove_watcher() i=3 2024-09-22T08:36:43.480 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.469+0000 7f9ce300f800 1 -- 172.21.15.142:0/2205049680 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94903388974048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56506ac9b6b0 con 0x56506ac8e8d0 2024-09-22T08:36:43.480 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.471+0000 7f9cd7fff640 1 -- 172.21.15.142:0/2205049680 <== osd.1 v2:172.21.15.142:6816/3192108003 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94903388974048] v30'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9cc803b040 con 0x56506ac8e8d0 2024-09-22T08:36:43.480 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.471+0000 7f9ce300f800 20 remove_watcher() i=4 2024-09-22T08:36:43.480 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.471+0000 7f9ce300f800 1 -- 172.21.15.142:0/2205049680 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94903388986848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56506ac9c1c0 con 0x7f9cd00a4040 2024-09-22T08:36:43.480 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.472+0000 7f9cd7fff640 1 -- 172.21.15.142:0/2205049680 <== osd.0 v2:172.21.15.31:6800/168281188 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94903388986848] v30'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9cc803b040 con 0x7f9cd00a4040 2024-09-22T08:36:43.480 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.472+0000 7f9ce300f800 20 remove_watcher() i=5 2024-09-22T08:36:43.480 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.472+0000 7f9ce300f800 1 -- 172.21.15.142:0/2205049680 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94903388983232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56506ac9f660 con 0x7f9cd00a4040 2024-09-22T08:36:43.480 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.473+0000 7f9cd7fff640 1 -- 172.21.15.142:0/2205049680 <== osd.0 v2:172.21.15.31:6800/168281188 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94903388983232] v30'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9cc803b040 con 0x7f9cd00a4040 2024-09-22T08:36:43.480 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.473+0000 7f9ce300f800 20 remove_watcher() i=6 2024-09-22T08:36:43.480 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.473+0000 7f9ce300f800 1 -- 172.21.15.142:0/2205049680 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94903388992064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56506ac9abe0 con 0x7f9cd00a4040 2024-09-22T08:36:43.480 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.474+0000 7f9cd7fff640 1 -- 172.21.15.142:0/2205049680 <== osd.0 v2:172.21.15.31:6800/168281188 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94903388992064] v30'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9cc803b040 con 0x7f9cd00a4040 2024-09-22T08:36:43.480 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.474+0000 7f9ce300f800 20 remove_watcher() i=7 2024-09-22T08:36:43.480 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.474+0000 7f9ce300f800 1 -- 172.21.15.142:0/2205049680 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f9cd00a4040 msgr2=0x7f9cd0095300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:43.481 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.474+0000 7f9ce300f800 1 --2- 172.21.15.142:0/2205049680 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f9cd00a4040 0x7f9cd0095300 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:43.481 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.474+0000 7f9ce300f800 1 -- 172.21.15.142:0/2205049680 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x56506ac8e8d0 msgr2=0x56506ac90d60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:43.481 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.474+0000 7f9ce300f800 1 --2- 172.21.15.142:0/2205049680 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x56506ac8e8d0 0x56506ac90d60 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:43.481 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.474+0000 7f9ce300f800 1 -- 172.21.15.142:0/2205049680 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f9cd80454c0 msgr2=0x7f9cd8023a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:43.481 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.474+0000 7f9ce300f800 1 --2- 172.21.15.142:0/2205049680 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f9cd80454c0 0x7f9cd8023a80 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:43.481 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.474+0000 7f9ce300f800 1 -- 172.21.15.142:0/2205049680 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x56506ac93160 msgr2=0x56506ac95570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:43.481 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.474+0000 7f9ce300f800 1 --2- 172.21.15.142:0/2205049680 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x56506ac93160 0x56506ac95570 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:43.481 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.475+0000 7f9ce300f800 1 -- 172.21.15.142:0/2205049680 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f9ba803d000 msgr2=0x7f9ba803f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:43.481 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.475+0000 7f9ce300f800 1 --2- 172.21.15.142:0/2205049680 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f9ba803d000 0x7f9ba803f4c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f9cd0078030 tx=0x7f9cd008d000 comp rx=0 tx=0).stop 2024-09-22T08:36:43.481 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.475+0000 7f9ce300f800 1 -- 172.21.15.142:0/2205049680 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56506ac79830 msgr2=0x56506aad0240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:43.481 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.475+0000 7f9ce300f800 1 --2- 172.21.15.142:0/2205049680 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56506ac79830 0x56506aad0240 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f9cd8020510 tx=0x7f9cd80547a0 comp rx=0 tx=0).stop 2024-09-22T08:36:43.481 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.475+0000 7f9cd7fff640 1 -- 172.21.15.142:0/2205049680 reap_dead start 2024-09-22T08:36:43.481 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.475+0000 7f9cd7fff640 1 -- 172.21.15.142:0/2205049680 reap_dead start 2024-09-22T08:36:43.481 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.475+0000 7f9ce300f800 1 -- 172.21.15.142:0/2205049680 shutdown_connections 2024-09-22T08:36:43.481 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.475+0000 7f9ce300f800 1 -- 172.21.15.142:0/2205049680 >> 172.21.15.142:0/2205049680 conn(0x56506ac75c30 msgr2=0x56506ac73e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:43.482 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.475+0000 7f9ce300f800 1 -- 172.21.15.142:0/2205049680 shutdown_connections 2024-09-22T08:36:43.482 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.475+0000 7f9ce300f800 1 -- 172.21.15.142:0/2205049680 wait complete. 2024-09-22T08:36:43.482 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.475+0000 7f9ce300f800 1 -- 172.21.15.142:0/3930520012 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f9bb803cfb0 msgr2=0x7f9bb803f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:43.482 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.475+0000 7f9ce300f800 1 --2- 172.21.15.142:0/3930520012 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f9bb803cfb0 0x7f9bb803f470 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f9cd0077bd0 tx=0x7f9cd0095f70 comp rx=0 tx=0).stop 2024-09-22T08:36:43.482 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.475+0000 7f9ce300f800 1 -- 172.21.15.142:0/3930520012 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56506ac6cd70 msgr2=0x56506ac6d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:43.482 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.475+0000 7f9ce300f800 1 --2- 172.21.15.142:0/3930520012 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56506ac6cd70 0x56506ac6d190 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x56506ac529a0 tx=0x7f9cd80167b0 comp rx=0 tx=0).stop 2024-09-22T08:36:43.482 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.475+0000 7f9ce300f800 1 -- 172.21.15.142:0/3930520012 shutdown_connections 2024-09-22T08:36:43.482 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.475+0000 7f9ce300f800 1 --2- 172.21.15.142:0/3930520012 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f9bb803cfb0 0x7f9bb803f470 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:43.482 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.475+0000 7f9ce300f800 1 --2- 172.21.15.142:0/3930520012 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56506ac6cd70 0x56506ac6d190 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:43.482 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.475+0000 7f9ce300f800 1 -- 172.21.15.142:0/3930520012 >> 172.21.15.142:0/3930520012 conn(0x56506ac61120 msgr2=0x56506ac61500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:43.482 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.475+0000 7f9ce300f800 1 -- 172.21.15.142:0/3930520012 shutdown_connections 2024-09-22T08:36:43.482 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.475+0000 7f9ce300f800 1 -- 172.21.15.142:0/3930520012 wait complete. 2024-09-22T08:36:43.482 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.475+0000 7f9ce300f800 1 -- 172.21.15.142:0/981395207 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x56506ac56fe0 msgr2=0x56506ac593d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:43.483 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.475+0000 7f9ce300f800 1 --2- 172.21.15.142:0/981395207 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x56506ac56fe0 0x56506ac593d0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:43.483 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.475+0000 7f9ce300f800 1 -- 172.21.15.142:0/981395207 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x56506ac5b7b0 msgr2=0x56506ac5dc50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:43.483 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.475+0000 7f9ce300f800 1 --2- 172.21.15.142:0/981395207 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x56506ac5b7b0 0x56506ac5dc50 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:43.483 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.475+0000 7f9ce300f800 1 -- 172.21.15.142:0/981395207 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f9bc403cfb0 msgr2=0x7f9bc403f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:43.483 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.475+0000 7f9ce300f800 1 --2- 172.21.15.142:0/981395207 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f9bc403cfb0 0x7f9bc403f470 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f9cc8000c00 tx=0x7f9cc80013b0 comp rx=0 tx=0).stop 2024-09-22T08:36:43.483 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.475+0000 7f9ce300f800 1 -- 172.21.15.142:0/981395207 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56506ab5bae0 msgr2=0x56506ac519a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:43.483 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.475+0000 7f9ce300f800 1 --2- 172.21.15.142:0/981395207 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56506ab5bae0 0x56506ac519a0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f9cd0025da0 tx=0x7f9cd0002fb0 comp rx=0 tx=0).stop 2024-09-22T08:36:43.483 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.476+0000 7f9ce300f800 1 -- 172.21.15.142:0/981395207 shutdown_connections 2024-09-22T08:36:43.483 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.476+0000 7f9ce300f800 1 --2- 172.21.15.142:0/981395207 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x56506ac5b7b0 0x56506ac5dc50 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:43.483 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.476+0000 7f9ce300f800 1 --2- 172.21.15.142:0/981395207 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x56506ac56fe0 0x56506ac593d0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:43.483 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.476+0000 7f9ce300f800 1 --2- 172.21.15.142:0/981395207 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f9bc403cfb0 0x7f9bc403f470 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:43.483 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.476+0000 7f9ce300f800 1 --2- 172.21.15.142:0/981395207 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56506ab5bae0 0x56506ac519a0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:43.483 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.476+0000 7f9ce300f800 1 -- 172.21.15.142:0/981395207 >> 172.21.15.142:0/981395207 conn(0x56506ab55db0 msgr2=0x56506ac43f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:43.483 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.476+0000 7f9ce300f800 1 -- 172.21.15.142:0/981395207 shutdown_connections 2024-09-22T08:36:43.483 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.476+0000 7f9ce300f800 1 -- 172.21.15.142:0/981395207 wait complete. 2024-09-22T08:36:43.485 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-22T08:36:42.661297Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-22T08:36:42.661288Z', 'tags': [], 'group_ids': []} 2024-09-22T08:36:43.485 INFO:tasks.util.rgw:rgwadmin: client.0 : ['key', 'create', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'] 2024-09-22T08:36:43.485 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'key', 'create', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'] 2024-09-22T08:36:43.485 DEBUG:teuthology.orchestra.run.smithi142:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph key create --uid foo --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh 2024-09-22T08:36:43.534 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:36:43.534 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:36:43.535 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.533+0000 7f6289f42800 1 Processor -- start 2024-09-22T08:36:43.535 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.534+0000 7f6289f42800 1 -- start start 2024-09-22T08:36:43.535 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.534+0000 7f6289f42800 1 --2- >> v2:172.21.15.31:3300/0 conn(0x557625a37c10 0x557625a3d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:43.535 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.534+0000 7f6289f42800 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5576258c2a20 con 0x557625a36800 2024-09-22T08:36:43.536 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.534+0000 7f6289f42800 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x5576258c27d0 con 0x557625a37c10 2024-09-22T08:36:43.536 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.534+0000 7f62854ec640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x557625a37c10 0x557625a3d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:43.536 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.534+0000 7f62854ec640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x557625a37c10 0x557625a3d5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:38238/0 (socket says 172.21.15.142:38238) 2024-09-22T08:36:43.536 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.534+0000 7f62854ec640 1 -- 172.21.15.142:0/3726283045 learned_addr learned my addr 172.21.15.142:0/3726283045 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:43.536 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.534+0000 7f6285ced640 1 --1- 172.21.15.142:0/3726283045 >> v1:172.21.15.31:6789/0 conn(0x557625a36800 0x557625a37500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.142:42348/0 (socket says 172.21.15.142:42348) 2024-09-22T08:36:43.536 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.534+0000 7f62854ec640 1 -- 172.21.15.142:0/3726283045 >> v1:172.21.15.31:6789/0 conn(0x557625a36800 legacy=0x557625a37500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:43.536 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.534+0000 7f62854ec640 1 -- 172.21.15.142:0/3726283045 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x557625a36f00 con 0x557625a37c10 2024-09-22T08:36:43.538 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.536+0000 7f62854ec640 1 --2- 172.21.15.142:0/3726283045 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557625a37c10 0x557625a3d5a0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f627c00a6b0 tx=0x7f627c047e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67b24061b07a334b server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:43.539 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.536+0000 7f6284ceb640 1 -- 172.21.15.142:0/3726283045 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f627c00a200 con 0x557625a37c10 2024-09-22T08:36:43.539 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.536+0000 7f6284ceb640 1 -- 172.21.15.142:0/3726283045 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f627c00a3a0 con 0x557625a37c10 2024-09-22T08:36:43.539 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.536+0000 7f6284ceb640 1 -- 172.21.15.142:0/3726283045 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f627c008700 con 0x557625a37c10 2024-09-22T08:36:43.539 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.537+0000 7f6289f42800 1 -- 172.21.15.142:0/3726283045 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557625a37c10 msgr2=0x557625a3d5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:43.539 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.537+0000 7f6289f42800 1 --2- 172.21.15.142:0/3726283045 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557625a37c10 0x557625a3d5a0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f627c00a6b0 tx=0x7f627c047e30 comp rx=0 tx=0).stop 2024-09-22T08:36:43.539 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.537+0000 7f6289f42800 1 -- 172.21.15.142:0/3726283045 shutdown_connections 2024-09-22T08:36:43.539 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.537+0000 7f6289f42800 1 --2- 172.21.15.142:0/3726283045 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557625a37c10 0x557625a3d5a0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:43.540 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.537+0000 7f6289f42800 1 -- 172.21.15.142:0/3726283045 >> 172.21.15.142:0/3726283045 conn(0x557625a31bd0 msgr2=0x557625a34030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:43.540 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.537+0000 7f6289f42800 1 -- 172.21.15.142:0/3726283045 shutdown_connections 2024-09-22T08:36:43.540 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.537+0000 7f6289f42800 1 -- 172.21.15.142:0/3726283045 wait complete. 2024-09-22T08:36:43.588 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.550+0000 7f6289f42800 1 Processor -- start 2024-09-22T08:36:43.588 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.550+0000 7f6289f42800 1 -- start start 2024-09-22T08:36:43.589 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.551+0000 7f6289f42800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557625a36800 0x557625b24e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:43.589 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.551+0000 7f6289f42800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5576258cfdd0 con 0x557625a36800 2024-09-22T08:36:43.589 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.551+0000 7f6285ced640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557625a36800 0x557625b24e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:43.589 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.551+0000 7f6285ced640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557625a36800 0x557625b24e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:38242/0 (socket says 172.21.15.142:38242) 2024-09-22T08:36:43.589 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.551+0000 7f6285ced640 1 -- 172.21.15.142:0/3211467216 learned_addr learned my addr 172.21.15.142:0/3211467216 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:43.590 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.551+0000 7f6285ced640 1 -- 172.21.15.142:0/3211467216 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557625b25460 con 0x557625a36800 2024-09-22T08:36:43.590 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.551+0000 7f6285ced640 1 --2- 172.21.15.142:0/3211467216 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557625a36800 0x557625b24e70 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f627800b260 tx=0x7f627800b660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=683cbd8b368e9e58 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:43.590 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.552+0000 7f6173e07640 1 -- 172.21.15.142:0/3211467216 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f627800be60 con 0x557625a36800 2024-09-22T08:36:43.590 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.552+0000 7f6173e07640 1 -- 172.21.15.142:0/3211467216 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6278006070 con 0x557625a36800 2024-09-22T08:36:43.590 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.552+0000 7f6173e07640 1 -- 172.21.15.142:0/3211467216 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f627800e710 con 0x557625a36800 2024-09-22T08:36:43.590 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.552+0000 7f6289f42800 1 -- 172.21.15.142:0/3211467216 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557625a36800 msgr2=0x557625b24e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:43.590 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.552+0000 7f6289f42800 1 --2- 172.21.15.142:0/3211467216 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557625a36800 0x557625b24e70 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f627800b260 tx=0x7f627800b660 comp rx=0 tx=0).stop 2024-09-22T08:36:43.591 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.552+0000 7f6289f42800 1 -- 172.21.15.142:0/3211467216 shutdown_connections 2024-09-22T08:36:43.591 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.552+0000 7f6289f42800 1 --2- 172.21.15.142:0/3211467216 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557625a36800 0x557625b24e70 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:43.591 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.552+0000 7f6289f42800 1 -- 172.21.15.142:0/3211467216 >> 172.21.15.142:0/3211467216 conn(0x557625a31bd0 msgr2=0x557625b207f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:43.591 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.552+0000 7f6289f42800 1 -- 172.21.15.142:0/3211467216 shutdown_connections 2024-09-22T08:36:43.591 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.552+0000 7f6289f42800 1 -- 172.21.15.142:0/3211467216 wait complete. 2024-09-22T08:36:43.591 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.553+0000 7f6289f42800 1 Processor -- start 2024-09-22T08:36:43.591 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.553+0000 7f6289f42800 1 -- start start 2024-09-22T08:36:43.592 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.553+0000 7f6289f42800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557625a36800 0x557625b30da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:43.592 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.553+0000 7f6289f42800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5576259aa020 con 0x557625a36800 2024-09-22T08:36:43.592 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.553+0000 7f6285ced640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557625a36800 0x557625b30da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:43.592 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.553+0000 7f6285ced640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557625a36800 0x557625b30da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:38254/0 (socket says 172.21.15.142:38254) 2024-09-22T08:36:43.592 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.553+0000 7f6285ced640 1 -- 172.21.15.142:0/2475635960 learned_addr learned my addr 172.21.15.142:0/2475635960 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:43.592 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.553+0000 7f6285ced640 1 -- 172.21.15.142:0/2475635960 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557625b31300 con 0x557625a36800 2024-09-22T08:36:43.593 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.554+0000 7f6285ced640 1 --2- 172.21.15.142:0/2475635960 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557625a36800 0x557625b30da0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x557625b25e00 tx=0x7f6278000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:43.593 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.554+0000 7f6172604640 1 -- 172.21.15.142:0/2475635960 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f627800f810 con 0x557625a36800 2024-09-22T08:36:43.593 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.554+0000 7f6172604640 1 -- 172.21.15.142:0/2475635960 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f627800f9b0 con 0x557625a36800 2024-09-22T08:36:43.593 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.554+0000 7f6289f42800 1 -- 172.21.15.142:0/2475635960 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557625b31590 con 0x557625a36800 2024-09-22T08:36:43.593 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.554+0000 7f6172604640 1 -- 172.21.15.142:0/2475635960 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f627800fcd0 con 0x557625a36800 2024-09-22T08:36:43.593 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.554+0000 7f6289f42800 1 -- 172.21.15.142:0/2475635960 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557625b31f90 con 0x557625a36800 2024-09-22T08:36:43.594 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.555+0000 7f6172604640 1 -- 172.21.15.142:0/2475635960 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f6278017070 con 0x557625a36800 2024-09-22T08:36:43.594 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.555+0000 7f6172604640 1 --2- 172.21.15.142:0/2475635960 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f616c03cfb0 0x7f616c03f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:43.594 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.555+0000 7f6172604640 1 -- 172.21.15.142:0/2475635960 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f6278015020 con 0x557625a36800 2024-09-22T08:36:43.594 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.555+0000 7f62854ec640 1 --2- 172.21.15.142:0/2475635960 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f616c03cfb0 0x7f616c03f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:43.594 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.555+0000 7f6289f42800 1 --2- 172.21.15.142:0/2475635960 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x557625a37c10 0x557625b383f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:43.594 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.555+0000 7f6289f42800 1 -- 172.21.15.142:0/2475635960 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x557625b38930 con 0x557625a37c10 2024-09-22T08:36:43.595 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.555+0000 7f62864ee640 1 --2- 172.21.15.142:0/2475635960 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x557625a37c10 0x557625b383f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:43.595 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.555+0000 7f62854ec640 1 --2- 172.21.15.142:0/2475635960 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f616c03cfb0 0x7f616c03f470 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f627c058000 tx=0x7f627c053000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:43.595 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.555+0000 7f62864ee640 1 --2- 172.21.15.142:0/2475635960 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x557625a37c10 0x557625b383f0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:43.595 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.556+0000 7f62864ee640 1 -- 172.21.15.142:0/2475635960 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f628000a4d0 con 0x557625a37c10 2024-09-22T08:36:43.595 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.556+0000 7f6289f42800 1 -- 172.21.15.142:0/2475635960 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x557625b38cd0 con 0x557625a37c10 2024-09-22T08:36:43.595 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.556+0000 7f62864ee640 1 -- 172.21.15.142:0/2475635960 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f628000a4d0 con 0x557625a37c10 2024-09-22T08:36:43.596 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.556+0000 7f6289f42800 1 --2- 172.21.15.142:0/2475635960 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x557625b3a7d0 0x557625b3cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:43.596 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.556+0000 7f6289f42800 1 -- 172.21.15.142:0/2475635960 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:3 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x557625b3d3e0 con 0x557625b3a7d0 2024-09-22T08:36:43.596 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.556+0000 7f6285ced640 1 --2- 172.21.15.142:0/2475635960 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x557625b3a7d0 0x557625b3cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:43.596 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.556+0000 7f6285ced640 1 --2- 172.21.15.142:0/2475635960 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x557625b3a7d0 0x557625b3cc50 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:43.596 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.557+0000 7f6285ced640 1 -- 172.21.15.142:0/2475635960 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(3 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f627802e070 con 0x557625b3a7d0 2024-09-22T08:36:43.596 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.557+0000 7f6289f42800 1 -- 172.21.15.142:0/2475635960 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x557625b39520 con 0x557625a37c10 2024-09-22T08:36:43.597 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.557+0000 7f62864ee640 1 -- 172.21.15.142:0/2475635960 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f628000a4d0 con 0x557625a37c10 2024-09-22T08:36:43.597 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.557+0000 7f6289f42800 1 -- 172.21.15.142:0/2475635960 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x557625b39910 con 0x557625b3a7d0 2024-09-22T08:36:43.597 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.557+0000 7f6285ced640 1 -- 172.21.15.142:0/2475635960 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(5 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f627802e070 con 0x557625b3a7d0 2024-09-22T08:36:43.597 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.558+0000 7f6289f42800 1 Processor -- start 2024-09-22T08:36:43.597 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.558+0000 7f6289f42800 1 -- start start 2024-09-22T08:36:43.597 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.558+0000 7f6289f42800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557625b4bd70 0x557625b4c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:43.598 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.558+0000 7f6289f42800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55762592ed50 con 0x557625b4bd70 2024-09-22T08:36:43.598 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.558+0000 7f62864ee640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557625b4bd70 0x557625b4c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:43.598 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.558+0000 7f62864ee640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557625b4bd70 0x557625b4c190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:38256/0 (socket says 172.21.15.142:38256) 2024-09-22T08:36:43.598 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.558+0000 7f62864ee640 1 -- 172.21.15.142:0/2418381256 learned_addr learned my addr 172.21.15.142:0/2418381256 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:43.598 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.558+0000 7f62864ee640 1 -- 172.21.15.142:0/2418381256 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557625b4c7d0 con 0x557625b4bd70 2024-09-22T08:36:43.598 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.559+0000 7f62864ee640 1 --2- 172.21.15.142:0/2418381256 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557625b4bd70 0x557625b4c190 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x557625b31da0 tx=0x7f62800167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:43.599 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.559+0000 7f616b7fe640 1 -- 172.21.15.142:0/2418381256 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6280013640 con 0x557625b4bd70 2024-09-22T08:36:43.599 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.559+0000 7f616b7fe640 1 -- 172.21.15.142:0/2418381256 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62800137e0 con 0x557625b4bd70 2024-09-22T08:36:43.599 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.559+0000 7f616b7fe640 1 -- 172.21.15.142:0/2418381256 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6280013ae0 con 0x557625b4bd70 2024-09-22T08:36:43.599 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.559+0000 7f6289f42800 1 -- 172.21.15.142:0/2418381256 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557625b4d000 con 0x557625b4bd70 2024-09-22T08:36:43.599 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.559+0000 7f6289f42800 1 -- 172.21.15.142:0/2418381256 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557625b4d5a0 con 0x557625b4bd70 2024-09-22T08:36:43.599 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.560+0000 7f616b7fe640 1 -- 172.21.15.142:0/2418381256 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f6280011040 con 0x557625b4bd70 2024-09-22T08:36:43.599 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.560+0000 7f616b7fe640 1 --2- 172.21.15.142:0/2418381256 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f616003cfb0 0x7f616003f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:43.599 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.560+0000 7f616b7fe640 1 -- 172.21.15.142:0/2418381256 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f628000e040 con 0x557625b4bd70 2024-09-22T08:36:43.600 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.560+0000 7f6285ced640 1 --2- 172.21.15.142:0/2418381256 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f616003cfb0 0x7f616003f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:43.600 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.560+0000 7f6289f42800 1 Processor -- start 2024-09-22T08:36:43.600 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.560+0000 7f6289f42800 1 -- start start 2024-09-22T08:36:43.600 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.560+0000 7f6285ced640 1 --2- 172.21.15.142:0/2418381256 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f616003cfb0 0x7f616003f470 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x557625b32e90 tx=0x7f6278017c10 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:43.600 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.560+0000 7f6289f42800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557625b58830 0x557625b58c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:43.600 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.560+0000 7f6289f42800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x557625b25890 con 0x557625b58830 2024-09-22T08:36:43.600 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.561+0000 7f62864ee640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557625b58830 0x557625b58c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:43.600 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.561+0000 7f62864ee640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557625b58830 0x557625b58c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:38264/0 (socket says 172.21.15.142:38264) 2024-09-22T08:36:43.600 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.561+0000 7f62864ee640 1 -- 172.21.15.142:0/1758038766 learned_addr learned my addr 172.21.15.142:0/1758038766 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:43.600 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.561+0000 7f62864ee640 1 -- 172.21.15.142:0/1758038766 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557625b59220 con 0x557625b58830 2024-09-22T08:36:43.600 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.561+0000 7f62864ee640 1 --2- 172.21.15.142:0/1758038766 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557625b58830 0x557625b58c30 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f6280054840 tx=0x7f62800204d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0fa6dda4e9e59fb server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:43.600 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.561+0000 7f61697fa640 1 -- 172.21.15.142:0/1758038766 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6280021910 con 0x557625b58830 2024-09-22T08:36:43.600 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.561+0000 7f61697fa640 1 -- 172.21.15.142:0/1758038766 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6280052070 con 0x557625b58830 2024-09-22T08:36:43.601 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.561+0000 7f61697fa640 1 -- 172.21.15.142:0/1758038766 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6280021440 con 0x557625b58830 2024-09-22T08:36:43.601 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.562+0000 7f6289f42800 1 -- 172.21.15.142:0/1758038766 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557625b58830 msgr2=0x557625b58c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:43.601 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.562+0000 7f6289f42800 1 --2- 172.21.15.142:0/1758038766 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557625b58830 0x557625b58c30 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f6280054840 tx=0x7f62800204d0 comp rx=0 tx=0).stop 2024-09-22T08:36:43.601 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.562+0000 7f6289f42800 1 -- 172.21.15.142:0/1758038766 shutdown_connections 2024-09-22T08:36:43.601 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.562+0000 7f6289f42800 1 --2- 172.21.15.142:0/1758038766 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557625b58830 0x557625b58c30 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:43.601 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.562+0000 7f6289f42800 1 -- 172.21.15.142:0/1758038766 >> 172.21.15.142:0/1758038766 conn(0x557625b54c30 msgr2=0x557625b52e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:43.601 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.562+0000 7f6289f42800 1 -- 172.21.15.142:0/1758038766 shutdown_connections 2024-09-22T08:36:43.601 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.562+0000 7f6289f42800 1 -- 172.21.15.142:0/1758038766 wait complete. 2024-09-22T08:36:43.601 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.562+0000 7f6289f42800 1 Processor -- start 2024-09-22T08:36:43.601 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.562+0000 7f6289f42800 1 -- start start 2024-09-22T08:36:43.601 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.562+0000 7f6289f42800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557625b58830 0x557625b5fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:43.601 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.562+0000 7f6289f42800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x557625b59810 con 0x557625b58830 2024-09-22T08:36:43.601 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.562+0000 7f62864ee640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557625b58830 0x557625b5fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:43.602 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.562+0000 7f62864ee640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557625b58830 0x557625b5fdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:38280/0 (socket says 172.21.15.142:38280) 2024-09-22T08:36:43.602 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.562+0000 7f62864ee640 1 -- 172.21.15.142:0/3513957811 learned_addr learned my addr 172.21.15.142:0/3513957811 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:43.602 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.562+0000 7f62864ee640 1 -- 172.21.15.142:0/3513957811 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557625b60310 con 0x557625b58830 2024-09-22T08:36:43.602 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.563+0000 7f62864ee640 1 --2- 172.21.15.142:0/3513957811 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557625b58830 0x557625b5fdb0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f6280054740 tx=0x7f62800547a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:43.602 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.563+0000 7f61577fe640 1 -- 172.21.15.142:0/3513957811 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6280013db0 con 0x557625b58830 2024-09-22T08:36:43.602 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.563+0000 7f61577fe640 1 -- 172.21.15.142:0/3513957811 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62800459e0 con 0x557625b58830 2024-09-22T08:36:43.602 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.563+0000 7f6289f42800 1 -- 172.21.15.142:0/3513957811 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557625b605a0 con 0x557625b58830 2024-09-22T08:36:43.602 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.563+0000 7f61577fe640 1 -- 172.21.15.142:0/3513957811 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6280045d00 con 0x557625b58830 2024-09-22T08:36:43.602 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.563+0000 7f6289f42800 1 -- 172.21.15.142:0/3513957811 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557625b61130 con 0x557625b58830 2024-09-22T08:36:43.602 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.564+0000 7f61577fe640 1 -- 172.21.15.142:0/3513957811 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f62800451d0 con 0x557625b58830 2024-09-22T08:36:43.602 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.564+0000 7f61577fe640 1 --2- 172.21.15.142:0/3513957811 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f615003d000 0x7f615003f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:43.602 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.564+0000 7f61577fe640 1 -- 172.21.15.142:0/3513957811 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f628003d060 con 0x557625b58830 2024-09-22T08:36:43.602 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.564+0000 7f6285ced640 1 --2- 172.21.15.142:0/3513957811 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f615003d000 0x7f615003f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:43.603 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.564+0000 7f6285ced640 1 --2- 172.21.15.142:0/3513957811 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f615003d000 0x7f615003f4c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f6278019f70 tx=0x7f6278028000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:43.603 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.564+0000 7f6289f42800 20 rados->read ofs=0 len=0 2024-09-22T08:36:43.603 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.564+0000 7f6289f42800 1 --2- 172.21.15.142:0/3513957811 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x557625b6b700 0x557625b6dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:43.603 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.564+0000 7f6289f42800 1 -- 172.21.15.142:0/3513957811 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x557625b6e310 con 0x557625b6b700 2024-09-22T08:36:43.603 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.565+0000 7f62854ec640 1 --2- 172.21.15.142:0/3513957811 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x557625b6b700 0x557625b6dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:43.603 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.565+0000 7f62854ec640 1 --2- 172.21.15.142:0/3513957811 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x557625b6b700 0x557625b6dbc0 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:43.603 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.565+0000 7f62854ec640 1 -- 172.21.15.142:0/3513957811 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f627c04f740 con 0x557625b6b700 2024-09-22T08:36:43.603 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.565+0000 7f6289f42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:43.603 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.565+0000 7f6289f42800 20 realm 2024-09-22T08:36:43.603 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.565+0000 7f6289f42800 20 rados->read ofs=0 len=0 2024-09-22T08:36:43.603 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.565+0000 7f6289f42800 1 -- 172.21.15.142:0/3513957811 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x557625b6e740 con 0x557625b6b700 2024-09-22T08:36:43.603 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.565+0000 7f62854ec640 1 -- 172.21.15.142:0/3513957811 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f627c04f740 con 0x557625b6b700 2024-09-22T08:36:43.603 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.565+0000 7f6289f42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:43.604 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.565+0000 7f6289f42800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:36:43.604 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.565+0000 7f6289f42800 20 rados->read ofs=0 len=0 2024-09-22T08:36:43.604 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.565+0000 7f6289f42800 1 -- 172.21.15.142:0/3513957811 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x557625b6f010 con 0x557625b6b700 2024-09-22T08:36:43.604 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.565+0000 7f62854ec640 1 -- 172.21.15.142:0/3513957811 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f627c04f740 con 0x557625b6b700 2024-09-22T08:36:43.604 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.565+0000 7f6289f42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:43.604 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.565+0000 7f6289f42800 20 rados->read ofs=0 len=0 2024-09-22T08:36:43.604 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.565+0000 7f6289f42800 1 -- 172.21.15.142:0/3513957811 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x557625b6f3b0 con 0x557625b6b700 2024-09-22T08:36:43.604 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.566+0000 7f62854ec640 1 -- 172.21.15.142:0/3513957811 <== osd.1 v2:172.21.15.142:6816/3192108003 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f627c04f740 con 0x557625b6b700 2024-09-22T08:36:43.604 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.566+0000 7f6289f42800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:36:43.604 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.566+0000 7f6289f42800 20 rados->read ofs=0 len=0 2024-09-22T08:36:43.604 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.566+0000 7f6289f42800 1 --2- 172.21.15.142:0/3513957811 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x557625b70110 0x557625b72500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:43.604 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.566+0000 7f6289f42800 1 -- 172.21.15.142:0/3513957811 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x557625b72b10 con 0x557625b70110 2024-09-22T08:36:43.604 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.566+0000 7f62864ee640 1 --2- 172.21.15.142:0/3513957811 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x557625b70110 0x557625b72500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:43.604 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.566+0000 7f62864ee640 1 --2- 172.21.15.142:0/3513957811 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x557625b70110 0x557625b72500 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:43.605 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.566+0000 7f62864ee640 1 -- 172.21.15.142:0/3513957811 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(5 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f628000a4d0 con 0x557625b70110 2024-09-22T08:36:43.605 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.566+0000 7f6289f42800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:36:43.605 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.566+0000 7f6289f42800 20 searching for the correct realm 2024-09-22T08:36:43.605 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.566+0000 7f6289f42800 1 -- 172.21.15.142:0/3513957811 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557625b74440 con 0x557625b70110 2024-09-22T08:36:43.605 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.567+0000 7f62864ee640 1 -- 172.21.15.142:0/3513957811 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f628000a4d0 con 0x557625b70110 2024-09-22T08:36:43.605 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.567+0000 7f62864ee640 1 --2- 172.21.15.142:0/3513957811 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f6280054c20 0x7f6280048970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:43.605 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.567+0000 7f62864ee640 1 -- 172.21.15.142:0/3513957811 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557625b74440 con 0x7f6280054c20 2024-09-22T08:36:43.605 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.567+0000 7f6285ced640 1 --2- 172.21.15.142:0/3513957811 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f6280054c20 0x7f6280048970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:43.605 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.567+0000 7f6285ced640 1 --2- 172.21.15.142:0/3513957811 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f6280054c20 0x7f6280048970 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:43.605 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.567+0000 7f6285ced640 1 -- 172.21.15.142:0/3513957811 <== osd.2 v2:172.21.15.142:6808/279438927 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f627802e070 con 0x7f6280054c20 2024-09-22T08:36:43.605 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.567+0000 7f6285ced640 1 --2- 172.21.15.142:0/3513957811 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f627800f070 0x7f62780541f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:43.605 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.567+0000 7f6285ced640 1 -- 172.21.15.142:0/3513957811 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557625b74440 con 0x7f627800f070 2024-09-22T08:36:43.606 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.568+0000 7f62854ec640 1 --2- 172.21.15.142:0/3513957811 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f627800f070 0x7f62780541f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:43.606 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.568+0000 7f62854ec640 1 --2- 172.21.15.142:0/3513957811 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f627800f070 0x7f62780541f0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:43.606 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.568+0000 7f62854ec640 1 -- 172.21.15.142:0/3513957811 <== osd.0 v2:172.21.15.31:6800/168281188 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f627c04f740 con 0x7f627800f070 2024-09-22T08:36:43.606 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.568+0000 7f62854ec640 1 -- 172.21.15.142:0/3513957811 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557625b74440 con 0x557625b6b700 2024-09-22T08:36:43.606 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.568+0000 7f62854ec640 1 -- 172.21.15.142:0/3513957811 <== osd.1 v2:172.21.15.142:6816/3192108003 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f627c04f740 con 0x557625b6b700 2024-09-22T08:36:43.606 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.568+0000 7f62854ec640 1 -- 172.21.15.142:0/3513957811 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557625b74440 con 0x557625b6b700 2024-09-22T08:36:43.606 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.569+0000 7f62854ec640 1 -- 172.21.15.142:0/3513957811 <== osd.1 v2:172.21.15.142:6816/3192108003 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f627c04f740 con 0x557625b6b700 2024-09-22T08:36:43.606 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.569+0000 7f62854ec640 1 -- 172.21.15.142:0/3513957811 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557625b74440 con 0x7f627800f070 2024-09-22T08:36:43.606 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.569+0000 7f62854ec640 1 -- 172.21.15.142:0/3513957811 <== osd.0 v2:172.21.15.31:6800/168281188 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f627c04f740 con 0x7f627800f070 2024-09-22T08:36:43.606 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.569+0000 7f62854ec640 1 -- 172.21.15.142:0/3513957811 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557625b74440 con 0x7f627800f070 2024-09-22T08:36:43.606 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.569+0000 7f62854ec640 1 -- 172.21.15.142:0/3513957811 <== osd.0 v2:172.21.15.31:6800/168281188 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f627c04f740 con 0x7f627800f070 2024-09-22T08:36:43.606 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.569+0000 7f62854ec640 1 -- 172.21.15.142:0/3513957811 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557625b74440 con 0x7f6280054c20 2024-09-22T08:36:43.606 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.569+0000 7f6285ced640 1 -- 172.21.15.142:0/3513957811 <== osd.2 v2:172.21.15.142:6808/279438927 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f627802e070 con 0x7f6280054c20 2024-09-22T08:36:43.607 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.569+0000 7f6285ced640 1 -- 172.21.15.142:0/3513957811 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557625b74440 con 0x557625b70110 2024-09-22T08:36:43.607 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.570+0000 7f62864ee640 1 -- 172.21.15.142:0/3513957811 <== osd.3 v2:172.21.15.142:6800/1064901393 3 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f628000a4d0 con 0x557625b70110 2024-09-22T08:36:43.607 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.570+0000 7f62864ee640 1 -- 172.21.15.142:0/3513957811 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557625b74440 con 0x557625b6b700 2024-09-22T08:36:43.607 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.570+0000 7f62854ec640 1 -- 172.21.15.142:0/3513957811 <== osd.1 v2:172.21.15.142:6816/3192108003 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f627c04f740 con 0x557625b6b700 2024-09-22T08:36:43.607 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.570+0000 7f62854ec640 1 -- 172.21.15.142:0/3513957811 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557625b74440 con 0x7f627800f070 2024-09-22T08:36:43.607 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.570+0000 7f62854ec640 1 -- 172.21.15.142:0/3513957811 <== osd.0 v2:172.21.15.31:6800/168281188 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f627c04f740 con 0x7f627800f070 2024-09-22T08:36:43.607 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.570+0000 7f62854ec640 1 -- 172.21.15.142:0/3513957811 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557625b74440 con 0x557625b6b700 2024-09-22T08:36:43.607 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.570+0000 7f62854ec640 1 -- 172.21.15.142:0/3513957811 <== osd.1 v2:172.21.15.142:6816/3192108003 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f627c04f740 con 0x557625b6b700 2024-09-22T08:36:43.607 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.570+0000 7f62854ec640 1 -- 172.21.15.142:0/3513957811 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557625b74440 con 0x7f6280054c20 2024-09-22T08:36:43.607 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.570+0000 7f6285ced640 1 -- 172.21.15.142:0/3513957811 <== osd.2 v2:172.21.15.142:6808/279438927 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f627802e070 con 0x7f6280054c20 2024-09-22T08:36:43.607 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.570+0000 7f6285ced640 1 -- 172.21.15.142:0/3513957811 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557625b74440 con 0x557625b70110 2024-09-22T08:36:43.607 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.571+0000 7f62864ee640 1 -- 172.21.15.142:0/3513957811 <== osd.3 v2:172.21.15.142:6800/1064901393 4 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f628000a4d0 con 0x557625b70110 2024-09-22T08:36:43.607 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.571+0000 7f62864ee640 1 -- 172.21.15.142:0/3513957811 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557625b74440 con 0x557625b70110 2024-09-22T08:36:43.608 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.571+0000 7f62864ee640 1 -- 172.21.15.142:0/3513957811 <== osd.3 v2:172.21.15.142:6800/1064901393 5 ==== osd_op_reply(20 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f628000a4d0 con 0x557625b70110 2024-09-22T08:36:43.608 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.571+0000 7f62864ee640 1 -- 172.21.15.142:0/3513957811 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557625b74440 con 0x7f627800f070 2024-09-22T08:36:43.608 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.571+0000 7f62854ec640 1 -- 172.21.15.142:0/3513957811 <== osd.0 v2:172.21.15.31:6800/168281188 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f627c04f740 con 0x7f627800f070 2024-09-22T08:36:43.608 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.571+0000 7f62854ec640 1 -- 172.21.15.142:0/3513957811 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557625b74440 con 0x557625b70110 2024-09-22T08:36:43.608 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.571+0000 7f62864ee640 1 -- 172.21.15.142:0/3513957811 <== osd.3 v2:172.21.15.142:6800/1064901393 6 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f628000a4d0 con 0x557625b70110 2024-09-22T08:36:43.608 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.571+0000 7f62864ee640 1 -- 172.21.15.142:0/3513957811 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557625b74440 con 0x557625b70110 2024-09-22T08:36:43.608 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.572+0000 7f62864ee640 1 -- 172.21.15.142:0/3513957811 <== osd.3 v2:172.21.15.142:6800/1064901393 7 ==== osd_op_reply(23 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f628000a4d0 con 0x557625b70110 2024-09-22T08:36:43.608 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.572+0000 7f62864ee640 1 -- 172.21.15.142:0/3513957811 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557625b74440 con 0x557625b6b700 2024-09-22T08:36:43.608 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.572+0000 7f62854ec640 1 -- 172.21.15.142:0/3513957811 <== osd.1 v2:172.21.15.142:6816/3192108003 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f627c04f740 con 0x557625b6b700 2024-09-22T08:36:43.608 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.572+0000 7f62854ec640 1 -- 172.21.15.142:0/3513957811 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557625b74440 con 0x557625b6b700 2024-09-22T08:36:43.608 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.572+0000 7f62854ec640 1 -- 172.21.15.142:0/3513957811 <== osd.1 v2:172.21.15.142:6816/3192108003 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f627c04f740 con 0x557625b6b700 2024-09-22T08:36:43.608 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.572+0000 7f62854ec640 1 -- 172.21.15.142:0/3513957811 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557625b74440 con 0x7f627800f070 2024-09-22T08:36:43.608 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.572+0000 7f62854ec640 1 -- 172.21.15.142:0/3513957811 <== osd.0 v2:172.21.15.31:6800/168281188 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f627c04f740 con 0x7f627800f070 2024-09-22T08:36:43.609 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.572+0000 7f62854ec640 1 -- 172.21.15.142:0/3513957811 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557625b74440 con 0x557625b70110 2024-09-22T08:36:43.609 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.573+0000 7f62864ee640 1 -- 172.21.15.142:0/3513957811 <== osd.3 v2:172.21.15.142:6800/1064901393 8 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f628000a4d0 con 0x557625b70110 2024-09-22T08:36:43.609 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.573+0000 7f62864ee640 1 -- 172.21.15.142:0/3513957811 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557625b74440 con 0x7f6280054c20 2024-09-22T08:36:43.609 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.573+0000 7f6285ced640 1 -- 172.21.15.142:0/3513957811 <== osd.2 v2:172.21.15.142:6808/279438927 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f627802e070 con 0x7f6280054c20 2024-09-22T08:36:43.609 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.573+0000 7f6285ced640 1 -- 172.21.15.142:0/3513957811 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557625b74440 con 0x557625b6b700 2024-09-22T08:36:43.609 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.573+0000 7f62854ec640 1 -- 172.21.15.142:0/3513957811 <== osd.1 v2:172.21.15.142:6816/3192108003 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f627c04f740 con 0x557625b6b700 2024-09-22T08:36:43.609 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.573+0000 7f62854ec640 1 -- 172.21.15.142:0/3513957811 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557625b74440 con 0x7f627800f070 2024-09-22T08:36:43.609 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.573+0000 7f62854ec640 1 -- 172.21.15.142:0/3513957811 <== osd.0 v2:172.21.15.31:6800/168281188 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f627c04f740 con 0x7f627800f070 2024-09-22T08:36:43.609 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.573+0000 7f62854ec640 1 -- 172.21.15.142:0/3513957811 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557625b74440 con 0x557625b70110 2024-09-22T08:36:43.609 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.574+0000 7f62864ee640 1 -- 172.21.15.142:0/3513957811 <== osd.3 v2:172.21.15.142:6800/1064901393 9 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f628000a4d0 con 0x557625b70110 2024-09-22T08:36:43.609 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.574+0000 7f62864ee640 1 -- 172.21.15.142:0/3513957811 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557625b74440 con 0x7f627800f070 2024-09-22T08:36:43.609 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.574+0000 7f62854ec640 1 -- 172.21.15.142:0/3513957811 <== osd.0 v2:172.21.15.31:6800/168281188 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f627c04f740 con 0x7f627800f070 2024-09-22T08:36:43.609 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.574+0000 7f62854ec640 1 -- 172.21.15.142:0/3513957811 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557625b74440 con 0x7f6280054c20 2024-09-22T08:36:43.609 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.574+0000 7f6285ced640 1 -- 172.21.15.142:0/3513957811 <== osd.2 v2:172.21.15.142:6808/279438927 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f627802e070 con 0x7f6280054c20 2024-09-22T08:36:43.610 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.574+0000 7f6285ced640 1 -- 172.21.15.142:0/3513957811 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557625b74440 con 0x557625b70110 2024-09-22T08:36:43.610 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.574+0000 7f62864ee640 1 -- 172.21.15.142:0/3513957811 <== osd.3 v2:172.21.15.142:6800/1064901393 10 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f628000a4d0 con 0x557625b70110 2024-09-22T08:36:43.610 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.574+0000 7f62864ee640 1 -- 172.21.15.142:0/3513957811 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557625b74440 con 0x7f627800f070 2024-09-22T08:36:43.610 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.575+0000 7f62854ec640 1 -- 172.21.15.142:0/3513957811 <== osd.0 v2:172.21.15.31:6800/168281188 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f627c04f740 con 0x7f627800f070 2024-09-22T08:36:43.610 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.575+0000 7f62854ec640 1 -- 172.21.15.142:0/3513957811 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557625b74440 con 0x557625b6b700 2024-09-22T08:36:43.610 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.575+0000 7f62854ec640 1 -- 172.21.15.142:0/3513957811 <== osd.1 v2:172.21.15.142:6816/3192108003 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f627c04f740 con 0x557625b6b700 2024-09-22T08:36:43.610 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.575+0000 7f62854ec640 1 -- 172.21.15.142:0/3513957811 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557625b74440 con 0x7f6280054c20 2024-09-22T08:36:43.610 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.575+0000 7f6285ced640 1 -- 172.21.15.142:0/3513957811 <== osd.2 v2:172.21.15.142:6808/279438927 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f627802e070 con 0x7f6280054c20 2024-09-22T08:36:43.610 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.575+0000 7f6289f42800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:36:43.610 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.575+0000 7f6289f42800 20 RGWRados::pool_iterate: got zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec 2024-09-22T08:36:43.610 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.575+0000 7f6289f42800 20 RGWRados::pool_iterate: got zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f 2024-09-22T08:36:43.610 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.575+0000 7f6289f42800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:36:43.611 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.575+0000 7f6289f42800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:36:43.611 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.575+0000 7f6289f42800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:36:43.611 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.575+0000 7f6289f42800 20 rados->read ofs=0 len=0 2024-09-22T08:36:43.611 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.575+0000 7f6289f42800 1 -- 172.21.15.142:0/3513957811 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x557625b73500 con 0x557625b6b700 2024-09-22T08:36:43.611 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.575+0000 7f62854ec640 1 -- 172.21.15.142:0/3513957811 <== osd.1 v2:172.21.15.142:6816/3192108003 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f627c04f740 con 0x557625b6b700 2024-09-22T08:36:43.611 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.575+0000 7f6289f42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:43.611 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.575+0000 7f6289f42800 20 rados->read ofs=0 len=0 2024-09-22T08:36:43.611 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.575+0000 7f6289f42800 1 -- 172.21.15.142:0/3513957811 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x557625b73d50 con 0x557625b6b700 2024-09-22T08:36:43.611 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.575+0000 7f62854ec640 1 -- 172.21.15.142:0/3513957811 <== osd.1 v2:172.21.15.142:6816/3192108003 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f627c04f740 con 0x557625b6b700 2024-09-22T08:36:43.611 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.575+0000 7f6289f42800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:36:43.612 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.575+0000 7f6289f42800 20 rados->read ofs=0 len=0 2024-09-22T08:36:43.612 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.575+0000 7f6289f42800 1 -- 172.21.15.142:0/3513957811 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:40 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x557625b748c0 con 0x557625b70110 2024-09-22T08:36:43.612 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.576+0000 7f62864ee640 1 -- 172.21.15.142:0/3513957811 <== osd.3 v2:172.21.15.142:6800/1064901393 11 ==== osd_op_reply(40 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f628000a4d0 con 0x557625b70110 2024-09-22T08:36:43.612 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.576+0000 7f6289f42800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:36:43.612 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.576+0000 7f6289f42800 20 zone default found 2024-09-22T08:36:43.612 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.576+0000 7f6289f42800 4 Realm: () 2024-09-22T08:36:43.612 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.576+0000 7f6289f42800 4 ZoneGroup: default (d89f6f57-1007-47dd-9065-f486c7b01aec) 2024-09-22T08:36:43.612 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.576+0000 7f6289f42800 4 Zone: default (e239248c-0bee-4e41-803a-24b288d3eb8f) 2024-09-22T08:36:43.612 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.576+0000 7f6289f42800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:36:43.612 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.576+0000 7f6289f42800 20 zonegroup default 2024-09-22T08:36:43.612 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.576+0000 7f6289f42800 20 rados->read ofs=0 len=0 2024-09-22T08:36:43.612 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.576+0000 7f6289f42800 1 -- 172.21.15.142:0/3513957811 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x557625b74c80 con 0x7f627800f070 2024-09-22T08:36:43.612 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.576+0000 7f62854ec640 1 -- 172.21.15.142:0/3513957811 <== osd.0 v2:172.21.15.31:6800/168281188 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f627c04f740 con 0x7f627800f070 2024-09-22T08:36:43.613 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.576+0000 7f6289f42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:43.613 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.576+0000 7f6289f42800 20 rados->read ofs=0 len=0 2024-09-22T08:36:43.613 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.576+0000 7f6289f42800 1 -- 172.21.15.142:0/3513957811 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x557625b76ae0 con 0x557625b70110 2024-09-22T08:36:43.613 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.576+0000 7f62864ee640 1 -- 172.21.15.142:0/3513957811 <== osd.3 v2:172.21.15.142:6800/1064901393 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f628000a4d0 con 0x557625b70110 2024-09-22T08:36:43.613 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.576+0000 7f6289f42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:43.613 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.576+0000 7f6289f42800 20 rados->read ofs=0 len=0 2024-09-22T08:36:43.613 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.576+0000 7f6289f42800 1 -- 172.21.15.142:0/3513957811 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x557625b76f70 con 0x557625b70110 2024-09-22T08:36:43.613 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.577+0000 7f62864ee640 1 -- 172.21.15.142:0/3513957811 <== osd.3 v2:172.21.15.142:6800/1064901393 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f628000a4d0 con 0x557625b70110 2024-09-22T08:36:43.613 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.577+0000 7f6289f42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:43.613 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.577+0000 7f6289f42800 20 started sync module instance, tier type = 2024-09-22T08:36:43.613 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.577+0000 7f6289f42800 20 started zone id=e239248c-0bee-4e41-803a-24b288d3eb8f (name=default) with tier type = 2024-09-22T08:36:43.614 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.577+0000 7f6289f42800 1 -- 172.21.15.142:0/3513957811 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557625b75f50 con 0x7f6280054c20 2024-09-22T08:36:43.614 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.578+0000 7f6285ced640 1 -- 172.21.15.142:0/3513957811 <== osd.2 v2:172.21.15.142:6808/279438927 7 ==== osd_op_reply(44 notify.0 [create] v30'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f627802e070 con 0x7f6280054c20 2024-09-22T08:36:43.614 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.578+0000 7f6289f42800 1 -- 172.21.15.142:0/3513957811 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93965927277376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557625b75bb0 con 0x7f6280054c20 2024-09-22T08:36:43.614 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.578+0000 7f6289f42800 1 -- 172.21.15.142:0/3513957811 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557625b77ea0 con 0x557625b6b700 2024-09-22T08:36:43.614 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.579+0000 7f6285ced640 1 -- 172.21.15.142:0/3513957811 <== osd.2 v2:172.21.15.142:6808/279438927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93965927277376] v30'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f627802e070 con 0x7f6280054c20 2024-09-22T08:36:43.614 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.579+0000 7f62854ec640 1 -- 172.21.15.142:0/3513957811 <== osd.1 v2:172.21.15.142:6816/3192108003 15 ==== osd_op_reply(46 notify.1 [create] v30'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f627c04f740 con 0x557625b6b700 2024-09-22T08:36:43.614 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.579+0000 7f6289f42800 1 -- 172.21.15.142:0/3513957811 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93965927283184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557625b782c0 con 0x557625b6b700 2024-09-22T08:36:43.614 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.579+0000 7f6289f42800 1 -- 172.21.15.142:0/3513957811 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557625b78c80 con 0x557625b70110 2024-09-22T08:36:43.614 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.580+0000 7f62864ee640 1 -- 172.21.15.142:0/3513957811 <== osd.3 v2:172.21.15.142:6800/1064901393 14 ==== osd_op_reply(48 notify.2 [create] v30'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f628000a4d0 con 0x557625b70110 2024-09-22T08:36:43.614 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.580+0000 7f6289f42800 1 -- 172.21.15.142:0/3513957811 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93965927286736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557625b79100 con 0x557625b70110 2024-09-22T08:36:43.614 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.580+0000 7f6289f42800 1 -- 172.21.15.142:0/3513957811 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557625b79c20 con 0x7f6280054c20 2024-09-22T08:36:43.614 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.580+0000 7f62854ec640 1 -- 172.21.15.142:0/3513957811 <== osd.1 v2:172.21.15.142:6816/3192108003 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93965927283184] v30'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f627c04f740 con 0x557625b6b700 2024-09-22T08:36:43.614 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.583+0000 7f62864ee640 1 -- 172.21.15.142:0/3513957811 <== osd.3 v2:172.21.15.142:6800/1064901393 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 93965927286736] v30'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f628000a4d0 con 0x557625b70110 2024-09-22T08:36:43.615 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.583+0000 7f6285ced640 1 -- 172.21.15.142:0/3513957811 <== osd.2 v2:172.21.15.142:6808/279438927 9 ==== osd_op_reply(50 notify.3 [create] v30'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f627802e070 con 0x7f6280054c20 2024-09-22T08:36:43.615 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.583+0000 7f6289f42800 1 -- 172.21.15.142:0/3513957811 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93965927287792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557625b77e10 con 0x7f6280054c20 2024-09-22T08:36:43.615 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.583+0000 7f6289f42800 1 -- 172.21.15.142:0/3513957811 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557625b7a500 con 0x557625b6b700 2024-09-22T08:36:43.615 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.586+0000 7f6285ced640 1 -- 172.21.15.142:0/3513957811 <== osd.2 v2:172.21.15.142:6808/279438927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93965927287792] v30'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f627802e070 con 0x7f6280054c20 2024-09-22T08:36:43.620 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.589+0000 7f62854ec640 1 -- 172.21.15.142:0/3513957811 <== osd.1 v2:172.21.15.142:6816/3192108003 17 ==== osd_op_reply(52 notify.4 [create] v30'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f627c04f740 con 0x557625b6b700 2024-09-22T08:36:43.620 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.589+0000 7f6289f42800 1 -- 172.21.15.142:0/3513957811 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93965927290608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557625b7a4c0 con 0x557625b6b700 2024-09-22T08:36:43.620 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.589+0000 7f6289f42800 1 -- 172.21.15.142:0/3513957811 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557625b7af90 con 0x7f627800f070 2024-09-22T08:36:43.620 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.590+0000 7f62854ec640 1 -- 172.21.15.142:0/3513957811 <== osd.0 v2:172.21.15.31:6800/168281188 11 ==== osd_op_reply(54 notify.5 [create] v30'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f627c04f740 con 0x7f627800f070 2024-09-22T08:36:43.620 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.590+0000 7f6289f42800 1 -- 172.21.15.142:0/3513957811 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93965927295584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557625b7af50 con 0x7f627800f070 2024-09-22T08:36:43.620 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.590+0000 7f6289f42800 1 -- 172.21.15.142:0/3513957811 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557625b7bf50 con 0x7f627800f070 2024-09-22T08:36:43.621 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.590+0000 7f62854ec640 1 -- 172.21.15.142:0/3513957811 <== osd.1 v2:172.21.15.142:6816/3192108003 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93965927290608] v30'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f627c04f740 con 0x557625b6b700 2024-09-22T08:36:43.621 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.592+0000 7f62854ec640 1 -- 172.21.15.142:0/3513957811 <== osd.0 v2:172.21.15.31:6800/168281188 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93965927295584] v30'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f627c04f740 con 0x7f627800f070 2024-09-22T08:36:43.621 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.592+0000 7f62854ec640 1 -- 172.21.15.142:0/3513957811 <== osd.0 v2:172.21.15.31:6800/168281188 13 ==== osd_op_reply(56 notify.6 [create] v30'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f627c04f740 con 0x7f627800f070 2024-09-22T08:36:43.621 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.592+0000 7f6289f42800 1 -- 172.21.15.142:0/3513957811 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93965927297920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557625b7a010 con 0x7f627800f070 2024-09-22T08:36:43.621 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.592+0000 7f6289f42800 1 -- 172.21.15.142:0/3513957811 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557625b7c400 con 0x7f627800f070 2024-09-22T08:36:43.621 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.593+0000 7f62854ec640 1 -- 172.21.15.142:0/3513957811 <== osd.0 v2:172.21.15.31:6800/168281188 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93965927297920] v30'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f627c04f740 con 0x7f627800f070 2024-09-22T08:36:43.621 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.593+0000 7f62854ec640 1 -- 172.21.15.142:0/3513957811 <== osd.0 v2:172.21.15.31:6800/168281188 15 ==== osd_op_reply(58 notify.7 [create] v30'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f627c04f740 con 0x7f627800f070 2024-09-22T08:36:43.621 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.593+0000 7f6289f42800 1 -- 172.21.15.142:0/3513957811 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93965927299712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557625b7c400 con 0x7f627800f070 2024-09-22T08:36:43.621 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.593+0000 7f6289f42800 20 add_watcher() i=0 2024-09-22T08:36:43.621 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.593+0000 7f6289f42800 20 add_watcher() i=1 2024-09-22T08:36:43.621 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.593+0000 7f6289f42800 20 add_watcher() i=2 2024-09-22T08:36:43.621 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.593+0000 7f6289f42800 20 add_watcher() i=3 2024-09-22T08:36:43.621 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.593+0000 7f6289f42800 20 add_watcher() i=4 2024-09-22T08:36:43.622 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.593+0000 7f6289f42800 20 add_watcher() i=5 2024-09-22T08:36:43.622 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.593+0000 7f6289f42800 20 add_watcher() i=6 2024-09-22T08:36:43.622 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.594+0000 7f62854ec640 1 -- 172.21.15.142:0/3513957811 <== osd.0 v2:172.21.15.31:6800/168281188 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93965927299712] v30'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f627c04f740 con 0x7f627800f070 2024-09-22T08:36:43.622 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.594+0000 7f6289f42800 20 add_watcher() i=7 2024-09-22T08:36:43.622 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.594+0000 7f6289f42800 2 all 8 watchers are set, enabling cache 2024-09-22T08:36:43.622 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.594+0000 7f6289f42800 1 -- 172.21.15.142:0/3513957811 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x557625b7f940 con 0x557625b6b700 2024-09-22T08:36:43.622 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.594+0000 7f62854ec640 1 -- 172.21.15.142:0/3513957811 <== osd.1 v2:172.21.15.142:6816/3192108003 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f627c04f740 con 0x557625b6b700 2024-09-22T08:36:43.622 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.595+0000 7f6289f42800 1 -- 172.21.15.142:0/3513957811 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93965927301872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557625b7cc80 con 0x557625b6b700 2024-09-22T08:36:43.622 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.595+0000 7f62854ec640 1 -- 172.21.15.142:0/3513957811 <== osd.1 v2:172.21.15.142:6816/3192108003 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93965927301872] v30'64 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f627c080040 con 0x557625b6b700 2024-09-22T08:36:43.622 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.595+0000 7f61377fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:36:43.622 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.596+0000 7f6289f42800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:36:43.622 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.596+0000 7f6289f42800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:36:43.622 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.596+0000 7f6289f42800 5 note: GC not initialized 2024-09-22T08:36:43.622 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.596+0000 7f61367fc640 20 reqs_thread_entry: start 2024-09-22T08:36:43.623 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.596+0000 7f6289f42800 20 init_complete bucket index max shards: 11 2024-09-22T08:36:43.623 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.596+0000 7f6289f42800 20 Filter name: none 2024-09-22T08:36:43.623 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.596+0000 7f60a7fff640 20 reqs_thread_entry: start 2024-09-22T08:36:43.623 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.596+0000 7f6289f42800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-22T08:36:43.623 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.596+0000 7f6289f42800 20 rados->read ofs=0 len=0 2024-09-22T08:36:43.623 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.596+0000 7f6289f42800 1 -- 172.21.15.142:0/3513957811 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x557625bb2d80 con 0x557625b6b700 2024-09-22T08:36:43.623 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.596+0000 7f62854ec640 1 -- 172.21.15.142:0/3513957811 <== osd.1 v2:172.21.15.142:6816/3192108003 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f627c080040 con 0x557625b6b700 2024-09-22T08:36:43.623 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.596+0000 7f6289f42800 20 rados_obj.operate() r=0 bl.length=391 2024-09-22T08:36:43.623 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.596+0000 7f6289f42800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-22T08:36:43.623 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.596+0000 7f6289f42800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-22T08:36:43.623 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.597+0000 7f6289f42800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:36:43.623 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.597+0000 7f6289f42800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-09-22T08:36:43.623 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.597+0000 7f6289f42800 20 rados->read ofs=0 len=0 2024-09-22T08:36:43.623 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.597+0000 7f6289f42800 1 -- 172.21.15.142:0/3513957811 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x557625bb37f0 con 0x7f627800f070 2024-09-22T08:36:43.624 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.597+0000 7f62854ec640 1 -- 172.21.15.142:0/3513957811 <== osd.0 v2:172.21.15.31:6800/168281188 17 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7f627c080040 con 0x7f627800f070 2024-09-22T08:36:43.624 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.597+0000 7f6289f42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:43.624 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.597+0000 7f6289f42800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-09-22T08:36:43.624 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.597+0000 7f6289f42800 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-22T08:36:43.624 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.597+0000 7f6289f42800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-22T08:36:43.624 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.597+0000 7f6289f42800 1 -- 172.21.15.142:0/3513957811 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~502 in=502b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557625bb9180 con 0x557625b6b700 2024-09-22T08:36:43.624 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.598+0000 7f62854ec640 1 -- 172.21.15.142:0/3513957811 <== osd.1 v2:172.21.15.142:6816/3192108003 22 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~502] v30'4 uv4 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f627c080040 con 0x557625b6b700 2024-09-22T08:36:43.624 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.598+0000 7f6289f42800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-22T08:36:43.624 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.598+0000 7f6289f42800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-22T08:36:43.624 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.598+0000 7f6289f42800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-22T08:36:43.624 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.598+0000 7f6289f42800 1 -- 172.21.15.142:0/3513957811 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 93965927549824 in=690b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x557625bb4880 con 0x557625b6b700 2024-09-22T08:36:43.624 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.599+0000 7f62854ec640 1 -- 172.21.15.142:0/3513957811 <== osd.1 v2:172.21.15.142:6816/3192108003 23 ==== watch-notify(notify (1) cookie 93965927290608 notify 128849018883 ret 0) ==== 720+0+0 (crc 0 0 0) 0x7f627c073040 con 0x557625b6b700 2024-09-22T08:36:43.624 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.599+0000 7f61697fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018883 cookie 93965927290608 notifier 4338 bl.length()=678 2024-09-22T08:36:43.624 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.599+0000 7f61697fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-22T08:36:43.625 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.599+0000 7f61697fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-22T08:36:43.625 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.599+0000 7f61697fa640 1 -- 172.21.15.142:0/3513957811 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f6148003ea0 con 0x557625b6b700 2024-09-22T08:36:43.625 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.599+0000 7f62854ec640 1 -- 172.21.15.142:0/3513957811 <== osd.1 v2:172.21.15.142:6816/3192108003 24 ==== osd_op_reply(65 notify.4 [notify cookie 93965927549824 out=8b] v0'0 uv45 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f627c080040 con 0x557625b6b700 2024-09-22T08:36:43.625 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.599+0000 7f62854ec640 1 -- 172.21.15.142:0/3513957811 <== osd.1 v2:172.21.15.142:6816/3192108003 25 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f627c080040 con 0x557625b6b700 2024-09-22T08:36:43.625 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.599+0000 7f62854ec640 1 -- 172.21.15.142:0/3513957811 <== osd.1 v2:172.21.15.142:6816/3192108003 26 ==== watch-notify(notify_complete (2) cookie 93965927549824 notify 128849018883 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f627c067040 con 0x557625b6b700 2024-09-22T08:36:43.625 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.599+0000 7f6289f42800 1 -- 172.21.15.142:0/3513957811 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557625bb8b80 con 0x7f627800f070 2024-09-22T08:36:43.625 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.600+0000 7f62854ec640 1 -- 172.21.15.142:0/3513957811 <== osd.0 v2:172.21.15.31:6800/168281188 18 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~7] v30'1 uv1 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f627c080040 con 0x7f627800f070 2024-09-22T08:36:43.625 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.600+0000 7f6289f42800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-22T08:36:43.625 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.600+0000 7f6289f42800 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-22T08:36:43.625 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.600+0000 7f6289f42800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-22T08:36:43.625 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.600+0000 7f6289f42800 1 -- 172.21.15.142:0/3513957811 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 93965927549824 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x557625bb43d0 con 0x557625b70110 2024-09-22T08:36:43.625 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.600+0000 7f62864ee640 1 -- 172.21.15.142:0/3513957811 <== osd.3 v2:172.21.15.142:6800/1064901393 16 ==== watch-notify(notify (1) cookie 93965927286736 notify 128849018880 ret 0) ==== 219+0+0 (crc 0 0 0) 0x557625b605a0 con 0x557625b70110 2024-09-22T08:36:43.625 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.600+0000 7f6168ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018880 cookie 93965927286736 notifier 4338 bl.length()=177 2024-09-22T08:36:43.625 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.600+0000 7f6168ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-22T08:36:43.626 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.600+0000 7f6168ff9640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-22T08:36:43.626 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.600+0000 7f62864ee640 1 -- 172.21.15.142:0/3513957811 <== osd.3 v2:172.21.15.142:6800/1064901393 17 ==== osd_op_reply(68 notify.2 [notify cookie 93965927549824 out=8b] v0'0 uv45 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f628000a4d0 con 0x557625b70110 2024-09-22T08:36:43.626 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.600+0000 7f6168ff9640 1 -- 172.21.15.142:0/3513957811 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f60b0003400 con 0x557625b70110 2024-09-22T08:36:43.626 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.601+0000 7f62864ee640 1 -- 172.21.15.142:0/3513957811 <== osd.3 v2:172.21.15.142:6800/1064901393 18 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f628000a4d0 con 0x557625b70110 2024-09-22T08:36:43.626 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.601+0000 7f62864ee640 1 -- 172.21.15.142:0/3513957811 <== osd.3 v2:172.21.15.142:6800/1064901393 19 ==== watch-notify(notify_complete (2) cookie 93965927549824 notify 128849018880 ret 0) ==== 42+0+48 (crc 0 0 0) 0x557625b60310 con 0x557625b70110 2024-09-22T08:36:43.626 INFO:teuthology.orchestra.run.smithi142.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-22T08:36:42.661297Z"},{"user":"foo","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-09-22T08:36:43.598495Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-22T08:36:42.661288Z","tags":[],"group_ids":[]} 2024-09-22T08:36:43.631 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.602+0000 7f61377fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:36:43.631 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.602+0000 7f6289f42800 1 -- 172.21.15.142:0/3513957811 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93965927301872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557625bb77f0 con 0x557625b6b700 2024-09-22T08:36:43.631 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.603+0000 7f62854ec640 1 -- 172.21.15.142:0/3513957811 <== osd.1 v2:172.21.15.142:6816/3192108003 27 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 93965927301872] v30'65 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f627c080040 con 0x557625b6b700 2024-09-22T08:36:43.632 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.603+0000 7f6289f42800 1 -- 172.21.15.142:0/3513957811 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93965927277376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557625bb0a30 con 0x7f6280054c20 2024-09-22T08:36:43.632 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.603+0000 7f6285ced640 1 -- 172.21.15.142:0/3513957811 <== osd.2 v2:172.21.15.142:6808/279438927 11 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 93965927277376] v30'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f627802e070 con 0x7f6280054c20 2024-09-22T08:36:43.632 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.603+0000 7f6289f42800 20 remove_watcher() i=0 2024-09-22T08:36:43.632 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.603+0000 7f6289f42800 2 removed watcher, disabling cache 2024-09-22T08:36:43.632 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.604+0000 7f6289f42800 1 -- 172.21.15.142:0/3513957811 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93965927283184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557625bb0a30 con 0x557625b6b700 2024-09-22T08:36:43.632 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.605+0000 7f62854ec640 1 -- 172.21.15.142:0/3513957811 <== osd.1 v2:172.21.15.142:6816/3192108003 28 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 93965927283184] v30'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f627c080040 con 0x557625b6b700 2024-09-22T08:36:43.632 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.605+0000 7f6289f42800 20 remove_watcher() i=1 2024-09-22T08:36:43.632 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.605+0000 7f6289f42800 1 -- 172.21.15.142:0/3513957811 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93965927286736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557625bb0a30 con 0x557625b70110 2024-09-22T08:36:43.632 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.606+0000 7f62864ee640 1 -- 172.21.15.142:0/3513957811 <== osd.3 v2:172.21.15.142:6800/1064901393 20 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 93965927286736] v30'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f628000a4d0 con 0x557625b70110 2024-09-22T08:36:43.632 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.606+0000 7f6289f42800 20 remove_watcher() i=2 2024-09-22T08:36:43.632 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.606+0000 7f6289f42800 1 -- 172.21.15.142:0/3513957811 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93965927287792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557625bb0a30 con 0x7f6280054c20 2024-09-22T08:36:43.632 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.607+0000 7f6285ced640 1 -- 172.21.15.142:0/3513957811 <== osd.2 v2:172.21.15.142:6808/279438927 12 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 93965927287792] v30'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f627802e070 con 0x7f6280054c20 2024-09-22T08:36:43.633 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.607+0000 7f6289f42800 20 remove_watcher() i=3 2024-09-22T08:36:43.633 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.607+0000 7f6289f42800 1 -- 172.21.15.142:0/3513957811 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93965927290608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557625bb0a30 con 0x557625b6b700 2024-09-22T08:36:43.633 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.609+0000 7f62854ec640 1 -- 172.21.15.142:0/3513957811 <== osd.1 v2:172.21.15.142:6816/3192108003 29 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 93965927290608] v30'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f627c080040 con 0x557625b6b700 2024-09-22T08:36:43.633 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.609+0000 7f6289f42800 20 remove_watcher() i=4 2024-09-22T08:36:43.633 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.609+0000 7f6289f42800 1 -- 172.21.15.142:0/3513957811 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93965927295584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557625bb0a30 con 0x7f627800f070 2024-09-22T08:36:43.633 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.610+0000 7f62854ec640 1 -- 172.21.15.142:0/3513957811 <== osd.0 v2:172.21.15.31:6800/168281188 19 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 93965927295584] v30'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f627c080040 con 0x7f627800f070 2024-09-22T08:36:43.633 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.610+0000 7f6289f42800 20 remove_watcher() i=5 2024-09-22T08:36:43.633 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.610+0000 7f6289f42800 1 -- 172.21.15.142:0/3513957811 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93965927297920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557625bb0a30 con 0x7f627800f070 2024-09-22T08:36:43.633 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.611+0000 7f62854ec640 1 -- 172.21.15.142:0/3513957811 <== osd.0 v2:172.21.15.31:6800/168281188 20 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 93965927297920] v30'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f627c080040 con 0x7f627800f070 2024-09-22T08:36:43.633 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.611+0000 7f6289f42800 20 remove_watcher() i=6 2024-09-22T08:36:43.633 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.611+0000 7f6289f42800 1 -- 172.21.15.142:0/3513957811 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93965927299712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557625bb0a30 con 0x7f627800f070 2024-09-22T08:36:43.633 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.612+0000 7f62854ec640 1 -- 172.21.15.142:0/3513957811 <== osd.0 v2:172.21.15.31:6800/168281188 21 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 93965927299712] v30'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f627c080040 con 0x7f627800f070 2024-09-22T08:36:43.633 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.612+0000 7f6289f42800 20 remove_watcher() i=7 2024-09-22T08:36:43.633 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.612+0000 7f6289f42800 1 -- 172.21.15.142:0/3513957811 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f627800f070 msgr2=0x7f62780541f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:43.634 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.612+0000 7f6289f42800 1 --2- 172.21.15.142:0/3513957811 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f627800f070 0x7f62780541f0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:43.634 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.612+0000 7f6289f42800 1 -- 172.21.15.142:0/3513957811 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x557625b6b700 msgr2=0x557625b6dbc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:43.634 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.612+0000 7f6289f42800 1 --2- 172.21.15.142:0/3513957811 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x557625b6b700 0x557625b6dbc0 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:43.634 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.612+0000 7f6289f42800 1 -- 172.21.15.142:0/3513957811 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f6280054c20 msgr2=0x7f6280048970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:43.634 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.612+0000 7f6289f42800 1 --2- 172.21.15.142:0/3513957811 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f6280054c20 0x7f6280048970 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:43.634 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.612+0000 7f6289f42800 1 -- 172.21.15.142:0/3513957811 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x557625b70110 msgr2=0x557625b72500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:43.634 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.612+0000 7f6289f42800 1 --2- 172.21.15.142:0/3513957811 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x557625b70110 0x557625b72500 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:43.634 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.612+0000 7f6289f42800 1 -- 172.21.15.142:0/3513957811 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f615003d000 msgr2=0x7f615003f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:43.634 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.612+0000 7f6289f42800 1 --2- 172.21.15.142:0/3513957811 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f615003d000 0x7f615003f4c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f6278019f70 tx=0x7f6278028000 comp rx=0 tx=0).stop 2024-09-22T08:36:43.634 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.612+0000 7f6289f42800 1 -- 172.21.15.142:0/3513957811 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557625b58830 msgr2=0x557625b5fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:43.634 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.612+0000 7f62854ec640 1 -- 172.21.15.142:0/3513957811 reap_dead start 2024-09-22T08:36:43.634 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.612+0000 7f6289f42800 1 --2- 172.21.15.142:0/3513957811 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557625b58830 0x557625b5fdb0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f6280054740 tx=0x7f62800547a0 comp rx=0 tx=0).stop 2024-09-22T08:36:43.635 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.612+0000 7f6289f42800 1 -- 172.21.15.142:0/3513957811 shutdown_connections 2024-09-22T08:36:43.635 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.612+0000 7f6289f42800 1 --2- 172.21.15.142:0/3513957811 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557625b58830 0x557625b5fdb0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:43.635 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.612+0000 7f6289f42800 1 -- 172.21.15.142:0/3513957811 >> 172.21.15.142:0/3513957811 conn(0x557625b54c30 msgr2=0x557625b52e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:43.635 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.612+0000 7f6289f42800 1 -- 172.21.15.142:0/3513957811 shutdown_connections 2024-09-22T08:36:43.635 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.612+0000 7f6289f42800 1 -- 172.21.15.142:0/3513957811 wait complete. 2024-09-22T08:36:43.635 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.612+0000 7f6289f42800 1 -- 172.21.15.142:0/2418381256 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f616003cfb0 msgr2=0x7f616003f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:43.635 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.612+0000 7f6289f42800 1 --2- 172.21.15.142:0/2418381256 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f616003cfb0 0x7f616003f470 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x557625b32e90 tx=0x7f6278017c10 comp rx=0 tx=0).stop 2024-09-22T08:36:43.635 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.612+0000 7f6289f42800 1 -- 172.21.15.142:0/2418381256 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557625b4bd70 msgr2=0x557625b4c190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:43.635 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.612+0000 7f6289f42800 1 --2- 172.21.15.142:0/2418381256 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557625b4bd70 0x557625b4c190 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x557625b31da0 tx=0x7f62800167b0 comp rx=0 tx=0).stop 2024-09-22T08:36:43.635 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.612+0000 7f6289f42800 1 -- 172.21.15.142:0/2418381256 shutdown_connections 2024-09-22T08:36:43.635 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.612+0000 7f6289f42800 1 --2- 172.21.15.142:0/2418381256 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f616003cfb0 0x7f616003f470 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:43.635 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.612+0000 7f6289f42800 1 --2- 172.21.15.142:0/2418381256 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557625b4bd70 0x557625b4c190 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:43.635 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.612+0000 7f6289f42800 1 -- 172.21.15.142:0/2418381256 >> 172.21.15.142:0/2418381256 conn(0x557625b40120 msgr2=0x557625b40500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:43.635 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.612+0000 7f6289f42800 1 -- 172.21.15.142:0/2418381256 shutdown_connections 2024-09-22T08:36:43.636 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.612+0000 7f6289f42800 1 -- 172.21.15.142:0/2418381256 wait complete. 2024-09-22T08:36:43.636 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.613+0000 7f6289f42800 1 -- 172.21.15.142:0/2475635960 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x557625a37c10 msgr2=0x557625b383f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:43.636 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.613+0000 7f6289f42800 1 --2- 172.21.15.142:0/2475635960 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x557625a37c10 0x557625b383f0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:43.636 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.613+0000 7f6289f42800 1 -- 172.21.15.142:0/2475635960 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x557625b3a7d0 msgr2=0x557625b3cc50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:43.636 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.613+0000 7f6289f42800 1 --2- 172.21.15.142:0/2475635960 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x557625b3a7d0 0x557625b3cc50 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:43.636 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.613+0000 7f6289f42800 1 -- 172.21.15.142:0/2475635960 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f616c03cfb0 msgr2=0x7f616c03f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:43.636 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.613+0000 7f6289f42800 1 --2- 172.21.15.142:0/2475635960 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f616c03cfb0 0x7f616c03f470 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f627c058000 tx=0x7f627c053000 comp rx=0 tx=0).stop 2024-09-22T08:36:43.636 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.613+0000 7f6289f42800 1 -- 172.21.15.142:0/2475635960 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557625a36800 msgr2=0x557625b30da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:43.636 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.613+0000 7f6289f42800 1 --2- 172.21.15.142:0/2475635960 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557625a36800 0x557625b30da0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x557625b25e00 tx=0x7f6278000ed0 comp rx=0 tx=0).stop 2024-09-22T08:36:43.636 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.613+0000 7f6289f42800 1 -- 172.21.15.142:0/2475635960 shutdown_connections 2024-09-22T08:36:43.636 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.613+0000 7f6289f42800 1 --2- 172.21.15.142:0/2475635960 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x557625b3a7d0 0x557625b3cc50 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:43.636 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.613+0000 7f6289f42800 1 --2- 172.21.15.142:0/2475635960 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x557625a37c10 0x557625b383f0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:43.636 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.613+0000 7f6289f42800 1 --2- 172.21.15.142:0/2475635960 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f616c03cfb0 0x7f616c03f470 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:43.636 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.613+0000 7f6289f42800 1 --2- 172.21.15.142:0/2475635960 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557625a36800 0x557625b30da0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:43.637 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.613+0000 7f6289f42800 1 -- 172.21.15.142:0/2475635960 >> 172.21.15.142:0/2475635960 conn(0x557625a31bd0 msgr2=0x557625b26360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:43.637 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.613+0000 7f6289f42800 1 -- 172.21.15.142:0/2475635960 shutdown_connections 2024-09-22T08:36:43.637 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.613+0000 7f6289f42800 1 -- 172.21.15.142:0/2475635960 wait complete. 2024-09-22T08:36:43.637 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-22T08:36:42.661297Z'}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-09-22T08:36:43.598495Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-22T08:36:42.661288Z', 'tags': [], 'group_ids': []} 2024-09-22T08:36:43.637 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-22T08:36:43.637 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-22T08:36:43.637 DEBUG:teuthology.orchestra.run.smithi142:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-22T08:36:43.684 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:36:43.684 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:36:43.684 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.683+0000 7f158bd26800 1 Processor -- start 2024-09-22T08:36:43.685 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.683+0000 7f158bd26800 1 -- start start 2024-09-22T08:36:43.685 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.683+0000 7f158bd26800 1 --2- >> v2:172.21.15.31:3300/0 conn(0x5634336b1a90 0x5634336b1e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:43.685 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.684+0000 7f158bd26800 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56343353ea20 con 0x5634336b6910 2024-09-22T08:36:43.685 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.684+0000 7f158bd26800 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x56343353e7d0 con 0x5634336b1a90 2024-09-22T08:36:43.685 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.684+0000 7f15879d9640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x5634336b1a90 0x5634336b1e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:43.686 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.684+0000 7f157f1d8640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x5634336b6910 0x5634336b8d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.142:42358/0 (socket says 172.21.15.142:42358) 2024-09-22T08:36:43.686 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.684+0000 7f157f1d8640 1 -- 172.21.15.142:0/1240769140 learned_addr learned my addr 172.21.15.142:0/1240769140 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-09-22T08:36:43.686 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.684+0000 7f15879d9640 1 -- 172.21.15.142:0/1240769140 >> v1:172.21.15.31:6789/0 conn(0x5634336b6910 legacy=0x5634336b8d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:43.686 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.684+0000 7f15879d9640 1 -- 172.21.15.142:0/1240769140 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5634336bb570 con 0x5634336b1a90 2024-09-22T08:36:43.686 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.684+0000 7f15871d8640 1 -- 172.21.15.142:0/1240769140 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2513610097 0 0) 0x56343353ea20 con 0x5634336b6910 2024-09-22T08:36:43.687 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.686+0000 7f15879d9640 1 --2- 172.21.15.142:0/1240769140 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5634336b1a90 0x5634336b1e90 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f157800a470 tx=0x7f1578045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c92a27acb8a54b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:43.687 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.686+0000 7f15871d8640 1 -- 172.21.15.142:0/1240769140 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1578053570 con 0x5634336b1a90 2024-09-22T08:36:43.687 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.686+0000 7f15871d8640 1 -- 172.21.15.142:0/1240769140 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1578058070 con 0x5634336b1a90 2024-09-22T08:36:43.688 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.686+0000 7f15871d8640 1 -- 172.21.15.142:0/1240769140 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1578053880 con 0x5634336b1a90 2024-09-22T08:36:43.688 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.687+0000 7f158bd26800 1 -- 172.21.15.142:0/1240769140 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5634336b1a90 msgr2=0x5634336b1e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:43.688 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.687+0000 7f158bd26800 1 --2- 172.21.15.142:0/1240769140 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5634336b1a90 0x5634336b1e90 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f157800a470 tx=0x7f1578045a20 comp rx=0 tx=0).stop 2024-09-22T08:36:43.688 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.687+0000 7f158bd26800 1 -- 172.21.15.142:0/1240769140 shutdown_connections 2024-09-22T08:36:43.689 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.687+0000 7f158bd26800 1 --2- 172.21.15.142:0/1240769140 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5634336b1a90 0x5634336b1e90 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:43.689 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.687+0000 7f158bd26800 1 -- 172.21.15.142:0/1240769140 >> 172.21.15.142:0/1240769140 conn(0x5634336ad310 msgr2=0x5634336af790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:43.689 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.687+0000 7f158bd26800 1 -- 172.21.15.142:0/1240769140 shutdown_connections 2024-09-22T08:36:43.689 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.687+0000 7f158bd26800 1 -- 172.21.15.142:0/1240769140 wait complete. 2024-09-22T08:36:43.703 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.701+0000 7f158bd26800 1 Processor -- start 2024-09-22T08:36:43.703 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.701+0000 7f158bd26800 1 -- start start 2024-09-22T08:36:43.703 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.701+0000 7f158bd26800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5634336b1a90 0x5634337a2e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:43.703 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.701+0000 7f158bd26800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x56343354bdd0 con 0x5634336b1a90 2024-09-22T08:36:43.703 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.701+0000 7f15879d9640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5634336b1a90 0x5634337a2e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:43.703 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.701+0000 7f15879d9640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5634336b1a90 0x5634337a2e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:38302/0 (socket says 172.21.15.142:38302) 2024-09-22T08:36:43.703 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.701+0000 7f15879d9640 1 -- 172.21.15.142:0/3789953419 learned_addr learned my addr 172.21.15.142:0/3789953419 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:43.703 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.701+0000 7f15879d9640 1 -- 172.21.15.142:0/3789953419 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5634337a3470 con 0x5634336b1a90 2024-09-22T08:36:43.703 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.701+0000 7f15879d9640 1 --2- 172.21.15.142:0/3789953419 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5634336b1a90 0x5634337a2e80 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f1578025c20 tx=0x7f1578051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b82e21d858aa5c32 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:43.704 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.702+0000 7f1475e0b640 1 -- 172.21.15.142:0/3789953419 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1578053a20 con 0x5634336b1a90 2024-09-22T08:36:43.704 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.702+0000 7f1475e0b640 1 -- 172.21.15.142:0/3789953419 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1578063070 con 0x5634336b1a90 2024-09-22T08:36:43.704 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.702+0000 7f1475e0b640 1 -- 172.21.15.142:0/3789953419 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1578053d30 con 0x5634336b1a90 2024-09-22T08:36:43.707 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.702+0000 7f158bd26800 1 -- 172.21.15.142:0/3789953419 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5634336b1a90 msgr2=0x5634337a2e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:43.707 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.702+0000 7f158bd26800 1 --2- 172.21.15.142:0/3789953419 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5634336b1a90 0x5634337a2e80 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f1578025c20 tx=0x7f1578051000 comp rx=0 tx=0).stop 2024-09-22T08:36:43.707 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.702+0000 7f158bd26800 1 -- 172.21.15.142:0/3789953419 shutdown_connections 2024-09-22T08:36:43.707 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.702+0000 7f158bd26800 1 --2- 172.21.15.142:0/3789953419 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5634336b1a90 0x5634337a2e80 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:43.707 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.702+0000 7f158bd26800 1 -- 172.21.15.142:0/3789953419 >> 172.21.15.142:0/3789953419 conn(0x5634336ad310 msgr2=0x56343379e800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:43.708 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.702+0000 7f158bd26800 1 -- 172.21.15.142:0/3789953419 shutdown_connections 2024-09-22T08:36:43.708 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.702+0000 7f158bd26800 1 -- 172.21.15.142:0/3789953419 wait complete. 2024-09-22T08:36:43.708 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.703+0000 7f158bd26800 1 Processor -- start 2024-09-22T08:36:43.708 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.703+0000 7f158bd26800 1 -- start start 2024-09-22T08:36:43.708 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.703+0000 7f158bd26800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5634336b1a90 0x5634337aa960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:43.708 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.703+0000 7f158bd26800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5634336ba810 con 0x5634336b1a90 2024-09-22T08:36:43.708 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.703+0000 7f15879d9640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5634336b1a90 0x5634337aa960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:43.708 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.703+0000 7f15879d9640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5634336b1a90 0x5634337aa960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:38314/0 (socket says 172.21.15.142:38314) 2024-09-22T08:36:43.708 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.703+0000 7f15879d9640 1 -- 172.21.15.142:0/2149302137 learned_addr learned my addr 172.21.15.142:0/2149302137 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:43.708 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.703+0000 7f15879d9640 1 -- 172.21.15.142:0/2149302137 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5634337aaec0 con 0x5634336b1a90 2024-09-22T08:36:43.708 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.704+0000 7f15879d9640 1 --2- 172.21.15.142:0/2149302137 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5634336b1a90 0x5634337aa960 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f1578025c20 tx=0x7f1578002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:43.708 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.704+0000 7f146ffff640 1 -- 172.21.15.142:0/2149302137 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1578078070 con 0x5634336b1a90 2024-09-22T08:36:43.708 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.704+0000 7f146ffff640 1 -- 172.21.15.142:0/2149302137 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1578073470 con 0x5634336b1a90 2024-09-22T08:36:43.709 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.704+0000 7f158bd26800 1 -- 172.21.15.142:0/2149302137 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5634337ab150 con 0x5634336b1a90 2024-09-22T08:36:43.709 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.704+0000 7f146ffff640 1 -- 172.21.15.142:0/2149302137 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1578073750 con 0x5634336b1a90 2024-09-22T08:36:43.709 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.704+0000 7f158bd26800 1 -- 172.21.15.142:0/2149302137 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5634337abd10 con 0x5634336b1a90 2024-09-22T08:36:43.709 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.705+0000 7f146ffff640 1 -- 172.21.15.142:0/2149302137 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f157807b070 con 0x5634336b1a90 2024-09-22T08:36:43.709 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.705+0000 7f146ffff640 1 --2- 172.21.15.142:0/2149302137 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f147003cfb0 0x7f147003f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:43.709 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.705+0000 7f146ffff640 1 -- 172.21.15.142:0/2149302137 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f1578098510 con 0x5634336b1a90 2024-09-22T08:36:43.709 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.705+0000 7f157f1d8640 1 --2- 172.21.15.142:0/2149302137 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f147003cfb0 0x7f147003f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:43.709 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.705+0000 7f158bd26800 1 --2- 172.21.15.142:0/2149302137 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5634336b6910 0x5634337b1f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:43.709 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.705+0000 7f158bd26800 1 -- 172.21.15.142:0/2149302137 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5634337ac6d0 con 0x5634336b6910 2024-09-22T08:36:43.709 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.705+0000 7f15881da640 1 --2- 172.21.15.142:0/2149302137 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5634336b6910 0x5634337b1f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:43.709 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.705+0000 7f157f1d8640 1 --2- 172.21.15.142:0/2149302137 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f147003cfb0 0x7f147003f470 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f1570000c00 tx=0x7f15700013b0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:43.709 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.705+0000 7f15881da640 1 --2- 172.21.15.142:0/2149302137 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5634336b6910 0x5634337b1f60 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:43.709 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.706+0000 7f15881da640 1 -- 172.21.15.142:0/2149302137 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f158000a4d0 con 0x5634336b6910 2024-09-22T08:36:43.710 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.706+0000 7f158bd26800 1 -- 172.21.15.142:0/2149302137 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5634337ac080 con 0x5634336b6910 2024-09-22T08:36:43.710 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.706+0000 7f15881da640 1 -- 172.21.15.142:0/2149302137 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f158000a4d0 con 0x5634336b6910 2024-09-22T08:36:43.710 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.706+0000 7f158bd26800 1 --2- 172.21.15.142:0/2149302137 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5634337b43d0 0x5634337b67c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:43.710 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.706+0000 7f158bd26800 1 -- 172.21.15.142:0/2149302137 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:3 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5634337b6e90 con 0x5634337b43d0 2024-09-22T08:36:43.710 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.706+0000 7f15879d9640 1 --2- 172.21.15.142:0/2149302137 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5634337b43d0 0x5634337b67c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:43.710 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.706+0000 7f15879d9640 1 --2- 172.21.15.142:0/2149302137 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5634337b43d0 0x5634337b67c0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:43.720 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.707+0000 7f15879d9640 1 -- 172.21.15.142:0/2149302137 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(3 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f157807a030 con 0x5634337b43d0 2024-09-22T08:36:43.720 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.707+0000 7f158bd26800 1 -- 172.21.15.142:0/2149302137 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5634337b3270 con 0x5634336b6910 2024-09-22T08:36:43.720 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.707+0000 7f15881da640 1 -- 172.21.15.142:0/2149302137 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f158000a4d0 con 0x5634336b6910 2024-09-22T08:36:43.720 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.707+0000 7f158bd26800 1 -- 172.21.15.142:0/2149302137 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5634337b3710 con 0x5634337b43d0 2024-09-22T08:36:43.720 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.707+0000 7f15879d9640 1 -- 172.21.15.142:0/2149302137 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(5 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f157807a030 con 0x5634337b43d0 2024-09-22T08:36:43.721 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.707+0000 7f158bd26800 1 Processor -- start 2024-09-22T08:36:43.721 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.708+0000 7f158bd26800 1 -- start start 2024-09-22T08:36:43.721 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.708+0000 7f158bd26800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5634336b40a0 0x5634336b2910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:43.721 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.708+0000 7f158bd26800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5634335aad50 con 0x5634336b40a0 2024-09-22T08:36:43.721 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.708+0000 7f15881da640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5634336b40a0 0x5634336b2910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:43.721 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.708+0000 7f15881da640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5634336b40a0 0x5634336b2910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:38326/0 (socket says 172.21.15.142:38326) 2024-09-22T08:36:43.721 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.708+0000 7f15881da640 1 -- 172.21.15.142:0/2552770757 learned_addr learned my addr 172.21.15.142:0/2552770757 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:43.721 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.708+0000 7f15881da640 1 -- 172.21.15.142:0/2552770757 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5634336b45c0 con 0x5634336b40a0 2024-09-22T08:36:43.721 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.708+0000 7f15881da640 1 --2- 172.21.15.142:0/2552770757 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5634336b40a0 0x5634336b2910 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x5634337ab910 tx=0x7f15800167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:43.721 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.709+0000 7f146d7fa640 1 -- 172.21.15.142:0/2552770757 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1580013640 con 0x5634336b40a0 2024-09-22T08:36:43.721 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.709+0000 7f146d7fa640 1 -- 172.21.15.142:0/2552770757 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15800137e0 con 0x5634336b40a0 2024-09-22T08:36:43.721 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.709+0000 7f158bd26800 1 -- 172.21.15.142:0/2552770757 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5634336b2e50 con 0x5634336b40a0 2024-09-22T08:36:43.721 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.709+0000 7f146d7fa640 1 -- 172.21.15.142:0/2552770757 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1580013ae0 con 0x5634336b40a0 2024-09-22T08:36:43.722 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.709+0000 7f158bd26800 1 -- 172.21.15.142:0/2552770757 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5634336b33a0 con 0x5634336b40a0 2024-09-22T08:36:43.722 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.709+0000 7f146d7fa640 1 -- 172.21.15.142:0/2552770757 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f1580011040 con 0x5634336b40a0 2024-09-22T08:36:43.722 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.710+0000 7f146d7fa640 1 --2- 172.21.15.142:0/2552770757 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f146003cfb0 0x7f146003f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:43.722 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.710+0000 7f146d7fa640 1 -- 172.21.15.142:0/2552770757 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f158000e040 con 0x5634336b40a0 2024-09-22T08:36:43.722 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.710+0000 7f15879d9640 1 --2- 172.21.15.142:0/2552770757 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f146003cfb0 0x7f146003f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:43.722 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.710+0000 7f158bd26800 1 Processor -- start 2024-09-22T08:36:43.722 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.710+0000 7f158bd26800 1 -- start start 2024-09-22T08:36:43.722 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.710+0000 7f15879d9640 1 --2- 172.21.15.142:0/2552770757 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f146003cfb0 0x7f146003f470 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f1578096af0 tx=0x7f1578005390 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:43.722 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.710+0000 7f158bd26800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5634337d44e0 0x5634337d48e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:43.722 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.710+0000 7f158bd26800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5634337a3840 con 0x5634337d44e0 2024-09-22T08:36:43.722 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.710+0000 7f15881da640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5634337d44e0 0x5634337d48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:43.722 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.710+0000 7f15881da640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5634337d44e0 0x5634337d48e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:38330/0 (socket says 172.21.15.142:38330) 2024-09-22T08:36:43.723 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.710+0000 7f15881da640 1 -- 172.21.15.142:0/3816058375 learned_addr learned my addr 172.21.15.142:0/3816058375 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:43.723 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.711+0000 7f15881da640 1 -- 172.21.15.142:0/3816058375 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5634337d4ed0 con 0x5634337d44e0 2024-09-22T08:36:43.723 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.711+0000 7f15881da640 1 --2- 172.21.15.142:0/3816058375 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5634337d44e0 0x5634337d48e0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f1580054770 tx=0x7f1580056110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5325992cc641a9e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:43.723 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.711+0000 7f1466ffd640 1 -- 172.21.15.142:0/3816058375 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1580051020 con 0x5634337d44e0 2024-09-22T08:36:43.723 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.711+0000 7f1466ffd640 1 -- 172.21.15.142:0/3816058375 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1580021a90 con 0x5634337d44e0 2024-09-22T08:36:43.723 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.711+0000 7f1466ffd640 1 -- 172.21.15.142:0/3816058375 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f158001f490 con 0x5634337d44e0 2024-09-22T08:36:43.723 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.711+0000 7f158bd26800 1 -- 172.21.15.142:0/3816058375 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5634337d44e0 msgr2=0x5634337d48e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:43.723 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.711+0000 7f158bd26800 1 --2- 172.21.15.142:0/3816058375 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5634337d44e0 0x5634337d48e0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f1580054770 tx=0x7f1580056110 comp rx=0 tx=0).stop 2024-09-22T08:36:43.723 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.711+0000 7f158bd26800 1 -- 172.21.15.142:0/3816058375 shutdown_connections 2024-09-22T08:36:43.723 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.711+0000 7f158bd26800 1 --2- 172.21.15.142:0/3816058375 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5634337d44e0 0x5634337d48e0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:43.723 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.711+0000 7f158bd26800 1 -- 172.21.15.142:0/3816058375 >> 172.21.15.142:0/3816058375 conn(0x5634337d08e0 msgr2=0x5634337ceb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:43.723 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.711+0000 7f158bd26800 1 -- 172.21.15.142:0/3816058375 shutdown_connections 2024-09-22T08:36:43.723 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.711+0000 7f158bd26800 1 -- 172.21.15.142:0/3816058375 wait complete. 2024-09-22T08:36:43.724 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.712+0000 7f158bd26800 1 Processor -- start 2024-09-22T08:36:43.724 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.712+0000 7f158bd26800 1 -- start start 2024-09-22T08:36:43.724 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.712+0000 7f158bd26800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5634337d44e0 0x5634337dbaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:43.724 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.712+0000 7f158bd26800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5634337d54f0 con 0x5634337d44e0 2024-09-22T08:36:43.724 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.712+0000 7f15881da640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5634337d44e0 0x5634337dbaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:43.724 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.712+0000 7f15881da640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5634337d44e0 0x5634337dbaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:38344/0 (socket says 172.21.15.142:38344) 2024-09-22T08:36:43.724 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.712+0000 7f15881da640 1 -- 172.21.15.142:0/1385709764 learned_addr learned my addr 172.21.15.142:0/1385709764 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:43.724 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.712+0000 7f15881da640 1 -- 172.21.15.142:0/1385709764 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5634337dc050 con 0x5634337d44e0 2024-09-22T08:36:43.724 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.713+0000 7f15881da640 1 --2- 172.21.15.142:0/1385709764 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5634337d44e0 0x5634337dbaf0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f1580021a60 tx=0x7f15800547a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:43.724 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.713+0000 7f14657fa640 1 -- 172.21.15.142:0/1385709764 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1580045bf0 con 0x5634337d44e0 2024-09-22T08:36:43.724 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.713+0000 7f14657fa640 1 -- 172.21.15.142:0/1385709764 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1580045d90 con 0x5634337d44e0 2024-09-22T08:36:43.724 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.713+0000 7f158bd26800 1 -- 172.21.15.142:0/1385709764 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5634337dc2e0 con 0x5634337d44e0 2024-09-22T08:36:43.724 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.713+0000 7f14657fa640 1 -- 172.21.15.142:0/1385709764 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1580054a80 con 0x5634337d44e0 2024-09-22T08:36:43.724 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.713+0000 7f158bd26800 1 -- 172.21.15.142:0/1385709764 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5634337dcc60 con 0x5634337d44e0 2024-09-22T08:36:43.725 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.713+0000 7f14657fa640 1 -- 172.21.15.142:0/1385709764 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f1580054c20 con 0x5634337d44e0 2024-09-22T08:36:43.725 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.714+0000 7f14657fa640 1 --2- 172.21.15.142:0/1385709764 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f145003cfb0 0x7f145003f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:43.725 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.714+0000 7f14657fa640 1 -- 172.21.15.142:0/1385709764 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f158004c030 con 0x5634337d44e0 2024-09-22T08:36:43.725 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.714+0000 7f15879d9640 1 --2- 172.21.15.142:0/1385709764 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f145003cfb0 0x7f145003f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:43.725 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.714+0000 7f158bd26800 20 rados->read ofs=0 len=0 2024-09-22T08:36:43.725 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.714+0000 7f158bd26800 1 --2- 172.21.15.142:0/1385709764 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5634337e73e0 0x5634337e98a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:43.725 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.714+0000 7f158bd26800 1 -- 172.21.15.142:0/1385709764 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5634337e9ff0 con 0x5634337e73e0 2024-09-22T08:36:43.725 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.714+0000 7f157f1d8640 1 --2- 172.21.15.142:0/1385709764 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5634337e73e0 0x5634337e98a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:43.725 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.714+0000 7f15879d9640 1 --2- 172.21.15.142:0/1385709764 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f145003cfb0 0x7f145003f470 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x5634337b2540 tx=0x7f1578093000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:43.725 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.714+0000 7f157f1d8640 1 --2- 172.21.15.142:0/1385709764 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5634337e73e0 0x5634337e98a0 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:43.726 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.715+0000 7f157f1d8640 1 -- 172.21.15.142:0/1385709764 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f157000f5f0 con 0x5634337e73e0 2024-09-22T08:36:43.726 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.715+0000 7f158bd26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:43.726 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.715+0000 7f158bd26800 20 realm 2024-09-22T08:36:43.726 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.715+0000 7f158bd26800 20 rados->read ofs=0 len=0 2024-09-22T08:36:43.726 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.715+0000 7f158bd26800 1 -- 172.21.15.142:0/1385709764 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5634337e6730 con 0x5634337e73e0 2024-09-22T08:36:43.726 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.715+0000 7f157f1d8640 1 -- 172.21.15.142:0/1385709764 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f157000f5f0 con 0x5634337e73e0 2024-09-22T08:36:43.726 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.715+0000 7f158bd26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:43.726 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.715+0000 7f158bd26800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:36:43.726 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.715+0000 7f158bd26800 20 rados->read ofs=0 len=0 2024-09-22T08:36:43.726 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.715+0000 7f158bd26800 1 -- 172.21.15.142:0/1385709764 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5634337eaad0 con 0x5634337e73e0 2024-09-22T08:36:43.726 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.715+0000 7f157f1d8640 1 -- 172.21.15.142:0/1385709764 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f157000f5f0 con 0x5634337e73e0 2024-09-22T08:36:43.726 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.715+0000 7f158bd26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:43.727 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.715+0000 7f158bd26800 20 rados->read ofs=0 len=0 2024-09-22T08:36:43.727 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.715+0000 7f158bd26800 1 -- 172.21.15.142:0/1385709764 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5634337eb3a0 con 0x5634337e73e0 2024-09-22T08:36:43.727 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.715+0000 7f157f1d8640 1 -- 172.21.15.142:0/1385709764 <== osd.1 v2:172.21.15.142:6816/3192108003 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f157000f5f0 con 0x5634337e73e0 2024-09-22T08:36:43.727 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.715+0000 7f158bd26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:36:43.727 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.715+0000 7f158bd26800 20 rados->read ofs=0 len=0 2024-09-22T08:36:43.727 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.715+0000 7f158bd26800 1 --2- 172.21.15.142:0/1385709764 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5634337ebca0 0x5634337ee0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:43.727 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.715+0000 7f158bd26800 1 -- 172.21.15.142:0/1385709764 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5634337ee810 con 0x5634337ebca0 2024-09-22T08:36:43.727 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.715+0000 7f15881da640 1 --2- 172.21.15.142:0/1385709764 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5634337ebca0 0x5634337ee0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:43.727 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.716+0000 7f15881da640 1 --2- 172.21.15.142:0/1385709764 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5634337ebca0 0x5634337ee0b0 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:43.727 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.716+0000 7f15881da640 1 -- 172.21.15.142:0/1385709764 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(5 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f158000a4d0 con 0x5634337ebca0 2024-09-22T08:36:43.727 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.716+0000 7f158bd26800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:36:43.728 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.716+0000 7f158bd26800 20 searching for the correct realm 2024-09-22T08:36:43.728 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.716+0000 7f158bd26800 1 -- 172.21.15.142:0/1385709764 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5634337f01f0 con 0x5634337ebca0 2024-09-22T08:36:43.728 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.716+0000 7f15881da640 1 -- 172.21.15.142:0/1385709764 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f158000a4d0 con 0x5634337ebca0 2024-09-22T08:36:43.728 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.716+0000 7f15881da640 1 --2- 172.21.15.142:0/1385709764 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f158004d2d0 0x7f1580015460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:43.728 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.716+0000 7f15881da640 1 -- 172.21.15.142:0/1385709764 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5634337f01f0 con 0x7f158004d2d0 2024-09-22T08:36:43.728 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.716+0000 7f15879d9640 1 --2- 172.21.15.142:0/1385709764 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f158004d2d0 0x7f1580015460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:43.728 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.717+0000 7f15879d9640 1 --2- 172.21.15.142:0/1385709764 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f158004d2d0 0x7f1580015460 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:43.728 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.717+0000 7f15879d9640 1 -- 172.21.15.142:0/1385709764 <== osd.2 v2:172.21.15.142:6808/279438927 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1578091070 con 0x7f158004d2d0 2024-09-22T08:36:43.728 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.717+0000 7f15879d9640 1 --2- 172.21.15.142:0/1385709764 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f15780a6040 0x7f1578068470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:43.729 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.717+0000 7f15879d9640 1 -- 172.21.15.142:0/1385709764 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5634337f01f0 con 0x7f15780a6040 2024-09-22T08:36:43.729 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.717+0000 7f157f1d8640 1 --2- 172.21.15.142:0/1385709764 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f15780a6040 0x7f1578068470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:43.729 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.717+0000 7f157f1d8640 1 --2- 172.21.15.142:0/1385709764 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f15780a6040 0x7f1578068470 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:43.729 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.718+0000 7f157f1d8640 1 -- 172.21.15.142:0/1385709764 <== osd.0 v2:172.21.15.31:6800/168281188 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f157000f5f0 con 0x7f15780a6040 2024-09-22T08:36:43.729 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.718+0000 7f157f1d8640 1 -- 172.21.15.142:0/1385709764 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5634337f01f0 con 0x5634337e73e0 2024-09-22T08:36:43.729 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.718+0000 7f157f1d8640 1 -- 172.21.15.142:0/1385709764 <== osd.1 v2:172.21.15.142:6816/3192108003 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f157000f5f0 con 0x5634337e73e0 2024-09-22T08:36:43.730 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.718+0000 7f157f1d8640 1 -- 172.21.15.142:0/1385709764 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5634337f01f0 con 0x5634337e73e0 2024-09-22T08:36:43.730 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.718+0000 7f157f1d8640 1 -- 172.21.15.142:0/1385709764 <== osd.1 v2:172.21.15.142:6816/3192108003 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f157002b040 con 0x5634337e73e0 2024-09-22T08:36:43.730 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.718+0000 7f157f1d8640 1 -- 172.21.15.142:0/1385709764 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5634337f01f0 con 0x7f15780a6040 2024-09-22T08:36:43.730 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.718+0000 7f157f1d8640 1 -- 172.21.15.142:0/1385709764 <== osd.0 v2:172.21.15.31:6800/168281188 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f157002b040 con 0x7f15780a6040 2024-09-22T08:36:43.730 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.718+0000 7f157f1d8640 1 -- 172.21.15.142:0/1385709764 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5634337f01f0 con 0x7f15780a6040 2024-09-22T08:36:43.730 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.719+0000 7f157f1d8640 1 -- 172.21.15.142:0/1385709764 <== osd.0 v2:172.21.15.31:6800/168281188 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f157002b040 con 0x7f15780a6040 2024-09-22T08:36:43.731 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.719+0000 7f157f1d8640 1 -- 172.21.15.142:0/1385709764 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5634337f01f0 con 0x7f158004d2d0 2024-09-22T08:36:43.731 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.719+0000 7f15879d9640 1 -- 172.21.15.142:0/1385709764 <== osd.2 v2:172.21.15.142:6808/279438927 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1578091070 con 0x7f158004d2d0 2024-09-22T08:36:43.731 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.719+0000 7f15879d9640 1 -- 172.21.15.142:0/1385709764 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5634337f01f0 con 0x5634337ebca0 2024-09-22T08:36:43.731 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.719+0000 7f15881da640 1 -- 172.21.15.142:0/1385709764 <== osd.3 v2:172.21.15.142:6800/1064901393 3 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f158000a4d0 con 0x5634337ebca0 2024-09-22T08:36:43.731 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.719+0000 7f15881da640 1 -- 172.21.15.142:0/1385709764 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5634337f01f0 con 0x5634337e73e0 2024-09-22T08:36:43.731 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.719+0000 7f157f1d8640 1 -- 172.21.15.142:0/1385709764 <== osd.1 v2:172.21.15.142:6816/3192108003 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f157002b040 con 0x5634337e73e0 2024-09-22T08:36:43.731 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.719+0000 7f157f1d8640 1 -- 172.21.15.142:0/1385709764 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5634337f01f0 con 0x7f15780a6040 2024-09-22T08:36:43.743 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.720+0000 7f157f1d8640 1 -- 172.21.15.142:0/1385709764 <== osd.0 v2:172.21.15.31:6800/168281188 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f157002b040 con 0x7f15780a6040 2024-09-22T08:36:43.744 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.720+0000 7f157f1d8640 1 -- 172.21.15.142:0/1385709764 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5634337f01f0 con 0x5634337e73e0 2024-09-22T08:36:43.744 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.720+0000 7f157f1d8640 1 -- 172.21.15.142:0/1385709764 <== osd.1 v2:172.21.15.142:6816/3192108003 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f157002b040 con 0x5634337e73e0 2024-09-22T08:36:43.744 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.720+0000 7f157f1d8640 1 -- 172.21.15.142:0/1385709764 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5634337f01f0 con 0x7f158004d2d0 2024-09-22T08:36:43.744 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.720+0000 7f15879d9640 1 -- 172.21.15.142:0/1385709764 <== osd.2 v2:172.21.15.142:6808/279438927 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f1578091070 con 0x7f158004d2d0 2024-09-22T08:36:43.744 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.720+0000 7f15879d9640 1 -- 172.21.15.142:0/1385709764 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5634337f01f0 con 0x5634337ebca0 2024-09-22T08:36:43.744 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.720+0000 7f15881da640 1 -- 172.21.15.142:0/1385709764 <== osd.3 v2:172.21.15.142:6800/1064901393 4 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f158000a4d0 con 0x5634337ebca0 2024-09-22T08:36:43.744 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.720+0000 7f15881da640 1 -- 172.21.15.142:0/1385709764 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5634337f01f0 con 0x5634337ebca0 2024-09-22T08:36:43.744 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.720+0000 7f15881da640 1 -- 172.21.15.142:0/1385709764 <== osd.3 v2:172.21.15.142:6800/1064901393 5 ==== osd_op_reply(20 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f158000a4d0 con 0x5634337ebca0 2024-09-22T08:36:43.744 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.720+0000 7f15881da640 1 -- 172.21.15.142:0/1385709764 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5634337f01f0 con 0x7f15780a6040 2024-09-22T08:36:43.744 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.721+0000 7f157f1d8640 1 -- 172.21.15.142:0/1385709764 <== osd.0 v2:172.21.15.31:6800/168281188 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f157002b040 con 0x7f15780a6040 2024-09-22T08:36:43.744 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.721+0000 7f157f1d8640 1 -- 172.21.15.142:0/1385709764 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5634337f01f0 con 0x5634337ebca0 2024-09-22T08:36:43.744 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.721+0000 7f15881da640 1 -- 172.21.15.142:0/1385709764 <== osd.3 v2:172.21.15.142:6800/1064901393 6 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f158000a4d0 con 0x5634337ebca0 2024-09-22T08:36:43.745 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.721+0000 7f15881da640 1 -- 172.21.15.142:0/1385709764 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5634337f01f0 con 0x5634337ebca0 2024-09-22T08:36:43.745 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.721+0000 7f15881da640 1 -- 172.21.15.142:0/1385709764 <== osd.3 v2:172.21.15.142:6800/1064901393 7 ==== osd_op_reply(23 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f158000a4d0 con 0x5634337ebca0 2024-09-22T08:36:43.745 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.721+0000 7f15881da640 1 -- 172.21.15.142:0/1385709764 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5634337f01f0 con 0x5634337e73e0 2024-09-22T08:36:43.745 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.721+0000 7f157f1d8640 1 -- 172.21.15.142:0/1385709764 <== osd.1 v2:172.21.15.142:6816/3192108003 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f157002b040 con 0x5634337e73e0 2024-09-22T08:36:43.745 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.721+0000 7f157f1d8640 1 -- 172.21.15.142:0/1385709764 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5634337f01f0 con 0x5634337e73e0 2024-09-22T08:36:43.745 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.722+0000 7f157f1d8640 1 -- 172.21.15.142:0/1385709764 <== osd.1 v2:172.21.15.142:6816/3192108003 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f157002b040 con 0x5634337e73e0 2024-09-22T08:36:43.745 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.722+0000 7f157f1d8640 1 -- 172.21.15.142:0/1385709764 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5634337f01f0 con 0x7f15780a6040 2024-09-22T08:36:43.745 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.722+0000 7f157f1d8640 1 -- 172.21.15.142:0/1385709764 <== osd.0 v2:172.21.15.31:6800/168281188 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f157002b040 con 0x7f15780a6040 2024-09-22T08:36:43.745 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.722+0000 7f157f1d8640 1 -- 172.21.15.142:0/1385709764 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5634337f01f0 con 0x5634337ebca0 2024-09-22T08:36:43.745 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.722+0000 7f15881da640 1 -- 172.21.15.142:0/1385709764 <== osd.3 v2:172.21.15.142:6800/1064901393 8 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f158000a4d0 con 0x5634337ebca0 2024-09-22T08:36:43.745 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.722+0000 7f15881da640 1 -- 172.21.15.142:0/1385709764 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5634337f01f0 con 0x7f158004d2d0 2024-09-22T08:36:43.746 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.722+0000 7f15879d9640 1 -- 172.21.15.142:0/1385709764 <== osd.2 v2:172.21.15.142:6808/279438927 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1578091070 con 0x7f158004d2d0 2024-09-22T08:36:43.746 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.722+0000 7f15879d9640 1 -- 172.21.15.142:0/1385709764 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5634337f01f0 con 0x5634337e73e0 2024-09-22T08:36:43.746 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.723+0000 7f157f1d8640 1 -- 172.21.15.142:0/1385709764 <== osd.1 v2:172.21.15.142:6816/3192108003 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f157002b040 con 0x5634337e73e0 2024-09-22T08:36:43.746 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.723+0000 7f157f1d8640 1 -- 172.21.15.142:0/1385709764 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5634337f01f0 con 0x7f15780a6040 2024-09-22T08:36:43.746 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.723+0000 7f157f1d8640 1 -- 172.21.15.142:0/1385709764 <== osd.0 v2:172.21.15.31:6800/168281188 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f157003b040 con 0x7f15780a6040 2024-09-22T08:36:43.746 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.723+0000 7f157f1d8640 1 -- 172.21.15.142:0/1385709764 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5634337f01f0 con 0x5634337ebca0 2024-09-22T08:36:43.746 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.723+0000 7f15881da640 1 -- 172.21.15.142:0/1385709764 <== osd.3 v2:172.21.15.142:6800/1064901393 9 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f158000a4d0 con 0x5634337ebca0 2024-09-22T08:36:43.746 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.723+0000 7f15881da640 1 -- 172.21.15.142:0/1385709764 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5634337f01f0 con 0x7f15780a6040 2024-09-22T08:36:43.746 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.723+0000 7f157f1d8640 1 -- 172.21.15.142:0/1385709764 <== osd.0 v2:172.21.15.31:6800/168281188 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f157003b040 con 0x7f15780a6040 2024-09-22T08:36:43.746 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.723+0000 7f157f1d8640 1 -- 172.21.15.142:0/1385709764 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5634337f01f0 con 0x7f158004d2d0 2024-09-22T08:36:43.747 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.724+0000 7f15879d9640 1 -- 172.21.15.142:0/1385709764 <== osd.2 v2:172.21.15.142:6808/279438927 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1578091070 con 0x7f158004d2d0 2024-09-22T08:36:43.747 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.724+0000 7f15879d9640 1 -- 172.21.15.142:0/1385709764 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5634337f01f0 con 0x5634337ebca0 2024-09-22T08:36:43.747 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.724+0000 7f15881da640 1 -- 172.21.15.142:0/1385709764 <== osd.3 v2:172.21.15.142:6800/1064901393 10 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f158000a4d0 con 0x5634337ebca0 2024-09-22T08:36:43.747 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.724+0000 7f15881da640 1 -- 172.21.15.142:0/1385709764 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5634337f01f0 con 0x7f15780a6040 2024-09-22T08:36:43.747 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.724+0000 7f157f1d8640 1 -- 172.21.15.142:0/1385709764 <== osd.0 v2:172.21.15.31:6800/168281188 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f157003b040 con 0x7f15780a6040 2024-09-22T08:36:43.747 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.724+0000 7f157f1d8640 1 -- 172.21.15.142:0/1385709764 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5634337f01f0 con 0x5634337e73e0 2024-09-22T08:36:43.747 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.724+0000 7f157f1d8640 1 -- 172.21.15.142:0/1385709764 <== osd.1 v2:172.21.15.142:6816/3192108003 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f157003b040 con 0x5634337e73e0 2024-09-22T08:36:43.747 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.724+0000 7f157f1d8640 1 -- 172.21.15.142:0/1385709764 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5634337f01f0 con 0x7f158004d2d0 2024-09-22T08:36:43.747 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.725+0000 7f15879d9640 1 -- 172.21.15.142:0/1385709764 <== osd.2 v2:172.21.15.142:6808/279438927 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1578091070 con 0x7f158004d2d0 2024-09-22T08:36:43.747 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.725+0000 7f158bd26800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:36:43.747 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.725+0000 7f158bd26800 20 RGWRados::pool_iterate: got zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec 2024-09-22T08:36:43.747 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.725+0000 7f158bd26800 20 RGWRados::pool_iterate: got zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f 2024-09-22T08:36:43.747 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.725+0000 7f158bd26800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:36:43.747 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.725+0000 7f158bd26800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:36:43.748 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.725+0000 7f158bd26800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:36:43.748 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.725+0000 7f158bd26800 20 rados->read ofs=0 len=0 2024-09-22T08:36:43.748 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.725+0000 7f158bd26800 1 -- 172.21.15.142:0/1385709764 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5634337ef2c0 con 0x5634337e73e0 2024-09-22T08:36:43.748 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.725+0000 7f157f1d8640 1 -- 172.21.15.142:0/1385709764 <== osd.1 v2:172.21.15.142:6816/3192108003 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f157003b040 con 0x5634337e73e0 2024-09-22T08:36:43.748 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.725+0000 7f158bd26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:43.748 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.725+0000 7f158bd26800 20 rados->read ofs=0 len=0 2024-09-22T08:36:43.748 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.725+0000 7f158bd26800 1 -- 172.21.15.142:0/1385709764 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5634337eef00 con 0x5634337e73e0 2024-09-22T08:36:43.748 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.725+0000 7f157f1d8640 1 -- 172.21.15.142:0/1385709764 <== osd.1 v2:172.21.15.142:6816/3192108003 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f157003b040 con 0x5634337e73e0 2024-09-22T08:36:43.748 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.725+0000 7f158bd26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:36:43.748 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.725+0000 7f158bd26800 20 rados->read ofs=0 len=0 2024-09-22T08:36:43.748 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.725+0000 7f158bd26800 1 -- 172.21.15.142:0/1385709764 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:40 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5634337efc20 con 0x5634337ebca0 2024-09-22T08:36:43.748 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.725+0000 7f15881da640 1 -- 172.21.15.142:0/1385709764 <== osd.3 v2:172.21.15.142:6800/1064901393 11 ==== osd_op_reply(40 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f158000a4d0 con 0x5634337ebca0 2024-09-22T08:36:43.748 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.725+0000 7f158bd26800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:36:43.749 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.725+0000 7f158bd26800 20 zone default found 2024-09-22T08:36:43.749 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.725+0000 7f158bd26800 4 Realm: () 2024-09-22T08:36:43.749 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.725+0000 7f158bd26800 4 ZoneGroup: default (d89f6f57-1007-47dd-9065-f486c7b01aec) 2024-09-22T08:36:43.749 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.725+0000 7f158bd26800 4 Zone: default (e239248c-0bee-4e41-803a-24b288d3eb8f) 2024-09-22T08:36:43.749 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.725+0000 7f158bd26800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:36:43.749 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.725+0000 7f158bd26800 20 zonegroup default 2024-09-22T08:36:43.749 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.725+0000 7f158bd26800 20 rados->read ofs=0 len=0 2024-09-22T08:36:43.749 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.725+0000 7f158bd26800 1 -- 172.21.15.142:0/1385709764 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5634337ef790 con 0x7f15780a6040 2024-09-22T08:36:43.749 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.726+0000 7f157f1d8640 1 -- 172.21.15.142:0/1385709764 <== osd.0 v2:172.21.15.31:6800/168281188 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f157003b040 con 0x7f15780a6040 2024-09-22T08:36:43.749 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.726+0000 7f158bd26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:43.749 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.726+0000 7f158bd26800 20 rados->read ofs=0 len=0 2024-09-22T08:36:43.749 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.726+0000 7f158bd26800 1 -- 172.21.15.142:0/1385709764 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5634337f2610 con 0x5634337ebca0 2024-09-22T08:36:43.750 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.726+0000 7f15881da640 1 -- 172.21.15.142:0/1385709764 <== osd.3 v2:172.21.15.142:6800/1064901393 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f158000a4d0 con 0x5634337ebca0 2024-09-22T08:36:43.750 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.726+0000 7f158bd26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:43.750 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.726+0000 7f158bd26800 20 rados->read ofs=0 len=0 2024-09-22T08:36:43.750 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.726+0000 7f158bd26800 1 -- 172.21.15.142:0/1385709764 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5634337f2aa0 con 0x5634337ebca0 2024-09-22T08:36:43.750 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.726+0000 7f15881da640 1 -- 172.21.15.142:0/1385709764 <== osd.3 v2:172.21.15.142:6800/1064901393 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f158000a4d0 con 0x5634337ebca0 2024-09-22T08:36:43.750 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.726+0000 7f158bd26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:43.750 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.726+0000 7f158bd26800 20 started sync module instance, tier type = 2024-09-22T08:36:43.750 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.726+0000 7f158bd26800 20 started zone id=e239248c-0bee-4e41-803a-24b288d3eb8f (name=default) with tier type = 2024-09-22T08:36:43.750 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.726+0000 7f158bd26800 1 -- 172.21.15.142:0/1385709764 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5634337f1a80 con 0x7f158004d2d0 2024-09-22T08:36:43.750 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.727+0000 7f15879d9640 1 -- 172.21.15.142:0/1385709764 <== osd.2 v2:172.21.15.142:6808/279438927 7 ==== osd_op_reply(44 notify.0 [create] v30'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1578091070 con 0x7f158004d2d0 2024-09-22T08:36:43.750 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.727+0000 7f158bd26800 1 -- 172.21.15.142:0/1385709764 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94782202257312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5634337f1a80 con 0x7f158004d2d0 2024-09-22T08:36:43.750 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.727+0000 7f158bd26800 1 -- 172.21.15.142:0/1385709764 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5634337f3560 con 0x5634337e73e0 2024-09-22T08:36:43.751 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.728+0000 7f15879d9640 1 -- 172.21.15.142:0/1385709764 <== osd.2 v2:172.21.15.142:6808/279438927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94782202257312] v30'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1578091070 con 0x7f158004d2d0 2024-09-22T08:36:43.751 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.729+0000 7f157f1d8640 1 -- 172.21.15.142:0/1385709764 <== osd.1 v2:172.21.15.142:6816/3192108003 15 ==== osd_op_reply(46 notify.1 [create] v30'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f157003b040 con 0x5634337e73e0 2024-09-22T08:36:43.751 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.729+0000 7f158bd26800 1 -- 172.21.15.142:0/1385709764 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94782202254800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5634337f3520 con 0x5634337e73e0 2024-09-22T08:36:43.751 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.729+0000 7f158bd26800 1 -- 172.21.15.142:0/1385709764 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5634337f4020 con 0x5634337ebca0 2024-09-22T08:36:43.751 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.730+0000 7f157f1d8640 1 -- 172.21.15.142:0/1385709764 <== osd.1 v2:172.21.15.142:6816/3192108003 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94782202254800] v30'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f157003b040 con 0x5634337e73e0 2024-09-22T08:36:43.751 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.730+0000 7f15881da640 1 -- 172.21.15.142:0/1385709764 <== osd.3 v2:172.21.15.142:6800/1064901393 14 ==== osd_op_reply(48 notify.2 [create] v30'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f158000a4d0 con 0x5634337ebca0 2024-09-22T08:36:43.751 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.730+0000 7f158bd26800 1 -- 172.21.15.142:0/1385709764 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94782202264336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5634337f3520 con 0x5634337ebca0 2024-09-22T08:36:43.751 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.730+0000 7f158bd26800 1 -- 172.21.15.142:0/1385709764 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5634337f4ac0 con 0x7f158004d2d0 2024-09-22T08:36:43.751 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.731+0000 7f15881da640 1 -- 172.21.15.142:0/1385709764 <== osd.3 v2:172.21.15.142:6800/1064901393 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94782202264336] v30'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f158000a4d0 con 0x5634337ebca0 2024-09-22T08:36:43.751 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.731+0000 7f15879d9640 1 -- 172.21.15.142:0/1385709764 <== osd.2 v2:172.21.15.142:6808/279438927 9 ==== osd_op_reply(50 notify.3 [create] v30'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1578091070 con 0x7f158004d2d0 2024-09-22T08:36:43.751 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.731+0000 7f158bd26800 1 -- 172.21.15.142:0/1385709764 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94782202267056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5634337f3520 con 0x7f158004d2d0 2024-09-22T08:36:43.751 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.731+0000 7f158bd26800 1 -- 172.21.15.142:0/1385709764 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5634337f5530 con 0x5634337e73e0 2024-09-22T08:36:43.751 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.733+0000 7f15879d9640 1 -- 172.21.15.142:0/1385709764 <== osd.2 v2:172.21.15.142:6808/279438927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94782202267056] v30'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1578091070 con 0x7f158004d2d0 2024-09-22T08:36:43.752 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.734+0000 7f157f1d8640 1 -- 172.21.15.142:0/1385709764 <== osd.1 v2:172.21.15.142:6816/3192108003 17 ==== osd_op_reply(52 notify.4 [create] v30'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f157003b040 con 0x5634337e73e0 2024-09-22T08:36:43.752 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.734+0000 7f158bd26800 1 -- 172.21.15.142:0/1385709764 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94782202269728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5634337f54f0 con 0x5634337e73e0 2024-09-22T08:36:43.752 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.734+0000 7f158bd26800 1 -- 172.21.15.142:0/1385709764 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5634337f5fc0 con 0x7f15780a6040 2024-09-22T08:36:43.752 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.735+0000 7f157f1d8640 1 -- 172.21.15.142:0/1385709764 <== osd.1 v2:172.21.15.142:6816/3192108003 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94782202269728] v30'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f157003b040 con 0x5634337e73e0 2024-09-22T08:36:43.752 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.736+0000 7f157f1d8640 1 -- 172.21.15.142:0/1385709764 <== osd.0 v2:172.21.15.31:6800/168281188 11 ==== osd_op_reply(54 notify.5 [create] v30'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f157003b040 con 0x7f15780a6040 2024-09-22T08:36:43.752 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.736+0000 7f158bd26800 1 -- 172.21.15.142:0/1385709764 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94782202272432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5634337f5f80 con 0x7f15780a6040 2024-09-22T08:36:43.752 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.736+0000 7f158bd26800 1 -- 172.21.15.142:0/1385709764 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5634337f6a00 con 0x7f15780a6040 2024-09-22T08:36:43.752 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.737+0000 7f157f1d8640 1 -- 172.21.15.142:0/1385709764 <== osd.0 v2:172.21.15.31:6800/168281188 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94782202272432] v30'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f157003b040 con 0x7f15780a6040 2024-09-22T08:36:43.752 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.737+0000 7f157f1d8640 1 -- 172.21.15.142:0/1385709764 <== osd.0 v2:172.21.15.31:6800/168281188 13 ==== osd_op_reply(56 notify.6 [create] v30'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f157003b040 con 0x7f15780a6040 2024-09-22T08:36:43.752 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.737+0000 7f158bd26800 1 -- 172.21.15.142:0/1385709764 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94782202261616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5634337f6a00 con 0x7f15780a6040 2024-09-22T08:36:43.752 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.737+0000 7f158bd26800 1 -- 172.21.15.142:0/1385709764 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5634337f7400 con 0x7f15780a6040 2024-09-22T08:36:43.752 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.738+0000 7f157f1d8640 1 -- 172.21.15.142:0/1385709764 <== osd.0 v2:172.21.15.31:6800/168281188 14 ==== osd_op_reply(58 notify.7 [create] v30'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f157003b040 con 0x7f15780a6040 2024-09-22T08:36:43.753 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.738+0000 7f157f1d8640 1 -- 172.21.15.142:0/1385709764 <== osd.0 v2:172.21.15.31:6800/168281188 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94782202261616] v30'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f157003b040 con 0x7f15780a6040 2024-09-22T08:36:43.753 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.738+0000 7f158bd26800 1 -- 172.21.15.142:0/1385709764 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94782202277648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5634337f7820 con 0x7f15780a6040 2024-09-22T08:36:43.753 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.738+0000 7f158bd26800 20 add_watcher() i=0 2024-09-22T08:36:43.753 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.738+0000 7f158bd26800 20 add_watcher() i=1 2024-09-22T08:36:43.753 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.738+0000 7f158bd26800 20 add_watcher() i=2 2024-09-22T08:36:43.753 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.738+0000 7f158bd26800 20 add_watcher() i=3 2024-09-22T08:36:43.753 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.738+0000 7f158bd26800 20 add_watcher() i=4 2024-09-22T08:36:43.753 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.738+0000 7f158bd26800 20 add_watcher() i=5 2024-09-22T08:36:43.753 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.738+0000 7f158bd26800 20 add_watcher() i=6 2024-09-22T08:36:43.753 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.739+0000 7f157f1d8640 1 -- 172.21.15.142:0/1385709764 <== osd.0 v2:172.21.15.31:6800/168281188 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94782202277648] v30'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f157003b040 con 0x7f15780a6040 2024-09-22T08:36:43.753 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.739+0000 7f158bd26800 20 add_watcher() i=7 2024-09-22T08:36:43.753 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.739+0000 7f158bd26800 2 all 8 watchers are set, enabling cache 2024-09-22T08:36:43.753 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.739+0000 7f158bd26800 1 -- 172.21.15.142:0/1385709764 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5634337faca0 con 0x5634337e73e0 2024-09-22T08:36:43.753 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.739+0000 7f157f1d8640 1 -- 172.21.15.142:0/1385709764 <== osd.1 v2:172.21.15.142:6816/3192108003 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f157003b040 con 0x5634337e73e0 2024-09-22T08:36:43.754 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.739+0000 7f158bd26800 1 -- 172.21.15.142:0/1385709764 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94782202278704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5634337f8120 con 0x5634337e73e0 2024-09-22T08:36:43.754 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.740+0000 7f157f1d8640 1 -- 172.21.15.142:0/1385709764 <== osd.1 v2:172.21.15.142:6816/3192108003 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94782202278704] v30'66 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f157003b040 con 0x5634337e73e0 2024-09-22T08:36:43.754 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.740+0000 7f143dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:36:43.754 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.740+0000 7f158bd26800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:36:43.754 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.740+0000 7f158bd26800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:36:43.754 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.740+0000 7f158bd26800 5 note: GC not initialized 2024-09-22T08:36:43.754 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.741+0000 7f143cfe1640 20 reqs_thread_entry: start 2024-09-22T08:36:43.754 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.741+0000 7f158bd26800 20 init_complete bucket index max shards: 11 2024-09-22T08:36:43.754 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.741+0000 7f158bd26800 20 Filter name: none 2024-09-22T08:36:43.754 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.741+0000 7f13b67fc640 20 reqs_thread_entry: start 2024-09-22T08:36:43.754 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.741+0000 7f158bd26800 20 rados->read ofs=0 len=0 2024-09-22T08:36:43.754 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.741+0000 7f158bd26800 1 -- 172.21.15.142:0/1385709764 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56343382d8e0 con 0x5634337e73e0 2024-09-22T08:36:43.754 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.741+0000 7f157f1d8640 1 -- 172.21.15.142:0/1385709764 <== osd.1 v2:172.21.15.142:6816/3192108003 21 ==== osd_op_reply(62 foo [call out=48b,read 0~502 out=502b,getxattrs out=75b] v0'0 uv4 ondisk = 0) ==== 231+0+625 (crc 0 0 0) 0x7f157003b040 con 0x5634337e73e0 2024-09-22T08:36:43.754 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.742+0000 7f158bd26800 20 rados_obj.operate() r=0 bl.length=502 2024-09-22T08:36:43.755 INFO:teuthology.orchestra.run.smithi142.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-22T08:36:42.661297Z"},{"user":"foo","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-09-22T08:36:43.598495Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-22T08:36:42.661288Z","tags":[],"group_ids":[]} 2024-09-22T08:36:43.760 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.742+0000 7f143dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:36:43.760 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.742+0000 7f158bd26800 1 -- 172.21.15.142:0/1385709764 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94782202278704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56343382c250 con 0x5634337e73e0 2024-09-22T08:36:43.760 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.743+0000 7f157f1d8640 1 -- 172.21.15.142:0/1385709764 <== osd.1 v2:172.21.15.142:6816/3192108003 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94782202278704] v30'67 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f157003b040 con 0x5634337e73e0 2024-09-22T08:36:43.760 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.743+0000 7f158bd26800 1 -- 172.21.15.142:0/1385709764 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94782202257312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56343382b680 con 0x7f158004d2d0 2024-09-22T08:36:43.760 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.744+0000 7f15879d9640 1 -- 172.21.15.142:0/1385709764 <== osd.2 v2:172.21.15.142:6808/279438927 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94782202257312] v30'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1578091070 con 0x7f158004d2d0 2024-09-22T08:36:43.760 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.744+0000 7f158bd26800 20 remove_watcher() i=0 2024-09-22T08:36:43.760 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.744+0000 7f158bd26800 2 removed watcher, disabling cache 2024-09-22T08:36:43.760 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.744+0000 7f158bd26800 1 -- 172.21.15.142:0/1385709764 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94782202254800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56343382b680 con 0x5634337e73e0 2024-09-22T08:36:43.760 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.745+0000 7f157f1d8640 1 -- 172.21.15.142:0/1385709764 <== osd.1 v2:172.21.15.142:6816/3192108003 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94782202254800] v30'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f157003b040 con 0x5634337e73e0 2024-09-22T08:36:43.760 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.745+0000 7f158bd26800 20 remove_watcher() i=1 2024-09-22T08:36:43.760 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.745+0000 7f158bd26800 1 -- 172.21.15.142:0/1385709764 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94782202264336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56343382b680 con 0x5634337ebca0 2024-09-22T08:36:43.760 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.746+0000 7f15881da640 1 -- 172.21.15.142:0/1385709764 <== osd.3 v2:172.21.15.142:6800/1064901393 16 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94782202264336] v30'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f158000a4d0 con 0x5634337ebca0 2024-09-22T08:36:43.761 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.746+0000 7f158bd26800 20 remove_watcher() i=2 2024-09-22T08:36:43.761 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.746+0000 7f158bd26800 1 -- 172.21.15.142:0/1385709764 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94782202267056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56343382b680 con 0x7f158004d2d0 2024-09-22T08:36:43.761 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.747+0000 7f15879d9640 1 -- 172.21.15.142:0/1385709764 <== osd.2 v2:172.21.15.142:6808/279438927 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94782202267056] v30'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1578091070 con 0x7f158004d2d0 2024-09-22T08:36:43.761 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.747+0000 7f158bd26800 20 remove_watcher() i=3 2024-09-22T08:36:43.761 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.747+0000 7f158bd26800 1 -- 172.21.15.142:0/1385709764 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94782202269728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56343382b680 con 0x5634337e73e0 2024-09-22T08:36:43.761 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.748+0000 7f157f1d8640 1 -- 172.21.15.142:0/1385709764 <== osd.1 v2:172.21.15.142:6816/3192108003 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94782202269728] v30'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f157003b040 con 0x5634337e73e0 2024-09-22T08:36:43.761 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.748+0000 7f158bd26800 20 remove_watcher() i=4 2024-09-22T08:36:43.761 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.748+0000 7f158bd26800 1 -- 172.21.15.142:0/1385709764 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94782202272432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56343382b680 con 0x7f15780a6040 2024-09-22T08:36:43.761 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.749+0000 7f157f1d8640 1 -- 172.21.15.142:0/1385709764 <== osd.0 v2:172.21.15.31:6800/168281188 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94782202272432] v30'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f157003b040 con 0x7f15780a6040 2024-09-22T08:36:43.761 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.749+0000 7f158bd26800 20 remove_watcher() i=5 2024-09-22T08:36:43.761 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.749+0000 7f158bd26800 1 -- 172.21.15.142:0/1385709764 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94782202261616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56343382b680 con 0x7f15780a6040 2024-09-22T08:36:43.762 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.750+0000 7f157f1d8640 1 -- 172.21.15.142:0/1385709764 <== osd.0 v2:172.21.15.31:6800/168281188 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94782202261616] v30'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f157003b040 con 0x7f15780a6040 2024-09-22T08:36:43.762 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.750+0000 7f158bd26800 20 remove_watcher() i=6 2024-09-22T08:36:43.762 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.750+0000 7f158bd26800 1 -- 172.21.15.142:0/1385709764 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94782202277648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56343382b680 con 0x7f15780a6040 2024-09-22T08:36:43.762 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.751+0000 7f157f1d8640 1 -- 172.21.15.142:0/1385709764 <== osd.0 v2:172.21.15.31:6800/168281188 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94782202277648] v30'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f157003b040 con 0x7f15780a6040 2024-09-22T08:36:43.762 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.751+0000 7f158bd26800 20 remove_watcher() i=7 2024-09-22T08:36:43.762 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.751+0000 7f158bd26800 1 -- 172.21.15.142:0/1385709764 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f15780a6040 msgr2=0x7f1578068470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:43.762 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.751+0000 7f158bd26800 1 --2- 172.21.15.142:0/1385709764 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f15780a6040 0x7f1578068470 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:43.762 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.751+0000 7f158bd26800 1 -- 172.21.15.142:0/1385709764 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5634337e73e0 msgr2=0x5634337e98a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:43.762 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.751+0000 7f158bd26800 1 --2- 172.21.15.142:0/1385709764 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5634337e73e0 0x5634337e98a0 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:43.762 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.751+0000 7f158bd26800 1 -- 172.21.15.142:0/1385709764 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f158004d2d0 msgr2=0x7f1580015460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:43.762 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.751+0000 7f158bd26800 1 --2- 172.21.15.142:0/1385709764 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f158004d2d0 0x7f1580015460 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:43.763 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.751+0000 7f158bd26800 1 -- 172.21.15.142:0/1385709764 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5634337ebca0 msgr2=0x5634337ee0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:43.763 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.751+0000 7f158bd26800 1 --2- 172.21.15.142:0/1385709764 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5634337ebca0 0x5634337ee0b0 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:43.763 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.752+0000 7f158bd26800 1 -- 172.21.15.142:0/1385709764 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f145003cfb0 msgr2=0x7f145003f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:43.763 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.752+0000 7f158bd26800 1 --2- 172.21.15.142:0/1385709764 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f145003cfb0 0x7f145003f470 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x5634337b2540 tx=0x7f1578093000 comp rx=0 tx=0).stop 2024-09-22T08:36:43.763 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.752+0000 7f158bd26800 1 -- 172.21.15.142:0/1385709764 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5634337d44e0 msgr2=0x5634337dbaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:43.763 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.752+0000 7f158bd26800 1 --2- 172.21.15.142:0/1385709764 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5634337d44e0 0x5634337dbaf0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f1580021a60 tx=0x7f15800547a0 comp rx=0 tx=0).stop 2024-09-22T08:36:43.763 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.752+0000 7f157f1d8640 1 -- 172.21.15.142:0/1385709764 reap_dead start 2024-09-22T08:36:43.763 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.752+0000 7f158bd26800 1 -- 172.21.15.142:0/1385709764 shutdown_connections 2024-09-22T08:36:43.763 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.752+0000 7f158bd26800 1 --2- 172.21.15.142:0/1385709764 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5634337d44e0 0x5634337dbaf0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:43.763 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.752+0000 7f158bd26800 1 -- 172.21.15.142:0/1385709764 >> 172.21.15.142:0/1385709764 conn(0x5634337d08e0 msgr2=0x5634337ceaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:43.763 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.752+0000 7f158bd26800 1 -- 172.21.15.142:0/1385709764 shutdown_connections 2024-09-22T08:36:43.764 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.752+0000 7f158bd26800 1 -- 172.21.15.142:0/1385709764 wait complete. 2024-09-22T08:36:43.764 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.752+0000 7f158bd26800 1 -- 172.21.15.142:0/2552770757 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f146003cfb0 msgr2=0x7f146003f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:43.764 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.752+0000 7f158bd26800 1 --2- 172.21.15.142:0/2552770757 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f146003cfb0 0x7f146003f470 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f1578096af0 tx=0x7f1578005390 comp rx=0 tx=0).stop 2024-09-22T08:36:43.764 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.752+0000 7f158bd26800 1 -- 172.21.15.142:0/2552770757 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5634336b40a0 msgr2=0x5634336b2910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:43.764 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.752+0000 7f158bd26800 1 --2- 172.21.15.142:0/2552770757 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5634336b40a0 0x5634336b2910 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x5634337ab910 tx=0x7f15800167b0 comp rx=0 tx=0).stop 2024-09-22T08:36:43.764 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.752+0000 7f158bd26800 1 -- 172.21.15.142:0/2552770757 shutdown_connections 2024-09-22T08:36:43.764 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.752+0000 7f158bd26800 1 --2- 172.21.15.142:0/2552770757 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f146003cfb0 0x7f146003f470 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:43.764 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.752+0000 7f158bd26800 1 --2- 172.21.15.142:0/2552770757 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5634336b40a0 0x5634336b2910 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:43.764 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.752+0000 7f158bd26800 1 -- 172.21.15.142:0/2552770757 >> 172.21.15.142:0/2552770757 conn(0x5634337b9be0 msgr2=0x5634337b9fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:43.764 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.752+0000 7f158bd26800 1 -- 172.21.15.142:0/2552770757 shutdown_connections 2024-09-22T08:36:43.764 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.752+0000 7f158bd26800 1 -- 172.21.15.142:0/2552770757 wait complete. 2024-09-22T08:36:43.765 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.752+0000 7f158bd26800 1 -- 172.21.15.142:0/2149302137 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5634336b6910 msgr2=0x5634337b1f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:43.765 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.752+0000 7f158bd26800 1 --2- 172.21.15.142:0/2149302137 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5634336b6910 0x5634337b1f60 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:43.765 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.752+0000 7f158bd26800 1 -- 172.21.15.142:0/2149302137 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5634337b43d0 msgr2=0x5634337b67c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:43.765 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.752+0000 7f158bd26800 1 --2- 172.21.15.142:0/2149302137 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5634337b43d0 0x5634337b67c0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:43.765 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.752+0000 7f158bd26800 1 -- 172.21.15.142:0/2149302137 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f147003cfb0 msgr2=0x7f147003f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:43.765 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.753+0000 7f158bd26800 1 --2- 172.21.15.142:0/2149302137 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f147003cfb0 0x7f147003f470 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f1570000c00 tx=0x7f15700013b0 comp rx=0 tx=0).stop 2024-09-22T08:36:43.765 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.753+0000 7f158bd26800 1 -- 172.21.15.142:0/2149302137 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5634336b1a90 msgr2=0x5634337aa960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:43.766 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.753+0000 7f158bd26800 1 --2- 172.21.15.142:0/2149302137 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5634336b1a90 0x5634337aa960 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f1578025c20 tx=0x7f1578002fb0 comp rx=0 tx=0).stop 2024-09-22T08:36:43.766 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.753+0000 7f158bd26800 1 -- 172.21.15.142:0/2149302137 shutdown_connections 2024-09-22T08:36:43.766 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.753+0000 7f158bd26800 1 --2- 172.21.15.142:0/2149302137 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5634337b43d0 0x5634337b67c0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:43.766 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.753+0000 7f158bd26800 1 --2- 172.21.15.142:0/2149302137 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5634336b6910 0x5634337b1f60 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:43.766 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.753+0000 7f158bd26800 1 --2- 172.21.15.142:0/2149302137 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f147003cfb0 0x7f147003f470 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:43.766 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.753+0000 7f158bd26800 1 --2- 172.21.15.142:0/2149302137 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5634336b1a90 0x5634337aa960 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:43.766 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.753+0000 7f158bd26800 1 -- 172.21.15.142:0/2149302137 >> 172.21.15.142:0/2149302137 conn(0x5634336ad310 msgr2=0x5634337a4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:43.766 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.753+0000 7f158bd26800 1 -- 172.21.15.142:0/2149302137 shutdown_connections 2024-09-22T08:36:43.766 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.753+0000 7f158bd26800 1 -- 172.21.15.142:0/2149302137 wait complete. 2024-09-22T08:36:43.767 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-22T08:36:42.661297Z'}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-09-22T08:36:43.598495Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-22T08:36:42.661288Z', 'tags': [], 'group_ids': []} 2024-09-22T08:36:43.767 INFO:tasks.util.rgw:rgwadmin: client.0 : ['key', 'rm', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ'] 2024-09-22T08:36:43.767 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'key', 'rm', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ'] 2024-09-22T08:36:43.768 DEBUG:teuthology.orchestra.run.smithi142:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph key rm --uid foo --access-key p5YnriCv1nAtykxBrupQ 2024-09-22T08:36:43.814 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:36:43.814 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:36:43.815 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.813+0000 7f68d5575800 1 Processor -- start 2024-09-22T08:36:43.816 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.813+0000 7f68d5575800 1 -- start start 2024-09-22T08:36:43.816 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.814+0000 7f68d5575800 1 --2- >> v2:172.21.15.31:3300/0 conn(0x56100c242c00 0x56100c2450c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:43.816 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.814+0000 7f68d5575800 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56100c0c7a20 con 0x56100c1b0530 2024-09-22T08:36:43.816 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.814+0000 7f68d5575800 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x56100c0c77d0 con 0x56100c242c00 2024-09-22T08:36:43.816 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.814+0000 7f68ca85e640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x56100c242c00 0x56100c2450c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:43.816 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.814+0000 7f68d305f640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x56100c1b0530 0x56100c2414b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.142:42368/0 (socket says 172.21.15.142:42368) 2024-09-22T08:36:43.816 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.814+0000 7f68d305f640 1 -- 172.21.15.142:0/2575824517 learned_addr learned my addr 172.21.15.142:0/2575824517 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-09-22T08:36:43.816 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.814+0000 7f68ca85e640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x56100c242c00 0x56100c2450c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:38360/0 (socket says 172.21.15.142:38360) 2024-09-22T08:36:43.817 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.814+0000 7f68ca85e640 1 -- 172.21.15.142:0/2575824517 >> v1:172.21.15.31:6789/0 conn(0x56100c1b0530 legacy=0x56100c2414b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:43.817 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.814+0000 7f68ca85e640 1 -- 172.21.15.142:0/2575824517 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56100c2467d0 con 0x56100c242c00 2024-09-22T08:36:43.819 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.816+0000 7f68ca85e640 1 --2- 172.21.15.142:0/2575824517 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56100c242c00 0x56100c2450c0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f68bc00a470 tx=0x7f68bc045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80915b8a8bdea4f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:43.819 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.816+0000 7f68d285e640 1 -- 172.21.15.142:0/2575824517 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68bc053570 con 0x56100c242c00 2024-09-22T08:36:43.819 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.816+0000 7f68d285e640 1 -- 172.21.15.142:0/2575824517 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68bc058070 con 0x56100c242c00 2024-09-22T08:36:43.819 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.816+0000 7f68d285e640 1 -- 172.21.15.142:0/2575824517 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68bc053880 con 0x56100c242c00 2024-09-22T08:36:43.819 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.817+0000 7f68d5575800 1 -- 172.21.15.142:0/2575824517 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56100c242c00 msgr2=0x56100c2450c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:43.819 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.817+0000 7f68d5575800 1 --2- 172.21.15.142:0/2575824517 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56100c242c00 0x56100c2450c0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f68bc00a470 tx=0x7f68bc045a20 comp rx=0 tx=0).stop 2024-09-22T08:36:43.819 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.817+0000 7f68d5575800 1 -- 172.21.15.142:0/2575824517 shutdown_connections 2024-09-22T08:36:43.820 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.817+0000 7f68d5575800 1 --2- 172.21.15.142:0/2575824517 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56100c242c00 0x56100c2450c0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:43.820 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.817+0000 7f68d5575800 1 -- 172.21.15.142:0/2575824517 >> 172.21.15.142:0/2575824517 conn(0x56100c236be0 msgr2=0x56100c239020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:43.820 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.817+0000 7f68d5575800 1 -- 172.21.15.142:0/2575824517 shutdown_connections 2024-09-22T08:36:43.820 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.817+0000 7f68d5575800 1 -- 172.21.15.142:0/2575824517 wait complete. 2024-09-22T08:36:43.832 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.830+0000 7f68d5575800 1 Processor -- start 2024-09-22T08:36:43.832 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.830+0000 7f68d5575800 1 -- start start 2024-09-22T08:36:43.832 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.830+0000 7f68d5575800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56100c1b0530 0x56100c32e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:43.832 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.830+0000 7f68d5575800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x56100c0d4dd0 con 0x56100c1b0530 2024-09-22T08:36:43.832 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.831+0000 7f68d305f640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56100c1b0530 0x56100c32e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:43.832 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.831+0000 7f68d305f640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56100c1b0530 0x56100c32e230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:38362/0 (socket says 172.21.15.142:38362) 2024-09-22T08:36:43.832 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.831+0000 7f68d305f640 1 -- 172.21.15.142:0/1233600940 learned_addr learned my addr 172.21.15.142:0/1233600940 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:43.832 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.831+0000 7f68d305f640 1 -- 172.21.15.142:0/1233600940 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56100c32e820 con 0x56100c1b0530 2024-09-22T08:36:43.834 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.831+0000 7f68d305f640 1 --2- 172.21.15.142:0/1233600940 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56100c1b0530 0x56100c32e230 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f68c4001e40 tx=0x7f68c4001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dae4121afb347dd2 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:43.834 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.831+0000 7f67c160a640 1 -- 172.21.15.142:0/1233600940 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68c4012020 con 0x56100c1b0530 2024-09-22T08:36:43.834 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.831+0000 7f67c160a640 1 -- 172.21.15.142:0/1233600940 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68c400e5a0 con 0x56100c1b0530 2024-09-22T08:36:43.834 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.831+0000 7f67c160a640 1 -- 172.21.15.142:0/1233600940 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68c400e8a0 con 0x56100c1b0530 2024-09-22T08:36:43.835 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.832+0000 7f68d5575800 1 -- 172.21.15.142:0/1233600940 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56100c1b0530 msgr2=0x56100c32e230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:43.835 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.832+0000 7f68d5575800 1 --2- 172.21.15.142:0/1233600940 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56100c1b0530 0x56100c32e230 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f68c4001e40 tx=0x7f68c4001e70 comp rx=0 tx=0).stop 2024-09-22T08:36:43.835 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.832+0000 7f68d5575800 1 -- 172.21.15.142:0/1233600940 shutdown_connections 2024-09-22T08:36:43.835 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.832+0000 7f68d5575800 1 --2- 172.21.15.142:0/1233600940 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56100c1b0530 0x56100c32e230 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:43.835 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.832+0000 7f68d5575800 1 -- 172.21.15.142:0/1233600940 >> 172.21.15.142:0/1233600940 conn(0x56100c236be0 msgr2=0x56100c329bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:43.835 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.832+0000 7f68d5575800 1 -- 172.21.15.142:0/1233600940 shutdown_connections 2024-09-22T08:36:43.835 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.832+0000 7f68d5575800 1 -- 172.21.15.142:0/1233600940 wait complete. 2024-09-22T08:36:43.835 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.832+0000 7f68d5575800 1 Processor -- start 2024-09-22T08:36:43.835 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.833+0000 7f68d5575800 1 -- start start 2024-09-22T08:36:43.835 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.833+0000 7f68d5575800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56100c1b0530 0x56100c335d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:43.835 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.833+0000 7f68d5575800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x56100c245a70 con 0x56100c1b0530 2024-09-22T08:36:43.835 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.833+0000 7f68d305f640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56100c1b0530 0x56100c335d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:43.835 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.833+0000 7f68d305f640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56100c1b0530 0x56100c335d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:38374/0 (socket says 172.21.15.142:38374) 2024-09-22T08:36:43.836 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.833+0000 7f68d305f640 1 -- 172.21.15.142:0/1993612058 learned_addr learned my addr 172.21.15.142:0/1993612058 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:43.836 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.833+0000 7f68d305f640 1 -- 172.21.15.142:0/1993612058 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56100c3362b0 con 0x56100c1b0530 2024-09-22T08:36:43.836 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.833+0000 7f68d305f640 1 --2- 172.21.15.142:0/1993612058 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56100c1b0530 0x56100c335d50 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f68c400c010 tx=0x7f68c4000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:43.839 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.833+0000 7f67bfe07640 1 -- 172.21.15.142:0/1993612058 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68c4012030 con 0x56100c1b0530 2024-09-22T08:36:43.839 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.834+0000 7f67bfe07640 1 -- 172.21.15.142:0/1993612058 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68c40014a0 con 0x56100c1b0530 2024-09-22T08:36:43.839 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.834+0000 7f68d5575800 1 -- 172.21.15.142:0/1993612058 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56100c336540 con 0x56100c1b0530 2024-09-22T08:36:43.839 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.834+0000 7f67bfe07640 1 -- 172.21.15.142:0/1993612058 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68c401a7a0 con 0x56100c1b0530 2024-09-22T08:36:43.839 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.834+0000 7f68d5575800 1 -- 172.21.15.142:0/1993612058 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56100c336f40 con 0x56100c1b0530 2024-09-22T08:36:43.839 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.834+0000 7f67bfe07640 1 -- 172.21.15.142:0/1993612058 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f68c4015020 con 0x56100c1b0530 2024-09-22T08:36:43.839 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.835+0000 7f67bfe07640 1 --2- 172.21.15.142:0/1993612058 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f67b803cfb0 0x7f67b803f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:43.839 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.835+0000 7f67bfe07640 1 -- 172.21.15.142:0/1993612058 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f68c4020030 con 0x56100c1b0530 2024-09-22T08:36:43.839 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.835+0000 7f68ca85e640 1 --2- 172.21.15.142:0/1993612058 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f67b803cfb0 0x7f67b803f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:43.839 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.835+0000 7f68d5575800 1 --2- 172.21.15.142:0/1993612058 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x56100c242c00 0x56100c33d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:43.839 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.835+0000 7f68d5575800 1 -- 172.21.15.142:0/1993612058 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56100c33d8e0 con 0x56100c242c00 2024-09-22T08:36:43.839 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.835+0000 7f68d3860640 1 --2- 172.21.15.142:0/1993612058 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x56100c242c00 0x56100c33d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:43.840 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.835+0000 7f68ca85e640 1 --2- 172.21.15.142:0/1993612058 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f67b803cfb0 0x7f67b803f470 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f68bc057000 tx=0x7f68bc052000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:43.840 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.835+0000 7f68d3860640 1 --2- 172.21.15.142:0/1993612058 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x56100c242c00 0x56100c33d3a0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:43.840 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.835+0000 7f68d3860640 1 -- 172.21.15.142:0/1993612058 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f68cc00a4d0 con 0x56100c242c00 2024-09-22T08:36:43.840 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.836+0000 7f68d5575800 1 -- 172.21.15.142:0/1993612058 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56100c33dc80 con 0x56100c242c00 2024-09-22T08:36:43.840 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.836+0000 7f68d3860640 1 -- 172.21.15.142:0/1993612058 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f68cc00a4d0 con 0x56100c242c00 2024-09-22T08:36:43.840 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.836+0000 7f68d5575800 1 --2- 172.21.15.142:0/1993612058 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x56100c33f740 0x56100c341be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:43.840 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.836+0000 7f68d5575800 1 -- 172.21.15.142:0/1993612058 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:3 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56100c342370 con 0x56100c33f740 2024-09-22T08:36:43.840 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.836+0000 7f68d305f640 1 --2- 172.21.15.142:0/1993612058 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x56100c33f740 0x56100c341be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:43.840 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.836+0000 7f68d305f640 1 --2- 172.21.15.142:0/1993612058 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x56100c33f740 0x56100c341be0 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:43.840 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.837+0000 7f68d305f640 1 -- 172.21.15.142:0/1993612058 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(3 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f68c401ab20 con 0x56100c33f740 2024-09-22T08:36:43.840 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.837+0000 7f68d5575800 1 -- 172.21.15.142:0/1993612058 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56100c33e4d0 con 0x56100c242c00 2024-09-22T08:36:43.840 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.837+0000 7f68d3860640 1 -- 172.21.15.142:0/1993612058 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f68cc00a4d0 con 0x56100c242c00 2024-09-22T08:36:43.840 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.837+0000 7f68d5575800 1 -- 172.21.15.142:0/1993612058 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56100c33e8b0 con 0x56100c33f740 2024-09-22T08:36:43.840 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.837+0000 7f68d305f640 1 -- 172.21.15.142:0/1993612058 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(5 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f68c401ab20 con 0x56100c33f740 2024-09-22T08:36:43.841 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.837+0000 7f68d5575800 1 Processor -- start 2024-09-22T08:36:43.841 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.837+0000 7f68d5575800 1 -- start start 2024-09-22T08:36:43.841 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.838+0000 7f68d5575800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56100c350d40 0x56100c351160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:43.841 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.838+0000 7f68d5575800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x56100c133d50 con 0x56100c350d40 2024-09-22T08:36:43.876 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.838+0000 7f68d3860640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56100c350d40 0x56100c351160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:43.876 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.838+0000 7f68d3860640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56100c350d40 0x56100c351160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:38388/0 (socket says 172.21.15.142:38388) 2024-09-22T08:36:43.876 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.838+0000 7f68d3860640 1 -- 172.21.15.142:0/2373688259 learned_addr learned my addr 172.21.15.142:0/2373688259 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:43.877 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.838+0000 7f68d3860640 1 -- 172.21.15.142:0/2373688259 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56100c3517a0 con 0x56100c350d40 2024-09-22T08:36:43.877 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.838+0000 7f68d3860640 1 --2- 172.21.15.142:0/2373688259 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56100c350d40 0x56100c351160 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x56100c336be0 tx=0x7f68cc0167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:43.877 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.839+0000 7f67bd602640 1 -- 172.21.15.142:0/2373688259 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68cc013640 con 0x56100c350d40 2024-09-22T08:36:43.877 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.839+0000 7f67bd602640 1 -- 172.21.15.142:0/2373688259 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68cc0137e0 con 0x56100c350d40 2024-09-22T08:36:43.877 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.839+0000 7f68d5575800 1 -- 172.21.15.142:0/2373688259 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56100c351fd0 con 0x56100c350d40 2024-09-22T08:36:43.877 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.839+0000 7f67bd602640 1 -- 172.21.15.142:0/2373688259 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68cc013b00 con 0x56100c350d40 2024-09-22T08:36:43.877 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.839+0000 7f68d5575800 1 -- 172.21.15.142:0/2373688259 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56100c352570 con 0x56100c350d40 2024-09-22T08:36:43.877 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.839+0000 7f67bd602640 1 -- 172.21.15.142:0/2373688259 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f68cc011040 con 0x56100c350d40 2024-09-22T08:36:43.877 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.840+0000 7f67bd602640 1 --2- 172.21.15.142:0/2373688259 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f67ac03cfb0 0x7f67ac03f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:43.878 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.840+0000 7f67bd602640 1 -- 172.21.15.142:0/2373688259 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f68cc00e040 con 0x56100c350d40 2024-09-22T08:36:43.878 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.840+0000 7f68d305f640 1 --2- 172.21.15.142:0/2373688259 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f67ac03cfb0 0x7f67ac03f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:43.878 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.840+0000 7f68d5575800 1 Processor -- start 2024-09-22T08:36:43.878 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.840+0000 7f68d305f640 1 --2- 172.21.15.142:0/2373688259 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f67ac03cfb0 0x7f67ac03f470 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x56100c337e50 tx=0x7f68c40529c0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:43.878 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.840+0000 7f68d5575800 1 -- start start 2024-09-22T08:36:43.878 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.840+0000 7f68d5575800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56100c35d800 0x56100c35dc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:43.878 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.840+0000 7f68d5575800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x56100c32ec50 con 0x56100c35d800 2024-09-22T08:36:43.878 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.840+0000 7f68d3860640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56100c35d800 0x56100c35dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:43.878 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.840+0000 7f68d3860640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56100c35d800 0x56100c35dc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:38398/0 (socket says 172.21.15.142:38398) 2024-09-22T08:36:43.879 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.840+0000 7f68d3860640 1 -- 172.21.15.142:0/3575557305 learned_addr learned my addr 172.21.15.142:0/3575557305 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:43.879 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.841+0000 7f68d3860640 1 -- 172.21.15.142:0/3575557305 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56100c35e1f0 con 0x56100c35d800 2024-09-22T08:36:43.879 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.841+0000 7f68d3860640 1 --2- 172.21.15.142:0/3575557305 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56100c35d800 0x56100c35dc00 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f68cc020000 tx=0x7f68cc01f470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3d88ee1adba6d88 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:43.879 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.841+0000 7f67b6ffd640 1 -- 172.21.15.142:0/3575557305 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68cc021960 con 0x56100c35d800 2024-09-22T08:36:43.879 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.841+0000 7f67b6ffd640 1 -- 172.21.15.142:0/3575557305 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68cc013ca0 con 0x56100c35d800 2024-09-22T08:36:43.879 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.841+0000 7f67b6ffd640 1 -- 172.21.15.142:0/3575557305 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68cc021b00 con 0x56100c35d800 2024-09-22T08:36:43.879 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.841+0000 7f68d5575800 1 -- 172.21.15.142:0/3575557305 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56100c35d800 msgr2=0x56100c35dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:43.879 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.841+0000 7f68d5575800 1 --2- 172.21.15.142:0/3575557305 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56100c35d800 0x56100c35dc00 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f68cc020000 tx=0x7f68cc01f470 comp rx=0 tx=0).stop 2024-09-22T08:36:43.879 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.841+0000 7f68d5575800 1 -- 172.21.15.142:0/3575557305 shutdown_connections 2024-09-22T08:36:43.880 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.841+0000 7f68d5575800 1 --2- 172.21.15.142:0/3575557305 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56100c35d800 0x56100c35dc00 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:43.880 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.841+0000 7f68d5575800 1 -- 172.21.15.142:0/3575557305 >> 172.21.15.142:0/3575557305 conn(0x56100c359c00 msgr2=0x56100c357e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:43.880 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.841+0000 7f68d5575800 1 -- 172.21.15.142:0/3575557305 shutdown_connections 2024-09-22T08:36:43.880 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.841+0000 7f68d5575800 1 -- 172.21.15.142:0/3575557305 wait complete. 2024-09-22T08:36:43.880 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.842+0000 7f68d5575800 1 Processor -- start 2024-09-22T08:36:43.880 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.842+0000 7f68d5575800 1 -- start start 2024-09-22T08:36:43.880 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.842+0000 7f68d5575800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56100c35d800 0x56100c364de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:43.880 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.842+0000 7f68d5575800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x56100c35e810 con 0x56100c35d800 2024-09-22T08:36:43.880 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.842+0000 7f68d3860640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56100c35d800 0x56100c364de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:43.881 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.842+0000 7f68d3860640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56100c35d800 0x56100c364de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:38406/0 (socket says 172.21.15.142:38406) 2024-09-22T08:36:43.881 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.842+0000 7f68d3860640 1 -- 172.21.15.142:0/342891185 learned_addr learned my addr 172.21.15.142:0/342891185 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:43.881 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.842+0000 7f68d3860640 1 -- 172.21.15.142:0/342891185 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56100c365340 con 0x56100c35d800 2024-09-22T08:36:43.881 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.842+0000 7f68d3860640 1 --2- 172.21.15.142:0/342891185 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56100c35d800 0x56100c364de0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f68cc056360 tx=0x7f68cc054860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:43.881 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.843+0000 7f67b57fa640 1 -- 172.21.15.142:0/342891185 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68cc020de0 con 0x56100c35d800 2024-09-22T08:36:43.881 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.843+0000 7f67b57fa640 1 -- 172.21.15.142:0/342891185 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68cc01fa90 con 0x56100c35d800 2024-09-22T08:36:43.881 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.843+0000 7f68d5575800 1 -- 172.21.15.142:0/342891185 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56100c3655d0 con 0x56100c35d800 2024-09-22T08:36:43.881 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.843+0000 7f67b57fa640 1 -- 172.21.15.142:0/342891185 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68cc01fd70 con 0x56100c35d800 2024-09-22T08:36:43.881 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.843+0000 7f68d5575800 1 -- 172.21.15.142:0/342891185 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56100c365f50 con 0x56100c35d800 2024-09-22T08:36:43.882 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.843+0000 7f67b57fa640 1 -- 172.21.15.142:0/342891185 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f68cc01f500 con 0x56100c35d800 2024-09-22T08:36:43.882 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.844+0000 7f67b57fa640 1 --2- 172.21.15.142:0/342891185 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f679c03cfb0 0x7f679c03f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:43.882 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.844+0000 7f67b57fa640 1 -- 172.21.15.142:0/342891185 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f68cc053820 con 0x56100c35d800 2024-09-22T08:36:43.882 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.844+0000 7f68d305f640 1 --2- 172.21.15.142:0/342891185 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f679c03cfb0 0x7f679c03f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:43.882 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.844+0000 7f68d305f640 1 --2- 172.21.15.142:0/342891185 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f679c03cfb0 0x7f679c03f470 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f68c4001250 tx=0x7f68c4051000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:43.882 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.844+0000 7f68d5575800 20 rados->read ofs=0 len=0 2024-09-22T08:36:43.882 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.844+0000 7f68d5575800 1 --2- 172.21.15.142:0/342891185 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x56100c370710 0x56100c372bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:43.883 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.844+0000 7f68d5575800 1 -- 172.21.15.142:0/342891185 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56100c373320 con 0x56100c370710 2024-09-22T08:36:43.883 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.844+0000 7f68ca85e640 1 --2- 172.21.15.142:0/342891185 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x56100c370710 0x56100c372bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:43.883 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.845+0000 7f68ca85e640 1 --2- 172.21.15.142:0/342891185 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x56100c370710 0x56100c372bd0 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:43.883 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.845+0000 7f68ca85e640 1 -- 172.21.15.142:0/342891185 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f68bc051070 con 0x56100c370710 2024-09-22T08:36:43.883 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.845+0000 7f68d5575800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:43.883 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.845+0000 7f68d5575800 20 realm 2024-09-22T08:36:43.884 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.845+0000 7f68d5575800 20 rados->read ofs=0 len=0 2024-09-22T08:36:43.884 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.845+0000 7f68d5575800 1 -- 172.21.15.142:0/342891185 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56100c373750 con 0x56100c370710 2024-09-22T08:36:43.884 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.845+0000 7f68ca85e640 1 -- 172.21.15.142:0/342891185 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f68bc051070 con 0x56100c370710 2024-09-22T08:36:43.884 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.845+0000 7f68d5575800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:43.884 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.845+0000 7f68d5575800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:36:43.884 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.845+0000 7f68d5575800 20 rados->read ofs=0 len=0 2024-09-22T08:36:43.884 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.845+0000 7f68d5575800 1 -- 172.21.15.142:0/342891185 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56100c374020 con 0x56100c370710 2024-09-22T08:36:43.885 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.845+0000 7f68ca85e640 1 -- 172.21.15.142:0/342891185 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f68bc051070 con 0x56100c370710 2024-09-22T08:36:43.885 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.845+0000 7f68d5575800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:43.885 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.845+0000 7f68d5575800 20 rados->read ofs=0 len=0 2024-09-22T08:36:43.885 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.845+0000 7f68d5575800 1 -- 172.21.15.142:0/342891185 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56100c3743c0 con 0x56100c370710 2024-09-22T08:36:43.885 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.846+0000 7f68ca85e640 1 -- 172.21.15.142:0/342891185 <== osd.1 v2:172.21.15.142:6816/3192108003 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f68bc051070 con 0x56100c370710 2024-09-22T08:36:43.885 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.846+0000 7f68d5575800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:36:43.885 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.846+0000 7f68d5575800 20 rados->read ofs=0 len=0 2024-09-22T08:36:43.886 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.846+0000 7f68d5575800 1 --2- 172.21.15.142:0/342891185 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x56100c375120 0x56100c377510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:43.886 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.846+0000 7f68d5575800 1 -- 172.21.15.142:0/342891185 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56100c377b20 con 0x56100c375120 2024-09-22T08:36:43.886 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.846+0000 7f68d3860640 1 --2- 172.21.15.142:0/342891185 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x56100c375120 0x56100c377510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:43.886 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.846+0000 7f68d3860640 1 --2- 172.21.15.142:0/342891185 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x56100c375120 0x56100c377510 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:43.886 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.846+0000 7f68d3860640 1 -- 172.21.15.142:0/342891185 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(5 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f68cc00a4d0 con 0x56100c375120 2024-09-22T08:36:43.886 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.846+0000 7f68d5575800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:36:43.887 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.846+0000 7f68d5575800 20 searching for the correct realm 2024-09-22T08:36:43.887 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.846+0000 7f68d5575800 1 -- 172.21.15.142:0/342891185 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56100c379450 con 0x56100c375120 2024-09-22T08:36:43.887 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.847+0000 7f68d3860640 1 -- 172.21.15.142:0/342891185 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68cc00a4d0 con 0x56100c375120 2024-09-22T08:36:43.887 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.847+0000 7f68d3860640 1 --2- 172.21.15.142:0/342891185 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f68cc012ae0 0x7f68cc033950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:43.887 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.847+0000 7f68d3860640 1 -- 172.21.15.142:0/342891185 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56100c379450 con 0x7f68cc012ae0 2024-09-22T08:36:43.887 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.847+0000 7f68d305f640 1 --2- 172.21.15.142:0/342891185 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f68cc012ae0 0x7f68cc033950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:43.887 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.847+0000 7f68d305f640 1 --2- 172.21.15.142:0/342891185 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f68cc012ae0 0x7f68cc033950 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:43.888 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.847+0000 7f68d305f640 1 -- 172.21.15.142:0/342891185 <== osd.2 v2:172.21.15.142:6808/279438927 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68c401ab20 con 0x7f68cc012ae0 2024-09-22T08:36:43.888 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.847+0000 7f68d305f640 1 --2- 172.21.15.142:0/342891185 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f68c4017050 0x7f68c404b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:43.888 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.847+0000 7f68d305f640 1 -- 172.21.15.142:0/342891185 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56100c379450 con 0x7f68c4017050 2024-09-22T08:36:43.888 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.847+0000 7f68ca85e640 1 --2- 172.21.15.142:0/342891185 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f68c4017050 0x7f68c404b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:43.888 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.848+0000 7f68ca85e640 1 --2- 172.21.15.142:0/342891185 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f68c4017050 0x7f68c404b890 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:43.888 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.848+0000 7f68ca85e640 1 -- 172.21.15.142:0/342891185 <== osd.0 v2:172.21.15.31:6800/168281188 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68bc051070 con 0x7f68c4017050 2024-09-22T08:36:43.889 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.848+0000 7f68ca85e640 1 -- 172.21.15.142:0/342891185 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56100c379450 con 0x56100c370710 2024-09-22T08:36:43.889 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.848+0000 7f68ca85e640 1 -- 172.21.15.142:0/342891185 <== osd.1 v2:172.21.15.142:6816/3192108003 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68bc051070 con 0x56100c370710 2024-09-22T08:36:43.889 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.848+0000 7f68ca85e640 1 -- 172.21.15.142:0/342891185 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56100c379450 con 0x56100c370710 2024-09-22T08:36:43.889 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.848+0000 7f68ca85e640 1 -- 172.21.15.142:0/342891185 <== osd.1 v2:172.21.15.142:6816/3192108003 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68bc051070 con 0x56100c370710 2024-09-22T08:36:43.889 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.848+0000 7f68ca85e640 1 -- 172.21.15.142:0/342891185 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56100c379450 con 0x7f68c4017050 2024-09-22T08:36:43.889 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.849+0000 7f68ca85e640 1 -- 172.21.15.142:0/342891185 <== osd.0 v2:172.21.15.31:6800/168281188 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68bc051070 con 0x7f68c4017050 2024-09-22T08:36:43.889 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.849+0000 7f68ca85e640 1 -- 172.21.15.142:0/342891185 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56100c379450 con 0x7f68c4017050 2024-09-22T08:36:43.890 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.849+0000 7f68ca85e640 1 -- 172.21.15.142:0/342891185 <== osd.0 v2:172.21.15.31:6800/168281188 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68bc051070 con 0x7f68c4017050 2024-09-22T08:36:43.890 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.849+0000 7f68ca85e640 1 -- 172.21.15.142:0/342891185 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56100c379450 con 0x7f68cc012ae0 2024-09-22T08:36:43.890 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.849+0000 7f68d305f640 1 -- 172.21.15.142:0/342891185 <== osd.2 v2:172.21.15.142:6808/279438927 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68c401ab20 con 0x7f68cc012ae0 2024-09-22T08:36:43.890 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.849+0000 7f68d305f640 1 -- 172.21.15.142:0/342891185 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56100c379450 con 0x56100c375120 2024-09-22T08:36:43.890 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.849+0000 7f68d3860640 1 -- 172.21.15.142:0/342891185 <== osd.3 v2:172.21.15.142:6800/1064901393 3 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68cc00a4d0 con 0x56100c375120 2024-09-22T08:36:43.890 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.849+0000 7f68d3860640 1 -- 172.21.15.142:0/342891185 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56100c379450 con 0x56100c370710 2024-09-22T08:36:43.891 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.850+0000 7f68ca85e640 1 -- 172.21.15.142:0/342891185 <== osd.1 v2:172.21.15.142:6816/3192108003 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68bc051070 con 0x56100c370710 2024-09-22T08:36:43.891 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.850+0000 7f68ca85e640 1 -- 172.21.15.142:0/342891185 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56100c379450 con 0x7f68c4017050 2024-09-22T08:36:43.891 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.850+0000 7f68ca85e640 1 -- 172.21.15.142:0/342891185 <== osd.0 v2:172.21.15.31:6800/168281188 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68bc051070 con 0x7f68c4017050 2024-09-22T08:36:43.891 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.850+0000 7f68ca85e640 1 -- 172.21.15.142:0/342891185 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56100c379450 con 0x56100c370710 2024-09-22T08:36:43.891 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.850+0000 7f68ca85e640 1 -- 172.21.15.142:0/342891185 <== osd.1 v2:172.21.15.142:6816/3192108003 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68bc051070 con 0x56100c370710 2024-09-22T08:36:43.891 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.850+0000 7f68ca85e640 1 -- 172.21.15.142:0/342891185 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56100c379450 con 0x7f68cc012ae0 2024-09-22T08:36:43.892 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.850+0000 7f68d305f640 1 -- 172.21.15.142:0/342891185 <== osd.2 v2:172.21.15.142:6808/279438927 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f68c401ab20 con 0x7f68cc012ae0 2024-09-22T08:36:43.892 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.850+0000 7f68d305f640 1 -- 172.21.15.142:0/342891185 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56100c379450 con 0x56100c375120 2024-09-22T08:36:43.892 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.851+0000 7f68d3860640 1 -- 172.21.15.142:0/342891185 <== osd.3 v2:172.21.15.142:6800/1064901393 4 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68cc00a4d0 con 0x56100c375120 2024-09-22T08:36:43.892 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.851+0000 7f68d3860640 1 -- 172.21.15.142:0/342891185 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56100c379450 con 0x56100c375120 2024-09-22T08:36:43.892 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.851+0000 7f68d3860640 1 -- 172.21.15.142:0/342891185 <== osd.3 v2:172.21.15.142:6800/1064901393 5 ==== osd_op_reply(20 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f68cc00a4d0 con 0x56100c375120 2024-09-22T08:36:43.892 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.851+0000 7f68d3860640 1 -- 172.21.15.142:0/342891185 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56100c379450 con 0x7f68c4017050 2024-09-22T08:36:43.892 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.851+0000 7f68ca85e640 1 -- 172.21.15.142:0/342891185 <== osd.0 v2:172.21.15.31:6800/168281188 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68bc051070 con 0x7f68c4017050 2024-09-22T08:36:43.892 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.851+0000 7f68ca85e640 1 -- 172.21.15.142:0/342891185 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56100c379450 con 0x56100c375120 2024-09-22T08:36:43.893 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.851+0000 7f68d3860640 1 -- 172.21.15.142:0/342891185 <== osd.3 v2:172.21.15.142:6800/1064901393 6 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68cc00a4d0 con 0x56100c375120 2024-09-22T08:36:43.893 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.851+0000 7f68d3860640 1 -- 172.21.15.142:0/342891185 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56100c379450 con 0x56100c375120 2024-09-22T08:36:43.893 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.852+0000 7f68d3860640 1 -- 172.21.15.142:0/342891185 <== osd.3 v2:172.21.15.142:6800/1064901393 7 ==== osd_op_reply(23 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f68cc00a4d0 con 0x56100c375120 2024-09-22T08:36:43.893 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.852+0000 7f68d3860640 1 -- 172.21.15.142:0/342891185 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56100c379450 con 0x56100c370710 2024-09-22T08:36:43.893 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.852+0000 7f68ca85e640 1 -- 172.21.15.142:0/342891185 <== osd.1 v2:172.21.15.142:6816/3192108003 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68bc051070 con 0x56100c370710 2024-09-22T08:36:43.893 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.852+0000 7f68ca85e640 1 -- 172.21.15.142:0/342891185 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56100c379450 con 0x56100c370710 2024-09-22T08:36:43.894 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.852+0000 7f68ca85e640 1 -- 172.21.15.142:0/342891185 <== osd.1 v2:172.21.15.142:6816/3192108003 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f68bc051070 con 0x56100c370710 2024-09-22T08:36:43.894 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.852+0000 7f68ca85e640 1 -- 172.21.15.142:0/342891185 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56100c379450 con 0x7f68c4017050 2024-09-22T08:36:43.894 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.852+0000 7f68ca85e640 1 -- 172.21.15.142:0/342891185 <== osd.0 v2:172.21.15.31:6800/168281188 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68bc051070 con 0x7f68c4017050 2024-09-22T08:36:43.894 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.852+0000 7f68ca85e640 1 -- 172.21.15.142:0/342891185 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56100c379450 con 0x56100c375120 2024-09-22T08:36:43.894 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.853+0000 7f68d3860640 1 -- 172.21.15.142:0/342891185 <== osd.3 v2:172.21.15.142:6800/1064901393 8 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68cc00a4d0 con 0x56100c375120 2024-09-22T08:36:43.894 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.853+0000 7f68d3860640 1 -- 172.21.15.142:0/342891185 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56100c379450 con 0x7f68cc012ae0 2024-09-22T08:36:43.895 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.853+0000 7f68d305f640 1 -- 172.21.15.142:0/342891185 <== osd.2 v2:172.21.15.142:6808/279438927 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68c401ab20 con 0x7f68cc012ae0 2024-09-22T08:36:43.895 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.853+0000 7f68d305f640 1 -- 172.21.15.142:0/342891185 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56100c379450 con 0x56100c370710 2024-09-22T08:36:43.895 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.853+0000 7f68ca85e640 1 -- 172.21.15.142:0/342891185 <== osd.1 v2:172.21.15.142:6816/3192108003 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68bc051070 con 0x56100c370710 2024-09-22T08:36:43.895 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.853+0000 7f68ca85e640 1 -- 172.21.15.142:0/342891185 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56100c379450 con 0x7f68c4017050 2024-09-22T08:36:43.895 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.853+0000 7f68ca85e640 1 -- 172.21.15.142:0/342891185 <== osd.0 v2:172.21.15.31:6800/168281188 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68bc051070 con 0x7f68c4017050 2024-09-22T08:36:43.895 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.853+0000 7f68ca85e640 1 -- 172.21.15.142:0/342891185 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56100c379450 con 0x56100c375120 2024-09-22T08:36:43.896 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.854+0000 7f68d3860640 1 -- 172.21.15.142:0/342891185 <== osd.3 v2:172.21.15.142:6800/1064901393 9 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68cc00a4d0 con 0x56100c375120 2024-09-22T08:36:43.896 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.854+0000 7f68d3860640 1 -- 172.21.15.142:0/342891185 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56100c379450 con 0x7f68c4017050 2024-09-22T08:36:43.896 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.854+0000 7f68ca85e640 1 -- 172.21.15.142:0/342891185 <== osd.0 v2:172.21.15.31:6800/168281188 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68bc051070 con 0x7f68c4017050 2024-09-22T08:36:43.896 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.854+0000 7f68ca85e640 1 -- 172.21.15.142:0/342891185 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56100c379450 con 0x7f68cc012ae0 2024-09-22T08:36:43.896 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.854+0000 7f68d305f640 1 -- 172.21.15.142:0/342891185 <== osd.2 v2:172.21.15.142:6808/279438927 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68c401ab20 con 0x7f68cc012ae0 2024-09-22T08:36:43.896 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.854+0000 7f68d305f640 1 -- 172.21.15.142:0/342891185 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56100c379450 con 0x56100c375120 2024-09-22T08:36:43.896 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.854+0000 7f68d3860640 1 -- 172.21.15.142:0/342891185 <== osd.3 v2:172.21.15.142:6800/1064901393 10 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68cc00a4d0 con 0x56100c375120 2024-09-22T08:36:43.896 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.854+0000 7f68d3860640 1 -- 172.21.15.142:0/342891185 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56100c379450 con 0x7f68c4017050 2024-09-22T08:36:43.896 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.855+0000 7f68ca85e640 1 -- 172.21.15.142:0/342891185 <== osd.0 v2:172.21.15.31:6800/168281188 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68bc051070 con 0x7f68c4017050 2024-09-22T08:36:43.897 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.855+0000 7f68ca85e640 1 -- 172.21.15.142:0/342891185 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56100c379450 con 0x56100c370710 2024-09-22T08:36:43.897 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.855+0000 7f68ca85e640 1 -- 172.21.15.142:0/342891185 <== osd.1 v2:172.21.15.142:6816/3192108003 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f68bc051070 con 0x56100c370710 2024-09-22T08:36:43.897 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.855+0000 7f68ca85e640 1 -- 172.21.15.142:0/342891185 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56100c379450 con 0x7f68cc012ae0 2024-09-22T08:36:43.897 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.855+0000 7f68d305f640 1 -- 172.21.15.142:0/342891185 <== osd.2 v2:172.21.15.142:6808/279438927 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68c401ab20 con 0x7f68cc012ae0 2024-09-22T08:36:43.897 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.855+0000 7f68d5575800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:36:43.897 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.855+0000 7f68d5575800 20 RGWRados::pool_iterate: got zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec 2024-09-22T08:36:43.897 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.855+0000 7f68d5575800 20 RGWRados::pool_iterate: got zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f 2024-09-22T08:36:43.897 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.855+0000 7f68d5575800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:36:43.897 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.855+0000 7f68d5575800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:36:43.897 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.855+0000 7f68d5575800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:36:43.897 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.855+0000 7f68d5575800 20 rados->read ofs=0 len=0 2024-09-22T08:36:43.897 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.855+0000 7f68d5575800 1 -- 172.21.15.142:0/342891185 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56100c378510 con 0x56100c370710 2024-09-22T08:36:43.897 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.855+0000 7f68ca85e640 1 -- 172.21.15.142:0/342891185 <== osd.1 v2:172.21.15.142:6816/3192108003 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f68bc051070 con 0x56100c370710 2024-09-22T08:36:43.897 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.855+0000 7f68d5575800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:43.898 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.855+0000 7f68d5575800 20 rados->read ofs=0 len=0 2024-09-22T08:36:43.898 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.855+0000 7f68d5575800 1 -- 172.21.15.142:0/342891185 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56100c378d60 con 0x56100c370710 2024-09-22T08:36:43.898 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.856+0000 7f68ca85e640 1 -- 172.21.15.142:0/342891185 <== osd.1 v2:172.21.15.142:6816/3192108003 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f68bc051070 con 0x56100c370710 2024-09-22T08:36:43.898 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.856+0000 7f68d5575800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:36:43.898 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.856+0000 7f68d5575800 20 rados->read ofs=0 len=0 2024-09-22T08:36:43.898 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.856+0000 7f68d5575800 1 -- 172.21.15.142:0/342891185 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:40 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56100c3798d0 con 0x56100c375120 2024-09-22T08:36:43.898 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.856+0000 7f68d3860640 1 -- 172.21.15.142:0/342891185 <== osd.3 v2:172.21.15.142:6800/1064901393 11 ==== osd_op_reply(40 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f68cc00a4d0 con 0x56100c375120 2024-09-22T08:36:43.898 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.856+0000 7f68d5575800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:36:43.898 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.856+0000 7f68d5575800 20 zone default found 2024-09-22T08:36:43.898 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.856+0000 7f68d5575800 4 Realm: () 2024-09-22T08:36:43.898 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.856+0000 7f68d5575800 4 ZoneGroup: default (d89f6f57-1007-47dd-9065-f486c7b01aec) 2024-09-22T08:36:43.898 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.856+0000 7f68d5575800 4 Zone: default (e239248c-0bee-4e41-803a-24b288d3eb8f) 2024-09-22T08:36:43.898 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.856+0000 7f68d5575800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:36:43.899 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.856+0000 7f68d5575800 20 zonegroup default 2024-09-22T08:36:43.899 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.856+0000 7f68d5575800 20 rados->read ofs=0 len=0 2024-09-22T08:36:43.899 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.856+0000 7f68d5575800 1 -- 172.21.15.142:0/342891185 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56100c379cd0 con 0x7f68c4017050 2024-09-22T08:36:43.899 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.856+0000 7f68ca85e640 1 -- 172.21.15.142:0/342891185 <== osd.0 v2:172.21.15.31:6800/168281188 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f68bc051070 con 0x7f68c4017050 2024-09-22T08:36:43.899 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.856+0000 7f68d5575800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:43.899 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.856+0000 7f68d5575800 20 rados->read ofs=0 len=0 2024-09-22T08:36:43.899 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.856+0000 7f68d5575800 1 -- 172.21.15.142:0/342891185 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56100c37bfb0 con 0x56100c375120 2024-09-22T08:36:43.899 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.856+0000 7f68d3860640 1 -- 172.21.15.142:0/342891185 <== osd.3 v2:172.21.15.142:6800/1064901393 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f68cc00a4d0 con 0x56100c375120 2024-09-22T08:36:43.899 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.856+0000 7f68d5575800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:43.899 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.856+0000 7f68d5575800 20 rados->read ofs=0 len=0 2024-09-22T08:36:43.899 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.856+0000 7f68d5575800 1 -- 172.21.15.142:0/342891185 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56100c37c350 con 0x56100c375120 2024-09-22T08:36:43.899 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.857+0000 7f68d3860640 1 -- 172.21.15.142:0/342891185 <== osd.3 v2:172.21.15.142:6800/1064901393 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f68cc00a4d0 con 0x56100c375120 2024-09-22T08:36:43.899 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.857+0000 7f68d5575800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:43.901 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.857+0000 7f68d5575800 20 started sync module instance, tier type = 2024-09-22T08:36:43.901 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.857+0000 7f68d5575800 20 started zone id=e239248c-0bee-4e41-803a-24b288d3eb8f (name=default) with tier type = 2024-09-22T08:36:43.901 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.857+0000 7f68d5575800 1 -- 172.21.15.142:0/342891185 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56100c37b440 con 0x7f68cc012ae0 2024-09-22T08:36:43.902 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.858+0000 7f68d305f640 1 -- 172.21.15.142:0/342891185 <== osd.2 v2:172.21.15.142:6808/279438927 7 ==== osd_op_reply(44 notify.0 [create] v30'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68c401ab20 con 0x7f68cc012ae0 2024-09-22T08:36:43.902 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.858+0000 7f68d5575800 1 -- 172.21.15.142:0/342891185 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94626924443744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56100c37b0a0 con 0x7f68cc012ae0 2024-09-22T08:36:43.902 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.858+0000 7f68d5575800 1 -- 172.21.15.142:0/342891185 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56100c37d250 con 0x56100c370710 2024-09-22T08:36:43.902 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.859+0000 7f68ca85e640 1 -- 172.21.15.142:0/342891185 <== osd.1 v2:172.21.15.142:6816/3192108003 15 ==== osd_op_reply(46 notify.1 [create] v30'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68bc051070 con 0x56100c370710 2024-09-22T08:36:43.902 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.859+0000 7f68d5575800 1 -- 172.21.15.142:0/342891185 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94626924449664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56100c37d9f0 con 0x56100c370710 2024-09-22T08:36:43.902 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.859+0000 7f68d5575800 1 -- 172.21.15.142:0/342891185 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56100c37e510 con 0x56100c375120 2024-09-22T08:36:43.902 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.859+0000 7f68d305f640 1 -- 172.21.15.142:0/342891185 <== osd.2 v2:172.21.15.142:6808/279438927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94626924443744] v30'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68c401ab20 con 0x7f68cc012ae0 2024-09-22T08:36:43.902 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.860+0000 7f68ca85e640 1 -- 172.21.15.142:0/342891185 <== osd.1 v2:172.21.15.142:6816/3192108003 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94626924449664] v30'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68bc051070 con 0x56100c370710 2024-09-22T08:36:43.902 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.860+0000 7f68d3860640 1 -- 172.21.15.142:0/342891185 <== osd.3 v2:172.21.15.142:6800/1064901393 14 ==== osd_op_reply(48 notify.2 [create] v30'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68cc00a4d0 con 0x56100c375120 2024-09-22T08:36:43.902 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.860+0000 7f68d5575800 1 -- 172.21.15.142:0/342891185 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94626924453856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56100c37e4d0 con 0x56100c375120 2024-09-22T08:36:43.902 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.860+0000 7f68d5575800 1 -- 172.21.15.142:0/342891185 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56100c37edb0 con 0x7f68cc012ae0 2024-09-22T08:36:43.902 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.861+0000 7f68d3860640 1 -- 172.21.15.142:0/342891185 <== osd.3 v2:172.21.15.142:6800/1064901393 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94626924453856] v30'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68cc00a4d0 con 0x56100c375120 2024-09-22T08:36:43.903 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.861+0000 7f68d305f640 1 -- 172.21.15.142:0/342891185 <== osd.2 v2:172.21.15.142:6808/279438927 9 ==== osd_op_reply(50 notify.3 [create] v30'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68c401ab20 con 0x7f68cc012ae0 2024-09-22T08:36:43.903 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.861+0000 7f68d5575800 1 -- 172.21.15.142:0/342891185 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94626924456192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56100c37e510 con 0x7f68cc012ae0 2024-09-22T08:36:43.903 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.861+0000 7f68d5575800 1 -- 172.21.15.142:0/342891185 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56100c37f8c0 con 0x56100c370710 2024-09-22T08:36:43.903 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.862+0000 7f68ca85e640 1 -- 172.21.15.142:0/342891185 <== osd.1 v2:172.21.15.142:6816/3192108003 17 ==== osd_op_reply(52 notify.4 [create] v30'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68bc051070 con 0x56100c370710 2024-09-22T08:36:43.903 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.862+0000 7f68d5575800 1 -- 172.21.15.142:0/342891185 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94626924458864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56100c380160 con 0x56100c370710 2024-09-22T08:36:43.903 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.862+0000 7f68d5575800 1 -- 172.21.15.142:0/342891185 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56100c380c40 con 0x7f68c4017050 2024-09-22T08:36:43.903 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.862+0000 7f68d305f640 1 -- 172.21.15.142:0/342891185 <== osd.2 v2:172.21.15.142:6808/279438927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94626924456192] v30'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68c401ab20 con 0x7f68cc012ae0 2024-09-22T08:36:43.903 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.863+0000 7f68ca85e640 1 -- 172.21.15.142:0/342891185 <== osd.0 v2:172.21.15.31:6800/168281188 11 ==== osd_op_reply(54 notify.5 [create] v30'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68bc051070 con 0x7f68c4017050 2024-09-22T08:36:43.903 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.863+0000 7f68d5575800 1 -- 172.21.15.142:0/342891185 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94626924463952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56100c380c40 con 0x7f68c4017050 2024-09-22T08:36:43.903 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.863+0000 7f68d5575800 1 -- 172.21.15.142:0/342891185 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56100c3816b0 con 0x7f68c4017050 2024-09-22T08:36:43.903 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.863+0000 7f68ca85e640 1 -- 172.21.15.142:0/342891185 <== osd.1 v2:172.21.15.142:6816/3192108003 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94626924458864] v30'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68bc051070 con 0x56100c370710 2024-09-22T08:36:43.903 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.864+0000 7f68ca85e640 1 -- 172.21.15.142:0/342891185 <== osd.0 v2:172.21.15.31:6800/168281188 12 ==== osd_op_reply(56 notify.6 [create] v30'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68bc051070 con 0x7f68c4017050 2024-09-22T08:36:43.904 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.864+0000 7f68d5575800 1 -- 172.21.15.142:0/342891185 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94626924466592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56100c381670 con 0x7f68c4017050 2024-09-22T08:36:43.904 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.864+0000 7f68d5575800 1 -- 172.21.15.142:0/342891185 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56100c3820b0 con 0x7f68c4017050 2024-09-22T08:36:43.904 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.864+0000 7f68ca85e640 1 -- 172.21.15.142:0/342891185 <== osd.0 v2:172.21.15.31:6800/168281188 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94626924463952] v30'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68bc051070 con 0x7f68c4017050 2024-09-22T08:36:43.904 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.865+0000 7f68ca85e640 1 -- 172.21.15.142:0/342891185 <== osd.0 v2:172.21.15.31:6800/168281188 14 ==== osd_op_reply(58 notify.7 [create] v30'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68bc051070 con 0x7f68c4017050 2024-09-22T08:36:43.904 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.865+0000 7f68d5575800 1 -- 172.21.15.142:0/342891185 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94626924469120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56100c382070 con 0x7f68c4017050 2024-09-22T08:36:43.904 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.865+0000 7f68d5575800 20 add_watcher() i=0 2024-09-22T08:36:43.904 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.865+0000 7f68d5575800 20 add_watcher() i=1 2024-09-22T08:36:43.904 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.865+0000 7f68d5575800 20 add_watcher() i=2 2024-09-22T08:36:43.904 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.865+0000 7f68d5575800 20 add_watcher() i=3 2024-09-22T08:36:43.904 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.865+0000 7f68d5575800 20 add_watcher() i=4 2024-09-22T08:36:43.904 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.865+0000 7f68d5575800 20 add_watcher() i=5 2024-09-22T08:36:43.904 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.865+0000 7f68ca85e640 1 -- 172.21.15.142:0/342891185 <== osd.0 v2:172.21.15.31:6800/168281188 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94626924466592] v30'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68bc051070 con 0x7f68c4017050 2024-09-22T08:36:43.904 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.865+0000 7f68d5575800 20 add_watcher() i=6 2024-09-22T08:36:43.905 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.866+0000 7f68ca85e640 1 -- 172.21.15.142:0/342891185 <== osd.0 v2:172.21.15.31:6800/168281188 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94626924469120] v30'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68bc051070 con 0x7f68c4017050 2024-09-22T08:36:43.905 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.866+0000 7f68d5575800 20 add_watcher() i=7 2024-09-22T08:36:43.905 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.866+0000 7f68d5575800 2 all 8 watchers are set, enabling cache 2024-09-22T08:36:43.905 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.866+0000 7f68d5575800 1 -- 172.21.15.142:0/342891185 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56100c37fda0 con 0x56100c370710 2024-09-22T08:36:43.905 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.866+0000 7f68ca85e640 1 -- 172.21.15.142:0/342891185 <== osd.1 v2:172.21.15.142:6816/3192108003 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f68bc051070 con 0x56100c370710 2024-09-22T08:36:43.905 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.866+0000 7f68d5575800 1 -- 172.21.15.142:0/342891185 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94626924447616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56100c382920 con 0x56100c370710 2024-09-22T08:36:43.905 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.867+0000 7f68ca85e640 1 -- 172.21.15.142:0/342891185 <== osd.1 v2:172.21.15.142:6816/3192108003 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94626924447616] v30'68 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f68bc051070 con 0x56100c370710 2024-09-22T08:36:43.905 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.867+0000 7f678a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:36:43.905 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.867+0000 7f68d5575800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:36:43.905 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.867+0000 7f68d5575800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:36:43.905 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.867+0000 7f68d5575800 5 note: GC not initialized 2024-09-22T08:36:43.905 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.868+0000 7f67897e2640 20 reqs_thread_entry: start 2024-09-22T08:36:43.905 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.868+0000 7f68d5575800 20 init_complete bucket index max shards: 11 2024-09-22T08:36:43.906 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.868+0000 7f68d5575800 20 Filter name: none 2024-09-22T08:36:43.906 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.868+0000 7f67827fc640 20 reqs_thread_entry: start 2024-09-22T08:36:43.906 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.868+0000 7f68d5575800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-22T08:36:43.906 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.868+0000 7f68d5575800 20 rados->read ofs=0 len=0 2024-09-22T08:36:43.906 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.868+0000 7f68d5575800 1 -- 172.21.15.142:0/342891185 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56100c3b8450 con 0x56100c370710 2024-09-22T08:36:43.906 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.868+0000 7f68ca85e640 1 -- 172.21.15.142:0/342891185 <== osd.1 v2:172.21.15.142:6816/3192108003 21 ==== osd_op_reply(62 foo [call out=48b,read 0~502 out=502b,getxattrs out=75b] v0'0 uv4 ondisk = 0) ==== 231+0+625 (crc 0 0 0) 0x7f68bc051070 con 0x56100c370710 2024-09-22T08:36:43.906 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.868+0000 7f68d5575800 20 rados_obj.operate() r=0 bl.length=502 2024-09-22T08:36:43.906 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.868+0000 7f68d5575800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-22T08:36:43.906 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.868+0000 7f68d5575800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-22T08:36:43.906 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.868+0000 7f68d5575800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:36:43.906 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.868+0000 7f68d5575800 1 -- 172.21.15.142:0/342891185 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56100c3bead0 con 0x56100c370710 2024-09-22T08:36:43.906 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.869+0000 7f68ca85e640 1 -- 172.21.15.142:0/342891185 <== osd.1 v2:172.21.15.142:6816/3192108003 22 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~391] v30'5 uv5 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f68bc051070 con 0x56100c370710 2024-09-22T08:36:43.906 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.869+0000 7f68d5575800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-22T08:36:43.907 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.869+0000 7f68d5575800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-22T08:36:43.907 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.869+0000 7f68d5575800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-22T08:36:43.907 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.869+0000 7f68d5575800 1 -- 172.21.15.142:0/342891185 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94626924717328 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56100c3ba190 con 0x56100c370710 2024-09-22T08:36:43.907 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.870+0000 7f68ca85e640 1 -- 172.21.15.142:0/342891185 <== osd.1 v2:172.21.15.142:6816/3192108003 23 ==== watch-notify(notify (1) cookie 94626924458864 notify 128849018884 ret 0) ==== 609+0+0 (crc 0 0 0) 0x7f68bc081040 con 0x56100c370710 2024-09-22T08:36:43.907 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.870+0000 7f67b6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018884 cookie 94626924458864 notifier 4352 bl.length()=567 2024-09-22T08:36:43.907 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.870+0000 7f67b6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-22T08:36:43.907 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.870+0000 7f68ca85e640 1 -- 172.21.15.142:0/342891185 <== osd.1 v2:172.21.15.142:6816/3192108003 24 ==== osd_op_reply(64 notify.4 [notify cookie 94626924717328 out=8b] v0'0 uv51 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f68bc051070 con 0x56100c370710 2024-09-22T08:36:43.907 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.870+0000 7f67b6ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-22T08:36:43.907 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.870+0000 7f67b6ffd640 1 -- 172.21.15.142:0/342891185 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f6798003ea0 con 0x56100c370710 2024-09-22T08:36:43.907 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.870+0000 7f68ca85e640 1 -- 172.21.15.142:0/342891185 <== osd.1 v2:172.21.15.142:6816/3192108003 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68bc051070 con 0x56100c370710 2024-09-22T08:36:43.907 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.870+0000 7f68ca85e640 1 -- 172.21.15.142:0/342891185 <== osd.1 v2:172.21.15.142:6816/3192108003 26 ==== watch-notify(notify_complete (2) cookie 94626924717328 notify 128849018884 ret 0) ==== 42+0+48 (crc 0 0 0) 0x56100c2467d0 con 0x56100c370710 2024-09-22T08:36:43.907 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.870+0000 7f68d5575800 1 -- 172.21.15.142:0/342891185 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:66 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56100c3be510 con 0x7f68c4017050 2024-09-22T08:36:43.907 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.871+0000 7f68ca85e640 1 -- 172.21.15.142:0/342891185 <== osd.0 v2:172.21.15.31:6800/168281188 17 ==== osd_op_reply(66 p5YnriCv1nAtykxBrupQ [delete] v30'2 uv2 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f68bc051070 con 0x7f68c4017050 2024-09-22T08:36:43.908 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.871+0000 7f68d5575800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-22T08:36:43.908 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.871+0000 7f68d5575800 1 -- 172.21.15.142:0/342891185 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [notify cookie 94626924717328 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56100c3b9ce0 con 0x56100c375120 2024-09-22T08:36:43.908 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.871+0000 7f68d3860640 1 -- 172.21.15.142:0/342891185 <== osd.3 v2:172.21.15.142:6800/1064901393 16 ==== watch-notify(notify (1) cookie 94626924453856 notify 128849018881 ret 0) ==== 212+0+0 (crc 0 0 0) 0x56100c3655d0 con 0x56100c375120 2024-09-22T08:36:43.908 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.872+0000 7f67b6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018881 cookie 94626924453856 notifier 4352 bl.length()=170 2024-09-22T08:36:43.908 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.872+0000 7f67b6ffd640 1 -- 172.21.15.142:0/342891185 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f6798003ea0 con 0x56100c375120 2024-09-22T08:36:43.908 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.872+0000 7f68d3860640 1 -- 172.21.15.142:0/342891185 <== osd.3 v2:172.21.15.142:6800/1064901393 17 ==== osd_op_reply(67 notify.2 [notify cookie 94626924717328 out=8b] v0'0 uv51 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f68cc00a4d0 con 0x56100c375120 2024-09-22T08:36:43.908 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.872+0000 7f68d3860640 1 -- 172.21.15.142:0/342891185 <== osd.3 v2:172.21.15.142:6800/1064901393 18 ==== osd_op_reply(68 notify.2 [notify-ack] v0'0 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68cc00a4d0 con 0x56100c375120 2024-09-22T08:36:43.908 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.872+0000 7f68d3860640 1 -- 172.21.15.142:0/342891185 <== osd.3 v2:172.21.15.142:6800/1064901393 19 ==== watch-notify(notify_complete (2) cookie 94626924717328 notify 128849018881 ret 0) ==== 42+0+48 (crc 0 0 0) 0x56100c365340 con 0x56100c375120 2024-09-22T08:36:43.908 INFO:teuthology.orchestra.run.smithi142.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-22T08:36:42.661297Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-22T08:36:42.661288Z","tags":[],"group_ids":[]} 2024-09-22T08:36:43.914 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.873+0000 7f678a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:36:43.914 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.873+0000 7f68d5575800 1 -- 172.21.15.142:0/342891185 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:69 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94626924447616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56100c3b6140 con 0x56100c370710 2024-09-22T08:36:43.914 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.874+0000 7f68ca85e640 1 -- 172.21.15.142:0/342891185 <== osd.1 v2:172.21.15.142:6816/3192108003 27 ==== osd_op_reply(69 data_loggenerations_metadata [watch unwatch cookie 94626924447616] v30'69 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f68bc051070 con 0x56100c370710 2024-09-22T08:36:43.914 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.874+0000 7f68d5575800 1 -- 172.21.15.142:0/342891185 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:70 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94626924443744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56100c3b6140 con 0x7f68cc012ae0 2024-09-22T08:36:43.914 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.875+0000 7f68d305f640 1 -- 172.21.15.142:0/342891185 <== osd.2 v2:172.21.15.142:6808/279438927 11 ==== osd_op_reply(70 notify.0 [watch unwatch cookie 94626924443744] v30'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68c401ab20 con 0x7f68cc012ae0 2024-09-22T08:36:43.914 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.875+0000 7f68d5575800 20 remove_watcher() i=0 2024-09-22T08:36:43.915 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.875+0000 7f68d5575800 2 removed watcher, disabling cache 2024-09-22T08:36:43.915 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.875+0000 7f68d5575800 1 -- 172.21.15.142:0/342891185 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:71 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94626924449664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56100c3b6140 con 0x56100c370710 2024-09-22T08:36:43.915 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.876+0000 7f68ca85e640 1 -- 172.21.15.142:0/342891185 <== osd.1 v2:172.21.15.142:6816/3192108003 28 ==== osd_op_reply(71 notify.1 [watch unwatch cookie 94626924449664] v30'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68bc051070 con 0x56100c370710 2024-09-22T08:36:43.915 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.876+0000 7f68d5575800 20 remove_watcher() i=1 2024-09-22T08:36:43.915 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.876+0000 7f68d5575800 1 -- 172.21.15.142:0/342891185 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:72 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94626924453856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56100c3b6140 con 0x56100c375120 2024-09-22T08:36:43.915 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.877+0000 7f68d3860640 1 -- 172.21.15.142:0/342891185 <== osd.3 v2:172.21.15.142:6800/1064901393 20 ==== osd_op_reply(72 notify.2 [watch unwatch cookie 94626924453856] v30'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68cc00a4d0 con 0x56100c375120 2024-09-22T08:36:43.915 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.877+0000 7f68d5575800 20 remove_watcher() i=2 2024-09-22T08:36:43.915 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.877+0000 7f68d5575800 1 -- 172.21.15.142:0/342891185 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94626924456192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56100c3b6140 con 0x7f68cc012ae0 2024-09-22T08:36:43.915 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.877+0000 7f68d305f640 1 -- 172.21.15.142:0/342891185 <== osd.2 v2:172.21.15.142:6808/279438927 12 ==== osd_op_reply(73 notify.3 [watch unwatch cookie 94626924456192] v30'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68c401ab20 con 0x7f68cc012ae0 2024-09-22T08:36:43.915 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.877+0000 7f68d5575800 20 remove_watcher() i=3 2024-09-22T08:36:43.916 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.877+0000 7f68d5575800 1 -- 172.21.15.142:0/342891185 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94626924458864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56100c3b6140 con 0x56100c370710 2024-09-22T08:36:43.916 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.879+0000 7f68ca85e640 1 -- 172.21.15.142:0/342891185 <== osd.1 v2:172.21.15.142:6816/3192108003 29 ==== osd_op_reply(74 notify.4 [watch unwatch cookie 94626924458864] v30'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68bc051070 con 0x56100c370710 2024-09-22T08:36:43.916 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.879+0000 7f68d5575800 20 remove_watcher() i=4 2024-09-22T08:36:43.916 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.879+0000 7f68d5575800 1 -- 172.21.15.142:0/342891185 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:75 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94626924463952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56100c3b6140 con 0x7f68c4017050 2024-09-22T08:36:43.916 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.880+0000 7f68ca85e640 1 -- 172.21.15.142:0/342891185 <== osd.0 v2:172.21.15.31:6800/168281188 18 ==== osd_op_reply(75 notify.5 [watch unwatch cookie 94626924463952] v30'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68bc051070 con 0x7f68c4017050 2024-09-22T08:36:43.916 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.880+0000 7f68d5575800 20 remove_watcher() i=5 2024-09-22T08:36:43.916 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.880+0000 7f68d5575800 1 -- 172.21.15.142:0/342891185 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:76 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94626924466592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56100c3b6140 con 0x7f68c4017050 2024-09-22T08:36:43.916 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.881+0000 7f68ca85e640 1 -- 172.21.15.142:0/342891185 <== osd.0 v2:172.21.15.31:6800/168281188 19 ==== osd_op_reply(76 notify.6 [watch unwatch cookie 94626924466592] v30'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68bc051070 con 0x7f68c4017050 2024-09-22T08:36:43.916 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.881+0000 7f68d5575800 20 remove_watcher() i=6 2024-09-22T08:36:43.916 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.881+0000 7f68d5575800 1 -- 172.21.15.142:0/342891185 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:77 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94626924469120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56100c3b6140 con 0x7f68c4017050 2024-09-22T08:36:43.916 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.882+0000 7f68ca85e640 1 -- 172.21.15.142:0/342891185 <== osd.0 v2:172.21.15.31:6800/168281188 20 ==== osd_op_reply(77 notify.7 [watch unwatch cookie 94626924469120] v30'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68bc051070 con 0x7f68c4017050 2024-09-22T08:36:43.916 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.882+0000 7f68d5575800 20 remove_watcher() i=7 2024-09-22T08:36:43.916 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.882+0000 7f68d5575800 1 -- 172.21.15.142:0/342891185 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f68c4017050 msgr2=0x7f68c404b890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:43.917 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.882+0000 7f68d5575800 1 --2- 172.21.15.142:0/342891185 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f68c4017050 0x7f68c404b890 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:43.917 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.882+0000 7f68d5575800 1 -- 172.21.15.142:0/342891185 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x56100c370710 msgr2=0x56100c372bd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:43.917 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.882+0000 7f68d5575800 1 --2- 172.21.15.142:0/342891185 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x56100c370710 0x56100c372bd0 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:43.917 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.882+0000 7f68d5575800 1 -- 172.21.15.142:0/342891185 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f68cc012ae0 msgr2=0x7f68cc033950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:43.917 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.882+0000 7f68d5575800 1 --2- 172.21.15.142:0/342891185 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f68cc012ae0 0x7f68cc033950 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:43.917 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.882+0000 7f68d5575800 1 -- 172.21.15.142:0/342891185 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x56100c375120 msgr2=0x56100c377510 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:43.917 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.882+0000 7f68d5575800 1 --2- 172.21.15.142:0/342891185 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x56100c375120 0x56100c377510 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:43.917 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.882+0000 7f68d5575800 1 -- 172.21.15.142:0/342891185 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f679c03cfb0 msgr2=0x7f679c03f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:43.917 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.882+0000 7f68d5575800 1 --2- 172.21.15.142:0/342891185 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f679c03cfb0 0x7f679c03f470 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f68c4001250 tx=0x7f68c4051000 comp rx=0 tx=0).stop 2024-09-22T08:36:43.917 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.882+0000 7f68d5575800 1 -- 172.21.15.142:0/342891185 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56100c35d800 msgr2=0x56100c364de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:43.917 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.882+0000 7f68ca85e640 1 -- 172.21.15.142:0/342891185 reap_dead start 2024-09-22T08:36:43.917 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.882+0000 7f68d5575800 1 --2- 172.21.15.142:0/342891185 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56100c35d800 0x56100c364de0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f68cc056360 tx=0x7f68cc054860 comp rx=0 tx=0).stop 2024-09-22T08:36:43.917 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.882+0000 7f68d5575800 1 -- 172.21.15.142:0/342891185 shutdown_connections 2024-09-22T08:36:43.918 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.882+0000 7f68d5575800 1 --2- 172.21.15.142:0/342891185 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56100c35d800 0x56100c364de0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:43.918 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.882+0000 7f68d5575800 1 -- 172.21.15.142:0/342891185 >> 172.21.15.142:0/342891185 conn(0x56100c359c00 msgr2=0x56100c357e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:43.918 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.882+0000 7f68d5575800 1 -- 172.21.15.142:0/342891185 shutdown_connections 2024-09-22T08:36:43.918 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.882+0000 7f68d5575800 1 -- 172.21.15.142:0/342891185 wait complete. 2024-09-22T08:36:43.918 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.882+0000 7f68d5575800 1 -- 172.21.15.142:0/2373688259 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f67ac03cfb0 msgr2=0x7f67ac03f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:43.918 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.882+0000 7f68d5575800 1 --2- 172.21.15.142:0/2373688259 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f67ac03cfb0 0x7f67ac03f470 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x56100c337e50 tx=0x7f68c40529c0 comp rx=0 tx=0).stop 2024-09-22T08:36:43.918 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.882+0000 7f68d5575800 1 -- 172.21.15.142:0/2373688259 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56100c350d40 msgr2=0x56100c351160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:43.918 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.882+0000 7f68d5575800 1 --2- 172.21.15.142:0/2373688259 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56100c350d40 0x56100c351160 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x56100c336be0 tx=0x7f68cc0167b0 comp rx=0 tx=0).stop 2024-09-22T08:36:43.918 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.882+0000 7f68d5575800 1 -- 172.21.15.142:0/2373688259 shutdown_connections 2024-09-22T08:36:43.918 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.882+0000 7f68d5575800 1 --2- 172.21.15.142:0/2373688259 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f67ac03cfb0 0x7f67ac03f470 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:43.918 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.882+0000 7f68d5575800 1 --2- 172.21.15.142:0/2373688259 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56100c350d40 0x56100c351160 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:43.918 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.882+0000 7f68d5575800 1 -- 172.21.15.142:0/2373688259 >> 172.21.15.142:0/2373688259 conn(0x56100c3450f0 msgr2=0x56100c3454d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:43.918 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.883+0000 7f68d5575800 1 -- 172.21.15.142:0/2373688259 shutdown_connections 2024-09-22T08:36:43.919 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.883+0000 7f68d5575800 1 -- 172.21.15.142:0/2373688259 wait complete. 2024-09-22T08:36:43.919 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.883+0000 7f68d5575800 1 -- 172.21.15.142:0/1993612058 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x56100c242c00 msgr2=0x56100c33d3a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:43.919 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.883+0000 7f68d5575800 1 --2- 172.21.15.142:0/1993612058 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x56100c242c00 0x56100c33d3a0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:43.919 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.883+0000 7f68d5575800 1 -- 172.21.15.142:0/1993612058 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x56100c33f740 msgr2=0x56100c341be0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:43.919 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.883+0000 7f68d5575800 1 --2- 172.21.15.142:0/1993612058 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x56100c33f740 0x56100c341be0 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:43.919 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.883+0000 7f68d5575800 1 -- 172.21.15.142:0/1993612058 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f67b803cfb0 msgr2=0x7f67b803f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:43.919 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.883+0000 7f68d5575800 1 --2- 172.21.15.142:0/1993612058 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f67b803cfb0 0x7f67b803f470 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f68bc057000 tx=0x7f68bc052000 comp rx=0 tx=0).stop 2024-09-22T08:36:43.919 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.883+0000 7f68d5575800 1 -- 172.21.15.142:0/1993612058 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56100c1b0530 msgr2=0x56100c335d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:43.919 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.883+0000 7f68d5575800 1 --2- 172.21.15.142:0/1993612058 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56100c1b0530 0x56100c335d50 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f68c400c010 tx=0x7f68c4000ed0 comp rx=0 tx=0).stop 2024-09-22T08:36:43.919 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.883+0000 7f68d5575800 1 -- 172.21.15.142:0/1993612058 shutdown_connections 2024-09-22T08:36:43.919 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.883+0000 7f68d5575800 1 --2- 172.21.15.142:0/1993612058 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x56100c33f740 0x56100c341be0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:43.919 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.883+0000 7f68d5575800 1 --2- 172.21.15.142:0/1993612058 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x56100c242c00 0x56100c33d3a0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:43.919 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.883+0000 7f68d5575800 1 --2- 172.21.15.142:0/1993612058 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f67b803cfb0 0x7f67b803f470 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:43.920 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.883+0000 7f68d5575800 1 --2- 172.21.15.142:0/1993612058 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56100c1b0530 0x56100c335d50 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:43.920 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.883+0000 7f68d5575800 1 -- 172.21.15.142:0/1993612058 >> 172.21.15.142:0/1993612058 conn(0x56100c236be0 msgr2=0x56100c32f720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:43.920 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.883+0000 7f68d5575800 1 -- 172.21.15.142:0/1993612058 shutdown_connections 2024-09-22T08:36:43.920 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.883+0000 7f68d5575800 1 -- 172.21.15.142:0/1993612058 wait complete. 2024-09-22T08:36:43.920 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-22T08:36:42.661297Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-22T08:36:42.661288Z', 'tags': [], 'group_ids': []} 2024-09-22T08:36:43.920 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'create', '--subuser', 'foo:foo1', '--access', 'full'] 2024-09-22T08:36:43.920 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'create', '--subuser', 'foo:foo1', '--access', 'full'] 2024-09-22T08:36:43.920 DEBUG:teuthology.orchestra.run.smithi142:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser create --subuser foo:foo1 --access full 2024-09-22T08:36:43.966 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:36:43.967 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:36:43.967 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.966+0000 7fbd01928800 1 Processor -- start 2024-09-22T08:36:43.967 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.966+0000 7fbd01928800 1 -- start start 2024-09-22T08:36:43.967 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.966+0000 7fbd01928800 1 --2- >> v2:172.21.15.31:3300/0 conn(0x5573b2c40fe0 0x5573b2c48f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:43.968 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.966+0000 7fbd01928800 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5573b2acda20 con 0x5573b2c40be0 2024-09-22T08:36:43.968 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.966+0000 7fbd01928800 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x5573b2acd7d0 con 0x5573b2c40fe0 2024-09-22T08:36:43.968 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.967+0000 7fbcfced5640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x5573b2c40fe0 0x5573b2c48f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:43.968 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.967+0000 7fbcfd6d6640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x5573b2c40be0 0x5573b2c45850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.142:42376/0 (socket says 172.21.15.142:42376) 2024-09-22T08:36:43.968 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.967+0000 7fbcfd6d6640 1 -- 172.21.15.142:0/271111684 learned_addr learned my addr 172.21.15.142:0/271111684 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-09-22T08:36:43.969 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.967+0000 7fbcfced5640 1 -- 172.21.15.142:0/271111684 >> v1:172.21.15.31:6789/0 conn(0x5573b2c40be0 legacy=0x5573b2c45850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:43.969 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.967+0000 7fbcfced5640 1 -- 172.21.15.142:0/271111684 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5573b2c4a590 con 0x5573b2c40fe0 2024-09-22T08:36:43.970 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.969+0000 7fbcfced5640 1 --2- 172.21.15.142:0/271111684 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5573b2c40fe0 0x5573b2c48f80 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fbce800a470 tx=0x7fbce8045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d11e130ed6880d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:43.970 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.969+0000 7fbcf7fff640 1 -- 172.21.15.142:0/271111684 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbce8053570 con 0x5573b2c40fe0 2024-09-22T08:36:43.970 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.969+0000 7fbcf7fff640 1 -- 172.21.15.142:0/271111684 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbce8058070 con 0x5573b2c40fe0 2024-09-22T08:36:43.970 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.969+0000 7fbcf7fff640 1 -- 172.21.15.142:0/271111684 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbce8053880 con 0x5573b2c40fe0 2024-09-22T08:36:43.971 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.969+0000 7fbd01928800 1 -- 172.21.15.142:0/271111684 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5573b2c40fe0 msgr2=0x5573b2c48f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:43.972 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.969+0000 7fbd01928800 1 --2- 172.21.15.142:0/271111684 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5573b2c40fe0 0x5573b2c48f80 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fbce800a470 tx=0x7fbce8045a20 comp rx=0 tx=0).stop 2024-09-22T08:36:43.972 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.969+0000 7fbd01928800 1 -- 172.21.15.142:0/271111684 shutdown_connections 2024-09-22T08:36:43.972 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.969+0000 7fbd01928800 1 --2- 172.21.15.142:0/271111684 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5573b2c40fe0 0x5573b2c48f80 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:43.972 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.969+0000 7fbd01928800 1 -- 172.21.15.142:0/271111684 >> 172.21.15.142:0/271111684 conn(0x5573b2c3c310 msgr2=0x5573b2c3e790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:43.972 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.969+0000 7fbd01928800 1 -- 172.21.15.142:0/271111684 shutdown_connections 2024-09-22T08:36:43.972 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.970+0000 7fbd01928800 1 -- 172.21.15.142:0/271111684 wait complete. 2024-09-22T08:36:43.985 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.983+0000 7fbd01928800 1 Processor -- start 2024-09-22T08:36:43.985 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.983+0000 7fbd01928800 1 -- start start 2024-09-22T08:36:43.985 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.983+0000 7fbd01928800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5573b2c40be0 0x5573b2d32020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:43.985 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.983+0000 7fbd01928800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5573b2adadd0 con 0x5573b2c40be0 2024-09-22T08:36:43.985 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.984+0000 7fbcfd6d6640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5573b2c40be0 0x5573b2d32020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:43.985 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.984+0000 7fbcfd6d6640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5573b2c40be0 0x5573b2d32020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:38438/0 (socket says 172.21.15.142:38438) 2024-09-22T08:36:43.985 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.984+0000 7fbcfd6d6640 1 -- 172.21.15.142:0/1682778523 learned_addr learned my addr 172.21.15.142:0/1682778523 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:43.986 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.984+0000 7fbcfd6d6640 1 -- 172.21.15.142:0/1682778523 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5573b2d32610 con 0x5573b2c40be0 2024-09-22T08:36:43.986 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.984+0000 7fbcfd6d6640 1 --2- 172.21.15.142:0/1682778523 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5573b2c40be0 0x5573b2d32020 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fbcf0001800 tx=0x7fbcf0001cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47f145344228ed6c server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:43.986 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.984+0000 7fbbeb606640 1 -- 172.21.15.142:0/1682778523 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbcf0004520 con 0x5573b2c40be0 2024-09-22T08:36:43.986 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.984+0000 7fbbeb606640 1 -- 172.21.15.142:0/1682778523 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbcf00046c0 con 0x5573b2c40be0 2024-09-22T08:36:43.986 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.984+0000 7fbbeb606640 1 -- 172.21.15.142:0/1682778523 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbcf00049e0 con 0x5573b2c40be0 2024-09-22T08:36:43.988 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.985+0000 7fbd01928800 1 -- 172.21.15.142:0/1682778523 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5573b2c40be0 msgr2=0x5573b2d32020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:43.988 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.985+0000 7fbd01928800 1 --2- 172.21.15.142:0/1682778523 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5573b2c40be0 0x5573b2d32020 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fbcf0001800 tx=0x7fbcf0001cc0 comp rx=0 tx=0).stop 2024-09-22T08:36:43.988 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.985+0000 7fbd01928800 1 -- 172.21.15.142:0/1682778523 shutdown_connections 2024-09-22T08:36:43.988 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.985+0000 7fbd01928800 1 --2- 172.21.15.142:0/1682778523 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5573b2c40be0 0x5573b2d32020 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:43.988 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.985+0000 7fbd01928800 1 -- 172.21.15.142:0/1682778523 >> 172.21.15.142:0/1682778523 conn(0x5573b2c3c310 msgr2=0x5573b2d2d9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:43.989 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.985+0000 7fbd01928800 1 -- 172.21.15.142:0/1682778523 shutdown_connections 2024-09-22T08:36:43.989 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.985+0000 7fbd01928800 1 -- 172.21.15.142:0/1682778523 wait complete. 2024-09-22T08:36:43.989 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.986+0000 7fbd01928800 1 Processor -- start 2024-09-22T08:36:43.989 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.986+0000 7fbd01928800 1 -- start start 2024-09-22T08:36:43.989 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.986+0000 7fbd01928800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5573b2c40be0 0x5573b2d39b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:43.989 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.986+0000 7fbd01928800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5573b2c49850 con 0x5573b2c40be0 2024-09-22T08:36:43.989 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.986+0000 7fbcfd6d6640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5573b2c40be0 0x5573b2d39b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:43.989 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.986+0000 7fbcfd6d6640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5573b2c40be0 0x5573b2d39b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:38452/0 (socket says 172.21.15.142:38452) 2024-09-22T08:36:43.989 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.986+0000 7fbcfd6d6640 1 -- 172.21.15.142:0/3313753014 learned_addr learned my addr 172.21.15.142:0/3313753014 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:43.989 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.986+0000 7fbcfd6d6640 1 -- 172.21.15.142:0/3313753014 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5573b2d3a0f0 con 0x5573b2c40be0 2024-09-22T08:36:43.989 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.987+0000 7fbcfd6d6640 1 --2- 172.21.15.142:0/3313753014 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5573b2c40be0 0x5573b2d39b90 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fbcf0000f80 tx=0x7fbcf0001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:43.989 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.987+0000 7fbbe9e03640 1 -- 172.21.15.142:0/3313753014 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbcf0022020 con 0x5573b2c40be0 2024-09-22T08:36:43.989 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.987+0000 7fbbe9e03640 1 -- 172.21.15.142:0/3313753014 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbcf0014890 con 0x5573b2c40be0 2024-09-22T08:36:43.989 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.987+0000 7fbd01928800 1 -- 172.21.15.142:0/3313753014 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5573b2d3a380 con 0x5573b2c40be0 2024-09-22T08:36:43.989 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.987+0000 7fbbe9e03640 1 -- 172.21.15.142:0/3313753014 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbcf0014bb0 con 0x5573b2c40be0 2024-09-22T08:36:43.990 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.987+0000 7fbd01928800 1 -- 172.21.15.142:0/3313753014 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5573b2d3ad80 con 0x5573b2c40be0 2024-09-22T08:36:43.992 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.988+0000 7fbbe9e03640 1 -- 172.21.15.142:0/3313753014 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fbcf0025020 con 0x5573b2c40be0 2024-09-22T08:36:43.992 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.988+0000 7fbbe9e03640 1 --2- 172.21.15.142:0/3313753014 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fbbe403d000 0x7fbbe403f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:43.992 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.988+0000 7fbbe9e03640 1 -- 172.21.15.142:0/3313753014 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fbcf0018030 con 0x5573b2c40be0 2024-09-22T08:36:43.992 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.988+0000 7fbcfced5640 1 --2- 172.21.15.142:0/3313753014 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fbbe403d000 0x7fbbe403f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:43.992 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.988+0000 7fbd01928800 1 --2- 172.21.15.142:0/3313753014 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5573b2c40fe0 0x5573b2d411e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:43.992 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.988+0000 7fbd01928800 1 -- 172.21.15.142:0/3313753014 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5573b2d41720 con 0x5573b2c40fe0 2024-09-22T08:36:43.992 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.988+0000 7fbcfded7640 1 --2- 172.21.15.142:0/3313753014 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5573b2c40fe0 0x5573b2d411e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:43.993 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.989+0000 7fbcfced5640 1 --2- 172.21.15.142:0/3313753014 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fbbe403d000 0x7fbbe403f4c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fbce8057000 tx=0x7fbce8052000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:43.993 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.989+0000 7fbcfded7640 1 --2- 172.21.15.142:0/3313753014 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5573b2c40fe0 0x5573b2d411e0 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:43.993 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.989+0000 7fbcfded7640 1 -- 172.21.15.142:0/3313753014 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbcf80083e0 con 0x5573b2c40fe0 2024-09-22T08:36:43.993 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.989+0000 7fbd01928800 1 -- 172.21.15.142:0/3313753014 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5573b2d41ac0 con 0x5573b2c40fe0 2024-09-22T08:36:43.993 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.989+0000 7fbcfded7640 1 -- 172.21.15.142:0/3313753014 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbcf80083e0 con 0x5573b2c40fe0 2024-09-22T08:36:43.993 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.989+0000 7fbd01928800 1 --2- 172.21.15.142:0/3313753014 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5573b2d435c0 0x5573b2d45a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:43.993 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.989+0000 7fbd01928800 1 -- 172.21.15.142:0/3313753014 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:3 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5573b2d461d0 con 0x5573b2d435c0 2024-09-22T08:36:43.993 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.989+0000 7fbcfd6d6640 1 --2- 172.21.15.142:0/3313753014 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5573b2d435c0 0x5573b2d45a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:43.993 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.990+0000 7fbcfd6d6640 1 --2- 172.21.15.142:0/3313753014 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5573b2d435c0 0x5573b2d45a40 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:43.993 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.990+0000 7fbcfd6d6640 1 -- 172.21.15.142:0/3313753014 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(3 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fbcf001b070 con 0x5573b2d435c0 2024-09-22T08:36:43.993 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.990+0000 7fbd01928800 1 -- 172.21.15.142:0/3313753014 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5573b2d42310 con 0x5573b2c40fe0 2024-09-22T08:36:43.993 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.990+0000 7fbcfded7640 1 -- 172.21.15.142:0/3313753014 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbcf80083e0 con 0x5573b2c40fe0 2024-09-22T08:36:43.993 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.990+0000 7fbd01928800 1 -- 172.21.15.142:0/3313753014 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5573b2d42740 con 0x5573b2d435c0 2024-09-22T08:36:43.993 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.991+0000 7fbcfd6d6640 1 -- 172.21.15.142:0/3313753014 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(5 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fbcf001b070 con 0x5573b2d435c0 2024-09-22T08:36:43.993 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.991+0000 7fbd01928800 1 Processor -- start 2024-09-22T08:36:43.994 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.991+0000 7fbd01928800 1 -- start start 2024-09-22T08:36:43.994 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.991+0000 7fbd01928800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5573b2d54bd0 0x5573b2d54ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:43.994 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.991+0000 7fbd01928800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5573b2b39d50 con 0x5573b2d54bd0 2024-09-22T08:36:43.997 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.991+0000 7fbcfded7640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5573b2d54bd0 0x5573b2d54ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:43.997 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.991+0000 7fbcfded7640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5573b2d54bd0 0x5573b2d54ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:38462/0 (socket says 172.21.15.142:38462) 2024-09-22T08:36:43.997 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.991+0000 7fbcfded7640 1 -- 172.21.15.142:0/1564543410 learned_addr learned my addr 172.21.15.142:0/1564543410 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:43.997 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.992+0000 7fbcfded7640 1 -- 172.21.15.142:0/1564543410 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5573b2d55630 con 0x5573b2d54bd0 2024-09-22T08:36:43.997 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.992+0000 7fbcfded7640 1 --2- 172.21.15.142:0/1564543410 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5573b2d54bd0 0x5573b2d54ff0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x5573b2d3ab90 tx=0x7fbcf800bf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:43.997 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.992+0000 7fbbe2ffd640 1 -- 172.21.15.142:0/1564543410 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbcf801c020 con 0x5573b2d54bd0 2024-09-22T08:36:43.997 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.992+0000 7fbd01928800 1 -- 172.21.15.142:0/1564543410 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5573b2d55e60 con 0x5573b2d54bd0 2024-09-22T08:36:43.998 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.992+0000 7fbd01928800 1 -- 172.21.15.142:0/1564543410 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5573b2d56400 con 0x5573b2d54bd0 2024-09-22T08:36:43.998 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.992+0000 7fbbe2ffd640 1 -- 172.21.15.142:0/1564543410 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbcf8007c90 con 0x5573b2d54bd0 2024-09-22T08:36:43.998 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.992+0000 7fbbe2ffd640 1 -- 172.21.15.142:0/1564543410 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbcf8018440 con 0x5573b2d54bd0 2024-09-22T08:36:43.998 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.993+0000 7fbbe2ffd640 1 -- 172.21.15.142:0/1564543410 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fbcf801f020 con 0x5573b2d54bd0 2024-09-22T08:36:43.998 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.993+0000 7fbbe2ffd640 1 --2- 172.21.15.142:0/1564543410 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fbbd403cfb0 0x7fbbd403f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:43.998 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.993+0000 7fbbe2ffd640 1 -- 172.21.15.142:0/1564543410 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fbcf80555f0 con 0x5573b2d54bd0 2024-09-22T08:36:43.998 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.993+0000 7fbcfd6d6640 1 --2- 172.21.15.142:0/1564543410 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fbbd403cfb0 0x7fbbd403f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:43.998 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.994+0000 7fbd01928800 1 Processor -- start 2024-09-22T08:36:43.998 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.994+0000 7fbd01928800 1 -- start start 2024-09-22T08:36:43.998 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.994+0000 7fbcfd6d6640 1 --2- 172.21.15.142:0/1564543410 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fbbd403cfb0 0x7fbbd403f470 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x5573b2d465a0 tx=0x7fbcf0006820 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:43.998 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.994+0000 7fbd01928800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5573b2c41840 0x5573b2c41c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:43.998 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.994+0000 7fbd01928800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5573b2d32a40 con 0x5573b2c41840 2024-09-22T08:36:43.998 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.994+0000 7fbcfded7640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5573b2c41840 0x5573b2c41c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:43.999 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.994+0000 7fbcfded7640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5573b2c41840 0x5573b2c41c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:38476/0 (socket says 172.21.15.142:38476) 2024-09-22T08:36:43.999 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.994+0000 7fbcfded7640 1 -- 172.21.15.142:0/2435998098 learned_addr learned my addr 172.21.15.142:0/2435998098 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:43.999 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.994+0000 7fbcfded7640 1 -- 172.21.15.142:0/2435998098 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5573b2c42230 con 0x5573b2c41840 2024-09-22T08:36:43.999 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.995+0000 7fbcfded7640 1 --2- 172.21.15.142:0/2435998098 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5573b2c41840 0x5573b2c41c40 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fbcf8007760 tx=0x7fbcf80133e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=922d1542d2ebcfda server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:43.999 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.995+0000 7fbbe0ff9640 1 -- 172.21.15.142:0/2435998098 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbcf80203b0 con 0x5573b2c41840 2024-09-22T08:36:43.999 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.995+0000 7fbbe0ff9640 1 -- 172.21.15.142:0/2435998098 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbcf8016c50 con 0x5573b2c41840 2024-09-22T08:36:43.999 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.995+0000 7fbbe0ff9640 1 -- 172.21.15.142:0/2435998098 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbcf8020550 con 0x5573b2c41840 2024-09-22T08:36:43.999 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.995+0000 7fbd01928800 1 -- 172.21.15.142:0/2435998098 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5573b2c41840 msgr2=0x5573b2c41c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:43.999 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.995+0000 7fbd01928800 1 --2- 172.21.15.142:0/2435998098 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5573b2c41840 0x5573b2c41c40 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fbcf8007760 tx=0x7fbcf80133e0 comp rx=0 tx=0).stop 2024-09-22T08:36:43.999 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.995+0000 7fbd01928800 1 -- 172.21.15.142:0/2435998098 shutdown_connections 2024-09-22T08:36:44.000 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.995+0000 7fbd01928800 1 --2- 172.21.15.142:0/2435998098 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5573b2c41840 0x5573b2c41c40 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:44.000 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.995+0000 7fbd01928800 1 -- 172.21.15.142:0/2435998098 >> 172.21.15.142:0/2435998098 conn(0x5573b2d5da90 msgr2=0x5573b2d5bcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:44.000 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.995+0000 7fbd01928800 1 -- 172.21.15.142:0/2435998098 shutdown_connections 2024-09-22T08:36:44.000 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.995+0000 7fbd01928800 1 -- 172.21.15.142:0/2435998098 wait complete. 2024-09-22T08:36:44.000 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.996+0000 7fbd01928800 1 Processor -- start 2024-09-22T08:36:44.000 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.996+0000 7fbd01928800 1 -- start start 2024-09-22T08:36:44.000 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.996+0000 7fbd01928800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5573b2c41840 0x5573b2d6ae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:44.001 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.996+0000 7fbd01928800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5573b2c428a0 con 0x5573b2c41840 2024-09-22T08:36:44.001 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.996+0000 7fbcfded7640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5573b2c41840 0x5573b2d6ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:44.001 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.996+0000 7fbcfded7640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5573b2c41840 0x5573b2d6ae20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:38480/0 (socket says 172.21.15.142:38480) 2024-09-22T08:36:44.001 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.996+0000 7fbcfded7640 1 -- 172.21.15.142:0/798216012 learned_addr learned my addr 172.21.15.142:0/798216012 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:44.032 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.996+0000 7fbcfded7640 1 -- 172.21.15.142:0/798216012 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5573b2d6b380 con 0x5573b2c41840 2024-09-22T08:36:44.032 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.997+0000 7fbcfded7640 1 --2- 172.21.15.142:0/798216012 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5573b2c41840 0x5573b2d6ae20 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fbcf8013a90 tx=0x7fbcf8053a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:44.032 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.997+0000 7fbbd2ffd640 1 -- 172.21.15.142:0/798216012 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbcf802f070 con 0x5573b2c41840 2024-09-22T08:36:44.032 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.997+0000 7fbbd2ffd640 1 -- 172.21.15.142:0/798216012 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbcf800b030 con 0x5573b2c41840 2024-09-22T08:36:44.032 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.997+0000 7fbbd2ffd640 1 -- 172.21.15.142:0/798216012 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbcf800b350 con 0x5573b2c41840 2024-09-22T08:36:44.032 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.997+0000 7fbd01928800 1 -- 172.21.15.142:0/798216012 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5573b2d6b610 con 0x5573b2c41840 2024-09-22T08:36:44.032 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.997+0000 7fbd01928800 1 -- 172.21.15.142:0/798216012 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5573b2d6b610 con 0x5573b2c41840 2024-09-22T08:36:44.032 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.997+0000 7fbbd2ffd640 1 -- 172.21.15.142:0/798216012 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fbcf8032070 con 0x5573b2c41840 2024-09-22T08:36:44.032 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.998+0000 7fbbd2ffd640 1 --2- 172.21.15.142:0/798216012 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fbbc803d000 0x7fbbc803f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:44.032 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.998+0000 7fbbd2ffd640 1 -- 172.21.15.142:0/798216012 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fbcf803d010 con 0x5573b2c41840 2024-09-22T08:36:44.032 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.998+0000 7fbcfd6d6640 1 --2- 172.21.15.142:0/798216012 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fbbc803d000 0x7fbbc803f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:44.033 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.998+0000 7fbcfd6d6640 1 --2- 172.21.15.142:0/798216012 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fbbc803d000 0x7fbbc803f4c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fbcf0014fd0 tx=0x7fbcf0032000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:44.033 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.998+0000 7fbd01928800 20 rados->read ofs=0 len=0 2024-09-22T08:36:44.033 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.998+0000 7fbd01928800 1 --2- 172.21.15.142:0/798216012 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5573b2d76570 0x5573b2d78a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:44.033 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.998+0000 7fbd01928800 1 -- 172.21.15.142:0/798216012 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5573b2d79180 con 0x5573b2d76570 2024-09-22T08:36:44.033 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.998+0000 7fbcfced5640 1 --2- 172.21.15.142:0/798216012 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5573b2d76570 0x5573b2d78a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:44.033 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.999+0000 7fbcfced5640 1 --2- 172.21.15.142:0/798216012 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5573b2d76570 0x5573b2d78a30 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:44.033 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.999+0000 7fbcfced5640 1 -- 172.21.15.142:0/798216012 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbce8051070 con 0x5573b2d76570 2024-09-22T08:36:44.033 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.999+0000 7fbd01928800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:44.033 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.999+0000 7fbd01928800 20 realm 2024-09-22T08:36:44.033 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.999+0000 7fbd01928800 20 rados->read ofs=0 len=0 2024-09-22T08:36:44.033 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.999+0000 7fbd01928800 1 -- 172.21.15.142:0/798216012 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5573b2d795b0 con 0x5573b2d76570 2024-09-22T08:36:44.033 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.999+0000 7fbcfced5640 1 -- 172.21.15.142:0/798216012 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbce8051070 con 0x5573b2d76570 2024-09-22T08:36:44.033 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.999+0000 7fbd01928800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:44.033 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.999+0000 7fbd01928800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:36:44.034 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.999+0000 7fbd01928800 20 rados->read ofs=0 len=0 2024-09-22T08:36:44.034 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.999+0000 7fbd01928800 1 -- 172.21.15.142:0/798216012 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5573b2d79e80 con 0x5573b2d76570 2024-09-22T08:36:44.034 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.999+0000 7fbcfced5640 1 -- 172.21.15.142:0/798216012 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbce8051070 con 0x5573b2d76570 2024-09-22T08:36:44.034 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.999+0000 7fbd01928800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:44.034 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.999+0000 7fbd01928800 20 rados->read ofs=0 len=0 2024-09-22T08:36:44.034 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:43.999+0000 7fbd01928800 1 -- 172.21.15.142:0/798216012 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5573b2d7a220 con 0x5573b2d76570 2024-09-22T08:36:44.034 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.000+0000 7fbcfced5640 1 -- 172.21.15.142:0/798216012 <== osd.1 v2:172.21.15.142:6816/3192108003 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbce8051070 con 0x5573b2d76570 2024-09-22T08:36:44.034 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.000+0000 7fbd01928800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:36:44.034 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.000+0000 7fbd01928800 20 rados->read ofs=0 len=0 2024-09-22T08:36:44.034 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.000+0000 7fbd01928800 1 --2- 172.21.15.142:0/798216012 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5573b2d7af80 0x5573b2d7d370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:44.034 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.000+0000 7fbd01928800 1 -- 172.21.15.142:0/798216012 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5573b2d7d980 con 0x5573b2d7af80 2024-09-22T08:36:44.034 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.000+0000 7fbcfded7640 1 --2- 172.21.15.142:0/798216012 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5573b2d7af80 0x5573b2d7d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:44.034 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.000+0000 7fbcfded7640 1 --2- 172.21.15.142:0/798216012 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5573b2d7af80 0x5573b2d7d370 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:44.035 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.000+0000 7fbcfded7640 1 -- 172.21.15.142:0/798216012 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(5 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fbcf8031030 con 0x5573b2d7af80 2024-09-22T08:36:44.035 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.000+0000 7fbd01928800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:36:44.035 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.000+0000 7fbd01928800 20 searching for the correct realm 2024-09-22T08:36:44.035 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.000+0000 7fbd01928800 1 -- 172.21.15.142:0/798216012 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5573b2d7f2b0 con 0x5573b2d7af80 2024-09-22T08:36:44.035 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.000+0000 7fbcfded7640 1 -- 172.21.15.142:0/798216012 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbcf8031030 con 0x5573b2d7af80 2024-09-22T08:36:44.035 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.000+0000 7fbcfded7640 1 --2- 172.21.15.142:0/798216012 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7fbcf8034060 0x7fbcf802a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:44.035 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.000+0000 7fbcfded7640 1 -- 172.21.15.142:0/798216012 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5573b2d7f2b0 con 0x7fbcf8034060 2024-09-22T08:36:44.035 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.001+0000 7fbcfd6d6640 1 --2- 172.21.15.142:0/798216012 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7fbcf8034060 0x7fbcf802a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:44.035 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.001+0000 7fbcfd6d6640 1 --2- 172.21.15.142:0/798216012 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7fbcf8034060 0x7fbcf802a440 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:44.035 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.001+0000 7fbcfd6d6640 1 -- 172.21.15.142:0/798216012 <== osd.2 v2:172.21.15.142:6808/279438927 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbcf001b070 con 0x7fbcf8034060 2024-09-22T08:36:44.035 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.001+0000 7fbcfd6d6640 1 --2- 172.21.15.142:0/798216012 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7fbcf0027020 0x7fbcf001e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:44.035 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.001+0000 7fbcfd6d6640 1 -- 172.21.15.142:0/798216012 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5573b2d7f2b0 con 0x7fbcf0027020 2024-09-22T08:36:44.035 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.001+0000 7fbcfced5640 1 --2- 172.21.15.142:0/798216012 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7fbcf0027020 0x7fbcf001e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:44.035 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.002+0000 7fbcfced5640 1 --2- 172.21.15.142:0/798216012 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7fbcf0027020 0x7fbcf001e3f0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:44.036 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.002+0000 7fbcfced5640 1 -- 172.21.15.142:0/798216012 <== osd.0 v2:172.21.15.31:6800/168281188 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbce8051070 con 0x7fbcf0027020 2024-09-22T08:36:44.036 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.002+0000 7fbcfced5640 1 -- 172.21.15.142:0/798216012 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5573b2d7f2b0 con 0x5573b2d76570 2024-09-22T08:36:44.036 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.002+0000 7fbcfced5640 1 -- 172.21.15.142:0/798216012 <== osd.1 v2:172.21.15.142:6816/3192108003 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbce8051070 con 0x5573b2d76570 2024-09-22T08:36:44.036 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.002+0000 7fbcfced5640 1 -- 172.21.15.142:0/798216012 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5573b2d7f2b0 con 0x5573b2d76570 2024-09-22T08:36:44.036 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.002+0000 7fbcfced5640 1 -- 172.21.15.142:0/798216012 <== osd.1 v2:172.21.15.142:6816/3192108003 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbce8051070 con 0x5573b2d76570 2024-09-22T08:36:44.036 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.002+0000 7fbcfced5640 1 -- 172.21.15.142:0/798216012 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5573b2d7f2b0 con 0x7fbcf0027020 2024-09-22T08:36:44.036 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.003+0000 7fbcfced5640 1 -- 172.21.15.142:0/798216012 <== osd.0 v2:172.21.15.31:6800/168281188 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbce8051070 con 0x7fbcf0027020 2024-09-22T08:36:44.036 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.003+0000 7fbcfced5640 1 -- 172.21.15.142:0/798216012 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5573b2d7f2b0 con 0x7fbcf0027020 2024-09-22T08:36:44.036 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.003+0000 7fbcfced5640 1 -- 172.21.15.142:0/798216012 <== osd.0 v2:172.21.15.31:6800/168281188 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbce8051070 con 0x7fbcf0027020 2024-09-22T08:36:44.036 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.003+0000 7fbcfced5640 1 -- 172.21.15.142:0/798216012 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5573b2d7f2b0 con 0x7fbcf8034060 2024-09-22T08:36:44.036 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.003+0000 7fbcfd6d6640 1 -- 172.21.15.142:0/798216012 <== osd.2 v2:172.21.15.142:6808/279438927 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbcf001b070 con 0x7fbcf8034060 2024-09-22T08:36:44.036 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.003+0000 7fbcfd6d6640 1 -- 172.21.15.142:0/798216012 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5573b2d7f2b0 con 0x5573b2d7af80 2024-09-22T08:36:44.036 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.003+0000 7fbcfded7640 1 -- 172.21.15.142:0/798216012 <== osd.3 v2:172.21.15.142:6800/1064901393 3 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbcf8031030 con 0x5573b2d7af80 2024-09-22T08:36:44.036 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.003+0000 7fbcfded7640 1 -- 172.21.15.142:0/798216012 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5573b2d7f2b0 con 0x5573b2d76570 2024-09-22T08:36:44.036 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.004+0000 7fbcfced5640 1 -- 172.21.15.142:0/798216012 <== osd.1 v2:172.21.15.142:6816/3192108003 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbce8051070 con 0x5573b2d76570 2024-09-22T08:36:44.037 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.004+0000 7fbcfced5640 1 -- 172.21.15.142:0/798216012 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5573b2d7f2b0 con 0x7fbcf0027020 2024-09-22T08:36:44.037 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.004+0000 7fbcfced5640 1 -- 172.21.15.142:0/798216012 <== osd.0 v2:172.21.15.31:6800/168281188 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbce8051070 con 0x7fbcf0027020 2024-09-22T08:36:44.037 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.004+0000 7fbcfced5640 1 -- 172.21.15.142:0/798216012 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5573b2d7f2b0 con 0x5573b2d76570 2024-09-22T08:36:44.037 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.004+0000 7fbcfced5640 1 -- 172.21.15.142:0/798216012 <== osd.1 v2:172.21.15.142:6816/3192108003 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbce8051070 con 0x5573b2d76570 2024-09-22T08:36:44.037 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.004+0000 7fbcfced5640 1 -- 172.21.15.142:0/798216012 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5573b2d7f2b0 con 0x7fbcf8034060 2024-09-22T08:36:44.037 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.004+0000 7fbcfd6d6640 1 -- 172.21.15.142:0/798216012 <== osd.2 v2:172.21.15.142:6808/279438927 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fbcf001b070 con 0x7fbcf8034060 2024-09-22T08:36:44.037 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.004+0000 7fbcfd6d6640 1 -- 172.21.15.142:0/798216012 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5573b2d7f2b0 con 0x5573b2d7af80 2024-09-22T08:36:44.037 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.004+0000 7fbcfded7640 1 -- 172.21.15.142:0/798216012 <== osd.3 v2:172.21.15.142:6800/1064901393 4 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbcf8031030 con 0x5573b2d7af80 2024-09-22T08:36:44.037 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.004+0000 7fbcfded7640 1 -- 172.21.15.142:0/798216012 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5573b2d7f2b0 con 0x5573b2d7af80 2024-09-22T08:36:44.037 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.005+0000 7fbcfded7640 1 -- 172.21.15.142:0/798216012 <== osd.3 v2:172.21.15.142:6800/1064901393 5 ==== osd_op_reply(20 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fbcf8031030 con 0x5573b2d7af80 2024-09-22T08:36:44.037 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.005+0000 7fbcfded7640 1 -- 172.21.15.142:0/798216012 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5573b2d7f2b0 con 0x7fbcf0027020 2024-09-22T08:36:44.037 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.005+0000 7fbcfced5640 1 -- 172.21.15.142:0/798216012 <== osd.0 v2:172.21.15.31:6800/168281188 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbce8051070 con 0x7fbcf0027020 2024-09-22T08:36:44.038 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.005+0000 7fbcfced5640 1 -- 172.21.15.142:0/798216012 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5573b2d7f2b0 con 0x5573b2d7af80 2024-09-22T08:36:44.038 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.005+0000 7fbcfded7640 1 -- 172.21.15.142:0/798216012 <== osd.3 v2:172.21.15.142:6800/1064901393 6 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbcf8031030 con 0x5573b2d7af80 2024-09-22T08:36:44.038 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.005+0000 7fbcfded7640 1 -- 172.21.15.142:0/798216012 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5573b2d7f2b0 con 0x5573b2d7af80 2024-09-22T08:36:44.038 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.005+0000 7fbcfded7640 1 -- 172.21.15.142:0/798216012 <== osd.3 v2:172.21.15.142:6800/1064901393 7 ==== osd_op_reply(23 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fbcf8031030 con 0x5573b2d7af80 2024-09-22T08:36:44.038 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.005+0000 7fbcfded7640 1 -- 172.21.15.142:0/798216012 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5573b2d7f2b0 con 0x5573b2d76570 2024-09-22T08:36:44.038 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.006+0000 7fbcfced5640 1 -- 172.21.15.142:0/798216012 <== osd.1 v2:172.21.15.142:6816/3192108003 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbce8051070 con 0x5573b2d76570 2024-09-22T08:36:44.038 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.006+0000 7fbcfced5640 1 -- 172.21.15.142:0/798216012 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5573b2d7f2b0 con 0x5573b2d76570 2024-09-22T08:36:44.038 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.006+0000 7fbcfced5640 1 -- 172.21.15.142:0/798216012 <== osd.1 v2:172.21.15.142:6816/3192108003 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fbce8051070 con 0x5573b2d76570 2024-09-22T08:36:44.038 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.006+0000 7fbcfced5640 1 -- 172.21.15.142:0/798216012 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5573b2d7f2b0 con 0x7fbcf0027020 2024-09-22T08:36:44.038 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.006+0000 7fbcfced5640 1 -- 172.21.15.142:0/798216012 <== osd.0 v2:172.21.15.31:6800/168281188 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbce8051070 con 0x7fbcf0027020 2024-09-22T08:36:44.038 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.006+0000 7fbcfced5640 1 -- 172.21.15.142:0/798216012 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5573b2d7f2b0 con 0x5573b2d7af80 2024-09-22T08:36:44.038 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.006+0000 7fbcfded7640 1 -- 172.21.15.142:0/798216012 <== osd.3 v2:172.21.15.142:6800/1064901393 8 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbcf8031030 con 0x5573b2d7af80 2024-09-22T08:36:44.039 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.006+0000 7fbcfded7640 1 -- 172.21.15.142:0/798216012 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5573b2d7f2b0 con 0x7fbcf8034060 2024-09-22T08:36:44.039 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.006+0000 7fbcfd6d6640 1 -- 172.21.15.142:0/798216012 <== osd.2 v2:172.21.15.142:6808/279438927 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbcf001b070 con 0x7fbcf8034060 2024-09-22T08:36:44.039 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.006+0000 7fbcfd6d6640 1 -- 172.21.15.142:0/798216012 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5573b2d7f2b0 con 0x5573b2d76570 2024-09-22T08:36:44.039 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.007+0000 7fbcfced5640 1 -- 172.21.15.142:0/798216012 <== osd.1 v2:172.21.15.142:6816/3192108003 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbce8051070 con 0x5573b2d76570 2024-09-22T08:36:44.039 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.007+0000 7fbcfced5640 1 -- 172.21.15.142:0/798216012 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5573b2d7f2b0 con 0x7fbcf0027020 2024-09-22T08:36:44.039 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.007+0000 7fbcfced5640 1 -- 172.21.15.142:0/798216012 <== osd.0 v2:172.21.15.31:6800/168281188 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbce8051070 con 0x7fbcf0027020 2024-09-22T08:36:44.039 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.007+0000 7fbcfced5640 1 -- 172.21.15.142:0/798216012 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5573b2d7f2b0 con 0x5573b2d7af80 2024-09-22T08:36:44.039 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.007+0000 7fbcfded7640 1 -- 172.21.15.142:0/798216012 <== osd.3 v2:172.21.15.142:6800/1064901393 9 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbcf8031030 con 0x5573b2d7af80 2024-09-22T08:36:44.039 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.007+0000 7fbcfded7640 1 -- 172.21.15.142:0/798216012 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5573b2d7f2b0 con 0x7fbcf0027020 2024-09-22T08:36:44.039 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.007+0000 7fbcfced5640 1 -- 172.21.15.142:0/798216012 <== osd.0 v2:172.21.15.31:6800/168281188 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbce8051070 con 0x7fbcf0027020 2024-09-22T08:36:44.039 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.007+0000 7fbcfced5640 1 -- 172.21.15.142:0/798216012 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5573b2d7f2b0 con 0x7fbcf8034060 2024-09-22T08:36:44.039 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.008+0000 7fbcfd6d6640 1 -- 172.21.15.142:0/798216012 <== osd.2 v2:172.21.15.142:6808/279438927 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbcf001b070 con 0x7fbcf8034060 2024-09-22T08:36:44.039 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.008+0000 7fbcfd6d6640 1 -- 172.21.15.142:0/798216012 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5573b2d7f2b0 con 0x5573b2d7af80 2024-09-22T08:36:44.040 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.008+0000 7fbcfded7640 1 -- 172.21.15.142:0/798216012 <== osd.3 v2:172.21.15.142:6800/1064901393 10 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbcf8031030 con 0x5573b2d7af80 2024-09-22T08:36:44.040 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.008+0000 7fbcfded7640 1 -- 172.21.15.142:0/798216012 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5573b2d7f2b0 con 0x7fbcf0027020 2024-09-22T08:36:44.040 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.008+0000 7fbcfced5640 1 -- 172.21.15.142:0/798216012 <== osd.0 v2:172.21.15.31:6800/168281188 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbce8051070 con 0x7fbcf0027020 2024-09-22T08:36:44.040 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.008+0000 7fbcfced5640 1 -- 172.21.15.142:0/798216012 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5573b2d7f2b0 con 0x5573b2d76570 2024-09-22T08:36:44.040 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.008+0000 7fbcfced5640 1 -- 172.21.15.142:0/798216012 <== osd.1 v2:172.21.15.142:6816/3192108003 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fbce8051070 con 0x5573b2d76570 2024-09-22T08:36:44.040 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.008+0000 7fbcfced5640 1 -- 172.21.15.142:0/798216012 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5573b2d7f2b0 con 0x7fbcf8034060 2024-09-22T08:36:44.040 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.009+0000 7fbcfd6d6640 1 -- 172.21.15.142:0/798216012 <== osd.2 v2:172.21.15.142:6808/279438927 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbcf001b070 con 0x7fbcf8034060 2024-09-22T08:36:44.040 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.009+0000 7fbd01928800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:36:44.040 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.009+0000 7fbd01928800 20 RGWRados::pool_iterate: got zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec 2024-09-22T08:36:44.040 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.009+0000 7fbd01928800 20 RGWRados::pool_iterate: got zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f 2024-09-22T08:36:44.040 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.009+0000 7fbd01928800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:36:44.040 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.009+0000 7fbd01928800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:36:44.040 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.009+0000 7fbd01928800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:36:44.041 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.009+0000 7fbd01928800 20 rados->read ofs=0 len=0 2024-09-22T08:36:44.041 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.009+0000 7fbd01928800 1 -- 172.21.15.142:0/798216012 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5573b2d7e370 con 0x5573b2d76570 2024-09-22T08:36:44.041 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.009+0000 7fbcfced5640 1 -- 172.21.15.142:0/798216012 <== osd.1 v2:172.21.15.142:6816/3192108003 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbce8051070 con 0x5573b2d76570 2024-09-22T08:36:44.041 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.009+0000 7fbd01928800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:44.041 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.009+0000 7fbd01928800 20 rados->read ofs=0 len=0 2024-09-22T08:36:44.041 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.009+0000 7fbd01928800 1 -- 172.21.15.142:0/798216012 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5573b2d7ebc0 con 0x5573b2d76570 2024-09-22T08:36:44.041 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.009+0000 7fbcfced5640 1 -- 172.21.15.142:0/798216012 <== osd.1 v2:172.21.15.142:6816/3192108003 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbce8051070 con 0x5573b2d76570 2024-09-22T08:36:44.041 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.009+0000 7fbd01928800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:36:44.041 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.009+0000 7fbd01928800 20 rados->read ofs=0 len=0 2024-09-22T08:36:44.041 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.009+0000 7fbd01928800 1 -- 172.21.15.142:0/798216012 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:40 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5573b2d7f730 con 0x5573b2d7af80 2024-09-22T08:36:44.041 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.009+0000 7fbcfded7640 1 -- 172.21.15.142:0/798216012 <== osd.3 v2:172.21.15.142:6800/1064901393 11 ==== osd_op_reply(40 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fbcf8031030 con 0x5573b2d7af80 2024-09-22T08:36:44.041 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.009+0000 7fbd01928800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:36:44.041 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.009+0000 7fbd01928800 20 zone default found 2024-09-22T08:36:44.041 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.009+0000 7fbd01928800 4 Realm: () 2024-09-22T08:36:44.041 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.009+0000 7fbd01928800 4 ZoneGroup: default (d89f6f57-1007-47dd-9065-f486c7b01aec) 2024-09-22T08:36:44.042 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.009+0000 7fbd01928800 4 Zone: default (e239248c-0bee-4e41-803a-24b288d3eb8f) 2024-09-22T08:36:44.042 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.009+0000 7fbd01928800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:36:44.042 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.009+0000 7fbd01928800 20 zonegroup default 2024-09-22T08:36:44.042 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.009+0000 7fbd01928800 20 rados->read ofs=0 len=0 2024-09-22T08:36:44.042 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.009+0000 7fbd01928800 1 -- 172.21.15.142:0/798216012 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5573b2d7fb40 con 0x7fbcf0027020 2024-09-22T08:36:44.042 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.010+0000 7fbcfced5640 1 -- 172.21.15.142:0/798216012 <== osd.0 v2:172.21.15.31:6800/168281188 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fbce8051070 con 0x7fbcf0027020 2024-09-22T08:36:44.042 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.010+0000 7fbd01928800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:44.042 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.010+0000 7fbd01928800 20 rados->read ofs=0 len=0 2024-09-22T08:36:44.042 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.010+0000 7fbd01928800 1 -- 172.21.15.142:0/798216012 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5573b2d81e20 con 0x5573b2d7af80 2024-09-22T08:36:44.042 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.010+0000 7fbcfded7640 1 -- 172.21.15.142:0/798216012 <== osd.3 v2:172.21.15.142:6800/1064901393 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbcf8031030 con 0x5573b2d7af80 2024-09-22T08:36:44.042 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.010+0000 7fbd01928800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:44.042 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.010+0000 7fbd01928800 20 rados->read ofs=0 len=0 2024-09-22T08:36:44.042 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.010+0000 7fbd01928800 1 -- 172.21.15.142:0/798216012 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5573b2d821f0 con 0x5573b2d7af80 2024-09-22T08:36:44.043 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.010+0000 7fbcfded7640 1 -- 172.21.15.142:0/798216012 <== osd.3 v2:172.21.15.142:6800/1064901393 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbcf8031030 con 0x5573b2d7af80 2024-09-22T08:36:44.043 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.010+0000 7fbd01928800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:44.043 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.010+0000 7fbd01928800 20 started sync module instance, tier type = 2024-09-22T08:36:44.043 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.010+0000 7fbd01928800 20 started zone id=e239248c-0bee-4e41-803a-24b288d3eb8f (name=default) with tier type = 2024-09-22T08:36:44.043 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.010+0000 7fbd01928800 1 -- 172.21.15.142:0/798216012 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5573b2d81260 con 0x7fbcf8034060 2024-09-22T08:36:44.043 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.011+0000 7fbcfd6d6640 1 -- 172.21.15.142:0/798216012 <== osd.2 v2:172.21.15.142:6808/279438927 7 ==== osd_op_reply(44 notify.0 [create] v30'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbcf001b070 con 0x7fbcf8034060 2024-09-22T08:36:44.043 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.011+0000 7fbd01928800 1 -- 172.21.15.142:0/798216012 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93955410103728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5573b2d82650 con 0x7fbcf8034060 2024-09-22T08:36:44.043 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.011+0000 7fbd01928800 1 -- 172.21.15.142:0/798216012 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5573b2d82ea0 con 0x5573b2d76570 2024-09-22T08:36:44.043 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.012+0000 7fbcfd6d6640 1 -- 172.21.15.142:0/798216012 <== osd.2 v2:172.21.15.142:6808/279438927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93955410103728] v30'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbcf001b070 con 0x7fbcf8034060 2024-09-22T08:36:44.043 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.013+0000 7fbcfced5640 1 -- 172.21.15.142:0/798216012 <== osd.1 v2:172.21.15.142:6816/3192108003 15 ==== osd_op_reply(46 notify.1 [create] v30'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbce8051070 con 0x5573b2d76570 2024-09-22T08:36:44.043 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.013+0000 7fbd01928800 1 -- 172.21.15.142:0/798216012 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93955410110960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5573b2d832c0 con 0x5573b2d76570 2024-09-22T08:36:44.043 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.013+0000 7fbd01928800 1 -- 172.21.15.142:0/798216012 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5573b2d83b10 con 0x5573b2d7af80 2024-09-22T08:36:44.043 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.013+0000 7fbcfced5640 1 -- 172.21.15.142:0/798216012 <== osd.1 v2:172.21.15.142:6816/3192108003 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93955410110960] v30'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbce8051070 con 0x5573b2d76570 2024-09-22T08:36:44.043 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.014+0000 7fbcfded7640 1 -- 172.21.15.142:0/798216012 <== osd.3 v2:172.21.15.142:6800/1064901393 14 ==== osd_op_reply(48 notify.2 [create] v30'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbcf8031030 con 0x5573b2d7af80 2024-09-22T08:36:44.043 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.014+0000 7fbd01928800 1 -- 172.21.15.142:0/798216012 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93955410112496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5573b2d839e0 con 0x5573b2d7af80 2024-09-22T08:36:44.044 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.014+0000 7fbd01928800 1 -- 172.21.15.142:0/798216012 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5573b2d84500 con 0x7fbcf8034060 2024-09-22T08:36:44.044 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.015+0000 7fbcfded7640 1 -- 172.21.15.142:0/798216012 <== osd.3 v2:172.21.15.142:6800/1064901393 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 93955410112496] v30'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbcf8031030 con 0x5573b2d7af80 2024-09-22T08:36:44.044 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.015+0000 7fbcfd6d6640 1 -- 172.21.15.142:0/798216012 <== osd.2 v2:172.21.15.142:6808/279438927 9 ==== osd_op_reply(50 notify.3 [create] v30'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbcf001b070 con 0x7fbcf8034060 2024-09-22T08:36:44.044 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.015+0000 7fbd01928800 1 -- 172.21.15.142:0/798216012 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93955410116560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5573b2d848f0 con 0x7fbcf8034060 2024-09-22T08:36:44.044 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.015+0000 7fbd01928800 1 -- 172.21.15.142:0/798216012 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5573b2d85360 con 0x5573b2d76570 2024-09-22T08:36:44.044 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.016+0000 7fbcfd6d6640 1 -- 172.21.15.142:0/798216012 <== osd.2 v2:172.21.15.142:6808/279438927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93955410116560] v30'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbcf001b070 con 0x7fbcf8034060 2024-09-22T08:36:44.044 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.016+0000 7fbcfced5640 1 -- 172.21.15.142:0/798216012 <== osd.1 v2:172.21.15.142:6816/3192108003 17 ==== osd_op_reply(52 notify.4 [create] v30'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbce8051070 con 0x5573b2d76570 2024-09-22T08:36:44.044 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.016+0000 7fbd01928800 1 -- 172.21.15.142:0/798216012 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93955410120240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5573b2d85320 con 0x5573b2d76570 2024-09-22T08:36:44.044 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.016+0000 7fbd01928800 1 -- 172.21.15.142:0/798216012 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5573b2d85e10 con 0x7fbcf0027020 2024-09-22T08:36:44.044 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.017+0000 7fbcfced5640 1 -- 172.21.15.142:0/798216012 <== osd.0 v2:172.21.15.31:6800/168281188 11 ==== osd_op_reply(54 notify.5 [create] v30'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbce8051070 con 0x7fbcf0027020 2024-09-22T08:36:44.044 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.017+0000 7fbd01928800 1 -- 172.21.15.142:0/798216012 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93955410123040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5573b2d85e10 con 0x7fbcf0027020 2024-09-22T08:36:44.044 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.017+0000 7fbd01928800 1 -- 172.21.15.142:0/798216012 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5573b2d86db0 con 0x7fbcf0027020 2024-09-22T08:36:44.044 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.017+0000 7fbcfced5640 1 -- 172.21.15.142:0/798216012 <== osd.1 v2:172.21.15.142:6816/3192108003 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93955410120240] v30'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbce8051070 con 0x5573b2d76570 2024-09-22T08:36:44.044 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.018+0000 7fbcfced5640 1 -- 172.21.15.142:0/798216012 <== osd.0 v2:172.21.15.31:6800/168281188 12 ==== osd_op_reply(56 notify.6 [create] v30'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbce8051070 con 0x7fbcf0027020 2024-09-22T08:36:44.045 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.018+0000 7fbd01928800 1 -- 172.21.15.142:0/798216012 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93955410126976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5573b2d86d70 con 0x7fbcf0027020 2024-09-22T08:36:44.045 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.018+0000 7fbd01928800 1 -- 172.21.15.142:0/798216012 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5573b2d87790 con 0x7fbcf0027020 2024-09-22T08:36:44.045 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.018+0000 7fbcfced5640 1 -- 172.21.15.142:0/798216012 <== osd.0 v2:172.21.15.31:6800/168281188 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93955410123040] v30'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbce8051070 con 0x7fbcf0027020 2024-09-22T08:36:44.045 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.019+0000 7fbcfced5640 1 -- 172.21.15.142:0/798216012 <== osd.0 v2:172.21.15.31:6800/168281188 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93955410126976] v30'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbce8051070 con 0x7fbcf0027020 2024-09-22T08:36:44.045 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.019+0000 7fbcfced5640 1 -- 172.21.15.142:0/798216012 <== osd.0 v2:172.21.15.31:6800/168281188 15 ==== osd_op_reply(58 notify.7 [create] v30'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbce8051070 con 0x7fbcf0027020 2024-09-22T08:36:44.045 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.019+0000 7fbd01928800 1 -- 172.21.15.142:0/798216012 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93955410113616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5573b2d86200 con 0x7fbcf0027020 2024-09-22T08:36:44.045 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.019+0000 7fbd01928800 20 add_watcher() i=0 2024-09-22T08:36:44.045 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.019+0000 7fbd01928800 20 add_watcher() i=1 2024-09-22T08:36:44.045 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.019+0000 7fbd01928800 20 add_watcher() i=2 2024-09-22T08:36:44.045 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.019+0000 7fbd01928800 20 add_watcher() i=3 2024-09-22T08:36:44.045 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.019+0000 7fbd01928800 20 add_watcher() i=4 2024-09-22T08:36:44.045 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.019+0000 7fbd01928800 20 add_watcher() i=5 2024-09-22T08:36:44.045 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.019+0000 7fbd01928800 20 add_watcher() i=6 2024-09-22T08:36:44.046 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.020+0000 7fbcfced5640 1 -- 172.21.15.142:0/798216012 <== osd.0 v2:172.21.15.31:6800/168281188 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93955410113616] v30'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbce8051070 con 0x7fbcf0027020 2024-09-22T08:36:44.046 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.020+0000 7fbd01928800 20 add_watcher() i=7 2024-09-22T08:36:44.046 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.020+0000 7fbd01928800 2 all 8 watchers are set, enabling cache 2024-09-22T08:36:44.046 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.020+0000 7fbd01928800 1 -- 172.21.15.142:0/798216012 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5573b2d8a780 con 0x5573b2d76570 2024-09-22T08:36:44.046 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.020+0000 7fbcfced5640 1 -- 172.21.15.142:0/798216012 <== osd.1 v2:172.21.15.142:6816/3192108003 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fbce8051070 con 0x5573b2d76570 2024-09-22T08:36:44.046 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.020+0000 7fbd01928800 1 -- 172.21.15.142:0/798216012 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93955410129536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5573b2d87c30 con 0x5573b2d76570 2024-09-22T08:36:44.046 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.021+0000 7fbcfced5640 1 -- 172.21.15.142:0/798216012 <== osd.1 v2:172.21.15.142:6816/3192108003 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93955410129536] v30'70 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbce8051070 con 0x5573b2d76570 2024-09-22T08:36:44.046 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.021+0000 7fbbb37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:36:44.046 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.021+0000 7fbd01928800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:36:44.046 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.021+0000 7fbd01928800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:36:44.046 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.021+0000 7fbd01928800 5 note: GC not initialized 2024-09-22T08:36:44.046 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.022+0000 7fbbb27e4640 20 reqs_thread_entry: start 2024-09-22T08:36:44.047 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.022+0000 7fbd01928800 20 init_complete bucket index max shards: 11 2024-09-22T08:36:44.047 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.022+0000 7fbd01928800 20 Filter name: none 2024-09-22T08:36:44.047 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.022+0000 7fbb23fff640 20 reqs_thread_entry: start 2024-09-22T08:36:44.047 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.022+0000 7fbd01928800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-22T08:36:44.047 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.022+0000 7fbd01928800 20 rados->read ofs=0 len=0 2024-09-22T08:36:44.047 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.022+0000 7fbd01928800 1 -- 172.21.15.142:0/798216012 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5573b2dbda60 con 0x5573b2d76570 2024-09-22T08:36:44.047 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.022+0000 7fbcfced5640 1 -- 172.21.15.142:0/798216012 <== osd.1 v2:172.21.15.142:6816/3192108003 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fbce8051070 con 0x5573b2d76570 2024-09-22T08:36:44.047 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.022+0000 7fbd01928800 20 rados_obj.operate() r=0 bl.length=391 2024-09-22T08:36:44.047 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.022+0000 7fbd01928800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-22T08:36:44.047 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.022+0000 7fbd01928800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-22T08:36:44.047 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.022+0000 7fbd01928800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:36:44.047 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.023+0000 7fbd01928800 10 cache get: name=default.rgw.meta+users.swift+foo:foo1 : miss 2024-09-22T08:36:44.047 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.023+0000 7fbd01928800 20 rados->read ofs=0 len=0 2024-09-22T08:36:44.048 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.023+0000 7fbd01928800 1 -- 172.21.15.142:0/798216012 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:63 8.8 8:17d68d04:users.swift::foo%3afoo1:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5573b2dbe4d0 con 0x5573b2d76570 2024-09-22T08:36:44.048 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.023+0000 7fbcfced5640 1 -- 172.21.15.142:0/798216012 <== osd.1 v2:172.21.15.142:6816/3192108003 22 ==== osd_op_reply(63 foo:foo1 [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 194+0+0 (crc 0 0 0) 0x7fbce8051070 con 0x5573b2d76570 2024-09-22T08:36:44.048 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.023+0000 7fbd01928800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:44.048 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.023+0000 7fbd01928800 10 cache put: name=default.rgw.meta+users.swift+foo:foo1 info.flags=0x0 2024-09-22T08:36:44.048 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.023+0000 7fbd01928800 10 adding default.rgw.meta+users.swift+foo:foo1 to cache LRU end 2024-09-22T08:36:44.048 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.023+0000 7fbd01928800 10 cache get: name=default.rgw.meta+users.swift+foo:foo1 : hit (negative entry) 2024-09-22T08:36:44.048 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.023+0000 7fbd01928800 1 -- 172.21.15.142:0/798216012 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~556 in=556b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5573b2dc3ed0 con 0x5573b2d76570 2024-09-22T08:36:44.048 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.024+0000 7fbcfced5640 1 -- 172.21.15.142:0/798216012 <== osd.1 v2:172.21.15.142:6816/3192108003 23 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~556] v30'6 uv6 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fbce8051070 con 0x5573b2d76570 2024-09-22T08:36:44.048 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.024+0000 7fbd01928800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-22T08:36:44.048 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.024+0000 7fbd01928800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-22T08:36:44.048 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.024+0000 7fbd01928800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-22T08:36:44.048 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.024+0000 7fbd01928800 1 -- 172.21.15.142:0/798216012 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 93955410376912 in=744b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5573b2dbf4e0 con 0x5573b2d76570 2024-09-22T08:36:44.048 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.024+0000 7fbcfced5640 1 -- 172.21.15.142:0/798216012 <== osd.1 v2:172.21.15.142:6816/3192108003 24 ==== watch-notify(notify (1) cookie 93955410120240 notify 128849018885 ret 0) ==== 774+0+0 (crc 0 0 0) 0x7fbce8081040 con 0x5573b2d76570 2024-09-22T08:36:44.048 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.024+0000 7fbbe0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018885 cookie 93955410120240 notifier 4359 bl.length()=732 2024-09-22T08:36:44.049 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.024+0000 7fbbe0ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-22T08:36:44.049 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.024+0000 7fbbe0ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-22T08:36:44.049 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.024+0000 7fbbe0ff9640 1 -- 172.21.15.142:0/798216012 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7fbbc0003ea0 con 0x5573b2d76570 2024-09-22T08:36:44.049 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.024+0000 7fbcfced5640 1 -- 172.21.15.142:0/798216012 <== osd.1 v2:172.21.15.142:6816/3192108003 25 ==== osd_op_reply(65 notify.4 [notify cookie 93955410376912 out=8b] v0'0 uv54 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fbce8051070 con 0x5573b2d76570 2024-09-22T08:36:44.049 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.025+0000 7fbcfced5640 1 -- 172.21.15.142:0/798216012 <== osd.1 v2:172.21.15.142:6816/3192108003 26 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbce8051070 con 0x5573b2d76570 2024-09-22T08:36:44.049 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.025+0000 7fbcfced5640 1 -- 172.21.15.142:0/798216012 <== osd.1 v2:172.21.15.142:6816/3192108003 27 ==== watch-notify(notify_complete (2) cookie 93955410376912 notify 128849018885 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5573b2c4a590 con 0x5573b2d76570 2024-09-22T08:36:44.049 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.025+0000 7fbd01928800 1 -- 172.21.15.142:0/798216012 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:67 8.8 8:17d68d04:users.swift::foo%3afoo1:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5573b2dc38d0 con 0x5573b2d76570 2024-09-22T08:36:44.049 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.026+0000 7fbcfced5640 1 -- 172.21.15.142:0/798216012 <== osd.1 v2:172.21.15.142:6816/3192108003 28 ==== osd_op_reply(67 foo:foo1 [delete,create,writefull 0~7] v30'1 uv1 ondisk = 0) ==== 236+0+0 (crc 0 0 0) 0x7fbce8051070 con 0x5573b2d76570 2024-09-22T08:36:44.049 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.026+0000 7fbd01928800 10 cache put: name=default.rgw.meta+users.swift+foo:foo1 info.flags=0x7 2024-09-22T08:36:44.049 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.026+0000 7fbd01928800 10 moving default.rgw.meta+users.swift+foo:foo1 to cache LRU end 2024-09-22T08:36:44.049 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.026+0000 7fbd01928800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.swift:foo:foo1, ofs0, ns] 2024-09-22T08:36:44.049 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.026+0000 7fbd01928800 1 -- 172.21.15.142:0/798216012 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify cookie 93955410376912 in=178b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5573b2dbf030 con 0x7fbcf8034060 2024-09-22T08:36:44.049 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.026+0000 7fbcfd6d6640 1 -- 172.21.15.142:0/798216012 <== osd.2 v2:172.21.15.142:6808/279438927 11 ==== watch-notify(notify (1) cookie 93955410103728 notify 128849018882 ret 0) ==== 208+0+0 (crc 0 0 0) 0x7fbcf0052e30 con 0x7fbcf8034060 2024-09-22T08:36:44.050 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.026+0000 7fbbd3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018882 cookie 93955410103728 notifier 4359 bl.length()=166 2024-09-22T08:36:44.050 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.026+0000 7fbbd3fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.swift+foo:foo1 info.flags=0x7 2024-09-22T08:36:44.050 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.026+0000 7fbbd3fff640 10 rgw watcher librados: moving default.rgw.meta+users.swift+foo:foo1 to cache LRU end 2024-09-22T08:36:44.050 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.026+0000 7fbbd3fff640 1 -- 172.21.15.142:0/798216012 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:69 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7fbb30003400 con 0x7fbcf8034060 2024-09-22T08:36:44.050 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.026+0000 7fbcfd6d6640 1 -- 172.21.15.142:0/798216012 <== osd.2 v2:172.21.15.142:6808/279438927 12 ==== osd_op_reply(68 notify.0 [notify cookie 93955410376912 out=8b] v0'0 uv54 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fbcf001b070 con 0x7fbcf8034060 2024-09-22T08:36:44.050 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.026+0000 7fbcfd6d6640 1 -- 172.21.15.142:0/798216012 <== osd.2 v2:172.21.15.142:6808/279438927 13 ==== osd_op_reply(69 notify.0 [notify-ack] v0'0 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbcf001b070 con 0x7fbcf8034060 2024-09-22T08:36:44.050 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.026+0000 7fbcfd6d6640 1 -- 172.21.15.142:0/798216012 <== osd.2 v2:172.21.15.142:6808/279438927 14 ==== watch-notify(notify_complete (2) cookie 93955410376912 notify 128849018882 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5573b2d3ad80 con 0x7fbcf8034060 2024-09-22T08:36:44.050 INFO:teuthology.orchestra.run.smithi142.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-22T08:36:42.661297Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"td2vugNT3J2cFlOR6AvDF2W7anhkuGZGY3RhIE5a","active":true,"create_date":"2024-09-22T08:36:44.024160Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-22T08:36:42.661288Z","tags":[],"group_ids":[]} 2024-09-22T08:36:44.056 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.027+0000 7fbbb37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:36:44.056 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.027+0000 7fbd01928800 1 -- 172.21.15.142:0/798216012 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93955410129536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5573b2dbb780 con 0x5573b2d76570 2024-09-22T08:36:44.056 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.028+0000 7fbcfced5640 1 -- 172.21.15.142:0/798216012 <== osd.1 v2:172.21.15.142:6816/3192108003 29 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 93955410129536] v30'71 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbce8051070 con 0x5573b2d76570 2024-09-22T08:36:44.056 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.028+0000 7fbd01928800 1 -- 172.21.15.142:0/798216012 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93955410103728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5573b2dbb780 con 0x7fbcf8034060 2024-09-22T08:36:44.056 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.029+0000 7fbcfd6d6640 1 -- 172.21.15.142:0/798216012 <== osd.2 v2:172.21.15.142:6808/279438927 15 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 93955410103728] v30'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbcf001b070 con 0x7fbcf8034060 2024-09-22T08:36:44.056 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.029+0000 7fbd01928800 20 remove_watcher() i=0 2024-09-22T08:36:44.056 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.029+0000 7fbd01928800 2 removed watcher, disabling cache 2024-09-22T08:36:44.056 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.029+0000 7fbd01928800 1 -- 172.21.15.142:0/798216012 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93955410110960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5573b2dbb780 con 0x5573b2d76570 2024-09-22T08:36:44.056 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.031+0000 7fbcfced5640 1 -- 172.21.15.142:0/798216012 <== osd.1 v2:172.21.15.142:6816/3192108003 30 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 93955410110960] v30'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbce8051070 con 0x5573b2d76570 2024-09-22T08:36:44.056 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.031+0000 7fbd01928800 20 remove_watcher() i=1 2024-09-22T08:36:44.056 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.031+0000 7fbd01928800 1 -- 172.21.15.142:0/798216012 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93955410112496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5573b2dbb780 con 0x5573b2d7af80 2024-09-22T08:36:44.056 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.032+0000 7fbcfded7640 1 -- 172.21.15.142:0/798216012 <== osd.3 v2:172.21.15.142:6800/1064901393 16 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 93955410112496] v30'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbcf8031030 con 0x5573b2d7af80 2024-09-22T08:36:44.057 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.032+0000 7fbd01928800 20 remove_watcher() i=2 2024-09-22T08:36:44.057 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.032+0000 7fbd01928800 1 -- 172.21.15.142:0/798216012 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93955410116560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5573b2dbb780 con 0x7fbcf8034060 2024-09-22T08:36:44.057 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.033+0000 7fbcfd6d6640 1 -- 172.21.15.142:0/798216012 <== osd.2 v2:172.21.15.142:6808/279438927 16 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 93955410116560] v30'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbcf001b070 con 0x7fbcf8034060 2024-09-22T08:36:44.057 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.033+0000 7fbd01928800 20 remove_watcher() i=3 2024-09-22T08:36:44.057 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.033+0000 7fbd01928800 1 -- 172.21.15.142:0/798216012 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93955410120240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5573b2dbb780 con 0x5573b2d76570 2024-09-22T08:36:44.057 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.034+0000 7fbcfced5640 1 -- 172.21.15.142:0/798216012 <== osd.1 v2:172.21.15.142:6816/3192108003 31 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 93955410120240] v30'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbce8051070 con 0x5573b2d76570 2024-09-22T08:36:44.057 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.034+0000 7fbd01928800 20 remove_watcher() i=4 2024-09-22T08:36:44.057 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.034+0000 7fbd01928800 1 -- 172.21.15.142:0/798216012 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93955410123040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5573b2dbb780 con 0x7fbcf0027020 2024-09-22T08:36:44.057 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.035+0000 7fbcfced5640 1 -- 172.21.15.142:0/798216012 <== osd.0 v2:172.21.15.31:6800/168281188 17 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 93955410123040] v30'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbce8051070 con 0x7fbcf0027020 2024-09-22T08:36:44.057 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.035+0000 7fbd01928800 20 remove_watcher() i=5 2024-09-22T08:36:44.057 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.035+0000 7fbd01928800 1 -- 172.21.15.142:0/798216012 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93955410126976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5573b2dbb780 con 0x7fbcf0027020 2024-09-22T08:36:44.057 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.036+0000 7fbcfced5640 1 -- 172.21.15.142:0/798216012 <== osd.0 v2:172.21.15.31:6800/168281188 18 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 93955410126976] v30'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbce8051070 con 0x7fbcf0027020 2024-09-22T08:36:44.057 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.036+0000 7fbd01928800 20 remove_watcher() i=6 2024-09-22T08:36:44.058 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.037+0000 7fbd01928800 1 -- 172.21.15.142:0/798216012 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93955410113616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5573b2dbb780 con 0x7fbcf0027020 2024-09-22T08:36:44.058 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.037+0000 7fbcfced5640 1 -- 172.21.15.142:0/798216012 <== osd.0 v2:172.21.15.31:6800/168281188 19 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 93955410113616] v30'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbce8051070 con 0x7fbcf0027020 2024-09-22T08:36:44.058 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.037+0000 7fbd01928800 20 remove_watcher() i=7 2024-09-22T08:36:44.058 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.038+0000 7fbd01928800 1 -- 172.21.15.142:0/798216012 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7fbcf0027020 msgr2=0x7fbcf001e3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:44.058 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.038+0000 7fbd01928800 1 --2- 172.21.15.142:0/798216012 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7fbcf0027020 0x7fbcf001e3f0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:44.058 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.038+0000 7fbd01928800 1 -- 172.21.15.142:0/798216012 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5573b2d76570 msgr2=0x5573b2d78a30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:44.058 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.038+0000 7fbd01928800 1 --2- 172.21.15.142:0/798216012 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5573b2d76570 0x5573b2d78a30 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:44.058 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.038+0000 7fbd01928800 1 -- 172.21.15.142:0/798216012 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7fbcf8034060 msgr2=0x7fbcf802a440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:44.058 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.038+0000 7fbd01928800 1 --2- 172.21.15.142:0/798216012 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7fbcf8034060 0x7fbcf802a440 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:44.058 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.038+0000 7fbd01928800 1 -- 172.21.15.142:0/798216012 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5573b2d7af80 msgr2=0x5573b2d7d370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:44.058 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.038+0000 7fbd01928800 1 --2- 172.21.15.142:0/798216012 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5573b2d7af80 0x5573b2d7d370 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:44.059 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.038+0000 7fbd01928800 1 -- 172.21.15.142:0/798216012 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fbbc803d000 msgr2=0x7fbbc803f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:44.059 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.038+0000 7fbd01928800 1 --2- 172.21.15.142:0/798216012 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fbbc803d000 0x7fbbc803f4c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fbcf0014fd0 tx=0x7fbcf0032000 comp rx=0 tx=0).stop 2024-09-22T08:36:44.059 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.038+0000 7fbd01928800 1 -- 172.21.15.142:0/798216012 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5573b2c41840 msgr2=0x5573b2d6ae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:44.059 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.038+0000 7fbcfced5640 1 -- 172.21.15.142:0/798216012 reap_dead start 2024-09-22T08:36:44.059 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.038+0000 7fbd01928800 1 --2- 172.21.15.142:0/798216012 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5573b2c41840 0x5573b2d6ae20 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fbcf8013a90 tx=0x7fbcf8053a60 comp rx=0 tx=0).stop 2024-09-22T08:36:44.059 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.038+0000 7fbd01928800 1 -- 172.21.15.142:0/798216012 shutdown_connections 2024-09-22T08:36:44.059 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.038+0000 7fbd01928800 1 --2- 172.21.15.142:0/798216012 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5573b2c41840 0x5573b2d6ae20 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:44.059 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.038+0000 7fbd01928800 1 -- 172.21.15.142:0/798216012 >> 172.21.15.142:0/798216012 conn(0x5573b2d5da90 msgr2=0x5573b2d5bca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:44.059 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.038+0000 7fbd01928800 1 -- 172.21.15.142:0/798216012 shutdown_connections 2024-09-22T08:36:44.059 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.038+0000 7fbd01928800 1 -- 172.21.15.142:0/798216012 wait complete. 2024-09-22T08:36:44.059 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.038+0000 7fbd01928800 1 -- 172.21.15.142:0/1564543410 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fbbd403cfb0 msgr2=0x7fbbd403f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:44.059 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.038+0000 7fbd01928800 1 --2- 172.21.15.142:0/1564543410 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fbbd403cfb0 0x7fbbd403f470 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x5573b2d465a0 tx=0x7fbcf0006820 comp rx=0 tx=0).stop 2024-09-22T08:36:44.060 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.038+0000 7fbd01928800 1 -- 172.21.15.142:0/1564543410 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5573b2d54bd0 msgr2=0x5573b2d54ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:44.060 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.038+0000 7fbd01928800 1 --2- 172.21.15.142:0/1564543410 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5573b2d54bd0 0x5573b2d54ff0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x5573b2d3ab90 tx=0x7fbcf800bf30 comp rx=0 tx=0).stop 2024-09-22T08:36:44.060 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.038+0000 7fbd01928800 1 -- 172.21.15.142:0/1564543410 shutdown_connections 2024-09-22T08:36:44.060 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.038+0000 7fbd01928800 1 --2- 172.21.15.142:0/1564543410 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fbbd403cfb0 0x7fbbd403f470 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:44.060 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.038+0000 7fbd01928800 1 --2- 172.21.15.142:0/1564543410 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5573b2d54bd0 0x5573b2d54ff0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:44.060 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.038+0000 7fbd01928800 1 -- 172.21.15.142:0/1564543410 >> 172.21.15.142:0/1564543410 conn(0x5573b2d48f80 msgr2=0x5573b2d49360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:44.060 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.038+0000 7fbd01928800 1 -- 172.21.15.142:0/1564543410 shutdown_connections 2024-09-22T08:36:44.060 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.038+0000 7fbd01928800 1 -- 172.21.15.142:0/1564543410 wait complete. 2024-09-22T08:36:44.060 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.039+0000 7fbd01928800 1 -- 172.21.15.142:0/3313753014 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5573b2c40fe0 msgr2=0x5573b2d411e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:44.060 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.039+0000 7fbd01928800 1 --2- 172.21.15.142:0/3313753014 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5573b2c40fe0 0x5573b2d411e0 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:44.060 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.039+0000 7fbd01928800 1 -- 172.21.15.142:0/3313753014 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5573b2d435c0 msgr2=0x5573b2d45a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:44.060 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.039+0000 7fbd01928800 1 --2- 172.21.15.142:0/3313753014 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5573b2d435c0 0x5573b2d45a40 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:44.060 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.039+0000 7fbd01928800 1 -- 172.21.15.142:0/3313753014 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fbbe403d000 msgr2=0x7fbbe403f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:44.061 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.039+0000 7fbd01928800 1 --2- 172.21.15.142:0/3313753014 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fbbe403d000 0x7fbbe403f4c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fbce8057000 tx=0x7fbce8052000 comp rx=0 tx=0).stop 2024-09-22T08:36:44.061 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.039+0000 7fbd01928800 1 -- 172.21.15.142:0/3313753014 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5573b2c40be0 msgr2=0x5573b2d39b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:44.061 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.039+0000 7fbd01928800 1 --2- 172.21.15.142:0/3313753014 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5573b2c40be0 0x5573b2d39b90 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fbcf0000f80 tx=0x7fbcf0001250 comp rx=0 tx=0).stop 2024-09-22T08:36:44.061 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.039+0000 7fbd01928800 1 -- 172.21.15.142:0/3313753014 shutdown_connections 2024-09-22T08:36:44.061 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.039+0000 7fbd01928800 1 --2- 172.21.15.142:0/3313753014 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5573b2d435c0 0x5573b2d45a40 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:44.061 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.039+0000 7fbd01928800 1 --2- 172.21.15.142:0/3313753014 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5573b2c40fe0 0x5573b2d411e0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:44.061 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.039+0000 7fbd01928800 1 --2- 172.21.15.142:0/3313753014 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fbbe403d000 0x7fbbe403f4c0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:44.061 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.039+0000 7fbd01928800 1 --2- 172.21.15.142:0/3313753014 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5573b2c40be0 0x5573b2d39b90 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:44.061 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.039+0000 7fbd01928800 1 -- 172.21.15.142:0/3313753014 >> 172.21.15.142:0/3313753014 conn(0x5573b2c3c310 msgr2=0x5573b2d33510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:44.061 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.039+0000 7fbd01928800 1 -- 172.21.15.142:0/3313753014 shutdown_connections 2024-09-22T08:36:44.061 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.039+0000 7fbd01928800 1 -- 172.21.15.142:0/3313753014 wait complete. 2024-09-22T08:36:44.062 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-22T08:36:42.661297Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'td2vugNT3J2cFlOR6AvDF2W7anhkuGZGY3RhIE5a', 'active': True, 'create_date': '2024-09-22T08:36:44.024160Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-22T08:36:42.661288Z', 'tags': [], 'group_ids': []} 2024-09-22T08:36:44.062 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'modify', '--subuser', 'foo:foo1', '--secret', 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', '--key-type', 'swift'] 2024-09-22T08:36:44.062 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'modify', '--subuser', 'foo:foo1', '--secret', 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', '--key-type', 'swift'] 2024-09-22T08:36:44.062 DEBUG:teuthology.orchestra.run.smithi142:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser modify --subuser foo:foo1 --secret gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL --key-type swift 2024-09-22T08:36:44.111 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:36:44.111 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:36:44.112 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.111+0000 7ff670c13800 1 Processor -- start 2024-09-22T08:36:44.112 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.111+0000 7ff670c13800 1 -- start start 2024-09-22T08:36:44.112 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.111+0000 7ff670c13800 1 --2- >> v2:172.21.15.31:3300/0 conn(0x5557101afc10 0x5557101b20d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:44.112 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.111+0000 7ff670c13800 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x555710034a20 con 0x55571011cd30 2024-09-22T08:36:44.112 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.111+0000 7ff670c13800 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x5557100347d0 con 0x5557101afc10 2024-09-22T08:36:44.112 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.111+0000 7ff663b47640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x5557101afc10 0x5557101b20d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:44.113 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.111+0000 7ff66c348640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x55571011cd30 0x5557101ae4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.142:42392/0 (socket says 172.21.15.142:42392) 2024-09-22T08:36:44.113 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.111+0000 7ff66c348640 1 -- 172.21.15.142:0/4252670150 learned_addr learned my addr 172.21.15.142:0/4252670150 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-09-22T08:36:44.113 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.111+0000 7ff663b47640 1 -- 172.21.15.142:0/4252670150 >> v1:172.21.15.31:6789/0 conn(0x55571011cd30 legacy=0x5557101ae4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:44.113 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.111+0000 7ff66bb47640 1 -- 172.21.15.142:0/4252670150 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2052603066 0 0) 0x555710034a20 con 0x55571011cd30 2024-09-22T08:36:44.113 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.111+0000 7ff663b47640 1 -- 172.21.15.142:0/4252670150 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5557101b37e0 con 0x5557101afc10 2024-09-22T08:36:44.115 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.113+0000 7ff663b47640 1 --2- 172.21.15.142:0/4252670150 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5557101afc10 0x5557101b20d0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7ff65400a470 tx=0x7ff654045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=931b106e5f3dade1 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:44.115 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.113+0000 7ff66bb47640 1 -- 172.21.15.142:0/4252670150 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff654053570 con 0x5557101afc10 2024-09-22T08:36:44.115 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.113+0000 7ff66bb47640 1 -- 172.21.15.142:0/4252670150 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff654058070 con 0x5557101afc10 2024-09-22T08:36:44.115 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.113+0000 7ff66bb47640 1 -- 172.21.15.142:0/4252670150 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff654053880 con 0x5557101afc10 2024-09-22T08:36:44.115 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.114+0000 7ff670c13800 1 -- 172.21.15.142:0/4252670150 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5557101afc10 msgr2=0x5557101b20d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:44.115 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.114+0000 7ff670c13800 1 --2- 172.21.15.142:0/4252670150 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5557101afc10 0x5557101b20d0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7ff65400a470 tx=0x7ff654045a20 comp rx=0 tx=0).stop 2024-09-22T08:36:44.116 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.114+0000 7ff670c13800 1 -- 172.21.15.142:0/4252670150 shutdown_connections 2024-09-22T08:36:44.116 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.114+0000 7ff670c13800 1 --2- 172.21.15.142:0/4252670150 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5557101afc10 0x5557101b20d0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:44.116 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.114+0000 7ff670c13800 1 -- 172.21.15.142:0/4252670150 >> 172.21.15.142:0/4252670150 conn(0x5557101a3bd0 msgr2=0x5557101a6030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:44.116 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.114+0000 7ff670c13800 1 -- 172.21.15.142:0/4252670150 shutdown_connections 2024-09-22T08:36:44.116 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.114+0000 7ff670c13800 1 -- 172.21.15.142:0/4252670150 wait complete. 2024-09-22T08:36:44.129 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.127+0000 7ff670c13800 1 Processor -- start 2024-09-22T08:36:44.129 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.127+0000 7ff670c13800 1 -- start start 2024-09-22T08:36:44.129 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.128+0000 7ff670c13800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55571011cd30 0x55571029b130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:44.129 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.128+0000 7ff670c13800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x555710041dd0 con 0x55571011cd30 2024-09-22T08:36:44.129 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.128+0000 7ff66c348640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55571011cd30 0x55571029b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:44.129 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.128+0000 7ff66c348640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55571011cd30 0x55571029b130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:38492/0 (socket says 172.21.15.142:38492) 2024-09-22T08:36:44.130 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.128+0000 7ff66c348640 1 -- 172.21.15.142:0/1316695922 learned_addr learned my addr 172.21.15.142:0/1316695922 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:44.131 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.128+0000 7ff66c348640 1 -- 172.21.15.142:0/1316695922 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55571029b720 con 0x55571011cd30 2024-09-22T08:36:44.131 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.129+0000 7ff66c348640 1 --2- 172.21.15.142:0/1316695922 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55571011cd30 0x55571029b130 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7ff65c001ea0 tx=0x7ff65c00b6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b167cd63e61e4e12 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:44.131 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.129+0000 7ff55a60c640 1 -- 172.21.15.142:0/1316695922 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff65c008070 con 0x55571011cd30 2024-09-22T08:36:44.132 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.129+0000 7ff55a60c640 1 -- 172.21.15.142:0/1316695922 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff65c00d500 con 0x55571011cd30 2024-09-22T08:36:44.132 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.129+0000 7ff55a60c640 1 -- 172.21.15.142:0/1316695922 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff65c00d880 con 0x55571011cd30 2024-09-22T08:36:44.132 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.129+0000 7ff670c13800 1 -- 172.21.15.142:0/1316695922 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55571011cd30 msgr2=0x55571029b130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:44.132 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.129+0000 7ff670c13800 1 --2- 172.21.15.142:0/1316695922 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55571011cd30 0x55571029b130 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7ff65c001ea0 tx=0x7ff65c00b6a0 comp rx=0 tx=0).stop 2024-09-22T08:36:44.132 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.130+0000 7ff670c13800 1 -- 172.21.15.142:0/1316695922 shutdown_connections 2024-09-22T08:36:44.132 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.130+0000 7ff670c13800 1 --2- 172.21.15.142:0/1316695922 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55571011cd30 0x55571029b130 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:44.132 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.130+0000 7ff670c13800 1 -- 172.21.15.142:0/1316695922 >> 172.21.15.142:0/1316695922 conn(0x5557101a3bd0 msgr2=0x555710296ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:44.132 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.130+0000 7ff670c13800 1 -- 172.21.15.142:0/1316695922 shutdown_connections 2024-09-22T08:36:44.132 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.130+0000 7ff670c13800 1 -- 172.21.15.142:0/1316695922 wait complete. 2024-09-22T08:36:44.132 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.130+0000 7ff670c13800 1 Processor -- start 2024-09-22T08:36:44.132 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.130+0000 7ff670c13800 1 -- start start 2024-09-22T08:36:44.132 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.130+0000 7ff670c13800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55571011cd30 0x5557102a2c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:44.132 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.130+0000 7ff670c13800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5557101b2a80 con 0x55571011cd30 2024-09-22T08:36:44.133 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.130+0000 7ff66c348640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55571011cd30 0x5557102a2c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:44.133 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.130+0000 7ff66c348640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55571011cd30 0x5557102a2c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:38502/0 (socket says 172.21.15.142:38502) 2024-09-22T08:36:44.133 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.130+0000 7ff66c348640 1 -- 172.21.15.142:0/595942472 learned_addr learned my addr 172.21.15.142:0/595942472 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:44.137 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.131+0000 7ff66c348640 1 -- 172.21.15.142:0/595942472 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5557102a3180 con 0x55571011cd30 2024-09-22T08:36:44.137 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.131+0000 7ff66c348640 1 --2- 172.21.15.142:0/595942472 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55571011cd30 0x5557102a2c20 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7ff65c0012f0 tx=0x7ff65c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:44.137 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.131+0000 7ff558e09640 1 -- 172.21.15.142:0/595942472 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff65c00f9d0 con 0x55571011cd30 2024-09-22T08:36:44.137 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.131+0000 7ff558e09640 1 -- 172.21.15.142:0/595942472 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff65c00fb70 con 0x55571011cd30 2024-09-22T08:36:44.137 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.131+0000 7ff558e09640 1 -- 172.21.15.142:0/595942472 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff65c00fe50 con 0x55571011cd30 2024-09-22T08:36:44.137 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.131+0000 7ff670c13800 1 -- 172.21.15.142:0/595942472 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5557102a3410 con 0x55571011cd30 2024-09-22T08:36:44.138 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.131+0000 7ff670c13800 1 -- 172.21.15.142:0/595942472 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5557102a3e10 con 0x55571011cd30 2024-09-22T08:36:44.138 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.132+0000 7ff558e09640 1 -- 172.21.15.142:0/595942472 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7ff65c017040 con 0x55571011cd30 2024-09-22T08:36:44.138 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.132+0000 7ff558e09640 1 --2- 172.21.15.142:0/595942472 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7ff55403d1a0 0x7ff55403f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:44.138 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.132+0000 7ff558e09640 1 -- 172.21.15.142:0/595942472 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7ff65c015020 con 0x55571011cd30 2024-09-22T08:36:44.138 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.132+0000 7ff663b47640 1 --2- 172.21.15.142:0/595942472 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7ff55403d1a0 0x7ff55403f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:44.138 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.132+0000 7ff670c13800 1 --2- 172.21.15.142:0/595942472 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5557101afc10 0x5557102aa270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:44.138 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.132+0000 7ff670c13800 1 -- 172.21.15.142:0/595942472 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5557102aa7b0 con 0x5557101afc10 2024-09-22T08:36:44.138 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.133+0000 7ff66cb49640 1 --2- 172.21.15.142:0/595942472 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5557101afc10 0x5557102aa270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:44.138 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.133+0000 7ff663b47640 1 --2- 172.21.15.142:0/595942472 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7ff55403d1a0 0x7ff55403f660 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7ff654057000 tx=0x7ff654052000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:44.138 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.133+0000 7ff66cb49640 1 --2- 172.21.15.142:0/595942472 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5557101afc10 0x5557102aa270 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:44.138 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.133+0000 7ff66cb49640 1 -- 172.21.15.142:0/595942472 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff66400a4d0 con 0x5557101afc10 2024-09-22T08:36:44.138 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.133+0000 7ff670c13800 1 -- 172.21.15.142:0/595942472 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5557102aab50 con 0x5557101afc10 2024-09-22T08:36:44.139 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.133+0000 7ff66cb49640 1 -- 172.21.15.142:0/595942472 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff66400a4d0 con 0x5557101afc10 2024-09-22T08:36:44.139 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.133+0000 7ff670c13800 1 --2- 172.21.15.142:0/595942472 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5557102ac650 0x5557102aead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:44.139 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.133+0000 7ff670c13800 1 -- 172.21.15.142:0/595942472 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:3 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5557102af260 con 0x5557102ac650 2024-09-22T08:36:44.139 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.134+0000 7ff66c348640 1 --2- 172.21.15.142:0/595942472 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5557102ac650 0x5557102aead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:44.139 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.134+0000 7ff66c348640 1 --2- 172.21.15.142:0/595942472 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5557102ac650 0x5557102aead0 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:44.139 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.134+0000 7ff66c348640 1 -- 172.21.15.142:0/595942472 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(3 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7ff65c02d070 con 0x5557102ac650 2024-09-22T08:36:44.139 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.134+0000 7ff670c13800 1 -- 172.21.15.142:0/595942472 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5557102ab3a0 con 0x5557101afc10 2024-09-22T08:36:44.139 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.134+0000 7ff66cb49640 1 -- 172.21.15.142:0/595942472 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff66400a4d0 con 0x5557101afc10 2024-09-22T08:36:44.139 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.134+0000 7ff670c13800 1 -- 172.21.15.142:0/595942472 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5557102ab7f0 con 0x5557102ac650 2024-09-22T08:36:44.139 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.135+0000 7ff66c348640 1 -- 172.21.15.142:0/595942472 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(5 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7ff65c02d070 con 0x5557102ac650 2024-09-22T08:36:44.139 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.135+0000 7ff670c13800 1 Processor -- start 2024-09-22T08:36:44.139 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.135+0000 7ff670c13800 1 -- start start 2024-09-22T08:36:44.139 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.135+0000 7ff670c13800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5557102bdc10 0x5557102be030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:44.140 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.135+0000 7ff670c13800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5557100a0d50 con 0x5557102bdc10 2024-09-22T08:36:44.140 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.135+0000 7ff66cb49640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5557102bdc10 0x5557102be030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:44.140 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.135+0000 7ff66cb49640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5557102bdc10 0x5557102be030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:38508/0 (socket says 172.21.15.142:38508) 2024-09-22T08:36:44.140 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.135+0000 7ff66cb49640 1 -- 172.21.15.142:0/544614797 learned_addr learned my addr 172.21.15.142:0/544614797 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:44.140 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.136+0000 7ff66cb49640 1 -- 172.21.15.142:0/544614797 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5557102be670 con 0x5557102bdc10 2024-09-22T08:36:44.140 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.136+0000 7ff66cb49640 1 --2- 172.21.15.142:0/544614797 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5557102bdc10 0x5557102be030 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x5557102a3c20 tx=0x7ff6640167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:44.140 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.136+0000 7ff551ffb640 1 -- 172.21.15.142:0/544614797 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff664013640 con 0x5557102bdc10 2024-09-22T08:36:44.140 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.136+0000 7ff551ffb640 1 -- 172.21.15.142:0/544614797 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6640137e0 con 0x5557102bdc10 2024-09-22T08:36:44.140 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.136+0000 7ff670c13800 1 -- 172.21.15.142:0/544614797 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5557102beea0 con 0x5557102bdc10 2024-09-22T08:36:44.140 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.136+0000 7ff551ffb640 1 -- 172.21.15.142:0/544614797 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff664013ae0 con 0x5557102bdc10 2024-09-22T08:36:44.140 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.136+0000 7ff670c13800 1 -- 172.21.15.142:0/544614797 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5557102bf440 con 0x5557102bdc10 2024-09-22T08:36:44.151 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.137+0000 7ff551ffb640 1 -- 172.21.15.142:0/544614797 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7ff664011040 con 0x5557102bdc10 2024-09-22T08:36:44.151 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.137+0000 7ff551ffb640 1 --2- 172.21.15.142:0/544614797 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7ff54403d070 0x7ff54403f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:44.151 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.137+0000 7ff551ffb640 1 -- 172.21.15.142:0/544614797 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7ff66400e040 con 0x5557102bdc10 2024-09-22T08:36:44.151 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.137+0000 7ff66c348640 1 --2- 172.21.15.142:0/544614797 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7ff54403d070 0x7ff54403f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:44.151 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.137+0000 7ff670c13800 1 Processor -- start 2024-09-22T08:36:44.151 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.137+0000 7ff670c13800 1 -- start start 2024-09-22T08:36:44.151 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.137+0000 7ff66c348640 1 --2- 172.21.15.142:0/544614797 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7ff54403d070 0x7ff54403f530 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ff65c0531e0 tx=0x7ff65c0011b0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:44.151 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.138+0000 7ff670c13800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5557102ca670 0x5557102caa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:44.152 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.138+0000 7ff670c13800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55571029bb50 con 0x5557102ca670 2024-09-22T08:36:44.152 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.138+0000 7ff66cb49640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5557102ca670 0x5557102caa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:44.152 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.138+0000 7ff66cb49640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5557102ca670 0x5557102caa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:38518/0 (socket says 172.21.15.142:38518) 2024-09-22T08:36:44.152 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.138+0000 7ff66cb49640 1 -- 172.21.15.142:0/770774222 learned_addr learned my addr 172.21.15.142:0/770774222 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:44.152 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.138+0000 7ff66cb49640 1 -- 172.21.15.142:0/770774222 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5557102cb060 con 0x5557102ca670 2024-09-22T08:36:44.152 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.138+0000 7ff66cb49640 1 --2- 172.21.15.142:0/770774222 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5557102ca670 0x5557102caa70 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7ff664054810 tx=0x7ff6640143c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cd8e470539a0673 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:44.152 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.138+0000 7ff54b7fe640 1 -- 172.21.15.142:0/770774222 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff664044030 con 0x5557102ca670 2024-09-22T08:36:44.152 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.138+0000 7ff54b7fe640 1 -- 172.21.15.142:0/770774222 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff664021910 con 0x5557102ca670 2024-09-22T08:36:44.152 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.138+0000 7ff54b7fe640 1 -- 172.21.15.142:0/770774222 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff664021440 con 0x5557102ca670 2024-09-22T08:36:44.152 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.139+0000 7ff670c13800 1 -- 172.21.15.142:0/770774222 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5557102ca670 msgr2=0x5557102caa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:44.152 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.139+0000 7ff670c13800 1 --2- 172.21.15.142:0/770774222 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5557102ca670 0x5557102caa70 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7ff664054810 tx=0x7ff6640143c0 comp rx=0 tx=0).stop 2024-09-22T08:36:44.152 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.139+0000 7ff670c13800 1 -- 172.21.15.142:0/770774222 shutdown_connections 2024-09-22T08:36:44.152 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.139+0000 7ff670c13800 1 --2- 172.21.15.142:0/770774222 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5557102ca670 0x5557102caa70 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:44.152 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.139+0000 7ff670c13800 1 -- 172.21.15.142:0/770774222 >> 172.21.15.142:0/770774222 conn(0x5557102c6a90 msgr2=0x5557102c4cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:44.153 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.139+0000 7ff670c13800 1 -- 172.21.15.142:0/770774222 shutdown_connections 2024-09-22T08:36:44.153 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.139+0000 7ff670c13800 1 -- 172.21.15.142:0/770774222 wait complete. 2024-09-22T08:36:44.153 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.139+0000 7ff670c13800 1 Processor -- start 2024-09-22T08:36:44.153 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.139+0000 7ff670c13800 1 -- start start 2024-09-22T08:36:44.153 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.139+0000 7ff670c13800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5557102ca670 0x5557102d1c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:44.153 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.139+0000 7ff670c13800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5557102cb680 con 0x5557102ca670 2024-09-22T08:36:44.153 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.139+0000 7ff66cb49640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5557102ca670 0x5557102d1c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:44.153 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.139+0000 7ff66cb49640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5557102ca670 0x5557102d1c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:38522/0 (socket says 172.21.15.142:38522) 2024-09-22T08:36:44.153 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.139+0000 7ff66cb49640 1 -- 172.21.15.142:0/3957222728 learned_addr learned my addr 172.21.15.142:0/3957222728 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:44.153 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.140+0000 7ff66cb49640 1 -- 172.21.15.142:0/3957222728 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5557102d21c0 con 0x5557102ca670 2024-09-22T08:36:44.153 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.140+0000 7ff66cb49640 1 --2- 172.21.15.142:0/3957222728 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5557102ca670 0x5557102d1c60 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7ff664014400 tx=0x7ff66404e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:44.153 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.140+0000 7ff549ffb640 1 -- 172.21.15.142:0/3957222728 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff664013c80 con 0x5557102ca670 2024-09-22T08:36:44.153 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.140+0000 7ff549ffb640 1 -- 172.21.15.142:0/3957222728 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff664013e20 con 0x5557102ca670 2024-09-22T08:36:44.153 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.140+0000 7ff670c13800 1 -- 172.21.15.142:0/3957222728 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5557102d2450 con 0x5557102ca670 2024-09-22T08:36:44.154 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.140+0000 7ff549ffb640 1 -- 172.21.15.142:0/3957222728 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff6640459b0 con 0x5557102ca670 2024-09-22T08:36:44.154 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.140+0000 7ff670c13800 1 -- 172.21.15.142:0/3957222728 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5557102d2450 con 0x5557102ca670 2024-09-22T08:36:44.154 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.141+0000 7ff549ffb640 1 -- 172.21.15.142:0/3957222728 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7ff664045b70 con 0x5557102ca670 2024-09-22T08:36:44.154 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.141+0000 7ff549ffb640 1 --2- 172.21.15.142:0/3957222728 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7ff53c03d000 0x7ff53c03f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:44.154 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.141+0000 7ff549ffb640 1 -- 172.21.15.142:0/3957222728 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7ff664017c60 con 0x5557102ca670 2024-09-22T08:36:44.154 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.141+0000 7ff66c348640 1 --2- 172.21.15.142:0/3957222728 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7ff53c03d000 0x7ff53c03f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:44.154 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.141+0000 7ff66c348640 1 --2- 172.21.15.142:0/3957222728 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7ff53c03d000 0x7ff53c03f4c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7ff65c00efd0 tx=0x7ff65c041000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:44.154 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.141+0000 7ff670c13800 20 rados->read ofs=0 len=0 2024-09-22T08:36:44.154 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.141+0000 7ff670c13800 1 --2- 172.21.15.142:0/3957222728 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5557102dd3e0 0x5557102df8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:44.154 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.141+0000 7ff670c13800 1 -- 172.21.15.142:0/3957222728 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5557102dfff0 con 0x5557102dd3e0 2024-09-22T08:36:44.154 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.142+0000 7ff663b47640 1 --2- 172.21.15.142:0/3957222728 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5557102dd3e0 0x5557102df8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:44.154 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.142+0000 7ff663b47640 1 --2- 172.21.15.142:0/3957222728 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5557102dd3e0 0x5557102df8a0 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:44.155 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.142+0000 7ff663b47640 1 -- 172.21.15.142:0/3957222728 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff654051070 con 0x5557102dd3e0 2024-09-22T08:36:44.155 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.142+0000 7ff670c13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:44.155 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.142+0000 7ff670c13800 20 realm 2024-09-22T08:36:44.155 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.142+0000 7ff670c13800 20 rados->read ofs=0 len=0 2024-09-22T08:36:44.155 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.142+0000 7ff670c13800 1 -- 172.21.15.142:0/3957222728 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5557102e0420 con 0x5557102dd3e0 2024-09-22T08:36:44.155 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.142+0000 7ff663b47640 1 -- 172.21.15.142:0/3957222728 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff654051070 con 0x5557102dd3e0 2024-09-22T08:36:44.155 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.142+0000 7ff670c13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:44.155 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.142+0000 7ff670c13800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:36:44.155 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.142+0000 7ff670c13800 20 rados->read ofs=0 len=0 2024-09-22T08:36:44.155 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.142+0000 7ff670c13800 1 -- 172.21.15.142:0/3957222728 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5557102e0cf0 con 0x5557102dd3e0 2024-09-22T08:36:44.155 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.143+0000 7ff663b47640 1 -- 172.21.15.142:0/3957222728 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff654051070 con 0x5557102dd3e0 2024-09-22T08:36:44.155 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.143+0000 7ff670c13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:44.155 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.143+0000 7ff670c13800 20 rados->read ofs=0 len=0 2024-09-22T08:36:44.155 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.143+0000 7ff670c13800 1 -- 172.21.15.142:0/3957222728 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5557102e1090 con 0x5557102dd3e0 2024-09-22T08:36:44.156 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.143+0000 7ff663b47640 1 -- 172.21.15.142:0/3957222728 <== osd.1 v2:172.21.15.142:6816/3192108003 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff654051070 con 0x5557102dd3e0 2024-09-22T08:36:44.156 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.143+0000 7ff670c13800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:36:44.156 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.143+0000 7ff670c13800 20 rados->read ofs=0 len=0 2024-09-22T08:36:44.156 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.143+0000 7ff670c13800 1 --2- 172.21.15.142:0/3957222728 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5557102e1df0 0x5557102e41e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:44.156 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.143+0000 7ff670c13800 1 -- 172.21.15.142:0/3957222728 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5557102e47f0 con 0x5557102e1df0 2024-09-22T08:36:44.156 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.143+0000 7ff66cb49640 1 --2- 172.21.15.142:0/3957222728 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5557102e1df0 0x5557102e41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:44.156 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.143+0000 7ff66cb49640 1 --2- 172.21.15.142:0/3957222728 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5557102e1df0 0x5557102e41e0 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:44.156 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.143+0000 7ff66cb49640 1 -- 172.21.15.142:0/3957222728 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(5 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7ff664053020 con 0x5557102e1df0 2024-09-22T08:36:44.156 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.144+0000 7ff670c13800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:36:44.156 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.144+0000 7ff670c13800 20 searching for the correct realm 2024-09-22T08:36:44.156 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.144+0000 7ff670c13800 1 -- 172.21.15.142:0/3957222728 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5557102e6120 con 0x5557102e1df0 2024-09-22T08:36:44.156 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.144+0000 7ff66cb49640 1 -- 172.21.15.142:0/3957222728 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff664053020 con 0x5557102e1df0 2024-09-22T08:36:44.156 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.144+0000 7ff66cb49640 1 --2- 172.21.15.142:0/3957222728 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7ff664033440 0x7ff664045130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:44.156 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.144+0000 7ff66cb49640 1 -- 172.21.15.142:0/3957222728 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5557102e6120 con 0x7ff664033440 2024-09-22T08:36:44.157 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.144+0000 7ff66c348640 1 --2- 172.21.15.142:0/3957222728 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7ff664033440 0x7ff664045130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:44.157 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.144+0000 7ff66c348640 1 --2- 172.21.15.142:0/3957222728 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7ff664033440 0x7ff664045130 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:44.157 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.144+0000 7ff66c348640 1 -- 172.21.15.142:0/3957222728 <== osd.2 v2:172.21.15.142:6808/279438927 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff65c039070 con 0x7ff664033440 2024-09-22T08:36:44.157 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.144+0000 7ff66c348640 1 --2- 172.21.15.142:0/3957222728 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7ff65c0541f0 0x7ff65c054630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:44.157 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.144+0000 7ff66c348640 1 -- 172.21.15.142:0/3957222728 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5557102e6120 con 0x7ff65c0541f0 2024-09-22T08:36:44.157 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.145+0000 7ff663b47640 1 --2- 172.21.15.142:0/3957222728 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7ff65c0541f0 0x7ff65c054630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:44.157 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.145+0000 7ff663b47640 1 --2- 172.21.15.142:0/3957222728 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7ff65c0541f0 0x7ff65c054630 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:44.157 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.145+0000 7ff663b47640 1 -- 172.21.15.142:0/3957222728 <== osd.0 v2:172.21.15.31:6800/168281188 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff654051070 con 0x7ff65c0541f0 2024-09-22T08:36:44.157 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.145+0000 7ff663b47640 1 -- 172.21.15.142:0/3957222728 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5557102e6120 con 0x5557102dd3e0 2024-09-22T08:36:44.157 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.146+0000 7ff663b47640 1 -- 172.21.15.142:0/3957222728 <== osd.1 v2:172.21.15.142:6816/3192108003 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff654051070 con 0x5557102dd3e0 2024-09-22T08:36:44.157 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.146+0000 7ff663b47640 1 -- 172.21.15.142:0/3957222728 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5557102e6120 con 0x5557102dd3e0 2024-09-22T08:36:44.157 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.146+0000 7ff663b47640 1 -- 172.21.15.142:0/3957222728 <== osd.1 v2:172.21.15.142:6816/3192108003 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff654051070 con 0x5557102dd3e0 2024-09-22T08:36:44.157 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.146+0000 7ff663b47640 1 -- 172.21.15.142:0/3957222728 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5557102e6120 con 0x7ff65c0541f0 2024-09-22T08:36:44.158 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.146+0000 7ff663b47640 1 -- 172.21.15.142:0/3957222728 <== osd.0 v2:172.21.15.31:6800/168281188 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff654051070 con 0x7ff65c0541f0 2024-09-22T08:36:44.158 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.146+0000 7ff663b47640 1 -- 172.21.15.142:0/3957222728 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5557102e6120 con 0x7ff65c0541f0 2024-09-22T08:36:44.158 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.146+0000 7ff663b47640 1 -- 172.21.15.142:0/3957222728 <== osd.0 v2:172.21.15.31:6800/168281188 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff654051070 con 0x7ff65c0541f0 2024-09-22T08:36:44.158 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.146+0000 7ff663b47640 1 -- 172.21.15.142:0/3957222728 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5557102e6120 con 0x7ff664033440 2024-09-22T08:36:44.158 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.147+0000 7ff66c348640 1 -- 172.21.15.142:0/3957222728 <== osd.2 v2:172.21.15.142:6808/279438927 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff65c039070 con 0x7ff664033440 2024-09-22T08:36:44.158 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.147+0000 7ff66c348640 1 -- 172.21.15.142:0/3957222728 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5557102e6120 con 0x5557102e1df0 2024-09-22T08:36:44.158 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.147+0000 7ff66cb49640 1 -- 172.21.15.142:0/3957222728 <== osd.3 v2:172.21.15.142:6800/1064901393 3 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff664053020 con 0x5557102e1df0 2024-09-22T08:36:44.158 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.147+0000 7ff66cb49640 1 -- 172.21.15.142:0/3957222728 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5557102e6120 con 0x5557102dd3e0 2024-09-22T08:36:44.158 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.147+0000 7ff663b47640 1 -- 172.21.15.142:0/3957222728 <== osd.1 v2:172.21.15.142:6816/3192108003 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff654051070 con 0x5557102dd3e0 2024-09-22T08:36:44.158 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.147+0000 7ff663b47640 1 -- 172.21.15.142:0/3957222728 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5557102e6120 con 0x7ff65c0541f0 2024-09-22T08:36:44.158 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.147+0000 7ff663b47640 1 -- 172.21.15.142:0/3957222728 <== osd.0 v2:172.21.15.31:6800/168281188 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff654051070 con 0x7ff65c0541f0 2024-09-22T08:36:44.158 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.147+0000 7ff663b47640 1 -- 172.21.15.142:0/3957222728 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5557102e6120 con 0x5557102dd3e0 2024-09-22T08:36:44.158 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.148+0000 7ff663b47640 1 -- 172.21.15.142:0/3957222728 <== osd.1 v2:172.21.15.142:6816/3192108003 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff654051070 con 0x5557102dd3e0 2024-09-22T08:36:44.158 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.148+0000 7ff663b47640 1 -- 172.21.15.142:0/3957222728 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5557102e6120 con 0x7ff664033440 2024-09-22T08:36:44.159 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.148+0000 7ff66c348640 1 -- 172.21.15.142:0/3957222728 <== osd.2 v2:172.21.15.142:6808/279438927 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7ff65c039070 con 0x7ff664033440 2024-09-22T08:36:44.159 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.148+0000 7ff66c348640 1 -- 172.21.15.142:0/3957222728 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5557102e6120 con 0x5557102e1df0 2024-09-22T08:36:44.159 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.148+0000 7ff66cb49640 1 -- 172.21.15.142:0/3957222728 <== osd.3 v2:172.21.15.142:6800/1064901393 4 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff664053020 con 0x5557102e1df0 2024-09-22T08:36:44.159 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.148+0000 7ff66cb49640 1 -- 172.21.15.142:0/3957222728 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5557102e6120 con 0x5557102e1df0 2024-09-22T08:36:44.159 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.148+0000 7ff66cb49640 1 -- 172.21.15.142:0/3957222728 <== osd.3 v2:172.21.15.142:6800/1064901393 5 ==== osd_op_reply(20 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7ff664053020 con 0x5557102e1df0 2024-09-22T08:36:44.159 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.148+0000 7ff66cb49640 1 -- 172.21.15.142:0/3957222728 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5557102e6120 con 0x7ff65c0541f0 2024-09-22T08:36:44.159 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.149+0000 7ff663b47640 1 -- 172.21.15.142:0/3957222728 <== osd.0 v2:172.21.15.31:6800/168281188 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff654051070 con 0x7ff65c0541f0 2024-09-22T08:36:44.159 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.149+0000 7ff663b47640 1 -- 172.21.15.142:0/3957222728 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5557102e6120 con 0x5557102e1df0 2024-09-22T08:36:44.159 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.149+0000 7ff66cb49640 1 -- 172.21.15.142:0/3957222728 <== osd.3 v2:172.21.15.142:6800/1064901393 6 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff664053020 con 0x5557102e1df0 2024-09-22T08:36:44.159 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.149+0000 7ff66cb49640 1 -- 172.21.15.142:0/3957222728 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5557102e6120 con 0x5557102e1df0 2024-09-22T08:36:44.159 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.149+0000 7ff66cb49640 1 -- 172.21.15.142:0/3957222728 <== osd.3 v2:172.21.15.142:6800/1064901393 7 ==== osd_op_reply(23 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7ff664053020 con 0x5557102e1df0 2024-09-22T08:36:44.159 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.149+0000 7ff66cb49640 1 -- 172.21.15.142:0/3957222728 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5557102e6120 con 0x5557102dd3e0 2024-09-22T08:36:44.159 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.149+0000 7ff663b47640 1 -- 172.21.15.142:0/3957222728 <== osd.1 v2:172.21.15.142:6816/3192108003 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff654051070 con 0x5557102dd3e0 2024-09-22T08:36:44.160 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.149+0000 7ff663b47640 1 -- 172.21.15.142:0/3957222728 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5557102e6120 con 0x5557102dd3e0 2024-09-22T08:36:44.160 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.150+0000 7ff663b47640 1 -- 172.21.15.142:0/3957222728 <== osd.1 v2:172.21.15.142:6816/3192108003 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7ff654051070 con 0x5557102dd3e0 2024-09-22T08:36:44.160 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.150+0000 7ff663b47640 1 -- 172.21.15.142:0/3957222728 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5557102e6120 con 0x7ff65c0541f0 2024-09-22T08:36:44.160 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.150+0000 7ff663b47640 1 -- 172.21.15.142:0/3957222728 <== osd.0 v2:172.21.15.31:6800/168281188 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff654051070 con 0x7ff65c0541f0 2024-09-22T08:36:44.160 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.150+0000 7ff663b47640 1 -- 172.21.15.142:0/3957222728 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5557102e6120 con 0x5557102e1df0 2024-09-22T08:36:44.160 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.150+0000 7ff66cb49640 1 -- 172.21.15.142:0/3957222728 <== osd.3 v2:172.21.15.142:6800/1064901393 8 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff664053020 con 0x5557102e1df0 2024-09-22T08:36:44.160 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.150+0000 7ff66cb49640 1 -- 172.21.15.142:0/3957222728 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5557102e6120 con 0x7ff664033440 2024-09-22T08:36:44.170 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.150+0000 7ff66c348640 1 -- 172.21.15.142:0/3957222728 <== osd.2 v2:172.21.15.142:6808/279438927 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff65c039070 con 0x7ff664033440 2024-09-22T08:36:44.170 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.150+0000 7ff66c348640 1 -- 172.21.15.142:0/3957222728 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5557102e6120 con 0x5557102dd3e0 2024-09-22T08:36:44.170 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.150+0000 7ff663b47640 1 -- 172.21.15.142:0/3957222728 <== osd.1 v2:172.21.15.142:6816/3192108003 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff654051070 con 0x5557102dd3e0 2024-09-22T08:36:44.170 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.151+0000 7ff663b47640 1 -- 172.21.15.142:0/3957222728 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5557102e6120 con 0x7ff65c0541f0 2024-09-22T08:36:44.170 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.151+0000 7ff663b47640 1 -- 172.21.15.142:0/3957222728 <== osd.0 v2:172.21.15.31:6800/168281188 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff654051070 con 0x7ff65c0541f0 2024-09-22T08:36:44.170 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.151+0000 7ff663b47640 1 -- 172.21.15.142:0/3957222728 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5557102e6120 con 0x5557102e1df0 2024-09-22T08:36:44.171 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.151+0000 7ff66cb49640 1 -- 172.21.15.142:0/3957222728 <== osd.3 v2:172.21.15.142:6800/1064901393 9 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff664053020 con 0x5557102e1df0 2024-09-22T08:36:44.171 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.151+0000 7ff66cb49640 1 -- 172.21.15.142:0/3957222728 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5557102e6120 con 0x7ff65c0541f0 2024-09-22T08:36:44.171 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.151+0000 7ff663b47640 1 -- 172.21.15.142:0/3957222728 <== osd.0 v2:172.21.15.31:6800/168281188 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff654051070 con 0x7ff65c0541f0 2024-09-22T08:36:44.171 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.151+0000 7ff663b47640 1 -- 172.21.15.142:0/3957222728 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5557102e6120 con 0x7ff664033440 2024-09-22T08:36:44.171 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.152+0000 7ff66c348640 1 -- 172.21.15.142:0/3957222728 <== osd.2 v2:172.21.15.142:6808/279438927 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff65c039070 con 0x7ff664033440 2024-09-22T08:36:44.171 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.152+0000 7ff66c348640 1 -- 172.21.15.142:0/3957222728 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5557102e6120 con 0x5557102e1df0 2024-09-22T08:36:44.171 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.152+0000 7ff66cb49640 1 -- 172.21.15.142:0/3957222728 <== osd.3 v2:172.21.15.142:6800/1064901393 10 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff664053020 con 0x5557102e1df0 2024-09-22T08:36:44.171 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.152+0000 7ff66cb49640 1 -- 172.21.15.142:0/3957222728 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5557102e6120 con 0x7ff65c0541f0 2024-09-22T08:36:44.171 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.152+0000 7ff663b47640 1 -- 172.21.15.142:0/3957222728 <== osd.0 v2:172.21.15.31:6800/168281188 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff654051070 con 0x7ff65c0541f0 2024-09-22T08:36:44.171 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.152+0000 7ff663b47640 1 -- 172.21.15.142:0/3957222728 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5557102e6120 con 0x5557102dd3e0 2024-09-22T08:36:44.171 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.152+0000 7ff663b47640 1 -- 172.21.15.142:0/3957222728 <== osd.1 v2:172.21.15.142:6816/3192108003 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7ff654051070 con 0x5557102dd3e0 2024-09-22T08:36:44.172 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.152+0000 7ff663b47640 1 -- 172.21.15.142:0/3957222728 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5557102e6120 con 0x7ff664033440 2024-09-22T08:36:44.172 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.153+0000 7ff66c348640 1 -- 172.21.15.142:0/3957222728 <== osd.2 v2:172.21.15.142:6808/279438927 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff65c039070 con 0x7ff664033440 2024-09-22T08:36:44.172 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.153+0000 7ff670c13800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:36:44.172 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.153+0000 7ff670c13800 20 RGWRados::pool_iterate: got zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec 2024-09-22T08:36:44.172 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.153+0000 7ff670c13800 20 RGWRados::pool_iterate: got zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f 2024-09-22T08:36:44.172 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.153+0000 7ff670c13800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:36:44.172 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.153+0000 7ff670c13800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:36:44.172 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.153+0000 7ff670c13800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:36:44.172 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.153+0000 7ff670c13800 20 rados->read ofs=0 len=0 2024-09-22T08:36:44.172 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.153+0000 7ff670c13800 1 -- 172.21.15.142:0/3957222728 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5557102e51b0 con 0x5557102dd3e0 2024-09-22T08:36:44.172 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.153+0000 7ff663b47640 1 -- 172.21.15.142:0/3957222728 <== osd.1 v2:172.21.15.142:6816/3192108003 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff654051070 con 0x5557102dd3e0 2024-09-22T08:36:44.173 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.153+0000 7ff670c13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:44.173 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.153+0000 7ff670c13800 20 rados->read ofs=0 len=0 2024-09-22T08:36:44.173 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.153+0000 7ff670c13800 1 -- 172.21.15.142:0/3957222728 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5557102e5a00 con 0x5557102dd3e0 2024-09-22T08:36:44.173 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.153+0000 7ff663b47640 1 -- 172.21.15.142:0/3957222728 <== osd.1 v2:172.21.15.142:6816/3192108003 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff654051070 con 0x5557102dd3e0 2024-09-22T08:36:44.173 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.153+0000 7ff670c13800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:36:44.173 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.153+0000 7ff670c13800 20 rados->read ofs=0 len=0 2024-09-22T08:36:44.173 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.153+0000 7ff670c13800 1 -- 172.21.15.142:0/3957222728 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:40 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5557102e65a0 con 0x5557102e1df0 2024-09-22T08:36:44.173 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.153+0000 7ff66cb49640 1 -- 172.21.15.142:0/3957222728 <== osd.3 v2:172.21.15.142:6800/1064901393 11 ==== osd_op_reply(40 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7ff664053020 con 0x5557102e1df0 2024-09-22T08:36:44.173 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.153+0000 7ff670c13800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:36:44.173 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.153+0000 7ff670c13800 20 zone default found 2024-09-22T08:36:44.173 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.153+0000 7ff670c13800 4 Realm: () 2024-09-22T08:36:44.173 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.153+0000 7ff670c13800 4 ZoneGroup: default (d89f6f57-1007-47dd-9065-f486c7b01aec) 2024-09-22T08:36:44.174 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.153+0000 7ff670c13800 4 Zone: default (e239248c-0bee-4e41-803a-24b288d3eb8f) 2024-09-22T08:36:44.174 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.153+0000 7ff670c13800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:36:44.174 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.153+0000 7ff670c13800 20 zonegroup default 2024-09-22T08:36:44.174 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.153+0000 7ff670c13800 20 rados->read ofs=0 len=0 2024-09-22T08:36:44.174 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.153+0000 7ff670c13800 1 -- 172.21.15.142:0/3957222728 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5557102e69a0 con 0x7ff65c0541f0 2024-09-22T08:36:44.174 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.154+0000 7ff663b47640 1 -- 172.21.15.142:0/3957222728 <== osd.0 v2:172.21.15.31:6800/168281188 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7ff654051070 con 0x7ff65c0541f0 2024-09-22T08:36:44.174 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.154+0000 7ff670c13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:44.174 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.154+0000 7ff670c13800 20 rados->read ofs=0 len=0 2024-09-22T08:36:44.174 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.154+0000 7ff670c13800 1 -- 172.21.15.142:0/3957222728 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5557102e8c80 con 0x5557102e1df0 2024-09-22T08:36:44.174 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.154+0000 7ff66cb49640 1 -- 172.21.15.142:0/3957222728 <== osd.3 v2:172.21.15.142:6800/1064901393 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff664053020 con 0x5557102e1df0 2024-09-22T08:36:44.174 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.154+0000 7ff670c13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:44.174 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.154+0000 7ff670c13800 20 rados->read ofs=0 len=0 2024-09-22T08:36:44.174 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.154+0000 7ff670c13800 1 -- 172.21.15.142:0/3957222728 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5557102e9020 con 0x5557102e1df0 2024-09-22T08:36:44.175 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.154+0000 7ff66cb49640 1 -- 172.21.15.142:0/3957222728 <== osd.3 v2:172.21.15.142:6800/1064901393 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff664053020 con 0x5557102e1df0 2024-09-22T08:36:44.175 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.154+0000 7ff670c13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:44.175 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.154+0000 7ff670c13800 20 started sync module instance, tier type = 2024-09-22T08:36:44.175 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.154+0000 7ff670c13800 20 started zone id=e239248c-0bee-4e41-803a-24b288d3eb8f (name=default) with tier type = 2024-09-22T08:36:44.175 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.154+0000 7ff670c13800 1 -- 172.21.15.142:0/3957222728 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5557102e80c0 con 0x7ff664033440 2024-09-22T08:36:44.175 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.155+0000 7ff66c348640 1 -- 172.21.15.142:0/3957222728 <== osd.2 v2:172.21.15.142:6808/279438927 7 ==== osd_op_reply(44 notify.0 [create] v30'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff65c039070 con 0x7ff664033440 2024-09-22T08:36:44.175 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.155+0000 7ff670c13800 1 -- 172.21.15.142:0/3957222728 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93832421997584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5557102e9450 con 0x7ff664033440 2024-09-22T08:36:44.175 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.155+0000 7ff670c13800 1 -- 172.21.15.142:0/3957222728 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5557102e9ca0 con 0x5557102dd3e0 2024-09-22T08:36:44.175 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.156+0000 7ff66c348640 1 -- 172.21.15.142:0/3957222728 <== osd.2 v2:172.21.15.142:6808/279438927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93832421997584] v30'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff65c039070 con 0x7ff664033440 2024-09-22T08:36:44.175 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.157+0000 7ff663b47640 1 -- 172.21.15.142:0/3957222728 <== osd.1 v2:172.21.15.142:6816/3192108003 15 ==== osd_op_reply(46 notify.1 [create] v30'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff654051070 con 0x5557102dd3e0 2024-09-22T08:36:44.175 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.157+0000 7ff670c13800 1 -- 172.21.15.142:0/3957222728 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93832422004720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5557102ea0c0 con 0x5557102dd3e0 2024-09-22T08:36:44.175 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.157+0000 7ff670c13800 1 -- 172.21.15.142:0/3957222728 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5557102ea910 con 0x5557102e1df0 2024-09-22T08:36:44.175 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.158+0000 7ff663b47640 1 -- 172.21.15.142:0/3957222728 <== osd.1 v2:172.21.15.142:6816/3192108003 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93832422004720] v30'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff654051070 con 0x5557102dd3e0 2024-09-22T08:36:44.176 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.158+0000 7ff66cb49640 1 -- 172.21.15.142:0/3957222728 <== osd.3 v2:172.21.15.142:6800/1064901393 14 ==== osd_op_reply(48 notify.2 [create] v30'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff664053020 con 0x5557102e1df0 2024-09-22T08:36:44.176 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.158+0000 7ff670c13800 1 -- 172.21.15.142:0/3957222728 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93832422006256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5557102ea820 con 0x5557102e1df0 2024-09-22T08:36:44.176 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.158+0000 7ff670c13800 1 -- 172.21.15.142:0/3957222728 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5557102eb340 con 0x7ff664033440 2024-09-22T08:36:44.176 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.159+0000 7ff66cb49640 1 -- 172.21.15.142:0/3957222728 <== osd.3 v2:172.21.15.142:6800/1064901393 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 93832422006256] v30'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff664053020 con 0x5557102e1df0 2024-09-22T08:36:44.176 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.159+0000 7ff66c348640 1 -- 172.21.15.142:0/3957222728 <== osd.2 v2:172.21.15.142:6808/279438927 9 ==== osd_op_reply(50 notify.3 [create] v30'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff65c039070 con 0x7ff664033440 2024-09-22T08:36:44.176 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.159+0000 7ff670c13800 1 -- 172.21.15.142:0/3957222728 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93832422010384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5557102eb730 con 0x7ff664033440 2024-09-22T08:36:44.176 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.159+0000 7ff670c13800 1 -- 172.21.15.142:0/3957222728 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5557102ec180 con 0x5557102dd3e0 2024-09-22T08:36:44.176 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.160+0000 7ff66c348640 1 -- 172.21.15.142:0/3957222728 <== osd.2 v2:172.21.15.142:6808/279438927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93832422010384] v30'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff65c039070 con 0x7ff664033440 2024-09-22T08:36:44.176 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.160+0000 7ff663b47640 1 -- 172.21.15.142:0/3957222728 <== osd.1 v2:172.21.15.142:6816/3192108003 17 ==== osd_op_reply(52 notify.4 [create] v30'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff654051070 con 0x5557102dd3e0 2024-09-22T08:36:44.176 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.160+0000 7ff670c13800 1 -- 172.21.15.142:0/3957222728 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93832422014064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5557102ec570 con 0x5557102dd3e0 2024-09-22T08:36:44.176 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.160+0000 7ff670c13800 1 -- 172.21.15.142:0/3957222728 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5557102ecfd0 con 0x7ff65c0541f0 2024-09-22T08:36:44.176 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.161+0000 7ff663b47640 1 -- 172.21.15.142:0/3957222728 <== osd.1 v2:172.21.15.142:6816/3192108003 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93832422014064] v30'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff654051070 con 0x5557102dd3e0 2024-09-22T08:36:44.177 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.162+0000 7ff663b47640 1 -- 172.21.15.142:0/3957222728 <== osd.0 v2:172.21.15.31:6800/168281188 11 ==== osd_op_reply(54 notify.5 [create] v30'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff654051070 con 0x7ff65c0541f0 2024-09-22T08:36:44.177 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.162+0000 7ff670c13800 1 -- 172.21.15.142:0/3957222728 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93832422007408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5557102ecfd0 con 0x7ff65c0541f0 2024-09-22T08:36:44.177 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.162+0000 7ff670c13800 1 -- 172.21.15.142:0/3957222728 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5557102eda20 con 0x7ff65c0541f0 2024-09-22T08:36:44.177 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.163+0000 7ff663b47640 1 -- 172.21.15.142:0/3957222728 <== osd.0 v2:172.21.15.31:6800/168281188 12 ==== osd_op_reply(56 notify.6 [create] v30'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff654051070 con 0x7ff65c0541f0 2024-09-22T08:36:44.177 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.163+0000 7ff670c13800 1 -- 172.21.15.142:0/3957222728 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93832422020400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5557102ede40 con 0x7ff65c0541f0 2024-09-22T08:36:44.177 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.163+0000 7ff670c13800 1 -- 172.21.15.142:0/3957222728 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5557102ee960 con 0x7ff65c0541f0 2024-09-22T08:36:44.177 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.163+0000 7ff663b47640 1 -- 172.21.15.142:0/3957222728 <== osd.0 v2:172.21.15.31:6800/168281188 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93832422007408] v30'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff654051070 con 0x7ff65c0541f0 2024-09-22T08:36:44.177 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.164+0000 7ff663b47640 1 -- 172.21.15.142:0/3957222728 <== osd.0 v2:172.21.15.31:6800/168281188 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93832422020400] v30'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff654051070 con 0x7ff65c0541f0 2024-09-22T08:36:44.177 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.164+0000 7ff663b47640 1 -- 172.21.15.142:0/3957222728 <== osd.0 v2:172.21.15.31:6800/168281188 15 ==== osd_op_reply(58 notify.7 [create] v30'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff654051070 con 0x7ff65c0541f0 2024-09-22T08:36:44.177 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.164+0000 7ff670c13800 1 -- 172.21.15.142:0/3957222728 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93832422024240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5557102ed950 con 0x7ff65c0541f0 2024-09-22T08:36:44.178 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.164+0000 7ff670c13800 20 add_watcher() i=0 2024-09-22T08:36:44.178 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.164+0000 7ff670c13800 20 add_watcher() i=1 2024-09-22T08:36:44.178 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.164+0000 7ff670c13800 20 add_watcher() i=2 2024-09-22T08:36:44.178 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.164+0000 7ff670c13800 20 add_watcher() i=3 2024-09-22T08:36:44.178 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.164+0000 7ff670c13800 20 add_watcher() i=4 2024-09-22T08:36:44.178 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.164+0000 7ff670c13800 20 add_watcher() i=5 2024-09-22T08:36:44.178 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.164+0000 7ff670c13800 20 add_watcher() i=6 2024-09-22T08:36:44.178 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.164+0000 7ff663b47640 1 -- 172.21.15.142:0/3957222728 <== osd.0 v2:172.21.15.31:6800/168281188 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93832422024240] v30'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff654051070 con 0x7ff65c0541f0 2024-09-22T08:36:44.178 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.164+0000 7ff670c13800 20 add_watcher() i=7 2024-09-22T08:36:44.178 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.164+0000 7ff670c13800 2 all 8 watchers are set, enabling cache 2024-09-22T08:36:44.178 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.164+0000 7ff670c13800 1 -- 172.21.15.142:0/3957222728 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5557102f1950 con 0x5557102dd3e0 2024-09-22T08:36:44.179 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.165+0000 7ff663b47640 1 -- 172.21.15.142:0/3957222728 <== osd.1 v2:172.21.15.142:6816/3192108003 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7ff654051070 con 0x5557102dd3e0 2024-09-22T08:36:44.179 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.165+0000 7ff670c13800 1 -- 172.21.15.142:0/3957222728 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93832422017712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5557102eee70 con 0x5557102dd3e0 2024-09-22T08:36:44.179 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.166+0000 7ff663b47640 1 -- 172.21.15.142:0/3957222728 <== osd.1 v2:172.21.15.142:6816/3192108003 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93832422017712] v30'72 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff654051070 con 0x5557102dd3e0 2024-09-22T08:36:44.179 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.166+0000 7ff5227e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:36:44.179 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.166+0000 7ff670c13800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:36:44.179 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.166+0000 7ff670c13800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:36:44.179 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.166+0000 7ff670c13800 5 note: GC not initialized 2024-09-22T08:36:44.179 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.166+0000 7ff5217e2640 20 reqs_thread_entry: start 2024-09-22T08:36:44.179 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.166+0000 7ff670c13800 20 init_complete bucket index max shards: 11 2024-09-22T08:36:44.179 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.166+0000 7ff670c13800 20 Filter name: none 2024-09-22T08:36:44.179 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.166+0000 7ff492ffd640 20 reqs_thread_entry: start 2024-09-22T08:36:44.179 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.167+0000 7ff670c13800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-22T08:36:44.179 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.167+0000 7ff670c13800 20 rados->read ofs=0 len=0 2024-09-22T08:36:44.179 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.167+0000 7ff670c13800 1 -- 172.21.15.142:0/3957222728 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x555710324c80 con 0x5557102dd3e0 2024-09-22T08:36:44.180 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.167+0000 7ff663b47640 1 -- 172.21.15.142:0/3957222728 <== osd.1 v2:172.21.15.142:6816/3192108003 21 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv6 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7ff654051070 con 0x5557102dd3e0 2024-09-22T08:36:44.180 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.167+0000 7ff670c13800 20 rados_obj.operate() r=0 bl.length=556 2024-09-22T08:36:44.180 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.167+0000 7ff670c13800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-22T08:36:44.180 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.167+0000 7ff670c13800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-22T08:36:44.180 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.167+0000 7ff670c13800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:36:44.180 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.167+0000 7ff670c13800 1 -- 172.21.15.142:0/3957222728 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~556 in=556b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55571032b3f0 con 0x5557102dd3e0 2024-09-22T08:36:44.180 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.168+0000 7ff663b47640 1 -- 172.21.15.142:0/3957222728 <== osd.1 v2:172.21.15.142:6816/3192108003 22 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~556] v30'7 uv7 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7ff654051070 con 0x5557102dd3e0 2024-09-22T08:36:44.180 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.168+0000 7ff670c13800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-22T08:36:44.180 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.168+0000 7ff670c13800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-22T08:36:44.180 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.168+0000 7ff670c13800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-22T08:36:44.180 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.168+0000 7ff670c13800 1 -- 172.21.15.142:0/3957222728 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 93832422272496 in=744b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x555710326af0 con 0x5557102dd3e0 2024-09-22T08:36:44.180 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.168+0000 7ff663b47640 1 -- 172.21.15.142:0/3957222728 <== osd.1 v2:172.21.15.142:6816/3192108003 23 ==== watch-notify(notify (1) cookie 93832422014064 notify 128849018886 ret 0) ==== 774+0+0 (crc 0 0 0) 0x7ff654081040 con 0x5557102dd3e0 2024-09-22T08:36:44.180 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.168+0000 7ff54b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018886 cookie 93832422014064 notifier 4366 bl.length()=732 2024-09-22T08:36:44.180 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.168+0000 7ff54b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-22T08:36:44.181 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.168+0000 7ff54b7fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-22T08:36:44.181 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.168+0000 7ff54b7fe640 1 -- 172.21.15.142:0/3957222728 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7ff530003ea0 con 0x5557102dd3e0 2024-09-22T08:36:44.181 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.168+0000 7ff663b47640 1 -- 172.21.15.142:0/3957222728 <== osd.1 v2:172.21.15.142:6816/3192108003 24 ==== osd_op_reply(64 notify.4 [notify cookie 93832422272496 out=8b] v0'0 uv57 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7ff654051070 con 0x5557102dd3e0 2024-09-22T08:36:44.181 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.169+0000 7ff663b47640 1 -- 172.21.15.142:0/3957222728 <== osd.1 v2:172.21.15.142:6816/3192108003 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff654051070 con 0x5557102dd3e0 2024-09-22T08:36:44.181 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.169+0000 7ff663b47640 1 -- 172.21.15.142:0/3957222728 <== osd.1 v2:172.21.15.142:6816/3192108003 26 ==== watch-notify(notify_complete (2) cookie 93832422272496 notify 128849018886 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5557101b37e0 con 0x5557102dd3e0 2024-09-22T08:36:44.181 INFO:teuthology.orchestra.run.smithi142.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-22T08:36:42.661297Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-22T08:36:42.661288Z","tags":[],"group_ids":[]} 2024-09-22T08:36:44.186 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.170+0000 7ff5227e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:36:44.186 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.170+0000 7ff670c13800 1 -- 172.21.15.142:0/3957222728 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93832422017712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555710326640 con 0x5557102dd3e0 2024-09-22T08:36:44.186 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.171+0000 7ff663b47640 1 -- 172.21.15.142:0/3957222728 <== osd.1 v2:172.21.15.142:6816/3192108003 27 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 93832422017712] v30'73 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff654051070 con 0x5557102dd3e0 2024-09-22T08:36:44.186 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.171+0000 7ff670c13800 1 -- 172.21.15.142:0/3957222728 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93832421997584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5557103229a0 con 0x7ff664033440 2024-09-22T08:36:44.186 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.171+0000 7ff66c348640 1 -- 172.21.15.142:0/3957222728 <== osd.2 v2:172.21.15.142:6808/279438927 11 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 93832421997584] v30'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff65c039070 con 0x7ff664033440 2024-09-22T08:36:44.186 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.171+0000 7ff670c13800 20 remove_watcher() i=0 2024-09-22T08:36:44.186 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.171+0000 7ff670c13800 2 removed watcher, disabling cache 2024-09-22T08:36:44.186 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.172+0000 7ff670c13800 1 -- 172.21.15.142:0/3957222728 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93832422004720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5557103229a0 con 0x5557102dd3e0 2024-09-22T08:36:44.186 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.173+0000 7ff663b47640 1 -- 172.21.15.142:0/3957222728 <== osd.1 v2:172.21.15.142:6816/3192108003 28 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 93832422004720] v30'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff654051070 con 0x5557102dd3e0 2024-09-22T08:36:44.186 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.173+0000 7ff670c13800 20 remove_watcher() i=1 2024-09-22T08:36:44.186 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.173+0000 7ff670c13800 1 -- 172.21.15.142:0/3957222728 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93832422006256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5557103229a0 con 0x5557102e1df0 2024-09-22T08:36:44.186 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.174+0000 7ff66cb49640 1 -- 172.21.15.142:0/3957222728 <== osd.3 v2:172.21.15.142:6800/1064901393 16 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 93832422006256] v30'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff664053020 con 0x5557102e1df0 2024-09-22T08:36:44.187 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.174+0000 7ff670c13800 20 remove_watcher() i=2 2024-09-22T08:36:44.187 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.174+0000 7ff670c13800 1 -- 172.21.15.142:0/3957222728 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93832422010384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5557103229a0 con 0x7ff664033440 2024-09-22T08:36:44.187 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.175+0000 7ff66c348640 1 -- 172.21.15.142:0/3957222728 <== osd.2 v2:172.21.15.142:6808/279438927 12 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 93832422010384] v30'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff65c039070 con 0x7ff664033440 2024-09-22T08:36:44.187 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.175+0000 7ff670c13800 20 remove_watcher() i=3 2024-09-22T08:36:44.187 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.175+0000 7ff670c13800 1 -- 172.21.15.142:0/3957222728 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93832422014064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5557103229a0 con 0x5557102dd3e0 2024-09-22T08:36:44.187 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.176+0000 7ff663b47640 1 -- 172.21.15.142:0/3957222728 <== osd.1 v2:172.21.15.142:6816/3192108003 29 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 93832422014064] v30'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff654051070 con 0x5557102dd3e0 2024-09-22T08:36:44.187 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.176+0000 7ff670c13800 20 remove_watcher() i=4 2024-09-22T08:36:44.187 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.176+0000 7ff670c13800 1 -- 172.21.15.142:0/3957222728 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93832422007408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5557103229a0 con 0x7ff65c0541f0 2024-09-22T08:36:44.187 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.177+0000 7ff663b47640 1 -- 172.21.15.142:0/3957222728 <== osd.0 v2:172.21.15.31:6800/168281188 17 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 93832422007408] v30'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff654051070 con 0x7ff65c0541f0 2024-09-22T08:36:44.187 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.177+0000 7ff670c13800 20 remove_watcher() i=5 2024-09-22T08:36:44.187 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.177+0000 7ff670c13800 1 -- 172.21.15.142:0/3957222728 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93832422020400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5557103229a0 con 0x7ff65c0541f0 2024-09-22T08:36:44.187 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.178+0000 7ff663b47640 1 -- 172.21.15.142:0/3957222728 <== osd.0 v2:172.21.15.31:6800/168281188 18 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 93832422020400] v30'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff654051070 con 0x7ff65c0541f0 2024-09-22T08:36:44.187 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.178+0000 7ff670c13800 20 remove_watcher() i=6 2024-09-22T08:36:44.188 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.178+0000 7ff670c13800 1 -- 172.21.15.142:0/3957222728 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93832422024240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5557103229a0 con 0x7ff65c0541f0 2024-09-22T08:36:44.188 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.179+0000 7ff663b47640 1 -- 172.21.15.142:0/3957222728 <== osd.0 v2:172.21.15.31:6800/168281188 19 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 93832422024240] v30'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff654051070 con 0x7ff65c0541f0 2024-09-22T08:36:44.188 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.179+0000 7ff670c13800 20 remove_watcher() i=7 2024-09-22T08:36:44.188 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.179+0000 7ff670c13800 1 -- 172.21.15.142:0/3957222728 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7ff65c0541f0 msgr2=0x7ff65c054630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:44.188 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.179+0000 7ff670c13800 1 --2- 172.21.15.142:0/3957222728 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7ff65c0541f0 0x7ff65c054630 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:44.188 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.179+0000 7ff670c13800 1 -- 172.21.15.142:0/3957222728 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5557102dd3e0 msgr2=0x5557102df8a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:44.188 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.179+0000 7ff670c13800 1 --2- 172.21.15.142:0/3957222728 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5557102dd3e0 0x5557102df8a0 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:44.188 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.179+0000 7ff670c13800 1 -- 172.21.15.142:0/3957222728 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7ff664033440 msgr2=0x7ff664045130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:44.188 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.179+0000 7ff670c13800 1 --2- 172.21.15.142:0/3957222728 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7ff664033440 0x7ff664045130 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:44.188 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.179+0000 7ff670c13800 1 -- 172.21.15.142:0/3957222728 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5557102e1df0 msgr2=0x5557102e41e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:44.188 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.179+0000 7ff670c13800 1 --2- 172.21.15.142:0/3957222728 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5557102e1df0 0x5557102e41e0 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:44.189 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.179+0000 7ff670c13800 1 -- 172.21.15.142:0/3957222728 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7ff53c03d000 msgr2=0x7ff53c03f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:44.189 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.179+0000 7ff670c13800 1 --2- 172.21.15.142:0/3957222728 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7ff53c03d000 0x7ff53c03f4c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7ff65c00efd0 tx=0x7ff65c041000 comp rx=0 tx=0).stop 2024-09-22T08:36:44.189 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.179+0000 7ff663b47640 1 -- 172.21.15.142:0/3957222728 reap_dead start 2024-09-22T08:36:44.189 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.179+0000 7ff670c13800 1 -- 172.21.15.142:0/3957222728 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5557102ca670 msgr2=0x5557102d1c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:44.189 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.179+0000 7ff670c13800 1 --2- 172.21.15.142:0/3957222728 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5557102ca670 0x5557102d1c60 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7ff664014400 tx=0x7ff66404e000 comp rx=0 tx=0).stop 2024-09-22T08:36:44.189 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.179+0000 7ff670c13800 1 -- 172.21.15.142:0/3957222728 shutdown_connections 2024-09-22T08:36:44.189 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.179+0000 7ff670c13800 1 --2- 172.21.15.142:0/3957222728 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5557102ca670 0x5557102d1c60 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:44.189 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.179+0000 7ff670c13800 1 -- 172.21.15.142:0/3957222728 >> 172.21.15.142:0/3957222728 conn(0x5557102c6a90 msgr2=0x5557102c4ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:44.189 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.179+0000 7ff670c13800 1 -- 172.21.15.142:0/3957222728 shutdown_connections 2024-09-22T08:36:44.189 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.179+0000 7ff670c13800 1 -- 172.21.15.142:0/3957222728 wait complete. 2024-09-22T08:36:44.189 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.179+0000 7ff670c13800 1 -- 172.21.15.142:0/544614797 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7ff54403d070 msgr2=0x7ff54403f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:44.189 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.179+0000 7ff670c13800 1 --2- 172.21.15.142:0/544614797 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7ff54403d070 0x7ff54403f530 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ff65c0531e0 tx=0x7ff65c0011b0 comp rx=0 tx=0).stop 2024-09-22T08:36:44.189 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.179+0000 7ff670c13800 1 -- 172.21.15.142:0/544614797 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5557102bdc10 msgr2=0x5557102be030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:44.190 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.179+0000 7ff670c13800 1 --2- 172.21.15.142:0/544614797 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5557102bdc10 0x5557102be030 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x5557102a3c20 tx=0x7ff6640167b0 comp rx=0 tx=0).stop 2024-09-22T08:36:44.190 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.179+0000 7ff670c13800 1 -- 172.21.15.142:0/544614797 shutdown_connections 2024-09-22T08:36:44.190 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.180+0000 7ff670c13800 1 --2- 172.21.15.142:0/544614797 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7ff54403d070 0x7ff54403f530 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:44.190 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.180+0000 7ff670c13800 1 --2- 172.21.15.142:0/544614797 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5557102bdc10 0x5557102be030 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:44.190 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.180+0000 7ff670c13800 1 -- 172.21.15.142:0/544614797 >> 172.21.15.142:0/544614797 conn(0x5557102b1fc0 msgr2=0x5557102b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:44.190 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.180+0000 7ff670c13800 1 -- 172.21.15.142:0/544614797 shutdown_connections 2024-09-22T08:36:44.190 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.180+0000 7ff670c13800 1 -- 172.21.15.142:0/544614797 wait complete. 2024-09-22T08:36:44.190 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.180+0000 7ff670c13800 1 -- 172.21.15.142:0/595942472 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5557101afc10 msgr2=0x5557102aa270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:44.190 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.180+0000 7ff670c13800 1 --2- 172.21.15.142:0/595942472 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5557101afc10 0x5557102aa270 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:44.190 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.180+0000 7ff670c13800 1 -- 172.21.15.142:0/595942472 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5557102ac650 msgr2=0x5557102aead0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:44.190 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.180+0000 7ff670c13800 1 --2- 172.21.15.142:0/595942472 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5557102ac650 0x5557102aead0 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:44.190 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.180+0000 7ff670c13800 1 -- 172.21.15.142:0/595942472 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7ff55403d1a0 msgr2=0x7ff55403f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:44.191 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.180+0000 7ff670c13800 1 --2- 172.21.15.142:0/595942472 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7ff55403d1a0 0x7ff55403f660 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7ff654057000 tx=0x7ff654052000 comp rx=0 tx=0).stop 2024-09-22T08:36:44.191 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.180+0000 7ff670c13800 1 -- 172.21.15.142:0/595942472 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55571011cd30 msgr2=0x5557102a2c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:44.191 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.180+0000 7ff670c13800 1 --2- 172.21.15.142:0/595942472 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55571011cd30 0x5557102a2c20 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7ff65c0012f0 tx=0x7ff65c000ed0 comp rx=0 tx=0).stop 2024-09-22T08:36:44.191 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.180+0000 7ff670c13800 1 -- 172.21.15.142:0/595942472 shutdown_connections 2024-09-22T08:36:44.191 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.180+0000 7ff670c13800 1 --2- 172.21.15.142:0/595942472 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5557102ac650 0x5557102aead0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:44.191 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.180+0000 7ff670c13800 1 --2- 172.21.15.142:0/595942472 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5557101afc10 0x5557102aa270 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:44.191 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.180+0000 7ff670c13800 1 --2- 172.21.15.142:0/595942472 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7ff55403d1a0 0x7ff55403f660 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:44.191 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.180+0000 7ff670c13800 1 --2- 172.21.15.142:0/595942472 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55571011cd30 0x5557102a2c20 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:44.191 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.180+0000 7ff670c13800 1 -- 172.21.15.142:0/595942472 >> 172.21.15.142:0/595942472 conn(0x5557101a3bd0 msgr2=0x55571029c620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:44.191 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.180+0000 7ff670c13800 1 -- 172.21.15.142:0/595942472 shutdown_connections 2024-09-22T08:36:44.191 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.180+0000 7ff670c13800 1 -- 172.21.15.142:0/595942472 wait complete. 2024-09-22T08:36:44.192 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-22T08:36:42.661297Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-22T08:36:42.661288Z', 'tags': [], 'group_ids': []} 2024-09-22T08:36:44.192 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-22T08:36:44.192 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-22T08:36:44.193 DEBUG:teuthology.orchestra.run.smithi142:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-22T08:36:44.237 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:36:44.237 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:36:44.238 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.237+0000 7fd1ca81d800 1 Processor -- start 2024-09-22T08:36:44.239 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.237+0000 7fd1ca81d800 1 -- start start 2024-09-22T08:36:44.239 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.237+0000 7fd1ca81d800 1 --2- >> v2:172.21.15.31:3300/0 conn(0x56451cd370f0 0x56451cd394e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:44.239 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.237+0000 7fd1ca81d800 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56451cbc1a20 con 0x56451cd39a20 2024-09-22T08:36:44.239 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.237+0000 7fd1ca81d800 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x56451cbc17d0 con 0x56451cd370f0 2024-09-22T08:36:44.239 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.237+0000 7fd1c5feb640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x56451cd370f0 0x56451cd394e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:44.239 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.237+0000 7fd1bd7ea640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x56451cd39a20 0x56451cd3be10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.142:42406/0 (socket says 172.21.15.142:42406) 2024-09-22T08:36:44.239 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.237+0000 7fd1bd7ea640 1 -- 172.21.15.142:0/453502992 learned_addr learned my addr 172.21.15.142:0/453502992 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-09-22T08:36:44.239 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.237+0000 7fd1c5feb640 1 -- 172.21.15.142:0/453502992 >> v1:172.21.15.31:6789/0 conn(0x56451cd39a20 legacy=0x56451cd3be10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:44.239 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.237+0000 7fd1c57ea640 1 -- 172.21.15.142:0/453502992 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2676374631 0 0) 0x56451cbc1a20 con 0x56451cd39a20 2024-09-22T08:36:44.240 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.237+0000 7fd1c5feb640 1 -- 172.21.15.142:0/453502992 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56451cd3e570 con 0x56451cd370f0 2024-09-22T08:36:44.241 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.239+0000 7fd1c5feb640 1 --2- 172.21.15.142:0/453502992 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56451cd370f0 0x56451cd394e0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fd1b800a470 tx=0x7fd1b8045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed982be30c759e77 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:44.241 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.240+0000 7fd1c57ea640 1 -- 172.21.15.142:0/453502992 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd1b8053570 con 0x56451cd370f0 2024-09-22T08:36:44.241 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.240+0000 7fd1c57ea640 1 -- 172.21.15.142:0/453502992 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1b8058070 con 0x56451cd370f0 2024-09-22T08:36:44.241 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.240+0000 7fd1c57ea640 1 -- 172.21.15.142:0/453502992 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd1b8053880 con 0x56451cd370f0 2024-09-22T08:36:44.242 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.240+0000 7fd1ca81d800 1 -- 172.21.15.142:0/453502992 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56451cd370f0 msgr2=0x56451cd394e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:44.242 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.240+0000 7fd1ca81d800 1 --2- 172.21.15.142:0/453502992 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56451cd370f0 0x56451cd394e0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fd1b800a470 tx=0x7fd1b8045a20 comp rx=0 tx=0).stop 2024-09-22T08:36:44.242 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.240+0000 7fd1ca81d800 1 -- 172.21.15.142:0/453502992 shutdown_connections 2024-09-22T08:36:44.242 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.240+0000 7fd1ca81d800 1 --2- 172.21.15.142:0/453502992 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56451cd370f0 0x56451cd394e0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:44.242 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.240+0000 7fd1ca81d800 1 -- 172.21.15.142:0/453502992 >> 172.21.15.142:0/453502992 conn(0x56451cd30bb0 msgr2=0x56451cd33010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:44.242 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.240+0000 7fd1ca81d800 1 -- 172.21.15.142:0/453502992 shutdown_connections 2024-09-22T08:36:44.242 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.240+0000 7fd1ca81d800 1 -- 172.21.15.142:0/453502992 wait complete. 2024-09-22T08:36:44.255 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.254+0000 7fd1ca81d800 1 Processor -- start 2024-09-22T08:36:44.256 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.254+0000 7fd1ca81d800 1 -- start start 2024-09-22T08:36:44.256 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.254+0000 7fd1ca81d800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56451cd370f0 0x56451cd36860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:44.256 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.254+0000 7fd1ca81d800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x56451cbcedd0 con 0x56451cd370f0 2024-09-22T08:36:44.256 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.254+0000 7fd1c5feb640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56451cd370f0 0x56451cd36860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:44.256 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.254+0000 7fd1c5feb640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56451cd370f0 0x56451cd36860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:38534/0 (socket says 172.21.15.142:38534) 2024-09-22T08:36:44.256 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.254+0000 7fd1c5feb640 1 -- 172.21.15.142:0/3311756710 learned_addr learned my addr 172.21.15.142:0/3311756710 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:44.256 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.255+0000 7fd1c5feb640 1 -- 172.21.15.142:0/3311756710 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56451cd36e50 con 0x56451cd370f0 2024-09-22T08:36:44.258 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.255+0000 7fd1c5feb640 1 --2- 172.21.15.142:0/3311756710 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56451cd370f0 0x56451cd36860 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fd1b8025c20 tx=0x7fd1b8051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5dbf4d78fdf2b6bc server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:44.258 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.255+0000 7fd0b3e07640 1 -- 172.21.15.142:0/3311756710 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd1b8053a20 con 0x56451cd370f0 2024-09-22T08:36:44.258 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.255+0000 7fd0b3e07640 1 -- 172.21.15.142:0/3311756710 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1b8063070 con 0x56451cd370f0 2024-09-22T08:36:44.259 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.255+0000 7fd0b3e07640 1 -- 172.21.15.142:0/3311756710 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd1b8053d30 con 0x56451cd370f0 2024-09-22T08:36:44.259 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.256+0000 7fd1ca81d800 1 -- 172.21.15.142:0/3311756710 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56451cd370f0 msgr2=0x56451cd36860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:44.259 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.256+0000 7fd1ca81d800 1 --2- 172.21.15.142:0/3311756710 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56451cd370f0 0x56451cd36860 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fd1b8025c20 tx=0x7fd1b8051000 comp rx=0 tx=0).stop 2024-09-22T08:36:44.259 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.256+0000 7fd1ca81d800 1 -- 172.21.15.142:0/3311756710 shutdown_connections 2024-09-22T08:36:44.259 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.256+0000 7fd1ca81d800 1 --2- 172.21.15.142:0/3311756710 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56451cd370f0 0x56451cd36860 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:44.259 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.256+0000 7fd1ca81d800 1 -- 172.21.15.142:0/3311756710 >> 172.21.15.142:0/3311756710 conn(0x56451cd30bb0 msgr2=0x56451ce21800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:44.259 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.256+0000 7fd1ca81d800 1 -- 172.21.15.142:0/3311756710 shutdown_connections 2024-09-22T08:36:44.259 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.256+0000 7fd1ca81d800 1 -- 172.21.15.142:0/3311756710 wait complete. 2024-09-22T08:36:44.259 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.256+0000 7fd1ca81d800 1 Processor -- start 2024-09-22T08:36:44.259 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.256+0000 7fd1ca81d800 1 -- start start 2024-09-22T08:36:44.259 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.256+0000 7fd1ca81d800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56451cd370f0 0x56451ce2fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:44.259 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.256+0000 7fd1ca81d800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x56451cd3d830 con 0x56451cd370f0 2024-09-22T08:36:44.260 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.256+0000 7fd1c5feb640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56451cd370f0 0x56451ce2fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:44.260 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.256+0000 7fd1c5feb640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56451cd370f0 0x56451ce2fb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:38536/0 (socket says 172.21.15.142:38536) 2024-09-22T08:36:44.260 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.256+0000 7fd1c5feb640 1 -- 172.21.15.142:0/4012985376 learned_addr learned my addr 172.21.15.142:0/4012985376 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:44.260 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.257+0000 7fd1c5feb640 1 -- 172.21.15.142:0/4012985376 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56451ce300b0 con 0x56451cd370f0 2024-09-22T08:36:44.260 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.257+0000 7fd1c5feb640 1 --2- 172.21.15.142:0/4012985376 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56451cd370f0 0x56451ce2fb50 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fd1b8025c20 tx=0x7fd1b8002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:44.260 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.257+0000 7fd0b2604640 1 -- 172.21.15.142:0/4012985376 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd1b8078070 con 0x56451cd370f0 2024-09-22T08:36:44.260 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.257+0000 7fd0b2604640 1 -- 172.21.15.142:0/4012985376 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1b8073470 con 0x56451cd370f0 2024-09-22T08:36:44.260 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.257+0000 7fd1ca81d800 1 -- 172.21.15.142:0/4012985376 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56451ce30340 con 0x56451cd370f0 2024-09-22T08:36:44.260 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.257+0000 7fd0b2604640 1 -- 172.21.15.142:0/4012985376 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd1b8073750 con 0x56451cd370f0 2024-09-22T08:36:44.260 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.257+0000 7fd1ca81d800 1 -- 172.21.15.142:0/4012985376 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56451ce30f50 con 0x56451cd370f0 2024-09-22T08:36:44.264 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.258+0000 7fd0b2604640 1 -- 172.21.15.142:0/4012985376 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fd1b807b070 con 0x56451cd370f0 2024-09-22T08:36:44.264 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.258+0000 7fd0b2604640 1 --2- 172.21.15.142:0/4012985376 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fd0ac03d000 0x7fd0ac03f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:44.264 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.258+0000 7fd0b2604640 1 -- 172.21.15.142:0/4012985376 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fd1b8098510 con 0x56451cd370f0 2024-09-22T08:36:44.264 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.258+0000 7fd1bd7ea640 1 --2- 172.21.15.142:0/4012985376 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fd0ac03d000 0x7fd0ac03f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:44.264 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.258+0000 7fd1ca81d800 1 --2- 172.21.15.142:0/4012985376 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x56451cd39a20 0x56451ce371a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:44.264 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.258+0000 7fd1ca81d800 1 -- 172.21.15.142:0/4012985376 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56451ce31910 con 0x56451cd39a20 2024-09-22T08:36:44.264 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.258+0000 7fd1c67ec640 1 --2- 172.21.15.142:0/4012985376 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x56451cd39a20 0x56451ce371a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:44.264 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.259+0000 7fd1bd7ea640 1 --2- 172.21.15.142:0/4012985376 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fd0ac03d000 0x7fd0ac03f4c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fd1b0000c00 tx=0x7fd1b00013b0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:44.264 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.259+0000 7fd1c67ec640 1 --2- 172.21.15.142:0/4012985376 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x56451cd39a20 0x56451ce371a0 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:44.264 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.259+0000 7fd1c67ec640 1 -- 172.21.15.142:0/4012985376 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd1c000a4d0 con 0x56451cd39a20 2024-09-22T08:36:44.264 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.259+0000 7fd1ca81d800 1 -- 172.21.15.142:0/4012985376 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56451ce312c0 con 0x56451cd39a20 2024-09-22T08:36:44.264 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.259+0000 7fd1c67ec640 1 -- 172.21.15.142:0/4012985376 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd1c000a4d0 con 0x56451cd39a20 2024-09-22T08:36:44.265 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.259+0000 7fd1ca81d800 1 --2- 172.21.15.142:0/4012985376 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x56451ce39610 0x56451ce3ba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:44.265 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.259+0000 7fd1ca81d800 1 -- 172.21.15.142:0/4012985376 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:3 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56451ce3c0d0 con 0x56451ce39610 2024-09-22T08:36:44.265 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.259+0000 7fd1c5feb640 1 --2- 172.21.15.142:0/4012985376 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x56451ce39610 0x56451ce3ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:44.265 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.260+0000 7fd1c5feb640 1 --2- 172.21.15.142:0/4012985376 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x56451ce39610 0x56451ce3ba00 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:44.265 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.260+0000 7fd1c5feb640 1 -- 172.21.15.142:0/4012985376 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(3 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fd1b807a030 con 0x56451ce39610 2024-09-22T08:36:44.265 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.260+0000 7fd1ca81d800 1 -- 172.21.15.142:0/4012985376 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56451ce384b0 con 0x56451cd39a20 2024-09-22T08:36:44.265 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.260+0000 7fd1c67ec640 1 -- 172.21.15.142:0/4012985376 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd1c000a4d0 con 0x56451cd39a20 2024-09-22T08:36:44.265 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.260+0000 7fd1ca81d800 1 -- 172.21.15.142:0/4012985376 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56451ce38910 con 0x56451ce39610 2024-09-22T08:36:44.265 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.261+0000 7fd1c5feb640 1 -- 172.21.15.142:0/4012985376 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(5 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fd1b807a030 con 0x56451ce39610 2024-09-22T08:36:44.265 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.261+0000 7fd1ca81d800 1 Processor -- start 2024-09-22T08:36:44.266 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.261+0000 7fd1ca81d800 1 -- start start 2024-09-22T08:36:44.266 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.261+0000 7fd1ca81d800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56451ce4aa50 0x56451ce4ae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:44.266 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.261+0000 7fd1ca81d800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x56451cc2dd50 con 0x56451ce4aa50 2024-09-22T08:36:44.266 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.261+0000 7fd1c67ec640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56451ce4aa50 0x56451ce4ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:44.266 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.261+0000 7fd1c67ec640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56451ce4aa50 0x56451ce4ae70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:38538/0 (socket says 172.21.15.142:38538) 2024-09-22T08:36:44.266 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.261+0000 7fd1c67ec640 1 -- 172.21.15.142:0/2539605709 learned_addr learned my addr 172.21.15.142:0/2539605709 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:44.266 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.262+0000 7fd1c67ec640 1 -- 172.21.15.142:0/2539605709 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56451ce4b4b0 con 0x56451ce4aa50 2024-09-22T08:36:44.266 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.262+0000 7fd1c67ec640 1 --2- 172.21.15.142:0/2539605709 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56451ce4aa50 0x56451ce4ae70 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x56451ce30b50 tx=0x7fd1c00167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:44.266 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.262+0000 7fd0ab7fe640 1 -- 172.21.15.142:0/2539605709 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd1c0013640 con 0x56451ce4aa50 2024-09-22T08:36:44.266 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.262+0000 7fd0ab7fe640 1 -- 172.21.15.142:0/2539605709 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1c00137e0 con 0x56451ce4aa50 2024-09-22T08:36:44.266 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.262+0000 7fd1ca81d800 1 -- 172.21.15.142:0/2539605709 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56451ce4bce0 con 0x56451ce4aa50 2024-09-22T08:36:44.266 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.262+0000 7fd0ab7fe640 1 -- 172.21.15.142:0/2539605709 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd1c0013ae0 con 0x56451ce4aa50 2024-09-22T08:36:44.267 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.262+0000 7fd1ca81d800 1 -- 172.21.15.142:0/2539605709 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56451ce4c280 con 0x56451ce4aa50 2024-09-22T08:36:44.276 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.263+0000 7fd0ab7fe640 1 -- 172.21.15.142:0/2539605709 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fd1c0011040 con 0x56451ce4aa50 2024-09-22T08:36:44.276 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.263+0000 7fd0ab7fe640 1 --2- 172.21.15.142:0/2539605709 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fd0a003d000 0x7fd0a003f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:44.276 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.263+0000 7fd0ab7fe640 1 -- 172.21.15.142:0/2539605709 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fd1c000e040 con 0x56451ce4aa50 2024-09-22T08:36:44.276 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.263+0000 7fd1c5feb640 1 --2- 172.21.15.142:0/2539605709 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fd0a003d000 0x7fd0a003f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:44.276 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.263+0000 7fd1ca81d800 1 Processor -- start 2024-09-22T08:36:44.276 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.263+0000 7fd1c5feb640 1 --2- 172.21.15.142:0/2539605709 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fd0a003d000 0x7fd0a003f4c0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x56451ce377b0 tx=0x7fd1b8096cc0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:44.276 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.263+0000 7fd1ca81d800 1 -- start start 2024-09-22T08:36:44.276 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.264+0000 7fd1ca81d800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56451ce574d0 0x56451ce578d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:44.276 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.264+0000 7fd1ca81d800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x56451cd352a0 con 0x56451ce574d0 2024-09-22T08:36:44.277 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.264+0000 7fd1c67ec640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56451ce574d0 0x56451ce578d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:44.277 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.264+0000 7fd1c67ec640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56451ce574d0 0x56451ce578d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:38554/0 (socket says 172.21.15.142:38554) 2024-09-22T08:36:44.277 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.264+0000 7fd1c67ec640 1 -- 172.21.15.142:0/947550483 learned_addr learned my addr 172.21.15.142:0/947550483 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:44.277 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.264+0000 7fd1c67ec640 1 -- 172.21.15.142:0/947550483 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56451ce57ec0 con 0x56451ce574d0 2024-09-22T08:36:44.277 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.264+0000 7fd1c67ec640 1 --2- 172.21.15.142:0/947550483 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56451ce574d0 0x56451ce578d0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fd1c00547f0 tx=0x7fd1c001fe70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56827bb947090f75 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:44.277 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.264+0000 7fd0a97fa640 1 -- 172.21.15.142:0/947550483 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd1c0044030 con 0x56451ce574d0 2024-09-22T08:36:44.277 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.264+0000 7fd0a97fa640 1 -- 172.21.15.142:0/947550483 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1c0021960 con 0x56451ce574d0 2024-09-22T08:36:44.277 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.264+0000 7fd0a97fa640 1 -- 172.21.15.142:0/947550483 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd1c001f340 con 0x56451ce574d0 2024-09-22T08:36:44.277 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.265+0000 7fd1ca81d800 1 -- 172.21.15.142:0/947550483 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56451ce574d0 msgr2=0x56451ce578d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:44.277 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.265+0000 7fd1ca81d800 1 --2- 172.21.15.142:0/947550483 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56451ce574d0 0x56451ce578d0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fd1c00547f0 tx=0x7fd1c001fe70 comp rx=0 tx=0).stop 2024-09-22T08:36:44.277 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.265+0000 7fd1ca81d800 1 -- 172.21.15.142:0/947550483 shutdown_connections 2024-09-22T08:36:44.277 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.265+0000 7fd1ca81d800 1 --2- 172.21.15.142:0/947550483 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56451ce574d0 0x56451ce578d0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:44.277 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.265+0000 7fd1ca81d800 1 -- 172.21.15.142:0/947550483 >> 172.21.15.142:0/947550483 conn(0x56451ce538d0 msgr2=0x56451ce51b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:44.278 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.265+0000 7fd1ca81d800 1 -- 172.21.15.142:0/947550483 shutdown_connections 2024-09-22T08:36:44.278 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.265+0000 7fd1ca81d800 1 -- 172.21.15.142:0/947550483 wait complete. 2024-09-22T08:36:44.278 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.265+0000 7fd1ca81d800 1 Processor -- start 2024-09-22T08:36:44.278 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.265+0000 7fd1ca81d800 1 -- start start 2024-09-22T08:36:44.278 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.265+0000 7fd1ca81d800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56451ce574d0 0x56451ce5eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:44.278 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.265+0000 7fd1ca81d800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x56451ce584e0 con 0x56451ce574d0 2024-09-22T08:36:44.278 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.266+0000 7fd1c67ec640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56451ce574d0 0x56451ce5eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:44.278 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.266+0000 7fd1c67ec640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56451ce574d0 0x56451ce5eae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:38568/0 (socket says 172.21.15.142:38568) 2024-09-22T08:36:44.278 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.266+0000 7fd1c67ec640 1 -- 172.21.15.142:0/960400074 learned_addr learned my addr 172.21.15.142:0/960400074 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:44.278 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.266+0000 7fd1c67ec640 1 -- 172.21.15.142:0/960400074 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56451ce5f040 con 0x56451ce574d0 2024-09-22T08:36:44.278 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.266+0000 7fd1c67ec640 1 --2- 172.21.15.142:0/960400074 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56451ce574d0 0x56451ce5eae0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fd1c0022ff0 tx=0x7fd1c001fee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:44.278 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.266+0000 7fd0977fe640 1 -- 172.21.15.142:0/960400074 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd1c0045e60 con 0x56451ce574d0 2024-09-22T08:36:44.279 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.266+0000 7fd0977fe640 1 -- 172.21.15.142:0/960400074 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1c0013c80 con 0x56451ce574d0 2024-09-22T08:36:44.279 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.266+0000 7fd1ca81d800 1 -- 172.21.15.142:0/960400074 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56451ce5f2d0 con 0x56451ce574d0 2024-09-22T08:36:44.279 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.266+0000 7fd0977fe640 1 -- 172.21.15.142:0/960400074 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd1c0021440 con 0x56451ce574d0 2024-09-22T08:36:44.279 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.266+0000 7fd1ca81d800 1 -- 172.21.15.142:0/960400074 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56451ce5f2d0 con 0x56451ce574d0 2024-09-22T08:36:44.279 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.267+0000 7fd0977fe640 1 -- 172.21.15.142:0/960400074 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fd1c0045130 con 0x56451ce574d0 2024-09-22T08:36:44.279 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.267+0000 7fd0977fe640 1 --2- 172.21.15.142:0/960400074 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fd09003cfb0 0x7fd09003f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:44.279 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.267+0000 7fd0977fe640 1 -- 172.21.15.142:0/960400074 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fd1c0034af0 con 0x56451ce574d0 2024-09-22T08:36:44.279 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.267+0000 7fd1c5feb640 1 --2- 172.21.15.142:0/960400074 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fd09003cfb0 0x7fd09003f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:44.279 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.267+0000 7fd1ca81d800 20 rados->read ofs=0 len=0 2024-09-22T08:36:44.279 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.267+0000 7fd1ca81d800 1 --2- 172.21.15.142:0/960400074 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x56451ce6a240 0x56451ce6c700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:44.279 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.267+0000 7fd1ca81d800 1 -- 172.21.15.142:0/960400074 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56451ce6ce50 con 0x56451ce6a240 2024-09-22T08:36:44.279 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.268+0000 7fd1bd7ea640 1 --2- 172.21.15.142:0/960400074 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x56451ce6a240 0x56451ce6c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:44.279 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.268+0000 7fd1c5feb640 1 --2- 172.21.15.142:0/960400074 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fd09003cfb0 0x7fd09003f470 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fd1b8053730 tx=0x7fd1b8092000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:44.280 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.268+0000 7fd1bd7ea640 1 --2- 172.21.15.142:0/960400074 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x56451ce6a240 0x56451ce6c700 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:44.280 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.268+0000 7fd1bd7ea640 1 -- 172.21.15.142:0/960400074 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd1b000f5f0 con 0x56451ce6a240 2024-09-22T08:36:44.280 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.268+0000 7fd1ca81d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:44.280 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.268+0000 7fd1ca81d800 20 realm 2024-09-22T08:36:44.280 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.268+0000 7fd1ca81d800 20 rados->read ofs=0 len=0 2024-09-22T08:36:44.280 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.268+0000 7fd1ca81d800 1 -- 172.21.15.142:0/960400074 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56451ce69590 con 0x56451ce6a240 2024-09-22T08:36:44.280 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.268+0000 7fd1bd7ea640 1 -- 172.21.15.142:0/960400074 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd1b000f5f0 con 0x56451ce6a240 2024-09-22T08:36:44.280 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.268+0000 7fd1ca81d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:44.280 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.268+0000 7fd1ca81d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:36:44.280 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.268+0000 7fd1ca81d800 20 rados->read ofs=0 len=0 2024-09-22T08:36:44.280 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.268+0000 7fd1ca81d800 1 -- 172.21.15.142:0/960400074 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56451ce6d930 con 0x56451ce6a240 2024-09-22T08:36:44.280 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.269+0000 7fd1bd7ea640 1 -- 172.21.15.142:0/960400074 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd1b000f5f0 con 0x56451ce6a240 2024-09-22T08:36:44.280 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.269+0000 7fd1ca81d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:44.280 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.269+0000 7fd1ca81d800 20 rados->read ofs=0 len=0 2024-09-22T08:36:44.281 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.269+0000 7fd1ca81d800 1 -- 172.21.15.142:0/960400074 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56451ce6e200 con 0x56451ce6a240 2024-09-22T08:36:44.281 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.269+0000 7fd1bd7ea640 1 -- 172.21.15.142:0/960400074 <== osd.1 v2:172.21.15.142:6816/3192108003 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd1b000f5f0 con 0x56451ce6a240 2024-09-22T08:36:44.281 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.269+0000 7fd1ca81d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:36:44.281 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.269+0000 7fd1ca81d800 20 rados->read ofs=0 len=0 2024-09-22T08:36:44.281 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.269+0000 7fd1ca81d800 1 --2- 172.21.15.142:0/960400074 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x56451ce6eb00 0x56451ce70f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:44.281 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.269+0000 7fd1ca81d800 1 -- 172.21.15.142:0/960400074 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56451ce71670 con 0x56451ce6eb00 2024-09-22T08:36:44.281 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.269+0000 7fd1c67ec640 1 --2- 172.21.15.142:0/960400074 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x56451ce6eb00 0x56451ce70f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:44.281 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.269+0000 7fd1c67ec640 1 --2- 172.21.15.142:0/960400074 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x56451ce6eb00 0x56451ce70f10 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:44.281 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.269+0000 7fd1c67ec640 1 -- 172.21.15.142:0/960400074 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(5 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fd1c0053020 con 0x56451ce6eb00 2024-09-22T08:36:44.281 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.269+0000 7fd1ca81d800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:36:44.281 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.269+0000 7fd1ca81d800 20 searching for the correct realm 2024-09-22T08:36:44.281 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.269+0000 7fd1ca81d800 1 -- 172.21.15.142:0/960400074 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56451ce73050 con 0x56451ce6eb00 2024-09-22T08:36:44.281 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.270+0000 7fd1c67ec640 1 -- 172.21.15.142:0/960400074 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1c0053020 con 0x56451ce6eb00 2024-09-22T08:36:44.281 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.270+0000 7fd1c67ec640 1 --2- 172.21.15.142:0/960400074 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7fd1c0012930 0x7fd1c002b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:44.282 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.270+0000 7fd1c67ec640 1 -- 172.21.15.142:0/960400074 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56451ce73050 con 0x7fd1c0012930 2024-09-22T08:36:44.282 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.270+0000 7fd1c5feb640 1 --2- 172.21.15.142:0/960400074 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7fd1c0012930 0x7fd1c002b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:44.282 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.270+0000 7fd1c5feb640 1 --2- 172.21.15.142:0/960400074 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7fd1c0012930 0x7fd1c002b7d0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:44.282 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.270+0000 7fd1c5feb640 1 -- 172.21.15.142:0/960400074 <== osd.2 v2:172.21.15.142:6808/279438927 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1b808a050 con 0x7fd1c0012930 2024-09-22T08:36:44.282 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.270+0000 7fd1c5feb640 1 --2- 172.21.15.142:0/960400074 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7fd1b80a5040 0x7fd1b805c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:44.282 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.270+0000 7fd1c5feb640 1 -- 172.21.15.142:0/960400074 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56451ce73050 con 0x7fd1b80a5040 2024-09-22T08:36:44.282 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.271+0000 7fd1bd7ea640 1 --2- 172.21.15.142:0/960400074 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7fd1b80a5040 0x7fd1b805c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:44.282 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.271+0000 7fd1bd7ea640 1 --2- 172.21.15.142:0/960400074 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7fd1b80a5040 0x7fd1b805c870 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:44.282 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.271+0000 7fd1bd7ea640 1 -- 172.21.15.142:0/960400074 <== osd.0 v2:172.21.15.31:6800/168281188 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1b000f5f0 con 0x7fd1b80a5040 2024-09-22T08:36:44.282 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.271+0000 7fd1bd7ea640 1 -- 172.21.15.142:0/960400074 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56451ce73050 con 0x56451ce6a240 2024-09-22T08:36:44.282 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.272+0000 7fd1bd7ea640 1 -- 172.21.15.142:0/960400074 <== osd.1 v2:172.21.15.142:6816/3192108003 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1b000f5f0 con 0x56451ce6a240 2024-09-22T08:36:44.282 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.272+0000 7fd1bd7ea640 1 -- 172.21.15.142:0/960400074 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56451ce73050 con 0x56451ce6a240 2024-09-22T08:36:44.283 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.272+0000 7fd1bd7ea640 1 -- 172.21.15.142:0/960400074 <== osd.1 v2:172.21.15.142:6816/3192108003 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1b002b040 con 0x56451ce6a240 2024-09-22T08:36:44.283 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.272+0000 7fd1bd7ea640 1 -- 172.21.15.142:0/960400074 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56451ce73050 con 0x7fd1b80a5040 2024-09-22T08:36:44.283 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.272+0000 7fd1bd7ea640 1 -- 172.21.15.142:0/960400074 <== osd.0 v2:172.21.15.31:6800/168281188 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1b002b040 con 0x7fd1b80a5040 2024-09-22T08:36:44.283 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.272+0000 7fd1bd7ea640 1 -- 172.21.15.142:0/960400074 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56451ce73050 con 0x7fd1b80a5040 2024-09-22T08:36:44.283 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.272+0000 7fd1bd7ea640 1 -- 172.21.15.142:0/960400074 <== osd.0 v2:172.21.15.31:6800/168281188 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1b002b040 con 0x7fd1b80a5040 2024-09-22T08:36:44.283 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.272+0000 7fd1bd7ea640 1 -- 172.21.15.142:0/960400074 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56451ce73050 con 0x7fd1c0012930 2024-09-22T08:36:44.283 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.273+0000 7fd1c5feb640 1 -- 172.21.15.142:0/960400074 <== osd.2 v2:172.21.15.142:6808/279438927 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1b808a050 con 0x7fd1c0012930 2024-09-22T08:36:44.283 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.273+0000 7fd1c5feb640 1 -- 172.21.15.142:0/960400074 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56451ce73050 con 0x56451ce6eb00 2024-09-22T08:36:44.283 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.273+0000 7fd1c67ec640 1 -- 172.21.15.142:0/960400074 <== osd.3 v2:172.21.15.142:6800/1064901393 3 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1c0053020 con 0x56451ce6eb00 2024-09-22T08:36:44.283 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.273+0000 7fd1c67ec640 1 -- 172.21.15.142:0/960400074 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56451ce73050 con 0x56451ce6a240 2024-09-22T08:36:44.283 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.273+0000 7fd1bd7ea640 1 -- 172.21.15.142:0/960400074 <== osd.1 v2:172.21.15.142:6816/3192108003 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1b002b040 con 0x56451ce6a240 2024-09-22T08:36:44.284 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.273+0000 7fd1bd7ea640 1 -- 172.21.15.142:0/960400074 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56451ce73050 con 0x7fd1b80a5040 2024-09-22T08:36:44.284 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.273+0000 7fd1bd7ea640 1 -- 172.21.15.142:0/960400074 <== osd.0 v2:172.21.15.31:6800/168281188 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1b002b040 con 0x7fd1b80a5040 2024-09-22T08:36:44.284 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.273+0000 7fd1bd7ea640 1 -- 172.21.15.142:0/960400074 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56451ce73050 con 0x56451ce6a240 2024-09-22T08:36:44.284 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.274+0000 7fd1bd7ea640 1 -- 172.21.15.142:0/960400074 <== osd.1 v2:172.21.15.142:6816/3192108003 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1b002b040 con 0x56451ce6a240 2024-09-22T08:36:44.284 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.274+0000 7fd1bd7ea640 1 -- 172.21.15.142:0/960400074 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56451ce73050 con 0x7fd1c0012930 2024-09-22T08:36:44.284 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.274+0000 7fd1c5feb640 1 -- 172.21.15.142:0/960400074 <== osd.2 v2:172.21.15.142:6808/279438927 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fd1b808a050 con 0x7fd1c0012930 2024-09-22T08:36:44.284 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.274+0000 7fd1c5feb640 1 -- 172.21.15.142:0/960400074 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56451ce73050 con 0x56451ce6eb00 2024-09-22T08:36:44.284 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.274+0000 7fd1c67ec640 1 -- 172.21.15.142:0/960400074 <== osd.3 v2:172.21.15.142:6800/1064901393 4 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1c0053020 con 0x56451ce6eb00 2024-09-22T08:36:44.284 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.274+0000 7fd1c67ec640 1 -- 172.21.15.142:0/960400074 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56451ce73050 con 0x56451ce6eb00 2024-09-22T08:36:44.284 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.274+0000 7fd1c67ec640 1 -- 172.21.15.142:0/960400074 <== osd.3 v2:172.21.15.142:6800/1064901393 5 ==== osd_op_reply(20 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fd1c0053020 con 0x56451ce6eb00 2024-09-22T08:36:44.284 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.274+0000 7fd1c67ec640 1 -- 172.21.15.142:0/960400074 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56451ce73050 con 0x7fd1b80a5040 2024-09-22T08:36:44.284 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.275+0000 7fd1bd7ea640 1 -- 172.21.15.142:0/960400074 <== osd.0 v2:172.21.15.31:6800/168281188 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1b002b040 con 0x7fd1b80a5040 2024-09-22T08:36:44.284 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.275+0000 7fd1bd7ea640 1 -- 172.21.15.142:0/960400074 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56451ce73050 con 0x56451ce6eb00 2024-09-22T08:36:44.295 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.275+0000 7fd1c67ec640 1 -- 172.21.15.142:0/960400074 <== osd.3 v2:172.21.15.142:6800/1064901393 6 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1c0053020 con 0x56451ce6eb00 2024-09-22T08:36:44.295 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.275+0000 7fd1c67ec640 1 -- 172.21.15.142:0/960400074 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56451ce73050 con 0x56451ce6eb00 2024-09-22T08:36:44.295 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.275+0000 7fd1c67ec640 1 -- 172.21.15.142:0/960400074 <== osd.3 v2:172.21.15.142:6800/1064901393 7 ==== osd_op_reply(23 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fd1c0053020 con 0x56451ce6eb00 2024-09-22T08:36:44.295 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.275+0000 7fd1c67ec640 1 -- 172.21.15.142:0/960400074 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56451ce73050 con 0x56451ce6a240 2024-09-22T08:36:44.295 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.276+0000 7fd1bd7ea640 1 -- 172.21.15.142:0/960400074 <== osd.1 v2:172.21.15.142:6816/3192108003 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1b002b040 con 0x56451ce6a240 2024-09-22T08:36:44.295 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.276+0000 7fd1bd7ea640 1 -- 172.21.15.142:0/960400074 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56451ce73050 con 0x56451ce6a240 2024-09-22T08:36:44.295 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.276+0000 7fd1bd7ea640 1 -- 172.21.15.142:0/960400074 <== osd.1 v2:172.21.15.142:6816/3192108003 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fd1b002b040 con 0x56451ce6a240 2024-09-22T08:36:44.295 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.276+0000 7fd1bd7ea640 1 -- 172.21.15.142:0/960400074 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56451ce73050 con 0x7fd1b80a5040 2024-09-22T08:36:44.295 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.276+0000 7fd1bd7ea640 1 -- 172.21.15.142:0/960400074 <== osd.0 v2:172.21.15.31:6800/168281188 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1b002b040 con 0x7fd1b80a5040 2024-09-22T08:36:44.295 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.276+0000 7fd1bd7ea640 1 -- 172.21.15.142:0/960400074 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56451ce73050 con 0x56451ce6eb00 2024-09-22T08:36:44.296 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.276+0000 7fd1c67ec640 1 -- 172.21.15.142:0/960400074 <== osd.3 v2:172.21.15.142:6800/1064901393 8 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1c0053020 con 0x56451ce6eb00 2024-09-22T08:36:44.296 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.276+0000 7fd1c67ec640 1 -- 172.21.15.142:0/960400074 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56451ce73050 con 0x7fd1c0012930 2024-09-22T08:36:44.296 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.277+0000 7fd1c5feb640 1 -- 172.21.15.142:0/960400074 <== osd.2 v2:172.21.15.142:6808/279438927 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1b808a050 con 0x7fd1c0012930 2024-09-22T08:36:44.296 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.277+0000 7fd1c5feb640 1 -- 172.21.15.142:0/960400074 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56451ce73050 con 0x56451ce6a240 2024-09-22T08:36:44.296 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.277+0000 7fd1bd7ea640 1 -- 172.21.15.142:0/960400074 <== osd.1 v2:172.21.15.142:6816/3192108003 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1b002b040 con 0x56451ce6a240 2024-09-22T08:36:44.296 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.277+0000 7fd1bd7ea640 1 -- 172.21.15.142:0/960400074 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56451ce73050 con 0x7fd1b80a5040 2024-09-22T08:36:44.296 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.277+0000 7fd1bd7ea640 1 -- 172.21.15.142:0/960400074 <== osd.0 v2:172.21.15.31:6800/168281188 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1b003b040 con 0x7fd1b80a5040 2024-09-22T08:36:44.296 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.277+0000 7fd1bd7ea640 1 -- 172.21.15.142:0/960400074 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56451ce73050 con 0x56451ce6eb00 2024-09-22T08:36:44.296 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.278+0000 7fd1c67ec640 1 -- 172.21.15.142:0/960400074 <== osd.3 v2:172.21.15.142:6800/1064901393 9 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1c0053020 con 0x56451ce6eb00 2024-09-22T08:36:44.296 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.278+0000 7fd1c67ec640 1 -- 172.21.15.142:0/960400074 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56451ce73050 con 0x7fd1b80a5040 2024-09-22T08:36:44.296 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.278+0000 7fd1bd7ea640 1 -- 172.21.15.142:0/960400074 <== osd.0 v2:172.21.15.31:6800/168281188 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1b003b040 con 0x7fd1b80a5040 2024-09-22T08:36:44.296 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.278+0000 7fd1bd7ea640 1 -- 172.21.15.142:0/960400074 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56451ce73050 con 0x7fd1c0012930 2024-09-22T08:36:44.296 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.278+0000 7fd1c5feb640 1 -- 172.21.15.142:0/960400074 <== osd.2 v2:172.21.15.142:6808/279438927 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1b808a050 con 0x7fd1c0012930 2024-09-22T08:36:44.297 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.278+0000 7fd1c5feb640 1 -- 172.21.15.142:0/960400074 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56451ce73050 con 0x56451ce6eb00 2024-09-22T08:36:44.297 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.278+0000 7fd1c67ec640 1 -- 172.21.15.142:0/960400074 <== osd.3 v2:172.21.15.142:6800/1064901393 10 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1c0053020 con 0x56451ce6eb00 2024-09-22T08:36:44.297 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.278+0000 7fd1c67ec640 1 -- 172.21.15.142:0/960400074 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56451ce73050 con 0x7fd1b80a5040 2024-09-22T08:36:44.297 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.279+0000 7fd1bd7ea640 1 -- 172.21.15.142:0/960400074 <== osd.0 v2:172.21.15.31:6800/168281188 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1b003b040 con 0x7fd1b80a5040 2024-09-22T08:36:44.297 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.279+0000 7fd1bd7ea640 1 -- 172.21.15.142:0/960400074 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56451ce73050 con 0x56451ce6a240 2024-09-22T08:36:44.297 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.279+0000 7fd1bd7ea640 1 -- 172.21.15.142:0/960400074 <== osd.1 v2:172.21.15.142:6816/3192108003 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fd1b003b040 con 0x56451ce6a240 2024-09-22T08:36:44.297 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.279+0000 7fd1bd7ea640 1 -- 172.21.15.142:0/960400074 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56451ce73050 con 0x7fd1c0012930 2024-09-22T08:36:44.297 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.279+0000 7fd1c5feb640 1 -- 172.21.15.142:0/960400074 <== osd.2 v2:172.21.15.142:6808/279438927 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1b808a050 con 0x7fd1c0012930 2024-09-22T08:36:44.297 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.279+0000 7fd1ca81d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:36:44.298 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.280+0000 7fd1ca81d800 20 RGWRados::pool_iterate: got zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec 2024-09-22T08:36:44.298 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.280+0000 7fd1ca81d800 20 RGWRados::pool_iterate: got zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f 2024-09-22T08:36:44.298 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.280+0000 7fd1ca81d800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:36:44.298 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.280+0000 7fd1ca81d800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:36:44.298 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.280+0000 7fd1ca81d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:36:44.298 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.280+0000 7fd1ca81d800 20 rados->read ofs=0 len=0 2024-09-22T08:36:44.298 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.280+0000 7fd1ca81d800 1 -- 172.21.15.142:0/960400074 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56451ce72120 con 0x56451ce6a240 2024-09-22T08:36:44.298 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.280+0000 7fd1bd7ea640 1 -- 172.21.15.142:0/960400074 <== osd.1 v2:172.21.15.142:6816/3192108003 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd1b003b040 con 0x56451ce6a240 2024-09-22T08:36:44.298 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.280+0000 7fd1ca81d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:44.298 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.280+0000 7fd1ca81d800 20 rados->read ofs=0 len=0 2024-09-22T08:36:44.298 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.280+0000 7fd1ca81d800 1 -- 172.21.15.142:0/960400074 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56451ce71d60 con 0x56451ce6a240 2024-09-22T08:36:44.298 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.280+0000 7fd1bd7ea640 1 -- 172.21.15.142:0/960400074 <== osd.1 v2:172.21.15.142:6816/3192108003 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd1b003b040 con 0x56451ce6a240 2024-09-22T08:36:44.298 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.280+0000 7fd1ca81d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:36:44.298 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.280+0000 7fd1ca81d800 20 rados->read ofs=0 len=0 2024-09-22T08:36:44.299 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.280+0000 7fd1ca81d800 1 -- 172.21.15.142:0/960400074 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:40 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56451ce72a80 con 0x56451ce6eb00 2024-09-22T08:36:44.299 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.280+0000 7fd1c67ec640 1 -- 172.21.15.142:0/960400074 <== osd.3 v2:172.21.15.142:6800/1064901393 11 ==== osd_op_reply(40 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fd1c0053020 con 0x56451ce6eb00 2024-09-22T08:36:44.299 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.280+0000 7fd1ca81d800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:36:44.299 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.280+0000 7fd1ca81d800 20 zone default found 2024-09-22T08:36:44.299 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.280+0000 7fd1ca81d800 4 Realm: () 2024-09-22T08:36:44.299 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.280+0000 7fd1ca81d800 4 ZoneGroup: default (d89f6f57-1007-47dd-9065-f486c7b01aec) 2024-09-22T08:36:44.299 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.280+0000 7fd1ca81d800 4 Zone: default (e239248c-0bee-4e41-803a-24b288d3eb8f) 2024-09-22T08:36:44.299 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.280+0000 7fd1ca81d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:36:44.299 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.280+0000 7fd1ca81d800 20 zonegroup default 2024-09-22T08:36:44.299 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.280+0000 7fd1ca81d800 20 rados->read ofs=0 len=0 2024-09-22T08:36:44.299 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.280+0000 7fd1ca81d800 1 -- 172.21.15.142:0/960400074 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56451ce725f0 con 0x7fd1b80a5040 2024-09-22T08:36:44.299 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.281+0000 7fd1bd7ea640 1 -- 172.21.15.142:0/960400074 <== osd.0 v2:172.21.15.31:6800/168281188 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fd1b003b040 con 0x7fd1b80a5040 2024-09-22T08:36:44.299 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.281+0000 7fd1ca81d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:44.299 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.281+0000 7fd1ca81d800 20 rados->read ofs=0 len=0 2024-09-22T08:36:44.300 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.281+0000 7fd1ca81d800 1 -- 172.21.15.142:0/960400074 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56451ce75410 con 0x56451ce6eb00 2024-09-22T08:36:44.300 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.281+0000 7fd1c67ec640 1 -- 172.21.15.142:0/960400074 <== osd.3 v2:172.21.15.142:6800/1064901393 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd1c0053020 con 0x56451ce6eb00 2024-09-22T08:36:44.300 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.281+0000 7fd1ca81d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:44.300 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.281+0000 7fd1ca81d800 20 rados->read ofs=0 len=0 2024-09-22T08:36:44.300 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.281+0000 7fd1ca81d800 1 -- 172.21.15.142:0/960400074 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56451ce75870 con 0x56451ce6eb00 2024-09-22T08:36:44.300 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.282+0000 7fd1c67ec640 1 -- 172.21.15.142:0/960400074 <== osd.3 v2:172.21.15.142:6800/1064901393 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd1c0053020 con 0x56451ce6eb00 2024-09-22T08:36:44.300 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.282+0000 7fd1ca81d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:44.300 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.282+0000 7fd1ca81d800 20 started sync module instance, tier type = 2024-09-22T08:36:44.300 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.282+0000 7fd1ca81d800 20 started zone id=e239248c-0bee-4e41-803a-24b288d3eb8f (name=default) with tier type = 2024-09-22T08:36:44.300 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.282+0000 7fd1ca81d800 1 -- 172.21.15.142:0/960400074 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56451ce748b0 con 0x7fd1c0012930 2024-09-22T08:36:44.300 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.283+0000 7fd1c5feb640 1 -- 172.21.15.142:0/960400074 <== osd.2 v2:172.21.15.142:6808/279438927 7 ==== osd_op_reply(44 notify.0 [create] v30'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd1b808a050 con 0x7fd1c0012930 2024-09-22T08:36:44.300 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.283+0000 7fd1ca81d800 1 -- 172.21.15.142:0/960400074 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94854837652640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56451ce76180 con 0x7fd1c0012930 2024-09-22T08:36:44.300 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.283+0000 7fd1ca81d800 1 -- 172.21.15.142:0/960400074 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56451ce769d0 con 0x56451ce6a240 2024-09-22T08:36:44.300 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.283+0000 7fd1c5feb640 1 -- 172.21.15.142:0/960400074 <== osd.2 v2:172.21.15.142:6808/279438927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94854837652640] v30'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd1b808a050 con 0x7fd1c0012930 2024-09-22T08:36:44.301 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.284+0000 7fd1bd7ea640 1 -- 172.21.15.142:0/960400074 <== osd.1 v2:172.21.15.142:6816/3192108003 15 ==== osd_op_reply(46 notify.1 [create] v30'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd1b003b040 con 0x56451ce6a240 2024-09-22T08:36:44.301 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.284+0000 7fd1ca81d800 1 -- 172.21.15.142:0/960400074 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94854837656784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56451ce766e0 con 0x56451ce6a240 2024-09-22T08:36:44.301 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.284+0000 7fd1ca81d800 1 -- 172.21.15.142:0/960400074 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56451ce77200 con 0x56451ce6eb00 2024-09-22T08:36:44.301 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.285+0000 7fd1bd7ea640 1 -- 172.21.15.142:0/960400074 <== osd.1 v2:172.21.15.142:6816/3192108003 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94854837656784] v30'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd1b003b040 con 0x56451ce6a240 2024-09-22T08:36:44.301 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.285+0000 7fd1c67ec640 1 -- 172.21.15.142:0/960400074 <== osd.3 v2:172.21.15.142:6800/1064901393 14 ==== osd_op_reply(48 notify.2 [create] v30'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd1c0053020 con 0x56451ce6eb00 2024-09-22T08:36:44.301 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.285+0000 7fd1ca81d800 1 -- 172.21.15.142:0/960400074 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94854837660880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56451ce771c0 con 0x56451ce6eb00 2024-09-22T08:36:44.301 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.285+0000 7fd1ca81d800 1 -- 172.21.15.142:0/960400074 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56451ce77cb0 con 0x7fd1c0012930 2024-09-22T08:36:44.301 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.286+0000 7fd1c5feb640 1 -- 172.21.15.142:0/960400074 <== osd.2 v2:172.21.15.142:6808/279438927 9 ==== osd_op_reply(50 notify.3 [create] v30'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd1b808a050 con 0x7fd1c0012930 2024-09-22T08:36:44.301 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.286+0000 7fd1c67ec640 1 -- 172.21.15.142:0/960400074 <== osd.3 v2:172.21.15.142:6800/1064901393 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94854837660880] v30'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd1c0053020 con 0x56451ce6eb00 2024-09-22T08:36:44.301 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.286+0000 7fd1ca81d800 1 -- 172.21.15.142:0/960400074 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94854837663680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56451ce77cb0 con 0x7fd1c0012930 2024-09-22T08:36:44.301 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.286+0000 7fd1ca81d800 1 -- 172.21.15.142:0/960400074 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56451ce78730 con 0x56451ce6a240 2024-09-22T08:36:44.301 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.287+0000 7fd1c5feb640 1 -- 172.21.15.142:0/960400074 <== osd.2 v2:172.21.15.142:6808/279438927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94854837663680] v30'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd1b808a050 con 0x7fd1c0012930 2024-09-22T08:36:44.301 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.287+0000 7fd1bd7ea640 1 -- 172.21.15.142:0/960400074 <== osd.1 v2:172.21.15.142:6816/3192108003 17 ==== osd_op_reply(52 notify.4 [create] v30'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd1b003b040 con 0x56451ce6a240 2024-09-22T08:36:44.302 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.287+0000 7fd1ca81d800 1 -- 172.21.15.142:0/960400074 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94854837657904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56451ce786f0 con 0x56451ce6a240 2024-09-22T08:36:44.302 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.287+0000 7fd1ca81d800 1 -- 172.21.15.142:0/960400074 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56451ce79190 con 0x7fd1b80a5040 2024-09-22T08:36:44.302 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.288+0000 7fd1bd7ea640 1 -- 172.21.15.142:0/960400074 <== osd.1 v2:172.21.15.142:6816/3192108003 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94854837657904] v30'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd1b003b040 con 0x56451ce6a240 2024-09-22T08:36:44.302 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.288+0000 7fd1bd7ea640 1 -- 172.21.15.142:0/960400074 <== osd.0 v2:172.21.15.31:6800/168281188 11 ==== osd_op_reply(54 notify.5 [create] v30'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd1b003b040 con 0x7fd1b80a5040 2024-09-22T08:36:44.302 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.288+0000 7fd1ca81d800 1 -- 172.21.15.142:0/960400074 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94854837669056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56451ce786f0 con 0x7fd1b80a5040 2024-09-22T08:36:44.302 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.288+0000 7fd1ca81d800 1 -- 172.21.15.142:0/960400074 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56451ce79c00 con 0x7fd1b80a5040 2024-09-22T08:36:44.302 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.289+0000 7fd1bd7ea640 1 -- 172.21.15.142:0/960400074 <== osd.0 v2:172.21.15.31:6800/168281188 12 ==== osd_op_reply(56 notify.6 [create] v30'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd1b003b040 con 0x7fd1b80a5040 2024-09-22T08:36:44.302 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.289+0000 7fd1ca81d800 1 -- 172.21.15.142:0/960400074 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94854837671664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56451ce7a070 con 0x7fd1b80a5040 2024-09-22T08:36:44.302 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.289+0000 7fd1ca81d800 1 -- 172.21.15.142:0/960400074 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56451ce7ab60 con 0x7fd1b80a5040 2024-09-22T08:36:44.302 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.289+0000 7fd1bd7ea640 1 -- 172.21.15.142:0/960400074 <== osd.0 v2:172.21.15.31:6800/168281188 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94854837669056] v30'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd1b003b040 con 0x7fd1b80a5040 2024-09-22T08:36:44.302 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.290+0000 7fd1bd7ea640 1 -- 172.21.15.142:0/960400074 <== osd.0 v2:172.21.15.31:6800/168281188 14 ==== osd_op_reply(58 notify.7 [create] v30'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd1b003b040 con 0x7fd1b80a5040 2024-09-22T08:36:44.302 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.290+0000 7fd1ca81d800 1 -- 172.21.15.142:0/960400074 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94854837675568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56451ce7ab20 con 0x7fd1b80a5040 2024-09-22T08:36:44.302 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.290+0000 7fd1ca81d800 20 add_watcher() i=0 2024-09-22T08:36:44.302 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.290+0000 7fd1ca81d800 20 add_watcher() i=1 2024-09-22T08:36:44.303 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.290+0000 7fd1ca81d800 20 add_watcher() i=2 2024-09-22T08:36:44.303 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.290+0000 7fd1ca81d800 20 add_watcher() i=3 2024-09-22T08:36:44.303 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.290+0000 7fd1ca81d800 20 add_watcher() i=4 2024-09-22T08:36:44.303 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.290+0000 7fd1ca81d800 20 add_watcher() i=5 2024-09-22T08:36:44.303 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.290+0000 7fd1bd7ea640 1 -- 172.21.15.142:0/960400074 <== osd.0 v2:172.21.15.31:6800/168281188 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94854837671664] v30'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd1b003b040 con 0x7fd1b80a5040 2024-09-22T08:36:44.303 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.290+0000 7fd1ca81d800 20 add_watcher() i=6 2024-09-22T08:36:44.303 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.291+0000 7fd1bd7ea640 1 -- 172.21.15.142:0/960400074 <== osd.0 v2:172.21.15.31:6800/168281188 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94854837675568] v30'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd1b003b040 con 0x7fd1b80a5040 2024-09-22T08:36:44.303 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.291+0000 7fd1ca81d800 20 add_watcher() i=7 2024-09-22T08:36:44.303 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.291+0000 7fd1ca81d800 2 all 8 watchers are set, enabling cache 2024-09-22T08:36:44.303 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.291+0000 7fd1ca81d800 1 -- 172.21.15.142:0/960400074 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56451ce79c70 con 0x56451ce6a240 2024-09-22T08:36:44.304 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.291+0000 7fd1bd7ea640 1 -- 172.21.15.142:0/960400074 <== osd.1 v2:172.21.15.142:6816/3192108003 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fd1b003b040 con 0x56451ce6a240 2024-09-22T08:36:44.304 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.291+0000 7fd1ca81d800 1 -- 172.21.15.142:0/960400074 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94854837666368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56451ce79c70 con 0x56451ce6a240 2024-09-22T08:36:44.304 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.292+0000 7fd1bd7ea640 1 -- 172.21.15.142:0/960400074 <== osd.1 v2:172.21.15.142:6816/3192108003 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94854837666368] v30'74 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd1b003b040 con 0x56451ce6a240 2024-09-22T08:36:44.304 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.292+0000 7fd0777fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:36:44.304 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.292+0000 7fd1ca81d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:36:44.304 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.292+0000 7fd1ca81d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:36:44.304 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.292+0000 7fd1ca81d800 5 note: GC not initialized 2024-09-22T08:36:44.304 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.293+0000 7fd0767fc640 20 reqs_thread_entry: start 2024-09-22T08:36:44.304 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.293+0000 7fd1ca81d800 20 init_complete bucket index max shards: 11 2024-09-22T08:36:44.305 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.293+0000 7fd1ca81d800 20 Filter name: none 2024-09-22T08:36:44.305 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.293+0000 7fcfe7fff640 20 reqs_thread_entry: start 2024-09-22T08:36:44.305 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.293+0000 7fd1ca81d800 20 rados->read ofs=0 len=0 2024-09-22T08:36:44.305 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.293+0000 7fd1ca81d800 1 -- 172.21.15.142:0/960400074 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56451ceb0a60 con 0x56451ce6a240 2024-09-22T08:36:44.305 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.293+0000 7fd1bd7ea640 1 -- 172.21.15.142:0/960400074 <== osd.1 v2:172.21.15.142:6816/3192108003 21 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv7 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7fd1b003b040 con 0x56451ce6a240 2024-09-22T08:36:44.305 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.293+0000 7fd1ca81d800 20 rados_obj.operate() r=0 bl.length=556 2024-09-22T08:36:44.305 INFO:teuthology.orchestra.run.smithi142.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-22T08:36:42.661297Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-22T08:36:42.661288Z","tags":[],"group_ids":[]} 2024-09-22T08:36:44.310 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.294+0000 7fd0777fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:36:44.311 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.294+0000 7fd1ca81d800 1 -- 172.21.15.142:0/960400074 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94854837666368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56451ceaf410 con 0x56451ce6a240 2024-09-22T08:36:44.311 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.295+0000 7fd1bd7ea640 1 -- 172.21.15.142:0/960400074 <== osd.1 v2:172.21.15.142:6816/3192108003 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94854837666368] v30'75 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd1b003b040 con 0x56451ce6a240 2024-09-22T08:36:44.311 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.295+0000 7fd1ca81d800 1 -- 172.21.15.142:0/960400074 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94854837652640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56451ce78240 con 0x7fd1c0012930 2024-09-22T08:36:44.311 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.296+0000 7fd1c5feb640 1 -- 172.21.15.142:0/960400074 <== osd.2 v2:172.21.15.142:6808/279438927 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94854837652640] v30'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd1b808a050 con 0x7fd1c0012930 2024-09-22T08:36:44.311 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.296+0000 7fd1ca81d800 20 remove_watcher() i=0 2024-09-22T08:36:44.311 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.296+0000 7fd1ca81d800 2 removed watcher, disabling cache 2024-09-22T08:36:44.311 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.296+0000 7fd1ca81d800 1 -- 172.21.15.142:0/960400074 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94854837656784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56451ce78240 con 0x56451ce6a240 2024-09-22T08:36:44.311 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.297+0000 7fd1bd7ea640 1 -- 172.21.15.142:0/960400074 <== osd.1 v2:172.21.15.142:6816/3192108003 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94854837656784] v30'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd1b003b040 con 0x56451ce6a240 2024-09-22T08:36:44.311 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.297+0000 7fd1ca81d800 20 remove_watcher() i=1 2024-09-22T08:36:44.312 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.297+0000 7fd1ca81d800 1 -- 172.21.15.142:0/960400074 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94854837660880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56451ce75cd0 con 0x56451ce6eb00 2024-09-22T08:36:44.312 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.298+0000 7fd1c67ec640 1 -- 172.21.15.142:0/960400074 <== osd.3 v2:172.21.15.142:6800/1064901393 16 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94854837660880] v30'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd1c0053020 con 0x56451ce6eb00 2024-09-22T08:36:44.312 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.298+0000 7fd1ca81d800 20 remove_watcher() i=2 2024-09-22T08:36:44.312 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.298+0000 7fd1ca81d800 1 -- 172.21.15.142:0/960400074 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94854837663680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56451ce78240 con 0x7fd1c0012930 2024-09-22T08:36:44.312 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.299+0000 7fd1c5feb640 1 -- 172.21.15.142:0/960400074 <== osd.2 v2:172.21.15.142:6808/279438927 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94854837663680] v30'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd1b808a050 con 0x7fd1c0012930 2024-09-22T08:36:44.312 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.299+0000 7fd1ca81d800 20 remove_watcher() i=3 2024-09-22T08:36:44.312 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.299+0000 7fd1ca81d800 1 -- 172.21.15.142:0/960400074 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94854837657904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56451ce76cd0 con 0x56451ce6a240 2024-09-22T08:36:44.312 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.300+0000 7fd1bd7ea640 1 -- 172.21.15.142:0/960400074 <== osd.1 v2:172.21.15.142:6816/3192108003 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94854837657904] v30'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd1b003b040 con 0x56451ce6a240 2024-09-22T08:36:44.314 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.300+0000 7fd1ca81d800 20 remove_watcher() i=4 2024-09-22T08:36:44.314 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.300+0000 7fd1ca81d800 1 -- 172.21.15.142:0/960400074 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94854837669056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56451ce76180 con 0x7fd1b80a5040 2024-09-22T08:36:44.314 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.301+0000 7fd1bd7ea640 1 -- 172.21.15.142:0/960400074 <== osd.0 v2:172.21.15.31:6800/168281188 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94854837669056] v30'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd1b003b040 con 0x7fd1b80a5040 2024-09-22T08:36:44.315 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.301+0000 7fd1ca81d800 20 remove_watcher() i=5 2024-09-22T08:36:44.315 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.301+0000 7fd1ca81d800 1 -- 172.21.15.142:0/960400074 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94854837671664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56451ce76180 con 0x7fd1b80a5040 2024-09-22T08:36:44.315 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.302+0000 7fd1bd7ea640 1 -- 172.21.15.142:0/960400074 <== osd.0 v2:172.21.15.31:6800/168281188 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94854837671664] v30'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd1b003b040 con 0x7fd1b80a5040 2024-09-22T08:36:44.315 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.302+0000 7fd1ca81d800 20 remove_watcher() i=6 2024-09-22T08:36:44.315 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.302+0000 7fd1ca81d800 1 -- 172.21.15.142:0/960400074 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94854837675568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56451ce76180 con 0x7fd1b80a5040 2024-09-22T08:36:44.315 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.303+0000 7fd1bd7ea640 1 -- 172.21.15.142:0/960400074 <== osd.0 v2:172.21.15.31:6800/168281188 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94854837675568] v30'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd1b003b040 con 0x7fd1b80a5040 2024-09-22T08:36:44.315 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.303+0000 7fd1ca81d800 20 remove_watcher() i=7 2024-09-22T08:36:44.315 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.303+0000 7fd1ca81d800 1 -- 172.21.15.142:0/960400074 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7fd1b80a5040 msgr2=0x7fd1b805c870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:44.315 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.303+0000 7fd1ca81d800 1 --2- 172.21.15.142:0/960400074 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7fd1b80a5040 0x7fd1b805c870 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:44.315 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.303+0000 7fd1ca81d800 1 -- 172.21.15.142:0/960400074 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x56451ce6a240 msgr2=0x56451ce6c700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:44.315 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.303+0000 7fd1ca81d800 1 --2- 172.21.15.142:0/960400074 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x56451ce6a240 0x56451ce6c700 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:44.315 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.303+0000 7fd1ca81d800 1 -- 172.21.15.142:0/960400074 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7fd1c0012930 msgr2=0x7fd1c002b7d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:44.316 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.303+0000 7fd1ca81d800 1 --2- 172.21.15.142:0/960400074 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7fd1c0012930 0x7fd1c002b7d0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:44.316 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.303+0000 7fd1ca81d800 1 -- 172.21.15.142:0/960400074 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x56451ce6eb00 msgr2=0x56451ce70f10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:44.316 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.303+0000 7fd1ca81d800 1 --2- 172.21.15.142:0/960400074 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x56451ce6eb00 0x56451ce70f10 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:44.316 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.304+0000 7fd1ca81d800 1 -- 172.21.15.142:0/960400074 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fd09003cfb0 msgr2=0x7fd09003f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:44.316 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.304+0000 7fd1ca81d800 1 --2- 172.21.15.142:0/960400074 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fd09003cfb0 0x7fd09003f470 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fd1b8053730 tx=0x7fd1b8092000 comp rx=0 tx=0).stop 2024-09-22T08:36:44.316 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.304+0000 7fd1ca81d800 1 -- 172.21.15.142:0/960400074 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56451ce574d0 msgr2=0x56451ce5eae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:44.316 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.304+0000 7fd1ca81d800 1 --2- 172.21.15.142:0/960400074 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56451ce574d0 0x56451ce5eae0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fd1c0022ff0 tx=0x7fd1c001fee0 comp rx=0 tx=0).stop 2024-09-22T08:36:44.316 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.304+0000 7fd1bd7ea640 1 -- 172.21.15.142:0/960400074 reap_dead start 2024-09-22T08:36:44.316 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.304+0000 7fd1bd7ea640 1 -- 172.21.15.142:0/960400074 reap_dead start 2024-09-22T08:36:44.317 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.304+0000 7fd1ca81d800 1 -- 172.21.15.142:0/960400074 shutdown_connections 2024-09-22T08:36:44.317 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.304+0000 7fd1ca81d800 1 -- 172.21.15.142:0/960400074 >> 172.21.15.142:0/960400074 conn(0x56451ce538d0 msgr2=0x56451ce51ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:44.317 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.304+0000 7fd1ca81d800 1 -- 172.21.15.142:0/960400074 shutdown_connections 2024-09-22T08:36:44.317 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.304+0000 7fd1ca81d800 1 -- 172.21.15.142:0/960400074 wait complete. 2024-09-22T08:36:44.317 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.304+0000 7fd1ca81d800 1 -- 172.21.15.142:0/2539605709 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fd0a003d000 msgr2=0x7fd0a003f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:44.317 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.304+0000 7fd1ca81d800 1 --2- 172.21.15.142:0/2539605709 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fd0a003d000 0x7fd0a003f4c0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x56451ce377b0 tx=0x7fd1b8096cc0 comp rx=0 tx=0).stop 2024-09-22T08:36:44.317 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.304+0000 7fd1ca81d800 1 -- 172.21.15.142:0/2539605709 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56451ce4aa50 msgr2=0x56451ce4ae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:44.317 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.304+0000 7fd1ca81d800 1 --2- 172.21.15.142:0/2539605709 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56451ce4aa50 0x56451ce4ae70 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x56451ce30b50 tx=0x7fd1c00167b0 comp rx=0 tx=0).stop 2024-09-22T08:36:44.317 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.304+0000 7fd1ca81d800 1 -- 172.21.15.142:0/2539605709 shutdown_connections 2024-09-22T08:36:44.317 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.304+0000 7fd1ca81d800 1 --2- 172.21.15.142:0/2539605709 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fd0a003d000 0x7fd0a003f4c0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:44.317 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.304+0000 7fd1ca81d800 1 --2- 172.21.15.142:0/2539605709 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56451ce4aa50 0x56451ce4ae70 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:44.317 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.304+0000 7fd1ca81d800 1 -- 172.21.15.142:0/2539605709 >> 172.21.15.142:0/2539605709 conn(0x56451ce3ee30 msgr2=0x56451ce3f210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:44.317 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.304+0000 7fd1ca81d800 1 -- 172.21.15.142:0/2539605709 shutdown_connections 2024-09-22T08:36:44.318 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.304+0000 7fd1ca81d800 1 -- 172.21.15.142:0/2539605709 wait complete. 2024-09-22T08:36:44.318 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.304+0000 7fd1ca81d800 1 -- 172.21.15.142:0/4012985376 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x56451cd39a20 msgr2=0x56451ce371a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:44.318 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.304+0000 7fd1ca81d800 1 --2- 172.21.15.142:0/4012985376 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x56451cd39a20 0x56451ce371a0 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:44.318 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.304+0000 7fd1ca81d800 1 -- 172.21.15.142:0/4012985376 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x56451ce39610 msgr2=0x56451ce3ba00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:44.318 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.304+0000 7fd1ca81d800 1 --2- 172.21.15.142:0/4012985376 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x56451ce39610 0x56451ce3ba00 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:44.318 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.305+0000 7fd1ca81d800 1 -- 172.21.15.142:0/4012985376 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fd0ac03d000 msgr2=0x7fd0ac03f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:44.318 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.305+0000 7fd1ca81d800 1 --2- 172.21.15.142:0/4012985376 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fd0ac03d000 0x7fd0ac03f4c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fd1b0000c00 tx=0x7fd1b00013b0 comp rx=0 tx=0).stop 2024-09-22T08:36:44.318 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.305+0000 7fd1ca81d800 1 -- 172.21.15.142:0/4012985376 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56451cd370f0 msgr2=0x56451ce2fb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:44.318 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.305+0000 7fd1ca81d800 1 --2- 172.21.15.142:0/4012985376 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56451cd370f0 0x56451ce2fb50 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fd1b8025c20 tx=0x7fd1b8002fb0 comp rx=0 tx=0).stop 2024-09-22T08:36:44.318 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.305+0000 7fd1ca81d800 1 -- 172.21.15.142:0/4012985376 shutdown_connections 2024-09-22T08:36:44.319 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.305+0000 7fd1ca81d800 1 --2- 172.21.15.142:0/4012985376 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x56451ce39610 0x56451ce3ba00 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:44.319 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.305+0000 7fd1ca81d800 1 --2- 172.21.15.142:0/4012985376 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x56451cd39a20 0x56451ce371a0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:44.319 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.305+0000 7fd1ca81d800 1 --2- 172.21.15.142:0/4012985376 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fd0ac03d000 0x7fd0ac03f4c0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:44.319 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.305+0000 7fd1ca81d800 1 --2- 172.21.15.142:0/4012985376 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56451cd370f0 0x56451ce2fb50 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:44.319 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.305+0000 7fd1ca81d800 1 -- 172.21.15.142:0/4012985376 >> 172.21.15.142:0/4012985376 conn(0x56451cd30bb0 msgr2=0x56451ce21350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:44.319 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.305+0000 7fd1ca81d800 1 -- 172.21.15.142:0/4012985376 shutdown_connections 2024-09-22T08:36:44.319 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.305+0000 7fd1ca81d800 1 -- 172.21.15.142:0/4012985376 wait complete. 2024-09-22T08:36:44.320 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-22T08:36:42.661297Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-22T08:36:42.661288Z', 'tags': [], 'group_ids': []} 2024-09-22T08:36:44.320 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-22T08:36:44.320 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-22T08:36:44.320 DEBUG:teuthology.orchestra.run.smithi142:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-22T08:36:44.364 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:36:44.364 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:36:44.365 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.364+0000 7f06e1b26800 1 Processor -- start 2024-09-22T08:36:44.365 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.364+0000 7f06e1b26800 1 -- start start 2024-09-22T08:36:44.365 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.364+0000 7f06e1b26800 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55ba8ad46bf0 0x55ba8ad4c580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:44.366 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.364+0000 7f06e1b26800 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55ba8abd1a20 con 0x55ba8ad457e0 2024-09-22T08:36:44.366 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.364+0000 7f06e1b26800 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x55ba8abd17d0 con 0x55ba8ad46bf0 2024-09-22T08:36:44.366 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.365+0000 7f06dcfd8640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55ba8ad46bf0 0x55ba8ad4c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:44.366 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.365+0000 7f06dd7d9640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x55ba8ad457e0 0x55ba8ad464e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.142:42416/0 (socket says 172.21.15.142:42416) 2024-09-22T08:36:44.366 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.365+0000 7f06dd7d9640 1 -- 172.21.15.142:0/366450083 learned_addr learned my addr 172.21.15.142:0/366450083 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-09-22T08:36:44.367 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.365+0000 7f06dcfd8640 1 -- 172.21.15.142:0/366450083 >> v1:172.21.15.31:6789/0 conn(0x55ba8ad457e0 legacy=0x55ba8ad464e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:44.367 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.365+0000 7f06dcfd8640 1 -- 172.21.15.142:0/366450083 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ba8ad45ee0 con 0x55ba8ad46bf0 2024-09-22T08:36:44.367 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.365+0000 7f06cffff640 1 -- 172.21.15.142:0/366450083 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2206697422 0 0) 0x55ba8abd1a20 con 0x55ba8ad457e0 2024-09-22T08:36:44.368 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.367+0000 7f06dcfd8640 1 --2- 172.21.15.142:0/366450083 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ba8ad46bf0 0x55ba8ad4c580 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f06d400a470 tx=0x7f06d4045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aab438ff1145b300 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:44.368 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.367+0000 7f06cffff640 1 -- 172.21.15.142:0/366450083 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06d4053570 con 0x55ba8ad46bf0 2024-09-22T08:36:44.368 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.367+0000 7f06cffff640 1 -- 172.21.15.142:0/366450083 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06d4058070 con 0x55ba8ad46bf0 2024-09-22T08:36:44.368 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.367+0000 7f06cffff640 1 -- 172.21.15.142:0/366450083 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06d4053880 con 0x55ba8ad46bf0 2024-09-22T08:36:44.369 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.367+0000 7f06e1b26800 1 -- 172.21.15.142:0/366450083 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ba8ad46bf0 msgr2=0x55ba8ad4c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:44.369 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.367+0000 7f06e1b26800 1 --2- 172.21.15.142:0/366450083 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ba8ad46bf0 0x55ba8ad4c580 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f06d400a470 tx=0x7f06d4045a20 comp rx=0 tx=0).stop 2024-09-22T08:36:44.369 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.367+0000 7f06e1b26800 1 -- 172.21.15.142:0/366450083 shutdown_connections 2024-09-22T08:36:44.369 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.367+0000 7f06e1b26800 1 --2- 172.21.15.142:0/366450083 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ba8ad46bf0 0x55ba8ad4c580 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:44.369 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.367+0000 7f06e1b26800 1 -- 172.21.15.142:0/366450083 >> 172.21.15.142:0/366450083 conn(0x55ba8ad40bb0 msgr2=0x55ba8ad43010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:44.370 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.367+0000 7f06e1b26800 1 -- 172.21.15.142:0/366450083 shutdown_connections 2024-09-22T08:36:44.370 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.367+0000 7f06e1b26800 1 -- 172.21.15.142:0/366450083 wait complete. 2024-09-22T08:36:44.383 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.381+0000 7f06e1b26800 1 Processor -- start 2024-09-22T08:36:44.383 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.381+0000 7f06e1b26800 1 -- start start 2024-09-22T08:36:44.383 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.381+0000 7f06e1b26800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ba8ad457e0 0x55ba8ae34d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:44.383 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.381+0000 7f06e1b26800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55ba8abdedd0 con 0x55ba8ad457e0 2024-09-22T08:36:44.383 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.382+0000 7f06dd7d9640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ba8ad457e0 0x55ba8ae34d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:44.383 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.382+0000 7f06dd7d9640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ba8ad457e0 0x55ba8ae34d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:38588/0 (socket says 172.21.15.142:38588) 2024-09-22T08:36:44.383 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.382+0000 7f06dd7d9640 1 -- 172.21.15.142:0/1598531884 learned_addr learned my addr 172.21.15.142:0/1598531884 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:44.383 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.382+0000 7f06dd7d9640 1 -- 172.21.15.142:0/1598531884 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ba8ae35360 con 0x55ba8ad457e0 2024-09-22T08:36:44.385 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.382+0000 7f06dd7d9640 1 --2- 172.21.15.142:0/1598531884 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ba8ad457e0 0x55ba8ae34d70 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f06d0001ea0 tx=0x7f06d000b6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94b920bb3945cccc server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:44.385 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.382+0000 7f05cb606640 1 -- 172.21.15.142:0/1598531884 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06d0008070 con 0x55ba8ad457e0 2024-09-22T08:36:44.385 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.382+0000 7f05cb606640 1 -- 172.21.15.142:0/1598531884 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06d000d500 con 0x55ba8ad457e0 2024-09-22T08:36:44.385 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.382+0000 7f05cb606640 1 -- 172.21.15.142:0/1598531884 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06d000d880 con 0x55ba8ad457e0 2024-09-22T08:36:44.386 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.383+0000 7f06e1b26800 1 -- 172.21.15.142:0/1598531884 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ba8ad457e0 msgr2=0x55ba8ae34d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:44.386 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.383+0000 7f06e1b26800 1 --2- 172.21.15.142:0/1598531884 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ba8ad457e0 0x55ba8ae34d70 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f06d0001ea0 tx=0x7f06d000b6a0 comp rx=0 tx=0).stop 2024-09-22T08:36:44.386 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.383+0000 7f06e1b26800 1 -- 172.21.15.142:0/1598531884 shutdown_connections 2024-09-22T08:36:44.386 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.383+0000 7f06e1b26800 1 --2- 172.21.15.142:0/1598531884 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ba8ad457e0 0x55ba8ae34d70 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:44.386 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.383+0000 7f06e1b26800 1 -- 172.21.15.142:0/1598531884 >> 172.21.15.142:0/1598531884 conn(0x55ba8ad40bb0 msgr2=0x55ba8ae306f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:44.386 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.383+0000 7f06e1b26800 1 -- 172.21.15.142:0/1598531884 shutdown_connections 2024-09-22T08:36:44.386 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.383+0000 7f06e1b26800 1 -- 172.21.15.142:0/1598531884 wait complete. 2024-09-22T08:36:44.386 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.383+0000 7f06e1b26800 1 Processor -- start 2024-09-22T08:36:44.387 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.383+0000 7f06e1b26800 1 -- start start 2024-09-22T08:36:44.387 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.384+0000 7f06e1b26800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ba8ad457e0 0x55ba8acb98c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:44.387 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.384+0000 7f06e1b26800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55ba8ad4cac0 con 0x55ba8ad457e0 2024-09-22T08:36:44.387 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.384+0000 7f06dd7d9640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ba8ad457e0 0x55ba8acb98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:44.387 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.384+0000 7f06dd7d9640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ba8ad457e0 0x55ba8acb98c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:38600/0 (socket says 172.21.15.142:38600) 2024-09-22T08:36:44.387 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.384+0000 7f06dd7d9640 1 -- 172.21.15.142:0/3158576660 learned_addr learned my addr 172.21.15.142:0/3158576660 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:44.387 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.384+0000 7f06dd7d9640 1 -- 172.21.15.142:0/3158576660 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ba8acb9e00 con 0x55ba8ad457e0 2024-09-22T08:36:44.387 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.384+0000 7f06dd7d9640 1 --2- 172.21.15.142:0/3158576660 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ba8ad457e0 0x55ba8acb98c0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f06d00012f0 tx=0x7f06d0000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:44.392 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.385+0000 7f05c9e03640 1 -- 172.21.15.142:0/3158576660 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06d000f9d0 con 0x55ba8ad457e0 2024-09-22T08:36:44.393 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.385+0000 7f05c9e03640 1 -- 172.21.15.142:0/3158576660 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06d000fb70 con 0x55ba8ad457e0 2024-09-22T08:36:44.393 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.385+0000 7f06e1b26800 1 -- 172.21.15.142:0/3158576660 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ba8ae42980 con 0x55ba8ad457e0 2024-09-22T08:36:44.393 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.385+0000 7f05c9e03640 1 -- 172.21.15.142:0/3158576660 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06d000fe50 con 0x55ba8ad457e0 2024-09-22T08:36:44.393 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.385+0000 7f06e1b26800 1 -- 172.21.15.142:0/3158576660 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ba8ae42de0 con 0x55ba8ad457e0 2024-09-22T08:36:44.393 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.386+0000 7f05c9e03640 1 -- 172.21.15.142:0/3158576660 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f06d0017040 con 0x55ba8ad457e0 2024-09-22T08:36:44.393 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.386+0000 7f05c9e03640 1 --2- 172.21.15.142:0/3158576660 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f05c403d1a0 0x7f05c403f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:44.393 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.386+0000 7f05c9e03640 1 -- 172.21.15.142:0/3158576660 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f06d0015020 con 0x55ba8ad457e0 2024-09-22T08:36:44.393 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.386+0000 7f06dcfd8640 1 --2- 172.21.15.142:0/3158576660 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f05c403d1a0 0x7f05c403f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:44.393 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.386+0000 7f06e1b26800 1 --2- 172.21.15.142:0/3158576660 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55ba8ad46bf0 0x55ba8ae46d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:44.393 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.386+0000 7f06e1b26800 1 -- 172.21.15.142:0/3158576660 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ba8ae47400 con 0x55ba8ad46bf0 2024-09-22T08:36:44.393 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.386+0000 7f06ddfda640 1 --2- 172.21.15.142:0/3158576660 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55ba8ad46bf0 0x55ba8ae46d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:44.393 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.386+0000 7f06dcfd8640 1 --2- 172.21.15.142:0/3158576660 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f05c403d1a0 0x7f05c403f660 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f06d4057000 tx=0x7f06d4052000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:44.394 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.386+0000 7f06ddfda640 1 --2- 172.21.15.142:0/3158576660 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55ba8ad46bf0 0x55ba8ae46d90 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:44.394 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.387+0000 7f06ddfda640 1 -- 172.21.15.142:0/3158576660 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f06d800a4d0 con 0x55ba8ad46bf0 2024-09-22T08:36:44.394 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.387+0000 7f06e1b26800 1 -- 172.21.15.142:0/3158576660 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ba8ae44200 con 0x55ba8ad46bf0 2024-09-22T08:36:44.394 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.387+0000 7f06ddfda640 1 -- 172.21.15.142:0/3158576660 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f06d800a4d0 con 0x55ba8ad46bf0 2024-09-22T08:36:44.394 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.387+0000 7f06e1b26800 1 --2- 172.21.15.142:0/3158576660 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55ba8ae49730 0x55ba8ae4bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:44.394 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.387+0000 7f06e1b26800 1 -- 172.21.15.142:0/3158576660 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:3 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ba8ae4c1f0 con 0x55ba8ae49730 2024-09-22T08:36:44.394 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.387+0000 7f06dd7d9640 1 --2- 172.21.15.142:0/3158576660 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55ba8ae49730 0x55ba8ae4bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:44.394 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.387+0000 7f06dd7d9640 1 --2- 172.21.15.142:0/3158576660 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55ba8ae49730 0x55ba8ae4bb20 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:44.394 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.388+0000 7f06dd7d9640 1 -- 172.21.15.142:0/3158576660 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(3 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f06d002d070 con 0x55ba8ae49730 2024-09-22T08:36:44.394 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.388+0000 7f06e1b26800 1 -- 172.21.15.142:0/3158576660 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ba8ae485d0 con 0x55ba8ad46bf0 2024-09-22T08:36:44.394 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.388+0000 7f06ddfda640 1 -- 172.21.15.142:0/3158576660 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f06d800a4d0 con 0x55ba8ad46bf0 2024-09-22T08:36:44.394 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.388+0000 7f06e1b26800 1 -- 172.21.15.142:0/3158576660 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ba8ae48a70 con 0x55ba8ae49730 2024-09-22T08:36:44.394 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.388+0000 7f06dd7d9640 1 -- 172.21.15.142:0/3158576660 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(5 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f06d002d070 con 0x55ba8ae49730 2024-09-22T08:36:44.395 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.388+0000 7f06e1b26800 1 Processor -- start 2024-09-22T08:36:44.395 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.388+0000 7f06e1b26800 1 -- start start 2024-09-22T08:36:44.395 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.389+0000 7f06e1b26800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ba8ae5ab60 0x55ba8ae5af80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:44.395 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.389+0000 7f06e1b26800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55ba8ac3dd50 con 0x55ba8ae5ab60 2024-09-22T08:36:44.395 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.389+0000 7f06ddfda640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ba8ae5ab60 0x55ba8ae5af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:44.395 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.389+0000 7f06ddfda640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ba8ae5ab60 0x55ba8ae5af80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:38602/0 (socket says 172.21.15.142:38602) 2024-09-22T08:36:44.395 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.389+0000 7f06ddfda640 1 -- 172.21.15.142:0/1171137466 learned_addr learned my addr 172.21.15.142:0/1171137466 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:44.395 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.389+0000 7f06ddfda640 1 -- 172.21.15.142:0/1171137466 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ba8ae5b5c0 con 0x55ba8ae5ab60 2024-09-22T08:36:44.395 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.389+0000 7f06ddfda640 1 --2- 172.21.15.142:0/1171137466 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ba8ae5ab60 0x55ba8ae5af80 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x55ba8acba0e0 tx=0x7f06d80167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:44.395 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.389+0000 7f05c2ffd640 1 -- 172.21.15.142:0/1171137466 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06d8013640 con 0x55ba8ae5ab60 2024-09-22T08:36:44.395 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.390+0000 7f05c2ffd640 1 -- 172.21.15.142:0/1171137466 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06d80137e0 con 0x55ba8ae5ab60 2024-09-22T08:36:44.395 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.390+0000 7f06e1b26800 1 -- 172.21.15.142:0/1171137466 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ba8ae5bdf0 con 0x55ba8ae5ab60 2024-09-22T08:36:44.395 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.390+0000 7f05c2ffd640 1 -- 172.21.15.142:0/1171137466 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06d8013ae0 con 0x55ba8ae5ab60 2024-09-22T08:36:44.395 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.390+0000 7f06e1b26800 1 -- 172.21.15.142:0/1171137466 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ba8ae5c390 con 0x55ba8ae5ab60 2024-09-22T08:36:44.396 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.390+0000 7f05c2ffd640 1 -- 172.21.15.142:0/1171137466 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f06d8011040 con 0x55ba8ae5ab60 2024-09-22T08:36:44.396 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.391+0000 7f05c2ffd640 1 --2- 172.21.15.142:0/1171137466 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f05b403d000 0x7f05b403f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:44.396 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.391+0000 7f05c2ffd640 1 -- 172.21.15.142:0/1171137466 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f06d800e040 con 0x55ba8ae5ab60 2024-09-22T08:36:44.396 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.391+0000 7f06dd7d9640 1 --2- 172.21.15.142:0/1171137466 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f05b403d000 0x7f05b403f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:44.396 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.391+0000 7f06e1b26800 1 Processor -- start 2024-09-22T08:36:44.396 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.391+0000 7f06e1b26800 1 -- start start 2024-09-22T08:36:44.396 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.391+0000 7f06dd7d9640 1 --2- 172.21.15.142:0/1171137466 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f05b403d000 0x7f05b403f4c0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f06d00531e0 tx=0x7f06d00011b0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:44.396 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.391+0000 7f06e1b26800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ba8ae675e0 0x55ba8ae679e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:44.397 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.391+0000 7f06e1b26800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55ba8ae35790 con 0x55ba8ae675e0 2024-09-22T08:36:44.397 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.391+0000 7f06ddfda640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ba8ae675e0 0x55ba8ae679e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:44.397 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.391+0000 7f06ddfda640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ba8ae675e0 0x55ba8ae679e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:38608/0 (socket says 172.21.15.142:38608) 2024-09-22T08:36:44.397 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.391+0000 7f06ddfda640 1 -- 172.21.15.142:0/2190317854 learned_addr learned my addr 172.21.15.142:0/2190317854 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:44.397 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.392+0000 7f06ddfda640 1 -- 172.21.15.142:0/2190317854 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ba8ae67fd0 con 0x55ba8ae675e0 2024-09-22T08:36:44.412 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.392+0000 7f06ddfda640 1 --2- 172.21.15.142:0/2190317854 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ba8ae675e0 0x55ba8ae679e0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f06d80547f0 tx=0x7f06d80206e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8979a842fe4744ed server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:44.412 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.392+0000 7f05c0ff9640 1 -- 172.21.15.142:0/2190317854 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06d8044030 con 0x55ba8ae675e0 2024-09-22T08:36:44.412 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.392+0000 7f05c0ff9640 1 -- 172.21.15.142:0/2190317854 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06d8021960 con 0x55ba8ae675e0 2024-09-22T08:36:44.412 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.392+0000 7f05c0ff9640 1 -- 172.21.15.142:0/2190317854 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06d801f340 con 0x55ba8ae675e0 2024-09-22T08:36:44.412 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.392+0000 7f06e1b26800 1 -- 172.21.15.142:0/2190317854 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ba8ae675e0 msgr2=0x55ba8ae679e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:44.412 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.392+0000 7f06e1b26800 1 --2- 172.21.15.142:0/2190317854 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ba8ae675e0 0x55ba8ae679e0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f06d80547f0 tx=0x7f06d80206e0 comp rx=0 tx=0).stop 2024-09-22T08:36:44.412 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.392+0000 7f06e1b26800 1 -- 172.21.15.142:0/2190317854 shutdown_connections 2024-09-22T08:36:44.412 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.392+0000 7f06e1b26800 1 --2- 172.21.15.142:0/2190317854 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ba8ae675e0 0x55ba8ae679e0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:44.412 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.392+0000 7f06e1b26800 1 -- 172.21.15.142:0/2190317854 >> 172.21.15.142:0/2190317854 conn(0x55ba8ae639e0 msgr2=0x55ba8ae61c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:44.412 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.393+0000 7f06e1b26800 1 -- 172.21.15.142:0/2190317854 shutdown_connections 2024-09-22T08:36:44.413 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.393+0000 7f06e1b26800 1 -- 172.21.15.142:0/2190317854 wait complete. 2024-09-22T08:36:44.413 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.393+0000 7f06e1b26800 1 Processor -- start 2024-09-22T08:36:44.413 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.393+0000 7f06e1b26800 1 -- start start 2024-09-22T08:36:44.413 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.393+0000 7f06e1b26800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ba8ae675e0 0x55ba8ae6ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:44.413 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.393+0000 7f06e1b26800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55ba8ae685f0 con 0x55ba8ae675e0 2024-09-22T08:36:44.413 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.393+0000 7f06ddfda640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ba8ae675e0 0x55ba8ae6ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:44.413 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.393+0000 7f06ddfda640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ba8ae675e0 0x55ba8ae6ebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:38618/0 (socket says 172.21.15.142:38618) 2024-09-22T08:36:44.413 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.393+0000 7f06ddfda640 1 -- 172.21.15.142:0/483507074 learned_addr learned my addr 172.21.15.142:0/483507074 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:44.413 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.393+0000 7f06ddfda640 1 -- 172.21.15.142:0/483507074 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ba8ae6f110 con 0x55ba8ae675e0 2024-09-22T08:36:44.413 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.394+0000 7f06ddfda640 1 --2- 172.21.15.142:0/483507074 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ba8ae675e0 0x55ba8ae6ebb0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f06d8022ff0 tx=0x7f06d8054780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:44.413 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.394+0000 7f05b2ffd640 1 -- 172.21.15.142:0/483507074 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06d80459c0 con 0x55ba8ae675e0 2024-09-22T08:36:44.413 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.394+0000 7f05b2ffd640 1 -- 172.21.15.142:0/483507074 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06d8045b80 con 0x55ba8ae675e0 2024-09-22T08:36:44.413 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.394+0000 7f06e1b26800 1 -- 172.21.15.142:0/483507074 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ba8ae6f3a0 con 0x55ba8ae675e0 2024-09-22T08:36:44.413 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.394+0000 7f05b2ffd640 1 -- 172.21.15.142:0/483507074 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06d8045130 con 0x55ba8ae675e0 2024-09-22T08:36:44.414 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.394+0000 7f06e1b26800 1 -- 172.21.15.142:0/483507074 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ba8ae6ff30 con 0x55ba8ae675e0 2024-09-22T08:36:44.414 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.395+0000 7f05b2ffd640 1 -- 172.21.15.142:0/483507074 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f06d80452d0 con 0x55ba8ae675e0 2024-09-22T08:36:44.414 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.395+0000 7f05b2ffd640 1 --2- 172.21.15.142:0/483507074 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f05a803cfb0 0x7f05a803f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:44.414 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.395+0000 7f05b2ffd640 1 -- 172.21.15.142:0/483507074 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f06d8034af0 con 0x55ba8ae675e0 2024-09-22T08:36:44.414 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.395+0000 7f06e1b26800 20 rados->read ofs=0 len=0 2024-09-22T08:36:44.414 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.395+0000 7f06dd7d9640 1 --2- 172.21.15.142:0/483507074 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f05a803cfb0 0x7f05a803f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:44.414 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.395+0000 7f06e1b26800 1 --2- 172.21.15.142:0/483507074 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55ba8ae7a4e0 0x55ba8ae7c970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:44.414 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.395+0000 7f06e1b26800 1 -- 172.21.15.142:0/483507074 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ba8ae7d0c0 con 0x55ba8ae7a4e0 2024-09-22T08:36:44.414 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.395+0000 7f06dcfd8640 1 --2- 172.21.15.142:0/483507074 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55ba8ae7a4e0 0x55ba8ae7c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:44.414 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.395+0000 7f06dd7d9640 1 --2- 172.21.15.142:0/483507074 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f05a803cfb0 0x7f05a803f470 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f06d000efd0 tx=0x7f06d0041000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:44.414 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.396+0000 7f06dcfd8640 1 --2- 172.21.15.142:0/483507074 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55ba8ae7a4e0 0x55ba8ae7c970 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:44.414 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.396+0000 7f06dcfd8640 1 -- 172.21.15.142:0/483507074 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f06d4051070 con 0x55ba8ae7a4e0 2024-09-22T08:36:44.414 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.396+0000 7f06e1b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:44.415 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.396+0000 7f06e1b26800 20 realm 2024-09-22T08:36:44.415 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.396+0000 7f06e1b26800 20 rados->read ofs=0 len=0 2024-09-22T08:36:44.415 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.396+0000 7f06e1b26800 1 -- 172.21.15.142:0/483507074 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ba8ae7d4f0 con 0x55ba8ae7a4e0 2024-09-22T08:36:44.415 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.396+0000 7f06dcfd8640 1 -- 172.21.15.142:0/483507074 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f06d4051070 con 0x55ba8ae7a4e0 2024-09-22T08:36:44.415 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.396+0000 7f06e1b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:44.415 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.396+0000 7f06e1b26800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:36:44.415 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.396+0000 7f06e1b26800 20 rados->read ofs=0 len=0 2024-09-22T08:36:44.415 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.396+0000 7f06e1b26800 1 -- 172.21.15.142:0/483507074 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ba8ae7ddc0 con 0x55ba8ae7a4e0 2024-09-22T08:36:44.415 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.396+0000 7f06dcfd8640 1 -- 172.21.15.142:0/483507074 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f06d4051070 con 0x55ba8ae7a4e0 2024-09-22T08:36:44.415 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.396+0000 7f06e1b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:44.415 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.396+0000 7f06e1b26800 20 rados->read ofs=0 len=0 2024-09-22T08:36:44.415 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.396+0000 7f06e1b26800 1 -- 172.21.15.142:0/483507074 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ba8ae7e160 con 0x55ba8ae7a4e0 2024-09-22T08:36:44.415 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.397+0000 7f06dcfd8640 1 -- 172.21.15.142:0/483507074 <== osd.1 v2:172.21.15.142:6816/3192108003 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f06d4051070 con 0x55ba8ae7a4e0 2024-09-22T08:36:44.416 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.397+0000 7f06e1b26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:36:44.416 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.397+0000 7f06e1b26800 20 rados->read ofs=0 len=0 2024-09-22T08:36:44.416 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.397+0000 7f06e1b26800 1 --2- 172.21.15.142:0/483507074 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55ba8ae7eec0 0x55ba8ae812b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:44.416 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.397+0000 7f06e1b26800 1 -- 172.21.15.142:0/483507074 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ba8ae817f0 con 0x55ba8ae7eec0 2024-09-22T08:36:44.416 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.397+0000 7f06ddfda640 1 --2- 172.21.15.142:0/483507074 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55ba8ae7eec0 0x55ba8ae812b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:44.416 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.397+0000 7f06ddfda640 1 --2- 172.21.15.142:0/483507074 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55ba8ae7eec0 0x55ba8ae812b0 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:44.416 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.397+0000 7f06ddfda640 1 -- 172.21.15.142:0/483507074 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(5 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f06d8053020 con 0x55ba8ae7eec0 2024-09-22T08:36:44.416 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.397+0000 7f06e1b26800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:36:44.416 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.397+0000 7f06e1b26800 20 searching for the correct realm 2024-09-22T08:36:44.416 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.397+0000 7f06e1b26800 1 -- 172.21.15.142:0/483507074 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ba8ae83160 con 0x55ba8ae7eec0 2024-09-22T08:36:44.416 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.398+0000 7f06ddfda640 1 -- 172.21.15.142:0/483507074 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06d8053020 con 0x55ba8ae7eec0 2024-09-22T08:36:44.416 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.398+0000 7f06ddfda640 1 --2- 172.21.15.142:0/483507074 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f06d8057040 0x7f06d8035a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:44.416 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.398+0000 7f06ddfda640 1 -- 172.21.15.142:0/483507074 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ba8ae83160 con 0x7f06d8057040 2024-09-22T08:36:44.416 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.398+0000 7f06dd7d9640 1 --2- 172.21.15.142:0/483507074 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f06d8057040 0x7f06d8035a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:44.417 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.398+0000 7f06dd7d9640 1 --2- 172.21.15.142:0/483507074 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f06d8057040 0x7f06d8035a80 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:44.417 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.398+0000 7f06dd7d9640 1 -- 172.21.15.142:0/483507074 <== osd.2 v2:172.21.15.142:6808/279438927 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06d0039070 con 0x7f06d8057040 2024-09-22T08:36:44.417 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.398+0000 7f06dd7d9640 1 --2- 172.21.15.142:0/483507074 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f06d00541f0 0x7f06d0054630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:44.417 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.398+0000 7f06dd7d9640 1 -- 172.21.15.142:0/483507074 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ba8ae83160 con 0x7f06d00541f0 2024-09-22T08:36:44.417 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.398+0000 7f06dcfd8640 1 --2- 172.21.15.142:0/483507074 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f06d00541f0 0x7f06d0054630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:44.417 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.399+0000 7f06dcfd8640 1 --2- 172.21.15.142:0/483507074 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f06d00541f0 0x7f06d0054630 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:44.417 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.399+0000 7f06dcfd8640 1 -- 172.21.15.142:0/483507074 <== osd.0 v2:172.21.15.31:6800/168281188 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06d4051070 con 0x7f06d00541f0 2024-09-22T08:36:44.417 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.399+0000 7f06dcfd8640 1 -- 172.21.15.142:0/483507074 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ba8ae83160 con 0x55ba8ae7a4e0 2024-09-22T08:36:44.417 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.399+0000 7f06dcfd8640 1 -- 172.21.15.142:0/483507074 <== osd.1 v2:172.21.15.142:6816/3192108003 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06d4051070 con 0x55ba8ae7a4e0 2024-09-22T08:36:44.417 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.399+0000 7f06dcfd8640 1 -- 172.21.15.142:0/483507074 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ba8ae83160 con 0x55ba8ae7a4e0 2024-09-22T08:36:44.418 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.400+0000 7f06dcfd8640 1 -- 172.21.15.142:0/483507074 <== osd.1 v2:172.21.15.142:6816/3192108003 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06d4051070 con 0x55ba8ae7a4e0 2024-09-22T08:36:44.418 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.400+0000 7f06dcfd8640 1 -- 172.21.15.142:0/483507074 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ba8ae83160 con 0x7f06d00541f0 2024-09-22T08:36:44.418 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.400+0000 7f06dcfd8640 1 -- 172.21.15.142:0/483507074 <== osd.0 v2:172.21.15.31:6800/168281188 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06d4051070 con 0x7f06d00541f0 2024-09-22T08:36:44.418 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.400+0000 7f06dcfd8640 1 -- 172.21.15.142:0/483507074 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ba8ae83160 con 0x7f06d00541f0 2024-09-22T08:36:44.418 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.400+0000 7f06dcfd8640 1 -- 172.21.15.142:0/483507074 <== osd.0 v2:172.21.15.31:6800/168281188 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06d4051070 con 0x7f06d00541f0 2024-09-22T08:36:44.418 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.400+0000 7f06dcfd8640 1 -- 172.21.15.142:0/483507074 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ba8ae83160 con 0x7f06d8057040 2024-09-22T08:36:44.418 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.400+0000 7f06dd7d9640 1 -- 172.21.15.142:0/483507074 <== osd.2 v2:172.21.15.142:6808/279438927 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06d0039070 con 0x7f06d8057040 2024-09-22T08:36:44.418 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.400+0000 7f06dd7d9640 1 -- 172.21.15.142:0/483507074 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ba8ae83160 con 0x55ba8ae7eec0 2024-09-22T08:36:44.418 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.401+0000 7f06ddfda640 1 -- 172.21.15.142:0/483507074 <== osd.3 v2:172.21.15.142:6800/1064901393 3 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06d8053020 con 0x55ba8ae7eec0 2024-09-22T08:36:44.418 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.401+0000 7f06ddfda640 1 -- 172.21.15.142:0/483507074 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ba8ae83160 con 0x55ba8ae7a4e0 2024-09-22T08:36:44.418 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.401+0000 7f06dcfd8640 1 -- 172.21.15.142:0/483507074 <== osd.1 v2:172.21.15.142:6816/3192108003 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06d4051070 con 0x55ba8ae7a4e0 2024-09-22T08:36:44.419 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.401+0000 7f06dcfd8640 1 -- 172.21.15.142:0/483507074 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ba8ae83160 con 0x7f06d00541f0 2024-09-22T08:36:44.419 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.401+0000 7f06dcfd8640 1 -- 172.21.15.142:0/483507074 <== osd.0 v2:172.21.15.31:6800/168281188 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06d4051070 con 0x7f06d00541f0 2024-09-22T08:36:44.419 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.401+0000 7f06dcfd8640 1 -- 172.21.15.142:0/483507074 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ba8ae83160 con 0x55ba8ae7a4e0 2024-09-22T08:36:44.419 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.401+0000 7f06dcfd8640 1 -- 172.21.15.142:0/483507074 <== osd.1 v2:172.21.15.142:6816/3192108003 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06d4051070 con 0x55ba8ae7a4e0 2024-09-22T08:36:44.419 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.401+0000 7f06dcfd8640 1 -- 172.21.15.142:0/483507074 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ba8ae83160 con 0x7f06d8057040 2024-09-22T08:36:44.419 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.402+0000 7f06dd7d9640 1 -- 172.21.15.142:0/483507074 <== osd.2 v2:172.21.15.142:6808/279438927 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f06d0039070 con 0x7f06d8057040 2024-09-22T08:36:44.419 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.402+0000 7f06dd7d9640 1 -- 172.21.15.142:0/483507074 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ba8ae83160 con 0x55ba8ae7eec0 2024-09-22T08:36:44.419 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.402+0000 7f06ddfda640 1 -- 172.21.15.142:0/483507074 <== osd.3 v2:172.21.15.142:6800/1064901393 4 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06d8053020 con 0x55ba8ae7eec0 2024-09-22T08:36:44.419 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.402+0000 7f06ddfda640 1 -- 172.21.15.142:0/483507074 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ba8ae83160 con 0x55ba8ae7eec0 2024-09-22T08:36:44.419 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.402+0000 7f06ddfda640 1 -- 172.21.15.142:0/483507074 <== osd.3 v2:172.21.15.142:6800/1064901393 5 ==== osd_op_reply(20 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f06d8053020 con 0x55ba8ae7eec0 2024-09-22T08:36:44.419 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.402+0000 7f06ddfda640 1 -- 172.21.15.142:0/483507074 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ba8ae83160 con 0x7f06d00541f0 2024-09-22T08:36:44.419 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.402+0000 7f06dcfd8640 1 -- 172.21.15.142:0/483507074 <== osd.0 v2:172.21.15.31:6800/168281188 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06d4051070 con 0x7f06d00541f0 2024-09-22T08:36:44.419 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.402+0000 7f06dcfd8640 1 -- 172.21.15.142:0/483507074 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ba8ae83160 con 0x55ba8ae7eec0 2024-09-22T08:36:44.420 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.403+0000 7f06ddfda640 1 -- 172.21.15.142:0/483507074 <== osd.3 v2:172.21.15.142:6800/1064901393 6 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06d8053020 con 0x55ba8ae7eec0 2024-09-22T08:36:44.420 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.403+0000 7f06ddfda640 1 -- 172.21.15.142:0/483507074 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ba8ae83160 con 0x55ba8ae7eec0 2024-09-22T08:36:44.420 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.403+0000 7f06ddfda640 1 -- 172.21.15.142:0/483507074 <== osd.3 v2:172.21.15.142:6800/1064901393 7 ==== osd_op_reply(23 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f06d8053020 con 0x55ba8ae7eec0 2024-09-22T08:36:44.420 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.403+0000 7f06ddfda640 1 -- 172.21.15.142:0/483507074 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ba8ae83160 con 0x55ba8ae7a4e0 2024-09-22T08:36:44.420 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.403+0000 7f06dcfd8640 1 -- 172.21.15.142:0/483507074 <== osd.1 v2:172.21.15.142:6816/3192108003 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06d4051070 con 0x55ba8ae7a4e0 2024-09-22T08:36:44.420 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.403+0000 7f06dcfd8640 1 -- 172.21.15.142:0/483507074 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ba8ae83160 con 0x55ba8ae7a4e0 2024-09-22T08:36:44.420 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.403+0000 7f06dcfd8640 1 -- 172.21.15.142:0/483507074 <== osd.1 v2:172.21.15.142:6816/3192108003 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f06d4051070 con 0x55ba8ae7a4e0 2024-09-22T08:36:44.420 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.403+0000 7f06dcfd8640 1 -- 172.21.15.142:0/483507074 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ba8ae83160 con 0x7f06d00541f0 2024-09-22T08:36:44.420 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.403+0000 7f06dcfd8640 1 -- 172.21.15.142:0/483507074 <== osd.0 v2:172.21.15.31:6800/168281188 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06d4051070 con 0x7f06d00541f0 2024-09-22T08:36:44.420 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.404+0000 7f06dcfd8640 1 -- 172.21.15.142:0/483507074 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ba8ae83160 con 0x55ba8ae7eec0 2024-09-22T08:36:44.420 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.404+0000 7f06ddfda640 1 -- 172.21.15.142:0/483507074 <== osd.3 v2:172.21.15.142:6800/1064901393 8 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06d8053020 con 0x55ba8ae7eec0 2024-09-22T08:36:44.420 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.404+0000 7f06ddfda640 1 -- 172.21.15.142:0/483507074 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ba8ae83160 con 0x7f06d8057040 2024-09-22T08:36:44.420 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.404+0000 7f06dd7d9640 1 -- 172.21.15.142:0/483507074 <== osd.2 v2:172.21.15.142:6808/279438927 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06d0039070 con 0x7f06d8057040 2024-09-22T08:36:44.421 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.404+0000 7f06dd7d9640 1 -- 172.21.15.142:0/483507074 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ba8ae83160 con 0x55ba8ae7a4e0 2024-09-22T08:36:44.421 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.404+0000 7f06dcfd8640 1 -- 172.21.15.142:0/483507074 <== osd.1 v2:172.21.15.142:6816/3192108003 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06d4051070 con 0x55ba8ae7a4e0 2024-09-22T08:36:44.421 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.404+0000 7f06dcfd8640 1 -- 172.21.15.142:0/483507074 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ba8ae83160 con 0x7f06d00541f0 2024-09-22T08:36:44.421 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.405+0000 7f06dcfd8640 1 -- 172.21.15.142:0/483507074 <== osd.0 v2:172.21.15.31:6800/168281188 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06d4051070 con 0x7f06d00541f0 2024-09-22T08:36:44.421 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.405+0000 7f06dcfd8640 1 -- 172.21.15.142:0/483507074 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ba8ae83160 con 0x55ba8ae7eec0 2024-09-22T08:36:44.421 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.405+0000 7f06ddfda640 1 -- 172.21.15.142:0/483507074 <== osd.3 v2:172.21.15.142:6800/1064901393 9 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06d8053020 con 0x55ba8ae7eec0 2024-09-22T08:36:44.421 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.405+0000 7f06ddfda640 1 -- 172.21.15.142:0/483507074 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ba8ae83160 con 0x7f06d00541f0 2024-09-22T08:36:44.421 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.405+0000 7f06dcfd8640 1 -- 172.21.15.142:0/483507074 <== osd.0 v2:172.21.15.31:6800/168281188 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06d4051070 con 0x7f06d00541f0 2024-09-22T08:36:44.421 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.405+0000 7f06dcfd8640 1 -- 172.21.15.142:0/483507074 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ba8ae83160 con 0x7f06d8057040 2024-09-22T08:36:44.421 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.405+0000 7f06dd7d9640 1 -- 172.21.15.142:0/483507074 <== osd.2 v2:172.21.15.142:6808/279438927 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06d0039070 con 0x7f06d8057040 2024-09-22T08:36:44.421 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.405+0000 7f06dd7d9640 1 -- 172.21.15.142:0/483507074 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ba8ae83160 con 0x55ba8ae7eec0 2024-09-22T08:36:44.422 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.406+0000 7f06ddfda640 1 -- 172.21.15.142:0/483507074 <== osd.3 v2:172.21.15.142:6800/1064901393 10 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06d8053020 con 0x55ba8ae7eec0 2024-09-22T08:36:44.422 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.406+0000 7f06ddfda640 1 -- 172.21.15.142:0/483507074 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ba8ae83160 con 0x7f06d00541f0 2024-09-22T08:36:44.422 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.406+0000 7f06dcfd8640 1 -- 172.21.15.142:0/483507074 <== osd.0 v2:172.21.15.31:6800/168281188 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06d4051070 con 0x7f06d00541f0 2024-09-22T08:36:44.422 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.406+0000 7f06dcfd8640 1 -- 172.21.15.142:0/483507074 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ba8ae83160 con 0x55ba8ae7a4e0 2024-09-22T08:36:44.422 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.406+0000 7f06dcfd8640 1 -- 172.21.15.142:0/483507074 <== osd.1 v2:172.21.15.142:6816/3192108003 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f06d4051070 con 0x55ba8ae7a4e0 2024-09-22T08:36:44.422 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.406+0000 7f06dcfd8640 1 -- 172.21.15.142:0/483507074 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ba8ae83160 con 0x7f06d8057040 2024-09-22T08:36:44.422 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.406+0000 7f06dd7d9640 1 -- 172.21.15.142:0/483507074 <== osd.2 v2:172.21.15.142:6808/279438927 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06d0039070 con 0x7f06d8057040 2024-09-22T08:36:44.422 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.406+0000 7f06e1b26800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:36:44.422 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.406+0000 7f06e1b26800 20 RGWRados::pool_iterate: got zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec 2024-09-22T08:36:44.423 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.406+0000 7f06e1b26800 20 RGWRados::pool_iterate: got zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f 2024-09-22T08:36:44.423 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.406+0000 7f06e1b26800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:36:44.423 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.406+0000 7f06e1b26800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:36:44.423 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.406+0000 7f06e1b26800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:36:44.423 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.406+0000 7f06e1b26800 20 rados->read ofs=0 len=0 2024-09-22T08:36:44.423 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.406+0000 7f06e1b26800 1 -- 172.21.15.142:0/483507074 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ba8ae82230 con 0x55ba8ae7a4e0 2024-09-22T08:36:44.423 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.407+0000 7f06dcfd8640 1 -- 172.21.15.142:0/483507074 <== osd.1 v2:172.21.15.142:6816/3192108003 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f06d4051070 con 0x55ba8ae7a4e0 2024-09-22T08:36:44.423 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.407+0000 7f06e1b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:44.423 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.407+0000 7f06e1b26800 20 rados->read ofs=0 len=0 2024-09-22T08:36:44.423 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.407+0000 7f06e1b26800 1 -- 172.21.15.142:0/483507074 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ba8ae82ad0 con 0x55ba8ae7a4e0 2024-09-22T08:36:44.423 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.407+0000 7f06dcfd8640 1 -- 172.21.15.142:0/483507074 <== osd.1 v2:172.21.15.142:6816/3192108003 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f06d4051070 con 0x55ba8ae7a4e0 2024-09-22T08:36:44.423 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.407+0000 7f06e1b26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:36:44.423 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.407+0000 7f06e1b26800 20 rados->read ofs=0 len=0 2024-09-22T08:36:44.423 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.407+0000 7f06e1b26800 1 -- 172.21.15.142:0/483507074 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:40 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ba8ae81e70 con 0x55ba8ae7eec0 2024-09-22T08:36:44.424 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.407+0000 7f06ddfda640 1 -- 172.21.15.142:0/483507074 <== osd.3 v2:172.21.15.142:6800/1064901393 11 ==== osd_op_reply(40 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f06d8053020 con 0x55ba8ae7eec0 2024-09-22T08:36:44.424 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.407+0000 7f06e1b26800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:36:44.424 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.407+0000 7f06e1b26800 20 zone default found 2024-09-22T08:36:44.424 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.407+0000 7f06e1b26800 4 Realm: () 2024-09-22T08:36:44.424 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.407+0000 7f06e1b26800 4 ZoneGroup: default (d89f6f57-1007-47dd-9065-f486c7b01aec) 2024-09-22T08:36:44.424 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.407+0000 7f06e1b26800 4 Zone: default (e239248c-0bee-4e41-803a-24b288d3eb8f) 2024-09-22T08:36:44.424 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.407+0000 7f06e1b26800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:36:44.424 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.407+0000 7f06e1b26800 20 zonegroup default 2024-09-22T08:36:44.424 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.407+0000 7f06e1b26800 20 rados->read ofs=0 len=0 2024-09-22T08:36:44.424 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.407+0000 7f06e1b26800 1 -- 172.21.15.142:0/483507074 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ba8ae82720 con 0x7f06d00541f0 2024-09-22T08:36:44.424 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.408+0000 7f06dcfd8640 1 -- 172.21.15.142:0/483507074 <== osd.0 v2:172.21.15.31:6800/168281188 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f06d4051070 con 0x7f06d00541f0 2024-09-22T08:36:44.424 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.408+0000 7f06e1b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:44.424 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.408+0000 7f06e1b26800 20 rados->read ofs=0 len=0 2024-09-22T08:36:44.424 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.408+0000 7f06e1b26800 1 -- 172.21.15.142:0/483507074 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ba8ae85a20 con 0x55ba8ae7eec0 2024-09-22T08:36:44.425 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.408+0000 7f06ddfda640 1 -- 172.21.15.142:0/483507074 <== osd.3 v2:172.21.15.142:6800/1064901393 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f06d8053020 con 0x55ba8ae7eec0 2024-09-22T08:36:44.425 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.408+0000 7f06e1b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:44.425 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.408+0000 7f06e1b26800 20 rados->read ofs=0 len=0 2024-09-22T08:36:44.425 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.408+0000 7f06e1b26800 1 -- 172.21.15.142:0/483507074 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ba8ae85dc0 con 0x55ba8ae7eec0 2024-09-22T08:36:44.425 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.408+0000 7f06ddfda640 1 -- 172.21.15.142:0/483507074 <== osd.3 v2:172.21.15.142:6800/1064901393 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f06d8053020 con 0x55ba8ae7eec0 2024-09-22T08:36:44.425 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.408+0000 7f06e1b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:44.425 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.408+0000 7f06e1b26800 20 started sync module instance, tier type = 2024-09-22T08:36:44.425 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.408+0000 7f06e1b26800 20 started zone id=e239248c-0bee-4e41-803a-24b288d3eb8f (name=default) with tier type = 2024-09-22T08:36:44.425 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.408+0000 7f06e1b26800 1 -- 172.21.15.142:0/483507074 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ba8ae84eb0 con 0x7f06d8057040 2024-09-22T08:36:44.425 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.409+0000 7f06dd7d9640 1 -- 172.21.15.142:0/483507074 <== osd.2 v2:172.21.15.142:6808/279438927 7 ==== osd_op_reply(44 notify.0 [create] v30'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06d0039070 con 0x7f06d8057040 2024-09-22T08:36:44.425 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.409+0000 7f06e1b26800 1 -- 172.21.15.142:0/483507074 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94259682759328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ba8ae86700 con 0x7f06d8057040 2024-09-22T08:36:44.425 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.409+0000 7f06e1b26800 1 -- 172.21.15.142:0/483507074 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ba8ae86f50 con 0x55ba8ae7a4e0 2024-09-22T08:36:44.425 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.410+0000 7f06dd7d9640 1 -- 172.21.15.142:0/483507074 <== osd.2 v2:172.21.15.142:6808/279438927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94259682759328] v30'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06d0039070 con 0x7f06d8057040 2024-09-22T08:36:44.425 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.410+0000 7f06dcfd8640 1 -- 172.21.15.142:0/483507074 <== osd.1 v2:172.21.15.142:6816/3192108003 15 ==== osd_op_reply(46 notify.1 [create] v30'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06d4051070 con 0x55ba8ae7a4e0 2024-09-22T08:36:44.426 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.410+0000 7f06e1b26800 1 -- 172.21.15.142:0/483507074 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94259682765472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ba8ae87370 con 0x55ba8ae7a4e0 2024-09-22T08:36:44.426 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.410+0000 7f06e1b26800 1 -- 172.21.15.142:0/483507074 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ba8ae87e90 con 0x55ba8ae7eec0 2024-09-22T08:36:44.430 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.411+0000 7f06dcfd8640 1 -- 172.21.15.142:0/483507074 <== osd.1 v2:172.21.15.142:6816/3192108003 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94259682765472] v30'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06d4051070 con 0x55ba8ae7a4e0 2024-09-22T08:36:44.430 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.411+0000 7f06ddfda640 1 -- 172.21.15.142:0/483507074 <== osd.3 v2:172.21.15.142:6800/1064901393 14 ==== osd_op_reply(48 notify.2 [create] v30'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06d8053020 con 0x55ba8ae7eec0 2024-09-22T08:36:44.430 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.411+0000 7f06e1b26800 1 -- 172.21.15.142:0/483507074 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94259682769248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ba8ae87e50 con 0x55ba8ae7eec0 2024-09-22T08:36:44.430 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.411+0000 7f06e1b26800 1 -- 172.21.15.142:0/483507074 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ba8ae88910 con 0x7f06d8057040 2024-09-22T08:36:44.430 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.412+0000 7f06ddfda640 1 -- 172.21.15.142:0/483507074 <== osd.3 v2:172.21.15.142:6800/1064901393 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94259682769248] v30'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06d8053020 con 0x55ba8ae7eec0 2024-09-22T08:36:44.430 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.412+0000 7f06dd7d9640 1 -- 172.21.15.142:0/483507074 <== osd.2 v2:172.21.15.142:6808/279438927 9 ==== osd_op_reply(50 notify.3 [create] v30'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06d0039070 con 0x7f06d8057040 2024-09-22T08:36:44.430 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.412+0000 7f06e1b26800 1 -- 172.21.15.142:0/483507074 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94259682772000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ba8ae88d00 con 0x7f06d8057040 2024-09-22T08:36:44.431 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.412+0000 7f06e1b26800 1 -- 172.21.15.142:0/483507074 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ba8ae89740 con 0x55ba8ae7a4e0 2024-09-22T08:36:44.431 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.415+0000 7f06dcfd8640 1 -- 172.21.15.142:0/483507074 <== osd.1 v2:172.21.15.142:6816/3192108003 17 ==== osd_op_reply(52 notify.4 [create] v30'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06d4051070 con 0x55ba8ae7a4e0 2024-09-22T08:36:44.431 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.415+0000 7f06e1b26800 1 -- 172.21.15.142:0/483507074 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94259682775568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ba8ae89fe0 con 0x55ba8ae7a4e0 2024-09-22T08:36:44.431 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.415+0000 7f06e1b26800 1 -- 172.21.15.142:0/483507074 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ba8ae8aae0 con 0x7f06d00541f0 2024-09-22T08:36:44.431 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.415+0000 7f06dd7d9640 1 -- 172.21.15.142:0/483507074 <== osd.2 v2:172.21.15.142:6808/279438927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94259682772000] v30'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06d0039070 con 0x7f06d8057040 2024-09-22T08:36:44.431 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.416+0000 7f06dcfd8640 1 -- 172.21.15.142:0/483507074 <== osd.0 v2:172.21.15.31:6800/168281188 11 ==== osd_op_reply(54 notify.5 [create] v30'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06d4051070 con 0x7f06d00541f0 2024-09-22T08:36:44.431 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.416+0000 7f06e1b26800 1 -- 172.21.15.142:0/483507074 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94259682780624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ba8ae8aaa0 con 0x7f06d00541f0 2024-09-22T08:36:44.431 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.416+0000 7f06e1b26800 1 -- 172.21.15.142:0/483507074 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ba8ae8b4f0 con 0x7f06d00541f0 2024-09-22T08:36:44.431 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.416+0000 7f06dcfd8640 1 -- 172.21.15.142:0/483507074 <== osd.1 v2:172.21.15.142:6816/3192108003 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94259682775568] v30'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06d4051070 con 0x55ba8ae7a4e0 2024-09-22T08:36:44.431 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.417+0000 7f06dcfd8640 1 -- 172.21.15.142:0/483507074 <== osd.0 v2:172.21.15.31:6800/168281188 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94259682780624] v30'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06d4051070 con 0x7f06d00541f0 2024-09-22T08:36:44.431 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.417+0000 7f06dcfd8640 1 -- 172.21.15.142:0/483507074 <== osd.0 v2:172.21.15.31:6800/168281188 13 ==== osd_op_reply(56 notify.6 [create] v30'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06d4051070 con 0x7f06d00541f0 2024-09-22T08:36:44.431 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.417+0000 7f06e1b26800 1 -- 172.21.15.142:0/483507074 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94259682763344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ba8ae8b040 con 0x7f06d00541f0 2024-09-22T08:36:44.431 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.417+0000 7f06e1b26800 1 -- 172.21.15.142:0/483507074 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ba8ae8ba00 con 0x7f06d00541f0 2024-09-22T08:36:44.432 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.418+0000 7f06dcfd8640 1 -- 172.21.15.142:0/483507074 <== osd.0 v2:172.21.15.31:6800/168281188 14 ==== osd_op_reply(58 notify.7 [create] v30'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06d4051070 con 0x7f06d00541f0 2024-09-22T08:36:44.432 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.418+0000 7f06dcfd8640 1 -- 172.21.15.142:0/483507074 <== osd.0 v2:172.21.15.31:6800/168281188 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94259682763344] v30'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06d4051070 con 0x7f06d00541f0 2024-09-22T08:36:44.432 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.418+0000 7f06e1b26800 1 -- 172.21.15.142:0/483507074 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94259682784592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ba8ae8b970 con 0x7f06d00541f0 2024-09-22T08:36:44.432 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.418+0000 7f06e1b26800 20 add_watcher() i=0 2024-09-22T08:36:44.432 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.418+0000 7f06e1b26800 20 add_watcher() i=1 2024-09-22T08:36:44.432 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.418+0000 7f06e1b26800 20 add_watcher() i=2 2024-09-22T08:36:44.432 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.418+0000 7f06e1b26800 20 add_watcher() i=3 2024-09-22T08:36:44.432 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.418+0000 7f06e1b26800 20 add_watcher() i=4 2024-09-22T08:36:44.432 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.418+0000 7f06e1b26800 20 add_watcher() i=5 2024-09-22T08:36:44.432 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.418+0000 7f06e1b26800 20 add_watcher() i=6 2024-09-22T08:36:44.433 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.419+0000 7f06dcfd8640 1 -- 172.21.15.142:0/483507074 <== osd.0 v2:172.21.15.31:6800/168281188 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94259682784592] v30'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06d4051070 con 0x7f06d00541f0 2024-09-22T08:36:44.433 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.419+0000 7f06e1b26800 20 add_watcher() i=7 2024-09-22T08:36:44.433 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.419+0000 7f06e1b26800 2 all 8 watchers are set, enabling cache 2024-09-22T08:36:44.433 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.419+0000 7f06e1b26800 1 -- 172.21.15.142:0/483507074 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ba8ae8ee60 con 0x55ba8ae7a4e0 2024-09-22T08:36:44.433 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.419+0000 7f06dcfd8640 1 -- 172.21.15.142:0/483507074 <== osd.1 v2:172.21.15.142:6816/3192108003 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f06d4051070 con 0x55ba8ae7a4e0 2024-09-22T08:36:44.433 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.419+0000 7f06e1b26800 1 -- 172.21.15.142:0/483507074 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94259682777904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ba8ae8c1f0 con 0x55ba8ae7a4e0 2024-09-22T08:36:44.433 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.420+0000 7f06dcfd8640 1 -- 172.21.15.142:0/483507074 <== osd.1 v2:172.21.15.142:6816/3192108003 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94259682777904] v30'76 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f06d4051070 con 0x55ba8ae7a4e0 2024-09-22T08:36:44.433 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.420+0000 7f0593fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:36:44.433 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.420+0000 7f06e1b26800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:36:44.433 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.420+0000 7f06e1b26800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:36:44.433 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.420+0000 7f06e1b26800 5 note: GC not initialized 2024-09-22T08:36:44.433 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.421+0000 7f0592fe5640 20 reqs_thread_entry: start 2024-09-22T08:36:44.433 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.421+0000 7f06e1b26800 20 init_complete bucket index max shards: 11 2024-09-22T08:36:44.434 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.421+0000 7f06e1b26800 20 Filter name: none 2024-09-22T08:36:44.434 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.421+0000 7f0590fe1640 20 reqs_thread_entry: start 2024-09-22T08:36:44.434 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.421+0000 7f06e1b26800 20 rados->read ofs=0 len=0 2024-09-22T08:36:44.434 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.421+0000 7f06e1b26800 1 -- 172.21.15.142:0/483507074 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ba8aec1db0 con 0x55ba8ae7a4e0 2024-09-22T08:36:44.434 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.421+0000 7f06dcfd8640 1 -- 172.21.15.142:0/483507074 <== osd.1 v2:172.21.15.142:6816/3192108003 21 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv7 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7f06d4051070 con 0x55ba8ae7a4e0 2024-09-22T08:36:44.434 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.421+0000 7f06e1b26800 20 rados_obj.operate() r=0 bl.length=556 2024-09-22T08:36:44.434 INFO:teuthology.orchestra.run.smithi142.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-22T08:36:42.661297Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-22T08:36:42.661288Z","tags":[],"group_ids":[]} 2024-09-22T08:36:44.440 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.422+0000 7f0593fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:36:44.440 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.422+0000 7f06e1b26800 1 -- 172.21.15.142:0/483507074 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94259682777904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ba8aec0740 con 0x55ba8ae7a4e0 2024-09-22T08:36:44.440 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.423+0000 7f06dcfd8640 1 -- 172.21.15.142:0/483507074 <== osd.1 v2:172.21.15.142:6816/3192108003 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94259682777904] v30'77 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f06d4051070 con 0x55ba8ae7a4e0 2024-09-22T08:36:44.440 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.423+0000 7f06e1b26800 1 -- 172.21.15.142:0/483507074 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94259682759328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ba8ae89b30 con 0x7f06d8057040 2024-09-22T08:36:44.440 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.424+0000 7f06dd7d9640 1 -- 172.21.15.142:0/483507074 <== osd.2 v2:172.21.15.142:6808/279438927 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94259682759328] v30'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06d0039070 con 0x7f06d8057040 2024-09-22T08:36:44.441 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.424+0000 7f06e1b26800 20 remove_watcher() i=0 2024-09-22T08:36:44.441 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.424+0000 7f06e1b26800 2 removed watcher, disabling cache 2024-09-22T08:36:44.441 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.424+0000 7f06e1b26800 1 -- 172.21.15.142:0/483507074 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94259682765472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ba8ae852a0 con 0x55ba8ae7a4e0 2024-09-22T08:36:44.441 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.425+0000 7f06dcfd8640 1 -- 172.21.15.142:0/483507074 <== osd.1 v2:172.21.15.142:6816/3192108003 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94259682765472] v30'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06d4051070 con 0x55ba8ae7a4e0 2024-09-22T08:36:44.441 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.425+0000 7f06e1b26800 20 remove_watcher() i=1 2024-09-22T08:36:44.441 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.425+0000 7f06e1b26800 1 -- 172.21.15.142:0/483507074 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94259682769248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ba8ae852a0 con 0x55ba8ae7eec0 2024-09-22T08:36:44.441 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.426+0000 7f06ddfda640 1 -- 172.21.15.142:0/483507074 <== osd.3 v2:172.21.15.142:6800/1064901393 16 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94259682769248] v30'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06d8053020 con 0x55ba8ae7eec0 2024-09-22T08:36:44.441 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.426+0000 7f06e1b26800 20 remove_watcher() i=2 2024-09-22T08:36:44.441 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.426+0000 7f06e1b26800 1 -- 172.21.15.142:0/483507074 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94259682772000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ba8ae87960 con 0x7f06d8057040 2024-09-22T08:36:44.441 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.427+0000 7f06dd7d9640 1 -- 172.21.15.142:0/483507074 <== osd.2 v2:172.21.15.142:6808/279438927 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94259682772000] v30'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06d0039070 con 0x7f06d8057040 2024-09-22T08:36:44.441 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.427+0000 7f06e1b26800 20 remove_watcher() i=3 2024-09-22T08:36:44.441 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.427+0000 7f06e1b26800 1 -- 172.21.15.142:0/483507074 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94259682775568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ba8ae88420 con 0x55ba8ae7a4e0 2024-09-22T08:36:44.441 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.428+0000 7f06dcfd8640 1 -- 172.21.15.142:0/483507074 <== osd.1 v2:172.21.15.142:6816/3192108003 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94259682775568] v30'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06d4051070 con 0x55ba8ae7a4e0 2024-09-22T08:36:44.442 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.428+0000 7f06e1b26800 20 remove_watcher() i=4 2024-09-22T08:36:44.442 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.428+0000 7f06e1b26800 1 -- 172.21.15.142:0/483507074 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94259682780624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ba8ae87960 con 0x7f06d00541f0 2024-09-22T08:36:44.442 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.429+0000 7f06dcfd8640 1 -- 172.21.15.142:0/483507074 <== osd.0 v2:172.21.15.31:6800/168281188 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94259682780624] v30'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06d4051070 con 0x7f06d00541f0 2024-09-22T08:36:44.442 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.429+0000 7f06e1b26800 20 remove_watcher() i=5 2024-09-22T08:36:44.442 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.429+0000 7f06e1b26800 1 -- 172.21.15.142:0/483507074 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94259682763344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ba8ae88420 con 0x7f06d00541f0 2024-09-22T08:36:44.442 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.430+0000 7f06dcfd8640 1 -- 172.21.15.142:0/483507074 <== osd.0 v2:172.21.15.31:6800/168281188 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94259682763344] v30'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06d4051070 con 0x7f06d00541f0 2024-09-22T08:36:44.442 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.430+0000 7f06e1b26800 20 remove_watcher() i=6 2024-09-22T08:36:44.442 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.430+0000 7f06e1b26800 1 -- 172.21.15.142:0/483507074 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94259682784592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ba8ae87960 con 0x7f06d00541f0 2024-09-22T08:36:44.442 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.431+0000 7f06dcfd8640 1 -- 172.21.15.142:0/483507074 <== osd.0 v2:172.21.15.31:6800/168281188 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94259682784592] v30'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06d4051070 con 0x7f06d00541f0 2024-09-22T08:36:44.442 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.431+0000 7f06e1b26800 20 remove_watcher() i=7 2024-09-22T08:36:44.443 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.431+0000 7f06e1b26800 1 -- 172.21.15.142:0/483507074 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f06d00541f0 msgr2=0x7f06d0054630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:44.443 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.431+0000 7f06e1b26800 1 --2- 172.21.15.142:0/483507074 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f06d00541f0 0x7f06d0054630 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:44.443 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.431+0000 7f06e1b26800 1 -- 172.21.15.142:0/483507074 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55ba8ae7a4e0 msgr2=0x55ba8ae7c970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:44.443 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.431+0000 7f06e1b26800 1 --2- 172.21.15.142:0/483507074 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55ba8ae7a4e0 0x55ba8ae7c970 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:44.443 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.432+0000 7f06e1b26800 1 -- 172.21.15.142:0/483507074 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f06d8057040 msgr2=0x7f06d8035a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:44.443 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.432+0000 7f06e1b26800 1 --2- 172.21.15.142:0/483507074 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f06d8057040 0x7f06d8035a80 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:44.443 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.432+0000 7f06e1b26800 1 -- 172.21.15.142:0/483507074 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55ba8ae7eec0 msgr2=0x55ba8ae812b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:44.443 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.432+0000 7f06e1b26800 1 --2- 172.21.15.142:0/483507074 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55ba8ae7eec0 0x55ba8ae812b0 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:44.443 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.432+0000 7f06e1b26800 1 -- 172.21.15.142:0/483507074 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f05a803cfb0 msgr2=0x7f05a803f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:44.444 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.432+0000 7f06e1b26800 1 --2- 172.21.15.142:0/483507074 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f05a803cfb0 0x7f05a803f470 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f06d000efd0 tx=0x7f06d0041000 comp rx=0 tx=0).stop 2024-09-22T08:36:44.444 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.432+0000 7f06e1b26800 1 -- 172.21.15.142:0/483507074 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ba8ae675e0 msgr2=0x55ba8ae6ebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:44.444 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.432+0000 7f06dcfd8640 1 -- 172.21.15.142:0/483507074 reap_dead start 2024-09-22T08:36:44.444 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.432+0000 7f06e1b26800 1 --2- 172.21.15.142:0/483507074 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ba8ae675e0 0x55ba8ae6ebb0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f06d8022ff0 tx=0x7f06d8054780 comp rx=0 tx=0).stop 2024-09-22T08:36:44.444 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.432+0000 7f06e1b26800 1 -- 172.21.15.142:0/483507074 shutdown_connections 2024-09-22T08:36:44.444 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.432+0000 7f06e1b26800 1 --2- 172.21.15.142:0/483507074 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ba8ae675e0 0x55ba8ae6ebb0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:44.444 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.432+0000 7f06e1b26800 1 -- 172.21.15.142:0/483507074 >> 172.21.15.142:0/483507074 conn(0x55ba8ae639e0 msgr2=0x55ba8ae61bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:44.444 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.432+0000 7f06e1b26800 1 -- 172.21.15.142:0/483507074 shutdown_connections 2024-09-22T08:36:44.444 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.432+0000 7f06e1b26800 1 -- 172.21.15.142:0/483507074 wait complete. 2024-09-22T08:36:44.444 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.432+0000 7f06e1b26800 1 -- 172.21.15.142:0/1171137466 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f05b403d000 msgr2=0x7f05b403f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:44.444 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.432+0000 7f06e1b26800 1 --2- 172.21.15.142:0/1171137466 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f05b403d000 0x7f05b403f4c0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f06d00531e0 tx=0x7f06d00011b0 comp rx=0 tx=0).stop 2024-09-22T08:36:44.445 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.432+0000 7f06e1b26800 1 -- 172.21.15.142:0/1171137466 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ba8ae5ab60 msgr2=0x55ba8ae5af80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:44.445 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.432+0000 7f06e1b26800 1 --2- 172.21.15.142:0/1171137466 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ba8ae5ab60 0x55ba8ae5af80 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x55ba8acba0e0 tx=0x7f06d80167b0 comp rx=0 tx=0).stop 2024-09-22T08:36:44.445 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.432+0000 7f06e1b26800 1 -- 172.21.15.142:0/1171137466 shutdown_connections 2024-09-22T08:36:44.445 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.432+0000 7f06e1b26800 1 --2- 172.21.15.142:0/1171137466 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f05b403d000 0x7f05b403f4c0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:44.445 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.432+0000 7f06e1b26800 1 --2- 172.21.15.142:0/1171137466 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ba8ae5ab60 0x55ba8ae5af80 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:44.445 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.432+0000 7f06e1b26800 1 -- 172.21.15.142:0/1171137466 >> 172.21.15.142:0/1171137466 conn(0x55ba8ae4ef10 msgr2=0x55ba8ae4f2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:44.445 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.432+0000 7f06e1b26800 1 -- 172.21.15.142:0/1171137466 shutdown_connections 2024-09-22T08:36:44.445 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.432+0000 7f06e1b26800 1 -- 172.21.15.142:0/1171137466 wait complete. 2024-09-22T08:36:44.445 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.432+0000 7f06e1b26800 1 -- 172.21.15.142:0/3158576660 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55ba8ad46bf0 msgr2=0x55ba8ae46d90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:44.445 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.432+0000 7f06e1b26800 1 --2- 172.21.15.142:0/3158576660 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55ba8ad46bf0 0x55ba8ae46d90 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:44.445 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.433+0000 7f06e1b26800 1 -- 172.21.15.142:0/3158576660 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55ba8ae49730 msgr2=0x55ba8ae4bb20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:44.445 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.433+0000 7f06e1b26800 1 --2- 172.21.15.142:0/3158576660 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55ba8ae49730 0x55ba8ae4bb20 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:44.445 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.433+0000 7f06e1b26800 1 -- 172.21.15.142:0/3158576660 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f05c403d1a0 msgr2=0x7f05c403f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:44.445 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.433+0000 7f06e1b26800 1 --2- 172.21.15.142:0/3158576660 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f05c403d1a0 0x7f05c403f660 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f06d4057000 tx=0x7f06d4052000 comp rx=0 tx=0).stop 2024-09-22T08:36:44.446 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.433+0000 7f06e1b26800 1 -- 172.21.15.142:0/3158576660 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ba8ad457e0 msgr2=0x55ba8acb98c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:44.446 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.433+0000 7f06e1b26800 1 --2- 172.21.15.142:0/3158576660 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ba8ad457e0 0x55ba8acb98c0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f06d00012f0 tx=0x7f06d0000ed0 comp rx=0 tx=0).stop 2024-09-22T08:36:44.446 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.433+0000 7f06e1b26800 1 -- 172.21.15.142:0/3158576660 shutdown_connections 2024-09-22T08:36:44.446 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.433+0000 7f06e1b26800 1 --2- 172.21.15.142:0/3158576660 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55ba8ae49730 0x55ba8ae4bb20 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:44.446 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.433+0000 7f06e1b26800 1 --2- 172.21.15.142:0/3158576660 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55ba8ad46bf0 0x55ba8ae46d90 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:44.446 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.433+0000 7f06e1b26800 1 --2- 172.21.15.142:0/3158576660 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f05c403d1a0 0x7f05c403f660 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:44.446 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.433+0000 7f06e1b26800 1 --2- 172.21.15.142:0/3158576660 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ba8ad457e0 0x55ba8acb98c0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:44.446 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.433+0000 7f06e1b26800 1 -- 172.21.15.142:0/3158576660 >> 172.21.15.142:0/3158576660 conn(0x55ba8ad40bb0 msgr2=0x55ba8ae36260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:44.446 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.433+0000 7f06e1b26800 1 -- 172.21.15.142:0/3158576660 shutdown_connections 2024-09-22T08:36:44.446 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.433+0000 7f06e1b26800 1 -- 172.21.15.142:0/3158576660 wait complete. 2024-09-22T08:36:44.447 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-22T08:36:42.661297Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-22T08:36:42.661288Z', 'tags': [], 'group_ids': []} 2024-09-22T08:36:44.447 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'create', '--subuser', 'foo:foo2', '--secret', 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', '--key-type', 'swift'] 2024-09-22T08:36:44.447 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'create', '--subuser', 'foo:foo2', '--secret', 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', '--key-type', 'swift'] 2024-09-22T08:36:44.448 DEBUG:teuthology.orchestra.run.smithi142:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser create --subuser foo:foo2 --secret ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy --key-type swift 2024-09-22T08:36:44.496 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:36:44.496 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:36:44.497 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.496+0000 7f9493b32800 1 Processor -- start 2024-09-22T08:36:44.497 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.496+0000 7f9493b32800 1 -- start start 2024-09-22T08:36:44.497 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.496+0000 7f9493b32800 1 --2- >> v2:172.21.15.31:3300/0 conn(0x56025d4b8c10 0x56025d4be5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:44.498 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.496+0000 7f9493b32800 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56025d343a20 con 0x56025d4b7800 2024-09-22T08:36:44.498 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.496+0000 7f9493b32800 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x56025d3437d0 con 0x56025d4b8c10 2024-09-22T08:36:44.498 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.496+0000 7f948efbb640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x56025d4b8c10 0x56025d4be5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:44.498 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.496+0000 7f948f7bc640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x56025d4b7800 0x56025d4b8500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.142:42420/0 (socket says 172.21.15.142:42420) 2024-09-22T08:36:44.498 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.496+0000 7f948f7bc640 1 -- 172.21.15.142:0/201861403 learned_addr learned my addr 172.21.15.142:0/201861403 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-09-22T08:36:44.498 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.496+0000 7f948efbb640 1 -- 172.21.15.142:0/201861403 >> v1:172.21.15.31:6789/0 conn(0x56025d4b7800 legacy=0x56025d4b8500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:44.498 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.496+0000 7f948efbb640 1 -- 172.21.15.142:0/201861403 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56025d4b7f00 con 0x56025d4b8c10 2024-09-22T08:36:44.498 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.496+0000 7f948e7ba640 1 -- 172.21.15.142:0/201861403 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3741502240 0 0) 0x56025d343a20 con 0x56025d4b7800 2024-09-22T08:36:44.499 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.498+0000 7f948efbb640 1 --2- 172.21.15.142:0/201861403 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56025d4b8c10 0x56025d4be5a0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f948400a470 tx=0x7f9484045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=197ff479d9177513 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:44.499 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.498+0000 7f948e7ba640 1 -- 172.21.15.142:0/201861403 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9484053570 con 0x56025d4b8c10 2024-09-22T08:36:44.499 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.498+0000 7f948e7ba640 1 -- 172.21.15.142:0/201861403 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9484058070 con 0x56025d4b8c10 2024-09-22T08:36:44.500 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.498+0000 7f948e7ba640 1 -- 172.21.15.142:0/201861403 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9484053880 con 0x56025d4b8c10 2024-09-22T08:36:44.500 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.499+0000 7f9493b32800 1 -- 172.21.15.142:0/201861403 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56025d4b8c10 msgr2=0x56025d4be5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:44.500 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.499+0000 7f9493b32800 1 --2- 172.21.15.142:0/201861403 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56025d4b8c10 0x56025d4be5a0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f948400a470 tx=0x7f9484045a20 comp rx=0 tx=0).stop 2024-09-22T08:36:44.500 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.499+0000 7f9493b32800 1 -- 172.21.15.142:0/201861403 shutdown_connections 2024-09-22T08:36:44.501 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.499+0000 7f9493b32800 1 --2- 172.21.15.142:0/201861403 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56025d4b8c10 0x56025d4be5a0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:44.501 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.499+0000 7f9493b32800 1 -- 172.21.15.142:0/201861403 >> 172.21.15.142:0/201861403 conn(0x56025d4b2bd0 msgr2=0x56025d4b5030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:44.501 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.499+0000 7f9493b32800 1 -- 172.21.15.142:0/201861403 shutdown_connections 2024-09-22T08:36:44.501 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.499+0000 7f9493b32800 1 -- 172.21.15.142:0/201861403 wait complete. 2024-09-22T08:36:44.514 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.513+0000 7f9493b32800 1 Processor -- start 2024-09-22T08:36:44.514 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.513+0000 7f9493b32800 1 -- start start 2024-09-22T08:36:44.514 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.513+0000 7f9493b32800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56025d4b7800 0x56025d42b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:44.514 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.513+0000 7f9493b32800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x56025d350dd0 con 0x56025d4b7800 2024-09-22T08:36:44.515 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.513+0000 7f948f7bc640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56025d4b7800 0x56025d42b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:44.515 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.513+0000 7f948f7bc640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56025d4b7800 0x56025d42b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:38634/0 (socket says 172.21.15.142:38634) 2024-09-22T08:36:44.515 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.513+0000 7f948f7bc640 1 -- 172.21.15.142:0/986247946 learned_addr learned my addr 172.21.15.142:0/986247946 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:44.515 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.513+0000 7f948f7bc640 1 -- 172.21.15.142:0/986247946 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56025d5aaae0 con 0x56025d4b7800 2024-09-22T08:36:44.515 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.514+0000 7f948f7bc640 1 --2- 172.21.15.142:0/986247946 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56025d4b7800 0x56025d42b9d0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f9480001ea0 tx=0x7f948000b6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57d7416e8ab5d624 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:44.515 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.514+0000 7f937d60a640 1 -- 172.21.15.142:0/986247946 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9480008070 con 0x56025d4b7800 2024-09-22T08:36:44.516 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.514+0000 7f937d60a640 1 -- 172.21.15.142:0/986247946 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f948000d500 con 0x56025d4b7800 2024-09-22T08:36:44.516 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.514+0000 7f937d60a640 1 -- 172.21.15.142:0/986247946 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f948000d880 con 0x56025d4b7800 2024-09-22T08:36:44.517 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.515+0000 7f9493b32800 1 -- 172.21.15.142:0/986247946 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56025d4b7800 msgr2=0x56025d42b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:44.518 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.515+0000 7f9493b32800 1 --2- 172.21.15.142:0/986247946 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56025d4b7800 0x56025d42b9d0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f9480001ea0 tx=0x7f948000b6a0 comp rx=0 tx=0).stop 2024-09-22T08:36:44.518 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.515+0000 7f9493b32800 1 -- 172.21.15.142:0/986247946 shutdown_connections 2024-09-22T08:36:44.518 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.515+0000 7f9493b32800 1 --2- 172.21.15.142:0/986247946 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56025d4b7800 0x56025d42b9d0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:44.518 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.515+0000 7f9493b32800 1 -- 172.21.15.142:0/986247946 >> 172.21.15.142:0/986247946 conn(0x56025d4b2bd0 msgr2=0x56025d5a27a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:44.518 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.515+0000 7f9493b32800 1 -- 172.21.15.142:0/986247946 shutdown_connections 2024-09-22T08:36:44.518 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.515+0000 7f9493b32800 1 -- 172.21.15.142:0/986247946 wait complete. 2024-09-22T08:36:44.518 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.515+0000 7f9493b32800 1 Processor -- start 2024-09-22T08:36:44.518 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.515+0000 7f9493b32800 1 -- start start 2024-09-22T08:36:44.518 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.515+0000 7f9493b32800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56025d4b7800 0x56025d5afa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:44.518 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.515+0000 7f9493b32800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x56025d4beae0 con 0x56025d4b7800 2024-09-22T08:36:44.518 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.515+0000 7f948f7bc640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56025d4b7800 0x56025d5afa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:44.518 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.515+0000 7f948f7bc640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56025d4b7800 0x56025d5afa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:38642/0 (socket says 172.21.15.142:38642) 2024-09-22T08:36:44.519 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.515+0000 7f948f7bc640 1 -- 172.21.15.142:0/1052930757 learned_addr learned my addr 172.21.15.142:0/1052930757 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:44.519 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.516+0000 7f948f7bc640 1 -- 172.21.15.142:0/1052930757 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56025d5aff90 con 0x56025d4b7800 2024-09-22T08:36:44.519 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.516+0000 7f948f7bc640 1 --2- 172.21.15.142:0/1052930757 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56025d4b7800 0x56025d5afa30 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f94800012f0 tx=0x7f9480000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:44.519 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.516+0000 7f937be07640 1 -- 172.21.15.142:0/1052930757 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f948000f9d0 con 0x56025d4b7800 2024-09-22T08:36:44.519 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.516+0000 7f937be07640 1 -- 172.21.15.142:0/1052930757 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f948000fb70 con 0x56025d4b7800 2024-09-22T08:36:44.519 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.516+0000 7f9493b32800 1 -- 172.21.15.142:0/1052930757 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56025d5b0220 con 0x56025d4b7800 2024-09-22T08:36:44.519 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.516+0000 7f937be07640 1 -- 172.21.15.142:0/1052930757 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f948000fe50 con 0x56025d4b7800 2024-09-22T08:36:44.519 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.516+0000 7f9493b32800 1 -- 172.21.15.142:0/1052930757 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56025d5b0c20 con 0x56025d4b7800 2024-09-22T08:36:44.522 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.517+0000 7f937be07640 1 -- 172.21.15.142:0/1052930757 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f9480017040 con 0x56025d4b7800 2024-09-22T08:36:44.522 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.517+0000 7f937be07640 1 --2- 172.21.15.142:0/1052930757 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f937403d1a0 0x7f937403f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:44.523 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.517+0000 7f937be07640 1 -- 172.21.15.142:0/1052930757 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f9480015020 con 0x56025d4b7800 2024-09-22T08:36:44.523 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.517+0000 7f948efbb640 1 --2- 172.21.15.142:0/1052930757 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f937403d1a0 0x7f937403f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:44.523 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.517+0000 7f9493b32800 1 --2- 172.21.15.142:0/1052930757 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x56025d4b8c10 0x56025d5b7080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:44.523 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.517+0000 7f9493b32800 1 -- 172.21.15.142:0/1052930757 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56025d5b75c0 con 0x56025d4b8c10 2024-09-22T08:36:44.523 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.518+0000 7f948ffbd640 1 --2- 172.21.15.142:0/1052930757 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x56025d4b8c10 0x56025d5b7080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:44.523 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.518+0000 7f948efbb640 1 --2- 172.21.15.142:0/1052930757 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f937403d1a0 0x7f937403f660 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f9484057000 tx=0x7f9484052000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:44.523 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.518+0000 7f948ffbd640 1 --2- 172.21.15.142:0/1052930757 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x56025d4b8c10 0x56025d5b7080 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:44.523 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.518+0000 7f948ffbd640 1 -- 172.21.15.142:0/1052930757 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f948800a4d0 con 0x56025d4b8c10 2024-09-22T08:36:44.523 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.518+0000 7f9493b32800 1 -- 172.21.15.142:0/1052930757 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56025d5b7960 con 0x56025d4b8c10 2024-09-22T08:36:44.523 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.518+0000 7f948ffbd640 1 -- 172.21.15.142:0/1052930757 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f948800a4d0 con 0x56025d4b8c10 2024-09-22T08:36:44.523 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.518+0000 7f9493b32800 1 --2- 172.21.15.142:0/1052930757 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x56025d5b9460 0x56025d5bb8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:44.523 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.518+0000 7f9493b32800 1 -- 172.21.15.142:0/1052930757 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:3 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56025d5bc070 con 0x56025d5b9460 2024-09-22T08:36:44.523 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.519+0000 7f948f7bc640 1 --2- 172.21.15.142:0/1052930757 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x56025d5b9460 0x56025d5bb8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:44.524 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.519+0000 7f948f7bc640 1 --2- 172.21.15.142:0/1052930757 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x56025d5b9460 0x56025d5bb8e0 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:44.524 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.519+0000 7f948f7bc640 1 -- 172.21.15.142:0/1052930757 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(3 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f948002d070 con 0x56025d5b9460 2024-09-22T08:36:44.524 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.519+0000 7f9493b32800 1 -- 172.21.15.142:0/1052930757 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56025d5b81b0 con 0x56025d4b8c10 2024-09-22T08:36:44.524 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.519+0000 7f948ffbd640 1 -- 172.21.15.142:0/1052930757 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f948800a4d0 con 0x56025d4b8c10 2024-09-22T08:36:44.524 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.519+0000 7f9493b32800 1 -- 172.21.15.142:0/1052930757 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56025d5b8600 con 0x56025d5b9460 2024-09-22T08:36:44.524 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.520+0000 7f948f7bc640 1 -- 172.21.15.142:0/1052930757 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(5 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f948002d070 con 0x56025d5b9460 2024-09-22T08:36:44.524 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.520+0000 7f9493b32800 1 Processor -- start 2024-09-22T08:36:44.524 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.520+0000 7f9493b32800 1 -- start start 2024-09-22T08:36:44.524 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.520+0000 7f9493b32800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56025d5a8270 0x56025d5a6ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:44.524 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.520+0000 7f9493b32800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x56025d3afd50 con 0x56025d5a8270 2024-09-22T08:36:44.524 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.520+0000 7f948ffbd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56025d5a8270 0x56025d5a6ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:44.524 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.520+0000 7f948ffbd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56025d5a8270 0x56025d5a6ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:38644/0 (socket says 172.21.15.142:38644) 2024-09-22T08:36:44.524 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.521+0000 7f948ffbd640 1 -- 172.21.15.142:0/2717687137 learned_addr learned my addr 172.21.15.142:0/2717687137 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:44.524 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.521+0000 7f948ffbd640 1 -- 172.21.15.142:0/2717687137 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56025d5a8790 con 0x56025d5a8270 2024-09-22T08:36:44.525 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.521+0000 7f948ffbd640 1 --2- 172.21.15.142:0/2717687137 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56025d5a8270 0x56025d5a6ae0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x56025d5b0a30 tx=0x7f94880167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:44.525 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.521+0000 7f9379602640 1 -- 172.21.15.142:0/2717687137 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9488013640 con 0x56025d5a8270 2024-09-22T08:36:44.525 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.521+0000 7f9379602640 1 -- 172.21.15.142:0/2717687137 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94880137e0 con 0x56025d5a8270 2024-09-22T08:36:44.525 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.521+0000 7f9493b32800 1 -- 172.21.15.142:0/2717687137 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56025d5a7020 con 0x56025d5a8270 2024-09-22T08:36:44.525 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.521+0000 7f9379602640 1 -- 172.21.15.142:0/2717687137 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9488013ae0 con 0x56025d5a8270 2024-09-22T08:36:44.525 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.521+0000 7f9493b32800 1 -- 172.21.15.142:0/2717687137 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56025d5a7570 con 0x56025d5a8270 2024-09-22T08:36:44.537 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.522+0000 7f9379602640 1 -- 172.21.15.142:0/2717687137 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f9488011040 con 0x56025d5a8270 2024-09-22T08:36:44.537 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.522+0000 7f9379602640 1 --2- 172.21.15.142:0/2717687137 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f936803d070 0x7f936803f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:44.537 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.522+0000 7f9379602640 1 -- 172.21.15.142:0/2717687137 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f948800e040 con 0x56025d5a8270 2024-09-22T08:36:44.537 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.522+0000 7f948f7bc640 1 --2- 172.21.15.142:0/2717687137 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f936803d070 0x7f936803f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:44.537 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.523+0000 7f9493b32800 1 Processor -- start 2024-09-22T08:36:44.537 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.523+0000 7f948f7bc640 1 --2- 172.21.15.142:0/2717687137 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f936803d070 0x7f936803f530 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f94800531e0 tx=0x7f94800011b0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:44.537 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.523+0000 7f9493b32800 1 -- start start 2024-09-22T08:36:44.538 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.523+0000 7f9493b32800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56025d5d9680 0x56025d5d9a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:44.538 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.523+0000 7f9493b32800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x56025d5aadc0 con 0x56025d5d9680 2024-09-22T08:36:44.538 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.523+0000 7f948ffbd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56025d5d9680 0x56025d5d9a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:44.538 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.523+0000 7f948ffbd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56025d5d9680 0x56025d5d9a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:38648/0 (socket says 172.21.15.142:38648) 2024-09-22T08:36:44.538 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.523+0000 7f948ffbd640 1 -- 172.21.15.142:0/3101186666 learned_addr learned my addr 172.21.15.142:0/3101186666 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:44.538 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.523+0000 7f948ffbd640 1 -- 172.21.15.142:0/3101186666 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56025d5da070 con 0x56025d5d9680 2024-09-22T08:36:44.538 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.523+0000 7f948ffbd640 1 --2- 172.21.15.142:0/3101186666 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56025d5d9680 0x56025d5d9a80 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f94880547f0 tx=0x7f94880206e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b87c37fc64912eea server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:44.538 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.524+0000 7f9372ffd640 1 -- 172.21.15.142:0/3101186666 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9488044030 con 0x56025d5d9680 2024-09-22T08:36:44.538 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.524+0000 7f9372ffd640 1 -- 172.21.15.142:0/3101186666 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9488021960 con 0x56025d5d9680 2024-09-22T08:36:44.538 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.524+0000 7f9372ffd640 1 -- 172.21.15.142:0/3101186666 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f948801f340 con 0x56025d5d9680 2024-09-22T08:36:44.538 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.524+0000 7f9493b32800 1 -- 172.21.15.142:0/3101186666 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56025d5d9680 msgr2=0x56025d5d9a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:44.538 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.524+0000 7f9493b32800 1 --2- 172.21.15.142:0/3101186666 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56025d5d9680 0x56025d5d9a80 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f94880547f0 tx=0x7f94880206e0 comp rx=0 tx=0).stop 2024-09-22T08:36:44.538 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.524+0000 7f9493b32800 1 -- 172.21.15.142:0/3101186666 shutdown_connections 2024-09-22T08:36:44.539 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.524+0000 7f9493b32800 1 --2- 172.21.15.142:0/3101186666 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56025d5d9680 0x56025d5d9a80 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:44.539 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.524+0000 7f9493b32800 1 -- 172.21.15.142:0/3101186666 >> 172.21.15.142:0/3101186666 conn(0x56025d5d5a80 msgr2=0x56025d5d3cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:44.539 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.524+0000 7f9493b32800 1 -- 172.21.15.142:0/3101186666 shutdown_connections 2024-09-22T08:36:44.539 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.524+0000 7f9493b32800 1 -- 172.21.15.142:0/3101186666 wait complete. 2024-09-22T08:36:44.539 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.524+0000 7f9493b32800 1 Processor -- start 2024-09-22T08:36:44.539 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.524+0000 7f9493b32800 1 -- start start 2024-09-22T08:36:44.539 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.524+0000 7f9493b32800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56025d5d9680 0x56025d5e0c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:44.539 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.525+0000 7f9493b32800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x56025d5da690 con 0x56025d5d9680 2024-09-22T08:36:44.539 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.525+0000 7f948ffbd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56025d5d9680 0x56025d5e0c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:44.539 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.525+0000 7f948ffbd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56025d5d9680 0x56025d5e0c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:38654/0 (socket says 172.21.15.142:38654) 2024-09-22T08:36:44.539 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.525+0000 7f948ffbd640 1 -- 172.21.15.142:0/1316851120 learned_addr learned my addr 172.21.15.142:0/1316851120 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:44.540 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.525+0000 7f948ffbd640 1 -- 172.21.15.142:0/1316851120 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56025d5e11d0 con 0x56025d5d9680 2024-09-22T08:36:44.540 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.525+0000 7f948ffbd640 1 --2- 172.21.15.142:0/1316851120 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56025d5d9680 0x56025d5e0c70 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f9488022ff0 tx=0x7f9488054780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:44.540 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.525+0000 7f93717fa640 1 -- 172.21.15.142:0/1316851120 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f94880459c0 con 0x56025d5d9680 2024-09-22T08:36:44.540 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.525+0000 7f93717fa640 1 -- 172.21.15.142:0/1316851120 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9488045b80 con 0x56025d5d9680 2024-09-22T08:36:44.540 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.525+0000 7f9493b32800 1 -- 172.21.15.142:0/1316851120 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56025d5e1460 con 0x56025d5d9680 2024-09-22T08:36:44.540 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.525+0000 7f93717fa640 1 -- 172.21.15.142:0/1316851120 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9488045130 con 0x56025d5d9680 2024-09-22T08:36:44.540 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.525+0000 7f9493b32800 1 -- 172.21.15.142:0/1316851120 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56025d5e1ff0 con 0x56025d5d9680 2024-09-22T08:36:44.540 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.526+0000 7f93717fa640 1 -- 172.21.15.142:0/1316851120 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f94880452d0 con 0x56025d5d9680 2024-09-22T08:36:44.540 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.526+0000 7f93717fa640 1 --2- 172.21.15.142:0/1316851120 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f935803d000 0x7f935803f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:44.540 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.526+0000 7f93717fa640 1 -- 172.21.15.142:0/1316851120 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f9488017450 con 0x56025d5d9680 2024-09-22T08:36:44.540 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.526+0000 7f948f7bc640 1 --2- 172.21.15.142:0/1316851120 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f935803d000 0x7f935803f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:44.540 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.527+0000 7f948f7bc640 1 --2- 172.21.15.142:0/1316851120 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f935803d000 0x7f935803f4c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f948000efd0 tx=0x7f9480041000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:44.541 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.527+0000 7f9493b32800 20 rados->read ofs=0 len=0 2024-09-22T08:36:44.541 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.527+0000 7f9493b32800 1 --2- 172.21.15.142:0/1316851120 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x56025d5ec560 0x56025d5eea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:44.541 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.527+0000 7f9493b32800 1 -- 172.21.15.142:0/1316851120 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56025d5ef170 con 0x56025d5ec560 2024-09-22T08:36:44.541 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.527+0000 7f948efbb640 1 --2- 172.21.15.142:0/1316851120 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x56025d5ec560 0x56025d5eea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:44.541 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.527+0000 7f948efbb640 1 --2- 172.21.15.142:0/1316851120 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x56025d5ec560 0x56025d5eea20 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:44.541 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.527+0000 7f948efbb640 1 -- 172.21.15.142:0/1316851120 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9484051070 con 0x56025d5ec560 2024-09-22T08:36:44.541 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.527+0000 7f9493b32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:44.541 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.527+0000 7f9493b32800 20 realm 2024-09-22T08:36:44.541 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.527+0000 7f9493b32800 20 rados->read ofs=0 len=0 2024-09-22T08:36:44.541 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.527+0000 7f9493b32800 1 -- 172.21.15.142:0/1316851120 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56025d5ef5a0 con 0x56025d5ec560 2024-09-22T08:36:44.541 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.528+0000 7f948efbb640 1 -- 172.21.15.142:0/1316851120 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9484051070 con 0x56025d5ec560 2024-09-22T08:36:44.541 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.528+0000 7f9493b32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:44.541 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.528+0000 7f9493b32800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:36:44.542 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.528+0000 7f9493b32800 20 rados->read ofs=0 len=0 2024-09-22T08:36:44.542 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.528+0000 7f9493b32800 1 -- 172.21.15.142:0/1316851120 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56025d5efe70 con 0x56025d5ec560 2024-09-22T08:36:44.542 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.528+0000 7f948efbb640 1 -- 172.21.15.142:0/1316851120 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9484051070 con 0x56025d5ec560 2024-09-22T08:36:44.542 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.528+0000 7f9493b32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:44.542 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.528+0000 7f9493b32800 20 rados->read ofs=0 len=0 2024-09-22T08:36:44.542 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.528+0000 7f9493b32800 1 -- 172.21.15.142:0/1316851120 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56025d5f0210 con 0x56025d5ec560 2024-09-22T08:36:44.542 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.528+0000 7f948efbb640 1 -- 172.21.15.142:0/1316851120 <== osd.1 v2:172.21.15.142:6816/3192108003 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9484051070 con 0x56025d5ec560 2024-09-22T08:36:44.542 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.528+0000 7f9493b32800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:36:44.542 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.528+0000 7f9493b32800 20 rados->read ofs=0 len=0 2024-09-22T08:36:44.542 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.528+0000 7f9493b32800 1 --2- 172.21.15.142:0/1316851120 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x56025d5f0f70 0x56025d5f3360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:44.542 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.528+0000 7f9493b32800 1 -- 172.21.15.142:0/1316851120 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56025d5f3970 con 0x56025d5f0f70 2024-09-22T08:36:44.543 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.528+0000 7f948ffbd640 1 --2- 172.21.15.142:0/1316851120 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x56025d5f0f70 0x56025d5f3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:44.543 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.529+0000 7f948ffbd640 1 --2- 172.21.15.142:0/1316851120 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x56025d5f0f70 0x56025d5f3360 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:44.543 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.529+0000 7f948ffbd640 1 -- 172.21.15.142:0/1316851120 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(5 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f9488053020 con 0x56025d5f0f70 2024-09-22T08:36:44.543 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.529+0000 7f9493b32800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:36:44.543 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.529+0000 7f9493b32800 20 searching for the correct realm 2024-09-22T08:36:44.543 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.529+0000 7f9493b32800 1 -- 172.21.15.142:0/1316851120 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56025d5f52a0 con 0x56025d5f0f70 2024-09-22T08:36:44.543 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.529+0000 7f948ffbd640 1 -- 172.21.15.142:0/1316851120 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9488053020 con 0x56025d5f0f70 2024-09-22T08:36:44.543 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.529+0000 7f948ffbd640 1 --2- 172.21.15.142:0/1316851120 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f9488012a50 0x7f948803d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:44.543 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.529+0000 7f948ffbd640 1 -- 172.21.15.142:0/1316851120 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56025d5f52a0 con 0x7f9488012a50 2024-09-22T08:36:44.543 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.529+0000 7f948f7bc640 1 --2- 172.21.15.142:0/1316851120 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f9488012a50 0x7f948803d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:44.543 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.529+0000 7f948f7bc640 1 --2- 172.21.15.142:0/1316851120 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f9488012a50 0x7f948803d7f0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:44.543 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.530+0000 7f948f7bc640 1 -- 172.21.15.142:0/1316851120 <== osd.2 v2:172.21.15.142:6808/279438927 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9480039070 con 0x7f9488012a50 2024-09-22T08:36:44.543 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.530+0000 7f948f7bc640 1 --2- 172.21.15.142:0/1316851120 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f94800541f0 0x7f9480054630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:44.544 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.530+0000 7f948f7bc640 1 -- 172.21.15.142:0/1316851120 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56025d5f52a0 con 0x7f94800541f0 2024-09-22T08:36:44.544 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.530+0000 7f948efbb640 1 --2- 172.21.15.142:0/1316851120 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f94800541f0 0x7f9480054630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:44.544 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.530+0000 7f948efbb640 1 --2- 172.21.15.142:0/1316851120 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f94800541f0 0x7f9480054630 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:44.544 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.531+0000 7f948efbb640 1 -- 172.21.15.142:0/1316851120 <== osd.0 v2:172.21.15.31:6800/168281188 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9484051070 con 0x7f94800541f0 2024-09-22T08:36:44.544 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.531+0000 7f948efbb640 1 -- 172.21.15.142:0/1316851120 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56025d5f52a0 con 0x56025d5ec560 2024-09-22T08:36:44.544 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.531+0000 7f948efbb640 1 -- 172.21.15.142:0/1316851120 <== osd.1 v2:172.21.15.142:6816/3192108003 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9484051070 con 0x56025d5ec560 2024-09-22T08:36:44.544 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.531+0000 7f948efbb640 1 -- 172.21.15.142:0/1316851120 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56025d5f52a0 con 0x56025d5ec560 2024-09-22T08:36:44.544 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.531+0000 7f948efbb640 1 -- 172.21.15.142:0/1316851120 <== osd.1 v2:172.21.15.142:6816/3192108003 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9484051070 con 0x56025d5ec560 2024-09-22T08:36:44.544 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.531+0000 7f948efbb640 1 -- 172.21.15.142:0/1316851120 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56025d5f52a0 con 0x7f94800541f0 2024-09-22T08:36:44.544 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.531+0000 7f948efbb640 1 -- 172.21.15.142:0/1316851120 <== osd.0 v2:172.21.15.31:6800/168281188 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9484051070 con 0x7f94800541f0 2024-09-22T08:36:44.544 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.531+0000 7f948efbb640 1 -- 172.21.15.142:0/1316851120 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56025d5f52a0 con 0x7f94800541f0 2024-09-22T08:36:44.544 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.532+0000 7f948efbb640 1 -- 172.21.15.142:0/1316851120 <== osd.0 v2:172.21.15.31:6800/168281188 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9484051070 con 0x7f94800541f0 2024-09-22T08:36:44.544 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.532+0000 7f948efbb640 1 -- 172.21.15.142:0/1316851120 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56025d5f52a0 con 0x7f9488012a50 2024-09-22T08:36:44.545 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.532+0000 7f948f7bc640 1 -- 172.21.15.142:0/1316851120 <== osd.2 v2:172.21.15.142:6808/279438927 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9480039070 con 0x7f9488012a50 2024-09-22T08:36:44.545 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.532+0000 7f948f7bc640 1 -- 172.21.15.142:0/1316851120 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56025d5f52a0 con 0x56025d5f0f70 2024-09-22T08:36:44.545 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.532+0000 7f948ffbd640 1 -- 172.21.15.142:0/1316851120 <== osd.3 v2:172.21.15.142:6800/1064901393 3 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9488053020 con 0x56025d5f0f70 2024-09-22T08:36:44.545 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.532+0000 7f948ffbd640 1 -- 172.21.15.142:0/1316851120 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56025d5f52a0 con 0x56025d5ec560 2024-09-22T08:36:44.545 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.532+0000 7f948efbb640 1 -- 172.21.15.142:0/1316851120 <== osd.1 v2:172.21.15.142:6816/3192108003 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9484051070 con 0x56025d5ec560 2024-09-22T08:36:44.545 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.532+0000 7f948efbb640 1 -- 172.21.15.142:0/1316851120 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56025d5f52a0 con 0x7f94800541f0 2024-09-22T08:36:44.545 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.533+0000 7f948efbb640 1 -- 172.21.15.142:0/1316851120 <== osd.0 v2:172.21.15.31:6800/168281188 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9484051070 con 0x7f94800541f0 2024-09-22T08:36:44.545 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.533+0000 7f948efbb640 1 -- 172.21.15.142:0/1316851120 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56025d5f52a0 con 0x56025d5ec560 2024-09-22T08:36:44.545 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.533+0000 7f948efbb640 1 -- 172.21.15.142:0/1316851120 <== osd.1 v2:172.21.15.142:6816/3192108003 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9484051070 con 0x56025d5ec560 2024-09-22T08:36:44.545 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.533+0000 7f948efbb640 1 -- 172.21.15.142:0/1316851120 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56025d5f52a0 con 0x7f9488012a50 2024-09-22T08:36:44.545 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.533+0000 7f948f7bc640 1 -- 172.21.15.142:0/1316851120 <== osd.2 v2:172.21.15.142:6808/279438927 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f9480039070 con 0x7f9488012a50 2024-09-22T08:36:44.546 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.533+0000 7f948f7bc640 1 -- 172.21.15.142:0/1316851120 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56025d5f52a0 con 0x56025d5f0f70 2024-09-22T08:36:44.546 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.533+0000 7f948ffbd640 1 -- 172.21.15.142:0/1316851120 <== osd.3 v2:172.21.15.142:6800/1064901393 4 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9488053020 con 0x56025d5f0f70 2024-09-22T08:36:44.546 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.533+0000 7f948ffbd640 1 -- 172.21.15.142:0/1316851120 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56025d5f52a0 con 0x56025d5f0f70 2024-09-22T08:36:44.546 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.533+0000 7f948ffbd640 1 -- 172.21.15.142:0/1316851120 <== osd.3 v2:172.21.15.142:6800/1064901393 5 ==== osd_op_reply(20 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f9488053020 con 0x56025d5f0f70 2024-09-22T08:36:44.546 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.534+0000 7f948ffbd640 1 -- 172.21.15.142:0/1316851120 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56025d5f52a0 con 0x7f94800541f0 2024-09-22T08:36:44.546 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.534+0000 7f948efbb640 1 -- 172.21.15.142:0/1316851120 <== osd.0 v2:172.21.15.31:6800/168281188 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9484051070 con 0x7f94800541f0 2024-09-22T08:36:44.546 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.534+0000 7f948efbb640 1 -- 172.21.15.142:0/1316851120 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56025d5f52a0 con 0x56025d5f0f70 2024-09-22T08:36:44.546 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.534+0000 7f948ffbd640 1 -- 172.21.15.142:0/1316851120 <== osd.3 v2:172.21.15.142:6800/1064901393 6 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9488053020 con 0x56025d5f0f70 2024-09-22T08:36:44.546 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.534+0000 7f948ffbd640 1 -- 172.21.15.142:0/1316851120 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56025d5f52a0 con 0x56025d5f0f70 2024-09-22T08:36:44.546 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.534+0000 7f948ffbd640 1 -- 172.21.15.142:0/1316851120 <== osd.3 v2:172.21.15.142:6800/1064901393 7 ==== osd_op_reply(23 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f9488053020 con 0x56025d5f0f70 2024-09-22T08:36:44.546 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.534+0000 7f948ffbd640 1 -- 172.21.15.142:0/1316851120 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56025d5f52a0 con 0x56025d5ec560 2024-09-22T08:36:44.547 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.534+0000 7f948efbb640 1 -- 172.21.15.142:0/1316851120 <== osd.1 v2:172.21.15.142:6816/3192108003 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9484051070 con 0x56025d5ec560 2024-09-22T08:36:44.547 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.534+0000 7f948efbb640 1 -- 172.21.15.142:0/1316851120 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56025d5f52a0 con 0x56025d5ec560 2024-09-22T08:36:44.547 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.535+0000 7f948efbb640 1 -- 172.21.15.142:0/1316851120 <== osd.1 v2:172.21.15.142:6816/3192108003 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f9484051070 con 0x56025d5ec560 2024-09-22T08:36:44.547 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.535+0000 7f948efbb640 1 -- 172.21.15.142:0/1316851120 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56025d5f52a0 con 0x7f94800541f0 2024-09-22T08:36:44.547 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.535+0000 7f948efbb640 1 -- 172.21.15.142:0/1316851120 <== osd.0 v2:172.21.15.31:6800/168281188 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9484051070 con 0x7f94800541f0 2024-09-22T08:36:44.547 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.535+0000 7f948efbb640 1 -- 172.21.15.142:0/1316851120 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56025d5f52a0 con 0x56025d5f0f70 2024-09-22T08:36:44.547 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.535+0000 7f948ffbd640 1 -- 172.21.15.142:0/1316851120 <== osd.3 v2:172.21.15.142:6800/1064901393 8 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9488053020 con 0x56025d5f0f70 2024-09-22T08:36:44.547 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.535+0000 7f948ffbd640 1 -- 172.21.15.142:0/1316851120 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56025d5f52a0 con 0x7f9488012a50 2024-09-22T08:36:44.547 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.535+0000 7f948f7bc640 1 -- 172.21.15.142:0/1316851120 <== osd.2 v2:172.21.15.142:6808/279438927 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9480039070 con 0x7f9488012a50 2024-09-22T08:36:44.547 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.535+0000 7f948f7bc640 1 -- 172.21.15.142:0/1316851120 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56025d5f52a0 con 0x56025d5ec560 2024-09-22T08:36:44.547 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.536+0000 7f948efbb640 1 -- 172.21.15.142:0/1316851120 <== osd.1 v2:172.21.15.142:6816/3192108003 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9484051070 con 0x56025d5ec560 2024-09-22T08:36:44.547 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.536+0000 7f948efbb640 1 -- 172.21.15.142:0/1316851120 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56025d5f52a0 con 0x7f94800541f0 2024-09-22T08:36:44.547 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.536+0000 7f948efbb640 1 -- 172.21.15.142:0/1316851120 <== osd.0 v2:172.21.15.31:6800/168281188 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9484051070 con 0x7f94800541f0 2024-09-22T08:36:44.548 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.536+0000 7f948efbb640 1 -- 172.21.15.142:0/1316851120 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56025d5f52a0 con 0x56025d5f0f70 2024-09-22T08:36:44.548 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.536+0000 7f948ffbd640 1 -- 172.21.15.142:0/1316851120 <== osd.3 v2:172.21.15.142:6800/1064901393 9 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9488053020 con 0x56025d5f0f70 2024-09-22T08:36:44.548 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.536+0000 7f948ffbd640 1 -- 172.21.15.142:0/1316851120 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56025d5f52a0 con 0x7f94800541f0 2024-09-22T08:36:44.558 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.536+0000 7f948efbb640 1 -- 172.21.15.142:0/1316851120 <== osd.0 v2:172.21.15.31:6800/168281188 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9484051070 con 0x7f94800541f0 2024-09-22T08:36:44.558 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.536+0000 7f948efbb640 1 -- 172.21.15.142:0/1316851120 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56025d5f52a0 con 0x7f9488012a50 2024-09-22T08:36:44.558 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.537+0000 7f948f7bc640 1 -- 172.21.15.142:0/1316851120 <== osd.2 v2:172.21.15.142:6808/279438927 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9480039070 con 0x7f9488012a50 2024-09-22T08:36:44.558 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.537+0000 7f948f7bc640 1 -- 172.21.15.142:0/1316851120 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56025d5f52a0 con 0x56025d5f0f70 2024-09-22T08:36:44.559 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.537+0000 7f948ffbd640 1 -- 172.21.15.142:0/1316851120 <== osd.3 v2:172.21.15.142:6800/1064901393 10 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9488053020 con 0x56025d5f0f70 2024-09-22T08:36:44.559 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.537+0000 7f948ffbd640 1 -- 172.21.15.142:0/1316851120 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56025d5f52a0 con 0x7f94800541f0 2024-09-22T08:36:44.559 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.537+0000 7f948efbb640 1 -- 172.21.15.142:0/1316851120 <== osd.0 v2:172.21.15.31:6800/168281188 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9484051070 con 0x7f94800541f0 2024-09-22T08:36:44.559 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.537+0000 7f948efbb640 1 -- 172.21.15.142:0/1316851120 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56025d5f52a0 con 0x56025d5ec560 2024-09-22T08:36:44.559 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.537+0000 7f948efbb640 1 -- 172.21.15.142:0/1316851120 <== osd.1 v2:172.21.15.142:6816/3192108003 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f9484051070 con 0x56025d5ec560 2024-09-22T08:36:44.559 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.537+0000 7f948efbb640 1 -- 172.21.15.142:0/1316851120 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56025d5f52a0 con 0x7f9488012a50 2024-09-22T08:36:44.559 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.538+0000 7f948f7bc640 1 -- 172.21.15.142:0/1316851120 <== osd.2 v2:172.21.15.142:6808/279438927 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9480039070 con 0x7f9488012a50 2024-09-22T08:36:44.559 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.538+0000 7f9493b32800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:36:44.559 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.538+0000 7f9493b32800 20 RGWRados::pool_iterate: got zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec 2024-09-22T08:36:44.559 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.538+0000 7f9493b32800 20 RGWRados::pool_iterate: got zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f 2024-09-22T08:36:44.559 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.538+0000 7f9493b32800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:36:44.559 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.538+0000 7f9493b32800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:36:44.559 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.538+0000 7f9493b32800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:36:44.559 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.538+0000 7f9493b32800 20 rados->read ofs=0 len=0 2024-09-22T08:36:44.560 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.538+0000 7f9493b32800 1 -- 172.21.15.142:0/1316851120 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56025d5f4330 con 0x56025d5ec560 2024-09-22T08:36:44.560 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.538+0000 7f948efbb640 1 -- 172.21.15.142:0/1316851120 <== osd.1 v2:172.21.15.142:6816/3192108003 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9484051070 con 0x56025d5ec560 2024-09-22T08:36:44.560 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.538+0000 7f9493b32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:44.560 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.538+0000 7f9493b32800 20 rados->read ofs=0 len=0 2024-09-22T08:36:44.560 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.538+0000 7f9493b32800 1 -- 172.21.15.142:0/1316851120 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56025d5f4b80 con 0x56025d5ec560 2024-09-22T08:36:44.560 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.538+0000 7f948efbb640 1 -- 172.21.15.142:0/1316851120 <== osd.1 v2:172.21.15.142:6816/3192108003 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9484051070 con 0x56025d5ec560 2024-09-22T08:36:44.560 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.538+0000 7f9493b32800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:36:44.560 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.538+0000 7f9493b32800 20 rados->read ofs=0 len=0 2024-09-22T08:36:44.560 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.538+0000 7f9493b32800 1 -- 172.21.15.142:0/1316851120 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:40 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56025d5f5720 con 0x56025d5f0f70 2024-09-22T08:36:44.560 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.538+0000 7f948ffbd640 1 -- 172.21.15.142:0/1316851120 <== osd.3 v2:172.21.15.142:6800/1064901393 11 ==== osd_op_reply(40 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f9488053020 con 0x56025d5f0f70 2024-09-22T08:36:44.560 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.538+0000 7f9493b32800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:36:44.560 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.538+0000 7f9493b32800 20 zone default found 2024-09-22T08:36:44.560 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.538+0000 7f9493b32800 4 Realm: () 2024-09-22T08:36:44.561 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.538+0000 7f9493b32800 4 ZoneGroup: default (d89f6f57-1007-47dd-9065-f486c7b01aec) 2024-09-22T08:36:44.561 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.538+0000 7f9493b32800 4 Zone: default (e239248c-0bee-4e41-803a-24b288d3eb8f) 2024-09-22T08:36:44.561 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.538+0000 7f9493b32800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:36:44.561 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.538+0000 7f9493b32800 20 zonegroup default 2024-09-22T08:36:44.561 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.538+0000 7f9493b32800 20 rados->read ofs=0 len=0 2024-09-22T08:36:44.561 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.538+0000 7f9493b32800 1 -- 172.21.15.142:0/1316851120 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56025d5f5b20 con 0x7f94800541f0 2024-09-22T08:36:44.561 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.539+0000 7f948efbb640 1 -- 172.21.15.142:0/1316851120 <== osd.0 v2:172.21.15.31:6800/168281188 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f9484051070 con 0x7f94800541f0 2024-09-22T08:36:44.561 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.539+0000 7f9493b32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:44.561 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.539+0000 7f9493b32800 20 rados->read ofs=0 len=0 2024-09-22T08:36:44.561 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.539+0000 7f9493b32800 1 -- 172.21.15.142:0/1316851120 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56025d5f7e00 con 0x56025d5f0f70 2024-09-22T08:36:44.561 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.539+0000 7f948ffbd640 1 -- 172.21.15.142:0/1316851120 <== osd.3 v2:172.21.15.142:6800/1064901393 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9488053020 con 0x56025d5f0f70 2024-09-22T08:36:44.561 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.539+0000 7f9493b32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:44.561 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.539+0000 7f9493b32800 20 rados->read ofs=0 len=0 2024-09-22T08:36:44.561 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.539+0000 7f9493b32800 1 -- 172.21.15.142:0/1316851120 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56025d5f81a0 con 0x56025d5f0f70 2024-09-22T08:36:44.561 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.539+0000 7f948ffbd640 1 -- 172.21.15.142:0/1316851120 <== osd.3 v2:172.21.15.142:6800/1064901393 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9488053020 con 0x56025d5f0f70 2024-09-22T08:36:44.562 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.539+0000 7f9493b32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:44.562 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.539+0000 7f9493b32800 20 started sync module instance, tier type = 2024-09-22T08:36:44.562 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.539+0000 7f9493b32800 20 started zone id=e239248c-0bee-4e41-803a-24b288d3eb8f (name=default) with tier type = 2024-09-22T08:36:44.562 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.539+0000 7f9493b32800 1 -- 172.21.15.142:0/1316851120 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56025d5f7290 con 0x7f9488012a50 2024-09-22T08:36:44.562 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.540+0000 7f948f7bc640 1 -- 172.21.15.142:0/1316851120 <== osd.2 v2:172.21.15.142:6808/279438927 7 ==== osd_op_reply(44 notify.0 [create] v30'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9480039070 con 0x7f9488012a50 2024-09-22T08:36:44.562 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.540+0000 7f9493b32800 1 -- 172.21.15.142:0/1316851120 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94568156460672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56025d5f6ef0 con 0x7f9488012a50 2024-09-22T08:36:44.562 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.540+0000 7f9493b32800 1 -- 172.21.15.142:0/1316851120 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56025d5f8f90 con 0x56025d5ec560 2024-09-22T08:36:44.562 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.541+0000 7f948f7bc640 1 -- 172.21.15.142:0/1316851120 <== osd.2 v2:172.21.15.142:6808/279438927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94568156460672] v30'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9480039070 con 0x7f9488012a50 2024-09-22T08:36:44.562 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.541+0000 7f948efbb640 1 -- 172.21.15.142:0/1316851120 <== osd.1 v2:172.21.15.142:6816/3192108003 15 ==== osd_op_reply(46 notify.1 [create] v30'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9484051070 con 0x56025d5ec560 2024-09-22T08:36:44.562 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.542+0000 7f9493b32800 1 -- 172.21.15.142:0/1316851120 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94568156464592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56025d5f9380 con 0x56025d5ec560 2024-09-22T08:36:44.562 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.542+0000 7f9493b32800 1 -- 172.21.15.142:0/1316851120 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56025d5f9de0 con 0x56025d5f0f70 2024-09-22T08:36:44.563 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.543+0000 7f948efbb640 1 -- 172.21.15.142:0/1316851120 <== osd.1 v2:172.21.15.142:6816/3192108003 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94568156464592] v30'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9484051070 con 0x56025d5ec560 2024-09-22T08:36:44.563 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.543+0000 7f948ffbd640 1 -- 172.21.15.142:0/1316851120 <== osd.3 v2:172.21.15.142:6800/1064901393 14 ==== osd_op_reply(48 notify.2 [create] v30'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9488053020 con 0x56025d5f0f70 2024-09-22T08:36:44.563 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.543+0000 7f9493b32800 1 -- 172.21.15.142:0/1316851120 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94568156469392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56025d5f9da0 con 0x56025d5f0f70 2024-09-22T08:36:44.563 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.543+0000 7f9493b32800 1 -- 172.21.15.142:0/1316851120 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56025d5fa870 con 0x7f9488012a50 2024-09-22T08:36:44.563 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.544+0000 7f948f7bc640 1 -- 172.21.15.142:0/1316851120 <== osd.2 v2:172.21.15.142:6808/279438927 9 ==== osd_op_reply(50 notify.3 [create] v30'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9480039070 con 0x7f9488012a50 2024-09-22T08:36:44.563 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.544+0000 7f9493b32800 1 -- 172.21.15.142:0/1316851120 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94568156472224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56025d5fb100 con 0x7f9488012a50 2024-09-22T08:36:44.563 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.544+0000 7f9493b32800 1 -- 172.21.15.142:0/1316851120 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56025d5fbc00 con 0x56025d5ec560 2024-09-22T08:36:44.563 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.544+0000 7f948ffbd640 1 -- 172.21.15.142:0/1316851120 <== osd.3 v2:172.21.15.142:6800/1064901393 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94568156469392] v30'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9488053020 con 0x56025d5f0f70 2024-09-22T08:36:44.563 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.545+0000 7f948f7bc640 1 -- 172.21.15.142:0/1316851120 <== osd.2 v2:172.21.15.142:6808/279438927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94568156472224] v30'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9480039070 con 0x7f9488012a50 2024-09-22T08:36:44.563 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.545+0000 7f948efbb640 1 -- 172.21.15.142:0/1316851120 <== osd.1 v2:172.21.15.142:6816/3192108003 17 ==== osd_op_reply(52 notify.4 [create] v30'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9484051070 con 0x56025d5ec560 2024-09-22T08:36:44.563 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.545+0000 7f9493b32800 1 -- 172.21.15.142:0/1316851120 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94568156477072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56025d5fac10 con 0x56025d5ec560 2024-09-22T08:36:44.563 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.545+0000 7f9493b32800 1 -- 172.21.15.142:0/1316851120 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56025d5fc610 con 0x7f94800541f0 2024-09-22T08:36:44.563 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.546+0000 7f948efbb640 1 -- 172.21.15.142:0/1316851120 <== osd.0 v2:172.21.15.31:6800/168281188 11 ==== osd_op_reply(54 notify.5 [create] v30'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9484051070 con 0x7f94800541f0 2024-09-22T08:36:44.563 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.546+0000 7f9493b32800 1 -- 172.21.15.142:0/1316851120 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94568156479840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56025d5fca30 con 0x7f94800541f0 2024-09-22T08:36:44.564 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.546+0000 7f9493b32800 1 -- 172.21.15.142:0/1316851120 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56025d5fd050 con 0x7f94800541f0 2024-09-22T08:36:44.564 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.546+0000 7f948efbb640 1 -- 172.21.15.142:0/1316851120 <== osd.1 v2:172.21.15.142:6816/3192108003 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94568156477072] v30'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9484051070 con 0x56025d5ec560 2024-09-22T08:36:44.564 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.547+0000 7f948efbb640 1 -- 172.21.15.142:0/1316851120 <== osd.0 v2:172.21.15.31:6800/168281188 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94568156479840] v30'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9484051070 con 0x7f94800541f0 2024-09-22T08:36:44.564 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.547+0000 7f948efbb640 1 -- 172.21.15.142:0/1316851120 <== osd.0 v2:172.21.15.31:6800/168281188 13 ==== osd_op_reply(56 notify.6 [create] v30'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9484051070 con 0x7f94800541f0 2024-09-22T08:36:44.564 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.547+0000 7f9493b32800 1 -- 172.21.15.142:0/1316851120 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94568156465648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56025d5fd050 con 0x7f94800541f0 2024-09-22T08:36:44.564 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.548+0000 7f9493b32800 1 -- 172.21.15.142:0/1316851120 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56025d5fd920 con 0x7f94800541f0 2024-09-22T08:36:44.564 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.548+0000 7f948efbb640 1 -- 172.21.15.142:0/1316851120 <== osd.0 v2:172.21.15.31:6800/168281188 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94568156465648] v30'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9484051070 con 0x7f94800541f0 2024-09-22T08:36:44.564 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.548+0000 7f948efbb640 1 -- 172.21.15.142:0/1316851120 <== osd.0 v2:172.21.15.31:6800/168281188 15 ==== osd_op_reply(58 notify.7 [create] v30'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9484051070 con 0x7f94800541f0 2024-09-22T08:36:44.564 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.548+0000 7f9493b32800 1 -- 172.21.15.142:0/1316851120 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94568156482944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56025d5fd920 con 0x7f94800541f0 2024-09-22T08:36:44.564 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.548+0000 7f9493b32800 20 add_watcher() i=0 2024-09-22T08:36:44.564 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.548+0000 7f9493b32800 20 add_watcher() i=1 2024-09-22T08:36:44.564 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.548+0000 7f9493b32800 20 add_watcher() i=2 2024-09-22T08:36:44.564 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.548+0000 7f9493b32800 20 add_watcher() i=3 2024-09-22T08:36:44.564 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.548+0000 7f9493b32800 20 add_watcher() i=4 2024-09-22T08:36:44.564 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.548+0000 7f9493b32800 20 add_watcher() i=5 2024-09-22T08:36:44.565 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.548+0000 7f9493b32800 20 add_watcher() i=6 2024-09-22T08:36:44.565 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.549+0000 7f948efbb640 1 -- 172.21.15.142:0/1316851120 <== osd.0 v2:172.21.15.31:6800/168281188 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94568156482944] v30'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9484051070 con 0x7f94800541f0 2024-09-22T08:36:44.565 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.549+0000 7f9493b32800 20 add_watcher() i=7 2024-09-22T08:36:44.565 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.549+0000 7f9493b32800 2 all 8 watchers are set, enabling cache 2024-09-22T08:36:44.565 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.549+0000 7f9493b32800 1 -- 172.21.15.142:0/1316851120 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56025d600d80 con 0x56025d5ec560 2024-09-22T08:36:44.565 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.550+0000 7f948efbb640 1 -- 172.21.15.142:0/1316851120 <== osd.1 v2:172.21.15.142:6816/3192108003 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f9484051070 con 0x56025d5ec560 2024-09-22T08:36:44.565 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.550+0000 7f9493b32800 1 -- 172.21.15.142:0/1316851120 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94568156497776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56025d5fda90 con 0x56025d5ec560 2024-09-22T08:36:44.565 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.551+0000 7f948efbb640 1 -- 172.21.15.142:0/1316851120 <== osd.1 v2:172.21.15.142:6816/3192108003 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94568156497776] v30'78 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9484051070 con 0x56025d5ec560 2024-09-22T08:36:44.565 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.551+0000 7f9345fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:36:44.565 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.551+0000 7f9493b32800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:36:44.565 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.551+0000 7f9493b32800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:36:44.565 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.551+0000 7f9493b32800 5 note: GC not initialized 2024-09-22T08:36:44.565 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.551+0000 7f9344fe1640 20 reqs_thread_entry: start 2024-09-22T08:36:44.566 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.551+0000 7f9493b32800 20 init_complete bucket index max shards: 11 2024-09-22T08:36:44.566 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.551+0000 7f9493b32800 20 Filter name: none 2024-09-22T08:36:44.566 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.551+0000 7f92be7fc640 20 reqs_thread_entry: start 2024-09-22T08:36:44.566 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.552+0000 7f9493b32800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-22T08:36:44.566 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.552+0000 7f9493b32800 20 rados->read ofs=0 len=0 2024-09-22T08:36:44.566 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.552+0000 7f9493b32800 1 -- 172.21.15.142:0/1316851120 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56025d6340f0 con 0x56025d5ec560 2024-09-22T08:36:44.566 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.552+0000 7f948efbb640 1 -- 172.21.15.142:0/1316851120 <== osd.1 v2:172.21.15.142:6816/3192108003 21 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv7 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7f9484051070 con 0x56025d5ec560 2024-09-22T08:36:44.566 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.552+0000 7f9493b32800 20 rados_obj.operate() r=0 bl.length=556 2024-09-22T08:36:44.566 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.552+0000 7f9493b32800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-22T08:36:44.566 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.552+0000 7f9493b32800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-22T08:36:44.567 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.552+0000 7f9493b32800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:36:44.567 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.552+0000 7f9493b32800 10 cache get: name=default.rgw.meta+users.swift+foo:foo2 : miss 2024-09-22T08:36:44.567 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.552+0000 7f9493b32800 20 rados->read ofs=0 len=0 2024-09-22T08:36:44.567 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.552+0000 7f9493b32800 1 -- 172.21.15.142:0/1316851120 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:63 8.2 8:45671577:users.swift::foo%3afoo2:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56025d634ec0 con 0x7f9488012a50 2024-09-22T08:36:44.567 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.552+0000 7f948f7bc640 1 -- 172.21.15.142:0/1316851120 <== osd.2 v2:172.21.15.142:6808/279438927 11 ==== osd_op_reply(63 foo:foo2 [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 194+0+0 (crc 0 0 0) 0x7f9480039070 con 0x7f9488012a50 2024-09-22T08:36:44.567 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.552+0000 7f9493b32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:44.567 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.552+0000 7f9493b32800 10 cache put: name=default.rgw.meta+users.swift+foo:foo2 info.flags=0x0 2024-09-22T08:36:44.567 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.552+0000 7f9493b32800 10 adding default.rgw.meta+users.swift+foo:foo2 to cache LRU end 2024-09-22T08:36:44.567 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.552+0000 7f9493b32800 10 cache get: name=default.rgw.meta+users.swift+foo:foo2 : hit (negative entry) 2024-09-22T08:36:44.567 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.552+0000 7f9493b32800 1 -- 172.21.15.142:0/1316851120 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~673 in=673b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56025d63aba0 con 0x56025d5ec560 2024-09-22T08:36:44.567 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.554+0000 7f948efbb640 1 -- 172.21.15.142:0/1316851120 <== osd.1 v2:172.21.15.142:6816/3192108003 22 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~673] v30'8 uv8 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f9484051070 con 0x56025d5ec560 2024-09-22T08:36:44.567 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.554+0000 7f9493b32800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-22T08:36:44.568 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.554+0000 7f9493b32800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-22T08:36:44.568 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.554+0000 7f9493b32800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-22T08:36:44.568 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.554+0000 7f9493b32800 1 -- 172.21.15.142:0/1316851120 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94568156734944 in=861b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56025d6377b0 con 0x56025d5ec560 2024-09-22T08:36:44.568 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.554+0000 7f948efbb640 1 -- 172.21.15.142:0/1316851120 <== osd.1 v2:172.21.15.142:6816/3192108003 23 ==== watch-notify(notify (1) cookie 94568156477072 notify 128849018887 ret 0) ==== 891+0+0 (crc 0 0 0) 0x7f9484081040 con 0x56025d5ec560 2024-09-22T08:36:44.568 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.554+0000 7f9372ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018887 cookie 94568156477072 notifier 4387 bl.length()=849 2024-09-22T08:36:44.568 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.554+0000 7f9372ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-22T08:36:44.568 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.554+0000 7f9372ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-22T08:36:44.568 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.554+0000 7f9372ffd640 1 -- 172.21.15.142:0/1316851120 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f9354003ea0 con 0x56025d5ec560 2024-09-22T08:36:44.568 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.554+0000 7f948efbb640 1 -- 172.21.15.142:0/1316851120 <== osd.1 v2:172.21.15.142:6816/3192108003 24 ==== osd_op_reply(65 notify.4 [notify cookie 94568156734944 out=8b] v0'0 uv66 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f9484051070 con 0x56025d5ec560 2024-09-22T08:36:44.568 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.554+0000 7f948efbb640 1 -- 172.21.15.142:0/1316851120 <== osd.1 v2:172.21.15.142:6816/3192108003 25 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9484051070 con 0x56025d5ec560 2024-09-22T08:36:44.568 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.554+0000 7f948efbb640 1 -- 172.21.15.142:0/1316851120 <== osd.1 v2:172.21.15.142:6816/3192108003 26 ==== watch-notify(notify_complete (2) cookie 94568156734944 notify 128849018887 ret 0) ==== 42+0+48 (crc 0 0 0) 0x56025d4b7f00 con 0x56025d5ec560 2024-09-22T08:36:44.568 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.554+0000 7f9493b32800 1 -- 172.21.15.142:0/1316851120 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:67 8.2 8:45671577:users.swift::foo%3afoo2:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56025d63a5e0 con 0x7f9488012a50 2024-09-22T08:36:44.569 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.555+0000 7f948f7bc640 1 -- 172.21.15.142:0/1316851120 <== osd.2 v2:172.21.15.142:6808/279438927 12 ==== osd_op_reply(67 foo:foo2 [delete,create,writefull 0~7] v30'1 uv1 ondisk = 0) ==== 236+0+0 (crc 0 0 0) 0x7f9480039070 con 0x7f9488012a50 2024-09-22T08:36:44.569 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.555+0000 7f9493b32800 10 cache put: name=default.rgw.meta+users.swift+foo:foo2 info.flags=0x7 2024-09-22T08:36:44.569 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.555+0000 7f9493b32800 10 moving default.rgw.meta+users.swift+foo:foo2 to cache LRU end 2024-09-22T08:36:44.569 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.555+0000 7f9493b32800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.swift:foo:foo2, ofs0, ns] 2024-09-22T08:36:44.569 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.555+0000 7f9493b32800 1 -- 172.21.15.142:0/1316851120 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94568156734944 in=178b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56025d6352e0 con 0x7f9488012a50 2024-09-22T08:36:44.569 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.556+0000 7f948f7bc640 1 -- 172.21.15.142:0/1316851120 <== osd.2 v2:172.21.15.142:6808/279438927 13 ==== watch-notify(notify (1) cookie 94568156460672 notify 128849018883 ret 0) ==== 208+0+0 (crc 0 0 0) 0x56025d5b0c20 con 0x7f9488012a50 2024-09-22T08:36:44.569 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.556+0000 7f93727fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018883 cookie 94568156460672 notifier 4387 bl.length()=166 2024-09-22T08:36:44.569 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.556+0000 7f93727fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.swift+foo:foo2 info.flags=0x7 2024-09-22T08:36:44.569 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.556+0000 7f93727fc640 10 rgw watcher librados: moving default.rgw.meta+users.swift+foo:foo2 to cache LRU end 2024-09-22T08:36:44.569 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.556+0000 7f948f7bc640 1 -- 172.21.15.142:0/1316851120 <== osd.2 v2:172.21.15.142:6808/279438927 14 ==== osd_op_reply(68 notify.0 [notify cookie 94568156734944 out=8b] v0'0 uv66 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f9480039070 con 0x7f9488012a50 2024-09-22T08:36:44.569 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.556+0000 7f93727fc640 1 -- 172.21.15.142:0/1316851120 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:69 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f92c4003400 con 0x7f9488012a50 2024-09-22T08:36:44.569 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.556+0000 7f948f7bc640 1 -- 172.21.15.142:0/1316851120 <== osd.2 v2:172.21.15.142:6808/279438927 15 ==== osd_op_reply(69 notify.0 [notify-ack] v0'0 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9480039070 con 0x7f9488012a50 2024-09-22T08:36:44.569 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.556+0000 7f948f7bc640 1 -- 172.21.15.142:0/1316851120 <== osd.2 v2:172.21.15.142:6808/279438927 16 ==== watch-notify(notify_complete (2) cookie 94568156734944 notify 128849018883 ret 0) ==== 42+0+48 (crc 0 0 0) 0x56025d5b0220 con 0x7f9488012a50 2024-09-22T08:36:44.570 INFO:teuthology.orchestra.run.smithi142.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"},{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-22T08:36:42.661297Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"},{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true,"create_date":"2024-09-22T08:36:44.553654Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-22T08:36:42.661288Z","tags":[],"group_ids":[]} 2024-09-22T08:36:44.578 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.557+0000 7f9345fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:36:44.579 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.557+0000 7f9493b32800 1 -- 172.21.15.142:0/1316851120 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94568156497776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56025d631dd0 con 0x56025d5ec560 2024-09-22T08:36:44.579 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.558+0000 7f948efbb640 1 -- 172.21.15.142:0/1316851120 <== osd.1 v2:172.21.15.142:6816/3192108003 27 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94568156497776] v30'79 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9484051070 con 0x56025d5ec560 2024-09-22T08:36:44.579 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.558+0000 7f9493b32800 1 -- 172.21.15.142:0/1316851120 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94568156460672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56025d631dd0 con 0x7f9488012a50 2024-09-22T08:36:44.579 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.559+0000 7f948f7bc640 1 -- 172.21.15.142:0/1316851120 <== osd.2 v2:172.21.15.142:6808/279438927 17 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94568156460672] v30'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9480039070 con 0x7f9488012a50 2024-09-22T08:36:44.579 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.559+0000 7f9493b32800 20 remove_watcher() i=0 2024-09-22T08:36:44.579 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.559+0000 7f9493b32800 2 removed watcher, disabling cache 2024-09-22T08:36:44.579 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.559+0000 7f9493b32800 1 -- 172.21.15.142:0/1316851120 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94568156464592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56025d631dd0 con 0x56025d5ec560 2024-09-22T08:36:44.579 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.560+0000 7f948efbb640 1 -- 172.21.15.142:0/1316851120 <== osd.1 v2:172.21.15.142:6816/3192108003 28 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94568156464592] v30'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9484051070 con 0x56025d5ec560 2024-09-22T08:36:44.580 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.560+0000 7f9493b32800 20 remove_watcher() i=1 2024-09-22T08:36:44.580 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.560+0000 7f9493b32800 1 -- 172.21.15.142:0/1316851120 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94568156469392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56025d631dd0 con 0x56025d5f0f70 2024-09-22T08:36:44.580 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.561+0000 7f948ffbd640 1 -- 172.21.15.142:0/1316851120 <== osd.3 v2:172.21.15.142:6800/1064901393 16 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94568156469392] v30'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9488053020 con 0x56025d5f0f70 2024-09-22T08:36:44.580 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.561+0000 7f9493b32800 20 remove_watcher() i=2 2024-09-22T08:36:44.580 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.561+0000 7f9493b32800 1 -- 172.21.15.142:0/1316851120 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94568156472224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56025d631dd0 con 0x7f9488012a50 2024-09-22T08:36:44.580 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.562+0000 7f948f7bc640 1 -- 172.21.15.142:0/1316851120 <== osd.2 v2:172.21.15.142:6808/279438927 18 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94568156472224] v30'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9480039070 con 0x7f9488012a50 2024-09-22T08:36:44.580 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.562+0000 7f9493b32800 20 remove_watcher() i=3 2024-09-22T08:36:44.580 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.562+0000 7f9493b32800 1 -- 172.21.15.142:0/1316851120 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94568156477072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56025d631dd0 con 0x56025d5ec560 2024-09-22T08:36:44.581 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.563+0000 7f948efbb640 1 -- 172.21.15.142:0/1316851120 <== osd.1 v2:172.21.15.142:6816/3192108003 29 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94568156477072] v30'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9484051070 con 0x56025d5ec560 2024-09-22T08:36:44.581 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.563+0000 7f9493b32800 20 remove_watcher() i=4 2024-09-22T08:36:44.581 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.563+0000 7f9493b32800 1 -- 172.21.15.142:0/1316851120 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94568156479840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56025d631dd0 con 0x7f94800541f0 2024-09-22T08:36:44.581 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.564+0000 7f948efbb640 1 -- 172.21.15.142:0/1316851120 <== osd.0 v2:172.21.15.31:6800/168281188 17 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94568156479840] v30'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9484051070 con 0x7f94800541f0 2024-09-22T08:36:44.581 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.564+0000 7f9493b32800 20 remove_watcher() i=5 2024-09-22T08:36:44.581 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.564+0000 7f9493b32800 1 -- 172.21.15.142:0/1316851120 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94568156465648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56025d631dd0 con 0x7f94800541f0 2024-09-22T08:36:44.581 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.565+0000 7f948efbb640 1 -- 172.21.15.142:0/1316851120 <== osd.0 v2:172.21.15.31:6800/168281188 18 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94568156465648] v30'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9484051070 con 0x7f94800541f0 2024-09-22T08:36:44.581 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.565+0000 7f9493b32800 20 remove_watcher() i=6 2024-09-22T08:36:44.582 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.565+0000 7f9493b32800 1 -- 172.21.15.142:0/1316851120 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94568156482944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56025d631dd0 con 0x7f94800541f0 2024-09-22T08:36:44.582 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.566+0000 7f948efbb640 1 -- 172.21.15.142:0/1316851120 <== osd.0 v2:172.21.15.31:6800/168281188 19 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94568156482944] v30'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9484051070 con 0x7f94800541f0 2024-09-22T08:36:44.582 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.566+0000 7f9493b32800 20 remove_watcher() i=7 2024-09-22T08:36:44.582 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.566+0000 7f9493b32800 1 -- 172.21.15.142:0/1316851120 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f94800541f0 msgr2=0x7f9480054630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:44.582 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.566+0000 7f9493b32800 1 --2- 172.21.15.142:0/1316851120 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f94800541f0 0x7f9480054630 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:44.582 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.566+0000 7f9493b32800 1 -- 172.21.15.142:0/1316851120 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x56025d5ec560 msgr2=0x56025d5eea20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:44.582 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.566+0000 7f9493b32800 1 --2- 172.21.15.142:0/1316851120 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x56025d5ec560 0x56025d5eea20 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:44.582 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.566+0000 7f9493b32800 1 -- 172.21.15.142:0/1316851120 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f9488012a50 msgr2=0x7f948803d7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:44.583 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.566+0000 7f9493b32800 1 --2- 172.21.15.142:0/1316851120 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f9488012a50 0x7f948803d7f0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:44.583 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.566+0000 7f9493b32800 1 -- 172.21.15.142:0/1316851120 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x56025d5f0f70 msgr2=0x56025d5f3360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:44.583 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.566+0000 7f9493b32800 1 --2- 172.21.15.142:0/1316851120 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x56025d5f0f70 0x56025d5f3360 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:44.583 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.566+0000 7f9493b32800 1 -- 172.21.15.142:0/1316851120 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f935803d000 msgr2=0x7f935803f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:44.583 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.566+0000 7f9493b32800 1 --2- 172.21.15.142:0/1316851120 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f935803d000 0x7f935803f4c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f948000efd0 tx=0x7f9480041000 comp rx=0 tx=0).stop 2024-09-22T08:36:44.583 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.566+0000 7f9493b32800 1 -- 172.21.15.142:0/1316851120 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56025d5d9680 msgr2=0x56025d5e0c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:44.583 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.566+0000 7f9493b32800 1 --2- 172.21.15.142:0/1316851120 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56025d5d9680 0x56025d5e0c70 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f9488022ff0 tx=0x7f9488054780 comp rx=0 tx=0).stop 2024-09-22T08:36:44.584 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.566+0000 7f948efbb640 1 -- 172.21.15.142:0/1316851120 reap_dead start 2024-09-22T08:36:44.584 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.566+0000 7f948efbb640 1 -- 172.21.15.142:0/1316851120 reap_dead start 2024-09-22T08:36:44.584 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.566+0000 7f9493b32800 1 -- 172.21.15.142:0/1316851120 shutdown_connections 2024-09-22T08:36:44.584 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.566+0000 7f9493b32800 1 -- 172.21.15.142:0/1316851120 >> 172.21.15.142:0/1316851120 conn(0x56025d5d5a80 msgr2=0x56025d5d3c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:44.584 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.566+0000 7f9493b32800 1 -- 172.21.15.142:0/1316851120 shutdown_connections 2024-09-22T08:36:44.584 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.566+0000 7f9493b32800 1 -- 172.21.15.142:0/1316851120 wait complete. 2024-09-22T08:36:44.584 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.567+0000 7f9493b32800 1 -- 172.21.15.142:0/2717687137 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f936803d070 msgr2=0x7f936803f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:44.584 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.567+0000 7f9493b32800 1 --2- 172.21.15.142:0/2717687137 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f936803d070 0x7f936803f530 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f94800531e0 tx=0x7f94800011b0 comp rx=0 tx=0).stop 2024-09-22T08:36:44.584 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.567+0000 7f9493b32800 1 -- 172.21.15.142:0/2717687137 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56025d5a8270 msgr2=0x56025d5a6ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:44.585 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.567+0000 7f9493b32800 1 --2- 172.21.15.142:0/2717687137 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56025d5a8270 0x56025d5a6ae0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x56025d5b0a30 tx=0x7f94880167b0 comp rx=0 tx=0).stop 2024-09-22T08:36:44.585 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.567+0000 7f9493b32800 1 -- 172.21.15.142:0/2717687137 shutdown_connections 2024-09-22T08:36:44.585 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.567+0000 7f9493b32800 1 --2- 172.21.15.142:0/2717687137 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f936803d070 0x7f936803f530 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:44.585 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.567+0000 7f9493b32800 1 --2- 172.21.15.142:0/2717687137 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56025d5a8270 0x56025d5a6ae0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:44.585 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.567+0000 7f9493b32800 1 -- 172.21.15.142:0/2717687137 >> 172.21.15.142:0/2717687137 conn(0x56025d5bedd0 msgr2=0x56025d5bf1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:44.585 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.567+0000 7f9493b32800 1 -- 172.21.15.142:0/2717687137 shutdown_connections 2024-09-22T08:36:44.585 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.567+0000 7f9493b32800 1 -- 172.21.15.142:0/2717687137 wait complete. 2024-09-22T08:36:44.585 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.567+0000 7f9493b32800 1 -- 172.21.15.142:0/1052930757 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x56025d4b8c10 msgr2=0x56025d5b7080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:44.585 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.567+0000 7f9493b32800 1 --2- 172.21.15.142:0/1052930757 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x56025d4b8c10 0x56025d5b7080 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:44.585 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.567+0000 7f9493b32800 1 -- 172.21.15.142:0/1052930757 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x56025d5b9460 msgr2=0x56025d5bb8e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:44.585 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.567+0000 7f9493b32800 1 --2- 172.21.15.142:0/1052930757 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x56025d5b9460 0x56025d5bb8e0 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:44.585 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.567+0000 7f9493b32800 1 -- 172.21.15.142:0/1052930757 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f937403d1a0 msgr2=0x7f937403f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:44.585 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.567+0000 7f9493b32800 1 --2- 172.21.15.142:0/1052930757 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f937403d1a0 0x7f937403f660 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f9484057000 tx=0x7f9484052000 comp rx=0 tx=0).stop 2024-09-22T08:36:44.586 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.567+0000 7f9493b32800 1 -- 172.21.15.142:0/1052930757 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56025d4b7800 msgr2=0x56025d5afa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:44.586 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.567+0000 7f9493b32800 1 --2- 172.21.15.142:0/1052930757 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56025d4b7800 0x56025d5afa30 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f94800012f0 tx=0x7f9480000ed0 comp rx=0 tx=0).stop 2024-09-22T08:36:44.586 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.567+0000 7f9493b32800 1 -- 172.21.15.142:0/1052930757 shutdown_connections 2024-09-22T08:36:44.586 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.567+0000 7f9493b32800 1 --2- 172.21.15.142:0/1052930757 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x56025d5b9460 0x56025d5bb8e0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:44.586 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.567+0000 7f9493b32800 1 --2- 172.21.15.142:0/1052930757 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x56025d4b8c10 0x56025d5b7080 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:44.586 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.567+0000 7f9493b32800 1 --2- 172.21.15.142:0/1052930757 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f937403d1a0 0x7f937403f660 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:44.586 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.567+0000 7f9493b32800 1 --2- 172.21.15.142:0/1052930757 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56025d4b7800 0x56025d5afa30 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:44.586 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.567+0000 7f9493b32800 1 -- 172.21.15.142:0/1052930757 >> 172.21.15.142:0/1052930757 conn(0x56025d4b2bd0 msgr2=0x56025d5a0f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:44.586 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.567+0000 7f9493b32800 1 -- 172.21.15.142:0/1052930757 shutdown_connections 2024-09-22T08:36:44.586 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.567+0000 7f9493b32800 1 -- 172.21.15.142:0/1052930757 wait complete. 2024-09-22T08:36:44.586 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-22T08:36:42.661297Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}, {'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True, 'create_date': '2024-09-22T08:36:44.553654Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-22T08:36:42.661288Z', 'tags': [], 'group_ids': []} 2024-09-22T08:36:44.587 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-22T08:36:44.587 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-22T08:36:44.587 DEBUG:teuthology.orchestra.run.smithi142:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-22T08:36:44.631 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:36:44.631 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:36:44.633 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.631+0000 7f7d96a20800 1 Processor -- start 2024-09-22T08:36:44.633 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.631+0000 7f7d96a20800 1 -- start start 2024-09-22T08:36:44.633 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.631+0000 7f7d96a20800 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55bce9073be0 0x55bce9079570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:44.633 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.631+0000 7f7d96a20800 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55bce8efea20 con 0x55bce90727d0 2024-09-22T08:36:44.633 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.631+0000 7f7d96a20800 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x55bce8efe7d0 con 0x55bce9073be0 2024-09-22T08:36:44.633 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.631+0000 7f7d8bfff640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55bce9073be0 0x55bce9079570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:44.633 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.631+0000 7f7d94511640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x55bce90727d0 0x55bce90734d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.142:42436/0 (socket says 172.21.15.142:42436) 2024-09-22T08:36:44.634 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.631+0000 7f7d94511640 1 -- 172.21.15.142:0/1641029673 learned_addr learned my addr 172.21.15.142:0/1641029673 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-09-22T08:36:44.634 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.631+0000 7f7d93d10640 1 -- 172.21.15.142:0/1641029673 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2136931818 0 0) 0x55bce8efea20 con 0x55bce90727d0 2024-09-22T08:36:44.634 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.631+0000 7f7d93d10640 1 -- 172.21.15.142:0/1641029673 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7d80001e10 con 0x55bce90727d0 2024-09-22T08:36:44.634 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.632+0000 7f7d8bfff640 1 -- 172.21.15.142:0/1641029673 >> v1:172.21.15.31:6789/0 conn(0x55bce90727d0 legacy=0x55bce90734d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:44.634 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.632+0000 7f7d8bfff640 1 -- 172.21.15.142:0/1641029673 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bce9072ed0 con 0x55bce9073be0 2024-09-22T08:36:44.635 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.633+0000 7f7d8bfff640 1 --2- 172.21.15.142:0/1641029673 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bce9073be0 0x55bce9079570 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f7d7c00a470 tx=0x7f7d7c045920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=972341513a9ffca2 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:44.636 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.633+0000 7f7d93d10640 1 -- 172.21.15.142:0/1641029673 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d7c059070 con 0x55bce9073be0 2024-09-22T08:36:44.636 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.633+0000 7f7d93d10640 1 -- 172.21.15.142:0/1641029673 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d7c054570 con 0x55bce9073be0 2024-09-22T08:36:44.636 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.633+0000 7f7d93d10640 1 -- 172.21.15.142:0/1641029673 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d7c054870 con 0x55bce9073be0 2024-09-22T08:36:44.636 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.634+0000 7f7d96a20800 1 -- 172.21.15.142:0/1641029673 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bce9073be0 msgr2=0x55bce9079570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:44.636 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.634+0000 7f7d96a20800 1 --2- 172.21.15.142:0/1641029673 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bce9073be0 0x55bce9079570 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f7d7c00a470 tx=0x7f7d7c045920 comp rx=0 tx=0).stop 2024-09-22T08:36:44.636 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.634+0000 7f7d96a20800 1 -- 172.21.15.142:0/1641029673 shutdown_connections 2024-09-22T08:36:44.636 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.634+0000 7f7d96a20800 1 --2- 172.21.15.142:0/1641029673 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bce9073be0 0x55bce9079570 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:44.636 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.634+0000 7f7d96a20800 1 -- 172.21.15.142:0/1641029673 >> 172.21.15.142:0/1641029673 conn(0x55bce906dba0 msgr2=0x55bce9070000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:44.636 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.634+0000 7f7d96a20800 1 -- 172.21.15.142:0/1641029673 shutdown_connections 2024-09-22T08:36:44.636 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.634+0000 7f7d96a20800 1 -- 172.21.15.142:0/1641029673 wait complete. 2024-09-22T08:36:44.650 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.648+0000 7f7d96a20800 1 Processor -- start 2024-09-22T08:36:44.650 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.648+0000 7f7d96a20800 1 -- start start 2024-09-22T08:36:44.650 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.648+0000 7f7d96a20800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bce90727d0 0x55bce8fe7110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:44.650 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.648+0000 7f7d96a20800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55bce8f0bdd0 con 0x55bce90727d0 2024-09-22T08:36:44.650 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.648+0000 7f7d94511640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bce90727d0 0x55bce8fe7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:44.651 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.648+0000 7f7d94511640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bce90727d0 0x55bce8fe7110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:38672/0 (socket says 172.21.15.142:38672) 2024-09-22T08:36:44.651 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.648+0000 7f7d94511640 1 -- 172.21.15.142:0/617539801 learned_addr learned my addr 172.21.15.142:0/617539801 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:44.651 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.648+0000 7f7d94511640 1 -- 172.21.15.142:0/617539801 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bce8fe7650 con 0x55bce90727d0 2024-09-22T08:36:44.651 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.649+0000 7f7d94511640 1 --2- 172.21.15.142:0/617539801 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bce90727d0 0x55bce8fe7110 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f7d84001e30 tx=0x7f7d8400b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c17ac59bc09f0866 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:44.651 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.649+0000 7f7c8260c640 1 -- 172.21.15.142:0/617539801 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d84012020 con 0x55bce90727d0 2024-09-22T08:36:44.651 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.649+0000 7f7c8260c640 1 -- 172.21.15.142:0/617539801 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d8400e470 con 0x55bce90727d0 2024-09-22T08:36:44.651 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.649+0000 7f7c8260c640 1 -- 172.21.15.142:0/617539801 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d8400e790 con 0x55bce90727d0 2024-09-22T08:36:44.667 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.649+0000 7f7d96a20800 1 -- 172.21.15.142:0/617539801 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bce90727d0 msgr2=0x55bce8fe7110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:44.667 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.649+0000 7f7d96a20800 1 --2- 172.21.15.142:0/617539801 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bce90727d0 0x55bce8fe7110 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f7d84001e30 tx=0x7f7d8400b780 comp rx=0 tx=0).stop 2024-09-22T08:36:44.667 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.649+0000 7f7d96a20800 1 -- 172.21.15.142:0/617539801 shutdown_connections 2024-09-22T08:36:44.667 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.649+0000 7f7d96a20800 1 --2- 172.21.15.142:0/617539801 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bce90727d0 0x55bce8fe7110 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:44.668 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.650+0000 7f7d96a20800 1 -- 172.21.15.142:0/617539801 >> 172.21.15.142:0/617539801 conn(0x55bce906dba0 msgr2=0x55bce915d6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:44.668 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.650+0000 7f7d96a20800 1 -- 172.21.15.142:0/617539801 shutdown_connections 2024-09-22T08:36:44.668 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.650+0000 7f7d96a20800 1 -- 172.21.15.142:0/617539801 wait complete. 2024-09-22T08:36:44.668 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.650+0000 7f7d96a20800 1 Processor -- start 2024-09-22T08:36:44.668 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.650+0000 7f7d96a20800 1 -- start start 2024-09-22T08:36:44.668 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.650+0000 7f7d96a20800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bce90727d0 0x55bce916cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:44.668 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.650+0000 7f7d96a20800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55bce9079ab0 con 0x55bce90727d0 2024-09-22T08:36:44.668 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.650+0000 7f7d94511640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bce90727d0 0x55bce916cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:44.668 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.650+0000 7f7d94511640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bce90727d0 0x55bce916cb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:38680/0 (socket says 172.21.15.142:38680) 2024-09-22T08:36:44.668 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.650+0000 7f7d94511640 1 -- 172.21.15.142:0/3226409080 learned_addr learned my addr 172.21.15.142:0/3226409080 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:44.669 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.650+0000 7f7d94511640 1 -- 172.21.15.142:0/3226409080 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bce916d0f0 con 0x55bce90727d0 2024-09-22T08:36:44.669 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.651+0000 7f7d94511640 1 --2- 172.21.15.142:0/3226409080 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bce90727d0 0x55bce916cb90 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x55bce8fe6ce0 tx=0x7f7d840040e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:44.669 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.651+0000 7f7c80e09640 1 -- 172.21.15.142:0/3226409080 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d84012030 con 0x55bce90727d0 2024-09-22T08:36:44.669 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.651+0000 7f7c80e09640 1 -- 172.21.15.142:0/3226409080 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d8401a7a0 con 0x55bce90727d0 2024-09-22T08:36:44.669 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.651+0000 7f7d96a20800 1 -- 172.21.15.142:0/3226409080 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bce916d380 con 0x55bce90727d0 2024-09-22T08:36:44.669 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.651+0000 7f7c80e09640 1 -- 172.21.15.142:0/3226409080 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d8401aaa0 con 0x55bce90727d0 2024-09-22T08:36:44.669 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.651+0000 7f7d96a20800 1 -- 172.21.15.142:0/3226409080 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bce916dd80 con 0x55bce90727d0 2024-09-22T08:36:44.669 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.652+0000 7f7c80e09640 1 -- 172.21.15.142:0/3226409080 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f7d84015020 con 0x55bce90727d0 2024-09-22T08:36:44.669 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.652+0000 7f7c80e09640 1 --2- 172.21.15.142:0/3226409080 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f7c7c03d000 0x7f7c7c03f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:44.669 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.652+0000 7f7c80e09640 1 -- 172.21.15.142:0/3226409080 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f7d84020070 con 0x55bce90727d0 2024-09-22T08:36:44.669 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.652+0000 7f7d8bfff640 1 --2- 172.21.15.142:0/3226409080 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f7c7c03d000 0x7f7c7c03f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:44.669 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.652+0000 7f7d96a20800 1 --2- 172.21.15.142:0/3226409080 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55bce9073be0 0x55bce91741e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:44.669 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.652+0000 7f7d96a20800 1 -- 172.21.15.142:0/3226409080 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55bce916e970 con 0x55bce9073be0 2024-09-22T08:36:44.670 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.652+0000 7f7d94d12640 1 --2- 172.21.15.142:0/3226409080 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55bce9073be0 0x55bce91741e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:44.670 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.652+0000 7f7d8bfff640 1 --2- 172.21.15.142:0/3226409080 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f7c7c03d000 0x7f7c7c03f4c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x55bce9071f10 tx=0x7f7d7c050000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:44.670 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.653+0000 7f7d94d12640 1 --2- 172.21.15.142:0/3226409080 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55bce9073be0 0x55bce91741e0 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:44.670 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.653+0000 7f7d94d12640 1 -- 172.21.15.142:0/3226409080 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7d8c00a4d0 con 0x55bce9073be0 2024-09-22T08:36:44.670 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.653+0000 7f7d96a20800 1 -- 172.21.15.142:0/3226409080 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55bce916e260 con 0x55bce9073be0 2024-09-22T08:36:44.670 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.653+0000 7f7d94d12640 1 -- 172.21.15.142:0/3226409080 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7d8c00a4d0 con 0x55bce9073be0 2024-09-22T08:36:44.670 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.653+0000 7f7d96a20800 1 --2- 172.21.15.142:0/3226409080 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55bce91766d0 0x55bce9178ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:44.670 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.653+0000 7f7d96a20800 1 -- 172.21.15.142:0/3226409080 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:3 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55bce9179190 con 0x55bce91766d0 2024-09-22T08:36:44.670 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.653+0000 7f7d94511640 1 --2- 172.21.15.142:0/3226409080 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55bce91766d0 0x55bce9178ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:44.671 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.653+0000 7f7d94511640 1 --2- 172.21.15.142:0/3226409080 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55bce91766d0 0x55bce9178ac0 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:44.671 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.654+0000 7f7d94511640 1 -- 172.21.15.142:0/3226409080 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(3 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f7d84018950 con 0x55bce91766d0 2024-09-22T08:36:44.671 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.654+0000 7f7d96a20800 1 -- 172.21.15.142:0/3226409080 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55bce9175570 con 0x55bce9073be0 2024-09-22T08:36:44.671 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.654+0000 7f7d94d12640 1 -- 172.21.15.142:0/3226409080 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7d8c00a4d0 con 0x55bce9073be0 2024-09-22T08:36:44.671 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.654+0000 7f7d96a20800 1 -- 172.21.15.142:0/3226409080 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55bce9175a10 con 0x55bce91766d0 2024-09-22T08:36:44.671 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.654+0000 7f7d94511640 1 -- 172.21.15.142:0/3226409080 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(5 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f7d84018950 con 0x55bce91766d0 2024-09-22T08:36:44.671 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.655+0000 7f7d96a20800 1 Processor -- start 2024-09-22T08:36:44.671 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.655+0000 7f7d96a20800 1 -- start start 2024-09-22T08:36:44.671 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.655+0000 7f7d96a20800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bce9187b30 0x55bce9187f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:44.671 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.655+0000 7f7d96a20800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55bce8f6ad50 con 0x55bce9187b30 2024-09-22T08:36:44.671 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.655+0000 7f7d94d12640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bce9187b30 0x55bce9187f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:44.671 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.655+0000 7f7d94d12640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bce9187b30 0x55bce9187f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:38688/0 (socket says 172.21.15.142:38688) 2024-09-22T08:36:44.671 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.655+0000 7f7d94d12640 1 -- 172.21.15.142:0/2966830608 learned_addr learned my addr 172.21.15.142:0/2966830608 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:44.672 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.655+0000 7f7d94d12640 1 -- 172.21.15.142:0/2966830608 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bce9188590 con 0x55bce9187b30 2024-09-22T08:36:44.672 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.655+0000 7f7d94d12640 1 --2- 172.21.15.142:0/2966830608 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bce9187b30 0x55bce9187f50 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x55bce916df50 tx=0x7f7d8c0167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:44.672 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.656+0000 7f7c79ffb640 1 -- 172.21.15.142:0/2966830608 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d8c013640 con 0x55bce9187b30 2024-09-22T08:36:44.672 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.656+0000 7f7c79ffb640 1 -- 172.21.15.142:0/2966830608 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d8c0137e0 con 0x55bce9187b30 2024-09-22T08:36:44.672 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.656+0000 7f7d96a20800 1 -- 172.21.15.142:0/2966830608 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bce9188dc0 con 0x55bce9187b30 2024-09-22T08:36:44.672 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.656+0000 7f7c79ffb640 1 -- 172.21.15.142:0/2966830608 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d8c013ac0 con 0x55bce9187b30 2024-09-22T08:36:44.672 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.656+0000 7f7d96a20800 1 -- 172.21.15.142:0/2966830608 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bce9189360 con 0x55bce9187b30 2024-09-22T08:36:44.672 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.656+0000 7f7c79ffb640 1 -- 172.21.15.142:0/2966830608 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f7d8c011040 con 0x55bce9187b30 2024-09-22T08:36:44.672 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.657+0000 7f7c79ffb640 1 --2- 172.21.15.142:0/2966830608 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f7c6c03d000 0x7f7c6c03f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:44.672 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.657+0000 7f7c79ffb640 1 -- 172.21.15.142:0/2966830608 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f7d8c00e040 con 0x55bce9187b30 2024-09-22T08:36:44.672 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.657+0000 7f7d94511640 1 --2- 172.21.15.142:0/2966830608 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f7c6c03d000 0x7f7c6c03f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:44.672 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.657+0000 7f7d96a20800 1 Processor -- start 2024-09-22T08:36:44.673 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.657+0000 7f7d94511640 1 --2- 172.21.15.142:0/2966830608 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f7c6c03d000 0x7f7c6c03f4c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f7d84052c40 tx=0x7f7d8400beb0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:44.673 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.657+0000 7f7d96a20800 1 -- start start 2024-09-22T08:36:44.673 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.657+0000 7f7d96a20800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bce9194590 0x55bce9194990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:44.673 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.657+0000 7f7d96a20800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55bce9167f60 con 0x55bce9194590 2024-09-22T08:36:44.673 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.658+0000 7f7d94d12640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bce9194590 0x55bce9194990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:44.673 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.658+0000 7f7d94d12640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bce9194590 0x55bce9194990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:38700/0 (socket says 172.21.15.142:38700) 2024-09-22T08:36:44.673 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.658+0000 7f7d94d12640 1 -- 172.21.15.142:0/357962051 learned_addr learned my addr 172.21.15.142:0/357962051 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:44.673 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.658+0000 7f7d94d12640 1 -- 172.21.15.142:0/357962051 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bce9194f80 con 0x55bce9194590 2024-09-22T08:36:44.673 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.658+0000 7f7d94d12640 1 --2- 172.21.15.142:0/357962051 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bce9194590 0x55bce9194990 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f7d8c054890 tx=0x7f7d8c013f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e125c36d6809676 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:44.673 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.658+0000 7f7c737fe640 1 -- 172.21.15.142:0/357962051 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d8c044030 con 0x55bce9194590 2024-09-22T08:36:44.674 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.658+0000 7f7c737fe640 1 -- 172.21.15.142:0/357962051 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d8c021e20 con 0x55bce9194590 2024-09-22T08:36:44.674 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.658+0000 7f7c737fe640 1 -- 172.21.15.142:0/357962051 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d8c021a90 con 0x55bce9194590 2024-09-22T08:36:44.674 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.659+0000 7f7d96a20800 1 -- 172.21.15.142:0/357962051 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bce9194590 msgr2=0x55bce9194990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:44.674 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.659+0000 7f7d96a20800 1 --2- 172.21.15.142:0/357962051 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bce9194590 0x55bce9194990 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f7d8c054890 tx=0x7f7d8c013f00 comp rx=0 tx=0).stop 2024-09-22T08:36:44.674 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.659+0000 7f7d96a20800 1 -- 172.21.15.142:0/357962051 shutdown_connections 2024-09-22T08:36:44.674 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.659+0000 7f7d96a20800 1 --2- 172.21.15.142:0/357962051 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bce9194590 0x55bce9194990 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:44.674 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.659+0000 7f7d96a20800 1 -- 172.21.15.142:0/357962051 >> 172.21.15.142:0/357962051 conn(0x55bce91909b0 msgr2=0x55bce918ebf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:44.674 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.659+0000 7f7d96a20800 1 -- 172.21.15.142:0/357962051 shutdown_connections 2024-09-22T08:36:44.674 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.659+0000 7f7d96a20800 1 -- 172.21.15.142:0/357962051 wait complete. 2024-09-22T08:36:44.674 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.659+0000 7f7d96a20800 1 Processor -- start 2024-09-22T08:36:44.674 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.659+0000 7f7d96a20800 1 -- start start 2024-09-22T08:36:44.674 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.659+0000 7f7d96a20800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bce9194590 0x55bce919bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:44.675 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.659+0000 7f7d96a20800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55bce91955a0 con 0x55bce9194590 2024-09-22T08:36:44.675 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.659+0000 7f7d94d12640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bce9194590 0x55bce919bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:44.675 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.659+0000 7f7d94d12640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bce9194590 0x55bce919bbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:38714/0 (socket says 172.21.15.142:38714) 2024-09-22T08:36:44.675 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.659+0000 7f7d94d12640 1 -- 172.21.15.142:0/790787824 learned_addr learned my addr 172.21.15.142:0/790787824 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:44.675 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.660+0000 7f7d94d12640 1 -- 172.21.15.142:0/790787824 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bce919c140 con 0x55bce9194590 2024-09-22T08:36:44.675 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.660+0000 7f7d94d12640 1 --2- 172.21.15.142:0/790787824 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bce9194590 0x55bce919bbe0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f7d8c0547c0 tx=0x7f7d8c0547f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:44.675 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.660+0000 7f7c71ffb640 1 -- 172.21.15.142:0/790787824 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d8c01fa90 con 0x55bce9194590 2024-09-22T08:36:44.675 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.660+0000 7f7c71ffb640 1 -- 172.21.15.142:0/790787824 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d8c01fc30 con 0x55bce9194590 2024-09-22T08:36:44.675 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.660+0000 7f7c71ffb640 1 -- 172.21.15.142:0/790787824 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d8c01f500 con 0x55bce9194590 2024-09-22T08:36:44.675 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.660+0000 7f7d96a20800 1 -- 172.21.15.142:0/790787824 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bce919c3d0 con 0x55bce9194590 2024-09-22T08:36:44.675 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.660+0000 7f7d96a20800 1 -- 172.21.15.142:0/790787824 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bce919cf60 con 0x55bce9194590 2024-09-22T08:36:44.675 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.661+0000 7f7c71ffb640 1 -- 172.21.15.142:0/790787824 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f7d8c01f6c0 con 0x55bce9194590 2024-09-22T08:36:44.676 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.661+0000 7f7c71ffb640 1 --2- 172.21.15.142:0/790787824 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f7c6403d000 0x7f7c6403f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:44.676 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.661+0000 7f7c71ffb640 1 -- 172.21.15.142:0/790787824 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f7d8c017450 con 0x55bce9194590 2024-09-22T08:36:44.676 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.661+0000 7f7d94511640 1 --2- 172.21.15.142:0/790787824 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f7c6403d000 0x7f7c6403f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:44.676 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.661+0000 7f7d96a20800 20 rados->read ofs=0 len=0 2024-09-22T08:36:44.676 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.661+0000 7f7d96a20800 1 --2- 172.21.15.142:0/790787824 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55bce91a73b0 0x55bce91a9870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:44.676 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.661+0000 7f7d96a20800 1 -- 172.21.15.142:0/790787824 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55bce91a9fc0 con 0x55bce91a73b0 2024-09-22T08:36:44.676 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.661+0000 7f7d8bfff640 1 --2- 172.21.15.142:0/790787824 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55bce91a73b0 0x55bce91a9870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:44.676 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.661+0000 7f7d94511640 1 --2- 172.21.15.142:0/790787824 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f7c6403d000 0x7f7c6403f4c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f7d8400efd0 tx=0x7f7d8404f000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:44.676 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.662+0000 7f7d8bfff640 1 --2- 172.21.15.142:0/790787824 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55bce91a73b0 0x55bce91a9870 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:44.676 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.662+0000 7f7d8bfff640 1 -- 172.21.15.142:0/790787824 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7d7c061430 con 0x55bce91a73b0 2024-09-22T08:36:44.676 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.662+0000 7f7d96a20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:44.677 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.662+0000 7f7d96a20800 20 realm 2024-09-22T08:36:44.677 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.662+0000 7f7d96a20800 20 rados->read ofs=0 len=0 2024-09-22T08:36:44.677 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.662+0000 7f7d96a20800 1 -- 172.21.15.142:0/790787824 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55bce91aa390 con 0x55bce91a73b0 2024-09-22T08:36:44.677 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.662+0000 7f7d8bfff640 1 -- 172.21.15.142:0/790787824 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7d7c061430 con 0x55bce91a73b0 2024-09-22T08:36:44.677 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.662+0000 7f7d96a20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:44.677 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.662+0000 7f7d96a20800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:36:44.677 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.662+0000 7f7d96a20800 20 rados->read ofs=0 len=0 2024-09-22T08:36:44.677 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.662+0000 7f7d96a20800 1 -- 172.21.15.142:0/790787824 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55bce91aac60 con 0x55bce91a73b0 2024-09-22T08:36:44.677 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.662+0000 7f7d8bfff640 1 -- 172.21.15.142:0/790787824 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7d7c061430 con 0x55bce91a73b0 2024-09-22T08:36:44.677 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.662+0000 7f7d96a20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:44.677 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.662+0000 7f7d96a20800 20 rados->read ofs=0 len=0 2024-09-22T08:36:44.677 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.662+0000 7f7d96a20800 1 -- 172.21.15.142:0/790787824 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55bce91ab000 con 0x55bce91a73b0 2024-09-22T08:36:44.677 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.662+0000 7f7d8bfff640 1 -- 172.21.15.142:0/790787824 <== osd.1 v2:172.21.15.142:6816/3192108003 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7d7c061430 con 0x55bce91a73b0 2024-09-22T08:36:44.677 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.662+0000 7f7d96a20800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:36:44.678 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.662+0000 7f7d96a20800 20 rados->read ofs=0 len=0 2024-09-22T08:36:44.678 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.663+0000 7f7d96a20800 1 --2- 172.21.15.142:0/790787824 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55bce91abab0 0x55bce91adea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:44.678 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.663+0000 7f7d96a20800 1 -- 172.21.15.142:0/790787824 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55bce91ae600 con 0x55bce91abab0 2024-09-22T08:36:44.678 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.663+0000 7f7d94d12640 1 --2- 172.21.15.142:0/790787824 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55bce91abab0 0x55bce91adea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:44.678 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.663+0000 7f7d94d12640 1 --2- 172.21.15.142:0/790787824 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55bce91abab0 0x55bce91adea0 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:44.678 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.663+0000 7f7d94d12640 1 -- 172.21.15.142:0/790787824 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(5 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f7d8c053020 con 0x55bce91abab0 2024-09-22T08:36:44.678 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.663+0000 7f7d96a20800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:36:44.678 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.663+0000 7f7d96a20800 20 searching for the correct realm 2024-09-22T08:36:44.678 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.663+0000 7f7d96a20800 1 -- 172.21.15.142:0/790787824 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55bce91affe0 con 0x55bce91abab0 2024-09-22T08:36:44.678 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.663+0000 7f7d94d12640 1 -- 172.21.15.142:0/790787824 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d8c053020 con 0x55bce91abab0 2024-09-22T08:36:44.678 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.663+0000 7f7d94d12640 1 --2- 172.21.15.142:0/790787824 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f7d8c03c3f0 0x7f7d8c03d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:44.678 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.663+0000 7f7d94d12640 1 -- 172.21.15.142:0/790787824 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55bce91affe0 con 0x7f7d8c03c3f0 2024-09-22T08:36:44.679 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.663+0000 7f7d94511640 1 --2- 172.21.15.142:0/790787824 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f7d8c03c3f0 0x7f7d8c03d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:44.679 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.664+0000 7f7d94511640 1 --2- 172.21.15.142:0/790787824 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f7d8c03c3f0 0x7f7d8c03d7f0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:44.679 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.664+0000 7f7d94511640 1 -- 172.21.15.142:0/790787824 <== osd.2 v2:172.21.15.142:6808/279438927 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d84018950 con 0x7f7d8c03c3f0 2024-09-22T08:36:44.679 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.664+0000 7f7d94511640 1 --2- 172.21.15.142:0/790787824 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f7d84017050 0x7f7d8402c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:44.679 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.664+0000 7f7d94511640 1 -- 172.21.15.142:0/790787824 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55bce91affe0 con 0x7f7d84017050 2024-09-22T08:36:44.679 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.664+0000 7f7d8bfff640 1 --2- 172.21.15.142:0/790787824 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f7d84017050 0x7f7d8402c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:44.679 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.664+0000 7f7d8bfff640 1 --2- 172.21.15.142:0/790787824 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f7d84017050 0x7f7d8402c7d0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:44.679 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.665+0000 7f7d8bfff640 1 -- 172.21.15.142:0/790787824 <== osd.0 v2:172.21.15.31:6800/168281188 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d7c061430 con 0x7f7d84017050 2024-09-22T08:36:44.679 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.665+0000 7f7d8bfff640 1 -- 172.21.15.142:0/790787824 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55bce91affe0 con 0x55bce91a73b0 2024-09-22T08:36:44.679 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.665+0000 7f7d8bfff640 1 -- 172.21.15.142:0/790787824 <== osd.1 v2:172.21.15.142:6816/3192108003 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d7c061430 con 0x55bce91a73b0 2024-09-22T08:36:44.679 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.665+0000 7f7d8bfff640 1 -- 172.21.15.142:0/790787824 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55bce91affe0 con 0x55bce91a73b0 2024-09-22T08:36:44.679 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.665+0000 7f7d8bfff640 1 -- 172.21.15.142:0/790787824 <== osd.1 v2:172.21.15.142:6816/3192108003 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d7c061430 con 0x55bce91a73b0 2024-09-22T08:36:44.680 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.665+0000 7f7d8bfff640 1 -- 172.21.15.142:0/790787824 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f7d7c078040 con 0x7f7d84017050 2024-09-22T08:36:44.680 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.665+0000 7f7d8bfff640 1 -- 172.21.15.142:0/790787824 <== osd.0 v2:172.21.15.31:6800/168281188 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d7c061430 con 0x7f7d84017050 2024-09-22T08:36:44.680 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.665+0000 7f7d8bfff640 1 -- 172.21.15.142:0/790787824 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f7d7c078040 con 0x7f7d84017050 2024-09-22T08:36:44.680 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.666+0000 7f7d8bfff640 1 -- 172.21.15.142:0/790787824 <== osd.0 v2:172.21.15.31:6800/168281188 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d7c061430 con 0x7f7d84017050 2024-09-22T08:36:44.680 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.666+0000 7f7d8bfff640 1 -- 172.21.15.142:0/790787824 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f7d7c078040 con 0x7f7d8c03c3f0 2024-09-22T08:36:44.680 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.666+0000 7f7d94511640 1 -- 172.21.15.142:0/790787824 <== osd.2 v2:172.21.15.142:6808/279438927 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d84018950 con 0x7f7d8c03c3f0 2024-09-22T08:36:44.680 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.666+0000 7f7d94511640 1 -- 172.21.15.142:0/790787824 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f7d7c078040 con 0x55bce91abab0 2024-09-22T08:36:44.680 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.666+0000 7f7d94d12640 1 -- 172.21.15.142:0/790787824 <== osd.3 v2:172.21.15.142:6800/1064901393 3 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d8c053020 con 0x55bce91abab0 2024-09-22T08:36:44.681 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.666+0000 7f7d94d12640 1 -- 172.21.15.142:0/790787824 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f7d7c078040 con 0x55bce91a73b0 2024-09-22T08:36:44.681 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.666+0000 7f7d8bfff640 1 -- 172.21.15.142:0/790787824 <== osd.1 v2:172.21.15.142:6816/3192108003 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d7c061430 con 0x55bce91a73b0 2024-09-22T08:36:44.681 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.666+0000 7f7d8bfff640 1 -- 172.21.15.142:0/790787824 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f7d7c078040 con 0x7f7d84017050 2024-09-22T08:36:44.692 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.667+0000 7f7d8bfff640 1 -- 172.21.15.142:0/790787824 <== osd.0 v2:172.21.15.31:6800/168281188 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d7c061430 con 0x7f7d84017050 2024-09-22T08:36:44.692 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.667+0000 7f7d8bfff640 1 -- 172.21.15.142:0/790787824 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f7d7c078040 con 0x55bce91a73b0 2024-09-22T08:36:44.692 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.667+0000 7f7d8bfff640 1 -- 172.21.15.142:0/790787824 <== osd.1 v2:172.21.15.142:6816/3192108003 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d7c061430 con 0x55bce91a73b0 2024-09-22T08:36:44.693 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.667+0000 7f7d8bfff640 1 -- 172.21.15.142:0/790787824 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f7d7c078040 con 0x7f7d8c03c3f0 2024-09-22T08:36:44.693 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.667+0000 7f7d94511640 1 -- 172.21.15.142:0/790787824 <== osd.2 v2:172.21.15.142:6808/279438927 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f7d84018950 con 0x7f7d8c03c3f0 2024-09-22T08:36:44.693 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.667+0000 7f7d94511640 1 -- 172.21.15.142:0/790787824 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f7d7c078040 con 0x55bce91abab0 2024-09-22T08:36:44.693 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.668+0000 7f7d94d12640 1 -- 172.21.15.142:0/790787824 <== osd.3 v2:172.21.15.142:6800/1064901393 4 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d8c053020 con 0x55bce91abab0 2024-09-22T08:36:44.693 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.668+0000 7f7d94d12640 1 -- 172.21.15.142:0/790787824 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f7d7c078040 con 0x55bce91abab0 2024-09-22T08:36:44.693 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.668+0000 7f7d94d12640 1 -- 172.21.15.142:0/790787824 <== osd.3 v2:172.21.15.142:6800/1064901393 5 ==== osd_op_reply(20 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f7d8c053020 con 0x55bce91abab0 2024-09-22T08:36:44.693 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.668+0000 7f7d94d12640 1 -- 172.21.15.142:0/790787824 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f7d7c078040 con 0x7f7d84017050 2024-09-22T08:36:44.693 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.668+0000 7f7d8bfff640 1 -- 172.21.15.142:0/790787824 <== osd.0 v2:172.21.15.31:6800/168281188 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d7c061430 con 0x7f7d84017050 2024-09-22T08:36:44.693 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.668+0000 7f7d8bfff640 1 -- 172.21.15.142:0/790787824 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f7d7c078040 con 0x55bce91abab0 2024-09-22T08:36:44.693 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.668+0000 7f7d94d12640 1 -- 172.21.15.142:0/790787824 <== osd.3 v2:172.21.15.142:6800/1064901393 6 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d8c053020 con 0x55bce91abab0 2024-09-22T08:36:44.694 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.668+0000 7f7d94d12640 1 -- 172.21.15.142:0/790787824 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f7d7c078040 con 0x55bce91abab0 2024-09-22T08:36:44.694 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.668+0000 7f7d94d12640 1 -- 172.21.15.142:0/790787824 <== osd.3 v2:172.21.15.142:6800/1064901393 7 ==== osd_op_reply(23 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f7d8c053020 con 0x55bce91abab0 2024-09-22T08:36:44.694 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.668+0000 7f7d94d12640 1 -- 172.21.15.142:0/790787824 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f7d7c078040 con 0x55bce91a73b0 2024-09-22T08:36:44.694 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.669+0000 7f7d8bfff640 1 -- 172.21.15.142:0/790787824 <== osd.1 v2:172.21.15.142:6816/3192108003 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d7c061430 con 0x55bce91a73b0 2024-09-22T08:36:44.694 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.669+0000 7f7d8bfff640 1 -- 172.21.15.142:0/790787824 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f7d7c078040 con 0x55bce91a73b0 2024-09-22T08:36:44.694 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.669+0000 7f7d8bfff640 1 -- 172.21.15.142:0/790787824 <== osd.1 v2:172.21.15.142:6816/3192108003 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f7d7c061430 con 0x55bce91a73b0 2024-09-22T08:36:44.694 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.669+0000 7f7d8bfff640 1 -- 172.21.15.142:0/790787824 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f7d7c078040 con 0x7f7d84017050 2024-09-22T08:36:44.694 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.670+0000 7f7d8bfff640 1 -- 172.21.15.142:0/790787824 <== osd.0 v2:172.21.15.31:6800/168281188 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d7c061430 con 0x7f7d84017050 2024-09-22T08:36:44.694 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.670+0000 7f7d8bfff640 1 -- 172.21.15.142:0/790787824 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f7d7c078040 con 0x55bce91abab0 2024-09-22T08:36:44.694 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.670+0000 7f7d94d12640 1 -- 172.21.15.142:0/790787824 <== osd.3 v2:172.21.15.142:6800/1064901393 8 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d8c053020 con 0x55bce91abab0 2024-09-22T08:36:44.694 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.670+0000 7f7d94d12640 1 -- 172.21.15.142:0/790787824 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f7d7c078040 con 0x7f7d8c03c3f0 2024-09-22T08:36:44.694 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.670+0000 7f7d94511640 1 -- 172.21.15.142:0/790787824 <== osd.2 v2:172.21.15.142:6808/279438927 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d84018950 con 0x7f7d8c03c3f0 2024-09-22T08:36:44.695 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.670+0000 7f7d94511640 1 -- 172.21.15.142:0/790787824 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f7d7c078040 con 0x55bce91a73b0 2024-09-22T08:36:44.695 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.670+0000 7f7d8bfff640 1 -- 172.21.15.142:0/790787824 <== osd.1 v2:172.21.15.142:6816/3192108003 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d7c061430 con 0x55bce91a73b0 2024-09-22T08:36:44.695 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.670+0000 7f7d8bfff640 1 -- 172.21.15.142:0/790787824 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f7d7c078040 con 0x7f7d84017050 2024-09-22T08:36:44.695 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.671+0000 7f7d8bfff640 1 -- 172.21.15.142:0/790787824 <== osd.0 v2:172.21.15.31:6800/168281188 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d7c061430 con 0x7f7d84017050 2024-09-22T08:36:44.695 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.671+0000 7f7d8bfff640 1 -- 172.21.15.142:0/790787824 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f7d7c078040 con 0x55bce91abab0 2024-09-22T08:36:44.695 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.671+0000 7f7d94d12640 1 -- 172.21.15.142:0/790787824 <== osd.3 v2:172.21.15.142:6800/1064901393 9 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d8c053020 con 0x55bce91abab0 2024-09-22T08:36:44.695 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.671+0000 7f7d94d12640 1 -- 172.21.15.142:0/790787824 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f7d7c078040 con 0x7f7d84017050 2024-09-22T08:36:44.695 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.671+0000 7f7d8bfff640 1 -- 172.21.15.142:0/790787824 <== osd.0 v2:172.21.15.31:6800/168281188 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d7c061430 con 0x7f7d84017050 2024-09-22T08:36:44.695 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.671+0000 7f7d8bfff640 1 -- 172.21.15.142:0/790787824 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f7d7c078040 con 0x7f7d8c03c3f0 2024-09-22T08:36:44.695 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.671+0000 7f7d94511640 1 -- 172.21.15.142:0/790787824 <== osd.2 v2:172.21.15.142:6808/279438927 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d84018950 con 0x7f7d8c03c3f0 2024-09-22T08:36:44.696 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.671+0000 7f7d94511640 1 -- 172.21.15.142:0/790787824 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f7d7c078040 con 0x55bce91abab0 2024-09-22T08:36:44.696 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.672+0000 7f7d94d12640 1 -- 172.21.15.142:0/790787824 <== osd.3 v2:172.21.15.142:6800/1064901393 10 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d8c053020 con 0x55bce91abab0 2024-09-22T08:36:44.696 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.672+0000 7f7d94d12640 1 -- 172.21.15.142:0/790787824 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f7d7c078040 con 0x7f7d84017050 2024-09-22T08:36:44.696 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.672+0000 7f7d8bfff640 1 -- 172.21.15.142:0/790787824 <== osd.0 v2:172.21.15.31:6800/168281188 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d7c061430 con 0x7f7d84017050 2024-09-22T08:36:44.696 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.672+0000 7f7d8bfff640 1 -- 172.21.15.142:0/790787824 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f7d7c078040 con 0x55bce91a73b0 2024-09-22T08:36:44.696 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.672+0000 7f7d8bfff640 1 -- 172.21.15.142:0/790787824 <== osd.1 v2:172.21.15.142:6816/3192108003 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f7d7c061430 con 0x55bce91a73b0 2024-09-22T08:36:44.696 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.672+0000 7f7d8bfff640 1 -- 172.21.15.142:0/790787824 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f7d7c078040 con 0x7f7d8c03c3f0 2024-09-22T08:36:44.696 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.672+0000 7f7d94511640 1 -- 172.21.15.142:0/790787824 <== osd.2 v2:172.21.15.142:6808/279438927 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d84018950 con 0x7f7d8c03c3f0 2024-09-22T08:36:44.696 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.672+0000 7f7d96a20800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:36:44.696 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.672+0000 7f7d96a20800 20 RGWRados::pool_iterate: got zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec 2024-09-22T08:36:44.697 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.672+0000 7f7d96a20800 20 RGWRados::pool_iterate: got zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f 2024-09-22T08:36:44.697 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.672+0000 7f7d96a20800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:36:44.697 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.672+0000 7f7d96a20800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:36:44.697 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.672+0000 7f7d96a20800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:36:44.697 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.672+0000 7f7d96a20800 20 rados->read ofs=0 len=0 2024-09-22T08:36:44.697 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.672+0000 7f7d96a20800 1 -- 172.21.15.142:0/790787824 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55bce91af0e0 con 0x55bce91a73b0 2024-09-22T08:36:44.697 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.673+0000 7f7d8bfff640 1 -- 172.21.15.142:0/790787824 <== osd.1 v2:172.21.15.142:6816/3192108003 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7d7c061430 con 0x55bce91a73b0 2024-09-22T08:36:44.697 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.673+0000 7f7d96a20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:44.697 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.673+0000 7f7d96a20800 20 rados->read ofs=0 len=0 2024-09-22T08:36:44.697 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.673+0000 7f7d96a20800 1 -- 172.21.15.142:0/790787824 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55bce91af980 con 0x55bce91a73b0 2024-09-22T08:36:44.697 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.673+0000 7f7d8bfff640 1 -- 172.21.15.142:0/790787824 <== osd.1 v2:172.21.15.142:6816/3192108003 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7d7c061430 con 0x55bce91a73b0 2024-09-22T08:36:44.697 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.673+0000 7f7d96a20800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:36:44.698 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.673+0000 7f7d96a20800 20 rados->read ofs=0 len=0 2024-09-22T08:36:44.698 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.673+0000 7f7d96a20800 1 -- 172.21.15.142:0/790787824 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:40 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55bce91aed20 con 0x55bce91abab0 2024-09-22T08:36:44.698 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.673+0000 7f7d94d12640 1 -- 172.21.15.142:0/790787824 <== osd.3 v2:172.21.15.142:6800/1064901393 11 ==== osd_op_reply(40 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f7d8c053020 con 0x55bce91abab0 2024-09-22T08:36:44.698 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.673+0000 7f7d96a20800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:36:44.698 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.673+0000 7f7d96a20800 20 zone default found 2024-09-22T08:36:44.698 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.673+0000 7f7d96a20800 4 Realm: () 2024-09-22T08:36:44.698 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.673+0000 7f7d96a20800 4 ZoneGroup: default (d89f6f57-1007-47dd-9065-f486c7b01aec) 2024-09-22T08:36:44.698 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.673+0000 7f7d96a20800 4 Zone: default (e239248c-0bee-4e41-803a-24b288d3eb8f) 2024-09-22T08:36:44.698 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.673+0000 7f7d96a20800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:36:44.698 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.673+0000 7f7d96a20800 20 zonegroup default 2024-09-22T08:36:44.698 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.673+0000 7f7d96a20800 20 rados->read ofs=0 len=0 2024-09-22T08:36:44.698 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.673+0000 7f7d96a20800 1 -- 172.21.15.142:0/790787824 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55bce91b0960 con 0x7f7d84017050 2024-09-22T08:36:44.699 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.673+0000 7f7d8bfff640 1 -- 172.21.15.142:0/790787824 <== osd.0 v2:172.21.15.31:6800/168281188 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f7d7c061430 con 0x7f7d84017050 2024-09-22T08:36:44.699 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.674+0000 7f7d96a20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:44.699 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.674+0000 7f7d96a20800 20 rados->read ofs=0 len=0 2024-09-22T08:36:44.699 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.674+0000 7f7d96a20800 1 -- 172.21.15.142:0/790787824 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55bce91b2450 con 0x55bce91abab0 2024-09-22T08:36:44.699 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.674+0000 7f7d94d12640 1 -- 172.21.15.142:0/790787824 <== osd.3 v2:172.21.15.142:6800/1064901393 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7d8c053020 con 0x55bce91abab0 2024-09-22T08:36:44.699 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.674+0000 7f7d96a20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:44.699 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.674+0000 7f7d96a20800 20 rados->read ofs=0 len=0 2024-09-22T08:36:44.699 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.674+0000 7f7d96a20800 1 -- 172.21.15.142:0/790787824 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55bce91b2910 con 0x55bce91abab0 2024-09-22T08:36:44.699 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.674+0000 7f7d94d12640 1 -- 172.21.15.142:0/790787824 <== osd.3 v2:172.21.15.142:6800/1064901393 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7d8c053020 con 0x55bce91abab0 2024-09-22T08:36:44.699 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.674+0000 7f7d96a20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:44.699 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.674+0000 7f7d96a20800 20 started sync module instance, tier type = 2024-09-22T08:36:44.699 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.674+0000 7f7d96a20800 20 started zone id=e239248c-0bee-4e41-803a-24b288d3eb8f (name=default) with tier type = 2024-09-22T08:36:44.699 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.674+0000 7f7d96a20800 1 -- 172.21.15.142:0/790787824 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bce91b17e0 con 0x7f7d8c03c3f0 2024-09-22T08:36:44.700 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.675+0000 7f7d94511640 1 -- 172.21.15.142:0/790787824 <== osd.2 v2:172.21.15.142:6808/279438927 7 ==== osd_op_reply(44 notify.0 [create] v30'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d84018950 con 0x7f7d8c03c3f0 2024-09-22T08:36:44.700 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.675+0000 7f7d96a20800 1 -- 172.21.15.142:0/790787824 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94269853080528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bce91b3200 con 0x7f7d8c03c3f0 2024-09-22T08:36:44.700 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.675+0000 7f7d96a20800 1 -- 172.21.15.142:0/790787824 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bce91b3a50 con 0x55bce91a73b0 2024-09-22T08:36:44.700 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.676+0000 7f7d94511640 1 -- 172.21.15.142:0/790787824 <== osd.2 v2:172.21.15.142:6808/279438927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94269853080528] v30'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d84018950 con 0x7f7d8c03c3f0 2024-09-22T08:36:44.700 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.676+0000 7f7d8bfff640 1 -- 172.21.15.142:0/790787824 <== osd.1 v2:172.21.15.142:6816/3192108003 15 ==== osd_op_reply(46 notify.1 [create] v30'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d7c061430 con 0x55bce91a73b0 2024-09-22T08:36:44.700 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.676+0000 7f7d96a20800 1 -- 172.21.15.142:0/790787824 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94269853085008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bce91b3b30 con 0x55bce91a73b0 2024-09-22T08:36:44.700 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.676+0000 7f7d96a20800 1 -- 172.21.15.142:0/790787824 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bce91b45d0 con 0x55bce91abab0 2024-09-22T08:36:44.700 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.677+0000 7f7d8bfff640 1 -- 172.21.15.142:0/790787824 <== osd.1 v2:172.21.15.142:6816/3192108003 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94269853085008] v30'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d7c061430 con 0x55bce91a73b0 2024-09-22T08:36:44.700 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.677+0000 7f7d94d12640 1 -- 172.21.15.142:0/790787824 <== osd.3 v2:172.21.15.142:6800/1064901393 14 ==== osd_op_reply(48 notify.2 [create] v30'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d8c053020 con 0x55bce91abab0 2024-09-22T08:36:44.700 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.677+0000 7f7d96a20800 1 -- 172.21.15.142:0/790787824 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94269853089984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bce91b4590 con 0x55bce91abab0 2024-09-22T08:36:44.700 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.677+0000 7f7d96a20800 1 -- 172.21.15.142:0/790787824 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bce91b5060 con 0x7f7d8c03c3f0 2024-09-22T08:36:44.700 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.678+0000 7f7d94511640 1 -- 172.21.15.142:0/790787824 <== osd.2 v2:172.21.15.142:6808/279438927 9 ==== osd_op_reply(50 notify.3 [create] v30'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d84018950 con 0x7f7d8c03c3f0 2024-09-22T08:36:44.700 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.678+0000 7f7d96a20800 1 -- 172.21.15.142:0/790787824 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94269853092704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bce91b5900 con 0x7f7d8c03c3f0 2024-09-22T08:36:44.701 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.678+0000 7f7d96a20800 1 -- 172.21.15.142:0/790787824 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bce91b63d0 con 0x55bce91a73b0 2024-09-22T08:36:44.701 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.679+0000 7f7d94d12640 1 -- 172.21.15.142:0/790787824 <== osd.3 v2:172.21.15.142:6800/1064901393 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94269853089984] v30'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d8c053020 con 0x55bce91abab0 2024-09-22T08:36:44.701 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.679+0000 7f7d8bfff640 1 -- 172.21.15.142:0/790787824 <== osd.1 v2:172.21.15.142:6816/3192108003 17 ==== osd_op_reply(52 notify.4 [create] v30'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d7c061430 con 0x55bce91a73b0 2024-09-22T08:36:44.701 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.679+0000 7f7d96a20800 1 -- 172.21.15.142:0/790787824 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94269853097664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bce91b67f0 con 0x55bce91a73b0 2024-09-22T08:36:44.701 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.679+0000 7f7d96a20800 1 -- 172.21.15.142:0/790787824 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bce91b7230 con 0x7f7d84017050 2024-09-22T08:36:44.701 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.679+0000 7f7d94511640 1 -- 172.21.15.142:0/790787824 <== osd.2 v2:172.21.15.142:6808/279438927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94269853092704] v30'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d84018950 con 0x7f7d8c03c3f0 2024-09-22T08:36:44.701 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.680+0000 7f7d8bfff640 1 -- 172.21.15.142:0/790787824 <== osd.0 v2:172.21.15.31:6800/168281188 11 ==== osd_op_reply(54 notify.5 [create] v30'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d7c061430 con 0x7f7d84017050 2024-09-22T08:36:44.701 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.680+0000 7f7d96a20800 1 -- 172.21.15.142:0/790787824 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94269853101312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bce91b71f0 con 0x7f7d84017050 2024-09-22T08:36:44.701 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.680+0000 7f7d96a20800 1 -- 172.21.15.142:0/790787824 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bce91b7c40 con 0x7f7d84017050 2024-09-22T08:36:44.701 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.680+0000 7f7d8bfff640 1 -- 172.21.15.142:0/790787824 <== osd.1 v2:172.21.15.142:6816/3192108003 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94269853097664] v30'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d7c061430 con 0x55bce91a73b0 2024-09-22T08:36:44.702 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.681+0000 7f7d8bfff640 1 -- 172.21.15.142:0/790787824 <== osd.0 v2:172.21.15.31:6800/168281188 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94269853101312] v30'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d7c061430 con 0x7f7d84017050 2024-09-22T08:36:44.702 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.681+0000 7f7d8bfff640 1 -- 172.21.15.142:0/790787824 <== osd.0 v2:172.21.15.31:6800/168281188 13 ==== osd_op_reply(56 notify.6 [create] v30'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d7c061430 con 0x7f7d84017050 2024-09-22T08:36:44.702 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.681+0000 7f7d96a20800 1 -- 172.21.15.142:0/790787824 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94269853094992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bce91b7790 con 0x7f7d84017050 2024-09-22T08:36:44.702 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.682+0000 7f7d96a20800 1 -- 172.21.15.142:0/790787824 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bce91b8510 con 0x7f7d84017050 2024-09-22T08:36:44.702 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.682+0000 7f7d8bfff640 1 -- 172.21.15.142:0/790787824 <== osd.0 v2:172.21.15.31:6800/168281188 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94269853094992] v30'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d7c061430 con 0x7f7d84017050 2024-09-22T08:36:44.702 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.683+0000 7f7d8bfff640 1 -- 172.21.15.142:0/790787824 <== osd.0 v2:172.21.15.31:6800/168281188 15 ==== osd_op_reply(58 notify.7 [create] v30'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d7c061430 con 0x7f7d84017050 2024-09-22T08:36:44.702 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.683+0000 7f7d96a20800 1 -- 172.21.15.142:0/790787824 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94269853087136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bce91b8310 con 0x7f7d84017050 2024-09-22T08:36:44.702 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.683+0000 7f7d96a20800 20 add_watcher() i=0 2024-09-22T08:36:44.702 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.683+0000 7f7d96a20800 20 add_watcher() i=1 2024-09-22T08:36:44.702 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.683+0000 7f7d96a20800 20 add_watcher() i=2 2024-09-22T08:36:44.702 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.683+0000 7f7d96a20800 20 add_watcher() i=3 2024-09-22T08:36:44.702 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.683+0000 7f7d96a20800 20 add_watcher() i=4 2024-09-22T08:36:44.702 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.683+0000 7f7d96a20800 20 add_watcher() i=5 2024-09-22T08:36:44.703 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.683+0000 7f7d96a20800 20 add_watcher() i=6 2024-09-22T08:36:44.703 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.684+0000 7f7d8bfff640 1 -- 172.21.15.142:0/790787824 <== osd.0 v2:172.21.15.31:6800/168281188 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94269853087136] v30'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d7c061430 con 0x7f7d84017050 2024-09-22T08:36:44.703 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.684+0000 7f7d96a20800 20 add_watcher() i=7 2024-09-22T08:36:44.703 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.684+0000 7f7d96a20800 2 all 8 watchers are set, enabling cache 2024-09-22T08:36:44.703 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.684+0000 7f7d96a20800 1 -- 172.21.15.142:0/790787824 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55bce91bb5d0 con 0x55bce91a73b0 2024-09-22T08:36:44.703 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.684+0000 7f7d8bfff640 1 -- 172.21.15.142:0/790787824 <== osd.1 v2:172.21.15.142:6816/3192108003 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f7d7c061430 con 0x55bce91a73b0 2024-09-22T08:36:44.703 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.684+0000 7f7d96a20800 1 -- 172.21.15.142:0/790787824 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94269853118288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bce91b8200 con 0x55bce91a73b0 2024-09-22T08:36:44.703 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.685+0000 7f7d8bfff640 1 -- 172.21.15.142:0/790787824 <== osd.1 v2:172.21.15.142:6816/3192108003 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94269853118288] v30'80 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7d7c061430 con 0x55bce91a73b0 2024-09-22T08:36:44.703 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.685+0000 7f7c4afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:36:44.703 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.686+0000 7f7d96a20800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:36:44.704 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.686+0000 7f7d96a20800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:36:44.704 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.686+0000 7f7d96a20800 5 note: GC not initialized 2024-09-22T08:36:44.704 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.686+0000 7f7c49fe3640 20 reqs_thread_entry: start 2024-09-22T08:36:44.704 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.686+0000 7f7d96a20800 20 init_complete bucket index max shards: 11 2024-09-22T08:36:44.704 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.686+0000 7f7d96a20800 20 Filter name: none 2024-09-22T08:36:44.704 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.686+0000 7f7c42ffd640 20 reqs_thread_entry: start 2024-09-22T08:36:44.704 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.686+0000 7f7d96a20800 20 rados->read ofs=0 len=0 2024-09-22T08:36:44.704 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.686+0000 7f7d96a20800 1 -- 172.21.15.142:0/790787824 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55bce91ee520 con 0x55bce91a73b0 2024-09-22T08:36:44.704 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.687+0000 7f7d8bfff640 1 -- 172.21.15.142:0/790787824 <== osd.1 v2:172.21.15.142:6816/3192108003 21 ==== osd_op_reply(62 foo [call out=48b,read 0~673 out=673b,getxattrs out=75b] v0'0 uv8 ondisk = 0) ==== 231+0+796 (crc 0 0 0) 0x7f7d7c061430 con 0x55bce91a73b0 2024-09-22T08:36:44.704 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.687+0000 7f7d96a20800 20 rados_obj.operate() r=0 bl.length=673 2024-09-22T08:36:44.705 INFO:teuthology.orchestra.run.smithi142.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"},{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-22T08:36:42.661297Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"},{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true,"create_date":"2024-09-22T08:36:44.553654Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-22T08:36:42.661288Z","tags":[],"group_ids":[]} 2024-09-22T08:36:44.710 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.688+0000 7f7c4afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:36:44.710 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.688+0000 7f7d96a20800 1 -- 172.21.15.142:0/790787824 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94269853118288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bce91b96d0 con 0x55bce91a73b0 2024-09-22T08:36:44.710 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.688+0000 7f7d8bfff640 1 -- 172.21.15.142:0/790787824 <== osd.1 v2:172.21.15.142:6816/3192108003 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94269853118288] v30'81 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7d7c061430 con 0x55bce91a73b0 2024-09-22T08:36:44.710 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.689+0000 7f7d96a20800 1 -- 172.21.15.142:0/790787824 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94269853080528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bce91baf50 con 0x7f7d8c03c3f0 2024-09-22T08:36:44.710 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.689+0000 7f7d94511640 1 -- 172.21.15.142:0/790787824 <== osd.2 v2:172.21.15.142:6808/279438927 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94269853080528] v30'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d84018950 con 0x7f7d8c03c3f0 2024-09-22T08:36:44.710 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.689+0000 7f7d96a20800 20 remove_watcher() i=0 2024-09-22T08:36:44.711 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.689+0000 7f7d96a20800 2 removed watcher, disabling cache 2024-09-22T08:36:44.711 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.689+0000 7f7d96a20800 1 -- 172.21.15.142:0/790787824 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94269853085008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bce91b1bd0 con 0x55bce91a73b0 2024-09-22T08:36:44.711 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.690+0000 7f7d8bfff640 1 -- 172.21.15.142:0/790787824 <== osd.1 v2:172.21.15.142:6816/3192108003 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94269853085008] v30'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d7c061430 con 0x55bce91a73b0 2024-09-22T08:36:44.711 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.690+0000 7f7d96a20800 20 remove_watcher() i=1 2024-09-22T08:36:44.711 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.691+0000 7f7d96a20800 1 -- 172.21.15.142:0/790787824 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94269853089984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bce91b1bd0 con 0x55bce91abab0 2024-09-22T08:36:44.711 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.691+0000 7f7d94d12640 1 -- 172.21.15.142:0/790787824 <== osd.3 v2:172.21.15.142:6800/1064901393 16 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94269853089984] v30'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d8c053020 con 0x55bce91abab0 2024-09-22T08:36:44.711 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.691+0000 7f7d96a20800 20 remove_watcher() i=2 2024-09-22T08:36:44.711 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.691+0000 7f7d96a20800 1 -- 172.21.15.142:0/790787824 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94269853092704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bce91b1bd0 con 0x7f7d8c03c3f0 2024-09-22T08:36:44.711 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.692+0000 7f7d94511640 1 -- 172.21.15.142:0/790787824 <== osd.2 v2:172.21.15.142:6808/279438927 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94269853092704] v30'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d84018950 con 0x7f7d8c03c3f0 2024-09-22T08:36:44.712 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.692+0000 7f7d96a20800 20 remove_watcher() i=3 2024-09-22T08:36:44.712 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.692+0000 7f7d96a20800 1 -- 172.21.15.142:0/790787824 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94269853097664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bce91b4b60 con 0x55bce91a73b0 2024-09-22T08:36:44.712 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.693+0000 7f7d8bfff640 1 -- 172.21.15.142:0/790787824 <== osd.1 v2:172.21.15.142:6816/3192108003 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94269853097664] v30'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d7c061430 con 0x55bce91a73b0 2024-09-22T08:36:44.712 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.693+0000 7f7d96a20800 20 remove_watcher() i=4 2024-09-22T08:36:44.712 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.693+0000 7f7d96a20800 1 -- 172.21.15.142:0/790787824 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94269853101312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bce91b1bd0 con 0x7f7d84017050 2024-09-22T08:36:44.712 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.694+0000 7f7d8bfff640 1 -- 172.21.15.142:0/790787824 <== osd.0 v2:172.21.15.31:6800/168281188 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94269853101312] v30'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d7c061430 con 0x7f7d84017050 2024-09-22T08:36:44.712 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.694+0000 7f7d96a20800 20 remove_watcher() i=5 2024-09-22T08:36:44.712 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.694+0000 7f7d96a20800 1 -- 172.21.15.142:0/790787824 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94269853094992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bce91b5ec0 con 0x7f7d84017050 2024-09-22T08:36:44.712 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.695+0000 7f7d8bfff640 1 -- 172.21.15.142:0/790787824 <== osd.0 v2:172.21.15.31:6800/168281188 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94269853094992] v30'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d7c061430 con 0x7f7d84017050 2024-09-22T08:36:44.712 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.695+0000 7f7d96a20800 20 remove_watcher() i=6 2024-09-22T08:36:44.713 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.695+0000 7f7d96a20800 1 -- 172.21.15.142:0/790787824 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94269853087136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bce91b4b60 con 0x7f7d84017050 2024-09-22T08:36:44.713 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.696+0000 7f7d8bfff640 1 -- 172.21.15.142:0/790787824 <== osd.0 v2:172.21.15.31:6800/168281188 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94269853087136] v30'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d7c061430 con 0x7f7d84017050 2024-09-22T08:36:44.713 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.696+0000 7f7d96a20800 20 remove_watcher() i=7 2024-09-22T08:36:44.713 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.697+0000 7f7d96a20800 1 -- 172.21.15.142:0/790787824 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f7d84017050 msgr2=0x7f7d8402c7d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:44.713 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.697+0000 7f7d96a20800 1 --2- 172.21.15.142:0/790787824 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f7d84017050 0x7f7d8402c7d0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:44.713 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.697+0000 7f7d96a20800 1 -- 172.21.15.142:0/790787824 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55bce91a73b0 msgr2=0x55bce91a9870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:44.713 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.697+0000 7f7d96a20800 1 --2- 172.21.15.142:0/790787824 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55bce91a73b0 0x55bce91a9870 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:44.713 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.697+0000 7f7d96a20800 1 -- 172.21.15.142:0/790787824 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f7d8c03c3f0 msgr2=0x7f7d8c03d7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:44.713 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.697+0000 7f7d96a20800 1 --2- 172.21.15.142:0/790787824 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f7d8c03c3f0 0x7f7d8c03d7f0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:44.713 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.697+0000 7f7d96a20800 1 -- 172.21.15.142:0/790787824 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55bce91abab0 msgr2=0x55bce91adea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:44.713 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.697+0000 7f7d96a20800 1 --2- 172.21.15.142:0/790787824 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55bce91abab0 0x55bce91adea0 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:44.713 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.697+0000 7f7d96a20800 1 -- 172.21.15.142:0/790787824 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f7c6403d000 msgr2=0x7f7c6403f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:44.713 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.697+0000 7f7d96a20800 1 --2- 172.21.15.142:0/790787824 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f7c6403d000 0x7f7c6403f4c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f7d8400efd0 tx=0x7f7d8404f000 comp rx=0 tx=0).stop 2024-09-22T08:36:44.714 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.697+0000 7f7d96a20800 1 -- 172.21.15.142:0/790787824 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bce9194590 msgr2=0x55bce919bbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:44.714 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.697+0000 7f7d8bfff640 1 -- 172.21.15.142:0/790787824 reap_dead start 2024-09-22T08:36:44.714 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.697+0000 7f7d96a20800 1 --2- 172.21.15.142:0/790787824 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bce9194590 0x55bce919bbe0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f7d8c0547c0 tx=0x7f7d8c0547f0 comp rx=0 tx=0).stop 2024-09-22T08:36:44.714 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.697+0000 7f7d96a20800 1 -- 172.21.15.142:0/790787824 shutdown_connections 2024-09-22T08:36:44.714 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.697+0000 7f7d96a20800 1 --2- 172.21.15.142:0/790787824 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bce9194590 0x55bce919bbe0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:44.714 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.697+0000 7f7d96a20800 1 -- 172.21.15.142:0/790787824 >> 172.21.15.142:0/790787824 conn(0x55bce91909b0 msgr2=0x55bce918ebc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:44.714 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.697+0000 7f7d96a20800 1 -- 172.21.15.142:0/790787824 shutdown_connections 2024-09-22T08:36:44.714 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.697+0000 7f7d96a20800 1 -- 172.21.15.142:0/790787824 wait complete. 2024-09-22T08:36:44.714 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.697+0000 7f7d96a20800 1 -- 172.21.15.142:0/2966830608 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f7c6c03d000 msgr2=0x7f7c6c03f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:44.714 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.697+0000 7f7d96a20800 1 --2- 172.21.15.142:0/2966830608 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f7c6c03d000 0x7f7c6c03f4c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f7d84052c40 tx=0x7f7d8400beb0 comp rx=0 tx=0).stop 2024-09-22T08:36:44.714 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.697+0000 7f7d96a20800 1 -- 172.21.15.142:0/2966830608 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bce9187b30 msgr2=0x55bce9187f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:44.714 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.697+0000 7f7d96a20800 1 --2- 172.21.15.142:0/2966830608 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bce9187b30 0x55bce9187f50 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x55bce916df50 tx=0x7f7d8c0167b0 comp rx=0 tx=0).stop 2024-09-22T08:36:44.715 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.697+0000 7f7d96a20800 1 -- 172.21.15.142:0/2966830608 shutdown_connections 2024-09-22T08:36:44.715 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.697+0000 7f7d96a20800 1 --2- 172.21.15.142:0/2966830608 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f7c6c03d000 0x7f7c6c03f4c0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:44.715 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.697+0000 7f7d96a20800 1 --2- 172.21.15.142:0/2966830608 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bce9187b30 0x55bce9187f50 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:44.715 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.697+0000 7f7d96a20800 1 -- 172.21.15.142:0/2966830608 >> 172.21.15.142:0/2966830608 conn(0x55bce917bee0 msgr2=0x55bce917c2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:44.715 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.697+0000 7f7d96a20800 1 -- 172.21.15.142:0/2966830608 shutdown_connections 2024-09-22T08:36:44.715 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.697+0000 7f7d96a20800 1 -- 172.21.15.142:0/2966830608 wait complete. 2024-09-22T08:36:44.715 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.698+0000 7f7d96a20800 1 -- 172.21.15.142:0/3226409080 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55bce9073be0 msgr2=0x55bce91741e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:44.715 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.698+0000 7f7d96a20800 1 --2- 172.21.15.142:0/3226409080 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55bce9073be0 0x55bce91741e0 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:44.715 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.698+0000 7f7d96a20800 1 -- 172.21.15.142:0/3226409080 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55bce91766d0 msgr2=0x55bce9178ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:44.715 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.698+0000 7f7d96a20800 1 --2- 172.21.15.142:0/3226409080 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55bce91766d0 0x55bce9178ac0 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:44.715 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.698+0000 7f7d96a20800 1 -- 172.21.15.142:0/3226409080 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f7c7c03d000 msgr2=0x7f7c7c03f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:44.715 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.698+0000 7f7d96a20800 1 --2- 172.21.15.142:0/3226409080 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f7c7c03d000 0x7f7c7c03f4c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x55bce9071f10 tx=0x7f7d7c050000 comp rx=0 tx=0).stop 2024-09-22T08:36:44.715 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.698+0000 7f7d96a20800 1 -- 172.21.15.142:0/3226409080 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bce90727d0 msgr2=0x55bce916cb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:44.716 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.698+0000 7f7d96a20800 1 --2- 172.21.15.142:0/3226409080 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bce90727d0 0x55bce916cb90 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x55bce8fe6ce0 tx=0x7f7d840040e0 comp rx=0 tx=0).stop 2024-09-22T08:36:44.716 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.698+0000 7f7d96a20800 1 -- 172.21.15.142:0/3226409080 shutdown_connections 2024-09-22T08:36:44.716 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.698+0000 7f7d96a20800 1 --2- 172.21.15.142:0/3226409080 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55bce91766d0 0x55bce9178ac0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:44.716 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.698+0000 7f7d96a20800 1 --2- 172.21.15.142:0/3226409080 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55bce9073be0 0x55bce91741e0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:44.716 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.698+0000 7f7d96a20800 1 --2- 172.21.15.142:0/3226409080 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f7c7c03d000 0x7f7c7c03f4c0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:44.716 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.698+0000 7f7d96a20800 1 --2- 172.21.15.142:0/3226409080 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bce90727d0 0x55bce916cb90 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:44.716 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.698+0000 7f7d96a20800 1 -- 172.21.15.142:0/3226409080 >> 172.21.15.142:0/3226409080 conn(0x55bce906dba0 msgr2=0x55bce915bee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:44.716 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.698+0000 7f7d96a20800 1 -- 172.21.15.142:0/3226409080 shutdown_connections 2024-09-22T08:36:44.716 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.698+0000 7f7d96a20800 1 -- 172.21.15.142:0/3226409080 wait complete. 2024-09-22T08:36:44.716 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-22T08:36:42.661297Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}, {'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True, 'create_date': '2024-09-22T08:36:44.553654Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-22T08:36:42.661288Z', 'tags': [], 'group_ids': []} 2024-09-22T08:36:44.717 INFO:tasks.util.rgw:rgwadmin: client.0 : ['key', 'rm', '--subuser', 'foo:foo1', '--key-type', 'swift'] 2024-09-22T08:36:44.717 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'key', 'rm', '--subuser', 'foo:foo1', '--key-type', 'swift'] 2024-09-22T08:36:44.717 DEBUG:teuthology.orchestra.run.smithi142:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph key rm --subuser foo:foo1 --key-type swift 2024-09-22T08:36:44.765 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:36:44.766 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:36:44.766 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.765+0000 7fa384f28800 1 Processor -- start 2024-09-22T08:36:44.766 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.765+0000 7fa384f28800 1 -- start start 2024-09-22T08:36:44.767 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.765+0000 7fa384f28800 1 --2- >> v2:172.21.15.31:3300/0 conn(0x558d10b6c080 0x558d10b6e470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:44.767 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.765+0000 7fa384f28800 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x558d109f6a20 con 0x558d10b6e9b0 2024-09-22T08:36:44.767 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.765+0000 7fa384f28800 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x558d109f67d0 con 0x558d10b6c080 2024-09-22T08:36:44.767 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.766+0000 7fa380c6f640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x558d10b6c080 0x558d10b6e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:44.767 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.766+0000 7fa37846e640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x558d10b6e9b0 0x558d10b70da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.142:42444/0 (socket says 172.21.15.142:42444) 2024-09-22T08:36:44.767 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.766+0000 7fa37846e640 1 -- 172.21.15.142:0/259609060 learned_addr learned my addr 172.21.15.142:0/259609060 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-09-22T08:36:44.768 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.766+0000 7fa380c6f640 1 --2- 172.21.15.142:0/259609060 >> v2:172.21.15.31:3300/0 conn(0x558d10b6c080 0x558d10b6e470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:38716/0 (socket says 172.21.15.142:38716) 2024-09-22T08:36:44.768 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.766+0000 7fa380c6f640 1 -- 172.21.15.142:0/259609060 >> v1:172.21.15.31:6789/0 conn(0x558d10b6e9b0 legacy=0x558d10b70da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:44.768 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.766+0000 7fa380c6f640 1 -- 172.21.15.142:0/259609060 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x558d10b73560 con 0x558d10b6c080 2024-09-22T08:36:44.770 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.768+0000 7fa380c6f640 1 --2- 172.21.15.142:0/259609060 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558d10b6c080 0x558d10b6e470 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fa37000a470 tx=0x7fa370045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ec530fe4d13cce0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:44.770 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.768+0000 7fa37bfff640 1 -- 172.21.15.142:0/259609060 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa370053570 con 0x558d10b6c080 2024-09-22T08:36:44.770 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.768+0000 7fa37bfff640 1 -- 172.21.15.142:0/259609060 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa370058070 con 0x558d10b6c080 2024-09-22T08:36:44.770 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.768+0000 7fa37bfff640 1 -- 172.21.15.142:0/259609060 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa370053880 con 0x558d10b6c080 2024-09-22T08:36:44.770 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.768+0000 7fa384f28800 1 -- 172.21.15.142:0/259609060 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558d10b6c080 msgr2=0x558d10b6e470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:44.770 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.768+0000 7fa384f28800 1 --2- 172.21.15.142:0/259609060 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558d10b6c080 0x558d10b6e470 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fa37000a470 tx=0x7fa370045a20 comp rx=0 tx=0).stop 2024-09-22T08:36:44.770 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.768+0000 7fa384f28800 1 -- 172.21.15.142:0/259609060 shutdown_connections 2024-09-22T08:36:44.770 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.768+0000 7fa384f28800 1 --2- 172.21.15.142:0/259609060 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558d10b6c080 0x558d10b6e470 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:44.770 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.768+0000 7fa384f28800 1 -- 172.21.15.142:0/259609060 >> 172.21.15.142:0/259609060 conn(0x558d10b65be0 msgr2=0x558d10b68020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:44.770 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.768+0000 7fa384f28800 1 -- 172.21.15.142:0/259609060 shutdown_connections 2024-09-22T08:36:44.771 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.769+0000 7fa384f28800 1 -- 172.21.15.142:0/259609060 wait complete. 2024-09-22T08:36:44.784 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.782+0000 7fa384f28800 1 Processor -- start 2024-09-22T08:36:44.784 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.782+0000 7fa384f28800 1 -- start start 2024-09-22T08:36:44.784 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.782+0000 7fa384f28800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558d10b6c080 0x558d10c5afe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:44.784 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.782+0000 7fa384f28800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x558d10a03dd0 con 0x558d10b6c080 2024-09-22T08:36:44.785 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.783+0000 7fa380c6f640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558d10b6c080 0x558d10c5afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:44.785 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.783+0000 7fa380c6f640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558d10b6c080 0x558d10c5afe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:38732/0 (socket says 172.21.15.142:38732) 2024-09-22T08:36:44.785 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.783+0000 7fa380c6f640 1 -- 172.21.15.142:0/1343469673 learned_addr learned my addr 172.21.15.142:0/1343469673 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:44.785 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.783+0000 7fa380c6f640 1 -- 172.21.15.142:0/1343469673 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558d10c5b5d0 con 0x558d10b6c080 2024-09-22T08:36:44.785 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.783+0000 7fa380c6f640 1 --2- 172.21.15.142:0/1343469673 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558d10b6c080 0x558d10c5afe0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fa370025c20 tx=0x7fa370051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e8beb54addf4907 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:44.785 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.784+0000 7fa26ee0d640 1 -- 172.21.15.142:0/1343469673 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa370053a20 con 0x558d10b6c080 2024-09-22T08:36:44.785 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.784+0000 7fa26ee0d640 1 -- 172.21.15.142:0/1343469673 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa370063070 con 0x558d10b6c080 2024-09-22T08:36:44.786 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.784+0000 7fa26ee0d640 1 -- 172.21.15.142:0/1343469673 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa370053cf0 con 0x558d10b6c080 2024-09-22T08:36:44.788 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.784+0000 7fa384f28800 1 -- 172.21.15.142:0/1343469673 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558d10b6c080 msgr2=0x558d10c5afe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:44.788 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.784+0000 7fa384f28800 1 --2- 172.21.15.142:0/1343469673 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558d10b6c080 0x558d10c5afe0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fa370025c20 tx=0x7fa370051000 comp rx=0 tx=0).stop 2024-09-22T08:36:44.788 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.784+0000 7fa384f28800 1 -- 172.21.15.142:0/1343469673 shutdown_connections 2024-09-22T08:36:44.788 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.784+0000 7fa384f28800 1 --2- 172.21.15.142:0/1343469673 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558d10b6c080 0x558d10c5afe0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:44.788 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.784+0000 7fa384f28800 1 -- 172.21.15.142:0/1343469673 >> 172.21.15.142:0/1343469673 conn(0x558d10b65be0 msgr2=0x558d10c56960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:44.788 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.784+0000 7fa384f28800 1 -- 172.21.15.142:0/1343469673 shutdown_connections 2024-09-22T08:36:44.788 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.784+0000 7fa384f28800 1 -- 172.21.15.142:0/1343469673 wait complete. 2024-09-22T08:36:44.788 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.785+0000 7fa384f28800 1 Processor -- start 2024-09-22T08:36:44.788 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.785+0000 7fa384f28800 1 -- start start 2024-09-22T08:36:44.788 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.785+0000 7fa384f28800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558d10b6c080 0x558d10c62ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:44.788 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.785+0000 7fa384f28800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x558d10b72850 con 0x558d10b6c080 2024-09-22T08:36:44.788 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.785+0000 7fa380c6f640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558d10b6c080 0x558d10c62ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:44.789 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.785+0000 7fa380c6f640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558d10b6c080 0x558d10c62ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:38734/0 (socket says 172.21.15.142:38734) 2024-09-22T08:36:44.789 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.785+0000 7fa380c6f640 1 -- 172.21.15.142:0/1224855341 learned_addr learned my addr 172.21.15.142:0/1224855341 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:44.789 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.785+0000 7fa380c6f640 1 -- 172.21.15.142:0/1224855341 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558d10c63040 con 0x558d10b6c080 2024-09-22T08:36:44.789 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.786+0000 7fa380c6f640 1 --2- 172.21.15.142:0/1224855341 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558d10b6c080 0x558d10c62ae0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fa370025c20 tx=0x7fa370002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:44.789 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.786+0000 7fa26d60a640 1 -- 172.21.15.142:0/1224855341 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa370068660 con 0x558d10b6c080 2024-09-22T08:36:44.789 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.786+0000 7fa26d60a640 1 -- 172.21.15.142:0/1224855341 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa370068800 con 0x558d10b6c080 2024-09-22T08:36:44.789 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.786+0000 7fa26d60a640 1 -- 172.21.15.142:0/1224855341 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa370068ae0 con 0x558d10b6c080 2024-09-22T08:36:44.789 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.786+0000 7fa384f28800 1 -- 172.21.15.142:0/1224855341 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558d10c632d0 con 0x558d10b6c080 2024-09-22T08:36:44.789 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.786+0000 7fa384f28800 1 -- 172.21.15.142:0/1224855341 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558d10c63ee0 con 0x558d10b6c080 2024-09-22T08:36:44.789 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.787+0000 7fa26d60a640 1 -- 172.21.15.142:0/1224855341 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fa370068c80 con 0x558d10b6c080 2024-09-22T08:36:44.794 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.787+0000 7fa26d60a640 1 --2- 172.21.15.142:0/1224855341 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fa26803cfb0 0x7fa26803f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:44.794 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.787+0000 7fa26d60a640 1 -- 172.21.15.142:0/1224855341 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fa370098c30 con 0x558d10b6c080 2024-09-22T08:36:44.794 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.787+0000 7fa37846e640 1 --2- 172.21.15.142:0/1224855341 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fa26803cfb0 0x7fa26803f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:44.794 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.787+0000 7fa384f28800 1 --2- 172.21.15.142:0/1224855341 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x558d10b6e9b0 0x558d10c6a130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:44.795 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.787+0000 7fa384f28800 1 -- 172.21.15.142:0/1224855341 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558d10c6a670 con 0x558d10b6e9b0 2024-09-22T08:36:44.795 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.787+0000 7fa381470640 1 --2- 172.21.15.142:0/1224855341 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x558d10b6e9b0 0x558d10c6a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:44.795 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.788+0000 7fa37846e640 1 --2- 172.21.15.142:0/1224855341 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fa26803cfb0 0x7fa26803f470 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fa368001d70 tx=0x7fa3680012d0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:44.795 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.788+0000 7fa381470640 1 --2- 172.21.15.142:0/1224855341 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x558d10b6e9b0 0x558d10c6a130 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:44.795 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.788+0000 7fa381470640 1 -- 172.21.15.142:0/1224855341 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa37c00a4d0 con 0x558d10b6e9b0 2024-09-22T08:36:44.795 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.788+0000 7fa384f28800 1 -- 172.21.15.142:0/1224855341 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558d10c6aa10 con 0x558d10b6e9b0 2024-09-22T08:36:44.795 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.788+0000 7fa381470640 1 -- 172.21.15.142:0/1224855341 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa37c00a4d0 con 0x558d10b6e9b0 2024-09-22T08:36:44.795 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.788+0000 7fa384f28800 1 --2- 172.21.15.142:0/1224855341 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x558d10c6c4d0 0x558d10c6e970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:44.795 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.788+0000 7fa384f28800 1 -- 172.21.15.142:0/1224855341 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:3 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558d10c6f100 con 0x558d10c6c4d0 2024-09-22T08:36:44.795 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.788+0000 7fa380c6f640 1 --2- 172.21.15.142:0/1224855341 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x558d10c6c4d0 0x558d10c6e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:44.795 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.789+0000 7fa380c6f640 1 --2- 172.21.15.142:0/1224855341 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x558d10c6c4d0 0x558d10c6e970 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:44.796 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.789+0000 7fa380c6f640 1 -- 172.21.15.142:0/1224855341 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(3 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fa370051070 con 0x558d10c6c4d0 2024-09-22T08:36:44.796 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.789+0000 7fa384f28800 1 -- 172.21.15.142:0/1224855341 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558d10c6b260 con 0x558d10b6e9b0 2024-09-22T08:36:44.796 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.789+0000 7fa381470640 1 -- 172.21.15.142:0/1224855341 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa37c00a4d0 con 0x558d10b6e9b0 2024-09-22T08:36:44.796 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.789+0000 7fa384f28800 1 -- 172.21.15.142:0/1224855341 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558d10c6b640 con 0x558d10c6c4d0 2024-09-22T08:36:44.796 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.790+0000 7fa380c6f640 1 -- 172.21.15.142:0/1224855341 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(5 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fa370051070 con 0x558d10c6c4d0 2024-09-22T08:36:44.796 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.790+0000 7fa384f28800 1 Processor -- start 2024-09-22T08:36:44.796 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.790+0000 7fa384f28800 1 -- start start 2024-09-22T08:36:44.796 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.790+0000 7fa384f28800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558d10b6b840 0x558d10b6a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:44.796 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.790+0000 7fa384f28800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x558d10a62d50 con 0x558d10b6b840 2024-09-22T08:36:44.796 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.790+0000 7fa381470640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558d10b6b840 0x558d10b6a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:44.796 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.790+0000 7fa381470640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558d10b6b840 0x558d10b6a0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:38746/0 (socket says 172.21.15.142:38746) 2024-09-22T08:36:44.797 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.790+0000 7fa381470640 1 -- 172.21.15.142:0/2992885428 learned_addr learned my addr 172.21.15.142:0/2992885428 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:44.797 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.791+0000 7fa381470640 1 -- 172.21.15.142:0/2992885428 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558d10b6bd60 con 0x558d10b6b840 2024-09-22T08:36:44.797 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.791+0000 7fa381470640 1 --2- 172.21.15.142:0/2992885428 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558d10b6b840 0x558d10b6a0b0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x558d10c63ae0 tx=0x7fa37c0167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:44.797 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.791+0000 7fa2667fc640 1 -- 172.21.15.142:0/2992885428 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa37c013640 con 0x558d10b6b840 2024-09-22T08:36:44.797 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.791+0000 7fa2667fc640 1 -- 172.21.15.142:0/2992885428 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa37c0137e0 con 0x558d10b6b840 2024-09-22T08:36:44.797 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.791+0000 7fa384f28800 1 -- 172.21.15.142:0/2992885428 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558d10b6a5f0 con 0x558d10b6b840 2024-09-22T08:36:44.797 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.791+0000 7fa2667fc640 1 -- 172.21.15.142:0/2992885428 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa37c013ae0 con 0x558d10b6b840 2024-09-22T08:36:44.797 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.791+0000 7fa384f28800 1 -- 172.21.15.142:0/2992885428 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558d10b6ab90 con 0x558d10b6b840 2024-09-22T08:36:44.797 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.792+0000 7fa2667fc640 1 -- 172.21.15.142:0/2992885428 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fa37c011040 con 0x558d10b6b840 2024-09-22T08:36:44.798 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.792+0000 7fa2667fc640 1 --2- 172.21.15.142:0/2992885428 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fa25803cfb0 0x7fa25803f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:44.798 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.792+0000 7fa2667fc640 1 -- 172.21.15.142:0/2992885428 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fa37c00e040 con 0x558d10b6b840 2024-09-22T08:36:44.798 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.792+0000 7fa380c6f640 1 --2- 172.21.15.142:0/2992885428 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fa25803cfb0 0x7fa25803f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:44.798 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.792+0000 7fa384f28800 1 Processor -- start 2024-09-22T08:36:44.798 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.792+0000 7fa384f28800 1 -- start start 2024-09-22T08:36:44.798 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.792+0000 7fa380c6f640 1 --2- 172.21.15.142:0/2992885428 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fa25803cfb0 0x7fa25803f470 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x558d10c64be0 tx=0x7fa37005da60 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:44.798 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.792+0000 7fa384f28800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558d10c8c720 0x558d10c8cb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:44.798 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.792+0000 7fa384f28800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x558d10c5b9a0 con 0x558d10c8c720 2024-09-22T08:36:44.798 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.793+0000 7fa381470640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558d10c8c720 0x558d10c8cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:44.798 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.793+0000 7fa381470640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558d10c8c720 0x558d10c8cb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:38756/0 (socket says 172.21.15.142:38756) 2024-09-22T08:36:44.799 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.793+0000 7fa381470640 1 -- 172.21.15.142:0/3876425692 learned_addr learned my addr 172.21.15.142:0/3876425692 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:44.799 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.793+0000 7fa381470640 1 -- 172.21.15.142:0/3876425692 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558d10c8d110 con 0x558d10c8c720 2024-09-22T08:36:44.799 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.793+0000 7fa381470640 1 --2- 172.21.15.142:0/3876425692 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558d10c8c720 0x558d10c8cb20 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fa37c054840 tx=0x7fa37c020460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3b78c7d9ff63e6f server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:44.799 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.793+0000 7fa257fff640 1 -- 172.21.15.142:0/3876425692 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa37c0143c0 con 0x558d10c8c720 2024-09-22T08:36:44.799 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.793+0000 7fa257fff640 1 -- 172.21.15.142:0/3876425692 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa37c052070 con 0x558d10c8c720 2024-09-22T08:36:44.799 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.793+0000 7fa257fff640 1 -- 172.21.15.142:0/3876425692 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa37c021910 con 0x558d10c8c720 2024-09-22T08:36:44.815 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.794+0000 7fa384f28800 1 -- 172.21.15.142:0/3876425692 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558d10c8c720 msgr2=0x558d10c8cb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:44.815 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.794+0000 7fa384f28800 1 --2- 172.21.15.142:0/3876425692 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558d10c8c720 0x558d10c8cb20 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fa37c054840 tx=0x7fa37c020460 comp rx=0 tx=0).stop 2024-09-22T08:36:44.815 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.794+0000 7fa384f28800 1 -- 172.21.15.142:0/3876425692 shutdown_connections 2024-09-22T08:36:44.815 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.794+0000 7fa384f28800 1 --2- 172.21.15.142:0/3876425692 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558d10c8c720 0x558d10c8cb20 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:44.815 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.794+0000 7fa384f28800 1 -- 172.21.15.142:0/3876425692 >> 172.21.15.142:0/3876425692 conn(0x558d10c88b20 msgr2=0x558d10c86d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:44.815 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.794+0000 7fa384f28800 1 -- 172.21.15.142:0/3876425692 shutdown_connections 2024-09-22T08:36:44.815 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.794+0000 7fa384f28800 1 -- 172.21.15.142:0/3876425692 wait complete. 2024-09-22T08:36:44.815 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.794+0000 7fa384f28800 1 Processor -- start 2024-09-22T08:36:44.815 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.794+0000 7fa384f28800 1 -- start start 2024-09-22T08:36:44.816 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.794+0000 7fa384f28800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558d10c8c720 0x558d10c93cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:44.816 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.794+0000 7fa384f28800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x558d10c8d730 con 0x558d10c8c720 2024-09-22T08:36:44.816 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.794+0000 7fa381470640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558d10c8c720 0x558d10c93cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:44.816 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.794+0000 7fa381470640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558d10c8c720 0x558d10c93cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:38758/0 (socket says 172.21.15.142:38758) 2024-09-22T08:36:44.816 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.794+0000 7fa381470640 1 -- 172.21.15.142:0/1459273945 learned_addr learned my addr 172.21.15.142:0/1459273945 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:44.816 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.795+0000 7fa381470640 1 -- 172.21.15.142:0/1459273945 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558d10c94250 con 0x558d10c8c720 2024-09-22T08:36:44.816 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.795+0000 7fa381470640 1 --2- 172.21.15.142:0/1459273945 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558d10c8c720 0x558d10c93cf0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fa37c01ff70 tx=0x7fa37c0547d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:44.816 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.795+0000 7fa2567fc640 1 -- 172.21.15.142:0/1459273945 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa37c021910 con 0x558d10c8c720 2024-09-22T08:36:44.816 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.795+0000 7fa2567fc640 1 -- 172.21.15.142:0/1459273945 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa37c053270 con 0x558d10c8c720 2024-09-22T08:36:44.816 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.795+0000 7fa384f28800 1 -- 172.21.15.142:0/1459273945 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558d10c944e0 con 0x558d10c8c720 2024-09-22T08:36:44.816 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.795+0000 7fa2567fc640 1 -- 172.21.15.142:0/1459273945 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa37c021ab0 con 0x558d10c8c720 2024-09-22T08:36:44.816 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.795+0000 7fa384f28800 1 -- 172.21.15.142:0/1459273945 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558d10c94e60 con 0x558d10c8c720 2024-09-22T08:36:44.816 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.796+0000 7fa2567fc640 1 -- 172.21.15.142:0/1459273945 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fa37c045a10 con 0x558d10c8c720 2024-09-22T08:36:44.817 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.796+0000 7fa2567fc640 1 --2- 172.21.15.142:0/1459273945 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fa24c03cfb0 0x7fa24c03f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:44.817 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.796+0000 7fa2567fc640 1 -- 172.21.15.142:0/1459273945 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fa37c04c030 con 0x558d10c8c720 2024-09-22T08:36:44.817 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.796+0000 7fa380c6f640 1 --2- 172.21.15.142:0/1459273945 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fa24c03cfb0 0x7fa24c03f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:44.817 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.797+0000 7fa380c6f640 1 --2- 172.21.15.142:0/1459273945 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fa24c03cfb0 0x7fa24c03f470 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fa370097430 tx=0x7fa370089000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:44.817 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.797+0000 7fa384f28800 20 rados->read ofs=0 len=0 2024-09-22T08:36:44.817 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.797+0000 7fa384f28800 1 --2- 172.21.15.142:0/1459273945 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x558d10c9f670 0x558d10ca1b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:44.817 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.797+0000 7fa384f28800 1 -- 172.21.15.142:0/1459273945 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558d10ca2280 con 0x558d10c9f670 2024-09-22T08:36:44.817 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.797+0000 7fa37846e640 1 --2- 172.21.15.142:0/1459273945 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x558d10c9f670 0x558d10ca1b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:44.817 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.797+0000 7fa37846e640 1 --2- 172.21.15.142:0/1459273945 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x558d10c9f670 0x558d10ca1b30 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:44.817 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.797+0000 7fa37846e640 1 -- 172.21.15.142:0/1459273945 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa368009050 con 0x558d10c9f670 2024-09-22T08:36:44.817 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.797+0000 7fa384f28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:44.817 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.797+0000 7fa384f28800 20 realm 2024-09-22T08:36:44.817 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.797+0000 7fa384f28800 20 rados->read ofs=0 len=0 2024-09-22T08:36:44.817 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.797+0000 7fa384f28800 1 -- 172.21.15.142:0/1459273945 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558d10c9e9c0 con 0x558d10c9f670 2024-09-22T08:36:44.818 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.798+0000 7fa37846e640 1 -- 172.21.15.142:0/1459273945 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa368009050 con 0x558d10c9f670 2024-09-22T08:36:44.818 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.798+0000 7fa384f28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:44.818 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.798+0000 7fa384f28800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:36:44.818 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.798+0000 7fa384f28800 20 rados->read ofs=0 len=0 2024-09-22T08:36:44.818 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.798+0000 7fa384f28800 1 -- 172.21.15.142:0/1459273945 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558d10ca2d70 con 0x558d10c9f670 2024-09-22T08:36:44.818 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.798+0000 7fa37846e640 1 -- 172.21.15.142:0/1459273945 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa368009050 con 0x558d10c9f670 2024-09-22T08:36:44.818 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.798+0000 7fa384f28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:44.818 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.798+0000 7fa384f28800 20 rados->read ofs=0 len=0 2024-09-22T08:36:44.818 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.798+0000 7fa384f28800 1 -- 172.21.15.142:0/1459273945 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558d10ca3640 con 0x558d10c9f670 2024-09-22T08:36:44.818 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.798+0000 7fa37846e640 1 -- 172.21.15.142:0/1459273945 <== osd.1 v2:172.21.15.142:6816/3192108003 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa368009050 con 0x558d10c9f670 2024-09-22T08:36:44.818 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.798+0000 7fa384f28800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:36:44.818 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.798+0000 7fa384f28800 20 rados->read ofs=0 len=0 2024-09-22T08:36:44.819 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.798+0000 7fa384f28800 1 --2- 172.21.15.142:0/1459273945 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x558d10ca4060 0x558d10ca6450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:44.819 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.798+0000 7fa384f28800 1 -- 172.21.15.142:0/1459273945 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558d10ca6b90 con 0x558d10ca4060 2024-09-22T08:36:44.819 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.798+0000 7fa381470640 1 --2- 172.21.15.142:0/1459273945 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x558d10ca4060 0x558d10ca6450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:44.819 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.798+0000 7fa381470640 1 --2- 172.21.15.142:0/1459273945 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x558d10ca4060 0x558d10ca6450 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:44.819 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.799+0000 7fa381470640 1 -- 172.21.15.142:0/1459273945 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(5 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fa37c03a070 con 0x558d10ca4060 2024-09-22T08:36:44.819 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.799+0000 7fa384f28800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:36:44.819 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.799+0000 7fa384f28800 20 searching for the correct realm 2024-09-22T08:36:44.819 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.799+0000 7fa384f28800 1 -- 172.21.15.142:0/1459273945 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558d10ca84c0 con 0x558d10ca4060 2024-09-22T08:36:44.819 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.799+0000 7fa381470640 1 -- 172.21.15.142:0/1459273945 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa37c03a070 con 0x558d10ca4060 2024-09-22T08:36:44.819 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.799+0000 7fa381470640 1 --2- 172.21.15.142:0/1459273945 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7fa37c04d4b0 0x7fa37c04d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:44.819 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.799+0000 7fa381470640 1 -- 172.21.15.142:0/1459273945 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558d10ca84c0 con 0x7fa37c04d4b0 2024-09-22T08:36:44.819 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.799+0000 7fa380c6f640 1 --2- 172.21.15.142:0/1459273945 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7fa37c04d4b0 0x7fa37c04d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:44.819 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.799+0000 7fa380c6f640 1 --2- 172.21.15.142:0/1459273945 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7fa37c04d4b0 0x7fa37c04d8b0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:44.820 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.800+0000 7fa380c6f640 1 -- 172.21.15.142:0/1459273945 <== osd.2 v2:172.21.15.142:6808/279438927 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa370051070 con 0x7fa37c04d4b0 2024-09-22T08:36:44.820 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.800+0000 7fa380c6f640 1 --2- 172.21.15.142:0/1459273945 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7fa3700a5040 0x7fa370074480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:44.820 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.800+0000 7fa380c6f640 1 -- 172.21.15.142:0/1459273945 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558d10ca84c0 con 0x7fa3700a5040 2024-09-22T08:36:44.820 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.800+0000 7fa37846e640 1 --2- 172.21.15.142:0/1459273945 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7fa3700a5040 0x7fa370074480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:44.820 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.800+0000 7fa37846e640 1 --2- 172.21.15.142:0/1459273945 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7fa3700a5040 0x7fa370074480 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:44.820 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.800+0000 7fa37846e640 1 -- 172.21.15.142:0/1459273945 <== osd.0 v2:172.21.15.31:6800/168281188 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa368009050 con 0x7fa3700a5040 2024-09-22T08:36:44.820 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.800+0000 7fa37846e640 1 -- 172.21.15.142:0/1459273945 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558d10ca84c0 con 0x558d10c9f670 2024-09-22T08:36:44.820 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.801+0000 7fa37846e640 1 -- 172.21.15.142:0/1459273945 <== osd.1 v2:172.21.15.142:6816/3192108003 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa368009050 con 0x558d10c9f670 2024-09-22T08:36:44.820 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.801+0000 7fa37846e640 1 -- 172.21.15.142:0/1459273945 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558d10ca84c0 con 0x558d10c9f670 2024-09-22T08:36:44.820 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.801+0000 7fa37846e640 1 -- 172.21.15.142:0/1459273945 <== osd.1 v2:172.21.15.142:6816/3192108003 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa368029040 con 0x558d10c9f670 2024-09-22T08:36:44.820 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.801+0000 7fa37846e640 1 -- 172.21.15.142:0/1459273945 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558d10ca84c0 con 0x7fa3700a5040 2024-09-22T08:36:44.820 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.801+0000 7fa37846e640 1 -- 172.21.15.142:0/1459273945 <== osd.0 v2:172.21.15.31:6800/168281188 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa368029040 con 0x7fa3700a5040 2024-09-22T08:36:44.820 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.801+0000 7fa37846e640 1 -- 172.21.15.142:0/1459273945 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558d10ca84c0 con 0x7fa3700a5040 2024-09-22T08:36:44.820 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.801+0000 7fa37846e640 1 -- 172.21.15.142:0/1459273945 <== osd.0 v2:172.21.15.31:6800/168281188 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa368029040 con 0x7fa3700a5040 2024-09-22T08:36:44.821 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.801+0000 7fa37846e640 1 -- 172.21.15.142:0/1459273945 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558d10ca84c0 con 0x7fa37c04d4b0 2024-09-22T08:36:44.821 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.802+0000 7fa380c6f640 1 -- 172.21.15.142:0/1459273945 <== osd.2 v2:172.21.15.142:6808/279438927 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa370051070 con 0x7fa37c04d4b0 2024-09-22T08:36:44.821 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.802+0000 7fa380c6f640 1 -- 172.21.15.142:0/1459273945 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558d10ca84c0 con 0x558d10ca4060 2024-09-22T08:36:44.821 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.802+0000 7fa381470640 1 -- 172.21.15.142:0/1459273945 <== osd.3 v2:172.21.15.142:6800/1064901393 3 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa37c03a070 con 0x558d10ca4060 2024-09-22T08:36:44.821 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.802+0000 7fa381470640 1 -- 172.21.15.142:0/1459273945 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558d10ca84c0 con 0x558d10c9f670 2024-09-22T08:36:44.821 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.802+0000 7fa37846e640 1 -- 172.21.15.142:0/1459273945 <== osd.1 v2:172.21.15.142:6816/3192108003 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa368029040 con 0x558d10c9f670 2024-09-22T08:36:44.821 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.802+0000 7fa37846e640 1 -- 172.21.15.142:0/1459273945 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558d10ca84c0 con 0x7fa3700a5040 2024-09-22T08:36:44.821 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.802+0000 7fa37846e640 1 -- 172.21.15.142:0/1459273945 <== osd.0 v2:172.21.15.31:6800/168281188 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa368029040 con 0x7fa3700a5040 2024-09-22T08:36:44.821 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.802+0000 7fa37846e640 1 -- 172.21.15.142:0/1459273945 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558d10ca84c0 con 0x558d10c9f670 2024-09-22T08:36:44.821 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.803+0000 7fa37846e640 1 -- 172.21.15.142:0/1459273945 <== osd.1 v2:172.21.15.142:6816/3192108003 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa368029040 con 0x558d10c9f670 2024-09-22T08:36:44.821 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.803+0000 7fa37846e640 1 -- 172.21.15.142:0/1459273945 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558d10ca84c0 con 0x7fa37c04d4b0 2024-09-22T08:36:44.821 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.803+0000 7fa380c6f640 1 -- 172.21.15.142:0/1459273945 <== osd.2 v2:172.21.15.142:6808/279438927 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fa370051070 con 0x7fa37c04d4b0 2024-09-22T08:36:44.821 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.803+0000 7fa380c6f640 1 -- 172.21.15.142:0/1459273945 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558d10ca84c0 con 0x558d10ca4060 2024-09-22T08:36:44.822 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.803+0000 7fa381470640 1 -- 172.21.15.142:0/1459273945 <== osd.3 v2:172.21.15.142:6800/1064901393 4 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa37c03a070 con 0x558d10ca4060 2024-09-22T08:36:44.822 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.803+0000 7fa381470640 1 -- 172.21.15.142:0/1459273945 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558d10ca84c0 con 0x558d10ca4060 2024-09-22T08:36:44.822 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.803+0000 7fa381470640 1 -- 172.21.15.142:0/1459273945 <== osd.3 v2:172.21.15.142:6800/1064901393 5 ==== osd_op_reply(20 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fa37c03a070 con 0x558d10ca4060 2024-09-22T08:36:44.822 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.803+0000 7fa381470640 1 -- 172.21.15.142:0/1459273945 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558d10ca84c0 con 0x7fa3700a5040 2024-09-22T08:36:44.822 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.804+0000 7fa37846e640 1 -- 172.21.15.142:0/1459273945 <== osd.0 v2:172.21.15.31:6800/168281188 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa368029040 con 0x7fa3700a5040 2024-09-22T08:36:44.822 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.804+0000 7fa37846e640 1 -- 172.21.15.142:0/1459273945 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558d10ca84c0 con 0x558d10ca4060 2024-09-22T08:36:44.822 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.804+0000 7fa381470640 1 -- 172.21.15.142:0/1459273945 <== osd.3 v2:172.21.15.142:6800/1064901393 6 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa37c03a070 con 0x558d10ca4060 2024-09-22T08:36:44.822 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.804+0000 7fa381470640 1 -- 172.21.15.142:0/1459273945 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558d10ca84c0 con 0x558d10ca4060 2024-09-22T08:36:44.822 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.804+0000 7fa381470640 1 -- 172.21.15.142:0/1459273945 <== osd.3 v2:172.21.15.142:6800/1064901393 7 ==== osd_op_reply(23 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fa37c03a070 con 0x558d10ca4060 2024-09-22T08:36:44.822 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.804+0000 7fa381470640 1 -- 172.21.15.142:0/1459273945 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558d10ca84c0 con 0x558d10c9f670 2024-09-22T08:36:44.822 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.804+0000 7fa37846e640 1 -- 172.21.15.142:0/1459273945 <== osd.1 v2:172.21.15.142:6816/3192108003 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa368029040 con 0x558d10c9f670 2024-09-22T08:36:44.823 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.804+0000 7fa37846e640 1 -- 172.21.15.142:0/1459273945 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558d10ca84c0 con 0x558d10c9f670 2024-09-22T08:36:44.823 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.804+0000 7fa37846e640 1 -- 172.21.15.142:0/1459273945 <== osd.1 v2:172.21.15.142:6816/3192108003 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fa368029040 con 0x558d10c9f670 2024-09-22T08:36:44.823 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.804+0000 7fa37846e640 1 -- 172.21.15.142:0/1459273945 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558d10ca84c0 con 0x7fa3700a5040 2024-09-22T08:36:44.823 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.805+0000 7fa37846e640 1 -- 172.21.15.142:0/1459273945 <== osd.0 v2:172.21.15.31:6800/168281188 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa368029040 con 0x7fa3700a5040 2024-09-22T08:36:44.823 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.805+0000 7fa37846e640 1 -- 172.21.15.142:0/1459273945 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558d10ca84c0 con 0x558d10ca4060 2024-09-22T08:36:44.823 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.805+0000 7fa381470640 1 -- 172.21.15.142:0/1459273945 <== osd.3 v2:172.21.15.142:6800/1064901393 8 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa37c03a070 con 0x558d10ca4060 2024-09-22T08:36:44.823 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.805+0000 7fa381470640 1 -- 172.21.15.142:0/1459273945 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558d10ca84c0 con 0x7fa37c04d4b0 2024-09-22T08:36:44.823 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.805+0000 7fa380c6f640 1 -- 172.21.15.142:0/1459273945 <== osd.2 v2:172.21.15.142:6808/279438927 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa370051070 con 0x7fa37c04d4b0 2024-09-22T08:36:44.823 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.805+0000 7fa380c6f640 1 -- 172.21.15.142:0/1459273945 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558d10ca84c0 con 0x558d10c9f670 2024-09-22T08:36:44.823 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.805+0000 7fa37846e640 1 -- 172.21.15.142:0/1459273945 <== osd.1 v2:172.21.15.142:6816/3192108003 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa368029040 con 0x558d10c9f670 2024-09-22T08:36:44.823 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.805+0000 7fa37846e640 1 -- 172.21.15.142:0/1459273945 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558d10ca84c0 con 0x7fa3700a5040 2024-09-22T08:36:44.823 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.806+0000 7fa37846e640 1 -- 172.21.15.142:0/1459273945 <== osd.0 v2:172.21.15.31:6800/168281188 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa368029040 con 0x7fa3700a5040 2024-09-22T08:36:44.823 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.806+0000 7fa37846e640 1 -- 172.21.15.142:0/1459273945 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558d10ca84c0 con 0x558d10ca4060 2024-09-22T08:36:44.824 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.806+0000 7fa381470640 1 -- 172.21.15.142:0/1459273945 <== osd.3 v2:172.21.15.142:6800/1064901393 9 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa37c03a070 con 0x558d10ca4060 2024-09-22T08:36:44.824 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.806+0000 7fa381470640 1 -- 172.21.15.142:0/1459273945 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558d10ca84c0 con 0x7fa3700a5040 2024-09-22T08:36:44.824 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.806+0000 7fa37846e640 1 -- 172.21.15.142:0/1459273945 <== osd.0 v2:172.21.15.31:6800/168281188 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa368029040 con 0x7fa3700a5040 2024-09-22T08:36:44.824 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.806+0000 7fa37846e640 1 -- 172.21.15.142:0/1459273945 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558d10ca84c0 con 0x7fa37c04d4b0 2024-09-22T08:36:44.824 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.806+0000 7fa380c6f640 1 -- 172.21.15.142:0/1459273945 <== osd.2 v2:172.21.15.142:6808/279438927 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa370051070 con 0x7fa37c04d4b0 2024-09-22T08:36:44.824 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.806+0000 7fa380c6f640 1 -- 172.21.15.142:0/1459273945 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558d10ca84c0 con 0x558d10ca4060 2024-09-22T08:36:44.824 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.807+0000 7fa381470640 1 -- 172.21.15.142:0/1459273945 <== osd.3 v2:172.21.15.142:6800/1064901393 10 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa37c03a070 con 0x558d10ca4060 2024-09-22T08:36:44.824 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.807+0000 7fa381470640 1 -- 172.21.15.142:0/1459273945 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558d10ca84c0 con 0x7fa3700a5040 2024-09-22T08:36:44.824 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.807+0000 7fa37846e640 1 -- 172.21.15.142:0/1459273945 <== osd.0 v2:172.21.15.31:6800/168281188 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa368029040 con 0x7fa3700a5040 2024-09-22T08:36:44.824 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.807+0000 7fa37846e640 1 -- 172.21.15.142:0/1459273945 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558d10ca84c0 con 0x558d10c9f670 2024-09-22T08:36:44.824 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.807+0000 7fa37846e640 1 -- 172.21.15.142:0/1459273945 <== osd.1 v2:172.21.15.142:6816/3192108003 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fa368029040 con 0x558d10c9f670 2024-09-22T08:36:44.824 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.807+0000 7fa37846e640 1 -- 172.21.15.142:0/1459273945 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558d10ca84c0 con 0x7fa37c04d4b0 2024-09-22T08:36:44.824 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.807+0000 7fa380c6f640 1 -- 172.21.15.142:0/1459273945 <== osd.2 v2:172.21.15.142:6808/279438927 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa370051070 con 0x7fa37c04d4b0 2024-09-22T08:36:44.825 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.807+0000 7fa384f28800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:36:44.825 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.807+0000 7fa384f28800 20 RGWRados::pool_iterate: got zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec 2024-09-22T08:36:44.825 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.807+0000 7fa384f28800 20 RGWRados::pool_iterate: got zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f 2024-09-22T08:36:44.825 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.807+0000 7fa384f28800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:36:44.825 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.807+0000 7fa384f28800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:36:44.825 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.807+0000 7fa384f28800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:36:44.825 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.807+0000 7fa384f28800 20 rados->read ofs=0 len=0 2024-09-22T08:36:44.825 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.807+0000 7fa384f28800 1 -- 172.21.15.142:0/1459273945 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558d10ca7550 con 0x558d10c9f670 2024-09-22T08:36:44.825 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.808+0000 7fa37846e640 1 -- 172.21.15.142:0/1459273945 <== osd.1 v2:172.21.15.142:6816/3192108003 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa368029040 con 0x558d10c9f670 2024-09-22T08:36:44.825 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.808+0000 7fa384f28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:44.825 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.808+0000 7fa384f28800 20 rados->read ofs=0 len=0 2024-09-22T08:36:44.825 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.808+0000 7fa384f28800 1 -- 172.21.15.142:0/1459273945 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558d10ca7da0 con 0x558d10c9f670 2024-09-22T08:36:44.826 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.808+0000 7fa37846e640 1 -- 172.21.15.142:0/1459273945 <== osd.1 v2:172.21.15.142:6816/3192108003 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa368029040 con 0x558d10c9f670 2024-09-22T08:36:44.826 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.808+0000 7fa384f28800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:36:44.826 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.808+0000 7fa384f28800 20 rados->read ofs=0 len=0 2024-09-22T08:36:44.826 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.808+0000 7fa384f28800 1 -- 172.21.15.142:0/1459273945 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:40 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558d10ca8940 con 0x558d10ca4060 2024-09-22T08:36:44.826 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.808+0000 7fa381470640 1 -- 172.21.15.142:0/1459273945 <== osd.3 v2:172.21.15.142:6800/1064901393 11 ==== osd_op_reply(40 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fa37c03a070 con 0x558d10ca4060 2024-09-22T08:36:44.826 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.808+0000 7fa384f28800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:36:44.826 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.808+0000 7fa384f28800 20 zone default found 2024-09-22T08:36:44.826 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.808+0000 7fa384f28800 4 Realm: () 2024-09-22T08:36:44.826 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.808+0000 7fa384f28800 4 ZoneGroup: default (d89f6f57-1007-47dd-9065-f486c7b01aec) 2024-09-22T08:36:44.826 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.808+0000 7fa384f28800 4 Zone: default (e239248c-0bee-4e41-803a-24b288d3eb8f) 2024-09-22T08:36:44.826 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.808+0000 7fa384f28800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:36:44.826 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.808+0000 7fa384f28800 20 zonegroup default 2024-09-22T08:36:44.826 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.808+0000 7fa384f28800 20 rados->read ofs=0 len=0 2024-09-22T08:36:44.826 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.808+0000 7fa384f28800 1 -- 172.21.15.142:0/1459273945 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558d10ca8ce0 con 0x7fa3700a5040 2024-09-22T08:36:44.827 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.808+0000 7fa37846e640 1 -- 172.21.15.142:0/1459273945 <== osd.0 v2:172.21.15.31:6800/168281188 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fa368029040 con 0x7fa3700a5040 2024-09-22T08:36:44.827 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.808+0000 7fa384f28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:44.827 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.809+0000 7fa384f28800 20 rados->read ofs=0 len=0 2024-09-22T08:36:44.827 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.809+0000 7fa384f28800 1 -- 172.21.15.142:0/1459273945 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558d10caaf90 con 0x558d10ca4060 2024-09-22T08:36:44.827 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.809+0000 7fa381470640 1 -- 172.21.15.142:0/1459273945 <== osd.3 v2:172.21.15.142:6800/1064901393 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa37c03a070 con 0x558d10ca4060 2024-09-22T08:36:44.827 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.809+0000 7fa384f28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:44.827 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.809+0000 7fa384f28800 20 rados->read ofs=0 len=0 2024-09-22T08:36:44.827 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.809+0000 7fa384f28800 1 -- 172.21.15.142:0/1459273945 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558d10cab330 con 0x558d10ca4060 2024-09-22T08:36:44.827 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.809+0000 7fa381470640 1 -- 172.21.15.142:0/1459273945 <== osd.3 v2:172.21.15.142:6800/1064901393 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa37c03a070 con 0x558d10ca4060 2024-09-22T08:36:44.827 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.809+0000 7fa384f28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:44.827 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.809+0000 7fa384f28800 20 started sync module instance, tier type = 2024-09-22T08:36:44.827 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.809+0000 7fa384f28800 20 started zone id=e239248c-0bee-4e41-803a-24b288d3eb8f (name=default) with tier type = 2024-09-22T08:36:44.828 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.809+0000 7fa384f28800 1 -- 172.21.15.142:0/1459273945 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558d10caa420 con 0x7fa37c04d4b0 2024-09-22T08:36:44.828 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.810+0000 7fa380c6f640 1 -- 172.21.15.142:0/1459273945 <== osd.2 v2:172.21.15.142:6808/279438927 7 ==== osd_op_reply(44 notify.0 [create] v30'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa370051070 con 0x7fa37c04d4b0 2024-09-22T08:36:44.828 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.810+0000 7fa384f28800 1 -- 172.21.15.142:0/1459273945 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94064360466496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558d10caa080 con 0x7fa37c04d4b0 2024-09-22T08:36:44.828 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.810+0000 7fa384f28800 1 -- 172.21.15.142:0/1459273945 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558d10cac130 con 0x558d10c9f670 2024-09-22T08:36:44.828 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.811+0000 7fa380c6f640 1 -- 172.21.15.142:0/1459273945 <== osd.2 v2:172.21.15.142:6808/279438927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94064360466496] v30'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa370051070 con 0x7fa37c04d4b0 2024-09-22T08:36:44.828 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.811+0000 7fa37846e640 1 -- 172.21.15.142:0/1459273945 <== osd.1 v2:172.21.15.142:6816/3192108003 15 ==== osd_op_reply(46 notify.1 [create] v30'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa368029040 con 0x558d10c9f670 2024-09-22T08:36:44.828 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.811+0000 7fa384f28800 1 -- 172.21.15.142:0/1459273945 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94064360470416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558d10cac550 con 0x558d10c9f670 2024-09-22T08:36:44.828 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.811+0000 7fa384f28800 1 -- 172.21.15.142:0/1459273945 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558d10cacfa0 con 0x558d10ca4060 2024-09-22T08:36:44.828 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.813+0000 7fa381470640 1 -- 172.21.15.142:0/1459273945 <== osd.3 v2:172.21.15.142:6800/1064901393 14 ==== osd_op_reply(48 notify.2 [create] v30'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa37c03a070 con 0x558d10ca4060 2024-09-22T08:36:44.829 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.813+0000 7fa384f28800 1 -- 172.21.15.142:0/1459273945 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94064360475280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558d10cacfa0 con 0x558d10ca4060 2024-09-22T08:36:44.829 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.813+0000 7fa384f28800 1 -- 172.21.15.142:0/1459273945 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558d10cadfa0 con 0x7fa37c04d4b0 2024-09-22T08:36:44.829 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.813+0000 7fa37846e640 1 -- 172.21.15.142:0/1459273945 <== osd.1 v2:172.21.15.142:6816/3192108003 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94064360470416] v30'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa368029040 con 0x558d10c9f670 2024-09-22T08:36:44.829 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.814+0000 7fa381470640 1 -- 172.21.15.142:0/1459273945 <== osd.3 v2:172.21.15.142:6800/1064901393 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94064360475280] v30'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa37c03a070 con 0x558d10ca4060 2024-09-22T08:36:44.829 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.814+0000 7fa380c6f640 1 -- 172.21.15.142:0/1459273945 <== osd.2 v2:172.21.15.142:6808/279438927 9 ==== osd_op_reply(50 notify.3 [create] v30'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa370051070 con 0x7fa37c04d4b0 2024-09-22T08:36:44.829 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.814+0000 7fa384f28800 1 -- 172.21.15.142:0/1459273945 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94064360479376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558d10cadf60 con 0x7fa37c04d4b0 2024-09-22T08:36:44.829 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.814+0000 7fa384f28800 1 -- 172.21.15.142:0/1459273945 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558d10cae840 con 0x558d10c9f670 2024-09-22T08:36:44.834 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.815+0000 7fa37846e640 1 -- 172.21.15.142:0/1459273945 <== osd.1 v2:172.21.15.142:6816/3192108003 17 ==== osd_op_reply(52 notify.4 [create] v30'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa368029040 con 0x558d10c9f670 2024-09-22T08:36:44.834 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.815+0000 7fa380c6f640 1 -- 172.21.15.142:0/1459273945 <== osd.2 v2:172.21.15.142:6808/279438927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94064360479376] v30'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa370051070 con 0x7fa37c04d4b0 2024-09-22T08:36:44.834 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.815+0000 7fa384f28800 1 -- 172.21.15.142:0/1459273945 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94064360481680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558d10caec60 con 0x558d10c9f670 2024-09-22T08:36:44.834 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.815+0000 7fa384f28800 1 -- 172.21.15.142:0/1459273945 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558d10cad390 con 0x7fa3700a5040 2024-09-22T08:36:44.834 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.816+0000 7fa37846e640 1 -- 172.21.15.142:0/1459273945 <== osd.0 v2:172.21.15.31:6800/168281188 11 ==== osd_op_reply(54 notify.5 [create] v30'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa368029040 con 0x7fa3700a5040 2024-09-22T08:36:44.834 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.816+0000 7fa384f28800 1 -- 172.21.15.142:0/1459273945 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94064360483936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558d10caf530 con 0x7fa3700a5040 2024-09-22T08:36:44.834 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.816+0000 7fa384f28800 1 -- 172.21.15.142:0/1459273945 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558d10caff30 con 0x7fa3700a5040 2024-09-22T08:36:44.835 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.816+0000 7fa37846e640 1 -- 172.21.15.142:0/1459273945 <== osd.1 v2:172.21.15.142:6816/3192108003 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94064360481680] v30'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa368029040 con 0x558d10c9f670 2024-09-22T08:36:44.835 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.817+0000 7fa37846e640 1 -- 172.21.15.142:0/1459273945 <== osd.0 v2:172.21.15.31:6800/168281188 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94064360483936] v30'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa368029040 con 0x7fa3700a5040 2024-09-22T08:36:44.835 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.817+0000 7fa37846e640 1 -- 172.21.15.142:0/1459273945 <== osd.0 v2:172.21.15.31:6800/168281188 13 ==== osd_op_reply(56 notify.6 [create] v30'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa368029040 con 0x7fa3700a5040 2024-09-22T08:36:44.835 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.817+0000 7fa384f28800 1 -- 172.21.15.142:0/1459273945 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94064360482736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558d10caf080 con 0x7fa3700a5040 2024-09-22T08:36:44.835 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.817+0000 7fa384f28800 1 -- 172.21.15.142:0/1459273945 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558d10cb05c0 con 0x7fa3700a5040 2024-09-22T08:36:44.835 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.818+0000 7fa37846e640 1 -- 172.21.15.142:0/1459273945 <== osd.0 v2:172.21.15.31:6800/168281188 14 ==== osd_op_reply(58 notify.7 [create] v30'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa368029040 con 0x7fa3700a5040 2024-09-22T08:36:44.835 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.818+0000 7fa37846e640 1 -- 172.21.15.142:0/1459273945 <== osd.0 v2:172.21.15.31:6800/168281188 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94064360482736] v30'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa368029040 con 0x7fa3700a5040 2024-09-22T08:36:44.835 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.818+0000 7fa384f28800 1 -- 172.21.15.142:0/1459273945 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94064360489232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558d10cb09e0 con 0x7fa3700a5040 2024-09-22T08:36:44.835 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.818+0000 7fa384f28800 20 add_watcher() i=0 2024-09-22T08:36:44.835 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.818+0000 7fa384f28800 20 add_watcher() i=1 2024-09-22T08:36:44.835 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.818+0000 7fa384f28800 20 add_watcher() i=2 2024-09-22T08:36:44.835 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.818+0000 7fa384f28800 20 add_watcher() i=3 2024-09-22T08:36:44.836 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.818+0000 7fa384f28800 20 add_watcher() i=4 2024-09-22T08:36:44.836 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.818+0000 7fa384f28800 20 add_watcher() i=5 2024-09-22T08:36:44.836 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.818+0000 7fa384f28800 20 add_watcher() i=6 2024-09-22T08:36:44.836 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.819+0000 7fa37846e640 1 -- 172.21.15.142:0/1459273945 <== osd.0 v2:172.21.15.31:6800/168281188 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94064360489232] v30'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa368029040 con 0x7fa3700a5040 2024-09-22T08:36:44.836 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.819+0000 7fa384f28800 20 add_watcher() i=7 2024-09-22T08:36:44.836 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.819+0000 7fa384f28800 2 all 8 watchers are set, enabling cache 2024-09-22T08:36:44.836 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.819+0000 7fa384f28800 1 -- 172.21.15.142:0/1459273945 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558d10cb3a10 con 0x558d10c9f670 2024-09-22T08:36:44.836 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.819+0000 7fa37846e640 1 -- 172.21.15.142:0/1459273945 <== osd.1 v2:172.21.15.142:6816/3192108003 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fa368029040 con 0x558d10c9f670 2024-09-22T08:36:44.836 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.819+0000 7fa384f28800 1 -- 172.21.15.142:0/1459273945 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94064360490288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558d10cb0e70 con 0x558d10c9f670 2024-09-22T08:36:44.836 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.820+0000 7fa37846e640 1 -- 172.21.15.142:0/1459273945 <== osd.1 v2:172.21.15.142:6816/3192108003 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94064360490288] v30'82 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa368029040 con 0x558d10c9f670 2024-09-22T08:36:44.836 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.820+0000 7fa2377e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:36:44.837 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.820+0000 7fa384f28800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:36:44.837 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.820+0000 7fa384f28800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:36:44.837 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.820+0000 7fa384f28800 5 note: GC not initialized 2024-09-22T08:36:44.837 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.821+0000 7fa2367e4640 20 reqs_thread_entry: start 2024-09-22T08:36:44.837 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.821+0000 7fa384f28800 20 init_complete bucket index max shards: 11 2024-09-22T08:36:44.837 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.821+0000 7fa384f28800 20 Filter name: none 2024-09-22T08:36:44.837 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.821+0000 7fa22ffff640 20 reqs_thread_entry: start 2024-09-22T08:36:44.837 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.821+0000 7fa384f28800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-22T08:36:44.837 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.821+0000 7fa384f28800 20 rados->read ofs=0 len=0 2024-09-22T08:36:44.837 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.821+0000 7fa384f28800 1 -- 172.21.15.142:0/1459273945 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558d10ce6c20 con 0x558d10c9f670 2024-09-22T08:36:44.837 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.821+0000 7fa37846e640 1 -- 172.21.15.142:0/1459273945 <== osd.1 v2:172.21.15.142:6816/3192108003 21 ==== osd_op_reply(62 foo [call out=48b,read 0~673 out=673b,getxattrs out=75b] v0'0 uv8 ondisk = 0) ==== 231+0+796 (crc 0 0 0) 0x7fa368029040 con 0x558d10c9f670 2024-09-22T08:36:44.837 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.821+0000 7fa384f28800 20 rados_obj.operate() r=0 bl.length=673 2024-09-22T08:36:44.838 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.821+0000 7fa384f28800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-22T08:36:44.838 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.821+0000 7fa384f28800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-22T08:36:44.838 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.821+0000 7fa384f28800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:36:44.838 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.821+0000 7fa384f28800 1 -- 172.21.15.142:0/1459273945 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558d10ced7d0 con 0x558d10c9f670 2024-09-22T08:36:44.838 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.822+0000 7fa37846e640 1 -- 172.21.15.142:0/1459273945 <== osd.1 v2:172.21.15.142:6816/3192108003 22 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~582] v30'9 uv9 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fa368029040 con 0x558d10c9f670 2024-09-22T08:36:44.838 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.822+0000 7fa384f28800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-22T08:36:44.838 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.822+0000 7fa384f28800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-22T08:36:44.838 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.822+0000 7fa384f28800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-22T08:36:44.838 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.822+0000 7fa384f28800 1 -- 172.21.15.142:0/1459273945 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94064360739344 in=770b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558d10ce8f10 con 0x558d10c9f670 2024-09-22T08:36:44.838 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.823+0000 7fa37846e640 1 -- 172.21.15.142:0/1459273945 <== osd.1 v2:172.21.15.142:6816/3192108003 23 ==== watch-notify(notify (1) cookie 94064360481680 notify 128849018888 ret 0) ==== 800+0+0 (crc 0 0 0) 0x558d109f6a20 con 0x558d10c9f670 2024-09-22T08:36:44.838 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.823+0000 7fa257fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018888 cookie 94064360481680 notifier 4401 bl.length()=758 2024-09-22T08:36:44.838 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.823+0000 7fa257fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-22T08:36:44.838 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.823+0000 7fa257fff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-22T08:36:44.839 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.823+0000 7fa257fff640 1 -- 172.21.15.142:0/1459273945 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7fa244003ea0 con 0x558d10c9f670 2024-09-22T08:36:44.839 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.823+0000 7fa37846e640 1 -- 172.21.15.142:0/1459273945 <== osd.1 v2:172.21.15.142:6816/3192108003 24 ==== osd_op_reply(64 notify.4 [notify cookie 94064360739344 out=8b] v0'0 uv72 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fa368029040 con 0x558d10c9f670 2024-09-22T08:36:44.839 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.823+0000 7fa37846e640 1 -- 172.21.15.142:0/1459273945 <== osd.1 v2:172.21.15.142:6816/3192108003 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa368029040 con 0x558d10c9f670 2024-09-22T08:36:44.839 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.823+0000 7fa37846e640 1 -- 172.21.15.142:0/1459273945 <== osd.1 v2:172.21.15.142:6816/3192108003 26 ==== watch-notify(notify_complete (2) cookie 94064360739344 notify 128849018888 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fa36802d5f0 con 0x558d10c9f670 2024-09-22T08:36:44.839 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.823+0000 7fa384f28800 1 -- 172.21.15.142:0/1459273945 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:66 8.8 8:17d68d04:users.swift::foo%3afoo1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558d10ced210 con 0x558d10c9f670 2024-09-22T08:36:44.839 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.824+0000 7fa37846e640 1 -- 172.21.15.142:0/1459273945 <== osd.1 v2:172.21.15.142:6816/3192108003 27 ==== osd_op_reply(66 foo:foo1 [delete] v30'2 uv2 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa368029040 con 0x558d10c9f670 2024-09-22T08:36:44.839 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.824+0000 7fa384f28800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:users.swift:foo:foo1, ofs0, ns] 2024-09-22T08:36:44.839 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.824+0000 7fa384f28800 1 -- 172.21.15.142:0/1459273945 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94064360739344 in=171b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558d10ce8a60 con 0x7fa37c04d4b0 2024-09-22T08:36:44.839 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.824+0000 7fa380c6f640 1 -- 172.21.15.142:0/1459273945 <== osd.2 v2:172.21.15.142:6808/279438927 11 ==== watch-notify(notify (1) cookie 94064360466496 notify 128849018884 ret 0) ==== 201+0+0 (crc 0 0 0) 0x7fa3700ad060 con 0x7fa37c04d4b0 2024-09-22T08:36:44.839 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.824+0000 7fa2577fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018884 cookie 94064360466496 notifier 4401 bl.length()=159 2024-09-22T08:36:44.839 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.824+0000 7fa2577fe640 1 -- 172.21.15.142:0/1459273945 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7fa1a80032c0 con 0x7fa37c04d4b0 2024-09-22T08:36:44.839 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.824+0000 7fa380c6f640 1 -- 172.21.15.142:0/1459273945 <== osd.2 v2:172.21.15.142:6808/279438927 12 ==== osd_op_reply(67 notify.0 [notify cookie 94064360739344 out=8b] v0'0 uv72 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fa370051070 con 0x7fa37c04d4b0 2024-09-22T08:36:44.839 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.825+0000 7fa380c6f640 1 -- 172.21.15.142:0/1459273945 <== osd.2 v2:172.21.15.142:6808/279438927 13 ==== osd_op_reply(68 notify.0 [notify-ack] v0'0 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa370051070 con 0x7fa37c04d4b0 2024-09-22T08:36:44.839 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.825+0000 7fa380c6f640 1 -- 172.21.15.142:0/1459273945 <== osd.2 v2:172.21.15.142:6808/279438927 14 ==== watch-notify(notify_complete (2) cookie 94064360739344 notify 128849018884 ret 0) ==== 42+0+48 (crc 0 0 0) 0x558d10c63ee0 con 0x7fa37c04d4b0 2024-09-22T08:36:44.840 INFO:teuthology.orchestra.run.smithi142.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"},{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-22T08:36:42.661297Z"}],"swift_keys":[{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true,"create_date":"2024-09-22T08:36:44.553654Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-22T08:36:42.661288Z","tags":[],"group_ids":[]} 2024-09-22T08:36:44.845 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.825+0000 7fa2377e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:36:44.845 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.825+0000 7fa384f28800 1 -- 172.21.15.142:0/1459273945 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:69 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94064360490288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558d10ce8a60 con 0x558d10c9f670 2024-09-22T08:36:44.845 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.826+0000 7fa37846e640 1 -- 172.21.15.142:0/1459273945 <== osd.1 v2:172.21.15.142:6816/3192108003 28 ==== osd_op_reply(69 data_loggenerations_metadata [watch unwatch cookie 94064360490288] v30'83 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa368029040 con 0x558d10c9f670 2024-09-22T08:36:44.845 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.826+0000 7fa384f28800 1 -- 172.21.15.142:0/1459273945 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:70 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94064360466496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558d10ce8a60 con 0x7fa37c04d4b0 2024-09-22T08:36:44.845 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.827+0000 7fa380c6f640 1 -- 172.21.15.142:0/1459273945 <== osd.2 v2:172.21.15.142:6808/279438927 15 ==== osd_op_reply(70 notify.0 [watch unwatch cookie 94064360466496] v30'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa370051070 con 0x7fa37c04d4b0 2024-09-22T08:36:44.845 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.827+0000 7fa384f28800 20 remove_watcher() i=0 2024-09-22T08:36:44.845 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.827+0000 7fa384f28800 2 removed watcher, disabling cache 2024-09-22T08:36:44.845 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.827+0000 7fa384f28800 1 -- 172.21.15.142:0/1459273945 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:71 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94064360470416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558d10ce8a60 con 0x558d10c9f670 2024-09-22T08:36:44.845 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.829+0000 7fa37846e640 1 -- 172.21.15.142:0/1459273945 <== osd.1 v2:172.21.15.142:6816/3192108003 29 ==== osd_op_reply(71 notify.1 [watch unwatch cookie 94064360470416] v30'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa368029040 con 0x558d10c9f670 2024-09-22T08:36:44.845 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.829+0000 7fa384f28800 20 remove_watcher() i=1 2024-09-22T08:36:44.845 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.829+0000 7fa384f28800 1 -- 172.21.15.142:0/1459273945 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:72 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94064360475280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558d10ce8a60 con 0x558d10ca4060 2024-09-22T08:36:44.846 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.830+0000 7fa381470640 1 -- 172.21.15.142:0/1459273945 <== osd.3 v2:172.21.15.142:6800/1064901393 16 ==== osd_op_reply(72 notify.2 [watch unwatch cookie 94064360475280] v30'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa37c03a070 con 0x558d10ca4060 2024-09-22T08:36:44.846 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.830+0000 7fa384f28800 20 remove_watcher() i=2 2024-09-22T08:36:44.846 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.830+0000 7fa384f28800 1 -- 172.21.15.142:0/1459273945 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94064360479376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558d10ce8a60 con 0x7fa37c04d4b0 2024-09-22T08:36:44.846 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.831+0000 7fa380c6f640 1 -- 172.21.15.142:0/1459273945 <== osd.2 v2:172.21.15.142:6808/279438927 16 ==== osd_op_reply(73 notify.3 [watch unwatch cookie 94064360479376] v30'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa370051070 con 0x7fa37c04d4b0 2024-09-22T08:36:44.846 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.831+0000 7fa384f28800 20 remove_watcher() i=3 2024-09-22T08:36:44.846 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.831+0000 7fa384f28800 1 -- 172.21.15.142:0/1459273945 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94064360481680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558d10ce8a60 con 0x558d10c9f670 2024-09-22T08:36:44.846 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.832+0000 7fa37846e640 1 -- 172.21.15.142:0/1459273945 <== osd.1 v2:172.21.15.142:6816/3192108003 30 ==== osd_op_reply(74 notify.4 [watch unwatch cookie 94064360481680] v30'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa368029040 con 0x558d10c9f670 2024-09-22T08:36:44.846 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.832+0000 7fa384f28800 20 remove_watcher() i=4 2024-09-22T08:36:44.846 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.832+0000 7fa384f28800 1 -- 172.21.15.142:0/1459273945 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:75 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94064360483936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558d10ce8a60 con 0x7fa3700a5040 2024-09-22T08:36:44.846 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.833+0000 7fa37846e640 1 -- 172.21.15.142:0/1459273945 <== osd.0 v2:172.21.15.31:6800/168281188 17 ==== osd_op_reply(75 notify.5 [watch unwatch cookie 94064360483936] v30'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa368029040 con 0x7fa3700a5040 2024-09-22T08:36:44.846 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.833+0000 7fa384f28800 20 remove_watcher() i=5 2024-09-22T08:36:44.846 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.833+0000 7fa384f28800 1 -- 172.21.15.142:0/1459273945 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:76 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94064360482736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558d10ce8a60 con 0x7fa3700a5040 2024-09-22T08:36:44.846 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.834+0000 7fa37846e640 1 -- 172.21.15.142:0/1459273945 <== osd.0 v2:172.21.15.31:6800/168281188 18 ==== osd_op_reply(76 notify.6 [watch unwatch cookie 94064360482736] v30'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa368029040 con 0x7fa3700a5040 2024-09-22T08:36:44.847 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.834+0000 7fa384f28800 20 remove_watcher() i=6 2024-09-22T08:36:44.847 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.834+0000 7fa384f28800 1 -- 172.21.15.142:0/1459273945 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:77 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94064360489232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558d10ce8a60 con 0x7fa3700a5040 2024-09-22T08:36:44.847 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.835+0000 7fa37846e640 1 -- 172.21.15.142:0/1459273945 <== osd.0 v2:172.21.15.31:6800/168281188 19 ==== osd_op_reply(77 notify.7 [watch unwatch cookie 94064360489232] v30'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa368029040 con 0x7fa3700a5040 2024-09-22T08:36:44.847 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.835+0000 7fa384f28800 20 remove_watcher() i=7 2024-09-22T08:36:44.847 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.835+0000 7fa384f28800 1 -- 172.21.15.142:0/1459273945 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7fa3700a5040 msgr2=0x7fa370074480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:44.847 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.835+0000 7fa384f28800 1 --2- 172.21.15.142:0/1459273945 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7fa3700a5040 0x7fa370074480 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:44.847 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.835+0000 7fa384f28800 1 -- 172.21.15.142:0/1459273945 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x558d10c9f670 msgr2=0x558d10ca1b30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:44.847 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.835+0000 7fa384f28800 1 --2- 172.21.15.142:0/1459273945 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x558d10c9f670 0x558d10ca1b30 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:44.847 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.835+0000 7fa384f28800 1 -- 172.21.15.142:0/1459273945 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7fa37c04d4b0 msgr2=0x7fa37c04d8b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:44.847 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.835+0000 7fa384f28800 1 --2- 172.21.15.142:0/1459273945 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7fa37c04d4b0 0x7fa37c04d8b0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:44.847 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.835+0000 7fa384f28800 1 -- 172.21.15.142:0/1459273945 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x558d10ca4060 msgr2=0x558d10ca6450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:44.847 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.835+0000 7fa384f28800 1 --2- 172.21.15.142:0/1459273945 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x558d10ca4060 0x558d10ca6450 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:44.847 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.835+0000 7fa384f28800 1 -- 172.21.15.142:0/1459273945 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fa24c03cfb0 msgr2=0x7fa24c03f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:44.847 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.835+0000 7fa384f28800 1 --2- 172.21.15.142:0/1459273945 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fa24c03cfb0 0x7fa24c03f470 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fa370097430 tx=0x7fa370089000 comp rx=0 tx=0).stop 2024-09-22T08:36:44.848 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.835+0000 7fa384f28800 1 -- 172.21.15.142:0/1459273945 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558d10c8c720 msgr2=0x558d10c93cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:44.848 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.835+0000 7fa37846e640 1 -- 172.21.15.142:0/1459273945 reap_dead start 2024-09-22T08:36:44.848 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.835+0000 7fa384f28800 1 --2- 172.21.15.142:0/1459273945 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558d10c8c720 0x558d10c93cf0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fa37c01ff70 tx=0x7fa37c0547d0 comp rx=0 tx=0).stop 2024-09-22T08:36:44.848 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.835+0000 7fa384f28800 1 -- 172.21.15.142:0/1459273945 shutdown_connections 2024-09-22T08:36:44.848 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.835+0000 7fa384f28800 1 --2- 172.21.15.142:0/1459273945 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558d10c8c720 0x558d10c93cf0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:44.848 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.835+0000 7fa384f28800 1 -- 172.21.15.142:0/1459273945 >> 172.21.15.142:0/1459273945 conn(0x558d10c88b20 msgr2=0x558d10c86d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:44.848 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.836+0000 7fa384f28800 1 -- 172.21.15.142:0/1459273945 shutdown_connections 2024-09-22T08:36:44.848 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.836+0000 7fa384f28800 1 -- 172.21.15.142:0/1459273945 wait complete. 2024-09-22T08:36:44.848 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.836+0000 7fa384f28800 1 -- 172.21.15.142:0/2992885428 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fa25803cfb0 msgr2=0x7fa25803f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:44.848 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.836+0000 7fa384f28800 1 --2- 172.21.15.142:0/2992885428 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fa25803cfb0 0x7fa25803f470 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x558d10c64be0 tx=0x7fa37005da60 comp rx=0 tx=0).stop 2024-09-22T08:36:44.848 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.836+0000 7fa384f28800 1 -- 172.21.15.142:0/2992885428 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558d10b6b840 msgr2=0x558d10b6a0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:44.848 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.836+0000 7fa384f28800 1 --2- 172.21.15.142:0/2992885428 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558d10b6b840 0x558d10b6a0b0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x558d10c63ae0 tx=0x7fa37c0167b0 comp rx=0 tx=0).stop 2024-09-22T08:36:44.848 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.836+0000 7fa384f28800 1 -- 172.21.15.142:0/2992885428 shutdown_connections 2024-09-22T08:36:44.848 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.836+0000 7fa384f28800 1 --2- 172.21.15.142:0/2992885428 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fa25803cfb0 0x7fa25803f470 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:44.849 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.836+0000 7fa384f28800 1 --2- 172.21.15.142:0/2992885428 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558d10b6b840 0x558d10b6a0b0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:44.849 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.836+0000 7fa384f28800 1 -- 172.21.15.142:0/2992885428 >> 172.21.15.142:0/2992885428 conn(0x558d10c71e00 msgr2=0x558d10c721e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:44.849 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.836+0000 7fa384f28800 1 -- 172.21.15.142:0/2992885428 shutdown_connections 2024-09-22T08:36:44.849 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.836+0000 7fa384f28800 1 -- 172.21.15.142:0/2992885428 wait complete. 2024-09-22T08:36:44.849 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.836+0000 7fa384f28800 1 -- 172.21.15.142:0/1224855341 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x558d10b6e9b0 msgr2=0x558d10c6a130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:44.849 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.836+0000 7fa384f28800 1 --2- 172.21.15.142:0/1224855341 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x558d10b6e9b0 0x558d10c6a130 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:44.849 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.836+0000 7fa384f28800 1 -- 172.21.15.142:0/1224855341 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x558d10c6c4d0 msgr2=0x558d10c6e970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:44.849 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.836+0000 7fa384f28800 1 --2- 172.21.15.142:0/1224855341 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x558d10c6c4d0 0x558d10c6e970 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:44.849 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.836+0000 7fa384f28800 1 -- 172.21.15.142:0/1224855341 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fa26803cfb0 msgr2=0x7fa26803f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:44.849 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.836+0000 7fa384f28800 1 --2- 172.21.15.142:0/1224855341 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fa26803cfb0 0x7fa26803f470 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fa368001d70 tx=0x7fa3680012d0 comp rx=0 tx=0).stop 2024-09-22T08:36:44.849 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.836+0000 7fa384f28800 1 -- 172.21.15.142:0/1224855341 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558d10b6c080 msgr2=0x558d10c62ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:44.849 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.836+0000 7fa384f28800 1 --2- 172.21.15.142:0/1224855341 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558d10b6c080 0x558d10c62ae0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fa370025c20 tx=0x7fa370002fb0 comp rx=0 tx=0).stop 2024-09-22T08:36:44.849 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.836+0000 7fa384f28800 1 -- 172.21.15.142:0/1224855341 shutdown_connections 2024-09-22T08:36:44.849 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.836+0000 7fa384f28800 1 --2- 172.21.15.142:0/1224855341 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x558d10c6c4d0 0x558d10c6e970 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:44.850 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.836+0000 7fa384f28800 1 --2- 172.21.15.142:0/1224855341 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x558d10b6e9b0 0x558d10c6a130 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:44.850 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.836+0000 7fa384f28800 1 --2- 172.21.15.142:0/1224855341 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fa26803cfb0 0x7fa26803f470 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:44.850 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.836+0000 7fa384f28800 1 --2- 172.21.15.142:0/1224855341 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558d10b6c080 0x558d10c62ae0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:44.850 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.836+0000 7fa384f28800 1 -- 172.21.15.142:0/1224855341 >> 172.21.15.142:0/1224855341 conn(0x558d10b65be0 msgr2=0x558d10c55150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:44.850 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.837+0000 7fa384f28800 1 -- 172.21.15.142:0/1224855341 shutdown_connections 2024-09-22T08:36:44.850 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.837+0000 7fa384f28800 1 -- 172.21.15.142:0/1224855341 wait complete. 2024-09-22T08:36:44.851 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-22T08:36:42.661297Z'}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True, 'create_date': '2024-09-22T08:36:44.553654Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-22T08:36:42.661288Z', 'tags': [], 'group_ids': []} 2024-09-22T08:36:44.851 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'rm', '--subuser', 'foo:foo1'] 2024-09-22T08:36:44.851 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'rm', '--subuser', 'foo:foo1'] 2024-09-22T08:36:44.851 DEBUG:teuthology.orchestra.run.smithi142:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser rm --subuser foo:foo1 2024-09-22T08:36:44.896 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:36:44.896 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:36:44.896 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.895+0000 7f9f68b25800 1 Processor -- start 2024-09-22T08:36:44.897 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.895+0000 7f9f68b25800 1 -- start start 2024-09-22T08:36:44.897 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.895+0000 7f9f68b25800 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55b0003f2280 0x55b0004864e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:44.897 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.895+0000 7f9f68b25800 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55b000308a20 con 0x55b0003f3590 2024-09-22T08:36:44.897 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.895+0000 7f9f68b25800 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x55b0003087d0 con 0x55b0003f2280 2024-09-22T08:36:44.897 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.896+0000 7f9f5ffff640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55b0003f2280 0x55b0004864e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:44.897 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.896+0000 7f9f648a2640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x55b0003f3590 0x55b0003f1b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.142:42454/0 (socket says 172.21.15.142:42454) 2024-09-22T08:36:44.898 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.896+0000 7f9f5ffff640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55b0003f2280 0x55b0004864e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:38768/0 (socket says 172.21.15.142:38768) 2024-09-22T08:36:44.898 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.896+0000 7f9f648a2640 1 -- 172.21.15.142:0/437205447 learned_addr learned my addr 172.21.15.142:0/437205447 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-09-22T08:36:44.898 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.896+0000 7f9f5ffff640 1 -- 172.21.15.142:0/437205447 >> v1:172.21.15.31:6789/0 conn(0x55b0003f3590 legacy=0x55b0003f1b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:44.898 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.896+0000 7f9f5ffff640 1 -- 172.21.15.142:0/437205447 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b0003f2880 con 0x55b0003f2280 2024-09-22T08:36:44.899 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.898+0000 7f9f5ffff640 1 --2- 172.21.15.142:0/437205447 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b0003f2280 0x55b0004864e0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f9f5000a470 tx=0x7f9f50045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac26ed59aeb96e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:44.899 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.898+0000 7f9f5f7fe640 1 -- 172.21.15.142:0/437205447 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9f50053570 con 0x55b0003f2280 2024-09-22T08:36:44.899 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.898+0000 7f9f5f7fe640 1 -- 172.21.15.142:0/437205447 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f50058070 con 0x55b0003f2280 2024-09-22T08:36:44.899 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.898+0000 7f9f5f7fe640 1 -- 172.21.15.142:0/437205447 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9f50053880 con 0x55b0003f2280 2024-09-22T08:36:44.900 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.898+0000 7f9f68b25800 1 -- 172.21.15.142:0/437205447 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b0003f2280 msgr2=0x55b0004864e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:44.900 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.898+0000 7f9f68b25800 1 --2- 172.21.15.142:0/437205447 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b0003f2280 0x55b0004864e0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f9f5000a470 tx=0x7f9f50045a20 comp rx=0 tx=0).stop 2024-09-22T08:36:44.900 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.899+0000 7f9f68b25800 1 -- 172.21.15.142:0/437205447 shutdown_connections 2024-09-22T08:36:44.900 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.899+0000 7f9f68b25800 1 --2- 172.21.15.142:0/437205447 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b0003f2280 0x55b0004864e0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:44.900 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.899+0000 7f9f68b25800 1 -- 172.21.15.142:0/437205447 >> 172.21.15.142:0/437205447 conn(0x55b000478db0 msgr2=0x55b00047b210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:44.900 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.899+0000 7f9f68b25800 1 -- 172.21.15.142:0/437205447 shutdown_connections 2024-09-22T08:36:44.900 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.899+0000 7f9f68b25800 1 -- 172.21.15.142:0/437205447 wait complete. 2024-09-22T08:36:44.913 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.912+0000 7f9f68b25800 1 Processor -- start 2024-09-22T08:36:44.913 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.912+0000 7f9f68b25800 1 -- start start 2024-09-22T08:36:44.914 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.912+0000 7f9f68b25800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b0003f2280 0x55b00056f180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:44.914 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.912+0000 7f9f68b25800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55b000315dd0 con 0x55b0003f2280 2024-09-22T08:36:44.915 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.913+0000 7f9f648a2640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b0003f2280 0x55b00056f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:44.915 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.913+0000 7f9f648a2640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b0003f2280 0x55b00056f180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:38770/0 (socket says 172.21.15.142:38770) 2024-09-22T08:36:44.915 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.913+0000 7f9f648a2640 1 -- 172.21.15.142:0/4011138494 learned_addr learned my addr 172.21.15.142:0/4011138494 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:44.915 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.913+0000 7f9f648a2640 1 -- 172.21.15.142:0/4011138494 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b00056f770 con 0x55b0003f2280 2024-09-22T08:36:44.915 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.913+0000 7f9f648a2640 1 --2- 172.21.15.142:0/4011138494 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b0003f2280 0x55b00056f180 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f9f58001e40 tx=0x7f9f58001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb10f3c4dfa7a6bb server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:44.915 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.913+0000 7f9e52e05640 1 -- 172.21.15.142:0/4011138494 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9f58012020 con 0x55b0003f2280 2024-09-22T08:36:44.915 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.913+0000 7f9e52e05640 1 -- 172.21.15.142:0/4011138494 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f5800e5a0 con 0x55b0003f2280 2024-09-22T08:36:44.915 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.913+0000 7f9e52e05640 1 -- 172.21.15.142:0/4011138494 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9f5800e8a0 con 0x55b0003f2280 2024-09-22T08:36:44.917 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.914+0000 7f9f68b25800 1 -- 172.21.15.142:0/4011138494 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b0003f2280 msgr2=0x55b00056f180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:44.917 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.914+0000 7f9f68b25800 1 --2- 172.21.15.142:0/4011138494 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b0003f2280 0x55b00056f180 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f9f58001e40 tx=0x7f9f58001e70 comp rx=0 tx=0).stop 2024-09-22T08:36:44.917 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.914+0000 7f9f68b25800 1 -- 172.21.15.142:0/4011138494 shutdown_connections 2024-09-22T08:36:44.917 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.914+0000 7f9f68b25800 1 --2- 172.21.15.142:0/4011138494 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b0003f2280 0x55b00056f180 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:44.917 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.914+0000 7f9f68b25800 1 -- 172.21.15.142:0/4011138494 >> 172.21.15.142:0/4011138494 conn(0x55b000478db0 msgr2=0x55b00056ab00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:44.917 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.914+0000 7f9f68b25800 1 -- 172.21.15.142:0/4011138494 shutdown_connections 2024-09-22T08:36:44.917 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.914+0000 7f9f68b25800 1 -- 172.21.15.142:0/4011138494 wait complete. 2024-09-22T08:36:44.917 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.914+0000 7f9f68b25800 1 Processor -- start 2024-09-22T08:36:44.917 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.915+0000 7f9f68b25800 1 -- start start 2024-09-22T08:36:44.918 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.915+0000 7f9f68b25800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b0003f3590 0x55b000576f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:44.918 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.915+0000 7f9f68b25800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55b000486d20 con 0x55b0003f3590 2024-09-22T08:36:44.918 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.915+0000 7f9f648a2640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b0003f3590 0x55b000576f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:44.918 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.915+0000 7f9f648a2640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b0003f3590 0x55b000576f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:38780/0 (socket says 172.21.15.142:38780) 2024-09-22T08:36:44.918 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.915+0000 7f9f648a2640 1 -- 172.21.15.142:0/1800736118 learned_addr learned my addr 172.21.15.142:0/1800736118 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:44.918 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.915+0000 7f9f648a2640 1 -- 172.21.15.142:0/1800736118 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b000577480 con 0x55b0003f3590 2024-09-22T08:36:44.918 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.915+0000 7f9f648a2640 1 --2- 172.21.15.142:0/1800736118 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b0003f3590 0x55b000576f20 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f9f5800c010 tx=0x7f9f58000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:44.918 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.915+0000 7f9e51602640 1 -- 172.21.15.142:0/1800736118 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9f58012030 con 0x55b0003f3590 2024-09-22T08:36:44.918 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.915+0000 7f9e51602640 1 -- 172.21.15.142:0/1800736118 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f580014a0 con 0x55b0003f3590 2024-09-22T08:36:44.918 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.915+0000 7f9e51602640 1 -- 172.21.15.142:0/1800736118 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9f5801a700 con 0x55b0003f3590 2024-09-22T08:36:44.918 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.916+0000 7f9f68b25800 1 -- 172.21.15.142:0/1800736118 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b000577710 con 0x55b0003f3590 2024-09-22T08:36:44.918 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.916+0000 7f9f68b25800 1 -- 172.21.15.142:0/1800736118 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b000578110 con 0x55b0003f3590 2024-09-22T08:36:44.921 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.916+0000 7f9e51602640 1 -- 172.21.15.142:0/1800736118 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f9f58015020 con 0x55b0003f3590 2024-09-22T08:36:44.922 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.917+0000 7f9e51602640 1 --2- 172.21.15.142:0/1800736118 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f9e4c03cfb0 0x7f9e4c03f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:44.922 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.917+0000 7f9e51602640 1 -- 172.21.15.142:0/1800736118 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f9f58020030 con 0x55b0003f3590 2024-09-22T08:36:44.922 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.917+0000 7f9f5ffff640 1 --2- 172.21.15.142:0/1800736118 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f9e4c03cfb0 0x7f9e4c03f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:44.922 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.917+0000 7f9f68b25800 1 --2- 172.21.15.142:0/1800736118 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55b000578c30 0x55b00057e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:44.922 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.917+0000 7f9f68b25800 1 -- 172.21.15.142:0/1800736118 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b00057eb00 con 0x55b000578c30 2024-09-22T08:36:44.922 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.917+0000 7f9f650a3640 1 --2- 172.21.15.142:0/1800736118 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55b000578c30 0x55b00057e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:44.922 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.917+0000 7f9f5ffff640 1 --2- 172.21.15.142:0/1800736118 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f9e4c03cfb0 0x7f9e4c03f470 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f9f50057000 tx=0x7f9f50052000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:44.922 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.917+0000 7f9f650a3640 1 --2- 172.21.15.142:0/1800736118 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55b000578c30 0x55b00057e570 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:44.922 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.917+0000 7f9f650a3640 1 -- 172.21.15.142:0/1800736118 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9f6000a4d0 con 0x55b000578c30 2024-09-22T08:36:44.922 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.918+0000 7f9f68b25800 1 -- 172.21.15.142:0/1800736118 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b0005785c0 con 0x55b000578c30 2024-09-22T08:36:44.922 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.918+0000 7f9f650a3640 1 -- 172.21.15.142:0/1800736118 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9f6000a4d0 con 0x55b000578c30 2024-09-22T08:36:44.922 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.918+0000 7f9f68b25800 1 --2- 172.21.15.142:0/1800736118 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55b000580e30 0x55b000583220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:44.922 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.918+0000 7f9f68b25800 1 -- 172.21.15.142:0/1800736118 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:3 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b0005838f0 con 0x55b000580e30 2024-09-22T08:36:44.923 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.918+0000 7f9f648a2640 1 --2- 172.21.15.142:0/1800736118 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55b000580e30 0x55b000583220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:44.923 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.918+0000 7f9f648a2640 1 --2- 172.21.15.142:0/1800736118 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55b000580e30 0x55b000583220 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:44.923 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.918+0000 7f9f648a2640 1 -- 172.21.15.142:0/1800736118 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(3 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f9f580187b0 con 0x55b000580e30 2024-09-22T08:36:44.923 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.918+0000 7f9f68b25800 1 -- 172.21.15.142:0/1800736118 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b00057fcd0 con 0x55b000578c30 2024-09-22T08:36:44.923 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.919+0000 7f9f650a3640 1 -- 172.21.15.142:0/1800736118 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9f6000a4d0 con 0x55b000578c30 2024-09-22T08:36:44.923 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.919+0000 7f9f68b25800 1 -- 172.21.15.142:0/1800736118 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b000580170 con 0x55b000580e30 2024-09-22T08:36:44.923 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.919+0000 7f9f648a2640 1 -- 172.21.15.142:0/1800736118 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(5 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f9f580187b0 con 0x55b000580e30 2024-09-22T08:36:44.923 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.919+0000 7f9f68b25800 1 Processor -- start 2024-09-22T08:36:44.923 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.919+0000 7f9f68b25800 1 -- start start 2024-09-22T08:36:44.923 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.919+0000 7f9f68b25800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b000592290 0x55b0005926b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:44.923 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.920+0000 7f9f68b25800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55b000374d50 con 0x55b000592290 2024-09-22T08:36:44.923 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.920+0000 7f9f650a3640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b000592290 0x55b0005926b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:44.923 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.920+0000 7f9f650a3640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b000592290 0x55b0005926b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:38796/0 (socket says 172.21.15.142:38796) 2024-09-22T08:36:44.923 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.920+0000 7f9f650a3640 1 -- 172.21.15.142:0/2926606625 learned_addr learned my addr 172.21.15.142:0/2926606625 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:44.924 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.920+0000 7f9f650a3640 1 -- 172.21.15.142:0/2926606625 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b000592cf0 con 0x55b000592290 2024-09-22T08:36:44.924 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.920+0000 7f9f650a3640 1 --2- 172.21.15.142:0/2926606625 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b000592290 0x55b0005926b0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x55b000577db0 tx=0x7f9f600167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:44.924 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.920+0000 7f9e4a7fc640 1 -- 172.21.15.142:0/2926606625 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9f60013640 con 0x55b000592290 2024-09-22T08:36:44.924 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.920+0000 7f9e4a7fc640 1 -- 172.21.15.142:0/2926606625 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f600137e0 con 0x55b000592290 2024-09-22T08:36:44.924 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.920+0000 7f9f68b25800 1 -- 172.21.15.142:0/2926606625 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b000593520 con 0x55b000592290 2024-09-22T08:36:44.924 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.920+0000 7f9e4a7fc640 1 -- 172.21.15.142:0/2926606625 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9f60013ae0 con 0x55b000592290 2024-09-22T08:36:44.924 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.920+0000 7f9f68b25800 1 -- 172.21.15.142:0/2926606625 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b000593ac0 con 0x55b000592290 2024-09-22T08:36:44.931 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.921+0000 7f9e4a7fc640 1 -- 172.21.15.142:0/2926606625 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f9f60011040 con 0x55b000592290 2024-09-22T08:36:44.931 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.921+0000 7f9e4a7fc640 1 --2- 172.21.15.142:0/2926606625 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f9e3c03cfb0 0x7f9e3c03f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:44.931 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.922+0000 7f9e4a7fc640 1 -- 172.21.15.142:0/2926606625 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f9f6000e040 con 0x55b000592290 2024-09-22T08:36:44.931 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.922+0000 7f9f648a2640 1 --2- 172.21.15.142:0/2926606625 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f9e3c03cfb0 0x7f9e3c03f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:44.931 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.922+0000 7f9f68b25800 1 Processor -- start 2024-09-22T08:36:44.931 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.922+0000 7f9f648a2640 1 --2- 172.21.15.142:0/2926606625 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f9e3c03cfb0 0x7f9e3c03f470 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x55b00057efb0 tx=0x7f9f5804d040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:44.932 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.922+0000 7f9f68b25800 1 -- start start 2024-09-22T08:36:44.932 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.922+0000 7f9f68b25800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b00059ed50 0x55b00059f150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:44.932 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.922+0000 7f9f68b25800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55b00056fba0 con 0x55b00059ed50 2024-09-22T08:36:44.932 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.922+0000 7f9f650a3640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b00059ed50 0x55b00059f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:44.932 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.922+0000 7f9f650a3640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b00059ed50 0x55b00059f150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:38798/0 (socket says 172.21.15.142:38798) 2024-09-22T08:36:44.932 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.922+0000 7f9f650a3640 1 -- 172.21.15.142:0/2479452850 learned_addr learned my addr 172.21.15.142:0/2479452850 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:44.932 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.923+0000 7f9f650a3640 1 -- 172.21.15.142:0/2479452850 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b00059f740 con 0x55b00059ed50 2024-09-22T08:36:44.932 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.923+0000 7f9f650a3640 1 --2- 172.21.15.142:0/2479452850 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b00059ed50 0x55b00059f150 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f9f60054840 tx=0x7f9f600204d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67194c33bf501362 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:44.932 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.923+0000 7f9e3bfff640 1 -- 172.21.15.142:0/2479452850 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9f60021910 con 0x55b00059ed50 2024-09-22T08:36:44.932 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.923+0000 7f9e3bfff640 1 -- 172.21.15.142:0/2479452850 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f60052070 con 0x55b00059ed50 2024-09-22T08:36:44.932 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.923+0000 7f9e3bfff640 1 -- 172.21.15.142:0/2479452850 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9f60021440 con 0x55b00059ed50 2024-09-22T08:36:44.932 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.924+0000 7f9f68b25800 1 -- 172.21.15.142:0/2479452850 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b00059ed50 msgr2=0x55b00059f150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:44.932 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.924+0000 7f9f68b25800 1 --2- 172.21.15.142:0/2479452850 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b00059ed50 0x55b00059f150 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f9f60054840 tx=0x7f9f600204d0 comp rx=0 tx=0).stop 2024-09-22T08:36:44.932 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.924+0000 7f9f68b25800 1 -- 172.21.15.142:0/2479452850 shutdown_connections 2024-09-22T08:36:44.933 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.924+0000 7f9f68b25800 1 --2- 172.21.15.142:0/2479452850 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b00059ed50 0x55b00059f150 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:44.933 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.924+0000 7f9f68b25800 1 -- 172.21.15.142:0/2479452850 >> 172.21.15.142:0/2479452850 conn(0x55b00059b150 msgr2=0x55b000599390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:44.933 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.924+0000 7f9f68b25800 1 -- 172.21.15.142:0/2479452850 shutdown_connections 2024-09-22T08:36:44.933 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.924+0000 7f9f68b25800 1 -- 172.21.15.142:0/2479452850 wait complete. 2024-09-22T08:36:44.933 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.924+0000 7f9f68b25800 1 Processor -- start 2024-09-22T08:36:44.933 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.924+0000 7f9f68b25800 1 -- start start 2024-09-22T08:36:44.933 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.924+0000 7f9f68b25800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b00059ed50 0x55b0005a62d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:44.933 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.924+0000 7f9f68b25800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55b00059fd30 con 0x55b00059ed50 2024-09-22T08:36:44.933 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.924+0000 7f9f650a3640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b00059ed50 0x55b0005a62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:44.933 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.924+0000 7f9f650a3640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b00059ed50 0x55b0005a62d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:38808/0 (socket says 172.21.15.142:38808) 2024-09-22T08:36:44.933 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.924+0000 7f9f650a3640 1 -- 172.21.15.142:0/2272062311 learned_addr learned my addr 172.21.15.142:0/2272062311 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:44.933 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.925+0000 7f9f650a3640 1 -- 172.21.15.142:0/2272062311 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b0005a6830 con 0x55b00059ed50 2024-09-22T08:36:44.933 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.925+0000 7f9f650a3640 1 --2- 172.21.15.142:0/2272062311 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b00059ed50 0x55b0005a62d0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f9f6001fcf0 tx=0x7f9f600547a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:44.933 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.925+0000 7f9e3a7fc640 1 -- 172.21.15.142:0/2272062311 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9f60013db0 con 0x55b00059ed50 2024-09-22T08:36:44.934 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.925+0000 7f9e3a7fc640 1 -- 172.21.15.142:0/2272062311 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f600459e0 con 0x55b00059ed50 2024-09-22T08:36:44.934 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.925+0000 7f9f68b25800 1 -- 172.21.15.142:0/2272062311 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b0005a6ac0 con 0x55b00059ed50 2024-09-22T08:36:44.934 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.925+0000 7f9e3a7fc640 1 -- 172.21.15.142:0/2272062311 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9f60045d00 con 0x55b00059ed50 2024-09-22T08:36:44.934 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.925+0000 7f9f68b25800 1 -- 172.21.15.142:0/2272062311 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b0005a7650 con 0x55b00059ed50 2024-09-22T08:36:44.934 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.926+0000 7f9e3a7fc640 1 -- 172.21.15.142:0/2272062311 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f9f600451d0 con 0x55b00059ed50 2024-09-22T08:36:44.934 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.926+0000 7f9e3a7fc640 1 --2- 172.21.15.142:0/2272062311 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f9e3003cfa0 0x7f9e3003f460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:44.934 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.926+0000 7f9e3a7fc640 1 -- 172.21.15.142:0/2272062311 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f9f6004c030 con 0x55b00059ed50 2024-09-22T08:36:44.934 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.926+0000 7f9f648a2640 1 --2- 172.21.15.142:0/2272062311 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f9e3003cfa0 0x7f9e3003f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:44.934 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.927+0000 7f9f68b25800 20 rados->read ofs=0 len=0 2024-09-22T08:36:44.934 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.927+0000 7f9f648a2640 1 --2- 172.21.15.142:0/2272062311 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f9e3003cfa0 0x7f9e3003f460 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f9f58001b10 tx=0x7f9f58047000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:44.934 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.927+0000 7f9f68b25800 1 --2- 172.21.15.142:0/2272062311 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55b0005b1c20 0x55b0005b40e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:44.934 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.927+0000 7f9f68b25800 1 -- 172.21.15.142:0/2272062311 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b0005b4830 con 0x55b0005b1c20 2024-09-22T08:36:44.934 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.927+0000 7f9f5ffff640 1 --2- 172.21.15.142:0/2272062311 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55b0005b1c20 0x55b0005b40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:44.935 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.927+0000 7f9f5ffff640 1 --2- 172.21.15.142:0/2272062311 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55b0005b1c20 0x55b0005b40e0 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:44.935 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.927+0000 7f9f5ffff640 1 -- 172.21.15.142:0/2272062311 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9f50051070 con 0x55b0005b1c20 2024-09-22T08:36:44.935 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.927+0000 7f9f68b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:44.935 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.927+0000 7f9f68b25800 20 realm 2024-09-22T08:36:44.935 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.927+0000 7f9f68b25800 20 rados->read ofs=0 len=0 2024-09-22T08:36:44.935 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.927+0000 7f9f68b25800 1 -- 172.21.15.142:0/2272062311 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b0005b4c60 con 0x55b0005b1c20 2024-09-22T08:36:44.935 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.928+0000 7f9f5ffff640 1 -- 172.21.15.142:0/2272062311 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9f50051070 con 0x55b0005b1c20 2024-09-22T08:36:44.935 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.928+0000 7f9f68b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:44.935 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.928+0000 7f9f68b25800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:36:44.935 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.928+0000 7f9f68b25800 20 rados->read ofs=0 len=0 2024-09-22T08:36:44.935 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.928+0000 7f9f68b25800 1 -- 172.21.15.142:0/2272062311 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b0005b5530 con 0x55b0005b1c20 2024-09-22T08:36:44.935 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.928+0000 7f9f5ffff640 1 -- 172.21.15.142:0/2272062311 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9f50051070 con 0x55b0005b1c20 2024-09-22T08:36:44.935 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.928+0000 7f9f68b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:44.935 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.928+0000 7f9f68b25800 20 rados->read ofs=0 len=0 2024-09-22T08:36:44.936 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.928+0000 7f9f68b25800 1 -- 172.21.15.142:0/2272062311 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b0005b58d0 con 0x55b0005b1c20 2024-09-22T08:36:44.936 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.928+0000 7f9f5ffff640 1 -- 172.21.15.142:0/2272062311 <== osd.1 v2:172.21.15.142:6816/3192108003 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9f50051070 con 0x55b0005b1c20 2024-09-22T08:36:44.936 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.928+0000 7f9f68b25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:36:44.936 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.928+0000 7f9f68b25800 20 rados->read ofs=0 len=0 2024-09-22T08:36:44.936 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.928+0000 7f9f68b25800 1 --2- 172.21.15.142:0/2272062311 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55b0005b6630 0x55b0005b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:44.936 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.928+0000 7f9f68b25800 1 -- 172.21.15.142:0/2272062311 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b0005b9030 con 0x55b0005b6630 2024-09-22T08:36:44.936 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.928+0000 7f9f650a3640 1 --2- 172.21.15.142:0/2272062311 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55b0005b6630 0x55b0005b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:44.936 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.928+0000 7f9f650a3640 1 --2- 172.21.15.142:0/2272062311 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55b0005b6630 0x55b0005b8a20 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:44.936 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.929+0000 7f9f650a3640 1 -- 172.21.15.142:0/2272062311 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(5 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f9f6003a070 con 0x55b0005b6630 2024-09-22T08:36:44.936 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.929+0000 7f9f68b25800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:36:44.936 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.929+0000 7f9f68b25800 20 searching for the correct realm 2024-09-22T08:36:44.936 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.929+0000 7f9f68b25800 1 -- 172.21.15.142:0/2272062311 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b0005ba960 con 0x55b0005b6630 2024-09-22T08:36:44.936 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.929+0000 7f9f650a3640 1 -- 172.21.15.142:0/2272062311 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f6003a070 con 0x55b0005b6630 2024-09-22T08:36:44.936 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.929+0000 7f9f650a3640 1 --2- 172.21.15.142:0/2272062311 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f9f60054c20 0x7f9f6004d800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:44.937 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.929+0000 7f9f650a3640 1 -- 172.21.15.142:0/2272062311 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b0005ba960 con 0x7f9f60054c20 2024-09-22T08:36:44.937 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.929+0000 7f9f648a2640 1 --2- 172.21.15.142:0/2272062311 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f9f60054c20 0x7f9f6004d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:44.937 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.929+0000 7f9f648a2640 1 --2- 172.21.15.142:0/2272062311 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f9f60054c20 0x7f9f6004d800 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:44.937 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.930+0000 7f9f648a2640 1 -- 172.21.15.142:0/2272062311 <== osd.2 v2:172.21.15.142:6808/279438927 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f580187b0 con 0x7f9f60054c20 2024-09-22T08:36:44.937 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.930+0000 7f9f648a2640 1 --2- 172.21.15.142:0/2272062311 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f9f58017050 0x7f9f5803e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:44.937 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.930+0000 7f9f648a2640 1 -- 172.21.15.142:0/2272062311 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b0005ba960 con 0x7f9f58017050 2024-09-22T08:36:44.937 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.930+0000 7f9f5ffff640 1 --2- 172.21.15.142:0/2272062311 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f9f58017050 0x7f9f5803e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:44.937 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.930+0000 7f9f5ffff640 1 --2- 172.21.15.142:0/2272062311 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f9f58017050 0x7f9f5803e0e0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:44.945 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.930+0000 7f9f5ffff640 1 -- 172.21.15.142:0/2272062311 <== osd.0 v2:172.21.15.31:6800/168281188 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f50051070 con 0x7f9f58017050 2024-09-22T08:36:44.945 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.930+0000 7f9f5ffff640 1 -- 172.21.15.142:0/2272062311 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b0005ba960 con 0x55b0005b1c20 2024-09-22T08:36:44.946 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.931+0000 7f9f5ffff640 1 -- 172.21.15.142:0/2272062311 <== osd.1 v2:172.21.15.142:6816/3192108003 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f50051070 con 0x55b0005b1c20 2024-09-22T08:36:44.946 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.931+0000 7f9f5ffff640 1 -- 172.21.15.142:0/2272062311 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b0005ba960 con 0x55b0005b1c20 2024-09-22T08:36:44.946 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.931+0000 7f9f5ffff640 1 -- 172.21.15.142:0/2272062311 <== osd.1 v2:172.21.15.142:6816/3192108003 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f50051070 con 0x55b0005b1c20 2024-09-22T08:36:44.946 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.931+0000 7f9f5ffff640 1 -- 172.21.15.142:0/2272062311 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b0005ba960 con 0x7f9f58017050 2024-09-22T08:36:44.946 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.931+0000 7f9f5ffff640 1 -- 172.21.15.142:0/2272062311 <== osd.0 v2:172.21.15.31:6800/168281188 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f50051070 con 0x7f9f58017050 2024-09-22T08:36:44.946 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.931+0000 7f9f5ffff640 1 -- 172.21.15.142:0/2272062311 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b0005ba960 con 0x7f9f58017050 2024-09-22T08:36:44.946 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.931+0000 7f9f5ffff640 1 -- 172.21.15.142:0/2272062311 <== osd.0 v2:172.21.15.31:6800/168281188 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f50051070 con 0x7f9f58017050 2024-09-22T08:36:44.946 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.931+0000 7f9f5ffff640 1 -- 172.21.15.142:0/2272062311 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b0005ba960 con 0x7f9f60054c20 2024-09-22T08:36:44.946 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.932+0000 7f9f648a2640 1 -- 172.21.15.142:0/2272062311 <== osd.2 v2:172.21.15.142:6808/279438927 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f580187b0 con 0x7f9f60054c20 2024-09-22T08:36:44.946 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.932+0000 7f9f648a2640 1 -- 172.21.15.142:0/2272062311 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b0005ba960 con 0x55b0005b6630 2024-09-22T08:36:44.946 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.932+0000 7f9f650a3640 1 -- 172.21.15.142:0/2272062311 <== osd.3 v2:172.21.15.142:6800/1064901393 3 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f6003a070 con 0x55b0005b6630 2024-09-22T08:36:44.946 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.932+0000 7f9f650a3640 1 -- 172.21.15.142:0/2272062311 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b0005ba960 con 0x55b0005b1c20 2024-09-22T08:36:44.946 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.932+0000 7f9f5ffff640 1 -- 172.21.15.142:0/2272062311 <== osd.1 v2:172.21.15.142:6816/3192108003 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f50051070 con 0x55b0005b1c20 2024-09-22T08:36:44.947 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.932+0000 7f9f5ffff640 1 -- 172.21.15.142:0/2272062311 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b0005ba960 con 0x7f9f58017050 2024-09-22T08:36:44.947 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.932+0000 7f9f5ffff640 1 -- 172.21.15.142:0/2272062311 <== osd.0 v2:172.21.15.31:6800/168281188 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f50051070 con 0x7f9f58017050 2024-09-22T08:36:44.947 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.932+0000 7f9f5ffff640 1 -- 172.21.15.142:0/2272062311 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b0005ba960 con 0x55b0005b1c20 2024-09-22T08:36:44.947 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.932+0000 7f9f5ffff640 1 -- 172.21.15.142:0/2272062311 <== osd.1 v2:172.21.15.142:6816/3192108003 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f50051070 con 0x55b0005b1c20 2024-09-22T08:36:44.947 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.932+0000 7f9f5ffff640 1 -- 172.21.15.142:0/2272062311 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b0005ba960 con 0x7f9f60054c20 2024-09-22T08:36:44.947 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.933+0000 7f9f648a2640 1 -- 172.21.15.142:0/2272062311 <== osd.2 v2:172.21.15.142:6808/279438927 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f9f580187b0 con 0x7f9f60054c20 2024-09-22T08:36:44.947 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.933+0000 7f9f648a2640 1 -- 172.21.15.142:0/2272062311 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b0005ba960 con 0x55b0005b6630 2024-09-22T08:36:44.947 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.933+0000 7f9f650a3640 1 -- 172.21.15.142:0/2272062311 <== osd.3 v2:172.21.15.142:6800/1064901393 4 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f6003a070 con 0x55b0005b6630 2024-09-22T08:36:44.947 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.933+0000 7f9f650a3640 1 -- 172.21.15.142:0/2272062311 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b0005ba960 con 0x55b0005b6630 2024-09-22T08:36:44.947 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.933+0000 7f9f650a3640 1 -- 172.21.15.142:0/2272062311 <== osd.3 v2:172.21.15.142:6800/1064901393 5 ==== osd_op_reply(20 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f9f6003a070 con 0x55b0005b6630 2024-09-22T08:36:44.947 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.933+0000 7f9f650a3640 1 -- 172.21.15.142:0/2272062311 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b0005ba960 con 0x7f9f58017050 2024-09-22T08:36:44.947 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.933+0000 7f9f5ffff640 1 -- 172.21.15.142:0/2272062311 <== osd.0 v2:172.21.15.31:6800/168281188 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f50051070 con 0x7f9f58017050 2024-09-22T08:36:44.947 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.933+0000 7f9f5ffff640 1 -- 172.21.15.142:0/2272062311 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b0005ba960 con 0x55b0005b6630 2024-09-22T08:36:44.948 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.934+0000 7f9f650a3640 1 -- 172.21.15.142:0/2272062311 <== osd.3 v2:172.21.15.142:6800/1064901393 6 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f6003a070 con 0x55b0005b6630 2024-09-22T08:36:44.948 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.934+0000 7f9f650a3640 1 -- 172.21.15.142:0/2272062311 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b0005ba960 con 0x55b0005b6630 2024-09-22T08:36:44.948 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.934+0000 7f9f650a3640 1 -- 172.21.15.142:0/2272062311 <== osd.3 v2:172.21.15.142:6800/1064901393 7 ==== osd_op_reply(23 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f9f6003a070 con 0x55b0005b6630 2024-09-22T08:36:44.948 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.934+0000 7f9f650a3640 1 -- 172.21.15.142:0/2272062311 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b0005ba960 con 0x55b0005b1c20 2024-09-22T08:36:44.948 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.934+0000 7f9f5ffff640 1 -- 172.21.15.142:0/2272062311 <== osd.1 v2:172.21.15.142:6816/3192108003 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f50051070 con 0x55b0005b1c20 2024-09-22T08:36:44.948 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.934+0000 7f9f5ffff640 1 -- 172.21.15.142:0/2272062311 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b0005ba960 con 0x55b0005b1c20 2024-09-22T08:36:44.948 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.934+0000 7f9f5ffff640 1 -- 172.21.15.142:0/2272062311 <== osd.1 v2:172.21.15.142:6816/3192108003 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f9f50051070 con 0x55b0005b1c20 2024-09-22T08:36:44.948 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.934+0000 7f9f5ffff640 1 -- 172.21.15.142:0/2272062311 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b0005ba960 con 0x7f9f58017050 2024-09-22T08:36:44.948 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.935+0000 7f9f5ffff640 1 -- 172.21.15.142:0/2272062311 <== osd.0 v2:172.21.15.31:6800/168281188 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f50051070 con 0x7f9f58017050 2024-09-22T08:36:44.948 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.935+0000 7f9f5ffff640 1 -- 172.21.15.142:0/2272062311 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b0005ba960 con 0x55b0005b6630 2024-09-22T08:36:44.949 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.935+0000 7f9f650a3640 1 -- 172.21.15.142:0/2272062311 <== osd.3 v2:172.21.15.142:6800/1064901393 8 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f6003a070 con 0x55b0005b6630 2024-09-22T08:36:44.949 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.935+0000 7f9f650a3640 1 -- 172.21.15.142:0/2272062311 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b0005ba960 con 0x7f9f60054c20 2024-09-22T08:36:44.949 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.935+0000 7f9f648a2640 1 -- 172.21.15.142:0/2272062311 <== osd.2 v2:172.21.15.142:6808/279438927 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f580187b0 con 0x7f9f60054c20 2024-09-22T08:36:44.949 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.935+0000 7f9f648a2640 1 -- 172.21.15.142:0/2272062311 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b0005ba960 con 0x55b0005b1c20 2024-09-22T08:36:44.949 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.935+0000 7f9f5ffff640 1 -- 172.21.15.142:0/2272062311 <== osd.1 v2:172.21.15.142:6816/3192108003 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f50051070 con 0x55b0005b1c20 2024-09-22T08:36:44.949 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.935+0000 7f9f5ffff640 1 -- 172.21.15.142:0/2272062311 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b0005ba960 con 0x7f9f58017050 2024-09-22T08:36:44.949 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.936+0000 7f9f5ffff640 1 -- 172.21.15.142:0/2272062311 <== osd.0 v2:172.21.15.31:6800/168281188 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f50051070 con 0x7f9f58017050 2024-09-22T08:36:44.949 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.936+0000 7f9f5ffff640 1 -- 172.21.15.142:0/2272062311 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b0005ba960 con 0x55b0005b6630 2024-09-22T08:36:44.949 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.936+0000 7f9f650a3640 1 -- 172.21.15.142:0/2272062311 <== osd.3 v2:172.21.15.142:6800/1064901393 9 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f6003a070 con 0x55b0005b6630 2024-09-22T08:36:44.949 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.936+0000 7f9f650a3640 1 -- 172.21.15.142:0/2272062311 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b0005ba960 con 0x7f9f58017050 2024-09-22T08:36:44.949 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.936+0000 7f9f5ffff640 1 -- 172.21.15.142:0/2272062311 <== osd.0 v2:172.21.15.31:6800/168281188 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f50051070 con 0x7f9f58017050 2024-09-22T08:36:44.949 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.936+0000 7f9f5ffff640 1 -- 172.21.15.142:0/2272062311 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b0005ba960 con 0x7f9f60054c20 2024-09-22T08:36:44.949 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.936+0000 7f9f648a2640 1 -- 172.21.15.142:0/2272062311 <== osd.2 v2:172.21.15.142:6808/279438927 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f580187b0 con 0x7f9f60054c20 2024-09-22T08:36:44.950 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.936+0000 7f9f648a2640 1 -- 172.21.15.142:0/2272062311 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b0005ba960 con 0x55b0005b6630 2024-09-22T08:36:44.950 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.936+0000 7f9f650a3640 1 -- 172.21.15.142:0/2272062311 <== osd.3 v2:172.21.15.142:6800/1064901393 10 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f6003a070 con 0x55b0005b6630 2024-09-22T08:36:44.950 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.937+0000 7f9f650a3640 1 -- 172.21.15.142:0/2272062311 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b0005ba960 con 0x7f9f58017050 2024-09-22T08:36:44.950 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.937+0000 7f9f5ffff640 1 -- 172.21.15.142:0/2272062311 <== osd.0 v2:172.21.15.31:6800/168281188 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f50051070 con 0x7f9f58017050 2024-09-22T08:36:44.950 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.937+0000 7f9f5ffff640 1 -- 172.21.15.142:0/2272062311 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b0005ba960 con 0x55b0005b1c20 2024-09-22T08:36:44.950 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.937+0000 7f9f5ffff640 1 -- 172.21.15.142:0/2272062311 <== osd.1 v2:172.21.15.142:6816/3192108003 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f9f50051070 con 0x55b0005b1c20 2024-09-22T08:36:44.950 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.937+0000 7f9f5ffff640 1 -- 172.21.15.142:0/2272062311 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b0005ba960 con 0x7f9f60054c20 2024-09-22T08:36:44.950 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.937+0000 7f9f648a2640 1 -- 172.21.15.142:0/2272062311 <== osd.2 v2:172.21.15.142:6808/279438927 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f580187b0 con 0x7f9f60054c20 2024-09-22T08:36:44.950 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.937+0000 7f9f68b25800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:36:44.950 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.937+0000 7f9f68b25800 20 RGWRados::pool_iterate: got zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec 2024-09-22T08:36:44.950 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.937+0000 7f9f68b25800 20 RGWRados::pool_iterate: got zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f 2024-09-22T08:36:44.950 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.937+0000 7f9f68b25800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:36:44.950 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.937+0000 7f9f68b25800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:36:44.951 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.937+0000 7f9f68b25800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:36:44.951 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.937+0000 7f9f68b25800 20 rados->read ofs=0 len=0 2024-09-22T08:36:44.951 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.937+0000 7f9f68b25800 1 -- 172.21.15.142:0/2272062311 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b0005b99f0 con 0x55b0005b1c20 2024-09-22T08:36:44.951 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.937+0000 7f9f5ffff640 1 -- 172.21.15.142:0/2272062311 <== osd.1 v2:172.21.15.142:6816/3192108003 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9f50051070 con 0x55b0005b1c20 2024-09-22T08:36:44.951 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.937+0000 7f9f68b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:44.951 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.937+0000 7f9f68b25800 20 rados->read ofs=0 len=0 2024-09-22T08:36:44.951 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.937+0000 7f9f68b25800 1 -- 172.21.15.142:0/2272062311 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b0005ba240 con 0x55b0005b1c20 2024-09-22T08:36:44.951 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.938+0000 7f9f5ffff640 1 -- 172.21.15.142:0/2272062311 <== osd.1 v2:172.21.15.142:6816/3192108003 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9f50051070 con 0x55b0005b1c20 2024-09-22T08:36:44.951 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.938+0000 7f9f68b25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:36:44.951 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.938+0000 7f9f68b25800 20 rados->read ofs=0 len=0 2024-09-22T08:36:44.951 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.938+0000 7f9f68b25800 1 -- 172.21.15.142:0/2272062311 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:40 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b0005bade0 con 0x55b0005b6630 2024-09-22T08:36:44.951 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.938+0000 7f9f650a3640 1 -- 172.21.15.142:0/2272062311 <== osd.3 v2:172.21.15.142:6800/1064901393 11 ==== osd_op_reply(40 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f9f6003a070 con 0x55b0005b6630 2024-09-22T08:36:44.951 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.938+0000 7f9f68b25800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:36:44.952 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.938+0000 7f9f68b25800 20 zone default found 2024-09-22T08:36:44.952 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.938+0000 7f9f68b25800 4 Realm: () 2024-09-22T08:36:44.952 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.938+0000 7f9f68b25800 4 ZoneGroup: default (d89f6f57-1007-47dd-9065-f486c7b01aec) 2024-09-22T08:36:44.952 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.938+0000 7f9f68b25800 4 Zone: default (e239248c-0bee-4e41-803a-24b288d3eb8f) 2024-09-22T08:36:44.952 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.938+0000 7f9f68b25800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:36:44.952 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.938+0000 7f9f68b25800 20 zonegroup default 2024-09-22T08:36:44.952 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.938+0000 7f9f68b25800 20 rados->read ofs=0 len=0 2024-09-22T08:36:44.952 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.938+0000 7f9f68b25800 1 -- 172.21.15.142:0/2272062311 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b0005bb1c0 con 0x7f9f58017050 2024-09-22T08:36:44.952 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.938+0000 7f9f5ffff640 1 -- 172.21.15.142:0/2272062311 <== osd.0 v2:172.21.15.31:6800/168281188 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f9f50051070 con 0x7f9f58017050 2024-09-22T08:36:44.952 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.938+0000 7f9f68b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:44.952 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.938+0000 7f9f68b25800 20 rados->read ofs=0 len=0 2024-09-22T08:36:44.952 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.938+0000 7f9f68b25800 1 -- 172.21.15.142:0/2272062311 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b0005bd4a0 con 0x55b0005b6630 2024-09-22T08:36:44.952 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.939+0000 7f9f650a3640 1 -- 172.21.15.142:0/2272062311 <== osd.3 v2:172.21.15.142:6800/1064901393 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9f6003a070 con 0x55b0005b6630 2024-09-22T08:36:44.952 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.939+0000 7f9f68b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:44.953 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.939+0000 7f9f68b25800 20 rados->read ofs=0 len=0 2024-09-22T08:36:44.953 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.939+0000 7f9f68b25800 1 -- 172.21.15.142:0/2272062311 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b0005bd840 con 0x55b0005b6630 2024-09-22T08:36:44.953 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.939+0000 7f9f650a3640 1 -- 172.21.15.142:0/2272062311 <== osd.3 v2:172.21.15.142:6800/1064901393 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9f6003a070 con 0x55b0005b6630 2024-09-22T08:36:44.953 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.939+0000 7f9f68b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:44.953 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.939+0000 7f9f68b25800 20 started sync module instance, tier type = 2024-09-22T08:36:44.953 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.939+0000 7f9f68b25800 20 started zone id=e239248c-0bee-4e41-803a-24b288d3eb8f (name=default) with tier type = 2024-09-22T08:36:44.953 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.939+0000 7f9f68b25800 1 -- 172.21.15.142:0/2272062311 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b0005bc930 con 0x7f9f60054c20 2024-09-22T08:36:44.953 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.940+0000 7f9f648a2640 1 -- 172.21.15.142:0/2272062311 <== osd.2 v2:172.21.15.142:6808/279438927 7 ==== osd_op_reply(44 notify.0 [create] v30'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9f580187b0 con 0x7f9f60054c20 2024-09-22T08:36:44.953 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.940+0000 7f9f68b25800 1 -- 172.21.15.142:0/2272062311 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94214408621392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b0005bc590 con 0x7f9f60054c20 2024-09-22T08:36:44.953 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.940+0000 7f9f68b25800 1 -- 172.21.15.142:0/2272062311 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b0005be770 con 0x55b0005b1c20 2024-09-22T08:36:44.953 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.941+0000 7f9f648a2640 1 -- 172.21.15.142:0/2272062311 <== osd.2 v2:172.21.15.142:6808/279438927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94214408621392] v30'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9f580187b0 con 0x7f9f60054c20 2024-09-22T08:36:44.953 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.941+0000 7f9f5ffff640 1 -- 172.21.15.142:0/2272062311 <== osd.1 v2:172.21.15.142:6816/3192108003 15 ==== osd_op_reply(46 notify.1 [create] v30'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9f50051070 con 0x55b0005b1c20 2024-09-22T08:36:44.953 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.941+0000 7f9f68b25800 1 -- 172.21.15.142:0/2272062311 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94214408626880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b0005beb90 con 0x55b0005b1c20 2024-09-22T08:36:44.954 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.941+0000 7f9f68b25800 1 -- 172.21.15.142:0/2272062311 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b0005bf550 con 0x55b0005b6630 2024-09-22T08:36:44.954 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.942+0000 7f9f5ffff640 1 -- 172.21.15.142:0/2272062311 <== osd.1 v2:172.21.15.142:6816/3192108003 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94214408626880] v30'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9f50051070 con 0x55b0005b1c20 2024-09-22T08:36:44.954 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.942+0000 7f9f650a3640 1 -- 172.21.15.142:0/2272062311 <== osd.3 v2:172.21.15.142:6800/1064901393 14 ==== osd_op_reply(48 notify.2 [create] v30'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9f6003a070 con 0x55b0005b6630 2024-09-22T08:36:44.954 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.942+0000 7f9f68b25800 1 -- 172.21.15.142:0/2272062311 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94214408630912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b0005beb90 con 0x55b0005b6630 2024-09-22T08:36:44.954 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.942+0000 7f9f68b25800 1 -- 172.21.15.142:0/2272062311 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b0005bffa0 con 0x7f9f60054c20 2024-09-22T08:36:44.954 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.943+0000 7f9f648a2640 1 -- 172.21.15.142:0/2272062311 <== osd.2 v2:172.21.15.142:6808/279438927 9 ==== osd_op_reply(50 notify.3 [create] v30'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9f580187b0 con 0x7f9f60054c20 2024-09-22T08:36:44.954 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.943+0000 7f9f68b25800 1 -- 172.21.15.142:0/2272062311 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94214408633008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b0005c0840 con 0x7f9f60054c20 2024-09-22T08:36:44.954 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.943+0000 7f9f68b25800 1 -- 172.21.15.142:0/2272062311 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b0005c1310 con 0x55b0005b1c20 2024-09-22T08:36:44.954 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.943+0000 7f9f650a3640 1 -- 172.21.15.142:0/2272062311 <== osd.3 v2:172.21.15.142:6800/1064901393 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94214408630912] v30'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9f6003a070 con 0x55b0005b6630 2024-09-22T08:36:44.958 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.946+0000 7f9f5ffff640 1 -- 172.21.15.142:0/2272062311 <== osd.1 v2:172.21.15.142:6816/3192108003 17 ==== osd_op_reply(52 notify.4 [create] v30'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9f50051070 con 0x55b0005b1c20 2024-09-22T08:36:44.959 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.946+0000 7f9f68b25800 1 -- 172.21.15.142:0/2272062311 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94214408627936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b0005c1700 con 0x55b0005b1c20 2024-09-22T08:36:44.959 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.946+0000 7f9f68b25800 1 -- 172.21.15.142:0/2272062311 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b0005c2140 con 0x7f9f58017050 2024-09-22T08:36:44.959 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.946+0000 7f9f648a2640 1 -- 172.21.15.142:0/2272062311 <== osd.2 v2:172.21.15.142:6808/279438927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94214408633008] v30'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9f580187b0 con 0x7f9f60054c20 2024-09-22T08:36:44.959 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.947+0000 7f9f5ffff640 1 -- 172.21.15.142:0/2272062311 <== osd.0 v2:172.21.15.31:6800/168281188 11 ==== osd_op_reply(54 notify.5 [create] v30'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9f50051070 con 0x7f9f58017050 2024-09-22T08:36:44.959 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.947+0000 7f9f68b25800 1 -- 172.21.15.142:0/2272062311 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94214408641552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b0005c2100 con 0x7f9f58017050 2024-09-22T08:36:44.959 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.947+0000 7f9f68b25800 1 -- 172.21.15.142:0/2272062311 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b0005c2b90 con 0x7f9f58017050 2024-09-22T08:36:44.959 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.947+0000 7f9f5ffff640 1 -- 172.21.15.142:0/2272062311 <== osd.1 v2:172.21.15.142:6816/3192108003 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94214408627936] v30'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9f50051070 con 0x55b0005b1c20 2024-09-22T08:36:44.959 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.948+0000 7f9f5ffff640 1 -- 172.21.15.142:0/2272062311 <== osd.0 v2:172.21.15.31:6800/168281188 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94214408641552] v30'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9f50051070 con 0x7f9f58017050 2024-09-22T08:36:44.959 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.949+0000 7f9f5ffff640 1 -- 172.21.15.142:0/2272062311 <== osd.0 v2:172.21.15.31:6800/168281188 13 ==== osd_op_reply(56 notify.6 [create] v30'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9f50051070 con 0x7f9f58017050 2024-09-22T08:36:44.959 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.949+0000 7f9f68b25800 1 -- 172.21.15.142:0/2272062311 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94214408635280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b0005c0dd0 con 0x7f9f58017050 2024-09-22T08:36:44.959 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.949+0000 7f9f68b25800 1 -- 172.21.15.142:0/2272062311 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b0005c3040 con 0x7f9f58017050 2024-09-22T08:36:44.959 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.950+0000 7f9f5ffff640 1 -- 172.21.15.142:0/2272062311 <== osd.0 v2:172.21.15.31:6800/168281188 14 ==== osd_op_reply(58 notify.7 [create] v30'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9f50051070 con 0x7f9f58017050 2024-09-22T08:36:44.960 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.950+0000 7f9f5ffff640 1 -- 172.21.15.142:0/2272062311 <== osd.0 v2:172.21.15.31:6800/168281188 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94214408635280] v30'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9f50051070 con 0x7f9f58017050 2024-09-22T08:36:44.960 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.950+0000 7f9f68b25800 1 -- 172.21.15.142:0/2272062311 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94214408645520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b0005c3460 con 0x7f9f58017050 2024-09-22T08:36:44.960 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.950+0000 7f9f68b25800 20 add_watcher() i=0 2024-09-22T08:36:44.960 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.950+0000 7f9f68b25800 20 add_watcher() i=1 2024-09-22T08:36:44.960 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.950+0000 7f9f68b25800 20 add_watcher() i=2 2024-09-22T08:36:44.960 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.950+0000 7f9f68b25800 20 add_watcher() i=3 2024-09-22T08:36:44.960 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.950+0000 7f9f68b25800 20 add_watcher() i=4 2024-09-22T08:36:44.960 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.950+0000 7f9f68b25800 20 add_watcher() i=5 2024-09-22T08:36:44.960 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.950+0000 7f9f68b25800 20 add_watcher() i=6 2024-09-22T08:36:44.960 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.951+0000 7f9f5ffff640 1 -- 172.21.15.142:0/2272062311 <== osd.0 v2:172.21.15.31:6800/168281188 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94214408645520] v30'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9f50051070 con 0x7f9f58017050 2024-09-22T08:36:44.960 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.951+0000 7f9f68b25800 20 add_watcher() i=7 2024-09-22T08:36:44.960 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.951+0000 7f9f68b25800 2 all 8 watchers are set, enabling cache 2024-09-22T08:36:44.960 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.951+0000 7f9f68b25800 1 -- 172.21.15.142:0/2272062311 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b0005c68b0 con 0x55b0005b1c20 2024-09-22T08:36:44.961 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.951+0000 7f9f5ffff640 1 -- 172.21.15.142:0/2272062311 <== osd.1 v2:172.21.15.142:6816/3192108003 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f9f50051070 con 0x55b0005b1c20 2024-09-22T08:36:44.961 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.951+0000 7f9f68b25800 1 -- 172.21.15.142:0/2272062311 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94214408646576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b0005c3d30 con 0x55b0005b1c20 2024-09-22T08:36:44.961 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.952+0000 7f9f5ffff640 1 -- 172.21.15.142:0/2272062311 <== osd.1 v2:172.21.15.142:6816/3192108003 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94214408646576] v30'84 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9f50051070 con 0x55b0005b1c20 2024-09-22T08:36:44.961 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.952+0000 7f9e1afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:36:44.961 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.953+0000 7f9f68b25800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:36:44.961 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.953+0000 7f9f68b25800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:36:44.961 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.953+0000 7f9f68b25800 5 note: GC not initialized 2024-09-22T08:36:44.961 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.953+0000 7f9e19fe3640 20 reqs_thread_entry: start 2024-09-22T08:36:44.961 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.953+0000 7f9f68b25800 20 init_complete bucket index max shards: 11 2024-09-22T08:36:44.961 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.953+0000 7f9f68b25800 20 Filter name: none 2024-09-22T08:36:44.961 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.953+0000 7f9d8b7fe640 20 reqs_thread_entry: start 2024-09-22T08:36:44.961 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.953+0000 7f9f68b25800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-22T08:36:44.961 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.953+0000 7f9f68b25800 20 rados->read ofs=0 len=0 2024-09-22T08:36:44.961 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.953+0000 7f9f68b25800 1 -- 172.21.15.142:0/2272062311 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b0005f9870 con 0x55b0005b1c20 2024-09-22T08:36:44.962 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.954+0000 7f9f5ffff640 1 -- 172.21.15.142:0/2272062311 <== osd.1 v2:172.21.15.142:6816/3192108003 21 ==== osd_op_reply(62 foo [call out=48b,read 0~582 out=582b,getxattrs out=75b] v0'0 uv9 ondisk = 0) ==== 231+0+705 (crc 0 0 0) 0x7f9f50051070 con 0x55b0005b1c20 2024-09-22T08:36:44.962 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.954+0000 7f9f68b25800 20 rados_obj.operate() r=0 bl.length=582 2024-09-22T08:36:44.962 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.954+0000 7f9f68b25800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-22T08:36:44.962 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.954+0000 7f9f68b25800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-22T08:36:44.962 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.954+0000 7f9f68b25800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:36:44.962 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.954+0000 7f9f68b25800 1 -- 172.21.15.142:0/2272062311 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~556 in=556b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b0005ffe80 con 0x55b0005b1c20 2024-09-22T08:36:44.962 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.955+0000 7f9f5ffff640 1 -- 172.21.15.142:0/2272062311 <== osd.1 v2:172.21.15.142:6816/3192108003 22 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~556] v30'10 uv10 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f9f50051070 con 0x55b0005b1c20 2024-09-22T08:36:44.962 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.955+0000 7f9f68b25800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-22T08:36:44.962 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.955+0000 7f9f68b25800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-22T08:36:44.962 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.955+0000 7f9f68b25800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-22T08:36:44.962 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.955+0000 7f9f68b25800 1 -- 172.21.15.142:0/2272062311 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94214408894592 in=744b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b0005fb830 con 0x55b0005b1c20 2024-09-22T08:36:44.962 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.955+0000 7f9f5ffff640 1 -- 172.21.15.142:0/2272062311 <== osd.1 v2:172.21.15.142:6816/3192108003 23 ==== watch-notify(notify (1) cookie 94214408627936 notify 128849018889 ret 0) ==== 774+0+0 (crc 0 0 0) 0x7f9f50081040 con 0x55b0005b1c20 2024-09-22T08:36:44.962 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.955+0000 7f9e3bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018889 cookie 94214408627936 notifier 4408 bl.length()=732 2024-09-22T08:36:44.963 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.955+0000 7f9e3bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-22T08:36:44.963 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.955+0000 7f9e3bfff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-22T08:36:44.963 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.955+0000 7f9e3bfff640 1 -- 172.21.15.142:0/2272062311 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f9e28003ea0 con 0x55b0005b1c20 2024-09-22T08:36:44.963 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.955+0000 7f9f5ffff640 1 -- 172.21.15.142:0/2272062311 <== osd.1 v2:172.21.15.142:6816/3192108003 24 ==== osd_op_reply(64 notify.4 [notify cookie 94214408894592 out=8b] v0'0 uv75 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f9f50051070 con 0x55b0005b1c20 2024-09-22T08:36:44.963 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.955+0000 7f9f5ffff640 1 -- 172.21.15.142:0/2272062311 <== osd.1 v2:172.21.15.142:6816/3192108003 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9f50051070 con 0x55b0005b1c20 2024-09-22T08:36:44.963 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.955+0000 7f9f5ffff640 1 -- 172.21.15.142:0/2272062311 <== osd.1 v2:172.21.15.142:6816/3192108003 26 ==== watch-notify(notify_complete (2) cookie 94214408894592 notify 128849018889 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55b0003f2880 con 0x55b0005b1c20 2024-09-22T08:36:44.963 INFO:teuthology.orchestra.run.smithi142.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-22T08:36:42.661297Z"}],"swift_keys":[{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true,"create_date":"2024-09-22T08:36:44.553654Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-22T08:36:42.661288Z","tags":[],"group_ids":[]} 2024-09-22T08:36:44.966 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.956+0000 7f9e1afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:36:44.966 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.956+0000 7f9f68b25800 1 -- 172.21.15.142:0/2272062311 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94214408646576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b0005f7590 con 0x55b0005b1c20 2024-09-22T08:36:44.966 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.957+0000 7f9f5ffff640 1 -- 172.21.15.142:0/2272062311 <== osd.1 v2:172.21.15.142:6816/3192108003 27 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94214408646576] v30'85 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9f50051070 con 0x55b0005b1c20 2024-09-22T08:36:44.966 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.957+0000 7f9f68b25800 1 -- 172.21.15.142:0/2272062311 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94214408621392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b0005f7590 con 0x7f9f60054c20 2024-09-22T08:36:44.966 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.958+0000 7f9f648a2640 1 -- 172.21.15.142:0/2272062311 <== osd.2 v2:172.21.15.142:6808/279438927 11 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94214408621392] v30'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9f580187b0 con 0x7f9f60054c20 2024-09-22T08:36:44.966 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.958+0000 7f9f68b25800 20 remove_watcher() i=0 2024-09-22T08:36:44.966 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.958+0000 7f9f68b25800 2 removed watcher, disabling cache 2024-09-22T08:36:44.966 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.958+0000 7f9f68b25800 1 -- 172.21.15.142:0/2272062311 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94214408626880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b0005f7590 con 0x55b0005b1c20 2024-09-22T08:36:44.966 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.959+0000 7f9f5ffff640 1 -- 172.21.15.142:0/2272062311 <== osd.1 v2:172.21.15.142:6816/3192108003 28 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94214408626880] v30'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9f50051070 con 0x55b0005b1c20 2024-09-22T08:36:44.966 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.960+0000 7f9f68b25800 20 remove_watcher() i=1 2024-09-22T08:36:44.966 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.960+0000 7f9f68b25800 1 -- 172.21.15.142:0/2272062311 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94214408630912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b0005f7590 con 0x55b0005b6630 2024-09-22T08:36:44.967 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.961+0000 7f9f650a3640 1 -- 172.21.15.142:0/2272062311 <== osd.3 v2:172.21.15.142:6800/1064901393 16 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94214408630912] v30'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9f6003a070 con 0x55b0005b6630 2024-09-22T08:36:44.967 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.961+0000 7f9f68b25800 20 remove_watcher() i=2 2024-09-22T08:36:44.967 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.961+0000 7f9f68b25800 1 -- 172.21.15.142:0/2272062311 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94214408633008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b0005f7590 con 0x7f9f60054c20 2024-09-22T08:36:44.967 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.962+0000 7f9f648a2640 1 -- 172.21.15.142:0/2272062311 <== osd.2 v2:172.21.15.142:6808/279438927 12 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94214408633008] v30'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9f580187b0 con 0x7f9f60054c20 2024-09-22T08:36:44.967 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.962+0000 7f9f68b25800 20 remove_watcher() i=3 2024-09-22T08:36:44.967 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.962+0000 7f9f68b25800 1 -- 172.21.15.142:0/2272062311 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94214408627936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b0005f7590 con 0x55b0005b1c20 2024-09-22T08:36:44.967 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.963+0000 7f9f5ffff640 1 -- 172.21.15.142:0/2272062311 <== osd.1 v2:172.21.15.142:6816/3192108003 29 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94214408627936] v30'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9f50051070 con 0x55b0005b1c20 2024-09-22T08:36:44.967 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.963+0000 7f9f68b25800 20 remove_watcher() i=4 2024-09-22T08:36:44.967 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.963+0000 7f9f68b25800 1 -- 172.21.15.142:0/2272062311 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94214408641552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b0005f7590 con 0x7f9f58017050 2024-09-22T08:36:44.967 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.964+0000 7f9f5ffff640 1 -- 172.21.15.142:0/2272062311 <== osd.0 v2:172.21.15.31:6800/168281188 17 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94214408641552] v30'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9f50051070 con 0x7f9f58017050 2024-09-22T08:36:44.967 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.964+0000 7f9f68b25800 20 remove_watcher() i=5 2024-09-22T08:36:44.967 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.964+0000 7f9f68b25800 1 -- 172.21.15.142:0/2272062311 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94214408635280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b0005f7590 con 0x7f9f58017050 2024-09-22T08:36:44.967 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.965+0000 7f9f5ffff640 1 -- 172.21.15.142:0/2272062311 <== osd.0 v2:172.21.15.31:6800/168281188 18 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94214408635280] v30'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9f50051070 con 0x7f9f58017050 2024-09-22T08:36:44.968 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.965+0000 7f9f68b25800 20 remove_watcher() i=6 2024-09-22T08:36:44.968 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.965+0000 7f9f68b25800 1 -- 172.21.15.142:0/2272062311 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94214408645520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b0005f7590 con 0x7f9f58017050 2024-09-22T08:36:44.970 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.966+0000 7f9f5ffff640 1 -- 172.21.15.142:0/2272062311 <== osd.0 v2:172.21.15.31:6800/168281188 19 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94214408645520] v30'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9f50051070 con 0x7f9f58017050 2024-09-22T08:36:44.970 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.966+0000 7f9f68b25800 20 remove_watcher() i=7 2024-09-22T08:36:44.971 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.966+0000 7f9f68b25800 1 -- 172.21.15.142:0/2272062311 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f9f58017050 msgr2=0x7f9f5803e0e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:44.971 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.966+0000 7f9f68b25800 1 --2- 172.21.15.142:0/2272062311 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f9f58017050 0x7f9f5803e0e0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:44.971 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.966+0000 7f9f68b25800 1 -- 172.21.15.142:0/2272062311 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55b0005b1c20 msgr2=0x55b0005b40e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:44.971 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.966+0000 7f9f68b25800 1 --2- 172.21.15.142:0/2272062311 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55b0005b1c20 0x55b0005b40e0 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:44.971 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.966+0000 7f9f68b25800 1 -- 172.21.15.142:0/2272062311 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f9f60054c20 msgr2=0x7f9f6004d800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:44.971 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.966+0000 7f9f68b25800 1 --2- 172.21.15.142:0/2272062311 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f9f60054c20 0x7f9f6004d800 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:44.971 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.966+0000 7f9f68b25800 1 -- 172.21.15.142:0/2272062311 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55b0005b6630 msgr2=0x55b0005b8a20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:44.971 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.966+0000 7f9f68b25800 1 --2- 172.21.15.142:0/2272062311 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55b0005b6630 0x55b0005b8a20 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:44.971 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.966+0000 7f9f68b25800 1 -- 172.21.15.142:0/2272062311 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f9e3003cfa0 msgr2=0x7f9e3003f460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:44.971 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.966+0000 7f9f68b25800 1 --2- 172.21.15.142:0/2272062311 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f9e3003cfa0 0x7f9e3003f460 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f9f58001b10 tx=0x7f9f58047000 comp rx=0 tx=0).stop 2024-09-22T08:36:44.971 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.966+0000 7f9f68b25800 1 -- 172.21.15.142:0/2272062311 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b00059ed50 msgr2=0x55b0005a62d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:44.971 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.966+0000 7f9f5ffff640 1 -- 172.21.15.142:0/2272062311 reap_dead start 2024-09-22T08:36:44.971 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.966+0000 7f9f68b25800 1 --2- 172.21.15.142:0/2272062311 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b00059ed50 0x55b0005a62d0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f9f6001fcf0 tx=0x7f9f600547a0 comp rx=0 tx=0).stop 2024-09-22T08:36:44.972 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.966+0000 7f9f68b25800 1 -- 172.21.15.142:0/2272062311 shutdown_connections 2024-09-22T08:36:44.972 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.966+0000 7f9f68b25800 1 --2- 172.21.15.142:0/2272062311 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b00059ed50 0x55b0005a62d0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:44.972 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.966+0000 7f9f68b25800 1 -- 172.21.15.142:0/2272062311 >> 172.21.15.142:0/2272062311 conn(0x55b00059b150 msgr2=0x55b000599360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:44.972 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.966+0000 7f9f68b25800 1 -- 172.21.15.142:0/2272062311 shutdown_connections 2024-09-22T08:36:44.972 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.966+0000 7f9f68b25800 1 -- 172.21.15.142:0/2272062311 wait complete. 2024-09-22T08:36:44.972 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.966+0000 7f9f68b25800 1 -- 172.21.15.142:0/2926606625 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f9e3c03cfb0 msgr2=0x7f9e3c03f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:44.972 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.966+0000 7f9f68b25800 1 --2- 172.21.15.142:0/2926606625 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f9e3c03cfb0 0x7f9e3c03f470 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x55b00057efb0 tx=0x7f9f5804d040 comp rx=0 tx=0).stop 2024-09-22T08:36:44.972 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.966+0000 7f9f68b25800 1 -- 172.21.15.142:0/2926606625 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b000592290 msgr2=0x55b0005926b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:44.972 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.966+0000 7f9f68b25800 1 --2- 172.21.15.142:0/2926606625 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b000592290 0x55b0005926b0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x55b000577db0 tx=0x7f9f600167b0 comp rx=0 tx=0).stop 2024-09-22T08:36:44.972 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.967+0000 7f9f68b25800 1 -- 172.21.15.142:0/2926606625 shutdown_connections 2024-09-22T08:36:44.972 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.967+0000 7f9f68b25800 1 --2- 172.21.15.142:0/2926606625 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f9e3c03cfb0 0x7f9e3c03f470 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:44.972 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.967+0000 7f9f68b25800 1 --2- 172.21.15.142:0/2926606625 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b000592290 0x55b0005926b0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:44.972 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.967+0000 7f9f68b25800 1 -- 172.21.15.142:0/2926606625 >> 172.21.15.142:0/2926606625 conn(0x55b000586640 msgr2=0x55b000586a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:44.972 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.967+0000 7f9f68b25800 1 -- 172.21.15.142:0/2926606625 shutdown_connections 2024-09-22T08:36:44.973 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.967+0000 7f9f68b25800 1 -- 172.21.15.142:0/2926606625 wait complete. 2024-09-22T08:36:44.973 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.967+0000 7f9f68b25800 1 -- 172.21.15.142:0/1800736118 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55b000578c30 msgr2=0x55b00057e570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:44.973 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.967+0000 7f9f68b25800 1 --2- 172.21.15.142:0/1800736118 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55b000578c30 0x55b00057e570 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:44.973 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.967+0000 7f9f68b25800 1 -- 172.21.15.142:0/1800736118 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55b000580e30 msgr2=0x55b000583220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:44.973 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.967+0000 7f9f68b25800 1 --2- 172.21.15.142:0/1800736118 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55b000580e30 0x55b000583220 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:44.973 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.967+0000 7f9f68b25800 1 -- 172.21.15.142:0/1800736118 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f9e4c03cfb0 msgr2=0x7f9e4c03f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:44.973 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.967+0000 7f9f68b25800 1 --2- 172.21.15.142:0/1800736118 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f9e4c03cfb0 0x7f9e4c03f470 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f9f50057000 tx=0x7f9f50052000 comp rx=0 tx=0).stop 2024-09-22T08:36:44.973 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.967+0000 7f9f68b25800 1 -- 172.21.15.142:0/1800736118 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b0003f3590 msgr2=0x55b000576f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:44.973 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.967+0000 7f9f68b25800 1 --2- 172.21.15.142:0/1800736118 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b0003f3590 0x55b000576f20 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f9f5800c010 tx=0x7f9f58000ed0 comp rx=0 tx=0).stop 2024-09-22T08:36:44.973 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.967+0000 7f9f68b25800 1 -- 172.21.15.142:0/1800736118 shutdown_connections 2024-09-22T08:36:44.973 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.967+0000 7f9f68b25800 1 --2- 172.21.15.142:0/1800736118 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55b000580e30 0x55b000583220 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:44.973 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.967+0000 7f9f68b25800 1 --2- 172.21.15.142:0/1800736118 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55b000578c30 0x55b00057e570 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:44.974 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.967+0000 7f9f68b25800 1 --2- 172.21.15.142:0/1800736118 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f9e4c03cfb0 0x7f9e4c03f470 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:44.974 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.967+0000 7f9f68b25800 1 --2- 172.21.15.142:0/1800736118 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b0003f3590 0x55b000576f20 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:44.974 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.967+0000 7f9f68b25800 1 -- 172.21.15.142:0/1800736118 >> 172.21.15.142:0/1800736118 conn(0x55b000478db0 msgr2=0x55b0005706f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:44.974 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.967+0000 7f9f68b25800 1 -- 172.21.15.142:0/1800736118 shutdown_connections 2024-09-22T08:36:44.974 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:44.967+0000 7f9f68b25800 1 -- 172.21.15.142:0/1800736118 wait complete. 2024-09-22T08:36:44.977 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-22T08:36:42.661297Z'}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True, 'create_date': '2024-09-22T08:36:44.553654Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-22T08:36:42.661288Z', 'tags': [], 'group_ids': []} 2024-09-22T08:36:44.977 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'rm', '--subuser', 'foo:foo2', '--key-type', 'swift', '--purge-keys'] 2024-09-22T08:36:44.977 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'rm', '--subuser', 'foo:foo2', '--key-type', 'swift', '--purge-keys'] 2024-09-22T08:36:44.978 DEBUG:teuthology.orchestra.run.smithi142:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser rm --subuser foo:foo2 --key-type swift --purge-keys 2024-09-22T08:36:45.025 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:36:45.025 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:36:45.026 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.024+0000 7fa165925800 1 Processor -- start 2024-09-22T08:36:45.026 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.024+0000 7fa165925800 1 -- start start 2024-09-22T08:36:45.026 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.024+0000 7fa165925800 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55986bd6bc10 0x55986bd6e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:45.026 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.024+0000 7fa165925800 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55986bbf0a20 con 0x55986bcd9530 2024-09-22T08:36:45.026 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.024+0000 7fa165925800 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x55986bbf07d0 con 0x55986bd6bc10 2024-09-22T08:36:45.026 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.025+0000 7fa160d32640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55986bd6bc10 0x55986bd6e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:45.026 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.025+0000 7fa161533640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x55986bcd9530 0x55986bd6a4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.142:42466/0 (socket says 172.21.15.142:42466) 2024-09-22T08:36:45.027 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.025+0000 7fa160d32640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55986bd6bc10 0x55986bd6e0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:38816/0 (socket says 172.21.15.142:38816) 2024-09-22T08:36:45.027 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.025+0000 7fa161533640 1 -- 172.21.15.142:0/1626692065 learned_addr learned my addr 172.21.15.142:0/1626692065 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-09-22T08:36:45.027 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.025+0000 7fa160d32640 1 -- 172.21.15.142:0/1626692065 >> v1:172.21.15.31:6789/0 conn(0x55986bcd9530 legacy=0x55986bd6a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:45.027 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.025+0000 7fa160d32640 1 -- 172.21.15.142:0/1626692065 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55986bd6f7b0 con 0x55986bd6bc10 2024-09-22T08:36:45.028 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.027+0000 7fa160d32640 1 --2- 172.21.15.142:0/1626692065 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55986bd6bc10 0x55986bd6e0d0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fa15800a470 tx=0x7fa158045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2704897c99e2c49 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:45.029 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.027+0000 7fa153fff640 1 -- 172.21.15.142:0/1626692065 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa158053570 con 0x55986bd6bc10 2024-09-22T08:36:45.029 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.027+0000 7fa153fff640 1 -- 172.21.15.142:0/1626692065 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa158058070 con 0x55986bd6bc10 2024-09-22T08:36:45.029 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.027+0000 7fa153fff640 1 -- 172.21.15.142:0/1626692065 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa158053880 con 0x55986bd6bc10 2024-09-22T08:36:45.029 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.027+0000 7fa165925800 1 -- 172.21.15.142:0/1626692065 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55986bd6bc10 msgr2=0x55986bd6e0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:45.029 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.027+0000 7fa165925800 1 --2- 172.21.15.142:0/1626692065 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55986bd6bc10 0x55986bd6e0d0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fa15800a470 tx=0x7fa158045a20 comp rx=0 tx=0).stop 2024-09-22T08:36:45.029 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.027+0000 7fa165925800 1 -- 172.21.15.142:0/1626692065 shutdown_connections 2024-09-22T08:36:45.029 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.027+0000 7fa165925800 1 --2- 172.21.15.142:0/1626692065 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55986bd6bc10 0x55986bd6e0d0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:45.029 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.027+0000 7fa165925800 1 -- 172.21.15.142:0/1626692065 >> 172.21.15.142:0/1626692065 conn(0x55986bd5fc00 msgr2=0x55986bd62040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:45.029 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.027+0000 7fa165925800 1 -- 172.21.15.142:0/1626692065 shutdown_connections 2024-09-22T08:36:45.029 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.027+0000 7fa165925800 1 -- 172.21.15.142:0/1626692065 wait complete. 2024-09-22T08:36:45.043 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.041+0000 7fa165925800 1 Processor -- start 2024-09-22T08:36:45.043 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.041+0000 7fa165925800 1 -- start start 2024-09-22T08:36:45.043 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.041+0000 7fa165925800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55986bcd9530 0x55986be57210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:45.043 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.041+0000 7fa165925800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55986bbfddd0 con 0x55986bcd9530 2024-09-22T08:36:45.043 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.042+0000 7fa161533640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55986bcd9530 0x55986be57210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:45.044 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.042+0000 7fa161533640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55986bcd9530 0x55986be57210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:38818/0 (socket says 172.21.15.142:38818) 2024-09-22T08:36:45.044 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.042+0000 7fa161533640 1 -- 172.21.15.142:0/3429943015 learned_addr learned my addr 172.21.15.142:0/3429943015 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:45.044 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.042+0000 7fa161533640 1 -- 172.21.15.142:0/3429943015 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55986be57800 con 0x55986bcd9530 2024-09-22T08:36:45.044 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.042+0000 7fa161533640 1 --2- 172.21.15.142:0/3429943015 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55986bcd9530 0x55986be57210 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fa154001e40 tx=0x7fa154001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68c0a151da3d09c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:45.044 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.042+0000 7fa04f606640 1 -- 172.21.15.142:0/3429943015 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa154012020 con 0x55986bcd9530 2024-09-22T08:36:45.044 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.042+0000 7fa04f606640 1 -- 172.21.15.142:0/3429943015 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa15400e5a0 con 0x55986bcd9530 2024-09-22T08:36:45.044 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.042+0000 7fa04f606640 1 -- 172.21.15.142:0/3429943015 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa15400e8a0 con 0x55986bcd9530 2024-09-22T08:36:45.046 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.043+0000 7fa165925800 1 -- 172.21.15.142:0/3429943015 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55986bcd9530 msgr2=0x55986be57210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:45.046 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.043+0000 7fa165925800 1 --2- 172.21.15.142:0/3429943015 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55986bcd9530 0x55986be57210 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fa154001e40 tx=0x7fa154001e70 comp rx=0 tx=0).stop 2024-09-22T08:36:45.046 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.043+0000 7fa165925800 1 -- 172.21.15.142:0/3429943015 shutdown_connections 2024-09-22T08:36:45.046 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.043+0000 7fa165925800 1 --2- 172.21.15.142:0/3429943015 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55986bcd9530 0x55986be57210 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:45.046 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.043+0000 7fa165925800 1 -- 172.21.15.142:0/3429943015 >> 172.21.15.142:0/3429943015 conn(0x55986bd5fc00 msgr2=0x55986be52b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:45.046 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.043+0000 7fa165925800 1 -- 172.21.15.142:0/3429943015 shutdown_connections 2024-09-22T08:36:45.047 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.043+0000 7fa165925800 1 -- 172.21.15.142:0/3429943015 wait complete. 2024-09-22T08:36:45.047 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.043+0000 7fa165925800 1 Processor -- start 2024-09-22T08:36:45.047 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.043+0000 7fa165925800 1 -- start start 2024-09-22T08:36:45.047 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.044+0000 7fa165925800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55986bcd9530 0x55986be5ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:45.047 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.044+0000 7fa165925800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55986bd6ea50 con 0x55986bcd9530 2024-09-22T08:36:45.047 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.044+0000 7fa161533640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55986bcd9530 0x55986be5ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:45.047 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.044+0000 7fa161533640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55986bcd9530 0x55986be5ed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:38820/0 (socket says 172.21.15.142:38820) 2024-09-22T08:36:45.047 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.044+0000 7fa161533640 1 -- 172.21.15.142:0/914928439 learned_addr learned my addr 172.21.15.142:0/914928439 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:45.047 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.044+0000 7fa161533640 1 -- 172.21.15.142:0/914928439 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55986be5f2c0 con 0x55986bcd9530 2024-09-22T08:36:45.047 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.044+0000 7fa161533640 1 --2- 172.21.15.142:0/914928439 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55986bcd9530 0x55986be5ed60 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fa15400c010 tx=0x7fa154000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:45.047 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.044+0000 7fa04de03640 1 -- 172.21.15.142:0/914928439 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa154012030 con 0x55986bcd9530 2024-09-22T08:36:45.047 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.044+0000 7fa04de03640 1 -- 172.21.15.142:0/914928439 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1540014a0 con 0x55986bcd9530 2024-09-22T08:36:45.047 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.045+0000 7fa165925800 1 -- 172.21.15.142:0/914928439 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55986be5f550 con 0x55986bcd9530 2024-09-22T08:36:45.048 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.045+0000 7fa04de03640 1 -- 172.21.15.142:0/914928439 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa15401a7a0 con 0x55986bcd9530 2024-09-22T08:36:45.048 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.045+0000 7fa165925800 1 -- 172.21.15.142:0/914928439 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55986be5ff50 con 0x55986bcd9530 2024-09-22T08:36:45.051 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.045+0000 7fa04de03640 1 -- 172.21.15.142:0/914928439 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fa154015020 con 0x55986bcd9530 2024-09-22T08:36:45.051 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.046+0000 7fa04de03640 1 --2- 172.21.15.142:0/914928439 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fa04803d000 0x7fa04803f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:45.051 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.046+0000 7fa04de03640 1 -- 172.21.15.142:0/914928439 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fa154020030 con 0x55986bcd9530 2024-09-22T08:36:45.051 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.046+0000 7fa160d32640 1 --2- 172.21.15.142:0/914928439 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fa04803d000 0x7fa04803f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:45.051 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.046+0000 7fa165925800 1 --2- 172.21.15.142:0/914928439 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55986bd6bc10 0x55986be663b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:45.051 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.046+0000 7fa165925800 1 -- 172.21.15.142:0/914928439 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55986be60b00 con 0x55986bd6bc10 2024-09-22T08:36:45.051 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.046+0000 7fa161d34640 1 --2- 172.21.15.142:0/914928439 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55986bd6bc10 0x55986be663b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:45.052 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.046+0000 7fa160d32640 1 --2- 172.21.15.142:0/914928439 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fa04803d000 0x7fa04803f4c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fa158057000 tx=0x7fa158052000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:45.052 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.046+0000 7fa161d34640 1 --2- 172.21.15.142:0/914928439 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55986bd6bc10 0x55986be663b0 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:45.052 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.046+0000 7fa161d34640 1 -- 172.21.15.142:0/914928439 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa15c00a4d0 con 0x55986bd6bc10 2024-09-22T08:36:45.052 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.047+0000 7fa165925800 1 -- 172.21.15.142:0/914928439 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55986be603e0 con 0x55986bd6bc10 2024-09-22T08:36:45.052 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.047+0000 7fa161d34640 1 -- 172.21.15.142:0/914928439 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa15c00a4d0 con 0x55986bd6bc10 2024-09-22T08:36:45.052 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.047+0000 7fa165925800 1 --2- 172.21.15.142:0/914928439 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55986be68820 0x55986be6ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:45.052 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.047+0000 7fa165925800 1 -- 172.21.15.142:0/914928439 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:3 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55986be6b2e0 con 0x55986be68820 2024-09-22T08:36:45.052 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.047+0000 7fa161533640 1 --2- 172.21.15.142:0/914928439 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55986be68820 0x55986be6ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:45.052 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.047+0000 7fa161533640 1 --2- 172.21.15.142:0/914928439 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55986be68820 0x55986be6ac10 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:45.052 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.047+0000 7fa161533640 1 -- 172.21.15.142:0/914928439 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(3 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fa1540187b0 con 0x55986be68820 2024-09-22T08:36:45.052 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.048+0000 7fa165925800 1 -- 172.21.15.142:0/914928439 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55986be676c0 con 0x55986bd6bc10 2024-09-22T08:36:45.052 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.048+0000 7fa161d34640 1 -- 172.21.15.142:0/914928439 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa15c00a4d0 con 0x55986bd6bc10 2024-09-22T08:36:45.052 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.048+0000 7fa165925800 1 -- 172.21.15.142:0/914928439 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55986be67b60 con 0x55986be68820 2024-09-22T08:36:45.053 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.048+0000 7fa161533640 1 -- 172.21.15.142:0/914928439 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(5 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fa1540187b0 con 0x55986be68820 2024-09-22T08:36:45.053 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.048+0000 7fa165925800 1 Processor -- start 2024-09-22T08:36:45.053 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.048+0000 7fa165925800 1 -- start start 2024-09-22T08:36:45.053 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.049+0000 7fa165925800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55986be79c90 0x55986be7a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:45.053 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.049+0000 7fa165925800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55986bc5cd50 con 0x55986be79c90 2024-09-22T08:36:45.053 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.049+0000 7fa161d34640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55986be79c90 0x55986be7a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:45.053 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.049+0000 7fa161d34640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55986be79c90 0x55986be7a0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:38832/0 (socket says 172.21.15.142:38832) 2024-09-22T08:36:45.053 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.049+0000 7fa161d34640 1 -- 172.21.15.142:0/3011549188 learned_addr learned my addr 172.21.15.142:0/3011549188 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:45.053 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.049+0000 7fa161d34640 1 -- 172.21.15.142:0/3011549188 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55986be7a6f0 con 0x55986be79c90 2024-09-22T08:36:45.053 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.049+0000 7fa161d34640 1 --2- 172.21.15.142:0/3011549188 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55986be79c90 0x55986be7a0b0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x55986be5fbf0 tx=0x7fa15c0167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:45.053 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.049+0000 7fa046ffd640 1 -- 172.21.15.142:0/3011549188 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa15c013640 con 0x55986be79c90 2024-09-22T08:36:45.053 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.049+0000 7fa046ffd640 1 -- 172.21.15.142:0/3011549188 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa15c0137e0 con 0x55986be79c90 2024-09-22T08:36:45.053 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.049+0000 7fa165925800 1 -- 172.21.15.142:0/3011549188 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55986be7af20 con 0x55986be79c90 2024-09-22T08:36:45.053 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.049+0000 7fa046ffd640 1 -- 172.21.15.142:0/3011549188 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa15c013ae0 con 0x55986be79c90 2024-09-22T08:36:45.054 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.049+0000 7fa165925800 1 -- 172.21.15.142:0/3011549188 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55986be7b4c0 con 0x55986be79c90 2024-09-22T08:36:45.062 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.050+0000 7fa046ffd640 1 -- 172.21.15.142:0/3011549188 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fa15c011040 con 0x55986be79c90 2024-09-22T08:36:45.062 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.050+0000 7fa046ffd640 1 --2- 172.21.15.142:0/3011549188 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fa03803cfb0 0x7fa03803f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:45.062 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.050+0000 7fa046ffd640 1 -- 172.21.15.142:0/3011549188 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fa15c00e040 con 0x55986be79c90 2024-09-22T08:36:45.062 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.051+0000 7fa161533640 1 --2- 172.21.15.142:0/3011549188 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fa03803cfb0 0x7fa03803f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:45.062 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.051+0000 7fa165925800 1 Processor -- start 2024-09-22T08:36:45.062 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.051+0000 7fa161533640 1 --2- 172.21.15.142:0/3011549188 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fa03803cfb0 0x7fa03803f470 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fa15400c720 tx=0x7fa154052990 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:45.062 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.051+0000 7fa165925800 1 -- start start 2024-09-22T08:36:45.062 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.051+0000 7fa165925800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55986be86730 0x55986be86b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:45.062 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.051+0000 7fa165925800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55986be57c30 con 0x55986be86730 2024-09-22T08:36:45.063 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.051+0000 7fa161d34640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55986be86730 0x55986be86b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:45.063 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.051+0000 7fa161d34640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55986be86730 0x55986be86b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:38846/0 (socket says 172.21.15.142:38846) 2024-09-22T08:36:45.063 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.051+0000 7fa161d34640 1 -- 172.21.15.142:0/2658831131 learned_addr learned my addr 172.21.15.142:0/2658831131 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:45.063 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.051+0000 7fa161d34640 1 -- 172.21.15.142:0/2658831131 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55986be87120 con 0x55986be86730 2024-09-22T08:36:45.063 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.052+0000 7fa161d34640 1 --2- 172.21.15.142:0/2658831131 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55986be86730 0x55986be86b30 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fa15c054840 tx=0x7fa15c014480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fbd95add0660291 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:45.063 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.052+0000 7fa044ff9640 1 -- 172.21.15.142:0/2658831131 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa15c021910 con 0x55986be86730 2024-09-22T08:36:45.063 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.052+0000 7fa044ff9640 1 -- 172.21.15.142:0/2658831131 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa15c052070 con 0x55986be86730 2024-09-22T08:36:45.063 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.052+0000 7fa044ff9640 1 -- 172.21.15.142:0/2658831131 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa15c021440 con 0x55986be86730 2024-09-22T08:36:45.063 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.052+0000 7fa165925800 1 -- 172.21.15.142:0/2658831131 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55986be86730 msgr2=0x55986be86b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:45.063 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.052+0000 7fa165925800 1 --2- 172.21.15.142:0/2658831131 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55986be86730 0x55986be86b30 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fa15c054840 tx=0x7fa15c014480 comp rx=0 tx=0).stop 2024-09-22T08:36:45.063 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.052+0000 7fa165925800 1 -- 172.21.15.142:0/2658831131 shutdown_connections 2024-09-22T08:36:45.063 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.052+0000 7fa165925800 1 --2- 172.21.15.142:0/2658831131 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55986be86730 0x55986be86b30 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:45.063 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.052+0000 7fa165925800 1 -- 172.21.15.142:0/2658831131 >> 172.21.15.142:0/2658831131 conn(0x55986be82b50 msgr2=0x55986be80d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:45.063 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.052+0000 7fa165925800 1 -- 172.21.15.142:0/2658831131 shutdown_connections 2024-09-22T08:36:45.064 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.052+0000 7fa165925800 1 -- 172.21.15.142:0/2658831131 wait complete. 2024-09-22T08:36:45.064 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.052+0000 7fa165925800 1 Processor -- start 2024-09-22T08:36:45.064 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.053+0000 7fa165925800 1 -- start start 2024-09-22T08:36:45.064 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.053+0000 7fa165925800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55986be86730 0x55986be8dce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:45.064 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.053+0000 7fa165925800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55986be87710 con 0x55986be86730 2024-09-22T08:36:45.064 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.053+0000 7fa161d34640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55986be86730 0x55986be8dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:45.064 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.053+0000 7fa161d34640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55986be86730 0x55986be8dce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:38856/0 (socket says 172.21.15.142:38856) 2024-09-22T08:36:45.064 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.053+0000 7fa161d34640 1 -- 172.21.15.142:0/2436585700 learned_addr learned my addr 172.21.15.142:0/2436585700 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:45.064 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.053+0000 7fa161d34640 1 -- 172.21.15.142:0/2436585700 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55986be8e240 con 0x55986be86730 2024-09-22T08:36:45.064 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.053+0000 7fa161d34640 1 --2- 172.21.15.142:0/2436585700 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55986be86730 0x55986be8dce0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fa15c020790 tx=0x7fa15c0547a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:45.064 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.053+0000 7fa036ffd640 1 -- 172.21.15.142:0/2436585700 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa15c013c80 con 0x55986be86730 2024-09-22T08:36:45.064 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.053+0000 7fa036ffd640 1 -- 172.21.15.142:0/2436585700 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa15c013e20 con 0x55986be86730 2024-09-22T08:36:45.064 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.053+0000 7fa165925800 1 -- 172.21.15.142:0/2436585700 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55986be8e4d0 con 0x55986be86730 2024-09-22T08:36:45.065 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.054+0000 7fa036ffd640 1 -- 172.21.15.142:0/2436585700 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa15c045b30 con 0x55986be86730 2024-09-22T08:36:45.065 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.054+0000 7fa165925800 1 -- 172.21.15.142:0/2436585700 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55986be8f060 con 0x55986be86730 2024-09-22T08:36:45.065 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.054+0000 7fa036ffd640 1 -- 172.21.15.142:0/2436585700 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fa15c045cd0 con 0x55986be86730 2024-09-22T08:36:45.065 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.054+0000 7fa036ffd640 1 --2- 172.21.15.142:0/2436585700 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fa02c03cfb0 0x7fa02c03f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:45.065 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.055+0000 7fa036ffd640 1 -- 172.21.15.142:0/2436585700 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fa15c04c030 con 0x55986be86730 2024-09-22T08:36:45.065 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.055+0000 7fa161533640 1 --2- 172.21.15.142:0/2436585700 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fa02c03cfb0 0x7fa02c03f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:45.065 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.055+0000 7fa161533640 1 --2- 172.21.15.142:0/2436585700 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fa02c03cfb0 0x7fa02c03f470 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fa154018ac0 tx=0x7fa154047000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:45.065 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.055+0000 7fa165925800 20 rados->read ofs=0 len=0 2024-09-22T08:36:45.065 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.055+0000 7fa165925800 1 --2- 172.21.15.142:0/2436585700 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55986be99660 0x55986be9bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:45.065 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.055+0000 7fa165925800 1 -- 172.21.15.142:0/2436585700 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55986be9c270 con 0x55986be99660 2024-09-22T08:36:45.065 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.055+0000 7fa160d32640 1 --2- 172.21.15.142:0/2436585700 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55986be99660 0x55986be9bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:45.065 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.056+0000 7fa160d32640 1 --2- 172.21.15.142:0/2436585700 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55986be99660 0x55986be9bb20 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:45.065 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.056+0000 7fa160d32640 1 -- 172.21.15.142:0/2436585700 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa158051070 con 0x55986be99660 2024-09-22T08:36:45.065 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.056+0000 7fa165925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:45.066 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.056+0000 7fa165925800 20 realm 2024-09-22T08:36:45.066 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.056+0000 7fa165925800 20 rados->read ofs=0 len=0 2024-09-22T08:36:45.066 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.056+0000 7fa165925800 1 -- 172.21.15.142:0/2436585700 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55986be9c6a0 con 0x55986be99660 2024-09-22T08:36:45.066 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.056+0000 7fa160d32640 1 -- 172.21.15.142:0/2436585700 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa158051070 con 0x55986be99660 2024-09-22T08:36:45.066 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.056+0000 7fa165925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:45.066 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.056+0000 7fa165925800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:36:45.066 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.056+0000 7fa165925800 20 rados->read ofs=0 len=0 2024-09-22T08:36:45.066 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.056+0000 7fa165925800 1 -- 172.21.15.142:0/2436585700 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55986be9cf70 con 0x55986be99660 2024-09-22T08:36:45.066 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.056+0000 7fa160d32640 1 -- 172.21.15.142:0/2436585700 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa158051070 con 0x55986be99660 2024-09-22T08:36:45.066 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.056+0000 7fa165925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:45.066 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.056+0000 7fa165925800 20 rados->read ofs=0 len=0 2024-09-22T08:36:45.066 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.056+0000 7fa165925800 1 -- 172.21.15.142:0/2436585700 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55986be9d310 con 0x55986be99660 2024-09-22T08:36:45.066 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.056+0000 7fa160d32640 1 -- 172.21.15.142:0/2436585700 <== osd.1 v2:172.21.15.142:6816/3192108003 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa158051070 con 0x55986be99660 2024-09-22T08:36:45.067 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.056+0000 7fa165925800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:36:45.067 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.056+0000 7fa165925800 20 rados->read ofs=0 len=0 2024-09-22T08:36:45.067 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.056+0000 7fa165925800 1 --2- 172.21.15.142:0/2436585700 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55986be9e070 0x55986bea0460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:45.067 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.056+0000 7fa165925800 1 -- 172.21.15.142:0/2436585700 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55986bea0a70 con 0x55986be9e070 2024-09-22T08:36:45.067 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.057+0000 7fa161d34640 1 --2- 172.21.15.142:0/2436585700 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55986be9e070 0x55986bea0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:45.067 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.057+0000 7fa161d34640 1 --2- 172.21.15.142:0/2436585700 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55986be9e070 0x55986bea0460 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:45.067 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.057+0000 7fa161d34640 1 -- 172.21.15.142:0/2436585700 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(5 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fa15c00a4d0 con 0x55986be9e070 2024-09-22T08:36:45.067 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.057+0000 7fa165925800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:36:45.067 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.057+0000 7fa165925800 20 searching for the correct realm 2024-09-22T08:36:45.067 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.057+0000 7fa165925800 1 -- 172.21.15.142:0/2436585700 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55986bea23d0 con 0x55986be9e070 2024-09-22T08:36:45.067 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.057+0000 7fa161d34640 1 -- 172.21.15.142:0/2436585700 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa15c00a4d0 con 0x55986be9e070 2024-09-22T08:36:45.067 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.057+0000 7fa161d34640 1 --2- 172.21.15.142:0/2436585700 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7fa15c054c20 0x7fa15c0451d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:45.067 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.057+0000 7fa161d34640 1 -- 172.21.15.142:0/2436585700 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55986bea23d0 con 0x7fa15c054c20 2024-09-22T08:36:45.067 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.057+0000 7fa161533640 1 --2- 172.21.15.142:0/2436585700 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7fa15c054c20 0x7fa15c0451d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:45.068 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.058+0000 7fa161533640 1 --2- 172.21.15.142:0/2436585700 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7fa15c054c20 0x7fa15c0451d0 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:45.068 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.058+0000 7fa161533640 1 -- 172.21.15.142:0/2436585700 <== osd.2 v2:172.21.15.142:6808/279438927 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa1540187b0 con 0x7fa15c054c20 2024-09-22T08:36:45.068 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.058+0000 7fa161533640 1 --2- 172.21.15.142:0/2436585700 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7fa154044c20 0x7fa154042130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:45.068 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.058+0000 7fa161533640 1 -- 172.21.15.142:0/2436585700 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55986bea23d0 con 0x7fa154044c20 2024-09-22T08:36:45.068 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.058+0000 7fa160d32640 1 --2- 172.21.15.142:0/2436585700 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7fa154044c20 0x7fa154042130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:45.068 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.059+0000 7fa160d32640 1 --2- 172.21.15.142:0/2436585700 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7fa154044c20 0x7fa154042130 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:45.068 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.059+0000 7fa160d32640 1 -- 172.21.15.142:0/2436585700 <== osd.0 v2:172.21.15.31:6800/168281188 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa158051070 con 0x7fa154044c20 2024-09-22T08:36:45.068 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.059+0000 7fa160d32640 1 -- 172.21.15.142:0/2436585700 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55986bea23d0 con 0x55986be99660 2024-09-22T08:36:45.068 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.059+0000 7fa160d32640 1 -- 172.21.15.142:0/2436585700 <== osd.1 v2:172.21.15.142:6816/3192108003 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa158051070 con 0x55986be99660 2024-09-22T08:36:45.068 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.059+0000 7fa160d32640 1 -- 172.21.15.142:0/2436585700 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55986bea23d0 con 0x55986be99660 2024-09-22T08:36:45.068 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.059+0000 7fa160d32640 1 -- 172.21.15.142:0/2436585700 <== osd.1 v2:172.21.15.142:6816/3192108003 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa158051070 con 0x55986be99660 2024-09-22T08:36:45.068 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.059+0000 7fa160d32640 1 -- 172.21.15.142:0/2436585700 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55986bea23d0 con 0x7fa154044c20 2024-09-22T08:36:45.068 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.059+0000 7fa160d32640 1 -- 172.21.15.142:0/2436585700 <== osd.0 v2:172.21.15.31:6800/168281188 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa158051070 con 0x7fa154044c20 2024-09-22T08:36:45.068 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.059+0000 7fa160d32640 1 -- 172.21.15.142:0/2436585700 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55986bea23d0 con 0x7fa154044c20 2024-09-22T08:36:45.069 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.060+0000 7fa160d32640 1 -- 172.21.15.142:0/2436585700 <== osd.0 v2:172.21.15.31:6800/168281188 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa158051070 con 0x7fa154044c20 2024-09-22T08:36:45.069 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.060+0000 7fa160d32640 1 -- 172.21.15.142:0/2436585700 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55986bea23d0 con 0x7fa15c054c20 2024-09-22T08:36:45.069 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.060+0000 7fa161533640 1 -- 172.21.15.142:0/2436585700 <== osd.2 v2:172.21.15.142:6808/279438927 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa1540187b0 con 0x7fa15c054c20 2024-09-22T08:36:45.069 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.060+0000 7fa161533640 1 -- 172.21.15.142:0/2436585700 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55986bea23d0 con 0x55986be9e070 2024-09-22T08:36:45.069 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.060+0000 7fa161d34640 1 -- 172.21.15.142:0/2436585700 <== osd.3 v2:172.21.15.142:6800/1064901393 3 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa15c00a4d0 con 0x55986be9e070 2024-09-22T08:36:45.069 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.060+0000 7fa161d34640 1 -- 172.21.15.142:0/2436585700 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55986bea23d0 con 0x55986be99660 2024-09-22T08:36:45.069 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.060+0000 7fa160d32640 1 -- 172.21.15.142:0/2436585700 <== osd.1 v2:172.21.15.142:6816/3192108003 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa158051070 con 0x55986be99660 2024-09-22T08:36:45.069 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.060+0000 7fa160d32640 1 -- 172.21.15.142:0/2436585700 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55986bea23d0 con 0x7fa154044c20 2024-09-22T08:36:45.069 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.061+0000 7fa160d32640 1 -- 172.21.15.142:0/2436585700 <== osd.0 v2:172.21.15.31:6800/168281188 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa158051070 con 0x7fa154044c20 2024-09-22T08:36:45.069 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.061+0000 7fa160d32640 1 -- 172.21.15.142:0/2436585700 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55986bea23d0 con 0x55986be99660 2024-09-22T08:36:45.069 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.061+0000 7fa160d32640 1 -- 172.21.15.142:0/2436585700 <== osd.1 v2:172.21.15.142:6816/3192108003 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa158051070 con 0x55986be99660 2024-09-22T08:36:45.069 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.061+0000 7fa160d32640 1 -- 172.21.15.142:0/2436585700 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55986bea23d0 con 0x7fa15c054c20 2024-09-22T08:36:45.078 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.061+0000 7fa161533640 1 -- 172.21.15.142:0/2436585700 <== osd.2 v2:172.21.15.142:6808/279438927 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fa1540187b0 con 0x7fa15c054c20 2024-09-22T08:36:45.078 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.061+0000 7fa161533640 1 -- 172.21.15.142:0/2436585700 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55986bea23d0 con 0x55986be9e070 2024-09-22T08:36:45.078 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.061+0000 7fa161d34640 1 -- 172.21.15.142:0/2436585700 <== osd.3 v2:172.21.15.142:6800/1064901393 4 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa15c00a4d0 con 0x55986be9e070 2024-09-22T08:36:45.078 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.061+0000 7fa161d34640 1 -- 172.21.15.142:0/2436585700 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55986bea23d0 con 0x55986be9e070 2024-09-22T08:36:45.078 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.062+0000 7fa161d34640 1 -- 172.21.15.142:0/2436585700 <== osd.3 v2:172.21.15.142:6800/1064901393 5 ==== osd_op_reply(20 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fa15c00a4d0 con 0x55986be9e070 2024-09-22T08:36:45.078 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.062+0000 7fa161d34640 1 -- 172.21.15.142:0/2436585700 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55986bea23d0 con 0x7fa154044c20 2024-09-22T08:36:45.079 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.062+0000 7fa160d32640 1 -- 172.21.15.142:0/2436585700 <== osd.0 v2:172.21.15.31:6800/168281188 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa158051070 con 0x7fa154044c20 2024-09-22T08:36:45.079 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.062+0000 7fa160d32640 1 -- 172.21.15.142:0/2436585700 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55986bea23d0 con 0x55986be9e070 2024-09-22T08:36:45.079 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.062+0000 7fa161d34640 1 -- 172.21.15.142:0/2436585700 <== osd.3 v2:172.21.15.142:6800/1064901393 6 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa15c00a4d0 con 0x55986be9e070 2024-09-22T08:36:45.079 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.062+0000 7fa161d34640 1 -- 172.21.15.142:0/2436585700 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55986bea23d0 con 0x55986be9e070 2024-09-22T08:36:45.079 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.062+0000 7fa161d34640 1 -- 172.21.15.142:0/2436585700 <== osd.3 v2:172.21.15.142:6800/1064901393 7 ==== osd_op_reply(23 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fa15c00a4d0 con 0x55986be9e070 2024-09-22T08:36:45.079 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.063+0000 7fa161d34640 1 -- 172.21.15.142:0/2436585700 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55986bea23d0 con 0x55986be99660 2024-09-22T08:36:45.079 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.063+0000 7fa160d32640 1 -- 172.21.15.142:0/2436585700 <== osd.1 v2:172.21.15.142:6816/3192108003 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa158051070 con 0x55986be99660 2024-09-22T08:36:45.079 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.063+0000 7fa160d32640 1 -- 172.21.15.142:0/2436585700 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55986bea23d0 con 0x55986be99660 2024-09-22T08:36:45.079 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.063+0000 7fa160d32640 1 -- 172.21.15.142:0/2436585700 <== osd.1 v2:172.21.15.142:6816/3192108003 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fa158051070 con 0x55986be99660 2024-09-22T08:36:45.079 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.063+0000 7fa160d32640 1 -- 172.21.15.142:0/2436585700 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55986bea23d0 con 0x7fa154044c20 2024-09-22T08:36:45.079 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.063+0000 7fa160d32640 1 -- 172.21.15.142:0/2436585700 <== osd.0 v2:172.21.15.31:6800/168281188 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa158051070 con 0x7fa154044c20 2024-09-22T08:36:45.079 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.063+0000 7fa160d32640 1 -- 172.21.15.142:0/2436585700 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55986bea23d0 con 0x55986be9e070 2024-09-22T08:36:45.080 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.063+0000 7fa161d34640 1 -- 172.21.15.142:0/2436585700 <== osd.3 v2:172.21.15.142:6800/1064901393 8 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa15c00a4d0 con 0x55986be9e070 2024-09-22T08:36:45.080 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.063+0000 7fa161d34640 1 -- 172.21.15.142:0/2436585700 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55986bea23d0 con 0x7fa15c054c20 2024-09-22T08:36:45.080 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.064+0000 7fa161533640 1 -- 172.21.15.142:0/2436585700 <== osd.2 v2:172.21.15.142:6808/279438927 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa1540187b0 con 0x7fa15c054c20 2024-09-22T08:36:45.080 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.064+0000 7fa161533640 1 -- 172.21.15.142:0/2436585700 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55986bea23d0 con 0x55986be99660 2024-09-22T08:36:45.080 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.064+0000 7fa160d32640 1 -- 172.21.15.142:0/2436585700 <== osd.1 v2:172.21.15.142:6816/3192108003 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa158051070 con 0x55986be99660 2024-09-22T08:36:45.080 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.064+0000 7fa160d32640 1 -- 172.21.15.142:0/2436585700 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55986bea23d0 con 0x7fa154044c20 2024-09-22T08:36:45.080 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.064+0000 7fa160d32640 1 -- 172.21.15.142:0/2436585700 <== osd.0 v2:172.21.15.31:6800/168281188 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa158051070 con 0x7fa154044c20 2024-09-22T08:36:45.080 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.064+0000 7fa160d32640 1 -- 172.21.15.142:0/2436585700 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55986bea23d0 con 0x55986be9e070 2024-09-22T08:36:45.080 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.065+0000 7fa161d34640 1 -- 172.21.15.142:0/2436585700 <== osd.3 v2:172.21.15.142:6800/1064901393 9 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa15c00a4d0 con 0x55986be9e070 2024-09-22T08:36:45.080 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.065+0000 7fa161d34640 1 -- 172.21.15.142:0/2436585700 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55986bea23d0 con 0x7fa154044c20 2024-09-22T08:36:45.080 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.065+0000 7fa160d32640 1 -- 172.21.15.142:0/2436585700 <== osd.0 v2:172.21.15.31:6800/168281188 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa158051070 con 0x7fa154044c20 2024-09-22T08:36:45.080 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.065+0000 7fa160d32640 1 -- 172.21.15.142:0/2436585700 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55986bea23d0 con 0x7fa15c054c20 2024-09-22T08:36:45.080 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.065+0000 7fa161533640 1 -- 172.21.15.142:0/2436585700 <== osd.2 v2:172.21.15.142:6808/279438927 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa1540187b0 con 0x7fa15c054c20 2024-09-22T08:36:45.081 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.065+0000 7fa161533640 1 -- 172.21.15.142:0/2436585700 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55986bea23d0 con 0x55986be9e070 2024-09-22T08:36:45.081 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.065+0000 7fa161d34640 1 -- 172.21.15.142:0/2436585700 <== osd.3 v2:172.21.15.142:6800/1064901393 10 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa15c00a4d0 con 0x55986be9e070 2024-09-22T08:36:45.081 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.065+0000 7fa161d34640 1 -- 172.21.15.142:0/2436585700 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55986bea23d0 con 0x7fa154044c20 2024-09-22T08:36:45.081 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.066+0000 7fa160d32640 1 -- 172.21.15.142:0/2436585700 <== osd.0 v2:172.21.15.31:6800/168281188 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa158051070 con 0x7fa154044c20 2024-09-22T08:36:45.081 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.066+0000 7fa160d32640 1 -- 172.21.15.142:0/2436585700 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55986bea23d0 con 0x55986be99660 2024-09-22T08:36:45.081 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.066+0000 7fa160d32640 1 -- 172.21.15.142:0/2436585700 <== osd.1 v2:172.21.15.142:6816/3192108003 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fa158051070 con 0x55986be99660 2024-09-22T08:36:45.081 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.066+0000 7fa160d32640 1 -- 172.21.15.142:0/2436585700 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55986bea23d0 con 0x7fa15c054c20 2024-09-22T08:36:45.081 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.066+0000 7fa161533640 1 -- 172.21.15.142:0/2436585700 <== osd.2 v2:172.21.15.142:6808/279438927 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa1540187b0 con 0x7fa15c054c20 2024-09-22T08:36:45.081 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.066+0000 7fa165925800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:36:45.081 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.066+0000 7fa165925800 20 RGWRados::pool_iterate: got zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec 2024-09-22T08:36:45.081 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.066+0000 7fa165925800 20 RGWRados::pool_iterate: got zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f 2024-09-22T08:36:45.081 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.066+0000 7fa165925800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:36:45.081 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.066+0000 7fa165925800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:36:45.081 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.066+0000 7fa165925800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:36:45.082 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.066+0000 7fa165925800 20 rados->read ofs=0 len=0 2024-09-22T08:36:45.082 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.066+0000 7fa165925800 1 -- 172.21.15.142:0/2436585700 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55986bea1330 con 0x55986be99660 2024-09-22T08:36:45.082 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.066+0000 7fa160d32640 1 -- 172.21.15.142:0/2436585700 <== osd.1 v2:172.21.15.142:6816/3192108003 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa158051070 con 0x55986be99660 2024-09-22T08:36:45.082 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.066+0000 7fa165925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:45.082 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.066+0000 7fa165925800 20 rados->read ofs=0 len=0 2024-09-22T08:36:45.082 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.066+0000 7fa165925800 1 -- 172.21.15.142:0/2436585700 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55986bea16d0 con 0x55986be99660 2024-09-22T08:36:45.082 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.067+0000 7fa160d32640 1 -- 172.21.15.142:0/2436585700 <== osd.1 v2:172.21.15.142:6816/3192108003 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa158051070 con 0x55986be99660 2024-09-22T08:36:45.082 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.067+0000 7fa165925800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:36:45.082 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.067+0000 7fa165925800 20 rados->read ofs=0 len=0 2024-09-22T08:36:45.082 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.067+0000 7fa165925800 1 -- 172.21.15.142:0/2436585700 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:40 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55986bea1af0 con 0x55986be9e070 2024-09-22T08:36:45.082 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.067+0000 7fa161d34640 1 -- 172.21.15.142:0/2436585700 <== osd.3 v2:172.21.15.142:6800/1064901393 11 ==== osd_op_reply(40 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fa15c00a4d0 con 0x55986be9e070 2024-09-22T08:36:45.082 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.067+0000 7fa165925800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:36:45.082 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.067+0000 7fa165925800 20 zone default found 2024-09-22T08:36:45.082 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.067+0000 7fa165925800 4 Realm: () 2024-09-22T08:36:45.083 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.067+0000 7fa165925800 4 ZoneGroup: default (d89f6f57-1007-47dd-9065-f486c7b01aec) 2024-09-22T08:36:45.083 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.067+0000 7fa165925800 4 Zone: default (e239248c-0bee-4e41-803a-24b288d3eb8f) 2024-09-22T08:36:45.083 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.067+0000 7fa165925800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:36:45.083 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.067+0000 7fa165925800 20 zonegroup default 2024-09-22T08:36:45.083 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.067+0000 7fa165925800 20 rados->read ofs=0 len=0 2024-09-22T08:36:45.083 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.067+0000 7fa165925800 1 -- 172.21.15.142:0/2436585700 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55986bea2d00 con 0x7fa154044c20 2024-09-22T08:36:45.083 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.067+0000 7fa160d32640 1 -- 172.21.15.142:0/2436585700 <== osd.0 v2:172.21.15.31:6800/168281188 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fa158051070 con 0x7fa154044c20 2024-09-22T08:36:45.083 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.067+0000 7fa165925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:45.083 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.067+0000 7fa165925800 20 rados->read ofs=0 len=0 2024-09-22T08:36:45.083 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.067+0000 7fa165925800 1 -- 172.21.15.142:0/2436585700 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55986bea4f40 con 0x55986be9e070 2024-09-22T08:36:45.083 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.067+0000 7fa161d34640 1 -- 172.21.15.142:0/2436585700 <== osd.3 v2:172.21.15.142:6800/1064901393 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa15c00a4d0 con 0x55986be9e070 2024-09-22T08:36:45.083 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.067+0000 7fa165925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:45.083 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.067+0000 7fa165925800 20 rados->read ofs=0 len=0 2024-09-22T08:36:45.084 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.067+0000 7fa165925800 1 -- 172.21.15.142:0/2436585700 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55986bea52e0 con 0x55986be9e070 2024-09-22T08:36:45.084 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.068+0000 7fa161d34640 1 -- 172.21.15.142:0/2436585700 <== osd.3 v2:172.21.15.142:6800/1064901393 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa15c00a4d0 con 0x55986be9e070 2024-09-22T08:36:45.084 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.068+0000 7fa165925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:45.084 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.068+0000 7fa165925800 20 started sync module instance, tier type = 2024-09-22T08:36:45.084 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.068+0000 7fa165925800 20 started zone id=e239248c-0bee-4e41-803a-24b288d3eb8f (name=default) with tier type = 2024-09-22T08:36:45.084 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.068+0000 7fa165925800 1 -- 172.21.15.142:0/2436585700 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55986bea43d0 con 0x7fa15c054c20 2024-09-22T08:36:45.084 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.069+0000 7fa161533640 1 -- 172.21.15.142:0/2436585700 <== osd.2 v2:172.21.15.142:6808/279438927 7 ==== osd_op_reply(44 notify.0 [create] v30'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa1540187b0 con 0x7fa15c054c20 2024-09-22T08:36:45.084 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.069+0000 7fa165925800 1 -- 172.21.15.142:0/2436585700 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94113133905856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55986bea5ba0 con 0x7fa15c054c20 2024-09-22T08:36:45.084 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.069+0000 7fa165925800 1 -- 172.21.15.142:0/2436585700 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55986bea63f0 con 0x55986be99660 2024-09-22T08:36:45.084 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.070+0000 7fa161533640 1 -- 172.21.15.142:0/2436585700 <== osd.2 v2:172.21.15.142:6808/279438927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94113133905856] v30'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa1540187b0 con 0x7fa15c054c20 2024-09-22T08:36:45.084 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.070+0000 7fa160d32640 1 -- 172.21.15.142:0/2436585700 <== osd.1 v2:172.21.15.142:6816/3192108003 15 ==== osd_op_reply(46 notify.1 [create] v30'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa158051070 con 0x55986be99660 2024-09-22T08:36:45.084 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.070+0000 7fa165925800 1 -- 172.21.15.142:0/2436585700 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94113133909744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55986bea6450 con 0x55986be99660 2024-09-22T08:36:45.084 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.070+0000 7fa165925800 1 -- 172.21.15.142:0/2436585700 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55986bea6f60 con 0x55986be9e070 2024-09-22T08:36:45.084 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.071+0000 7fa160d32640 1 -- 172.21.15.142:0/2436585700 <== osd.1 v2:172.21.15.142:6816/3192108003 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94113133909744] v30'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa158051070 con 0x55986be99660 2024-09-22T08:36:45.085 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.071+0000 7fa161d34640 1 -- 172.21.15.142:0/2436585700 <== osd.3 v2:172.21.15.142:6800/1064901393 14 ==== osd_op_reply(48 notify.2 [create] v30'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa15c00a4d0 con 0x55986be9e070 2024-09-22T08:36:45.085 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.071+0000 7fa165925800 1 -- 172.21.15.142:0/2436585700 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94113133914640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55986bea6f20 con 0x55986be9e070 2024-09-22T08:36:45.085 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.071+0000 7fa165925800 1 -- 172.21.15.142:0/2436585700 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55986bea79f0 con 0x7fa15c054c20 2024-09-22T08:36:45.085 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.072+0000 7fa161d34640 1 -- 172.21.15.142:0/2436585700 <== osd.3 v2:172.21.15.142:6800/1064901393 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94113133914640] v30'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa15c00a4d0 con 0x55986be9e070 2024-09-22T08:36:45.085 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.072+0000 7fa161533640 1 -- 172.21.15.142:0/2436585700 <== osd.2 v2:172.21.15.142:6808/279438927 9 ==== osd_op_reply(50 notify.3 [create] v30'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa1540187b0 con 0x7fa15c054c20 2024-09-22T08:36:45.085 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.072+0000 7fa165925800 1 -- 172.21.15.142:0/2436585700 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94113133917472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55986bea7de0 con 0x7fa15c054c20 2024-09-22T08:36:45.085 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.072+0000 7fa165925800 1 -- 172.21.15.142:0/2436585700 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55986bea8800 con 0x55986be99660 2024-09-22T08:36:45.085 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.073+0000 7fa161533640 1 -- 172.21.15.142:0/2436585700 <== osd.2 v2:172.21.15.142:6808/279438927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94113133917472] v30'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa1540187b0 con 0x7fa15c054c20 2024-09-22T08:36:45.085 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.073+0000 7fa160d32640 1 -- 172.21.15.142:0/2436585700 <== osd.1 v2:172.21.15.142:6816/3192108003 17 ==== osd_op_reply(52 notify.4 [create] v30'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa158051070 con 0x55986be99660 2024-09-22T08:36:45.085 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.073+0000 7fa165925800 1 -- 172.21.15.142:0/2436585700 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94113133921008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55986bea87c0 con 0x55986be99660 2024-09-22T08:36:45.085 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.074+0000 7fa165925800 1 -- 172.21.15.142:0/2436585700 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55986bea9290 con 0x7fa154044c20 2024-09-22T08:36:45.085 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.074+0000 7fa160d32640 1 -- 172.21.15.142:0/2436585700 <== osd.0 v2:172.21.15.31:6800/168281188 11 ==== osd_op_reply(54 notify.5 [create] v30'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa158051070 con 0x7fa154044c20 2024-09-22T08:36:45.085 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.074+0000 7fa165925800 1 -- 172.21.15.142:0/2436585700 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94113133923728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55986bea9290 con 0x7fa154044c20 2024-09-22T08:36:45.086 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.074+0000 7fa165925800 1 -- 172.21.15.142:0/2436585700 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55986beaa230 con 0x7fa154044c20 2024-09-22T08:36:45.086 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.075+0000 7fa160d32640 1 -- 172.21.15.142:0/2436585700 <== osd.1 v2:172.21.15.142:6816/3192108003 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94113133921008] v30'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa158051070 con 0x55986be99660 2024-09-22T08:36:45.086 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.075+0000 7fa160d32640 1 -- 172.21.15.142:0/2436585700 <== osd.0 v2:172.21.15.31:6800/168281188 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94113133923728] v30'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa158051070 con 0x7fa154044c20 2024-09-22T08:36:45.086 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.076+0000 7fa160d32640 1 -- 172.21.15.142:0/2436585700 <== osd.0 v2:172.21.15.31:6800/168281188 13 ==== osd_op_reply(56 notify.6 [create] v30'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa158051070 con 0x7fa154044c20 2024-09-22T08:36:45.086 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.076+0000 7fa165925800 1 -- 172.21.15.142:0/2436585700 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94113133927680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55986bea94f0 con 0x7fa154044c20 2024-09-22T08:36:45.086 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.076+0000 7fa165925800 1 -- 172.21.15.142:0/2436585700 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55986beaa6a0 con 0x7fa154044c20 2024-09-22T08:36:45.086 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.077+0000 7fa160d32640 1 -- 172.21.15.142:0/2436585700 <== osd.0 v2:172.21.15.31:6800/168281188 14 ==== osd_op_reply(58 notify.7 [create] v30'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa158051070 con 0x7fa154044c20 2024-09-22T08:36:45.086 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.077+0000 7fa160d32640 1 -- 172.21.15.142:0/2436585700 <== osd.0 v2:172.21.15.31:6800/168281188 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94113133927680] v30'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa158051070 con 0x7fa154044c20 2024-09-22T08:36:45.086 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.077+0000 7fa165925800 1 -- 172.21.15.142:0/2436585700 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94113133928944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55986beaa610 con 0x7fa154044c20 2024-09-22T08:36:45.086 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.077+0000 7fa165925800 20 add_watcher() i=0 2024-09-22T08:36:45.086 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.077+0000 7fa165925800 20 add_watcher() i=1 2024-09-22T08:36:45.086 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.077+0000 7fa165925800 20 add_watcher() i=2 2024-09-22T08:36:45.086 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.077+0000 7fa165925800 20 add_watcher() i=3 2024-09-22T08:36:45.087 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.077+0000 7fa165925800 20 add_watcher() i=4 2024-09-22T08:36:45.087 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.077+0000 7fa165925800 20 add_watcher() i=5 2024-09-22T08:36:45.087 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.077+0000 7fa165925800 20 add_watcher() i=6 2024-09-22T08:36:45.090 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.078+0000 7fa160d32640 1 -- 172.21.15.142:0/2436585700 <== osd.0 v2:172.21.15.31:6800/168281188 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94113133928944] v30'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa158051070 con 0x7fa154044c20 2024-09-22T08:36:45.090 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.078+0000 7fa165925800 20 add_watcher() i=7 2024-09-22T08:36:45.090 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.078+0000 7fa165925800 2 all 8 watchers are set, enabling cache 2024-09-22T08:36:45.090 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.078+0000 7fa165925800 1 -- 172.21.15.142:0/2436585700 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55986beadb90 con 0x55986be99660 2024-09-22T08:36:45.091 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.078+0000 7fa160d32640 1 -- 172.21.15.142:0/2436585700 <== osd.1 v2:172.21.15.142:6816/3192108003 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fa158051070 con 0x55986be99660 2024-09-22T08:36:45.091 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.078+0000 7fa165925800 1 -- 172.21.15.142:0/2436585700 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94113133911872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55986beaaf20 con 0x55986be99660 2024-09-22T08:36:45.091 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.079+0000 7fa160d32640 1 -- 172.21.15.142:0/2436585700 <== osd.1 v2:172.21.15.142:6816/3192108003 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94113133911872] v30'86 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa158051070 con 0x55986be99660 2024-09-22T08:36:45.091 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.079+0000 7fa0177e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:36:45.091 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.079+0000 7fa165925800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:36:45.091 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.079+0000 7fa165925800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:36:45.091 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.079+0000 7fa165925800 5 note: GC not initialized 2024-09-22T08:36:45.091 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.080+0000 7fa0167e4640 20 reqs_thread_entry: start 2024-09-22T08:36:45.091 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.080+0000 7fa165925800 20 init_complete bucket index max shards: 11 2024-09-22T08:36:45.091 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.080+0000 7fa165925800 20 Filter name: none 2024-09-22T08:36:45.091 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.080+0000 7f9f87fff640 20 reqs_thread_entry: start 2024-09-22T08:36:45.091 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.080+0000 7fa165925800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-22T08:36:45.092 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.080+0000 7fa165925800 20 rados->read ofs=0 len=0 2024-09-22T08:36:45.092 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.080+0000 7fa165925800 1 -- 172.21.15.142:0/2436585700 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55986bee0ef0 con 0x55986be99660 2024-09-22T08:36:45.092 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.080+0000 7fa160d32640 1 -- 172.21.15.142:0/2436585700 <== osd.1 v2:172.21.15.142:6816/3192108003 21 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv10 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7fa158051070 con 0x55986be99660 2024-09-22T08:36:45.092 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.080+0000 7fa165925800 20 rados_obj.operate() r=0 bl.length=556 2024-09-22T08:36:45.092 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.080+0000 7fa165925800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-22T08:36:45.092 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.080+0000 7fa165925800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-22T08:36:45.092 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.080+0000 7fa165925800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:36:45.092 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.080+0000 7fa165925800 1 -- 172.21.15.142:0/2436585700 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55986bee7640 con 0x55986be99660 2024-09-22T08:36:45.092 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.082+0000 7fa160d32640 1 -- 172.21.15.142:0/2436585700 <== osd.1 v2:172.21.15.142:6816/3192108003 22 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~391] v30'11 uv11 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fa158051070 con 0x55986be99660 2024-09-22T08:36:45.092 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.082+0000 7fa165925800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-22T08:36:45.092 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.082+0000 7fa165925800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-22T08:36:45.092 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.082+0000 7fa165925800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-22T08:36:45.092 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.082+0000 7fa165925800 1 -- 172.21.15.142:0/2436585700 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94113134178432 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55986bee2d60 con 0x55986be99660 2024-09-22T08:36:45.093 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.082+0000 7fa160d32640 1 -- 172.21.15.142:0/2436585700 <== osd.1 v2:172.21.15.142:6816/3192108003 23 ==== watch-notify(notify (1) cookie 94113133921008 notify 128849018890 ret 0) ==== 609+0+0 (crc 0 0 0) 0x7fa158081040 con 0x55986be99660 2024-09-22T08:36:45.093 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.082+0000 7fa044ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018890 cookie 94113133921008 notifier 4415 bl.length()=567 2024-09-22T08:36:45.093 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.082+0000 7fa044ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-22T08:36:45.093 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.082+0000 7fa044ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-22T08:36:45.093 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.082+0000 7fa044ff9640 1 -- 172.21.15.142:0/2436585700 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7fa024003ea0 con 0x55986be99660 2024-09-22T08:36:45.093 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.082+0000 7fa160d32640 1 -- 172.21.15.142:0/2436585700 <== osd.1 v2:172.21.15.142:6816/3192108003 24 ==== osd_op_reply(64 notify.4 [notify cookie 94113134178432 out=8b] v0'0 uv78 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fa158051070 con 0x55986be99660 2024-09-22T08:36:45.093 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.082+0000 7fa160d32640 1 -- 172.21.15.142:0/2436585700 <== osd.1 v2:172.21.15.142:6816/3192108003 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa158051070 con 0x55986be99660 2024-09-22T08:36:45.093 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.082+0000 7fa160d32640 1 -- 172.21.15.142:0/2436585700 <== osd.1 v2:172.21.15.142:6816/3192108003 26 ==== watch-notify(notify_complete (2) cookie 94113134178432 notify 128849018890 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55986bd6f7b0 con 0x55986be99660 2024-09-22T08:36:45.093 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.082+0000 7fa165925800 1 -- 172.21.15.142:0/2436585700 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:66 8.2 8:45671577:users.swift::foo%3afoo2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55986bee7080 con 0x7fa15c054c20 2024-09-22T08:36:45.093 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.083+0000 7fa161533640 1 -- 172.21.15.142:0/2436585700 <== osd.2 v2:172.21.15.142:6808/279438927 11 ==== osd_op_reply(66 foo:foo2 [delete] v30'2 uv2 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa1540187b0 con 0x7fa15c054c20 2024-09-22T08:36:45.093 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.083+0000 7fa165925800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:users.swift:foo:foo2, ofs0, ns] 2024-09-22T08:36:45.093 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.083+0000 7fa165925800 1 -- 172.21.15.142:0/2436585700 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94113134178432 in=171b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55986bee28b0 con 0x7fa15c054c20 2024-09-22T08:36:45.093 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.084+0000 7fa161533640 1 -- 172.21.15.142:0/2436585700 <== osd.2 v2:172.21.15.142:6808/279438927 12 ==== watch-notify(notify (1) cookie 94113133905856 notify 128849018885 ret 0) ==== 201+0+0 (crc 0 0 0) 0x55986be5ff50 con 0x7fa15c054c20 2024-09-22T08:36:45.094 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.084+0000 7fa037fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018885 cookie 94113133905856 notifier 4415 bl.length()=159 2024-09-22T08:36:45.094 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.084+0000 7fa037fff640 1 -- 172.21.15.142:0/2436585700 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f9f940032c0 con 0x7fa15c054c20 2024-09-22T08:36:45.094 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.084+0000 7fa161533640 1 -- 172.21.15.142:0/2436585700 <== osd.2 v2:172.21.15.142:6808/279438927 13 ==== osd_op_reply(67 notify.0 [notify cookie 94113134178432 out=8b] v0'0 uv78 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fa1540187b0 con 0x7fa15c054c20 2024-09-22T08:36:45.094 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.084+0000 7fa161533640 1 -- 172.21.15.142:0/2436585700 <== osd.2 v2:172.21.15.142:6808/279438927 14 ==== osd_op_reply(68 notify.0 [notify-ack] v0'0 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa1540187b0 con 0x7fa15c054c20 2024-09-22T08:36:45.094 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.084+0000 7fa161533640 1 -- 172.21.15.142:0/2436585700 <== osd.2 v2:172.21.15.142:6808/279438927 15 ==== watch-notify(notify_complete (2) cookie 94113134178432 notify 128849018885 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55986be5f550 con 0x7fa15c054c20 2024-09-22T08:36:45.094 INFO:teuthology.orchestra.run.smithi142.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-22T08:36:42.661297Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-22T08:36:42.661288Z","tags":[],"group_ids":[]} 2024-09-22T08:36:45.099 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.085+0000 7fa0177e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:36:45.099 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.085+0000 7fa165925800 1 -- 172.21.15.142:0/2436585700 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:69 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94113133911872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55986bedebf0 con 0x55986be99660 2024-09-22T08:36:45.099 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.086+0000 7fa160d32640 1 -- 172.21.15.142:0/2436585700 <== osd.1 v2:172.21.15.142:6816/3192108003 27 ==== osd_op_reply(69 data_loggenerations_metadata [watch unwatch cookie 94113133911872] v30'87 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa158051070 con 0x55986be99660 2024-09-22T08:36:45.099 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.086+0000 7fa165925800 1 -- 172.21.15.142:0/2436585700 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:70 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94113133905856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55986bedebf0 con 0x7fa15c054c20 2024-09-22T08:36:45.099 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.087+0000 7fa161533640 1 -- 172.21.15.142:0/2436585700 <== osd.2 v2:172.21.15.142:6808/279438927 16 ==== osd_op_reply(70 notify.0 [watch unwatch cookie 94113133905856] v30'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa1540187b0 con 0x7fa15c054c20 2024-09-22T08:36:45.099 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.087+0000 7fa165925800 20 remove_watcher() i=0 2024-09-22T08:36:45.099 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.087+0000 7fa165925800 2 removed watcher, disabling cache 2024-09-22T08:36:45.099 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.087+0000 7fa165925800 1 -- 172.21.15.142:0/2436585700 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:71 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94113133909744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55986bedebf0 con 0x55986be99660 2024-09-22T08:36:45.099 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.088+0000 7fa160d32640 1 -- 172.21.15.142:0/2436585700 <== osd.1 v2:172.21.15.142:6816/3192108003 28 ==== osd_op_reply(71 notify.1 [watch unwatch cookie 94113133909744] v30'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa158051070 con 0x55986be99660 2024-09-22T08:36:45.100 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.088+0000 7fa165925800 20 remove_watcher() i=1 2024-09-22T08:36:45.100 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.088+0000 7fa165925800 1 -- 172.21.15.142:0/2436585700 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:72 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94113133914640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55986bedebf0 con 0x55986be9e070 2024-09-22T08:36:45.100 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.089+0000 7fa161d34640 1 -- 172.21.15.142:0/2436585700 <== osd.3 v2:172.21.15.142:6800/1064901393 16 ==== osd_op_reply(72 notify.2 [watch unwatch cookie 94113133914640] v30'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa15c00a4d0 con 0x55986be9e070 2024-09-22T08:36:45.100 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.089+0000 7fa165925800 20 remove_watcher() i=2 2024-09-22T08:36:45.100 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.089+0000 7fa165925800 1 -- 172.21.15.142:0/2436585700 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94113133917472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55986bedebf0 con 0x7fa15c054c20 2024-09-22T08:36:45.100 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.090+0000 7fa161533640 1 -- 172.21.15.142:0/2436585700 <== osd.2 v2:172.21.15.142:6808/279438927 17 ==== osd_op_reply(73 notify.3 [watch unwatch cookie 94113133917472] v30'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa1540187b0 con 0x7fa15c054c20 2024-09-22T08:36:45.100 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.090+0000 7fa165925800 20 remove_watcher() i=3 2024-09-22T08:36:45.100 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.090+0000 7fa165925800 1 -- 172.21.15.142:0/2436585700 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94113133921008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55986bedebf0 con 0x55986be99660 2024-09-22T08:36:45.100 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.091+0000 7fa160d32640 1 -- 172.21.15.142:0/2436585700 <== osd.1 v2:172.21.15.142:6816/3192108003 29 ==== osd_op_reply(74 notify.4 [watch unwatch cookie 94113133921008] v30'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa158051070 con 0x55986be99660 2024-09-22T08:36:45.100 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.091+0000 7fa165925800 20 remove_watcher() i=4 2024-09-22T08:36:45.100 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.091+0000 7fa165925800 1 -- 172.21.15.142:0/2436585700 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:75 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94113133923728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55986bedebf0 con 0x7fa154044c20 2024-09-22T08:36:45.100 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.092+0000 7fa160d32640 1 -- 172.21.15.142:0/2436585700 <== osd.0 v2:172.21.15.31:6800/168281188 17 ==== osd_op_reply(75 notify.5 [watch unwatch cookie 94113133923728] v30'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa158051070 con 0x7fa154044c20 2024-09-22T08:36:45.100 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.092+0000 7fa165925800 20 remove_watcher() i=5 2024-09-22T08:36:45.101 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.092+0000 7fa165925800 1 -- 172.21.15.142:0/2436585700 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:76 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94113133927680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55986bedebf0 con 0x7fa154044c20 2024-09-22T08:36:45.101 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.093+0000 7fa160d32640 1 -- 172.21.15.142:0/2436585700 <== osd.0 v2:172.21.15.31:6800/168281188 18 ==== osd_op_reply(76 notify.6 [watch unwatch cookie 94113133927680] v30'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa158051070 con 0x7fa154044c20 2024-09-22T08:36:45.101 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.093+0000 7fa165925800 20 remove_watcher() i=6 2024-09-22T08:36:45.101 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.093+0000 7fa165925800 1 -- 172.21.15.142:0/2436585700 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:77 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94113133928944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55986bedebf0 con 0x7fa154044c20 2024-09-22T08:36:45.101 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.094+0000 7fa160d32640 1 -- 172.21.15.142:0/2436585700 <== osd.0 v2:172.21.15.31:6800/168281188 19 ==== osd_op_reply(77 notify.7 [watch unwatch cookie 94113133928944] v30'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa158051070 con 0x7fa154044c20 2024-09-22T08:36:45.101 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.094+0000 7fa165925800 20 remove_watcher() i=7 2024-09-22T08:36:45.101 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.094+0000 7fa165925800 1 -- 172.21.15.142:0/2436585700 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7fa154044c20 msgr2=0x7fa154042130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:45.101 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.094+0000 7fa165925800 1 --2- 172.21.15.142:0/2436585700 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7fa154044c20 0x7fa154042130 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:45.101 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.094+0000 7fa165925800 1 -- 172.21.15.142:0/2436585700 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55986be99660 msgr2=0x55986be9bb20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:45.101 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.094+0000 7fa165925800 1 --2- 172.21.15.142:0/2436585700 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55986be99660 0x55986be9bb20 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:45.101 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.094+0000 7fa165925800 1 -- 172.21.15.142:0/2436585700 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7fa15c054c20 msgr2=0x7fa15c0451d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:45.101 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.094+0000 7fa165925800 1 --2- 172.21.15.142:0/2436585700 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7fa15c054c20 0x7fa15c0451d0 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:45.101 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.094+0000 7fa165925800 1 -- 172.21.15.142:0/2436585700 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55986be9e070 msgr2=0x55986bea0460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:45.102 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.094+0000 7fa165925800 1 --2- 172.21.15.142:0/2436585700 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55986be9e070 0x55986bea0460 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:45.102 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.094+0000 7fa165925800 1 -- 172.21.15.142:0/2436585700 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fa02c03cfb0 msgr2=0x7fa02c03f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:45.102 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.094+0000 7fa165925800 1 --2- 172.21.15.142:0/2436585700 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fa02c03cfb0 0x7fa02c03f470 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fa154018ac0 tx=0x7fa154047000 comp rx=0 tx=0).stop 2024-09-22T08:36:45.102 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.094+0000 7fa165925800 1 -- 172.21.15.142:0/2436585700 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55986be86730 msgr2=0x55986be8dce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:45.102 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.094+0000 7fa165925800 1 --2- 172.21.15.142:0/2436585700 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55986be86730 0x55986be8dce0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fa15c020790 tx=0x7fa15c0547a0 comp rx=0 tx=0).stop 2024-09-22T08:36:45.102 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.094+0000 7fa160d32640 1 -- 172.21.15.142:0/2436585700 reap_dead start 2024-09-22T08:36:45.102 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.094+0000 7fa165925800 1 -- 172.21.15.142:0/2436585700 shutdown_connections 2024-09-22T08:36:45.102 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.094+0000 7fa165925800 1 --2- 172.21.15.142:0/2436585700 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55986be86730 0x55986be8dce0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:45.102 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.094+0000 7fa165925800 1 -- 172.21.15.142:0/2436585700 >> 172.21.15.142:0/2436585700 conn(0x55986be82b50 msgr2=0x55986be80d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:45.102 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.094+0000 7fa165925800 1 -- 172.21.15.142:0/2436585700 shutdown_connections 2024-09-22T08:36:45.102 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.094+0000 7fa165925800 1 -- 172.21.15.142:0/2436585700 wait complete. 2024-09-22T08:36:45.102 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.095+0000 7fa165925800 1 -- 172.21.15.142:0/3011549188 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fa03803cfb0 msgr2=0x7fa03803f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:45.102 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.095+0000 7fa165925800 1 --2- 172.21.15.142:0/3011549188 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fa03803cfb0 0x7fa03803f470 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fa15400c720 tx=0x7fa154052990 comp rx=0 tx=0).stop 2024-09-22T08:36:45.103 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.095+0000 7fa165925800 1 -- 172.21.15.142:0/3011549188 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55986be79c90 msgr2=0x55986be7a0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:45.103 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.095+0000 7fa165925800 1 --2- 172.21.15.142:0/3011549188 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55986be79c90 0x55986be7a0b0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x55986be5fbf0 tx=0x7fa15c0167b0 comp rx=0 tx=0).stop 2024-09-22T08:36:45.103 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.095+0000 7fa165925800 1 -- 172.21.15.142:0/3011549188 shutdown_connections 2024-09-22T08:36:45.103 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.095+0000 7fa165925800 1 --2- 172.21.15.142:0/3011549188 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fa03803cfb0 0x7fa03803f470 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:45.103 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.095+0000 7fa165925800 1 --2- 172.21.15.142:0/3011549188 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55986be79c90 0x55986be7a0b0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:45.103 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.095+0000 7fa165925800 1 -- 172.21.15.142:0/3011549188 >> 172.21.15.142:0/3011549188 conn(0x55986be6e040 msgr2=0x55986be6e420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:45.103 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.095+0000 7fa165925800 1 -- 172.21.15.142:0/3011549188 shutdown_connections 2024-09-22T08:36:45.103 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.095+0000 7fa165925800 1 -- 172.21.15.142:0/3011549188 wait complete. 2024-09-22T08:36:45.103 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.095+0000 7fa165925800 1 -- 172.21.15.142:0/914928439 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55986bd6bc10 msgr2=0x55986be663b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:45.103 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.095+0000 7fa165925800 1 --2- 172.21.15.142:0/914928439 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55986bd6bc10 0x55986be663b0 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:45.103 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.095+0000 7fa165925800 1 -- 172.21.15.142:0/914928439 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55986be68820 msgr2=0x55986be6ac10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:45.103 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.095+0000 7fa165925800 1 --2- 172.21.15.142:0/914928439 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55986be68820 0x55986be6ac10 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:45.103 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.095+0000 7fa165925800 1 -- 172.21.15.142:0/914928439 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fa04803d000 msgr2=0x7fa04803f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:45.104 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.095+0000 7fa165925800 1 --2- 172.21.15.142:0/914928439 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fa04803d000 0x7fa04803f4c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fa158057000 tx=0x7fa158052000 comp rx=0 tx=0).stop 2024-09-22T08:36:45.104 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.095+0000 7fa165925800 1 -- 172.21.15.142:0/914928439 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55986bcd9530 msgr2=0x55986be5ed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:45.104 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.095+0000 7fa165925800 1 --2- 172.21.15.142:0/914928439 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55986bcd9530 0x55986be5ed60 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fa15400c010 tx=0x7fa154000ed0 comp rx=0 tx=0).stop 2024-09-22T08:36:45.104 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.095+0000 7fa165925800 1 -- 172.21.15.142:0/914928439 shutdown_connections 2024-09-22T08:36:45.104 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.095+0000 7fa165925800 1 --2- 172.21.15.142:0/914928439 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55986be68820 0x55986be6ac10 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:45.104 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.095+0000 7fa165925800 1 --2- 172.21.15.142:0/914928439 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55986bd6bc10 0x55986be663b0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:45.104 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.095+0000 7fa165925800 1 --2- 172.21.15.142:0/914928439 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fa04803d000 0x7fa04803f4c0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:45.104 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.095+0000 7fa165925800 1 --2- 172.21.15.142:0/914928439 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55986bcd9530 0x55986be5ed60 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:45.104 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.095+0000 7fa165925800 1 -- 172.21.15.142:0/914928439 >> 172.21.15.142:0/914928439 conn(0x55986bd5fc00 msgr2=0x55986be58700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:45.104 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.095+0000 7fa165925800 1 -- 172.21.15.142:0/914928439 shutdown_connections 2024-09-22T08:36:45.104 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.095+0000 7fa165925800 1 -- 172.21.15.142:0/914928439 wait complete. 2024-09-22T08:36:45.106 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-22T08:36:42.661297Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-22T08:36:42.661288Z', 'tags': [], 'group_ids': []} 2024-09-22T08:36:45.106 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--uid', 'foo'] 2024-09-22T08:36:45.106 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--uid', 'foo'] 2024-09-22T08:36:45.106 DEBUG:teuthology.orchestra.run.smithi142:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --uid foo 2024-09-22T08:36:45.151 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:36:45.152 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:36:45.152 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.150+0000 7fd0b6298800 1 Processor -- start 2024-09-22T08:36:45.152 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.150+0000 7fd0b6298800 1 -- start start 2024-09-22T08:36:45.152 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.150+0000 7fd0b6298800 1 --2- >> v2:172.21.15.31:3300/0 conn(0x5613132f17d0 0x5613132f24d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:45.152 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.150+0000 7fd0b6298800 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56131317da20 con 0x5613132f2a10 2024-09-22T08:36:45.152 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.150+0000 7fd0b6298800 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x56131317d7d0 con 0x5613132f17d0 2024-09-22T08:36:45.152 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.150+0000 7fd0b3d82640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x5613132f17d0 0x5613132f24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:45.152 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.150+0000 7fd0b3581640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x5613132f2a10 0x5613132f7560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.142:42470/0 (socket says 172.21.15.142:42470) 2024-09-22T08:36:45.152 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.150+0000 7fd0b3d82640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x5613132f17d0 0x5613132f24d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:38862/0 (socket says 172.21.15.142:38862) 2024-09-22T08:36:45.152 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.150+0000 7fd0b3581640 1 -- 172.21.15.142:0/3256512545 learned_addr learned my addr 172.21.15.142:0/3256512545 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-09-22T08:36:45.152 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.150+0000 7fd0b3d82640 1 -- 172.21.15.142:0/3256512545 >> v1:172.21.15.31:6789/0 conn(0x5613132f2a10 legacy=0x5613132f7560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:45.153 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.150+0000 7fd0b3d82640 1 -- 172.21.15.142:0/3256512545 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5613132f1ed0 con 0x5613132f17d0 2024-09-22T08:36:45.153 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.152+0000 7fd0b3d82640 1 --2- 172.21.15.142:0/3256512545 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5613132f17d0 0x5613132f24d0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fd0a400a470 tx=0x7fd0a4045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=757defce681fbdf4 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:45.154 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.153+0000 7fd0b2d80640 1 -- 172.21.15.142:0/3256512545 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd0a4053570 con 0x5613132f17d0 2024-09-22T08:36:45.154 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.153+0000 7fd0b2d80640 1 -- 172.21.15.142:0/3256512545 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0a4058070 con 0x5613132f17d0 2024-09-22T08:36:45.154 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.153+0000 7fd0b2d80640 1 -- 172.21.15.142:0/3256512545 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd0a4053880 con 0x5613132f17d0 2024-09-22T08:36:45.154 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.153+0000 7fd0b6298800 1 -- 172.21.15.142:0/3256512545 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5613132f17d0 msgr2=0x5613132f24d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:45.155 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.153+0000 7fd0b6298800 1 --2- 172.21.15.142:0/3256512545 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5613132f17d0 0x5613132f24d0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fd0a400a470 tx=0x7fd0a4045a20 comp rx=0 tx=0).stop 2024-09-22T08:36:45.155 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.153+0000 7fd0b6298800 1 -- 172.21.15.142:0/3256512545 shutdown_connections 2024-09-22T08:36:45.155 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.153+0000 7fd0b6298800 1 --2- 172.21.15.142:0/3256512545 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5613132f17d0 0x5613132f24d0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:45.155 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.153+0000 7fd0b6298800 1 -- 172.21.15.142:0/3256512545 >> 172.21.15.142:0/3256512545 conn(0x5613132ecba0 msgr2=0x5613132ef000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:45.155 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.153+0000 7fd0b6298800 1 -- 172.21.15.142:0/3256512545 shutdown_connections 2024-09-22T08:36:45.155 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.153+0000 7fd0b6298800 1 -- 172.21.15.142:0/3256512545 wait complete. 2024-09-22T08:36:45.169 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.167+0000 7fd0b6298800 1 Processor -- start 2024-09-22T08:36:45.169 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.167+0000 7fd0b6298800 1 -- start start 2024-09-22T08:36:45.169 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.167+0000 7fd0b6298800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5613132f17d0 0x561313266150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:45.170 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.167+0000 7fd0b6298800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x56131318add0 con 0x5613132f17d0 2024-09-22T08:36:45.170 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.168+0000 7fd0b3d82640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5613132f17d0 0x561313266150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:45.170 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.168+0000 7fd0b3d82640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5613132f17d0 0x561313266150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:38878/0 (socket says 172.21.15.142:38878) 2024-09-22T08:36:45.170 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.168+0000 7fd0b3d82640 1 -- 172.21.15.142:0/3285814651 learned_addr learned my addr 172.21.15.142:0/3285814651 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:45.170 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.168+0000 7fd0b3d82640 1 -- 172.21.15.142:0/3285814651 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561313266740 con 0x5613132f17d0 2024-09-22T08:36:45.170 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.168+0000 7fd0b3d82640 1 --2- 172.21.15.142:0/3285814651 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5613132f17d0 0x561313266150 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fd0a4025c20 tx=0x7fd0a4051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c1a23f75ff760b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:45.170 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.168+0000 7fcfa1e0b640 1 -- 172.21.15.142:0/3285814651 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd0a4053a20 con 0x5613132f17d0 2024-09-22T08:36:45.170 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.168+0000 7fcfa1e0b640 1 -- 172.21.15.142:0/3285814651 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0a4063070 con 0x5613132f17d0 2024-09-22T08:36:45.170 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.168+0000 7fcfa1e0b640 1 -- 172.21.15.142:0/3285814651 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd0a4053cf0 con 0x5613132f17d0 2024-09-22T08:36:45.172 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.169+0000 7fd0b6298800 1 -- 172.21.15.142:0/3285814651 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5613132f17d0 msgr2=0x561313266150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:45.172 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.169+0000 7fd0b6298800 1 --2- 172.21.15.142:0/3285814651 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5613132f17d0 0x561313266150 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fd0a4025c20 tx=0x7fd0a4051000 comp rx=0 tx=0).stop 2024-09-22T08:36:45.172 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.169+0000 7fd0b6298800 1 -- 172.21.15.142:0/3285814651 shutdown_connections 2024-09-22T08:36:45.173 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.169+0000 7fd0b6298800 1 --2- 172.21.15.142:0/3285814651 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5613132f17d0 0x561313266150 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:45.173 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.169+0000 7fd0b6298800 1 -- 172.21.15.142:0/3285814651 >> 172.21.15.142:0/3285814651 conn(0x5613132ecba0 msgr2=0x5613133dc890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:45.173 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.169+0000 7fd0b6298800 1 -- 172.21.15.142:0/3285814651 shutdown_connections 2024-09-22T08:36:45.173 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.169+0000 7fd0b6298800 1 -- 172.21.15.142:0/3285814651 wait complete. 2024-09-22T08:36:45.173 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.169+0000 7fd0b6298800 1 Processor -- start 2024-09-22T08:36:45.173 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.169+0000 7fd0b6298800 1 -- start start 2024-09-22T08:36:45.173 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.170+0000 7fd0b6298800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5613132f17d0 0x5613133e2360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:45.173 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.170+0000 7fd0b6298800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5613132f3280 con 0x5613132f17d0 2024-09-22T08:36:45.173 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.170+0000 7fd0b3d82640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5613132f17d0 0x5613133e2360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:45.173 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.170+0000 7fd0b3d82640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5613132f17d0 0x5613133e2360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:38886/0 (socket says 172.21.15.142:38886) 2024-09-22T08:36:45.173 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.170+0000 7fd0b3d82640 1 -- 172.21.15.142:0/3142930690 learned_addr learned my addr 172.21.15.142:0/3142930690 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:45.173 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.170+0000 7fd0b3d82640 1 -- 172.21.15.142:0/3142930690 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5613133e28c0 con 0x5613132f17d0 2024-09-22T08:36:45.173 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.170+0000 7fd0b3d82640 1 --2- 172.21.15.142:0/3142930690 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5613132f17d0 0x5613133e2360 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fd0a4025c20 tx=0x7fd0a4002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:45.173 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.171+0000 7fcf9bfff640 1 -- 172.21.15.142:0/3142930690 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd0a4068660 con 0x5613132f17d0 2024-09-22T08:36:45.174 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.171+0000 7fcf9bfff640 1 -- 172.21.15.142:0/3142930690 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0a4068800 con 0x5613132f17d0 2024-09-22T08:36:45.174 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.171+0000 7fd0b6298800 1 -- 172.21.15.142:0/3142930690 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5613133e0c70 con 0x5613132f17d0 2024-09-22T08:36:45.174 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.171+0000 7fcf9bfff640 1 -- 172.21.15.142:0/3142930690 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd0a4068ae0 con 0x5613132f17d0 2024-09-22T08:36:45.174 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.171+0000 7fd0b6298800 1 -- 172.21.15.142:0/3142930690 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5613133e1290 con 0x5613132f17d0 2024-09-22T08:36:45.176 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.172+0000 7fcf9bfff640 1 -- 172.21.15.142:0/3142930690 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fd0a4068c80 con 0x5613132f17d0 2024-09-22T08:36:45.176 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.172+0000 7fcf9bfff640 1 --2- 172.21.15.142:0/3142930690 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fcf9c03d000 0x7fcf9c03f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:45.176 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.172+0000 7fcf9bfff640 1 -- 172.21.15.142:0/3142930690 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fd0a4098bf0 con 0x5613132f17d0 2024-09-22T08:36:45.177 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.172+0000 7fd0b3581640 1 --2- 172.21.15.142:0/3142930690 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fcf9c03d000 0x7fcf9c03f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:45.177 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.172+0000 7fd0b6298800 1 --2- 172.21.15.142:0/3142930690 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5613132f2a10 0x5613133f3010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:45.177 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.172+0000 7fd0b6298800 1 -- 172.21.15.142:0/3142930690 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5613133f3550 con 0x5613132f2a10 2024-09-22T08:36:45.177 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.172+0000 7fd0b4583640 1 --2- 172.21.15.142:0/3142930690 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5613132f2a10 0x5613133f3010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:45.177 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.172+0000 7fd0b3581640 1 --2- 172.21.15.142:0/3142930690 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fcf9c03d000 0x7fcf9c03f4c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fd0a8001d70 tx=0x7fd0a80012d0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:45.177 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.173+0000 7fd0b4583640 1 --2- 172.21.15.142:0/3142930690 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5613132f2a10 0x5613133f3010 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:45.177 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.173+0000 7fd0b4583640 1 -- 172.21.15.142:0/3142930690 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd0ac00a4d0 con 0x5613132f2a10 2024-09-22T08:36:45.177 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.173+0000 7fd0b6298800 1 -- 172.21.15.142:0/3142930690 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5613133f3da0 con 0x5613132f2a10 2024-09-22T08:36:45.177 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.173+0000 7fd0b4583640 1 -- 172.21.15.142:0/3142930690 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd0ac00a4d0 con 0x5613132f2a10 2024-09-22T08:36:45.177 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.173+0000 7fd0b6298800 1 --2- 172.21.15.142:0/3142930690 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5613133f5660 0x5613133f7b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:45.177 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.173+0000 7fd0b6298800 1 -- 172.21.15.142:0/3142930690 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:3 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5613133f8290 con 0x5613133f5660 2024-09-22T08:36:45.177 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.173+0000 7fd0b3d82640 1 --2- 172.21.15.142:0/3142930690 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5613133f5660 0x5613133f7b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:45.177 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.174+0000 7fd0b3d82640 1 --2- 172.21.15.142:0/3142930690 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5613133f5660 0x5613133f7b00 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:45.177 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.174+0000 7fd0b3d82640 1 -- 172.21.15.142:0/3142930690 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(3 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fd0a4051070 con 0x5613133f5660 2024-09-22T08:36:45.178 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.174+0000 7fd0b6298800 1 -- 172.21.15.142:0/3142930690 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5613133f45f0 con 0x5613132f2a10 2024-09-22T08:36:45.178 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.174+0000 7fd0b4583640 1 -- 172.21.15.142:0/3142930690 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd0ac00a4d0 con 0x5613132f2a10 2024-09-22T08:36:45.178 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.174+0000 7fd0b6298800 1 -- 172.21.15.142:0/3142930690 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5613133f49d0 con 0x5613133f5660 2024-09-22T08:36:45.178 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.175+0000 7fd0b3d82640 1 -- 172.21.15.142:0/3142930690 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(5 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fd0a4051070 con 0x5613133f5660 2024-09-22T08:36:45.178 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.175+0000 7fd0b6298800 1 Processor -- start 2024-09-22T08:36:45.178 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.175+0000 7fd0b6298800 1 -- start start 2024-09-22T08:36:45.178 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.175+0000 7fd0b6298800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561313406c90 0x5613134070b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:45.178 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.175+0000 7fd0b6298800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5613131e9d50 con 0x561313406c90 2024-09-22T08:36:45.178 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.175+0000 7fd0b4583640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561313406c90 0x5613134070b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:45.178 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.175+0000 7fd0b4583640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561313406c90 0x5613134070b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:38898/0 (socket says 172.21.15.142:38898) 2024-09-22T08:36:45.178 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.175+0000 7fd0b4583640 1 -- 172.21.15.142:0/2882888465 learned_addr learned my addr 172.21.15.142:0/2882888465 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:45.182 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.176+0000 7fd0b4583640 1 -- 172.21.15.142:0/2882888465 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5613134076f0 con 0x561313406c90 2024-09-22T08:36:45.182 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.176+0000 7fd0b4583640 1 --2- 172.21.15.142:0/2882888465 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561313406c90 0x5613134070b0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x5613133e1f00 tx=0x7fd0ac0167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:45.182 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.176+0000 7fcf997fa640 1 -- 172.21.15.142:0/2882888465 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd0ac013640 con 0x561313406c90 2024-09-22T08:36:45.182 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.176+0000 7fcf997fa640 1 -- 172.21.15.142:0/2882888465 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0ac0137e0 con 0x561313406c90 2024-09-22T08:36:45.182 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.176+0000 7fcf997fa640 1 -- 172.21.15.142:0/2882888465 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd0ac013ae0 con 0x561313406c90 2024-09-22T08:36:45.182 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.176+0000 7fd0b6298800 1 -- 172.21.15.142:0/2882888465 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561313407f20 con 0x561313406c90 2024-09-22T08:36:45.182 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.176+0000 7fd0b6298800 1 -- 172.21.15.142:0/2882888465 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5613134084c0 con 0x561313406c90 2024-09-22T08:36:45.183 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.177+0000 7fcf997fa640 1 -- 172.21.15.142:0/2882888465 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fd0ac011040 con 0x561313406c90 2024-09-22T08:36:45.183 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.177+0000 7fcf997fa640 1 --2- 172.21.15.142:0/2882888465 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fcf8c03cfb0 0x7fcf8c03f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:45.183 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.177+0000 7fcf997fa640 1 -- 172.21.15.142:0/2882888465 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fd0ac00e040 con 0x561313406c90 2024-09-22T08:36:45.183 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.177+0000 7fd0b3d82640 1 --2- 172.21.15.142:0/2882888465 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fcf8c03cfb0 0x7fcf8c03f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:45.183 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.178+0000 7fd0b6298800 1 Processor -- start 2024-09-22T08:36:45.183 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.178+0000 7fd0b3d82640 1 --2- 172.21.15.142:0/2882888465 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fcf8c03cfb0 0x7fcf8c03f470 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fd0a4068fd0 tx=0x7fd0a405d5c0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:45.183 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.178+0000 7fd0b6298800 1 -- start start 2024-09-22T08:36:45.183 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.178+0000 7fd0b6298800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561313413790 0x561313413b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:45.183 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.178+0000 7fd0b6298800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5613133e4e50 con 0x561313413790 2024-09-22T08:36:45.183 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.178+0000 7fd0b4583640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561313413790 0x561313413b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:45.183 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.178+0000 7fd0b4583640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561313413790 0x561313413b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:38908/0 (socket says 172.21.15.142:38908) 2024-09-22T08:36:45.184 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.178+0000 7fd0b4583640 1 -- 172.21.15.142:0/2489862374 learned_addr learned my addr 172.21.15.142:0/2489862374 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:45.184 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.178+0000 7fd0b4583640 1 -- 172.21.15.142:0/2489862374 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561313414180 con 0x561313413790 2024-09-22T08:36:45.184 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.179+0000 7fd0b4583640 1 --2- 172.21.15.142:0/2489862374 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561313413790 0x561313413b90 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fd0ac020000 tx=0x7fd0ac01f400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=502e7aa7763483c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:45.184 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.179+0000 7fcf92ffd640 1 -- 172.21.15.142:0/2489862374 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd0ac021cf0 con 0x561313413790 2024-09-22T08:36:45.184 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.179+0000 7fcf92ffd640 1 -- 172.21.15.142:0/2489862374 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0ac052070 con 0x561313413790 2024-09-22T08:36:45.184 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.179+0000 7fd0b6298800 1 -- 172.21.15.142:0/2489862374 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561313413790 msgr2=0x561313413b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:45.184 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.179+0000 7fd0b6298800 1 --2- 172.21.15.142:0/2489862374 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561313413790 0x561313413b90 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fd0ac020000 tx=0x7fd0ac01f400 comp rx=0 tx=0).stop 2024-09-22T08:36:45.184 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.179+0000 7fd0b6298800 1 -- 172.21.15.142:0/2489862374 shutdown_connections 2024-09-22T08:36:45.184 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.179+0000 7fd0b6298800 1 --2- 172.21.15.142:0/2489862374 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561313413790 0x561313413b90 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:45.184 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.179+0000 7fd0b6298800 1 -- 172.21.15.142:0/2489862374 >> 172.21.15.142:0/2489862374 conn(0x56131340fbb0 msgr2=0x56131340ddf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:45.184 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.179+0000 7fd0b6298800 1 -- 172.21.15.142:0/2489862374 shutdown_connections 2024-09-22T08:36:45.184 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.179+0000 7fd0b6298800 1 -- 172.21.15.142:0/2489862374 wait complete. 2024-09-22T08:36:45.184 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.180+0000 7fd0b6298800 1 Processor -- start 2024-09-22T08:36:45.184 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.180+0000 7fd0b6298800 1 -- start start 2024-09-22T08:36:45.184 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.180+0000 7fd0b6298800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561313413790 0x56131341ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:45.185 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.180+0000 7fd0b6298800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5613134147a0 con 0x561313413790 2024-09-22T08:36:45.185 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.180+0000 7fd0b4583640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561313413790 0x56131341ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:45.185 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.180+0000 7fd0b4583640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561313413790 0x56131341ab90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:38920/0 (socket says 172.21.15.142:38920) 2024-09-22T08:36:45.185 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.180+0000 7fd0b4583640 1 -- 172.21.15.142:0/2229781816 learned_addr learned my addr 172.21.15.142:0/2229781816 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:45.185 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.180+0000 7fd0b4583640 1 -- 172.21.15.142:0/2229781816 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56131341b0f0 con 0x561313413790 2024-09-22T08:36:45.185 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.180+0000 7fd0b4583640 1 --2- 172.21.15.142:0/2229781816 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561313413790 0x56131341ab90 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fd0ac0208e0 tx=0x7fd0ac054860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:45.185 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.181+0000 7fcf917fa640 1 -- 172.21.15.142:0/2229781816 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd0ac021cf0 con 0x561313413790 2024-09-22T08:36:45.185 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.181+0000 7fcf917fa640 1 -- 172.21.15.142:0/2229781816 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0ac01fca0 con 0x561313413790 2024-09-22T08:36:45.185 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.181+0000 7fd0b6298800 1 -- 172.21.15.142:0/2229781816 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56131341b380 con 0x561313413790 2024-09-22T08:36:45.185 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.181+0000 7fcf917fa640 1 -- 172.21.15.142:0/2229781816 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd0ac01f500 con 0x561313413790 2024-09-22T08:36:45.185 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.181+0000 7fd0b6298800 1 -- 172.21.15.142:0/2229781816 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56131341bf10 con 0x561313413790 2024-09-22T08:36:45.196 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.181+0000 7fcf917fa640 1 -- 172.21.15.142:0/2229781816 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fd0ac01f6a0 con 0x561313413790 2024-09-22T08:36:45.196 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.182+0000 7fcf917fa640 1 --2- 172.21.15.142:0/2229781816 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fcf7c03d020 0x7fcf7c03f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:45.196 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.182+0000 7fcf917fa640 1 -- 172.21.15.142:0/2229781816 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fd0ac034cd0 con 0x561313413790 2024-09-22T08:36:45.196 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.182+0000 7fd0b3d82640 1 --2- 172.21.15.142:0/2229781816 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fcf7c03d020 0x7fcf7c03f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:45.196 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.182+0000 7fd0b6298800 20 rados->read ofs=0 len=0 2024-09-22T08:36:45.197 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.182+0000 7fd0b6298800 1 --2- 172.21.15.142:0/2229781816 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5613134264b0 0x561313428970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:45.197 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.182+0000 7fd0b6298800 1 -- 172.21.15.142:0/2229781816 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5613134290c0 con 0x5613134264b0 2024-09-22T08:36:45.197 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.182+0000 7fd0b3581640 1 --2- 172.21.15.142:0/2229781816 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5613134264b0 0x561313428970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:45.197 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.182+0000 7fd0b3d82640 1 --2- 172.21.15.142:0/2229781816 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fcf7c03d020 0x7fcf7c03f4e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fd0a4097430 tx=0x7fd0a4082000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:45.197 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.182+0000 7fd0b3581640 1 --2- 172.21.15.142:0/2229781816 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5613134264b0 0x561313428970 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:45.197 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.182+0000 7fd0b3581640 1 -- 172.21.15.142:0/2229781816 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd0a8009050 con 0x5613134264b0 2024-09-22T08:36:45.197 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.182+0000 7fd0b6298800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:45.197 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.182+0000 7fd0b6298800 20 realm 2024-09-22T08:36:45.197 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.182+0000 7fd0b6298800 20 rados->read ofs=0 len=0 2024-09-22T08:36:45.197 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.182+0000 7fd0b6298800 1 -- 172.21.15.142:0/2229781816 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561313425820 con 0x5613134264b0 2024-09-22T08:36:45.197 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.183+0000 7fd0b3581640 1 -- 172.21.15.142:0/2229781816 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd0a8009050 con 0x5613134264b0 2024-09-22T08:36:45.197 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.183+0000 7fd0b6298800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:45.197 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.183+0000 7fd0b6298800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:36:45.197 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.183+0000 7fd0b6298800 20 rados->read ofs=0 len=0 2024-09-22T08:36:45.198 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.183+0000 7fd0b6298800 1 -- 172.21.15.142:0/2229781816 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561313429ba0 con 0x5613134264b0 2024-09-22T08:36:45.198 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.183+0000 7fd0b3581640 1 -- 172.21.15.142:0/2229781816 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd0a8009050 con 0x5613134264b0 2024-09-22T08:36:45.198 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.183+0000 7fd0b6298800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:45.198 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.183+0000 7fd0b6298800 20 rados->read ofs=0 len=0 2024-09-22T08:36:45.198 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.183+0000 7fd0b6298800 1 -- 172.21.15.142:0/2229781816 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56131342a470 con 0x5613134264b0 2024-09-22T08:36:45.198 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.183+0000 7fd0b3581640 1 -- 172.21.15.142:0/2229781816 <== osd.1 v2:172.21.15.142:6816/3192108003 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd0a8009050 con 0x5613134264b0 2024-09-22T08:36:45.198 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.183+0000 7fd0b6298800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:36:45.198 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.183+0000 7fd0b6298800 20 rados->read ofs=0 len=0 2024-09-22T08:36:45.198 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.183+0000 7fd0b6298800 1 --2- 172.21.15.142:0/2229781816 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x56131342adb0 0x56131342d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:45.198 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.183+0000 7fd0b6298800 1 -- 172.21.15.142:0/2229781816 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56131342d8e0 con 0x56131342adb0 2024-09-22T08:36:45.198 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.183+0000 7fd0b4583640 1 --2- 172.21.15.142:0/2229781816 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x56131342adb0 0x56131342d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:45.198 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.183+0000 7fd0b4583640 1 --2- 172.21.15.142:0/2229781816 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x56131342adb0 0x56131342d1a0 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:45.198 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.184+0000 7fd0b4583640 1 -- 172.21.15.142:0/2229781816 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(5 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fd0ac00a4d0 con 0x56131342adb0 2024-09-22T08:36:45.198 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.184+0000 7fd0b6298800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:36:45.199 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.184+0000 7fd0b6298800 20 searching for the correct realm 2024-09-22T08:36:45.199 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.184+0000 7fd0b6298800 1 -- 172.21.15.142:0/2229781816 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56131342f290 con 0x56131342adb0 2024-09-22T08:36:45.199 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.184+0000 7fd0b4583640 1 -- 172.21.15.142:0/2229781816 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0ac00a4d0 con 0x56131342adb0 2024-09-22T08:36:45.199 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.184+0000 7fd0b4583640 1 --2- 172.21.15.142:0/2229781816 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7fd0ac03cad0 0x7fd0ac0123d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:45.199 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.184+0000 7fd0b4583640 1 -- 172.21.15.142:0/2229781816 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56131342f290 con 0x7fd0ac03cad0 2024-09-22T08:36:45.199 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.184+0000 7fd0b3d82640 1 --2- 172.21.15.142:0/2229781816 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7fd0ac03cad0 0x7fd0ac0123d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:45.199 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.184+0000 7fd0b3d82640 1 --2- 172.21.15.142:0/2229781816 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7fd0ac03cad0 0x7fd0ac0123d0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:45.199 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.185+0000 7fd0b3d82640 1 -- 172.21.15.142:0/2229781816 <== osd.2 v2:172.21.15.142:6808/279438927 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0a4051070 con 0x7fd0ac03cad0 2024-09-22T08:36:45.199 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.185+0000 7fd0b3d82640 1 --2- 172.21.15.142:0/2229781816 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7fd0a405f040 0x7fd0a408ff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:45.199 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.185+0000 7fd0b3d82640 1 -- 172.21.15.142:0/2229781816 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56131342f290 con 0x7fd0a405f040 2024-09-22T08:36:45.200 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.185+0000 7fd0b3581640 1 --2- 172.21.15.142:0/2229781816 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7fd0a405f040 0x7fd0a408ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:45.200 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.185+0000 7fd0b3581640 1 --2- 172.21.15.142:0/2229781816 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7fd0a405f040 0x7fd0a408ff70 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:45.200 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.185+0000 7fd0b3581640 1 -- 172.21.15.142:0/2229781816 <== osd.0 v2:172.21.15.31:6800/168281188 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0a8009050 con 0x7fd0a405f040 2024-09-22T08:36:45.200 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.185+0000 7fd0b3581640 1 -- 172.21.15.142:0/2229781816 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56131342f290 con 0x5613134264b0 2024-09-22T08:36:45.200 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.186+0000 7fd0b3581640 1 -- 172.21.15.142:0/2229781816 <== osd.1 v2:172.21.15.142:6816/3192108003 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0a8009050 con 0x5613134264b0 2024-09-22T08:36:45.200 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.186+0000 7fd0b3581640 1 -- 172.21.15.142:0/2229781816 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56131342f290 con 0x5613134264b0 2024-09-22T08:36:45.200 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.186+0000 7fd0b3581640 1 -- 172.21.15.142:0/2229781816 <== osd.1 v2:172.21.15.142:6816/3192108003 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0a8029040 con 0x5613134264b0 2024-09-22T08:36:45.200 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.186+0000 7fd0b3581640 1 -- 172.21.15.142:0/2229781816 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56131342f290 con 0x7fd0a405f040 2024-09-22T08:36:45.200 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.186+0000 7fd0b3581640 1 -- 172.21.15.142:0/2229781816 <== osd.0 v2:172.21.15.31:6800/168281188 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0a8029040 con 0x7fd0a405f040 2024-09-22T08:36:45.200 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.186+0000 7fd0b3581640 1 -- 172.21.15.142:0/2229781816 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56131342f290 con 0x7fd0a405f040 2024-09-22T08:36:45.200 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.186+0000 7fd0b3581640 1 -- 172.21.15.142:0/2229781816 <== osd.0 v2:172.21.15.31:6800/168281188 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0a8029040 con 0x7fd0a405f040 2024-09-22T08:36:45.200 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.186+0000 7fd0b3581640 1 -- 172.21.15.142:0/2229781816 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56131342f290 con 0x7fd0ac03cad0 2024-09-22T08:36:45.200 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.186+0000 7fd0b3d82640 1 -- 172.21.15.142:0/2229781816 <== osd.2 v2:172.21.15.142:6808/279438927 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0a4051070 con 0x7fd0ac03cad0 2024-09-22T08:36:45.201 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.186+0000 7fd0b3d82640 1 -- 172.21.15.142:0/2229781816 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56131342f290 con 0x56131342adb0 2024-09-22T08:36:45.201 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.187+0000 7fd0b4583640 1 -- 172.21.15.142:0/2229781816 <== osd.3 v2:172.21.15.142:6800/1064901393 3 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0ac00a4d0 con 0x56131342adb0 2024-09-22T08:36:45.201 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.187+0000 7fd0b4583640 1 -- 172.21.15.142:0/2229781816 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56131342f290 con 0x5613134264b0 2024-09-22T08:36:45.201 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.187+0000 7fd0b3581640 1 -- 172.21.15.142:0/2229781816 <== osd.1 v2:172.21.15.142:6816/3192108003 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0a8029040 con 0x5613134264b0 2024-09-22T08:36:45.201 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.187+0000 7fd0b3581640 1 -- 172.21.15.142:0/2229781816 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56131342f290 con 0x7fd0a405f040 2024-09-22T08:36:45.201 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.187+0000 7fd0b3581640 1 -- 172.21.15.142:0/2229781816 <== osd.0 v2:172.21.15.31:6800/168281188 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0a8029040 con 0x7fd0a405f040 2024-09-22T08:36:45.201 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.187+0000 7fd0b3581640 1 -- 172.21.15.142:0/2229781816 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56131342f290 con 0x5613134264b0 2024-09-22T08:36:45.201 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.187+0000 7fd0b3581640 1 -- 172.21.15.142:0/2229781816 <== osd.1 v2:172.21.15.142:6816/3192108003 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0a8029040 con 0x5613134264b0 2024-09-22T08:36:45.201 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.187+0000 7fd0b3581640 1 -- 172.21.15.142:0/2229781816 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56131342f290 con 0x7fd0ac03cad0 2024-09-22T08:36:45.201 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.188+0000 7fd0b3d82640 1 -- 172.21.15.142:0/2229781816 <== osd.2 v2:172.21.15.142:6808/279438927 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fd0a4051070 con 0x7fd0ac03cad0 2024-09-22T08:36:45.201 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.188+0000 7fd0b3d82640 1 -- 172.21.15.142:0/2229781816 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56131342f290 con 0x56131342adb0 2024-09-22T08:36:45.201 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.188+0000 7fd0b4583640 1 -- 172.21.15.142:0/2229781816 <== osd.3 v2:172.21.15.142:6800/1064901393 4 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0ac00a4d0 con 0x56131342adb0 2024-09-22T08:36:45.201 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.188+0000 7fd0b4583640 1 -- 172.21.15.142:0/2229781816 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56131342f290 con 0x56131342adb0 2024-09-22T08:36:45.201 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.188+0000 7fd0b4583640 1 -- 172.21.15.142:0/2229781816 <== osd.3 v2:172.21.15.142:6800/1064901393 5 ==== osd_op_reply(20 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fd0ac00a4d0 con 0x56131342adb0 2024-09-22T08:36:45.202 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.188+0000 7fd0b4583640 1 -- 172.21.15.142:0/2229781816 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56131342f290 con 0x7fd0a405f040 2024-09-22T08:36:45.202 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.188+0000 7fd0b3581640 1 -- 172.21.15.142:0/2229781816 <== osd.0 v2:172.21.15.31:6800/168281188 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0a8029040 con 0x7fd0a405f040 2024-09-22T08:36:45.202 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.188+0000 7fd0b3581640 1 -- 172.21.15.142:0/2229781816 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56131342f290 con 0x56131342adb0 2024-09-22T08:36:45.202 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.189+0000 7fd0b4583640 1 -- 172.21.15.142:0/2229781816 <== osd.3 v2:172.21.15.142:6800/1064901393 6 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0ac00a4d0 con 0x56131342adb0 2024-09-22T08:36:45.202 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.189+0000 7fd0b4583640 1 -- 172.21.15.142:0/2229781816 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fd0ac066040 con 0x56131342adb0 2024-09-22T08:36:45.202 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.189+0000 7fd0b4583640 1 -- 172.21.15.142:0/2229781816 <== osd.3 v2:172.21.15.142:6800/1064901393 7 ==== osd_op_reply(23 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fd0ac00a4d0 con 0x56131342adb0 2024-09-22T08:36:45.202 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.189+0000 7fd0b4583640 1 -- 172.21.15.142:0/2229781816 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fd0ac066040 con 0x5613134264b0 2024-09-22T08:36:45.202 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.189+0000 7fd0b3581640 1 -- 172.21.15.142:0/2229781816 <== osd.1 v2:172.21.15.142:6816/3192108003 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0a8029040 con 0x5613134264b0 2024-09-22T08:36:45.202 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.189+0000 7fd0b3581640 1 -- 172.21.15.142:0/2229781816 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fd0ac066040 con 0x5613134264b0 2024-09-22T08:36:45.202 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.189+0000 7fd0b3581640 1 -- 172.21.15.142:0/2229781816 <== osd.1 v2:172.21.15.142:6816/3192108003 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fd0a8029040 con 0x5613134264b0 2024-09-22T08:36:45.202 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.189+0000 7fd0b3581640 1 -- 172.21.15.142:0/2229781816 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fd0ac066040 con 0x7fd0a405f040 2024-09-22T08:36:45.202 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.190+0000 7fd0b3581640 1 -- 172.21.15.142:0/2229781816 <== osd.0 v2:172.21.15.31:6800/168281188 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0a8029040 con 0x7fd0a405f040 2024-09-22T08:36:45.202 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.190+0000 7fd0b3581640 1 -- 172.21.15.142:0/2229781816 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fd0ac066040 con 0x56131342adb0 2024-09-22T08:36:45.202 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.190+0000 7fd0b4583640 1 -- 172.21.15.142:0/2229781816 <== osd.3 v2:172.21.15.142:6800/1064901393 8 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0ac00a4d0 con 0x56131342adb0 2024-09-22T08:36:45.203 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.190+0000 7fd0b4583640 1 -- 172.21.15.142:0/2229781816 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fd0ac066040 con 0x7fd0ac03cad0 2024-09-22T08:36:45.203 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.190+0000 7fd0b3d82640 1 -- 172.21.15.142:0/2229781816 <== osd.2 v2:172.21.15.142:6808/279438927 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0a4051070 con 0x7fd0ac03cad0 2024-09-22T08:36:45.203 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.190+0000 7fd0b3d82640 1 -- 172.21.15.142:0/2229781816 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fd0ac066040 con 0x5613134264b0 2024-09-22T08:36:45.203 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.190+0000 7fd0b3581640 1 -- 172.21.15.142:0/2229781816 <== osd.1 v2:172.21.15.142:6816/3192108003 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0a8029040 con 0x5613134264b0 2024-09-22T08:36:45.203 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.190+0000 7fd0b3581640 1 -- 172.21.15.142:0/2229781816 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fd0ac066040 con 0x7fd0a405f040 2024-09-22T08:36:45.203 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.191+0000 7fd0b3581640 1 -- 172.21.15.142:0/2229781816 <== osd.0 v2:172.21.15.31:6800/168281188 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0a8029040 con 0x7fd0a405f040 2024-09-22T08:36:45.203 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.191+0000 7fd0b3581640 1 -- 172.21.15.142:0/2229781816 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fd0ac066040 con 0x56131342adb0 2024-09-22T08:36:45.203 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.191+0000 7fd0b4583640 1 -- 172.21.15.142:0/2229781816 <== osd.3 v2:172.21.15.142:6800/1064901393 9 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0ac00a4d0 con 0x56131342adb0 2024-09-22T08:36:45.203 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.191+0000 7fd0b4583640 1 -- 172.21.15.142:0/2229781816 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fd0ac066040 con 0x7fd0a405f040 2024-09-22T08:36:45.203 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.191+0000 7fd0b3581640 1 -- 172.21.15.142:0/2229781816 <== osd.0 v2:172.21.15.31:6800/168281188 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0a8029040 con 0x7fd0a405f040 2024-09-22T08:36:45.203 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.191+0000 7fd0b3581640 1 -- 172.21.15.142:0/2229781816 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fd0ac066040 con 0x7fd0ac03cad0 2024-09-22T08:36:45.203 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.192+0000 7fd0b3d82640 1 -- 172.21.15.142:0/2229781816 <== osd.2 v2:172.21.15.142:6808/279438927 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0a4051070 con 0x7fd0ac03cad0 2024-09-22T08:36:45.203 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.192+0000 7fd0b3d82640 1 -- 172.21.15.142:0/2229781816 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fd0ac066040 con 0x56131342adb0 2024-09-22T08:36:45.203 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.192+0000 7fd0b4583640 1 -- 172.21.15.142:0/2229781816 <== osd.3 v2:172.21.15.142:6800/1064901393 10 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0ac00a4d0 con 0x56131342adb0 2024-09-22T08:36:45.204 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.192+0000 7fd0b4583640 1 -- 172.21.15.142:0/2229781816 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fd0ac066040 con 0x7fd0a405f040 2024-09-22T08:36:45.204 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.192+0000 7fd0b3581640 1 -- 172.21.15.142:0/2229781816 <== osd.0 v2:172.21.15.31:6800/168281188 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0a8029040 con 0x7fd0a405f040 2024-09-22T08:36:45.204 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.192+0000 7fd0b3581640 1 -- 172.21.15.142:0/2229781816 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fd0ac066040 con 0x5613134264b0 2024-09-22T08:36:45.204 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.192+0000 7fd0b3581640 1 -- 172.21.15.142:0/2229781816 <== osd.1 v2:172.21.15.142:6816/3192108003 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fd0a8029040 con 0x5613134264b0 2024-09-22T08:36:45.204 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.192+0000 7fd0b3581640 1 -- 172.21.15.142:0/2229781816 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fd0ac066040 con 0x7fd0ac03cad0 2024-09-22T08:36:45.204 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.193+0000 7fd0b3d82640 1 -- 172.21.15.142:0/2229781816 <== osd.2 v2:172.21.15.142:6808/279438927 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0a4051070 con 0x7fd0ac03cad0 2024-09-22T08:36:45.204 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.193+0000 7fd0b6298800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:36:45.204 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.193+0000 7fd0b6298800 20 RGWRados::pool_iterate: got zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec 2024-09-22T08:36:45.204 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.193+0000 7fd0b6298800 20 RGWRados::pool_iterate: got zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f 2024-09-22T08:36:45.204 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.193+0000 7fd0b6298800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:36:45.204 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.193+0000 7fd0b6298800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:36:45.204 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.193+0000 7fd0b6298800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:36:45.204 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.193+0000 7fd0b6298800 20 rados->read ofs=0 len=0 2024-09-22T08:36:45.204 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.193+0000 7fd0b6298800 1 -- 172.21.15.142:0/2229781816 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56131342e360 con 0x5613134264b0 2024-09-22T08:36:45.205 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.193+0000 7fd0b3581640 1 -- 172.21.15.142:0/2229781816 <== osd.1 v2:172.21.15.142:6816/3192108003 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd0a8029040 con 0x5613134264b0 2024-09-22T08:36:45.205 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.193+0000 7fd0b6298800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:45.205 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.193+0000 7fd0b6298800 20 rados->read ofs=0 len=0 2024-09-22T08:36:45.205 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.193+0000 7fd0b6298800 1 -- 172.21.15.142:0/2229781816 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56131342dfa0 con 0x5613134264b0 2024-09-22T08:36:45.205 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.193+0000 7fd0b3581640 1 -- 172.21.15.142:0/2229781816 <== osd.1 v2:172.21.15.142:6816/3192108003 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd0a8029040 con 0x5613134264b0 2024-09-22T08:36:45.205 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.193+0000 7fd0b6298800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:36:45.205 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.193+0000 7fd0b6298800 20 rados->read ofs=0 len=0 2024-09-22T08:36:45.205 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.193+0000 7fd0b6298800 1 -- 172.21.15.142:0/2229781816 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:40 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56131342ecc0 con 0x56131342adb0 2024-09-22T08:36:45.205 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.193+0000 7fd0b4583640 1 -- 172.21.15.142:0/2229781816 <== osd.3 v2:172.21.15.142:6800/1064901393 11 ==== osd_op_reply(40 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fd0ac00a4d0 con 0x56131342adb0 2024-09-22T08:36:45.205 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.193+0000 7fd0b6298800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:36:45.205 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.193+0000 7fd0b6298800 20 zone default found 2024-09-22T08:36:45.205 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.193+0000 7fd0b6298800 4 Realm: () 2024-09-22T08:36:45.205 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.193+0000 7fd0b6298800 4 ZoneGroup: default (d89f6f57-1007-47dd-9065-f486c7b01aec) 2024-09-22T08:36:45.205 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.193+0000 7fd0b6298800 4 Zone: default (e239248c-0bee-4e41-803a-24b288d3eb8f) 2024-09-22T08:36:45.205 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.193+0000 7fd0b6298800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:36:45.206 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.193+0000 7fd0b6298800 20 zonegroup default 2024-09-22T08:36:45.206 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.193+0000 7fd0b6298800 20 rados->read ofs=0 len=0 2024-09-22T08:36:45.206 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.193+0000 7fd0b6298800 1 -- 172.21.15.142:0/2229781816 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56131342e830 con 0x7fd0a405f040 2024-09-22T08:36:45.206 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.194+0000 7fd0b3581640 1 -- 172.21.15.142:0/2229781816 <== osd.0 v2:172.21.15.31:6800/168281188 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fd0a8029040 con 0x7fd0a405f040 2024-09-22T08:36:45.206 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.194+0000 7fd0b6298800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:45.206 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.194+0000 7fd0b6298800 20 rados->read ofs=0 len=0 2024-09-22T08:36:45.206 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.194+0000 7fd0b6298800 1 -- 172.21.15.142:0/2229781816 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561313431b00 con 0x56131342adb0 2024-09-22T08:36:45.206 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.194+0000 7fd0b4583640 1 -- 172.21.15.142:0/2229781816 <== osd.3 v2:172.21.15.142:6800/1064901393 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd0ac00a4d0 con 0x56131342adb0 2024-09-22T08:36:45.206 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.194+0000 7fd0b6298800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:45.206 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.194+0000 7fd0b6298800 20 rados->read ofs=0 len=0 2024-09-22T08:36:45.206 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.194+0000 7fd0b6298800 1 -- 172.21.15.142:0/2229781816 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561313431ea0 con 0x56131342adb0 2024-09-22T08:36:45.206 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.194+0000 7fd0b4583640 1 -- 172.21.15.142:0/2229781816 <== osd.3 v2:172.21.15.142:6800/1064901393 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd0ac00a4d0 con 0x56131342adb0 2024-09-22T08:36:45.206 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.194+0000 7fd0b6298800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:45.207 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.194+0000 7fd0b6298800 20 started sync module instance, tier type = 2024-09-22T08:36:45.207 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.194+0000 7fd0b6298800 20 started zone id=e239248c-0bee-4e41-803a-24b288d3eb8f (name=default) with tier type = 2024-09-22T08:36:45.207 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.194+0000 7fd0b6298800 1 -- 172.21.15.142:0/2229781816 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561313430f40 con 0x7fd0ac03cad0 2024-09-22T08:36:45.212 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.195+0000 7fd0b3d82640 1 -- 172.21.15.142:0/2229781816 <== osd.2 v2:172.21.15.142:6808/279438927 7 ==== osd_op_reply(44 notify.0 [create] v30'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd0a4051070 con 0x7fd0ac03cad0 2024-09-22T08:36:45.212 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.195+0000 7fd0b6298800 1 -- 172.21.15.142:0/2229781816 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94639927528080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5613134322e0 con 0x7fd0ac03cad0 2024-09-22T08:36:45.212 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.195+0000 7fd0b6298800 1 -- 172.21.15.142:0/2229781816 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561313432b30 con 0x5613134264b0 2024-09-22T08:36:45.212 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.196+0000 7fd0b3d82640 1 -- 172.21.15.142:0/2229781816 <== osd.2 v2:172.21.15.142:6808/279438927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94639927528080] v30'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd0a4051070 con 0x7fd0ac03cad0 2024-09-22T08:36:45.212 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.197+0000 7fd0b3581640 1 -- 172.21.15.142:0/2229781816 <== osd.1 v2:172.21.15.142:6816/3192108003 15 ==== osd_op_reply(46 notify.1 [create] v30'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd0a8029040 con 0x5613134264b0 2024-09-22T08:36:45.212 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.197+0000 7fd0b6298800 1 -- 172.21.15.142:0/2229781816 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94639927535232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561313432f50 con 0x5613134264b0 2024-09-22T08:36:45.212 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.197+0000 7fd0b6298800 1 -- 172.21.15.142:0/2229781816 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561313433910 con 0x56131342adb0 2024-09-22T08:36:45.212 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.198+0000 7fd0b4583640 1 -- 172.21.15.142:0/2229781816 <== osd.3 v2:172.21.15.142:6800/1064901393 14 ==== osd_op_reply(48 notify.2 [create] v30'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd0ac00a4d0 con 0x56131342adb0 2024-09-22T08:36:45.212 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.198+0000 7fd0b6298800 1 -- 172.21.15.142:0/2229781816 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94639927538784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561313433d30 con 0x56131342adb0 2024-09-22T08:36:45.212 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.198+0000 7fd0b6298800 1 -- 172.21.15.142:0/2229781816 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561313434830 con 0x7fd0ac03cad0 2024-09-22T08:36:45.212 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.198+0000 7fd0b3581640 1 -- 172.21.15.142:0/2229781816 <== osd.1 v2:172.21.15.142:6816/3192108003 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94639927535232] v30'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd0a8029040 con 0x5613134264b0 2024-09-22T08:36:45.212 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.199+0000 7fd0b4583640 1 -- 172.21.15.142:0/2229781816 <== osd.3 v2:172.21.15.142:6800/1064901393 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94639927538784] v30'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd0ac00a4d0 con 0x56131342adb0 2024-09-22T08:36:45.212 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.199+0000 7fd0b3d82640 1 -- 172.21.15.142:0/2229781816 <== osd.2 v2:172.21.15.142:6808/279438927 9 ==== osd_op_reply(50 notify.3 [create] v30'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd0a4051070 con 0x7fd0ac03cad0 2024-09-22T08:36:45.213 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.199+0000 7fd0b6298800 1 -- 172.21.15.142:0/2229781816 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94639927542560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561313433880 con 0x7fd0ac03cad0 2024-09-22T08:36:45.213 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.199+0000 7fd0b6298800 1 -- 172.21.15.142:0/2229781816 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5613134350d0 con 0x5613134264b0 2024-09-22T08:36:45.213 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.200+0000 7fd0b3d82640 1 -- 172.21.15.142:0/2229781816 <== osd.2 v2:172.21.15.142:6808/279438927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94639927542560] v30'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd0a4051070 con 0x7fd0ac03cad0 2024-09-22T08:36:45.213 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.200+0000 7fd0b3581640 1 -- 172.21.15.142:0/2229781816 <== osd.1 v2:172.21.15.142:6816/3192108003 17 ==== osd_op_reply(52 notify.4 [create] v30'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd0a8029040 con 0x5613134264b0 2024-09-22T08:36:45.213 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.200+0000 7fd0b6298800 1 -- 172.21.15.142:0/2229781816 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94639927536288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561313433880 con 0x5613134264b0 2024-09-22T08:36:45.213 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.200+0000 7fd0b6298800 1 -- 172.21.15.142:0/2229781816 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5613134357b0 con 0x7fd0a405f040 2024-09-22T08:36:45.213 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.201+0000 7fd0b3581640 1 -- 172.21.15.142:0/2229781816 <== osd.1 v2:172.21.15.142:6816/3192108003 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94639927536288] v30'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd0a8029040 con 0x5613134264b0 2024-09-22T08:36:45.213 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.201+0000 7fd0b3581640 1 -- 172.21.15.142:0/2229781816 <== osd.0 v2:172.21.15.31:6800/168281188 11 ==== osd_op_reply(54 notify.5 [create] v30'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd0a8029040 con 0x7fd0a405f040 2024-09-22T08:36:45.213 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.201+0000 7fd0b6298800 1 -- 172.21.15.142:0/2229781816 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94639927546560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5613134357b0 con 0x7fd0a405f040 2024-09-22T08:36:45.213 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.201+0000 7fd0b6298800 1 -- 172.21.15.142:0/2229781816 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5613134361f0 con 0x7fd0a405f040 2024-09-22T08:36:45.213 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.202+0000 7fd0b3581640 1 -- 172.21.15.142:0/2229781816 <== osd.0 v2:172.21.15.31:6800/168281188 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94639927546560] v30'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd0a8029040 con 0x7fd0a405f040 2024-09-22T08:36:45.213 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.202+0000 7fd0b3581640 1 -- 172.21.15.142:0/2229781816 <== osd.0 v2:172.21.15.31:6800/168281188 13 ==== osd_op_reply(56 notify.6 [create] v30'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd0a8029040 con 0x7fd0a405f040 2024-09-22T08:36:45.213 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.202+0000 7fd0b6298800 1 -- 172.21.15.142:0/2229781816 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94639927549120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5613134361b0 con 0x7fd0a405f040 2024-09-22T08:36:45.214 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.202+0000 7fd0b6298800 1 -- 172.21.15.142:0/2229781816 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561313436c10 con 0x7fd0a405f040 2024-09-22T08:36:45.214 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.203+0000 7fd0b3581640 1 -- 172.21.15.142:0/2229781816 <== osd.0 v2:172.21.15.31:6800/168281188 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94639927549120] v30'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd0a8029040 con 0x7fd0a405f040 2024-09-22T08:36:45.214 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.205+0000 7fd0b3581640 1 -- 172.21.15.142:0/2229781816 <== osd.0 v2:172.21.15.31:6800/168281188 15 ==== osd_op_reply(58 notify.7 [create] v30'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd0a8029040 con 0x7fd0a405f040 2024-09-22T08:36:45.214 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.205+0000 7fd0b6298800 1 -- 172.21.15.142:0/2229781816 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94639927551680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561313436bd0 con 0x7fd0a405f040 2024-09-22T08:36:45.214 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.205+0000 7fd0b6298800 20 add_watcher() i=0 2024-09-22T08:36:45.214 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.205+0000 7fd0b6298800 20 add_watcher() i=1 2024-09-22T08:36:45.214 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.205+0000 7fd0b6298800 20 add_watcher() i=2 2024-09-22T08:36:45.214 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.205+0000 7fd0b6298800 20 add_watcher() i=3 2024-09-22T08:36:45.214 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.205+0000 7fd0b6298800 20 add_watcher() i=4 2024-09-22T08:36:45.214 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.205+0000 7fd0b6298800 20 add_watcher() i=5 2024-09-22T08:36:45.214 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.205+0000 7fd0b6298800 20 add_watcher() i=6 2024-09-22T08:36:45.214 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.206+0000 7fd0b3581640 1 -- 172.21.15.142:0/2229781816 <== osd.0 v2:172.21.15.31:6800/168281188 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94639927551680] v30'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd0a8029040 con 0x7fd0a405f040 2024-09-22T08:36:45.215 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.206+0000 7fd0b6298800 20 add_watcher() i=7 2024-09-22T08:36:45.215 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.206+0000 7fd0b6298800 2 all 8 watchers are set, enabling cache 2024-09-22T08:36:45.215 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.206+0000 7fd0b6298800 1 -- 172.21.15.142:0/2229781816 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56131343a100 con 0x5613134264b0 2024-09-22T08:36:45.215 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.207+0000 7fd0b3581640 1 -- 172.21.15.142:0/2229781816 <== osd.1 v2:172.21.15.142:6816/3192108003 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fd0a8029040 con 0x5613134264b0 2024-09-22T08:36:45.215 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.207+0000 7fd0b6298800 1 -- 172.21.15.142:0/2229781816 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94639927544864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5613134374b0 con 0x5613134264b0 2024-09-22T08:36:45.215 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.208+0000 7fd0b3581640 1 -- 172.21.15.142:0/2229781816 <== osd.1 v2:172.21.15.142:6816/3192108003 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94639927544864] v30'88 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd0a8029040 con 0x5613134264b0 2024-09-22T08:36:45.215 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.208+0000 7fcf69fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:36:45.215 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.208+0000 7fd0b6298800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:36:45.215 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.208+0000 7fd0b6298800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:36:45.215 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.208+0000 7fd0b6298800 5 note: GC not initialized 2024-09-22T08:36:45.215 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.208+0000 7fcf68fe1640 20 reqs_thread_entry: start 2024-09-22T08:36:45.215 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.208+0000 7fd0b6298800 20 init_complete bucket index max shards: 11 2024-09-22T08:36:45.215 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.208+0000 7fd0b6298800 20 Filter name: none 2024-09-22T08:36:45.215 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.208+0000 7fcee27fc640 20 reqs_thread_entry: start 2024-09-22T08:36:45.216 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.208+0000 7fd0b6298800 20 rados->read ofs=0 len=0 2024-09-22T08:36:45.216 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.208+0000 7fd0b6298800 1 -- 172.21.15.142:0/2229781816 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56131346d040 con 0x5613134264b0 2024-09-22T08:36:45.216 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.209+0000 7fd0b3581640 1 -- 172.21.15.142:0/2229781816 <== osd.1 v2:172.21.15.142:6816/3192108003 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fd0a8029040 con 0x5613134264b0 2024-09-22T08:36:45.216 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.209+0000 7fd0b6298800 20 rados_obj.operate() r=0 bl.length=391 2024-09-22T08:36:45.216 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.209+0000 7fd0b6298800 20 rados->read ofs=0 len=0 2024-09-22T08:36:45.216 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.209+0000 7fd0b6298800 1 -- 172.21.15.142:0/2229781816 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56131346da60 con 0x5613134264b0 2024-09-22T08:36:45.216 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.209+0000 7fd0b3581640 1 -- 172.21.15.142:0/2229781816 <== osd.1 v2:172.21.15.142:6816/3192108003 22 ==== osd_op_reply(63 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fd0a8029040 con 0x5613134264b0 2024-09-22T08:36:45.216 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.209+0000 7fd0b6298800 20 rados_obj.operate() r=0 bl.length=391 2024-09-22T08:36:45.216 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.209+0000 7fd0b6298800 1 -- 172.21.15.142:0/2229781816 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:64 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56131346ea70 con 0x7fd0ac03cad0 2024-09-22T08:36:45.216 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.210+0000 7fd0b3d82640 1 -- 172.21.15.142:0/2229781816 <== osd.2 v2:172.21.15.142:6808/279438927 11 ==== osd_op_reply(64 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 155+0+0 (crc 0 0 0) 0x7fd0a4051070 con 0x7fd0ac03cad0 2024-09-22T08:36:45.216 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.210+0000 7fcf69fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:36:45.216 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.210+0000 7fd0b6298800 1 -- 172.21.15.142:0/2229781816 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94639927544864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56131346ade0 con 0x5613134264b0 2024-09-22T08:36:45.218 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.211+0000 7fd0b3581640 1 -- 172.21.15.142:0/2229781816 <== osd.1 v2:172.21.15.142:6816/3192108003 23 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94639927544864] v30'89 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd0a8029040 con 0x5613134264b0 2024-09-22T08:36:45.218 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.211+0000 7fd0b6298800 1 -- 172.21.15.142:0/2229781816 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94639927528080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56131346ade0 con 0x7fd0ac03cad0 2024-09-22T08:36:45.218 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.212+0000 7fd0b3d82640 1 -- 172.21.15.142:0/2229781816 <== osd.2 v2:172.21.15.142:6808/279438927 12 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94639927528080] v30'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd0a4051070 con 0x7fd0ac03cad0 2024-09-22T08:36:45.218 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.212+0000 7fd0b6298800 20 remove_watcher() i=0 2024-09-22T08:36:45.218 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.212+0000 7fd0b6298800 2 removed watcher, disabling cache 2024-09-22T08:36:45.218 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.212+0000 7fd0b6298800 1 -- 172.21.15.142:0/2229781816 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94639927535232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56131346ade0 con 0x5613134264b0 2024-09-22T08:36:45.219 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.214+0000 7fd0b3581640 1 -- 172.21.15.142:0/2229781816 <== osd.1 v2:172.21.15.142:6816/3192108003 24 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94639927535232] v30'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd0a8029040 con 0x5613134264b0 2024-09-22T08:36:45.219 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.214+0000 7fd0b6298800 20 remove_watcher() i=1 2024-09-22T08:36:45.219 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.214+0000 7fd0b6298800 1 -- 172.21.15.142:0/2229781816 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94639927538784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56131346ade0 con 0x56131342adb0 2024-09-22T08:36:45.219 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.215+0000 7fd0b4583640 1 -- 172.21.15.142:0/2229781816 <== osd.3 v2:172.21.15.142:6800/1064901393 16 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94639927538784] v30'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd0ac00a4d0 con 0x56131342adb0 2024-09-22T08:36:45.219 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.215+0000 7fd0b6298800 20 remove_watcher() i=2 2024-09-22T08:36:45.219 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.215+0000 7fd0b6298800 1 -- 172.21.15.142:0/2229781816 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94639927542560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56131346ade0 con 0x7fd0ac03cad0 2024-09-22T08:36:45.219 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.216+0000 7fd0b3d82640 1 -- 172.21.15.142:0/2229781816 <== osd.2 v2:172.21.15.142:6808/279438927 13 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94639927542560] v30'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd0a4051070 con 0x7fd0ac03cad0 2024-09-22T08:36:45.219 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.216+0000 7fd0b6298800 20 remove_watcher() i=3 2024-09-22T08:36:45.219 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.216+0000 7fd0b6298800 1 -- 172.21.15.142:0/2229781816 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94639927536288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56131346ade0 con 0x5613134264b0 2024-09-22T08:36:45.219 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.217+0000 7fd0b3581640 1 -- 172.21.15.142:0/2229781816 <== osd.1 v2:172.21.15.142:6816/3192108003 25 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94639927536288] v30'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd0a8029040 con 0x5613134264b0 2024-09-22T08:36:45.219 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.217+0000 7fd0b6298800 20 remove_watcher() i=4 2024-09-22T08:36:45.219 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.217+0000 7fd0b6298800 1 -- 172.21.15.142:0/2229781816 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94639927546560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56131346ade0 con 0x7fd0a405f040 2024-09-22T08:36:45.220 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.218+0000 7fd0b3581640 1 -- 172.21.15.142:0/2229781816 <== osd.0 v2:172.21.15.31:6800/168281188 17 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94639927546560] v30'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd0a8029040 con 0x7fd0a405f040 2024-09-22T08:36:45.220 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.218+0000 7fd0b6298800 20 remove_watcher() i=5 2024-09-22T08:36:45.220 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.218+0000 7fd0b6298800 1 -- 172.21.15.142:0/2229781816 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94639927549120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56131346ade0 con 0x7fd0a405f040 2024-09-22T08:36:45.220 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.219+0000 7fd0b3581640 1 -- 172.21.15.142:0/2229781816 <== osd.0 v2:172.21.15.31:6800/168281188 18 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94639927549120] v30'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd0a8029040 con 0x7fd0a405f040 2024-09-22T08:36:45.220 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.219+0000 7fd0b6298800 20 remove_watcher() i=6 2024-09-22T08:36:45.220 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.219+0000 7fd0b6298800 1 -- 172.21.15.142:0/2229781816 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94639927551680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56131346ade0 con 0x7fd0a405f040 2024-09-22T08:36:45.223 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.219+0000 7fd0b3581640 1 -- 172.21.15.142:0/2229781816 <== osd.0 v2:172.21.15.31:6800/168281188 19 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94639927551680] v30'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd0a8029040 con 0x7fd0a405f040 2024-09-22T08:36:45.223 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.219+0000 7fd0b6298800 20 remove_watcher() i=7 2024-09-22T08:36:45.223 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.220+0000 7fd0b6298800 1 -- 172.21.15.142:0/2229781816 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7fd0a405f040 msgr2=0x7fd0a408ff70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:45.223 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.220+0000 7fd0b6298800 1 --2- 172.21.15.142:0/2229781816 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7fd0a405f040 0x7fd0a408ff70 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:45.223 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.220+0000 7fd0b6298800 1 -- 172.21.15.142:0/2229781816 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5613134264b0 msgr2=0x561313428970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:45.224 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.220+0000 7fd0b6298800 1 --2- 172.21.15.142:0/2229781816 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5613134264b0 0x561313428970 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:45.224 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.220+0000 7fd0b6298800 1 -- 172.21.15.142:0/2229781816 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7fd0ac03cad0 msgr2=0x7fd0ac0123d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:45.224 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.220+0000 7fd0b6298800 1 --2- 172.21.15.142:0/2229781816 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7fd0ac03cad0 0x7fd0ac0123d0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:45.224 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.220+0000 7fd0b6298800 1 -- 172.21.15.142:0/2229781816 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x56131342adb0 msgr2=0x56131342d1a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:45.224 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.220+0000 7fd0b6298800 1 --2- 172.21.15.142:0/2229781816 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x56131342adb0 0x56131342d1a0 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:45.224 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.220+0000 7fd0b6298800 1 -- 172.21.15.142:0/2229781816 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fcf7c03d020 msgr2=0x7fcf7c03f4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:45.224 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.220+0000 7fd0b6298800 1 --2- 172.21.15.142:0/2229781816 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fcf7c03d020 0x7fcf7c03f4e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fd0a4097430 tx=0x7fd0a4082000 comp rx=0 tx=0).stop 2024-09-22T08:36:45.224 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.220+0000 7fd0b6298800 1 -- 172.21.15.142:0/2229781816 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561313413790 msgr2=0x56131341ab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:45.224 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.220+0000 7fd0b6298800 1 --2- 172.21.15.142:0/2229781816 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561313413790 0x56131341ab90 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fd0ac0208e0 tx=0x7fd0ac054860 comp rx=0 tx=0).stop 2024-09-22T08:36:45.224 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.220+0000 7fd0b3581640 1 -- 172.21.15.142:0/2229781816 reap_dead start 2024-09-22T08:36:45.224 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.220+0000 7fd0b3581640 1 -- 172.21.15.142:0/2229781816 reap_dead start 2024-09-22T08:36:45.224 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.220+0000 7fd0b6298800 1 -- 172.21.15.142:0/2229781816 shutdown_connections 2024-09-22T08:36:45.224 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.220+0000 7fd0b6298800 1 -- 172.21.15.142:0/2229781816 >> 172.21.15.142:0/2229781816 conn(0x56131340fbb0 msgr2=0x56131340ddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:45.224 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.220+0000 7fd0b6298800 1 -- 172.21.15.142:0/2229781816 shutdown_connections 2024-09-22T08:36:45.224 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.220+0000 7fd0b6298800 1 -- 172.21.15.142:0/2229781816 wait complete. 2024-09-22T08:36:45.225 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.220+0000 7fd0b6298800 1 -- 172.21.15.142:0/2882888465 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fcf8c03cfb0 msgr2=0x7fcf8c03f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:45.225 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.220+0000 7fd0b6298800 1 --2- 172.21.15.142:0/2882888465 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fcf8c03cfb0 0x7fcf8c03f470 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fd0a4068fd0 tx=0x7fd0a405d5c0 comp rx=0 tx=0).stop 2024-09-22T08:36:45.225 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.220+0000 7fd0b6298800 1 -- 172.21.15.142:0/2882888465 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561313406c90 msgr2=0x5613134070b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:45.225 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.220+0000 7fd0b6298800 1 --2- 172.21.15.142:0/2882888465 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561313406c90 0x5613134070b0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x5613133e1f00 tx=0x7fd0ac0167b0 comp rx=0 tx=0).stop 2024-09-22T08:36:45.225 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.220+0000 7fd0b6298800 1 -- 172.21.15.142:0/2882888465 shutdown_connections 2024-09-22T08:36:45.225 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.220+0000 7fd0b6298800 1 --2- 172.21.15.142:0/2882888465 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fcf8c03cfb0 0x7fcf8c03f470 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:45.225 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.220+0000 7fd0b6298800 1 --2- 172.21.15.142:0/2882888465 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561313406c90 0x5613134070b0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:45.225 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.220+0000 7fd0b6298800 1 -- 172.21.15.142:0/2882888465 >> 172.21.15.142:0/2882888465 conn(0x5613133fb040 msgr2=0x5613133fb420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:45.225 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.220+0000 7fd0b6298800 1 -- 172.21.15.142:0/2882888465 shutdown_connections 2024-09-22T08:36:45.225 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.220+0000 7fd0b6298800 1 -- 172.21.15.142:0/2882888465 wait complete. 2024-09-22T08:36:45.225 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.221+0000 7fd0b6298800 1 -- 172.21.15.142:0/3142930690 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5613132f2a10 msgr2=0x5613133f3010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:45.225 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.221+0000 7fd0b6298800 1 --2- 172.21.15.142:0/3142930690 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5613132f2a10 0x5613133f3010 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:45.225 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.221+0000 7fd0b6298800 1 -- 172.21.15.142:0/3142930690 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5613133f5660 msgr2=0x5613133f7b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:45.226 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.221+0000 7fd0b6298800 1 --2- 172.21.15.142:0/3142930690 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5613133f5660 0x5613133f7b00 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:45.226 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.221+0000 7fd0b6298800 1 -- 172.21.15.142:0/3142930690 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fcf9c03d000 msgr2=0x7fcf9c03f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:45.226 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.221+0000 7fd0b6298800 1 --2- 172.21.15.142:0/3142930690 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fcf9c03d000 0x7fcf9c03f4c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fd0a8001d70 tx=0x7fd0a80012d0 comp rx=0 tx=0).stop 2024-09-22T08:36:45.226 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.221+0000 7fd0b6298800 1 -- 172.21.15.142:0/3142930690 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5613132f17d0 msgr2=0x5613133e2360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:45.226 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.221+0000 7fd0b6298800 1 --2- 172.21.15.142:0/3142930690 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5613132f17d0 0x5613133e2360 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fd0a4025c20 tx=0x7fd0a4002fb0 comp rx=0 tx=0).stop 2024-09-22T08:36:45.226 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.221+0000 7fd0b6298800 1 -- 172.21.15.142:0/3142930690 shutdown_connections 2024-09-22T08:36:45.226 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.221+0000 7fd0b6298800 1 --2- 172.21.15.142:0/3142930690 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5613133f5660 0x5613133f7b00 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:45.226 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.221+0000 7fd0b6298800 1 --2- 172.21.15.142:0/3142930690 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5613132f2a10 0x5613133f3010 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:45.226 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.221+0000 7fd0b6298800 1 --2- 172.21.15.142:0/3142930690 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fcf9c03d000 0x7fcf9c03f4c0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:45.226 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.221+0000 7fd0b6298800 1 --2- 172.21.15.142:0/3142930690 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5613132f17d0 0x5613133e2360 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:45.226 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.221+0000 7fd0b6298800 1 -- 172.21.15.142:0/3142930690 >> 172.21.15.142:0/3142930690 conn(0x5613132ecba0 msgr2=0x5613133db080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:45.226 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.221+0000 7fd0b6298800 1 -- 172.21.15.142:0/3142930690 shutdown_connections 2024-09-22T08:36:45.226 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.221+0000 7fd0b6298800 1 -- 172.21.15.142:0/3142930690 wait complete. 2024-09-22T08:36:45.230 INFO:teuthology.orchestra.run.smithi142.stdout:[] 2024-09-22T08:36:45.231 DEBUG:tasks.util.rgw: json result: [] 2024-09-22T08:36:45.231 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list', '--uid', 'foo'] 2024-09-22T08:36:45.231 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list', '--uid', 'foo'] 2024-09-22T08:36:45.231 DEBUG:teuthology.orchestra.run.smithi142:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list --uid foo 2024-09-22T08:36:45.276 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:36:45.276 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:36:45.276 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.275+0000 7fc9fab0c800 1 Processor -- start 2024-09-22T08:36:45.276 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.275+0000 7fc9fab0c800 1 -- start start 2024-09-22T08:36:45.277 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.275+0000 7fc9fab0c800 1 --2- >> v2:172.21.15.31:3300/0 conn(0x561cc004b8e0 0x561cc004dda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:45.277 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.275+0000 7fc9fab0c800 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x561cbfed3a20 con 0x561cc0047da0 2024-09-22T08:36:45.277 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.275+0000 7fc9fab0c800 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x561cbfed37d0 con 0x561cc004b8e0 2024-09-22T08:36:45.277 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.276+0000 7fc9effff640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x561cc004b8e0 0x561cc004dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:45.277 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.276+0000 7fc9effff640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x561cc004b8e0 0x561cc004dda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:38928/0 (socket says 172.21.15.142:38928) 2024-09-22T08:36:45.277 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.276+0000 7fc9effff640 1 -- 172.21.15.142:0/1754966372 learned_addr learned my addr 172.21.15.142:0/1754966372 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:45.278 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.276+0000 7fc9effff640 1 -- 172.21.15.142:0/1754966372 >> v1:172.21.15.31:6789/0 conn(0x561cc0047da0 legacy=0x561cc004a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:45.278 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.276+0000 7fc9effff640 1 -- 172.21.15.142:0/1754966372 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x561cc004f4b0 con 0x561cc004b8e0 2024-09-22T08:36:45.279 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.278+0000 7fc9effff640 1 --2- 172.21.15.142:0/1754966372 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561cc004b8e0 0x561cc004dda0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fc9e000a520 tx=0x7fc9e0045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=617abd307c4c2dc1 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:45.279 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.278+0000 7fc9f7dfc640 1 -- 172.21.15.142:0/1754966372 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9e0055070 con 0x561cc004b8e0 2024-09-22T08:36:45.279 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.278+0000 7fc9f7dfc640 1 -- 172.21.15.142:0/1754966372 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9e00515b0 con 0x561cc004b8e0 2024-09-22T08:36:45.279 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.278+0000 7fc9f7dfc640 1 -- 172.21.15.142:0/1754966372 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9e00518d0 con 0x561cc004b8e0 2024-09-22T08:36:45.280 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.278+0000 7fc9fab0c800 1 -- 172.21.15.142:0/1754966372 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561cc004b8e0 msgr2=0x561cc004dda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:45.280 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.279+0000 7fc9fab0c800 1 --2- 172.21.15.142:0/1754966372 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561cc004b8e0 0x561cc004dda0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fc9e000a520 tx=0x7fc9e0045ba0 comp rx=0 tx=0).stop 2024-09-22T08:36:45.281 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.279+0000 7fc9fab0c800 1 -- 172.21.15.142:0/1754966372 shutdown_connections 2024-09-22T08:36:45.281 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.279+0000 7fc9fab0c800 1 --2- 172.21.15.142:0/1754966372 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561cc004b8e0 0x561cc004dda0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:45.281 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.279+0000 7fc9fab0c800 1 -- 172.21.15.142:0/1754966372 >> 172.21.15.142:0/1754966372 conn(0x561cc0042310 msgr2=0x561cc0044790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:45.281 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.279+0000 7fc9fab0c800 1 -- 172.21.15.142:0/1754966372 shutdown_connections 2024-09-22T08:36:45.281 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.279+0000 7fc9fab0c800 1 -- 172.21.15.142:0/1754966372 wait complete. 2024-09-22T08:36:45.294 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.292+0000 7fc9fab0c800 1 Processor -- start 2024-09-22T08:36:45.294 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.292+0000 7fc9fab0c800 1 -- start start 2024-09-22T08:36:45.294 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.292+0000 7fc9fab0c800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561cc0047da0 0x561cc0047010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:45.294 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.293+0000 7fc9fab0c800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x561cbfee0dd0 con 0x561cc0047da0 2024-09-22T08:36:45.294 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.293+0000 7fc9f85fd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561cc0047da0 0x561cc0047010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:45.295 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.293+0000 7fc9f85fd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561cc0047da0 0x561cc0047010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:38934/0 (socket says 172.21.15.142:38934) 2024-09-22T08:36:45.295 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.293+0000 7fc9f85fd640 1 -- 172.21.15.142:0/3055604255 learned_addr learned my addr 172.21.15.142:0/3055604255 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:45.295 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.293+0000 7fc9f85fd640 1 -- 172.21.15.142:0/3055604255 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561cc013abe0 con 0x561cc0047da0 2024-09-22T08:36:45.295 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.293+0000 7fc9f85fd640 1 --2- 172.21.15.142:0/3055604255 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561cc0047da0 0x561cc0047010 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fc9e8001da0 tx=0x7fc9e800b5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50eb1dffb455197 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:45.297 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.293+0000 7fc8e660c640 1 -- 172.21.15.142:0/3055604255 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9e800f400 con 0x561cc0047da0 2024-09-22T08:36:45.297 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.293+0000 7fc8e660c640 1 -- 172.21.15.142:0/3055604255 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9e800f5a0 con 0x561cc0047da0 2024-09-22T08:36:45.297 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.293+0000 7fc8e660c640 1 -- 172.21.15.142:0/3055604255 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9e800f8c0 con 0x561cc0047da0 2024-09-22T08:36:45.297 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.294+0000 7fc9fab0c800 1 -- 172.21.15.142:0/3055604255 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561cc0047da0 msgr2=0x561cc0047010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:45.297 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.294+0000 7fc9fab0c800 1 --2- 172.21.15.142:0/3055604255 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561cc0047da0 0x561cc0047010 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fc9e8001da0 tx=0x7fc9e800b5b0 comp rx=0 tx=0).stop 2024-09-22T08:36:45.297 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.294+0000 7fc9fab0c800 1 -- 172.21.15.142:0/3055604255 shutdown_connections 2024-09-22T08:36:45.298 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.294+0000 7fc9fab0c800 1 --2- 172.21.15.142:0/3055604255 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561cc0047da0 0x561cc0047010 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:45.298 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.294+0000 7fc9fab0c800 1 -- 172.21.15.142:0/3055604255 >> 172.21.15.142:0/3055604255 conn(0x561cc0042310 msgr2=0x561cc01328a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:45.298 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.294+0000 7fc9fab0c800 1 -- 172.21.15.142:0/3055604255 shutdown_connections 2024-09-22T08:36:45.298 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.294+0000 7fc9fab0c800 1 -- 172.21.15.142:0/3055604255 wait complete. 2024-09-22T08:36:45.298 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.294+0000 7fc9fab0c800 1 Processor -- start 2024-09-22T08:36:45.298 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.295+0000 7fc9fab0c800 1 -- start start 2024-09-22T08:36:45.298 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.295+0000 7fc9fab0c800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561cc0047da0 0x561cc01382f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:45.298 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.295+0000 7fc9fab0c800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x561cc004e750 con 0x561cc0047da0 2024-09-22T08:36:45.298 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.295+0000 7fc9f85fd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561cc0047da0 0x561cc01382f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:45.298 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.295+0000 7fc9f85fd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561cc0047da0 0x561cc01382f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:38940/0 (socket says 172.21.15.142:38940) 2024-09-22T08:36:45.298 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.295+0000 7fc9f85fd640 1 -- 172.21.15.142:0/2508287983 learned_addr learned my addr 172.21.15.142:0/2508287983 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:45.298 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.295+0000 7fc9f85fd640 1 -- 172.21.15.142:0/2508287983 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561cc0138850 con 0x561cc0047da0 2024-09-22T08:36:45.299 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.296+0000 7fc9f85fd640 1 --2- 172.21.15.142:0/2508287983 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561cc0047da0 0x561cc01382f0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x561cc0046b40 tx=0x7fc9e8000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:45.299 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.296+0000 7fc8e4e09640 1 -- 172.21.15.142:0/2508287983 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9e801a690 con 0x561cc0047da0 2024-09-22T08:36:45.299 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.296+0000 7fc8e4e09640 1 -- 172.21.15.142:0/2508287983 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9e801a830 con 0x561cc0047da0 2024-09-22T08:36:45.299 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.296+0000 7fc9fab0c800 1 -- 172.21.15.142:0/2508287983 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561cc0136c00 con 0x561cc0047da0 2024-09-22T08:36:45.299 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.296+0000 7fc8e4e09640 1 -- 172.21.15.142:0/2508287983 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9e801ab50 con 0x561cc0047da0 2024-09-22T08:36:45.299 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.296+0000 7fc9fab0c800 1 -- 172.21.15.142:0/2508287983 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561cc0137160 con 0x561cc0047da0 2024-09-22T08:36:45.302 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.297+0000 7fc8e4e09640 1 -- 172.21.15.142:0/2508287983 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fc9e8017070 con 0x561cc0047da0 2024-09-22T08:36:45.302 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.297+0000 7fc8e4e09640 1 --2- 172.21.15.142:0/2508287983 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fc8e003d000 0x7fc8e003f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:45.302 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.297+0000 7fc8e4e09640 1 -- 172.21.15.142:0/2508287983 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fc9e8015020 con 0x561cc0047da0 2024-09-22T08:36:45.303 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.297+0000 7fc9effff640 1 --2- 172.21.15.142:0/2508287983 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fc8e003d000 0x7fc8e003f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:45.303 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.297+0000 7fc9fab0c800 1 --2- 172.21.15.142:0/2508287983 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x561cc004b8e0 0x561cc0149090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:45.303 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.297+0000 7fc9fab0c800 1 -- 172.21.15.142:0/2508287983 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561cc01495d0 con 0x561cc004b8e0 2024-09-22T08:36:45.303 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.297+0000 7fc9f8dfe640 1 --2- 172.21.15.142:0/2508287983 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x561cc004b8e0 0x561cc0149090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:45.303 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.297+0000 7fc9effff640 1 --2- 172.21.15.142:0/2508287983 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fc8e003d000 0x7fc8e003f4c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fc9e0057000 tx=0x7fc9e0052000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:45.303 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.297+0000 7fc9f8dfe640 1 --2- 172.21.15.142:0/2508287983 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x561cc004b8e0 0x561cc0149090 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:45.303 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.298+0000 7fc9f8dfe640 1 -- 172.21.15.142:0/2508287983 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc9f000a4d0 con 0x561cc004b8e0 2024-09-22T08:36:45.303 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.298+0000 7fc9fab0c800 1 -- 172.21.15.142:0/2508287983 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561cc0137640 con 0x561cc004b8e0 2024-09-22T08:36:45.303 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.298+0000 7fc9f8dfe640 1 -- 172.21.15.142:0/2508287983 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc9f000a4d0 con 0x561cc004b8e0 2024-09-22T08:36:45.303 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.298+0000 7fc9fab0c800 1 --2- 172.21.15.142:0/2508287983 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x561cc014b8c0 0x561cc014dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:45.303 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.298+0000 7fc9fab0c800 1 -- 172.21.15.142:0/2508287983 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:3 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561cc014e380 con 0x561cc014b8c0 2024-09-22T08:36:45.303 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.298+0000 7fc9f85fd640 1 --2- 172.21.15.142:0/2508287983 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x561cc014b8c0 0x561cc014dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:45.303 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.298+0000 7fc9f85fd640 1 --2- 172.21.15.142:0/2508287983 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x561cc014b8c0 0x561cc014dcb0 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:45.304 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.299+0000 7fc9f85fd640 1 -- 172.21.15.142:0/2508287983 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(3 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fc9e802e070 con 0x561cc014b8c0 2024-09-22T08:36:45.304 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.299+0000 7fc9fab0c800 1 -- 172.21.15.142:0/2508287983 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561cc014a760 con 0x561cc004b8e0 2024-09-22T08:36:45.304 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.299+0000 7fc9f8dfe640 1 -- 172.21.15.142:0/2508287983 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc9f000a4d0 con 0x561cc004b8e0 2024-09-22T08:36:45.304 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.299+0000 7fc9fab0c800 1 -- 172.21.15.142:0/2508287983 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561cc014ac00 con 0x561cc014b8c0 2024-09-22T08:36:45.304 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.299+0000 7fc9f85fd640 1 -- 172.21.15.142:0/2508287983 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(5 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fc9e802e070 con 0x561cc014b8c0 2024-09-22T08:36:45.304 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.300+0000 7fc9fab0c800 1 Processor -- start 2024-09-22T08:36:45.304 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.300+0000 7fc9fab0c800 1 -- start start 2024-09-22T08:36:45.304 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.300+0000 7fc9fab0c800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561cc015cd20 0x561cc015d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:45.304 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.300+0000 7fc9fab0c800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x561cbff3fd50 con 0x561cc015cd20 2024-09-22T08:36:45.304 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.300+0000 7fc9f8dfe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561cc015cd20 0x561cc015d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:45.304 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.300+0000 7fc9f8dfe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561cc015cd20 0x561cc015d140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:38942/0 (socket says 172.21.15.142:38942) 2024-09-22T08:36:45.304 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.300+0000 7fc9f8dfe640 1 -- 172.21.15.142:0/1586454332 learned_addr learned my addr 172.21.15.142:0/1586454332 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:45.305 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.301+0000 7fc9f8dfe640 1 -- 172.21.15.142:0/1586454332 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561cc015d780 con 0x561cc015cd20 2024-09-22T08:36:45.305 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.301+0000 7fc9f8dfe640 1 --2- 172.21.15.142:0/1586454332 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561cc015cd20 0x561cc015d140 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x561cc0137e90 tx=0x7fc9f00167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:45.305 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.301+0000 7fc8ddffb640 1 -- 172.21.15.142:0/1586454332 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9f0013640 con 0x561cc015cd20 2024-09-22T08:36:45.305 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.301+0000 7fc8ddffb640 1 -- 172.21.15.142:0/1586454332 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9f00137e0 con 0x561cc015cd20 2024-09-22T08:36:45.305 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.301+0000 7fc9fab0c800 1 -- 172.21.15.142:0/1586454332 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561cc015dfb0 con 0x561cc015cd20 2024-09-22T08:36:45.305 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.301+0000 7fc8ddffb640 1 -- 172.21.15.142:0/1586454332 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9f0013ae0 con 0x561cc015cd20 2024-09-22T08:36:45.305 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.301+0000 7fc9fab0c800 1 -- 172.21.15.142:0/1586454332 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561cc015e550 con 0x561cc015cd20 2024-09-22T08:36:45.313 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.302+0000 7fc8ddffb640 1 -- 172.21.15.142:0/1586454332 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fc9f0011040 con 0x561cc015cd20 2024-09-22T08:36:45.313 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.302+0000 7fc8ddffb640 1 --2- 172.21.15.142:0/1586454332 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fc8d003d000 0x7fc8d003f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:45.313 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.302+0000 7fc8ddffb640 1 -- 172.21.15.142:0/1586454332 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fc9f000e040 con 0x561cc015cd20 2024-09-22T08:36:45.313 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.302+0000 7fc9f85fd640 1 --2- 172.21.15.142:0/1586454332 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fc8d003d000 0x7fc8d003f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:45.313 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.302+0000 7fc9fab0c800 1 Processor -- start 2024-09-22T08:36:45.313 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.302+0000 7fc9fab0c800 1 -- start start 2024-09-22T08:36:45.313 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.302+0000 7fc9f85fd640 1 --2- 172.21.15.142:0/1586454332 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fc8d003d000 0x7fc8d003f4c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x561cc0149a60 tx=0x7fc9e8054040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:45.313 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.302+0000 7fc9fab0c800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561cc01697a0 0x561cc0169ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:45.313 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.302+0000 7fc9fab0c800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x561cc013aec0 con 0x561cc01697a0 2024-09-22T08:36:45.313 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.303+0000 7fc9f8dfe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561cc01697a0 0x561cc0169ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:45.314 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.303+0000 7fc9f8dfe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561cc01697a0 0x561cc0169ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:38956/0 (socket says 172.21.15.142:38956) 2024-09-22T08:36:45.314 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.303+0000 7fc9f8dfe640 1 -- 172.21.15.142:0/2935411867 learned_addr learned my addr 172.21.15.142:0/2935411867 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:45.314 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.303+0000 7fc9f8dfe640 1 -- 172.21.15.142:0/2935411867 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561cc016a190 con 0x561cc01697a0 2024-09-22T08:36:45.314 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.303+0000 7fc9f8dfe640 1 --2- 172.21.15.142:0/2935411867 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561cc01697a0 0x561cc0169ba0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fc9f00547f0 tx=0x7fc9f001fe70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78aef198e834e543 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:45.314 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.303+0000 7fc8d77fe640 1 -- 172.21.15.142:0/2935411867 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9f0044030 con 0x561cc01697a0 2024-09-22T08:36:45.314 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.303+0000 7fc8d77fe640 1 -- 172.21.15.142:0/2935411867 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9f0021960 con 0x561cc01697a0 2024-09-22T08:36:45.314 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.303+0000 7fc8d77fe640 1 -- 172.21.15.142:0/2935411867 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9f001f340 con 0x561cc01697a0 2024-09-22T08:36:45.314 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.304+0000 7fc9fab0c800 1 -- 172.21.15.142:0/2935411867 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561cc01697a0 msgr2=0x561cc0169ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:45.314 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.304+0000 7fc9fab0c800 1 --2- 172.21.15.142:0/2935411867 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561cc01697a0 0x561cc0169ba0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fc9f00547f0 tx=0x7fc9f001fe70 comp rx=0 tx=0).stop 2024-09-22T08:36:45.314 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.304+0000 7fc9fab0c800 1 -- 172.21.15.142:0/2935411867 shutdown_connections 2024-09-22T08:36:45.314 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.304+0000 7fc9fab0c800 1 --2- 172.21.15.142:0/2935411867 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561cc01697a0 0x561cc0169ba0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:45.314 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.304+0000 7fc9fab0c800 1 -- 172.21.15.142:0/2935411867 >> 172.21.15.142:0/2935411867 conn(0x561cc0165ba0 msgr2=0x561cc0163de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:45.314 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.304+0000 7fc9fab0c800 1 -- 172.21.15.142:0/2935411867 shutdown_connections 2024-09-22T08:36:45.315 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.304+0000 7fc9fab0c800 1 -- 172.21.15.142:0/2935411867 wait complete. 2024-09-22T08:36:45.315 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.304+0000 7fc9fab0c800 1 Processor -- start 2024-09-22T08:36:45.315 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.304+0000 7fc9fab0c800 1 -- start start 2024-09-22T08:36:45.315 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.304+0000 7fc9fab0c800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561cc01697a0 0x561cc0170d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:45.315 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.304+0000 7fc9fab0c800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x561cc016a7b0 con 0x561cc01697a0 2024-09-22T08:36:45.315 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.305+0000 7fc9f8dfe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561cc01697a0 0x561cc0170d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:45.315 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.305+0000 7fc9f8dfe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561cc01697a0 0x561cc0170d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:38968/0 (socket says 172.21.15.142:38968) 2024-09-22T08:36:45.315 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.305+0000 7fc9f8dfe640 1 -- 172.21.15.142:0/966767488 learned_addr learned my addr 172.21.15.142:0/966767488 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:45.315 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.305+0000 7fc9f8dfe640 1 -- 172.21.15.142:0/966767488 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561cc01712e0 con 0x561cc01697a0 2024-09-22T08:36:45.315 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.305+0000 7fc9f8dfe640 1 --2- 172.21.15.142:0/966767488 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561cc01697a0 0x561cc0170d80 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fc9f001feb0 tx=0x7fc9f004e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:45.315 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.305+0000 7fc8d5ffb640 1 -- 172.21.15.142:0/966767488 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9f0056070 con 0x561cc01697a0 2024-09-22T08:36:45.315 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.305+0000 7fc8d5ffb640 1 -- 172.21.15.142:0/966767488 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9f0021440 con 0x561cc01697a0 2024-09-22T08:36:45.315 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.305+0000 7fc8d5ffb640 1 -- 172.21.15.142:0/966767488 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9f00459c0 con 0x561cc01697a0 2024-09-22T08:36:45.315 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.305+0000 7fc9fab0c800 1 -- 172.21.15.142:0/966767488 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561cc0171570 con 0x561cc01697a0 2024-09-22T08:36:45.316 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.305+0000 7fc9fab0c800 1 -- 172.21.15.142:0/966767488 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561cc0171570 con 0x561cc01697a0 2024-09-22T08:36:45.316 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.306+0000 7fc8d5ffb640 1 -- 172.21.15.142:0/966767488 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fc9f0045b60 con 0x561cc01697a0 2024-09-22T08:36:45.316 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.306+0000 7fc8d5ffb640 1 --2- 172.21.15.142:0/966767488 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fc8c803cfb0 0x7fc8c803f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:45.316 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.306+0000 7fc8d5ffb640 1 -- 172.21.15.142:0/966767488 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fc9f0034af0 con 0x561cc01697a0 2024-09-22T08:36:45.316 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.307+0000 7fc9f85fd640 1 --2- 172.21.15.142:0/966767488 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fc8c803cfb0 0x7fc8c803f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:45.316 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.307+0000 7fc9fab0c800 20 rados->read ofs=0 len=0 2024-09-22T08:36:45.316 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.307+0000 7fc9fab0c800 1 --2- 172.21.15.142:0/966767488 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x561cc017c4a0 0x561cc017e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:45.316 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.307+0000 7fc9fab0c800 1 -- 172.21.15.142:0/966767488 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561cc017f0b0 con 0x561cc017c4a0 2024-09-22T08:36:45.316 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.307+0000 7fc9effff640 1 --2- 172.21.15.142:0/966767488 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x561cc017c4a0 0x561cc017e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:45.316 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.307+0000 7fc9f85fd640 1 --2- 172.21.15.142:0/966767488 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fc8c803cfb0 0x7fc8c803f470 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fc9e800e520 tx=0x7fc9e8033040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:45.316 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.307+0000 7fc9effff640 1 --2- 172.21.15.142:0/966767488 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x561cc017c4a0 0x561cc017e960 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:45.316 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.307+0000 7fc9effff640 1 -- 172.21.15.142:0/966767488 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc9e0057030 con 0x561cc017c4a0 2024-09-22T08:36:45.316 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.307+0000 7fc9fab0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:45.316 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.307+0000 7fc9fab0c800 20 realm 2024-09-22T08:36:45.317 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.307+0000 7fc9fab0c800 20 rados->read ofs=0 len=0 2024-09-22T08:36:45.317 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.307+0000 7fc9fab0c800 1 -- 172.21.15.142:0/966767488 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561cc017f4e0 con 0x561cc017c4a0 2024-09-22T08:36:45.317 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.308+0000 7fc9effff640 1 -- 172.21.15.142:0/966767488 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc9e0057030 con 0x561cc017c4a0 2024-09-22T08:36:45.317 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.308+0000 7fc9fab0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:45.317 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.308+0000 7fc9fab0c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:36:45.317 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.308+0000 7fc9fab0c800 20 rados->read ofs=0 len=0 2024-09-22T08:36:45.317 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.308+0000 7fc9fab0c800 1 -- 172.21.15.142:0/966767488 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561cc017fdb0 con 0x561cc017c4a0 2024-09-22T08:36:45.317 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.308+0000 7fc9effff640 1 -- 172.21.15.142:0/966767488 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc9e0057030 con 0x561cc017c4a0 2024-09-22T08:36:45.317 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.308+0000 7fc9fab0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:45.317 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.308+0000 7fc9fab0c800 20 rados->read ofs=0 len=0 2024-09-22T08:36:45.317 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.308+0000 7fc9fab0c800 1 -- 172.21.15.142:0/966767488 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561cc0180150 con 0x561cc017c4a0 2024-09-22T08:36:45.317 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.308+0000 7fc9effff640 1 -- 172.21.15.142:0/966767488 <== osd.1 v2:172.21.15.142:6816/3192108003 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc9e0057030 con 0x561cc017c4a0 2024-09-22T08:36:45.317 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.308+0000 7fc9fab0c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:36:45.317 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.308+0000 7fc9fab0c800 20 rados->read ofs=0 len=0 2024-09-22T08:36:45.318 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.308+0000 7fc9fab0c800 1 --2- 172.21.15.142:0/966767488 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x561cc0180eb0 0x561cc01832a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:45.318 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.308+0000 7fc9fab0c800 1 -- 172.21.15.142:0/966767488 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561cc01837e0 con 0x561cc0180eb0 2024-09-22T08:36:45.318 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.308+0000 7fc9f8dfe640 1 --2- 172.21.15.142:0/966767488 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x561cc0180eb0 0x561cc01832a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:45.318 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.308+0000 7fc9f8dfe640 1 --2- 172.21.15.142:0/966767488 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x561cc0180eb0 0x561cc01832a0 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:45.318 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.309+0000 7fc9f8dfe640 1 -- 172.21.15.142:0/966767488 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(5 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fc9f0053020 con 0x561cc0180eb0 2024-09-22T08:36:45.318 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.309+0000 7fc9fab0c800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:36:45.318 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.309+0000 7fc9fab0c800 20 searching for the correct realm 2024-09-22T08:36:45.318 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.309+0000 7fc9fab0c800 1 -- 172.21.15.142:0/966767488 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561cc0185180 con 0x561cc0180eb0 2024-09-22T08:36:45.318 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.309+0000 7fc9f8dfe640 1 -- 172.21.15.142:0/966767488 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9f0053020 con 0x561cc0180eb0 2024-09-22T08:36:45.318 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.309+0000 7fc9f8dfe640 1 --2- 172.21.15.142:0/966767488 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7fc9f004d340 0x7fc9f00119f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:45.318 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.309+0000 7fc9f8dfe640 1 -- 172.21.15.142:0/966767488 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561cc0185180 con 0x7fc9f004d340 2024-09-22T08:36:45.318 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.309+0000 7fc9f85fd640 1 --2- 172.21.15.142:0/966767488 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7fc9f004d340 0x7fc9f00119f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:45.318 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.309+0000 7fc9f85fd640 1 --2- 172.21.15.142:0/966767488 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7fc9f004d340 0x7fc9f00119f0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:45.319 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.310+0000 7fc9f85fd640 1 -- 172.21.15.142:0/966767488 <== osd.2 v2:172.21.15.142:6808/279438927 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9e8047030 con 0x7fc9f004d340 2024-09-22T08:36:45.319 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.310+0000 7fc9f85fd640 1 --2- 172.21.15.142:0/966767488 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7fc9e800e7c0 0x7fc9e8054740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:45.319 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.310+0000 7fc9f85fd640 1 -- 172.21.15.142:0/966767488 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561cc0185180 con 0x7fc9e800e7c0 2024-09-22T08:36:45.319 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.310+0000 7fc9effff640 1 --2- 172.21.15.142:0/966767488 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7fc9e800e7c0 0x7fc9e8054740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:45.319 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.310+0000 7fc9effff640 1 --2- 172.21.15.142:0/966767488 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7fc9e800e7c0 0x7fc9e8054740 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:45.319 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.310+0000 7fc9effff640 1 -- 172.21.15.142:0/966767488 <== osd.0 v2:172.21.15.31:6800/168281188 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9e0057030 con 0x7fc9e800e7c0 2024-09-22T08:36:45.319 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.311+0000 7fc9effff640 1 -- 172.21.15.142:0/966767488 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561cc0185180 con 0x561cc017c4a0 2024-09-22T08:36:45.319 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.311+0000 7fc9effff640 1 -- 172.21.15.142:0/966767488 <== osd.1 v2:172.21.15.142:6816/3192108003 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9e0057030 con 0x561cc017c4a0 2024-09-22T08:36:45.319 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.311+0000 7fc9effff640 1 -- 172.21.15.142:0/966767488 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561cc0185180 con 0x561cc017c4a0 2024-09-22T08:36:45.319 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.311+0000 7fc9effff640 1 -- 172.21.15.142:0/966767488 <== osd.1 v2:172.21.15.142:6816/3192108003 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9e0057030 con 0x561cc017c4a0 2024-09-22T08:36:45.319 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.311+0000 7fc9effff640 1 -- 172.21.15.142:0/966767488 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561cc0185180 con 0x7fc9e800e7c0 2024-09-22T08:36:45.319 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.311+0000 7fc9effff640 1 -- 172.21.15.142:0/966767488 <== osd.0 v2:172.21.15.31:6800/168281188 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9e0057030 con 0x7fc9e800e7c0 2024-09-22T08:36:45.319 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.311+0000 7fc9effff640 1 -- 172.21.15.142:0/966767488 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561cc0185180 con 0x7fc9e800e7c0 2024-09-22T08:36:45.320 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.311+0000 7fc9effff640 1 -- 172.21.15.142:0/966767488 <== osd.0 v2:172.21.15.31:6800/168281188 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9e0057030 con 0x7fc9e800e7c0 2024-09-22T08:36:45.320 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.311+0000 7fc9effff640 1 -- 172.21.15.142:0/966767488 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561cc0185180 con 0x7fc9f004d340 2024-09-22T08:36:45.320 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.312+0000 7fc9f85fd640 1 -- 172.21.15.142:0/966767488 <== osd.2 v2:172.21.15.142:6808/279438927 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9e8047030 con 0x7fc9f004d340 2024-09-22T08:36:45.320 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.312+0000 7fc9f85fd640 1 -- 172.21.15.142:0/966767488 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561cc0185180 con 0x561cc0180eb0 2024-09-22T08:36:45.320 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.312+0000 7fc9f8dfe640 1 -- 172.21.15.142:0/966767488 <== osd.3 v2:172.21.15.142:6800/1064901393 3 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9f0053020 con 0x561cc0180eb0 2024-09-22T08:36:45.320 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.312+0000 7fc9f8dfe640 1 -- 172.21.15.142:0/966767488 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561cc0185180 con 0x561cc017c4a0 2024-09-22T08:36:45.328 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.312+0000 7fc9effff640 1 -- 172.21.15.142:0/966767488 <== osd.1 v2:172.21.15.142:6816/3192108003 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9e0057030 con 0x561cc017c4a0 2024-09-22T08:36:45.329 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.312+0000 7fc9effff640 1 -- 172.21.15.142:0/966767488 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561cc0185180 con 0x7fc9e800e7c0 2024-09-22T08:36:45.329 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.312+0000 7fc9effff640 1 -- 172.21.15.142:0/966767488 <== osd.0 v2:172.21.15.31:6800/168281188 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9e0057030 con 0x7fc9e800e7c0 2024-09-22T08:36:45.329 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.312+0000 7fc9effff640 1 -- 172.21.15.142:0/966767488 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561cc0185180 con 0x561cc017c4a0 2024-09-22T08:36:45.329 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.313+0000 7fc9effff640 1 -- 172.21.15.142:0/966767488 <== osd.1 v2:172.21.15.142:6816/3192108003 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9e0057030 con 0x561cc017c4a0 2024-09-22T08:36:45.329 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.313+0000 7fc9effff640 1 -- 172.21.15.142:0/966767488 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561cc0185180 con 0x7fc9f004d340 2024-09-22T08:36:45.329 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.313+0000 7fc9f85fd640 1 -- 172.21.15.142:0/966767488 <== osd.2 v2:172.21.15.142:6808/279438927 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fc9e8047030 con 0x7fc9f004d340 2024-09-22T08:36:45.329 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.313+0000 7fc9f85fd640 1 -- 172.21.15.142:0/966767488 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fc9e8060060 con 0x561cc0180eb0 2024-09-22T08:36:45.329 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.313+0000 7fc9f8dfe640 1 -- 172.21.15.142:0/966767488 <== osd.3 v2:172.21.15.142:6800/1064901393 4 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9f0053020 con 0x561cc0180eb0 2024-09-22T08:36:45.329 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.313+0000 7fc9f8dfe640 1 -- 172.21.15.142:0/966767488 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fc9e8060060 con 0x561cc0180eb0 2024-09-22T08:36:45.329 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.313+0000 7fc9f8dfe640 1 -- 172.21.15.142:0/966767488 <== osd.3 v2:172.21.15.142:6800/1064901393 5 ==== osd_op_reply(20 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fc9f0053020 con 0x561cc0180eb0 2024-09-22T08:36:45.329 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.313+0000 7fc9f8dfe640 1 -- 172.21.15.142:0/966767488 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fc9e8060060 con 0x7fc9e800e7c0 2024-09-22T08:36:45.329 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.314+0000 7fc9effff640 1 -- 172.21.15.142:0/966767488 <== osd.0 v2:172.21.15.31:6800/168281188 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9e0057030 con 0x7fc9e800e7c0 2024-09-22T08:36:45.330 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.314+0000 7fc9effff640 1 -- 172.21.15.142:0/966767488 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fc9e8060060 con 0x561cc0180eb0 2024-09-22T08:36:45.330 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.314+0000 7fc9f8dfe640 1 -- 172.21.15.142:0/966767488 <== osd.3 v2:172.21.15.142:6800/1064901393 6 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9f0053020 con 0x561cc0180eb0 2024-09-22T08:36:45.330 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.314+0000 7fc9f8dfe640 1 -- 172.21.15.142:0/966767488 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fc9e8060060 con 0x561cc0180eb0 2024-09-22T08:36:45.330 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.314+0000 7fc9f8dfe640 1 -- 172.21.15.142:0/966767488 <== osd.3 v2:172.21.15.142:6800/1064901393 7 ==== osd_op_reply(23 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fc9f0053020 con 0x561cc0180eb0 2024-09-22T08:36:45.330 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.314+0000 7fc9f8dfe640 1 -- 172.21.15.142:0/966767488 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fc9e8060060 con 0x561cc017c4a0 2024-09-22T08:36:45.330 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.314+0000 7fc9effff640 1 -- 172.21.15.142:0/966767488 <== osd.1 v2:172.21.15.142:6816/3192108003 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9e0057030 con 0x561cc017c4a0 2024-09-22T08:36:45.330 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.314+0000 7fc9effff640 1 -- 172.21.15.142:0/966767488 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fc9e8060060 con 0x561cc017c4a0 2024-09-22T08:36:45.330 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.314+0000 7fc9effff640 1 -- 172.21.15.142:0/966767488 <== osd.1 v2:172.21.15.142:6816/3192108003 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fc9e0057030 con 0x561cc017c4a0 2024-09-22T08:36:45.330 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.314+0000 7fc9effff640 1 -- 172.21.15.142:0/966767488 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fc9e8060060 con 0x7fc9e800e7c0 2024-09-22T08:36:45.330 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.315+0000 7fc9effff640 1 -- 172.21.15.142:0/966767488 <== osd.0 v2:172.21.15.31:6800/168281188 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9e0057030 con 0x7fc9e800e7c0 2024-09-22T08:36:45.330 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.315+0000 7fc9effff640 1 -- 172.21.15.142:0/966767488 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fc9e8060060 con 0x561cc0180eb0 2024-09-22T08:36:45.330 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.315+0000 7fc9f8dfe640 1 -- 172.21.15.142:0/966767488 <== osd.3 v2:172.21.15.142:6800/1064901393 8 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9f0053020 con 0x561cc0180eb0 2024-09-22T08:36:45.330 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.315+0000 7fc9f8dfe640 1 -- 172.21.15.142:0/966767488 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fc9e8060060 con 0x7fc9f004d340 2024-09-22T08:36:45.331 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.315+0000 7fc9f85fd640 1 -- 172.21.15.142:0/966767488 <== osd.2 v2:172.21.15.142:6808/279438927 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9e8047030 con 0x7fc9f004d340 2024-09-22T08:36:45.331 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.315+0000 7fc9f85fd640 1 -- 172.21.15.142:0/966767488 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fc9e8060060 con 0x561cc017c4a0 2024-09-22T08:36:45.331 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.316+0000 7fc9effff640 1 -- 172.21.15.142:0/966767488 <== osd.1 v2:172.21.15.142:6816/3192108003 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9e0057030 con 0x561cc017c4a0 2024-09-22T08:36:45.331 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.316+0000 7fc9effff640 1 -- 172.21.15.142:0/966767488 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fc9e8060060 con 0x7fc9e800e7c0 2024-09-22T08:36:45.331 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.316+0000 7fc9effff640 1 -- 172.21.15.142:0/966767488 <== osd.0 v2:172.21.15.31:6800/168281188 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9e0057030 con 0x7fc9e800e7c0 2024-09-22T08:36:45.331 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.316+0000 7fc9effff640 1 -- 172.21.15.142:0/966767488 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fc9e8060060 con 0x561cc0180eb0 2024-09-22T08:36:45.331 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.316+0000 7fc9f8dfe640 1 -- 172.21.15.142:0/966767488 <== osd.3 v2:172.21.15.142:6800/1064901393 9 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9f0053020 con 0x561cc0180eb0 2024-09-22T08:36:45.331 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.316+0000 7fc9f8dfe640 1 -- 172.21.15.142:0/966767488 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fc9e8060060 con 0x7fc9e800e7c0 2024-09-22T08:36:45.331 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.316+0000 7fc9effff640 1 -- 172.21.15.142:0/966767488 <== osd.0 v2:172.21.15.31:6800/168281188 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9e0057030 con 0x7fc9e800e7c0 2024-09-22T08:36:45.331 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.316+0000 7fc9effff640 1 -- 172.21.15.142:0/966767488 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fc9e8060060 con 0x7fc9f004d340 2024-09-22T08:36:45.331 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.317+0000 7fc9f85fd640 1 -- 172.21.15.142:0/966767488 <== osd.2 v2:172.21.15.142:6808/279438927 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9e8047030 con 0x7fc9f004d340 2024-09-22T08:36:45.331 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.317+0000 7fc9f85fd640 1 -- 172.21.15.142:0/966767488 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fc9e8060060 con 0x561cc0180eb0 2024-09-22T08:36:45.331 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.317+0000 7fc9f8dfe640 1 -- 172.21.15.142:0/966767488 <== osd.3 v2:172.21.15.142:6800/1064901393 10 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9f0053020 con 0x561cc0180eb0 2024-09-22T08:36:45.332 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.317+0000 7fc9f8dfe640 1 -- 172.21.15.142:0/966767488 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fc9e8060060 con 0x7fc9e800e7c0 2024-09-22T08:36:45.332 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.317+0000 7fc9effff640 1 -- 172.21.15.142:0/966767488 <== osd.0 v2:172.21.15.31:6800/168281188 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9e0057030 con 0x7fc9e800e7c0 2024-09-22T08:36:45.332 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.317+0000 7fc9effff640 1 -- 172.21.15.142:0/966767488 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fc9e8060060 con 0x561cc017c4a0 2024-09-22T08:36:45.332 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.317+0000 7fc9effff640 1 -- 172.21.15.142:0/966767488 <== osd.1 v2:172.21.15.142:6816/3192108003 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fc9e0057030 con 0x561cc017c4a0 2024-09-22T08:36:45.332 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.317+0000 7fc9effff640 1 -- 172.21.15.142:0/966767488 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fc9e8060060 con 0x7fc9f004d340 2024-09-22T08:36:45.332 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.318+0000 7fc9f85fd640 1 -- 172.21.15.142:0/966767488 <== osd.2 v2:172.21.15.142:6808/279438927 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9e8047030 con 0x7fc9f004d340 2024-09-22T08:36:45.332 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.318+0000 7fc9fab0c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:36:45.332 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.318+0000 7fc9fab0c800 20 RGWRados::pool_iterate: got zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec 2024-09-22T08:36:45.332 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.318+0000 7fc9fab0c800 20 RGWRados::pool_iterate: got zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f 2024-09-22T08:36:45.332 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.318+0000 7fc9fab0c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:36:45.332 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.318+0000 7fc9fab0c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:36:45.332 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.318+0000 7fc9fab0c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:36:45.332 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.318+0000 7fc9fab0c800 20 rados->read ofs=0 len=0 2024-09-22T08:36:45.332 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.318+0000 7fc9fab0c800 1 -- 172.21.15.142:0/966767488 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561cc0184280 con 0x561cc017c4a0 2024-09-22T08:36:45.333 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.318+0000 7fc9effff640 1 -- 172.21.15.142:0/966767488 <== osd.1 v2:172.21.15.142:6816/3192108003 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc9e0057030 con 0x561cc017c4a0 2024-09-22T08:36:45.333 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.318+0000 7fc9fab0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:45.333 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.318+0000 7fc9fab0c800 20 rados->read ofs=0 len=0 2024-09-22T08:36:45.333 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.318+0000 7fc9fab0c800 1 -- 172.21.15.142:0/966767488 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561cc0184b20 con 0x561cc017c4a0 2024-09-22T08:36:45.333 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.318+0000 7fc9effff640 1 -- 172.21.15.142:0/966767488 <== osd.1 v2:172.21.15.142:6816/3192108003 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc9e0057030 con 0x561cc017c4a0 2024-09-22T08:36:45.333 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.318+0000 7fc9fab0c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:36:45.333 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.318+0000 7fc9fab0c800 20 rados->read ofs=0 len=0 2024-09-22T08:36:45.333 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.318+0000 7fc9fab0c800 1 -- 172.21.15.142:0/966767488 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:40 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561cc0185650 con 0x561cc0180eb0 2024-09-22T08:36:45.333 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.318+0000 7fc9f8dfe640 1 -- 172.21.15.142:0/966767488 <== osd.3 v2:172.21.15.142:6800/1064901393 11 ==== osd_op_reply(40 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fc9f0053020 con 0x561cc0180eb0 2024-09-22T08:36:45.333 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.318+0000 7fc9fab0c800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:36:45.333 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.318+0000 7fc9fab0c800 20 zone default found 2024-09-22T08:36:45.333 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.318+0000 7fc9fab0c800 4 Realm: () 2024-09-22T08:36:45.333 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.318+0000 7fc9fab0c800 4 ZoneGroup: default (d89f6f57-1007-47dd-9065-f486c7b01aec) 2024-09-22T08:36:45.333 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.318+0000 7fc9fab0c800 4 Zone: default (e239248c-0bee-4e41-803a-24b288d3eb8f) 2024-09-22T08:36:45.334 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.318+0000 7fc9fab0c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:36:45.334 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.318+0000 7fc9fab0c800 20 zonegroup default 2024-09-22T08:36:45.334 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.318+0000 7fc9fab0c800 20 rados->read ofs=0 len=0 2024-09-22T08:36:45.334 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.318+0000 7fc9fab0c800 1 -- 172.21.15.142:0/966767488 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561cc01859f0 con 0x7fc9e800e7c0 2024-09-22T08:36:45.334 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.319+0000 7fc9effff640 1 -- 172.21.15.142:0/966767488 <== osd.0 v2:172.21.15.31:6800/168281188 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fc9e0057030 con 0x7fc9e800e7c0 2024-09-22T08:36:45.334 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.319+0000 7fc9fab0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:45.334 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.319+0000 7fc9fab0c800 20 rados->read ofs=0 len=0 2024-09-22T08:36:45.334 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.319+0000 7fc9fab0c800 1 -- 172.21.15.142:0/966767488 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561cc0187910 con 0x561cc0180eb0 2024-09-22T08:36:45.334 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.319+0000 7fc9f8dfe640 1 -- 172.21.15.142:0/966767488 <== osd.3 v2:172.21.15.142:6800/1064901393 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc9f0053020 con 0x561cc0180eb0 2024-09-22T08:36:45.334 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.319+0000 7fc9fab0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:45.334 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.319+0000 7fc9fab0c800 20 rados->read ofs=0 len=0 2024-09-22T08:36:45.334 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.319+0000 7fc9fab0c800 1 -- 172.21.15.142:0/966767488 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561cc0187dd0 con 0x561cc0180eb0 2024-09-22T08:36:45.334 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.319+0000 7fc9f8dfe640 1 -- 172.21.15.142:0/966767488 <== osd.3 v2:172.21.15.142:6800/1064901393 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc9f0053020 con 0x561cc0180eb0 2024-09-22T08:36:45.335 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.319+0000 7fc9fab0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:45.335 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.319+0000 7fc9fab0c800 20 started sync module instance, tier type = 2024-09-22T08:36:45.335 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.319+0000 7fc9fab0c800 20 started zone id=e239248c-0bee-4e41-803a-24b288d3eb8f (name=default) with tier type = 2024-09-22T08:36:45.335 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.319+0000 7fc9fab0c800 1 -- 172.21.15.142:0/966767488 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561cc0186c20 con 0x7fc9f004d340 2024-09-22T08:36:45.335 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.320+0000 7fc9f85fd640 1 -- 172.21.15.142:0/966767488 <== osd.2 v2:172.21.15.142:6808/279438927 7 ==== osd_op_reply(44 notify.0 [create] v30'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9e8047030 con 0x7fc9f004d340 2024-09-22T08:36:45.335 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.320+0000 7fc9fab0c800 1 -- 172.21.15.142:0/966767488 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94681481897840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561cc0188230 con 0x7fc9f004d340 2024-09-22T08:36:45.335 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.320+0000 7fc9fab0c800 1 -- 172.21.15.142:0/966767488 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561cc0188a80 con 0x561cc017c4a0 2024-09-22T08:36:45.335 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.321+0000 7fc9f85fd640 1 -- 172.21.15.142:0/966767488 <== osd.2 v2:172.21.15.142:6808/279438927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94681481897840] v30'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9e8047030 con 0x7fc9f004d340 2024-09-22T08:36:45.335 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.322+0000 7fc9effff640 1 -- 172.21.15.142:0/966767488 <== osd.1 v2:172.21.15.142:6816/3192108003 15 ==== osd_op_reply(46 notify.1 [create] v30'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9e0057030 con 0x561cc017c4a0 2024-09-22T08:36:45.335 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.322+0000 7fc9fab0c800 1 -- 172.21.15.142:0/966767488 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94681481905616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561cc0188ea0 con 0x561cc017c4a0 2024-09-22T08:36:45.335 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.322+0000 7fc9fab0c800 1 -- 172.21.15.142:0/966767488 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561cc0189770 con 0x561cc0180eb0 2024-09-22T08:36:45.335 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.323+0000 7fc9effff640 1 -- 172.21.15.142:0/966767488 <== osd.1 v2:172.21.15.142:6816/3192108003 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94681481905616] v30'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9e0057030 con 0x561cc017c4a0 2024-09-22T08:36:45.335 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.323+0000 7fc9f8dfe640 1 -- 172.21.15.142:0/966767488 <== osd.3 v2:172.21.15.142:6800/1064901393 14 ==== osd_op_reply(48 notify.2 [create] v30'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9f0053020 con 0x561cc0180eb0 2024-09-22T08:36:45.335 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.323+0000 7fc9fab0c800 1 -- 172.21.15.142:0/966767488 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94681481906672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561cc01892c0 con 0x561cc0180eb0 2024-09-22T08:36:45.336 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.323+0000 7fc9fab0c800 1 -- 172.21.15.142:0/966767488 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561cc018a260 con 0x7fc9f004d340 2024-09-22T08:36:45.336 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.324+0000 7fc9f8dfe640 1 -- 172.21.15.142:0/966767488 <== osd.3 v2:172.21.15.142:6800/1064901393 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94681481906672] v30'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9f0053020 con 0x561cc0180eb0 2024-09-22T08:36:45.336 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.324+0000 7fc9f85fd640 1 -- 172.21.15.142:0/966767488 <== osd.2 v2:172.21.15.142:6808/279438927 9 ==== osd_op_reply(50 notify.3 [create] v30'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9e8047030 con 0x7fc9f004d340 2024-09-22T08:36:45.336 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.324+0000 7fc9fab0c800 1 -- 172.21.15.142:0/966767488 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94681481907728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561cc0189230 con 0x7fc9f004d340 2024-09-22T08:36:45.336 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.324+0000 7fc9fab0c800 1 -- 172.21.15.142:0/966767488 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561cc018b120 con 0x561cc017c4a0 2024-09-22T08:36:45.336 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.325+0000 7fc9effff640 1 -- 172.21.15.142:0/966767488 <== osd.1 v2:172.21.15.142:6816/3192108003 17 ==== osd_op_reply(52 notify.4 [create] v30'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9e0057030 con 0x561cc017c4a0 2024-09-22T08:36:45.336 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.325+0000 7fc9fab0c800 1 -- 172.21.15.142:0/966767488 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94681481915504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561cc018b540 con 0x561cc017c4a0 2024-09-22T08:36:45.336 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.325+0000 7fc9fab0c800 1 -- 172.21.15.142:0/966767488 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561cc018c040 con 0x7fc9e800e7c0 2024-09-22T08:36:45.336 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.325+0000 7fc9f85fd640 1 -- 172.21.15.142:0/966767488 <== osd.2 v2:172.21.15.142:6808/279438927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94681481907728] v30'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9e8047030 con 0x7fc9f004d340 2024-09-22T08:36:45.336 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.326+0000 7fc9effff640 1 -- 172.21.15.142:0/966767488 <== osd.1 v2:172.21.15.142:6816/3192108003 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94681481915504] v30'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9e0057030 con 0x561cc017c4a0 2024-09-22T08:36:45.336 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.326+0000 7fc9effff640 1 -- 172.21.15.142:0/966767488 <== osd.0 v2:172.21.15.31:6800/168281188 11 ==== osd_op_reply(54 notify.5 [create] v30'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9e0057030 con 0x7fc9e800e7c0 2024-09-22T08:36:45.336 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.326+0000 7fc9fab0c800 1 -- 172.21.15.142:0/966767488 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94681481919280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561cc018b090 con 0x7fc9e800e7c0 2024-09-22T08:36:45.336 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.326+0000 7fc9fab0c800 1 -- 172.21.15.142:0/966767488 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561cc018c620 con 0x7fc9e800e7c0 2024-09-22T08:36:45.337 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.327+0000 7fc9effff640 1 -- 172.21.15.142:0/966767488 <== osd.0 v2:172.21.15.31:6800/168281188 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94681481919280] v30'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9e0057030 con 0x7fc9e800e7c0 2024-09-22T08:36:45.337 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.327+0000 7fc9effff640 1 -- 172.21.15.142:0/966767488 <== osd.0 v2:172.21.15.31:6800/168281188 13 ==== osd_op_reply(56 notify.6 [create] v30'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9e0057030 con 0x7fc9e800e7c0 2024-09-22T08:36:45.337 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.327+0000 7fc9fab0c800 1 -- 172.21.15.142:0/966767488 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94681481913936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561cc018c620 con 0x7fc9e800e7c0 2024-09-22T08:36:45.337 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.327+0000 7fc9fab0c800 1 -- 172.21.15.142:0/966767488 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561cc018ced0 con 0x7fc9e800e7c0 2024-09-22T08:36:45.342 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.328+0000 7fc9effff640 1 -- 172.21.15.142:0/966767488 <== osd.0 v2:172.21.15.31:6800/168281188 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94681481913936] v30'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9e0057030 con 0x7fc9e800e7c0 2024-09-22T08:36:45.342 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.328+0000 7fc9effff640 1 -- 172.21.15.142:0/966767488 <== osd.0 v2:172.21.15.31:6800/168281188 15 ==== osd_op_reply(58 notify.7 [create] v30'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9e0057030 con 0x7fc9e800e7c0 2024-09-22T08:36:45.342 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.328+0000 7fc9fab0c800 1 -- 172.21.15.142:0/966767488 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94681481920880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561cc018ca40 con 0x7fc9e800e7c0 2024-09-22T08:36:45.342 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.328+0000 7fc9fab0c800 20 add_watcher() i=0 2024-09-22T08:36:45.342 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.328+0000 7fc9fab0c800 20 add_watcher() i=1 2024-09-22T08:36:45.342 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.328+0000 7fc9fab0c800 20 add_watcher() i=2 2024-09-22T08:36:45.342 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.328+0000 7fc9fab0c800 20 add_watcher() i=3 2024-09-22T08:36:45.342 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.328+0000 7fc9fab0c800 20 add_watcher() i=4 2024-09-22T08:36:45.342 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.328+0000 7fc9fab0c800 20 add_watcher() i=5 2024-09-22T08:36:45.343 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.328+0000 7fc9fab0c800 20 add_watcher() i=6 2024-09-22T08:36:45.343 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.329+0000 7fc9effff640 1 -- 172.21.15.142:0/966767488 <== osd.0 v2:172.21.15.31:6800/168281188 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94681481920880] v30'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9e0057030 con 0x7fc9e800e7c0 2024-09-22T08:36:45.343 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.329+0000 7fc9fab0c800 20 add_watcher() i=7 2024-09-22T08:36:45.343 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.329+0000 7fc9fab0c800 2 all 8 watchers are set, enabling cache 2024-09-22T08:36:45.343 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.329+0000 7fc9fab0c800 1 -- 172.21.15.142:0/966767488 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561cc01903f0 con 0x561cc017c4a0 2024-09-22T08:36:45.343 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.330+0000 7fc9effff640 1 -- 172.21.15.142:0/966767488 <== osd.1 v2:172.21.15.142:6816/3192108003 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fc9e0057030 con 0x561cc017c4a0 2024-09-22T08:36:45.343 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.330+0000 7fc9fab0c800 1 -- 172.21.15.142:0/966767488 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94681481922864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561cc018d7a0 con 0x561cc017c4a0 2024-09-22T08:36:45.343 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.331+0000 7fc9effff640 1 -- 172.21.15.142:0/966767488 <== osd.1 v2:172.21.15.142:6816/3192108003 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94681481922864] v30'90 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc9e0057030 con 0x561cc017c4a0 2024-09-22T08:36:45.343 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.331+0000 7fc8aefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:36:45.343 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.331+0000 7fc9fab0c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:36:45.343 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.331+0000 7fc9fab0c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:36:45.343 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.331+0000 7fc9fab0c800 5 note: GC not initialized 2024-09-22T08:36:45.343 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.331+0000 7fc8adfe3640 20 reqs_thread_entry: start 2024-09-22T08:36:45.344 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.331+0000 7fc9fab0c800 20 init_complete bucket index max shards: 11 2024-09-22T08:36:45.344 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.331+0000 7fc9fab0c800 20 Filter name: none 2024-09-22T08:36:45.344 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.331+0000 7fc8a6ffd640 20 reqs_thread_entry: start 2024-09-22T08:36:45.344 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.331+0000 7fc9fab0c800 20 rados->read ofs=0 len=0 2024-09-22T08:36:45.344 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.331+0000 7fc9fab0c800 1 -- 172.21.15.142:0/966767488 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561cc01c32f0 con 0x561cc017c4a0 2024-09-22T08:36:45.344 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.332+0000 7fc9effff640 1 -- 172.21.15.142:0/966767488 <== osd.1 v2:172.21.15.142:6816/3192108003 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fc9e0057030 con 0x561cc017c4a0 2024-09-22T08:36:45.344 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.332+0000 7fc9fab0c800 20 rados_obj.operate() r=0 bl.length=391 2024-09-22T08:36:45.344 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.332+0000 7fc9fab0c800 20 rados->read ofs=0 len=0 2024-09-22T08:36:45.344 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.332+0000 7fc9fab0c800 1 -- 172.21.15.142:0/966767488 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561cc01c3d10 con 0x561cc017c4a0 2024-09-22T08:36:45.344 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.332+0000 7fc9effff640 1 -- 172.21.15.142:0/966767488 <== osd.1 v2:172.21.15.142:6816/3192108003 22 ==== osd_op_reply(63 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fc9e0057030 con 0x561cc017c4a0 2024-09-22T08:36:45.344 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.332+0000 7fc9fab0c800 20 rados_obj.operate() r=0 bl.length=391 2024-09-22T08:36:45.344 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.332+0000 7fc9fab0c800 1 -- 172.21.15.142:0/966767488 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:64 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561cc01c4d20 con 0x7fc9f004d340 2024-09-22T08:36:45.344 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.332+0000 7fc9f85fd640 1 -- 172.21.15.142:0/966767488 <== osd.2 v2:172.21.15.142:6808/279438927 11 ==== osd_op_reply(64 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 155+0+0 (crc 0 0 0) 0x7fc9e8047030 con 0x7fc9f004d340 2024-09-22T08:36:45.344 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.333+0000 7fc8aefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:36:45.345 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.333+0000 7fc9fab0c800 1 -- 172.21.15.142:0/966767488 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94681481922864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561cc01c10b0 con 0x561cc017c4a0 2024-09-22T08:36:45.345 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.334+0000 7fc9effff640 1 -- 172.21.15.142:0/966767488 <== osd.1 v2:172.21.15.142:6816/3192108003 23 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94681481922864] v30'91 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc9e0057030 con 0x561cc017c4a0 2024-09-22T08:36:45.345 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.334+0000 7fc9fab0c800 1 -- 172.21.15.142:0/966767488 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94681481897840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561cc01c10b0 con 0x7fc9f004d340 2024-09-22T08:36:45.345 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.335+0000 7fc9f85fd640 1 -- 172.21.15.142:0/966767488 <== osd.2 v2:172.21.15.142:6808/279438927 12 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94681481897840] v30'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9e8047030 con 0x7fc9f004d340 2024-09-22T08:36:45.345 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.335+0000 7fc9fab0c800 20 remove_watcher() i=0 2024-09-22T08:36:45.345 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.335+0000 7fc9fab0c800 2 removed watcher, disabling cache 2024-09-22T08:36:45.345 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.335+0000 7fc9fab0c800 1 -- 172.21.15.142:0/966767488 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94681481905616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561cc01c10b0 con 0x561cc017c4a0 2024-09-22T08:36:45.345 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.336+0000 7fc9effff640 1 -- 172.21.15.142:0/966767488 <== osd.1 v2:172.21.15.142:6816/3192108003 24 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94681481905616] v30'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9e0057030 con 0x561cc017c4a0 2024-09-22T08:36:45.345 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.336+0000 7fc9fab0c800 20 remove_watcher() i=1 2024-09-22T08:36:45.345 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.336+0000 7fc9fab0c800 1 -- 172.21.15.142:0/966767488 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94681481906672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561cc01c10b0 con 0x561cc0180eb0 2024-09-22T08:36:45.345 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.337+0000 7fc9f8dfe640 1 -- 172.21.15.142:0/966767488 <== osd.3 v2:172.21.15.142:6800/1064901393 16 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94681481906672] v30'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9f0053020 con 0x561cc0180eb0 2024-09-22T08:36:45.345 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.337+0000 7fc9fab0c800 20 remove_watcher() i=2 2024-09-22T08:36:45.345 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.337+0000 7fc9fab0c800 1 -- 172.21.15.142:0/966767488 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94681481907728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561cc01c10b0 con 0x7fc9f004d340 2024-09-22T08:36:45.345 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.338+0000 7fc9f85fd640 1 -- 172.21.15.142:0/966767488 <== osd.2 v2:172.21.15.142:6808/279438927 13 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94681481907728] v30'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9e8047030 con 0x7fc9f004d340 2024-09-22T08:36:45.346 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.338+0000 7fc9fab0c800 20 remove_watcher() i=3 2024-09-22T08:36:45.346 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.338+0000 7fc9fab0c800 1 -- 172.21.15.142:0/966767488 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94681481915504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561cc01c10b0 con 0x561cc017c4a0 2024-09-22T08:36:45.346 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.339+0000 7fc9effff640 1 -- 172.21.15.142:0/966767488 <== osd.1 v2:172.21.15.142:6816/3192108003 25 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94681481915504] v30'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9e0057030 con 0x561cc017c4a0 2024-09-22T08:36:45.346 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.339+0000 7fc9fab0c800 20 remove_watcher() i=4 2024-09-22T08:36:45.346 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.340+0000 7fc9fab0c800 1 -- 172.21.15.142:0/966767488 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94681481919280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561cc01c10b0 con 0x7fc9e800e7c0 2024-09-22T08:36:45.346 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.340+0000 7fc9effff640 1 -- 172.21.15.142:0/966767488 <== osd.0 v2:172.21.15.31:6800/168281188 17 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94681481919280] v30'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9e0057030 con 0x7fc9e800e7c0 2024-09-22T08:36:45.346 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.340+0000 7fc9fab0c800 20 remove_watcher() i=5 2024-09-22T08:36:45.346 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.340+0000 7fc9fab0c800 1 -- 172.21.15.142:0/966767488 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94681481913936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561cc01c10b0 con 0x7fc9e800e7c0 2024-09-22T08:36:45.349 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.341+0000 7fc9effff640 1 -- 172.21.15.142:0/966767488 <== osd.0 v2:172.21.15.31:6800/168281188 18 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94681481913936] v30'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9e0057030 con 0x7fc9e800e7c0 2024-09-22T08:36:45.349 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.341+0000 7fc9fab0c800 20 remove_watcher() i=6 2024-09-22T08:36:45.349 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.341+0000 7fc9fab0c800 1 -- 172.21.15.142:0/966767488 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94681481920880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561cc01c10b0 con 0x7fc9e800e7c0 2024-09-22T08:36:45.349 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.342+0000 7fc9effff640 1 -- 172.21.15.142:0/966767488 <== osd.0 v2:172.21.15.31:6800/168281188 19 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94681481920880] v30'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9e0057030 con 0x7fc9e800e7c0 2024-09-22T08:36:45.349 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.342+0000 7fc9fab0c800 20 remove_watcher() i=7 2024-09-22T08:36:45.349 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.342+0000 7fc9fab0c800 1 -- 172.21.15.142:0/966767488 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7fc9e800e7c0 msgr2=0x7fc9e8054740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:45.349 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.342+0000 7fc9fab0c800 1 --2- 172.21.15.142:0/966767488 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7fc9e800e7c0 0x7fc9e8054740 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:45.349 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.342+0000 7fc9fab0c800 1 -- 172.21.15.142:0/966767488 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x561cc017c4a0 msgr2=0x561cc017e960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:45.349 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.342+0000 7fc9fab0c800 1 --2- 172.21.15.142:0/966767488 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x561cc017c4a0 0x561cc017e960 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:45.349 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.342+0000 7fc9fab0c800 1 -- 172.21.15.142:0/966767488 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7fc9f004d340 msgr2=0x7fc9f00119f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:45.349 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.342+0000 7fc9fab0c800 1 --2- 172.21.15.142:0/966767488 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7fc9f004d340 0x7fc9f00119f0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:45.350 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.342+0000 7fc9fab0c800 1 -- 172.21.15.142:0/966767488 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x561cc0180eb0 msgr2=0x561cc01832a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:45.350 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.342+0000 7fc9fab0c800 1 --2- 172.21.15.142:0/966767488 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x561cc0180eb0 0x561cc01832a0 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:45.350 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.343+0000 7fc9fab0c800 1 -- 172.21.15.142:0/966767488 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fc8c803cfb0 msgr2=0x7fc8c803f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:45.350 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.343+0000 7fc9fab0c800 1 --2- 172.21.15.142:0/966767488 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fc8c803cfb0 0x7fc8c803f470 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fc9e800e520 tx=0x7fc9e8033040 comp rx=0 tx=0).stop 2024-09-22T08:36:45.350 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.343+0000 7fc9fab0c800 1 -- 172.21.15.142:0/966767488 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561cc01697a0 msgr2=0x561cc0170d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:45.350 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.343+0000 7fc9fab0c800 1 --2- 172.21.15.142:0/966767488 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561cc01697a0 0x561cc0170d80 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fc9f001feb0 tx=0x7fc9f004e000 comp rx=0 tx=0).stop 2024-09-22T08:36:45.350 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.343+0000 7fc9effff640 1 -- 172.21.15.142:0/966767488 reap_dead start 2024-09-22T08:36:45.350 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.343+0000 7fc9fab0c800 1 -- 172.21.15.142:0/966767488 shutdown_connections 2024-09-22T08:36:45.350 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.343+0000 7fc9fab0c800 1 --2- 172.21.15.142:0/966767488 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561cc01697a0 0x561cc0170d80 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:45.350 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.343+0000 7fc9fab0c800 1 -- 172.21.15.142:0/966767488 >> 172.21.15.142:0/966767488 conn(0x561cc0165ba0 msgr2=0x561cc0163db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:45.350 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.343+0000 7fc9fab0c800 1 -- 172.21.15.142:0/966767488 shutdown_connections 2024-09-22T08:36:45.350 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.343+0000 7fc9fab0c800 1 -- 172.21.15.142:0/966767488 wait complete. 2024-09-22T08:36:45.350 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.343+0000 7fc9fab0c800 1 -- 172.21.15.142:0/1586454332 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fc8d003d000 msgr2=0x7fc8d003f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:45.350 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.343+0000 7fc9fab0c800 1 --2- 172.21.15.142:0/1586454332 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fc8d003d000 0x7fc8d003f4c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x561cc0149a60 tx=0x7fc9e8054040 comp rx=0 tx=0).stop 2024-09-22T08:36:45.351 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.343+0000 7fc9fab0c800 1 -- 172.21.15.142:0/1586454332 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561cc015cd20 msgr2=0x561cc015d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:45.351 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.343+0000 7fc9fab0c800 1 --2- 172.21.15.142:0/1586454332 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561cc015cd20 0x561cc015d140 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x561cc0137e90 tx=0x7fc9f00167b0 comp rx=0 tx=0).stop 2024-09-22T08:36:45.351 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.343+0000 7fc9fab0c800 1 -- 172.21.15.142:0/1586454332 shutdown_connections 2024-09-22T08:36:45.351 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.343+0000 7fc9fab0c800 1 --2- 172.21.15.142:0/1586454332 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fc8d003d000 0x7fc8d003f4c0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:45.351 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.343+0000 7fc9fab0c800 1 --2- 172.21.15.142:0/1586454332 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561cc015cd20 0x561cc015d140 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:45.351 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.343+0000 7fc9fab0c800 1 -- 172.21.15.142:0/1586454332 >> 172.21.15.142:0/1586454332 conn(0x561cc01510d0 msgr2=0x561cc01514b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:45.351 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.343+0000 7fc9fab0c800 1 -- 172.21.15.142:0/1586454332 shutdown_connections 2024-09-22T08:36:45.351 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.343+0000 7fc9fab0c800 1 -- 172.21.15.142:0/1586454332 wait complete. 2024-09-22T08:36:45.351 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.343+0000 7fc9fab0c800 1 -- 172.21.15.142:0/2508287983 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x561cc004b8e0 msgr2=0x561cc0149090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:45.351 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.344+0000 7fc9fab0c800 1 --2- 172.21.15.142:0/2508287983 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x561cc004b8e0 0x561cc0149090 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:45.351 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.344+0000 7fc9fab0c800 1 -- 172.21.15.142:0/2508287983 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x561cc014b8c0 msgr2=0x561cc014dcb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:45.351 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.344+0000 7fc9fab0c800 1 --2- 172.21.15.142:0/2508287983 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x561cc014b8c0 0x561cc014dcb0 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:45.351 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.344+0000 7fc9fab0c800 1 -- 172.21.15.142:0/2508287983 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fc8e003d000 msgr2=0x7fc8e003f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:45.351 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.344+0000 7fc9fab0c800 1 --2- 172.21.15.142:0/2508287983 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fc8e003d000 0x7fc8e003f4c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fc9e0057000 tx=0x7fc9e0052000 comp rx=0 tx=0).stop 2024-09-22T08:36:45.352 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.344+0000 7fc9fab0c800 1 -- 172.21.15.142:0/2508287983 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561cc0047da0 msgr2=0x561cc01382f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:45.352 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.344+0000 7fc9fab0c800 1 --2- 172.21.15.142:0/2508287983 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561cc0047da0 0x561cc01382f0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x561cc0046b40 tx=0x7fc9e8000ed0 comp rx=0 tx=0).stop 2024-09-22T08:36:45.352 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.344+0000 7fc9fab0c800 1 -- 172.21.15.142:0/2508287983 shutdown_connections 2024-09-22T08:36:45.352 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.344+0000 7fc9fab0c800 1 --2- 172.21.15.142:0/2508287983 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x561cc014b8c0 0x561cc014dcb0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:45.352 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.344+0000 7fc9fab0c800 1 --2- 172.21.15.142:0/2508287983 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x561cc004b8e0 0x561cc0149090 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:45.352 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.344+0000 7fc9fab0c800 1 --2- 172.21.15.142:0/2508287983 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fc8e003d000 0x7fc8e003f4c0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:45.352 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.344+0000 7fc9fab0c800 1 --2- 172.21.15.142:0/2508287983 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561cc0047da0 0x561cc01382f0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:45.352 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.344+0000 7fc9fab0c800 1 -- 172.21.15.142:0/2508287983 >> 172.21.15.142:0/2508287983 conn(0x561cc0042310 msgr2=0x561cc0131090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:45.352 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.344+0000 7fc9fab0c800 1 -- 172.21.15.142:0/2508287983 shutdown_connections 2024-09-22T08:36:45.352 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.344+0000 7fc9fab0c800 1 -- 172.21.15.142:0/2508287983 wait complete. 2024-09-22T08:36:45.353 INFO:teuthology.orchestra.run.smithi142.stdout:[] 2024-09-22T08:36:45.354 DEBUG:tasks.util.rgw: json result: [] 2024-09-22T08:36:45.368 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-22T08:36:45.368 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list', '--uid', 'foo'] 2024-09-22T08:36:45.368 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list', '--uid', 'foo'] 2024-09-22T08:36:45.368 DEBUG:teuthology.orchestra.run.smithi142:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list --uid foo 2024-09-22T08:36:45.412 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:36:45.412 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:36:45.413 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.412+0000 7fd807f1f800 1 Processor -- start 2024-09-22T08:36:45.413 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.412+0000 7fd807f1f800 1 -- start start 2024-09-22T08:36:45.413 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.412+0000 7fd807f1f800 1 --2- >> v2:172.21.15.31:3300/0 conn(0x560c10e71ff0 0x560c10e743e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:45.414 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.412+0000 7fd807f1f800 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x560c10cfca20 con 0x560c10e74920 2024-09-22T08:36:45.414 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.412+0000 7fd807f1f800 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x560c10cfc7d0 con 0x560c10e71ff0 2024-09-22T08:36:45.414 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.413+0000 7fd803b92640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x560c10e71ff0 0x560c10e743e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:45.414 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.413+0000 7fd803b92640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x560c10e71ff0 0x560c10e743e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:38976/0 (socket says 172.21.15.142:38976) 2024-09-22T08:36:45.415 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.413+0000 7fd803b92640 1 -- 172.21.15.142:0/766058908 learned_addr learned my addr 172.21.15.142:0/766058908 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:45.415 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.413+0000 7fd803391640 1 --1- 172.21.15.142:0/766058908 >> v1:172.21.15.31:6789/0 conn(0x560c10e74920 0x560c10e76d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.142:42484/0 (socket says 172.21.15.142:42484) 2024-09-22T08:36:45.415 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.413+0000 7fd803b92640 1 -- 172.21.15.142:0/766058908 >> v1:172.21.15.31:6789/0 conn(0x560c10e74920 legacy=0x560c10e76d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:45.415 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.413+0000 7fd803b92640 1 -- 172.21.15.142:0/766058908 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c10e79580 con 0x560c10e71ff0 2024-09-22T08:36:45.417 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.415+0000 7fd803b92640 1 --2- 172.21.15.142:0/766058908 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560c10e71ff0 0x560c10e743e0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fd7f400a520 tx=0x7fd7f4045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38ee74affaa48892 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:45.417 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.415+0000 7fd802b90640 1 -- 172.21.15.142:0/766058908 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd7f4055070 con 0x560c10e71ff0 2024-09-22T08:36:45.417 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.415+0000 7fd802b90640 1 -- 172.21.15.142:0/766058908 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7f40515b0 con 0x560c10e71ff0 2024-09-22T08:36:45.417 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.415+0000 7fd802b90640 1 -- 172.21.15.142:0/766058908 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd7f40518d0 con 0x560c10e71ff0 2024-09-22T08:36:45.417 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.415+0000 7fd807f1f800 1 -- 172.21.15.142:0/766058908 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560c10e71ff0 msgr2=0x560c10e743e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:45.417 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.415+0000 7fd807f1f800 1 --2- 172.21.15.142:0/766058908 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560c10e71ff0 0x560c10e743e0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fd7f400a520 tx=0x7fd7f4045ba0 comp rx=0 tx=0).stop 2024-09-22T08:36:45.417 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.415+0000 7fd807f1f800 1 -- 172.21.15.142:0/766058908 shutdown_connections 2024-09-22T08:36:45.417 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.415+0000 7fd807f1f800 1 --2- 172.21.15.142:0/766058908 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560c10e71ff0 0x560c10e743e0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:45.417 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.415+0000 7fd807f1f800 1 -- 172.21.15.142:0/766058908 >> 172.21.15.142:0/766058908 conn(0x560c10e6bbb0 msgr2=0x560c10e6e010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:45.417 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.415+0000 7fd807f1f800 1 -- 172.21.15.142:0/766058908 shutdown_connections 2024-09-22T08:36:45.417 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.415+0000 7fd807f1f800 1 -- 172.21.15.142:0/766058908 wait complete. 2024-09-22T08:36:45.431 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.429+0000 7fd807f1f800 1 Processor -- start 2024-09-22T08:36:45.431 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.429+0000 7fd807f1f800 1 -- start start 2024-09-22T08:36:45.431 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.429+0000 7fd807f1f800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560c10e71ff0 0x560c10e71740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:45.431 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.429+0000 7fd807f1f800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x560c10d09dd0 con 0x560c10e71ff0 2024-09-22T08:36:45.431 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.430+0000 7fd803b92640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560c10e71ff0 0x560c10e71740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:45.431 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.430+0000 7fd803b92640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560c10e71ff0 0x560c10e71740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:38992/0 (socket says 172.21.15.142:38992) 2024-09-22T08:36:45.431 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.430+0000 7fd803b92640 1 -- 172.21.15.142:0/3100240744 learned_addr learned my addr 172.21.15.142:0/3100240744 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:45.431 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.430+0000 7fd803b92640 1 -- 172.21.15.142:0/3100240744 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c10e71d30 con 0x560c10e71ff0 2024-09-22T08:36:45.433 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.430+0000 7fd803b92640 1 --2- 172.21.15.142:0/3100240744 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560c10e71ff0 0x560c10e71740 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fd7f40460d0 tx=0x7fd7f4051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e471a4843022a2c server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:45.433 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.430+0000 7fd6f1e0b640 1 -- 172.21.15.142:0/3100240744 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd7f40519d0 con 0x560c10e71ff0 2024-09-22T08:36:45.434 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.430+0000 7fd6f1e0b640 1 -- 172.21.15.142:0/3100240744 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7f4051b70 con 0x560c10e71ff0 2024-09-22T08:36:45.434 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.430+0000 7fd6f1e0b640 1 -- 172.21.15.142:0/3100240744 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd7f4051e50 con 0x560c10e71ff0 2024-09-22T08:36:45.434 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.431+0000 7fd807f1f800 1 -- 172.21.15.142:0/3100240744 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560c10e71ff0 msgr2=0x560c10e71740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:45.434 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.431+0000 7fd807f1f800 1 --2- 172.21.15.142:0/3100240744 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560c10e71ff0 0x560c10e71740 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fd7f40460d0 tx=0x7fd7f4051000 comp rx=0 tx=0).stop 2024-09-22T08:36:45.434 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.431+0000 7fd807f1f800 1 -- 172.21.15.142:0/3100240744 shutdown_connections 2024-09-22T08:36:45.434 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.431+0000 7fd807f1f800 1 --2- 172.21.15.142:0/3100240744 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560c10e71ff0 0x560c10e71740 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:45.434 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.431+0000 7fd807f1f800 1 -- 172.21.15.142:0/3100240744 >> 172.21.15.142:0/3100240744 conn(0x560c10e6bbb0 msgr2=0x560c10f5c9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:45.434 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.431+0000 7fd807f1f800 1 -- 172.21.15.142:0/3100240744 shutdown_connections 2024-09-22T08:36:45.434 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.431+0000 7fd807f1f800 1 -- 172.21.15.142:0/3100240744 wait complete. 2024-09-22T08:36:45.434 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.431+0000 7fd807f1f800 1 Processor -- start 2024-09-22T08:36:45.434 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.431+0000 7fd807f1f800 1 -- start start 2024-09-22T08:36:45.434 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.431+0000 7fd807f1f800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560c10e71ff0 0x560c10f6ac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:45.435 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.431+0000 7fd807f1f800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x560c10e78820 con 0x560c10e71ff0 2024-09-22T08:36:45.435 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.432+0000 7fd803b92640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560c10e71ff0 0x560c10f6ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:45.435 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.432+0000 7fd803b92640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560c10e71ff0 0x560c10f6ac40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:38996/0 (socket says 172.21.15.142:38996) 2024-09-22T08:36:45.435 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.432+0000 7fd803b92640 1 -- 172.21.15.142:0/4069967762 learned_addr learned my addr 172.21.15.142:0/4069967762 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:45.435 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.432+0000 7fd803b92640 1 -- 172.21.15.142:0/4069967762 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c10f6b1a0 con 0x560c10e71ff0 2024-09-22T08:36:45.435 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.432+0000 7fd803b92640 1 --2- 172.21.15.142:0/4069967762 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560c10e71ff0 0x560c10f6ac40 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fd7f40460d0 tx=0x7fd7f4002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:45.435 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.432+0000 7fd6ebfff640 1 -- 172.21.15.142:0/4069967762 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd7f4073020 con 0x560c10e71ff0 2024-09-22T08:36:45.435 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.432+0000 7fd6ebfff640 1 -- 172.21.15.142:0/4069967762 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7f406f580 con 0x560c10e71ff0 2024-09-22T08:36:45.435 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.432+0000 7fd807f1f800 1 -- 172.21.15.142:0/4069967762 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560c10f6b430 con 0x560c10e71ff0 2024-09-22T08:36:45.435 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.432+0000 7fd6ebfff640 1 -- 172.21.15.142:0/4069967762 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd7f406f8a0 con 0x560c10e71ff0 2024-09-22T08:36:45.435 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.432+0000 7fd807f1f800 1 -- 172.21.15.142:0/4069967762 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560c10f6c040 con 0x560c10e71ff0 2024-09-22T08:36:45.439 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.433+0000 7fd6ebfff640 1 -- 172.21.15.142:0/4069967762 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fd7f4076020 con 0x560c10e71ff0 2024-09-22T08:36:45.439 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.433+0000 7fd6ebfff640 1 --2- 172.21.15.142:0/4069967762 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fd6ec03d000 0x7fd6ec03f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:45.439 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.433+0000 7fd6ebfff640 1 -- 172.21.15.142:0/4069967762 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fd7f406b040 con 0x560c10e71ff0 2024-09-22T08:36:45.439 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.434+0000 7fd803391640 1 --2- 172.21.15.142:0/4069967762 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fd6ec03d000 0x7fd6ec03f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:45.439 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.434+0000 7fd807f1f800 1 --2- 172.21.15.142:0/4069967762 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x560c10e74920 0x560c10f72290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:45.439 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.434+0000 7fd807f1f800 1 -- 172.21.15.142:0/4069967762 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560c10f727d0 con 0x560c10e74920 2024-09-22T08:36:45.439 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.434+0000 7fd804393640 1 --2- 172.21.15.142:0/4069967762 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x560c10e74920 0x560c10f72290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:45.439 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.434+0000 7fd803391640 1 --2- 172.21.15.142:0/4069967762 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fd6ec03d000 0x7fd6ec03f4c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fd7f8001e30 tx=0x7fd7f8001390 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:45.439 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.434+0000 7fd804393640 1 --2- 172.21.15.142:0/4069967762 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x560c10e74920 0x560c10f72290 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:45.439 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.434+0000 7fd804393640 1 -- 172.21.15.142:0/4069967762 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd7fc00a4d0 con 0x560c10e74920 2024-09-22T08:36:45.440 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.434+0000 7fd807f1f800 1 -- 172.21.15.142:0/4069967762 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560c10f72b70 con 0x560c10e74920 2024-09-22T08:36:45.440 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.435+0000 7fd804393640 1 -- 172.21.15.142:0/4069967762 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd7fc00a4d0 con 0x560c10e74920 2024-09-22T08:36:45.440 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.435+0000 7fd807f1f800 1 --2- 172.21.15.142:0/4069967762 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x560c10f74670 0x560c10f76b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:45.440 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.435+0000 7fd807f1f800 1 -- 172.21.15.142:0/4069967762 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:3 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560c10f772a0 con 0x560c10f74670 2024-09-22T08:36:45.440 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.435+0000 7fd803b92640 1 --2- 172.21.15.142:0/4069967762 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x560c10f74670 0x560c10f76b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:45.440 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.435+0000 7fd803b92640 1 --2- 172.21.15.142:0/4069967762 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x560c10f74670 0x560c10f76b10 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:45.440 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.435+0000 7fd803b92640 1 -- 172.21.15.142:0/4069967762 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(3 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fd7f4096d70 con 0x560c10f74670 2024-09-22T08:36:45.440 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.435+0000 7fd807f1f800 1 -- 172.21.15.142:0/4069967762 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560c10f733c0 con 0x560c10e74920 2024-09-22T08:36:45.440 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.436+0000 7fd804393640 1 -- 172.21.15.142:0/4069967762 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd7fc00a4d0 con 0x560c10e74920 2024-09-22T08:36:45.440 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.436+0000 7fd807f1f800 1 -- 172.21.15.142:0/4069967762 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560c10f73810 con 0x560c10f74670 2024-09-22T08:36:45.440 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.436+0000 7fd803b92640 1 -- 172.21.15.142:0/4069967762 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(5 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fd7f4096d70 con 0x560c10f74670 2024-09-22T08:36:45.440 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.436+0000 7fd807f1f800 1 Processor -- start 2024-09-22T08:36:45.440 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.436+0000 7fd807f1f800 1 -- start start 2024-09-22T08:36:45.440 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.436+0000 7fd807f1f800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560c10f85c60 0x560c10f86080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:45.441 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.436+0000 7fd807f1f800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x560c10d68d50 con 0x560c10f85c60 2024-09-22T08:36:45.441 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.437+0000 7fd804393640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560c10f85c60 0x560c10f86080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:45.441 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.437+0000 7fd804393640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560c10f85c60 0x560c10f86080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:39010/0 (socket says 172.21.15.142:39010) 2024-09-22T08:36:45.441 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.437+0000 7fd804393640 1 -- 172.21.15.142:0/1852402960 learned_addr learned my addr 172.21.15.142:0/1852402960 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:45.441 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.437+0000 7fd804393640 1 -- 172.21.15.142:0/1852402960 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c10f866c0 con 0x560c10f85c60 2024-09-22T08:36:45.441 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.437+0000 7fd804393640 1 --2- 172.21.15.142:0/1852402960 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560c10f85c60 0x560c10f86080 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x560c10f6bc40 tx=0x7fd7fc0167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:45.441 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.437+0000 7fd6e97fa640 1 -- 172.21.15.142:0/1852402960 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd7fc013640 con 0x560c10f85c60 2024-09-22T08:36:45.441 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.437+0000 7fd6e97fa640 1 -- 172.21.15.142:0/1852402960 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7fc0137e0 con 0x560c10f85c60 2024-09-22T08:36:45.441 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.437+0000 7fd807f1f800 1 -- 172.21.15.142:0/1852402960 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560c10f86ef0 con 0x560c10f85c60 2024-09-22T08:36:45.441 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.437+0000 7fd6e97fa640 1 -- 172.21.15.142:0/1852402960 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd7fc013ac0 con 0x560c10f85c60 2024-09-22T08:36:45.441 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.437+0000 7fd807f1f800 1 -- 172.21.15.142:0/1852402960 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560c10f87490 con 0x560c10f85c60 2024-09-22T08:36:45.450 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.438+0000 7fd6e97fa640 1 -- 172.21.15.142:0/1852402960 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fd7fc011040 con 0x560c10f85c60 2024-09-22T08:36:45.450 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.438+0000 7fd6e97fa640 1 --2- 172.21.15.142:0/1852402960 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fd6dc03d000 0x7fd6dc03f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:45.450 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.438+0000 7fd6e97fa640 1 -- 172.21.15.142:0/1852402960 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fd7fc00e040 con 0x560c10f85c60 2024-09-22T08:36:45.450 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.438+0000 7fd803b92640 1 --2- 172.21.15.142:0/1852402960 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fd6dc03d000 0x7fd6dc03f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:45.450 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.439+0000 7fd807f1f800 1 Processor -- start 2024-09-22T08:36:45.450 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.439+0000 7fd803b92640 1 --2- 172.21.15.142:0/1852402960 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fd6dc03d000 0x7fd6dc03f4c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fd7f4051b40 tx=0x7fd7f40968f0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:45.450 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.439+0000 7fd807f1f800 1 -- start start 2024-09-22T08:36:45.450 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.439+0000 7fd807f1f800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560c10f926a0 0x560c10f92aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:45.450 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.439+0000 7fd807f1f800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x560c10e70090 con 0x560c10f926a0 2024-09-22T08:36:45.451 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.439+0000 7fd804393640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560c10f926a0 0x560c10f92aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:45.451 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.439+0000 7fd804393640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560c10f926a0 0x560c10f92aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:39020/0 (socket says 172.21.15.142:39020) 2024-09-22T08:36:45.451 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.439+0000 7fd804393640 1 -- 172.21.15.142:0/1915987739 learned_addr learned my addr 172.21.15.142:0/1915987739 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:45.451 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.439+0000 7fd804393640 1 -- 172.21.15.142:0/1915987739 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c10f93090 con 0x560c10f926a0 2024-09-22T08:36:45.451 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.439+0000 7fd804393640 1 --2- 172.21.15.142:0/1915987739 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560c10f926a0 0x560c10f92aa0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fd7fc054890 tx=0x7fd7fc013f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f49b6c60bd66c415 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:45.451 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.440+0000 7fd6e2ffd640 1 -- 172.21.15.142:0/1915987739 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd7fc044030 con 0x560c10f926a0 2024-09-22T08:36:45.451 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.440+0000 7fd6e2ffd640 1 -- 172.21.15.142:0/1915987739 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7fc021e20 con 0x560c10f926a0 2024-09-22T08:36:45.451 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.440+0000 7fd6e2ffd640 1 -- 172.21.15.142:0/1915987739 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd7fc021a90 con 0x560c10f926a0 2024-09-22T08:36:45.451 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.440+0000 7fd807f1f800 1 -- 172.21.15.142:0/1915987739 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560c10f926a0 msgr2=0x560c10f92aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:45.451 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.440+0000 7fd807f1f800 1 --2- 172.21.15.142:0/1915987739 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560c10f926a0 0x560c10f92aa0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fd7fc054890 tx=0x7fd7fc013f00 comp rx=0 tx=0).stop 2024-09-22T08:36:45.451 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.440+0000 7fd807f1f800 1 -- 172.21.15.142:0/1915987739 shutdown_connections 2024-09-22T08:36:45.451 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.440+0000 7fd807f1f800 1 --2- 172.21.15.142:0/1915987739 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560c10f926a0 0x560c10f92aa0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:45.451 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.440+0000 7fd807f1f800 1 -- 172.21.15.142:0/1915987739 >> 172.21.15.142:0/1915987739 conn(0x560c10f8eac0 msgr2=0x560c10f8cd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:45.451 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.440+0000 7fd807f1f800 1 -- 172.21.15.142:0/1915987739 shutdown_connections 2024-09-22T08:36:45.452 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.440+0000 7fd807f1f800 1 -- 172.21.15.142:0/1915987739 wait complete. 2024-09-22T08:36:45.452 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.440+0000 7fd807f1f800 1 Processor -- start 2024-09-22T08:36:45.452 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.440+0000 7fd807f1f800 1 -- start start 2024-09-22T08:36:45.452 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.441+0000 7fd807f1f800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560c10f926a0 0x560c10f99d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:45.452 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.441+0000 7fd807f1f800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x560c10f936b0 con 0x560c10f926a0 2024-09-22T08:36:45.452 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.441+0000 7fd804393640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560c10f926a0 0x560c10f99d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:45.452 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.441+0000 7fd804393640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560c10f926a0 0x560c10f99d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:39036/0 (socket says 172.21.15.142:39036) 2024-09-22T08:36:45.452 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.441+0000 7fd804393640 1 -- 172.21.15.142:0/3349196122 learned_addr learned my addr 172.21.15.142:0/3349196122 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:45.452 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.441+0000 7fd804393640 1 -- 172.21.15.142:0/3349196122 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c10f9a270 con 0x560c10f926a0 2024-09-22T08:36:45.452 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.441+0000 7fd804393640 1 --2- 172.21.15.142:0/3349196122 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560c10f926a0 0x560c10f99d10 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fd7fc0547c0 tx=0x7fd7fc0547f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:45.452 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.441+0000 7fd6e17fa640 1 -- 172.21.15.142:0/3349196122 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd7fc01fa90 con 0x560c10f926a0 2024-09-22T08:36:45.452 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.441+0000 7fd6e17fa640 1 -- 172.21.15.142:0/3349196122 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7fc01fc30 con 0x560c10f926a0 2024-09-22T08:36:45.452 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.441+0000 7fd807f1f800 1 -- 172.21.15.142:0/3349196122 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560c10f9a500 con 0x560c10f926a0 2024-09-22T08:36:45.452 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.441+0000 7fd6e17fa640 1 -- 172.21.15.142:0/3349196122 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd7fc01f500 con 0x560c10f926a0 2024-09-22T08:36:45.453 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.441+0000 7fd807f1f800 1 -- 172.21.15.142:0/3349196122 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560c10f9b090 con 0x560c10f926a0 2024-09-22T08:36:45.453 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.442+0000 7fd6e17fa640 1 -- 172.21.15.142:0/3349196122 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fd7fc01f6c0 con 0x560c10f926a0 2024-09-22T08:36:45.453 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.442+0000 7fd6e17fa640 1 --2- 172.21.15.142:0/3349196122 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fd6cc03d000 0x7fd6cc03f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:45.453 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.442+0000 7fd6e17fa640 1 -- 172.21.15.142:0/3349196122 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fd7fc017450 con 0x560c10f926a0 2024-09-22T08:36:45.453 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.442+0000 7fd803b92640 1 --2- 172.21.15.142:0/3349196122 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fd6cc03d000 0x7fd6cc03f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:45.453 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.442+0000 7fd807f1f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:45.453 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.443+0000 7fd807f1f800 1 --2- 172.21.15.142:0/3349196122 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x560c10fa5520 0x560c10fa79b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:45.453 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.443+0000 7fd807f1f800 1 -- 172.21.15.142:0/3349196122 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560c10fa8100 con 0x560c10fa5520 2024-09-22T08:36:45.453 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.443+0000 7fd803391640 1 --2- 172.21.15.142:0/3349196122 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x560c10fa5520 0x560c10fa79b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:45.453 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.443+0000 7fd803b92640 1 --2- 172.21.15.142:0/3349196122 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fd6cc03d000 0x7fd6cc03f4c0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fd7f4065fd0 tx=0x7fd7f4086040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:45.453 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.443+0000 7fd803391640 1 --2- 172.21.15.142:0/3349196122 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x560c10fa5520 0x560c10fa79b0 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:45.453 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.443+0000 7fd803391640 1 -- 172.21.15.142:0/3349196122 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd7f800f610 con 0x560c10fa5520 2024-09-22T08:36:45.453 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.443+0000 7fd807f1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:45.453 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.443+0000 7fd807f1f800 20 realm 2024-09-22T08:36:45.454 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.443+0000 7fd807f1f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:45.454 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.443+0000 7fd807f1f800 1 -- 172.21.15.142:0/3349196122 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560c10fa48d0 con 0x560c10fa5520 2024-09-22T08:36:45.454 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.443+0000 7fd803391640 1 -- 172.21.15.142:0/3349196122 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd7f800f610 con 0x560c10fa5520 2024-09-22T08:36:45.454 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.443+0000 7fd807f1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:45.454 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.443+0000 7fd807f1f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:36:45.454 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.443+0000 7fd807f1f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:45.454 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.443+0000 7fd807f1f800 1 -- 172.21.15.142:0/3349196122 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560c10fa8be0 con 0x560c10fa5520 2024-09-22T08:36:45.454 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.444+0000 7fd803391640 1 -- 172.21.15.142:0/3349196122 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd7f800f610 con 0x560c10fa5520 2024-09-22T08:36:45.454 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.444+0000 7fd807f1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:45.454 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.444+0000 7fd807f1f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:45.454 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.444+0000 7fd807f1f800 1 -- 172.21.15.142:0/3349196122 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560c10fa94b0 con 0x560c10fa5520 2024-09-22T08:36:45.454 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.444+0000 7fd803391640 1 -- 172.21.15.142:0/3349196122 <== osd.1 v2:172.21.15.142:6816/3192108003 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd7f800f610 con 0x560c10fa5520 2024-09-22T08:36:45.454 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.444+0000 7fd807f1f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:36:45.455 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.444+0000 7fd807f1f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:45.455 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.444+0000 7fd807f1f800 1 --2- 172.21.15.142:0/3349196122 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x560c10fa9df0 0x560c10fac1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:45.455 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.444+0000 7fd807f1f800 1 -- 172.21.15.142:0/3349196122 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560c10fac920 con 0x560c10fa9df0 2024-09-22T08:36:45.455 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.444+0000 7fd804393640 1 --2- 172.21.15.142:0/3349196122 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x560c10fa9df0 0x560c10fac1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:45.455 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.444+0000 7fd804393640 1 --2- 172.21.15.142:0/3349196122 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x560c10fa9df0 0x560c10fac1e0 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:45.455 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.444+0000 7fd804393640 1 -- 172.21.15.142:0/3349196122 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(5 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fd7fc053020 con 0x560c10fa9df0 2024-09-22T08:36:45.455 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.444+0000 7fd807f1f800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:36:45.455 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.444+0000 7fd807f1f800 20 searching for the correct realm 2024-09-22T08:36:45.455 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.445+0000 7fd807f1f800 1 -- 172.21.15.142:0/3349196122 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560c10fae2d0 con 0x560c10fa9df0 2024-09-22T08:36:45.455 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.445+0000 7fd804393640 1 -- 172.21.15.142:0/3349196122 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd7fc053020 con 0x560c10fa9df0 2024-09-22T08:36:45.455 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.445+0000 7fd804393640 1 --2- 172.21.15.142:0/3349196122 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7fd7fc03c3f0 0x7fd7fc03d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:45.455 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.445+0000 7fd804393640 1 -- 172.21.15.142:0/3349196122 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560c10fae2d0 con 0x7fd7fc03c3f0 2024-09-22T08:36:45.455 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.445+0000 7fd803b92640 1 --2- 172.21.15.142:0/3349196122 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7fd7fc03c3f0 0x7fd7fc03d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:45.456 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.445+0000 7fd803b92640 1 --2- 172.21.15.142:0/3349196122 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7fd7fc03c3f0 0x7fd7fc03d7f0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:45.456 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.445+0000 7fd803b92640 1 -- 172.21.15.142:0/3349196122 <== osd.2 v2:172.21.15.142:6808/279438927 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd7f4096d70 con 0x7fd7fc03c3f0 2024-09-22T08:36:45.456 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.445+0000 7fd803b92640 1 --2- 172.21.15.142:0/3349196122 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7fd7f4082070 0x7fd7f408f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:45.456 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.445+0000 7fd803b92640 1 -- 172.21.15.142:0/3349196122 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560c10fae2d0 con 0x7fd7f4082070 2024-09-22T08:36:45.456 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.446+0000 7fd803391640 1 --2- 172.21.15.142:0/3349196122 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7fd7f4082070 0x7fd7f408f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:45.456 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.446+0000 7fd803391640 1 --2- 172.21.15.142:0/3349196122 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7fd7f4082070 0x7fd7f408f7c0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:45.456 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.446+0000 7fd803391640 1 -- 172.21.15.142:0/3349196122 <== osd.0 v2:172.21.15.31:6800/168281188 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd7f800f610 con 0x7fd7f4082070 2024-09-22T08:36:45.456 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.446+0000 7fd803391640 1 -- 172.21.15.142:0/3349196122 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560c10fae2d0 con 0x560c10fa5520 2024-09-22T08:36:45.456 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.446+0000 7fd803391640 1 -- 172.21.15.142:0/3349196122 <== osd.1 v2:172.21.15.142:6816/3192108003 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd7f800f610 con 0x560c10fa5520 2024-09-22T08:36:45.456 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.446+0000 7fd803391640 1 -- 172.21.15.142:0/3349196122 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560c10fae2d0 con 0x560c10fa5520 2024-09-22T08:36:45.456 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.447+0000 7fd803391640 1 -- 172.21.15.142:0/3349196122 <== osd.1 v2:172.21.15.142:6816/3192108003 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd7f802b040 con 0x560c10fa5520 2024-09-22T08:36:45.456 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.447+0000 7fd803391640 1 -- 172.21.15.142:0/3349196122 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560c10fae2d0 con 0x7fd7f4082070 2024-09-22T08:36:45.456 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.447+0000 7fd803391640 1 -- 172.21.15.142:0/3349196122 <== osd.0 v2:172.21.15.31:6800/168281188 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd7f802b040 con 0x7fd7f4082070 2024-09-22T08:36:45.457 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.447+0000 7fd803391640 1 -- 172.21.15.142:0/3349196122 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560c10fae2d0 con 0x7fd7f4082070 2024-09-22T08:36:45.457 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.447+0000 7fd803391640 1 -- 172.21.15.142:0/3349196122 <== osd.0 v2:172.21.15.31:6800/168281188 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd7f802b040 con 0x7fd7f4082070 2024-09-22T08:36:45.457 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.447+0000 7fd803391640 1 -- 172.21.15.142:0/3349196122 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560c10fae2d0 con 0x7fd7fc03c3f0 2024-09-22T08:36:45.457 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.447+0000 7fd803b92640 1 -- 172.21.15.142:0/3349196122 <== osd.2 v2:172.21.15.142:6808/279438927 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd7f4096d70 con 0x7fd7fc03c3f0 2024-09-22T08:36:45.457 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.447+0000 7fd803b92640 1 -- 172.21.15.142:0/3349196122 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560c10fae2d0 con 0x560c10fa9df0 2024-09-22T08:36:45.457 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.448+0000 7fd804393640 1 -- 172.21.15.142:0/3349196122 <== osd.3 v2:172.21.15.142:6800/1064901393 3 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd7fc053020 con 0x560c10fa9df0 2024-09-22T08:36:45.457 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.448+0000 7fd804393640 1 -- 172.21.15.142:0/3349196122 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560c10fae2d0 con 0x560c10fa5520 2024-09-22T08:36:45.457 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.448+0000 7fd803391640 1 -- 172.21.15.142:0/3349196122 <== osd.1 v2:172.21.15.142:6816/3192108003 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd7f802b040 con 0x560c10fa5520 2024-09-22T08:36:45.457 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.448+0000 7fd803391640 1 -- 172.21.15.142:0/3349196122 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560c10fae2d0 con 0x7fd7f4082070 2024-09-22T08:36:45.457 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.448+0000 7fd803391640 1 -- 172.21.15.142:0/3349196122 <== osd.0 v2:172.21.15.31:6800/168281188 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd7f802b040 con 0x7fd7f4082070 2024-09-22T08:36:45.457 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.448+0000 7fd803391640 1 -- 172.21.15.142:0/3349196122 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560c10fae2d0 con 0x560c10fa5520 2024-09-22T08:36:45.457 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.448+0000 7fd803391640 1 -- 172.21.15.142:0/3349196122 <== osd.1 v2:172.21.15.142:6816/3192108003 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd7f802b040 con 0x560c10fa5520 2024-09-22T08:36:45.457 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.448+0000 7fd803391640 1 -- 172.21.15.142:0/3349196122 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560c10fae2d0 con 0x7fd7fc03c3f0 2024-09-22T08:36:45.457 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.448+0000 7fd803b92640 1 -- 172.21.15.142:0/3349196122 <== osd.2 v2:172.21.15.142:6808/279438927 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fd7f4096d70 con 0x7fd7fc03c3f0 2024-09-22T08:36:45.458 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.448+0000 7fd803b92640 1 -- 172.21.15.142:0/3349196122 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560c10fae2d0 con 0x560c10fa9df0 2024-09-22T08:36:45.458 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.449+0000 7fd804393640 1 -- 172.21.15.142:0/3349196122 <== osd.3 v2:172.21.15.142:6800/1064901393 4 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd7fc053020 con 0x560c10fa9df0 2024-09-22T08:36:45.458 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.449+0000 7fd804393640 1 -- 172.21.15.142:0/3349196122 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560c10fae2d0 con 0x560c10fa9df0 2024-09-22T08:36:45.458 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.449+0000 7fd804393640 1 -- 172.21.15.142:0/3349196122 <== osd.3 v2:172.21.15.142:6800/1064901393 5 ==== osd_op_reply(20 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fd7fc053020 con 0x560c10fa9df0 2024-09-22T08:36:45.458 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.449+0000 7fd804393640 1 -- 172.21.15.142:0/3349196122 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560c10fae2d0 con 0x7fd7f4082070 2024-09-22T08:36:45.466 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.449+0000 7fd803391640 1 -- 172.21.15.142:0/3349196122 <== osd.0 v2:172.21.15.31:6800/168281188 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd7f802b040 con 0x7fd7f4082070 2024-09-22T08:36:45.466 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.449+0000 7fd803391640 1 -- 172.21.15.142:0/3349196122 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560c10fae2d0 con 0x560c10fa9df0 2024-09-22T08:36:45.467 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.449+0000 7fd804393640 1 -- 172.21.15.142:0/3349196122 <== osd.3 v2:172.21.15.142:6800/1064901393 6 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd7fc053020 con 0x560c10fa9df0 2024-09-22T08:36:45.467 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.449+0000 7fd804393640 1 -- 172.21.15.142:0/3349196122 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560c10fae2d0 con 0x560c10fa9df0 2024-09-22T08:36:45.467 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.450+0000 7fd804393640 1 -- 172.21.15.142:0/3349196122 <== osd.3 v2:172.21.15.142:6800/1064901393 7 ==== osd_op_reply(23 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fd7fc053020 con 0x560c10fa9df0 2024-09-22T08:36:45.467 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.450+0000 7fd804393640 1 -- 172.21.15.142:0/3349196122 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560c10fae2d0 con 0x560c10fa5520 2024-09-22T08:36:45.467 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.450+0000 7fd803391640 1 -- 172.21.15.142:0/3349196122 <== osd.1 v2:172.21.15.142:6816/3192108003 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd7f802b040 con 0x560c10fa5520 2024-09-22T08:36:45.467 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.450+0000 7fd803391640 1 -- 172.21.15.142:0/3349196122 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560c10fae2d0 con 0x560c10fa5520 2024-09-22T08:36:45.467 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.450+0000 7fd803391640 1 -- 172.21.15.142:0/3349196122 <== osd.1 v2:172.21.15.142:6816/3192108003 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fd7f802b040 con 0x560c10fa5520 2024-09-22T08:36:45.467 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.450+0000 7fd803391640 1 -- 172.21.15.142:0/3349196122 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560c10fae2d0 con 0x7fd7f4082070 2024-09-22T08:36:45.467 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.450+0000 7fd803391640 1 -- 172.21.15.142:0/3349196122 <== osd.0 v2:172.21.15.31:6800/168281188 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd7f802b040 con 0x7fd7f4082070 2024-09-22T08:36:45.467 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.450+0000 7fd803391640 1 -- 172.21.15.142:0/3349196122 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560c10fae2d0 con 0x560c10fa9df0 2024-09-22T08:36:45.467 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.451+0000 7fd804393640 1 -- 172.21.15.142:0/3349196122 <== osd.3 v2:172.21.15.142:6800/1064901393 8 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd7fc053020 con 0x560c10fa9df0 2024-09-22T08:36:45.467 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.451+0000 7fd804393640 1 -- 172.21.15.142:0/3349196122 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560c10fae2d0 con 0x7fd7fc03c3f0 2024-09-22T08:36:45.467 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.451+0000 7fd803b92640 1 -- 172.21.15.142:0/3349196122 <== osd.2 v2:172.21.15.142:6808/279438927 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd7f4096d70 con 0x7fd7fc03c3f0 2024-09-22T08:36:45.468 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.451+0000 7fd803b92640 1 -- 172.21.15.142:0/3349196122 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560c10fae2d0 con 0x560c10fa5520 2024-09-22T08:36:45.468 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.451+0000 7fd803391640 1 -- 172.21.15.142:0/3349196122 <== osd.1 v2:172.21.15.142:6816/3192108003 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd7f802b040 con 0x560c10fa5520 2024-09-22T08:36:45.468 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.451+0000 7fd803391640 1 -- 172.21.15.142:0/3349196122 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560c10fae2d0 con 0x7fd7f4082070 2024-09-22T08:36:45.468 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.451+0000 7fd803391640 1 -- 172.21.15.142:0/3349196122 <== osd.0 v2:172.21.15.31:6800/168281188 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd7f803b040 con 0x7fd7f4082070 2024-09-22T08:36:45.468 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.451+0000 7fd803391640 1 -- 172.21.15.142:0/3349196122 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560c10fae2d0 con 0x560c10fa9df0 2024-09-22T08:36:45.468 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.452+0000 7fd804393640 1 -- 172.21.15.142:0/3349196122 <== osd.3 v2:172.21.15.142:6800/1064901393 9 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd7fc053020 con 0x560c10fa9df0 2024-09-22T08:36:45.468 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.452+0000 7fd804393640 1 -- 172.21.15.142:0/3349196122 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560c10fae2d0 con 0x7fd7f4082070 2024-09-22T08:36:45.468 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.452+0000 7fd803391640 1 -- 172.21.15.142:0/3349196122 <== osd.0 v2:172.21.15.31:6800/168281188 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd7f803b040 con 0x7fd7f4082070 2024-09-22T08:36:45.468 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.452+0000 7fd803391640 1 -- 172.21.15.142:0/3349196122 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560c10fae2d0 con 0x7fd7fc03c3f0 2024-09-22T08:36:45.468 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.452+0000 7fd803b92640 1 -- 172.21.15.142:0/3349196122 <== osd.2 v2:172.21.15.142:6808/279438927 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd7f4096d70 con 0x7fd7fc03c3f0 2024-09-22T08:36:45.468 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.452+0000 7fd803b92640 1 -- 172.21.15.142:0/3349196122 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560c10fae2d0 con 0x560c10fa9df0 2024-09-22T08:36:45.468 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.452+0000 7fd804393640 1 -- 172.21.15.142:0/3349196122 <== osd.3 v2:172.21.15.142:6800/1064901393 10 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd7fc053020 con 0x560c10fa9df0 2024-09-22T08:36:45.468 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.452+0000 7fd804393640 1 -- 172.21.15.142:0/3349196122 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560c10fae2d0 con 0x7fd7f4082070 2024-09-22T08:36:45.469 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.453+0000 7fd803391640 1 -- 172.21.15.142:0/3349196122 <== osd.0 v2:172.21.15.31:6800/168281188 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd7f803b040 con 0x7fd7f4082070 2024-09-22T08:36:45.469 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.453+0000 7fd803391640 1 -- 172.21.15.142:0/3349196122 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560c10fae2d0 con 0x560c10fa5520 2024-09-22T08:36:45.469 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.453+0000 7fd803391640 1 -- 172.21.15.142:0/3349196122 <== osd.1 v2:172.21.15.142:6816/3192108003 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fd7f803b040 con 0x560c10fa5520 2024-09-22T08:36:45.469 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.453+0000 7fd803391640 1 -- 172.21.15.142:0/3349196122 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560c10fae2d0 con 0x7fd7fc03c3f0 2024-09-22T08:36:45.469 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.453+0000 7fd803b92640 1 -- 172.21.15.142:0/3349196122 <== osd.2 v2:172.21.15.142:6808/279438927 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd7f4096d70 con 0x7fd7fc03c3f0 2024-09-22T08:36:45.469 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.453+0000 7fd807f1f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:36:45.469 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.453+0000 7fd807f1f800 20 RGWRados::pool_iterate: got zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec 2024-09-22T08:36:45.469 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.453+0000 7fd807f1f800 20 RGWRados::pool_iterate: got zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f 2024-09-22T08:36:45.469 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.453+0000 7fd807f1f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:36:45.469 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.453+0000 7fd807f1f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:36:45.469 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.453+0000 7fd807f1f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:36:45.469 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.453+0000 7fd807f1f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:45.469 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.453+0000 7fd807f1f800 1 -- 172.21.15.142:0/3349196122 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560c10fad3a0 con 0x560c10fa5520 2024-09-22T08:36:45.469 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.453+0000 7fd803391640 1 -- 172.21.15.142:0/3349196122 <== osd.1 v2:172.21.15.142:6816/3192108003 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd7f803b040 con 0x560c10fa5520 2024-09-22T08:36:45.470 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.453+0000 7fd807f1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:45.470 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.453+0000 7fd807f1f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:45.470 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.453+0000 7fd807f1f800 1 -- 172.21.15.142:0/3349196122 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560c10fadc40 con 0x560c10fa5520 2024-09-22T08:36:45.470 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.453+0000 7fd803391640 1 -- 172.21.15.142:0/3349196122 <== osd.1 v2:172.21.15.142:6816/3192108003 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd7f803b040 con 0x560c10fa5520 2024-09-22T08:36:45.470 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.453+0000 7fd807f1f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:36:45.470 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.453+0000 7fd807f1f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:45.470 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.453+0000 7fd807f1f800 1 -- 172.21.15.142:0/3349196122 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:40 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560c10facfe0 con 0x560c10fa9df0 2024-09-22T08:36:45.470 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.454+0000 7fd804393640 1 -- 172.21.15.142:0/3349196122 <== osd.3 v2:172.21.15.142:6800/1064901393 11 ==== osd_op_reply(40 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fd7fc053020 con 0x560c10fa9df0 2024-09-22T08:36:45.470 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.454+0000 7fd807f1f800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:36:45.470 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.454+0000 7fd807f1f800 20 zone default found 2024-09-22T08:36:45.470 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.454+0000 7fd807f1f800 4 Realm: () 2024-09-22T08:36:45.470 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.454+0000 7fd807f1f800 4 ZoneGroup: default (d89f6f57-1007-47dd-9065-f486c7b01aec) 2024-09-22T08:36:45.470 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.454+0000 7fd807f1f800 4 Zone: default (e239248c-0bee-4e41-803a-24b288d3eb8f) 2024-09-22T08:36:45.470 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.454+0000 7fd807f1f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:36:45.471 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.454+0000 7fd807f1f800 20 zonegroup default 2024-09-22T08:36:45.471 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.454+0000 7fd807f1f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:45.471 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.454+0000 7fd807f1f800 1 -- 172.21.15.142:0/3349196122 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560c10fad840 con 0x7fd7f4082070 2024-09-22T08:36:45.471 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.454+0000 7fd803391640 1 -- 172.21.15.142:0/3349196122 <== osd.0 v2:172.21.15.31:6800/168281188 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fd7f803b040 con 0x7fd7f4082070 2024-09-22T08:36:45.471 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.454+0000 7fd807f1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:45.471 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.454+0000 7fd807f1f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:45.471 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.454+0000 7fd807f1f800 1 -- 172.21.15.142:0/3349196122 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560c10fb0690 con 0x560c10fa9df0 2024-09-22T08:36:45.471 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.454+0000 7fd804393640 1 -- 172.21.15.142:0/3349196122 <== osd.3 v2:172.21.15.142:6800/1064901393 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd7fc053020 con 0x560c10fa9df0 2024-09-22T08:36:45.471 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.454+0000 7fd807f1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:45.471 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.454+0000 7fd807f1f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:45.471 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.454+0000 7fd807f1f800 1 -- 172.21.15.142:0/3349196122 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560c10fb0b50 con 0x560c10fa9df0 2024-09-22T08:36:45.471 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.455+0000 7fd804393640 1 -- 172.21.15.142:0/3349196122 <== osd.3 v2:172.21.15.142:6800/1064901393 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd7fc053020 con 0x560c10fa9df0 2024-09-22T08:36:45.471 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.455+0000 7fd807f1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:45.471 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.455+0000 7fd807f1f800 20 started sync module instance, tier type = 2024-09-22T08:36:45.472 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.455+0000 7fd807f1f800 20 started zone id=e239248c-0bee-4e41-803a-24b288d3eb8f (name=default) with tier type = 2024-09-22T08:36:45.472 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.455+0000 7fd807f1f800 1 -- 172.21.15.142:0/3349196122 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560c10fafb30 con 0x7fd7fc03c3f0 2024-09-22T08:36:45.472 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.456+0000 7fd803b92640 1 -- 172.21.15.142:0/3349196122 <== osd.2 v2:172.21.15.142:6808/279438927 7 ==== osd_op_reply(44 notify.0 [create] v30'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd7f4096d70 con 0x7fd7fc03c3f0 2024-09-22T08:36:45.472 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.456+0000 7fd807f1f800 1 -- 172.21.15.142:0/3349196122 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94609824481056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560c10fb1460 con 0x7fd7fc03c3f0 2024-09-22T08:36:45.472 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.456+0000 7fd807f1f800 1 -- 172.21.15.142:0/3349196122 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560c10fb1cb0 con 0x560c10fa5520 2024-09-22T08:36:45.472 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.457+0000 7fd803b92640 1 -- 172.21.15.142:0/3349196122 <== osd.2 v2:172.21.15.142:6808/279438927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94609824481056] v30'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd7f4096d70 con 0x7fd7fc03c3f0 2024-09-22T08:36:45.472 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.457+0000 7fd803391640 1 -- 172.21.15.142:0/3349196122 <== osd.1 v2:172.21.15.142:6816/3192108003 15 ==== osd_op_reply(46 notify.1 [create] v30'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd7f803b040 con 0x560c10fa5520 2024-09-22T08:36:45.472 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.457+0000 7fd807f1f800 1 -- 172.21.15.142:0/3349196122 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94609824485296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560c10fb1d50 con 0x560c10fa5520 2024-09-22T08:36:45.472 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.457+0000 7fd807f1f800 1 -- 172.21.15.142:0/3349196122 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560c10fb2850 con 0x560c10fa9df0 2024-09-22T08:36:45.472 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.458+0000 7fd803391640 1 -- 172.21.15.142:0/3349196122 <== osd.1 v2:172.21.15.142:6816/3192108003 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94609824485296] v30'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd7f803b040 con 0x560c10fa5520 2024-09-22T08:36:45.472 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.458+0000 7fd804393640 1 -- 172.21.15.142:0/3349196122 <== osd.3 v2:172.21.15.142:6800/1064901393 14 ==== osd_op_reply(48 notify.2 [create] v30'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd7fc053020 con 0x560c10fa9df0 2024-09-22T08:36:45.472 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.459+0000 7fd807f1f800 1 -- 172.21.15.142:0/3349196122 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94609824490304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560c10fb2810 con 0x560c10fa9df0 2024-09-22T08:36:45.472 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.459+0000 7fd807f1f800 1 -- 172.21.15.142:0/3349196122 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560c10fb32d0 con 0x7fd7fc03c3f0 2024-09-22T08:36:45.472 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.459+0000 7fd803b92640 1 -- 172.21.15.142:0/3349196122 <== osd.2 v2:172.21.15.142:6808/279438927 9 ==== osd_op_reply(50 notify.3 [create] v30'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd7f4096d70 con 0x7fd7fc03c3f0 2024-09-22T08:36:45.473 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.460+0000 7fd807f1f800 1 -- 172.21.15.142:0/3349196122 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94609824493024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560c10fb3b70 con 0x7fd7fc03c3f0 2024-09-22T08:36:45.473 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.460+0000 7fd807f1f800 1 -- 172.21.15.142:0/3349196122 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560c10fb4640 con 0x560c10fa5520 2024-09-22T08:36:45.473 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.460+0000 7fd804393640 1 -- 172.21.15.142:0/3349196122 <== osd.3 v2:172.21.15.142:6800/1064901393 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94609824490304] v30'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd7fc053020 con 0x560c10fa9df0 2024-09-22T08:36:45.473 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.461+0000 7fd803b92640 1 -- 172.21.15.142:0/3349196122 <== osd.2 v2:172.21.15.142:6808/279438927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94609824493024] v30'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd7f4096d70 con 0x7fd7fc03c3f0 2024-09-22T08:36:45.473 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.461+0000 7fd803391640 1 -- 172.21.15.142:0/3349196122 <== osd.1 v2:172.21.15.142:6816/3192108003 17 ==== osd_op_reply(52 notify.4 [create] v30'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd7f803b040 con 0x560c10fa5520 2024-09-22T08:36:45.473 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.461+0000 7fd807f1f800 1 -- 172.21.15.142:0/3349196122 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94609824495296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560c10fb1800 con 0x560c10fa5520 2024-09-22T08:36:45.473 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.461+0000 7fd807f1f800 1 -- 172.21.15.142:0/3349196122 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560c10fb4f50 con 0x7fd7f4082070 2024-09-22T08:36:45.473 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.462+0000 7fd803391640 1 -- 172.21.15.142:0/3349196122 <== osd.0 v2:172.21.15.31:6800/168281188 11 ==== osd_op_reply(54 notify.5 [create] v30'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd7f803b040 con 0x7fd7f4082070 2024-09-22T08:36:45.473 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.462+0000 7fd807f1f800 1 -- 172.21.15.142:0/3349196122 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94609824500240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560c10fb53c0 con 0x7fd7f4082070 2024-09-22T08:36:45.473 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.462+0000 7fd807f1f800 1 -- 172.21.15.142:0/3349196122 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560c10fb5eb0 con 0x7fd7f4082070 2024-09-22T08:36:45.473 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.462+0000 7fd803391640 1 -- 172.21.15.142:0/3349196122 <== osd.1 v2:172.21.15.142:6816/3192108003 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94609824495296] v30'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd7f803b040 con 0x560c10fa5520 2024-09-22T08:36:45.473 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.463+0000 7fd803391640 1 -- 172.21.15.142:0/3349196122 <== osd.0 v2:172.21.15.31:6800/168281188 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94609824500240] v30'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd7f803b040 con 0x7fd7f4082070 2024-09-22T08:36:45.473 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.463+0000 7fd803391640 1 -- 172.21.15.142:0/3349196122 <== osd.0 v2:172.21.15.31:6800/168281188 13 ==== osd_op_reply(56 notify.6 [create] v30'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd7f803b040 con 0x7fd7f4082070 2024-09-22T08:36:45.473 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.463+0000 7fd807f1f800 1 -- 172.21.15.142:0/3349196122 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94609824504192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560c10fb4e30 con 0x7fd7f4082070 2024-09-22T08:36:45.474 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.463+0000 7fd807f1f800 1 -- 172.21.15.142:0/3349196122 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560c10fb6490 con 0x7fd7f4082070 2024-09-22T08:36:45.474 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.464+0000 7fd803391640 1 -- 172.21.15.142:0/3349196122 <== osd.0 v2:172.21.15.31:6800/168281188 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94609824504192] v30'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd7f803b040 con 0x7fd7f4082070 2024-09-22T08:36:45.474 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.464+0000 7fd803391640 1 -- 172.21.15.142:0/3349196122 <== osd.0 v2:172.21.15.31:6800/168281188 15 ==== osd_op_reply(58 notify.7 [create] v30'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd7f803b040 con 0x7fd7f4082070 2024-09-22T08:36:45.474 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.464+0000 7fd807f1f800 1 -- 172.21.15.142:0/3349196122 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94609824497968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560c10fb6490 con 0x7fd7f4082070 2024-09-22T08:36:45.474 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.464+0000 7fd807f1f800 20 add_watcher() i=0 2024-09-22T08:36:45.474 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.464+0000 7fd807f1f800 20 add_watcher() i=1 2024-09-22T08:36:45.474 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.464+0000 7fd807f1f800 20 add_watcher() i=2 2024-09-22T08:36:45.474 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.464+0000 7fd807f1f800 20 add_watcher() i=3 2024-09-22T08:36:45.474 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.464+0000 7fd807f1f800 20 add_watcher() i=4 2024-09-22T08:36:45.474 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.464+0000 7fd807f1f800 20 add_watcher() i=5 2024-09-22T08:36:45.474 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.464+0000 7fd807f1f800 20 add_watcher() i=6 2024-09-22T08:36:45.474 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.465+0000 7fd803391640 1 -- 172.21.15.142:0/3349196122 <== osd.0 v2:172.21.15.31:6800/168281188 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94609824497968] v30'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd7f803b040 con 0x7fd7f4082070 2024-09-22T08:36:45.474 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.465+0000 7fd807f1f800 20 add_watcher() i=7 2024-09-22T08:36:45.474 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.465+0000 7fd807f1f800 2 all 8 watchers are set, enabling cache 2024-09-22T08:36:45.475 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.465+0000 7fd807f1f800 1 -- 172.21.15.142:0/3349196122 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560c10fb9820 con 0x560c10fa5520 2024-09-22T08:36:45.475 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.465+0000 7fd803391640 1 -- 172.21.15.142:0/3349196122 <== osd.1 v2:172.21.15.142:6816/3192108003 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fd7f803b040 con 0x560c10fa5520 2024-09-22T08:36:45.475 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.465+0000 7fd807f1f800 1 -- 172.21.15.142:0/3349196122 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94609824518880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560c10fb6600 con 0x560c10fa5520 2024-09-22T08:36:45.481 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.466+0000 7fd803391640 1 -- 172.21.15.142:0/3349196122 <== osd.1 v2:172.21.15.142:6816/3192108003 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94609824518880] v30'92 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd7f803b040 con 0x560c10fa5520 2024-09-22T08:36:45.481 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.466+0000 7fd6b9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:36:45.481 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.466+0000 7fd807f1f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:36:45.481 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.466+0000 7fd807f1f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:36:45.481 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.466+0000 7fd807f1f800 5 note: GC not initialized 2024-09-22T08:36:45.482 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.466+0000 7fd6b8fe1640 20 reqs_thread_entry: start 2024-09-22T08:36:45.482 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.466+0000 7fd807f1f800 20 init_complete bucket index max shards: 11 2024-09-22T08:36:45.482 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.467+0000 7fd807f1f800 20 Filter name: none 2024-09-22T08:36:45.482 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.467+0000 7fd6327fc640 20 reqs_thread_entry: start 2024-09-22T08:36:45.482 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.467+0000 7fd807f1f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:45.482 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.467+0000 7fd807f1f800 1 -- 172.21.15.142:0/3349196122 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560c10fec860 con 0x560c10fa5520 2024-09-22T08:36:45.482 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.467+0000 7fd803391640 1 -- 172.21.15.142:0/3349196122 <== osd.1 v2:172.21.15.142:6816/3192108003 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fd7f803b040 con 0x560c10fa5520 2024-09-22T08:36:45.482 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.467+0000 7fd807f1f800 20 rados_obj.operate() r=0 bl.length=391 2024-09-22T08:36:45.482 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.467+0000 7fd807f1f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:45.482 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.467+0000 7fd807f1f800 1 -- 172.21.15.142:0/3349196122 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560c10fed280 con 0x560c10fa5520 2024-09-22T08:36:45.482 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.467+0000 7fd803391640 1 -- 172.21.15.142:0/3349196122 <== osd.1 v2:172.21.15.142:6816/3192108003 22 ==== osd_op_reply(63 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fd7f803b040 con 0x560c10fa5520 2024-09-22T08:36:45.482 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.467+0000 7fd807f1f800 20 rados_obj.operate() r=0 bl.length=391 2024-09-22T08:36:45.482 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.467+0000 7fd807f1f800 1 -- 172.21.15.142:0/3349196122 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:64 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560c10fee290 con 0x7fd7fc03c3f0 2024-09-22T08:36:45.483 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.468+0000 7fd803b92640 1 -- 172.21.15.142:0/3349196122 <== osd.2 v2:172.21.15.142:6808/279438927 11 ==== osd_op_reply(64 foo.buckets [call out=183b] v0'0 uv2 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7fd7f4096d70 con 0x7fd7fc03c3f0 2024-09-22T08:36:45.483 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.469+0000 7fd6b9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:36:45.483 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.469+0000 7fd807f1f800 1 -- 172.21.15.142:0/3349196122 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94609824518880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560c10fea600 con 0x560c10fa5520 2024-09-22T08:36:45.483 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.469+0000 7fd803391640 1 -- 172.21.15.142:0/3349196122 <== osd.1 v2:172.21.15.142:6816/3192108003 23 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94609824518880] v30'93 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd7f803b040 con 0x560c10fa5520 2024-09-22T08:36:45.483 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.470+0000 7fd807f1f800 1 -- 172.21.15.142:0/3349196122 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94609824481056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560c10fea600 con 0x7fd7fc03c3f0 2024-09-22T08:36:45.483 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.471+0000 7fd803b92640 1 -- 172.21.15.142:0/3349196122 <== osd.2 v2:172.21.15.142:6808/279438927 12 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94609824481056] v30'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd7f4096d70 con 0x7fd7fc03c3f0 2024-09-22T08:36:45.483 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.471+0000 7fd807f1f800 20 remove_watcher() i=0 2024-09-22T08:36:45.483 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.471+0000 7fd807f1f800 2 removed watcher, disabling cache 2024-09-22T08:36:45.483 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.471+0000 7fd807f1f800 1 -- 172.21.15.142:0/3349196122 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94609824485296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560c10fea600 con 0x560c10fa5520 2024-09-22T08:36:45.483 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.472+0000 7fd803391640 1 -- 172.21.15.142:0/3349196122 <== osd.1 v2:172.21.15.142:6816/3192108003 24 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94609824485296] v30'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd7f803b040 con 0x560c10fa5520 2024-09-22T08:36:45.483 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.472+0000 7fd807f1f800 20 remove_watcher() i=1 2024-09-22T08:36:45.483 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.472+0000 7fd807f1f800 1 -- 172.21.15.142:0/3349196122 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94609824490304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560c10fea600 con 0x560c10fa9df0 2024-09-22T08:36:45.483 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.473+0000 7fd804393640 1 -- 172.21.15.142:0/3349196122 <== osd.3 v2:172.21.15.142:6800/1064901393 16 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94609824490304] v30'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd7fc053020 con 0x560c10fa9df0 2024-09-22T08:36:45.483 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.473+0000 7fd807f1f800 20 remove_watcher() i=2 2024-09-22T08:36:45.484 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.473+0000 7fd807f1f800 1 -- 172.21.15.142:0/3349196122 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94609824493024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560c10fea600 con 0x7fd7fc03c3f0 2024-09-22T08:36:45.484 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.474+0000 7fd803b92640 1 -- 172.21.15.142:0/3349196122 <== osd.2 v2:172.21.15.142:6808/279438927 13 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94609824493024] v30'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd7f4096d70 con 0x7fd7fc03c3f0 2024-09-22T08:36:45.484 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.474+0000 7fd807f1f800 20 remove_watcher() i=3 2024-09-22T08:36:45.484 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.474+0000 7fd807f1f800 1 -- 172.21.15.142:0/3349196122 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94609824495296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560c10fea600 con 0x560c10fa5520 2024-09-22T08:36:45.484 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.475+0000 7fd803391640 1 -- 172.21.15.142:0/3349196122 <== osd.1 v2:172.21.15.142:6816/3192108003 25 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94609824495296] v30'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd7f803b040 con 0x560c10fa5520 2024-09-22T08:36:45.484 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.475+0000 7fd807f1f800 20 remove_watcher() i=4 2024-09-22T08:36:45.484 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.475+0000 7fd807f1f800 1 -- 172.21.15.142:0/3349196122 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94609824500240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560c10fea600 con 0x7fd7f4082070 2024-09-22T08:36:45.484 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.476+0000 7fd803391640 1 -- 172.21.15.142:0/3349196122 <== osd.0 v2:172.21.15.31:6800/168281188 17 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94609824500240] v30'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd7f803b040 con 0x7fd7f4082070 2024-09-22T08:36:45.484 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.476+0000 7fd807f1f800 20 remove_watcher() i=5 2024-09-22T08:36:45.484 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.476+0000 7fd807f1f800 1 -- 172.21.15.142:0/3349196122 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94609824504192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560c10fea600 con 0x7fd7f4082070 2024-09-22T08:36:45.484 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.477+0000 7fd803391640 1 -- 172.21.15.142:0/3349196122 <== osd.0 v2:172.21.15.31:6800/168281188 18 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94609824504192] v30'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd7f803b040 con 0x7fd7f4082070 2024-09-22T08:36:45.484 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.477+0000 7fd807f1f800 20 remove_watcher() i=6 2024-09-22T08:36:45.484 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.477+0000 7fd807f1f800 1 -- 172.21.15.142:0/3349196122 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94609824497968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560c10fea600 con 0x7fd7f4082070 2024-09-22T08:36:45.484 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.478+0000 7fd803391640 1 -- 172.21.15.142:0/3349196122 <== osd.0 v2:172.21.15.31:6800/168281188 19 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94609824497968] v30'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd7f803b040 con 0x7fd7f4082070 2024-09-22T08:36:45.485 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.478+0000 7fd807f1f800 20 remove_watcher() i=7 2024-09-22T08:36:45.485 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.478+0000 7fd807f1f800 1 -- 172.21.15.142:0/3349196122 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7fd7f4082070 msgr2=0x7fd7f408f7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:45.485 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.478+0000 7fd807f1f800 1 --2- 172.21.15.142:0/3349196122 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7fd7f4082070 0x7fd7f408f7c0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:45.485 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.478+0000 7fd807f1f800 1 -- 172.21.15.142:0/3349196122 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x560c10fa5520 msgr2=0x560c10fa79b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:45.485 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.478+0000 7fd807f1f800 1 --2- 172.21.15.142:0/3349196122 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x560c10fa5520 0x560c10fa79b0 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:45.485 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.478+0000 7fd807f1f800 1 -- 172.21.15.142:0/3349196122 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7fd7fc03c3f0 msgr2=0x7fd7fc03d7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:45.485 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.478+0000 7fd807f1f800 1 --2- 172.21.15.142:0/3349196122 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7fd7fc03c3f0 0x7fd7fc03d7f0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:45.485 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.478+0000 7fd807f1f800 1 -- 172.21.15.142:0/3349196122 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x560c10fa9df0 msgr2=0x560c10fac1e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:45.485 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.478+0000 7fd807f1f800 1 --2- 172.21.15.142:0/3349196122 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x560c10fa9df0 0x560c10fac1e0 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:45.485 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.478+0000 7fd807f1f800 1 -- 172.21.15.142:0/3349196122 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fd6cc03d000 msgr2=0x7fd6cc03f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:45.485 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.478+0000 7fd807f1f800 1 --2- 172.21.15.142:0/3349196122 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fd6cc03d000 0x7fd6cc03f4c0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fd7f4065fd0 tx=0x7fd7f4086040 comp rx=0 tx=0).stop 2024-09-22T08:36:45.485 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.478+0000 7fd807f1f800 1 -- 172.21.15.142:0/3349196122 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560c10f926a0 msgr2=0x560c10f99d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:45.485 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.478+0000 7fd803391640 1 -- 172.21.15.142:0/3349196122 reap_dead start 2024-09-22T08:36:45.485 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.478+0000 7fd807f1f800 1 --2- 172.21.15.142:0/3349196122 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560c10f926a0 0x560c10f99d10 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fd7fc0547c0 tx=0x7fd7fc0547f0 comp rx=0 tx=0).stop 2024-09-22T08:36:45.486 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.478+0000 7fd807f1f800 1 -- 172.21.15.142:0/3349196122 shutdown_connections 2024-09-22T08:36:45.486 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.478+0000 7fd807f1f800 1 --2- 172.21.15.142:0/3349196122 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560c10f926a0 0x560c10f99d10 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:45.486 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.478+0000 7fd807f1f800 1 -- 172.21.15.142:0/3349196122 >> 172.21.15.142:0/3349196122 conn(0x560c10f8eac0 msgr2=0x560c10f8ccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:45.486 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.478+0000 7fd807f1f800 1 -- 172.21.15.142:0/3349196122 shutdown_connections 2024-09-22T08:36:45.486 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.478+0000 7fd807f1f800 1 -- 172.21.15.142:0/3349196122 wait complete. 2024-09-22T08:36:45.486 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.478+0000 7fd807f1f800 1 -- 172.21.15.142:0/1852402960 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fd6dc03d000 msgr2=0x7fd6dc03f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:45.486 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.478+0000 7fd807f1f800 1 --2- 172.21.15.142:0/1852402960 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fd6dc03d000 0x7fd6dc03f4c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fd7f4051b40 tx=0x7fd7f40968f0 comp rx=0 tx=0).stop 2024-09-22T08:36:45.486 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.478+0000 7fd807f1f800 1 -- 172.21.15.142:0/1852402960 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560c10f85c60 msgr2=0x560c10f86080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:45.486 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.478+0000 7fd807f1f800 1 --2- 172.21.15.142:0/1852402960 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560c10f85c60 0x560c10f86080 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x560c10f6bc40 tx=0x7fd7fc0167b0 comp rx=0 tx=0).stop 2024-09-22T08:36:45.486 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.478+0000 7fd807f1f800 1 -- 172.21.15.142:0/1852402960 shutdown_connections 2024-09-22T08:36:45.486 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.478+0000 7fd807f1f800 1 --2- 172.21.15.142:0/1852402960 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fd6dc03d000 0x7fd6dc03f4c0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:45.486 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.478+0000 7fd807f1f800 1 --2- 172.21.15.142:0/1852402960 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560c10f85c60 0x560c10f86080 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:45.486 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.478+0000 7fd807f1f800 1 -- 172.21.15.142:0/1852402960 >> 172.21.15.142:0/1852402960 conn(0x560c10f7a010 msgr2=0x560c10f7a3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:45.487 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.478+0000 7fd807f1f800 1 -- 172.21.15.142:0/1852402960 shutdown_connections 2024-09-22T08:36:45.487 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.478+0000 7fd807f1f800 1 -- 172.21.15.142:0/1852402960 wait complete. 2024-09-22T08:36:45.487 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.479+0000 7fd807f1f800 1 -- 172.21.15.142:0/4069967762 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x560c10e74920 msgr2=0x560c10f72290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:45.487 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.479+0000 7fd807f1f800 1 --2- 172.21.15.142:0/4069967762 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x560c10e74920 0x560c10f72290 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:45.487 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.479+0000 7fd807f1f800 1 -- 172.21.15.142:0/4069967762 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x560c10f74670 msgr2=0x560c10f76b10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:45.487 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.479+0000 7fd807f1f800 1 --2- 172.21.15.142:0/4069967762 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x560c10f74670 0x560c10f76b10 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:45.487 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.479+0000 7fd807f1f800 1 -- 172.21.15.142:0/4069967762 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fd6ec03d000 msgr2=0x7fd6ec03f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:45.487 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.479+0000 7fd807f1f800 1 --2- 172.21.15.142:0/4069967762 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fd6ec03d000 0x7fd6ec03f4c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fd7f8001e30 tx=0x7fd7f8001390 comp rx=0 tx=0).stop 2024-09-22T08:36:45.487 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.479+0000 7fd807f1f800 1 -- 172.21.15.142:0/4069967762 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560c10e71ff0 msgr2=0x560c10f6ac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:45.487 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.479+0000 7fd807f1f800 1 --2- 172.21.15.142:0/4069967762 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560c10e71ff0 0x560c10f6ac40 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fd7f40460d0 tx=0x7fd7f4002fb0 comp rx=0 tx=0).stop 2024-09-22T08:36:45.487 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.479+0000 7fd807f1f800 1 -- 172.21.15.142:0/4069967762 shutdown_connections 2024-09-22T08:36:45.487 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.479+0000 7fd807f1f800 1 --2- 172.21.15.142:0/4069967762 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x560c10f74670 0x560c10f76b10 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:45.487 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.479+0000 7fd807f1f800 1 --2- 172.21.15.142:0/4069967762 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x560c10e74920 0x560c10f72290 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:45.488 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.479+0000 7fd807f1f800 1 --2- 172.21.15.142:0/4069967762 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fd6ec03d000 0x7fd6ec03f4c0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:45.488 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.479+0000 7fd807f1f800 1 --2- 172.21.15.142:0/4069967762 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560c10e71ff0 0x560c10f6ac40 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:45.488 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.479+0000 7fd807f1f800 1 -- 172.21.15.142:0/4069967762 >> 172.21.15.142:0/4069967762 conn(0x560c10e6bbb0 msgr2=0x560c10f5c510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:45.488 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.479+0000 7fd807f1f800 1 -- 172.21.15.142:0/4069967762 shutdown_connections 2024-09-22T08:36:45.488 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.479+0000 7fd807f1f800 1 -- 172.21.15.142:0/4069967762 wait complete. 2024-09-22T08:36:45.489 INFO:teuthology.orchestra.run.smithi142.stdout:["myfoo"] 2024-09-22T08:36:45.489 DEBUG:tasks.util.rgw: json result: ['myfoo'] 2024-09-22T08:36:45.492 INFO:tasks.radosgw_admin:RL: list_buckets foo bytes_out=0 bytes_in=0 failed=False 2024-09-22T08:36:45.492 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list'] 2024-09-22T08:36:45.492 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list'] 2024-09-22T08:36:45.492 DEBUG:teuthology.orchestra.run.smithi142:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list 2024-09-22T08:36:45.535 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:36:45.535 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:36:45.536 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.534+0000 7f24b6a0e800 1 Processor -- start 2024-09-22T08:36:45.536 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.534+0000 7f24b6a0e800 1 -- start start 2024-09-22T08:36:45.536 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.534+0000 7f24b6a0e800 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55828cd00be0 0x55828cd030a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:45.536 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.534+0000 7f24b6a0e800 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55828cb85a20 con 0x55828cc6dd00 2024-09-22T08:36:45.536 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.534+0000 7f24b6a0e800 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x55828cb857d0 con 0x55828cd00be0 2024-09-22T08:36:45.536 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.535+0000 7f24b1a19640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55828cd00be0 0x55828cd030a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:45.536 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.535+0000 7f24b221a640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x55828cc6dd00 0x55828ccff490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.142:42494/0 (socket says 172.21.15.142:42494) 2024-09-22T08:36:45.536 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.535+0000 7f24b1a19640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55828cd00be0 0x55828cd030a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:39050/0 (socket says 172.21.15.142:39050) 2024-09-22T08:36:45.537 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.535+0000 7f24b221a640 1 -- 172.21.15.142:0/1317892494 learned_addr learned my addr 172.21.15.142:0/1317892494 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-09-22T08:36:45.537 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.535+0000 7f24b1a19640 1 -- 172.21.15.142:0/1317892494 >> v1:172.21.15.31:6789/0 conn(0x55828cc6dd00 legacy=0x55828ccff490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:45.537 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.535+0000 7f24b1a19640 1 -- 172.21.15.142:0/1317892494 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55828cd047b0 con 0x55828cd00be0 2024-09-22T08:36:45.538 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.537+0000 7f24b1a19640 1 --2- 172.21.15.142:0/1317892494 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55828cd00be0 0x55828cd030a0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f24a800a470 tx=0x7f24a8045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c7c0bf7f5fd259f server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:45.538 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.537+0000 7f24b1218640 1 -- 172.21.15.142:0/1317892494 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f24a8053570 con 0x55828cd00be0 2024-09-22T08:36:45.538 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.537+0000 7f24b1218640 1 -- 172.21.15.142:0/1317892494 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24a8058070 con 0x55828cd00be0 2024-09-22T08:36:45.538 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.537+0000 7f24b1218640 1 -- 172.21.15.142:0/1317892494 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f24a8053880 con 0x55828cd00be0 2024-09-22T08:36:45.539 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.537+0000 7f24b6a0e800 1 -- 172.21.15.142:0/1317892494 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55828cd00be0 msgr2=0x55828cd030a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:45.539 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.537+0000 7f24b6a0e800 1 --2- 172.21.15.142:0/1317892494 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55828cd00be0 0x55828cd030a0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f24a800a470 tx=0x7f24a8045a20 comp rx=0 tx=0).stop 2024-09-22T08:36:45.539 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.537+0000 7f24b6a0e800 1 -- 172.21.15.142:0/1317892494 shutdown_connections 2024-09-22T08:36:45.539 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.537+0000 7f24b6a0e800 1 --2- 172.21.15.142:0/1317892494 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55828cd00be0 0x55828cd030a0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:45.539 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.537+0000 7f24b6a0e800 1 -- 172.21.15.142:0/1317892494 >> 172.21.15.142:0/1317892494 conn(0x55828ccf4ba0 msgr2=0x55828ccf7000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:45.539 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.537+0000 7f24b6a0e800 1 -- 172.21.15.142:0/1317892494 shutdown_connections 2024-09-22T08:36:45.539 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.537+0000 7f24b6a0e800 1 -- 172.21.15.142:0/1317892494 wait complete. 2024-09-22T08:36:45.553 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.551+0000 7f24b6a0e800 1 Processor -- start 2024-09-22T08:36:45.553 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.551+0000 7f24b6a0e800 1 -- start start 2024-09-22T08:36:45.553 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.551+0000 7f24b6a0e800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55828cc6dd00 0x55828cdec220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:45.553 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.551+0000 7f24b6a0e800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55828cb92dd0 con 0x55828cc6dd00 2024-09-22T08:36:45.553 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.552+0000 7f24b221a640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55828cc6dd00 0x55828cdec220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:45.553 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.552+0000 7f24b221a640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55828cc6dd00 0x55828cdec220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:39062/0 (socket says 172.21.15.142:39062) 2024-09-22T08:36:45.553 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.552+0000 7f24b221a640 1 -- 172.21.15.142:0/2749788241 learned_addr learned my addr 172.21.15.142:0/2749788241 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:45.553 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.552+0000 7f24b221a640 1 -- 172.21.15.142:0/2749788241 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55828cdec810 con 0x55828cc6dd00 2024-09-22T08:36:45.554 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.552+0000 7f24b221a640 1 --2- 172.21.15.142:0/2749788241 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55828cc6dd00 0x55828cdec220 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f24a4001e40 tx=0x7f24a4001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8de611c1bf998387 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:45.556 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.552+0000 7f23a0608640 1 -- 172.21.15.142:0/2749788241 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f24a4012020 con 0x55828cc6dd00 2024-09-22T08:36:45.556 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.552+0000 7f23a0608640 1 -- 172.21.15.142:0/2749788241 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24a400e5a0 con 0x55828cc6dd00 2024-09-22T08:36:45.556 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.552+0000 7f23a0608640 1 -- 172.21.15.142:0/2749788241 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f24a400e8a0 con 0x55828cc6dd00 2024-09-22T08:36:45.556 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.553+0000 7f24b6a0e800 1 -- 172.21.15.142:0/2749788241 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55828cc6dd00 msgr2=0x55828cdec220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:45.556 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.553+0000 7f24b6a0e800 1 --2- 172.21.15.142:0/2749788241 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55828cc6dd00 0x55828cdec220 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f24a4001e40 tx=0x7f24a4001e70 comp rx=0 tx=0).stop 2024-09-22T08:36:45.556 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.553+0000 7f24b6a0e800 1 -- 172.21.15.142:0/2749788241 shutdown_connections 2024-09-22T08:36:45.556 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.553+0000 7f24b6a0e800 1 --2- 172.21.15.142:0/2749788241 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55828cc6dd00 0x55828cdec220 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:45.556 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.553+0000 7f24b6a0e800 1 -- 172.21.15.142:0/2749788241 >> 172.21.15.142:0/2749788241 conn(0x55828ccf4ba0 msgr2=0x55828cde7ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:45.556 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.553+0000 7f24b6a0e800 1 -- 172.21.15.142:0/2749788241 shutdown_connections 2024-09-22T08:36:45.556 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.553+0000 7f24b6a0e800 1 -- 172.21.15.142:0/2749788241 wait complete. 2024-09-22T08:36:45.556 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.553+0000 7f24b6a0e800 1 Processor -- start 2024-09-22T08:36:45.557 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.553+0000 7f24b6a0e800 1 -- start start 2024-09-22T08:36:45.557 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.554+0000 7f24b6a0e800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55828cd00be0 0x55828cdf3fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:45.557 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.554+0000 7f24b6a0e800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55828cd03a50 con 0x55828cd00be0 2024-09-22T08:36:45.557 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.554+0000 7f24b221a640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55828cd00be0 0x55828cdf3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:45.557 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.554+0000 7f24b221a640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55828cd00be0 0x55828cdf3fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:39074/0 (socket says 172.21.15.142:39074) 2024-09-22T08:36:45.557 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.554+0000 7f24b221a640 1 -- 172.21.15.142:0/3791594092 learned_addr learned my addr 172.21.15.142:0/3791594092 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:45.557 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.554+0000 7f24b221a640 1 -- 172.21.15.142:0/3791594092 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55828cdf4500 con 0x55828cd00be0 2024-09-22T08:36:45.557 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.554+0000 7f24b221a640 1 --2- 172.21.15.142:0/3791594092 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55828cd00be0 0x55828cdf3fa0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f24a400c010 tx=0x7f24a4000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:45.557 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.554+0000 7f239ee05640 1 -- 172.21.15.142:0/3791594092 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f24a4012030 con 0x55828cd00be0 2024-09-22T08:36:45.557 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.554+0000 7f239ee05640 1 -- 172.21.15.142:0/3791594092 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24a40014a0 con 0x55828cd00be0 2024-09-22T08:36:45.557 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.554+0000 7f24b6a0e800 1 -- 172.21.15.142:0/3791594092 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55828cdf4790 con 0x55828cd00be0 2024-09-22T08:36:45.557 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.554+0000 7f239ee05640 1 -- 172.21.15.142:0/3791594092 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f24a401a700 con 0x55828cd00be0 2024-09-22T08:36:45.557 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.554+0000 7f24b6a0e800 1 -- 172.21.15.142:0/3791594092 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55828cdf5190 con 0x55828cd00be0 2024-09-22T08:36:45.560 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.555+0000 7f239ee05640 1 -- 172.21.15.142:0/3791594092 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f24a4015020 con 0x55828cd00be0 2024-09-22T08:36:45.560 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.555+0000 7f239ee05640 1 --2- 172.21.15.142:0/3791594092 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f239803cfb0 0x7f239803f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:45.560 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.555+0000 7f239ee05640 1 -- 172.21.15.142:0/3791594092 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f24a4020030 con 0x55828cd00be0 2024-09-22T08:36:45.561 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.556+0000 7f24b1a19640 1 --2- 172.21.15.142:0/3791594092 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f239803cfb0 0x7f239803f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:45.561 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.556+0000 7f24b6a0e800 1 --2- 172.21.15.142:0/3791594092 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55828cdf5cb0 0x55828cdfb5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:45.561 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.556+0000 7f24b6a0e800 1 -- 172.21.15.142:0/3791594092 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55828cdfbb80 con 0x55828cdf5cb0 2024-09-22T08:36:45.561 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.556+0000 7f24b2a1b640 1 --2- 172.21.15.142:0/3791594092 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55828cdf5cb0 0x55828cdfb5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:45.561 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.556+0000 7f24b1a19640 1 --2- 172.21.15.142:0/3791594092 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f239803cfb0 0x7f239803f470 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f24a8057000 tx=0x7f24a8052000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:45.561 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.556+0000 7f24b2a1b640 1 --2- 172.21.15.142:0/3791594092 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55828cdf5cb0 0x55828cdfb5f0 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:45.561 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.556+0000 7f24b2a1b640 1 -- 172.21.15.142:0/3791594092 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f24ac00a4d0 con 0x55828cdf5cb0 2024-09-22T08:36:45.561 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.556+0000 7f24b6a0e800 1 -- 172.21.15.142:0/3791594092 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55828cdf5620 con 0x55828cdf5cb0 2024-09-22T08:36:45.561 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.557+0000 7f24b2a1b640 1 -- 172.21.15.142:0/3791594092 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f24ac00a4d0 con 0x55828cdf5cb0 2024-09-22T08:36:45.561 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.557+0000 7f24b6a0e800 1 --2- 172.21.15.142:0/3791594092 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55828cdfdeb0 0x55828ce002a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:45.561 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.557+0000 7f24b6a0e800 1 -- 172.21.15.142:0/3791594092 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:3 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55828ce00970 con 0x55828cdfdeb0 2024-09-22T08:36:45.561 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.557+0000 7f24b221a640 1 --2- 172.21.15.142:0/3791594092 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55828cdfdeb0 0x55828ce002a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:45.561 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.557+0000 7f24b221a640 1 --2- 172.21.15.142:0/3791594092 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55828cdfdeb0 0x55828ce002a0 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:45.562 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.557+0000 7f24b221a640 1 -- 172.21.15.142:0/3791594092 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(3 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f24a40187b0 con 0x55828cdfdeb0 2024-09-22T08:36:45.562 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.557+0000 7f24b6a0e800 1 -- 172.21.15.142:0/3791594092 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55828cdfcd50 con 0x55828cdf5cb0 2024-09-22T08:36:45.562 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.557+0000 7f24b2a1b640 1 -- 172.21.15.142:0/3791594092 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f24ac00a4d0 con 0x55828cdf5cb0 2024-09-22T08:36:45.562 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.558+0000 7f24b6a0e800 1 -- 172.21.15.142:0/3791594092 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55828cdfd1f0 con 0x55828cdfdeb0 2024-09-22T08:36:45.562 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.558+0000 7f24b221a640 1 -- 172.21.15.142:0/3791594092 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(5 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f24a40187b0 con 0x55828cdfdeb0 2024-09-22T08:36:45.562 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.558+0000 7f24b6a0e800 1 Processor -- start 2024-09-22T08:36:45.562 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.558+0000 7f24b6a0e800 1 -- start start 2024-09-22T08:36:45.562 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.558+0000 7f24b6a0e800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55828ce0f310 0x55828ce0f730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:45.562 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.558+0000 7f24b6a0e800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55828cbf1d50 con 0x55828ce0f310 2024-09-22T08:36:45.562 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.559+0000 7f24b2a1b640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55828ce0f310 0x55828ce0f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:45.562 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.559+0000 7f24b2a1b640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55828ce0f310 0x55828ce0f730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:39086/0 (socket says 172.21.15.142:39086) 2024-09-22T08:36:45.562 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.559+0000 7f24b2a1b640 1 -- 172.21.15.142:0/2591553013 learned_addr learned my addr 172.21.15.142:0/2591553013 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:45.562 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.559+0000 7f24b2a1b640 1 -- 172.21.15.142:0/2591553013 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55828ce0fd70 con 0x55828ce0f310 2024-09-22T08:36:45.563 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.559+0000 7f24b2a1b640 1 --2- 172.21.15.142:0/2591553013 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55828ce0f310 0x55828ce0f730 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x55828cdf4e30 tx=0x7f24ac0167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:45.563 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.559+0000 7f2397fff640 1 -- 172.21.15.142:0/2591553013 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f24ac013640 con 0x55828ce0f310 2024-09-22T08:36:45.563 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.559+0000 7f2397fff640 1 -- 172.21.15.142:0/2591553013 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24ac0137e0 con 0x55828ce0f310 2024-09-22T08:36:45.563 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.559+0000 7f24b6a0e800 1 -- 172.21.15.142:0/2591553013 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55828ce105a0 con 0x55828ce0f310 2024-09-22T08:36:45.563 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.559+0000 7f2397fff640 1 -- 172.21.15.142:0/2591553013 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f24ac013ae0 con 0x55828ce0f310 2024-09-22T08:36:45.563 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.559+0000 7f24b6a0e800 1 -- 172.21.15.142:0/2591553013 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55828ce10b40 con 0x55828ce0f310 2024-09-22T08:36:45.570 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.560+0000 7f2397fff640 1 -- 172.21.15.142:0/2591553013 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f24ac011040 con 0x55828ce0f310 2024-09-22T08:36:45.570 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.560+0000 7f2397fff640 1 --2- 172.21.15.142:0/2591553013 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f238c03d000 0x7f238c03f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:45.570 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.560+0000 7f2397fff640 1 -- 172.21.15.142:0/2591553013 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f24ac00e040 con 0x55828ce0f310 2024-09-22T08:36:45.571 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.560+0000 7f24b221a640 1 --2- 172.21.15.142:0/2591553013 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f238c03d000 0x7f238c03f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:45.571 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.561+0000 7f24b6a0e800 1 Processor -- start 2024-09-22T08:36:45.571 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.561+0000 7f24b221a640 1 --2- 172.21.15.142:0/2591553013 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f238c03d000 0x7f238c03f4c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x55828cdfc050 tx=0x7f24a404d040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:45.571 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.561+0000 7f24b6a0e800 1 -- start start 2024-09-22T08:36:45.571 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.561+0000 7f24b6a0e800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55828ce1bd90 0x55828ce1c190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:45.571 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.561+0000 7f24b6a0e800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55828cdecc40 con 0x55828ce1bd90 2024-09-22T08:36:45.571 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.561+0000 7f24b2a1b640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55828ce1bd90 0x55828ce1c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:45.571 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.561+0000 7f24b2a1b640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55828ce1bd90 0x55828ce1c190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:39096/0 (socket says 172.21.15.142:39096) 2024-09-22T08:36:45.571 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.561+0000 7f24b2a1b640 1 -- 172.21.15.142:0/3998965652 learned_addr learned my addr 172.21.15.142:0/3998965652 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:45.571 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.561+0000 7f24b2a1b640 1 -- 172.21.15.142:0/3998965652 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55828ce1c780 con 0x55828ce1bd90 2024-09-22T08:36:45.571 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.561+0000 7f24b2a1b640 1 --2- 172.21.15.142:0/3998965652 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55828ce1bd90 0x55828ce1c190 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f24ac016cd0 tx=0x7f24ac014480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccc7f7ff85b8d0e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:45.571 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.561+0000 7f2395ffb640 1 -- 172.21.15.142:0/3998965652 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f24ac044030 con 0x55828ce1bd90 2024-09-22T08:36:45.571 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.561+0000 7f2395ffb640 1 -- 172.21.15.142:0/3998965652 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24ac056070 con 0x55828ce1bd90 2024-09-22T08:36:45.571 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.561+0000 7f2395ffb640 1 -- 172.21.15.142:0/3998965652 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f24ac021a60 con 0x55828ce1bd90 2024-09-22T08:36:45.572 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.562+0000 7f24b6a0e800 1 -- 172.21.15.142:0/3998965652 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55828ce1bd90 msgr2=0x55828ce1c190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:45.572 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.562+0000 7f24b6a0e800 1 --2- 172.21.15.142:0/3998965652 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55828ce1bd90 0x55828ce1c190 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f24ac016cd0 tx=0x7f24ac014480 comp rx=0 tx=0).stop 2024-09-22T08:36:45.572 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.562+0000 7f24b6a0e800 1 -- 172.21.15.142:0/3998965652 shutdown_connections 2024-09-22T08:36:45.572 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.562+0000 7f24b6a0e800 1 --2- 172.21.15.142:0/3998965652 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55828ce1bd90 0x55828ce1c190 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:45.572 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.562+0000 7f24b6a0e800 1 -- 172.21.15.142:0/3998965652 >> 172.21.15.142:0/3998965652 conn(0x55828ce18190 msgr2=0x55828ce163d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:45.572 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.562+0000 7f24b6a0e800 1 -- 172.21.15.142:0/3998965652 shutdown_connections 2024-09-22T08:36:45.572 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.562+0000 7f24b6a0e800 1 -- 172.21.15.142:0/3998965652 wait complete. 2024-09-22T08:36:45.572 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.562+0000 7f24b6a0e800 1 Processor -- start 2024-09-22T08:36:45.572 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.562+0000 7f24b6a0e800 1 -- start start 2024-09-22T08:36:45.572 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.562+0000 7f24b6a0e800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55828ce1bd90 0x55828ce233a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:45.572 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.562+0000 7f24b6a0e800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55828ce1cda0 con 0x55828ce1bd90 2024-09-22T08:36:45.572 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.563+0000 7f24b2a1b640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55828ce1bd90 0x55828ce233a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:45.572 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.563+0000 7f24b2a1b640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55828ce1bd90 0x55828ce233a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:39110/0 (socket says 172.21.15.142:39110) 2024-09-22T08:36:45.572 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.563+0000 7f24b2a1b640 1 -- 172.21.15.142:0/1319999315 learned_addr learned my addr 172.21.15.142:0/1319999315 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:45.573 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.563+0000 7f24b2a1b640 1 -- 172.21.15.142:0/1319999315 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55828ce23900 con 0x55828ce1bd90 2024-09-22T08:36:45.573 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.563+0000 7f24b2a1b640 1 --2- 172.21.15.142:0/1319999315 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55828ce1bd90 0x55828ce233a0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f24ac020560 tx=0x7f24ac054770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:45.573 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.563+0000 7f2383fff640 1 -- 172.21.15.142:0/1319999315 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f24ac013c80 con 0x55828ce1bd90 2024-09-22T08:36:45.573 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.563+0000 7f2383fff640 1 -- 172.21.15.142:0/1319999315 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24ac013e40 con 0x55828ce1bd90 2024-09-22T08:36:45.573 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.563+0000 7f2383fff640 1 -- 172.21.15.142:0/1319999315 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f24ac045b20 con 0x55828ce1bd90 2024-09-22T08:36:45.573 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.563+0000 7f24b6a0e800 1 -- 172.21.15.142:0/1319999315 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55828ce23b90 con 0x55828ce1bd90 2024-09-22T08:36:45.573 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.563+0000 7f24b6a0e800 1 -- 172.21.15.142:0/1319999315 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55828ce24720 con 0x55828ce1bd90 2024-09-22T08:36:45.573 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.564+0000 7f2383fff640 1 -- 172.21.15.142:0/1319999315 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f24ac045cc0 con 0x55828ce1bd90 2024-09-22T08:36:45.573 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.564+0000 7f2383fff640 1 --2- 172.21.15.142:0/1319999315 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f237c03d000 0x7f237c03f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:45.573 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.564+0000 7f2383fff640 1 -- 172.21.15.142:0/1319999315 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f24ac034b10 con 0x55828ce1bd90 2024-09-22T08:36:45.573 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.564+0000 7f24b221a640 1 --2- 172.21.15.142:0/1319999315 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f237c03d000 0x7f237c03f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:45.573 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.564+0000 7f24b6a0e800 20 rados->read ofs=0 len=0 2024-09-22T08:36:45.573 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.564+0000 7f24b6a0e800 1 --2- 172.21.15.142:0/1319999315 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55828ce2ec60 0x55828ce31120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:45.573 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.564+0000 7f24b6a0e800 1 -- 172.21.15.142:0/1319999315 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55828ce31870 con 0x55828ce2ec60 2024-09-22T08:36:45.574 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.565+0000 7f24b1a19640 1 --2- 172.21.15.142:0/1319999315 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55828ce2ec60 0x55828ce31120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:45.574 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.565+0000 7f24b221a640 1 --2- 172.21.15.142:0/1319999315 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f237c03d000 0x7f237c03f4c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f24a4001b10 tx=0x7f24a4047000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:45.574 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.565+0000 7f24b1a19640 1 --2- 172.21.15.142:0/1319999315 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55828ce2ec60 0x55828ce31120 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:45.574 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.565+0000 7f24b1a19640 1 -- 172.21.15.142:0/1319999315 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f24a8051070 con 0x55828ce2ec60 2024-09-22T08:36:45.574 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.565+0000 7f24b6a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:45.574 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.565+0000 7f24b6a0e800 20 realm 2024-09-22T08:36:45.574 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.565+0000 7f24b6a0e800 20 rados->read ofs=0 len=0 2024-09-22T08:36:45.574 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.565+0000 7f24b6a0e800 1 -- 172.21.15.142:0/1319999315 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55828ce31ca0 con 0x55828ce2ec60 2024-09-22T08:36:45.574 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.565+0000 7f24b1a19640 1 -- 172.21.15.142:0/1319999315 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f24a8051070 con 0x55828ce2ec60 2024-09-22T08:36:45.574 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.565+0000 7f24b6a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:45.574 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.565+0000 7f24b6a0e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:36:45.574 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.565+0000 7f24b6a0e800 20 rados->read ofs=0 len=0 2024-09-22T08:36:45.574 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.565+0000 7f24b6a0e800 1 -- 172.21.15.142:0/1319999315 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55828ce32570 con 0x55828ce2ec60 2024-09-22T08:36:45.575 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.566+0000 7f24b1a19640 1 -- 172.21.15.142:0/1319999315 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f24a8051070 con 0x55828ce2ec60 2024-09-22T08:36:45.575 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.566+0000 7f24b6a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:45.575 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.566+0000 7f24b6a0e800 20 rados->read ofs=0 len=0 2024-09-22T08:36:45.575 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.566+0000 7f24b6a0e800 1 -- 172.21.15.142:0/1319999315 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55828ce32910 con 0x55828ce2ec60 2024-09-22T08:36:45.575 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.566+0000 7f24b1a19640 1 -- 172.21.15.142:0/1319999315 <== osd.1 v2:172.21.15.142:6816/3192108003 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f24a8051070 con 0x55828ce2ec60 2024-09-22T08:36:45.575 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.566+0000 7f24b6a0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:36:45.575 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.566+0000 7f24b6a0e800 20 rados->read ofs=0 len=0 2024-09-22T08:36:45.575 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.566+0000 7f24b6a0e800 1 --2- 172.21.15.142:0/1319999315 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55828ce33670 0x55828ce35a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:45.575 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.566+0000 7f24b6a0e800 1 -- 172.21.15.142:0/1319999315 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55828ce35fa0 con 0x55828ce33670 2024-09-22T08:36:45.575 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.566+0000 7f24b2a1b640 1 --2- 172.21.15.142:0/1319999315 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55828ce33670 0x55828ce35a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:45.575 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.566+0000 7f24b2a1b640 1 --2- 172.21.15.142:0/1319999315 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55828ce33670 0x55828ce35a60 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:45.575 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.566+0000 7f24b2a1b640 1 -- 172.21.15.142:0/1319999315 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(5 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f24ac053020 con 0x55828ce33670 2024-09-22T08:36:45.575 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.566+0000 7f24b6a0e800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:36:45.575 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.566+0000 7f24b6a0e800 20 searching for the correct realm 2024-09-22T08:36:45.576 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.566+0000 7f24b6a0e800 1 -- 172.21.15.142:0/1319999315 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55828ce37910 con 0x55828ce33670 2024-09-22T08:36:45.576 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.567+0000 7f24b2a1b640 1 -- 172.21.15.142:0/1319999315 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24ac053020 con 0x55828ce33670 2024-09-22T08:36:45.576 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.567+0000 7f24b2a1b640 1 --2- 172.21.15.142:0/1319999315 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f24ac058040 0x7f24ac03d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:45.576 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.567+0000 7f24b2a1b640 1 -- 172.21.15.142:0/1319999315 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55828ce37910 con 0x7f24ac058040 2024-09-22T08:36:45.576 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.567+0000 7f24b221a640 1 --2- 172.21.15.142:0/1319999315 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f24ac058040 0x7f24ac03d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:45.576 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.567+0000 7f24b221a640 1 --2- 172.21.15.142:0/1319999315 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f24ac058040 0x7f24ac03d7f0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:45.576 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.567+0000 7f24b221a640 1 -- 172.21.15.142:0/1319999315 <== osd.2 v2:172.21.15.142:6808/279438927 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24a40187b0 con 0x7f24ac058040 2024-09-22T08:36:45.576 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.567+0000 7f24b221a640 1 --2- 172.21.15.142:0/1319999315 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f24a4017050 0x7f24a403e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:45.576 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.567+0000 7f24b221a640 1 -- 172.21.15.142:0/1319999315 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55828ce37910 con 0x7f24a4017050 2024-09-22T08:36:45.576 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.568+0000 7f24b1a19640 1 --2- 172.21.15.142:0/1319999315 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f24a4017050 0x7f24a403e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:45.576 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.568+0000 7f24b1a19640 1 --2- 172.21.15.142:0/1319999315 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f24a4017050 0x7f24a403e0e0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:45.576 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.568+0000 7f24b1a19640 1 -- 172.21.15.142:0/1319999315 <== osd.0 v2:172.21.15.31:6800/168281188 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24a8051070 con 0x7f24a4017050 2024-09-22T08:36:45.576 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.568+0000 7f24b1a19640 1 -- 172.21.15.142:0/1319999315 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55828ce37910 con 0x55828ce2ec60 2024-09-22T08:36:45.576 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.568+0000 7f24b1a19640 1 -- 172.21.15.142:0/1319999315 <== osd.1 v2:172.21.15.142:6816/3192108003 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24a8051070 con 0x55828ce2ec60 2024-09-22T08:36:45.577 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.568+0000 7f24b1a19640 1 -- 172.21.15.142:0/1319999315 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55828ce37910 con 0x55828ce2ec60 2024-09-22T08:36:45.577 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.569+0000 7f24b1a19640 1 -- 172.21.15.142:0/1319999315 <== osd.1 v2:172.21.15.142:6816/3192108003 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24a8051070 con 0x55828ce2ec60 2024-09-22T08:36:45.577 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.569+0000 7f24b1a19640 1 -- 172.21.15.142:0/1319999315 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55828ce37910 con 0x7f24a4017050 2024-09-22T08:36:45.577 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.569+0000 7f24b1a19640 1 -- 172.21.15.142:0/1319999315 <== osd.0 v2:172.21.15.31:6800/168281188 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24a8051070 con 0x7f24a4017050 2024-09-22T08:36:45.577 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.569+0000 7f24b1a19640 1 -- 172.21.15.142:0/1319999315 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55828ce37910 con 0x7f24a4017050 2024-09-22T08:36:45.577 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.569+0000 7f24b1a19640 1 -- 172.21.15.142:0/1319999315 <== osd.0 v2:172.21.15.31:6800/168281188 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24a8051070 con 0x7f24a4017050 2024-09-22T08:36:45.577 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.569+0000 7f24b1a19640 1 -- 172.21.15.142:0/1319999315 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55828ce37910 con 0x7f24ac058040 2024-09-22T08:36:45.577 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.569+0000 7f24b221a640 1 -- 172.21.15.142:0/1319999315 <== osd.2 v2:172.21.15.142:6808/279438927 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24a40187b0 con 0x7f24ac058040 2024-09-22T08:36:45.577 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.569+0000 7f24b221a640 1 -- 172.21.15.142:0/1319999315 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55828ce37910 con 0x55828ce33670 2024-09-22T08:36:45.586 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.570+0000 7f24b2a1b640 1 -- 172.21.15.142:0/1319999315 <== osd.3 v2:172.21.15.142:6800/1064901393 3 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24ac053020 con 0x55828ce33670 2024-09-22T08:36:45.586 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.570+0000 7f24b2a1b640 1 -- 172.21.15.142:0/1319999315 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55828ce37910 con 0x55828ce2ec60 2024-09-22T08:36:45.586 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.570+0000 7f24b1a19640 1 -- 172.21.15.142:0/1319999315 <== osd.1 v2:172.21.15.142:6816/3192108003 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24a8051070 con 0x55828ce2ec60 2024-09-22T08:36:45.586 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.570+0000 7f24b1a19640 1 -- 172.21.15.142:0/1319999315 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55828ce37910 con 0x7f24a4017050 2024-09-22T08:36:45.586 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.570+0000 7f24b1a19640 1 -- 172.21.15.142:0/1319999315 <== osd.0 v2:172.21.15.31:6800/168281188 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24a8051070 con 0x7f24a4017050 2024-09-22T08:36:45.586 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.570+0000 7f24b1a19640 1 -- 172.21.15.142:0/1319999315 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55828ce37910 con 0x55828ce2ec60 2024-09-22T08:36:45.586 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.570+0000 7f24b1a19640 1 -- 172.21.15.142:0/1319999315 <== osd.1 v2:172.21.15.142:6816/3192108003 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24a8051070 con 0x55828ce2ec60 2024-09-22T08:36:45.586 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.570+0000 7f24b1a19640 1 -- 172.21.15.142:0/1319999315 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55828ce37910 con 0x7f24ac058040 2024-09-22T08:36:45.586 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.570+0000 7f24b221a640 1 -- 172.21.15.142:0/1319999315 <== osd.2 v2:172.21.15.142:6808/279438927 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f24a40187b0 con 0x7f24ac058040 2024-09-22T08:36:45.586 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.570+0000 7f24b221a640 1 -- 172.21.15.142:0/1319999315 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55828ce37910 con 0x55828ce33670 2024-09-22T08:36:45.587 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.571+0000 7f24b2a1b640 1 -- 172.21.15.142:0/1319999315 <== osd.3 v2:172.21.15.142:6800/1064901393 4 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24ac053020 con 0x55828ce33670 2024-09-22T08:36:45.587 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.571+0000 7f24b2a1b640 1 -- 172.21.15.142:0/1319999315 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55828ce37910 con 0x55828ce33670 2024-09-22T08:36:45.587 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.571+0000 7f24b2a1b640 1 -- 172.21.15.142:0/1319999315 <== osd.3 v2:172.21.15.142:6800/1064901393 5 ==== osd_op_reply(20 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f24ac053020 con 0x55828ce33670 2024-09-22T08:36:45.587 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.571+0000 7f24b2a1b640 1 -- 172.21.15.142:0/1319999315 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55828ce37910 con 0x7f24a4017050 2024-09-22T08:36:45.587 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.571+0000 7f24b1a19640 1 -- 172.21.15.142:0/1319999315 <== osd.0 v2:172.21.15.31:6800/168281188 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24a8051070 con 0x7f24a4017050 2024-09-22T08:36:45.587 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.571+0000 7f24b1a19640 1 -- 172.21.15.142:0/1319999315 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55828ce37910 con 0x55828ce33670 2024-09-22T08:36:45.587 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.571+0000 7f24b2a1b640 1 -- 172.21.15.142:0/1319999315 <== osd.3 v2:172.21.15.142:6800/1064901393 6 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24ac053020 con 0x55828ce33670 2024-09-22T08:36:45.587 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.571+0000 7f24b2a1b640 1 -- 172.21.15.142:0/1319999315 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55828ce37910 con 0x55828ce33670 2024-09-22T08:36:45.587 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.572+0000 7f24b2a1b640 1 -- 172.21.15.142:0/1319999315 <== osd.3 v2:172.21.15.142:6800/1064901393 7 ==== osd_op_reply(23 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f24ac053020 con 0x55828ce33670 2024-09-22T08:36:45.587 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.572+0000 7f24b2a1b640 1 -- 172.21.15.142:0/1319999315 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55828ce37910 con 0x55828ce2ec60 2024-09-22T08:36:45.587 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.572+0000 7f24b1a19640 1 -- 172.21.15.142:0/1319999315 <== osd.1 v2:172.21.15.142:6816/3192108003 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24a8051070 con 0x55828ce2ec60 2024-09-22T08:36:45.587 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.572+0000 7f24b1a19640 1 -- 172.21.15.142:0/1319999315 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55828ce37910 con 0x55828ce2ec60 2024-09-22T08:36:45.587 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.572+0000 7f24b1a19640 1 -- 172.21.15.142:0/1319999315 <== osd.1 v2:172.21.15.142:6816/3192108003 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f24a8051070 con 0x55828ce2ec60 2024-09-22T08:36:45.587 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.572+0000 7f24b1a19640 1 -- 172.21.15.142:0/1319999315 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55828ce37910 con 0x7f24a4017050 2024-09-22T08:36:45.588 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.573+0000 7f24b1a19640 1 -- 172.21.15.142:0/1319999315 <== osd.0 v2:172.21.15.31:6800/168281188 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24a8051070 con 0x7f24a4017050 2024-09-22T08:36:45.588 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.573+0000 7f24b1a19640 1 -- 172.21.15.142:0/1319999315 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55828ce37910 con 0x55828ce33670 2024-09-22T08:36:45.588 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.573+0000 7f24b2a1b640 1 -- 172.21.15.142:0/1319999315 <== osd.3 v2:172.21.15.142:6800/1064901393 8 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24ac053020 con 0x55828ce33670 2024-09-22T08:36:45.588 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.573+0000 7f24b2a1b640 1 -- 172.21.15.142:0/1319999315 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55828ce37910 con 0x7f24ac058040 2024-09-22T08:36:45.588 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.573+0000 7f24b221a640 1 -- 172.21.15.142:0/1319999315 <== osd.2 v2:172.21.15.142:6808/279438927 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24a40187b0 con 0x7f24ac058040 2024-09-22T08:36:45.588 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.573+0000 7f24b221a640 1 -- 172.21.15.142:0/1319999315 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55828ce37910 con 0x55828ce2ec60 2024-09-22T08:36:45.588 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.573+0000 7f24b1a19640 1 -- 172.21.15.142:0/1319999315 <== osd.1 v2:172.21.15.142:6816/3192108003 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24a8051070 con 0x55828ce2ec60 2024-09-22T08:36:45.588 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.573+0000 7f24b1a19640 1 -- 172.21.15.142:0/1319999315 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55828ce37910 con 0x7f24a4017050 2024-09-22T08:36:45.588 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.574+0000 7f24b1a19640 1 -- 172.21.15.142:0/1319999315 <== osd.0 v2:172.21.15.31:6800/168281188 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24a8051070 con 0x7f24a4017050 2024-09-22T08:36:45.588 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.574+0000 7f24b1a19640 1 -- 172.21.15.142:0/1319999315 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55828ce37910 con 0x55828ce33670 2024-09-22T08:36:45.588 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.574+0000 7f24b2a1b640 1 -- 172.21.15.142:0/1319999315 <== osd.3 v2:172.21.15.142:6800/1064901393 9 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24ac053020 con 0x55828ce33670 2024-09-22T08:36:45.588 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.574+0000 7f24b2a1b640 1 -- 172.21.15.142:0/1319999315 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55828ce37910 con 0x7f24a4017050 2024-09-22T08:36:45.588 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.574+0000 7f24b1a19640 1 -- 172.21.15.142:0/1319999315 <== osd.0 v2:172.21.15.31:6800/168281188 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24a8051070 con 0x7f24a4017050 2024-09-22T08:36:45.589 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.574+0000 7f24b1a19640 1 -- 172.21.15.142:0/1319999315 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55828ce37910 con 0x7f24ac058040 2024-09-22T08:36:45.589 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.574+0000 7f24b221a640 1 -- 172.21.15.142:0/1319999315 <== osd.2 v2:172.21.15.142:6808/279438927 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24a40187b0 con 0x7f24ac058040 2024-09-22T08:36:45.589 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.574+0000 7f24b221a640 1 -- 172.21.15.142:0/1319999315 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55828ce37910 con 0x55828ce33670 2024-09-22T08:36:45.589 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.574+0000 7f24b2a1b640 1 -- 172.21.15.142:0/1319999315 <== osd.3 v2:172.21.15.142:6800/1064901393 10 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24ac053020 con 0x55828ce33670 2024-09-22T08:36:45.589 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.575+0000 7f24b2a1b640 1 -- 172.21.15.142:0/1319999315 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55828ce37910 con 0x7f24a4017050 2024-09-22T08:36:45.589 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.575+0000 7f24b1a19640 1 -- 172.21.15.142:0/1319999315 <== osd.0 v2:172.21.15.31:6800/168281188 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24a8051070 con 0x7f24a4017050 2024-09-22T08:36:45.589 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.575+0000 7f24b1a19640 1 -- 172.21.15.142:0/1319999315 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55828ce37910 con 0x55828ce2ec60 2024-09-22T08:36:45.589 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.575+0000 7f24b1a19640 1 -- 172.21.15.142:0/1319999315 <== osd.1 v2:172.21.15.142:6816/3192108003 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f24a8051070 con 0x55828ce2ec60 2024-09-22T08:36:45.589 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.575+0000 7f24b1a19640 1 -- 172.21.15.142:0/1319999315 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55828ce37910 con 0x7f24ac058040 2024-09-22T08:36:45.589 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.575+0000 7f24b221a640 1 -- 172.21.15.142:0/1319999315 <== osd.2 v2:172.21.15.142:6808/279438927 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24a40187b0 con 0x7f24ac058040 2024-09-22T08:36:45.589 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.575+0000 7f24b6a0e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:36:45.589 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.575+0000 7f24b6a0e800 20 RGWRados::pool_iterate: got zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec 2024-09-22T08:36:45.589 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.575+0000 7f24b6a0e800 20 RGWRados::pool_iterate: got zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f 2024-09-22T08:36:45.590 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.575+0000 7f24b6a0e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:36:45.590 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.575+0000 7f24b6a0e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:36:45.590 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.575+0000 7f24b6a0e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:36:45.590 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.575+0000 7f24b6a0e800 20 rados->read ofs=0 len=0 2024-09-22T08:36:45.590 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.575+0000 7f24b6a0e800 1 -- 172.21.15.142:0/1319999315 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55828ce36a10 con 0x55828ce2ec60 2024-09-22T08:36:45.590 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.575+0000 7f24b1a19640 1 -- 172.21.15.142:0/1319999315 <== osd.1 v2:172.21.15.142:6816/3192108003 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f24a8051070 con 0x55828ce2ec60 2024-09-22T08:36:45.590 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.575+0000 7f24b6a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:45.590 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.576+0000 7f24b6a0e800 20 rados->read ofs=0 len=0 2024-09-22T08:36:45.590 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.576+0000 7f24b6a0e800 1 -- 172.21.15.142:0/1319999315 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55828ce372b0 con 0x55828ce2ec60 2024-09-22T08:36:45.590 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.576+0000 7f24b1a19640 1 -- 172.21.15.142:0/1319999315 <== osd.1 v2:172.21.15.142:6816/3192108003 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f24a8051070 con 0x55828ce2ec60 2024-09-22T08:36:45.590 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.576+0000 7f24b6a0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:36:45.590 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.576+0000 7f24b6a0e800 20 rados->read ofs=0 len=0 2024-09-22T08:36:45.590 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.576+0000 7f24b6a0e800 1 -- 172.21.15.142:0/1319999315 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:40 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55828ce36650 con 0x55828ce33670 2024-09-22T08:36:45.591 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.576+0000 7f24b2a1b640 1 -- 172.21.15.142:0/1319999315 <== osd.3 v2:172.21.15.142:6800/1064901393 11 ==== osd_op_reply(40 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f24ac053020 con 0x55828ce33670 2024-09-22T08:36:45.591 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.576+0000 7f24b6a0e800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:36:45.591 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.576+0000 7f24b6a0e800 20 zone default found 2024-09-22T08:36:45.591 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.576+0000 7f24b6a0e800 4 Realm: () 2024-09-22T08:36:45.591 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.576+0000 7f24b6a0e800 4 ZoneGroup: default (d89f6f57-1007-47dd-9065-f486c7b01aec) 2024-09-22T08:36:45.591 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.576+0000 7f24b6a0e800 4 Zone: default (e239248c-0bee-4e41-803a-24b288d3eb8f) 2024-09-22T08:36:45.591 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.576+0000 7f24b6a0e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:36:45.591 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.576+0000 7f24b6a0e800 20 zonegroup default 2024-09-22T08:36:45.591 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.576+0000 7f24b6a0e800 20 rados->read ofs=0 len=0 2024-09-22T08:36:45.591 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.576+0000 7f24b6a0e800 1 -- 172.21.15.142:0/1319999315 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55828ce38290 con 0x7f24a4017050 2024-09-22T08:36:45.591 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.576+0000 7f24b1a19640 1 -- 172.21.15.142:0/1319999315 <== osd.0 v2:172.21.15.31:6800/168281188 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f24a8051070 con 0x7f24a4017050 2024-09-22T08:36:45.591 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.576+0000 7f24b6a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:45.591 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.576+0000 7f24b6a0e800 20 rados->read ofs=0 len=0 2024-09-22T08:36:45.592 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.576+0000 7f24b6a0e800 1 -- 172.21.15.142:0/1319999315 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55828ce3a150 con 0x55828ce33670 2024-09-22T08:36:45.592 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.577+0000 7f24b2a1b640 1 -- 172.21.15.142:0/1319999315 <== osd.3 v2:172.21.15.142:6800/1064901393 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f24ac053020 con 0x55828ce33670 2024-09-22T08:36:45.592 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.577+0000 7f24b6a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:45.592 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.577+0000 7f24b6a0e800 20 rados->read ofs=0 len=0 2024-09-22T08:36:45.592 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.577+0000 7f24b6a0e800 1 -- 172.21.15.142:0/1319999315 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55828ce3a5c0 con 0x55828ce33670 2024-09-22T08:36:45.592 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.577+0000 7f24b2a1b640 1 -- 172.21.15.142:0/1319999315 <== osd.3 v2:172.21.15.142:6800/1064901393 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f24ac053020 con 0x55828ce33670 2024-09-22T08:36:45.592 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.577+0000 7f24b6a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:45.592 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.577+0000 7f24b6a0e800 20 started sync module instance, tier type = 2024-09-22T08:36:45.592 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.577+0000 7f24b6a0e800 20 started zone id=e239248c-0bee-4e41-803a-24b288d3eb8f (name=default) with tier type = 2024-09-22T08:36:45.592 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.577+0000 7f24b6a0e800 1 -- 172.21.15.142:0/1319999315 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55828ce394c0 con 0x7f24ac058040 2024-09-22T08:36:45.592 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.578+0000 7f24b221a640 1 -- 172.21.15.142:0/1319999315 <== osd.2 v2:172.21.15.142:6808/279438927 7 ==== osd_op_reply(44 notify.0 [create] v30'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24a40187b0 con 0x7f24ac058040 2024-09-22T08:36:45.592 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.578+0000 7f24b6a0e800 1 -- 172.21.15.142:0/1319999315 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94019197835440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55828ce39120 con 0x7f24ac058040 2024-09-22T08:36:45.593 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.578+0000 7f24b6a0e800 1 -- 172.21.15.142:0/1319999315 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55828ce3b4d0 con 0x55828ce2ec60 2024-09-22T08:36:45.593 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.579+0000 7f24b221a640 1 -- 172.21.15.142:0/1319999315 <== osd.2 v2:172.21.15.142:6808/279438927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94019197835440] v30'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24a40187b0 con 0x7f24ac058040 2024-09-22T08:36:45.593 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.579+0000 7f24b1a19640 1 -- 172.21.15.142:0/1319999315 <== osd.1 v2:172.21.15.142:6816/3192108003 15 ==== osd_op_reply(46 notify.1 [create] v30'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24a8051070 con 0x55828ce2ec60 2024-09-22T08:36:45.593 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.579+0000 7f24b6a0e800 1 -- 172.21.15.142:0/1319999315 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94019197841440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55828ce3b440 con 0x55828ce2ec60 2024-09-22T08:36:45.593 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.579+0000 7f24b6a0e800 1 -- 172.21.15.142:0/1319999315 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55828ce3c390 con 0x55828ce33670 2024-09-22T08:36:45.593 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.580+0000 7f24b2a1b640 1 -- 172.21.15.142:0/1319999315 <== osd.3 v2:172.21.15.142:6800/1064901393 14 ==== osd_op_reply(48 notify.2 [create] v30'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24ac053020 con 0x55828ce33670 2024-09-22T08:36:45.593 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.580+0000 7f24b6a0e800 1 -- 172.21.15.142:0/1319999315 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94019197845216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55828ce3c360 con 0x55828ce33670 2024-09-22T08:36:45.593 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.580+0000 7f24b6a0e800 1 -- 172.21.15.142:0/1319999315 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55828ce3d370 con 0x7f24ac058040 2024-09-22T08:36:45.593 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.580+0000 7f24b1a19640 1 -- 172.21.15.142:0/1319999315 <== osd.1 v2:172.21.15.142:6816/3192108003 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94019197841440] v30'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24a8051070 con 0x55828ce2ec60 2024-09-22T08:36:45.593 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.581+0000 7f24b2a1b640 1 -- 172.21.15.142:0/1319999315 <== osd.3 v2:172.21.15.142:6800/1064901393 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94019197845216] v30'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24ac053020 con 0x55828ce33670 2024-09-22T08:36:45.593 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.581+0000 7f24b221a640 1 -- 172.21.15.142:0/1319999315 <== osd.2 v2:172.21.15.142:6808/279438927 9 ==== osd_op_reply(50 notify.3 [create] v30'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24a40187b0 con 0x7f24ac058040 2024-09-22T08:36:45.593 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.581+0000 7f24b6a0e800 1 -- 172.21.15.142:0/1319999315 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94019197847424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55828ce3b8c0 con 0x7f24ac058040 2024-09-22T08:36:45.593 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.581+0000 7f24b6a0e800 1 -- 172.21.15.142:0/1319999315 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55828ce3dc10 con 0x55828ce2ec60 2024-09-22T08:36:45.593 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.583+0000 7f24b221a640 1 -- 172.21.15.142:0/1319999315 <== osd.2 v2:172.21.15.142:6808/279438927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94019197847424] v30'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24a40187b0 con 0x7f24ac058040 2024-09-22T08:36:45.594 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.583+0000 7f24b1a19640 1 -- 172.21.15.142:0/1319999315 <== osd.1 v2:172.21.15.142:6816/3192108003 17 ==== osd_op_reply(52 notify.4 [create] v30'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24a8051070 con 0x55828ce2ec60 2024-09-22T08:36:45.594 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.583+0000 7f24b6a0e800 1 -- 172.21.15.142:0/1319999315 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94019197851488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55828ce3db80 con 0x55828ce2ec60 2024-09-22T08:36:45.594 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.583+0000 7f24b6a0e800 1 -- 172.21.15.142:0/1319999315 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55828ce3ead0 con 0x7f24a4017050 2024-09-22T08:36:45.594 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.584+0000 7f24b1a19640 1 -- 172.21.15.142:0/1319999315 <== osd.0 v2:172.21.15.31:6800/168281188 11 ==== osd_op_reply(54 notify.5 [create] v30'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24a8051070 con 0x7f24a4017050 2024-09-22T08:36:45.594 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.584+0000 7f24b6a0e800 1 -- 172.21.15.142:0/1319999315 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94019197855264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55828ce3ea40 con 0x7f24a4017050 2024-09-22T08:36:45.594 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.584+0000 7f24b6a0e800 1 -- 172.21.15.142:0/1319999315 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55828ce3fa80 con 0x7f24a4017050 2024-09-22T08:36:45.594 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.584+0000 7f24b1a19640 1 -- 172.21.15.142:0/1319999315 <== osd.1 v2:172.21.15.142:6816/3192108003 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94019197851488] v30'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24a8051070 con 0x55828ce2ec60 2024-09-22T08:36:45.594 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.585+0000 7f24b1a19640 1 -- 172.21.15.142:0/1319999315 <== osd.0 v2:172.21.15.31:6800/168281188 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94019197855264] v30'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24a8051070 con 0x7f24a4017050 2024-09-22T08:36:45.602 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.585+0000 7f24b1a19640 1 -- 172.21.15.142:0/1319999315 <== osd.0 v2:172.21.15.31:6800/168281188 13 ==== osd_op_reply(56 notify.6 [create] v30'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24a8051070 con 0x7f24a4017050 2024-09-22T08:36:45.603 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.585+0000 7f24b6a0e800 1 -- 172.21.15.142:0/1319999315 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94019197857472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55828ce3f590 con 0x7f24a4017050 2024-09-22T08:36:45.603 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.585+0000 7f24b6a0e800 1 -- 172.21.15.142:0/1319999315 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55828ce3ff50 con 0x7f24a4017050 2024-09-22T08:36:45.603 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.586+0000 7f24b1a19640 1 -- 172.21.15.142:0/1319999315 <== osd.0 v2:172.21.15.31:6800/168281188 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94019197857472] v30'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24a8051070 con 0x7f24a4017050 2024-09-22T08:36:45.603 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.586+0000 7f24b1a19640 1 -- 172.21.15.142:0/1319999315 <== osd.0 v2:172.21.15.31:6800/168281188 15 ==== osd_op_reply(58 notify.7 [create] v30'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24a8051070 con 0x7f24a4017050 2024-09-22T08:36:45.603 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.586+0000 7f24b6a0e800 1 -- 172.21.15.142:0/1319999315 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94019197853648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55828ce3ff50 con 0x7f24a4017050 2024-09-22T08:36:45.603 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.586+0000 7f24b6a0e800 20 add_watcher() i=0 2024-09-22T08:36:45.603 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.586+0000 7f24b6a0e800 20 add_watcher() i=1 2024-09-22T08:36:45.603 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.586+0000 7f24b6a0e800 20 add_watcher() i=2 2024-09-22T08:36:45.603 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.586+0000 7f24b6a0e800 20 add_watcher() i=3 2024-09-22T08:36:45.603 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.586+0000 7f24b6a0e800 20 add_watcher() i=4 2024-09-22T08:36:45.603 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.586+0000 7f24b6a0e800 20 add_watcher() i=5 2024-09-22T08:36:45.603 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.586+0000 7f24b6a0e800 20 add_watcher() i=6 2024-09-22T08:36:45.603 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.587+0000 7f24b1a19640 1 -- 172.21.15.142:0/1319999315 <== osd.0 v2:172.21.15.31:6800/168281188 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94019197853648] v30'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24a8051070 con 0x7f24a4017050 2024-09-22T08:36:45.604 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.587+0000 7f24b6a0e800 20 add_watcher() i=7 2024-09-22T08:36:45.604 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.587+0000 7f24b6a0e800 2 all 8 watchers are set, enabling cache 2024-09-22T08:36:45.604 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.587+0000 7f24b6a0e800 1 -- 172.21.15.142:0/1319999315 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55828ce433f0 con 0x55828ce2ec60 2024-09-22T08:36:45.604 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.587+0000 7f24b1a19640 1 -- 172.21.15.142:0/1319999315 <== osd.1 v2:172.21.15.142:6816/3192108003 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f24a8051070 con 0x55828ce2ec60 2024-09-22T08:36:45.604 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.587+0000 7f24b6a0e800 1 -- 172.21.15.142:0/1319999315 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94019197873680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55828ce400c0 con 0x55828ce2ec60 2024-09-22T08:36:45.604 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.588+0000 7f24b1a19640 1 -- 172.21.15.142:0/1319999315 <== osd.1 v2:172.21.15.142:6816/3192108003 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94019197873680] v30'94 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f24a8051070 con 0x55828ce2ec60 2024-09-22T08:36:45.604 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.588+0000 7f23697e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:36:45.604 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.588+0000 7f24b6a0e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:36:45.604 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.588+0000 7f24b6a0e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:36:45.604 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.588+0000 7f24b6a0e800 5 note: GC not initialized 2024-09-22T08:36:45.604 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.588+0000 7f23637fe640 20 reqs_thread_entry: start 2024-09-22T08:36:45.604 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.589+0000 7f24b6a0e800 20 init_complete bucket index max shards: 11 2024-09-22T08:36:45.604 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.589+0000 7f24b6a0e800 20 Filter name: none 2024-09-22T08:36:45.604 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.589+0000 7f23617fa640 20 reqs_thread_entry: start 2024-09-22T08:36:45.605 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.589+0000 7f24b6a0e800 1 -- 172.21.15.142:0/1319999315 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:62 8.0 8:00000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55828ce75e60 con 0x55828ce33670 2024-09-22T08:36:45.605 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.589+0000 7f24b2a1b640 1 -- 172.21.15.142:0/1319999315 <== osd.3 v2:172.21.15.142:6800/1064901393 16 ==== osd_op_reply(62 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24ac053020 con 0x55828ce33670 2024-09-22T08:36:45.605 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.589+0000 7f24b2a1b640 1 -- 172.21.15.142:0/1319999315 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:63 8.10 8:08000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55828ce3a5c0 con 0x55828ce33670 2024-09-22T08:36:45.605 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.589+0000 7f24b2a1b640 1 -- 172.21.15.142:0/1319999315 <== osd.3 v2:172.21.15.142:6800/1064901393 17 ==== osd_op_reply(63 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24ac053020 con 0x55828ce33670 2024-09-22T08:36:45.605 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.589+0000 7f24b2a1b640 1 -- 172.21.15.142:0/1319999315 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:64 8.8 8:10000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55828ce3a5c0 con 0x55828ce2ec60 2024-09-22T08:36:45.605 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.590+0000 7f24b1a19640 1 -- 172.21.15.142:0/1319999315 <== osd.1 v2:172.21.15.142:6816/3192108003 21 ==== osd_op_reply(64 [pgnls start_epoch 30 out=49b] v30'2 uv2 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24a8051070 con 0x55828ce2ec60 2024-09-22T08:36:45.605 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.590+0000 7f24b1a19640 1 -- 172.21.15.142:0/1319999315 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:65 8.18 8:18000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55828ce38290 con 0x55828ce2ec60 2024-09-22T08:36:45.605 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.590+0000 7f24b1a19640 1 -- 172.21.15.142:0/1319999315 <== osd.1 v2:172.21.15.142:6816/3192108003 22 ==== osd_op_reply(65 [pgnls start_epoch 30 out=49b] v30'11 uv11 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24a8051070 con 0x55828ce2ec60 2024-09-22T08:36:45.605 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.590+0000 7f24b1a19640 1 -- 172.21.15.142:0/1319999315 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:66 8.4 8:20000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55828ce38290 con 0x7f24ac058040 2024-09-22T08:36:45.605 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.590+0000 7f24b221a640 1 -- 172.21.15.142:0/1319999315 <== osd.2 v2:172.21.15.142:6808/279438927 11 ==== osd_op_reply(66 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24a40187b0 con 0x7f24ac058040 2024-09-22T08:36:45.605 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.590+0000 7f24b221a640 1 -- 172.21.15.142:0/1319999315 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:67 8.14 8:28000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55828ce3b8c0 con 0x55828ce33670 2024-09-22T08:36:45.605 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.590+0000 7f24b2a1b640 1 -- 172.21.15.142:0/1319999315 <== osd.3 v2:172.21.15.142:6800/1064901393 18 ==== osd_op_reply(67 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24ac053020 con 0x55828ce33670 2024-09-22T08:36:45.605 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.590+0000 7f24b2a1b640 1 -- 172.21.15.142:0/1319999315 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:68 8.c 8:30000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55828ce3b8c0 con 0x55828ce2ec60 2024-09-22T08:36:45.605 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.590+0000 7f24b1a19640 1 -- 172.21.15.142:0/1319999315 <== osd.1 v2:172.21.15.142:6816/3192108003 23 ==== osd_op_reply(68 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24a8051070 con 0x55828ce2ec60 2024-09-22T08:36:45.606 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.590+0000 7f24b1a19640 1 -- 172.21.15.142:0/1319999315 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:69 8.1c 8:38000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55828ce3b8c0 con 0x55828ce33670 2024-09-22T08:36:45.606 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.591+0000 7f24b2a1b640 1 -- 172.21.15.142:0/1319999315 <== osd.3 v2:172.21.15.142:6800/1064901393 19 ==== osd_op_reply(69 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24ac053020 con 0x55828ce33670 2024-09-22T08:36:45.606 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.591+0000 7f24b2a1b640 1 -- 172.21.15.142:0/1319999315 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:70 8.2 8:40000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55828ce3b8c0 con 0x7f24ac058040 2024-09-22T08:36:45.606 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.591+0000 7f24b221a640 1 -- 172.21.15.142:0/1319999315 <== osd.2 v2:172.21.15.142:6808/279438927 12 ==== osd_op_reply(70 [pgnls start_epoch 30 out=49b] v30'2 uv2 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24a40187b0 con 0x7f24ac058040 2024-09-22T08:36:45.606 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.591+0000 7f24b221a640 1 -- 172.21.15.142:0/1319999315 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:71 8.12 8:48000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55828ce3b8c0 con 0x55828ce33670 2024-09-22T08:36:45.606 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.591+0000 7f24b2a1b640 1 -- 172.21.15.142:0/1319999315 <== osd.3 v2:172.21.15.142:6800/1064901393 20 ==== osd_op_reply(71 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24ac053020 con 0x55828ce33670 2024-09-22T08:36:45.606 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.591+0000 7f24b2a1b640 1 -- 172.21.15.142:0/1319999315 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:72 8.a 8:50000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55828ce3b8c0 con 0x55828ce2ec60 2024-09-22T08:36:45.606 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.591+0000 7f24b1a19640 1 -- 172.21.15.142:0/1319999315 <== osd.1 v2:172.21.15.142:6816/3192108003 24 ==== osd_op_reply(72 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24a8051070 con 0x55828ce2ec60 2024-09-22T08:36:45.606 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.591+0000 7f24b1a19640 1 -- 172.21.15.142:0/1319999315 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:73 8.1a 8:58000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55828ce3b8c0 con 0x7f24a4017050 2024-09-22T08:36:45.606 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.592+0000 7f24b1a19640 1 -- 172.21.15.142:0/1319999315 <== osd.0 v2:172.21.15.31:6800/168281188 17 ==== osd_op_reply(73 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24a8051070 con 0x7f24a4017050 2024-09-22T08:36:45.606 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.592+0000 7f24b1a19640 1 -- 172.21.15.142:0/1319999315 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:74 8.6 8:60000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55828ce3b8c0 con 0x7f24a4017050 2024-09-22T08:36:45.606 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.592+0000 7f24b1a19640 1 -- 172.21.15.142:0/1319999315 <== osd.0 v2:172.21.15.31:6800/168281188 18 ==== osd_op_reply(74 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24a8051070 con 0x7f24a4017050 2024-09-22T08:36:45.606 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.592+0000 7f24b1a19640 1 -- 172.21.15.142:0/1319999315 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:75 8.16 8:68000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55828ce3b8c0 con 0x55828ce33670 2024-09-22T08:36:45.607 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.592+0000 7f24b2a1b640 1 -- 172.21.15.142:0/1319999315 <== osd.3 v2:172.21.15.142:6800/1064901393 21 ==== osd_op_reply(75 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24ac053020 con 0x55828ce33670 2024-09-22T08:36:45.607 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.592+0000 7f24b2a1b640 1 -- 172.21.15.142:0/1319999315 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:76 8.e 8:70000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55828ce3b8c0 con 0x7f24a4017050 2024-09-22T08:36:45.607 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.592+0000 7f24b1a19640 1 -- 172.21.15.142:0/1319999315 <== osd.0 v2:172.21.15.31:6800/168281188 19 ==== osd_op_reply(76 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24a8051070 con 0x7f24a4017050 2024-09-22T08:36:45.607 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.592+0000 7f24b1a19640 1 -- 172.21.15.142:0/1319999315 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:77 8.1e 8:78000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55828ce3b8c0 con 0x7f24a4017050 2024-09-22T08:36:45.607 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.593+0000 7f24b1a19640 1 -- 172.21.15.142:0/1319999315 <== osd.0 v2:172.21.15.31:6800/168281188 20 ==== osd_op_reply(77 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24a8051070 con 0x7f24a4017050 2024-09-22T08:36:45.607 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.593+0000 7f24b1a19640 1 -- 172.21.15.142:0/1319999315 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:78 8.1 8:80000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55828ce3b8c0 con 0x7f24a4017050 2024-09-22T08:36:45.607 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.593+0000 7f24b1a19640 1 -- 172.21.15.142:0/1319999315 <== osd.0 v2:172.21.15.31:6800/168281188 21 ==== osd_op_reply(78 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24a8051070 con 0x7f24a4017050 2024-09-22T08:36:45.607 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.593+0000 7f24b1a19640 1 -- 172.21.15.142:0/1319999315 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:79 8.11 8:88000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55828ce3b8c0 con 0x55828ce33670 2024-09-22T08:36:45.607 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.593+0000 7f24b2a1b640 1 -- 172.21.15.142:0/1319999315 <== osd.3 v2:172.21.15.142:6800/1064901393 22 ==== osd_op_reply(79 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24ac053020 con 0x55828ce33670 2024-09-22T08:36:45.607 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.593+0000 7f24b2a1b640 1 -- 172.21.15.142:0/1319999315 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:80 8.9 8:90000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55828ce3b8c0 con 0x7f24ac058040 2024-09-22T08:36:45.607 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.594+0000 7f24b221a640 1 -- 172.21.15.142:0/1319999315 <== osd.2 v2:172.21.15.142:6808/279438927 13 ==== osd_op_reply(80 [pgnls start_epoch 30 out=70b] v30'2 uv2 ondisk = 1) ==== 144+0+70 (crc 0 0 0) 0x7f24a40187b0 con 0x7f24ac058040 2024-09-22T08:36:45.607 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.594+0000 7f24b221a640 1 -- 172.21.15.142:0/1319999315 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:81 8.19 8:98000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55828ce3b8c0 con 0x55828ce2ec60 2024-09-22T08:36:45.607 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.594+0000 7f24b1a19640 1 -- 172.21.15.142:0/1319999315 <== osd.1 v2:172.21.15.142:6816/3192108003 25 ==== osd_op_reply(81 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24a8051070 con 0x55828ce2ec60 2024-09-22T08:36:45.607 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.594+0000 7f24b1a19640 1 -- 172.21.15.142:0/1319999315 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:82 8.5 8:a0000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55828ce3b8c0 con 0x55828ce2ec60 2024-09-22T08:36:45.608 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.594+0000 7f24b1a19640 1 -- 172.21.15.142:0/1319999315 <== osd.1 v2:172.21.15.142:6816/3192108003 26 ==== osd_op_reply(82 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24a8051070 con 0x55828ce2ec60 2024-09-22T08:36:45.608 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.594+0000 7f24b1a19640 1 -- 172.21.15.142:0/1319999315 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:83 8.15 8:a8000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55828ce3b8c0 con 0x55828ce33670 2024-09-22T08:36:45.608 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.594+0000 7f24b2a1b640 1 -- 172.21.15.142:0/1319999315 <== osd.3 v2:172.21.15.142:6800/1064901393 23 ==== osd_op_reply(83 [pgnls start_epoch 30 out=127b] v30'1 uv1 ondisk = 1) ==== 144+0+127 (crc 0 0 0) 0x7f24ac053020 con 0x55828ce33670 2024-09-22T08:36:45.608 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.594+0000 7f24b2a1b640 1 -- 172.21.15.142:0/1319999315 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:84 8.d 8:b0000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55828ce3b8c0 con 0x7f24ac058040 2024-09-22T08:36:45.608 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.594+0000 7f24b221a640 1 -- 172.21.15.142:0/1319999315 <== osd.2 v2:172.21.15.142:6808/279438927 14 ==== osd_op_reply(84 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24a40187b0 con 0x7f24ac058040 2024-09-22T08:36:45.608 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.594+0000 7f24b221a640 1 -- 172.21.15.142:0/1319999315 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:85 8.1d 8:b8000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55828ce3b8c0 con 0x7f24a4017050 2024-09-22T08:36:45.608 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.595+0000 7f24b1a19640 1 -- 172.21.15.142:0/1319999315 <== osd.0 v2:172.21.15.31:6800/168281188 22 ==== osd_op_reply(85 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24a8051070 con 0x7f24a4017050 2024-09-22T08:36:45.608 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.595+0000 7f24b1a19640 1 -- 172.21.15.142:0/1319999315 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:86 8.3 8:c0000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55828ce3b8c0 con 0x55828ce2ec60 2024-09-22T08:36:45.608 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.595+0000 7f24b1a19640 1 -- 172.21.15.142:0/1319999315 <== osd.1 v2:172.21.15.142:6816/3192108003 27 ==== osd_op_reply(86 [pgnls start_epoch 30 out=49b] v30'1 uv1 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24a8051070 con 0x55828ce2ec60 2024-09-22T08:36:45.608 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.595+0000 7f24b1a19640 1 -- 172.21.15.142:0/1319999315 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:87 8.13 8:c8000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55828ce3b8c0 con 0x7f24a4017050 2024-09-22T08:36:45.608 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.595+0000 7f24b1a19640 1 -- 172.21.15.142:0/1319999315 <== osd.0 v2:172.21.15.31:6800/168281188 23 ==== osd_op_reply(87 [pgnls start_epoch 30 out=49b] v30'2 uv2 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24a8051070 con 0x7f24a4017050 2024-09-22T08:36:45.608 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.595+0000 7f24b1a19640 1 -- 172.21.15.142:0/1319999315 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:88 8.b 8:d0000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55828ce3b8c0 con 0x55828ce33670 2024-09-22T08:36:45.608 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.595+0000 7f24b2a1b640 1 -- 172.21.15.142:0/1319999315 <== osd.3 v2:172.21.15.142:6800/1064901393 24 ==== osd_op_reply(88 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24ac053020 con 0x55828ce33670 2024-09-22T08:36:45.609 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.595+0000 7f24b2a1b640 1 -- 172.21.15.142:0/1319999315 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:89 8.1b 8:d8000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55828ce3b8c0 con 0x7f24ac058040 2024-09-22T08:36:45.609 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.596+0000 7f24b221a640 1 -- 172.21.15.142:0/1319999315 <== osd.2 v2:172.21.15.142:6808/279438927 15 ==== osd_op_reply(89 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24a40187b0 con 0x7f24ac058040 2024-09-22T08:36:45.609 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.596+0000 7f24b221a640 1 -- 172.21.15.142:0/1319999315 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:90 8.7 8:e0000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55828ce3b8c0 con 0x7f24a4017050 2024-09-22T08:36:45.609 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.596+0000 7f24b1a19640 1 -- 172.21.15.142:0/1319999315 <== osd.0 v2:172.21.15.31:6800/168281188 24 ==== osd_op_reply(90 [pgnls start_epoch 30 out=49b] v30'1 uv1 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24a8051070 con 0x7f24a4017050 2024-09-22T08:36:45.609 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.596+0000 7f24b1a19640 1 -- 172.21.15.142:0/1319999315 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:91 8.17 8:e8000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55828ce3b8c0 con 0x55828ce2ec60 2024-09-22T08:36:45.609 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.596+0000 7f24b1a19640 1 -- 172.21.15.142:0/1319999315 <== osd.1 v2:172.21.15.142:6816/3192108003 28 ==== osd_op_reply(91 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24a8051070 con 0x55828ce2ec60 2024-09-22T08:36:45.609 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.596+0000 7f24b1a19640 1 -- 172.21.15.142:0/1319999315 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:92 8.f 8:f0000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55828ce3b8c0 con 0x55828ce33670 2024-09-22T08:36:45.609 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.596+0000 7f24b2a1b640 1 -- 172.21.15.142:0/1319999315 <== osd.3 v2:172.21.15.142:6800/1064901393 25 ==== osd_op_reply(92 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24ac053020 con 0x55828ce33670 2024-09-22T08:36:45.609 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.596+0000 7f24b2a1b640 1 -- 172.21.15.142:0/1319999315 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:93 8.1f 8:f8000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55828ce3b8c0 con 0x7f24ac058040 2024-09-22T08:36:45.609 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.597+0000 7f24b221a640 1 -- 172.21.15.142:0/1319999315 <== osd.2 v2:172.21.15.142:6808/279438927 16 ==== osd_op_reply(93 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24a40187b0 con 0x7f24ac058040 2024-09-22T08:36:45.609 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.597+0000 7f24b6a0e800 20 RGWRados::pool_iterate: got myfoo 2024-09-22T08:36:45.609 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.597+0000 7f24b6a0e800 20 RGWRados::pool_iterate: got .bucket.meta.myfoo:e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1 2024-09-22T08:36:45.609 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.597+0000 7f23697e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:36:45.610 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.597+0000 7f24b6a0e800 1 -- 172.21.15.142:0/1319999315 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94019197873680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55828ce3a5c0 con 0x55828ce2ec60 2024-09-22T08:36:45.610 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.598+0000 7f24b1a19640 1 -- 172.21.15.142:0/1319999315 <== osd.1 v2:172.21.15.142:6816/3192108003 29 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94019197873680] v30'95 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f24a8051070 con 0x55828ce2ec60 2024-09-22T08:36:45.610 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.598+0000 7f24b6a0e800 1 -- 172.21.15.142:0/1319999315 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94019197835440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55828ce38290 con 0x7f24ac058040 2024-09-22T08:36:45.610 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.599+0000 7f24b221a640 1 -- 172.21.15.142:0/1319999315 <== osd.2 v2:172.21.15.142:6808/279438927 17 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94019197835440] v30'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24a40187b0 con 0x7f24ac058040 2024-09-22T08:36:45.610 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.599+0000 7f24b6a0e800 20 remove_watcher() i=0 2024-09-22T08:36:45.610 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.599+0000 7f24b6a0e800 2 removed watcher, disabling cache 2024-09-22T08:36:45.610 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.599+0000 7f24b6a0e800 1 -- 172.21.15.142:0/1319999315 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94019197841440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55828ce38290 con 0x55828ce2ec60 2024-09-22T08:36:45.610 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.601+0000 7f24b1a19640 1 -- 172.21.15.142:0/1319999315 <== osd.1 v2:172.21.15.142:6816/3192108003 30 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94019197841440] v30'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24a8051070 con 0x55828ce2ec60 2024-09-22T08:36:45.610 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.601+0000 7f24b6a0e800 20 remove_watcher() i=1 2024-09-22T08:36:45.610 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.601+0000 7f24b6a0e800 1 -- 172.21.15.142:0/1319999315 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94019197845216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55828ce38290 con 0x55828ce33670 2024-09-22T08:36:45.614 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.602+0000 7f24b2a1b640 1 -- 172.21.15.142:0/1319999315 <== osd.3 v2:172.21.15.142:6800/1064901393 26 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94019197845216] v30'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24ac053020 con 0x55828ce33670 2024-09-22T08:36:45.614 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.602+0000 7f24b6a0e800 20 remove_watcher() i=2 2024-09-22T08:36:45.614 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.602+0000 7f24b6a0e800 1 -- 172.21.15.142:0/1319999315 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94019197847424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55828ce74080 con 0x7f24ac058040 2024-09-22T08:36:45.614 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.603+0000 7f24b221a640 1 -- 172.21.15.142:0/1319999315 <== osd.2 v2:172.21.15.142:6808/279438927 18 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94019197847424] v30'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24a40187b0 con 0x7f24ac058040 2024-09-22T08:36:45.615 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.603+0000 7f24b6a0e800 20 remove_watcher() i=3 2024-09-22T08:36:45.615 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.603+0000 7f24b6a0e800 1 -- 172.21.15.142:0/1319999315 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94019197851488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55828ce74080 con 0x55828ce2ec60 2024-09-22T08:36:45.615 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.604+0000 7f24b1a19640 1 -- 172.21.15.142:0/1319999315 <== osd.1 v2:172.21.15.142:6816/3192108003 31 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94019197851488] v30'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24a8051070 con 0x55828ce2ec60 2024-09-22T08:36:45.615 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.604+0000 7f24b6a0e800 20 remove_watcher() i=4 2024-09-22T08:36:45.615 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.604+0000 7f24b6a0e800 1 -- 172.21.15.142:0/1319999315 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94019197855264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55828ce74080 con 0x7f24a4017050 2024-09-22T08:36:45.615 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.605+0000 7f24b1a19640 1 -- 172.21.15.142:0/1319999315 <== osd.0 v2:172.21.15.31:6800/168281188 25 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94019197855264] v30'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24a8051070 con 0x7f24a4017050 2024-09-22T08:36:45.615 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.605+0000 7f24b6a0e800 20 remove_watcher() i=5 2024-09-22T08:36:45.615 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.605+0000 7f24b6a0e800 1 -- 172.21.15.142:0/1319999315 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94019197857472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55828ce74080 con 0x7f24a4017050 2024-09-22T08:36:45.615 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.606+0000 7f24b1a19640 1 -- 172.21.15.142:0/1319999315 <== osd.0 v2:172.21.15.31:6800/168281188 26 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94019197857472] v30'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24a8051070 con 0x7f24a4017050 2024-09-22T08:36:45.615 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.606+0000 7f24b6a0e800 20 remove_watcher() i=6 2024-09-22T08:36:45.615 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.606+0000 7f24b6a0e800 1 -- 172.21.15.142:0/1319999315 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94019197853648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55828ce74080 con 0x7f24a4017050 2024-09-22T08:36:45.615 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.607+0000 7f24b1a19640 1 -- 172.21.15.142:0/1319999315 <== osd.0 v2:172.21.15.31:6800/168281188 27 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94019197853648] v30'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24a8051070 con 0x7f24a4017050 2024-09-22T08:36:45.615 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.607+0000 7f24b6a0e800 20 remove_watcher() i=7 2024-09-22T08:36:45.616 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.607+0000 7f24b6a0e800 1 -- 172.21.15.142:0/1319999315 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f24a4017050 msgr2=0x7f24a403e0e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:45.616 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.607+0000 7f24b6a0e800 1 --2- 172.21.15.142:0/1319999315 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f24a4017050 0x7f24a403e0e0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:45.616 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.607+0000 7f24b6a0e800 1 -- 172.21.15.142:0/1319999315 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55828ce2ec60 msgr2=0x55828ce31120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:45.616 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.607+0000 7f24b6a0e800 1 --2- 172.21.15.142:0/1319999315 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55828ce2ec60 0x55828ce31120 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:45.616 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.607+0000 7f24b6a0e800 1 -- 172.21.15.142:0/1319999315 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f24ac058040 msgr2=0x7f24ac03d7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:45.616 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.607+0000 7f24b6a0e800 1 --2- 172.21.15.142:0/1319999315 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f24ac058040 0x7f24ac03d7f0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:45.616 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.607+0000 7f24b6a0e800 1 -- 172.21.15.142:0/1319999315 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55828ce33670 msgr2=0x55828ce35a60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:45.616 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.607+0000 7f24b6a0e800 1 --2- 172.21.15.142:0/1319999315 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55828ce33670 0x55828ce35a60 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:45.616 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.607+0000 7f24b6a0e800 1 -- 172.21.15.142:0/1319999315 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f237c03d000 msgr2=0x7f237c03f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:45.616 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.607+0000 7f24b6a0e800 1 --2- 172.21.15.142:0/1319999315 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f237c03d000 0x7f237c03f4c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f24a4001b10 tx=0x7f24a4047000 comp rx=0 tx=0).stop 2024-09-22T08:36:45.616 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.607+0000 7f24b6a0e800 1 -- 172.21.15.142:0/1319999315 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55828ce1bd90 msgr2=0x55828ce233a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:45.616 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.607+0000 7f24b1a19640 1 -- 172.21.15.142:0/1319999315 reap_dead start 2024-09-22T08:36:45.616 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.607+0000 7f24b6a0e800 1 --2- 172.21.15.142:0/1319999315 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55828ce1bd90 0x55828ce233a0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f24ac020560 tx=0x7f24ac054770 comp rx=0 tx=0).stop 2024-09-22T08:36:45.616 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.607+0000 7f24b6a0e800 1 -- 172.21.15.142:0/1319999315 shutdown_connections 2024-09-22T08:36:45.617 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.607+0000 7f24b6a0e800 1 --2- 172.21.15.142:0/1319999315 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55828ce1bd90 0x55828ce233a0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:45.617 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.607+0000 7f24b6a0e800 1 -- 172.21.15.142:0/1319999315 >> 172.21.15.142:0/1319999315 conn(0x55828ce18190 msgr2=0x55828ce163a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:45.617 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.607+0000 7f24b6a0e800 1 -- 172.21.15.142:0/1319999315 shutdown_connections 2024-09-22T08:36:45.617 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.607+0000 7f24b6a0e800 1 -- 172.21.15.142:0/1319999315 wait complete. 2024-09-22T08:36:45.617 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.607+0000 7f24b6a0e800 1 -- 172.21.15.142:0/2591553013 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f238c03d000 msgr2=0x7f238c03f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:45.617 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.607+0000 7f24b6a0e800 1 --2- 172.21.15.142:0/2591553013 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f238c03d000 0x7f238c03f4c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x55828cdfc050 tx=0x7f24a404d040 comp rx=0 tx=0).stop 2024-09-22T08:36:45.617 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.607+0000 7f24b6a0e800 1 -- 172.21.15.142:0/2591553013 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55828ce0f310 msgr2=0x55828ce0f730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:45.617 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.607+0000 7f24b6a0e800 1 --2- 172.21.15.142:0/2591553013 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55828ce0f310 0x55828ce0f730 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x55828cdf4e30 tx=0x7f24ac0167b0 comp rx=0 tx=0).stop 2024-09-22T08:36:45.617 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.607+0000 7f24b6a0e800 1 -- 172.21.15.142:0/2591553013 shutdown_connections 2024-09-22T08:36:45.617 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.607+0000 7f24b6a0e800 1 --2- 172.21.15.142:0/2591553013 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f238c03d000 0x7f238c03f4c0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:45.617 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.607+0000 7f24b6a0e800 1 --2- 172.21.15.142:0/2591553013 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55828ce0f310 0x55828ce0f730 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:45.617 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.607+0000 7f24b6a0e800 1 -- 172.21.15.142:0/2591553013 >> 172.21.15.142:0/2591553013 conn(0x55828ce036c0 msgr2=0x55828ce03aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:45.617 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.608+0000 7f24b6a0e800 1 -- 172.21.15.142:0/2591553013 shutdown_connections 2024-09-22T08:36:45.618 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.608+0000 7f24b6a0e800 1 -- 172.21.15.142:0/2591553013 wait complete. 2024-09-22T08:36:45.618 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.608+0000 7f24b6a0e800 1 -- 172.21.15.142:0/3791594092 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55828cdf5cb0 msgr2=0x55828cdfb5f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:45.618 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.608+0000 7f24b6a0e800 1 --2- 172.21.15.142:0/3791594092 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55828cdf5cb0 0x55828cdfb5f0 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:45.618 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.608+0000 7f24b6a0e800 1 -- 172.21.15.142:0/3791594092 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55828cdfdeb0 msgr2=0x55828ce002a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:45.618 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.608+0000 7f24b6a0e800 1 --2- 172.21.15.142:0/3791594092 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55828cdfdeb0 0x55828ce002a0 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:45.618 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.608+0000 7f24b6a0e800 1 -- 172.21.15.142:0/3791594092 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f239803cfb0 msgr2=0x7f239803f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:45.618 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.608+0000 7f24b6a0e800 1 --2- 172.21.15.142:0/3791594092 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f239803cfb0 0x7f239803f470 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f24a8057000 tx=0x7f24a8052000 comp rx=0 tx=0).stop 2024-09-22T08:36:45.618 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.608+0000 7f24b6a0e800 1 -- 172.21.15.142:0/3791594092 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55828cd00be0 msgr2=0x55828cdf3fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:45.618 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.608+0000 7f24b6a0e800 1 --2- 172.21.15.142:0/3791594092 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55828cd00be0 0x55828cdf3fa0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f24a400c010 tx=0x7f24a4000ed0 comp rx=0 tx=0).stop 2024-09-22T08:36:45.618 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.608+0000 7f24b6a0e800 1 -- 172.21.15.142:0/3791594092 shutdown_connections 2024-09-22T08:36:45.618 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.608+0000 7f24b6a0e800 1 --2- 172.21.15.142:0/3791594092 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55828cdfdeb0 0x55828ce002a0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:45.618 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.608+0000 7f24b6a0e800 1 --2- 172.21.15.142:0/3791594092 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55828cdf5cb0 0x55828cdfb5f0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:45.618 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.608+0000 7f24b6a0e800 1 --2- 172.21.15.142:0/3791594092 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f239803cfb0 0x7f239803f470 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:45.619 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.608+0000 7f24b6a0e800 1 --2- 172.21.15.142:0/3791594092 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55828cd00be0 0x55828cdf3fa0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:45.619 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.608+0000 7f24b6a0e800 1 -- 172.21.15.142:0/3791594092 >> 172.21.15.142:0/3791594092 conn(0x55828ccf4ba0 msgr2=0x55828cded710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:45.619 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.608+0000 7f24b6a0e800 1 -- 172.21.15.142:0/3791594092 shutdown_connections 2024-09-22T08:36:45.619 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.608+0000 7f24b6a0e800 1 -- 172.21.15.142:0/3791594092 wait complete. 2024-09-22T08:36:45.620 INFO:teuthology.orchestra.run.smithi142.stdout:["myfoo"] 2024-09-22T08:36:45.620 DEBUG:tasks.util.rgw: json result: ['myfoo'] 2024-09-22T08:36:45.632 INFO:tasks.radosgw_admin:RL: create_bucket myfoo2 foo bytes_out=0 bytes_in=0 failed=False 2024-09-22T08:36:45.644 INFO:tasks.radosgw_admin:RL: create_bucket myfoo3 foo bytes_out=0 bytes_in=0 failed=False 2024-09-22T08:36:45.657 INFO:tasks.radosgw_admin:RL: create_bucket myfoo4 foo bytes_out=0 bytes_in=0 failed=False 2024-09-22T08:36:45.707 INFO:tasks.radosgw_admin:RL: create_bucket myfoo5 foo bytes_out=0 bytes_in=237 failed=True 2024-09-22T08:36:45.738 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo2 foo bytes_out=0 bytes_in=0 failed=False 2024-09-22T08:36:45.765 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo3 foo bytes_out=0 bytes_in=0 failed=False 2024-09-22T08:36:45.792 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo4 foo bytes_out=0 bytes_in=0 failed=False 2024-09-22T08:36:45.792 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--bucket', 'myfoo'] 2024-09-22T08:36:45.792 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--bucket', 'myfoo'] 2024-09-22T08:36:45.793 DEBUG:teuthology.orchestra.run.smithi142:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --bucket myfoo 2024-09-22T08:36:45.837 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:36:45.837 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:36:45.838 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.836+0000 7f685a922800 1 Processor -- start 2024-09-22T08:36:45.838 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.836+0000 7f685a922800 1 -- start start 2024-09-22T08:36:45.838 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.836+0000 7f685a922800 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55a947b767e0 0x55a947b774e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:45.838 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.837+0000 7f685a922800 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55a947a02a20 con 0x55a947b77a20 2024-09-22T08:36:45.838 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.837+0000 7f685a922800 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x55a947a027d0 con 0x55a947b767e0 2024-09-22T08:36:45.838 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.837+0000 7f68565d2640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55a947b767e0 0x55a947b774e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:45.839 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.837+0000 7f6855dd1640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x55a947b77a20 0x55a947b7c570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.142:42502/0 (socket says 172.21.15.142:42502) 2024-09-22T08:36:45.839 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.837+0000 7f6855dd1640 1 -- 172.21.15.142:0/1989004364 learned_addr learned my addr 172.21.15.142:0/1989004364 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-09-22T08:36:45.839 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.837+0000 7f68565d2640 1 -- 172.21.15.142:0/1989004364 >> v1:172.21.15.31:6789/0 conn(0x55a947b77a20 legacy=0x55a947b7c570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:45.839 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.837+0000 7f68565d2640 1 -- 172.21.15.142:0/1989004364 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a947b76ee0 con 0x55a947b767e0 2024-09-22T08:36:45.840 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.839+0000 7f68565d2640 1 --2- 172.21.15.142:0/1989004364 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a947b767e0 0x55a947b774e0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f684800a600 tx=0x7f6848047cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5537ced3b0f9a34b server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:45.840 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.839+0000 7f68555d0640 1 -- 172.21.15.142:0/1989004364 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6848056070 con 0x55a947b767e0 2024-09-22T08:36:45.840 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.839+0000 7f68555d0640 1 -- 172.21.15.142:0/1989004364 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f684800a200 con 0x55a947b767e0 2024-09-22T08:36:45.840 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.839+0000 7f68555d0640 1 -- 172.21.15.142:0/1989004364 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6848008590 con 0x55a947b767e0 2024-09-22T08:36:45.841 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.839+0000 7f685a922800 1 -- 172.21.15.142:0/1989004364 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a947b767e0 msgr2=0x55a947b774e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:45.841 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.839+0000 7f685a922800 1 --2- 172.21.15.142:0/1989004364 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a947b767e0 0x55a947b774e0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f684800a600 tx=0x7f6848047cb0 comp rx=0 tx=0).stop 2024-09-22T08:36:45.841 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.840+0000 7f685a922800 1 -- 172.21.15.142:0/1989004364 shutdown_connections 2024-09-22T08:36:45.841 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.840+0000 7f685a922800 1 --2- 172.21.15.142:0/1989004364 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a947b767e0 0x55a947b774e0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:45.841 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.840+0000 7f685a922800 1 -- 172.21.15.142:0/1989004364 >> 172.21.15.142:0/1989004364 conn(0x55a947b71bb0 msgr2=0x55a947b74010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:45.841 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.840+0000 7f685a922800 1 -- 172.21.15.142:0/1989004364 shutdown_connections 2024-09-22T08:36:45.841 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.840+0000 7f685a922800 1 -- 172.21.15.142:0/1989004364 wait complete. 2024-09-22T08:36:45.855 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.853+0000 7f685a922800 1 Processor -- start 2024-09-22T08:36:45.855 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.853+0000 7f685a922800 1 -- start start 2024-09-22T08:36:45.855 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.853+0000 7f685a922800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a947b767e0 0x55a947c64e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:45.855 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.853+0000 7f685a922800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55a947a0fdd0 con 0x55a947b767e0 2024-09-22T08:36:45.855 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.853+0000 7f68565d2640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a947b767e0 0x55a947c64e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:45.855 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.854+0000 7f68565d2640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a947b767e0 0x55a947c64e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:39140/0 (socket says 172.21.15.142:39140) 2024-09-22T08:36:45.855 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.854+0000 7f68565d2640 1 -- 172.21.15.142:0/3809453930 learned_addr learned my addr 172.21.15.142:0/3809453930 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:45.855 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.854+0000 7f68565d2640 1 -- 172.21.15.142:0/3809453930 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a947c653f0 con 0x55a947b767e0 2024-09-22T08:36:45.855 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.854+0000 7f68565d2640 1 --2- 172.21.15.142:0/3809453930 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a947b767e0 0x55a947c64e00 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f6848027ae0 tx=0x7f6848053000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d6898b3a660b043 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:45.858 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.854+0000 7f6744608640 1 -- 172.21.15.142:0/3809453930 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68480088b0 con 0x55a947b767e0 2024-09-22T08:36:45.858 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.854+0000 7f6744608640 1 -- 172.21.15.142:0/3809453930 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6848008a50 con 0x55a947b767e0 2024-09-22T08:36:45.858 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.854+0000 7f6744608640 1 -- 172.21.15.142:0/3809453930 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6848008d30 con 0x55a947b767e0 2024-09-22T08:36:45.858 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.855+0000 7f685a922800 1 -- 172.21.15.142:0/3809453930 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a947b767e0 msgr2=0x55a947c64e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:45.858 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.855+0000 7f685a922800 1 --2- 172.21.15.142:0/3809453930 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a947b767e0 0x55a947c64e00 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f6848027ae0 tx=0x7f6848053000 comp rx=0 tx=0).stop 2024-09-22T08:36:45.858 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.855+0000 7f685a922800 1 -- 172.21.15.142:0/3809453930 shutdown_connections 2024-09-22T08:36:45.858 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.855+0000 7f685a922800 1 --2- 172.21.15.142:0/3809453930 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a947b767e0 0x55a947c64e00 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:45.858 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.855+0000 7f685a922800 1 -- 172.21.15.142:0/3809453930 >> 172.21.15.142:0/3809453930 conn(0x55a947b71bb0 msgr2=0x55a947c60780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:45.858 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.855+0000 7f685a922800 1 -- 172.21.15.142:0/3809453930 shutdown_connections 2024-09-22T08:36:45.858 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.855+0000 7f685a922800 1 -- 172.21.15.142:0/3809453930 wait complete. 2024-09-22T08:36:45.859 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.855+0000 7f685a922800 1 Processor -- start 2024-09-22T08:36:45.859 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.855+0000 7f685a922800 1 -- start start 2024-09-22T08:36:45.859 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.856+0000 7f685a922800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a947b767e0 0x55a947c70bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:45.859 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.856+0000 7f685a922800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55a947b78290 con 0x55a947b767e0 2024-09-22T08:36:45.859 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.856+0000 7f68565d2640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a947b767e0 0x55a947c70bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:45.859 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.856+0000 7f68565d2640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a947b767e0 0x55a947c70bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:39152/0 (socket says 172.21.15.142:39152) 2024-09-22T08:36:45.859 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.856+0000 7f68565d2640 1 -- 172.21.15.142:0/3931410608 learned_addr learned my addr 172.21.15.142:0/3931410608 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:45.859 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.856+0000 7f68565d2640 1 -- 172.21.15.142:0/3931410608 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a947c71150 con 0x55a947b767e0 2024-09-22T08:36:45.859 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.856+0000 7f68565d2640 1 --2- 172.21.15.142:0/3931410608 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a947b767e0 0x55a947c70bf0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f684800a1d0 tx=0x7f6848002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:45.859 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.857+0000 7f6742e05640 1 -- 172.21.15.142:0/3931410608 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6848051660 con 0x55a947b767e0 2024-09-22T08:36:45.859 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.857+0000 7f6742e05640 1 -- 172.21.15.142:0/3931410608 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6848051820 con 0x55a947b767e0 2024-09-22T08:36:45.859 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.857+0000 7f685a922800 1 -- 172.21.15.142:0/3931410608 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a947c713e0 con 0x55a947b767e0 2024-09-22T08:36:45.859 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.857+0000 7f6742e05640 1 -- 172.21.15.142:0/3931410608 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6848051b40 con 0x55a947b767e0 2024-09-22T08:36:45.859 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.857+0000 7f685a922800 1 -- 172.21.15.142:0/3931410608 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a947c71de0 con 0x55a947b767e0 2024-09-22T08:36:45.863 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.857+0000 7f6742e05640 1 -- 172.21.15.142:0/3931410608 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f6848059070 con 0x55a947b767e0 2024-09-22T08:36:45.863 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.858+0000 7f6742e05640 1 --2- 172.21.15.142:0/3931410608 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f673c03cfb0 0x7f673c03f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:45.863 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.858+0000 7f6742e05640 1 -- 172.21.15.142:0/3931410608 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f6848062070 con 0x55a947b767e0 2024-09-22T08:36:45.863 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.858+0000 7f6855dd1640 1 --2- 172.21.15.142:0/3931410608 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f673c03cfb0 0x7f673c03f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:45.863 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.858+0000 7f685a922800 1 --2- 172.21.15.142:0/3931410608 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55a947b77a20 0x55a947c78240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:45.863 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.858+0000 7f685a922800 1 -- 172.21.15.142:0/3931410608 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a947c78780 con 0x55a947b77a20 2024-09-22T08:36:45.863 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.858+0000 7f6856dd3640 1 --2- 172.21.15.142:0/3931410608 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55a947b77a20 0x55a947c78240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:45.863 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.858+0000 7f6855dd1640 1 --2- 172.21.15.142:0/3931410608 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f673c03cfb0 0x7f673c03f470 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f684c001d70 tx=0x7f684c0012d0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:45.863 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.858+0000 7f6856dd3640 1 --2- 172.21.15.142:0/3931410608 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55a947b77a20 0x55a947c78240 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:45.863 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.859+0000 7f6856dd3640 1 -- 172.21.15.142:0/3931410608 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f685000a4d0 con 0x55a947b77a20 2024-09-22T08:36:45.863 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.859+0000 7f685a922800 1 -- 172.21.15.142:0/3931410608 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a947c78b20 con 0x55a947b77a20 2024-09-22T08:36:45.864 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.859+0000 7f6856dd3640 1 -- 172.21.15.142:0/3931410608 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f685000a4d0 con 0x55a947b77a20 2024-09-22T08:36:45.864 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.859+0000 7f685a922800 1 --2- 172.21.15.142:0/3931410608 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55a947c7a620 0x55a947c7caa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:45.864 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.859+0000 7f685a922800 1 -- 172.21.15.142:0/3931410608 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:3 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a947c7d230 con 0x55a947c7a620 2024-09-22T08:36:45.864 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.859+0000 7f68565d2640 1 --2- 172.21.15.142:0/3931410608 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55a947c7a620 0x55a947c7caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:45.864 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.859+0000 7f68565d2640 1 --2- 172.21.15.142:0/3931410608 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55a947c7a620 0x55a947c7caa0 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:45.864 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.859+0000 7f68565d2640 1 -- 172.21.15.142:0/3931410608 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(3 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f6848076020 con 0x55a947c7a620 2024-09-22T08:36:45.864 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.860+0000 7f685a922800 1 -- 172.21.15.142:0/3931410608 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a947c79370 con 0x55a947b77a20 2024-09-22T08:36:45.864 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.860+0000 7f6856dd3640 1 -- 172.21.15.142:0/3931410608 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f685000a4d0 con 0x55a947b77a20 2024-09-22T08:36:45.864 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.860+0000 7f685a922800 1 -- 172.21.15.142:0/3931410608 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a947c797c0 con 0x55a947c7a620 2024-09-22T08:36:45.864 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.860+0000 7f68565d2640 1 -- 172.21.15.142:0/3931410608 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(5 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f6848076020 con 0x55a947c7a620 2024-09-22T08:36:45.864 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.860+0000 7f685a922800 1 Processor -- start 2024-09-22T08:36:45.864 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.860+0000 7f685a922800 1 -- start start 2024-09-22T08:36:45.864 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.861+0000 7f685a922800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a947c8bb00 0x55a947c8bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:45.865 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.861+0000 7f685a922800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55a947a6ed50 con 0x55a947c8bb00 2024-09-22T08:36:45.865 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.861+0000 7f6856dd3640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a947c8bb00 0x55a947c8bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:45.865 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.861+0000 7f6856dd3640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a947c8bb00 0x55a947c8bf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:39154/0 (socket says 172.21.15.142:39154) 2024-09-22T08:36:45.865 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.861+0000 7f6856dd3640 1 -- 172.21.15.142:0/1251463826 learned_addr learned my addr 172.21.15.142:0/1251463826 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:45.865 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.861+0000 7f6856dd3640 1 -- 172.21.15.142:0/1251463826 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a947c8c560 con 0x55a947c8bb00 2024-09-22T08:36:45.865 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.861+0000 7f6856dd3640 1 --2- 172.21.15.142:0/1251463826 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a947c8bb00 0x55a947c8bf20 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x55a947c71bf0 tx=0x7f68500167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:45.865 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.861+0000 7f673bfff640 1 -- 172.21.15.142:0/1251463826 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6850013640 con 0x55a947c8bb00 2024-09-22T08:36:45.865 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.861+0000 7f673bfff640 1 -- 172.21.15.142:0/1251463826 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68500137e0 con 0x55a947c8bb00 2024-09-22T08:36:45.865 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.861+0000 7f685a922800 1 -- 172.21.15.142:0/1251463826 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a947c8cd90 con 0x55a947c8bb00 2024-09-22T08:36:45.865 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.861+0000 7f673bfff640 1 -- 172.21.15.142:0/1251463826 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6850013ae0 con 0x55a947c8bb00 2024-09-22T08:36:45.865 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.862+0000 7f685a922800 1 -- 172.21.15.142:0/1251463826 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a947c8d330 con 0x55a947c8bb00 2024-09-22T08:36:45.872 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.862+0000 7f673bfff640 1 -- 172.21.15.142:0/1251463826 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f6850011040 con 0x55a947c8bb00 2024-09-22T08:36:45.872 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.862+0000 7f673bfff640 1 --2- 172.21.15.142:0/1251463826 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f673003d000 0x7f673003f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:45.872 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.863+0000 7f673bfff640 1 -- 172.21.15.142:0/1251463826 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f685000e040 con 0x55a947c8bb00 2024-09-22T08:36:45.873 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.863+0000 7f68565d2640 1 --2- 172.21.15.142:0/1251463826 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f673003d000 0x7f673003f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:45.873 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.863+0000 7f685a922800 1 Processor -- start 2024-09-22T08:36:45.873 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.863+0000 7f68565d2640 1 --2- 172.21.15.142:0/1251463826 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f673003d000 0x7f673003f4c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f6848000c00 tx=0x7f684805bf00 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:45.873 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.863+0000 7f685a922800 1 -- start start 2024-09-22T08:36:45.873 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.863+0000 7f685a922800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a947c98560 0x55a947c98960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:45.873 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.863+0000 7f685a922800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55a947c65760 con 0x55a947c98560 2024-09-22T08:36:45.873 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.863+0000 7f6856dd3640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a947c98560 0x55a947c98960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:45.873 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.863+0000 7f6856dd3640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a947c98560 0x55a947c98960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:39158/0 (socket says 172.21.15.142:39158) 2024-09-22T08:36:45.873 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.863+0000 7f6856dd3640 1 -- 172.21.15.142:0/1416718804 learned_addr learned my addr 172.21.15.142:0/1416718804 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:45.873 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.864+0000 7f6856dd3640 1 -- 172.21.15.142:0/1416718804 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a947c98f50 con 0x55a947c98560 2024-09-22T08:36:45.873 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.864+0000 7f6856dd3640 1 --2- 172.21.15.142:0/1416718804 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a947c98560 0x55a947c98960 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f68500547f0 tx=0x7f68500206e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=666febb9e1fbc170 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:45.873 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.864+0000 7f6739ffb640 1 -- 172.21.15.142:0/1416718804 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6850044030 con 0x55a947c98560 2024-09-22T08:36:45.874 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.864+0000 7f6739ffb640 1 -- 172.21.15.142:0/1416718804 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6850021960 con 0x55a947c98560 2024-09-22T08:36:45.874 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.864+0000 7f6739ffb640 1 -- 172.21.15.142:0/1416718804 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f685001f340 con 0x55a947c98560 2024-09-22T08:36:45.874 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.864+0000 7f685a922800 1 -- 172.21.15.142:0/1416718804 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a947c98560 msgr2=0x55a947c98960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:45.874 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.864+0000 7f685a922800 1 --2- 172.21.15.142:0/1416718804 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a947c98560 0x55a947c98960 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f68500547f0 tx=0x7f68500206e0 comp rx=0 tx=0).stop 2024-09-22T08:36:45.874 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.864+0000 7f685a922800 1 -- 172.21.15.142:0/1416718804 shutdown_connections 2024-09-22T08:36:45.874 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.864+0000 7f685a922800 1 --2- 172.21.15.142:0/1416718804 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a947c98560 0x55a947c98960 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:45.874 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.864+0000 7f685a922800 1 -- 172.21.15.142:0/1416718804 >> 172.21.15.142:0/1416718804 conn(0x55a947c94980 msgr2=0x55a947c92bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:45.874 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.864+0000 7f685a922800 1 -- 172.21.15.142:0/1416718804 shutdown_connections 2024-09-22T08:36:45.874 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.864+0000 7f685a922800 1 -- 172.21.15.142:0/1416718804 wait complete. 2024-09-22T08:36:45.874 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.865+0000 7f685a922800 1 Processor -- start 2024-09-22T08:36:45.874 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.865+0000 7f685a922800 1 -- start start 2024-09-22T08:36:45.874 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.865+0000 7f685a922800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a947c98560 0x55a947c9fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:45.874 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.865+0000 7f685a922800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55a947c99570 con 0x55a947c98560 2024-09-22T08:36:45.874 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.865+0000 7f6856dd3640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a947c98560 0x55a947c9fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:45.875 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.865+0000 7f6856dd3640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a947c98560 0x55a947c9fb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:39174/0 (socket says 172.21.15.142:39174) 2024-09-22T08:36:45.875 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.865+0000 7f6856dd3640 1 -- 172.21.15.142:0/191912376 learned_addr learned my addr 172.21.15.142:0/191912376 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:45.875 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.865+0000 7f6856dd3640 1 -- 172.21.15.142:0/191912376 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a947ca00d0 con 0x55a947c98560 2024-09-22T08:36:45.875 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.866+0000 7f6856dd3640 1 --2- 172.21.15.142:0/191912376 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a947c98560 0x55a947c9fb70 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f6850022ff0 tx=0x7f6850054780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:45.875 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.866+0000 7f6727fff640 1 -- 172.21.15.142:0/191912376 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68500459c0 con 0x55a947c98560 2024-09-22T08:36:45.875 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.866+0000 7f6727fff640 1 -- 172.21.15.142:0/191912376 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6850045b80 con 0x55a947c98560 2024-09-22T08:36:45.875 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.866+0000 7f685a922800 1 -- 172.21.15.142:0/191912376 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a947ca0360 con 0x55a947c98560 2024-09-22T08:36:45.875 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.866+0000 7f6727fff640 1 -- 172.21.15.142:0/191912376 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6850045130 con 0x55a947c98560 2024-09-22T08:36:45.875 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.866+0000 7f685a922800 1 -- 172.21.15.142:0/191912376 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a947ca0ef0 con 0x55a947c98560 2024-09-22T08:36:45.875 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.866+0000 7f6727fff640 1 -- 172.21.15.142:0/191912376 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f68500452d0 con 0x55a947c98560 2024-09-22T08:36:45.875 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.867+0000 7f6727fff640 1 --2- 172.21.15.142:0/191912376 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f672003d000 0x7f672003f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:45.875 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.867+0000 7f6727fff640 1 -- 172.21.15.142:0/191912376 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f6850017450 con 0x55a947c98560 2024-09-22T08:36:45.875 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.867+0000 7f68565d2640 1 --2- 172.21.15.142:0/191912376 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f672003d000 0x7f672003f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:45.875 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.867+0000 7f685a922800 20 rados->read ofs=0 len=0 2024-09-22T08:36:45.876 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.867+0000 7f685a922800 1 --2- 172.21.15.142:0/191912376 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55a947cab410 0x55a947cad8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:45.876 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.867+0000 7f685a922800 1 -- 172.21.15.142:0/191912376 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a947cae020 con 0x55a947cab410 2024-09-22T08:36:45.876 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.867+0000 7f6855dd1640 1 --2- 172.21.15.142:0/191912376 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55a947cab410 0x55a947cad8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:45.876 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.867+0000 7f68565d2640 1 --2- 172.21.15.142:0/191912376 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f672003d000 0x7f672003f4c0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f6848008970 tx=0x7f684808d000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:45.876 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.867+0000 7f6855dd1640 1 --2- 172.21.15.142:0/191912376 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55a947cab410 0x55a947cad8d0 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:45.876 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.868+0000 7f6855dd1640 1 -- 172.21.15.142:0/191912376 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f684c009050 con 0x55a947cab410 2024-09-22T08:36:45.876 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.868+0000 7f685a922800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:45.876 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.868+0000 7f685a922800 20 realm 2024-09-22T08:36:45.876 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.868+0000 7f685a922800 20 rados->read ofs=0 len=0 2024-09-22T08:36:45.876 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.868+0000 7f685a922800 1 -- 172.21.15.142:0/191912376 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a947caa760 con 0x55a947cab410 2024-09-22T08:36:45.876 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.868+0000 7f6855dd1640 1 -- 172.21.15.142:0/191912376 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f684c009050 con 0x55a947cab410 2024-09-22T08:36:45.876 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.868+0000 7f685a922800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:45.876 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.868+0000 7f685a922800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:36:45.877 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.868+0000 7f685a922800 20 rados->read ofs=0 len=0 2024-09-22T08:36:45.877 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.868+0000 7f685a922800 1 -- 172.21.15.142:0/191912376 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a947caeb00 con 0x55a947cab410 2024-09-22T08:36:45.877 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.868+0000 7f6855dd1640 1 -- 172.21.15.142:0/191912376 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f684c009050 con 0x55a947cab410 2024-09-22T08:36:45.877 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.868+0000 7f685a922800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:45.877 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.868+0000 7f685a922800 20 rados->read ofs=0 len=0 2024-09-22T08:36:45.877 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.868+0000 7f685a922800 1 -- 172.21.15.142:0/191912376 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a947caf3d0 con 0x55a947cab410 2024-09-22T08:36:45.877 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.868+0000 7f6855dd1640 1 -- 172.21.15.142:0/191912376 <== osd.1 v2:172.21.15.142:6816/3192108003 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f684c009050 con 0x55a947cab410 2024-09-22T08:36:45.877 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.868+0000 7f685a922800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:36:45.877 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.868+0000 7f685a922800 20 rados->read ofs=0 len=0 2024-09-22T08:36:45.877 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.868+0000 7f685a922800 1 --2- 172.21.15.142:0/191912376 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55a947cafd10 0x55a947cb2100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:45.877 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.868+0000 7f685a922800 1 -- 172.21.15.142:0/191912376 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a947cb2840 con 0x55a947cafd10 2024-09-22T08:36:45.877 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.868+0000 7f6856dd3640 1 --2- 172.21.15.142:0/191912376 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55a947cafd10 0x55a947cb2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:45.877 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.869+0000 7f6856dd3640 1 --2- 172.21.15.142:0/191912376 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55a947cafd10 0x55a947cb2100 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:45.877 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.869+0000 7f6856dd3640 1 -- 172.21.15.142:0/191912376 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(5 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f6850053020 con 0x55a947cafd10 2024-09-22T08:36:45.878 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.869+0000 7f685a922800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:36:45.878 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.869+0000 7f685a922800 20 searching for the correct realm 2024-09-22T08:36:45.878 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.869+0000 7f685a922800 1 -- 172.21.15.142:0/191912376 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a947cb41f0 con 0x55a947cafd10 2024-09-22T08:36:45.878 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.869+0000 7f6856dd3640 1 -- 172.21.15.142:0/191912376 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6850053020 con 0x55a947cafd10 2024-09-22T08:36:45.878 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.869+0000 7f6856dd3640 1 --2- 172.21.15.142:0/191912376 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f6850012a50 0x7f685003d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:45.878 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.869+0000 7f6856dd3640 1 -- 172.21.15.142:0/191912376 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a947cb41f0 con 0x7f6850012a50 2024-09-22T08:36:45.878 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.869+0000 7f68565d2640 1 --2- 172.21.15.142:0/191912376 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f6850012a50 0x7f685003d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:45.878 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.870+0000 7f68565d2640 1 --2- 172.21.15.142:0/191912376 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f6850012a50 0x7f685003d7f0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:45.878 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.870+0000 7f68565d2640 1 -- 172.21.15.142:0/191912376 <== osd.2 v2:172.21.15.142:6808/279438927 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6848076020 con 0x7f6850012a50 2024-09-22T08:36:45.878 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.870+0000 7f68565d2640 1 --2- 172.21.15.142:0/191912376 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f684805b070 0x7f6848066460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:45.878 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.870+0000 7f68565d2640 1 -- 172.21.15.142:0/191912376 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a947cb41f0 con 0x7f684805b070 2024-09-22T08:36:45.878 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.870+0000 7f6855dd1640 1 --2- 172.21.15.142:0/191912376 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f684805b070 0x7f6848066460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:45.878 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.871+0000 7f6855dd1640 1 --2- 172.21.15.142:0/191912376 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f684805b070 0x7f6848066460 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:45.879 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.871+0000 7f6855dd1640 1 -- 172.21.15.142:0/191912376 <== osd.0 v2:172.21.15.31:6800/168281188 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f684c009050 con 0x7f684805b070 2024-09-22T08:36:45.879 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.871+0000 7f6855dd1640 1 -- 172.21.15.142:0/191912376 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a947cb41f0 con 0x55a947cab410 2024-09-22T08:36:45.879 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.871+0000 7f6855dd1640 1 -- 172.21.15.142:0/191912376 <== osd.1 v2:172.21.15.142:6816/3192108003 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f684c009050 con 0x55a947cab410 2024-09-22T08:36:45.879 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.871+0000 7f6855dd1640 1 -- 172.21.15.142:0/191912376 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a947cb41f0 con 0x55a947cab410 2024-09-22T08:36:45.879 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.871+0000 7f6855dd1640 1 -- 172.21.15.142:0/191912376 <== osd.1 v2:172.21.15.142:6816/3192108003 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f684c029040 con 0x55a947cab410 2024-09-22T08:36:45.879 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.871+0000 7f6855dd1640 1 -- 172.21.15.142:0/191912376 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a947cb41f0 con 0x7f684805b070 2024-09-22T08:36:45.887 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.872+0000 7f6855dd1640 1 -- 172.21.15.142:0/191912376 <== osd.0 v2:172.21.15.31:6800/168281188 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f684c029040 con 0x7f684805b070 2024-09-22T08:36:45.887 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.872+0000 7f6855dd1640 1 -- 172.21.15.142:0/191912376 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a947cb41f0 con 0x7f684805b070 2024-09-22T08:36:45.887 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.872+0000 7f6855dd1640 1 -- 172.21.15.142:0/191912376 <== osd.0 v2:172.21.15.31:6800/168281188 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f684c029040 con 0x7f684805b070 2024-09-22T08:36:45.887 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.872+0000 7f6855dd1640 1 -- 172.21.15.142:0/191912376 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a947cb41f0 con 0x7f6850012a50 2024-09-22T08:36:45.887 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.872+0000 7f68565d2640 1 -- 172.21.15.142:0/191912376 <== osd.2 v2:172.21.15.142:6808/279438927 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6848076020 con 0x7f6850012a50 2024-09-22T08:36:45.888 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.872+0000 7f68565d2640 1 -- 172.21.15.142:0/191912376 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a947cb41f0 con 0x55a947cafd10 2024-09-22T08:36:45.888 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.873+0000 7f6856dd3640 1 -- 172.21.15.142:0/191912376 <== osd.3 v2:172.21.15.142:6800/1064901393 3 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6850053020 con 0x55a947cafd10 2024-09-22T08:36:45.888 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.873+0000 7f6856dd3640 1 -- 172.21.15.142:0/191912376 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a947cb41f0 con 0x55a947cab410 2024-09-22T08:36:45.888 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.873+0000 7f6855dd1640 1 -- 172.21.15.142:0/191912376 <== osd.1 v2:172.21.15.142:6816/3192108003 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f684c029040 con 0x55a947cab410 2024-09-22T08:36:45.888 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.873+0000 7f6855dd1640 1 -- 172.21.15.142:0/191912376 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a947cb41f0 con 0x7f684805b070 2024-09-22T08:36:45.888 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.873+0000 7f6855dd1640 1 -- 172.21.15.142:0/191912376 <== osd.0 v2:172.21.15.31:6800/168281188 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f684c029040 con 0x7f684805b070 2024-09-22T08:36:45.888 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.873+0000 7f6855dd1640 1 -- 172.21.15.142:0/191912376 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a947cb41f0 con 0x55a947cab410 2024-09-22T08:36:45.888 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.873+0000 7f6855dd1640 1 -- 172.21.15.142:0/191912376 <== osd.1 v2:172.21.15.142:6816/3192108003 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f684c029040 con 0x55a947cab410 2024-09-22T08:36:45.888 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.873+0000 7f6855dd1640 1 -- 172.21.15.142:0/191912376 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a947cb41f0 con 0x7f6850012a50 2024-09-22T08:36:45.888 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.874+0000 7f68565d2640 1 -- 172.21.15.142:0/191912376 <== osd.2 v2:172.21.15.142:6808/279438927 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f6848076020 con 0x7f6850012a50 2024-09-22T08:36:45.888 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.874+0000 7f68565d2640 1 -- 172.21.15.142:0/191912376 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a947cb41f0 con 0x55a947cafd10 2024-09-22T08:36:45.888 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.874+0000 7f6856dd3640 1 -- 172.21.15.142:0/191912376 <== osd.3 v2:172.21.15.142:6800/1064901393 4 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6850053020 con 0x55a947cafd10 2024-09-22T08:36:45.888 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.874+0000 7f6856dd3640 1 -- 172.21.15.142:0/191912376 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a947cb41f0 con 0x55a947cafd10 2024-09-22T08:36:45.888 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.874+0000 7f6856dd3640 1 -- 172.21.15.142:0/191912376 <== osd.3 v2:172.21.15.142:6800/1064901393 5 ==== osd_op_reply(20 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f6850053020 con 0x55a947cafd10 2024-09-22T08:36:45.889 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.874+0000 7f6856dd3640 1 -- 172.21.15.142:0/191912376 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a947cb41f0 con 0x7f684805b070 2024-09-22T08:36:45.889 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.874+0000 7f6855dd1640 1 -- 172.21.15.142:0/191912376 <== osd.0 v2:172.21.15.31:6800/168281188 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f684c029040 con 0x7f684805b070 2024-09-22T08:36:45.889 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.874+0000 7f6855dd1640 1 -- 172.21.15.142:0/191912376 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a947cb41f0 con 0x55a947cafd10 2024-09-22T08:36:45.889 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.875+0000 7f6856dd3640 1 -- 172.21.15.142:0/191912376 <== osd.3 v2:172.21.15.142:6800/1064901393 6 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6850053020 con 0x55a947cafd10 2024-09-22T08:36:45.889 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.875+0000 7f6856dd3640 1 -- 172.21.15.142:0/191912376 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a947cb41f0 con 0x55a947cafd10 2024-09-22T08:36:45.889 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.875+0000 7f6856dd3640 1 -- 172.21.15.142:0/191912376 <== osd.3 v2:172.21.15.142:6800/1064901393 7 ==== osd_op_reply(23 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f6850053020 con 0x55a947cafd10 2024-09-22T08:36:45.889 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.875+0000 7f6856dd3640 1 -- 172.21.15.142:0/191912376 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a947cb41f0 con 0x55a947cab410 2024-09-22T08:36:45.889 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.875+0000 7f6855dd1640 1 -- 172.21.15.142:0/191912376 <== osd.1 v2:172.21.15.142:6816/3192108003 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f684c029040 con 0x55a947cab410 2024-09-22T08:36:45.889 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.875+0000 7f6855dd1640 1 -- 172.21.15.142:0/191912376 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a947cb41f0 con 0x55a947cab410 2024-09-22T08:36:45.889 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.875+0000 7f6855dd1640 1 -- 172.21.15.142:0/191912376 <== osd.1 v2:172.21.15.142:6816/3192108003 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f684c029040 con 0x55a947cab410 2024-09-22T08:36:45.889 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.875+0000 7f6855dd1640 1 -- 172.21.15.142:0/191912376 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a947cb41f0 con 0x7f684805b070 2024-09-22T08:36:45.889 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.876+0000 7f6855dd1640 1 -- 172.21.15.142:0/191912376 <== osd.0 v2:172.21.15.31:6800/168281188 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f684c029040 con 0x7f684805b070 2024-09-22T08:36:45.889 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.876+0000 7f6855dd1640 1 -- 172.21.15.142:0/191912376 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a947cb41f0 con 0x55a947cafd10 2024-09-22T08:36:45.890 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.876+0000 7f6856dd3640 1 -- 172.21.15.142:0/191912376 <== osd.3 v2:172.21.15.142:6800/1064901393 8 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6850053020 con 0x55a947cafd10 2024-09-22T08:36:45.890 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.876+0000 7f6856dd3640 1 -- 172.21.15.142:0/191912376 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a947cb41f0 con 0x7f6850012a50 2024-09-22T08:36:45.890 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.876+0000 7f68565d2640 1 -- 172.21.15.142:0/191912376 <== osd.2 v2:172.21.15.142:6808/279438927 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6848076020 con 0x7f6850012a50 2024-09-22T08:36:45.890 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.876+0000 7f68565d2640 1 -- 172.21.15.142:0/191912376 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a947cb41f0 con 0x55a947cab410 2024-09-22T08:36:45.890 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.876+0000 7f6855dd1640 1 -- 172.21.15.142:0/191912376 <== osd.1 v2:172.21.15.142:6816/3192108003 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f684c029040 con 0x55a947cab410 2024-09-22T08:36:45.890 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.876+0000 7f6855dd1640 1 -- 172.21.15.142:0/191912376 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a947cb41f0 con 0x7f684805b070 2024-09-22T08:36:45.890 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.877+0000 7f6855dd1640 1 -- 172.21.15.142:0/191912376 <== osd.0 v2:172.21.15.31:6800/168281188 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f684c029040 con 0x7f684805b070 2024-09-22T08:36:45.890 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.877+0000 7f6855dd1640 1 -- 172.21.15.142:0/191912376 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a947cb41f0 con 0x55a947cafd10 2024-09-22T08:36:45.890 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.877+0000 7f6856dd3640 1 -- 172.21.15.142:0/191912376 <== osd.3 v2:172.21.15.142:6800/1064901393 9 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6850053020 con 0x55a947cafd10 2024-09-22T08:36:45.890 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.877+0000 7f6856dd3640 1 -- 172.21.15.142:0/191912376 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a947cb41f0 con 0x7f684805b070 2024-09-22T08:36:45.890 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.877+0000 7f6855dd1640 1 -- 172.21.15.142:0/191912376 <== osd.0 v2:172.21.15.31:6800/168281188 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f684c029040 con 0x7f684805b070 2024-09-22T08:36:45.890 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.877+0000 7f6855dd1640 1 -- 172.21.15.142:0/191912376 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a947cb41f0 con 0x7f6850012a50 2024-09-22T08:36:45.890 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.877+0000 7f68565d2640 1 -- 172.21.15.142:0/191912376 <== osd.2 v2:172.21.15.142:6808/279438927 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6848076020 con 0x7f6850012a50 2024-09-22T08:36:45.891 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.877+0000 7f68565d2640 1 -- 172.21.15.142:0/191912376 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a947cb41f0 con 0x55a947cafd10 2024-09-22T08:36:45.891 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.878+0000 7f6856dd3640 1 -- 172.21.15.142:0/191912376 <== osd.3 v2:172.21.15.142:6800/1064901393 10 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6850053020 con 0x55a947cafd10 2024-09-22T08:36:45.891 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.878+0000 7f6856dd3640 1 -- 172.21.15.142:0/191912376 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a947cb41f0 con 0x7f684805b070 2024-09-22T08:36:45.891 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.878+0000 7f6855dd1640 1 -- 172.21.15.142:0/191912376 <== osd.0 v2:172.21.15.31:6800/168281188 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f684c029040 con 0x7f684805b070 2024-09-22T08:36:45.891 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.878+0000 7f6855dd1640 1 -- 172.21.15.142:0/191912376 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a947cb41f0 con 0x55a947cab410 2024-09-22T08:36:45.891 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.878+0000 7f6855dd1640 1 -- 172.21.15.142:0/191912376 <== osd.1 v2:172.21.15.142:6816/3192108003 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f684c029040 con 0x55a947cab410 2024-09-22T08:36:45.891 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.878+0000 7f6855dd1640 1 -- 172.21.15.142:0/191912376 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a947cb41f0 con 0x7f6850012a50 2024-09-22T08:36:45.891 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.878+0000 7f68565d2640 1 -- 172.21.15.142:0/191912376 <== osd.2 v2:172.21.15.142:6808/279438927 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6848076020 con 0x7f6850012a50 2024-09-22T08:36:45.891 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.878+0000 7f685a922800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:36:45.891 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.879+0000 7f685a922800 20 RGWRados::pool_iterate: got zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec 2024-09-22T08:36:45.891 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.879+0000 7f685a922800 20 RGWRados::pool_iterate: got zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f 2024-09-22T08:36:45.891 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.879+0000 7f685a922800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:36:45.891 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.879+0000 7f685a922800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:36:45.891 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.879+0000 7f685a922800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:36:45.892 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.879+0000 7f685a922800 20 rados->read ofs=0 len=0 2024-09-22T08:36:45.892 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.879+0000 7f685a922800 1 -- 172.21.15.142:0/191912376 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a947cb32c0 con 0x55a947cab410 2024-09-22T08:36:45.892 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.879+0000 7f6855dd1640 1 -- 172.21.15.142:0/191912376 <== osd.1 v2:172.21.15.142:6816/3192108003 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f684c029040 con 0x55a947cab410 2024-09-22T08:36:45.892 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.879+0000 7f685a922800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:45.892 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.879+0000 7f685a922800 20 rados->read ofs=0 len=0 2024-09-22T08:36:45.892 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.879+0000 7f685a922800 1 -- 172.21.15.142:0/191912376 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a947cb3b60 con 0x55a947cab410 2024-09-22T08:36:45.892 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.879+0000 7f6855dd1640 1 -- 172.21.15.142:0/191912376 <== osd.1 v2:172.21.15.142:6816/3192108003 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f684c029040 con 0x55a947cab410 2024-09-22T08:36:45.892 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.879+0000 7f685a922800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:36:45.892 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.879+0000 7f685a922800 20 rados->read ofs=0 len=0 2024-09-22T08:36:45.892 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.879+0000 7f685a922800 1 -- 172.21.15.142:0/191912376 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:40 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a947cb2f00 con 0x55a947cafd10 2024-09-22T08:36:45.892 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.879+0000 7f6856dd3640 1 -- 172.21.15.142:0/191912376 <== osd.3 v2:172.21.15.142:6800/1064901393 11 ==== osd_op_reply(40 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f6850053020 con 0x55a947cafd10 2024-09-22T08:36:45.892 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.879+0000 7f685a922800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:36:45.892 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.879+0000 7f685a922800 20 zone default found 2024-09-22T08:36:45.892 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.879+0000 7f685a922800 4 Realm: () 2024-09-22T08:36:45.893 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.879+0000 7f685a922800 4 ZoneGroup: default (d89f6f57-1007-47dd-9065-f486c7b01aec) 2024-09-22T08:36:45.893 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.879+0000 7f685a922800 4 Zone: default (e239248c-0bee-4e41-803a-24b288d3eb8f) 2024-09-22T08:36:45.893 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.879+0000 7f685a922800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:36:45.893 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.879+0000 7f685a922800 20 zonegroup default 2024-09-22T08:36:45.893 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.879+0000 7f685a922800 20 rados->read ofs=0 len=0 2024-09-22T08:36:45.893 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.879+0000 7f685a922800 1 -- 172.21.15.142:0/191912376 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a947cb3790 con 0x7f684805b070 2024-09-22T08:36:45.893 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.880+0000 7f6855dd1640 1 -- 172.21.15.142:0/191912376 <== osd.0 v2:172.21.15.31:6800/168281188 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f684c029040 con 0x7f684805b070 2024-09-22T08:36:45.893 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.880+0000 7f685a922800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:45.893 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.880+0000 7f685a922800 20 rados->read ofs=0 len=0 2024-09-22T08:36:45.893 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.880+0000 7f685a922800 1 -- 172.21.15.142:0/191912376 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a947cb6a90 con 0x55a947cafd10 2024-09-22T08:36:45.893 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.880+0000 7f6856dd3640 1 -- 172.21.15.142:0/191912376 <== osd.3 v2:172.21.15.142:6800/1064901393 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6850053020 con 0x55a947cafd10 2024-09-22T08:36:45.893 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.880+0000 7f685a922800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:45.893 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.880+0000 7f685a922800 20 rados->read ofs=0 len=0 2024-09-22T08:36:45.893 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.880+0000 7f685a922800 1 -- 172.21.15.142:0/191912376 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a947cb6e30 con 0x55a947cafd10 2024-09-22T08:36:45.894 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.880+0000 7f6856dd3640 1 -- 172.21.15.142:0/191912376 <== osd.3 v2:172.21.15.142:6800/1064901393 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6850053020 con 0x55a947cafd10 2024-09-22T08:36:45.894 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.880+0000 7f685a922800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:45.894 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.880+0000 7f685a922800 20 started sync module instance, tier type = 2024-09-22T08:36:45.894 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.880+0000 7f685a922800 20 started zone id=e239248c-0bee-4e41-803a-24b288d3eb8f (name=default) with tier type = 2024-09-22T08:36:45.894 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.880+0000 7f685a922800 1 -- 172.21.15.142:0/191912376 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a947cb5f20 con 0x7f6850012a50 2024-09-22T08:36:45.894 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.881+0000 7f68565d2640 1 -- 172.21.15.142:0/191912376 <== osd.2 v2:172.21.15.142:6808/279438927 7 ==== osd_op_reply(44 notify.0 [create] v30'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6848076020 con 0x7f6850012a50 2024-09-22T08:36:45.894 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.881+0000 7f685a922800 1 -- 172.21.15.142:0/191912376 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94185542345488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a947cb7710 con 0x7f6850012a50 2024-09-22T08:36:45.894 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.881+0000 7f685a922800 1 -- 172.21.15.142:0/191912376 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a947cb7f60 con 0x55a947cab410 2024-09-22T08:36:45.894 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.882+0000 7f68565d2640 1 -- 172.21.15.142:0/191912376 <== osd.2 v2:172.21.15.142:6808/279438927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94185542345488] v30'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6848076020 con 0x7f6850012a50 2024-09-22T08:36:45.894 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.883+0000 7f6855dd1640 1 -- 172.21.15.142:0/191912376 <== osd.1 v2:172.21.15.142:6816/3192108003 15 ==== osd_op_reply(46 notify.1 [create] v30'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f684c029040 con 0x55a947cab410 2024-09-22T08:36:45.894 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.883+0000 7f685a922800 1 -- 172.21.15.142:0/191912376 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94185542351536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a947cb8380 con 0x55a947cab410 2024-09-22T08:36:45.894 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.883+0000 7f685a922800 1 -- 172.21.15.142:0/191912376 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a947cb8bd0 con 0x55a947cafd10 2024-09-22T08:36:45.894 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.884+0000 7f6855dd1640 1 -- 172.21.15.142:0/191912376 <== osd.1 v2:172.21.15.142:6816/3192108003 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94185542351536] v30'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f684c029040 con 0x55a947cab410 2024-09-22T08:36:45.895 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.884+0000 7f6856dd3640 1 -- 172.21.15.142:0/191912376 <== osd.3 v2:172.21.15.142:6800/1064901393 14 ==== osd_op_reply(48 notify.2 [create] v30'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6850053020 con 0x55a947cafd10 2024-09-22T08:36:45.895 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.884+0000 7f685a922800 1 -- 172.21.15.142:0/191912376 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94185542353072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a947cb8ac0 con 0x55a947cafd10 2024-09-22T08:36:45.895 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.884+0000 7f685a922800 1 -- 172.21.15.142:0/191912376 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a947cb95b0 con 0x7f6850012a50 2024-09-22T08:36:45.895 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.885+0000 7f6856dd3640 1 -- 172.21.15.142:0/191912376 <== osd.3 v2:172.21.15.142:6800/1064901393 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94185542353072] v30'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6850053020 con 0x55a947cafd10 2024-09-22T08:36:45.895 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.885+0000 7f68565d2640 1 -- 172.21.15.142:0/191912376 <== osd.2 v2:172.21.15.142:6808/279438927 9 ==== osd_op_reply(50 notify.3 [create] v30'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6848076020 con 0x7f6850012a50 2024-09-22T08:36:45.895 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.885+0000 7f685a922800 1 -- 172.21.15.142:0/191912376 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94185542357120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a947cb9950 con 0x7f6850012a50 2024-09-22T08:36:45.895 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.885+0000 7f685a922800 1 -- 172.21.15.142:0/191912376 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a947cba400 con 0x55a947cab410 2024-09-22T08:36:45.895 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.886+0000 7f68565d2640 1 -- 172.21.15.142:0/191912376 <== osd.2 v2:172.21.15.142:6808/279438927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94185542357120] v30'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6848076020 con 0x7f6850012a50 2024-09-22T08:36:45.895 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.886+0000 7f6855dd1640 1 -- 172.21.15.142:0/191912376 <== osd.1 v2:172.21.15.142:6816/3192108003 17 ==== osd_op_reply(52 notify.4 [create] v30'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f684c029040 con 0x55a947cab410 2024-09-22T08:36:45.895 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.886+0000 7f685a922800 1 -- 172.21.15.142:0/191912376 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94185542354192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a947cba400 con 0x55a947cab410 2024-09-22T08:36:45.895 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.886+0000 7f685a922800 1 -- 172.21.15.142:0/191912376 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a947cbaeb0 con 0x7f684805b070 2024-09-22T08:36:45.901 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.887+0000 7f6855dd1640 1 -- 172.21.15.142:0/191912376 <== osd.0 v2:172.21.15.31:6800/168281188 11 ==== osd_op_reply(54 notify.5 [create] v30'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f684c029040 con 0x7f684805b070 2024-09-22T08:36:45.902 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.887+0000 7f685a922800 1 -- 172.21.15.142:0/191912376 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94185542363536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a947cbaeb0 con 0x7f684805b070 2024-09-22T08:36:45.902 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.887+0000 7f685a922800 1 -- 172.21.15.142:0/191912376 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a947cbbea0 con 0x7f684805b070 2024-09-22T08:36:45.902 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.887+0000 7f6855dd1640 1 -- 172.21.15.142:0/191912376 <== osd.1 v2:172.21.15.142:6816/3192108003 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94185542354192] v30'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f684c029040 con 0x55a947cab410 2024-09-22T08:36:45.902 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.888+0000 7f6855dd1640 1 -- 172.21.15.142:0/191912376 <== osd.0 v2:172.21.15.31:6800/168281188 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94185542363536] v30'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f684c029040 con 0x7f684805b070 2024-09-22T08:36:45.902 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.888+0000 7f6855dd1640 1 -- 172.21.15.142:0/191912376 <== osd.0 v2:172.21.15.31:6800/168281188 13 ==== osd_op_reply(56 notify.6 [create] v30'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f684c029040 con 0x7f684805b070 2024-09-22T08:36:45.902 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.888+0000 7f685a922800 1 -- 172.21.15.142:0/191912376 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94185542367600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a947cbbea0 con 0x7f684805b070 2024-09-22T08:36:45.902 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.888+0000 7f685a922800 1 -- 172.21.15.142:0/191912376 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a947cbc2f0 con 0x7f684805b070 2024-09-22T08:36:45.902 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.889+0000 7f6855dd1640 1 -- 172.21.15.142:0/191912376 <== osd.0 v2:172.21.15.31:6800/168281188 14 ==== osd_op_reply(58 notify.7 [create] v30'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f684c029040 con 0x7f684805b070 2024-09-22T08:36:45.902 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.889+0000 7f6855dd1640 1 -- 172.21.15.142:0/191912376 <== osd.0 v2:172.21.15.31:6800/168281188 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94185542367600] v30'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f684c029040 con 0x7f684805b070 2024-09-22T08:36:45.902 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.889+0000 7f685a922800 1 -- 172.21.15.142:0/191912376 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94185542365824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a947cbc760 con 0x7f684805b070 2024-09-22T08:36:45.902 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.889+0000 7f685a922800 20 add_watcher() i=0 2024-09-22T08:36:45.902 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.889+0000 7f685a922800 20 add_watcher() i=1 2024-09-22T08:36:45.902 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.889+0000 7f685a922800 20 add_watcher() i=2 2024-09-22T08:36:45.903 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.889+0000 7f685a922800 20 add_watcher() i=3 2024-09-22T08:36:45.903 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.889+0000 7f685a922800 20 add_watcher() i=4 2024-09-22T08:36:45.903 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.889+0000 7f685a922800 20 add_watcher() i=5 2024-09-22T08:36:45.903 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.889+0000 7f685a922800 20 add_watcher() i=6 2024-09-22T08:36:45.903 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.890+0000 7f6855dd1640 1 -- 172.21.15.142:0/191912376 <== osd.0 v2:172.21.15.31:6800/168281188 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94185542365824] v30'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f684c029040 con 0x7f684805b070 2024-09-22T08:36:45.903 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.890+0000 7f685a922800 20 add_watcher() i=7 2024-09-22T08:36:45.903 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.890+0000 7f685a922800 2 all 8 watchers are set, enabling cache 2024-09-22T08:36:45.903 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.890+0000 7f685a922800 1 -- 172.21.15.142:0/191912376 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a947cbfb80 con 0x55a947cab410 2024-09-22T08:36:45.903 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.890+0000 7f6855dd1640 1 -- 172.21.15.142:0/191912376 <== osd.1 v2:172.21.15.142:6816/3192108003 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f684c029040 con 0x55a947cab410 2024-09-22T08:36:45.903 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.890+0000 7f685a922800 1 -- 172.21.15.142:0/191912376 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94185542369968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a947cbd000 con 0x55a947cab410 2024-09-22T08:36:45.903 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.891+0000 7f6855dd1640 1 -- 172.21.15.142:0/191912376 <== osd.1 v2:172.21.15.142:6816/3192108003 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94185542369968] v30'96 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f684c029040 con 0x55a947cab410 2024-09-22T08:36:45.903 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.891+0000 7f670cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:36:45.903 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.892+0000 7f685a922800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:36:45.903 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.892+0000 7f685a922800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:36:45.904 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.892+0000 7f685a922800 5 note: GC not initialized 2024-09-22T08:36:45.904 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.892+0000 7f66877fe640 20 reqs_thread_entry: start 2024-09-22T08:36:45.904 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.892+0000 7f685a922800 20 init_complete bucket index max shards: 11 2024-09-22T08:36:45.904 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.892+0000 7f685a922800 20 Filter name: none 2024-09-22T08:36:45.904 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.892+0000 7f66857fa640 20 reqs_thread_entry: start 2024-09-22T08:36:45.904 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.892+0000 7f685a922800 20 rados->read ofs=0 len=0 2024-09-22T08:36:45.904 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.892+0000 7f685a922800 1 -- 172.21.15.142:0/191912376 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a947cf2c90 con 0x7f6850012a50 2024-09-22T08:36:45.904 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.893+0000 7f68565d2640 1 -- 172.21.15.142:0/191912376 <== osd.2 v2:172.21.15.142:6808/279438927 11 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f6848076020 con 0x7f6850012a50 2024-09-22T08:36:45.904 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.893+0000 7f685a922800 20 rados_obj.operate() r=0 bl.length=165 2024-09-22T08:36:45.904 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.893+0000 7f685a922800 20 rados->read ofs=0 len=0 2024-09-22T08:36:45.904 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.893+0000 7f685a922800 1 -- 172.21.15.142:0/191912376 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:63 8.15 8:ab67ca09:root::.bucket.meta.myfoo%3ae239248c-0bee-4e41-803a-24b288d3eb8f.4226.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a947cf3620 con 0x55a947cafd10 2024-09-22T08:36:45.904 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.893+0000 7f6856dd3640 1 -- 172.21.15.142:0/191912376 <== osd.3 v2:172.21.15.142:6800/1064901393 16 ==== osd_op_reply(63 .bucket.meta.myfoo:e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7f6850053020 con 0x55a947cafd10 2024-09-22T08:36:45.904 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.893+0000 7f685a922800 20 rados_obj.operate() r=0 bl.length=387 2024-09-22T08:36:45.905 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.893+0000 7f685a922800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:36:45.905 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.893+0000 7f685a922800 20 rados->read ofs=0 len=0 2024-09-22T08:36:45.905 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.893+0000 7f685a922800 1 -- 172.21.15.142:0/191912376 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a947cf35d0 con 0x7f6850012a50 2024-09-22T08:36:45.905 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.893+0000 7f68565d2640 1 -- 172.21.15.142:0/191912376 <== osd.2 v2:172.21.15.142:6808/279438927 12 ==== osd_op_reply(64 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f6848076020 con 0x7f6850012a50 2024-09-22T08:36:45.905 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.893+0000 7f685a922800 20 rados_obj.operate() r=0 bl.length=165 2024-09-22T08:36:45.905 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.893+0000 7f685a922800 20 rados->read ofs=0 len=0 2024-09-22T08:36:45.905 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.894+0000 7f685a922800 1 -- 172.21.15.142:0/191912376 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:65 8.15 8:ab67ca09:root::.bucket.meta.myfoo%3ae239248c-0bee-4e41-803a-24b288d3eb8f.4226.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a947cf35d0 con 0x55a947cafd10 2024-09-22T08:36:45.905 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.894+0000 7f6856dd3640 1 -- 172.21.15.142:0/191912376 <== osd.3 v2:172.21.15.142:6800/1064901393 17 ==== osd_op_reply(65 .bucket.meta.myfoo:e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7f6850053020 con 0x55a947cafd10 2024-09-22T08:36:45.905 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.894+0000 7f685a922800 20 rados_obj.operate() r=0 bl.length=387 2024-09-22T08:36:45.905 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.894+0000 7f685a922800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:36:45.905 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.894+0000 7f685a922800 1 -- 172.21.15.142:0/191912376 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:66 4.12 4:48caaf34:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a947cf6240 con 0x55a947cab410 2024-09-22T08:36:45.905 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.894+0000 7f685a922800 1 -- 172.21.15.142:0/191912376 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:67 4.10 4:09af3fe1:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a947cf8c30 con 0x55a947cafd10 2024-09-22T08:36:45.905 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.894+0000 7f685a922800 1 -- 172.21.15.142:0/191912376 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:68 4.12 4:49def6fa:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a947cfb590 con 0x55a947cab410 2024-09-22T08:36:45.905 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.894+0000 7f685a922800 1 -- 172.21.15.142:0/191912376 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:69 4.2 4:4255cd8e:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a947cfe050 con 0x55a947cab410 2024-09-22T08:36:45.906 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.894+0000 7f685a922800 1 -- 172.21.15.142:0/191912376 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:70 4.c 4:323d0659:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a947d00940 con 0x55a947cab410 2024-09-22T08:36:45.906 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.894+0000 7f685a922800 1 -- 172.21.15.142:0/191912376 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:71 4.20 4:061d9e92:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a947d03360 con 0x55a947cab410 2024-09-22T08:36:45.906 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.894+0000 7f685a922800 1 -- 172.21.15.142:0/191912376 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:72 4.3b 4:dc8435be:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a947d05d20 con 0x55a947cafd10 2024-09-22T08:36:45.906 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.894+0000 7f685a922800 1 -- 172.21.15.142:0/191912376 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:73 4.22 4:44b3b4fd:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a947d08590 con 0x55a947cab410 2024-09-22T08:36:45.906 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.894+0000 7f685a922800 1 -- 172.21.15.142:0/191912376 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:74 4.2d 4:b74eadf4:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a947d0b2b0 con 0x7f684805b070 2024-09-22T08:36:45.906 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.894+0000 7f685a922800 1 -- 172.21.15.142:0/191912376 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:75 4.12 4:4be25f13:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a947d0dd80 con 0x55a947cab410 2024-09-22T08:36:45.906 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.894+0000 7f685a922800 1 -- 172.21.15.142:0/191912376 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:76 4.5 4:a0e4e0ec:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a947d106b0 con 0x55a947cafd10 2024-09-22T08:36:45.906 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.894+0000 7f6856dd3640 1 -- 172.21.15.142:0/191912376 <== osd.3 v2:172.21.15.142:6800/1064901393 18 ==== osd_op_reply(67 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1.1 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f6850053020 con 0x55a947cafd10 2024-09-22T08:36:45.906 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.895+0000 7f6856dd3640 1 -- 172.21.15.142:0/191912376 <== osd.3 v2:172.21.15.142:6800/1064901393 19 ==== osd_op_reply(72 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1.6 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f6850053020 con 0x55a947cafd10 2024-09-22T08:36:45.906 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.895+0000 7f6856dd3640 1 -- 172.21.15.142:0/191912376 <== osd.3 v2:172.21.15.142:6800/1064901393 20 ==== osd_op_reply(76 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1.10 [call out=89b] v0'0 uv1 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f6850053020 con 0x55a947cafd10 2024-09-22T08:36:45.906 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.895+0000 7f6855dd1640 1 -- 172.21.15.142:0/191912376 <== osd.1 v2:172.21.15.142:6816/3192108003 21 ==== osd_op_reply(66 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1.0 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f684c029040 con 0x55a947cab410 2024-09-22T08:36:45.906 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.895+0000 7f6855dd1640 1 -- 172.21.15.142:0/191912376 <== osd.1 v2:172.21.15.142:6816/3192108003 22 ==== osd_op_reply(70 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1.4 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f684c029040 con 0x55a947cab410 2024-09-22T08:36:45.906 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.895+0000 7f6855dd1640 1 -- 172.21.15.142:0/191912376 <== osd.1 v2:172.21.15.142:6816/3192108003 23 ==== osd_op_reply(68 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1.2 [call out=89b] v0'0 uv2 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f684c029040 con 0x55a947cab410 2024-09-22T08:36:45.906 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.895+0000 7f6855dd1640 1 -- 172.21.15.142:0/191912376 <== osd.1 v2:172.21.15.142:6816/3192108003 24 ==== osd_op_reply(71 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1.5 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f684c029040 con 0x55a947cab410 2024-09-22T08:36:45.907 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.895+0000 7f6855dd1640 1 -- 172.21.15.142:0/191912376 <== osd.1 v2:172.21.15.142:6816/3192108003 25 ==== osd_op_reply(69 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1.3 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f684c029040 con 0x55a947cab410 2024-09-22T08:36:45.907 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.895+0000 7f6855dd1640 1 -- 172.21.15.142:0/191912376 <== osd.1 v2:172.21.15.142:6816/3192108003 26 ==== osd_op_reply(73 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1.7 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f684c029040 con 0x55a947cab410 2024-09-22T08:36:45.907 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.895+0000 7f6855dd1640 1 -- 172.21.15.142:0/191912376 <== osd.0 v2:172.21.15.31:6800/168281188 17 ==== osd_op_reply(74 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1.8 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f684c029040 con 0x7f684805b070 2024-09-22T08:36:45.907 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.895+0000 7f6855dd1640 1 -- 172.21.15.142:0/191912376 <== osd.1 v2:172.21.15.142:6816/3192108003 27 ==== osd_op_reply(75 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1.9 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f684c029040 con 0x55a947cab410 2024-09-22T08:36:45.907 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.896+0000 7f670cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:36:45.907 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.896+0000 7f685a922800 1 -- 172.21.15.142:0/191912376 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:77 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94185542369968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a947cf05f0 con 0x55a947cab410 2024-09-22T08:36:45.907 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.897+0000 7f6855dd1640 1 -- 172.21.15.142:0/191912376 <== osd.1 v2:172.21.15.142:6816/3192108003 28 ==== osd_op_reply(77 data_loggenerations_metadata [watch unwatch cookie 94185542369968] v30'97 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f684c029040 con 0x55a947cab410 2024-09-22T08:36:45.907 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.897+0000 7f685a922800 1 -- 172.21.15.142:0/191912376 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:78 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94185542345488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a947cf05f0 con 0x7f6850012a50 2024-09-22T08:36:45.907 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.898+0000 7f68565d2640 1 -- 172.21.15.142:0/191912376 <== osd.2 v2:172.21.15.142:6808/279438927 13 ==== osd_op_reply(78 notify.0 [watch unwatch cookie 94185542345488] v30'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68480b2040 con 0x7f6850012a50 2024-09-22T08:36:45.907 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.898+0000 7f685a922800 20 remove_watcher() i=0 2024-09-22T08:36:45.907 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.898+0000 7f685a922800 2 removed watcher, disabling cache 2024-09-22T08:36:45.907 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.898+0000 7f685a922800 1 -- 172.21.15.142:0/191912376 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:79 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94185542351536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a947cf05f0 con 0x55a947cab410 2024-09-22T08:36:45.908 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.899+0000 7f6855dd1640 1 -- 172.21.15.142:0/191912376 <== osd.1 v2:172.21.15.142:6816/3192108003 29 ==== osd_op_reply(79 notify.1 [watch unwatch cookie 94185542351536] v30'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f684c029040 con 0x55a947cab410 2024-09-22T08:36:45.908 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.899+0000 7f685a922800 20 remove_watcher() i=1 2024-09-22T08:36:45.908 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.899+0000 7f685a922800 1 -- 172.21.15.142:0/191912376 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:80 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94185542353072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a947cf05f0 con 0x55a947cafd10 2024-09-22T08:36:45.908 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.900+0000 7f6856dd3640 1 -- 172.21.15.142:0/191912376 <== osd.3 v2:172.21.15.142:6800/1064901393 21 ==== osd_op_reply(80 notify.2 [watch unwatch cookie 94185542353072] v30'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6850053020 con 0x55a947cafd10 2024-09-22T08:36:45.908 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.900+0000 7f685a922800 20 remove_watcher() i=2 2024-09-22T08:36:45.908 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.900+0000 7f685a922800 1 -- 172.21.15.142:0/191912376 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:81 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94185542357120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a947cf05f0 con 0x7f6850012a50 2024-09-22T08:36:45.912 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.901+0000 7f68565d2640 1 -- 172.21.15.142:0/191912376 <== osd.2 v2:172.21.15.142:6808/279438927 14 ==== osd_op_reply(81 notify.3 [watch unwatch cookie 94185542357120] v30'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68480b2040 con 0x7f6850012a50 2024-09-22T08:36:45.912 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.901+0000 7f685a922800 20 remove_watcher() i=3 2024-09-22T08:36:45.912 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.901+0000 7f685a922800 1 -- 172.21.15.142:0/191912376 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:82 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94185542354192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a947cf05f0 con 0x55a947cab410 2024-09-22T08:36:45.912 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.902+0000 7f6855dd1640 1 -- 172.21.15.142:0/191912376 <== osd.1 v2:172.21.15.142:6816/3192108003 30 ==== osd_op_reply(82 notify.4 [watch unwatch cookie 94185542354192] v30'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f684c029040 con 0x55a947cab410 2024-09-22T08:36:45.912 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.902+0000 7f685a922800 20 remove_watcher() i=4 2024-09-22T08:36:45.912 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.902+0000 7f685a922800 1 -- 172.21.15.142:0/191912376 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:83 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94185542363536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a947cf05f0 con 0x7f684805b070 2024-09-22T08:36:45.912 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.903+0000 7f6855dd1640 1 -- 172.21.15.142:0/191912376 <== osd.0 v2:172.21.15.31:6800/168281188 18 ==== osd_op_reply(83 notify.5 [watch unwatch cookie 94185542363536] v30'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f684c029040 con 0x7f684805b070 2024-09-22T08:36:45.912 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.903+0000 7f685a922800 20 remove_watcher() i=5 2024-09-22T08:36:45.912 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.903+0000 7f685a922800 1 -- 172.21.15.142:0/191912376 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:84 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94185542367600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a947cf05f0 con 0x7f684805b070 2024-09-22T08:36:45.912 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.904+0000 7f6855dd1640 1 -- 172.21.15.142:0/191912376 <== osd.0 v2:172.21.15.31:6800/168281188 19 ==== osd_op_reply(84 notify.6 [watch unwatch cookie 94185542367600] v30'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f684c029040 con 0x7f684805b070 2024-09-22T08:36:45.912 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.904+0000 7f685a922800 20 remove_watcher() i=6 2024-09-22T08:36:45.912 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.904+0000 7f685a922800 1 -- 172.21.15.142:0/191912376 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:85 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94185542365824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a947cf05f0 con 0x7f684805b070 2024-09-22T08:36:45.913 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.905+0000 7f6855dd1640 1 -- 172.21.15.142:0/191912376 <== osd.0 v2:172.21.15.31:6800/168281188 20 ==== osd_op_reply(85 notify.7 [watch unwatch cookie 94185542365824] v30'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f684c029040 con 0x7f684805b070 2024-09-22T08:36:45.913 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.905+0000 7f685a922800 20 remove_watcher() i=7 2024-09-22T08:36:45.913 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.905+0000 7f685a922800 1 -- 172.21.15.142:0/191912376 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f684805b070 msgr2=0x7f6848066460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:45.913 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.905+0000 7f685a922800 1 --2- 172.21.15.142:0/191912376 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f684805b070 0x7f6848066460 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:45.913 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.905+0000 7f685a922800 1 -- 172.21.15.142:0/191912376 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55a947cab410 msgr2=0x55a947cad8d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:45.913 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.905+0000 7f685a922800 1 --2- 172.21.15.142:0/191912376 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55a947cab410 0x55a947cad8d0 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:45.913 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.905+0000 7f685a922800 1 -- 172.21.15.142:0/191912376 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f6850012a50 msgr2=0x7f685003d7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:45.913 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.905+0000 7f685a922800 1 --2- 172.21.15.142:0/191912376 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f6850012a50 0x7f685003d7f0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:45.913 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.905+0000 7f685a922800 1 -- 172.21.15.142:0/191912376 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55a947cafd10 msgr2=0x55a947cb2100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:45.913 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.905+0000 7f685a922800 1 --2- 172.21.15.142:0/191912376 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55a947cafd10 0x55a947cb2100 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:45.913 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.905+0000 7f685a922800 1 -- 172.21.15.142:0/191912376 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f672003d000 msgr2=0x7f672003f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:45.913 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.905+0000 7f685a922800 1 --2- 172.21.15.142:0/191912376 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f672003d000 0x7f672003f4c0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f6848008970 tx=0x7f684808d000 comp rx=0 tx=0).stop 2024-09-22T08:36:45.913 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.905+0000 7f685a922800 1 -- 172.21.15.142:0/191912376 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a947c98560 msgr2=0x55a947c9fb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:45.913 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.905+0000 7f6855dd1640 1 -- 172.21.15.142:0/191912376 reap_dead start 2024-09-22T08:36:45.914 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.905+0000 7f685a922800 1 --2- 172.21.15.142:0/191912376 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a947c98560 0x55a947c9fb70 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f6850022ff0 tx=0x7f6850054780 comp rx=0 tx=0).stop 2024-09-22T08:36:45.914 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.905+0000 7f685a922800 1 -- 172.21.15.142:0/191912376 shutdown_connections 2024-09-22T08:36:45.914 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.905+0000 7f685a922800 1 --2- 172.21.15.142:0/191912376 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a947c98560 0x55a947c9fb70 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:45.914 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.905+0000 7f685a922800 1 -- 172.21.15.142:0/191912376 >> 172.21.15.142:0/191912376 conn(0x55a947c94980 msgr2=0x55a947c92b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:45.914 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.905+0000 7f685a922800 1 -- 172.21.15.142:0/191912376 shutdown_connections 2024-09-22T08:36:45.914 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.905+0000 7f685a922800 1 -- 172.21.15.142:0/191912376 wait complete. 2024-09-22T08:36:45.914 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.906+0000 7f685a922800 1 -- 172.21.15.142:0/1251463826 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f673003d000 msgr2=0x7f673003f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:45.914 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.906+0000 7f685a922800 1 --2- 172.21.15.142:0/1251463826 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f673003d000 0x7f673003f4c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f6848000c00 tx=0x7f684805bf00 comp rx=0 tx=0).stop 2024-09-22T08:36:45.914 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.906+0000 7f685a922800 1 -- 172.21.15.142:0/1251463826 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a947c8bb00 msgr2=0x55a947c8bf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:45.914 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.906+0000 7f685a922800 1 --2- 172.21.15.142:0/1251463826 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a947c8bb00 0x55a947c8bf20 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x55a947c71bf0 tx=0x7f68500167b0 comp rx=0 tx=0).stop 2024-09-22T08:36:45.914 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.906+0000 7f685a922800 1 -- 172.21.15.142:0/1251463826 shutdown_connections 2024-09-22T08:36:45.914 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.906+0000 7f685a922800 1 --2- 172.21.15.142:0/1251463826 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f673003d000 0x7f673003f4c0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:45.915 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.906+0000 7f685a922800 1 --2- 172.21.15.142:0/1251463826 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a947c8bb00 0x55a947c8bf20 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:45.915 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.906+0000 7f685a922800 1 -- 172.21.15.142:0/1251463826 >> 172.21.15.142:0/1251463826 conn(0x55a947c7feb0 msgr2=0x55a947c80290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:45.915 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.906+0000 7f685a922800 1 -- 172.21.15.142:0/1251463826 shutdown_connections 2024-09-22T08:36:45.915 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.906+0000 7f685a922800 1 -- 172.21.15.142:0/1251463826 wait complete. 2024-09-22T08:36:45.915 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.906+0000 7f685a922800 1 -- 172.21.15.142:0/3931410608 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55a947b77a20 msgr2=0x55a947c78240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:45.915 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.906+0000 7f685a922800 1 --2- 172.21.15.142:0/3931410608 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55a947b77a20 0x55a947c78240 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:45.915 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.906+0000 7f685a922800 1 -- 172.21.15.142:0/3931410608 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55a947c7a620 msgr2=0x55a947c7caa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:45.915 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.906+0000 7f685a922800 1 --2- 172.21.15.142:0/3931410608 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55a947c7a620 0x55a947c7caa0 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:45.915 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.906+0000 7f685a922800 1 -- 172.21.15.142:0/3931410608 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f673c03cfb0 msgr2=0x7f673c03f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:45.915 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.906+0000 7f685a922800 1 --2- 172.21.15.142:0/3931410608 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f673c03cfb0 0x7f673c03f470 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f684c001d70 tx=0x7f684c0012d0 comp rx=0 tx=0).stop 2024-09-22T08:36:45.915 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.906+0000 7f685a922800 1 -- 172.21.15.142:0/3931410608 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a947b767e0 msgr2=0x55a947c70bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:45.915 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.906+0000 7f685a922800 1 --2- 172.21.15.142:0/3931410608 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a947b767e0 0x55a947c70bf0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f684800a1d0 tx=0x7f6848002fb0 comp rx=0 tx=0).stop 2024-09-22T08:36:45.915 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.906+0000 7f685a922800 1 -- 172.21.15.142:0/3931410608 shutdown_connections 2024-09-22T08:36:45.915 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.906+0000 7f685a922800 1 --2- 172.21.15.142:0/3931410608 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55a947c7a620 0x55a947c7caa0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:45.916 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.906+0000 7f685a922800 1 --2- 172.21.15.142:0/3931410608 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55a947b77a20 0x55a947c78240 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:45.916 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.906+0000 7f685a922800 1 --2- 172.21.15.142:0/3931410608 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f673c03cfb0 0x7f673c03f470 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:45.916 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.906+0000 7f685a922800 1 --2- 172.21.15.142:0/3931410608 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a947b767e0 0x55a947c70bf0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:45.916 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.906+0000 7f685a922800 1 -- 172.21.15.142:0/3931410608 >> 172.21.15.142:0/3931410608 conn(0x55a947b71bb0 msgr2=0x55a947c661f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:45.916 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.906+0000 7f685a922800 1 -- 172.21.15.142:0/3931410608 shutdown_connections 2024-09-22T08:36:45.916 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.906+0000 7f685a922800 1 -- 172.21.15.142:0/3931410608 wait complete. 2024-09-22T08:36:45.917 INFO:teuthology.orchestra.run.smithi142.stdout:{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"d89f6f57-1007-47dd-9065-f486c7b01aec","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1","marker":"e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1","index_type":"Normal","index_generation":0,"num_shards":11,"reshard_status":"None","judge_reshard_lock_time":"0.000000","object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-09-22T08:36:45.363175Z","creation_time":"2024-09-22T08:36:45.359780Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"read_tracker":1} 2024-09-22T08:36:45.917 DEBUG:tasks.util.rgw: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': 'd89f6f57-1007-47dd-9065-f486c7b01aec', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': 'e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1', 'marker': 'e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'reshard_status': 'None', 'judge_reshard_lock_time': '0.000000', 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-22T08:36:45.363175Z', 'creation_time': '2024-09-22T08:36:45.359780Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'read_tracker': 1} 2024-09-22T08:36:45.917 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--uid', 'foo'] 2024-09-22T08:36:45.917 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--uid', 'foo'] 2024-09-22T08:36:45.917 DEBUG:teuthology.orchestra.run.smithi142:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --uid foo 2024-09-22T08:36:45.961 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:36:45.961 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:36:45.963 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.961+0000 7f5ea8326800 1 Processor -- start 2024-09-22T08:36:45.963 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.961+0000 7f5ea8326800 1 -- start start 2024-09-22T08:36:45.963 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.961+0000 7f5ea8326800 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55c14c052bf0 0x55c14c058580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:45.963 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.961+0000 7f5ea8326800 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55c14bedda20 con 0x55c14c0517e0 2024-09-22T08:36:45.963 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.961+0000 7f5ea8326800 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x55c14bedd7d0 con 0x55c14c052bf0 2024-09-22T08:36:45.963 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.961+0000 7f5ea384a640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55c14c052bf0 0x55c14c058580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:45.964 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.961+0000 7f5ea404b640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x55c14c0517e0 0x55c14c0524e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.142:42516/0 (socket says 172.21.15.142:42516) 2024-09-22T08:36:45.964 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.961+0000 7f5ea404b640 1 -- 172.21.15.142:0/2501536613 learned_addr learned my addr 172.21.15.142:0/2501536613 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-09-22T08:36:45.964 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.961+0000 7f5ea384a640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55c14c052bf0 0x55c14c058580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:39178/0 (socket says 172.21.15.142:39178) 2024-09-22T08:36:45.964 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.962+0000 7f5ea3049640 1 -- 172.21.15.142:0/2501536613 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3910934654 0 0) 0x55c14bedda20 con 0x55c14c0517e0 2024-09-22T08:36:45.964 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.962+0000 7f5ea3049640 1 -- 172.21.15.142:0/2501536613 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5e90001e10 con 0x55c14c0517e0 2024-09-22T08:36:45.964 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.962+0000 7f5ea384a640 1 -- 172.21.15.142:0/2501536613 >> v1:172.21.15.31:6789/0 conn(0x55c14c0517e0 legacy=0x55c14c0524e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:45.964 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.962+0000 7f5ea384a640 1 -- 172.21.15.142:0/2501536613 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c14c051ee0 con 0x55c14c052bf0 2024-09-22T08:36:45.965 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.964+0000 7f5ea384a640 1 --2- 172.21.15.142:0/2501536613 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c14c052bf0 0x55c14c058580 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f5e8c00a470 tx=0x7f5e8c045920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d0c7cae496bc294 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:45.965 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.964+0000 7f5ea3049640 1 -- 172.21.15.142:0/2501536613 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e8c059070 con 0x55c14c052bf0 2024-09-22T08:36:45.965 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.964+0000 7f5ea3049640 1 -- 172.21.15.142:0/2501536613 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e8c054570 con 0x55c14c052bf0 2024-09-22T08:36:45.965 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.964+0000 7f5ea3049640 1 -- 172.21.15.142:0/2501536613 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e8c054870 con 0x55c14c052bf0 2024-09-22T08:36:45.966 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.964+0000 7f5ea8326800 1 -- 172.21.15.142:0/2501536613 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c14c052bf0 msgr2=0x55c14c058580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:45.966 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.964+0000 7f5ea8326800 1 --2- 172.21.15.142:0/2501536613 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c14c052bf0 0x55c14c058580 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f5e8c00a470 tx=0x7f5e8c045920 comp rx=0 tx=0).stop 2024-09-22T08:36:45.966 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.964+0000 7f5ea8326800 1 -- 172.21.15.142:0/2501536613 shutdown_connections 2024-09-22T08:36:45.966 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.964+0000 7f5ea8326800 1 --2- 172.21.15.142:0/2501536613 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c14c052bf0 0x55c14c058580 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:45.966 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.964+0000 7f5ea8326800 1 -- 172.21.15.142:0/2501536613 >> 172.21.15.142:0/2501536613 conn(0x55c14c04cbb0 msgr2=0x55c14c04f010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:45.966 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.964+0000 7f5ea8326800 1 -- 172.21.15.142:0/2501536613 shutdown_connections 2024-09-22T08:36:45.966 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.964+0000 7f5ea8326800 1 -- 172.21.15.142:0/2501536613 wait complete. 2024-09-22T08:36:45.980 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.978+0000 7f5ea8326800 1 Processor -- start 2024-09-22T08:36:45.980 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.978+0000 7f5ea8326800 1 -- start start 2024-09-22T08:36:45.981 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.978+0000 7f5ea8326800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c14c0517e0 0x55c14c13d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:45.981 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.978+0000 7f5ea8326800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55c14beeadd0 con 0x55c14c0517e0 2024-09-22T08:36:45.981 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.978+0000 7f5ea404b640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c14c0517e0 0x55c14c13d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:45.981 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.978+0000 7f5ea404b640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c14c0517e0 0x55c14c13d960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:39182/0 (socket says 172.21.15.142:39182) 2024-09-22T08:36:45.981 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.978+0000 7f5ea404b640 1 -- 172.21.15.142:0/1574030497 learned_addr learned my addr 172.21.15.142:0/1574030497 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:45.981 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.979+0000 7f5ea404b640 1 -- 172.21.15.142:0/1574030497 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c14c13df50 con 0x55c14c0517e0 2024-09-22T08:36:45.981 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.979+0000 7f5ea404b640 1 --2- 172.21.15.142:0/1574030497 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c14c0517e0 0x55c14c13d960 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f5e940016c0 tx=0x7f5e94001b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e48c20e2c559258a server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:45.981 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.979+0000 7f5d9260c640 1 -- 172.21.15.142:0/1574030497 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e94004520 con 0x55c14c0517e0 2024-09-22T08:36:45.981 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.979+0000 7f5d9260c640 1 -- 172.21.15.142:0/1574030497 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e940046c0 con 0x55c14c0517e0 2024-09-22T08:36:45.981 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.979+0000 7f5d9260c640 1 -- 172.21.15.142:0/1574030497 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e940049c0 con 0x55c14c0517e0 2024-09-22T08:36:45.984 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.980+0000 7f5ea8326800 1 -- 172.21.15.142:0/1574030497 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c14c0517e0 msgr2=0x55c14c13d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:45.984 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.980+0000 7f5ea8326800 1 --2- 172.21.15.142:0/1574030497 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c14c0517e0 0x55c14c13d960 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f5e940016c0 tx=0x7f5e94001b80 comp rx=0 tx=0).stop 2024-09-22T08:36:45.984 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.980+0000 7f5ea8326800 1 -- 172.21.15.142:0/1574030497 shutdown_connections 2024-09-22T08:36:45.984 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.980+0000 7f5ea8326800 1 --2- 172.21.15.142:0/1574030497 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c14c0517e0 0x55c14c13d960 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:45.984 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.980+0000 7f5ea8326800 1 -- 172.21.15.142:0/1574030497 >> 172.21.15.142:0/1574030497 conn(0x55c14c04cbb0 msgr2=0x55c14c140220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:45.984 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.980+0000 7f5ea8326800 1 -- 172.21.15.142:0/1574030497 shutdown_connections 2024-09-22T08:36:45.984 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.980+0000 7f5ea8326800 1 -- 172.21.15.142:0/1574030497 wait complete. 2024-09-22T08:36:45.984 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.980+0000 7f5ea8326800 1 Processor -- start 2024-09-22T08:36:45.984 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.980+0000 7f5ea8326800 1 -- start start 2024-09-22T08:36:45.984 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.980+0000 7f5ea8326800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c14c0517e0 0x55c14c14bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:45.984 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.980+0000 7f5ea8326800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55c14c058ac0 con 0x55c14c0517e0 2024-09-22T08:36:45.985 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.980+0000 7f5ea404b640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c14c0517e0 0x55c14c14bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:45.985 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.981+0000 7f5ea404b640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c14c0517e0 0x55c14c14bb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:39194/0 (socket says 172.21.15.142:39194) 2024-09-22T08:36:45.985 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.981+0000 7f5ea404b640 1 -- 172.21.15.142:0/112671327 learned_addr learned my addr 172.21.15.142:0/112671327 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:45.985 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.981+0000 7f5ea404b640 1 -- 172.21.15.142:0/112671327 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c14c14c0d0 con 0x55c14c0517e0 2024-09-22T08:36:45.985 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.981+0000 7f5ea404b640 1 --2- 172.21.15.142:0/112671327 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c14c0517e0 0x55c14c14bb70 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f5e94007fd0 tx=0x7f5e94004460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:45.985 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.981+0000 7f5d90e09640 1 -- 172.21.15.142:0/112671327 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e94022020 con 0x55c14c0517e0 2024-09-22T08:36:45.985 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.981+0000 7f5d90e09640 1 -- 172.21.15.142:0/112671327 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e94019040 con 0x55c14c0517e0 2024-09-22T08:36:45.985 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.981+0000 7f5d90e09640 1 -- 172.21.15.142:0/112671327 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e94014940 con 0x55c14c0517e0 2024-09-22T08:36:45.985 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.981+0000 7f5ea8326800 1 -- 172.21.15.142:0/112671327 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c14c14c360 con 0x55c14c0517e0 2024-09-22T08:36:45.985 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.981+0000 7f5ea8326800 1 -- 172.21.15.142:0/112671327 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c14c14cd60 con 0x55c14c0517e0 2024-09-22T08:36:45.985 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.982+0000 7f5d90e09640 1 -- 172.21.15.142:0/112671327 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f5e94025020 con 0x55c14c0517e0 2024-09-22T08:36:45.985 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.982+0000 7f5d90e09640 1 --2- 172.21.15.142:0/112671327 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f5d8c03d000 0x7f5d8c03f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:45.985 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.982+0000 7f5d90e09640 1 -- 172.21.15.142:0/112671327 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f5e94054380 con 0x55c14c0517e0 2024-09-22T08:36:45.985 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.983+0000 7f5ea384a640 1 --2- 172.21.15.142:0/112671327 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f5d8c03d000 0x7f5d8c03f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:45.986 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.983+0000 7f5ea8326800 1 --2- 172.21.15.142:0/112671327 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55c14c052bf0 0x55c14c1531c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:45.986 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.983+0000 7f5ea8326800 1 -- 172.21.15.142:0/112671327 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c14c153700 con 0x55c14c052bf0 2024-09-22T08:36:45.986 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.983+0000 7f5ea484c640 1 --2- 172.21.15.142:0/112671327 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55c14c052bf0 0x55c14c1531c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:45.988 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.983+0000 7f5ea384a640 1 --2- 172.21.15.142:0/112671327 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f5d8c03d000 0x7f5d8c03f4c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x55c14c050f20 tx=0x7f5e8c050000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:45.988 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.983+0000 7f5ea484c640 1 --2- 172.21.15.142:0/112671327 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55c14c052bf0 0x55c14c1531c0 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:45.989 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.983+0000 7f5ea484c640 1 -- 172.21.15.142:0/112671327 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5e9c0083e0 con 0x55c14c052bf0 2024-09-22T08:36:45.989 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.983+0000 7f5ea8326800 1 -- 172.21.15.142:0/112671327 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c14c153aa0 con 0x55c14c052bf0 2024-09-22T08:36:45.989 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.984+0000 7f5ea484c640 1 -- 172.21.15.142:0/112671327 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5e9c0083e0 con 0x55c14c052bf0 2024-09-22T08:36:45.989 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.984+0000 7f5ea8326800 1 --2- 172.21.15.142:0/112671327 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55c14c1555a0 0x55c14c157a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:45.989 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.984+0000 7f5ea8326800 1 -- 172.21.15.142:0/112671327 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:3 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c14c1581b0 con 0x55c14c1555a0 2024-09-22T08:36:45.989 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.984+0000 7f5ea404b640 1 --2- 172.21.15.142:0/112671327 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55c14c1555a0 0x55c14c157a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:45.989 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.984+0000 7f5ea404b640 1 --2- 172.21.15.142:0/112671327 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55c14c1555a0 0x55c14c157a20 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:45.989 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.984+0000 7f5ea404b640 1 -- 172.21.15.142:0/112671327 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(3 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f5e9400f030 con 0x55c14c1555a0 2024-09-22T08:36:45.989 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.984+0000 7f5ea8326800 1 -- 172.21.15.142:0/112671327 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c14c1542f0 con 0x55c14c052bf0 2024-09-22T08:36:45.989 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.985+0000 7f5ea484c640 1 -- 172.21.15.142:0/112671327 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5e9c0083e0 con 0x55c14c052bf0 2024-09-22T08:36:45.989 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.985+0000 7f5ea8326800 1 -- 172.21.15.142:0/112671327 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c14c154740 con 0x55c14c1555a0 2024-09-22T08:36:45.989 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.985+0000 7f5ea404b640 1 -- 172.21.15.142:0/112671327 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(5 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f5e9400f030 con 0x55c14c1555a0 2024-09-22T08:36:45.989 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.985+0000 7f5ea8326800 1 Processor -- start 2024-09-22T08:36:45.989 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.985+0000 7f5ea8326800 1 -- start start 2024-09-22T08:36:45.990 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.985+0000 7f5ea8326800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c14c166bd0 0x55c14c166ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:45.990 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.985+0000 7f5ea8326800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55c14bf49d50 con 0x55c14c166bd0 2024-09-22T08:36:45.990 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.986+0000 7f5ea484c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c14c166bd0 0x55c14c166ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:45.990 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.986+0000 7f5ea484c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c14c166bd0 0x55c14c166ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:39204/0 (socket says 172.21.15.142:39204) 2024-09-22T08:36:45.990 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.986+0000 7f5ea484c640 1 -- 172.21.15.142:0/3830947030 learned_addr learned my addr 172.21.15.142:0/3830947030 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:45.990 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.986+0000 7f5ea484c640 1 -- 172.21.15.142:0/3830947030 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c14c167630 con 0x55c14c166bd0 2024-09-22T08:36:45.990 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.986+0000 7f5ea484c640 1 --2- 172.21.15.142:0/3830947030 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c14c166bd0 0x55c14c166ff0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x55c14c14cb70 tx=0x7f5e9c00bf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:45.990 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.986+0000 7f5d8a7fc640 1 -- 172.21.15.142:0/3830947030 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e9c01c020 con 0x55c14c166bd0 2024-09-22T08:36:45.990 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.986+0000 7f5d8a7fc640 1 -- 172.21.15.142:0/3830947030 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e9c007c90 con 0x55c14c166bd0 2024-09-22T08:36:45.990 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.986+0000 7f5ea8326800 1 -- 172.21.15.142:0/3830947030 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c14c167e60 con 0x55c14c166bd0 2024-09-22T08:36:45.990 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.986+0000 7f5d8a7fc640 1 -- 172.21.15.142:0/3830947030 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e9c018440 con 0x55c14c166bd0 2024-09-22T08:36:45.990 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.987+0000 7f5ea8326800 1 -- 172.21.15.142:0/3830947030 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c14c168400 con 0x55c14c166bd0 2024-09-22T08:36:45.990 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.987+0000 7f5d8a7fc640 1 -- 172.21.15.142:0/3830947030 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f5e9c01f020 con 0x55c14c166bd0 2024-09-22T08:36:45.994 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.987+0000 7f5d8a7fc640 1 --2- 172.21.15.142:0/3830947030 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f5d7c03d000 0x7f5d7c03f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:45.994 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.988+0000 7f5d8a7fc640 1 -- 172.21.15.142:0/3830947030 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f5e9c055870 con 0x55c14c166bd0 2024-09-22T08:36:45.994 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.988+0000 7f5ea404b640 1 --2- 172.21.15.142:0/3830947030 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f5d7c03d000 0x7f5d7c03f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:45.994 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.988+0000 7f5ea8326800 1 Processor -- start 2024-09-22T08:36:45.994 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.988+0000 7f5ea8326800 1 -- start start 2024-09-22T08:36:45.994 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.988+0000 7f5ea404b640 1 --2- 172.21.15.142:0/3830947030 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f5d7c03d000 0x7f5d7c03f4c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x55c14c154690 tx=0x7f5e94012f70 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:45.994 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.988+0000 7f5ea8326800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c14c1736b0 0x55c14c173a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:45.994 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.988+0000 7f5ea8326800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55c14c13c370 con 0x55c14c1736b0 2024-09-22T08:36:45.994 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.988+0000 7f5ea484c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c14c1736b0 0x55c14c173a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:45.994 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.988+0000 7f5ea484c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c14c1736b0 0x55c14c173a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:39206/0 (socket says 172.21.15.142:39206) 2024-09-22T08:36:45.994 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.988+0000 7f5ea484c640 1 -- 172.21.15.142:0/1917347146 learned_addr learned my addr 172.21.15.142:0/1917347146 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:45.994 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.989+0000 7f5ea484c640 1 -- 172.21.15.142:0/1917347146 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c14c174080 con 0x55c14c1736b0 2024-09-22T08:36:45.995 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.989+0000 7f5ea484c640 1 --2- 172.21.15.142:0/1917347146 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c14c1736b0 0x55c14c173a90 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f5e9c053d80 tx=0x7f5e9c0153e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9738349d792e34af server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:45.995 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.989+0000 7f5d837fe640 1 -- 172.21.15.142:0/1917347146 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e9c04a070 con 0x55c14c1736b0 2024-09-22T08:36:45.995 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.989+0000 7f5d837fe640 1 -- 172.21.15.142:0/1917347146 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e9c0174d0 con 0x55c14c1736b0 2024-09-22T08:36:45.995 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.989+0000 7f5d837fe640 1 -- 172.21.15.142:0/1917347146 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e9c052070 con 0x55c14c1736b0 2024-09-22T08:36:45.995 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.989+0000 7f5ea8326800 1 -- 172.21.15.142:0/1917347146 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c14c1736b0 msgr2=0x55c14c173a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:45.995 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.989+0000 7f5ea8326800 1 --2- 172.21.15.142:0/1917347146 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c14c1736b0 0x55c14c173a90 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f5e9c053d80 tx=0x7f5e9c0153e0 comp rx=0 tx=0).stop 2024-09-22T08:36:45.995 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.989+0000 7f5ea8326800 1 -- 172.21.15.142:0/1917347146 shutdown_connections 2024-09-22T08:36:45.995 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.989+0000 7f5ea8326800 1 --2- 172.21.15.142:0/1917347146 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c14c1736b0 0x55c14c173a90 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:45.995 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.989+0000 7f5ea8326800 1 -- 172.21.15.142:0/1917347146 >> 172.21.15.142:0/1917347146 conn(0x55c14c16fab0 msgr2=0x55c14c16dcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:45.995 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.989+0000 7f5ea8326800 1 -- 172.21.15.142:0/1917347146 shutdown_connections 2024-09-22T08:36:45.995 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.989+0000 7f5ea8326800 1 -- 172.21.15.142:0/1917347146 wait complete. 2024-09-22T08:36:45.995 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.990+0000 7f5ea8326800 1 Processor -- start 2024-09-22T08:36:45.995 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.990+0000 7f5ea8326800 1 -- start start 2024-09-22T08:36:45.996 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.990+0000 7f5ea8326800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c14c1736b0 0x55c14c17acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:45.996 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.990+0000 7f5ea8326800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55c14c1746c0 con 0x55c14c1736b0 2024-09-22T08:36:45.996 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.990+0000 7f5ea484c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c14c1736b0 0x55c14c17acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:45.996 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.990+0000 7f5ea484c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c14c1736b0 0x55c14c17acb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:39222/0 (socket says 172.21.15.142:39222) 2024-09-22T08:36:45.996 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.990+0000 7f5ea484c640 1 -- 172.21.15.142:0/3605576910 learned_addr learned my addr 172.21.15.142:0/3605576910 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:45.996 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.990+0000 7f5ea484c640 1 -- 172.21.15.142:0/3605576910 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c14c17b210 con 0x55c14c1736b0 2024-09-22T08:36:45.996 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.991+0000 7f5ea484c640 1 --2- 172.21.15.142:0/3605576910 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c14c1736b0 0x55c14c17acb0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f5e9c0540f0 tx=0x7f5e9c053ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:45.996 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.991+0000 7f5d81ffb640 1 -- 172.21.15.142:0/3605576910 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e9c030020 con 0x55c14c1736b0 2024-09-22T08:36:45.996 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.991+0000 7f5d81ffb640 1 -- 172.21.15.142:0/3605576910 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e9c04b040 con 0x55c14c1736b0 2024-09-22T08:36:45.996 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.991+0000 7f5ea8326800 1 -- 172.21.15.142:0/3605576910 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c14c17b4a0 con 0x55c14c1736b0 2024-09-22T08:36:45.996 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.991+0000 7f5d81ffb640 1 -- 172.21.15.142:0/3605576910 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e9c04a050 con 0x55c14c1736b0 2024-09-22T08:36:45.996 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.991+0000 7f5ea8326800 1 -- 172.21.15.142:0/3605576910 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c14c17be20 con 0x55c14c1736b0 2024-09-22T08:36:46.001 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.992+0000 7f5d81ffb640 1 -- 172.21.15.142:0/3605576910 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f5e9c033020 con 0x55c14c1736b0 2024-09-22T08:36:46.001 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.992+0000 7f5d81ffb640 1 --2- 172.21.15.142:0/3605576910 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f5d6c03d000 0x7f5d6c03f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:46.001 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.992+0000 7f5d81ffb640 1 -- 172.21.15.142:0/3605576910 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f5e9c036ab0 con 0x55c14c1736b0 2024-09-22T08:36:46.001 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.992+0000 7f5ea404b640 1 --2- 172.21.15.142:0/3605576910 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f5d6c03d000 0x7f5d6c03f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:46.001 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.992+0000 7f5ea8326800 20 rados->read ofs=0 len=0 2024-09-22T08:36:46.001 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.992+0000 7f5ea8326800 1 --2- 172.21.15.142:0/3605576910 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55c14c1865e0 0x55c14c188aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:46.001 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.992+0000 7f5ea8326800 1 -- 172.21.15.142:0/3605576910 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c14c1891f0 con 0x55c14c1865e0 2024-09-22T08:36:46.001 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.992+0000 7f5ea384a640 1 --2- 172.21.15.142:0/3605576910 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55c14c1865e0 0x55c14c188aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:46.001 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.992+0000 7f5ea404b640 1 --2- 172.21.15.142:0/3605576910 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f5d6c03d000 0x7f5d6c03f4c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f5e94000f80 tx=0x7f5e94050000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:46.001 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.993+0000 7f5ea384a640 1 --2- 172.21.15.142:0/3605576910 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55c14c1865e0 0x55c14c188aa0 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:46.002 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.993+0000 7f5ea384a640 1 -- 172.21.15.142:0/3605576910 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5e8c061430 con 0x55c14c1865e0 2024-09-22T08:36:46.002 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.993+0000 7f5ea8326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:46.002 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.993+0000 7f5ea8326800 20 realm 2024-09-22T08:36:46.002 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.993+0000 7f5ea8326800 20 rados->read ofs=0 len=0 2024-09-22T08:36:46.002 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.993+0000 7f5ea8326800 1 -- 172.21.15.142:0/3605576910 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c14c1895c0 con 0x55c14c1865e0 2024-09-22T08:36:46.002 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.993+0000 7f5ea384a640 1 -- 172.21.15.142:0/3605576910 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5e8c061430 con 0x55c14c1865e0 2024-09-22T08:36:46.002 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.993+0000 7f5ea8326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:46.002 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.993+0000 7f5ea8326800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:36:46.002 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.993+0000 7f5ea8326800 20 rados->read ofs=0 len=0 2024-09-22T08:36:46.002 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.993+0000 7f5ea8326800 1 -- 172.21.15.142:0/3605576910 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c14c189e90 con 0x55c14c1865e0 2024-09-22T08:36:46.002 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.994+0000 7f5ea384a640 1 -- 172.21.15.142:0/3605576910 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5e8c061430 con 0x55c14c1865e0 2024-09-22T08:36:46.002 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.994+0000 7f5ea8326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:46.002 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.994+0000 7f5ea8326800 20 rados->read ofs=0 len=0 2024-09-22T08:36:46.003 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.994+0000 7f5ea8326800 1 -- 172.21.15.142:0/3605576910 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c14c18a230 con 0x55c14c1865e0 2024-09-22T08:36:46.003 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.994+0000 7f5ea384a640 1 -- 172.21.15.142:0/3605576910 <== osd.1 v2:172.21.15.142:6816/3192108003 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5e8c061430 con 0x55c14c1865e0 2024-09-22T08:36:46.003 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.994+0000 7f5ea8326800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:36:46.003 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.994+0000 7f5ea8326800 20 rados->read ofs=0 len=0 2024-09-22T08:36:46.003 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.994+0000 7f5ea8326800 1 --2- 172.21.15.142:0/3605576910 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55c14c18ace0 0x55c14c18d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:46.003 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.994+0000 7f5ea8326800 1 -- 172.21.15.142:0/3605576910 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c14c18d830 con 0x55c14c18ace0 2024-09-22T08:36:46.003 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.994+0000 7f5ea484c640 1 --2- 172.21.15.142:0/3605576910 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55c14c18ace0 0x55c14c18d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:46.003 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.995+0000 7f5ea484c640 1 --2- 172.21.15.142:0/3605576910 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55c14c18ace0 0x55c14c18d0d0 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:46.003 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.995+0000 7f5ea484c640 1 -- 172.21.15.142:0/3605576910 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(5 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f5e9c04d070 con 0x55c14c18ace0 2024-09-22T08:36:46.003 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.995+0000 7f5ea8326800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:36:46.003 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.995+0000 7f5ea8326800 20 searching for the correct realm 2024-09-22T08:36:46.003 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.995+0000 7f5ea8326800 1 -- 172.21.15.142:0/3605576910 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c14c18f210 con 0x55c14c18ace0 2024-09-22T08:36:46.003 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.995+0000 7f5ea484c640 1 -- 172.21.15.142:0/3605576910 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e9c04d070 con 0x55c14c18ace0 2024-09-22T08:36:46.003 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.995+0000 7f5ea484c640 1 --2- 172.21.15.142:0/3605576910 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f5e9c040040 0x7f5e9c04eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:46.004 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.995+0000 7f5ea484c640 1 -- 172.21.15.142:0/3605576910 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c14c18f210 con 0x7f5e9c040040 2024-09-22T08:36:46.004 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.995+0000 7f5ea404b640 1 --2- 172.21.15.142:0/3605576910 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f5e9c040040 0x7f5e9c04eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:46.004 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.996+0000 7f5ea404b640 1 --2- 172.21.15.142:0/3605576910 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f5e9c040040 0x7f5e9c04eab0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:46.004 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.996+0000 7f5ea404b640 1 -- 172.21.15.142:0/3605576910 <== osd.2 v2:172.21.15.142:6808/279438927 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e9400f030 con 0x7f5e9c040040 2024-09-22T08:36:46.004 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.996+0000 7f5ea404b640 1 --2- 172.21.15.142:0/3605576910 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f5e94027020 0x7f5e9404b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:46.004 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.996+0000 7f5ea404b640 1 -- 172.21.15.142:0/3605576910 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c14c18f210 con 0x7f5e94027020 2024-09-22T08:36:46.004 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.996+0000 7f5ea384a640 1 --2- 172.21.15.142:0/3605576910 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f5e94027020 0x7f5e9404b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:46.004 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.997+0000 7f5ea384a640 1 --2- 172.21.15.142:0/3605576910 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f5e94027020 0x7f5e9404b6c0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:46.004 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.997+0000 7f5ea384a640 1 -- 172.21.15.142:0/3605576910 <== osd.0 v2:172.21.15.31:6800/168281188 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e8c061430 con 0x7f5e94027020 2024-09-22T08:36:46.004 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.997+0000 7f5ea384a640 1 -- 172.21.15.142:0/3605576910 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c14c18f210 con 0x55c14c1865e0 2024-09-22T08:36:46.004 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.997+0000 7f5ea384a640 1 -- 172.21.15.142:0/3605576910 <== osd.1 v2:172.21.15.142:6816/3192108003 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e8c061430 con 0x55c14c1865e0 2024-09-22T08:36:46.004 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.997+0000 7f5ea384a640 1 -- 172.21.15.142:0/3605576910 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c14c18f210 con 0x55c14c1865e0 2024-09-22T08:36:46.004 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.997+0000 7f5ea384a640 1 -- 172.21.15.142:0/3605576910 <== osd.1 v2:172.21.15.142:6816/3192108003 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e8c061430 con 0x55c14c1865e0 2024-09-22T08:36:46.004 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.997+0000 7f5ea384a640 1 -- 172.21.15.142:0/3605576910 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f5e8c078040 con 0x7f5e94027020 2024-09-22T08:36:46.005 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.998+0000 7f5ea384a640 1 -- 172.21.15.142:0/3605576910 <== osd.0 v2:172.21.15.31:6800/168281188 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e8c061430 con 0x7f5e94027020 2024-09-22T08:36:46.005 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.998+0000 7f5ea384a640 1 -- 172.21.15.142:0/3605576910 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f5e8c078040 con 0x7f5e94027020 2024-09-22T08:36:46.005 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.998+0000 7f5ea384a640 1 -- 172.21.15.142:0/3605576910 <== osd.0 v2:172.21.15.31:6800/168281188 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e8c061430 con 0x7f5e94027020 2024-09-22T08:36:46.005 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.998+0000 7f5ea384a640 1 -- 172.21.15.142:0/3605576910 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f5e8c078040 con 0x7f5e9c040040 2024-09-22T08:36:46.005 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.998+0000 7f5ea404b640 1 -- 172.21.15.142:0/3605576910 <== osd.2 v2:172.21.15.142:6808/279438927 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e9400f030 con 0x7f5e9c040040 2024-09-22T08:36:46.005 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.998+0000 7f5ea404b640 1 -- 172.21.15.142:0/3605576910 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f5e8c078040 con 0x55c14c18ace0 2024-09-22T08:36:46.005 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.998+0000 7f5ea484c640 1 -- 172.21.15.142:0/3605576910 <== osd.3 v2:172.21.15.142:6800/1064901393 3 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e9c04d070 con 0x55c14c18ace0 2024-09-22T08:36:46.005 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.998+0000 7f5ea484c640 1 -- 172.21.15.142:0/3605576910 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f5e8c078040 con 0x55c14c1865e0 2024-09-22T08:36:46.013 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.998+0000 7f5ea384a640 1 -- 172.21.15.142:0/3605576910 <== osd.1 v2:172.21.15.142:6816/3192108003 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e8c061430 con 0x55c14c1865e0 2024-09-22T08:36:46.013 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.999+0000 7f5ea384a640 1 -- 172.21.15.142:0/3605576910 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f5e8c078040 con 0x7f5e94027020 2024-09-22T08:36:46.013 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.999+0000 7f5ea384a640 1 -- 172.21.15.142:0/3605576910 <== osd.0 v2:172.21.15.31:6800/168281188 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e8c061430 con 0x7f5e94027020 2024-09-22T08:36:46.013 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.999+0000 7f5ea384a640 1 -- 172.21.15.142:0/3605576910 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f5e8c078040 con 0x55c14c1865e0 2024-09-22T08:36:46.013 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.999+0000 7f5ea384a640 1 -- 172.21.15.142:0/3605576910 <== osd.1 v2:172.21.15.142:6816/3192108003 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e8c061430 con 0x55c14c1865e0 2024-09-22T08:36:46.014 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.999+0000 7f5ea384a640 1 -- 172.21.15.142:0/3605576910 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f5e8c078040 con 0x7f5e9c040040 2024-09-22T08:36:46.014 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.999+0000 7f5ea404b640 1 -- 172.21.15.142:0/3605576910 <== osd.2 v2:172.21.15.142:6808/279438927 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f5e9400f030 con 0x7f5e9c040040 2024-09-22T08:36:46.014 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:45.999+0000 7f5ea404b640 1 -- 172.21.15.142:0/3605576910 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f5e8c078040 con 0x55c14c18ace0 2024-09-22T08:36:46.014 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.000+0000 7f5ea484c640 1 -- 172.21.15.142:0/3605576910 <== osd.3 v2:172.21.15.142:6800/1064901393 4 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e9c04d070 con 0x55c14c18ace0 2024-09-22T08:36:46.014 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.000+0000 7f5ea484c640 1 -- 172.21.15.142:0/3605576910 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f5e8c078040 con 0x55c14c18ace0 2024-09-22T08:36:46.014 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.000+0000 7f5ea484c640 1 -- 172.21.15.142:0/3605576910 <== osd.3 v2:172.21.15.142:6800/1064901393 5 ==== osd_op_reply(20 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f5e9c04d070 con 0x55c14c18ace0 2024-09-22T08:36:46.014 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.000+0000 7f5ea484c640 1 -- 172.21.15.142:0/3605576910 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f5e8c078040 con 0x7f5e94027020 2024-09-22T08:36:46.014 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.000+0000 7f5ea384a640 1 -- 172.21.15.142:0/3605576910 <== osd.0 v2:172.21.15.31:6800/168281188 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e8c061430 con 0x7f5e94027020 2024-09-22T08:36:46.014 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.000+0000 7f5ea384a640 1 -- 172.21.15.142:0/3605576910 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f5e8c078040 con 0x55c14c18ace0 2024-09-22T08:36:46.014 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.001+0000 7f5ea484c640 1 -- 172.21.15.142:0/3605576910 <== osd.3 v2:172.21.15.142:6800/1064901393 6 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e9c04d070 con 0x55c14c18ace0 2024-09-22T08:36:46.014 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.001+0000 7f5ea484c640 1 -- 172.21.15.142:0/3605576910 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f5e8c078040 con 0x55c14c18ace0 2024-09-22T08:36:46.014 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.001+0000 7f5ea484c640 1 -- 172.21.15.142:0/3605576910 <== osd.3 v2:172.21.15.142:6800/1064901393 7 ==== osd_op_reply(23 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f5e9c04d070 con 0x55c14c18ace0 2024-09-22T08:36:46.015 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.001+0000 7f5ea484c640 1 -- 172.21.15.142:0/3605576910 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f5e8c078040 con 0x55c14c1865e0 2024-09-22T08:36:46.015 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.001+0000 7f5ea384a640 1 -- 172.21.15.142:0/3605576910 <== osd.1 v2:172.21.15.142:6816/3192108003 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e8c061430 con 0x55c14c1865e0 2024-09-22T08:36:46.015 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.001+0000 7f5ea384a640 1 -- 172.21.15.142:0/3605576910 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f5e8c078040 con 0x55c14c1865e0 2024-09-22T08:36:46.015 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.001+0000 7f5ea384a640 1 -- 172.21.15.142:0/3605576910 <== osd.1 v2:172.21.15.142:6816/3192108003 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f5e8c061430 con 0x55c14c1865e0 2024-09-22T08:36:46.015 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.001+0000 7f5ea384a640 1 -- 172.21.15.142:0/3605576910 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f5e8c078040 con 0x7f5e94027020 2024-09-22T08:36:46.015 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.002+0000 7f5ea384a640 1 -- 172.21.15.142:0/3605576910 <== osd.0 v2:172.21.15.31:6800/168281188 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e8c061430 con 0x7f5e94027020 2024-09-22T08:36:46.015 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.002+0000 7f5ea384a640 1 -- 172.21.15.142:0/3605576910 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f5e8c078040 con 0x55c14c18ace0 2024-09-22T08:36:46.015 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.002+0000 7f5ea484c640 1 -- 172.21.15.142:0/3605576910 <== osd.3 v2:172.21.15.142:6800/1064901393 8 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e9c04d070 con 0x55c14c18ace0 2024-09-22T08:36:46.015 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.002+0000 7f5ea484c640 1 -- 172.21.15.142:0/3605576910 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f5e8c078040 con 0x7f5e9c040040 2024-09-22T08:36:46.015 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.002+0000 7f5ea404b640 1 -- 172.21.15.142:0/3605576910 <== osd.2 v2:172.21.15.142:6808/279438927 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e9400f030 con 0x7f5e9c040040 2024-09-22T08:36:46.015 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.002+0000 7f5ea404b640 1 -- 172.21.15.142:0/3605576910 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f5e8c078040 con 0x55c14c1865e0 2024-09-22T08:36:46.015 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.002+0000 7f5ea384a640 1 -- 172.21.15.142:0/3605576910 <== osd.1 v2:172.21.15.142:6816/3192108003 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e8c061430 con 0x55c14c1865e0 2024-09-22T08:36:46.015 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.002+0000 7f5ea384a640 1 -- 172.21.15.142:0/3605576910 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f5e8c078040 con 0x7f5e94027020 2024-09-22T08:36:46.015 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.003+0000 7f5ea384a640 1 -- 172.21.15.142:0/3605576910 <== osd.0 v2:172.21.15.31:6800/168281188 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e8c061430 con 0x7f5e94027020 2024-09-22T08:36:46.016 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.003+0000 7f5ea384a640 1 -- 172.21.15.142:0/3605576910 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f5e8c078040 con 0x55c14c18ace0 2024-09-22T08:36:46.016 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.003+0000 7f5ea484c640 1 -- 172.21.15.142:0/3605576910 <== osd.3 v2:172.21.15.142:6800/1064901393 9 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e9c04d070 con 0x55c14c18ace0 2024-09-22T08:36:46.016 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.003+0000 7f5ea484c640 1 -- 172.21.15.142:0/3605576910 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f5e8c078040 con 0x7f5e94027020 2024-09-22T08:36:46.016 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.003+0000 7f5ea384a640 1 -- 172.21.15.142:0/3605576910 <== osd.0 v2:172.21.15.31:6800/168281188 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e8c061430 con 0x7f5e94027020 2024-09-22T08:36:46.016 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.003+0000 7f5ea384a640 1 -- 172.21.15.142:0/3605576910 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f5e8c078040 con 0x7f5e9c040040 2024-09-22T08:36:46.016 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.004+0000 7f5ea404b640 1 -- 172.21.15.142:0/3605576910 <== osd.2 v2:172.21.15.142:6808/279438927 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e9400f030 con 0x7f5e9c040040 2024-09-22T08:36:46.016 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.004+0000 7f5ea404b640 1 -- 172.21.15.142:0/3605576910 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f5e8c078040 con 0x55c14c18ace0 2024-09-22T08:36:46.016 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.004+0000 7f5ea484c640 1 -- 172.21.15.142:0/3605576910 <== osd.3 v2:172.21.15.142:6800/1064901393 10 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e9c04d070 con 0x55c14c18ace0 2024-09-22T08:36:46.016 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.004+0000 7f5ea484c640 1 -- 172.21.15.142:0/3605576910 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f5e8c078040 con 0x7f5e94027020 2024-09-22T08:36:46.016 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.004+0000 7f5ea384a640 1 -- 172.21.15.142:0/3605576910 <== osd.0 v2:172.21.15.31:6800/168281188 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e8c061430 con 0x7f5e94027020 2024-09-22T08:36:46.016 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.004+0000 7f5ea384a640 1 -- 172.21.15.142:0/3605576910 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f5e8c078040 con 0x55c14c1865e0 2024-09-22T08:36:46.016 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.004+0000 7f5ea384a640 1 -- 172.21.15.142:0/3605576910 <== osd.1 v2:172.21.15.142:6816/3192108003 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f5e8c061430 con 0x55c14c1865e0 2024-09-22T08:36:46.016 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.004+0000 7f5ea384a640 1 -- 172.21.15.142:0/3605576910 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f5e8c078040 con 0x7f5e9c040040 2024-09-22T08:36:46.017 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.005+0000 7f5ea404b640 1 -- 172.21.15.142:0/3605576910 <== osd.2 v2:172.21.15.142:6808/279438927 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e9400f030 con 0x7f5e9c040040 2024-09-22T08:36:46.017 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.005+0000 7f5ea8326800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:36:46.017 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.005+0000 7f5ea8326800 20 RGWRados::pool_iterate: got zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec 2024-09-22T08:36:46.017 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.005+0000 7f5ea8326800 20 RGWRados::pool_iterate: got zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f 2024-09-22T08:36:46.017 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.005+0000 7f5ea8326800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:36:46.017 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.005+0000 7f5ea8326800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:36:46.017 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.005+0000 7f5ea8326800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:36:46.017 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.005+0000 7f5ea8326800 20 rados->read ofs=0 len=0 2024-09-22T08:36:46.017 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.005+0000 7f5ea8326800 1 -- 172.21.15.142:0/3605576910 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c14c18e310 con 0x55c14c1865e0 2024-09-22T08:36:46.017 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.005+0000 7f5ea384a640 1 -- 172.21.15.142:0/3605576910 <== osd.1 v2:172.21.15.142:6816/3192108003 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5e8c061430 con 0x55c14c1865e0 2024-09-22T08:36:46.017 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.005+0000 7f5ea8326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:46.017 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.005+0000 7f5ea8326800 20 rados->read ofs=0 len=0 2024-09-22T08:36:46.017 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.005+0000 7f5ea8326800 1 -- 172.21.15.142:0/3605576910 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c14c18ebb0 con 0x55c14c1865e0 2024-09-22T08:36:46.017 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.005+0000 7f5ea384a640 1 -- 172.21.15.142:0/3605576910 <== osd.1 v2:172.21.15.142:6816/3192108003 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5e8c061430 con 0x55c14c1865e0 2024-09-22T08:36:46.018 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.005+0000 7f5ea8326800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:36:46.018 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.005+0000 7f5ea8326800 20 rados->read ofs=0 len=0 2024-09-22T08:36:46.018 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.005+0000 7f5ea8326800 1 -- 172.21.15.142:0/3605576910 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:40 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c14c18df50 con 0x55c14c18ace0 2024-09-22T08:36:46.018 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.005+0000 7f5ea484c640 1 -- 172.21.15.142:0/3605576910 <== osd.3 v2:172.21.15.142:6800/1064901393 11 ==== osd_op_reply(40 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f5e9c04d070 con 0x55c14c18ace0 2024-09-22T08:36:46.018 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.005+0000 7f5ea8326800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:36:46.018 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.005+0000 7f5ea8326800 20 zone default found 2024-09-22T08:36:46.018 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.005+0000 7f5ea8326800 4 Realm: () 2024-09-22T08:36:46.018 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.005+0000 7f5ea8326800 4 ZoneGroup: default (d89f6f57-1007-47dd-9065-f486c7b01aec) 2024-09-22T08:36:46.018 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.005+0000 7f5ea8326800 4 Zone: default (e239248c-0bee-4e41-803a-24b288d3eb8f) 2024-09-22T08:36:46.018 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.005+0000 7f5ea8326800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:36:46.018 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.005+0000 7f5ea8326800 20 zonegroup default 2024-09-22T08:36:46.018 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.005+0000 7f5ea8326800 20 rados->read ofs=0 len=0 2024-09-22T08:36:46.018 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.005+0000 7f5ea8326800 1 -- 172.21.15.142:0/3605576910 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c14c18fb90 con 0x7f5e94027020 2024-09-22T08:36:46.019 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.006+0000 7f5ea384a640 1 -- 172.21.15.142:0/3605576910 <== osd.0 v2:172.21.15.31:6800/168281188 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f5e8c061430 con 0x7f5e94027020 2024-09-22T08:36:46.019 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.006+0000 7f5ea8326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:46.019 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.006+0000 7f5ea8326800 20 rados->read ofs=0 len=0 2024-09-22T08:36:46.019 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.006+0000 7f5ea8326800 1 -- 172.21.15.142:0/3605576910 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c14c191680 con 0x55c14c18ace0 2024-09-22T08:36:46.019 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.006+0000 7f5ea484c640 1 -- 172.21.15.142:0/3605576910 <== osd.3 v2:172.21.15.142:6800/1064901393 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5e9c04d070 con 0x55c14c18ace0 2024-09-22T08:36:46.019 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.006+0000 7f5ea8326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:46.019 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.006+0000 7f5ea8326800 20 rados->read ofs=0 len=0 2024-09-22T08:36:46.019 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.006+0000 7f5ea8326800 1 -- 172.21.15.142:0/3605576910 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c14c191af0 con 0x55c14c18ace0 2024-09-22T08:36:46.019 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.006+0000 7f5ea484c640 1 -- 172.21.15.142:0/3605576910 <== osd.3 v2:172.21.15.142:6800/1064901393 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5e9c04d070 con 0x55c14c18ace0 2024-09-22T08:36:46.019 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.006+0000 7f5ea8326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:46.019 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.006+0000 7f5ea8326800 20 started sync module instance, tier type = 2024-09-22T08:36:46.019 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.006+0000 7f5ea8326800 20 started zone id=e239248c-0bee-4e41-803a-24b288d3eb8f (name=default) with tier type = 2024-09-22T08:36:46.019 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.006+0000 7f5ea8326800 1 -- 172.21.15.142:0/3605576910 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c14c1909c0 con 0x7f5e9c040040 2024-09-22T08:36:46.019 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.007+0000 7f5ea404b640 1 -- 172.21.15.142:0/3605576910 <== osd.2 v2:172.21.15.142:6808/279438927 7 ==== osd_op_reply(44 notify.0 [create] v30'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e9400f030 con 0x7f5e9c040040 2024-09-22T08:36:46.020 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.007+0000 7f5ea8326800 1 -- 172.21.15.142:0/3605576910 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94288693757200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c14c191f50 con 0x7f5e9c040040 2024-09-22T08:36:46.020 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.007+0000 7f5ea8326800 1 -- 172.21.15.142:0/3605576910 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c14c1927a0 con 0x55c14c1865e0 2024-09-22T08:36:46.020 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.008+0000 7f5ea404b640 1 -- 172.21.15.142:0/3605576910 <== osd.2 v2:172.21.15.142:6808/279438927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94288693757200] v30'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e9400f030 con 0x7f5e9c040040 2024-09-22T08:36:46.020 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.009+0000 7f5ea384a640 1 -- 172.21.15.142:0/3605576910 <== osd.1 v2:172.21.15.142:6816/3192108003 15 ==== osd_op_reply(46 notify.1 [create] v30'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e8c061430 con 0x55c14c1865e0 2024-09-22T08:36:46.020 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.009+0000 7f5ea8326800 1 -- 172.21.15.142:0/3605576910 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94288693764848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c14c192bc0 con 0x55c14c1865e0 2024-09-22T08:36:46.020 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.009+0000 7f5ea8326800 1 -- 172.21.15.142:0/3605576910 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c14c193490 con 0x55c14c18ace0 2024-09-22T08:36:46.020 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.010+0000 7f5ea484c640 1 -- 172.21.15.142:0/3605576910 <== osd.3 v2:172.21.15.142:6800/1064901393 14 ==== osd_op_reply(48 notify.2 [create] v30'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e9c04d070 con 0x55c14c18ace0 2024-09-22T08:36:46.020 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.010+0000 7f5ea8326800 1 -- 172.21.15.142:0/3605576910 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94288693767104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c14c193020 con 0x55c14c18ace0 2024-09-22T08:36:46.020 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.010+0000 7f5ea8326800 1 -- 172.21.15.142:0/3605576910 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c14c194460 con 0x7f5e9c040040 2024-09-22T08:36:46.020 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.010+0000 7f5ea384a640 1 -- 172.21.15.142:0/3605576910 <== osd.1 v2:172.21.15.142:6816/3192108003 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94288693764848] v30'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e8c061430 con 0x55c14c1865e0 2024-09-22T08:36:46.020 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.011+0000 7f5ea404b640 1 -- 172.21.15.142:0/3605576910 <== osd.2 v2:172.21.15.142:6808/279438927 9 ==== osd_op_reply(50 notify.3 [create] v30'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e9400f030 con 0x7f5e9c040040 2024-09-22T08:36:46.020 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.011+0000 7f5ea8326800 1 -- 172.21.15.142:0/3605576910 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94288693772112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c14c194850 con 0x7f5e9c040040 2024-09-22T08:36:46.020 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.011+0000 7f5ea8326800 1 -- 172.21.15.142:0/3605576910 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c14c1952a0 con 0x55c14c1865e0 2024-09-22T08:36:46.021 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.011+0000 7f5ea484c640 1 -- 172.21.15.142:0/3605576910 <== osd.3 v2:172.21.15.142:6800/1064901393 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94288693767104] v30'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e9c04d070 con 0x55c14c18ace0 2024-09-22T08:36:46.021 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.012+0000 7f5ea384a640 1 -- 172.21.15.142:0/3605576910 <== osd.1 v2:172.21.15.142:6816/3192108003 17 ==== osd_op_reply(52 notify.4 [create] v30'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e8c061430 con 0x55c14c1865e0 2024-09-22T08:36:46.021 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.012+0000 7f5ea8326800 1 -- 172.21.15.142:0/3605576910 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94288693775760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c14c195260 con 0x55c14c1865e0 2024-09-22T08:36:46.021 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.012+0000 7f5ea8326800 1 -- 172.21.15.142:0/3605576910 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c14c195d30 con 0x7f5e94027020 2024-09-22T08:36:46.021 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.012+0000 7f5ea404b640 1 -- 172.21.15.142:0/3605576910 <== osd.2 v2:172.21.15.142:6808/279438927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94288693772112] v30'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e9400f030 con 0x7f5e9c040040 2024-09-22T08:36:46.027 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.013+0000 7f5ea384a640 1 -- 172.21.15.142:0/3605576910 <== osd.0 v2:172.21.15.31:6800/168281188 11 ==== osd_op_reply(54 notify.5 [create] v30'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e8c061430 con 0x7f5e94027020 2024-09-22T08:36:46.027 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.013+0000 7f5ea8326800 1 -- 172.21.15.142:0/3605576910 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94288693778432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c14c195cf0 con 0x7f5e94027020 2024-09-22T08:36:46.027 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.013+0000 7f5ea8326800 1 -- 172.21.15.142:0/3605576910 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c14c196780 con 0x7f5e94027020 2024-09-22T08:36:46.027 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.013+0000 7f5ea384a640 1 -- 172.21.15.142:0/3605576910 <== osd.1 v2:172.21.15.142:6816/3192108003 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94288693775760] v30'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e8c061430 con 0x55c14c1865e0 2024-09-22T08:36:46.028 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.014+0000 7f5ea384a640 1 -- 172.21.15.142:0/3605576910 <== osd.0 v2:172.21.15.31:6800/168281188 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94288693778432] v30'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e8c061430 con 0x7f5e94027020 2024-09-22T08:36:46.028 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.014+0000 7f5ea384a640 1 -- 172.21.15.142:0/3605576910 <== osd.0 v2:172.21.15.31:6800/168281188 13 ==== osd_op_reply(56 notify.6 [create] v30'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e8c061430 con 0x7f5e94027020 2024-09-22T08:36:46.028 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.014+0000 7f5ea8326800 1 -- 172.21.15.142:0/3605576910 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94288693765904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c14c193880 con 0x7f5e94027020 2024-09-22T08:36:46.028 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.014+0000 7f5ea8326800 1 -- 172.21.15.142:0/3605576910 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c14c196c30 con 0x7f5e94027020 2024-09-22T08:36:46.028 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.015+0000 7f5ea384a640 1 -- 172.21.15.142:0/3605576910 <== osd.0 v2:172.21.15.31:6800/168281188 14 ==== osd_op_reply(58 notify.7 [create] v30'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e8c061430 con 0x7f5e94027020 2024-09-22T08:36:46.028 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.015+0000 7f5ea384a640 1 -- 172.21.15.142:0/3605576910 <== osd.0 v2:172.21.15.31:6800/168281188 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94288693765904] v30'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e8c061430 con 0x7f5e94027020 2024-09-22T08:36:46.028 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.015+0000 7f5ea8326800 1 -- 172.21.15.142:0/3605576910 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94288693782400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c14c196ba0 con 0x7f5e94027020 2024-09-22T08:36:46.028 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.015+0000 7f5ea8326800 20 add_watcher() i=0 2024-09-22T08:36:46.028 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.015+0000 7f5ea8326800 20 add_watcher() i=1 2024-09-22T08:36:46.028 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.015+0000 7f5ea8326800 20 add_watcher() i=2 2024-09-22T08:36:46.028 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.015+0000 7f5ea8326800 20 add_watcher() i=3 2024-09-22T08:36:46.028 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.015+0000 7f5ea8326800 20 add_watcher() i=4 2024-09-22T08:36:46.028 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.015+0000 7f5ea8326800 20 add_watcher() i=5 2024-09-22T08:36:46.029 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.015+0000 7f5ea8326800 20 add_watcher() i=6 2024-09-22T08:36:46.029 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.016+0000 7f5ea384a640 1 -- 172.21.15.142:0/3605576910 <== osd.0 v2:172.21.15.31:6800/168281188 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94288693782400] v30'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e8c061430 con 0x7f5e94027020 2024-09-22T08:36:46.029 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.016+0000 7f5ea8326800 20 add_watcher() i=7 2024-09-22T08:36:46.029 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.016+0000 7f5ea8326800 2 all 8 watchers are set, enabling cache 2024-09-22T08:36:46.029 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.016+0000 7f5ea8326800 1 -- 172.21.15.142:0/3605576910 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c14c19a500 con 0x55c14c1865e0 2024-09-22T08:36:46.029 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.016+0000 7f5ea384a640 1 -- 172.21.15.142:0/3605576910 <== osd.1 v2:172.21.15.142:6816/3192108003 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f5e8c061430 con 0x55c14c1865e0 2024-09-22T08:36:46.029 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.016+0000 7f5ea8326800 1 -- 172.21.15.142:0/3605576910 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94288693784528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c14c1978a0 con 0x55c14c1865e0 2024-09-22T08:36:46.029 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.017+0000 7f5ea384a640 1 -- 172.21.15.142:0/3605576910 <== osd.1 v2:172.21.15.142:6816/3192108003 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94288693784528] v30'98 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5e8c061430 con 0x55c14c1865e0 2024-09-22T08:36:46.029 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.017+0000 7f5d5a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:36:46.029 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.017+0000 7f5ea8326800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:36:46.029 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.017+0000 7f5ea8326800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:36:46.029 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.017+0000 7f5ea8326800 5 note: GC not initialized 2024-09-22T08:36:46.029 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.017+0000 7f5d597e2640 20 reqs_thread_entry: start 2024-09-22T08:36:46.029 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.017+0000 7f5ea8326800 20 init_complete bucket index max shards: 11 2024-09-22T08:36:46.030 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.018+0000 7f5ea8326800 20 Filter name: none 2024-09-22T08:36:46.030 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.018+0000 7f5ccaffd640 20 reqs_thread_entry: start 2024-09-22T08:36:46.030 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.018+0000 7f5ea8326800 20 rados->read ofs=0 len=0 2024-09-22T08:36:46.030 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.018+0000 7f5ea8326800 1 -- 172.21.15.142:0/3605576910 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c14c1cd040 con 0x55c14c1865e0 2024-09-22T08:36:46.030 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.018+0000 7f5ea384a640 1 -- 172.21.15.142:0/3605576910 <== osd.1 v2:172.21.15.142:6816/3192108003 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f5e8c061430 con 0x55c14c1865e0 2024-09-22T08:36:46.030 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.018+0000 7f5ea8326800 20 rados_obj.operate() r=0 bl.length=391 2024-09-22T08:36:46.030 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.018+0000 7f5ea8326800 20 rados->read ofs=0 len=0 2024-09-22T08:36:46.030 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.018+0000 7f5ea8326800 1 -- 172.21.15.142:0/3605576910 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c14c1cda60 con 0x55c14c1865e0 2024-09-22T08:36:46.030 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.018+0000 7f5ea384a640 1 -- 172.21.15.142:0/3605576910 <== osd.1 v2:172.21.15.142:6816/3192108003 22 ==== osd_op_reply(63 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f5e8c081040 con 0x55c14c1865e0 2024-09-22T08:36:46.030 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.018+0000 7f5ea8326800 20 rados_obj.operate() r=0 bl.length=391 2024-09-22T08:36:46.030 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.019+0000 7f5ea8326800 1 -- 172.21.15.142:0/3605576910 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:64 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c14c1cea70 con 0x7f5e9c040040 2024-09-22T08:36:46.030 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.019+0000 7f5ea404b640 1 -- 172.21.15.142:0/3605576910 <== osd.2 v2:172.21.15.142:6808/279438927 11 ==== osd_op_reply(64 foo.buckets [call out=183b] v0'0 uv14 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f5e9400f030 con 0x7f5e9c040040 2024-09-22T08:36:46.030 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.019+0000 7f5ea8326800 20 rados->read ofs=0 len=0 2024-09-22T08:36:46.031 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.019+0000 7f5ea8326800 1 -- 172.21.15.142:0/3605576910 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:65 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c14c1cc060 con 0x7f5e9c040040 2024-09-22T08:36:46.031 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.019+0000 7f5ea404b640 1 -- 172.21.15.142:0/3605576910 <== osd.2 v2:172.21.15.142:6808/279438927 12 ==== osd_op_reply(65 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f5e9400f030 con 0x7f5e9c040040 2024-09-22T08:36:46.031 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.019+0000 7f5ea8326800 20 rados_obj.operate() r=0 bl.length=165 2024-09-22T08:36:46.031 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.019+0000 7f5ea8326800 20 rados->read ofs=0 len=0 2024-09-22T08:36:46.031 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.019+0000 7f5ea8326800 1 -- 172.21.15.142:0/3605576910 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:66 8.15 8:ab67ca09:root::.bucket.meta.myfoo%3ae239248c-0bee-4e41-803a-24b288d3eb8f.4226.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c14c1cea70 con 0x55c14c18ace0 2024-09-22T08:36:46.031 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.020+0000 7f5ea484c640 1 -- 172.21.15.142:0/3605576910 <== osd.3 v2:172.21.15.142:6800/1064901393 16 ==== osd_op_reply(66 .bucket.meta.myfoo:e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7f5e9c04d070 con 0x55c14c18ace0 2024-09-22T08:36:46.031 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.020+0000 7f5ea8326800 20 rados_obj.operate() r=0 bl.length=387 2024-09-22T08:36:46.031 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.020+0000 7f5ea8326800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:36:46.031 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.020+0000 7f5ea8326800 1 -- 172.21.15.142:0/3605576910 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:67 4.12 4:48caaf34:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c14c1d0310 con 0x55c14c1865e0 2024-09-22T08:36:46.031 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.020+0000 7f5ea8326800 1 -- 172.21.15.142:0/3605576910 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:68 4.10 4:09af3fe1:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c14c1d2eb0 con 0x55c14c18ace0 2024-09-22T08:36:46.031 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.020+0000 7f5ea8326800 1 -- 172.21.15.142:0/3605576910 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:69 4.12 4:49def6fa:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c14c1d5810 con 0x55c14c1865e0 2024-09-22T08:36:46.031 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.020+0000 7f5ea8326800 1 -- 172.21.15.142:0/3605576910 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:70 4.2 4:4255cd8e:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c14c1d7ce0 con 0x55c14c1865e0 2024-09-22T08:36:46.031 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.020+0000 7f5ea8326800 1 -- 172.21.15.142:0/3605576910 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:71 4.c 4:323d0659:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c14c1da370 con 0x55c14c1865e0 2024-09-22T08:36:46.032 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.020+0000 7f5ea8326800 1 -- 172.21.15.142:0/3605576910 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:72 4.20 4:061d9e92:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c14c1dcd40 con 0x55c14c1865e0 2024-09-22T08:36:46.032 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.020+0000 7f5ea484c640 1 -- 172.21.15.142:0/3605576910 <== osd.3 v2:172.21.15.142:6800/1064901393 17 ==== osd_op_reply(68 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1.1 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f5e9c04d070 con 0x55c14c18ace0 2024-09-22T08:36:46.032 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.020+0000 7f5ea8326800 1 -- 172.21.15.142:0/3605576910 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:73 4.3b 4:dc8435be:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c14c1d2880 con 0x55c14c18ace0 2024-09-22T08:36:46.032 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.020+0000 7f5ea8326800 1 -- 172.21.15.142:0/3605576910 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:74 4.22 4:44b3b4fd:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c14c1d1010 con 0x55c14c1865e0 2024-09-22T08:36:46.032 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.020+0000 7f5ea8326800 1 -- 172.21.15.142:0/3605576910 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:75 4.2d 4:b74eadf4:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c14c1d1010 con 0x7f5e94027020 2024-09-22T08:36:46.032 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.020+0000 7f5ea8326800 1 -- 172.21.15.142:0/3605576910 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:76 4.12 4:4be25f13:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c14c1e5060 con 0x55c14c1865e0 2024-09-22T08:36:46.032 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.020+0000 7f5ea8326800 1 -- 172.21.15.142:0/3605576910 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:77 4.5 4:a0e4e0ec:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c14c1e7910 con 0x55c14c18ace0 2024-09-22T08:36:46.032 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.020+0000 7f5ea484c640 1 -- 172.21.15.142:0/3605576910 <== osd.3 v2:172.21.15.142:6800/1064901393 18 ==== osd_op_reply(73 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1.6 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f5e9c04d070 con 0x55c14c18ace0 2024-09-22T08:36:46.032 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.020+0000 7f5ea384a640 1 -- 172.21.15.142:0/3605576910 <== osd.1 v2:172.21.15.142:6816/3192108003 23 ==== osd_op_reply(67 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1.0 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f5e8c081040 con 0x55c14c1865e0 2024-09-22T08:36:46.032 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.020+0000 7f5ea384a640 1 -- 172.21.15.142:0/3605576910 <== osd.1 v2:172.21.15.142:6816/3192108003 24 ==== osd_op_reply(71 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1.4 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f5e8c081040 con 0x55c14c1865e0 2024-09-22T08:36:46.032 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.020+0000 7f5ea384a640 1 -- 172.21.15.142:0/3605576910 <== osd.1 v2:172.21.15.142:6816/3192108003 25 ==== osd_op_reply(69 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1.2 [call out=89b] v0'0 uv2 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f5e8c081040 con 0x55c14c1865e0 2024-09-22T08:36:46.032 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.020+0000 7f5ea384a640 1 -- 172.21.15.142:0/3605576910 <== osd.1 v2:172.21.15.142:6816/3192108003 26 ==== osd_op_reply(70 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1.3 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f5e8c081040 con 0x55c14c1865e0 2024-09-22T08:36:46.032 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.020+0000 7f5ea384a640 1 -- 172.21.15.142:0/3605576910 <== osd.1 v2:172.21.15.142:6816/3192108003 27 ==== osd_op_reply(72 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1.5 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f5e8c081040 con 0x55c14c1865e0 2024-09-22T08:36:46.033 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.020+0000 7f5ea384a640 1 -- 172.21.15.142:0/3605576910 <== osd.1 v2:172.21.15.142:6816/3192108003 28 ==== osd_op_reply(74 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1.7 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f5e8c081040 con 0x55c14c1865e0 2024-09-22T08:36:46.033 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.021+0000 7f5ea384a640 1 -- 172.21.15.142:0/3605576910 <== osd.1 v2:172.21.15.142:6816/3192108003 29 ==== osd_op_reply(76 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1.9 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f5e8c081040 con 0x55c14c1865e0 2024-09-22T08:36:46.033 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.021+0000 7f5ea484c640 1 -- 172.21.15.142:0/3605576910 <== osd.3 v2:172.21.15.142:6800/1064901393 19 ==== osd_op_reply(77 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1.10 [call out=89b] v0'0 uv1 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f5e9c04d070 con 0x55c14c18ace0 2024-09-22T08:36:46.033 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.021+0000 7f5ea384a640 1 -- 172.21.15.142:0/3605576910 <== osd.0 v2:172.21.15.31:6800/168281188 17 ==== osd_op_reply(75 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1.8 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f5e8c081040 con 0x7f5e94027020 2024-09-22T08:36:46.033 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.021+0000 7f5d5a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:36:46.033 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.021+0000 7f5ea8326800 1 -- 172.21.15.142:0/3605576910 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:78 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94288693784528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c14c1d1a00 con 0x55c14c1865e0 2024-09-22T08:36:46.033 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.022+0000 7f5ea384a640 1 -- 172.21.15.142:0/3605576910 <== osd.1 v2:172.21.15.142:6816/3192108003 30 ==== osd_op_reply(78 data_loggenerations_metadata [watch unwatch cookie 94288693784528] v30'99 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5e8c081040 con 0x55c14c1865e0 2024-09-22T08:36:46.033 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.023+0000 7f5ea8326800 1 -- 172.21.15.142:0/3605576910 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:79 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94288693757200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c14c1d1a00 con 0x7f5e9c040040 2024-09-22T08:36:46.033 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.023+0000 7f5ea404b640 1 -- 172.21.15.142:0/3605576910 <== osd.2 v2:172.21.15.142:6808/279438927 13 ==== osd_op_reply(79 notify.0 [watch unwatch cookie 94288693757200] v30'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e9400f030 con 0x7f5e9c040040 2024-09-22T08:36:46.033 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.023+0000 7f5ea8326800 20 remove_watcher() i=0 2024-09-22T08:36:46.033 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.023+0000 7f5ea8326800 2 removed watcher, disabling cache 2024-09-22T08:36:46.033 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.023+0000 7f5ea8326800 1 -- 172.21.15.142:0/3605576910 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:80 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94288693764848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c14c190510 con 0x55c14c1865e0 2024-09-22T08:36:46.033 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.025+0000 7f5ea384a640 1 -- 172.21.15.142:0/3605576910 <== osd.1 v2:172.21.15.142:6816/3192108003 31 ==== osd_op_reply(80 notify.1 [watch unwatch cookie 94288693764848] v30'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e8c081040 con 0x55c14c1865e0 2024-09-22T08:36:46.033 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.025+0000 7f5ea8326800 20 remove_watcher() i=1 2024-09-22T08:36:46.034 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.025+0000 7f5ea8326800 1 -- 172.21.15.142:0/3605576910 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:81 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94288693767104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c14c190510 con 0x55c14c18ace0 2024-09-22T08:36:46.034 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.026+0000 7f5ea484c640 1 -- 172.21.15.142:0/3605576910 <== osd.3 v2:172.21.15.142:6800/1064901393 20 ==== osd_op_reply(81 notify.2 [watch unwatch cookie 94288693767104] v30'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e9c04d070 con 0x55c14c18ace0 2024-09-22T08:36:46.034 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.026+0000 7f5ea8326800 20 remove_watcher() i=2 2024-09-22T08:36:46.034 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.026+0000 7f5ea8326800 1 -- 172.21.15.142:0/3605576910 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:82 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94288693772112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c14c192bc0 con 0x7f5e9c040040 2024-09-22T08:36:46.037 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.026+0000 7f5ea404b640 1 -- 172.21.15.142:0/3605576910 <== osd.2 v2:172.21.15.142:6808/279438927 14 ==== osd_op_reply(82 notify.3 [watch unwatch cookie 94288693772112] v30'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e9400f030 con 0x7f5e9c040040 2024-09-22T08:36:46.038 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.027+0000 7f5ea8326800 20 remove_watcher() i=3 2024-09-22T08:36:46.038 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.027+0000 7f5ea8326800 1 -- 172.21.15.142:0/3605576910 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:83 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94288693775760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c14c190510 con 0x55c14c1865e0 2024-09-22T08:36:46.038 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.027+0000 7f5ea384a640 1 -- 172.21.15.142:0/3605576910 <== osd.1 v2:172.21.15.142:6816/3192108003 32 ==== osd_op_reply(83 notify.4 [watch unwatch cookie 94288693775760] v30'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e8c081040 con 0x55c14c1865e0 2024-09-22T08:36:46.038 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.028+0000 7f5ea8326800 20 remove_watcher() i=4 2024-09-22T08:36:46.038 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.028+0000 7f5ea8326800 1 -- 172.21.15.142:0/3605576910 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:84 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94288693778432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c14c193f50 con 0x7f5e94027020 2024-09-22T08:36:46.038 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.028+0000 7f5ea384a640 1 -- 172.21.15.142:0/3605576910 <== osd.0 v2:172.21.15.31:6800/168281188 18 ==== osd_op_reply(84 notify.5 [watch unwatch cookie 94288693778432] v30'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e8c081040 con 0x7f5e94027020 2024-09-22T08:36:46.038 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.028+0000 7f5ea8326800 20 remove_watcher() i=5 2024-09-22T08:36:46.038 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.029+0000 7f5ea8326800 1 -- 172.21.15.142:0/3605576910 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:85 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94288693765904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c14c194d90 con 0x7f5e94027020 2024-09-22T08:36:46.038 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.029+0000 7f5ea384a640 1 -- 172.21.15.142:0/3605576910 <== osd.0 v2:172.21.15.31:6800/168281188 19 ==== osd_op_reply(85 notify.6 [watch unwatch cookie 94288693765904] v30'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e8c081040 con 0x7f5e94027020 2024-09-22T08:36:46.038 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.029+0000 7f5ea8326800 20 remove_watcher() i=6 2024-09-22T08:36:46.038 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.029+0000 7f5ea8326800 1 -- 172.21.15.142:0/3605576910 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:86 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94288693782400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c14c190510 con 0x7f5e94027020 2024-09-22T08:36:46.038 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.030+0000 7f5ea384a640 1 -- 172.21.15.142:0/3605576910 <== osd.0 v2:172.21.15.31:6800/168281188 20 ==== osd_op_reply(86 notify.7 [watch unwatch cookie 94288693782400] v30'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e8c081040 con 0x7f5e94027020 2024-09-22T08:36:46.039 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.030+0000 7f5ea8326800 20 remove_watcher() i=7 2024-09-22T08:36:46.039 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.030+0000 7f5ea8326800 1 -- 172.21.15.142:0/3605576910 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f5e94027020 msgr2=0x7f5e9404b6c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:46.039 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.030+0000 7f5ea8326800 1 --2- 172.21.15.142:0/3605576910 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f5e94027020 0x7f5e9404b6c0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:46.039 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.030+0000 7f5ea8326800 1 -- 172.21.15.142:0/3605576910 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55c14c1865e0 msgr2=0x55c14c188aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:46.039 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.030+0000 7f5ea8326800 1 --2- 172.21.15.142:0/3605576910 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55c14c1865e0 0x55c14c188aa0 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:46.039 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.030+0000 7f5ea8326800 1 -- 172.21.15.142:0/3605576910 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f5e9c040040 msgr2=0x7f5e9c04eab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:46.039 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.030+0000 7f5ea8326800 1 --2- 172.21.15.142:0/3605576910 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f5e9c040040 0x7f5e9c04eab0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:46.039 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.030+0000 7f5ea8326800 1 -- 172.21.15.142:0/3605576910 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55c14c18ace0 msgr2=0x55c14c18d0d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:46.039 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.030+0000 7f5ea8326800 1 --2- 172.21.15.142:0/3605576910 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55c14c18ace0 0x55c14c18d0d0 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:46.039 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.031+0000 7f5ea8326800 1 -- 172.21.15.142:0/3605576910 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f5d6c03d000 msgr2=0x7f5d6c03f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:46.039 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.031+0000 7f5ea8326800 1 --2- 172.21.15.142:0/3605576910 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f5d6c03d000 0x7f5d6c03f4c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f5e94000f80 tx=0x7f5e94050000 comp rx=0 tx=0).stop 2024-09-22T08:36:46.039 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.031+0000 7f5ea8326800 1 -- 172.21.15.142:0/3605576910 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c14c1736b0 msgr2=0x55c14c17acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:46.039 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.031+0000 7f5ea384a640 1 -- 172.21.15.142:0/3605576910 reap_dead start 2024-09-22T08:36:46.040 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.031+0000 7f5ea8326800 1 --2- 172.21.15.142:0/3605576910 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c14c1736b0 0x55c14c17acb0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f5e9c0540f0 tx=0x7f5e9c053ce0 comp rx=0 tx=0).stop 2024-09-22T08:36:46.040 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.031+0000 7f5ea8326800 1 -- 172.21.15.142:0/3605576910 shutdown_connections 2024-09-22T08:36:46.040 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.031+0000 7f5ea8326800 1 --2- 172.21.15.142:0/3605576910 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c14c1736b0 0x55c14c17acb0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:46.040 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.031+0000 7f5ea8326800 1 -- 172.21.15.142:0/3605576910 >> 172.21.15.142:0/3605576910 conn(0x55c14c16fab0 msgr2=0x55c14c16dcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:46.040 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.031+0000 7f5ea8326800 1 -- 172.21.15.142:0/3605576910 shutdown_connections 2024-09-22T08:36:46.040 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.031+0000 7f5ea8326800 1 -- 172.21.15.142:0/3605576910 wait complete. 2024-09-22T08:36:46.040 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.031+0000 7f5ea8326800 1 -- 172.21.15.142:0/3830947030 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f5d7c03d000 msgr2=0x7f5d7c03f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:46.040 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.031+0000 7f5ea8326800 1 --2- 172.21.15.142:0/3830947030 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f5d7c03d000 0x7f5d7c03f4c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x55c14c154690 tx=0x7f5e94012f70 comp rx=0 tx=0).stop 2024-09-22T08:36:46.040 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.031+0000 7f5ea8326800 1 -- 172.21.15.142:0/3830947030 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c14c166bd0 msgr2=0x55c14c166ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:46.040 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.031+0000 7f5ea8326800 1 --2- 172.21.15.142:0/3830947030 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c14c166bd0 0x55c14c166ff0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x55c14c14cb70 tx=0x7f5e9c00bf30 comp rx=0 tx=0).stop 2024-09-22T08:36:46.040 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.031+0000 7f5ea8326800 1 -- 172.21.15.142:0/3830947030 shutdown_connections 2024-09-22T08:36:46.040 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.031+0000 7f5ea8326800 1 --2- 172.21.15.142:0/3830947030 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f5d7c03d000 0x7f5d7c03f4c0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:46.040 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.031+0000 7f5ea8326800 1 --2- 172.21.15.142:0/3830947030 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c14c166bd0 0x55c14c166ff0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:46.040 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.031+0000 7f5ea8326800 1 -- 172.21.15.142:0/3830947030 >> 172.21.15.142:0/3830947030 conn(0x55c14c15af80 msgr2=0x55c14c15b360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:46.041 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.031+0000 7f5ea8326800 1 -- 172.21.15.142:0/3830947030 shutdown_connections 2024-09-22T08:36:46.041 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.031+0000 7f5ea8326800 1 -- 172.21.15.142:0/3830947030 wait complete. 2024-09-22T08:36:46.041 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.031+0000 7f5ea8326800 1 -- 172.21.15.142:0/112671327 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55c14c052bf0 msgr2=0x55c14c1531c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:46.041 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.031+0000 7f5ea8326800 1 --2- 172.21.15.142:0/112671327 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55c14c052bf0 0x55c14c1531c0 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:46.041 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.031+0000 7f5ea8326800 1 -- 172.21.15.142:0/112671327 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55c14c1555a0 msgr2=0x55c14c157a20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:46.041 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.031+0000 7f5ea8326800 1 --2- 172.21.15.142:0/112671327 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55c14c1555a0 0x55c14c157a20 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:46.041 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.032+0000 7f5ea8326800 1 -- 172.21.15.142:0/112671327 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f5d8c03d000 msgr2=0x7f5d8c03f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:46.041 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.032+0000 7f5ea8326800 1 --2- 172.21.15.142:0/112671327 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f5d8c03d000 0x7f5d8c03f4c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x55c14c050f20 tx=0x7f5e8c050000 comp rx=0 tx=0).stop 2024-09-22T08:36:46.041 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.032+0000 7f5ea8326800 1 -- 172.21.15.142:0/112671327 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c14c0517e0 msgr2=0x55c14c14bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:46.041 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.032+0000 7f5ea8326800 1 --2- 172.21.15.142:0/112671327 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c14c0517e0 0x55c14c14bb70 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f5e94007fd0 tx=0x7f5e94004460 comp rx=0 tx=0).stop 2024-09-22T08:36:46.041 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.032+0000 7f5ea8326800 1 -- 172.21.15.142:0/112671327 shutdown_connections 2024-09-22T08:36:46.041 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.032+0000 7f5ea8326800 1 --2- 172.21.15.142:0/112671327 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55c14c1555a0 0x55c14c157a20 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:46.041 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.032+0000 7f5ea8326800 1 --2- 172.21.15.142:0/112671327 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55c14c052bf0 0x55c14c1531c0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:46.041 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.032+0000 7f5ea8326800 1 --2- 172.21.15.142:0/112671327 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f5d8c03d000 0x7f5d8c03f4c0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:46.042 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.032+0000 7f5ea8326800 1 --2- 172.21.15.142:0/112671327 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c14c0517e0 0x55c14c14bb70 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:46.042 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.032+0000 7f5ea8326800 1 -- 172.21.15.142:0/112671327 >> 172.21.15.142:0/112671327 conn(0x55c14c04cbb0 msgr2=0x55c14c13aea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:46.042 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.032+0000 7f5ea8326800 1 -- 172.21.15.142:0/112671327 shutdown_connections 2024-09-22T08:36:46.042 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.032+0000 7f5ea8326800 1 -- 172.21.15.142:0/112671327 wait complete. 2024-09-22T08:36:46.043 INFO:teuthology.orchestra.run.smithi142.stdout:[{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"d89f6f57-1007-47dd-9065-f486c7b01aec","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1","marker":"e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1","index_type":"Normal","index_generation":0,"num_shards":11,"reshard_status":"None","judge_reshard_lock_time":"0.000000","object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-09-22T08:36:45.363175Z","creation_time":"2024-09-22T08:36:45.359780Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"read_tracker":1}] 2024-09-22T08:36:46.043 DEBUG:tasks.util.rgw: json result: [{'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': 'd89f6f57-1007-47dd-9065-f486c7b01aec', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': 'e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1', 'marker': 'e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'reshard_status': 'None', 'judge_reshard_lock_time': '0.000000', 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-22T08:36:45.363175Z', 'creation_time': '2024-09-22T08:36:45.359780Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'read_tracker': 1}] 2024-09-22T08:36:46.051 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-09-22T08:36:46.051 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--bucket', 'myfoo'] 2024-09-22T08:36:46.051 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--bucket', 'myfoo'] 2024-09-22T08:36:46.051 DEBUG:teuthology.orchestra.run.smithi142:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --bucket myfoo 2024-09-22T08:36:46.101 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:36:46.102 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:36:46.102 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.098+0000 7f867fd3e800 1 Processor -- start 2024-09-22T08:36:46.102 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.098+0000 7f867fd3e800 1 -- start start 2024-09-22T08:36:46.102 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.099+0000 7f867fd3e800 1 --2- >> v2:172.21.15.31:3300/0 conn(0x5623ab1a7fe0 0x5623ab1aff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:46.102 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.099+0000 7f867fd3e800 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5623ab034a20 con 0x5623ab1a7be0 2024-09-22T08:36:46.102 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.099+0000 7f867fd3e800 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x5623ab0347d0 con 0x5623ab1a7fe0 2024-09-22T08:36:46.103 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.099+0000 7f86732ec640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x5623ab1a7fe0 0x5623ab1aff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:46.103 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.099+0000 7f867baed640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x5623ab1a7be0 0x5623ab1ac850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.142:42522/0 (socket says 172.21.15.142:42522) 2024-09-22T08:36:46.103 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.099+0000 7f867baed640 1 -- 172.21.15.142:0/3478668651 learned_addr learned my addr 172.21.15.142:0/3478668651 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-09-22T08:36:46.103 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.099+0000 7f86732ec640 1 --2- 172.21.15.142:0/3478668651 >> v2:172.21.15.31:3300/0 conn(0x5623ab1a7fe0 0x5623ab1aff80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:39236/0 (socket says 172.21.15.142:39236) 2024-09-22T08:36:46.103 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.099+0000 7f86732ec640 1 -- 172.21.15.142:0/3478668651 >> v1:172.21.15.31:6789/0 conn(0x5623ab1a7be0 legacy=0x5623ab1ac850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:46.103 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.099+0000 7f86732ec640 1 -- 172.21.15.142:0/3478668651 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5623ab1b1590 con 0x5623ab1a7fe0 2024-09-22T08:36:46.104 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.099+0000 7f867b2ec640 1 -- 172.21.15.142:0/3478668651 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2811481625 0 0) 0x5623ab034a20 con 0x5623ab1a7be0 2024-09-22T08:36:46.105 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.101+0000 7f86732ec640 1 --2- 172.21.15.142:0/3478668651 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5623ab1a7fe0 0x5623ab1aff80 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f866400a470 tx=0x7f8664045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62180a34a82d7d8a server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:46.105 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.101+0000 7f867b2ec640 1 -- 172.21.15.142:0/3478668651 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8664053570 con 0x5623ab1a7fe0 2024-09-22T08:36:46.106 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.101+0000 7f867b2ec640 1 -- 172.21.15.142:0/3478668651 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8664058070 con 0x5623ab1a7fe0 2024-09-22T08:36:46.106 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.101+0000 7f867b2ec640 1 -- 172.21.15.142:0/3478668651 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8664053880 con 0x5623ab1a7fe0 2024-09-22T08:36:46.106 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.101+0000 7f867fd3e800 1 -- 172.21.15.142:0/3478668651 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5623ab1a7fe0 msgr2=0x5623ab1aff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:46.106 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.101+0000 7f867fd3e800 1 --2- 172.21.15.142:0/3478668651 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5623ab1a7fe0 0x5623ab1aff80 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f866400a470 tx=0x7f8664045a20 comp rx=0 tx=0).stop 2024-09-22T08:36:46.106 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.102+0000 7f867fd3e800 1 -- 172.21.15.142:0/3478668651 shutdown_connections 2024-09-22T08:36:46.106 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.102+0000 7f867fd3e800 1 --2- 172.21.15.142:0/3478668651 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5623ab1a7fe0 0x5623ab1aff80 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:46.106 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.102+0000 7f867fd3e800 1 -- 172.21.15.142:0/3478668651 >> 172.21.15.142:0/3478668651 conn(0x5623ab1a3310 msgr2=0x5623ab1a5790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:46.106 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.102+0000 7f867fd3e800 1 -- 172.21.15.142:0/3478668651 shutdown_connections 2024-09-22T08:36:46.107 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.102+0000 7f867fd3e800 1 -- 172.21.15.142:0/3478668651 wait complete. 2024-09-22T08:36:46.122 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.115+0000 7f867fd3e800 1 Processor -- start 2024-09-22T08:36:46.122 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.115+0000 7f867fd3e800 1 -- start start 2024-09-22T08:36:46.123 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.115+0000 7f867fd3e800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5623ab1a7be0 0x5623ab298e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:46.123 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.115+0000 7f867fd3e800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5623ab041dd0 con 0x5623ab1a7be0 2024-09-22T08:36:46.123 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.116+0000 7f867baed640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5623ab1a7be0 0x5623ab298e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:46.123 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.116+0000 7f867baed640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5623ab1a7be0 0x5623ab298e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:39248/0 (socket says 172.21.15.142:39248) 2024-09-22T08:36:46.123 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.116+0000 7f867baed640 1 -- 172.21.15.142:0/3150972100 learned_addr learned my addr 172.21.15.142:0/3150972100 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:46.123 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.116+0000 7f867baed640 1 -- 172.21.15.142:0/3150972100 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5623ab299480 con 0x5623ab1a7be0 2024-09-22T08:36:46.123 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.116+0000 7f867baed640 1 --2- 172.21.15.142:0/3150972100 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5623ab1a7be0 0x5623ab298e90 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f866c001ea0 tx=0x7f866c00b6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88989866921ad8c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:46.123 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.116+0000 7f8569e0b640 1 -- 172.21.15.142:0/3150972100 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f866c008070 con 0x5623ab1a7be0 2024-09-22T08:36:46.123 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.116+0000 7f8569e0b640 1 -- 172.21.15.142:0/3150972100 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f866c00d500 con 0x5623ab1a7be0 2024-09-22T08:36:46.124 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.116+0000 7f8569e0b640 1 -- 172.21.15.142:0/3150972100 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f866c00d880 con 0x5623ab1a7be0 2024-09-22T08:36:46.124 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.117+0000 7f867fd3e800 1 -- 172.21.15.142:0/3150972100 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5623ab1a7be0 msgr2=0x5623ab298e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:46.124 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.117+0000 7f867fd3e800 1 --2- 172.21.15.142:0/3150972100 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5623ab1a7be0 0x5623ab298e90 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f866c001ea0 tx=0x7f866c00b6a0 comp rx=0 tx=0).stop 2024-09-22T08:36:46.124 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.117+0000 7f867fd3e800 1 -- 172.21.15.142:0/3150972100 shutdown_connections 2024-09-22T08:36:46.124 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.117+0000 7f867fd3e800 1 --2- 172.21.15.142:0/3150972100 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5623ab1a7be0 0x5623ab298e90 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:46.124 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.117+0000 7f867fd3e800 1 -- 172.21.15.142:0/3150972100 >> 172.21.15.142:0/3150972100 conn(0x5623ab1a3310 msgr2=0x5623ab294810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:46.124 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.117+0000 7f867fd3e800 1 -- 172.21.15.142:0/3150972100 shutdown_connections 2024-09-22T08:36:46.124 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.117+0000 7f867fd3e800 1 -- 172.21.15.142:0/3150972100 wait complete. 2024-09-22T08:36:46.124 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.117+0000 7f867fd3e800 1 Processor -- start 2024-09-22T08:36:46.125 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.118+0000 7f867fd3e800 1 -- start start 2024-09-22T08:36:46.125 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.118+0000 7f867fd3e800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5623ab1a7be0 0x5623ab2a0970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:46.125 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.118+0000 7f867fd3e800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5623ab1b0850 con 0x5623ab1a7be0 2024-09-22T08:36:46.125 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.118+0000 7f867baed640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5623ab1a7be0 0x5623ab2a0970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:46.125 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.118+0000 7f867baed640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5623ab1a7be0 0x5623ab2a0970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:39258/0 (socket says 172.21.15.142:39258) 2024-09-22T08:36:46.125 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.118+0000 7f867baed640 1 -- 172.21.15.142:0/1724897265 learned_addr learned my addr 172.21.15.142:0/1724897265 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:46.125 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.118+0000 7f867baed640 1 -- 172.21.15.142:0/1724897265 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5623ab2a0ed0 con 0x5623ab1a7be0 2024-09-22T08:36:46.125 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.118+0000 7f867baed640 1 --2- 172.21.15.142:0/1724897265 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5623ab1a7be0 0x5623ab2a0970 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f866c0012f0 tx=0x7f866c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:46.125 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.119+0000 7f8563fff640 1 -- 172.21.15.142:0/1724897265 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f866c00f9d0 con 0x5623ab1a7be0 2024-09-22T08:36:46.125 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.119+0000 7f8563fff640 1 -- 172.21.15.142:0/1724897265 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f866c00fb70 con 0x5623ab1a7be0 2024-09-22T08:36:46.125 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.119+0000 7f867fd3e800 1 -- 172.21.15.142:0/1724897265 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5623ab2a1160 con 0x5623ab1a7be0 2024-09-22T08:36:46.125 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.119+0000 7f8563fff640 1 -- 172.21.15.142:0/1724897265 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f866c00fe50 con 0x5623ab1a7be0 2024-09-22T08:36:46.126 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.119+0000 7f867fd3e800 1 -- 172.21.15.142:0/1724897265 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5623ab2a1b60 con 0x5623ab1a7be0 2024-09-22T08:36:46.126 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.120+0000 7f8563fff640 1 -- 172.21.15.142:0/1724897265 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f866c017040 con 0x5623ab1a7be0 2024-09-22T08:36:46.126 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.120+0000 7f8563fff640 1 --2- 172.21.15.142:0/1724897265 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f856403d150 0x7f856403f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:46.126 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.120+0000 7f8563fff640 1 -- 172.21.15.142:0/1724897265 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f866c015020 con 0x5623ab1a7be0 2024-09-22T08:36:46.126 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.120+0000 7f86732ec640 1 --2- 172.21.15.142:0/1724897265 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f856403d150 0x7f856403f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:46.126 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.120+0000 7f867fd3e800 1 --2- 172.21.15.142:0/1724897265 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5623ab1a7fe0 0x5623ab2a7fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:46.126 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.120+0000 7f867fd3e800 1 -- 172.21.15.142:0/1724897265 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5623ab2a8500 con 0x5623ab1a7fe0 2024-09-22T08:36:46.126 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.120+0000 7f867c2ee640 1 --2- 172.21.15.142:0/1724897265 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5623ab1a7fe0 0x5623ab2a7fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:46.126 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.120+0000 7f86732ec640 1 --2- 172.21.15.142:0/1724897265 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f856403d150 0x7f856403f610 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f8664057000 tx=0x7f8664052000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:46.126 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.121+0000 7f867c2ee640 1 --2- 172.21.15.142:0/1724897265 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5623ab1a7fe0 0x5623ab2a7fc0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:46.126 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.121+0000 7f867c2ee640 1 -- 172.21.15.142:0/1724897265 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f867400a4d0 con 0x5623ab1a7fe0 2024-09-22T08:36:46.126 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.121+0000 7f867fd3e800 1 -- 172.21.15.142:0/1724897265 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5623ab2a88a0 con 0x5623ab1a7fe0 2024-09-22T08:36:46.127 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.121+0000 7f867c2ee640 1 -- 172.21.15.142:0/1724897265 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f867400a4d0 con 0x5623ab1a7fe0 2024-09-22T08:36:46.127 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.121+0000 7f867fd3e800 1 --2- 172.21.15.142:0/1724897265 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5623ab2aa3a0 0x5623ab2ac820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:46.127 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.121+0000 7f867fd3e800 1 -- 172.21.15.142:0/1724897265 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:3 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5623ab2acfb0 con 0x5623ab2aa3a0 2024-09-22T08:36:46.127 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.121+0000 7f867baed640 1 --2- 172.21.15.142:0/1724897265 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5623ab2aa3a0 0x5623ab2ac820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:46.127 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.121+0000 7f867baed640 1 --2- 172.21.15.142:0/1724897265 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5623ab2aa3a0 0x5623ab2ac820 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:46.140 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.122+0000 7f867baed640 1 -- 172.21.15.142:0/1724897265 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(3 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f866c02d070 con 0x5623ab2aa3a0 2024-09-22T08:36:46.140 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.122+0000 7f867fd3e800 1 -- 172.21.15.142:0/1724897265 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5623ab2a90f0 con 0x5623ab1a7fe0 2024-09-22T08:36:46.140 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.122+0000 7f867c2ee640 1 -- 172.21.15.142:0/1724897265 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f867400a4d0 con 0x5623ab1a7fe0 2024-09-22T08:36:46.140 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.122+0000 7f867fd3e800 1 -- 172.21.15.142:0/1724897265 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5623ab2a9510 con 0x5623ab2aa3a0 2024-09-22T08:36:46.140 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.122+0000 7f867baed640 1 -- 172.21.15.142:0/1724897265 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(5 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f866c02d070 con 0x5623ab2aa3a0 2024-09-22T08:36:46.140 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.123+0000 7f867fd3e800 1 Processor -- start 2024-09-22T08:36:46.140 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.123+0000 7f867fd3e800 1 -- start start 2024-09-22T08:36:46.140 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.123+0000 7f867fd3e800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5623ab2bb970 0x5623ab2bbd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:46.140 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.123+0000 7f867fd3e800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5623ab0a0d50 con 0x5623ab2bb970 2024-09-22T08:36:46.141 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.123+0000 7f867c2ee640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5623ab2bb970 0x5623ab2bbd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:46.141 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.123+0000 7f867c2ee640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5623ab2bb970 0x5623ab2bbd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:39262/0 (socket says 172.21.15.142:39262) 2024-09-22T08:36:46.141 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.123+0000 7f867c2ee640 1 -- 172.21.15.142:0/1503685066 learned_addr learned my addr 172.21.15.142:0/1503685066 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:46.141 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.123+0000 7f867c2ee640 1 -- 172.21.15.142:0/1503685066 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5623ab2bc3d0 con 0x5623ab2bb970 2024-09-22T08:36:46.141 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.123+0000 7f867c2ee640 1 --2- 172.21.15.142:0/1503685066 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5623ab2bb970 0x5623ab2bbd90 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x5623ab2a1970 tx=0x7f86740167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:46.141 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.124+0000 7f85617fa640 1 -- 172.21.15.142:0/1503685066 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8674013640 con 0x5623ab2bb970 2024-09-22T08:36:46.141 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.124+0000 7f85617fa640 1 -- 172.21.15.142:0/1503685066 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86740137e0 con 0x5623ab2bb970 2024-09-22T08:36:46.141 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.124+0000 7f867fd3e800 1 -- 172.21.15.142:0/1503685066 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5623ab2bcc00 con 0x5623ab2bb970 2024-09-22T08:36:46.141 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.124+0000 7f85617fa640 1 -- 172.21.15.142:0/1503685066 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8674013ae0 con 0x5623ab2bb970 2024-09-22T08:36:46.141 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.124+0000 7f867fd3e800 1 -- 172.21.15.142:0/1503685066 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5623ab2bd1a0 con 0x5623ab2bb970 2024-09-22T08:36:46.142 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.124+0000 7f85617fa640 1 -- 172.21.15.142:0/1503685066 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f8674011040 con 0x5623ab2bb970 2024-09-22T08:36:46.142 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.125+0000 7f85617fa640 1 --2- 172.21.15.142:0/1503685066 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f855403d000 0x7f855403f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:46.142 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.125+0000 7f85617fa640 1 -- 172.21.15.142:0/1503685066 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f867400e040 con 0x5623ab2bb970 2024-09-22T08:36:46.142 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.125+0000 7f867baed640 1 --2- 172.21.15.142:0/1503685066 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f855403d000 0x7f855403f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:46.142 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.125+0000 7f867fd3e800 1 Processor -- start 2024-09-22T08:36:46.142 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.125+0000 7f867fd3e800 1 -- start start 2024-09-22T08:36:46.142 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.125+0000 7f867baed640 1 --2- 172.21.15.142:0/1503685066 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f855403d000 0x7f855403f4c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x5623ab2ad380 tx=0x7f866c053170 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:46.142 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.125+0000 7f867fd3e800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5623ab1a8840 0x5623ab1a8c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:46.142 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.125+0000 7f867fd3e800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5623ab2998b0 con 0x5623ab1a8840 2024-09-22T08:36:46.142 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.125+0000 7f867c2ee640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5623ab1a8840 0x5623ab1a8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:46.142 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.126+0000 7f867c2ee640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5623ab1a8840 0x5623ab1a8c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:39278/0 (socket says 172.21.15.142:39278) 2024-09-22T08:36:46.143 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.126+0000 7f867c2ee640 1 -- 172.21.15.142:0/2186112821 learned_addr learned my addr 172.21.15.142:0/2186112821 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:46.143 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.126+0000 7f867c2ee640 1 -- 172.21.15.142:0/2186112821 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5623ab1a9230 con 0x5623ab1a8840 2024-09-22T08:36:46.143 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.126+0000 7f867c2ee640 1 --2- 172.21.15.142:0/2186112821 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5623ab1a8840 0x5623ab1a8c40 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f86740547f0 tx=0x7f867401fe70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=714caa8c7b70ee93 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:46.143 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.126+0000 7f855affd640 1 -- 172.21.15.142:0/2186112821 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8674044030 con 0x5623ab1a8840 2024-09-22T08:36:46.143 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.126+0000 7f855affd640 1 -- 172.21.15.142:0/2186112821 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8674021960 con 0x5623ab1a8840 2024-09-22T08:36:46.143 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.126+0000 7f855affd640 1 -- 172.21.15.142:0/2186112821 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f867401f340 con 0x5623ab1a8840 2024-09-22T08:36:46.143 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.126+0000 7f867fd3e800 1 -- 172.21.15.142:0/2186112821 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5623ab1a8840 msgr2=0x5623ab1a8c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:46.143 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.126+0000 7f867fd3e800 1 --2- 172.21.15.142:0/2186112821 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5623ab1a8840 0x5623ab1a8c40 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f86740547f0 tx=0x7f867401fe70 comp rx=0 tx=0).stop 2024-09-22T08:36:46.143 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.127+0000 7f867fd3e800 1 -- 172.21.15.142:0/2186112821 shutdown_connections 2024-09-22T08:36:46.143 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.127+0000 7f867fd3e800 1 --2- 172.21.15.142:0/2186112821 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5623ab1a8840 0x5623ab1a8c40 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:46.143 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.127+0000 7f867fd3e800 1 -- 172.21.15.142:0/2186112821 >> 172.21.15.142:0/2186112821 conn(0x5623ab2c47f0 msgr2=0x5623ab2c2a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:46.143 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.127+0000 7f867fd3e800 1 -- 172.21.15.142:0/2186112821 shutdown_connections 2024-09-22T08:36:46.143 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.127+0000 7f867fd3e800 1 -- 172.21.15.142:0/2186112821 wait complete. 2024-09-22T08:36:46.144 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.127+0000 7f867fd3e800 1 Processor -- start 2024-09-22T08:36:46.144 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.127+0000 7f867fd3e800 1 -- start start 2024-09-22T08:36:46.144 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.127+0000 7f867fd3e800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5623ab1a8840 0x5623ab2d1c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:46.144 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.127+0000 7f867fd3e800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5623ab1a98a0 con 0x5623ab1a8840 2024-09-22T08:36:46.144 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.127+0000 7f867c2ee640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5623ab1a8840 0x5623ab2d1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:46.144 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.127+0000 7f867c2ee640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5623ab1a8840 0x5623ab2d1c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:39294/0 (socket says 172.21.15.142:39294) 2024-09-22T08:36:46.144 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.127+0000 7f867c2ee640 1 -- 172.21.15.142:0/1954950536 learned_addr learned my addr 172.21.15.142:0/1954950536 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:46.144 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.127+0000 7f867c2ee640 1 -- 172.21.15.142:0/1954950536 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5623ab2d2160 con 0x5623ab1a8840 2024-09-22T08:36:46.144 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.128+0000 7f867c2ee640 1 --2- 172.21.15.142:0/1954950536 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5623ab1a8840 0x5623ab2d1c00 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f8674016cd0 tx=0x7f8674054780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:46.144 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.128+0000 7f85597fa640 1 -- 172.21.15.142:0/1954950536 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f867401f6c0 con 0x5623ab1a8840 2024-09-22T08:36:46.144 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.128+0000 7f85597fa640 1 -- 172.21.15.142:0/1954950536 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f867401f8a0 con 0x5623ab1a8840 2024-09-22T08:36:46.144 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.128+0000 7f867fd3e800 1 -- 172.21.15.142:0/1954950536 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5623ab2d23f0 con 0x5623ab1a8840 2024-09-22T08:36:46.144 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.128+0000 7f85597fa640 1 -- 172.21.15.142:0/1954950536 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f86740459c0 con 0x5623ab1a8840 2024-09-22T08:36:46.145 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.128+0000 7f867fd3e800 1 -- 172.21.15.142:0/1954950536 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5623ab2d2d70 con 0x5623ab1a8840 2024-09-22T08:36:46.145 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.129+0000 7f85597fa640 1 -- 172.21.15.142:0/1954950536 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f8674045b60 con 0x5623ab1a8840 2024-09-22T08:36:46.145 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.129+0000 7f85597fa640 1 --2- 172.21.15.142:0/1954950536 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f854403d000 0x7f854403f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:46.145 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.129+0000 7f85597fa640 1 -- 172.21.15.142:0/1954950536 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f8674034af0 con 0x5623ab1a8840 2024-09-22T08:36:46.145 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.129+0000 7f867baed640 1 --2- 172.21.15.142:0/1954950536 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f854403d000 0x7f854403f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:46.145 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.129+0000 7f867fd3e800 20 rados->read ofs=0 len=0 2024-09-22T08:36:46.145 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.129+0000 7f867fd3e800 1 --2- 172.21.15.142:0/1954950536 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5623ab2dd450 0x5623ab2df910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:46.145 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.129+0000 7f867fd3e800 1 -- 172.21.15.142:0/1954950536 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5623ab2e0060 con 0x5623ab2dd450 2024-09-22T08:36:46.145 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.129+0000 7f86732ec640 1 --2- 172.21.15.142:0/1954950536 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5623ab2dd450 0x5623ab2df910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:46.145 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.130+0000 7f867baed640 1 --2- 172.21.15.142:0/1954950536 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f854403d000 0x7f854403f4c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f866c00f640 tx=0x7f866c048000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:46.145 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.130+0000 7f86732ec640 1 --2- 172.21.15.142:0/1954950536 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5623ab2dd450 0x5623ab2df910 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:46.145 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.130+0000 7f86732ec640 1 -- 172.21.15.142:0/1954950536 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8664051070 con 0x5623ab2dd450 2024-09-22T08:36:46.145 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.130+0000 7f867fd3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:46.146 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.130+0000 7f867fd3e800 20 realm 2024-09-22T08:36:46.146 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.130+0000 7f867fd3e800 20 rados->read ofs=0 len=0 2024-09-22T08:36:46.146 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.130+0000 7f867fd3e800 1 -- 172.21.15.142:0/1954950536 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5623ab2e0490 con 0x5623ab2dd450 2024-09-22T08:36:46.146 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.130+0000 7f86732ec640 1 -- 172.21.15.142:0/1954950536 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8664051070 con 0x5623ab2dd450 2024-09-22T08:36:46.146 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.130+0000 7f867fd3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:46.146 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.130+0000 7f867fd3e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:36:46.146 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.130+0000 7f867fd3e800 20 rados->read ofs=0 len=0 2024-09-22T08:36:46.146 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.130+0000 7f867fd3e800 1 -- 172.21.15.142:0/1954950536 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5623ab2e0d60 con 0x5623ab2dd450 2024-09-22T08:36:46.146 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.130+0000 7f86732ec640 1 -- 172.21.15.142:0/1954950536 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8664051070 con 0x5623ab2dd450 2024-09-22T08:36:46.146 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.130+0000 7f867fd3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:46.146 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.130+0000 7f867fd3e800 20 rados->read ofs=0 len=0 2024-09-22T08:36:46.146 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.130+0000 7f867fd3e800 1 -- 172.21.15.142:0/1954950536 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5623ab2e1100 con 0x5623ab2dd450 2024-09-22T08:36:46.147 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.131+0000 7f86732ec640 1 -- 172.21.15.142:0/1954950536 <== osd.1 v2:172.21.15.142:6816/3192108003 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8664051070 con 0x5623ab2dd450 2024-09-22T08:36:46.147 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.131+0000 7f867fd3e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:36:46.147 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.131+0000 7f867fd3e800 20 rados->read ofs=0 len=0 2024-09-22T08:36:46.147 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.131+0000 7f867fd3e800 1 --2- 172.21.15.142:0/1954950536 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5623ab2e1e60 0x5623ab2e4250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:46.147 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.131+0000 7f867fd3e800 1 -- 172.21.15.142:0/1954950536 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5623ab2e4790 con 0x5623ab2e1e60 2024-09-22T08:36:46.147 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.131+0000 7f867c2ee640 1 --2- 172.21.15.142:0/1954950536 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5623ab2e1e60 0x5623ab2e4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:46.147 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.131+0000 7f867c2ee640 1 --2- 172.21.15.142:0/1954950536 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5623ab2e1e60 0x5623ab2e4250 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:46.147 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.131+0000 7f867c2ee640 1 -- 172.21.15.142:0/1954950536 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(5 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f8674053020 con 0x5623ab2e1e60 2024-09-22T08:36:46.147 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.131+0000 7f867fd3e800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:36:46.147 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.131+0000 7f867fd3e800 20 searching for the correct realm 2024-09-22T08:36:46.147 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.131+0000 7f867fd3e800 1 -- 172.21.15.142:0/1954950536 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5623ab2e6100 con 0x5623ab2e1e60 2024-09-22T08:36:46.147 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.132+0000 7f867c2ee640 1 -- 172.21.15.142:0/1954950536 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8674053020 con 0x5623ab2e1e60 2024-09-22T08:36:46.147 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.132+0000 7f867c2ee640 1 --2- 172.21.15.142:0/1954950536 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f867404d2d0 0x7f8674045130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:46.147 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.132+0000 7f867c2ee640 1 -- 172.21.15.142:0/1954950536 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5623ab2e6100 con 0x7f867404d2d0 2024-09-22T08:36:46.148 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.132+0000 7f867baed640 1 --2- 172.21.15.142:0/1954950536 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f867404d2d0 0x7f8674045130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:46.148 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.132+0000 7f867baed640 1 --2- 172.21.15.142:0/1954950536 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f867404d2d0 0x7f8674045130 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:46.148 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.132+0000 7f867baed640 1 -- 172.21.15.142:0/1954950536 <== osd.2 v2:172.21.15.142:6808/279438927 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f866c02d070 con 0x7f867404d2d0 2024-09-22T08:36:46.148 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.132+0000 7f867baed640 1 --2- 172.21.15.142:0/1954950536 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f866c0535f0 0x7f866c053a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:46.148 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.132+0000 7f867baed640 1 -- 172.21.15.142:0/1954950536 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5623ab2e6100 con 0x7f866c0535f0 2024-09-22T08:36:46.148 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.133+0000 7f86732ec640 1 --2- 172.21.15.142:0/1954950536 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f866c0535f0 0x7f866c053a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:46.148 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.133+0000 7f86732ec640 1 --2- 172.21.15.142:0/1954950536 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f866c0535f0 0x7f866c053a10 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:46.148 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.133+0000 7f86732ec640 1 -- 172.21.15.142:0/1954950536 <== osd.0 v2:172.21.15.31:6800/168281188 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8664051070 con 0x7f866c0535f0 2024-09-22T08:36:46.148 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.133+0000 7f86732ec640 1 -- 172.21.15.142:0/1954950536 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5623ab2e6100 con 0x5623ab2dd450 2024-09-22T08:36:46.148 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.134+0000 7f86732ec640 1 -- 172.21.15.142:0/1954950536 <== osd.1 v2:172.21.15.142:6816/3192108003 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8664051070 con 0x5623ab2dd450 2024-09-22T08:36:46.148 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.134+0000 7f86732ec640 1 -- 172.21.15.142:0/1954950536 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5623ab2e6100 con 0x5623ab2dd450 2024-09-22T08:36:46.148 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.134+0000 7f86732ec640 1 -- 172.21.15.142:0/1954950536 <== osd.1 v2:172.21.15.142:6816/3192108003 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8664051070 con 0x5623ab2dd450 2024-09-22T08:36:46.148 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.134+0000 7f86732ec640 1 -- 172.21.15.142:0/1954950536 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5623ab2e6100 con 0x7f866c0535f0 2024-09-22T08:36:46.148 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.134+0000 7f86732ec640 1 -- 172.21.15.142:0/1954950536 <== osd.0 v2:172.21.15.31:6800/168281188 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8664051070 con 0x7f866c0535f0 2024-09-22T08:36:46.149 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.134+0000 7f86732ec640 1 -- 172.21.15.142:0/1954950536 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5623ab2e6100 con 0x7f866c0535f0 2024-09-22T08:36:46.149 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.134+0000 7f86732ec640 1 -- 172.21.15.142:0/1954950536 <== osd.0 v2:172.21.15.31:6800/168281188 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8664051070 con 0x7f866c0535f0 2024-09-22T08:36:46.149 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.134+0000 7f86732ec640 1 -- 172.21.15.142:0/1954950536 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5623ab2e6100 con 0x7f867404d2d0 2024-09-22T08:36:46.149 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.135+0000 7f867baed640 1 -- 172.21.15.142:0/1954950536 <== osd.2 v2:172.21.15.142:6808/279438927 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f866c02d070 con 0x7f867404d2d0 2024-09-22T08:36:46.149 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.135+0000 7f867baed640 1 -- 172.21.15.142:0/1954950536 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5623ab2e6100 con 0x5623ab2e1e60 2024-09-22T08:36:46.149 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.135+0000 7f867c2ee640 1 -- 172.21.15.142:0/1954950536 <== osd.3 v2:172.21.15.142:6800/1064901393 3 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8674053020 con 0x5623ab2e1e60 2024-09-22T08:36:46.149 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.135+0000 7f867c2ee640 1 -- 172.21.15.142:0/1954950536 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5623ab2e6100 con 0x5623ab2dd450 2024-09-22T08:36:46.149 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.135+0000 7f86732ec640 1 -- 172.21.15.142:0/1954950536 <== osd.1 v2:172.21.15.142:6816/3192108003 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8664051070 con 0x5623ab2dd450 2024-09-22T08:36:46.149 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.135+0000 7f86732ec640 1 -- 172.21.15.142:0/1954950536 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5623ab2e6100 con 0x7f866c0535f0 2024-09-22T08:36:46.149 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.135+0000 7f86732ec640 1 -- 172.21.15.142:0/1954950536 <== osd.0 v2:172.21.15.31:6800/168281188 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8664051070 con 0x7f866c0535f0 2024-09-22T08:36:46.149 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.135+0000 7f86732ec640 1 -- 172.21.15.142:0/1954950536 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5623ab2e6100 con 0x5623ab2dd450 2024-09-22T08:36:46.149 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.135+0000 7f86732ec640 1 -- 172.21.15.142:0/1954950536 <== osd.1 v2:172.21.15.142:6816/3192108003 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8664051070 con 0x5623ab2dd450 2024-09-22T08:36:46.149 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.135+0000 7f86732ec640 1 -- 172.21.15.142:0/1954950536 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5623ab2e6100 con 0x7f867404d2d0 2024-09-22T08:36:46.150 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.136+0000 7f867baed640 1 -- 172.21.15.142:0/1954950536 <== osd.2 v2:172.21.15.142:6808/279438927 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f866c02d070 con 0x7f867404d2d0 2024-09-22T08:36:46.150 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.136+0000 7f867baed640 1 -- 172.21.15.142:0/1954950536 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5623ab2e6100 con 0x5623ab2e1e60 2024-09-22T08:36:46.150 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.136+0000 7f867c2ee640 1 -- 172.21.15.142:0/1954950536 <== osd.3 v2:172.21.15.142:6800/1064901393 4 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8674053020 con 0x5623ab2e1e60 2024-09-22T08:36:46.150 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.136+0000 7f867c2ee640 1 -- 172.21.15.142:0/1954950536 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5623ab2e6100 con 0x5623ab2e1e60 2024-09-22T08:36:46.150 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.136+0000 7f867c2ee640 1 -- 172.21.15.142:0/1954950536 <== osd.3 v2:172.21.15.142:6800/1064901393 5 ==== osd_op_reply(20 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f8674053020 con 0x5623ab2e1e60 2024-09-22T08:36:46.150 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.136+0000 7f867c2ee640 1 -- 172.21.15.142:0/1954950536 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5623ab2e6100 con 0x7f866c0535f0 2024-09-22T08:36:46.150 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.136+0000 7f86732ec640 1 -- 172.21.15.142:0/1954950536 <== osd.0 v2:172.21.15.31:6800/168281188 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8664051070 con 0x7f866c0535f0 2024-09-22T08:36:46.150 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.136+0000 7f86732ec640 1 -- 172.21.15.142:0/1954950536 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5623ab2e6100 con 0x5623ab2e1e60 2024-09-22T08:36:46.150 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.137+0000 7f867c2ee640 1 -- 172.21.15.142:0/1954950536 <== osd.3 v2:172.21.15.142:6800/1064901393 6 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8674053020 con 0x5623ab2e1e60 2024-09-22T08:36:46.150 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.137+0000 7f867c2ee640 1 -- 172.21.15.142:0/1954950536 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5623ab2e6100 con 0x5623ab2e1e60 2024-09-22T08:36:46.150 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.137+0000 7f867c2ee640 1 -- 172.21.15.142:0/1954950536 <== osd.3 v2:172.21.15.142:6800/1064901393 7 ==== osd_op_reply(23 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f8674053020 con 0x5623ab2e1e60 2024-09-22T08:36:46.150 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.137+0000 7f867c2ee640 1 -- 172.21.15.142:0/1954950536 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5623ab2e6100 con 0x5623ab2dd450 2024-09-22T08:36:46.150 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.137+0000 7f86732ec640 1 -- 172.21.15.142:0/1954950536 <== osd.1 v2:172.21.15.142:6816/3192108003 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8664051070 con 0x5623ab2dd450 2024-09-22T08:36:46.151 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.137+0000 7f86732ec640 1 -- 172.21.15.142:0/1954950536 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5623ab2e6100 con 0x5623ab2dd450 2024-09-22T08:36:46.151 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.137+0000 7f86732ec640 1 -- 172.21.15.142:0/1954950536 <== osd.1 v2:172.21.15.142:6816/3192108003 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f8664051070 con 0x5623ab2dd450 2024-09-22T08:36:46.151 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.137+0000 7f86732ec640 1 -- 172.21.15.142:0/1954950536 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5623ab2e6100 con 0x7f866c0535f0 2024-09-22T08:36:46.151 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.138+0000 7f86732ec640 1 -- 172.21.15.142:0/1954950536 <== osd.0 v2:172.21.15.31:6800/168281188 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8664051070 con 0x7f866c0535f0 2024-09-22T08:36:46.151 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.138+0000 7f86732ec640 1 -- 172.21.15.142:0/1954950536 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5623ab2e6100 con 0x5623ab2e1e60 2024-09-22T08:36:46.151 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.138+0000 7f867c2ee640 1 -- 172.21.15.142:0/1954950536 <== osd.3 v2:172.21.15.142:6800/1064901393 8 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8674053020 con 0x5623ab2e1e60 2024-09-22T08:36:46.151 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.138+0000 7f867c2ee640 1 -- 172.21.15.142:0/1954950536 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5623ab2e6100 con 0x7f867404d2d0 2024-09-22T08:36:46.151 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.138+0000 7f867baed640 1 -- 172.21.15.142:0/1954950536 <== osd.2 v2:172.21.15.142:6808/279438927 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f866c02d070 con 0x7f867404d2d0 2024-09-22T08:36:46.151 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.138+0000 7f867baed640 1 -- 172.21.15.142:0/1954950536 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5623ab2e6100 con 0x5623ab2dd450 2024-09-22T08:36:46.151 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.138+0000 7f86732ec640 1 -- 172.21.15.142:0/1954950536 <== osd.1 v2:172.21.15.142:6816/3192108003 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8664051070 con 0x5623ab2dd450 2024-09-22T08:36:46.152 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.138+0000 7f86732ec640 1 -- 172.21.15.142:0/1954950536 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5623ab2e6100 con 0x7f866c0535f0 2024-09-22T08:36:46.170 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.139+0000 7f86732ec640 1 -- 172.21.15.142:0/1954950536 <== osd.0 v2:172.21.15.31:6800/168281188 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8664051070 con 0x7f866c0535f0 2024-09-22T08:36:46.170 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.139+0000 7f86732ec640 1 -- 172.21.15.142:0/1954950536 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5623ab2e6100 con 0x5623ab2e1e60 2024-09-22T08:36:46.170 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.139+0000 7f867c2ee640 1 -- 172.21.15.142:0/1954950536 <== osd.3 v2:172.21.15.142:6800/1064901393 9 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8674053020 con 0x5623ab2e1e60 2024-09-22T08:36:46.170 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.139+0000 7f867c2ee640 1 -- 172.21.15.142:0/1954950536 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5623ab2e6100 con 0x7f866c0535f0 2024-09-22T08:36:46.170 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.139+0000 7f86732ec640 1 -- 172.21.15.142:0/1954950536 <== osd.0 v2:172.21.15.31:6800/168281188 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8664051070 con 0x7f866c0535f0 2024-09-22T08:36:46.170 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.139+0000 7f86732ec640 1 -- 172.21.15.142:0/1954950536 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5623ab2e6100 con 0x7f867404d2d0 2024-09-22T08:36:46.170 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.139+0000 7f867baed640 1 -- 172.21.15.142:0/1954950536 <== osd.2 v2:172.21.15.142:6808/279438927 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f866c02d070 con 0x7f867404d2d0 2024-09-22T08:36:46.170 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.139+0000 7f867baed640 1 -- 172.21.15.142:0/1954950536 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5623ab2e6100 con 0x5623ab2e1e60 2024-09-22T08:36:46.171 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.139+0000 7f867c2ee640 1 -- 172.21.15.142:0/1954950536 <== osd.3 v2:172.21.15.142:6800/1064901393 10 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8674053020 con 0x5623ab2e1e60 2024-09-22T08:36:46.171 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.140+0000 7f867c2ee640 1 -- 172.21.15.142:0/1954950536 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5623ab2e6100 con 0x7f866c0535f0 2024-09-22T08:36:46.171 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.140+0000 7f86732ec640 1 -- 172.21.15.142:0/1954950536 <== osd.0 v2:172.21.15.31:6800/168281188 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8664051070 con 0x7f866c0535f0 2024-09-22T08:36:46.171 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.140+0000 7f86732ec640 1 -- 172.21.15.142:0/1954950536 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5623ab2e6100 con 0x5623ab2dd450 2024-09-22T08:36:46.171 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.140+0000 7f86732ec640 1 -- 172.21.15.142:0/1954950536 <== osd.1 v2:172.21.15.142:6816/3192108003 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f8664051070 con 0x5623ab2dd450 2024-09-22T08:36:46.171 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.140+0000 7f86732ec640 1 -- 172.21.15.142:0/1954950536 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5623ab2e6100 con 0x7f867404d2d0 2024-09-22T08:36:46.171 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.140+0000 7f867baed640 1 -- 172.21.15.142:0/1954950536 <== osd.2 v2:172.21.15.142:6808/279438927 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f866c061040 con 0x7f867404d2d0 2024-09-22T08:36:46.171 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.140+0000 7f867fd3e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:36:46.171 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.140+0000 7f867fd3e800 20 RGWRados::pool_iterate: got zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec 2024-09-22T08:36:46.171 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.140+0000 7f867fd3e800 20 RGWRados::pool_iterate: got zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f 2024-09-22T08:36:46.171 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.140+0000 7f867fd3e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:36:46.171 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.140+0000 7f867fd3e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:36:46.172 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.140+0000 7f867fd3e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:36:46.172 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.140+0000 7f867fd3e800 20 rados->read ofs=0 len=0 2024-09-22T08:36:46.172 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.140+0000 7f867fd3e800 1 -- 172.21.15.142:0/1954950536 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5623ab2e5200 con 0x5623ab2dd450 2024-09-22T08:36:46.172 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.140+0000 7f86732ec640 1 -- 172.21.15.142:0/1954950536 <== osd.1 v2:172.21.15.142:6816/3192108003 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8664051070 con 0x5623ab2dd450 2024-09-22T08:36:46.172 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.140+0000 7f867fd3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:46.172 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.140+0000 7f867fd3e800 20 rados->read ofs=0 len=0 2024-09-22T08:36:46.172 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.141+0000 7f867fd3e800 1 -- 172.21.15.142:0/1954950536 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5623ab2e5aa0 con 0x5623ab2dd450 2024-09-22T08:36:46.172 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.141+0000 7f86732ec640 1 -- 172.21.15.142:0/1954950536 <== osd.1 v2:172.21.15.142:6816/3192108003 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8664051070 con 0x5623ab2dd450 2024-09-22T08:36:46.172 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.141+0000 7f867fd3e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:36:46.173 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.141+0000 7f867fd3e800 20 rados->read ofs=0 len=0 2024-09-22T08:36:46.173 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.141+0000 7f867fd3e800 1 -- 172.21.15.142:0/1954950536 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:40 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5623ab2e4e40 con 0x5623ab2e1e60 2024-09-22T08:36:46.173 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.141+0000 7f867c2ee640 1 -- 172.21.15.142:0/1954950536 <== osd.3 v2:172.21.15.142:6800/1064901393 11 ==== osd_op_reply(40 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f8674053020 con 0x5623ab2e1e60 2024-09-22T08:36:46.173 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.141+0000 7f867fd3e800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:36:46.173 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.141+0000 7f867fd3e800 20 zone default found 2024-09-22T08:36:46.173 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.141+0000 7f867fd3e800 4 Realm: () 2024-09-22T08:36:46.173 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.141+0000 7f867fd3e800 4 ZoneGroup: default (d89f6f57-1007-47dd-9065-f486c7b01aec) 2024-09-22T08:36:46.173 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.141+0000 7f867fd3e800 4 Zone: default (e239248c-0bee-4e41-803a-24b288d3eb8f) 2024-09-22T08:36:46.173 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.141+0000 7f867fd3e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:36:46.173 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.141+0000 7f867fd3e800 20 zonegroup default 2024-09-22T08:36:46.173 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.141+0000 7f867fd3e800 20 rados->read ofs=0 len=0 2024-09-22T08:36:46.173 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.141+0000 7f867fd3e800 1 -- 172.21.15.142:0/1954950536 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5623ab2e6a80 con 0x7f866c0535f0 2024-09-22T08:36:46.173 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.141+0000 7f86732ec640 1 -- 172.21.15.142:0/1954950536 <== osd.0 v2:172.21.15.31:6800/168281188 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f8664051070 con 0x7f866c0535f0 2024-09-22T08:36:46.173 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.141+0000 7f867fd3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:46.174 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.141+0000 7f867fd3e800 20 rados->read ofs=0 len=0 2024-09-22T08:36:46.174 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.141+0000 7f867fd3e800 1 -- 172.21.15.142:0/1954950536 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5623ab2e8940 con 0x5623ab2e1e60 2024-09-22T08:36:46.174 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.142+0000 7f867c2ee640 1 -- 172.21.15.142:0/1954950536 <== osd.3 v2:172.21.15.142:6800/1064901393 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8674053020 con 0x5623ab2e1e60 2024-09-22T08:36:46.174 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.142+0000 7f867fd3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:46.174 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.142+0000 7f867fd3e800 20 rados->read ofs=0 len=0 2024-09-22T08:36:46.174 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.142+0000 7f867fd3e800 1 -- 172.21.15.142:0/1954950536 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5623ab2e8db0 con 0x5623ab2e1e60 2024-09-22T08:36:46.174 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.142+0000 7f867c2ee640 1 -- 172.21.15.142:0/1954950536 <== osd.3 v2:172.21.15.142:6800/1064901393 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8674053020 con 0x5623ab2e1e60 2024-09-22T08:36:46.174 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.142+0000 7f867fd3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:46.174 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.142+0000 7f867fd3e800 20 started sync module instance, tier type = 2024-09-22T08:36:46.174 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.142+0000 7f867fd3e800 20 started zone id=e239248c-0bee-4e41-803a-24b288d3eb8f (name=default) with tier type = 2024-09-22T08:36:46.174 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.142+0000 7f867fd3e800 1 -- 172.21.15.142:0/1954950536 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5623ab2e7cb0 con 0x7f867404d2d0 2024-09-22T08:36:46.174 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.143+0000 7f867baed640 1 -- 172.21.15.142:0/1954950536 <== osd.2 v2:172.21.15.142:6808/279438927 7 ==== osd_op_reply(44 notify.0 [create] v30'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f866c061040 con 0x7f867404d2d0 2024-09-22T08:36:46.175 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.143+0000 7f867fd3e800 1 -- 172.21.15.142:0/1954950536 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94711195793408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5623ab2e91f0 con 0x7f867404d2d0 2024-09-22T08:36:46.175 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.143+0000 7f867fd3e800 1 -- 172.21.15.142:0/1954950536 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5623ab2e9a40 con 0x5623ab2dd450 2024-09-22T08:36:46.175 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.144+0000 7f867baed640 1 -- 172.21.15.142:0/1954950536 <== osd.2 v2:172.21.15.142:6808/279438927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94711195793408] v30'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f866c061040 con 0x7f867404d2d0 2024-09-22T08:36:46.175 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.144+0000 7f86732ec640 1 -- 172.21.15.142:0/1954950536 <== osd.1 v2:172.21.15.142:6816/3192108003 15 ==== osd_op_reply(46 notify.1 [create] v30'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8664051070 con 0x5623ab2dd450 2024-09-22T08:36:46.175 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.144+0000 7f867fd3e800 1 -- 172.21.15.142:0/1954950536 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94711195800976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5623ab2e9e60 con 0x5623ab2dd450 2024-09-22T08:36:46.175 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.144+0000 7f867fd3e800 1 -- 172.21.15.142:0/1954950536 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5623ab2ea730 con 0x5623ab2e1e60 2024-09-22T08:36:46.175 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.145+0000 7f867c2ee640 1 -- 172.21.15.142:0/1954950536 <== osd.3 v2:172.21.15.142:6800/1064901393 14 ==== osd_op_reply(48 notify.2 [create] v30'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8674053020 con 0x5623ab2e1e60 2024-09-22T08:36:46.175 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.145+0000 7f867fd3e800 1 -- 172.21.15.142:0/1954950536 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94711195803232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5623ab2ea2e0 con 0x5623ab2e1e60 2024-09-22T08:36:46.175 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.145+0000 7f867fd3e800 1 -- 172.21.15.142:0/1954950536 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5623ab2eb720 con 0x7f867404d2d0 2024-09-22T08:36:46.175 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.145+0000 7f86732ec640 1 -- 172.21.15.142:0/1954950536 <== osd.1 v2:172.21.15.142:6816/3192108003 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94711195800976] v30'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8664051070 con 0x5623ab2dd450 2024-09-22T08:36:46.175 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.146+0000 7f867c2ee640 1 -- 172.21.15.142:0/1954950536 <== osd.3 v2:172.21.15.142:6800/1064901393 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94711195803232] v30'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8674053020 con 0x5623ab2e1e60 2024-09-22T08:36:46.175 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.146+0000 7f867baed640 1 -- 172.21.15.142:0/1954950536 <== osd.2 v2:172.21.15.142:6808/279438927 9 ==== osd_op_reply(50 notify.3 [create] v30'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f866c061040 con 0x7f867404d2d0 2024-09-22T08:36:46.175 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.146+0000 7f867fd3e800 1 -- 172.21.15.142:0/1954950536 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94711195806496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5623ab2e99b0 con 0x7f867404d2d0 2024-09-22T08:36:46.175 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.146+0000 7f867fd3e800 1 -- 172.21.15.142:0/1954950536 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5623ab2ebfc0 con 0x5623ab2dd450 2024-09-22T08:36:46.176 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.147+0000 7f867baed640 1 -- 172.21.15.142:0/1954950536 <== osd.2 v2:172.21.15.142:6808/279438927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94711195806496] v30'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f866c061040 con 0x7f867404d2d0 2024-09-22T08:36:46.176 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.147+0000 7f86732ec640 1 -- 172.21.15.142:0/1954950536 <== osd.1 v2:172.21.15.142:6816/3192108003 17 ==== osd_op_reply(52 notify.4 [create] v30'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8664051070 con 0x5623ab2dd450 2024-09-22T08:36:46.176 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.147+0000 7f867fd3e800 1 -- 172.21.15.142:0/1954950536 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94711195810576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5623ab2ebf30 con 0x5623ab2dd450 2024-09-22T08:36:46.176 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.147+0000 7f867fd3e800 1 -- 172.21.15.142:0/1954950536 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5623ab2ece80 con 0x7f866c0535f0 2024-09-22T08:36:46.176 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.148+0000 7f86732ec640 1 -- 172.21.15.142:0/1954950536 <== osd.0 v2:172.21.15.31:6800/168281188 11 ==== osd_op_reply(54 notify.5 [create] v30'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8664051070 con 0x7f866c0535f0 2024-09-22T08:36:46.176 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.149+0000 7f867fd3e800 1 -- 172.21.15.142:0/1954950536 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94711195814352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5623ab2ecdf0 con 0x7f866c0535f0 2024-09-22T08:36:46.176 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.149+0000 7f867fd3e800 1 -- 172.21.15.142:0/1954950536 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5623ab2ede70 con 0x7f866c0535f0 2024-09-22T08:36:46.176 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.149+0000 7f86732ec640 1 -- 172.21.15.142:0/1954950536 <== osd.1 v2:172.21.15.142:6816/3192108003 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94711195810576] v30'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8664051070 con 0x5623ab2dd450 2024-09-22T08:36:46.176 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.150+0000 7f86732ec640 1 -- 172.21.15.142:0/1954950536 <== osd.0 v2:172.21.15.31:6800/168281188 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94711195814352] v30'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8664051070 con 0x7f866c0535f0 2024-09-22T08:36:46.176 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.150+0000 7f86732ec640 1 -- 172.21.15.142:0/1954950536 <== osd.0 v2:172.21.15.31:6800/168281188 13 ==== osd_op_reply(56 notify.6 [create] v30'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8664051070 con 0x7f866c0535f0 2024-09-22T08:36:46.176 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.150+0000 7f867fd3e800 1 -- 172.21.15.142:0/1954950536 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94711195818304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5623ab2ede30 con 0x7f866c0535f0 2024-09-22T08:36:46.176 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.150+0000 7f867fd3e800 1 -- 172.21.15.142:0/1954950536 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5623ab2ee710 con 0x7f866c0535f0 2024-09-22T08:36:46.177 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.151+0000 7f86732ec640 1 -- 172.21.15.142:0/1954950536 <== osd.0 v2:172.21.15.31:6800/168281188 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94711195818304] v30'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8664051070 con 0x7f866c0535f0 2024-09-22T08:36:46.177 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.151+0000 7f86732ec640 1 -- 172.21.15.142:0/1954950536 <== osd.0 v2:172.21.15.31:6800/168281188 15 ==== osd_op_reply(58 notify.7 [create] v30'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8664051070 con 0x7f866c0535f0 2024-09-22T08:36:46.177 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.151+0000 7f867fd3e800 1 -- 172.21.15.142:0/1954950536 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94711195812736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5623ab2ede30 con 0x7f866c0535f0 2024-09-22T08:36:46.177 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.151+0000 7f867fd3e800 20 add_watcher() i=0 2024-09-22T08:36:46.177 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.151+0000 7f867fd3e800 20 add_watcher() i=1 2024-09-22T08:36:46.177 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.151+0000 7f867fd3e800 20 add_watcher() i=2 2024-09-22T08:36:46.177 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.151+0000 7f867fd3e800 20 add_watcher() i=3 2024-09-22T08:36:46.177 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.151+0000 7f867fd3e800 20 add_watcher() i=4 2024-09-22T08:36:46.177 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.151+0000 7f867fd3e800 20 add_watcher() i=5 2024-09-22T08:36:46.177 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.151+0000 7f867fd3e800 20 add_watcher() i=6 2024-09-22T08:36:46.177 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.152+0000 7f86732ec640 1 -- 172.21.15.142:0/1954950536 <== osd.0 v2:172.21.15.31:6800/168281188 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94711195812736] v30'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8664051070 con 0x7f866c0535f0 2024-09-22T08:36:46.177 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.152+0000 7f867fd3e800 20 add_watcher() i=7 2024-09-22T08:36:46.177 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.152+0000 7f867fd3e800 2 all 8 watchers are set, enabling cache 2024-09-22T08:36:46.178 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.152+0000 7f867fd3e800 1 -- 172.21.15.142:0/1954950536 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5623ab2f17d0 con 0x5623ab2dd450 2024-09-22T08:36:46.178 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.152+0000 7f86732ec640 1 -- 172.21.15.142:0/1954950536 <== osd.1 v2:172.21.15.142:6816/3192108003 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f8664051070 con 0x5623ab2dd450 2024-09-22T08:36:46.178 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.152+0000 7f867fd3e800 1 -- 172.21.15.142:0/1954950536 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94711195820640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5623ab2eeb30 con 0x5623ab2dd450 2024-09-22T08:36:46.178 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.153+0000 7f86732ec640 1 -- 172.21.15.142:0/1954950536 <== osd.1 v2:172.21.15.142:6816/3192108003 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94711195820640] v30'100 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8664051070 con 0x5623ab2dd450 2024-09-22T08:36:46.178 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.153+0000 7f8531fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:36:46.178 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.153+0000 7f867fd3e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:36:46.178 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.153+0000 7f867fd3e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:36:46.178 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.153+0000 7f867fd3e800 5 note: GC not initialized 2024-09-22T08:36:46.178 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.154+0000 7f8530fe1640 20 reqs_thread_entry: start 2024-09-22T08:36:46.178 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.154+0000 7f867fd3e800 20 init_complete bucket index max shards: 11 2024-09-22T08:36:46.178 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.154+0000 7f867fd3e800 20 Filter name: none 2024-09-22T08:36:46.178 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.154+0000 7f84aa7fc640 20 reqs_thread_entry: start 2024-09-22T08:36:46.178 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.154+0000 7f867fd3e800 20 rados->read ofs=0 len=0 2024-09-22T08:36:46.179 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.154+0000 7f867fd3e800 1 -- 172.21.15.142:0/1954950536 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5623ab324ae0 con 0x7f867404d2d0 2024-09-22T08:36:46.179 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.154+0000 7f867baed640 1 -- 172.21.15.142:0/1954950536 <== osd.2 v2:172.21.15.142:6808/279438927 11 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f866c061040 con 0x7f867404d2d0 2024-09-22T08:36:46.179 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.154+0000 7f867fd3e800 20 rados_obj.operate() r=0 bl.length=165 2024-09-22T08:36:46.179 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.154+0000 7f867fd3e800 20 rados->read ofs=0 len=0 2024-09-22T08:36:46.179 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.154+0000 7f867fd3e800 1 -- 172.21.15.142:0/1954950536 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:63 8.15 8:ab67ca09:root::.bucket.meta.myfoo%3ae239248c-0bee-4e41-803a-24b288d3eb8f.4226.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5623ab3254a0 con 0x5623ab2e1e60 2024-09-22T08:36:46.179 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.155+0000 7f867c2ee640 1 -- 172.21.15.142:0/1954950536 <== osd.3 v2:172.21.15.142:6800/1064901393 16 ==== osd_op_reply(63 .bucket.meta.myfoo:e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7f8674053020 con 0x5623ab2e1e60 2024-09-22T08:36:46.179 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.155+0000 7f867fd3e800 20 rados_obj.operate() r=0 bl.length=387 2024-09-22T08:36:46.179 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.155+0000 7f867fd3e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:36:46.179 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.155+0000 7f867fd3e800 20 rados->read ofs=0 len=0 2024-09-22T08:36:46.179 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.155+0000 7f867fd3e800 1 -- 172.21.15.142:0/1954950536 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5623ab325450 con 0x7f867404d2d0 2024-09-22T08:36:46.179 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.155+0000 7f867baed640 1 -- 172.21.15.142:0/1954950536 <== osd.2 v2:172.21.15.142:6808/279438927 12 ==== osd_op_reply(64 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f866c061040 con 0x7f867404d2d0 2024-09-22T08:36:46.179 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.155+0000 7f867fd3e800 20 rados_obj.operate() r=0 bl.length=165 2024-09-22T08:36:46.179 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.155+0000 7f867fd3e800 20 rados->read ofs=0 len=0 2024-09-22T08:36:46.180 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.155+0000 7f867fd3e800 1 -- 172.21.15.142:0/1954950536 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:65 8.15 8:ab67ca09:root::.bucket.meta.myfoo%3ae239248c-0bee-4e41-803a-24b288d3eb8f.4226.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5623ab325450 con 0x5623ab2e1e60 2024-09-22T08:36:46.180 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.155+0000 7f867c2ee640 1 -- 172.21.15.142:0/1954950536 <== osd.3 v2:172.21.15.142:6800/1064901393 17 ==== osd_op_reply(65 .bucket.meta.myfoo:e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7f8674053020 con 0x5623ab2e1e60 2024-09-22T08:36:46.180 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.155+0000 7f867fd3e800 20 rados_obj.operate() r=0 bl.length=387 2024-09-22T08:36:46.180 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.155+0000 7f867fd3e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:36:46.180 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.155+0000 7f867fd3e800 1 -- 172.21.15.142:0/1954950536 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:66 4.12 4:48caaf34:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5623ab3280c0 con 0x5623ab2dd450 2024-09-22T08:36:46.180 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.155+0000 7f867fd3e800 1 -- 172.21.15.142:0/1954950536 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:67 4.10 4:09af3fe1:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5623ab32aa70 con 0x5623ab2e1e60 2024-09-22T08:36:46.180 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.155+0000 7f867fd3e800 1 -- 172.21.15.142:0/1954950536 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:68 4.12 4:49def6fa:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5623ab32d4f0 con 0x5623ab2dd450 2024-09-22T08:36:46.180 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.155+0000 7f867fd3e800 1 -- 172.21.15.142:0/1954950536 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:69 4.2 4:4255cd8e:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5623ab32fea0 con 0x5623ab2dd450 2024-09-22T08:36:46.180 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.155+0000 7f867fd3e800 1 -- 172.21.15.142:0/1954950536 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:70 4.c 4:323d0659:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5623ab332870 con 0x5623ab2dd450 2024-09-22T08:36:46.180 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.155+0000 7f867fd3e800 1 -- 172.21.15.142:0/1954950536 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:71 4.20 4:061d9e92:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5623ab3356e0 con 0x5623ab2dd450 2024-09-22T08:36:46.180 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.155+0000 7f867fd3e800 1 -- 172.21.15.142:0/1954950536 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:72 4.3b 4:dc8435be:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5623ab3385a0 con 0x5623ab2e1e60 2024-09-22T08:36:46.180 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.155+0000 7f867fd3e800 1 -- 172.21.15.142:0/1954950536 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:73 4.22 4:44b3b4fd:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5623ab332870 con 0x5623ab2dd450 2024-09-22T08:36:46.180 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.155+0000 7f867fd3e800 1 -- 172.21.15.142:0/1954950536 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:74 4.2d 4:b74eadf4:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5623ab33d8b0 con 0x7f866c0535f0 2024-09-22T08:36:46.181 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.156+0000 7f867fd3e800 1 -- 172.21.15.142:0/1954950536 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:75 4.12 4:4be25f13:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5623ab340120 con 0x5623ab2dd450 2024-09-22T08:36:46.181 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.156+0000 7f867fd3e800 1 -- 172.21.15.142:0/1954950536 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:76 4.5 4:a0e4e0ec:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5623ab342990 con 0x5623ab2e1e60 2024-09-22T08:36:46.181 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.156+0000 7f86732ec640 1 -- 172.21.15.142:0/1954950536 <== osd.1 v2:172.21.15.142:6816/3192108003 21 ==== osd_op_reply(66 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1.0 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f8664051070 con 0x5623ab2dd450 2024-09-22T08:36:46.181 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.156+0000 7f86732ec640 1 -- 172.21.15.142:0/1954950536 <== osd.1 v2:172.21.15.142:6816/3192108003 22 ==== osd_op_reply(70 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1.4 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f8664051070 con 0x5623ab2dd450 2024-09-22T08:36:46.181 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.156+0000 7f86732ec640 1 -- 172.21.15.142:0/1954950536 <== osd.1 v2:172.21.15.142:6816/3192108003 23 ==== osd_op_reply(71 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1.5 [call out=128b] v0'0 uv3 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7f8664051070 con 0x5623ab2dd450 2024-09-22T08:36:46.181 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.156+0000 7f86732ec640 1 -- 172.21.15.142:0/1954950536 <== osd.1 v2:172.21.15.142:6816/3192108003 24 ==== osd_op_reply(68 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1.2 [call out=89b] v0'0 uv2 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f8664051070 con 0x5623ab2dd450 2024-09-22T08:36:46.181 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.156+0000 7f86732ec640 1 -- 172.21.15.142:0/1954950536 <== osd.0 v2:172.21.15.31:6800/168281188 17 ==== osd_op_reply(74 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1.8 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f8664051070 con 0x7f866c0535f0 2024-09-22T08:36:46.181 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.156+0000 7f867c2ee640 1 -- 172.21.15.142:0/1954950536 <== osd.3 v2:172.21.15.142:6800/1064901393 18 ==== osd_op_reply(67 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1.1 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f8674053020 con 0x5623ab2e1e60 2024-09-22T08:36:46.181 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.156+0000 7f86732ec640 1 -- 172.21.15.142:0/1954950536 <== osd.1 v2:172.21.15.142:6816/3192108003 25 ==== osd_op_reply(69 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1.3 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f8664051070 con 0x5623ab2dd450 2024-09-22T08:36:46.181 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.156+0000 7f867c2ee640 1 -- 172.21.15.142:0/1954950536 <== osd.3 v2:172.21.15.142:6800/1064901393 19 ==== osd_op_reply(72 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1.6 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f8674053020 con 0x5623ab2e1e60 2024-09-22T08:36:46.181 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.156+0000 7f867c2ee640 1 -- 172.21.15.142:0/1954950536 <== osd.3 v2:172.21.15.142:6800/1064901393 20 ==== osd_op_reply(76 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1.10 [call out=89b] v0'0 uv1 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f8674053020 con 0x5623ab2e1e60 2024-09-22T08:36:46.181 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.156+0000 7f86732ec640 1 -- 172.21.15.142:0/1954950536 <== osd.1 v2:172.21.15.142:6816/3192108003 26 ==== osd_op_reply(73 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1.7 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f8664051070 con 0x5623ab2dd450 2024-09-22T08:36:46.181 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.156+0000 7f86732ec640 1 -- 172.21.15.142:0/1954950536 <== osd.1 v2:172.21.15.142:6816/3192108003 27 ==== osd_op_reply(75 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1.9 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f8664051070 con 0x5623ab2dd450 2024-09-22T08:36:46.182 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.157+0000 7f8531fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:36:46.182 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.157+0000 7f867fd3e800 1 -- 172.21.15.142:0/1954950536 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:77 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94711195820640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5623ab3385a0 con 0x5623ab2dd450 2024-09-22T08:36:46.182 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.158+0000 7f86732ec640 1 -- 172.21.15.142:0/1954950536 <== osd.1 v2:172.21.15.142:6816/3192108003 28 ==== osd_op_reply(77 data_loggenerations_metadata [watch unwatch cookie 94711195820640] v30'101 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8664051070 con 0x5623ab2dd450 2024-09-22T08:36:46.182 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.158+0000 7f867fd3e800 1 -- 172.21.15.142:0/1954950536 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:78 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94711195793408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5623ab322460 con 0x7f867404d2d0 2024-09-22T08:36:46.182 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.159+0000 7f867baed640 1 -- 172.21.15.142:0/1954950536 <== osd.2 v2:172.21.15.142:6808/279438927 13 ==== osd_op_reply(78 notify.0 [watch unwatch cookie 94711195793408] v30'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f866c061040 con 0x7f867404d2d0 2024-09-22T08:36:46.182 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.159+0000 7f867fd3e800 20 remove_watcher() i=0 2024-09-22T08:36:46.183 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.159+0000 7f867fd3e800 2 removed watcher, disabling cache 2024-09-22T08:36:46.183 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.159+0000 7f867fd3e800 1 -- 172.21.15.142:0/1954950536 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:79 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94711195800976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5623ab322460 con 0x5623ab2dd450 2024-09-22T08:36:46.183 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.160+0000 7f86732ec640 1 -- 172.21.15.142:0/1954950536 <== osd.1 v2:172.21.15.142:6816/3192108003 29 ==== osd_op_reply(79 notify.1 [watch unwatch cookie 94711195800976] v30'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8664051070 con 0x5623ab2dd450 2024-09-22T08:36:46.183 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.160+0000 7f867fd3e800 20 remove_watcher() i=1 2024-09-22T08:36:46.183 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.160+0000 7f867fd3e800 1 -- 172.21.15.142:0/1954950536 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:80 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94711195803232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5623ab322460 con 0x5623ab2e1e60 2024-09-22T08:36:46.183 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.161+0000 7f867c2ee640 1 -- 172.21.15.142:0/1954950536 <== osd.3 v2:172.21.15.142:6800/1064901393 21 ==== osd_op_reply(80 notify.2 [watch unwatch cookie 94711195803232] v30'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8674053020 con 0x5623ab2e1e60 2024-09-22T08:36:46.183 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.161+0000 7f867fd3e800 20 remove_watcher() i=2 2024-09-22T08:36:46.184 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.161+0000 7f867fd3e800 1 -- 172.21.15.142:0/1954950536 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:81 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94711195806496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5623ab322460 con 0x7f867404d2d0 2024-09-22T08:36:46.184 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.162+0000 7f867baed640 1 -- 172.21.15.142:0/1954950536 <== osd.2 v2:172.21.15.142:6808/279438927 14 ==== osd_op_reply(81 notify.3 [watch unwatch cookie 94711195806496] v30'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f866c061040 con 0x7f867404d2d0 2024-09-22T08:36:46.184 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.162+0000 7f867fd3e800 20 remove_watcher() i=3 2024-09-22T08:36:46.184 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.162+0000 7f867fd3e800 1 -- 172.21.15.142:0/1954950536 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:82 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94711195810576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5623ab322460 con 0x5623ab2dd450 2024-09-22T08:36:46.184 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.163+0000 7f86732ec640 1 -- 172.21.15.142:0/1954950536 <== osd.1 v2:172.21.15.142:6816/3192108003 30 ==== osd_op_reply(82 notify.4 [watch unwatch cookie 94711195810576] v30'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8664051070 con 0x5623ab2dd450 2024-09-22T08:36:46.184 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.163+0000 7f867fd3e800 20 remove_watcher() i=4 2024-09-22T08:36:46.185 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.163+0000 7f867fd3e800 1 -- 172.21.15.142:0/1954950536 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:83 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94711195814352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5623ab322460 con 0x7f866c0535f0 2024-09-22T08:36:46.185 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.164+0000 7f86732ec640 1 -- 172.21.15.142:0/1954950536 <== osd.0 v2:172.21.15.31:6800/168281188 18 ==== osd_op_reply(83 notify.5 [watch unwatch cookie 94711195814352] v30'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8664051070 con 0x7f866c0535f0 2024-09-22T08:36:46.185 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.164+0000 7f867fd3e800 20 remove_watcher() i=5 2024-09-22T08:36:46.185 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.164+0000 7f867fd3e800 1 -- 172.21.15.142:0/1954950536 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:84 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94711195818304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5623ab322460 con 0x7f866c0535f0 2024-09-22T08:36:46.185 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.165+0000 7f86732ec640 1 -- 172.21.15.142:0/1954950536 <== osd.0 v2:172.21.15.31:6800/168281188 19 ==== osd_op_reply(84 notify.6 [watch unwatch cookie 94711195818304] v30'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8664051070 con 0x7f866c0535f0 2024-09-22T08:36:46.185 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.165+0000 7f867fd3e800 20 remove_watcher() i=6 2024-09-22T08:36:46.185 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.165+0000 7f867fd3e800 1 -- 172.21.15.142:0/1954950536 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:85 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94711195812736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5623ab322460 con 0x7f866c0535f0 2024-09-22T08:36:46.186 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.166+0000 7f86732ec640 1 -- 172.21.15.142:0/1954950536 <== osd.0 v2:172.21.15.31:6800/168281188 20 ==== osd_op_reply(85 notify.7 [watch unwatch cookie 94711195812736] v30'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8664051070 con 0x7f866c0535f0 2024-09-22T08:36:46.186 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.166+0000 7f867fd3e800 20 remove_watcher() i=7 2024-09-22T08:36:46.186 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.166+0000 7f867fd3e800 1 -- 172.21.15.142:0/1954950536 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f866c0535f0 msgr2=0x7f866c053a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:46.186 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.166+0000 7f867fd3e800 1 --2- 172.21.15.142:0/1954950536 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f866c0535f0 0x7f866c053a10 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:46.186 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.166+0000 7f867fd3e800 1 -- 172.21.15.142:0/1954950536 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5623ab2dd450 msgr2=0x5623ab2df910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:46.186 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.166+0000 7f867fd3e800 1 --2- 172.21.15.142:0/1954950536 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5623ab2dd450 0x5623ab2df910 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:46.187 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.166+0000 7f867fd3e800 1 -- 172.21.15.142:0/1954950536 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f867404d2d0 msgr2=0x7f8674045130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:46.187 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.166+0000 7f867fd3e800 1 --2- 172.21.15.142:0/1954950536 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f867404d2d0 0x7f8674045130 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:46.187 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.166+0000 7f867fd3e800 1 -- 172.21.15.142:0/1954950536 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5623ab2e1e60 msgr2=0x5623ab2e4250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:46.187 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.166+0000 7f867fd3e800 1 --2- 172.21.15.142:0/1954950536 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5623ab2e1e60 0x5623ab2e4250 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:46.187 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.166+0000 7f867fd3e800 1 -- 172.21.15.142:0/1954950536 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f854403d000 msgr2=0x7f854403f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:46.187 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.166+0000 7f867fd3e800 1 --2- 172.21.15.142:0/1954950536 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f854403d000 0x7f854403f4c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f866c00f640 tx=0x7f866c048000 comp rx=0 tx=0).stop 2024-09-22T08:36:46.188 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.166+0000 7f867fd3e800 1 -- 172.21.15.142:0/1954950536 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5623ab1a8840 msgr2=0x5623ab2d1c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:46.188 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.166+0000 7f867fd3e800 1 --2- 172.21.15.142:0/1954950536 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5623ab1a8840 0x5623ab2d1c00 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f8674016cd0 tx=0x7f8674054780 comp rx=0 tx=0).stop 2024-09-22T08:36:46.188 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.166+0000 7f86732ec640 1 -- 172.21.15.142:0/1954950536 reap_dead start 2024-09-22T08:36:46.188 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.166+0000 7f867fd3e800 1 -- 172.21.15.142:0/1954950536 shutdown_connections 2024-09-22T08:36:46.188 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.166+0000 7f867fd3e800 1 --2- 172.21.15.142:0/1954950536 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5623ab1a8840 0x5623ab2d1c00 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:46.188 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.166+0000 7f867fd3e800 1 -- 172.21.15.142:0/1954950536 >> 172.21.15.142:0/1954950536 conn(0x5623ab2c47f0 msgr2=0x5623ab2c2a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:46.189 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.166+0000 7f867fd3e800 1 -- 172.21.15.142:0/1954950536 shutdown_connections 2024-09-22T08:36:46.189 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.166+0000 7f867fd3e800 1 -- 172.21.15.142:0/1954950536 wait complete. 2024-09-22T08:36:46.189 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.167+0000 7f867fd3e800 1 -- 172.21.15.142:0/1503685066 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f855403d000 msgr2=0x7f855403f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:46.189 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.167+0000 7f867fd3e800 1 --2- 172.21.15.142:0/1503685066 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f855403d000 0x7f855403f4c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x5623ab2ad380 tx=0x7f866c053170 comp rx=0 tx=0).stop 2024-09-22T08:36:46.189 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.167+0000 7f867fd3e800 1 -- 172.21.15.142:0/1503685066 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5623ab2bb970 msgr2=0x5623ab2bbd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:46.189 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.167+0000 7f867fd3e800 1 --2- 172.21.15.142:0/1503685066 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5623ab2bb970 0x5623ab2bbd90 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x5623ab2a1970 tx=0x7f86740167b0 comp rx=0 tx=0).stop 2024-09-22T08:36:46.190 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.167+0000 7f867fd3e800 1 -- 172.21.15.142:0/1503685066 shutdown_connections 2024-09-22T08:36:46.190 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.167+0000 7f867fd3e800 1 --2- 172.21.15.142:0/1503685066 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f855403d000 0x7f855403f4c0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:46.190 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.167+0000 7f867fd3e800 1 --2- 172.21.15.142:0/1503685066 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5623ab2bb970 0x5623ab2bbd90 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:46.190 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.167+0000 7f867fd3e800 1 -- 172.21.15.142:0/1503685066 >> 172.21.15.142:0/1503685066 conn(0x5623ab2afd20 msgr2=0x5623ab2b0100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:46.190 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.167+0000 7f867fd3e800 1 -- 172.21.15.142:0/1503685066 shutdown_connections 2024-09-22T08:36:46.190 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.167+0000 7f867fd3e800 1 -- 172.21.15.142:0/1503685066 wait complete. 2024-09-22T08:36:46.191 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.167+0000 7f867fd3e800 1 -- 172.21.15.142:0/1724897265 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5623ab1a7fe0 msgr2=0x5623ab2a7fc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:46.191 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.167+0000 7f867fd3e800 1 --2- 172.21.15.142:0/1724897265 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5623ab1a7fe0 0x5623ab2a7fc0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:46.191 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.167+0000 7f867fd3e800 1 -- 172.21.15.142:0/1724897265 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5623ab2aa3a0 msgr2=0x5623ab2ac820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:46.191 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.167+0000 7f867fd3e800 1 --2- 172.21.15.142:0/1724897265 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5623ab2aa3a0 0x5623ab2ac820 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:46.191 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.167+0000 7f867fd3e800 1 -- 172.21.15.142:0/1724897265 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f856403d150 msgr2=0x7f856403f610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:46.191 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.167+0000 7f867fd3e800 1 --2- 172.21.15.142:0/1724897265 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f856403d150 0x7f856403f610 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f8664057000 tx=0x7f8664052000 comp rx=0 tx=0).stop 2024-09-22T08:36:46.192 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.167+0000 7f867fd3e800 1 -- 172.21.15.142:0/1724897265 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5623ab1a7be0 msgr2=0x5623ab2a0970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:46.192 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.167+0000 7f867fd3e800 1 --2- 172.21.15.142:0/1724897265 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5623ab1a7be0 0x5623ab2a0970 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f866c0012f0 tx=0x7f866c000ed0 comp rx=0 tx=0).stop 2024-09-22T08:36:46.192 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.167+0000 7f867fd3e800 1 -- 172.21.15.142:0/1724897265 shutdown_connections 2024-09-22T08:36:46.192 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.167+0000 7f867fd3e800 1 --2- 172.21.15.142:0/1724897265 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5623ab2aa3a0 0x5623ab2ac820 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:46.192 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.167+0000 7f867fd3e800 1 --2- 172.21.15.142:0/1724897265 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5623ab1a7fe0 0x5623ab2a7fc0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:46.192 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.167+0000 7f867fd3e800 1 --2- 172.21.15.142:0/1724897265 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f856403d150 0x7f856403f610 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:46.193 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.167+0000 7f867fd3e800 1 --2- 172.21.15.142:0/1724897265 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5623ab1a7be0 0x5623ab2a0970 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:46.193 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.167+0000 7f867fd3e800 1 -- 172.21.15.142:0/1724897265 >> 172.21.15.142:0/1724897265 conn(0x5623ab1a3310 msgr2=0x5623ab29a380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:46.193 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.167+0000 7f867fd3e800 1 -- 172.21.15.142:0/1724897265 shutdown_connections 2024-09-22T08:36:46.193 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.167+0000 7f867fd3e800 1 -- 172.21.15.142:0/1724897265 wait complete. 2024-09-22T08:36:46.195 INFO:teuthology.orchestra.run.smithi142.stdout:{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"d89f6f57-1007-47dd-9065-f486c7b01aec","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1","marker":"e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1","index_type":"Normal","index_generation":0,"num_shards":11,"reshard_status":"None","judge_reshard_lock_time":"0.000000","object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#2,6#1,7#1,8#1,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-09-22T08:36:45.363175Z","creation_time":"2024-09-22T08:36:45.359780Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{"rgw.main":{"size":3,"size_actual":4096,"size_utilized":3,"size_kb":1,"size_kb_actual":4,"size_kb_utilized":1,"num_objects":1}},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"read_tracker":1} 2024-09-22T08:36:46.195 DEBUG:tasks.util.rgw: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': 'd89f6f57-1007-47dd-9065-f486c7b01aec', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': 'e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1', 'marker': 'e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'reshard_status': 'None', 'judge_reshard_lock_time': '0.000000', 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#2,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-22T08:36:45.363175Z', 'creation_time': '2024-09-22T08:36:45.359780Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 3, 'size_actual': 4096, 'size_utilized': 3, 'size_kb': 1, 'size_kb_actual': 4, 'size_kb_utilized': 1, 'num_objects': 1}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'read_tracker': 1} 2024-09-22T08:36:46.196 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'stats', '--uid', 'foo', '--sync-stats'] 2024-09-22T08:36:46.196 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'stats', '--uid', 'foo', '--sync-stats'] 2024-09-22T08:36:46.196 DEBUG:teuthology.orchestra.run.smithi142:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user stats --uid foo --sync-stats 2024-09-22T08:36:46.242 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:36:46.242 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:36:46.244 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.241+0000 7f98ecf2f800 1 Processor -- start 2024-09-22T08:36:46.245 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.241+0000 7f98ecf2f800 1 -- start start 2024-09-22T08:36:46.245 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.242+0000 7f98ecf2f800 1 --2- >> v2:172.21.15.31:3300/0 conn(0x5555e0d517e0 0x5555e0d524e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:46.245 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.242+0000 7f98ecf2f800 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5555e0bdda20 con 0x5555e0d52a20 2024-09-22T08:36:46.245 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.242+0000 7f98ecf2f800 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x5555e0bdd7d0 con 0x5555e0d517e0 2024-09-22T08:36:46.245 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.242+0000 7f98e8c76640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x5555e0d517e0 0x5555e0d524e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:46.245 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.242+0000 7f98e8475640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x5555e0d52a20 0x5555e0d57570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.142:42526/0 (socket says 172.21.15.142:42526) 2024-09-22T08:36:46.246 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.242+0000 7f98e8475640 1 -- 172.21.15.142:0/2923464524 learned_addr learned my addr 172.21.15.142:0/2923464524 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-09-22T08:36:46.246 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.242+0000 7f98e8c76640 1 -- 172.21.15.142:0/2923464524 >> v1:172.21.15.31:6789/0 conn(0x5555e0d52a20 legacy=0x5555e0d57570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:46.246 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.242+0000 7f98e8c76640 1 -- 172.21.15.142:0/2923464524 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5555e0d51ee0 con 0x5555e0d517e0 2024-09-22T08:36:46.248 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.244+0000 7f98e8c76640 1 --2- 172.21.15.142:0/2923464524 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5555e0d517e0 0x5555e0d524e0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f98d800a470 tx=0x7f98d8045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c414aa3d4124083 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:46.248 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.244+0000 7f98e7c74640 1 -- 172.21.15.142:0/2923464524 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98d8053570 con 0x5555e0d517e0 2024-09-22T08:36:46.248 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.244+0000 7f98e7c74640 1 -- 172.21.15.142:0/2923464524 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98d8058070 con 0x5555e0d517e0 2024-09-22T08:36:46.248 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.244+0000 7f98e7c74640 1 -- 172.21.15.142:0/2923464524 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98d8053880 con 0x5555e0d517e0 2024-09-22T08:36:46.248 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.245+0000 7f98ecf2f800 1 -- 172.21.15.142:0/2923464524 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5555e0d517e0 msgr2=0x5555e0d524e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:46.249 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.245+0000 7f98ecf2f800 1 --2- 172.21.15.142:0/2923464524 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5555e0d517e0 0x5555e0d524e0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f98d800a470 tx=0x7f98d8045a20 comp rx=0 tx=0).stop 2024-09-22T08:36:46.249 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.245+0000 7f98ecf2f800 1 -- 172.21.15.142:0/2923464524 shutdown_connections 2024-09-22T08:36:46.249 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.245+0000 7f98ecf2f800 1 --2- 172.21.15.142:0/2923464524 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5555e0d517e0 0x5555e0d524e0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:46.249 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.245+0000 7f98ecf2f800 1 -- 172.21.15.142:0/2923464524 >> 172.21.15.142:0/2923464524 conn(0x5555e0d4cbb0 msgr2=0x5555e0d4f010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:46.249 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.245+0000 7f98ecf2f800 1 -- 172.21.15.142:0/2923464524 shutdown_connections 2024-09-22T08:36:46.249 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.245+0000 7f98ecf2f800 1 -- 172.21.15.142:0/2923464524 wait complete. 2024-09-22T08:36:46.264 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.259+0000 7f98ecf2f800 1 Processor -- start 2024-09-22T08:36:46.264 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.259+0000 7f98ecf2f800 1 -- start start 2024-09-22T08:36:46.264 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.259+0000 7f98ecf2f800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5555e0d517e0 0x5555e0cc5930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:46.265 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.259+0000 7f98ecf2f800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5555e0beadd0 con 0x5555e0d517e0 2024-09-22T08:36:46.265 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.259+0000 7f98e8c76640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5555e0d517e0 0x5555e0cc5930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:46.265 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.259+0000 7f98e8c76640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5555e0d517e0 0x5555e0cc5930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:39300/0 (socket says 172.21.15.142:39300) 2024-09-22T08:36:46.265 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.259+0000 7f98e8c76640 1 -- 172.21.15.142:0/57372670 learned_addr learned my addr 172.21.15.142:0/57372670 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:46.265 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.259+0000 7f98e8c76640 1 -- 172.21.15.142:0/57372670 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5555e0cc5f20 con 0x5555e0d517e0 2024-09-22T08:36:46.265 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.260+0000 7f98e8c76640 1 --2- 172.21.15.142:0/57372670 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5555e0d517e0 0x5555e0cc5930 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f98d8025c20 tx=0x7f98d8051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a25548b29107e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:46.265 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.260+0000 7f97d6e0d640 1 -- 172.21.15.142:0/57372670 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98d8053a20 con 0x5555e0d517e0 2024-09-22T08:36:46.265 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.260+0000 7f97d6e0d640 1 -- 172.21.15.142:0/57372670 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98d8063070 con 0x5555e0d517e0 2024-09-22T08:36:46.265 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.260+0000 7f97d6e0d640 1 -- 172.21.15.142:0/57372670 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98d8053cf0 con 0x5555e0d517e0 2024-09-22T08:36:46.265 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.260+0000 7f98ecf2f800 1 -- 172.21.15.142:0/57372670 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5555e0d517e0 msgr2=0x5555e0cc5930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:46.265 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.260+0000 7f98ecf2f800 1 --2- 172.21.15.142:0/57372670 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5555e0d517e0 0x5555e0cc5930 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f98d8025c20 tx=0x7f98d8051000 comp rx=0 tx=0).stop 2024-09-22T08:36:46.265 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.261+0000 7f98ecf2f800 1 -- 172.21.15.142:0/57372670 shutdown_connections 2024-09-22T08:36:46.265 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.261+0000 7f98ecf2f800 1 --2- 172.21.15.142:0/57372670 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5555e0d517e0 0x5555e0cc5930 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:46.266 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.261+0000 7f98ecf2f800 1 -- 172.21.15.142:0/57372670 >> 172.21.15.142:0/57372670 conn(0x5555e0d4cbb0 msgr2=0x5555e0e3c890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:46.266 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.261+0000 7f98ecf2f800 1 -- 172.21.15.142:0/57372670 shutdown_connections 2024-09-22T08:36:46.266 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.261+0000 7f98ecf2f800 1 -- 172.21.15.142:0/57372670 wait complete. 2024-09-22T08:36:46.266 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.261+0000 7f98ecf2f800 1 Processor -- start 2024-09-22T08:36:46.266 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.261+0000 7f98ecf2f800 1 -- start start 2024-09-22T08:36:46.266 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.261+0000 7f98ecf2f800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5555e0d517e0 0x5555e0e42360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:46.266 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.261+0000 7f98ecf2f800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5555e0d53290 con 0x5555e0d517e0 2024-09-22T08:36:46.266 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.261+0000 7f98e8c76640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5555e0d517e0 0x5555e0e42360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:46.266 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.261+0000 7f98e8c76640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5555e0d517e0 0x5555e0e42360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:39306/0 (socket says 172.21.15.142:39306) 2024-09-22T08:36:46.266 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.261+0000 7f98e8c76640 1 -- 172.21.15.142:0/525029892 learned_addr learned my addr 172.21.15.142:0/525029892 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:46.266 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.261+0000 7f98e8c76640 1 -- 172.21.15.142:0/525029892 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5555e0e428c0 con 0x5555e0d517e0 2024-09-22T08:36:46.266 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.262+0000 7f98e8c76640 1 --2- 172.21.15.142:0/525029892 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5555e0d517e0 0x5555e0e42360 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f98d8025c20 tx=0x7f98d8002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:46.266 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.262+0000 7f97d560a640 1 -- 172.21.15.142:0/525029892 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98d8068660 con 0x5555e0d517e0 2024-09-22T08:36:46.267 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.262+0000 7f97d560a640 1 -- 172.21.15.142:0/525029892 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98d8068800 con 0x5555e0d517e0 2024-09-22T08:36:46.267 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.262+0000 7f98ecf2f800 1 -- 172.21.15.142:0/525029892 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5555e0e40c70 con 0x5555e0d517e0 2024-09-22T08:36:46.267 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.262+0000 7f97d560a640 1 -- 172.21.15.142:0/525029892 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98d8068ae0 con 0x5555e0d517e0 2024-09-22T08:36:46.267 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.262+0000 7f98ecf2f800 1 -- 172.21.15.142:0/525029892 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5555e0e41290 con 0x5555e0d517e0 2024-09-22T08:36:46.267 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.263+0000 7f97d560a640 1 -- 172.21.15.142:0/525029892 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f98d8068c80 con 0x5555e0d517e0 2024-09-22T08:36:46.267 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.263+0000 7f97d560a640 1 --2- 172.21.15.142:0/525029892 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f97d003cfb0 0x7f97d003f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:46.267 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.263+0000 7f97d560a640 1 -- 172.21.15.142:0/525029892 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f98d8098c30 con 0x5555e0d517e0 2024-09-22T08:36:46.267 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.263+0000 7f98e8475640 1 --2- 172.21.15.142:0/525029892 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f97d003cfb0 0x7f97d003f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:46.267 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.263+0000 7f98ecf2f800 1 --2- 172.21.15.142:0/525029892 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5555e0d52a20 0x5555e0e53010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:46.267 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.263+0000 7f98ecf2f800 1 -- 172.21.15.142:0/525029892 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5555e0e53550 con 0x5555e0d52a20 2024-09-22T08:36:46.267 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.263+0000 7f98e9477640 1 --2- 172.21.15.142:0/525029892 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5555e0d52a20 0x5555e0e53010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:46.268 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.263+0000 7f98e8475640 1 --2- 172.21.15.142:0/525029892 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f97d003cfb0 0x7f97d003f470 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f98dc001d70 tx=0x7f98dc0012d0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:46.273 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.264+0000 7f98e9477640 1 --2- 172.21.15.142:0/525029892 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5555e0d52a20 0x5555e0e53010 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:46.273 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.264+0000 7f98e9477640 1 -- 172.21.15.142:0/525029892 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f98e000a4d0 con 0x5555e0d52a20 2024-09-22T08:36:46.273 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.264+0000 7f98ecf2f800 1 -- 172.21.15.142:0/525029892 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5555e0e53df0 con 0x5555e0d52a20 2024-09-22T08:36:46.273 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.264+0000 7f98e9477640 1 -- 172.21.15.142:0/525029892 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f98e000a4d0 con 0x5555e0d52a20 2024-09-22T08:36:46.273 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.264+0000 7f98ecf2f800 1 --2- 172.21.15.142:0/525029892 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5555e0e55700 0x5555e0e57ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:46.273 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.264+0000 7f98ecf2f800 1 -- 172.21.15.142:0/525029892 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:3 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5555e0e58330 con 0x5555e0e55700 2024-09-22T08:36:46.273 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.264+0000 7f98e8c76640 1 --2- 172.21.15.142:0/525029892 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5555e0e55700 0x5555e0e57ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:46.274 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.264+0000 7f98e8c76640 1 --2- 172.21.15.142:0/525029892 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5555e0e55700 0x5555e0e57ba0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:46.274 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.265+0000 7f98e8c76640 1 -- 172.21.15.142:0/525029892 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(3 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f98d8051070 con 0x5555e0e55700 2024-09-22T08:36:46.274 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.265+0000 7f98ecf2f800 1 -- 172.21.15.142:0/525029892 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5555e0e54640 con 0x5555e0d52a20 2024-09-22T08:36:46.274 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.265+0000 7f98e9477640 1 -- 172.21.15.142:0/525029892 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f98e000a4d0 con 0x5555e0d52a20 2024-09-22T08:36:46.274 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.265+0000 7f98ecf2f800 1 -- 172.21.15.142:0/525029892 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5555e0e54a20 con 0x5555e0e55700 2024-09-22T08:36:46.274 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.265+0000 7f98e8c76640 1 -- 172.21.15.142:0/525029892 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(5 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f98d8051070 con 0x5555e0e55700 2024-09-22T08:36:46.274 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.266+0000 7f98ecf2f800 1 Processor -- start 2024-09-22T08:36:46.274 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.266+0000 7f98ecf2f800 1 -- start start 2024-09-22T08:36:46.274 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.266+0000 7f98ecf2f800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5555e0e66cf0 0x5555e0e67110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:46.274 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.266+0000 7f98ecf2f800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5555e0c49d50 con 0x5555e0e66cf0 2024-09-22T08:36:46.274 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.266+0000 7f98e9477640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5555e0e66cf0 0x5555e0e67110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:46.275 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.266+0000 7f98e9477640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5555e0e66cf0 0x5555e0e67110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:39318/0 (socket says 172.21.15.142:39318) 2024-09-22T08:36:46.275 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.266+0000 7f98e9477640 1 -- 172.21.15.142:0/2042424833 learned_addr learned my addr 172.21.15.142:0/2042424833 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:46.275 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.266+0000 7f98e9477640 1 -- 172.21.15.142:0/2042424833 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5555e0e67750 con 0x5555e0e66cf0 2024-09-22T08:36:46.275 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.267+0000 7f98e9477640 1 --2- 172.21.15.142:0/2042424833 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5555e0e66cf0 0x5555e0e67110 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x5555e0e41f00 tx=0x7f98e00167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:46.275 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.267+0000 7f97ce7fc640 1 -- 172.21.15.142:0/2042424833 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98e0013640 con 0x5555e0e66cf0 2024-09-22T08:36:46.275 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.267+0000 7f97ce7fc640 1 -- 172.21.15.142:0/2042424833 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98e00137e0 con 0x5555e0e66cf0 2024-09-22T08:36:46.275 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.267+0000 7f98ecf2f800 1 -- 172.21.15.142:0/2042424833 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5555e0e67f80 con 0x5555e0e66cf0 2024-09-22T08:36:46.275 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.267+0000 7f97ce7fc640 1 -- 172.21.15.142:0/2042424833 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98e0013ae0 con 0x5555e0e66cf0 2024-09-22T08:36:46.275 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.267+0000 7f98ecf2f800 1 -- 172.21.15.142:0/2042424833 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5555e0e68520 con 0x5555e0e66cf0 2024-09-22T08:36:46.275 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.268+0000 7f97ce7fc640 1 -- 172.21.15.142:0/2042424833 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f98e0011040 con 0x5555e0e66cf0 2024-09-22T08:36:46.275 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.268+0000 7f97ce7fc640 1 --2- 172.21.15.142:0/2042424833 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f97c003d000 0x7f97c003f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:46.275 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.268+0000 7f97ce7fc640 1 -- 172.21.15.142:0/2042424833 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f98e000e040 con 0x5555e0e66cf0 2024-09-22T08:36:46.276 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.268+0000 7f98e8c76640 1 --2- 172.21.15.142:0/2042424833 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f97c003d000 0x7f97c003f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:46.276 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.268+0000 7f98ecf2f800 1 Processor -- start 2024-09-22T08:36:46.276 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.268+0000 7f98ecf2f800 1 -- start start 2024-09-22T08:36:46.276 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.268+0000 7f98e8c76640 1 --2- 172.21.15.142:0/2042424833 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f97c003d000 0x7f97c003f4c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x5555e0e418f0 tx=0x7f98d805da60 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:46.276 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.268+0000 7f98ecf2f800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5555e0e73770 0x5555e0e73b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:46.276 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.268+0000 7f98ecf2f800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5555e0e44e50 con 0x5555e0e73770 2024-09-22T08:36:46.276 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.269+0000 7f98e9477640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5555e0e73770 0x5555e0e73b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:46.276 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.269+0000 7f98e9477640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5555e0e73770 0x5555e0e73b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:39328/0 (socket says 172.21.15.142:39328) 2024-09-22T08:36:46.276 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.269+0000 7f98e9477640 1 -- 172.21.15.142:0/3717908307 learned_addr learned my addr 172.21.15.142:0/3717908307 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:46.276 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.269+0000 7f98e9477640 1 -- 172.21.15.142:0/3717908307 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5555e0e74160 con 0x5555e0e73770 2024-09-22T08:36:46.276 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.269+0000 7f98e9477640 1 --2- 172.21.15.142:0/3717908307 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5555e0e73770 0x5555e0e73b70 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f98e0016cd0 tx=0x7f98e0020460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c4235bc4ca3bf19 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:46.277 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.269+0000 7f97bffff640 1 -- 172.21.15.142:0/3717908307 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98e0044030 con 0x5555e0e73770 2024-09-22T08:36:46.277 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.269+0000 7f97bffff640 1 -- 172.21.15.142:0/3717908307 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98e002adb0 con 0x5555e0e73770 2024-09-22T08:36:46.277 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.269+0000 7f97bffff640 1 -- 172.21.15.142:0/3717908307 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98e001fdb0 con 0x5555e0e73770 2024-09-22T08:36:46.277 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.270+0000 7f98ecf2f800 1 -- 172.21.15.142:0/3717908307 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5555e0e73770 msgr2=0x5555e0e73b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:46.277 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.270+0000 7f98ecf2f800 1 --2- 172.21.15.142:0/3717908307 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5555e0e73770 0x5555e0e73b70 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f98e0016cd0 tx=0x7f98e0020460 comp rx=0 tx=0).stop 2024-09-22T08:36:46.277 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.270+0000 7f98ecf2f800 1 -- 172.21.15.142:0/3717908307 shutdown_connections 2024-09-22T08:36:46.277 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.270+0000 7f98ecf2f800 1 --2- 172.21.15.142:0/3717908307 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5555e0e73770 0x5555e0e73b70 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:46.277 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.270+0000 7f98ecf2f800 1 -- 172.21.15.142:0/3717908307 >> 172.21.15.142:0/3717908307 conn(0x5555e0e6fb70 msgr2=0x5555e0e6ddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:46.277 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.270+0000 7f98ecf2f800 1 -- 172.21.15.142:0/3717908307 shutdown_connections 2024-09-22T08:36:46.277 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.270+0000 7f98ecf2f800 1 -- 172.21.15.142:0/3717908307 wait complete. 2024-09-22T08:36:46.277 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.270+0000 7f98ecf2f800 1 Processor -- start 2024-09-22T08:36:46.277 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.270+0000 7f98ecf2f800 1 -- start start 2024-09-22T08:36:46.277 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.270+0000 7f98ecf2f800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5555e0e73770 0x5555e0e7ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:46.277 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.270+0000 7f98ecf2f800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5555e0e74780 con 0x5555e0e73770 2024-09-22T08:36:46.278 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.270+0000 7f98e9477640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5555e0e73770 0x5555e0e7ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:46.278 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.270+0000 7f98e9477640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5555e0e73770 0x5555e0e7ace0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:39342/0 (socket says 172.21.15.142:39342) 2024-09-22T08:36:46.278 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.270+0000 7f98e9477640 1 -- 172.21.15.142:0/2024592751 learned_addr learned my addr 172.21.15.142:0/2024592751 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:46.278 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.271+0000 7f98e9477640 1 -- 172.21.15.142:0/2024592751 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5555e0e7b240 con 0x5555e0e73770 2024-09-22T08:36:46.278 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.271+0000 7f98e9477640 1 --2- 172.21.15.142:0/2024592751 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5555e0e73770 0x5555e0e7ace0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f98e0020560 tx=0x7f98e0054790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:46.278 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.271+0000 7f97be7fc640 1 -- 172.21.15.142:0/2024592751 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98e001f340 con 0x5555e0e73770 2024-09-22T08:36:46.278 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.271+0000 7f97be7fc640 1 -- 172.21.15.142:0/2024592751 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98e00459d0 con 0x5555e0e73770 2024-09-22T08:36:46.278 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.271+0000 7f98ecf2f800 1 -- 172.21.15.142:0/2024592751 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5555e0e7b4d0 con 0x5555e0e73770 2024-09-22T08:36:46.278 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.271+0000 7f97be7fc640 1 -- 172.21.15.142:0/2024592751 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98e001f4e0 con 0x5555e0e73770 2024-09-22T08:36:46.278 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.271+0000 7f98ecf2f800 1 -- 172.21.15.142:0/2024592751 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5555e0e7b4d0 con 0x5555e0e73770 2024-09-22T08:36:46.278 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.272+0000 7f97be7fc640 1 -- 172.21.15.142:0/2024592751 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f98e0045cd0 con 0x5555e0e73770 2024-09-22T08:36:46.291 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.272+0000 7f97be7fc640 1 --2- 172.21.15.142:0/2024592751 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f97b403d000 0x7f97b403f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:46.291 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.272+0000 7f97be7fc640 1 -- 172.21.15.142:0/2024592751 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f98e0034af0 con 0x5555e0e73770 2024-09-22T08:36:46.291 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.272+0000 7f98e8c76640 1 --2- 172.21.15.142:0/2024592751 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f97b403d000 0x7f97b403f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:46.291 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.273+0000 7f98ecf2f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:46.291 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.273+0000 7f98e8c76640 1 --2- 172.21.15.142:0/2024592751 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f97b403d000 0x7f97b403f4c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f98d8097430 tx=0x7f98d8089000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:46.292 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.273+0000 7f98ecf2f800 1 --2- 172.21.15.142:0/2024592751 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5555e0e863d0 0x5555e0e88890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:46.292 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.273+0000 7f98ecf2f800 1 -- 172.21.15.142:0/2024592751 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5555e0e88fe0 con 0x5555e0e863d0 2024-09-22T08:36:46.292 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.273+0000 7f98e8475640 1 --2- 172.21.15.142:0/2024592751 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5555e0e863d0 0x5555e0e88890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:46.292 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.273+0000 7f98e8475640 1 --2- 172.21.15.142:0/2024592751 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5555e0e863d0 0x5555e0e88890 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:46.292 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.273+0000 7f98e8475640 1 -- 172.21.15.142:0/2024592751 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f98dc009050 con 0x5555e0e863d0 2024-09-22T08:36:46.292 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.273+0000 7f98ecf2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:46.292 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.273+0000 7f98ecf2f800 20 realm 2024-09-22T08:36:46.292 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.273+0000 7f98ecf2f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:46.292 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.273+0000 7f98ecf2f800 1 -- 172.21.15.142:0/2024592751 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5555e0e85720 con 0x5555e0e863d0 2024-09-22T08:36:46.292 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.274+0000 7f98e8475640 1 -- 172.21.15.142:0/2024592751 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f98dc009050 con 0x5555e0e863d0 2024-09-22T08:36:46.292 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.274+0000 7f98ecf2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:46.292 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.274+0000 7f98ecf2f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:36:46.292 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.274+0000 7f98ecf2f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:46.293 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.274+0000 7f98ecf2f800 1 -- 172.21.15.142:0/2024592751 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5555e0e89ac0 con 0x5555e0e863d0 2024-09-22T08:36:46.293 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.274+0000 7f98e8475640 1 -- 172.21.15.142:0/2024592751 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f98dc009050 con 0x5555e0e863d0 2024-09-22T08:36:46.293 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.274+0000 7f98ecf2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:46.293 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.274+0000 7f98ecf2f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:46.293 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.274+0000 7f98ecf2f800 1 -- 172.21.15.142:0/2024592751 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5555e0e8a390 con 0x5555e0e863d0 2024-09-22T08:36:46.293 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.274+0000 7f98e8475640 1 -- 172.21.15.142:0/2024592751 <== osd.1 v2:172.21.15.142:6816/3192108003 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f98dc009050 con 0x5555e0e863d0 2024-09-22T08:36:46.293 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.274+0000 7f98ecf2f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:36:46.293 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.274+0000 7f98ecf2f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:46.293 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.274+0000 7f98ecf2f800 1 --2- 172.21.15.142:0/2024592751 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5555e0e8acd0 0x5555e0e8d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:46.293 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.274+0000 7f98ecf2f800 1 -- 172.21.15.142:0/2024592751 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5555e0e8d800 con 0x5555e0e8acd0 2024-09-22T08:36:46.293 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.274+0000 7f98e9477640 1 --2- 172.21.15.142:0/2024592751 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5555e0e8acd0 0x5555e0e8d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:46.293 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.274+0000 7f98e9477640 1 --2- 172.21.15.142:0/2024592751 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5555e0e8acd0 0x5555e0e8d0c0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:46.293 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.275+0000 7f98e9477640 1 -- 172.21.15.142:0/2024592751 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(5 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f98e0053020 con 0x5555e0e8acd0 2024-09-22T08:36:46.293 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.275+0000 7f98ecf2f800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:36:46.294 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.275+0000 7f98ecf2f800 20 searching for the correct realm 2024-09-22T08:36:46.294 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.275+0000 7f98ecf2f800 1 -- 172.21.15.142:0/2024592751 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5555e0e8f1b0 con 0x5555e0e8acd0 2024-09-22T08:36:46.294 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.275+0000 7f98e9477640 1 -- 172.21.15.142:0/2024592751 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98e0053020 con 0x5555e0e8acd0 2024-09-22T08:36:46.294 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.275+0000 7f98e9477640 1 --2- 172.21.15.142:0/2024592751 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f98e0045130 0x7f98e003d000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:46.294 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.275+0000 7f98e9477640 1 -- 172.21.15.142:0/2024592751 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5555e0e8f1b0 con 0x7f98e0045130 2024-09-22T08:36:46.294 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.275+0000 7f98e8c76640 1 --2- 172.21.15.142:0/2024592751 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f98e0045130 0x7f98e003d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:46.294 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.275+0000 7f98e8c76640 1 --2- 172.21.15.142:0/2024592751 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f98e0045130 0x7f98e003d000 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:46.294 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.276+0000 7f98e8c76640 1 -- 172.21.15.142:0/2024592751 <== osd.2 v2:172.21.15.142:6808/279438927 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98d8051070 con 0x7f98e0045130 2024-09-22T08:36:46.294 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.276+0000 7f98e8c76640 1 --2- 172.21.15.142:0/2024592751 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f98d80a5040 0x7f98d8074480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:46.294 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.276+0000 7f98e8c76640 1 -- 172.21.15.142:0/2024592751 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5555e0e8f1b0 con 0x7f98d80a5040 2024-09-22T08:36:46.294 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.276+0000 7f98e8475640 1 --2- 172.21.15.142:0/2024592751 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f98d80a5040 0x7f98d8074480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:46.294 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.276+0000 7f98e8475640 1 --2- 172.21.15.142:0/2024592751 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f98d80a5040 0x7f98d8074480 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:46.295 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.276+0000 7f98e8475640 1 -- 172.21.15.142:0/2024592751 <== osd.0 v2:172.21.15.31:6800/168281188 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98dc009050 con 0x7f98d80a5040 2024-09-22T08:36:46.295 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.276+0000 7f98e8475640 1 -- 172.21.15.142:0/2024592751 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5555e0e8f1b0 con 0x5555e0e863d0 2024-09-22T08:36:46.295 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.277+0000 7f98e8475640 1 -- 172.21.15.142:0/2024592751 <== osd.1 v2:172.21.15.142:6816/3192108003 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98dc009050 con 0x5555e0e863d0 2024-09-22T08:36:46.295 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.277+0000 7f98e8475640 1 -- 172.21.15.142:0/2024592751 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5555e0e8f1b0 con 0x5555e0e863d0 2024-09-22T08:36:46.295 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.277+0000 7f98e8475640 1 -- 172.21.15.142:0/2024592751 <== osd.1 v2:172.21.15.142:6816/3192108003 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98dc029040 con 0x5555e0e863d0 2024-09-22T08:36:46.295 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.277+0000 7f98e8475640 1 -- 172.21.15.142:0/2024592751 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5555e0e8f1b0 con 0x7f98d80a5040 2024-09-22T08:36:46.295 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.277+0000 7f98e8475640 1 -- 172.21.15.142:0/2024592751 <== osd.0 v2:172.21.15.31:6800/168281188 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98dc029040 con 0x7f98d80a5040 2024-09-22T08:36:46.295 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.277+0000 7f98e8475640 1 -- 172.21.15.142:0/2024592751 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5555e0e8f1b0 con 0x7f98d80a5040 2024-09-22T08:36:46.295 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.277+0000 7f98e8475640 1 -- 172.21.15.142:0/2024592751 <== osd.0 v2:172.21.15.31:6800/168281188 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98dc029040 con 0x7f98d80a5040 2024-09-22T08:36:46.295 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.277+0000 7f98e8475640 1 -- 172.21.15.142:0/2024592751 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5555e0e8f1b0 con 0x7f98e0045130 2024-09-22T08:36:46.295 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.278+0000 7f98e8c76640 1 -- 172.21.15.142:0/2024592751 <== osd.2 v2:172.21.15.142:6808/279438927 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98d8051070 con 0x7f98e0045130 2024-09-22T08:36:46.295 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.278+0000 7f98e8c76640 1 -- 172.21.15.142:0/2024592751 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5555e0e8f1b0 con 0x5555e0e8acd0 2024-09-22T08:36:46.296 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.278+0000 7f98e9477640 1 -- 172.21.15.142:0/2024592751 <== osd.3 v2:172.21.15.142:6800/1064901393 3 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98e0053020 con 0x5555e0e8acd0 2024-09-22T08:36:46.296 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.278+0000 7f98e9477640 1 -- 172.21.15.142:0/2024592751 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5555e0e8f1b0 con 0x5555e0e863d0 2024-09-22T08:36:46.296 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.278+0000 7f98e8475640 1 -- 172.21.15.142:0/2024592751 <== osd.1 v2:172.21.15.142:6816/3192108003 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98dc029040 con 0x5555e0e863d0 2024-09-22T08:36:46.296 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.278+0000 7f98e8475640 1 -- 172.21.15.142:0/2024592751 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5555e0e8f1b0 con 0x7f98d80a5040 2024-09-22T08:36:46.296 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.278+0000 7f98e8475640 1 -- 172.21.15.142:0/2024592751 <== osd.0 v2:172.21.15.31:6800/168281188 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98dc029040 con 0x7f98d80a5040 2024-09-22T08:36:46.296 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.278+0000 7f98e8475640 1 -- 172.21.15.142:0/2024592751 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5555e0e8f1b0 con 0x5555e0e863d0 2024-09-22T08:36:46.296 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.279+0000 7f98e8475640 1 -- 172.21.15.142:0/2024592751 <== osd.1 v2:172.21.15.142:6816/3192108003 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98dc029040 con 0x5555e0e863d0 2024-09-22T08:36:46.296 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.279+0000 7f98e8475640 1 -- 172.21.15.142:0/2024592751 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5555e0e8f1b0 con 0x7f98e0045130 2024-09-22T08:36:46.296 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.279+0000 7f98e8c76640 1 -- 172.21.15.142:0/2024592751 <== osd.2 v2:172.21.15.142:6808/279438927 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f98d8051070 con 0x7f98e0045130 2024-09-22T08:36:46.296 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.279+0000 7f98e8c76640 1 -- 172.21.15.142:0/2024592751 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5555e0e8f1b0 con 0x5555e0e8acd0 2024-09-22T08:36:46.296 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.279+0000 7f98e9477640 1 -- 172.21.15.142:0/2024592751 <== osd.3 v2:172.21.15.142:6800/1064901393 4 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98e0053020 con 0x5555e0e8acd0 2024-09-22T08:36:46.296 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.279+0000 7f98e9477640 1 -- 172.21.15.142:0/2024592751 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5555e0e8f1b0 con 0x5555e0e8acd0 2024-09-22T08:36:46.296 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.279+0000 7f98e9477640 1 -- 172.21.15.142:0/2024592751 <== osd.3 v2:172.21.15.142:6800/1064901393 5 ==== osd_op_reply(20 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f98e0053020 con 0x5555e0e8acd0 2024-09-22T08:36:46.297 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.279+0000 7f98e9477640 1 -- 172.21.15.142:0/2024592751 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5555e0e8f1b0 con 0x7f98d80a5040 2024-09-22T08:36:46.297 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.280+0000 7f98e8475640 1 -- 172.21.15.142:0/2024592751 <== osd.0 v2:172.21.15.31:6800/168281188 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98dc029040 con 0x7f98d80a5040 2024-09-22T08:36:46.297 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.280+0000 7f98e8475640 1 -- 172.21.15.142:0/2024592751 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5555e0e8f1b0 con 0x5555e0e8acd0 2024-09-22T08:36:46.297 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.280+0000 7f98e9477640 1 -- 172.21.15.142:0/2024592751 <== osd.3 v2:172.21.15.142:6800/1064901393 6 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98e0053020 con 0x5555e0e8acd0 2024-09-22T08:36:46.297 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.280+0000 7f98e9477640 1 -- 172.21.15.142:0/2024592751 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5555e0e8f1b0 con 0x5555e0e8acd0 2024-09-22T08:36:46.297 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.280+0000 7f98e9477640 1 -- 172.21.15.142:0/2024592751 <== osd.3 v2:172.21.15.142:6800/1064901393 7 ==== osd_op_reply(23 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f98e0053020 con 0x5555e0e8acd0 2024-09-22T08:36:46.297 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.280+0000 7f98e9477640 1 -- 172.21.15.142:0/2024592751 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5555e0e8f1b0 con 0x5555e0e863d0 2024-09-22T08:36:46.297 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.280+0000 7f98e8475640 1 -- 172.21.15.142:0/2024592751 <== osd.1 v2:172.21.15.142:6816/3192108003 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98dc029040 con 0x5555e0e863d0 2024-09-22T08:36:46.297 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.280+0000 7f98e8475640 1 -- 172.21.15.142:0/2024592751 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5555e0e8f1b0 con 0x5555e0e863d0 2024-09-22T08:36:46.297 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.280+0000 7f98e8475640 1 -- 172.21.15.142:0/2024592751 <== osd.1 v2:172.21.15.142:6816/3192108003 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f98dc029040 con 0x5555e0e863d0 2024-09-22T08:36:46.297 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.280+0000 7f98e8475640 1 -- 172.21.15.142:0/2024592751 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5555e0e8f1b0 con 0x7f98d80a5040 2024-09-22T08:36:46.297 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.281+0000 7f98e8475640 1 -- 172.21.15.142:0/2024592751 <== osd.0 v2:172.21.15.31:6800/168281188 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98dc029040 con 0x7f98d80a5040 2024-09-22T08:36:46.297 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.281+0000 7f98e8475640 1 -- 172.21.15.142:0/2024592751 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5555e0e8f1b0 con 0x5555e0e8acd0 2024-09-22T08:36:46.298 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.281+0000 7f98e9477640 1 -- 172.21.15.142:0/2024592751 <== osd.3 v2:172.21.15.142:6800/1064901393 8 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98e0053020 con 0x5555e0e8acd0 2024-09-22T08:36:46.298 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.281+0000 7f98e9477640 1 -- 172.21.15.142:0/2024592751 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5555e0e8f1b0 con 0x7f98e0045130 2024-09-22T08:36:46.298 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.281+0000 7f98e8c76640 1 -- 172.21.15.142:0/2024592751 <== osd.2 v2:172.21.15.142:6808/279438927 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98d8051070 con 0x7f98e0045130 2024-09-22T08:36:46.298 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.281+0000 7f98e8c76640 1 -- 172.21.15.142:0/2024592751 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5555e0e8f1b0 con 0x5555e0e863d0 2024-09-22T08:36:46.298 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.281+0000 7f98e8475640 1 -- 172.21.15.142:0/2024592751 <== osd.1 v2:172.21.15.142:6816/3192108003 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98dc029040 con 0x5555e0e863d0 2024-09-22T08:36:46.298 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.281+0000 7f98e8475640 1 -- 172.21.15.142:0/2024592751 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5555e0e8f1b0 con 0x7f98d80a5040 2024-09-22T08:36:46.298 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.282+0000 7f98e8475640 1 -- 172.21.15.142:0/2024592751 <== osd.0 v2:172.21.15.31:6800/168281188 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98dc029040 con 0x7f98d80a5040 2024-09-22T08:36:46.298 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.282+0000 7f98e8475640 1 -- 172.21.15.142:0/2024592751 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5555e0e8f1b0 con 0x5555e0e8acd0 2024-09-22T08:36:46.298 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.282+0000 7f98e9477640 1 -- 172.21.15.142:0/2024592751 <== osd.3 v2:172.21.15.142:6800/1064901393 9 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98e0053020 con 0x5555e0e8acd0 2024-09-22T08:36:46.298 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.282+0000 7f98e9477640 1 -- 172.21.15.142:0/2024592751 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5555e0e8f1b0 con 0x7f98d80a5040 2024-09-22T08:36:46.298 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.282+0000 7f98e8475640 1 -- 172.21.15.142:0/2024592751 <== osd.0 v2:172.21.15.31:6800/168281188 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98dc029040 con 0x7f98d80a5040 2024-09-22T08:36:46.298 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.282+0000 7f98e8475640 1 -- 172.21.15.142:0/2024592751 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5555e0e8f1b0 con 0x7f98e0045130 2024-09-22T08:36:46.298 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.282+0000 7f98e8c76640 1 -- 172.21.15.142:0/2024592751 <== osd.2 v2:172.21.15.142:6808/279438927 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98d8051070 con 0x7f98e0045130 2024-09-22T08:36:46.299 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.282+0000 7f98e8c76640 1 -- 172.21.15.142:0/2024592751 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5555e0e8f1b0 con 0x5555e0e8acd0 2024-09-22T08:36:46.299 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.283+0000 7f98e9477640 1 -- 172.21.15.142:0/2024592751 <== osd.3 v2:172.21.15.142:6800/1064901393 10 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98e0053020 con 0x5555e0e8acd0 2024-09-22T08:36:46.299 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.283+0000 7f98e9477640 1 -- 172.21.15.142:0/2024592751 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5555e0e8f1b0 con 0x7f98d80a5040 2024-09-22T08:36:46.299 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.283+0000 7f98e8475640 1 -- 172.21.15.142:0/2024592751 <== osd.0 v2:172.21.15.31:6800/168281188 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98dc029040 con 0x7f98d80a5040 2024-09-22T08:36:46.299 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.283+0000 7f98e8475640 1 -- 172.21.15.142:0/2024592751 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5555e0e8f1b0 con 0x5555e0e863d0 2024-09-22T08:36:46.299 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.283+0000 7f98e8475640 1 -- 172.21.15.142:0/2024592751 <== osd.1 v2:172.21.15.142:6816/3192108003 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f98dc029040 con 0x5555e0e863d0 2024-09-22T08:36:46.299 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.283+0000 7f98e8475640 1 -- 172.21.15.142:0/2024592751 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5555e0e8f1b0 con 0x7f98e0045130 2024-09-22T08:36:46.299 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.283+0000 7f98e8c76640 1 -- 172.21.15.142:0/2024592751 <== osd.2 v2:172.21.15.142:6808/279438927 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98d8051070 con 0x7f98e0045130 2024-09-22T08:36:46.299 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.283+0000 7f98ecf2f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:36:46.299 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.283+0000 7f98ecf2f800 20 RGWRados::pool_iterate: got zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec 2024-09-22T08:36:46.299 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.283+0000 7f98ecf2f800 20 RGWRados::pool_iterate: got zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f 2024-09-22T08:36:46.299 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.283+0000 7f98ecf2f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:36:46.300 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.283+0000 7f98ecf2f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:36:46.300 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.283+0000 7f98ecf2f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:36:46.300 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.283+0000 7f98ecf2f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:46.300 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.283+0000 7f98ecf2f800 1 -- 172.21.15.142:0/2024592751 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5555e0e8e280 con 0x5555e0e863d0 2024-09-22T08:36:46.300 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.284+0000 7f98e8475640 1 -- 172.21.15.142:0/2024592751 <== osd.1 v2:172.21.15.142:6816/3192108003 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f98dc029040 con 0x5555e0e863d0 2024-09-22T08:36:46.300 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.284+0000 7f98ecf2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:46.300 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.284+0000 7f98ecf2f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:46.300 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.284+0000 7f98ecf2f800 1 -- 172.21.15.142:0/2024592751 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5555e0e8dec0 con 0x5555e0e863d0 2024-09-22T08:36:46.300 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.284+0000 7f98e8475640 1 -- 172.21.15.142:0/2024592751 <== osd.1 v2:172.21.15.142:6816/3192108003 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f98dc029040 con 0x5555e0e863d0 2024-09-22T08:36:46.300 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.284+0000 7f98ecf2f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:36:46.300 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.284+0000 7f98ecf2f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:46.300 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.284+0000 7f98ecf2f800 1 -- 172.21.15.142:0/2024592751 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:40 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5555e0e8ebe0 con 0x5555e0e8acd0 2024-09-22T08:36:46.300 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.284+0000 7f98e9477640 1 -- 172.21.15.142:0/2024592751 <== osd.3 v2:172.21.15.142:6800/1064901393 11 ==== osd_op_reply(40 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f98e0053020 con 0x5555e0e8acd0 2024-09-22T08:36:46.300 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.284+0000 7f98ecf2f800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:36:46.301 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.284+0000 7f98ecf2f800 20 zone default found 2024-09-22T08:36:46.301 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.284+0000 7f98ecf2f800 4 Realm: () 2024-09-22T08:36:46.301 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.284+0000 7f98ecf2f800 4 ZoneGroup: default (d89f6f57-1007-47dd-9065-f486c7b01aec) 2024-09-22T08:36:46.301 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.284+0000 7f98ecf2f800 4 Zone: default (e239248c-0bee-4e41-803a-24b288d3eb8f) 2024-09-22T08:36:46.301 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.284+0000 7f98ecf2f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:36:46.301 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.284+0000 7f98ecf2f800 20 zonegroup default 2024-09-22T08:36:46.301 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.284+0000 7f98ecf2f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:46.301 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.284+0000 7f98ecf2f800 1 -- 172.21.15.142:0/2024592751 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5555e0e8e750 con 0x7f98d80a5040 2024-09-22T08:36:46.301 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.284+0000 7f98e8475640 1 -- 172.21.15.142:0/2024592751 <== osd.0 v2:172.21.15.31:6800/168281188 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f98dc029040 con 0x7f98d80a5040 2024-09-22T08:36:46.301 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.284+0000 7f98ecf2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:46.301 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.285+0000 7f98ecf2f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:46.301 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.285+0000 7f98ecf2f800 1 -- 172.21.15.142:0/2024592751 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5555e0e91a20 con 0x5555e0e8acd0 2024-09-22T08:36:46.301 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.285+0000 7f98e9477640 1 -- 172.21.15.142:0/2024592751 <== osd.3 v2:172.21.15.142:6800/1064901393 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f98e0053020 con 0x5555e0e8acd0 2024-09-22T08:36:46.302 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.285+0000 7f98ecf2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:46.302 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.285+0000 7f98ecf2f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:46.302 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.285+0000 7f98ecf2f800 1 -- 172.21.15.142:0/2024592751 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5555e0e91dc0 con 0x5555e0e8acd0 2024-09-22T08:36:46.302 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.285+0000 7f98e9477640 1 -- 172.21.15.142:0/2024592751 <== osd.3 v2:172.21.15.142:6800/1064901393 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f98e0053020 con 0x5555e0e8acd0 2024-09-22T08:36:46.302 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.285+0000 7f98ecf2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:46.302 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.285+0000 7f98ecf2f800 20 started sync module instance, tier type = 2024-09-22T08:36:46.302 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.285+0000 7f98ecf2f800 20 started zone id=e239248c-0bee-4e41-803a-24b288d3eb8f (name=default) with tier type = 2024-09-22T08:36:46.302 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.285+0000 7f98ecf2f800 1 -- 172.21.15.142:0/2024592751 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5555e0e90eb0 con 0x7f98e0045130 2024-09-22T08:36:46.302 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.286+0000 7f98e8c76640 1 -- 172.21.15.142:0/2024592751 <== osd.2 v2:172.21.15.142:6808/279438927 7 ==== osd_op_reply(44 notify.0 [create] v30'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98d8051070 con 0x7f98e0045130 2024-09-22T08:36:46.302 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.286+0000 7f98ecf2f800 1 -- 172.21.15.142:0/2024592751 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93827333952208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5555e0e926a0 con 0x7f98e0045130 2024-09-22T08:36:46.302 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.286+0000 7f98ecf2f800 1 -- 172.21.15.142:0/2024592751 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5555e0e92ef0 con 0x5555e0e863d0 2024-09-22T08:36:46.302 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.287+0000 7f98e8c76640 1 -- 172.21.15.142:0/2024592751 <== osd.2 v2:172.21.15.142:6808/279438927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93827333952208] v30'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98d8051070 con 0x7f98e0045130 2024-09-22T08:36:46.303 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.287+0000 7f98e8475640 1 -- 172.21.15.142:0/2024592751 <== osd.1 v2:172.21.15.142:6816/3192108003 15 ==== osd_op_reply(46 notify.1 [create] v30'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98dc029040 con 0x5555e0e863d0 2024-09-22T08:36:46.303 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.287+0000 7f98ecf2f800 1 -- 172.21.15.142:0/2024592751 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93827333958208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5555e0e93310 con 0x5555e0e863d0 2024-09-22T08:36:46.303 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.287+0000 7f98ecf2f800 1 -- 172.21.15.142:0/2024592751 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5555e0e93b60 con 0x5555e0e8acd0 2024-09-22T08:36:46.303 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.288+0000 7f98e8475640 1 -- 172.21.15.142:0/2024592751 <== osd.1 v2:172.21.15.142:6816/3192108003 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93827333958208] v30'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98dc029040 con 0x5555e0e863d0 2024-09-22T08:36:46.303 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.288+0000 7f98e9477640 1 -- 172.21.15.142:0/2024592751 <== osd.3 v2:172.21.15.142:6800/1064901393 14 ==== osd_op_reply(48 notify.2 [create] v30'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98e0053020 con 0x5555e0e8acd0 2024-09-22T08:36:46.303 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.288+0000 7f98ecf2f800 1 -- 172.21.15.142:0/2024592751 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93827333959744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5555e0e93a30 con 0x5555e0e8acd0 2024-09-22T08:36:46.303 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.288+0000 7f98ecf2f800 1 -- 172.21.15.142:0/2024592751 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5555e0e945b0 con 0x7f98e0045130 2024-09-22T08:36:46.303 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.289+0000 7f98e9477640 1 -- 172.21.15.142:0/2024592751 <== osd.3 v2:172.21.15.142:6800/1064901393 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 93827333959744] v30'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98e0053020 con 0x5555e0e8acd0 2024-09-22T08:36:46.303 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.289+0000 7f98e8c76640 1 -- 172.21.15.142:0/2024592751 <== osd.2 v2:172.21.15.142:6808/279438927 9 ==== osd_op_reply(50 notify.3 [create] v30'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98d8051070 con 0x7f98e0045130 2024-09-22T08:36:46.304 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.289+0000 7f98ecf2f800 1 -- 172.21.15.142:0/2024592751 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93827333960864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5555e0e94570 con 0x7f98e0045130 2024-09-22T08:36:46.304 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.289+0000 7f98ecf2f800 1 -- 172.21.15.142:0/2024592751 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5555e0e95010 con 0x5555e0e863d0 2024-09-22T08:36:46.317 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.291+0000 7f98e8475640 1 -- 172.21.15.142:0/2024592751 <== osd.1 v2:172.21.15.142:6816/3192108003 17 ==== osd_op_reply(52 notify.4 [create] v30'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98dc029040 con 0x5555e0e863d0 2024-09-22T08:36:46.318 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.291+0000 7f98ecf2f800 1 -- 172.21.15.142:0/2024592751 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93827333966656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5555e0e95010 con 0x5555e0e863d0 2024-09-22T08:36:46.318 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.291+0000 7f98ecf2f800 1 -- 172.21.15.142:0/2024592751 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5555e0e95fd0 con 0x7f98d80a5040 2024-09-22T08:36:46.318 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.291+0000 7f98e8c76640 1 -- 172.21.15.142:0/2024592751 <== osd.2 v2:172.21.15.142:6808/279438927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93827333960864] v30'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98d8051070 con 0x7f98e0045130 2024-09-22T08:36:46.318 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.292+0000 7f98e8475640 1 -- 172.21.15.142:0/2024592751 <== osd.0 v2:172.21.15.31:6800/168281188 11 ==== osd_op_reply(54 notify.5 [create] v30'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98dc029040 con 0x7f98d80a5040 2024-09-22T08:36:46.318 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.292+0000 7f98ecf2f800 1 -- 172.21.15.142:0/2024592751 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93827333970592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5555e0e95f90 con 0x7f98d80a5040 2024-09-22T08:36:46.318 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.292+0000 7f98ecf2f800 1 -- 172.21.15.142:0/2024592751 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5555e0e969e0 con 0x7f98d80a5040 2024-09-22T08:36:46.319 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.292+0000 7f98e8475640 1 -- 172.21.15.142:0/2024592751 <== osd.1 v2:172.21.15.142:6816/3192108003 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93827333966656] v30'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98dc029040 con 0x5555e0e863d0 2024-09-22T08:36:46.319 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.293+0000 7f98e8475640 1 -- 172.21.15.142:0/2024592751 <== osd.0 v2:172.21.15.31:6800/168281188 12 ==== osd_op_reply(56 notify.6 [create] v30'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98dc029040 con 0x7f98d80a5040 2024-09-22T08:36:46.319 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.293+0000 7f98ecf2f800 1 -- 172.21.15.142:0/2024592751 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93827333968896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5555e0e969e0 con 0x7f98d80a5040 2024-09-22T08:36:46.319 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.293+0000 7f98ecf2f800 1 -- 172.21.15.142:0/2024592751 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5555e0e973f0 con 0x7f98d80a5040 2024-09-22T08:36:46.319 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.293+0000 7f98e8475640 1 -- 172.21.15.142:0/2024592751 <== osd.0 v2:172.21.15.31:6800/168281188 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93827333970592] v30'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98dc029040 con 0x7f98d80a5040 2024-09-22T08:36:46.319 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.294+0000 7f98e8475640 1 -- 172.21.15.142:0/2024592751 <== osd.0 v2:172.21.15.31:6800/168281188 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93827333968896] v30'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98dc029040 con 0x7f98d80a5040 2024-09-22T08:36:46.320 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.294+0000 7f98e8475640 1 -- 172.21.15.142:0/2024592751 <== osd.0 v2:172.21.15.31:6800/168281188 15 ==== osd_op_reply(58 notify.7 [create] v30'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98dc029040 con 0x7f98d80a5040 2024-09-22T08:36:46.320 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.294+0000 7f98ecf2f800 1 -- 172.21.15.142:0/2024592751 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93827333973296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5555e0e96950 con 0x7f98d80a5040 2024-09-22T08:36:46.320 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.294+0000 7f98ecf2f800 20 add_watcher() i=0 2024-09-22T08:36:46.320 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.294+0000 7f98ecf2f800 20 add_watcher() i=1 2024-09-22T08:36:46.320 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.294+0000 7f98ecf2f800 20 add_watcher() i=2 2024-09-22T08:36:46.320 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.294+0000 7f98ecf2f800 20 add_watcher() i=3 2024-09-22T08:36:46.320 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.294+0000 7f98ecf2f800 20 add_watcher() i=4 2024-09-22T08:36:46.320 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.294+0000 7f98ecf2f800 20 add_watcher() i=5 2024-09-22T08:36:46.320 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.294+0000 7f98ecf2f800 20 add_watcher() i=6 2024-09-22T08:36:46.321 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.295+0000 7f98e8475640 1 -- 172.21.15.142:0/2024592751 <== osd.0 v2:172.21.15.31:6800/168281188 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93827333973296] v30'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98dc029040 con 0x7f98d80a5040 2024-09-22T08:36:46.321 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.295+0000 7f98ecf2f800 20 add_watcher() i=7 2024-09-22T08:36:46.321 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.295+0000 7f98ecf2f800 2 all 8 watchers are set, enabling cache 2024-09-22T08:36:46.321 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.295+0000 7f98ecf2f800 1 -- 172.21.15.142:0/2024592751 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5555e0e9a420 con 0x5555e0e863d0 2024-09-22T08:36:46.321 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.295+0000 7f98e8475640 1 -- 172.21.15.142:0/2024592751 <== osd.1 v2:172.21.15.142:6816/3192108003 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f98dc029040 con 0x5555e0e863d0 2024-09-22T08:36:46.321 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.295+0000 7f98ecf2f800 1 -- 172.21.15.142:0/2024592751 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93827333975872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5555e0e97920 con 0x5555e0e863d0 2024-09-22T08:36:46.322 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.296+0000 7f98e8475640 1 -- 172.21.15.142:0/2024592751 <== osd.1 v2:172.21.15.142:6816/3192108003 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93827333975872] v30'102 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f98dc029040 con 0x5555e0e863d0 2024-09-22T08:36:46.322 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.296+0000 7f979efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:36:46.322 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.296+0000 7f98ecf2f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:36:46.322 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.296+0000 7f98ecf2f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:36:46.322 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.296+0000 7f98ecf2f800 5 note: GC not initialized 2024-09-22T08:36:46.322 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.296+0000 7f979dfe3640 20 reqs_thread_entry: start 2024-09-22T08:36:46.322 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.296+0000 7f98ecf2f800 20 init_complete bucket index max shards: 11 2024-09-22T08:36:46.323 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.296+0000 7f98ecf2f800 20 Filter name: none 2024-09-22T08:36:46.323 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.297+0000 7f970f7fe640 20 reqs_thread_entry: start 2024-09-22T08:36:46.323 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.297+0000 7f98ecf2f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:46.323 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.297+0000 7f98ecf2f800 1 -- 172.21.15.142:0/2024592751 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5555e0ecd2b0 con 0x5555e0e863d0 2024-09-22T08:36:46.323 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.297+0000 7f98e8475640 1 -- 172.21.15.142:0/2024592751 <== osd.1 v2:172.21.15.142:6816/3192108003 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f98dc029040 con 0x5555e0e863d0 2024-09-22T08:36:46.323 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.297+0000 7f98ecf2f800 20 rados_obj.operate() r=0 bl.length=391 2024-09-22T08:36:46.323 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.297+0000 7f98ecf2f800 1 -- 172.21.15.142:0/2024592751 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5555e0ece830 con 0x7f98e0045130 2024-09-22T08:36:46.324 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.297+0000 7f98e8c76640 1 -- 172.21.15.142:0/2024592751 <== osd.2 v2:172.21.15.142:6808/279438927 11 ==== osd_op_reply(63 foo.buckets [call out=183b] v0'0 uv14 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f98d8051070 con 0x7f98e0045130 2024-09-22T08:36:46.324 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.297+0000 7f98ecf2f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:46.324 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.297+0000 7f98ecf2f800 1 -- 172.21.15.142:0/2024592751 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:64 8.15 8:ab67ca09:root::.bucket.meta.myfoo%3ae239248c-0bee-4e41-803a-24b288d3eb8f.4226.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5555e0ece7c0 con 0x5555e0e8acd0 2024-09-22T08:36:46.324 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.298+0000 7f98e9477640 1 -- 172.21.15.142:0/2024592751 <== osd.3 v2:172.21.15.142:6800/1064901393 16 ==== osd_op_reply(64 .bucket.meta.myfoo:e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7f98e0053020 con 0x5555e0e8acd0 2024-09-22T08:36:46.324 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.298+0000 7f98ecf2f800 20 rados_obj.operate() r=0 bl.length=387 2024-09-22T08:36:46.324 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.298+0000 7f98ecf2f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:36:46.324 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.298+0000 7f98ecf2f800 1 -- 172.21.15.142:0/2024592751 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:65 4.12 4:48caaf34:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5555e0ed02d0 con 0x5555e0e863d0 2024-09-22T08:36:46.324 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.298+0000 7f98ecf2f800 1 -- 172.21.15.142:0/2024592751 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:66 4.10 4:09af3fe1:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5555e0ed2ce0 con 0x5555e0e8acd0 2024-09-22T08:36:46.325 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.298+0000 7f98ecf2f800 1 -- 172.21.15.142:0/2024592751 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:67 4.12 4:49def6fa:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5555e0ed59b0 con 0x5555e0e863d0 2024-09-22T08:36:46.325 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.298+0000 7f98ecf2f800 1 -- 172.21.15.142:0/2024592751 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:68 4.2 4:4255cd8e:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5555e0ed59b0 con 0x5555e0e863d0 2024-09-22T08:36:46.325 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.298+0000 7f98ecf2f800 1 -- 172.21.15.142:0/2024592751 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:69 4.c 4:323d0659:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5555e0eda790 con 0x5555e0e863d0 2024-09-22T08:36:46.325 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.298+0000 7f98ecf2f800 1 -- 172.21.15.142:0/2024592751 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:70 4.20 4:061d9e92:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5555e0edd000 con 0x5555e0e863d0 2024-09-22T08:36:46.325 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.298+0000 7f98ecf2f800 1 -- 172.21.15.142:0/2024592751 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:71 4.3b 4:dc8435be:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5555e0edf870 con 0x5555e0e8acd0 2024-09-22T08:36:46.325 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.298+0000 7f98ecf2f800 1 -- 172.21.15.142:0/2024592751 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:72 4.22 4:44b3b4fd:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5555e0ee2140 con 0x5555e0e863d0 2024-09-22T08:36:46.326 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.298+0000 7f98ecf2f800 1 -- 172.21.15.142:0/2024592751 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:73 4.2d 4:b74eadf4:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5555e0ee4b30 con 0x7f98d80a5040 2024-09-22T08:36:46.326 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.298+0000 7f98ecf2f800 1 -- 172.21.15.142:0/2024592751 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:74 4.12 4:4be25f13:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5555e0ee77b0 con 0x5555e0e863d0 2024-09-22T08:36:46.326 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.298+0000 7f98ecf2f800 1 -- 172.21.15.142:0/2024592751 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:75 4.5 4:a0e4e0ec:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5555e0eea530 con 0x5555e0e8acd0 2024-09-22T08:36:46.326 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.298+0000 7f98e9477640 1 -- 172.21.15.142:0/2024592751 <== osd.3 v2:172.21.15.142:6800/1064901393 17 ==== osd_op_reply(66 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1.1 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f98e0053020 con 0x5555e0e8acd0 2024-09-22T08:36:46.326 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.298+0000 7f98e8475640 1 -- 172.21.15.142:0/2024592751 <== osd.1 v2:172.21.15.142:6816/3192108003 22 ==== osd_op_reply(65 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1.0 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f98dc029040 con 0x5555e0e863d0 2024-09-22T08:36:46.326 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.298+0000 7f98e8475640 1 -- 172.21.15.142:0/2024592751 <== osd.1 v2:172.21.15.142:6816/3192108003 23 ==== osd_op_reply(67 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1.2 [call out=89b] v0'0 uv2 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f98dc029040 con 0x5555e0e863d0 2024-09-22T08:36:46.327 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.298+0000 7f98e8475640 1 -- 172.21.15.142:0/2024592751 <== osd.0 v2:172.21.15.31:6800/168281188 17 ==== osd_op_reply(73 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1.8 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f98dc029040 con 0x7f98d80a5040 2024-09-22T08:36:46.327 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.298+0000 7f98e8475640 1 -- 172.21.15.142:0/2024592751 <== osd.1 v2:172.21.15.142:6816/3192108003 24 ==== osd_op_reply(68 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1.3 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f98dc029040 con 0x5555e0e863d0 2024-09-22T08:36:46.327 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.299+0000 7f98e8475640 1 -- 172.21.15.142:0/2024592751 <== osd.1 v2:172.21.15.142:6816/3192108003 25 ==== osd_op_reply(69 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1.4 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f98dc029040 con 0x5555e0e863d0 2024-09-22T08:36:46.327 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.299+0000 7f98e8475640 1 -- 172.21.15.142:0/2024592751 <== osd.1 v2:172.21.15.142:6816/3192108003 26 ==== osd_op_reply(70 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1.5 [call out=128b] v0'0 uv3 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7f98dc029040 con 0x5555e0e863d0 2024-09-22T08:36:46.327 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.299+0000 7f98e8475640 1 -- 172.21.15.142:0/2024592751 <== osd.1 v2:172.21.15.142:6816/3192108003 27 ==== osd_op_reply(72 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1.7 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f98dc029040 con 0x5555e0e863d0 2024-09-22T08:36:46.327 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.299+0000 7f98e8475640 1 -- 172.21.15.142:0/2024592751 <== osd.1 v2:172.21.15.142:6816/3192108003 28 ==== osd_op_reply(74 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1.9 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f98dc029040 con 0x5555e0e863d0 2024-09-22T08:36:46.327 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.299+0000 7f98e9477640 1 -- 172.21.15.142:0/2024592751 <== osd.3 v2:172.21.15.142:6800/1064901393 18 ==== osd_op_reply(71 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1.6 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f98e0053020 con 0x5555e0e8acd0 2024-09-22T08:36:46.328 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.299+0000 7f98e9477640 1 -- 172.21.15.142:0/2024592751 <== osd.3 v2:172.21.15.142:6800/1064901393 19 ==== osd_op_reply(75 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1.10 [call out=89b] v0'0 uv1 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f98e0053020 con 0x5555e0e8acd0 2024-09-22T08:36:46.328 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.299+0000 7f98ecf2f800 1 -- 172.21.15.142:0/2024592751 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:76 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5555e0ecc2c0 con 0x7f98e0045130 2024-09-22T08:36:46.328 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.300+0000 7f98e8c76640 1 -- 172.21.15.142:0/2024592751 <== osd.2 v2:172.21.15.142:6808/279438927 12 ==== osd_op_reply(76 foo.buckets [call] v30'15 uv15 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f98d8051070 con 0x7f98e0045130 2024-09-22T08:36:46.328 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.300+0000 7f98ecf2f800 1 -- 172.21.15.142:0/2024592751 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:77 8.9 8:96d98480:users.uid::foo.buckets:head [call user.complete_stats_sync in=37b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5555e0ecc2c0 con 0x7f98e0045130 2024-09-22T08:36:46.328 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.301+0000 7f98e8c76640 1 -- 172.21.15.142:0/2024592751 <== osd.2 v2:172.21.15.142:6808/279438927 13 ==== osd_op_reply(77 foo.buckets [call] v30'16 uv16 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f98d8051070 con 0x7f98e0045130 2024-09-22T08:36:46.328 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.301+0000 7f98ecf2f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:46.328 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.301+0000 7f98ecf2f800 1 -- 172.21.15.142:0/2024592751 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:78 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5555e0ecc2c0 con 0x5555e0e863d0 2024-09-22T08:36:46.328 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.301+0000 7f98e8475640 1 -- 172.21.15.142:0/2024592751 <== osd.1 v2:172.21.15.142:6816/3192108003 29 ==== osd_op_reply(78 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f98dc029040 con 0x5555e0e863d0 2024-09-22T08:36:46.328 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.301+0000 7f98ecf2f800 20 rados_obj.operate() r=0 bl.length=391 2024-09-22T08:36:46.328 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.301+0000 7f98ecf2f800 1 -- 172.21.15.142:0/2024592751 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:79 8.9 8:96d98480:users.uid::foo.buckets:head [call user.get_header in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5555e0ecc2c0 con 0x7f98e0045130 2024-09-22T08:36:46.328 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.301+0000 7f98e8c76640 1 -- 172.21.15.142:0/2024592751 <== osd.2 v2:172.21.15.142:6808/279438927 14 ==== osd_op_reply(79 foo.buckets [call out=58b] v0'0 uv16 ondisk = 0) ==== 155+0+58 (crc 0 0 0) 0x7f98d8051070 con 0x7f98e0045130 2024-09-22T08:36:46.328 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.302+0000 7f979efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:36:46.329 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.302+0000 7f98ecf2f800 1 -- 172.21.15.142:0/2024592751 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:80 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93827333975872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5555e0ecc2c0 con 0x5555e0e863d0 2024-09-22T08:36:46.329 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.303+0000 7f98e8475640 1 -- 172.21.15.142:0/2024592751 <== osd.1 v2:172.21.15.142:6816/3192108003 30 ==== osd_op_reply(80 data_loggenerations_metadata [watch unwatch cookie 93827333975872] v30'103 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f98dc029040 con 0x5555e0e863d0 2024-09-22T08:36:46.329 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.303+0000 7f98ecf2f800 1 -- 172.21.15.142:0/2024592751 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:81 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93827333952208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5555e0ecc2c0 con 0x7f98e0045130 2024-09-22T08:36:46.329 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.304+0000 7f98e8c76640 1 -- 172.21.15.142:0/2024592751 <== osd.2 v2:172.21.15.142:6808/279438927 15 ==== osd_op_reply(81 notify.0 [watch unwatch cookie 93827333952208] v30'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98d8051070 con 0x7f98e0045130 2024-09-22T08:36:46.329 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.304+0000 7f98ecf2f800 20 remove_watcher() i=0 2024-09-22T08:36:46.329 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.304+0000 7f98ecf2f800 2 removed watcher, disabling cache 2024-09-22T08:36:46.329 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.304+0000 7f98ecf2f800 1 -- 172.21.15.142:0/2024592751 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:82 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93827333958208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5555e0e912d0 con 0x5555e0e863d0 2024-09-22T08:36:46.329 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.305+0000 7f98e8475640 1 -- 172.21.15.142:0/2024592751 <== osd.1 v2:172.21.15.142:6816/3192108003 31 ==== osd_op_reply(82 notify.1 [watch unwatch cookie 93827333958208] v30'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98dc029040 con 0x5555e0e863d0 2024-09-22T08:36:46.329 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.305+0000 7f98ecf2f800 20 remove_watcher() i=1 2024-09-22T08:36:46.329 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.305+0000 7f98ecf2f800 1 -- 172.21.15.142:0/2024592751 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:83 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93827333959744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5555e0ecc2c0 con 0x5555e0e8acd0 2024-09-22T08:36:46.329 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.307+0000 7f98e9477640 1 -- 172.21.15.142:0/2024592751 <== osd.3 v2:172.21.15.142:6800/1064901393 20 ==== osd_op_reply(83 notify.2 [watch unwatch cookie 93827333959744] v30'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98e0053020 con 0x5555e0e8acd0 2024-09-22T08:36:46.329 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.307+0000 7f98ecf2f800 20 remove_watcher() i=2 2024-09-22T08:36:46.330 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.307+0000 7f98ecf2f800 1 -- 172.21.15.142:0/2024592751 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:84 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93827333960864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5555e0e92a40 con 0x7f98e0045130 2024-09-22T08:36:46.330 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.307+0000 7f98e8c76640 1 -- 172.21.15.142:0/2024592751 <== osd.2 v2:172.21.15.142:6808/279438927 16 ==== osd_op_reply(84 notify.3 [watch unwatch cookie 93827333960864] v30'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98d8051070 con 0x7f98e0045130 2024-09-22T08:36:46.330 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.307+0000 7f98ecf2f800 20 remove_watcher() i=3 2024-09-22T08:36:46.330 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.307+0000 7f98ecf2f800 1 -- 172.21.15.142:0/2024592751 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:85 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93827333966656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5555e0e912d0 con 0x5555e0e863d0 2024-09-22T08:36:46.330 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.309+0000 7f98e8475640 1 -- 172.21.15.142:0/2024592751 <== osd.1 v2:172.21.15.142:6816/3192108003 32 ==== osd_op_reply(85 notify.4 [watch unwatch cookie 93827333966656] v30'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98dc029040 con 0x5555e0e863d0 2024-09-22T08:36:46.330 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.309+0000 7f98ecf2f800 20 remove_watcher() i=4 2024-09-22T08:36:46.330 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.309+0000 7f98ecf2f800 1 -- 172.21.15.142:0/2024592751 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:86 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93827333970592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5555e0e92a40 con 0x7f98d80a5040 2024-09-22T08:36:46.330 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.310+0000 7f98e8475640 1 -- 172.21.15.142:0/2024592751 <== osd.0 v2:172.21.15.31:6800/168281188 18 ==== osd_op_reply(86 notify.5 [watch unwatch cookie 93827333970592] v30'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98dc029040 con 0x7f98d80a5040 2024-09-22T08:36:46.330 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.310+0000 7f98ecf2f800 20 remove_watcher() i=5 2024-09-22T08:36:46.330 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.310+0000 7f98ecf2f800 1 -- 172.21.15.142:0/2024592751 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:87 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93827333968896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5555e0e94b40 con 0x7f98d80a5040 2024-09-22T08:36:46.330 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.311+0000 7f98e8475640 1 -- 172.21.15.142:0/2024592751 <== osd.0 v2:172.21.15.31:6800/168281188 19 ==== osd_op_reply(87 notify.6 [watch unwatch cookie 93827333968896] v30'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98dc029040 con 0x7f98d80a5040 2024-09-22T08:36:46.330 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.311+0000 7f98ecf2f800 20 remove_watcher() i=6 2024-09-22T08:36:46.331 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.311+0000 7f98ecf2f800 1 -- 172.21.15.142:0/2024592751 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:88 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93827333973296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5555e0e912d0 con 0x7f98d80a5040 2024-09-22T08:36:46.331 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.312+0000 7f98e8475640 1 -- 172.21.15.142:0/2024592751 <== osd.0 v2:172.21.15.31:6800/168281188 20 ==== osd_op_reply(88 notify.7 [watch unwatch cookie 93827333973296] v30'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98dc029040 con 0x7f98d80a5040 2024-09-22T08:36:46.331 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.312+0000 7f98ecf2f800 20 remove_watcher() i=7 2024-09-22T08:36:46.331 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.312+0000 7f98ecf2f800 1 -- 172.21.15.142:0/2024592751 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f98d80a5040 msgr2=0x7f98d8074480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:46.331 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.312+0000 7f98ecf2f800 1 --2- 172.21.15.142:0/2024592751 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f98d80a5040 0x7f98d8074480 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:46.331 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.312+0000 7f98ecf2f800 1 -- 172.21.15.142:0/2024592751 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5555e0e863d0 msgr2=0x5555e0e88890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:46.331 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.312+0000 7f98ecf2f800 1 --2- 172.21.15.142:0/2024592751 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5555e0e863d0 0x5555e0e88890 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:46.331 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.312+0000 7f98ecf2f800 1 -- 172.21.15.142:0/2024592751 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f98e0045130 msgr2=0x7f98e003d000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:46.331 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.312+0000 7f98ecf2f800 1 --2- 172.21.15.142:0/2024592751 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f98e0045130 0x7f98e003d000 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:46.331 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.312+0000 7f98ecf2f800 1 -- 172.21.15.142:0/2024592751 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5555e0e8acd0 msgr2=0x5555e0e8d0c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:46.331 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.312+0000 7f98ecf2f800 1 --2- 172.21.15.142:0/2024592751 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5555e0e8acd0 0x5555e0e8d0c0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:46.331 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.312+0000 7f98ecf2f800 1 -- 172.21.15.142:0/2024592751 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f97b403d000 msgr2=0x7f97b403f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:46.332 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.312+0000 7f98ecf2f800 1 --2- 172.21.15.142:0/2024592751 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f97b403d000 0x7f97b403f4c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f98d8097430 tx=0x7f98d8089000 comp rx=0 tx=0).stop 2024-09-22T08:36:46.332 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.312+0000 7f98ecf2f800 1 -- 172.21.15.142:0/2024592751 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5555e0e73770 msgr2=0x5555e0e7ace0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:46.332 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.312+0000 7f98e8475640 1 -- 172.21.15.142:0/2024592751 reap_dead start 2024-09-22T08:36:46.332 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.312+0000 7f98ecf2f800 1 --2- 172.21.15.142:0/2024592751 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5555e0e73770 0x5555e0e7ace0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f98e0020560 tx=0x7f98e0054790 comp rx=0 tx=0).stop 2024-09-22T08:36:46.332 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.312+0000 7f98ecf2f800 1 -- 172.21.15.142:0/2024592751 shutdown_connections 2024-09-22T08:36:46.333 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.312+0000 7f98ecf2f800 1 --2- 172.21.15.142:0/2024592751 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5555e0e73770 0x5555e0e7ace0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:46.333 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.312+0000 7f98ecf2f800 1 -- 172.21.15.142:0/2024592751 >> 172.21.15.142:0/2024592751 conn(0x5555e0e6fb70 msgr2=0x5555e0e6dd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:46.333 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.312+0000 7f98ecf2f800 1 -- 172.21.15.142:0/2024592751 shutdown_connections 2024-09-22T08:36:46.333 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.312+0000 7f98ecf2f800 1 -- 172.21.15.142:0/2024592751 wait complete. 2024-09-22T08:36:46.333 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.312+0000 7f98ecf2f800 1 -- 172.21.15.142:0/2042424833 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f97c003d000 msgr2=0x7f97c003f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:46.333 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.312+0000 7f98ecf2f800 1 --2- 172.21.15.142:0/2042424833 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f97c003d000 0x7f97c003f4c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x5555e0e418f0 tx=0x7f98d805da60 comp rx=0 tx=0).stop 2024-09-22T08:36:46.333 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.312+0000 7f98ecf2f800 1 -- 172.21.15.142:0/2042424833 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5555e0e66cf0 msgr2=0x5555e0e67110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:46.334 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.312+0000 7f98ecf2f800 1 --2- 172.21.15.142:0/2042424833 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5555e0e66cf0 0x5555e0e67110 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x5555e0e41f00 tx=0x7f98e00167b0 comp rx=0 tx=0).stop 2024-09-22T08:36:46.334 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.313+0000 7f98ecf2f800 1 -- 172.21.15.142:0/2042424833 shutdown_connections 2024-09-22T08:36:46.334 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.313+0000 7f98ecf2f800 1 --2- 172.21.15.142:0/2042424833 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f97c003d000 0x7f97c003f4c0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:46.334 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.313+0000 7f98ecf2f800 1 --2- 172.21.15.142:0/2042424833 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5555e0e66cf0 0x5555e0e67110 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:46.334 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.313+0000 7f98ecf2f800 1 -- 172.21.15.142:0/2042424833 >> 172.21.15.142:0/2042424833 conn(0x5555e0e5b0a0 msgr2=0x5555e0e5b480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:46.334 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.313+0000 7f98ecf2f800 1 -- 172.21.15.142:0/2042424833 shutdown_connections 2024-09-22T08:36:46.334 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.313+0000 7f98ecf2f800 1 -- 172.21.15.142:0/2042424833 wait complete. 2024-09-22T08:36:46.334 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.313+0000 7f98ecf2f800 1 -- 172.21.15.142:0/525029892 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5555e0d52a20 msgr2=0x5555e0e53010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:46.334 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.313+0000 7f98ecf2f800 1 --2- 172.21.15.142:0/525029892 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5555e0d52a20 0x5555e0e53010 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:46.334 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.313+0000 7f98ecf2f800 1 -- 172.21.15.142:0/525029892 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5555e0e55700 msgr2=0x5555e0e57ba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:46.334 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.313+0000 7f98ecf2f800 1 --2- 172.21.15.142:0/525029892 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5555e0e55700 0x5555e0e57ba0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:46.334 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.313+0000 7f98ecf2f800 1 -- 172.21.15.142:0/525029892 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f97d003cfb0 msgr2=0x7f97d003f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:46.335 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.313+0000 7f98ecf2f800 1 --2- 172.21.15.142:0/525029892 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f97d003cfb0 0x7f97d003f470 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f98dc001d70 tx=0x7f98dc0012d0 comp rx=0 tx=0).stop 2024-09-22T08:36:46.335 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.313+0000 7f98ecf2f800 1 -- 172.21.15.142:0/525029892 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5555e0d517e0 msgr2=0x5555e0e42360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:46.335 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.313+0000 7f98ecf2f800 1 --2- 172.21.15.142:0/525029892 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5555e0d517e0 0x5555e0e42360 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f98d8025c20 tx=0x7f98d8002fb0 comp rx=0 tx=0).stop 2024-09-22T08:36:46.335 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.313+0000 7f98ecf2f800 1 -- 172.21.15.142:0/525029892 shutdown_connections 2024-09-22T08:36:46.335 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.313+0000 7f98ecf2f800 1 --2- 172.21.15.142:0/525029892 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5555e0e55700 0x5555e0e57ba0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:46.335 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.313+0000 7f98ecf2f800 1 --2- 172.21.15.142:0/525029892 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5555e0d52a20 0x5555e0e53010 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:46.335 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.313+0000 7f98ecf2f800 1 --2- 172.21.15.142:0/525029892 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f97d003cfb0 0x7f97d003f470 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:46.335 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.313+0000 7f98ecf2f800 1 --2- 172.21.15.142:0/525029892 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5555e0d517e0 0x5555e0e42360 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:46.335 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.313+0000 7f98ecf2f800 1 -- 172.21.15.142:0/525029892 >> 172.21.15.142:0/525029892 conn(0x5555e0d4cbb0 msgr2=0x5555e0e3b080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:46.335 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.313+0000 7f98ecf2f800 1 -- 172.21.15.142:0/525029892 shutdown_connections 2024-09-22T08:36:46.335 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.313+0000 7f98ecf2f800 1 -- 172.21.15.142:0/525029892 wait complete. 2024-09-22T08:36:46.336 INFO:teuthology.orchestra.run.smithi142.stdout:{"stats":{"size":3,"size_actual":4096,"size_kb":1,"size_kb_actual":4,"num_objects":1},"last_stats_sync":"2024-09-22T08:36:46.301144Z","last_stats_update":"2024-09-22T08:36:46.300063Z"} 2024-09-22T08:36:46.337 DEBUG:tasks.util.rgw: json result: {'stats': {'size': 3, 'size_actual': 4096, 'size_kb': 1, 'size_kb_actual': 4, 'num_objects': 1}, 'last_stats_sync': '2024-09-22T08:36:46.301144Z', 'last_stats_update': '2024-09-22T08:36:46.300063Z'} 2024-09-22T08:36:46.342 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-22T08:36:46.342 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'unlink', '--uid', 'foo', '--bucket', 'myfoo'] 2024-09-22T08:36:46.342 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'unlink', '--uid', 'foo', '--bucket', 'myfoo'] 2024-09-22T08:36:46.342 DEBUG:teuthology.orchestra.run.smithi142:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket unlink --uid foo --bucket myfoo 2024-09-22T08:36:46.388 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:36:46.389 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:36:46.389 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.388+0000 7f1892123800 1 Processor -- start 2024-09-22T08:36:46.389 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.388+0000 7f1892123800 1 -- start start 2024-09-22T08:36:46.390 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.388+0000 7f1892123800 1 --2- >> v2:172.21.15.31:3300/0 conn(0x556c5a797fe0 0x556c5a79ff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:46.390 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.388+0000 7f1892123800 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x556c5a624a20 con 0x556c5a797be0 2024-09-22T08:36:46.390 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.388+0000 7f1892123800 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x556c5a6247d0 con 0x556c5a797fe0 2024-09-22T08:36:46.390 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.389+0000 7f188d5ad640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x556c5a797fe0 0x556c5a79ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:46.390 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.389+0000 7f188ddae640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x556c5a797be0 0x556c5a79c850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.142:42528/0 (socket says 172.21.15.142:42528) 2024-09-22T08:36:46.390 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.389+0000 7f188ddae640 1 -- 172.21.15.142:0/792212332 learned_addr learned my addr 172.21.15.142:0/792212332 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-09-22T08:36:46.390 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.389+0000 7f188d5ad640 1 -- 172.21.15.142:0/792212332 >> v1:172.21.15.31:6789/0 conn(0x556c5a797be0 legacy=0x556c5a79c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:46.391 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.389+0000 7f188d5ad640 1 -- 172.21.15.142:0/792212332 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x556c5a7a1590 con 0x556c5a797fe0 2024-09-22T08:36:46.392 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.391+0000 7f188d5ad640 1 --2- 172.21.15.142:0/792212332 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556c5a797fe0 0x556c5a79ff80 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f188400a470 tx=0x7f1884045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=743bb09da4a3657f server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:46.392 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.391+0000 7f188cdac640 1 -- 172.21.15.142:0/792212332 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1884053570 con 0x556c5a797fe0 2024-09-22T08:36:46.392 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.391+0000 7f188cdac640 1 -- 172.21.15.142:0/792212332 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1884058070 con 0x556c5a797fe0 2024-09-22T08:36:46.392 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.391+0000 7f188cdac640 1 -- 172.21.15.142:0/792212332 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1884053880 con 0x556c5a797fe0 2024-09-22T08:36:46.393 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.391+0000 7f1892123800 1 -- 172.21.15.142:0/792212332 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556c5a797fe0 msgr2=0x556c5a79ff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:46.393 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.391+0000 7f1892123800 1 --2- 172.21.15.142:0/792212332 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556c5a797fe0 0x556c5a79ff80 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f188400a470 tx=0x7f1884045a20 comp rx=0 tx=0).stop 2024-09-22T08:36:46.393 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.391+0000 7f1892123800 1 -- 172.21.15.142:0/792212332 shutdown_connections 2024-09-22T08:36:46.393 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.391+0000 7f1892123800 1 --2- 172.21.15.142:0/792212332 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556c5a797fe0 0x556c5a79ff80 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:46.393 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.391+0000 7f1892123800 1 -- 172.21.15.142:0/792212332 >> 172.21.15.142:0/792212332 conn(0x556c5a793310 msgr2=0x556c5a795790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:46.393 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.391+0000 7f1892123800 1 -- 172.21.15.142:0/792212332 shutdown_connections 2024-09-22T08:36:46.393 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.391+0000 7f1892123800 1 -- 172.21.15.142:0/792212332 wait complete. 2024-09-22T08:36:46.406 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.405+0000 7f1892123800 1 Processor -- start 2024-09-22T08:36:46.406 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.405+0000 7f1892123800 1 -- start start 2024-09-22T08:36:46.407 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.405+0000 7f1892123800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556c5a797be0 0x556c5a889020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:46.407 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.405+0000 7f1892123800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x556c5a631dd0 con 0x556c5a797be0 2024-09-22T08:36:46.409 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.406+0000 7f188ddae640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556c5a797be0 0x556c5a889020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:46.409 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.406+0000 7f188ddae640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556c5a797be0 0x556c5a889020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:39362/0 (socket says 172.21.15.142:39362) 2024-09-22T08:36:46.409 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.406+0000 7f188ddae640 1 -- 172.21.15.142:0/2072730846 learned_addr learned my addr 172.21.15.142:0/2072730846 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:46.409 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.406+0000 7f188ddae640 1 -- 172.21.15.142:0/2072730846 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556c5a889610 con 0x556c5a797be0 2024-09-22T08:36:46.409 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.406+0000 7f188ddae640 1 --2- 172.21.15.142:0/2072730846 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556c5a797be0 0x556c5a889020 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f1880001e40 tx=0x7f1880001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51f6a3c3e719fd54 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:46.410 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.406+0000 7f177be07640 1 -- 172.21.15.142:0/2072730846 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1880012020 con 0x556c5a797be0 2024-09-22T08:36:46.410 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.406+0000 7f177be07640 1 -- 172.21.15.142:0/2072730846 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f188000e5a0 con 0x556c5a797be0 2024-09-22T08:36:46.410 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.406+0000 7f177be07640 1 -- 172.21.15.142:0/2072730846 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f188000e8a0 con 0x556c5a797be0 2024-09-22T08:36:46.410 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.407+0000 7f1892123800 1 -- 172.21.15.142:0/2072730846 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556c5a797be0 msgr2=0x556c5a889020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:46.410 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.407+0000 7f1892123800 1 --2- 172.21.15.142:0/2072730846 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556c5a797be0 0x556c5a889020 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f1880001e40 tx=0x7f1880001e70 comp rx=0 tx=0).stop 2024-09-22T08:36:46.410 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.407+0000 7f1892123800 1 -- 172.21.15.142:0/2072730846 shutdown_connections 2024-09-22T08:36:46.410 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.407+0000 7f1892123800 1 --2- 172.21.15.142:0/2072730846 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556c5a797be0 0x556c5a889020 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:46.410 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.407+0000 7f1892123800 1 -- 172.21.15.142:0/2072730846 >> 172.21.15.142:0/2072730846 conn(0x556c5a793310 msgr2=0x556c5a8849a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:46.410 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.407+0000 7f1892123800 1 -- 172.21.15.142:0/2072730846 shutdown_connections 2024-09-22T08:36:46.410 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.407+0000 7f1892123800 1 -- 172.21.15.142:0/2072730846 wait complete. 2024-09-22T08:36:46.410 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.407+0000 7f1892123800 1 Processor -- start 2024-09-22T08:36:46.410 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.407+0000 7f1892123800 1 -- start start 2024-09-22T08:36:46.410 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.408+0000 7f1892123800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556c5a797be0 0x556c5a890b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:46.411 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.408+0000 7f1892123800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x556c5a7a0850 con 0x556c5a797be0 2024-09-22T08:36:46.411 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.408+0000 7f188ddae640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556c5a797be0 0x556c5a890b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:46.411 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.408+0000 7f188ddae640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556c5a797be0 0x556c5a890b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:39370/0 (socket says 172.21.15.142:39370) 2024-09-22T08:36:46.411 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.408+0000 7f188ddae640 1 -- 172.21.15.142:0/915207167 learned_addr learned my addr 172.21.15.142:0/915207167 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:46.411 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.408+0000 7f188ddae640 1 -- 172.21.15.142:0/915207167 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556c5a8910f0 con 0x556c5a797be0 2024-09-22T08:36:46.415 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.408+0000 7f188ddae640 1 --2- 172.21.15.142:0/915207167 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556c5a797be0 0x556c5a890b90 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f188000c010 tx=0x7f1880000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:46.415 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.409+0000 7f177a604640 1 -- 172.21.15.142:0/915207167 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1880012030 con 0x556c5a797be0 2024-09-22T08:36:46.415 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.409+0000 7f177a604640 1 -- 172.21.15.142:0/915207167 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18800014a0 con 0x556c5a797be0 2024-09-22T08:36:46.415 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.409+0000 7f177a604640 1 -- 172.21.15.142:0/915207167 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f188001a7a0 con 0x556c5a797be0 2024-09-22T08:36:46.415 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.409+0000 7f1892123800 1 -- 172.21.15.142:0/915207167 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556c5a891380 con 0x556c5a797be0 2024-09-22T08:36:46.415 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.409+0000 7f1892123800 1 -- 172.21.15.142:0/915207167 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556c5a891d80 con 0x556c5a797be0 2024-09-22T08:36:46.415 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.409+0000 7f177a604640 1 -- 172.21.15.142:0/915207167 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f1880015020 con 0x556c5a797be0 2024-09-22T08:36:46.416 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.410+0000 7f177a604640 1 --2- 172.21.15.142:0/915207167 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f177403cfb0 0x7f177403f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:46.416 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.410+0000 7f177a604640 1 -- 172.21.15.142:0/915207167 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f1880020030 con 0x556c5a797be0 2024-09-22T08:36:46.416 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.410+0000 7f188d5ad640 1 --2- 172.21.15.142:0/915207167 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f177403cfb0 0x7f177403f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:46.416 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.410+0000 7f1892123800 1 --2- 172.21.15.142:0/915207167 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x556c5a797fe0 0x556c5a8981e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:46.416 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.410+0000 7f1892123800 1 -- 172.21.15.142:0/915207167 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556c5a898720 con 0x556c5a797fe0 2024-09-22T08:36:46.416 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.410+0000 7f188e5af640 1 --2- 172.21.15.142:0/915207167 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x556c5a797fe0 0x556c5a8981e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:46.416 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.410+0000 7f188d5ad640 1 --2- 172.21.15.142:0/915207167 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f177403cfb0 0x7f177403f470 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f1884057000 tx=0x7f1884052000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:46.416 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.410+0000 7f188e5af640 1 --2- 172.21.15.142:0/915207167 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x556c5a797fe0 0x556c5a8981e0 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:46.416 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.410+0000 7f188e5af640 1 -- 172.21.15.142:0/915207167 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f188800a4d0 con 0x556c5a797fe0 2024-09-22T08:36:46.416 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.411+0000 7f1892123800 1 -- 172.21.15.142:0/915207167 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556c5a898ac0 con 0x556c5a797fe0 2024-09-22T08:36:46.416 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.411+0000 7f188e5af640 1 -- 172.21.15.142:0/915207167 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f188800a4d0 con 0x556c5a797fe0 2024-09-22T08:36:46.416 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.411+0000 7f1892123800 1 --2- 172.21.15.142:0/915207167 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x556c5a89a580 0x556c5a89ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:46.416 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.411+0000 7f1892123800 1 -- 172.21.15.142:0/915207167 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:3 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556c5a89d1b0 con 0x556c5a89a580 2024-09-22T08:36:46.417 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.411+0000 7f188ddae640 1 --2- 172.21.15.142:0/915207167 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x556c5a89a580 0x556c5a89ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:46.417 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.411+0000 7f188ddae640 1 --2- 172.21.15.142:0/915207167 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x556c5a89a580 0x556c5a89ca20 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:46.417 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.411+0000 7f188ddae640 1 -- 172.21.15.142:0/915207167 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(3 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f188001ab20 con 0x556c5a89a580 2024-09-22T08:36:46.417 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.411+0000 7f1892123800 1 -- 172.21.15.142:0/915207167 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556c5a899310 con 0x556c5a797fe0 2024-09-22T08:36:46.417 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.412+0000 7f188e5af640 1 -- 172.21.15.142:0/915207167 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f188800a4d0 con 0x556c5a797fe0 2024-09-22T08:36:46.417 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.412+0000 7f1892123800 1 -- 172.21.15.142:0/915207167 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556c5a8996f0 con 0x556c5a89a580 2024-09-22T08:36:46.417 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.412+0000 7f188ddae640 1 -- 172.21.15.142:0/915207167 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(5 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f188001ab20 con 0x556c5a89a580 2024-09-22T08:36:46.417 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.412+0000 7f1892123800 1 Processor -- start 2024-09-22T08:36:46.417 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.412+0000 7f1892123800 1 -- start start 2024-09-22T08:36:46.417 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.413+0000 7f1892123800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556c5a8abb80 0x556c5a8abfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:46.417 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.413+0000 7f1892123800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x556c5a690d50 con 0x556c5a8abb80 2024-09-22T08:36:46.417 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.413+0000 7f188e5af640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556c5a8abb80 0x556c5a8abfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:46.418 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.413+0000 7f188e5af640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556c5a8abb80 0x556c5a8abfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:39372/0 (socket says 172.21.15.142:39372) 2024-09-22T08:36:46.418 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.413+0000 7f188e5af640 1 -- 172.21.15.142:0/2114369540 learned_addr learned my addr 172.21.15.142:0/2114369540 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:46.418 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.413+0000 7f188e5af640 1 -- 172.21.15.142:0/2114369540 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556c5a8ac5e0 con 0x556c5a8abb80 2024-09-22T08:36:46.418 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.413+0000 7f188e5af640 1 --2- 172.21.15.142:0/2114369540 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556c5a8abb80 0x556c5a8abfa0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x556c5a891a20 tx=0x7f18880167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:46.418 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.413+0000 7f17737fe640 1 -- 172.21.15.142:0/2114369540 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1888013640 con 0x556c5a8abb80 2024-09-22T08:36:46.418 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.413+0000 7f17737fe640 1 -- 172.21.15.142:0/2114369540 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18880137e0 con 0x556c5a8abb80 2024-09-22T08:36:46.418 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.413+0000 7f1892123800 1 -- 172.21.15.142:0/2114369540 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556c5a8ace10 con 0x556c5a8abb80 2024-09-22T08:36:46.418 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.413+0000 7f17737fe640 1 -- 172.21.15.142:0/2114369540 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1888013b00 con 0x556c5a8abb80 2024-09-22T08:36:46.418 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.414+0000 7f1892123800 1 -- 172.21.15.142:0/2114369540 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556c5a8ad3b0 con 0x556c5a8abb80 2024-09-22T08:36:46.429 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.414+0000 7f17737fe640 1 -- 172.21.15.142:0/2114369540 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f1888011040 con 0x556c5a8abb80 2024-09-22T08:36:46.429 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.414+0000 7f17737fe640 1 --2- 172.21.15.142:0/2114369540 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f176803d000 0x7f176803f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:46.429 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.414+0000 7f17737fe640 1 -- 172.21.15.142:0/2114369540 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f188800e040 con 0x556c5a8abb80 2024-09-22T08:36:46.430 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.415+0000 7f188ddae640 1 --2- 172.21.15.142:0/2114369540 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f176803d000 0x7f176803f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:46.430 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.415+0000 7f1892123800 1 Processor -- start 2024-09-22T08:36:46.430 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.415+0000 7f188ddae640 1 --2- 172.21.15.142:0/2114369540 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f176803d000 0x7f176803f4c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x556c5a892c90 tx=0x7f18800529c0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:46.430 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.415+0000 7f1892123800 1 -- start start 2024-09-22T08:36:46.430 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.415+0000 7f1892123800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556c5a8b8600 0x556c5a8b8a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:46.430 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.415+0000 7f1892123800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x556c5a889a40 con 0x556c5a8b8600 2024-09-22T08:36:46.430 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.415+0000 7f188e5af640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556c5a8b8600 0x556c5a8b8a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:46.430 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.415+0000 7f188e5af640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556c5a8b8600 0x556c5a8b8a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:39384/0 (socket says 172.21.15.142:39384) 2024-09-22T08:36:46.430 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.415+0000 7f188e5af640 1 -- 172.21.15.142:0/428220387 learned_addr learned my addr 172.21.15.142:0/428220387 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:46.430 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.416+0000 7f188e5af640 1 -- 172.21.15.142:0/428220387 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556c5a8b8ff0 con 0x556c5a8b8600 2024-09-22T08:36:46.430 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.416+0000 7f188e5af640 1 --2- 172.21.15.142:0/428220387 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556c5a8b8600 0x556c5a8b8a00 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f188800afe0 tx=0x7f1888020f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d72da3ec8e1b312 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:46.430 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.416+0000 7f17717fa640 1 -- 172.21.15.142:0/428220387 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f188802a910 con 0x556c5a8b8600 2024-09-22T08:36:46.431 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.416+0000 7f17717fa640 1 -- 172.21.15.142:0/428220387 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f188804de50 con 0x556c5a8b8600 2024-09-22T08:36:46.431 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.416+0000 7f17717fa640 1 -- 172.21.15.142:0/428220387 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1888013ca0 con 0x556c5a8b8600 2024-09-22T08:36:46.431 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.416+0000 7f1892123800 1 -- 172.21.15.142:0/428220387 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556c5a8b8600 msgr2=0x556c5a8b8a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:46.431 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.416+0000 7f1892123800 1 --2- 172.21.15.142:0/428220387 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556c5a8b8600 0x556c5a8b8a00 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f188800afe0 tx=0x7f1888020f00 comp rx=0 tx=0).stop 2024-09-22T08:36:46.431 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.416+0000 7f1892123800 1 -- 172.21.15.142:0/428220387 shutdown_connections 2024-09-22T08:36:46.431 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.416+0000 7f1892123800 1 --2- 172.21.15.142:0/428220387 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556c5a8b8600 0x556c5a8b8a00 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:46.431 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.416+0000 7f1892123800 1 -- 172.21.15.142:0/428220387 >> 172.21.15.142:0/428220387 conn(0x556c5a8b4a00 msgr2=0x556c5a8b2c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:46.431 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.416+0000 7f1892123800 1 -- 172.21.15.142:0/428220387 shutdown_connections 2024-09-22T08:36:46.431 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.416+0000 7f1892123800 1 -- 172.21.15.142:0/428220387 wait complete. 2024-09-22T08:36:46.431 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.417+0000 7f1892123800 1 Processor -- start 2024-09-22T08:36:46.431 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.417+0000 7f1892123800 1 -- start start 2024-09-22T08:36:46.431 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.417+0000 7f1892123800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556c5a8b8600 0x556c5a8bfbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:46.431 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.417+0000 7f1892123800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x556c5a8b9610 con 0x556c5a8b8600 2024-09-22T08:36:46.432 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.417+0000 7f188e5af640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556c5a8b8600 0x556c5a8bfbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:46.432 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.417+0000 7f188e5af640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556c5a8b8600 0x556c5a8bfbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:39386/0 (socket says 172.21.15.142:39386) 2024-09-22T08:36:46.432 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.417+0000 7f188e5af640 1 -- 172.21.15.142:0/3579313285 learned_addr learned my addr 172.21.15.142:0/3579313285 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:46.432 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.417+0000 7f188e5af640 1 -- 172.21.15.142:0/3579313285 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556c5a8c0110 con 0x556c5a8b8600 2024-09-22T08:36:46.432 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.418+0000 7f188e5af640 1 --2- 172.21.15.142:0/3579313285 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556c5a8b8600 0x556c5a8bfbb0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f188800afe0 tx=0x7f18880547b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:46.432 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.418+0000 7f175f7fe640 1 -- 172.21.15.142:0/3579313285 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f18880532b0 con 0x556c5a8b8600 2024-09-22T08:36:46.432 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.418+0000 7f175f7fe640 1 -- 172.21.15.142:0/3579313285 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1888053450 con 0x556c5a8b8600 2024-09-22T08:36:46.432 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.418+0000 7f175f7fe640 1 -- 172.21.15.142:0/3579313285 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f188802a520 con 0x556c5a8b8600 2024-09-22T08:36:46.432 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.418+0000 7f1892123800 1 -- 172.21.15.142:0/3579313285 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556c5a8c03a0 con 0x556c5a8b8600 2024-09-22T08:36:46.432 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.418+0000 7f1892123800 1 -- 172.21.15.142:0/3579313285 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556c5a8c0d20 con 0x556c5a8b8600 2024-09-22T08:36:46.432 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.418+0000 7f175f7fe640 1 -- 172.21.15.142:0/3579313285 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f18880451d0 con 0x556c5a8b8600 2024-09-22T08:36:46.432 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.419+0000 7f175f7fe640 1 --2- 172.21.15.142:0/3579313285 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f175803d000 0x7f175803f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:46.433 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.419+0000 7f175f7fe640 1 -- 172.21.15.142:0/3579313285 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f1888004b30 con 0x556c5a8b8600 2024-09-22T08:36:46.433 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.419+0000 7f188ddae640 1 --2- 172.21.15.142:0/3579313285 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f175803d000 0x7f175803f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:46.433 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.419+0000 7f188ddae640 1 --2- 172.21.15.142:0/3579313285 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f175803d000 0x7f175803f4c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f1880001250 tx=0x7f1880051000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:46.433 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.419+0000 7f1892123800 20 rados->read ofs=0 len=0 2024-09-22T08:36:46.433 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.419+0000 7f1892123800 1 --2- 172.21.15.142:0/3579313285 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x556c5a8cb4c0 0x556c5a8cd980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:46.433 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.419+0000 7f1892123800 1 -- 172.21.15.142:0/3579313285 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556c5a8ce0d0 con 0x556c5a8cb4c0 2024-09-22T08:36:46.433 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.419+0000 7f188d5ad640 1 --2- 172.21.15.142:0/3579313285 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x556c5a8cb4c0 0x556c5a8cd980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:46.433 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.420+0000 7f188d5ad640 1 --2- 172.21.15.142:0/3579313285 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x556c5a8cb4c0 0x556c5a8cd980 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:46.433 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.420+0000 7f188d5ad640 1 -- 172.21.15.142:0/3579313285 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1884051070 con 0x556c5a8cb4c0 2024-09-22T08:36:46.433 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.420+0000 7f1892123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:46.433 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.420+0000 7f1892123800 20 realm 2024-09-22T08:36:46.433 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.420+0000 7f1892123800 20 rados->read ofs=0 len=0 2024-09-22T08:36:46.433 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.420+0000 7f1892123800 1 -- 172.21.15.142:0/3579313285 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556c5a8ce500 con 0x556c5a8cb4c0 2024-09-22T08:36:46.434 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.420+0000 7f188d5ad640 1 -- 172.21.15.142:0/3579313285 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1884051070 con 0x556c5a8cb4c0 2024-09-22T08:36:46.434 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.420+0000 7f1892123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:46.434 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.420+0000 7f1892123800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:36:46.434 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.420+0000 7f1892123800 20 rados->read ofs=0 len=0 2024-09-22T08:36:46.434 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.420+0000 7f1892123800 1 -- 172.21.15.142:0/3579313285 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556c5a8cedd0 con 0x556c5a8cb4c0 2024-09-22T08:36:46.434 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.420+0000 7f188d5ad640 1 -- 172.21.15.142:0/3579313285 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1884051070 con 0x556c5a8cb4c0 2024-09-22T08:36:46.434 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.420+0000 7f1892123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:46.434 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.420+0000 7f1892123800 20 rados->read ofs=0 len=0 2024-09-22T08:36:46.434 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.420+0000 7f1892123800 1 -- 172.21.15.142:0/3579313285 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556c5a8cf170 con 0x556c5a8cb4c0 2024-09-22T08:36:46.434 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.421+0000 7f188d5ad640 1 -- 172.21.15.142:0/3579313285 <== osd.1 v2:172.21.15.142:6816/3192108003 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1884051070 con 0x556c5a8cb4c0 2024-09-22T08:36:46.434 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.421+0000 7f1892123800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:36:46.434 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.421+0000 7f1892123800 20 rados->read ofs=0 len=0 2024-09-22T08:36:46.434 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.421+0000 7f1892123800 1 --2- 172.21.15.142:0/3579313285 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x556c5a8cfed0 0x556c5a8d22c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:46.435 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.421+0000 7f1892123800 1 -- 172.21.15.142:0/3579313285 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556c5a8d28d0 con 0x556c5a8cfed0 2024-09-22T08:36:46.435 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.421+0000 7f188e5af640 1 --2- 172.21.15.142:0/3579313285 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x556c5a8cfed0 0x556c5a8d22c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:46.435 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.421+0000 7f188e5af640 1 --2- 172.21.15.142:0/3579313285 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x556c5a8cfed0 0x556c5a8d22c0 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:46.435 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.421+0000 7f188e5af640 1 -- 172.21.15.142:0/3579313285 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(5 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f188800a4d0 con 0x556c5a8cfed0 2024-09-22T08:36:46.435 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.421+0000 7f1892123800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:36:46.435 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.421+0000 7f1892123800 20 searching for the correct realm 2024-09-22T08:36:46.435 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.421+0000 7f1892123800 1 -- 172.21.15.142:0/3579313285 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556c5a8d4200 con 0x556c5a8cfed0 2024-09-22T08:36:46.435 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.421+0000 7f188e5af640 1 -- 172.21.15.142:0/3579313285 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f188800a4d0 con 0x556c5a8cfed0 2024-09-22T08:36:46.435 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.422+0000 7f188e5af640 1 --2- 172.21.15.142:0/3579313285 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f18880217c0 0x7f1888007050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:46.435 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.422+0000 7f188e5af640 1 -- 172.21.15.142:0/3579313285 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556c5a8d4200 con 0x7f18880217c0 2024-09-22T08:36:46.435 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.422+0000 7f188ddae640 1 --2- 172.21.15.142:0/3579313285 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f18880217c0 0x7f1888007050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:46.436 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.422+0000 7f188ddae640 1 --2- 172.21.15.142:0/3579313285 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f18880217c0 0x7f1888007050 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:46.436 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.422+0000 7f188ddae640 1 -- 172.21.15.142:0/3579313285 <== osd.2 v2:172.21.15.142:6808/279438927 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f188001ab20 con 0x7f18880217c0 2024-09-22T08:36:46.436 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.422+0000 7f188ddae640 1 --2- 172.21.15.142:0/3579313285 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f1880017050 0x7f188004b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:46.436 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.422+0000 7f188ddae640 1 -- 172.21.15.142:0/3579313285 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556c5a8d4200 con 0x7f1880017050 2024-09-22T08:36:46.436 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.422+0000 7f188d5ad640 1 --2- 172.21.15.142:0/3579313285 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f1880017050 0x7f188004b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:46.436 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.423+0000 7f188d5ad640 1 --2- 172.21.15.142:0/3579313285 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f1880017050 0x7f188004b890 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:46.436 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.423+0000 7f188d5ad640 1 -- 172.21.15.142:0/3579313285 <== osd.0 v2:172.21.15.31:6800/168281188 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1884051070 con 0x7f1880017050 2024-09-22T08:36:46.436 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.423+0000 7f188d5ad640 1 -- 172.21.15.142:0/3579313285 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556c5a8d4200 con 0x556c5a8cb4c0 2024-09-22T08:36:46.436 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.423+0000 7f188d5ad640 1 -- 172.21.15.142:0/3579313285 <== osd.1 v2:172.21.15.142:6816/3192108003 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1884051070 con 0x556c5a8cb4c0 2024-09-22T08:36:46.436 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.423+0000 7f188d5ad640 1 -- 172.21.15.142:0/3579313285 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556c5a8d4200 con 0x556c5a8cb4c0 2024-09-22T08:36:46.436 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.423+0000 7f188d5ad640 1 -- 172.21.15.142:0/3579313285 <== osd.1 v2:172.21.15.142:6816/3192108003 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1884051070 con 0x556c5a8cb4c0 2024-09-22T08:36:46.436 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.423+0000 7f188d5ad640 1 -- 172.21.15.142:0/3579313285 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556c5a8d4200 con 0x7f1880017050 2024-09-22T08:36:46.436 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.424+0000 7f188d5ad640 1 -- 172.21.15.142:0/3579313285 <== osd.0 v2:172.21.15.31:6800/168281188 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1884051070 con 0x7f1880017050 2024-09-22T08:36:46.437 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.424+0000 7f188d5ad640 1 -- 172.21.15.142:0/3579313285 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556c5a8d4200 con 0x7f1880017050 2024-09-22T08:36:46.437 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.424+0000 7f188d5ad640 1 -- 172.21.15.142:0/3579313285 <== osd.0 v2:172.21.15.31:6800/168281188 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1884051070 con 0x7f1880017050 2024-09-22T08:36:46.437 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.424+0000 7f188d5ad640 1 -- 172.21.15.142:0/3579313285 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556c5a8d4200 con 0x7f18880217c0 2024-09-22T08:36:46.437 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.424+0000 7f188ddae640 1 -- 172.21.15.142:0/3579313285 <== osd.2 v2:172.21.15.142:6808/279438927 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f188001ab20 con 0x7f18880217c0 2024-09-22T08:36:46.437 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.424+0000 7f188ddae640 1 -- 172.21.15.142:0/3579313285 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556c5a8d4200 con 0x556c5a8cfed0 2024-09-22T08:36:46.437 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.425+0000 7f188e5af640 1 -- 172.21.15.142:0/3579313285 <== osd.3 v2:172.21.15.142:6800/1064901393 3 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f188800a4d0 con 0x556c5a8cfed0 2024-09-22T08:36:46.437 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.425+0000 7f188e5af640 1 -- 172.21.15.142:0/3579313285 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556c5a8d4200 con 0x556c5a8cb4c0 2024-09-22T08:36:46.437 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.425+0000 7f188d5ad640 1 -- 172.21.15.142:0/3579313285 <== osd.1 v2:172.21.15.142:6816/3192108003 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1884051070 con 0x556c5a8cb4c0 2024-09-22T08:36:46.437 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.425+0000 7f188d5ad640 1 -- 172.21.15.142:0/3579313285 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556c5a8d4200 con 0x7f1880017050 2024-09-22T08:36:46.437 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.425+0000 7f188d5ad640 1 -- 172.21.15.142:0/3579313285 <== osd.0 v2:172.21.15.31:6800/168281188 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1884051070 con 0x7f1880017050 2024-09-22T08:36:46.437 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.425+0000 7f188d5ad640 1 -- 172.21.15.142:0/3579313285 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556c5a8d4200 con 0x556c5a8cb4c0 2024-09-22T08:36:46.437 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.425+0000 7f188d5ad640 1 -- 172.21.15.142:0/3579313285 <== osd.1 v2:172.21.15.142:6816/3192108003 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1884051070 con 0x556c5a8cb4c0 2024-09-22T08:36:46.437 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.425+0000 7f188d5ad640 1 -- 172.21.15.142:0/3579313285 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556c5a8d4200 con 0x7f18880217c0 2024-09-22T08:36:46.438 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.426+0000 7f188ddae640 1 -- 172.21.15.142:0/3579313285 <== osd.2 v2:172.21.15.142:6808/279438927 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f188001ab20 con 0x7f18880217c0 2024-09-22T08:36:46.438 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.426+0000 7f188ddae640 1 -- 172.21.15.142:0/3579313285 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556c5a8d4200 con 0x556c5a8cfed0 2024-09-22T08:36:46.438 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.426+0000 7f188e5af640 1 -- 172.21.15.142:0/3579313285 <== osd.3 v2:172.21.15.142:6800/1064901393 4 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f188800a4d0 con 0x556c5a8cfed0 2024-09-22T08:36:46.438 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.426+0000 7f188e5af640 1 -- 172.21.15.142:0/3579313285 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556c5a8d4200 con 0x556c5a8cfed0 2024-09-22T08:36:46.438 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.426+0000 7f188e5af640 1 -- 172.21.15.142:0/3579313285 <== osd.3 v2:172.21.15.142:6800/1064901393 5 ==== osd_op_reply(20 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f188800a4d0 con 0x556c5a8cfed0 2024-09-22T08:36:46.438 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.426+0000 7f188e5af640 1 -- 172.21.15.142:0/3579313285 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556c5a8d4200 con 0x7f1880017050 2024-09-22T08:36:46.438 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.426+0000 7f188d5ad640 1 -- 172.21.15.142:0/3579313285 <== osd.0 v2:172.21.15.31:6800/168281188 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1884051070 con 0x7f1880017050 2024-09-22T08:36:46.438 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.426+0000 7f188d5ad640 1 -- 172.21.15.142:0/3579313285 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556c5a8d4200 con 0x556c5a8cfed0 2024-09-22T08:36:46.438 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.427+0000 7f188e5af640 1 -- 172.21.15.142:0/3579313285 <== osd.3 v2:172.21.15.142:6800/1064901393 6 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f188800a4d0 con 0x556c5a8cfed0 2024-09-22T08:36:46.439 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.427+0000 7f188e5af640 1 -- 172.21.15.142:0/3579313285 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556c5a8d4200 con 0x556c5a8cfed0 2024-09-22T08:36:46.439 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.427+0000 7f188e5af640 1 -- 172.21.15.142:0/3579313285 <== osd.3 v2:172.21.15.142:6800/1064901393 7 ==== osd_op_reply(23 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f188800a4d0 con 0x556c5a8cfed0 2024-09-22T08:36:46.439 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.427+0000 7f188e5af640 1 -- 172.21.15.142:0/3579313285 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556c5a8d4200 con 0x556c5a8cb4c0 2024-09-22T08:36:46.439 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.427+0000 7f188d5ad640 1 -- 172.21.15.142:0/3579313285 <== osd.1 v2:172.21.15.142:6816/3192108003 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1884051070 con 0x556c5a8cb4c0 2024-09-22T08:36:46.439 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.427+0000 7f188d5ad640 1 -- 172.21.15.142:0/3579313285 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556c5a8d4200 con 0x556c5a8cb4c0 2024-09-22T08:36:46.439 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.427+0000 7f188d5ad640 1 -- 172.21.15.142:0/3579313285 <== osd.1 v2:172.21.15.142:6816/3192108003 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f1884051070 con 0x556c5a8cb4c0 2024-09-22T08:36:46.439 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.427+0000 7f188d5ad640 1 -- 172.21.15.142:0/3579313285 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556c5a8d4200 con 0x7f1880017050 2024-09-22T08:36:46.439 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.427+0000 7f188d5ad640 1 -- 172.21.15.142:0/3579313285 <== osd.0 v2:172.21.15.31:6800/168281188 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1884051070 con 0x7f1880017050 2024-09-22T08:36:46.439 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.427+0000 7f188d5ad640 1 -- 172.21.15.142:0/3579313285 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556c5a8d4200 con 0x556c5a8cfed0 2024-09-22T08:36:46.439 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.428+0000 7f188e5af640 1 -- 172.21.15.142:0/3579313285 <== osd.3 v2:172.21.15.142:6800/1064901393 8 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f188800a4d0 con 0x556c5a8cfed0 2024-09-22T08:36:46.439 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.428+0000 7f188e5af640 1 -- 172.21.15.142:0/3579313285 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556c5a8d4200 con 0x7f18880217c0 2024-09-22T08:36:46.439 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.428+0000 7f188ddae640 1 -- 172.21.15.142:0/3579313285 <== osd.2 v2:172.21.15.142:6808/279438927 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f188001ab20 con 0x7f18880217c0 2024-09-22T08:36:46.439 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.428+0000 7f188ddae640 1 -- 172.21.15.142:0/3579313285 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556c5a8d4200 con 0x556c5a8cb4c0 2024-09-22T08:36:46.440 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.428+0000 7f188d5ad640 1 -- 172.21.15.142:0/3579313285 <== osd.1 v2:172.21.15.142:6816/3192108003 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1884051070 con 0x556c5a8cb4c0 2024-09-22T08:36:46.440 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.428+0000 7f188d5ad640 1 -- 172.21.15.142:0/3579313285 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556c5a8d4200 con 0x7f1880017050 2024-09-22T08:36:46.440 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.428+0000 7f188d5ad640 1 -- 172.21.15.142:0/3579313285 <== osd.0 v2:172.21.15.31:6800/168281188 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1884051070 con 0x7f1880017050 2024-09-22T08:36:46.440 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.428+0000 7f188d5ad640 1 -- 172.21.15.142:0/3579313285 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556c5a8d4200 con 0x556c5a8cfed0 2024-09-22T08:36:46.450 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.429+0000 7f188e5af640 1 -- 172.21.15.142:0/3579313285 <== osd.3 v2:172.21.15.142:6800/1064901393 9 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f188800a4d0 con 0x556c5a8cfed0 2024-09-22T08:36:46.451 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.429+0000 7f188e5af640 1 -- 172.21.15.142:0/3579313285 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556c5a8d4200 con 0x7f1880017050 2024-09-22T08:36:46.451 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.429+0000 7f188d5ad640 1 -- 172.21.15.142:0/3579313285 <== osd.0 v2:172.21.15.31:6800/168281188 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1884051070 con 0x7f1880017050 2024-09-22T08:36:46.451 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.429+0000 7f188d5ad640 1 -- 172.21.15.142:0/3579313285 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556c5a8d4200 con 0x7f18880217c0 2024-09-22T08:36:46.451 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.429+0000 7f188ddae640 1 -- 172.21.15.142:0/3579313285 <== osd.2 v2:172.21.15.142:6808/279438927 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f188001ab20 con 0x7f18880217c0 2024-09-22T08:36:46.451 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.429+0000 7f188ddae640 1 -- 172.21.15.142:0/3579313285 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556c5a8d4200 con 0x556c5a8cfed0 2024-09-22T08:36:46.451 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.429+0000 7f188e5af640 1 -- 172.21.15.142:0/3579313285 <== osd.3 v2:172.21.15.142:6800/1064901393 10 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f188800a4d0 con 0x556c5a8cfed0 2024-09-22T08:36:46.451 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.429+0000 7f188e5af640 1 -- 172.21.15.142:0/3579313285 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556c5a8d4200 con 0x7f1880017050 2024-09-22T08:36:46.451 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.430+0000 7f188d5ad640 1 -- 172.21.15.142:0/3579313285 <== osd.0 v2:172.21.15.31:6800/168281188 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1884051070 con 0x7f1880017050 2024-09-22T08:36:46.451 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.430+0000 7f188d5ad640 1 -- 172.21.15.142:0/3579313285 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556c5a8d4200 con 0x556c5a8cb4c0 2024-09-22T08:36:46.451 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.430+0000 7f188d5ad640 1 -- 172.21.15.142:0/3579313285 <== osd.1 v2:172.21.15.142:6816/3192108003 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f1884051070 con 0x556c5a8cb4c0 2024-09-22T08:36:46.451 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.430+0000 7f188d5ad640 1 -- 172.21.15.142:0/3579313285 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556c5a8d4200 con 0x7f18880217c0 2024-09-22T08:36:46.451 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.430+0000 7f188ddae640 1 -- 172.21.15.142:0/3579313285 <== osd.2 v2:172.21.15.142:6808/279438927 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f188001ab20 con 0x7f18880217c0 2024-09-22T08:36:46.451 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.430+0000 7f1892123800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:36:46.452 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.430+0000 7f1892123800 20 RGWRados::pool_iterate: got zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec 2024-09-22T08:36:46.452 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.430+0000 7f1892123800 20 RGWRados::pool_iterate: got zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f 2024-09-22T08:36:46.452 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.430+0000 7f1892123800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:36:46.452 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.430+0000 7f1892123800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:36:46.452 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.430+0000 7f1892123800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:36:46.452 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.430+0000 7f1892123800 20 rados->read ofs=0 len=0 2024-09-22T08:36:46.452 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.430+0000 7f1892123800 1 -- 172.21.15.142:0/3579313285 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556c5a8d3290 con 0x556c5a8cb4c0 2024-09-22T08:36:46.452 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.430+0000 7f188d5ad640 1 -- 172.21.15.142:0/3579313285 <== osd.1 v2:172.21.15.142:6816/3192108003 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1884051070 con 0x556c5a8cb4c0 2024-09-22T08:36:46.452 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.431+0000 7f1892123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:46.452 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.431+0000 7f1892123800 20 rados->read ofs=0 len=0 2024-09-22T08:36:46.452 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.431+0000 7f1892123800 1 -- 172.21.15.142:0/3579313285 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556c5a8d3ae0 con 0x556c5a8cb4c0 2024-09-22T08:36:46.452 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.431+0000 7f188d5ad640 1 -- 172.21.15.142:0/3579313285 <== osd.1 v2:172.21.15.142:6816/3192108003 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1884051070 con 0x556c5a8cb4c0 2024-09-22T08:36:46.452 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.431+0000 7f1892123800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:36:46.453 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.431+0000 7f1892123800 20 rados->read ofs=0 len=0 2024-09-22T08:36:46.453 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.431+0000 7f1892123800 1 -- 172.21.15.142:0/3579313285 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:40 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556c5a8d4680 con 0x556c5a8cfed0 2024-09-22T08:36:46.453 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.431+0000 7f188e5af640 1 -- 172.21.15.142:0/3579313285 <== osd.3 v2:172.21.15.142:6800/1064901393 11 ==== osd_op_reply(40 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f188800a4d0 con 0x556c5a8cfed0 2024-09-22T08:36:46.453 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.431+0000 7f1892123800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:36:46.453 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.431+0000 7f1892123800 20 zone default found 2024-09-22T08:36:46.453 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.431+0000 7f1892123800 4 Realm: () 2024-09-22T08:36:46.453 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.431+0000 7f1892123800 4 ZoneGroup: default (d89f6f57-1007-47dd-9065-f486c7b01aec) 2024-09-22T08:36:46.453 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.431+0000 7f1892123800 4 Zone: default (e239248c-0bee-4e41-803a-24b288d3eb8f) 2024-09-22T08:36:46.453 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.431+0000 7f1892123800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:36:46.453 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.431+0000 7f1892123800 20 zonegroup default 2024-09-22T08:36:46.453 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.431+0000 7f1892123800 20 rados->read ofs=0 len=0 2024-09-22T08:36:46.453 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.431+0000 7f1892123800 1 -- 172.21.15.142:0/3579313285 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556c5a8d4a60 con 0x7f1880017050 2024-09-22T08:36:46.453 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.431+0000 7f188d5ad640 1 -- 172.21.15.142:0/3579313285 <== osd.0 v2:172.21.15.31:6800/168281188 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f1884051070 con 0x7f1880017050 2024-09-22T08:36:46.454 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.431+0000 7f1892123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:46.454 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.432+0000 7f1892123800 20 rados->read ofs=0 len=0 2024-09-22T08:36:46.454 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.432+0000 7f1892123800 1 -- 172.21.15.142:0/3579313285 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556c5a8d6d40 con 0x556c5a8cfed0 2024-09-22T08:36:46.454 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.432+0000 7f188e5af640 1 -- 172.21.15.142:0/3579313285 <== osd.3 v2:172.21.15.142:6800/1064901393 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f188800a4d0 con 0x556c5a8cfed0 2024-09-22T08:36:46.454 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.432+0000 7f1892123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:46.454 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.432+0000 7f1892123800 20 rados->read ofs=0 len=0 2024-09-22T08:36:46.454 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.432+0000 7f1892123800 1 -- 172.21.15.142:0/3579313285 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556c5a8d70e0 con 0x556c5a8cfed0 2024-09-22T08:36:46.454 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.432+0000 7f188e5af640 1 -- 172.21.15.142:0/3579313285 <== osd.3 v2:172.21.15.142:6800/1064901393 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f188800a4d0 con 0x556c5a8cfed0 2024-09-22T08:36:46.454 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.432+0000 7f1892123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:46.454 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.432+0000 7f1892123800 20 started sync module instance, tier type = 2024-09-22T08:36:46.454 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.432+0000 7f1892123800 20 started zone id=e239248c-0bee-4e41-803a-24b288d3eb8f (name=default) with tier type = 2024-09-22T08:36:46.454 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.432+0000 7f1892123800 1 -- 172.21.15.142:0/3579313285 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556c5a8d61d0 con 0x7f18880217c0 2024-09-22T08:36:46.455 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.433+0000 7f188ddae640 1 -- 172.21.15.142:0/3579313285 <== osd.2 v2:172.21.15.142:6808/279438927 7 ==== osd_op_reply(44 notify.0 [create] v30'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f188001ab20 con 0x7f18880217c0 2024-09-22T08:36:46.455 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.433+0000 7f1892123800 1 -- 172.21.15.142:0/3579313285 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93923864045040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556c5a8d5e30 con 0x7f18880217c0 2024-09-22T08:36:46.455 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.433+0000 7f1892123800 1 -- 172.21.15.142:0/3579313285 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556c5a8d7fe0 con 0x556c5a8cb4c0 2024-09-22T08:36:46.455 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.434+0000 7f188ddae640 1 -- 172.21.15.142:0/3579313285 <== osd.2 v2:172.21.15.142:6808/279438927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93923864045040] v30'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f188001ab20 con 0x7f18880217c0 2024-09-22T08:36:46.455 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.435+0000 7f188d5ad640 1 -- 172.21.15.142:0/3579313285 <== osd.1 v2:172.21.15.142:6816/3192108003 15 ==== osd_op_reply(46 notify.1 [create] v30'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1884051070 con 0x556c5a8cb4c0 2024-09-22T08:36:46.455 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.435+0000 7f1892123800 1 -- 172.21.15.142:0/3579313285 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93923864050480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556c5a8d8400 con 0x556c5a8cb4c0 2024-09-22T08:36:46.455 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.435+0000 7f1892123800 1 -- 172.21.15.142:0/3579313285 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556c5a8d8dc0 con 0x556c5a8cfed0 2024-09-22T08:36:46.455 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.436+0000 7f188e5af640 1 -- 172.21.15.142:0/3579313285 <== osd.3 v2:172.21.15.142:6800/1064901393 14 ==== osd_op_reply(48 notify.2 [create] v30'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f188800a4d0 con 0x556c5a8cfed0 2024-09-22T08:36:46.455 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.436+0000 7f188d5ad640 1 -- 172.21.15.142:0/3579313285 <== osd.1 v2:172.21.15.142:6816/3192108003 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93923864050480] v30'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1884051070 con 0x556c5a8cb4c0 2024-09-22T08:36:46.455 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.436+0000 7f1892123800 1 -- 172.21.15.142:0/3579313285 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93923864054032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556c5a8d9220 con 0x556c5a8cfed0 2024-09-22T08:36:46.455 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.436+0000 7f1892123800 1 -- 172.21.15.142:0/3579313285 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556c5a8d7f70 con 0x7f18880217c0 2024-09-22T08:36:46.456 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.437+0000 7f188ddae640 1 -- 172.21.15.142:0/3579313285 <== osd.2 v2:172.21.15.142:6808/279438927 9 ==== osd_op_reply(50 notify.3 [create] v30'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f188001ab20 con 0x7f18880217c0 2024-09-22T08:36:46.456 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.437+0000 7f188e5af640 1 -- 172.21.15.142:0/3579313285 <== osd.3 v2:172.21.15.142:6800/1064901393 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 93923864054032] v30'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f188800a4d0 con 0x556c5a8cfed0 2024-09-22T08:36:46.456 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.437+0000 7f1892123800 1 -- 172.21.15.142:0/3579313285 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93923864057824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556c5a8da0b0 con 0x7f18880217c0 2024-09-22T08:36:46.456 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.437+0000 7f1892123800 1 -- 172.21.15.142:0/3579313285 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556c5a8d8d70 con 0x556c5a8cb4c0 2024-09-22T08:36:46.456 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.438+0000 7f188ddae640 1 -- 172.21.15.142:0/3579313285 <== osd.2 v2:172.21.15.142:6808/279438927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93923864057824] v30'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f188001ab20 con 0x7f18880217c0 2024-09-22T08:36:46.456 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.438+0000 7f188d5ad640 1 -- 172.21.15.142:0/3579313285 <== osd.1 v2:172.21.15.142:6816/3192108003 17 ==== osd_op_reply(52 notify.4 [create] v30'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1884051070 con 0x556c5a8cb4c0 2024-09-22T08:36:46.456 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.438+0000 7f1892123800 1 -- 172.21.15.142:0/3579313285 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93923864058880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556c5a8dab50 con 0x556c5a8cb4c0 2024-09-22T08:36:46.456 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.438+0000 7f1892123800 1 -- 172.21.15.142:0/3579313285 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556c5a8db510 con 0x7f1880017050 2024-09-22T08:36:46.456 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.439+0000 7f188d5ad640 1 -- 172.21.15.142:0/3579313285 <== osd.1 v2:172.21.15.142:6816/3192108003 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93923864058880] v30'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1884051070 con 0x556c5a8cb4c0 2024-09-22T08:36:46.456 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.439+0000 7f188d5ad640 1 -- 172.21.15.142:0/3579313285 <== osd.0 v2:172.21.15.31:6800/168281188 11 ==== osd_op_reply(54 notify.5 [create] v30'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1884051070 con 0x7f1880017050 2024-09-22T08:36:46.456 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.439+0000 7f1892123800 1 -- 172.21.15.142:0/3579313285 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93923864062080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556c5a8db510 con 0x7f1880017050 2024-09-22T08:36:46.457 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.439+0000 7f1892123800 1 -- 172.21.15.142:0/3579313285 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556c5a8dbed0 con 0x7f1880017050 2024-09-22T08:36:46.457 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.440+0000 7f188d5ad640 1 -- 172.21.15.142:0/3579313285 <== osd.0 v2:172.21.15.31:6800/168281188 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93923864062080] v30'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1884051070 con 0x7f1880017050 2024-09-22T08:36:46.457 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.440+0000 7f188d5ad640 1 -- 172.21.15.142:0/3579313285 <== osd.0 v2:172.21.15.31:6800/168281188 13 ==== osd_op_reply(56 notify.6 [create] v30'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1884051070 con 0x7f1880017050 2024-09-22T08:36:46.457 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.440+0000 7f1892123800 1 -- 172.21.15.142:0/3579313285 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93923864064096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556c5a8dc0b0 con 0x7f1880017050 2024-09-22T08:36:46.457 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.440+0000 7f1892123800 1 -- 172.21.15.142:0/3579313285 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556c5a8dc900 con 0x7f1880017050 2024-09-22T08:36:46.457 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.441+0000 7f188d5ad640 1 -- 172.21.15.142:0/3579313285 <== osd.0 v2:172.21.15.31:6800/168281188 14 ==== osd_op_reply(58 notify.7 [create] v30'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1884051070 con 0x7f1880017050 2024-09-22T08:36:46.457 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.441+0000 7f1892123800 1 -- 172.21.15.142:0/3579313285 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93923864068752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556c5a8dcca0 con 0x7f1880017050 2024-09-22T08:36:46.457 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.441+0000 7f1892123800 20 add_watcher() i=0 2024-09-22T08:36:46.457 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.441+0000 7f1892123800 20 add_watcher() i=1 2024-09-22T08:36:46.457 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.441+0000 7f1892123800 20 add_watcher() i=2 2024-09-22T08:36:46.457 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.441+0000 7f188d5ad640 1 -- 172.21.15.142:0/3579313285 <== osd.0 v2:172.21.15.31:6800/168281188 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93923864064096] v30'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1884051070 con 0x7f1880017050 2024-09-22T08:36:46.457 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.441+0000 7f1892123800 20 add_watcher() i=3 2024-09-22T08:36:46.457 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.441+0000 7f1892123800 20 add_watcher() i=4 2024-09-22T08:36:46.457 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.441+0000 7f1892123800 20 add_watcher() i=5 2024-09-22T08:36:46.458 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.441+0000 7f1892123800 20 add_watcher() i=6 2024-09-22T08:36:46.458 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.442+0000 7f188d5ad640 1 -- 172.21.15.142:0/3579313285 <== osd.0 v2:172.21.15.31:6800/168281188 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93923864068752] v30'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1884051070 con 0x7f1880017050 2024-09-22T08:36:46.458 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.442+0000 7f1892123800 20 add_watcher() i=7 2024-09-22T08:36:46.458 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.442+0000 7f1892123800 2 all 8 watchers are set, enabling cache 2024-09-22T08:36:46.458 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.442+0000 7f1892123800 1 -- 172.21.15.142:0/3579313285 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556c5a8dbc80 con 0x556c5a8cb4c0 2024-09-22T08:36:46.458 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.442+0000 7f188d5ad640 1 -- 172.21.15.142:0/3579313285 <== osd.1 v2:172.21.15.142:6816/3192108003 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f1884051070 con 0x556c5a8cb4c0 2024-09-22T08:36:46.458 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.442+0000 7f1892123800 1 -- 172.21.15.142:0/3579313285 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93923864069936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556c5a8dbc80 con 0x556c5a8cb4c0 2024-09-22T08:36:46.458 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.443+0000 7f188d5ad640 1 -- 172.21.15.142:0/3579313285 <== osd.1 v2:172.21.15.142:6816/3192108003 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93923864069936] v30'104 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1884051070 con 0x556c5a8cb4c0 2024-09-22T08:36:46.458 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.443+0000 7f173f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:36:46.458 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.444+0000 7f1892123800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:36:46.458 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.444+0000 7f1892123800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:36:46.458 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.444+0000 7f1892123800 5 note: GC not initialized 2024-09-22T08:36:46.458 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.444+0000 7f173e7fc640 20 reqs_thread_entry: start 2024-09-22T08:36:46.458 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.444+0000 7f1892123800 20 init_complete bucket index max shards: 11 2024-09-22T08:36:46.459 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.444+0000 7f1892123800 20 Filter name: none 2024-09-22T08:36:46.459 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.444+0000 7f16affff640 20 reqs_thread_entry: start 2024-09-22T08:36:46.459 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.444+0000 7f1892123800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-22T08:36:46.459 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.444+0000 7f1892123800 20 rados->read ofs=0 len=0 2024-09-22T08:36:46.459 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.444+0000 7f1892123800 1 -- 172.21.15.142:0/3579313285 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556c5a913160 con 0x556c5a8cb4c0 2024-09-22T08:36:46.459 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.445+0000 7f188d5ad640 1 -- 172.21.15.142:0/3579313285 <== osd.1 v2:172.21.15.142:6816/3192108003 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f1884051070 con 0x556c5a8cb4c0 2024-09-22T08:36:46.459 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.445+0000 7f1892123800 20 rados_obj.operate() r=0 bl.length=391 2024-09-22T08:36:46.459 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.445+0000 7f1892123800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-22T08:36:46.459 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.445+0000 7f1892123800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-22T08:36:46.459 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.445+0000 7f1892123800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:36:46.459 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.445+0000 7f1892123800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-22T08:36:46.459 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.445+0000 7f1892123800 20 rados->read ofs=0 len=0 2024-09-22T08:36:46.460 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.445+0000 7f1892123800 1 -- 172.21.15.142:0/3579313285 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556c5a915250 con 0x7f18880217c0 2024-09-22T08:36:46.460 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.445+0000 7f188ddae640 1 -- 172.21.15.142:0/3579313285 <== osd.2 v2:172.21.15.142:6808/279438927 11 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f188001ab20 con 0x7f18880217c0 2024-09-22T08:36:46.460 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.445+0000 7f1892123800 20 rados_obj.operate() r=0 bl.length=165 2024-09-22T08:36:46.460 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.445+0000 7f1892123800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-22T08:36:46.460 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.445+0000 7f1892123800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-22T08:36:46.460 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.445+0000 7f1892123800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1 : miss 2024-09-22T08:36:46.460 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.445+0000 7f1892123800 20 rados->read ofs=0 len=0 2024-09-22T08:36:46.460 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.445+0000 7f1892123800 1 -- 172.21.15.142:0/3579313285 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:64 8.15 8:ab67ca09:root::.bucket.meta.myfoo%3ae239248c-0bee-4e41-803a-24b288d3eb8f.4226.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556c5a916af0 con 0x556c5a8cfed0 2024-09-22T08:36:46.460 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.445+0000 7f188e5af640 1 -- 172.21.15.142:0/3579313285 <== osd.3 v2:172.21.15.142:6800/1064901393 16 ==== osd_op_reply(64 .bucket.meta.myfoo:e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7f188800a4d0 con 0x556c5a8cfed0 2024-09-22T08:36:46.460 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.445+0000 7f1892123800 20 rados_obj.operate() r=0 bl.length=387 2024-09-22T08:36:46.460 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.445+0000 7f1892123800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1 info.flags=0x17 2024-09-22T08:36:46.460 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.445+0000 7f1892123800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1 to cache LRU end 2024-09-22T08:36:46.460 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.445+0000 7f1892123800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:36:46.461 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.445+0000 7f1892123800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-22T08:36:46.461 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.445+0000 7f1892123800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1 2024-09-22T08:36:46.461 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.445+0000 7f1892123800 10 cache get: name=default.rgw.meta+users.uid+foo : hit (requested=0x13, cached=0x13) 2024-09-22T08:36:46.461 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.445+0000 7f1892123800 1 -- 172.21.15.142:0/3579313285 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:65 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556c5a919cf0 con 0x7f18880217c0 2024-09-22T08:36:46.461 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.446+0000 7f188ddae640 1 -- 172.21.15.142:0/3579313285 <== osd.2 v2:172.21.15.142:6808/279438927 12 ==== osd_op_reply(65 foo.buckets [call] v30'17 uv17 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f188001ab20 con 0x7f18880217c0 2024-09-22T08:36:46.461 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.446+0000 7f1892123800 10 cache get: name=default.rgw.meta+root+myfoo : type miss (requested=0x13, cached=0x11) 2024-09-22T08:36:46.461 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.446+0000 7f1892123800 20 rados->read ofs=0 len=0 2024-09-22T08:36:46.461 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.446+0000 7f1892123800 1 -- 172.21.15.142:0/3579313285 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:66 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556c5a918e60 con 0x7f18880217c0 2024-09-22T08:36:46.461 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.447+0000 7f188ddae640 1 -- 172.21.15.142:0/3579313285 <== osd.2 v2:172.21.15.142:6808/279438927 13 ==== osd_op_reply(66 myfoo [call out=48b,read 0~165 out=165b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 233+0+288 (crc 0 0 0) 0x7f188001ab20 con 0x7f18880217c0 2024-09-22T08:36:46.461 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.447+0000 7f1892123800 20 rados_obj.operate() r=0 bl.length=165 2024-09-22T08:36:46.461 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.447+0000 7f1892123800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x13 2024-09-22T08:36:46.461 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.447+0000 7f1892123800 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-22T08:36:46.461 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.447+0000 7f1892123800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:36:46.461 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.447+0000 7f1892123800 1 -- 172.21.15.142:0/3579313285 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:67 8.9 8:91b71841:root::myfoo:head [delete,create,call version.check_conds in=122b,call version.inc in=38b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556c5a919a80 con 0x7f18880217c0 2024-09-22T08:36:46.461 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.448+0000 7f188ddae640 1 -- 172.21.15.142:0/3579313285 <== osd.2 v2:172.21.15.142:6808/279438927 14 ==== osd_op_reply(67 myfoo [delete,create,call,call,writefull 0~165] v30'18 uv18 ondisk = 0) ==== 317+0+0 (crc 0 0 0) 0x7f188001ab20 con 0x7f18880217c0 2024-09-22T08:36:46.462 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.448+0000 7f1892123800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-09-22T08:36:46.462 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.448+0000 7f1892123800 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-22T08:36:46.462 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.448+0000 7f1892123800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-22T08:36:46.462 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.448+0000 7f1892123800 1 -- 172.21.15.142:0/3579313285 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:68 7.14 7:2b04a3e9:::notify.6:head [notify cookie 93923864319088 in=350b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556c5a91b5a0 con 0x7f1880017050 2024-09-22T08:36:46.462 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.448+0000 7f188d5ad640 1 -- 172.21.15.142:0/3579313285 <== osd.0 v2:172.21.15.31:6800/168281188 17 ==== watch-notify(notify (1) cookie 93923864064096 notify 128849018887 ret 0) ==== 380+0+0 (crc 0 0 0) 0x7f1884081040 con 0x7f1880017050 2024-09-22T08:36:46.462 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.448+0000 7f17717fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018887 cookie 93923864064096 notifier 4478 bl.length()=338 2024-09-22T08:36:46.462 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.448+0000 7f17717fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-09-22T08:36:46.462 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.448+0000 7f17717fa640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-22T08:36:46.462 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.448+0000 7f188d5ad640 1 -- 172.21.15.142:0/3579313285 <== osd.0 v2:172.21.15.31:6800/168281188 18 ==== osd_op_reply(68 notify.6 [notify cookie 93923864319088 out=8b] v0'0 uv105 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f1884051070 con 0x7f1880017050 2024-09-22T08:36:46.462 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.448+0000 7f17717fa640 1 -- 172.21.15.142:0/3579313285 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:69 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f1750003ea0 con 0x7f1880017050 2024-09-22T08:36:46.462 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.448+0000 7f188d5ad640 1 -- 172.21.15.142:0/3579313285 <== osd.0 v2:172.21.15.31:6800/168281188 19 ==== osd_op_reply(69 notify.6 [notify-ack] v0'0 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1884051070 con 0x7f1880017050 2024-09-22T08:36:46.462 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.449+0000 7f188d5ad640 1 -- 172.21.15.142:0/3579313285 <== osd.0 v2:172.21.15.31:6800/168281188 20 ==== watch-notify(notify_complete (2) cookie 93923864319088 notify 128849018887 ret 0) ==== 42+0+48 (crc 0 0 0) 0x556c5a7a1590 con 0x7f1880017050 2024-09-22T08:36:46.462 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.449+0000 7f173f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:36:46.462 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.449+0000 7f1892123800 1 -- 172.21.15.142:0/3579313285 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93923864069936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556c5a919a60 con 0x556c5a8cb4c0 2024-09-22T08:36:46.467 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.450+0000 7f188d5ad640 1 -- 172.21.15.142:0/3579313285 <== osd.1 v2:172.21.15.142:6816/3192108003 22 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 93923864069936] v30'105 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1884051070 con 0x556c5a8cb4c0 2024-09-22T08:36:46.467 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.450+0000 7f1892123800 1 -- 172.21.15.142:0/3579313285 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93923864045040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556c5a910e60 con 0x7f18880217c0 2024-09-22T08:36:46.467 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.451+0000 7f188ddae640 1 -- 172.21.15.142:0/3579313285 <== osd.2 v2:172.21.15.142:6808/279438927 15 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 93923864045040] v30'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f188001ab20 con 0x7f18880217c0 2024-09-22T08:36:46.467 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.451+0000 7f1892123800 20 remove_watcher() i=0 2024-09-22T08:36:46.467 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.451+0000 7f1892123800 2 removed watcher, disabling cache 2024-09-22T08:36:46.467 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.451+0000 7f1892123800 1 -- 172.21.15.142:0/3579313285 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93923864050480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556c5a919a60 con 0x556c5a8cb4c0 2024-09-22T08:36:46.467 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.452+0000 7f188d5ad640 1 -- 172.21.15.142:0/3579313285 <== osd.1 v2:172.21.15.142:6816/3192108003 23 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 93923864050480] v30'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1884051070 con 0x556c5a8cb4c0 2024-09-22T08:36:46.467 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.453+0000 7f1892123800 20 remove_watcher() i=1 2024-09-22T08:36:46.467 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.453+0000 7f1892123800 1 -- 172.21.15.142:0/3579313285 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93923864054032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556c5a910e60 con 0x556c5a8cfed0 2024-09-22T08:36:46.468 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.454+0000 7f188e5af640 1 -- 172.21.15.142:0/3579313285 <== osd.3 v2:172.21.15.142:6800/1064901393 17 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 93923864054032] v30'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f188800a4d0 con 0x556c5a8cfed0 2024-09-22T08:36:46.468 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.454+0000 7f1892123800 20 remove_watcher() i=2 2024-09-22T08:36:46.468 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.454+0000 7f1892123800 1 -- 172.21.15.142:0/3579313285 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93923864057824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556c5a919a60 con 0x7f18880217c0 2024-09-22T08:36:46.468 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.454+0000 7f188ddae640 1 -- 172.21.15.142:0/3579313285 <== osd.2 v2:172.21.15.142:6808/279438927 16 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 93923864057824] v30'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f188001ab20 con 0x7f18880217c0 2024-09-22T08:36:46.468 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.454+0000 7f1892123800 20 remove_watcher() i=3 2024-09-22T08:36:46.468 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.454+0000 7f1892123800 1 -- 172.21.15.142:0/3579313285 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93923864058880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556c5a910e60 con 0x556c5a8cb4c0 2024-09-22T08:36:46.468 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.455+0000 7f188d5ad640 1 -- 172.21.15.142:0/3579313285 <== osd.1 v2:172.21.15.142:6816/3192108003 24 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 93923864058880] v30'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1884051070 con 0x556c5a8cb4c0 2024-09-22T08:36:46.468 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.455+0000 7f1892123800 20 remove_watcher() i=4 2024-09-22T08:36:46.468 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.455+0000 7f1892123800 1 -- 172.21.15.142:0/3579313285 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93923864062080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556c5a919a60 con 0x7f1880017050 2024-09-22T08:36:46.468 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.456+0000 7f188d5ad640 1 -- 172.21.15.142:0/3579313285 <== osd.0 v2:172.21.15.31:6800/168281188 21 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 93923864062080] v30'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1884051070 con 0x7f1880017050 2024-09-22T08:36:46.468 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.456+0000 7f1892123800 20 remove_watcher() i=5 2024-09-22T08:36:46.468 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.456+0000 7f1892123800 1 -- 172.21.15.142:0/3579313285 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93923864064096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556c5a910e60 con 0x7f1880017050 2024-09-22T08:36:46.469 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.457+0000 7f188d5ad640 1 -- 172.21.15.142:0/3579313285 <== osd.0 v2:172.21.15.31:6800/168281188 22 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 93923864064096] v30'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1884051070 con 0x7f1880017050 2024-09-22T08:36:46.469 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.457+0000 7f1892123800 20 remove_watcher() i=6 2024-09-22T08:36:46.469 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.457+0000 7f1892123800 1 -- 172.21.15.142:0/3579313285 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93923864068752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556c5a910e60 con 0x7f1880017050 2024-09-22T08:36:46.469 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.458+0000 7f188d5ad640 1 -- 172.21.15.142:0/3579313285 <== osd.0 v2:172.21.15.31:6800/168281188 23 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 93923864068752] v30'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1884051070 con 0x7f1880017050 2024-09-22T08:36:46.469 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.458+0000 7f1892123800 20 remove_watcher() i=7 2024-09-22T08:36:46.469 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.458+0000 7f1892123800 1 -- 172.21.15.142:0/3579313285 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f1880017050 msgr2=0x7f188004b890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:46.469 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.458+0000 7f1892123800 1 --2- 172.21.15.142:0/3579313285 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f1880017050 0x7f188004b890 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:46.469 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.458+0000 7f1892123800 1 -- 172.21.15.142:0/3579313285 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x556c5a8cb4c0 msgr2=0x556c5a8cd980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:46.469 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.458+0000 7f1892123800 1 --2- 172.21.15.142:0/3579313285 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x556c5a8cb4c0 0x556c5a8cd980 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:46.469 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.458+0000 7f1892123800 1 -- 172.21.15.142:0/3579313285 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f18880217c0 msgr2=0x7f1888007050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:46.469 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.458+0000 7f1892123800 1 --2- 172.21.15.142:0/3579313285 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f18880217c0 0x7f1888007050 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:46.469 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.458+0000 7f1892123800 1 -- 172.21.15.142:0/3579313285 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x556c5a8cfed0 msgr2=0x556c5a8d22c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:46.469 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.458+0000 7f1892123800 1 --2- 172.21.15.142:0/3579313285 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x556c5a8cfed0 0x556c5a8d22c0 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:46.470 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.458+0000 7f1892123800 1 -- 172.21.15.142:0/3579313285 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f175803d000 msgr2=0x7f175803f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:46.470 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.458+0000 7f1892123800 1 --2- 172.21.15.142:0/3579313285 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f175803d000 0x7f175803f4c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f1880001250 tx=0x7f1880051000 comp rx=0 tx=0).stop 2024-09-22T08:36:46.470 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.458+0000 7f1892123800 1 -- 172.21.15.142:0/3579313285 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556c5a8b8600 msgr2=0x556c5a8bfbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:46.470 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.458+0000 7f188d5ad640 1 -- 172.21.15.142:0/3579313285 reap_dead start 2024-09-22T08:36:46.470 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.458+0000 7f1892123800 1 --2- 172.21.15.142:0/3579313285 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556c5a8b8600 0x556c5a8bfbb0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f188800afe0 tx=0x7f18880547b0 comp rx=0 tx=0).stop 2024-09-22T08:36:46.470 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.459+0000 7f1892123800 1 -- 172.21.15.142:0/3579313285 shutdown_connections 2024-09-22T08:36:46.470 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.459+0000 7f1892123800 1 --2- 172.21.15.142:0/3579313285 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556c5a8b8600 0x556c5a8bfbb0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:46.470 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.459+0000 7f1892123800 1 -- 172.21.15.142:0/3579313285 >> 172.21.15.142:0/3579313285 conn(0x556c5a8b4a00 msgr2=0x556c5a8b2c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:46.470 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.459+0000 7f1892123800 1 -- 172.21.15.142:0/3579313285 shutdown_connections 2024-09-22T08:36:46.470 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.459+0000 7f1892123800 1 -- 172.21.15.142:0/3579313285 wait complete. 2024-09-22T08:36:46.470 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.459+0000 7f1892123800 1 -- 172.21.15.142:0/2114369540 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f176803d000 msgr2=0x7f176803f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:46.470 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.459+0000 7f1892123800 1 --2- 172.21.15.142:0/2114369540 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f176803d000 0x7f176803f4c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x556c5a892c90 tx=0x7f18800529c0 comp rx=0 tx=0).stop 2024-09-22T08:36:46.471 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.459+0000 7f1892123800 1 -- 172.21.15.142:0/2114369540 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556c5a8abb80 msgr2=0x556c5a8abfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:46.471 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.459+0000 7f1892123800 1 --2- 172.21.15.142:0/2114369540 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556c5a8abb80 0x556c5a8abfa0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x556c5a891a20 tx=0x7f18880167b0 comp rx=0 tx=0).stop 2024-09-22T08:36:46.471 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.459+0000 7f1892123800 1 -- 172.21.15.142:0/2114369540 shutdown_connections 2024-09-22T08:36:46.471 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.459+0000 7f1892123800 1 --2- 172.21.15.142:0/2114369540 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f176803d000 0x7f176803f4c0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:46.471 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.459+0000 7f1892123800 1 --2- 172.21.15.142:0/2114369540 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556c5a8abb80 0x556c5a8abfa0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:46.471 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.459+0000 7f1892123800 1 -- 172.21.15.142:0/2114369540 >> 172.21.15.142:0/2114369540 conn(0x556c5a89ff30 msgr2=0x556c5a8a0310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:46.471 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.459+0000 7f1892123800 1 -- 172.21.15.142:0/2114369540 shutdown_connections 2024-09-22T08:36:46.471 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.459+0000 7f1892123800 1 -- 172.21.15.142:0/2114369540 wait complete. 2024-09-22T08:36:46.471 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.459+0000 7f1892123800 1 -- 172.21.15.142:0/915207167 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x556c5a797fe0 msgr2=0x556c5a8981e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:46.471 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.459+0000 7f1892123800 1 --2- 172.21.15.142:0/915207167 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x556c5a797fe0 0x556c5a8981e0 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:46.471 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.459+0000 7f1892123800 1 -- 172.21.15.142:0/915207167 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x556c5a89a580 msgr2=0x556c5a89ca20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:46.471 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.459+0000 7f1892123800 1 --2- 172.21.15.142:0/915207167 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x556c5a89a580 0x556c5a89ca20 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:46.471 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.459+0000 7f1892123800 1 -- 172.21.15.142:0/915207167 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f177403cfb0 msgr2=0x7f177403f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:46.472 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.459+0000 7f1892123800 1 --2- 172.21.15.142:0/915207167 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f177403cfb0 0x7f177403f470 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f1884057000 tx=0x7f1884052000 comp rx=0 tx=0).stop 2024-09-22T08:36:46.472 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.459+0000 7f1892123800 1 -- 172.21.15.142:0/915207167 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556c5a797be0 msgr2=0x556c5a890b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:46.472 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.459+0000 7f1892123800 1 --2- 172.21.15.142:0/915207167 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556c5a797be0 0x556c5a890b90 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f188000c010 tx=0x7f1880000ed0 comp rx=0 tx=0).stop 2024-09-22T08:36:46.472 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.459+0000 7f1892123800 1 -- 172.21.15.142:0/915207167 shutdown_connections 2024-09-22T08:36:46.472 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.459+0000 7f1892123800 1 --2- 172.21.15.142:0/915207167 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x556c5a89a580 0x556c5a89ca20 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:46.472 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.459+0000 7f1892123800 1 --2- 172.21.15.142:0/915207167 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x556c5a797fe0 0x556c5a8981e0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:46.472 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.459+0000 7f1892123800 1 --2- 172.21.15.142:0/915207167 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f177403cfb0 0x7f177403f470 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:46.472 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.459+0000 7f1892123800 1 --2- 172.21.15.142:0/915207167 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556c5a797be0 0x556c5a890b90 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:46.472 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.459+0000 7f1892123800 1 -- 172.21.15.142:0/915207167 >> 172.21.15.142:0/915207167 conn(0x556c5a793310 msgr2=0x556c5a88a510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:46.472 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.460+0000 7f1892123800 1 -- 172.21.15.142:0/915207167 shutdown_connections 2024-09-22T08:36:46.472 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.460+0000 7f1892123800 1 -- 172.21.15.142:0/915207167 wait complete. 2024-09-22T08:36:46.473 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-09-22T08:36:46.473 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-09-22T08:36:46.474 DEBUG:teuthology.orchestra.run.smithi142:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid fud --display-name Fud --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh --max-buckets 1 2024-09-22T08:36:46.526 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:36:46.526 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:36:46.527 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.525+0000 7f8775d75800 1 Processor -- start 2024-09-22T08:36:46.527 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.525+0000 7f8775d75800 1 -- start start 2024-09-22T08:36:46.528 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.525+0000 7f8775d75800 1 --2- >> v2:172.21.15.31:3300/0 conn(0x559508f510d0 0x559508f534c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:46.528 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.526+0000 7f8775d75800 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x559508ddba20 con 0x559508f53a00 2024-09-22T08:36:46.528 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.526+0000 7f8775d75800 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x559508ddb7d0 con 0x559508f510d0 2024-09-22T08:36:46.528 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.526+0000 7f877385f640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x559508f510d0 0x559508f534c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:46.528 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.526+0000 7f877385f640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x559508f510d0 0x559508f534c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:39390/0 (socket says 172.21.15.142:39390) 2024-09-22T08:36:46.528 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.526+0000 7f877385f640 1 -- 172.21.15.142:0/3742688040 learned_addr learned my addr 172.21.15.142:0/3742688040 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:46.528 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.526+0000 7f877305e640 1 --1- 172.21.15.142:0/3742688040 >> v1:172.21.15.31:6789/0 conn(0x559508f53a00 0x559508f55df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.142:42536/0 (socket says 172.21.15.142:42536) 2024-09-22T08:36:46.528 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.526+0000 7f877385f640 1 -- 172.21.15.142:0/3742688040 >> v1:172.21.15.31:6789/0 conn(0x559508f53a00 legacy=0x559508f55df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:46.528 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.526+0000 7f877385f640 1 -- 172.21.15.142:0/3742688040 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x559508f585b0 con 0x559508f510d0 2024-09-22T08:36:46.529 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.528+0000 7f877385f640 1 --2- 172.21.15.142:0/3742688040 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559508f510d0 0x559508f534c0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f876400a520 tx=0x7f8764045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=695fe5e1085c4a5f server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:46.529 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.528+0000 7f877285d640 1 -- 172.21.15.142:0/3742688040 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8764055070 con 0x559508f510d0 2024-09-22T08:36:46.529 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.528+0000 7f877285d640 1 -- 172.21.15.142:0/3742688040 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87640515b0 con 0x559508f510d0 2024-09-22T08:36:46.529 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.528+0000 7f877285d640 1 -- 172.21.15.142:0/3742688040 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f87640518d0 con 0x559508f510d0 2024-09-22T08:36:46.530 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.529+0000 7f8775d75800 1 -- 172.21.15.142:0/3742688040 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559508f510d0 msgr2=0x559508f534c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:46.530 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.529+0000 7f8775d75800 1 --2- 172.21.15.142:0/3742688040 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559508f510d0 0x559508f534c0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f876400a520 tx=0x7f8764045ba0 comp rx=0 tx=0).stop 2024-09-22T08:36:46.530 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.529+0000 7f8775d75800 1 -- 172.21.15.142:0/3742688040 shutdown_connections 2024-09-22T08:36:46.531 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.529+0000 7f8775d75800 1 --2- 172.21.15.142:0/3742688040 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559508f510d0 0x559508f534c0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:46.531 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.529+0000 7f8775d75800 1 -- 172.21.15.142:0/3742688040 >> 172.21.15.142:0/3742688040 conn(0x559508f4abf0 msgr2=0x559508f4d050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:46.531 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.529+0000 7f8775d75800 1 -- 172.21.15.142:0/3742688040 shutdown_connections 2024-09-22T08:36:46.531 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.529+0000 7f8775d75800 1 -- 172.21.15.142:0/3742688040 wait complete. 2024-09-22T08:36:46.544 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.542+0000 7f8775d75800 1 Processor -- start 2024-09-22T08:36:46.544 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.542+0000 7f8775d75800 1 -- start start 2024-09-22T08:36:46.544 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.543+0000 7f8775d75800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559508f510d0 0x559508f50860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:46.544 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.543+0000 7f8775d75800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x559508de8dd0 con 0x559508f510d0 2024-09-22T08:36:46.544 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.543+0000 7f877385f640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559508f510d0 0x559508f50860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:46.544 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.543+0000 7f877385f640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559508f510d0 0x559508f50860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:39392/0 (socket says 172.21.15.142:39392) 2024-09-22T08:36:46.545 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.543+0000 7f877385f640 1 -- 172.21.15.142:0/108362355 learned_addr learned my addr 172.21.15.142:0/108362355 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:46.545 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.543+0000 7f877385f640 1 -- 172.21.15.142:0/108362355 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559508f50e50 con 0x559508f510d0 2024-09-22T08:36:46.547 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.543+0000 7f877385f640 1 --2- 172.21.15.142:0/108362355 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559508f510d0 0x559508f50860 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f8764025da0 tx=0x7f8764051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c54593732093d315 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:46.547 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.544+0000 7f8661e0b640 1 -- 172.21.15.142:0/108362355 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8764051ac0 con 0x559508f510d0 2024-09-22T08:36:46.547 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.544+0000 7f8661e0b640 1 -- 172.21.15.142:0/108362355 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8764051c60 con 0x559508f510d0 2024-09-22T08:36:46.547 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.544+0000 7f8661e0b640 1 -- 172.21.15.142:0/108362355 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f876405a450 con 0x559508f510d0 2024-09-22T08:36:46.547 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.544+0000 7f8775d75800 1 -- 172.21.15.142:0/108362355 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559508f510d0 msgr2=0x559508f50860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:46.547 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.544+0000 7f8775d75800 1 --2- 172.21.15.142:0/108362355 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559508f510d0 0x559508f50860 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f8764025da0 tx=0x7f8764051000 comp rx=0 tx=0).stop 2024-09-22T08:36:46.547 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.544+0000 7f8775d75800 1 -- 172.21.15.142:0/108362355 shutdown_connections 2024-09-22T08:36:46.547 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.544+0000 7f8775d75800 1 --2- 172.21.15.142:0/108362355 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559508f510d0 0x559508f50860 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:46.547 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.544+0000 7f8775d75800 1 -- 172.21.15.142:0/108362355 >> 172.21.15.142:0/108362355 conn(0x559508f4abf0 msgr2=0x55950903bac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:46.548 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.544+0000 7f8775d75800 1 -- 172.21.15.142:0/108362355 shutdown_connections 2024-09-22T08:36:46.548 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.544+0000 7f8775d75800 1 -- 172.21.15.142:0/108362355 wait complete. 2024-09-22T08:36:46.548 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.545+0000 7f8775d75800 1 Processor -- start 2024-09-22T08:36:46.548 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.545+0000 7f8775d75800 1 -- start start 2024-09-22T08:36:46.548 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.545+0000 7f8775d75800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559508f510d0 0x559509049ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:46.548 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.545+0000 7f8775d75800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x559508f578a0 con 0x559508f510d0 2024-09-22T08:36:46.548 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.545+0000 7f877385f640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559508f510d0 0x559509049ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:46.548 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.545+0000 7f877385f640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559508f510d0 0x559509049ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:39394/0 (socket says 172.21.15.142:39394) 2024-09-22T08:36:46.548 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.545+0000 7f877385f640 1 -- 172.21.15.142:0/3970677039 learned_addr learned my addr 172.21.15.142:0/3970677039 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:46.548 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.545+0000 7f877385f640 1 -- 172.21.15.142:0/3970677039 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55950904a240 con 0x559508f510d0 2024-09-22T08:36:46.548 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.545+0000 7f877385f640 1 --2- 172.21.15.142:0/3970677039 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559508f510d0 0x559509049ce0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f8764067040 tx=0x7f8764002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:46.548 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.546+0000 7f865bfff640 1 -- 172.21.15.142:0/3970677039 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8764073070 con 0x559508f510d0 2024-09-22T08:36:46.549 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.546+0000 7f865bfff640 1 -- 172.21.15.142:0/3970677039 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f876405a600 con 0x559508f510d0 2024-09-22T08:36:46.549 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.546+0000 7f8775d75800 1 -- 172.21.15.142:0/3970677039 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55950904a4d0 con 0x559508f510d0 2024-09-22T08:36:46.549 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.546+0000 7f865bfff640 1 -- 172.21.15.142:0/3970677039 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f876405a8e0 con 0x559508f510d0 2024-09-22T08:36:46.549 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.546+0000 7f8775d75800 1 -- 172.21.15.142:0/3970677039 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55950904b0e0 con 0x559508f510d0 2024-09-22T08:36:46.552 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.547+0000 7f865bfff640 1 -- 172.21.15.142:0/3970677039 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f8764076070 con 0x559508f510d0 2024-09-22T08:36:46.552 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.547+0000 7f865bfff640 1 --2- 172.21.15.142:0/3970677039 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f865c03d000 0x7f865c03f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:46.552 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.547+0000 7f865bfff640 1 -- 172.21.15.142:0/3970677039 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f8764062070 con 0x559508f510d0 2024-09-22T08:36:46.552 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.547+0000 7f877305e640 1 --2- 172.21.15.142:0/3970677039 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f865c03d000 0x7f865c03f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:46.552 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.547+0000 7f8775d75800 1 --2- 172.21.15.142:0/3970677039 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x559508f53a00 0x559509051330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:46.553 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.547+0000 7f8775d75800 1 -- 172.21.15.142:0/3970677039 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559509051870 con 0x559508f53a00 2024-09-22T08:36:46.553 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.547+0000 7f8774060640 1 --2- 172.21.15.142:0/3970677039 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x559508f53a00 0x559509051330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:46.553 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.547+0000 7f877305e640 1 --2- 172.21.15.142:0/3970677039 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f865c03d000 0x7f865c03f4c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f8768001e30 tx=0x7f8768001390 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:46.553 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.547+0000 7f8774060640 1 --2- 172.21.15.142:0/3970677039 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x559508f53a00 0x559509051330 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:46.553 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.548+0000 7f8774060640 1 -- 172.21.15.142:0/3970677039 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f876c00a4d0 con 0x559508f53a00 2024-09-22T08:36:46.553 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.548+0000 7f8775d75800 1 -- 172.21.15.142:0/3970677039 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559509051c10 con 0x559508f53a00 2024-09-22T08:36:46.553 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.548+0000 7f8774060640 1 -- 172.21.15.142:0/3970677039 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f876c00a4d0 con 0x559508f53a00 2024-09-22T08:36:46.553 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.548+0000 7f8775d75800 1 --2- 172.21.15.142:0/3970677039 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x559509053750 0x559509055bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:46.553 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.548+0000 7f8775d75800 1 -- 172.21.15.142:0/3970677039 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:3 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559509056380 con 0x559509053750 2024-09-22T08:36:46.553 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.548+0000 7f877385f640 1 --2- 172.21.15.142:0/3970677039 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x559509053750 0x559509055bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:46.553 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.548+0000 7f877385f640 1 --2- 172.21.15.142:0/3970677039 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x559509053750 0x559509055bf0 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:46.553 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.549+0000 7f877385f640 1 -- 172.21.15.142:0/3970677039 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(3 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f876407f070 con 0x559509053750 2024-09-22T08:36:46.553 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.549+0000 7f8775d75800 1 -- 172.21.15.142:0/3970677039 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559509052460 con 0x559508f53a00 2024-09-22T08:36:46.554 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.549+0000 7f8774060640 1 -- 172.21.15.142:0/3970677039 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f876c00a4d0 con 0x559508f53a00 2024-09-22T08:36:46.554 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.549+0000 7f8775d75800 1 -- 172.21.15.142:0/3970677039 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5595090528c0 con 0x559509053750 2024-09-22T08:36:46.554 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.549+0000 7f877385f640 1 -- 172.21.15.142:0/3970677039 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(5 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f876407f070 con 0x559509053750 2024-09-22T08:36:46.554 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.549+0000 7f8775d75800 1 Processor -- start 2024-09-22T08:36:46.554 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.549+0000 7f8775d75800 1 -- start start 2024-09-22T08:36:46.554 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.550+0000 7f8775d75800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559509064d40 0x559509065160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:46.554 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.550+0000 7f8775d75800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x559508e47d50 con 0x559509064d40 2024-09-22T08:36:46.554 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.550+0000 7f8774060640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559509064d40 0x559509065160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:46.554 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.550+0000 7f8774060640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559509064d40 0x559509065160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:39396/0 (socket says 172.21.15.142:39396) 2024-09-22T08:36:46.554 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.550+0000 7f8774060640 1 -- 172.21.15.142:0/111531029 learned_addr learned my addr 172.21.15.142:0/111531029 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:46.554 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.550+0000 7f8774060640 1 -- 172.21.15.142:0/111531029 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5595090657a0 con 0x559509064d40 2024-09-22T08:36:46.554 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.550+0000 7f8774060640 1 --2- 172.21.15.142:0/111531029 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559509064d40 0x559509065160 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x55950904ace0 tx=0x7f876c0167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:46.554 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.551+0000 7f86597fa640 1 -- 172.21.15.142:0/111531029 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f876c013640 con 0x559509064d40 2024-09-22T08:36:46.555 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.551+0000 7f86597fa640 1 -- 172.21.15.142:0/111531029 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f876c0137e0 con 0x559509064d40 2024-09-22T08:36:46.555 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.551+0000 7f8775d75800 1 -- 172.21.15.142:0/111531029 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559509065fd0 con 0x559509064d40 2024-09-22T08:36:46.555 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.551+0000 7f86597fa640 1 -- 172.21.15.142:0/111531029 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f876c013ae0 con 0x559509064d40 2024-09-22T08:36:46.555 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.551+0000 7f8775d75800 1 -- 172.21.15.142:0/111531029 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559509066570 con 0x559509064d40 2024-09-22T08:36:46.561 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.551+0000 7f86597fa640 1 -- 172.21.15.142:0/111531029 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f876c011040 con 0x559509064d40 2024-09-22T08:36:46.562 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.552+0000 7f86597fa640 1 --2- 172.21.15.142:0/111531029 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f864c03d000 0x7f864c03f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:46.562 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.552+0000 7f86597fa640 1 -- 172.21.15.142:0/111531029 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f876c00e040 con 0x559509064d40 2024-09-22T08:36:46.562 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.552+0000 7f877385f640 1 --2- 172.21.15.142:0/111531029 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f864c03d000 0x7f864c03f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:46.562 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.552+0000 7f8775d75800 1 Processor -- start 2024-09-22T08:36:46.562 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.552+0000 7f877385f640 1 --2- 172.21.15.142:0/111531029 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f864c03d000 0x7f864c03f4c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f8764076750 tx=0x7f8764008330 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:46.562 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.552+0000 7f8775d75800 1 -- start start 2024-09-22T08:36:46.562 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.552+0000 7f8775d75800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5595090717c0 0x559509071bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:46.562 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.552+0000 7f8775d75800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x559508f4f1f0 con 0x5595090717c0 2024-09-22T08:36:46.562 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.553+0000 7f8774060640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5595090717c0 0x559509071bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:46.562 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.553+0000 7f8774060640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5595090717c0 0x559509071bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:39406/0 (socket says 172.21.15.142:39406) 2024-09-22T08:36:46.562 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.553+0000 7f8774060640 1 -- 172.21.15.142:0/3593382872 learned_addr learned my addr 172.21.15.142:0/3593382872 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:46.563 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.553+0000 7f8774060640 1 -- 172.21.15.142:0/3593382872 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559509072190 con 0x5595090717c0 2024-09-22T08:36:46.563 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.553+0000 7f8774060640 1 --2- 172.21.15.142:0/3593382872 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5595090717c0 0x559509071bc0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f876c016cd0 tx=0x7f876c01fc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81c71e6de82324d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:46.563 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.553+0000 7f8652ffd640 1 -- 172.21.15.142:0/3593382872 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f876c02ade0 con 0x5595090717c0 2024-09-22T08:36:46.563 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.553+0000 7f8652ffd640 1 -- 172.21.15.142:0/3593382872 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f876c052070 con 0x5595090717c0 2024-09-22T08:36:46.563 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.553+0000 7f8652ffd640 1 -- 172.21.15.142:0/3593382872 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f876c021910 con 0x5595090717c0 2024-09-22T08:36:46.565 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.553+0000 7f8775d75800 1 -- 172.21.15.142:0/3593382872 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5595090717c0 msgr2=0x559509071bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:46.565 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.553+0000 7f8775d75800 1 --2- 172.21.15.142:0/3593382872 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5595090717c0 0x559509071bc0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f876c016cd0 tx=0x7f876c01fc90 comp rx=0 tx=0).stop 2024-09-22T08:36:46.565 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.553+0000 7f8775d75800 1 -- 172.21.15.142:0/3593382872 shutdown_connections 2024-09-22T08:36:46.565 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.553+0000 7f8775d75800 1 --2- 172.21.15.142:0/3593382872 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5595090717c0 0x559509071bc0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:46.566 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.553+0000 7f8775d75800 1 -- 172.21.15.142:0/3593382872 >> 172.21.15.142:0/3593382872 conn(0x55950906dbe0 msgr2=0x55950906be20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:46.566 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.554+0000 7f8775d75800 1 -- 172.21.15.142:0/3593382872 shutdown_connections 2024-09-22T08:36:46.566 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.554+0000 7f8775d75800 1 -- 172.21.15.142:0/3593382872 wait complete. 2024-09-22T08:36:46.566 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.554+0000 7f8775d75800 1 Processor -- start 2024-09-22T08:36:46.566 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.554+0000 7f8775d75800 1 -- start start 2024-09-22T08:36:46.566 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.554+0000 7f8775d75800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5595090717c0 0x559509078d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:46.566 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.554+0000 7f8775d75800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5595090727a0 con 0x5595090717c0 2024-09-22T08:36:46.566 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.554+0000 7f8774060640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5595090717c0 0x559509078d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:46.566 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.554+0000 7f8774060640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5595090717c0 0x559509078d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:39412/0 (socket says 172.21.15.142:39412) 2024-09-22T08:36:46.566 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.554+0000 7f8774060640 1 -- 172.21.15.142:0/1600417673 learned_addr learned my addr 172.21.15.142:0/1600417673 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:46.566 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.554+0000 7f8774060640 1 -- 172.21.15.142:0/1600417673 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5595090792a0 con 0x5595090717c0 2024-09-22T08:36:46.566 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.555+0000 7f8774060640 1 --2- 172.21.15.142:0/1600417673 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5595090717c0 0x559509078d40 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f876c020560 tx=0x7f876c054790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:46.567 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.555+0000 7f86517fa640 1 -- 172.21.15.142:0/1600417673 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f876c01f340 con 0x5595090717c0 2024-09-22T08:36:46.567 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.555+0000 7f86517fa640 1 -- 172.21.15.142:0/1600417673 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f876c021910 con 0x5595090717c0 2024-09-22T08:36:46.567 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.555+0000 7f8775d75800 1 -- 172.21.15.142:0/1600417673 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559509079530 con 0x5595090717c0 2024-09-22T08:36:46.567 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.555+0000 7f86517fa640 1 -- 172.21.15.142:0/1600417673 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f876c01f4e0 con 0x5595090717c0 2024-09-22T08:36:46.567 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.555+0000 7f8775d75800 1 -- 172.21.15.142:0/1600417673 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559509079530 con 0x5595090717c0 2024-09-22T08:36:46.567 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.556+0000 7f86517fa640 1 -- 172.21.15.142:0/1600417673 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f876c053270 con 0x5595090717c0 2024-09-22T08:36:46.567 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.556+0000 7f86517fa640 1 --2- 172.21.15.142:0/1600417673 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f863c03cfb0 0x7f863c03f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:46.567 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.556+0000 7f86517fa640 1 -- 172.21.15.142:0/1600417673 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f876c04d050 con 0x5595090717c0 2024-09-22T08:36:46.567 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.556+0000 7f877385f640 1 --2- 172.21.15.142:0/1600417673 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f863c03cfb0 0x7f863c03f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:46.567 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.556+0000 7f877385f640 1 --2- 172.21.15.142:0/1600417673 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f863c03cfb0 0x7f863c03f470 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f87640514a0 tx=0x7f8764084420 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:46.567 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.557+0000 7f8775d75800 20 rados->read ofs=0 len=0 2024-09-22T08:36:46.567 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.557+0000 7f8775d75800 1 --2- 172.21.15.142:0/1600417673 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x559509084580 0x559509086a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:46.568 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.557+0000 7f8775d75800 1 -- 172.21.15.142:0/1600417673 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559509087190 con 0x559509084580 2024-09-22T08:36:46.568 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.557+0000 7f877305e640 1 --2- 172.21.15.142:0/1600417673 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x559509084580 0x559509086a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:46.568 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.557+0000 7f877305e640 1 --2- 172.21.15.142:0/1600417673 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x559509084580 0x559509086a40 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:46.568 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.557+0000 7f877305e640 1 -- 172.21.15.142:0/1600417673 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f876800f610 con 0x559509084580 2024-09-22T08:36:46.568 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.557+0000 7f8775d75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:46.568 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.557+0000 7f8775d75800 20 realm 2024-09-22T08:36:46.568 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.557+0000 7f8775d75800 20 rados->read ofs=0 len=0 2024-09-22T08:36:46.568 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.557+0000 7f8775d75800 1 -- 172.21.15.142:0/1600417673 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5595090838d0 con 0x559509084580 2024-09-22T08:36:46.568 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.557+0000 7f877305e640 1 -- 172.21.15.142:0/1600417673 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f876800f610 con 0x559509084580 2024-09-22T08:36:46.568 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.557+0000 7f8775d75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:46.568 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.557+0000 7f8775d75800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:36:46.568 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.558+0000 7f8775d75800 20 rados->read ofs=0 len=0 2024-09-22T08:36:46.568 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.558+0000 7f8775d75800 1 -- 172.21.15.142:0/1600417673 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559509087c80 con 0x559509084580 2024-09-22T08:36:46.568 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.558+0000 7f877305e640 1 -- 172.21.15.142:0/1600417673 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f876800f610 con 0x559509084580 2024-09-22T08:36:46.569 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.558+0000 7f8775d75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:46.569 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.558+0000 7f8775d75800 20 rados->read ofs=0 len=0 2024-09-22T08:36:46.569 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.558+0000 7f8775d75800 1 -- 172.21.15.142:0/1600417673 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559509088550 con 0x559509084580 2024-09-22T08:36:46.569 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.558+0000 7f877305e640 1 -- 172.21.15.142:0/1600417673 <== osd.1 v2:172.21.15.142:6816/3192108003 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f876800f610 con 0x559509084580 2024-09-22T08:36:46.569 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.558+0000 7f8775d75800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:36:46.569 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.558+0000 7f8775d75800 20 rados->read ofs=0 len=0 2024-09-22T08:36:46.569 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.558+0000 7f8775d75800 1 --2- 172.21.15.142:0/1600417673 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x559509088f70 0x55950908b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:46.569 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.558+0000 7f8775d75800 1 -- 172.21.15.142:0/1600417673 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55950908baa0 con 0x559509088f70 2024-09-22T08:36:46.569 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.558+0000 7f8774060640 1 --2- 172.21.15.142:0/1600417673 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x559509088f70 0x55950908b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:46.569 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.558+0000 7f8774060640 1 --2- 172.21.15.142:0/1600417673 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x559509088f70 0x55950908b360 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:46.569 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.559+0000 7f8774060640 1 -- 172.21.15.142:0/1600417673 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(5 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f876c03a070 con 0x559509088f70 2024-09-22T08:36:46.570 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.559+0000 7f8775d75800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:36:46.570 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.559+0000 7f8775d75800 20 searching for the correct realm 2024-09-22T08:36:46.570 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.559+0000 7f8775d75800 1 -- 172.21.15.142:0/1600417673 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55950908d3d0 con 0x559509088f70 2024-09-22T08:36:46.570 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.559+0000 7f8774060640 1 -- 172.21.15.142:0/1600417673 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f876c03a070 con 0x559509088f70 2024-09-22T08:36:46.570 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.559+0000 7f8774060640 1 --2- 172.21.15.142:0/1600417673 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f876c0145e0 0x7f876c0459d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:46.570 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.559+0000 7f8774060640 1 -- 172.21.15.142:0/1600417673 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55950908d3d0 con 0x7f876c0145e0 2024-09-22T08:36:46.570 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.559+0000 7f877385f640 1 --2- 172.21.15.142:0/1600417673 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f876c0145e0 0x7f876c0459d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:46.570 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.559+0000 7f877385f640 1 --2- 172.21.15.142:0/1600417673 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f876c0145e0 0x7f876c0459d0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:46.570 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.560+0000 7f877385f640 1 -- 172.21.15.142:0/1600417673 <== osd.2 v2:172.21.15.142:6808/279438927 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8764087050 con 0x7f876c0145e0 2024-09-22T08:36:46.570 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.560+0000 7f877385f640 1 --2- 172.21.15.142:0/1600417673 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f87640a5040 0x7f8764095280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:46.570 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.560+0000 7f877385f640 1 -- 172.21.15.142:0/1600417673 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55950908d3d0 con 0x7f87640a5040 2024-09-22T08:36:46.570 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.560+0000 7f877305e640 1 --2- 172.21.15.142:0/1600417673 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f87640a5040 0x7f8764095280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:46.570 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.561+0000 7f877305e640 1 --2- 172.21.15.142:0/1600417673 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f87640a5040 0x7f8764095280 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:46.581 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.561+0000 7f877305e640 1 -- 172.21.15.142:0/1600417673 <== osd.0 v2:172.21.15.31:6800/168281188 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f876800f610 con 0x7f87640a5040 2024-09-22T08:36:46.582 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.561+0000 7f877305e640 1 -- 172.21.15.142:0/1600417673 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55950908d3d0 con 0x559509084580 2024-09-22T08:36:46.582 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.561+0000 7f877305e640 1 -- 172.21.15.142:0/1600417673 <== osd.1 v2:172.21.15.142:6816/3192108003 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f876800f610 con 0x559509084580 2024-09-22T08:36:46.582 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.561+0000 7f877305e640 1 -- 172.21.15.142:0/1600417673 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55950908d3d0 con 0x559509084580 2024-09-22T08:36:46.582 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.561+0000 7f877305e640 1 -- 172.21.15.142:0/1600417673 <== osd.1 v2:172.21.15.142:6816/3192108003 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f876802b040 con 0x559509084580 2024-09-22T08:36:46.582 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.561+0000 7f877305e640 1 -- 172.21.15.142:0/1600417673 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55950908d3d0 con 0x7f87640a5040 2024-09-22T08:36:46.582 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.562+0000 7f877305e640 1 -- 172.21.15.142:0/1600417673 <== osd.0 v2:172.21.15.31:6800/168281188 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f876802b040 con 0x7f87640a5040 2024-09-22T08:36:46.582 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.562+0000 7f877305e640 1 -- 172.21.15.142:0/1600417673 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55950908d3d0 con 0x7f87640a5040 2024-09-22T08:36:46.582 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.562+0000 7f877305e640 1 -- 172.21.15.142:0/1600417673 <== osd.0 v2:172.21.15.31:6800/168281188 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f876802b040 con 0x7f87640a5040 2024-09-22T08:36:46.582 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.562+0000 7f877305e640 1 -- 172.21.15.142:0/1600417673 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55950908d3d0 con 0x7f876c0145e0 2024-09-22T08:36:46.582 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.562+0000 7f877385f640 1 -- 172.21.15.142:0/1600417673 <== osd.2 v2:172.21.15.142:6808/279438927 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8764087050 con 0x7f876c0145e0 2024-09-22T08:36:46.582 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.562+0000 7f877385f640 1 -- 172.21.15.142:0/1600417673 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55950908d3d0 con 0x559509088f70 2024-09-22T08:36:46.582 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.562+0000 7f8774060640 1 -- 172.21.15.142:0/1600417673 <== osd.3 v2:172.21.15.142:6800/1064901393 3 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f876c03a070 con 0x559509088f70 2024-09-22T08:36:46.583 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.562+0000 7f8774060640 1 -- 172.21.15.142:0/1600417673 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55950908d3d0 con 0x559509084580 2024-09-22T08:36:46.583 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.562+0000 7f877305e640 1 -- 172.21.15.142:0/1600417673 <== osd.1 v2:172.21.15.142:6816/3192108003 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f876802b040 con 0x559509084580 2024-09-22T08:36:46.583 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.562+0000 7f877305e640 1 -- 172.21.15.142:0/1600417673 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55950908d3d0 con 0x7f87640a5040 2024-09-22T08:36:46.583 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.563+0000 7f877305e640 1 -- 172.21.15.142:0/1600417673 <== osd.0 v2:172.21.15.31:6800/168281188 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f876802b040 con 0x7f87640a5040 2024-09-22T08:36:46.583 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.563+0000 7f877305e640 1 -- 172.21.15.142:0/1600417673 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55950908d3d0 con 0x559509084580 2024-09-22T08:36:46.583 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.563+0000 7f877305e640 1 -- 172.21.15.142:0/1600417673 <== osd.1 v2:172.21.15.142:6816/3192108003 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f876802b040 con 0x559509084580 2024-09-22T08:36:46.583 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.563+0000 7f877305e640 1 -- 172.21.15.142:0/1600417673 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55950908d3d0 con 0x7f876c0145e0 2024-09-22T08:36:46.583 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.563+0000 7f877385f640 1 -- 172.21.15.142:0/1600417673 <== osd.2 v2:172.21.15.142:6808/279438927 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f8764087050 con 0x7f876c0145e0 2024-09-22T08:36:46.583 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.563+0000 7f877385f640 1 -- 172.21.15.142:0/1600417673 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55950908d3d0 con 0x559509088f70 2024-09-22T08:36:46.583 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.563+0000 7f8774060640 1 -- 172.21.15.142:0/1600417673 <== osd.3 v2:172.21.15.142:6800/1064901393 4 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f876c03a070 con 0x559509088f70 2024-09-22T08:36:46.583 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.563+0000 7f8774060640 1 -- 172.21.15.142:0/1600417673 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55950908d3d0 con 0x559509088f70 2024-09-22T08:36:46.583 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.563+0000 7f8774060640 1 -- 172.21.15.142:0/1600417673 <== osd.3 v2:172.21.15.142:6800/1064901393 5 ==== osd_op_reply(20 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f876c03a070 con 0x559509088f70 2024-09-22T08:36:46.583 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.563+0000 7f8774060640 1 -- 172.21.15.142:0/1600417673 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55950908d3d0 con 0x7f87640a5040 2024-09-22T08:36:46.583 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.564+0000 7f877305e640 1 -- 172.21.15.142:0/1600417673 <== osd.0 v2:172.21.15.31:6800/168281188 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f876802b040 con 0x7f87640a5040 2024-09-22T08:36:46.584 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.564+0000 7f877305e640 1 -- 172.21.15.142:0/1600417673 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55950908d3d0 con 0x559509088f70 2024-09-22T08:36:46.584 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.564+0000 7f8774060640 1 -- 172.21.15.142:0/1600417673 <== osd.3 v2:172.21.15.142:6800/1064901393 6 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f876c03a070 con 0x559509088f70 2024-09-22T08:36:46.584 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.564+0000 7f8774060640 1 -- 172.21.15.142:0/1600417673 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55950908d3d0 con 0x559509088f70 2024-09-22T08:36:46.584 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.564+0000 7f8774060640 1 -- 172.21.15.142:0/1600417673 <== osd.3 v2:172.21.15.142:6800/1064901393 7 ==== osd_op_reply(23 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f876c03a070 con 0x559509088f70 2024-09-22T08:36:46.584 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.564+0000 7f8774060640 1 -- 172.21.15.142:0/1600417673 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55950908d3d0 con 0x559509084580 2024-09-22T08:36:46.584 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.564+0000 7f877305e640 1 -- 172.21.15.142:0/1600417673 <== osd.1 v2:172.21.15.142:6816/3192108003 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f876802b040 con 0x559509084580 2024-09-22T08:36:46.584 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.564+0000 7f877305e640 1 -- 172.21.15.142:0/1600417673 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55950908d3d0 con 0x559509084580 2024-09-22T08:36:46.584 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.565+0000 7f877305e640 1 -- 172.21.15.142:0/1600417673 <== osd.1 v2:172.21.15.142:6816/3192108003 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f876802b040 con 0x559509084580 2024-09-22T08:36:46.584 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.565+0000 7f877305e640 1 -- 172.21.15.142:0/1600417673 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55950908d3d0 con 0x7f87640a5040 2024-09-22T08:36:46.584 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.565+0000 7f877305e640 1 -- 172.21.15.142:0/1600417673 <== osd.0 v2:172.21.15.31:6800/168281188 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f876802b040 con 0x7f87640a5040 2024-09-22T08:36:46.584 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.565+0000 7f877305e640 1 -- 172.21.15.142:0/1600417673 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55950908d3d0 con 0x559509088f70 2024-09-22T08:36:46.585 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.565+0000 7f8774060640 1 -- 172.21.15.142:0/1600417673 <== osd.3 v2:172.21.15.142:6800/1064901393 8 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f876c03a070 con 0x559509088f70 2024-09-22T08:36:46.585 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.565+0000 7f8774060640 1 -- 172.21.15.142:0/1600417673 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55950908d3d0 con 0x7f876c0145e0 2024-09-22T08:36:46.585 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.565+0000 7f877385f640 1 -- 172.21.15.142:0/1600417673 <== osd.2 v2:172.21.15.142:6808/279438927 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8764087050 con 0x7f876c0145e0 2024-09-22T08:36:46.585 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.565+0000 7f877385f640 1 -- 172.21.15.142:0/1600417673 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55950908d3d0 con 0x559509084580 2024-09-22T08:36:46.585 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.566+0000 7f877305e640 1 -- 172.21.15.142:0/1600417673 <== osd.1 v2:172.21.15.142:6816/3192108003 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f876802b040 con 0x559509084580 2024-09-22T08:36:46.585 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.566+0000 7f877305e640 1 -- 172.21.15.142:0/1600417673 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55950908d3d0 con 0x7f87640a5040 2024-09-22T08:36:46.585 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.566+0000 7f877305e640 1 -- 172.21.15.142:0/1600417673 <== osd.0 v2:172.21.15.31:6800/168281188 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f876803b040 con 0x7f87640a5040 2024-09-22T08:36:46.586 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.566+0000 7f877305e640 1 -- 172.21.15.142:0/1600417673 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55950908d3d0 con 0x559509088f70 2024-09-22T08:36:46.586 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.566+0000 7f8774060640 1 -- 172.21.15.142:0/1600417673 <== osd.3 v2:172.21.15.142:6800/1064901393 9 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f876c03a070 con 0x559509088f70 2024-09-22T08:36:46.586 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.566+0000 7f8774060640 1 -- 172.21.15.142:0/1600417673 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55950908d3d0 con 0x7f87640a5040 2024-09-22T08:36:46.586 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.566+0000 7f877305e640 1 -- 172.21.15.142:0/1600417673 <== osd.0 v2:172.21.15.31:6800/168281188 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f876803b040 con 0x7f87640a5040 2024-09-22T08:36:46.586 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.566+0000 7f877305e640 1 -- 172.21.15.142:0/1600417673 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55950908d3d0 con 0x7f876c0145e0 2024-09-22T08:36:46.586 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.566+0000 7f877385f640 1 -- 172.21.15.142:0/1600417673 <== osd.2 v2:172.21.15.142:6808/279438927 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8764087050 con 0x7f876c0145e0 2024-09-22T08:36:46.587 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.567+0000 7f877385f640 1 -- 172.21.15.142:0/1600417673 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55950908d3d0 con 0x559509088f70 2024-09-22T08:36:46.587 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.567+0000 7f8774060640 1 -- 172.21.15.142:0/1600417673 <== osd.3 v2:172.21.15.142:6800/1064901393 10 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f876c03a070 con 0x559509088f70 2024-09-22T08:36:46.587 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.567+0000 7f8774060640 1 -- 172.21.15.142:0/1600417673 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55950908d3d0 con 0x7f87640a5040 2024-09-22T08:36:46.587 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.567+0000 7f877305e640 1 -- 172.21.15.142:0/1600417673 <== osd.0 v2:172.21.15.31:6800/168281188 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f876803b040 con 0x7f87640a5040 2024-09-22T08:36:46.587 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.567+0000 7f877305e640 1 -- 172.21.15.142:0/1600417673 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55950908d3d0 con 0x559509084580 2024-09-22T08:36:46.587 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.567+0000 7f877305e640 1 -- 172.21.15.142:0/1600417673 <== osd.1 v2:172.21.15.142:6816/3192108003 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f876803b040 con 0x559509084580 2024-09-22T08:36:46.587 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.567+0000 7f877305e640 1 -- 172.21.15.142:0/1600417673 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55950908d3d0 con 0x7f876c0145e0 2024-09-22T08:36:46.588 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.568+0000 7f877385f640 1 -- 172.21.15.142:0/1600417673 <== osd.2 v2:172.21.15.142:6808/279438927 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8764087050 con 0x7f876c0145e0 2024-09-22T08:36:46.588 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.568+0000 7f8775d75800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:36:46.588 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.568+0000 7f8775d75800 20 RGWRados::pool_iterate: got zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec 2024-09-22T08:36:46.588 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.568+0000 7f8775d75800 20 RGWRados::pool_iterate: got zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f 2024-09-22T08:36:46.588 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.568+0000 7f8775d75800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:36:46.588 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.568+0000 7f8775d75800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:36:46.588 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.568+0000 7f8775d75800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:36:46.588 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.568+0000 7f8775d75800 20 rados->read ofs=0 len=0 2024-09-22T08:36:46.589 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.568+0000 7f8775d75800 1 -- 172.21.15.142:0/1600417673 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55950908c460 con 0x559509084580 2024-09-22T08:36:46.589 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.568+0000 7f877305e640 1 -- 172.21.15.142:0/1600417673 <== osd.1 v2:172.21.15.142:6816/3192108003 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f876803b040 con 0x559509084580 2024-09-22T08:36:46.589 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.568+0000 7f8775d75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:46.589 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.568+0000 7f8775d75800 20 rados->read ofs=0 len=0 2024-09-22T08:36:46.589 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.568+0000 7f8775d75800 1 -- 172.21.15.142:0/1600417673 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55950908ccb0 con 0x559509084580 2024-09-22T08:36:46.589 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.568+0000 7f877305e640 1 -- 172.21.15.142:0/1600417673 <== osd.1 v2:172.21.15.142:6816/3192108003 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f876803b040 con 0x559509084580 2024-09-22T08:36:46.589 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.568+0000 7f8775d75800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:36:46.589 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.568+0000 7f8775d75800 20 rados->read ofs=0 len=0 2024-09-22T08:36:46.590 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.568+0000 7f8775d75800 1 -- 172.21.15.142:0/1600417673 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:40 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55950908d850 con 0x559509088f70 2024-09-22T08:36:46.590 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.568+0000 7f8774060640 1 -- 172.21.15.142:0/1600417673 <== osd.3 v2:172.21.15.142:6800/1064901393 11 ==== osd_op_reply(40 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f876c03a070 con 0x559509088f70 2024-09-22T08:36:46.590 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.568+0000 7f8775d75800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:36:46.590 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.568+0000 7f8775d75800 20 zone default found 2024-09-22T08:36:46.590 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.568+0000 7f8775d75800 4 Realm: () 2024-09-22T08:36:46.590 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.568+0000 7f8775d75800 4 ZoneGroup: default (d89f6f57-1007-47dd-9065-f486c7b01aec) 2024-09-22T08:36:46.591 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.568+0000 7f8775d75800 4 Zone: default (e239248c-0bee-4e41-803a-24b288d3eb8f) 2024-09-22T08:36:46.591 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.568+0000 7f8775d75800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:36:46.591 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.568+0000 7f8775d75800 20 zonegroup default 2024-09-22T08:36:46.591 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.568+0000 7f8775d75800 20 rados->read ofs=0 len=0 2024-09-22T08:36:46.591 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.568+0000 7f8775d75800 1 -- 172.21.15.142:0/1600417673 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55950908dc30 con 0x7f87640a5040 2024-09-22T08:36:46.591 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.569+0000 7f877305e640 1 -- 172.21.15.142:0/1600417673 <== osd.0 v2:172.21.15.31:6800/168281188 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f876803b040 con 0x7f87640a5040 2024-09-22T08:36:46.592 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.569+0000 7f8775d75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:46.592 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.569+0000 7f8775d75800 20 rados->read ofs=0 len=0 2024-09-22T08:36:46.592 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.569+0000 7f8775d75800 1 -- 172.21.15.142:0/1600417673 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55950908fa60 con 0x559509088f70 2024-09-22T08:36:46.592 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.569+0000 7f8774060640 1 -- 172.21.15.142:0/1600417673 <== osd.3 v2:172.21.15.142:6800/1064901393 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f876c03a070 con 0x559509088f70 2024-09-22T08:36:46.592 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.569+0000 7f8775d75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:46.592 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.569+0000 7f8775d75800 20 rados->read ofs=0 len=0 2024-09-22T08:36:46.592 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.569+0000 7f8775d75800 1 -- 172.21.15.142:0/1600417673 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55950908feb0 con 0x559509088f70 2024-09-22T08:36:46.592 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.569+0000 7f8774060640 1 -- 172.21.15.142:0/1600417673 <== osd.3 v2:172.21.15.142:6800/1064901393 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f876c03a070 con 0x559509088f70 2024-09-22T08:36:46.592 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.569+0000 7f8775d75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:46.593 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.569+0000 7f8775d75800 20 started sync module instance, tier type = 2024-09-22T08:36:46.593 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.569+0000 7f8775d75800 20 started zone id=e239248c-0bee-4e41-803a-24b288d3eb8f (name=default) with tier type = 2024-09-22T08:36:46.593 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.569+0000 7f8775d75800 1 -- 172.21.15.142:0/1600417673 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55950908ef00 con 0x7f876c0145e0 2024-09-22T08:36:46.593 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.570+0000 7f877385f640 1 -- 172.21.15.142:0/1600417673 <== osd.2 v2:172.21.15.142:6808/279438927 7 ==== osd_op_reply(44 notify.0 [create] v30'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8764087050 con 0x7f876c0145e0 2024-09-22T08:36:46.593 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.570+0000 7f8775d75800 1 -- 172.21.15.142:0/1600417673 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94098590067280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559509090310 con 0x7f876c0145e0 2024-09-22T08:36:46.593 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.570+0000 7f8775d75800 1 -- 172.21.15.142:0/1600417673 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559509090b60 con 0x559509084580 2024-09-22T08:36:46.593 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.571+0000 7f877385f640 1 -- 172.21.15.142:0/1600417673 <== osd.2 v2:172.21.15.142:6808/279438927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94098590067280] v30'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8764087050 con 0x7f876c0145e0 2024-09-22T08:36:46.593 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.571+0000 7f877305e640 1 -- 172.21.15.142:0/1600417673 <== osd.1 v2:172.21.15.142:6816/3192108003 15 ==== osd_op_reply(46 notify.1 [create] v30'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f876803b040 con 0x559509084580 2024-09-22T08:36:46.593 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.571+0000 7f8775d75800 1 -- 172.21.15.142:0/1600417673 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94098590074544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559509090f80 con 0x559509084580 2024-09-22T08:36:46.593 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.571+0000 7f8775d75800 1 -- 172.21.15.142:0/1600417673 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5595090917d0 con 0x559509088f70 2024-09-22T08:36:46.593 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.574+0000 7f877305e640 1 -- 172.21.15.142:0/1600417673 <== osd.1 v2:172.21.15.142:6816/3192108003 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94098590074544] v30'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f876803b040 con 0x559509084580 2024-09-22T08:36:46.594 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.574+0000 7f8774060640 1 -- 172.21.15.142:0/1600417673 <== osd.3 v2:172.21.15.142:6800/1064901393 14 ==== osd_op_reply(48 notify.2 [create] v30'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f876c03a070 con 0x559509088f70 2024-09-22T08:36:46.594 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.574+0000 7f8775d75800 1 -- 172.21.15.142:0/1600417673 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94098590076080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5595090916e0 con 0x559509088f70 2024-09-22T08:36:46.594 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.574+0000 7f8775d75800 1 -- 172.21.15.142:0/1600417673 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559509092260 con 0x7f876c0145e0 2024-09-22T08:36:46.594 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.575+0000 7f877385f640 1 -- 172.21.15.142:0/1600417673 <== osd.2 v2:172.21.15.142:6808/279438927 9 ==== osd_op_reply(50 notify.3 [create] v30'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8764087050 con 0x7f876c0145e0 2024-09-22T08:36:46.594 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.575+0000 7f8774060640 1 -- 172.21.15.142:0/1600417673 <== osd.3 v2:172.21.15.142:6800/1064901393 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94098590076080] v30'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f876c03a070 con 0x559509088f70 2024-09-22T08:36:46.594 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.575+0000 7f8775d75800 1 -- 172.21.15.142:0/1600417673 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94098590077296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559509092650 con 0x7f876c0145e0 2024-09-22T08:36:46.594 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.575+0000 7f8775d75800 1 -- 172.21.15.142:0/1600417673 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559509093070 con 0x559509084580 2024-09-22T08:36:46.594 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.576+0000 7f877385f640 1 -- 172.21.15.142:0/1600417673 <== osd.2 v2:172.21.15.142:6808/279438927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94098590077296] v30'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8764087050 con 0x7f876c0145e0 2024-09-22T08:36:46.594 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.577+0000 7f877305e640 1 -- 172.21.15.142:0/1600417673 <== osd.1 v2:172.21.15.142:6816/3192108003 17 ==== osd_op_reply(52 notify.4 [create] v30'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f876803b040 con 0x559509084580 2024-09-22T08:36:46.594 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.577+0000 7f8775d75800 1 -- 172.21.15.142:0/1600417673 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94098590083936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559509093460 con 0x559509084580 2024-09-22T08:36:46.594 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.577+0000 7f8775d75800 1 -- 172.21.15.142:0/1600417673 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559509093ec0 con 0x7f87640a5040 2024-09-22T08:36:46.595 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.578+0000 7f877305e640 1 -- 172.21.15.142:0/1600417673 <== osd.1 v2:172.21.15.142:6816/3192108003 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94098590083936] v30'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f876803b040 con 0x559509084580 2024-09-22T08:36:46.595 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.578+0000 7f877305e640 1 -- 172.21.15.142:0/1600417673 <== osd.0 v2:172.21.15.31:6800/168281188 11 ==== osd_op_reply(54 notify.5 [create] v30'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f876803b040 con 0x7f87640a5040 2024-09-22T08:36:46.595 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.578+0000 7f8775d75800 1 -- 172.21.15.142:0/1600417673 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94098590080304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559509093ec0 con 0x7f87640a5040 2024-09-22T08:36:46.595 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.578+0000 7f8775d75800 1 -- 172.21.15.142:0/1600417673 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559509094910 con 0x7f87640a5040 2024-09-22T08:36:46.595 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.579+0000 7f877305e640 1 -- 172.21.15.142:0/1600417673 <== osd.0 v2:172.21.15.31:6800/168281188 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94098590080304] v30'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f876803b040 con 0x7f87640a5040 2024-09-22T08:36:46.595 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.579+0000 7f877305e640 1 -- 172.21.15.142:0/1600417673 <== osd.0 v2:172.21.15.31:6800/168281188 13 ==== osd_op_reply(56 notify.6 [create] v30'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f876803b040 con 0x7f87640a5040 2024-09-22T08:36:46.595 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.579+0000 7f8775d75800 1 -- 172.21.15.142:0/1600417673 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94098590087584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5595090948d0 con 0x7f87640a5040 2024-09-22T08:36:46.595 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.579+0000 7f8775d75800 1 -- 172.21.15.142:0/1600417673 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5595090952d0 con 0x7f87640a5040 2024-09-22T08:36:46.595 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.580+0000 7f877305e640 1 -- 172.21.15.142:0/1600417673 <== osd.0 v2:172.21.15.31:6800/168281188 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94098590087584] v30'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f876803b040 con 0x7f87640a5040 2024-09-22T08:36:46.595 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.580+0000 7f877305e640 1 -- 172.21.15.142:0/1600417673 <== osd.0 v2:172.21.15.31:6800/168281188 15 ==== osd_op_reply(58 notify.7 [create] v30'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f876803b040 con 0x7f87640a5040 2024-09-22T08:36:46.595 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.580+0000 7f8775d75800 1 -- 172.21.15.142:0/1600417673 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94098590090272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559509095470 con 0x7f87640a5040 2024-09-22T08:36:46.595 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.580+0000 7f8775d75800 20 add_watcher() i=0 2024-09-22T08:36:46.596 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.580+0000 7f8775d75800 20 add_watcher() i=1 2024-09-22T08:36:46.596 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.580+0000 7f8775d75800 20 add_watcher() i=2 2024-09-22T08:36:46.596 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.580+0000 7f8775d75800 20 add_watcher() i=3 2024-09-22T08:36:46.596 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.580+0000 7f8775d75800 20 add_watcher() i=4 2024-09-22T08:36:46.596 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.580+0000 7f8775d75800 20 add_watcher() i=5 2024-09-22T08:36:46.596 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.580+0000 7f8775d75800 20 add_watcher() i=6 2024-09-22T08:36:46.600 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.581+0000 7f877305e640 1 -- 172.21.15.142:0/1600417673 <== osd.0 v2:172.21.15.31:6800/168281188 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94098590090272] v30'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f876803b040 con 0x7f87640a5040 2024-09-22T08:36:46.600 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.581+0000 7f8775d75800 20 add_watcher() i=7 2024-09-22T08:36:46.600 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.581+0000 7f8775d75800 2 all 8 watchers are set, enabling cache 2024-09-22T08:36:46.601 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.581+0000 7f8775d75800 1 -- 172.21.15.142:0/1600417673 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5595090987b0 con 0x559509084580 2024-09-22T08:36:46.601 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.581+0000 7f877305e640 1 -- 172.21.15.142:0/1600417673 <== osd.1 v2:172.21.15.142:6816/3192108003 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f876803b040 con 0x559509084580 2024-09-22T08:36:46.601 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.581+0000 7f8775d75800 1 -- 172.21.15.142:0/1600417673 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94098590105952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559509095410 con 0x559509084580 2024-09-22T08:36:46.601 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.582+0000 7f877305e640 1 -- 172.21.15.142:0/1600417673 <== osd.1 v2:172.21.15.142:6816/3192108003 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94098590105952] v30'106 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f876803b040 con 0x559509084580 2024-09-22T08:36:46.601 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.582+0000 7f8629fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:36:46.601 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.583+0000 7f8775d75800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:36:46.601 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.583+0000 7f8775d75800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:36:46.601 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.583+0000 7f8775d75800 5 note: GC not initialized 2024-09-22T08:36:46.601 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.583+0000 7f8628fe1640 20 reqs_thread_entry: start 2024-09-22T08:36:46.601 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.583+0000 7f8775d75800 20 init_complete bucket index max shards: 11 2024-09-22T08:36:46.601 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.583+0000 7f8775d75800 20 Filter name: none 2024-09-22T08:36:46.602 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.583+0000 7f85a27fc640 20 reqs_thread_entry: start 2024-09-22T08:36:46.602 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.583+0000 7f8775d75800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-22T08:36:46.602 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.583+0000 7f8775d75800 20 rados->read ofs=0 len=0 2024-09-22T08:36:46.602 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.583+0000 7f8775d75800 1 -- 172.21.15.142:0/1600417673 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5595090cbc70 con 0x7f87640a5040 2024-09-22T08:36:46.602 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.583+0000 7f877305e640 1 -- 172.21.15.142:0/1600417673 <== osd.0 v2:172.21.15.31:6800/168281188 17 ==== osd_op_reply(62 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f876803b040 con 0x7f87640a5040 2024-09-22T08:36:46.602 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.583+0000 7f8775d75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:46.602 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.583+0000 7f8775d75800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-09-22T08:36:46.602 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.583+0000 7f8775d75800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-22T08:36:46.602 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.583+0000 7f8775d75800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-09-22T08:36:46.602 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.583+0000 7f8775d75800 20 rados->read ofs=0 len=0 2024-09-22T08:36:46.603 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.583+0000 7f8775d75800 1 -- 172.21.15.142:0/1600417673 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5595090ca1d0 con 0x7f87640a5040 2024-09-22T08:36:46.603 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.584+0000 7f877305e640 1 -- 172.21.15.142:0/1600417673 <== osd.0 v2:172.21.15.31:6800/168281188 18 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7f876803b040 con 0x7f87640a5040 2024-09-22T08:36:46.603 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.584+0000 7f8775d75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:46.603 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.584+0000 7f8775d75800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-09-22T08:36:46.603 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.584+0000 7f8775d75800 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-22T08:36:46.603 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.584+0000 7f8775d75800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-22T08:36:46.603 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.584+0000 7f8775d75800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-22T08:36:46.603 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.584+0000 7f8775d75800 1 -- 172.21.15.142:0/1600417673 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:64 8.e 8:75f48285:users.uid::fud:head [delete,create,call version.set in=58b,writefull 0~380 in=380b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5595090caaa0 con 0x7f87640a5040 2024-09-22T08:36:46.603 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.585+0000 7f877305e640 1 -- 172.21.15.142:0/1600417673 <== osd.0 v2:172.21.15.31:6800/168281188 19 ==== osd_op_reply(64 fud [delete,create,call,writefull 0~380] v30'3 uv3 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7f876803b040 con 0x7f87640a5040 2024-09-22T08:36:46.603 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.585+0000 7f8775d75800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-09-22T08:36:46.603 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.585+0000 7f8775d75800 10 moving default.rgw.meta+users.uid+fud to cache LRU end 2024-09-22T08:36:46.603 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.585+0000 7f8775d75800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-09-22T08:36:46.603 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.585+0000 7f8775d75800 1 -- 172.21.15.142:0/1600417673 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:65 7.3 7:c609908c:::notify.5:head [notify cookie 94098590311920 in=568b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5595090cf710 con 0x7f87640a5040 2024-09-22T08:36:46.604 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.585+0000 7f877305e640 1 -- 172.21.15.142:0/1600417673 <== osd.0 v2:172.21.15.31:6800/168281188 20 ==== watch-notify(notify (1) cookie 94098590080304 notify 128849018888 ret 0) ==== 598+0+0 (crc 0 0 0) 0x5595090cae40 con 0x7f87640a5040 2024-09-22T08:36:46.604 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.585+0000 7f8652ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018888 cookie 94098590080304 notifier 4485 bl.length()=556 2024-09-22T08:36:46.604 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.585+0000 7f8652ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-09-22T08:36:46.604 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.585+0000 7f8652ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+fud to cache LRU end 2024-09-22T08:36:46.604 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.585+0000 7f8652ffd640 1 -- 172.21.15.142:0/1600417673 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:66 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f8638003ea0 con 0x7f87640a5040 2024-09-22T08:36:46.604 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.585+0000 7f877305e640 1 -- 172.21.15.142:0/1600417673 <== osd.0 v2:172.21.15.31:6800/168281188 21 ==== osd_op_reply(65 notify.5 [notify cookie 94098590311920 out=8b] v0'0 uv108 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f876803b040 con 0x7f87640a5040 2024-09-22T08:36:46.604 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.585+0000 7f877305e640 1 -- 172.21.15.142:0/1600417673 <== osd.0 v2:172.21.15.31:6800/168281188 22 ==== osd_op_reply(66 notify.5 [notify-ack] v0'0 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f876803b040 con 0x7f87640a5040 2024-09-22T08:36:46.604 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.586+0000 7f877305e640 1 -- 172.21.15.142:0/1600417673 <== osd.0 v2:172.21.15.31:6800/168281188 23 ==== watch-notify(notify_complete (2) cookie 94098590311920 notify 128849018888 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5595090cb5c0 con 0x7f87640a5040 2024-09-22T08:36:46.604 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.586+0000 7f8775d75800 1 -- 172.21.15.142:0/1600417673 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5595090cd220 con 0x7f87640a5040 2024-09-22T08:36:46.604 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.587+0000 7f877305e640 1 -- 172.21.15.142:0/1600417673 <== osd.0 v2:172.21.15.31:6800/168281188 24 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~7] v30'3 uv3 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f876803b040 con 0x7f87640a5040 2024-09-22T08:36:46.604 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.587+0000 7f8775d75800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-22T08:36:46.605 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.587+0000 7f8775d75800 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-22T08:36:46.605 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.587+0000 7f8775d75800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-22T08:36:46.605 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.587+0000 7f8775d75800 1 -- 172.21.15.142:0/1600417673 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94098590311808 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5595090cf6f0 con 0x559509088f70 2024-09-22T08:36:46.605 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.587+0000 7f8774060640 1 -- 172.21.15.142:0/1600417673 <== osd.3 v2:172.21.15.142:6800/1064901393 16 ==== watch-notify(notify (1) cookie 94098590076080 notify 128849018882 ret 0) ==== 219+0+0 (crc 0 0 0) 0x5595090792a0 con 0x559509088f70 2024-09-22T08:36:46.605 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.587+0000 7f86527fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018882 cookie 94098590076080 notifier 4485 bl.length()=177 2024-09-22T08:36:46.605 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.587+0000 7f86527fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-22T08:36:46.605 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.587+0000 7f86527fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-22T08:36:46.606 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.587+0000 7f8774060640 1 -- 172.21.15.142:0/1600417673 <== osd.3 v2:172.21.15.142:6800/1064901393 17 ==== osd_op_reply(68 notify.2 [notify cookie 94098590311808 out=8b] v0'0 uv108 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f876c03a070 con 0x559509088f70 2024-09-22T08:36:46.606 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.587+0000 7f86527fc640 1 -- 172.21.15.142:0/1600417673 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f85a8003400 con 0x559509088f70 2024-09-22T08:36:46.606 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.587+0000 7f8774060640 1 -- 172.21.15.142:0/1600417673 <== osd.3 v2:172.21.15.142:6800/1064901393 18 ==== watch-notify(notify_complete (2) cookie 94098590311808 notify 128849018882 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f876c05f020 con 0x559509088f70 2024-09-22T08:36:46.606 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.587+0000 7f8774060640 1 -- 172.21.15.142:0/1600417673 <== osd.3 v2:172.21.15.142:6800/1064901393 19 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f876c03a070 con 0x559509088f70 2024-09-22T08:36:46.607 INFO:teuthology.orchestra.run.smithi142.stdout:{"user_id":"fud","display_name":"Fud","email":"","suspended":0,"max_buckets":1,"subusers":[],"keys":[{"user":"fud","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-09-22T08:36:46.585096Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-22T08:36:46.585086Z","tags":[],"group_ids":[]} 2024-09-22T08:36:46.614 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.588+0000 7f8629fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:36:46.614 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.588+0000 7f8775d75800 1 -- 172.21.15.142:0/1600417673 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94098590105952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5595090c9940 con 0x559509084580 2024-09-22T08:36:46.614 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.589+0000 7f877305e640 1 -- 172.21.15.142:0/1600417673 <== osd.1 v2:172.21.15.142:6816/3192108003 21 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94098590105952] v30'107 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f876803b040 con 0x559509084580 2024-09-22T08:36:46.614 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.589+0000 7f8775d75800 1 -- 172.21.15.142:0/1600417673 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94098590067280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5595090c9940 con 0x7f876c0145e0 2024-09-22T08:36:46.614 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.590+0000 7f877385f640 1 -- 172.21.15.142:0/1600417673 <== osd.2 v2:172.21.15.142:6808/279438927 11 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94098590067280] v30'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8764087050 con 0x7f876c0145e0 2024-09-22T08:36:46.614 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.590+0000 7f8775d75800 20 remove_watcher() i=0 2024-09-22T08:36:46.614 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.590+0000 7f8775d75800 2 removed watcher, disabling cache 2024-09-22T08:36:46.614 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.590+0000 7f8775d75800 1 -- 172.21.15.142:0/1600417673 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94098590074544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5595090c9940 con 0x559509084580 2024-09-22T08:36:46.614 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.592+0000 7f877305e640 1 -- 172.21.15.142:0/1600417673 <== osd.1 v2:172.21.15.142:6816/3192108003 22 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94098590074544] v30'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f876803b040 con 0x559509084580 2024-09-22T08:36:46.615 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.592+0000 7f8775d75800 20 remove_watcher() i=1 2024-09-22T08:36:46.615 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.592+0000 7f8775d75800 1 -- 172.21.15.142:0/1600417673 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94098590076080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5595090c9940 con 0x559509088f70 2024-09-22T08:36:46.615 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.593+0000 7f8774060640 1 -- 172.21.15.142:0/1600417673 <== osd.3 v2:172.21.15.142:6800/1064901393 20 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94098590076080] v30'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f876c03a070 con 0x559509088f70 2024-09-22T08:36:46.615 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.593+0000 7f8775d75800 20 remove_watcher() i=2 2024-09-22T08:36:46.615 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.593+0000 7f8775d75800 1 -- 172.21.15.142:0/1600417673 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94098590077296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5595090c9940 con 0x7f876c0145e0 2024-09-22T08:36:46.615 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.594+0000 7f877385f640 1 -- 172.21.15.142:0/1600417673 <== osd.2 v2:172.21.15.142:6808/279438927 12 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94098590077296] v30'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8764087050 con 0x7f876c0145e0 2024-09-22T08:36:46.615 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.594+0000 7f8775d75800 20 remove_watcher() i=3 2024-09-22T08:36:46.615 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.594+0000 7f8775d75800 1 -- 172.21.15.142:0/1600417673 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94098590083936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5595090c9940 con 0x559509084580 2024-09-22T08:36:46.615 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.595+0000 7f877305e640 1 -- 172.21.15.142:0/1600417673 <== osd.1 v2:172.21.15.142:6816/3192108003 23 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94098590083936] v30'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f876803b040 con 0x559509084580 2024-09-22T08:36:46.615 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.595+0000 7f8775d75800 20 remove_watcher() i=4 2024-09-22T08:36:46.615 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.595+0000 7f8775d75800 1 -- 172.21.15.142:0/1600417673 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94098590080304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5595090c9940 con 0x7f87640a5040 2024-09-22T08:36:46.615 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.596+0000 7f877305e640 1 -- 172.21.15.142:0/1600417673 <== osd.0 v2:172.21.15.31:6800/168281188 25 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94098590080304] v30'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f876803b040 con 0x7f87640a5040 2024-09-22T08:36:46.615 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.596+0000 7f8775d75800 20 remove_watcher() i=5 2024-09-22T08:36:46.615 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.596+0000 7f8775d75800 1 -- 172.21.15.142:0/1600417673 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94098590087584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5595090c9940 con 0x7f87640a5040 2024-09-22T08:36:46.616 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.597+0000 7f877305e640 1 -- 172.21.15.142:0/1600417673 <== osd.0 v2:172.21.15.31:6800/168281188 26 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94098590087584] v30'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f876803b040 con 0x7f87640a5040 2024-09-22T08:36:46.616 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.597+0000 7f8775d75800 20 remove_watcher() i=6 2024-09-22T08:36:46.616 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.597+0000 7f8775d75800 1 -- 172.21.15.142:0/1600417673 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94098590090272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5595090c9940 con 0x7f87640a5040 2024-09-22T08:36:46.616 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.598+0000 7f877305e640 1 -- 172.21.15.142:0/1600417673 <== osd.0 v2:172.21.15.31:6800/168281188 27 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94098590090272] v30'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f876803b040 con 0x7f87640a5040 2024-09-22T08:36:46.616 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.598+0000 7f8775d75800 20 remove_watcher() i=7 2024-09-22T08:36:46.616 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.598+0000 7f8775d75800 1 -- 172.21.15.142:0/1600417673 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f87640a5040 msgr2=0x7f8764095280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:46.616 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.598+0000 7f8775d75800 1 --2- 172.21.15.142:0/1600417673 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f87640a5040 0x7f8764095280 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:46.616 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.598+0000 7f8775d75800 1 -- 172.21.15.142:0/1600417673 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x559509084580 msgr2=0x559509086a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:46.616 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.598+0000 7f8775d75800 1 --2- 172.21.15.142:0/1600417673 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x559509084580 0x559509086a40 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:46.616 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.598+0000 7f8775d75800 1 -- 172.21.15.142:0/1600417673 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f876c0145e0 msgr2=0x7f876c0459d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:46.616 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.598+0000 7f8775d75800 1 --2- 172.21.15.142:0/1600417673 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f876c0145e0 0x7f876c0459d0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:46.616 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.598+0000 7f8775d75800 1 -- 172.21.15.142:0/1600417673 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x559509088f70 msgr2=0x55950908b360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:46.616 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.598+0000 7f8775d75800 1 --2- 172.21.15.142:0/1600417673 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x559509088f70 0x55950908b360 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:46.617 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.598+0000 7f8775d75800 1 -- 172.21.15.142:0/1600417673 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f863c03cfb0 msgr2=0x7f863c03f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:46.617 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.598+0000 7f8775d75800 1 --2- 172.21.15.142:0/1600417673 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f863c03cfb0 0x7f863c03f470 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f87640514a0 tx=0x7f8764084420 comp rx=0 tx=0).stop 2024-09-22T08:36:46.617 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.598+0000 7f8775d75800 1 -- 172.21.15.142:0/1600417673 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5595090717c0 msgr2=0x559509078d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:46.617 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.598+0000 7f877305e640 1 -- 172.21.15.142:0/1600417673 reap_dead start 2024-09-22T08:36:46.617 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.598+0000 7f8775d75800 1 --2- 172.21.15.142:0/1600417673 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5595090717c0 0x559509078d40 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f876c020560 tx=0x7f876c054790 comp rx=0 tx=0).stop 2024-09-22T08:36:46.617 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.598+0000 7f8775d75800 1 -- 172.21.15.142:0/1600417673 shutdown_connections 2024-09-22T08:36:46.617 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.598+0000 7f8775d75800 1 --2- 172.21.15.142:0/1600417673 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5595090717c0 0x559509078d40 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:46.617 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.598+0000 7f8775d75800 1 -- 172.21.15.142:0/1600417673 >> 172.21.15.142:0/1600417673 conn(0x55950906dbe0 msgr2=0x55950906bdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:46.617 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.598+0000 7f8775d75800 1 -- 172.21.15.142:0/1600417673 shutdown_connections 2024-09-22T08:36:46.617 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.598+0000 7f8775d75800 1 -- 172.21.15.142:0/1600417673 wait complete. 2024-09-22T08:36:46.617 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.598+0000 7f8775d75800 1 -- 172.21.15.142:0/111531029 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f864c03d000 msgr2=0x7f864c03f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:46.617 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.598+0000 7f8775d75800 1 --2- 172.21.15.142:0/111531029 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f864c03d000 0x7f864c03f4c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f8764076750 tx=0x7f8764008330 comp rx=0 tx=0).stop 2024-09-22T08:36:46.617 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.598+0000 7f8775d75800 1 -- 172.21.15.142:0/111531029 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559509064d40 msgr2=0x559509065160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:46.618 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.598+0000 7f8775d75800 1 --2- 172.21.15.142:0/111531029 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559509064d40 0x559509065160 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x55950904ace0 tx=0x7f876c0167b0 comp rx=0 tx=0).stop 2024-09-22T08:36:46.618 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.599+0000 7f8775d75800 1 -- 172.21.15.142:0/111531029 shutdown_connections 2024-09-22T08:36:46.618 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.599+0000 7f8775d75800 1 --2- 172.21.15.142:0/111531029 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f864c03d000 0x7f864c03f4c0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:46.618 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.599+0000 7f8775d75800 1 --2- 172.21.15.142:0/111531029 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559509064d40 0x559509065160 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:46.618 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.599+0000 7f8775d75800 1 -- 172.21.15.142:0/111531029 >> 172.21.15.142:0/111531029 conn(0x5595090590f0 msgr2=0x5595090594d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:46.618 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.599+0000 7f8775d75800 1 -- 172.21.15.142:0/111531029 shutdown_connections 2024-09-22T08:36:46.618 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.599+0000 7f8775d75800 1 -- 172.21.15.142:0/111531029 wait complete. 2024-09-22T08:36:46.618 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.599+0000 7f8775d75800 1 -- 172.21.15.142:0/3970677039 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x559508f53a00 msgr2=0x559509051330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:46.618 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.599+0000 7f8775d75800 1 --2- 172.21.15.142:0/3970677039 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x559508f53a00 0x559509051330 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:46.618 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.599+0000 7f8775d75800 1 -- 172.21.15.142:0/3970677039 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x559509053750 msgr2=0x559509055bf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:46.618 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.599+0000 7f8775d75800 1 --2- 172.21.15.142:0/3970677039 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x559509053750 0x559509055bf0 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:46.618 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.599+0000 7f8775d75800 1 -- 172.21.15.142:0/3970677039 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f865c03d000 msgr2=0x7f865c03f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:46.619 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.599+0000 7f8775d75800 1 --2- 172.21.15.142:0/3970677039 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f865c03d000 0x7f865c03f4c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f8768001e30 tx=0x7f8768001390 comp rx=0 tx=0).stop 2024-09-22T08:36:46.619 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.599+0000 7f8775d75800 1 -- 172.21.15.142:0/3970677039 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559508f510d0 msgr2=0x559509049ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:46.619 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.599+0000 7f8775d75800 1 --2- 172.21.15.142:0/3970677039 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559508f510d0 0x559509049ce0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f8764067040 tx=0x7f8764002fb0 comp rx=0 tx=0).stop 2024-09-22T08:36:46.619 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.599+0000 7f8775d75800 1 -- 172.21.15.142:0/3970677039 shutdown_connections 2024-09-22T08:36:46.619 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.599+0000 7f8775d75800 1 --2- 172.21.15.142:0/3970677039 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x559509053750 0x559509055bf0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:46.619 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.599+0000 7f8775d75800 1 --2- 172.21.15.142:0/3970677039 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x559508f53a00 0x559509051330 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:46.619 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.599+0000 7f8775d75800 1 --2- 172.21.15.142:0/3970677039 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f865c03d000 0x7f865c03f4c0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:46.619 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.599+0000 7f8775d75800 1 --2- 172.21.15.142:0/3970677039 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559508f510d0 0x559509049ce0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:46.619 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.599+0000 7f8775d75800 1 -- 172.21.15.142:0/3970677039 >> 172.21.15.142:0/3970677039 conn(0x559508f4abf0 msgr2=0x55950903b610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:46.619 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.599+0000 7f8775d75800 1 -- 172.21.15.142:0/3970677039 shutdown_connections 2024-09-22T08:36:46.619 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.599+0000 7f8775d75800 1 -- 172.21.15.142:0/3970677039 wait complete. 2024-09-22T08:36:46.620 DEBUG:tasks.util.rgw: json result: {'user_id': 'fud', 'display_name': 'Fud', 'email': '', 'suspended': 0, 'max_buckets': 1, 'subusers': [], 'keys': [{'user': 'fud', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-09-22T08:36:46.585096Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-22T08:36:46.585086Z', 'tags': [], 'group_ids': []} 2024-09-22T08:36:46.625 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-09-22T08:36:46.629 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-22T08:36:46.629 INFO:tasks.util.rgw:rgwadmin: client.0 : ['metadata', 'get', 'bucket:myfoo'] 2024-09-22T08:36:46.629 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'metadata', 'get', 'bucket:myfoo'] 2024-09-22T08:36:46.630 DEBUG:teuthology.orchestra.run.smithi142:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph metadata get bucket:myfoo 2024-09-22T08:36:46.673 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:36:46.673 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:36:46.674 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.672+0000 7ff180e2f800 1 Processor -- start 2024-09-22T08:36:46.674 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.672+0000 7ff180e2f800 1 -- start start 2024-09-22T08:36:46.674 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.672+0000 7ff180e2f800 1 --2- >> v2:172.21.15.31:3300/0 conn(0x5579e3069d30 0x5579e30fb480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:46.674 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.672+0000 7ff180e2f800 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5579e2f81a20 con 0x5579e30fba20 2024-09-22T08:36:46.675 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.672+0000 7ff180e2f800 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x5579e2f817d0 con 0x5579e3069d30 2024-09-22T08:36:46.675 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.673+0000 7ff17e919640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x5579e3069d30 0x5579e30fb480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:46.675 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.673+0000 7ff176118640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x5579e30fba20 0x5579e30fdec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.142:42548/0 (socket says 172.21.15.142:42548) 2024-09-22T08:36:46.675 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.673+0000 7ff176118640 1 -- 172.21.15.142:0/4090736590 learned_addr learned my addr 172.21.15.142:0/4090736590 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-09-22T08:36:46.675 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.673+0000 7ff17e919640 1 -- 172.21.15.142:0/4090736590 >> v1:172.21.15.31:6789/0 conn(0x5579e30fba20 legacy=0x5579e30fdec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:46.675 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.673+0000 7ff17e919640 1 -- 172.21.15.142:0/4090736590 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5579e3100780 con 0x5579e3069d30 2024-09-22T08:36:46.676 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.675+0000 7ff17e919640 1 --2- 172.21.15.142:0/4090736590 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5579e3069d30 0x5579e30fb480 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7ff17000a470 tx=0x7ff170045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5981e3a05708504e server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:46.676 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.675+0000 7ff17e118640 1 -- 172.21.15.142:0/4090736590 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff170053570 con 0x5579e3069d30 2024-09-22T08:36:46.676 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.675+0000 7ff17e118640 1 -- 172.21.15.142:0/4090736590 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff170058070 con 0x5579e3069d30 2024-09-22T08:36:46.676 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.675+0000 7ff17e118640 1 -- 172.21.15.142:0/4090736590 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff170053880 con 0x5579e3069d30 2024-09-22T08:36:46.677 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.676+0000 7ff180e2f800 1 -- 172.21.15.142:0/4090736590 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5579e3069d30 msgr2=0x5579e30fb480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:46.677 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.676+0000 7ff180e2f800 1 --2- 172.21.15.142:0/4090736590 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5579e3069d30 0x5579e30fb480 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7ff17000a470 tx=0x7ff170045a20 comp rx=0 tx=0).stop 2024-09-22T08:36:46.677 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.676+0000 7ff180e2f800 1 -- 172.21.15.142:0/4090736590 shutdown_connections 2024-09-22T08:36:46.677 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.676+0000 7ff180e2f800 1 --2- 172.21.15.142:0/4090736590 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5579e3069d30 0x5579e30fb480 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:46.678 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.676+0000 7ff180e2f800 1 -- 172.21.15.142:0/4090736590 >> 172.21.15.142:0/4090736590 conn(0x5579e30f0bb0 msgr2=0x5579e30f3010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:46.678 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.676+0000 7ff180e2f800 1 -- 172.21.15.142:0/4090736590 shutdown_connections 2024-09-22T08:36:46.678 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.676+0000 7ff180e2f800 1 -- 172.21.15.142:0/4090736590 wait complete. 2024-09-22T08:36:46.691 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.690+0000 7ff180e2f800 1 Processor -- start 2024-09-22T08:36:46.691 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.690+0000 7ff180e2f800 1 -- start start 2024-09-22T08:36:46.691 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.690+0000 7ff180e2f800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5579e3069d30 0x5579e31e8270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:46.692 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.690+0000 7ff180e2f800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5579e2f8edd0 con 0x5579e3069d30 2024-09-22T08:36:46.692 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.690+0000 7ff17e919640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5579e3069d30 0x5579e31e8270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:46.692 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.690+0000 7ff17e919640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5579e3069d30 0x5579e31e8270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:39434/0 (socket says 172.21.15.142:39434) 2024-09-22T08:36:46.692 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.690+0000 7ff17e919640 1 -- 172.21.15.142:0/3244636796 learned_addr learned my addr 172.21.15.142:0/3244636796 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:46.692 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.690+0000 7ff17e919640 1 -- 172.21.15.142:0/3244636796 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5579e31e8860 con 0x5579e3069d30 2024-09-22T08:36:46.692 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.690+0000 7ff17e919640 1 --2- 172.21.15.142:0/3244636796 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5579e3069d30 0x5579e31e8270 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7ff170025c20 tx=0x7ff170051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5400800809aa7713 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:46.694 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.691+0000 7ff06ce09640 1 -- 172.21.15.142:0/3244636796 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff170053a20 con 0x5579e3069d30 2024-09-22T08:36:46.694 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.691+0000 7ff06ce09640 1 -- 172.21.15.142:0/3244636796 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff170063070 con 0x5579e3069d30 2024-09-22T08:36:46.694 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.691+0000 7ff06ce09640 1 -- 172.21.15.142:0/3244636796 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff170053cf0 con 0x5579e3069d30 2024-09-22T08:36:46.694 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.691+0000 7ff180e2f800 1 -- 172.21.15.142:0/3244636796 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5579e3069d30 msgr2=0x5579e31e8270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:46.694 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.691+0000 7ff180e2f800 1 --2- 172.21.15.142:0/3244636796 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5579e3069d30 0x5579e31e8270 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7ff170025c20 tx=0x7ff170051000 comp rx=0 tx=0).stop 2024-09-22T08:36:46.694 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.691+0000 7ff180e2f800 1 -- 172.21.15.142:0/3244636796 shutdown_connections 2024-09-22T08:36:46.695 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.691+0000 7ff180e2f800 1 --2- 172.21.15.142:0/3244636796 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5579e3069d30 0x5579e31e8270 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:46.695 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.691+0000 7ff180e2f800 1 -- 172.21.15.142:0/3244636796 >> 172.21.15.142:0/3244636796 conn(0x5579e30f0bb0 msgr2=0x5579e31e3bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:46.695 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.691+0000 7ff180e2f800 1 -- 172.21.15.142:0/3244636796 shutdown_connections 2024-09-22T08:36:46.695 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.691+0000 7ff180e2f800 1 -- 172.21.15.142:0/3244636796 wait complete. 2024-09-22T08:36:46.695 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.692+0000 7ff180e2f800 1 Processor -- start 2024-09-22T08:36:46.695 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.692+0000 7ff180e2f800 1 -- start start 2024-09-22T08:36:46.695 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.692+0000 7ff180e2f800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5579e3069d30 0x5579e31efd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:46.695 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.692+0000 7ff180e2f800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5579e30ffa20 con 0x5579e3069d30 2024-09-22T08:36:46.695 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.692+0000 7ff17e919640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5579e3069d30 0x5579e31efd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:46.695 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.692+0000 7ff17e919640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5579e3069d30 0x5579e31efd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:39448/0 (socket says 172.21.15.142:39448) 2024-09-22T08:36:46.695 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.692+0000 7ff17e919640 1 -- 172.21.15.142:0/196252256 learned_addr learned my addr 172.21.15.142:0/196252256 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:46.695 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.692+0000 7ff17e919640 1 -- 172.21.15.142:0/196252256 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5579e31f0280 con 0x5579e3069d30 2024-09-22T08:36:46.695 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.692+0000 7ff17e919640 1 --2- 172.21.15.142:0/196252256 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5579e3069d30 0x5579e31efd20 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7ff170025c20 tx=0x7ff170002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:46.696 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.693+0000 7ff06b606640 1 -- 172.21.15.142:0/196252256 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff170068660 con 0x5579e3069d30 2024-09-22T08:36:46.696 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.693+0000 7ff06b606640 1 -- 172.21.15.142:0/196252256 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff170068800 con 0x5579e3069d30 2024-09-22T08:36:46.696 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.693+0000 7ff06b606640 1 -- 172.21.15.142:0/196252256 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff170068ae0 con 0x5579e3069d30 2024-09-22T08:36:46.696 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.693+0000 7ff180e2f800 1 -- 172.21.15.142:0/196252256 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5579e31f0510 con 0x5579e3069d30 2024-09-22T08:36:46.696 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.693+0000 7ff180e2f800 1 -- 172.21.15.142:0/196252256 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5579e31f1120 con 0x5579e3069d30 2024-09-22T08:36:46.701 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.694+0000 7ff06b606640 1 -- 172.21.15.142:0/196252256 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7ff170068c80 con 0x5579e3069d30 2024-09-22T08:36:46.701 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.694+0000 7ff06b606640 1 --2- 172.21.15.142:0/196252256 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7ff06403d000 0x7ff06403f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:46.701 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.694+0000 7ff06b606640 1 -- 172.21.15.142:0/196252256 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7ff170098c30 con 0x5579e3069d30 2024-09-22T08:36:46.701 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.694+0000 7ff176118640 1 --2- 172.21.15.142:0/196252256 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7ff06403d000 0x7ff06403f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:46.701 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.694+0000 7ff180e2f800 1 --2- 172.21.15.142:0/196252256 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5579e30fba20 0x5579e31f7370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:46.701 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.694+0000 7ff180e2f800 1 -- 172.21.15.142:0/196252256 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5579e31f78b0 con 0x5579e30fba20 2024-09-22T08:36:46.701 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.694+0000 7ff17f11a640 1 --2- 172.21.15.142:0/196252256 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5579e30fba20 0x5579e31f7370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:46.701 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.694+0000 7ff176118640 1 --2- 172.21.15.142:0/196252256 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7ff06403d000 0x7ff06403f4c0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7ff168001d70 tx=0x7ff1680012d0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:46.701 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.694+0000 7ff17f11a640 1 --2- 172.21.15.142:0/196252256 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5579e30fba20 0x5579e31f7370 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:46.702 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.695+0000 7ff17f11a640 1 -- 172.21.15.142:0/196252256 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff17800a4d0 con 0x5579e30fba20 2024-09-22T08:36:46.702 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.695+0000 7ff180e2f800 1 -- 172.21.15.142:0/196252256 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5579e31f7c50 con 0x5579e30fba20 2024-09-22T08:36:46.702 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.695+0000 7ff17f11a640 1 -- 172.21.15.142:0/196252256 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff17800a4d0 con 0x5579e30fba20 2024-09-22T08:36:46.702 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.695+0000 7ff180e2f800 1 --2- 172.21.15.142:0/196252256 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5579e31f9680 0x5579e31fbb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:46.702 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.695+0000 7ff180e2f800 1 -- 172.21.15.142:0/196252256 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:3 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5579e31fc2b0 con 0x5579e31f9680 2024-09-22T08:36:46.702 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.695+0000 7ff17e919640 1 --2- 172.21.15.142:0/196252256 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5579e31f9680 0x5579e31fbb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:46.702 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.695+0000 7ff17e919640 1 --2- 172.21.15.142:0/196252256 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5579e31f9680 0x5579e31fbb20 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:46.702 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.696+0000 7ff17e919640 1 -- 172.21.15.142:0/196252256 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(3 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7ff170051070 con 0x5579e31f9680 2024-09-22T08:36:46.702 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.696+0000 7ff180e2f800 1 -- 172.21.15.142:0/196252256 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5579e31f84a0 con 0x5579e30fba20 2024-09-22T08:36:46.702 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.696+0000 7ff17f11a640 1 -- 172.21.15.142:0/196252256 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff17800a4d0 con 0x5579e30fba20 2024-09-22T08:36:46.702 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.696+0000 7ff180e2f800 1 -- 172.21.15.142:0/196252256 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5579e31f8880 con 0x5579e31f9680 2024-09-22T08:36:46.703 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.696+0000 7ff17e919640 1 -- 172.21.15.142:0/196252256 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(5 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7ff170051070 con 0x5579e31f9680 2024-09-22T08:36:46.703 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.697+0000 7ff180e2f800 1 Processor -- start 2024-09-22T08:36:46.703 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.697+0000 7ff180e2f800 1 -- start start 2024-09-22T08:36:46.703 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.697+0000 7ff180e2f800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5579e320ac60 0x5579e320b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:46.703 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.697+0000 7ff180e2f800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5579e2fedd50 con 0x5579e320ac60 2024-09-22T08:36:46.703 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.697+0000 7ff17f11a640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5579e320ac60 0x5579e320b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:46.703 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.697+0000 7ff17f11a640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5579e320ac60 0x5579e320b080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:39464/0 (socket says 172.21.15.142:39464) 2024-09-22T08:36:46.703 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.697+0000 7ff17f11a640 1 -- 172.21.15.142:0/3827845333 learned_addr learned my addr 172.21.15.142:0/3827845333 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:46.703 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.697+0000 7ff17f11a640 1 -- 172.21.15.142:0/3827845333 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5579e320b6c0 con 0x5579e320ac60 2024-09-22T08:36:46.703 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.698+0000 7ff17f11a640 1 --2- 172.21.15.142:0/3827845333 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5579e320ac60 0x5579e320b080 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x5579e31f0d20 tx=0x7ff1780167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:46.703 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.698+0000 7ff068e01640 1 -- 172.21.15.142:0/3827845333 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff178013640 con 0x5579e320ac60 2024-09-22T08:36:46.704 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.698+0000 7ff068e01640 1 -- 172.21.15.142:0/3827845333 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1780137e0 con 0x5579e320ac60 2024-09-22T08:36:46.704 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.698+0000 7ff068e01640 1 -- 172.21.15.142:0/3827845333 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff178013ae0 con 0x5579e320ac60 2024-09-22T08:36:46.704 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.698+0000 7ff180e2f800 1 -- 172.21.15.142:0/3827845333 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5579e320bef0 con 0x5579e320ac60 2024-09-22T08:36:46.704 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.698+0000 7ff180e2f800 1 -- 172.21.15.142:0/3827845333 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5579e320c490 con 0x5579e320ac60 2024-09-22T08:36:46.704 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.699+0000 7ff068e01640 1 -- 172.21.15.142:0/3827845333 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7ff178011040 con 0x5579e320ac60 2024-09-22T08:36:46.704 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.699+0000 7ff068e01640 1 --2- 172.21.15.142:0/3827845333 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7ff05803cfb0 0x7ff05803f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:46.704 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.699+0000 7ff068e01640 1 -- 172.21.15.142:0/3827845333 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7ff17800e040 con 0x5579e320ac60 2024-09-22T08:36:46.704 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.699+0000 7ff17e919640 1 --2- 172.21.15.142:0/3827845333 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7ff05803cfb0 0x7ff05803f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:46.704 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.699+0000 7ff180e2f800 1 Processor -- start 2024-09-22T08:36:46.704 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.699+0000 7ff180e2f800 1 -- start start 2024-09-22T08:36:46.704 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.699+0000 7ff17e919640 1 --2- 172.21.15.142:0/3827845333 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7ff05803cfb0 0x7ff05803f470 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7ff170068fd0 tx=0x7ff17005d620 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:46.704 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.699+0000 7ff180e2f800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5579e3217780 0x5579e3217b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:46.704 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.699+0000 7ff180e2f800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5579e31e8c30 con 0x5579e3217780 2024-09-22T08:36:46.705 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.700+0000 7ff17f11a640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5579e3217780 0x5579e3217b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:46.705 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.700+0000 7ff17f11a640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5579e3217780 0x5579e3217b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:39480/0 (socket says 172.21.15.142:39480) 2024-09-22T08:36:46.705 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.700+0000 7ff17f11a640 1 -- 172.21.15.142:0/4053167704 learned_addr learned my addr 172.21.15.142:0/4053167704 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:46.721 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.700+0000 7ff17f11a640 1 -- 172.21.15.142:0/4053167704 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5579e3218170 con 0x5579e3217780 2024-09-22T08:36:46.721 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.700+0000 7ff17f11a640 1 --2- 172.21.15.142:0/4053167704 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5579e3217780 0x5579e3217b80 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7ff178020000 tx=0x7ff17801f400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46633aa31fb1aaea server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:46.721 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.700+0000 7ff0627fc640 1 -- 172.21.15.142:0/4053167704 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff178056070 con 0x5579e3217780 2024-09-22T08:36:46.721 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.700+0000 7ff0627fc640 1 -- 172.21.15.142:0/4053167704 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff178052070 con 0x5579e3217780 2024-09-22T08:36:46.721 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.700+0000 7ff0627fc640 1 -- 172.21.15.142:0/4053167704 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff178021960 con 0x5579e3217780 2024-09-22T08:36:46.721 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.701+0000 7ff180e2f800 1 -- 172.21.15.142:0/4053167704 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5579e3217780 msgr2=0x5579e3217b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:46.721 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.701+0000 7ff180e2f800 1 --2- 172.21.15.142:0/4053167704 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5579e3217780 0x5579e3217b80 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7ff178020000 tx=0x7ff17801f400 comp rx=0 tx=0).stop 2024-09-22T08:36:46.722 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.701+0000 7ff180e2f800 1 -- 172.21.15.142:0/4053167704 shutdown_connections 2024-09-22T08:36:46.722 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.701+0000 7ff180e2f800 1 --2- 172.21.15.142:0/4053167704 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5579e3217780 0x5579e3217b80 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:46.722 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.701+0000 7ff180e2f800 1 -- 172.21.15.142:0/4053167704 >> 172.21.15.142:0/4053167704 conn(0x5579e3213b80 msgr2=0x5579e3211dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:46.722 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.701+0000 7ff180e2f800 1 -- 172.21.15.142:0/4053167704 shutdown_connections 2024-09-22T08:36:46.722 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.701+0000 7ff180e2f800 1 -- 172.21.15.142:0/4053167704 wait complete. 2024-09-22T08:36:46.722 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.701+0000 7ff180e2f800 1 Processor -- start 2024-09-22T08:36:46.722 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.701+0000 7ff180e2f800 1 -- start start 2024-09-22T08:36:46.722 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.701+0000 7ff180e2f800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5579e3217780 0x5579e321ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:46.722 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.701+0000 7ff180e2f800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5579e3218790 con 0x5579e3217780 2024-09-22T08:36:46.722 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.702+0000 7ff17f11a640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5579e3217780 0x5579e321ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:46.722 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.702+0000 7ff17f11a640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5579e3217780 0x5579e321ecf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:39492/0 (socket says 172.21.15.142:39492) 2024-09-22T08:36:46.723 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.702+0000 7ff17f11a640 1 -- 172.21.15.142:0/3965501416 learned_addr learned my addr 172.21.15.142:0/3965501416 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:46.723 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.702+0000 7ff17f11a640 1 -- 172.21.15.142:0/3965501416 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5579e321f250 con 0x5579e3217780 2024-09-22T08:36:46.723 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.702+0000 7ff17f11a640 1 --2- 172.21.15.142:0/3965501416 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5579e3217780 0x5579e321ecf0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7ff178054800 tx=0x7ff178054860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:46.723 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.702+0000 7ff060ff9640 1 -- 172.21.15.142:0/3965501416 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff178020bd0 con 0x5579e3217780 2024-09-22T08:36:46.723 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.702+0000 7ff060ff9640 1 -- 172.21.15.142:0/3965501416 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff178020d70 con 0x5579e3217780 2024-09-22T08:36:46.723 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.702+0000 7ff180e2f800 1 -- 172.21.15.142:0/3965501416 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5579e321f4e0 con 0x5579e3217780 2024-09-22T08:36:46.723 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.702+0000 7ff060ff9640 1 -- 172.21.15.142:0/3965501416 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff17801fa90 con 0x5579e3217780 2024-09-22T08:36:46.723 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.702+0000 7ff180e2f800 1 -- 172.21.15.142:0/3965501416 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5579e321fe60 con 0x5579e3217780 2024-09-22T08:36:46.723 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.703+0000 7ff060ff9640 1 -- 172.21.15.142:0/3965501416 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7ff17801fc30 con 0x5579e3217780 2024-09-22T08:36:46.723 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.703+0000 7ff060ff9640 1 --2- 172.21.15.142:0/3965501416 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7ff04803cfb0 0x7ff04803f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:46.723 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.703+0000 7ff060ff9640 1 -- 172.21.15.142:0/3965501416 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7ff17804d050 con 0x5579e3217780 2024-09-22T08:36:46.724 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.703+0000 7ff17e919640 1 --2- 172.21.15.142:0/3965501416 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7ff04803cfb0 0x7ff04803f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:46.724 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.703+0000 7ff180e2f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:46.724 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.703+0000 7ff180e2f800 1 --2- 172.21.15.142:0/3965501416 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5579e322a680 0x5579e322cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:46.724 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.703+0000 7ff180e2f800 1 -- 172.21.15.142:0/3965501416 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5579e322d290 con 0x5579e322a680 2024-09-22T08:36:46.724 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.704+0000 7ff176118640 1 --2- 172.21.15.142:0/3965501416 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5579e322a680 0x5579e322cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:46.724 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.704+0000 7ff17e919640 1 --2- 172.21.15.142:0/3965501416 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7ff04803cfb0 0x7ff04803f470 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7ff170045a60 tx=0x7ff170082000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:46.724 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.704+0000 7ff176118640 1 --2- 172.21.15.142:0/3965501416 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5579e322a680 0x5579e322cb40 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:46.724 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.704+0000 7ff176118640 1 -- 172.21.15.142:0/3965501416 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff168009050 con 0x5579e322a680 2024-09-22T08:36:46.724 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.704+0000 7ff180e2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:46.724 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.704+0000 7ff180e2f800 20 realm 2024-09-22T08:36:46.724 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.704+0000 7ff180e2f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:46.725 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.704+0000 7ff180e2f800 1 -- 172.21.15.142:0/3965501416 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5579e3229a10 con 0x5579e322a680 2024-09-22T08:36:46.725 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.704+0000 7ff176118640 1 -- 172.21.15.142:0/3965501416 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff168009050 con 0x5579e322a680 2024-09-22T08:36:46.725 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.704+0000 7ff180e2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:46.725 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.704+0000 7ff180e2f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:36:46.725 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.704+0000 7ff180e2f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:46.725 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.704+0000 7ff180e2f800 1 -- 172.21.15.142:0/3965501416 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5579e322dd70 con 0x5579e322a680 2024-09-22T08:36:46.725 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.705+0000 7ff176118640 1 -- 172.21.15.142:0/3965501416 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff168009050 con 0x5579e322a680 2024-09-22T08:36:46.725 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.705+0000 7ff180e2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:46.725 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.705+0000 7ff180e2f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:46.725 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.705+0000 7ff180e2f800 1 -- 172.21.15.142:0/3965501416 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5579e322e640 con 0x5579e322a680 2024-09-22T08:36:46.725 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.705+0000 7ff176118640 1 -- 172.21.15.142:0/3965501416 <== osd.1 v2:172.21.15.142:6816/3192108003 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff168009050 con 0x5579e322a680 2024-09-22T08:36:46.725 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.705+0000 7ff180e2f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:36:46.726 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.705+0000 7ff180e2f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:46.726 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.705+0000 7ff180e2f800 1 --2- 172.21.15.142:0/3965501416 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5579e322ef80 0x5579e3231370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:46.726 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.705+0000 7ff180e2f800 1 -- 172.21.15.142:0/3965501416 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5579e3231ab0 con 0x5579e322ef80 2024-09-22T08:36:46.726 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.705+0000 7ff17f11a640 1 --2- 172.21.15.142:0/3965501416 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5579e322ef80 0x5579e3231370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:46.726 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.705+0000 7ff17f11a640 1 --2- 172.21.15.142:0/3965501416 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5579e322ef80 0x5579e3231370 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:46.726 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.705+0000 7ff17f11a640 1 -- 172.21.15.142:0/3965501416 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(5 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7ff17803a070 con 0x5579e322ef80 2024-09-22T08:36:46.726 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.706+0000 7ff180e2f800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:36:46.726 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.706+0000 7ff180e2f800 20 searching for the correct realm 2024-09-22T08:36:46.726 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.706+0000 7ff180e2f800 1 -- 172.21.15.142:0/3965501416 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5579e3233460 con 0x5579e322ef80 2024-09-22T08:36:46.726 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.706+0000 7ff17f11a640 1 -- 172.21.15.142:0/3965501416 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff17803a070 con 0x5579e322ef80 2024-09-22T08:36:46.727 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.706+0000 7ff17f11a640 1 --2- 172.21.15.142:0/3965501416 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7ff17803b6d0 0x7ff178041570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:46.727 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.706+0000 7ff17f11a640 1 -- 172.21.15.142:0/3965501416 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5579e3233460 con 0x7ff17803b6d0 2024-09-22T08:36:46.727 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.706+0000 7ff17e919640 1 --2- 172.21.15.142:0/3965501416 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7ff17803b6d0 0x7ff178041570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:46.727 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.706+0000 7ff17e919640 1 --2- 172.21.15.142:0/3965501416 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7ff17803b6d0 0x7ff178041570 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:46.727 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.706+0000 7ff17e919640 1 -- 172.21.15.142:0/3965501416 <== osd.2 v2:172.21.15.142:6808/279438927 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff170051070 con 0x7ff17803b6d0 2024-09-22T08:36:46.727 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.706+0000 7ff17e919640 1 --2- 172.21.15.142:0/3965501416 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7ff17005f040 0x7ff17008ff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:46.727 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.706+0000 7ff17e919640 1 -- 172.21.15.142:0/3965501416 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5579e3233460 con 0x7ff17005f040 2024-09-22T08:36:46.727 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.707+0000 7ff176118640 1 --2- 172.21.15.142:0/3965501416 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7ff17005f040 0x7ff17008ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:46.727 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.707+0000 7ff176118640 1 --2- 172.21.15.142:0/3965501416 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7ff17005f040 0x7ff17008ff70 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:46.727 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.707+0000 7ff176118640 1 -- 172.21.15.142:0/3965501416 <== osd.0 v2:172.21.15.31:6800/168281188 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff168009050 con 0x7ff17005f040 2024-09-22T08:36:46.728 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.707+0000 7ff176118640 1 -- 172.21.15.142:0/3965501416 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5579e3233460 con 0x5579e322a680 2024-09-22T08:36:46.728 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.707+0000 7ff176118640 1 -- 172.21.15.142:0/3965501416 <== osd.1 v2:172.21.15.142:6816/3192108003 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff168009050 con 0x5579e322a680 2024-09-22T08:36:46.728 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.707+0000 7ff176118640 1 -- 172.21.15.142:0/3965501416 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5579e3233460 con 0x5579e322a680 2024-09-22T08:36:46.728 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.708+0000 7ff176118640 1 -- 172.21.15.142:0/3965501416 <== osd.1 v2:172.21.15.142:6816/3192108003 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff168029040 con 0x5579e322a680 2024-09-22T08:36:46.728 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.708+0000 7ff176118640 1 -- 172.21.15.142:0/3965501416 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5579e3233460 con 0x7ff17005f040 2024-09-22T08:36:46.728 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.708+0000 7ff176118640 1 -- 172.21.15.142:0/3965501416 <== osd.0 v2:172.21.15.31:6800/168281188 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff168029040 con 0x7ff17005f040 2024-09-22T08:36:46.728 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.708+0000 7ff176118640 1 -- 172.21.15.142:0/3965501416 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5579e3233460 con 0x7ff17005f040 2024-09-22T08:36:46.728 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.708+0000 7ff176118640 1 -- 172.21.15.142:0/3965501416 <== osd.0 v2:172.21.15.31:6800/168281188 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff168029040 con 0x7ff17005f040 2024-09-22T08:36:46.728 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.708+0000 7ff176118640 1 -- 172.21.15.142:0/3965501416 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5579e3233460 con 0x7ff17803b6d0 2024-09-22T08:36:46.729 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.708+0000 7ff17e919640 1 -- 172.21.15.142:0/3965501416 <== osd.2 v2:172.21.15.142:6808/279438927 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff170051070 con 0x7ff17803b6d0 2024-09-22T08:36:46.729 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.708+0000 7ff17e919640 1 -- 172.21.15.142:0/3965501416 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5579e3233460 con 0x5579e322ef80 2024-09-22T08:36:46.729 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.709+0000 7ff17f11a640 1 -- 172.21.15.142:0/3965501416 <== osd.3 v2:172.21.15.142:6800/1064901393 3 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff17803a070 con 0x5579e322ef80 2024-09-22T08:36:46.729 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.709+0000 7ff17f11a640 1 -- 172.21.15.142:0/3965501416 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5579e3233460 con 0x5579e322a680 2024-09-22T08:36:46.729 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.709+0000 7ff176118640 1 -- 172.21.15.142:0/3965501416 <== osd.1 v2:172.21.15.142:6816/3192108003 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff168029040 con 0x5579e322a680 2024-09-22T08:36:46.729 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.709+0000 7ff176118640 1 -- 172.21.15.142:0/3965501416 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5579e3233460 con 0x7ff17005f040 2024-09-22T08:36:46.729 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.709+0000 7ff176118640 1 -- 172.21.15.142:0/3965501416 <== osd.0 v2:172.21.15.31:6800/168281188 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff168029040 con 0x7ff17005f040 2024-09-22T08:36:46.729 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.709+0000 7ff176118640 1 -- 172.21.15.142:0/3965501416 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5579e3233460 con 0x5579e322a680 2024-09-22T08:36:46.729 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.709+0000 7ff176118640 1 -- 172.21.15.142:0/3965501416 <== osd.1 v2:172.21.15.142:6816/3192108003 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff168029040 con 0x5579e322a680 2024-09-22T08:36:46.729 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.709+0000 7ff176118640 1 -- 172.21.15.142:0/3965501416 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5579e3233460 con 0x7ff17803b6d0 2024-09-22T08:36:46.729 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.710+0000 7ff17e919640 1 -- 172.21.15.142:0/3965501416 <== osd.2 v2:172.21.15.142:6808/279438927 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7ff170051070 con 0x7ff17803b6d0 2024-09-22T08:36:46.729 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.710+0000 7ff17e919640 1 -- 172.21.15.142:0/3965501416 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5579e3233460 con 0x5579e322ef80 2024-09-22T08:36:46.730 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.710+0000 7ff17f11a640 1 -- 172.21.15.142:0/3965501416 <== osd.3 v2:172.21.15.142:6800/1064901393 4 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff17803a070 con 0x5579e322ef80 2024-09-22T08:36:46.730 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.710+0000 7ff17f11a640 1 -- 172.21.15.142:0/3965501416 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5579e3233460 con 0x5579e322ef80 2024-09-22T08:36:46.730 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.710+0000 7ff17f11a640 1 -- 172.21.15.142:0/3965501416 <== osd.3 v2:172.21.15.142:6800/1064901393 5 ==== osd_op_reply(20 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7ff17803a070 con 0x5579e322ef80 2024-09-22T08:36:46.730 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.710+0000 7ff17f11a640 1 -- 172.21.15.142:0/3965501416 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5579e3233460 con 0x7ff17005f040 2024-09-22T08:36:46.730 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.710+0000 7ff176118640 1 -- 172.21.15.142:0/3965501416 <== osd.0 v2:172.21.15.31:6800/168281188 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff168029040 con 0x7ff17005f040 2024-09-22T08:36:46.730 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.710+0000 7ff176118640 1 -- 172.21.15.142:0/3965501416 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5579e3233460 con 0x5579e322ef80 2024-09-22T08:36:46.730 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.710+0000 7ff17f11a640 1 -- 172.21.15.142:0/3965501416 <== osd.3 v2:172.21.15.142:6800/1064901393 6 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff17803a070 con 0x5579e322ef80 2024-09-22T08:36:46.730 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.711+0000 7ff17f11a640 1 -- 172.21.15.142:0/3965501416 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5579e3233460 con 0x5579e322ef80 2024-09-22T08:36:46.730 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.711+0000 7ff17f11a640 1 -- 172.21.15.142:0/3965501416 <== osd.3 v2:172.21.15.142:6800/1064901393 7 ==== osd_op_reply(23 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7ff17803a070 con 0x5579e322ef80 2024-09-22T08:36:46.730 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.711+0000 7ff17f11a640 1 -- 172.21.15.142:0/3965501416 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5579e3233460 con 0x5579e322a680 2024-09-22T08:36:46.730 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.711+0000 7ff176118640 1 -- 172.21.15.142:0/3965501416 <== osd.1 v2:172.21.15.142:6816/3192108003 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff168029040 con 0x5579e322a680 2024-09-22T08:36:46.730 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.711+0000 7ff176118640 1 -- 172.21.15.142:0/3965501416 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5579e3233460 con 0x5579e322a680 2024-09-22T08:36:46.730 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.711+0000 7ff176118640 1 -- 172.21.15.142:0/3965501416 <== osd.1 v2:172.21.15.142:6816/3192108003 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7ff168029040 con 0x5579e322a680 2024-09-22T08:36:46.731 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.711+0000 7ff176118640 1 -- 172.21.15.142:0/3965501416 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5579e3233460 con 0x7ff17005f040 2024-09-22T08:36:46.731 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.711+0000 7ff176118640 1 -- 172.21.15.142:0/3965501416 <== osd.0 v2:172.21.15.31:6800/168281188 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff168029040 con 0x7ff17005f040 2024-09-22T08:36:46.731 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.711+0000 7ff176118640 1 -- 172.21.15.142:0/3965501416 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5579e3233460 con 0x5579e322ef80 2024-09-22T08:36:46.731 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.712+0000 7ff17f11a640 1 -- 172.21.15.142:0/3965501416 <== osd.3 v2:172.21.15.142:6800/1064901393 8 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff17803a070 con 0x5579e322ef80 2024-09-22T08:36:46.731 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.712+0000 7ff17f11a640 1 -- 172.21.15.142:0/3965501416 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5579e3233460 con 0x7ff17803b6d0 2024-09-22T08:36:46.731 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.712+0000 7ff17e919640 1 -- 172.21.15.142:0/3965501416 <== osd.2 v2:172.21.15.142:6808/279438927 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff170051070 con 0x7ff17803b6d0 2024-09-22T08:36:46.731 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.712+0000 7ff17e919640 1 -- 172.21.15.142:0/3965501416 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5579e3233460 con 0x5579e322a680 2024-09-22T08:36:46.731 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.712+0000 7ff176118640 1 -- 172.21.15.142:0/3965501416 <== osd.1 v2:172.21.15.142:6816/3192108003 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff168029040 con 0x5579e322a680 2024-09-22T08:36:46.731 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.712+0000 7ff176118640 1 -- 172.21.15.142:0/3965501416 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5579e3233460 con 0x7ff17005f040 2024-09-22T08:36:46.731 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.712+0000 7ff176118640 1 -- 172.21.15.142:0/3965501416 <== osd.0 v2:172.21.15.31:6800/168281188 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff168029040 con 0x7ff17005f040 2024-09-22T08:36:46.731 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.712+0000 7ff176118640 1 -- 172.21.15.142:0/3965501416 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5579e3233460 con 0x5579e322ef80 2024-09-22T08:36:46.731 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.713+0000 7ff17f11a640 1 -- 172.21.15.142:0/3965501416 <== osd.3 v2:172.21.15.142:6800/1064901393 9 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff17803a070 con 0x5579e322ef80 2024-09-22T08:36:46.732 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.713+0000 7ff17f11a640 1 -- 172.21.15.142:0/3965501416 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5579e3233460 con 0x7ff17005f040 2024-09-22T08:36:46.732 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.713+0000 7ff176118640 1 -- 172.21.15.142:0/3965501416 <== osd.0 v2:172.21.15.31:6800/168281188 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff168029040 con 0x7ff17005f040 2024-09-22T08:36:46.732 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.713+0000 7ff176118640 1 -- 172.21.15.142:0/3965501416 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5579e3233460 con 0x7ff17803b6d0 2024-09-22T08:36:46.732 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.713+0000 7ff17e919640 1 -- 172.21.15.142:0/3965501416 <== osd.2 v2:172.21.15.142:6808/279438927 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff170051070 con 0x7ff17803b6d0 2024-09-22T08:36:46.732 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.713+0000 7ff17e919640 1 -- 172.21.15.142:0/3965501416 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5579e3233460 con 0x5579e322ef80 2024-09-22T08:36:46.732 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.713+0000 7ff17f11a640 1 -- 172.21.15.142:0/3965501416 <== osd.3 v2:172.21.15.142:6800/1064901393 10 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff17803a070 con 0x5579e322ef80 2024-09-22T08:36:46.732 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.713+0000 7ff17f11a640 1 -- 172.21.15.142:0/3965501416 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5579e3233460 con 0x7ff17005f040 2024-09-22T08:36:46.732 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.714+0000 7ff176118640 1 -- 172.21.15.142:0/3965501416 <== osd.0 v2:172.21.15.31:6800/168281188 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff168029040 con 0x7ff17005f040 2024-09-22T08:36:46.732 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.714+0000 7ff176118640 1 -- 172.21.15.142:0/3965501416 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5579e3233460 con 0x5579e322a680 2024-09-22T08:36:46.732 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.714+0000 7ff176118640 1 -- 172.21.15.142:0/3965501416 <== osd.1 v2:172.21.15.142:6816/3192108003 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7ff168029040 con 0x5579e322a680 2024-09-22T08:36:46.732 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.714+0000 7ff176118640 1 -- 172.21.15.142:0/3965501416 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5579e3233460 con 0x7ff17803b6d0 2024-09-22T08:36:46.732 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.714+0000 7ff17e919640 1 -- 172.21.15.142:0/3965501416 <== osd.2 v2:172.21.15.142:6808/279438927 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff170051070 con 0x7ff17803b6d0 2024-09-22T08:36:46.733 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.714+0000 7ff180e2f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:36:46.733 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.714+0000 7ff180e2f800 20 RGWRados::pool_iterate: got zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec 2024-09-22T08:36:46.733 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.714+0000 7ff180e2f800 20 RGWRados::pool_iterate: got zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f 2024-09-22T08:36:46.733 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.714+0000 7ff180e2f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:36:46.733 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.714+0000 7ff180e2f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:36:46.733 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.714+0000 7ff180e2f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:36:46.733 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.714+0000 7ff180e2f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:46.733 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.714+0000 7ff180e2f800 1 -- 172.21.15.142:0/3965501416 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5579e3232530 con 0x5579e322a680 2024-09-22T08:36:46.733 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.714+0000 7ff176118640 1 -- 172.21.15.142:0/3965501416 <== osd.1 v2:172.21.15.142:6816/3192108003 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff168029040 con 0x5579e322a680 2024-09-22T08:36:46.733 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.714+0000 7ff180e2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:46.733 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.714+0000 7ff180e2f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:46.733 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.714+0000 7ff180e2f800 1 -- 172.21.15.142:0/3965501416 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5579e3232dd0 con 0x5579e322a680 2024-09-22T08:36:46.733 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.715+0000 7ff176118640 1 -- 172.21.15.142:0/3965501416 <== osd.1 v2:172.21.15.142:6816/3192108003 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff168029040 con 0x5579e322a680 2024-09-22T08:36:46.734 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.715+0000 7ff180e2f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:36:46.734 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.715+0000 7ff180e2f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:46.734 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.715+0000 7ff180e2f800 1 -- 172.21.15.142:0/3965501416 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:40 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5579e3232170 con 0x5579e322ef80 2024-09-22T08:36:46.734 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.715+0000 7ff17f11a640 1 -- 172.21.15.142:0/3965501416 <== osd.3 v2:172.21.15.142:6800/1064901393 11 ==== osd_op_reply(40 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7ff17803a070 con 0x5579e322ef80 2024-09-22T08:36:46.734 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.715+0000 7ff180e2f800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:36:46.734 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.715+0000 7ff180e2f800 20 zone default found 2024-09-22T08:36:46.734 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.715+0000 7ff180e2f800 4 Realm: () 2024-09-22T08:36:46.734 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.715+0000 7ff180e2f800 4 ZoneGroup: default (d89f6f57-1007-47dd-9065-f486c7b01aec) 2024-09-22T08:36:46.734 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.715+0000 7ff180e2f800 4 Zone: default (e239248c-0bee-4e41-803a-24b288d3eb8f) 2024-09-22T08:36:46.734 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.715+0000 7ff180e2f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:36:46.734 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.715+0000 7ff180e2f800 20 zonegroup default 2024-09-22T08:36:46.734 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.715+0000 7ff180e2f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:46.734 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.715+0000 7ff180e2f800 1 -- 172.21.15.142:0/3965501416 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5579e3232a00 con 0x7ff17005f040 2024-09-22T08:36:46.734 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.715+0000 7ff176118640 1 -- 172.21.15.142:0/3965501416 <== osd.0 v2:172.21.15.31:6800/168281188 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7ff168029040 con 0x7ff17005f040 2024-09-22T08:36:46.735 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.715+0000 7ff180e2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:46.735 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.715+0000 7ff180e2f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:46.735 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.715+0000 7ff180e2f800 1 -- 172.21.15.142:0/3965501416 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5579e3235cd0 con 0x5579e322ef80 2024-09-22T08:36:46.735 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.716+0000 7ff17f11a640 1 -- 172.21.15.142:0/3965501416 <== osd.3 v2:172.21.15.142:6800/1064901393 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff17803a070 con 0x5579e322ef80 2024-09-22T08:36:46.735 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.716+0000 7ff180e2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:46.735 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.716+0000 7ff180e2f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:46.735 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.716+0000 7ff180e2f800 1 -- 172.21.15.142:0/3965501416 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5579e3236070 con 0x5579e322ef80 2024-09-22T08:36:46.735 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.716+0000 7ff17f11a640 1 -- 172.21.15.142:0/3965501416 <== osd.3 v2:172.21.15.142:6800/1064901393 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff17803a070 con 0x5579e322ef80 2024-09-22T08:36:46.735 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.716+0000 7ff180e2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:46.735 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.716+0000 7ff180e2f800 20 started sync module instance, tier type = 2024-09-22T08:36:46.735 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.716+0000 7ff180e2f800 20 started zone id=e239248c-0bee-4e41-803a-24b288d3eb8f (name=default) with tier type = 2024-09-22T08:36:46.735 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.716+0000 7ff180e2f800 1 -- 172.21.15.142:0/3965501416 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5579e3235160 con 0x7ff17803b6d0 2024-09-22T08:36:46.735 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.717+0000 7ff17e919640 1 -- 172.21.15.142:0/3965501416 <== osd.2 v2:172.21.15.142:6808/279438927 7 ==== osd_op_reply(44 notify.0 [create] v30'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff170051070 con 0x7ff17803b6d0 2024-09-22T08:36:46.736 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.717+0000 7ff180e2f800 1 -- 172.21.15.142:0/3965501416 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93981990147408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5579e3236930 con 0x7ff17803b6d0 2024-09-22T08:36:46.736 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.717+0000 7ff180e2f800 1 -- 172.21.15.142:0/3965501416 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5579e3237180 con 0x5579e322a680 2024-09-22T08:36:46.736 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.718+0000 7ff17e919640 1 -- 172.21.15.142:0/3965501416 <== osd.2 v2:172.21.15.142:6808/279438927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93981990147408] v30'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff170051070 con 0x7ff17803b6d0 2024-09-22T08:36:46.736 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.718+0000 7ff176118640 1 -- 172.21.15.142:0/3965501416 <== osd.1 v2:172.21.15.142:6816/3192108003 15 ==== osd_op_reply(46 notify.1 [create] v30'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff168029040 con 0x5579e322a680 2024-09-22T08:36:46.736 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.718+0000 7ff180e2f800 1 -- 172.21.15.142:0/3965501416 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93981990153424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5579e32375a0 con 0x5579e322a680 2024-09-22T08:36:46.736 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.718+0000 7ff180e2f800 1 -- 172.21.15.142:0/3965501416 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5579e3237df0 con 0x5579e322ef80 2024-09-22T08:36:46.736 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.719+0000 7ff176118640 1 -- 172.21.15.142:0/3965501416 <== osd.1 v2:172.21.15.142:6816/3192108003 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93981990153424] v30'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff168029040 con 0x5579e322a680 2024-09-22T08:36:46.736 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.719+0000 7ff17f11a640 1 -- 172.21.15.142:0/3965501416 <== osd.3 v2:172.21.15.142:6800/1064901393 14 ==== osd_op_reply(48 notify.2 [create] v30'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff17803a070 con 0x5579e322ef80 2024-09-22T08:36:46.736 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.719+0000 7ff180e2f800 1 -- 172.21.15.142:0/3965501416 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93981990154960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5579e3237d00 con 0x5579e322ef80 2024-09-22T08:36:46.736 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.719+0000 7ff180e2f800 1 -- 172.21.15.142:0/3965501416 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5579e32387f0 con 0x7ff17803b6d0 2024-09-22T08:36:46.752 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.720+0000 7ff17e919640 1 -- 172.21.15.142:0/3965501416 <== osd.2 v2:172.21.15.142:6808/279438927 9 ==== osd_op_reply(50 notify.3 [create] v30'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff170051070 con 0x7ff17803b6d0 2024-09-22T08:36:46.752 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.720+0000 7ff180e2f800 1 -- 172.21.15.142:0/3965501416 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93981990159040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5579e32387f0 con 0x7ff17803b6d0 2024-09-22T08:36:46.753 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.720+0000 7ff17f11a640 1 -- 172.21.15.142:0/3965501416 <== osd.3 v2:172.21.15.142:6800/1064901393 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 93981990154960] v30'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff17803a070 con 0x5579e322ef80 2024-09-22T08:36:46.753 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.720+0000 7ff180e2f800 1 -- 172.21.15.142:0/3965501416 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5579e32397d0 con 0x5579e322a680 2024-09-22T08:36:46.753 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.721+0000 7ff176118640 1 -- 172.21.15.142:0/3965501416 <== osd.1 v2:172.21.15.142:6816/3192108003 17 ==== osd_op_reply(52 notify.4 [create] v30'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff168029040 con 0x5579e322a680 2024-09-22T08:36:46.753 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.721+0000 7ff180e2f800 1 -- 172.21.15.142:0/3965501416 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93981990156112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5579e3239790 con 0x5579e322a680 2024-09-22T08:36:46.753 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.721+0000 7ff180e2f800 1 -- 172.21.15.142:0/3965501416 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5579e323a260 con 0x7ff17005f040 2024-09-22T08:36:46.753 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.721+0000 7ff17e919640 1 -- 172.21.15.142:0/3965501416 <== osd.2 v2:172.21.15.142:6808/279438927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93981990159040] v30'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff170051070 con 0x7ff17803b6d0 2024-09-22T08:36:46.754 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.722+0000 7ff176118640 1 -- 172.21.15.142:0/3965501416 <== osd.0 v2:172.21.15.31:6800/168281188 11 ==== osd_op_reply(54 notify.5 [create] v30'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff168029040 con 0x7ff17005f040 2024-09-22T08:36:46.754 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.722+0000 7ff180e2f800 1 -- 172.21.15.142:0/3965501416 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93981990161376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5579e323a260 con 0x7ff17005f040 2024-09-22T08:36:46.754 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.722+0000 7ff180e2f800 1 -- 172.21.15.142:0/3965501416 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5579e323ac70 con 0x7ff17005f040 2024-09-22T08:36:46.754 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.722+0000 7ff176118640 1 -- 172.21.15.142:0/3965501416 <== osd.1 v2:172.21.15.142:6816/3192108003 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93981990156112] v30'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff168029040 con 0x5579e322a680 2024-09-22T08:36:46.754 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.723+0000 7ff176118640 1 -- 172.21.15.142:0/3965501416 <== osd.0 v2:172.21.15.31:6800/168281188 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93981990161376] v30'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff168029040 con 0x7ff17005f040 2024-09-22T08:36:46.754 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.723+0000 7ff176118640 1 -- 172.21.15.142:0/3965501416 <== osd.0 v2:172.21.15.31:6800/168281188 13 ==== osd_op_reply(56 notify.6 [create] v30'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff168029040 con 0x7ff17005f040 2024-09-22T08:36:46.755 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.723+0000 7ff180e2f800 1 -- 172.21.15.142:0/3965501416 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93981990163168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5579e323a7c0 con 0x7ff17005f040 2024-09-22T08:36:46.755 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.723+0000 7ff180e2f800 1 -- 172.21.15.142:0/3965501416 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5579e323b510 con 0x7ff17005f040 2024-09-22T08:36:46.755 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.725+0000 7ff176118640 1 -- 172.21.15.142:0/3965501416 <== osd.0 v2:172.21.15.31:6800/168281188 14 ==== osd_op_reply(58 notify.7 [create] v30'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff168029040 con 0x7ff17005f040 2024-09-22T08:36:46.755 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.725+0000 7ff176118640 1 -- 172.21.15.142:0/3965501416 <== osd.0 v2:172.21.15.31:6800/168281188 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93981990163168] v30'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff168029040 con 0x7ff17005f040 2024-09-22T08:36:46.755 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.725+0000 7ff180e2f800 1 -- 172.21.15.142:0/3965501416 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93981990170720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5579e323a7c0 con 0x7ff17005f040 2024-09-22T08:36:46.755 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.725+0000 7ff180e2f800 20 add_watcher() i=0 2024-09-22T08:36:46.756 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.725+0000 7ff180e2f800 20 add_watcher() i=1 2024-09-22T08:36:46.756 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.725+0000 7ff180e2f800 20 add_watcher() i=2 2024-09-22T08:36:46.756 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.725+0000 7ff180e2f800 20 add_watcher() i=3 2024-09-22T08:36:46.756 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.725+0000 7ff180e2f800 20 add_watcher() i=4 2024-09-22T08:36:46.756 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.725+0000 7ff180e2f800 20 add_watcher() i=5 2024-09-22T08:36:46.756 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.725+0000 7ff180e2f800 20 add_watcher() i=6 2024-09-22T08:36:46.757 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.726+0000 7ff176118640 1 -- 172.21.15.142:0/3965501416 <== osd.0 v2:172.21.15.31:6800/168281188 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93981990170720] v30'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff168029040 con 0x7ff17005f040 2024-09-22T08:36:46.757 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.726+0000 7ff180e2f800 20 add_watcher() i=7 2024-09-22T08:36:46.757 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.726+0000 7ff180e2f800 2 all 8 watchers are set, enabling cache 2024-09-22T08:36:46.757 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.726+0000 7ff180e2f800 1 -- 172.21.15.142:0/3965501416 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5579e323e630 con 0x5579e322a680 2024-09-22T08:36:46.757 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.726+0000 7ff176118640 1 -- 172.21.15.142:0/3965501416 <== osd.1 v2:172.21.15.142:6816/3192108003 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7ff168029040 con 0x5579e322a680 2024-09-22T08:36:46.757 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.726+0000 7ff180e2f800 1 -- 172.21.15.142:0/3965501416 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93981990165856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5579e323b990 con 0x5579e322a680 2024-09-22T08:36:46.758 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.727+0000 7ff176118640 1 -- 172.21.15.142:0/3965501416 <== osd.1 v2:172.21.15.142:6816/3192108003 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93981990165856] v30'108 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff168029040 con 0x5579e322a680 2024-09-22T08:36:46.758 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.727+0000 7ff0357e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:36:46.758 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.727+0000 7ff180e2f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:36:46.758 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.727+0000 7ff180e2f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:36:46.758 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.727+0000 7ff180e2f800 5 note: GC not initialized 2024-09-22T08:36:46.758 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.727+0000 7fefaffff640 20 reqs_thread_entry: start 2024-09-22T08:36:46.759 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.728+0000 7ff180e2f800 20 init_complete bucket index max shards: 11 2024-09-22T08:36:46.759 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.728+0000 7ff180e2f800 20 Filter name: none 2024-09-22T08:36:46.759 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.728+0000 7fefadffb640 20 reqs_thread_entry: start 2024-09-22T08:36:46.759 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.728+0000 7ff180e2f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:46.759 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.728+0000 7ff180e2f800 1 -- 172.21.15.142:0/3965501416 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5579e32714e0 con 0x7ff17803b6d0 2024-09-22T08:36:46.759 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.728+0000 7ff17e919640 1 -- 172.21.15.142:0/3965501416 <== osd.2 v2:172.21.15.142:6808/279438927 11 ==== osd_op_reply(62 myfoo [call out=48b,stat out=16b,read 0~165 out=165b,getxattrs out=75b] v0'0 uv18 ondisk = 0) ==== 275+0+304 (crc 0 0 0) 0x7ff170051070 con 0x7ff17803b6d0 2024-09-22T08:36:46.760 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.728+0000 7ff180e2f800 20 rados_obj.operate() r=0 bl.length=165 2024-09-22T08:36:46.760 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.729+0000 7ff0357e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:36:46.760 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.729+0000 7ff180e2f800 1 -- 172.21.15.142:0/3965501416 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93981990165856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5579e323b4e0 con 0x5579e322a680 2024-09-22T08:36:46.760 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.730+0000 7ff176118640 1 -- 172.21.15.142:0/3965501416 <== osd.1 v2:172.21.15.142:6816/3192108003 21 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 93981990165856] v30'109 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff168029040 con 0x5579e322a680 2024-09-22T08:36:46.760 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.730+0000 7ff180e2f800 1 -- 172.21.15.142:0/3965501416 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93981990147408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5579e326f310 con 0x7ff17803b6d0 2024-09-22T08:36:46.760 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.731+0000 7ff17e919640 1 -- 172.21.15.142:0/3965501416 <== osd.2 v2:172.21.15.142:6808/279438927 12 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 93981990147408] v30'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff170051070 con 0x7ff17803b6d0 2024-09-22T08:36:46.761 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.731+0000 7ff180e2f800 20 remove_watcher() i=0 2024-09-22T08:36:46.761 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.731+0000 7ff180e2f800 2 removed watcher, disabling cache 2024-09-22T08:36:46.761 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.731+0000 7ff180e2f800 1 -- 172.21.15.142:0/3965501416 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93981990153424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5579e326f310 con 0x5579e322a680 2024-09-22T08:36:46.761 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.732+0000 7ff176118640 1 -- 172.21.15.142:0/3965501416 <== osd.1 v2:172.21.15.142:6816/3192108003 22 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 93981990153424] v30'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff168029040 con 0x5579e322a680 2024-09-22T08:36:46.761 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.732+0000 7ff180e2f800 20 remove_watcher() i=1 2024-09-22T08:36:46.761 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.732+0000 7ff180e2f800 1 -- 172.21.15.142:0/3965501416 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93981990154960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5579e326f310 con 0x5579e322ef80 2024-09-22T08:36:46.762 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.733+0000 7ff17f11a640 1 -- 172.21.15.142:0/3965501416 <== osd.3 v2:172.21.15.142:6800/1064901393 16 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 93981990154960] v30'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff17803a070 con 0x5579e322ef80 2024-09-22T08:36:46.762 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.733+0000 7ff180e2f800 20 remove_watcher() i=2 2024-09-22T08:36:46.762 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.733+0000 7ff180e2f800 1 -- 172.21.15.142:0/3965501416 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93981990159040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5579e326f310 con 0x7ff17803b6d0 2024-09-22T08:36:46.762 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.734+0000 7ff17e919640 1 -- 172.21.15.142:0/3965501416 <== osd.2 v2:172.21.15.142:6808/279438927 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 93981990159040] v30'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff170051070 con 0x7ff17803b6d0 2024-09-22T08:36:46.762 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.734+0000 7ff180e2f800 20 remove_watcher() i=3 2024-09-22T08:36:46.762 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.734+0000 7ff180e2f800 1 -- 172.21.15.142:0/3965501416 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93981990156112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5579e326f310 con 0x5579e322a680 2024-09-22T08:36:46.763 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.735+0000 7ff176118640 1 -- 172.21.15.142:0/3965501416 <== osd.1 v2:172.21.15.142:6816/3192108003 23 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 93981990156112] v30'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff168029040 con 0x5579e322a680 2024-09-22T08:36:46.763 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.735+0000 7ff180e2f800 20 remove_watcher() i=4 2024-09-22T08:36:46.763 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.735+0000 7ff180e2f800 1 -- 172.21.15.142:0/3965501416 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93981990161376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5579e326f310 con 0x7ff17005f040 2024-09-22T08:36:46.763 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.736+0000 7ff176118640 1 -- 172.21.15.142:0/3965501416 <== osd.0 v2:172.21.15.31:6800/168281188 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 93981990161376] v30'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff168029040 con 0x7ff17005f040 2024-09-22T08:36:46.763 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.736+0000 7ff180e2f800 20 remove_watcher() i=5 2024-09-22T08:36:46.763 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.736+0000 7ff180e2f800 1 -- 172.21.15.142:0/3965501416 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93981990163168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5579e326f310 con 0x7ff17005f040 2024-09-22T08:36:46.764 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.737+0000 7ff176118640 1 -- 172.21.15.142:0/3965501416 <== osd.0 v2:172.21.15.31:6800/168281188 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 93981990163168] v30'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff168029040 con 0x7ff17005f040 2024-09-22T08:36:46.764 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.737+0000 7ff180e2f800 20 remove_watcher() i=6 2024-09-22T08:36:46.764 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.737+0000 7ff180e2f800 1 -- 172.21.15.142:0/3965501416 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93981990170720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5579e326f310 con 0x7ff17005f040 2024-09-22T08:36:46.764 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.738+0000 7ff176118640 1 -- 172.21.15.142:0/3965501416 <== osd.0 v2:172.21.15.31:6800/168281188 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 93981990170720] v30'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff168029040 con 0x7ff17005f040 2024-09-22T08:36:46.764 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.738+0000 7ff180e2f800 20 remove_watcher() i=7 2024-09-22T08:36:46.764 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.738+0000 7ff180e2f800 1 -- 172.21.15.142:0/3965501416 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7ff17005f040 msgr2=0x7ff17008ff70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:46.765 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.738+0000 7ff180e2f800 1 --2- 172.21.15.142:0/3965501416 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7ff17005f040 0x7ff17008ff70 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:46.765 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.738+0000 7ff180e2f800 1 -- 172.21.15.142:0/3965501416 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5579e322a680 msgr2=0x5579e322cb40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:46.765 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.738+0000 7ff180e2f800 1 --2- 172.21.15.142:0/3965501416 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5579e322a680 0x5579e322cb40 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:46.765 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.738+0000 7ff180e2f800 1 -- 172.21.15.142:0/3965501416 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7ff17803b6d0 msgr2=0x7ff178041570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:46.765 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.738+0000 7ff180e2f800 1 --2- 172.21.15.142:0/3965501416 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7ff17803b6d0 0x7ff178041570 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:46.766 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.738+0000 7ff180e2f800 1 -- 172.21.15.142:0/3965501416 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5579e322ef80 msgr2=0x5579e3231370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:46.766 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.738+0000 7ff180e2f800 1 --2- 172.21.15.142:0/3965501416 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5579e322ef80 0x5579e3231370 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:46.766 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.738+0000 7ff180e2f800 1 -- 172.21.15.142:0/3965501416 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7ff04803cfb0 msgr2=0x7ff04803f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:46.766 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.738+0000 7ff180e2f800 1 --2- 172.21.15.142:0/3965501416 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7ff04803cfb0 0x7ff04803f470 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7ff170045a60 tx=0x7ff170082000 comp rx=0 tx=0).stop 2024-09-22T08:36:46.766 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.738+0000 7ff180e2f800 1 -- 172.21.15.142:0/3965501416 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5579e3217780 msgr2=0x5579e321ecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:46.766 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.738+0000 7ff176118640 1 -- 172.21.15.142:0/3965501416 reap_dead start 2024-09-22T08:36:46.767 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.738+0000 7ff180e2f800 1 --2- 172.21.15.142:0/3965501416 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5579e3217780 0x5579e321ecf0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7ff178054800 tx=0x7ff178054860 comp rx=0 tx=0).stop 2024-09-22T08:36:46.767 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.738+0000 7ff180e2f800 1 -- 172.21.15.142:0/3965501416 shutdown_connections 2024-09-22T08:36:46.767 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.738+0000 7ff180e2f800 1 --2- 172.21.15.142:0/3965501416 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5579e3217780 0x5579e321ecf0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:46.767 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.738+0000 7ff180e2f800 1 -- 172.21.15.142:0/3965501416 >> 172.21.15.142:0/3965501416 conn(0x5579e3213b80 msgr2=0x5579e3211d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:46.767 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.738+0000 7ff180e2f800 1 -- 172.21.15.142:0/3965501416 shutdown_connections 2024-09-22T08:36:46.767 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.738+0000 7ff180e2f800 1 -- 172.21.15.142:0/3965501416 wait complete. 2024-09-22T08:36:46.768 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.739+0000 7ff180e2f800 1 -- 172.21.15.142:0/3827845333 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7ff05803cfb0 msgr2=0x7ff05803f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:46.768 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.739+0000 7ff180e2f800 1 --2- 172.21.15.142:0/3827845333 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7ff05803cfb0 0x7ff05803f470 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7ff170068fd0 tx=0x7ff17005d620 comp rx=0 tx=0).stop 2024-09-22T08:36:46.768 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.739+0000 7ff180e2f800 1 -- 172.21.15.142:0/3827845333 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5579e320ac60 msgr2=0x5579e320b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:46.768 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.739+0000 7ff180e2f800 1 --2- 172.21.15.142:0/3827845333 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5579e320ac60 0x5579e320b080 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x5579e31f0d20 tx=0x7ff1780167b0 comp rx=0 tx=0).stop 2024-09-22T08:36:46.769 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.739+0000 7ff180e2f800 1 -- 172.21.15.142:0/3827845333 shutdown_connections 2024-09-22T08:36:46.770 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.739+0000 7ff180e2f800 1 --2- 172.21.15.142:0/3827845333 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7ff05803cfb0 0x7ff05803f470 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:46.770 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.739+0000 7ff180e2f800 1 --2- 172.21.15.142:0/3827845333 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5579e320ac60 0x5579e320b080 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:46.770 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.739+0000 7ff180e2f800 1 -- 172.21.15.142:0/3827845333 >> 172.21.15.142:0/3827845333 conn(0x5579e31ff010 msgr2=0x5579e31ff3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:46.770 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.739+0000 7ff180e2f800 1 -- 172.21.15.142:0/3827845333 shutdown_connections 2024-09-22T08:36:46.770 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.739+0000 7ff180e2f800 1 -- 172.21.15.142:0/3827845333 wait complete. 2024-09-22T08:36:46.770 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.739+0000 7ff180e2f800 1 -- 172.21.15.142:0/196252256 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5579e30fba20 msgr2=0x5579e31f7370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:46.771 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.739+0000 7ff180e2f800 1 --2- 172.21.15.142:0/196252256 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5579e30fba20 0x5579e31f7370 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:46.771 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.739+0000 7ff180e2f800 1 -- 172.21.15.142:0/196252256 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5579e31f9680 msgr2=0x5579e31fbb20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:46.771 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.739+0000 7ff180e2f800 1 --2- 172.21.15.142:0/196252256 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5579e31f9680 0x5579e31fbb20 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:46.771 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.739+0000 7ff180e2f800 1 -- 172.21.15.142:0/196252256 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7ff06403d000 msgr2=0x7ff06403f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:46.771 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.739+0000 7ff180e2f800 1 --2- 172.21.15.142:0/196252256 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7ff06403d000 0x7ff06403f4c0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7ff168001d70 tx=0x7ff1680012d0 comp rx=0 tx=0).stop 2024-09-22T08:36:46.771 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.739+0000 7ff180e2f800 1 -- 172.21.15.142:0/196252256 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5579e3069d30 msgr2=0x5579e31efd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:46.772 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.739+0000 7ff180e2f800 1 --2- 172.21.15.142:0/196252256 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5579e3069d30 0x5579e31efd20 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7ff170025c20 tx=0x7ff170002fb0 comp rx=0 tx=0).stop 2024-09-22T08:36:46.772 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.739+0000 7ff180e2f800 1 -- 172.21.15.142:0/196252256 shutdown_connections 2024-09-22T08:36:46.772 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.739+0000 7ff180e2f800 1 --2- 172.21.15.142:0/196252256 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5579e31f9680 0x5579e31fbb20 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:46.772 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.739+0000 7ff180e2f800 1 --2- 172.21.15.142:0/196252256 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5579e30fba20 0x5579e31f7370 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:46.772 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.739+0000 7ff180e2f800 1 --2- 172.21.15.142:0/196252256 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7ff06403d000 0x7ff06403f4c0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:46.772 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.739+0000 7ff180e2f800 1 --2- 172.21.15.142:0/196252256 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5579e3069d30 0x5579e31efd20 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:46.773 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.739+0000 7ff180e2f800 1 -- 172.21.15.142:0/196252256 >> 172.21.15.142:0/196252256 conn(0x5579e30f0bb0 msgr2=0x5579e31e23e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:46.773 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.739+0000 7ff180e2f800 1 -- 172.21.15.142:0/196252256 shutdown_connections 2024-09-22T08:36:46.773 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.739+0000 7ff180e2f800 1 -- 172.21.15.142:0/196252256 wait complete. 2024-09-22T08:36:46.774 INFO:teuthology.orchestra.run.smithi142.stdout:{"key":"bucket:myfoo","ver":{"tag":"_WtXt5bFXxSmskXUHwyCdi3T","ver":2},"mtime":"2024-09-22T08:36:46.448114Z","data":{"bucket":{"name":"myfoo","marker":"e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1","bucket_id":"e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1","tenant":"","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""}},"owner":"foo","creation_time":"2024-09-22T08:36:45.359780Z","linked":false,"has_bucket_info":false}} 2024-09-22T08:36:46.775 DEBUG:tasks.util.rgw: json result: {'key': 'bucket:myfoo', 'ver': {'tag': '_WtXt5bFXxSmskXUHwyCdi3T', 'ver': 2}, 'mtime': '2024-09-22T08:36:46.448114Z', 'data': {'bucket': {'name': 'myfoo', 'marker': 'e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1', 'bucket_id': 'e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1', 'tenant': '', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}}, 'owner': 'foo', 'creation_time': '2024-09-22T08:36:45.359780Z', 'linked': False, 'has_bucket_info': False}} 2024-09-22T08:36:46.775 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--uid', 'fud', '--bucket', 'myfoo', '--bucket-id', 'e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1'] 2024-09-22T08:36:46.775 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--uid', 'fud', '--bucket', 'myfoo', '--bucket-id', 'e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1'] 2024-09-22T08:36:46.775 DEBUG:teuthology.orchestra.run.smithi142:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --uid fud --bucket myfoo --bucket-id e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1 2024-09-22T08:36:46.824 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:36:46.824 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:36:46.825 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.824+0000 7f9259487800 1 Processor -- start 2024-09-22T08:36:46.825 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.824+0000 7f9259487800 1 -- start start 2024-09-22T08:36:46.825 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.824+0000 7f9259487800 1 --2- >> v2:172.21.15.31:3300/0 conn(0x5634e5aedc00 0x5634e5af00c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:46.825 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.824+0000 7f9259487800 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5634e5972a20 con 0x5634e5a5b550 2024-09-22T08:36:46.826 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.824+0000 7f9259487800 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x5634e59727d0 con 0x5634e5aedc00 2024-09-22T08:36:46.826 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.824+0000 7f9256770640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x5634e5aedc00 0x5634e5af00c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:46.826 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.824+0000 7f9256f71640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x5634e5a5b550 0x5634e5aec4b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.142:42554/0 (socket says 172.21.15.142:42554) 2024-09-22T08:36:46.826 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.824+0000 7f9256f71640 1 -- 172.21.15.142:0/2769388169 learned_addr learned my addr 172.21.15.142:0/2769388169 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-09-22T08:36:46.826 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.824+0000 7f9256770640 1 -- 172.21.15.142:0/2769388169 >> v1:172.21.15.31:6789/0 conn(0x5634e5a5b550 legacy=0x5634e5aec4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:46.826 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.824+0000 7f9256770640 1 -- 172.21.15.142:0/2769388169 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5634e5af17d0 con 0x5634e5aedc00 2024-09-22T08:36:46.827 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.826+0000 7f9256770640 1 --2- 172.21.15.142:0/2769388169 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5634e5aedc00 0x5634e5af00c0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f924000a470 tx=0x7f9240045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b9812322b47332f server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:46.828 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.826+0000 7f9255f6f640 1 -- 172.21.15.142:0/2769388169 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9240053570 con 0x5634e5aedc00 2024-09-22T08:36:46.828 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.826+0000 7f9255f6f640 1 -- 172.21.15.142:0/2769388169 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9240058070 con 0x5634e5aedc00 2024-09-22T08:36:46.828 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.826+0000 7f9255f6f640 1 -- 172.21.15.142:0/2769388169 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9240053880 con 0x5634e5aedc00 2024-09-22T08:36:46.828 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.827+0000 7f9259487800 1 -- 172.21.15.142:0/2769388169 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5634e5aedc00 msgr2=0x5634e5af00c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:46.828 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.827+0000 7f9259487800 1 --2- 172.21.15.142:0/2769388169 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5634e5aedc00 0x5634e5af00c0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f924000a470 tx=0x7f9240045a20 comp rx=0 tx=0).stop 2024-09-22T08:36:46.828 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.827+0000 7f9259487800 1 -- 172.21.15.142:0/2769388169 shutdown_connections 2024-09-22T08:36:46.829 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.827+0000 7f9259487800 1 --2- 172.21.15.142:0/2769388169 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5634e5aedc00 0x5634e5af00c0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:46.829 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.827+0000 7f9259487800 1 -- 172.21.15.142:0/2769388169 >> 172.21.15.142:0/2769388169 conn(0x5634e5ae1bc0 msgr2=0x5634e5ae4020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:46.829 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.827+0000 7f9259487800 1 -- 172.21.15.142:0/2769388169 shutdown_connections 2024-09-22T08:36:46.829 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.827+0000 7f9259487800 1 -- 172.21.15.142:0/2769388169 wait complete. 2024-09-22T08:36:46.842 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.841+0000 7f9259487800 1 Processor -- start 2024-09-22T08:36:46.842 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.841+0000 7f9259487800 1 -- start start 2024-09-22T08:36:46.843 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.841+0000 7f9259487800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5634e5a5b550 0x5634e5bd9310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:46.843 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.841+0000 7f9259487800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5634e597fdd0 con 0x5634e5a5b550 2024-09-22T08:36:46.843 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.841+0000 7f9256f71640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5634e5a5b550 0x5634e5bd9310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:46.843 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.841+0000 7f9256f71640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5634e5a5b550 0x5634e5bd9310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:39510/0 (socket says 172.21.15.142:39510) 2024-09-22T08:36:46.843 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.841+0000 7f9256f71640 1 -- 172.21.15.142:0/925825035 learned_addr learned my addr 172.21.15.142:0/925825035 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:46.843 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.841+0000 7f9256f71640 1 -- 172.21.15.142:0/925825035 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5634e5bd9900 con 0x5634e5a5b550 2024-09-22T08:36:46.847 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.842+0000 7f9256f71640 1 --2- 172.21.15.142:0/925825035 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5634e5a5b550 0x5634e5bd9310 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f9248001800 tx=0x7f9248001cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec2056284d7323e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:46.847 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.842+0000 7f9144e09640 1 -- 172.21.15.142:0/925825035 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9248004520 con 0x5634e5a5b550 2024-09-22T08:36:46.848 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.842+0000 7f9144e09640 1 -- 172.21.15.142:0/925825035 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92480046c0 con 0x5634e5a5b550 2024-09-22T08:36:46.848 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.842+0000 7f9144e09640 1 -- 172.21.15.142:0/925825035 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f92480049e0 con 0x5634e5a5b550 2024-09-22T08:36:46.848 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.842+0000 7f9259487800 1 -- 172.21.15.142:0/925825035 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5634e5a5b550 msgr2=0x5634e5bd9310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:46.848 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.842+0000 7f9259487800 1 --2- 172.21.15.142:0/925825035 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5634e5a5b550 0x5634e5bd9310 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f9248001800 tx=0x7f9248001cc0 comp rx=0 tx=0).stop 2024-09-22T08:36:46.848 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.842+0000 7f9259487800 1 -- 172.21.15.142:0/925825035 shutdown_connections 2024-09-22T08:36:46.848 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.842+0000 7f9259487800 1 --2- 172.21.15.142:0/925825035 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5634e5a5b550 0x5634e5bd9310 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:46.848 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.843+0000 7f9259487800 1 -- 172.21.15.142:0/925825035 >> 172.21.15.142:0/925825035 conn(0x5634e5ae1bc0 msgr2=0x5634e5bd4c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:46.848 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.843+0000 7f9259487800 1 -- 172.21.15.142:0/925825035 shutdown_connections 2024-09-22T08:36:46.848 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.843+0000 7f9259487800 1 -- 172.21.15.142:0/925825035 wait complete. 2024-09-22T08:36:46.848 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.843+0000 7f9259487800 1 Processor -- start 2024-09-22T08:36:46.848 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.843+0000 7f9259487800 1 -- start start 2024-09-22T08:36:46.848 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.843+0000 7f9259487800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5634e5a5b550 0x5634e5be0e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:46.849 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.843+0000 7f9259487800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5634e5af0a70 con 0x5634e5a5b550 2024-09-22T08:36:46.849 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.843+0000 7f9256f71640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5634e5a5b550 0x5634e5be0e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:46.849 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.843+0000 7f9256f71640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5634e5a5b550 0x5634e5be0e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:39522/0 (socket says 172.21.15.142:39522) 2024-09-22T08:36:46.849 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.843+0000 7f9256f71640 1 -- 172.21.15.142:0/1241601303 learned_addr learned my addr 172.21.15.142:0/1241601303 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:46.849 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.843+0000 7f9256f71640 1 -- 172.21.15.142:0/1241601303 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5634e5be13e0 con 0x5634e5a5b550 2024-09-22T08:36:46.849 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.844+0000 7f9256f71640 1 --2- 172.21.15.142:0/1241601303 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5634e5a5b550 0x5634e5be0e80 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f9248000f80 tx=0x7f9248001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:46.849 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.844+0000 7f9143606640 1 -- 172.21.15.142:0/1241601303 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9248022020 con 0x5634e5a5b550 2024-09-22T08:36:46.849 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.844+0000 7f9143606640 1 -- 172.21.15.142:0/1241601303 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9248014890 con 0x5634e5a5b550 2024-09-22T08:36:46.849 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.844+0000 7f9143606640 1 -- 172.21.15.142:0/1241601303 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9248014bb0 con 0x5634e5a5b550 2024-09-22T08:36:46.849 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.844+0000 7f9259487800 1 -- 172.21.15.142:0/1241601303 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5634e5be1670 con 0x5634e5a5b550 2024-09-22T08:36:46.849 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.844+0000 7f9259487800 1 -- 172.21.15.142:0/1241601303 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5634e5be2070 con 0x5634e5a5b550 2024-09-22T08:36:46.849 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.845+0000 7f9143606640 1 -- 172.21.15.142:0/1241601303 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f9248025020 con 0x5634e5a5b550 2024-09-22T08:36:46.849 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.845+0000 7f9143606640 1 --2- 172.21.15.142:0/1241601303 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f913c03d000 0x7f913c03f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:46.850 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.845+0000 7f9143606640 1 -- 172.21.15.142:0/1241601303 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f9248018030 con 0x5634e5a5b550 2024-09-22T08:36:46.850 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.845+0000 7f9256770640 1 --2- 172.21.15.142:0/1241601303 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f913c03d000 0x7f913c03f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:46.850 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.845+0000 7f9259487800 1 --2- 172.21.15.142:0/1241601303 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5634e5aedc00 0x5634e5be84d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:46.850 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.845+0000 7f9259487800 1 -- 172.21.15.142:0/1241601303 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5634e5be8a10 con 0x5634e5aedc00 2024-09-22T08:36:46.850 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.845+0000 7f9257772640 1 --2- 172.21.15.142:0/1241601303 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5634e5aedc00 0x5634e5be84d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:46.850 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.845+0000 7f9256770640 1 --2- 172.21.15.142:0/1241601303 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f913c03d000 0x7f913c03f4c0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f9240057000 tx=0x7f9240052000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:46.850 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.846+0000 7f9257772640 1 --2- 172.21.15.142:0/1241601303 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5634e5aedc00 0x5634e5be84d0 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:46.850 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.846+0000 7f9257772640 1 -- 172.21.15.142:0/1241601303 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f92500083e0 con 0x5634e5aedc00 2024-09-22T08:36:46.850 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.846+0000 7f9259487800 1 -- 172.21.15.142:0/1241601303 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5634e5be8db0 con 0x5634e5aedc00 2024-09-22T08:36:46.850 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.846+0000 7f9257772640 1 -- 172.21.15.142:0/1241601303 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f92500083e0 con 0x5634e5aedc00 2024-09-22T08:36:46.850 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.846+0000 7f9259487800 1 --2- 172.21.15.142:0/1241601303 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5634e5bea8b0 0x5634e5becd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:46.850 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.846+0000 7f9259487800 1 -- 172.21.15.142:0/1241601303 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:3 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5634e5bed4c0 con 0x5634e5bea8b0 2024-09-22T08:36:46.851 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.846+0000 7f9256f71640 1 --2- 172.21.15.142:0/1241601303 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5634e5bea8b0 0x5634e5becd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:46.851 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.846+0000 7f9256f71640 1 --2- 172.21.15.142:0/1241601303 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5634e5bea8b0 0x5634e5becd30 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:46.861 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.847+0000 7f9256f71640 1 -- 172.21.15.142:0/1241601303 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(3 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f924801b070 con 0x5634e5bea8b0 2024-09-22T08:36:46.861 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.847+0000 7f9259487800 1 -- 172.21.15.142:0/1241601303 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5634e5be9600 con 0x5634e5aedc00 2024-09-22T08:36:46.862 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.847+0000 7f9257772640 1 -- 172.21.15.142:0/1241601303 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f92500083e0 con 0x5634e5aedc00 2024-09-22T08:36:46.862 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.847+0000 7f9259487800 1 -- 172.21.15.142:0/1241601303 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5634e5be9a30 con 0x5634e5bea8b0 2024-09-22T08:36:46.862 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.847+0000 7f9256f71640 1 -- 172.21.15.142:0/1241601303 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(5 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f924801b070 con 0x5634e5bea8b0 2024-09-22T08:36:46.862 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.848+0000 7f9259487800 1 Processor -- start 2024-09-22T08:36:46.862 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.848+0000 7f9259487800 1 -- start start 2024-09-22T08:36:46.862 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.848+0000 7f9259487800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5634e5bfbec0 0x5634e5bfc2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:46.862 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.848+0000 7f9259487800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5634e59ded50 con 0x5634e5bfbec0 2024-09-22T08:36:46.862 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.848+0000 7f9257772640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5634e5bfbec0 0x5634e5bfc2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:46.862 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.848+0000 7f9257772640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5634e5bfbec0 0x5634e5bfc2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:39534/0 (socket says 172.21.15.142:39534) 2024-09-22T08:36:46.862 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.848+0000 7f9257772640 1 -- 172.21.15.142:0/1746036213 learned_addr learned my addr 172.21.15.142:0/1746036213 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:46.862 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.848+0000 7f9257772640 1 -- 172.21.15.142:0/1746036213 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5634e5bfc920 con 0x5634e5bfbec0 2024-09-22T08:36:46.862 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.849+0000 7f9257772640 1 --2- 172.21.15.142:0/1746036213 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5634e5bfbec0 0x5634e5bfc2e0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x5634e5be1e80 tx=0x7f925000bf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:46.863 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.849+0000 7f9140e01640 1 -- 172.21.15.142:0/1746036213 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f925001c020 con 0x5634e5bfbec0 2024-09-22T08:36:46.863 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.849+0000 7f9140e01640 1 -- 172.21.15.142:0/1746036213 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9250007c90 con 0x5634e5bfbec0 2024-09-22T08:36:46.863 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.849+0000 7f9259487800 1 -- 172.21.15.142:0/1746036213 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5634e5bfd150 con 0x5634e5bfbec0 2024-09-22T08:36:46.863 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.849+0000 7f9140e01640 1 -- 172.21.15.142:0/1746036213 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9250018440 con 0x5634e5bfbec0 2024-09-22T08:36:46.863 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.849+0000 7f9259487800 1 -- 172.21.15.142:0/1746036213 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5634e5bfd6f0 con 0x5634e5bfbec0 2024-09-22T08:36:46.863 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.850+0000 7f9140e01640 1 -- 172.21.15.142:0/1746036213 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f925001f020 con 0x5634e5bfbec0 2024-09-22T08:36:46.863 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.850+0000 7f9140e01640 1 --2- 172.21.15.142:0/1746036213 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f913003cfb0 0x7f913003f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:46.863 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.850+0000 7f9140e01640 1 -- 172.21.15.142:0/1746036213 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f92500558a0 con 0x5634e5bfbec0 2024-09-22T08:36:46.863 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.850+0000 7f9256f71640 1 --2- 172.21.15.142:0/1746036213 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f913003cfb0 0x7f913003f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:46.863 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.850+0000 7f9259487800 1 Processor -- start 2024-09-22T08:36:46.863 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.850+0000 7f9256f71640 1 --2- 172.21.15.142:0/1746036213 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f913003cfb0 0x7f913003f470 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x5634e5bed890 tx=0x7f9248006820 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:46.863 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.850+0000 7f9259487800 1 -- start start 2024-09-22T08:36:46.863 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.850+0000 7f9259487800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5634e5c08920 0x5634e5c08d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:46.864 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.850+0000 7f9259487800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5634e5bd9d30 con 0x5634e5c08920 2024-09-22T08:36:46.864 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.851+0000 7f9257772640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5634e5c08920 0x5634e5c08d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:46.864 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.851+0000 7f9257772640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5634e5c08920 0x5634e5c08d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:39550/0 (socket says 172.21.15.142:39550) 2024-09-22T08:36:46.864 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.851+0000 7f9257772640 1 -- 172.21.15.142:0/4196141892 learned_addr learned my addr 172.21.15.142:0/4196141892 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:46.864 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.851+0000 7f9257772640 1 -- 172.21.15.142:0/4196141892 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5634e5c09310 con 0x5634e5c08920 2024-09-22T08:36:46.864 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.851+0000 7f9257772640 1 --2- 172.21.15.142:0/4196141892 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5634e5c08920 0x5634e5c08d20 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f9250053df0 tx=0x7f92500158b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f69c564ec95f2eef server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:46.864 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.851+0000 7f913a7fc640 1 -- 172.21.15.142:0/4196141892 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f925004a070 con 0x5634e5c08920 2024-09-22T08:36:46.864 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.851+0000 7f913a7fc640 1 -- 172.21.15.142:0/4196141892 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9250015e70 con 0x5634e5c08920 2024-09-22T08:36:46.864 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.851+0000 7f913a7fc640 1 -- 172.21.15.142:0/4196141892 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f92500174d0 con 0x5634e5c08920 2024-09-22T08:36:46.864 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.852+0000 7f9259487800 1 -- 172.21.15.142:0/4196141892 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5634e5c08920 msgr2=0x5634e5c08d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:46.864 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.852+0000 7f9259487800 1 --2- 172.21.15.142:0/4196141892 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5634e5c08920 0x5634e5c08d20 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f9250053df0 tx=0x7f92500158b0 comp rx=0 tx=0).stop 2024-09-22T08:36:46.864 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.852+0000 7f9259487800 1 -- 172.21.15.142:0/4196141892 shutdown_connections 2024-09-22T08:36:46.865 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.852+0000 7f9259487800 1 --2- 172.21.15.142:0/4196141892 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5634e5c08920 0x5634e5c08d20 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:46.865 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.852+0000 7f9259487800 1 -- 172.21.15.142:0/4196141892 >> 172.21.15.142:0/4196141892 conn(0x5634e5c04d20 msgr2=0x5634e5c02f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:46.865 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.852+0000 7f9259487800 1 -- 172.21.15.142:0/4196141892 shutdown_connections 2024-09-22T08:36:46.865 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.852+0000 7f9259487800 1 -- 172.21.15.142:0/4196141892 wait complete. 2024-09-22T08:36:46.865 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.852+0000 7f9259487800 1 Processor -- start 2024-09-22T08:36:46.865 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.852+0000 7f9259487800 1 -- start start 2024-09-22T08:36:46.865 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.852+0000 7f9259487800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5634e5c08920 0x5634e5c0fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:46.865 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.852+0000 7f9259487800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5634e5c09930 con 0x5634e5c08920 2024-09-22T08:36:46.865 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.852+0000 7f9257772640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5634e5c08920 0x5634e5c0fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:46.865 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.852+0000 7f9257772640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5634e5c08920 0x5634e5c0fe90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:39552/0 (socket says 172.21.15.142:39552) 2024-09-22T08:36:46.865 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.852+0000 7f9257772640 1 -- 172.21.15.142:0/458428614 learned_addr learned my addr 172.21.15.142:0/458428614 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:46.865 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.852+0000 7f9257772640 1 -- 172.21.15.142:0/458428614 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5634e5c103f0 con 0x5634e5c08920 2024-09-22T08:36:46.865 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.853+0000 7f9257772640 1 --2- 172.21.15.142:0/458428614 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5634e5c08920 0x5634e5c0fe90 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f92500154a0 tx=0x7f9250053d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:46.866 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.853+0000 7f9138ff9640 1 -- 172.21.15.142:0/458428614 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f925002e070 con 0x5634e5c08920 2024-09-22T08:36:46.866 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.853+0000 7f9138ff9640 1 -- 172.21.15.142:0/458428614 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f925004b040 con 0x5634e5c08920 2024-09-22T08:36:46.866 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.853+0000 7f9259487800 1 -- 172.21.15.142:0/458428614 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5634e5c10680 con 0x5634e5c08920 2024-09-22T08:36:46.866 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.853+0000 7f9138ff9640 1 -- 172.21.15.142:0/458428614 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f925004a070 con 0x5634e5c08920 2024-09-22T08:36:46.866 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.853+0000 7f9259487800 1 -- 172.21.15.142:0/458428614 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5634e5c11210 con 0x5634e5c08920 2024-09-22T08:36:46.866 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.854+0000 7f9138ff9640 1 -- 172.21.15.142:0/458428614 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f9250016040 con 0x5634e5c08920 2024-09-22T08:36:46.866 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.854+0000 7f9138ff9640 1 --2- 172.21.15.142:0/458428614 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f912003cfb0 0x7f912003f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:46.866 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.854+0000 7f9138ff9640 1 -- 172.21.15.142:0/458428614 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f925003d260 con 0x5634e5c08920 2024-09-22T08:36:46.866 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.854+0000 7f9256f71640 1 --2- 172.21.15.142:0/458428614 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f912003cfb0 0x7f912003f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:46.866 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.854+0000 7f9256f71640 1 --2- 172.21.15.142:0/458428614 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f912003cfb0 0x7f912003f470 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f9248014fd0 tx=0x7f9248032000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:46.866 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.854+0000 7f9259487800 20 rados->read ofs=0 len=0 2024-09-22T08:36:46.866 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.855+0000 7f9259487800 1 --2- 172.21.15.142:0/458428614 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5634e5c1b7f0 0x5634e5c1dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:46.866 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.855+0000 7f9259487800 1 -- 172.21.15.142:0/458428614 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5634e5c1e400 con 0x5634e5c1b7f0 2024-09-22T08:36:46.867 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.855+0000 7f9256770640 1 --2- 172.21.15.142:0/458428614 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5634e5c1b7f0 0x5634e5c1dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:46.867 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.855+0000 7f9256770640 1 --2- 172.21.15.142:0/458428614 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5634e5c1b7f0 0x5634e5c1dcb0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:46.867 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.855+0000 7f9256770640 1 -- 172.21.15.142:0/458428614 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9240051070 con 0x5634e5c1b7f0 2024-09-22T08:36:46.867 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.855+0000 7f9259487800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:46.867 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.855+0000 7f9259487800 20 realm 2024-09-22T08:36:46.867 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.855+0000 7f9259487800 20 rados->read ofs=0 len=0 2024-09-22T08:36:46.867 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.855+0000 7f9259487800 1 -- 172.21.15.142:0/458428614 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5634e5c1e830 con 0x5634e5c1b7f0 2024-09-22T08:36:46.867 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.855+0000 7f9256770640 1 -- 172.21.15.142:0/458428614 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9240051070 con 0x5634e5c1b7f0 2024-09-22T08:36:46.867 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.855+0000 7f9259487800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:46.867 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.855+0000 7f9259487800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:36:46.867 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.855+0000 7f9259487800 20 rados->read ofs=0 len=0 2024-09-22T08:36:46.867 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.855+0000 7f9259487800 1 -- 172.21.15.142:0/458428614 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5634e5c1f100 con 0x5634e5c1b7f0 2024-09-22T08:36:46.867 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.856+0000 7f9256770640 1 -- 172.21.15.142:0/458428614 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9240051070 con 0x5634e5c1b7f0 2024-09-22T08:36:46.867 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.856+0000 7f9259487800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:46.868 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.856+0000 7f9259487800 20 rados->read ofs=0 len=0 2024-09-22T08:36:46.868 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.856+0000 7f9259487800 1 -- 172.21.15.142:0/458428614 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5634e5c1f4a0 con 0x5634e5c1b7f0 2024-09-22T08:36:46.868 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.856+0000 7f9256770640 1 -- 172.21.15.142:0/458428614 <== osd.1 v2:172.21.15.142:6816/3192108003 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9240051070 con 0x5634e5c1b7f0 2024-09-22T08:36:46.868 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.856+0000 7f9259487800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:36:46.868 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.856+0000 7f9259487800 20 rados->read ofs=0 len=0 2024-09-22T08:36:46.868 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.856+0000 7f9259487800 1 --2- 172.21.15.142:0/458428614 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5634e5c20200 0x5634e5c225f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:46.868 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.856+0000 7f9259487800 1 -- 172.21.15.142:0/458428614 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5634e5c22c00 con 0x5634e5c20200 2024-09-22T08:36:46.868 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.856+0000 7f9257772640 1 --2- 172.21.15.142:0/458428614 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5634e5c20200 0x5634e5c225f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:46.868 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.856+0000 7f9257772640 1 --2- 172.21.15.142:0/458428614 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5634e5c20200 0x5634e5c225f0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:46.868 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.857+0000 7f9257772640 1 -- 172.21.15.142:0/458428614 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(5 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f92500083e0 con 0x5634e5c20200 2024-09-22T08:36:46.868 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.857+0000 7f9259487800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:36:46.868 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.857+0000 7f9259487800 20 searching for the correct realm 2024-09-22T08:36:46.868 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.857+0000 7f9259487800 1 -- 172.21.15.142:0/458428614 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5634e5c24530 con 0x5634e5c20200 2024-09-22T08:36:46.869 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.857+0000 7f9257772640 1 -- 172.21.15.142:0/458428614 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f92500083e0 con 0x5634e5c20200 2024-09-22T08:36:46.869 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.857+0000 7f9257772640 1 --2- 172.21.15.142:0/458428614 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f9250032020 0x7f925003b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:46.869 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.857+0000 7f9257772640 1 -- 172.21.15.142:0/458428614 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5634e5c24530 con 0x7f9250032020 2024-09-22T08:36:46.869 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.857+0000 7f9256f71640 1 --2- 172.21.15.142:0/458428614 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f9250032020 0x7f925003b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:46.869 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.857+0000 7f9256f71640 1 --2- 172.21.15.142:0/458428614 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f9250032020 0x7f925003b9a0 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:46.869 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.857+0000 7f9256f71640 1 -- 172.21.15.142:0/458428614 <== osd.2 v2:172.21.15.142:6808/279438927 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f924801b070 con 0x7f9250032020 2024-09-22T08:36:46.869 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.857+0000 7f9256f71640 1 --2- 172.21.15.142:0/458428614 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f9248027020 0x7f924801e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:46.869 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.857+0000 7f9256f71640 1 -- 172.21.15.142:0/458428614 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5634e5c24530 con 0x7f9248027020 2024-09-22T08:36:46.869 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.858+0000 7f9256770640 1 --2- 172.21.15.142:0/458428614 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f9248027020 0x7f924801e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:46.869 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.858+0000 7f9256770640 1 --2- 172.21.15.142:0/458428614 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f9248027020 0x7f924801e3f0 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:46.869 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.858+0000 7f9256770640 1 -- 172.21.15.142:0/458428614 <== osd.0 v2:172.21.15.31:6800/168281188 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9240051070 con 0x7f9248027020 2024-09-22T08:36:46.869 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.858+0000 7f9256770640 1 -- 172.21.15.142:0/458428614 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5634e5c24530 con 0x5634e5c1b7f0 2024-09-22T08:36:46.869 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.859+0000 7f9256770640 1 -- 172.21.15.142:0/458428614 <== osd.1 v2:172.21.15.142:6816/3192108003 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9240051070 con 0x5634e5c1b7f0 2024-09-22T08:36:46.870 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.859+0000 7f9256770640 1 -- 172.21.15.142:0/458428614 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5634e5c24530 con 0x5634e5c1b7f0 2024-09-22T08:36:46.870 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.859+0000 7f9256770640 1 -- 172.21.15.142:0/458428614 <== osd.1 v2:172.21.15.142:6816/3192108003 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9240051070 con 0x5634e5c1b7f0 2024-09-22T08:36:46.870 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.859+0000 7f9256770640 1 -- 172.21.15.142:0/458428614 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5634e5c24530 con 0x7f9248027020 2024-09-22T08:36:46.870 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.859+0000 7f9256770640 1 -- 172.21.15.142:0/458428614 <== osd.0 v2:172.21.15.31:6800/168281188 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9240051070 con 0x7f9248027020 2024-09-22T08:36:46.870 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.859+0000 7f9256770640 1 -- 172.21.15.142:0/458428614 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5634e5c24530 con 0x7f9248027020 2024-09-22T08:36:46.870 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.859+0000 7f9256770640 1 -- 172.21.15.142:0/458428614 <== osd.0 v2:172.21.15.31:6800/168281188 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9240051070 con 0x7f9248027020 2024-09-22T08:36:46.870 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.859+0000 7f9256770640 1 -- 172.21.15.142:0/458428614 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5634e5c24530 con 0x7f9250032020 2024-09-22T08:36:46.870 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.859+0000 7f9256f71640 1 -- 172.21.15.142:0/458428614 <== osd.2 v2:172.21.15.142:6808/279438927 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f924801b070 con 0x7f9250032020 2024-09-22T08:36:46.870 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.860+0000 7f9256f71640 1 -- 172.21.15.142:0/458428614 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5634e5c24530 con 0x5634e5c20200 2024-09-22T08:36:46.870 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.860+0000 7f9257772640 1 -- 172.21.15.142:0/458428614 <== osd.3 v2:172.21.15.142:6800/1064901393 3 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f92500083e0 con 0x5634e5c20200 2024-09-22T08:36:46.870 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.860+0000 7f9257772640 1 -- 172.21.15.142:0/458428614 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5634e5c24530 con 0x5634e5c1b7f0 2024-09-22T08:36:46.870 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.860+0000 7f9256770640 1 -- 172.21.15.142:0/458428614 <== osd.1 v2:172.21.15.142:6816/3192108003 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9240051070 con 0x5634e5c1b7f0 2024-09-22T08:36:46.870 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.860+0000 7f9256770640 1 -- 172.21.15.142:0/458428614 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5634e5c24530 con 0x7f9248027020 2024-09-22T08:36:46.871 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.860+0000 7f9256770640 1 -- 172.21.15.142:0/458428614 <== osd.0 v2:172.21.15.31:6800/168281188 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9240051070 con 0x7f9248027020 2024-09-22T08:36:46.871 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.860+0000 7f9256770640 1 -- 172.21.15.142:0/458428614 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5634e5c24530 con 0x5634e5c1b7f0 2024-09-22T08:36:46.871 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.860+0000 7f9256770640 1 -- 172.21.15.142:0/458428614 <== osd.1 v2:172.21.15.142:6816/3192108003 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9240051070 con 0x5634e5c1b7f0 2024-09-22T08:36:46.871 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.860+0000 7f9256770640 1 -- 172.21.15.142:0/458428614 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5634e5c24530 con 0x7f9250032020 2024-09-22T08:36:46.880 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.861+0000 7f9256f71640 1 -- 172.21.15.142:0/458428614 <== osd.2 v2:172.21.15.142:6808/279438927 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f924801b070 con 0x7f9250032020 2024-09-22T08:36:46.880 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.861+0000 7f9256f71640 1 -- 172.21.15.142:0/458428614 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5634e5c24530 con 0x5634e5c20200 2024-09-22T08:36:46.880 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.861+0000 7f9257772640 1 -- 172.21.15.142:0/458428614 <== osd.3 v2:172.21.15.142:6800/1064901393 4 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f92500083e0 con 0x5634e5c20200 2024-09-22T08:36:46.880 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.861+0000 7f9257772640 1 -- 172.21.15.142:0/458428614 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5634e5c24530 con 0x5634e5c20200 2024-09-22T08:36:46.880 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.861+0000 7f9257772640 1 -- 172.21.15.142:0/458428614 <== osd.3 v2:172.21.15.142:6800/1064901393 5 ==== osd_op_reply(20 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f92500083e0 con 0x5634e5c20200 2024-09-22T08:36:46.881 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.861+0000 7f9257772640 1 -- 172.21.15.142:0/458428614 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5634e5c24530 con 0x7f9248027020 2024-09-22T08:36:46.881 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.861+0000 7f9256770640 1 -- 172.21.15.142:0/458428614 <== osd.0 v2:172.21.15.31:6800/168281188 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9240051070 con 0x7f9248027020 2024-09-22T08:36:46.881 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.861+0000 7f9256770640 1 -- 172.21.15.142:0/458428614 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5634e5c24530 con 0x5634e5c20200 2024-09-22T08:36:46.881 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.862+0000 7f9257772640 1 -- 172.21.15.142:0/458428614 <== osd.3 v2:172.21.15.142:6800/1064901393 6 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f92500083e0 con 0x5634e5c20200 2024-09-22T08:36:46.881 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.862+0000 7f9257772640 1 -- 172.21.15.142:0/458428614 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5634e5c24530 con 0x5634e5c20200 2024-09-22T08:36:46.881 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.862+0000 7f9257772640 1 -- 172.21.15.142:0/458428614 <== osd.3 v2:172.21.15.142:6800/1064901393 7 ==== osd_op_reply(23 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f92500083e0 con 0x5634e5c20200 2024-09-22T08:36:46.881 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.862+0000 7f9257772640 1 -- 172.21.15.142:0/458428614 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5634e5c24530 con 0x5634e5c1b7f0 2024-09-22T08:36:46.881 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.862+0000 7f9256770640 1 -- 172.21.15.142:0/458428614 <== osd.1 v2:172.21.15.142:6816/3192108003 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9240051070 con 0x5634e5c1b7f0 2024-09-22T08:36:46.881 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.862+0000 7f9256770640 1 -- 172.21.15.142:0/458428614 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5634e5c24530 con 0x5634e5c1b7f0 2024-09-22T08:36:46.881 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.862+0000 7f9256770640 1 -- 172.21.15.142:0/458428614 <== osd.1 v2:172.21.15.142:6816/3192108003 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f9240051070 con 0x5634e5c1b7f0 2024-09-22T08:36:46.881 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.862+0000 7f9256770640 1 -- 172.21.15.142:0/458428614 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5634e5c24530 con 0x7f9248027020 2024-09-22T08:36:46.881 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.863+0000 7f9256770640 1 -- 172.21.15.142:0/458428614 <== osd.0 v2:172.21.15.31:6800/168281188 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9240051070 con 0x7f9248027020 2024-09-22T08:36:46.881 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.863+0000 7f9256770640 1 -- 172.21.15.142:0/458428614 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5634e5c24530 con 0x5634e5c20200 2024-09-22T08:36:46.881 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.863+0000 7f9257772640 1 -- 172.21.15.142:0/458428614 <== osd.3 v2:172.21.15.142:6800/1064901393 8 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f92500083e0 con 0x5634e5c20200 2024-09-22T08:36:46.882 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.863+0000 7f9257772640 1 -- 172.21.15.142:0/458428614 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5634e5c24530 con 0x7f9250032020 2024-09-22T08:36:46.882 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.863+0000 7f9256f71640 1 -- 172.21.15.142:0/458428614 <== osd.2 v2:172.21.15.142:6808/279438927 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f924801b070 con 0x7f9250032020 2024-09-22T08:36:46.882 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.863+0000 7f9256f71640 1 -- 172.21.15.142:0/458428614 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5634e5c24530 con 0x5634e5c1b7f0 2024-09-22T08:36:46.882 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.863+0000 7f9256770640 1 -- 172.21.15.142:0/458428614 <== osd.1 v2:172.21.15.142:6816/3192108003 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9240051070 con 0x5634e5c1b7f0 2024-09-22T08:36:46.882 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.863+0000 7f9256770640 1 -- 172.21.15.142:0/458428614 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5634e5c24530 con 0x7f9248027020 2024-09-22T08:36:46.882 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.864+0000 7f9256770640 1 -- 172.21.15.142:0/458428614 <== osd.0 v2:172.21.15.31:6800/168281188 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9240051070 con 0x7f9248027020 2024-09-22T08:36:46.882 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.864+0000 7f9256770640 1 -- 172.21.15.142:0/458428614 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5634e5c24530 con 0x5634e5c20200 2024-09-22T08:36:46.882 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.864+0000 7f9257772640 1 -- 172.21.15.142:0/458428614 <== osd.3 v2:172.21.15.142:6800/1064901393 9 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f92500083e0 con 0x5634e5c20200 2024-09-22T08:36:46.882 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.864+0000 7f9257772640 1 -- 172.21.15.142:0/458428614 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5634e5c24530 con 0x7f9248027020 2024-09-22T08:36:46.882 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.864+0000 7f9256770640 1 -- 172.21.15.142:0/458428614 <== osd.0 v2:172.21.15.31:6800/168281188 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9240051070 con 0x7f9248027020 2024-09-22T08:36:46.882 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.864+0000 7f9256770640 1 -- 172.21.15.142:0/458428614 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5634e5c24530 con 0x7f9250032020 2024-09-22T08:36:46.882 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.864+0000 7f9256f71640 1 -- 172.21.15.142:0/458428614 <== osd.2 v2:172.21.15.142:6808/279438927 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f924801b070 con 0x7f9250032020 2024-09-22T08:36:46.883 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.864+0000 7f9256f71640 1 -- 172.21.15.142:0/458428614 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5634e5c24530 con 0x5634e5c20200 2024-09-22T08:36:46.883 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.865+0000 7f9257772640 1 -- 172.21.15.142:0/458428614 <== osd.3 v2:172.21.15.142:6800/1064901393 10 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f92500083e0 con 0x5634e5c20200 2024-09-22T08:36:46.883 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.865+0000 7f9257772640 1 -- 172.21.15.142:0/458428614 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5634e5c24530 con 0x7f9248027020 2024-09-22T08:36:46.883 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.865+0000 7f9256770640 1 -- 172.21.15.142:0/458428614 <== osd.0 v2:172.21.15.31:6800/168281188 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9240051070 con 0x7f9248027020 2024-09-22T08:36:46.883 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.865+0000 7f9256770640 1 -- 172.21.15.142:0/458428614 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5634e5c24530 con 0x5634e5c1b7f0 2024-09-22T08:36:46.883 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.865+0000 7f9256770640 1 -- 172.21.15.142:0/458428614 <== osd.1 v2:172.21.15.142:6816/3192108003 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f9240051070 con 0x5634e5c1b7f0 2024-09-22T08:36:46.883 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.865+0000 7f9256770640 1 -- 172.21.15.142:0/458428614 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5634e5c24530 con 0x7f9250032020 2024-09-22T08:36:46.883 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.865+0000 7f9256f71640 1 -- 172.21.15.142:0/458428614 <== osd.2 v2:172.21.15.142:6808/279438927 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f924801b070 con 0x7f9250032020 2024-09-22T08:36:46.883 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.865+0000 7f9259487800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:36:46.883 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.865+0000 7f9259487800 20 RGWRados::pool_iterate: got zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec 2024-09-22T08:36:46.883 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.865+0000 7f9259487800 20 RGWRados::pool_iterate: got zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f 2024-09-22T08:36:46.883 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.865+0000 7f9259487800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:36:46.883 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.865+0000 7f9259487800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:36:46.883 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.865+0000 7f9259487800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:36:46.884 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.865+0000 7f9259487800 20 rados->read ofs=0 len=0 2024-09-22T08:36:46.884 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.865+0000 7f9259487800 1 -- 172.21.15.142:0/458428614 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5634e5c235f0 con 0x5634e5c1b7f0 2024-09-22T08:36:46.884 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.866+0000 7f9256770640 1 -- 172.21.15.142:0/458428614 <== osd.1 v2:172.21.15.142:6816/3192108003 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9240051070 con 0x5634e5c1b7f0 2024-09-22T08:36:46.884 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.866+0000 7f9259487800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:46.884 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.866+0000 7f9259487800 20 rados->read ofs=0 len=0 2024-09-22T08:36:46.884 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.866+0000 7f9259487800 1 -- 172.21.15.142:0/458428614 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5634e5c23e40 con 0x5634e5c1b7f0 2024-09-22T08:36:46.884 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.866+0000 7f9256770640 1 -- 172.21.15.142:0/458428614 <== osd.1 v2:172.21.15.142:6816/3192108003 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9240051070 con 0x5634e5c1b7f0 2024-09-22T08:36:46.884 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.866+0000 7f9259487800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:36:46.884 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.866+0000 7f9259487800 20 rados->read ofs=0 len=0 2024-09-22T08:36:46.884 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.866+0000 7f9259487800 1 -- 172.21.15.142:0/458428614 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:40 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5634e5c249b0 con 0x5634e5c20200 2024-09-22T08:36:46.884 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.866+0000 7f9257772640 1 -- 172.21.15.142:0/458428614 <== osd.3 v2:172.21.15.142:6800/1064901393 11 ==== osd_op_reply(40 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f92500083e0 con 0x5634e5c20200 2024-09-22T08:36:46.884 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.866+0000 7f9259487800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:36:46.884 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.866+0000 7f9259487800 20 zone default found 2024-09-22T08:36:46.885 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.866+0000 7f9259487800 4 Realm: () 2024-09-22T08:36:46.885 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.866+0000 7f9259487800 4 ZoneGroup: default (d89f6f57-1007-47dd-9065-f486c7b01aec) 2024-09-22T08:36:46.885 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.866+0000 7f9259487800 4 Zone: default (e239248c-0bee-4e41-803a-24b288d3eb8f) 2024-09-22T08:36:46.885 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.866+0000 7f9259487800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:36:46.885 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.866+0000 7f9259487800 20 zonegroup default 2024-09-22T08:36:46.885 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.866+0000 7f9259487800 20 rados->read ofs=0 len=0 2024-09-22T08:36:46.885 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.866+0000 7f9259487800 1 -- 172.21.15.142:0/458428614 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5634e5c24d90 con 0x7f9248027020 2024-09-22T08:36:46.885 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.867+0000 7f9256770640 1 -- 172.21.15.142:0/458428614 <== osd.0 v2:172.21.15.31:6800/168281188 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f9240051070 con 0x7f9248027020 2024-09-22T08:36:46.885 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.867+0000 7f9259487800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:46.885 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.867+0000 7f9259487800 20 rados->read ofs=0 len=0 2024-09-22T08:36:46.885 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.867+0000 7f9259487800 1 -- 172.21.15.142:0/458428614 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5634e5c27070 con 0x5634e5c20200 2024-09-22T08:36:46.885 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.867+0000 7f9257772640 1 -- 172.21.15.142:0/458428614 <== osd.3 v2:172.21.15.142:6800/1064901393 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f92500083e0 con 0x5634e5c20200 2024-09-22T08:36:46.885 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.867+0000 7f9259487800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:46.886 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.867+0000 7f9259487800 20 rados->read ofs=0 len=0 2024-09-22T08:36:46.886 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.867+0000 7f9259487800 1 -- 172.21.15.142:0/458428614 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5634e5c27410 con 0x5634e5c20200 2024-09-22T08:36:46.886 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.867+0000 7f9257772640 1 -- 172.21.15.142:0/458428614 <== osd.3 v2:172.21.15.142:6800/1064901393 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f92500083e0 con 0x5634e5c20200 2024-09-22T08:36:46.886 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.867+0000 7f9259487800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:46.886 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.867+0000 7f9259487800 20 started sync module instance, tier type = 2024-09-22T08:36:46.886 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.867+0000 7f9259487800 20 started zone id=e239248c-0bee-4e41-803a-24b288d3eb8f (name=default) with tier type = 2024-09-22T08:36:46.886 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.867+0000 7f9259487800 1 -- 172.21.15.142:0/458428614 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5634e5c264b0 con 0x7f9250032020 2024-09-22T08:36:46.886 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.868+0000 7f9256f71640 1 -- 172.21.15.142:0/458428614 <== osd.2 v2:172.21.15.142:6808/279438927 7 ==== osd_op_reply(44 notify.0 [create] v30'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f924801b070 con 0x7f9250032020 2024-09-22T08:36:46.886 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.868+0000 7f9259487800 1 -- 172.21.15.142:0/458428614 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94785193009152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5634e5c27870 con 0x7f9250032020 2024-09-22T08:36:46.886 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.868+0000 7f9259487800 1 -- 172.21.15.142:0/458428614 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5634e5c280c0 con 0x5634e5c1b7f0 2024-09-22T08:36:46.886 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.869+0000 7f9256f71640 1 -- 172.21.15.142:0/458428614 <== osd.2 v2:172.21.15.142:6808/279438927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94785193009152] v30'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f924801b070 con 0x7f9250032020 2024-09-22T08:36:46.886 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.869+0000 7f9256770640 1 -- 172.21.15.142:0/458428614 <== osd.1 v2:172.21.15.142:6816/3192108003 15 ==== osd_op_reply(46 notify.1 [create] v30'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9240051070 con 0x5634e5c1b7f0 2024-09-22T08:36:46.886 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.869+0000 7f9259487800 1 -- 172.21.15.142:0/458428614 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94785193016336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5634e5c284e0 con 0x5634e5c1b7f0 2024-09-22T08:36:46.887 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.869+0000 7f9259487800 1 -- 172.21.15.142:0/458428614 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5634e5c28d30 con 0x5634e5c20200 2024-09-22T08:36:46.887 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.871+0000 7f9257772640 1 -- 172.21.15.142:0/458428614 <== osd.3 v2:172.21.15.142:6800/1064901393 14 ==== osd_op_reply(48 notify.2 [create] v30'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f92500083e0 con 0x5634e5c20200 2024-09-22T08:36:46.887 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.871+0000 7f9256770640 1 -- 172.21.15.142:0/458428614 <== osd.1 v2:172.21.15.142:6816/3192108003 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94785193016336] v30'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9240051070 con 0x5634e5c1b7f0 2024-09-22T08:36:46.887 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.871+0000 7f9259487800 1 -- 172.21.15.142:0/458428614 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94785193019072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5634e5c29170 con 0x5634e5c20200 2024-09-22T08:36:46.887 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.871+0000 7f9259487800 1 -- 172.21.15.142:0/458428614 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5634e5c28070 con 0x7f9250032020 2024-09-22T08:36:46.887 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.872+0000 7f9256f71640 1 -- 172.21.15.142:0/458428614 <== osd.2 v2:172.21.15.142:6808/279438927 9 ==== osd_op_reply(50 notify.3 [create] v30'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f924801b070 con 0x7f9250032020 2024-09-22T08:36:46.887 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.872+0000 7f9259487800 1 -- 172.21.15.142:0/458428614 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94785193023328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5634e5c2a030 con 0x7f9250032020 2024-09-22T08:36:46.887 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.872+0000 7f9259487800 1 -- 172.21.15.142:0/458428614 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5634e5c2aab0 con 0x5634e5c1b7f0 2024-09-22T08:36:46.887 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.872+0000 7f9257772640 1 -- 172.21.15.142:0/458428614 <== osd.3 v2:172.21.15.142:6800/1064901393 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94785193019072] v30'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f92500083e0 con 0x5634e5c20200 2024-09-22T08:36:46.887 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.873+0000 7f9256770640 1 -- 172.21.15.142:0/458428614 <== osd.1 v2:172.21.15.142:6816/3192108003 17 ==== osd_op_reply(52 notify.4 [create] v30'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9240051070 con 0x5634e5c1b7f0 2024-09-22T08:36:46.887 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.873+0000 7f9259487800 1 -- 172.21.15.142:0/458428614 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94785193026976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5634e5c2a030 con 0x5634e5c1b7f0 2024-09-22T08:36:46.887 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.873+0000 7f9259487800 1 -- 172.21.15.142:0/458428614 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5634e5c2b550 con 0x7f9248027020 2024-09-22T08:36:46.887 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.873+0000 7f9256f71640 1 -- 172.21.15.142:0/458428614 <== osd.2 v2:172.21.15.142:6808/279438927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94785193023328] v30'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f924801b070 con 0x7f9250032020 2024-09-22T08:36:46.888 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.874+0000 7f9256770640 1 -- 172.21.15.142:0/458428614 <== osd.0 v2:172.21.15.31:6800/168281188 11 ==== osd_op_reply(54 notify.5 [create] v30'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9240051070 con 0x7f9248027020 2024-09-22T08:36:46.888 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.874+0000 7f9256770640 1 -- 172.21.15.142:0/458428614 <== osd.1 v2:172.21.15.142:6816/3192108003 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94785193026976] v30'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9240051070 con 0x5634e5c1b7f0 2024-09-22T08:36:46.888 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.874+0000 7f9259487800 1 -- 172.21.15.142:0/458428614 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94785193029696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5634e5c2a030 con 0x7f9248027020 2024-09-22T08:36:46.888 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.874+0000 7f9259487800 1 -- 172.21.15.142:0/458428614 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5634e5c28bc0 con 0x7f9248027020 2024-09-22T08:36:46.888 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.875+0000 7f9256770640 1 -- 172.21.15.142:0/458428614 <== osd.0 v2:172.21.15.31:6800/168281188 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94785193029696] v30'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9240051070 con 0x7f9248027020 2024-09-22T08:36:46.888 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.875+0000 7f9256770640 1 -- 172.21.15.142:0/458428614 <== osd.0 v2:172.21.15.31:6800/168281188 13 ==== osd_op_reply(56 notify.6 [create] v30'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9240051070 con 0x7f9248027020 2024-09-22T08:36:46.888 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.875+0000 7f9259487800 1 -- 172.21.15.142:0/458428614 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94785193024384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5634e5c29fa0 con 0x7f9248027020 2024-09-22T08:36:46.888 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.875+0000 7f9259487800 1 -- 172.21.15.142:0/458428614 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5634e5c2c430 con 0x7f9248027020 2024-09-22T08:36:46.888 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.876+0000 7f9256770640 1 -- 172.21.15.142:0/458428614 <== osd.0 v2:172.21.15.31:6800/168281188 14 ==== osd_op_reply(58 notify.7 [create] v30'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9240051070 con 0x7f9248027020 2024-09-22T08:36:46.888 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.876+0000 7f9256770640 1 -- 172.21.15.142:0/458428614 <== osd.0 v2:172.21.15.31:6800/168281188 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94785193024384] v30'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9240051070 con 0x7f9248027020 2024-09-22T08:36:46.888 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.876+0000 7f9259487800 1 -- 172.21.15.142:0/458428614 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94785193033568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5634e5c2c430 con 0x7f9248027020 2024-09-22T08:36:46.888 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.876+0000 7f9259487800 20 add_watcher() i=0 2024-09-22T08:36:46.888 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.876+0000 7f9259487800 20 add_watcher() i=1 2024-09-22T08:36:46.889 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.876+0000 7f9259487800 20 add_watcher() i=2 2024-09-22T08:36:46.889 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.876+0000 7f9259487800 20 add_watcher() i=3 2024-09-22T08:36:46.889 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.876+0000 7f9259487800 20 add_watcher() i=4 2024-09-22T08:36:46.889 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.876+0000 7f9259487800 20 add_watcher() i=5 2024-09-22T08:36:46.889 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.876+0000 7f9259487800 20 add_watcher() i=6 2024-09-22T08:36:46.889 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.877+0000 7f9256770640 1 -- 172.21.15.142:0/458428614 <== osd.0 v2:172.21.15.31:6800/168281188 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94785193033568] v30'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9240051070 con 0x7f9248027020 2024-09-22T08:36:46.889 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.877+0000 7f9259487800 20 add_watcher() i=7 2024-09-22T08:36:46.889 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.877+0000 7f9259487800 2 all 8 watchers are set, enabling cache 2024-09-22T08:36:46.889 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.877+0000 7f9259487800 1 -- 172.21.15.142:0/458428614 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5634e5c2fd00 con 0x5634e5c1b7f0 2024-09-22T08:36:46.889 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.877+0000 7f9256770640 1 -- 172.21.15.142:0/458428614 <== osd.1 v2:172.21.15.142:6816/3192108003 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f9240051070 con 0x5634e5c1b7f0 2024-09-22T08:36:46.889 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.877+0000 7f9259487800 1 -- 172.21.15.142:0/458428614 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94785193035728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5634e5c2d0a0 con 0x5634e5c1b7f0 2024-09-22T08:36:46.889 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.878+0000 7f9256770640 1 -- 172.21.15.142:0/458428614 <== osd.1 v2:172.21.15.142:6816/3192108003 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94785193035728] v30'110 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9240051070 con 0x5634e5c1b7f0 2024-09-22T08:36:46.889 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.878+0000 7f910d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:36:46.889 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.878+0000 7f9259487800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:36:46.889 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.878+0000 7f9259487800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:36:46.890 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.878+0000 7f9259487800 5 note: GC not initialized 2024-09-22T08:36:46.890 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.879+0000 7f9087fff640 20 reqs_thread_entry: start 2024-09-22T08:36:46.890 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.879+0000 7f9259487800 20 init_complete bucket index max shards: 11 2024-09-22T08:36:46.890 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.879+0000 7f9259487800 20 Filter name: none 2024-09-22T08:36:46.890 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.879+0000 7f9085ffb640 20 reqs_thread_entry: start 2024-09-22T08:36:46.890 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.879+0000 7f9259487800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-22T08:36:46.890 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.879+0000 7f9259487800 20 rados->read ofs=0 len=0 2024-09-22T08:36:46.890 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.879+0000 7f9259487800 1 -- 172.21.15.142:0/458428614 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5634e5c62cc0 con 0x7f9248027020 2024-09-22T08:36:46.895 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.879+0000 7f9256770640 1 -- 172.21.15.142:0/458428614 <== osd.0 v2:172.21.15.31:6800/168281188 17 ==== osd_op_reply(62 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f9240051070 con 0x7f9248027020 2024-09-22T08:36:46.895 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.879+0000 7f9259487800 20 rados_obj.operate() r=0 bl.length=380 2024-09-22T08:36:46.895 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.879+0000 7f9259487800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-09-22T08:36:46.895 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.879+0000 7f9259487800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-22T08:36:46.895 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.879+0000 7f9259487800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:36:46.895 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.880+0000 7f9259487800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-22T08:36:46.896 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.880+0000 7f9259487800 20 rados->read ofs=0 len=0 2024-09-22T08:36:46.896 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.880+0000 7f9259487800 1 -- 172.21.15.142:0/458428614 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5634e5c64db0 con 0x7f9250032020 2024-09-22T08:36:46.896 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.880+0000 7f9256f71640 1 -- 172.21.15.142:0/458428614 <== osd.2 v2:172.21.15.142:6808/279438927 11 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv18 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f924801b070 con 0x7f9250032020 2024-09-22T08:36:46.896 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.880+0000 7f9259487800 20 rados_obj.operate() r=0 bl.length=165 2024-09-22T08:36:46.896 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.880+0000 7f9259487800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-22T08:36:46.896 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.880+0000 7f9259487800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-22T08:36:46.896 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.880+0000 7f9259487800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1 : miss 2024-09-22T08:36:46.896 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.880+0000 7f9259487800 20 rados->read ofs=0 len=0 2024-09-22T08:36:46.896 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.880+0000 7f9259487800 1 -- 172.21.15.142:0/458428614 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:64 8.15 8:ab67ca09:root::.bucket.meta.myfoo%3ae239248c-0bee-4e41-803a-24b288d3eb8f.4226.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5634e5c66870 con 0x5634e5c20200 2024-09-22T08:36:46.896 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.880+0000 7f9257772640 1 -- 172.21.15.142:0/458428614 <== osd.3 v2:172.21.15.142:6800/1064901393 16 ==== osd_op_reply(64 .bucket.meta.myfoo:e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7f92500083e0 con 0x5634e5c20200 2024-09-22T08:36:46.896 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.880+0000 7f9259487800 20 rados_obj.operate() r=0 bl.length=387 2024-09-22T08:36:46.896 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.880+0000 7f9259487800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1 info.flags=0x17 2024-09-22T08:36:46.896 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.880+0000 7f9259487800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1 to cache LRU end 2024-09-22T08:36:46.896 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.880+0000 7f9259487800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:36:46.897 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.880+0000 7f9259487800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-22T08:36:46.897 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.880+0000 7f9259487800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1 2024-09-22T08:36:46.897 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.880+0000 7f9259487800 10 cache get: name=default.rgw.meta+users.uid+fud : hit (requested=0x13, cached=0x13) 2024-09-22T08:36:46.897 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.880+0000 7f9259487800 1 -- 172.21.15.142:0/458428614 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:65 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5634e5c6aad0 con 0x7f9250032020 2024-09-22T08:36:46.897 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.881+0000 7f9256f71640 1 -- 172.21.15.142:0/458428614 <== osd.2 v2:172.21.15.142:6808/279438927 12 ==== osd_op_reply(65 foo.buckets [call] v30'19 uv17 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f924801b070 con 0x7f9250032020 2024-09-22T08:36:46.897 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.881+0000 7f9259487800 1 -- 172.21.15.142:0/458428614 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:66 8.15 8:ab67ca09:root::.bucket.meta.myfoo%3ae239248c-0bee-4e41-803a-24b288d3eb8f.4226.1:head [delete,create,call version.check_conds in=122b,call version.inc in=38b,writefull 0~387 in=387b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5634e5c708a0 con 0x5634e5c20200 2024-09-22T08:36:46.897 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.883+0000 7f9257772640 1 -- 172.21.15.142:0/458428614 <== osd.3 v2:172.21.15.142:6800/1064901393 17 ==== osd_op_reply(66 .bucket.meta.myfoo:e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1 [delete,create,call,call,writefull 0~387,setxattr (123)] v30'4 uv4 ondisk = 0) ==== 416+0+0 (crc 0 0 0) 0x7f92500083e0 con 0x5634e5c20200 2024-09-22T08:36:46.897 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.883+0000 7f9259487800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1 info.flags=0x17 2024-09-22T08:36:46.897 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.883+0000 7f9259487800 10 moving default.rgw.meta+root+.bucket.meta.myfoo:e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1 to cache LRU end 2024-09-22T08:36:46.897 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.883+0000 7f9259487800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-22T08:36:46.897 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.883+0000 7f9259487800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1, ofs0, ns] 2024-09-22T08:36:46.897 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.883+0000 7f9259487800 1 -- 172.21.15.142:0/458428614 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [notify cookie 94785193273312 in=772b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5634e5c6af00 con 0x7f9250032020 2024-09-22T08:36:46.897 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.883+0000 7f9256f71640 1 -- 172.21.15.142:0/458428614 <== osd.2 v2:172.21.15.142:6808/279438927 13 ==== watch-notify(notify (1) cookie 94785193023328 notify 128849018893 ret 0) ==== 802+0+0 (crc 0 0 0) 0x7f9248052e30 con 0x7f9250032020 2024-09-22T08:36:46.898 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.883+0000 7f913a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018893 cookie 94785193023328 notifier 4499 bl.length()=760 2024-09-22T08:36:46.898 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.883+0000 7f9256f71640 1 -- 172.21.15.142:0/458428614 <== osd.2 v2:172.21.15.142:6808/279438927 14 ==== osd_op_reply(67 notify.3 [notify cookie 94785193273312 out=8b] v0'0 uv114 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f924801b070 con 0x7f9250032020 2024-09-22T08:36:46.898 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.883+0000 7f913a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1 info.flags=0x17 2024-09-22T08:36:46.898 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.883+0000 7f913a7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1 to cache LRU end 2024-09-22T08:36:46.898 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.883+0000 7f913a7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-09-22T08:36:46.898 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.883+0000 7f913a7fc640 1 -- 172.21.15.142:0/458428614 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f911c003ea0 con 0x7f9250032020 2024-09-22T08:36:46.898 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.883+0000 7f9256f71640 1 -- 172.21.15.142:0/458428614 <== osd.2 v2:172.21.15.142:6808/279438927 15 ==== osd_op_reply(68 notify.3 [notify-ack] v0'0 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f924801b070 con 0x7f9250032020 2024-09-22T08:36:46.898 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.883+0000 7f9256f71640 1 -- 172.21.15.142:0/458428614 <== osd.2 v2:172.21.15.142:6808/279438927 16 ==== watch-notify(notify_complete (2) cookie 94785193273312 notify 128849018893 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5634e5be2070 con 0x7f9250032020 2024-09-22T08:36:46.898 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.883+0000 7f9259487800 20 handle_bi_update(): bucket=:myfoo[e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1]): orig_sources= new_sources= 2024-09-22T08:36:46.898 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.883+0000 7f9259487800 20 handle_bi_update(): bucket=:myfoo[e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1]): potential sources added=[] removed=[] 2024-09-22T08:36:46.898 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.883+0000 7f9259487800 20 handle_bi_update(): bucket=:myfoo[e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1]): orig_dests= new_dests= 2024-09-22T08:36:46.898 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.883+0000 7f9259487800 20 handle_bi_update(): bucket=:myfoo[e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1]): potential dests added=[] removed=[] 2024-09-22T08:36:46.899 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.883+0000 7f9259487800 1 -- 172.21.15.142:0/458428614 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:69 8.1 8:810902b1:users.uid::fud.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5634e5c667e0 con 0x7f9248027020 2024-09-22T08:36:46.899 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.885+0000 7f9256770640 1 -- 172.21.15.142:0/458428614 <== osd.0 v2:172.21.15.31:6800/168281188 18 ==== osd_op_reply(69 fud.buckets [call] v30'1 uv1 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f9240051070 con 0x7f9248027020 2024-09-22T08:36:46.899 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.885+0000 7f9259487800 1 -- 172.21.15.142:0/458428614 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:70 8.9 8:91b71841:root::myfoo:head [delete,create,call version.inc in=38b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5634e5c667e0 con 0x7f9250032020 2024-09-22T08:36:46.899 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.886+0000 7f9256f71640 1 -- 172.21.15.142:0/458428614 <== osd.2 v2:172.21.15.142:6808/279438927 17 ==== osd_op_reply(70 myfoo [delete,create,call,writefull 0~165] v30'20 uv20 ondisk = 0) ==== 275+0+0 (crc 0 0 0) 0x7f924801b070 con 0x7f9250032020 2024-09-22T08:36:46.899 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.886+0000 7f9259487800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-09-22T08:36:46.899 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.886+0000 7f9259487800 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-22T08:36:46.899 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.886+0000 7f9259487800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-22T08:36:46.899 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.886+0000 7f9259487800 1 -- 172.21.15.142:0/458428614 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94785193273312 in=326b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5634e5c6f6a0 con 0x7f9248027020 2024-09-22T08:36:46.899 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.886+0000 7f9256770640 1 -- 172.21.15.142:0/458428614 <== osd.0 v2:172.21.15.31:6800/168281188 19 ==== watch-notify(notify (1) cookie 94785193024384 notify 128849018889 ret 0) ==== 356+0+0 (crc 0 0 0) 0x5634e5af17d0 con 0x7f9248027020 2024-09-22T08:36:46.899 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.886+0000 7f913a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018889 cookie 94785193024384 notifier 4499 bl.length()=314 2024-09-22T08:36:46.899 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.886+0000 7f913a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-09-22T08:36:46.899 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.886+0000 7f913a7fc640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-22T08:36:46.899 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.886+0000 7f913a7fc640 1 -- 172.21.15.142:0/458428614 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f911c003ea0 con 0x7f9248027020 2024-09-22T08:36:46.899 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.886+0000 7f9256770640 1 -- 172.21.15.142:0/458428614 <== osd.0 v2:172.21.15.31:6800/168281188 20 ==== osd_op_reply(71 notify.6 [notify cookie 94785193273312 out=8b] v0'0 uv114 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f9240051070 con 0x7f9248027020 2024-09-22T08:36:46.900 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.886+0000 7f9256770640 1 -- 172.21.15.142:0/458428614 <== osd.0 v2:172.21.15.31:6800/168281188 21 ==== osd_op_reply(72 notify.6 [notify-ack] v0'0 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9240051070 con 0x7f9248027020 2024-09-22T08:36:46.900 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.887+0000 7f9256770640 1 -- 172.21.15.142:0/458428614 <== osd.0 v2:172.21.15.31:6800/168281188 22 ==== watch-notify(notify_complete (2) cookie 94785193273312 notify 128849018889 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f924007a7e0 con 0x7f9248027020 2024-09-22T08:36:46.900 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.887+0000 7f910d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:36:46.900 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.887+0000 7f9259487800 1 -- 172.21.15.142:0/458428614 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:73 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94785193035728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5634e5c609c0 con 0x5634e5c1b7f0 2024-09-22T08:36:46.900 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.889+0000 7f9256770640 1 -- 172.21.15.142:0/458428614 <== osd.1 v2:172.21.15.142:6816/3192108003 21 ==== osd_op_reply(73 data_loggenerations_metadata [watch unwatch cookie 94785193035728] v30'111 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9240051070 con 0x5634e5c1b7f0 2024-09-22T08:36:46.900 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.889+0000 7f9259487800 1 -- 172.21.15.142:0/458428614 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:74 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94785193009152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5634e5c609c0 con 0x7f9250032020 2024-09-22T08:36:46.900 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.889+0000 7f9256f71640 1 -- 172.21.15.142:0/458428614 <== osd.2 v2:172.21.15.142:6808/279438927 18 ==== osd_op_reply(74 notify.0 [watch unwatch cookie 94785193009152] v30'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f924801b070 con 0x7f9250032020 2024-09-22T08:36:46.900 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.889+0000 7f9259487800 20 remove_watcher() i=0 2024-09-22T08:36:46.900 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.889+0000 7f9259487800 2 removed watcher, disabling cache 2024-09-22T08:36:46.900 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.890+0000 7f9259487800 1 -- 172.21.15.142:0/458428614 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:75 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94785193016336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5634e5c609c0 con 0x5634e5c1b7f0 2024-09-22T08:36:46.900 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.891+0000 7f9256770640 1 -- 172.21.15.142:0/458428614 <== osd.1 v2:172.21.15.142:6816/3192108003 22 ==== osd_op_reply(75 notify.1 [watch unwatch cookie 94785193016336] v30'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9240051070 con 0x5634e5c1b7f0 2024-09-22T08:36:46.900 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.891+0000 7f9259487800 20 remove_watcher() i=1 2024-09-22T08:36:46.900 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.891+0000 7f9259487800 1 -- 172.21.15.142:0/458428614 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:76 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94785193019072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5634e5c609c0 con 0x5634e5c20200 2024-09-22T08:36:46.900 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.891+0000 7f9257772640 1 -- 172.21.15.142:0/458428614 <== osd.3 v2:172.21.15.142:6800/1064901393 18 ==== osd_op_reply(76 notify.2 [watch unwatch cookie 94785193019072] v30'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f92500083e0 con 0x5634e5c20200 2024-09-22T08:36:46.901 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.892+0000 7f9259487800 20 remove_watcher() i=2 2024-09-22T08:36:46.901 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.892+0000 7f9259487800 1 -- 172.21.15.142:0/458428614 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:77 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94785193023328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5634e5c609c0 con 0x7f9250032020 2024-09-22T08:36:46.901 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.892+0000 7f9256f71640 1 -- 172.21.15.142:0/458428614 <== osd.2 v2:172.21.15.142:6808/279438927 19 ==== osd_op_reply(77 notify.3 [watch unwatch cookie 94785193023328] v30'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f924801b070 con 0x7f9250032020 2024-09-22T08:36:46.901 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.892+0000 7f9259487800 20 remove_watcher() i=3 2024-09-22T08:36:46.901 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.892+0000 7f9259487800 1 -- 172.21.15.142:0/458428614 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:78 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94785193026976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5634e5c609c0 con 0x5634e5c1b7f0 2024-09-22T08:36:46.901 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.894+0000 7f9256770640 1 -- 172.21.15.142:0/458428614 <== osd.1 v2:172.21.15.142:6816/3192108003 23 ==== osd_op_reply(78 notify.4 [watch unwatch cookie 94785193026976] v30'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9240051070 con 0x5634e5c1b7f0 2024-09-22T08:36:46.901 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.894+0000 7f9259487800 20 remove_watcher() i=4 2024-09-22T08:36:46.901 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.894+0000 7f9259487800 1 -- 172.21.15.142:0/458428614 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:79 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94785193029696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5634e5c609c0 con 0x7f9248027020 2024-09-22T08:36:46.904 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.895+0000 7f9256770640 1 -- 172.21.15.142:0/458428614 <== osd.0 v2:172.21.15.31:6800/168281188 23 ==== osd_op_reply(79 notify.5 [watch unwatch cookie 94785193029696] v30'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9240051070 con 0x7f9248027020 2024-09-22T08:36:46.904 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.895+0000 7f9259487800 20 remove_watcher() i=5 2024-09-22T08:36:46.904 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.895+0000 7f9259487800 1 -- 172.21.15.142:0/458428614 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:80 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94785193024384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5634e5c609c0 con 0x7f9248027020 2024-09-22T08:36:46.904 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.896+0000 7f9256770640 1 -- 172.21.15.142:0/458428614 <== osd.0 v2:172.21.15.31:6800/168281188 24 ==== osd_op_reply(80 notify.6 [watch unwatch cookie 94785193024384] v30'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9240051070 con 0x7f9248027020 2024-09-22T08:36:46.904 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.896+0000 7f9259487800 20 remove_watcher() i=6 2024-09-22T08:36:46.905 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.896+0000 7f9259487800 1 -- 172.21.15.142:0/458428614 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:81 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94785193033568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5634e5c609c0 con 0x7f9248027020 2024-09-22T08:36:46.905 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.897+0000 7f9256770640 1 -- 172.21.15.142:0/458428614 <== osd.0 v2:172.21.15.31:6800/168281188 25 ==== osd_op_reply(81 notify.7 [watch unwatch cookie 94785193033568] v30'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9240051070 con 0x7f9248027020 2024-09-22T08:36:46.905 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.897+0000 7f9259487800 20 remove_watcher() i=7 2024-09-22T08:36:46.905 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.897+0000 7f9259487800 1 -- 172.21.15.142:0/458428614 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f9248027020 msgr2=0x7f924801e3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:46.905 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.897+0000 7f9259487800 1 --2- 172.21.15.142:0/458428614 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f9248027020 0x7f924801e3f0 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:46.905 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.897+0000 7f9259487800 1 -- 172.21.15.142:0/458428614 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5634e5c1b7f0 msgr2=0x5634e5c1dcb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:46.905 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.897+0000 7f9259487800 1 --2- 172.21.15.142:0/458428614 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5634e5c1b7f0 0x5634e5c1dcb0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:46.905 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.897+0000 7f9259487800 1 -- 172.21.15.142:0/458428614 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f9250032020 msgr2=0x7f925003b9a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:46.905 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.897+0000 7f9259487800 1 --2- 172.21.15.142:0/458428614 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f9250032020 0x7f925003b9a0 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:46.905 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.897+0000 7f9259487800 1 -- 172.21.15.142:0/458428614 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5634e5c20200 msgr2=0x5634e5c225f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:46.905 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.897+0000 7f9259487800 1 --2- 172.21.15.142:0/458428614 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5634e5c20200 0x5634e5c225f0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:46.905 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.897+0000 7f9259487800 1 -- 172.21.15.142:0/458428614 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f912003cfb0 msgr2=0x7f912003f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:46.905 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.897+0000 7f9259487800 1 --2- 172.21.15.142:0/458428614 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f912003cfb0 0x7f912003f470 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f9248014fd0 tx=0x7f9248032000 comp rx=0 tx=0).stop 2024-09-22T08:36:46.905 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.897+0000 7f9259487800 1 -- 172.21.15.142:0/458428614 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5634e5c08920 msgr2=0x5634e5c0fe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:46.906 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.897+0000 7f9259487800 1 --2- 172.21.15.142:0/458428614 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5634e5c08920 0x5634e5c0fe90 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f92500154a0 tx=0x7f9250053d50 comp rx=0 tx=0).stop 2024-09-22T08:36:46.906 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.897+0000 7f9256770640 1 -- 172.21.15.142:0/458428614 reap_dead start 2024-09-22T08:36:46.906 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.897+0000 7f9259487800 1 -- 172.21.15.142:0/458428614 shutdown_connections 2024-09-22T08:36:46.906 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.897+0000 7f9259487800 1 -- 172.21.15.142:0/458428614 >> 172.21.15.142:0/458428614 conn(0x5634e5c04d20 msgr2=0x5634e5c02f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:46.906 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.897+0000 7f9259487800 1 -- 172.21.15.142:0/458428614 shutdown_connections 2024-09-22T08:36:46.906 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.897+0000 7f9259487800 1 -- 172.21.15.142:0/458428614 wait complete. 2024-09-22T08:36:46.906 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.897+0000 7f9259487800 1 -- 172.21.15.142:0/1746036213 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f913003cfb0 msgr2=0x7f913003f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:46.906 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.897+0000 7f9259487800 1 --2- 172.21.15.142:0/1746036213 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f913003cfb0 0x7f913003f470 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x5634e5bed890 tx=0x7f9248006820 comp rx=0 tx=0).stop 2024-09-22T08:36:46.906 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.897+0000 7f9259487800 1 -- 172.21.15.142:0/1746036213 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5634e5bfbec0 msgr2=0x5634e5bfc2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:46.906 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.897+0000 7f9259487800 1 --2- 172.21.15.142:0/1746036213 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5634e5bfbec0 0x5634e5bfc2e0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x5634e5be1e80 tx=0x7f925000bf30 comp rx=0 tx=0).stop 2024-09-22T08:36:46.906 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.897+0000 7f9259487800 1 -- 172.21.15.142:0/1746036213 shutdown_connections 2024-09-22T08:36:46.906 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.897+0000 7f9259487800 1 --2- 172.21.15.142:0/1746036213 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f913003cfb0 0x7f913003f470 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:46.906 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.897+0000 7f9259487800 1 --2- 172.21.15.142:0/1746036213 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5634e5bfbec0 0x5634e5bfc2e0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:46.906 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.897+0000 7f9259487800 1 -- 172.21.15.142:0/1746036213 >> 172.21.15.142:0/1746036213 conn(0x5634e5bf0270 msgr2=0x5634e5bf0650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:46.907 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.897+0000 7f9259487800 1 -- 172.21.15.142:0/1746036213 shutdown_connections 2024-09-22T08:36:46.907 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.897+0000 7f9259487800 1 -- 172.21.15.142:0/1746036213 wait complete. 2024-09-22T08:36:46.907 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.898+0000 7f9259487800 1 -- 172.21.15.142:0/1241601303 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5634e5aedc00 msgr2=0x5634e5be84d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:46.907 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.898+0000 7f9259487800 1 --2- 172.21.15.142:0/1241601303 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5634e5aedc00 0x5634e5be84d0 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:46.907 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.898+0000 7f9259487800 1 -- 172.21.15.142:0/1241601303 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5634e5bea8b0 msgr2=0x5634e5becd30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:46.907 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.898+0000 7f9259487800 1 --2- 172.21.15.142:0/1241601303 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5634e5bea8b0 0x5634e5becd30 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:46.907 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.898+0000 7f9259487800 1 -- 172.21.15.142:0/1241601303 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f913c03d000 msgr2=0x7f913c03f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:46.907 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.898+0000 7f9259487800 1 --2- 172.21.15.142:0/1241601303 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f913c03d000 0x7f913c03f4c0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f9240057000 tx=0x7f9240052000 comp rx=0 tx=0).stop 2024-09-22T08:36:46.907 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.898+0000 7f9259487800 1 -- 172.21.15.142:0/1241601303 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5634e5a5b550 msgr2=0x5634e5be0e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:46.907 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.898+0000 7f9259487800 1 --2- 172.21.15.142:0/1241601303 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5634e5a5b550 0x5634e5be0e80 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f9248000f80 tx=0x7f9248001250 comp rx=0 tx=0).stop 2024-09-22T08:36:46.907 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.898+0000 7f9259487800 1 -- 172.21.15.142:0/1241601303 shutdown_connections 2024-09-22T08:36:46.907 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.898+0000 7f9259487800 1 --2- 172.21.15.142:0/1241601303 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5634e5bea8b0 0x5634e5becd30 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:46.907 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.898+0000 7f9259487800 1 --2- 172.21.15.142:0/1241601303 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5634e5aedc00 0x5634e5be84d0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:46.908 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.898+0000 7f9259487800 1 --2- 172.21.15.142:0/1241601303 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f913c03d000 0x7f913c03f4c0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:46.908 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.898+0000 7f9259487800 1 --2- 172.21.15.142:0/1241601303 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5634e5a5b550 0x5634e5be0e80 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:46.908 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.898+0000 7f9259487800 1 -- 172.21.15.142:0/1241601303 >> 172.21.15.142:0/1241601303 conn(0x5634e5ae1bc0 msgr2=0x5634e5bda800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:46.908 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.898+0000 7f9259487800 1 -- 172.21.15.142:0/1241601303 shutdown_connections 2024-09-22T08:36:46.908 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.898+0000 7f9259487800 1 -- 172.21.15.142:0/1241601303 wait complete. 2024-09-22T08:36:46.909 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud'] 2024-09-22T08:36:46.909 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud'] 2024-09-22T08:36:46.909 DEBUG:teuthology.orchestra.run.smithi142:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud 2024-09-22T08:36:46.953 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:36:46.953 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:36:46.954 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.952+0000 7fc96632a800 1 Processor -- start 2024-09-22T08:36:46.955 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.952+0000 7fc96632a800 1 -- start start 2024-09-22T08:36:46.955 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.953+0000 7fc96632a800 1 --2- >> v2:172.21.15.31:3300/0 conn(0x556311ed87e0 0x556311ed94e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:46.955 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.953+0000 7fc96632a800 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x556311d64a20 con 0x556311ed9a20 2024-09-22T08:36:46.955 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.953+0000 7fc96632a800 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x556311d647d0 con 0x556311ed87e0 2024-09-22T08:36:46.955 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.953+0000 7fc961f61640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x556311ed87e0 0x556311ed94e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:46.955 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.953+0000 7fc961f61640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x556311ed87e0 0x556311ed94e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:39564/0 (socket says 172.21.15.142:39564) 2024-09-22T08:36:46.955 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.953+0000 7fc961f61640 1 -- 172.21.15.142:0/2867228640 learned_addr learned my addr 172.21.15.142:0/2867228640 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:46.955 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.953+0000 7fc961f61640 1 -- 172.21.15.142:0/2867228640 >> v1:172.21.15.31:6789/0 conn(0x556311ed9a20 legacy=0x556311ede570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:46.955 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.953+0000 7fc961f61640 1 -- 172.21.15.142:0/2867228640 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x556311ed8ee0 con 0x556311ed87e0 2024-09-22T08:36:46.956 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.955+0000 7fc961f61640 1 --2- 172.21.15.142:0/2867228640 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556311ed87e0 0x556311ed94e0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fc954005fd0 tx=0x7fc954045cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffb6b2dee85ba9e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:46.956 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.955+0000 7fc960f5f640 1 -- 172.21.15.142:0/2867228640 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc95404e600 con 0x556311ed87e0 2024-09-22T08:36:46.956 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.955+0000 7fc960f5f640 1 -- 172.21.15.142:0/2867228640 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc95404e7a0 con 0x556311ed87e0 2024-09-22T08:36:46.956 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.955+0000 7fc960f5f640 1 -- 172.21.15.142:0/2867228640 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc95404eaa0 con 0x556311ed87e0 2024-09-22T08:36:46.957 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.956+0000 7fc96632a800 1 -- 172.21.15.142:0/2867228640 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556311ed87e0 msgr2=0x556311ed94e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:46.957 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.956+0000 7fc96632a800 1 --2- 172.21.15.142:0/2867228640 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556311ed87e0 0x556311ed94e0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fc954005fd0 tx=0x7fc954045cf0 comp rx=0 tx=0).stop 2024-09-22T08:36:46.958 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.956+0000 7fc96632a800 1 -- 172.21.15.142:0/2867228640 shutdown_connections 2024-09-22T08:36:46.958 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.956+0000 7fc96632a800 1 --2- 172.21.15.142:0/2867228640 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556311ed87e0 0x556311ed94e0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:46.958 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.956+0000 7fc96632a800 1 -- 172.21.15.142:0/2867228640 >> 172.21.15.142:0/2867228640 conn(0x556311ed3bb0 msgr2=0x556311ed6010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:46.958 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.956+0000 7fc96632a800 1 -- 172.21.15.142:0/2867228640 shutdown_connections 2024-09-22T08:36:46.958 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.956+0000 7fc96632a800 1 -- 172.21.15.142:0/2867228640 wait complete. 2024-09-22T08:36:46.971 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.969+0000 7fc96632a800 1 Processor -- start 2024-09-22T08:36:46.971 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.970+0000 7fc96632a800 1 -- start start 2024-09-22T08:36:46.971 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.970+0000 7fc96632a800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556311ed87e0 0x556311e4c910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:46.971 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.970+0000 7fc96632a800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x556311d71dd0 con 0x556311ed87e0 2024-09-22T08:36:46.972 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.970+0000 7fc961f61640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556311ed87e0 0x556311e4c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:46.972 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.970+0000 7fc961f61640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556311ed87e0 0x556311e4c910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:39570/0 (socket says 172.21.15.142:39570) 2024-09-22T08:36:46.972 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.970+0000 7fc961f61640 1 -- 172.21.15.142:0/96185114 learned_addr learned my addr 172.21.15.142:0/96185114 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:46.972 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.970+0000 7fc961f61640 1 -- 172.21.15.142:0/96185114 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556311e4ce50 con 0x556311ed87e0 2024-09-22T08:36:46.972 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.970+0000 7fc961f61640 1 --2- 172.21.15.142:0/96185114 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556311ed87e0 0x556311e4c910 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fc954005fd0 tx=0x7fc954050000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c26b00437413b447 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:46.975 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.971+0000 7fc84fe07640 1 -- 172.21.15.142:0/96185114 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc95404eb40 con 0x556311ed87e0 2024-09-22T08:36:46.975 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.971+0000 7fc84fe07640 1 -- 172.21.15.142:0/96185114 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc954066070 con 0x556311ed87e0 2024-09-22T08:36:46.976 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.971+0000 7fc84fe07640 1 -- 172.21.15.142:0/96185114 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc95404ee50 con 0x556311ed87e0 2024-09-22T08:36:46.976 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.971+0000 7fc96632a800 1 -- 172.21.15.142:0/96185114 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556311ed87e0 msgr2=0x556311e4c910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:46.976 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.971+0000 7fc96632a800 1 --2- 172.21.15.142:0/96185114 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556311ed87e0 0x556311e4c910 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fc954005fd0 tx=0x7fc954050000 comp rx=0 tx=0).stop 2024-09-22T08:36:46.976 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.971+0000 7fc96632a800 1 -- 172.21.15.142:0/96185114 shutdown_connections 2024-09-22T08:36:46.976 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.971+0000 7fc96632a800 1 --2- 172.21.15.142:0/96185114 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556311ed87e0 0x556311e4c910 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:46.976 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.971+0000 7fc96632a800 1 -- 172.21.15.142:0/96185114 >> 172.21.15.142:0/96185114 conn(0x556311ed3bb0 msgr2=0x556311fc3890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:46.976 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.971+0000 7fc96632a800 1 -- 172.21.15.142:0/96185114 shutdown_connections 2024-09-22T08:36:46.976 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.971+0000 7fc96632a800 1 -- 172.21.15.142:0/96185114 wait complete. 2024-09-22T08:36:46.976 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.972+0000 7fc96632a800 1 Processor -- start 2024-09-22T08:36:46.976 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.972+0000 7fc96632a800 1 -- start start 2024-09-22T08:36:46.976 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.972+0000 7fc96632a800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556311ed87e0 0x556311fd2c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:46.976 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.972+0000 7fc96632a800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x556311eda290 con 0x556311ed87e0 2024-09-22T08:36:46.976 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.972+0000 7fc961f61640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556311ed87e0 0x556311fd2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:46.977 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.972+0000 7fc961f61640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556311ed87e0 0x556311fd2c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:39574/0 (socket says 172.21.15.142:39574) 2024-09-22T08:36:46.977 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.972+0000 7fc961f61640 1 -- 172.21.15.142:0/3217537769 learned_addr learned my addr 172.21.15.142:0/3217537769 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:46.977 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.972+0000 7fc961f61640 1 -- 172.21.15.142:0/3217537769 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556311fd31d0 con 0x556311ed87e0 2024-09-22T08:36:46.977 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.973+0000 7fc961f61640 1 --2- 172.21.15.142:0/3217537769 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556311ed87e0 0x556311fd2c70 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fc954063040 tx=0x7fc954003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:46.977 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.973+0000 7fc84e604640 1 -- 172.21.15.142:0/3217537769 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc95406d550 con 0x556311ed87e0 2024-09-22T08:36:46.977 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.973+0000 7fc96632a800 1 -- 172.21.15.142:0/3217537769 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556311fd3460 con 0x556311ed87e0 2024-09-22T08:36:46.977 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.973+0000 7fc84e604640 1 -- 172.21.15.142:0/3217537769 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc954071030 con 0x556311ed87e0 2024-09-22T08:36:46.977 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.973+0000 7fc96632a800 1 -- 172.21.15.142:0/3217537769 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556311fd3e60 con 0x556311ed87e0 2024-09-22T08:36:46.977 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.973+0000 7fc84e604640 1 -- 172.21.15.142:0/3217537769 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc95407b060 con 0x556311ed87e0 2024-09-22T08:36:46.977 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.974+0000 7fc84e604640 1 -- 172.21.15.142:0/3217537769 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fc95406d820 con 0x556311ed87e0 2024-09-22T08:36:46.977 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.974+0000 7fc84e604640 1 --2- 172.21.15.142:0/3217537769 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fc84803cfb0 0x7fc84803f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:46.977 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.974+0000 7fc84e604640 1 -- 172.21.15.142:0/3217537769 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fc954098e70 con 0x556311ed87e0 2024-09-22T08:36:46.977 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.974+0000 7fc961760640 1 --2- 172.21.15.142:0/3217537769 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fc84803cfb0 0x7fc84803f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:46.977 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.974+0000 7fc96632a800 1 --2- 172.21.15.142:0/3217537769 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x556311ed9a20 0x556311fda2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:46.978 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.974+0000 7fc96632a800 1 -- 172.21.15.142:0/3217537769 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556311fda800 con 0x556311ed9a20 2024-09-22T08:36:46.978 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.974+0000 7fc962762640 1 --2- 172.21.15.142:0/3217537769 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x556311ed9a20 0x556311fda2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:46.978 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.974+0000 7fc961760640 1 --2- 172.21.15.142:0/3217537769 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fc84803cfb0 0x7fc84803f470 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fc94c001e50 tx=0x7fc94c0013d0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:46.978 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.975+0000 7fc962762640 1 --2- 172.21.15.142:0/3217537769 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x556311ed9a20 0x556311fda2c0 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:46.984 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.975+0000 7fc962762640 1 -- 172.21.15.142:0/3217537769 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc95c0083e0 con 0x556311ed9a20 2024-09-22T08:36:46.984 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.975+0000 7fc96632a800 1 -- 172.21.15.142:0/3217537769 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556311fdaba0 con 0x556311ed9a20 2024-09-22T08:36:46.984 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.975+0000 7fc962762640 1 -- 172.21.15.142:0/3217537769 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc95c0083e0 con 0x556311ed9a20 2024-09-22T08:36:46.984 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.975+0000 7fc96632a800 1 --2- 172.21.15.142:0/3217537769 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x556311fdc660 0x556311fdeb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:46.984 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.975+0000 7fc96632a800 1 -- 172.21.15.142:0/3217537769 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:3 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556311fdf290 con 0x556311fdc660 2024-09-22T08:36:46.984 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.975+0000 7fc961f61640 1 --2- 172.21.15.142:0/3217537769 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x556311fdc660 0x556311fdeb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:46.984 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.975+0000 7fc961f61640 1 --2- 172.21.15.142:0/3217537769 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x556311fdc660 0x556311fdeb00 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:46.984 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.976+0000 7fc961f61640 1 -- 172.21.15.142:0/3217537769 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(3 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fc954076940 con 0x556311fdc660 2024-09-22T08:36:46.984 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.976+0000 7fc96632a800 1 -- 172.21.15.142:0/3217537769 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556311fdb3f0 con 0x556311ed9a20 2024-09-22T08:36:46.984 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.976+0000 7fc962762640 1 -- 172.21.15.142:0/3217537769 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc95c0083e0 con 0x556311ed9a20 2024-09-22T08:36:46.984 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.976+0000 7fc96632a800 1 -- 172.21.15.142:0/3217537769 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556311fdb7d0 con 0x556311fdc660 2024-09-22T08:36:46.984 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.976+0000 7fc961f61640 1 -- 172.21.15.142:0/3217537769 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(5 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fc954076940 con 0x556311fdc660 2024-09-22T08:36:46.985 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.977+0000 7fc96632a800 1 Processor -- start 2024-09-22T08:36:46.985 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.977+0000 7fc96632a800 1 -- start start 2024-09-22T08:36:46.985 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.977+0000 7fc96632a800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556311fedc70 0x556311fee090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:46.985 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.977+0000 7fc96632a800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x556311dd0d50 con 0x556311fedc70 2024-09-22T08:36:46.985 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.977+0000 7fc962762640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556311fedc70 0x556311fee090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:46.985 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.977+0000 7fc962762640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556311fedc70 0x556311fee090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:39584/0 (socket says 172.21.15.142:39584) 2024-09-22T08:36:46.985 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.977+0000 7fc962762640 1 -- 172.21.15.142:0/2380963973 learned_addr learned my addr 172.21.15.142:0/2380963973 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:46.985 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.977+0000 7fc962762640 1 -- 172.21.15.142:0/2380963973 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556311fee6d0 con 0x556311fedc70 2024-09-22T08:36:46.985 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.978+0000 7fc962762640 1 --2- 172.21.15.142:0/2380963973 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556311fedc70 0x556311fee090 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x556311fd4b60 tx=0x7fc95c00bf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:46.985 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.978+0000 7fc8477fe640 1 -- 172.21.15.142:0/2380963973 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc95c01c020 con 0x556311fedc70 2024-09-22T08:36:46.985 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.978+0000 7fc8477fe640 1 -- 172.21.15.142:0/2380963973 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc95c007c90 con 0x556311fedc70 2024-09-22T08:36:46.985 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.978+0000 7fc96632a800 1 -- 172.21.15.142:0/2380963973 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556311feef00 con 0x556311fedc70 2024-09-22T08:36:46.985 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.978+0000 7fc8477fe640 1 -- 172.21.15.142:0/2380963973 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc95c018440 con 0x556311fedc70 2024-09-22T08:36:46.986 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.978+0000 7fc96632a800 1 -- 172.21.15.142:0/2380963973 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556311fef4a0 con 0x556311fedc70 2024-09-22T08:36:46.986 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.979+0000 7fc8477fe640 1 -- 172.21.15.142:0/2380963973 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fc95c01f020 con 0x556311fedc70 2024-09-22T08:36:46.986 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.979+0000 7fc8477fe640 1 --2- 172.21.15.142:0/2380963973 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fc83c03cfb0 0x7fc83c03f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:46.986 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.979+0000 7fc8477fe640 1 -- 172.21.15.142:0/2380963973 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fc95c0558f0 con 0x556311fedc70 2024-09-22T08:36:46.986 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.979+0000 7fc961f61640 1 --2- 172.21.15.142:0/2380963973 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fc83c03cfb0 0x7fc83c03f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:46.986 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.979+0000 7fc96632a800 1 Processor -- start 2024-09-22T08:36:46.986 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.979+0000 7fc961f61640 1 --2- 172.21.15.142:0/2380963973 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fc83c03cfb0 0x7fc83c03f470 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x556311fdf630 tx=0x7fc954075d60 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:46.986 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.979+0000 7fc96632a800 1 -- start start 2024-09-22T08:36:46.986 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.980+0000 7fc96632a800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556311ffa6d0 0x556311ffaad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:46.986 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.980+0000 7fc96632a800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x556311fce000 con 0x556311ffa6d0 2024-09-22T08:36:46.986 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.980+0000 7fc962762640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556311ffa6d0 0x556311ffaad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:46.986 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.980+0000 7fc962762640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556311ffa6d0 0x556311ffaad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:39588/0 (socket says 172.21.15.142:39588) 2024-09-22T08:36:46.987 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.980+0000 7fc962762640 1 -- 172.21.15.142:0/949661834 learned_addr learned my addr 172.21.15.142:0/949661834 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:46.987 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.980+0000 7fc962762640 1 -- 172.21.15.142:0/949661834 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556311ffb0c0 con 0x556311ffa6d0 2024-09-22T08:36:46.987 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.980+0000 7fc962762640 1 --2- 172.21.15.142:0/949661834 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556311ffa6d0 0x556311ffaad0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fc95c053e10 tx=0x7fc95c0156f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ba8ee8f30e9247a server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:46.987 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.980+0000 7fc8457fa640 1 -- 172.21.15.142:0/949661834 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc95c051070 con 0x556311ffa6d0 2024-09-22T08:36:46.987 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.980+0000 7fc8457fa640 1 -- 172.21.15.142:0/949661834 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc95c04a070 con 0x556311ffa6d0 2024-09-22T08:36:46.987 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.980+0000 7fc8457fa640 1 -- 172.21.15.142:0/949661834 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc95c0173a0 con 0x556311ffa6d0 2024-09-22T08:36:46.987 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.981+0000 7fc96632a800 1 -- 172.21.15.142:0/949661834 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556311ffa6d0 msgr2=0x556311ffaad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:46.987 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.981+0000 7fc96632a800 1 --2- 172.21.15.142:0/949661834 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556311ffa6d0 0x556311ffaad0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fc95c053e10 tx=0x7fc95c0156f0 comp rx=0 tx=0).stop 2024-09-22T08:36:46.987 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.981+0000 7fc96632a800 1 -- 172.21.15.142:0/949661834 shutdown_connections 2024-09-22T08:36:46.987 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.981+0000 7fc96632a800 1 --2- 172.21.15.142:0/949661834 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556311ffa6d0 0x556311ffaad0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:46.987 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.981+0000 7fc96632a800 1 -- 172.21.15.142:0/949661834 >> 172.21.15.142:0/949661834 conn(0x556311ff6ad0 msgr2=0x556311ff4d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:46.987 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.981+0000 7fc96632a800 1 -- 172.21.15.142:0/949661834 shutdown_connections 2024-09-22T08:36:46.987 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.981+0000 7fc96632a800 1 -- 172.21.15.142:0/949661834 wait complete. 2024-09-22T08:36:46.988 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.981+0000 7fc96632a800 1 Processor -- start 2024-09-22T08:36:46.988 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.981+0000 7fc96632a800 1 -- start start 2024-09-22T08:36:46.988 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.981+0000 7fc96632a800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556311ffa6d0 0x556312001cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:46.988 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.981+0000 7fc96632a800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x556311ffb6e0 con 0x556311ffa6d0 2024-09-22T08:36:46.988 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.981+0000 7fc962762640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556311ffa6d0 0x556312001cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:46.988 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.981+0000 7fc962762640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556311ffa6d0 0x556312001cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:39604/0 (socket says 172.21.15.142:39604) 2024-09-22T08:36:46.988 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.981+0000 7fc962762640 1 -- 172.21.15.142:0/1646387468 learned_addr learned my addr 172.21.15.142:0/1646387468 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:46.988 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.982+0000 7fc962762640 1 -- 172.21.15.142:0/1646387468 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556312002210 con 0x556311ffa6d0 2024-09-22T08:36:46.988 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.982+0000 7fc962762640 1 --2- 172.21.15.142:0/1646387468 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556311ffa6d0 0x556312001cb0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fc95c016010 tx=0x7fc95c053da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:46.988 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.982+0000 7fc8337fe640 1 -- 172.21.15.142:0/1646387468 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc95c013450 con 0x556311ffa6d0 2024-09-22T08:36:46.988 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.982+0000 7fc8337fe640 1 -- 172.21.15.142:0/1646387468 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc95c0135f0 con 0x556311ffa6d0 2024-09-22T08:36:46.988 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.982+0000 7fc8337fe640 1 -- 172.21.15.142:0/1646387468 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc95c055250 con 0x556311ffa6d0 2024-09-22T08:36:46.988 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.982+0000 7fc96632a800 1 -- 172.21.15.142:0/1646387468 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5563120024a0 con 0x556311ffa6d0 2024-09-22T08:36:46.988 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.982+0000 7fc96632a800 1 -- 172.21.15.142:0/1646387468 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556312003030 con 0x556311ffa6d0 2024-09-22T08:36:46.989 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.983+0000 7fc8337fe640 1 -- 172.21.15.142:0/1646387468 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fc95c016040 con 0x556311ffa6d0 2024-09-22T08:36:47.000 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.983+0000 7fc8337fe640 1 --2- 172.21.15.142:0/1646387468 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fc82c03d000 0x7fc82c03f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:47.001 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.983+0000 7fc8337fe640 1 -- 172.21.15.142:0/1646387468 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fc95c036ae0 con 0x556311ffa6d0 2024-09-22T08:36:47.001 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.983+0000 7fc961f61640 1 --2- 172.21.15.142:0/1646387468 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fc82c03d000 0x7fc82c03f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:47.001 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.983+0000 7fc961f61640 1 --2- 172.21.15.142:0/1646387468 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fc82c03d000 0x7fc82c03f4c0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fc954076c50 tx=0x7fc954089000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:47.001 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.984+0000 7fc96632a800 20 rados->read ofs=0 len=0 2024-09-22T08:36:47.001 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.984+0000 7fc96632a800 1 --2- 172.21.15.142:0/1646387468 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55631200d5e0 0x55631200faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:47.001 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.984+0000 7fc96632a800 1 -- 172.21.15.142:0/1646387468 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5563120101f0 con 0x55631200d5e0 2024-09-22T08:36:47.001 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.984+0000 7fc961760640 1 --2- 172.21.15.142:0/1646387468 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55631200d5e0 0x55631200faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:47.001 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.984+0000 7fc961760640 1 --2- 172.21.15.142:0/1646387468 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55631200d5e0 0x55631200faa0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:47.001 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.984+0000 7fc961760640 1 -- 172.21.15.142:0/1646387468 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc94c010580 con 0x55631200d5e0 2024-09-22T08:36:47.001 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.984+0000 7fc96632a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:47.001 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.984+0000 7fc96632a800 20 realm 2024-09-22T08:36:47.001 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.984+0000 7fc96632a800 20 rados->read ofs=0 len=0 2024-09-22T08:36:47.002 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.984+0000 7fc96632a800 1 -- 172.21.15.142:0/1646387468 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55631200c930 con 0x55631200d5e0 2024-09-22T08:36:47.002 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.984+0000 7fc961760640 1 -- 172.21.15.142:0/1646387468 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc94c010580 con 0x55631200d5e0 2024-09-22T08:36:47.002 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.984+0000 7fc96632a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:47.002 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.984+0000 7fc96632a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:36:47.002 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.985+0000 7fc96632a800 20 rados->read ofs=0 len=0 2024-09-22T08:36:47.002 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.985+0000 7fc96632a800 1 -- 172.21.15.142:0/1646387468 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556312010ce0 con 0x55631200d5e0 2024-09-22T08:36:47.002 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.985+0000 7fc961760640 1 -- 172.21.15.142:0/1646387468 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc94c010580 con 0x55631200d5e0 2024-09-22T08:36:47.002 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.985+0000 7fc96632a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:47.002 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.985+0000 7fc96632a800 20 rados->read ofs=0 len=0 2024-09-22T08:36:47.002 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.985+0000 7fc96632a800 1 -- 172.21.15.142:0/1646387468 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5563120115b0 con 0x55631200d5e0 2024-09-22T08:36:47.002 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.985+0000 7fc961760640 1 -- 172.21.15.142:0/1646387468 <== osd.1 v2:172.21.15.142:6816/3192108003 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc94c010580 con 0x55631200d5e0 2024-09-22T08:36:47.002 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.985+0000 7fc96632a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:36:47.003 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.985+0000 7fc96632a800 20 rados->read ofs=0 len=0 2024-09-22T08:36:47.003 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.985+0000 7fc96632a800 1 --2- 172.21.15.142:0/1646387468 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x556312011fd0 0x5563120143c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:47.003 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.985+0000 7fc96632a800 1 -- 172.21.15.142:0/1646387468 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556312014b00 con 0x556312011fd0 2024-09-22T08:36:47.003 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.985+0000 7fc962762640 1 --2- 172.21.15.142:0/1646387468 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x556312011fd0 0x5563120143c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:47.003 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.985+0000 7fc962762640 1 --2- 172.21.15.142:0/1646387468 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x556312011fd0 0x5563120143c0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:47.003 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.986+0000 7fc962762640 1 -- 172.21.15.142:0/1646387468 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(5 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fc95c03c070 con 0x556312011fd0 2024-09-22T08:36:47.003 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.986+0000 7fc96632a800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:36:47.003 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.986+0000 7fc96632a800 20 searching for the correct realm 2024-09-22T08:36:47.003 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.986+0000 7fc96632a800 1 -- 172.21.15.142:0/1646387468 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556312016450 con 0x556312011fd0 2024-09-22T08:36:47.003 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.986+0000 7fc962762640 1 -- 172.21.15.142:0/1646387468 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc95c03c070 con 0x556312011fd0 2024-09-22T08:36:47.003 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.986+0000 7fc962762640 1 --2- 172.21.15.142:0/1646387468 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7fc95c021020 0x7fc95c0284c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:47.003 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.986+0000 7fc962762640 1 -- 172.21.15.142:0/1646387468 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556312016450 con 0x7fc95c021020 2024-09-22T08:36:47.004 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.986+0000 7fc961f61640 1 --2- 172.21.15.142:0/1646387468 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7fc95c021020 0x7fc95c0284c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:47.004 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.986+0000 7fc961f61640 1 --2- 172.21.15.142:0/1646387468 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7fc95c021020 0x7fc95c0284c0 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:47.004 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.986+0000 7fc961f61640 1 -- 172.21.15.142:0/1646387468 <== osd.2 v2:172.21.15.142:6808/279438927 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc954076940 con 0x7fc95c021020 2024-09-22T08:36:47.004 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.987+0000 7fc961f61640 1 --2- 172.21.15.142:0/1646387468 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7fc95406d040 0x7fc954090270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:47.004 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.987+0000 7fc961f61640 1 -- 172.21.15.142:0/1646387468 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556312016450 con 0x7fc95406d040 2024-09-22T08:36:47.004 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.987+0000 7fc961760640 1 --2- 172.21.15.142:0/1646387468 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7fc95406d040 0x7fc954090270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:47.004 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.987+0000 7fc961760640 1 --2- 172.21.15.142:0/1646387468 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7fc95406d040 0x7fc954090270 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:47.004 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.987+0000 7fc961760640 1 -- 172.21.15.142:0/1646387468 <== osd.0 v2:172.21.15.31:6800/168281188 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc94c010580 con 0x7fc95406d040 2024-09-22T08:36:47.004 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.988+0000 7fc961760640 1 -- 172.21.15.142:0/1646387468 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556312016450 con 0x55631200d5e0 2024-09-22T08:36:47.004 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.988+0000 7fc961760640 1 -- 172.21.15.142:0/1646387468 <== osd.1 v2:172.21.15.142:6816/3192108003 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc94c010580 con 0x55631200d5e0 2024-09-22T08:36:47.004 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.988+0000 7fc961760640 1 -- 172.21.15.142:0/1646387468 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556312016450 con 0x55631200d5e0 2024-09-22T08:36:47.005 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.988+0000 7fc961760640 1 -- 172.21.15.142:0/1646387468 <== osd.1 v2:172.21.15.142:6816/3192108003 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc94c02a040 con 0x55631200d5e0 2024-09-22T08:36:47.005 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.988+0000 7fc961760640 1 -- 172.21.15.142:0/1646387468 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556312016450 con 0x7fc95406d040 2024-09-22T08:36:47.005 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.988+0000 7fc961760640 1 -- 172.21.15.142:0/1646387468 <== osd.0 v2:172.21.15.31:6800/168281188 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc94c02a040 con 0x7fc95406d040 2024-09-22T08:36:47.005 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.988+0000 7fc961760640 1 -- 172.21.15.142:0/1646387468 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556312016450 con 0x7fc95406d040 2024-09-22T08:36:47.005 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.989+0000 7fc961760640 1 -- 172.21.15.142:0/1646387468 <== osd.0 v2:172.21.15.31:6800/168281188 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc94c02a040 con 0x7fc95406d040 2024-09-22T08:36:47.005 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.989+0000 7fc961760640 1 -- 172.21.15.142:0/1646387468 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556312016450 con 0x7fc95c021020 2024-09-22T08:36:47.005 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.989+0000 7fc961f61640 1 -- 172.21.15.142:0/1646387468 <== osd.2 v2:172.21.15.142:6808/279438927 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc954076940 con 0x7fc95c021020 2024-09-22T08:36:47.005 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.989+0000 7fc961f61640 1 -- 172.21.15.142:0/1646387468 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556312016450 con 0x556312011fd0 2024-09-22T08:36:47.005 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.989+0000 7fc962762640 1 -- 172.21.15.142:0/1646387468 <== osd.3 v2:172.21.15.142:6800/1064901393 3 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc95c03c070 con 0x556312011fd0 2024-09-22T08:36:47.005 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.989+0000 7fc962762640 1 -- 172.21.15.142:0/1646387468 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556312016450 con 0x55631200d5e0 2024-09-22T08:36:47.005 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.989+0000 7fc961760640 1 -- 172.21.15.142:0/1646387468 <== osd.1 v2:172.21.15.142:6816/3192108003 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc94c02a040 con 0x55631200d5e0 2024-09-22T08:36:47.005 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.989+0000 7fc961760640 1 -- 172.21.15.142:0/1646387468 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556312016450 con 0x7fc95406d040 2024-09-22T08:36:47.005 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.990+0000 7fc961760640 1 -- 172.21.15.142:0/1646387468 <== osd.0 v2:172.21.15.31:6800/168281188 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc94c02a040 con 0x7fc95406d040 2024-09-22T08:36:47.006 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.990+0000 7fc961760640 1 -- 172.21.15.142:0/1646387468 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556312016450 con 0x55631200d5e0 2024-09-22T08:36:47.006 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.990+0000 7fc961760640 1 -- 172.21.15.142:0/1646387468 <== osd.1 v2:172.21.15.142:6816/3192108003 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc94c02a040 con 0x55631200d5e0 2024-09-22T08:36:47.006 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.990+0000 7fc961760640 1 -- 172.21.15.142:0/1646387468 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556312016450 con 0x7fc95c021020 2024-09-22T08:36:47.006 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.990+0000 7fc961f61640 1 -- 172.21.15.142:0/1646387468 <== osd.2 v2:172.21.15.142:6808/279438927 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fc954076940 con 0x7fc95c021020 2024-09-22T08:36:47.006 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.990+0000 7fc961f61640 1 -- 172.21.15.142:0/1646387468 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556312016450 con 0x556312011fd0 2024-09-22T08:36:47.006 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.990+0000 7fc962762640 1 -- 172.21.15.142:0/1646387468 <== osd.3 v2:172.21.15.142:6800/1064901393 4 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc95c03c070 con 0x556312011fd0 2024-09-22T08:36:47.006 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.990+0000 7fc962762640 1 -- 172.21.15.142:0/1646387468 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556312016450 con 0x556312011fd0 2024-09-22T08:36:47.006 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.991+0000 7fc962762640 1 -- 172.21.15.142:0/1646387468 <== osd.3 v2:172.21.15.142:6800/1064901393 5 ==== osd_op_reply(20 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fc95c03c070 con 0x556312011fd0 2024-09-22T08:36:47.006 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.991+0000 7fc962762640 1 -- 172.21.15.142:0/1646387468 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556312016450 con 0x7fc95406d040 2024-09-22T08:36:47.006 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.991+0000 7fc961760640 1 -- 172.21.15.142:0/1646387468 <== osd.0 v2:172.21.15.31:6800/168281188 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc94c02a040 con 0x7fc95406d040 2024-09-22T08:36:47.006 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.991+0000 7fc961760640 1 -- 172.21.15.142:0/1646387468 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556312016450 con 0x556312011fd0 2024-09-22T08:36:47.006 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.991+0000 7fc962762640 1 -- 172.21.15.142:0/1646387468 <== osd.3 v2:172.21.15.142:6800/1064901393 6 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc95c03c070 con 0x556312011fd0 2024-09-22T08:36:47.007 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.991+0000 7fc962762640 1 -- 172.21.15.142:0/1646387468 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556312016450 con 0x556312011fd0 2024-09-22T08:36:47.007 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.991+0000 7fc962762640 1 -- 172.21.15.142:0/1646387468 <== osd.3 v2:172.21.15.142:6800/1064901393 7 ==== osd_op_reply(23 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fc95c03c070 con 0x556312011fd0 2024-09-22T08:36:47.007 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.991+0000 7fc962762640 1 -- 172.21.15.142:0/1646387468 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556312016450 con 0x55631200d5e0 2024-09-22T08:36:47.007 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.992+0000 7fc961760640 1 -- 172.21.15.142:0/1646387468 <== osd.1 v2:172.21.15.142:6816/3192108003 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc94c02a040 con 0x55631200d5e0 2024-09-22T08:36:47.007 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.992+0000 7fc961760640 1 -- 172.21.15.142:0/1646387468 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556312016450 con 0x55631200d5e0 2024-09-22T08:36:47.007 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.992+0000 7fc961760640 1 -- 172.21.15.142:0/1646387468 <== osd.1 v2:172.21.15.142:6816/3192108003 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fc94c02a040 con 0x55631200d5e0 2024-09-22T08:36:47.007 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.992+0000 7fc961760640 1 -- 172.21.15.142:0/1646387468 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556312016450 con 0x7fc95406d040 2024-09-22T08:36:47.007 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.992+0000 7fc961760640 1 -- 172.21.15.142:0/1646387468 <== osd.0 v2:172.21.15.31:6800/168281188 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc94c02a040 con 0x7fc95406d040 2024-09-22T08:36:47.007 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.992+0000 7fc961760640 1 -- 172.21.15.142:0/1646387468 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556312016450 con 0x556312011fd0 2024-09-22T08:36:47.007 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.993+0000 7fc962762640 1 -- 172.21.15.142:0/1646387468 <== osd.3 v2:172.21.15.142:6800/1064901393 8 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc95c03c070 con 0x556312011fd0 2024-09-22T08:36:47.007 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.993+0000 7fc962762640 1 -- 172.21.15.142:0/1646387468 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556312016450 con 0x7fc95c021020 2024-09-22T08:36:47.007 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.993+0000 7fc961f61640 1 -- 172.21.15.142:0/1646387468 <== osd.2 v2:172.21.15.142:6808/279438927 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc954076940 con 0x7fc95c021020 2024-09-22T08:36:47.007 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.993+0000 7fc961f61640 1 -- 172.21.15.142:0/1646387468 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556312016450 con 0x55631200d5e0 2024-09-22T08:36:47.007 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.993+0000 7fc961760640 1 -- 172.21.15.142:0/1646387468 <== osd.1 v2:172.21.15.142:6816/3192108003 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc94c02a040 con 0x55631200d5e0 2024-09-22T08:36:47.008 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.993+0000 7fc961760640 1 -- 172.21.15.142:0/1646387468 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556312016450 con 0x7fc95406d040 2024-09-22T08:36:47.008 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.994+0000 7fc961760640 1 -- 172.21.15.142:0/1646387468 <== osd.0 v2:172.21.15.31:6800/168281188 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc94c02a040 con 0x7fc95406d040 2024-09-22T08:36:47.008 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.994+0000 7fc961760640 1 -- 172.21.15.142:0/1646387468 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556312016450 con 0x556312011fd0 2024-09-22T08:36:47.008 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.994+0000 7fc962762640 1 -- 172.21.15.142:0/1646387468 <== osd.3 v2:172.21.15.142:6800/1064901393 9 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc95c03c070 con 0x556312011fd0 2024-09-22T08:36:47.008 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.994+0000 7fc962762640 1 -- 172.21.15.142:0/1646387468 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556312016450 con 0x7fc95406d040 2024-09-22T08:36:47.008 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.994+0000 7fc961760640 1 -- 172.21.15.142:0/1646387468 <== osd.0 v2:172.21.15.31:6800/168281188 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc94c02a040 con 0x7fc95406d040 2024-09-22T08:36:47.008 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.994+0000 7fc961760640 1 -- 172.21.15.142:0/1646387468 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556312016450 con 0x7fc95c021020 2024-09-22T08:36:47.008 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.994+0000 7fc961f61640 1 -- 172.21.15.142:0/1646387468 <== osd.2 v2:172.21.15.142:6808/279438927 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc954076940 con 0x7fc95c021020 2024-09-22T08:36:47.008 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.994+0000 7fc961f61640 1 -- 172.21.15.142:0/1646387468 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556312016450 con 0x556312011fd0 2024-09-22T08:36:47.008 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.995+0000 7fc962762640 1 -- 172.21.15.142:0/1646387468 <== osd.3 v2:172.21.15.142:6800/1064901393 10 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc95c03c070 con 0x556312011fd0 2024-09-22T08:36:47.008 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.995+0000 7fc962762640 1 -- 172.21.15.142:0/1646387468 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556312016450 con 0x7fc95406d040 2024-09-22T08:36:47.008 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.995+0000 7fc961760640 1 -- 172.21.15.142:0/1646387468 <== osd.0 v2:172.21.15.31:6800/168281188 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc94c02a040 con 0x7fc95406d040 2024-09-22T08:36:47.008 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.995+0000 7fc961760640 1 -- 172.21.15.142:0/1646387468 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556312016450 con 0x55631200d5e0 2024-09-22T08:36:47.009 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.995+0000 7fc961760640 1 -- 172.21.15.142:0/1646387468 <== osd.1 v2:172.21.15.142:6816/3192108003 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fc94c02a040 con 0x55631200d5e0 2024-09-22T08:36:47.009 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.995+0000 7fc961760640 1 -- 172.21.15.142:0/1646387468 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556312016450 con 0x7fc95c021020 2024-09-22T08:36:47.009 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.996+0000 7fc961f61640 1 -- 172.21.15.142:0/1646387468 <== osd.2 v2:172.21.15.142:6808/279438927 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc954076940 con 0x7fc95c021020 2024-09-22T08:36:47.009 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.996+0000 7fc96632a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:36:47.009 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.996+0000 7fc96632a800 20 RGWRados::pool_iterate: got zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec 2024-09-22T08:36:47.009 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.996+0000 7fc96632a800 20 RGWRados::pool_iterate: got zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f 2024-09-22T08:36:47.009 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.996+0000 7fc96632a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:36:47.009 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.996+0000 7fc96632a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:36:47.009 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.996+0000 7fc96632a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:36:47.009 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.996+0000 7fc96632a800 20 rados->read ofs=0 len=0 2024-09-22T08:36:47.009 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.996+0000 7fc96632a800 1 -- 172.21.15.142:0/1646387468 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5563120154c0 con 0x55631200d5e0 2024-09-22T08:36:47.009 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.996+0000 7fc961760640 1 -- 172.21.15.142:0/1646387468 <== osd.1 v2:172.21.15.142:6816/3192108003 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc94c02a040 con 0x55631200d5e0 2024-09-22T08:36:47.009 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.996+0000 7fc96632a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:47.010 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.996+0000 7fc96632a800 20 rados->read ofs=0 len=0 2024-09-22T08:36:47.010 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.996+0000 7fc96632a800 1 -- 172.21.15.142:0/1646387468 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556312015d60 con 0x55631200d5e0 2024-09-22T08:36:47.010 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.996+0000 7fc961760640 1 -- 172.21.15.142:0/1646387468 <== osd.1 v2:172.21.15.142:6816/3192108003 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc94c02a040 con 0x55631200d5e0 2024-09-22T08:36:47.010 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.996+0000 7fc96632a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:36:47.010 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.996+0000 7fc96632a800 20 rados->read ofs=0 len=0 2024-09-22T08:36:47.010 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.996+0000 7fc96632a800 1 -- 172.21.15.142:0/1646387468 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:40 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5563120168d0 con 0x556312011fd0 2024-09-22T08:36:47.010 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.996+0000 7fc962762640 1 -- 172.21.15.142:0/1646387468 <== osd.3 v2:172.21.15.142:6800/1064901393 11 ==== osd_op_reply(40 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fc95c03c070 con 0x556312011fd0 2024-09-22T08:36:47.010 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.996+0000 7fc96632a800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:36:47.010 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.996+0000 7fc96632a800 20 zone default found 2024-09-22T08:36:47.010 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.996+0000 7fc96632a800 4 Realm: () 2024-09-22T08:36:47.010 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.996+0000 7fc96632a800 4 ZoneGroup: default (d89f6f57-1007-47dd-9065-f486c7b01aec) 2024-09-22T08:36:47.010 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.996+0000 7fc96632a800 4 Zone: default (e239248c-0bee-4e41-803a-24b288d3eb8f) 2024-09-22T08:36:47.010 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.996+0000 7fc96632a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:36:47.011 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.996+0000 7fc96632a800 20 zonegroup default 2024-09-22T08:36:47.011 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.996+0000 7fc96632a800 20 rados->read ofs=0 len=0 2024-09-22T08:36:47.011 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.996+0000 7fc96632a800 1 -- 172.21.15.142:0/1646387468 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556312016c70 con 0x7fc95406d040 2024-09-22T08:36:47.011 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.997+0000 7fc961760640 1 -- 172.21.15.142:0/1646387468 <== osd.0 v2:172.21.15.31:6800/168281188 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fc94c02a040 con 0x7fc95406d040 2024-09-22T08:36:47.011 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.997+0000 7fc96632a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:47.011 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.997+0000 7fc96632a800 20 rados->read ofs=0 len=0 2024-09-22T08:36:47.011 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.997+0000 7fc96632a800 1 -- 172.21.15.142:0/1646387468 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556312018aa0 con 0x556312011fd0 2024-09-22T08:36:47.011 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.997+0000 7fc962762640 1 -- 172.21.15.142:0/1646387468 <== osd.3 v2:172.21.15.142:6800/1064901393 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc95c03c070 con 0x556312011fd0 2024-09-22T08:36:47.011 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.997+0000 7fc96632a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:47.011 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.997+0000 7fc96632a800 20 rados->read ofs=0 len=0 2024-09-22T08:36:47.011 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.997+0000 7fc96632a800 1 -- 172.21.15.142:0/1646387468 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556312018ee0 con 0x556312011fd0 2024-09-22T08:36:47.011 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.997+0000 7fc962762640 1 -- 172.21.15.142:0/1646387468 <== osd.3 v2:172.21.15.142:6800/1064901393 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc95c03c070 con 0x556312011fd0 2024-09-22T08:36:47.011 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.997+0000 7fc96632a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:47.012 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.997+0000 7fc96632a800 20 started sync module instance, tier type = 2024-09-22T08:36:47.012 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.997+0000 7fc96632a800 20 started zone id=e239248c-0bee-4e41-803a-24b288d3eb8f (name=default) with tier type = 2024-09-22T08:36:47.012 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.997+0000 7fc96632a800 1 -- 172.21.15.142:0/1646387468 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556312017f10 con 0x7fc95c021020 2024-09-22T08:36:47.012 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.998+0000 7fc961f61640 1 -- 172.21.15.142:0/1646387468 <== osd.2 v2:172.21.15.142:6808/279438927 7 ==== osd_op_reply(44 notify.0 [create] v30'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc954076940 con 0x7fc95c021020 2024-09-22T08:36:47.012 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.998+0000 7fc96632a800 1 -- 172.21.15.142:0/1646387468 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93883992210016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556312019310 con 0x7fc95c021020 2024-09-22T08:36:47.012 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.998+0000 7fc96632a800 1 -- 172.21.15.142:0/1646387468 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556312019b60 con 0x55631200d5e0 2024-09-22T08:36:47.012 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:46.999+0000 7fc961f61640 1 -- 172.21.15.142:0/1646387468 <== osd.2 v2:172.21.15.142:6808/279438927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93883992210016] v30'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc954076940 con 0x7fc95c021020 2024-09-22T08:36:47.016 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.000+0000 7fc961760640 1 -- 172.21.15.142:0/1646387468 <== osd.1 v2:172.21.15.142:6816/3192108003 15 ==== osd_op_reply(46 notify.1 [create] v30'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc94c02a040 con 0x55631200d5e0 2024-09-22T08:36:47.016 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.000+0000 7fc96632a800 1 -- 172.21.15.142:0/1646387468 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93883992216336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556312019be0 con 0x55631200d5e0 2024-09-22T08:36:47.016 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.000+0000 7fc96632a800 1 -- 172.21.15.142:0/1646387468 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55631201a4b0 con 0x556312011fd0 2024-09-22T08:36:47.016 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.001+0000 7fc962762640 1 -- 172.21.15.142:0/1646387468 <== osd.3 v2:172.21.15.142:6800/1064901393 14 ==== osd_op_reply(48 notify.2 [create] v30'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc95c03c070 con 0x556312011fd0 2024-09-22T08:36:47.017 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.001+0000 7fc96632a800 1 -- 172.21.15.142:0/1646387468 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93883992218592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55631201a040 con 0x556312011fd0 2024-09-22T08:36:47.017 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.001+0000 7fc96632a800 1 -- 172.21.15.142:0/1646387468 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55631201b480 con 0x7fc95c021020 2024-09-22T08:36:47.017 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.001+0000 7fc961760640 1 -- 172.21.15.142:0/1646387468 <== osd.1 v2:172.21.15.142:6816/3192108003 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93883992216336] v30'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc94c02a040 con 0x55631200d5e0 2024-09-22T08:36:47.017 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.002+0000 7fc961f61640 1 -- 172.21.15.142:0/1646387468 <== osd.2 v2:172.21.15.142:6808/279438927 9 ==== osd_op_reply(50 notify.3 [create] v30'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc954076940 con 0x7fc95c021020 2024-09-22T08:36:47.017 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.002+0000 7fc96632a800 1 -- 172.21.15.142:0/1646387468 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93883992223600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55631201b440 con 0x7fc95c021020 2024-09-22T08:36:47.017 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.002+0000 7fc96632a800 1 -- 172.21.15.142:0/1646387468 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55631201bf00 con 0x55631200d5e0 2024-09-22T08:36:47.017 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.002+0000 7fc962762640 1 -- 172.21.15.142:0/1646387468 <== osd.3 v2:172.21.15.142:6800/1064901393 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 93883992218592] v30'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc95c03c070 con 0x556312011fd0 2024-09-22T08:36:47.017 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.003+0000 7fc961760640 1 -- 172.21.15.142:0/1646387468 <== osd.1 v2:172.21.15.142:6816/3192108003 17 ==== osd_op_reply(52 notify.4 [create] v30'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc94c02a040 con 0x55631200d5e0 2024-09-22T08:36:47.017 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.003+0000 7fc96632a800 1 -- 172.21.15.142:0/1646387468 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93883992226320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55631201bf00 con 0x55631200d5e0 2024-09-22T08:36:47.017 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.003+0000 7fc96632a800 1 -- 172.21.15.142:0/1646387468 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55631201c910 con 0x7fc95406d040 2024-09-22T08:36:47.017 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.003+0000 7fc961f61640 1 -- 172.21.15.142:0/1646387468 <== osd.2 v2:172.21.15.142:6808/279438927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93883992223600] v30'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc954076940 con 0x7fc95c021020 2024-09-22T08:36:47.018 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.004+0000 7fc961760640 1 -- 172.21.15.142:0/1646387468 <== osd.0 v2:172.21.15.31:6800/168281188 11 ==== osd_op_reply(54 notify.5 [create] v30'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc94c02a040 con 0x7fc95406d040 2024-09-22T08:36:47.018 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.004+0000 7fc96632a800 1 -- 172.21.15.142:0/1646387468 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93883992217392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55631201c910 con 0x7fc95406d040 2024-09-22T08:36:47.018 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.004+0000 7fc96632a800 1 -- 172.21.15.142:0/1646387468 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55631201d390 con 0x7fc95406d040 2024-09-22T08:36:47.018 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.004+0000 7fc961760640 1 -- 172.21.15.142:0/1646387468 <== osd.1 v2:172.21.15.142:6816/3192108003 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93883992226320] v30'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc94c02a040 con 0x55631200d5e0 2024-09-22T08:36:47.018 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.005+0000 7fc961760640 1 -- 172.21.15.142:0/1646387468 <== osd.0 v2:172.21.15.31:6800/168281188 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93883992217392] v30'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc94c02a040 con 0x7fc95406d040 2024-09-22T08:36:47.018 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.005+0000 7fc961760640 1 -- 172.21.15.142:0/1646387468 <== osd.0 v2:172.21.15.31:6800/168281188 13 ==== osd_op_reply(56 notify.6 [create] v30'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc94c02a040 con 0x7fc95406d040 2024-09-22T08:36:47.018 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.005+0000 7fc96632a800 1 -- 172.21.15.142:0/1646387468 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93883992221856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55631201c460 con 0x7fc95406d040 2024-09-22T08:36:47.018 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.005+0000 7fc96632a800 1 -- 172.21.15.142:0/1646387468 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55631201dc30 con 0x7fc95406d040 2024-09-22T08:36:47.018 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.006+0000 7fc961760640 1 -- 172.21.15.142:0/1646387468 <== osd.0 v2:172.21.15.31:6800/168281188 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93883992221856] v30'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc94c02a040 con 0x7fc95406d040 2024-09-22T08:36:47.018 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.006+0000 7fc961760640 1 -- 172.21.15.142:0/1646387468 <== osd.0 v2:172.21.15.31:6800/168281188 15 ==== osd_op_reply(58 notify.7 [create] v30'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc94c02a040 con 0x7fc95406d040 2024-09-22T08:36:47.018 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.006+0000 7fc96632a800 1 -- 172.21.15.142:0/1646387468 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93883992231584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55631201c460 con 0x7fc95406d040 2024-09-22T08:36:47.018 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.006+0000 7fc96632a800 20 add_watcher() i=0 2024-09-22T08:36:47.018 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.006+0000 7fc96632a800 20 add_watcher() i=1 2024-09-22T08:36:47.019 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.006+0000 7fc96632a800 20 add_watcher() i=2 2024-09-22T08:36:47.019 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.006+0000 7fc96632a800 20 add_watcher() i=3 2024-09-22T08:36:47.019 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.006+0000 7fc96632a800 20 add_watcher() i=4 2024-09-22T08:36:47.019 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.006+0000 7fc96632a800 20 add_watcher() i=5 2024-09-22T08:36:47.019 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.006+0000 7fc96632a800 20 add_watcher() i=6 2024-09-22T08:36:47.019 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.007+0000 7fc961760640 1 -- 172.21.15.142:0/1646387468 <== osd.0 v2:172.21.15.31:6800/168281188 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93883992231584] v30'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc94c02a040 con 0x7fc95406d040 2024-09-22T08:36:47.019 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.007+0000 7fc96632a800 20 add_watcher() i=7 2024-09-22T08:36:47.019 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.007+0000 7fc96632a800 2 all 8 watchers are set, enabling cache 2024-09-22T08:36:47.019 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.007+0000 7fc96632a800 1 -- 172.21.15.142:0/1646387468 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556312020d30 con 0x55631200d5e0 2024-09-22T08:36:47.019 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.008+0000 7fc961760640 1 -- 172.21.15.142:0/1646387468 <== osd.1 v2:172.21.15.142:6816/3192108003 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fc94c02a040 con 0x55631200d5e0 2024-09-22T08:36:47.019 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.008+0000 7fc96632a800 1 -- 172.21.15.142:0/1646387468 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93883992233856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55631201e050 con 0x55631200d5e0 2024-09-22T08:36:47.019 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.009+0000 7fc961760640 1 -- 172.21.15.142:0/1646387468 <== osd.1 v2:172.21.15.142:6816/3192108003 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93883992233856] v30'112 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc94c02a040 con 0x55631200d5e0 2024-09-22T08:36:47.019 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.009+0000 7fc8137fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:36:47.019 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.009+0000 7fc96632a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:36:47.020 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.009+0000 7fc96632a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:36:47.020 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.009+0000 7fc96632a800 1 -- 172.21.15.142:0/1646387468 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5563120298c0 con 0x55631200d5e0 2024-09-22T08:36:47.020 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.010+0000 7fc961760640 1 -- 172.21.15.142:0/1646387468 <== osd.1 v2:172.21.15.142:6816/3192108003 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v30'20 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc94c02a040 con 0x55631200d5e0 2024-09-22T08:36:47.020 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.010+0000 7fc96632a800 1 -- 172.21.15.142:0/1646387468 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556312029880 con 0x7fc95406d040 2024-09-22T08:36:47.020 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.011+0000 7fc961760640 1 -- 172.21.15.142:0/1646387468 <== osd.0 v2:172.21.15.31:6800/168281188 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v30'14 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc94c02a040 con 0x7fc95406d040 2024-09-22T08:36:47.020 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.011+0000 7fc96632a800 1 -- 172.21.15.142:0/1646387468 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55631202a2e0 con 0x556312011fd0 2024-09-22T08:36:47.020 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.013+0000 7fc962762640 1 -- 172.21.15.142:0/1646387468 <== osd.3 v2:172.21.15.142:6800/1064901393 16 ==== osd_op_reply(64 gc.2 [create,call,call,call] v30'14 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc95c03c070 con 0x556312011fd0 2024-09-22T08:36:47.020 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.013+0000 7fc96632a800 1 -- 172.21.15.142:0/1646387468 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55631202a2e0 con 0x55631200d5e0 2024-09-22T08:36:47.020 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.013+0000 7fc961760640 1 -- 172.21.15.142:0/1646387468 <== osd.1 v2:172.21.15.142:6816/3192108003 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v30'113 uv15 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc94c02a040 con 0x55631200d5e0 2024-09-22T08:36:47.020 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.013+0000 7fc96632a800 1 -- 172.21.15.142:0/1646387468 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55631202a850 con 0x7fc95c021020 2024-09-22T08:36:47.020 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.015+0000 7fc961f61640 1 -- 172.21.15.142:0/1646387468 <== osd.2 v2:172.21.15.142:6808/279438927 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v30'32 uv13 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc954076940 con 0x7fc95c021020 2024-09-22T08:36:47.020 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.015+0000 7fc96632a800 1 -- 172.21.15.142:0/1646387468 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55631202adc0 con 0x556312011fd0 2024-09-22T08:36:47.022 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.015+0000 7fc962762640 1 -- 172.21.15.142:0/1646387468 <== osd.3 v2:172.21.15.142:6800/1064901393 17 ==== osd_op_reply(67 gc.5 [create,call,call,call] v30'21 uv10 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc95c03c070 con 0x556312011fd0 2024-09-22T08:36:47.022 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.016+0000 7fc96632a800 1 -- 172.21.15.142:0/1646387468 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55631202adc0 con 0x55631200d5e0 2024-09-22T08:36:47.022 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.017+0000 7fc961760640 1 -- 172.21.15.142:0/1646387468 <== osd.1 v2:172.21.15.142:6816/3192108003 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v30'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc94c02a040 con 0x55631200d5e0 2024-09-22T08:36:47.023 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.017+0000 7fc96632a800 1 -- 172.21.15.142:0/1646387468 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55631202adc0 con 0x7fc95406d040 2024-09-22T08:36:47.023 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.018+0000 7fc961760640 1 -- 172.21.15.142:0/1646387468 <== osd.0 v2:172.21.15.31:6800/168281188 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v30'21 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc94c02a040 con 0x7fc95406d040 2024-09-22T08:36:47.023 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.018+0000 7fc96632a800 1 -- 172.21.15.142:0/1646387468 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55631202adc0 con 0x7fc95c021020 2024-09-22T08:36:47.023 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.019+0000 7fc961f61640 1 -- 172.21.15.142:0/1646387468 <== osd.2 v2:172.21.15.142:6808/279438927 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v30'14 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc954076940 con 0x7fc95c021020 2024-09-22T08:36:47.023 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.019+0000 7fc96632a800 1 -- 172.21.15.142:0/1646387468 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55631202b0a0 con 0x556312011fd0 2024-09-22T08:36:47.023 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.020+0000 7fc962762640 1 -- 172.21.15.142:0/1646387468 <== osd.3 v2:172.21.15.142:6800/1064901393 18 ==== osd_op_reply(71 gc.9 [create,call,call,call] v30'20 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc95c03c070 con 0x556312011fd0 2024-09-22T08:36:47.023 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.020+0000 7fc96632a800 1 -- 172.21.15.142:0/1646387468 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55631202b0a0 con 0x7fc95c021020 2024-09-22T08:36:47.023 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.021+0000 7fc961f61640 1 -- 172.21.15.142:0/1646387468 <== osd.2 v2:172.21.15.142:6808/279438927 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v30'33 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc954076940 con 0x7fc95c021020 2024-09-22T08:36:47.023 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.021+0000 7fc96632a800 1 -- 172.21.15.142:0/1646387468 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55631202aed0 con 0x7fc95406d040 2024-09-22T08:36:47.024 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.022+0000 7fc961760640 1 -- 172.21.15.142:0/1646387468 <== osd.0 v2:172.21.15.31:6800/168281188 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v30'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc94c02a040 con 0x7fc95406d040 2024-09-22T08:36:47.024 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.022+0000 7fc96632a800 1 -- 172.21.15.142:0/1646387468 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55631202aed0 con 0x7fc95c021020 2024-09-22T08:36:47.024 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.023+0000 7fc961f61640 1 -- 172.21.15.142:0/1646387468 <== osd.2 v2:172.21.15.142:6808/279438927 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v30'14 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc954076940 con 0x7fc95c021020 2024-09-22T08:36:47.024 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.023+0000 7fc96632a800 1 -- 172.21.15.142:0/1646387468 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55631202af00 con 0x7fc95406d040 2024-09-22T08:36:47.025 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.024+0000 7fc961760640 1 -- 172.21.15.142:0/1646387468 <== osd.0 v2:172.21.15.31:6800/168281188 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v30'29 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc94c02a040 con 0x7fc95406d040 2024-09-22T08:36:47.025 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.024+0000 7fc96632a800 1 -- 172.21.15.142:0/1646387468 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55631202aed0 con 0x55631200d5e0 2024-09-22T08:36:47.026 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.025+0000 7fc961760640 1 -- 172.21.15.142:0/1646387468 <== osd.1 v2:172.21.15.142:6816/3192108003 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v30'114 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc94c02a040 con 0x55631200d5e0 2024-09-22T08:36:47.026 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.025+0000 7fc96632a800 1 -- 172.21.15.142:0/1646387468 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55631202af30 con 0x556312011fd0 2024-09-22T08:36:47.027 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.026+0000 7fc962762640 1 -- 172.21.15.142:0/1646387468 <== osd.3 v2:172.21.15.142:6800/1064901393 19 ==== osd_op_reply(77 gc.15 [create,call,call,call] v30'26 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc95c03c070 con 0x556312011fd0 2024-09-22T08:36:47.027 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.026+0000 7fc96632a800 1 -- 172.21.15.142:0/1646387468 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55631202af60 con 0x7fc95c021020 2024-09-22T08:36:47.028 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.027+0000 7fc961f61640 1 -- 172.21.15.142:0/1646387468 <== osd.2 v2:172.21.15.142:6808/279438927 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v30'34 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc954076940 con 0x7fc95c021020 2024-09-22T08:36:47.028 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.027+0000 7fc96632a800 1 -- 172.21.15.142:0/1646387468 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55631202af60 con 0x556312011fd0 2024-09-22T08:36:47.029 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.028+0000 7fc962762640 1 -- 172.21.15.142:0/1646387468 <== osd.3 v2:172.21.15.142:6800/1064901393 20 ==== osd_op_reply(79 gc.17 [create,call,call,call] v30'14 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc95c03c070 con 0x556312011fd0 2024-09-22T08:36:47.029 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.028+0000 7fc96632a800 1 -- 172.21.15.142:0/1646387468 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55631202b130 con 0x55631200d5e0 2024-09-22T08:36:47.030 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.029+0000 7fc961760640 1 -- 172.21.15.142:0/1646387468 <== osd.1 v2:172.21.15.142:6816/3192108003 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v30'22 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc94c02a040 con 0x55631200d5e0 2024-09-22T08:36:47.030 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.029+0000 7fc96632a800 1 -- 172.21.15.142:0/1646387468 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55631202b100 con 0x55631200d5e0 2024-09-22T08:36:47.031 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.030+0000 7fc961760640 1 -- 172.21.15.142:0/1646387468 <== osd.1 v2:172.21.15.142:6816/3192108003 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v30'115 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc94c02a040 con 0x55631200d5e0 2024-09-22T08:36:47.031 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.030+0000 7fc96632a800 1 -- 172.21.15.142:0/1646387468 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55631202b3e0 con 0x556312011fd0 2024-09-22T08:36:47.032 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.031+0000 7fc962762640 1 -- 172.21.15.142:0/1646387468 <== osd.3 v2:172.21.15.142:6800/1064901393 21 ==== osd_op_reply(82 gc.20 [create,call,call,call] v30'27 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc95c03c070 con 0x556312011fd0 2024-09-22T08:36:47.032 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.031+0000 7fc96632a800 1 -- 172.21.15.142:0/1646387468 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55631202b3e0 con 0x7fc95c021020 2024-09-22T08:36:47.033 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.032+0000 7fc961f61640 1 -- 172.21.15.142:0/1646387468 <== osd.2 v2:172.21.15.142:6808/279438927 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v30'24 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc954076940 con 0x7fc95c021020 2024-09-22T08:36:47.033 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.032+0000 7fc96632a800 1 -- 172.21.15.142:0/1646387468 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55631202b3e0 con 0x556312011fd0 2024-09-22T08:36:47.034 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.033+0000 7fc962762640 1 -- 172.21.15.142:0/1646387468 <== osd.3 v2:172.21.15.142:6800/1064901393 22 ==== osd_op_reply(84 gc.22 [create,call,call,call] v30'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc95c03c070 con 0x556312011fd0 2024-09-22T08:36:47.034 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.033+0000 7fc96632a800 1 -- 172.21.15.142:0/1646387468 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55631202b3e0 con 0x556312011fd0 2024-09-22T08:36:47.035 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.034+0000 7fc962762640 1 -- 172.21.15.142:0/1646387468 <== osd.3 v2:172.21.15.142:6800/1064901393 23 ==== osd_op_reply(85 gc.23 [create,call,call,call] v30'20 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc95c03c070 con 0x556312011fd0 2024-09-22T08:36:47.035 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.034+0000 7fc96632a800 1 -- 172.21.15.142:0/1646387468 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55631202b3e0 con 0x556312011fd0 2024-09-22T08:36:47.036 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.035+0000 7fc962762640 1 -- 172.21.15.142:0/1646387468 <== osd.3 v2:172.21.15.142:6800/1064901393 24 ==== osd_op_reply(86 gc.24 [create,call,call,call] v30'10 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc95c03c070 con 0x556312011fd0 2024-09-22T08:36:47.036 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.035+0000 7fc96632a800 1 -- 172.21.15.142:0/1646387468 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55631202b3e0 con 0x556312011fd0 2024-09-22T08:36:47.037 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.036+0000 7fc962762640 1 -- 172.21.15.142:0/1646387468 <== osd.3 v2:172.21.15.142:6800/1064901393 25 ==== osd_op_reply(87 gc.25 [create,call,call,call] v30'22 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc95c03c070 con 0x556312011fd0 2024-09-22T08:36:47.037 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.036+0000 7fc96632a800 1 -- 172.21.15.142:0/1646387468 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55631202b3e0 con 0x7fc95406d040 2024-09-22T08:36:47.038 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.037+0000 7fc961760640 1 -- 172.21.15.142:0/1646387468 <== osd.0 v2:172.21.15.31:6800/168281188 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v30'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc94c02a040 con 0x7fc95406d040 2024-09-22T08:36:47.038 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.037+0000 7fc96632a800 1 -- 172.21.15.142:0/1646387468 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55631202b3e0 con 0x556312011fd0 2024-09-22T08:36:47.039 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.038+0000 7fc962762640 1 -- 172.21.15.142:0/1646387468 <== osd.3 v2:172.21.15.142:6800/1064901393 26 ==== osd_op_reply(89 gc.27 [create,call,call,call] v30'14 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc95c03c070 con 0x556312011fd0 2024-09-22T08:36:47.039 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.038+0000 7fc96632a800 1 -- 172.21.15.142:0/1646387468 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55631202b3e0 con 0x7fc95406d040 2024-09-22T08:36:47.040 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.039+0000 7fc961760640 1 -- 172.21.15.142:0/1646387468 <== osd.0 v2:172.21.15.31:6800/168281188 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v30'22 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc94c02a040 con 0x7fc95406d040 2024-09-22T08:36:47.041 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.039+0000 7fc96632a800 1 -- 172.21.15.142:0/1646387468 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55631202b3e0 con 0x556312011fd0 2024-09-22T08:36:47.041 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.040+0000 7fc962762640 1 -- 172.21.15.142:0/1646387468 <== osd.3 v2:172.21.15.142:6800/1064901393 27 ==== osd_op_reply(91 gc.29 [create,call,call,call] v30'28 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc95c03c070 con 0x556312011fd0 2024-09-22T08:36:47.042 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.040+0000 7fc96632a800 1 -- 172.21.15.142:0/1646387468 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55631202b3e0 con 0x7fc95406d040 2024-09-22T08:36:47.043 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.042+0000 7fc961760640 1 -- 172.21.15.142:0/1646387468 <== osd.0 v2:172.21.15.31:6800/168281188 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v30'30 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc94c02a040 con 0x7fc95406d040 2024-09-22T08:36:47.043 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.042+0000 7fc96632a800 1 -- 172.21.15.142:0/1646387468 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55631202b3e0 con 0x7fc95c021020 2024-09-22T08:36:47.044 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.043+0000 7fc961f61640 1 -- 172.21.15.142:0/1646387468 <== osd.2 v2:172.21.15.142:6808/279438927 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v30'20 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc954076940 con 0x7fc95c021020 2024-09-22T08:36:47.044 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.043+0000 7fc8127fc640 20 reqs_thread_entry: start 2024-09-22T08:36:47.045 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.043+0000 7fc96632a800 20 init_complete bucket index max shards: 11 2024-09-22T08:36:47.045 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.043+0000 7fc96632a800 20 Filter name: none 2024-09-22T08:36:47.045 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.043+0000 7fc783fff640 20 reqs_thread_entry: start 2024-09-22T08:36:47.045 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.043+0000 7fc96632a800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-22T08:36:47.045 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.043+0000 7fc96632a800 20 rados->read ofs=0 len=0 2024-09-22T08:36:47.045 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.043+0000 7fc96632a800 1 -- 172.21.15.142:0/1646387468 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556312056090 con 0x7fc95406d040 2024-09-22T08:36:47.046 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.044+0000 7fc961760640 1 -- 172.21.15.142:0/1646387468 <== osd.0 v2:172.21.15.31:6800/168281188 24 ==== osd_op_reply(94 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7fc94c02a040 con 0x7fc95406d040 2024-09-22T08:36:47.046 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.044+0000 7fc96632a800 20 rados_obj.operate() r=0 bl.length=380 2024-09-22T08:36:47.046 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.044+0000 7fc96632a800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-09-22T08:36:47.046 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.044+0000 7fc96632a800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-22T08:36:47.046 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.044+0000 7fc96632a800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:36:47.047 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.044+0000 7fc96632a800 1 -- 172.21.15.142:0/1646387468 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:95 8.1 8:810902b1:users.uid::fud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556312058ab0 con 0x7fc95406d040 2024-09-22T08:36:47.047 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.044+0000 7fc961760640 1 -- 172.21.15.142:0/1646387468 <== osd.0 v2:172.21.15.31:6800/168281188 25 ==== osd_op_reply(95 fud.buckets [call out=183b] v0'0 uv1 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7fc94c02a040 con 0x7fc95406d040 2024-09-22T08:36:47.047 INFO:teuthology.orchestra.run.smithi142.stderr:could not remove user: unable to remove user, must specify purge data to remove user with buckets 2024-09-22T08:36:47.047 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.045+0000 7fc8137fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:36:47.047 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.045+0000 7fc96632a800 1 -- 172.21.15.142:0/1646387468 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:96 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93883992233856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556312009c80 con 0x55631200d5e0 2024-09-22T08:36:47.047 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.046+0000 7fc961760640 1 -- 172.21.15.142:0/1646387468 <== osd.1 v2:172.21.15.142:6816/3192108003 27 ==== osd_op_reply(96 data_loggenerations_metadata [watch unwatch cookie 93883992233856] v30'116 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc94c02a040 con 0x55631200d5e0 2024-09-22T08:36:47.047 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.046+0000 7fc96632a800 1 -- 172.21.15.142:0/1646387468 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:97 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93883992210016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556312009c80 con 0x7fc95c021020 2024-09-22T08:36:47.048 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.047+0000 7fc961f61640 1 -- 172.21.15.142:0/1646387468 <== osd.2 v2:172.21.15.142:6808/279438927 18 ==== osd_op_reply(97 notify.0 [watch unwatch cookie 93883992210016] v30'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc954076940 con 0x7fc95c021020 2024-09-22T08:36:47.048 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.047+0000 7fc96632a800 20 remove_watcher() i=0 2024-09-22T08:36:47.049 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.047+0000 7fc96632a800 2 removed watcher, disabling cache 2024-09-22T08:36:47.049 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.047+0000 7fc96632a800 1 -- 172.21.15.142:0/1646387468 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93883992216336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556312017a60 con 0x55631200d5e0 2024-09-22T08:36:47.049 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.048+0000 7fc961760640 1 -- 172.21.15.142:0/1646387468 <== osd.1 v2:172.21.15.142:6816/3192108003 28 ==== osd_op_reply(98 notify.1 [watch unwatch cookie 93883992216336] v30'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc94c02a040 con 0x55631200d5e0 2024-09-22T08:36:47.049 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.048+0000 7fc96632a800 20 remove_watcher() i=1 2024-09-22T08:36:47.050 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.048+0000 7fc96632a800 1 -- 172.21.15.142:0/1646387468 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:99 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93883992218592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556312019310 con 0x556312011fd0 2024-09-22T08:36:47.050 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.049+0000 7fc962762640 1 -- 172.21.15.142:0/1646387468 <== osd.3 v2:172.21.15.142:6800/1064901393 28 ==== osd_op_reply(99 notify.2 [watch unwatch cookie 93883992218592] v30'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc95c03c070 con 0x556312011fd0 2024-09-22T08:36:47.051 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.049+0000 7fc96632a800 20 remove_watcher() i=2 2024-09-22T08:36:47.051 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.049+0000 7fc96632a800 1 -- 172.21.15.142:0/1646387468 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:100 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93883992223600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556312019310 con 0x7fc95c021020 2024-09-22T08:36:47.051 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.050+0000 7fc961f61640 1 -- 172.21.15.142:0/1646387468 <== osd.2 v2:172.21.15.142:6808/279438927 19 ==== osd_op_reply(100 notify.3 [watch unwatch cookie 93883992223600] v30'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc954076940 con 0x7fc95c021020 2024-09-22T08:36:47.051 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.050+0000 7fc96632a800 20 remove_watcher() i=3 2024-09-22T08:36:47.052 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.050+0000 7fc96632a800 1 -- 172.21.15.142:0/1646387468 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93883992226320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55631201af70 con 0x55631200d5e0 2024-09-22T08:36:47.053 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.052+0000 7fc961760640 1 -- 172.21.15.142:0/1646387468 <== osd.1 v2:172.21.15.142:6816/3192108003 29 ==== osd_op_reply(101 notify.4 [watch unwatch cookie 93883992226320] v30'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc94c02a040 con 0x55631200d5e0 2024-09-22T08:36:47.053 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.052+0000 7fc96632a800 20 remove_watcher() i=4 2024-09-22T08:36:47.053 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.052+0000 7fc96632a800 1 -- 172.21.15.142:0/1646387468 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:102 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93883992217392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55631201ba10 con 0x7fc95406d040 2024-09-22T08:36:47.054 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.053+0000 7fc961760640 1 -- 172.21.15.142:0/1646387468 <== osd.0 v2:172.21.15.31:6800/168281188 26 ==== osd_op_reply(102 notify.5 [watch unwatch cookie 93883992217392] v30'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc94c02a040 con 0x7fc95406d040 2024-09-22T08:36:47.054 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.053+0000 7fc96632a800 20 remove_watcher() i=5 2024-09-22T08:36:47.054 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.053+0000 7fc96632a800 1 -- 172.21.15.142:0/1646387468 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:103 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93883992221856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55631201af70 con 0x7fc95406d040 2024-09-22T08:36:47.055 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.054+0000 7fc961760640 1 -- 172.21.15.142:0/1646387468 <== osd.0 v2:172.21.15.31:6800/168281188 27 ==== osd_op_reply(103 notify.6 [watch unwatch cookie 93883992221856] v30'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc94c02a040 con 0x7fc95406d040 2024-09-22T08:36:47.055 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.054+0000 7fc96632a800 20 remove_watcher() i=6 2024-09-22T08:36:47.055 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.054+0000 7fc96632a800 1 -- 172.21.15.142:0/1646387468 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:104 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93883992231584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55631201af70 con 0x7fc95406d040 2024-09-22T08:36:47.058 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.055+0000 7fc961760640 1 -- 172.21.15.142:0/1646387468 <== osd.0 v2:172.21.15.31:6800/168281188 28 ==== osd_op_reply(104 notify.7 [watch unwatch cookie 93883992231584] v30'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc94c02a040 con 0x7fc95406d040 2024-09-22T08:36:47.058 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.055+0000 7fc96632a800 20 remove_watcher() i=7 2024-09-22T08:36:47.058 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.055+0000 7fc96632a800 1 -- 172.21.15.142:0/1646387468 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7fc95406d040 msgr2=0x7fc954090270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:47.058 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.055+0000 7fc96632a800 1 --2- 172.21.15.142:0/1646387468 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7fc95406d040 0x7fc954090270 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:47.058 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.055+0000 7fc96632a800 1 -- 172.21.15.142:0/1646387468 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55631200d5e0 msgr2=0x55631200faa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:47.058 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.055+0000 7fc96632a800 1 --2- 172.21.15.142:0/1646387468 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55631200d5e0 0x55631200faa0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:47.058 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.055+0000 7fc96632a800 1 -- 172.21.15.142:0/1646387468 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7fc95c021020 msgr2=0x7fc95c0284c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:47.058 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.055+0000 7fc96632a800 1 --2- 172.21.15.142:0/1646387468 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7fc95c021020 0x7fc95c0284c0 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:47.059 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.055+0000 7fc96632a800 1 -- 172.21.15.142:0/1646387468 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x556312011fd0 msgr2=0x5563120143c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:47.059 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.055+0000 7fc96632a800 1 --2- 172.21.15.142:0/1646387468 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x556312011fd0 0x5563120143c0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:47.059 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.055+0000 7fc96632a800 1 -- 172.21.15.142:0/1646387468 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fc82c03d000 msgr2=0x7fc82c03f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:47.059 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.055+0000 7fc96632a800 1 --2- 172.21.15.142:0/1646387468 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fc82c03d000 0x7fc82c03f4c0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fc954076c50 tx=0x7fc954089000 comp rx=0 tx=0).stop 2024-09-22T08:36:47.059 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.055+0000 7fc96632a800 1 -- 172.21.15.142:0/1646387468 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556311ffa6d0 msgr2=0x556312001cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:47.059 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.055+0000 7fc961760640 1 -- 172.21.15.142:0/1646387468 reap_dead start 2024-09-22T08:36:47.059 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.055+0000 7fc96632a800 1 --2- 172.21.15.142:0/1646387468 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556311ffa6d0 0x556312001cb0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fc95c016010 tx=0x7fc95c053da0 comp rx=0 tx=0).stop 2024-09-22T08:36:47.059 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.055+0000 7fc96632a800 1 -- 172.21.15.142:0/1646387468 shutdown_connections 2024-09-22T08:36:47.059 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.055+0000 7fc96632a800 1 --2- 172.21.15.142:0/1646387468 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556311ffa6d0 0x556312001cb0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:47.059 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.055+0000 7fc96632a800 1 -- 172.21.15.142:0/1646387468 >> 172.21.15.142:0/1646387468 conn(0x556311ff6ad0 msgr2=0x556311ff4ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:47.059 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.055+0000 7fc96632a800 1 -- 172.21.15.142:0/1646387468 shutdown_connections 2024-09-22T08:36:47.059 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.055+0000 7fc96632a800 1 -- 172.21.15.142:0/1646387468 wait complete. 2024-09-22T08:36:47.060 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.055+0000 7fc96632a800 1 -- 172.21.15.142:0/2380963973 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fc83c03cfb0 msgr2=0x7fc83c03f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:47.060 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.055+0000 7fc96632a800 1 --2- 172.21.15.142:0/2380963973 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fc83c03cfb0 0x7fc83c03f470 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x556311fdf630 tx=0x7fc954075d60 comp rx=0 tx=0).stop 2024-09-22T08:36:47.060 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.055+0000 7fc96632a800 1 -- 172.21.15.142:0/2380963973 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556311fedc70 msgr2=0x556311fee090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:47.060 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.055+0000 7fc96632a800 1 --2- 172.21.15.142:0/2380963973 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556311fedc70 0x556311fee090 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x556311fd4b60 tx=0x7fc95c00bf30 comp rx=0 tx=0).stop 2024-09-22T08:36:47.060 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.056+0000 7fc96632a800 1 -- 172.21.15.142:0/2380963973 shutdown_connections 2024-09-22T08:36:47.060 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.056+0000 7fc96632a800 1 --2- 172.21.15.142:0/2380963973 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fc83c03cfb0 0x7fc83c03f470 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:47.060 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.056+0000 7fc96632a800 1 --2- 172.21.15.142:0/2380963973 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556311fedc70 0x556311fee090 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:47.060 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.056+0000 7fc96632a800 1 -- 172.21.15.142:0/2380963973 >> 172.21.15.142:0/2380963973 conn(0x556311fe2020 msgr2=0x556311fe2400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:47.060 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.056+0000 7fc96632a800 1 -- 172.21.15.142:0/2380963973 shutdown_connections 2024-09-22T08:36:47.060 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.056+0000 7fc96632a800 1 -- 172.21.15.142:0/2380963973 wait complete. 2024-09-22T08:36:47.060 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.056+0000 7fc96632a800 1 -- 172.21.15.142:0/3217537769 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x556311ed9a20 msgr2=0x556311fda2c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:47.060 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.056+0000 7fc96632a800 1 --2- 172.21.15.142:0/3217537769 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x556311ed9a20 0x556311fda2c0 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:47.060 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.056+0000 7fc96632a800 1 -- 172.21.15.142:0/3217537769 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x556311fdc660 msgr2=0x556311fdeb00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:47.060 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.056+0000 7fc96632a800 1 --2- 172.21.15.142:0/3217537769 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x556311fdc660 0x556311fdeb00 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:47.061 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.056+0000 7fc96632a800 1 -- 172.21.15.142:0/3217537769 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fc84803cfb0 msgr2=0x7fc84803f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:47.061 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.056+0000 7fc96632a800 1 --2- 172.21.15.142:0/3217537769 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fc84803cfb0 0x7fc84803f470 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fc94c001e50 tx=0x7fc94c0013d0 comp rx=0 tx=0).stop 2024-09-22T08:36:47.061 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.056+0000 7fc96632a800 1 -- 172.21.15.142:0/3217537769 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556311ed87e0 msgr2=0x556311fd2c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:47.061 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.056+0000 7fc96632a800 1 --2- 172.21.15.142:0/3217537769 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556311ed87e0 0x556311fd2c70 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fc954063040 tx=0x7fc954003330 comp rx=0 tx=0).stop 2024-09-22T08:36:47.061 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.056+0000 7fc96632a800 1 -- 172.21.15.142:0/3217537769 shutdown_connections 2024-09-22T08:36:47.061 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.056+0000 7fc96632a800 1 --2- 172.21.15.142:0/3217537769 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x556311fdc660 0x556311fdeb00 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:47.061 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.056+0000 7fc96632a800 1 --2- 172.21.15.142:0/3217537769 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x556311ed9a20 0x556311fda2c0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:47.061 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.056+0000 7fc96632a800 1 --2- 172.21.15.142:0/3217537769 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fc84803cfb0 0x7fc84803f470 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:47.061 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.056+0000 7fc96632a800 1 --2- 172.21.15.142:0/3217537769 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556311ed87e0 0x556311fd2c70 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:47.061 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.056+0000 7fc96632a800 1 -- 172.21.15.142:0/3217537769 >> 172.21.15.142:0/3217537769 conn(0x556311ed3bb0 msgr2=0x556311fc2080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:47.061 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.056+0000 7fc96632a800 1 -- 172.21.15.142:0/3217537769 shutdown_connections 2024-09-22T08:36:47.061 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.056+0000 7fc96632a800 1 -- 172.21.15.142:0/3217537769 wait complete. 2024-09-22T08:36:47.066 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-09-22T08:36:47.066 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'unlink', '--uid', 'fud', '--bucket', 'myfoo'] 2024-09-22T08:36:47.066 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'unlink', '--uid', 'fud', '--bucket', 'myfoo'] 2024-09-22T08:36:47.066 DEBUG:teuthology.orchestra.run.smithi142:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket unlink --uid fud --bucket myfoo 2024-09-22T08:36:47.112 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:36:47.112 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:36:47.114 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.112+0000 7f3bbb415800 1 Processor -- start 2024-09-22T08:36:47.114 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.112+0000 7f3bbb415800 1 -- start start 2024-09-22T08:36:47.114 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.112+0000 7f3bbb415800 1 --2- >> v2:172.21.15.31:3300/0 conn(0x561c7293db80 0x561c7293ff70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:47.114 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.112+0000 7f3bbb415800 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x561c727c4a20 con 0x561c7293a070 2024-09-22T08:36:47.114 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.112+0000 7f3bbb415800 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x561c727c47d0 con 0x561c7293db80 2024-09-22T08:36:47.114 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.112+0000 7f3bb6391640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x561c7293db80 0x561c7293ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:47.114 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.112+0000 7f3bb6b92640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x561c7293a070 0x561c7293c460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.142:42582/0 (socket says 172.21.15.142:42582) 2024-09-22T08:36:47.114 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.112+0000 7f3bb6b92640 1 -- 172.21.15.142:0/1291802728 learned_addr learned my addr 172.21.15.142:0/1291802728 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-09-22T08:36:47.114 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.112+0000 7f3bb6391640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x561c7293db80 0x561c7293ff70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:39612/0 (socket says 172.21.15.142:39612) 2024-09-22T08:36:47.114 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.113+0000 7f3bb6391640 1 -- 172.21.15.142:0/1291802728 >> v1:172.21.15.31:6789/0 conn(0x561c7293a070 legacy=0x561c7293c460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:47.114 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.113+0000 7f3bb6391640 1 -- 172.21.15.142:0/1291802728 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x561c72941550 con 0x561c7293db80 2024-09-22T08:36:47.116 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.114+0000 7f3bb6391640 1 --2- 172.21.15.142:0/1291802728 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561c7293db80 0x561c7293ff70 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f3bac00a470 tx=0x7f3bac045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b5c9467a8b636e9 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:47.116 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.115+0000 7f3bb5b90640 1 -- 172.21.15.142:0/1291802728 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3bac053570 con 0x561c7293db80 2024-09-22T08:36:47.116 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.115+0000 7f3bb5b90640 1 -- 172.21.15.142:0/1291802728 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3bac058070 con 0x561c7293db80 2024-09-22T08:36:47.116 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.115+0000 7f3bb5b90640 1 -- 172.21.15.142:0/1291802728 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3bac053880 con 0x561c7293db80 2024-09-22T08:36:47.117 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.115+0000 7f3bbb415800 1 -- 172.21.15.142:0/1291802728 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561c7293db80 msgr2=0x561c7293ff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:47.118 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.115+0000 7f3bbb415800 1 --2- 172.21.15.142:0/1291802728 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561c7293db80 0x561c7293ff70 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f3bac00a470 tx=0x7f3bac045a20 comp rx=0 tx=0).stop 2024-09-22T08:36:47.118 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.115+0000 7f3bbb415800 1 -- 172.21.15.142:0/1291802728 shutdown_connections 2024-09-22T08:36:47.118 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.115+0000 7f3bbb415800 1 --2- 172.21.15.142:0/1291802728 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561c7293db80 0x561c7293ff70 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:47.118 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.115+0000 7f3bbb415800 1 -- 172.21.15.142:0/1291802728 >> 172.21.15.142:0/1291802728 conn(0x561c72933bb0 msgr2=0x561c72936010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:47.118 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.115+0000 7f3bbb415800 1 -- 172.21.15.142:0/1291802728 shutdown_connections 2024-09-22T08:36:47.118 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.115+0000 7f3bbb415800 1 -- 172.21.15.142:0/1291802728 wait complete. 2024-09-22T08:36:47.130 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.129+0000 7f3bbb415800 1 Processor -- start 2024-09-22T08:36:47.130 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.129+0000 7f3bbb415800 1 -- start start 2024-09-22T08:36:47.131 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.129+0000 7f3bbb415800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561c7293a070 0x561c72a29030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:47.131 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.129+0000 7f3bbb415800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x561c727d1dd0 con 0x561c7293a070 2024-09-22T08:36:47.133 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.130+0000 7f3bb6b92640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561c7293a070 0x561c72a29030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:47.133 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.130+0000 7f3bb6b92640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561c7293a070 0x561c72a29030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:39624/0 (socket says 172.21.15.142:39624) 2024-09-22T08:36:47.134 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.130+0000 7f3bb6b92640 1 -- 172.21.15.142:0/2081407603 learned_addr learned my addr 172.21.15.142:0/2081407603 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:47.134 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.130+0000 7f3bb6b92640 1 -- 172.21.15.142:0/2081407603 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561c72a29620 con 0x561c7293a070 2024-09-22T08:36:47.134 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.130+0000 7f3bb6b92640 1 --2- 172.21.15.142:0/2081407603 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561c7293a070 0x561c72a29030 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f3ba8001800 tx=0x7f3ba8001cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21b06ab7039b23d server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:47.134 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.130+0000 7f3aa4e09640 1 -- 172.21.15.142:0/2081407603 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ba8004520 con 0x561c7293a070 2024-09-22T08:36:47.134 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.130+0000 7f3aa4e09640 1 -- 172.21.15.142:0/2081407603 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ba80046c0 con 0x561c7293a070 2024-09-22T08:36:47.134 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.130+0000 7f3aa4e09640 1 -- 172.21.15.142:0/2081407603 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ba80049e0 con 0x561c7293a070 2024-09-22T08:36:47.134 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.131+0000 7f3bbb415800 1 -- 172.21.15.142:0/2081407603 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561c7293a070 msgr2=0x561c72a29030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:47.134 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.131+0000 7f3bbb415800 1 --2- 172.21.15.142:0/2081407603 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561c7293a070 0x561c72a29030 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f3ba8001800 tx=0x7f3ba8001cc0 comp rx=0 tx=0).stop 2024-09-22T08:36:47.134 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.131+0000 7f3bbb415800 1 -- 172.21.15.142:0/2081407603 shutdown_connections 2024-09-22T08:36:47.134 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.131+0000 7f3bbb415800 1 --2- 172.21.15.142:0/2081407603 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561c7293a070 0x561c72a29030 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:47.134 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.131+0000 7f3bbb415800 1 -- 172.21.15.142:0/2081407603 >> 172.21.15.142:0/2081407603 conn(0x561c72933bb0 msgr2=0x561c72a249b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:47.134 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.131+0000 7f3bbb415800 1 -- 172.21.15.142:0/2081407603 shutdown_connections 2024-09-22T08:36:47.135 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.131+0000 7f3bbb415800 1 -- 172.21.15.142:0/2081407603 wait complete. 2024-09-22T08:36:47.135 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.131+0000 7f3bbb415800 1 Processor -- start 2024-09-22T08:36:47.135 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.131+0000 7f3bbb415800 1 -- start start 2024-09-22T08:36:47.135 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.131+0000 7f3bbb415800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561c7293a070 0x561c72a30ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:47.135 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.131+0000 7f3bbb415800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x561c72940840 con 0x561c7293a070 2024-09-22T08:36:47.135 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.132+0000 7f3bb6b92640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561c7293a070 0x561c72a30ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:47.135 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.132+0000 7f3bb6b92640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561c7293a070 0x561c72a30ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:39640/0 (socket says 172.21.15.142:39640) 2024-09-22T08:36:47.135 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.132+0000 7f3bb6b92640 1 -- 172.21.15.142:0/2405726590 learned_addr learned my addr 172.21.15.142:0/2405726590 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:47.135 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.132+0000 7f3bb6b92640 1 -- 172.21.15.142:0/2405726590 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561c72a31100 con 0x561c7293a070 2024-09-22T08:36:47.135 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.132+0000 7f3bb6b92640 1 --2- 172.21.15.142:0/2405726590 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561c7293a070 0x561c72a30ba0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f3ba8000f80 tx=0x7f3ba8001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:47.135 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.132+0000 7f3aa3606640 1 -- 172.21.15.142:0/2405726590 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ba8022020 con 0x561c7293a070 2024-09-22T08:36:47.135 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.132+0000 7f3aa3606640 1 -- 172.21.15.142:0/2405726590 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ba8014890 con 0x561c7293a070 2024-09-22T08:36:47.135 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.132+0000 7f3aa3606640 1 -- 172.21.15.142:0/2405726590 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ba8014bb0 con 0x561c7293a070 2024-09-22T08:36:47.135 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.132+0000 7f3bbb415800 1 -- 172.21.15.142:0/2405726590 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561c72a31390 con 0x561c7293a070 2024-09-22T08:36:47.136 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.132+0000 7f3bbb415800 1 -- 172.21.15.142:0/2405726590 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561c72a31d90 con 0x561c7293a070 2024-09-22T08:36:47.140 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.133+0000 7f3aa3606640 1 -- 172.21.15.142:0/2405726590 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f3ba8025020 con 0x561c7293a070 2024-09-22T08:36:47.140 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.133+0000 7f3aa3606640 1 --2- 172.21.15.142:0/2405726590 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f3a9c03d000 0x7f3a9c03f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:47.140 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.133+0000 7f3aa3606640 1 -- 172.21.15.142:0/2405726590 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f3ba8018030 con 0x561c7293a070 2024-09-22T08:36:47.140 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.134+0000 7f3bb6391640 1 --2- 172.21.15.142:0/2405726590 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f3a9c03d000 0x7f3a9c03f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:47.140 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.134+0000 7f3bbb415800 1 --2- 172.21.15.142:0/2405726590 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x561c7293db80 0x561c72a381f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:47.141 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.134+0000 7f3bbb415800 1 -- 172.21.15.142:0/2405726590 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561c72a38730 con 0x561c7293db80 2024-09-22T08:36:47.141 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.134+0000 7f3bb7393640 1 --2- 172.21.15.142:0/2405726590 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x561c7293db80 0x561c72a381f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:47.141 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.134+0000 7f3bb6391640 1 --2- 172.21.15.142:0/2405726590 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f3a9c03d000 0x7f3a9c03f4c0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f3bac057000 tx=0x7f3bac052000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:47.141 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.134+0000 7f3bb7393640 1 --2- 172.21.15.142:0/2405726590 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x561c7293db80 0x561c72a381f0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:47.141 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.134+0000 7f3bb7393640 1 -- 172.21.15.142:0/2405726590 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3bb00083e0 con 0x561c7293db80 2024-09-22T08:36:47.141 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.134+0000 7f3bbb415800 1 -- 172.21.15.142:0/2405726590 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561c72a38ad0 con 0x561c7293db80 2024-09-22T08:36:47.141 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.135+0000 7f3bb7393640 1 -- 172.21.15.142:0/2405726590 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3bb00083e0 con 0x561c7293db80 2024-09-22T08:36:47.141 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.135+0000 7f3bbb415800 1 --2- 172.21.15.142:0/2405726590 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x561c72a3a5d0 0x561c72a3ca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:47.141 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.135+0000 7f3bbb415800 1 -- 172.21.15.142:0/2405726590 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:3 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561c72a3d1e0 con 0x561c72a3a5d0 2024-09-22T08:36:47.141 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.135+0000 7f3bb6b92640 1 --2- 172.21.15.142:0/2405726590 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x561c72a3a5d0 0x561c72a3ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:47.141 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.135+0000 7f3bb6b92640 1 --2- 172.21.15.142:0/2405726590 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x561c72a3a5d0 0x561c72a3ca50 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:47.141 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.135+0000 7f3bb6b92640 1 -- 172.21.15.142:0/2405726590 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(3 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f3ba801b070 con 0x561c72a3a5d0 2024-09-22T08:36:47.141 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.135+0000 7f3bbb415800 1 -- 172.21.15.142:0/2405726590 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561c72a39320 con 0x561c7293db80 2024-09-22T08:36:47.142 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.136+0000 7f3bb7393640 1 -- 172.21.15.142:0/2405726590 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3bb00083e0 con 0x561c7293db80 2024-09-22T08:36:47.142 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.136+0000 7f3bbb415800 1 -- 172.21.15.142:0/2405726590 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561c72a39770 con 0x561c72a3a5d0 2024-09-22T08:36:47.142 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.136+0000 7f3bb6b92640 1 -- 172.21.15.142:0/2405726590 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(5 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f3ba801b070 con 0x561c72a3a5d0 2024-09-22T08:36:47.142 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.136+0000 7f3bbb415800 1 Processor -- start 2024-09-22T08:36:47.142 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.136+0000 7f3bbb415800 1 -- start start 2024-09-22T08:36:47.142 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.136+0000 7f3bbb415800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561c72a4bbe0 0x561c72a4c000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:47.142 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.136+0000 7f3bbb415800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x561c72830d50 con 0x561c72a4bbe0 2024-09-22T08:36:47.142 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.137+0000 7f3bb7393640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561c72a4bbe0 0x561c72a4c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:47.142 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.137+0000 7f3bb7393640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561c72a4bbe0 0x561c72a4c000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:39654/0 (socket says 172.21.15.142:39654) 2024-09-22T08:36:47.142 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.137+0000 7f3bb7393640 1 -- 172.21.15.142:0/3423207874 learned_addr learned my addr 172.21.15.142:0/3423207874 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:47.142 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.137+0000 7f3bb7393640 1 -- 172.21.15.142:0/3423207874 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561c72a4c640 con 0x561c72a4bbe0 2024-09-22T08:36:47.143 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.137+0000 7f3bb7393640 1 --2- 172.21.15.142:0/3423207874 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561c72a4bbe0 0x561c72a4c000 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x561c72a31ba0 tx=0x7f3bb000bf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:47.143 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.137+0000 7f3aa0e01640 1 -- 172.21.15.142:0/3423207874 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3bb001c020 con 0x561c72a4bbe0 2024-09-22T08:36:47.143 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.137+0000 7f3aa0e01640 1 -- 172.21.15.142:0/3423207874 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3bb0007c90 con 0x561c72a4bbe0 2024-09-22T08:36:47.143 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.137+0000 7f3bbb415800 1 -- 172.21.15.142:0/3423207874 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561c72a4ce70 con 0x561c72a4bbe0 2024-09-22T08:36:47.143 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.137+0000 7f3aa0e01640 1 -- 172.21.15.142:0/3423207874 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3bb0018440 con 0x561c72a4bbe0 2024-09-22T08:36:47.143 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.137+0000 7f3bbb415800 1 -- 172.21.15.142:0/3423207874 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561c72a4d410 con 0x561c72a4bbe0 2024-09-22T08:36:47.143 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.138+0000 7f3aa0e01640 1 -- 172.21.15.142:0/3423207874 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f3bb001f020 con 0x561c72a4bbe0 2024-09-22T08:36:47.143 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.138+0000 7f3aa0e01640 1 --2- 172.21.15.142:0/3423207874 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f3a9003cfb0 0x7f3a9003f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:47.143 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.138+0000 7f3aa0e01640 1 -- 172.21.15.142:0/3423207874 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f3bb00558e0 con 0x561c72a4bbe0 2024-09-22T08:36:47.143 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.138+0000 7f3bb6b92640 1 --2- 172.21.15.142:0/3423207874 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f3a9003cfb0 0x7f3a9003f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:47.144 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.139+0000 7f3bbb415800 1 Processor -- start 2024-09-22T08:36:47.144 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.139+0000 7f3bb6b92640 1 --2- 172.21.15.142:0/3423207874 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f3a9003cfb0 0x7f3a9003f470 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f3ba8052b50 tx=0x7f3ba8011f40 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:47.144 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.139+0000 7f3bbb415800 1 -- start start 2024-09-22T08:36:47.144 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.139+0000 7f3bbb415800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561c72a58640 0x561c72a58a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:47.144 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.139+0000 7f3bbb415800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x561c72a29a50 con 0x561c72a58640 2024-09-22T08:36:47.144 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.139+0000 7f3bb7393640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561c72a58640 0x561c72a58a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:47.144 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.139+0000 7f3bb7393640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561c72a58640 0x561c72a58a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:39666/0 (socket says 172.21.15.142:39666) 2024-09-22T08:36:47.144 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.139+0000 7f3bb7393640 1 -- 172.21.15.142:0/1040798475 learned_addr learned my addr 172.21.15.142:0/1040798475 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:47.144 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.139+0000 7f3bb7393640 1 -- 172.21.15.142:0/1040798475 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561c72a59030 con 0x561c72a58640 2024-09-22T08:36:47.159 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.139+0000 7f3bb7393640 1 --2- 172.21.15.142:0/1040798475 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561c72a58640 0x561c72a58a40 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f3bb0053df0 tx=0x7f3bb0015970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=101ce93bf3b57186 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:47.159 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.140+0000 7f3a9a7fc640 1 -- 172.21.15.142:0/1040798475 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3bb004a070 con 0x561c72a58640 2024-09-22T08:36:47.159 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.140+0000 7f3a9a7fc640 1 -- 172.21.15.142:0/1040798475 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3bb0015e70 con 0x561c72a58640 2024-09-22T08:36:47.159 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.140+0000 7f3a9a7fc640 1 -- 172.21.15.142:0/1040798475 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3bb00174d0 con 0x561c72a58640 2024-09-22T08:36:47.159 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.140+0000 7f3bbb415800 1 -- 172.21.15.142:0/1040798475 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561c72a58640 msgr2=0x561c72a58a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:47.159 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.140+0000 7f3bbb415800 1 --2- 172.21.15.142:0/1040798475 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561c72a58640 0x561c72a58a40 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f3bb0053df0 tx=0x7f3bb0015970 comp rx=0 tx=0).stop 2024-09-22T08:36:47.159 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.140+0000 7f3bbb415800 1 -- 172.21.15.142:0/1040798475 shutdown_connections 2024-09-22T08:36:47.159 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.140+0000 7f3bbb415800 1 --2- 172.21.15.142:0/1040798475 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561c72a58640 0x561c72a58a40 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:47.160 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.140+0000 7f3bbb415800 1 -- 172.21.15.142:0/1040798475 >> 172.21.15.142:0/1040798475 conn(0x561c72a54a40 msgr2=0x561c72a52c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:47.160 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.140+0000 7f3bbb415800 1 -- 172.21.15.142:0/1040798475 shutdown_connections 2024-09-22T08:36:47.160 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.140+0000 7f3bbb415800 1 -- 172.21.15.142:0/1040798475 wait complete. 2024-09-22T08:36:47.160 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.140+0000 7f3bbb415800 1 Processor -- start 2024-09-22T08:36:47.160 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.140+0000 7f3bbb415800 1 -- start start 2024-09-22T08:36:47.160 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.141+0000 7f3bbb415800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561c72a58640 0x561c72a5fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:47.160 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.141+0000 7f3bbb415800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x561c72a59650 con 0x561c72a58640 2024-09-22T08:36:47.160 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.141+0000 7f3bb7393640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561c72a58640 0x561c72a5fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:47.160 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.141+0000 7f3bb7393640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561c72a58640 0x561c72a5fc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:39668/0 (socket says 172.21.15.142:39668) 2024-09-22T08:36:47.160 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.141+0000 7f3bb7393640 1 -- 172.21.15.142:0/471598257 learned_addr learned my addr 172.21.15.142:0/471598257 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:47.160 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.141+0000 7f3bb7393640 1 -- 172.21.15.142:0/471598257 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561c72a601b0 con 0x561c72a58640 2024-09-22T08:36:47.160 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.141+0000 7f3bb7393640 1 --2- 172.21.15.142:0/471598257 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561c72a58640 0x561c72a5fc50 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f3bb00206f0 tx=0x7f3bb0053d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:47.160 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.141+0000 7f3a98ff9640 1 -- 172.21.15.142:0/471598257 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3bb004a070 con 0x561c72a58640 2024-09-22T08:36:47.161 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.141+0000 7f3a98ff9640 1 -- 172.21.15.142:0/471598257 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3bb004b040 con 0x561c72a58640 2024-09-22T08:36:47.161 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.141+0000 7f3bbb415800 1 -- 172.21.15.142:0/471598257 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561c72a60440 con 0x561c72a58640 2024-09-22T08:36:47.161 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.141+0000 7f3a98ff9640 1 -- 172.21.15.142:0/471598257 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3bb0017730 con 0x561c72a58640 2024-09-22T08:36:47.161 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.141+0000 7f3bbb415800 1 -- 172.21.15.142:0/471598257 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561c72a60fd0 con 0x561c72a58640 2024-09-22T08:36:47.161 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.142+0000 7f3a98ff9640 1 -- 172.21.15.142:0/471598257 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f3bb0016040 con 0x561c72a58640 2024-09-22T08:36:47.161 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.142+0000 7f3a98ff9640 1 --2- 172.21.15.142:0/471598257 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f3a8003cfb0 0x7f3a8003f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:47.161 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.142+0000 7f3a98ff9640 1 -- 172.21.15.142:0/471598257 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f3bb0055040 con 0x561c72a58640 2024-09-22T08:36:47.161 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.142+0000 7f3bb6b92640 1 --2- 172.21.15.142:0/471598257 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f3a8003cfb0 0x7f3a8003f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:47.161 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.143+0000 7f3bb6b92640 1 --2- 172.21.15.142:0/471598257 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f3a8003cfb0 0x7f3a8003f470 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f3ba8006530 tx=0x7f3ba801df90 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:47.161 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.143+0000 7f3bbb415800 20 rados->read ofs=0 len=0 2024-09-22T08:36:47.161 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.143+0000 7f3bbb415800 1 --2- 172.21.15.142:0/471598257 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x561c72a6b580 0x561c72a6da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:47.161 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.143+0000 7f3bbb415800 1 -- 172.21.15.142:0/471598257 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561c72a6e190 con 0x561c72a6b580 2024-09-22T08:36:47.162 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.143+0000 7f3bb6391640 1 --2- 172.21.15.142:0/471598257 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x561c72a6b580 0x561c72a6da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:47.162 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.143+0000 7f3bb6391640 1 --2- 172.21.15.142:0/471598257 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x561c72a6b580 0x561c72a6da40 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:47.162 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.144+0000 7f3bb6391640 1 -- 172.21.15.142:0/471598257 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3bac051070 con 0x561c72a6b580 2024-09-22T08:36:47.162 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.144+0000 7f3bbb415800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:47.162 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.144+0000 7f3bbb415800 20 realm 2024-09-22T08:36:47.162 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.144+0000 7f3bbb415800 20 rados->read ofs=0 len=0 2024-09-22T08:36:47.162 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.144+0000 7f3bbb415800 1 -- 172.21.15.142:0/471598257 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561c72a6e5c0 con 0x561c72a6b580 2024-09-22T08:36:47.162 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.144+0000 7f3bb6391640 1 -- 172.21.15.142:0/471598257 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3bac051070 con 0x561c72a6b580 2024-09-22T08:36:47.162 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.144+0000 7f3bbb415800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:47.162 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.144+0000 7f3bbb415800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:36:47.162 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.144+0000 7f3bbb415800 20 rados->read ofs=0 len=0 2024-09-22T08:36:47.162 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.144+0000 7f3bbb415800 1 -- 172.21.15.142:0/471598257 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561c72a6ee90 con 0x561c72a6b580 2024-09-22T08:36:47.163 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.144+0000 7f3bb6391640 1 -- 172.21.15.142:0/471598257 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3bac051070 con 0x561c72a6b580 2024-09-22T08:36:47.163 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.144+0000 7f3bbb415800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:47.163 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.144+0000 7f3bbb415800 20 rados->read ofs=0 len=0 2024-09-22T08:36:47.163 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.144+0000 7f3bbb415800 1 -- 172.21.15.142:0/471598257 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561c72a6f230 con 0x561c72a6b580 2024-09-22T08:36:47.163 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.144+0000 7f3bb6391640 1 -- 172.21.15.142:0/471598257 <== osd.1 v2:172.21.15.142:6816/3192108003 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3bac051070 con 0x561c72a6b580 2024-09-22T08:36:47.163 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.144+0000 7f3bbb415800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:36:47.163 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.144+0000 7f3bbb415800 20 rados->read ofs=0 len=0 2024-09-22T08:36:47.163 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.144+0000 7f3bbb415800 1 --2- 172.21.15.142:0/471598257 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x561c72a6ff90 0x561c72a72380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:47.163 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.144+0000 7f3bbb415800 1 -- 172.21.15.142:0/471598257 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561c72a72990 con 0x561c72a6ff90 2024-09-22T08:36:47.163 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.145+0000 7f3bb7393640 1 --2- 172.21.15.142:0/471598257 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x561c72a6ff90 0x561c72a72380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:47.163 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.145+0000 7f3bb7393640 1 --2- 172.21.15.142:0/471598257 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x561c72a6ff90 0x561c72a72380 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:47.163 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.145+0000 7f3bb7393640 1 -- 172.21.15.142:0/471598257 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(5 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f3bb00083e0 con 0x561c72a6ff90 2024-09-22T08:36:47.163 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.145+0000 7f3bbb415800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:36:47.164 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.145+0000 7f3bbb415800 20 searching for the correct realm 2024-09-22T08:36:47.164 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.145+0000 7f3bbb415800 1 -- 172.21.15.142:0/471598257 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561c72a742c0 con 0x561c72a6ff90 2024-09-22T08:36:47.164 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.145+0000 7f3bb7393640 1 -- 172.21.15.142:0/471598257 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3bb00083e0 con 0x561c72a6ff90 2024-09-22T08:36:47.164 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.145+0000 7f3bb7393640 1 --2- 172.21.15.142:0/471598257 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f3bb0057c20 0x7f3bb0041800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:47.164 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.145+0000 7f3bb7393640 1 -- 172.21.15.142:0/471598257 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561c72a742c0 con 0x7f3bb0057c20 2024-09-22T08:36:47.164 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.145+0000 7f3bb6b92640 1 --2- 172.21.15.142:0/471598257 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f3bb0057c20 0x7f3bb0041800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:47.164 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.146+0000 7f3bb6b92640 1 --2- 172.21.15.142:0/471598257 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f3bb0057c20 0x7f3bb0041800 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:47.164 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.146+0000 7f3bb6b92640 1 -- 172.21.15.142:0/471598257 <== osd.2 v2:172.21.15.142:6808/279438927 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ba801b070 con 0x7f3bb0057c20 2024-09-22T08:36:47.164 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.146+0000 7f3bb6b92640 1 --2- 172.21.15.142:0/471598257 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f3ba8027020 0x7f3ba801e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:47.164 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.146+0000 7f3bb6b92640 1 -- 172.21.15.142:0/471598257 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561c72a742c0 con 0x7f3ba8027020 2024-09-22T08:36:47.164 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.146+0000 7f3bb6391640 1 --2- 172.21.15.142:0/471598257 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f3ba8027020 0x7f3ba801e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:47.165 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.147+0000 7f3bb6391640 1 --2- 172.21.15.142:0/471598257 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f3ba8027020 0x7f3ba801e3f0 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:47.165 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.147+0000 7f3bb6391640 1 -- 172.21.15.142:0/471598257 <== osd.0 v2:172.21.15.31:6800/168281188 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3bac051070 con 0x7f3ba8027020 2024-09-22T08:36:47.165 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.147+0000 7f3bb6391640 1 -- 172.21.15.142:0/471598257 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561c72a742c0 con 0x561c72a6b580 2024-09-22T08:36:47.165 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.147+0000 7f3bb6391640 1 -- 172.21.15.142:0/471598257 <== osd.1 v2:172.21.15.142:6816/3192108003 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3bac051070 con 0x561c72a6b580 2024-09-22T08:36:47.165 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.147+0000 7f3bb6391640 1 -- 172.21.15.142:0/471598257 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561c72a742c0 con 0x561c72a6b580 2024-09-22T08:36:47.165 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.147+0000 7f3bb6391640 1 -- 172.21.15.142:0/471598257 <== osd.1 v2:172.21.15.142:6816/3192108003 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3bac051070 con 0x561c72a6b580 2024-09-22T08:36:47.165 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.147+0000 7f3bb6391640 1 -- 172.21.15.142:0/471598257 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561c72a742c0 con 0x7f3ba8027020 2024-09-22T08:36:47.165 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.148+0000 7f3bb6391640 1 -- 172.21.15.142:0/471598257 <== osd.0 v2:172.21.15.31:6800/168281188 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3bac051070 con 0x7f3ba8027020 2024-09-22T08:36:47.165 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.148+0000 7f3bb6391640 1 -- 172.21.15.142:0/471598257 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561c72a742c0 con 0x7f3ba8027020 2024-09-22T08:36:47.165 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.148+0000 7f3bb6391640 1 -- 172.21.15.142:0/471598257 <== osd.0 v2:172.21.15.31:6800/168281188 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3bac051070 con 0x7f3ba8027020 2024-09-22T08:36:47.165 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.148+0000 7f3bb6391640 1 -- 172.21.15.142:0/471598257 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561c72a742c0 con 0x7f3bb0057c20 2024-09-22T08:36:47.165 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.148+0000 7f3bb6b92640 1 -- 172.21.15.142:0/471598257 <== osd.2 v2:172.21.15.142:6808/279438927 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ba801b070 con 0x7f3bb0057c20 2024-09-22T08:36:47.165 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.148+0000 7f3bb6b92640 1 -- 172.21.15.142:0/471598257 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561c72a742c0 con 0x561c72a6ff90 2024-09-22T08:36:47.166 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.148+0000 7f3bb7393640 1 -- 172.21.15.142:0/471598257 <== osd.3 v2:172.21.15.142:6800/1064901393 3 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3bb00083e0 con 0x561c72a6ff90 2024-09-22T08:36:47.166 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.148+0000 7f3bb7393640 1 -- 172.21.15.142:0/471598257 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561c72a742c0 con 0x561c72a6b580 2024-09-22T08:36:47.166 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.148+0000 7f3bb6391640 1 -- 172.21.15.142:0/471598257 <== osd.1 v2:172.21.15.142:6816/3192108003 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3bac051070 con 0x561c72a6b580 2024-09-22T08:36:47.166 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.148+0000 7f3bb6391640 1 -- 172.21.15.142:0/471598257 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561c72a742c0 con 0x7f3ba8027020 2024-09-22T08:36:47.166 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.149+0000 7f3bb6391640 1 -- 172.21.15.142:0/471598257 <== osd.0 v2:172.21.15.31:6800/168281188 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3bac051070 con 0x7f3ba8027020 2024-09-22T08:36:47.166 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.149+0000 7f3bb6391640 1 -- 172.21.15.142:0/471598257 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561c72a742c0 con 0x561c72a6b580 2024-09-22T08:36:47.166 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.149+0000 7f3bb6391640 1 -- 172.21.15.142:0/471598257 <== osd.1 v2:172.21.15.142:6816/3192108003 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3bac051070 con 0x561c72a6b580 2024-09-22T08:36:47.166 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.149+0000 7f3bb6391640 1 -- 172.21.15.142:0/471598257 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561c72a742c0 con 0x7f3bb0057c20 2024-09-22T08:36:47.166 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.149+0000 7f3bb6b92640 1 -- 172.21.15.142:0/471598257 <== osd.2 v2:172.21.15.142:6808/279438927 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f3ba801b070 con 0x7f3bb0057c20 2024-09-22T08:36:47.166 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.149+0000 7f3bb6b92640 1 -- 172.21.15.142:0/471598257 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561c72a742c0 con 0x561c72a6ff90 2024-09-22T08:36:47.166 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.149+0000 7f3bb7393640 1 -- 172.21.15.142:0/471598257 <== osd.3 v2:172.21.15.142:6800/1064901393 4 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3bb00083e0 con 0x561c72a6ff90 2024-09-22T08:36:47.166 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.149+0000 7f3bb7393640 1 -- 172.21.15.142:0/471598257 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561c72a742c0 con 0x561c72a6ff90 2024-09-22T08:36:47.167 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.150+0000 7f3bb7393640 1 -- 172.21.15.142:0/471598257 <== osd.3 v2:172.21.15.142:6800/1064901393 5 ==== osd_op_reply(20 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f3bb00083e0 con 0x561c72a6ff90 2024-09-22T08:36:47.167 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.150+0000 7f3bb7393640 1 -- 172.21.15.142:0/471598257 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561c72a742c0 con 0x7f3ba8027020 2024-09-22T08:36:47.167 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.150+0000 7f3bb6391640 1 -- 172.21.15.142:0/471598257 <== osd.0 v2:172.21.15.31:6800/168281188 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3bac051070 con 0x7f3ba8027020 2024-09-22T08:36:47.167 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.150+0000 7f3bb6391640 1 -- 172.21.15.142:0/471598257 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561c72a742c0 con 0x561c72a6ff90 2024-09-22T08:36:47.167 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.150+0000 7f3bb7393640 1 -- 172.21.15.142:0/471598257 <== osd.3 v2:172.21.15.142:6800/1064901393 6 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3bb00083e0 con 0x561c72a6ff90 2024-09-22T08:36:47.167 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.150+0000 7f3bb7393640 1 -- 172.21.15.142:0/471598257 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561c72a742c0 con 0x561c72a6ff90 2024-09-22T08:36:47.167 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.150+0000 7f3bb7393640 1 -- 172.21.15.142:0/471598257 <== osd.3 v2:172.21.15.142:6800/1064901393 7 ==== osd_op_reply(23 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f3bb00083e0 con 0x561c72a6ff90 2024-09-22T08:36:47.167 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.150+0000 7f3bb7393640 1 -- 172.21.15.142:0/471598257 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561c72a742c0 con 0x561c72a6b580 2024-09-22T08:36:47.167 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.151+0000 7f3bb6391640 1 -- 172.21.15.142:0/471598257 <== osd.1 v2:172.21.15.142:6816/3192108003 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3bac051070 con 0x561c72a6b580 2024-09-22T08:36:47.167 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.151+0000 7f3bb6391640 1 -- 172.21.15.142:0/471598257 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561c72a742c0 con 0x561c72a6b580 2024-09-22T08:36:47.167 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.151+0000 7f3bb6391640 1 -- 172.21.15.142:0/471598257 <== osd.1 v2:172.21.15.142:6816/3192108003 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f3bac051070 con 0x561c72a6b580 2024-09-22T08:36:47.167 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.151+0000 7f3bb6391640 1 -- 172.21.15.142:0/471598257 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561c72a742c0 con 0x7f3ba8027020 2024-09-22T08:36:47.167 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.151+0000 7f3bb6391640 1 -- 172.21.15.142:0/471598257 <== osd.0 v2:172.21.15.31:6800/168281188 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3bac051070 con 0x7f3ba8027020 2024-09-22T08:36:47.168 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.151+0000 7f3bb6391640 1 -- 172.21.15.142:0/471598257 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561c72a742c0 con 0x561c72a6ff90 2024-09-22T08:36:47.168 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.151+0000 7f3bb7393640 1 -- 172.21.15.142:0/471598257 <== osd.3 v2:172.21.15.142:6800/1064901393 8 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3bb00083e0 con 0x561c72a6ff90 2024-09-22T08:36:47.168 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.151+0000 7f3bb7393640 1 -- 172.21.15.142:0/471598257 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561c72a742c0 con 0x7f3bb0057c20 2024-09-22T08:36:47.168 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.152+0000 7f3bb6b92640 1 -- 172.21.15.142:0/471598257 <== osd.2 v2:172.21.15.142:6808/279438927 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ba801b070 con 0x7f3bb0057c20 2024-09-22T08:36:47.168 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.152+0000 7f3bb6b92640 1 -- 172.21.15.142:0/471598257 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561c72a742c0 con 0x561c72a6b580 2024-09-22T08:36:47.168 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.152+0000 7f3bb6391640 1 -- 172.21.15.142:0/471598257 <== osd.1 v2:172.21.15.142:6816/3192108003 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3bac051070 con 0x561c72a6b580 2024-09-22T08:36:47.168 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.152+0000 7f3bb6391640 1 -- 172.21.15.142:0/471598257 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561c72a742c0 con 0x7f3ba8027020 2024-09-22T08:36:47.168 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.152+0000 7f3bb6391640 1 -- 172.21.15.142:0/471598257 <== osd.0 v2:172.21.15.31:6800/168281188 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3bac051070 con 0x7f3ba8027020 2024-09-22T08:36:47.168 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.152+0000 7f3bb6391640 1 -- 172.21.15.142:0/471598257 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561c72a742c0 con 0x561c72a6ff90 2024-09-22T08:36:47.168 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.153+0000 7f3bb7393640 1 -- 172.21.15.142:0/471598257 <== osd.3 v2:172.21.15.142:6800/1064901393 9 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3bb00083e0 con 0x561c72a6ff90 2024-09-22T08:36:47.168 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.153+0000 7f3bb7393640 1 -- 172.21.15.142:0/471598257 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561c72a742c0 con 0x7f3ba8027020 2024-09-22T08:36:47.169 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.153+0000 7f3bb6391640 1 -- 172.21.15.142:0/471598257 <== osd.0 v2:172.21.15.31:6800/168281188 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3bac051070 con 0x7f3ba8027020 2024-09-22T08:36:47.169 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.153+0000 7f3bb6391640 1 -- 172.21.15.142:0/471598257 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561c72a742c0 con 0x7f3bb0057c20 2024-09-22T08:36:47.169 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.153+0000 7f3bb6b92640 1 -- 172.21.15.142:0/471598257 <== osd.2 v2:172.21.15.142:6808/279438927 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ba801b070 con 0x7f3bb0057c20 2024-09-22T08:36:47.169 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.153+0000 7f3bb6b92640 1 -- 172.21.15.142:0/471598257 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561c72a742c0 con 0x561c72a6ff90 2024-09-22T08:36:47.169 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.153+0000 7f3bb7393640 1 -- 172.21.15.142:0/471598257 <== osd.3 v2:172.21.15.142:6800/1064901393 10 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3bb00083e0 con 0x561c72a6ff90 2024-09-22T08:36:47.169 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.153+0000 7f3bb7393640 1 -- 172.21.15.142:0/471598257 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561c72a742c0 con 0x7f3ba8027020 2024-09-22T08:36:47.169 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.154+0000 7f3bb6391640 1 -- 172.21.15.142:0/471598257 <== osd.0 v2:172.21.15.31:6800/168281188 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3bac051070 con 0x7f3ba8027020 2024-09-22T08:36:47.169 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.154+0000 7f3bb6391640 1 -- 172.21.15.142:0/471598257 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561c72a742c0 con 0x561c72a6b580 2024-09-22T08:36:47.169 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.154+0000 7f3bb6391640 1 -- 172.21.15.142:0/471598257 <== osd.1 v2:172.21.15.142:6816/3192108003 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f3bac051070 con 0x561c72a6b580 2024-09-22T08:36:47.169 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.154+0000 7f3bb6391640 1 -- 172.21.15.142:0/471598257 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561c72a742c0 con 0x7f3bb0057c20 2024-09-22T08:36:47.169 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.154+0000 7f3bb6b92640 1 -- 172.21.15.142:0/471598257 <== osd.2 v2:172.21.15.142:6808/279438927 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ba801b070 con 0x7f3bb0057c20 2024-09-22T08:36:47.169 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.154+0000 7f3bbb415800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:36:47.169 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.154+0000 7f3bbb415800 20 RGWRados::pool_iterate: got zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec 2024-09-22T08:36:47.170 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.154+0000 7f3bbb415800 20 RGWRados::pool_iterate: got zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f 2024-09-22T08:36:47.170 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.154+0000 7f3bbb415800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:36:47.170 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.154+0000 7f3bbb415800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:36:47.170 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.154+0000 7f3bbb415800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:36:47.170 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.154+0000 7f3bbb415800 20 rados->read ofs=0 len=0 2024-09-22T08:36:47.170 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.154+0000 7f3bbb415800 1 -- 172.21.15.142:0/471598257 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561c72a73380 con 0x561c72a6b580 2024-09-22T08:36:47.170 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.154+0000 7f3bb6391640 1 -- 172.21.15.142:0/471598257 <== osd.1 v2:172.21.15.142:6816/3192108003 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3bac051070 con 0x561c72a6b580 2024-09-22T08:36:47.170 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.154+0000 7f3bbb415800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:47.170 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.154+0000 7f3bbb415800 20 rados->read ofs=0 len=0 2024-09-22T08:36:47.170 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.154+0000 7f3bbb415800 1 -- 172.21.15.142:0/471598257 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561c72a73bd0 con 0x561c72a6b580 2024-09-22T08:36:47.170 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.155+0000 7f3bb6391640 1 -- 172.21.15.142:0/471598257 <== osd.1 v2:172.21.15.142:6816/3192108003 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3bac051070 con 0x561c72a6b580 2024-09-22T08:36:47.170 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.155+0000 7f3bbb415800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:36:47.170 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.155+0000 7f3bbb415800 20 rados->read ofs=0 len=0 2024-09-22T08:36:47.171 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.155+0000 7f3bbb415800 1 -- 172.21.15.142:0/471598257 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:40 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561c72a74740 con 0x561c72a6ff90 2024-09-22T08:36:47.171 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.155+0000 7f3bb7393640 1 -- 172.21.15.142:0/471598257 <== osd.3 v2:172.21.15.142:6800/1064901393 11 ==== osd_op_reply(40 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f3bb00083e0 con 0x561c72a6ff90 2024-09-22T08:36:47.171 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.155+0000 7f3bbb415800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:36:47.171 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.155+0000 7f3bbb415800 20 zone default found 2024-09-22T08:36:47.171 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.155+0000 7f3bbb415800 4 Realm: () 2024-09-22T08:36:47.171 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.155+0000 7f3bbb415800 4 ZoneGroup: default (d89f6f57-1007-47dd-9065-f486c7b01aec) 2024-09-22T08:36:47.171 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.155+0000 7f3bbb415800 4 Zone: default (e239248c-0bee-4e41-803a-24b288d3eb8f) 2024-09-22T08:36:47.171 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.155+0000 7f3bbb415800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:36:47.171 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.155+0000 7f3bbb415800 20 zonegroup default 2024-09-22T08:36:47.171 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.155+0000 7f3bbb415800 20 rados->read ofs=0 len=0 2024-09-22T08:36:47.171 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.155+0000 7f3bbb415800 1 -- 172.21.15.142:0/471598257 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561c72a74b20 con 0x7f3ba8027020 2024-09-22T08:36:47.171 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.155+0000 7f3bb6391640 1 -- 172.21.15.142:0/471598257 <== osd.0 v2:172.21.15.31:6800/168281188 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f3bac051070 con 0x7f3ba8027020 2024-09-22T08:36:47.171 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.155+0000 7f3bbb415800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:47.172 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.155+0000 7f3bbb415800 20 rados->read ofs=0 len=0 2024-09-22T08:36:47.172 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.155+0000 7f3bbb415800 1 -- 172.21.15.142:0/471598257 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561c72a76e00 con 0x561c72a6ff90 2024-09-22T08:36:47.172 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.155+0000 7f3bb7393640 1 -- 172.21.15.142:0/471598257 <== osd.3 v2:172.21.15.142:6800/1064901393 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3bb00083e0 con 0x561c72a6ff90 2024-09-22T08:36:47.172 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.155+0000 7f3bbb415800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:47.172 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.155+0000 7f3bbb415800 20 rados->read ofs=0 len=0 2024-09-22T08:36:47.172 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.156+0000 7f3bbb415800 1 -- 172.21.15.142:0/471598257 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561c72a76e00 con 0x561c72a6ff90 2024-09-22T08:36:47.172 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.156+0000 7f3bb7393640 1 -- 172.21.15.142:0/471598257 <== osd.3 v2:172.21.15.142:6800/1064901393 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3bb00083e0 con 0x561c72a6ff90 2024-09-22T08:36:47.172 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.156+0000 7f3bbb415800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:47.172 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.156+0000 7f3bbb415800 20 started sync module instance, tier type = 2024-09-22T08:36:47.172 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.156+0000 7f3bbb415800 20 started zone id=e239248c-0bee-4e41-803a-24b288d3eb8f (name=default) with tier type = 2024-09-22T08:36:47.172 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.156+0000 7f3bbb415800 1 -- 172.21.15.142:0/471598257 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561c72a76290 con 0x7f3bb0057c20 2024-09-22T08:36:47.172 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.157+0000 7f3bb6b92640 1 -- 172.21.15.142:0/471598257 <== osd.2 v2:172.21.15.142:6808/279438927 7 ==== osd_op_reply(44 notify.0 [create] v30'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ba801b070 con 0x7f3bb0057c20 2024-09-22T08:36:47.172 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.157+0000 7f3bbb415800 1 -- 172.21.15.142:0/471598257 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94680182646448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561c72a77230 con 0x7f3bb0057c20 2024-09-22T08:36:47.173 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.157+0000 7f3bbb415800 1 -- 172.21.15.142:0/471598257 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561c72a77a80 con 0x561c72a6b580 2024-09-22T08:36:47.173 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.158+0000 7f3bb6b92640 1 -- 172.21.15.142:0/471598257 <== osd.2 v2:172.21.15.142:6808/279438927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94680182646448] v30'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ba801b070 con 0x7f3bb0057c20 2024-09-22T08:36:47.173 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.158+0000 7f3bb6391640 1 -- 172.21.15.142:0/471598257 <== osd.1 v2:172.21.15.142:6816/3192108003 15 ==== osd_op_reply(46 notify.1 [create] v30'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3bac051070 con 0x561c72a6b580 2024-09-22T08:36:47.173 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.158+0000 7f3bbb415800 1 -- 172.21.15.142:0/471598257 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94680182650320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561c72a77ea0 con 0x561c72a6b580 2024-09-22T08:36:47.173 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.158+0000 7f3bbb415800 1 -- 172.21.15.142:0/471598257 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561c72a78730 con 0x561c72a6ff90 2024-09-22T08:36:47.183 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.159+0000 7f3bb6391640 1 -- 172.21.15.142:0/471598257 <== osd.1 v2:172.21.15.142:6816/3192108003 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94680182650320] v30'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3bac051070 con 0x561c72a6b580 2024-09-22T08:36:47.183 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.159+0000 7f3bb7393640 1 -- 172.21.15.142:0/471598257 <== osd.3 v2:172.21.15.142:6800/1064901393 14 ==== osd_op_reply(48 notify.2 [create] v30'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3bb00083e0 con 0x561c72a6ff90 2024-09-22T08:36:47.183 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.159+0000 7f3bbb415800 1 -- 172.21.15.142:0/471598257 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94680182651376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561c72a782c0 con 0x561c72a6ff90 2024-09-22T08:36:47.183 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.159+0000 7f3bbb415800 1 -- 172.21.15.142:0/471598257 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561c72a791b0 con 0x7f3bb0057c20 2024-09-22T08:36:47.183 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.160+0000 7f3bb7393640 1 -- 172.21.15.142:0/471598257 <== osd.3 v2:172.21.15.142:6800/1064901393 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94680182651376] v30'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3bb00083e0 con 0x561c72a6ff90 2024-09-22T08:36:47.183 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.160+0000 7f3bb6b92640 1 -- 172.21.15.142:0/471598257 <== osd.2 v2:172.21.15.142:6808/279438927 9 ==== osd_op_reply(50 notify.3 [create] v30'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ba801b070 con 0x7f3bb0057c20 2024-09-22T08:36:47.183 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.160+0000 7f3bbb415800 1 -- 172.21.15.142:0/471598257 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94680182652432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561c72a78230 con 0x7f3bb0057c20 2024-09-22T08:36:47.183 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.160+0000 7f3bbb415800 1 -- 172.21.15.142:0/471598257 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561c72a7a070 con 0x561c72a6b580 2024-09-22T08:36:47.183 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.161+0000 7f3bb6391640 1 -- 172.21.15.142:0/471598257 <== osd.1 v2:172.21.15.142:6816/3192108003 17 ==== osd_op_reply(52 notify.4 [create] v30'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3bac051070 con 0x561c72a6b580 2024-09-22T08:36:47.184 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.161+0000 7f3bbb415800 1 -- 172.21.15.142:0/471598257 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94680182660032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561c72a7a490 con 0x561c72a6b580 2024-09-22T08:36:47.184 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.161+0000 7f3bbb415800 1 -- 172.21.15.142:0/471598257 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561c72a7af80 con 0x7f3ba8027020 2024-09-22T08:36:47.184 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.161+0000 7f3bb6b92640 1 -- 172.21.15.142:0/471598257 <== osd.2 v2:172.21.15.142:6808/279438927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94680182652432] v30'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ba801b070 con 0x7f3bb0057c20 2024-09-22T08:36:47.184 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.162+0000 7f3bb6391640 1 -- 172.21.15.142:0/471598257 <== osd.0 v2:172.21.15.31:6800/168281188 11 ==== osd_op_reply(54 notify.5 [create] v30'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3bac051070 con 0x7f3ba8027020 2024-09-22T08:36:47.184 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.162+0000 7f3bbb415800 1 -- 172.21.15.142:0/471598257 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94680182663760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561c72a7af40 con 0x7f3ba8027020 2024-09-22T08:36:47.184 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.162+0000 7f3bbb415800 1 -- 172.21.15.142:0/471598257 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561c72a7b9a0 con 0x7f3ba8027020 2024-09-22T08:36:47.184 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.162+0000 7f3bb6391640 1 -- 172.21.15.142:0/471598257 <== osd.1 v2:172.21.15.142:6816/3192108003 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94680182660032] v30'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3bac051070 con 0x561c72a6b580 2024-09-22T08:36:47.184 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.163+0000 7f3bb6391640 1 -- 172.21.15.142:0/471598257 <== osd.0 v2:172.21.15.31:6800/168281188 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94680182663760] v30'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3bac051070 con 0x7f3ba8027020 2024-09-22T08:36:47.184 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.163+0000 7f3bb6391640 1 -- 172.21.15.142:0/471598257 <== osd.0 v2:172.21.15.31:6800/168281188 13 ==== osd_op_reply(56 notify.6 [create] v30'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3bac051070 con 0x7f3ba8027020 2024-09-22T08:36:47.184 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.163+0000 7f3bbb415800 1 -- 172.21.15.142:0/471598257 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94680182658464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561c72a7b4b0 con 0x7f3ba8027020 2024-09-22T08:36:47.184 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.163+0000 7f3bbb415800 1 -- 172.21.15.142:0/471598257 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561c72a7be70 con 0x7f3ba8027020 2024-09-22T08:36:47.185 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.164+0000 7f3bb6391640 1 -- 172.21.15.142:0/471598257 <== osd.0 v2:172.21.15.31:6800/168281188 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94680182658464] v30'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3bac051070 con 0x7f3ba8027020 2024-09-22T08:36:47.185 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.164+0000 7f3bb6391640 1 -- 172.21.15.142:0/471598257 <== osd.0 v2:172.21.15.31:6800/168281188 15 ==== osd_op_reply(58 notify.7 [create] v30'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3bac051070 con 0x7f3ba8027020 2024-09-22T08:36:47.185 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.164+0000 7f3bbb415800 1 -- 172.21.15.142:0/471598257 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94680182661088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561c72a7be70 con 0x7f3ba8027020 2024-09-22T08:36:47.185 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.164+0000 7f3bbb415800 20 add_watcher() i=0 2024-09-22T08:36:47.185 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.164+0000 7f3bbb415800 20 add_watcher() i=1 2024-09-22T08:36:47.185 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.164+0000 7f3bbb415800 20 add_watcher() i=2 2024-09-22T08:36:47.185 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.164+0000 7f3bbb415800 20 add_watcher() i=3 2024-09-22T08:36:47.185 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.164+0000 7f3bbb415800 20 add_watcher() i=4 2024-09-22T08:36:47.185 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.164+0000 7f3bbb415800 20 add_watcher() i=5 2024-09-22T08:36:47.185 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.164+0000 7f3bbb415800 20 add_watcher() i=6 2024-09-22T08:36:47.185 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.165+0000 7f3bb6391640 1 -- 172.21.15.142:0/471598257 <== osd.0 v2:172.21.15.31:6800/168281188 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94680182661088] v30'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3bac051070 con 0x7f3ba8027020 2024-09-22T08:36:47.185 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.165+0000 7f3bbb415800 20 add_watcher() i=7 2024-09-22T08:36:47.185 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.165+0000 7f3bbb415800 2 all 8 watchers are set, enabling cache 2024-09-22T08:36:47.186 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.165+0000 7f3bbb415800 1 -- 172.21.15.142:0/471598257 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561c72a7f390 con 0x561c72a6b580 2024-09-22T08:36:47.186 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.165+0000 7f3bb6391640 1 -- 172.21.15.142:0/471598257 <== osd.1 v2:172.21.15.142:6816/3192108003 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f3bac051070 con 0x561c72a6b580 2024-09-22T08:36:47.186 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.165+0000 7f3bbb415800 1 -- 172.21.15.142:0/471598257 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94680182668640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561c72a7c720 con 0x561c72a6b580 2024-09-22T08:36:47.186 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.166+0000 7f3bb6391640 1 -- 172.21.15.142:0/471598257 <== osd.1 v2:172.21.15.142:6816/3192108003 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94680182668640] v30'117 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3bac051070 con 0x561c72a6b580 2024-09-22T08:36:47.186 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.166+0000 7f3a6d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:36:47.186 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.167+0000 7f3bbb415800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:36:47.186 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.167+0000 7f3bbb415800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:36:47.186 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.167+0000 7f3bbb415800 5 note: GC not initialized 2024-09-22T08:36:47.186 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.167+0000 7f39e7fff640 20 reqs_thread_entry: start 2024-09-22T08:36:47.186 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.167+0000 7f3bbb415800 20 init_complete bucket index max shards: 11 2024-09-22T08:36:47.186 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.167+0000 7f3bbb415800 20 Filter name: none 2024-09-22T08:36:47.186 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.167+0000 7f39e5ffb640 20 reqs_thread_entry: start 2024-09-22T08:36:47.186 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.167+0000 7f3bbb415800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-22T08:36:47.187 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.167+0000 7f3bbb415800 20 rados->read ofs=0 len=0 2024-09-22T08:36:47.187 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.167+0000 7f3bbb415800 1 -- 172.21.15.142:0/471598257 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561c72ab26d0 con 0x7f3ba8027020 2024-09-22T08:36:47.187 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.168+0000 7f3bb6391640 1 -- 172.21.15.142:0/471598257 <== osd.0 v2:172.21.15.31:6800/168281188 17 ==== osd_op_reply(62 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f3bac051070 con 0x7f3ba8027020 2024-09-22T08:36:47.187 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.168+0000 7f3bbb415800 20 rados_obj.operate() r=0 bl.length=380 2024-09-22T08:36:47.187 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.168+0000 7f3bbb415800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-09-22T08:36:47.187 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.168+0000 7f3bbb415800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-22T08:36:47.187 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.168+0000 7f3bbb415800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:36:47.187 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.168+0000 7f3bbb415800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-22T08:36:47.187 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.168+0000 7f3bbb415800 20 rados->read ofs=0 len=0 2024-09-22T08:36:47.187 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.168+0000 7f3bbb415800 1 -- 172.21.15.142:0/471598257 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561c72ab47c0 con 0x7f3bb0057c20 2024-09-22T08:36:47.187 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.168+0000 7f3bb6b92640 1 -- 172.21.15.142:0/471598257 <== osd.2 v2:172.21.15.142:6808/279438927 11 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv20 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f3ba801b070 con 0x7f3bb0057c20 2024-09-22T08:36:47.187 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.168+0000 7f3bbb415800 20 rados_obj.operate() r=0 bl.length=165 2024-09-22T08:36:47.187 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.168+0000 7f3bbb415800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-22T08:36:47.187 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.168+0000 7f3bbb415800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-22T08:36:47.188 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.168+0000 7f3bbb415800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1 : miss 2024-09-22T08:36:47.188 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.168+0000 7f3bbb415800 20 rados->read ofs=0 len=0 2024-09-22T08:36:47.188 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.168+0000 7f3bbb415800 1 -- 172.21.15.142:0/471598257 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:64 8.15 8:ab67ca09:root::.bucket.meta.myfoo%3ae239248c-0bee-4e41-803a-24b288d3eb8f.4226.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561c72ab6280 con 0x561c72a6ff90 2024-09-22T08:36:47.188 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.169+0000 7f3bb7393640 1 -- 172.21.15.142:0/471598257 <== osd.3 v2:172.21.15.142:6800/1064901393 16 ==== osd_op_reply(64 .bucket.meta.myfoo:e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv4 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7f3bb00083e0 con 0x561c72a6ff90 2024-09-22T08:36:47.188 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.169+0000 7f3bbb415800 20 rados_obj.operate() r=0 bl.length=387 2024-09-22T08:36:47.188 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.169+0000 7f3bbb415800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1 info.flags=0x17 2024-09-22T08:36:47.188 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.169+0000 7f3bbb415800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1 to cache LRU end 2024-09-22T08:36:47.188 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.169+0000 7f3bbb415800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:36:47.188 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.169+0000 7f3bbb415800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-22T08:36:47.188 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.169+0000 7f3bbb415800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1 2024-09-22T08:36:47.188 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.169+0000 7f3bbb415800 10 cache get: name=default.rgw.meta+users.uid+fud : hit (requested=0x13, cached=0x13) 2024-09-22T08:36:47.188 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.169+0000 7f3bbb415800 1 -- 172.21.15.142:0/471598257 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:65 8.1 8:810902b1:users.uid::fud.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561c72ab94c0 con 0x7f3ba8027020 2024-09-22T08:36:47.188 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.170+0000 7f3bb6391640 1 -- 172.21.15.142:0/471598257 <== osd.0 v2:172.21.15.31:6800/168281188 18 ==== osd_op_reply(65 fud.buckets [call] v30'2 uv2 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f3bac080040 con 0x7f3ba8027020 2024-09-22T08:36:47.188 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.170+0000 7f3bbb415800 10 cache get: name=default.rgw.meta+root+myfoo : type miss (requested=0x13, cached=0x11) 2024-09-22T08:36:47.189 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.170+0000 7f3bbb415800 20 rados->read ofs=0 len=0 2024-09-22T08:36:47.189 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.170+0000 7f3bbb415800 1 -- 172.21.15.142:0/471598257 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:66 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561c72ab8470 con 0x7f3bb0057c20 2024-09-22T08:36:47.189 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.170+0000 7f3bb6b92640 1 -- 172.21.15.142:0/471598257 <== osd.2 v2:172.21.15.142:6808/279438927 12 ==== osd_op_reply(66 myfoo [call out=48b,read 0~165 out=165b,getxattrs out=75b] v0'0 uv20 ondisk = 0) ==== 233+0+288 (crc 0 0 0) 0x7f3ba801b070 con 0x7f3bb0057c20 2024-09-22T08:36:47.189 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.170+0000 7f3bbb415800 20 rados_obj.operate() r=0 bl.length=165 2024-09-22T08:36:47.189 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.170+0000 7f3bbb415800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x13 2024-09-22T08:36:47.189 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.170+0000 7f3bbb415800 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-22T08:36:47.189 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.170+0000 7f3bbb415800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:36:47.189 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.171+0000 7f3bbb415800 1 -- 172.21.15.142:0/471598257 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:67 8.9 8:91b71841:root::myfoo:head [delete,create,call version.check_conds in=122b,call version.inc in=38b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561c72ab8e60 con 0x7f3bb0057c20 2024-09-22T08:36:47.189 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.172+0000 7f3bb6b92640 1 -- 172.21.15.142:0/471598257 <== osd.2 v2:172.21.15.142:6808/279438927 13 ==== osd_op_reply(67 myfoo [delete,create,call,call,writefull 0~165] v30'21 uv21 ondisk = 0) ==== 317+0+0 (crc 0 0 0) 0x7f3ba801b070 con 0x7f3bb0057c20 2024-09-22T08:36:47.189 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.172+0000 7f3bbb415800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-09-22T08:36:47.189 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.172+0000 7f3bbb415800 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-22T08:36:47.189 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.172+0000 7f3bbb415800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-22T08:36:47.189 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.172+0000 7f3bbb415800 1 -- 172.21.15.142:0/471598257 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:68 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94680182917552 in=350b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561c72ab8e50 con 0x7f3ba8027020 2024-09-22T08:36:47.190 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.172+0000 7f3bb6391640 1 -- 172.21.15.142:0/471598257 <== osd.0 v2:172.21.15.31:6800/168281188 19 ==== watch-notify(notify (1) cookie 94680182658464 notify 128849018890 ret 0) ==== 380+0+0 (crc 0 0 0) 0x561c72941550 con 0x7f3ba8027020 2024-09-22T08:36:47.190 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.172+0000 7f3a9a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018890 cookie 94680182658464 notifier 4513 bl.length()=338 2024-09-22T08:36:47.190 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.172+0000 7f3a9a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-09-22T08:36:47.190 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.172+0000 7f3a9a7fc640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-22T08:36:47.190 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.172+0000 7f3bb6391640 1 -- 172.21.15.142:0/471598257 <== osd.0 v2:172.21.15.31:6800/168281188 20 ==== osd_op_reply(68 notify.6 [notify cookie 94680182917552 out=8b] v0'0 uv120 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f3bac080040 con 0x7f3ba8027020 2024-09-22T08:36:47.190 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.172+0000 7f3a9a7fc640 1 -- 172.21.15.142:0/471598257 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:69 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f3a7c003ea0 con 0x7f3ba8027020 2024-09-22T08:36:47.190 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.172+0000 7f3bb6391640 1 -- 172.21.15.142:0/471598257 <== osd.0 v2:172.21.15.31:6800/168281188 21 ==== osd_op_reply(69 notify.6 [notify-ack] v0'0 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3bac080040 con 0x7f3ba8027020 2024-09-22T08:36:47.190 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.173+0000 7f3bb6391640 1 -- 172.21.15.142:0/471598257 <== osd.0 v2:172.21.15.31:6800/168281188 22 ==== watch-notify(notify_complete (2) cookie 94680182917552 notify 128849018890 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f3bac05fb50 con 0x7f3ba8027020 2024-09-22T08:36:47.190 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.173+0000 7f3a6d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:36:47.190 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.173+0000 7f3bbb415800 1 -- 172.21.15.142:0/471598257 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94680182668640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561c72ab0430 con 0x561c72a6b580 2024-09-22T08:36:47.190 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.174+0000 7f3bb6391640 1 -- 172.21.15.142:0/471598257 <== osd.1 v2:172.21.15.142:6816/3192108003 21 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94680182668640] v30'118 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3bac080040 con 0x561c72a6b580 2024-09-22T08:36:47.190 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.174+0000 7f3bbb415800 1 -- 172.21.15.142:0/471598257 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94680182646448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561c72ab0430 con 0x7f3bb0057c20 2024-09-22T08:36:47.190 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.175+0000 7f3bb6b92640 1 -- 172.21.15.142:0/471598257 <== osd.2 v2:172.21.15.142:6808/279438927 14 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94680182646448] v30'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ba801b070 con 0x7f3bb0057c20 2024-09-22T08:36:47.191 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.175+0000 7f3bbb415800 20 remove_watcher() i=0 2024-09-22T08:36:47.191 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.175+0000 7f3bbb415800 2 removed watcher, disabling cache 2024-09-22T08:36:47.191 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.175+0000 7f3bbb415800 1 -- 172.21.15.142:0/471598257 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94680182650320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561c72ab0430 con 0x561c72a6b580 2024-09-22T08:36:47.191 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.176+0000 7f3bb6391640 1 -- 172.21.15.142:0/471598257 <== osd.1 v2:172.21.15.142:6816/3192108003 22 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94680182650320] v30'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3bac080040 con 0x561c72a6b580 2024-09-22T08:36:47.191 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.176+0000 7f3bbb415800 20 remove_watcher() i=1 2024-09-22T08:36:47.191 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.176+0000 7f3bbb415800 1 -- 172.21.15.142:0/471598257 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94680182651376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561c72ab0430 con 0x561c72a6ff90 2024-09-22T08:36:47.191 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.177+0000 7f3bb7393640 1 -- 172.21.15.142:0/471598257 <== osd.3 v2:172.21.15.142:6800/1064901393 17 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94680182651376] v30'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3bb00083e0 con 0x561c72a6ff90 2024-09-22T08:36:47.191 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.177+0000 7f3bbb415800 20 remove_watcher() i=2 2024-09-22T08:36:47.191 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.177+0000 7f3bbb415800 1 -- 172.21.15.142:0/471598257 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94680182652432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561c72ab0430 con 0x7f3bb0057c20 2024-09-22T08:36:47.191 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.178+0000 7f3bb6b92640 1 -- 172.21.15.142:0/471598257 <== osd.2 v2:172.21.15.142:6808/279438927 15 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94680182652432] v30'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ba801b070 con 0x7f3bb0057c20 2024-09-22T08:36:47.191 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.178+0000 7f3bbb415800 20 remove_watcher() i=3 2024-09-22T08:36:47.191 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.178+0000 7f3bbb415800 1 -- 172.21.15.142:0/471598257 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94680182660032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561c72ab0430 con 0x561c72a6b580 2024-09-22T08:36:47.191 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.179+0000 7f3bb6391640 1 -- 172.21.15.142:0/471598257 <== osd.1 v2:172.21.15.142:6816/3192108003 23 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94680182660032] v30'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3bac080040 con 0x561c72a6b580 2024-09-22T08:36:47.192 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.179+0000 7f3bbb415800 20 remove_watcher() i=4 2024-09-22T08:36:47.192 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.179+0000 7f3bbb415800 1 -- 172.21.15.142:0/471598257 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94680182663760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561c72ab0430 con 0x7f3ba8027020 2024-09-22T08:36:47.192 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.181+0000 7f3bb6391640 1 -- 172.21.15.142:0/471598257 <== osd.0 v2:172.21.15.31:6800/168281188 23 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94680182663760] v30'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3bac080040 con 0x7f3ba8027020 2024-09-22T08:36:47.192 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.181+0000 7f3bbb415800 20 remove_watcher() i=5 2024-09-22T08:36:47.192 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.181+0000 7f3bbb415800 1 -- 172.21.15.142:0/471598257 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94680182658464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561c72ab0430 con 0x7f3ba8027020 2024-09-22T08:36:47.192 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.181+0000 7f3bb6391640 1 -- 172.21.15.142:0/471598257 <== osd.0 v2:172.21.15.31:6800/168281188 24 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94680182658464] v30'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3bac080040 con 0x7f3ba8027020 2024-09-22T08:36:47.192 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.181+0000 7f3bbb415800 20 remove_watcher() i=6 2024-09-22T08:36:47.192 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.181+0000 7f3bbb415800 1 -- 172.21.15.142:0/471598257 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94680182661088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561c72ab0430 con 0x7f3ba8027020 2024-09-22T08:36:47.197 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.182+0000 7f3bb6391640 1 -- 172.21.15.142:0/471598257 <== osd.0 v2:172.21.15.31:6800/168281188 25 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94680182661088] v30'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3bac080040 con 0x7f3ba8027020 2024-09-22T08:36:47.197 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.182+0000 7f3bbb415800 20 remove_watcher() i=7 2024-09-22T08:36:47.197 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.183+0000 7f3bbb415800 1 -- 172.21.15.142:0/471598257 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f3ba8027020 msgr2=0x7f3ba801e3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:47.198 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.183+0000 7f3bbb415800 1 --2- 172.21.15.142:0/471598257 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f3ba8027020 0x7f3ba801e3f0 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:47.198 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.183+0000 7f3bbb415800 1 -- 172.21.15.142:0/471598257 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x561c72a6b580 msgr2=0x561c72a6da40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:47.198 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.183+0000 7f3bbb415800 1 --2- 172.21.15.142:0/471598257 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x561c72a6b580 0x561c72a6da40 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:47.198 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.183+0000 7f3bbb415800 1 -- 172.21.15.142:0/471598257 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f3bb0057c20 msgr2=0x7f3bb0041800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:47.198 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.183+0000 7f3bbb415800 1 --2- 172.21.15.142:0/471598257 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f3bb0057c20 0x7f3bb0041800 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:47.198 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.183+0000 7f3bbb415800 1 -- 172.21.15.142:0/471598257 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x561c72a6ff90 msgr2=0x561c72a72380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:47.198 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.183+0000 7f3bbb415800 1 --2- 172.21.15.142:0/471598257 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x561c72a6ff90 0x561c72a72380 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:47.198 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.183+0000 7f3bbb415800 1 -- 172.21.15.142:0/471598257 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f3a8003cfb0 msgr2=0x7f3a8003f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:47.199 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.183+0000 7f3bbb415800 1 --2- 172.21.15.142:0/471598257 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f3a8003cfb0 0x7f3a8003f470 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f3ba8006530 tx=0x7f3ba801df90 comp rx=0 tx=0).stop 2024-09-22T08:36:47.199 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.183+0000 7f3bbb415800 1 -- 172.21.15.142:0/471598257 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561c72a58640 msgr2=0x561c72a5fc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:47.199 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.183+0000 7f3bbb415800 1 --2- 172.21.15.142:0/471598257 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561c72a58640 0x561c72a5fc50 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f3bb00206f0 tx=0x7f3bb0053d50 comp rx=0 tx=0).stop 2024-09-22T08:36:47.199 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.183+0000 7f3bb6391640 1 -- 172.21.15.142:0/471598257 reap_dead start 2024-09-22T08:36:47.199 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.183+0000 7f3bb6391640 1 -- 172.21.15.142:0/471598257 reap_dead start 2024-09-22T08:36:47.199 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.183+0000 7f3bbb415800 1 -- 172.21.15.142:0/471598257 shutdown_connections 2024-09-22T08:36:47.199 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.183+0000 7f3bbb415800 1 -- 172.21.15.142:0/471598257 >> 172.21.15.142:0/471598257 conn(0x561c72a54a40 msgr2=0x561c72a52c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:47.199 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.183+0000 7f3bbb415800 1 -- 172.21.15.142:0/471598257 shutdown_connections 2024-09-22T08:36:47.200 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.183+0000 7f3bbb415800 1 -- 172.21.15.142:0/471598257 wait complete. 2024-09-22T08:36:47.200 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.183+0000 7f3bbb415800 1 -- 172.21.15.142:0/3423207874 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f3a9003cfb0 msgr2=0x7f3a9003f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:47.200 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.183+0000 7f3bbb415800 1 --2- 172.21.15.142:0/3423207874 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f3a9003cfb0 0x7f3a9003f470 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f3ba8052b50 tx=0x7f3ba8011f40 comp rx=0 tx=0).stop 2024-09-22T08:36:47.200 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.183+0000 7f3bbb415800 1 -- 172.21.15.142:0/3423207874 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561c72a4bbe0 msgr2=0x561c72a4c000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:47.200 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.183+0000 7f3bbb415800 1 --2- 172.21.15.142:0/3423207874 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561c72a4bbe0 0x561c72a4c000 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x561c72a31ba0 tx=0x7f3bb000bf30 comp rx=0 tx=0).stop 2024-09-22T08:36:47.200 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.183+0000 7f3bbb415800 1 -- 172.21.15.142:0/3423207874 shutdown_connections 2024-09-22T08:36:47.200 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.183+0000 7f3bbb415800 1 --2- 172.21.15.142:0/3423207874 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f3a9003cfb0 0x7f3a9003f470 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:47.200 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.183+0000 7f3bbb415800 1 --2- 172.21.15.142:0/3423207874 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561c72a4bbe0 0x561c72a4c000 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:47.201 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.183+0000 7f3bbb415800 1 -- 172.21.15.142:0/3423207874 >> 172.21.15.142:0/3423207874 conn(0x561c72a3ff90 msgr2=0x561c72a40370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:47.201 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.183+0000 7f3bbb415800 1 -- 172.21.15.142:0/3423207874 shutdown_connections 2024-09-22T08:36:47.201 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.183+0000 7f3bbb415800 1 -- 172.21.15.142:0/3423207874 wait complete. 2024-09-22T08:36:47.201 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.184+0000 7f3bbb415800 1 -- 172.21.15.142:0/2405726590 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x561c7293db80 msgr2=0x561c72a381f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:47.201 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.184+0000 7f3bbb415800 1 --2- 172.21.15.142:0/2405726590 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x561c7293db80 0x561c72a381f0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:47.201 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.184+0000 7f3bbb415800 1 -- 172.21.15.142:0/2405726590 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x561c72a3a5d0 msgr2=0x561c72a3ca50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:47.201 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.184+0000 7f3bbb415800 1 --2- 172.21.15.142:0/2405726590 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x561c72a3a5d0 0x561c72a3ca50 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:47.201 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.184+0000 7f3bbb415800 1 -- 172.21.15.142:0/2405726590 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f3a9c03d000 msgr2=0x7f3a9c03f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:47.202 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.184+0000 7f3bbb415800 1 --2- 172.21.15.142:0/2405726590 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f3a9c03d000 0x7f3a9c03f4c0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f3bac057000 tx=0x7f3bac052000 comp rx=0 tx=0).stop 2024-09-22T08:36:47.202 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.184+0000 7f3bbb415800 1 -- 172.21.15.142:0/2405726590 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561c7293a070 msgr2=0x561c72a30ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:47.202 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.184+0000 7f3bbb415800 1 --2- 172.21.15.142:0/2405726590 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561c7293a070 0x561c72a30ba0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f3ba8000f80 tx=0x7f3ba8001250 comp rx=0 tx=0).stop 2024-09-22T08:36:47.202 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.184+0000 7f3bbb415800 1 -- 172.21.15.142:0/2405726590 shutdown_connections 2024-09-22T08:36:47.202 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.184+0000 7f3bbb415800 1 --2- 172.21.15.142:0/2405726590 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x561c72a3a5d0 0x561c72a3ca50 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:47.202 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.184+0000 7f3bbb415800 1 --2- 172.21.15.142:0/2405726590 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x561c7293db80 0x561c72a381f0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:47.202 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.184+0000 7f3bbb415800 1 --2- 172.21.15.142:0/2405726590 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f3a9c03d000 0x7f3a9c03f4c0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:47.202 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.184+0000 7f3bbb415800 1 --2- 172.21.15.142:0/2405726590 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561c7293a070 0x561c72a30ba0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:47.203 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.184+0000 7f3bbb415800 1 -- 172.21.15.142:0/2405726590 >> 172.21.15.142:0/2405726590 conn(0x561c72933bb0 msgr2=0x561c72a2a520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:47.203 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.184+0000 7f3bbb415800 1 -- 172.21.15.142:0/2405726590 shutdown_connections 2024-09-22T08:36:47.203 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.184+0000 7f3bbb415800 1 -- 172.21.15.142:0/2405726590 wait complete. 2024-09-22T08:36:47.203 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--uid', 'foo', '--bucket', 'myfoo', '--bucket-id', 'e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1'] 2024-09-22T08:36:47.203 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--uid', 'foo', '--bucket', 'myfoo', '--bucket-id', 'e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1'] 2024-09-22T08:36:47.204 DEBUG:teuthology.orchestra.run.smithi142:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --uid foo --bucket myfoo --bucket-id e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1 2024-09-22T08:36:47.252 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:36:47.252 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:36:47.254 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.252+0000 7fc8f3f23800 1 Processor -- start 2024-09-22T08:36:47.254 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.252+0000 7fc8f3f23800 1 -- start start 2024-09-22T08:36:47.254 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.252+0000 7fc8f3f23800 1 --2- >> v2:172.21.15.31:3300/0 conn(0x56327db97c00 0x56327db98000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:47.254 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.252+0000 7fc8f3f23800 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56327da24a20 con 0x56327db9c870 2024-09-22T08:36:47.254 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.252+0000 7fc8f3f23800 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x56327da247d0 con 0x56327db97c00 2024-09-22T08:36:47.254 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.252+0000 7fc8efc44640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x56327db97c00 0x56327db98000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:47.254 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.252+0000 7fc8ef443640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x56327db9c870 0x56327db9ece0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.142:42598/0 (socket says 172.21.15.142:42598) 2024-09-22T08:36:47.254 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.252+0000 7fc8ef443640 1 -- 172.21.15.142:0/2598475893 learned_addr learned my addr 172.21.15.142:0/2598475893 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-09-22T08:36:47.254 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.253+0000 7fc8efc44640 1 -- 172.21.15.142:0/2598475893 >> v1:172.21.15.31:6789/0 conn(0x56327db9c870 legacy=0x56327db9ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:47.254 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.253+0000 7fc8efc44640 1 -- 172.21.15.142:0/2598475893 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56327dba15a0 con 0x56327db97c00 2024-09-22T08:36:47.256 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.255+0000 7fc8efc44640 1 --2- 172.21.15.142:0/2598475893 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56327db97c00 0x56327db98000 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fc8e000a470 tx=0x7fc8e0045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46efc41232a53290 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:47.256 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.255+0000 7fc8eec42640 1 -- 172.21.15.142:0/2598475893 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc8e0053570 con 0x56327db97c00 2024-09-22T08:36:47.257 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.255+0000 7fc8eec42640 1 -- 172.21.15.142:0/2598475893 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8e0058070 con 0x56327db97c00 2024-09-22T08:36:47.257 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.255+0000 7fc8eec42640 1 -- 172.21.15.142:0/2598475893 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc8e0053880 con 0x56327db97c00 2024-09-22T08:36:47.257 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.255+0000 7fc8f3f23800 1 -- 172.21.15.142:0/2598475893 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56327db97c00 msgr2=0x56327db98000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:47.257 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.255+0000 7fc8f3f23800 1 --2- 172.21.15.142:0/2598475893 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56327db97c00 0x56327db98000 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fc8e000a470 tx=0x7fc8e0045a20 comp rx=0 tx=0).stop 2024-09-22T08:36:47.257 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.255+0000 7fc8f3f23800 1 -- 172.21.15.142:0/2598475893 shutdown_connections 2024-09-22T08:36:47.257 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.255+0000 7fc8f3f23800 1 --2- 172.21.15.142:0/2598475893 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56327db97c00 0x56327db98000 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:47.257 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.255+0000 7fc8f3f23800 1 -- 172.21.15.142:0/2598475893 >> 172.21.15.142:0/2598475893 conn(0x56327db93330 msgr2=0x56327db957b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:47.257 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.255+0000 7fc8f3f23800 1 -- 172.21.15.142:0/2598475893 shutdown_connections 2024-09-22T08:36:47.257 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.255+0000 7fc8f3f23800 1 -- 172.21.15.142:0/2598475893 wait complete. 2024-09-22T08:36:47.271 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.269+0000 7fc8f3f23800 1 Processor -- start 2024-09-22T08:36:47.271 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.269+0000 7fc8f3f23800 1 -- start start 2024-09-22T08:36:47.271 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.269+0000 7fc8f3f23800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56327db97c00 0x56327dc89120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:47.271 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.269+0000 7fc8f3f23800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x56327da31dd0 con 0x56327db97c00 2024-09-22T08:36:47.271 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.270+0000 7fc8efc44640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56327db97c00 0x56327dc89120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:47.271 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.270+0000 7fc8efc44640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56327db97c00 0x56327dc89120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:39682/0 (socket says 172.21.15.142:39682) 2024-09-22T08:36:47.271 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.270+0000 7fc8efc44640 1 -- 172.21.15.142:0/3892657187 learned_addr learned my addr 172.21.15.142:0/3892657187 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:47.271 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.270+0000 7fc8efc44640 1 -- 172.21.15.142:0/3892657187 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56327dc89710 con 0x56327db97c00 2024-09-22T08:36:47.273 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.270+0000 7fc8efc44640 1 --2- 172.21.15.142:0/3892657187 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56327db97c00 0x56327dc89120 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fc8e0025c20 tx=0x7fc8e0051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f04a76f9906bd93c server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:47.273 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.270+0000 7fc7dde0b640 1 -- 172.21.15.142:0/3892657187 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc8e0053a20 con 0x56327db97c00 2024-09-22T08:36:47.273 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.270+0000 7fc7dde0b640 1 -- 172.21.15.142:0/3892657187 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8e0063070 con 0x56327db97c00 2024-09-22T08:36:47.273 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.270+0000 7fc7dde0b640 1 -- 172.21.15.142:0/3892657187 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc8e0053cf0 con 0x56327db97c00 2024-09-22T08:36:47.273 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.271+0000 7fc8f3f23800 1 -- 172.21.15.142:0/3892657187 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56327db97c00 msgr2=0x56327dc89120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:47.273 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.271+0000 7fc8f3f23800 1 --2- 172.21.15.142:0/3892657187 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56327db97c00 0x56327dc89120 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fc8e0025c20 tx=0x7fc8e0051000 comp rx=0 tx=0).stop 2024-09-22T08:36:47.274 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.271+0000 7fc8f3f23800 1 -- 172.21.15.142:0/3892657187 shutdown_connections 2024-09-22T08:36:47.274 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.271+0000 7fc8f3f23800 1 --2- 172.21.15.142:0/3892657187 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56327db97c00 0x56327dc89120 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:47.274 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.271+0000 7fc8f3f23800 1 -- 172.21.15.142:0/3892657187 >> 172.21.15.142:0/3892657187 conn(0x56327db93330 msgr2=0x56327dc84aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:47.274 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.271+0000 7fc8f3f23800 1 -- 172.21.15.142:0/3892657187 shutdown_connections 2024-09-22T08:36:47.274 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.271+0000 7fc8f3f23800 1 -- 172.21.15.142:0/3892657187 wait complete. 2024-09-22T08:36:47.274 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.271+0000 7fc8f3f23800 1 Processor -- start 2024-09-22T08:36:47.274 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.271+0000 7fc8f3f23800 1 -- start start 2024-09-22T08:36:47.274 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.272+0000 7fc8f3f23800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56327db97c00 0x56327dc90bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:47.274 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.272+0000 7fc8f3f23800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x56327dba0840 con 0x56327db97c00 2024-09-22T08:36:47.274 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.272+0000 7fc8efc44640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56327db97c00 0x56327dc90bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:47.274 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.272+0000 7fc8efc44640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56327db97c00 0x56327dc90bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:39688/0 (socket says 172.21.15.142:39688) 2024-09-22T08:36:47.274 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.272+0000 7fc8efc44640 1 -- 172.21.15.142:0/4103160168 learned_addr learned my addr 172.21.15.142:0/4103160168 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:47.274 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.272+0000 7fc8efc44640 1 -- 172.21.15.142:0/4103160168 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56327dc91130 con 0x56327db97c00 2024-09-22T08:36:47.277 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.272+0000 7fc8efc44640 1 --2- 172.21.15.142:0/4103160168 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56327db97c00 0x56327dc90bd0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fc8e0025c20 tx=0x7fc8e0002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:47.277 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.273+0000 7fc7d7fff640 1 -- 172.21.15.142:0/4103160168 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc8e0068660 con 0x56327db97c00 2024-09-22T08:36:47.278 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.273+0000 7fc7d7fff640 1 -- 172.21.15.142:0/4103160168 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8e0068800 con 0x56327db97c00 2024-09-22T08:36:47.278 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.273+0000 7fc7d7fff640 1 -- 172.21.15.142:0/4103160168 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc8e0068ae0 con 0x56327db97c00 2024-09-22T08:36:47.278 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.273+0000 7fc8f3f23800 1 -- 172.21.15.142:0/4103160168 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56327dc913c0 con 0x56327db97c00 2024-09-22T08:36:47.278 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.273+0000 7fc8f3f23800 1 -- 172.21.15.142:0/4103160168 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56327dc91fd0 con 0x56327db97c00 2024-09-22T08:36:47.278 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.273+0000 7fc7d7fff640 1 -- 172.21.15.142:0/4103160168 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fc8e0068c80 con 0x56327db97c00 2024-09-22T08:36:47.278 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.274+0000 7fc7d7fff640 1 --2- 172.21.15.142:0/4103160168 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fc7d803d000 0x7fc7d803f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:47.278 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.274+0000 7fc7d7fff640 1 -- 172.21.15.142:0/4103160168 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fc8e0098c30 con 0x56327db97c00 2024-09-22T08:36:47.278 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.274+0000 7fc8ef443640 1 --2- 172.21.15.142:0/4103160168 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fc7d803d000 0x7fc7d803f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:47.278 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.274+0000 7fc8f3f23800 1 --2- 172.21.15.142:0/4103160168 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x56327db9c870 0x56327dc98220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:47.279 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.274+0000 7fc8f3f23800 1 -- 172.21.15.142:0/4103160168 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56327dc98760 con 0x56327db9c870 2024-09-22T08:36:47.279 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.274+0000 7fc8f0445640 1 --2- 172.21.15.142:0/4103160168 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x56327db9c870 0x56327dc98220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:47.279 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.274+0000 7fc8ef443640 1 --2- 172.21.15.142:0/4103160168 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fc7d803d000 0x7fc7d803f4c0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fc8e4001d70 tx=0x7fc8e40012d0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:47.279 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.274+0000 7fc8f0445640 1 --2- 172.21.15.142:0/4103160168 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x56327db9c870 0x56327dc98220 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:47.279 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.274+0000 7fc8f0445640 1 -- 172.21.15.142:0/4103160168 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc8e800a4d0 con 0x56327db9c870 2024-09-22T08:36:47.279 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.275+0000 7fc8f3f23800 1 -- 172.21.15.142:0/4103160168 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56327dc98b00 con 0x56327db9c870 2024-09-22T08:36:47.279 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.275+0000 7fc8f0445640 1 -- 172.21.15.142:0/4103160168 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc8e800a4d0 con 0x56327db9c870 2024-09-22T08:36:47.279 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.275+0000 7fc8f3f23800 1 --2- 172.21.15.142:0/4103160168 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x56327dc9a580 0x56327dc9c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:47.279 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.275+0000 7fc8f3f23800 1 -- 172.21.15.142:0/4103160168 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:3 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56327dc9d180 con 0x56327dc9a580 2024-09-22T08:36:47.279 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.275+0000 7fc8efc44640 1 --2- 172.21.15.142:0/4103160168 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x56327dc9a580 0x56327dc9c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:47.279 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.275+0000 7fc8efc44640 1 --2- 172.21.15.142:0/4103160168 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x56327dc9a580 0x56327dc9c9f0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:47.279 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.275+0000 7fc8efc44640 1 -- 172.21.15.142:0/4103160168 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(3 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fc8e0051070 con 0x56327dc9a580 2024-09-22T08:36:47.279 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.275+0000 7fc8f3f23800 1 -- 172.21.15.142:0/4103160168 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56327dc99350 con 0x56327db9c870 2024-09-22T08:36:47.280 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.276+0000 7fc8f0445640 1 -- 172.21.15.142:0/4103160168 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc8e800a4d0 con 0x56327db9c870 2024-09-22T08:36:47.280 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.276+0000 7fc8f3f23800 1 -- 172.21.15.142:0/4103160168 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56327dc99730 con 0x56327dc9a580 2024-09-22T08:36:47.280 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.276+0000 7fc8efc44640 1 -- 172.21.15.142:0/4103160168 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(5 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fc8e0051070 con 0x56327dc9a580 2024-09-22T08:36:47.280 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.276+0000 7fc8f3f23800 1 Processor -- start 2024-09-22T08:36:47.280 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.276+0000 7fc8f3f23800 1 -- start start 2024-09-22T08:36:47.280 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.277+0000 7fc8f3f23800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56327dcabb30 0x56327dcabf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:47.280 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.277+0000 7fc8f3f23800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x56327da90d50 con 0x56327dcabb30 2024-09-22T08:36:47.288 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.277+0000 7fc8f0445640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56327dcabb30 0x56327dcabf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:47.288 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.277+0000 7fc8f0445640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56327dcabb30 0x56327dcabf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:39696/0 (socket says 172.21.15.142:39696) 2024-09-22T08:36:47.288 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.277+0000 7fc8f0445640 1 -- 172.21.15.142:0/3633977841 learned_addr learned my addr 172.21.15.142:0/3633977841 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:47.288 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.277+0000 7fc8f0445640 1 -- 172.21.15.142:0/3633977841 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56327dcac590 con 0x56327dcabb30 2024-09-22T08:36:47.288 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.277+0000 7fc8f0445640 1 --2- 172.21.15.142:0/3633977841 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56327dcabb30 0x56327dcabf50 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x56327dc91bd0 tx=0x7fc8e80167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:47.288 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.277+0000 7fc7d57fa640 1 -- 172.21.15.142:0/3633977841 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc8e8013640 con 0x56327dcabb30 2024-09-22T08:36:47.289 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.277+0000 7fc7d57fa640 1 -- 172.21.15.142:0/3633977841 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8e80137e0 con 0x56327dcabb30 2024-09-22T08:36:47.289 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.277+0000 7fc8f3f23800 1 -- 172.21.15.142:0/3633977841 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56327dcacdc0 con 0x56327dcabb30 2024-09-22T08:36:47.289 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.277+0000 7fc7d57fa640 1 -- 172.21.15.142:0/3633977841 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc8e8013ae0 con 0x56327dcabb30 2024-09-22T08:36:47.289 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.278+0000 7fc8f3f23800 1 -- 172.21.15.142:0/3633977841 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56327dcad360 con 0x56327dcabb30 2024-09-22T08:36:47.289 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.278+0000 7fc7d57fa640 1 -- 172.21.15.142:0/3633977841 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fc8e8011040 con 0x56327dcabb30 2024-09-22T08:36:47.289 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.278+0000 7fc7d57fa640 1 --2- 172.21.15.142:0/3633977841 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fc7c803cfb0 0x7fc7c803f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:47.289 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.279+0000 7fc7d57fa640 1 -- 172.21.15.142:0/3633977841 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fc8e800e040 con 0x56327dcabb30 2024-09-22T08:36:47.289 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.279+0000 7fc8efc44640 1 --2- 172.21.15.142:0/3633977841 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fc7c803cfb0 0x7fc7c803f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:47.289 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.279+0000 7fc8f3f23800 1 Processor -- start 2024-09-22T08:36:47.289 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.279+0000 7fc8efc44640 1 --2- 172.21.15.142:0/3633977841 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fc7c803cfb0 0x7fc7c803f470 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fc8e0068fd0 tx=0x7fc8e005d620 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:47.289 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.279+0000 7fc8f3f23800 1 -- start start 2024-09-22T08:36:47.289 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.279+0000 7fc8f3f23800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56327dcb85d0 0x56327dcb89d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:47.290 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.279+0000 7fc8f3f23800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x56327dc89ae0 con 0x56327dcb85d0 2024-09-22T08:36:47.290 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.279+0000 7fc8f0445640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56327dcb85d0 0x56327dcb89d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:47.290 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.279+0000 7fc8f0445640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56327dcb85d0 0x56327dcb89d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:39710/0 (socket says 172.21.15.142:39710) 2024-09-22T08:36:47.290 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.279+0000 7fc8f0445640 1 -- 172.21.15.142:0/2430093070 learned_addr learned my addr 172.21.15.142:0/2430093070 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:47.290 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.280+0000 7fc8f0445640 1 -- 172.21.15.142:0/2430093070 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56327dcb8fc0 con 0x56327dcb85d0 2024-09-22T08:36:47.290 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.280+0000 7fc8f0445640 1 --2- 172.21.15.142:0/2430093070 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56327dcb85d0 0x56327dcb89d0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fc8e8054870 tx=0x7fc8e8020460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fc6e6f437afab7d server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:47.290 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.280+0000 7fc7ceffd640 1 -- 172.21.15.142:0/2430093070 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc8e80143c0 con 0x56327dcb85d0 2024-09-22T08:36:47.290 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.280+0000 7fc7ceffd640 1 -- 172.21.15.142:0/2430093070 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8e8052070 con 0x56327dcb85d0 2024-09-22T08:36:47.290 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.280+0000 7fc7ceffd640 1 -- 172.21.15.142:0/2430093070 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc8e8021910 con 0x56327dcb85d0 2024-09-22T08:36:47.290 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.280+0000 7fc8f3f23800 1 -- 172.21.15.142:0/2430093070 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56327dcb85d0 msgr2=0x56327dcb89d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:47.290 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.280+0000 7fc8f3f23800 1 --2- 172.21.15.142:0/2430093070 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56327dcb85d0 0x56327dcb89d0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fc8e8054870 tx=0x7fc8e8020460 comp rx=0 tx=0).stop 2024-09-22T08:36:47.290 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.280+0000 7fc8f3f23800 1 -- 172.21.15.142:0/2430093070 shutdown_connections 2024-09-22T08:36:47.290 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.280+0000 7fc8f3f23800 1 --2- 172.21.15.142:0/2430093070 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56327dcb85d0 0x56327dcb89d0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:47.291 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.280+0000 7fc8f3f23800 1 -- 172.21.15.142:0/2430093070 >> 172.21.15.142:0/2430093070 conn(0x56327dcb49f0 msgr2=0x56327dcb2c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:47.291 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.280+0000 7fc8f3f23800 1 -- 172.21.15.142:0/2430093070 shutdown_connections 2024-09-22T08:36:47.291 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.280+0000 7fc8f3f23800 1 -- 172.21.15.142:0/2430093070 wait complete. 2024-09-22T08:36:47.291 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.281+0000 7fc8f3f23800 1 Processor -- start 2024-09-22T08:36:47.291 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.281+0000 7fc8f3f23800 1 -- start start 2024-09-22T08:36:47.291 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.281+0000 7fc8f3f23800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56327dcb85d0 0x56327dcbfbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:47.291 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.281+0000 7fc8f3f23800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x56327dcb95e0 con 0x56327dcb85d0 2024-09-22T08:36:47.291 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.281+0000 7fc8f0445640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56327dcb85d0 0x56327dcbfbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:47.291 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.281+0000 7fc8f0445640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56327dcb85d0 0x56327dcbfbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:39726/0 (socket says 172.21.15.142:39726) 2024-09-22T08:36:47.291 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.281+0000 7fc8f0445640 1 -- 172.21.15.142:0/1165638939 learned_addr learned my addr 172.21.15.142:0/1165638939 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:47.291 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.281+0000 7fc8f0445640 1 -- 172.21.15.142:0/1165638939 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56327dcc0110 con 0x56327dcb85d0 2024-09-22T08:36:47.291 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.281+0000 7fc8f0445640 1 --2- 172.21.15.142:0/1165638939 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56327dcb85d0 0x56327dcbfbb0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fc8e8022ff0 tx=0x7fc8e80547d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:47.291 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.281+0000 7fc7cd7fa640 1 -- 172.21.15.142:0/1165638939 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc8e8021910 con 0x56327dcb85d0 2024-09-22T08:36:47.292 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.281+0000 7fc7cd7fa640 1 -- 172.21.15.142:0/1165638939 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8e8053270 con 0x56327dcb85d0 2024-09-22T08:36:47.292 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.281+0000 7fc8f3f23800 1 -- 172.21.15.142:0/1165638939 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56327dcc03a0 con 0x56327dcb85d0 2024-09-22T08:36:47.292 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.281+0000 7fc7cd7fa640 1 -- 172.21.15.142:0/1165638939 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc8e8021ab0 con 0x56327dcb85d0 2024-09-22T08:36:47.292 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.282+0000 7fc8f3f23800 1 -- 172.21.15.142:0/1165638939 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56327dcc0d20 con 0x56327dcb85d0 2024-09-22T08:36:47.292 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.282+0000 7fc7cd7fa640 1 -- 172.21.15.142:0/1165638939 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fc8e8045a10 con 0x56327dcb85d0 2024-09-22T08:36:47.292 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.282+0000 7fc7cd7fa640 1 --2- 172.21.15.142:0/1165638939 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fc7b803d000 0x7fc7b803f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:47.292 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.283+0000 7fc7cd7fa640 1 -- 172.21.15.142:0/1165638939 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fc8e803d710 con 0x56327dcb85d0 2024-09-22T08:36:47.292 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.283+0000 7fc8efc44640 1 --2- 172.21.15.142:0/1165638939 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fc7b803d000 0x7fc7b803f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:47.292 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.283+0000 7fc8efc44640 1 --2- 172.21.15.142:0/1165638939 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fc7b803d000 0x7fc7b803f4c0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fc8e0045a60 tx=0x7fc8e0082000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:47.292 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.283+0000 7fc8f3f23800 20 rados->read ofs=0 len=0 2024-09-22T08:36:47.292 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.283+0000 7fc8f3f23800 1 --2- 172.21.15.142:0/1165638939 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x56327dccb4d0 0x56327dccd990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:47.292 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.283+0000 7fc8f3f23800 1 -- 172.21.15.142:0/1165638939 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56327dcce0e0 con 0x56327dccb4d0 2024-09-22T08:36:47.292 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.283+0000 7fc8ef443640 1 --2- 172.21.15.142:0/1165638939 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x56327dccb4d0 0x56327dccd990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:47.293 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.284+0000 7fc8ef443640 1 --2- 172.21.15.142:0/1165638939 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x56327dccb4d0 0x56327dccd990 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:47.293 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.284+0000 7fc8ef443640 1 -- 172.21.15.142:0/1165638939 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc8e4009050 con 0x56327dccb4d0 2024-09-22T08:36:47.293 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.284+0000 7fc8f3f23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:47.293 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.284+0000 7fc8f3f23800 20 realm 2024-09-22T08:36:47.293 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.284+0000 7fc8f3f23800 20 rados->read ofs=0 len=0 2024-09-22T08:36:47.293 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.284+0000 7fc8f3f23800 1 -- 172.21.15.142:0/1165638939 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56327dcca820 con 0x56327dccb4d0 2024-09-22T08:36:47.293 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.284+0000 7fc8ef443640 1 -- 172.21.15.142:0/1165638939 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc8e4009050 con 0x56327dccb4d0 2024-09-22T08:36:47.293 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.284+0000 7fc8f3f23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:47.293 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.284+0000 7fc8f3f23800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:36:47.293 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.284+0000 7fc8f3f23800 20 rados->read ofs=0 len=0 2024-09-22T08:36:47.293 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.284+0000 7fc8f3f23800 1 -- 172.21.15.142:0/1165638939 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56327dccebd0 con 0x56327dccb4d0 2024-09-22T08:36:47.293 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.284+0000 7fc8ef443640 1 -- 172.21.15.142:0/1165638939 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc8e4009050 con 0x56327dccb4d0 2024-09-22T08:36:47.293 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.284+0000 7fc8f3f23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:47.294 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.284+0000 7fc8f3f23800 20 rados->read ofs=0 len=0 2024-09-22T08:36:47.294 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.284+0000 7fc8f3f23800 1 -- 172.21.15.142:0/1165638939 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56327dccf4a0 con 0x56327dccb4d0 2024-09-22T08:36:47.294 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.285+0000 7fc8ef443640 1 -- 172.21.15.142:0/1165638939 <== osd.1 v2:172.21.15.142:6816/3192108003 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc8e4009050 con 0x56327dccb4d0 2024-09-22T08:36:47.294 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.285+0000 7fc8f3f23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:36:47.294 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.285+0000 7fc8f3f23800 20 rados->read ofs=0 len=0 2024-09-22T08:36:47.294 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.285+0000 7fc8f3f23800 1 --2- 172.21.15.142:0/1165638939 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x56327dccfec0 0x56327dcd22b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:47.294 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.285+0000 7fc8f3f23800 1 -- 172.21.15.142:0/1165638939 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56327dcd29f0 con 0x56327dccfec0 2024-09-22T08:36:47.294 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.285+0000 7fc8f0445640 1 --2- 172.21.15.142:0/1165638939 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x56327dccfec0 0x56327dcd22b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:47.294 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.285+0000 7fc8f0445640 1 --2- 172.21.15.142:0/1165638939 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x56327dccfec0 0x56327dcd22b0 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:47.294 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.285+0000 7fc8f0445640 1 -- 172.21.15.142:0/1165638939 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(5 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fc8e800a4d0 con 0x56327dccfec0 2024-09-22T08:36:47.294 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.285+0000 7fc8f3f23800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:36:47.294 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.285+0000 7fc8f3f23800 20 searching for the correct realm 2024-09-22T08:36:47.294 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.285+0000 7fc8f3f23800 1 -- 172.21.15.142:0/1165638939 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56327dcd4320 con 0x56327dccfec0 2024-09-22T08:36:47.295 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.286+0000 7fc8f0445640 1 -- 172.21.15.142:0/1165638939 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8e800a4d0 con 0x56327dccfec0 2024-09-22T08:36:47.295 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.286+0000 7fc8f0445640 1 --2- 172.21.15.142:0/1165638939 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7fc8e803e9c0 0x7fc8e803d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:47.295 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.286+0000 7fc8f0445640 1 -- 172.21.15.142:0/1165638939 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56327dcd4320 con 0x7fc8e803e9c0 2024-09-22T08:36:47.295 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.286+0000 7fc8efc44640 1 --2- 172.21.15.142:0/1165638939 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7fc8e803e9c0 0x7fc8e803d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:47.295 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.286+0000 7fc8efc44640 1 --2- 172.21.15.142:0/1165638939 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7fc8e803e9c0 0x7fc8e803d0d0 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:47.295 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.286+0000 7fc8efc44640 1 -- 172.21.15.142:0/1165638939 <== osd.2 v2:172.21.15.142:6808/279438927 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8e0051070 con 0x7fc8e803e9c0 2024-09-22T08:36:47.295 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.286+0000 7fc8efc44640 1 --2- 172.21.15.142:0/1165638939 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7fc8e005f040 0x7fc8e008ff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:47.295 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.286+0000 7fc8efc44640 1 -- 172.21.15.142:0/1165638939 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56327dcd4320 con 0x7fc8e005f040 2024-09-22T08:36:47.295 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.286+0000 7fc8ef443640 1 --2- 172.21.15.142:0/1165638939 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7fc8e005f040 0x7fc8e008ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:47.295 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.287+0000 7fc8ef443640 1 --2- 172.21.15.142:0/1165638939 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7fc8e005f040 0x7fc8e008ff70 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:47.304 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.287+0000 7fc8ef443640 1 -- 172.21.15.142:0/1165638939 <== osd.0 v2:172.21.15.31:6800/168281188 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8e4009050 con 0x7fc8e005f040 2024-09-22T08:36:47.304 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.287+0000 7fc8ef443640 1 -- 172.21.15.142:0/1165638939 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56327dcd4320 con 0x56327dccb4d0 2024-09-22T08:36:47.304 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.288+0000 7fc8ef443640 1 -- 172.21.15.142:0/1165638939 <== osd.1 v2:172.21.15.142:6816/3192108003 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8e4009050 con 0x56327dccb4d0 2024-09-22T08:36:47.305 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.288+0000 7fc8ef443640 1 -- 172.21.15.142:0/1165638939 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56327dcd4320 con 0x56327dccb4d0 2024-09-22T08:36:47.305 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.288+0000 7fc8ef443640 1 -- 172.21.15.142:0/1165638939 <== osd.1 v2:172.21.15.142:6816/3192108003 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8e4029040 con 0x56327dccb4d0 2024-09-22T08:36:47.305 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.288+0000 7fc8ef443640 1 -- 172.21.15.142:0/1165638939 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56327dcd4320 con 0x7fc8e005f040 2024-09-22T08:36:47.305 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.288+0000 7fc8ef443640 1 -- 172.21.15.142:0/1165638939 <== osd.0 v2:172.21.15.31:6800/168281188 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8e4029040 con 0x7fc8e005f040 2024-09-22T08:36:47.305 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.288+0000 7fc8ef443640 1 -- 172.21.15.142:0/1165638939 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56327dcd4320 con 0x7fc8e005f040 2024-09-22T08:36:47.305 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.288+0000 7fc8ef443640 1 -- 172.21.15.142:0/1165638939 <== osd.0 v2:172.21.15.31:6800/168281188 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8e4029040 con 0x7fc8e005f040 2024-09-22T08:36:47.305 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.288+0000 7fc8ef443640 1 -- 172.21.15.142:0/1165638939 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56327dcd4320 con 0x7fc8e803e9c0 2024-09-22T08:36:47.305 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.289+0000 7fc8efc44640 1 -- 172.21.15.142:0/1165638939 <== osd.2 v2:172.21.15.142:6808/279438927 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8e0051070 con 0x7fc8e803e9c0 2024-09-22T08:36:47.305 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.289+0000 7fc8efc44640 1 -- 172.21.15.142:0/1165638939 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56327dcd4320 con 0x56327dccfec0 2024-09-22T08:36:47.305 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.289+0000 7fc8f0445640 1 -- 172.21.15.142:0/1165638939 <== osd.3 v2:172.21.15.142:6800/1064901393 3 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8e800a4d0 con 0x56327dccfec0 2024-09-22T08:36:47.305 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.289+0000 7fc8f0445640 1 -- 172.21.15.142:0/1165638939 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56327dcd4320 con 0x56327dccb4d0 2024-09-22T08:36:47.305 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.289+0000 7fc8ef443640 1 -- 172.21.15.142:0/1165638939 <== osd.1 v2:172.21.15.142:6816/3192108003 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8e4029040 con 0x56327dccb4d0 2024-09-22T08:36:47.305 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.289+0000 7fc8ef443640 1 -- 172.21.15.142:0/1165638939 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56327dcd4320 con 0x7fc8e005f040 2024-09-22T08:36:47.306 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.289+0000 7fc8ef443640 1 -- 172.21.15.142:0/1165638939 <== osd.0 v2:172.21.15.31:6800/168281188 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8e4029040 con 0x7fc8e005f040 2024-09-22T08:36:47.306 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.289+0000 7fc8ef443640 1 -- 172.21.15.142:0/1165638939 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56327dcd4320 con 0x56327dccb4d0 2024-09-22T08:36:47.306 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.289+0000 7fc8ef443640 1 -- 172.21.15.142:0/1165638939 <== osd.1 v2:172.21.15.142:6816/3192108003 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8e4029040 con 0x56327dccb4d0 2024-09-22T08:36:47.306 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.289+0000 7fc8ef443640 1 -- 172.21.15.142:0/1165638939 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56327dcd4320 con 0x7fc8e803e9c0 2024-09-22T08:36:47.306 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.290+0000 7fc8efc44640 1 -- 172.21.15.142:0/1165638939 <== osd.2 v2:172.21.15.142:6808/279438927 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fc8e0051070 con 0x7fc8e803e9c0 2024-09-22T08:36:47.306 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.290+0000 7fc8efc44640 1 -- 172.21.15.142:0/1165638939 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56327dcd4320 con 0x56327dccfec0 2024-09-22T08:36:47.306 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.290+0000 7fc8f0445640 1 -- 172.21.15.142:0/1165638939 <== osd.3 v2:172.21.15.142:6800/1064901393 4 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8e800a4d0 con 0x56327dccfec0 2024-09-22T08:36:47.306 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.290+0000 7fc8f0445640 1 -- 172.21.15.142:0/1165638939 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56327dcd4320 con 0x56327dccfec0 2024-09-22T08:36:47.306 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.290+0000 7fc8f0445640 1 -- 172.21.15.142:0/1165638939 <== osd.3 v2:172.21.15.142:6800/1064901393 5 ==== osd_op_reply(20 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fc8e800a4d0 con 0x56327dccfec0 2024-09-22T08:36:47.306 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.290+0000 7fc8f0445640 1 -- 172.21.15.142:0/1165638939 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56327dcd4320 con 0x7fc8e005f040 2024-09-22T08:36:47.306 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.290+0000 7fc8ef443640 1 -- 172.21.15.142:0/1165638939 <== osd.0 v2:172.21.15.31:6800/168281188 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8e4029040 con 0x7fc8e005f040 2024-09-22T08:36:47.307 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.290+0000 7fc8ef443640 1 -- 172.21.15.142:0/1165638939 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56327dcd4320 con 0x56327dccfec0 2024-09-22T08:36:47.307 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.291+0000 7fc8f0445640 1 -- 172.21.15.142:0/1165638939 <== osd.3 v2:172.21.15.142:6800/1064901393 6 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8e800a4d0 con 0x56327dccfec0 2024-09-22T08:36:47.307 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.291+0000 7fc8f0445640 1 -- 172.21.15.142:0/1165638939 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56327dcd4320 con 0x56327dccfec0 2024-09-22T08:36:47.307 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.291+0000 7fc8f0445640 1 -- 172.21.15.142:0/1165638939 <== osd.3 v2:172.21.15.142:6800/1064901393 7 ==== osd_op_reply(23 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fc8e800a4d0 con 0x56327dccfec0 2024-09-22T08:36:47.307 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.291+0000 7fc8f0445640 1 -- 172.21.15.142:0/1165638939 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56327dcd4320 con 0x56327dccb4d0 2024-09-22T08:36:47.307 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.291+0000 7fc8ef443640 1 -- 172.21.15.142:0/1165638939 <== osd.1 v2:172.21.15.142:6816/3192108003 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8e4029040 con 0x56327dccb4d0 2024-09-22T08:36:47.307 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.291+0000 7fc8ef443640 1 -- 172.21.15.142:0/1165638939 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56327dcd4320 con 0x56327dccb4d0 2024-09-22T08:36:47.307 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.291+0000 7fc8ef443640 1 -- 172.21.15.142:0/1165638939 <== osd.1 v2:172.21.15.142:6816/3192108003 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fc8e4029040 con 0x56327dccb4d0 2024-09-22T08:36:47.307 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.291+0000 7fc8ef443640 1 -- 172.21.15.142:0/1165638939 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56327dcd4320 con 0x7fc8e005f040 2024-09-22T08:36:47.307 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.292+0000 7fc8ef443640 1 -- 172.21.15.142:0/1165638939 <== osd.0 v2:172.21.15.31:6800/168281188 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8e4029040 con 0x7fc8e005f040 2024-09-22T08:36:47.307 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.292+0000 7fc8ef443640 1 -- 172.21.15.142:0/1165638939 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56327dcd4320 con 0x56327dccfec0 2024-09-22T08:36:47.307 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.292+0000 7fc8f0445640 1 -- 172.21.15.142:0/1165638939 <== osd.3 v2:172.21.15.142:6800/1064901393 8 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8e800a4d0 con 0x56327dccfec0 2024-09-22T08:36:47.307 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.292+0000 7fc8f0445640 1 -- 172.21.15.142:0/1165638939 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56327dcd4320 con 0x7fc8e803e9c0 2024-09-22T08:36:47.308 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.293+0000 7fc8efc44640 1 -- 172.21.15.142:0/1165638939 <== osd.2 v2:172.21.15.142:6808/279438927 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8e0051070 con 0x7fc8e803e9c0 2024-09-22T08:36:47.308 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.293+0000 7fc8efc44640 1 -- 172.21.15.142:0/1165638939 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56327dcd4320 con 0x56327dccb4d0 2024-09-22T08:36:47.308 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.293+0000 7fc8ef443640 1 -- 172.21.15.142:0/1165638939 <== osd.1 v2:172.21.15.142:6816/3192108003 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8e4029040 con 0x56327dccb4d0 2024-09-22T08:36:47.308 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.293+0000 7fc8ef443640 1 -- 172.21.15.142:0/1165638939 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56327dcd4320 con 0x7fc8e005f040 2024-09-22T08:36:47.308 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.293+0000 7fc8ef443640 1 -- 172.21.15.142:0/1165638939 <== osd.0 v2:172.21.15.31:6800/168281188 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8e4029040 con 0x7fc8e005f040 2024-09-22T08:36:47.308 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.293+0000 7fc8ef443640 1 -- 172.21.15.142:0/1165638939 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56327dcd4320 con 0x56327dccfec0 2024-09-22T08:36:47.308 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.294+0000 7fc8f0445640 1 -- 172.21.15.142:0/1165638939 <== osd.3 v2:172.21.15.142:6800/1064901393 9 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8e800a4d0 con 0x56327dccfec0 2024-09-22T08:36:47.308 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.294+0000 7fc8f0445640 1 -- 172.21.15.142:0/1165638939 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56327dcd4320 con 0x7fc8e005f040 2024-09-22T08:36:47.308 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.294+0000 7fc8ef443640 1 -- 172.21.15.142:0/1165638939 <== osd.0 v2:172.21.15.31:6800/168281188 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8e4029040 con 0x7fc8e005f040 2024-09-22T08:36:47.308 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.294+0000 7fc8ef443640 1 -- 172.21.15.142:0/1165638939 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56327dcd4320 con 0x7fc8e803e9c0 2024-09-22T08:36:47.308 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.294+0000 7fc8efc44640 1 -- 172.21.15.142:0/1165638939 <== osd.2 v2:172.21.15.142:6808/279438927 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8e0051070 con 0x7fc8e803e9c0 2024-09-22T08:36:47.308 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.294+0000 7fc8efc44640 1 -- 172.21.15.142:0/1165638939 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56327dcd4320 con 0x56327dccfec0 2024-09-22T08:36:47.308 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.294+0000 7fc8f0445640 1 -- 172.21.15.142:0/1165638939 <== osd.3 v2:172.21.15.142:6800/1064901393 10 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8e800a4d0 con 0x56327dccfec0 2024-09-22T08:36:47.309 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.294+0000 7fc8f0445640 1 -- 172.21.15.142:0/1165638939 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56327dcd4320 con 0x7fc8e005f040 2024-09-22T08:36:47.309 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.295+0000 7fc8ef443640 1 -- 172.21.15.142:0/1165638939 <== osd.0 v2:172.21.15.31:6800/168281188 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8e4029040 con 0x7fc8e005f040 2024-09-22T08:36:47.309 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.295+0000 7fc8ef443640 1 -- 172.21.15.142:0/1165638939 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56327dcd4320 con 0x56327dccb4d0 2024-09-22T08:36:47.309 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.295+0000 7fc8ef443640 1 -- 172.21.15.142:0/1165638939 <== osd.1 v2:172.21.15.142:6816/3192108003 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fc8e4029040 con 0x56327dccb4d0 2024-09-22T08:36:47.309 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.295+0000 7fc8ef443640 1 -- 172.21.15.142:0/1165638939 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56327dcd4320 con 0x7fc8e803e9c0 2024-09-22T08:36:47.309 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.295+0000 7fc8efc44640 1 -- 172.21.15.142:0/1165638939 <== osd.2 v2:172.21.15.142:6808/279438927 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8e0051070 con 0x7fc8e803e9c0 2024-09-22T08:36:47.309 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.295+0000 7fc8f3f23800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:36:47.310 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.295+0000 7fc8f3f23800 20 RGWRados::pool_iterate: got zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec 2024-09-22T08:36:47.310 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.295+0000 7fc8f3f23800 20 RGWRados::pool_iterate: got zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f 2024-09-22T08:36:47.310 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.295+0000 7fc8f3f23800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:36:47.310 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.295+0000 7fc8f3f23800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:36:47.310 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.295+0000 7fc8f3f23800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:36:47.310 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.295+0000 7fc8f3f23800 20 rados->read ofs=0 len=0 2024-09-22T08:36:47.310 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.295+0000 7fc8f3f23800 1 -- 172.21.15.142:0/1165638939 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56327dcd33b0 con 0x56327dccb4d0 2024-09-22T08:36:47.310 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.295+0000 7fc8ef443640 1 -- 172.21.15.142:0/1165638939 <== osd.1 v2:172.21.15.142:6816/3192108003 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc8e4029040 con 0x56327dccb4d0 2024-09-22T08:36:47.310 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.295+0000 7fc8f3f23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:47.310 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.295+0000 7fc8f3f23800 20 rados->read ofs=0 len=0 2024-09-22T08:36:47.310 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.295+0000 7fc8f3f23800 1 -- 172.21.15.142:0/1165638939 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56327dcd3c00 con 0x56327dccb4d0 2024-09-22T08:36:47.310 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.296+0000 7fc8ef443640 1 -- 172.21.15.142:0/1165638939 <== osd.1 v2:172.21.15.142:6816/3192108003 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc8e4029040 con 0x56327dccb4d0 2024-09-22T08:36:47.311 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.296+0000 7fc8f3f23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:36:47.311 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.296+0000 7fc8f3f23800 20 rados->read ofs=0 len=0 2024-09-22T08:36:47.311 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.296+0000 7fc8f3f23800 1 -- 172.21.15.142:0/1165638939 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:40 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56327dcd47a0 con 0x56327dccfec0 2024-09-22T08:36:47.311 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.296+0000 7fc8f0445640 1 -- 172.21.15.142:0/1165638939 <== osd.3 v2:172.21.15.142:6800/1064901393 11 ==== osd_op_reply(40 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fc8e800a4d0 con 0x56327dccfec0 2024-09-22T08:36:47.311 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.296+0000 7fc8f3f23800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:36:47.311 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.296+0000 7fc8f3f23800 20 zone default found 2024-09-22T08:36:47.311 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.296+0000 7fc8f3f23800 4 Realm: () 2024-09-22T08:36:47.311 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.296+0000 7fc8f3f23800 4 ZoneGroup: default (d89f6f57-1007-47dd-9065-f486c7b01aec) 2024-09-22T08:36:47.311 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.296+0000 7fc8f3f23800 4 Zone: default (e239248c-0bee-4e41-803a-24b288d3eb8f) 2024-09-22T08:36:47.311 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.296+0000 7fc8f3f23800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:36:47.311 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.296+0000 7fc8f3f23800 20 zonegroup default 2024-09-22T08:36:47.311 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.296+0000 7fc8f3f23800 20 rados->read ofs=0 len=0 2024-09-22T08:36:47.311 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.296+0000 7fc8f3f23800 1 -- 172.21.15.142:0/1165638939 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56327dcd4b40 con 0x7fc8e005f040 2024-09-22T08:36:47.311 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.296+0000 7fc8ef443640 1 -- 172.21.15.142:0/1165638939 <== osd.0 v2:172.21.15.31:6800/168281188 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fc8e4029040 con 0x7fc8e005f040 2024-09-22T08:36:47.312 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.296+0000 7fc8f3f23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:47.312 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.296+0000 7fc8f3f23800 20 rados->read ofs=0 len=0 2024-09-22T08:36:47.312 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.296+0000 7fc8f3f23800 1 -- 172.21.15.142:0/1165638939 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56327dcd6e20 con 0x56327dccfec0 2024-09-22T08:36:47.312 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.297+0000 7fc8f0445640 1 -- 172.21.15.142:0/1165638939 <== osd.3 v2:172.21.15.142:6800/1064901393 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc8e800a4d0 con 0x56327dccfec0 2024-09-22T08:36:47.312 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.297+0000 7fc8f3f23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:47.312 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.297+0000 7fc8f3f23800 20 rados->read ofs=0 len=0 2024-09-22T08:36:47.312 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.297+0000 7fc8f3f23800 1 -- 172.21.15.142:0/1165638939 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56327dcd71c0 con 0x56327dccfec0 2024-09-22T08:36:47.312 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.297+0000 7fc8f0445640 1 -- 172.21.15.142:0/1165638939 <== osd.3 v2:172.21.15.142:6800/1064901393 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc8e800a4d0 con 0x56327dccfec0 2024-09-22T08:36:47.312 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.297+0000 7fc8f3f23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:47.313 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.297+0000 7fc8f3f23800 20 started sync module instance, tier type = 2024-09-22T08:36:47.313 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.297+0000 7fc8f3f23800 20 started zone id=e239248c-0bee-4e41-803a-24b288d3eb8f (name=default) with tier type = 2024-09-22T08:36:47.313 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.297+0000 7fc8f3f23800 1 -- 172.21.15.142:0/1165638939 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56327dcd62b0 con 0x7fc8e803e9c0 2024-09-22T08:36:47.313 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.298+0000 7fc8efc44640 1 -- 172.21.15.142:0/1165638939 <== osd.2 v2:172.21.15.142:6808/279438927 7 ==== osd_op_reply(44 notify.0 [create] v30'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8e0051070 con 0x7fc8e803e9c0 2024-09-22T08:36:47.313 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.298+0000 7fc8f3f23800 1 -- 172.21.15.142:0/1165638939 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94774858966688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56327dcd5f10 con 0x7fc8e803e9c0 2024-09-22T08:36:47.313 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.298+0000 7fc8f3f23800 1 -- 172.21.15.142:0/1165638939 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56327dcd7fe0 con 0x56327dccb4d0 2024-09-22T08:36:47.313 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.299+0000 7fc8efc44640 1 -- 172.21.15.142:0/1165638939 <== osd.2 v2:172.21.15.142:6808/279438927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94774858966688] v30'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8e0051070 con 0x7fc8e803e9c0 2024-09-22T08:36:47.313 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.299+0000 7fc8ef443640 1 -- 172.21.15.142:0/1165638939 <== osd.1 v2:172.21.15.142:6816/3192108003 15 ==== osd_op_reply(46 notify.1 [create] v30'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8e4029040 con 0x56327dccb4d0 2024-09-22T08:36:47.313 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.299+0000 7fc8f3f23800 1 -- 172.21.15.142:0/1165638939 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94774858970656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56327dcd8400 con 0x56327dccb4d0 2024-09-22T08:36:47.313 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.299+0000 7fc8f3f23800 1 -- 172.21.15.142:0/1165638939 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56327dcd8e20 con 0x56327dccfec0 2024-09-22T08:36:47.313 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.300+0000 7fc8ef443640 1 -- 172.21.15.142:0/1165638939 <== osd.1 v2:172.21.15.142:6816/3192108003 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94774858970656] v30'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8e4029040 con 0x56327dccb4d0 2024-09-22T08:36:47.313 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.300+0000 7fc8f0445640 1 -- 172.21.15.142:0/1165638939 <== osd.3 v2:172.21.15.142:6800/1064901393 14 ==== osd_op_reply(48 notify.2 [create] v30'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8e800a4d0 con 0x56327dccfec0 2024-09-22T08:36:47.314 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.300+0000 7fc8f3f23800 1 -- 172.21.15.142:0/1165638939 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94774858975504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56327dcd8de0 con 0x56327dccfec0 2024-09-22T08:36:47.314 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.300+0000 7fc8f3f23800 1 -- 172.21.15.142:0/1165638939 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56327dcd98b0 con 0x7fc8e803e9c0 2024-09-22T08:36:47.314 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.301+0000 7fc8efc44640 1 -- 172.21.15.142:0/1165638939 <== osd.2 v2:172.21.15.142:6808/279438927 9 ==== osd_op_reply(50 notify.3 [create] v30'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8e0051070 con 0x7fc8e803e9c0 2024-09-22T08:36:47.314 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.301+0000 7fc8f3f23800 1 -- 172.21.15.142:0/1165638939 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94774858978272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56327dcd98b0 con 0x7fc8e803e9c0 2024-09-22T08:36:47.314 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.301+0000 7fc8f3f23800 1 -- 172.21.15.142:0/1165638939 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56327dcda8b0 con 0x56327dccb4d0 2024-09-22T08:36:47.314 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.302+0000 7fc8efc44640 1 -- 172.21.15.142:0/1165638939 <== osd.2 v2:172.21.15.142:6808/279438927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94774858978272] v30'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8e0051070 con 0x7fc8e803e9c0 2024-09-22T08:36:47.315 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.308+0000 7fc8f0445640 1 -- 172.21.15.142:0/1165638939 <== osd.3 v2:172.21.15.142:6800/1064901393 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94774858975504] v30'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8e800a4d0 con 0x56327dccfec0 2024-09-22T08:36:47.315 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.308+0000 7fc8ef443640 1 -- 172.21.15.142:0/1165638939 <== osd.1 v2:172.21.15.142:6816/3192108003 17 ==== osd_op_reply(52 notify.4 [create] v30'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8e4029040 con 0x56327dccb4d0 2024-09-22T08:36:47.315 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.308+0000 7fc8f3f23800 1 -- 172.21.15.142:0/1165638939 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94774858971712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56327dcda870 con 0x56327dccb4d0 2024-09-22T08:36:47.315 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.308+0000 7fc8f3f23800 1 -- 172.21.15.142:0/1165638939 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56327dcdb150 con 0x7fc8e005f040 2024-09-22T08:36:47.316 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.309+0000 7fc8ef443640 1 -- 172.21.15.142:0/1165638939 <== osd.1 v2:172.21.15.142:6816/3192108003 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94774858971712] v30'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8e4029040 con 0x56327dccb4d0 2024-09-22T08:36:47.316 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.314+0000 7fc8ef443640 1 -- 172.21.15.142:0/1165638939 <== osd.0 v2:172.21.15.31:6800/168281188 11 ==== osd_op_reply(54 notify.5 [create] v30'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8e4029040 con 0x7fc8e005f040 2024-09-22T08:36:47.316 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.314+0000 7fc8f3f23800 1 -- 172.21.15.142:0/1165638939 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94774858982304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56327dcdad20 con 0x7fc8e005f040 2024-09-22T08:36:47.316 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.314+0000 7fc8f3f23800 1 -- 172.21.15.142:0/1165638939 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56327dcdb7f0 con 0x7fc8e005f040 2024-09-22T08:36:47.317 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.316+0000 7fc8ef443640 1 -- 172.21.15.142:0/1165638939 <== osd.0 v2:172.21.15.31:6800/168281188 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94774858982304] v30'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8e4029040 con 0x7fc8e005f040 2024-09-22T08:36:47.317 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.316+0000 7fc8ef443640 1 -- 172.21.15.142:0/1165638939 <== osd.0 v2:172.21.15.31:6800/168281188 13 ==== osd_op_reply(56 notify.6 [create] v30'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8e4029040 con 0x7fc8e005f040 2024-09-22T08:36:47.317 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.316+0000 7fc8f3f23800 1 -- 172.21.15.142:0/1165638939 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94774858986208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56327dcdb9d0 con 0x7fc8e005f040 2024-09-22T08:36:47.318 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.316+0000 7fc8f3f23800 1 -- 172.21.15.142:0/1165638939 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56327dcdc220 con 0x7fc8e005f040 2024-09-22T08:36:47.318 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.317+0000 7fc8ef443640 1 -- 172.21.15.142:0/1165638939 <== osd.0 v2:172.21.15.31:6800/168281188 14 ==== osd_op_reply(58 notify.7 [create] v30'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8e4029040 con 0x7fc8e005f040 2024-09-22T08:36:47.318 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.317+0000 7fc8f3f23800 1 -- 172.21.15.142:0/1165638939 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94774858988464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56327dcdc600 con 0x7fc8e005f040 2024-09-22T08:36:47.319 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.317+0000 7fc8f3f23800 20 add_watcher() i=0 2024-09-22T08:36:47.319 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.317+0000 7fc8f3f23800 20 add_watcher() i=1 2024-09-22T08:36:47.319 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.317+0000 7fc8f3f23800 20 add_watcher() i=2 2024-09-22T08:36:47.319 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.317+0000 7fc8f3f23800 20 add_watcher() i=3 2024-09-22T08:36:47.319 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.317+0000 7fc8f3f23800 20 add_watcher() i=4 2024-09-22T08:36:47.319 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.317+0000 7fc8f3f23800 20 add_watcher() i=5 2024-09-22T08:36:47.319 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.317+0000 7fc8ef443640 1 -- 172.21.15.142:0/1165638939 <== osd.0 v2:172.21.15.31:6800/168281188 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94774858986208] v30'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8e4029040 con 0x7fc8e005f040 2024-09-22T08:36:47.319 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.317+0000 7fc8f3f23800 20 add_watcher() i=6 2024-09-22T08:36:47.320 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.318+0000 7fc8ef443640 1 -- 172.21.15.142:0/1165638939 <== osd.0 v2:172.21.15.31:6800/168281188 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94774858988464] v30'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8e4029040 con 0x7fc8e005f040 2024-09-22T08:36:47.321 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.318+0000 7fc8f3f23800 20 add_watcher() i=7 2024-09-22T08:36:47.321 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.318+0000 7fc8f3f23800 2 all 8 watchers are set, enabling cache 2024-09-22T08:36:47.321 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.318+0000 7fc8f3f23800 1 -- 172.21.15.142:0/1165638939 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56327dcda910 con 0x56327dccb4d0 2024-09-22T08:36:47.321 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.318+0000 7fc8ef443640 1 -- 172.21.15.142:0/1165638939 <== osd.1 v2:172.21.15.142:6816/3192108003 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fc8e4029040 con 0x56327dccb4d0 2024-09-22T08:36:47.321 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.318+0000 7fc8f3f23800 1 -- 172.21.15.142:0/1165638939 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94774858989712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56327dcdcfc0 con 0x56327dccb4d0 2024-09-22T08:36:47.321 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.319+0000 7fc8ef443640 1 -- 172.21.15.142:0/1165638939 <== osd.1 v2:172.21.15.142:6816/3192108003 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94774858989712] v30'119 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc8e4029040 con 0x56327dccb4d0 2024-09-22T08:36:47.321 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.319+0000 7fc7a5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:36:47.321 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.320+0000 7fc8f3f23800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:36:47.321 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.320+0000 7fc8f3f23800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:36:47.321 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.320+0000 7fc8f3f23800 5 note: GC not initialized 2024-09-22T08:36:47.324 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.320+0000 7fc7a4fe1640 20 reqs_thread_entry: start 2024-09-22T08:36:47.324 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.320+0000 7fc8f3f23800 20 init_complete bucket index max shards: 11 2024-09-22T08:36:47.324 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.320+0000 7fc8f3f23800 20 Filter name: none 2024-09-22T08:36:47.324 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.320+0000 7fc71e7fc640 20 reqs_thread_entry: start 2024-09-22T08:36:47.324 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.320+0000 7fc8f3f23800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-22T08:36:47.324 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.320+0000 7fc8f3f23800 20 rados->read ofs=0 len=0 2024-09-22T08:36:47.324 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.320+0000 7fc8f3f23800 1 -- 172.21.15.142:0/1165638939 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56327dd12b30 con 0x56327dccb4d0 2024-09-22T08:36:47.324 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.320+0000 7fc8ef443640 1 -- 172.21.15.142:0/1165638939 <== osd.1 v2:172.21.15.142:6816/3192108003 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fc8e4029040 con 0x56327dccb4d0 2024-09-22T08:36:47.324 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.320+0000 7fc8f3f23800 20 rados_obj.operate() r=0 bl.length=391 2024-09-22T08:36:47.324 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.320+0000 7fc8f3f23800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-22T08:36:47.324 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.320+0000 7fc8f3f23800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-22T08:36:47.324 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.320+0000 7fc8f3f23800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:36:47.324 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.320+0000 7fc8f3f23800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-22T08:36:47.324 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.320+0000 7fc8f3f23800 20 rados->read ofs=0 len=0 2024-09-22T08:36:47.325 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.321+0000 7fc8f3f23800 1 -- 172.21.15.142:0/1165638939 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56327dd14c20 con 0x7fc8e803e9c0 2024-09-22T08:36:47.325 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.321+0000 7fc8efc44640 1 -- 172.21.15.142:0/1165638939 <== osd.2 v2:172.21.15.142:6808/279438927 11 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv21 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fc8e0051070 con 0x7fc8e803e9c0 2024-09-22T08:36:47.325 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.321+0000 7fc8f3f23800 20 rados_obj.operate() r=0 bl.length=165 2024-09-22T08:36:47.325 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.321+0000 7fc8f3f23800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-22T08:36:47.325 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.321+0000 7fc8f3f23800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-22T08:36:47.325 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.321+0000 7fc8f3f23800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1 : miss 2024-09-22T08:36:47.325 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.321+0000 7fc8f3f23800 20 rados->read ofs=0 len=0 2024-09-22T08:36:47.325 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.321+0000 7fc8f3f23800 1 -- 172.21.15.142:0/1165638939 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:64 8.15 8:ab67ca09:root::.bucket.meta.myfoo%3ae239248c-0bee-4e41-803a-24b288d3eb8f.4226.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56327dd164f0 con 0x56327dccfec0 2024-09-22T08:36:47.325 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.321+0000 7fc8f0445640 1 -- 172.21.15.142:0/1165638939 <== osd.3 v2:172.21.15.142:6800/1064901393 16 ==== osd_op_reply(64 .bucket.meta.myfoo:e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv4 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7fc8e800a4d0 con 0x56327dccfec0 2024-09-22T08:36:47.325 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.321+0000 7fc8f3f23800 20 rados_obj.operate() r=0 bl.length=387 2024-09-22T08:36:47.325 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.321+0000 7fc8f3f23800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1 info.flags=0x17 2024-09-22T08:36:47.325 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.321+0000 7fc8f3f23800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1 to cache LRU end 2024-09-22T08:36:47.326 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.321+0000 7fc8f3f23800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:36:47.326 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.321+0000 7fc8f3f23800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-22T08:36:47.326 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.321+0000 7fc8f3f23800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1 2024-09-22T08:36:47.326 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.321+0000 7fc8f3f23800 10 cache get: name=default.rgw.meta+users.uid+foo : hit (requested=0x13, cached=0x13) 2024-09-22T08:36:47.326 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.321+0000 7fc8f3f23800 1 -- 172.21.15.142:0/1165638939 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:65 8.1 8:810902b1:users.uid::fud.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56327dd1a7c0 con 0x7fc8e005f040 2024-09-22T08:36:47.326 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.322+0000 7fc8ef443640 1 -- 172.21.15.142:0/1165638939 <== osd.0 v2:172.21.15.31:6800/168281188 17 ==== osd_op_reply(65 fud.buckets [call] v30'3 uv2 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fc8e4029040 con 0x7fc8e005f040 2024-09-22T08:36:47.326 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.323+0000 7fc8f3f23800 1 -- 172.21.15.142:0/1165638939 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:66 8.15 8:ab67ca09:root::.bucket.meta.myfoo%3ae239248c-0bee-4e41-803a-24b288d3eb8f.4226.1:head [delete,create,call version.check_conds in=122b,call version.inc in=38b,writefull 0~387 in=387b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56327dd204c0 con 0x56327dccfec0 2024-09-22T08:36:47.327 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.324+0000 7fc8f0445640 1 -- 172.21.15.142:0/1165638939 <== osd.3 v2:172.21.15.142:6800/1064901393 17 ==== osd_op_reply(66 .bucket.meta.myfoo:e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1 [delete,create,call,call,writefull 0~387,setxattr (123)] v30'5 uv5 ondisk = 0) ==== 416+0+0 (crc 0 0 0) 0x7fc8e800a4d0 con 0x56327dccfec0 2024-09-22T08:36:47.328 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.324+0000 7fc8f3f23800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1 info.flags=0x17 2024-09-22T08:36:47.328 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.324+0000 7fc8f3f23800 10 moving default.rgw.meta+root+.bucket.meta.myfoo:e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1 to cache LRU end 2024-09-22T08:36:47.328 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.324+0000 7fc8f3f23800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-22T08:36:47.328 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.324+0000 7fc8f3f23800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1, ofs0, ns] 2024-09-22T08:36:47.328 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.324+0000 7fc8f3f23800 1 -- 172.21.15.142:0/1165638939 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [notify cookie 94774859228256 in=772b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56327dd1abf0 con 0x7fc8e803e9c0 2024-09-22T08:36:47.328 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.324+0000 7fc8efc44640 1 -- 172.21.15.142:0/1165638939 <== osd.2 v2:172.21.15.142:6808/279438927 12 ==== watch-notify(notify (1) cookie 94774858978272 notify 128849018894 ret 0) ==== 802+0+0 (crc 0 0 0) 0x7fc8e00ac060 con 0x7fc8e803e9c0 2024-09-22T08:36:47.328 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.324+0000 7fc7ceffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018894 cookie 94774858978272 notifier 4520 bl.length()=760 2024-09-22T08:36:47.328 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.324+0000 7fc8efc44640 1 -- 172.21.15.142:0/1165638939 <== osd.2 v2:172.21.15.142:6808/279438927 13 ==== osd_op_reply(67 notify.3 [notify cookie 94774859228256 out=8b] v0'0 uv123 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fc8e0051070 con 0x7fc8e803e9c0 2024-09-22T08:36:47.328 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.324+0000 7fc7ceffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1 info.flags=0x17 2024-09-22T08:36:47.328 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.324+0000 7fc7ceffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1 to cache LRU end 2024-09-22T08:36:47.328 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.324+0000 7fc7ceffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-09-22T08:36:47.328 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.324+0000 7fc7ceffd640 1 -- 172.21.15.142:0/1165638939 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7fc7b4003ea0 con 0x7fc8e803e9c0 2024-09-22T08:36:47.328 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.324+0000 7fc8efc44640 1 -- 172.21.15.142:0/1165638939 <== osd.2 v2:172.21.15.142:6808/279438927 14 ==== osd_op_reply(68 notify.3 [notify-ack] v0'0 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8e0051070 con 0x7fc8e803e9c0 2024-09-22T08:36:47.329 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.324+0000 7fc8efc44640 1 -- 172.21.15.142:0/1165638939 <== osd.2 v2:172.21.15.142:6808/279438927 15 ==== watch-notify(notify_complete (2) cookie 94774859228256 notify 128849018894 ret 0) ==== 42+0+48 (crc 0 0 0) 0x56327dc91fd0 con 0x7fc8e803e9c0 2024-09-22T08:36:47.329 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.324+0000 7fc8f3f23800 20 handle_bi_update(): bucket=:myfoo[e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1]): orig_sources= new_sources= 2024-09-22T08:36:47.329 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.324+0000 7fc8f3f23800 20 handle_bi_update(): bucket=:myfoo[e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1]): potential sources added=[] removed=[] 2024-09-22T08:36:47.329 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.324+0000 7fc8f3f23800 20 handle_bi_update(): bucket=:myfoo[e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1]): orig_dests= new_dests= 2024-09-22T08:36:47.329 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.324+0000 7fc8f3f23800 20 handle_bi_update(): bucket=:myfoo[e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1]): potential dests added=[] removed=[] 2024-09-22T08:36:47.329 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.324+0000 7fc8f3f23800 1 -- 172.21.15.142:0/1165638939 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:69 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56327dd16460 con 0x7fc8e803e9c0 2024-09-22T08:36:47.329 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.326+0000 7fc8efc44640 1 -- 172.21.15.142:0/1165638939 <== osd.2 v2:172.21.15.142:6808/279438927 16 ==== osd_op_reply(69 foo.buckets [call] v30'22 uv22 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fc8e0051070 con 0x7fc8e803e9c0 2024-09-22T08:36:47.329 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.326+0000 7fc8f3f23800 1 -- 172.21.15.142:0/1165638939 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:70 8.9 8:91b71841:root::myfoo:head [delete,create,call version.inc in=38b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56327dd16460 con 0x7fc8e803e9c0 2024-09-22T08:36:47.331 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.327+0000 7fc8efc44640 1 -- 172.21.15.142:0/1165638939 <== osd.2 v2:172.21.15.142:6808/279438927 17 ==== osd_op_reply(70 myfoo [delete,create,call,writefull 0~165] v30'23 uv23 ondisk = 0) ==== 275+0+0 (crc 0 0 0) 0x7fc8e0051070 con 0x7fc8e803e9c0 2024-09-22T08:36:47.331 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.327+0000 7fc8f3f23800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-09-22T08:36:47.331 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.327+0000 7fc8f3f23800 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-22T08:36:47.331 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.327+0000 7fc8f3f23800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-22T08:36:47.331 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.327+0000 7fc8f3f23800 1 -- 172.21.15.142:0/1165638939 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94774859228256 in=326b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56327dd1f1b0 con 0x7fc8e005f040 2024-09-22T08:36:47.331 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.327+0000 7fc8ef443640 1 -- 172.21.15.142:0/1165638939 <== osd.0 v2:172.21.15.31:6800/168281188 18 ==== watch-notify(notify (1) cookie 94774858986208 notify 128849018891 ret 0) ==== 356+0+0 (crc 0 0 0) 0x7fc8e402d430 con 0x7fc8e005f040 2024-09-22T08:36:47.331 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.327+0000 7fc8ef443640 1 -- 172.21.15.142:0/1165638939 <== osd.0 v2:172.21.15.31:6800/168281188 19 ==== osd_op_reply(71 notify.6 [notify cookie 94774859228256 out=8b] v0'0 uv123 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fc8e4029040 con 0x7fc8e005f040 2024-09-22T08:36:47.331 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.327+0000 7fc7ceffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018891 cookie 94774858986208 notifier 4520 bl.length()=314 2024-09-22T08:36:47.331 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.327+0000 7fc7ceffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-09-22T08:36:47.331 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.327+0000 7fc7ceffd640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-22T08:36:47.331 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.327+0000 7fc7ceffd640 1 -- 172.21.15.142:0/1165638939 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7fc7b4003ea0 con 0x7fc8e005f040 2024-09-22T08:36:47.332 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.328+0000 7fc8ef443640 1 -- 172.21.15.142:0/1165638939 <== osd.0 v2:172.21.15.31:6800/168281188 20 ==== osd_op_reply(72 notify.6 [notify-ack] v0'0 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8e4029040 con 0x7fc8e005f040 2024-09-22T08:36:47.332 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.328+0000 7fc8ef443640 1 -- 172.21.15.142:0/1165638939 <== osd.0 v2:172.21.15.31:6800/168281188 21 ==== watch-notify(notify_complete (2) cookie 94774859228256 notify 128849018891 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fc8e402d600 con 0x7fc8e005f040 2024-09-22T08:36:47.332 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.329+0000 7fc7a5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:36:47.332 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.329+0000 7fc8f3f23800 1 -- 172.21.15.142:0/1165638939 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:73 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94774858989712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56327dd10870 con 0x56327dccb4d0 2024-09-22T08:36:47.332 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.330+0000 7fc8ef443640 1 -- 172.21.15.142:0/1165638939 <== osd.1 v2:172.21.15.142:6816/3192108003 22 ==== osd_op_reply(73 data_loggenerations_metadata [watch unwatch cookie 94774858989712] v30'120 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc8e4029040 con 0x56327dccb4d0 2024-09-22T08:36:47.332 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.330+0000 7fc8f3f23800 1 -- 172.21.15.142:0/1165638939 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:74 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94774858966688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56327dd10870 con 0x7fc8e803e9c0 2024-09-22T08:36:47.333 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.331+0000 7fc8efc44640 1 -- 172.21.15.142:0/1165638939 <== osd.2 v2:172.21.15.142:6808/279438927 18 ==== osd_op_reply(74 notify.0 [watch unwatch cookie 94774858966688] v30'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8e0051070 con 0x7fc8e803e9c0 2024-09-22T08:36:47.333 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.331+0000 7fc8f3f23800 20 remove_watcher() i=0 2024-09-22T08:36:47.333 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.331+0000 7fc8f3f23800 2 removed watcher, disabling cache 2024-09-22T08:36:47.333 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.331+0000 7fc8f3f23800 1 -- 172.21.15.142:0/1165638939 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:75 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94774858970656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56327dd10870 con 0x56327dccb4d0 2024-09-22T08:36:47.333 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.332+0000 7fc8ef443640 1 -- 172.21.15.142:0/1165638939 <== osd.1 v2:172.21.15.142:6816/3192108003 23 ==== osd_op_reply(75 notify.1 [watch unwatch cookie 94774858970656] v30'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8e4029040 con 0x56327dccb4d0 2024-09-22T08:36:47.333 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.332+0000 7fc8f3f23800 20 remove_watcher() i=1 2024-09-22T08:36:47.333 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.332+0000 7fc8f3f23800 1 -- 172.21.15.142:0/1165638939 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:76 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94774858975504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56327dd10870 con 0x56327dccfec0 2024-09-22T08:36:47.334 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.333+0000 7fc8f0445640 1 -- 172.21.15.142:0/1165638939 <== osd.3 v2:172.21.15.142:6800/1064901393 18 ==== osd_op_reply(76 notify.2 [watch unwatch cookie 94774858975504] v30'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8e800a4d0 con 0x56327dccfec0 2024-09-22T08:36:47.334 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.333+0000 7fc8f3f23800 20 remove_watcher() i=2 2024-09-22T08:36:47.334 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.333+0000 7fc8f3f23800 1 -- 172.21.15.142:0/1165638939 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:77 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94774858978272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56327dd10870 con 0x7fc8e803e9c0 2024-09-22T08:36:47.335 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.334+0000 7fc8efc44640 1 -- 172.21.15.142:0/1165638939 <== osd.2 v2:172.21.15.142:6808/279438927 19 ==== osd_op_reply(77 notify.3 [watch unwatch cookie 94774858978272] v30'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8e0051070 con 0x7fc8e803e9c0 2024-09-22T08:36:47.335 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.334+0000 7fc8f3f23800 20 remove_watcher() i=3 2024-09-22T08:36:47.335 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.334+0000 7fc8f3f23800 1 -- 172.21.15.142:0/1165638939 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:78 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94774858971712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56327dd10870 con 0x56327dccb4d0 2024-09-22T08:36:47.336 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.335+0000 7fc8ef443640 1 -- 172.21.15.142:0/1165638939 <== osd.1 v2:172.21.15.142:6816/3192108003 24 ==== osd_op_reply(78 notify.4 [watch unwatch cookie 94774858971712] v30'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8e4029040 con 0x56327dccb4d0 2024-09-22T08:36:47.336 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.335+0000 7fc8f3f23800 20 remove_watcher() i=4 2024-09-22T08:36:47.336 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.335+0000 7fc8f3f23800 1 -- 172.21.15.142:0/1165638939 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:79 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94774858982304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56327dd10870 con 0x7fc8e005f040 2024-09-22T08:36:47.337 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.336+0000 7fc8ef443640 1 -- 172.21.15.142:0/1165638939 <== osd.0 v2:172.21.15.31:6800/168281188 22 ==== osd_op_reply(79 notify.5 [watch unwatch cookie 94774858982304] v30'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8e4029040 con 0x7fc8e005f040 2024-09-22T08:36:47.337 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.336+0000 7fc8f3f23800 20 remove_watcher() i=5 2024-09-22T08:36:47.337 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.336+0000 7fc8f3f23800 1 -- 172.21.15.142:0/1165638939 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:80 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94774858986208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56327dd10870 con 0x7fc8e005f040 2024-09-22T08:36:47.338 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.337+0000 7fc8ef443640 1 -- 172.21.15.142:0/1165638939 <== osd.0 v2:172.21.15.31:6800/168281188 23 ==== osd_op_reply(80 notify.6 [watch unwatch cookie 94774858986208] v30'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8e4029040 con 0x7fc8e005f040 2024-09-22T08:36:47.338 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.337+0000 7fc8f3f23800 20 remove_watcher() i=6 2024-09-22T08:36:47.338 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.337+0000 7fc8f3f23800 1 -- 172.21.15.142:0/1165638939 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:81 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94774858988464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56327dd10870 con 0x7fc8e005f040 2024-09-22T08:36:47.341 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.337+0000 7fc8ef443640 1 -- 172.21.15.142:0/1165638939 <== osd.0 v2:172.21.15.31:6800/168281188 24 ==== osd_op_reply(81 notify.7 [watch unwatch cookie 94774858988464] v30'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8e4029040 con 0x7fc8e005f040 2024-09-22T08:36:47.341 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.338+0000 7fc8f3f23800 20 remove_watcher() i=7 2024-09-22T08:36:47.342 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.338+0000 7fc8f3f23800 1 -- 172.21.15.142:0/1165638939 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7fc8e005f040 msgr2=0x7fc8e008ff70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:47.342 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.338+0000 7fc8f3f23800 1 --2- 172.21.15.142:0/1165638939 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7fc8e005f040 0x7fc8e008ff70 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:47.342 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.338+0000 7fc8f3f23800 1 -- 172.21.15.142:0/1165638939 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x56327dccb4d0 msgr2=0x56327dccd990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:47.342 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.338+0000 7fc8f3f23800 1 --2- 172.21.15.142:0/1165638939 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x56327dccb4d0 0x56327dccd990 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:47.342 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.338+0000 7fc8f3f23800 1 -- 172.21.15.142:0/1165638939 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7fc8e803e9c0 msgr2=0x7fc8e803d0d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:47.342 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.338+0000 7fc8f3f23800 1 --2- 172.21.15.142:0/1165638939 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7fc8e803e9c0 0x7fc8e803d0d0 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:47.342 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.338+0000 7fc8f3f23800 1 -- 172.21.15.142:0/1165638939 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x56327dccfec0 msgr2=0x56327dcd22b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:47.342 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.338+0000 7fc8f3f23800 1 --2- 172.21.15.142:0/1165638939 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x56327dccfec0 0x56327dcd22b0 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:47.342 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.338+0000 7fc8f3f23800 1 -- 172.21.15.142:0/1165638939 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fc7b803d000 msgr2=0x7fc7b803f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:47.342 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.338+0000 7fc8f3f23800 1 --2- 172.21.15.142:0/1165638939 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fc7b803d000 0x7fc7b803f4c0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fc8e0045a60 tx=0x7fc8e0082000 comp rx=0 tx=0).stop 2024-09-22T08:36:47.342 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.338+0000 7fc8f3f23800 1 -- 172.21.15.142:0/1165638939 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56327dcb85d0 msgr2=0x56327dcbfbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:47.342 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.338+0000 7fc8f3f23800 1 --2- 172.21.15.142:0/1165638939 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56327dcb85d0 0x56327dcbfbb0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fc8e8022ff0 tx=0x7fc8e80547d0 comp rx=0 tx=0).stop 2024-09-22T08:36:47.343 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.338+0000 7fc8ef443640 1 -- 172.21.15.142:0/1165638939 reap_dead start 2024-09-22T08:36:47.343 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.338+0000 7fc8f3f23800 1 -- 172.21.15.142:0/1165638939 shutdown_connections 2024-09-22T08:36:47.343 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.338+0000 7fc8f3f23800 1 -- 172.21.15.142:0/1165638939 >> 172.21.15.142:0/1165638939 conn(0x56327dcb49f0 msgr2=0x56327dcb2c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:47.343 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.338+0000 7fc8f3f23800 1 -- 172.21.15.142:0/1165638939 shutdown_connections 2024-09-22T08:36:47.343 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.338+0000 7fc8f3f23800 1 -- 172.21.15.142:0/1165638939 wait complete. 2024-09-22T08:36:47.343 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.338+0000 7fc8f3f23800 1 -- 172.21.15.142:0/3633977841 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fc7c803cfb0 msgr2=0x7fc7c803f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:47.343 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.338+0000 7fc8f3f23800 1 --2- 172.21.15.142:0/3633977841 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fc7c803cfb0 0x7fc7c803f470 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fc8e0068fd0 tx=0x7fc8e005d620 comp rx=0 tx=0).stop 2024-09-22T08:36:47.343 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.338+0000 7fc8f3f23800 1 -- 172.21.15.142:0/3633977841 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56327dcabb30 msgr2=0x56327dcabf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:47.343 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.338+0000 7fc8f3f23800 1 --2- 172.21.15.142:0/3633977841 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56327dcabb30 0x56327dcabf50 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x56327dc91bd0 tx=0x7fc8e80167b0 comp rx=0 tx=0).stop 2024-09-22T08:36:47.343 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.338+0000 7fc8f3f23800 1 -- 172.21.15.142:0/3633977841 shutdown_connections 2024-09-22T08:36:47.343 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.338+0000 7fc8f3f23800 1 --2- 172.21.15.142:0/3633977841 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fc7c803cfb0 0x7fc7c803f470 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:47.343 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.338+0000 7fc8f3f23800 1 --2- 172.21.15.142:0/3633977841 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56327dcabb30 0x56327dcabf50 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:47.343 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.338+0000 7fc8f3f23800 1 -- 172.21.15.142:0/3633977841 >> 172.21.15.142:0/3633977841 conn(0x56327dc9fee0 msgr2=0x56327dca02c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:47.343 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.338+0000 7fc8f3f23800 1 -- 172.21.15.142:0/3633977841 shutdown_connections 2024-09-22T08:36:47.344 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.338+0000 7fc8f3f23800 1 -- 172.21.15.142:0/3633977841 wait complete. 2024-09-22T08:36:47.344 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.339+0000 7fc8f3f23800 1 -- 172.21.15.142:0/4103160168 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x56327db9c870 msgr2=0x56327dc98220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:47.344 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.339+0000 7fc8f3f23800 1 --2- 172.21.15.142:0/4103160168 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x56327db9c870 0x56327dc98220 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:47.344 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.339+0000 7fc8f3f23800 1 -- 172.21.15.142:0/4103160168 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x56327dc9a580 msgr2=0x56327dc9c9f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:47.344 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.339+0000 7fc8f3f23800 1 --2- 172.21.15.142:0/4103160168 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x56327dc9a580 0x56327dc9c9f0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:47.344 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.339+0000 7fc8f3f23800 1 -- 172.21.15.142:0/4103160168 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fc7d803d000 msgr2=0x7fc7d803f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:47.344 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.339+0000 7fc8f3f23800 1 --2- 172.21.15.142:0/4103160168 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fc7d803d000 0x7fc7d803f4c0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fc8e4001d70 tx=0x7fc8e40012d0 comp rx=0 tx=0).stop 2024-09-22T08:36:47.344 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.339+0000 7fc8f3f23800 1 -- 172.21.15.142:0/4103160168 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56327db97c00 msgr2=0x56327dc90bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:47.344 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.339+0000 7fc8f3f23800 1 --2- 172.21.15.142:0/4103160168 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56327db97c00 0x56327dc90bd0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fc8e0025c20 tx=0x7fc8e0002fb0 comp rx=0 tx=0).stop 2024-09-22T08:36:47.344 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.339+0000 7fc8f3f23800 1 -- 172.21.15.142:0/4103160168 shutdown_connections 2024-09-22T08:36:47.344 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.339+0000 7fc8f3f23800 1 --2- 172.21.15.142:0/4103160168 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x56327dc9a580 0x56327dc9c9f0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:47.344 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.339+0000 7fc8f3f23800 1 --2- 172.21.15.142:0/4103160168 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x56327db9c870 0x56327dc98220 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:47.344 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.339+0000 7fc8f3f23800 1 --2- 172.21.15.142:0/4103160168 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fc7d803d000 0x7fc7d803f4c0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:47.344 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.339+0000 7fc8f3f23800 1 --2- 172.21.15.142:0/4103160168 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56327db97c00 0x56327dc90bd0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:47.345 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.339+0000 7fc8f3f23800 1 -- 172.21.15.142:0/4103160168 >> 172.21.15.142:0/4103160168 conn(0x56327db93330 msgr2=0x56327dc83290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:47.345 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.339+0000 7fc8f3f23800 1 -- 172.21.15.142:0/4103160168 shutdown_connections 2024-09-22T08:36:47.345 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.339+0000 7fc8f3f23800 1 -- 172.21.15.142:0/4103160168 wait complete. 2024-09-22T08:36:47.349 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud'] 2024-09-22T08:36:47.349 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud'] 2024-09-22T08:36:47.349 DEBUG:teuthology.orchestra.run.smithi142:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud 2024-09-22T08:36:47.393 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:36:47.393 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:36:47.394 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.393+0000 7fc9c4342800 1 Processor -- start 2024-09-22T08:36:47.394 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.393+0000 7fc9c4342800 1 -- start start 2024-09-22T08:36:47.395 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.393+0000 7fc9c4342800 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55e932287bf0 0x55e93228d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:47.395 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.393+0000 7fc9c4342800 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55e932112a20 con 0x55e9322867e0 2024-09-22T08:36:47.395 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.393+0000 7fc9c4342800 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x55e9321127d0 con 0x55e932287bf0 2024-09-22T08:36:47.395 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.393+0000 7fc9bf8ec640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55e932287bf0 0x55e93228d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:47.395 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.393+0000 7fc9bf8ec640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55e932287bf0 0x55e93228d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:39736/0 (socket says 172.21.15.142:39736) 2024-09-22T08:36:47.395 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.393+0000 7fc9bf8ec640 1 -- 172.21.15.142:0/2490650556 learned_addr learned my addr 172.21.15.142:0/2490650556 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:47.395 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.393+0000 7fc9c00ed640 1 --1- 172.21.15.142:0/2490650556 >> v1:172.21.15.31:6789/0 conn(0x55e9322867e0 0x55e9322874e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.142:42610/0 (socket says 172.21.15.142:42610) 2024-09-22T08:36:47.395 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.393+0000 7fc9bf8ec640 1 -- 172.21.15.142:0/2490650556 >> v1:172.21.15.31:6789/0 conn(0x55e9322867e0 legacy=0x55e9322874e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:47.395 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.393+0000 7fc9bf8ec640 1 -- 172.21.15.142:0/2490650556 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e932286ee0 con 0x55e932287bf0 2024-09-22T08:36:47.396 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.395+0000 7fc9bf8ec640 1 --2- 172.21.15.142:0/2490650556 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e932287bf0 0x55e93228d580 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fc9a800a520 tx=0x7fc9a8045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8fef64b51be4d37 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:47.396 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.395+0000 7fc9bf0eb640 1 -- 172.21.15.142:0/2490650556 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9a8055070 con 0x55e932287bf0 2024-09-22T08:36:47.397 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.395+0000 7fc9bf0eb640 1 -- 172.21.15.142:0/2490650556 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9a80515b0 con 0x55e932287bf0 2024-09-22T08:36:47.397 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.395+0000 7fc9bf0eb640 1 -- 172.21.15.142:0/2490650556 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9a80518d0 con 0x55e932287bf0 2024-09-22T08:36:47.397 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.396+0000 7fc9c4342800 1 -- 172.21.15.142:0/2490650556 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e932287bf0 msgr2=0x55e93228d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:47.397 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.396+0000 7fc9c4342800 1 --2- 172.21.15.142:0/2490650556 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e932287bf0 0x55e93228d580 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fc9a800a520 tx=0x7fc9a8045ba0 comp rx=0 tx=0).stop 2024-09-22T08:36:47.398 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.396+0000 7fc9c4342800 1 -- 172.21.15.142:0/2490650556 shutdown_connections 2024-09-22T08:36:47.398 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.396+0000 7fc9c4342800 1 --2- 172.21.15.142:0/2490650556 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e932287bf0 0x55e93228d580 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:47.398 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.396+0000 7fc9c4342800 1 -- 172.21.15.142:0/2490650556 >> 172.21.15.142:0/2490650556 conn(0x55e932281bb0 msgr2=0x55e932284010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:47.398 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.396+0000 7fc9c4342800 1 -- 172.21.15.142:0/2490650556 shutdown_connections 2024-09-22T08:36:47.398 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.396+0000 7fc9c4342800 1 -- 172.21.15.142:0/2490650556 wait complete. 2024-09-22T08:36:47.411 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.409+0000 7fc9c4342800 1 Processor -- start 2024-09-22T08:36:47.412 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.410+0000 7fc9c4342800 1 -- start start 2024-09-22T08:36:47.412 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.410+0000 7fc9c4342800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e9322867e0 0x55e932374df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:47.412 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.410+0000 7fc9c4342800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55e93211fdd0 con 0x55e9322867e0 2024-09-22T08:36:47.412 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.410+0000 7fc9c00ed640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e9322867e0 0x55e932374df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:47.412 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.410+0000 7fc9c00ed640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e9322867e0 0x55e932374df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:39750/0 (socket says 172.21.15.142:39750) 2024-09-22T08:36:47.412 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.410+0000 7fc9c00ed640 1 -- 172.21.15.142:0/1186230017 learned_addr learned my addr 172.21.15.142:0/1186230017 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:47.412 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.410+0000 7fc9c00ed640 1 -- 172.21.15.142:0/1186230017 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e9323753e0 con 0x55e9322867e0 2024-09-22T08:36:47.412 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.410+0000 7fc9c00ed640 1 --2- 172.21.15.142:0/1186230017 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e9322867e0 0x55e932374df0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fc9b00016e0 tx=0x7fc9b0001ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=173723806d1b5e1c server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:47.412 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.410+0000 7fc8ae60c640 1 -- 172.21.15.142:0/1186230017 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9b0013420 con 0x55e9322867e0 2024-09-22T08:36:47.412 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.411+0000 7fc8ae60c640 1 -- 172.21.15.142:0/1186230017 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9b00135e0 con 0x55e9322867e0 2024-09-22T08:36:47.412 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.411+0000 7fc8ae60c640 1 -- 172.21.15.142:0/1186230017 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9b0013900 con 0x55e9322867e0 2024-09-22T08:36:47.414 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.411+0000 7fc9c4342800 1 -- 172.21.15.142:0/1186230017 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e9322867e0 msgr2=0x55e932374df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:47.414 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.411+0000 7fc9c4342800 1 --2- 172.21.15.142:0/1186230017 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e9322867e0 0x55e932374df0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fc9b00016e0 tx=0x7fc9b0001ba0 comp rx=0 tx=0).stop 2024-09-22T08:36:47.414 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.411+0000 7fc9c4342800 1 -- 172.21.15.142:0/1186230017 shutdown_connections 2024-09-22T08:36:47.414 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.411+0000 7fc9c4342800 1 --2- 172.21.15.142:0/1186230017 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e9322867e0 0x55e932374df0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:47.414 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.411+0000 7fc9c4342800 1 -- 172.21.15.142:0/1186230017 >> 172.21.15.142:0/1186230017 conn(0x55e932281bb0 msgr2=0x55e932370770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:47.415 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.411+0000 7fc9c4342800 1 -- 172.21.15.142:0/1186230017 shutdown_connections 2024-09-22T08:36:47.415 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.411+0000 7fc9c4342800 1 -- 172.21.15.142:0/1186230017 wait complete. 2024-09-22T08:36:47.415 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.412+0000 7fc9c4342800 1 Processor -- start 2024-09-22T08:36:47.415 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.412+0000 7fc9c4342800 1 -- start start 2024-09-22T08:36:47.415 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.412+0000 7fc9c4342800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e932287bf0 0x55e93237cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:47.415 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.412+0000 7fc9c4342800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55e9321fa000 con 0x55e932287bf0 2024-09-22T08:36:47.415 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.412+0000 7fc9c00ed640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e932287bf0 0x55e93237cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:47.415 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.412+0000 7fc9c00ed640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e932287bf0 0x55e93237cb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:39752/0 (socket says 172.21.15.142:39752) 2024-09-22T08:36:47.415 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.412+0000 7fc9c00ed640 1 -- 172.21.15.142:0/3789896659 learned_addr learned my addr 172.21.15.142:0/3789896659 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:47.415 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.412+0000 7fc9c00ed640 1 -- 172.21.15.142:0/3789896659 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e93237d0d0 con 0x55e932287bf0 2024-09-22T08:36:47.415 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.413+0000 7fc9c00ed640 1 --2- 172.21.15.142:0/3789896659 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e932287bf0 0x55e93237cb70 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fc9b0000f80 tx=0x7fc9b0001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:47.415 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.413+0000 7fc8ace09640 1 -- 172.21.15.142:0/3789896659 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9b0022020 con 0x55e932287bf0 2024-09-22T08:36:47.416 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.413+0000 7fc8ace09640 1 -- 172.21.15.142:0/3789896659 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9b0006810 con 0x55e932287bf0 2024-09-22T08:36:47.416 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.413+0000 7fc8ace09640 1 -- 172.21.15.142:0/3789896659 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9b0004a90 con 0x55e932287bf0 2024-09-22T08:36:47.416 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.413+0000 7fc9c4342800 1 -- 172.21.15.142:0/3789896659 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e93237d360 con 0x55e932287bf0 2024-09-22T08:36:47.416 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.413+0000 7fc9c4342800 1 -- 172.21.15.142:0/3789896659 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e93237dd60 con 0x55e932287bf0 2024-09-22T08:36:47.419 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.414+0000 7fc8ace09640 1 -- 172.21.15.142:0/3789896659 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fc9b0025020 con 0x55e932287bf0 2024-09-22T08:36:47.419 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.414+0000 7fc8ace09640 1 --2- 172.21.15.142:0/3789896659 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fc8a803cfb0 0x7fc8a803f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:47.419 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.414+0000 7fc8ace09640 1 -- 172.21.15.142:0/3789896659 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fc9b0018030 con 0x55e932287bf0 2024-09-22T08:36:47.420 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.414+0000 7fc9bf8ec640 1 --2- 172.21.15.142:0/3789896659 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fc8a803cfb0 0x7fc8a803f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:47.420 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.414+0000 7fc9c4342800 1 --2- 172.21.15.142:0/3789896659 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55e93237e860 0x55e9323841c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:47.420 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.414+0000 7fc9c4342800 1 -- 172.21.15.142:0/3789896659 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e932384750 con 0x55e93237e860 2024-09-22T08:36:47.420 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.414+0000 7fc9c08ee640 1 --2- 172.21.15.142:0/3789896659 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55e93237e860 0x55e9323841c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:47.420 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.414+0000 7fc9bf8ec640 1 --2- 172.21.15.142:0/3789896659 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fc8a803cfb0 0x7fc8a803f470 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fc9a8057000 tx=0x7fc9a8052000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:47.420 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.414+0000 7fc9c08ee640 1 --2- 172.21.15.142:0/3789896659 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55e93237e860 0x55e9323841c0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:47.420 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.415+0000 7fc9c08ee640 1 -- 172.21.15.142:0/3789896659 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc9b80083e0 con 0x55e93237e860 2024-09-22T08:36:47.420 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.415+0000 7fc9c4342800 1 -- 172.21.15.142:0/3789896659 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e93237e210 con 0x55e93237e860 2024-09-22T08:36:47.420 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.415+0000 7fc9c08ee640 1 -- 172.21.15.142:0/3789896659 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc9b80083e0 con 0x55e93237e860 2024-09-22T08:36:47.420 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.415+0000 7fc9c4342800 1 --2- 172.21.15.142:0/3789896659 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55e932386aa0 0x55e932388e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:47.420 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.415+0000 7fc9c4342800 1 -- 172.21.15.142:0/3789896659 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:3 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e932389560 con 0x55e932386aa0 2024-09-22T08:36:47.420 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.415+0000 7fc9c00ed640 1 --2- 172.21.15.142:0/3789896659 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55e932386aa0 0x55e932388e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:47.421 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.415+0000 7fc9c00ed640 1 --2- 172.21.15.142:0/3789896659 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55e932386aa0 0x55e932388e90 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:47.421 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.416+0000 7fc9c00ed640 1 -- 172.21.15.142:0/3789896659 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(3 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fc9b001b070 con 0x55e932386aa0 2024-09-22T08:36:47.421 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.416+0000 7fc9c4342800 1 -- 172.21.15.142:0/3789896659 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e932385940 con 0x55e93237e860 2024-09-22T08:36:47.421 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.416+0000 7fc9c08ee640 1 -- 172.21.15.142:0/3789896659 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc9b80083e0 con 0x55e93237e860 2024-09-22T08:36:47.421 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.416+0000 7fc9c4342800 1 -- 172.21.15.142:0/3789896659 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e932385e20 con 0x55e932386aa0 2024-09-22T08:36:47.421 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.416+0000 7fc9c00ed640 1 -- 172.21.15.142:0/3789896659 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(5 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fc9b001b070 con 0x55e932386aa0 2024-09-22T08:36:47.421 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.417+0000 7fc9c4342800 1 Processor -- start 2024-09-22T08:36:47.421 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.417+0000 7fc9c4342800 1 -- start start 2024-09-22T08:36:47.421 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.417+0000 7fc9c4342800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e932397f00 0x55e932398320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:47.421 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.417+0000 7fc9c4342800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55e93217ed50 con 0x55e932397f00 2024-09-22T08:36:47.421 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.417+0000 7fc9c08ee640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e932397f00 0x55e932398320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:47.421 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.417+0000 7fc9c08ee640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e932397f00 0x55e932398320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:39754/0 (socket says 172.21.15.142:39754) 2024-09-22T08:36:47.421 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.417+0000 7fc9c08ee640 1 -- 172.21.15.142:0/1809811197 learned_addr learned my addr 172.21.15.142:0/1809811197 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:47.422 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.417+0000 7fc9c08ee640 1 -- 172.21.15.142:0/1809811197 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e932398960 con 0x55e932397f00 2024-09-22T08:36:47.422 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.417+0000 7fc9c08ee640 1 --2- 172.21.15.142:0/1809811197 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e932397f00 0x55e932398320 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x55e93237db70 tx=0x7fc9b800bf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:47.422 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.418+0000 7fc8a5ffb640 1 -- 172.21.15.142:0/1809811197 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9b801c020 con 0x55e932397f00 2024-09-22T08:36:47.422 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.418+0000 7fc8a5ffb640 1 -- 172.21.15.142:0/1809811197 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9b8007c90 con 0x55e932397f00 2024-09-22T08:36:47.422 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.418+0000 7fc9c4342800 1 -- 172.21.15.142:0/1809811197 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e932399190 con 0x55e932397f00 2024-09-22T08:36:47.422 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.418+0000 7fc8a5ffb640 1 -- 172.21.15.142:0/1809811197 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9b8018440 con 0x55e932397f00 2024-09-22T08:36:47.422 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.418+0000 7fc9c4342800 1 -- 172.21.15.142:0/1809811197 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e932399730 con 0x55e932397f00 2024-09-22T08:36:47.431 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.418+0000 7fc8a5ffb640 1 -- 172.21.15.142:0/1809811197 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fc9b801f020 con 0x55e932397f00 2024-09-22T08:36:47.431 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.419+0000 7fc8a5ffb640 1 --2- 172.21.15.142:0/1809811197 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fc89803cfb0 0x7fc89803f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:47.431 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.419+0000 7fc8a5ffb640 1 -- 172.21.15.142:0/1809811197 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fc9b80558a0 con 0x55e932397f00 2024-09-22T08:36:47.431 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.419+0000 7fc9c00ed640 1 --2- 172.21.15.142:0/1809811197 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fc89803cfb0 0x7fc89803f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:47.431 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.419+0000 7fc9c4342800 1 Processor -- start 2024-09-22T08:36:47.431 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.419+0000 7fc9c4342800 1 -- start start 2024-09-22T08:36:47.431 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.419+0000 7fc9c00ed640 1 --2- 172.21.15.142:0/1809811197 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fc89803cfb0 0x7fc89803f470 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fc9b001d740 tx=0x7fc9b0026f90 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:47.431 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.419+0000 7fc9c4342800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e9323a4960 0x55e9323a4d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:47.431 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.419+0000 7fc9c4342800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55e932375810 con 0x55e9323a4960 2024-09-22T08:36:47.431 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.419+0000 7fc9c08ee640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e9323a4960 0x55e9323a4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:47.431 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.419+0000 7fc9c08ee640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e9323a4960 0x55e9323a4d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:39764/0 (socket says 172.21.15.142:39764) 2024-09-22T08:36:47.432 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.419+0000 7fc9c08ee640 1 -- 172.21.15.142:0/2287736946 learned_addr learned my addr 172.21.15.142:0/2287736946 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:47.432 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.420+0000 7fc9c08ee640 1 -- 172.21.15.142:0/2287736946 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e9323a5350 con 0x55e9323a4960 2024-09-22T08:36:47.432 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.420+0000 7fc9c08ee640 1 --2- 172.21.15.142:0/2287736946 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e9323a4960 0x55e9323a4d60 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fc9b8053df0 tx=0x7fc9b80158b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fadc9e8068e5661a server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:47.432 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.420+0000 7fc89f7fe640 1 -- 172.21.15.142:0/2287736946 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9b804a070 con 0x55e9323a4960 2024-09-22T08:36:47.432 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.420+0000 7fc89f7fe640 1 -- 172.21.15.142:0/2287736946 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9b8015e70 con 0x55e9323a4960 2024-09-22T08:36:47.432 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.420+0000 7fc89f7fe640 1 -- 172.21.15.142:0/2287736946 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9b80174d0 con 0x55e9323a4960 2024-09-22T08:36:47.432 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.420+0000 7fc9c4342800 1 -- 172.21.15.142:0/2287736946 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e9323a4960 msgr2=0x55e9323a4d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:47.432 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.420+0000 7fc9c4342800 1 --2- 172.21.15.142:0/2287736946 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e9323a4960 0x55e9323a4d60 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fc9b8053df0 tx=0x7fc9b80158b0 comp rx=0 tx=0).stop 2024-09-22T08:36:47.432 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.420+0000 7fc9c4342800 1 -- 172.21.15.142:0/2287736946 shutdown_connections 2024-09-22T08:36:47.432 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.420+0000 7fc9c4342800 1 --2- 172.21.15.142:0/2287736946 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e9323a4960 0x55e9323a4d60 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:47.432 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.420+0000 7fc9c4342800 1 -- 172.21.15.142:0/2287736946 >> 172.21.15.142:0/2287736946 conn(0x55e9323a0d60 msgr2=0x55e93239efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:47.432 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.420+0000 7fc9c4342800 1 -- 172.21.15.142:0/2287736946 shutdown_connections 2024-09-22T08:36:47.432 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.420+0000 7fc9c4342800 1 -- 172.21.15.142:0/2287736946 wait complete. 2024-09-22T08:36:47.432 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.421+0000 7fc9c4342800 1 Processor -- start 2024-09-22T08:36:47.433 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.421+0000 7fc9c4342800 1 -- start start 2024-09-22T08:36:47.433 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.421+0000 7fc9c4342800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e9323a4960 0x55e9323abf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:47.433 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.421+0000 7fc9c4342800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55e9323a5970 con 0x55e9323a4960 2024-09-22T08:36:47.433 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.421+0000 7fc9c08ee640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e9323a4960 0x55e9323abf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:47.433 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.421+0000 7fc9c08ee640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e9323a4960 0x55e9323abf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:39766/0 (socket says 172.21.15.142:39766) 2024-09-22T08:36:47.433 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.421+0000 7fc9c08ee640 1 -- 172.21.15.142:0/102802715 learned_addr learned my addr 172.21.15.142:0/102802715 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:47.433 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.421+0000 7fc9c08ee640 1 -- 172.21.15.142:0/102802715 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e9323ac4a0 con 0x55e9323a4960 2024-09-22T08:36:47.433 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.421+0000 7fc9c08ee640 1 --2- 172.21.15.142:0/102802715 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e9323a4960 0x55e9323abf40 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fc9b8048040 tx=0x7fc9b8053d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:47.433 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.422+0000 7fc89dffb640 1 -- 172.21.15.142:0/102802715 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9b802e070 con 0x55e9323a4960 2024-09-22T08:36:47.433 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.422+0000 7fc89dffb640 1 -- 172.21.15.142:0/102802715 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9b804b040 con 0x55e9323a4960 2024-09-22T08:36:47.433 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.422+0000 7fc9c4342800 1 -- 172.21.15.142:0/102802715 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e9323ac730 con 0x55e9323a4960 2024-09-22T08:36:47.433 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.422+0000 7fc89dffb640 1 -- 172.21.15.142:0/102802715 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9b804a070 con 0x55e9323a4960 2024-09-22T08:36:47.433 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.422+0000 7fc9c4342800 1 -- 172.21.15.142:0/102802715 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e9323ad2c0 con 0x55e9323a4960 2024-09-22T08:36:47.433 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.422+0000 7fc89dffb640 1 -- 172.21.15.142:0/102802715 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fc9b8016040 con 0x55e9323a4960 2024-09-22T08:36:47.434 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.423+0000 7fc89dffb640 1 --2- 172.21.15.142:0/102802715 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fc89003d000 0x7fc89003f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:47.434 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.423+0000 7fc89dffb640 1 -- 172.21.15.142:0/102802715 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fc9b8032ab0 con 0x55e9323a4960 2024-09-22T08:36:47.434 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.423+0000 7fc9c00ed640 1 --2- 172.21.15.142:0/102802715 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fc89003d000 0x7fc89003f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:47.434 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.423+0000 7fc9c00ed640 1 --2- 172.21.15.142:0/102802715 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fc89003d000 0x7fc89003f4c0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x55e932384bf0 tx=0x7fc9b0050000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:47.434 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.423+0000 7fc9c4342800 20 rados->read ofs=0 len=0 2024-09-22T08:36:47.434 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.423+0000 7fc9c4342800 1 --2- 172.21.15.142:0/102802715 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55e9323b7870 0x55e9323b9d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:47.434 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.423+0000 7fc9c4342800 1 -- 172.21.15.142:0/102802715 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e9323ba480 con 0x55e9323b7870 2024-09-22T08:36:47.434 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.423+0000 7fc9bf8ec640 1 --2- 172.21.15.142:0/102802715 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55e9323b7870 0x55e9323b9d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:47.434 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.424+0000 7fc9bf8ec640 1 --2- 172.21.15.142:0/102802715 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55e9323b7870 0x55e9323b9d30 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:47.434 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.424+0000 7fc9bf8ec640 1 -- 172.21.15.142:0/102802715 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc9a8057030 con 0x55e9323b7870 2024-09-22T08:36:47.434 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.424+0000 7fc9c4342800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:47.434 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.424+0000 7fc9c4342800 20 realm 2024-09-22T08:36:47.434 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.424+0000 7fc9c4342800 20 rados->read ofs=0 len=0 2024-09-22T08:36:47.435 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.424+0000 7fc9c4342800 1 -- 172.21.15.142:0/102802715 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e9323ba8b0 con 0x55e9323b7870 2024-09-22T08:36:47.435 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.424+0000 7fc9bf8ec640 1 -- 172.21.15.142:0/102802715 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc9a8057030 con 0x55e9323b7870 2024-09-22T08:36:47.435 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.424+0000 7fc9c4342800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:47.435 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.424+0000 7fc9c4342800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:36:47.435 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.424+0000 7fc9c4342800 20 rados->read ofs=0 len=0 2024-09-22T08:36:47.435 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.424+0000 7fc9c4342800 1 -- 172.21.15.142:0/102802715 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e9323bb180 con 0x55e9323b7870 2024-09-22T08:36:47.435 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.424+0000 7fc9bf8ec640 1 -- 172.21.15.142:0/102802715 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc9a8057030 con 0x55e9323b7870 2024-09-22T08:36:47.435 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.424+0000 7fc9c4342800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:47.435 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.424+0000 7fc9c4342800 20 rados->read ofs=0 len=0 2024-09-22T08:36:47.435 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.424+0000 7fc9c4342800 1 -- 172.21.15.142:0/102802715 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e9323bb520 con 0x55e9323b7870 2024-09-22T08:36:47.435 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.425+0000 7fc9bf8ec640 1 -- 172.21.15.142:0/102802715 <== osd.1 v2:172.21.15.142:6816/3192108003 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc9a8057030 con 0x55e9323b7870 2024-09-22T08:36:47.435 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.425+0000 7fc9c4342800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:36:47.435 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.425+0000 7fc9c4342800 20 rados->read ofs=0 len=0 2024-09-22T08:36:47.435 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.425+0000 7fc9c4342800 1 --2- 172.21.15.142:0/102802715 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55e9323bc280 0x55e9323be670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:47.436 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.425+0000 7fc9c4342800 1 -- 172.21.15.142:0/102802715 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e9323bec80 con 0x55e9323bc280 2024-09-22T08:36:47.436 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.425+0000 7fc9c08ee640 1 --2- 172.21.15.142:0/102802715 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55e9323bc280 0x55e9323be670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:47.436 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.425+0000 7fc9c08ee640 1 --2- 172.21.15.142:0/102802715 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55e9323bc280 0x55e9323be670 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:47.436 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.425+0000 7fc9c08ee640 1 -- 172.21.15.142:0/102802715 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(5 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fc9b80083e0 con 0x55e9323bc280 2024-09-22T08:36:47.436 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.425+0000 7fc9c4342800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:36:47.436 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.425+0000 7fc9c4342800 20 searching for the correct realm 2024-09-22T08:36:47.436 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.425+0000 7fc9c4342800 1 -- 172.21.15.142:0/102802715 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e9323c05d0 con 0x55e9323bc280 2024-09-22T08:36:47.436 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.426+0000 7fc9c08ee640 1 -- 172.21.15.142:0/102802715 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9b80083e0 con 0x55e9323bc280 2024-09-22T08:36:47.436 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.426+0000 7fc9c08ee640 1 --2- 172.21.15.142:0/102802715 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7fc9b8032020 0x7fc9b8024ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:47.436 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.426+0000 7fc9c08ee640 1 -- 172.21.15.142:0/102802715 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e9323c05d0 con 0x7fc9b8032020 2024-09-22T08:36:47.436 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.426+0000 7fc9c00ed640 1 --2- 172.21.15.142:0/102802715 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7fc9b8032020 0x7fc9b8024ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:47.436 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.426+0000 7fc9c00ed640 1 --2- 172.21.15.142:0/102802715 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7fc9b8032020 0x7fc9b8024ae0 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:47.437 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.426+0000 7fc9c00ed640 1 -- 172.21.15.142:0/102802715 <== osd.2 v2:172.21.15.142:6808/279438927 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9b001b070 con 0x7fc9b8032020 2024-09-22T08:36:47.437 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.426+0000 7fc9c00ed640 1 --2- 172.21.15.142:0/102802715 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7fc9b0027020 0x7fc9b0044210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:47.437 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.426+0000 7fc9c00ed640 1 -- 172.21.15.142:0/102802715 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e9323c05d0 con 0x7fc9b0027020 2024-09-22T08:36:47.437 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.427+0000 7fc9bf8ec640 1 --2- 172.21.15.142:0/102802715 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7fc9b0027020 0x7fc9b0044210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:47.437 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.427+0000 7fc9bf8ec640 1 --2- 172.21.15.142:0/102802715 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7fc9b0027020 0x7fc9b0044210 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:47.437 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.427+0000 7fc9bf8ec640 1 -- 172.21.15.142:0/102802715 <== osd.0 v2:172.21.15.31:6800/168281188 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9a8057030 con 0x7fc9b0027020 2024-09-22T08:36:47.437 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.427+0000 7fc9bf8ec640 1 -- 172.21.15.142:0/102802715 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e9323c05d0 con 0x55e9323b7870 2024-09-22T08:36:47.437 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.428+0000 7fc9bf8ec640 1 -- 172.21.15.142:0/102802715 <== osd.1 v2:172.21.15.142:6816/3192108003 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9a8057030 con 0x55e9323b7870 2024-09-22T08:36:47.437 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.428+0000 7fc9bf8ec640 1 -- 172.21.15.142:0/102802715 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e9323c05d0 con 0x55e9323b7870 2024-09-22T08:36:47.437 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.428+0000 7fc9bf8ec640 1 -- 172.21.15.142:0/102802715 <== osd.1 v2:172.21.15.142:6816/3192108003 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9a8057030 con 0x55e9323b7870 2024-09-22T08:36:47.437 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.428+0000 7fc9bf8ec640 1 -- 172.21.15.142:0/102802715 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e9323c05d0 con 0x7fc9b0027020 2024-09-22T08:36:47.437 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.428+0000 7fc9bf8ec640 1 -- 172.21.15.142:0/102802715 <== osd.0 v2:172.21.15.31:6800/168281188 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9a8057030 con 0x7fc9b0027020 2024-09-22T08:36:47.437 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.428+0000 7fc9bf8ec640 1 -- 172.21.15.142:0/102802715 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e9323c05d0 con 0x7fc9b0027020 2024-09-22T08:36:47.437 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.428+0000 7fc9bf8ec640 1 -- 172.21.15.142:0/102802715 <== osd.0 v2:172.21.15.31:6800/168281188 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9a8057030 con 0x7fc9b0027020 2024-09-22T08:36:47.438 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.428+0000 7fc9bf8ec640 1 -- 172.21.15.142:0/102802715 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e9323c05d0 con 0x7fc9b8032020 2024-09-22T08:36:47.438 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.429+0000 7fc9c00ed640 1 -- 172.21.15.142:0/102802715 <== osd.2 v2:172.21.15.142:6808/279438927 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9b001b070 con 0x7fc9b8032020 2024-09-22T08:36:47.438 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.429+0000 7fc9c00ed640 1 -- 172.21.15.142:0/102802715 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e9323c05d0 con 0x55e9323bc280 2024-09-22T08:36:47.438 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.429+0000 7fc9c08ee640 1 -- 172.21.15.142:0/102802715 <== osd.3 v2:172.21.15.142:6800/1064901393 3 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9b80083e0 con 0x55e9323bc280 2024-09-22T08:36:47.438 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.429+0000 7fc9c08ee640 1 -- 172.21.15.142:0/102802715 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e9323c05d0 con 0x55e9323b7870 2024-09-22T08:36:47.438 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.429+0000 7fc9bf8ec640 1 -- 172.21.15.142:0/102802715 <== osd.1 v2:172.21.15.142:6816/3192108003 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9a8057030 con 0x55e9323b7870 2024-09-22T08:36:47.438 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.429+0000 7fc9bf8ec640 1 -- 172.21.15.142:0/102802715 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e9323c05d0 con 0x7fc9b0027020 2024-09-22T08:36:47.438 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.429+0000 7fc9bf8ec640 1 -- 172.21.15.142:0/102802715 <== osd.0 v2:172.21.15.31:6800/168281188 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9a8057030 con 0x7fc9b0027020 2024-09-22T08:36:47.438 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.429+0000 7fc9bf8ec640 1 -- 172.21.15.142:0/102802715 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e9323c05d0 con 0x55e9323b7870 2024-09-22T08:36:47.438 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.430+0000 7fc9bf8ec640 1 -- 172.21.15.142:0/102802715 <== osd.1 v2:172.21.15.142:6816/3192108003 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9a8057030 con 0x55e9323b7870 2024-09-22T08:36:47.438 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.430+0000 7fc9bf8ec640 1 -- 172.21.15.142:0/102802715 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e9323c05d0 con 0x7fc9b8032020 2024-09-22T08:36:47.438 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.430+0000 7fc9c00ed640 1 -- 172.21.15.142:0/102802715 <== osd.2 v2:172.21.15.142:6808/279438927 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fc9b001b070 con 0x7fc9b8032020 2024-09-22T08:36:47.438 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.430+0000 7fc9c00ed640 1 -- 172.21.15.142:0/102802715 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e9323c05d0 con 0x55e9323bc280 2024-09-22T08:36:47.447 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.430+0000 7fc9c08ee640 1 -- 172.21.15.142:0/102802715 <== osd.3 v2:172.21.15.142:6800/1064901393 4 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9b80083e0 con 0x55e9323bc280 2024-09-22T08:36:47.447 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.430+0000 7fc9c08ee640 1 -- 172.21.15.142:0/102802715 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e9323c05d0 con 0x55e9323bc280 2024-09-22T08:36:47.447 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.430+0000 7fc9c08ee640 1 -- 172.21.15.142:0/102802715 <== osd.3 v2:172.21.15.142:6800/1064901393 5 ==== osd_op_reply(20 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fc9b80083e0 con 0x55e9323bc280 2024-09-22T08:36:47.447 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.430+0000 7fc9c08ee640 1 -- 172.21.15.142:0/102802715 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e9323c05d0 con 0x7fc9b0027020 2024-09-22T08:36:47.448 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.430+0000 7fc9bf8ec640 1 -- 172.21.15.142:0/102802715 <== osd.0 v2:172.21.15.31:6800/168281188 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9a8057030 con 0x7fc9b0027020 2024-09-22T08:36:47.448 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.430+0000 7fc9bf8ec640 1 -- 172.21.15.142:0/102802715 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e9323c05d0 con 0x55e9323bc280 2024-09-22T08:36:47.448 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.431+0000 7fc9c08ee640 1 -- 172.21.15.142:0/102802715 <== osd.3 v2:172.21.15.142:6800/1064901393 6 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9b80083e0 con 0x55e9323bc280 2024-09-22T08:36:47.448 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.431+0000 7fc9c08ee640 1 -- 172.21.15.142:0/102802715 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e9323c05d0 con 0x55e9323bc280 2024-09-22T08:36:47.448 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.431+0000 7fc9c08ee640 1 -- 172.21.15.142:0/102802715 <== osd.3 v2:172.21.15.142:6800/1064901393 7 ==== osd_op_reply(23 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fc9b80083e0 con 0x55e9323bc280 2024-09-22T08:36:47.448 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.431+0000 7fc9c08ee640 1 -- 172.21.15.142:0/102802715 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e9323c05d0 con 0x55e9323b7870 2024-09-22T08:36:47.448 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.431+0000 7fc9bf8ec640 1 -- 172.21.15.142:0/102802715 <== osd.1 v2:172.21.15.142:6816/3192108003 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9a8057030 con 0x55e9323b7870 2024-09-22T08:36:47.448 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.431+0000 7fc9bf8ec640 1 -- 172.21.15.142:0/102802715 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e9323c05d0 con 0x55e9323b7870 2024-09-22T08:36:47.448 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.431+0000 7fc9bf8ec640 1 -- 172.21.15.142:0/102802715 <== osd.1 v2:172.21.15.142:6816/3192108003 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fc9a8057030 con 0x55e9323b7870 2024-09-22T08:36:47.448 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.431+0000 7fc9bf8ec640 1 -- 172.21.15.142:0/102802715 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e9323c05d0 con 0x7fc9b0027020 2024-09-22T08:36:47.448 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.432+0000 7fc9bf8ec640 1 -- 172.21.15.142:0/102802715 <== osd.0 v2:172.21.15.31:6800/168281188 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9a8057030 con 0x7fc9b0027020 2024-09-22T08:36:47.448 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.432+0000 7fc9bf8ec640 1 -- 172.21.15.142:0/102802715 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e9323c05d0 con 0x55e9323bc280 2024-09-22T08:36:47.448 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.432+0000 7fc9c08ee640 1 -- 172.21.15.142:0/102802715 <== osd.3 v2:172.21.15.142:6800/1064901393 8 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9b80083e0 con 0x55e9323bc280 2024-09-22T08:36:47.448 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.432+0000 7fc9c08ee640 1 -- 172.21.15.142:0/102802715 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e9323c05d0 con 0x7fc9b8032020 2024-09-22T08:36:47.449 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.432+0000 7fc9c00ed640 1 -- 172.21.15.142:0/102802715 <== osd.2 v2:172.21.15.142:6808/279438927 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9b001b070 con 0x7fc9b8032020 2024-09-22T08:36:47.449 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.432+0000 7fc9c00ed640 1 -- 172.21.15.142:0/102802715 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e9323c05d0 con 0x55e9323b7870 2024-09-22T08:36:47.449 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.432+0000 7fc9bf8ec640 1 -- 172.21.15.142:0/102802715 <== osd.1 v2:172.21.15.142:6816/3192108003 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9a8057030 con 0x55e9323b7870 2024-09-22T08:36:47.449 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.432+0000 7fc9bf8ec640 1 -- 172.21.15.142:0/102802715 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e9323c05d0 con 0x7fc9b0027020 2024-09-22T08:36:47.449 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.433+0000 7fc9bf8ec640 1 -- 172.21.15.142:0/102802715 <== osd.0 v2:172.21.15.31:6800/168281188 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9a8057030 con 0x7fc9b0027020 2024-09-22T08:36:47.449 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.433+0000 7fc9bf8ec640 1 -- 172.21.15.142:0/102802715 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e9323c05d0 con 0x55e9323bc280 2024-09-22T08:36:47.449 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.433+0000 7fc9c08ee640 1 -- 172.21.15.142:0/102802715 <== osd.3 v2:172.21.15.142:6800/1064901393 9 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9b80083e0 con 0x55e9323bc280 2024-09-22T08:36:47.449 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.433+0000 7fc9c08ee640 1 -- 172.21.15.142:0/102802715 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e9323c05d0 con 0x7fc9b0027020 2024-09-22T08:36:47.449 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.433+0000 7fc9bf8ec640 1 -- 172.21.15.142:0/102802715 <== osd.0 v2:172.21.15.31:6800/168281188 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9a8057030 con 0x7fc9b0027020 2024-09-22T08:36:47.449 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.433+0000 7fc9bf8ec640 1 -- 172.21.15.142:0/102802715 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e9323c05d0 con 0x7fc9b8032020 2024-09-22T08:36:47.449 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.433+0000 7fc9c00ed640 1 -- 172.21.15.142:0/102802715 <== osd.2 v2:172.21.15.142:6808/279438927 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9b001b070 con 0x7fc9b8032020 2024-09-22T08:36:47.449 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.433+0000 7fc9c00ed640 1 -- 172.21.15.142:0/102802715 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e9323c05d0 con 0x55e9323bc280 2024-09-22T08:36:47.449 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.434+0000 7fc9c08ee640 1 -- 172.21.15.142:0/102802715 <== osd.3 v2:172.21.15.142:6800/1064901393 10 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9b80083e0 con 0x55e9323bc280 2024-09-22T08:36:47.449 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.434+0000 7fc9c08ee640 1 -- 172.21.15.142:0/102802715 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e9323c05d0 con 0x7fc9b0027020 2024-09-22T08:36:47.450 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.434+0000 7fc9bf8ec640 1 -- 172.21.15.142:0/102802715 <== osd.0 v2:172.21.15.31:6800/168281188 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9a8057030 con 0x7fc9b0027020 2024-09-22T08:36:47.450 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.434+0000 7fc9bf8ec640 1 -- 172.21.15.142:0/102802715 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e9323c05d0 con 0x55e9323b7870 2024-09-22T08:36:47.450 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.434+0000 7fc9bf8ec640 1 -- 172.21.15.142:0/102802715 <== osd.1 v2:172.21.15.142:6816/3192108003 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fc9a8057030 con 0x55e9323b7870 2024-09-22T08:36:47.450 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.434+0000 7fc9bf8ec640 1 -- 172.21.15.142:0/102802715 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e9323c05d0 con 0x7fc9b8032020 2024-09-22T08:36:47.450 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.434+0000 7fc9c00ed640 1 -- 172.21.15.142:0/102802715 <== osd.2 v2:172.21.15.142:6808/279438927 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9b001b070 con 0x7fc9b8032020 2024-09-22T08:36:47.450 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.434+0000 7fc9c4342800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:36:47.450 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.434+0000 7fc9c4342800 20 RGWRados::pool_iterate: got zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec 2024-09-22T08:36:47.450 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.434+0000 7fc9c4342800 20 RGWRados::pool_iterate: got zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f 2024-09-22T08:36:47.450 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.434+0000 7fc9c4342800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:36:47.450 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.434+0000 7fc9c4342800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:36:47.450 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.434+0000 7fc9c4342800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:36:47.450 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.434+0000 7fc9c4342800 20 rados->read ofs=0 len=0 2024-09-22T08:36:47.450 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.434+0000 7fc9c4342800 1 -- 172.21.15.142:0/102802715 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e9323bf670 con 0x55e9323b7870 2024-09-22T08:36:47.451 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.435+0000 7fc9bf8ec640 1 -- 172.21.15.142:0/102802715 <== osd.1 v2:172.21.15.142:6816/3192108003 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc9a8057030 con 0x55e9323b7870 2024-09-22T08:36:47.451 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.435+0000 7fc9c4342800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:47.451 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.435+0000 7fc9c4342800 20 rados->read ofs=0 len=0 2024-09-22T08:36:47.451 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.435+0000 7fc9c4342800 1 -- 172.21.15.142:0/102802715 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e9323bfec0 con 0x55e9323b7870 2024-09-22T08:36:47.451 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.435+0000 7fc9bf8ec640 1 -- 172.21.15.142:0/102802715 <== osd.1 v2:172.21.15.142:6816/3192108003 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc9a8057030 con 0x55e9323b7870 2024-09-22T08:36:47.451 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.435+0000 7fc9c4342800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:36:47.451 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.435+0000 7fc9c4342800 20 rados->read ofs=0 len=0 2024-09-22T08:36:47.451 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.435+0000 7fc9c4342800 1 -- 172.21.15.142:0/102802715 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:40 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e9323c0a50 con 0x55e9323bc280 2024-09-22T08:36:47.451 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.435+0000 7fc9c08ee640 1 -- 172.21.15.142:0/102802715 <== osd.3 v2:172.21.15.142:6800/1064901393 11 ==== osd_op_reply(40 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fc9b80083e0 con 0x55e9323bc280 2024-09-22T08:36:47.451 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.435+0000 7fc9c4342800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:36:47.451 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.435+0000 7fc9c4342800 20 zone default found 2024-09-22T08:36:47.451 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.435+0000 7fc9c4342800 4 Realm: () 2024-09-22T08:36:47.451 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.435+0000 7fc9c4342800 4 ZoneGroup: default (d89f6f57-1007-47dd-9065-f486c7b01aec) 2024-09-22T08:36:47.451 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.435+0000 7fc9c4342800 4 Zone: default (e239248c-0bee-4e41-803a-24b288d3eb8f) 2024-09-22T08:36:47.451 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.435+0000 7fc9c4342800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:36:47.452 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.435+0000 7fc9c4342800 20 zonegroup default 2024-09-22T08:36:47.452 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.435+0000 7fc9c4342800 20 rados->read ofs=0 len=0 2024-09-22T08:36:47.452 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.435+0000 7fc9c4342800 1 -- 172.21.15.142:0/102802715 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e9323c0e30 con 0x7fc9b0027020 2024-09-22T08:36:47.452 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.436+0000 7fc9bf8ec640 1 -- 172.21.15.142:0/102802715 <== osd.0 v2:172.21.15.31:6800/168281188 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fc9a8057030 con 0x7fc9b0027020 2024-09-22T08:36:47.452 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.436+0000 7fc9c4342800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:47.452 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.436+0000 7fc9c4342800 20 rados->read ofs=0 len=0 2024-09-22T08:36:47.452 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.436+0000 7fc9c4342800 1 -- 172.21.15.142:0/102802715 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e9323c3110 con 0x55e9323bc280 2024-09-22T08:36:47.452 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.436+0000 7fc9c08ee640 1 -- 172.21.15.142:0/102802715 <== osd.3 v2:172.21.15.142:6800/1064901393 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc9b80083e0 con 0x55e9323bc280 2024-09-22T08:36:47.452 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.436+0000 7fc9c4342800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:47.452 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.436+0000 7fc9c4342800 20 rados->read ofs=0 len=0 2024-09-22T08:36:47.452 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.436+0000 7fc9c4342800 1 -- 172.21.15.142:0/102802715 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e9323c34b0 con 0x55e9323bc280 2024-09-22T08:36:47.452 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.436+0000 7fc9c08ee640 1 -- 172.21.15.142:0/102802715 <== osd.3 v2:172.21.15.142:6800/1064901393 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc9b80083e0 con 0x55e9323bc280 2024-09-22T08:36:47.452 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.436+0000 7fc9c4342800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:47.452 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.436+0000 7fc9c4342800 20 started sync module instance, tier type = 2024-09-22T08:36:47.453 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.436+0000 7fc9c4342800 20 started zone id=e239248c-0bee-4e41-803a-24b288d3eb8f (name=default) with tier type = 2024-09-22T08:36:47.453 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.436+0000 7fc9c4342800 1 -- 172.21.15.142:0/102802715 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e9323c2550 con 0x7fc9b8032020 2024-09-22T08:36:47.453 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.437+0000 7fc9c00ed640 1 -- 172.21.15.142:0/102802715 <== osd.2 v2:172.21.15.142:6808/279438927 7 ==== osd_op_reply(44 notify.0 [create] v30'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9b001b070 con 0x7fc9b8032020 2024-09-22T08:36:47.453 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.437+0000 7fc9c4342800 1 -- 172.21.15.142:0/102802715 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94460058542240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e9323c38f0 con 0x7fc9b8032020 2024-09-22T08:36:47.453 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.437+0000 7fc9c4342800 1 -- 172.21.15.142:0/102802715 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e9323c4140 con 0x55e9323b7870 2024-09-22T08:36:47.453 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.438+0000 7fc9c00ed640 1 -- 172.21.15.142:0/102802715 <== osd.2 v2:172.21.15.142:6808/279438927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94460058542240] v30'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9b001b070 con 0x7fc9b8032020 2024-09-22T08:36:47.453 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.438+0000 7fc9bf8ec640 1 -- 172.21.15.142:0/102802715 <== osd.1 v2:172.21.15.142:6816/3192108003 15 ==== osd_op_reply(46 notify.1 [create] v30'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9a8057030 con 0x55e9323b7870 2024-09-22T08:36:47.453 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.438+0000 7fc9c4342800 1 -- 172.21.15.142:0/102802715 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94460058549392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e9323c4560 con 0x55e9323b7870 2024-09-22T08:36:47.453 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.438+0000 7fc9c4342800 1 -- 172.21.15.142:0/102802715 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e9323c4df0 con 0x55e9323bc280 2024-09-22T08:36:47.453 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.439+0000 7fc9bf8ec640 1 -- 172.21.15.142:0/102802715 <== osd.1 v2:172.21.15.142:6816/3192108003 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94460058549392] v30'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9a8057030 con 0x55e9323b7870 2024-09-22T08:36:47.453 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.440+0000 7fc9c08ee640 1 -- 172.21.15.142:0/102802715 <== osd.3 v2:172.21.15.142:6800/1064901393 14 ==== osd_op_reply(48 notify.2 [create] v30'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9b80083e0 con 0x55e9323bc280 2024-09-22T08:36:47.453 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.440+0000 7fc9c4342800 1 -- 172.21.15.142:0/102802715 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94460058550448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e9323c4980 con 0x55e9323bc280 2024-09-22T08:36:47.453 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.440+0000 7fc9c4342800 1 -- 172.21.15.142:0/102802715 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e9323c5840 con 0x7fc9b8032020 2024-09-22T08:36:47.454 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.441+0000 7fc9c08ee640 1 -- 172.21.15.142:0/102802715 <== osd.3 v2:172.21.15.142:6800/1064901393 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94460058550448] v30'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9b80083e0 con 0x55e9323bc280 2024-09-22T08:36:47.454 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.441+0000 7fc9c00ed640 1 -- 172.21.15.142:0/102802715 <== osd.2 v2:172.21.15.142:6808/279438927 9 ==== osd_op_reply(50 notify.3 [create] v30'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9b001b070 con 0x7fc9b8032020 2024-09-22T08:36:47.454 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.441+0000 7fc9c4342800 1 -- 172.21.15.142:0/102802715 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94460058551504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e9323c48f0 con 0x7fc9b8032020 2024-09-22T08:36:47.454 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.441+0000 7fc9c4342800 1 -- 172.21.15.142:0/102802715 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e9323c6700 con 0x55e9323b7870 2024-09-22T08:36:47.454 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.442+0000 7fc9c00ed640 1 -- 172.21.15.142:0/102802715 <== osd.2 v2:172.21.15.142:6808/279438927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94460058551504] v30'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9b001b070 con 0x7fc9b8032020 2024-09-22T08:36:47.454 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.442+0000 7fc9bf8ec640 1 -- 172.21.15.142:0/102802715 <== osd.1 v2:172.21.15.142:6816/3192108003 17 ==== osd_op_reply(52 notify.4 [create] v30'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9a8057030 con 0x55e9323b7870 2024-09-22T08:36:47.454 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.442+0000 7fc9c4342800 1 -- 172.21.15.142:0/102802715 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94460058557488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e9323c6700 con 0x55e9323b7870 2024-09-22T08:36:47.454 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.442+0000 7fc9c4342800 1 -- 172.21.15.142:0/102802715 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e9323c7150 con 0x7fc9b0027020 2024-09-22T08:36:47.454 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.443+0000 7fc9bf8ec640 1 -- 172.21.15.142:0/102802715 <== osd.1 v2:172.21.15.142:6816/3192108003 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94460058557488] v30'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9a8057030 con 0x55e9323b7870 2024-09-22T08:36:47.454 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.443+0000 7fc9bf8ec640 1 -- 172.21.15.142:0/102802715 <== osd.0 v2:172.21.15.31:6800/168281188 11 ==== osd_op_reply(54 notify.5 [create] v30'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9a8057030 con 0x7fc9b0027020 2024-09-22T08:36:47.454 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.443+0000 7fc9c4342800 1 -- 172.21.15.142:0/102802715 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94460058561632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e9323c6700 con 0x7fc9b0027020 2024-09-22T08:36:47.454 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.443+0000 7fc9c4342800 1 -- 172.21.15.142:0/102802715 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e9323c7ba0 con 0x7fc9b0027020 2024-09-22T08:36:47.455 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.444+0000 7fc9bf8ec640 1 -- 172.21.15.142:0/102802715 <== osd.0 v2:172.21.15.31:6800/168281188 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94460058561632] v30'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9a8057030 con 0x7fc9b0027020 2024-09-22T08:36:47.455 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.444+0000 7fc9bf8ec640 1 -- 172.21.15.142:0/102802715 <== osd.0 v2:172.21.15.31:6800/168281188 13 ==== osd_op_reply(56 notify.6 [create] v30'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9a8057030 con 0x7fc9b0027020 2024-09-22T08:36:47.455 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.444+0000 7fc9c4342800 1 -- 172.21.15.142:0/102802715 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94460058564272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e9323c7d80 con 0x7fc9b0027020 2024-09-22T08:36:47.455 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.444+0000 7fc9c4342800 1 -- 172.21.15.142:0/102802715 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e9323c85d0 con 0x7fc9b0027020 2024-09-22T08:36:47.455 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.445+0000 7fc9bf8ec640 1 -- 172.21.15.142:0/102802715 <== osd.0 v2:172.21.15.31:6800/168281188 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94460058564272] v30'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9a8057030 con 0x7fc9b0027020 2024-09-22T08:36:47.455 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.445+0000 7fc9bf8ec640 1 -- 172.21.15.142:0/102802715 <== osd.0 v2:172.21.15.31:6800/168281188 15 ==== osd_op_reply(58 notify.7 [create] v30'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9a8057030 con 0x7fc9b0027020 2024-09-22T08:36:47.455 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.445+0000 7fc9c4342800 1 -- 172.21.15.142:0/102802715 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94460058566016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e9323c8650 con 0x7fc9b0027020 2024-09-22T08:36:47.455 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.445+0000 7fc9c4342800 20 add_watcher() i=0 2024-09-22T08:36:47.455 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.445+0000 7fc9c4342800 20 add_watcher() i=1 2024-09-22T08:36:47.455 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.445+0000 7fc9c4342800 20 add_watcher() i=2 2024-09-22T08:36:47.455 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.445+0000 7fc9c4342800 20 add_watcher() i=3 2024-09-22T08:36:47.455 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.445+0000 7fc9c4342800 20 add_watcher() i=4 2024-09-22T08:36:47.455 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.445+0000 7fc9c4342800 20 add_watcher() i=5 2024-09-22T08:36:47.456 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.445+0000 7fc9c4342800 20 add_watcher() i=6 2024-09-22T08:36:47.456 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.446+0000 7fc9bf8ec640 1 -- 172.21.15.142:0/102802715 <== osd.0 v2:172.21.15.31:6800/168281188 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94460058566016] v30'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9a8057030 con 0x7fc9b0027020 2024-09-22T08:36:47.456 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.446+0000 7fc9c4342800 20 add_watcher() i=7 2024-09-22T08:36:47.456 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.446+0000 7fc9c4342800 2 all 8 watchers are set, enabling cache 2024-09-22T08:36:47.456 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.446+0000 7fc9c4342800 1 -- 172.21.15.142:0/102802715 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e9323cba70 con 0x55e9323b7870 2024-09-22T08:36:47.458 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.447+0000 7fc9bf8ec640 1 -- 172.21.15.142:0/102802715 <== osd.1 v2:172.21.15.142:6816/3192108003 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fc9a8057030 con 0x55e9323b7870 2024-09-22T08:36:47.458 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.447+0000 7fc9c4342800 1 -- 172.21.15.142:0/102802715 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94460058580128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e9323c87c0 con 0x55e9323b7870 2024-09-22T08:36:47.458 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.448+0000 7fc9bf8ec640 1 -- 172.21.15.142:0/102802715 <== osd.1 v2:172.21.15.142:6816/3192108003 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94460058580128] v30'121 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc9a8057030 con 0x55e9323b7870 2024-09-22T08:36:47.458 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.448+0000 7fc8767e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:36:47.458 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.448+0000 7fc9c4342800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:36:47.458 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.448+0000 7fc9c4342800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:36:47.458 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.448+0000 7fc9c4342800 1 -- 172.21.15.142:0/102802715 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e9323d45a0 con 0x55e9323b7870 2024-09-22T08:36:47.458 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.449+0000 7fc9bf8ec640 1 -- 172.21.15.142:0/102802715 <== osd.1 v2:172.21.15.142:6816/3192108003 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v30'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc9a8057030 con 0x55e9323b7870 2024-09-22T08:36:47.459 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.449+0000 7fc9c4342800 1 -- 172.21.15.142:0/102802715 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e9323d4c30 con 0x7fc9b0027020 2024-09-22T08:36:47.459 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.450+0000 7fc9bf8ec640 1 -- 172.21.15.142:0/102802715 <== osd.0 v2:172.21.15.31:6800/168281188 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v30'15 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc9a8057030 con 0x7fc9b0027020 2024-09-22T08:36:47.459 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.450+0000 7fc9c4342800 1 -- 172.21.15.142:0/102802715 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e9323d5030 con 0x55e9323bc280 2024-09-22T08:36:47.459 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.451+0000 7fc9c08ee640 1 -- 172.21.15.142:0/102802715 <== osd.3 v2:172.21.15.142:6800/1064901393 16 ==== osd_op_reply(64 gc.2 [create,call,call,call] v30'15 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc9b80083e0 con 0x55e9323bc280 2024-09-22T08:36:47.459 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.452+0000 7fc9c4342800 1 -- 172.21.15.142:0/102802715 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e9323d4f20 con 0x55e9323b7870 2024-09-22T08:36:47.459 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.452+0000 7fc9bf8ec640 1 -- 172.21.15.142:0/102802715 <== osd.1 v2:172.21.15.142:6816/3192108003 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v30'122 uv15 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc9a8057030 con 0x55e9323b7870 2024-09-22T08:36:47.459 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.452+0000 7fc9c4342800 1 -- 172.21.15.142:0/102802715 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e9323d54f0 con 0x7fc9b8032020 2024-09-22T08:36:47.459 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.453+0000 7fc9c00ed640 1 -- 172.21.15.142:0/102802715 <== osd.2 v2:172.21.15.142:6808/279438927 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v30'35 uv13 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc9b001b070 con 0x7fc9b8032020 2024-09-22T08:36:47.459 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.453+0000 7fc9c4342800 1 -- 172.21.15.142:0/102802715 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e9323d5940 con 0x55e9323bc280 2024-09-22T08:36:47.459 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.454+0000 7fc9c08ee640 1 -- 172.21.15.142:0/102802715 <== osd.3 v2:172.21.15.142:6800/1064901393 17 ==== osd_op_reply(67 gc.5 [create,call,call,call] v30'23 uv10 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc9b80083e0 con 0x55e9323bc280 2024-09-22T08:36:47.459 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.454+0000 7fc9c4342800 1 -- 172.21.15.142:0/102802715 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e9323d5940 con 0x55e9323b7870 2024-09-22T08:36:47.459 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.456+0000 7fc9bf8ec640 1 -- 172.21.15.142:0/102802715 <== osd.1 v2:172.21.15.142:6816/3192108003 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v30'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc9a8057030 con 0x55e9323b7870 2024-09-22T08:36:47.459 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.456+0000 7fc9c4342800 1 -- 172.21.15.142:0/102802715 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e9323d02c0 con 0x7fc9b0027020 2024-09-22T08:36:47.460 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.457+0000 7fc9bf8ec640 1 -- 172.21.15.142:0/102802715 <== osd.0 v2:172.21.15.31:6800/168281188 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v30'23 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc9a8057030 con 0x7fc9b0027020 2024-09-22T08:36:47.460 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.457+0000 7fc9c4342800 1 -- 172.21.15.142:0/102802715 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e9323d02c0 con 0x7fc9b8032020 2024-09-22T08:36:47.460 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.458+0000 7fc9c00ed640 1 -- 172.21.15.142:0/102802715 <== osd.2 v2:172.21.15.142:6808/279438927 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v30'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc9b001b070 con 0x7fc9b8032020 2024-09-22T08:36:47.461 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.458+0000 7fc9c4342800 1 -- 172.21.15.142:0/102802715 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e9323d02c0 con 0x55e9323bc280 2024-09-22T08:36:47.461 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.459+0000 7fc9c08ee640 1 -- 172.21.15.142:0/102802715 <== osd.3 v2:172.21.15.142:6800/1064901393 18 ==== osd_op_reply(71 gc.9 [create,call,call,call] v30'21 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc9b80083e0 con 0x55e9323bc280 2024-09-22T08:36:47.461 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.459+0000 7fc9c4342800 1 -- 172.21.15.142:0/102802715 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e9323d02c0 con 0x7fc9b8032020 2024-09-22T08:36:47.461 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.459+0000 7fc9c00ed640 1 -- 172.21.15.142:0/102802715 <== osd.2 v2:172.21.15.142:6808/279438927 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v30'36 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc9b001b070 con 0x7fc9b8032020 2024-09-22T08:36:47.461 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.459+0000 7fc9c4342800 1 -- 172.21.15.142:0/102802715 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e9323d02c0 con 0x7fc9b0027020 2024-09-22T08:36:47.461 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.461+0000 7fc9bf8ec640 1 -- 172.21.15.142:0/102802715 <== osd.0 v2:172.21.15.31:6800/168281188 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v30'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc9a8057030 con 0x7fc9b0027020 2024-09-22T08:36:47.462 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.461+0000 7fc9c4342800 1 -- 172.21.15.142:0/102802715 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e9323d0320 con 0x7fc9b8032020 2024-09-22T08:36:47.463 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.462+0000 7fc9c00ed640 1 -- 172.21.15.142:0/102802715 <== osd.2 v2:172.21.15.142:6808/279438927 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v30'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc9b001b070 con 0x7fc9b8032020 2024-09-22T08:36:47.463 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.462+0000 7fc9c4342800 1 -- 172.21.15.142:0/102802715 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e9323d0350 con 0x7fc9b0027020 2024-09-22T08:36:47.464 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.463+0000 7fc9bf8ec640 1 -- 172.21.15.142:0/102802715 <== osd.0 v2:172.21.15.31:6800/168281188 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v30'31 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc9a8057030 con 0x7fc9b0027020 2024-09-22T08:36:47.464 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.463+0000 7fc9c4342800 1 -- 172.21.15.142:0/102802715 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e9323d0350 con 0x55e9323b7870 2024-09-22T08:36:47.465 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.464+0000 7fc9bf8ec640 1 -- 172.21.15.142:0/102802715 <== osd.1 v2:172.21.15.142:6816/3192108003 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v30'123 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc9a8057030 con 0x55e9323b7870 2024-09-22T08:36:47.465 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.464+0000 7fc9c4342800 1 -- 172.21.15.142:0/102802715 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e9323d0350 con 0x55e9323bc280 2024-09-22T08:36:47.466 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.465+0000 7fc9c08ee640 1 -- 172.21.15.142:0/102802715 <== osd.3 v2:172.21.15.142:6800/1064901393 19 ==== osd_op_reply(77 gc.15 [create,call,call,call] v30'29 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc9b80083e0 con 0x55e9323bc280 2024-09-22T08:36:47.466 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.465+0000 7fc9c4342800 1 -- 172.21.15.142:0/102802715 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e9323d0440 con 0x7fc9b8032020 2024-09-22T08:36:47.467 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.466+0000 7fc9c00ed640 1 -- 172.21.15.142:0/102802715 <== osd.2 v2:172.21.15.142:6808/279438927 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v30'37 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc9b001b070 con 0x7fc9b8032020 2024-09-22T08:36:47.467 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.466+0000 7fc9c4342800 1 -- 172.21.15.142:0/102802715 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e9323d6340 con 0x55e9323bc280 2024-09-22T08:36:47.468 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.467+0000 7fc9c08ee640 1 -- 172.21.15.142:0/102802715 <== osd.3 v2:172.21.15.142:6800/1064901393 20 ==== osd_op_reply(79 gc.17 [create,call,call,call] v30'15 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc9b80083e0 con 0x55e9323bc280 2024-09-22T08:36:47.468 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.467+0000 7fc9c4342800 1 -- 172.21.15.142:0/102802715 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e9323d62e0 con 0x55e9323b7870 2024-09-22T08:36:47.470 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.469+0000 7fc9bf8ec640 1 -- 172.21.15.142:0/102802715 <== osd.1 v2:172.21.15.142:6816/3192108003 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v30'23 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc9a8057030 con 0x55e9323b7870 2024-09-22T08:36:47.470 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.469+0000 7fc9c4342800 1 -- 172.21.15.142:0/102802715 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e9323d62e0 con 0x55e9323b7870 2024-09-22T08:36:47.471 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.470+0000 7fc9bf8ec640 1 -- 172.21.15.142:0/102802715 <== osd.1 v2:172.21.15.142:6816/3192108003 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v30'124 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc9a8057030 con 0x55e9323b7870 2024-09-22T08:36:47.471 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.470+0000 7fc9c4342800 1 -- 172.21.15.142:0/102802715 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e9323d62e0 con 0x55e9323bc280 2024-09-22T08:36:47.472 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.471+0000 7fc9c08ee640 1 -- 172.21.15.142:0/102802715 <== osd.3 v2:172.21.15.142:6800/1064901393 21 ==== osd_op_reply(82 gc.20 [create,call,call,call] v30'30 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc9b80083e0 con 0x55e9323bc280 2024-09-22T08:36:47.472 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.471+0000 7fc9c4342800 1 -- 172.21.15.142:0/102802715 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e9323d62c0 con 0x7fc9b8032020 2024-09-22T08:36:47.473 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.472+0000 7fc9c00ed640 1 -- 172.21.15.142:0/102802715 <== osd.2 v2:172.21.15.142:6808/279438927 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v30'25 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc9b001b070 con 0x7fc9b8032020 2024-09-22T08:36:47.473 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.472+0000 7fc9c4342800 1 -- 172.21.15.142:0/102802715 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e9323d62c0 con 0x55e9323bc280 2024-09-22T08:36:47.474 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.473+0000 7fc9c08ee640 1 -- 172.21.15.142:0/102802715 <== osd.3 v2:172.21.15.142:6800/1064901393 22 ==== osd_op_reply(84 gc.22 [create,call,call,call] v30'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc9b80083e0 con 0x55e9323bc280 2024-09-22T08:36:47.474 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.473+0000 7fc9c4342800 1 -- 172.21.15.142:0/102802715 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e9323d62c0 con 0x55e9323bc280 2024-09-22T08:36:47.475 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.474+0000 7fc9c08ee640 1 -- 172.21.15.142:0/102802715 <== osd.3 v2:172.21.15.142:6800/1064901393 23 ==== osd_op_reply(85 gc.23 [create,call,call,call] v30'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc9b80083e0 con 0x55e9323bc280 2024-09-22T08:36:47.475 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.474+0000 7fc9c4342800 1 -- 172.21.15.142:0/102802715 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e9323d62c0 con 0x55e9323bc280 2024-09-22T08:36:47.475 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.474+0000 7fc9c08ee640 1 -- 172.21.15.142:0/102802715 <== osd.3 v2:172.21.15.142:6800/1064901393 24 ==== osd_op_reply(86 gc.24 [create,call,call,call] v30'11 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc9b80083e0 con 0x55e9323bc280 2024-09-22T08:36:47.476 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.475+0000 7fc9c4342800 1 -- 172.21.15.142:0/102802715 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e9323d62c0 con 0x55e9323bc280 2024-09-22T08:36:47.476 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.475+0000 7fc9c08ee640 1 -- 172.21.15.142:0/102802715 <== osd.3 v2:172.21.15.142:6800/1064901393 25 ==== osd_op_reply(87 gc.25 [create,call,call,call] v30'24 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc9b80083e0 con 0x55e9323bc280 2024-09-22T08:36:47.476 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.475+0000 7fc9c4342800 1 -- 172.21.15.142:0/102802715 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e9323d62c0 con 0x7fc9b0027020 2024-09-22T08:36:47.478 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.477+0000 7fc9bf8ec640 1 -- 172.21.15.142:0/102802715 <== osd.0 v2:172.21.15.31:6800/168281188 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v30'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc9a8057030 con 0x7fc9b0027020 2024-09-22T08:36:47.478 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.477+0000 7fc9c4342800 1 -- 172.21.15.142:0/102802715 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e9323d62c0 con 0x55e9323bc280 2024-09-22T08:36:47.479 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.478+0000 7fc9c08ee640 1 -- 172.21.15.142:0/102802715 <== osd.3 v2:172.21.15.142:6800/1064901393 26 ==== osd_op_reply(89 gc.27 [create,call,call,call] v30'15 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc9b80083e0 con 0x55e9323bc280 2024-09-22T08:36:47.479 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.478+0000 7fc9c4342800 1 -- 172.21.15.142:0/102802715 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e9323d62c0 con 0x7fc9b0027020 2024-09-22T08:36:47.480 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.479+0000 7fc9bf8ec640 1 -- 172.21.15.142:0/102802715 <== osd.0 v2:172.21.15.31:6800/168281188 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v30'24 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc9a8057030 con 0x7fc9b0027020 2024-09-22T08:36:47.480 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.479+0000 7fc9c4342800 1 -- 172.21.15.142:0/102802715 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e9323d62c0 con 0x55e9323bc280 2024-09-22T08:36:47.481 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.480+0000 7fc9c08ee640 1 -- 172.21.15.142:0/102802715 <== osd.3 v2:172.21.15.142:6800/1064901393 27 ==== osd_op_reply(91 gc.29 [create,call,call,call] v30'31 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc9b80083e0 con 0x55e9323bc280 2024-09-22T08:36:47.482 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.481+0000 7fc9c4342800 1 -- 172.21.15.142:0/102802715 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e9323d62c0 con 0x7fc9b0027020 2024-09-22T08:36:47.483 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.482+0000 7fc9bf8ec640 1 -- 172.21.15.142:0/102802715 <== osd.0 v2:172.21.15.31:6800/168281188 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v30'32 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc9a8057030 con 0x7fc9b0027020 2024-09-22T08:36:47.483 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.482+0000 7fc9c4342800 1 -- 172.21.15.142:0/102802715 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e9323d62c0 con 0x7fc9b8032020 2024-09-22T08:36:47.484 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.483+0000 7fc9c00ed640 1 -- 172.21.15.142:0/102802715 <== osd.2 v2:172.21.15.142:6808/279438927 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v30'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc9b001b070 con 0x7fc9b8032020 2024-09-22T08:36:47.484 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.483+0000 7fc8757e2640 20 reqs_thread_entry: start 2024-09-22T08:36:47.484 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.483+0000 7fc9c4342800 20 init_complete bucket index max shards: 11 2024-09-22T08:36:47.484 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.483+0000 7fc9c4342800 20 Filter name: none 2024-09-22T08:36:47.485 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.483+0000 7fc7e6ffd640 20 reqs_thread_entry: start 2024-09-22T08:36:47.485 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.483+0000 7fc9c4342800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-22T08:36:47.485 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.483+0000 7fc9c4342800 20 rados->read ofs=0 len=0 2024-09-22T08:36:47.485 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.483+0000 7fc9c4342800 1 -- 172.21.15.142:0/102802715 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e932400f90 con 0x7fc9b0027020 2024-09-22T08:36:47.487 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.484+0000 7fc9bf8ec640 1 -- 172.21.15.142:0/102802715 <== osd.0 v2:172.21.15.31:6800/168281188 24 ==== osd_op_reply(94 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7fc9a8057030 con 0x7fc9b0027020 2024-09-22T08:36:47.487 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.484+0000 7fc9c4342800 20 rados_obj.operate() r=0 bl.length=380 2024-09-22T08:36:47.487 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.484+0000 7fc9c4342800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-09-22T08:36:47.487 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.484+0000 7fc9c4342800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-22T08:36:47.487 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.484+0000 7fc9c4342800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:36:47.487 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.484+0000 7fc9c4342800 1 -- 172.21.15.142:0/102802715 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:95 8.1 8:810902b1:users.uid::fud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e932403850 con 0x7fc9b0027020 2024-09-22T08:36:47.487 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.484+0000 7fc9bf8ec640 1 -- 172.21.15.142:0/102802715 <== osd.0 v2:172.21.15.31:6800/168281188 25 ==== osd_op_reply(95 fud.buckets [call out=15b] v0'0 uv2 ondisk = 0) ==== 155+0+15 (crc 0 0 0) 0x7fc9a8057030 con 0x7fc9b0027020 2024-09-22T08:36:47.487 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.484+0000 7fc9c4342800 10 removing key index: p5YnriCv1nAtykxBrupQ 2024-09-22T08:36:47.487 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.484+0000 7fc9c4342800 1 -- 172.21.15.142:0/102802715 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:96 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e932401830 con 0x7fc9b0027020 2024-09-22T08:36:47.487 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.485+0000 7fc9bf8ec640 1 -- 172.21.15.142:0/102802715 <== osd.0 v2:172.21.15.31:6800/168281188 26 ==== osd_op_reply(96 p5YnriCv1nAtykxBrupQ [delete] v30'4 uv4 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fc9a8057030 con 0x7fc9b0027020 2024-09-22T08:36:47.487 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.485+0000 7fc9c4342800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-22T08:36:47.487 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.485+0000 7fc9c4342800 1 -- 172.21.15.142:0/102802715 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [notify cookie 94460058804864 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e932403de0 con 0x55e9323bc280 2024-09-22T08:36:47.487 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.485+0000 7fc9c08ee640 1 -- 172.21.15.142:0/102802715 <== osd.3 v2:172.21.15.142:6800/1064901393 28 ==== watch-notify(notify (1) cookie 94460058550448 notify 128849018883 ret 0) ==== 212+0+0 (crc 0 0 0) 0x55e9323d4f00 con 0x55e9323bc280 2024-09-22T08:36:47.488 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.485+0000 7fc89f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018883 cookie 94460058550448 notifier 4527 bl.length()=170 2024-09-22T08:36:47.488 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.485+0000 7fc89f7fe640 1 -- 172.21.15.142:0/102802715 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7fc884003d60 con 0x55e9323bc280 2024-09-22T08:36:47.488 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.485+0000 7fc9c08ee640 1 -- 172.21.15.142:0/102802715 <== osd.3 v2:172.21.15.142:6800/1064901393 29 ==== osd_op_reply(97 notify.2 [notify cookie 94460058804864 out=8b] v0'0 uv126 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fc9b80083e0 con 0x55e9323bc280 2024-09-22T08:36:47.488 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.485+0000 7fc9c08ee640 1 -- 172.21.15.142:0/102802715 <== osd.3 v2:172.21.15.142:6800/1064901393 30 ==== osd_op_reply(98 notify.2 [notify-ack] v0'0 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9b80083e0 con 0x55e9323bc280 2024-09-22T08:36:47.488 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.485+0000 7fc9c08ee640 1 -- 172.21.15.142:0/102802715 <== osd.3 v2:172.21.15.142:6800/1064901393 31 ==== watch-notify(notify_complete (2) cookie 94460058804864 notify 128849018883 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55e9323ac4a0 con 0x55e9323bc280 2024-09-22T08:36:47.488 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.486+0000 7fc9c4342800 10 removing email index: 2024-09-22T08:36:47.488 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.486+0000 7fc9c4342800 10 removing user buckets index 2024-09-22T08:36:47.488 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.486+0000 7fc9c4342800 1 -- 172.21.15.142:0/102802715 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:99 8.1 8:810902b1:users.uid::fud.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e932403d40 con 0x7fc9b0027020 2024-09-22T08:36:47.489 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.487+0000 7fc9bf8ec640 1 -- 172.21.15.142:0/102802715 <== osd.0 v2:172.21.15.31:6800/168281188 27 ==== osd_op_reply(99 fud.buckets [delete] v30'4 uv4 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fc9a8057030 con 0x7fc9b0027020 2024-09-22T08:36:47.489 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.487+0000 7fc9c4342800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:fud.buckets, ofs0, ns] 2024-09-22T08:36:47.489 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.487+0000 7fc9c4342800 1 -- 172.21.15.142:0/102802715 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:100 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94460058811712 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e932403260 con 0x7fc9b0027020 2024-09-22T08:36:47.489 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.487+0000 7fc9bf8ec640 1 -- 172.21.15.142:0/102802715 <== osd.0 v2:172.21.15.31:6800/168281188 28 ==== watch-notify(notify (1) cookie 94460058564272 notify 128849018892 ret 0) ==== 202+0+0 (crc 0 0 0) 0x55e9323d4c30 con 0x7fc9b0027020 2024-09-22T08:36:47.489 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.487+0000 7fc89effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018892 cookie 94460058564272 notifier 4527 bl.length()=160 2024-09-22T08:36:47.489 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.487+0000 7fc9bf8ec640 1 -- 172.21.15.142:0/102802715 <== osd.0 v2:172.21.15.31:6800/168281188 29 ==== osd_op_reply(100 notify.6 [notify cookie 94460058811712 out=8b] v0'0 uv126 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fc9a8057030 con 0x7fc9b0027020 2024-09-22T08:36:47.489 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.487+0000 7fc89effd640 1 -- 172.21.15.142:0/102802715 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7fc7f40032c0 con 0x7fc9b0027020 2024-09-22T08:36:47.490 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.487+0000 7fc9bf8ec640 1 -- 172.21.15.142:0/102802715 <== osd.0 v2:172.21.15.31:6800/168281188 30 ==== osd_op_reply(101 notify.6 [notify-ack] v0'0 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9a8089040 con 0x7fc9b0027020 2024-09-22T08:36:47.490 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.487+0000 7fc9bf8ec640 1 -- 172.21.15.142:0/102802715 <== osd.0 v2:172.21.15.31:6800/168281188 31 ==== watch-notify(notify_complete (2) cookie 94460058811712 notify 128849018892 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55e9323ac730 con 0x7fc9b0027020 2024-09-22T08:36:47.490 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.487+0000 7fc9c4342800 10 removing user index: fud 2024-09-22T08:36:47.490 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.487+0000 7fc9c4342800 1 -- 172.21.15.142:0/102802715 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:102 8.e 8:75f48285:users.uid::fud:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e932403260 con 0x7fc9b0027020 2024-09-22T08:36:47.491 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.488+0000 7fc9bf8ec640 1 -- 172.21.15.142:0/102802715 <== osd.0 v2:172.21.15.31:6800/168281188 32 ==== osd_op_reply(102 fud [call,call,delete] v30'4 uv4 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7fc9a8089040 con 0x7fc9b0027020 2024-09-22T08:36:47.491 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.488+0000 7fc9c4342800 10 removing default.rgw.meta+users.uid+fud from cache 2024-09-22T08:36:47.491 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.488+0000 7fc9c4342800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-09-22T08:36:47.491 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.488+0000 7fc9c4342800 1 -- 172.21.15.142:0/102802715 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:103 7.3 7:c609908c:::notify.5:head [notify cookie 94460058810416 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e9324026b0 con 0x7fc9b0027020 2024-09-22T08:36:47.491 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.489+0000 7fc9bf8ec640 1 -- 172.21.15.142:0/102802715 <== osd.0 v2:172.21.15.31:6800/168281188 33 ==== watch-notify(notify (1) cookie 94460058561632 notify 128849018893 ret 0) ==== 194+0+0 (crc 0 0 0) 0x55e9323ac730 con 0x7fc9b0027020 2024-09-22T08:36:47.491 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.489+0000 7fc89f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018893 cookie 94460058561632 notifier 4527 bl.length()=152 2024-09-22T08:36:47.491 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.489+0000 7fc89f7fe640 1 -- 172.21.15.142:0/102802715 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:104 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7fc884003d60 con 0x7fc9b0027020 2024-09-22T08:36:47.492 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.489+0000 7fc9bf8ec640 1 -- 172.21.15.142:0/102802715 <== osd.0 v2:172.21.15.31:6800/168281188 34 ==== osd_op_reply(103 notify.5 [notify cookie 94460058810416 out=8b] v0'0 uv126 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fc9a8089040 con 0x7fc9b0027020 2024-09-22T08:36:47.492 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.489+0000 7fc9bf8ec640 1 -- 172.21.15.142:0/102802715 <== osd.0 v2:172.21.15.31:6800/168281188 35 ==== osd_op_reply(104 notify.5 [notify-ack] v0'0 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9a8089040 con 0x7fc9b0027020 2024-09-22T08:36:47.492 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.489+0000 7fc9bf8ec640 1 -- 172.21.15.142:0/102802715 <== osd.0 v2:172.21.15.31:6800/168281188 36 ==== watch-notify(notify_complete (2) cookie 94460058810416 notify 128849018893 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55e9323d4730 con 0x7fc9b0027020 2024-09-22T08:36:47.492 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.490+0000 7fc8767e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:36:47.492 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.490+0000 7fc9c4342800 1 -- 172.21.15.142:0/102802715 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:105 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94460058580128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e932402aa0 con 0x55e9323b7870 2024-09-22T08:36:47.492 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.491+0000 7fc9bf8ec640 1 -- 172.21.15.142:0/102802715 <== osd.1 v2:172.21.15.142:6816/3192108003 27 ==== osd_op_reply(105 data_loggenerations_metadata [watch unwatch cookie 94460058580128] v30'125 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc9a8089040 con 0x55e9323b7870 2024-09-22T08:36:47.492 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.491+0000 7fc9c4342800 1 -- 172.21.15.142:0/102802715 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:106 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94460058542240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e9323cb4a0 con 0x7fc9b8032020 2024-09-22T08:36:47.493 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.492+0000 7fc9c00ed640 1 -- 172.21.15.142:0/102802715 <== osd.2 v2:172.21.15.142:6808/279438927 18 ==== osd_op_reply(106 notify.0 [watch unwatch cookie 94460058542240] v30'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9b001b070 con 0x7fc9b8032020 2024-09-22T08:36:47.493 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.492+0000 7fc9c4342800 20 remove_watcher() i=0 2024-09-22T08:36:47.493 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.492+0000 7fc9c4342800 2 removed watcher, disabling cache 2024-09-22T08:36:47.493 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.492+0000 7fc9c4342800 1 -- 172.21.15.142:0/102802715 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:107 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94460058549392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e9323c20a0 con 0x55e9323b7870 2024-09-22T08:36:47.494 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.493+0000 7fc9bf8ec640 1 -- 172.21.15.142:0/102802715 <== osd.1 v2:172.21.15.142:6816/3192108003 28 ==== osd_op_reply(107 notify.1 [watch unwatch cookie 94460058549392] v30'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9a8089040 con 0x55e9323b7870 2024-09-22T08:36:47.494 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.493+0000 7fc9c4342800 20 remove_watcher() i=1 2024-09-22T08:36:47.494 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.493+0000 7fc9c4342800 1 -- 172.21.15.142:0/102802715 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:108 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94460058550448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e9323c20a0 con 0x55e9323bc280 2024-09-22T08:36:47.495 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.494+0000 7fc9c08ee640 1 -- 172.21.15.142:0/102802715 <== osd.3 v2:172.21.15.142:6800/1064901393 32 ==== osd_op_reply(108 notify.2 [watch unwatch cookie 94460058550448] v30'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9b80083e0 con 0x55e9323bc280 2024-09-22T08:36:47.495 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.494+0000 7fc9c4342800 20 remove_watcher() i=2 2024-09-22T08:36:47.495 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.494+0000 7fc9c4342800 1 -- 172.21.15.142:0/102802715 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:109 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94460058551504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e9323c20a0 con 0x7fc9b8032020 2024-09-22T08:36:47.496 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.495+0000 7fc9c00ed640 1 -- 172.21.15.142:0/102802715 <== osd.2 v2:172.21.15.142:6808/279438927 19 ==== osd_op_reply(109 notify.3 [watch unwatch cookie 94460058551504] v30'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9b001b070 con 0x7fc9b8032020 2024-09-22T08:36:47.496 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.495+0000 7fc9c4342800 20 remove_watcher() i=3 2024-09-22T08:36:47.496 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.495+0000 7fc9c4342800 1 -- 172.21.15.142:0/102802715 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:110 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94460058557488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e9323c20a0 con 0x55e9323b7870 2024-09-22T08:36:47.497 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.496+0000 7fc9bf8ec640 1 -- 172.21.15.142:0/102802715 <== osd.1 v2:172.21.15.142:6816/3192108003 29 ==== osd_op_reply(110 notify.4 [watch unwatch cookie 94460058557488] v30'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9a8089040 con 0x55e9323b7870 2024-09-22T08:36:47.497 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.496+0000 7fc9c4342800 20 remove_watcher() i=4 2024-09-22T08:36:47.498 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.496+0000 7fc9c4342800 1 -- 172.21.15.142:0/102802715 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:111 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94460058561632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e9323c20a0 con 0x7fc9b0027020 2024-09-22T08:36:47.498 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.497+0000 7fc9bf8ec640 1 -- 172.21.15.142:0/102802715 <== osd.0 v2:172.21.15.31:6800/168281188 37 ==== osd_op_reply(111 notify.5 [watch unwatch cookie 94460058561632] v30'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9a8089040 con 0x7fc9b0027020 2024-09-22T08:36:47.499 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.497+0000 7fc9c4342800 20 remove_watcher() i=5 2024-09-22T08:36:47.499 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.497+0000 7fc9c4342800 1 -- 172.21.15.142:0/102802715 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:112 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94460058564272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e9323c20a0 con 0x7fc9b0027020 2024-09-22T08:36:47.499 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.498+0000 7fc9bf8ec640 1 -- 172.21.15.142:0/102802715 <== osd.0 v2:172.21.15.31:6800/168281188 38 ==== osd_op_reply(112 notify.6 [watch unwatch cookie 94460058564272] v30'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9a8089040 con 0x7fc9b0027020 2024-09-22T08:36:47.500 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.498+0000 7fc9c4342800 20 remove_watcher() i=6 2024-09-22T08:36:47.500 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.498+0000 7fc9c4342800 1 -- 172.21.15.142:0/102802715 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:113 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94460058566016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e9323c76b0 con 0x7fc9b0027020 2024-09-22T08:36:47.503 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.499+0000 7fc9bf8ec640 1 -- 172.21.15.142:0/102802715 <== osd.0 v2:172.21.15.31:6800/168281188 39 ==== osd_op_reply(113 notify.7 [watch unwatch cookie 94460058566016] v30'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9a8089040 con 0x7fc9b0027020 2024-09-22T08:36:47.503 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.499+0000 7fc9c4342800 20 remove_watcher() i=7 2024-09-22T08:36:47.503 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.499+0000 7fc9c4342800 1 -- 172.21.15.142:0/102802715 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7fc9b0027020 msgr2=0x7fc9b0044210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:47.503 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.499+0000 7fc9c4342800 1 --2- 172.21.15.142:0/102802715 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7fc9b0027020 0x7fc9b0044210 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:47.503 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.499+0000 7fc9c4342800 1 -- 172.21.15.142:0/102802715 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55e9323b7870 msgr2=0x55e9323b9d30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:47.503 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.499+0000 7fc9c4342800 1 --2- 172.21.15.142:0/102802715 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55e9323b7870 0x55e9323b9d30 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:47.503 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.499+0000 7fc9c4342800 1 -- 172.21.15.142:0/102802715 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7fc9b8032020 msgr2=0x7fc9b8024ae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:47.503 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.499+0000 7fc9c4342800 1 --2- 172.21.15.142:0/102802715 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7fc9b8032020 0x7fc9b8024ae0 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:47.503 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.499+0000 7fc9c4342800 1 -- 172.21.15.142:0/102802715 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55e9323bc280 msgr2=0x55e9323be670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:47.503 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.499+0000 7fc9c4342800 1 --2- 172.21.15.142:0/102802715 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55e9323bc280 0x55e9323be670 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:47.503 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.500+0000 7fc9c4342800 1 -- 172.21.15.142:0/102802715 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fc89003d000 msgr2=0x7fc89003f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:47.503 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.500+0000 7fc9c4342800 1 --2- 172.21.15.142:0/102802715 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fc89003d000 0x7fc89003f4c0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x55e932384bf0 tx=0x7fc9b0050000 comp rx=0 tx=0).stop 2024-09-22T08:36:47.504 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.500+0000 7fc9c4342800 1 -- 172.21.15.142:0/102802715 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e9323a4960 msgr2=0x55e9323abf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:47.504 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.500+0000 7fc9bf8ec640 1 -- 172.21.15.142:0/102802715 reap_dead start 2024-09-22T08:36:47.504 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.500+0000 7fc9c4342800 1 --2- 172.21.15.142:0/102802715 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e9323a4960 0x55e9323abf40 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fc9b8048040 tx=0x7fc9b8053d50 comp rx=0 tx=0).stop 2024-09-22T08:36:47.504 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.500+0000 7fc9c4342800 1 -- 172.21.15.142:0/102802715 shutdown_connections 2024-09-22T08:36:47.504 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.500+0000 7fc9c4342800 1 --2- 172.21.15.142:0/102802715 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e9323a4960 0x55e9323abf40 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:47.504 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.500+0000 7fc9c4342800 1 -- 172.21.15.142:0/102802715 >> 172.21.15.142:0/102802715 conn(0x55e9323a0d60 msgr2=0x55e93239ef70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:47.504 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.500+0000 7fc9c4342800 1 -- 172.21.15.142:0/102802715 shutdown_connections 2024-09-22T08:36:47.504 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.500+0000 7fc9c4342800 1 -- 172.21.15.142:0/102802715 wait complete. 2024-09-22T08:36:47.504 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.500+0000 7fc9c4342800 1 -- 172.21.15.142:0/1809811197 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fc89803cfb0 msgr2=0x7fc89803f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:47.504 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.500+0000 7fc9c4342800 1 --2- 172.21.15.142:0/1809811197 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fc89803cfb0 0x7fc89803f470 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fc9b001d740 tx=0x7fc9b0026f90 comp rx=0 tx=0).stop 2024-09-22T08:36:47.504 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.500+0000 7fc9c4342800 1 -- 172.21.15.142:0/1809811197 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e932397f00 msgr2=0x55e932398320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:47.504 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.500+0000 7fc9c4342800 1 --2- 172.21.15.142:0/1809811197 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e932397f00 0x55e932398320 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x55e93237db70 tx=0x7fc9b800bf30 comp rx=0 tx=0).stop 2024-09-22T08:36:47.504 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.500+0000 7fc9c4342800 1 -- 172.21.15.142:0/1809811197 shutdown_connections 2024-09-22T08:36:47.504 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.500+0000 7fc9c4342800 1 --2- 172.21.15.142:0/1809811197 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fc89803cfb0 0x7fc89803f470 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:47.505 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.500+0000 7fc9c4342800 1 --2- 172.21.15.142:0/1809811197 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e932397f00 0x55e932398320 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:47.505 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.500+0000 7fc9c4342800 1 -- 172.21.15.142:0/1809811197 >> 172.21.15.142:0/1809811197 conn(0x55e93238c2b0 msgr2=0x55e93238c690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:47.505 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.500+0000 7fc9c4342800 1 -- 172.21.15.142:0/1809811197 shutdown_connections 2024-09-22T08:36:47.505 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.500+0000 7fc9c4342800 1 -- 172.21.15.142:0/1809811197 wait complete. 2024-09-22T08:36:47.505 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.500+0000 7fc9c4342800 1 -- 172.21.15.142:0/3789896659 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55e93237e860 msgr2=0x55e9323841c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:47.505 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.500+0000 7fc9c4342800 1 --2- 172.21.15.142:0/3789896659 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55e93237e860 0x55e9323841c0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:47.505 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.500+0000 7fc9c4342800 1 -- 172.21.15.142:0/3789896659 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55e932386aa0 msgr2=0x55e932388e90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:47.505 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.500+0000 7fc9c4342800 1 --2- 172.21.15.142:0/3789896659 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55e932386aa0 0x55e932388e90 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:47.505 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.501+0000 7fc9c4342800 1 -- 172.21.15.142:0/3789896659 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fc8a803cfb0 msgr2=0x7fc8a803f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:47.505 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.501+0000 7fc9c4342800 1 --2- 172.21.15.142:0/3789896659 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fc8a803cfb0 0x7fc8a803f470 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fc9a8057000 tx=0x7fc9a8052000 comp rx=0 tx=0).stop 2024-09-22T08:36:47.505 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.501+0000 7fc9c4342800 1 -- 172.21.15.142:0/3789896659 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e932287bf0 msgr2=0x55e93237cb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:47.505 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.501+0000 7fc9c4342800 1 --2- 172.21.15.142:0/3789896659 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e932287bf0 0x55e93237cb70 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fc9b0000f80 tx=0x7fc9b0001250 comp rx=0 tx=0).stop 2024-09-22T08:36:47.505 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.501+0000 7fc9c4342800 1 -- 172.21.15.142:0/3789896659 shutdown_connections 2024-09-22T08:36:47.506 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.501+0000 7fc9c4342800 1 --2- 172.21.15.142:0/3789896659 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55e932386aa0 0x55e932388e90 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:47.506 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.501+0000 7fc9c4342800 1 --2- 172.21.15.142:0/3789896659 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55e93237e860 0x55e9323841c0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:47.506 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.501+0000 7fc9c4342800 1 --2- 172.21.15.142:0/3789896659 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fc8a803cfb0 0x7fc8a803f470 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:47.506 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.501+0000 7fc9c4342800 1 --2- 172.21.15.142:0/3789896659 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e932287bf0 0x55e93237cb70 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:47.506 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.501+0000 7fc9c4342800 1 -- 172.21.15.142:0/3789896659 >> 172.21.15.142:0/3789896659 conn(0x55e932281bb0 msgr2=0x55e932376360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:47.506 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.501+0000 7fc9c4342800 1 -- 172.21.15.142:0/3789896659 shutdown_connections 2024-09-22T08:36:47.506 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.501+0000 7fc9c4342800 1 -- 172.21.15.142:0/3789896659 wait complete. 2024-09-22T08:36:47.510 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--tenant', 'testx', '--uid', 'tenanteduser', '--display-name', 'tenanted-user', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-09-22T08:36:47.511 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--tenant', 'testx', '--uid', 'tenanteduser', '--display-name', 'tenanted-user', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-09-22T08:36:47.511 DEBUG:teuthology.orchestra.run.smithi142:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --tenant testx --uid tenanteduser --display-name tenanted-user --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh --max-buckets 1 2024-09-22T08:36:47.605 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:36:47.605 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:36:47.606 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.605+0000 7f91e9335800 1 Processor -- start 2024-09-22T08:36:47.606 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.605+0000 7f91e9335800 1 -- start start 2024-09-22T08:36:47.606 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.605+0000 7f91e9335800 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55efcf279c50 0x55efcf27c110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:47.607 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.605+0000 7f91e9335800 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55efcf0fea20 con 0x55efcf1e7580 2024-09-22T08:36:47.607 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.605+0000 7f91e9335800 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x55efcf0fe7d0 con 0x55efcf279c50 2024-09-22T08:36:47.607 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.606+0000 7f91dc820640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55efcf279c50 0x55efcf27c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:47.607 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.606+0000 7f91dc820640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55efcf279c50 0x55efcf27c110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:39782/0 (socket says 172.21.15.142:39782) 2024-09-22T08:36:47.608 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.606+0000 7f91dc820640 1 -- 172.21.15.142:0/529065513 learned_addr learned my addr 172.21.15.142:0/529065513 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:47.608 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.606+0000 7f91e5021640 1 --1- 172.21.15.142:0/529065513 >> v1:172.21.15.31:6789/0 conn(0x55efcf1e7580 0x55efcf278500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.142:42616/0 (socket says 172.21.15.142:42616) 2024-09-22T08:36:47.608 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.606+0000 7f91dc820640 1 -- 172.21.15.142:0/529065513 >> v1:172.21.15.31:6789/0 conn(0x55efcf1e7580 legacy=0x55efcf278500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:47.608 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.606+0000 7f91dc820640 1 -- 172.21.15.142:0/529065513 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55efcf27d820 con 0x55efcf279c50 2024-09-22T08:36:47.609 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.608+0000 7f91dc820640 1 --2- 172.21.15.142:0/529065513 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55efcf279c50 0x55efcf27c110 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f91d000a520 tx=0x7f91d0045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d08c78dcaa772ba5 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:47.609 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.608+0000 7f91e4820640 1 -- 172.21.15.142:0/529065513 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f91d0055070 con 0x55efcf279c50 2024-09-22T08:36:47.609 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.608+0000 7f91e4820640 1 -- 172.21.15.142:0/529065513 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91d00515b0 con 0x55efcf279c50 2024-09-22T08:36:47.609 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.608+0000 7f91e4820640 1 -- 172.21.15.142:0/529065513 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f91d00518d0 con 0x55efcf279c50 2024-09-22T08:36:47.610 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.608+0000 7f91e9335800 1 -- 172.21.15.142:0/529065513 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55efcf279c50 msgr2=0x55efcf27c110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:47.610 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.608+0000 7f91e9335800 1 --2- 172.21.15.142:0/529065513 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55efcf279c50 0x55efcf27c110 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f91d000a520 tx=0x7f91d0045ba0 comp rx=0 tx=0).stop 2024-09-22T08:36:47.610 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.608+0000 7f91e9335800 1 -- 172.21.15.142:0/529065513 shutdown_connections 2024-09-22T08:36:47.610 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.608+0000 7f91e9335800 1 --2- 172.21.15.142:0/529065513 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55efcf279c50 0x55efcf27c110 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:47.610 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.608+0000 7f91e9335800 1 -- 172.21.15.142:0/529065513 >> 172.21.15.142:0/529065513 conn(0x55efcf26dc30 msgr2=0x55efcf270070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:47.610 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.608+0000 7f91e9335800 1 -- 172.21.15.142:0/529065513 shutdown_connections 2024-09-22T08:36:47.610 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.608+0000 7f91e9335800 1 -- 172.21.15.142:0/529065513 wait complete. 2024-09-22T08:36:47.624 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.622+0000 7f91e9335800 1 Processor -- start 2024-09-22T08:36:47.624 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.622+0000 7f91e9335800 1 -- start start 2024-09-22T08:36:47.624 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.622+0000 7f91e9335800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55efcf1e7580 0x55efcf3652e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:47.624 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.622+0000 7f91e9335800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55efcf10bdd0 con 0x55efcf1e7580 2024-09-22T08:36:47.624 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.623+0000 7f91e5021640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55efcf1e7580 0x55efcf3652e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:47.624 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.623+0000 7f91e5021640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55efcf1e7580 0x55efcf3652e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:39788/0 (socket says 172.21.15.142:39788) 2024-09-22T08:36:47.624 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.623+0000 7f91e5021640 1 -- 172.21.15.142:0/2412500936 learned_addr learned my addr 172.21.15.142:0/2412500936 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:47.624 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.623+0000 7f91e5021640 1 -- 172.21.15.142:0/2412500936 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55efcf3658d0 con 0x55efcf1e7580 2024-09-22T08:36:47.626 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.623+0000 7f91e5021640 1 --2- 172.21.15.142:0/2412500936 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55efcf1e7580 0x55efcf3652e0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f91d800b260 tx=0x7f91d800b660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=990bf12cd9e0268a server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:47.627 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.623+0000 7f90d3606640 1 -- 172.21.15.142:0/2412500936 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f91d800be60 con 0x55efcf1e7580 2024-09-22T08:36:47.627 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.623+0000 7f90d3606640 1 -- 172.21.15.142:0/2412500936 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91d8006070 con 0x55efcf1e7580 2024-09-22T08:36:47.627 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.623+0000 7f90d3606640 1 -- 172.21.15.142:0/2412500936 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f91d800e710 con 0x55efcf1e7580 2024-09-22T08:36:47.627 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.624+0000 7f91e9335800 1 -- 172.21.15.142:0/2412500936 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55efcf1e7580 msgr2=0x55efcf3652e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:47.627 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.624+0000 7f91e9335800 1 --2- 172.21.15.142:0/2412500936 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55efcf1e7580 0x55efcf3652e0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f91d800b260 tx=0x7f91d800b660 comp rx=0 tx=0).stop 2024-09-22T08:36:47.627 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.624+0000 7f91e9335800 1 -- 172.21.15.142:0/2412500936 shutdown_connections 2024-09-22T08:36:47.627 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.624+0000 7f91e9335800 1 --2- 172.21.15.142:0/2412500936 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55efcf1e7580 0x55efcf3652e0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:47.627 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.624+0000 7f91e9335800 1 -- 172.21.15.142:0/2412500936 >> 172.21.15.142:0/2412500936 conn(0x55efcf26dc30 msgr2=0x55efcf360c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:47.627 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.624+0000 7f91e9335800 1 -- 172.21.15.142:0/2412500936 shutdown_connections 2024-09-22T08:36:47.627 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.624+0000 7f91e9335800 1 -- 172.21.15.142:0/2412500936 wait complete. 2024-09-22T08:36:47.627 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.624+0000 7f91e9335800 1 Processor -- start 2024-09-22T08:36:47.627 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.624+0000 7f91e9335800 1 -- start start 2024-09-22T08:36:47.627 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.625+0000 7f91e9335800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55efcf279c50 0x55efcf36d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:47.628 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.625+0000 7f91e9335800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55efcf27cac0 con 0x55efcf279c50 2024-09-22T08:36:47.628 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.625+0000 7f91e5021640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55efcf279c50 0x55efcf36d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:47.628 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.625+0000 7f91e5021640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55efcf279c50 0x55efcf36d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:39800/0 (socket says 172.21.15.142:39800) 2024-09-22T08:36:47.628 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.625+0000 7f91e5021640 1 -- 172.21.15.142:0/3667943747 learned_addr learned my addr 172.21.15.142:0/3667943747 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:47.628 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.625+0000 7f91e5021640 1 -- 172.21.15.142:0/3667943747 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55efcf36d5e0 con 0x55efcf279c50 2024-09-22T08:36:47.628 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.625+0000 7f91e5021640 1 --2- 172.21.15.142:0/3667943747 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55efcf279c50 0x55efcf36d080 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x55efcf366270 tx=0x7f91d8000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:47.628 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.625+0000 7f90d1e03640 1 -- 172.21.15.142:0/3667943747 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f91d8001560 con 0x55efcf279c50 2024-09-22T08:36:47.628 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.625+0000 7f90d1e03640 1 -- 172.21.15.142:0/3667943747 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91d800ee10 con 0x55efcf279c50 2024-09-22T08:36:47.628 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.625+0000 7f91e9335800 1 -- 172.21.15.142:0/3667943747 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55efcf36d870 con 0x55efcf279c50 2024-09-22T08:36:47.628 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.625+0000 7f90d1e03640 1 -- 172.21.15.142:0/3667943747 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f91d800fb00 con 0x55efcf279c50 2024-09-22T08:36:47.628 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.626+0000 7f91e9335800 1 -- 172.21.15.142:0/3667943747 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55efcf36e270 con 0x55efcf279c50 2024-09-22T08:36:47.632 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.626+0000 7f90d1e03640 1 -- 172.21.15.142:0/3667943747 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f91d8017070 con 0x55efcf279c50 2024-09-22T08:36:47.632 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.627+0000 7f90d1e03640 1 --2- 172.21.15.142:0/3667943747 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f90cc03d000 0x7f90cc03f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:47.632 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.627+0000 7f90d1e03640 1 -- 172.21.15.142:0/3667943747 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f91d8015020 con 0x55efcf279c50 2024-09-22T08:36:47.632 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.627+0000 7f91dc820640 1 --2- 172.21.15.142:0/3667943747 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f90cc03d000 0x7f90cc03f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:47.632 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.627+0000 7f91e9335800 1 --2- 172.21.15.142:0/3667943747 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55efcf36ed70 0x55efcf3746d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:47.632 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.627+0000 7f91e9335800 1 -- 172.21.15.142:0/3667943747 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55efcf374c60 con 0x55efcf36ed70 2024-09-22T08:36:47.632 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.627+0000 7f91e5822640 1 --2- 172.21.15.142:0/3667943747 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55efcf36ed70 0x55efcf3746d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:47.632 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.627+0000 7f91dc820640 1 --2- 172.21.15.142:0/3667943747 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f90cc03d000 0x7f90cc03f4c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f91d0057000 tx=0x7f91d0052000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:47.632 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.627+0000 7f91e5822640 1 --2- 172.21.15.142:0/3667943747 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55efcf36ed70 0x55efcf3746d0 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:47.632 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.627+0000 7f91e5822640 1 -- 172.21.15.142:0/3667943747 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f91e000a4d0 con 0x55efcf36ed70 2024-09-22T08:36:47.632 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.627+0000 7f91e9335800 1 -- 172.21.15.142:0/3667943747 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55efcf36e720 con 0x55efcf36ed70 2024-09-22T08:36:47.633 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.628+0000 7f91e5822640 1 -- 172.21.15.142:0/3667943747 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f91e000a4d0 con 0x55efcf36ed70 2024-09-22T08:36:47.633 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.628+0000 7f91e9335800 1 --2- 172.21.15.142:0/3667943747 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55efcf376fb0 0x55efcf3793a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:47.633 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.628+0000 7f91e9335800 1 -- 172.21.15.142:0/3667943747 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:3 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55efcf379a70 con 0x55efcf376fb0 2024-09-22T08:36:47.633 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.628+0000 7f91e5021640 1 --2- 172.21.15.142:0/3667943747 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55efcf376fb0 0x55efcf3793a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:47.633 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.628+0000 7f91e5021640 1 --2- 172.21.15.142:0/3667943747 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55efcf376fb0 0x55efcf3793a0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:47.633 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.628+0000 7f91e5021640 1 -- 172.21.15.142:0/3667943747 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(3 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f91d802e070 con 0x55efcf376fb0 2024-09-22T08:36:47.633 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.628+0000 7f91e9335800 1 -- 172.21.15.142:0/3667943747 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55efcf375e50 con 0x55efcf36ed70 2024-09-22T08:36:47.633 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.629+0000 7f91e5822640 1 -- 172.21.15.142:0/3667943747 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f91e000a4d0 con 0x55efcf36ed70 2024-09-22T08:36:47.633 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.629+0000 7f91e9335800 1 -- 172.21.15.142:0/3667943747 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55efcf3762f0 con 0x55efcf376fb0 2024-09-22T08:36:47.633 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.629+0000 7f91e5021640 1 -- 172.21.15.142:0/3667943747 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(5 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f91d802e070 con 0x55efcf376fb0 2024-09-22T08:36:47.633 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.629+0000 7f91e9335800 1 Processor -- start 2024-09-22T08:36:47.633 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.629+0000 7f91e9335800 1 -- start start 2024-09-22T08:36:47.634 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.629+0000 7f91e9335800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55efcf388410 0x55efcf388830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:47.634 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.629+0000 7f91e9335800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55efcf16ad50 con 0x55efcf388410 2024-09-22T08:36:47.634 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.630+0000 7f91e5822640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55efcf388410 0x55efcf388830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:47.634 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.630+0000 7f91e5822640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55efcf388410 0x55efcf388830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:39810/0 (socket says 172.21.15.142:39810) 2024-09-22T08:36:47.634 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.630+0000 7f91e5822640 1 -- 172.21.15.142:0/1455840527 learned_addr learned my addr 172.21.15.142:0/1455840527 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:47.634 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.630+0000 7f91e5822640 1 -- 172.21.15.142:0/1455840527 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55efcf388e70 con 0x55efcf388410 2024-09-22T08:36:47.634 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.630+0000 7f91e5822640 1 --2- 172.21.15.142:0/1455840527 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55efcf388410 0x55efcf388830 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x55efcf36e080 tx=0x7f91e00167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:47.634 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.630+0000 7f90caffd640 1 -- 172.21.15.142:0/1455840527 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f91e0013640 con 0x55efcf388410 2024-09-22T08:36:47.634 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.630+0000 7f90caffd640 1 -- 172.21.15.142:0/1455840527 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91e00137e0 con 0x55efcf388410 2024-09-22T08:36:47.634 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.630+0000 7f91e9335800 1 -- 172.21.15.142:0/1455840527 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55efcf3896a0 con 0x55efcf388410 2024-09-22T08:36:47.634 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.630+0000 7f90caffd640 1 -- 172.21.15.142:0/1455840527 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f91e0013ae0 con 0x55efcf388410 2024-09-22T08:36:47.634 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.630+0000 7f91e9335800 1 -- 172.21.15.142:0/1455840527 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55efcf389c40 con 0x55efcf388410 2024-09-22T08:36:47.641 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.631+0000 7f90caffd640 1 -- 172.21.15.142:0/1455840527 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f91e0011040 con 0x55efcf388410 2024-09-22T08:36:47.641 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.631+0000 7f90caffd640 1 --2- 172.21.15.142:0/1455840527 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f90bc03cfb0 0x7f90bc03f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:47.641 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.631+0000 7f90caffd640 1 -- 172.21.15.142:0/1455840527 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f91e000e040 con 0x55efcf388410 2024-09-22T08:36:47.642 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.631+0000 7f91e5021640 1 --2- 172.21.15.142:0/1455840527 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f90bc03cfb0 0x7f90bc03f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:47.642 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.632+0000 7f91e9335800 1 Processor -- start 2024-09-22T08:36:47.642 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.632+0000 7f91e5021640 1 --2- 172.21.15.142:0/1455840527 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f90bc03cfb0 0x7f90bc03f470 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x55efcf375130 tx=0x7f91d8017a40 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:47.642 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.632+0000 7f91e9335800 1 -- start start 2024-09-22T08:36:47.642 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.632+0000 7f91e9335800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55efcf394ed0 0x55efcf3952d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:47.642 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.632+0000 7f91e9335800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55efcf365d00 con 0x55efcf394ed0 2024-09-22T08:36:47.642 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.632+0000 7f91e5822640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55efcf394ed0 0x55efcf3952d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:47.642 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.632+0000 7f91e5822640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55efcf394ed0 0x55efcf3952d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:39812/0 (socket says 172.21.15.142:39812) 2024-09-22T08:36:47.642 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.632+0000 7f91e5822640 1 -- 172.21.15.142:0/3678245756 learned_addr learned my addr 172.21.15.142:0/3678245756 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:47.642 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.632+0000 7f91e5822640 1 -- 172.21.15.142:0/3678245756 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55efcf3958c0 con 0x55efcf394ed0 2024-09-22T08:36:47.642 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.633+0000 7f91e5822640 1 --2- 172.21.15.142:0/3678245756 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55efcf394ed0 0x55efcf3952d0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f91e0005a30 tx=0x7f91e001fee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f804c68422fb0058 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:47.642 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.633+0000 7f90c8ff9640 1 -- 172.21.15.142:0/3678245756 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f91e0021e20 con 0x55efcf394ed0 2024-09-22T08:36:47.642 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.633+0000 7f90c8ff9640 1 -- 172.21.15.142:0/3678245756 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91e0052070 con 0x55efcf394ed0 2024-09-22T08:36:47.643 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.633+0000 7f90c8ff9640 1 -- 172.21.15.142:0/3678245756 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f91e0021ab0 con 0x55efcf394ed0 2024-09-22T08:36:47.643 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.633+0000 7f91e9335800 1 -- 172.21.15.142:0/3678245756 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55efcf394ed0 msgr2=0x55efcf3952d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:47.643 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.633+0000 7f91e9335800 1 --2- 172.21.15.142:0/3678245756 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55efcf394ed0 0x55efcf3952d0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f91e0005a30 tx=0x7f91e001fee0 comp rx=0 tx=0).stop 2024-09-22T08:36:47.643 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.633+0000 7f91e9335800 1 -- 172.21.15.142:0/3678245756 shutdown_connections 2024-09-22T08:36:47.643 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.633+0000 7f91e9335800 1 --2- 172.21.15.142:0/3678245756 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55efcf394ed0 0x55efcf3952d0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:47.643 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.633+0000 7f91e9335800 1 -- 172.21.15.142:0/3678245756 >> 172.21.15.142:0/3678245756 conn(0x55efcf3912d0 msgr2=0x55efcf38f510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:47.643 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.633+0000 7f91e9335800 1 -- 172.21.15.142:0/3678245756 shutdown_connections 2024-09-22T08:36:47.643 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.633+0000 7f91e9335800 1 -- 172.21.15.142:0/3678245756 wait complete. 2024-09-22T08:36:47.643 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.633+0000 7f91e9335800 1 Processor -- start 2024-09-22T08:36:47.643 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.634+0000 7f91e9335800 1 -- start start 2024-09-22T08:36:47.643 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.634+0000 7f91e9335800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55efcf394ed0 0x55efcf39c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:47.643 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.634+0000 7f91e9335800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55efcf395ee0 con 0x55efcf394ed0 2024-09-22T08:36:47.643 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.634+0000 7f91e5822640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55efcf394ed0 0x55efcf39c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:47.643 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.634+0000 7f91e5822640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55efcf394ed0 0x55efcf39c4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:39816/0 (socket says 172.21.15.142:39816) 2024-09-22T08:36:47.644 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.634+0000 7f91e5822640 1 -- 172.21.15.142:0/2737950933 learned_addr learned my addr 172.21.15.142:0/2737950933 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:47.644 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.634+0000 7f91e5822640 1 -- 172.21.15.142:0/2737950933 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55efcf39ca10 con 0x55efcf394ed0 2024-09-22T08:36:47.644 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.634+0000 7f91e5822640 1 --2- 172.21.15.142:0/2737950933 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55efcf394ed0 0x55efcf39c4b0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f91e0054740 tx=0x7f91e00547a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:47.644 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.634+0000 7f90baffd640 1 -- 172.21.15.142:0/2737950933 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f91e0021570 con 0x55efcf394ed0 2024-09-22T08:36:47.644 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.635+0000 7f90baffd640 1 -- 172.21.15.142:0/2737950933 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91e00459e0 con 0x55efcf394ed0 2024-09-22T08:36:47.644 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.635+0000 7f91e9335800 1 -- 172.21.15.142:0/2737950933 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55efcf39cca0 con 0x55efcf394ed0 2024-09-22T08:36:47.644 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.635+0000 7f90baffd640 1 -- 172.21.15.142:0/2737950933 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f91e0045d00 con 0x55efcf394ed0 2024-09-22T08:36:47.644 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.635+0000 7f91e9335800 1 -- 172.21.15.142:0/2737950933 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55efcf39d830 con 0x55efcf394ed0 2024-09-22T08:36:47.644 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.635+0000 7f90baffd640 1 -- 172.21.15.142:0/2737950933 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f91e00451d0 con 0x55efcf394ed0 2024-09-22T08:36:47.644 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.635+0000 7f90baffd640 1 --2- 172.21.15.142:0/2737950933 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f90b003cfb0 0x7f90b003f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:47.644 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.636+0000 7f90baffd640 1 -- 172.21.15.142:0/2737950933 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f91e004c030 con 0x55efcf394ed0 2024-09-22T08:36:47.644 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.636+0000 7f91e5021640 1 --2- 172.21.15.142:0/2737950933 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f90b003cfb0 0x7f90b003f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:47.644 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.636+0000 7f91e5021640 1 --2- 172.21.15.142:0/2737950933 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f90b003cfb0 0x7f90b003f470 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f91d8053320 tx=0x7f91d8032000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:47.644 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.636+0000 7f91e9335800 20 rados->read ofs=0 len=0 2024-09-22T08:36:47.645 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.636+0000 7f91e9335800 1 --2- 172.21.15.142:0/2737950933 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55efcf3a7e30 0x55efcf3aa2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:47.645 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.636+0000 7f91e9335800 1 -- 172.21.15.142:0/2737950933 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55efcf3aaa40 con 0x55efcf3a7e30 2024-09-22T08:36:47.645 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.636+0000 7f91dc820640 1 --2- 172.21.15.142:0/2737950933 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55efcf3a7e30 0x55efcf3aa2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:47.645 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.636+0000 7f91dc820640 1 --2- 172.21.15.142:0/2737950933 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55efcf3a7e30 0x55efcf3aa2f0 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:47.645 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.637+0000 7f91dc820640 1 -- 172.21.15.142:0/2737950933 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f91d0057030 con 0x55efcf3a7e30 2024-09-22T08:36:47.645 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.637+0000 7f91e9335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:47.645 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.637+0000 7f91e9335800 20 realm 2024-09-22T08:36:47.645 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.637+0000 7f91e9335800 20 rados->read ofs=0 len=0 2024-09-22T08:36:47.645 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.637+0000 7f91e9335800 1 -- 172.21.15.142:0/2737950933 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55efcf3aae70 con 0x55efcf3a7e30 2024-09-22T08:36:47.645 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.637+0000 7f91dc820640 1 -- 172.21.15.142:0/2737950933 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f91d0057030 con 0x55efcf3a7e30 2024-09-22T08:36:47.645 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.637+0000 7f91e9335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:47.645 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.637+0000 7f91e9335800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:36:47.645 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.637+0000 7f91e9335800 20 rados->read ofs=0 len=0 2024-09-22T08:36:47.645 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.637+0000 7f91e9335800 1 -- 172.21.15.142:0/2737950933 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55efcf3ab740 con 0x55efcf3a7e30 2024-09-22T08:36:47.646 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.637+0000 7f91dc820640 1 -- 172.21.15.142:0/2737950933 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f91d0057030 con 0x55efcf3a7e30 2024-09-22T08:36:47.646 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.637+0000 7f91e9335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:47.646 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.637+0000 7f91e9335800 20 rados->read ofs=0 len=0 2024-09-22T08:36:47.646 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.637+0000 7f91e9335800 1 -- 172.21.15.142:0/2737950933 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55efcf3abae0 con 0x55efcf3a7e30 2024-09-22T08:36:47.646 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.637+0000 7f91dc820640 1 -- 172.21.15.142:0/2737950933 <== osd.1 v2:172.21.15.142:6816/3192108003 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f91d0057030 con 0x55efcf3a7e30 2024-09-22T08:36:47.646 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.637+0000 7f91e9335800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:36:47.646 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.637+0000 7f91e9335800 20 rados->read ofs=0 len=0 2024-09-22T08:36:47.646 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.637+0000 7f91e9335800 1 --2- 172.21.15.142:0/2737950933 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55efcf3ac840 0x55efcf3aec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:47.646 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.637+0000 7f91e9335800 1 -- 172.21.15.142:0/2737950933 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55efcf3af240 con 0x55efcf3ac840 2024-09-22T08:36:47.646 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.638+0000 7f91e5822640 1 --2- 172.21.15.142:0/2737950933 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55efcf3ac840 0x55efcf3aec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:47.646 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.638+0000 7f91e5822640 1 --2- 172.21.15.142:0/2737950933 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55efcf3ac840 0x55efcf3aec30 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:47.646 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.638+0000 7f91e5822640 1 -- 172.21.15.142:0/2737950933 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(5 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f91e003a070 con 0x55efcf3ac840 2024-09-22T08:36:47.646 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.638+0000 7f91e9335800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:36:47.646 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.638+0000 7f91e9335800 20 searching for the correct realm 2024-09-22T08:36:47.647 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.638+0000 7f91e9335800 1 -- 172.21.15.142:0/2737950933 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55efcf3b0b90 con 0x55efcf3ac840 2024-09-22T08:36:47.647 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.638+0000 7f91e5822640 1 -- 172.21.15.142:0/2737950933 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f91e003a070 con 0x55efcf3ac840 2024-09-22T08:36:47.647 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.638+0000 7f91e5822640 1 --2- 172.21.15.142:0/2737950933 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f91e0054c20 0x7f91e004e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:47.647 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.638+0000 7f91e5822640 1 -- 172.21.15.142:0/2737950933 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55efcf3b0b90 con 0x7f91e0054c20 2024-09-22T08:36:47.647 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.638+0000 7f91e5021640 1 --2- 172.21.15.142:0/2737950933 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f91e0054c20 0x7f91e004e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:47.647 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.639+0000 7f91e5021640 1 --2- 172.21.15.142:0/2737950933 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f91e0054c20 0x7f91e004e000 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:47.647 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.639+0000 7f91e5021640 1 -- 172.21.15.142:0/2737950933 <== osd.2 v2:172.21.15.142:6808/279438927 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f91d802e070 con 0x7f91e0054c20 2024-09-22T08:36:47.647 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.639+0000 7f91e5021640 1 --2- 172.21.15.142:0/2737950933 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x55efcf1e7580 0x7f91d804b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:47.647 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.639+0000 7f91e5021640 1 -- 172.21.15.142:0/2737950933 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55efcf3b0b90 con 0x55efcf1e7580 2024-09-22T08:36:47.647 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.639+0000 7f91dc820640 1 --2- 172.21.15.142:0/2737950933 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x55efcf1e7580 0x7f91d804b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:47.647 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.640+0000 7f91dc820640 1 --2- 172.21.15.142:0/2737950933 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x55efcf1e7580 0x7f91d804b3a0 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:47.647 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.640+0000 7f91dc820640 1 -- 172.21.15.142:0/2737950933 <== osd.0 v2:172.21.15.31:6800/168281188 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f91d0057030 con 0x55efcf1e7580 2024-09-22T08:36:47.647 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.640+0000 7f91dc820640 1 -- 172.21.15.142:0/2737950933 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55efcf3b0b90 con 0x55efcf3a7e30 2024-09-22T08:36:47.647 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.640+0000 7f91dc820640 1 -- 172.21.15.142:0/2737950933 <== osd.1 v2:172.21.15.142:6816/3192108003 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f91d0057030 con 0x55efcf3a7e30 2024-09-22T08:36:47.648 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.640+0000 7f91dc820640 1 -- 172.21.15.142:0/2737950933 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55efcf3b0b90 con 0x55efcf3a7e30 2024-09-22T08:36:47.648 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.640+0000 7f91dc820640 1 -- 172.21.15.142:0/2737950933 <== osd.1 v2:172.21.15.142:6816/3192108003 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f91d0057030 con 0x55efcf3a7e30 2024-09-22T08:36:47.648 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.640+0000 7f91dc820640 1 -- 172.21.15.142:0/2737950933 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55efcf3b0b90 con 0x55efcf1e7580 2024-09-22T08:36:47.656 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.641+0000 7f91dc820640 1 -- 172.21.15.142:0/2737950933 <== osd.0 v2:172.21.15.31:6800/168281188 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f91d0057030 con 0x55efcf1e7580 2024-09-22T08:36:47.656 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.641+0000 7f91dc820640 1 -- 172.21.15.142:0/2737950933 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55efcf3b0b90 con 0x55efcf1e7580 2024-09-22T08:36:47.657 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.641+0000 7f91dc820640 1 -- 172.21.15.142:0/2737950933 <== osd.0 v2:172.21.15.31:6800/168281188 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f91d0057030 con 0x55efcf1e7580 2024-09-22T08:36:47.657 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.641+0000 7f91dc820640 1 -- 172.21.15.142:0/2737950933 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55efcf3b0b90 con 0x7f91e0054c20 2024-09-22T08:36:47.657 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.641+0000 7f91e5021640 1 -- 172.21.15.142:0/2737950933 <== osd.2 v2:172.21.15.142:6808/279438927 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f91d802e070 con 0x7f91e0054c20 2024-09-22T08:36:47.657 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.641+0000 7f91e5021640 1 -- 172.21.15.142:0/2737950933 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55efcf3b0b90 con 0x55efcf3ac840 2024-09-22T08:36:47.657 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.641+0000 7f91e5822640 1 -- 172.21.15.142:0/2737950933 <== osd.3 v2:172.21.15.142:6800/1064901393 3 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f91e003a070 con 0x55efcf3ac840 2024-09-22T08:36:47.657 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.641+0000 7f91e5822640 1 -- 172.21.15.142:0/2737950933 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55efcf3b0b90 con 0x55efcf3a7e30 2024-09-22T08:36:47.657 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.642+0000 7f91dc820640 1 -- 172.21.15.142:0/2737950933 <== osd.1 v2:172.21.15.142:6816/3192108003 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f91d0057030 con 0x55efcf3a7e30 2024-09-22T08:36:47.657 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.642+0000 7f91dc820640 1 -- 172.21.15.142:0/2737950933 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55efcf3b0b90 con 0x55efcf1e7580 2024-09-22T08:36:47.657 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.642+0000 7f91dc820640 1 -- 172.21.15.142:0/2737950933 <== osd.0 v2:172.21.15.31:6800/168281188 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f91d0057030 con 0x55efcf1e7580 2024-09-22T08:36:47.657 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.642+0000 7f91dc820640 1 -- 172.21.15.142:0/2737950933 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55efcf3b0b90 con 0x55efcf3a7e30 2024-09-22T08:36:47.657 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.642+0000 7f91dc820640 1 -- 172.21.15.142:0/2737950933 <== osd.1 v2:172.21.15.142:6816/3192108003 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f91d0057030 con 0x55efcf3a7e30 2024-09-22T08:36:47.657 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.642+0000 7f91dc820640 1 -- 172.21.15.142:0/2737950933 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55efcf3b0b90 con 0x7f91e0054c20 2024-09-22T08:36:47.658 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.642+0000 7f91e5021640 1 -- 172.21.15.142:0/2737950933 <== osd.2 v2:172.21.15.142:6808/279438927 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f91d802e070 con 0x7f91e0054c20 2024-09-22T08:36:47.658 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.642+0000 7f91e5021640 1 -- 172.21.15.142:0/2737950933 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55efcf3b0b90 con 0x55efcf3ac840 2024-09-22T08:36:47.658 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.642+0000 7f91e5822640 1 -- 172.21.15.142:0/2737950933 <== osd.3 v2:172.21.15.142:6800/1064901393 4 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f91e003a070 con 0x55efcf3ac840 2024-09-22T08:36:47.658 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.642+0000 7f91e5822640 1 -- 172.21.15.142:0/2737950933 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55efcf3b0b90 con 0x55efcf3ac840 2024-09-22T08:36:47.658 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.643+0000 7f91e5822640 1 -- 172.21.15.142:0/2737950933 <== osd.3 v2:172.21.15.142:6800/1064901393 5 ==== osd_op_reply(20 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f91e003a070 con 0x55efcf3ac840 2024-09-22T08:36:47.658 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.643+0000 7f91e5822640 1 -- 172.21.15.142:0/2737950933 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55efcf3b0b90 con 0x55efcf1e7580 2024-09-22T08:36:47.658 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.643+0000 7f91dc820640 1 -- 172.21.15.142:0/2737950933 <== osd.0 v2:172.21.15.31:6800/168281188 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f91d0057030 con 0x55efcf1e7580 2024-09-22T08:36:47.658 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.643+0000 7f91dc820640 1 -- 172.21.15.142:0/2737950933 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55efcf3b0b90 con 0x55efcf3ac840 2024-09-22T08:36:47.658 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.643+0000 7f91e5822640 1 -- 172.21.15.142:0/2737950933 <== osd.3 v2:172.21.15.142:6800/1064901393 6 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f91e003a070 con 0x55efcf3ac840 2024-09-22T08:36:47.658 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.643+0000 7f91e5822640 1 -- 172.21.15.142:0/2737950933 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55efcf3b0b90 con 0x55efcf3ac840 2024-09-22T08:36:47.658 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.643+0000 7f91e5822640 1 -- 172.21.15.142:0/2737950933 <== osd.3 v2:172.21.15.142:6800/1064901393 7 ==== osd_op_reply(23 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f91e003a070 con 0x55efcf3ac840 2024-09-22T08:36:47.658 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.643+0000 7f91e5822640 1 -- 172.21.15.142:0/2737950933 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55efcf3b0b90 con 0x55efcf3a7e30 2024-09-22T08:36:47.658 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.644+0000 7f91dc820640 1 -- 172.21.15.142:0/2737950933 <== osd.1 v2:172.21.15.142:6816/3192108003 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f91d0057030 con 0x55efcf3a7e30 2024-09-22T08:36:47.659 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.644+0000 7f91dc820640 1 -- 172.21.15.142:0/2737950933 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55efcf3b0b90 con 0x55efcf3a7e30 2024-09-22T08:36:47.659 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.644+0000 7f91dc820640 1 -- 172.21.15.142:0/2737950933 <== osd.1 v2:172.21.15.142:6816/3192108003 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f91d0057030 con 0x55efcf3a7e30 2024-09-22T08:36:47.659 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.644+0000 7f91dc820640 1 -- 172.21.15.142:0/2737950933 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55efcf3b0b90 con 0x55efcf1e7580 2024-09-22T08:36:47.659 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.644+0000 7f91dc820640 1 -- 172.21.15.142:0/2737950933 <== osd.0 v2:172.21.15.31:6800/168281188 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f91d0057030 con 0x55efcf1e7580 2024-09-22T08:36:47.659 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.644+0000 7f91dc820640 1 -- 172.21.15.142:0/2737950933 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55efcf3b0b90 con 0x55efcf3ac840 2024-09-22T08:36:47.659 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.644+0000 7f91e5822640 1 -- 172.21.15.142:0/2737950933 <== osd.3 v2:172.21.15.142:6800/1064901393 8 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f91e003a070 con 0x55efcf3ac840 2024-09-22T08:36:47.659 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.644+0000 7f91e5822640 1 -- 172.21.15.142:0/2737950933 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55efcf3b0b90 con 0x7f91e0054c20 2024-09-22T08:36:47.659 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.644+0000 7f91e5021640 1 -- 172.21.15.142:0/2737950933 <== osd.2 v2:172.21.15.142:6808/279438927 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f91d802e070 con 0x7f91e0054c20 2024-09-22T08:36:47.659 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.645+0000 7f91e5021640 1 -- 172.21.15.142:0/2737950933 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55efcf3b0b90 con 0x55efcf3a7e30 2024-09-22T08:36:47.659 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.645+0000 7f91dc820640 1 -- 172.21.15.142:0/2737950933 <== osd.1 v2:172.21.15.142:6816/3192108003 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f91d0057030 con 0x55efcf3a7e30 2024-09-22T08:36:47.659 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.645+0000 7f91dc820640 1 -- 172.21.15.142:0/2737950933 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55efcf3b0b90 con 0x55efcf1e7580 2024-09-22T08:36:47.659 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.645+0000 7f91dc820640 1 -- 172.21.15.142:0/2737950933 <== osd.0 v2:172.21.15.31:6800/168281188 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f91d0057030 con 0x55efcf1e7580 2024-09-22T08:36:47.659 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.645+0000 7f91dc820640 1 -- 172.21.15.142:0/2737950933 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55efcf3b0b90 con 0x55efcf3ac840 2024-09-22T08:36:47.660 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.645+0000 7f91e5822640 1 -- 172.21.15.142:0/2737950933 <== osd.3 v2:172.21.15.142:6800/1064901393 9 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f91e003a070 con 0x55efcf3ac840 2024-09-22T08:36:47.660 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.645+0000 7f91e5822640 1 -- 172.21.15.142:0/2737950933 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55efcf3b0b90 con 0x55efcf1e7580 2024-09-22T08:36:47.660 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.645+0000 7f91dc820640 1 -- 172.21.15.142:0/2737950933 <== osd.0 v2:172.21.15.31:6800/168281188 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f91d0057030 con 0x55efcf1e7580 2024-09-22T08:36:47.660 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.645+0000 7f91dc820640 1 -- 172.21.15.142:0/2737950933 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55efcf3b0b90 con 0x7f91e0054c20 2024-09-22T08:36:47.660 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.646+0000 7f91e5021640 1 -- 172.21.15.142:0/2737950933 <== osd.2 v2:172.21.15.142:6808/279438927 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f91d802e070 con 0x7f91e0054c20 2024-09-22T08:36:47.660 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.646+0000 7f91e5021640 1 -- 172.21.15.142:0/2737950933 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55efcf3b0b90 con 0x55efcf3ac840 2024-09-22T08:36:47.660 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.646+0000 7f91e5822640 1 -- 172.21.15.142:0/2737950933 <== osd.3 v2:172.21.15.142:6800/1064901393 10 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f91e003a070 con 0x55efcf3ac840 2024-09-22T08:36:47.660 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.646+0000 7f91e5822640 1 -- 172.21.15.142:0/2737950933 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55efcf3b0b90 con 0x55efcf1e7580 2024-09-22T08:36:47.660 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.646+0000 7f91dc820640 1 -- 172.21.15.142:0/2737950933 <== osd.0 v2:172.21.15.31:6800/168281188 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f91d0057030 con 0x55efcf1e7580 2024-09-22T08:36:47.660 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.646+0000 7f91dc820640 1 -- 172.21.15.142:0/2737950933 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55efcf3b0b90 con 0x55efcf3a7e30 2024-09-22T08:36:47.660 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.646+0000 7f91dc820640 1 -- 172.21.15.142:0/2737950933 <== osd.1 v2:172.21.15.142:6816/3192108003 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f91d0057030 con 0x55efcf3a7e30 2024-09-22T08:36:47.660 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.646+0000 7f91dc820640 1 -- 172.21.15.142:0/2737950933 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55efcf3b0b90 con 0x7f91e0054c20 2024-09-22T08:36:47.660 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.647+0000 7f91e5021640 1 -- 172.21.15.142:0/2737950933 <== osd.2 v2:172.21.15.142:6808/279438927 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f91d802e070 con 0x7f91e0054c20 2024-09-22T08:36:47.661 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.647+0000 7f91e9335800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:36:47.661 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.647+0000 7f91e9335800 20 RGWRados::pool_iterate: got zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec 2024-09-22T08:36:47.661 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.647+0000 7f91e9335800 20 RGWRados::pool_iterate: got zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f 2024-09-22T08:36:47.661 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.647+0000 7f91e9335800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:36:47.661 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.647+0000 7f91e9335800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:36:47.661 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.647+0000 7f91e9335800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:36:47.661 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.647+0000 7f91e9335800 20 rados->read ofs=0 len=0 2024-09-22T08:36:47.661 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.647+0000 7f91e9335800 1 -- 172.21.15.142:0/2737950933 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55efcf3afc00 con 0x55efcf3a7e30 2024-09-22T08:36:47.661 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.647+0000 7f91dc820640 1 -- 172.21.15.142:0/2737950933 <== osd.1 v2:172.21.15.142:6816/3192108003 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f91d0057030 con 0x55efcf3a7e30 2024-09-22T08:36:47.661 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.647+0000 7f91e9335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:47.661 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.647+0000 7f91e9335800 20 rados->read ofs=0 len=0 2024-09-22T08:36:47.661 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.647+0000 7f91e9335800 1 -- 172.21.15.142:0/2737950933 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55efcf3b0450 con 0x55efcf3a7e30 2024-09-22T08:36:47.661 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.647+0000 7f91dc820640 1 -- 172.21.15.142:0/2737950933 <== osd.1 v2:172.21.15.142:6816/3192108003 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f91d0057030 con 0x55efcf3a7e30 2024-09-22T08:36:47.661 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.647+0000 7f91e9335800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:36:47.662 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.647+0000 7f91e9335800 20 rados->read ofs=0 len=0 2024-09-22T08:36:47.662 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.647+0000 7f91e9335800 1 -- 172.21.15.142:0/2737950933 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:40 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55efcf3b1010 con 0x55efcf3ac840 2024-09-22T08:36:47.662 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.647+0000 7f91e5822640 1 -- 172.21.15.142:0/2737950933 <== osd.3 v2:172.21.15.142:6800/1064901393 11 ==== osd_op_reply(40 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f91e003a070 con 0x55efcf3ac840 2024-09-22T08:36:47.662 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.647+0000 7f91e9335800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:36:47.662 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.648+0000 7f91e9335800 20 zone default found 2024-09-22T08:36:47.662 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.648+0000 7f91e9335800 4 Realm: () 2024-09-22T08:36:47.662 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.648+0000 7f91e9335800 4 ZoneGroup: default (d89f6f57-1007-47dd-9065-f486c7b01aec) 2024-09-22T08:36:47.662 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.648+0000 7f91e9335800 4 Zone: default (e239248c-0bee-4e41-803a-24b288d3eb8f) 2024-09-22T08:36:47.662 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.648+0000 7f91e9335800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:36:47.662 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.648+0000 7f91e9335800 20 zonegroup default 2024-09-22T08:36:47.662 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.648+0000 7f91e9335800 20 rados->read ofs=0 len=0 2024-09-22T08:36:47.662 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.648+0000 7f91e9335800 1 -- 172.21.15.142:0/2737950933 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55efcf3b13b0 con 0x55efcf1e7580 2024-09-22T08:36:47.662 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.648+0000 7f91dc820640 1 -- 172.21.15.142:0/2737950933 <== osd.0 v2:172.21.15.31:6800/168281188 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f91d0057030 con 0x55efcf1e7580 2024-09-22T08:36:47.663 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.648+0000 7f91e9335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:47.663 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.648+0000 7f91e9335800 20 rados->read ofs=0 len=0 2024-09-22T08:36:47.663 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.648+0000 7f91e9335800 1 -- 172.21.15.142:0/2737950933 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55efcf3b3670 con 0x55efcf3ac840 2024-09-22T08:36:47.663 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.648+0000 7f91e5822640 1 -- 172.21.15.142:0/2737950933 <== osd.3 v2:172.21.15.142:6800/1064901393 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f91e003a070 con 0x55efcf3ac840 2024-09-22T08:36:47.663 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.648+0000 7f91e9335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:47.663 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.648+0000 7f91e9335800 20 rados->read ofs=0 len=0 2024-09-22T08:36:47.663 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.648+0000 7f91e9335800 1 -- 172.21.15.142:0/2737950933 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55efcf3b3a10 con 0x55efcf3ac840 2024-09-22T08:36:47.663 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.648+0000 7f91e5822640 1 -- 172.21.15.142:0/2737950933 <== osd.3 v2:172.21.15.142:6800/1064901393 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f91e003a070 con 0x55efcf3ac840 2024-09-22T08:36:47.663 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.648+0000 7f91e9335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:47.663 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.648+0000 7f91e9335800 20 started sync module instance, tier type = 2024-09-22T08:36:47.663 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.648+0000 7f91e9335800 20 started zone id=e239248c-0bee-4e41-803a-24b288d3eb8f (name=default) with tier type = 2024-09-22T08:36:47.663 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.648+0000 7f91e9335800 1 -- 172.21.15.142:0/2737950933 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55efcf3b2b00 con 0x7f91e0054c20 2024-09-22T08:36:47.663 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.649+0000 7f91e5021640 1 -- 172.21.15.142:0/2737950933 <== osd.2 v2:172.21.15.142:6808/279438927 7 ==== osd_op_reply(44 notify.0 [create] v30'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f91d802e070 con 0x7f91e0054c20 2024-09-22T08:36:47.663 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.649+0000 7f91e9335800 1 -- 172.21.15.142:0/2737950933 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94488462307056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55efcf3b2760 con 0x7f91e0054c20 2024-09-22T08:36:47.664 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.649+0000 7f91e9335800 1 -- 172.21.15.142:0/2737950933 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55efcf3b4860 con 0x55efcf3a7e30 2024-09-22T08:36:47.664 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.650+0000 7f91e5021640 1 -- 172.21.15.142:0/2737950933 <== osd.2 v2:172.21.15.142:6808/279438927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94488462307056] v30'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f91d802e070 con 0x7f91e0054c20 2024-09-22T08:36:47.664 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.651+0000 7f91dc820640 1 -- 172.21.15.142:0/2737950933 <== osd.1 v2:172.21.15.142:6816/3192108003 15 ==== osd_op_reply(46 notify.1 [create] v30'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f91d0057030 con 0x55efcf3a7e30 2024-09-22T08:36:47.664 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.651+0000 7f91e9335800 1 -- 172.21.15.142:0/2737950933 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94488462311072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55efcf3b4c50 con 0x55efcf3a7e30 2024-09-22T08:36:47.664 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.651+0000 7f91e9335800 1 -- 172.21.15.142:0/2737950933 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55efcf3b5690 con 0x55efcf3ac840 2024-09-22T08:36:47.664 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.652+0000 7f91dc820640 1 -- 172.21.15.142:0/2737950933 <== osd.1 v2:172.21.15.142:6816/3192108003 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94488462311072] v30'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f91d0057030 con 0x55efcf3a7e30 2024-09-22T08:36:47.664 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.652+0000 7f91e5822640 1 -- 172.21.15.142:0/2737950933 <== osd.3 v2:172.21.15.142:6800/1064901393 14 ==== osd_op_reply(48 notify.2 [create] v30'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f91e003a070 con 0x55efcf3ac840 2024-09-22T08:36:47.664 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.652+0000 7f91e9335800 1 -- 172.21.15.142:0/2737950933 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94488462315872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55efcf3b5650 con 0x55efcf3ac840 2024-09-22T08:36:47.664 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.652+0000 7f91e9335800 1 -- 172.21.15.142:0/2737950933 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55efcf3b60c0 con 0x7f91e0054c20 2024-09-22T08:36:47.664 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.653+0000 7f91e5021640 1 -- 172.21.15.142:0/2737950933 <== osd.2 v2:172.21.15.142:6808/279438927 9 ==== osd_op_reply(50 notify.3 [create] v30'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f91d802e070 con 0x7f91e0054c20 2024-09-22T08:36:47.664 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.653+0000 7f91e9335800 1 -- 172.21.15.142:0/2737950933 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94488462318512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55efcf3b6990 con 0x7f91e0054c20 2024-09-22T08:36:47.664 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.653+0000 7f91e9335800 1 -- 172.21.15.142:0/2737950933 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55efcf3b7470 con 0x55efcf3a7e30 2024-09-22T08:36:47.664 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.653+0000 7f91e5822640 1 -- 172.21.15.142:0/2737950933 <== osd.3 v2:172.21.15.142:6800/1064901393 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94488462315872] v30'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f91e003a070 con 0x55efcf3ac840 2024-09-22T08:36:47.665 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.654+0000 7f91dc820640 1 -- 172.21.15.142:0/2737950933 <== osd.1 v2:172.21.15.142:6816/3192108003 17 ==== osd_op_reply(52 notify.4 [create] v30'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f91d0057030 con 0x55efcf3a7e30 2024-09-22T08:36:47.665 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.654+0000 7f91e5021640 1 -- 172.21.15.142:0/2737950933 <== osd.2 v2:172.21.15.142:6808/279438927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94488462318512] v30'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f91d802e070 con 0x7f91e0054c20 2024-09-22T08:36:47.665 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.654+0000 7f91e9335800 1 -- 172.21.15.142:0/2737950933 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94488462323584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55efcf3b42c0 con 0x55efcf3a7e30 2024-09-22T08:36:47.665 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.654+0000 7f91e9335800 1 -- 172.21.15.142:0/2737950933 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55efcf3b7e80 con 0x55efcf1e7580 2024-09-22T08:36:47.665 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.655+0000 7f91dc820640 1 -- 172.21.15.142:0/2737950933 <== osd.0 v2:172.21.15.31:6800/168281188 11 ==== osd_op_reply(54 notify.5 [create] v30'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f91d0057030 con 0x55efcf1e7580 2024-09-22T08:36:47.665 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.655+0000 7f91e9335800 1 -- 172.21.15.142:0/2737950933 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94488462326224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55efcf3b82a0 con 0x55efcf1e7580 2024-09-22T08:36:47.665 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.655+0000 7f91e9335800 1 -- 172.21.15.142:0/2737950933 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55efcf3b8d90 con 0x55efcf1e7580 2024-09-22T08:36:47.665 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.655+0000 7f91dc820640 1 -- 172.21.15.142:0/2737950933 <== osd.1 v2:172.21.15.142:6816/3192108003 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94488462323584] v30'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f91d0057030 con 0x55efcf3a7e30 2024-09-22T08:36:47.670 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.656+0000 7f91dc820640 1 -- 172.21.15.142:0/2737950933 <== osd.0 v2:172.21.15.31:6800/168281188 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94488462326224] v30'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f91d0057030 con 0x55efcf1e7580 2024-09-22T08:36:47.670 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.656+0000 7f91dc820640 1 -- 172.21.15.142:0/2737950933 <== osd.0 v2:172.21.15.31:6800/168281188 13 ==== osd_op_reply(56 notify.6 [create] v30'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f91d0057030 con 0x55efcf1e7580 2024-09-22T08:36:47.670 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.656+0000 7f91e9335800 1 -- 172.21.15.142:0/2737950933 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94488462329952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55efcf3b7df0 con 0x55efcf1e7580 2024-09-22T08:36:47.670 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.656+0000 7f91e9335800 1 -- 172.21.15.142:0/2737950933 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55efcf3b9420 con 0x55efcf1e7580 2024-09-22T08:36:47.670 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.657+0000 7f91dc820640 1 -- 172.21.15.142:0/2737950933 <== osd.0 v2:172.21.15.31:6800/168281188 14 ==== osd_op_reply(58 notify.7 [create] v30'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f91d0057030 con 0x55efcf1e7580 2024-09-22T08:36:47.670 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.657+0000 7f91e9335800 1 -- 172.21.15.142:0/2737950933 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94488462331760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55efcf3b9840 con 0x55efcf1e7580 2024-09-22T08:36:47.670 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.657+0000 7f91e9335800 20 add_watcher() i=0 2024-09-22T08:36:47.671 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.657+0000 7f91e9335800 20 add_watcher() i=1 2024-09-22T08:36:47.671 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.657+0000 7f91e9335800 20 add_watcher() i=2 2024-09-22T08:36:47.671 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.657+0000 7f91e9335800 20 add_watcher() i=3 2024-09-22T08:36:47.671 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.657+0000 7f91e9335800 20 add_watcher() i=4 2024-09-22T08:36:47.671 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.657+0000 7f91e9335800 20 add_watcher() i=5 2024-09-22T08:36:47.671 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.657+0000 7f91dc820640 1 -- 172.21.15.142:0/2737950933 <== osd.0 v2:172.21.15.31:6800/168281188 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94488462329952] v30'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f91d0057030 con 0x55efcf1e7580 2024-09-22T08:36:47.671 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.657+0000 7f91e9335800 20 add_watcher() i=6 2024-09-22T08:36:47.671 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.658+0000 7f91dc820640 1 -- 172.21.15.142:0/2737950933 <== osd.0 v2:172.21.15.31:6800/168281188 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94488462331760] v30'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f91d0057030 con 0x55efcf1e7580 2024-09-22T08:36:47.671 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.658+0000 7f91e9335800 20 add_watcher() i=7 2024-09-22T08:36:47.671 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.658+0000 7f91e9335800 2 all 8 watchers are set, enabling cache 2024-09-22T08:36:47.671 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.658+0000 7f91e9335800 1 -- 172.21.15.142:0/2737950933 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55efcf3bc870 con 0x55efcf3a7e30 2024-09-22T08:36:47.671 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.658+0000 7f91dc820640 1 -- 172.21.15.142:0/2737950933 <== osd.1 v2:172.21.15.142:6816/3192108003 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f91d0057030 con 0x55efcf3a7e30 2024-09-22T08:36:47.671 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.658+0000 7f91e9335800 1 -- 172.21.15.142:0/2737950933 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94488462332816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55efcf3b9d00 con 0x55efcf3a7e30 2024-09-22T08:36:47.672 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.659+0000 7f91dc820640 1 -- 172.21.15.142:0/2737950933 <== osd.1 v2:172.21.15.142:6816/3192108003 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94488462332816] v30'126 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f91d0057030 con 0x55efcf3a7e30 2024-09-22T08:36:47.672 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.659+0000 7f909bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:36:47.672 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.659+0000 7f91e9335800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:36:47.672 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.659+0000 7f91e9335800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:36:47.672 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.659+0000 7f91e9335800 5 note: GC not initialized 2024-09-22T08:36:47.672 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.660+0000 7f909afe5640 20 reqs_thread_entry: start 2024-09-22T08:36:47.672 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.660+0000 7f91e9335800 20 init_complete bucket index max shards: 11 2024-09-22T08:36:47.672 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.660+0000 7f91e9335800 20 Filter name: none 2024-09-22T08:36:47.672 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.660+0000 7f9098fe1640 20 reqs_thread_entry: start 2024-09-22T08:36:47.672 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.660+0000 7f91e9335800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : miss 2024-09-22T08:36:47.672 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.660+0000 7f91e9335800 20 rados->read ofs=0 len=0 2024-09-22T08:36:47.672 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.660+0000 7f91e9335800 1 -- 172.21.15.142:0/2737950933 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:62 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55efcf3efc60 con 0x55efcf1e7580 2024-09-22T08:36:47.673 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.661+0000 7f91dc820640 1 -- 172.21.15.142:0/2737950933 <== osd.0 v2:172.21.15.31:6800/168281188 17 ==== osd_op_reply(62 testx$tenanteduser [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 246+0+0 (crc 0 0 0) 0x7f91d0057030 con 0x55efcf1e7580 2024-09-22T08:36:47.673 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.661+0000 7f91e9335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:47.673 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.661+0000 7f91e9335800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x0 2024-09-22T08:36:47.673 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.661+0000 7f91e9335800 10 adding default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-09-22T08:36:47.673 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.661+0000 7f91e9335800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-09-22T08:36:47.673 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.661+0000 7f91e9335800 20 rados->read ofs=0 len=0 2024-09-22T08:36:47.673 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.661+0000 7f91e9335800 1 -- 172.21.15.142:0/2737950933 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55efcf3ee0f0 con 0x55efcf1e7580 2024-09-22T08:36:47.673 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.661+0000 7f91dc820640 1 -- 172.21.15.142:0/2737950933 <== osd.0 v2:172.21.15.31:6800/168281188 18 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7f91d0057030 con 0x55efcf1e7580 2024-09-22T08:36:47.673 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.661+0000 7f91e9335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:47.673 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.661+0000 7f91e9335800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-09-22T08:36:47.673 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.661+0000 7f91e9335800 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-22T08:36:47.673 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.661+0000 7f91e9335800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-22T08:36:47.673 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.661+0000 7f91e9335800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-22T08:36:47.673 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.661+0000 7f91e9335800 1 -- 172.21.15.142:0/2737950933 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:64 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [delete,create,call version.set in=58b,writefull 0~419 in=419b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55efcf3ee970 con 0x55efcf1e7580 2024-09-22T08:36:47.674 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.662+0000 7f91dc820640 1 -- 172.21.15.142:0/2737950933 <== osd.0 v2:172.21.15.31:6800/168281188 19 ==== osd_op_reply(64 testx$tenanteduser [delete,create,call,writefull 0~419] v30'5 uv5 ondisk = 0) ==== 288+0+0 (crc 0 0 0) 0x7f91d0057030 con 0x55efcf1e7580 2024-09-22T08:36:47.674 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.662+0000 7f91e9335800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x17 2024-09-22T08:36:47.674 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.662+0000 7f91e9335800 10 moving default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-09-22T08:36:47.674 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.662+0000 7f91e9335800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.uid:testx$tenanteduser, ofs0, ns] 2024-09-22T08:36:47.674 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.662+0000 7f91e9335800 1 -- 172.21.15.142:0/2737950933 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:65 7.e 7:7759931f:::notify.3:head [notify cookie 94488462550208 in=622b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55efcf3f3700 con 0x7f91e0054c20 2024-09-22T08:36:47.674 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.662+0000 7f91e5021640 1 -- 172.21.15.142:0/2737950933 <== osd.2 v2:172.21.15.142:6808/279438927 11 ==== watch-notify(notify (1) cookie 94488462318512 notify 128849018895 ret 0) ==== 652+0+0 (crc 0 0 0) 0x55efcf36e270 con 0x7f91e0054c20 2024-09-22T08:36:47.674 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.662+0000 7f91e5021640 1 -- 172.21.15.142:0/2737950933 <== osd.2 v2:172.21.15.142:6808/279438927 12 ==== osd_op_reply(65 notify.3 [notify cookie 94488462550208 out=8b] v0'0 uv129 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f91d802e070 con 0x7f91e0054c20 2024-09-22T08:36:47.674 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.662+0000 7f90c8ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018895 cookie 94488462318512 notifier 4534 bl.length()=610 2024-09-22T08:36:47.674 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.662+0000 7f90c8ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x17 2024-09-22T08:36:47.674 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.662+0000 7f90c8ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-09-22T08:36:47.674 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.662+0000 7f90c8ff9640 1 -- 172.21.15.142:0/2737950933 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:66 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f90a8003ea0 con 0x7f91e0054c20 2024-09-22T08:36:47.674 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.663+0000 7f91e5021640 1 -- 172.21.15.142:0/2737950933 <== osd.2 v2:172.21.15.142:6808/279438927 13 ==== osd_op_reply(66 notify.3 [notify-ack] v0'0 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f91d802e070 con 0x7f91e0054c20 2024-09-22T08:36:47.674 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.663+0000 7f91e5021640 1 -- 172.21.15.142:0/2737950933 <== osd.2 v2:172.21.15.142:6808/279438927 14 ==== watch-notify(notify_complete (2) cookie 94488462550208 notify 128849018895 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55efcf36d870 con 0x7f91e0054c20 2024-09-22T08:36:47.675 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.663+0000 7f91e9335800 1 -- 172.21.15.142:0/2737950933 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55efcf3ee920 con 0x55efcf1e7580 2024-09-22T08:36:47.675 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.664+0000 7f91dc820640 1 -- 172.21.15.142:0/2737950933 <== osd.0 v2:172.21.15.31:6800/168281188 20 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~22] v30'6 uv6 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f91d0057030 con 0x55efcf1e7580 2024-09-22T08:36:47.675 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.664+0000 7f91e9335800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-22T08:36:47.675 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.664+0000 7f91e9335800 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-22T08:36:47.675 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.664+0000 7f91e9335800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-22T08:36:47.675 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.664+0000 7f91e9335800 1 -- 172.21.15.142:0/2737950933 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94488462565952 in=204b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55efcf3ee920 con 0x55efcf3ac840 2024-09-22T08:36:47.675 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.664+0000 7f91e5822640 1 -- 172.21.15.142:0/2737950933 <== osd.3 v2:172.21.15.142:6800/1064901393 16 ==== watch-notify(notify (1) cookie 94488462315872 notify 128849018884 ret 0) ==== 234+0+0 (crc 0 0 0) 0x55efcf39cca0 con 0x55efcf3ac840 2024-09-22T08:36:47.675 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.664+0000 7f90c8ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018884 cookie 94488462315872 notifier 4534 bl.length()=192 2024-09-22T08:36:47.675 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.664+0000 7f90c8ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-22T08:36:47.675 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.664+0000 7f90c8ff9640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-22T08:36:47.675 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.664+0000 7f91e5822640 1 -- 172.21.15.142:0/2737950933 <== osd.3 v2:172.21.15.142:6800/1064901393 17 ==== osd_op_reply(68 notify.2 [notify cookie 94488462565952 out=8b] v0'0 uv129 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f91e003a070 con 0x55efcf3ac840 2024-09-22T08:36:47.675 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.664+0000 7f90c8ff9640 1 -- 172.21.15.142:0/2737950933 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f90a8003ea0 con 0x55efcf3ac840 2024-09-22T08:36:47.675 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.664+0000 7f91e5822640 1 -- 172.21.15.142:0/2737950933 <== osd.3 v2:172.21.15.142:6800/1064901393 18 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f91e003a070 con 0x55efcf3ac840 2024-09-22T08:36:47.676 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.665+0000 7f91e5822640 1 -- 172.21.15.142:0/2737950933 <== osd.3 v2:172.21.15.142:6800/1064901393 19 ==== watch-notify(notify_complete (2) cookie 94488462565952 notify 128849018884 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f91e005e020 con 0x55efcf3ac840 2024-09-22T08:36:47.676 INFO:teuthology.orchestra.run.smithi142.stdout:{"user_id":"testx$tenanteduser","display_name":"tenanted-user","email":"","suspended":0,"max_buckets":1,"subusers":[],"keys":[{"user":"testx$tenanteduser","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-09-22T08:36:47.662382Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-22T08:36:47.662372Z","tags":[],"group_ids":[]} 2024-09-22T08:36:47.681 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.665+0000 7f909bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:36:47.681 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.665+0000 7f91e9335800 1 -- 172.21.15.142:0/2737950933 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94488462332816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55efcf3ed760 con 0x55efcf3a7e30 2024-09-22T08:36:47.681 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.666+0000 7f91dc820640 1 -- 172.21.15.142:0/2737950933 <== osd.1 v2:172.21.15.142:6816/3192108003 21 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94488462332816] v30'127 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f91d0057030 con 0x55efcf3a7e30 2024-09-22T08:36:47.681 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.666+0000 7f91e9335800 1 -- 172.21.15.142:0/2737950933 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94488462307056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55efcf3ed760 con 0x7f91e0054c20 2024-09-22T08:36:47.681 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.667+0000 7f91e5021640 1 -- 172.21.15.142:0/2737950933 <== osd.2 v2:172.21.15.142:6808/279438927 15 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94488462307056] v30'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f91d802e070 con 0x7f91e0054c20 2024-09-22T08:36:47.681 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.667+0000 7f91e9335800 20 remove_watcher() i=0 2024-09-22T08:36:47.681 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.667+0000 7f91e9335800 2 removed watcher, disabling cache 2024-09-22T08:36:47.681 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.667+0000 7f91e9335800 1 -- 172.21.15.142:0/2737950933 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94488462311072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55efcf3ed760 con 0x55efcf3a7e30 2024-09-22T08:36:47.682 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.669+0000 7f91dc820640 1 -- 172.21.15.142:0/2737950933 <== osd.1 v2:172.21.15.142:6816/3192108003 22 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94488462311072] v30'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f91d0057030 con 0x55efcf3a7e30 2024-09-22T08:36:47.682 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.669+0000 7f91e9335800 20 remove_watcher() i=1 2024-09-22T08:36:47.682 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.669+0000 7f91e9335800 1 -- 172.21.15.142:0/2737950933 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94488462315872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55efcf3ed760 con 0x55efcf3ac840 2024-09-22T08:36:47.682 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.670+0000 7f91e5822640 1 -- 172.21.15.142:0/2737950933 <== osd.3 v2:172.21.15.142:6800/1064901393 20 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94488462315872] v30'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f91e003a070 con 0x55efcf3ac840 2024-09-22T08:36:47.682 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.670+0000 7f91e9335800 20 remove_watcher() i=2 2024-09-22T08:36:47.682 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.670+0000 7f91e9335800 1 -- 172.21.15.142:0/2737950933 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94488462318512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55efcf3ed760 con 0x7f91e0054c20 2024-09-22T08:36:47.682 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.671+0000 7f91e5021640 1 -- 172.21.15.142:0/2737950933 <== osd.2 v2:172.21.15.142:6808/279438927 16 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94488462318512] v30'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f91d802e070 con 0x7f91e0054c20 2024-09-22T08:36:47.682 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.671+0000 7f91e9335800 20 remove_watcher() i=3 2024-09-22T08:36:47.682 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.671+0000 7f91e9335800 1 -- 172.21.15.142:0/2737950933 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94488462323584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55efcf3ed760 con 0x55efcf3a7e30 2024-09-22T08:36:47.682 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.672+0000 7f91dc820640 1 -- 172.21.15.142:0/2737950933 <== osd.1 v2:172.21.15.142:6816/3192108003 23 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94488462323584] v30'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f91d0057030 con 0x55efcf3a7e30 2024-09-22T08:36:47.682 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.672+0000 7f91e9335800 20 remove_watcher() i=4 2024-09-22T08:36:47.682 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.672+0000 7f91e9335800 1 -- 172.21.15.142:0/2737950933 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94488462326224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55efcf3ed760 con 0x55efcf1e7580 2024-09-22T08:36:47.682 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.673+0000 7f91dc820640 1 -- 172.21.15.142:0/2737950933 <== osd.0 v2:172.21.15.31:6800/168281188 21 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94488462326224] v30'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f91d0057030 con 0x55efcf1e7580 2024-09-22T08:36:47.683 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.673+0000 7f91e9335800 20 remove_watcher() i=5 2024-09-22T08:36:47.683 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.673+0000 7f91e9335800 1 -- 172.21.15.142:0/2737950933 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94488462329952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55efcf3ed760 con 0x55efcf1e7580 2024-09-22T08:36:47.683 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.674+0000 7f91dc820640 1 -- 172.21.15.142:0/2737950933 <== osd.0 v2:172.21.15.31:6800/168281188 22 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94488462329952] v30'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f91d0057030 con 0x55efcf1e7580 2024-09-22T08:36:47.683 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.674+0000 7f91e9335800 20 remove_watcher() i=6 2024-09-22T08:36:47.683 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.674+0000 7f91e9335800 1 -- 172.21.15.142:0/2737950933 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94488462331760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55efcf3ed760 con 0x55efcf1e7580 2024-09-22T08:36:47.683 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.674+0000 7f91dc820640 1 -- 172.21.15.142:0/2737950933 <== osd.0 v2:172.21.15.31:6800/168281188 23 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94488462331760] v30'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f91d0057030 con 0x55efcf1e7580 2024-09-22T08:36:47.683 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.675+0000 7f91e9335800 20 remove_watcher() i=7 2024-09-22T08:36:47.683 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.675+0000 7f91e9335800 1 -- 172.21.15.142:0/2737950933 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x55efcf1e7580 msgr2=0x7f91d804b3a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:47.683 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.675+0000 7f91e9335800 1 --2- 172.21.15.142:0/2737950933 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x55efcf1e7580 0x7f91d804b3a0 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:47.683 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.675+0000 7f91e9335800 1 -- 172.21.15.142:0/2737950933 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55efcf3a7e30 msgr2=0x55efcf3aa2f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:47.683 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.675+0000 7f91e9335800 1 --2- 172.21.15.142:0/2737950933 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55efcf3a7e30 0x55efcf3aa2f0 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:47.683 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.675+0000 7f91e9335800 1 -- 172.21.15.142:0/2737950933 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f91e0054c20 msgr2=0x7f91e004e000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:47.683 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.675+0000 7f91e9335800 1 --2- 172.21.15.142:0/2737950933 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f91e0054c20 0x7f91e004e000 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:47.684 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.675+0000 7f91e9335800 1 -- 172.21.15.142:0/2737950933 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55efcf3ac840 msgr2=0x55efcf3aec30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:47.684 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.675+0000 7f91e9335800 1 --2- 172.21.15.142:0/2737950933 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55efcf3ac840 0x55efcf3aec30 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:47.684 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.675+0000 7f91e9335800 1 -- 172.21.15.142:0/2737950933 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f90b003cfb0 msgr2=0x7f90b003f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:47.684 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.675+0000 7f91e9335800 1 --2- 172.21.15.142:0/2737950933 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f90b003cfb0 0x7f90b003f470 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f91d8053320 tx=0x7f91d8032000 comp rx=0 tx=0).stop 2024-09-22T08:36:47.684 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.675+0000 7f91e9335800 1 -- 172.21.15.142:0/2737950933 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55efcf394ed0 msgr2=0x55efcf39c4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:47.684 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.675+0000 7f91dc820640 1 -- 172.21.15.142:0/2737950933 reap_dead start 2024-09-22T08:36:47.684 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.675+0000 7f91e9335800 1 --2- 172.21.15.142:0/2737950933 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55efcf394ed0 0x55efcf39c4b0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f91e0054740 tx=0x7f91e00547a0 comp rx=0 tx=0).stop 2024-09-22T08:36:47.684 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.675+0000 7f91e9335800 1 -- 172.21.15.142:0/2737950933 shutdown_connections 2024-09-22T08:36:47.684 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.675+0000 7f91e9335800 1 --2- 172.21.15.142:0/2737950933 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55efcf394ed0 0x55efcf39c4b0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:47.684 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.675+0000 7f91e9335800 1 -- 172.21.15.142:0/2737950933 >> 172.21.15.142:0/2737950933 conn(0x55efcf3912d0 msgr2=0x55efcf38f4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:47.684 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.675+0000 7f91e9335800 1 -- 172.21.15.142:0/2737950933 shutdown_connections 2024-09-22T08:36:47.684 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.675+0000 7f91e9335800 1 -- 172.21.15.142:0/2737950933 wait complete. 2024-09-22T08:36:47.684 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.675+0000 7f91e9335800 1 -- 172.21.15.142:0/1455840527 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f90bc03cfb0 msgr2=0x7f90bc03f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:47.684 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.675+0000 7f91e9335800 1 --2- 172.21.15.142:0/1455840527 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f90bc03cfb0 0x7f90bc03f470 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x55efcf375130 tx=0x7f91d8017a40 comp rx=0 tx=0).stop 2024-09-22T08:36:47.685 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.675+0000 7f91e9335800 1 -- 172.21.15.142:0/1455840527 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55efcf388410 msgr2=0x55efcf388830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:47.685 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.675+0000 7f91e9335800 1 --2- 172.21.15.142:0/1455840527 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55efcf388410 0x55efcf388830 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x55efcf36e080 tx=0x7f91e00167b0 comp rx=0 tx=0).stop 2024-09-22T08:36:47.685 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.675+0000 7f91e9335800 1 -- 172.21.15.142:0/1455840527 shutdown_connections 2024-09-22T08:36:47.685 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.675+0000 7f91e9335800 1 --2- 172.21.15.142:0/1455840527 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f90bc03cfb0 0x7f90bc03f470 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:47.685 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.675+0000 7f91e9335800 1 --2- 172.21.15.142:0/1455840527 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55efcf388410 0x55efcf388830 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:47.685 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.675+0000 7f91e9335800 1 -- 172.21.15.142:0/1455840527 >> 172.21.15.142:0/1455840527 conn(0x55efcf37c7c0 msgr2=0x55efcf37cba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:47.685 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.675+0000 7f91e9335800 1 -- 172.21.15.142:0/1455840527 shutdown_connections 2024-09-22T08:36:47.685 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.675+0000 7f91e9335800 1 -- 172.21.15.142:0/1455840527 wait complete. 2024-09-22T08:36:47.685 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.676+0000 7f91e9335800 1 -- 172.21.15.142:0/3667943747 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55efcf36ed70 msgr2=0x55efcf3746d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:47.685 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.676+0000 7f91e9335800 1 --2- 172.21.15.142:0/3667943747 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55efcf36ed70 0x55efcf3746d0 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:47.685 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.676+0000 7f91e9335800 1 -- 172.21.15.142:0/3667943747 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55efcf376fb0 msgr2=0x55efcf3793a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:47.685 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.676+0000 7f91e9335800 1 --2- 172.21.15.142:0/3667943747 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55efcf376fb0 0x55efcf3793a0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:47.685 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.676+0000 7f91e9335800 1 -- 172.21.15.142:0/3667943747 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f90cc03d000 msgr2=0x7f90cc03f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:47.686 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.676+0000 7f91e9335800 1 --2- 172.21.15.142:0/3667943747 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f90cc03d000 0x7f90cc03f4c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f91d0057000 tx=0x7f91d0052000 comp rx=0 tx=0).stop 2024-09-22T08:36:47.686 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.676+0000 7f91e9335800 1 -- 172.21.15.142:0/3667943747 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55efcf279c50 msgr2=0x55efcf36d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:47.686 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.676+0000 7f91e9335800 1 --2- 172.21.15.142:0/3667943747 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55efcf279c50 0x55efcf36d080 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x55efcf366270 tx=0x7f91d8000ed0 comp rx=0 tx=0).stop 2024-09-22T08:36:47.686 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.676+0000 7f91e9335800 1 -- 172.21.15.142:0/3667943747 shutdown_connections 2024-09-22T08:36:47.686 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.676+0000 7f91e9335800 1 --2- 172.21.15.142:0/3667943747 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55efcf376fb0 0x55efcf3793a0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:47.686 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.676+0000 7f91e9335800 1 --2- 172.21.15.142:0/3667943747 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55efcf36ed70 0x55efcf3746d0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:47.686 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.676+0000 7f91e9335800 1 --2- 172.21.15.142:0/3667943747 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f90cc03d000 0x7f90cc03f4c0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:47.686 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.676+0000 7f91e9335800 1 --2- 172.21.15.142:0/3667943747 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55efcf279c50 0x55efcf36d080 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:47.686 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.676+0000 7f91e9335800 1 -- 172.21.15.142:0/3667943747 >> 172.21.15.142:0/3667943747 conn(0x55efcf26dc30 msgr2=0x55efcf366850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:47.686 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.676+0000 7f91e9335800 1 -- 172.21.15.142:0/3667943747 shutdown_connections 2024-09-22T08:36:47.686 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.676+0000 7f91e9335800 1 -- 172.21.15.142:0/3667943747 wait complete. 2024-09-22T08:36:47.687 DEBUG:tasks.util.rgw: json result: {'user_id': 'testx$tenanteduser', 'display_name': 'tenanted-user', 'email': '', 'suspended': 0, 'max_buckets': 1, 'subusers': [], 'keys': [{'user': 'testx$tenanteduser', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-09-22T08:36:47.662382Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-22T08:36:47.662372Z', 'tags': [], 'group_ids': []} 2024-09-22T08:36:47.687 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--bucket', '/myfoo', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-09-22T08:36:47.687 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--bucket', '/myfoo', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-09-22T08:36:47.688 DEBUG:teuthology.orchestra.run.smithi142:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --bucket /myfoo --tenant testx --uid tenanteduser 2024-09-22T08:36:47.736 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:36:47.736 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:36:47.737 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.735+0000 7f5f97a0f800 1 Processor -- start 2024-09-22T08:36:47.737 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.736+0000 7f5f97a0f800 1 -- start start 2024-09-22T08:36:47.737 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.736+0000 7f5f97a0f800 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55b67d927530 0x55b67d9b84f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:47.737 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.736+0000 7f5f97a0f800 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55b67d83ea20 con 0x55b67d9b8a30 2024-09-22T08:36:47.737 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.736+0000 7f5f97a0f800 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x55b67d83e7d0 con 0x55b67d927530 2024-09-22T08:36:47.738 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.736+0000 7f5f93122640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55b67d927530 0x55b67d9b84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:47.738 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.736+0000 7f5f93122640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55b67d927530 0x55b67d9b84f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:39824/0 (socket says 172.21.15.142:39824) 2024-09-22T08:36:47.738 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.736+0000 7f5f8a921640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x55b67d9b8a30 0x55b67d9baef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.142:42632/0 (socket says 172.21.15.142:42632) 2024-09-22T08:36:47.738 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.736+0000 7f5f93122640 1 -- 172.21.15.142:0/3732562193 learned_addr learned my addr 172.21.15.142:0/3732562193 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:47.738 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.736+0000 7f5f93122640 1 -- 172.21.15.142:0/3732562193 >> v1:172.21.15.31:6789/0 conn(0x55b67d9b8a30 legacy=0x55b67d9baef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:47.738 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.736+0000 7f5f93122640 1 -- 172.21.15.142:0/3732562193 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b67d9bd7b0 con 0x55b67d927530 2024-09-22T08:36:47.739 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.738+0000 7f5f93122640 1 --2- 172.21.15.142:0/3732562193 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b67d927530 0x55b67d9b84f0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f5f8400a520 tx=0x7f5f84045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b13c4f8a9825a086 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:47.739 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.738+0000 7f5f92921640 1 -- 172.21.15.142:0/3732562193 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f84055070 con 0x55b67d927530 2024-09-22T08:36:47.740 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.738+0000 7f5f92921640 1 -- 172.21.15.142:0/3732562193 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f840515b0 con 0x55b67d927530 2024-09-22T08:36:47.740 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.738+0000 7f5f92921640 1 -- 172.21.15.142:0/3732562193 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f840518d0 con 0x55b67d927530 2024-09-22T08:36:47.740 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.739+0000 7f5f97a0f800 1 -- 172.21.15.142:0/3732562193 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b67d927530 msgr2=0x55b67d9b84f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:47.740 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.739+0000 7f5f97a0f800 1 --2- 172.21.15.142:0/3732562193 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b67d927530 0x55b67d9b84f0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f5f8400a520 tx=0x7f5f84045ba0 comp rx=0 tx=0).stop 2024-09-22T08:36:47.740 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.739+0000 7f5f97a0f800 1 -- 172.21.15.142:0/3732562193 shutdown_connections 2024-09-22T08:36:47.741 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.739+0000 7f5f97a0f800 1 --2- 172.21.15.142:0/3732562193 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b67d927530 0x55b67d9b84f0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:47.741 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.739+0000 7f5f97a0f800 1 -- 172.21.15.142:0/3732562193 >> 172.21.15.142:0/3732562193 conn(0x55b67d9adc00 msgr2=0x55b67d9b0040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:47.741 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.739+0000 7f5f97a0f800 1 -- 172.21.15.142:0/3732562193 shutdown_connections 2024-09-22T08:36:47.741 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.739+0000 7f5f97a0f800 1 -- 172.21.15.142:0/3732562193 wait complete. 2024-09-22T08:36:47.754 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.752+0000 7f5f97a0f800 1 Processor -- start 2024-09-22T08:36:47.754 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.752+0000 7f5f97a0f800 1 -- start start 2024-09-22T08:36:47.754 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.752+0000 7f5f97a0f800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b67d927530 0x55b67daa5200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:47.754 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.752+0000 7f5f97a0f800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55b67d84bdd0 con 0x55b67d927530 2024-09-22T08:36:47.754 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.753+0000 7f5f93122640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b67d927530 0x55b67daa5200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:47.754 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.753+0000 7f5f93122640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b67d927530 0x55b67daa5200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:39832/0 (socket says 172.21.15.142:39832) 2024-09-22T08:36:47.754 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.753+0000 7f5f93122640 1 -- 172.21.15.142:0/2406652642 learned_addr learned my addr 172.21.15.142:0/2406652642 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:47.754 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.753+0000 7f5f93122640 1 -- 172.21.15.142:0/2406652642 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b67daa57f0 con 0x55b67d927530 2024-09-22T08:36:47.756 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.753+0000 7f5f93122640 1 --2- 172.21.15.142:0/2406652642 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b67d927530 0x55b67daa5200 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f5f840460d0 tx=0x7f5f84051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d032f7ba439a443 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:47.756 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.753+0000 7f5e8160a640 1 -- 172.21.15.142:0/2406652642 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f840519d0 con 0x55b67d927530 2024-09-22T08:36:47.756 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.753+0000 7f5e8160a640 1 -- 172.21.15.142:0/2406652642 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f84051b70 con 0x55b67d927530 2024-09-22T08:36:47.756 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.753+0000 7f5e8160a640 1 -- 172.21.15.142:0/2406652642 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f84051e50 con 0x55b67d927530 2024-09-22T08:36:47.756 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.754+0000 7f5f97a0f800 1 -- 172.21.15.142:0/2406652642 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b67d927530 msgr2=0x55b67daa5200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:47.756 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.754+0000 7f5f97a0f800 1 --2- 172.21.15.142:0/2406652642 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b67d927530 0x55b67daa5200 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f5f840460d0 tx=0x7f5f84051000 comp rx=0 tx=0).stop 2024-09-22T08:36:47.756 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.754+0000 7f5f97a0f800 1 -- 172.21.15.142:0/2406652642 shutdown_connections 2024-09-22T08:36:47.757 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.754+0000 7f5f97a0f800 1 --2- 172.21.15.142:0/2406652642 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b67d927530 0x55b67daa5200 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:47.757 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.754+0000 7f5f97a0f800 1 -- 172.21.15.142:0/2406652642 >> 172.21.15.142:0/2406652642 conn(0x55b67d9adc00 msgr2=0x55b67daa0b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:47.757 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.754+0000 7f5f97a0f800 1 -- 172.21.15.142:0/2406652642 shutdown_connections 2024-09-22T08:36:47.757 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.754+0000 7f5f97a0f800 1 -- 172.21.15.142:0/2406652642 wait complete. 2024-09-22T08:36:47.757 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.754+0000 7f5f97a0f800 1 Processor -- start 2024-09-22T08:36:47.757 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.754+0000 7f5f97a0f800 1 -- start start 2024-09-22T08:36:47.757 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.755+0000 7f5f97a0f800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b67d927530 0x55b67daacbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:47.757 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.755+0000 7f5f97a0f800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55b67d9bca50 con 0x55b67d927530 2024-09-22T08:36:47.757 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.755+0000 7f5f93122640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b67d927530 0x55b67daacbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:47.757 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.755+0000 7f5f93122640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b67d927530 0x55b67daacbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:39836/0 (socket says 172.21.15.142:39836) 2024-09-22T08:36:47.757 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.755+0000 7f5f93122640 1 -- 172.21.15.142:0/888810703 learned_addr learned my addr 172.21.15.142:0/888810703 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:47.757 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.755+0000 7f5f93122640 1 -- 172.21.15.142:0/888810703 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b67daad140 con 0x55b67d927530 2024-09-22T08:36:47.760 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.755+0000 7f5f93122640 1 --2- 172.21.15.142:0/888810703 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b67d927530 0x55b67daacbe0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f5f840460d0 tx=0x7f5f84002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:47.760 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.756+0000 7f5e7fe07640 1 -- 172.21.15.142:0/888810703 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f84073020 con 0x55b67d927530 2024-09-22T08:36:47.760 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.756+0000 7f5f97a0f800 1 -- 172.21.15.142:0/888810703 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b67daad3d0 con 0x55b67d927530 2024-09-22T08:36:47.760 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.756+0000 7f5e7fe07640 1 -- 172.21.15.142:0/888810703 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f8406f580 con 0x55b67d927530 2024-09-22T08:36:47.760 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.756+0000 7f5f97a0f800 1 -- 172.21.15.142:0/888810703 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b67daadfe0 con 0x55b67d927530 2024-09-22T08:36:47.760 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.756+0000 7f5e7fe07640 1 -- 172.21.15.142:0/888810703 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f8406f860 con 0x55b67d927530 2024-09-22T08:36:47.760 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.757+0000 7f5e7fe07640 1 -- 172.21.15.142:0/888810703 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f5f84076020 con 0x55b67d927530 2024-09-22T08:36:47.760 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.757+0000 7f5e7fe07640 1 --2- 172.21.15.142:0/888810703 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f5e7803cfb0 0x7f5e7803f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:47.760 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.757+0000 7f5e7fe07640 1 -- 172.21.15.142:0/888810703 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f5f8406b040 con 0x55b67d927530 2024-09-22T08:36:47.760 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.757+0000 7f5f8a921640 1 --2- 172.21.15.142:0/888810703 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f5e7803cfb0 0x7f5e7803f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:47.761 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.757+0000 7f5f97a0f800 1 --2- 172.21.15.142:0/888810703 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55b67d9b8a30 0x55b67dab4230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:47.761 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.757+0000 7f5f97a0f800 1 -- 172.21.15.142:0/888810703 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b67dab4770 con 0x55b67d9b8a30 2024-09-22T08:36:47.761 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.757+0000 7f5f93923640 1 --2- 172.21.15.142:0/888810703 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55b67d9b8a30 0x55b67dab4230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:47.761 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.757+0000 7f5f8a921640 1 --2- 172.21.15.142:0/888810703 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f5e7803cfb0 0x7f5e7803f470 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f5f7c001e30 tx=0x7f5f7c001390 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:47.761 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.757+0000 7f5f93923640 1 --2- 172.21.15.142:0/888810703 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55b67d9b8a30 0x55b67dab4230 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:47.761 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.758+0000 7f5f93923640 1 -- 172.21.15.142:0/888810703 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5f8c00a4d0 con 0x55b67d9b8a30 2024-09-22T08:36:47.761 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.758+0000 7f5f97a0f800 1 -- 172.21.15.142:0/888810703 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b67dab4b10 con 0x55b67d9b8a30 2024-09-22T08:36:47.761 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.758+0000 7f5f93923640 1 -- 172.21.15.142:0/888810703 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5f8c00a4d0 con 0x55b67d9b8a30 2024-09-22T08:36:47.761 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.758+0000 7f5f97a0f800 1 --2- 172.21.15.142:0/888810703 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55b67dab6610 0x55b67dab8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:47.761 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.758+0000 7f5f97a0f800 1 -- 172.21.15.142:0/888810703 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:3 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b67dab9240 con 0x55b67dab6610 2024-09-22T08:36:47.761 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.758+0000 7f5f93122640 1 --2- 172.21.15.142:0/888810703 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55b67dab6610 0x55b67dab8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:47.761 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.758+0000 7f5f93122640 1 --2- 172.21.15.142:0/888810703 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55b67dab6610 0x55b67dab8ab0 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:47.761 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.759+0000 7f5f93122640 1 -- 172.21.15.142:0/888810703 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(3 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f5f84057030 con 0x55b67dab6610 2024-09-22T08:36:47.761 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.759+0000 7f5f97a0f800 1 -- 172.21.15.142:0/888810703 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b67dab5360 con 0x55b67d9b8a30 2024-09-22T08:36:47.762 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.759+0000 7f5f93923640 1 -- 172.21.15.142:0/888810703 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5f8c00a4d0 con 0x55b67d9b8a30 2024-09-22T08:36:47.762 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.759+0000 7f5f97a0f800 1 -- 172.21.15.142:0/888810703 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b67dab5780 con 0x55b67dab6610 2024-09-22T08:36:47.766 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.759+0000 7f5f93122640 1 -- 172.21.15.142:0/888810703 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(5 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f5f84057030 con 0x55b67dab6610 2024-09-22T08:36:47.766 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.759+0000 7f5f97a0f800 1 Processor -- start 2024-09-22T08:36:47.766 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.760+0000 7f5f97a0f800 1 -- start start 2024-09-22T08:36:47.766 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.760+0000 7f5f97a0f800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b67dac7c00 0x55b67dac8020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:47.766 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.760+0000 7f5f97a0f800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55b67d8aad50 con 0x55b67dac7c00 2024-09-22T08:36:47.767 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.760+0000 7f5f93923640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b67dac7c00 0x55b67dac8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:47.767 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.760+0000 7f5f93923640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b67dac7c00 0x55b67dac8020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:39852/0 (socket says 172.21.15.142:39852) 2024-09-22T08:36:47.767 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.760+0000 7f5f93923640 1 -- 172.21.15.142:0/2313005359 learned_addr learned my addr 172.21.15.142:0/2313005359 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:47.767 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.760+0000 7f5f93923640 1 -- 172.21.15.142:0/2313005359 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b67dac8660 con 0x55b67dac7c00 2024-09-22T08:36:47.767 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.760+0000 7f5f93923640 1 --2- 172.21.15.142:0/2313005359 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b67dac7c00 0x55b67dac8020 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x55b67daadbe0 tx=0x7f5f8c0167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:47.767 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.760+0000 7f5e7d602640 1 -- 172.21.15.142:0/2313005359 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f8c013640 con 0x55b67dac7c00 2024-09-22T08:36:47.767 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.760+0000 7f5e7d602640 1 -- 172.21.15.142:0/2313005359 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f8c0137e0 con 0x55b67dac7c00 2024-09-22T08:36:47.767 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.760+0000 7f5f97a0f800 1 -- 172.21.15.142:0/2313005359 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b67dac8e90 con 0x55b67dac7c00 2024-09-22T08:36:47.767 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.760+0000 7f5e7d602640 1 -- 172.21.15.142:0/2313005359 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f8c013ae0 con 0x55b67dac7c00 2024-09-22T08:36:47.767 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.761+0000 7f5f97a0f800 1 -- 172.21.15.142:0/2313005359 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b67dac9430 con 0x55b67dac7c00 2024-09-22T08:36:47.767 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.761+0000 7f5e7d602640 1 -- 172.21.15.142:0/2313005359 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f5f8c011040 con 0x55b67dac7c00 2024-09-22T08:36:47.767 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.762+0000 7f5e7d602640 1 --2- 172.21.15.142:0/2313005359 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f5e6c03cfb0 0x7f5e6c03f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:47.767 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.762+0000 7f5e7d602640 1 -- 172.21.15.142:0/2313005359 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f5f8c00e040 con 0x55b67dac7c00 2024-09-22T08:36:47.767 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.762+0000 7f5f93122640 1 --2- 172.21.15.142:0/2313005359 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f5e6c03cfb0 0x7f5e6c03f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:47.768 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.762+0000 7f5f97a0f800 1 Processor -- start 2024-09-22T08:36:47.768 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.762+0000 7f5f93122640 1 --2- 172.21.15.142:0/2313005359 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f5e6c03cfb0 0x7f5e6c03f470 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x55b67dab95e0 tx=0x7f5f8406ef30 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:47.768 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.762+0000 7f5f97a0f800 1 -- start start 2024-09-22T08:36:47.768 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.762+0000 7f5f97a0f800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b67dad4720 0x55b67dad4b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:47.768 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.762+0000 7f5f97a0f800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55b67daa5b60 con 0x55b67dad4720 2024-09-22T08:36:47.768 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.762+0000 7f5f93923640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b67dad4720 0x55b67dad4b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:47.768 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.762+0000 7f5f93923640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b67dad4720 0x55b67dad4b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:39866/0 (socket says 172.21.15.142:39866) 2024-09-22T08:36:47.768 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.762+0000 7f5f93923640 1 -- 172.21.15.142:0/691737706 learned_addr learned my addr 172.21.15.142:0/691737706 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:47.768 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.762+0000 7f5f93923640 1 -- 172.21.15.142:0/691737706 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b67dad5110 con 0x55b67dad4720 2024-09-22T08:36:47.768 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.763+0000 7f5f93923640 1 --2- 172.21.15.142:0/691737706 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b67dad4720 0x55b67dad4b20 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f5f8c054770 tx=0x7f5f8c014530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1525ad0fe4738df8 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:47.768 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.763+0000 7f5e76ffd640 1 -- 172.21.15.142:0/691737706 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f8c051020 con 0x55b67dad4720 2024-09-22T08:36:47.768 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.763+0000 7f5e76ffd640 1 -- 172.21.15.142:0/691737706 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f8c021960 con 0x55b67dad4720 2024-09-22T08:36:47.768 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.763+0000 7f5e76ffd640 1 -- 172.21.15.142:0/691737706 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f8c0532c0 con 0x55b67dad4720 2024-09-22T08:36:47.769 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.763+0000 7f5f97a0f800 1 -- 172.21.15.142:0/691737706 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b67dad4720 msgr2=0x55b67dad4b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:47.769 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.763+0000 7f5f97a0f800 1 --2- 172.21.15.142:0/691737706 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b67dad4720 0x55b67dad4b20 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f5f8c054770 tx=0x7f5f8c014530 comp rx=0 tx=0).stop 2024-09-22T08:36:47.769 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.763+0000 7f5f97a0f800 1 -- 172.21.15.142:0/691737706 shutdown_connections 2024-09-22T08:36:47.769 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.763+0000 7f5f97a0f800 1 --2- 172.21.15.142:0/691737706 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b67dad4720 0x55b67dad4b20 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:47.769 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.763+0000 7f5f97a0f800 1 -- 172.21.15.142:0/691737706 >> 172.21.15.142:0/691737706 conn(0x55b67dad0b20 msgr2=0x55b67daced60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:47.769 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.763+0000 7f5f97a0f800 1 -- 172.21.15.142:0/691737706 shutdown_connections 2024-09-22T08:36:47.769 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.763+0000 7f5f97a0f800 1 -- 172.21.15.142:0/691737706 wait complete. 2024-09-22T08:36:47.769 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.764+0000 7f5f97a0f800 1 Processor -- start 2024-09-22T08:36:47.769 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.764+0000 7f5f97a0f800 1 -- start start 2024-09-22T08:36:47.769 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.764+0000 7f5f97a0f800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b67dad4720 0x55b67dadbd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:47.769 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.764+0000 7f5f97a0f800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55b67dad5730 con 0x55b67dad4720 2024-09-22T08:36:47.769 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.764+0000 7f5f93923640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b67dad4720 0x55b67dadbd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:47.769 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.764+0000 7f5f93923640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b67dad4720 0x55b67dadbd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:39882/0 (socket says 172.21.15.142:39882) 2024-09-22T08:36:47.769 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.764+0000 7f5f93923640 1 -- 172.21.15.142:0/229102318 learned_addr learned my addr 172.21.15.142:0/229102318 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:47.770 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.764+0000 7f5f93923640 1 -- 172.21.15.142:0/229102318 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b67dadc270 con 0x55b67dad4720 2024-09-22T08:36:47.770 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.764+0000 7f5f93923640 1 --2- 172.21.15.142:0/229102318 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b67dad4720 0x55b67dadbd10 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f5f8c021eb0 tx=0x7f5f8c0547a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:47.770 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.764+0000 7f5e757fa640 1 -- 172.21.15.142:0/229102318 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f8c054a10 con 0x55b67dad4720 2024-09-22T08:36:47.770 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.765+0000 7f5e757fa640 1 -- 172.21.15.142:0/229102318 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f8c054040 con 0x55b67dad4720 2024-09-22T08:36:47.770 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.765+0000 7f5f97a0f800 1 -- 172.21.15.142:0/229102318 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b67dadc500 con 0x55b67dad4720 2024-09-22T08:36:47.770 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.765+0000 7f5e757fa640 1 -- 172.21.15.142:0/229102318 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f8c054320 con 0x55b67dad4720 2024-09-22T08:36:47.770 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.765+0000 7f5f97a0f800 1 -- 172.21.15.142:0/229102318 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b67dadce80 con 0x55b67dad4720 2024-09-22T08:36:47.770 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.765+0000 7f5e757fa640 1 -- 172.21.15.142:0/229102318 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f5f8c0451d0 con 0x55b67dad4720 2024-09-22T08:36:47.781 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.766+0000 7f5e757fa640 1 --2- 172.21.15.142:0/229102318 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f5e5c03d000 0x7f5e5c03f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:47.781 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.766+0000 7f5e757fa640 1 -- 172.21.15.142:0/229102318 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f5f8c034aa0 con 0x55b67dad4720 2024-09-22T08:36:47.781 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.766+0000 7f5f93122640 1 --2- 172.21.15.142:0/229102318 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f5e5c03d000 0x7f5e5c03f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:47.781 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.766+0000 7f5f93122640 1 --2- 172.21.15.142:0/229102318 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f5e5c03d000 0x7f5e5c03f4c0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f5f840507d0 tx=0x7f5f84091000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:47.781 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.766+0000 7f5f97a0f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:47.781 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.766+0000 7f5f97a0f800 1 --2- 172.21.15.142:0/229102318 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55b67dae7630 0x55b67dae9af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:47.781 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.766+0000 7f5f97a0f800 1 -- 172.21.15.142:0/229102318 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b67daea240 con 0x55b67dae7630 2024-09-22T08:36:47.781 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.766+0000 7f5f8a921640 1 --2- 172.21.15.142:0/229102318 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55b67dae7630 0x55b67dae9af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:47.781 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.767+0000 7f5f8a921640 1 --2- 172.21.15.142:0/229102318 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55b67dae7630 0x55b67dae9af0 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:47.781 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.767+0000 7f5f8a921640 1 -- 172.21.15.142:0/229102318 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5f7c00f610 con 0x55b67dae7630 2024-09-22T08:36:47.782 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.767+0000 7f5f97a0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:47.782 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.767+0000 7f5f97a0f800 20 realm 2024-09-22T08:36:47.782 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.767+0000 7f5f97a0f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:47.782 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.767+0000 7f5f97a0f800 1 -- 172.21.15.142:0/229102318 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b67dae6980 con 0x55b67dae7630 2024-09-22T08:36:47.782 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.767+0000 7f5f8a921640 1 -- 172.21.15.142:0/229102318 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5f7c00f610 con 0x55b67dae7630 2024-09-22T08:36:47.782 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.767+0000 7f5f97a0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:47.782 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.767+0000 7f5f97a0f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:36:47.782 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.767+0000 7f5f97a0f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:47.782 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.767+0000 7f5f97a0f800 1 -- 172.21.15.142:0/229102318 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b67daead30 con 0x55b67dae7630 2024-09-22T08:36:47.782 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.767+0000 7f5f8a921640 1 -- 172.21.15.142:0/229102318 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5f7c00f610 con 0x55b67dae7630 2024-09-22T08:36:47.782 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.767+0000 7f5f97a0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:47.782 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.767+0000 7f5f97a0f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:47.783 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.767+0000 7f5f97a0f800 1 -- 172.21.15.142:0/229102318 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b67daeb600 con 0x55b67dae7630 2024-09-22T08:36:47.783 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.768+0000 7f5f8a921640 1 -- 172.21.15.142:0/229102318 <== osd.1 v2:172.21.15.142:6816/3192108003 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5f7c00f610 con 0x55b67dae7630 2024-09-22T08:36:47.783 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.768+0000 7f5f97a0f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:36:47.783 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.768+0000 7f5f97a0f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:47.783 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.768+0000 7f5f97a0f800 1 --2- 172.21.15.142:0/229102318 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55b67daec020 0x55b67daee410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:47.783 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.768+0000 7f5f97a0f800 1 -- 172.21.15.142:0/229102318 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b67daeeb50 con 0x55b67daec020 2024-09-22T08:36:47.783 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.768+0000 7f5f93923640 1 --2- 172.21.15.142:0/229102318 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55b67daec020 0x55b67daee410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:47.783 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.768+0000 7f5f93923640 1 --2- 172.21.15.142:0/229102318 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55b67daec020 0x55b67daee410 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:47.783 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.768+0000 7f5f93923640 1 -- 172.21.15.142:0/229102318 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(5 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f5f8c00a4d0 con 0x55b67daec020 2024-09-22T08:36:47.783 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.768+0000 7f5f97a0f800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:36:47.783 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.768+0000 7f5f97a0f800 20 searching for the correct realm 2024-09-22T08:36:47.783 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.768+0000 7f5f97a0f800 1 -- 172.21.15.142:0/229102318 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b67daf0480 con 0x55b67daec020 2024-09-22T08:36:47.784 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.769+0000 7f5f93923640 1 -- 172.21.15.142:0/229102318 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f8c00a4d0 con 0x55b67daec020 2024-09-22T08:36:47.784 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.769+0000 7f5f93923640 1 --2- 172.21.15.142:0/229102318 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f5f8c054c20 0x7f5f8c0538d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:47.784 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.769+0000 7f5f93923640 1 -- 172.21.15.142:0/229102318 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b67daf0480 con 0x7f5f8c054c20 2024-09-22T08:36:47.784 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.769+0000 7f5f93122640 1 --2- 172.21.15.142:0/229102318 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f5f8c054c20 0x7f5f8c0538d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:47.784 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.769+0000 7f5f93122640 1 --2- 172.21.15.142:0/229102318 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f5f8c054c20 0x7f5f8c0538d0 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:47.784 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.769+0000 7f5f93122640 1 -- 172.21.15.142:0/229102318 <== osd.2 v2:172.21.15.142:6808/279438927 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f84057030 con 0x7f5f8c054c20 2024-09-22T08:36:47.784 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.769+0000 7f5f93122640 1 --2- 172.21.15.142:0/229102318 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f5f840a5040 0x7f5f84050840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:47.784 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.769+0000 7f5f93122640 1 -- 172.21.15.142:0/229102318 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b67daf0480 con 0x7f5f840a5040 2024-09-22T08:36:47.784 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.769+0000 7f5f8a921640 1 --2- 172.21.15.142:0/229102318 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f5f840a5040 0x7f5f84050840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:47.784 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.770+0000 7f5f8a921640 1 --2- 172.21.15.142:0/229102318 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f5f840a5040 0x7f5f84050840 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:47.784 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.770+0000 7f5f8a921640 1 -- 172.21.15.142:0/229102318 <== osd.0 v2:172.21.15.31:6800/168281188 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f7c00f610 con 0x7f5f840a5040 2024-09-22T08:36:47.784 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.770+0000 7f5f8a921640 1 -- 172.21.15.142:0/229102318 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b67daf0480 con 0x55b67dae7630 2024-09-22T08:36:47.784 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.770+0000 7f5f8a921640 1 -- 172.21.15.142:0/229102318 <== osd.1 v2:172.21.15.142:6816/3192108003 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f7c00f610 con 0x55b67dae7630 2024-09-22T08:36:47.785 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.770+0000 7f5f8a921640 1 -- 172.21.15.142:0/229102318 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b67daf0480 con 0x55b67dae7630 2024-09-22T08:36:47.785 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.770+0000 7f5f8a921640 1 -- 172.21.15.142:0/229102318 <== osd.1 v2:172.21.15.142:6816/3192108003 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f7c02b040 con 0x55b67dae7630 2024-09-22T08:36:47.785 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.770+0000 7f5f8a921640 1 -- 172.21.15.142:0/229102318 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b67daf0480 con 0x7f5f840a5040 2024-09-22T08:36:47.785 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.771+0000 7f5f8a921640 1 -- 172.21.15.142:0/229102318 <== osd.0 v2:172.21.15.31:6800/168281188 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f7c02b040 con 0x7f5f840a5040 2024-09-22T08:36:47.785 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.771+0000 7f5f8a921640 1 -- 172.21.15.142:0/229102318 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b67daf0480 con 0x7f5f840a5040 2024-09-22T08:36:47.785 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.771+0000 7f5f8a921640 1 -- 172.21.15.142:0/229102318 <== osd.0 v2:172.21.15.31:6800/168281188 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f7c02b040 con 0x7f5f840a5040 2024-09-22T08:36:47.785 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.771+0000 7f5f8a921640 1 -- 172.21.15.142:0/229102318 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b67daf0480 con 0x7f5f8c054c20 2024-09-22T08:36:47.785 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.771+0000 7f5f93122640 1 -- 172.21.15.142:0/229102318 <== osd.2 v2:172.21.15.142:6808/279438927 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f84057030 con 0x7f5f8c054c20 2024-09-22T08:36:47.785 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.771+0000 7f5f93122640 1 -- 172.21.15.142:0/229102318 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b67daf0480 con 0x55b67daec020 2024-09-22T08:36:47.785 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.771+0000 7f5f93923640 1 -- 172.21.15.142:0/229102318 <== osd.3 v2:172.21.15.142:6800/1064901393 3 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f8c00a4d0 con 0x55b67daec020 2024-09-22T08:36:47.785 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.771+0000 7f5f93923640 1 -- 172.21.15.142:0/229102318 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b67daf0480 con 0x55b67dae7630 2024-09-22T08:36:47.785 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.772+0000 7f5f8a921640 1 -- 172.21.15.142:0/229102318 <== osd.1 v2:172.21.15.142:6816/3192108003 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f7c02b040 con 0x55b67dae7630 2024-09-22T08:36:47.785 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.772+0000 7f5f8a921640 1 -- 172.21.15.142:0/229102318 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b67daf0480 con 0x7f5f840a5040 2024-09-22T08:36:47.785 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.772+0000 7f5f8a921640 1 -- 172.21.15.142:0/229102318 <== osd.0 v2:172.21.15.31:6800/168281188 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f7c02b040 con 0x7f5f840a5040 2024-09-22T08:36:47.786 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.772+0000 7f5f8a921640 1 -- 172.21.15.142:0/229102318 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b67daf0480 con 0x55b67dae7630 2024-09-22T08:36:47.786 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.772+0000 7f5f8a921640 1 -- 172.21.15.142:0/229102318 <== osd.1 v2:172.21.15.142:6816/3192108003 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f7c02b040 con 0x55b67dae7630 2024-09-22T08:36:47.786 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.772+0000 7f5f8a921640 1 -- 172.21.15.142:0/229102318 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b67daf0480 con 0x7f5f8c054c20 2024-09-22T08:36:47.786 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.772+0000 7f5f93122640 1 -- 172.21.15.142:0/229102318 <== osd.2 v2:172.21.15.142:6808/279438927 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f5f84057030 con 0x7f5f8c054c20 2024-09-22T08:36:47.786 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.772+0000 7f5f93122640 1 -- 172.21.15.142:0/229102318 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b67daf0480 con 0x55b67daec020 2024-09-22T08:36:47.786 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.773+0000 7f5f93923640 1 -- 172.21.15.142:0/229102318 <== osd.3 v2:172.21.15.142:6800/1064901393 4 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f8c00a4d0 con 0x55b67daec020 2024-09-22T08:36:47.786 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.773+0000 7f5f93923640 1 -- 172.21.15.142:0/229102318 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b67daf0480 con 0x55b67daec020 2024-09-22T08:36:47.786 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.773+0000 7f5f93923640 1 -- 172.21.15.142:0/229102318 <== osd.3 v2:172.21.15.142:6800/1064901393 5 ==== osd_op_reply(20 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f5f8c00a4d0 con 0x55b67daec020 2024-09-22T08:36:47.786 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.773+0000 7f5f93923640 1 -- 172.21.15.142:0/229102318 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b67daf0480 con 0x7f5f840a5040 2024-09-22T08:36:47.786 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.773+0000 7f5f8a921640 1 -- 172.21.15.142:0/229102318 <== osd.0 v2:172.21.15.31:6800/168281188 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f7c02b040 con 0x7f5f840a5040 2024-09-22T08:36:47.786 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.773+0000 7f5f8a921640 1 -- 172.21.15.142:0/229102318 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b67daf0480 con 0x55b67daec020 2024-09-22T08:36:47.786 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.773+0000 7f5f93923640 1 -- 172.21.15.142:0/229102318 <== osd.3 v2:172.21.15.142:6800/1064901393 6 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f8c00a4d0 con 0x55b67daec020 2024-09-22T08:36:47.786 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.773+0000 7f5f93923640 1 -- 172.21.15.142:0/229102318 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b67daf0480 con 0x55b67daec020 2024-09-22T08:36:47.787 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.774+0000 7f5f93923640 1 -- 172.21.15.142:0/229102318 <== osd.3 v2:172.21.15.142:6800/1064901393 7 ==== osd_op_reply(23 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f5f8c00a4d0 con 0x55b67daec020 2024-09-22T08:36:47.787 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.774+0000 7f5f93923640 1 -- 172.21.15.142:0/229102318 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b67daf0480 con 0x55b67dae7630 2024-09-22T08:36:47.787 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.774+0000 7f5f8a921640 1 -- 172.21.15.142:0/229102318 <== osd.1 v2:172.21.15.142:6816/3192108003 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f7c02b040 con 0x55b67dae7630 2024-09-22T08:36:47.787 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.774+0000 7f5f8a921640 1 -- 172.21.15.142:0/229102318 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b67daf0480 con 0x55b67dae7630 2024-09-22T08:36:47.787 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.774+0000 7f5f8a921640 1 -- 172.21.15.142:0/229102318 <== osd.1 v2:172.21.15.142:6816/3192108003 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f5f7c02b040 con 0x55b67dae7630 2024-09-22T08:36:47.787 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.774+0000 7f5f8a921640 1 -- 172.21.15.142:0/229102318 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b67daf0480 con 0x7f5f840a5040 2024-09-22T08:36:47.787 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.774+0000 7f5f8a921640 1 -- 172.21.15.142:0/229102318 <== osd.0 v2:172.21.15.31:6800/168281188 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f7c02b040 con 0x7f5f840a5040 2024-09-22T08:36:47.787 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.774+0000 7f5f8a921640 1 -- 172.21.15.142:0/229102318 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b67daf0480 con 0x55b67daec020 2024-09-22T08:36:47.787 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.774+0000 7f5f93923640 1 -- 172.21.15.142:0/229102318 <== osd.3 v2:172.21.15.142:6800/1064901393 8 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f8c00a4d0 con 0x55b67daec020 2024-09-22T08:36:47.787 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.774+0000 7f5f93923640 1 -- 172.21.15.142:0/229102318 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b67daf0480 con 0x7f5f8c054c20 2024-09-22T08:36:47.787 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.775+0000 7f5f93122640 1 -- 172.21.15.142:0/229102318 <== osd.2 v2:172.21.15.142:6808/279438927 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f84057030 con 0x7f5f8c054c20 2024-09-22T08:36:47.787 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.775+0000 7f5f93122640 1 -- 172.21.15.142:0/229102318 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b67daf0480 con 0x55b67dae7630 2024-09-22T08:36:47.787 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.775+0000 7f5f8a921640 1 -- 172.21.15.142:0/229102318 <== osd.1 v2:172.21.15.142:6816/3192108003 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f7c02b040 con 0x55b67dae7630 2024-09-22T08:36:47.787 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.775+0000 7f5f8a921640 1 -- 172.21.15.142:0/229102318 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b67daf0480 con 0x7f5f840a5040 2024-09-22T08:36:47.788 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.775+0000 7f5f8a921640 1 -- 172.21.15.142:0/229102318 <== osd.0 v2:172.21.15.31:6800/168281188 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f7c03b040 con 0x7f5f840a5040 2024-09-22T08:36:47.788 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.775+0000 7f5f8a921640 1 -- 172.21.15.142:0/229102318 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b67daf0480 con 0x55b67daec020 2024-09-22T08:36:47.788 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.775+0000 7f5f93923640 1 -- 172.21.15.142:0/229102318 <== osd.3 v2:172.21.15.142:6800/1064901393 9 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f8c00a4d0 con 0x55b67daec020 2024-09-22T08:36:47.788 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.775+0000 7f5f93923640 1 -- 172.21.15.142:0/229102318 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b67daf0480 con 0x7f5f840a5040 2024-09-22T08:36:47.789 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.776+0000 7f5f8a921640 1 -- 172.21.15.142:0/229102318 <== osd.0 v2:172.21.15.31:6800/168281188 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f7c03b040 con 0x7f5f840a5040 2024-09-22T08:36:47.789 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.776+0000 7f5f8a921640 1 -- 172.21.15.142:0/229102318 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b67daf0480 con 0x7f5f8c054c20 2024-09-22T08:36:47.789 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.776+0000 7f5f93122640 1 -- 172.21.15.142:0/229102318 <== osd.2 v2:172.21.15.142:6808/279438927 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f84057030 con 0x7f5f8c054c20 2024-09-22T08:36:47.789 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.776+0000 7f5f93122640 1 -- 172.21.15.142:0/229102318 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b67daf0480 con 0x55b67daec020 2024-09-22T08:36:47.790 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.776+0000 7f5f93923640 1 -- 172.21.15.142:0/229102318 <== osd.3 v2:172.21.15.142:6800/1064901393 10 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f8c00a4d0 con 0x55b67daec020 2024-09-22T08:36:47.790 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.776+0000 7f5f93923640 1 -- 172.21.15.142:0/229102318 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b67daf0480 con 0x7f5f840a5040 2024-09-22T08:36:47.790 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.776+0000 7f5f8a921640 1 -- 172.21.15.142:0/229102318 <== osd.0 v2:172.21.15.31:6800/168281188 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f7c03b040 con 0x7f5f840a5040 2024-09-22T08:36:47.790 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.776+0000 7f5f8a921640 1 -- 172.21.15.142:0/229102318 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b67daf0480 con 0x55b67dae7630 2024-09-22T08:36:47.790 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.777+0000 7f5f8a921640 1 -- 172.21.15.142:0/229102318 <== osd.1 v2:172.21.15.142:6816/3192108003 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f5f7c03b040 con 0x55b67dae7630 2024-09-22T08:36:47.790 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.777+0000 7f5f8a921640 1 -- 172.21.15.142:0/229102318 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b67daf0480 con 0x7f5f8c054c20 2024-09-22T08:36:47.790 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.777+0000 7f5f93122640 1 -- 172.21.15.142:0/229102318 <== osd.2 v2:172.21.15.142:6808/279438927 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f84057030 con 0x7f5f8c054c20 2024-09-22T08:36:47.790 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.777+0000 7f5f97a0f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:36:47.790 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.777+0000 7f5f97a0f800 20 RGWRados::pool_iterate: got zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec 2024-09-22T08:36:47.790 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.777+0000 7f5f97a0f800 20 RGWRados::pool_iterate: got zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f 2024-09-22T08:36:47.790 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.777+0000 7f5f97a0f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:36:47.790 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.777+0000 7f5f97a0f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:36:47.790 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.777+0000 7f5f97a0f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:36:47.791 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.777+0000 7f5f97a0f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:47.791 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.777+0000 7f5f97a0f800 1 -- 172.21.15.142:0/229102318 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b67daef540 con 0x55b67dae7630 2024-09-22T08:36:47.791 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.777+0000 7f5f8a921640 1 -- 172.21.15.142:0/229102318 <== osd.1 v2:172.21.15.142:6816/3192108003 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5f7c03b040 con 0x55b67dae7630 2024-09-22T08:36:47.791 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.777+0000 7f5f97a0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:47.791 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.777+0000 7f5f97a0f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:47.791 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.777+0000 7f5f97a0f800 1 -- 172.21.15.142:0/229102318 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b67daefd90 con 0x55b67dae7630 2024-09-22T08:36:47.791 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.777+0000 7f5f8a921640 1 -- 172.21.15.142:0/229102318 <== osd.1 v2:172.21.15.142:6816/3192108003 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5f7c03b040 con 0x55b67dae7630 2024-09-22T08:36:47.791 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.777+0000 7f5f97a0f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:36:47.791 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.777+0000 7f5f97a0f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:47.791 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.777+0000 7f5f97a0f800 1 -- 172.21.15.142:0/229102318 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:40 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b67daf0900 con 0x55b67daec020 2024-09-22T08:36:47.791 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.778+0000 7f5f93923640 1 -- 172.21.15.142:0/229102318 <== osd.3 v2:172.21.15.142:6800/1064901393 11 ==== osd_op_reply(40 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f5f8c00a4d0 con 0x55b67daec020 2024-09-22T08:36:47.791 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.778+0000 7f5f97a0f800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:36:47.791 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.778+0000 7f5f97a0f800 20 zone default found 2024-09-22T08:36:47.791 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.778+0000 7f5f97a0f800 4 Realm: () 2024-09-22T08:36:47.792 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.778+0000 7f5f97a0f800 4 ZoneGroup: default (d89f6f57-1007-47dd-9065-f486c7b01aec) 2024-09-22T08:36:47.792 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.778+0000 7f5f97a0f800 4 Zone: default (e239248c-0bee-4e41-803a-24b288d3eb8f) 2024-09-22T08:36:47.792 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.778+0000 7f5f97a0f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:36:47.792 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.778+0000 7f5f97a0f800 20 zonegroup default 2024-09-22T08:36:47.792 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.778+0000 7f5f97a0f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:47.792 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.778+0000 7f5f97a0f800 1 -- 172.21.15.142:0/229102318 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b67daf0cc0 con 0x7f5f840a5040 2024-09-22T08:36:47.792 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.778+0000 7f5f8a921640 1 -- 172.21.15.142:0/229102318 <== osd.0 v2:172.21.15.31:6800/168281188 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f5f7c03b040 con 0x7f5f840a5040 2024-09-22T08:36:47.792 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.778+0000 7f5f97a0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:47.792 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.778+0000 7f5f97a0f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:47.792 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.778+0000 7f5f97a0f800 1 -- 172.21.15.142:0/229102318 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b67daf2b20 con 0x55b67daec020 2024-09-22T08:36:47.792 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.778+0000 7f5f93923640 1 -- 172.21.15.142:0/229102318 <== osd.3 v2:172.21.15.142:6800/1064901393 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5f8c00a4d0 con 0x55b67daec020 2024-09-22T08:36:47.792 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.778+0000 7f5f97a0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:47.792 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.778+0000 7f5f97a0f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:47.792 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.778+0000 7f5f97a0f800 1 -- 172.21.15.142:0/229102318 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b67daf2f80 con 0x55b67daec020 2024-09-22T08:36:47.793 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.779+0000 7f5f93923640 1 -- 172.21.15.142:0/229102318 <== osd.3 v2:172.21.15.142:6800/1064901393 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5f8c00a4d0 con 0x55b67daec020 2024-09-22T08:36:47.793 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.779+0000 7f5f97a0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:47.793 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.779+0000 7f5f97a0f800 20 started sync module instance, tier type = 2024-09-22T08:36:47.793 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.779+0000 7f5f97a0f800 20 started zone id=e239248c-0bee-4e41-803a-24b288d3eb8f (name=default) with tier type = 2024-09-22T08:36:47.793 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.779+0000 7f5f97a0f800 1 -- 172.21.15.142:0/229102318 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b67daf1f90 con 0x7f5f8c054c20 2024-09-22T08:36:47.793 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.780+0000 7f5f93122640 1 -- 172.21.15.142:0/229102318 <== osd.2 v2:172.21.15.142:6808/279438927 7 ==== osd_op_reply(44 notify.0 [create] v30'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f84057030 con 0x7f5f8c054c20 2024-09-22T08:36:47.793 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.780+0000 7f5f97a0f800 1 -- 172.21.15.142:0/229102318 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94242281038720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b67daf1bf0 con 0x7f5f8c054c20 2024-09-22T08:36:47.793 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.780+0000 7f5f97a0f800 1 -- 172.21.15.142:0/229102318 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b67daf3eb0 con 0x55b67dae7630 2024-09-22T08:36:47.800 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.781+0000 7f5f93122640 1 -- 172.21.15.142:0/229102318 <== osd.2 v2:172.21.15.142:6808/279438927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94242281038720] v30'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f84057030 con 0x7f5f8c054c20 2024-09-22T08:36:47.800 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.781+0000 7f5f8a921640 1 -- 172.21.15.142:0/229102318 <== osd.1 v2:172.21.15.142:6816/3192108003 15 ==== osd_op_reply(46 notify.1 [create] v30'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f7c03b040 con 0x55b67dae7630 2024-09-22T08:36:47.800 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.781+0000 7f5f97a0f800 1 -- 172.21.15.142:0/229102318 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94242281044480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b67daf42d0 con 0x55b67dae7630 2024-09-22T08:36:47.801 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.781+0000 7f5f97a0f800 1 -- 172.21.15.142:0/229102318 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b67daf4c90 con 0x55b67daec020 2024-09-22T08:36:47.801 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.782+0000 7f5f8a921640 1 -- 172.21.15.142:0/229102318 <== osd.1 v2:172.21.15.142:6816/3192108003 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94242281044480] v30'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f7c03b040 con 0x55b67dae7630 2024-09-22T08:36:47.801 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.782+0000 7f5f93923640 1 -- 172.21.15.142:0/229102318 <== osd.3 v2:172.21.15.142:6800/1064901393 14 ==== osd_op_reply(48 notify.2 [create] v30'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f8c00a4d0 con 0x55b67daec020 2024-09-22T08:36:47.801 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.783+0000 7f5f97a0f800 1 -- 172.21.15.142:0/229102318 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94242281048512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b67daf42d0 con 0x55b67daec020 2024-09-22T08:36:47.801 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.783+0000 7f5f97a0f800 1 -- 172.21.15.142:0/229102318 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b67daf5700 con 0x7f5f8c054c20 2024-09-22T08:36:47.801 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.784+0000 7f5f93923640 1 -- 172.21.15.142:0/229102318 <== osd.3 v2:172.21.15.142:6800/1064901393 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94242281048512] v30'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f8c00a4d0 con 0x55b67daec020 2024-09-22T08:36:47.801 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.784+0000 7f5f93122640 1 -- 172.21.15.142:0/229102318 <== osd.2 v2:172.21.15.142:6808/279438927 9 ==== osd_op_reply(50 notify.3 [create] v30'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f84057030 con 0x7f5f8c054c20 2024-09-22T08:36:47.801 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.784+0000 7f5f97a0f800 1 -- 172.21.15.142:0/229102318 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94242281045536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b67daf4240 con 0x7f5f8c054c20 2024-09-22T08:36:47.801 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.784+0000 7f5f97a0f800 1 -- 172.21.15.142:0/229102318 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b67daf65c0 con 0x55b67dae7630 2024-09-22T08:36:47.801 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.784+0000 7f5f93122640 1 -- 172.21.15.142:0/229102318 <== osd.2 v2:172.21.15.142:6808/279438927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94242281045536] v30'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f84057030 con 0x7f5f8c054c20 2024-09-22T08:36:47.801 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.785+0000 7f5f8a921640 1 -- 172.21.15.142:0/229102318 <== osd.1 v2:172.21.15.142:6816/3192108003 17 ==== osd_op_reply(52 notify.4 [create] v30'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f7c03b040 con 0x55b67dae7630 2024-09-22T08:36:47.801 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.785+0000 7f5f97a0f800 1 -- 172.21.15.142:0/229102318 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94242281052912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b67daf65c0 con 0x55b67dae7630 2024-09-22T08:36:47.801 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.785+0000 7f5f97a0f800 1 -- 172.21.15.142:0/229102318 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b67daf6fd0 con 0x7f5f840a5040 2024-09-22T08:36:47.802 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.786+0000 7f5f8a921640 1 -- 172.21.15.142:0/229102318 <== osd.1 v2:172.21.15.142:6816/3192108003 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94242281052912] v30'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f7c03b040 con 0x55b67dae7630 2024-09-22T08:36:47.802 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.786+0000 7f5f8a921640 1 -- 172.21.15.142:0/229102318 <== osd.0 v2:172.21.15.31:6800/168281188 11 ==== osd_op_reply(54 notify.5 [create] v30'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f7c03b040 con 0x7f5f840a5040 2024-09-22T08:36:47.802 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.786+0000 7f5f97a0f800 1 -- 172.21.15.142:0/229102318 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94242281057536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b67daf65c0 con 0x7f5f840a5040 2024-09-22T08:36:47.802 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.786+0000 7f5f97a0f800 1 -- 172.21.15.142:0/229102318 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b67daf7a50 con 0x7f5f840a5040 2024-09-22T08:36:47.802 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.787+0000 7f5f8a921640 1 -- 172.21.15.142:0/229102318 <== osd.0 v2:172.21.15.31:6800/168281188 12 ==== osd_op_reply(56 notify.6 [create] v30'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f7c03b040 con 0x7f5f840a5040 2024-09-22T08:36:47.802 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.787+0000 7f5f97a0f800 1 -- 172.21.15.142:0/229102318 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94242281059680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b67daf7e70 con 0x7f5f840a5040 2024-09-22T08:36:47.802 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.787+0000 7f5f97a0f800 1 -- 172.21.15.142:0/229102318 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b67daf8970 con 0x7f5f840a5040 2024-09-22T08:36:47.802 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.787+0000 7f5f8a921640 1 -- 172.21.15.142:0/229102318 <== osd.0 v2:172.21.15.31:6800/168281188 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94242281057536] v30'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f7c03b040 con 0x7f5f840a5040 2024-09-22T08:36:47.802 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.788+0000 7f5f8a921640 1 -- 172.21.15.142:0/229102318 <== osd.0 v2:172.21.15.31:6800/168281188 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94242281059680] v30'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f7c03b040 con 0x7f5f840a5040 2024-09-22T08:36:47.802 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.788+0000 7f5f8a921640 1 -- 172.21.15.142:0/229102318 <== osd.0 v2:172.21.15.31:6800/168281188 15 ==== osd_op_reply(58 notify.7 [create] v30'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f7c03b040 con 0x7f5f840a5040 2024-09-22T08:36:47.802 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.788+0000 7f5f97a0f800 1 -- 172.21.15.142:0/229102318 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94242281063520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b67daf8930 con 0x7f5f840a5040 2024-09-22T08:36:47.802 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.788+0000 7f5f97a0f800 20 add_watcher() i=0 2024-09-22T08:36:47.802 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.788+0000 7f5f97a0f800 20 add_watcher() i=1 2024-09-22T08:36:47.803 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.788+0000 7f5f97a0f800 20 add_watcher() i=2 2024-09-22T08:36:47.803 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.788+0000 7f5f97a0f800 20 add_watcher() i=3 2024-09-22T08:36:47.803 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.788+0000 7f5f97a0f800 20 add_watcher() i=4 2024-09-22T08:36:47.803 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.788+0000 7f5f97a0f800 20 add_watcher() i=5 2024-09-22T08:36:47.803 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.788+0000 7f5f97a0f800 20 add_watcher() i=6 2024-09-22T08:36:47.803 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.789+0000 7f5f8a921640 1 -- 172.21.15.142:0/229102318 <== osd.0 v2:172.21.15.31:6800/168281188 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94242281063520] v30'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f7c03b040 con 0x7f5f840a5040 2024-09-22T08:36:47.803 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.789+0000 7f5f97a0f800 20 add_watcher() i=7 2024-09-22T08:36:47.803 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.789+0000 7f5f97a0f800 2 all 8 watchers are set, enabling cache 2024-09-22T08:36:47.803 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.789+0000 7f5f97a0f800 1 -- 172.21.15.142:0/229102318 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b67daf79f0 con 0x55b67dae7630 2024-09-22T08:36:47.803 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.789+0000 7f5f8a921640 1 -- 172.21.15.142:0/229102318 <== osd.1 v2:172.21.15.142:6816/3192108003 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f5f7c03b040 con 0x55b67dae7630 2024-09-22T08:36:47.803 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.789+0000 7f5f97a0f800 1 -- 172.21.15.142:0/229102318 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94242281054480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b67daf91f0 con 0x55b67dae7630 2024-09-22T08:36:47.803 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.790+0000 7f5f8a921640 1 -- 172.21.15.142:0/229102318 <== osd.1 v2:172.21.15.142:6816/3192108003 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94242281054480] v30'128 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5f7c03b040 con 0x55b67dae7630 2024-09-22T08:36:47.803 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.790+0000 7f5e49fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:36:47.803 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.791+0000 7f5f97a0f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:36:47.804 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.791+0000 7f5f97a0f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:36:47.804 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.791+0000 7f5f97a0f800 5 note: GC not initialized 2024-09-22T08:36:47.804 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.791+0000 7f5e48fe1640 20 reqs_thread_entry: start 2024-09-22T08:36:47.804 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.791+0000 7f5f97a0f800 20 init_complete bucket index max shards: 11 2024-09-22T08:36:47.804 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.791+0000 7f5f97a0f800 20 Filter name: none 2024-09-22T08:36:47.804 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.791+0000 7f5dc27fc640 20 reqs_thread_entry: start 2024-09-22T08:36:47.804 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.791+0000 7f5f97a0f800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : miss 2024-09-22T08:36:47.804 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.791+0000 7f5f97a0f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:47.804 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.791+0000 7f5f97a0f800 1 -- 172.21.15.142:0/229102318 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:62 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b67db2ee30 con 0x7f5f840a5040 2024-09-22T08:36:47.804 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.792+0000 7f5f8a921640 1 -- 172.21.15.142:0/229102318 <== osd.0 v2:172.21.15.31:6800/168281188 17 ==== osd_op_reply(62 testx$tenanteduser [call out=48b,read 0~419 out=419b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 246+0+542 (crc 0 0 0) 0x7f5f7c03b040 con 0x7f5f840a5040 2024-09-22T08:36:47.804 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.792+0000 7f5f97a0f800 20 rados_obj.operate() r=0 bl.length=419 2024-09-22T08:36:47.804 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.792+0000 7f5f97a0f800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x13 2024-09-22T08:36:47.804 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.792+0000 7f5f97a0f800 10 adding default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-09-22T08:36:47.804 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.792+0000 7f5f97a0f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:36:47.805 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.792+0000 7f5f97a0f800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-22T08:36:47.805 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.792+0000 7f5f97a0f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:47.805 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.792+0000 7f5f97a0f800 1 -- 172.21.15.142:0/229102318 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b67db2e7c0 con 0x7f5f8c054c20 2024-09-22T08:36:47.805 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.792+0000 7f5f93122640 1 -- 172.21.15.142:0/229102318 <== osd.2 v2:172.21.15.142:6808/279438927 11 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv23 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f5f84057030 con 0x7f5f8c054c20 2024-09-22T08:36:47.805 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.792+0000 7f5f97a0f800 20 rados_obj.operate() r=0 bl.length=165 2024-09-22T08:36:47.805 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.792+0000 7f5f97a0f800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-22T08:36:47.805 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.792+0000 7f5f97a0f800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-22T08:36:47.805 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.792+0000 7f5f97a0f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1 : miss 2024-09-22T08:36:47.805 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.792+0000 7f5f97a0f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:47.805 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.792+0000 7f5f97a0f800 1 -- 172.21.15.142:0/229102318 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:64 8.15 8:ab67ca09:root::.bucket.meta.myfoo%3ae239248c-0bee-4e41-803a-24b288d3eb8f.4226.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b67db326a0 con 0x55b67daec020 2024-09-22T08:36:47.805 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.793+0000 7f5f93923640 1 -- 172.21.15.142:0/229102318 <== osd.3 v2:172.21.15.142:6800/1064901393 16 ==== osd_op_reply(64 .bucket.meta.myfoo:e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv5 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7f5f8c00a4d0 con 0x55b67daec020 2024-09-22T08:36:47.805 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.793+0000 7f5f97a0f800 20 rados_obj.operate() r=0 bl.length=387 2024-09-22T08:36:47.805 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.793+0000 7f5f97a0f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1 info.flags=0x17 2024-09-22T08:36:47.806 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.793+0000 7f5f97a0f800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1 to cache LRU end 2024-09-22T08:36:47.806 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.793+0000 7f5f97a0f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:36:47.806 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.793+0000 7f5f97a0f800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-22T08:36:47.806 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.793+0000 7f5f97a0f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1 2024-09-22T08:36:47.806 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.793+0000 7f5f97a0f800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : hit (requested=0x13, cached=0x13) 2024-09-22T08:36:47.806 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.793+0000 7f5f97a0f800 1 -- 172.21.15.142:0/229102318 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:65 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b67db368a0 con 0x7f5f8c054c20 2024-09-22T08:36:47.806 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.794+0000 7f5f93122640 1 -- 172.21.15.142:0/229102318 <== osd.2 v2:172.21.15.142:6808/279438927 12 ==== osd_op_reply(65 foo.buckets [call] v30'24 uv24 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f5f84057030 con 0x7f5f8c054c20 2024-09-22T08:36:47.806 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.794+0000 7f5f97a0f800 1 -- 172.21.15.142:0/229102318 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:66 8.c 8:35339db6:root::.bucket.meta.testx%3amyfoo%3ae239248c-0bee-4e41-803a-24b288d3eb8f.4226.1:head [create,call version.inc in=38b,writefull 0~420 in=420b,setxattr user.rgw.acl (203) in=215b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b67db3a1b0 con 0x55b67dae7630 2024-09-22T08:36:47.806 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.795+0000 7f5f8a921640 1 -- 172.21.15.142:0/229102318 <== osd.1 v2:172.21.15.142:6816/3192108003 21 ==== osd_op_reply(66 .bucket.meta.testx:myfoo:e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1 [create,call,writefull 0~420,setxattr (203)] v30'1 uv1 ondisk = 0) ==== 338+0+0 (crc 0 0 0) 0x7f5f7c03b040 con 0x55b67dae7630 2024-09-22T08:36:47.806 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.795+0000 7f5f97a0f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1 info.flags=0x7 2024-09-22T08:36:47.806 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.795+0000 7f5f97a0f800 10 adding default.rgw.meta+root+.bucket.meta.testx:myfoo:e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1 to cache LRU end 2024-09-22T08:36:47.806 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.795+0000 7f5f97a0f800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-22T08:36:47.806 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.795+0000 7f5f97a0f800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.testx:myfoo:e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1, ofs0, ns] 2024-09-22T08:36:47.806 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.795+0000 7f5f97a0f800 1 -- 172.21.15.142:0/229102318 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [notify cookie 94242281324512 in=867b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b67db39bc0 con 0x55b67daec020 2024-09-22T08:36:47.807 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.795+0000 7f5f93923640 1 -- 172.21.15.142:0/229102318 <== osd.3 v2:172.21.15.142:6800/1064901393 17 ==== watch-notify(notify (1) cookie 94242281048512 notify 128849018885 ret 0) ==== 897+0+0 (crc 0 0 0) 0x55b67db31be0 con 0x55b67daec020 2024-09-22T08:36:47.807 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.795+0000 7f5e76ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018885 cookie 94242281048512 notifier 4541 bl.length()=855 2024-09-22T08:36:47.807 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.796+0000 7f5e76ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1 info.flags=0x7 2024-09-22T08:36:47.807 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.796+0000 7f5e76ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.testx:myfoo:e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1 to cache LRU end 2024-09-22T08:36:47.807 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.796+0000 7f5e76ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-22T08:36:47.807 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.796+0000 7f5f93923640 1 -- 172.21.15.142:0/229102318 <== osd.3 v2:172.21.15.142:6800/1064901393 18 ==== osd_op_reply(67 notify.2 [notify cookie 94242281324512 out=8b] v0'0 uv132 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f5f8c00a4d0 con 0x55b67daec020 2024-09-22T08:36:47.807 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.796+0000 7f5e76ffd640 1 -- 172.21.15.142:0/229102318 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f5e58003ea0 con 0x55b67daec020 2024-09-22T08:36:47.807 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.796+0000 7f5f93923640 1 -- 172.21.15.142:0/229102318 <== osd.3 v2:172.21.15.142:6800/1064901393 19 ==== osd_op_reply(68 notify.2 [notify-ack] v0'0 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f8c00a4d0 con 0x55b67daec020 2024-09-22T08:36:47.807 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.796+0000 7f5f93923640 1 -- 172.21.15.142:0/229102318 <== osd.3 v2:172.21.15.142:6800/1064901393 20 ==== watch-notify(notify_complete (2) cookie 94242281324512 notify 128849018885 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55b67dadc270 con 0x55b67daec020 2024-09-22T08:36:47.807 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.796+0000 7f5f97a0f800 20 handle_bi_update(): bucket=testx:myfoo[e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1]): orig_sources= new_sources= 2024-09-22T08:36:47.807 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.796+0000 7f5f97a0f800 20 handle_bi_update(): bucket=testx:myfoo[e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1]): potential sources added=[] removed=[] 2024-09-22T08:36:47.807 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.796+0000 7f5f97a0f800 20 handle_bi_update(): bucket=testx:myfoo[e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1]): orig_dests= new_dests= 2024-09-22T08:36:47.807 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.796+0000 7f5f97a0f800 20 handle_bi_update(): bucket=testx:myfoo[e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1]): potential dests added=[] removed=[] 2024-09-22T08:36:47.808 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.796+0000 7f5f97a0f800 1 -- 172.21.15.142:0/229102318 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:69 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b67db39ca0 con 0x55b67dae7630 2024-09-22T08:36:47.808 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.797+0000 7f5f8a921640 1 -- 172.21.15.142:0/229102318 <== osd.1 v2:172.21.15.142:6816/3192108003 22 ==== osd_op_reply(69 testx$tenanteduser.buckets [call] v30'2 uv2 ondisk = 0) ==== 170+0+0 (crc 0 0 0) 0x7f5f7c03b040 con 0x55b67dae7630 2024-09-22T08:36:47.808 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.797+0000 7f5f97a0f800 1 -- 172.21.15.142:0/229102318 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:70 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [delete,create,call version.inc in=38b,writefull 0~193 in=193b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b67db39ca0 con 0x55b67dae7630 2024-09-22T08:36:47.808 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.798+0000 7f5f8a921640 1 -- 172.21.15.142:0/229102318 <== osd.1 v2:172.21.15.142:6816/3192108003 23 ==== osd_op_reply(70 testx/myfoo [delete,create,call,writefull 0~193] v30'1 uv1 ondisk = 0) ==== 281+0+0 (crc 0 0 0) 0x7f5f7c03b040 con 0x55b67dae7630 2024-09-22T08:36:47.808 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.798+0000 7f5f97a0f800 10 cache put: name=default.rgw.meta+root+testx/myfoo info.flags=0x7 2024-09-22T08:36:47.808 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.798+0000 7f5f97a0f800 10 adding default.rgw.meta+root+testx/myfoo to cache LRU end 2024-09-22T08:36:47.808 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.798+0000 7f5f97a0f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:testx/myfoo, ofs0, ns] 2024-09-22T08:36:47.808 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.798+0000 7f5f97a0f800 1 -- 172.21.15.142:0/229102318 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [notify cookie 94242281330672 in=360b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b67db39c10 con 0x55b67dae7630 2024-09-22T08:36:47.808 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.798+0000 7f5f8a921640 1 -- 172.21.15.142:0/229102318 <== osd.1 v2:172.21.15.142:6816/3192108003 24 ==== watch-notify(notify (1) cookie 94242281052912 notify 128849018891 ret 0) ==== 390+0+0 (crc 0 0 0) 0x55b67db3a040 con 0x55b67dae7630 2024-09-22T08:36:47.808 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.798+0000 7f5e767fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018891 cookie 94242281052912 notifier 4541 bl.length()=348 2024-09-22T08:36:47.808 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.798+0000 7f5e767fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+testx/myfoo info.flags=0x7 2024-09-22T08:36:47.808 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.798+0000 7f5e767fc640 10 rgw watcher librados: moving default.rgw.meta+root+testx/myfoo to cache LRU end 2024-09-22T08:36:47.808 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.798+0000 7f5e767fc640 1 -- 172.21.15.142:0/229102318 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:72 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f5dc8003400 con 0x55b67dae7630 2024-09-22T08:36:47.809 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.798+0000 7f5f8a921640 1 -- 172.21.15.142:0/229102318 <== osd.1 v2:172.21.15.142:6816/3192108003 25 ==== osd_op_reply(71 notify.4 [notify cookie 94242281330672 out=8b] v0'0 uv132 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f5f7c03b040 con 0x55b67dae7630 2024-09-22T08:36:47.809 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.799+0000 7f5f8a921640 1 -- 172.21.15.142:0/229102318 <== osd.1 v2:172.21.15.142:6816/3192108003 26 ==== osd_op_reply(72 notify.4 [notify-ack] v0'0 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f7c03b040 con 0x55b67dae7630 2024-09-22T08:36:47.809 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.799+0000 7f5f8a921640 1 -- 172.21.15.142:0/229102318 <== osd.1 v2:172.21.15.142:6816/3192108003 27 ==== watch-notify(notify_complete (2) cookie 94242281330672 notify 128849018891 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55b67db38ff0 con 0x55b67dae7630 2024-09-22T08:36:47.809 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.799+0000 7f5f97a0f800 1 -- 172.21.15.142:0/229102318 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:73 8.9 8:91b71841:root::myfoo:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b67db39c60 con 0x7f5f8c054c20 2024-09-22T08:36:47.812 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.800+0000 7f5f93122640 1 -- 172.21.15.142:0/229102318 <== osd.2 v2:172.21.15.142:6808/279438927 13 ==== osd_op_reply(73 myfoo [call,delete] v30'25 uv25 ondisk = 0) ==== 191+0+0 (crc 0 0 0) 0x7f5f84057030 con 0x7f5f8c054c20 2024-09-22T08:36:47.812 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.800+0000 7f5f97a0f800 10 removing default.rgw.meta+root+myfoo from cache 2024-09-22T08:36:47.812 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.800+0000 7f5f97a0f800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-22T08:36:47.812 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.800+0000 7f5f97a0f800 1 -- 172.21.15.142:0/229102318 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:74 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94242281330608 in=161b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b67db39bd0 con 0x7f5f840a5040 2024-09-22T08:36:47.812 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.800+0000 7f5f8a921640 1 -- 172.21.15.142:0/229102318 <== osd.0 v2:172.21.15.31:6800/168281188 18 ==== watch-notify(notify (1) cookie 94242281059680 notify 128849018894 ret 0) ==== 191+0+0 (crc 0 0 0) 0x55b67db38ff0 con 0x7f5f840a5040 2024-09-22T08:36:47.812 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.800+0000 7f5e76ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018894 cookie 94242281059680 notifier 4541 bl.length()=149 2024-09-22T08:36:47.813 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.800+0000 7f5e76ffd640 1 -- 172.21.15.142:0/229102318 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:75 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f5e58003ea0 con 0x7f5f840a5040 2024-09-22T08:36:47.813 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.800+0000 7f5f8a921640 1 -- 172.21.15.142:0/229102318 <== osd.0 v2:172.21.15.31:6800/168281188 19 ==== osd_op_reply(74 notify.6 [notify cookie 94242281330608 out=8b] v0'0 uv132 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f5f7c03b040 con 0x7f5f840a5040 2024-09-22T08:36:47.813 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.800+0000 7f5f8a921640 1 -- 172.21.15.142:0/229102318 <== osd.0 v2:172.21.15.31:6800/168281188 20 ==== osd_op_reply(75 notify.6 [notify-ack] v0'0 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f7c03b040 con 0x7f5f840a5040 2024-09-22T08:36:47.813 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.801+0000 7f5f8a921640 1 -- 172.21.15.142:0/229102318 <== osd.0 v2:172.21.15.31:6800/168281188 21 ==== watch-notify(notify_complete (2) cookie 94242281330608 notify 128849018894 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55b67db3a550 con 0x7f5f840a5040 2024-09-22T08:36:47.813 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.801+0000 7f5f97a0f800 1 -- 172.21.15.142:0/229102318 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:76 8.15 8:ab67ca09:root::.bucket.meta.myfoo%3ae239248c-0bee-4e41-803a-24b288d3eb8f.4226.1:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b67db39c60 con 0x55b67daec020 2024-09-22T08:36:47.813 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.802+0000 7f5f93923640 1 -- 172.21.15.142:0/229102318 <== osd.3 v2:172.21.15.142:6800/1064901393 21 ==== osd_op_reply(76 .bucket.meta.myfoo:e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1 [call,delete] v30'6 uv6 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f5f8c00a4d0 con 0x55b67daec020 2024-09-22T08:36:47.813 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.802+0000 7f5f97a0f800 10 removing default.rgw.meta+root+.bucket.meta.myfoo:e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1 from cache 2024-09-22T08:36:47.813 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.802+0000 7f5f97a0f800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo:e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1, ofs0, ns] 2024-09-22T08:36:47.813 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.802+0000 7f5f97a0f800 1 -- 172.21.15.142:0/229102318 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:77 7.e 7:7759931f:::notify.3:head [notify cookie 94242281301520 in=218b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b67db39c60 con 0x7f5f8c054c20 2024-09-22T08:36:47.813 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.802+0000 7f5f93122640 1 -- 172.21.15.142:0/229102318 <== osd.2 v2:172.21.15.142:6808/279438927 14 ==== watch-notify(notify (1) cookie 94242281045536 notify 128849018896 ret 0) ==== 248+0+0 (crc 0 0 0) 0x55b67daadfe0 con 0x7f5f8c054c20 2024-09-22T08:36:47.813 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.802+0000 7f5e767fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018896 cookie 94242281045536 notifier 4541 bl.length()=206 2024-09-22T08:36:47.813 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.802+0000 7f5e767fc640 1 -- 172.21.15.142:0/229102318 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:78 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f5dc8003400 con 0x7f5f8c054c20 2024-09-22T08:36:47.814 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.802+0000 7f5f93122640 1 -- 172.21.15.142:0/229102318 <== osd.2 v2:172.21.15.142:6808/279438927 15 ==== osd_op_reply(77 notify.3 [notify cookie 94242281301520 out=8b] v0'0 uv132 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f5f84057030 con 0x7f5f8c054c20 2024-09-22T08:36:47.814 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.802+0000 7f5f93122640 1 -- 172.21.15.142:0/229102318 <== osd.2 v2:172.21.15.142:6808/279438927 16 ==== osd_op_reply(78 notify.3 [notify-ack] v0'0 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f84057030 con 0x7f5f8c054c20 2024-09-22T08:36:47.814 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.802+0000 7f5f93122640 1 -- 172.21.15.142:0/229102318 <== osd.2 v2:172.21.15.142:6808/279438927 17 ==== watch-notify(notify_complete (2) cookie 94242281301520 notify 128849018896 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55b67daad3d0 con 0x7f5f8c054c20 2024-09-22T08:36:47.814 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.803+0000 7f5e49fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:36:47.814 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.803+0000 7f5f97a0f800 1 -- 172.21.15.142:0/229102318 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:79 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94242281054480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b67db2ca20 con 0x55b67dae7630 2024-09-22T08:36:47.814 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.804+0000 7f5f8a921640 1 -- 172.21.15.142:0/229102318 <== osd.1 v2:172.21.15.142:6816/3192108003 28 ==== osd_op_reply(79 data_loggenerations_metadata [watch unwatch cookie 94242281054480] v30'129 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5f7c03b040 con 0x55b67dae7630 2024-09-22T08:36:47.814 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.804+0000 7f5f97a0f800 1 -- 172.21.15.142:0/229102318 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:80 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94242281038720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b67db2ca20 con 0x7f5f8c054c20 2024-09-22T08:36:47.814 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.805+0000 7f5f93122640 1 -- 172.21.15.142:0/229102318 <== osd.2 v2:172.21.15.142:6808/279438927 18 ==== osd_op_reply(80 notify.0 [watch unwatch cookie 94242281038720] v30'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f84057030 con 0x7f5f8c054c20 2024-09-22T08:36:47.814 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.805+0000 7f5f97a0f800 20 remove_watcher() i=0 2024-09-22T08:36:47.814 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.805+0000 7f5f97a0f800 2 removed watcher, disabling cache 2024-09-22T08:36:47.814 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.805+0000 7f5f97a0f800 1 -- 172.21.15.142:0/229102318 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:81 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94242281044480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b67db2ca20 con 0x55b67dae7630 2024-09-22T08:36:47.814 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.806+0000 7f5f8a921640 1 -- 172.21.15.142:0/229102318 <== osd.1 v2:172.21.15.142:6816/3192108003 29 ==== osd_op_reply(81 notify.1 [watch unwatch cookie 94242281044480] v30'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f7c03b040 con 0x55b67dae7630 2024-09-22T08:36:47.814 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.806+0000 7f5f97a0f800 20 remove_watcher() i=1 2024-09-22T08:36:47.814 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.806+0000 7f5f97a0f800 1 -- 172.21.15.142:0/229102318 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:82 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94242281048512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b67db2ca20 con 0x55b67daec020 2024-09-22T08:36:47.815 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.807+0000 7f5f93923640 1 -- 172.21.15.142:0/229102318 <== osd.3 v2:172.21.15.142:6800/1064901393 22 ==== osd_op_reply(82 notify.2 [watch unwatch cookie 94242281048512] v30'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f8c00a4d0 con 0x55b67daec020 2024-09-22T08:36:47.815 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.807+0000 7f5f97a0f800 20 remove_watcher() i=2 2024-09-22T08:36:47.815 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.807+0000 7f5f97a0f800 1 -- 172.21.15.142:0/229102318 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:83 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94242281045536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b67db2ca20 con 0x7f5f8c054c20 2024-09-22T08:36:47.815 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.808+0000 7f5f93122640 1 -- 172.21.15.142:0/229102318 <== osd.2 v2:172.21.15.142:6808/279438927 19 ==== osd_op_reply(83 notify.3 [watch unwatch cookie 94242281045536] v30'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f84057030 con 0x7f5f8c054c20 2024-09-22T08:36:47.815 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.808+0000 7f5f97a0f800 20 remove_watcher() i=3 2024-09-22T08:36:47.815 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.808+0000 7f5f97a0f800 1 -- 172.21.15.142:0/229102318 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:84 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94242281052912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b67db2ca20 con 0x55b67dae7630 2024-09-22T08:36:47.815 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.809+0000 7f5f8a921640 1 -- 172.21.15.142:0/229102318 <== osd.1 v2:172.21.15.142:6816/3192108003 30 ==== osd_op_reply(84 notify.4 [watch unwatch cookie 94242281052912] v30'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f7c03b040 con 0x55b67dae7630 2024-09-22T08:36:47.815 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.809+0000 7f5f97a0f800 20 remove_watcher() i=4 2024-09-22T08:36:47.815 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.809+0000 7f5f97a0f800 1 -- 172.21.15.142:0/229102318 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:85 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94242281057536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b67db2ca20 con 0x7f5f840a5040 2024-09-22T08:36:47.818 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.812+0000 7f5f8a921640 1 -- 172.21.15.142:0/229102318 <== osd.0 v2:172.21.15.31:6800/168281188 22 ==== osd_op_reply(85 notify.5 [watch unwatch cookie 94242281057536] v30'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f7c03b040 con 0x7f5f840a5040 2024-09-22T08:36:47.818 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.812+0000 7f5f97a0f800 20 remove_watcher() i=5 2024-09-22T08:36:47.818 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.812+0000 7f5f97a0f800 1 -- 172.21.15.142:0/229102318 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:86 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94242281059680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b67db2ca20 con 0x7f5f840a5040 2024-09-22T08:36:47.818 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.813+0000 7f5f8a921640 1 -- 172.21.15.142:0/229102318 <== osd.0 v2:172.21.15.31:6800/168281188 23 ==== osd_op_reply(86 notify.6 [watch unwatch cookie 94242281059680] v30'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f7c03b040 con 0x7f5f840a5040 2024-09-22T08:36:47.818 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.813+0000 7f5f97a0f800 20 remove_watcher() i=6 2024-09-22T08:36:47.819 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.813+0000 7f5f97a0f800 1 -- 172.21.15.142:0/229102318 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:87 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94242281063520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b67db2ca20 con 0x7f5f840a5040 2024-09-22T08:36:47.819 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.814+0000 7f5f8a921640 1 -- 172.21.15.142:0/229102318 <== osd.0 v2:172.21.15.31:6800/168281188 24 ==== osd_op_reply(87 notify.7 [watch unwatch cookie 94242281063520] v30'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f7c03b040 con 0x7f5f840a5040 2024-09-22T08:36:47.819 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.814+0000 7f5f97a0f800 20 remove_watcher() i=7 2024-09-22T08:36:47.819 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.814+0000 7f5f97a0f800 1 -- 172.21.15.142:0/229102318 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f5f840a5040 msgr2=0x7f5f84050840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:47.819 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.814+0000 7f5f97a0f800 1 --2- 172.21.15.142:0/229102318 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f5f840a5040 0x7f5f84050840 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:47.819 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.814+0000 7f5f97a0f800 1 -- 172.21.15.142:0/229102318 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55b67dae7630 msgr2=0x55b67dae9af0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:47.819 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.814+0000 7f5f97a0f800 1 --2- 172.21.15.142:0/229102318 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55b67dae7630 0x55b67dae9af0 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:47.819 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.814+0000 7f5f97a0f800 1 -- 172.21.15.142:0/229102318 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f5f8c054c20 msgr2=0x7f5f8c0538d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:47.819 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.814+0000 7f5f97a0f800 1 --2- 172.21.15.142:0/229102318 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f5f8c054c20 0x7f5f8c0538d0 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:47.819 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.814+0000 7f5f97a0f800 1 -- 172.21.15.142:0/229102318 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55b67daec020 msgr2=0x55b67daee410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:47.819 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.814+0000 7f5f97a0f800 1 --2- 172.21.15.142:0/229102318 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55b67daec020 0x55b67daee410 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:47.819 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.814+0000 7f5f97a0f800 1 -- 172.21.15.142:0/229102318 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f5e5c03d000 msgr2=0x7f5e5c03f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:47.819 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.814+0000 7f5f97a0f800 1 --2- 172.21.15.142:0/229102318 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f5e5c03d000 0x7f5e5c03f4c0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f5f840507d0 tx=0x7f5f84091000 comp rx=0 tx=0).stop 2024-09-22T08:36:47.820 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.814+0000 7f5f97a0f800 1 -- 172.21.15.142:0/229102318 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b67dad4720 msgr2=0x55b67dadbd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:47.820 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.814+0000 7f5f97a0f800 1 --2- 172.21.15.142:0/229102318 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b67dad4720 0x55b67dadbd10 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f5f8c021eb0 tx=0x7f5f8c0547a0 comp rx=0 tx=0).stop 2024-09-22T08:36:47.820 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.814+0000 7f5f8a921640 1 -- 172.21.15.142:0/229102318 reap_dead start 2024-09-22T08:36:47.820 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.814+0000 7f5f97a0f800 1 -- 172.21.15.142:0/229102318 shutdown_connections 2024-09-22T08:36:47.820 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.814+0000 7f5f97a0f800 1 --2- 172.21.15.142:0/229102318 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b67dad4720 0x55b67dadbd10 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:47.820 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.814+0000 7f5f97a0f800 1 -- 172.21.15.142:0/229102318 >> 172.21.15.142:0/229102318 conn(0x55b67dad0b20 msgr2=0x55b67daced30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:47.820 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.814+0000 7f5f97a0f800 1 -- 172.21.15.142:0/229102318 shutdown_connections 2024-09-22T08:36:47.820 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.814+0000 7f5f97a0f800 1 -- 172.21.15.142:0/229102318 wait complete. 2024-09-22T08:36:47.820 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.815+0000 7f5f97a0f800 1 -- 172.21.15.142:0/2313005359 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f5e6c03cfb0 msgr2=0x7f5e6c03f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:47.820 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.815+0000 7f5f97a0f800 1 --2- 172.21.15.142:0/2313005359 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f5e6c03cfb0 0x7f5e6c03f470 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x55b67dab95e0 tx=0x7f5f8406ef30 comp rx=0 tx=0).stop 2024-09-22T08:36:47.820 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.815+0000 7f5f97a0f800 1 -- 172.21.15.142:0/2313005359 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b67dac7c00 msgr2=0x55b67dac8020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:47.820 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.815+0000 7f5f97a0f800 1 --2- 172.21.15.142:0/2313005359 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b67dac7c00 0x55b67dac8020 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x55b67daadbe0 tx=0x7f5f8c0167b0 comp rx=0 tx=0).stop 2024-09-22T08:36:47.820 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.815+0000 7f5f97a0f800 1 -- 172.21.15.142:0/2313005359 shutdown_connections 2024-09-22T08:36:47.820 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.815+0000 7f5f97a0f800 1 --2- 172.21.15.142:0/2313005359 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f5e6c03cfb0 0x7f5e6c03f470 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:47.821 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.815+0000 7f5f97a0f800 1 --2- 172.21.15.142:0/2313005359 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b67dac7c00 0x55b67dac8020 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:47.821 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.815+0000 7f5f97a0f800 1 -- 172.21.15.142:0/2313005359 >> 172.21.15.142:0/2313005359 conn(0x55b67dabbfb0 msgr2=0x55b67dabc390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:47.821 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.815+0000 7f5f97a0f800 1 -- 172.21.15.142:0/2313005359 shutdown_connections 2024-09-22T08:36:47.821 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.815+0000 7f5f97a0f800 1 -- 172.21.15.142:0/2313005359 wait complete. 2024-09-22T08:36:47.821 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.815+0000 7f5f97a0f800 1 -- 172.21.15.142:0/888810703 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55b67d9b8a30 msgr2=0x55b67dab4230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:47.821 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.815+0000 7f5f97a0f800 1 --2- 172.21.15.142:0/888810703 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55b67d9b8a30 0x55b67dab4230 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:47.821 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.815+0000 7f5f97a0f800 1 -- 172.21.15.142:0/888810703 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55b67dab6610 msgr2=0x55b67dab8ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:47.821 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.815+0000 7f5f97a0f800 1 --2- 172.21.15.142:0/888810703 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55b67dab6610 0x55b67dab8ab0 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:47.821 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.815+0000 7f5f97a0f800 1 -- 172.21.15.142:0/888810703 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f5e7803cfb0 msgr2=0x7f5e7803f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:47.821 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.815+0000 7f5f97a0f800 1 --2- 172.21.15.142:0/888810703 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f5e7803cfb0 0x7f5e7803f470 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f5f7c001e30 tx=0x7f5f7c001390 comp rx=0 tx=0).stop 2024-09-22T08:36:47.821 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.815+0000 7f5f97a0f800 1 -- 172.21.15.142:0/888810703 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b67d927530 msgr2=0x55b67daacbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:47.821 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.815+0000 7f5f97a0f800 1 --2- 172.21.15.142:0/888810703 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b67d927530 0x55b67daacbe0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f5f840460d0 tx=0x7f5f84002fb0 comp rx=0 tx=0).stop 2024-09-22T08:36:47.821 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.815+0000 7f5f97a0f800 1 -- 172.21.15.142:0/888810703 shutdown_connections 2024-09-22T08:36:47.821 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.815+0000 7f5f97a0f800 1 --2- 172.21.15.142:0/888810703 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55b67dab6610 0x55b67dab8ab0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:47.822 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.815+0000 7f5f97a0f800 1 --2- 172.21.15.142:0/888810703 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55b67d9b8a30 0x55b67dab4230 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:47.822 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.815+0000 7f5f97a0f800 1 --2- 172.21.15.142:0/888810703 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f5e7803cfb0 0x7f5e7803f470 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:47.822 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.815+0000 7f5f97a0f800 1 --2- 172.21.15.142:0/888810703 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b67d927530 0x55b67daacbe0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:47.822 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.815+0000 7f5f97a0f800 1 -- 172.21.15.142:0/888810703 >> 172.21.15.142:0/888810703 conn(0x55b67d9adc00 msgr2=0x55b67daa6530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:47.822 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.815+0000 7f5f97a0f800 1 -- 172.21.15.142:0/888810703 shutdown_connections 2024-09-22T08:36:47.822 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.815+0000 7f5f97a0f800 1 -- 172.21.15.142:0/888810703 wait complete. 2024-09-22T08:36:47.825 INFO:tasks.util.rgw:rgwadmin: client.0 : ['metadata', 'get', 'bucket:testx/myfoo'] 2024-09-22T08:36:47.825 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'metadata', 'get', 'bucket:testx/myfoo'] 2024-09-22T08:36:47.825 DEBUG:teuthology.orchestra.run.smithi142:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph metadata get bucket:testx/myfoo 2024-09-22T08:36:47.868 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:36:47.868 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:36:47.869 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.868+0000 7fa1c9887800 1 Processor -- start 2024-09-22T08:36:47.869 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.868+0000 7fa1c9887800 1 -- start start 2024-09-22T08:36:47.869 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.868+0000 7fa1c9887800 1 --2- >> v2:172.21.15.31:3300/0 conn(0x5586fbfedbe0 0x5586fbfefff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:47.869 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.868+0000 7fa1c9887800 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5586fbe7aa20 con 0x5586fbff4c50 2024-09-22T08:36:47.870 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.868+0000 7fa1c9887800 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x5586fbe7a7d0 con 0x5586fbfedbe0 2024-09-22T08:36:47.870 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.869+0000 7fa1c7371640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x5586fbfedbe0 0x5586fbfefff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:47.870 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.869+0000 7fa1c7371640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x5586fbfedbe0 0x5586fbfefff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:39894/0 (socket says 172.21.15.142:39894) 2024-09-22T08:36:47.871 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.869+0000 7fa1c7371640 1 -- 172.21.15.142:0/2497605188 learned_addr learned my addr 172.21.15.142:0/2497605188 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:47.871 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.869+0000 7fa1c6b70640 1 --1- 172.21.15.142:0/2497605188 >> v1:172.21.15.31:6789/0 conn(0x5586fbff4c50 0x5586fbff7040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.142:42634/0 (socket says 172.21.15.142:42634) 2024-09-22T08:36:47.871 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.869+0000 7fa1c7371640 1 -- 172.21.15.142:0/2497605188 >> v1:172.21.15.31:6789/0 conn(0x5586fbff4c50 legacy=0x5586fbff7040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:47.871 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.869+0000 7fa1c7371640 1 -- 172.21.15.142:0/2497605188 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5586fbff97a0 con 0x5586fbfedbe0 2024-09-22T08:36:47.872 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.871+0000 7fa1c7371640 1 --2- 172.21.15.142:0/2497605188 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5586fbfedbe0 0x5586fbfefff0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fa1b8005fd0 tx=0x7fa1b8045cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89005a6d48624294 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:47.872 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.871+0000 7fa1c636f640 1 -- 172.21.15.142:0/2497605188 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa1b804e600 con 0x5586fbfedbe0 2024-09-22T08:36:47.872 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.871+0000 7fa1c636f640 1 -- 172.21.15.142:0/2497605188 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1b804e7a0 con 0x5586fbfedbe0 2024-09-22T08:36:47.872 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.871+0000 7fa1c636f640 1 -- 172.21.15.142:0/2497605188 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa1b804eaa0 con 0x5586fbfedbe0 2024-09-22T08:36:47.873 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.871+0000 7fa1c9887800 1 -- 172.21.15.142:0/2497605188 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5586fbfedbe0 msgr2=0x5586fbfefff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:47.873 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.871+0000 7fa1c9887800 1 --2- 172.21.15.142:0/2497605188 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5586fbfedbe0 0x5586fbfefff0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fa1b8005fd0 tx=0x7fa1b8045cf0 comp rx=0 tx=0).stop 2024-09-22T08:36:47.873 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.871+0000 7fa1c9887800 1 -- 172.21.15.142:0/2497605188 shutdown_connections 2024-09-22T08:36:47.873 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.871+0000 7fa1c9887800 1 --2- 172.21.15.142:0/2497605188 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5586fbfedbe0 0x5586fbfefff0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:47.873 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.871+0000 7fa1c9887800 1 -- 172.21.15.142:0/2497605188 >> 172.21.15.142:0/2497605188 conn(0x5586fbfe9310 msgr2=0x5586fbfeb790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:47.873 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.871+0000 7fa1c9887800 1 -- 172.21.15.142:0/2497605188 shutdown_connections 2024-09-22T08:36:47.873 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.871+0000 7fa1c9887800 1 -- 172.21.15.142:0/2497605188 wait complete. 2024-09-22T08:36:47.886 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.885+0000 7fa1c9887800 1 Processor -- start 2024-09-22T08:36:47.886 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.885+0000 7fa1c9887800 1 -- start start 2024-09-22T08:36:47.886 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.885+0000 7fa1c9887800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5586fbfedbe0 0x5586fc0e12b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:47.886 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.885+0000 7fa1c9887800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5586fbe87dd0 con 0x5586fbfedbe0 2024-09-22T08:36:47.887 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.886+0000 7fa1c7371640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5586fbfedbe0 0x5586fc0e12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:47.887 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.886+0000 7fa1c7371640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5586fbfedbe0 0x5586fc0e12b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:39910/0 (socket says 172.21.15.142:39910) 2024-09-22T08:36:47.888 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.886+0000 7fa1c7371640 1 -- 172.21.15.142:0/4210051751 learned_addr learned my addr 172.21.15.142:0/4210051751 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:47.888 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.886+0000 7fa1c7371640 1 -- 172.21.15.142:0/4210051751 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5586fc0e18a0 con 0x5586fbfedbe0 2024-09-22T08:36:47.888 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.886+0000 7fa1c7371640 1 --2- 172.21.15.142:0/4210051751 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5586fbfedbe0 0x5586fc0e12b0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fa1b8005fd0 tx=0x7fa1b8050000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fecded8f082deb8 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:47.888 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.886+0000 7fa0b560a640 1 -- 172.21.15.142:0/4210051751 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa1b804eb40 con 0x5586fbfedbe0 2024-09-22T08:36:47.888 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.886+0000 7fa0b560a640 1 -- 172.21.15.142:0/4210051751 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1b8066070 con 0x5586fbfedbe0 2024-09-22T08:36:47.888 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.886+0000 7fa0b560a640 1 -- 172.21.15.142:0/4210051751 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa1b804ee50 con 0x5586fbfedbe0 2024-09-22T08:36:47.890 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.887+0000 7fa1c9887800 1 -- 172.21.15.142:0/4210051751 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5586fbfedbe0 msgr2=0x5586fc0e12b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:47.890 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.887+0000 7fa1c9887800 1 --2- 172.21.15.142:0/4210051751 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5586fbfedbe0 0x5586fc0e12b0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fa1b8005fd0 tx=0x7fa1b8050000 comp rx=0 tx=0).stop 2024-09-22T08:36:47.890 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.887+0000 7fa1c9887800 1 -- 172.21.15.142:0/4210051751 shutdown_connections 2024-09-22T08:36:47.890 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.887+0000 7fa1c9887800 1 --2- 172.21.15.142:0/4210051751 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5586fbfedbe0 0x5586fc0e12b0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:47.890 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.887+0000 7fa1c9887800 1 -- 172.21.15.142:0/4210051751 >> 172.21.15.142:0/4210051751 conn(0x5586fbfe9310 msgr2=0x5586fc0dcc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:47.890 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.887+0000 7fa1c9887800 1 -- 172.21.15.142:0/4210051751 shutdown_connections 2024-09-22T08:36:47.890 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.887+0000 7fa1c9887800 1 -- 172.21.15.142:0/4210051751 wait complete. 2024-09-22T08:36:47.890 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.887+0000 7fa1c9887800 1 Processor -- start 2024-09-22T08:36:47.890 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.887+0000 7fa1c9887800 1 -- start start 2024-09-22T08:36:47.890 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.888+0000 7fa1c9887800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5586fbfedbe0 0x5586fc0e8d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:47.890 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.888+0000 7fa1c9887800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5586fbff8a60 con 0x5586fbfedbe0 2024-09-22T08:36:47.891 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.888+0000 7fa1c7371640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5586fbfedbe0 0x5586fc0e8d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:47.891 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.888+0000 7fa1c7371640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5586fbfedbe0 0x5586fc0e8d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:39914/0 (socket says 172.21.15.142:39914) 2024-09-22T08:36:47.891 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.888+0000 7fa1c7371640 1 -- 172.21.15.142:0/3709297448 learned_addr learned my addr 172.21.15.142:0/3709297448 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:47.891 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.888+0000 7fa1c7371640 1 -- 172.21.15.142:0/3709297448 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5586fc0e9280 con 0x5586fbfedbe0 2024-09-22T08:36:47.891 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.888+0000 7fa1c7371640 1 --2- 172.21.15.142:0/3709297448 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5586fbfedbe0 0x5586fc0e8d20 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fa1b8063040 tx=0x7fa1b8003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:47.891 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.888+0000 7fa0b3e07640 1 -- 172.21.15.142:0/3709297448 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa1b806d550 con 0x5586fbfedbe0 2024-09-22T08:36:47.891 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.888+0000 7fa0b3e07640 1 -- 172.21.15.142:0/3709297448 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1b8071030 con 0x5586fbfedbe0 2024-09-22T08:36:47.891 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.888+0000 7fa1c9887800 1 -- 172.21.15.142:0/3709297448 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5586fc0e9510 con 0x5586fbfedbe0 2024-09-22T08:36:47.891 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.888+0000 7fa0b3e07640 1 -- 172.21.15.142:0/3709297448 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa1b806d820 con 0x5586fbfedbe0 2024-09-22T08:36:47.891 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.889+0000 7fa1c9887800 1 -- 172.21.15.142:0/3709297448 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5586fc0e9f10 con 0x5586fbfedbe0 2024-09-22T08:36:47.894 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.889+0000 7fa0b3e07640 1 -- 172.21.15.142:0/3709297448 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fa1b806da50 con 0x5586fbfedbe0 2024-09-22T08:36:47.894 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.890+0000 7fa0b3e07640 1 --2- 172.21.15.142:0/3709297448 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fa0ac03cfb0 0x7fa0ac03f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:47.894 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.890+0000 7fa0b3e07640 1 -- 172.21.15.142:0/3709297448 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fa1b8098ba0 con 0x5586fbfedbe0 2024-09-22T08:36:47.894 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.890+0000 7fa1c6b70640 1 --2- 172.21.15.142:0/3709297448 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fa0ac03cfb0 0x7fa0ac03f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:47.894 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.890+0000 7fa1c9887800 1 --2- 172.21.15.142:0/3709297448 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5586fbff4c50 0x5586fc0f0370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:47.894 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.890+0000 7fa1c9887800 1 -- 172.21.15.142:0/3709297448 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5586fc0eab00 con 0x5586fbff4c50 2024-09-22T08:36:47.894 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.890+0000 7fa1c7b72640 1 --2- 172.21.15.142:0/3709297448 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5586fbff4c50 0x5586fc0f0370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:47.894 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.890+0000 7fa1c6b70640 1 --2- 172.21.15.142:0/3709297448 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fa0ac03cfb0 0x7fa0ac03f470 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fa1b0001e30 tx=0x7fa1b0001390 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:47.894 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.890+0000 7fa1c7b72640 1 --2- 172.21.15.142:0/3709297448 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5586fbff4c50 0x5586fc0f0370 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:47.894 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.890+0000 7fa1c7b72640 1 -- 172.21.15.142:0/3709297448 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa1c00083e0 con 0x5586fbff4c50 2024-09-22T08:36:47.894 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.890+0000 7fa1c9887800 1 -- 172.21.15.142:0/3709297448 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5586fc0f0df0 con 0x5586fbff4c50 2024-09-22T08:36:47.895 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.891+0000 7fa1c7b72640 1 -- 172.21.15.142:0/3709297448 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa1c00083e0 con 0x5586fbff4c50 2024-09-22T08:36:47.895 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.891+0000 7fa1c9887800 1 --2- 172.21.15.142:0/3709297448 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5586fc0f2700 0x5586fc0f4ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:47.895 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.891+0000 7fa1c9887800 1 -- 172.21.15.142:0/3709297448 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:3 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5586fc0f5330 con 0x5586fc0f2700 2024-09-22T08:36:47.895 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.891+0000 7fa1c7371640 1 --2- 172.21.15.142:0/3709297448 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5586fc0f2700 0x5586fc0f4ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:47.895 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.891+0000 7fa1c7371640 1 --2- 172.21.15.142:0/3709297448 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5586fc0f2700 0x5586fc0f4ba0 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:47.895 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.891+0000 7fa1c7371640 1 -- 172.21.15.142:0/3709297448 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(3 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fa1b807d070 con 0x5586fc0f2700 2024-09-22T08:36:47.895 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.891+0000 7fa1c9887800 1 -- 172.21.15.142:0/3709297448 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5586fc0f1640 con 0x5586fbff4c50 2024-09-22T08:36:47.895 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.892+0000 7fa1c7b72640 1 -- 172.21.15.142:0/3709297448 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa1c00083e0 con 0x5586fbff4c50 2024-09-22T08:36:47.895 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.892+0000 7fa1c9887800 1 -- 172.21.15.142:0/3709297448 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5586fc0f1a20 con 0x5586fc0f2700 2024-09-22T08:36:47.895 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.892+0000 7fa1c7371640 1 -- 172.21.15.142:0/3709297448 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(5 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fa1b807d070 con 0x5586fc0f2700 2024-09-22T08:36:47.895 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.892+0000 7fa1c9887800 1 Processor -- start 2024-09-22T08:36:47.895 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.892+0000 7fa1c9887800 1 -- start start 2024-09-22T08:36:47.895 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.892+0000 7fa1c9887800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5586fc103d00 0x5586fc104120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:47.896 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.892+0000 7fa1c9887800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5586fbee6d50 con 0x5586fc103d00 2024-09-22T08:36:47.896 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.893+0000 7fa1c7b72640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5586fc103d00 0x5586fc104120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:47.896 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.893+0000 7fa1c7b72640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5586fc103d00 0x5586fc104120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:39928/0 (socket says 172.21.15.142:39928) 2024-09-22T08:36:47.896 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.893+0000 7fa1c7b72640 1 -- 172.21.15.142:0/3248429164 learned_addr learned my addr 172.21.15.142:0/3248429164 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:47.896 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.893+0000 7fa1c7b72640 1 -- 172.21.15.142:0/3248429164 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5586fc104760 con 0x5586fc103d00 2024-09-22T08:36:47.900 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.893+0000 7fa1c7b72640 1 --2- 172.21.15.142:0/3248429164 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5586fc103d00 0x5586fc104120 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x5586fc0ea310 tx=0x7fa1c000bf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:47.900 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.893+0000 7fa0b1602640 1 -- 172.21.15.142:0/3248429164 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa1c001c020 con 0x5586fc103d00 2024-09-22T08:36:47.900 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.893+0000 7fa0b1602640 1 -- 172.21.15.142:0/3248429164 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1c0007c90 con 0x5586fc103d00 2024-09-22T08:36:47.900 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.893+0000 7fa1c9887800 1 -- 172.21.15.142:0/3248429164 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5586fc104f90 con 0x5586fc103d00 2024-09-22T08:36:47.900 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.893+0000 7fa0b1602640 1 -- 172.21.15.142:0/3248429164 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa1c0018440 con 0x5586fc103d00 2024-09-22T08:36:47.900 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.893+0000 7fa1c9887800 1 -- 172.21.15.142:0/3248429164 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5586fc105530 con 0x5586fc103d00 2024-09-22T08:36:47.900 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.894+0000 7fa0b1602640 1 -- 172.21.15.142:0/3248429164 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fa1c001f020 con 0x5586fc103d00 2024-09-22T08:36:47.900 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.894+0000 7fa0b1602640 1 --2- 172.21.15.142:0/3248429164 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fa0a003cfb0 0x7fa0a003f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:47.900 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.894+0000 7fa0b1602640 1 -- 172.21.15.142:0/3248429164 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fa1c0055930 con 0x5586fc103d00 2024-09-22T08:36:47.900 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.894+0000 7fa1c7371640 1 --2- 172.21.15.142:0/3248429164 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fa0a003cfb0 0x7fa0a003f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:47.900 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.895+0000 7fa1c9887800 1 Processor -- start 2024-09-22T08:36:47.900 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.895+0000 7fa1c7371640 1 --2- 172.21.15.142:0/3248429164 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fa0a003cfb0 0x7fa0a003f470 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fa1b8097180 tx=0x7fa1b8061db0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:47.900 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.895+0000 7fa1c9887800 1 -- start start 2024-09-22T08:36:47.901 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.895+0000 7fa1c9887800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5586fc110740 0x5586fc110b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:47.901 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.895+0000 7fa1c9887800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5586fc0e1c10 con 0x5586fc110740 2024-09-22T08:36:47.901 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.895+0000 7fa1c7b72640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5586fc110740 0x5586fc110b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:47.901 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.895+0000 7fa1c7b72640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5586fc110740 0x5586fc110b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:39936/0 (socket says 172.21.15.142:39936) 2024-09-22T08:36:47.901 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.895+0000 7fa1c7b72640 1 -- 172.21.15.142:0/1675689848 learned_addr learned my addr 172.21.15.142:0/1675689848 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:47.901 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.896+0000 7fa1c7b72640 1 -- 172.21.15.142:0/1675689848 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5586fc111130 con 0x5586fc110740 2024-09-22T08:36:47.901 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.896+0000 7fa1c7b72640 1 --2- 172.21.15.142:0/1675689848 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5586fc110740 0x5586fc110b40 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fa1c0053e40 tx=0x7fa1c0015f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aaec9a5ffb667c44 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:47.901 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.896+0000 7fa0aaffd640 1 -- 172.21.15.142:0/1675689848 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa1c0017520 con 0x5586fc110740 2024-09-22T08:36:47.901 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.896+0000 7fa0aaffd640 1 -- 172.21.15.142:0/1675689848 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1c004a070 con 0x5586fc110740 2024-09-22T08:36:47.901 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.896+0000 7fa0aaffd640 1 -- 172.21.15.142:0/1675689848 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa1c0015820 con 0x5586fc110740 2024-09-22T08:36:47.901 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.896+0000 7fa1c9887800 1 -- 172.21.15.142:0/1675689848 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5586fc110740 msgr2=0x5586fc110b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:47.901 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.896+0000 7fa1c9887800 1 --2- 172.21.15.142:0/1675689848 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5586fc110740 0x5586fc110b40 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fa1c0053e40 tx=0x7fa1c0015f20 comp rx=0 tx=0).stop 2024-09-22T08:36:47.901 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.896+0000 7fa1c9887800 1 -- 172.21.15.142:0/1675689848 shutdown_connections 2024-09-22T08:36:47.902 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.896+0000 7fa1c9887800 1 --2- 172.21.15.142:0/1675689848 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5586fc110740 0x5586fc110b40 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:47.902 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.896+0000 7fa1c9887800 1 -- 172.21.15.142:0/1675689848 >> 172.21.15.142:0/1675689848 conn(0x5586fc10cb40 msgr2=0x5586fc10ad80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:47.902 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.896+0000 7fa1c9887800 1 -- 172.21.15.142:0/1675689848 shutdown_connections 2024-09-22T08:36:47.902 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.896+0000 7fa1c9887800 1 -- 172.21.15.142:0/1675689848 wait complete. 2024-09-22T08:36:47.902 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.897+0000 7fa1c9887800 1 Processor -- start 2024-09-22T08:36:47.902 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.897+0000 7fa1c9887800 1 -- start start 2024-09-22T08:36:47.902 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.897+0000 7fa1c9887800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5586fc110740 0x5586fc117d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:47.902 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.897+0000 7fa1c9887800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5586fc111750 con 0x5586fc110740 2024-09-22T08:36:47.902 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.897+0000 7fa1c7b72640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5586fc110740 0x5586fc117d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:47.902 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.897+0000 7fa1c7b72640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5586fc110740 0x5586fc117d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:39948/0 (socket says 172.21.15.142:39948) 2024-09-22T08:36:47.902 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.897+0000 7fa1c7b72640 1 -- 172.21.15.142:0/2545471878 learned_addr learned my addr 172.21.15.142:0/2545471878 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:47.902 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.897+0000 7fa1c7b72640 1 -- 172.21.15.142:0/2545471878 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5586fc118270 con 0x5586fc110740 2024-09-22T08:36:47.902 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.897+0000 7fa1c7b72640 1 --2- 172.21.15.142:0/2545471878 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5586fc110740 0x5586fc117d10 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fa1c0028fd0 tx=0x7fa1c0053da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:47.902 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.897+0000 7fa0a97fa640 1 -- 172.21.15.142:0/2545471878 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa1c000b230 con 0x5586fc110740 2024-09-22T08:36:47.903 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.898+0000 7fa0a97fa640 1 -- 172.21.15.142:0/2545471878 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1c0013320 con 0x5586fc110740 2024-09-22T08:36:47.903 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.898+0000 7fa1c9887800 1 -- 172.21.15.142:0/2545471878 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5586fc118500 con 0x5586fc110740 2024-09-22T08:36:47.903 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.898+0000 7fa0a97fa640 1 -- 172.21.15.142:0/2545471878 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa1c000b3d0 con 0x5586fc110740 2024-09-22T08:36:47.903 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.898+0000 7fa1c9887800 1 -- 172.21.15.142:0/2545471878 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5586fc119090 con 0x5586fc110740 2024-09-22T08:36:47.903 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.898+0000 7fa0a97fa640 1 -- 172.21.15.142:0/2545471878 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fa1c0016040 con 0x5586fc110740 2024-09-22T08:36:47.903 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.898+0000 7fa0a97fa640 1 --2- 172.21.15.142:0/2545471878 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fa09003d000 0x7fa09003f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:47.903 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.899+0000 7fa0a97fa640 1 -- 172.21.15.142:0/2545471878 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fa1c0035ae0 con 0x5586fc110740 2024-09-22T08:36:47.903 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.899+0000 7fa1c7371640 1 --2- 172.21.15.142:0/2545471878 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fa09003d000 0x7fa09003f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:47.911 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.899+0000 7fa1c9887800 20 rados->read ofs=0 len=0 2024-09-22T08:36:47.911 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.899+0000 7fa1c7371640 1 --2- 172.21.15.142:0/2545471878 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fa09003d000 0x7fa09003f4c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fa1b80973e0 tx=0x7fa1b8088000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:47.911 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.899+0000 7fa1c9887800 1 --2- 172.21.15.142:0/2545471878 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5586fc1235e0 0x5586fc125aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:47.911 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.899+0000 7fa1c9887800 1 -- 172.21.15.142:0/2545471878 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5586fc1261f0 con 0x5586fc1235e0 2024-09-22T08:36:47.911 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.899+0000 7fa1c6b70640 1 --2- 172.21.15.142:0/2545471878 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5586fc1235e0 0x5586fc125aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:47.911 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.899+0000 7fa1c6b70640 1 --2- 172.21.15.142:0/2545471878 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5586fc1235e0 0x5586fc125aa0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:47.911 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.900+0000 7fa1c6b70640 1 -- 172.21.15.142:0/2545471878 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa1b000f610 con 0x5586fc1235e0 2024-09-22T08:36:47.911 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.900+0000 7fa1c9887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:47.911 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.900+0000 7fa1c9887800 20 realm 2024-09-22T08:36:47.911 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.900+0000 7fa1c9887800 20 rados->read ofs=0 len=0 2024-09-22T08:36:47.911 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.900+0000 7fa1c9887800 1 -- 172.21.15.142:0/2545471878 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5586fc122930 con 0x5586fc1235e0 2024-09-22T08:36:47.912 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.900+0000 7fa1c6b70640 1 -- 172.21.15.142:0/2545471878 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa1b000f610 con 0x5586fc1235e0 2024-09-22T08:36:47.912 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.900+0000 7fa1c9887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:47.912 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.900+0000 7fa1c9887800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:36:47.912 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.900+0000 7fa1c9887800 20 rados->read ofs=0 len=0 2024-09-22T08:36:47.912 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.900+0000 7fa1c9887800 1 -- 172.21.15.142:0/2545471878 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5586fc126cd0 con 0x5586fc1235e0 2024-09-22T08:36:47.912 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.900+0000 7fa1c6b70640 1 -- 172.21.15.142:0/2545471878 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa1b000f610 con 0x5586fc1235e0 2024-09-22T08:36:47.912 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.900+0000 7fa1c9887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:47.912 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.900+0000 7fa1c9887800 20 rados->read ofs=0 len=0 2024-09-22T08:36:47.912 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.900+0000 7fa1c9887800 1 -- 172.21.15.142:0/2545471878 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5586fc1275a0 con 0x5586fc1235e0 2024-09-22T08:36:47.912 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.900+0000 7fa1c6b70640 1 -- 172.21.15.142:0/2545471878 <== osd.1 v2:172.21.15.142:6816/3192108003 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa1b000f610 con 0x5586fc1235e0 2024-09-22T08:36:47.912 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.900+0000 7fa1c9887800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:36:47.912 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.900+0000 7fa1c9887800 20 rados->read ofs=0 len=0 2024-09-22T08:36:47.912 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.900+0000 7fa1c9887800 1 --2- 172.21.15.142:0/2545471878 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5586fc127ee0 0x5586fc12a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:47.912 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.900+0000 7fa1c9887800 1 -- 172.21.15.142:0/2545471878 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5586fc12aa10 con 0x5586fc127ee0 2024-09-22T08:36:47.913 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.901+0000 7fa1c7b72640 1 --2- 172.21.15.142:0/2545471878 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5586fc127ee0 0x5586fc12a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:47.913 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.901+0000 7fa1c7b72640 1 --2- 172.21.15.142:0/2545471878 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5586fc127ee0 0x5586fc12a2d0 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:47.913 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.901+0000 7fa1c7b72640 1 -- 172.21.15.142:0/2545471878 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(5 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fa1c003b070 con 0x5586fc127ee0 2024-09-22T08:36:47.913 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.901+0000 7fa1c9887800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:36:47.913 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.901+0000 7fa1c9887800 20 searching for the correct realm 2024-09-22T08:36:47.913 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.901+0000 7fa1c9887800 1 -- 172.21.15.142:0/2545471878 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5586fc12c3c0 con 0x5586fc127ee0 2024-09-22T08:36:47.913 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.901+0000 7fa1c7b72640 1 -- 172.21.15.142:0/2545471878 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa1c003b070 con 0x5586fc127ee0 2024-09-22T08:36:47.913 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.901+0000 7fa1c7b72640 1 --2- 172.21.15.142:0/2545471878 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7fa1c0021020 0x7fa1c0004280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:47.913 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.901+0000 7fa1c7b72640 1 -- 172.21.15.142:0/2545471878 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5586fc12c3c0 con 0x7fa1c0021020 2024-09-22T08:36:47.913 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.901+0000 7fa1c7371640 1 --2- 172.21.15.142:0/2545471878 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7fa1c0021020 0x7fa1c0004280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:47.913 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.902+0000 7fa1c7371640 1 --2- 172.21.15.142:0/2545471878 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7fa1c0021020 0x7fa1c0004280 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:47.913 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.902+0000 7fa1c7371640 1 -- 172.21.15.142:0/2545471878 <== osd.2 v2:172.21.15.142:6808/279438927 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa1b80a2040 con 0x7fa1c0021020 2024-09-22T08:36:47.913 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.902+0000 7fa1c7371640 1 --2- 172.21.15.142:0/2545471878 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7fa1b80a5040 0x7fa1b8056910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:47.914 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.902+0000 7fa1c7371640 1 -- 172.21.15.142:0/2545471878 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5586fc12c3c0 con 0x7fa1b80a5040 2024-09-22T08:36:47.914 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.902+0000 7fa1c6b70640 1 --2- 172.21.15.142:0/2545471878 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7fa1b80a5040 0x7fa1b8056910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:47.914 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.903+0000 7fa1c6b70640 1 --2- 172.21.15.142:0/2545471878 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7fa1b80a5040 0x7fa1b8056910 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:47.914 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.903+0000 7fa1c6b70640 1 -- 172.21.15.142:0/2545471878 <== osd.0 v2:172.21.15.31:6800/168281188 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa1b000f610 con 0x7fa1b80a5040 2024-09-22T08:36:47.914 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.903+0000 7fa1c6b70640 1 -- 172.21.15.142:0/2545471878 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5586fc12c3c0 con 0x5586fc1235e0 2024-09-22T08:36:47.914 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.903+0000 7fa1c6b70640 1 -- 172.21.15.142:0/2545471878 <== osd.1 v2:172.21.15.142:6816/3192108003 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa1b000f610 con 0x5586fc1235e0 2024-09-22T08:36:47.914 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.903+0000 7fa1c6b70640 1 -- 172.21.15.142:0/2545471878 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5586fc12c3c0 con 0x5586fc1235e0 2024-09-22T08:36:47.914 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.903+0000 7fa1c6b70640 1 -- 172.21.15.142:0/2545471878 <== osd.1 v2:172.21.15.142:6816/3192108003 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa1b002b040 con 0x5586fc1235e0 2024-09-22T08:36:47.914 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.903+0000 7fa1c6b70640 1 -- 172.21.15.142:0/2545471878 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5586fc12c3c0 con 0x7fa1b80a5040 2024-09-22T08:36:47.914 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.904+0000 7fa1c6b70640 1 -- 172.21.15.142:0/2545471878 <== osd.0 v2:172.21.15.31:6800/168281188 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa1b002b040 con 0x7fa1b80a5040 2024-09-22T08:36:47.914 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.904+0000 7fa1c6b70640 1 -- 172.21.15.142:0/2545471878 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5586fc12c3c0 con 0x7fa1b80a5040 2024-09-22T08:36:47.914 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.904+0000 7fa1c6b70640 1 -- 172.21.15.142:0/2545471878 <== osd.0 v2:172.21.15.31:6800/168281188 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa1b002b040 con 0x7fa1b80a5040 2024-09-22T08:36:47.914 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.904+0000 7fa1c6b70640 1 -- 172.21.15.142:0/2545471878 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5586fc12c3c0 con 0x7fa1c0021020 2024-09-22T08:36:47.915 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.904+0000 7fa1c7371640 1 -- 172.21.15.142:0/2545471878 <== osd.2 v2:172.21.15.142:6808/279438927 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa1b80a2040 con 0x7fa1c0021020 2024-09-22T08:36:47.915 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.904+0000 7fa1c7371640 1 -- 172.21.15.142:0/2545471878 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5586fc12c3c0 con 0x5586fc127ee0 2024-09-22T08:36:47.915 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.904+0000 7fa1c7b72640 1 -- 172.21.15.142:0/2545471878 <== osd.3 v2:172.21.15.142:6800/1064901393 3 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa1c003b070 con 0x5586fc127ee0 2024-09-22T08:36:47.915 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.904+0000 7fa1c7b72640 1 -- 172.21.15.142:0/2545471878 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5586fc12c3c0 con 0x5586fc1235e0 2024-09-22T08:36:47.915 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.905+0000 7fa1c6b70640 1 -- 172.21.15.142:0/2545471878 <== osd.1 v2:172.21.15.142:6816/3192108003 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa1b002b040 con 0x5586fc1235e0 2024-09-22T08:36:47.915 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.905+0000 7fa1c6b70640 1 -- 172.21.15.142:0/2545471878 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5586fc12c3c0 con 0x7fa1b80a5040 2024-09-22T08:36:47.915 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.905+0000 7fa1c6b70640 1 -- 172.21.15.142:0/2545471878 <== osd.0 v2:172.21.15.31:6800/168281188 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa1b002b040 con 0x7fa1b80a5040 2024-09-22T08:36:47.915 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.905+0000 7fa1c6b70640 1 -- 172.21.15.142:0/2545471878 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5586fc12c3c0 con 0x5586fc1235e0 2024-09-22T08:36:47.915 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.905+0000 7fa1c6b70640 1 -- 172.21.15.142:0/2545471878 <== osd.1 v2:172.21.15.142:6816/3192108003 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa1b002b040 con 0x5586fc1235e0 2024-09-22T08:36:47.915 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.905+0000 7fa1c6b70640 1 -- 172.21.15.142:0/2545471878 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5586fc12c3c0 con 0x7fa1c0021020 2024-09-22T08:36:47.915 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.905+0000 7fa1c7371640 1 -- 172.21.15.142:0/2545471878 <== osd.2 v2:172.21.15.142:6808/279438927 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fa1b80a2040 con 0x7fa1c0021020 2024-09-22T08:36:47.915 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.905+0000 7fa1c7371640 1 -- 172.21.15.142:0/2545471878 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5586fc12c3c0 con 0x5586fc127ee0 2024-09-22T08:36:47.915 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.906+0000 7fa1c7b72640 1 -- 172.21.15.142:0/2545471878 <== osd.3 v2:172.21.15.142:6800/1064901393 4 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa1c003b070 con 0x5586fc127ee0 2024-09-22T08:36:47.916 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.906+0000 7fa1c7b72640 1 -- 172.21.15.142:0/2545471878 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5586fc12c3c0 con 0x5586fc127ee0 2024-09-22T08:36:47.916 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.906+0000 7fa1c7b72640 1 -- 172.21.15.142:0/2545471878 <== osd.3 v2:172.21.15.142:6800/1064901393 5 ==== osd_op_reply(20 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fa1c003b070 con 0x5586fc127ee0 2024-09-22T08:36:47.916 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.906+0000 7fa1c7b72640 1 -- 172.21.15.142:0/2545471878 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5586fc12c3c0 con 0x7fa1b80a5040 2024-09-22T08:36:47.916 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.906+0000 7fa1c6b70640 1 -- 172.21.15.142:0/2545471878 <== osd.0 v2:172.21.15.31:6800/168281188 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa1b002b040 con 0x7fa1b80a5040 2024-09-22T08:36:47.916 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.906+0000 7fa1c6b70640 1 -- 172.21.15.142:0/2545471878 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5586fc12c3c0 con 0x5586fc127ee0 2024-09-22T08:36:47.916 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.907+0000 7fa1c7b72640 1 -- 172.21.15.142:0/2545471878 <== osd.3 v2:172.21.15.142:6800/1064901393 6 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa1c003b070 con 0x5586fc127ee0 2024-09-22T08:36:47.916 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.907+0000 7fa1c7b72640 1 -- 172.21.15.142:0/2545471878 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5586fc12c3c0 con 0x5586fc127ee0 2024-09-22T08:36:47.916 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.907+0000 7fa1c7b72640 1 -- 172.21.15.142:0/2545471878 <== osd.3 v2:172.21.15.142:6800/1064901393 7 ==== osd_op_reply(23 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fa1c003b070 con 0x5586fc127ee0 2024-09-22T08:36:47.916 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.907+0000 7fa1c7b72640 1 -- 172.21.15.142:0/2545471878 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5586fc12c3c0 con 0x5586fc1235e0 2024-09-22T08:36:47.916 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.907+0000 7fa1c6b70640 1 -- 172.21.15.142:0/2545471878 <== osd.1 v2:172.21.15.142:6816/3192108003 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa1b002b040 con 0x5586fc1235e0 2024-09-22T08:36:47.916 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.907+0000 7fa1c6b70640 1 -- 172.21.15.142:0/2545471878 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5586fc12c3c0 con 0x5586fc1235e0 2024-09-22T08:36:47.916 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.907+0000 7fa1c6b70640 1 -- 172.21.15.142:0/2545471878 <== osd.1 v2:172.21.15.142:6816/3192108003 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fa1b002b040 con 0x5586fc1235e0 2024-09-22T08:36:47.916 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.907+0000 7fa1c6b70640 1 -- 172.21.15.142:0/2545471878 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5586fc12c3c0 con 0x7fa1b80a5040 2024-09-22T08:36:47.916 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.908+0000 7fa1c6b70640 1 -- 172.21.15.142:0/2545471878 <== osd.0 v2:172.21.15.31:6800/168281188 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa1b002b040 con 0x7fa1b80a5040 2024-09-22T08:36:47.917 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.908+0000 7fa1c6b70640 1 -- 172.21.15.142:0/2545471878 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5586fc12c3c0 con 0x5586fc127ee0 2024-09-22T08:36:47.917 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.908+0000 7fa1c7b72640 1 -- 172.21.15.142:0/2545471878 <== osd.3 v2:172.21.15.142:6800/1064901393 8 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa1c003b070 con 0x5586fc127ee0 2024-09-22T08:36:47.917 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.908+0000 7fa1c7b72640 1 -- 172.21.15.142:0/2545471878 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fa1c0064040 con 0x7fa1c0021020 2024-09-22T08:36:47.917 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.908+0000 7fa1c7371640 1 -- 172.21.15.142:0/2545471878 <== osd.2 v2:172.21.15.142:6808/279438927 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa1b80a2040 con 0x7fa1c0021020 2024-09-22T08:36:47.917 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.908+0000 7fa1c7371640 1 -- 172.21.15.142:0/2545471878 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fa1c0064040 con 0x5586fc1235e0 2024-09-22T08:36:47.917 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.908+0000 7fa1c6b70640 1 -- 172.21.15.142:0/2545471878 <== osd.1 v2:172.21.15.142:6816/3192108003 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa1b002b040 con 0x5586fc1235e0 2024-09-22T08:36:47.917 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.908+0000 7fa1c6b70640 1 -- 172.21.15.142:0/2545471878 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fa1c0064040 con 0x7fa1b80a5040 2024-09-22T08:36:47.917 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.909+0000 7fa1c6b70640 1 -- 172.21.15.142:0/2545471878 <== osd.0 v2:172.21.15.31:6800/168281188 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa1b003b040 con 0x7fa1b80a5040 2024-09-22T08:36:47.917 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.909+0000 7fa1c6b70640 1 -- 172.21.15.142:0/2545471878 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fa1c0064040 con 0x5586fc127ee0 2024-09-22T08:36:47.917 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.909+0000 7fa1c7b72640 1 -- 172.21.15.142:0/2545471878 <== osd.3 v2:172.21.15.142:6800/1064901393 9 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa1c003b070 con 0x5586fc127ee0 2024-09-22T08:36:47.917 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.909+0000 7fa1c7b72640 1 -- 172.21.15.142:0/2545471878 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fa1c0064040 con 0x7fa1b80a5040 2024-09-22T08:36:47.917 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.909+0000 7fa1c6b70640 1 -- 172.21.15.142:0/2545471878 <== osd.0 v2:172.21.15.31:6800/168281188 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa1b003b040 con 0x7fa1b80a5040 2024-09-22T08:36:47.917 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.909+0000 7fa1c6b70640 1 -- 172.21.15.142:0/2545471878 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fa1c0064040 con 0x7fa1c0021020 2024-09-22T08:36:47.917 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.909+0000 7fa1c7371640 1 -- 172.21.15.142:0/2545471878 <== osd.2 v2:172.21.15.142:6808/279438927 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa1b80a2040 con 0x7fa1c0021020 2024-09-22T08:36:47.918 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.909+0000 7fa1c7371640 1 -- 172.21.15.142:0/2545471878 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fa1c0064040 con 0x5586fc127ee0 2024-09-22T08:36:47.918 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.909+0000 7fa1c7b72640 1 -- 172.21.15.142:0/2545471878 <== osd.3 v2:172.21.15.142:6800/1064901393 10 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa1c003b070 con 0x5586fc127ee0 2024-09-22T08:36:47.918 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.910+0000 7fa1c7b72640 1 -- 172.21.15.142:0/2545471878 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fa1c0064040 con 0x7fa1b80a5040 2024-09-22T08:36:47.918 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.910+0000 7fa1c6b70640 1 -- 172.21.15.142:0/2545471878 <== osd.0 v2:172.21.15.31:6800/168281188 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa1b003b040 con 0x7fa1b80a5040 2024-09-22T08:36:47.918 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.910+0000 7fa1c6b70640 1 -- 172.21.15.142:0/2545471878 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fa1c0064040 con 0x5586fc1235e0 2024-09-22T08:36:47.923 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.910+0000 7fa1c6b70640 1 -- 172.21.15.142:0/2545471878 <== osd.1 v2:172.21.15.142:6816/3192108003 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fa1b003b040 con 0x5586fc1235e0 2024-09-22T08:36:47.923 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.910+0000 7fa1c6b70640 1 -- 172.21.15.142:0/2545471878 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fa1c0064040 con 0x7fa1c0021020 2024-09-22T08:36:47.923 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.910+0000 7fa1c7371640 1 -- 172.21.15.142:0/2545471878 <== osd.2 v2:172.21.15.142:6808/279438927 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa1b80a2040 con 0x7fa1c0021020 2024-09-22T08:36:47.923 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.910+0000 7fa1c9887800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:36:47.923 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.910+0000 7fa1c9887800 20 RGWRados::pool_iterate: got zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec 2024-09-22T08:36:47.923 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.910+0000 7fa1c9887800 20 RGWRados::pool_iterate: got zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f 2024-09-22T08:36:47.923 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.910+0000 7fa1c9887800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:36:47.923 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.910+0000 7fa1c9887800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:36:47.924 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.910+0000 7fa1c9887800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:36:47.924 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.910+0000 7fa1c9887800 20 rados->read ofs=0 len=0 2024-09-22T08:36:47.924 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.910+0000 7fa1c9887800 1 -- 172.21.15.142:0/2545471878 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5586fc12b390 con 0x5586fc1235e0 2024-09-22T08:36:47.924 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.911+0000 7fa1c6b70640 1 -- 172.21.15.142:0/2545471878 <== osd.1 v2:172.21.15.142:6816/3192108003 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa1b003b040 con 0x5586fc1235e0 2024-09-22T08:36:47.924 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.911+0000 7fa1c9887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:47.924 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.911+0000 7fa1c9887800 20 rados->read ofs=0 len=0 2024-09-22T08:36:47.924 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.911+0000 7fa1c9887800 1 -- 172.21.15.142:0/2545471878 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5586fc12b780 con 0x5586fc1235e0 2024-09-22T08:36:47.924 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.911+0000 7fa1c6b70640 1 -- 172.21.15.142:0/2545471878 <== osd.1 v2:172.21.15.142:6816/3192108003 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa1b003b040 con 0x5586fc1235e0 2024-09-22T08:36:47.924 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.911+0000 7fa1c9887800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:36:47.924 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.911+0000 7fa1c9887800 20 rados->read ofs=0 len=0 2024-09-22T08:36:47.924 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.911+0000 7fa1c9887800 1 -- 172.21.15.142:0/2545471878 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:40 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5586fc12bba0 con 0x5586fc127ee0 2024-09-22T08:36:47.924 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.911+0000 7fa1c7b72640 1 -- 172.21.15.142:0/2545471878 <== osd.3 v2:172.21.15.142:6800/1064901393 11 ==== osd_op_reply(40 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fa1c003b070 con 0x5586fc127ee0 2024-09-22T08:36:47.924 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.911+0000 7fa1c9887800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:36:47.925 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.911+0000 7fa1c9887800 20 zone default found 2024-09-22T08:36:47.925 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.911+0000 7fa1c9887800 4 Realm: () 2024-09-22T08:36:47.925 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.911+0000 7fa1c9887800 4 ZoneGroup: default (d89f6f57-1007-47dd-9065-f486c7b01aec) 2024-09-22T08:36:47.925 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.911+0000 7fa1c9887800 4 Zone: default (e239248c-0bee-4e41-803a-24b288d3eb8f) 2024-09-22T08:36:47.925 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.911+0000 7fa1c9887800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:36:47.925 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.911+0000 7fa1c9887800 20 zonegroup default 2024-09-22T08:36:47.925 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.911+0000 7fa1c9887800 20 rados->read ofs=0 len=0 2024-09-22T08:36:47.925 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.911+0000 7fa1c9887800 1 -- 172.21.15.142:0/2545471878 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5586fc12c890 con 0x7fa1b80a5040 2024-09-22T08:36:47.925 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.911+0000 7fa1c6b70640 1 -- 172.21.15.142:0/2545471878 <== osd.0 v2:172.21.15.31:6800/168281188 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fa1b003b040 con 0x7fa1b80a5040 2024-09-22T08:36:47.925 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.911+0000 7fa1c9887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:47.925 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.911+0000 7fa1c9887800 20 rados->read ofs=0 len=0 2024-09-22T08:36:47.925 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.911+0000 7fa1c9887800 1 -- 172.21.15.142:0/2545471878 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5586fc12e730 con 0x5586fc127ee0 2024-09-22T08:36:47.925 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.912+0000 7fa1c7b72640 1 -- 172.21.15.142:0/2545471878 <== osd.3 v2:172.21.15.142:6800/1064901393 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa1c003b070 con 0x5586fc127ee0 2024-09-22T08:36:47.926 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.912+0000 7fa1c9887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:47.926 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.912+0000 7fa1c9887800 20 rados->read ofs=0 len=0 2024-09-22T08:36:47.926 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.912+0000 7fa1c9887800 1 -- 172.21.15.142:0/2545471878 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5586fc12e730 con 0x5586fc127ee0 2024-09-22T08:36:47.926 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.912+0000 7fa1c7b72640 1 -- 172.21.15.142:0/2545471878 <== osd.3 v2:172.21.15.142:6800/1064901393 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa1c003b070 con 0x5586fc127ee0 2024-09-22T08:36:47.926 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.912+0000 7fa1c9887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:47.926 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.912+0000 7fa1c9887800 20 started sync module instance, tier type = 2024-09-22T08:36:47.926 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.912+0000 7fa1c9887800 20 started zone id=e239248c-0bee-4e41-803a-24b288d3eb8f (name=default) with tier type = 2024-09-22T08:36:47.926 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.912+0000 7fa1c9887800 1 -- 172.21.15.142:0/2545471878 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5586fc12db70 con 0x7fa1c0021020 2024-09-22T08:36:47.926 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.913+0000 7fa1c7371640 1 -- 172.21.15.142:0/2545471878 <== osd.2 v2:172.21.15.142:6808/279438927 7 ==== osd_op_reply(44 notify.0 [create] v30'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa1b80a2040 con 0x7fa1c0021020 2024-09-22T08:36:47.926 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.913+0000 7fa1c9887800 1 -- 172.21.15.142:0/2545471878 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94038243071680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5586fc12e4e0 con 0x7fa1c0021020 2024-09-22T08:36:47.926 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.913+0000 7fa1c9887800 1 -- 172.21.15.142:0/2545471878 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5586fc12f000 con 0x5586fc1235e0 2024-09-22T08:36:47.926 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.914+0000 7fa1c7371640 1 -- 172.21.15.142:0/2545471878 <== osd.2 v2:172.21.15.142:6808/279438927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94038243071680] v30'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa1b80a2040 con 0x7fa1c0021020 2024-09-22T08:36:47.926 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.914+0000 7fa1c6b70640 1 -- 172.21.15.142:0/2545471878 <== osd.1 v2:172.21.15.142:6816/3192108003 15 ==== osd_op_reply(46 notify.1 [create] v30'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa1b003b040 con 0x5586fc1235e0 2024-09-22T08:36:47.927 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.914+0000 7fa1c9887800 1 -- 172.21.15.142:0/2545471878 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94038243076816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5586fc12f3f0 con 0x5586fc1235e0 2024-09-22T08:36:47.927 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.914+0000 7fa1c9887800 1 -- 172.21.15.142:0/2545471878 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5586fc12fdf0 con 0x5586fc127ee0 2024-09-22T08:36:47.927 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.915+0000 7fa1c6b70640 1 -- 172.21.15.142:0/2545471878 <== osd.1 v2:172.21.15.142:6816/3192108003 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94038243076816] v30'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa1b003b040 con 0x5586fc1235e0 2024-09-22T08:36:47.927 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.916+0000 7fa1c7b72640 1 -- 172.21.15.142:0/2545471878 <== osd.3 v2:172.21.15.142:6800/1064901393 14 ==== osd_op_reply(48 notify.2 [create] v30'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa1c003b070 con 0x5586fc127ee0 2024-09-22T08:36:47.927 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.916+0000 7fa1c9887800 1 -- 172.21.15.142:0/2545471878 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94038243073872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5586fc12fdb0 con 0x5586fc127ee0 2024-09-22T08:36:47.927 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.916+0000 7fa1c9887800 1 -- 172.21.15.142:0/2545471878 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5586fc1308a0 con 0x7fa1c0021020 2024-09-22T08:36:47.927 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.917+0000 7fa1c7371640 1 -- 172.21.15.142:0/2545471878 <== osd.2 v2:172.21.15.142:6808/279438927 9 ==== osd_op_reply(50 notify.3 [create] v30'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa1b80a2040 con 0x7fa1c0021020 2024-09-22T08:36:47.927 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.917+0000 7fa1c9887800 1 -- 172.21.15.142:0/2545471878 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94038243083184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5586fc131140 con 0x7fa1c0021020 2024-09-22T08:36:47.927 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.917+0000 7fa1c9887800 1 -- 172.21.15.142:0/2545471878 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5586fc131c60 con 0x5586fc1235e0 2024-09-22T08:36:47.927 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.917+0000 7fa1c7b72640 1 -- 172.21.15.142:0/2545471878 <== osd.3 v2:172.21.15.142:6800/1064901393 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94038243073872] v30'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa1c003b070 con 0x5586fc127ee0 2024-09-22T08:36:47.927 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.918+0000 7fa1c6b70640 1 -- 172.21.15.142:0/2545471878 <== osd.1 v2:172.21.15.142:6816/3192108003 17 ==== osd_op_reply(52 notify.4 [create] v30'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa1b003b040 con 0x5586fc1235e0 2024-09-22T08:36:47.927 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.918+0000 7fa1c9887800 1 -- 172.21.15.142:0/2545471878 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94038243088176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5586fc131c20 con 0x5586fc1235e0 2024-09-22T08:36:47.927 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.918+0000 7fa1c7371640 1 -- 172.21.15.142:0/2545471878 <== osd.2 v2:172.21.15.142:6808/279438927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94038243083184] v30'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa1b80a2040 con 0x7fa1c0021020 2024-09-22T08:36:47.927 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.918+0000 7fa1c9887800 1 -- 172.21.15.142:0/2545471878 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5586fc1326e0 con 0x7fa1b80a5040 2024-09-22T08:36:47.928 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.919+0000 7fa1c6b70640 1 -- 172.21.15.142:0/2545471878 <== osd.1 v2:172.21.15.142:6816/3192108003 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94038243088176] v30'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa1b003b040 con 0x5586fc1235e0 2024-09-22T08:36:47.928 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.919+0000 7fa1c6b70640 1 -- 172.21.15.142:0/2545471878 <== osd.0 v2:172.21.15.31:6800/168281188 11 ==== osd_op_reply(54 notify.5 [create] v30'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa1b003b040 con 0x7fa1b80a5040 2024-09-22T08:36:47.928 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.919+0000 7fa1c9887800 1 -- 172.21.15.142:0/2545471878 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94038243080448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5586fc1326e0 con 0x7fa1b80a5040 2024-09-22T08:36:47.928 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.919+0000 7fa1c9887800 1 -- 172.21.15.142:0/2545471878 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5586fc132b30 con 0x7fa1b80a5040 2024-09-22T08:36:47.928 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.920+0000 7fa1c6b70640 1 -- 172.21.15.142:0/2545471878 <== osd.0 v2:172.21.15.31:6800/168281188 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94038243080448] v30'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa1b003b040 con 0x7fa1b80a5040 2024-09-22T08:36:47.928 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.920+0000 7fa1c6b70640 1 -- 172.21.15.142:0/2545471878 <== osd.0 v2:172.21.15.31:6800/168281188 13 ==== osd_op_reply(56 notify.6 [create] v30'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa1b003b040 con 0x7fa1b80a5040 2024-09-22T08:36:47.928 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.920+0000 7fa1c9887800 1 -- 172.21.15.142:0/2545471878 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94038243085456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5586fc132af0 con 0x7fa1b80a5040 2024-09-22T08:36:47.928 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.920+0000 7fa1c9887800 1 -- 172.21.15.142:0/2545471878 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5586fc1334f0 con 0x7fa1b80a5040 2024-09-22T08:36:47.928 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.921+0000 7fa1c6b70640 1 -- 172.21.15.142:0/2545471878 <== osd.0 v2:172.21.15.31:6800/168281188 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94038243085456] v30'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa1b003b040 con 0x7fa1b80a5040 2024-09-22T08:36:47.928 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.922+0000 7fa1c6b70640 1 -- 172.21.15.142:0/2545471878 <== osd.0 v2:172.21.15.31:6800/168281188 15 ==== osd_op_reply(58 notify.7 [create] v30'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa1b003b040 con 0x7fa1b80a5040 2024-09-22T08:36:47.928 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.922+0000 7fa1c9887800 1 -- 172.21.15.142:0/2545471878 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94038243090928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5586fc1334b0 con 0x7fa1b80a5040 2024-09-22T08:36:47.928 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.922+0000 7fa1c9887800 20 add_watcher() i=0 2024-09-22T08:36:47.928 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.922+0000 7fa1c9887800 20 add_watcher() i=1 2024-09-22T08:36:47.929 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.922+0000 7fa1c9887800 20 add_watcher() i=2 2024-09-22T08:36:47.929 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.922+0000 7fa1c9887800 20 add_watcher() i=3 2024-09-22T08:36:47.929 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.922+0000 7fa1c9887800 20 add_watcher() i=4 2024-09-22T08:36:47.929 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.922+0000 7fa1c9887800 20 add_watcher() i=5 2024-09-22T08:36:47.929 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.922+0000 7fa1c9887800 20 add_watcher() i=6 2024-09-22T08:36:47.932 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.923+0000 7fa1c6b70640 1 -- 172.21.15.142:0/2545471878 <== osd.0 v2:172.21.15.31:6800/168281188 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94038243090928] v30'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa1b003b040 con 0x7fa1b80a5040 2024-09-22T08:36:47.932 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.923+0000 7fa1c9887800 20 add_watcher() i=7 2024-09-22T08:36:47.932 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.923+0000 7fa1c9887800 2 all 8 watchers are set, enabling cache 2024-09-22T08:36:47.932 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.923+0000 7fa1c9887800 1 -- 172.21.15.142:0/2545471878 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5586fc136a30 con 0x5586fc1235e0 2024-09-22T08:36:47.932 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.923+0000 7fa1c6b70640 1 -- 172.21.15.142:0/2545471878 <== osd.1 v2:172.21.15.142:6816/3192108003 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fa1b003b040 con 0x5586fc1235e0 2024-09-22T08:36:47.932 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.923+0000 7fa1c9887800 1 -- 172.21.15.142:0/2545471878 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94038243095456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5586fc133dc0 con 0x5586fc1235e0 2024-09-22T08:36:47.932 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.924+0000 7fa1c6b70640 1 -- 172.21.15.142:0/2545471878 <== osd.1 v2:172.21.15.142:6816/3192108003 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94038243095456] v30'130 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa1b003b040 con 0x5586fc1235e0 2024-09-22T08:36:47.932 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.924+0000 7fa07dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:36:47.932 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.924+0000 7fa1c9887800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:36:47.932 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.924+0000 7fa1c9887800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:36:47.933 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.924+0000 7fa1c9887800 5 note: GC not initialized 2024-09-22T08:36:47.933 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.924+0000 7fa07cfe1640 20 reqs_thread_entry: start 2024-09-22T08:36:47.933 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.925+0000 7fa1c9887800 20 init_complete bucket index max shards: 11 2024-09-22T08:36:47.933 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.925+0000 7fa1c9887800 20 Filter name: none 2024-09-22T08:36:47.933 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.925+0000 7f9ff67fc640 20 reqs_thread_entry: start 2024-09-22T08:36:47.933 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.925+0000 7fa1c9887800 20 rados->read ofs=0 len=0 2024-09-22T08:36:47.933 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.925+0000 7fa1c9887800 1 -- 172.21.15.142:0/2545471878 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:62 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5586fc1698f0 con 0x5586fc1235e0 2024-09-22T08:36:47.933 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.925+0000 7fa1c6b70640 1 -- 172.21.15.142:0/2545471878 <== osd.1 v2:172.21.15.142:6816/3192108003 21 ==== osd_op_reply(62 testx/myfoo [call out=48b,stat out=16b,read 0~193 out=193b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 281+0+332 (crc 0 0 0) 0x7fa1b003b040 con 0x5586fc1235e0 2024-09-22T08:36:47.933 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.925+0000 7fa1c9887800 20 rados_obj.operate() r=0 bl.length=193 2024-09-22T08:36:47.933 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.926+0000 7fa07dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:36:47.933 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.926+0000 7fa1c9887800 1 -- 172.21.15.142:0/2545471878 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94038243095456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5586fc135740 con 0x5586fc1235e0 2024-09-22T08:36:47.933 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.927+0000 7fa1c6b70640 1 -- 172.21.15.142:0/2545471878 <== osd.1 v2:172.21.15.142:6816/3192108003 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94038243095456] v30'131 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa1b003b040 con 0x5586fc1235e0 2024-09-22T08:36:47.933 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.927+0000 7fa1c9887800 1 -- 172.21.15.142:0/2545471878 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94038243071680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5586fc167740 con 0x7fa1c0021020 2024-09-22T08:36:47.934 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.928+0000 7fa1c7371640 1 -- 172.21.15.142:0/2545471878 <== osd.2 v2:172.21.15.142:6808/279438927 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94038243071680] v30'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa1b80a2040 con 0x7fa1c0021020 2024-09-22T08:36:47.934 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.928+0000 7fa1c9887800 20 remove_watcher() i=0 2024-09-22T08:36:47.934 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.928+0000 7fa1c9887800 2 removed watcher, disabling cache 2024-09-22T08:36:47.934 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.928+0000 7fa1c9887800 1 -- 172.21.15.142:0/2545471878 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94038243076816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5586fc167740 con 0x5586fc1235e0 2024-09-22T08:36:47.934 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.929+0000 7fa1c6b70640 1 -- 172.21.15.142:0/2545471878 <== osd.1 v2:172.21.15.142:6816/3192108003 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94038243076816] v30'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa1b003b040 con 0x5586fc1235e0 2024-09-22T08:36:47.934 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.929+0000 7fa1c9887800 20 remove_watcher() i=1 2024-09-22T08:36:47.934 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.929+0000 7fa1c9887800 1 -- 172.21.15.142:0/2545471878 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94038243073872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5586fc167740 con 0x5586fc127ee0 2024-09-22T08:36:47.934 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.930+0000 7fa1c7b72640 1 -- 172.21.15.142:0/2545471878 <== osd.3 v2:172.21.15.142:6800/1064901393 16 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94038243073872] v30'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa1c003b070 con 0x5586fc127ee0 2024-09-22T08:36:47.934 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.930+0000 7fa1c9887800 20 remove_watcher() i=2 2024-09-22T08:36:47.934 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.930+0000 7fa1c9887800 1 -- 172.21.15.142:0/2545471878 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94038243083184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5586fc167740 con 0x7fa1c0021020 2024-09-22T08:36:47.935 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.931+0000 7fa1c7371640 1 -- 172.21.15.142:0/2545471878 <== osd.2 v2:172.21.15.142:6808/279438927 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94038243083184] v30'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa1b80a2040 con 0x7fa1c0021020 2024-09-22T08:36:47.935 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.931+0000 7fa1c9887800 20 remove_watcher() i=3 2024-09-22T08:36:47.935 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.931+0000 7fa1c9887800 1 -- 172.21.15.142:0/2545471878 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94038243088176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5586fc167740 con 0x5586fc1235e0 2024-09-22T08:36:47.936 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.933+0000 7fa1c6b70640 1 -- 172.21.15.142:0/2545471878 <== osd.1 v2:172.21.15.142:6816/3192108003 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94038243088176] v30'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa1b003b040 con 0x5586fc1235e0 2024-09-22T08:36:47.936 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.933+0000 7fa1c9887800 20 remove_watcher() i=4 2024-09-22T08:36:47.936 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.933+0000 7fa1c9887800 1 -- 172.21.15.142:0/2545471878 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94038243080448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5586fc167740 con 0x7fa1b80a5040 2024-09-22T08:36:47.936 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.934+0000 7fa1c6b70640 1 -- 172.21.15.142:0/2545471878 <== osd.0 v2:172.21.15.31:6800/168281188 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94038243080448] v30'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa1b003b040 con 0x7fa1b80a5040 2024-09-22T08:36:47.936 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.934+0000 7fa1c9887800 20 remove_watcher() i=5 2024-09-22T08:36:47.936 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.934+0000 7fa1c9887800 1 -- 172.21.15.142:0/2545471878 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94038243085456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5586fc167740 con 0x7fa1b80a5040 2024-09-22T08:36:47.939 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.935+0000 7fa1c6b70640 1 -- 172.21.15.142:0/2545471878 <== osd.0 v2:172.21.15.31:6800/168281188 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94038243085456] v30'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa1b003b040 con 0x7fa1b80a5040 2024-09-22T08:36:47.939 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.935+0000 7fa1c9887800 20 remove_watcher() i=6 2024-09-22T08:36:47.939 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.935+0000 7fa1c9887800 1 -- 172.21.15.142:0/2545471878 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94038243090928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5586fc167740 con 0x7fa1b80a5040 2024-09-22T08:36:47.939 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.936+0000 7fa1c6b70640 1 -- 172.21.15.142:0/2545471878 <== osd.0 v2:172.21.15.31:6800/168281188 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94038243090928] v30'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa1b003b040 con 0x7fa1b80a5040 2024-09-22T08:36:47.939 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.936+0000 7fa1c9887800 20 remove_watcher() i=7 2024-09-22T08:36:47.939 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.936+0000 7fa1c9887800 1 -- 172.21.15.142:0/2545471878 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7fa1b80a5040 msgr2=0x7fa1b8056910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:47.939 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.936+0000 7fa1c9887800 1 --2- 172.21.15.142:0/2545471878 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7fa1b80a5040 0x7fa1b8056910 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:47.939 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.936+0000 7fa1c9887800 1 -- 172.21.15.142:0/2545471878 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5586fc1235e0 msgr2=0x5586fc125aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:47.939 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.936+0000 7fa1c9887800 1 --2- 172.21.15.142:0/2545471878 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5586fc1235e0 0x5586fc125aa0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:47.939 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.936+0000 7fa1c9887800 1 -- 172.21.15.142:0/2545471878 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7fa1c0021020 msgr2=0x7fa1c0004280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:47.940 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.936+0000 7fa1c9887800 1 --2- 172.21.15.142:0/2545471878 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7fa1c0021020 0x7fa1c0004280 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:47.940 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.936+0000 7fa1c9887800 1 -- 172.21.15.142:0/2545471878 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5586fc127ee0 msgr2=0x5586fc12a2d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:47.940 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.936+0000 7fa1c9887800 1 --2- 172.21.15.142:0/2545471878 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5586fc127ee0 0x5586fc12a2d0 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:47.940 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.936+0000 7fa1c9887800 1 -- 172.21.15.142:0/2545471878 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fa09003d000 msgr2=0x7fa09003f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:47.940 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.936+0000 7fa1c9887800 1 --2- 172.21.15.142:0/2545471878 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fa09003d000 0x7fa09003f4c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fa1b80973e0 tx=0x7fa1b8088000 comp rx=0 tx=0).stop 2024-09-22T08:36:47.940 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.936+0000 7fa1c9887800 1 -- 172.21.15.142:0/2545471878 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5586fc110740 msgr2=0x5586fc117d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:47.940 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.936+0000 7fa1c6b70640 1 -- 172.21.15.142:0/2545471878 reap_dead start 2024-09-22T08:36:47.940 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.936+0000 7fa1c9887800 1 --2- 172.21.15.142:0/2545471878 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5586fc110740 0x5586fc117d10 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fa1c0028fd0 tx=0x7fa1c0053da0 comp rx=0 tx=0).stop 2024-09-22T08:36:47.940 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.936+0000 7fa1c9887800 1 -- 172.21.15.142:0/2545471878 shutdown_connections 2024-09-22T08:36:47.940 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.936+0000 7fa1c9887800 1 --2- 172.21.15.142:0/2545471878 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5586fc110740 0x5586fc117d10 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:47.940 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.936+0000 7fa1c9887800 1 -- 172.21.15.142:0/2545471878 >> 172.21.15.142:0/2545471878 conn(0x5586fc10cb40 msgr2=0x5586fc10ad50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:47.940 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.936+0000 7fa1c9887800 1 -- 172.21.15.142:0/2545471878 shutdown_connections 2024-09-22T08:36:47.940 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.936+0000 7fa1c9887800 1 -- 172.21.15.142:0/2545471878 wait complete. 2024-09-22T08:36:47.940 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.936+0000 7fa1c9887800 1 -- 172.21.15.142:0/3248429164 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fa0a003cfb0 msgr2=0x7fa0a003f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:47.941 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.936+0000 7fa1c9887800 1 --2- 172.21.15.142:0/3248429164 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fa0a003cfb0 0x7fa0a003f470 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fa1b8097180 tx=0x7fa1b8061db0 comp rx=0 tx=0).stop 2024-09-22T08:36:47.941 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.936+0000 7fa1c9887800 1 -- 172.21.15.142:0/3248429164 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5586fc103d00 msgr2=0x5586fc104120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:47.941 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.936+0000 7fa1c9887800 1 --2- 172.21.15.142:0/3248429164 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5586fc103d00 0x5586fc104120 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x5586fc0ea310 tx=0x7fa1c000bf30 comp rx=0 tx=0).stop 2024-09-22T08:36:47.941 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.936+0000 7fa1c9887800 1 -- 172.21.15.142:0/3248429164 shutdown_connections 2024-09-22T08:36:47.941 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.936+0000 7fa1c9887800 1 --2- 172.21.15.142:0/3248429164 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fa0a003cfb0 0x7fa0a003f470 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:47.941 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.936+0000 7fa1c9887800 1 --2- 172.21.15.142:0/3248429164 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5586fc103d00 0x5586fc104120 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:47.941 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.936+0000 7fa1c9887800 1 -- 172.21.15.142:0/3248429164 >> 172.21.15.142:0/3248429164 conn(0x5586fc0f80b0 msgr2=0x5586fc0f8490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:47.941 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.936+0000 7fa1c9887800 1 -- 172.21.15.142:0/3248429164 shutdown_connections 2024-09-22T08:36:47.941 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.936+0000 7fa1c9887800 1 -- 172.21.15.142:0/3248429164 wait complete. 2024-09-22T08:36:47.941 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.937+0000 7fa1c9887800 1 -- 172.21.15.142:0/3709297448 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5586fbff4c50 msgr2=0x5586fc0f0370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:47.941 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.937+0000 7fa1c9887800 1 --2- 172.21.15.142:0/3709297448 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5586fbff4c50 0x5586fc0f0370 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:47.941 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.937+0000 7fa1c9887800 1 -- 172.21.15.142:0/3709297448 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5586fc0f2700 msgr2=0x5586fc0f4ba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:47.941 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.937+0000 7fa1c9887800 1 --2- 172.21.15.142:0/3709297448 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5586fc0f2700 0x5586fc0f4ba0 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:47.941 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.937+0000 7fa1c9887800 1 -- 172.21.15.142:0/3709297448 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fa0ac03cfb0 msgr2=0x7fa0ac03f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:47.942 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.937+0000 7fa1c9887800 1 --2- 172.21.15.142:0/3709297448 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fa0ac03cfb0 0x7fa0ac03f470 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fa1b0001e30 tx=0x7fa1b0001390 comp rx=0 tx=0).stop 2024-09-22T08:36:47.942 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.937+0000 7fa1c9887800 1 -- 172.21.15.142:0/3709297448 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5586fbfedbe0 msgr2=0x5586fc0e8d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:47.942 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.937+0000 7fa1c9887800 1 --2- 172.21.15.142:0/3709297448 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5586fbfedbe0 0x5586fc0e8d20 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fa1b8063040 tx=0x7fa1b8003330 comp rx=0 tx=0).stop 2024-09-22T08:36:47.942 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.937+0000 7fa1c9887800 1 -- 172.21.15.142:0/3709297448 shutdown_connections 2024-09-22T08:36:47.942 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.937+0000 7fa1c9887800 1 --2- 172.21.15.142:0/3709297448 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5586fc0f2700 0x5586fc0f4ba0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:47.942 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.937+0000 7fa1c9887800 1 --2- 172.21.15.142:0/3709297448 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5586fbff4c50 0x5586fc0f0370 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:47.942 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.937+0000 7fa1c9887800 1 --2- 172.21.15.142:0/3709297448 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fa0ac03cfb0 0x7fa0ac03f470 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:47.942 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.937+0000 7fa1c9887800 1 --2- 172.21.15.142:0/3709297448 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5586fbfedbe0 0x5586fc0e8d20 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:47.942 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.937+0000 7fa1c9887800 1 -- 172.21.15.142:0/3709297448 >> 172.21.15.142:0/3709297448 conn(0x5586fbfe9310 msgr2=0x5586fc0e26a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:47.942 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.937+0000 7fa1c9887800 1 -- 172.21.15.142:0/3709297448 shutdown_connections 2024-09-22T08:36:47.942 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:47.937+0000 7fa1c9887800 1 -- 172.21.15.142:0/3709297448 wait complete. 2024-09-22T08:36:47.947 INFO:teuthology.orchestra.run.smithi142.stdout:{"key":"bucket:testx/myfoo","ver":{"tag":"POoi/jMB5gYlR5cZ2jDwxVs0","ver":2},"mtime":"2024-09-22T08:36:47.798349Z","data":{"bucket":{"name":"myfoo","marker":"e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1","bucket_id":"e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1","tenant":"testx","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""}},"owner":"testx$tenanteduser","creation_time":"2024-09-22T08:36:45.359780Z","linked":true,"has_bucket_info":false}} 2024-09-22T08:36:47.947 DEBUG:tasks.util.rgw: json result: {'key': 'bucket:testx/myfoo', 'ver': {'tag': 'POoi/jMB5gYlR5cZ2jDwxVs0', 'ver': 2}, 'mtime': '2024-09-22T08:36:47.798349Z', 'data': {'bucket': {'name': 'myfoo', 'marker': 'e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1', 'bucket_id': 'e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1', 'tenant': 'testx', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}}, 'owner': 'testx$tenanteduser', 'creation_time': '2024-09-22T08:36:45.359780Z', 'linked': True, 'has_bucket_info': False}} 2024-09-22T08:36:47.947 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--bucket', 'testx/myfoo', '--uid', 'foo'] 2024-09-22T08:36:47.947 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--bucket', 'testx/myfoo', '--uid', 'foo'] 2024-09-22T08:36:47.947 DEBUG:teuthology.orchestra.run.smithi142:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --bucket testx/myfoo --uid foo 2024-09-22T08:36:48.034 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:36:48.034 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:36:48.035 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.034+0000 7f2b19b24800 1 Processor -- start 2024-09-22T08:36:48.035 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.034+0000 7f2b19b24800 1 -- start start 2024-09-22T08:36:48.036 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.034+0000 7f2b19b24800 1 --2- >> v2:172.21.15.31:3300/0 conn(0x557c293b5da0 0x557c293b8190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:48.036 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.034+0000 7f2b19b24800 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x557c29241a20 con 0x557c293b8700 2024-09-22T08:36:48.036 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.034+0000 7f2b19b24800 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x557c292417d0 con 0x557c293b5da0 2024-09-22T08:36:48.036 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.034+0000 7f2b157d2640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x557c293b5da0 0x557c293b8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:48.036 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.034+0000 7f2b14fd1640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x557c293b8700 0x557c293babc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.142:42636/0 (socket says 172.21.15.142:42636) 2024-09-22T08:36:48.036 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.034+0000 7f2b14fd1640 1 -- 172.21.15.142:0/1502770309 learned_addr learned my addr 172.21.15.142:0/1502770309 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-09-22T08:36:48.036 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.034+0000 7f2b157d2640 1 -- 172.21.15.142:0/1502770309 >> v1:172.21.15.31:6789/0 conn(0x557c293b8700 legacy=0x557c293babc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:48.036 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.034+0000 7f2b157d2640 1 -- 172.21.15.142:0/1502770309 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x557c293bd4b0 con 0x557c293b5da0 2024-09-22T08:36:48.037 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.036+0000 7f2b157d2640 1 --2- 172.21.15.142:0/1502770309 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557c293b5da0 0x557c293b8190 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f2b1000a600 tx=0x7f2b10047cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b15cdff3cb80a43 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:48.037 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.036+0000 7f2b0ffff640 1 -- 172.21.15.142:0/1502770309 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b10056070 con 0x557c293b5da0 2024-09-22T08:36:48.037 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.036+0000 7f2b0ffff640 1 -- 172.21.15.142:0/1502770309 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b1000a200 con 0x557c293b5da0 2024-09-22T08:36:48.037 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.036+0000 7f2b0ffff640 1 -- 172.21.15.142:0/1502770309 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b10008590 con 0x557c293b5da0 2024-09-22T08:36:48.038 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.037+0000 7f2b19b24800 1 -- 172.21.15.142:0/1502770309 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557c293b5da0 msgr2=0x557c293b8190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:48.038 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.037+0000 7f2b19b24800 1 --2- 172.21.15.142:0/1502770309 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557c293b5da0 0x557c293b8190 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f2b1000a600 tx=0x7f2b10047cb0 comp rx=0 tx=0).stop 2024-09-22T08:36:48.039 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.037+0000 7f2b19b24800 1 -- 172.21.15.142:0/1502770309 shutdown_connections 2024-09-22T08:36:48.039 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.037+0000 7f2b19b24800 1 --2- 172.21.15.142:0/1502770309 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557c293b5da0 0x557c293b8190 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:48.039 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.037+0000 7f2b19b24800 1 -- 172.21.15.142:0/1502770309 >> 172.21.15.142:0/1502770309 conn(0x557c293b0310 msgr2=0x557c293b2790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:48.039 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.037+0000 7f2b19b24800 1 -- 172.21.15.142:0/1502770309 shutdown_connections 2024-09-22T08:36:48.039 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.037+0000 7f2b19b24800 1 -- 172.21.15.142:0/1502770309 wait complete. 2024-09-22T08:36:48.052 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.051+0000 7f2b19b24800 1 Processor -- start 2024-09-22T08:36:48.053 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.051+0000 7f2b19b24800 1 -- start start 2024-09-22T08:36:48.053 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.051+0000 7f2b19b24800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557c293b5da0 0x557c294a3e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:48.053 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.051+0000 7f2b19b24800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x557c2924edd0 con 0x557c293b5da0 2024-09-22T08:36:48.053 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.051+0000 7f2b157d2640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557c293b5da0 0x557c294a3e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:48.053 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.051+0000 7f2b157d2640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557c293b5da0 0x557c294a3e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:39968/0 (socket says 172.21.15.142:39968) 2024-09-22T08:36:48.053 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.051+0000 7f2b157d2640 1 -- 172.21.15.142:0/2636760713 learned_addr learned my addr 172.21.15.142:0/2636760713 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:48.053 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.052+0000 7f2b157d2640 1 -- 172.21.15.142:0/2636760713 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557c294a4420 con 0x557c293b5da0 2024-09-22T08:36:48.055 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.052+0000 7f2b157d2640 1 --2- 172.21.15.142:0/2636760713 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557c293b5da0 0x557c294a3e30 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f2b10027ae0 tx=0x7f2b10053000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29684c76574729e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:48.055 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.052+0000 7f2a03606640 1 -- 172.21.15.142:0/2636760713 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b10009810 con 0x557c293b5da0 2024-09-22T08:36:48.056 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.052+0000 7f2a03606640 1 -- 172.21.15.142:0/2636760713 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b100099b0 con 0x557c293b5da0 2024-09-22T08:36:48.056 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.052+0000 7f2a03606640 1 -- 172.21.15.142:0/2636760713 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b10009cb0 con 0x557c293b5da0 2024-09-22T08:36:48.056 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.053+0000 7f2b19b24800 1 -- 172.21.15.142:0/2636760713 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557c293b5da0 msgr2=0x557c294a3e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:48.056 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.053+0000 7f2b19b24800 1 --2- 172.21.15.142:0/2636760713 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557c293b5da0 0x557c294a3e30 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f2b10027ae0 tx=0x7f2b10053000 comp rx=0 tx=0).stop 2024-09-22T08:36:48.056 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.053+0000 7f2b19b24800 1 -- 172.21.15.142:0/2636760713 shutdown_connections 2024-09-22T08:36:48.056 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.053+0000 7f2b19b24800 1 --2- 172.21.15.142:0/2636760713 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557c293b5da0 0x557c294a3e30 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:48.056 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.053+0000 7f2b19b24800 1 -- 172.21.15.142:0/2636760713 >> 172.21.15.142:0/2636760713 conn(0x557c293b0310 msgr2=0x557c2949f7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:48.056 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.053+0000 7f2b19b24800 1 -- 172.21.15.142:0/2636760713 shutdown_connections 2024-09-22T08:36:48.056 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.053+0000 7f2b19b24800 1 -- 172.21.15.142:0/2636760713 wait complete. 2024-09-22T08:36:48.056 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.053+0000 7f2b19b24800 1 Processor -- start 2024-09-22T08:36:48.056 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.053+0000 7f2b19b24800 1 -- start start 2024-09-22T08:36:48.056 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.053+0000 7f2b19b24800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557c293b5da0 0x557c294ab8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:48.056 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.053+0000 7f2b19b24800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x557c293bc750 con 0x557c293b5da0 2024-09-22T08:36:48.057 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.053+0000 7f2b157d2640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557c293b5da0 0x557c294ab8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:48.057 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.054+0000 7f2b157d2640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557c293b5da0 0x557c294ab8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:39978/0 (socket says 172.21.15.142:39978) 2024-09-22T08:36:48.057 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.054+0000 7f2b157d2640 1 -- 172.21.15.142:0/1211048932 learned_addr learned my addr 172.21.15.142:0/1211048932 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:48.057 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.054+0000 7f2b157d2640 1 -- 172.21.15.142:0/1211048932 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557c294abe10 con 0x557c293b5da0 2024-09-22T08:36:48.057 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.054+0000 7f2b157d2640 1 --2- 172.21.15.142:0/1211048932 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557c293b5da0 0x557c294ab8b0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f2b10027ae0 tx=0x7f2b10002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:48.057 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.054+0000 7f2a01e03640 1 -- 172.21.15.142:0/1211048932 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b100516e0 con 0x557c293b5da0 2024-09-22T08:36:48.057 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.054+0000 7f2a01e03640 1 -- 172.21.15.142:0/1211048932 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b100518a0 con 0x557c293b5da0 2024-09-22T08:36:48.057 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.054+0000 7f2b19b24800 1 -- 172.21.15.142:0/1211048932 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557c294ac0a0 con 0x557c293b5da0 2024-09-22T08:36:48.057 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.054+0000 7f2a01e03640 1 -- 172.21.15.142:0/1211048932 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b10051bc0 con 0x557c293b5da0 2024-09-22T08:36:48.057 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.054+0000 7f2b19b24800 1 -- 172.21.15.142:0/1211048932 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557c294acaa0 con 0x557c293b5da0 2024-09-22T08:36:48.060 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.055+0000 7f2a01e03640 1 -- 172.21.15.142:0/1211048932 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f2b10075060 con 0x557c293b5da0 2024-09-22T08:36:48.060 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.055+0000 7f2a01e03640 1 --2- 172.21.15.142:0/1211048932 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f29fc03cfb0 0x7f29fc03f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:48.061 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.055+0000 7f2a01e03640 1 -- 172.21.15.142:0/1211048932 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f2b1006a040 con 0x557c293b5da0 2024-09-22T08:36:48.061 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.055+0000 7f2b14fd1640 1 --2- 172.21.15.142:0/1211048932 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f29fc03cfb0 0x7f29fc03f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:48.061 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.055+0000 7f2b19b24800 1 --2- 172.21.15.142:0/1211048932 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x557c293b8700 0x557c294b2f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:48.061 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.055+0000 7f2b19b24800 1 -- 172.21.15.142:0/1211048932 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x557c294b3440 con 0x557c293b8700 2024-09-22T08:36:48.061 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.056+0000 7f2b15fd3640 1 --2- 172.21.15.142:0/1211048932 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x557c293b8700 0x557c294b2f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:48.061 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.056+0000 7f2b14fd1640 1 --2- 172.21.15.142:0/1211048932 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f29fc03cfb0 0x7f29fc03f470 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f2b00001d70 tx=0x7f2b000012d0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:48.061 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.056+0000 7f2b15fd3640 1 --2- 172.21.15.142:0/1211048932 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x557c293b8700 0x557c294b2f00 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:48.061 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.056+0000 7f2b15fd3640 1 -- 172.21.15.142:0/1211048932 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2b0800a4d0 con 0x557c293b8700 2024-09-22T08:36:48.061 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.056+0000 7f2b19b24800 1 -- 172.21.15.142:0/1211048932 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x557c294b37e0 con 0x557c293b8700 2024-09-22T08:36:48.061 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.056+0000 7f2b15fd3640 1 -- 172.21.15.142:0/1211048932 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2b0800a4d0 con 0x557c293b8700 2024-09-22T08:36:48.061 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.056+0000 7f2b19b24800 1 --2- 172.21.15.142:0/1211048932 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x557c294b52e0 0x557c294b7780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:48.061 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.056+0000 7f2b19b24800 1 -- 172.21.15.142:0/1211048932 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:3 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x557c294b7f10 con 0x557c294b52e0 2024-09-22T08:36:48.061 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.057+0000 7f2b157d2640 1 --2- 172.21.15.142:0/1211048932 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x557c294b52e0 0x557c294b7780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:48.062 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.057+0000 7f2b157d2640 1 --2- 172.21.15.142:0/1211048932 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x557c294b52e0 0x557c294b7780 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:48.062 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.057+0000 7f2b157d2640 1 -- 172.21.15.142:0/1211048932 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(3 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f2b10058030 con 0x557c294b52e0 2024-09-22T08:36:48.062 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.057+0000 7f2b19b24800 1 -- 172.21.15.142:0/1211048932 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x557c294b4030 con 0x557c293b8700 2024-09-22T08:36:48.062 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.057+0000 7f2b15fd3640 1 -- 172.21.15.142:0/1211048932 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2b0800a4d0 con 0x557c293b8700 2024-09-22T08:36:48.062 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.057+0000 7f2b19b24800 1 -- 172.21.15.142:0/1211048932 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x557c294b4450 con 0x557c294b52e0 2024-09-22T08:36:48.062 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.058+0000 7f2b157d2640 1 -- 172.21.15.142:0/1211048932 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(5 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f2b10058030 con 0x557c294b52e0 2024-09-22T08:36:48.062 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.058+0000 7f2b19b24800 1 Processor -- start 2024-09-22T08:36:48.062 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.058+0000 7f2b19b24800 1 -- start start 2024-09-22T08:36:48.062 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.058+0000 7f2b19b24800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557c294c6820 0x557c294c6c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:48.062 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.058+0000 7f2b19b24800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x557c292add50 con 0x557c294c6820 2024-09-22T08:36:48.062 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.059+0000 7f2b15fd3640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557c294c6820 0x557c294c6c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:48.062 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.059+0000 7f2b15fd3640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557c294c6820 0x557c294c6c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:39980/0 (socket says 172.21.15.142:39980) 2024-09-22T08:36:48.062 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.059+0000 7f2b15fd3640 1 -- 172.21.15.142:0/2032808544 learned_addr learned my addr 172.21.15.142:0/2032808544 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:48.063 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.059+0000 7f2b15fd3640 1 -- 172.21.15.142:0/2032808544 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557c294c7280 con 0x557c294c6820 2024-09-22T08:36:48.063 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.059+0000 7f2b15fd3640 1 --2- 172.21.15.142:0/2032808544 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557c294c6820 0x557c294c6c40 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x557c294ac8b0 tx=0x7f2b080167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:48.063 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.059+0000 7f29faffd640 1 -- 172.21.15.142:0/2032808544 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b08013640 con 0x557c294c6820 2024-09-22T08:36:48.063 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.059+0000 7f29faffd640 1 -- 172.21.15.142:0/2032808544 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b080137e0 con 0x557c294c6820 2024-09-22T08:36:48.063 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.059+0000 7f2b19b24800 1 -- 172.21.15.142:0/2032808544 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557c294c7ab0 con 0x557c294c6820 2024-09-22T08:36:48.063 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.059+0000 7f29faffd640 1 -- 172.21.15.142:0/2032808544 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b08013ae0 con 0x557c294c6820 2024-09-22T08:36:48.063 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.059+0000 7f2b19b24800 1 -- 172.21.15.142:0/2032808544 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557c294c8050 con 0x557c294c6820 2024-09-22T08:36:48.071 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.060+0000 7f29faffd640 1 -- 172.21.15.142:0/2032808544 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f2b08011040 con 0x557c294c6820 2024-09-22T08:36:48.071 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.060+0000 7f29faffd640 1 --2- 172.21.15.142:0/2032808544 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f29ec03cfb0 0x7f29ec03f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:48.071 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.060+0000 7f29faffd640 1 -- 172.21.15.142:0/2032808544 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f2b0800e040 con 0x557c294c6820 2024-09-22T08:36:48.071 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.060+0000 7f2b157d2640 1 --2- 172.21.15.142:0/2032808544 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f29ec03cfb0 0x7f29ec03f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:48.072 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.061+0000 7f2b157d2640 1 --2- 172.21.15.142:0/2032808544 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f29ec03cfb0 0x7f29ec03f470 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f2b1006cb00 tx=0x7f2b10099040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:48.072 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.061+0000 7f2b19b24800 1 Processor -- start 2024-09-22T08:36:48.072 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.061+0000 7f2b19b24800 1 -- start start 2024-09-22T08:36:48.072 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.061+0000 7f2b19b24800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557c294d3300 0x557c294d3700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:48.072 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.061+0000 7f2b19b24800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x557c294a4790 con 0x557c294d3300 2024-09-22T08:36:48.072 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.061+0000 7f2b15fd3640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557c294d3300 0x557c294d3700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:48.072 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.061+0000 7f2b15fd3640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557c294d3300 0x557c294d3700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:39988/0 (socket says 172.21.15.142:39988) 2024-09-22T08:36:48.072 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.061+0000 7f2b15fd3640 1 -- 172.21.15.142:0/679258635 learned_addr learned my addr 172.21.15.142:0/679258635 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:48.072 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.061+0000 7f2b15fd3640 1 -- 172.21.15.142:0/679258635 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557c294d3cf0 con 0x557c294d3300 2024-09-22T08:36:48.072 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.061+0000 7f2b15fd3640 1 --2- 172.21.15.142:0/679258635 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557c294d3300 0x557c294d3700 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f2b08020000 tx=0x7f2b0801f400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cb85b0ce3e2ba57 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:48.072 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.062+0000 7f29f8ff9640 1 -- 172.21.15.142:0/679258635 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b08056070 con 0x557c294d3300 2024-09-22T08:36:48.072 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.062+0000 7f29f8ff9640 1 -- 172.21.15.142:0/679258635 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b08052070 con 0x557c294d3300 2024-09-22T08:36:48.072 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.062+0000 7f29f8ff9640 1 -- 172.21.15.142:0/679258635 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b08021960 con 0x557c294d3300 2024-09-22T08:36:48.072 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.062+0000 7f2b19b24800 1 -- 172.21.15.142:0/679258635 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557c294d3300 msgr2=0x557c294d3700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:48.073 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.062+0000 7f2b19b24800 1 --2- 172.21.15.142:0/679258635 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557c294d3300 0x557c294d3700 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f2b08020000 tx=0x7f2b0801f400 comp rx=0 tx=0).stop 2024-09-22T08:36:48.073 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.062+0000 7f2b19b24800 1 -- 172.21.15.142:0/679258635 shutdown_connections 2024-09-22T08:36:48.073 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.062+0000 7f2b19b24800 1 --2- 172.21.15.142:0/679258635 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557c294d3300 0x557c294d3700 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:48.073 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.062+0000 7f2b19b24800 1 -- 172.21.15.142:0/679258635 >> 172.21.15.142:0/679258635 conn(0x557c294cf720 msgr2=0x557c294cd960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:48.073 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.062+0000 7f2b19b24800 1 -- 172.21.15.142:0/679258635 shutdown_connections 2024-09-22T08:36:48.073 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.062+0000 7f2b19b24800 1 -- 172.21.15.142:0/679258635 wait complete. 2024-09-22T08:36:48.073 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.062+0000 7f2b19b24800 1 Processor -- start 2024-09-22T08:36:48.073 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.062+0000 7f2b19b24800 1 -- start start 2024-09-22T08:36:48.073 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.063+0000 7f2b19b24800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557c294d3300 0x557c294da960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:48.073 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.063+0000 7f2b19b24800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x557c294d4310 con 0x557c294d3300 2024-09-22T08:36:48.073 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.063+0000 7f2b15fd3640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557c294d3300 0x557c294da960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:48.073 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.063+0000 7f2b15fd3640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557c294d3300 0x557c294da960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:40002/0 (socket says 172.21.15.142:40002) 2024-09-22T08:36:48.073 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.063+0000 7f2b15fd3640 1 -- 172.21.15.142:0/3095114352 learned_addr learned my addr 172.21.15.142:0/3095114352 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:48.073 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.063+0000 7f2b15fd3640 1 -- 172.21.15.142:0/3095114352 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557c294daec0 con 0x557c294d3300 2024-09-22T08:36:48.074 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.063+0000 7f2b15fd3640 1 --2- 172.21.15.142:0/3095114352 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557c294d3300 0x557c294da960 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f2b08054800 tx=0x7f2b08054860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:48.074 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.063+0000 7f29eaffd640 1 -- 172.21.15.142:0/3095114352 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b08020bd0 con 0x557c294d3300 2024-09-22T08:36:48.074 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.063+0000 7f29eaffd640 1 -- 172.21.15.142:0/3095114352 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b08020d70 con 0x557c294d3300 2024-09-22T08:36:48.074 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.063+0000 7f2b19b24800 1 -- 172.21.15.142:0/3095114352 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557c294db150 con 0x557c294d3300 2024-09-22T08:36:48.074 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.063+0000 7f29eaffd640 1 -- 172.21.15.142:0/3095114352 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b0801fa90 con 0x557c294d3300 2024-09-22T08:36:48.074 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.063+0000 7f2b19b24800 1 -- 172.21.15.142:0/3095114352 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557c294dbad0 con 0x557c294d3300 2024-09-22T08:36:48.074 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.064+0000 7f29eaffd640 1 -- 172.21.15.142:0/3095114352 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f2b0801fc30 con 0x557c294d3300 2024-09-22T08:36:48.074 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.064+0000 7f29eaffd640 1 --2- 172.21.15.142:0/3095114352 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f29e003cfb0 0x7f29e003f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:48.074 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.064+0000 7f29eaffd640 1 -- 172.21.15.142:0/3095114352 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f2b0804d050 con 0x557c294d3300 2024-09-22T08:36:48.074 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.064+0000 7f2b157d2640 1 --2- 172.21.15.142:0/3095114352 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f29e003cfb0 0x7f29e003f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:48.074 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.065+0000 7f2b157d2640 1 --2- 172.21.15.142:0/3095114352 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f29e003cfb0 0x7f29e003f470 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x557c294ad9b0 tx=0x7f2b1006cfc0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:48.074 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.065+0000 7f2b19b24800 20 rados->read ofs=0 len=0 2024-09-22T08:36:48.074 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.065+0000 7f2b19b24800 1 --2- 172.21.15.142:0/3095114352 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x557c294e6290 0x557c294e8750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:48.075 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.065+0000 7f2b19b24800 1 -- 172.21.15.142:0/3095114352 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x557c294e8ea0 con 0x557c294e6290 2024-09-22T08:36:48.075 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.065+0000 7f2b14fd1640 1 --2- 172.21.15.142:0/3095114352 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x557c294e6290 0x557c294e8750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:48.075 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.065+0000 7f2b14fd1640 1 --2- 172.21.15.142:0/3095114352 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x557c294e6290 0x557c294e8750 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:48.075 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.065+0000 7f2b14fd1640 1 -- 172.21.15.142:0/3095114352 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2b00009050 con 0x557c294e6290 2024-09-22T08:36:48.075 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.065+0000 7f2b19b24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:48.075 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.065+0000 7f2b19b24800 20 realm 2024-09-22T08:36:48.075 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.065+0000 7f2b19b24800 20 rados->read ofs=0 len=0 2024-09-22T08:36:48.075 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.065+0000 7f2b19b24800 1 -- 172.21.15.142:0/3095114352 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x557c294e55e0 con 0x557c294e6290 2024-09-22T08:36:48.075 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.066+0000 7f2b14fd1640 1 -- 172.21.15.142:0/3095114352 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2b00009050 con 0x557c294e6290 2024-09-22T08:36:48.075 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.066+0000 7f2b19b24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:48.075 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.066+0000 7f2b19b24800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:36:48.075 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.066+0000 7f2b19b24800 20 rados->read ofs=0 len=0 2024-09-22T08:36:48.075 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.066+0000 7f2b19b24800 1 -- 172.21.15.142:0/3095114352 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x557c294e9990 con 0x557c294e6290 2024-09-22T08:36:48.075 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.066+0000 7f2b14fd1640 1 -- 172.21.15.142:0/3095114352 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2b00009050 con 0x557c294e6290 2024-09-22T08:36:48.076 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.066+0000 7f2b19b24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:48.076 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.066+0000 7f2b19b24800 20 rados->read ofs=0 len=0 2024-09-22T08:36:48.076 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.066+0000 7f2b19b24800 1 -- 172.21.15.142:0/3095114352 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x557c294ea260 con 0x557c294e6290 2024-09-22T08:36:48.076 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.066+0000 7f2b14fd1640 1 -- 172.21.15.142:0/3095114352 <== osd.1 v2:172.21.15.142:6816/3192108003 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2b00009050 con 0x557c294e6290 2024-09-22T08:36:48.076 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.066+0000 7f2b19b24800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:36:48.076 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.066+0000 7f2b19b24800 20 rados->read ofs=0 len=0 2024-09-22T08:36:48.076 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.066+0000 7f2b19b24800 1 --2- 172.21.15.142:0/3095114352 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x557c294eac80 0x557c294ed070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:48.076 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.066+0000 7f2b19b24800 1 -- 172.21.15.142:0/3095114352 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x557c294ed7b0 con 0x557c294eac80 2024-09-22T08:36:48.076 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.066+0000 7f2b15fd3640 1 --2- 172.21.15.142:0/3095114352 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x557c294eac80 0x557c294ed070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:48.076 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.067+0000 7f2b15fd3640 1 --2- 172.21.15.142:0/3095114352 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x557c294eac80 0x557c294ed070 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:48.076 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.067+0000 7f2b15fd3640 1 -- 172.21.15.142:0/3095114352 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(5 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f2b0803a070 con 0x557c294eac80 2024-09-22T08:36:48.076 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.067+0000 7f2b19b24800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:36:48.076 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.067+0000 7f2b19b24800 20 searching for the correct realm 2024-09-22T08:36:48.076 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.067+0000 7f2b19b24800 1 -- 172.21.15.142:0/3095114352 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557c294ef0e0 con 0x557c294eac80 2024-09-22T08:36:48.076 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.067+0000 7f2b15fd3640 1 -- 172.21.15.142:0/3095114352 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b0803a070 con 0x557c294eac80 2024-09-22T08:36:48.077 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.067+0000 7f2b15fd3640 1 --2- 172.21.15.142:0/3095114352 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f2b0803b6d0 0x7f2b08041570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:48.077 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.067+0000 7f2b15fd3640 1 -- 172.21.15.142:0/3095114352 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557c294ef0e0 con 0x7f2b0803b6d0 2024-09-22T08:36:48.077 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.067+0000 7f2b157d2640 1 --2- 172.21.15.142:0/3095114352 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f2b0803b6d0 0x7f2b08041570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:48.077 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.067+0000 7f2b157d2640 1 --2- 172.21.15.142:0/3095114352 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f2b0803b6d0 0x7f2b08041570 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:48.077 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.068+0000 7f2b157d2640 1 -- 172.21.15.142:0/3095114352 <== osd.2 v2:172.21.15.142:6808/279438927 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b10058030 con 0x7f2b0803b6d0 2024-09-22T08:36:48.077 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.068+0000 7f2b157d2640 1 --2- 172.21.15.142:0/3095114352 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f2b10065030 0x7f2b1005b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:48.077 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.068+0000 7f2b157d2640 1 -- 172.21.15.142:0/3095114352 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557c294ef0e0 con 0x7f2b10065030 2024-09-22T08:36:48.077 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.068+0000 7f2b14fd1640 1 --2- 172.21.15.142:0/3095114352 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f2b10065030 0x7f2b1005b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:48.077 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.068+0000 7f2b14fd1640 1 --2- 172.21.15.142:0/3095114352 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f2b10065030 0x7f2b1005b450 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:48.077 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.068+0000 7f2b14fd1640 1 -- 172.21.15.142:0/3095114352 <== osd.0 v2:172.21.15.31:6800/168281188 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b00009050 con 0x7f2b10065030 2024-09-22T08:36:48.077 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.068+0000 7f2b14fd1640 1 -- 172.21.15.142:0/3095114352 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557c294ef0e0 con 0x557c294e6290 2024-09-22T08:36:48.077 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.069+0000 7f2b14fd1640 1 -- 172.21.15.142:0/3095114352 <== osd.1 v2:172.21.15.142:6816/3192108003 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b00009050 con 0x557c294e6290 2024-09-22T08:36:48.077 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.069+0000 7f2b14fd1640 1 -- 172.21.15.142:0/3095114352 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557c294ef0e0 con 0x557c294e6290 2024-09-22T08:36:48.078 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.069+0000 7f2b14fd1640 1 -- 172.21.15.142:0/3095114352 <== osd.1 v2:172.21.15.142:6816/3192108003 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b00029040 con 0x557c294e6290 2024-09-22T08:36:48.078 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.069+0000 7f2b14fd1640 1 -- 172.21.15.142:0/3095114352 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557c294ef0e0 con 0x7f2b10065030 2024-09-22T08:36:48.078 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.069+0000 7f2b14fd1640 1 -- 172.21.15.142:0/3095114352 <== osd.0 v2:172.21.15.31:6800/168281188 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b00029040 con 0x7f2b10065030 2024-09-22T08:36:48.078 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.069+0000 7f2b14fd1640 1 -- 172.21.15.142:0/3095114352 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557c294ef0e0 con 0x7f2b10065030 2024-09-22T08:36:48.078 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.069+0000 7f2b14fd1640 1 -- 172.21.15.142:0/3095114352 <== osd.0 v2:172.21.15.31:6800/168281188 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b00029040 con 0x7f2b10065030 2024-09-22T08:36:48.078 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.069+0000 7f2b14fd1640 1 -- 172.21.15.142:0/3095114352 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557c294ef0e0 con 0x7f2b0803b6d0 2024-09-22T08:36:48.078 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.070+0000 7f2b157d2640 1 -- 172.21.15.142:0/3095114352 <== osd.2 v2:172.21.15.142:6808/279438927 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b10058030 con 0x7f2b0803b6d0 2024-09-22T08:36:48.078 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.070+0000 7f2b157d2640 1 -- 172.21.15.142:0/3095114352 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557c294ef0e0 con 0x557c294eac80 2024-09-22T08:36:48.078 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.070+0000 7f2b15fd3640 1 -- 172.21.15.142:0/3095114352 <== osd.3 v2:172.21.15.142:6800/1064901393 3 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b0803a070 con 0x557c294eac80 2024-09-22T08:36:48.078 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.070+0000 7f2b15fd3640 1 -- 172.21.15.142:0/3095114352 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557c294ef0e0 con 0x557c294e6290 2024-09-22T08:36:48.078 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.070+0000 7f2b14fd1640 1 -- 172.21.15.142:0/3095114352 <== osd.1 v2:172.21.15.142:6816/3192108003 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b00029040 con 0x557c294e6290 2024-09-22T08:36:48.078 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.070+0000 7f2b14fd1640 1 -- 172.21.15.142:0/3095114352 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557c294ef0e0 con 0x7f2b10065030 2024-09-22T08:36:48.078 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.070+0000 7f2b14fd1640 1 -- 172.21.15.142:0/3095114352 <== osd.0 v2:172.21.15.31:6800/168281188 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b00029040 con 0x7f2b10065030 2024-09-22T08:36:48.078 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.070+0000 7f2b14fd1640 1 -- 172.21.15.142:0/3095114352 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557c294ef0e0 con 0x557c294e6290 2024-09-22T08:36:48.086 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.071+0000 7f2b14fd1640 1 -- 172.21.15.142:0/3095114352 <== osd.1 v2:172.21.15.142:6816/3192108003 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b00029040 con 0x557c294e6290 2024-09-22T08:36:48.086 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.071+0000 7f2b14fd1640 1 -- 172.21.15.142:0/3095114352 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557c294ef0e0 con 0x7f2b0803b6d0 2024-09-22T08:36:48.087 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.071+0000 7f2b157d2640 1 -- 172.21.15.142:0/3095114352 <== osd.2 v2:172.21.15.142:6808/279438927 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f2b10058030 con 0x7f2b0803b6d0 2024-09-22T08:36:48.087 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.071+0000 7f2b157d2640 1 -- 172.21.15.142:0/3095114352 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557c294ef0e0 con 0x557c294eac80 2024-09-22T08:36:48.087 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.071+0000 7f2b15fd3640 1 -- 172.21.15.142:0/3095114352 <== osd.3 v2:172.21.15.142:6800/1064901393 4 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b0803a070 con 0x557c294eac80 2024-09-22T08:36:48.087 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.071+0000 7f2b15fd3640 1 -- 172.21.15.142:0/3095114352 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557c294ef0e0 con 0x557c294eac80 2024-09-22T08:36:48.087 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.071+0000 7f2b15fd3640 1 -- 172.21.15.142:0/3095114352 <== osd.3 v2:172.21.15.142:6800/1064901393 5 ==== osd_op_reply(20 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f2b0803a070 con 0x557c294eac80 2024-09-22T08:36:48.087 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.071+0000 7f2b15fd3640 1 -- 172.21.15.142:0/3095114352 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557c294ef0e0 con 0x7f2b10065030 2024-09-22T08:36:48.087 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.072+0000 7f2b14fd1640 1 -- 172.21.15.142:0/3095114352 <== osd.0 v2:172.21.15.31:6800/168281188 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b00029040 con 0x7f2b10065030 2024-09-22T08:36:48.087 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.072+0000 7f2b14fd1640 1 -- 172.21.15.142:0/3095114352 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557c294ef0e0 con 0x557c294eac80 2024-09-22T08:36:48.087 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.072+0000 7f2b15fd3640 1 -- 172.21.15.142:0/3095114352 <== osd.3 v2:172.21.15.142:6800/1064901393 6 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b0803a070 con 0x557c294eac80 2024-09-22T08:36:48.087 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.072+0000 7f2b15fd3640 1 -- 172.21.15.142:0/3095114352 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557c294ef0e0 con 0x557c294eac80 2024-09-22T08:36:48.087 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.072+0000 7f2b15fd3640 1 -- 172.21.15.142:0/3095114352 <== osd.3 v2:172.21.15.142:6800/1064901393 7 ==== osd_op_reply(23 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f2b0803a070 con 0x557c294eac80 2024-09-22T08:36:48.087 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.072+0000 7f2b15fd3640 1 -- 172.21.15.142:0/3095114352 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557c294ef0e0 con 0x557c294e6290 2024-09-22T08:36:48.087 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.072+0000 7f2b14fd1640 1 -- 172.21.15.142:0/3095114352 <== osd.1 v2:172.21.15.142:6816/3192108003 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b00029040 con 0x557c294e6290 2024-09-22T08:36:48.088 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.072+0000 7f2b14fd1640 1 -- 172.21.15.142:0/3095114352 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557c294ef0e0 con 0x557c294e6290 2024-09-22T08:36:48.088 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.073+0000 7f2b14fd1640 1 -- 172.21.15.142:0/3095114352 <== osd.1 v2:172.21.15.142:6816/3192108003 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f2b00029040 con 0x557c294e6290 2024-09-22T08:36:48.088 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.073+0000 7f2b14fd1640 1 -- 172.21.15.142:0/3095114352 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557c294ef0e0 con 0x7f2b10065030 2024-09-22T08:36:48.088 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.073+0000 7f2b14fd1640 1 -- 172.21.15.142:0/3095114352 <== osd.0 v2:172.21.15.31:6800/168281188 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b00029040 con 0x7f2b10065030 2024-09-22T08:36:48.088 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.073+0000 7f2b14fd1640 1 -- 172.21.15.142:0/3095114352 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557c294ef0e0 con 0x557c294eac80 2024-09-22T08:36:48.088 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.073+0000 7f2b15fd3640 1 -- 172.21.15.142:0/3095114352 <== osd.3 v2:172.21.15.142:6800/1064901393 8 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b0803a070 con 0x557c294eac80 2024-09-22T08:36:48.088 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.073+0000 7f2b15fd3640 1 -- 172.21.15.142:0/3095114352 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557c294ef0e0 con 0x7f2b0803b6d0 2024-09-22T08:36:48.088 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.073+0000 7f2b157d2640 1 -- 172.21.15.142:0/3095114352 <== osd.2 v2:172.21.15.142:6808/279438927 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b10058030 con 0x7f2b0803b6d0 2024-09-22T08:36:48.088 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.073+0000 7f2b157d2640 1 -- 172.21.15.142:0/3095114352 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557c294ef0e0 con 0x557c294e6290 2024-09-22T08:36:48.088 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.074+0000 7f2b14fd1640 1 -- 172.21.15.142:0/3095114352 <== osd.1 v2:172.21.15.142:6816/3192108003 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b00029040 con 0x557c294e6290 2024-09-22T08:36:48.088 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.074+0000 7f2b14fd1640 1 -- 172.21.15.142:0/3095114352 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557c294ef0e0 con 0x7f2b10065030 2024-09-22T08:36:48.088 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.074+0000 7f2b14fd1640 1 -- 172.21.15.142:0/3095114352 <== osd.0 v2:172.21.15.31:6800/168281188 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b00029040 con 0x7f2b10065030 2024-09-22T08:36:48.089 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.074+0000 7f2b14fd1640 1 -- 172.21.15.142:0/3095114352 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557c294ef0e0 con 0x557c294eac80 2024-09-22T08:36:48.089 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.074+0000 7f2b15fd3640 1 -- 172.21.15.142:0/3095114352 <== osd.3 v2:172.21.15.142:6800/1064901393 9 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b0803a070 con 0x557c294eac80 2024-09-22T08:36:48.089 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.074+0000 7f2b15fd3640 1 -- 172.21.15.142:0/3095114352 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557c294ef0e0 con 0x7f2b10065030 2024-09-22T08:36:48.089 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.074+0000 7f2b14fd1640 1 -- 172.21.15.142:0/3095114352 <== osd.0 v2:172.21.15.31:6800/168281188 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b00029040 con 0x7f2b10065030 2024-09-22T08:36:48.089 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.074+0000 7f2b14fd1640 1 -- 172.21.15.142:0/3095114352 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557c294ef0e0 con 0x7f2b0803b6d0 2024-09-22T08:36:48.089 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.075+0000 7f2b157d2640 1 -- 172.21.15.142:0/3095114352 <== osd.2 v2:172.21.15.142:6808/279438927 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b10058030 con 0x7f2b0803b6d0 2024-09-22T08:36:48.089 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.075+0000 7f2b157d2640 1 -- 172.21.15.142:0/3095114352 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557c294ef0e0 con 0x557c294eac80 2024-09-22T08:36:48.089 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.075+0000 7f2b15fd3640 1 -- 172.21.15.142:0/3095114352 <== osd.3 v2:172.21.15.142:6800/1064901393 10 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b0803a070 con 0x557c294eac80 2024-09-22T08:36:48.089 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.075+0000 7f2b15fd3640 1 -- 172.21.15.142:0/3095114352 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557c294ef0e0 con 0x7f2b10065030 2024-09-22T08:36:48.089 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.075+0000 7f2b14fd1640 1 -- 172.21.15.142:0/3095114352 <== osd.0 v2:172.21.15.31:6800/168281188 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b00029040 con 0x7f2b10065030 2024-09-22T08:36:48.089 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.075+0000 7f2b14fd1640 1 -- 172.21.15.142:0/3095114352 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557c294ef0e0 con 0x557c294e6290 2024-09-22T08:36:48.089 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.075+0000 7f2b14fd1640 1 -- 172.21.15.142:0/3095114352 <== osd.1 v2:172.21.15.142:6816/3192108003 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f2b00029040 con 0x557c294e6290 2024-09-22T08:36:48.089 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.075+0000 7f2b14fd1640 1 -- 172.21.15.142:0/3095114352 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557c294ef0e0 con 0x7f2b0803b6d0 2024-09-22T08:36:48.090 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.076+0000 7f2b157d2640 1 -- 172.21.15.142:0/3095114352 <== osd.2 v2:172.21.15.142:6808/279438927 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b10058030 con 0x7f2b0803b6d0 2024-09-22T08:36:48.090 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.076+0000 7f2b19b24800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:36:48.090 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.076+0000 7f2b19b24800 20 RGWRados::pool_iterate: got zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec 2024-09-22T08:36:48.090 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.076+0000 7f2b19b24800 20 RGWRados::pool_iterate: got zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f 2024-09-22T08:36:48.090 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.076+0000 7f2b19b24800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:36:48.090 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.076+0000 7f2b19b24800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:36:48.090 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.076+0000 7f2b19b24800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:36:48.090 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.076+0000 7f2b19b24800 20 rados->read ofs=0 len=0 2024-09-22T08:36:48.090 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.076+0000 7f2b19b24800 1 -- 172.21.15.142:0/3095114352 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x557c294ee170 con 0x557c294e6290 2024-09-22T08:36:48.090 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.076+0000 7f2b14fd1640 1 -- 172.21.15.142:0/3095114352 <== osd.1 v2:172.21.15.142:6816/3192108003 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2b00029040 con 0x557c294e6290 2024-09-22T08:36:48.090 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.076+0000 7f2b19b24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:48.090 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.076+0000 7f2b19b24800 20 rados->read ofs=0 len=0 2024-09-22T08:36:48.090 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.076+0000 7f2b19b24800 1 -- 172.21.15.142:0/3095114352 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x557c294ee9c0 con 0x557c294e6290 2024-09-22T08:36:48.090 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.076+0000 7f2b14fd1640 1 -- 172.21.15.142:0/3095114352 <== osd.1 v2:172.21.15.142:6816/3192108003 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2b00029040 con 0x557c294e6290 2024-09-22T08:36:48.091 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.076+0000 7f2b19b24800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:36:48.091 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.076+0000 7f2b19b24800 20 rados->read ofs=0 len=0 2024-09-22T08:36:48.091 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.076+0000 7f2b19b24800 1 -- 172.21.15.142:0/3095114352 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:40 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x557c294ef560 con 0x557c294eac80 2024-09-22T08:36:48.091 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.076+0000 7f2b15fd3640 1 -- 172.21.15.142:0/3095114352 <== osd.3 v2:172.21.15.142:6800/1064901393 11 ==== osd_op_reply(40 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f2b0803a070 con 0x557c294eac80 2024-09-22T08:36:48.091 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.076+0000 7f2b19b24800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:36:48.091 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.076+0000 7f2b19b24800 20 zone default found 2024-09-22T08:36:48.091 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.076+0000 7f2b19b24800 4 Realm: () 2024-09-22T08:36:48.091 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.076+0000 7f2b19b24800 4 ZoneGroup: default (d89f6f57-1007-47dd-9065-f486c7b01aec) 2024-09-22T08:36:48.091 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.076+0000 7f2b19b24800 4 Zone: default (e239248c-0bee-4e41-803a-24b288d3eb8f) 2024-09-22T08:36:48.091 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.076+0000 7f2b19b24800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:36:48.091 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.076+0000 7f2b19b24800 20 zonegroup default 2024-09-22T08:36:48.091 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.076+0000 7f2b19b24800 20 rados->read ofs=0 len=0 2024-09-22T08:36:48.091 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.076+0000 7f2b19b24800 1 -- 172.21.15.142:0/3095114352 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x557c294ef920 con 0x7f2b10065030 2024-09-22T08:36:48.091 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.077+0000 7f2b14fd1640 1 -- 172.21.15.142:0/3095114352 <== osd.0 v2:172.21.15.31:6800/168281188 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f2b00029040 con 0x7f2b10065030 2024-09-22T08:36:48.091 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.077+0000 7f2b19b24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:48.092 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.077+0000 7f2b19b24800 20 rados->read ofs=0 len=0 2024-09-22T08:36:48.092 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.077+0000 7f2b19b24800 1 -- 172.21.15.142:0/3095114352 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x557c294f1c00 con 0x557c294eac80 2024-09-22T08:36:48.092 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.077+0000 7f2b15fd3640 1 -- 172.21.15.142:0/3095114352 <== osd.3 v2:172.21.15.142:6800/1064901393 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2b0803a070 con 0x557c294eac80 2024-09-22T08:36:48.092 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.077+0000 7f2b19b24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:48.092 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.077+0000 7f2b19b24800 20 rados->read ofs=0 len=0 2024-09-22T08:36:48.092 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.077+0000 7f2b19b24800 1 -- 172.21.15.142:0/3095114352 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x557c294f1fa0 con 0x557c294eac80 2024-09-22T08:36:48.092 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.077+0000 7f2b15fd3640 1 -- 172.21.15.142:0/3095114352 <== osd.3 v2:172.21.15.142:6800/1064901393 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2b0803a070 con 0x557c294eac80 2024-09-22T08:36:48.092 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.077+0000 7f2b19b24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:48.092 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.077+0000 7f2b19b24800 20 started sync module instance, tier type = 2024-09-22T08:36:48.092 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.077+0000 7f2b19b24800 20 started zone id=e239248c-0bee-4e41-803a-24b288d3eb8f (name=default) with tier type = 2024-09-22T08:36:48.092 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.077+0000 7f2b19b24800 1 -- 172.21.15.142:0/3095114352 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557c294f1090 con 0x7f2b0803b6d0 2024-09-22T08:36:48.092 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.078+0000 7f2b157d2640 1 -- 172.21.15.142:0/3095114352 <== osd.2 v2:172.21.15.142:6808/279438927 7 ==== osd_op_reply(44 notify.0 [create] v30'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b10058030 con 0x7f2b0803b6d0 2024-09-22T08:36:48.092 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.078+0000 7f2b19b24800 1 -- 172.21.15.142:0/3095114352 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93991757354160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557c294f0cf0 con 0x7f2b0803b6d0 2024-09-22T08:36:48.093 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.078+0000 7f2b19b24800 1 -- 172.21.15.142:0/3095114352 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557c294f2d90 con 0x557c294e6290 2024-09-22T08:36:48.093 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.079+0000 7f2b157d2640 1 -- 172.21.15.142:0/3095114352 <== osd.2 v2:172.21.15.142:6808/279438927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93991757354160] v30'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b10058030 con 0x7f2b0803b6d0 2024-09-22T08:36:48.093 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.079+0000 7f2b14fd1640 1 -- 172.21.15.142:0/3095114352 <== osd.1 v2:172.21.15.142:6816/3192108003 15 ==== osd_op_reply(46 notify.1 [create] v30'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b00029040 con 0x557c294e6290 2024-09-22T08:36:48.093 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.079+0000 7f2b19b24800 1 -- 172.21.15.142:0/3095114352 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93991757358032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557c294f3180 con 0x557c294e6290 2024-09-22T08:36:48.093 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.079+0000 7f2b19b24800 1 -- 172.21.15.142:0/3095114352 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557c294f3c10 con 0x557c294eac80 2024-09-22T08:36:48.093 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.080+0000 7f2b15fd3640 1 -- 172.21.15.142:0/3095114352 <== osd.3 v2:172.21.15.142:6800/1064901393 14 ==== osd_op_reply(48 notify.2 [create] v30'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b0803a070 con 0x557c294eac80 2024-09-22T08:36:48.093 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.080+0000 7f2b19b24800 1 -- 172.21.15.142:0/3095114352 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93991757362880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557c294f3bd0 con 0x557c294eac80 2024-09-22T08:36:48.093 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.080+0000 7f2b19b24800 1 -- 172.21.15.142:0/3095114352 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557c294f4bf0 con 0x7f2b0803b6d0 2024-09-22T08:36:48.093 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.081+0000 7f2b14fd1640 1 -- 172.21.15.142:0/3095114352 <== osd.1 v2:172.21.15.142:6816/3192108003 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93991757358032] v30'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b00029040 con 0x557c294e6290 2024-09-22T08:36:48.093 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.081+0000 7f2b15fd3640 1 -- 172.21.15.142:0/3095114352 <== osd.3 v2:172.21.15.142:6800/1064901393 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 93991757362880] v30'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b0803a070 con 0x557c294eac80 2024-09-22T08:36:48.093 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.082+0000 7f2b157d2640 1 -- 172.21.15.142:0/3095114352 <== osd.2 v2:172.21.15.142:6808/279438927 9 ==== osd_op_reply(50 notify.3 [create] v30'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b10058030 con 0x7f2b0803b6d0 2024-09-22T08:36:48.093 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.082+0000 7f2b19b24800 1 -- 172.21.15.142:0/3095114352 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93991757365248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557c294f27f0 con 0x7f2b0803b6d0 2024-09-22T08:36:48.093 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.082+0000 7f2b19b24800 1 -- 172.21.15.142:0/3095114352 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557c294f54d0 con 0x557c294e6290 2024-09-22T08:36:48.093 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.083+0000 7f2b14fd1640 1 -- 172.21.15.142:0/3095114352 <== osd.1 v2:172.21.15.142:6816/3192108003 17 ==== osd_op_reply(52 notify.4 [create] v30'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b00029040 con 0x557c294e6290 2024-09-22T08:36:48.093 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.083+0000 7f2b19b24800 1 -- 172.21.15.142:0/3095114352 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93991757369312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557c294f5480 con 0x557c294e6290 2024-09-22T08:36:48.094 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.083+0000 7f2b19b24800 1 -- 172.21.15.142:0/3095114352 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557c294f64a0 con 0x7f2b10065030 2024-09-22T08:36:48.094 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.083+0000 7f2b157d2640 1 -- 172.21.15.142:0/3095114352 <== osd.2 v2:172.21.15.142:6808/279438927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93991757365248] v30'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b10058030 con 0x7f2b0803b6d0 2024-09-22T08:36:48.094 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.084+0000 7f2b14fd1640 1 -- 172.21.15.142:0/3095114352 <== osd.0 v2:172.21.15.31:6800/168281188 11 ==== osd_op_reply(54 notify.5 [create] v30'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b00029040 con 0x7f2b10065030 2024-09-22T08:36:48.094 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.084+0000 7f2b19b24800 1 -- 172.21.15.142:0/3095114352 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93991757373328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557c294f6460 con 0x7f2b10065030 2024-09-22T08:36:48.094 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.084+0000 7f2b19b24800 1 -- 172.21.15.142:0/3095114352 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557c294f6ef0 con 0x7f2b10065030 2024-09-22T08:36:48.094 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.084+0000 7f2b14fd1640 1 -- 172.21.15.142:0/3095114352 <== osd.1 v2:172.21.15.142:6816/3192108003 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93991757369312] v30'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b00029040 con 0x557c294e6290 2024-09-22T08:36:48.094 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.085+0000 7f2b14fd1640 1 -- 172.21.15.142:0/3095114352 <== osd.0 v2:172.21.15.31:6800/168281188 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93991757373328] v30'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b00029040 con 0x7f2b10065030 2024-09-22T08:36:48.094 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.085+0000 7f2b14fd1640 1 -- 172.21.15.142:0/3095114352 <== osd.0 v2:172.21.15.31:6800/168281188 13 ==== osd_op_reply(56 notify.6 [create] v30'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b00029040 con 0x7f2b10065030 2024-09-22T08:36:48.094 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.085+0000 7f2b19b24800 1 -- 172.21.15.142:0/3095114352 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93991757367040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557c294f58c0 con 0x7f2b10065030 2024-09-22T08:36:48.094 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.085+0000 7f2b19b24800 1 -- 172.21.15.142:0/3095114352 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557c294f73a0 con 0x7f2b10065030 2024-09-22T08:36:48.101 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.086+0000 7f2b14fd1640 1 -- 172.21.15.142:0/3095114352 <== osd.0 v2:172.21.15.31:6800/168281188 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93991757367040] v30'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b00029040 con 0x7f2b10065030 2024-09-22T08:36:48.101 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.086+0000 7f2b14fd1640 1 -- 172.21.15.142:0/3095114352 <== osd.0 v2:172.21.15.31:6800/168281188 15 ==== osd_op_reply(58 notify.7 [create] v30'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b00029040 con 0x7f2b10065030 2024-09-22T08:36:48.102 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.086+0000 7f2b19b24800 1 -- 172.21.15.142:0/3095114352 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93991757376000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557c294f73a0 con 0x7f2b10065030 2024-09-22T08:36:48.102 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.086+0000 7f2b19b24800 20 add_watcher() i=0 2024-09-22T08:36:48.102 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.086+0000 7f2b19b24800 20 add_watcher() i=1 2024-09-22T08:36:48.102 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.086+0000 7f2b19b24800 20 add_watcher() i=2 2024-09-22T08:36:48.102 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.086+0000 7f2b19b24800 20 add_watcher() i=3 2024-09-22T08:36:48.102 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.086+0000 7f2b19b24800 20 add_watcher() i=4 2024-09-22T08:36:48.102 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.086+0000 7f2b19b24800 20 add_watcher() i=5 2024-09-22T08:36:48.102 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.086+0000 7f2b19b24800 20 add_watcher() i=6 2024-09-22T08:36:48.102 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.087+0000 7f2b14fd1640 1 -- 172.21.15.142:0/3095114352 <== osd.0 v2:172.21.15.31:6800/168281188 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93991757376000] v30'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b00029040 con 0x7f2b10065030 2024-09-22T08:36:48.102 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.087+0000 7f2b19b24800 20 add_watcher() i=7 2024-09-22T08:36:48.102 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.087+0000 7f2b19b24800 2 all 8 watchers are set, enabling cache 2024-09-22T08:36:48.102 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.087+0000 7f2b19b24800 1 -- 172.21.15.142:0/3095114352 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x557c294fa840 con 0x557c294e6290 2024-09-22T08:36:48.102 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.088+0000 7f2b14fd1640 1 -- 172.21.15.142:0/3095114352 <== osd.1 v2:172.21.15.142:6816/3192108003 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f2b00029040 con 0x557c294e6290 2024-09-22T08:36:48.103 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.088+0000 7f2b19b24800 1 -- 172.21.15.142:0/3095114352 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93991757390432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557c294f7510 con 0x557c294e6290 2024-09-22T08:36:48.103 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.089+0000 7f2b14fd1640 1 -- 172.21.15.142:0/3095114352 <== osd.1 v2:172.21.15.142:6816/3192108003 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93991757390432] v30'132 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2b00029040 con 0x557c294e6290 2024-09-22T08:36:48.103 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.089+0000 7f29cb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:36:48.103 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.089+0000 7f2b19b24800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:36:48.103 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.089+0000 7f2b19b24800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:36:48.103 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.089+0000 7f2b19b24800 5 note: GC not initialized 2024-09-22T08:36:48.103 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.089+0000 7f29ca7e4640 20 reqs_thread_entry: start 2024-09-22T08:36:48.103 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.089+0000 7f2b19b24800 20 init_complete bucket index max shards: 11 2024-09-22T08:36:48.103 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.089+0000 7f2b19b24800 20 Filter name: none 2024-09-22T08:36:48.103 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.089+0000 7f293bfff640 20 reqs_thread_entry: start 2024-09-22T08:36:48.103 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.089+0000 7f2b19b24800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-22T08:36:48.103 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.089+0000 7f2b19b24800 20 rados->read ofs=0 len=0 2024-09-22T08:36:48.103 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.089+0000 7f2b19b24800 1 -- 172.21.15.142:0/3095114352 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x557c2952dc80 con 0x557c294e6290 2024-09-22T08:36:48.104 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.090+0000 7f2b14fd1640 1 -- 172.21.15.142:0/3095114352 <== osd.1 v2:172.21.15.142:6816/3192108003 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f2b00029040 con 0x557c294e6290 2024-09-22T08:36:48.104 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.090+0000 7f2b19b24800 20 rados_obj.operate() r=0 bl.length=391 2024-09-22T08:36:48.104 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.090+0000 7f2b19b24800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-22T08:36:48.104 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.090+0000 7f2b19b24800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-22T08:36:48.104 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.090+0000 7f2b19b24800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:36:48.104 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.090+0000 7f2b19b24800 10 cache get: name=default.rgw.meta+root+testx/myfoo : miss 2024-09-22T08:36:48.104 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.090+0000 7f2b19b24800 20 rados->read ofs=0 len=0 2024-09-22T08:36:48.104 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.090+0000 7f2b19b24800 1 -- 172.21.15.142:0/3095114352 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:63 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x557c2952fd70 con 0x557c294e6290 2024-09-22T08:36:48.104 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.090+0000 7f2b14fd1640 1 -- 172.21.15.142:0/3095114352 <== osd.1 v2:172.21.15.142:6816/3192108003 22 ==== osd_op_reply(63 testx/myfoo [call out=48b,read 0~193 out=193b] v0'0 uv1 ondisk = 0) ==== 197+0+241 (crc 0 0 0) 0x7f2b00029040 con 0x557c294e6290 2024-09-22T08:36:48.104 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.090+0000 7f2b19b24800 20 rados_obj.operate() r=0 bl.length=193 2024-09-22T08:36:48.104 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.090+0000 7f2b19b24800 10 cache put: name=default.rgw.meta+root+testx/myfoo info.flags=0x11 2024-09-22T08:36:48.104 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.090+0000 7f2b19b24800 10 adding default.rgw.meta+root+testx/myfoo to cache LRU end 2024-09-22T08:36:48.104 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.090+0000 7f2b19b24800 10 cache get: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1 : miss 2024-09-22T08:36:48.104 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.090+0000 7f2b19b24800 20 rados->read ofs=0 len=0 2024-09-22T08:36:48.105 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.090+0000 7f2b19b24800 1 -- 172.21.15.142:0/3095114352 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:64 8.c 8:35339db6:root::.bucket.meta.testx%3amyfoo%3ae239248c-0bee-4e41-803a-24b288d3eb8f.4226.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x557c29531640 con 0x557c294e6290 2024-09-22T08:36:48.105 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.090+0000 7f2b14fd1640 1 -- 172.21.15.142:0/3095114352 <== osd.1 v2:172.21.15.142:6816/3192108003 23 ==== osd_op_reply(64 .bucket.meta.testx:myfoo:e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1 [call out=48b,stat out=16b,read 0~420 out=420b,getxattrs out=298b] v0'0 uv1 ondisk = 0) ==== 338+0+782 (crc 0 0 0) 0x7f2b00029040 con 0x557c294e6290 2024-09-22T08:36:48.105 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.090+0000 7f2b19b24800 20 rados_obj.operate() r=0 bl.length=420 2024-09-22T08:36:48.105 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.090+0000 7f2b19b24800 10 cache put: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1 info.flags=0x17 2024-09-22T08:36:48.105 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.090+0000 7f2b19b24800 10 adding default.rgw.meta+root+.bucket.meta.testx:myfoo:e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1 to cache LRU end 2024-09-22T08:36:48.105 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.090+0000 7f2b19b24800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:36:48.105 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.090+0000 7f2b19b24800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-22T08:36:48.105 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.090+0000 7f2b19b24800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.testx:myfoo:e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1 2024-09-22T08:36:48.105 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.090+0000 7f2b19b24800 10 cache get: name=default.rgw.meta+users.uid+foo : hit (requested=0x13, cached=0x13) 2024-09-22T08:36:48.105 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.090+0000 7f2b19b24800 1 -- 172.21.15.142:0/3095114352 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:65 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557c29535c60 con 0x557c294e6290 2024-09-22T08:36:48.105 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.091+0000 7f2b14fd1640 1 -- 172.21.15.142:0/3095114352 <== osd.1 v2:172.21.15.142:6816/3192108003 24 ==== osd_op_reply(65 testx$tenanteduser.buckets [call] v30'3 uv3 ondisk = 0) ==== 170+0+0 (crc 0 0 0) 0x7f2b00029040 con 0x557c294e6290 2024-09-22T08:36:48.106 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.091+0000 7f2b19b24800 1 -- 172.21.15.142:0/3095114352 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:66 8.15 8:ab67ca09:root::.bucket.meta.myfoo%3ae239248c-0bee-4e41-803a-24b288d3eb8f.4226.1:head [create,call version.inc in=38b,writefull 0~387 in=387b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557c29539570 con 0x557c294eac80 2024-09-22T08:36:48.106 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.093+0000 7f2b15fd3640 1 -- 172.21.15.142:0/3095114352 <== osd.3 v2:172.21.15.142:6800/1064901393 16 ==== osd_op_reply(66 .bucket.meta.myfoo:e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1 [create,call,writefull 0~387,setxattr (123)] v30'7 uv7 ondisk = 0) ==== 332+0+0 (crc 0 0 0) 0x7f2b0803a070 con 0x557c294eac80 2024-09-22T08:36:48.106 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.093+0000 7f2b19b24800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1 info.flags=0x7 2024-09-22T08:36:48.106 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.093+0000 7f2b19b24800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1 to cache LRU end 2024-09-22T08:36:48.106 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.093+0000 7f2b19b24800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-22T08:36:48.106 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.093+0000 7f2b19b24800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1, ofs0, ns] 2024-09-22T08:36:48.106 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.093+0000 7f2b19b24800 1 -- 172.21.15.142:0/3095114352 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [notify cookie 93991757639840 in=748b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x557c29538da0 con 0x7f2b0803b6d0 2024-09-22T08:36:48.106 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.093+0000 7f2b157d2640 1 -- 172.21.15.142:0/3095114352 <== osd.2 v2:172.21.15.142:6808/279438927 11 ==== watch-notify(notify (1) cookie 93991757365248 notify 128849018897 ret 0) ==== 778+0+0 (crc 0 0 0) 0x7f2b100a1060 con 0x7f2b0803b6d0 2024-09-22T08:36:48.106 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.093+0000 7f29f8ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018897 cookie 93991757365248 notifier 4555 bl.length()=736 2024-09-22T08:36:48.106 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.093+0000 7f29f8ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1 info.flags=0x7 2024-09-22T08:36:48.106 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.093+0000 7f29f8ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1 to cache LRU end 2024-09-22T08:36:48.106 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.093+0000 7f29f8ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-09-22T08:36:48.106 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.093+0000 7f29f8ff9640 1 -- 172.21.15.142:0/3095114352 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f29d8003ea0 con 0x7f2b0803b6d0 2024-09-22T08:36:48.107 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.093+0000 7f2b157d2640 1 -- 172.21.15.142:0/3095114352 <== osd.2 v2:172.21.15.142:6808/279438927 12 ==== osd_op_reply(67 notify.3 [notify cookie 93991757639840 out=8b] v0'0 uv138 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f2b10058030 con 0x7f2b0803b6d0 2024-09-22T08:36:48.107 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.093+0000 7f2b157d2640 1 -- 172.21.15.142:0/3095114352 <== osd.2 v2:172.21.15.142:6808/279438927 13 ==== osd_op_reply(68 notify.3 [notify-ack] v0'0 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b10058030 con 0x7f2b0803b6d0 2024-09-22T08:36:48.107 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.093+0000 7f2b157d2640 1 -- 172.21.15.142:0/3095114352 <== osd.2 v2:172.21.15.142:6808/279438927 14 ==== watch-notify(notify_complete (2) cookie 93991757639840 notify 128849018897 ret 0) ==== 42+0+48 (crc 0 0 0) 0x557c294acaa0 con 0x7f2b0803b6d0 2024-09-22T08:36:48.107 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.093+0000 7f2b19b24800 20 handle_bi_update(): bucket=:myfoo[e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1]): orig_sources= new_sources= 2024-09-22T08:36:48.107 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.093+0000 7f2b19b24800 20 handle_bi_update(): bucket=:myfoo[e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1]): potential sources added=[] removed=[] 2024-09-22T08:36:48.107 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.093+0000 7f2b19b24800 20 handle_bi_update(): bucket=:myfoo[e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1]): orig_dests= new_dests= 2024-09-22T08:36:48.107 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.093+0000 7f2b19b24800 20 handle_bi_update(): bucket=:myfoo[e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1]): potential dests added=[] removed=[] 2024-09-22T08:36:48.107 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.093+0000 7f2b19b24800 1 -- 172.21.15.142:0/3095114352 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:69 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557c29538060 con 0x7f2b0803b6d0 2024-09-22T08:36:48.107 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.094+0000 7f2b157d2640 1 -- 172.21.15.142:0/3095114352 <== osd.2 v2:172.21.15.142:6808/279438927 15 ==== osd_op_reply(69 foo.buckets [call] v30'26 uv26 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f2b10058030 con 0x7f2b0803b6d0 2024-09-22T08:36:48.107 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.094+0000 7f2b19b24800 1 -- 172.21.15.142:0/3095114352 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:70 8.9 8:91b71841:root::myfoo:head [delete,create,call version.inc in=38b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557c29534dc0 con 0x7f2b0803b6d0 2024-09-22T08:36:48.107 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.096+0000 7f2b157d2640 1 -- 172.21.15.142:0/3095114352 <== osd.2 v2:172.21.15.142:6808/279438927 16 ==== osd_op_reply(70 myfoo [delete,create,call,writefull 0~165] v30'27 uv27 ondisk = 0) ==== 275+0+0 (crc 0 0 0) 0x7f2b10058030 con 0x7f2b0803b6d0 2024-09-22T08:36:48.107 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.096+0000 7f2b19b24800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-09-22T08:36:48.107 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.096+0000 7f2b19b24800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-22T08:36:48.108 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.096+0000 7f2b19b24800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-22T08:36:48.108 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.096+0000 7f2b19b24800 1 -- 172.21.15.142:0/3095114352 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [notify cookie 93991757629712 in=326b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x557c29534d30 con 0x7f2b10065030 2024-09-22T08:36:48.108 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.096+0000 7f2b14fd1640 1 -- 172.21.15.142:0/3095114352 <== osd.0 v2:172.21.15.31:6800/168281188 17 ==== watch-notify(notify (1) cookie 93991757367040 notify 128849018895 ret 0) ==== 356+0+0 (crc 0 0 0) 0x557c29530b80 con 0x7f2b10065030 2024-09-22T08:36:48.108 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.096+0000 7f29ebfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018895 cookie 93991757367040 notifier 4555 bl.length()=314 2024-09-22T08:36:48.108 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.096+0000 7f29ebfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-09-22T08:36:48.108 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.096+0000 7f29ebfff640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-22T08:36:48.108 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.096+0000 7f2b14fd1640 1 -- 172.21.15.142:0/3095114352 <== osd.0 v2:172.21.15.31:6800/168281188 18 ==== osd_op_reply(71 notify.6 [notify cookie 93991757629712 out=8b] v0'0 uv138 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f2b00029040 con 0x7f2b10065030 2024-09-22T08:36:48.108 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.096+0000 7f29ebfff640 1 -- 172.21.15.142:0/3095114352 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f2948003400 con 0x7f2b10065030 2024-09-22T08:36:48.108 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.096+0000 7f2b14fd1640 1 -- 172.21.15.142:0/3095114352 <== osd.0 v2:172.21.15.31:6800/168281188 19 ==== osd_op_reply(72 notify.6 [notify-ack] v0'0 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b00029040 con 0x7f2b10065030 2024-09-22T08:36:48.108 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.096+0000 7f2b14fd1640 1 -- 172.21.15.142:0/3095114352 <== osd.0 v2:172.21.15.31:6800/168281188 20 ==== watch-notify(notify_complete (2) cookie 93991757629712 notify 128849018895 ret 0) ==== 42+0+48 (crc 0 0 0) 0x557c29241a20 con 0x7f2b10065030 2024-09-22T08:36:48.108 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.096+0000 7f2b19b24800 1 -- 172.21.15.142:0/3095114352 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:73 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557c29534dc0 con 0x557c294e6290 2024-09-22T08:36:48.108 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.097+0000 7f2b14fd1640 1 -- 172.21.15.142:0/3095114352 <== osd.1 v2:172.21.15.142:6816/3192108003 25 ==== osd_op_reply(73 testx/myfoo [call,delete] v30'2 uv2 ondisk = 0) ==== 197+0+0 (crc 0 0 0) 0x7f2b00029040 con 0x557c294e6290 2024-09-22T08:36:48.108 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.097+0000 7f2b19b24800 10 removing default.rgw.meta+root+testx/myfoo from cache 2024-09-22T08:36:48.108 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.097+0000 7f2b19b24800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:testx/myfoo, ofs0, ns] 2024-09-22T08:36:48.109 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.097+0000 7f2b19b24800 1 -- 172.21.15.142:0/3095114352 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [notify cookie 93991757629712 in=167b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x557c29534d30 con 0x557c294e6290 2024-09-22T08:36:48.109 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.098+0000 7f2b14fd1640 1 -- 172.21.15.142:0/3095114352 <== osd.1 v2:172.21.15.142:6816/3192108003 26 ==== watch-notify(notify (1) cookie 93991757369312 notify 128849018892 ret 0) ==== 197+0+0 (crc 0 0 0) 0x557c29241a20 con 0x557c294e6290 2024-09-22T08:36:48.109 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.098+0000 7f29f8ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018892 cookie 93991757369312 notifier 4555 bl.length()=155 2024-09-22T08:36:48.109 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.098+0000 7f29f8ff9640 1 -- 172.21.15.142:0/3095114352 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f29d8003ea0 con 0x557c294e6290 2024-09-22T08:36:48.109 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.098+0000 7f2b14fd1640 1 -- 172.21.15.142:0/3095114352 <== osd.1 v2:172.21.15.142:6816/3192108003 27 ==== osd_op_reply(74 notify.4 [notify cookie 93991757629712 out=8b] v0'0 uv138 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f2b00029040 con 0x557c294e6290 2024-09-22T08:36:48.109 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.098+0000 7f2b14fd1640 1 -- 172.21.15.142:0/3095114352 <== osd.1 v2:172.21.15.142:6816/3192108003 28 ==== osd_op_reply(75 notify.4 [notify-ack] v0'0 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b00029040 con 0x557c294e6290 2024-09-22T08:36:48.109 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.098+0000 7f2b14fd1640 1 -- 172.21.15.142:0/3095114352 <== osd.1 v2:172.21.15.142:6816/3192108003 29 ==== watch-notify(notify_complete (2) cookie 93991757629712 notify 128849018892 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f2b0002d960 con 0x557c294e6290 2024-09-22T08:36:48.109 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.098+0000 7f2b19b24800 1 -- 172.21.15.142:0/3095114352 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:76 8.c 8:35339db6:root::.bucket.meta.testx%3amyfoo%3ae239248c-0bee-4e41-803a-24b288d3eb8f.4226.1:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557c29535330 con 0x557c294e6290 2024-09-22T08:36:48.109 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.099+0000 7f2b14fd1640 1 -- 172.21.15.142:0/3095114352 <== osd.1 v2:172.21.15.142:6816/3192108003 30 ==== osd_op_reply(76 .bucket.meta.testx:myfoo:e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1 [call,delete] v30'4 uv4 ondisk = 0) ==== 254+0+0 (crc 0 0 0) 0x7f2b00029040 con 0x557c294e6290 2024-09-22T08:36:48.109 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.099+0000 7f2b19b24800 10 removing default.rgw.meta+root+.bucket.meta.testx:myfoo:e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1 from cache 2024-09-22T08:36:48.109 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.099+0000 7f2b19b24800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.testx:myfoo:e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1, ofs0, ns] 2024-09-22T08:36:48.109 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.099+0000 7f2b19b24800 1 -- 172.21.15.142:0/3095114352 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:77 7.15 7:a93a5511:::notify.2:head [notify cookie 93991757618368 in=224b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x557c29535330 con 0x557c294eac80 2024-09-22T08:36:48.110 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.099+0000 7f2b15fd3640 1 -- 172.21.15.142:0/3095114352 <== osd.3 v2:172.21.15.142:6800/1064901393 17 ==== watch-notify(notify (1) cookie 93991757362880 notify 128849018886 ret 0) ==== 254+0+0 (crc 0 0 0) 0x557c295356d0 con 0x557c294eac80 2024-09-22T08:36:48.110 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.099+0000 7f29ebfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018886 cookie 93991757362880 notifier 4555 bl.length()=212 2024-09-22T08:36:48.110 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.099+0000 7f29ebfff640 1 -- 172.21.15.142:0/3095114352 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:78 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f2948003470 con 0x557c294eac80 2024-09-22T08:36:48.110 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.099+0000 7f2b15fd3640 1 -- 172.21.15.142:0/3095114352 <== osd.3 v2:172.21.15.142:6800/1064901393 18 ==== osd_op_reply(77 notify.2 [notify cookie 93991757618368 out=8b] v0'0 uv138 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f2b0803a070 con 0x557c294eac80 2024-09-22T08:36:48.110 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.099+0000 7f2b15fd3640 1 -- 172.21.15.142:0/3095114352 <== osd.3 v2:172.21.15.142:6800/1064901393 19 ==== osd_op_reply(78 notify.2 [notify-ack] v0'0 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b0803a070 con 0x557c294eac80 2024-09-22T08:36:48.110 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.100+0000 7f2b15fd3640 1 -- 172.21.15.142:0/3095114352 <== osd.3 v2:172.21.15.142:6800/1064901393 20 ==== watch-notify(notify_complete (2) cookie 93991757618368 notify 128849018886 ret 0) ==== 42+0+48 (crc 0 0 0) 0x557c294daec0 con 0x557c294eac80 2024-09-22T08:36:48.110 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.100+0000 7f29cb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:36:48.110 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.100+0000 7f2b19b24800 1 -- 172.21.15.142:0/3095114352 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:79 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93991757390432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557c29535330 con 0x557c294e6290 2024-09-22T08:36:48.115 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.101+0000 7f2b14fd1640 1 -- 172.21.15.142:0/3095114352 <== osd.1 v2:172.21.15.142:6816/3192108003 31 ==== osd_op_reply(79 data_loggenerations_metadata [watch unwatch cookie 93991757390432] v30'133 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2b00029040 con 0x557c294e6290 2024-09-22T08:36:48.115 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.101+0000 7f2b19b24800 1 -- 172.21.15.142:0/3095114352 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:80 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93991757354160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557c29535330 con 0x7f2b0803b6d0 2024-09-22T08:36:48.115 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.102+0000 7f2b157d2640 1 -- 172.21.15.142:0/3095114352 <== osd.2 v2:172.21.15.142:6808/279438927 17 ==== osd_op_reply(80 notify.0 [watch unwatch cookie 93991757354160] v30'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b10058030 con 0x7f2b0803b6d0 2024-09-22T08:36:48.115 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.102+0000 7f2b19b24800 20 remove_watcher() i=0 2024-09-22T08:36:48.115 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.102+0000 7f2b19b24800 2 removed watcher, disabling cache 2024-09-22T08:36:48.115 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.102+0000 7f2b19b24800 1 -- 172.21.15.142:0/3095114352 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:81 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93991757358032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557c29535330 con 0x557c294e6290 2024-09-22T08:36:48.115 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.103+0000 7f2b14fd1640 1 -- 172.21.15.142:0/3095114352 <== osd.1 v2:172.21.15.142:6816/3192108003 32 ==== osd_op_reply(81 notify.1 [watch unwatch cookie 93991757358032] v30'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b00029040 con 0x557c294e6290 2024-09-22T08:36:48.115 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.103+0000 7f2b19b24800 20 remove_watcher() i=1 2024-09-22T08:36:48.115 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.103+0000 7f2b19b24800 1 -- 172.21.15.142:0/3095114352 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:82 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93991757362880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557c29535330 con 0x557c294eac80 2024-09-22T08:36:48.116 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.104+0000 7f2b15fd3640 1 -- 172.21.15.142:0/3095114352 <== osd.3 v2:172.21.15.142:6800/1064901393 21 ==== osd_op_reply(82 notify.2 [watch unwatch cookie 93991757362880] v30'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b0803a070 con 0x557c294eac80 2024-09-22T08:36:48.116 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.105+0000 7f2b19b24800 20 remove_watcher() i=2 2024-09-22T08:36:48.116 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.105+0000 7f2b19b24800 1 -- 172.21.15.142:0/3095114352 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:83 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93991757365248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557c29535330 con 0x7f2b0803b6d0 2024-09-22T08:36:48.116 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.105+0000 7f2b157d2640 1 -- 172.21.15.142:0/3095114352 <== osd.2 v2:172.21.15.142:6808/279438927 18 ==== osd_op_reply(83 notify.3 [watch unwatch cookie 93991757365248] v30'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b10058030 con 0x7f2b0803b6d0 2024-09-22T08:36:48.116 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.105+0000 7f2b19b24800 20 remove_watcher() i=3 2024-09-22T08:36:48.116 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.105+0000 7f2b19b24800 1 -- 172.21.15.142:0/3095114352 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:84 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93991757369312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557c29535330 con 0x557c294e6290 2024-09-22T08:36:48.116 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.107+0000 7f2b14fd1640 1 -- 172.21.15.142:0/3095114352 <== osd.1 v2:172.21.15.142:6816/3192108003 33 ==== osd_op_reply(84 notify.4 [watch unwatch cookie 93991757369312] v30'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b00029040 con 0x557c294e6290 2024-09-22T08:36:48.116 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.107+0000 7f2b19b24800 20 remove_watcher() i=4 2024-09-22T08:36:48.116 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.107+0000 7f2b19b24800 1 -- 172.21.15.142:0/3095114352 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:85 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93991757373328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557c29535330 con 0x7f2b10065030 2024-09-22T08:36:48.116 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.108+0000 7f2b14fd1640 1 -- 172.21.15.142:0/3095114352 <== osd.0 v2:172.21.15.31:6800/168281188 21 ==== osd_op_reply(85 notify.5 [watch unwatch cookie 93991757373328] v30'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b00029040 con 0x7f2b10065030 2024-09-22T08:36:48.116 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.108+0000 7f2b19b24800 20 remove_watcher() i=5 2024-09-22T08:36:48.116 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.108+0000 7f2b19b24800 1 -- 172.21.15.142:0/3095114352 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:86 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93991757367040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557c29535330 con 0x7f2b10065030 2024-09-22T08:36:48.116 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.109+0000 7f2b14fd1640 1 -- 172.21.15.142:0/3095114352 <== osd.0 v2:172.21.15.31:6800/168281188 22 ==== osd_op_reply(86 notify.6 [watch unwatch cookie 93991757367040] v30'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b00029040 con 0x7f2b10065030 2024-09-22T08:36:48.117 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.109+0000 7f2b19b24800 20 remove_watcher() i=6 2024-09-22T08:36:48.117 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.109+0000 7f2b19b24800 1 -- 172.21.15.142:0/3095114352 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:87 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93991757376000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557c29535330 con 0x7f2b10065030 2024-09-22T08:36:48.117 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.110+0000 7f2b14fd1640 1 -- 172.21.15.142:0/3095114352 <== osd.0 v2:172.21.15.31:6800/168281188 23 ==== osd_op_reply(87 notify.7 [watch unwatch cookie 93991757376000] v30'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b00029040 con 0x7f2b10065030 2024-09-22T08:36:48.117 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.110+0000 7f2b19b24800 20 remove_watcher() i=7 2024-09-22T08:36:48.117 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.110+0000 7f2b19b24800 1 -- 172.21.15.142:0/3095114352 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f2b10065030 msgr2=0x7f2b1005b450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:48.117 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.110+0000 7f2b19b24800 1 --2- 172.21.15.142:0/3095114352 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f2b10065030 0x7f2b1005b450 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:48.117 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.110+0000 7f2b19b24800 1 -- 172.21.15.142:0/3095114352 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x557c294e6290 msgr2=0x557c294e8750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:48.117 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.110+0000 7f2b19b24800 1 --2- 172.21.15.142:0/3095114352 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x557c294e6290 0x557c294e8750 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:48.117 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.110+0000 7f2b19b24800 1 -- 172.21.15.142:0/3095114352 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f2b0803b6d0 msgr2=0x7f2b08041570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:48.117 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.110+0000 7f2b19b24800 1 --2- 172.21.15.142:0/3095114352 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f2b0803b6d0 0x7f2b08041570 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:48.117 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.110+0000 7f2b19b24800 1 -- 172.21.15.142:0/3095114352 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x557c294eac80 msgr2=0x557c294ed070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:48.117 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.110+0000 7f2b19b24800 1 --2- 172.21.15.142:0/3095114352 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x557c294eac80 0x557c294ed070 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:48.117 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.110+0000 7f2b19b24800 1 -- 172.21.15.142:0/3095114352 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f29e003cfb0 msgr2=0x7f29e003f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:48.118 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.110+0000 7f2b19b24800 1 --2- 172.21.15.142:0/3095114352 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f29e003cfb0 0x7f29e003f470 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x557c294ad9b0 tx=0x7f2b1006cfc0 comp rx=0 tx=0).stop 2024-09-22T08:36:48.118 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.110+0000 7f2b19b24800 1 -- 172.21.15.142:0/3095114352 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557c294d3300 msgr2=0x557c294da960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:48.118 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.110+0000 7f2b14fd1640 1 -- 172.21.15.142:0/3095114352 reap_dead start 2024-09-22T08:36:48.118 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.110+0000 7f2b19b24800 1 --2- 172.21.15.142:0/3095114352 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557c294d3300 0x557c294da960 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f2b08054800 tx=0x7f2b08054860 comp rx=0 tx=0).stop 2024-09-22T08:36:48.118 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.110+0000 7f2b19b24800 1 -- 172.21.15.142:0/3095114352 shutdown_connections 2024-09-22T08:36:48.118 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.110+0000 7f2b19b24800 1 --2- 172.21.15.142:0/3095114352 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557c294d3300 0x557c294da960 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:48.118 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.110+0000 7f2b19b24800 1 -- 172.21.15.142:0/3095114352 >> 172.21.15.142:0/3095114352 conn(0x557c294cf720 msgr2=0x557c294cd930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:48.118 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.110+0000 7f2b19b24800 1 -- 172.21.15.142:0/3095114352 shutdown_connections 2024-09-22T08:36:48.118 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.110+0000 7f2b19b24800 1 -- 172.21.15.142:0/3095114352 wait complete. 2024-09-22T08:36:48.118 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.110+0000 7f2b19b24800 1 -- 172.21.15.142:0/2032808544 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f29ec03cfb0 msgr2=0x7f29ec03f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:48.118 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.110+0000 7f2b19b24800 1 --2- 172.21.15.142:0/2032808544 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f29ec03cfb0 0x7f29ec03f470 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f2b1006cb00 tx=0x7f2b10099040 comp rx=0 tx=0).stop 2024-09-22T08:36:48.118 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.110+0000 7f2b19b24800 1 -- 172.21.15.142:0/2032808544 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557c294c6820 msgr2=0x557c294c6c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:48.118 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.110+0000 7f2b19b24800 1 --2- 172.21.15.142:0/2032808544 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557c294c6820 0x557c294c6c40 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x557c294ac8b0 tx=0x7f2b080167b0 comp rx=0 tx=0).stop 2024-09-22T08:36:48.118 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.111+0000 7f2b19b24800 1 -- 172.21.15.142:0/2032808544 shutdown_connections 2024-09-22T08:36:48.119 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.111+0000 7f2b19b24800 1 --2- 172.21.15.142:0/2032808544 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f29ec03cfb0 0x7f29ec03f470 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:48.119 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.111+0000 7f2b19b24800 1 --2- 172.21.15.142:0/2032808544 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557c294c6820 0x557c294c6c40 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:48.119 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.111+0000 7f2b19b24800 1 -- 172.21.15.142:0/2032808544 >> 172.21.15.142:0/2032808544 conn(0x557c294babd0 msgr2=0x557c294bafb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:48.119 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.111+0000 7f2b19b24800 1 -- 172.21.15.142:0/2032808544 shutdown_connections 2024-09-22T08:36:48.119 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.111+0000 7f2b19b24800 1 -- 172.21.15.142:0/2032808544 wait complete. 2024-09-22T08:36:48.119 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.111+0000 7f2b19b24800 1 -- 172.21.15.142:0/1211048932 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x557c293b8700 msgr2=0x557c294b2f00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:48.119 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.111+0000 7f2b19b24800 1 --2- 172.21.15.142:0/1211048932 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x557c293b8700 0x557c294b2f00 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:48.119 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.111+0000 7f2b19b24800 1 -- 172.21.15.142:0/1211048932 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x557c294b52e0 msgr2=0x557c294b7780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:48.119 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.111+0000 7f2b19b24800 1 --2- 172.21.15.142:0/1211048932 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x557c294b52e0 0x557c294b7780 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:48.119 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.111+0000 7f2b19b24800 1 -- 172.21.15.142:0/1211048932 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f29fc03cfb0 msgr2=0x7f29fc03f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:48.119 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.111+0000 7f2b19b24800 1 --2- 172.21.15.142:0/1211048932 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f29fc03cfb0 0x7f29fc03f470 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f2b00001d70 tx=0x7f2b000012d0 comp rx=0 tx=0).stop 2024-09-22T08:36:48.119 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.111+0000 7f2b19b24800 1 -- 172.21.15.142:0/1211048932 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557c293b5da0 msgr2=0x557c294ab8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:48.119 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.111+0000 7f2b19b24800 1 --2- 172.21.15.142:0/1211048932 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557c293b5da0 0x557c294ab8b0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f2b10027ae0 tx=0x7f2b10002fb0 comp rx=0 tx=0).stop 2024-09-22T08:36:48.119 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.111+0000 7f2b19b24800 1 -- 172.21.15.142:0/1211048932 shutdown_connections 2024-09-22T08:36:48.120 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.111+0000 7f2b19b24800 1 --2- 172.21.15.142:0/1211048932 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x557c294b52e0 0x557c294b7780 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:48.120 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.111+0000 7f2b19b24800 1 --2- 172.21.15.142:0/1211048932 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x557c293b8700 0x557c294b2f00 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:48.120 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.111+0000 7f2b19b24800 1 --2- 172.21.15.142:0/1211048932 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f29fc03cfb0 0x7f29fc03f470 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:48.120 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.111+0000 7f2b19b24800 1 --2- 172.21.15.142:0/1211048932 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557c293b5da0 0x557c294ab8b0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:48.120 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.111+0000 7f2b19b24800 1 -- 172.21.15.142:0/1211048932 >> 172.21.15.142:0/1211048932 conn(0x557c293b0310 msgr2=0x557c294a5220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:48.120 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.111+0000 7f2b19b24800 1 -- 172.21.15.142:0/1211048932 shutdown_connections 2024-09-22T08:36:48.120 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.111+0000 7f2b19b24800 1 -- 172.21.15.142:0/1211048932 wait complete. 2024-09-22T08:36:48.121 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-09-22T08:36:48.121 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-09-22T08:36:48.121 DEBUG:teuthology.orchestra.run.smithi142:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --tenant testx --uid tenanteduser 2024-09-22T08:36:48.168 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:36:48.168 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:36:48.169 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.168+0000 7f546d725800 1 Processor -- start 2024-09-22T08:36:48.169 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.168+0000 7f546d725800 1 -- start start 2024-09-22T08:36:48.169 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.168+0000 7f546d725800 1 --2- >> v2:172.21.15.31:3300/0 conn(0x5613cef899e0 0x5613cef8bea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:48.170 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.168+0000 7f546d725800 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5613cee10a20 con 0x5613ceef9550 2024-09-22T08:36:48.170 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.168+0000 7f546d725800 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x5613cee107d0 con 0x5613cef899e0 2024-09-22T08:36:48.170 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.169+0000 7f5468ca1640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x5613cef899e0 0x5613cef8bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:48.170 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.169+0000 7f54694a2640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x5613ceef9550 0x5613cef88150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.142:42650/0 (socket says 172.21.15.142:42650) 2024-09-22T08:36:48.170 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.169+0000 7f54694a2640 1 -- 172.21.15.142:0/634087094 learned_addr learned my addr 172.21.15.142:0/634087094 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-09-22T08:36:48.171 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.169+0000 7f5468ca1640 1 -- 172.21.15.142:0/634087094 >> v1:172.21.15.31:6789/0 conn(0x5613ceef9550 legacy=0x5613cef88150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:48.171 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.169+0000 7f5468ca1640 1 -- 172.21.15.142:0/634087094 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5613cef8d580 con 0x5613cef899e0 2024-09-22T08:36:48.172 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.171+0000 7f5468ca1640 1 --2- 172.21.15.142:0/634087094 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5613cef899e0 0x5613cef8bea0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f546000a470 tx=0x7f5460045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c33e86086eac2f12 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:48.172 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.171+0000 7f545bfff640 1 -- 172.21.15.142:0/634087094 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5460053570 con 0x5613cef899e0 2024-09-22T08:36:48.172 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.171+0000 7f545bfff640 1 -- 172.21.15.142:0/634087094 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5460058070 con 0x5613cef899e0 2024-09-22T08:36:48.172 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.171+0000 7f545bfff640 1 -- 172.21.15.142:0/634087094 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5460053880 con 0x5613cef899e0 2024-09-22T08:36:48.173 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.171+0000 7f546d725800 1 -- 172.21.15.142:0/634087094 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5613cef899e0 msgr2=0x5613cef8bea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:48.173 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.171+0000 7f546d725800 1 --2- 172.21.15.142:0/634087094 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5613cef899e0 0x5613cef8bea0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f546000a470 tx=0x7f5460045a20 comp rx=0 tx=0).stop 2024-09-22T08:36:48.173 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.171+0000 7f546d725800 1 -- 172.21.15.142:0/634087094 shutdown_connections 2024-09-22T08:36:48.173 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.171+0000 7f546d725800 1 --2- 172.21.15.142:0/634087094 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5613cef899e0 0x5613cef8bea0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:48.173 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.171+0000 7f546d725800 1 -- 172.21.15.142:0/634087094 >> 172.21.15.142:0/634087094 conn(0x5613cef7fbe0 msgr2=0x5613cef82020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:48.173 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.171+0000 7f546d725800 1 -- 172.21.15.142:0/634087094 shutdown_connections 2024-09-22T08:36:48.173 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.171+0000 7f546d725800 1 -- 172.21.15.142:0/634087094 wait complete. 2024-09-22T08:36:48.187 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.185+0000 7f546d725800 1 Processor -- start 2024-09-22T08:36:48.187 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.185+0000 7f546d725800 1 -- start start 2024-09-22T08:36:48.187 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.185+0000 7f546d725800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5613ceef9550 0x5613cf074ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:48.187 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.185+0000 7f546d725800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5613cee1ddd0 con 0x5613ceef9550 2024-09-22T08:36:48.187 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.185+0000 7f54694a2640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5613ceef9550 0x5613cf074ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:48.187 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.185+0000 7f54694a2640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5613ceef9550 0x5613cf074ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:40016/0 (socket says 172.21.15.142:40016) 2024-09-22T08:36:48.188 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.185+0000 7f54694a2640 1 -- 172.21.15.142:0/919016459 learned_addr learned my addr 172.21.15.142:0/919016459 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:48.188 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.186+0000 7f54694a2640 1 -- 172.21.15.142:0/919016459 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5613cf0755e0 con 0x5613ceef9550 2024-09-22T08:36:48.188 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.186+0000 7f54694a2640 1 --2- 172.21.15.142:0/919016459 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5613ceef9550 0x5613cf074ff0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f545c001e40 tx=0x7f545c001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ceddbb4cc2f3ae4b server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:48.188 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.186+0000 7f5357606640 1 -- 172.21.15.142:0/919016459 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f545c012020 con 0x5613ceef9550 2024-09-22T08:36:48.188 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.186+0000 7f5357606640 1 -- 172.21.15.142:0/919016459 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f545c00e5a0 con 0x5613ceef9550 2024-09-22T08:36:48.188 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.186+0000 7f5357606640 1 -- 172.21.15.142:0/919016459 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f545c00e8a0 con 0x5613ceef9550 2024-09-22T08:36:48.191 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.187+0000 7f546d725800 1 -- 172.21.15.142:0/919016459 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5613ceef9550 msgr2=0x5613cf074ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:48.191 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.187+0000 7f546d725800 1 --2- 172.21.15.142:0/919016459 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5613ceef9550 0x5613cf074ff0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f545c001e40 tx=0x7f545c001e70 comp rx=0 tx=0).stop 2024-09-22T08:36:48.192 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.187+0000 7f546d725800 1 -- 172.21.15.142:0/919016459 shutdown_connections 2024-09-22T08:36:48.192 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.187+0000 7f546d725800 1 --2- 172.21.15.142:0/919016459 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5613ceef9550 0x5613cf074ff0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:48.192 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.187+0000 7f546d725800 1 -- 172.21.15.142:0/919016459 >> 172.21.15.142:0/919016459 conn(0x5613cef7fbe0 msgr2=0x5613cf070970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:48.192 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.187+0000 7f546d725800 1 -- 172.21.15.142:0/919016459 shutdown_connections 2024-09-22T08:36:48.192 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.187+0000 7f546d725800 1 -- 172.21.15.142:0/919016459 wait complete. 2024-09-22T08:36:48.192 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.187+0000 7f546d725800 1 Processor -- start 2024-09-22T08:36:48.192 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.187+0000 7f546d725800 1 -- start start 2024-09-22T08:36:48.192 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.187+0000 7f546d725800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5613ceef9550 0x5613cf07cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:48.192 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.187+0000 7f546d725800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5613cef8c820 con 0x5613ceef9550 2024-09-22T08:36:48.192 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.187+0000 7f54694a2640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5613ceef9550 0x5613cf07cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:48.192 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.187+0000 7f54694a2640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5613ceef9550 0x5613cf07cb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:40030/0 (socket says 172.21.15.142:40030) 2024-09-22T08:36:48.192 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.187+0000 7f54694a2640 1 -- 172.21.15.142:0/1824562721 learned_addr learned my addr 172.21.15.142:0/1824562721 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:48.193 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.188+0000 7f54694a2640 1 -- 172.21.15.142:0/1824562721 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5613cf07d0a0 con 0x5613ceef9550 2024-09-22T08:36:48.193 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.188+0000 7f54694a2640 1 --2- 172.21.15.142:0/1824562721 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5613ceef9550 0x5613cf07cb40 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f545c00c010 tx=0x7f545c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:48.193 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.188+0000 7f5355e03640 1 -- 172.21.15.142:0/1824562721 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f545c012030 con 0x5613ceef9550 2024-09-22T08:36:48.193 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.188+0000 7f5355e03640 1 -- 172.21.15.142:0/1824562721 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f545c0014a0 con 0x5613ceef9550 2024-09-22T08:36:48.193 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.188+0000 7f546d725800 1 -- 172.21.15.142:0/1824562721 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5613cf07d330 con 0x5613ceef9550 2024-09-22T08:36:48.193 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.188+0000 7f5355e03640 1 -- 172.21.15.142:0/1824562721 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f545c01a7a0 con 0x5613ceef9550 2024-09-22T08:36:48.193 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.188+0000 7f546d725800 1 -- 172.21.15.142:0/1824562721 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5613cf07dd30 con 0x5613ceef9550 2024-09-22T08:36:48.193 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.189+0000 7f5355e03640 1 -- 172.21.15.142:0/1824562721 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f545c015020 con 0x5613ceef9550 2024-09-22T08:36:48.193 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.189+0000 7f5355e03640 1 --2- 172.21.15.142:0/1824562721 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f535003cfb0 0x7f535003f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:48.193 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.189+0000 7f5355e03640 1 -- 172.21.15.142:0/1824562721 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f545c020030 con 0x5613ceef9550 2024-09-22T08:36:48.193 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.189+0000 7f5468ca1640 1 --2- 172.21.15.142:0/1824562721 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f535003cfb0 0x7f535003f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:48.194 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.189+0000 7f546d725800 1 --2- 172.21.15.142:0/1824562721 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5613cef899e0 0x5613cf084190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:48.194 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.189+0000 7f546d725800 1 -- 172.21.15.142:0/1824562721 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5613cf0846d0 con 0x5613cef899e0 2024-09-22T08:36:48.194 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.189+0000 7f5469ca3640 1 --2- 172.21.15.142:0/1824562721 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5613cef899e0 0x5613cf084190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:48.194 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.190+0000 7f5468ca1640 1 --2- 172.21.15.142:0/1824562721 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f535003cfb0 0x7f535003f470 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f5460057000 tx=0x7f5460052000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:48.194 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.190+0000 7f5469ca3640 1 --2- 172.21.15.142:0/1824562721 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5613cef899e0 0x5613cf084190 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:48.194 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.190+0000 7f5469ca3640 1 -- 172.21.15.142:0/1824562721 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f546400a4d0 con 0x5613cef899e0 2024-09-22T08:36:48.194 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.190+0000 7f546d725800 1 -- 172.21.15.142:0/1824562721 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5613cf084a70 con 0x5613cef899e0 2024-09-22T08:36:48.194 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.190+0000 7f5469ca3640 1 -- 172.21.15.142:0/1824562721 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f546400a4d0 con 0x5613cef899e0 2024-09-22T08:36:48.194 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.190+0000 7f546d725800 1 --2- 172.21.15.142:0/1824562721 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5613cf086530 0x5613cf0889d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:48.194 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.190+0000 7f546d725800 1 -- 172.21.15.142:0/1824562721 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:3 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5613cf089160 con 0x5613cf086530 2024-09-22T08:36:48.194 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.190+0000 7f54694a2640 1 --2- 172.21.15.142:0/1824562721 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5613cf086530 0x5613cf0889d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:48.194 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.190+0000 7f54694a2640 1 --2- 172.21.15.142:0/1824562721 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5613cf086530 0x5613cf0889d0 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:48.214 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.191+0000 7f54694a2640 1 -- 172.21.15.142:0/1824562721 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(3 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f545c01ab20 con 0x5613cf086530 2024-09-22T08:36:48.214 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.191+0000 7f546d725800 1 -- 172.21.15.142:0/1824562721 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5613cf0852c0 con 0x5613cef899e0 2024-09-22T08:36:48.214 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.191+0000 7f5469ca3640 1 -- 172.21.15.142:0/1824562721 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f546400a4d0 con 0x5613cef899e0 2024-09-22T08:36:48.214 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.191+0000 7f546d725800 1 -- 172.21.15.142:0/1824562721 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5613cf0856a0 con 0x5613cf086530 2024-09-22T08:36:48.214 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.191+0000 7f54694a2640 1 -- 172.21.15.142:0/1824562721 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(5 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f545c01ab20 con 0x5613cf086530 2024-09-22T08:36:48.214 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.192+0000 7f546d725800 1 Processor -- start 2024-09-22T08:36:48.214 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.192+0000 7f546d725800 1 -- start start 2024-09-22T08:36:48.214 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.192+0000 7f546d725800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5613cf097b30 0x5613cf097f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:48.214 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.192+0000 7f546d725800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5613cee7cd50 con 0x5613cf097b30 2024-09-22T08:36:48.215 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.192+0000 7f5469ca3640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5613cf097b30 0x5613cf097f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:48.215 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.192+0000 7f5469ca3640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5613cf097b30 0x5613cf097f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:40044/0 (socket says 172.21.15.142:40044) 2024-09-22T08:36:48.215 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.192+0000 7f5469ca3640 1 -- 172.21.15.142:0/1859299121 learned_addr learned my addr 172.21.15.142:0/1859299121 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:48.215 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.192+0000 7f5469ca3640 1 -- 172.21.15.142:0/1859299121 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5613cf098590 con 0x5613cf097b30 2024-09-22T08:36:48.215 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.193+0000 7f5469ca3640 1 --2- 172.21.15.142:0/1859299121 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5613cf097b30 0x5613cf097f50 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x5613cf07d9d0 tx=0x7f54640167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:48.215 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.193+0000 7f534effd640 1 -- 172.21.15.142:0/1859299121 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5464013640 con 0x5613cf097b30 2024-09-22T08:36:48.215 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.193+0000 7f534effd640 1 -- 172.21.15.142:0/1859299121 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54640137e0 con 0x5613cf097b30 2024-09-22T08:36:48.215 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.193+0000 7f534effd640 1 -- 172.21.15.142:0/1859299121 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5464013b00 con 0x5613cf097b30 2024-09-22T08:36:48.215 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.193+0000 7f546d725800 1 -- 172.21.15.142:0/1859299121 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5613cf098dc0 con 0x5613cf097b30 2024-09-22T08:36:48.215 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.193+0000 7f546d725800 1 -- 172.21.15.142:0/1859299121 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5613cf099360 con 0x5613cf097b30 2024-09-22T08:36:48.215 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.194+0000 7f534effd640 1 -- 172.21.15.142:0/1859299121 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f5464011040 con 0x5613cf097b30 2024-09-22T08:36:48.215 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.194+0000 7f534effd640 1 --2- 172.21.15.142:0/1859299121 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f534403cfb0 0x7f534403f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:48.216 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.194+0000 7f534effd640 1 -- 172.21.15.142:0/1859299121 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f546400e040 con 0x5613cf097b30 2024-09-22T08:36:48.216 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.194+0000 7f54694a2640 1 --2- 172.21.15.142:0/1859299121 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f534403cfb0 0x7f534403f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:48.216 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.194+0000 7f546d725800 1 Processor -- start 2024-09-22T08:36:48.216 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.194+0000 7f546d725800 1 -- start start 2024-09-22T08:36:48.216 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.194+0000 7f54694a2640 1 --2- 172.21.15.142:0/1859299121 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f534403cfb0 0x7f534403f470 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x5613cf07ec40 tx=0x7f545c0529c0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:48.216 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.194+0000 7f546d725800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5613cf0a45f0 0x5613cf0a49f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:48.216 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.194+0000 7f546d725800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5613cf075a10 con 0x5613cf0a45f0 2024-09-22T08:36:48.216 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.195+0000 7f5469ca3640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5613cf0a45f0 0x5613cf0a49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:48.216 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.195+0000 7f5469ca3640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5613cf0a45f0 0x5613cf0a49f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:40060/0 (socket says 172.21.15.142:40060) 2024-09-22T08:36:48.216 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.195+0000 7f5469ca3640 1 -- 172.21.15.142:0/1769728072 learned_addr learned my addr 172.21.15.142:0/1769728072 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:48.216 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.195+0000 7f5469ca3640 1 -- 172.21.15.142:0/1769728072 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5613cf0a4fe0 con 0x5613cf0a45f0 2024-09-22T08:36:48.216 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.195+0000 7f5469ca3640 1 --2- 172.21.15.142:0/1769728072 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5613cf0a45f0 0x5613cf0a49f0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f5464054840 tx=0x7f546401f340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a38892542879af4 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:48.216 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.195+0000 7f534cff9640 1 -- 172.21.15.142:0/1769728072 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5464051020 con 0x5613cf0a45f0 2024-09-22T08:36:48.217 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.195+0000 7f534cff9640 1 -- 172.21.15.142:0/1769728072 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5464056070 con 0x5613cf0a45f0 2024-09-22T08:36:48.217 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.195+0000 7f534cff9640 1 -- 172.21.15.142:0/1769728072 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f546402aa40 con 0x5613cf0a45f0 2024-09-22T08:36:48.217 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.195+0000 7f546d725800 1 -- 172.21.15.142:0/1769728072 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5613cf0a45f0 msgr2=0x5613cf0a49f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:48.217 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.195+0000 7f546d725800 1 --2- 172.21.15.142:0/1769728072 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5613cf0a45f0 0x5613cf0a49f0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f5464054840 tx=0x7f546401f340 comp rx=0 tx=0).stop 2024-09-22T08:36:48.217 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.196+0000 7f546d725800 1 -- 172.21.15.142:0/1769728072 shutdown_connections 2024-09-22T08:36:48.217 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.196+0000 7f546d725800 1 --2- 172.21.15.142:0/1769728072 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5613cf0a45f0 0x5613cf0a49f0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:48.217 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.196+0000 7f546d725800 1 -- 172.21.15.142:0/1769728072 >> 172.21.15.142:0/1769728072 conn(0x5613cf0a09f0 msgr2=0x5613cf09ec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:48.217 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.196+0000 7f546d725800 1 -- 172.21.15.142:0/1769728072 shutdown_connections 2024-09-22T08:36:48.217 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.196+0000 7f546d725800 1 -- 172.21.15.142:0/1769728072 wait complete. 2024-09-22T08:36:48.217 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.196+0000 7f546d725800 1 Processor -- start 2024-09-22T08:36:48.217 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.196+0000 7f546d725800 1 -- start start 2024-09-22T08:36:48.218 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.196+0000 7f546d725800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5613cf0a45f0 0x5613cf0abbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:48.218 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.196+0000 7f546d725800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5613cf0a5600 con 0x5613cf0a45f0 2024-09-22T08:36:48.218 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.196+0000 7f5469ca3640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5613cf0a45f0 0x5613cf0abbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:48.218 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.196+0000 7f5469ca3640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5613cf0a45f0 0x5613cf0abbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:40068/0 (socket says 172.21.15.142:40068) 2024-09-22T08:36:48.218 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.196+0000 7f5469ca3640 1 -- 172.21.15.142:0/1041748053 learned_addr learned my addr 172.21.15.142:0/1041748053 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:48.218 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.196+0000 7f5469ca3640 1 -- 172.21.15.142:0/1041748053 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5613cf0ac150 con 0x5613cf0a45f0 2024-09-22T08:36:48.218 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.197+0000 7f5469ca3640 1 --2- 172.21.15.142:0/1041748053 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5613cf0a45f0 0x5613cf0abbf0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f5464020f40 tx=0x7f5464054870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:48.218 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.197+0000 7f533affd640 1 -- 172.21.15.142:0/1041748053 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f546404b070 con 0x5613cf0a45f0 2024-09-22T08:36:48.218 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.197+0000 7f533affd640 1 -- 172.21.15.142:0/1041748053 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5464045ab0 con 0x5613cf0a45f0 2024-09-22T08:36:48.218 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.197+0000 7f546d725800 1 -- 172.21.15.142:0/1041748053 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5613cf0ac3e0 con 0x5613cf0a45f0 2024-09-22T08:36:48.218 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.197+0000 7f533affd640 1 -- 172.21.15.142:0/1041748053 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5464045d90 con 0x5613cf0a45f0 2024-09-22T08:36:48.218 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.197+0000 7f546d725800 1 -- 172.21.15.142:0/1041748053 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5613cf0acd60 con 0x5613cf0a45f0 2024-09-22T08:36:48.219 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.198+0000 7f533affd640 1 -- 172.21.15.142:0/1041748053 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f54640203a0 con 0x5613cf0a45f0 2024-09-22T08:36:48.219 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.198+0000 7f533affd640 1 --2- 172.21.15.142:0/1041748053 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f533403d000 0x7f533403f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:48.219 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.198+0000 7f533affd640 1 -- 172.21.15.142:0/1041748053 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f546402f030 con 0x5613cf0a45f0 2024-09-22T08:36:48.219 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.198+0000 7f54694a2640 1 --2- 172.21.15.142:0/1041748053 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f533403d000 0x7f533403f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:48.219 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.198+0000 7f54694a2640 1 --2- 172.21.15.142:0/1041748053 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f533403d000 0x7f533403f4c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f545c001250 tx=0x7f545c02e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:48.219 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.198+0000 7f546d725800 20 rados->read ofs=0 len=0 2024-09-22T08:36:48.219 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.199+0000 7f546d725800 1 --2- 172.21.15.142:0/1041748053 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5613cf0b7490 0x5613cf0b9950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:48.219 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.199+0000 7f546d725800 1 -- 172.21.15.142:0/1041748053 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5613cf0ba0a0 con 0x5613cf0b7490 2024-09-22T08:36:48.219 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.199+0000 7f5468ca1640 1 --2- 172.21.15.142:0/1041748053 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5613cf0b7490 0x5613cf0b9950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:48.219 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.199+0000 7f5468ca1640 1 --2- 172.21.15.142:0/1041748053 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5613cf0b7490 0x5613cf0b9950 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:48.219 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.199+0000 7f5468ca1640 1 -- 172.21.15.142:0/1041748053 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5460051070 con 0x5613cf0b7490 2024-09-22T08:36:48.219 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.199+0000 7f546d725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:48.219 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.199+0000 7f546d725800 20 realm 2024-09-22T08:36:48.220 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.199+0000 7f546d725800 20 rados->read ofs=0 len=0 2024-09-22T08:36:48.220 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.199+0000 7f546d725800 1 -- 172.21.15.142:0/1041748053 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5613cf0ba4d0 con 0x5613cf0b7490 2024-09-22T08:36:48.220 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.199+0000 7f5468ca1640 1 -- 172.21.15.142:0/1041748053 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5460051070 con 0x5613cf0b7490 2024-09-22T08:36:48.220 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.199+0000 7f546d725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:48.220 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.199+0000 7f546d725800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:36:48.220 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.199+0000 7f546d725800 20 rados->read ofs=0 len=0 2024-09-22T08:36:48.220 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.199+0000 7f546d725800 1 -- 172.21.15.142:0/1041748053 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5613cf0bada0 con 0x5613cf0b7490 2024-09-22T08:36:48.220 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.200+0000 7f5468ca1640 1 -- 172.21.15.142:0/1041748053 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5460051070 con 0x5613cf0b7490 2024-09-22T08:36:48.220 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.200+0000 7f546d725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:48.220 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.200+0000 7f546d725800 20 rados->read ofs=0 len=0 2024-09-22T08:36:48.220 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.200+0000 7f546d725800 1 -- 172.21.15.142:0/1041748053 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5613cf0bb140 con 0x5613cf0b7490 2024-09-22T08:36:48.220 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.200+0000 7f5468ca1640 1 -- 172.21.15.142:0/1041748053 <== osd.1 v2:172.21.15.142:6816/3192108003 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5460051070 con 0x5613cf0b7490 2024-09-22T08:36:48.221 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.200+0000 7f546d725800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:36:48.221 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.200+0000 7f546d725800 20 rados->read ofs=0 len=0 2024-09-22T08:36:48.221 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.200+0000 7f546d725800 1 --2- 172.21.15.142:0/1041748053 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5613cf0bbea0 0x5613cf0be290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:48.221 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.200+0000 7f546d725800 1 -- 172.21.15.142:0/1041748053 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5613cf0be8a0 con 0x5613cf0bbea0 2024-09-22T08:36:48.221 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.200+0000 7f5469ca3640 1 --2- 172.21.15.142:0/1041748053 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5613cf0bbea0 0x5613cf0be290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:48.221 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.200+0000 7f5469ca3640 1 --2- 172.21.15.142:0/1041748053 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5613cf0bbea0 0x5613cf0be290 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:48.221 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.200+0000 7f5469ca3640 1 -- 172.21.15.142:0/1041748053 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(5 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f546400a4d0 con 0x5613cf0bbea0 2024-09-22T08:36:48.221 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.200+0000 7f546d725800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:36:48.221 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.201+0000 7f546d725800 20 searching for the correct realm 2024-09-22T08:36:48.221 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.201+0000 7f546d725800 1 -- 172.21.15.142:0/1041748053 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5613cf0c01d0 con 0x5613cf0bbea0 2024-09-22T08:36:48.221 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.201+0000 7f5469ca3640 1 -- 172.21.15.142:0/1041748053 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f546400a4d0 con 0x5613cf0bbea0 2024-09-22T08:36:48.221 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.201+0000 7f5469ca3640 1 --2- 172.21.15.142:0/1041748053 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f54640197d0 0x7f5464048090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:48.222 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.201+0000 7f5469ca3640 1 -- 172.21.15.142:0/1041748053 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5613cf0c01d0 con 0x7f54640197d0 2024-09-22T08:36:48.222 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.201+0000 7f54694a2640 1 --2- 172.21.15.142:0/1041748053 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f54640197d0 0x7f5464048090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:48.222 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.201+0000 7f54694a2640 1 --2- 172.21.15.142:0/1041748053 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f54640197d0 0x7f5464048090 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:48.222 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.201+0000 7f54694a2640 1 -- 172.21.15.142:0/1041748053 <== osd.2 v2:172.21.15.142:6808/279438927 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f545c01ab20 con 0x7f54640197d0 2024-09-22T08:36:48.222 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.201+0000 7f54694a2640 1 --2- 172.21.15.142:0/1041748053 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f545c017050 0x7f545c00c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:48.222 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.201+0000 7f54694a2640 1 -- 172.21.15.142:0/1041748053 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5613cf0c01d0 con 0x7f545c017050 2024-09-22T08:36:48.222 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.202+0000 7f5468ca1640 1 --2- 172.21.15.142:0/1041748053 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f545c017050 0x7f545c00c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:48.222 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.202+0000 7f5468ca1640 1 --2- 172.21.15.142:0/1041748053 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f545c017050 0x7f545c00c790 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:48.222 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.202+0000 7f5468ca1640 1 -- 172.21.15.142:0/1041748053 <== osd.0 v2:172.21.15.31:6800/168281188 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5460051070 con 0x7f545c017050 2024-09-22T08:36:48.222 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.202+0000 7f5468ca1640 1 -- 172.21.15.142:0/1041748053 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5613cf0c01d0 con 0x5613cf0b7490 2024-09-22T08:36:48.222 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.202+0000 7f5468ca1640 1 -- 172.21.15.142:0/1041748053 <== osd.1 v2:172.21.15.142:6816/3192108003 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5460051070 con 0x5613cf0b7490 2024-09-22T08:36:48.222 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.202+0000 7f5468ca1640 1 -- 172.21.15.142:0/1041748053 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5613cf0c01d0 con 0x5613cf0b7490 2024-09-22T08:36:48.223 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.203+0000 7f5468ca1640 1 -- 172.21.15.142:0/1041748053 <== osd.1 v2:172.21.15.142:6816/3192108003 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5460051070 con 0x5613cf0b7490 2024-09-22T08:36:48.223 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.203+0000 7f5468ca1640 1 -- 172.21.15.142:0/1041748053 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5613cf0c01d0 con 0x7f545c017050 2024-09-22T08:36:48.223 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.203+0000 7f5468ca1640 1 -- 172.21.15.142:0/1041748053 <== osd.0 v2:172.21.15.31:6800/168281188 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5460051070 con 0x7f545c017050 2024-09-22T08:36:48.223 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.203+0000 7f5468ca1640 1 -- 172.21.15.142:0/1041748053 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5613cf0c01d0 con 0x7f545c017050 2024-09-22T08:36:48.223 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.203+0000 7f5468ca1640 1 -- 172.21.15.142:0/1041748053 <== osd.0 v2:172.21.15.31:6800/168281188 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5460051070 con 0x7f545c017050 2024-09-22T08:36:48.223 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.203+0000 7f5468ca1640 1 -- 172.21.15.142:0/1041748053 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5613cf0c01d0 con 0x7f54640197d0 2024-09-22T08:36:48.223 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.203+0000 7f54694a2640 1 -- 172.21.15.142:0/1041748053 <== osd.2 v2:172.21.15.142:6808/279438927 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f545c01ab20 con 0x7f54640197d0 2024-09-22T08:36:48.223 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.203+0000 7f54694a2640 1 -- 172.21.15.142:0/1041748053 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5613cf0c01d0 con 0x5613cf0bbea0 2024-09-22T08:36:48.223 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.204+0000 7f5469ca3640 1 -- 172.21.15.142:0/1041748053 <== osd.3 v2:172.21.15.142:6800/1064901393 3 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f546400a4d0 con 0x5613cf0bbea0 2024-09-22T08:36:48.223 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.204+0000 7f5469ca3640 1 -- 172.21.15.142:0/1041748053 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5613cf0c01d0 con 0x5613cf0b7490 2024-09-22T08:36:48.223 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.204+0000 7f5468ca1640 1 -- 172.21.15.142:0/1041748053 <== osd.1 v2:172.21.15.142:6816/3192108003 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5460051070 con 0x5613cf0b7490 2024-09-22T08:36:48.224 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.204+0000 7f5468ca1640 1 -- 172.21.15.142:0/1041748053 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5613cf0c01d0 con 0x7f545c017050 2024-09-22T08:36:48.224 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.204+0000 7f5468ca1640 1 -- 172.21.15.142:0/1041748053 <== osd.0 v2:172.21.15.31:6800/168281188 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5460051070 con 0x7f545c017050 2024-09-22T08:36:48.224 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.204+0000 7f5468ca1640 1 -- 172.21.15.142:0/1041748053 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5613cf0c01d0 con 0x5613cf0b7490 2024-09-22T08:36:48.224 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.204+0000 7f5468ca1640 1 -- 172.21.15.142:0/1041748053 <== osd.1 v2:172.21.15.142:6816/3192108003 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5460051070 con 0x5613cf0b7490 2024-09-22T08:36:48.224 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.204+0000 7f5468ca1640 1 -- 172.21.15.142:0/1041748053 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5613cf0c01d0 con 0x7f54640197d0 2024-09-22T08:36:48.224 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.205+0000 7f54694a2640 1 -- 172.21.15.142:0/1041748053 <== osd.2 v2:172.21.15.142:6808/279438927 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f545c01ab20 con 0x7f54640197d0 2024-09-22T08:36:48.224 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.205+0000 7f54694a2640 1 -- 172.21.15.142:0/1041748053 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5613cf0c01d0 con 0x5613cf0bbea0 2024-09-22T08:36:48.224 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.205+0000 7f5469ca3640 1 -- 172.21.15.142:0/1041748053 <== osd.3 v2:172.21.15.142:6800/1064901393 4 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f546400a4d0 con 0x5613cf0bbea0 2024-09-22T08:36:48.224 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.205+0000 7f5469ca3640 1 -- 172.21.15.142:0/1041748053 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5613cf0c01d0 con 0x5613cf0bbea0 2024-09-22T08:36:48.224 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.205+0000 7f5469ca3640 1 -- 172.21.15.142:0/1041748053 <== osd.3 v2:172.21.15.142:6800/1064901393 5 ==== osd_op_reply(20 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f546400a4d0 con 0x5613cf0bbea0 2024-09-22T08:36:48.224 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.205+0000 7f5469ca3640 1 -- 172.21.15.142:0/1041748053 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5613cf0c01d0 con 0x7f545c017050 2024-09-22T08:36:48.224 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.205+0000 7f5468ca1640 1 -- 172.21.15.142:0/1041748053 <== osd.0 v2:172.21.15.31:6800/168281188 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5460051070 con 0x7f545c017050 2024-09-22T08:36:48.225 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.205+0000 7f5468ca1640 1 -- 172.21.15.142:0/1041748053 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5613cf0c01d0 con 0x5613cf0bbea0 2024-09-22T08:36:48.225 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.206+0000 7f5469ca3640 1 -- 172.21.15.142:0/1041748053 <== osd.3 v2:172.21.15.142:6800/1064901393 6 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f546400a4d0 con 0x5613cf0bbea0 2024-09-22T08:36:48.225 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.206+0000 7f5469ca3640 1 -- 172.21.15.142:0/1041748053 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5613cf0c01d0 con 0x5613cf0bbea0 2024-09-22T08:36:48.225 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.206+0000 7f5469ca3640 1 -- 172.21.15.142:0/1041748053 <== osd.3 v2:172.21.15.142:6800/1064901393 7 ==== osd_op_reply(23 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f546400a4d0 con 0x5613cf0bbea0 2024-09-22T08:36:48.225 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.206+0000 7f5469ca3640 1 -- 172.21.15.142:0/1041748053 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5613cf0c01d0 con 0x5613cf0b7490 2024-09-22T08:36:48.225 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.206+0000 7f5468ca1640 1 -- 172.21.15.142:0/1041748053 <== osd.1 v2:172.21.15.142:6816/3192108003 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5460051070 con 0x5613cf0b7490 2024-09-22T08:36:48.225 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.206+0000 7f5468ca1640 1 -- 172.21.15.142:0/1041748053 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5613cf0c01d0 con 0x5613cf0b7490 2024-09-22T08:36:48.225 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.206+0000 7f5468ca1640 1 -- 172.21.15.142:0/1041748053 <== osd.1 v2:172.21.15.142:6816/3192108003 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f5460051070 con 0x5613cf0b7490 2024-09-22T08:36:48.225 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.206+0000 7f5468ca1640 1 -- 172.21.15.142:0/1041748053 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5613cf0c01d0 con 0x7f545c017050 2024-09-22T08:36:48.225 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.206+0000 7f5468ca1640 1 -- 172.21.15.142:0/1041748053 <== osd.0 v2:172.21.15.31:6800/168281188 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5460051070 con 0x7f545c017050 2024-09-22T08:36:48.225 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.207+0000 7f5468ca1640 1 -- 172.21.15.142:0/1041748053 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5613cf0c01d0 con 0x5613cf0bbea0 2024-09-22T08:36:48.225 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.207+0000 7f5469ca3640 1 -- 172.21.15.142:0/1041748053 <== osd.3 v2:172.21.15.142:6800/1064901393 8 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f546400a4d0 con 0x5613cf0bbea0 2024-09-22T08:36:48.226 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.207+0000 7f5469ca3640 1 -- 172.21.15.142:0/1041748053 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5613cf0c01d0 con 0x7f54640197d0 2024-09-22T08:36:48.226 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.207+0000 7f54694a2640 1 -- 172.21.15.142:0/1041748053 <== osd.2 v2:172.21.15.142:6808/279438927 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f545c01ab20 con 0x7f54640197d0 2024-09-22T08:36:48.226 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.207+0000 7f54694a2640 1 -- 172.21.15.142:0/1041748053 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5613cf0c01d0 con 0x5613cf0b7490 2024-09-22T08:36:48.226 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.207+0000 7f5468ca1640 1 -- 172.21.15.142:0/1041748053 <== osd.1 v2:172.21.15.142:6816/3192108003 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5460051070 con 0x5613cf0b7490 2024-09-22T08:36:48.226 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.207+0000 7f5468ca1640 1 -- 172.21.15.142:0/1041748053 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5613cf0c01d0 con 0x7f545c017050 2024-09-22T08:36:48.226 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.207+0000 7f5468ca1640 1 -- 172.21.15.142:0/1041748053 <== osd.0 v2:172.21.15.31:6800/168281188 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5460051070 con 0x7f545c017050 2024-09-22T08:36:48.226 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.207+0000 7f5468ca1640 1 -- 172.21.15.142:0/1041748053 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5613cf0c01d0 con 0x5613cf0bbea0 2024-09-22T08:36:48.226 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.208+0000 7f5469ca3640 1 -- 172.21.15.142:0/1041748053 <== osd.3 v2:172.21.15.142:6800/1064901393 9 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f546400a4d0 con 0x5613cf0bbea0 2024-09-22T08:36:48.226 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.208+0000 7f5469ca3640 1 -- 172.21.15.142:0/1041748053 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5613cf0c01d0 con 0x7f545c017050 2024-09-22T08:36:48.226 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.208+0000 7f5468ca1640 1 -- 172.21.15.142:0/1041748053 <== osd.0 v2:172.21.15.31:6800/168281188 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5460051070 con 0x7f545c017050 2024-09-22T08:36:48.226 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.208+0000 7f5468ca1640 1 -- 172.21.15.142:0/1041748053 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5613cf0c01d0 con 0x7f54640197d0 2024-09-22T08:36:48.226 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.208+0000 7f54694a2640 1 -- 172.21.15.142:0/1041748053 <== osd.2 v2:172.21.15.142:6808/279438927 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f545c01ab20 con 0x7f54640197d0 2024-09-22T08:36:48.226 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.208+0000 7f54694a2640 1 -- 172.21.15.142:0/1041748053 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5613cf0c01d0 con 0x5613cf0bbea0 2024-09-22T08:36:48.226 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.208+0000 7f5469ca3640 1 -- 172.21.15.142:0/1041748053 <== osd.3 v2:172.21.15.142:6800/1064901393 10 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f546400a4d0 con 0x5613cf0bbea0 2024-09-22T08:36:48.227 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.208+0000 7f5469ca3640 1 -- 172.21.15.142:0/1041748053 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5613cf0c01d0 con 0x7f545c017050 2024-09-22T08:36:48.227 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.209+0000 7f5468ca1640 1 -- 172.21.15.142:0/1041748053 <== osd.0 v2:172.21.15.31:6800/168281188 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5460051070 con 0x7f545c017050 2024-09-22T08:36:48.227 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.209+0000 7f5468ca1640 1 -- 172.21.15.142:0/1041748053 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5613cf0c01d0 con 0x5613cf0b7490 2024-09-22T08:36:48.227 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.209+0000 7f5468ca1640 1 -- 172.21.15.142:0/1041748053 <== osd.1 v2:172.21.15.142:6816/3192108003 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f5460051070 con 0x5613cf0b7490 2024-09-22T08:36:48.227 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.209+0000 7f5468ca1640 1 -- 172.21.15.142:0/1041748053 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5613cf0c01d0 con 0x7f54640197d0 2024-09-22T08:36:48.227 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.209+0000 7f54694a2640 1 -- 172.21.15.142:0/1041748053 <== osd.2 v2:172.21.15.142:6808/279438927 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f545c01ab20 con 0x7f54640197d0 2024-09-22T08:36:48.227 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.209+0000 7f546d725800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:36:48.227 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.209+0000 7f546d725800 20 RGWRados::pool_iterate: got zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec 2024-09-22T08:36:48.227 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.209+0000 7f546d725800 20 RGWRados::pool_iterate: got zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f 2024-09-22T08:36:48.227 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.209+0000 7f546d725800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:36:48.227 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.209+0000 7f546d725800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:36:48.227 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.209+0000 7f546d725800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:36:48.228 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.209+0000 7f546d725800 20 rados->read ofs=0 len=0 2024-09-22T08:36:48.228 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.209+0000 7f546d725800 1 -- 172.21.15.142:0/1041748053 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5613cf0bf260 con 0x5613cf0b7490 2024-09-22T08:36:48.228 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.209+0000 7f5468ca1640 1 -- 172.21.15.142:0/1041748053 <== osd.1 v2:172.21.15.142:6816/3192108003 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5460051070 con 0x5613cf0b7490 2024-09-22T08:36:48.228 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.209+0000 7f546d725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:48.228 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.209+0000 7f546d725800 20 rados->read ofs=0 len=0 2024-09-22T08:36:48.228 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.209+0000 7f546d725800 1 -- 172.21.15.142:0/1041748053 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5613cf0bfab0 con 0x5613cf0b7490 2024-09-22T08:36:48.228 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.210+0000 7f5468ca1640 1 -- 172.21.15.142:0/1041748053 <== osd.1 v2:172.21.15.142:6816/3192108003 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5460051070 con 0x5613cf0b7490 2024-09-22T08:36:48.228 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.210+0000 7f546d725800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:36:48.228 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.210+0000 7f546d725800 20 rados->read ofs=0 len=0 2024-09-22T08:36:48.228 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.210+0000 7f546d725800 1 -- 172.21.15.142:0/1041748053 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:40 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5613cf0c0650 con 0x5613cf0bbea0 2024-09-22T08:36:48.228 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.210+0000 7f5469ca3640 1 -- 172.21.15.142:0/1041748053 <== osd.3 v2:172.21.15.142:6800/1064901393 11 ==== osd_op_reply(40 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f546400a4d0 con 0x5613cf0bbea0 2024-09-22T08:36:48.228 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.210+0000 7f546d725800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:36:48.229 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.210+0000 7f546d725800 20 zone default found 2024-09-22T08:36:48.229 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.210+0000 7f546d725800 4 Realm: () 2024-09-22T08:36:48.229 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.210+0000 7f546d725800 4 ZoneGroup: default (d89f6f57-1007-47dd-9065-f486c7b01aec) 2024-09-22T08:36:48.229 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.210+0000 7f546d725800 4 Zone: default (e239248c-0bee-4e41-803a-24b288d3eb8f) 2024-09-22T08:36:48.229 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.210+0000 7f546d725800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:36:48.229 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.210+0000 7f546d725800 20 zonegroup default 2024-09-22T08:36:48.229 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.210+0000 7f546d725800 20 rados->read ofs=0 len=0 2024-09-22T08:36:48.229 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.210+0000 7f546d725800 1 -- 172.21.15.142:0/1041748053 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5613cf0c0a10 con 0x7f545c017050 2024-09-22T08:36:48.229 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.210+0000 7f5468ca1640 1 -- 172.21.15.142:0/1041748053 <== osd.0 v2:172.21.15.31:6800/168281188 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f5460051070 con 0x7f545c017050 2024-09-22T08:36:48.229 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.210+0000 7f546d725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:48.229 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.210+0000 7f546d725800 20 rados->read ofs=0 len=0 2024-09-22T08:36:48.229 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.210+0000 7f546d725800 1 -- 172.21.15.142:0/1041748053 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5613cf0c2cf0 con 0x5613cf0bbea0 2024-09-22T08:36:48.230 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.210+0000 7f5469ca3640 1 -- 172.21.15.142:0/1041748053 <== osd.3 v2:172.21.15.142:6800/1064901393 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f546400a4d0 con 0x5613cf0bbea0 2024-09-22T08:36:48.230 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.211+0000 7f546d725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:48.230 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.211+0000 7f546d725800 20 rados->read ofs=0 len=0 2024-09-22T08:36:48.230 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.211+0000 7f546d725800 1 -- 172.21.15.142:0/1041748053 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5613cf0c3090 con 0x5613cf0bbea0 2024-09-22T08:36:48.230 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.211+0000 7f5469ca3640 1 -- 172.21.15.142:0/1041748053 <== osd.3 v2:172.21.15.142:6800/1064901393 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f546400a4d0 con 0x5613cf0bbea0 2024-09-22T08:36:48.230 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.211+0000 7f546d725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:48.230 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.211+0000 7f546d725800 20 started sync module instance, tier type = 2024-09-22T08:36:48.230 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.211+0000 7f546d725800 20 started zone id=e239248c-0bee-4e41-803a-24b288d3eb8f (name=default) with tier type = 2024-09-22T08:36:48.230 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.211+0000 7f546d725800 1 -- 172.21.15.142:0/1041748053 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5613cf0c2180 con 0x7f54640197d0 2024-09-22T08:36:48.230 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.212+0000 7f54694a2640 1 -- 172.21.15.142:0/1041748053 <== osd.2 v2:172.21.15.142:6808/279438927 7 ==== osd_op_reply(44 notify.0 [create] v30'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f545c01ab20 con 0x7f54640197d0 2024-09-22T08:36:48.230 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.212+0000 7f546d725800 1 -- 172.21.15.142:0/1041748053 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94643078047088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5613cf0c1de0 con 0x7f54640197d0 2024-09-22T08:36:48.230 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.212+0000 7f546d725800 1 -- 172.21.15.142:0/1041748053 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5613cf0c3e60 con 0x5613cf0b7490 2024-09-22T08:36:48.230 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.213+0000 7f54694a2640 1 -- 172.21.15.142:0/1041748053 <== osd.2 v2:172.21.15.142:6808/279438927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94643078047088] v30'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f545c01ab20 con 0x7f54640197d0 2024-09-22T08:36:48.236 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.213+0000 7f5468ca1640 1 -- 172.21.15.142:0/1041748053 <== osd.1 v2:172.21.15.142:6816/3192108003 15 ==== osd_op_reply(46 notify.1 [create] v30'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5460051070 con 0x5613cf0b7490 2024-09-22T08:36:48.236 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.213+0000 7f546d725800 1 -- 172.21.15.142:0/1041748053 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94643078051008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5613cf0c4250 con 0x5613cf0b7490 2024-09-22T08:36:48.236 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.213+0000 7f546d725800 1 -- 172.21.15.142:0/1041748053 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5613cf0c4ca0 con 0x5613cf0bbea0 2024-09-22T08:36:48.236 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.214+0000 7f5468ca1640 1 -- 172.21.15.142:0/1041748053 <== osd.1 v2:172.21.15.142:6816/3192108003 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94643078051008] v30'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5460051070 con 0x5613cf0b7490 2024-09-22T08:36:48.236 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.214+0000 7f5469ca3640 1 -- 172.21.15.142:0/1041748053 <== osd.3 v2:172.21.15.142:6800/1064901393 14 ==== osd_op_reply(48 notify.2 [create] v30'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f546400a4d0 con 0x5613cf0bbea0 2024-09-22T08:36:48.236 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.214+0000 7f546d725800 1 -- 172.21.15.142:0/1041748053 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94643078055824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5613cf0c4c60 con 0x5613cf0bbea0 2024-09-22T08:36:48.236 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.214+0000 7f546d725800 1 -- 172.21.15.142:0/1041748053 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5613cf0c5710 con 0x7f54640197d0 2024-09-22T08:36:48.236 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.215+0000 7f54694a2640 1 -- 172.21.15.142:0/1041748053 <== osd.2 v2:172.21.15.142:6808/279438927 9 ==== osd_op_reply(50 notify.3 [create] v30'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f545c01ab20 con 0x7f54640197d0 2024-09-22T08:36:48.236 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.216+0000 7f546d725800 1 -- 172.21.15.142:0/1041748053 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94643078058592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5613cf0c5fe0 con 0x7f54640197d0 2024-09-22T08:36:48.236 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.216+0000 7f546d725800 1 -- 172.21.15.142:0/1041748053 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5613cf0c6ae0 con 0x5613cf0b7490 2024-09-22T08:36:48.236 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.216+0000 7f5469ca3640 1 -- 172.21.15.142:0/1041748053 <== osd.3 v2:172.21.15.142:6800/1064901393 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94643078055824] v30'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f546400a4d0 con 0x5613cf0bbea0 2024-09-22T08:36:48.237 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.217+0000 7f5468ca1640 1 -- 172.21.15.142:0/1041748053 <== osd.1 v2:172.21.15.142:6816/3192108003 17 ==== osd_op_reply(52 notify.4 [create] v30'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5460051070 con 0x5613cf0b7490 2024-09-22T08:36:48.237 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.217+0000 7f546d725800 1 -- 172.21.15.142:0/1041748053 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94643078063568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5613cf0c6ed0 con 0x5613cf0b7490 2024-09-22T08:36:48.237 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.217+0000 7f546d725800 1 -- 172.21.15.142:0/1041748053 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5613cf0c78f0 con 0x7f545c017050 2024-09-22T08:36:48.237 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.217+0000 7f54694a2640 1 -- 172.21.15.142:0/1041748053 <== osd.2 v2:172.21.15.142:6808/279438927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94643078058592] v30'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f545c01ab20 con 0x7f54640197d0 2024-09-22T08:36:48.237 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.218+0000 7f5468ca1640 1 -- 172.21.15.142:0/1041748053 <== osd.0 v2:172.21.15.31:6800/168281188 11 ==== osd_op_reply(54 notify.5 [create] v30'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5460051070 con 0x7f545c017050 2024-09-22T08:36:48.237 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.218+0000 7f5468ca1640 1 -- 172.21.15.142:0/1041748053 <== osd.1 v2:172.21.15.142:6816/3192108003 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94643078063568] v30'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5460051070 con 0x5613cf0b7490 2024-09-22T08:36:48.237 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.218+0000 7f546d725800 1 -- 172.21.15.142:0/1041748053 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94643078067168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5613cf0c78b0 con 0x7f545c017050 2024-09-22T08:36:48.237 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.218+0000 7f546d725800 1 -- 172.21.15.142:0/1041748053 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5613cf0c8190 con 0x7f545c017050 2024-09-22T08:36:48.237 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.219+0000 7f5468ca1640 1 -- 172.21.15.142:0/1041748053 <== osd.0 v2:172.21.15.31:6800/168281188 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94643078067168] v30'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5460051070 con 0x7f545c017050 2024-09-22T08:36:48.237 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.219+0000 7f5468ca1640 1 -- 172.21.15.142:0/1041748053 <== osd.0 v2:172.21.15.31:6800/168281188 13 ==== osd_op_reply(56 notify.6 [create] v30'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5460051070 con 0x7f545c017050 2024-09-22T08:36:48.237 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.219+0000 7f546d725800 1 -- 172.21.15.142:0/1041748053 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94643078060848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5613cf0c78b0 con 0x7f545c017050 2024-09-22T08:36:48.237 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.219+0000 7f546d725800 1 -- 172.21.15.142:0/1041748053 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5613cf0c8740 con 0x7f545c017050 2024-09-22T08:36:48.237 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.220+0000 7f5468ca1640 1 -- 172.21.15.142:0/1041748053 <== osd.0 v2:172.21.15.31:6800/168281188 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94643078060848] v30'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5460051070 con 0x7f545c017050 2024-09-22T08:36:48.238 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.220+0000 7f5468ca1640 1 -- 172.21.15.142:0/1041748053 <== osd.0 v2:172.21.15.31:6800/168281188 15 ==== osd_op_reply(58 notify.7 [create] v30'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5460051070 con 0x7f545c017050 2024-09-22T08:36:48.238 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.220+0000 7f546d725800 1 -- 172.21.15.142:0/1041748053 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94643078069360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5613cf0c8740 con 0x7f545c017050 2024-09-22T08:36:48.238 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.220+0000 7f546d725800 20 add_watcher() i=0 2024-09-22T08:36:48.238 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.220+0000 7f546d725800 20 add_watcher() i=1 2024-09-22T08:36:48.238 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.220+0000 7f546d725800 20 add_watcher() i=2 2024-09-22T08:36:48.238 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.220+0000 7f546d725800 20 add_watcher() i=3 2024-09-22T08:36:48.238 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.220+0000 7f546d725800 20 add_watcher() i=4 2024-09-22T08:36:48.238 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.220+0000 7f546d725800 20 add_watcher() i=5 2024-09-22T08:36:48.238 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.220+0000 7f546d725800 20 add_watcher() i=6 2024-09-22T08:36:48.238 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.221+0000 7f5468ca1640 1 -- 172.21.15.142:0/1041748053 <== osd.0 v2:172.21.15.31:6800/168281188 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94643078069360] v30'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5460051070 con 0x7f545c017050 2024-09-22T08:36:48.238 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.221+0000 7f546d725800 20 add_watcher() i=7 2024-09-22T08:36:48.239 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.221+0000 7f546d725800 2 all 8 watchers are set, enabling cache 2024-09-22T08:36:48.239 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.221+0000 7f546d725800 1 -- 172.21.15.142:0/1041748053 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5613cf0cbc50 con 0x5613cf0b7490 2024-09-22T08:36:48.239 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.221+0000 7f5468ca1640 1 -- 172.21.15.142:0/1041748053 <== osd.1 v2:172.21.15.142:6816/3192108003 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f5460051070 con 0x5613cf0b7490 2024-09-22T08:36:48.239 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.221+0000 7f546d725800 1 -- 172.21.15.142:0/1041748053 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94643078071856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5613cf0c8f00 con 0x5613cf0b7490 2024-09-22T08:36:48.239 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.222+0000 7f5468ca1640 1 -- 172.21.15.142:0/1041748053 <== osd.1 v2:172.21.15.142:6816/3192108003 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94643078071856] v30'134 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5460051070 con 0x5613cf0b7490 2024-09-22T08:36:48.239 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.222+0000 7f531ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:36:48.239 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.223+0000 7f546d725800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:36:48.239 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.223+0000 7f546d725800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:36:48.239 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.223+0000 7f546d725800 1 -- 172.21.15.142:0/1041748053 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5613cf0d4780 con 0x5613cf0b7490 2024-09-22T08:36:48.239 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.224+0000 7f5468ca1640 1 -- 172.21.15.142:0/1041748053 <== osd.1 v2:172.21.15.142:6816/3192108003 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v30'22 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5460051070 con 0x5613cf0b7490 2024-09-22T08:36:48.239 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.224+0000 7f546d725800 1 -- 172.21.15.142:0/1041748053 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5613cf0d4e10 con 0x7f545c017050 2024-09-22T08:36:48.239 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.225+0000 7f5468ca1640 1 -- 172.21.15.142:0/1041748053 <== osd.0 v2:172.21.15.31:6800/168281188 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v30'16 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5460051070 con 0x7f545c017050 2024-09-22T08:36:48.239 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.225+0000 7f546d725800 1 -- 172.21.15.142:0/1041748053 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5613cf0d5250 con 0x5613cf0bbea0 2024-09-22T08:36:48.240 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.226+0000 7f5469ca3640 1 -- 172.21.15.142:0/1041748053 <== osd.3 v2:172.21.15.142:6800/1064901393 16 ==== osd_op_reply(64 gc.2 [create,call,call,call] v30'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f546400a4d0 con 0x5613cf0bbea0 2024-09-22T08:36:48.240 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.226+0000 7f546d725800 1 -- 172.21.15.142:0/1041748053 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5613cf0d5150 con 0x5613cf0b7490 2024-09-22T08:36:48.240 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.227+0000 7f5468ca1640 1 -- 172.21.15.142:0/1041748053 <== osd.1 v2:172.21.15.142:6816/3192108003 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v30'135 uv15 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5460051070 con 0x5613cf0b7490 2024-09-22T08:36:48.240 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.227+0000 7f546d725800 1 -- 172.21.15.142:0/1041748053 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5613cf0d5780 con 0x7f54640197d0 2024-09-22T08:36:48.240 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.228+0000 7f54694a2640 1 -- 172.21.15.142:0/1041748053 <== osd.2 v2:172.21.15.142:6808/279438927 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v30'38 uv13 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f545c01ab20 con 0x7f54640197d0 2024-09-22T08:36:48.240 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.228+0000 7f546d725800 1 -- 172.21.15.142:0/1041748053 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5613cf0d5b80 con 0x5613cf0bbea0 2024-09-22T08:36:48.240 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.229+0000 7f5469ca3640 1 -- 172.21.15.142:0/1041748053 <== osd.3 v2:172.21.15.142:6800/1064901393 17 ==== osd_op_reply(67 gc.5 [create,call,call,call] v30'25 uv10 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f546400a4d0 con 0x5613cf0bbea0 2024-09-22T08:36:48.240 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.229+0000 7f546d725800 1 -- 172.21.15.142:0/1041748053 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5613cf0d5b80 con 0x5613cf0b7490 2024-09-22T08:36:48.240 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.230+0000 7f5468ca1640 1 -- 172.21.15.142:0/1041748053 <== osd.1 v2:172.21.15.142:6816/3192108003 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v30'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5460051070 con 0x5613cf0b7490 2024-09-22T08:36:48.240 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.230+0000 7f546d725800 1 -- 172.21.15.142:0/1041748053 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5613cf0d5b80 con 0x7f545c017050 2024-09-22T08:36:48.240 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.231+0000 7f5468ca1640 1 -- 172.21.15.142:0/1041748053 <== osd.0 v2:172.21.15.31:6800/168281188 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v30'25 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5460051070 con 0x7f545c017050 2024-09-22T08:36:48.240 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.231+0000 7f546d725800 1 -- 172.21.15.142:0/1041748053 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5613cf0d5c70 con 0x7f54640197d0 2024-09-22T08:36:48.240 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.232+0000 7f54694a2640 1 -- 172.21.15.142:0/1041748053 <== osd.2 v2:172.21.15.142:6808/279438927 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v30'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f545c01ab20 con 0x7f54640197d0 2024-09-22T08:36:48.241 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.232+0000 7f546d725800 1 -- 172.21.15.142:0/1041748053 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5613cf0d6120 con 0x5613cf0bbea0 2024-09-22T08:36:48.241 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.233+0000 7f5469ca3640 1 -- 172.21.15.142:0/1041748053 <== osd.3 v2:172.21.15.142:6800/1064901393 18 ==== osd_op_reply(71 gc.9 [create,call,call,call] v30'22 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f546400a4d0 con 0x5613cf0bbea0 2024-09-22T08:36:48.241 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.233+0000 7f546d725800 1 -- 172.21.15.142:0/1041748053 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5613cf0d6120 con 0x7f54640197d0 2024-09-22T08:36:48.241 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.234+0000 7f54694a2640 1 -- 172.21.15.142:0/1041748053 <== osd.2 v2:172.21.15.142:6808/279438927 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v30'39 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f545c01ab20 con 0x7f54640197d0 2024-09-22T08:36:48.241 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.234+0000 7f546d725800 1 -- 172.21.15.142:0/1041748053 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5613cf0d6120 con 0x7f545c017050 2024-09-22T08:36:48.243 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.235+0000 7f5468ca1640 1 -- 172.21.15.142:0/1041748053 <== osd.0 v2:172.21.15.31:6800/168281188 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v30'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5460051070 con 0x7f545c017050 2024-09-22T08:36:48.243 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.235+0000 7f546d725800 1 -- 172.21.15.142:0/1041748053 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5613cf0d6120 con 0x7f54640197d0 2024-09-22T08:36:48.243 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.236+0000 7f54694a2640 1 -- 172.21.15.142:0/1041748053 <== osd.2 v2:172.21.15.142:6808/279438927 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v30'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f545c01ab20 con 0x7f54640197d0 2024-09-22T08:36:48.243 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.236+0000 7f546d725800 1 -- 172.21.15.142:0/1041748053 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5613cf0d6230 con 0x7f545c017050 2024-09-22T08:36:48.243 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.237+0000 7f5468ca1640 1 -- 172.21.15.142:0/1041748053 <== osd.0 v2:172.21.15.31:6800/168281188 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v30'33 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5460051070 con 0x7f545c017050 2024-09-22T08:36:48.243 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.237+0000 7f546d725800 1 -- 172.21.15.142:0/1041748053 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5613cf0d61f0 con 0x5613cf0b7490 2024-09-22T08:36:48.243 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.238+0000 7f5468ca1640 1 -- 172.21.15.142:0/1041748053 <== osd.1 v2:172.21.15.142:6816/3192108003 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v30'136 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5460051070 con 0x5613cf0b7490 2024-09-22T08:36:48.243 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.238+0000 7f546d725800 1 -- 172.21.15.142:0/1041748053 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5613cf0d61f0 con 0x5613cf0bbea0 2024-09-22T08:36:48.243 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.239+0000 7f5469ca3640 1 -- 172.21.15.142:0/1041748053 <== osd.3 v2:172.21.15.142:6800/1064901393 19 ==== osd_op_reply(77 gc.15 [create,call,call,call] v30'32 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f546400a4d0 con 0x5613cf0bbea0 2024-09-22T08:36:48.243 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.239+0000 7f546d725800 1 -- 172.21.15.142:0/1041748053 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5613cf0d61f0 con 0x7f54640197d0 2024-09-22T08:36:48.243 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.240+0000 7f54694a2640 1 -- 172.21.15.142:0/1041748053 <== osd.2 v2:172.21.15.142:6808/279438927 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v30'40 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f545c01ab20 con 0x7f54640197d0 2024-09-22T08:36:48.243 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.240+0000 7f546d725800 1 -- 172.21.15.142:0/1041748053 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5613cf0d6230 con 0x5613cf0bbea0 2024-09-22T08:36:48.244 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.241+0000 7f5469ca3640 1 -- 172.21.15.142:0/1041748053 <== osd.3 v2:172.21.15.142:6800/1064901393 20 ==== osd_op_reply(79 gc.17 [create,call,call,call] v30'16 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f546400a4d0 con 0x5613cf0bbea0 2024-09-22T08:36:48.244 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.241+0000 7f546d725800 1 -- 172.21.15.142:0/1041748053 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5613cf0d6230 con 0x5613cf0b7490 2024-09-22T08:36:48.244 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.243+0000 7f5468ca1640 1 -- 172.21.15.142:0/1041748053 <== osd.1 v2:172.21.15.142:6816/3192108003 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v30'24 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5460051070 con 0x5613cf0b7490 2024-09-22T08:36:48.244 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.243+0000 7f546d725800 1 -- 172.21.15.142:0/1041748053 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5613cf0d6230 con 0x5613cf0b7490 2024-09-22T08:36:48.245 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.244+0000 7f5468ca1640 1 -- 172.21.15.142:0/1041748053 <== osd.1 v2:172.21.15.142:6816/3192108003 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v30'137 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5460051070 con 0x5613cf0b7490 2024-09-22T08:36:48.245 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.244+0000 7f546d725800 1 -- 172.21.15.142:0/1041748053 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5613cf0d6230 con 0x5613cf0bbea0 2024-09-22T08:36:48.246 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.245+0000 7f5469ca3640 1 -- 172.21.15.142:0/1041748053 <== osd.3 v2:172.21.15.142:6800/1064901393 21 ==== osd_op_reply(82 gc.20 [create,call,call,call] v30'33 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f546400a4d0 con 0x5613cf0bbea0 2024-09-22T08:36:48.246 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.245+0000 7f546d725800 1 -- 172.21.15.142:0/1041748053 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5613cf0d6270 con 0x7f54640197d0 2024-09-22T08:36:48.247 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.246+0000 7f54694a2640 1 -- 172.21.15.142:0/1041748053 <== osd.2 v2:172.21.15.142:6808/279438927 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v30'26 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f545c01ab20 con 0x7f54640197d0 2024-09-22T08:36:48.247 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.246+0000 7f546d725800 1 -- 172.21.15.142:0/1041748053 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5613cf0d6270 con 0x5613cf0bbea0 2024-09-22T08:36:48.248 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.247+0000 7f5469ca3640 1 -- 172.21.15.142:0/1041748053 <== osd.3 v2:172.21.15.142:6800/1064901393 22 ==== osd_op_reply(84 gc.22 [create,call,call,call] v30'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f546400a4d0 con 0x5613cf0bbea0 2024-09-22T08:36:48.248 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.247+0000 7f546d725800 1 -- 172.21.15.142:0/1041748053 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5613cf0d62b0 con 0x5613cf0bbea0 2024-09-22T08:36:48.248 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.248+0000 7f5469ca3640 1 -- 172.21.15.142:0/1041748053 <== osd.3 v2:172.21.15.142:6800/1064901393 23 ==== osd_op_reply(85 gc.23 [create,call,call,call] v30'22 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f546400a4d0 con 0x5613cf0bbea0 2024-09-22T08:36:48.249 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.248+0000 7f546d725800 1 -- 172.21.15.142:0/1041748053 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5613cf0d62f0 con 0x5613cf0bbea0 2024-09-22T08:36:48.249 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.249+0000 7f5469ca3640 1 -- 172.21.15.142:0/1041748053 <== osd.3 v2:172.21.15.142:6800/1064901393 24 ==== osd_op_reply(86 gc.24 [create,call,call,call] v30'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f546400a4d0 con 0x5613cf0bbea0 2024-09-22T08:36:48.250 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.249+0000 7f546d725800 1 -- 172.21.15.142:0/1041748053 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5613cf0d62f0 con 0x5613cf0bbea0 2024-09-22T08:36:48.250 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.249+0000 7f5469ca3640 1 -- 172.21.15.142:0/1041748053 <== osd.3 v2:172.21.15.142:6800/1064901393 25 ==== osd_op_reply(87 gc.25 [create,call,call,call] v30'26 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f546400a4d0 con 0x5613cf0bbea0 2024-09-22T08:36:48.250 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.249+0000 7f546d725800 1 -- 172.21.15.142:0/1041748053 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5613cf0d6330 con 0x7f545c017050 2024-09-22T08:36:48.252 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.251+0000 7f5468ca1640 1 -- 172.21.15.142:0/1041748053 <== osd.0 v2:172.21.15.31:6800/168281188 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v30'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5460051070 con 0x7f545c017050 2024-09-22T08:36:48.252 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.251+0000 7f546d725800 1 -- 172.21.15.142:0/1041748053 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5613cf0d6370 con 0x5613cf0bbea0 2024-09-22T08:36:48.253 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.252+0000 7f5469ca3640 1 -- 172.21.15.142:0/1041748053 <== osd.3 v2:172.21.15.142:6800/1064901393 26 ==== osd_op_reply(89 gc.27 [create,call,call,call] v30'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f546400a4d0 con 0x5613cf0bbea0 2024-09-22T08:36:48.253 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.252+0000 7f546d725800 1 -- 172.21.15.142:0/1041748053 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5613cf0d6370 con 0x7f545c017050 2024-09-22T08:36:48.254 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.253+0000 7f5468ca1640 1 -- 172.21.15.142:0/1041748053 <== osd.0 v2:172.21.15.31:6800/168281188 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v30'26 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5460051070 con 0x7f545c017050 2024-09-22T08:36:48.254 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.253+0000 7f546d725800 1 -- 172.21.15.142:0/1041748053 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5613cf0d6370 con 0x5613cf0bbea0 2024-09-22T08:36:48.255 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.254+0000 7f5469ca3640 1 -- 172.21.15.142:0/1041748053 <== osd.3 v2:172.21.15.142:6800/1064901393 27 ==== osd_op_reply(91 gc.29 [create,call,call,call] v30'34 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f546400a4d0 con 0x5613cf0bbea0 2024-09-22T08:36:48.255 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.254+0000 7f546d725800 1 -- 172.21.15.142:0/1041748053 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5613cf0d6370 con 0x7f545c017050 2024-09-22T08:36:48.256 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.255+0000 7f5468ca1640 1 -- 172.21.15.142:0/1041748053 <== osd.0 v2:172.21.15.31:6800/168281188 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v30'34 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5460051070 con 0x7f545c017050 2024-09-22T08:36:48.256 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.255+0000 7f546d725800 1 -- 172.21.15.142:0/1041748053 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5613cf0d63b0 con 0x7f54640197d0 2024-09-22T08:36:48.258 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.256+0000 7f54694a2640 1 -- 172.21.15.142:0/1041748053 <== osd.2 v2:172.21.15.142:6808/279438927 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v30'22 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f545c01ab20 con 0x7f54640197d0 2024-09-22T08:36:48.258 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.257+0000 7f531efe5640 20 reqs_thread_entry: start 2024-09-22T08:36:48.258 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.257+0000 7f546d725800 20 init_complete bucket index max shards: 11 2024-09-22T08:36:48.258 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.257+0000 7f546d725800 20 Filter name: none 2024-09-22T08:36:48.259 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.257+0000 7f531cfe1640 20 reqs_thread_entry: start 2024-09-22T08:36:48.259 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.257+0000 7f546d725800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : miss 2024-09-22T08:36:48.259 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.257+0000 7f546d725800 20 rados->read ofs=0 len=0 2024-09-22T08:36:48.259 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.257+0000 7f546d725800 1 -- 172.21.15.142:0/1041748053 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:94 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5613cf1012d0 con 0x7f545c017050 2024-09-22T08:36:48.260 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.258+0000 7f5468ca1640 1 -- 172.21.15.142:0/1041748053 <== osd.0 v2:172.21.15.31:6800/168281188 24 ==== osd_op_reply(94 testx$tenanteduser [call out=48b,read 0~419 out=419b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 246+0+542 (crc 0 0 0) 0x7f5460051070 con 0x7f545c017050 2024-09-22T08:36:48.260 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.258+0000 7f546d725800 20 rados_obj.operate() r=0 bl.length=419 2024-09-22T08:36:48.260 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.258+0000 7f546d725800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x13 2024-09-22T08:36:48.260 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.258+0000 7f546d725800 10 adding default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-09-22T08:36:48.260 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.258+0000 7f546d725800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:36:48.260 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.258+0000 7f546d725800 1 -- 172.21.15.142:0/1041748053 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:95 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5613cf103cf0 con 0x5613cf0b7490 2024-09-22T08:36:48.260 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.258+0000 7f5468ca1640 1 -- 172.21.15.142:0/1041748053 <== osd.1 v2:172.21.15.142:6816/3192108003 27 ==== osd_op_reply(95 testx$tenanteduser.buckets [call out=15b] v0'0 uv3 ondisk = 0) ==== 170+0+15 (crc 0 0 0) 0x7f5460051070 con 0x5613cf0b7490 2024-09-22T08:36:48.260 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.258+0000 7f546d725800 10 removing key index: p5YnriCv1nAtykxBrupQ 2024-09-22T08:36:48.260 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.258+0000 7f546d725800 1 -- 172.21.15.142:0/1041748053 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:96 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5613cf101cd0 con 0x7f545c017050 2024-09-22T08:36:48.263 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.259+0000 7f5468ca1640 1 -- 172.21.15.142:0/1041748053 <== osd.0 v2:172.21.15.31:6800/168281188 25 ==== osd_op_reply(96 p5YnriCv1nAtykxBrupQ [delete] v30'7 uv7 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f5460051070 con 0x7f545c017050 2024-09-22T08:36:48.263 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.259+0000 7f546d725800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-22T08:36:48.263 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.259+0000 7f546d725800 1 -- 172.21.15.142:0/1041748053 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [notify cookie 94643078309856 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5613cf1040c0 con 0x5613cf0bbea0 2024-09-22T08:36:48.263 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.259+0000 7f5469ca3640 1 -- 172.21.15.142:0/1041748053 <== osd.3 v2:172.21.15.142:6800/1064901393 28 ==== watch-notify(notify (1) cookie 94643078055824 notify 128849018887 ret 0) ==== 212+0+0 (crc 0 0 0) 0x5613cf0d5680 con 0x5613cf0bbea0 2024-09-22T08:36:48.263 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.259+0000 7f534cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018887 cookie 94643078055824 notifier 4562 bl.length()=170 2024-09-22T08:36:48.263 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.259+0000 7f534cff9640 1 -- 172.21.15.142:0/1041748053 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f532c003d60 con 0x5613cf0bbea0 2024-09-22T08:36:48.263 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.260+0000 7f5469ca3640 1 -- 172.21.15.142:0/1041748053 <== osd.3 v2:172.21.15.142:6800/1064901393 29 ==== osd_op_reply(97 notify.2 [notify cookie 94643078309856 out=8b] v0'0 uv141 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f546400a4d0 con 0x5613cf0bbea0 2024-09-22T08:36:48.263 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.260+0000 7f5469ca3640 1 -- 172.21.15.142:0/1041748053 <== osd.3 v2:172.21.15.142:6800/1064901393 30 ==== osd_op_reply(98 notify.2 [notify-ack] v0'0 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f546400a4d0 con 0x5613cf0bbea0 2024-09-22T08:36:48.263 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.260+0000 7f5469ca3640 1 -- 172.21.15.142:0/1041748053 <== osd.3 v2:172.21.15.142:6800/1064901393 31 ==== watch-notify(notify_complete (2) cookie 94643078309856 notify 128849018887 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f5464061040 con 0x5613cf0bbea0 2024-09-22T08:36:48.263 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.260+0000 7f546d725800 10 removing email index: 2024-09-22T08:36:48.263 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.260+0000 7f546d725800 10 removing user buckets index 2024-09-22T08:36:48.264 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.260+0000 7f546d725800 1 -- 172.21.15.142:0/1041748053 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:99 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5613cf101c80 con 0x5613cf0b7490 2024-09-22T08:36:48.264 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.261+0000 7f5468ca1640 1 -- 172.21.15.142:0/1041748053 <== osd.1 v2:172.21.15.142:6816/3192108003 28 ==== osd_op_reply(99 testx$tenanteduser.buckets [delete] v30'5 uv5 ondisk = 0) ==== 170+0+0 (crc 0 0 0) 0x7f5460051070 con 0x5613cf0b7490 2024-09-22T08:36:48.264 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.261+0000 7f546d725800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.uid:testx$tenanteduser.buckets, ofs0, ns] 2024-09-22T08:36:48.264 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.261+0000 7f546d725800 1 -- 172.21.15.142:0/1041748053 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [notify cookie 94643078309856 in=187b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5613cf1040c0 con 0x5613cf0b7490 2024-09-22T08:36:48.264 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.261+0000 7f5468ca1640 1 -- 172.21.15.142:0/1041748053 <== osd.1 v2:172.21.15.142:6816/3192108003 29 ==== watch-notify(notify (1) cookie 94643078063568 notify 128849018893 ret 0) ==== 217+0+0 (crc 0 0 0) 0x5613cf0d4e10 con 0x5613cf0b7490 2024-09-22T08:36:48.264 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.261+0000 7f533bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018893 cookie 94643078063568 notifier 4562 bl.length()=175 2024-09-22T08:36:48.264 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.261+0000 7f533bfff640 1 -- 172.21.15.142:0/1041748053 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f52900032c0 con 0x5613cf0b7490 2024-09-22T08:36:48.264 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.261+0000 7f5468ca1640 1 -- 172.21.15.142:0/1041748053 <== osd.1 v2:172.21.15.142:6816/3192108003 30 ==== osd_op_reply(100 notify.4 [notify cookie 94643078309856 out=8b] v0'0 uv141 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f5460051070 con 0x5613cf0b7490 2024-09-22T08:36:48.264 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.261+0000 7f5468ca1640 1 -- 172.21.15.142:0/1041748053 <== osd.1 v2:172.21.15.142:6816/3192108003 31 ==== osd_op_reply(101 notify.4 [notify-ack] v0'0 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5460051070 con 0x5613cf0b7490 2024-09-22T08:36:48.264 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.261+0000 7f5468ca1640 1 -- 172.21.15.142:0/1041748053 <== osd.1 v2:172.21.15.142:6816/3192108003 32 ==== watch-notify(notify_complete (2) cookie 94643078309856 notify 128849018893 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5613cf0d4910 con 0x5613cf0b7490 2024-09-22T08:36:48.264 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.261+0000 7f546d725800 10 removing user index: testx$tenanteduser 2024-09-22T08:36:48.264 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.261+0000 7f546d725800 1 -- 172.21.15.142:0/1041748053 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:102 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5613cf105e20 con 0x7f545c017050 2024-09-22T08:36:48.266 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.263+0000 7f5468ca1640 1 -- 172.21.15.142:0/1041748053 <== osd.0 v2:172.21.15.31:6800/168281188 26 ==== osd_op_reply(102 testx$tenanteduser [call,call,delete] v30'8 uv8 ondisk = 0) ==== 246+0+0 (crc 0 0 0) 0x7f5460051070 con 0x7f545c017050 2024-09-22T08:36:48.266 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.263+0000 7f546d725800 10 removing default.rgw.meta+users.uid+testx$tenanteduser from cache 2024-09-22T08:36:48.266 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.263+0000 7f546d725800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.uid:testx$tenanteduser, ofs0, ns] 2024-09-22T08:36:48.266 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.263+0000 7f546d725800 1 -- 172.21.15.142:0/1041748053 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:103 7.e 7:7759931f:::notify.3:head [notify cookie 94643078322544 in=179b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5613cf105d90 con 0x7f54640197d0 2024-09-22T08:36:48.266 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.263+0000 7f54694a2640 1 -- 172.21.15.142:0/1041748053 <== osd.2 v2:172.21.15.142:6808/279438927 18 ==== watch-notify(notify (1) cookie 94643078058592 notify 128849018898 ret 0) ==== 209+0+0 (crc 0 0 0) 0x5613cf0d5070 con 0x7f54640197d0 2024-09-22T08:36:48.266 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.263+0000 7f534cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018898 cookie 94643078058592 notifier 4562 bl.length()=167 2024-09-22T08:36:48.266 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.263+0000 7f534cff9640 1 -- 172.21.15.142:0/1041748053 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:104 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f532c003d60 con 0x7f54640197d0 2024-09-22T08:36:48.266 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.263+0000 7f54694a2640 1 -- 172.21.15.142:0/1041748053 <== osd.2 v2:172.21.15.142:6808/279438927 19 ==== osd_op_reply(103 notify.3 [notify cookie 94643078322544 out=8b] v0'0 uv141 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f545c01ab20 con 0x7f54640197d0 2024-09-22T08:36:48.267 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.263+0000 7f54694a2640 1 -- 172.21.15.142:0/1041748053 <== osd.2 v2:172.21.15.142:6808/279438927 20 ==== watch-notify(notify_complete (2) cookie 94643078322544 notify 128849018898 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5613cf0d4190 con 0x7f54640197d0 2024-09-22T08:36:48.267 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.263+0000 7f54694a2640 1 -- 172.21.15.142:0/1041748053 <== osd.2 v2:172.21.15.142:6808/279438927 21 ==== osd_op_reply(104 notify.3 [notify-ack] v0'0 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f545c01ab20 con 0x7f54640197d0 2024-09-22T08:36:48.267 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.264+0000 7f531ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:36:48.267 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.264+0000 7f546d725800 1 -- 172.21.15.142:0/1041748053 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:105 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94643078071856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5613cf105e20 con 0x5613cf0b7490 2024-09-22T08:36:48.268 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.265+0000 7f5468ca1640 1 -- 172.21.15.142:0/1041748053 <== osd.1 v2:172.21.15.142:6816/3192108003 33 ==== osd_op_reply(105 data_loggenerations_metadata [watch unwatch cookie 94643078071856] v30'138 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5460051070 con 0x5613cf0b7490 2024-09-22T08:36:48.268 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.265+0000 7f546d725800 1 -- 172.21.15.142:0/1041748053 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:106 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94643078047088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5613cf105e20 con 0x7f54640197d0 2024-09-22T08:36:48.268 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.266+0000 7f54694a2640 1 -- 172.21.15.142:0/1041748053 <== osd.2 v2:172.21.15.142:6808/279438927 22 ==== osd_op_reply(106 notify.0 [watch unwatch cookie 94643078047088] v30'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f545c01ab20 con 0x7f54640197d0 2024-09-22T08:36:48.268 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.266+0000 7f546d725800 20 remove_watcher() i=0 2024-09-22T08:36:48.268 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.266+0000 7f546d725800 2 removed watcher, disabling cache 2024-09-22T08:36:48.268 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.266+0000 7f546d725800 1 -- 172.21.15.142:0/1041748053 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:107 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94643078051008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5613cf105e20 con 0x5613cf0b7490 2024-09-22T08:36:48.269 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.267+0000 7f5468ca1640 1 -- 172.21.15.142:0/1041748053 <== osd.1 v2:172.21.15.142:6816/3192108003 34 ==== osd_op_reply(107 notify.1 [watch unwatch cookie 94643078051008] v30'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5460051070 con 0x5613cf0b7490 2024-09-22T08:36:48.269 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.267+0000 7f546d725800 20 remove_watcher() i=1 2024-09-22T08:36:48.269 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.267+0000 7f546d725800 1 -- 172.21.15.142:0/1041748053 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:108 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94643078055824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5613cf105e20 con 0x5613cf0bbea0 2024-09-22T08:36:48.269 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.268+0000 7f5469ca3640 1 -- 172.21.15.142:0/1041748053 <== osd.3 v2:172.21.15.142:6800/1064901393 32 ==== osd_op_reply(108 notify.2 [watch unwatch cookie 94643078055824] v30'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f546400a4d0 con 0x5613cf0bbea0 2024-09-22T08:36:48.270 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.268+0000 7f546d725800 20 remove_watcher() i=2 2024-09-22T08:36:48.270 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.268+0000 7f546d725800 1 -- 172.21.15.142:0/1041748053 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:109 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94643078058592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5613cf105e20 con 0x7f54640197d0 2024-09-22T08:36:48.270 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.269+0000 7f54694a2640 1 -- 172.21.15.142:0/1041748053 <== osd.2 v2:172.21.15.142:6808/279438927 23 ==== osd_op_reply(109 notify.3 [watch unwatch cookie 94643078058592] v30'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f545c01ab20 con 0x7f54640197d0 2024-09-22T08:36:48.270 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.269+0000 7f546d725800 20 remove_watcher() i=3 2024-09-22T08:36:48.271 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.269+0000 7f546d725800 1 -- 172.21.15.142:0/1041748053 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:110 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94643078063568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5613cf105e20 con 0x5613cf0b7490 2024-09-22T08:36:48.271 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.270+0000 7f5468ca1640 1 -- 172.21.15.142:0/1041748053 <== osd.1 v2:172.21.15.142:6816/3192108003 35 ==== osd_op_reply(110 notify.4 [watch unwatch cookie 94643078063568] v30'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5460051070 con 0x5613cf0b7490 2024-09-22T08:36:48.272 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.270+0000 7f546d725800 20 remove_watcher() i=4 2024-09-22T08:36:48.272 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.270+0000 7f546d725800 1 -- 172.21.15.142:0/1041748053 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:111 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94643078067168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5613cf105e20 con 0x7f545c017050 2024-09-22T08:36:48.272 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.271+0000 7f5468ca1640 1 -- 172.21.15.142:0/1041748053 <== osd.0 v2:172.21.15.31:6800/168281188 27 ==== osd_op_reply(111 notify.5 [watch unwatch cookie 94643078067168] v30'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5460051070 con 0x7f545c017050 2024-09-22T08:36:48.272 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.271+0000 7f546d725800 20 remove_watcher() i=5 2024-09-22T08:36:48.273 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.271+0000 7f546d725800 1 -- 172.21.15.142:0/1041748053 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:112 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94643078060848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5613cf105e20 con 0x7f545c017050 2024-09-22T08:36:48.273 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.272+0000 7f5468ca1640 1 -- 172.21.15.142:0/1041748053 <== osd.0 v2:172.21.15.31:6800/168281188 28 ==== osd_op_reply(112 notify.6 [watch unwatch cookie 94643078060848] v30'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5460051070 con 0x7f545c017050 2024-09-22T08:36:48.273 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.272+0000 7f546d725800 20 remove_watcher() i=6 2024-09-22T08:36:48.273 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.272+0000 7f546d725800 1 -- 172.21.15.142:0/1041748053 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:113 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94643078069360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5613cf105e20 con 0x7f545c017050 2024-09-22T08:36:48.276 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.273+0000 7f5468ca1640 1 -- 172.21.15.142:0/1041748053 <== osd.0 v2:172.21.15.31:6800/168281188 29 ==== osd_op_reply(113 notify.7 [watch unwatch cookie 94643078069360] v30'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5460051070 con 0x7f545c017050 2024-09-22T08:36:48.276 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.273+0000 7f546d725800 20 remove_watcher() i=7 2024-09-22T08:36:48.277 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.273+0000 7f546d725800 1 -- 172.21.15.142:0/1041748053 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f545c017050 msgr2=0x7f545c00c790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:48.277 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.273+0000 7f546d725800 1 --2- 172.21.15.142:0/1041748053 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f545c017050 0x7f545c00c790 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:48.277 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.273+0000 7f546d725800 1 -- 172.21.15.142:0/1041748053 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5613cf0b7490 msgr2=0x5613cf0b9950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:48.277 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.273+0000 7f546d725800 1 --2- 172.21.15.142:0/1041748053 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5613cf0b7490 0x5613cf0b9950 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:48.277 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.273+0000 7f546d725800 1 -- 172.21.15.142:0/1041748053 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f54640197d0 msgr2=0x7f5464048090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:48.277 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.273+0000 7f546d725800 1 --2- 172.21.15.142:0/1041748053 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f54640197d0 0x7f5464048090 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:48.277 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.273+0000 7f546d725800 1 -- 172.21.15.142:0/1041748053 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5613cf0bbea0 msgr2=0x5613cf0be290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:48.277 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.273+0000 7f546d725800 1 --2- 172.21.15.142:0/1041748053 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5613cf0bbea0 0x5613cf0be290 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:48.277 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.273+0000 7f546d725800 1 -- 172.21.15.142:0/1041748053 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f533403d000 msgr2=0x7f533403f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:48.277 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.273+0000 7f546d725800 1 --2- 172.21.15.142:0/1041748053 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f533403d000 0x7f533403f4c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f545c001250 tx=0x7f545c02e000 comp rx=0 tx=0).stop 2024-09-22T08:36:48.277 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.273+0000 7f546d725800 1 -- 172.21.15.142:0/1041748053 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5613cf0a45f0 msgr2=0x5613cf0abbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:48.277 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.273+0000 7f5468ca1640 1 -- 172.21.15.142:0/1041748053 reap_dead start 2024-09-22T08:36:48.277 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.273+0000 7f546d725800 1 --2- 172.21.15.142:0/1041748053 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5613cf0a45f0 0x5613cf0abbf0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f5464020f40 tx=0x7f5464054870 comp rx=0 tx=0).stop 2024-09-22T08:36:48.278 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.274+0000 7f546d725800 1 -- 172.21.15.142:0/1041748053 shutdown_connections 2024-09-22T08:36:48.278 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.274+0000 7f546d725800 1 --2- 172.21.15.142:0/1041748053 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5613cf0a45f0 0x5613cf0abbf0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:48.278 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.274+0000 7f546d725800 1 -- 172.21.15.142:0/1041748053 >> 172.21.15.142:0/1041748053 conn(0x5613cf0a09f0 msgr2=0x5613cf09ec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:48.278 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.274+0000 7f546d725800 1 -- 172.21.15.142:0/1041748053 shutdown_connections 2024-09-22T08:36:48.278 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.274+0000 7f546d725800 1 -- 172.21.15.142:0/1041748053 wait complete. 2024-09-22T08:36:48.278 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.274+0000 7f546d725800 1 -- 172.21.15.142:0/1859299121 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f534403cfb0 msgr2=0x7f534403f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:48.278 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.274+0000 7f546d725800 1 --2- 172.21.15.142:0/1859299121 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f534403cfb0 0x7f534403f470 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x5613cf07ec40 tx=0x7f545c0529c0 comp rx=0 tx=0).stop 2024-09-22T08:36:48.278 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.274+0000 7f546d725800 1 -- 172.21.15.142:0/1859299121 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5613cf097b30 msgr2=0x5613cf097f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:48.278 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.274+0000 7f546d725800 1 --2- 172.21.15.142:0/1859299121 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5613cf097b30 0x5613cf097f50 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x5613cf07d9d0 tx=0x7f54640167b0 comp rx=0 tx=0).stop 2024-09-22T08:36:48.278 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.274+0000 7f546d725800 1 -- 172.21.15.142:0/1859299121 shutdown_connections 2024-09-22T08:36:48.278 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.274+0000 7f546d725800 1 --2- 172.21.15.142:0/1859299121 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f534403cfb0 0x7f534403f470 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:48.278 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.274+0000 7f546d725800 1 --2- 172.21.15.142:0/1859299121 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5613cf097b30 0x5613cf097f50 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:48.278 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.274+0000 7f546d725800 1 -- 172.21.15.142:0/1859299121 >> 172.21.15.142:0/1859299121 conn(0x5613cf08bee0 msgr2=0x5613cf08c2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:48.278 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.274+0000 7f546d725800 1 -- 172.21.15.142:0/1859299121 shutdown_connections 2024-09-22T08:36:48.279 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.274+0000 7f546d725800 1 -- 172.21.15.142:0/1859299121 wait complete. 2024-09-22T08:36:48.279 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.274+0000 7f546d725800 1 -- 172.21.15.142:0/1824562721 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5613cef899e0 msgr2=0x5613cf084190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:48.279 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.274+0000 7f546d725800 1 --2- 172.21.15.142:0/1824562721 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5613cef899e0 0x5613cf084190 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:48.279 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.274+0000 7f546d725800 1 -- 172.21.15.142:0/1824562721 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5613cf086530 msgr2=0x5613cf0889d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:48.279 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.274+0000 7f546d725800 1 --2- 172.21.15.142:0/1824562721 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5613cf086530 0x5613cf0889d0 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:48.279 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.274+0000 7f546d725800 1 -- 172.21.15.142:0/1824562721 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f535003cfb0 msgr2=0x7f535003f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:48.279 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.275+0000 7f546d725800 1 --2- 172.21.15.142:0/1824562721 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f535003cfb0 0x7f535003f470 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f5460057000 tx=0x7f5460052000 comp rx=0 tx=0).stop 2024-09-22T08:36:48.279 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.275+0000 7f546d725800 1 -- 172.21.15.142:0/1824562721 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5613ceef9550 msgr2=0x5613cf07cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:48.279 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.275+0000 7f546d725800 1 --2- 172.21.15.142:0/1824562721 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5613ceef9550 0x5613cf07cb40 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f545c00c010 tx=0x7f545c000ed0 comp rx=0 tx=0).stop 2024-09-22T08:36:48.279 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.275+0000 7f546d725800 1 -- 172.21.15.142:0/1824562721 shutdown_connections 2024-09-22T08:36:48.279 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.275+0000 7f546d725800 1 --2- 172.21.15.142:0/1824562721 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5613cf086530 0x5613cf0889d0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:48.279 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.275+0000 7f546d725800 1 --2- 172.21.15.142:0/1824562721 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5613cef899e0 0x5613cf084190 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:48.279 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.275+0000 7f546d725800 1 --2- 172.21.15.142:0/1824562721 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f535003cfb0 0x7f535003f470 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:48.279 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.275+0000 7f546d725800 1 --2- 172.21.15.142:0/1824562721 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5613ceef9550 0x5613cf07cb40 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:48.280 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.275+0000 7f546d725800 1 -- 172.21.15.142:0/1824562721 >> 172.21.15.142:0/1824562721 conn(0x5613cef7fbe0 msgr2=0x5613cf0764e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:48.280 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.275+0000 7f546d725800 1 -- 172.21.15.142:0/1824562721 shutdown_connections 2024-09-22T08:36:48.280 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.275+0000 7f546d725800 1 -- 172.21.15.142:0/1824562721 wait complete. 2024-09-22T08:36:48.290 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=4 bytes_in=0 failed=False 2024-09-22T08:36:48.293 INFO:tasks.radosgw_admin:RL: get_obj myfoo foo bytes_out=0 bytes_in=4 failed=False 2024-09-22T08:36:48.296 INFO:tasks.radosgw_admin:RL: list_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-22T08:36:48.296 INFO:tasks.util.rgw:rgwadmin: client.0 : ['object', 'rm', '--bucket', 'myfoo', '--object', 'four'] 2024-09-22T08:36:48.296 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'object', 'rm', '--bucket', 'myfoo', '--object', 'four'] 2024-09-22T08:36:48.296 DEBUG:teuthology.orchestra.run.smithi142:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph object rm --bucket myfoo --object four 2024-09-22T08:36:48.342 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:36:48.342 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:36:48.343 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.342+0000 7f32d4c96800 1 Processor -- start 2024-09-22T08:36:48.343 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.342+0000 7f32d4c96800 1 -- start start 2024-09-22T08:36:48.343 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.342+0000 7f32d4c96800 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55af76f87550 0x55af77016150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:48.344 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.342+0000 7f32d4c96800 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55af76e9ea20 con 0x55af77016800 2024-09-22T08:36:48.344 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.342+0000 7f32d4c96800 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x55af76e9e7d0 con 0x55af76f87550 2024-09-22T08:36:48.344 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.343+0000 7f32d2780640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55af76f87550 0x55af77016150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:48.344 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.343+0000 7f32d2780640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55af76f87550 0x55af77016150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:48768/0 (socket says 172.21.15.142:48768) 2024-09-22T08:36:48.345 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.343+0000 7f32d2780640 1 -- 172.21.15.142:0/480356124 learned_addr learned my addr 172.21.15.142:0/480356124 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:48.345 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.343+0000 7f32d1f7f640 1 --1- 172.21.15.142:0/480356124 >> v1:172.21.15.31:6789/0 conn(0x55af77016800 0x55af77018cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.142:44770/0 (socket says 172.21.15.142:44770) 2024-09-22T08:36:48.345 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.343+0000 7f32d2780640 1 -- 172.21.15.142:0/480356124 >> v1:172.21.15.31:6789/0 conn(0x55af77016800 legacy=0x55af77018cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:48.345 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.343+0000 7f32d2780640 1 -- 172.21.15.142:0/480356124 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55af7701b580 con 0x55af76f87550 2024-09-22T08:36:48.346 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.345+0000 7f32d2780640 1 --2- 172.21.15.142:0/480356124 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55af76f87550 0x55af77016150 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f32c4005fd0 tx=0x7f32c4045cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f3e1c61507b80fa server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:48.346 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.345+0000 7f32d177e640 1 -- 172.21.15.142:0/480356124 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32c404e600 con 0x55af76f87550 2024-09-22T08:36:48.346 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.345+0000 7f32d177e640 1 -- 172.21.15.142:0/480356124 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32c404e7a0 con 0x55af76f87550 2024-09-22T08:36:48.346 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.345+0000 7f32d177e640 1 -- 172.21.15.142:0/480356124 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32c404eaa0 con 0x55af76f87550 2024-09-22T08:36:48.347 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.345+0000 7f32d4c96800 1 -- 172.21.15.142:0/480356124 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55af76f87550 msgr2=0x55af77016150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:48.347 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.345+0000 7f32d4c96800 1 --2- 172.21.15.142:0/480356124 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55af76f87550 0x55af77016150 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f32c4005fd0 tx=0x7f32c4045cf0 comp rx=0 tx=0).stop 2024-09-22T08:36:48.347 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.345+0000 7f32d4c96800 1 -- 172.21.15.142:0/480356124 shutdown_connections 2024-09-22T08:36:48.347 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.345+0000 7f32d4c96800 1 --2- 172.21.15.142:0/480356124 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55af76f87550 0x55af77016150 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:48.347 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.345+0000 7f32d4c96800 1 -- 172.21.15.142:0/480356124 >> 172.21.15.142:0/480356124 conn(0x55af7700dbe0 msgr2=0x55af77010020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:48.347 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.345+0000 7f32d4c96800 1 -- 172.21.15.142:0/480356124 shutdown_connections 2024-09-22T08:36:48.348 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.345+0000 7f32d4c96800 1 -- 172.21.15.142:0/480356124 wait complete. 2024-09-22T08:36:48.360 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.359+0000 7f32d4c96800 1 Processor -- start 2024-09-22T08:36:48.360 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.359+0000 7f32d4c96800 1 -- start start 2024-09-22T08:36:48.361 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.359+0000 7f32d4c96800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55af76f87550 0x55af77102ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:48.361 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.359+0000 7f32d4c96800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55af76eabdd0 con 0x55af76f87550 2024-09-22T08:36:48.361 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.359+0000 7f32d2780640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55af76f87550 0x55af77102ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:48.361 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.359+0000 7f32d2780640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55af76f87550 0x55af77102ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:48784/0 (socket says 172.21.15.142:48784) 2024-09-22T08:36:48.361 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.359+0000 7f32d2780640 1 -- 172.21.15.142:0/140339612 learned_addr learned my addr 172.21.15.142:0/140339612 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:48.363 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.360+0000 7f32d2780640 1 -- 172.21.15.142:0/140339612 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55af771035e0 con 0x55af76f87550 2024-09-22T08:36:48.363 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.360+0000 7f32d2780640 1 --2- 172.21.15.142:0/140339612 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55af76f87550 0x55af77102ff0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f32c4005fd0 tx=0x7f32c4050000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46f136ba70bc90c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:48.363 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.360+0000 7f31c0608640 1 -- 172.21.15.142:0/140339612 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32c404eb40 con 0x55af76f87550 2024-09-22T08:36:48.363 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.360+0000 7f31c0608640 1 -- 172.21.15.142:0/140339612 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32c4066070 con 0x55af76f87550 2024-09-22T08:36:48.363 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.360+0000 7f31c0608640 1 -- 172.21.15.142:0/140339612 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32c404ee50 con 0x55af76f87550 2024-09-22T08:36:48.363 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.361+0000 7f32d4c96800 1 -- 172.21.15.142:0/140339612 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55af76f87550 msgr2=0x55af77102ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:48.363 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.361+0000 7f32d4c96800 1 --2- 172.21.15.142:0/140339612 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55af76f87550 0x55af77102ff0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f32c4005fd0 tx=0x7f32c4050000 comp rx=0 tx=0).stop 2024-09-22T08:36:48.363 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.361+0000 7f32d4c96800 1 -- 172.21.15.142:0/140339612 shutdown_connections 2024-09-22T08:36:48.363 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.361+0000 7f32d4c96800 1 --2- 172.21.15.142:0/140339612 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55af76f87550 0x55af77102ff0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:48.363 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.361+0000 7f32d4c96800 1 -- 172.21.15.142:0/140339612 >> 172.21.15.142:0/140339612 conn(0x55af7700dbe0 msgr2=0x55af770fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:48.364 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.361+0000 7f32d4c96800 1 -- 172.21.15.142:0/140339612 shutdown_connections 2024-09-22T08:36:48.364 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.361+0000 7f32d4c96800 1 -- 172.21.15.142:0/140339612 wait complete. 2024-09-22T08:36:48.364 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.361+0000 7f32d4c96800 1 Processor -- start 2024-09-22T08:36:48.364 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.361+0000 7f32d4c96800 1 -- start start 2024-09-22T08:36:48.364 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.361+0000 7f32d4c96800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55af76f87550 0x55af77013840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:48.364 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.361+0000 7f32d4c96800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55af7701a820 con 0x55af76f87550 2024-09-22T08:36:48.364 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.361+0000 7f32d2780640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55af76f87550 0x55af77013840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:48.364 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.362+0000 7f32d2780640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55af76f87550 0x55af77013840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:48790/0 (socket says 172.21.15.142:48790) 2024-09-22T08:36:48.364 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.362+0000 7f32d2780640 1 -- 172.21.15.142:0/4217570571 learned_addr learned my addr 172.21.15.142:0/4217570571 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:48.364 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.362+0000 7f32d2780640 1 -- 172.21.15.142:0/4217570571 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55af77013da0 con 0x55af76f87550 2024-09-22T08:36:48.367 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.362+0000 7f32d2780640 1 --2- 172.21.15.142:0/4217570571 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55af76f87550 0x55af77013840 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f32c4063040 tx=0x7f32c4003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:48.367 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.362+0000 7f31bee05640 1 -- 172.21.15.142:0/4217570571 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32c406d550 con 0x55af76f87550 2024-09-22T08:36:48.367 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.362+0000 7f31bee05640 1 -- 172.21.15.142:0/4217570571 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32c4071030 con 0x55af76f87550 2024-09-22T08:36:48.368 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.362+0000 7f32d4c96800 1 -- 172.21.15.142:0/4217570571 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55af77012150 con 0x55af76f87550 2024-09-22T08:36:48.368 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.362+0000 7f31bee05640 1 -- 172.21.15.142:0/4217570571 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32c406d820 con 0x55af76f87550 2024-09-22T08:36:48.368 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.362+0000 7f32d4c96800 1 -- 172.21.15.142:0/4217570571 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55af77012710 con 0x55af76f87550 2024-09-22T08:36:48.368 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.363+0000 7f31bee05640 1 -- 172.21.15.142:0/4217570571 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f32c406da50 con 0x55af76f87550 2024-09-22T08:36:48.368 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.363+0000 7f31bee05640 1 --2- 172.21.15.142:0/4217570571 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f31b803cfb0 0x7f31b803f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:48.368 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.363+0000 7f31bee05640 1 -- 172.21.15.142:0/4217570571 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f32c4098be0 con 0x55af76f87550 2024-09-22T08:36:48.368 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.363+0000 7f32d1f7f640 1 --2- 172.21.15.142:0/4217570571 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f31b803cfb0 0x7f31b803f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:48.368 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.364+0000 7f32d4c96800 1 --2- 172.21.15.142:0/4217570571 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55af77016800 0x55af77113f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:48.368 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.364+0000 7f32d4c96800 1 -- 172.21.15.142:0/4217570571 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55af771144a0 con 0x55af77016800 2024-09-22T08:36:48.368 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.364+0000 7f32d2f81640 1 --2- 172.21.15.142:0/4217570571 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55af77016800 0x55af77113f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:48.368 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.364+0000 7f32d1f7f640 1 --2- 172.21.15.142:0/4217570571 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f31b803cfb0 0x7f31b803f470 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f32bc001e30 tx=0x7f32bc001390 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:48.368 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.364+0000 7f32d2f81640 1 --2- 172.21.15.142:0/4217570571 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55af77016800 0x55af77113f60 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:48.368 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.364+0000 7f32d2f81640 1 -- 172.21.15.142:0/4217570571 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f32cc0083e0 con 0x55af77016800 2024-09-22T08:36:48.369 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.364+0000 7f32d4c96800 1 -- 172.21.15.142:0/4217570571 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55af77012c10 con 0x55af77016800 2024-09-22T08:36:48.369 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.364+0000 7f32d2f81640 1 -- 172.21.15.142:0/4217570571 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f32cc0083e0 con 0x55af77016800 2024-09-22T08:36:48.369 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.364+0000 7f32d4c96800 1 --2- 172.21.15.142:0/4217570571 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55af77116790 0x55af77118b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:48.369 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.365+0000 7f32d4c96800 1 -- 172.21.15.142:0/4217570571 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:3 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55af77119250 con 0x55af77116790 2024-09-22T08:36:48.369 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.365+0000 7f32d2780640 1 --2- 172.21.15.142:0/4217570571 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55af77116790 0x55af77118b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:48.369 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.365+0000 7f32d2780640 1 --2- 172.21.15.142:0/4217570571 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55af77116790 0x55af77118b80 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:48.369 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.365+0000 7f32d2780640 1 -- 172.21.15.142:0/4217570571 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(3 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f32c407d070 con 0x55af77116790 2024-09-22T08:36:48.369 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.365+0000 7f32d4c96800 1 -- 172.21.15.142:0/4217570571 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55af77115630 con 0x55af77016800 2024-09-22T08:36:48.369 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.365+0000 7f32d2f81640 1 -- 172.21.15.142:0/4217570571 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f32cc0083e0 con 0x55af77016800 2024-09-22T08:36:48.369 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.365+0000 7f32d4c96800 1 -- 172.21.15.142:0/4217570571 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55af77115b10 con 0x55af77116790 2024-09-22T08:36:48.369 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.366+0000 7f32d2780640 1 -- 172.21.15.142:0/4217570571 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(5 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f32c407d070 con 0x55af77116790 2024-09-22T08:36:48.369 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.366+0000 7f32d4c96800 1 Processor -- start 2024-09-22T08:36:48.370 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.366+0000 7f32d4c96800 1 -- start start 2024-09-22T08:36:48.370 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.366+0000 7f32d4c96800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55af77127c10 0x55af77128030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:48.370 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.366+0000 7f32d4c96800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55af76f0ad50 con 0x55af77127c10 2024-09-22T08:36:48.370 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.366+0000 7f32d2f81640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55af77127c10 0x55af77128030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:48.370 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.366+0000 7f32d2f81640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55af77127c10 0x55af77128030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:48796/0 (socket says 172.21.15.142:48796) 2024-09-22T08:36:48.370 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.366+0000 7f32d2f81640 1 -- 172.21.15.142:0/339998147 learned_addr learned my addr 172.21.15.142:0/339998147 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:48.376 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.367+0000 7f32d2f81640 1 -- 172.21.15.142:0/339998147 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55af77128670 con 0x55af77127c10 2024-09-22T08:36:48.376 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.367+0000 7f32d2f81640 1 --2- 172.21.15.142:0/339998147 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55af77127c10 0x55af77128030 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x55af770133e0 tx=0x7f32cc00bf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:48.377 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.367+0000 7f31b7fff640 1 -- 172.21.15.142:0/339998147 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32cc01c020 con 0x55af77127c10 2024-09-22T08:36:48.377 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.367+0000 7f31b7fff640 1 -- 172.21.15.142:0/339998147 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32cc007c90 con 0x55af77127c10 2024-09-22T08:36:48.377 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.367+0000 7f32d4c96800 1 -- 172.21.15.142:0/339998147 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55af77128ea0 con 0x55af77127c10 2024-09-22T08:36:48.377 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.367+0000 7f31b7fff640 1 -- 172.21.15.142:0/339998147 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32cc018440 con 0x55af77127c10 2024-09-22T08:36:48.377 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.367+0000 7f32d4c96800 1 -- 172.21.15.142:0/339998147 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55af77129440 con 0x55af77127c10 2024-09-22T08:36:48.377 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.368+0000 7f31b7fff640 1 -- 172.21.15.142:0/339998147 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f32cc01f020 con 0x55af77127c10 2024-09-22T08:36:48.377 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.368+0000 7f31b7fff640 1 --2- 172.21.15.142:0/339998147 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f31ac03cfb0 0x7f31ac03f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:48.377 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.368+0000 7f31b7fff640 1 -- 172.21.15.142:0/339998147 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f32cc0558e0 con 0x55af77127c10 2024-09-22T08:36:48.377 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.368+0000 7f32d2780640 1 --2- 172.21.15.142:0/339998147 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f31ac03cfb0 0x7f31ac03f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:48.377 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.369+0000 7f32d4c96800 1 Processor -- start 2024-09-22T08:36:48.377 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.369+0000 7f32d2780640 1 --2- 172.21.15.142:0/339998147 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f31ac03cfb0 0x7f31ac03f470 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f32c4097180 tx=0x7f32c4061db0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:48.377 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.369+0000 7f32d4c96800 1 -- start start 2024-09-22T08:36:48.378 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.369+0000 7f32d4c96800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55af77134630 0x55af77134a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:48.378 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.369+0000 7f32d4c96800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55af77103950 con 0x55af77134630 2024-09-22T08:36:48.378 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.369+0000 7f32d2f81640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55af77134630 0x55af77134a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:48.378 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.369+0000 7f32d2f81640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55af77134630 0x55af77134a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:48798/0 (socket says 172.21.15.142:48798) 2024-09-22T08:36:48.378 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.369+0000 7f32d2f81640 1 -- 172.21.15.142:0/3503882990 learned_addr learned my addr 172.21.15.142:0/3503882990 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:48.378 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.369+0000 7f32d2f81640 1 -- 172.21.15.142:0/3503882990 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55af77135020 con 0x55af77134630 2024-09-22T08:36:48.378 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.369+0000 7f32d2f81640 1 --2- 172.21.15.142:0/3503882990 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55af77134630 0x55af77134a30 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f32cc053df0 tx=0x7f32cc015970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90baae80dd44d44a server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:48.378 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.369+0000 7f31b5ffb640 1 -- 172.21.15.142:0/3503882990 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32cc04a070 con 0x55af77134630 2024-09-22T08:36:48.378 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.369+0000 7f31b5ffb640 1 -- 172.21.15.142:0/3503882990 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32cc015e70 con 0x55af77134630 2024-09-22T08:36:48.378 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.369+0000 7f31b5ffb640 1 -- 172.21.15.142:0/3503882990 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32cc0174d0 con 0x55af77134630 2024-09-22T08:36:48.378 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.370+0000 7f32d4c96800 1 -- 172.21.15.142:0/3503882990 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55af77134630 msgr2=0x55af77134a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:48.378 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.370+0000 7f32d4c96800 1 --2- 172.21.15.142:0/3503882990 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55af77134630 0x55af77134a30 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f32cc053df0 tx=0x7f32cc015970 comp rx=0 tx=0).stop 2024-09-22T08:36:48.378 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.370+0000 7f32d4c96800 1 -- 172.21.15.142:0/3503882990 shutdown_connections 2024-09-22T08:36:48.379 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.370+0000 7f32d4c96800 1 --2- 172.21.15.142:0/3503882990 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55af77134630 0x55af77134a30 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:48.379 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.370+0000 7f32d4c96800 1 -- 172.21.15.142:0/3503882990 >> 172.21.15.142:0/3503882990 conn(0x55af77130a50 msgr2=0x55af7712ec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:48.379 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.370+0000 7f32d4c96800 1 -- 172.21.15.142:0/3503882990 shutdown_connections 2024-09-22T08:36:48.379 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.370+0000 7f32d4c96800 1 -- 172.21.15.142:0/3503882990 wait complete. 2024-09-22T08:36:48.379 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.370+0000 7f32d4c96800 1 Processor -- start 2024-09-22T08:36:48.379 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.370+0000 7f32d4c96800 1 -- start start 2024-09-22T08:36:48.379 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.370+0000 7f32d4c96800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55af77134630 0x55af7713bc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:48.379 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.370+0000 7f32d4c96800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55af77135640 con 0x55af77134630 2024-09-22T08:36:48.379 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.371+0000 7f32d2f81640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55af77134630 0x55af7713bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:48.379 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.371+0000 7f32d2f81640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55af77134630 0x55af7713bc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:48804/0 (socket says 172.21.15.142:48804) 2024-09-22T08:36:48.379 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.371+0000 7f32d2f81640 1 -- 172.21.15.142:0/1128250386 learned_addr learned my addr 172.21.15.142:0/1128250386 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:48.379 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.371+0000 7f32d2f81640 1 -- 172.21.15.142:0/1128250386 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55af7713c1d0 con 0x55af77134630 2024-09-22T08:36:48.379 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.371+0000 7f32d2f81640 1 --2- 172.21.15.142:0/1128250386 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55af77134630 0x55af7713bc70 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f32cc008fd0 tx=0x7f32cc053d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:48.380 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.371+0000 7f31a3fff640 1 -- 172.21.15.142:0/1128250386 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32cc04a070 con 0x55af77134630 2024-09-22T08:36:48.380 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.371+0000 7f31a3fff640 1 -- 172.21.15.142:0/1128250386 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32cc04b040 con 0x55af77134630 2024-09-22T08:36:48.380 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.371+0000 7f32d4c96800 1 -- 172.21.15.142:0/1128250386 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55af7713c460 con 0x55af77134630 2024-09-22T08:36:48.380 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.371+0000 7f31a3fff640 1 -- 172.21.15.142:0/1128250386 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32cc017730 con 0x55af77134630 2024-09-22T08:36:48.380 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.371+0000 7f32d4c96800 1 -- 172.21.15.142:0/1128250386 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55af7713cff0 con 0x55af77134630 2024-09-22T08:36:48.380 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.372+0000 7f31a3fff640 1 -- 172.21.15.142:0/1128250386 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f32cc016040 con 0x55af77134630 2024-09-22T08:36:48.380 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.372+0000 7f31a3fff640 1 --2- 172.21.15.142:0/1128250386 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f319c03cfb0 0x7f319c03f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:48.380 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.372+0000 7f31a3fff640 1 -- 172.21.15.142:0/1128250386 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f32cc055040 con 0x55af77134630 2024-09-22T08:36:48.380 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.372+0000 7f32d2780640 1 --2- 172.21.15.142:0/1128250386 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f319c03cfb0 0x7f319c03f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:48.380 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.373+0000 7f32d2780640 1 --2- 172.21.15.142:0/1128250386 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f319c03cfb0 0x7f319c03f470 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f32c40973e0 tx=0x7f32c4088000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:48.380 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.373+0000 7f32d4c96800 20 rados->read ofs=0 len=0 2024-09-22T08:36:48.380 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.373+0000 7f32d4c96800 1 --2- 172.21.15.142:0/1128250386 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55af77147540 0x55af77149a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:48.380 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.373+0000 7f32d4c96800 1 -- 172.21.15.142:0/1128250386 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55af7714a150 con 0x55af77147540 2024-09-22T08:36:48.380 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.373+0000 7f32d1f7f640 1 --2- 172.21.15.142:0/1128250386 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55af77147540 0x55af77149a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:48.381 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.373+0000 7f32d1f7f640 1 --2- 172.21.15.142:0/1128250386 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55af77147540 0x55af77149a00 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:48.381 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.373+0000 7f32d1f7f640 1 -- 172.21.15.142:0/1128250386 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f32bc00f610 con 0x55af77147540 2024-09-22T08:36:48.381 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.373+0000 7f32d4c96800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:48.381 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.373+0000 7f32d4c96800 20 realm 2024-09-22T08:36:48.381 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.373+0000 7f32d4c96800 20 rados->read ofs=0 len=0 2024-09-22T08:36:48.381 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.373+0000 7f32d4c96800 1 -- 172.21.15.142:0/1128250386 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55af77146890 con 0x55af77147540 2024-09-22T08:36:48.381 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.374+0000 7f32d1f7f640 1 -- 172.21.15.142:0/1128250386 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f32bc00f610 con 0x55af77147540 2024-09-22T08:36:48.381 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.374+0000 7f32d4c96800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:48.381 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.374+0000 7f32d4c96800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:36:48.381 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.374+0000 7f32d4c96800 20 rados->read ofs=0 len=0 2024-09-22T08:36:48.381 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.374+0000 7f32d4c96800 1 -- 172.21.15.142:0/1128250386 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55af7714ac40 con 0x55af77147540 2024-09-22T08:36:48.381 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.374+0000 7f32d1f7f640 1 -- 172.21.15.142:0/1128250386 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f32bc00f610 con 0x55af77147540 2024-09-22T08:36:48.381 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.374+0000 7f32d4c96800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:48.382 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.374+0000 7f32d4c96800 20 rados->read ofs=0 len=0 2024-09-22T08:36:48.382 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.374+0000 7f32d4c96800 1 -- 172.21.15.142:0/1128250386 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55af7714b510 con 0x55af77147540 2024-09-22T08:36:48.382 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.374+0000 7f32d1f7f640 1 -- 172.21.15.142:0/1128250386 <== osd.1 v2:172.21.15.142:6816/3192108003 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f32bc00f610 con 0x55af77147540 2024-09-22T08:36:48.382 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.374+0000 7f32d4c96800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:36:48.382 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.374+0000 7f32d4c96800 20 rados->read ofs=0 len=0 2024-09-22T08:36:48.382 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.374+0000 7f32d4c96800 1 --2- 172.21.15.142:0/1128250386 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55af7714bf30 0x55af7714e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:48.382 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.374+0000 7f32d4c96800 1 -- 172.21.15.142:0/1128250386 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55af7714ea60 con 0x55af7714bf30 2024-09-22T08:36:48.382 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.374+0000 7f32d2f81640 1 --2- 172.21.15.142:0/1128250386 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55af7714bf30 0x55af7714e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:48.382 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.374+0000 7f32d2f81640 1 --2- 172.21.15.142:0/1128250386 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55af7714bf30 0x55af7714e320 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:48.382 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.375+0000 7f32d2f81640 1 -- 172.21.15.142:0/1128250386 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(5 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f32cc0083e0 con 0x55af7714bf30 2024-09-22T08:36:48.382 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.375+0000 7f32d4c96800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:36:48.382 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.375+0000 7f32d4c96800 20 searching for the correct realm 2024-09-22T08:36:48.382 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.375+0000 7f32d4c96800 1 -- 172.21.15.142:0/1128250386 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55af77150390 con 0x55af7714bf30 2024-09-22T08:36:48.383 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.375+0000 7f32d2f81640 1 -- 172.21.15.142:0/1128250386 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32cc0083e0 con 0x55af7714bf30 2024-09-22T08:36:48.383 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.375+0000 7f32d2f81640 1 --2- 172.21.15.142:0/1128250386 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f32cc057c20 0x7f32cc021aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:48.383 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.375+0000 7f32d2f81640 1 -- 172.21.15.142:0/1128250386 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55af77150390 con 0x7f32cc057c20 2024-09-22T08:36:48.383 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.375+0000 7f32d2780640 1 --2- 172.21.15.142:0/1128250386 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f32cc057c20 0x7f32cc021aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:48.383 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.375+0000 7f32d2780640 1 --2- 172.21.15.142:0/1128250386 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f32cc057c20 0x7f32cc021aa0 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:48.392 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.376+0000 7f32d2780640 1 -- 172.21.15.142:0/1128250386 <== osd.2 v2:172.21.15.142:6808/279438927 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32c40a2040 con 0x7f32cc057c20 2024-09-22T08:36:48.392 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.376+0000 7f32d2780640 1 --2- 172.21.15.142:0/1128250386 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f32c40a5040 0x7f32c4056910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:48.392 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.376+0000 7f32d2780640 1 -- 172.21.15.142:0/1128250386 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55af77150390 con 0x7f32c40a5040 2024-09-22T08:36:48.392 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.376+0000 7f32d1f7f640 1 --2- 172.21.15.142:0/1128250386 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f32c40a5040 0x7f32c4056910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:48.392 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.376+0000 7f32d1f7f640 1 --2- 172.21.15.142:0/1128250386 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f32c40a5040 0x7f32c4056910 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:48.392 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.377+0000 7f32d1f7f640 1 -- 172.21.15.142:0/1128250386 <== osd.0 v2:172.21.15.31:6800/168281188 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32bc00f610 con 0x7f32c40a5040 2024-09-22T08:36:48.392 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.377+0000 7f32d1f7f640 1 -- 172.21.15.142:0/1128250386 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55af77150390 con 0x55af77147540 2024-09-22T08:36:48.393 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.377+0000 7f32d1f7f640 1 -- 172.21.15.142:0/1128250386 <== osd.1 v2:172.21.15.142:6816/3192108003 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32bc00f610 con 0x55af77147540 2024-09-22T08:36:48.393 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.377+0000 7f32d1f7f640 1 -- 172.21.15.142:0/1128250386 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55af77150390 con 0x55af77147540 2024-09-22T08:36:48.393 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.377+0000 7f32d1f7f640 1 -- 172.21.15.142:0/1128250386 <== osd.1 v2:172.21.15.142:6816/3192108003 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32bc02b040 con 0x55af77147540 2024-09-22T08:36:48.393 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.377+0000 7f32d1f7f640 1 -- 172.21.15.142:0/1128250386 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55af77150390 con 0x7f32c40a5040 2024-09-22T08:36:48.393 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.377+0000 7f32d1f7f640 1 -- 172.21.15.142:0/1128250386 <== osd.0 v2:172.21.15.31:6800/168281188 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32bc02b040 con 0x7f32c40a5040 2024-09-22T08:36:48.393 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.377+0000 7f32d1f7f640 1 -- 172.21.15.142:0/1128250386 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55af77150390 con 0x7f32c40a5040 2024-09-22T08:36:48.393 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.377+0000 7f32d1f7f640 1 -- 172.21.15.142:0/1128250386 <== osd.0 v2:172.21.15.31:6800/168281188 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32bc02b040 con 0x7f32c40a5040 2024-09-22T08:36:48.393 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.378+0000 7f32d1f7f640 1 -- 172.21.15.142:0/1128250386 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55af77150390 con 0x7f32cc057c20 2024-09-22T08:36:48.393 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.378+0000 7f32d2780640 1 -- 172.21.15.142:0/1128250386 <== osd.2 v2:172.21.15.142:6808/279438927 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32c40a2040 con 0x7f32cc057c20 2024-09-22T08:36:48.393 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.378+0000 7f32d2780640 1 -- 172.21.15.142:0/1128250386 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55af77150390 con 0x55af7714bf30 2024-09-22T08:36:48.393 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.378+0000 7f32d2f81640 1 -- 172.21.15.142:0/1128250386 <== osd.3 v2:172.21.15.142:6800/1064901393 3 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32cc0083e0 con 0x55af7714bf30 2024-09-22T08:36:48.393 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.378+0000 7f32d2f81640 1 -- 172.21.15.142:0/1128250386 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55af77150390 con 0x55af77147540 2024-09-22T08:36:48.393 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.378+0000 7f32d1f7f640 1 -- 172.21.15.142:0/1128250386 <== osd.1 v2:172.21.15.142:6816/3192108003 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32bc02b040 con 0x55af77147540 2024-09-22T08:36:48.394 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.378+0000 7f32d1f7f640 1 -- 172.21.15.142:0/1128250386 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55af77150390 con 0x7f32c40a5040 2024-09-22T08:36:48.394 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.379+0000 7f32d1f7f640 1 -- 172.21.15.142:0/1128250386 <== osd.0 v2:172.21.15.31:6800/168281188 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32bc02b040 con 0x7f32c40a5040 2024-09-22T08:36:48.394 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.379+0000 7f32d1f7f640 1 -- 172.21.15.142:0/1128250386 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55af77150390 con 0x55af77147540 2024-09-22T08:36:48.394 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.379+0000 7f32d1f7f640 1 -- 172.21.15.142:0/1128250386 <== osd.1 v2:172.21.15.142:6816/3192108003 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32bc02b040 con 0x55af77147540 2024-09-22T08:36:48.394 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.379+0000 7f32d1f7f640 1 -- 172.21.15.142:0/1128250386 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55af77150390 con 0x7f32cc057c20 2024-09-22T08:36:48.394 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.379+0000 7f32d2780640 1 -- 172.21.15.142:0/1128250386 <== osd.2 v2:172.21.15.142:6808/279438927 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f32c40a2040 con 0x7f32cc057c20 2024-09-22T08:36:48.394 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.379+0000 7f32d2780640 1 -- 172.21.15.142:0/1128250386 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55af77150390 con 0x55af7714bf30 2024-09-22T08:36:48.394 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.379+0000 7f32d2f81640 1 -- 172.21.15.142:0/1128250386 <== osd.3 v2:172.21.15.142:6800/1064901393 4 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32cc0083e0 con 0x55af7714bf30 2024-09-22T08:36:48.394 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.379+0000 7f32d2f81640 1 -- 172.21.15.142:0/1128250386 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55af77150390 con 0x55af7714bf30 2024-09-22T08:36:48.394 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.379+0000 7f32d2f81640 1 -- 172.21.15.142:0/1128250386 <== osd.3 v2:172.21.15.142:6800/1064901393 5 ==== osd_op_reply(20 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f32cc0083e0 con 0x55af7714bf30 2024-09-22T08:36:48.394 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.379+0000 7f32d2f81640 1 -- 172.21.15.142:0/1128250386 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55af77150390 con 0x7f32c40a5040 2024-09-22T08:36:48.394 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.380+0000 7f32d1f7f640 1 -- 172.21.15.142:0/1128250386 <== osd.0 v2:172.21.15.31:6800/168281188 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32bc02b040 con 0x7f32c40a5040 2024-09-22T08:36:48.395 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.380+0000 7f32d1f7f640 1 -- 172.21.15.142:0/1128250386 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55af77150390 con 0x55af7714bf30 2024-09-22T08:36:48.395 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.380+0000 7f32d2f81640 1 -- 172.21.15.142:0/1128250386 <== osd.3 v2:172.21.15.142:6800/1064901393 6 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32cc0083e0 con 0x55af7714bf30 2024-09-22T08:36:48.395 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.380+0000 7f32d2f81640 1 -- 172.21.15.142:0/1128250386 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55af77150390 con 0x55af7714bf30 2024-09-22T08:36:48.395 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.380+0000 7f32d2f81640 1 -- 172.21.15.142:0/1128250386 <== osd.3 v2:172.21.15.142:6800/1064901393 7 ==== osd_op_reply(23 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f32cc0083e0 con 0x55af7714bf30 2024-09-22T08:36:48.395 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.380+0000 7f32d2f81640 1 -- 172.21.15.142:0/1128250386 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55af77150390 con 0x55af77147540 2024-09-22T08:36:48.395 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.381+0000 7f32d1f7f640 1 -- 172.21.15.142:0/1128250386 <== osd.1 v2:172.21.15.142:6816/3192108003 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32bc02b040 con 0x55af77147540 2024-09-22T08:36:48.395 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.381+0000 7f32d1f7f640 1 -- 172.21.15.142:0/1128250386 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55af77150390 con 0x55af77147540 2024-09-22T08:36:48.395 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.381+0000 7f32d1f7f640 1 -- 172.21.15.142:0/1128250386 <== osd.1 v2:172.21.15.142:6816/3192108003 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f32bc02b040 con 0x55af77147540 2024-09-22T08:36:48.395 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.381+0000 7f32d1f7f640 1 -- 172.21.15.142:0/1128250386 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55af77150390 con 0x7f32c40a5040 2024-09-22T08:36:48.395 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.381+0000 7f32d1f7f640 1 -- 172.21.15.142:0/1128250386 <== osd.0 v2:172.21.15.31:6800/168281188 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32bc02b040 con 0x7f32c40a5040 2024-09-22T08:36:48.395 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.381+0000 7f32d1f7f640 1 -- 172.21.15.142:0/1128250386 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55af77150390 con 0x55af7714bf30 2024-09-22T08:36:48.395 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.381+0000 7f32d2f81640 1 -- 172.21.15.142:0/1128250386 <== osd.3 v2:172.21.15.142:6800/1064901393 8 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32cc0083e0 con 0x55af7714bf30 2024-09-22T08:36:48.395 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.381+0000 7f32d2f81640 1 -- 172.21.15.142:0/1128250386 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55af77150390 con 0x7f32cc057c20 2024-09-22T08:36:48.396 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.382+0000 7f32d2780640 1 -- 172.21.15.142:0/1128250386 <== osd.2 v2:172.21.15.142:6808/279438927 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32c40a2040 con 0x7f32cc057c20 2024-09-22T08:36:48.396 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.382+0000 7f32d2780640 1 -- 172.21.15.142:0/1128250386 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55af77150390 con 0x55af77147540 2024-09-22T08:36:48.396 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.382+0000 7f32d1f7f640 1 -- 172.21.15.142:0/1128250386 <== osd.1 v2:172.21.15.142:6816/3192108003 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32bc02b040 con 0x55af77147540 2024-09-22T08:36:48.396 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.382+0000 7f32d1f7f640 1 -- 172.21.15.142:0/1128250386 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55af77150390 con 0x7f32c40a5040 2024-09-22T08:36:48.396 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.382+0000 7f32d1f7f640 1 -- 172.21.15.142:0/1128250386 <== osd.0 v2:172.21.15.31:6800/168281188 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32bc03b040 con 0x7f32c40a5040 2024-09-22T08:36:48.396 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.382+0000 7f32d1f7f640 1 -- 172.21.15.142:0/1128250386 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55af77150390 con 0x55af7714bf30 2024-09-22T08:36:48.396 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.382+0000 7f32d2f81640 1 -- 172.21.15.142:0/1128250386 <== osd.3 v2:172.21.15.142:6800/1064901393 9 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32cc0083e0 con 0x55af7714bf30 2024-09-22T08:36:48.396 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.382+0000 7f32d2f81640 1 -- 172.21.15.142:0/1128250386 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55af77150390 con 0x7f32c40a5040 2024-09-22T08:36:48.396 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.383+0000 7f32d1f7f640 1 -- 172.21.15.142:0/1128250386 <== osd.0 v2:172.21.15.31:6800/168281188 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32bc03b040 con 0x7f32c40a5040 2024-09-22T08:36:48.396 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.383+0000 7f32d1f7f640 1 -- 172.21.15.142:0/1128250386 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55af77150390 con 0x7f32cc057c20 2024-09-22T08:36:48.396 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.383+0000 7f32d2780640 1 -- 172.21.15.142:0/1128250386 <== osd.2 v2:172.21.15.142:6808/279438927 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32c40a2040 con 0x7f32cc057c20 2024-09-22T08:36:48.396 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.383+0000 7f32d2780640 1 -- 172.21.15.142:0/1128250386 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55af77150390 con 0x55af7714bf30 2024-09-22T08:36:48.396 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.383+0000 7f32d2f81640 1 -- 172.21.15.142:0/1128250386 <== osd.3 v2:172.21.15.142:6800/1064901393 10 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32cc0083e0 con 0x55af7714bf30 2024-09-22T08:36:48.397 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.383+0000 7f32d2f81640 1 -- 172.21.15.142:0/1128250386 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55af77150390 con 0x7f32c40a5040 2024-09-22T08:36:48.397 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.384+0000 7f32d1f7f640 1 -- 172.21.15.142:0/1128250386 <== osd.0 v2:172.21.15.31:6800/168281188 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32bc03b040 con 0x7f32c40a5040 2024-09-22T08:36:48.397 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.384+0000 7f32d1f7f640 1 -- 172.21.15.142:0/1128250386 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55af77150390 con 0x55af77147540 2024-09-22T08:36:48.397 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.384+0000 7f32d1f7f640 1 -- 172.21.15.142:0/1128250386 <== osd.1 v2:172.21.15.142:6816/3192108003 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f32bc03b040 con 0x55af77147540 2024-09-22T08:36:48.397 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.384+0000 7f32d1f7f640 1 -- 172.21.15.142:0/1128250386 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55af77150390 con 0x7f32cc057c20 2024-09-22T08:36:48.397 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.384+0000 7f32d2780640 1 -- 172.21.15.142:0/1128250386 <== osd.2 v2:172.21.15.142:6808/279438927 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32c40a2040 con 0x7f32cc057c20 2024-09-22T08:36:48.397 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.384+0000 7f32d4c96800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:36:48.397 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.384+0000 7f32d4c96800 20 RGWRados::pool_iterate: got zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec 2024-09-22T08:36:48.397 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.384+0000 7f32d4c96800 20 RGWRados::pool_iterate: got zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f 2024-09-22T08:36:48.397 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.384+0000 7f32d4c96800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:36:48.397 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.384+0000 7f32d4c96800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:36:48.397 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.384+0000 7f32d4c96800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:36:48.397 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.384+0000 7f32d4c96800 20 rados->read ofs=0 len=0 2024-09-22T08:36:48.397 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.384+0000 7f32d4c96800 1 -- 172.21.15.142:0/1128250386 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55af7714f420 con 0x55af77147540 2024-09-22T08:36:48.398 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.384+0000 7f32d1f7f640 1 -- 172.21.15.142:0/1128250386 <== osd.1 v2:172.21.15.142:6816/3192108003 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f32bc03b040 con 0x55af77147540 2024-09-22T08:36:48.398 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.384+0000 7f32d4c96800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:48.398 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.384+0000 7f32d4c96800 20 rados->read ofs=0 len=0 2024-09-22T08:36:48.398 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.384+0000 7f32d4c96800 1 -- 172.21.15.142:0/1128250386 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55af7714fc70 con 0x55af77147540 2024-09-22T08:36:48.398 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.385+0000 7f32d1f7f640 1 -- 172.21.15.142:0/1128250386 <== osd.1 v2:172.21.15.142:6816/3192108003 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f32bc03b040 con 0x55af77147540 2024-09-22T08:36:48.398 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.385+0000 7f32d4c96800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:36:48.398 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.385+0000 7f32d4c96800 20 rados->read ofs=0 len=0 2024-09-22T08:36:48.398 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.385+0000 7f32d4c96800 1 -- 172.21.15.142:0/1128250386 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:40 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55af77150810 con 0x55af7714bf30 2024-09-22T08:36:48.398 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.385+0000 7f32d2f81640 1 -- 172.21.15.142:0/1128250386 <== osd.3 v2:172.21.15.142:6800/1064901393 11 ==== osd_op_reply(40 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f32cc0083e0 con 0x55af7714bf30 2024-09-22T08:36:48.398 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.385+0000 7f32d4c96800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:36:48.398 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.385+0000 7f32d4c96800 20 zone default found 2024-09-22T08:36:48.398 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.385+0000 7f32d4c96800 4 Realm: () 2024-09-22T08:36:48.398 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.385+0000 7f32d4c96800 4 ZoneGroup: default (d89f6f57-1007-47dd-9065-f486c7b01aec) 2024-09-22T08:36:48.399 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.385+0000 7f32d4c96800 4 Zone: default (e239248c-0bee-4e41-803a-24b288d3eb8f) 2024-09-22T08:36:48.399 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.385+0000 7f32d4c96800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:36:48.399 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.385+0000 7f32d4c96800 20 zonegroup default 2024-09-22T08:36:48.399 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.385+0000 7f32d4c96800 20 rados->read ofs=0 len=0 2024-09-22T08:36:48.399 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.385+0000 7f32d4c96800 1 -- 172.21.15.142:0/1128250386 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55af77150bf0 con 0x7f32c40a5040 2024-09-22T08:36:48.399 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.385+0000 7f32d1f7f640 1 -- 172.21.15.142:0/1128250386 <== osd.0 v2:172.21.15.31:6800/168281188 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f32bc03b040 con 0x7f32c40a5040 2024-09-22T08:36:48.399 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.385+0000 7f32d4c96800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:48.399 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.385+0000 7f32d4c96800 20 rados->read ofs=0 len=0 2024-09-22T08:36:48.399 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.385+0000 7f32d4c96800 1 -- 172.21.15.142:0/1128250386 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55af77152a20 con 0x55af7714bf30 2024-09-22T08:36:48.399 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.385+0000 7f32d2f81640 1 -- 172.21.15.142:0/1128250386 <== osd.3 v2:172.21.15.142:6800/1064901393 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f32cc0083e0 con 0x55af7714bf30 2024-09-22T08:36:48.399 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.385+0000 7f32d4c96800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:48.399 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.385+0000 7f32d4c96800 20 rados->read ofs=0 len=0 2024-09-22T08:36:48.399 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.385+0000 7f32d4c96800 1 -- 172.21.15.142:0/1128250386 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55af77152ee0 con 0x55af7714bf30 2024-09-22T08:36:48.399 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.386+0000 7f32d2f81640 1 -- 172.21.15.142:0/1128250386 <== osd.3 v2:172.21.15.142:6800/1064901393 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f32cc0083e0 con 0x55af7714bf30 2024-09-22T08:36:48.400 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.386+0000 7f32d4c96800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:48.400 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.386+0000 7f32d4c96800 20 started sync module instance, tier type = 2024-09-22T08:36:48.400 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.386+0000 7f32d4c96800 20 started zone id=e239248c-0bee-4e41-803a-24b288d3eb8f (name=default) with tier type = 2024-09-22T08:36:48.400 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.386+0000 7f32d4c96800 1 -- 172.21.15.142:0/1128250386 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55af77151ec0 con 0x7f32cc057c20 2024-09-22T08:36:48.400 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.387+0000 7f32d2780640 1 -- 172.21.15.142:0/1128250386 <== osd.2 v2:172.21.15.142:6808/279438927 7 ==== osd_op_reply(44 notify.0 [create] v30'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32c40a2040 con 0x7f32cc057c20 2024-09-22T08:36:48.401 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.387+0000 7f32d4c96800 1 -- 172.21.15.142:0/1128250386 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94212105509392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55af77153340 con 0x7f32cc057c20 2024-09-22T08:36:48.401 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.387+0000 7f32d4c96800 1 -- 172.21.15.142:0/1128250386 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55af77153b90 con 0x55af77147540 2024-09-22T08:36:48.401 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.388+0000 7f32d2780640 1 -- 172.21.15.142:0/1128250386 <== osd.2 v2:172.21.15.142:6808/279438927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94212105509392] v30'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32c40a2040 con 0x7f32cc057c20 2024-09-22T08:36:48.402 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.388+0000 7f32d1f7f640 1 -- 172.21.15.142:0/1128250386 <== osd.1 v2:172.21.15.142:6816/3192108003 15 ==== osd_op_reply(46 notify.1 [create] v30'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32bc03b040 con 0x55af77147540 2024-09-22T08:36:48.402 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.388+0000 7f32d4c96800 1 -- 172.21.15.142:0/1128250386 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94212105511648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55af77153cd0 con 0x55af77147540 2024-09-22T08:36:48.402 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.388+0000 7f32d4c96800 1 -- 172.21.15.142:0/1128250386 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55af771547f0 con 0x55af7714bf30 2024-09-22T08:36:48.402 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.389+0000 7f32d2f81640 1 -- 172.21.15.142:0/1128250386 <== osd.3 v2:172.21.15.142:6800/1064901393 14 ==== osd_op_reply(48 notify.2 [create] v30'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32cc0083e0 con 0x55af7714bf30 2024-09-22T08:36:48.402 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.389+0000 7f32d4c96800 1 -- 172.21.15.142:0/1128250386 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94212105519808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55af771547b0 con 0x55af7714bf30 2024-09-22T08:36:48.402 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.389+0000 7f32d1f7f640 1 -- 172.21.15.142:0/1128250386 <== osd.1 v2:172.21.15.142:6816/3192108003 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94212105511648] v30'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32bc03b040 con 0x55af77147540 2024-09-22T08:36:48.402 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.389+0000 7f32d4c96800 1 -- 172.21.15.142:0/1128250386 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55af771557d0 con 0x7f32cc057c20 2024-09-22T08:36:48.402 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.391+0000 7f32d2f81640 1 -- 172.21.15.142:0/1128250386 <== osd.3 v2:172.21.15.142:6800/1064901393 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94212105519808] v30'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32cc0083e0 con 0x55af7714bf30 2024-09-22T08:36:48.402 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.391+0000 7f32d2780640 1 -- 172.21.15.142:0/1128250386 <== osd.2 v2:172.21.15.142:6808/279438927 9 ==== osd_op_reply(50 notify.3 [create] v30'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32c40a2040 con 0x7f32cc057c20 2024-09-22T08:36:48.402 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.391+0000 7f32d4c96800 1 -- 172.21.15.142:0/1128250386 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94212105522144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55af77153720 con 0x7f32cc057c20 2024-09-22T08:36:48.402 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.391+0000 7f32d4c96800 1 -- 172.21.15.142:0/1128250386 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55af771560b0 con 0x55af77147540 2024-09-22T08:36:48.406 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.392+0000 7f32d1f7f640 1 -- 172.21.15.142:0/1128250386 <== osd.1 v2:172.21.15.142:6816/3192108003 17 ==== osd_op_reply(52 notify.4 [create] v30'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32bc03b040 con 0x55af77147540 2024-09-22T08:36:48.406 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.392+0000 7f32d4c96800 1 -- 172.21.15.142:0/1128250386 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94212105526208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55af77156060 con 0x55af77147540 2024-09-22T08:36:48.406 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.392+0000 7f32d4c96800 1 -- 172.21.15.142:0/1128250386 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55af77157080 con 0x7f32c40a5040 2024-09-22T08:36:48.406 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.392+0000 7f32d2780640 1 -- 172.21.15.142:0/1128250386 <== osd.2 v2:172.21.15.142:6808/279438927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94212105522144] v30'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32c40a2040 con 0x7f32cc057c20 2024-09-22T08:36:48.406 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.393+0000 7f32d1f7f640 1 -- 172.21.15.142:0/1128250386 <== osd.0 v2:172.21.15.31:6800/168281188 11 ==== osd_op_reply(54 notify.5 [create] v30'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32bc03b040 con 0x7f32c40a5040 2024-09-22T08:36:48.406 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.393+0000 7f32d1f7f640 1 -- 172.21.15.142:0/1128250386 <== osd.1 v2:172.21.15.142:6816/3192108003 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94212105526208] v30'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32bc03b040 con 0x55af77147540 2024-09-22T08:36:48.406 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.393+0000 7f32d4c96800 1 -- 172.21.15.142:0/1128250386 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94212105530224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55af77157040 con 0x7f32c40a5040 2024-09-22T08:36:48.406 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.393+0000 7f32d4c96800 1 -- 172.21.15.142:0/1128250386 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55af77157920 con 0x7f32c40a5040 2024-09-22T08:36:48.406 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.394+0000 7f32d1f7f640 1 -- 172.21.15.142:0/1128250386 <== osd.0 v2:172.21.15.31:6800/168281188 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94212105530224] v30'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32bc03b040 con 0x7f32c40a5040 2024-09-22T08:36:48.406 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.394+0000 7f32d1f7f640 1 -- 172.21.15.142:0/1128250386 <== osd.0 v2:172.21.15.31:6800/168281188 13 ==== osd_op_reply(56 notify.6 [create] v30'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32bc03b040 con 0x7f32c40a5040 2024-09-22T08:36:48.406 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.394+0000 7f32d4c96800 1 -- 172.21.15.142:0/1128250386 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94212105528480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55af77157040 con 0x7f32c40a5040 2024-09-22T08:36:48.407 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.394+0000 7f32d4c96800 1 -- 172.21.15.142:0/1128250386 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55af77157f40 con 0x7f32c40a5040 2024-09-22T08:36:48.407 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.395+0000 7f32d1f7f640 1 -- 172.21.15.142:0/1128250386 <== osd.0 v2:172.21.15.31:6800/168281188 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94212105528480] v30'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32bc03b040 con 0x7f32c40a5040 2024-09-22T08:36:48.407 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.395+0000 7f32d1f7f640 1 -- 172.21.15.142:0/1128250386 <== osd.0 v2:172.21.15.31:6800/168281188 15 ==== osd_op_reply(58 notify.7 [create] v30'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32bc03b040 con 0x7f32c40a5040 2024-09-22T08:36:48.407 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.395+0000 7f32d4c96800 1 -- 172.21.15.142:0/1128250386 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94212105531936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55af77157f40 con 0x7f32c40a5040 2024-09-22T08:36:48.407 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.395+0000 7f32d4c96800 20 add_watcher() i=0 2024-09-22T08:36:48.407 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.395+0000 7f32d4c96800 20 add_watcher() i=1 2024-09-22T08:36:48.407 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.395+0000 7f32d4c96800 20 add_watcher() i=2 2024-09-22T08:36:48.407 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.395+0000 7f32d4c96800 20 add_watcher() i=3 2024-09-22T08:36:48.407 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.395+0000 7f32d4c96800 20 add_watcher() i=4 2024-09-22T08:36:48.407 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.395+0000 7f32d4c96800 20 add_watcher() i=5 2024-09-22T08:36:48.407 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.395+0000 7f32d4c96800 20 add_watcher() i=6 2024-09-22T08:36:48.407 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.396+0000 7f32d1f7f640 1 -- 172.21.15.142:0/1128250386 <== osd.0 v2:172.21.15.31:6800/168281188 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94212105531936] v30'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32bc03b040 con 0x7f32c40a5040 2024-09-22T08:36:48.407 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.396+0000 7f32d4c96800 20 add_watcher() i=7 2024-09-22T08:36:48.407 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.396+0000 7f32d4c96800 2 all 8 watchers are set, enabling cache 2024-09-22T08:36:48.408 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.396+0000 7f32d4c96800 1 -- 172.21.15.142:0/1128250386 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55af7715b400 con 0x55af77147540 2024-09-22T08:36:48.408 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.396+0000 7f32d1f7f640 1 -- 172.21.15.142:0/1128250386 <== osd.1 v2:172.21.15.142:6816/3192108003 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f32bc03b040 con 0x55af77147540 2024-09-22T08:36:48.408 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.396+0000 7f32d4c96800 1 -- 172.21.15.142:0/1128250386 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94212105547264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55af771580b0 con 0x55af77147540 2024-09-22T08:36:48.408 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.398+0000 7f32d1f7f640 1 -- 172.21.15.142:0/1128250386 <== osd.1 v2:172.21.15.142:6816/3192108003 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94212105547264] v30'139 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f32bc03b040 con 0x55af77147540 2024-09-22T08:36:48.408 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.398+0000 7f3188fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:36:48.408 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.398+0000 7f32d4c96800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:36:48.408 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.398+0000 7f32d4c96800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:36:48.408 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.398+0000 7f32d4c96800 1 -- 172.21.15.142:0/1128250386 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55af77163f60 con 0x55af77147540 2024-09-22T08:36:48.408 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.399+0000 7f32d1f7f640 1 -- 172.21.15.142:0/1128250386 <== osd.1 v2:172.21.15.142:6816/3192108003 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v30'23 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f32bc03b040 con 0x55af77147540 2024-09-22T08:36:48.408 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.399+0000 7f32d4c96800 1 -- 172.21.15.142:0/1128250386 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55af77164590 con 0x7f32c40a5040 2024-09-22T08:36:48.408 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.400+0000 7f32d1f7f640 1 -- 172.21.15.142:0/1128250386 <== osd.0 v2:172.21.15.31:6800/168281188 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v30'17 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f32bc03b040 con 0x7f32c40a5040 2024-09-22T08:36:48.408 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.400+0000 7f32d4c96800 1 -- 172.21.15.142:0/1128250386 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55af771649f0 con 0x55af7714bf30 2024-09-22T08:36:48.408 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.401+0000 7f32d2f81640 1 -- 172.21.15.142:0/1128250386 <== osd.3 v2:172.21.15.142:6800/1064901393 16 ==== osd_op_reply(64 gc.2 [create,call,call,call] v30'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f32cc0083e0 con 0x55af7714bf30 2024-09-22T08:36:48.409 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.401+0000 7f32d4c96800 1 -- 172.21.15.142:0/1128250386 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55af77164920 con 0x55af77147540 2024-09-22T08:36:48.409 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.402+0000 7f32d1f7f640 1 -- 172.21.15.142:0/1128250386 <== osd.1 v2:172.21.15.142:6816/3192108003 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v30'140 uv15 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f32bc03b040 con 0x55af77147540 2024-09-22T08:36:48.409 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.402+0000 7f32d4c96800 1 -- 172.21.15.142:0/1128250386 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55af771639d0 con 0x7f32cc057c20 2024-09-22T08:36:48.409 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.403+0000 7f32d2780640 1 -- 172.21.15.142:0/1128250386 <== osd.2 v2:172.21.15.142:6808/279438927 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v30'41 uv13 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f32c40a2040 con 0x7f32cc057c20 2024-09-22T08:36:48.409 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.403+0000 7f32d4c96800 1 -- 172.21.15.142:0/1128250386 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55af77165140 con 0x55af7714bf30 2024-09-22T08:36:48.409 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.404+0000 7f32d2f81640 1 -- 172.21.15.142:0/1128250386 <== osd.3 v2:172.21.15.142:6800/1064901393 17 ==== osd_op_reply(67 gc.5 [create,call,call,call] v30'27 uv10 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f32cc0083e0 con 0x55af7714bf30 2024-09-22T08:36:48.409 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.404+0000 7f32d4c96800 1 -- 172.21.15.142:0/1128250386 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55af77165140 con 0x55af77147540 2024-09-22T08:36:48.410 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.405+0000 7f32d1f7f640 1 -- 172.21.15.142:0/1128250386 <== osd.1 v2:172.21.15.142:6816/3192108003 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v30'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f32bc03b040 con 0x55af77147540 2024-09-22T08:36:48.410 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.405+0000 7f32d4c96800 1 -- 172.21.15.142:0/1128250386 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55af77165140 con 0x7f32c40a5040 2024-09-22T08:36:48.410 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.406+0000 7f32d1f7f640 1 -- 172.21.15.142:0/1128250386 <== osd.0 v2:172.21.15.31:6800/168281188 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v30'27 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f32bc03b040 con 0x7f32c40a5040 2024-09-22T08:36:48.410 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.406+0000 7f32d4c96800 1 -- 172.21.15.142:0/1128250386 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55af77165140 con 0x7f32cc057c20 2024-09-22T08:36:48.410 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.407+0000 7f32d2780640 1 -- 172.21.15.142:0/1128250386 <== osd.2 v2:172.21.15.142:6808/279438927 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v30'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f32c40a2040 con 0x7f32cc057c20 2024-09-22T08:36:48.411 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.407+0000 7f32d4c96800 1 -- 172.21.15.142:0/1128250386 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55af77165750 con 0x55af7714bf30 2024-09-22T08:36:48.411 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.408+0000 7f32d2f81640 1 -- 172.21.15.142:0/1128250386 <== osd.3 v2:172.21.15.142:6800/1064901393 18 ==== osd_op_reply(71 gc.9 [create,call,call,call] v30'23 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f32cc0083e0 con 0x55af7714bf30 2024-09-22T08:36:48.411 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.408+0000 7f32d4c96800 1 -- 172.21.15.142:0/1128250386 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55af771654b0 con 0x7f32cc057c20 2024-09-22T08:36:48.411 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.409+0000 7f32d2780640 1 -- 172.21.15.142:0/1128250386 <== osd.2 v2:172.21.15.142:6808/279438927 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v30'42 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f32c40a2040 con 0x7f32cc057c20 2024-09-22T08:36:48.411 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.409+0000 7f32d4c96800 1 -- 172.21.15.142:0/1128250386 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55af771655e0 con 0x7f32c40a5040 2024-09-22T08:36:48.411 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.410+0000 7f32d1f7f640 1 -- 172.21.15.142:0/1128250386 <== osd.0 v2:172.21.15.31:6800/168281188 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v30'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f32bc03b040 con 0x7f32c40a5040 2024-09-22T08:36:48.411 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.410+0000 7f32d4c96800 1 -- 172.21.15.142:0/1128250386 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55af771655e0 con 0x7f32cc057c20 2024-09-22T08:36:48.412 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.411+0000 7f32d2780640 1 -- 172.21.15.142:0/1128250386 <== osd.2 v2:172.21.15.142:6808/279438927 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v30'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f32c40a2040 con 0x7f32cc057c20 2024-09-22T08:36:48.412 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.411+0000 7f32d4c96800 1 -- 172.21.15.142:0/1128250386 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55af77165710 con 0x7f32c40a5040 2024-09-22T08:36:48.413 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.412+0000 7f32d1f7f640 1 -- 172.21.15.142:0/1128250386 <== osd.0 v2:172.21.15.31:6800/168281188 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v30'35 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f32bc03b040 con 0x7f32c40a5040 2024-09-22T08:36:48.413 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.412+0000 7f32d4c96800 1 -- 172.21.15.142:0/1128250386 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55af77165710 con 0x55af77147540 2024-09-22T08:36:48.414 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.413+0000 7f32d1f7f640 1 -- 172.21.15.142:0/1128250386 <== osd.1 v2:172.21.15.142:6816/3192108003 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v30'141 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f32bc03b040 con 0x55af77147540 2024-09-22T08:36:48.414 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.413+0000 7f32d4c96800 1 -- 172.21.15.142:0/1128250386 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55af77165710 con 0x55af7714bf30 2024-09-22T08:36:48.415 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.414+0000 7f32d2f81640 1 -- 172.21.15.142:0/1128250386 <== osd.3 v2:172.21.15.142:6800/1064901393 19 ==== osd_op_reply(77 gc.15 [create,call,call,call] v30'35 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f32cc0083e0 con 0x55af7714bf30 2024-09-22T08:36:48.415 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.414+0000 7f32d4c96800 1 -- 172.21.15.142:0/1128250386 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55af771657a0 con 0x7f32cc057c20 2024-09-22T08:36:48.416 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.415+0000 7f32d2780640 1 -- 172.21.15.142:0/1128250386 <== osd.2 v2:172.21.15.142:6808/279438927 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v30'43 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f32c40a2040 con 0x7f32cc057c20 2024-09-22T08:36:48.416 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.415+0000 7f32d4c96800 1 -- 172.21.15.142:0/1128250386 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55af771657a0 con 0x55af7714bf30 2024-09-22T08:36:48.417 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.416+0000 7f32d2f81640 1 -- 172.21.15.142:0/1128250386 <== osd.3 v2:172.21.15.142:6800/1064901393 20 ==== osd_op_reply(79 gc.17 [create,call,call,call] v30'17 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f32cc0083e0 con 0x55af7714bf30 2024-09-22T08:36:48.417 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.416+0000 7f32d4c96800 1 -- 172.21.15.142:0/1128250386 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55af771657a0 con 0x55af77147540 2024-09-22T08:36:48.418 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.417+0000 7f32d1f7f640 1 -- 172.21.15.142:0/1128250386 <== osd.1 v2:172.21.15.142:6816/3192108003 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v30'25 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f32bc03b040 con 0x55af77147540 2024-09-22T08:36:48.418 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.417+0000 7f32d4c96800 1 -- 172.21.15.142:0/1128250386 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55af771657a0 con 0x55af77147540 2024-09-22T08:36:48.419 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.418+0000 7f32d1f7f640 1 -- 172.21.15.142:0/1128250386 <== osd.1 v2:172.21.15.142:6816/3192108003 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v30'142 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f32bc03b040 con 0x55af77147540 2024-09-22T08:36:48.419 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.418+0000 7f32d4c96800 1 -- 172.21.15.142:0/1128250386 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55af771657a0 con 0x55af7714bf30 2024-09-22T08:36:48.420 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.419+0000 7f32d2f81640 1 -- 172.21.15.142:0/1128250386 <== osd.3 v2:172.21.15.142:6800/1064901393 21 ==== osd_op_reply(82 gc.20 [create,call,call,call] v30'36 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f32cc0083e0 con 0x55af7714bf30 2024-09-22T08:36:48.420 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.419+0000 7f32d4c96800 1 -- 172.21.15.142:0/1128250386 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55af77165800 con 0x7f32cc057c20 2024-09-22T08:36:48.421 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.420+0000 7f32d2780640 1 -- 172.21.15.142:0/1128250386 <== osd.2 v2:172.21.15.142:6808/279438927 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v30'27 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f32c40a2040 con 0x7f32cc057c20 2024-09-22T08:36:48.421 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.420+0000 7f32d4c96800 1 -- 172.21.15.142:0/1128250386 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55af77165800 con 0x55af7714bf30 2024-09-22T08:36:48.422 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.421+0000 7f32d2f81640 1 -- 172.21.15.142:0/1128250386 <== osd.3 v2:172.21.15.142:6800/1064901393 22 ==== osd_op_reply(84 gc.22 [create,call,call,call] v30'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f32cc0083e0 con 0x55af7714bf30 2024-09-22T08:36:48.422 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.421+0000 7f32d4c96800 1 -- 172.21.15.142:0/1128250386 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55af771657c0 con 0x55af7714bf30 2024-09-22T08:36:48.423 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.422+0000 7f32d2f81640 1 -- 172.21.15.142:0/1128250386 <== osd.3 v2:172.21.15.142:6800/1064901393 23 ==== osd_op_reply(85 gc.23 [create,call,call,call] v30'23 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f32cc0083e0 con 0x55af7714bf30 2024-09-22T08:36:48.423 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.422+0000 7f32d4c96800 1 -- 172.21.15.142:0/1128250386 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55af771657c0 con 0x55af7714bf30 2024-09-22T08:36:48.424 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.423+0000 7f32d2f81640 1 -- 172.21.15.142:0/1128250386 <== osd.3 v2:172.21.15.142:6800/1064901393 24 ==== osd_op_reply(86 gc.24 [create,call,call,call] v30'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f32cc0083e0 con 0x55af7714bf30 2024-09-22T08:36:48.424 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.423+0000 7f32d4c96800 1 -- 172.21.15.142:0/1128250386 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55af771657c0 con 0x55af7714bf30 2024-09-22T08:36:48.424 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.423+0000 7f32d2f81640 1 -- 172.21.15.142:0/1128250386 <== osd.3 v2:172.21.15.142:6800/1064901393 25 ==== osd_op_reply(87 gc.25 [create,call,call,call] v30'28 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f32cc0083e0 con 0x55af7714bf30 2024-09-22T08:36:48.425 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.424+0000 7f32d4c96800 1 -- 172.21.15.142:0/1128250386 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55af77165860 con 0x7f32c40a5040 2024-09-22T08:36:48.426 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.425+0000 7f32d1f7f640 1 -- 172.21.15.142:0/1128250386 <== osd.0 v2:172.21.15.31:6800/168281188 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v30'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f32bc03b040 con 0x7f32c40a5040 2024-09-22T08:36:48.426 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.425+0000 7f32d4c96800 1 -- 172.21.15.142:0/1128250386 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55af77165860 con 0x55af7714bf30 2024-09-22T08:36:48.427 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.426+0000 7f32d2f81640 1 -- 172.21.15.142:0/1128250386 <== osd.3 v2:172.21.15.142:6800/1064901393 26 ==== osd_op_reply(89 gc.27 [create,call,call,call] v30'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f32cc0083e0 con 0x55af7714bf30 2024-09-22T08:36:48.427 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.426+0000 7f32d4c96800 1 -- 172.21.15.142:0/1128250386 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55af77165860 con 0x7f32c40a5040 2024-09-22T08:36:48.428 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.427+0000 7f32d1f7f640 1 -- 172.21.15.142:0/1128250386 <== osd.0 v2:172.21.15.31:6800/168281188 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v30'28 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f32bc03b040 con 0x7f32c40a5040 2024-09-22T08:36:48.428 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.427+0000 7f32d4c96800 1 -- 172.21.15.142:0/1128250386 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55af77165860 con 0x55af7714bf30 2024-09-22T08:36:48.429 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.428+0000 7f32d2f81640 1 -- 172.21.15.142:0/1128250386 <== osd.3 v2:172.21.15.142:6800/1064901393 27 ==== osd_op_reply(91 gc.29 [create,call,call,call] v30'37 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f32cc0083e0 con 0x55af7714bf30 2024-09-22T08:36:48.429 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.428+0000 7f32d4c96800 1 -- 172.21.15.142:0/1128250386 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55af77165860 con 0x7f32c40a5040 2024-09-22T08:36:48.430 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.429+0000 7f32d1f7f640 1 -- 172.21.15.142:0/1128250386 <== osd.0 v2:172.21.15.31:6800/168281188 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v30'36 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f32bc03b040 con 0x7f32c40a5040 2024-09-22T08:36:48.430 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.429+0000 7f32d4c96800 1 -- 172.21.15.142:0/1128250386 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55af77165880 con 0x7f32cc057c20 2024-09-22T08:36:48.431 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.430+0000 7f32d2780640 1 -- 172.21.15.142:0/1128250386 <== osd.2 v2:172.21.15.142:6808/279438927 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v30'23 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f32c40a2040 con 0x7f32cc057c20 2024-09-22T08:36:48.433 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.431+0000 7f31037fe640 20 reqs_thread_entry: start 2024-09-22T08:36:48.433 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.431+0000 7f32d4c96800 20 init_complete bucket index max shards: 11 2024-09-22T08:36:48.434 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.431+0000 7f32d4c96800 20 Filter name: none 2024-09-22T08:36:48.434 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.431+0000 7f31017fa640 20 reqs_thread_entry: start 2024-09-22T08:36:48.434 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.431+0000 7f32d4c96800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-22T08:36:48.434 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.431+0000 7f32d4c96800 20 rados->read ofs=0 len=0 2024-09-22T08:36:48.434 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.431+0000 7f32d4c96800 1 -- 172.21.15.142:0/1128250386 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:94 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55af77190820 con 0x7f32cc057c20 2024-09-22T08:36:48.434 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.431+0000 7f32d2780640 1 -- 172.21.15.142:0/1128250386 <== osd.2 v2:172.21.15.142:6808/279438927 18 ==== osd_op_reply(94 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv27 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f32c40a2040 con 0x7f32cc057c20 2024-09-22T08:36:48.434 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.431+0000 7f32d4c96800 20 rados_obj.operate() r=0 bl.length=165 2024-09-22T08:36:48.434 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.431+0000 7f32d4c96800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-22T08:36:48.434 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.431+0000 7f32d4c96800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-22T08:36:48.434 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.431+0000 7f32d4c96800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1 : miss 2024-09-22T08:36:48.434 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.431+0000 7f32d4c96800 20 rados->read ofs=0 len=0 2024-09-22T08:36:48.434 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.431+0000 7f32d4c96800 1 -- 172.21.15.142:0/1128250386 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:95 8.15 8:ab67ca09:root::.bucket.meta.myfoo%3ae239248c-0bee-4e41-803a-24b288d3eb8f.4226.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55af77192270 con 0x55af7714bf30 2024-09-22T08:36:48.434 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.432+0000 7f32d2f81640 1 -- 172.21.15.142:0/1128250386 <== osd.3 v2:172.21.15.142:6800/1064901393 28 ==== osd_op_reply(95 .bucket.meta.myfoo:e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv7 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7f32cc0083e0 con 0x55af7714bf30 2024-09-22T08:36:48.435 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.432+0000 7f32d4c96800 20 rados_obj.operate() r=0 bl.length=387 2024-09-22T08:36:48.435 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.432+0000 7f32d4c96800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1 info.flags=0x17 2024-09-22T08:36:48.435 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.432+0000 7f32d4c96800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1 to cache LRU end 2024-09-22T08:36:48.435 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.432+0000 7f32d4c96800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:36:48.435 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.432+0000 7f32d4c96800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-22T08:36:48.435 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.432+0000 7f32d4c96800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1 2024-09-22T08:36:48.435 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.432+0000 7f32d4c96800 20 get_obj_state: octx=0x7f32c4075d80 obj=myfoo:four state=0x55af77193008 s->prefetch_data=0 2024-09-22T08:36:48.435 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.432+0000 7f32d4c96800 1 -- 172.21.15.142:0/1128250386 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:96 3.3f 3:feb819ff:::e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1_four:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55af77195310 con 0x7f32cc057c20 2024-09-22T08:36:48.435 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.432+0000 7f32d2780640 1 -- 172.21.15.142:0/1128250386 <== osd.2 v2:172.21.15.142:6808/279438927 19 ==== osd_op_reply(96 e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1_four [call out=24b,getxattrs out=860b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 276+0+900 (crc 0 0 0) 0x7f32c40a2040 con 0x7f32cc057c20 2024-09-22T08:36:48.435 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.432+0000 7f32d4c96800 10 manifest: total_size = 4 2024-09-22T08:36:48.435 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.432+0000 7f32d4c96800 20 get_obj_state: setting s->obj_tag to e239248c-0bee-4e41-803a-24b288d3eb8f.4226.14095488682254326020 2024-09-22T08:36:48.435 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.432+0000 7f32d4c96800 20 get_obj_state: octx=0x7f32c4075d80 obj=myfoo:four state=0x55af77193008 s->prefetch_data=0 2024-09-22T08:36:48.435 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.432+0000 7f32d4c96800 20 prepare_atomic_modification: state is not atomic. state=0x55af77193008 2024-09-22T08:36:48.435 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.432+0000 7f32d4c96800 20 bucket index object: :.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1.6 2024-09-22T08:36:48.436 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.432+0000 7f32d4c96800 1 -- 172.21.15.142:0/1128250386 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:97 4.3b 4:dc8435be:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=182b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55af77199040 con 0x55af7714bf30 2024-09-22T08:36:48.436 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.433+0000 7f32d2f81640 1 -- 172.21.15.142:0/1128250386 <== osd.3 v2:172.21.15.142:6800/1064901393 29 ==== osd_op_reply(97 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1.6 [stat,call,call] v30'6 uv6 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f32cc0083e0 con 0x55af7714bf30 2024-09-22T08:36:48.437 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.433+0000 7f32d4c96800 1 -- 172.21.15.142:0/1128250386 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:98 3.3f 3:feb819ff:::e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1_four:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55af77199040 con 0x7f32cc057c20 2024-09-22T08:36:48.437 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.434+0000 7f32d2780640 1 -- 172.21.15.142:0/1128250386 <== osd.2 v2:172.21.15.142:6808/279438927 20 ==== osd_op_reply(98 e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1_four [call] v30'2 uv2 ondisk = 0) ==== 192+0+0 (crc 0 0 0) 0x7f32c40a2040 con 0x7f32cc057c20 2024-09-22T08:36:48.437 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.434+0000 7f32d4c96800 1 -- 172.21.15.142:0/1128250386 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:99 4.3b 4:dc8435be:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=259b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55af77199ad0 con 0x55af7714bf30 2024-09-22T08:36:48.437 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.435+0000 7f3188fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:36:48.437 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.435+0000 7f32d4c96800 1 -- 172.21.15.142:0/1128250386 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94212105547264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55af77199ad0 con 0x55af77147540 2024-09-22T08:36:48.437 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.435+0000 7f32d2f81640 1 -- 172.21.15.142:0/1128250386 <== osd.3 v2:172.21.15.142:6800/1064901393 30 ==== osd_op_reply(99 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1.6 [stat,call,call] v30'7 uv7 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f32cc0083e0 con 0x55af7714bf30 2024-09-22T08:36:48.437 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.435+0000 7f31b5ffb640 20 handle_completion(): completion ok for obj=four 2024-09-22T08:36:48.437 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.436+0000 7f32d1f7f640 1 -- 172.21.15.142:0/1128250386 <== osd.1 v2:172.21.15.142:6816/3192108003 27 ==== osd_op_reply(100 data_loggenerations_metadata [watch unwatch cookie 94212105547264] v30'143 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f32bc03b040 con 0x55af77147540 2024-09-22T08:36:48.438 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.436+0000 7f32d4c96800 1 -- 172.21.15.142:0/1128250386 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:101 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94212105509392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55af77199ad0 con 0x7f32cc057c20 2024-09-22T08:36:48.438 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.437+0000 7f32d2780640 1 -- 172.21.15.142:0/1128250386 <== osd.2 v2:172.21.15.142:6808/279438927 21 ==== osd_op_reply(101 notify.0 [watch unwatch cookie 94212105509392] v30'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32c40a2040 con 0x7f32cc057c20 2024-09-22T08:36:48.438 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.437+0000 7f32d4c96800 20 remove_watcher() i=0 2024-09-22T08:36:48.439 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.437+0000 7f32d4c96800 2 removed watcher, disabling cache 2024-09-22T08:36:48.439 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.437+0000 7f32d4c96800 1 -- 172.21.15.142:0/1128250386 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:102 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94212105511648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55af77151a10 con 0x55af77147540 2024-09-22T08:36:48.439 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.438+0000 7f32d1f7f640 1 -- 172.21.15.142:0/1128250386 <== osd.1 v2:172.21.15.142:6816/3192108003 28 ==== osd_op_reply(102 notify.1 [watch unwatch cookie 94212105511648] v30'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32bc03b040 con 0x55af77147540 2024-09-22T08:36:48.440 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.438+0000 7f32d4c96800 20 remove_watcher() i=1 2024-09-22T08:36:48.440 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.438+0000 7f32d4c96800 1 -- 172.21.15.142:0/1128250386 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:103 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94212105519808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55af77151a10 con 0x55af7714bf30 2024-09-22T08:36:48.441 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.439+0000 7f32d2f81640 1 -- 172.21.15.142:0/1128250386 <== osd.3 v2:172.21.15.142:6800/1064901393 31 ==== osd_op_reply(103 notify.2 [watch unwatch cookie 94212105519808] v30'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32cc0083e0 con 0x55af7714bf30 2024-09-22T08:36:48.441 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.440+0000 7f32d4c96800 20 remove_watcher() i=2 2024-09-22T08:36:48.441 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.440+0000 7f32d4c96800 1 -- 172.21.15.142:0/1128250386 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:104 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94212105522144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55af77151a10 con 0x7f32cc057c20 2024-09-22T08:36:48.442 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.440+0000 7f32d2780640 1 -- 172.21.15.142:0/1128250386 <== osd.2 v2:172.21.15.142:6808/279438927 22 ==== osd_op_reply(104 notify.3 [watch unwatch cookie 94212105522144] v30'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32c40a2040 con 0x7f32cc057c20 2024-09-22T08:36:48.442 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.440+0000 7f32d4c96800 20 remove_watcher() i=3 2024-09-22T08:36:48.442 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.440+0000 7f32d4c96800 1 -- 172.21.15.142:0/1128250386 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:105 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94212105526208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55af77151a10 con 0x55af77147540 2024-09-22T08:36:48.443 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.442+0000 7f32d1f7f640 1 -- 172.21.15.142:0/1128250386 <== osd.1 v2:172.21.15.142:6816/3192108003 29 ==== osd_op_reply(105 notify.4 [watch unwatch cookie 94212105526208] v30'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32bc03b040 con 0x55af77147540 2024-09-22T08:36:48.443 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.442+0000 7f32d4c96800 20 remove_watcher() i=4 2024-09-22T08:36:48.443 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.442+0000 7f32d4c96800 1 -- 172.21.15.142:0/1128250386 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:106 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94212105530224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55af77155bc0 con 0x7f32c40a5040 2024-09-22T08:36:48.444 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.443+0000 7f32d1f7f640 1 -- 172.21.15.142:0/1128250386 <== osd.0 v2:172.21.15.31:6800/168281188 24 ==== osd_op_reply(106 notify.5 [watch unwatch cookie 94212105530224] v30'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32bc03b040 con 0x7f32c40a5040 2024-09-22T08:36:48.444 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.443+0000 7f32d4c96800 20 remove_watcher() i=5 2024-09-22T08:36:48.444 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.443+0000 7f32d4c96800 1 -- 172.21.15.142:0/1128250386 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:107 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94212105528480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55af77151a10 con 0x7f32c40a5040 2024-09-22T08:36:48.445 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.444+0000 7f32d1f7f640 1 -- 172.21.15.142:0/1128250386 <== osd.0 v2:172.21.15.31:6800/168281188 25 ==== osd_op_reply(107 notify.6 [watch unwatch cookie 94212105528480] v30'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32bc03b040 con 0x7f32c40a5040 2024-09-22T08:36:48.445 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.444+0000 7f32d4c96800 20 remove_watcher() i=6 2024-09-22T08:36:48.445 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.444+0000 7f32d4c96800 1 -- 172.21.15.142:0/1128250386 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:108 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94212105531936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55af77156b70 con 0x7f32c40a5040 2024-09-22T08:36:48.448 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.445+0000 7f32d1f7f640 1 -- 172.21.15.142:0/1128250386 <== osd.0 v2:172.21.15.31:6800/168281188 26 ==== osd_op_reply(108 notify.7 [watch unwatch cookie 94212105531936] v30'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32bc03b040 con 0x7f32c40a5040 2024-09-22T08:36:48.448 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.445+0000 7f32d4c96800 20 remove_watcher() i=7 2024-09-22T08:36:48.448 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.445+0000 7f32d4c96800 1 -- 172.21.15.142:0/1128250386 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f32c40a5040 msgr2=0x7f32c4056910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:48.448 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.445+0000 7f32d4c96800 1 --2- 172.21.15.142:0/1128250386 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f32c40a5040 0x7f32c4056910 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:48.448 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.445+0000 7f32d4c96800 1 -- 172.21.15.142:0/1128250386 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55af77147540 msgr2=0x55af77149a00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:48.448 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.445+0000 7f32d4c96800 1 --2- 172.21.15.142:0/1128250386 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55af77147540 0x55af77149a00 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:48.448 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.445+0000 7f32d4c96800 1 -- 172.21.15.142:0/1128250386 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f32cc057c20 msgr2=0x7f32cc021aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:48.448 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.445+0000 7f32d4c96800 1 --2- 172.21.15.142:0/1128250386 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f32cc057c20 0x7f32cc021aa0 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:48.448 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.445+0000 7f32d4c96800 1 -- 172.21.15.142:0/1128250386 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55af7714bf30 msgr2=0x55af7714e320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:48.448 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.445+0000 7f32d4c96800 1 --2- 172.21.15.142:0/1128250386 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55af7714bf30 0x55af7714e320 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:48.448 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.445+0000 7f32d4c96800 1 -- 172.21.15.142:0/1128250386 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f319c03cfb0 msgr2=0x7f319c03f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:48.449 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.445+0000 7f32d4c96800 1 --2- 172.21.15.142:0/1128250386 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f319c03cfb0 0x7f319c03f470 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f32c40973e0 tx=0x7f32c4088000 comp rx=0 tx=0).stop 2024-09-22T08:36:48.449 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.445+0000 7f32d4c96800 1 -- 172.21.15.142:0/1128250386 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55af77134630 msgr2=0x55af7713bc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:48.449 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.445+0000 7f32d1f7f640 1 -- 172.21.15.142:0/1128250386 reap_dead start 2024-09-22T08:36:48.449 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.445+0000 7f32d4c96800 1 --2- 172.21.15.142:0/1128250386 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55af77134630 0x55af7713bc70 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f32cc008fd0 tx=0x7f32cc053d50 comp rx=0 tx=0).stop 2024-09-22T08:36:48.449 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.445+0000 7f32d4c96800 1 -- 172.21.15.142:0/1128250386 shutdown_connections 2024-09-22T08:36:48.449 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.445+0000 7f32d4c96800 1 --2- 172.21.15.142:0/1128250386 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55af77134630 0x55af7713bc70 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:48.449 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.445+0000 7f32d4c96800 1 -- 172.21.15.142:0/1128250386 >> 172.21.15.142:0/1128250386 conn(0x55af77130a50 msgr2=0x55af7712ec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:48.449 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.445+0000 7f32d4c96800 1 -- 172.21.15.142:0/1128250386 shutdown_connections 2024-09-22T08:36:48.449 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.445+0000 7f32d4c96800 1 -- 172.21.15.142:0/1128250386 wait complete. 2024-09-22T08:36:48.449 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.445+0000 7f32d4c96800 1 -- 172.21.15.142:0/339998147 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f31ac03cfb0 msgr2=0x7f31ac03f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:48.449 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.445+0000 7f32d4c96800 1 --2- 172.21.15.142:0/339998147 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f31ac03cfb0 0x7f31ac03f470 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f32c4097180 tx=0x7f32c4061db0 comp rx=0 tx=0).stop 2024-09-22T08:36:48.449 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.445+0000 7f32d4c96800 1 -- 172.21.15.142:0/339998147 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55af77127c10 msgr2=0x55af77128030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:48.450 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.445+0000 7f32d4c96800 1 --2- 172.21.15.142:0/339998147 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55af77127c10 0x55af77128030 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x55af770133e0 tx=0x7f32cc00bf30 comp rx=0 tx=0).stop 2024-09-22T08:36:48.450 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.445+0000 7f32d4c96800 1 -- 172.21.15.142:0/339998147 shutdown_connections 2024-09-22T08:36:48.450 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.445+0000 7f32d4c96800 1 --2- 172.21.15.142:0/339998147 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f31ac03cfb0 0x7f31ac03f470 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:48.450 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.445+0000 7f32d4c96800 1 --2- 172.21.15.142:0/339998147 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55af77127c10 0x55af77128030 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:48.450 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.445+0000 7f32d4c96800 1 -- 172.21.15.142:0/339998147 >> 172.21.15.142:0/339998147 conn(0x55af7711bfc0 msgr2=0x55af7711c3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:48.450 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.445+0000 7f32d4c96800 1 -- 172.21.15.142:0/339998147 shutdown_connections 2024-09-22T08:36:48.450 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.445+0000 7f32d4c96800 1 -- 172.21.15.142:0/339998147 wait complete. 2024-09-22T08:36:48.450 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.446+0000 7f32d4c96800 1 -- 172.21.15.142:0/4217570571 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55af77016800 msgr2=0x55af77113f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:48.450 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.446+0000 7f32d4c96800 1 --2- 172.21.15.142:0/4217570571 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55af77016800 0x55af77113f60 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:48.450 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.446+0000 7f32d4c96800 1 -- 172.21.15.142:0/4217570571 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55af77116790 msgr2=0x55af77118b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:48.450 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.446+0000 7f32d4c96800 1 --2- 172.21.15.142:0/4217570571 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55af77116790 0x55af77118b80 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:48.450 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.446+0000 7f32d4c96800 1 -- 172.21.15.142:0/4217570571 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f31b803cfb0 msgr2=0x7f31b803f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:48.450 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.446+0000 7f32d4c96800 1 --2- 172.21.15.142:0/4217570571 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f31b803cfb0 0x7f31b803f470 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f32bc001e30 tx=0x7f32bc001390 comp rx=0 tx=0).stop 2024-09-22T08:36:48.450 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.446+0000 7f32d4c96800 1 -- 172.21.15.142:0/4217570571 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55af76f87550 msgr2=0x55af77013840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:48.451 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.446+0000 7f32d4c96800 1 --2- 172.21.15.142:0/4217570571 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55af76f87550 0x55af77013840 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f32c4063040 tx=0x7f32c4003330 comp rx=0 tx=0).stop 2024-09-22T08:36:48.451 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.446+0000 7f32d4c96800 1 -- 172.21.15.142:0/4217570571 shutdown_connections 2024-09-22T08:36:48.451 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.446+0000 7f32d4c96800 1 --2- 172.21.15.142:0/4217570571 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55af77116790 0x55af77118b80 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:48.451 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.446+0000 7f32d4c96800 1 --2- 172.21.15.142:0/4217570571 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55af77016800 0x55af77113f60 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:48.451 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.446+0000 7f32d4c96800 1 --2- 172.21.15.142:0/4217570571 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f31b803cfb0 0x7f31b803f470 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:48.451 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.446+0000 7f32d4c96800 1 --2- 172.21.15.142:0/4217570571 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55af76f87550 0x55af77013840 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:48.451 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.446+0000 7f32d4c96800 1 -- 172.21.15.142:0/4217570571 >> 172.21.15.142:0/4217570571 conn(0x55af7700dbe0 msgr2=0x55af771043e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:48.451 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.446+0000 7f32d4c96800 1 -- 172.21.15.142:0/4217570571 shutdown_connections 2024-09-22T08:36:48.451 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.446+0000 7f32d4c96800 1 -- 172.21.15.142:0/4217570571 wait complete. 2024-09-22T08:36:48.456 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--bucket', 'myfoo'] 2024-09-22T08:36:48.456 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--bucket', 'myfoo'] 2024-09-22T08:36:48.456 DEBUG:teuthology.orchestra.run.smithi142:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --bucket myfoo 2024-09-22T08:36:48.500 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:36:48.500 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:36:48.501 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.500+0000 7f5e2b125800 1 Processor -- start 2024-09-22T08:36:48.501 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.500+0000 7f5e2b125800 1 -- start start 2024-09-22T08:36:48.501 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.500+0000 7f5e2b125800 1 --2- >> v2:172.21.15.31:3300/0 conn(0x5637660f1be0 0x5637660f40a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:48.501 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.500+0000 7f5e2b125800 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x563765f76a20 con 0x56376605ecf0 2024-09-22T08:36:48.501 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.500+0000 7f5e2b125800 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x563765f767d0 con 0x5637660f1be0 2024-09-22T08:36:48.502 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.501+0000 7f5e1e5ad640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x5637660f1be0 0x5637660f40a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:48.502 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.501+0000 7f5e26dae640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x56376605ecf0 0x5637660f04c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.142:44782/0 (socket says 172.21.15.142:44782) 2024-09-22T08:36:48.503 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.501+0000 7f5e26dae640 1 -- 172.21.15.142:0/225550258 learned_addr learned my addr 172.21.15.142:0/225550258 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-09-22T08:36:48.503 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.501+0000 7f5e1e5ad640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x5637660f1be0 0x5637660f40a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:48808/0 (socket says 172.21.15.142:48808) 2024-09-22T08:36:48.503 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.501+0000 7f5e1e5ad640 1 -- 172.21.15.142:0/225550258 >> v1:172.21.15.31:6789/0 conn(0x56376605ecf0 legacy=0x5637660f04c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:48.503 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.501+0000 7f5e1e5ad640 1 -- 172.21.15.142:0/225550258 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5637660f5780 con 0x5637660f1be0 2024-09-22T08:36:48.504 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.503+0000 7f5e1e5ad640 1 --2- 172.21.15.142:0/225550258 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5637660f1be0 0x5637660f40a0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f5e1000a470 tx=0x7f5e10045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5112b6d20321b6d server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:48.504 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.503+0000 7f5e265ad640 1 -- 172.21.15.142:0/225550258 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e10053570 con 0x5637660f1be0 2024-09-22T08:36:48.504 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.503+0000 7f5e265ad640 1 -- 172.21.15.142:0/225550258 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e10058070 con 0x5637660f1be0 2024-09-22T08:36:48.504 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.503+0000 7f5e265ad640 1 -- 172.21.15.142:0/225550258 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e10053880 con 0x5637660f1be0 2024-09-22T08:36:48.505 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.503+0000 7f5e2b125800 1 -- 172.21.15.142:0/225550258 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5637660f1be0 msgr2=0x5637660f40a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:48.505 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.503+0000 7f5e2b125800 1 --2- 172.21.15.142:0/225550258 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5637660f1be0 0x5637660f40a0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f5e1000a470 tx=0x7f5e10045a20 comp rx=0 tx=0).stop 2024-09-22T08:36:48.505 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.503+0000 7f5e2b125800 1 -- 172.21.15.142:0/225550258 shutdown_connections 2024-09-22T08:36:48.505 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.503+0000 7f5e2b125800 1 --2- 172.21.15.142:0/225550258 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5637660f1be0 0x5637660f40a0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:48.505 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.503+0000 7f5e2b125800 1 -- 172.21.15.142:0/225550258 >> 172.21.15.142:0/225550258 conn(0x5637660e5bb0 msgr2=0x5637660e8010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:48.505 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.503+0000 7f5e2b125800 1 -- 172.21.15.142:0/225550258 shutdown_connections 2024-09-22T08:36:48.505 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.503+0000 7f5e2b125800 1 -- 172.21.15.142:0/225550258 wait complete. 2024-09-22T08:36:48.519 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.517+0000 7f5e2b125800 1 Processor -- start 2024-09-22T08:36:48.519 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.517+0000 7f5e2b125800 1 -- start start 2024-09-22T08:36:48.519 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.517+0000 7f5e2b125800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56376605ecf0 0x5637661dd220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:48.519 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.517+0000 7f5e2b125800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x563765f83dd0 con 0x56376605ecf0 2024-09-22T08:36:48.519 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.518+0000 7f5e26dae640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56376605ecf0 0x5637661dd220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:48.519 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.518+0000 7f5e26dae640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56376605ecf0 0x5637661dd220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:48816/0 (socket says 172.21.15.142:48816) 2024-09-22T08:36:48.519 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.518+0000 7f5e26dae640 1 -- 172.21.15.142:0/3841393766 learned_addr learned my addr 172.21.15.142:0/3841393766 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:48.520 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.518+0000 7f5e26dae640 1 -- 172.21.15.142:0/3841393766 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5637661dd810 con 0x56376605ecf0 2024-09-22T08:36:48.520 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.518+0000 7f5e26dae640 1 --2- 172.21.15.142:0/3841393766 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56376605ecf0 0x5637661dd220 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f5e18001e40 tx=0x7f5e18001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f064e3239d689b7b server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:48.522 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.518+0000 7f5d14e09640 1 -- 172.21.15.142:0/3841393766 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e18012020 con 0x56376605ecf0 2024-09-22T08:36:48.522 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.518+0000 7f5d14e09640 1 -- 172.21.15.142:0/3841393766 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e1800e5a0 con 0x56376605ecf0 2024-09-22T08:36:48.522 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.518+0000 7f5d14e09640 1 -- 172.21.15.142:0/3841393766 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e1800e8a0 con 0x56376605ecf0 2024-09-22T08:36:48.522 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.519+0000 7f5e2b125800 1 -- 172.21.15.142:0/3841393766 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56376605ecf0 msgr2=0x5637661dd220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:48.522 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.519+0000 7f5e2b125800 1 --2- 172.21.15.142:0/3841393766 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56376605ecf0 0x5637661dd220 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f5e18001e40 tx=0x7f5e18001e70 comp rx=0 tx=0).stop 2024-09-22T08:36:48.522 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.519+0000 7f5e2b125800 1 -- 172.21.15.142:0/3841393766 shutdown_connections 2024-09-22T08:36:48.522 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.519+0000 7f5e2b125800 1 --2- 172.21.15.142:0/3841393766 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56376605ecf0 0x5637661dd220 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:48.522 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.519+0000 7f5e2b125800 1 -- 172.21.15.142:0/3841393766 >> 172.21.15.142:0/3841393766 conn(0x5637660e5bb0 msgr2=0x5637661d8ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:48.522 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.519+0000 7f5e2b125800 1 -- 172.21.15.142:0/3841393766 shutdown_connections 2024-09-22T08:36:48.523 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.519+0000 7f5e2b125800 1 -- 172.21.15.142:0/3841393766 wait complete. 2024-09-22T08:36:48.523 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.519+0000 7f5e2b125800 1 Processor -- start 2024-09-22T08:36:48.523 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.519+0000 7f5e2b125800 1 -- start start 2024-09-22T08:36:48.523 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.519+0000 7f5e2b125800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56376605ecf0 0x5637661e4d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:48.523 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.519+0000 7f5e2b125800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5637660f4a20 con 0x56376605ecf0 2024-09-22T08:36:48.523 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.520+0000 7f5e26dae640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56376605ecf0 0x5637661e4d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:48.523 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.520+0000 7f5e26dae640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56376605ecf0 0x5637661e4d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:48818/0 (socket says 172.21.15.142:48818) 2024-09-22T08:36:48.523 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.520+0000 7f5e26dae640 1 -- 172.21.15.142:0/1937765211 learned_addr learned my addr 172.21.15.142:0/1937765211 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:48.523 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.520+0000 7f5e26dae640 1 -- 172.21.15.142:0/1937765211 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5637661e5290 con 0x56376605ecf0 2024-09-22T08:36:48.523 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.520+0000 7f5e26dae640 1 --2- 172.21.15.142:0/1937765211 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56376605ecf0 0x5637661e4d30 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f5e180012b0 tx=0x7f5e18000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:48.523 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.520+0000 7f5d13606640 1 -- 172.21.15.142:0/1937765211 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e18012030 con 0x56376605ecf0 2024-09-22T08:36:48.524 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.520+0000 7f5d13606640 1 -- 172.21.15.142:0/1937765211 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e1801a750 con 0x56376605ecf0 2024-09-22T08:36:48.524 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.520+0000 7f5e2b125800 1 -- 172.21.15.142:0/1937765211 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5637661e5520 con 0x56376605ecf0 2024-09-22T08:36:48.524 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.520+0000 7f5d13606640 1 -- 172.21.15.142:0/1937765211 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e1801aa70 con 0x56376605ecf0 2024-09-22T08:36:48.524 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.520+0000 7f5e2b125800 1 -- 172.21.15.142:0/1937765211 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5637661e5f20 con 0x56376605ecf0 2024-09-22T08:36:48.528 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.521+0000 7f5d13606640 1 -- 172.21.15.142:0/1937765211 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f5e18015020 con 0x56376605ecf0 2024-09-22T08:36:48.529 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.521+0000 7f5d13606640 1 --2- 172.21.15.142:0/1937765211 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f5d0c03cfb0 0x7f5d0c03f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:48.529 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.521+0000 7f5d13606640 1 -- 172.21.15.142:0/1937765211 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f5e18020030 con 0x56376605ecf0 2024-09-22T08:36:48.529 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.521+0000 7f5e1e5ad640 1 --2- 172.21.15.142:0/1937765211 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f5d0c03cfb0 0x7f5d0c03f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:48.529 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.521+0000 7f5e2b125800 1 --2- 172.21.15.142:0/1937765211 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5637660f1be0 0x5637661ec380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:48.529 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.521+0000 7f5e2b125800 1 -- 172.21.15.142:0/1937765211 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5637661ec8c0 con 0x5637660f1be0 2024-09-22T08:36:48.529 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.522+0000 7f5e275af640 1 --2- 172.21.15.142:0/1937765211 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5637660f1be0 0x5637661ec380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:48.529 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.522+0000 7f5e1e5ad640 1 --2- 172.21.15.142:0/1937765211 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f5d0c03cfb0 0x7f5d0c03f470 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f5e10057000 tx=0x7f5e10052000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:48.529 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.522+0000 7f5e275af640 1 --2- 172.21.15.142:0/1937765211 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5637660f1be0 0x5637661ec380 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:48.529 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.522+0000 7f5e275af640 1 -- 172.21.15.142:0/1937765211 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5e2000a4d0 con 0x5637660f1be0 2024-09-22T08:36:48.529 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.522+0000 7f5e2b125800 1 -- 172.21.15.142:0/1937765211 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5637661ecc60 con 0x5637660f1be0 2024-09-22T08:36:48.529 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.522+0000 7f5e275af640 1 -- 172.21.15.142:0/1937765211 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5e2000a4d0 con 0x5637660f1be0 2024-09-22T08:36:48.530 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.522+0000 7f5e2b125800 1 --2- 172.21.15.142:0/1937765211 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5637661ee720 0x5637661f0ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:48.530 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.522+0000 7f5e2b125800 1 -- 172.21.15.142:0/1937765211 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:3 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5637661f1330 con 0x5637661ee720 2024-09-22T08:36:48.530 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.523+0000 7f5e26dae640 1 --2- 172.21.15.142:0/1937765211 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5637661ee720 0x5637661f0ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:48.530 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.523+0000 7f5e26dae640 1 --2- 172.21.15.142:0/1937765211 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5637661ee720 0x5637661f0ba0 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:48.530 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.523+0000 7f5e26dae640 1 -- 172.21.15.142:0/1937765211 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(3 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f5e18051040 con 0x5637661ee720 2024-09-22T08:36:48.530 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.523+0000 7f5e2b125800 1 -- 172.21.15.142:0/1937765211 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5637661ed4b0 con 0x5637660f1be0 2024-09-22T08:36:48.530 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.523+0000 7f5e275af640 1 -- 172.21.15.142:0/1937765211 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5e2000a4d0 con 0x5637660f1be0 2024-09-22T08:36:48.530 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.523+0000 7f5e2b125800 1 -- 172.21.15.142:0/1937765211 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5637661ed850 con 0x5637661ee720 2024-09-22T08:36:48.530 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.524+0000 7f5e26dae640 1 -- 172.21.15.142:0/1937765211 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(5 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f5e18051040 con 0x5637661ee720 2024-09-22T08:36:48.530 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.524+0000 7f5e2b125800 1 Processor -- start 2024-09-22T08:36:48.530 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.524+0000 7f5e2b125800 1 -- start start 2024-09-22T08:36:48.530 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.524+0000 7f5e2b125800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5637661ffca0 0x5637662000c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:48.530 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.524+0000 7f5e2b125800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x563765fe2d50 con 0x5637661ffca0 2024-09-22T08:36:48.531 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.524+0000 7f5e275af640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5637661ffca0 0x5637662000c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:48.531 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.524+0000 7f5e275af640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5637661ffca0 0x5637662000c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:48828/0 (socket says 172.21.15.142:48828) 2024-09-22T08:36:48.531 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.524+0000 7f5e275af640 1 -- 172.21.15.142:0/182044124 learned_addr learned my addr 172.21.15.142:0/182044124 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:48.531 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.525+0000 7f5e275af640 1 -- 172.21.15.142:0/182044124 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563766200700 con 0x5637661ffca0 2024-09-22T08:36:48.531 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.525+0000 7f5e275af640 1 --2- 172.21.15.142:0/182044124 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5637661ffca0 0x5637662000c0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x5637661e5d30 tx=0x7f5e200167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:48.531 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.525+0000 7f5d10e01640 1 -- 172.21.15.142:0/182044124 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e20013640 con 0x5637661ffca0 2024-09-22T08:36:48.531 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.525+0000 7f5d10e01640 1 -- 172.21.15.142:0/182044124 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e200137e0 con 0x5637661ffca0 2024-09-22T08:36:48.531 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.525+0000 7f5d10e01640 1 -- 172.21.15.142:0/182044124 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e20013ae0 con 0x5637661ffca0 2024-09-22T08:36:48.531 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.525+0000 7f5e2b125800 1 -- 172.21.15.142:0/182044124 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563766200f30 con 0x5637661ffca0 2024-09-22T08:36:48.531 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.525+0000 7f5e2b125800 1 -- 172.21.15.142:0/182044124 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5637662014d0 con 0x5637661ffca0 2024-09-22T08:36:48.531 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.526+0000 7f5d10e01640 1 -- 172.21.15.142:0/182044124 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f5e20011040 con 0x5637661ffca0 2024-09-22T08:36:48.531 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.526+0000 7f5d10e01640 1 --2- 172.21.15.142:0/182044124 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f5d0003cfb0 0x7f5d0003f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:48.531 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.526+0000 7f5d10e01640 1 -- 172.21.15.142:0/182044124 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f5e2000e040 con 0x5637661ffca0 2024-09-22T08:36:48.532 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.526+0000 7f5e26dae640 1 --2- 172.21.15.142:0/182044124 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f5d0003cfb0 0x7f5d0003f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:48.532 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.526+0000 7f5e2b125800 1 Processor -- start 2024-09-22T08:36:48.532 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.527+0000 7f5e2b125800 1 -- start start 2024-09-22T08:36:48.532 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.527+0000 7f5e26dae640 1 --2- 172.21.15.142:0/182044124 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f5d0003cfb0 0x7f5d0003f470 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f5e18016910 tx=0x7f5e18052ac0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:48.532 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.527+0000 7f5e2b125800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56376620c7c0 0x56376620cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:48.532 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.527+0000 7f5e2b125800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5637661ddc40 con 0x56376620c7c0 2024-09-22T08:36:48.532 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.527+0000 7f5e275af640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56376620c7c0 0x56376620cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:48.532 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.527+0000 7f5e275af640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56376620c7c0 0x56376620cbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:48842/0 (socket says 172.21.15.142:48842) 2024-09-22T08:36:48.532 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.527+0000 7f5e275af640 1 -- 172.21.15.142:0/3130004534 learned_addr learned my addr 172.21.15.142:0/3130004534 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:48.532 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.527+0000 7f5e275af640 1 -- 172.21.15.142:0/3130004534 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56376620d1b0 con 0x56376620c7c0 2024-09-22T08:36:48.532 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.527+0000 7f5e275af640 1 --2- 172.21.15.142:0/3130004534 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56376620c7c0 0x56376620cbc0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f5e20054860 tx=0x7f5e2001fdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80023d83a622615c server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:48.533 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.527+0000 7f5d0a7fc640 1 -- 172.21.15.142:0/3130004534 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e20051020 con 0x56376620c7c0 2024-09-22T08:36:48.533 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.527+0000 7f5d0a7fc640 1 -- 172.21.15.142:0/3130004534 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e20021cf0 con 0x56376620c7c0 2024-09-22T08:36:48.533 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.527+0000 7f5d0a7fc640 1 -- 172.21.15.142:0/3130004534 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e2004de60 con 0x56376620c7c0 2024-09-22T08:36:48.545 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.528+0000 7f5e2b125800 1 -- 172.21.15.142:0/3130004534 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56376620c7c0 msgr2=0x56376620cbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:48.545 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.528+0000 7f5e2b125800 1 --2- 172.21.15.142:0/3130004534 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56376620c7c0 0x56376620cbc0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f5e20054860 tx=0x7f5e2001fdb0 comp rx=0 tx=0).stop 2024-09-22T08:36:48.545 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.528+0000 7f5e2b125800 1 -- 172.21.15.142:0/3130004534 shutdown_connections 2024-09-22T08:36:48.545 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.528+0000 7f5e2b125800 1 --2- 172.21.15.142:0/3130004534 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56376620c7c0 0x56376620cbc0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:48.545 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.528+0000 7f5e2b125800 1 -- 172.21.15.142:0/3130004534 >> 172.21.15.142:0/3130004534 conn(0x563766208bc0 msgr2=0x563766206e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:48.545 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.528+0000 7f5e2b125800 1 -- 172.21.15.142:0/3130004534 shutdown_connections 2024-09-22T08:36:48.545 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.528+0000 7f5e2b125800 1 -- 172.21.15.142:0/3130004534 wait complete. 2024-09-22T08:36:48.545 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.528+0000 7f5e2b125800 1 Processor -- start 2024-09-22T08:36:48.545 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.528+0000 7f5e2b125800 1 -- start start 2024-09-22T08:36:48.546 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.528+0000 7f5e2b125800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56376620c7c0 0x563766213d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:48.546 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.528+0000 7f5e2b125800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x56376620d7d0 con 0x56376620c7c0 2024-09-22T08:36:48.546 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.529+0000 7f5e275af640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56376620c7c0 0x563766213d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:48.546 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.529+0000 7f5e275af640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56376620c7c0 0x563766213d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:48846/0 (socket says 172.21.15.142:48846) 2024-09-22T08:36:48.546 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.529+0000 7f5e275af640 1 -- 172.21.15.142:0/3927600742 learned_addr learned my addr 172.21.15.142:0/3927600742 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:48.546 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.529+0000 7f5e275af640 1 -- 172.21.15.142:0/3927600742 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5637662142e0 con 0x56376620c7c0 2024-09-22T08:36:48.546 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.529+0000 7f5e275af640 1 --2- 172.21.15.142:0/3927600742 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56376620c7c0 0x563766213d80 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f5e20013df0 tx=0x7f5e200547c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:48.546 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.529+0000 7f5d08ff9640 1 -- 172.21.15.142:0/3927600742 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e2001f470 con 0x56376620c7c0 2024-09-22T08:36:48.546 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.529+0000 7f5d08ff9640 1 -- 172.21.15.142:0/3927600742 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e200532c0 con 0x56376620c7c0 2024-09-22T08:36:48.546 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.529+0000 7f5e2b125800 1 -- 172.21.15.142:0/3927600742 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563766214570 con 0x56376620c7c0 2024-09-22T08:36:48.546 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.529+0000 7f5d08ff9640 1 -- 172.21.15.142:0/3927600742 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e20021440 con 0x56376620c7c0 2024-09-22T08:36:48.546 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.529+0000 7f5e2b125800 1 -- 172.21.15.142:0/3927600742 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563766214ef0 con 0x56376620c7c0 2024-09-22T08:36:48.546 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.530+0000 7f5d08ff9640 1 -- 172.21.15.142:0/3927600742 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f5e200451d0 con 0x56376620c7c0 2024-09-22T08:36:48.547 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.530+0000 7f5d08ff9640 1 --2- 172.21.15.142:0/3927600742 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f5cf003d000 0x7f5cf003f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:48.547 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.530+0000 7f5d08ff9640 1 -- 172.21.15.142:0/3927600742 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f5e2004b030 con 0x56376620c7c0 2024-09-22T08:36:48.547 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.530+0000 7f5e26dae640 1 --2- 172.21.15.142:0/3927600742 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f5cf003d000 0x7f5cf003f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:48.547 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.530+0000 7f5e2b125800 20 rados->read ofs=0 len=0 2024-09-22T08:36:48.547 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.530+0000 7f5e2b125800 1 --2- 172.21.15.142:0/3927600742 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x56376621f670 0x563766221b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:48.547 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.531+0000 7f5e2b125800 1 -- 172.21.15.142:0/3927600742 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563766222280 con 0x56376621f670 2024-09-22T08:36:48.547 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.531+0000 7f5e1e5ad640 1 --2- 172.21.15.142:0/3927600742 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x56376621f670 0x563766221b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:48.547 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.531+0000 7f5e26dae640 1 --2- 172.21.15.142:0/3927600742 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f5cf003d000 0x7f5cf003f4c0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f5e18042fd0 tx=0x7f5e18034000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:48.547 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.531+0000 7f5e1e5ad640 1 --2- 172.21.15.142:0/3927600742 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x56376621f670 0x563766221b30 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:48.547 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.531+0000 7f5e1e5ad640 1 -- 172.21.15.142:0/3927600742 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5e10051070 con 0x56376621f670 2024-09-22T08:36:48.547 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.531+0000 7f5e2b125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:48.547 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.531+0000 7f5e2b125800 20 realm 2024-09-22T08:36:48.547 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.531+0000 7f5e2b125800 20 rados->read ofs=0 len=0 2024-09-22T08:36:48.548 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.531+0000 7f5e2b125800 1 -- 172.21.15.142:0/3927600742 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5637662226b0 con 0x56376621f670 2024-09-22T08:36:48.548 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.531+0000 7f5e1e5ad640 1 -- 172.21.15.142:0/3927600742 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5e10051070 con 0x56376621f670 2024-09-22T08:36:48.548 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.531+0000 7f5e2b125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:48.548 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.531+0000 7f5e2b125800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:36:48.548 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.531+0000 7f5e2b125800 20 rados->read ofs=0 len=0 2024-09-22T08:36:48.548 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.531+0000 7f5e2b125800 1 -- 172.21.15.142:0/3927600742 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563766222f80 con 0x56376621f670 2024-09-22T08:36:48.548 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.532+0000 7f5e1e5ad640 1 -- 172.21.15.142:0/3927600742 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5e10051070 con 0x56376621f670 2024-09-22T08:36:48.548 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.532+0000 7f5e2b125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:48.548 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.532+0000 7f5e2b125800 20 rados->read ofs=0 len=0 2024-09-22T08:36:48.548 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.532+0000 7f5e2b125800 1 -- 172.21.15.142:0/3927600742 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563766223320 con 0x56376621f670 2024-09-22T08:36:48.548 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.532+0000 7f5e1e5ad640 1 -- 172.21.15.142:0/3927600742 <== osd.1 v2:172.21.15.142:6816/3192108003 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5e10051070 con 0x56376621f670 2024-09-22T08:36:48.548 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.532+0000 7f5e2b125800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:36:48.548 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.532+0000 7f5e2b125800 20 rados->read ofs=0 len=0 2024-09-22T08:36:48.548 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.532+0000 7f5e2b125800 1 --2- 172.21.15.142:0/3927600742 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x563766224080 0x563766226470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:48.549 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.532+0000 7f5e2b125800 1 -- 172.21.15.142:0/3927600742 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5637662269b0 con 0x563766224080 2024-09-22T08:36:48.549 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.532+0000 7f5e275af640 1 --2- 172.21.15.142:0/3927600742 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x563766224080 0x563766226470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:48.549 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.532+0000 7f5e275af640 1 --2- 172.21.15.142:0/3927600742 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x563766224080 0x563766226470 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:48.549 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.532+0000 7f5e275af640 1 -- 172.21.15.142:0/3927600742 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(5 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f5e2000a4d0 con 0x563766224080 2024-09-22T08:36:48.549 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.532+0000 7f5e2b125800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:36:48.549 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.533+0000 7f5e2b125800 20 searching for the correct realm 2024-09-22T08:36:48.549 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.533+0000 7f5e2b125800 1 -- 172.21.15.142:0/3927600742 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563766228320 con 0x563766224080 2024-09-22T08:36:48.549 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.533+0000 7f5e275af640 1 -- 172.21.15.142:0/3927600742 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e2000a4d0 con 0x563766224080 2024-09-22T08:36:48.549 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.533+0000 7f5e275af640 1 --2- 172.21.15.142:0/3927600742 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f5e2003b7b0 0x7f5e2003c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:48.549 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.533+0000 7f5e275af640 1 -- 172.21.15.142:0/3927600742 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563766228320 con 0x7f5e2003b7b0 2024-09-22T08:36:48.549 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.533+0000 7f5e26dae640 1 --2- 172.21.15.142:0/3927600742 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f5e2003b7b0 0x7f5e2003c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:48.549 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.533+0000 7f5e26dae640 1 --2- 172.21.15.142:0/3927600742 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f5e2003b7b0 0x7f5e2003c5c0 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:48.549 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.533+0000 7f5e26dae640 1 -- 172.21.15.142:0/3927600742 <== osd.2 v2:172.21.15.142:6808/279438927 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e18051040 con 0x7f5e2003b7b0 2024-09-22T08:36:48.550 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.533+0000 7f5e26dae640 1 --2- 172.21.15.142:0/3927600742 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f5e1803a040 0x7f5e180422b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:48.550 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.533+0000 7f5e26dae640 1 -- 172.21.15.142:0/3927600742 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563766228320 con 0x7f5e1803a040 2024-09-22T08:36:48.550 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.534+0000 7f5e1e5ad640 1 --2- 172.21.15.142:0/3927600742 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f5e1803a040 0x7f5e180422b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:48.550 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.534+0000 7f5e1e5ad640 1 --2- 172.21.15.142:0/3927600742 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f5e1803a040 0x7f5e180422b0 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:48.550 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.534+0000 7f5e1e5ad640 1 -- 172.21.15.142:0/3927600742 <== osd.0 v2:172.21.15.31:6800/168281188 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e10051070 con 0x7f5e1803a040 2024-09-22T08:36:48.550 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.534+0000 7f5e1e5ad640 1 -- 172.21.15.142:0/3927600742 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563766228320 con 0x56376621f670 2024-09-22T08:36:48.550 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.534+0000 7f5e1e5ad640 1 -- 172.21.15.142:0/3927600742 <== osd.1 v2:172.21.15.142:6816/3192108003 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e10051070 con 0x56376621f670 2024-09-22T08:36:48.550 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.534+0000 7f5e1e5ad640 1 -- 172.21.15.142:0/3927600742 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563766228320 con 0x56376621f670 2024-09-22T08:36:48.550 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.535+0000 7f5e1e5ad640 1 -- 172.21.15.142:0/3927600742 <== osd.1 v2:172.21.15.142:6816/3192108003 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e10051070 con 0x56376621f670 2024-09-22T08:36:48.550 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.535+0000 7f5e1e5ad640 1 -- 172.21.15.142:0/3927600742 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563766228320 con 0x7f5e1803a040 2024-09-22T08:36:48.550 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.535+0000 7f5e1e5ad640 1 -- 172.21.15.142:0/3927600742 <== osd.0 v2:172.21.15.31:6800/168281188 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e10051070 con 0x7f5e1803a040 2024-09-22T08:36:48.550 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.535+0000 7f5e1e5ad640 1 -- 172.21.15.142:0/3927600742 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563766228320 con 0x7f5e1803a040 2024-09-22T08:36:48.551 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.535+0000 7f5e1e5ad640 1 -- 172.21.15.142:0/3927600742 <== osd.0 v2:172.21.15.31:6800/168281188 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e10051070 con 0x7f5e1803a040 2024-09-22T08:36:48.551 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.535+0000 7f5e1e5ad640 1 -- 172.21.15.142:0/3927600742 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563766228320 con 0x7f5e2003b7b0 2024-09-22T08:36:48.551 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.535+0000 7f5e26dae640 1 -- 172.21.15.142:0/3927600742 <== osd.2 v2:172.21.15.142:6808/279438927 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e18051040 con 0x7f5e2003b7b0 2024-09-22T08:36:48.551 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.535+0000 7f5e26dae640 1 -- 172.21.15.142:0/3927600742 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563766228320 con 0x563766224080 2024-09-22T08:36:48.551 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.536+0000 7f5e275af640 1 -- 172.21.15.142:0/3927600742 <== osd.3 v2:172.21.15.142:6800/1064901393 3 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e2000a4d0 con 0x563766224080 2024-09-22T08:36:48.551 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.536+0000 7f5e275af640 1 -- 172.21.15.142:0/3927600742 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563766228320 con 0x56376621f670 2024-09-22T08:36:48.551 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.536+0000 7f5e1e5ad640 1 -- 172.21.15.142:0/3927600742 <== osd.1 v2:172.21.15.142:6816/3192108003 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e10051070 con 0x56376621f670 2024-09-22T08:36:48.551 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.536+0000 7f5e1e5ad640 1 -- 172.21.15.142:0/3927600742 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563766228320 con 0x7f5e1803a040 2024-09-22T08:36:48.551 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.536+0000 7f5e1e5ad640 1 -- 172.21.15.142:0/3927600742 <== osd.0 v2:172.21.15.31:6800/168281188 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e10051070 con 0x7f5e1803a040 2024-09-22T08:36:48.551 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.536+0000 7f5e1e5ad640 1 -- 172.21.15.142:0/3927600742 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563766228320 con 0x56376621f670 2024-09-22T08:36:48.551 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.536+0000 7f5e1e5ad640 1 -- 172.21.15.142:0/3927600742 <== osd.1 v2:172.21.15.142:6816/3192108003 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e10051070 con 0x56376621f670 2024-09-22T08:36:48.551 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.536+0000 7f5e1e5ad640 1 -- 172.21.15.142:0/3927600742 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563766228320 con 0x7f5e2003b7b0 2024-09-22T08:36:48.551 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.536+0000 7f5e26dae640 1 -- 172.21.15.142:0/3927600742 <== osd.2 v2:172.21.15.142:6808/279438927 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f5e18051040 con 0x7f5e2003b7b0 2024-09-22T08:36:48.552 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.536+0000 7f5e26dae640 1 -- 172.21.15.142:0/3927600742 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563766228320 con 0x563766224080 2024-09-22T08:36:48.552 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.537+0000 7f5e275af640 1 -- 172.21.15.142:0/3927600742 <== osd.3 v2:172.21.15.142:6800/1064901393 4 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e2000a4d0 con 0x563766224080 2024-09-22T08:36:48.552 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.537+0000 7f5e275af640 1 -- 172.21.15.142:0/3927600742 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563766228320 con 0x563766224080 2024-09-22T08:36:48.552 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.537+0000 7f5e275af640 1 -- 172.21.15.142:0/3927600742 <== osd.3 v2:172.21.15.142:6800/1064901393 5 ==== osd_op_reply(20 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f5e2000a4d0 con 0x563766224080 2024-09-22T08:36:48.552 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.537+0000 7f5e275af640 1 -- 172.21.15.142:0/3927600742 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563766228320 con 0x7f5e1803a040 2024-09-22T08:36:48.552 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.537+0000 7f5e1e5ad640 1 -- 172.21.15.142:0/3927600742 <== osd.0 v2:172.21.15.31:6800/168281188 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e10051070 con 0x7f5e1803a040 2024-09-22T08:36:48.552 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.537+0000 7f5e1e5ad640 1 -- 172.21.15.142:0/3927600742 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563766228320 con 0x563766224080 2024-09-22T08:36:48.552 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.538+0000 7f5e275af640 1 -- 172.21.15.142:0/3927600742 <== osd.3 v2:172.21.15.142:6800/1064901393 6 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e2000a4d0 con 0x563766224080 2024-09-22T08:36:48.552 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.538+0000 7f5e275af640 1 -- 172.21.15.142:0/3927600742 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563766228320 con 0x563766224080 2024-09-22T08:36:48.552 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.538+0000 7f5e275af640 1 -- 172.21.15.142:0/3927600742 <== osd.3 v2:172.21.15.142:6800/1064901393 7 ==== osd_op_reply(23 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f5e2000a4d0 con 0x563766224080 2024-09-22T08:36:48.552 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.538+0000 7f5e275af640 1 -- 172.21.15.142:0/3927600742 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563766228320 con 0x56376621f670 2024-09-22T08:36:48.552 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.538+0000 7f5e1e5ad640 1 -- 172.21.15.142:0/3927600742 <== osd.1 v2:172.21.15.142:6816/3192108003 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e10051070 con 0x56376621f670 2024-09-22T08:36:48.553 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.538+0000 7f5e1e5ad640 1 -- 172.21.15.142:0/3927600742 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563766228320 con 0x56376621f670 2024-09-22T08:36:48.553 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.538+0000 7f5e1e5ad640 1 -- 172.21.15.142:0/3927600742 <== osd.1 v2:172.21.15.142:6816/3192108003 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f5e10051070 con 0x56376621f670 2024-09-22T08:36:48.553 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.538+0000 7f5e1e5ad640 1 -- 172.21.15.142:0/3927600742 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563766228320 con 0x7f5e1803a040 2024-09-22T08:36:48.553 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.539+0000 7f5e1e5ad640 1 -- 172.21.15.142:0/3927600742 <== osd.0 v2:172.21.15.31:6800/168281188 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e10051070 con 0x7f5e1803a040 2024-09-22T08:36:48.553 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.539+0000 7f5e1e5ad640 1 -- 172.21.15.142:0/3927600742 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563766228320 con 0x563766224080 2024-09-22T08:36:48.553 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.539+0000 7f5e275af640 1 -- 172.21.15.142:0/3927600742 <== osd.3 v2:172.21.15.142:6800/1064901393 8 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e2000a4d0 con 0x563766224080 2024-09-22T08:36:48.553 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.539+0000 7f5e275af640 1 -- 172.21.15.142:0/3927600742 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563766228320 con 0x7f5e2003b7b0 2024-09-22T08:36:48.553 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.539+0000 7f5e26dae640 1 -- 172.21.15.142:0/3927600742 <== osd.2 v2:172.21.15.142:6808/279438927 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e18051040 con 0x7f5e2003b7b0 2024-09-22T08:36:48.553 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.539+0000 7f5e26dae640 1 -- 172.21.15.142:0/3927600742 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563766228320 con 0x56376621f670 2024-09-22T08:36:48.553 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.540+0000 7f5e1e5ad640 1 -- 172.21.15.142:0/3927600742 <== osd.1 v2:172.21.15.142:6816/3192108003 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e10051070 con 0x56376621f670 2024-09-22T08:36:48.553 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.540+0000 7f5e1e5ad640 1 -- 172.21.15.142:0/3927600742 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563766228320 con 0x7f5e1803a040 2024-09-22T08:36:48.553 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.540+0000 7f5e1e5ad640 1 -- 172.21.15.142:0/3927600742 <== osd.0 v2:172.21.15.31:6800/168281188 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e10051070 con 0x7f5e1803a040 2024-09-22T08:36:48.554 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.540+0000 7f5e1e5ad640 1 -- 172.21.15.142:0/3927600742 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563766228320 con 0x563766224080 2024-09-22T08:36:48.554 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.540+0000 7f5e275af640 1 -- 172.21.15.142:0/3927600742 <== osd.3 v2:172.21.15.142:6800/1064901393 9 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e2000a4d0 con 0x563766224080 2024-09-22T08:36:48.554 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.540+0000 7f5e275af640 1 -- 172.21.15.142:0/3927600742 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563766228320 con 0x7f5e1803a040 2024-09-22T08:36:48.554 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.540+0000 7f5e1e5ad640 1 -- 172.21.15.142:0/3927600742 <== osd.0 v2:172.21.15.31:6800/168281188 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e10051070 con 0x7f5e1803a040 2024-09-22T08:36:48.554 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.540+0000 7f5e1e5ad640 1 -- 172.21.15.142:0/3927600742 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563766228320 con 0x7f5e2003b7b0 2024-09-22T08:36:48.554 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.541+0000 7f5e26dae640 1 -- 172.21.15.142:0/3927600742 <== osd.2 v2:172.21.15.142:6808/279438927 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e18051040 con 0x7f5e2003b7b0 2024-09-22T08:36:48.554 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.541+0000 7f5e26dae640 1 -- 172.21.15.142:0/3927600742 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563766228320 con 0x563766224080 2024-09-22T08:36:48.554 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.541+0000 7f5e275af640 1 -- 172.21.15.142:0/3927600742 <== osd.3 v2:172.21.15.142:6800/1064901393 10 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e2000a4d0 con 0x563766224080 2024-09-22T08:36:48.554 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.541+0000 7f5e275af640 1 -- 172.21.15.142:0/3927600742 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563766228320 con 0x7f5e1803a040 2024-09-22T08:36:48.554 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.541+0000 7f5e1e5ad640 1 -- 172.21.15.142:0/3927600742 <== osd.0 v2:172.21.15.31:6800/168281188 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e10051070 con 0x7f5e1803a040 2024-09-22T08:36:48.554 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.541+0000 7f5e1e5ad640 1 -- 172.21.15.142:0/3927600742 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563766228320 con 0x56376621f670 2024-09-22T08:36:48.554 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.542+0000 7f5e1e5ad640 1 -- 172.21.15.142:0/3927600742 <== osd.1 v2:172.21.15.142:6816/3192108003 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f5e10051070 con 0x56376621f670 2024-09-22T08:36:48.554 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.542+0000 7f5e1e5ad640 1 -- 172.21.15.142:0/3927600742 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563766228320 con 0x7f5e2003b7b0 2024-09-22T08:36:48.555 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.542+0000 7f5e26dae640 1 -- 172.21.15.142:0/3927600742 <== osd.2 v2:172.21.15.142:6808/279438927 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e18051040 con 0x7f5e2003b7b0 2024-09-22T08:36:48.555 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.542+0000 7f5e2b125800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:36:48.555 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.542+0000 7f5e2b125800 20 RGWRados::pool_iterate: got zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec 2024-09-22T08:36:48.555 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.542+0000 7f5e2b125800 20 RGWRados::pool_iterate: got zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f 2024-09-22T08:36:48.555 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.542+0000 7f5e2b125800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:36:48.555 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.542+0000 7f5e2b125800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:36:48.555 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.542+0000 7f5e2b125800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:36:48.555 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.542+0000 7f5e2b125800 20 rados->read ofs=0 len=0 2024-09-22T08:36:48.555 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.542+0000 7f5e2b125800 1 -- 172.21.15.142:0/3927600742 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563766227420 con 0x56376621f670 2024-09-22T08:36:48.555 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.542+0000 7f5e1e5ad640 1 -- 172.21.15.142:0/3927600742 <== osd.1 v2:172.21.15.142:6816/3192108003 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5e10051070 con 0x56376621f670 2024-09-22T08:36:48.555 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.542+0000 7f5e2b125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:48.555 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.542+0000 7f5e2b125800 20 rados->read ofs=0 len=0 2024-09-22T08:36:48.555 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.542+0000 7f5e2b125800 1 -- 172.21.15.142:0/3927600742 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563766227cc0 con 0x56376621f670 2024-09-22T08:36:48.555 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.542+0000 7f5e1e5ad640 1 -- 172.21.15.142:0/3927600742 <== osd.1 v2:172.21.15.142:6816/3192108003 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5e10051070 con 0x56376621f670 2024-09-22T08:36:48.556 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.542+0000 7f5e2b125800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:36:48.556 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.542+0000 7f5e2b125800 20 rados->read ofs=0 len=0 2024-09-22T08:36:48.556 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.542+0000 7f5e2b125800 1 -- 172.21.15.142:0/3927600742 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:40 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563766227060 con 0x563766224080 2024-09-22T08:36:48.556 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.542+0000 7f5e275af640 1 -- 172.21.15.142:0/3927600742 <== osd.3 v2:172.21.15.142:6800/1064901393 11 ==== osd_op_reply(40 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f5e2000a4d0 con 0x563766224080 2024-09-22T08:36:48.556 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.543+0000 7f5e2b125800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:36:48.556 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.543+0000 7f5e2b125800 20 zone default found 2024-09-22T08:36:48.556 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.543+0000 7f5e2b125800 4 Realm: () 2024-09-22T08:36:48.556 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.543+0000 7f5e2b125800 4 ZoneGroup: default (d89f6f57-1007-47dd-9065-f486c7b01aec) 2024-09-22T08:36:48.556 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.543+0000 7f5e2b125800 4 Zone: default (e239248c-0bee-4e41-803a-24b288d3eb8f) 2024-09-22T08:36:48.556 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.543+0000 7f5e2b125800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:36:48.556 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.543+0000 7f5e2b125800 20 zonegroup default 2024-09-22T08:36:48.556 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.543+0000 7f5e2b125800 20 rados->read ofs=0 len=0 2024-09-22T08:36:48.556 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.543+0000 7f5e2b125800 1 -- 172.21.15.142:0/3927600742 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563766228ca0 con 0x7f5e1803a040 2024-09-22T08:36:48.557 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.543+0000 7f5e1e5ad640 1 -- 172.21.15.142:0/3927600742 <== osd.0 v2:172.21.15.31:6800/168281188 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f5e10051070 con 0x7f5e1803a040 2024-09-22T08:36:48.557 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.543+0000 7f5e2b125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:48.557 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.543+0000 7f5e2b125800 20 rados->read ofs=0 len=0 2024-09-22T08:36:48.557 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.543+0000 7f5e2b125800 1 -- 172.21.15.142:0/3927600742 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56376622ab30 con 0x563766224080 2024-09-22T08:36:48.557 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.543+0000 7f5e275af640 1 -- 172.21.15.142:0/3927600742 <== osd.3 v2:172.21.15.142:6800/1064901393 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5e2000a4d0 con 0x563766224080 2024-09-22T08:36:48.557 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.543+0000 7f5e2b125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:48.557 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.543+0000 7f5e2b125800 20 rados->read ofs=0 len=0 2024-09-22T08:36:48.557 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.543+0000 7f5e2b125800 1 -- 172.21.15.142:0/3927600742 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56376622afc0 con 0x563766224080 2024-09-22T08:36:48.557 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.543+0000 7f5e275af640 1 -- 172.21.15.142:0/3927600742 <== osd.3 v2:172.21.15.142:6800/1064901393 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5e2000a4d0 con 0x563766224080 2024-09-22T08:36:48.557 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.543+0000 7f5e2b125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:48.557 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.543+0000 7f5e2b125800 20 started sync module instance, tier type = 2024-09-22T08:36:48.557 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.543+0000 7f5e2b125800 20 started zone id=e239248c-0bee-4e41-803a-24b288d3eb8f (name=default) with tier type = 2024-09-22T08:36:48.557 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.543+0000 7f5e2b125800 1 -- 172.21.15.142:0/3927600742 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563766229ed0 con 0x7f5e2003b7b0 2024-09-22T08:36:48.567 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.544+0000 7f5e26dae640 1 -- 172.21.15.142:0/3927600742 <== osd.2 v2:172.21.15.142:6808/279438927 7 ==== osd_op_reply(44 notify.0 [create] v30'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e18051040 con 0x7f5e2003b7b0 2024-09-22T08:36:48.567 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.544+0000 7f5e2b125800 1 -- 172.21.15.142:0/3927600742 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94795936735984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56376622b8d0 con 0x7f5e2003b7b0 2024-09-22T08:36:48.567 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.544+0000 7f5e2b125800 1 -- 172.21.15.142:0/3927600742 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56376622c120 con 0x56376621f670 2024-09-22T08:36:48.567 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.545+0000 7f5e26dae640 1 -- 172.21.15.142:0/3927600742 <== osd.2 v2:172.21.15.142:6808/279438927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94795936735984] v30'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e18051040 con 0x7f5e2003b7b0 2024-09-22T08:36:48.567 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.545+0000 7f5e1e5ad640 1 -- 172.21.15.142:0/3927600742 <== osd.1 v2:172.21.15.142:6816/3192108003 15 ==== osd_op_reply(46 notify.1 [create] v30'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e10051070 con 0x56376621f670 2024-09-22T08:36:48.568 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.545+0000 7f5e2b125800 1 -- 172.21.15.142:0/3927600742 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94795936740384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56376622c1a0 con 0x56376621f670 2024-09-22T08:36:48.568 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.546+0000 7f5e2b125800 1 -- 172.21.15.142:0/3927600742 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56376622ccc0 con 0x563766224080 2024-09-22T08:36:48.568 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.547+0000 7f5e1e5ad640 1 -- 172.21.15.142:0/3927600742 <== osd.1 v2:172.21.15.142:6816/3192108003 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94795936740384] v30'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e10051070 con 0x56376621f670 2024-09-22T08:36:48.568 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.547+0000 7f5e275af640 1 -- 172.21.15.142:0/3927600742 <== osd.3 v2:172.21.15.142:6800/1064901393 14 ==== osd_op_reply(48 notify.2 [create] v30'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e2000a4d0 con 0x563766224080 2024-09-22T08:36:48.568 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.547+0000 7f5e2b125800 1 -- 172.21.15.142:0/3927600742 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94795936745360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56376622cc80 con 0x563766224080 2024-09-22T08:36:48.568 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.547+0000 7f5e2b125800 1 -- 172.21.15.142:0/3927600742 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56376622d720 con 0x7f5e2003b7b0 2024-09-22T08:36:48.568 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.548+0000 7f5e26dae640 1 -- 172.21.15.142:0/3927600742 <== osd.2 v2:172.21.15.142:6808/279438927 9 ==== osd_op_reply(50 notify.3 [create] v30'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e18051040 con 0x7f5e2003b7b0 2024-09-22T08:36:48.568 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.548+0000 7f5e2b125800 1 -- 172.21.15.142:0/3927600742 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94795936748112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56376622dff0 con 0x7f5e2003b7b0 2024-09-22T08:36:48.568 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.548+0000 7f5e275af640 1 -- 172.21.15.142:0/3927600742 <== osd.3 v2:172.21.15.142:6800/1064901393 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94795936745360] v30'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e2000a4d0 con 0x563766224080 2024-09-22T08:36:48.568 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.548+0000 7f5e2b125800 1 -- 172.21.15.142:0/3927600742 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56376622bcb0 con 0x56376621f670 2024-09-22T08:36:48.568 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.549+0000 7f5e26dae640 1 -- 172.21.15.142:0/3927600742 <== osd.2 v2:172.21.15.142:6808/279438927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94795936748112] v30'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e18051040 con 0x7f5e2003b7b0 2024-09-22T08:36:48.568 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.549+0000 7f5e1e5ad640 1 -- 172.21.15.142:0/3927600742 <== osd.1 v2:172.21.15.142:6816/3192108003 17 ==== osd_op_reply(52 notify.4 [create] v30'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e10051070 con 0x56376621f670 2024-09-22T08:36:48.568 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.549+0000 7f5e2b125800 1 -- 172.21.15.142:0/3927600742 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94795936750400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56376622ea30 con 0x56376621f670 2024-09-22T08:36:48.569 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.549+0000 7f5e2b125800 1 -- 172.21.15.142:0/3927600742 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56376622f3f0 con 0x7f5e1803a040 2024-09-22T08:36:48.569 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.550+0000 7f5e1e5ad640 1 -- 172.21.15.142:0/3927600742 <== osd.0 v2:172.21.15.31:6800/168281188 11 ==== osd_op_reply(54 notify.5 [create] v30'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e10051070 con 0x7f5e1803a040 2024-09-22T08:36:48.569 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.550+0000 7f5e2b125800 1 -- 172.21.15.142:0/3927600742 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94795936755520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56376622f810 con 0x7f5e1803a040 2024-09-22T08:36:48.569 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.550+0000 7f5e2b125800 1 -- 172.21.15.142:0/3927600742 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563766230310 con 0x7f5e1803a040 2024-09-22T08:36:48.569 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.550+0000 7f5e1e5ad640 1 -- 172.21.15.142:0/3927600742 <== osd.1 v2:172.21.15.142:6816/3192108003 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94795936750400] v30'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e10051070 con 0x56376621f670 2024-09-22T08:36:48.569 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.551+0000 7f5e1e5ad640 1 -- 172.21.15.142:0/3927600742 <== osd.0 v2:172.21.15.31:6800/168281188 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94795936755520] v30'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e10051070 con 0x7f5e1803a040 2024-09-22T08:36:48.569 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.551+0000 7f5e1e5ad640 1 -- 172.21.15.142:0/3927600742 <== osd.0 v2:172.21.15.31:6800/168281188 13 ==== osd_op_reply(56 notify.6 [create] v30'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e10051070 con 0x7f5e1803a040 2024-09-22T08:36:48.569 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.551+0000 7f5e2b125800 1 -- 172.21.15.142:0/3927600742 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94795936759296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56376622f360 con 0x7f5e1803a040 2024-09-22T08:36:48.569 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.551+0000 7f5e2b125800 1 -- 172.21.15.142:0/3927600742 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5637662309a0 con 0x7f5e1803a040 2024-09-22T08:36:48.569 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.552+0000 7f5e1e5ad640 1 -- 172.21.15.142:0/3927600742 <== osd.0 v2:172.21.15.31:6800/168281188 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94795936759296] v30'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e10051070 con 0x7f5e1803a040 2024-09-22T08:36:48.569 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.552+0000 7f5e1e5ad640 1 -- 172.21.15.142:0/3927600742 <== osd.0 v2:172.21.15.31:6800/168281188 15 ==== osd_op_reply(58 notify.7 [create] v30'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e10051070 con 0x7f5e1803a040 2024-09-22T08:36:48.569 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.552+0000 7f5e2b125800 1 -- 172.21.15.142:0/3927600742 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94795936753024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5637662309a0 con 0x7f5e1803a040 2024-09-22T08:36:48.569 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.552+0000 7f5e2b125800 20 add_watcher() i=0 2024-09-22T08:36:48.569 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.552+0000 7f5e2b125800 20 add_watcher() i=1 2024-09-22T08:36:48.570 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.552+0000 7f5e2b125800 20 add_watcher() i=2 2024-09-22T08:36:48.570 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.552+0000 7f5e2b125800 20 add_watcher() i=3 2024-09-22T08:36:48.570 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.552+0000 7f5e2b125800 20 add_watcher() i=4 2024-09-22T08:36:48.570 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.552+0000 7f5e2b125800 20 add_watcher() i=5 2024-09-22T08:36:48.570 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.552+0000 7f5e2b125800 20 add_watcher() i=6 2024-09-22T08:36:48.570 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.553+0000 7f5e1e5ad640 1 -- 172.21.15.142:0/3927600742 <== osd.0 v2:172.21.15.31:6800/168281188 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94795936753024] v30'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e10051070 con 0x7f5e1803a040 2024-09-22T08:36:48.570 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.553+0000 7f5e2b125800 20 add_watcher() i=7 2024-09-22T08:36:48.570 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.553+0000 7f5e2b125800 2 all 8 watchers are set, enabling cache 2024-09-22T08:36:48.570 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.553+0000 7f5e2b125800 1 -- 172.21.15.142:0/3927600742 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563766233ca0 con 0x56376621f670 2024-09-22T08:36:48.570 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.553+0000 7f5e1e5ad640 1 -- 172.21.15.142:0/3927600742 <== osd.1 v2:172.21.15.142:6816/3192108003 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f5e10051070 con 0x56376621f670 2024-09-22T08:36:48.570 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.553+0000 7f5e2b125800 1 -- 172.21.15.142:0/3927600742 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94795936773760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5637662309a0 con 0x56376621f670 2024-09-22T08:36:48.570 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.555+0000 7f5e1e5ad640 1 -- 172.21.15.142:0/3927600742 <== osd.1 v2:172.21.15.142:6816/3192108003 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94795936773760] v30'144 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5e10051070 con 0x56376621f670 2024-09-22T08:36:48.570 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.555+0000 7f5cddfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:36:48.571 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.555+0000 7f5e2b125800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:36:48.571 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.555+0000 7f5e2b125800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:36:48.571 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.555+0000 7f5e2b125800 5 note: GC not initialized 2024-09-22T08:36:48.571 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.555+0000 7f5cdcfe1640 20 reqs_thread_entry: start 2024-09-22T08:36:48.571 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.555+0000 7f5e2b125800 20 init_complete bucket index max shards: 11 2024-09-22T08:36:48.571 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.555+0000 7f5e2b125800 20 Filter name: none 2024-09-22T08:36:48.571 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.555+0000 7f5cd5ffb640 20 reqs_thread_entry: start 2024-09-22T08:36:48.571 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.555+0000 7f5e2b125800 20 rados->read ofs=0 len=0 2024-09-22T08:36:48.571 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.555+0000 7f5e2b125800 1 -- 172.21.15.142:0/3927600742 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563766266f90 con 0x7f5e2003b7b0 2024-09-22T08:36:48.571 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.556+0000 7f5e26dae640 1 -- 172.21.15.142:0/3927600742 <== osd.2 v2:172.21.15.142:6808/279438927 11 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv27 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f5e18051040 con 0x7f5e2003b7b0 2024-09-22T08:36:48.571 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.556+0000 7f5e2b125800 20 rados_obj.operate() r=0 bl.length=165 2024-09-22T08:36:48.571 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.556+0000 7f5e2b125800 20 rados->read ofs=0 len=0 2024-09-22T08:36:48.571 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.556+0000 7f5e2b125800 1 -- 172.21.15.142:0/3927600742 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:63 8.15 8:ab67ca09:root::.bucket.meta.myfoo%3ae239248c-0bee-4e41-803a-24b288d3eb8f.4226.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563766267920 con 0x563766224080 2024-09-22T08:36:48.571 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.556+0000 7f5e275af640 1 -- 172.21.15.142:0/3927600742 <== osd.3 v2:172.21.15.142:6800/1064901393 16 ==== osd_op_reply(63 .bucket.meta.myfoo:e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv7 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7f5e2000a4d0 con 0x563766224080 2024-09-22T08:36:48.571 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.556+0000 7f5e2b125800 20 rados_obj.operate() r=0 bl.length=387 2024-09-22T08:36:48.572 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.556+0000 7f5e2b125800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:36:48.572 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.556+0000 7f5e2b125800 20 rados->read ofs=0 len=0 2024-09-22T08:36:48.572 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.556+0000 7f5e2b125800 1 -- 172.21.15.142:0/3927600742 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5637662678d0 con 0x7f5e2003b7b0 2024-09-22T08:36:48.572 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.556+0000 7f5e26dae640 1 -- 172.21.15.142:0/3927600742 <== osd.2 v2:172.21.15.142:6808/279438927 12 ==== osd_op_reply(64 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv27 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f5e18051040 con 0x7f5e2003b7b0 2024-09-22T08:36:48.572 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.556+0000 7f5e2b125800 20 rados_obj.operate() r=0 bl.length=165 2024-09-22T08:36:48.572 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.556+0000 7f5e2b125800 20 rados->read ofs=0 len=0 2024-09-22T08:36:48.572 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.556+0000 7f5e2b125800 1 -- 172.21.15.142:0/3927600742 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:65 8.15 8:ab67ca09:root::.bucket.meta.myfoo%3ae239248c-0bee-4e41-803a-24b288d3eb8f.4226.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5637662678d0 con 0x563766224080 2024-09-22T08:36:48.572 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.557+0000 7f5e275af640 1 -- 172.21.15.142:0/3927600742 <== osd.3 v2:172.21.15.142:6800/1064901393 17 ==== osd_op_reply(65 .bucket.meta.myfoo:e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv7 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7f5e2000a4d0 con 0x563766224080 2024-09-22T08:36:48.572 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.557+0000 7f5e2b125800 20 rados_obj.operate() r=0 bl.length=387 2024-09-22T08:36:48.572 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.557+0000 7f5e2b125800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:36:48.572 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.557+0000 7f5e2b125800 1 -- 172.21.15.142:0/3927600742 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:66 4.12 4:48caaf34:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56376626a540 con 0x56376621f670 2024-09-22T08:36:48.572 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.557+0000 7f5e2b125800 1 -- 172.21.15.142:0/3927600742 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:67 4.10 4:09af3fe1:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56376626cfb0 con 0x563766224080 2024-09-22T08:36:48.572 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.557+0000 7f5e2b125800 1 -- 172.21.15.142:0/3927600742 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:68 4.12 4:49def6fa:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56376626f930 con 0x56376621f670 2024-09-22T08:36:48.573 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.557+0000 7f5e2b125800 1 -- 172.21.15.142:0/3927600742 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:69 4.2 4:4255cd8e:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56376626f930 con 0x56376621f670 2024-09-22T08:36:48.573 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.557+0000 7f5e2b125800 1 -- 172.21.15.142:0/3927600742 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:70 4.c 4:323d0659:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563766274960 con 0x56376621f670 2024-09-22T08:36:48.573 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.557+0000 7f5e2b125800 1 -- 172.21.15.142:0/3927600742 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:71 4.20 4:061d9e92:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563766277820 con 0x56376621f670 2024-09-22T08:36:48.573 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.557+0000 7f5e2b125800 1 -- 172.21.15.142:0/3927600742 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:72 4.3b 4:dc8435be:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56376627a6e0 con 0x563766224080 2024-09-22T08:36:48.573 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.557+0000 7f5e2b125800 1 -- 172.21.15.142:0/3927600742 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:73 4.22 4:44b3b4fd:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56376627d530 con 0x56376621f670 2024-09-22T08:36:48.573 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.557+0000 7f5e2b125800 1 -- 172.21.15.142:0/3927600742 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:74 4.2d 4:b74eadf4:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5637662803b0 con 0x7f5e1803a040 2024-09-22T08:36:48.573 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.557+0000 7f5e2b125800 1 -- 172.21.15.142:0/3927600742 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:75 4.12 4:4be25f13:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563766282ce0 con 0x56376621f670 2024-09-22T08:36:48.573 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.557+0000 7f5e2b125800 1 -- 172.21.15.142:0/3927600742 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:76 4.5 4:a0e4e0ec:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5637662856c0 con 0x563766224080 2024-09-22T08:36:48.573 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.557+0000 7f5e1e5ad640 1 -- 172.21.15.142:0/3927600742 <== osd.1 v2:172.21.15.142:6816/3192108003 21 ==== osd_op_reply(66 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1.0 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f5e10051070 con 0x56376621f670 2024-09-22T08:36:48.573 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.557+0000 7f5e275af640 1 -- 172.21.15.142:0/3927600742 <== osd.3 v2:172.21.15.142:6800/1064901393 18 ==== osd_op_reply(67 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1.1 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f5e2000a4d0 con 0x563766224080 2024-09-22T08:36:48.573 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.557+0000 7f5e275af640 1 -- 172.21.15.142:0/3927600742 <== osd.3 v2:172.21.15.142:6800/1064901393 19 ==== osd_op_reply(72 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1.6 [call out=128b] v0'0 uv7 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7f5e2000a4d0 con 0x563766224080 2024-09-22T08:36:48.573 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.558+0000 7f5e1e5ad640 1 -- 172.21.15.142:0/3927600742 <== osd.1 v2:172.21.15.142:6816/3192108003 22 ==== osd_op_reply(69 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1.3 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f5e10051070 con 0x56376621f670 2024-09-22T08:36:48.573 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.558+0000 7f5e1e5ad640 1 -- 172.21.15.142:0/3927600742 <== osd.1 v2:172.21.15.142:6816/3192108003 23 ==== osd_op_reply(68 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1.2 [call out=89b] v0'0 uv2 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f5e10051070 con 0x56376621f670 2024-09-22T08:36:48.573 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.558+0000 7f5e275af640 1 -- 172.21.15.142:0/3927600742 <== osd.3 v2:172.21.15.142:6800/1064901393 20 ==== osd_op_reply(76 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1.10 [call out=89b] v0'0 uv1 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f5e2000a4d0 con 0x563766224080 2024-09-22T08:36:48.574 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.558+0000 7f5e1e5ad640 1 -- 172.21.15.142:0/3927600742 <== osd.1 v2:172.21.15.142:6816/3192108003 24 ==== osd_op_reply(70 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1.4 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f5e10051070 con 0x56376621f670 2024-09-22T08:36:48.574 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.558+0000 7f5e1e5ad640 1 -- 172.21.15.142:0/3927600742 <== osd.1 v2:172.21.15.142:6816/3192108003 25 ==== osd_op_reply(75 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1.9 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f5e10051070 con 0x56376621f670 2024-09-22T08:36:48.574 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.558+0000 7f5e1e5ad640 1 -- 172.21.15.142:0/3927600742 <== osd.1 v2:172.21.15.142:6816/3192108003 26 ==== osd_op_reply(71 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1.5 [call out=128b] v0'0 uv5 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7f5e10051070 con 0x56376621f670 2024-09-22T08:36:48.574 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.558+0000 7f5e1e5ad640 1 -- 172.21.15.142:0/3927600742 <== osd.1 v2:172.21.15.142:6816/3192108003 27 ==== osd_op_reply(73 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1.7 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f5e10051070 con 0x56376621f670 2024-09-22T08:36:48.574 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.558+0000 7f5e1e5ad640 1 -- 172.21.15.142:0/3927600742 <== osd.0 v2:172.21.15.31:6800/168281188 17 ==== osd_op_reply(74 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1.8 [call out=128b] v0'0 uv5 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7f5e10051070 con 0x7f5e1803a040 2024-09-22T08:36:48.574 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.559+0000 7f5cddfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:36:48.574 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.559+0000 7f5e2b125800 1 -- 172.21.15.142:0/3927600742 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:77 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94795936773760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563766277820 con 0x56376621f670 2024-09-22T08:36:48.574 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.560+0000 7f5e1e5ad640 1 -- 172.21.15.142:0/3927600742 <== osd.1 v2:172.21.15.142:6816/3192108003 28 ==== osd_op_reply(77 data_loggenerations_metadata [watch unwatch cookie 94795936773760] v30'145 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5e10051070 con 0x56376621f670 2024-09-22T08:36:48.574 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.560+0000 7f5e2b125800 1 -- 172.21.15.142:0/3927600742 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:78 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94795936735984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563766264930 con 0x7f5e2003b7b0 2024-09-22T08:36:48.574 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.561+0000 7f5e26dae640 1 -- 172.21.15.142:0/3927600742 <== osd.2 v2:172.21.15.142:6808/279438927 13 ==== osd_op_reply(78 notify.0 [watch unwatch cookie 94795936735984] v30'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e18065040 con 0x7f5e2003b7b0 2024-09-22T08:36:48.574 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.561+0000 7f5e2b125800 20 remove_watcher() i=0 2024-09-22T08:36:48.574 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.561+0000 7f5e2b125800 2 removed watcher, disabling cache 2024-09-22T08:36:48.574 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.561+0000 7f5e2b125800 1 -- 172.21.15.142:0/3927600742 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:79 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94795936740384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563766264930 con 0x56376621f670 2024-09-22T08:36:48.575 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.562+0000 7f5e1e5ad640 1 -- 172.21.15.142:0/3927600742 <== osd.1 v2:172.21.15.142:6816/3192108003 29 ==== osd_op_reply(79 notify.1 [watch unwatch cookie 94795936740384] v30'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e10051070 con 0x56376621f670 2024-09-22T08:36:48.575 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.562+0000 7f5e2b125800 20 remove_watcher() i=1 2024-09-22T08:36:48.575 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.562+0000 7f5e2b125800 1 -- 172.21.15.142:0/3927600742 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:80 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94795936745360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563766264930 con 0x563766224080 2024-09-22T08:36:48.575 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.563+0000 7f5e275af640 1 -- 172.21.15.142:0/3927600742 <== osd.3 v2:172.21.15.142:6800/1064901393 21 ==== osd_op_reply(80 notify.2 [watch unwatch cookie 94795936745360] v30'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e2000a4d0 con 0x563766224080 2024-09-22T08:36:48.575 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.563+0000 7f5e2b125800 20 remove_watcher() i=2 2024-09-22T08:36:48.575 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.563+0000 7f5e2b125800 1 -- 172.21.15.142:0/3927600742 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:81 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94795936748112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563766264930 con 0x7f5e2003b7b0 2024-09-22T08:36:48.575 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.564+0000 7f5e26dae640 1 -- 172.21.15.142:0/3927600742 <== osd.2 v2:172.21.15.142:6808/279438927 14 ==== osd_op_reply(81 notify.3 [watch unwatch cookie 94795936748112] v30'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e18065040 con 0x7f5e2003b7b0 2024-09-22T08:36:48.575 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.564+0000 7f5e2b125800 20 remove_watcher() i=3 2024-09-22T08:36:48.575 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.564+0000 7f5e2b125800 1 -- 172.21.15.142:0/3927600742 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:82 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94795936750400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563766264930 con 0x56376621f670 2024-09-22T08:36:48.575 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.565+0000 7f5e1e5ad640 1 -- 172.21.15.142:0/3927600742 <== osd.1 v2:172.21.15.142:6816/3192108003 30 ==== osd_op_reply(82 notify.4 [watch unwatch cookie 94795936750400] v30'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e10051070 con 0x56376621f670 2024-09-22T08:36:48.575 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.565+0000 7f5e2b125800 20 remove_watcher() i=4 2024-09-22T08:36:48.575 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.565+0000 7f5e2b125800 1 -- 172.21.15.142:0/3927600742 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:83 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94795936755520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563766264930 con 0x7f5e1803a040 2024-09-22T08:36:48.575 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.566+0000 7f5e1e5ad640 1 -- 172.21.15.142:0/3927600742 <== osd.0 v2:172.21.15.31:6800/168281188 18 ==== osd_op_reply(83 notify.5 [watch unwatch cookie 94795936755520] v30'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e10051070 con 0x7f5e1803a040 2024-09-22T08:36:48.575 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.566+0000 7f5e2b125800 20 remove_watcher() i=5 2024-09-22T08:36:48.576 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.566+0000 7f5e2b125800 1 -- 172.21.15.142:0/3927600742 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:84 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94795936759296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563766264930 con 0x7f5e1803a040 2024-09-22T08:36:48.579 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.567+0000 7f5e1e5ad640 1 -- 172.21.15.142:0/3927600742 <== osd.0 v2:172.21.15.31:6800/168281188 19 ==== osd_op_reply(84 notify.6 [watch unwatch cookie 94795936759296] v30'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e10051070 con 0x7f5e1803a040 2024-09-22T08:36:48.579 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.567+0000 7f5e2b125800 20 remove_watcher() i=6 2024-09-22T08:36:48.579 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.567+0000 7f5e2b125800 1 -- 172.21.15.142:0/3927600742 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:85 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94795936753024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563766264930 con 0x7f5e1803a040 2024-09-22T08:36:48.579 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.568+0000 7f5e1e5ad640 1 -- 172.21.15.142:0/3927600742 <== osd.0 v2:172.21.15.31:6800/168281188 20 ==== osd_op_reply(85 notify.7 [watch unwatch cookie 94795936753024] v30'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e10051070 con 0x7f5e1803a040 2024-09-22T08:36:48.579 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.568+0000 7f5e2b125800 20 remove_watcher() i=7 2024-09-22T08:36:48.579 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.568+0000 7f5e2b125800 1 -- 172.21.15.142:0/3927600742 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f5e1803a040 msgr2=0x7f5e180422b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:48.579 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.568+0000 7f5e2b125800 1 --2- 172.21.15.142:0/3927600742 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f5e1803a040 0x7f5e180422b0 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:48.580 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.568+0000 7f5e2b125800 1 -- 172.21.15.142:0/3927600742 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x56376621f670 msgr2=0x563766221b30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:48.580 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.568+0000 7f5e2b125800 1 --2- 172.21.15.142:0/3927600742 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x56376621f670 0x563766221b30 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:48.580 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.568+0000 7f5e2b125800 1 -- 172.21.15.142:0/3927600742 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f5e2003b7b0 msgr2=0x7f5e2003c5c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:48.580 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.568+0000 7f5e2b125800 1 --2- 172.21.15.142:0/3927600742 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f5e2003b7b0 0x7f5e2003c5c0 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:48.580 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.568+0000 7f5e2b125800 1 -- 172.21.15.142:0/3927600742 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x563766224080 msgr2=0x563766226470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:48.580 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.568+0000 7f5e2b125800 1 --2- 172.21.15.142:0/3927600742 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x563766224080 0x563766226470 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:48.580 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.568+0000 7f5e2b125800 1 -- 172.21.15.142:0/3927600742 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f5cf003d000 msgr2=0x7f5cf003f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:48.580 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.568+0000 7f5e2b125800 1 --2- 172.21.15.142:0/3927600742 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f5cf003d000 0x7f5cf003f4c0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f5e18042fd0 tx=0x7f5e18034000 comp rx=0 tx=0).stop 2024-09-22T08:36:48.580 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.568+0000 7f5e2b125800 1 -- 172.21.15.142:0/3927600742 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56376620c7c0 msgr2=0x563766213d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:48.580 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.568+0000 7f5e2b125800 1 --2- 172.21.15.142:0/3927600742 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56376620c7c0 0x563766213d80 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f5e20013df0 tx=0x7f5e200547c0 comp rx=0 tx=0).stop 2024-09-22T08:36:48.580 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.568+0000 7f5e1e5ad640 1 -- 172.21.15.142:0/3927600742 reap_dead start 2024-09-22T08:36:48.580 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.568+0000 7f5e1e5ad640 1 -- 172.21.15.142:0/3927600742 reap_dead start 2024-09-22T08:36:48.580 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.568+0000 7f5e2b125800 1 -- 172.21.15.142:0/3927600742 shutdown_connections 2024-09-22T08:36:48.581 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.568+0000 7f5e2b125800 1 -- 172.21.15.142:0/3927600742 >> 172.21.15.142:0/3927600742 conn(0x563766208bc0 msgr2=0x563766206dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:48.581 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.568+0000 7f5e2b125800 1 -- 172.21.15.142:0/3927600742 shutdown_connections 2024-09-22T08:36:48.581 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.568+0000 7f5e2b125800 1 -- 172.21.15.142:0/3927600742 wait complete. 2024-09-22T08:36:48.581 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.569+0000 7f5e2b125800 1 -- 172.21.15.142:0/182044124 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f5d0003cfb0 msgr2=0x7f5d0003f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:48.581 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.569+0000 7f5e2b125800 1 --2- 172.21.15.142:0/182044124 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f5d0003cfb0 0x7f5d0003f470 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f5e18016910 tx=0x7f5e18052ac0 comp rx=0 tx=0).stop 2024-09-22T08:36:48.581 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.569+0000 7f5e2b125800 1 -- 172.21.15.142:0/182044124 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5637661ffca0 msgr2=0x5637662000c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:48.581 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.569+0000 7f5e2b125800 1 --2- 172.21.15.142:0/182044124 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5637661ffca0 0x5637662000c0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x5637661e5d30 tx=0x7f5e200167b0 comp rx=0 tx=0).stop 2024-09-22T08:36:48.581 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.569+0000 7f5e2b125800 1 -- 172.21.15.142:0/182044124 shutdown_connections 2024-09-22T08:36:48.581 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.569+0000 7f5e2b125800 1 --2- 172.21.15.142:0/182044124 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f5d0003cfb0 0x7f5d0003f470 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:48.581 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.569+0000 7f5e2b125800 1 --2- 172.21.15.142:0/182044124 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5637661ffca0 0x5637662000c0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:48.581 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.569+0000 7f5e2b125800 1 -- 172.21.15.142:0/182044124 >> 172.21.15.142:0/182044124 conn(0x5637661f4050 msgr2=0x5637661f4430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:48.581 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.569+0000 7f5e2b125800 1 -- 172.21.15.142:0/182044124 shutdown_connections 2024-09-22T08:36:48.581 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.569+0000 7f5e2b125800 1 -- 172.21.15.142:0/182044124 wait complete. 2024-09-22T08:36:48.581 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.569+0000 7f5e2b125800 1 -- 172.21.15.142:0/1937765211 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5637660f1be0 msgr2=0x5637661ec380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:48.582 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.569+0000 7f5e2b125800 1 --2- 172.21.15.142:0/1937765211 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5637660f1be0 0x5637661ec380 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:48.582 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.569+0000 7f5e2b125800 1 -- 172.21.15.142:0/1937765211 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5637661ee720 msgr2=0x5637661f0ba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:48.582 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.569+0000 7f5e2b125800 1 --2- 172.21.15.142:0/1937765211 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5637661ee720 0x5637661f0ba0 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:48.582 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.569+0000 7f5e2b125800 1 -- 172.21.15.142:0/1937765211 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f5d0c03cfb0 msgr2=0x7f5d0c03f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:48.582 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.569+0000 7f5e2b125800 1 --2- 172.21.15.142:0/1937765211 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f5d0c03cfb0 0x7f5d0c03f470 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f5e10057000 tx=0x7f5e10052000 comp rx=0 tx=0).stop 2024-09-22T08:36:48.582 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.569+0000 7f5e2b125800 1 -- 172.21.15.142:0/1937765211 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56376605ecf0 msgr2=0x5637661e4d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:48.582 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.569+0000 7f5e2b125800 1 --2- 172.21.15.142:0/1937765211 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56376605ecf0 0x5637661e4d30 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f5e180012b0 tx=0x7f5e18000ed0 comp rx=0 tx=0).stop 2024-09-22T08:36:48.582 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.569+0000 7f5e2b125800 1 -- 172.21.15.142:0/1937765211 shutdown_connections 2024-09-22T08:36:48.582 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.569+0000 7f5e2b125800 1 --2- 172.21.15.142:0/1937765211 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5637661ee720 0x5637661f0ba0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:48.582 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.569+0000 7f5e2b125800 1 --2- 172.21.15.142:0/1937765211 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5637660f1be0 0x5637661ec380 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:48.582 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.569+0000 7f5e2b125800 1 --2- 172.21.15.142:0/1937765211 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f5d0c03cfb0 0x7f5d0c03f470 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:48.582 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.569+0000 7f5e2b125800 1 --2- 172.21.15.142:0/1937765211 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56376605ecf0 0x5637661e4d30 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:48.582 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.569+0000 7f5e2b125800 1 -- 172.21.15.142:0/1937765211 >> 172.21.15.142:0/1937765211 conn(0x5637660e5bb0 msgr2=0x5637661de710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:48.583 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.569+0000 7f5e2b125800 1 -- 172.21.15.142:0/1937765211 shutdown_connections 2024-09-22T08:36:48.583 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.569+0000 7f5e2b125800 1 -- 172.21.15.142:0/1937765211 wait complete. 2024-09-22T08:36:48.583 INFO:teuthology.orchestra.run.smithi142.stdout:{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"d89f6f57-1007-47dd-9065-f486c7b01aec","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1","marker":"e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1","index_type":"Normal","index_generation":0,"num_shards":11,"reshard_status":"None","judge_reshard_lock_time":"0.000000","object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#3,6#3,7#1,8#3,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-09-22T08:36:48.092798Z","creation_time":"2024-09-22T08:36:45.359780Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{"rgw.main":{"size":0,"size_actual":0,"size_utilized":0,"size_kb":0,"size_kb_actual":0,"size_kb_utilized":0,"num_objects":0}},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"read_tracker":2} 2024-09-22T08:36:48.584 DEBUG:tasks.util.rgw: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': 'd89f6f57-1007-47dd-9065-f486c7b01aec', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': 'e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1', 'marker': 'e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'reshard_status': 'None', 'judge_reshard_lock_time': '0.000000', 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#3,6#3,7#1,8#3,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-22T08:36:48.092798Z', 'creation_time': '2024-09-22T08:36:45.359780Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'read_tracker': 2} 2024-09-22T08:36:48.584 INFO:tasks.util.rgw:rgwadmin: client.0 : ['log', 'list'] 2024-09-22T08:36:48.584 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'log', 'list'] 2024-09-22T08:36:48.584 DEBUG:teuthology.orchestra.run.smithi142:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph log list 2024-09-22T08:36:48.626 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:36:48.626 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:36:48.627 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.626+0000 7fdd6a72c800 1 Processor -- start 2024-09-22T08:36:48.628 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.626+0000 7fdd6a72c800 1 -- start start 2024-09-22T08:36:48.628 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.626+0000 7fdd6a72c800 1 --2- >> v2:172.21.15.31:3300/0 conn(0x563ff93a9ca0 0x563ff93af630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:48.628 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.626+0000 7fdd6a72c800 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x563ff9233a20 con 0x563ff93a89d0 2024-09-22T08:36:48.628 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.626+0000 7fdd6a72c800 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x563ff92337d0 con 0x563ff93a9ca0 2024-09-22T08:36:48.628 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.626+0000 7fdd65b44640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x563ff93a9ca0 0x563ff93af630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:48.628 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.626+0000 7fdd66345640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x563ff93a89d0 0x563ff93a9590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.142:44788/0 (socket says 172.21.15.142:44788) 2024-09-22T08:36:48.628 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.626+0000 7fdd66345640 1 -- 172.21.15.142:0/793146995 learned_addr learned my addr 172.21.15.142:0/793146995 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-09-22T08:36:48.628 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.626+0000 7fdd65b44640 1 --2- 172.21.15.142:0/793146995 >> v2:172.21.15.31:3300/0 conn(0x563ff93a9ca0 0x563ff93af630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:48862/0 (socket says 172.21.15.142:48862) 2024-09-22T08:36:48.628 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.627+0000 7fdd65b44640 1 -- 172.21.15.142:0/793146995 >> v1:172.21.15.31:6789/0 conn(0x563ff93a89d0 legacy=0x563ff93a9590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:48.628 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.627+0000 7fdd65b44640 1 -- 172.21.15.142:0/793146995 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x563ff93a90d0 con 0x563ff93a9ca0 2024-09-22T08:36:48.630 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.628+0000 7fdd65b44640 1 --2- 172.21.15.142:0/793146995 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563ff93a9ca0 0x563ff93af630 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fdd5c00a470 tx=0x7fdd5c045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b838ddd4d9f6e8ba server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:48.630 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.629+0000 7fdd65343640 1 -- 172.21.15.142:0/793146995 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdd5c053570 con 0x563ff93a9ca0 2024-09-22T08:36:48.630 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.629+0000 7fdd65343640 1 -- 172.21.15.142:0/793146995 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd5c058070 con 0x563ff93a9ca0 2024-09-22T08:36:48.630 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.629+0000 7fdd65343640 1 -- 172.21.15.142:0/793146995 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdd5c053880 con 0x563ff93a9ca0 2024-09-22T08:36:48.631 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.629+0000 7fdd6a72c800 1 -- 172.21.15.142:0/793146995 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563ff93a9ca0 msgr2=0x563ff93af630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:48.631 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.629+0000 7fdd6a72c800 1 --2- 172.21.15.142:0/793146995 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563ff93a9ca0 0x563ff93af630 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fdd5c00a470 tx=0x7fdd5c045a20 comp rx=0 tx=0).stop 2024-09-22T08:36:48.631 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.629+0000 7fdd6a72c800 1 -- 172.21.15.142:0/793146995 shutdown_connections 2024-09-22T08:36:48.631 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.629+0000 7fdd6a72c800 1 --2- 172.21.15.142:0/793146995 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563ff93a9ca0 0x563ff93af630 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:48.631 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.629+0000 7fdd6a72c800 1 -- 172.21.15.142:0/793146995 >> 172.21.15.142:0/793146995 conn(0x563ff93a3da0 msgr2=0x563ff93a6200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:48.631 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.629+0000 7fdd6a72c800 1 -- 172.21.15.142:0/793146995 shutdown_connections 2024-09-22T08:36:48.631 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.629+0000 7fdd6a72c800 1 -- 172.21.15.142:0/793146995 wait complete. 2024-09-22T08:36:48.644 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.643+0000 7fdd6a72c800 1 Processor -- start 2024-09-22T08:36:48.644 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.643+0000 7fdd6a72c800 1 -- start start 2024-09-22T08:36:48.644 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.643+0000 7fdd6a72c800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563ff93a89d0 0x563ff931e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:48.645 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.643+0000 7fdd6a72c800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x563ff9240dd0 con 0x563ff93a89d0 2024-09-22T08:36:48.645 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.643+0000 7fdd66345640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563ff93a89d0 0x563ff931e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:48.645 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.643+0000 7fdd66345640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563ff93a89d0 0x563ff931e2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:48866/0 (socket says 172.21.15.142:48866) 2024-09-22T08:36:48.645 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.643+0000 7fdd66345640 1 -- 172.21.15.142:0/3702428053 learned_addr learned my addr 172.21.15.142:0/3702428053 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:48.645 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.643+0000 7fdd66345640 1 -- 172.21.15.142:0/3702428053 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563ff931e890 con 0x563ff93a89d0 2024-09-22T08:36:48.645 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.644+0000 7fdd66345640 1 --2- 172.21.15.142:0/3702428053 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563ff93a89d0 0x563ff931e2a0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fdd58001e40 tx=0x7fdd58001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7585195b1474a618 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:48.647 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.644+0000 7fdc54608640 1 -- 172.21.15.142:0/3702428053 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdd58012020 con 0x563ff93a89d0 2024-09-22T08:36:48.647 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.644+0000 7fdc54608640 1 -- 172.21.15.142:0/3702428053 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd5800e5a0 con 0x563ff93a89d0 2024-09-22T08:36:48.647 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.644+0000 7fdc54608640 1 -- 172.21.15.142:0/3702428053 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdd5800e8a0 con 0x563ff93a89d0 2024-09-22T08:36:48.647 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.644+0000 7fdd6a72c800 1 -- 172.21.15.142:0/3702428053 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563ff93a89d0 msgr2=0x563ff931e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:48.648 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.644+0000 7fdd6a72c800 1 --2- 172.21.15.142:0/3702428053 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563ff93a89d0 0x563ff931e2a0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fdd58001e40 tx=0x7fdd58001e70 comp rx=0 tx=0).stop 2024-09-22T08:36:48.648 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.644+0000 7fdd6a72c800 1 -- 172.21.15.142:0/3702428053 shutdown_connections 2024-09-22T08:36:48.648 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.644+0000 7fdd6a72c800 1 --2- 172.21.15.142:0/3702428053 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563ff93a89d0 0x563ff931e2a0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:48.648 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.644+0000 7fdd6a72c800 1 -- 172.21.15.142:0/3702428053 >> 172.21.15.142:0/3702428053 conn(0x563ff93a3da0 msgr2=0x563ff94938f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:48.648 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.644+0000 7fdd6a72c800 1 -- 172.21.15.142:0/3702428053 shutdown_connections 2024-09-22T08:36:48.648 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.644+0000 7fdd6a72c800 1 -- 172.21.15.142:0/3702428053 wait complete. 2024-09-22T08:36:48.648 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.645+0000 7fdd6a72c800 1 Processor -- start 2024-09-22T08:36:48.648 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.645+0000 7fdd6a72c800 1 -- start start 2024-09-22T08:36:48.648 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.645+0000 7fdd6a72c800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563ff93a89d0 0x563ff94a1c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:48.648 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.645+0000 7fdd6a72c800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x563ff93afb70 con 0x563ff93a89d0 2024-09-22T08:36:48.648 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.645+0000 7fdd66345640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563ff93a89d0 0x563ff94a1c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:48.648 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.645+0000 7fdd66345640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563ff93a89d0 0x563ff94a1c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:48880/0 (socket says 172.21.15.142:48880) 2024-09-22T08:36:48.648 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.645+0000 7fdd66345640 1 -- 172.21.15.142:0/3868282500 learned_addr learned my addr 172.21.15.142:0/3868282500 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:48.648 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.645+0000 7fdd66345640 1 -- 172.21.15.142:0/3868282500 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563ff94a21b0 con 0x563ff93a89d0 2024-09-22T08:36:48.649 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.646+0000 7fdd66345640 1 --2- 172.21.15.142:0/3868282500 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563ff93a89d0 0x563ff94a1c50 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fdd5800c010 tx=0x7fdd58000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:48.649 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.646+0000 7fdc52e05640 1 -- 172.21.15.142:0/3868282500 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdd58012030 con 0x563ff93a89d0 2024-09-22T08:36:48.649 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.646+0000 7fdc52e05640 1 -- 172.21.15.142:0/3868282500 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd580014a0 con 0x563ff93a89d0 2024-09-22T08:36:48.649 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.646+0000 7fdc52e05640 1 -- 172.21.15.142:0/3868282500 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdd5801a7a0 con 0x563ff93a89d0 2024-09-22T08:36:48.649 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.646+0000 7fdd6a72c800 1 -- 172.21.15.142:0/3868282500 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563ff94a24a0 con 0x563ff93a89d0 2024-09-22T08:36:48.649 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.646+0000 7fdd6a72c800 1 -- 172.21.15.142:0/3868282500 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563ff94a3050 con 0x563ff93a89d0 2024-09-22T08:36:48.652 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.647+0000 7fdc52e05640 1 -- 172.21.15.142:0/3868282500 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fdd58015020 con 0x563ff93a89d0 2024-09-22T08:36:48.652 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.647+0000 7fdc52e05640 1 --2- 172.21.15.142:0/3868282500 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fdc4c03d000 0x7fdc4c03f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:48.652 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.647+0000 7fdc52e05640 1 -- 172.21.15.142:0/3868282500 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fdd58020030 con 0x563ff93a89d0 2024-09-22T08:36:48.652 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.647+0000 7fdd65b44640 1 --2- 172.21.15.142:0/3868282500 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fdc4c03d000 0x7fdc4c03f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:48.653 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.647+0000 7fdd6a72c800 1 --2- 172.21.15.142:0/3868282500 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x563ff93a9ca0 0x563ff94a92a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:48.653 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.647+0000 7fdd6a72c800 1 -- 172.21.15.142:0/3868282500 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563ff94a97e0 con 0x563ff93a9ca0 2024-09-22T08:36:48.653 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.647+0000 7fdd66b46640 1 --2- 172.21.15.142:0/3868282500 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x563ff93a9ca0 0x563ff94a92a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:48.653 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.647+0000 7fdd65b44640 1 --2- 172.21.15.142:0/3868282500 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fdc4c03d000 0x7fdc4c03f4c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fdd5c057000 tx=0x7fdd5c052000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:48.653 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.648+0000 7fdd66b46640 1 --2- 172.21.15.142:0/3868282500 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x563ff93a9ca0 0x563ff94a92a0 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:48.653 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.648+0000 7fdd66b46640 1 -- 172.21.15.142:0/3868282500 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdd6000a4d0 con 0x563ff93a9ca0 2024-09-22T08:36:48.653 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.648+0000 7fdd6a72c800 1 -- 172.21.15.142:0/3868282500 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563ff94a9b80 con 0x563ff93a9ca0 2024-09-22T08:36:48.653 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.648+0000 7fdd66b46640 1 -- 172.21.15.142:0/3868282500 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fdd6000a4d0 con 0x563ff93a9ca0 2024-09-22T08:36:48.653 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.648+0000 7fdd6a72c800 1 --2- 172.21.15.142:0/3868282500 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x563ff94ab640 0x563ff94adae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:48.653 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.648+0000 7fdd6a72c800 1 -- 172.21.15.142:0/3868282500 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:3 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563ff94ae270 con 0x563ff94ab640 2024-09-22T08:36:48.653 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.648+0000 7fdd66345640 1 --2- 172.21.15.142:0/3868282500 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x563ff94ab640 0x563ff94adae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:48.653 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.648+0000 7fdd66345640 1 --2- 172.21.15.142:0/3868282500 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x563ff94ab640 0x563ff94adae0 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:48.653 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.649+0000 7fdd66345640 1 -- 172.21.15.142:0/3868282500 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(3 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fdd580187b0 con 0x563ff94ab640 2024-09-22T08:36:48.654 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.649+0000 7fdd6a72c800 1 -- 172.21.15.142:0/3868282500 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563ff94aa3d0 con 0x563ff93a9ca0 2024-09-22T08:36:48.654 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.649+0000 7fdd66b46640 1 -- 172.21.15.142:0/3868282500 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fdd6000a4d0 con 0x563ff93a9ca0 2024-09-22T08:36:48.654 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.649+0000 7fdd6a72c800 1 -- 172.21.15.142:0/3868282500 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563ff94aa7b0 con 0x563ff94ab640 2024-09-22T08:36:48.654 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.649+0000 7fdd66345640 1 -- 172.21.15.142:0/3868282500 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(5 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fdd580187b0 con 0x563ff94ab640 2024-09-22T08:36:48.654 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.650+0000 7fdd6a72c800 1 Processor -- start 2024-09-22T08:36:48.654 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.650+0000 7fdd6a72c800 1 -- start start 2024-09-22T08:36:48.654 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.650+0000 7fdd6a72c800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563ff94bcc30 0x563ff94bd050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:48.654 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.650+0000 7fdd6a72c800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x563ff929fd50 con 0x563ff94bcc30 2024-09-22T08:36:48.654 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.650+0000 7fdd66b46640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563ff94bcc30 0x563ff94bd050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:48.654 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.650+0000 7fdd66b46640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563ff94bcc30 0x563ff94bd050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:48890/0 (socket says 172.21.15.142:48890) 2024-09-22T08:36:48.654 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.650+0000 7fdd66b46640 1 -- 172.21.15.142:0/901575465 learned_addr learned my addr 172.21.15.142:0/901575465 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:48.654 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.651+0000 7fdd66b46640 1 -- 172.21.15.142:0/901575465 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563ff94bd690 con 0x563ff94bcc30 2024-09-22T08:36:48.654 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.651+0000 7fdd66b46640 1 --2- 172.21.15.142:0/901575465 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563ff94bcc30 0x563ff94bd050 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x563ff94a2ae0 tx=0x7fdd600167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:48.655 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.651+0000 7fdc4bfff640 1 -- 172.21.15.142:0/901575465 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdd60013640 con 0x563ff94bcc30 2024-09-22T08:36:48.655 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.651+0000 7fdc4bfff640 1 -- 172.21.15.142:0/901575465 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd600137e0 con 0x563ff94bcc30 2024-09-22T08:36:48.655 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.651+0000 7fdd6a72c800 1 -- 172.21.15.142:0/901575465 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563ff94bdec0 con 0x563ff94bcc30 2024-09-22T08:36:48.655 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.651+0000 7fdc4bfff640 1 -- 172.21.15.142:0/901575465 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdd60013ae0 con 0x563ff94bcc30 2024-09-22T08:36:48.655 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.651+0000 7fdd6a72c800 1 -- 172.21.15.142:0/901575465 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563ff94be460 con 0x563ff94bcc30 2024-09-22T08:36:48.663 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.652+0000 7fdc4bfff640 1 -- 172.21.15.142:0/901575465 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fdd60011040 con 0x563ff94bcc30 2024-09-22T08:36:48.663 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.652+0000 7fdc4bfff640 1 --2- 172.21.15.142:0/901575465 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fdc4003cfb0 0x7fdc4003f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:48.663 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.652+0000 7fdc4bfff640 1 -- 172.21.15.142:0/901575465 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fdd6000e040 con 0x563ff94bcc30 2024-09-22T08:36:48.663 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.652+0000 7fdd66345640 1 --2- 172.21.15.142:0/901575465 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fdc4003cfb0 0x7fdc4003f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:48.663 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.652+0000 7fdd6a72c800 1 Processor -- start 2024-09-22T08:36:48.663 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.652+0000 7fdd6a72c800 1 -- start start 2024-09-22T08:36:48.663 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.652+0000 7fdd66345640 1 --2- 172.21.15.142:0/901575465 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fdc4003cfb0 0x7fdc4003f470 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fdd5800c720 tx=0x7fdd58052920 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:48.663 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.652+0000 7fdd6a72c800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563ff94c9750 0x563ff94c9b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:48.663 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.652+0000 7fdd6a72c800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x563ff931cce0 con 0x563ff94c9750 2024-09-22T08:36:48.663 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.653+0000 7fdd66b46640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563ff94c9750 0x563ff94c9b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:48.664 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.653+0000 7fdd66b46640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563ff94c9750 0x563ff94c9b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:48898/0 (socket says 172.21.15.142:48898) 2024-09-22T08:36:48.664 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.653+0000 7fdd66b46640 1 -- 172.21.15.142:0/3012497282 learned_addr learned my addr 172.21.15.142:0/3012497282 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:48.664 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.653+0000 7fdd66b46640 1 -- 172.21.15.142:0/3012497282 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563ff94ca140 con 0x563ff94c9750 2024-09-22T08:36:48.664 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.653+0000 7fdd66b46640 1 --2- 172.21.15.142:0/3012497282 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563ff94c9750 0x563ff94c9b50 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fdd60020000 tx=0x7fdd6001f400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc9652640fa05f40 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:48.664 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.653+0000 7fdc49ffb640 1 -- 172.21.15.142:0/3012497282 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdd60021cf0 con 0x563ff94c9750 2024-09-22T08:36:48.664 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.653+0000 7fdc49ffb640 1 -- 172.21.15.142:0/3012497282 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd60052070 con 0x563ff94c9750 2024-09-22T08:36:48.664 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.653+0000 7fdc49ffb640 1 -- 172.21.15.142:0/3012497282 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdd60021960 con 0x563ff94c9750 2024-09-22T08:36:48.664 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.654+0000 7fdd6a72c800 1 -- 172.21.15.142:0/3012497282 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563ff94c9750 msgr2=0x563ff94c9b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:48.664 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.654+0000 7fdd6a72c800 1 --2- 172.21.15.142:0/3012497282 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563ff94c9750 0x563ff94c9b50 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fdd60020000 tx=0x7fdd6001f400 comp rx=0 tx=0).stop 2024-09-22T08:36:48.664 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.654+0000 7fdd6a72c800 1 -- 172.21.15.142:0/3012497282 shutdown_connections 2024-09-22T08:36:48.664 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.654+0000 7fdd6a72c800 1 --2- 172.21.15.142:0/3012497282 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563ff94c9750 0x563ff94c9b50 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:48.664 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.654+0000 7fdd6a72c800 1 -- 172.21.15.142:0/3012497282 >> 172.21.15.142:0/3012497282 conn(0x563ff94c5b50 msgr2=0x563ff94c3d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:48.664 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.654+0000 7fdd6a72c800 1 -- 172.21.15.142:0/3012497282 shutdown_connections 2024-09-22T08:36:48.665 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.654+0000 7fdd6a72c800 1 -- 172.21.15.142:0/3012497282 wait complete. 2024-09-22T08:36:48.665 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.654+0000 7fdd6a72c800 1 Processor -- start 2024-09-22T08:36:48.665 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.654+0000 7fdd6a72c800 1 -- start start 2024-09-22T08:36:48.665 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.654+0000 7fdd6a72c800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563ff94c9750 0x563ff94d0d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:48.665 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.654+0000 7fdd6a72c800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x563ff94ca760 con 0x563ff94c9750 2024-09-22T08:36:48.665 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.654+0000 7fdd66b46640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563ff94c9750 0x563ff94d0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:48.665 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.654+0000 7fdd66b46640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563ff94c9750 0x563ff94d0d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:48900/0 (socket says 172.21.15.142:48900) 2024-09-22T08:36:48.665 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.654+0000 7fdd66b46640 1 -- 172.21.15.142:0/1763553621 learned_addr learned my addr 172.21.15.142:0/1763553621 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:48.665 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.655+0000 7fdd66b46640 1 -- 172.21.15.142:0/1763553621 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563ff94d12a0 con 0x563ff94c9750 2024-09-22T08:36:48.665 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.655+0000 7fdd66b46640 1 --2- 172.21.15.142:0/1763553621 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563ff94c9750 0x563ff94d0d40 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fdd60054800 tx=0x7fdd60054860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:48.665 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.655+0000 7fdc37fff640 1 -- 172.21.15.142:0/1763553621 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdd60020de0 con 0x563ff94c9750 2024-09-22T08:36:48.665 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.655+0000 7fdc37fff640 1 -- 172.21.15.142:0/1763553621 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd6001fa90 con 0x563ff94c9750 2024-09-22T08:36:48.665 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.655+0000 7fdd6a72c800 1 -- 172.21.15.142:0/1763553621 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563ff94d1530 con 0x563ff94c9750 2024-09-22T08:36:48.665 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.655+0000 7fdc37fff640 1 -- 172.21.15.142:0/1763553621 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdd6001fd90 con 0x563ff94c9750 2024-09-22T08:36:48.666 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.655+0000 7fdd6a72c800 1 -- 172.21.15.142:0/1763553621 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563ff94d1eb0 con 0x563ff94c9750 2024-09-22T08:36:48.666 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.656+0000 7fdc37fff640 1 -- 172.21.15.142:0/1763553621 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fdd6001f500 con 0x563ff94c9750 2024-09-22T08:36:48.666 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.656+0000 7fdc37fff640 1 --2- 172.21.15.142:0/1763553621 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fdc3003d000 0x7fdc3003f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:48.666 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.656+0000 7fdc37fff640 1 -- 172.21.15.142:0/1763553621 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fdd6004d050 con 0x563ff94c9750 2024-09-22T08:36:48.666 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.656+0000 7fdd66345640 1 --2- 172.21.15.142:0/1763553621 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fdc3003d000 0x7fdc3003f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:48.666 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.657+0000 7fdd6a72c800 20 rados->read ofs=0 len=0 2024-09-22T08:36:48.666 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.657+0000 7fdd6a72c800 1 --2- 172.21.15.142:0/1763553621 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x563ff94dc620 0x563ff94deae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:48.666 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.657+0000 7fdd6a72c800 1 -- 172.21.15.142:0/1763553621 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563ff94df230 con 0x563ff94dc620 2024-09-22T08:36:48.666 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.657+0000 7fdd66345640 1 --2- 172.21.15.142:0/1763553621 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fdc3003d000 0x7fdc3003f4c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fdd5801af70 tx=0x7fdd58046000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:48.666 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.657+0000 7fdd65b44640 1 --2- 172.21.15.142:0/1763553621 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x563ff94dc620 0x563ff94deae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:48.666 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.657+0000 7fdd65b44640 1 --2- 172.21.15.142:0/1763553621 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x563ff94dc620 0x563ff94deae0 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:48.666 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.657+0000 7fdd65b44640 1 -- 172.21.15.142:0/1763553621 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdd5c051070 con 0x563ff94dc620 2024-09-22T08:36:48.667 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.657+0000 7fdd6a72c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:48.667 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.657+0000 7fdd6a72c800 20 realm 2024-09-22T08:36:48.667 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.657+0000 7fdd6a72c800 20 rados->read ofs=0 len=0 2024-09-22T08:36:48.667 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.657+0000 7fdd6a72c800 1 -- 172.21.15.142:0/1763553621 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563ff94df660 con 0x563ff94dc620 2024-09-22T08:36:48.667 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.657+0000 7fdd65b44640 1 -- 172.21.15.142:0/1763553621 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdd5c051070 con 0x563ff94dc620 2024-09-22T08:36:48.667 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.657+0000 7fdd6a72c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:48.667 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.657+0000 7fdd6a72c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:36:48.667 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.657+0000 7fdd6a72c800 20 rados->read ofs=0 len=0 2024-09-22T08:36:48.667 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.657+0000 7fdd6a72c800 1 -- 172.21.15.142:0/1763553621 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563ff94dff30 con 0x563ff94dc620 2024-09-22T08:36:48.667 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.658+0000 7fdd65b44640 1 -- 172.21.15.142:0/1763553621 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdd5c051070 con 0x563ff94dc620 2024-09-22T08:36:48.667 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.658+0000 7fdd6a72c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:48.667 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.658+0000 7fdd6a72c800 20 rados->read ofs=0 len=0 2024-09-22T08:36:48.667 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.658+0000 7fdd6a72c800 1 -- 172.21.15.142:0/1763553621 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563ff94e02d0 con 0x563ff94dc620 2024-09-22T08:36:48.667 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.658+0000 7fdd65b44640 1 -- 172.21.15.142:0/1763553621 <== osd.1 v2:172.21.15.142:6816/3192108003 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fdd5c051070 con 0x563ff94dc620 2024-09-22T08:36:48.668 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.658+0000 7fdd6a72c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:36:48.668 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.658+0000 7fdd6a72c800 20 rados->read ofs=0 len=0 2024-09-22T08:36:48.668 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.658+0000 7fdd6a72c800 1 --2- 172.21.15.142:0/1763553621 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x563ff94e1030 0x563ff94e3420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:48.668 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.658+0000 7fdd6a72c800 1 -- 172.21.15.142:0/1763553621 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563ff94e3960 con 0x563ff94e1030 2024-09-22T08:36:48.668 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.658+0000 7fdd66b46640 1 --2- 172.21.15.142:0/1763553621 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x563ff94e1030 0x563ff94e3420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:48.668 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.658+0000 7fdd66b46640 1 --2- 172.21.15.142:0/1763553621 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x563ff94e1030 0x563ff94e3420 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:48.668 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.659+0000 7fdd66b46640 1 -- 172.21.15.142:0/1763553621 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(5 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fdd6000a4d0 con 0x563ff94e1030 2024-09-22T08:36:48.668 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.659+0000 7fdd6a72c800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:36:48.668 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.659+0000 7fdd6a72c800 20 searching for the correct realm 2024-09-22T08:36:48.668 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.659+0000 7fdd6a72c800 1 -- 172.21.15.142:0/1763553621 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563ff94e52d0 con 0x563ff94e1030 2024-09-22T08:36:48.668 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.659+0000 7fdd66b46640 1 -- 172.21.15.142:0/1763553621 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd6000a4d0 con 0x563ff94e1030 2024-09-22T08:36:48.668 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.659+0000 7fdd66b46640 1 --2- 172.21.15.142:0/1763553621 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7fdd6003c3a0 0x7fdd6003c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:48.668 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.659+0000 7fdd66b46640 1 -- 172.21.15.142:0/1763553621 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563ff94e52d0 con 0x7fdd6003c3a0 2024-09-22T08:36:48.669 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.659+0000 7fdd66345640 1 --2- 172.21.15.142:0/1763553621 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7fdd6003c3a0 0x7fdd6003c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:48.669 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.659+0000 7fdd66345640 1 --2- 172.21.15.142:0/1763553621 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7fdd6003c3a0 0x7fdd6003c820 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:48.669 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.659+0000 7fdd66345640 1 -- 172.21.15.142:0/1763553621 <== osd.2 v2:172.21.15.142:6808/279438927 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd580187b0 con 0x7fdd6003c3a0 2024-09-22T08:36:48.669 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.659+0000 7fdd66345640 1 --2- 172.21.15.142:0/1763553621 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7fdd58017050 0x7fdd58042130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:48.669 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.659+0000 7fdd66345640 1 -- 172.21.15.142:0/1763553621 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563ff94e52d0 con 0x7fdd58017050 2024-09-22T08:36:48.669 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.660+0000 7fdd65b44640 1 --2- 172.21.15.142:0/1763553621 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7fdd58017050 0x7fdd58042130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:48.669 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.660+0000 7fdd65b44640 1 --2- 172.21.15.142:0/1763553621 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7fdd58017050 0x7fdd58042130 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:48.669 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.660+0000 7fdd65b44640 1 -- 172.21.15.142:0/1763553621 <== osd.0 v2:172.21.15.31:6800/168281188 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd5c051070 con 0x7fdd58017050 2024-09-22T08:36:48.669 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.660+0000 7fdd65b44640 1 -- 172.21.15.142:0/1763553621 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563ff94e52d0 con 0x563ff94dc620 2024-09-22T08:36:48.669 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.660+0000 7fdd65b44640 1 -- 172.21.15.142:0/1763553621 <== osd.1 v2:172.21.15.142:6816/3192108003 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd5c051070 con 0x563ff94dc620 2024-09-22T08:36:48.669 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.660+0000 7fdd65b44640 1 -- 172.21.15.142:0/1763553621 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563ff94e52d0 con 0x563ff94dc620 2024-09-22T08:36:48.669 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.661+0000 7fdd65b44640 1 -- 172.21.15.142:0/1763553621 <== osd.1 v2:172.21.15.142:6816/3192108003 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd5c051070 con 0x563ff94dc620 2024-09-22T08:36:48.669 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.661+0000 7fdd65b44640 1 -- 172.21.15.142:0/1763553621 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563ff94e52d0 con 0x7fdd58017050 2024-09-22T08:36:48.670 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.661+0000 7fdd65b44640 1 -- 172.21.15.142:0/1763553621 <== osd.0 v2:172.21.15.31:6800/168281188 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd5c051070 con 0x7fdd58017050 2024-09-22T08:36:48.670 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.661+0000 7fdd65b44640 1 -- 172.21.15.142:0/1763553621 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563ff94e52d0 con 0x7fdd58017050 2024-09-22T08:36:48.670 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.661+0000 7fdd65b44640 1 -- 172.21.15.142:0/1763553621 <== osd.0 v2:172.21.15.31:6800/168281188 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd5c051070 con 0x7fdd58017050 2024-09-22T08:36:48.670 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.661+0000 7fdd65b44640 1 -- 172.21.15.142:0/1763553621 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563ff94e52d0 con 0x7fdd6003c3a0 2024-09-22T08:36:48.670 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.661+0000 7fdd66345640 1 -- 172.21.15.142:0/1763553621 <== osd.2 v2:172.21.15.142:6808/279438927 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd580187b0 con 0x7fdd6003c3a0 2024-09-22T08:36:48.670 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.661+0000 7fdd66345640 1 -- 172.21.15.142:0/1763553621 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563ff94e52d0 con 0x563ff94e1030 2024-09-22T08:36:48.670 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.662+0000 7fdd66b46640 1 -- 172.21.15.142:0/1763553621 <== osd.3 v2:172.21.15.142:6800/1064901393 3 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd6000a4d0 con 0x563ff94e1030 2024-09-22T08:36:48.670 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.662+0000 7fdd66b46640 1 -- 172.21.15.142:0/1763553621 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563ff94e52d0 con 0x563ff94dc620 2024-09-22T08:36:48.670 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.662+0000 7fdd65b44640 1 -- 172.21.15.142:0/1763553621 <== osd.1 v2:172.21.15.142:6816/3192108003 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd5c051070 con 0x563ff94dc620 2024-09-22T08:36:48.670 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.662+0000 7fdd65b44640 1 -- 172.21.15.142:0/1763553621 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563ff94e52d0 con 0x7fdd58017050 2024-09-22T08:36:48.678 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.662+0000 7fdd65b44640 1 -- 172.21.15.142:0/1763553621 <== osd.0 v2:172.21.15.31:6800/168281188 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd5c051070 con 0x7fdd58017050 2024-09-22T08:36:48.678 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.662+0000 7fdd65b44640 1 -- 172.21.15.142:0/1763553621 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563ff94e52d0 con 0x563ff94dc620 2024-09-22T08:36:48.678 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.662+0000 7fdd65b44640 1 -- 172.21.15.142:0/1763553621 <== osd.1 v2:172.21.15.142:6816/3192108003 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd5c051070 con 0x563ff94dc620 2024-09-22T08:36:48.679 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.662+0000 7fdd65b44640 1 -- 172.21.15.142:0/1763553621 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563ff94e52d0 con 0x7fdd6003c3a0 2024-09-22T08:36:48.679 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.663+0000 7fdd66345640 1 -- 172.21.15.142:0/1763553621 <== osd.2 v2:172.21.15.142:6808/279438927 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fdd580187b0 con 0x7fdd6003c3a0 2024-09-22T08:36:48.679 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.663+0000 7fdd66345640 1 -- 172.21.15.142:0/1763553621 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563ff94e52d0 con 0x563ff94e1030 2024-09-22T08:36:48.679 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.663+0000 7fdd66b46640 1 -- 172.21.15.142:0/1763553621 <== osd.3 v2:172.21.15.142:6800/1064901393 4 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd6000a4d0 con 0x563ff94e1030 2024-09-22T08:36:48.679 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.663+0000 7fdd66b46640 1 -- 172.21.15.142:0/1763553621 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563ff94e52d0 con 0x563ff94e1030 2024-09-22T08:36:48.679 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.663+0000 7fdd66b46640 1 -- 172.21.15.142:0/1763553621 <== osd.3 v2:172.21.15.142:6800/1064901393 5 ==== osd_op_reply(20 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fdd6000a4d0 con 0x563ff94e1030 2024-09-22T08:36:48.679 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.663+0000 7fdd66b46640 1 -- 172.21.15.142:0/1763553621 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563ff94e52d0 con 0x7fdd58017050 2024-09-22T08:36:48.679 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.663+0000 7fdd65b44640 1 -- 172.21.15.142:0/1763553621 <== osd.0 v2:172.21.15.31:6800/168281188 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd5c051070 con 0x7fdd58017050 2024-09-22T08:36:48.679 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.663+0000 7fdd65b44640 1 -- 172.21.15.142:0/1763553621 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563ff94e52d0 con 0x563ff94e1030 2024-09-22T08:36:48.679 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.663+0000 7fdd66b46640 1 -- 172.21.15.142:0/1763553621 <== osd.3 v2:172.21.15.142:6800/1064901393 6 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd6000a4d0 con 0x563ff94e1030 2024-09-22T08:36:48.679 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.664+0000 7fdd66b46640 1 -- 172.21.15.142:0/1763553621 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563ff94e52d0 con 0x563ff94e1030 2024-09-22T08:36:48.679 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.664+0000 7fdd66b46640 1 -- 172.21.15.142:0/1763553621 <== osd.3 v2:172.21.15.142:6800/1064901393 7 ==== osd_op_reply(23 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fdd6000a4d0 con 0x563ff94e1030 2024-09-22T08:36:48.679 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.664+0000 7fdd66b46640 1 -- 172.21.15.142:0/1763553621 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563ff94e52d0 con 0x563ff94dc620 2024-09-22T08:36:48.679 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.664+0000 7fdd65b44640 1 -- 172.21.15.142:0/1763553621 <== osd.1 v2:172.21.15.142:6816/3192108003 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd5c051070 con 0x563ff94dc620 2024-09-22T08:36:48.680 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.664+0000 7fdd65b44640 1 -- 172.21.15.142:0/1763553621 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563ff94e52d0 con 0x563ff94dc620 2024-09-22T08:36:48.680 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.664+0000 7fdd65b44640 1 -- 172.21.15.142:0/1763553621 <== osd.1 v2:172.21.15.142:6816/3192108003 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fdd5c051070 con 0x563ff94dc620 2024-09-22T08:36:48.680 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.664+0000 7fdd65b44640 1 -- 172.21.15.142:0/1763553621 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563ff94e52d0 con 0x7fdd58017050 2024-09-22T08:36:48.680 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.664+0000 7fdd65b44640 1 -- 172.21.15.142:0/1763553621 <== osd.0 v2:172.21.15.31:6800/168281188 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd5c051070 con 0x7fdd58017050 2024-09-22T08:36:48.680 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.664+0000 7fdd65b44640 1 -- 172.21.15.142:0/1763553621 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563ff94e52d0 con 0x563ff94e1030 2024-09-22T08:36:48.680 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.665+0000 7fdd66b46640 1 -- 172.21.15.142:0/1763553621 <== osd.3 v2:172.21.15.142:6800/1064901393 8 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd6000a4d0 con 0x563ff94e1030 2024-09-22T08:36:48.680 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.665+0000 7fdd66b46640 1 -- 172.21.15.142:0/1763553621 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563ff94e52d0 con 0x7fdd6003c3a0 2024-09-22T08:36:48.680 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.665+0000 7fdd66345640 1 -- 172.21.15.142:0/1763553621 <== osd.2 v2:172.21.15.142:6808/279438927 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd580187b0 con 0x7fdd6003c3a0 2024-09-22T08:36:48.680 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.665+0000 7fdd66345640 1 -- 172.21.15.142:0/1763553621 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563ff94e52d0 con 0x563ff94dc620 2024-09-22T08:36:48.680 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.665+0000 7fdd65b44640 1 -- 172.21.15.142:0/1763553621 <== osd.1 v2:172.21.15.142:6816/3192108003 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd5c051070 con 0x563ff94dc620 2024-09-22T08:36:48.680 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.665+0000 7fdd65b44640 1 -- 172.21.15.142:0/1763553621 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563ff94e52d0 con 0x7fdd58017050 2024-09-22T08:36:48.680 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.665+0000 7fdd65b44640 1 -- 172.21.15.142:0/1763553621 <== osd.0 v2:172.21.15.31:6800/168281188 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd5c051070 con 0x7fdd58017050 2024-09-22T08:36:48.680 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.665+0000 7fdd65b44640 1 -- 172.21.15.142:0/1763553621 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563ff94e52d0 con 0x563ff94e1030 2024-09-22T08:36:48.680 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.666+0000 7fdd66b46640 1 -- 172.21.15.142:0/1763553621 <== osd.3 v2:172.21.15.142:6800/1064901393 9 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd6000a4d0 con 0x563ff94e1030 2024-09-22T08:36:48.681 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.666+0000 7fdd66b46640 1 -- 172.21.15.142:0/1763553621 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563ff94e52d0 con 0x7fdd58017050 2024-09-22T08:36:48.681 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.666+0000 7fdd65b44640 1 -- 172.21.15.142:0/1763553621 <== osd.0 v2:172.21.15.31:6800/168281188 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd5c051070 con 0x7fdd58017050 2024-09-22T08:36:48.681 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.666+0000 7fdd65b44640 1 -- 172.21.15.142:0/1763553621 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563ff94e52d0 con 0x7fdd6003c3a0 2024-09-22T08:36:48.681 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.666+0000 7fdd66345640 1 -- 172.21.15.142:0/1763553621 <== osd.2 v2:172.21.15.142:6808/279438927 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd580187b0 con 0x7fdd6003c3a0 2024-09-22T08:36:48.681 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.666+0000 7fdd66345640 1 -- 172.21.15.142:0/1763553621 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563ff94e52d0 con 0x563ff94e1030 2024-09-22T08:36:48.681 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.666+0000 7fdd66b46640 1 -- 172.21.15.142:0/1763553621 <== osd.3 v2:172.21.15.142:6800/1064901393 10 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd6000a4d0 con 0x563ff94e1030 2024-09-22T08:36:48.681 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.666+0000 7fdd66b46640 1 -- 172.21.15.142:0/1763553621 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563ff94e52d0 con 0x7fdd58017050 2024-09-22T08:36:48.681 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.667+0000 7fdd65b44640 1 -- 172.21.15.142:0/1763553621 <== osd.0 v2:172.21.15.31:6800/168281188 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd5c051070 con 0x7fdd58017050 2024-09-22T08:36:48.681 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.667+0000 7fdd65b44640 1 -- 172.21.15.142:0/1763553621 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563ff94e52d0 con 0x563ff94dc620 2024-09-22T08:36:48.681 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.667+0000 7fdd65b44640 1 -- 172.21.15.142:0/1763553621 <== osd.1 v2:172.21.15.142:6816/3192108003 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fdd5c051070 con 0x563ff94dc620 2024-09-22T08:36:48.681 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.667+0000 7fdd65b44640 1 -- 172.21.15.142:0/1763553621 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563ff94e52d0 con 0x7fdd6003c3a0 2024-09-22T08:36:48.681 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.667+0000 7fdd66345640 1 -- 172.21.15.142:0/1763553621 <== osd.2 v2:172.21.15.142:6808/279438927 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd580187b0 con 0x7fdd6003c3a0 2024-09-22T08:36:48.681 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.667+0000 7fdd6a72c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:36:48.681 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.667+0000 7fdd6a72c800 20 RGWRados::pool_iterate: got zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec 2024-09-22T08:36:48.682 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.667+0000 7fdd6a72c800 20 RGWRados::pool_iterate: got zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f 2024-09-22T08:36:48.682 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.667+0000 7fdd6a72c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:36:48.682 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.667+0000 7fdd6a72c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:36:48.682 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.667+0000 7fdd6a72c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:36:48.682 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.667+0000 7fdd6a72c800 20 rados->read ofs=0 len=0 2024-09-22T08:36:48.682 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.667+0000 7fdd6a72c800 1 -- 172.21.15.142:0/1763553621 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563ff94e43d0 con 0x563ff94dc620 2024-09-22T08:36:48.682 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.667+0000 7fdd65b44640 1 -- 172.21.15.142:0/1763553621 <== osd.1 v2:172.21.15.142:6816/3192108003 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdd5c051070 con 0x563ff94dc620 2024-09-22T08:36:48.682 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.667+0000 7fdd6a72c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:48.682 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.667+0000 7fdd6a72c800 20 rados->read ofs=0 len=0 2024-09-22T08:36:48.682 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.667+0000 7fdd6a72c800 1 -- 172.21.15.142:0/1763553621 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563ff94e4c70 con 0x563ff94dc620 2024-09-22T08:36:48.682 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.668+0000 7fdd65b44640 1 -- 172.21.15.142:0/1763553621 <== osd.1 v2:172.21.15.142:6816/3192108003 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fdd5c051070 con 0x563ff94dc620 2024-09-22T08:36:48.682 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.668+0000 7fdd6a72c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:36:48.682 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.668+0000 7fdd6a72c800 20 rados->read ofs=0 len=0 2024-09-22T08:36:48.682 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.668+0000 7fdd6a72c800 1 -- 172.21.15.142:0/1763553621 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:40 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563ff94e4010 con 0x563ff94e1030 2024-09-22T08:36:48.683 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.668+0000 7fdd66b46640 1 -- 172.21.15.142:0/1763553621 <== osd.3 v2:172.21.15.142:6800/1064901393 11 ==== osd_op_reply(40 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fdd6000a4d0 con 0x563ff94e1030 2024-09-22T08:36:48.683 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.668+0000 7fdd6a72c800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:36:48.683 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.668+0000 7fdd6a72c800 20 zone default found 2024-09-22T08:36:48.683 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.668+0000 7fdd6a72c800 4 Realm: () 2024-09-22T08:36:48.683 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.668+0000 7fdd6a72c800 4 ZoneGroup: default (d89f6f57-1007-47dd-9065-f486c7b01aec) 2024-09-22T08:36:48.683 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.668+0000 7fdd6a72c800 4 Zone: default (e239248c-0bee-4e41-803a-24b288d3eb8f) 2024-09-22T08:36:48.683 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.668+0000 7fdd6a72c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:36:48.683 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.668+0000 7fdd6a72c800 20 zonegroup default 2024-09-22T08:36:48.683 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.668+0000 7fdd6a72c800 20 rados->read ofs=0 len=0 2024-09-22T08:36:48.683 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.668+0000 7fdd6a72c800 1 -- 172.21.15.142:0/1763553621 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563ff94e5c50 con 0x7fdd58017050 2024-09-22T08:36:48.683 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.668+0000 7fdd65b44640 1 -- 172.21.15.142:0/1763553621 <== osd.0 v2:172.21.15.31:6800/168281188 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fdd5c051070 con 0x7fdd58017050 2024-09-22T08:36:48.683 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.668+0000 7fdd6a72c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:48.684 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.668+0000 7fdd6a72c800 20 rados->read ofs=0 len=0 2024-09-22T08:36:48.684 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.668+0000 7fdd6a72c800 1 -- 172.21.15.142:0/1763553621 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563ff94e7ae0 con 0x563ff94e1030 2024-09-22T08:36:48.684 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.668+0000 7fdd66b46640 1 -- 172.21.15.142:0/1763553621 <== osd.3 v2:172.21.15.142:6800/1064901393 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fdd6000a4d0 con 0x563ff94e1030 2024-09-22T08:36:48.684 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.668+0000 7fdd6a72c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:48.684 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.668+0000 7fdd6a72c800 20 rados->read ofs=0 len=0 2024-09-22T08:36:48.684 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.668+0000 7fdd6a72c800 1 -- 172.21.15.142:0/1763553621 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563ff94e7f70 con 0x563ff94e1030 2024-09-22T08:36:48.684 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.669+0000 7fdd66b46640 1 -- 172.21.15.142:0/1763553621 <== osd.3 v2:172.21.15.142:6800/1064901393 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fdd6000a4d0 con 0x563ff94e1030 2024-09-22T08:36:48.684 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.669+0000 7fdd6a72c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:48.684 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.669+0000 7fdd6a72c800 20 started sync module instance, tier type = 2024-09-22T08:36:48.684 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.669+0000 7fdd6a72c800 20 started zone id=e239248c-0bee-4e41-803a-24b288d3eb8f (name=default) with tier type = 2024-09-22T08:36:48.684 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.669+0000 7fdd6a72c800 1 -- 172.21.15.142:0/1763553621 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563ff94e6e80 con 0x7fdd6003c3a0 2024-09-22T08:36:48.684 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.670+0000 7fdd66345640 1 -- 172.21.15.142:0/1763553621 <== osd.2 v2:172.21.15.142:6808/279438927 7 ==== osd_op_reply(44 notify.0 [create] v30'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd580187b0 con 0x7fdd6003c3a0 2024-09-22T08:36:48.685 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.670+0000 7fdd6a72c800 1 -- 172.21.15.142:0/1763553621 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94832765596320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563ff94e6ae0 con 0x7fdd6003c3a0 2024-09-22T08:36:48.685 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.670+0000 7fdd6a72c800 1 -- 172.21.15.142:0/1763553621 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563ff94e8ea0 con 0x563ff94dc620 2024-09-22T08:36:48.685 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.671+0000 7fdd66345640 1 -- 172.21.15.142:0/1763553621 <== osd.2 v2:172.21.15.142:6808/279438927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94832765596320] v30'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd580187b0 con 0x7fdd6003c3a0 2024-09-22T08:36:48.685 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.671+0000 7fdd65b44640 1 -- 172.21.15.142:0/1763553621 <== osd.1 v2:172.21.15.142:6816/3192108003 15 ==== osd_op_reply(46 notify.1 [create] v30'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd5c051070 con 0x563ff94dc620 2024-09-22T08:36:48.685 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.671+0000 7fdd6a72c800 1 -- 172.21.15.142:0/1763553621 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94832765602288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563ff94e8e10 con 0x563ff94dc620 2024-09-22T08:36:48.685 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.671+0000 7fdd6a72c800 1 -- 172.21.15.142:0/1763553621 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563ff94e9d60 con 0x563ff94e1030 2024-09-22T08:36:48.685 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.672+0000 7fdd65b44640 1 -- 172.21.15.142:0/1763553621 <== osd.1 v2:172.21.15.142:6816/3192108003 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94832765602288] v30'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd5c051070 con 0x563ff94dc620 2024-09-22T08:36:48.685 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.672+0000 7fdd66b46640 1 -- 172.21.15.142:0/1763553621 <== osd.3 v2:172.21.15.142:6800/1064901393 14 ==== osd_op_reply(48 notify.2 [create] v30'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd6000a4d0 con 0x563ff94e1030 2024-09-22T08:36:48.685 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.672+0000 7fdd6a72c800 1 -- 172.21.15.142:0/1763553621 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94832765604496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563ff94e9d60 con 0x563ff94e1030 2024-09-22T08:36:48.685 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.672+0000 7fdd6a72c800 1 -- 172.21.15.142:0/1763553621 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563ff94ea7f0 con 0x7fdd6003c3a0 2024-09-22T08:36:48.685 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.673+0000 7fdd66345640 1 -- 172.21.15.142:0/1763553621 <== osd.2 v2:172.21.15.142:6808/279438927 9 ==== osd_op_reply(50 notify.3 [create] v30'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd580187b0 con 0x7fdd6003c3a0 2024-09-22T08:36:48.685 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.673+0000 7fdd66b46640 1 -- 172.21.15.142:0/1763553621 <== osd.3 v2:172.21.15.142:6800/1064901393 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94832765604496] v30'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd6000a4d0 con 0x563ff94e1030 2024-09-22T08:36:48.686 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.673+0000 7fdd6a72c800 1 -- 172.21.15.142:0/1763553621 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94832765608640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563ff94eabe0 con 0x7fdd6003c3a0 2024-09-22T08:36:48.686 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.673+0000 7fdd6a72c800 1 -- 172.21.15.142:0/1763553621 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563ff94eb640 con 0x563ff94dc620 2024-09-22T08:36:48.686 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.674+0000 7fdd65b44640 1 -- 172.21.15.142:0/1763553621 <== osd.1 v2:172.21.15.142:6816/3192108003 17 ==== osd_op_reply(52 notify.4 [create] v30'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd5c051070 con 0x563ff94dc620 2024-09-22T08:36:48.686 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.674+0000 7fdd66345640 1 -- 172.21.15.142:0/1763553621 <== osd.2 v2:172.21.15.142:6808/279438927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94832765608640] v30'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd580187b0 con 0x7fdd6003c3a0 2024-09-22T08:36:48.686 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.674+0000 7fdd6a72c800 1 -- 172.21.15.142:0/1763553621 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94832765612368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563ff94ebee0 con 0x563ff94dc620 2024-09-22T08:36:48.686 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.674+0000 7fdd6a72c800 1 -- 172.21.15.142:0/1763553621 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563ff94e98d0 con 0x7fdd58017050 2024-09-22T08:36:48.686 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.675+0000 7fdd65b44640 1 -- 172.21.15.142:0/1763553621 <== osd.0 v2:172.21.15.31:6800/168281188 11 ==== osd_op_reply(54 notify.5 [create] v30'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd5c051070 con 0x7fdd58017050 2024-09-22T08:36:48.686 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.675+0000 7fdd65b44640 1 -- 172.21.15.142:0/1763553621 <== osd.1 v2:172.21.15.142:6816/3192108003 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94832765612368] v30'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd5c051070 con 0x563ff94dc620 2024-09-22T08:36:48.686 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.675+0000 7fdd6a72c800 1 -- 172.21.15.142:0/1763553621 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94832765617360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563ff94e98d0 con 0x7fdd58017050 2024-09-22T08:36:48.686 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.675+0000 7fdd6a72c800 1 -- 172.21.15.142:0/1763553621 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563ff94ecf10 con 0x7fdd58017050 2024-09-22T08:36:48.686 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.676+0000 7fdd65b44640 1 -- 172.21.15.142:0/1763553621 <== osd.0 v2:172.21.15.31:6800/168281188 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94832765617360] v30'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd5c051070 con 0x7fdd58017050 2024-09-22T08:36:48.687 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.676+0000 7fdd65b44640 1 -- 172.21.15.142:0/1763553621 <== osd.0 v2:172.21.15.31:6800/168281188 13 ==== osd_op_reply(56 notify.6 [create] v30'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd5c051070 con 0x7fdd58017050 2024-09-22T08:36:48.687 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.676+0000 7fdd6a72c800 1 -- 172.21.15.142:0/1763553621 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94832765618416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563ff94ecf10 con 0x7fdd58017050 2024-09-22T08:36:48.687 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.676+0000 7fdd6a72c800 1 -- 172.21.15.142:0/1763553621 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563ff94ed8d0 con 0x7fdd58017050 2024-09-22T08:36:48.695 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.678+0000 7fdd65b44640 1 -- 172.21.15.142:0/1763553621 <== osd.0 v2:172.21.15.31:6800/168281188 14 ==== osd_op_reply(58 notify.7 [create] v30'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd5c051070 con 0x7fdd58017050 2024-09-22T08:36:48.695 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.678+0000 7fdd6a72c800 1 -- 172.21.15.142:0/1763553621 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94832765621280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563ff94edcf0 con 0x7fdd58017050 2024-09-22T08:36:48.695 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.678+0000 7fdd6a72c800 20 add_watcher() i=0 2024-09-22T08:36:48.695 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.678+0000 7fdd6a72c800 20 add_watcher() i=1 2024-09-22T08:36:48.695 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.678+0000 7fdd6a72c800 20 add_watcher() i=2 2024-09-22T08:36:48.695 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.678+0000 7fdd6a72c800 20 add_watcher() i=3 2024-09-22T08:36:48.695 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.678+0000 7fdd6a72c800 20 add_watcher() i=4 2024-09-22T08:36:48.695 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.678+0000 7fdd6a72c800 20 add_watcher() i=5 2024-09-22T08:36:48.695 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.678+0000 7fdd65b44640 1 -- 172.21.15.142:0/1763553621 <== osd.0 v2:172.21.15.31:6800/168281188 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94832765618416] v30'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd5c051070 con 0x7fdd58017050 2024-09-22T08:36:48.696 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.678+0000 7fdd6a72c800 20 add_watcher() i=6 2024-09-22T08:36:48.696 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.679+0000 7fdd65b44640 1 -- 172.21.15.142:0/1763553621 <== osd.0 v2:172.21.15.31:6800/168281188 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94832765621280] v30'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd5c051070 con 0x7fdd58017050 2024-09-22T08:36:48.696 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.679+0000 7fdd6a72c800 20 add_watcher() i=7 2024-09-22T08:36:48.696 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.679+0000 7fdd6a72c800 2 all 8 watchers are set, enabling cache 2024-09-22T08:36:48.696 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.679+0000 7fdd6a72c800 1 -- 172.21.15.142:0/1763553621 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563ff94edcf0 con 0x563ff94dc620 2024-09-22T08:36:48.696 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.679+0000 7fdd65b44640 1 -- 172.21.15.142:0/1763553621 <== osd.1 v2:172.21.15.142:6816/3192108003 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fdd5c051070 con 0x563ff94dc620 2024-09-22T08:36:48.696 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.679+0000 7fdd6a72c800 1 -- 172.21.15.142:0/1763553621 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94832765622336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563ff94ee6b0 con 0x563ff94dc620 2024-09-22T08:36:48.696 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.680+0000 7fdd65b44640 1 -- 172.21.15.142:0/1763553621 <== osd.1 v2:172.21.15.142:6816/3192108003 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94832765622336] v30'146 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fdd5c051070 con 0x563ff94dc620 2024-09-22T08:36:48.696 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.680+0000 7fdc1cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:36:48.696 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.680+0000 7fdd6a72c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:36:48.696 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.680+0000 7fdd6a72c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:36:48.697 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.680+0000 7fdd6a72c800 5 note: GC not initialized 2024-09-22T08:36:48.697 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.680+0000 7fdb977fe640 20 reqs_thread_entry: start 2024-09-22T08:36:48.697 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.681+0000 7fdd6a72c800 20 init_complete bucket index max shards: 11 2024-09-22T08:36:48.697 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.681+0000 7fdd6a72c800 20 Filter name: none 2024-09-22T08:36:48.697 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.681+0000 7fdb957fa640 20 reqs_thread_entry: start 2024-09-22T08:36:48.697 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.681+0000 7fdd6a72c800 1 -- 172.21.15.142:0/1763553621 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:62 6.0 6:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563ff9523740 con 0x7fdd58017050 2024-09-22T08:36:48.697 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.681+0000 7fdd65b44640 1 -- 172.21.15.142:0/1763553621 <== osd.0 v2:172.21.15.31:6800/168281188 17 ==== osd_op_reply(62 [pgnls start_epoch 30 out=254b] v30'36 uv18 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7fdd5c051070 con 0x7fdd58017050 2024-09-22T08:36:48.697 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.681+0000 7fdd65b44640 1 -- 172.21.15.142:0/1763553621 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:63 6.10 6:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563ff94e5c50 con 0x7fdd58017050 2024-09-22T08:36:48.697 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.682+0000 7fdd65b44640 1 -- 172.21.15.142:0/1763553621 <== osd.0 v2:172.21.15.31:6800/168281188 18 ==== osd_op_reply(63 [pgnls start_epoch 30 out=131b] v30'4 uv4 ondisk = 1) ==== 144+0+131 (crc 0 0 0) 0x7fdd5c051070 con 0x7fdd58017050 2024-09-22T08:36:48.697 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.682+0000 7fdd65b44640 1 -- 172.21.15.142:0/1763553621 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:64 6.8 6:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563ff94e5c50 con 0x563ff94e1030 2024-09-22T08:36:48.697 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.682+0000 7fdd66b46640 1 -- 172.21.15.142:0/1763553621 <== osd.3 v2:172.21.15.142:6800/1064901393 16 ==== osd_op_reply(64 [pgnls start_epoch 30 out=295b] v30'23 uv15 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7fdd6000a4d0 con 0x563ff94e1030 2024-09-22T08:36:48.697 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.682+0000 7fdd66b46640 1 -- 172.21.15.142:0/1763553621 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:65 6.18 6:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563ff94e7f70 con 0x7fdd58017050 2024-09-22T08:36:48.698 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.682+0000 7fdd65b44640 1 -- 172.21.15.142:0/1763553621 <== osd.0 v2:172.21.15.31:6800/168281188 19 ==== osd_op_reply(65 [pgnls start_epoch 30 out=172b] v30'17 uv9 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7fdd5c051070 con 0x7fdd58017050 2024-09-22T08:36:48.698 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.682+0000 7fdd65b44640 1 -- 172.21.15.142:0/1763553621 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:66 6.4 6:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563ff94e7f70 con 0x563ff94dc620 2024-09-22T08:36:48.698 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.683+0000 7fdd65b44640 1 -- 172.21.15.142:0/1763553621 <== osd.1 v2:172.21.15.142:6816/3192108003 21 ==== osd_op_reply(66 [pgnls start_epoch 30 out=335b] v30'146 uv23 ondisk = 1) ==== 144+0+335 (crc 0 0 0) 0x7fdd5c051070 con 0x563ff94dc620 2024-09-22T08:36:48.698 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.683+0000 7fdd65b44640 1 -- 172.21.15.142:0/1763553621 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:67 6.14 6:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563ff94e7f70 con 0x7fdd6003c3a0 2024-09-22T08:36:48.698 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.683+0000 7fdd66345640 1 -- 172.21.15.142:0/1763553621 <== osd.2 v2:172.21.15.142:6808/279438927 11 ==== osd_op_reply(67 [pgnls start_epoch 30 out=213b] v30'10 uv10 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7fdd580187b0 con 0x7fdd6003c3a0 2024-09-22T08:36:48.698 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.683+0000 7fdd66345640 1 -- 172.21.15.142:0/1763553621 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:68 6.c 6:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563ff94eabe0 con 0x563ff94e1030 2024-09-22T08:36:48.698 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.683+0000 7fdd66b46640 1 -- 172.21.15.142:0/1763553621 <== osd.3 v2:172.21.15.142:6800/1064901393 17 ==== osd_op_reply(68 [pgnls start_epoch 30 out=254b] v30'10 uv10 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7fdd6000a4d0 con 0x563ff94e1030 2024-09-22T08:36:48.698 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.683+0000 7fdd66b46640 1 -- 172.21.15.142:0/1763553621 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:69 6.1c 6:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563ff94eabe0 con 0x563ff94e1030 2024-09-22T08:36:48.698 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.684+0000 7fdd66b46640 1 -- 172.21.15.142:0/1763553621 <== osd.3 v2:172.21.15.142:6800/1064901393 18 ==== osd_op_reply(69 [pgnls start_epoch 30 out=295b] v30'23 uv15 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7fdd6000a4d0 con 0x563ff94e1030 2024-09-22T08:36:48.698 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.684+0000 7fdd66b46640 1 -- 172.21.15.142:0/1763553621 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:70 6.2 6:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563ff94eabe0 con 0x563ff94e1030 2024-09-22T08:36:48.698 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.684+0000 7fdd66b46640 1 -- 172.21.15.142:0/1763553621 <== osd.3 v2:172.21.15.142:6800/1064901393 19 ==== osd_op_reply(70 [pgnls start_epoch 30 out=213b] v30'10 uv10 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7fdd6000a4d0 con 0x563ff94e1030 2024-09-22T08:36:48.698 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.684+0000 7fdd66b46640 1 -- 172.21.15.142:0/1763553621 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:71 6.12 6:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563ff94eabe0 con 0x7fdd6003c3a0 2024-09-22T08:36:48.699 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.684+0000 7fdd66345640 1 -- 172.21.15.142:0/1763553621 <== osd.2 v2:172.21.15.142:6808/279438927 12 ==== osd_op_reply(71 [pgnls start_epoch 30 out=172b] v30'17 uv9 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7fdd580187b0 con 0x7fdd6003c3a0 2024-09-22T08:36:48.699 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.684+0000 7fdd66345640 1 -- 172.21.15.142:0/1763553621 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:72 6.a 6:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563ff94eabe0 con 0x7fdd6003c3a0 2024-09-22T08:36:48.699 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.684+0000 7fdd66345640 1 -- 172.21.15.142:0/1763553621 <== osd.2 v2:172.21.15.142:6808/279438927 13 ==== osd_op_reply(72 [pgnls start_epoch 30 out=336b] v30'27 uv19 ondisk = 1) ==== 144+0+336 (crc 0 0 0) 0x7fdd580187b0 con 0x7fdd6003c3a0 2024-09-22T08:36:48.699 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.684+0000 7fdd66345640 1 -- 172.21.15.142:0/1763553621 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:73 6.1a 6:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563ff94eabe0 con 0x563ff94e1030 2024-09-22T08:36:48.699 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.685+0000 7fdd66b46640 1 -- 172.21.15.142:0/1763553621 <== osd.3 v2:172.21.15.142:6800/1064901393 20 ==== osd_op_reply(73 [pgnls start_epoch 30 out=131b] v30'17 uv9 ondisk = 1) ==== 144+0+131 (crc 0 0 0) 0x7fdd6000a4d0 con 0x563ff94e1030 2024-09-22T08:36:48.699 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.685+0000 7fdd66b46640 1 -- 172.21.15.142:0/1763553621 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:74 6.6 6:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563ff94eabe0 con 0x563ff94e1030 2024-09-22T08:36:48.699 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.685+0000 7fdd66b46640 1 -- 172.21.15.142:0/1763553621 <== osd.3 v2:172.21.15.142:6800/1064901393 21 ==== osd_op_reply(74 [pgnls start_epoch 30 out=254b] v30'12 uv12 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7fdd6000a4d0 con 0x563ff94e1030 2024-09-22T08:36:48.699 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.685+0000 7fdd66b46640 1 -- 172.21.15.142:0/1763553621 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:75 6.16 6:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563ff94eabe0 con 0x563ff94e1030 2024-09-22T08:36:48.699 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.685+0000 7fdd66b46640 1 -- 172.21.15.142:0/1763553621 <== osd.3 v2:172.21.15.142:6800/1064901393 22 ==== osd_op_reply(75 [pgnls start_epoch 30 out=90b] v30'17 uv9 ondisk = 1) ==== 144+0+90 (crc 0 0 0) 0x7fdd6000a4d0 con 0x563ff94e1030 2024-09-22T08:36:48.699 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.685+0000 7fdd66b46640 1 -- 172.21.15.142:0/1763553621 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:76 6.e 6:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563ff94eabe0 con 0x563ff94dc620 2024-09-22T08:36:48.699 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.685+0000 7fdd65b44640 1 -- 172.21.15.142:0/1763553621 <== osd.1 v2:172.21.15.142:6816/3192108003 22 ==== osd_op_reply(76 [pgnls start_epoch 30 out=213b] v30'19 uv11 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7fdd5c051070 con 0x563ff94dc620 2024-09-22T08:36:48.699 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.685+0000 7fdd65b44640 1 -- 172.21.15.142:0/1763553621 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:77 6.1e 6:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563ff94eabe0 con 0x563ff94e1030 2024-09-22T08:36:48.700 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.686+0000 7fdd66b46640 1 -- 172.21.15.142:0/1763553621 <== osd.3 v2:172.21.15.142:6800/1064901393 23 ==== osd_op_reply(77 [pgnls start_epoch 30 out=254b] v30'10 uv10 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7fdd60079110 con 0x563ff94e1030 2024-09-22T08:36:48.700 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.686+0000 7fdd66b46640 1 -- 172.21.15.142:0/1763553621 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:78 6.1 6:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563ff94eabe0 con 0x563ff94dc620 2024-09-22T08:36:48.700 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.686+0000 7fdd65b44640 1 -- 172.21.15.142:0/1763553621 <== osd.1 v2:172.21.15.142:6816/3192108003 23 ==== osd_op_reply(78 [pgnls start_epoch 30 out=254b] v30'14 uv14 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7fdd5c051070 con 0x563ff94dc620 2024-09-22T08:36:48.700 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.686+0000 7fdd65b44640 1 -- 172.21.15.142:0/1763553621 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:79 6.11 6:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563ff94eabe0 con 0x563ff94e1030 2024-09-22T08:36:48.700 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.686+0000 7fdd66b46640 1 -- 172.21.15.142:0/1763553621 <== osd.3 v2:172.21.15.142:6800/1064901393 24 ==== osd_op_reply(79 [pgnls start_epoch 30 out=213b] v30'19 uv11 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7fdd60079110 con 0x563ff94e1030 2024-09-22T08:36:48.700 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.686+0000 7fdd66b46640 1 -- 172.21.15.142:0/1763553621 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:80 6.9 6:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563ff94eabe0 con 0x563ff94e1030 2024-09-22T08:36:48.700 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.686+0000 7fdd66b46640 1 -- 172.21.15.142:0/1763553621 <== osd.3 v2:172.21.15.142:6800/1064901393 25 ==== osd_op_reply(80 [pgnls start_epoch 30 out=172b] v30'28 uv12 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7fdd60079110 con 0x563ff94e1030 2024-09-22T08:36:48.700 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.686+0000 7fdd66b46640 1 -- 172.21.15.142:0/1763553621 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:81 6.19 6:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563ff94eabe0 con 0x563ff94dc620 2024-09-22T08:36:48.700 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.687+0000 7fdd65b44640 1 -- 172.21.15.142:0/1763553621 <== osd.1 v2:172.21.15.142:6816/3192108003 24 ==== osd_op_reply(81 [pgnls start_epoch 30 out=295b] v30'23 uv15 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7fdd5c051070 con 0x563ff94dc620 2024-09-22T08:36:48.700 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.687+0000 7fdd65b44640 1 -- 172.21.15.142:0/1763553621 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:82 6.5 6:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563ff94eabe0 con 0x7fdd6003c3a0 2024-09-22T08:36:48.700 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.687+0000 7fdd66345640 1 -- 172.21.15.142:0/1763553621 <== osd.2 v2:172.21.15.142:6808/279438927 14 ==== osd_op_reply(82 [pgnls start_epoch 30 out=276b] v30'16 uv15 ondisk = 1) ==== 144+0+276 (crc 0 0 0) 0x7fdd580187b0 con 0x7fdd6003c3a0 2024-09-22T08:36:48.701 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.687+0000 7fdd66345640 1 -- 172.21.15.142:0/1763553621 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:83 6.15 6:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563ff94eabe0 con 0x7fdd6003c3a0 2024-09-22T08:36:48.701 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.687+0000 7fdd66345640 1 -- 172.21.15.142:0/1763553621 <== osd.2 v2:172.21.15.142:6808/279438927 15 ==== osd_op_reply(83 [pgnls start_epoch 30 out=172b] v30'17 uv9 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7fdd580187b0 con 0x7fdd6003c3a0 2024-09-22T08:36:48.701 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.687+0000 7fdd66345640 1 -- 172.21.15.142:0/1763553621 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:84 6.d 6:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563ff94eabe0 con 0x563ff94dc620 2024-09-22T08:36:48.701 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.688+0000 7fdd65b44640 1 -- 172.21.15.142:0/1763553621 <== osd.1 v2:172.21.15.142:6816/3192108003 25 ==== osd_op_reply(84 [pgnls start_epoch 30 out=295b] v30'25 uv17 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7fdd5c051070 con 0x563ff94dc620 2024-09-22T08:36:48.701 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.688+0000 7fdd65b44640 1 -- 172.21.15.142:0/1763553621 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:85 6.1d 6:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563ff94eabe0 con 0x7fdd58017050 2024-09-22T08:36:48.701 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.688+0000 7fdd65b44640 1 -- 172.21.15.142:0/1763553621 <== osd.0 v2:172.21.15.31:6800/168281188 20 ==== osd_op_reply(85 [pgnls start_epoch 30 out=172b] v30'28 uv12 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7fdd5c051070 con 0x7fdd58017050 2024-09-22T08:36:48.701 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.688+0000 7fdd65b44640 1 -- 172.21.15.142:0/1763553621 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:86 6.3 6:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563ff94eabe0 con 0x7fdd6003c3a0 2024-09-22T08:36:48.701 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.689+0000 7fdd66345640 1 -- 172.21.15.142:0/1763553621 <== osd.2 v2:172.21.15.142:6808/279438927 16 ==== osd_op_reply(86 [pgnls start_epoch 30 out=213b] v30'43 uv19 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7fdd580187b0 con 0x7fdd6003c3a0 2024-09-22T08:36:48.701 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.689+0000 7fdd66345640 1 -- 172.21.15.142:0/1763553621 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:87 6.13 6:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563ff94eabe0 con 0x7fdd58017050 2024-09-22T08:36:48.701 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.689+0000 7fdd65b44640 1 -- 172.21.15.142:0/1763553621 <== osd.0 v2:172.21.15.31:6800/168281188 21 ==== osd_op_reply(87 [pgnls start_epoch 30 out=172b] v30'19 uv11 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7fdd5c051070 con 0x7fdd58017050 2024-09-22T08:36:48.701 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.689+0000 7fdd65b44640 1 -- 172.21.15.142:0/1763553621 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:88 6.b 6:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563ff94eabe0 con 0x563ff94e1030 2024-09-22T08:36:48.702 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.689+0000 7fdd66b46640 1 -- 172.21.15.142:0/1763553621 <== osd.3 v2:172.21.15.142:6800/1064901393 26 ==== osd_op_reply(88 [pgnls start_epoch 30 out=172b] v30'17 uv9 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7fdd60079110 con 0x563ff94e1030 2024-09-22T08:36:48.702 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.689+0000 7fdd66b46640 1 -- 172.21.15.142:0/1763553621 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:89 6.1b 6:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563ff94eabe0 con 0x563ff94e1030 2024-09-22T08:36:48.702 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.689+0000 7fdd66b46640 1 -- 172.21.15.142:0/1763553621 <== osd.3 v2:172.21.15.142:6800/1064901393 27 ==== osd_op_reply(89 [pgnls start_epoch 30 out=90b] v30'13 uv5 ondisk = 1) ==== 144+0+90 (crc 0 0 0) 0x7fdd60079110 con 0x563ff94e1030 2024-09-22T08:36:48.702 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.689+0000 7fdd66b46640 1 -- 172.21.15.142:0/1763553621 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:90 6.7 6:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563ff94eabe0 con 0x563ff94e1030 2024-09-22T08:36:48.702 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.690+0000 7fdd66b46640 1 -- 172.21.15.142:0/1763553621 <== osd.3 v2:172.21.15.142:6800/1064901393 28 ==== osd_op_reply(90 [pgnls start_epoch 30 out=90b] v30'37 uv13 ondisk = 1) ==== 144+0+90 (crc 0 0 0) 0x7fdd60079110 con 0x563ff94e1030 2024-09-22T08:36:48.702 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.690+0000 7fdd66b46640 1 -- 172.21.15.142:0/1763553621 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:91 6.17 6:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563ff94eabe0 con 0x563ff94dc620 2024-09-22T08:36:48.702 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.690+0000 7fdd65b44640 1 -- 172.21.15.142:0/1763553621 <== osd.1 v2:172.21.15.142:6816/3192108003 26 ==== osd_op_reply(91 [pgnls start_epoch 30 out=131b] v30'6 uv6 ondisk = 1) ==== 144+0+131 (crc 0 0 0) 0x7fdd5c051070 con 0x563ff94dc620 2024-09-22T08:36:48.702 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.690+0000 7fdd65b44640 1 -- 172.21.15.142:0/1763553621 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:92 6.f 6:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563ff94eabe0 con 0x7fdd6003c3a0 2024-09-22T08:36:48.702 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.690+0000 7fdd66345640 1 -- 172.21.15.142:0/1763553621 <== osd.2 v2:172.21.15.142:6808/279438927 17 ==== osd_op_reply(92 [pgnls start_epoch 30 out=295b] v30'23 uv15 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7fdd580187b0 con 0x7fdd6003c3a0 2024-09-22T08:36:48.702 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.690+0000 7fdd66345640 1 -- 172.21.15.142:0/1763553621 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:93 6.1f 6:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563ff94eabe0 con 0x7fdd58017050 2024-09-22T08:36:48.702 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.691+0000 7fdd65b44640 1 -- 172.21.15.142:0/1763553621 <== osd.0 v2:172.21.15.31:6800/168281188 22 ==== osd_op_reply(93 [pgnls start_epoch 30 out=213b] v30'19 uv11 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7fdd5c051070 con 0x7fdd58017050 2024-09-22T08:36:48.703 INFO:teuthology.orchestra.run.smithi142.stdout:["obj_delete_at_hint.0000000078","obj_delete_at_hint.0000000070","obj_delete_at_hint.0000000104","obj_delete_at_hint.0000000026","obj_delete_at_hint.0000000028","obj_delete_at_hint.0000000040","obj_delete_at_hint.0000000015","obj_delete_at_hint.0000000069","obj_delete_at_hint.0000000095","obj_delete_at_hint.0000000003","obj_delete_at_hint.0000000047","obj_delete_at_hint.0000000035","obj_delete_at_hint.0000000037","obj_delete_at_hint.0000000024","obj_delete_at_hint.0000000000","obj_delete_at_hint.0000000031","data_loggenerations_metadata","obj_delete_at_hint.0000000076","obj_delete_at_hint.0000000113","obj_delete_at_hint.0000000005","obj_delete_at_hint.0000000011","obj_delete_at_hint.0000000058","obj_delete_at_hint.0000000052","obj_delete_at_hint.0000000088","obj_delete_at_hint.0000000080","obj_delete_at_hint.0000000090","obj_delete_at_hint.0000000110","obj_delete_at_hint.0000000096","obj_delete_at_hint.0000000087","obj_delete_at_hint.0000000008","obj_delete_at_hint.0000000006","obj_delete_at_hint.0000000029","obj_delete_at_hint.0000000089","obj_delete_at_hint.0000000022","obj_delete_at_hint.0000000016","obj_delete_at_hint.0000000041","obj_delete_at_hint.0000000018","obj_delete_at_hint.0000000092","obj_delete_at_hint.0000000014","obj_delete_at_hint.0000000112","obj_delete_at_hint.0000000007","obj_delete_at_hint.0000000021","obj_delete_at_hint.0000000064","obj_delete_at_hint.0000000071","obj_delete_at_hint.0000000074","obj_delete_at_hint.0000000081","obj_delete_at_hint.0000000009","obj_delete_at_hint.0000000121","obj_delete_at_hint.0000000125","obj_delete_at_hint.0000000082","obj_delete_at_hint.0000000105","obj_delete_at_hint.0000000059","obj_delete_at_hint.0000000077","obj_delete_at_hint.0000000032","obj_delete_at_hint.0000000053","obj_delete_at_hint.0000000091","obj_delete_at_hint.0000000065","obj_delete_at_hint.0000000083","obj_delete_at_hint.0000000010","obj_delete_at_hint.0000000045","obj_delete_at_hint.0000000002","obj_delete_at_hint.0000000116","obj_delete_at_hint.0000000034","obj_delete_at_hint.0000000101","obj_delete_at_hint.0000000079","obj_delete_at_hint.0000000049","obj_delete_at_hint.0000000117","obj_delete_at_hint.0000000044","obj_delete_at_hint.0000000066","obj_delete_at_hint.0000000068","obj_delete_at_hint.0000000085","obj_delete_at_hint.0000000073","obj_delete_at_hint.0000000038","obj_delete_at_hint.0000000118","obj_delete_at_hint.0000000036","obj_delete_at_hint.0000000103","obj_delete_at_hint.0000000119","obj_delete_at_hint.0000000098","obj_delete_at_hint.0000000027","obj_delete_at_hint.0000000019","obj_delete_at_hint.0000000039","obj_delete_at_hint.0000000100","obj_delete_at_hint.0000000093","obj_delete_at_hint.0000000004","obj_delete_at_hint.0000000063","obj_delete_at_hint.0000000122","obj_delete_at_hint.0000000057","obj_delete_at_hint.0000000054","obj_delete_at_hint.0000000114","data_log.0","obj_delete_at_hint.0000000012","obj_delete_at_hint.0000000084","obj_delete_at_hint.0000000043","obj_delete_at_hint.0000000111","obj_delete_at_hint.0000000048","obj_delete_at_hint.0000000020","obj_delete_at_hint.0000000099","obj_delete_at_hint.0000000056","obj_delete_at_hint.0000000072","obj_delete_at_hint.0000000062","obj_delete_at_hint.0000000115","obj_delete_at_hint.0000000033","obj_delete_at_hint.0000000025","obj_delete_at_hint.0000000123","obj_delete_at_hint.0000000108","obj_delete_at_hint.0000000094","obj_delete_at_hint.0000000060","obj_delete_at_hint.0000000109","obj_delete_at_hint.0000000013","obj_delete_at_hint.0000000051","obj_delete_at_hint.0000000106","obj_delete_at_hint.0000000017","obj_delete_at_hint.0000000023","obj_delete_at_hint.0000000107","obj_delete_at_hint.0000000046","obj_delete_at_hint.0000000067","obj_delete_at_hint.0000000086","obj_delete_at_hint.0000000050","obj_delete_at_hint.0000000102","obj_delete_at_hint.0000000124","obj_delete_at_hint.0000000001","obj_delete_at_hint.0000000126","obj_delete_at_hint.0000000055","obj_delete_at_hint.0000000061","obj_delete_at_hint.0000000097","obj_delete_at_hint.0000000042","obj_delete_at_hint.0000000075","obj_delete_at_hint.0000000120","obj_delete_at_hint.0000000030"] 2024-09-22T08:36:48.708 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.692+0000 7fdc1cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:36:48.708 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.692+0000 7fdd6a72c800 1 -- 172.21.15.142:0/1763553621 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94832765622336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563ff94e5c50 con 0x563ff94dc620 2024-09-22T08:36:48.708 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.693+0000 7fdd65b44640 1 -- 172.21.15.142:0/1763553621 <== osd.1 v2:172.21.15.142:6816/3192108003 27 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94832765622336] v30'147 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fdd5c051070 con 0x563ff94dc620 2024-09-22T08:36:48.708 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.693+0000 7fdd6a72c800 1 -- 172.21.15.142:0/1763553621 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94832765596320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563ff94e5c50 con 0x7fdd6003c3a0 2024-09-22T08:36:48.708 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.694+0000 7fdd66345640 1 -- 172.21.15.142:0/1763553621 <== osd.2 v2:172.21.15.142:6808/279438927 18 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94832765596320] v30'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd580187b0 con 0x7fdd6003c3a0 2024-09-22T08:36:48.708 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.694+0000 7fdd6a72c800 20 remove_watcher() i=0 2024-09-22T08:36:48.708 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.694+0000 7fdd6a72c800 2 removed watcher, disabling cache 2024-09-22T08:36:48.708 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.694+0000 7fdd6a72c800 1 -- 172.21.15.142:0/1763553621 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94832765602288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563ff9521b50 con 0x563ff94dc620 2024-09-22T08:36:48.708 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.696+0000 7fdd65b44640 1 -- 172.21.15.142:0/1763553621 <== osd.1 v2:172.21.15.142:6816/3192108003 28 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94832765602288] v30'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd5c051070 con 0x563ff94dc620 2024-09-22T08:36:48.709 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.696+0000 7fdd6a72c800 20 remove_watcher() i=1 2024-09-22T08:36:48.709 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.696+0000 7fdd6a72c800 1 -- 172.21.15.142:0/1763553621 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94832765604496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563ff9521b50 con 0x563ff94e1030 2024-09-22T08:36:48.709 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.696+0000 7fdd66b46640 1 -- 172.21.15.142:0/1763553621 <== osd.3 v2:172.21.15.142:6800/1064901393 29 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94832765604496] v30'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd60079110 con 0x563ff94e1030 2024-09-22T08:36:48.709 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.697+0000 7fdd6a72c800 20 remove_watcher() i=2 2024-09-22T08:36:48.709 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.697+0000 7fdd6a72c800 1 -- 172.21.15.142:0/1763553621 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94832765608640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563ff9523700 con 0x7fdd6003c3a0 2024-09-22T08:36:48.709 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.697+0000 7fdd66345640 1 -- 172.21.15.142:0/1763553621 <== osd.2 v2:172.21.15.142:6808/279438927 19 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94832765608640] v30'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd580187b0 con 0x7fdd6003c3a0 2024-09-22T08:36:48.709 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.697+0000 7fdd6a72c800 20 remove_watcher() i=3 2024-09-22T08:36:48.709 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.697+0000 7fdd6a72c800 1 -- 172.21.15.142:0/1763553621 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94832765612368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563ff95231b0 con 0x563ff94dc620 2024-09-22T08:36:48.709 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.699+0000 7fdd65b44640 1 -- 172.21.15.142:0/1763553621 <== osd.1 v2:172.21.15.142:6816/3192108003 29 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94832765612368] v30'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd5c051070 con 0x563ff94dc620 2024-09-22T08:36:48.709 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.699+0000 7fdd6a72c800 20 remove_watcher() i=4 2024-09-22T08:36:48.709 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.699+0000 7fdd6a72c800 1 -- 172.21.15.142:0/1763553621 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94832765617360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563ff9523700 con 0x7fdd58017050 2024-09-22T08:36:48.709 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.700+0000 7fdd65b44640 1 -- 172.21.15.142:0/1763553621 <== osd.0 v2:172.21.15.31:6800/168281188 23 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94832765617360] v30'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd5c051070 con 0x7fdd58017050 2024-09-22T08:36:48.709 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.700+0000 7fdd6a72c800 20 remove_watcher() i=5 2024-09-22T08:36:48.710 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.700+0000 7fdd6a72c800 1 -- 172.21.15.142:0/1763553621 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94832765618416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563ff95231b0 con 0x7fdd58017050 2024-09-22T08:36:48.710 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.701+0000 7fdd65b44640 1 -- 172.21.15.142:0/1763553621 <== osd.0 v2:172.21.15.31:6800/168281188 24 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94832765618416] v30'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd5c051070 con 0x7fdd58017050 2024-09-22T08:36:48.710 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.701+0000 7fdd6a72c800 20 remove_watcher() i=6 2024-09-22T08:36:48.710 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.701+0000 7fdd6a72c800 1 -- 172.21.15.142:0/1763553621 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94832765621280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563ff9523700 con 0x7fdd58017050 2024-09-22T08:36:48.710 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.702+0000 7fdd65b44640 1 -- 172.21.15.142:0/1763553621 <== osd.0 v2:172.21.15.31:6800/168281188 25 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94832765621280] v30'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd5c051070 con 0x7fdd58017050 2024-09-22T08:36:48.710 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.702+0000 7fdd6a72c800 20 remove_watcher() i=7 2024-09-22T08:36:48.710 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.702+0000 7fdd6a72c800 1 -- 172.21.15.142:0/1763553621 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7fdd58017050 msgr2=0x7fdd58042130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:48.710 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.702+0000 7fdd6a72c800 1 --2- 172.21.15.142:0/1763553621 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7fdd58017050 0x7fdd58042130 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:48.710 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.702+0000 7fdd6a72c800 1 -- 172.21.15.142:0/1763553621 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x563ff94dc620 msgr2=0x563ff94deae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:48.710 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.702+0000 7fdd6a72c800 1 --2- 172.21.15.142:0/1763553621 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x563ff94dc620 0x563ff94deae0 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:48.710 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.702+0000 7fdd6a72c800 1 -- 172.21.15.142:0/1763553621 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7fdd6003c3a0 msgr2=0x7fdd6003c820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:48.710 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.702+0000 7fdd6a72c800 1 --2- 172.21.15.142:0/1763553621 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7fdd6003c3a0 0x7fdd6003c820 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:48.710 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.702+0000 7fdd6a72c800 1 -- 172.21.15.142:0/1763553621 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x563ff94e1030 msgr2=0x563ff94e3420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:48.711 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.702+0000 7fdd6a72c800 1 --2- 172.21.15.142:0/1763553621 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x563ff94e1030 0x563ff94e3420 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:48.711 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.702+0000 7fdd6a72c800 1 -- 172.21.15.142:0/1763553621 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fdc3003d000 msgr2=0x7fdc3003f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:48.711 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.702+0000 7fdd6a72c800 1 --2- 172.21.15.142:0/1763553621 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fdc3003d000 0x7fdc3003f4c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fdd5801af70 tx=0x7fdd58046000 comp rx=0 tx=0).stop 2024-09-22T08:36:48.711 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.702+0000 7fdd6a72c800 1 -- 172.21.15.142:0/1763553621 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563ff94c9750 msgr2=0x563ff94d0d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:48.711 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.702+0000 7fdd65b44640 1 -- 172.21.15.142:0/1763553621 reap_dead start 2024-09-22T08:36:48.711 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.702+0000 7fdd6a72c800 1 --2- 172.21.15.142:0/1763553621 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563ff94c9750 0x563ff94d0d40 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fdd60054800 tx=0x7fdd60054860 comp rx=0 tx=0).stop 2024-09-22T08:36:48.711 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.702+0000 7fdd6a72c800 1 -- 172.21.15.142:0/1763553621 shutdown_connections 2024-09-22T08:36:48.711 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.702+0000 7fdd6a72c800 1 --2- 172.21.15.142:0/1763553621 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563ff94c9750 0x563ff94d0d40 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:48.711 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.702+0000 7fdd6a72c800 1 -- 172.21.15.142:0/1763553621 >> 172.21.15.142:0/1763553621 conn(0x563ff94c5b50 msgr2=0x563ff94c3d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:48.711 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.702+0000 7fdd6a72c800 1 -- 172.21.15.142:0/1763553621 shutdown_connections 2024-09-22T08:36:48.711 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.702+0000 7fdd6a72c800 1 -- 172.21.15.142:0/1763553621 wait complete. 2024-09-22T08:36:48.711 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.702+0000 7fdd6a72c800 1 -- 172.21.15.142:0/901575465 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fdc4003cfb0 msgr2=0x7fdc4003f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:48.712 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.702+0000 7fdd6a72c800 1 --2- 172.21.15.142:0/901575465 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fdc4003cfb0 0x7fdc4003f470 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fdd5800c720 tx=0x7fdd58052920 comp rx=0 tx=0).stop 2024-09-22T08:36:48.712 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.702+0000 7fdd6a72c800 1 -- 172.21.15.142:0/901575465 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563ff94bcc30 msgr2=0x563ff94bd050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:48.712 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.702+0000 7fdd6a72c800 1 --2- 172.21.15.142:0/901575465 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563ff94bcc30 0x563ff94bd050 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x563ff94a2ae0 tx=0x7fdd600167b0 comp rx=0 tx=0).stop 2024-09-22T08:36:48.712 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.703+0000 7fdd6a72c800 1 -- 172.21.15.142:0/901575465 shutdown_connections 2024-09-22T08:36:48.712 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.703+0000 7fdd6a72c800 1 --2- 172.21.15.142:0/901575465 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fdc4003cfb0 0x7fdc4003f470 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:48.712 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.703+0000 7fdd6a72c800 1 --2- 172.21.15.142:0/901575465 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563ff94bcc30 0x563ff94bd050 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:48.712 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.703+0000 7fdd6a72c800 1 -- 172.21.15.142:0/901575465 >> 172.21.15.142:0/901575465 conn(0x563ff94b0fe0 msgr2=0x563ff94b13c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:48.712 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.703+0000 7fdd6a72c800 1 -- 172.21.15.142:0/901575465 shutdown_connections 2024-09-22T08:36:48.712 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.703+0000 7fdd6a72c800 1 -- 172.21.15.142:0/901575465 wait complete. 2024-09-22T08:36:48.712 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.703+0000 7fdd6a72c800 1 -- 172.21.15.142:0/3868282500 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x563ff93a9ca0 msgr2=0x563ff94a92a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:48.712 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.703+0000 7fdd6a72c800 1 --2- 172.21.15.142:0/3868282500 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x563ff93a9ca0 0x563ff94a92a0 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:48.712 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.703+0000 7fdd6a72c800 1 -- 172.21.15.142:0/3868282500 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x563ff94ab640 msgr2=0x563ff94adae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:48.712 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.703+0000 7fdd6a72c800 1 --2- 172.21.15.142:0/3868282500 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x563ff94ab640 0x563ff94adae0 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:48.713 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.703+0000 7fdd6a72c800 1 -- 172.21.15.142:0/3868282500 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fdc4c03d000 msgr2=0x7fdc4c03f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:48.713 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.703+0000 7fdd6a72c800 1 --2- 172.21.15.142:0/3868282500 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fdc4c03d000 0x7fdc4c03f4c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fdd5c057000 tx=0x7fdd5c052000 comp rx=0 tx=0).stop 2024-09-22T08:36:48.713 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.703+0000 7fdd6a72c800 1 -- 172.21.15.142:0/3868282500 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563ff93a89d0 msgr2=0x563ff94a1c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:48.713 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.703+0000 7fdd6a72c800 1 --2- 172.21.15.142:0/3868282500 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563ff93a89d0 0x563ff94a1c50 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fdd5800c010 tx=0x7fdd58000ed0 comp rx=0 tx=0).stop 2024-09-22T08:36:48.713 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.703+0000 7fdd6a72c800 1 -- 172.21.15.142:0/3868282500 shutdown_connections 2024-09-22T08:36:48.713 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.703+0000 7fdd6a72c800 1 --2- 172.21.15.142:0/3868282500 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x563ff94ab640 0x563ff94adae0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:48.713 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.703+0000 7fdd6a72c800 1 --2- 172.21.15.142:0/3868282500 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x563ff93a9ca0 0x563ff94a92a0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:48.713 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.703+0000 7fdd6a72c800 1 --2- 172.21.15.142:0/3868282500 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fdc4c03d000 0x7fdc4c03f4c0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:48.713 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.703+0000 7fdd6a72c800 1 --2- 172.21.15.142:0/3868282500 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563ff93a89d0 0x563ff94a1c50 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:48.713 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.703+0000 7fdd6a72c800 1 -- 172.21.15.142:0/3868282500 >> 172.21.15.142:0/3868282500 conn(0x563ff93a3da0 msgr2=0x563ff9493440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:48.713 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.703+0000 7fdd6a72c800 1 -- 172.21.15.142:0/3868282500 shutdown_connections 2024-09-22T08:36:48.713 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.703+0000 7fdd6a72c800 1 -- 172.21.15.142:0/3868282500 wait complete. 2024-09-22T08:36:48.714 DEBUG:tasks.util.rgw: json result: ['obj_delete_at_hint.0000000078', 'obj_delete_at_hint.0000000070', 'obj_delete_at_hint.0000000104', 'obj_delete_at_hint.0000000026', 'obj_delete_at_hint.0000000028', 'obj_delete_at_hint.0000000040', 'obj_delete_at_hint.0000000015', 'obj_delete_at_hint.0000000069', 'obj_delete_at_hint.0000000095', 'obj_delete_at_hint.0000000003', 'obj_delete_at_hint.0000000047', 'obj_delete_at_hint.0000000035', 'obj_delete_at_hint.0000000037', 'obj_delete_at_hint.0000000024', 'obj_delete_at_hint.0000000000', 'obj_delete_at_hint.0000000031', 'data_loggenerations_metadata', 'obj_delete_at_hint.0000000076', 'obj_delete_at_hint.0000000113', 'obj_delete_at_hint.0000000005', 'obj_delete_at_hint.0000000011', 'obj_delete_at_hint.0000000058', 'obj_delete_at_hint.0000000052', 'obj_delete_at_hint.0000000088', 'obj_delete_at_hint.0000000080', 'obj_delete_at_hint.0000000090', 'obj_delete_at_hint.0000000110', 'obj_delete_at_hint.0000000096', 'obj_delete_at_hint.0000000087', 'obj_delete_at_hint.0000000008', 'obj_delete_at_hint.0000000006', 'obj_delete_at_hint.0000000029', 'obj_delete_at_hint.0000000089', 'obj_delete_at_hint.0000000022', 'obj_delete_at_hint.0000000016', 'obj_delete_at_hint.0000000041', 'obj_delete_at_hint.0000000018', 'obj_delete_at_hint.0000000092', 'obj_delete_at_hint.0000000014', 'obj_delete_at_hint.0000000112', 'obj_delete_at_hint.0000000007', 'obj_delete_at_hint.0000000021', 'obj_delete_at_hint.0000000064', 'obj_delete_at_hint.0000000071', 'obj_delete_at_hint.0000000074', 'obj_delete_at_hint.0000000081', 'obj_delete_at_hint.0000000009', 'obj_delete_at_hint.0000000121', 'obj_delete_at_hint.0000000125', 'obj_delete_at_hint.0000000082', 'obj_delete_at_hint.0000000105', 'obj_delete_at_hint.0000000059', 'obj_delete_at_hint.0000000077', 'obj_delete_at_hint.0000000032', 'obj_delete_at_hint.0000000053', 'obj_delete_at_hint.0000000091', 'obj_delete_at_hint.0000000065', 'obj_delete_at_hint.0000000083', 'obj_delete_at_hint.0000000010', 'obj_delete_at_hint.0000000045', 'obj_delete_at_hint.0000000002', 'obj_delete_at_hint.0000000116', 'obj_delete_at_hint.0000000034', 'obj_delete_at_hint.0000000101', 'obj_delete_at_hint.0000000079', 'obj_delete_at_hint.0000000049', 'obj_delete_at_hint.0000000117', 'obj_delete_at_hint.0000000044', 'obj_delete_at_hint.0000000066', 'obj_delete_at_hint.0000000068', 'obj_delete_at_hint.0000000085', 'obj_delete_at_hint.0000000073', 'obj_delete_at_hint.0000000038', 'obj_delete_at_hint.0000000118', 'obj_delete_at_hint.0000000036', 'obj_delete_at_hint.0000000103', 'obj_delete_at_hint.0000000119', 'obj_delete_at_hint.0000000098', 'obj_delete_at_hint.0000000027', 'obj_delete_at_hint.0000000019', 'obj_delete_at_hint.0000000039', 'obj_delete_at_hint.0000000100', 'obj_delete_at_hint.0000000093', 'obj_delete_at_hint.0000000004', 'obj_delete_at_hint.0000000063', 'obj_delete_at_hint.0000000122', 'obj_delete_at_hint.0000000057', 'obj_delete_at_hint.0000000054', 'obj_delete_at_hint.0000000114', 'data_log.0', 'obj_delete_at_hint.0000000012', 'obj_delete_at_hint.0000000084', 'obj_delete_at_hint.0000000043', 'obj_delete_at_hint.0000000111', 'obj_delete_at_hint.0000000048', 'obj_delete_at_hint.0000000020', 'obj_delete_at_hint.0000000099', 'obj_delete_at_hint.0000000056', 'obj_delete_at_hint.0000000072', 'obj_delete_at_hint.0000000062', 'obj_delete_at_hint.0000000115', 'obj_delete_at_hint.0000000033', 'obj_delete_at_hint.0000000025', 'obj_delete_at_hint.0000000123', 'obj_delete_at_hint.0000000108', 'obj_delete_at_hint.0000000094', 'obj_delete_at_hint.0000000060', 'obj_delete_at_hint.0000000109', 'obj_delete_at_hint.0000000013', 'obj_delete_at_hint.0000000051', 'obj_delete_at_hint.0000000106', 'obj_delete_at_hint.0000000017', 'obj_delete_at_hint.0000000023', 'obj_delete_at_hint.0000000107', 'obj_delete_at_hint.0000000046', 'obj_delete_at_hint.0000000067', 'obj_delete_at_hint.0000000086', 'obj_delete_at_hint.0000000050', 'obj_delete_at_hint.0000000102', 'obj_delete_at_hint.0000000124', 'obj_delete_at_hint.0000000001', 'obj_delete_at_hint.0000000126', 'obj_delete_at_hint.0000000055', 'obj_delete_at_hint.0000000061', 'obj_delete_at_hint.0000000097', 'obj_delete_at_hint.0000000042', 'obj_delete_at_hint.0000000075', 'obj_delete_at_hint.0000000120', 'obj_delete_at_hint.0000000030'] 2024-09-22T08:36:48.715 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'suspend', '--uid', 'foo'] 2024-09-22T08:36:48.715 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'suspend', '--uid', 'foo'] 2024-09-22T08:36:48.715 DEBUG:teuthology.orchestra.run.smithi142:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user suspend --uid foo 2024-09-22T08:36:48.799 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:36:48.800 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:36:48.801 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.799+0000 7f0f58c13800 1 Processor -- start 2024-09-22T08:36:48.801 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.799+0000 7f0f58c13800 1 -- start start 2024-09-22T08:36:48.801 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.799+0000 7f0f58c13800 1 --2- >> v2:172.21.15.31:3300/0 conn(0x5596b92d3d10 0x5596b93654a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:48.801 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.799+0000 7f0f58c13800 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5596b91eba20 con 0x5596b9365a10 2024-09-22T08:36:48.801 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.799+0000 7f0f58c13800 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x5596b91eb7d0 con 0x5596b92d3d10 2024-09-22T08:36:48.801 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.800+0000 7f0f54348640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x5596b92d3d10 0x5596b93654a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:48.801 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.800+0000 7f0f53b47640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x5596b9365a10 0x5596b9367ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.142:44802/0 (socket says 172.21.15.142:44802) 2024-09-22T08:36:48.802 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.800+0000 7f0f54348640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x5596b92d3d10 0x5596b93654a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:48902/0 (socket says 172.21.15.142:48902) 2024-09-22T08:36:48.802 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.800+0000 7f0f53b47640 1 -- 172.21.15.142:0/3537559019 learned_addr learned my addr 172.21.15.142:0/3537559019 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-09-22T08:36:48.802 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.800+0000 7f0f54348640 1 -- 172.21.15.142:0/3537559019 >> v1:172.21.15.31:6789/0 conn(0x5596b9365a10 legacy=0x5596b9367ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:48.802 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.800+0000 7f0f54348640 1 -- 172.21.15.142:0/3537559019 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5596b936a7c0 con 0x5596b92d3d10 2024-09-22T08:36:48.803 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.802+0000 7f0f54348640 1 --2- 172.21.15.142:0/3537559019 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5596b92d3d10 0x5596b93654a0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f0f4c00a470 tx=0x7f0f4c045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca3991eb6a53107f server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:48.804 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.802+0000 7f0f53346640 1 -- 172.21.15.142:0/3537559019 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f4c053570 con 0x5596b92d3d10 2024-09-22T08:36:48.804 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.802+0000 7f0f53346640 1 -- 172.21.15.142:0/3537559019 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f4c058070 con 0x5596b92d3d10 2024-09-22T08:36:48.804 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.802+0000 7f0f53346640 1 -- 172.21.15.142:0/3537559019 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f4c053880 con 0x5596b92d3d10 2024-09-22T08:36:48.804 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.802+0000 7f0f58c13800 1 -- 172.21.15.142:0/3537559019 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5596b92d3d10 msgr2=0x5596b93654a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:48.804 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.802+0000 7f0f58c13800 1 --2- 172.21.15.142:0/3537559019 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5596b92d3d10 0x5596b93654a0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f0f4c00a470 tx=0x7f0f4c045a20 comp rx=0 tx=0).stop 2024-09-22T08:36:48.804 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.802+0000 7f0f58c13800 1 -- 172.21.15.142:0/3537559019 shutdown_connections 2024-09-22T08:36:48.804 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.802+0000 7f0f58c13800 1 --2- 172.21.15.142:0/3537559019 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5596b92d3d10 0x5596b93654a0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:48.804 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.802+0000 7f0f58c13800 1 -- 172.21.15.142:0/3537559019 >> 172.21.15.142:0/3537559019 conn(0x5596b935abb0 msgr2=0x5596b935d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:48.804 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.802+0000 7f0f58c13800 1 -- 172.21.15.142:0/3537559019 shutdown_connections 2024-09-22T08:36:48.804 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.803+0000 7f0f58c13800 1 -- 172.21.15.142:0/3537559019 wait complete. 2024-09-22T08:36:48.819 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.816+0000 7f0f58c13800 1 Processor -- start 2024-09-22T08:36:48.819 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.816+0000 7f0f58c13800 1 -- start start 2024-09-22T08:36:48.819 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.817+0000 7f0f58c13800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5596b92d3d10 0x5596b9452230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:48.819 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.817+0000 7f0f58c13800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5596b91f8dd0 con 0x5596b92d3d10 2024-09-22T08:36:48.819 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.817+0000 7f0f54348640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5596b92d3d10 0x5596b9452230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:48.819 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.817+0000 7f0f54348640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5596b92d3d10 0x5596b9452230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:48918/0 (socket says 172.21.15.142:48918) 2024-09-22T08:36:48.819 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.817+0000 7f0f54348640 1 -- 172.21.15.142:0/147370430 learned_addr learned my addr 172.21.15.142:0/147370430 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:48.819 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.817+0000 7f0f54348640 1 -- 172.21.15.142:0/147370430 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5596b9452820 con 0x5596b92d3d10 2024-09-22T08:36:48.819 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.817+0000 7f0f54348640 1 --2- 172.21.15.142:0/147370430 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5596b92d3d10 0x5596b9452230 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f0f4c025c20 tx=0x7f0f4c051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=692b3d2686cc14c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:48.819 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.817+0000 7f0e4260c640 1 -- 172.21.15.142:0/147370430 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f4c053a20 con 0x5596b92d3d10 2024-09-22T08:36:48.819 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.818+0000 7f0e4260c640 1 -- 172.21.15.142:0/147370430 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f4c063070 con 0x5596b92d3d10 2024-09-22T08:36:48.820 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.818+0000 7f0e4260c640 1 -- 172.21.15.142:0/147370430 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f4c053cf0 con 0x5596b92d3d10 2024-09-22T08:36:48.822 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.818+0000 7f0f58c13800 1 -- 172.21.15.142:0/147370430 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5596b92d3d10 msgr2=0x5596b9452230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:48.822 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.818+0000 7f0f58c13800 1 --2- 172.21.15.142:0/147370430 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5596b92d3d10 0x5596b9452230 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f0f4c025c20 tx=0x7f0f4c051000 comp rx=0 tx=0).stop 2024-09-22T08:36:48.822 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.818+0000 7f0f58c13800 1 -- 172.21.15.142:0/147370430 shutdown_connections 2024-09-22T08:36:48.823 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.818+0000 7f0f58c13800 1 --2- 172.21.15.142:0/147370430 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5596b92d3d10 0x5596b9452230 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:48.823 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.818+0000 7f0f58c13800 1 -- 172.21.15.142:0/147370430 >> 172.21.15.142:0/147370430 conn(0x5596b935abb0 msgr2=0x5596b944dbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:48.823 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.818+0000 7f0f58c13800 1 -- 172.21.15.142:0/147370430 shutdown_connections 2024-09-22T08:36:48.823 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.818+0000 7f0f58c13800 1 -- 172.21.15.142:0/147370430 wait complete. 2024-09-22T08:36:48.823 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.819+0000 7f0f58c13800 1 Processor -- start 2024-09-22T08:36:48.823 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.819+0000 7f0f58c13800 1 -- start start 2024-09-22T08:36:48.823 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.819+0000 7f0f58c13800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5596b92d3d10 0x5596b9459ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:48.823 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.819+0000 7f0f58c13800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5596b9369a60 con 0x5596b92d3d10 2024-09-22T08:36:48.823 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.819+0000 7f0f54348640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5596b92d3d10 0x5596b9459ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:48.823 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.819+0000 7f0f54348640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5596b92d3d10 0x5596b9459ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:48920/0 (socket says 172.21.15.142:48920) 2024-09-22T08:36:48.823 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.819+0000 7f0f54348640 1 -- 172.21.15.142:0/3869355357 learned_addr learned my addr 172.21.15.142:0/3869355357 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:48.823 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.819+0000 7f0f54348640 1 -- 172.21.15.142:0/3869355357 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5596b945a240 con 0x5596b92d3d10 2024-09-22T08:36:48.823 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.820+0000 7f0f54348640 1 --2- 172.21.15.142:0/3869355357 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5596b92d3d10 0x5596b9459ce0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f0f4c025c20 tx=0x7f0f4c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:48.824 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.820+0000 7f0e40e09640 1 -- 172.21.15.142:0/3869355357 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f4c068660 con 0x5596b92d3d10 2024-09-22T08:36:48.824 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.820+0000 7f0e40e09640 1 -- 172.21.15.142:0/3869355357 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f4c068800 con 0x5596b92d3d10 2024-09-22T08:36:48.824 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.820+0000 7f0f58c13800 1 -- 172.21.15.142:0/3869355357 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5596b945a4d0 con 0x5596b92d3d10 2024-09-22T08:36:48.824 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.820+0000 7f0e40e09640 1 -- 172.21.15.142:0/3869355357 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f4c068ae0 con 0x5596b92d3d10 2024-09-22T08:36:48.824 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.820+0000 7f0f58c13800 1 -- 172.21.15.142:0/3869355357 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5596b945b0e0 con 0x5596b92d3d10 2024-09-22T08:36:48.824 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.821+0000 7f0e40e09640 1 -- 172.21.15.142:0/3869355357 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f0f4c068c80 con 0x5596b92d3d10 2024-09-22T08:36:48.824 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.821+0000 7f0e40e09640 1 --2- 172.21.15.142:0/3869355357 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f0e3c03cfb0 0x7f0e3c03f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:48.824 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.821+0000 7f0e40e09640 1 -- 172.21.15.142:0/3869355357 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f0f4c098bf0 con 0x5596b92d3d10 2024-09-22T08:36:48.824 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.821+0000 7f0f53b47640 1 --2- 172.21.15.142:0/3869355357 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f0e3c03cfb0 0x7f0e3c03f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:48.824 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.821+0000 7f0f58c13800 1 --2- 172.21.15.142:0/3869355357 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5596b9365a10 0x5596b9461330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:48.824 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.821+0000 7f0f58c13800 1 -- 172.21.15.142:0/3869355357 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5596b9461870 con 0x5596b9365a10 2024-09-22T08:36:48.824 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.821+0000 7f0f54b49640 1 --2- 172.21.15.142:0/3869355357 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5596b9365a10 0x5596b9461330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:48.824 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.821+0000 7f0f53b47640 1 --2- 172.21.15.142:0/3869355357 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f0e3c03cfb0 0x7f0e3c03f470 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f0f3c001d70 tx=0x7f0f3c0012d0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:48.825 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.821+0000 7f0f54b49640 1 --2- 172.21.15.142:0/3869355357 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5596b9365a10 0x5596b9461330 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:48.830 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.822+0000 7f0f54b49640 1 -- 172.21.15.142:0/3869355357 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0f4400a4d0 con 0x5596b9365a10 2024-09-22T08:36:48.830 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.822+0000 7f0f58c13800 1 -- 172.21.15.142:0/3869355357 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5596b9461c10 con 0x5596b9365a10 2024-09-22T08:36:48.830 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.822+0000 7f0f54b49640 1 -- 172.21.15.142:0/3869355357 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0f4400a4d0 con 0x5596b9365a10 2024-09-22T08:36:48.830 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.822+0000 7f0f58c13800 1 --2- 172.21.15.142:0/3869355357 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5596b94636d0 0x5596b9465b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:48.830 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.822+0000 7f0f58c13800 1 -- 172.21.15.142:0/3869355357 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:3 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5596b9466300 con 0x5596b94636d0 2024-09-22T08:36:48.830 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.822+0000 7f0f54348640 1 --2- 172.21.15.142:0/3869355357 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5596b94636d0 0x5596b9465b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:48.831 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.822+0000 7f0f54348640 1 --2- 172.21.15.142:0/3869355357 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5596b94636d0 0x5596b9465b70 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:48.831 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.823+0000 7f0f54348640 1 -- 172.21.15.142:0/3869355357 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(3 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f0f4c051070 con 0x5596b94636d0 2024-09-22T08:36:48.831 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.823+0000 7f0f58c13800 1 -- 172.21.15.142:0/3869355357 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5596b9462460 con 0x5596b9365a10 2024-09-22T08:36:48.831 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.823+0000 7f0f54b49640 1 -- 172.21.15.142:0/3869355357 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0f4400a4d0 con 0x5596b9365a10 2024-09-22T08:36:48.831 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.823+0000 7f0f58c13800 1 -- 172.21.15.142:0/3869355357 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5596b9462840 con 0x5596b94636d0 2024-09-22T08:36:48.831 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.823+0000 7f0f54348640 1 -- 172.21.15.142:0/3869355357 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(5 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f0f4c051070 con 0x5596b94636d0 2024-09-22T08:36:48.831 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.823+0000 7f0f58c13800 1 Processor -- start 2024-09-22T08:36:48.831 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.824+0000 7f0f58c13800 1 -- start start 2024-09-22T08:36:48.831 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.824+0000 7f0f58c13800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5596b9474cc0 0x5596b94750e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:48.831 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.824+0000 7f0f58c13800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5596b9257d50 con 0x5596b9474cc0 2024-09-22T08:36:48.831 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.824+0000 7f0f54b49640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5596b9474cc0 0x5596b94750e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:48.831 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.824+0000 7f0f54b49640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5596b9474cc0 0x5596b94750e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:48936/0 (socket says 172.21.15.142:48936) 2024-09-22T08:36:48.831 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.824+0000 7f0f54b49640 1 -- 172.21.15.142:0/1887601593 learned_addr learned my addr 172.21.15.142:0/1887601593 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:48.832 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.824+0000 7f0f54b49640 1 -- 172.21.15.142:0/1887601593 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5596b9475720 con 0x5596b9474cc0 2024-09-22T08:36:48.832 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.824+0000 7f0f54b49640 1 --2- 172.21.15.142:0/1887601593 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5596b9474cc0 0x5596b94750e0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x5596b945ace0 tx=0x7f0f440167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:48.832 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.825+0000 7f0e39ffb640 1 -- 172.21.15.142:0/1887601593 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f44013640 con 0x5596b9474cc0 2024-09-22T08:36:48.832 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.825+0000 7f0e39ffb640 1 -- 172.21.15.142:0/1887601593 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f440137e0 con 0x5596b9474cc0 2024-09-22T08:36:48.832 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.825+0000 7f0e39ffb640 1 -- 172.21.15.142:0/1887601593 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f44013ae0 con 0x5596b9474cc0 2024-09-22T08:36:48.832 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.825+0000 7f0f58c13800 1 -- 172.21.15.142:0/1887601593 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5596b9475f50 con 0x5596b9474cc0 2024-09-22T08:36:48.832 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.825+0000 7f0f58c13800 1 -- 172.21.15.142:0/1887601593 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5596b94764f0 con 0x5596b9474cc0 2024-09-22T08:36:48.832 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.826+0000 7f0e39ffb640 1 -- 172.21.15.142:0/1887601593 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f0f44011040 con 0x5596b9474cc0 2024-09-22T08:36:48.832 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.826+0000 7f0e39ffb640 1 --2- 172.21.15.142:0/1887601593 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f0e2c03cfb0 0x7f0e2c03f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:48.832 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.826+0000 7f0e39ffb640 1 -- 172.21.15.142:0/1887601593 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f0f4400e040 con 0x5596b9474cc0 2024-09-22T08:36:48.832 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.826+0000 7f0f54348640 1 --2- 172.21.15.142:0/1887601593 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f0e2c03cfb0 0x7f0e2c03f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:48.832 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.826+0000 7f0f58c13800 1 Processor -- start 2024-09-22T08:36:48.832 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.826+0000 7f0f54348640 1 --2- 172.21.15.142:0/1887601593 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f0e2c03cfb0 0x7f0e2c03f470 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x5596b945bde0 tx=0x7f0f4c05da60 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:48.832 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.826+0000 7f0f58c13800 1 -- start start 2024-09-22T08:36:48.833 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.826+0000 7f0f58c13800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5596b94817e0 0x5596b9481be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:48.833 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.826+0000 7f0f58c13800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5596b9452bf0 con 0x5596b94817e0 2024-09-22T08:36:48.833 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.826+0000 7f0f54b49640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5596b94817e0 0x5596b9481be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:48.833 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.827+0000 7f0f54b49640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5596b94817e0 0x5596b9481be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:48944/0 (socket says 172.21.15.142:48944) 2024-09-22T08:36:48.833 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.827+0000 7f0f54b49640 1 -- 172.21.15.142:0/641173674 learned_addr learned my addr 172.21.15.142:0/641173674 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:48.833 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.827+0000 7f0f54b49640 1 -- 172.21.15.142:0/641173674 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5596b94821d0 con 0x5596b94817e0 2024-09-22T08:36:48.833 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.827+0000 7f0f54b49640 1 --2- 172.21.15.142:0/641173674 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5596b94817e0 0x5596b9481be0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f0f44020000 tx=0x7f0f4401f400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11016fa5a68c496f server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:48.833 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.827+0000 7f0e2b7fe640 1 -- 172.21.15.142:0/641173674 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f44051020 con 0x5596b94817e0 2024-09-22T08:36:48.833 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.827+0000 7f0e2b7fe640 1 -- 172.21.15.142:0/641173674 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f44021960 con 0x5596b94817e0 2024-09-22T08:36:48.833 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.827+0000 7f0e2b7fe640 1 -- 172.21.15.142:0/641173674 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f44021440 con 0x5596b94817e0 2024-09-22T08:36:48.833 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.827+0000 7f0f58c13800 1 -- 172.21.15.142:0/641173674 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5596b94817e0 msgr2=0x5596b9481be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:48.833 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.827+0000 7f0f58c13800 1 --2- 172.21.15.142:0/641173674 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5596b94817e0 0x5596b9481be0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f0f44020000 tx=0x7f0f4401f400 comp rx=0 tx=0).stop 2024-09-22T08:36:48.833 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.828+0000 7f0f58c13800 1 -- 172.21.15.142:0/641173674 shutdown_connections 2024-09-22T08:36:48.834 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.828+0000 7f0f58c13800 1 --2- 172.21.15.142:0/641173674 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5596b94817e0 0x5596b9481be0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:48.834 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.828+0000 7f0f58c13800 1 -- 172.21.15.142:0/641173674 >> 172.21.15.142:0/641173674 conn(0x5596b947dbe0 msgr2=0x5596b947be20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:48.834 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.828+0000 7f0f58c13800 1 -- 172.21.15.142:0/641173674 shutdown_connections 2024-09-22T08:36:48.834 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.828+0000 7f0f58c13800 1 -- 172.21.15.142:0/641173674 wait complete. 2024-09-22T08:36:48.834 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.828+0000 7f0f58c13800 1 Processor -- start 2024-09-22T08:36:48.834 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.828+0000 7f0f58c13800 1 -- start start 2024-09-22T08:36:48.834 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.828+0000 7f0f58c13800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5596b94817e0 0x5596b9488d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:48.834 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.828+0000 7f0f58c13800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5596b94827f0 con 0x5596b94817e0 2024-09-22T08:36:48.834 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.828+0000 7f0f54b49640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5596b94817e0 0x5596b9488d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:48.834 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.828+0000 7f0f54b49640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5596b94817e0 0x5596b9488d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:48958/0 (socket says 172.21.15.142:48958) 2024-09-22T08:36:48.834 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.828+0000 7f0f54b49640 1 -- 172.21.15.142:0/436982125 learned_addr learned my addr 172.21.15.142:0/436982125 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:48.834 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.828+0000 7f0f54b49640 1 -- 172.21.15.142:0/436982125 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5596b94892f0 con 0x5596b94817e0 2024-09-22T08:36:48.834 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.829+0000 7f0f54b49640 1 --2- 172.21.15.142:0/436982125 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5596b94817e0 0x5596b9488d90 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f0f44054800 tx=0x7f0f44054860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:48.835 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.829+0000 7f0e29ffb640 1 -- 172.21.15.142:0/436982125 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f44056110 con 0x5596b94817e0 2024-09-22T08:36:48.835 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.829+0000 7f0e29ffb640 1 -- 172.21.15.142:0/436982125 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f4404c070 con 0x5596b94817e0 2024-09-22T08:36:48.835 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.829+0000 7f0e29ffb640 1 -- 172.21.15.142:0/436982125 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f4401f500 con 0x5596b94817e0 2024-09-22T08:36:48.835 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.829+0000 7f0f58c13800 1 -- 172.21.15.142:0/436982125 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5596b9489580 con 0x5596b94817e0 2024-09-22T08:36:48.835 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.829+0000 7f0f58c13800 1 -- 172.21.15.142:0/436982125 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5596b9489f00 con 0x5596b94817e0 2024-09-22T08:36:48.846 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.830+0000 7f0e29ffb640 1 -- 172.21.15.142:0/436982125 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f0f4401f6a0 con 0x5596b94817e0 2024-09-22T08:36:48.847 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.830+0000 7f0e29ffb640 1 --2- 172.21.15.142:0/436982125 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f0e1c03cfb0 0x7f0e1c03f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:48.847 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.830+0000 7f0e29ffb640 1 -- 172.21.15.142:0/436982125 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f0f4403da90 con 0x5596b94817e0 2024-09-22T08:36:48.847 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.830+0000 7f0f54348640 1 --2- 172.21.15.142:0/436982125 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f0e1c03cfb0 0x7f0e1c03f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:48.847 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.830+0000 7f0f54348640 1 --2- 172.21.15.142:0/436982125 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f0e1c03cfb0 0x7f0e1c03f470 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f0f4c097430 tx=0x7f0f4c089000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:48.847 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.830+0000 7f0f58c13800 20 rados->read ofs=0 len=0 2024-09-22T08:36:48.847 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.830+0000 7f0f58c13800 1 --2- 172.21.15.142:0/436982125 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5596b9494750 0x5596b9496c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:48.847 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.830+0000 7f0f58c13800 1 -- 172.21.15.142:0/436982125 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5596b9497360 con 0x5596b9494750 2024-09-22T08:36:48.847 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.830+0000 7f0f53b47640 1 --2- 172.21.15.142:0/436982125 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5596b9494750 0x5596b9496c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:48.847 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.831+0000 7f0f53b47640 1 --2- 172.21.15.142:0/436982125 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5596b9494750 0x5596b9496c10 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:48.847 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.831+0000 7f0f53b47640 1 -- 172.21.15.142:0/436982125 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0f3c009050 con 0x5596b9494750 2024-09-22T08:36:48.847 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.831+0000 7f0f58c13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:48.847 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.831+0000 7f0f58c13800 20 realm 2024-09-22T08:36:48.847 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.831+0000 7f0f58c13800 20 rados->read ofs=0 len=0 2024-09-22T08:36:48.848 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.831+0000 7f0f58c13800 1 -- 172.21.15.142:0/436982125 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5596b9493ae0 con 0x5596b9494750 2024-09-22T08:36:48.848 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.831+0000 7f0f53b47640 1 -- 172.21.15.142:0/436982125 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0f3c009050 con 0x5596b9494750 2024-09-22T08:36:48.848 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.831+0000 7f0f58c13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:48.848 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.831+0000 7f0f58c13800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:36:48.848 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.831+0000 7f0f58c13800 20 rados->read ofs=0 len=0 2024-09-22T08:36:48.848 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.831+0000 7f0f58c13800 1 -- 172.21.15.142:0/436982125 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5596b9497e50 con 0x5596b9494750 2024-09-22T08:36:48.848 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.831+0000 7f0f53b47640 1 -- 172.21.15.142:0/436982125 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0f3c009050 con 0x5596b9494750 2024-09-22T08:36:48.848 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.831+0000 7f0f58c13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:48.848 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.831+0000 7f0f58c13800 20 rados->read ofs=0 len=0 2024-09-22T08:36:48.848 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.831+0000 7f0f58c13800 1 -- 172.21.15.142:0/436982125 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5596b9498720 con 0x5596b9494750 2024-09-22T08:36:48.848 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.832+0000 7f0f53b47640 1 -- 172.21.15.142:0/436982125 <== osd.1 v2:172.21.15.142:6816/3192108003 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0f3c009050 con 0x5596b9494750 2024-09-22T08:36:48.848 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.832+0000 7f0f58c13800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:36:48.848 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.832+0000 7f0f58c13800 20 rados->read ofs=0 len=0 2024-09-22T08:36:48.848 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.832+0000 7f0f58c13800 1 --2- 172.21.15.142:0/436982125 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5596b9499140 0x5596b949b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:48.849 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.832+0000 7f0f58c13800 1 -- 172.21.15.142:0/436982125 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5596b949bc70 con 0x5596b9499140 2024-09-22T08:36:48.849 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.832+0000 7f0f54b49640 1 --2- 172.21.15.142:0/436982125 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5596b9499140 0x5596b949b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:48.849 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.832+0000 7f0f54b49640 1 --2- 172.21.15.142:0/436982125 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5596b9499140 0x5596b949b530 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:48.849 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.832+0000 7f0f54b49640 1 -- 172.21.15.142:0/436982125 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(5 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f0f4403a070 con 0x5596b9499140 2024-09-22T08:36:48.849 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.832+0000 7f0f58c13800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:36:48.849 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.832+0000 7f0f58c13800 20 searching for the correct realm 2024-09-22T08:36:48.849 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.832+0000 7f0f58c13800 1 -- 172.21.15.142:0/436982125 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5596b949d5a0 con 0x5596b9499140 2024-09-22T08:36:48.849 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.833+0000 7f0f54b49640 1 -- 172.21.15.142:0/436982125 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f4403a070 con 0x5596b9499140 2024-09-22T08:36:48.849 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.833+0000 7f0f54b49640 1 --2- 172.21.15.142:0/436982125 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f0f440323e0 0x7f0f4404d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:48.849 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.833+0000 7f0f54b49640 1 -- 172.21.15.142:0/436982125 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5596b949d5a0 con 0x7f0f440323e0 2024-09-22T08:36:48.849 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.833+0000 7f0f54348640 1 --2- 172.21.15.142:0/436982125 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f0f440323e0 0x7f0f4404d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:48.849 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.833+0000 7f0f54348640 1 --2- 172.21.15.142:0/436982125 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f0f440323e0 0x7f0f4404d480 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:48.849 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.833+0000 7f0f54348640 1 -- 172.21.15.142:0/436982125 <== osd.2 v2:172.21.15.142:6808/279438927 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f4c051070 con 0x7f0f440323e0 2024-09-22T08:36:48.849 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.833+0000 7f0f54348640 1 --2- 172.21.15.142:0/436982125 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f0f4c0a5040 0x7f0f4c074480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:48.850 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.833+0000 7f0f54348640 1 -- 172.21.15.142:0/436982125 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5596b949d5a0 con 0x7f0f4c0a5040 2024-09-22T08:36:48.850 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.833+0000 7f0f53b47640 1 --2- 172.21.15.142:0/436982125 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f0f4c0a5040 0x7f0f4c074480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:48.850 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.834+0000 7f0f53b47640 1 --2- 172.21.15.142:0/436982125 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f0f4c0a5040 0x7f0f4c074480 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:48.850 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.834+0000 7f0f53b47640 1 -- 172.21.15.142:0/436982125 <== osd.0 v2:172.21.15.31:6800/168281188 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f3c009050 con 0x7f0f4c0a5040 2024-09-22T08:36:48.850 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.834+0000 7f0f53b47640 1 -- 172.21.15.142:0/436982125 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5596b949d5a0 con 0x5596b9494750 2024-09-22T08:36:48.850 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.834+0000 7f0f53b47640 1 -- 172.21.15.142:0/436982125 <== osd.1 v2:172.21.15.142:6816/3192108003 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f3c009050 con 0x5596b9494750 2024-09-22T08:36:48.850 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.834+0000 7f0f53b47640 1 -- 172.21.15.142:0/436982125 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5596b949d5a0 con 0x5596b9494750 2024-09-22T08:36:48.850 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.834+0000 7f0f53b47640 1 -- 172.21.15.142:0/436982125 <== osd.1 v2:172.21.15.142:6816/3192108003 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f3c029040 con 0x5596b9494750 2024-09-22T08:36:48.850 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.834+0000 7f0f53b47640 1 -- 172.21.15.142:0/436982125 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5596b949d5a0 con 0x7f0f4c0a5040 2024-09-22T08:36:48.850 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.835+0000 7f0f53b47640 1 -- 172.21.15.142:0/436982125 <== osd.0 v2:172.21.15.31:6800/168281188 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f3c029040 con 0x7f0f4c0a5040 2024-09-22T08:36:48.850 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.835+0000 7f0f53b47640 1 -- 172.21.15.142:0/436982125 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5596b949d5a0 con 0x7f0f4c0a5040 2024-09-22T08:36:48.850 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.835+0000 7f0f53b47640 1 -- 172.21.15.142:0/436982125 <== osd.0 v2:172.21.15.31:6800/168281188 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f3c029040 con 0x7f0f4c0a5040 2024-09-22T08:36:48.850 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.835+0000 7f0f53b47640 1 -- 172.21.15.142:0/436982125 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5596b949d5a0 con 0x7f0f440323e0 2024-09-22T08:36:48.851 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.835+0000 7f0f54348640 1 -- 172.21.15.142:0/436982125 <== osd.2 v2:172.21.15.142:6808/279438927 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f4c051070 con 0x7f0f440323e0 2024-09-22T08:36:48.851 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.835+0000 7f0f54348640 1 -- 172.21.15.142:0/436982125 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5596b949d5a0 con 0x5596b9499140 2024-09-22T08:36:48.851 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.835+0000 7f0f54b49640 1 -- 172.21.15.142:0/436982125 <== osd.3 v2:172.21.15.142:6800/1064901393 3 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f4403a070 con 0x5596b9499140 2024-09-22T08:36:48.851 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.835+0000 7f0f54b49640 1 -- 172.21.15.142:0/436982125 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5596b949d5a0 con 0x5596b9494750 2024-09-22T08:36:48.851 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.836+0000 7f0f53b47640 1 -- 172.21.15.142:0/436982125 <== osd.1 v2:172.21.15.142:6816/3192108003 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f3c029040 con 0x5596b9494750 2024-09-22T08:36:48.851 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.836+0000 7f0f53b47640 1 -- 172.21.15.142:0/436982125 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5596b949d5a0 con 0x7f0f4c0a5040 2024-09-22T08:36:48.851 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.836+0000 7f0f53b47640 1 -- 172.21.15.142:0/436982125 <== osd.0 v2:172.21.15.31:6800/168281188 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f3c029040 con 0x7f0f4c0a5040 2024-09-22T08:36:48.851 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.836+0000 7f0f53b47640 1 -- 172.21.15.142:0/436982125 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5596b949d5a0 con 0x5596b9494750 2024-09-22T08:36:48.851 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.836+0000 7f0f53b47640 1 -- 172.21.15.142:0/436982125 <== osd.1 v2:172.21.15.142:6816/3192108003 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f3c029040 con 0x5596b9494750 2024-09-22T08:36:48.851 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.836+0000 7f0f53b47640 1 -- 172.21.15.142:0/436982125 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5596b949d5a0 con 0x7f0f440323e0 2024-09-22T08:36:48.851 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.836+0000 7f0f54348640 1 -- 172.21.15.142:0/436982125 <== osd.2 v2:172.21.15.142:6808/279438927 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f0f4c051070 con 0x7f0f440323e0 2024-09-22T08:36:48.851 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.836+0000 7f0f54348640 1 -- 172.21.15.142:0/436982125 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5596b949d5a0 con 0x5596b9499140 2024-09-22T08:36:48.851 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.837+0000 7f0f54b49640 1 -- 172.21.15.142:0/436982125 <== osd.3 v2:172.21.15.142:6800/1064901393 4 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f4403a070 con 0x5596b9499140 2024-09-22T08:36:48.852 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.837+0000 7f0f54b49640 1 -- 172.21.15.142:0/436982125 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5596b949d5a0 con 0x5596b9499140 2024-09-22T08:36:48.852 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.837+0000 7f0f54b49640 1 -- 172.21.15.142:0/436982125 <== osd.3 v2:172.21.15.142:6800/1064901393 5 ==== osd_op_reply(20 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f0f4403a070 con 0x5596b9499140 2024-09-22T08:36:48.852 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.837+0000 7f0f54b49640 1 -- 172.21.15.142:0/436982125 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5596b949d5a0 con 0x7f0f4c0a5040 2024-09-22T08:36:48.852 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.837+0000 7f0f53b47640 1 -- 172.21.15.142:0/436982125 <== osd.0 v2:172.21.15.31:6800/168281188 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f3c029040 con 0x7f0f4c0a5040 2024-09-22T08:36:48.852 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.837+0000 7f0f53b47640 1 -- 172.21.15.142:0/436982125 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5596b949d5a0 con 0x5596b9499140 2024-09-22T08:36:48.852 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.837+0000 7f0f54b49640 1 -- 172.21.15.142:0/436982125 <== osd.3 v2:172.21.15.142:6800/1064901393 6 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f4403a070 con 0x5596b9499140 2024-09-22T08:36:48.852 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.837+0000 7f0f54b49640 1 -- 172.21.15.142:0/436982125 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5596b949d5a0 con 0x5596b9499140 2024-09-22T08:36:48.852 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.838+0000 7f0f54b49640 1 -- 172.21.15.142:0/436982125 <== osd.3 v2:172.21.15.142:6800/1064901393 7 ==== osd_op_reply(23 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f0f4403a070 con 0x5596b9499140 2024-09-22T08:36:48.852 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.838+0000 7f0f54b49640 1 -- 172.21.15.142:0/436982125 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5596b949d5a0 con 0x5596b9494750 2024-09-22T08:36:48.852 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.838+0000 7f0f53b47640 1 -- 172.21.15.142:0/436982125 <== osd.1 v2:172.21.15.142:6816/3192108003 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f3c029040 con 0x5596b9494750 2024-09-22T08:36:48.852 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.838+0000 7f0f53b47640 1 -- 172.21.15.142:0/436982125 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5596b949d5a0 con 0x5596b9494750 2024-09-22T08:36:48.852 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.838+0000 7f0f53b47640 1 -- 172.21.15.142:0/436982125 <== osd.1 v2:172.21.15.142:6816/3192108003 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f0f3c029040 con 0x5596b9494750 2024-09-22T08:36:48.852 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.838+0000 7f0f53b47640 1 -- 172.21.15.142:0/436982125 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5596b949d5a0 con 0x7f0f4c0a5040 2024-09-22T08:36:48.852 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.838+0000 7f0f53b47640 1 -- 172.21.15.142:0/436982125 <== osd.0 v2:172.21.15.31:6800/168281188 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f3c029040 con 0x7f0f4c0a5040 2024-09-22T08:36:48.853 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.838+0000 7f0f53b47640 1 -- 172.21.15.142:0/436982125 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5596b949d5a0 con 0x5596b9499140 2024-09-22T08:36:48.853 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.838+0000 7f0f54b49640 1 -- 172.21.15.142:0/436982125 <== osd.3 v2:172.21.15.142:6800/1064901393 8 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f4403a070 con 0x5596b9499140 2024-09-22T08:36:48.853 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.838+0000 7f0f54b49640 1 -- 172.21.15.142:0/436982125 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5596b949d5a0 con 0x7f0f440323e0 2024-09-22T08:36:48.853 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.839+0000 7f0f54348640 1 -- 172.21.15.142:0/436982125 <== osd.2 v2:172.21.15.142:6808/279438927 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f4c051070 con 0x7f0f440323e0 2024-09-22T08:36:48.853 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.839+0000 7f0f54348640 1 -- 172.21.15.142:0/436982125 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5596b949d5a0 con 0x5596b9494750 2024-09-22T08:36:48.853 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.839+0000 7f0f53b47640 1 -- 172.21.15.142:0/436982125 <== osd.1 v2:172.21.15.142:6816/3192108003 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f3c029040 con 0x5596b9494750 2024-09-22T08:36:48.853 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.839+0000 7f0f53b47640 1 -- 172.21.15.142:0/436982125 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5596b949d5a0 con 0x7f0f4c0a5040 2024-09-22T08:36:48.853 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.839+0000 7f0f53b47640 1 -- 172.21.15.142:0/436982125 <== osd.0 v2:172.21.15.31:6800/168281188 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f3c029040 con 0x7f0f4c0a5040 2024-09-22T08:36:48.853 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.839+0000 7f0f53b47640 1 -- 172.21.15.142:0/436982125 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5596b949d5a0 con 0x5596b9499140 2024-09-22T08:36:48.853 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.839+0000 7f0f54b49640 1 -- 172.21.15.142:0/436982125 <== osd.3 v2:172.21.15.142:6800/1064901393 9 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f4403a070 con 0x5596b9499140 2024-09-22T08:36:48.853 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.840+0000 7f0f54b49640 1 -- 172.21.15.142:0/436982125 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5596b949d5a0 con 0x7f0f4c0a5040 2024-09-22T08:36:48.853 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.840+0000 7f0f53b47640 1 -- 172.21.15.142:0/436982125 <== osd.0 v2:172.21.15.31:6800/168281188 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f3c029040 con 0x7f0f4c0a5040 2024-09-22T08:36:48.853 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.840+0000 7f0f53b47640 1 -- 172.21.15.142:0/436982125 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5596b949d5a0 con 0x7f0f440323e0 2024-09-22T08:36:48.854 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.840+0000 7f0f54348640 1 -- 172.21.15.142:0/436982125 <== osd.2 v2:172.21.15.142:6808/279438927 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f4c051070 con 0x7f0f440323e0 2024-09-22T08:36:48.854 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.840+0000 7f0f54348640 1 -- 172.21.15.142:0/436982125 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5596b949d5a0 con 0x5596b9499140 2024-09-22T08:36:48.854 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.840+0000 7f0f54b49640 1 -- 172.21.15.142:0/436982125 <== osd.3 v2:172.21.15.142:6800/1064901393 10 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f4403a070 con 0x5596b9499140 2024-09-22T08:36:48.854 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.840+0000 7f0f54b49640 1 -- 172.21.15.142:0/436982125 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5596b949d5a0 con 0x7f0f4c0a5040 2024-09-22T08:36:48.854 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.841+0000 7f0f53b47640 1 -- 172.21.15.142:0/436982125 <== osd.0 v2:172.21.15.31:6800/168281188 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f3c029040 con 0x7f0f4c0a5040 2024-09-22T08:36:48.854 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.841+0000 7f0f53b47640 1 -- 172.21.15.142:0/436982125 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5596b949d5a0 con 0x5596b9494750 2024-09-22T08:36:48.854 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.841+0000 7f0f53b47640 1 -- 172.21.15.142:0/436982125 <== osd.1 v2:172.21.15.142:6816/3192108003 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f0f3c029040 con 0x5596b9494750 2024-09-22T08:36:48.854 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.841+0000 7f0f53b47640 1 -- 172.21.15.142:0/436982125 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5596b949d5a0 con 0x7f0f440323e0 2024-09-22T08:36:48.854 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.841+0000 7f0f54348640 1 -- 172.21.15.142:0/436982125 <== osd.2 v2:172.21.15.142:6808/279438927 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f4c051070 con 0x7f0f440323e0 2024-09-22T08:36:48.854 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.841+0000 7f0f58c13800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:36:48.854 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.841+0000 7f0f58c13800 20 RGWRados::pool_iterate: got zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec 2024-09-22T08:36:48.854 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.841+0000 7f0f58c13800 20 RGWRados::pool_iterate: got zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f 2024-09-22T08:36:48.854 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.841+0000 7f0f58c13800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:36:48.854 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.841+0000 7f0f58c13800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:36:48.855 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.841+0000 7f0f58c13800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:36:48.855 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.841+0000 7f0f58c13800 20 rados->read ofs=0 len=0 2024-09-22T08:36:48.855 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.841+0000 7f0f58c13800 1 -- 172.21.15.142:0/436982125 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5596b949c630 con 0x5596b9494750 2024-09-22T08:36:48.855 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.842+0000 7f0f53b47640 1 -- 172.21.15.142:0/436982125 <== osd.1 v2:172.21.15.142:6816/3192108003 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0f3c029040 con 0x5596b9494750 2024-09-22T08:36:48.855 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.842+0000 7f0f58c13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:48.855 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.842+0000 7f0f58c13800 20 rados->read ofs=0 len=0 2024-09-22T08:36:48.855 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.842+0000 7f0f58c13800 1 -- 172.21.15.142:0/436982125 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5596b949ce80 con 0x5596b9494750 2024-09-22T08:36:48.855 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.842+0000 7f0f53b47640 1 -- 172.21.15.142:0/436982125 <== osd.1 v2:172.21.15.142:6816/3192108003 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0f3c029040 con 0x5596b9494750 2024-09-22T08:36:48.855 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.842+0000 7f0f58c13800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:36:48.855 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.842+0000 7f0f58c13800 20 rados->read ofs=0 len=0 2024-09-22T08:36:48.855 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.842+0000 7f0f58c13800 1 -- 172.21.15.142:0/436982125 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:40 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5596b949da20 con 0x5596b9499140 2024-09-22T08:36:48.855 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.842+0000 7f0f54b49640 1 -- 172.21.15.142:0/436982125 <== osd.3 v2:172.21.15.142:6800/1064901393 11 ==== osd_op_reply(40 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f0f4403a070 con 0x5596b9499140 2024-09-22T08:36:48.855 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.842+0000 7f0f58c13800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:36:48.856 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.842+0000 7f0f58c13800 20 zone default found 2024-09-22T08:36:48.856 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.842+0000 7f0f58c13800 4 Realm: () 2024-09-22T08:36:48.856 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.842+0000 7f0f58c13800 4 ZoneGroup: default (d89f6f57-1007-47dd-9065-f486c7b01aec) 2024-09-22T08:36:48.856 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.842+0000 7f0f58c13800 4 Zone: default (e239248c-0bee-4e41-803a-24b288d3eb8f) 2024-09-22T08:36:48.856 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.842+0000 7f0f58c13800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:36:48.856 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.842+0000 7f0f58c13800 20 zonegroup default 2024-09-22T08:36:48.856 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.842+0000 7f0f58c13800 20 rados->read ofs=0 len=0 2024-09-22T08:36:48.856 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.842+0000 7f0f58c13800 1 -- 172.21.15.142:0/436982125 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5596b949ddc0 con 0x7f0f4c0a5040 2024-09-22T08:36:48.856 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.843+0000 7f0f53b47640 1 -- 172.21.15.142:0/436982125 <== osd.0 v2:172.21.15.31:6800/168281188 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f0f3c029040 con 0x7f0f4c0a5040 2024-09-22T08:36:48.856 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.843+0000 7f0f58c13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:48.856 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.843+0000 7f0f58c13800 20 rados->read ofs=0 len=0 2024-09-22T08:36:48.856 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.843+0000 7f0f58c13800 1 -- 172.21.15.142:0/436982125 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5596b94a0070 con 0x5596b9499140 2024-09-22T08:36:48.856 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.843+0000 7f0f54b49640 1 -- 172.21.15.142:0/436982125 <== osd.3 v2:172.21.15.142:6800/1064901393 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0f4403a070 con 0x5596b9499140 2024-09-22T08:36:48.856 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.843+0000 7f0f58c13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:48.857 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.843+0000 7f0f58c13800 20 rados->read ofs=0 len=0 2024-09-22T08:36:48.857 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.843+0000 7f0f58c13800 1 -- 172.21.15.142:0/436982125 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5596b94a0410 con 0x5596b9499140 2024-09-22T08:36:48.857 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.843+0000 7f0f54b49640 1 -- 172.21.15.142:0/436982125 <== osd.3 v2:172.21.15.142:6800/1064901393 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0f4403a070 con 0x5596b9499140 2024-09-22T08:36:48.857 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.843+0000 7f0f58c13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:48.857 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.843+0000 7f0f58c13800 20 started sync module instance, tier type = 2024-09-22T08:36:48.857 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.843+0000 7f0f58c13800 20 started zone id=e239248c-0bee-4e41-803a-24b288d3eb8f (name=default) with tier type = 2024-09-22T08:36:48.857 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.843+0000 7f0f58c13800 1 -- 172.21.15.142:0/436982125 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5596b949f500 con 0x7f0f440323e0 2024-09-22T08:36:48.857 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.844+0000 7f0f54348640 1 -- 172.21.15.142:0/436982125 <== osd.2 v2:172.21.15.142:6808/279438927 7 ==== osd_op_reply(44 notify.0 [create] v30'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f4c051070 con 0x7f0f440323e0 2024-09-22T08:36:48.857 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.844+0000 7f0f58c13800 1 -- 172.21.15.142:0/436982125 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94105842088176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5596b949f160 con 0x7f0f440323e0 2024-09-22T08:36:48.857 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.844+0000 7f0f58c13800 1 -- 172.21.15.142:0/436982125 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5596b94a1240 con 0x5596b9494750 2024-09-22T08:36:48.857 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.845+0000 7f0f54348640 1 -- 172.21.15.142:0/436982125 <== osd.2 v2:172.21.15.142:6808/279438927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94105842088176] v30'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f4c051070 con 0x7f0f440323e0 2024-09-22T08:36:48.857 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.845+0000 7f0f53b47640 1 -- 172.21.15.142:0/436982125 <== osd.1 v2:172.21.15.142:6816/3192108003 15 ==== osd_op_reply(46 notify.1 [create] v30'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f3c029040 con 0x5596b9494750 2024-09-22T08:36:48.857 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.845+0000 7f0f58c13800 1 -- 172.21.15.142:0/436982125 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94105842092192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5596b94a1660 con 0x5596b9494750 2024-09-22T08:36:48.857 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.845+0000 7f0f58c13800 1 -- 172.21.15.142:0/436982125 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5596b94a2080 con 0x5596b9499140 2024-09-22T08:36:48.863 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.847+0000 7f0f54b49640 1 -- 172.21.15.142:0/436982125 <== osd.3 v2:172.21.15.142:6800/1064901393 14 ==== osd_op_reply(48 notify.2 [create] v30'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f4403a070 con 0x5596b9499140 2024-09-22T08:36:48.863 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.847+0000 7f0f58c13800 1 -- 172.21.15.142:0/436982125 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94105842097008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5596b94a2080 con 0x5596b9499140 2024-09-22T08:36:48.864 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.847+0000 7f0f58c13800 1 -- 172.21.15.142:0/436982125 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5596b94a3080 con 0x7f0f440323e0 2024-09-22T08:36:48.864 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.847+0000 7f0f53b47640 1 -- 172.21.15.142:0/436982125 <== osd.1 v2:172.21.15.142:6816/3192108003 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94105842092192] v30'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f3c029040 con 0x5596b9494750 2024-09-22T08:36:48.864 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.848+0000 7f0f54b49640 1 -- 172.21.15.142:0/436982125 <== osd.3 v2:172.21.15.142:6800/1064901393 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94105842097008] v30'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f4403a070 con 0x5596b9499140 2024-09-22T08:36:48.864 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.848+0000 7f0f54348640 1 -- 172.21.15.142:0/436982125 <== osd.2 v2:172.21.15.142:6808/279438927 9 ==== osd_op_reply(50 notify.3 [create] v30'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f4c051070 con 0x7f0f440323e0 2024-09-22T08:36:48.864 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.848+0000 7f0f58c13800 1 -- 172.21.15.142:0/436982125 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94105842099360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5596b94a3040 con 0x7f0f440323e0 2024-09-22T08:36:48.864 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.848+0000 7f0f58c13800 1 -- 172.21.15.142:0/436982125 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5596b94a3920 con 0x5596b9494750 2024-09-22T08:36:48.864 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.849+0000 7f0f54348640 1 -- 172.21.15.142:0/436982125 <== osd.2 v2:172.21.15.142:6808/279438927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94105842099360] v30'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f4c051070 con 0x7f0f440323e0 2024-09-22T08:36:48.864 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.849+0000 7f0f53b47640 1 -- 172.21.15.142:0/436982125 <== osd.1 v2:172.21.15.142:6816/3192108003 17 ==== osd_op_reply(52 notify.4 [create] v30'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f3c029040 con 0x5596b9494750 2024-09-22T08:36:48.864 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.849+0000 7f0f58c13800 1 -- 172.21.15.142:0/436982125 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94105842101104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5596b94a3040 con 0x5596b9494750 2024-09-22T08:36:48.864 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.849+0000 7f0f58c13800 1 -- 172.21.15.142:0/436982125 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5596b94a40a0 con 0x7f0f4c0a5040 2024-09-22T08:36:48.864 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.850+0000 7f0f53b47640 1 -- 172.21.15.142:0/436982125 <== osd.0 v2:172.21.15.31:6800/168281188 11 ==== osd_op_reply(54 notify.5 [create] v30'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f3c029040 con 0x7f0f4c0a5040 2024-09-22T08:36:48.864 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.850+0000 7f0f58c13800 1 -- 172.21.15.142:0/436982125 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94105842105200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5596b94a4060 con 0x7f0f4c0a5040 2024-09-22T08:36:48.864 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.850+0000 7f0f58c13800 1 -- 172.21.15.142:0/436982125 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5596b94a5060 con 0x7f0f4c0a5040 2024-09-22T08:36:48.865 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.851+0000 7f0f53b47640 1 -- 172.21.15.142:0/436982125 <== osd.1 v2:172.21.15.142:6816/3192108003 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94105842101104] v30'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f3c029040 con 0x5596b9494750 2024-09-22T08:36:48.865 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.852+0000 7f0f53b47640 1 -- 172.21.15.142:0/436982125 <== osd.0 v2:172.21.15.31:6800/168281188 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94105842105200] v30'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f3c029040 con 0x7f0f4c0a5040 2024-09-22T08:36:48.865 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.852+0000 7f0f53b47640 1 -- 172.21.15.142:0/436982125 <== osd.0 v2:172.21.15.31:6800/168281188 13 ==== osd_op_reply(56 notify.6 [create] v30'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f3c029040 con 0x7f0f4c0a5040 2024-09-22T08:36:48.865 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.852+0000 7f0f58c13800 1 -- 172.21.15.142:0/436982125 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94105842107536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5596b94a3470 con 0x7f0f4c0a5040 2024-09-22T08:36:48.865 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.852+0000 7f0f58c13800 1 -- 172.21.15.142:0/436982125 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5596b94a5510 con 0x7f0f4c0a5040 2024-09-22T08:36:48.865 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.853+0000 7f0f53b47640 1 -- 172.21.15.142:0/436982125 <== osd.0 v2:172.21.15.31:6800/168281188 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94105842107536] v30'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f3c029040 con 0x7f0f4c0a5040 2024-09-22T08:36:48.865 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.855+0000 7f0f53b47640 1 -- 172.21.15.142:0/436982125 <== osd.0 v2:172.21.15.31:6800/168281188 15 ==== osd_op_reply(58 notify.7 [create] v30'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f3c029040 con 0x7f0f4c0a5040 2024-09-22T08:36:48.865 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.856+0000 7f0f58c13800 1 -- 172.21.15.142:0/436982125 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94105842109328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5596b94a5510 con 0x7f0f4c0a5040 2024-09-22T08:36:48.865 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.856+0000 7f0f58c13800 20 add_watcher() i=0 2024-09-22T08:36:48.865 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.856+0000 7f0f58c13800 20 add_watcher() i=1 2024-09-22T08:36:48.865 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.856+0000 7f0f58c13800 20 add_watcher() i=2 2024-09-22T08:36:48.865 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.856+0000 7f0f58c13800 20 add_watcher() i=3 2024-09-22T08:36:48.865 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.856+0000 7f0f58c13800 20 add_watcher() i=4 2024-09-22T08:36:48.865 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.856+0000 7f0f58c13800 20 add_watcher() i=5 2024-09-22T08:36:48.866 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.856+0000 7f0f58c13800 20 add_watcher() i=6 2024-09-22T08:36:48.866 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.857+0000 7f0f53b47640 1 -- 172.21.15.142:0/436982125 <== osd.0 v2:172.21.15.31:6800/168281188 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94105842109328] v30'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f3c029040 con 0x7f0f4c0a5040 2024-09-22T08:36:48.866 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.857+0000 7f0f58c13800 20 add_watcher() i=7 2024-09-22T08:36:48.866 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.857+0000 7f0f58c13800 2 all 8 watchers are set, enabling cache 2024-09-22T08:36:48.866 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.857+0000 7f0f58c13800 1 -- 172.21.15.142:0/436982125 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5596b94a89b0 con 0x5596b9494750 2024-09-22T08:36:48.866 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.857+0000 7f0f53b47640 1 -- 172.21.15.142:0/436982125 <== osd.1 v2:172.21.15.142:6816/3192108003 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f0f3c029040 con 0x5596b9494750 2024-09-22T08:36:48.866 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.857+0000 7f0f58c13800 1 -- 172.21.15.142:0/436982125 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94105842123728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5596b94a5680 con 0x5596b9494750 2024-09-22T08:36:48.866 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.858+0000 7f0f53b47640 1 -- 172.21.15.142:0/436982125 <== osd.1 v2:172.21.15.142:6816/3192108003 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94105842123728] v30'148 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0f3c029040 con 0x5596b9494750 2024-09-22T08:36:48.866 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.858+0000 7f0e0b7de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:36:48.866 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.858+0000 7f0f58c13800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:36:48.866 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.858+0000 7f0f58c13800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:36:48.866 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.858+0000 7f0f58c13800 5 note: GC not initialized 2024-09-22T08:36:48.866 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.859+0000 7f0e0a7dc640 20 reqs_thread_entry: start 2024-09-22T08:36:48.867 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.859+0000 7f0f58c13800 20 init_complete bucket index max shards: 11 2024-09-22T08:36:48.867 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.859+0000 7f0f58c13800 20 Filter name: none 2024-09-22T08:36:48.867 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.859+0000 7f0e037fe640 20 reqs_thread_entry: start 2024-09-22T08:36:48.867 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.859+0000 7f0f58c13800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-22T08:36:48.867 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.859+0000 7f0f58c13800 20 rados->read ofs=0 len=0 2024-09-22T08:36:48.867 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.859+0000 7f0f58c13800 1 -- 172.21.15.142:0/436982125 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5596b94dbd30 con 0x5596b9494750 2024-09-22T08:36:48.867 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.859+0000 7f0f53b47640 1 -- 172.21.15.142:0/436982125 <== osd.1 v2:172.21.15.142:6816/3192108003 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f0f3c029040 con 0x5596b9494750 2024-09-22T08:36:48.867 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.859+0000 7f0f58c13800 20 rados_obj.operate() r=0 bl.length=391 2024-09-22T08:36:48.867 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.859+0000 7f0f58c13800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-22T08:36:48.867 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.859+0000 7f0f58c13800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-22T08:36:48.867 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.859+0000 7f0f58c13800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:36:48.867 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.859+0000 7f0f58c13800 1 -- 172.21.15.142:0/436982125 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5596b94de7c0 con 0x7f0f440323e0 2024-09-22T08:36:48.867 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.860+0000 7f0f54348640 1 -- 172.21.15.142:0/436982125 <== osd.2 v2:172.21.15.142:6808/279438927 11 ==== osd_op_reply(63 foo.buckets [call out=183b] v0'0 uv26 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f0f4c051070 con 0x7f0f440323e0 2024-09-22T08:36:48.867 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.860+0000 7f0f58c13800 20 disabling bucket name=myfoo 2024-09-22T08:36:48.868 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.860+0000 7f0f58c13800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-22T08:36:48.868 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.860+0000 7f0f58c13800 20 rados->read ofs=0 len=0 2024-09-22T08:36:48.868 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.860+0000 7f0f58c13800 1 -- 172.21.15.142:0/436982125 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5596b94dc7a0 con 0x7f0f440323e0 2024-09-22T08:36:48.868 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.860+0000 7f0f54348640 1 -- 172.21.15.142:0/436982125 <== osd.2 v2:172.21.15.142:6808/279438927 12 ==== osd_op_reply(64 myfoo [read 0~165 out=165b] v0'0 uv27 ondisk = 0) ==== 149+0+165 (crc 0 0 0) 0x7f0f4c051070 con 0x7f0f440323e0 2024-09-22T08:36:48.868 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.860+0000 7f0f58c13800 20 rados_obj.operate() r=0 bl.length=165 2024-09-22T08:36:48.868 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.860+0000 7f0f58c13800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x1 2024-09-22T08:36:48.868 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.860+0000 7f0f58c13800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-22T08:36:48.868 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.860+0000 7f0f58c13800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1 : miss 2024-09-22T08:36:48.868 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.860+0000 7f0f58c13800 20 rados->read ofs=0 len=0 2024-09-22T08:36:48.868 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.860+0000 7f0f58c13800 1 -- 172.21.15.142:0/436982125 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:65 8.15 8:ab67ca09:root::.bucket.meta.myfoo%3ae239248c-0bee-4e41-803a-24b288d3eb8f.4226.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5596b94df0f0 con 0x5596b9499140 2024-09-22T08:36:48.868 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.860+0000 7f0f54b49640 1 -- 172.21.15.142:0/436982125 <== osd.3 v2:172.21.15.142:6800/1064901393 16 ==== osd_op_reply(65 .bucket.meta.myfoo:e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv7 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7f0f4403a070 con 0x5596b9499140 2024-09-22T08:36:48.868 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.860+0000 7f0f58c13800 20 rados_obj.operate() r=0 bl.length=387 2024-09-22T08:36:48.868 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.860+0000 7f0f58c13800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1 info.flags=0x17 2024-09-22T08:36:48.868 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.860+0000 7f0f58c13800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1 to cache LRU end 2024-09-22T08:36:48.869 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.860+0000 7f0f58c13800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:36:48.869 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.860+0000 7f0f58c13800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-22T08:36:48.869 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.860+0000 7f0f58c13800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1 2024-09-22T08:36:48.869 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.861+0000 7f0f58c13800 1 -- 172.21.15.142:0/436982125 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:66 8.15 8:ab67ca09:root::.bucket.meta.myfoo%3ae239248c-0bee-4e41-803a-24b288d3eb8f.4226.1:head [delete,create,call version.check_conds in=122b,call version.inc in=38b,writefull 0~387 in=387b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5596b94e6590 con 0x5596b9499140 2024-09-22T08:36:48.869 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.862+0000 7f0f54b49640 1 -- 172.21.15.142:0/436982125 <== osd.3 v2:172.21.15.142:6800/1064901393 17 ==== osd_op_reply(66 .bucket.meta.myfoo:e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1 [delete,create,call,call,writefull 0~387,setxattr (123)] v30'8 uv8 ondisk = 0) ==== 416+0+0 (crc 0 0 0) 0x7f0f4403a070 con 0x5596b9499140 2024-09-22T08:36:48.869 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.862+0000 7f0f58c13800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1 info.flags=0x17 2024-09-22T08:36:48.869 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.862+0000 7f0f58c13800 10 moving default.rgw.meta+root+.bucket.meta.myfoo:e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1 to cache LRU end 2024-09-22T08:36:48.869 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.862+0000 7f0f58c13800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-22T08:36:48.869 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.862+0000 7f0f58c13800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1, ofs0, ns] 2024-09-22T08:36:48.869 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.862+0000 7f0f58c13800 1 -- 172.21.15.142:0/436982125 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [notify cookie 94105842348128 in=772b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5596b94e0c50 con 0x7f0f440323e0 2024-09-22T08:36:48.869 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.862+0000 7f0f54348640 1 -- 172.21.15.142:0/436982125 <== osd.2 v2:172.21.15.142:6808/279438927 13 ==== watch-notify(notify (1) cookie 94105842099360 notify 128849018899 ret 0) ==== 802+0+0 (crc 0 0 0) 0x7f0f4c0ad060 con 0x7f0f440323e0 2024-09-22T08:36:48.869 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.862+0000 7f0e2b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018899 cookie 94105842099360 notifier 4590 bl.length()=760 2024-09-22T08:36:48.869 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.862+0000 7f0e2b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1 info.flags=0x17 2024-09-22T08:36:48.870 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.862+0000 7f0e2b7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1 to cache LRU end 2024-09-22T08:36:48.870 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.862+0000 7f0e2b7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-09-22T08:36:48.870 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.862+0000 7f0f54348640 1 -- 172.21.15.142:0/436982125 <== osd.2 v2:172.21.15.142:6808/279438927 14 ==== osd_op_reply(67 notify.3 [notify cookie 94105842348128 out=8b] v0'0 uv153 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f0f4c051070 con 0x7f0f440323e0 2024-09-22T08:36:48.870 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.862+0000 7f0e2b7fe640 1 -- 172.21.15.142:0/436982125 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f0e20003ea0 con 0x7f0f440323e0 2024-09-22T08:36:48.870 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.862+0000 7f0f54348640 1 -- 172.21.15.142:0/436982125 <== osd.2 v2:172.21.15.142:6808/279438927 15 ==== osd_op_reply(68 notify.3 [notify-ack] v0'0 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f4c051070 con 0x7f0f440323e0 2024-09-22T08:36:48.870 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.862+0000 7f0f54348640 1 -- 172.21.15.142:0/436982125 <== osd.2 v2:172.21.15.142:6808/279438927 16 ==== watch-notify(notify_complete (2) cookie 94105842348128 notify 128849018899 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5596b945b0e0 con 0x7f0f440323e0 2024-09-22T08:36:48.870 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.862+0000 7f0f58c13800 20 handle_bi_update(): bucket=:myfoo[e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1]): orig_sources= new_sources= 2024-09-22T08:36:48.870 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.862+0000 7f0f58c13800 20 handle_bi_update(): bucket=:myfoo[e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1]): potential sources added=[] removed=[] 2024-09-22T08:36:48.870 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.862+0000 7f0f58c13800 20 handle_bi_update(): bucket=:myfoo[e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1]): orig_dests= new_dests= 2024-09-22T08:36:48.870 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.862+0000 7f0f58c13800 20 handle_bi_update(): bucket=:myfoo[e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1]): potential dests added=[] removed=[] 2024-09-22T08:36:48.870 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.862+0000 7f0f58c13800 1 -- 172.21.15.142:0/436982125 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:69 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5596b94df060 con 0x5596b9494750 2024-09-22T08:36:48.872 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.863+0000 7f0f53b47640 1 -- 172.21.15.142:0/436982125 <== osd.1 v2:172.21.15.142:6816/3192108003 22 ==== osd_op_reply(69 foo [delete,create,call,call,writefull 0~391] v30'12 uv12 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f0f3c029040 con 0x5596b9494750 2024-09-22T08:36:48.872 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.864+0000 7f0f58c13800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-22T08:36:48.872 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.864+0000 7f0f58c13800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-22T08:36:48.872 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.864+0000 7f0f58c13800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-22T08:36:48.872 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.864+0000 7f0f58c13800 1 -- 172.21.15.142:0/436982125 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [notify cookie 94105842348128 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5596b94e1cf0 con 0x5596b9494750 2024-09-22T08:36:48.872 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.864+0000 7f0f53b47640 1 -- 172.21.15.142:0/436982125 <== osd.1 v2:172.21.15.142:6816/3192108003 23 ==== watch-notify(notify (1) cookie 94105842101104 notify 128849018894 ret 0) ==== 609+0+0 (crc 0 0 0) 0x5596b91eba20 con 0x5596b9494750 2024-09-22T08:36:48.872 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.864+0000 7f0e2affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018894 cookie 94105842101104 notifier 4590 bl.length()=567 2024-09-22T08:36:48.872 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.864+0000 7f0e2affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-22T08:36:48.872 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.864+0000 7f0e2affd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-22T08:36:48.872 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.864+0000 7f0e2affd640 1 -- 172.21.15.142:0/436982125 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f0d7c003430 con 0x5596b9494750 2024-09-22T08:36:48.872 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.864+0000 7f0f53b47640 1 -- 172.21.15.142:0/436982125 <== osd.1 v2:172.21.15.142:6816/3192108003 24 ==== osd_op_reply(70 notify.4 [notify cookie 94105842348128 out=8b] v0'0 uv153 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f0f3c029040 con 0x5596b9494750 2024-09-22T08:36:48.872 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.864+0000 7f0f53b47640 1 -- 172.21.15.142:0/436982125 <== osd.1 v2:172.21.15.142:6816/3192108003 25 ==== osd_op_reply(71 notify.4 [notify-ack] v0'0 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f3c029040 con 0x5596b9494750 2024-09-22T08:36:48.873 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.864+0000 7f0f53b47640 1 -- 172.21.15.142:0/436982125 <== osd.1 v2:172.21.15.142:6816/3192108003 26 ==== watch-notify(notify_complete (2) cookie 94105842348128 notify 128849018894 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f0f3c02d8a0 con 0x5596b9494750 2024-09-22T08:36:48.873 INFO:teuthology.orchestra.run.smithi142.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":1,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-22T08:36:42.661297Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-22T08:36:42.661288Z","tags":[],"group_ids":[]} 2024-09-22T08:36:48.877 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.865+0000 7f0e0b7de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:36:48.878 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.865+0000 7f0f58c13800 1 -- 172.21.15.142:0/436982125 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:72 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94105842123728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5596b94d9a90 con 0x5596b9494750 2024-09-22T08:36:48.878 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.866+0000 7f0f53b47640 1 -- 172.21.15.142:0/436982125 <== osd.1 v2:172.21.15.142:6816/3192108003 27 ==== osd_op_reply(72 data_loggenerations_metadata [watch unwatch cookie 94105842123728] v30'149 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0f3c029040 con 0x5596b9494750 2024-09-22T08:36:48.878 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.866+0000 7f0f58c13800 1 -- 172.21.15.142:0/436982125 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:73 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94105842088176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5596b94d9a90 con 0x7f0f440323e0 2024-09-22T08:36:48.878 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.867+0000 7f0f54348640 1 -- 172.21.15.142:0/436982125 <== osd.2 v2:172.21.15.142:6808/279438927 17 ==== osd_op_reply(73 notify.0 [watch unwatch cookie 94105842088176] v30'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f4c051070 con 0x7f0f440323e0 2024-09-22T08:36:48.878 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.867+0000 7f0f58c13800 20 remove_watcher() i=0 2024-09-22T08:36:48.878 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.867+0000 7f0f58c13800 2 removed watcher, disabling cache 2024-09-22T08:36:48.878 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.867+0000 7f0f58c13800 1 -- 172.21.15.142:0/436982125 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:74 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94105842092192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5596b94d9a90 con 0x5596b9494750 2024-09-22T08:36:48.878 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.868+0000 7f0f53b47640 1 -- 172.21.15.142:0/436982125 <== osd.1 v2:172.21.15.142:6816/3192108003 28 ==== osd_op_reply(74 notify.1 [watch unwatch cookie 94105842092192] v30'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f3c029040 con 0x5596b9494750 2024-09-22T08:36:48.878 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.868+0000 7f0f58c13800 20 remove_watcher() i=1 2024-09-22T08:36:48.878 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.868+0000 7f0f58c13800 1 -- 172.21.15.142:0/436982125 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:75 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94105842097008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5596b94d9a90 con 0x5596b9499140 2024-09-22T08:36:48.878 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.869+0000 7f0f54b49640 1 -- 172.21.15.142:0/436982125 <== osd.3 v2:172.21.15.142:6800/1064901393 18 ==== osd_op_reply(75 notify.2 [watch unwatch cookie 94105842097008] v30'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f4403a070 con 0x5596b9499140 2024-09-22T08:36:48.878 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.869+0000 7f0f58c13800 20 remove_watcher() i=2 2024-09-22T08:36:48.879 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.869+0000 7f0f58c13800 1 -- 172.21.15.142:0/436982125 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:76 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94105842099360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5596b94d9a90 con 0x7f0f440323e0 2024-09-22T08:36:48.879 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.870+0000 7f0f54348640 1 -- 172.21.15.142:0/436982125 <== osd.2 v2:172.21.15.142:6808/279438927 18 ==== osd_op_reply(76 notify.3 [watch unwatch cookie 94105842099360] v30'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f4c051070 con 0x7f0f440323e0 2024-09-22T08:36:48.879 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.870+0000 7f0f58c13800 20 remove_watcher() i=3 2024-09-22T08:36:48.879 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.870+0000 7f0f58c13800 1 -- 172.21.15.142:0/436982125 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:77 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94105842101104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5596b94d9a90 con 0x5596b9494750 2024-09-22T08:36:48.879 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.871+0000 7f0f53b47640 1 -- 172.21.15.142:0/436982125 <== osd.1 v2:172.21.15.142:6816/3192108003 29 ==== osd_op_reply(77 notify.4 [watch unwatch cookie 94105842101104] v30'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f3c029040 con 0x5596b9494750 2024-09-22T08:36:48.879 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.871+0000 7f0f58c13800 20 remove_watcher() i=4 2024-09-22T08:36:48.879 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.871+0000 7f0f58c13800 1 -- 172.21.15.142:0/436982125 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:78 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94105842105200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5596b94d9a90 con 0x7f0f4c0a5040 2024-09-22T08:36:48.879 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.872+0000 7f0f53b47640 1 -- 172.21.15.142:0/436982125 <== osd.0 v2:172.21.15.31:6800/168281188 17 ==== osd_op_reply(78 notify.5 [watch unwatch cookie 94105842105200] v30'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f3c029040 con 0x7f0f4c0a5040 2024-09-22T08:36:48.879 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.872+0000 7f0f58c13800 20 remove_watcher() i=5 2024-09-22T08:36:48.879 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.872+0000 7f0f58c13800 1 -- 172.21.15.142:0/436982125 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:79 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94105842107536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5596b94d9a90 con 0x7f0f4c0a5040 2024-09-22T08:36:48.879 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.873+0000 7f0f53b47640 1 -- 172.21.15.142:0/436982125 <== osd.0 v2:172.21.15.31:6800/168281188 18 ==== osd_op_reply(79 notify.6 [watch unwatch cookie 94105842107536] v30'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f3c029040 con 0x7f0f4c0a5040 2024-09-22T08:36:48.879 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.873+0000 7f0f58c13800 20 remove_watcher() i=6 2024-09-22T08:36:48.879 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.873+0000 7f0f58c13800 1 -- 172.21.15.142:0/436982125 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:80 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94105842109328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5596b94d9a90 con 0x7f0f4c0a5040 2024-09-22T08:36:48.879 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.874+0000 7f0f53b47640 1 -- 172.21.15.142:0/436982125 <== osd.0 v2:172.21.15.31:6800/168281188 19 ==== osd_op_reply(80 notify.7 [watch unwatch cookie 94105842109328] v30'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f3c029040 con 0x7f0f4c0a5040 2024-09-22T08:36:48.880 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.874+0000 7f0f58c13800 20 remove_watcher() i=7 2024-09-22T08:36:48.880 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.874+0000 7f0f58c13800 1 -- 172.21.15.142:0/436982125 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f0f4c0a5040 msgr2=0x7f0f4c074480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:48.880 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.874+0000 7f0f58c13800 1 --2- 172.21.15.142:0/436982125 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f0f4c0a5040 0x7f0f4c074480 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:48.880 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.874+0000 7f0f58c13800 1 -- 172.21.15.142:0/436982125 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5596b9494750 msgr2=0x5596b9496c10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:48.880 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.874+0000 7f0f58c13800 1 --2- 172.21.15.142:0/436982125 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5596b9494750 0x5596b9496c10 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:48.880 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.874+0000 7f0f58c13800 1 -- 172.21.15.142:0/436982125 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f0f440323e0 msgr2=0x7f0f4404d480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:48.880 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.874+0000 7f0f58c13800 1 --2- 172.21.15.142:0/436982125 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f0f440323e0 0x7f0f4404d480 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:48.880 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.874+0000 7f0f58c13800 1 -- 172.21.15.142:0/436982125 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5596b9499140 msgr2=0x5596b949b530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:48.880 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.874+0000 7f0f58c13800 1 --2- 172.21.15.142:0/436982125 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5596b9499140 0x5596b949b530 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:48.880 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.875+0000 7f0f58c13800 1 -- 172.21.15.142:0/436982125 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f0e1c03cfb0 msgr2=0x7f0e1c03f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:48.880 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.875+0000 7f0f58c13800 1 --2- 172.21.15.142:0/436982125 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f0e1c03cfb0 0x7f0e1c03f470 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f0f4c097430 tx=0x7f0f4c089000 comp rx=0 tx=0).stop 2024-09-22T08:36:48.880 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.875+0000 7f0f58c13800 1 -- 172.21.15.142:0/436982125 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5596b94817e0 msgr2=0x5596b9488d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:48.880 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.875+0000 7f0f58c13800 1 --2- 172.21.15.142:0/436982125 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5596b94817e0 0x5596b9488d90 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f0f44054800 tx=0x7f0f44054860 comp rx=0 tx=0).stop 2024-09-22T08:36:48.881 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.875+0000 7f0f53b47640 1 -- 172.21.15.142:0/436982125 reap_dead start 2024-09-22T08:36:48.881 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.875+0000 7f0f53b47640 1 -- 172.21.15.142:0/436982125 reap_dead start 2024-09-22T08:36:48.881 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.875+0000 7f0f58c13800 1 -- 172.21.15.142:0/436982125 shutdown_connections 2024-09-22T08:36:48.881 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.875+0000 7f0f58c13800 1 -- 172.21.15.142:0/436982125 >> 172.21.15.142:0/436982125 conn(0x5596b947dbe0 msgr2=0x5596b947bdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:48.881 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.875+0000 7f0f58c13800 1 -- 172.21.15.142:0/436982125 shutdown_connections 2024-09-22T08:36:48.881 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.875+0000 7f0f58c13800 1 -- 172.21.15.142:0/436982125 wait complete. 2024-09-22T08:36:48.881 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.875+0000 7f0f58c13800 1 -- 172.21.15.142:0/1887601593 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f0e2c03cfb0 msgr2=0x7f0e2c03f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:48.881 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.875+0000 7f0f58c13800 1 --2- 172.21.15.142:0/1887601593 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f0e2c03cfb0 0x7f0e2c03f470 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x5596b945bde0 tx=0x7f0f4c05da60 comp rx=0 tx=0).stop 2024-09-22T08:36:48.881 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.875+0000 7f0f58c13800 1 -- 172.21.15.142:0/1887601593 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5596b9474cc0 msgr2=0x5596b94750e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:48.881 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.875+0000 7f0f58c13800 1 --2- 172.21.15.142:0/1887601593 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5596b9474cc0 0x5596b94750e0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x5596b945ace0 tx=0x7f0f440167b0 comp rx=0 tx=0).stop 2024-09-22T08:36:48.881 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.875+0000 7f0f58c13800 1 -- 172.21.15.142:0/1887601593 shutdown_connections 2024-09-22T08:36:48.881 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.875+0000 7f0f58c13800 1 --2- 172.21.15.142:0/1887601593 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f0e2c03cfb0 0x7f0e2c03f470 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:48.881 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.875+0000 7f0f58c13800 1 --2- 172.21.15.142:0/1887601593 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5596b9474cc0 0x5596b94750e0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:48.881 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.875+0000 7f0f58c13800 1 -- 172.21.15.142:0/1887601593 >> 172.21.15.142:0/1887601593 conn(0x5596b9469070 msgr2=0x5596b9469450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:48.882 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.875+0000 7f0f58c13800 1 -- 172.21.15.142:0/1887601593 shutdown_connections 2024-09-22T08:36:48.882 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.875+0000 7f0f58c13800 1 -- 172.21.15.142:0/1887601593 wait complete. 2024-09-22T08:36:48.882 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.875+0000 7f0f58c13800 1 -- 172.21.15.142:0/3869355357 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5596b9365a10 msgr2=0x5596b9461330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:48.882 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.875+0000 7f0f58c13800 1 --2- 172.21.15.142:0/3869355357 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5596b9365a10 0x5596b9461330 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:48.882 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.875+0000 7f0f58c13800 1 -- 172.21.15.142:0/3869355357 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5596b94636d0 msgr2=0x5596b9465b70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:48.882 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.875+0000 7f0f58c13800 1 --2- 172.21.15.142:0/3869355357 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5596b94636d0 0x5596b9465b70 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:48.882 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.876+0000 7f0f58c13800 1 -- 172.21.15.142:0/3869355357 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f0e3c03cfb0 msgr2=0x7f0e3c03f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:48.882 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.876+0000 7f0f58c13800 1 --2- 172.21.15.142:0/3869355357 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f0e3c03cfb0 0x7f0e3c03f470 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f0f3c001d70 tx=0x7f0f3c0012d0 comp rx=0 tx=0).stop 2024-09-22T08:36:48.882 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.876+0000 7f0f58c13800 1 -- 172.21.15.142:0/3869355357 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5596b92d3d10 msgr2=0x5596b9459ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:48.882 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.876+0000 7f0f58c13800 1 --2- 172.21.15.142:0/3869355357 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5596b92d3d10 0x5596b9459ce0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f0f4c025c20 tx=0x7f0f4c002fb0 comp rx=0 tx=0).stop 2024-09-22T08:36:48.882 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.876+0000 7f0f58c13800 1 -- 172.21.15.142:0/3869355357 shutdown_connections 2024-09-22T08:36:48.882 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.876+0000 7f0f58c13800 1 --2- 172.21.15.142:0/3869355357 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5596b94636d0 0x5596b9465b70 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:48.882 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.876+0000 7f0f58c13800 1 --2- 172.21.15.142:0/3869355357 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5596b9365a10 0x5596b9461330 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:48.882 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.876+0000 7f0f58c13800 1 --2- 172.21.15.142:0/3869355357 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f0e3c03cfb0 0x7f0e3c03f470 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:48.883 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.876+0000 7f0f58c13800 1 --2- 172.21.15.142:0/3869355357 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5596b92d3d10 0x5596b9459ce0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:48.883 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.876+0000 7f0f58c13800 1 -- 172.21.15.142:0/3869355357 >> 172.21.15.142:0/3869355357 conn(0x5596b935abb0 msgr2=0x5596b944c3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:48.883 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.876+0000 7f0f58c13800 1 -- 172.21.15.142:0/3869355357 shutdown_connections 2024-09-22T08:36:48.883 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.876+0000 7f0f58c13800 1 -- 172.21.15.142:0/3869355357 wait complete. 2024-09-22T08:36:48.886 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-22T08:36:42.661297Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-22T08:36:42.661288Z', 'tags': [], 'group_ids': []} 2024-09-22T08:36:48.888 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'enable', '--uid', 'foo'] 2024-09-22T08:36:48.888 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'enable', '--uid', 'foo'] 2024-09-22T08:36:48.888 DEBUG:teuthology.orchestra.run.smithi142:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user enable --uid foo 2024-09-22T08:36:48.932 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:36:48.932 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:36:48.933 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.932+0000 7f9245d1f800 1 Processor -- start 2024-09-22T08:36:48.933 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.932+0000 7f9245d1f800 1 -- start start 2024-09-22T08:36:48.933 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.932+0000 7f9245d1f800 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55acaf658d10 0x55acaf6ea4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:48.933 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.932+0000 7f9245d1f800 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55acaf570a20 con 0x55acaf6eaa10 2024-09-22T08:36:48.933 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.932+0000 7f9245d1f800 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x55acaf5707d0 con 0x55acaf658d10 2024-09-22T08:36:48.934 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.932+0000 7f9241aa2640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55acaf658d10 0x55acaf6ea4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:48.934 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.932+0000 7f92412a1640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x55acaf6eaa10 0x55acaf6eced0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.142:44818/0 (socket says 172.21.15.142:44818) 2024-09-22T08:36:48.934 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.932+0000 7f9241aa2640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55acaf658d10 0x55acaf6ea4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:48960/0 (socket says 172.21.15.142:48960) 2024-09-22T08:36:48.934 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.932+0000 7f92412a1640 1 -- 172.21.15.142:0/3867153629 learned_addr learned my addr 172.21.15.142:0/3867153629 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-09-22T08:36:48.934 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.932+0000 7f9241aa2640 1 -- 172.21.15.142:0/3867153629 >> v1:172.21.15.31:6789/0 conn(0x55acaf6eaa10 legacy=0x55acaf6eced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:48.934 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.932+0000 7f9241aa2640 1 -- 172.21.15.142:0/3867153629 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55acaf6ef7c0 con 0x55acaf658d10 2024-09-22T08:36:48.935 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.934+0000 7f9241aa2640 1 --2- 172.21.15.142:0/3867153629 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55acaf658d10 0x55acaf6ea4a0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f9234005fd0 tx=0x7f9234045c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d97b8c3196774a61 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:48.936 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.934+0000 7f9240aa0640 1 -- 172.21.15.142:0/3867153629 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9234058530 con 0x55acaf658d10 2024-09-22T08:36:48.936 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.934+0000 7f9240aa0640 1 -- 172.21.15.142:0/3867153629 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92340586d0 con 0x55acaf658d10 2024-09-22T08:36:48.936 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.934+0000 7f9240aa0640 1 -- 172.21.15.142:0/3867153629 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f92340589d0 con 0x55acaf658d10 2024-09-22T08:36:48.936 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.935+0000 7f9245d1f800 1 -- 172.21.15.142:0/3867153629 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55acaf658d10 msgr2=0x55acaf6ea4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:48.937 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.935+0000 7f9245d1f800 1 --2- 172.21.15.142:0/3867153629 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55acaf658d10 0x55acaf6ea4a0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f9234005fd0 tx=0x7f9234045c30 comp rx=0 tx=0).stop 2024-09-22T08:36:48.937 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.935+0000 7f9245d1f800 1 -- 172.21.15.142:0/3867153629 shutdown_connections 2024-09-22T08:36:48.937 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.935+0000 7f9245d1f800 1 --2- 172.21.15.142:0/3867153629 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55acaf658d10 0x55acaf6ea4a0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:48.937 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.935+0000 7f9245d1f800 1 -- 172.21.15.142:0/3867153629 >> 172.21.15.142:0/3867153629 conn(0x55acaf6dfbb0 msgr2=0x55acaf6e2010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:48.937 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.935+0000 7f9245d1f800 1 -- 172.21.15.142:0/3867153629 shutdown_connections 2024-09-22T08:36:48.937 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.935+0000 7f9245d1f800 1 -- 172.21.15.142:0/3867153629 wait complete. 2024-09-22T08:36:48.950 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.948+0000 7f9245d1f800 1 Processor -- start 2024-09-22T08:36:48.950 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.949+0000 7f9245d1f800 1 -- start start 2024-09-22T08:36:48.950 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.949+0000 7f9245d1f800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55acaf658d10 0x55acaf7d7260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:48.950 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.949+0000 7f9245d1f800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55acaf57ddd0 con 0x55acaf658d10 2024-09-22T08:36:48.950 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.949+0000 7f9241aa2640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55acaf658d10 0x55acaf7d7260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:48.950 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.949+0000 7f9241aa2640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55acaf658d10 0x55acaf7d7260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:48972/0 (socket says 172.21.15.142:48972) 2024-09-22T08:36:48.951 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.949+0000 7f9241aa2640 1 -- 172.21.15.142:0/1087868943 learned_addr learned my addr 172.21.15.142:0/1087868943 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:48.951 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.949+0000 7f9241aa2640 1 -- 172.21.15.142:0/1087868943 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55acaf7d7850 con 0x55acaf658d10 2024-09-22T08:36:48.952 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.949+0000 7f9241aa2640 1 --2- 172.21.15.142:0/1087868943 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55acaf658d10 0x55acaf7d7260 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f9234025a60 tx=0x7f9234051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fe7b2c86978027d server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:48.952 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.950+0000 7f912fe07640 1 -- 172.21.15.142:0/1087868943 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f92340589b0 con 0x55acaf658d10 2024-09-22T08:36:48.952 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.950+0000 7f912fe07640 1 -- 172.21.15.142:0/1087868943 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9234068070 con 0x55acaf658d10 2024-09-22T08:36:48.953 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.950+0000 7f912fe07640 1 -- 172.21.15.142:0/1087868943 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9234058c80 con 0x55acaf658d10 2024-09-22T08:36:48.953 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.950+0000 7f9245d1f800 1 -- 172.21.15.142:0/1087868943 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55acaf658d10 msgr2=0x55acaf7d7260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:48.953 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.950+0000 7f9245d1f800 1 --2- 172.21.15.142:0/1087868943 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55acaf658d10 0x55acaf7d7260 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f9234025a60 tx=0x7f9234051000 comp rx=0 tx=0).stop 2024-09-22T08:36:48.953 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.950+0000 7f9245d1f800 1 -- 172.21.15.142:0/1087868943 shutdown_connections 2024-09-22T08:36:48.953 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.950+0000 7f9245d1f800 1 --2- 172.21.15.142:0/1087868943 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55acaf658d10 0x55acaf7d7260 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:48.953 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.950+0000 7f9245d1f800 1 -- 172.21.15.142:0/1087868943 >> 172.21.15.142:0/1087868943 conn(0x55acaf6dfbb0 msgr2=0x55acaf7d2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:48.953 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.950+0000 7f9245d1f800 1 -- 172.21.15.142:0/1087868943 shutdown_connections 2024-09-22T08:36:48.953 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.950+0000 7f9245d1f800 1 -- 172.21.15.142:0/1087868943 wait complete. 2024-09-22T08:36:48.953 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.951+0000 7f9245d1f800 1 Processor -- start 2024-09-22T08:36:48.953 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.951+0000 7f9245d1f800 1 -- start start 2024-09-22T08:36:48.953 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.951+0000 7f9245d1f800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55acaf658d10 0x55acaf7decb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:48.953 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.951+0000 7f9245d1f800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55acaf6eea60 con 0x55acaf658d10 2024-09-22T08:36:48.953 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.951+0000 7f9241aa2640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55acaf658d10 0x55acaf7decb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:48.954 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.951+0000 7f9241aa2640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55acaf658d10 0x55acaf7decb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:48976/0 (socket says 172.21.15.142:48976) 2024-09-22T08:36:48.954 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.951+0000 7f9241aa2640 1 -- 172.21.15.142:0/1294955683 learned_addr learned my addr 172.21.15.142:0/1294955683 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:48.954 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.951+0000 7f9241aa2640 1 -- 172.21.15.142:0/1294955683 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55acaf7df210 con 0x55acaf658d10 2024-09-22T08:36:48.956 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.952+0000 7f9241aa2640 1 --2- 172.21.15.142:0/1294955683 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55acaf658d10 0x55acaf7decb0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f9234025a60 tx=0x7f9234003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:48.956 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.952+0000 7f912e604640 1 -- 172.21.15.142:0/1294955683 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9234063650 con 0x55acaf658d10 2024-09-22T08:36:48.956 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.952+0000 7f9245d1f800 1 -- 172.21.15.142:0/1294955683 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55acaf7df4a0 con 0x55acaf658d10 2024-09-22T08:36:48.957 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.952+0000 7f912e604640 1 -- 172.21.15.142:0/1294955683 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92340637f0 con 0x55acaf658d10 2024-09-22T08:36:48.957 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.952+0000 7f9245d1f800 1 -- 172.21.15.142:0/1294955683 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55acaf7e00b0 con 0x55acaf658d10 2024-09-22T08:36:48.957 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.952+0000 7f912e604640 1 -- 172.21.15.142:0/1294955683 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9234063ad0 con 0x55acaf658d10 2024-09-22T08:36:48.957 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.953+0000 7f912e604640 1 -- 172.21.15.142:0/1294955683 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f9234063c70 con 0x55acaf658d10 2024-09-22T08:36:48.957 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.953+0000 7f912e604640 1 --2- 172.21.15.142:0/1294955683 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f912803cfb0 0x7f912803f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:48.957 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.953+0000 7f912e604640 1 -- 172.21.15.142:0/1294955683 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f9234098710 con 0x55acaf658d10 2024-09-22T08:36:48.957 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.953+0000 7f92412a1640 1 --2- 172.21.15.142:0/1294955683 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f912803cfb0 0x7f912803f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:48.957 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.953+0000 7f9245d1f800 1 --2- 172.21.15.142:0/1294955683 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55acaf6eaa10 0x55acaf7e6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:48.957 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.953+0000 7f9245d1f800 1 -- 172.21.15.142:0/1294955683 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55acaf7e6840 con 0x55acaf6eaa10 2024-09-22T08:36:48.957 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.953+0000 7f92422a3640 1 --2- 172.21.15.142:0/1294955683 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55acaf6eaa10 0x55acaf7e6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:48.957 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.954+0000 7f92412a1640 1 --2- 172.21.15.142:0/1294955683 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f912803cfb0 0x7f912803f470 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f922c001d70 tx=0x7f922c0012d0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:48.957 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.954+0000 7f92422a3640 1 --2- 172.21.15.142:0/1294955683 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55acaf6eaa10 0x55acaf7e6300 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:48.957 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.954+0000 7f92422a3640 1 -- 172.21.15.142:0/1294955683 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f923c0083e0 con 0x55acaf6eaa10 2024-09-22T08:36:48.958 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.954+0000 7f9245d1f800 1 -- 172.21.15.142:0/1294955683 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55acaf7e6be0 con 0x55acaf6eaa10 2024-09-22T08:36:48.958 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.954+0000 7f92422a3640 1 -- 172.21.15.142:0/1294955683 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f923c0083e0 con 0x55acaf6eaa10 2024-09-22T08:36:48.958 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.954+0000 7f9245d1f800 1 --2- 172.21.15.142:0/1294955683 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55acaf7e8720 0x55acaf7eaba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:48.958 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.954+0000 7f9245d1f800 1 -- 172.21.15.142:0/1294955683 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:3 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55acaf7eb330 con 0x55acaf7e8720 2024-09-22T08:36:48.958 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.954+0000 7f9241aa2640 1 --2- 172.21.15.142:0/1294955683 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55acaf7e8720 0x55acaf7eaba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:48.958 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.955+0000 7f9241aa2640 1 --2- 172.21.15.142:0/1294955683 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55acaf7e8720 0x55acaf7eaba0 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:48.958 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.955+0000 7f9241aa2640 1 -- 172.21.15.142:0/1294955683 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(3 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f923404f3f0 con 0x55acaf7e8720 2024-09-22T08:36:48.958 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.955+0000 7f9245d1f800 1 -- 172.21.15.142:0/1294955683 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55acaf7e7430 con 0x55acaf6eaa10 2024-09-22T08:36:48.958 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.955+0000 7f92422a3640 1 -- 172.21.15.142:0/1294955683 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f923c0083e0 con 0x55acaf6eaa10 2024-09-22T08:36:48.958 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.955+0000 7f9245d1f800 1 -- 172.21.15.142:0/1294955683 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55acaf7e7890 con 0x55acaf7e8720 2024-09-22T08:36:48.958 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.956+0000 7f9241aa2640 1 -- 172.21.15.142:0/1294955683 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(5 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f923404f3f0 con 0x55acaf7e8720 2024-09-22T08:36:48.963 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.956+0000 7f9245d1f800 1 Processor -- start 2024-09-22T08:36:48.963 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.956+0000 7f9245d1f800 1 -- start start 2024-09-22T08:36:48.963 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.956+0000 7f9245d1f800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55acaf7f9d30 0x55acaf7fa150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:48.963 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.956+0000 7f9245d1f800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55acaf5dcd50 con 0x55acaf7f9d30 2024-09-22T08:36:48.963 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.956+0000 7f92422a3640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55acaf7f9d30 0x55acaf7fa150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:48.963 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.956+0000 7f92422a3640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55acaf7f9d30 0x55acaf7fa150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:48982/0 (socket says 172.21.15.142:48982) 2024-09-22T08:36:48.963 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.956+0000 7f92422a3640 1 -- 172.21.15.142:0/3275881282 learned_addr learned my addr 172.21.15.142:0/3275881282 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:48.963 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.956+0000 7f92422a3640 1 -- 172.21.15.142:0/3275881282 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55acaf7fa790 con 0x55acaf7f9d30 2024-09-22T08:36:48.963 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.957+0000 7f92422a3640 1 --2- 172.21.15.142:0/3275881282 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55acaf7f9d30 0x55acaf7fa150 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x55acaf7dfcb0 tx=0x7f923c00bf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:48.963 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.957+0000 7f91277fe640 1 -- 172.21.15.142:0/3275881282 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f923c01c020 con 0x55acaf7f9d30 2024-09-22T08:36:48.963 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.957+0000 7f91277fe640 1 -- 172.21.15.142:0/3275881282 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f923c007c90 con 0x55acaf7f9d30 2024-09-22T08:36:48.964 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.957+0000 7f9245d1f800 1 -- 172.21.15.142:0/3275881282 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55acaf7fafc0 con 0x55acaf7f9d30 2024-09-22T08:36:48.964 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.957+0000 7f91277fe640 1 -- 172.21.15.142:0/3275881282 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f923c018440 con 0x55acaf7f9d30 2024-09-22T08:36:48.964 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.957+0000 7f9245d1f800 1 -- 172.21.15.142:0/3275881282 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55acaf7fb560 con 0x55acaf7f9d30 2024-09-22T08:36:48.964 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.958+0000 7f91277fe640 1 -- 172.21.15.142:0/3275881282 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f923c01f020 con 0x55acaf7f9d30 2024-09-22T08:36:48.964 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.958+0000 7f91277fe640 1 --2- 172.21.15.142:0/3275881282 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f911c03cfb0 0x7f911c03f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:48.964 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.958+0000 7f91277fe640 1 -- 172.21.15.142:0/3275881282 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f923c0558a0 con 0x55acaf7f9d30 2024-09-22T08:36:48.964 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.958+0000 7f9241aa2640 1 --2- 172.21.15.142:0/3275881282 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f911c03cfb0 0x7f911c03f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:48.964 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.958+0000 7f9245d1f800 1 Processor -- start 2024-09-22T08:36:48.964 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.958+0000 7f9245d1f800 1 -- start start 2024-09-22T08:36:48.964 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.958+0000 7f9241aa2640 1 --2- 172.21.15.142:0/3275881282 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f911c03cfb0 0x7f911c03f470 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x55acaf7e77d0 tx=0x7f9234073e70 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:48.964 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.958+0000 7f9245d1f800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55acaf806790 0x55acaf806b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:48.964 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.958+0000 7f9245d1f800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55acaf7d7bc0 con 0x55acaf806790 2024-09-22T08:36:48.964 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.959+0000 7f92422a3640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55acaf806790 0x55acaf806b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:48.964 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.959+0000 7f92422a3640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55acaf806790 0x55acaf806b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:48984/0 (socket says 172.21.15.142:48984) 2024-09-22T08:36:48.965 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.959+0000 7f92422a3640 1 -- 172.21.15.142:0/1054467391 learned_addr learned my addr 172.21.15.142:0/1054467391 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:48.965 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.959+0000 7f92422a3640 1 -- 172.21.15.142:0/1054467391 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55acaf807180 con 0x55acaf806790 2024-09-22T08:36:48.965 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.959+0000 7f92422a3640 1 --2- 172.21.15.142:0/1054467391 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55acaf806790 0x55acaf806b90 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f923c053df0 tx=0x7f923c0158b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f75d87ab5d79c9f2 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:48.965 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.959+0000 7f91257fa640 1 -- 172.21.15.142:0/1054467391 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f923c04a070 con 0x55acaf806790 2024-09-22T08:36:48.965 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.959+0000 7f91257fa640 1 -- 172.21.15.142:0/1054467391 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f923c015e70 con 0x55acaf806790 2024-09-22T08:36:48.965 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.959+0000 7f91257fa640 1 -- 172.21.15.142:0/1054467391 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f923c0174d0 con 0x55acaf806790 2024-09-22T08:36:48.965 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.960+0000 7f9245d1f800 1 -- 172.21.15.142:0/1054467391 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55acaf806790 msgr2=0x55acaf806b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:48.965 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.960+0000 7f9245d1f800 1 --2- 172.21.15.142:0/1054467391 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55acaf806790 0x55acaf806b90 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f923c053df0 tx=0x7f923c0158b0 comp rx=0 tx=0).stop 2024-09-22T08:36:48.965 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.960+0000 7f9245d1f800 1 -- 172.21.15.142:0/1054467391 shutdown_connections 2024-09-22T08:36:48.965 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.960+0000 7f9245d1f800 1 --2- 172.21.15.142:0/1054467391 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55acaf806790 0x55acaf806b90 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:48.965 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.960+0000 7f9245d1f800 1 -- 172.21.15.142:0/1054467391 >> 172.21.15.142:0/1054467391 conn(0x55acaf802b90 msgr2=0x55acaf800dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:48.965 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.960+0000 7f9245d1f800 1 -- 172.21.15.142:0/1054467391 shutdown_connections 2024-09-22T08:36:48.965 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.960+0000 7f9245d1f800 1 -- 172.21.15.142:0/1054467391 wait complete. 2024-09-22T08:36:48.965 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.960+0000 7f9245d1f800 1 Processor -- start 2024-09-22T08:36:48.966 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.960+0000 7f9245d1f800 1 -- start start 2024-09-22T08:36:48.966 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.960+0000 7f9245d1f800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55acaf806790 0x55acaf80dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:48.966 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.960+0000 7f9245d1f800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55acaf8077a0 con 0x55acaf806790 2024-09-22T08:36:48.966 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.960+0000 7f92422a3640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55acaf806790 0x55acaf80dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:48.966 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.960+0000 7f92422a3640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55acaf806790 0x55acaf80dd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:48990/0 (socket says 172.21.15.142:48990) 2024-09-22T08:36:48.966 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.960+0000 7f92422a3640 1 -- 172.21.15.142:0/830284283 learned_addr learned my addr 172.21.15.142:0/830284283 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:36:48.966 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.961+0000 7f92422a3640 1 -- 172.21.15.142:0/830284283 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55acaf80e260 con 0x55acaf806790 2024-09-22T08:36:48.966 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.961+0000 7f92422a3640 1 --2- 172.21.15.142:0/830284283 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55acaf806790 0x55acaf80dd00 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f923c0154a0 tx=0x7f923c053d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:48.966 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.961+0000 7f91137fe640 1 -- 172.21.15.142:0/830284283 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f923c02e070 con 0x55acaf806790 2024-09-22T08:36:48.966 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.961+0000 7f91137fe640 1 -- 172.21.15.142:0/830284283 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f923c04b040 con 0x55acaf806790 2024-09-22T08:36:48.966 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.961+0000 7f91137fe640 1 -- 172.21.15.142:0/830284283 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f923c04a070 con 0x55acaf806790 2024-09-22T08:36:48.966 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.961+0000 7f9245d1f800 1 -- 172.21.15.142:0/830284283 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55acaf80e4f0 con 0x55acaf806790 2024-09-22T08:36:48.966 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.961+0000 7f9245d1f800 1 -- 172.21.15.142:0/830284283 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55acaf80f080 con 0x55acaf806790 2024-09-22T08:36:48.977 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.962+0000 7f91137fe640 1 -- 172.21.15.142:0/830284283 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f923c016040 con 0x55acaf806790 2024-09-22T08:36:48.977 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.962+0000 7f91137fe640 1 --2- 172.21.15.142:0/830284283 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f910c03cfb0 0x7f910c03f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:48.977 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.962+0000 7f91137fe640 1 -- 172.21.15.142:0/830284283 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f923c03d260 con 0x55acaf806790 2024-09-22T08:36:48.977 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.962+0000 7f9241aa2640 1 --2- 172.21.15.142:0/830284283 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f910c03cfb0 0x7f910c03f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:48.977 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.963+0000 7f9245d1f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:48.977 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.963+0000 7f9245d1f800 1 --2- 172.21.15.142:0/830284283 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55acaf819660 0x55acaf81bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:48.977 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.963+0000 7f9245d1f800 1 -- 172.21.15.142:0/830284283 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55acaf81c270 con 0x55acaf819660 2024-09-22T08:36:48.977 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.963+0000 7f9241aa2640 1 --2- 172.21.15.142:0/830284283 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f910c03cfb0 0x7f910c03f470 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f9234096f50 tx=0x7f923408f000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:48.978 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.963+0000 7f92412a1640 1 --2- 172.21.15.142:0/830284283 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55acaf819660 0x55acaf81bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:48.978 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.963+0000 7f92412a1640 1 --2- 172.21.15.142:0/830284283 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55acaf819660 0x55acaf81bb20 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:48.978 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.963+0000 7f92412a1640 1 -- 172.21.15.142:0/830284283 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f922c009050 con 0x55acaf819660 2024-09-22T08:36:48.978 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.963+0000 7f9245d1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:48.978 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.963+0000 7f9245d1f800 20 realm 2024-09-22T08:36:48.978 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.964+0000 7f9245d1f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:48.978 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.964+0000 7f9245d1f800 1 -- 172.21.15.142:0/830284283 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55acaf8189b0 con 0x55acaf819660 2024-09-22T08:36:48.978 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.964+0000 7f92412a1640 1 -- 172.21.15.142:0/830284283 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f922c009050 con 0x55acaf819660 2024-09-22T08:36:48.978 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.964+0000 7f9245d1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:48.978 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.964+0000 7f9245d1f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:36:48.978 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.964+0000 7f9245d1f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:48.978 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.964+0000 7f9245d1f800 1 -- 172.21.15.142:0/830284283 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55acaf81cd60 con 0x55acaf819660 2024-09-22T08:36:48.979 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.964+0000 7f92412a1640 1 -- 172.21.15.142:0/830284283 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f922c009050 con 0x55acaf819660 2024-09-22T08:36:48.979 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.964+0000 7f9245d1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:48.979 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.964+0000 7f9245d1f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:48.979 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.964+0000 7f9245d1f800 1 -- 172.21.15.142:0/830284283 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55acaf81d630 con 0x55acaf819660 2024-09-22T08:36:48.979 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.964+0000 7f92412a1640 1 -- 172.21.15.142:0/830284283 <== osd.1 v2:172.21.15.142:6816/3192108003 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f922c009050 con 0x55acaf819660 2024-09-22T08:36:48.979 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.964+0000 7f9245d1f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:36:48.979 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.964+0000 7f9245d1f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:48.979 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.964+0000 7f9245d1f800 1 --2- 172.21.15.142:0/830284283 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55acaf81e050 0x55acaf820440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:48.979 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.964+0000 7f9245d1f800 1 -- 172.21.15.142:0/830284283 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55acaf820b80 con 0x55acaf81e050 2024-09-22T08:36:48.979 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.964+0000 7f92422a3640 1 --2- 172.21.15.142:0/830284283 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55acaf81e050 0x55acaf820440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:48.979 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.965+0000 7f92422a3640 1 --2- 172.21.15.142:0/830284283 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55acaf81e050 0x55acaf820440 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:48.979 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.965+0000 7f92422a3640 1 -- 172.21.15.142:0/830284283 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(5 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f923c0083e0 con 0x55acaf81e050 2024-09-22T08:36:48.979 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.965+0000 7f9245d1f800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:36:48.979 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.965+0000 7f9245d1f800 20 searching for the correct realm 2024-09-22T08:36:48.980 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.965+0000 7f9245d1f800 1 -- 172.21.15.142:0/830284283 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55acaf8224b0 con 0x55acaf81e050 2024-09-22T08:36:48.980 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.965+0000 7f92422a3640 1 -- 172.21.15.142:0/830284283 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f923c0083e0 con 0x55acaf81e050 2024-09-22T08:36:48.980 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.965+0000 7f92422a3640 1 --2- 172.21.15.142:0/830284283 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f923c032020 0x7f923c03b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:48.980 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.965+0000 7f92422a3640 1 -- 172.21.15.142:0/830284283 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55acaf8224b0 con 0x7f923c032020 2024-09-22T08:36:48.980 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.965+0000 7f9241aa2640 1 --2- 172.21.15.142:0/830284283 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f923c032020 0x7f923c03b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:48.980 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.966+0000 7f9241aa2640 1 --2- 172.21.15.142:0/830284283 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f923c032020 0x7f923c03b9a0 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:48.980 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.966+0000 7f9241aa2640 1 -- 172.21.15.142:0/830284283 <== osd.2 v2:172.21.15.142:6808/279438927 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9234087040 con 0x7f923c032020 2024-09-22T08:36:48.980 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.966+0000 7f9241aa2640 1 --2- 172.21.15.142:0/830284283 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f923407d3a0 0x7f9234074610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:36:48.980 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.966+0000 7f9241aa2640 1 -- 172.21.15.142:0/830284283 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55acaf8224b0 con 0x7f923407d3a0 2024-09-22T08:36:48.980 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.966+0000 7f92412a1640 1 --2- 172.21.15.142:0/830284283 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f923407d3a0 0x7f9234074610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:36:48.980 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.966+0000 7f92412a1640 1 --2- 172.21.15.142:0/830284283 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f923407d3a0 0x7f9234074610 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:36:48.980 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.967+0000 7f92412a1640 1 -- 172.21.15.142:0/830284283 <== osd.0 v2:172.21.15.31:6800/168281188 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f922c009050 con 0x7f923407d3a0 2024-09-22T08:36:48.981 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.967+0000 7f92412a1640 1 -- 172.21.15.142:0/830284283 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55acaf8224b0 con 0x55acaf819660 2024-09-22T08:36:48.981 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.967+0000 7f92412a1640 1 -- 172.21.15.142:0/830284283 <== osd.1 v2:172.21.15.142:6816/3192108003 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f922c009050 con 0x55acaf819660 2024-09-22T08:36:48.981 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.967+0000 7f92412a1640 1 -- 172.21.15.142:0/830284283 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55acaf8224b0 con 0x55acaf819660 2024-09-22T08:36:48.981 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.967+0000 7f92412a1640 1 -- 172.21.15.142:0/830284283 <== osd.1 v2:172.21.15.142:6816/3192108003 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f922c029040 con 0x55acaf819660 2024-09-22T08:36:48.981 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.967+0000 7f92412a1640 1 -- 172.21.15.142:0/830284283 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55acaf8224b0 con 0x7f923407d3a0 2024-09-22T08:36:48.981 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.967+0000 7f92412a1640 1 -- 172.21.15.142:0/830284283 <== osd.0 v2:172.21.15.31:6800/168281188 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f922c029040 con 0x7f923407d3a0 2024-09-22T08:36:48.981 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.967+0000 7f92412a1640 1 -- 172.21.15.142:0/830284283 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55acaf8224b0 con 0x7f923407d3a0 2024-09-22T08:36:48.981 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.968+0000 7f92412a1640 1 -- 172.21.15.142:0/830284283 <== osd.0 v2:172.21.15.31:6800/168281188 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f922c029040 con 0x7f923407d3a0 2024-09-22T08:36:48.981 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.968+0000 7f92412a1640 1 -- 172.21.15.142:0/830284283 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55acaf8224b0 con 0x7f923c032020 2024-09-22T08:36:48.981 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.968+0000 7f9241aa2640 1 -- 172.21.15.142:0/830284283 <== osd.2 v2:172.21.15.142:6808/279438927 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9234087040 con 0x7f923c032020 2024-09-22T08:36:48.981 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.968+0000 7f9241aa2640 1 -- 172.21.15.142:0/830284283 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55acaf8224b0 con 0x55acaf81e050 2024-09-22T08:36:48.981 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.968+0000 7f92422a3640 1 -- 172.21.15.142:0/830284283 <== osd.3 v2:172.21.15.142:6800/1064901393 3 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f923c0083e0 con 0x55acaf81e050 2024-09-22T08:36:48.981 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.968+0000 7f92422a3640 1 -- 172.21.15.142:0/830284283 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55acaf8224b0 con 0x55acaf819660 2024-09-22T08:36:48.981 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.968+0000 7f92412a1640 1 -- 172.21.15.142:0/830284283 <== osd.1 v2:172.21.15.142:6816/3192108003 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f922c029040 con 0x55acaf819660 2024-09-22T08:36:48.982 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.968+0000 7f92412a1640 1 -- 172.21.15.142:0/830284283 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55acaf8224b0 con 0x7f923407d3a0 2024-09-22T08:36:48.982 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.969+0000 7f92412a1640 1 -- 172.21.15.142:0/830284283 <== osd.0 v2:172.21.15.31:6800/168281188 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f922c029040 con 0x7f923407d3a0 2024-09-22T08:36:48.982 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.969+0000 7f92412a1640 1 -- 172.21.15.142:0/830284283 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55acaf8224b0 con 0x55acaf819660 2024-09-22T08:36:48.982 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.969+0000 7f92412a1640 1 -- 172.21.15.142:0/830284283 <== osd.1 v2:172.21.15.142:6816/3192108003 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f922c029040 con 0x55acaf819660 2024-09-22T08:36:48.982 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.969+0000 7f92412a1640 1 -- 172.21.15.142:0/830284283 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55acaf8224b0 con 0x7f923c032020 2024-09-22T08:36:48.982 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.969+0000 7f9241aa2640 1 -- 172.21.15.142:0/830284283 <== osd.2 v2:172.21.15.142:6808/279438927 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f9234087040 con 0x7f923c032020 2024-09-22T08:36:48.982 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.969+0000 7f9241aa2640 1 -- 172.21.15.142:0/830284283 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55acaf8224b0 con 0x55acaf81e050 2024-09-22T08:36:48.982 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.969+0000 7f92422a3640 1 -- 172.21.15.142:0/830284283 <== osd.3 v2:172.21.15.142:6800/1064901393 4 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f923c0083e0 con 0x55acaf81e050 2024-09-22T08:36:48.982 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.969+0000 7f92422a3640 1 -- 172.21.15.142:0/830284283 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55acaf8224b0 con 0x55acaf81e050 2024-09-22T08:36:48.982 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.969+0000 7f92422a3640 1 -- 172.21.15.142:0/830284283 <== osd.3 v2:172.21.15.142:6800/1064901393 5 ==== osd_op_reply(20 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f923c0083e0 con 0x55acaf81e050 2024-09-22T08:36:48.982 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.969+0000 7f92422a3640 1 -- 172.21.15.142:0/830284283 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55acaf8224b0 con 0x7f923407d3a0 2024-09-22T08:36:48.982 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.970+0000 7f92412a1640 1 -- 172.21.15.142:0/830284283 <== osd.0 v2:172.21.15.31:6800/168281188 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f922c029040 con 0x7f923407d3a0 2024-09-22T08:36:48.983 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.970+0000 7f92412a1640 1 -- 172.21.15.142:0/830284283 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55acaf8224b0 con 0x55acaf81e050 2024-09-22T08:36:48.983 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.970+0000 7f92422a3640 1 -- 172.21.15.142:0/830284283 <== osd.3 v2:172.21.15.142:6800/1064901393 6 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f923c0083e0 con 0x55acaf81e050 2024-09-22T08:36:48.983 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.970+0000 7f92422a3640 1 -- 172.21.15.142:0/830284283 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55acaf8224b0 con 0x55acaf81e050 2024-09-22T08:36:48.983 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.970+0000 7f92422a3640 1 -- 172.21.15.142:0/830284283 <== osd.3 v2:172.21.15.142:6800/1064901393 7 ==== osd_op_reply(23 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f923c0083e0 con 0x55acaf81e050 2024-09-22T08:36:48.983 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.970+0000 7f92422a3640 1 -- 172.21.15.142:0/830284283 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55acaf8224b0 con 0x55acaf819660 2024-09-22T08:36:48.983 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.970+0000 7f92412a1640 1 -- 172.21.15.142:0/830284283 <== osd.1 v2:172.21.15.142:6816/3192108003 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f922c029040 con 0x55acaf819660 2024-09-22T08:36:48.983 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.971+0000 7f92412a1640 1 -- 172.21.15.142:0/830284283 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55acaf8224b0 con 0x55acaf819660 2024-09-22T08:36:48.983 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.971+0000 7f92412a1640 1 -- 172.21.15.142:0/830284283 <== osd.1 v2:172.21.15.142:6816/3192108003 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f922c029040 con 0x55acaf819660 2024-09-22T08:36:48.983 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.971+0000 7f92412a1640 1 -- 172.21.15.142:0/830284283 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55acaf8224b0 con 0x7f923407d3a0 2024-09-22T08:36:48.983 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.971+0000 7f92412a1640 1 -- 172.21.15.142:0/830284283 <== osd.0 v2:172.21.15.31:6800/168281188 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f922c029040 con 0x7f923407d3a0 2024-09-22T08:36:48.983 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.971+0000 7f92412a1640 1 -- 172.21.15.142:0/830284283 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55acaf8224b0 con 0x55acaf81e050 2024-09-22T08:36:48.983 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.971+0000 7f92422a3640 1 -- 172.21.15.142:0/830284283 <== osd.3 v2:172.21.15.142:6800/1064901393 8 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f923c0083e0 con 0x55acaf81e050 2024-09-22T08:36:48.983 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.971+0000 7f92422a3640 1 -- 172.21.15.142:0/830284283 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55acaf8224b0 con 0x7f923c032020 2024-09-22T08:36:48.983 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.971+0000 7f9241aa2640 1 -- 172.21.15.142:0/830284283 <== osd.2 v2:172.21.15.142:6808/279438927 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9234087040 con 0x7f923c032020 2024-09-22T08:36:48.984 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.971+0000 7f9241aa2640 1 -- 172.21.15.142:0/830284283 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55acaf8224b0 con 0x55acaf819660 2024-09-22T08:36:48.984 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.972+0000 7f92412a1640 1 -- 172.21.15.142:0/830284283 <== osd.1 v2:172.21.15.142:6816/3192108003 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f922c029040 con 0x55acaf819660 2024-09-22T08:36:48.984 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.972+0000 7f92412a1640 1 -- 172.21.15.142:0/830284283 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55acaf8224b0 con 0x7f923407d3a0 2024-09-22T08:36:48.984 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.972+0000 7f92412a1640 1 -- 172.21.15.142:0/830284283 <== osd.0 v2:172.21.15.31:6800/168281188 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f922c029040 con 0x7f923407d3a0 2024-09-22T08:36:48.984 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.972+0000 7f92412a1640 1 -- 172.21.15.142:0/830284283 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55acaf8224b0 con 0x55acaf81e050 2024-09-22T08:36:48.984 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.972+0000 7f92422a3640 1 -- 172.21.15.142:0/830284283 <== osd.3 v2:172.21.15.142:6800/1064901393 9 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f923c0083e0 con 0x55acaf81e050 2024-09-22T08:36:48.984 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.972+0000 7f92422a3640 1 -- 172.21.15.142:0/830284283 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55acaf8224b0 con 0x7f923407d3a0 2024-09-22T08:36:48.984 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.972+0000 7f92412a1640 1 -- 172.21.15.142:0/830284283 <== osd.0 v2:172.21.15.31:6800/168281188 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f922c029040 con 0x7f923407d3a0 2024-09-22T08:36:48.984 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.972+0000 7f92412a1640 1 -- 172.21.15.142:0/830284283 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55acaf8224b0 con 0x7f923c032020 2024-09-22T08:36:48.984 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.973+0000 7f9241aa2640 1 -- 172.21.15.142:0/830284283 <== osd.2 v2:172.21.15.142:6808/279438927 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9234087040 con 0x7f923c032020 2024-09-22T08:36:48.984 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.973+0000 7f9241aa2640 1 -- 172.21.15.142:0/830284283 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55acaf8224b0 con 0x55acaf81e050 2024-09-22T08:36:48.984 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.973+0000 7f92422a3640 1 -- 172.21.15.142:0/830284283 <== osd.3 v2:172.21.15.142:6800/1064901393 10 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f923c0083e0 con 0x55acaf81e050 2024-09-22T08:36:48.984 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.973+0000 7f92422a3640 1 -- 172.21.15.142:0/830284283 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55acaf8224b0 con 0x7f923407d3a0 2024-09-22T08:36:48.985 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.973+0000 7f92412a1640 1 -- 172.21.15.142:0/830284283 <== osd.0 v2:172.21.15.31:6800/168281188 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f922c029040 con 0x7f923407d3a0 2024-09-22T08:36:48.985 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.973+0000 7f92412a1640 1 -- 172.21.15.142:0/830284283 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55acaf8224b0 con 0x55acaf819660 2024-09-22T08:36:48.985 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.973+0000 7f92412a1640 1 -- 172.21.15.142:0/830284283 <== osd.1 v2:172.21.15.142:6816/3192108003 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f922c029040 con 0x55acaf819660 2024-09-22T08:36:48.985 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.973+0000 7f92412a1640 1 -- 172.21.15.142:0/830284283 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55acaf8224b0 con 0x7f923c032020 2024-09-22T08:36:48.985 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.974+0000 7f9241aa2640 1 -- 172.21.15.142:0/830284283 <== osd.2 v2:172.21.15.142:6808/279438927 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9234087040 con 0x7f923c032020 2024-09-22T08:36:48.985 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.974+0000 7f9245d1f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:36:48.985 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.974+0000 7f9245d1f800 20 RGWRados::pool_iterate: got zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec 2024-09-22T08:36:48.985 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.974+0000 7f9245d1f800 20 RGWRados::pool_iterate: got zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f 2024-09-22T08:36:48.985 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.974+0000 7f9245d1f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:36:48.985 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.974+0000 7f9245d1f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:36:48.985 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.974+0000 7f9245d1f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:36:48.985 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.974+0000 7f9245d1f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:48.985 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.974+0000 7f9245d1f800 1 -- 172.21.15.142:0/830284283 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55acaf821540 con 0x55acaf819660 2024-09-22T08:36:48.985 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.974+0000 7f92412a1640 1 -- 172.21.15.142:0/830284283 <== osd.1 v2:172.21.15.142:6816/3192108003 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f922c029040 con 0x55acaf819660 2024-09-22T08:36:48.986 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.974+0000 7f9245d1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:48.986 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.974+0000 7f9245d1f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:48.986 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.974+0000 7f9245d1f800 1 -- 172.21.15.142:0/830284283 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55acaf821d90 con 0x55acaf819660 2024-09-22T08:36:48.986 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.974+0000 7f92412a1640 1 -- 172.21.15.142:0/830284283 <== osd.1 v2:172.21.15.142:6816/3192108003 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f922c029040 con 0x55acaf819660 2024-09-22T08:36:48.986 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.974+0000 7f9245d1f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:36:48.986 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.974+0000 7f9245d1f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:48.986 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.974+0000 7f9245d1f800 1 -- 172.21.15.142:0/830284283 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:40 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55acaf822930 con 0x55acaf81e050 2024-09-22T08:36:48.986 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.974+0000 7f92422a3640 1 -- 172.21.15.142:0/830284283 <== osd.3 v2:172.21.15.142:6800/1064901393 11 ==== osd_op_reply(40 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f923c0083e0 con 0x55acaf81e050 2024-09-22T08:36:48.986 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.974+0000 7f9245d1f800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:36:48.986 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.974+0000 7f9245d1f800 20 zone default found 2024-09-22T08:36:48.986 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.974+0000 7f9245d1f800 4 Realm: () 2024-09-22T08:36:48.986 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.974+0000 7f9245d1f800 4 ZoneGroup: default (d89f6f57-1007-47dd-9065-f486c7b01aec) 2024-09-22T08:36:48.986 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.974+0000 7f9245d1f800 4 Zone: default (e239248c-0bee-4e41-803a-24b288d3eb8f) 2024-09-22T08:36:48.986 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.974+0000 7f9245d1f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:36:48.987 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.974+0000 7f9245d1f800 20 zonegroup default 2024-09-22T08:36:48.987 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.974+0000 7f9245d1f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:48.987 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.974+0000 7f9245d1f800 1 -- 172.21.15.142:0/830284283 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55acaf822cf0 con 0x7f923407d3a0 2024-09-22T08:36:48.987 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.975+0000 7f92412a1640 1 -- 172.21.15.142:0/830284283 <== osd.0 v2:172.21.15.31:6800/168281188 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f922c029040 con 0x7f923407d3a0 2024-09-22T08:36:48.987 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.975+0000 7f9245d1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:48.987 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.975+0000 7f9245d1f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:48.987 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.975+0000 7f9245d1f800 1 -- 172.21.15.142:0/830284283 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55acaf824fd0 con 0x55acaf81e050 2024-09-22T08:36:48.987 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.975+0000 7f92422a3640 1 -- 172.21.15.142:0/830284283 <== osd.3 v2:172.21.15.142:6800/1064901393 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f923c0083e0 con 0x55acaf81e050 2024-09-22T08:36:48.987 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.975+0000 7f9245d1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:48.987 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.975+0000 7f9245d1f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:48.987 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.975+0000 7f9245d1f800 1 -- 172.21.15.142:0/830284283 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55acaf825370 con 0x55acaf81e050 2024-09-22T08:36:48.987 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.975+0000 7f92422a3640 1 -- 172.21.15.142:0/830284283 <== osd.3 v2:172.21.15.142:6800/1064901393 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f923c0083e0 con 0x55acaf81e050 2024-09-22T08:36:48.987 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.975+0000 7f9245d1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:48.988 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.975+0000 7f9245d1f800 20 started sync module instance, tier type = 2024-09-22T08:36:48.988 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.975+0000 7f9245d1f800 20 started zone id=e239248c-0bee-4e41-803a-24b288d3eb8f (name=default) with tier type = 2024-09-22T08:36:48.988 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.975+0000 7f9245d1f800 1 -- 172.21.15.142:0/830284283 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55acaf824410 con 0x7f923c032020 2024-09-22T08:36:48.995 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.976+0000 7f9241aa2640 1 -- 172.21.15.142:0/830284283 <== osd.2 v2:172.21.15.142:6808/279438927 7 ==== osd_op_reply(44 notify.0 [create] v30'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9234087040 con 0x7f923c032020 2024-09-22T08:36:48.995 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.976+0000 7f9245d1f800 1 -- 172.21.15.142:0/830284283 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94200167284576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55acaf8257a0 con 0x7f923c032020 2024-09-22T08:36:48.995 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.976+0000 7f9245d1f800 1 -- 172.21.15.142:0/830284283 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55acaf825ff0 con 0x55acaf819660 2024-09-22T08:36:48.996 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.977+0000 7f9241aa2640 1 -- 172.21.15.142:0/830284283 <== osd.2 v2:172.21.15.142:6808/279438927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94200167284576] v30'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9234087040 con 0x7f923c032020 2024-09-22T08:36:48.996 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.977+0000 7f92412a1640 1 -- 172.21.15.142:0/830284283 <== osd.1 v2:172.21.15.142:6816/3192108003 15 ==== osd_op_reply(46 notify.1 [create] v30'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f922c029040 con 0x55acaf819660 2024-09-22T08:36:48.996 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.977+0000 7f9245d1f800 1 -- 172.21.15.142:0/830284283 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94200167291712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55acaf826410 con 0x55acaf819660 2024-09-22T08:36:48.996 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.977+0000 7f9245d1f800 1 -- 172.21.15.142:0/830284283 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55acaf826c60 con 0x55acaf81e050 2024-09-22T08:36:48.996 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.978+0000 7f92412a1640 1 -- 172.21.15.142:0/830284283 <== osd.1 v2:172.21.15.142:6816/3192108003 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94200167291712] v30'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f922c029040 con 0x55acaf819660 2024-09-22T08:36:48.996 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.979+0000 7f92422a3640 1 -- 172.21.15.142:0/830284283 <== osd.3 v2:172.21.15.142:6800/1064901393 14 ==== osd_op_reply(48 notify.2 [create] v30'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f923c0083e0 con 0x55acaf81e050 2024-09-22T08:36:48.996 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.979+0000 7f9245d1f800 1 -- 172.21.15.142:0/830284283 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94200167293248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55acaf826b50 con 0x55acaf81e050 2024-09-22T08:36:48.996 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.979+0000 7f9245d1f800 1 -- 172.21.15.142:0/830284283 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55acaf827650 con 0x7f923c032020 2024-09-22T08:36:48.996 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.980+0000 7f9241aa2640 1 -- 172.21.15.142:0/830284283 <== osd.2 v2:172.21.15.142:6808/279438927 9 ==== osd_op_reply(50 notify.3 [create] v30'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9234087040 con 0x7f923c032020 2024-09-22T08:36:48.996 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.980+0000 7f92422a3640 1 -- 172.21.15.142:0/830284283 <== osd.3 v2:172.21.15.142:6800/1064901393 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94200167293248] v30'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f923c0083e0 con 0x55acaf81e050 2024-09-22T08:36:48.996 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.980+0000 7f9245d1f800 1 -- 172.21.15.142:0/830284283 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94200167297344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55acaf827650 con 0x7f923c032020 2024-09-22T08:36:48.996 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.980+0000 7f9245d1f800 1 -- 172.21.15.142:0/830284283 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55acaf828110 con 0x55acaf819660 2024-09-22T08:36:48.996 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.981+0000 7f92412a1640 1 -- 172.21.15.142:0/830284283 <== osd.1 v2:172.21.15.142:6816/3192108003 17 ==== osd_op_reply(52 notify.4 [create] v30'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f922c029040 con 0x55acaf819660 2024-09-22T08:36:48.997 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.981+0000 7f9245d1f800 1 -- 172.21.15.142:0/830284283 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94200167294368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55acaf828110 con 0x55acaf819660 2024-09-22T08:36:48.997 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.981+0000 7f9245d1f800 1 -- 172.21.15.142:0/830284283 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55acaf8290c0 con 0x7f923407d3a0 2024-09-22T08:36:48.997 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.981+0000 7f9241aa2640 1 -- 172.21.15.142:0/830284283 <== osd.2 v2:172.21.15.142:6808/279438927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94200167297344] v30'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9234087040 con 0x7f923c032020 2024-09-22T08:36:48.997 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.982+0000 7f92412a1640 1 -- 172.21.15.142:0/830284283 <== osd.0 v2:172.21.15.31:6800/168281188 11 ==== osd_op_reply(54 notify.5 [create] v30'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f922c029040 con 0x7f923407d3a0 2024-09-22T08:36:48.997 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.982+0000 7f92412a1640 1 -- 172.21.15.142:0/830284283 <== osd.1 v2:172.21.15.142:6816/3192108003 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94200167294368] v30'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f922c029040 con 0x55acaf819660 2024-09-22T08:36:48.997 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.982+0000 7f9245d1f800 1 -- 172.21.15.142:0/830284283 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94200167304112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55acaf8282f0 con 0x7f923407d3a0 2024-09-22T08:36:48.997 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.982+0000 7f9245d1f800 1 -- 172.21.15.142:0/830284283 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55acaf829960 con 0x7f923407d3a0 2024-09-22T08:36:48.997 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.983+0000 7f92412a1640 1 -- 172.21.15.142:0/830284283 <== osd.0 v2:172.21.15.31:6800/168281188 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94200167304112] v30'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f922c029040 con 0x7f923407d3a0 2024-09-22T08:36:48.997 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.983+0000 7f92412a1640 1 -- 172.21.15.142:0/830284283 <== osd.0 v2:172.21.15.31:6800/168281188 13 ==== osd_op_reply(56 notify.6 [create] v30'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f922c029040 con 0x7f923407d3a0 2024-09-22T08:36:48.997 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.983+0000 7f9245d1f800 1 -- 172.21.15.142:0/830284283 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94200167299696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55acaf8282f0 con 0x7f923407d3a0 2024-09-22T08:36:48.997 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.983+0000 7f9245d1f800 1 -- 172.21.15.142:0/830284283 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55acaf829f80 con 0x7f923407d3a0 2024-09-22T08:36:48.997 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.984+0000 7f92412a1640 1 -- 172.21.15.142:0/830284283 <== osd.0 v2:172.21.15.31:6800/168281188 14 ==== osd_op_reply(58 notify.7 [create] v30'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f922c029040 con 0x7f923407d3a0 2024-09-22T08:36:48.998 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.984+0000 7f9245d1f800 1 -- 172.21.15.142:0/830284283 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94200167307984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55acaf829ef0 con 0x7f923407d3a0 2024-09-22T08:36:48.998 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.984+0000 7f9245d1f800 20 add_watcher() i=0 2024-09-22T08:36:48.998 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.984+0000 7f9245d1f800 20 add_watcher() i=1 2024-09-22T08:36:48.998 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.984+0000 7f9245d1f800 20 add_watcher() i=2 2024-09-22T08:36:48.998 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.984+0000 7f9245d1f800 20 add_watcher() i=3 2024-09-22T08:36:48.998 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.984+0000 7f9245d1f800 20 add_watcher() i=4 2024-09-22T08:36:48.998 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.984+0000 7f9245d1f800 20 add_watcher() i=5 2024-09-22T08:36:48.998 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.984+0000 7f92412a1640 1 -- 172.21.15.142:0/830284283 <== osd.0 v2:172.21.15.31:6800/168281188 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94200167299696] v30'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f922c029040 con 0x7f923407d3a0 2024-09-22T08:36:48.998 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.984+0000 7f9245d1f800 20 add_watcher() i=6 2024-09-22T08:36:48.998 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.985+0000 7f92412a1640 1 -- 172.21.15.142:0/830284283 <== osd.0 v2:172.21.15.31:6800/168281188 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94200167307984] v30'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f922c029040 con 0x7f923407d3a0 2024-09-22T08:36:48.998 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.985+0000 7f9245d1f800 20 add_watcher() i=7 2024-09-22T08:36:48.998 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.985+0000 7f9245d1f800 2 all 8 watchers are set, enabling cache 2024-09-22T08:36:48.998 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.985+0000 7f9245d1f800 1 -- 172.21.15.142:0/830284283 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55acaf829550 con 0x55acaf819660 2024-09-22T08:36:48.999 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.985+0000 7f92412a1640 1 -- 172.21.15.142:0/830284283 <== osd.1 v2:172.21.15.142:6816/3192108003 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f922c029040 con 0x55acaf819660 2024-09-22T08:36:48.999 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.985+0000 7f9245d1f800 1 -- 172.21.15.142:0/830284283 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94200167310112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55acaf82ad90 con 0x55acaf819660 2024-09-22T08:36:48.999 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.986+0000 7f92412a1640 1 -- 172.21.15.142:0/830284283 <== osd.1 v2:172.21.15.142:6816/3192108003 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94200167310112] v30'150 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f922c029040 con 0x55acaf819660 2024-09-22T08:36:48.999 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.986+0000 7f90f37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:36:48.999 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.986+0000 7f9245d1f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:36:48.999 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.986+0000 7f9245d1f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:36:48.999 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.986+0000 7f9245d1f800 5 note: GC not initialized 2024-09-22T08:36:48.999 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.986+0000 7f90f27fc640 20 reqs_thread_entry: start 2024-09-22T08:36:48.999 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.986+0000 7f9245d1f800 20 init_complete bucket index max shards: 11 2024-09-22T08:36:48.999 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.987+0000 7f9245d1f800 20 Filter name: none 2024-09-22T08:36:48.999 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.987+0000 7f9063fff640 20 reqs_thread_entry: start 2024-09-22T08:36:48.999 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.987+0000 7f9245d1f800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-22T08:36:49.000 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.987+0000 7f9245d1f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:49.000 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.987+0000 7f9245d1f800 1 -- 172.21.15.142:0/830284283 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55acaf860950 con 0x55acaf819660 2024-09-22T08:36:49.000 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.987+0000 7f92412a1640 1 -- 172.21.15.142:0/830284283 <== osd.1 v2:172.21.15.142:6816/3192108003 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv12 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f922c029040 con 0x55acaf819660 2024-09-22T08:36:49.000 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.987+0000 7f9245d1f800 20 rados_obj.operate() r=0 bl.length=391 2024-09-22T08:36:49.000 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.987+0000 7f9245d1f800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-22T08:36:49.000 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.987+0000 7f9245d1f800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-22T08:36:49.000 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.987+0000 7f9245d1f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:36:49.000 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.987+0000 7f9245d1f800 1 -- 172.21.15.142:0/830284283 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55acaf8603a0 con 0x7f923c032020 2024-09-22T08:36:49.000 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.988+0000 7f9241aa2640 1 -- 172.21.15.142:0/830284283 <== osd.2 v2:172.21.15.142:6808/279438927 11 ==== osd_op_reply(63 foo.buckets [call out=183b] v0'0 uv26 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f9234087040 con 0x7f923c032020 2024-09-22T08:36:49.000 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.988+0000 7f9245d1f800 20 enabling bucket name=myfoo 2024-09-22T08:36:49.000 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.988+0000 7f9245d1f800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-22T08:36:49.000 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.988+0000 7f9245d1f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:49.000 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.988+0000 7f9245d1f800 1 -- 172.21.15.142:0/830284283 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55acaf8613c0 con 0x7f923c032020 2024-09-22T08:36:49.001 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.988+0000 7f9241aa2640 1 -- 172.21.15.142:0/830284283 <== osd.2 v2:172.21.15.142:6808/279438927 12 ==== osd_op_reply(64 myfoo [read 0~165 out=165b] v0'0 uv27 ondisk = 0) ==== 149+0+165 (crc 0 0 0) 0x7f9234087040 con 0x7f923c032020 2024-09-22T08:36:49.001 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.988+0000 7f9245d1f800 20 rados_obj.operate() r=0 bl.length=165 2024-09-22T08:36:49.001 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.988+0000 7f9245d1f800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x1 2024-09-22T08:36:49.001 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.988+0000 7f9245d1f800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-22T08:36:49.001 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.988+0000 7f9245d1f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1 : miss 2024-09-22T08:36:49.001 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.988+0000 7f9245d1f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:49.001 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.988+0000 7f9245d1f800 1 -- 172.21.15.142:0/830284283 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:65 8.15 8:ab67ca09:root::.bucket.meta.myfoo%3ae239248c-0bee-4e41-803a-24b288d3eb8f.4226.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55acaf862f90 con 0x55acaf81e050 2024-09-22T08:36:49.001 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.988+0000 7f92422a3640 1 -- 172.21.15.142:0/830284283 <== osd.3 v2:172.21.15.142:6800/1064901393 16 ==== osd_op_reply(65 .bucket.meta.myfoo:e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv8 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7f923c0083e0 con 0x55acaf81e050 2024-09-22T08:36:49.001 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.988+0000 7f9245d1f800 20 rados_obj.operate() r=0 bl.length=387 2024-09-22T08:36:49.001 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.988+0000 7f9245d1f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1 info.flags=0x17 2024-09-22T08:36:49.001 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.988+0000 7f9245d1f800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1 to cache LRU end 2024-09-22T08:36:49.001 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.988+0000 7f9245d1f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:36:49.001 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.988+0000 7f9245d1f800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-22T08:36:49.001 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.988+0000 7f9245d1f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1 2024-09-22T08:36:49.002 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.988+0000 7f9245d1f800 1 -- 172.21.15.142:0/830284283 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:66 8.15 8:ab67ca09:root::.bucket.meta.myfoo%3ae239248c-0bee-4e41-803a-24b288d3eb8f.4226.1:head [delete,create,call version.check_conds in=122b,call version.inc in=38b,writefull 0~387 in=387b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55acaf86b570 con 0x55acaf81e050 2024-09-22T08:36:49.002 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.989+0000 7f92422a3640 1 -- 172.21.15.142:0/830284283 <== osd.3 v2:172.21.15.142:6800/1064901393 17 ==== osd_op_reply(66 .bucket.meta.myfoo:e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1 [delete,create,call,call,writefull 0~387,setxattr (123)] v30'9 uv9 ondisk = 0) ==== 416+0+0 (crc 0 0 0) 0x7f923c0083e0 con 0x55acaf81e050 2024-09-22T08:36:49.002 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.990+0000 7f9245d1f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1 info.flags=0x17 2024-09-22T08:36:49.002 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.990+0000 7f9245d1f800 10 moving default.rgw.meta+root+.bucket.meta.myfoo:e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1 to cache LRU end 2024-09-22T08:36:49.002 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.990+0000 7f9245d1f800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-22T08:36:49.002 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.990+0000 7f9245d1f800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1, ofs0, ns] 2024-09-22T08:36:49.002 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.990+0000 7f9245d1f800 1 -- 172.21.15.142:0/830284283 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [notify cookie 94200167548752 in=772b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55acaf865ca0 con 0x7f923c032020 2024-09-22T08:36:49.002 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.990+0000 7f9241aa2640 1 -- 172.21.15.142:0/830284283 <== osd.2 v2:172.21.15.142:6808/279438927 13 ==== watch-notify(notify (1) cookie 94200167297344 notify 128849018900 ret 0) ==== 802+0+0 (crc 0 0 0) 0x7f9234094040 con 0x7f923c032020 2024-09-22T08:36:49.002 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.990+0000 7f91257fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018900 cookie 94200167297344 notifier 4597 bl.length()=760 2024-09-22T08:36:49.002 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.990+0000 7f91257fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1 info.flags=0x17 2024-09-22T08:36:49.002 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.990+0000 7f91257fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1 to cache LRU end 2024-09-22T08:36:49.002 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.990+0000 7f91257fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-09-22T08:36:49.003 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.990+0000 7f91257fa640 1 -- 172.21.15.142:0/830284283 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f9104003ea0 con 0x7f923c032020 2024-09-22T08:36:49.003 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.990+0000 7f9241aa2640 1 -- 172.21.15.142:0/830284283 <== osd.2 v2:172.21.15.142:6808/279438927 14 ==== osd_op_reply(67 notify.3 [notify cookie 94200167548752 out=8b] v0'0 uv156 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f9234087040 con 0x7f923c032020 2024-09-22T08:36:49.003 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.990+0000 7f9241aa2640 1 -- 172.21.15.142:0/830284283 <== osd.2 v2:172.21.15.142:6808/279438927 15 ==== osd_op_reply(68 notify.3 [notify-ack] v0'0 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9234087040 con 0x7f923c032020 2024-09-22T08:36:49.003 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.990+0000 7f9241aa2640 1 -- 172.21.15.142:0/830284283 <== osd.2 v2:172.21.15.142:6808/279438927 16 ==== watch-notify(notify_complete (2) cookie 94200167548752 notify 128849018900 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55acaf7e00b0 con 0x7f923c032020 2024-09-22T08:36:49.003 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.990+0000 7f9245d1f800 20 handle_bi_update(): bucket=:myfoo[e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1]): orig_sources= new_sources= 2024-09-22T08:36:49.003 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.990+0000 7f9245d1f800 20 handle_bi_update(): bucket=:myfoo[e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1]): potential sources added=[] removed=[] 2024-09-22T08:36:49.003 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.990+0000 7f9245d1f800 20 handle_bi_update(): bucket=:myfoo[e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1]): orig_dests= new_dests= 2024-09-22T08:36:49.003 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.990+0000 7f9245d1f800 20 handle_bi_update(): bucket=:myfoo[e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1]): potential dests added=[] removed=[] 2024-09-22T08:36:49.003 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.990+0000 7f9245d1f800 1 -- 172.21.15.142:0/830284283 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:69 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55acaf867760 con 0x55acaf819660 2024-09-22T08:36:49.003 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.991+0000 7f92412a1640 1 -- 172.21.15.142:0/830284283 <== osd.1 v2:172.21.15.142:6816/3192108003 22 ==== osd_op_reply(69 foo [delete,create,call,call,writefull 0~391] v30'13 uv13 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f922c029040 con 0x55acaf819660 2024-09-22T08:36:49.003 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.991+0000 7f9245d1f800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-22T08:36:49.003 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.991+0000 7f9245d1f800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-22T08:36:49.003 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.991+0000 7f9245d1f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-22T08:36:49.004 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.991+0000 7f9245d1f800 1 -- 172.21.15.142:0/830284283 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [notify cookie 94200167570864 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55acaf868210 con 0x55acaf819660 2024-09-22T08:36:49.004 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.992+0000 7f92412a1640 1 -- 172.21.15.142:0/830284283 <== osd.1 v2:172.21.15.142:6816/3192108003 23 ==== watch-notify(notify (1) cookie 94200167294368 notify 128849018895 ret 0) ==== 609+0+0 (crc 0 0 0) 0x55acaf570a20 con 0x55acaf819660 2024-09-22T08:36:49.004 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.992+0000 7f9124ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018895 cookie 94200167294368 notifier 4597 bl.length()=567 2024-09-22T08:36:49.004 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.992+0000 7f9124ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-22T08:36:49.004 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.992+0000 7f9124ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-22T08:36:49.004 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.992+0000 7f92412a1640 1 -- 172.21.15.142:0/830284283 <== osd.1 v2:172.21.15.142:6816/3192108003 24 ==== osd_op_reply(70 notify.4 [notify cookie 94200167570864 out=8b] v0'0 uv156 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f922c029040 con 0x55acaf819660 2024-09-22T08:36:49.004 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.992+0000 7f9124ff9640 1 -- 172.21.15.142:0/830284283 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f906c003430 con 0x55acaf819660 2024-09-22T08:36:49.004 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.992+0000 7f92412a1640 1 -- 172.21.15.142:0/830284283 <== osd.1 v2:172.21.15.142:6816/3192108003 25 ==== watch-notify(notify_complete (2) cookie 94200167570864 notify 128849018895 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f922c02d8a0 con 0x55acaf819660 2024-09-22T08:36:49.004 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.992+0000 7f92412a1640 1 -- 172.21.15.142:0/830284283 <== osd.1 v2:172.21.15.142:6816/3192108003 26 ==== osd_op_reply(71 notify.4 [notify-ack] v0'0 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f922c029040 con 0x55acaf819660 2024-09-22T08:36:49.004 INFO:teuthology.orchestra.run.smithi142.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-22T08:36:42.661297Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-22T08:36:42.661288Z","tags":[],"group_ids":[]} 2024-09-22T08:36:49.009 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.993+0000 7f90f37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:36:49.009 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.993+0000 7f9245d1f800 1 -- 172.21.15.142:0/830284283 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:72 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94200167310112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55acaf85e690 con 0x55acaf819660 2024-09-22T08:36:49.009 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.994+0000 7f92412a1640 1 -- 172.21.15.142:0/830284283 <== osd.1 v2:172.21.15.142:6816/3192108003 27 ==== osd_op_reply(72 data_loggenerations_metadata [watch unwatch cookie 94200167310112] v30'151 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f922c029040 con 0x55acaf819660 2024-09-22T08:36:49.009 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.994+0000 7f9245d1f800 1 -- 172.21.15.142:0/830284283 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:73 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94200167284576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55acaf85e690 con 0x7f923c032020 2024-09-22T08:36:49.009 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.995+0000 7f9241aa2640 1 -- 172.21.15.142:0/830284283 <== osd.2 v2:172.21.15.142:6808/279438927 17 ==== osd_op_reply(73 notify.0 [watch unwatch cookie 94200167284576] v30'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9234087040 con 0x7f923c032020 2024-09-22T08:36:49.010 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.995+0000 7f9245d1f800 20 remove_watcher() i=0 2024-09-22T08:36:49.010 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.995+0000 7f9245d1f800 2 removed watcher, disabling cache 2024-09-22T08:36:49.010 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.995+0000 7f9245d1f800 1 -- 172.21.15.142:0/830284283 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:74 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94200167291712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55acaf85e690 con 0x55acaf819660 2024-09-22T08:36:49.010 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.996+0000 7f92412a1640 1 -- 172.21.15.142:0/830284283 <== osd.1 v2:172.21.15.142:6816/3192108003 28 ==== osd_op_reply(74 notify.1 [watch unwatch cookie 94200167291712] v30'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f922c029040 con 0x55acaf819660 2024-09-22T08:36:49.010 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.996+0000 7f9245d1f800 20 remove_watcher() i=1 2024-09-22T08:36:49.010 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.996+0000 7f9245d1f800 1 -- 172.21.15.142:0/830284283 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:75 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94200167293248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55acaf85e690 con 0x55acaf81e050 2024-09-22T08:36:49.010 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.997+0000 7f92422a3640 1 -- 172.21.15.142:0/830284283 <== osd.3 v2:172.21.15.142:6800/1064901393 18 ==== osd_op_reply(75 notify.2 [watch unwatch cookie 94200167293248] v30'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f923c0083e0 con 0x55acaf81e050 2024-09-22T08:36:49.010 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.997+0000 7f9245d1f800 20 remove_watcher() i=2 2024-09-22T08:36:49.010 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.997+0000 7f9245d1f800 1 -- 172.21.15.142:0/830284283 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:76 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94200167297344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55acaf85e690 con 0x7f923c032020 2024-09-22T08:36:49.010 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.998+0000 7f9241aa2640 1 -- 172.21.15.142:0/830284283 <== osd.2 v2:172.21.15.142:6808/279438927 18 ==== osd_op_reply(76 notify.3 [watch unwatch cookie 94200167297344] v30'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9234087040 con 0x7f923c032020 2024-09-22T08:36:49.010 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.998+0000 7f9245d1f800 20 remove_watcher() i=3 2024-09-22T08:36:49.010 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.998+0000 7f9245d1f800 1 -- 172.21.15.142:0/830284283 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:77 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94200167294368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55acaf85e690 con 0x55acaf819660 2024-09-22T08:36:49.010 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.999+0000 7f92412a1640 1 -- 172.21.15.142:0/830284283 <== osd.1 v2:172.21.15.142:6816/3192108003 29 ==== osd_op_reply(77 notify.4 [watch unwatch cookie 94200167294368] v30'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f922c029040 con 0x55acaf819660 2024-09-22T08:36:49.011 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:48.999+0000 7f9245d1f800 20 remove_watcher() i=4 2024-09-22T08:36:49.011 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:49.000+0000 7f9245d1f800 1 -- 172.21.15.142:0/830284283 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:78 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94200167304112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55acaf85e690 con 0x7f923407d3a0 2024-09-22T08:36:49.011 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:49.000+0000 7f92412a1640 1 -- 172.21.15.142:0/830284283 <== osd.0 v2:172.21.15.31:6800/168281188 17 ==== osd_op_reply(78 notify.5 [watch unwatch cookie 94200167304112] v30'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f922c029040 con 0x7f923407d3a0 2024-09-22T08:36:49.011 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:49.000+0000 7f9245d1f800 20 remove_watcher() i=5 2024-09-22T08:36:49.011 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:49.000+0000 7f9245d1f800 1 -- 172.21.15.142:0/830284283 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:79 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94200167299696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55acaf85e690 con 0x7f923407d3a0 2024-09-22T08:36:49.011 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:49.001+0000 7f92412a1640 1 -- 172.21.15.142:0/830284283 <== osd.0 v2:172.21.15.31:6800/168281188 18 ==== osd_op_reply(79 notify.6 [watch unwatch cookie 94200167299696] v30'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f922c029040 con 0x7f923407d3a0 2024-09-22T08:36:49.011 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:49.002+0000 7f9245d1f800 20 remove_watcher() i=6 2024-09-22T08:36:49.011 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:49.002+0000 7f9245d1f800 1 -- 172.21.15.142:0/830284283 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:80 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94200167307984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55acaf85e690 con 0x7f923407d3a0 2024-09-22T08:36:49.011 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:49.002+0000 7f92412a1640 1 -- 172.21.15.142:0/830284283 <== osd.0 v2:172.21.15.31:6800/168281188 19 ==== osd_op_reply(80 notify.7 [watch unwatch cookie 94200167307984] v30'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f922c029040 con 0x7f923407d3a0 2024-09-22T08:36:49.011 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:49.003+0000 7f9245d1f800 20 remove_watcher() i=7 2024-09-22T08:36:49.011 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:49.003+0000 7f9245d1f800 1 -- 172.21.15.142:0/830284283 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f923407d3a0 msgr2=0x7f9234074610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:49.011 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:49.003+0000 7f9245d1f800 1 --2- 172.21.15.142:0/830284283 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f923407d3a0 0x7f9234074610 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:49.011 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:49.003+0000 7f9245d1f800 1 -- 172.21.15.142:0/830284283 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55acaf819660 msgr2=0x55acaf81bb20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:49.012 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:49.003+0000 7f9245d1f800 1 --2- 172.21.15.142:0/830284283 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55acaf819660 0x55acaf81bb20 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:49.012 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:49.003+0000 7f9245d1f800 1 -- 172.21.15.142:0/830284283 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f923c032020 msgr2=0x7f923c03b9a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:49.012 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:49.003+0000 7f9245d1f800 1 --2- 172.21.15.142:0/830284283 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f923c032020 0x7f923c03b9a0 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:49.012 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:49.003+0000 7f9245d1f800 1 -- 172.21.15.142:0/830284283 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55acaf81e050 msgr2=0x55acaf820440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:49.012 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:49.003+0000 7f9245d1f800 1 --2- 172.21.15.142:0/830284283 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55acaf81e050 0x55acaf820440 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:49.012 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:49.003+0000 7f9245d1f800 1 -- 172.21.15.142:0/830284283 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f910c03cfb0 msgr2=0x7f910c03f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:49.012 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:49.003+0000 7f9245d1f800 1 --2- 172.21.15.142:0/830284283 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f910c03cfb0 0x7f910c03f470 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f9234096f50 tx=0x7f923408f000 comp rx=0 tx=0).stop 2024-09-22T08:36:49.012 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:49.003+0000 7f9245d1f800 1 -- 172.21.15.142:0/830284283 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55acaf806790 msgr2=0x55acaf80dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:49.012 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:49.003+0000 7f9245d1f800 1 --2- 172.21.15.142:0/830284283 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55acaf806790 0x55acaf80dd00 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f923c0154a0 tx=0x7f923c053d50 comp rx=0 tx=0).stop 2024-09-22T08:36:49.012 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:49.003+0000 7f92412a1640 1 -- 172.21.15.142:0/830284283 reap_dead start 2024-09-22T08:36:49.012 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:49.003+0000 7f9245d1f800 1 -- 172.21.15.142:0/830284283 shutdown_connections 2024-09-22T08:36:49.012 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:49.003+0000 7f9245d1f800 1 --2- 172.21.15.142:0/830284283 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55acaf806790 0x55acaf80dd00 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:49.012 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:49.003+0000 7f9245d1f800 1 -- 172.21.15.142:0/830284283 >> 172.21.15.142:0/830284283 conn(0x55acaf802b90 msgr2=0x55acaf800da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:49.013 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:49.003+0000 7f9245d1f800 1 -- 172.21.15.142:0/830284283 shutdown_connections 2024-09-22T08:36:49.013 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:49.003+0000 7f9245d1f800 1 -- 172.21.15.142:0/830284283 wait complete. 2024-09-22T08:36:49.013 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:49.003+0000 7f9245d1f800 1 -- 172.21.15.142:0/3275881282 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f911c03cfb0 msgr2=0x7f911c03f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:49.013 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:49.003+0000 7f9245d1f800 1 --2- 172.21.15.142:0/3275881282 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f911c03cfb0 0x7f911c03f470 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x55acaf7e77d0 tx=0x7f9234073e70 comp rx=0 tx=0).stop 2024-09-22T08:36:49.013 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:49.003+0000 7f9245d1f800 1 -- 172.21.15.142:0/3275881282 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55acaf7f9d30 msgr2=0x55acaf7fa150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:49.013 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:49.003+0000 7f9245d1f800 1 --2- 172.21.15.142:0/3275881282 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55acaf7f9d30 0x55acaf7fa150 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x55acaf7dfcb0 tx=0x7f923c00bf30 comp rx=0 tx=0).stop 2024-09-22T08:36:49.013 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:49.003+0000 7f9245d1f800 1 -- 172.21.15.142:0/3275881282 shutdown_connections 2024-09-22T08:36:49.013 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:49.003+0000 7f9245d1f800 1 --2- 172.21.15.142:0/3275881282 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f911c03cfb0 0x7f911c03f470 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:49.013 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:49.003+0000 7f9245d1f800 1 --2- 172.21.15.142:0/3275881282 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55acaf7f9d30 0x55acaf7fa150 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:49.013 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:49.003+0000 7f9245d1f800 1 -- 172.21.15.142:0/3275881282 >> 172.21.15.142:0/3275881282 conn(0x55acaf7ee0e0 msgr2=0x55acaf7ee4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:49.013 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:49.003+0000 7f9245d1f800 1 -- 172.21.15.142:0/3275881282 shutdown_connections 2024-09-22T08:36:49.013 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:49.003+0000 7f9245d1f800 1 -- 172.21.15.142:0/3275881282 wait complete. 2024-09-22T08:36:49.013 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:49.004+0000 7f9245d1f800 1 -- 172.21.15.142:0/1294955683 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55acaf6eaa10 msgr2=0x55acaf7e6300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:49.013 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:49.004+0000 7f9245d1f800 1 --2- 172.21.15.142:0/1294955683 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55acaf6eaa10 0x55acaf7e6300 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:49.014 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:49.004+0000 7f9245d1f800 1 -- 172.21.15.142:0/1294955683 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55acaf7e8720 msgr2=0x55acaf7eaba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:49.014 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:49.004+0000 7f9245d1f800 1 --2- 172.21.15.142:0/1294955683 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55acaf7e8720 0x55acaf7eaba0 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:49.014 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:49.004+0000 7f9245d1f800 1 -- 172.21.15.142:0/1294955683 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f912803cfb0 msgr2=0x7f912803f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:49.014 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:49.004+0000 7f9245d1f800 1 --2- 172.21.15.142:0/1294955683 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f912803cfb0 0x7f912803f470 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f922c001d70 tx=0x7f922c0012d0 comp rx=0 tx=0).stop 2024-09-22T08:36:49.014 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:49.004+0000 7f9245d1f800 1 -- 172.21.15.142:0/1294955683 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55acaf658d10 msgr2=0x55acaf7decb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:36:49.014 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:49.004+0000 7f9245d1f800 1 --2- 172.21.15.142:0/1294955683 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55acaf658d10 0x55acaf7decb0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f9234025a60 tx=0x7f9234003330 comp rx=0 tx=0).stop 2024-09-22T08:36:49.014 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:49.004+0000 7f9245d1f800 1 -- 172.21.15.142:0/1294955683 shutdown_connections 2024-09-22T08:36:49.014 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:49.004+0000 7f9245d1f800 1 --2- 172.21.15.142:0/1294955683 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55acaf7e8720 0x55acaf7eaba0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:49.014 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:49.004+0000 7f9245d1f800 1 --2- 172.21.15.142:0/1294955683 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55acaf6eaa10 0x55acaf7e6300 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:49.014 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:49.004+0000 7f9245d1f800 1 --2- 172.21.15.142:0/1294955683 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f912803cfb0 0x7f912803f470 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:49.015 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:49.004+0000 7f9245d1f800 1 --2- 172.21.15.142:0/1294955683 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55acaf658d10 0x55acaf7decb0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:36:49.015 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:49.004+0000 7f9245d1f800 1 -- 172.21.15.142:0/1294955683 >> 172.21.15.142:0/1294955683 conn(0x55acaf6dfbb0 msgr2=0x55acaf7d13d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:36:49.015 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:49.004+0000 7f9245d1f800 1 -- 172.21.15.142:0/1294955683 shutdown_connections 2024-09-22T08:36:49.015 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:36:49.004+0000 7f9245d1f800 1 -- 172.21.15.142:0/1294955683 wait complete. 2024-09-22T08:36:49.016 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-22T08:36:42.661297Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-22T08:36:42.661288Z', 'tags': [], 'group_ids': []} 2024-09-22T08:36:49.022 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-09-22T08:36:49.246 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=30000000 bytes_in=0 failed=False 2024-09-22T08:36:49.254 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-22T08:37:04.255 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'list', '--include-all'] 2024-09-22T08:37:04.255 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'list', '--include-all'] 2024-09-22T08:37:04.255 DEBUG:teuthology.orchestra.run.smithi142:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc list --include-all 2024-09-22T08:37:04.303 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:37:04.303 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:37:04.304 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.302+0000 7f8d7c498800 1 Processor -- start 2024-09-22T08:37:04.304 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.302+0000 7f8d7c498800 1 -- start start 2024-09-22T08:37:04.305 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.303+0000 7f8d7c498800 1 --2- >> v2:172.21.15.31:3300/0 conn(0x558d918c44f0 0x558d919554f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:04.305 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.303+0000 7f8d7c498800 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x558d917dba20 con 0x558d91955a30 2024-09-22T08:37:04.305 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.303+0000 7f8d7c498800 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x558d917db7d0 con 0x558d918c44f0 2024-09-22T08:37:04.305 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.303+0000 7f8d79f82640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x558d918c44f0 0x558d919554f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:04.305 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.303+0000 7f8d79f82640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x558d918c44f0 0x558d919554f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:59208/0 (socket says 172.21.15.142:59208) 2024-09-22T08:37:04.305 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.303+0000 7f8d79f82640 1 -- 172.21.15.142:0/2597399018 learned_addr learned my addr 172.21.15.142:0/2597399018 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:37:04.305 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.303+0000 7f8d79781640 1 --1- 172.21.15.142:0/2597399018 >> v1:172.21.15.31:6789/0 conn(0x558d91955a30 0x558d91957ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.142:56302/0 (socket says 172.21.15.142:56302) 2024-09-22T08:37:04.305 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.303+0000 7f8d79f82640 1 -- 172.21.15.142:0/2597399018 >> v1:172.21.15.31:6789/0 conn(0x558d91955a30 legacy=0x558d91957ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:04.305 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.303+0000 7f8d79f82640 1 -- 172.21.15.142:0/2597399018 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x558d9195a790 con 0x558d918c44f0 2024-09-22T08:37:04.307 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.305+0000 7f8d79f82640 1 --2- 172.21.15.142:0/2597399018 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558d918c44f0 0x558d919554f0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f8d6c005fd0 tx=0x7f8d6c045cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9273adbc875a0fc1 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:04.307 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.305+0000 7f8d78f80640 1 -- 172.21.15.142:0/2597399018 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8d6c04e600 con 0x558d918c44f0 2024-09-22T08:37:04.307 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.305+0000 7f8d78f80640 1 -- 172.21.15.142:0/2597399018 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d6c04e7a0 con 0x558d918c44f0 2024-09-22T08:37:04.307 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.306+0000 7f8d78f80640 1 -- 172.21.15.142:0/2597399018 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8d6c04eaa0 con 0x558d918c44f0 2024-09-22T08:37:04.308 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.306+0000 7f8d7c498800 1 -- 172.21.15.142:0/2597399018 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558d918c44f0 msgr2=0x558d919554f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:04.308 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.306+0000 7f8d7c498800 1 --2- 172.21.15.142:0/2597399018 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558d918c44f0 0x558d919554f0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f8d6c005fd0 tx=0x7f8d6c045cf0 comp rx=0 tx=0).stop 2024-09-22T08:37:04.308 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.306+0000 7f8d7c498800 1 -- 172.21.15.142:0/2597399018 shutdown_connections 2024-09-22T08:37:04.308 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.306+0000 7f8d7c498800 1 --2- 172.21.15.142:0/2597399018 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558d918c44f0 0x558d919554f0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:04.308 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.306+0000 7f8d7c498800 1 -- 172.21.15.142:0/2597399018 >> 172.21.15.142:0/2597399018 conn(0x558d9194abe0 msgr2=0x558d9194d020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:37:04.308 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.306+0000 7f8d7c498800 1 -- 172.21.15.142:0/2597399018 shutdown_connections 2024-09-22T08:37:04.308 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.306+0000 7f8d7c498800 1 -- 172.21.15.142:0/2597399018 wait complete. 2024-09-22T08:37:04.322 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.321+0000 7f8d7c498800 1 Processor -- start 2024-09-22T08:37:04.323 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.321+0000 7f8d7c498800 1 -- start start 2024-09-22T08:37:04.323 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.321+0000 7f8d7c498800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558d918c44f0 0x558d91a421e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:04.323 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.321+0000 7f8d7c498800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x558d917e8dd0 con 0x558d918c44f0 2024-09-22T08:37:04.323 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.321+0000 7f8d79f82640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558d918c44f0 0x558d91a421e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:04.323 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.321+0000 7f8d79f82640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558d918c44f0 0x558d91a421e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:59224/0 (socket says 172.21.15.142:59224) 2024-09-22T08:37:04.323 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.321+0000 7f8d79f82640 1 -- 172.21.15.142:0/3383823610 learned_addr learned my addr 172.21.15.142:0/3383823610 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:37:04.323 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.322+0000 7f8d79f82640 1 -- 172.21.15.142:0/3383823610 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558d91a427d0 con 0x558d918c44f0 2024-09-22T08:37:04.326 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.322+0000 7f8d79f82640 1 --2- 172.21.15.142:0/3383823610 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558d918c44f0 0x558d91a421e0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f8d6c005fd0 tx=0x7f8d6c050000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ee663bb53a4353c server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:04.326 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.322+0000 7f8c67e07640 1 -- 172.21.15.142:0/3383823610 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8d6c04ea80 con 0x558d918c44f0 2024-09-22T08:37:04.326 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.322+0000 7f8c67e07640 1 -- 172.21.15.142:0/3383823610 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d6c066070 con 0x558d918c44f0 2024-09-22T08:37:04.326 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.322+0000 7f8c67e07640 1 -- 172.21.15.142:0/3383823610 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8d6c04edc0 con 0x558d918c44f0 2024-09-22T08:37:04.326 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.323+0000 7f8d7c498800 1 -- 172.21.15.142:0/3383823610 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558d918c44f0 msgr2=0x558d91a421e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:04.326 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.323+0000 7f8d7c498800 1 --2- 172.21.15.142:0/3383823610 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558d918c44f0 0x558d91a421e0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f8d6c005fd0 tx=0x7f8d6c050000 comp rx=0 tx=0).stop 2024-09-22T08:37:04.326 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.323+0000 7f8d7c498800 1 -- 172.21.15.142:0/3383823610 shutdown_connections 2024-09-22T08:37:04.326 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.323+0000 7f8d7c498800 1 --2- 172.21.15.142:0/3383823610 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558d918c44f0 0x558d91a421e0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:04.326 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.323+0000 7f8d7c498800 1 -- 172.21.15.142:0/3383823610 >> 172.21.15.142:0/3383823610 conn(0x558d9194abe0 msgr2=0x558d91a3db60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:37:04.326 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.323+0000 7f8d7c498800 1 -- 172.21.15.142:0/3383823610 shutdown_connections 2024-09-22T08:37:04.326 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.323+0000 7f8d7c498800 1 -- 172.21.15.142:0/3383823610 wait complete. 2024-09-22T08:37:04.327 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.323+0000 7f8d7c498800 1 Processor -- start 2024-09-22T08:37:04.327 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.323+0000 7f8d7c498800 1 -- start start 2024-09-22T08:37:04.327 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.323+0000 7f8d7c498800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558d918c44f0 0x558d91a49bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:04.327 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.323+0000 7f8d7c498800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x558d91959a30 con 0x558d918c44f0 2024-09-22T08:37:04.327 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.324+0000 7f8d79f82640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558d918c44f0 0x558d91a49bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:04.327 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.324+0000 7f8d79f82640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558d918c44f0 0x558d91a49bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:59226/0 (socket says 172.21.15.142:59226) 2024-09-22T08:37:04.327 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.324+0000 7f8d79f82640 1 -- 172.21.15.142:0/2186023671 learned_addr learned my addr 172.21.15.142:0/2186023671 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:37:04.327 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.324+0000 7f8d79f82640 1 -- 172.21.15.142:0/2186023671 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558d91a4a110 con 0x558d918c44f0 2024-09-22T08:37:04.327 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.324+0000 7f8d79f82640 1 --2- 172.21.15.142:0/2186023671 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558d918c44f0 0x558d91a49bb0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f8d6c063040 tx=0x7f8d6c003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:04.327 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.324+0000 7f8c66604640 1 -- 172.21.15.142:0/2186023671 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8d6c06d420 con 0x558d918c44f0 2024-09-22T08:37:04.327 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.324+0000 7f8c66604640 1 -- 172.21.15.142:0/2186023671 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d6c071030 con 0x558d918c44f0 2024-09-22T08:37:04.327 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.324+0000 7f8d7c498800 1 -- 172.21.15.142:0/2186023671 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558d91a4a3a0 con 0x558d918c44f0 2024-09-22T08:37:04.328 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.324+0000 7f8c66604640 1 -- 172.21.15.142:0/2186023671 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8d6c06d6f0 con 0x558d918c44f0 2024-09-22T08:37:04.328 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.324+0000 7f8d7c498800 1 -- 172.21.15.142:0/2186023671 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558d91a4ada0 con 0x558d918c44f0 2024-09-22T08:37:04.331 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.325+0000 7f8c66604640 1 -- 172.21.15.142:0/2186023671 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f8d6c06d8e0 con 0x558d918c44f0 2024-09-22T08:37:04.331 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.326+0000 7f8c66604640 1 --2- 172.21.15.142:0/2186023671 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f8c6003cfb0 0x7f8c6003f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:04.331 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.326+0000 7f8c66604640 1 -- 172.21.15.142:0/2186023671 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5938+0+0 (secure 0 0 0) 0x7f8d6c098ce0 con 0x558d918c44f0 2024-09-22T08:37:04.331 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.326+0000 7f8d79781640 1 --2- 172.21.15.142:0/2186023671 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f8c6003cfb0 0x7f8c6003f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:04.331 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.326+0000 7f8d7c498800 1 --2- 172.21.15.142:0/2186023671 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x558d91955a30 0x558d91a51200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:04.331 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.326+0000 7f8d7c498800 1 -- 172.21.15.142:0/2186023671 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558d91a51740 con 0x558d91955a30 2024-09-22T08:37:04.332 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.326+0000 7f8d7a783640 1 --2- 172.21.15.142:0/2186023671 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x558d91955a30 0x558d91a51200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:04.332 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.326+0000 7f8d79781640 1 --2- 172.21.15.142:0/2186023671 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f8c6003cfb0 0x7f8c6003f470 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f8d64001e30 tx=0x7f8d64001390 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:04.332 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.326+0000 7f8d7a783640 1 --2- 172.21.15.142:0/2186023671 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x558d91955a30 0x558d91a51200 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:04.332 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.327+0000 7f8d7a783640 1 -- 172.21.15.142:0/2186023671 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8d740083e0 con 0x558d91955a30 2024-09-22T08:37:04.332 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.327+0000 7f8d7c498800 1 -- 172.21.15.142:0/2186023671 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558d91a51ae0 con 0x558d91955a30 2024-09-22T08:37:04.332 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.327+0000 7f8d7a783640 1 -- 172.21.15.142:0/2186023671 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8d740083e0 con 0x558d91955a30 2024-09-22T08:37:04.332 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.327+0000 7f8d7c498800 1 --2- 172.21.15.142:0/2186023671 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x558d91a535e0 0x558d91a55a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:04.332 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.327+0000 7f8d7c498800 1 -- 172.21.15.142:0/2186023671 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:3 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558d91a561f0 con 0x558d91a535e0 2024-09-22T08:37:04.332 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.327+0000 7f8d79f82640 1 --2- 172.21.15.142:0/2186023671 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x558d91a535e0 0x558d91a55a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:04.332 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.327+0000 7f8d79f82640 1 --2- 172.21.15.142:0/2186023671 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x558d91a535e0 0x558d91a55a60 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:04.332 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.328+0000 7f8d79f82640 1 -- 172.21.15.142:0/2186023671 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(3 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f8d6c07d070 con 0x558d91a535e0 2024-09-22T08:37:04.333 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.328+0000 7f8d7c498800 1 -- 172.21.15.142:0/2186023671 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558d91a52330 con 0x558d91955a30 2024-09-22T08:37:04.333 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.328+0000 7f8d7a783640 1 -- 172.21.15.142:0/2186023671 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8d740083e0 con 0x558d91955a30 2024-09-22T08:37:04.333 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.328+0000 7f8d7c498800 1 -- 172.21.15.142:0/2186023671 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558d91a52780 con 0x558d91a535e0 2024-09-22T08:37:04.333 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.328+0000 7f8d79f82640 1 -- 172.21.15.142:0/2186023671 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(5 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f8d6c07d070 con 0x558d91a535e0 2024-09-22T08:37:04.333 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.329+0000 7f8d7c498800 1 Processor -- start 2024-09-22T08:37:04.333 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.329+0000 7f8d7c498800 1 -- start start 2024-09-22T08:37:04.333 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.329+0000 7f8d7c498800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558d91a64c10 0x558d91a65030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:04.333 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.329+0000 7f8d7c498800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x558d91847d50 con 0x558d91a64c10 2024-09-22T08:37:04.333 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.329+0000 7f8d7a783640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558d91a64c10 0x558d91a65030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:04.333 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.329+0000 7f8d7a783640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558d91a64c10 0x558d91a65030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:59238/0 (socket says 172.21.15.142:59238) 2024-09-22T08:37:04.333 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.329+0000 7f8d7a783640 1 -- 172.21.15.142:0/1494371791 learned_addr learned my addr 172.21.15.142:0/1494371791 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:37:04.334 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.329+0000 7f8d7a783640 1 -- 172.21.15.142:0/1494371791 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558d91a65670 con 0x558d91a64c10 2024-09-22T08:37:04.334 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.330+0000 7f8d7a783640 1 --2- 172.21.15.142:0/1494371791 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558d91a64c10 0x558d91a65030 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x558d91a4abb0 tx=0x7f8d7400bf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:04.334 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.330+0000 7f8c5f7fe640 1 -- 172.21.15.142:0/1494371791 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8d7401c020 con 0x558d91a64c10 2024-09-22T08:37:04.334 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.330+0000 7f8c5f7fe640 1 -- 172.21.15.142:0/1494371791 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d74007c90 con 0x558d91a64c10 2024-09-22T08:37:04.334 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.330+0000 7f8c5f7fe640 1 -- 172.21.15.142:0/1494371791 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8d74018440 con 0x558d91a64c10 2024-09-22T08:37:04.334 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.330+0000 7f8d7c498800 1 -- 172.21.15.142:0/1494371791 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558d91a65ea0 con 0x558d91a64c10 2024-09-22T08:37:04.334 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.330+0000 7f8d7c498800 1 -- 172.21.15.142:0/1494371791 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558d91a66440 con 0x558d91a64c10 2024-09-22T08:37:04.343 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.331+0000 7f8c5f7fe640 1 -- 172.21.15.142:0/1494371791 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f8d7401f020 con 0x558d91a64c10 2024-09-22T08:37:04.343 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.331+0000 7f8c5f7fe640 1 --2- 172.21.15.142:0/1494371791 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f8c5403d000 0x7f8c5403f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:04.344 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.331+0000 7f8c5f7fe640 1 -- 172.21.15.142:0/1494371791 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5938+0+0 (secure 0 0 0) 0x7f8d74055960 con 0x558d91a64c10 2024-09-22T08:37:04.344 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.331+0000 7f8d79f82640 1 --2- 172.21.15.142:0/1494371791 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f8c5403d000 0x7f8c5403f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:04.344 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.331+0000 7f8d7c498800 1 Processor -- start 2024-09-22T08:37:04.344 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.331+0000 7f8d79f82640 1 --2- 172.21.15.142:0/1494371791 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f8c5403d000 0x7f8c5403f4c0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x558d91a526d0 tx=0x7f8d6c06ab60 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:04.344 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.331+0000 7f8d7c498800 1 -- start start 2024-09-22T08:37:04.344 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.332+0000 7f8d7c498800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558d91a716d0 0x558d91a71ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:04.344 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.332+0000 7f8d7c498800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x558d91a42b40 con 0x558d91a716d0 2024-09-22T08:37:04.344 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.332+0000 7f8d7a783640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558d91a716d0 0x558d91a71ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:04.344 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.332+0000 7f8d7a783640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558d91a716d0 0x558d91a71ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:59252/0 (socket says 172.21.15.142:59252) 2024-09-22T08:37:04.344 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.332+0000 7f8d7a783640 1 -- 172.21.15.142:0/2376219039 learned_addr learned my addr 172.21.15.142:0/2376219039 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:37:04.344 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.332+0000 7f8d7a783640 1 -- 172.21.15.142:0/2376219039 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558d91a720c0 con 0x558d91a716d0 2024-09-22T08:37:04.344 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.332+0000 7f8d7a783640 1 --2- 172.21.15.142:0/2376219039 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558d91a716d0 0x558d91a71ad0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f8d74053d80 tx=0x7f8d740153e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abc631cc12c8865b server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:04.345 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.332+0000 7f8c5d7fa640 1 -- 172.21.15.142:0/2376219039 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8d7404a070 con 0x558d91a716d0 2024-09-22T08:37:04.345 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.332+0000 7f8c5d7fa640 1 -- 172.21.15.142:0/2376219039 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d740174d0 con 0x558d91a716d0 2024-09-22T08:37:04.345 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.332+0000 7f8c5d7fa640 1 -- 172.21.15.142:0/2376219039 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8d74052070 con 0x558d91a716d0 2024-09-22T08:37:04.345 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.333+0000 7f8d7c498800 1 -- 172.21.15.142:0/2376219039 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558d91a716d0 msgr2=0x558d91a71ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:04.345 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.333+0000 7f8d7c498800 1 --2- 172.21.15.142:0/2376219039 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558d91a716d0 0x558d91a71ad0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f8d74053d80 tx=0x7f8d740153e0 comp rx=0 tx=0).stop 2024-09-22T08:37:04.345 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.333+0000 7f8d7c498800 1 -- 172.21.15.142:0/2376219039 shutdown_connections 2024-09-22T08:37:04.345 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.333+0000 7f8d7c498800 1 --2- 172.21.15.142:0/2376219039 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558d91a716d0 0x558d91a71ad0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:04.345 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.333+0000 7f8d7c498800 1 -- 172.21.15.142:0/2376219039 >> 172.21.15.142:0/2376219039 conn(0x558d91a6dad0 msgr2=0x558d91a6bd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:37:04.345 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.333+0000 7f8d7c498800 1 -- 172.21.15.142:0/2376219039 shutdown_connections 2024-09-22T08:37:04.345 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.333+0000 7f8d7c498800 1 -- 172.21.15.142:0/2376219039 wait complete. 2024-09-22T08:37:04.345 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.333+0000 7f8d7c498800 1 Processor -- start 2024-09-22T08:37:04.345 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.333+0000 7f8d7c498800 1 -- start start 2024-09-22T08:37:04.346 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.333+0000 7f8d7c498800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558d91a716d0 0x558d91a78cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:04.346 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.333+0000 7f8d7c498800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x558d91a726e0 con 0x558d91a716d0 2024-09-22T08:37:04.346 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.334+0000 7f8d7a783640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558d91a716d0 0x558d91a78cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:04.346 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.334+0000 7f8d7a783640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558d91a716d0 0x558d91a78cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:59262/0 (socket says 172.21.15.142:59262) 2024-09-22T08:37:04.346 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.334+0000 7f8d7a783640 1 -- 172.21.15.142:0/4275839061 learned_addr learned my addr 172.21.15.142:0/4275839061 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:37:04.346 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.334+0000 7f8d7a783640 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558d91a79250 con 0x558d91a716d0 2024-09-22T08:37:04.346 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.334+0000 7f8d7a783640 1 --2- 172.21.15.142:0/4275839061 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558d91a716d0 0x558d91a78cf0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f8d740540f0 tx=0x7f8d74053ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:04.346 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.334+0000 7f8c4b7fe640 1 -- 172.21.15.142:0/4275839061 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8d7402e030 con 0x558d91a716d0 2024-09-22T08:37:04.346 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.334+0000 7f8c4b7fe640 1 -- 172.21.15.142:0/4275839061 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d74013320 con 0x558d91a716d0 2024-09-22T08:37:04.346 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.334+0000 7f8d7c498800 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558d91a794e0 con 0x558d91a716d0 2024-09-22T08:37:04.346 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.334+0000 7f8c4b7fe640 1 -- 172.21.15.142:0/4275839061 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8d7404a040 con 0x558d91a716d0 2024-09-22T08:37:04.347 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.334+0000 7f8d7c498800 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558d91a79e60 con 0x558d91a716d0 2024-09-22T08:37:04.347 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.335+0000 7f8c4b7fe640 1 -- 172.21.15.142:0/4275839061 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f8d74031030 con 0x558d91a716d0 2024-09-22T08:37:04.347 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.336+0000 7f8c4b7fe640 1 --2- 172.21.15.142:0/4275839061 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f8c4403cfb0 0x7f8c4403f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:04.347 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.336+0000 7f8d7c498800 20 rados->read ofs=0 len=0 2024-09-22T08:37:04.347 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.336+0000 7f8c4b7fe640 1 -- 172.21.15.142:0/4275839061 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5938+0+0 (secure 0 0 0) 0x7f8d7402f070 con 0x558d91a716d0 2024-09-22T08:37:04.347 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.336+0000 7f8d79f82640 1 --2- 172.21.15.142:0/4275839061 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f8c4403cfb0 0x7f8c4403f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:04.347 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.336+0000 7f8d7c498800 1 --2- 172.21.15.142:0/4275839061 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x558d91a84600 0x558d91a86a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:04.347 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.336+0000 7f8d7c498800 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558d91a871e0 con 0x558d91a84600 2024-09-22T08:37:04.347 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.336+0000 7f8d79781640 1 --2- 172.21.15.142:0/4275839061 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x558d91a84600 0x558d91a86a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:04.347 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.336+0000 7f8d79f82640 1 --2- 172.21.15.142:0/4275839061 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f8c4403cfb0 0x7f8c4403f470 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f8d6c061fd0 tx=0x7f8d6c088000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:04.347 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.336+0000 7f8d79781640 1 --2- 172.21.15.142:0/4275839061 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x558d91a84600 0x558d91a86a90 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:04.348 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.337+0000 7f8d79781640 1 -- 172.21.15.142:0/4275839061 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8d6400f610 con 0x558d91a84600 2024-09-22T08:37:04.348 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.337+0000 7f8d7c498800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:04.348 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.337+0000 7f8d7c498800 20 realm 2024-09-22T08:37:04.348 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.337+0000 7f8d7c498800 20 rados->read ofs=0 len=0 2024-09-22T08:37:04.348 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.337+0000 7f8d7c498800 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558d91a83a10 con 0x558d91a84600 2024-09-22T08:37:04.348 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.337+0000 7f8d79781640 1 -- 172.21.15.142:0/4275839061 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8d6400f610 con 0x558d91a84600 2024-09-22T08:37:04.348 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.337+0000 7f8d7c498800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:04.348 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.337+0000 7f8d7c498800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:37:04.348 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.337+0000 7f8d7c498800 20 rados->read ofs=0 len=0 2024-09-22T08:37:04.348 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.337+0000 7f8d7c498800 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558d91a87cc0 con 0x558d91a84600 2024-09-22T08:37:04.348 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.337+0000 7f8d79781640 1 -- 172.21.15.142:0/4275839061 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8d6400f610 con 0x558d91a84600 2024-09-22T08:37:04.348 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.337+0000 7f8d7c498800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:04.349 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.337+0000 7f8d7c498800 20 rados->read ofs=0 len=0 2024-09-22T08:37:04.349 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.337+0000 7f8d7c498800 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558d91a88590 con 0x558d91a84600 2024-09-22T08:37:04.349 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.337+0000 7f8d79781640 1 -- 172.21.15.142:0/4275839061 <== osd.1 v2:172.21.15.142:6816/3192108003 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8d6400f610 con 0x558d91a84600 2024-09-22T08:37:04.349 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.337+0000 7f8d7c498800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:37:04.349 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.337+0000 7f8d7c498800 20 rados->read ofs=0 len=0 2024-09-22T08:37:04.349 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.337+0000 7f8d7c498800 1 --2- 172.21.15.142:0/4275839061 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x558d91a88ed0 0x558d91a8b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:04.349 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.337+0000 7f8d7c498800 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558d91a8ba00 con 0x558d91a88ed0 2024-09-22T08:37:04.349 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.338+0000 7f8d7a783640 1 --2- 172.21.15.142:0/4275839061 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x558d91a88ed0 0x558d91a8b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:04.349 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.338+0000 7f8d7a783640 1 --2- 172.21.15.142:0/4275839061 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x558d91a88ed0 0x558d91a8b2c0 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:04.349 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.338+0000 7f8d7a783640 1 -- 172.21.15.142:0/4275839061 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(5 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f8d7403a070 con 0x558d91a88ed0 2024-09-22T08:37:04.349 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.338+0000 7f8d7c498800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:37:04.349 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.338+0000 7f8d7c498800 20 searching for the correct realm 2024-09-22T08:37:04.350 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.338+0000 7f8d7c498800 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558d91a8d3b0 con 0x558d91a88ed0 2024-09-22T08:37:04.350 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.338+0000 7f8d7a783640 1 -- 172.21.15.142:0/4275839061 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8d7403a070 con 0x558d91a88ed0 2024-09-22T08:37:04.350 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.338+0000 7f8d7a783640 1 --2- 172.21.15.142:0/4275839061 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f8d74021020 0x7f8d74016510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:04.350 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.338+0000 7f8d7a783640 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558d91a8d3b0 con 0x7f8d74021020 2024-09-22T08:37:04.350 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.338+0000 7f8d79f82640 1 --2- 172.21.15.142:0/4275839061 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f8d74021020 0x7f8d74016510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:04.350 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.339+0000 7f8d79f82640 1 --2- 172.21.15.142:0/4275839061 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f8d74021020 0x7f8d74016510 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:04.350 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.339+0000 7f8d79f82640 1 -- 172.21.15.142:0/4275839061 <== osd.2 v2:172.21.15.142:6808/279438927 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8d6c07d070 con 0x7f8d74021020 2024-09-22T08:37:04.350 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.339+0000 7f8d79f82640 1 --2- 172.21.15.142:0/4275839061 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f8d6c06d040 0x7f8d6c0974e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:04.350 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.339+0000 7f8d79f82640 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558d91a8d3b0 con 0x7f8d6c06d040 2024-09-22T08:37:04.350 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.339+0000 7f8d79781640 1 --2- 172.21.15.142:0/4275839061 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f8d6c06d040 0x7f8d6c0974e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:04.350 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.340+0000 7f8d79781640 1 --2- 172.21.15.142:0/4275839061 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f8d6c06d040 0x7f8d6c0974e0 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:04.350 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.340+0000 7f8d79781640 1 -- 172.21.15.142:0/4275839061 <== osd.0 v2:172.21.15.31:6800/168281188 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8d6400f610 con 0x7f8d6c06d040 2024-09-22T08:37:04.351 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.340+0000 7f8d79781640 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558d91a8d3b0 con 0x558d91a84600 2024-09-22T08:37:04.351 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.340+0000 7f8d79781640 1 -- 172.21.15.142:0/4275839061 <== osd.1 v2:172.21.15.142:6816/3192108003 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8d6400f610 con 0x558d91a84600 2024-09-22T08:37:04.351 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.340+0000 7f8d79781640 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558d91a8d3b0 con 0x558d91a84600 2024-09-22T08:37:04.351 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.341+0000 7f8d79781640 1 -- 172.21.15.142:0/4275839061 <== osd.1 v2:172.21.15.142:6816/3192108003 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8d6402b040 con 0x558d91a84600 2024-09-22T08:37:04.351 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.341+0000 7f8d79781640 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558d91a8d3b0 con 0x558d91a84600 2024-09-22T08:37:04.351 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.341+0000 7f8d79781640 1 -- 172.21.15.142:0/4275839061 <== osd.1 v2:172.21.15.142:6816/3192108003 7 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8d6402b040 con 0x558d91a84600 2024-09-22T08:37:04.351 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.341+0000 7f8d79781640 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558d91a8d3b0 con 0x7f8d6c06d040 2024-09-22T08:37:04.351 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.341+0000 7f8d79781640 1 -- 172.21.15.142:0/4275839061 <== osd.0 v2:172.21.15.31:6800/168281188 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8d6402b040 con 0x7f8d6c06d040 2024-09-22T08:37:04.351 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.341+0000 7f8d79781640 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558d91a8d3b0 con 0x7f8d74021020 2024-09-22T08:37:04.351 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.342+0000 7f8d79f82640 1 -- 172.21.15.142:0/4275839061 <== osd.2 v2:172.21.15.142:6808/279438927 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8d6c07d070 con 0x7f8d74021020 2024-09-22T08:37:04.351 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.342+0000 7f8d79f82640 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558d91a8d3b0 con 0x558d91a88ed0 2024-09-22T08:37:04.351 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.342+0000 7f8d7a783640 1 -- 172.21.15.142:0/4275839061 <== osd.3 v2:172.21.15.142:6800/1064901393 3 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8d7403a070 con 0x558d91a88ed0 2024-09-22T08:37:04.351 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.342+0000 7f8d7a783640 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558d91a8d3b0 con 0x558d91a84600 2024-09-22T08:37:04.352 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.342+0000 7f8d79781640 1 -- 172.21.15.142:0/4275839061 <== osd.1 v2:172.21.15.142:6816/3192108003 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8d6402b040 con 0x558d91a84600 2024-09-22T08:37:04.352 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.342+0000 7f8d79781640 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558d91a8d3b0 con 0x7f8d6c06d040 2024-09-22T08:37:04.352 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.342+0000 7f8d79781640 1 -- 172.21.15.142:0/4275839061 <== osd.0 v2:172.21.15.31:6800/168281188 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8d6402b040 con 0x7f8d6c06d040 2024-09-22T08:37:04.352 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.342+0000 7f8d79781640 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558d91a8d3b0 con 0x558d91a84600 2024-09-22T08:37:04.360 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.343+0000 7f8d79781640 1 -- 172.21.15.142:0/4275839061 <== osd.1 v2:172.21.15.142:6816/3192108003 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8d6402b040 con 0x558d91a84600 2024-09-22T08:37:04.360 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.343+0000 7f8d79781640 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558d91a8d3b0 con 0x7f8d74021020 2024-09-22T08:37:04.360 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.343+0000 7f8d79f82640 1 -- 172.21.15.142:0/4275839061 <== osd.2 v2:172.21.15.142:6808/279438927 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f8d6c07d070 con 0x7f8d74021020 2024-09-22T08:37:04.360 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.343+0000 7f8d79f82640 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558d91a8d3b0 con 0x558d91a88ed0 2024-09-22T08:37:04.360 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.343+0000 7f8d7a783640 1 -- 172.21.15.142:0/4275839061 <== osd.3 v2:172.21.15.142:6800/1064901393 4 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8d7403a070 con 0x558d91a88ed0 2024-09-22T08:37:04.360 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.343+0000 7f8d7a783640 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558d91a8d3b0 con 0x558d91a88ed0 2024-09-22T08:37:04.360 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.343+0000 7f8d7a783640 1 -- 172.21.15.142:0/4275839061 <== osd.3 v2:172.21.15.142:6800/1064901393 5 ==== osd_op_reply(20 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f8d7403a070 con 0x558d91a88ed0 2024-09-22T08:37:04.361 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.343+0000 7f8d7a783640 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558d91a8d3b0 con 0x7f8d6c06d040 2024-09-22T08:37:04.361 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.344+0000 7f8d79781640 1 -- 172.21.15.142:0/4275839061 <== osd.0 v2:172.21.15.31:6800/168281188 4 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8d6402b040 con 0x7f8d6c06d040 2024-09-22T08:37:04.361 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.344+0000 7f8d79781640 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558d91a8d3b0 con 0x558d91a88ed0 2024-09-22T08:37:04.361 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.344+0000 7f8d7a783640 1 -- 172.21.15.142:0/4275839061 <== osd.3 v2:172.21.15.142:6800/1064901393 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8d7403a070 con 0x558d91a88ed0 2024-09-22T08:37:04.361 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.344+0000 7f8d7a783640 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f8d74063040 con 0x558d91a88ed0 2024-09-22T08:37:04.361 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.344+0000 7f8d7a783640 1 -- 172.21.15.142:0/4275839061 <== osd.3 v2:172.21.15.142:6800/1064901393 7 ==== osd_op_reply(23 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f8d7403a070 con 0x558d91a88ed0 2024-09-22T08:37:04.361 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.344+0000 7f8d7a783640 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f8d74063040 con 0x558d91a84600 2024-09-22T08:37:04.361 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.344+0000 7f8d79781640 1 -- 172.21.15.142:0/4275839061 <== osd.1 v2:172.21.15.142:6816/3192108003 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8d6402b040 con 0x558d91a84600 2024-09-22T08:37:04.361 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.344+0000 7f8d79781640 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f8d74063040 con 0x558d91a84600 2024-09-22T08:37:04.361 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.345+0000 7f8d79781640 1 -- 172.21.15.142:0/4275839061 <== osd.1 v2:172.21.15.142:6816/3192108003 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f8d6402b040 con 0x558d91a84600 2024-09-22T08:37:04.361 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.345+0000 7f8d79781640 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f8d74063040 con 0x7f8d6c06d040 2024-09-22T08:37:04.361 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.345+0000 7f8d79781640 1 -- 172.21.15.142:0/4275839061 <== osd.0 v2:172.21.15.31:6800/168281188 5 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8d6402b040 con 0x7f8d6c06d040 2024-09-22T08:37:04.361 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.345+0000 7f8d79781640 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f8d74063040 con 0x558d91a88ed0 2024-09-22T08:37:04.362 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.345+0000 7f8d7a783640 1 -- 172.21.15.142:0/4275839061 <== osd.3 v2:172.21.15.142:6800/1064901393 8 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8d7403a070 con 0x558d91a88ed0 2024-09-22T08:37:04.362 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.345+0000 7f8d7a783640 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f8d74063040 con 0x7f8d74021020 2024-09-22T08:37:04.362 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.345+0000 7f8d79f82640 1 -- 172.21.15.142:0/4275839061 <== osd.2 v2:172.21.15.142:6808/279438927 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8d6c07d070 con 0x7f8d74021020 2024-09-22T08:37:04.362 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.345+0000 7f8d79f82640 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f8d74063040 con 0x558d91a84600 2024-09-22T08:37:04.362 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.346+0000 7f8d79781640 1 -- 172.21.15.142:0/4275839061 <== osd.1 v2:172.21.15.142:6816/3192108003 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8d6402b040 con 0x558d91a84600 2024-09-22T08:37:04.362 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.346+0000 7f8d79781640 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f8d74063040 con 0x7f8d6c06d040 2024-09-22T08:37:04.362 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.346+0000 7f8d79781640 1 -- 172.21.15.142:0/4275839061 <== osd.0 v2:172.21.15.31:6800/168281188 6 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8d6403b040 con 0x7f8d6c06d040 2024-09-22T08:37:04.362 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.346+0000 7f8d79781640 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f8d74063040 con 0x558d91a88ed0 2024-09-22T08:37:04.362 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.346+0000 7f8d7a783640 1 -- 172.21.15.142:0/4275839061 <== osd.3 v2:172.21.15.142:6800/1064901393 9 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8d7403a070 con 0x558d91a88ed0 2024-09-22T08:37:04.362 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.346+0000 7f8d7a783640 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f8d74063040 con 0x7f8d6c06d040 2024-09-22T08:37:04.363 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.347+0000 7f8d79781640 1 -- 172.21.15.142:0/4275839061 <== osd.0 v2:172.21.15.31:6800/168281188 7 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8d6403b040 con 0x7f8d6c06d040 2024-09-22T08:37:04.363 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.347+0000 7f8d79781640 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f8d74063040 con 0x7f8d74021020 2024-09-22T08:37:04.363 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.347+0000 7f8d79f82640 1 -- 172.21.15.142:0/4275839061 <== osd.2 v2:172.21.15.142:6808/279438927 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8d6c07d070 con 0x7f8d74021020 2024-09-22T08:37:04.363 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.347+0000 7f8d79f82640 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f8d74063040 con 0x558d91a88ed0 2024-09-22T08:37:04.363 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.347+0000 7f8d7a783640 1 -- 172.21.15.142:0/4275839061 <== osd.3 v2:172.21.15.142:6800/1064901393 10 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8d7403a070 con 0x558d91a88ed0 2024-09-22T08:37:04.363 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.347+0000 7f8d7a783640 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f8d74063040 con 0x7f8d6c06d040 2024-09-22T08:37:04.363 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.348+0000 7f8d79781640 1 -- 172.21.15.142:0/4275839061 <== osd.0 v2:172.21.15.31:6800/168281188 8 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8d6403b040 con 0x7f8d6c06d040 2024-09-22T08:37:04.363 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.348+0000 7f8d79781640 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f8d74063040 con 0x558d91a84600 2024-09-22T08:37:04.363 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.348+0000 7f8d79781640 1 -- 172.21.15.142:0/4275839061 <== osd.1 v2:172.21.15.142:6816/3192108003 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f8d6403b040 con 0x558d91a84600 2024-09-22T08:37:04.363 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.348+0000 7f8d79781640 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f8d74063040 con 0x7f8d74021020 2024-09-22T08:37:04.363 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.348+0000 7f8d79f82640 1 -- 172.21.15.142:0/4275839061 <== osd.2 v2:172.21.15.142:6808/279438927 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8d6c07d070 con 0x7f8d74021020 2024-09-22T08:37:04.364 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.348+0000 7f8d7c498800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:37:04.364 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.348+0000 7f8d7c498800 20 RGWRados::pool_iterate: got zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec 2024-09-22T08:37:04.364 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.348+0000 7f8d7c498800 20 RGWRados::pool_iterate: got zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f 2024-09-22T08:37:04.364 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.348+0000 7f8d7c498800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:37:04.364 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.348+0000 7f8d7c498800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:37:04.364 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.348+0000 7f8d7c498800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:37:04.364 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.348+0000 7f8d7c498800 20 rados->read ofs=0 len=0 2024-09-22T08:37:04.364 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.348+0000 7f8d7c498800 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558d91a8c480 con 0x558d91a84600 2024-09-22T08:37:04.364 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.348+0000 7f8d79781640 1 -- 172.21.15.142:0/4275839061 <== osd.1 v2:172.21.15.142:6816/3192108003 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8d6403b040 con 0x558d91a84600 2024-09-22T08:37:04.364 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.348+0000 7f8d7c498800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:04.364 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.348+0000 7f8d7c498800 20 rados->read ofs=0 len=0 2024-09-22T08:37:04.364 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.348+0000 7f8d7c498800 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558d91a8cd20 con 0x558d91a84600 2024-09-22T08:37:04.365 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.349+0000 7f8d79781640 1 -- 172.21.15.142:0/4275839061 <== osd.1 v2:172.21.15.142:6816/3192108003 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8d6403b040 con 0x558d91a84600 2024-09-22T08:37:04.365 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.349+0000 7f8d7c498800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:37:04.365 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.349+0000 7f8d7c498800 20 rados->read ofs=0 len=0 2024-09-22T08:37:04.365 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.349+0000 7f8d7c498800 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:40 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558d91a8c0c0 con 0x558d91a88ed0 2024-09-22T08:37:04.365 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.349+0000 7f8d7a783640 1 -- 172.21.15.142:0/4275839061 <== osd.3 v2:172.21.15.142:6800/1064901393 11 ==== osd_op_reply(40 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f8d7403a070 con 0x558d91a88ed0 2024-09-22T08:37:04.365 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.349+0000 7f8d7c498800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:37:04.365 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.349+0000 7f8d7c498800 20 zone default found 2024-09-22T08:37:04.365 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.349+0000 7f8d7c498800 4 Realm: () 2024-09-22T08:37:04.365 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.349+0000 7f8d7c498800 4 ZoneGroup: default (d89f6f57-1007-47dd-9065-f486c7b01aec) 2024-09-22T08:37:04.365 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.349+0000 7f8d7c498800 4 Zone: default (e239248c-0bee-4e41-803a-24b288d3eb8f) 2024-09-22T08:37:04.365 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.349+0000 7f8d7c498800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:37:04.365 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.349+0000 7f8d7c498800 20 zonegroup default 2024-09-22T08:37:04.365 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.349+0000 7f8d7c498800 20 rados->read ofs=0 len=0 2024-09-22T08:37:04.365 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.349+0000 7f8d7c498800 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558d91a8c950 con 0x7f8d6c06d040 2024-09-22T08:37:04.366 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.349+0000 7f8d79781640 1 -- 172.21.15.142:0/4275839061 <== osd.0 v2:172.21.15.31:6800/168281188 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f8d6403b040 con 0x7f8d6c06d040 2024-09-22T08:37:04.366 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.349+0000 7f8d7c498800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:04.366 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.349+0000 7f8d7c498800 20 rados->read ofs=0 len=0 2024-09-22T08:37:04.366 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.349+0000 7f8d7c498800 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558d91a8f870 con 0x558d91a88ed0 2024-09-22T08:37:04.366 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.349+0000 7f8d7a783640 1 -- 172.21.15.142:0/4275839061 <== osd.3 v2:172.21.15.142:6800/1064901393 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8d7403a070 con 0x558d91a88ed0 2024-09-22T08:37:04.366 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.350+0000 7f8d7c498800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:04.366 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.350+0000 7f8d7c498800 20 rados->read ofs=0 len=0 2024-09-22T08:37:04.366 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.350+0000 7f8d7c498800 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558d91a8f870 con 0x558d91a88ed0 2024-09-22T08:37:04.366 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.350+0000 7f8d7a783640 1 -- 172.21.15.142:0/4275839061 <== osd.3 v2:172.21.15.142:6800/1064901393 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8d7403a070 con 0x558d91a88ed0 2024-09-22T08:37:04.366 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.350+0000 7f8d7c498800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:04.366 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.350+0000 7f8d7c498800 20 started sync module instance, tier type = 2024-09-22T08:37:04.366 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.350+0000 7f8d7c498800 20 started zone id=e239248c-0bee-4e41-803a-24b288d3eb8f (name=default) with tier type = 2024-09-22T08:37:04.367 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.350+0000 7f8d7c498800 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558d91a8ec10 con 0x7f8d74021020 2024-09-22T08:37:04.367 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.351+0000 7f8d79f82640 1 -- 172.21.15.142:0/4275839061 <== osd.2 v2:172.21.15.142:6808/279438927 7 ==== osd_op_reply(44 notify.0 [create] v32'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8d6c07d070 con 0x7f8d74021020 2024-09-22T08:37:04.367 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.351+0000 7f8d7c498800 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94066522515296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558d91a8fcd0 con 0x7f8d74021020 2024-09-22T08:37:04.367 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.351+0000 7f8d7c498800 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558d91a90520 con 0x558d91a84600 2024-09-22T08:37:04.367 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.352+0000 7f8d79f82640 1 -- 172.21.15.142:0/4275839061 <== osd.2 v2:172.21.15.142:6808/279438927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94066522515296] v32'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8d6c07d070 con 0x7f8d74021020 2024-09-22T08:37:04.367 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.353+0000 7f8d79781640 1 -- 172.21.15.142:0/4275839061 <== osd.1 v2:172.21.15.142:6816/3192108003 16 ==== osd_op_reply(46 notify.1 [create] v32'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8d6403b040 con 0x558d91a84600 2024-09-22T08:37:04.367 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.353+0000 7f8d7c498800 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94066522521712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558d91a90940 con 0x558d91a84600 2024-09-22T08:37:04.367 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.353+0000 7f8d7c498800 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558d91a911f0 con 0x558d91a88ed0 2024-09-22T08:37:04.367 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.354+0000 7f8d79781640 1 -- 172.21.15.142:0/4275839061 <== osd.1 v2:172.21.15.142:6816/3192108003 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94066522521712] v32'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8d6403b040 con 0x558d91a84600 2024-09-22T08:37:04.367 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.354+0000 7f8d7a783640 1 -- 172.21.15.142:0/4275839061 <== osd.3 v2:172.21.15.142:6800/1064901393 14 ==== osd_op_reply(48 notify.2 [create] v32'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8d7403a070 con 0x558d91a88ed0 2024-09-22T08:37:04.367 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.354+0000 7f8d7c498800 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94066522522768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558d91a90d60 con 0x558d91a88ed0 2024-09-22T08:37:04.367 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.354+0000 7f8d7c498800 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558d91a91cc0 con 0x7f8d74021020 2024-09-22T08:37:04.367 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.355+0000 7f8d79f82640 1 -- 172.21.15.142:0/4275839061 <== osd.2 v2:172.21.15.142:6808/279438927 9 ==== osd_op_reply(50 notify.3 [create] v32'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8d6c07d070 con 0x7f8d74021020 2024-09-22T08:37:04.368 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.355+0000 7f8d7c498800 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94066522527664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558d91a92550 con 0x7f8d74021020 2024-09-22T08:37:04.368 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.355+0000 7f8d7c498800 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558d91a93060 con 0x558d91a84600 2024-09-22T08:37:04.368 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.355+0000 7f8d7a783640 1 -- 172.21.15.142:0/4275839061 <== osd.3 v2:172.21.15.142:6800/1064901393 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94066522522768] v32'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8d7403a070 con 0x558d91a88ed0 2024-09-22T08:37:04.368 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.356+0000 7f8d79f82640 1 -- 172.21.15.142:0/4275839061 <== osd.2 v2:172.21.15.142:6808/279438927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94066522527664] v32'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8d6c07d070 con 0x7f8d74021020 2024-09-22T08:37:04.368 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.356+0000 7f8d79781640 1 -- 172.21.15.142:0/4275839061 <== osd.1 v2:172.21.15.142:6816/3192108003 18 ==== osd_op_reply(52 notify.4 [create] v32'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8d6403b040 con 0x558d91a84600 2024-09-22T08:37:04.368 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.356+0000 7f8d7c498800 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94066522532624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558d91a93020 con 0x558d91a84600 2024-09-22T08:37:04.368 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.356+0000 7f8d7c498800 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558d91a93900 con 0x7f8d6c06d040 2024-09-22T08:37:04.368 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.358+0000 7f8d79781640 1 -- 172.21.15.142:0/4275839061 <== osd.0 v2:172.21.15.31:6800/168281188 10 ==== osd_op_reply(54 notify.5 [create] v32'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8d6403b040 con 0x7f8d6c06d040 2024-09-22T08:37:04.368 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.358+0000 7f8d7c498800 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94066522534912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558d91a93cd0 con 0x7f8d6c06d040 2024-09-22T08:37:04.368 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.358+0000 7f8d7c498800 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558d91a94580 con 0x7f8d6c06d040 2024-09-22T08:37:04.368 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.358+0000 7f8d79781640 1 -- 172.21.15.142:0/4275839061 <== osd.1 v2:172.21.15.142:6816/3192108003 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94066522532624] v32'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8d6403b040 con 0x558d91a84600 2024-09-22T08:37:04.369 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.359+0000 7f8d79781640 1 -- 172.21.15.142:0/4275839061 <== osd.0 v2:172.21.15.31:6800/168281188 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94066522534912] v32'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8d6403b040 con 0x7f8d6c06d040 2024-09-22T08:37:04.369 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.359+0000 7f8d79781640 1 -- 172.21.15.142:0/4275839061 <== osd.0 v2:172.21.15.31:6800/168281188 12 ==== osd_op_reply(56 notify.6 [create] v32'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8d6403b040 con 0x7f8d6c06d040 2024-09-22T08:37:04.369 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.359+0000 7f8d7c498800 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94066522523824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558d91a93cd0 con 0x7f8d6c06d040 2024-09-22T08:37:04.369 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.359+0000 7f8d7c498800 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558d91a94c10 con 0x7f8d6c06d040 2024-09-22T08:37:04.371 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.360+0000 7f8d79781640 1 -- 172.21.15.142:0/4275839061 <== osd.0 v2:172.21.15.31:6800/168281188 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94066522523824] v32'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8d6403b040 con 0x7f8d6c06d040 2024-09-22T08:37:04.372 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.360+0000 7f8d79781640 1 -- 172.21.15.142:0/4275839061 <== osd.0 v2:172.21.15.31:6800/168281188 14 ==== osd_op_reply(58 notify.7 [create] v32'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8d6403b040 con 0x7f8d6c06d040 2024-09-22T08:37:04.372 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.360+0000 7f8d7c498800 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94066522535968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558d91a94c10 con 0x7f8d6c06d040 2024-09-22T08:37:04.372 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.360+0000 7f8d7c498800 20 add_watcher() i=0 2024-09-22T08:37:04.372 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.360+0000 7f8d7c498800 20 add_watcher() i=1 2024-09-22T08:37:04.372 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.360+0000 7f8d7c498800 20 add_watcher() i=2 2024-09-22T08:37:04.372 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.360+0000 7f8d7c498800 20 add_watcher() i=3 2024-09-22T08:37:04.372 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.360+0000 7f8d7c498800 20 add_watcher() i=4 2024-09-22T08:37:04.372 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.360+0000 7f8d7c498800 20 add_watcher() i=5 2024-09-22T08:37:04.372 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.360+0000 7f8d7c498800 20 add_watcher() i=6 2024-09-22T08:37:04.372 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.361+0000 7f8d79781640 1 -- 172.21.15.142:0/4275839061 <== osd.0 v2:172.21.15.31:6800/168281188 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94066522535968] v32'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8d6403b040 con 0x7f8d6c06d040 2024-09-22T08:37:04.372 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.361+0000 7f8d7c498800 20 add_watcher() i=7 2024-09-22T08:37:04.372 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.361+0000 7f8d7c498800 2 all 8 watchers are set, enabling cache 2024-09-22T08:37:04.372 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.361+0000 7f8d7c498800 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558d91a97ed0 con 0x558d91a84600 2024-09-22T08:37:04.373 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.361+0000 7f8d79781640 1 -- 172.21.15.142:0/4275839061 <== osd.1 v2:172.21.15.142:6816/3192108003 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f8d6403b040 con 0x558d91a84600 2024-09-22T08:37:04.373 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.361+0000 7f8d7c498800 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94066522552560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558d91a94c10 con 0x558d91a84600 2024-09-22T08:37:04.373 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.362+0000 7f8d79781640 1 -- 172.21.15.142:0/4275839061 <== osd.1 v2:172.21.15.142:6816/3192108003 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94066522552560] v32'152 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8d6403b040 con 0x558d91a84600 2024-09-22T08:37:04.373 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.363+0000 7f8c2ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:37:04.373 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.363+0000 7f8d7c498800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:37:04.373 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.363+0000 7f8d7c498800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:37:04.373 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.363+0000 7f8d7c498800 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558d91aa06f0 con 0x558d91a84600 2024-09-22T08:37:04.373 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.364+0000 7f8d79781640 1 -- 172.21.15.142:0/4275839061 <== osd.1 v2:172.21.15.142:6816/3192108003 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'24 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8d6403b040 con 0x558d91a84600 2024-09-22T08:37:04.373 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.364+0000 7f8d7c498800 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558d91aa0ce0 con 0x7f8d6c06d040 2024-09-22T08:37:04.373 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.365+0000 7f8d79781640 1 -- 172.21.15.142:0/4275839061 <== osd.0 v2:172.21.15.31:6800/168281188 16 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'18 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8d6403b040 con 0x7f8d6c06d040 2024-09-22T08:37:04.373 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.365+0000 7f8d7c498800 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558d91aa1250 con 0x558d91a88ed0 2024-09-22T08:37:04.373 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.366+0000 7f8d7a783640 1 -- 172.21.15.142:0/4275839061 <== osd.3 v2:172.21.15.142:6800/1064901393 16 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8d7403a070 con 0x558d91a88ed0 2024-09-22T08:37:04.373 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.366+0000 7f8d7c498800 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558d91aa1250 con 0x558d91a84600 2024-09-22T08:37:04.373 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.367+0000 7f8d79781640 1 -- 172.21.15.142:0/4275839061 <== osd.1 v2:172.21.15.142:6816/3192108003 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'153 uv15 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8d6403b040 con 0x558d91a84600 2024-09-22T08:37:04.374 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.367+0000 7f8d7c498800 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558d91aa1340 con 0x7f8d74021020 2024-09-22T08:37:04.374 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.368+0000 7f8d79f82640 1 -- 172.21.15.142:0/4275839061 <== osd.2 v2:172.21.15.142:6808/279438927 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'45 uv44 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8d6c07d070 con 0x7f8d74021020 2024-09-22T08:37:04.374 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.368+0000 7f8d7c498800 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558d91a9e870 con 0x558d91a88ed0 2024-09-22T08:37:04.374 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.369+0000 7f8d7a783640 1 -- 172.21.15.142:0/4275839061 <== osd.3 v2:172.21.15.142:6800/1064901393 17 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'29 uv10 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8d7403a070 con 0x558d91a88ed0 2024-09-22T08:37:04.374 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.369+0000 7f8d7c498800 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558d91a9e870 con 0x558d91a84600 2024-09-22T08:37:04.374 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.370+0000 7f8d79781640 1 -- 172.21.15.142:0/4275839061 <== osd.1 v2:172.21.15.142:6816/3192108003 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'20 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8d6403b040 con 0x558d91a84600 2024-09-22T08:37:04.374 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.370+0000 7f8d7c498800 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558d91a9e870 con 0x7f8d6c06d040 2024-09-22T08:37:04.375 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.371+0000 7f8d79781640 1 -- 172.21.15.142:0/4275839061 <== osd.0 v2:172.21.15.31:6800/168281188 17 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'29 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8d6403b040 con 0x7f8d6c06d040 2024-09-22T08:37:04.375 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.371+0000 7f8d7c498800 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558d91a9e870 con 0x7f8d74021020 2024-09-22T08:37:04.375 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.372+0000 7f8d79f82640 1 -- 172.21.15.142:0/4275839061 <== osd.2 v2:172.21.15.142:6808/279438927 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8d6c07d070 con 0x7f8d74021020 2024-09-22T08:37:04.375 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.372+0000 7f8d7c498800 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558d91a9e970 con 0x558d91a88ed0 2024-09-22T08:37:04.376 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.373+0000 7f8d7a783640 1 -- 172.21.15.142:0/4275839061 <== osd.3 v2:172.21.15.142:6800/1064901393 18 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'24 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8d7403a070 con 0x558d91a88ed0 2024-09-22T08:37:04.376 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.373+0000 7f8d7c498800 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558d91aa1ef0 con 0x7f8d74021020 2024-09-22T08:37:04.376 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.374+0000 7f8d79f82640 1 -- 172.21.15.142:0/4275839061 <== osd.2 v2:172.21.15.142:6808/279438927 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'46 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8d6c07d070 con 0x7f8d74021020 2024-09-22T08:37:04.376 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.374+0000 7f8d7c498800 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558d91aa1ef0 con 0x7f8d6c06d040 2024-09-22T08:37:04.376 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.375+0000 7f8d79781640 1 -- 172.21.15.142:0/4275839061 <== osd.0 v2:172.21.15.31:6800/168281188 18 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'20 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8d6403b040 con 0x7f8d6c06d040 2024-09-22T08:37:04.376 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.375+0000 7f8d7c498800 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558d91aa1ef0 con 0x7f8d74021020 2024-09-22T08:37:04.378 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.376+0000 7f8d79f82640 1 -- 172.21.15.142:0/4275839061 <== osd.2 v2:172.21.15.142:6808/279438927 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8d6c07d070 con 0x7f8d74021020 2024-09-22T08:37:04.378 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.376+0000 7f8d7c498800 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558d91aa1ef0 con 0x7f8d6c06d040 2024-09-22T08:37:04.378 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.377+0000 7f8d79781640 1 -- 172.21.15.142:0/4275839061 <== osd.0 v2:172.21.15.31:6800/168281188 19 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'37 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8d6403b040 con 0x7f8d6c06d040 2024-09-22T08:37:04.378 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.377+0000 7f8d7c498800 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558d91aa1ef0 con 0x558d91a84600 2024-09-22T08:37:04.379 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.378+0000 7f8d79781640 1 -- 172.21.15.142:0/4275839061 <== osd.1 v2:172.21.15.142:6816/3192108003 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'154 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8d6403b040 con 0x558d91a84600 2024-09-22T08:37:04.379 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.378+0000 7f8d7c498800 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558d91aa1ef0 con 0x558d91a88ed0 2024-09-22T08:37:04.380 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.379+0000 7f8d7a783640 1 -- 172.21.15.142:0/4275839061 <== osd.3 v2:172.21.15.142:6800/1064901393 19 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'38 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8d7403a070 con 0x558d91a88ed0 2024-09-22T08:37:04.381 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.380+0000 7f8d7c498800 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558d91aa1ef0 con 0x7f8d74021020 2024-09-22T08:37:04.381 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.380+0000 7f8d79f82640 1 -- 172.21.15.142:0/4275839061 <== osd.2 v2:172.21.15.142:6808/279438927 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'47 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8d6c07d070 con 0x7f8d74021020 2024-09-22T08:37:04.382 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.380+0000 7f8d7c498800 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558d91aa1ef0 con 0x558d91a88ed0 2024-09-22T08:37:04.382 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.381+0000 7f8d7a783640 1 -- 172.21.15.142:0/4275839061 <== osd.3 v2:172.21.15.142:6800/1064901393 20 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'18 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8d7403a070 con 0x558d91a88ed0 2024-09-22T08:37:04.382 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.381+0000 7f8d7c498800 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558d91aa1ef0 con 0x558d91a84600 2024-09-22T08:37:04.383 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.382+0000 7f8d79781640 1 -- 172.21.15.142:0/4275839061 <== osd.1 v2:172.21.15.142:6816/3192108003 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'26 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8d6403b040 con 0x558d91a84600 2024-09-22T08:37:04.384 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.382+0000 7f8d7c498800 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558d91aa1ef0 con 0x558d91a84600 2024-09-22T08:37:04.385 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.383+0000 7f8d79781640 1 -- 172.21.15.142:0/4275839061 <== osd.1 v2:172.21.15.142:6816/3192108003 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'155 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8d6403b040 con 0x558d91a84600 2024-09-22T08:37:04.385 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.383+0000 7f8d7c498800 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558d91aa1ef0 con 0x558d91a88ed0 2024-09-22T08:37:04.385 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.384+0000 7f8d7a783640 1 -- 172.21.15.142:0/4275839061 <== osd.3 v2:172.21.15.142:6800/1064901393 21 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'39 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8d7403a070 con 0x558d91a88ed0 2024-09-22T08:37:04.385 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.384+0000 7f8d7c498800 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558d91aa1ef0 con 0x7f8d74021020 2024-09-22T08:37:04.386 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.385+0000 7f8d79f82640 1 -- 172.21.15.142:0/4275839061 <== osd.2 v2:172.21.15.142:6808/279438927 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'28 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8d6c07d070 con 0x7f8d74021020 2024-09-22T08:37:04.386 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.385+0000 7f8d7c498800 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558d91aa1ef0 con 0x558d91a88ed0 2024-09-22T08:37:04.389 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.386+0000 7f8d7a783640 1 -- 172.21.15.142:0/4275839061 <== osd.3 v2:172.21.15.142:6800/1064901393 22 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'20 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8d7403a070 con 0x558d91a88ed0 2024-09-22T08:37:04.390 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.386+0000 7f8d7c498800 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558d91aa1ef0 con 0x558d91a88ed0 2024-09-22T08:37:04.390 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.388+0000 7f8d7a783640 1 -- 172.21.15.142:0/4275839061 <== osd.3 v2:172.21.15.142:6800/1064901393 23 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'24 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8d7403a070 con 0x558d91a88ed0 2024-09-22T08:37:04.390 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.388+0000 7f8d7c498800 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558d91aa1ef0 con 0x558d91a88ed0 2024-09-22T08:37:04.390 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.389+0000 7f8d7a783640 1 -- 172.21.15.142:0/4275839061 <== osd.3 v2:172.21.15.142:6800/1064901393 24 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'14 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8d7403a070 con 0x558d91a88ed0 2024-09-22T08:37:04.390 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.389+0000 7f8d7c498800 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558d91aa1ef0 con 0x558d91a88ed0 2024-09-22T08:37:04.391 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.390+0000 7f8d7a783640 1 -- 172.21.15.142:0/4275839061 <== osd.3 v2:172.21.15.142:6800/1064901393 25 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'30 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8d7403a070 con 0x558d91a88ed0 2024-09-22T08:37:04.391 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.390+0000 7f8d7c498800 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558d91aa1ef0 con 0x7f8d6c06d040 2024-09-22T08:37:04.392 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.391+0000 7f8d79781640 1 -- 172.21.15.142:0/4275839061 <== osd.0 v2:172.21.15.31:6800/168281188 20 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'20 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8d6403b040 con 0x7f8d6c06d040 2024-09-22T08:37:04.392 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.391+0000 7f8d7c498800 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558d91aa1ef0 con 0x558d91a88ed0 2024-09-22T08:37:04.393 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.392+0000 7f8d7a783640 1 -- 172.21.15.142:0/4275839061 <== osd.3 v2:172.21.15.142:6800/1064901393 26 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8d7403a070 con 0x558d91a88ed0 2024-09-22T08:37:04.393 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.392+0000 7f8d7c498800 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558d91aa1ef0 con 0x7f8d6c06d040 2024-09-22T08:37:04.394 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.393+0000 7f8d79781640 1 -- 172.21.15.142:0/4275839061 <== osd.0 v2:172.21.15.31:6800/168281188 21 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'30 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8d6403b040 con 0x7f8d6c06d040 2024-09-22T08:37:04.394 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.393+0000 7f8d7c498800 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558d91aa1ef0 con 0x558d91a88ed0 2024-09-22T08:37:04.395 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.394+0000 7f8d7a783640 1 -- 172.21.15.142:0/4275839061 <== osd.3 v2:172.21.15.142:6800/1064901393 27 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'40 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8d7403a070 con 0x558d91a88ed0 2024-09-22T08:37:04.395 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.394+0000 7f8d7c498800 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558d91aa1ef0 con 0x7f8d6c06d040 2024-09-22T08:37:04.396 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.395+0000 7f8d79781640 1 -- 172.21.15.142:0/4275839061 <== osd.0 v2:172.21.15.31:6800/168281188 22 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'38 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8d6403b040 con 0x7f8d6c06d040 2024-09-22T08:37:04.396 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.395+0000 7f8d7c498800 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558d91aa1ef0 con 0x7f8d74021020 2024-09-22T08:37:04.397 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.396+0000 7f8d79f82640 1 -- 172.21.15.142:0/4275839061 <== osd.2 v2:172.21.15.142:6808/279438927 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'24 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8d6c07d070 con 0x7f8d74021020 2024-09-22T08:37:04.398 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.396+0000 7f8c2efe5640 20 reqs_thread_entry: start 2024-09-22T08:37:04.398 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.396+0000 7f8d7c498800 20 init_complete bucket index max shards: 11 2024-09-22T08:37:04.398 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.396+0000 7f8d7c498800 20 Filter name: none 2024-09-22T08:37:04.398 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.396+0000 7f8c2cfe1640 20 reqs_thread_entry: start 2024-09-22T08:37:04.398 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.396+0000 7f8d7c498800 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:94 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558d91a9e2f0 con 0x558d91a84600 2024-09-22T08:37:04.399 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.397+0000 7f8d79781640 1 -- 172.21.15.142:0/4275839061 <== osd.1 v2:172.21.15.142:6816/3192108003 28 ==== osd_op_reply(94 gc.0 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f8d6403b040 con 0x558d91a84600 2024-09-22T08:37:04.399 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.397+0000 7f8d7c498800 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:95 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558d91a9e2f0 con 0x558d91a84600 2024-09-22T08:37:04.399 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.397+0000 7f8d79781640 1 -- 172.21.15.142:0/4275839061 <== osd.1 v2:172.21.15.142:6816/3192108003 29 ==== osd_op_reply(95 gc.0 [call out=24b] v0'0 uv5 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f8d6403b040 con 0x558d91a84600 2024-09-22T08:37:04.399 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.397+0000 7f8d7c498800 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:96 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558d91a9e2f0 con 0x558d91a84600 2024-09-22T08:37:04.399 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.397+0000 7f8d79781640 1 -- 172.21.15.142:0/4275839061 <== osd.1 v2:172.21.15.142:6816/3192108003 30 ==== osd_op_reply(96 gc.0 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f8d6403b040 con 0x558d91a84600 2024-09-22T08:37:04.399 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.397+0000 7f8d7c498800 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:97 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558d91a9e2f0 con 0x7f8d6c06d040 2024-09-22T08:37:04.401 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.397+0000 7f8d79781640 1 -- 172.21.15.142:0/4275839061 <== osd.0 v2:172.21.15.31:6800/168281188 23 ==== osd_op_reply(97 gc.1 [call out=15b] v0'0 uv7 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f8d6403b040 con 0x7f8d6c06d040 2024-09-22T08:37:04.401 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.397+0000 7f8d7c498800 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:98 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558d91a9e2f0 con 0x7f8d6c06d040 2024-09-22T08:37:04.401 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.398+0000 7f8d79781640 1 -- 172.21.15.142:0/4275839061 <== osd.0 v2:172.21.15.31:6800/168281188 24 ==== osd_op_reply(98 gc.1 [call out=24b] v0'0 uv7 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f8d6403b040 con 0x7f8d6c06d040 2024-09-22T08:37:04.401 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.398+0000 7f8d7c498800 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:99 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558d91a9e2f0 con 0x7f8d6c06d040 2024-09-22T08:37:04.401 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.398+0000 7f8d79781640 1 -- 172.21.15.142:0/4275839061 <== osd.0 v2:172.21.15.31:6800/168281188 25 ==== osd_op_reply(99 gc.1 [call out=15b] v0'0 uv7 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f8d6403b040 con 0x7f8d6c06d040 2024-09-22T08:37:04.401 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.398+0000 7f8d7c498800 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:100 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558d91a9e2f0 con 0x558d91a88ed0 2024-09-22T08:37:04.401 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.399+0000 7f8d7a783640 1 -- 172.21.15.142:0/4275839061 <== osd.3 v2:172.21.15.142:6800/1064901393 28 ==== osd_op_reply(100 gc.2 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f8d7403a070 con 0x558d91a88ed0 2024-09-22T08:37:04.401 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.399+0000 7f8d7c498800 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:101 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558d91a9e2f0 con 0x558d91a88ed0 2024-09-22T08:37:04.401 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.399+0000 7f8d7a783640 1 -- 172.21.15.142:0/4275839061 <== osd.3 v2:172.21.15.142:6800/1064901393 29 ==== osd_op_reply(101 gc.2 [call out=24b] v0'0 uv5 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f8d7403a070 con 0x558d91a88ed0 2024-09-22T08:37:04.401 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.399+0000 7f8d7c498800 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:102 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558d91a9e2f0 con 0x558d91a88ed0 2024-09-22T08:37:04.402 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.399+0000 7f8d7a783640 1 -- 172.21.15.142:0/4275839061 <== osd.3 v2:172.21.15.142:6800/1064901393 30 ==== osd_op_reply(102 gc.2 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f8d7403a070 con 0x558d91a88ed0 2024-09-22T08:37:04.402 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.399+0000 7f8d7c498800 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:103 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558d91a9e2f0 con 0x558d91a84600 2024-09-22T08:37:04.402 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.399+0000 7f8d79781640 1 -- 172.21.15.142:0/4275839061 <== osd.1 v2:172.21.15.142:6816/3192108003 31 ==== osd_op_reply(103 gc.3 [call out=15b] v0'0 uv15 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f8d6403b040 con 0x558d91a84600 2024-09-22T08:37:04.402 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.399+0000 7f8d7c498800 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:104 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558d91a9e2f0 con 0x558d91a84600 2024-09-22T08:37:04.402 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.400+0000 7f8d79781640 1 -- 172.21.15.142:0/4275839061 <== osd.1 v2:172.21.15.142:6816/3192108003 32 ==== osd_op_reply(104 gc.3 [call out=24b] v0'0 uv15 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f8d6403b040 con 0x558d91a84600 2024-09-22T08:37:04.402 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.400+0000 7f8d7c498800 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:105 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558d91a9e2f0 con 0x558d91a84600 2024-09-22T08:37:04.402 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.400+0000 7f8d79781640 1 -- 172.21.15.142:0/4275839061 <== osd.1 v2:172.21.15.142:6816/3192108003 33 ==== osd_op_reply(105 gc.3 [call out=15b] v0'0 uv15 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f8d6403b040 con 0x558d91a84600 2024-09-22T08:37:04.402 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.400+0000 7f8d7c498800 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:106 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558d91a9e2f0 con 0x7f8d74021020 2024-09-22T08:37:04.405 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.400+0000 7f8d79f82640 1 -- 172.21.15.142:0/4275839061 <== osd.2 v2:172.21.15.142:6808/279438927 18 ==== osd_op_reply(106 gc.4 [call out=15b] v0'0 uv44 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f8d6c07d070 con 0x7f8d74021020 2024-09-22T08:37:04.405 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.400+0000 7f8d7c498800 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:107 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558d91a9e2f0 con 0x7f8d74021020 2024-09-22T08:37:04.405 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.400+0000 7f8d79f82640 1 -- 172.21.15.142:0/4275839061 <== osd.2 v2:172.21.15.142:6808/279438927 19 ==== osd_op_reply(107 gc.4 [call out=24b] v0'0 uv44 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f8d6c07d070 con 0x7f8d74021020 2024-09-22T08:37:04.405 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.400+0000 7f8d7c498800 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:108 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558d91a9e2f0 con 0x7f8d74021020 2024-09-22T08:37:04.405 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.401+0000 7f8d79f82640 1 -- 172.21.15.142:0/4275839061 <== osd.2 v2:172.21.15.142:6808/279438927 20 ==== osd_op_reply(108 gc.4 [call out=1701b] v0'0 uv44 ondisk = 0) ==== 148+0+1701 (crc 0 0 0) 0x7f8d6c07d070 con 0x7f8d74021020 2024-09-22T08:37:04.405 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.401+0000 7f8d7c498800 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:109 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558d91ace250 con 0x558d91a88ed0 2024-09-22T08:37:04.405 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.401+0000 7f8d7a783640 1 -- 172.21.15.142:0/4275839061 <== osd.3 v2:172.21.15.142:6800/1064901393 31 ==== osd_op_reply(109 gc.5 [call out=15b] v0'0 uv10 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f8d7403a070 con 0x558d91a88ed0 2024-09-22T08:37:04.405 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.401+0000 7f8d7c498800 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:110 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558d91acd200 con 0x558d91a88ed0 2024-09-22T08:37:04.405 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.401+0000 7f8d7a783640 1 -- 172.21.15.142:0/4275839061 <== osd.3 v2:172.21.15.142:6800/1064901393 32 ==== osd_op_reply(110 gc.5 [call out=24b] v0'0 uv10 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f8d7403a070 con 0x558d91a88ed0 2024-09-22T08:37:04.405 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.401+0000 7f8d7c498800 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:111 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558d91acd200 con 0x558d91a88ed0 2024-09-22T08:37:04.406 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.401+0000 7f8d7a783640 1 -- 172.21.15.142:0/4275839061 <== osd.3 v2:172.21.15.142:6800/1064901393 33 ==== osd_op_reply(111 gc.5 [call out=15b] v0'0 uv10 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f8d7403a070 con 0x558d91a88ed0 2024-09-22T08:37:04.406 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.401+0000 7f8d7c498800 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:112 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558d91acd200 con 0x558d91a84600 2024-09-22T08:37:04.406 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.402+0000 7f8d79781640 1 -- 172.21.15.142:0/4275839061 <== osd.1 v2:172.21.15.142:6816/3192108003 34 ==== osd_op_reply(112 gc.6 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f8d6403b040 con 0x558d91a84600 2024-09-22T08:37:04.406 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.402+0000 7f8d7c498800 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:113 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558d91acd200 con 0x558d91a84600 2024-09-22T08:37:04.406 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.402+0000 7f8d79781640 1 -- 172.21.15.142:0/4275839061 <== osd.1 v2:172.21.15.142:6816/3192108003 35 ==== osd_op_reply(113 gc.6 [call out=24b] v0'0 uv5 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f8d6403b040 con 0x558d91a84600 2024-09-22T08:37:04.406 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.402+0000 7f8d7c498800 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:114 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558d91acd200 con 0x558d91a84600 2024-09-22T08:37:04.406 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.402+0000 7f8d79781640 1 -- 172.21.15.142:0/4275839061 <== osd.1 v2:172.21.15.142:6816/3192108003 36 ==== osd_op_reply(114 gc.6 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f8d6403b040 con 0x558d91a84600 2024-09-22T08:37:04.406 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.402+0000 7f8d7c498800 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:115 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558d91acd200 con 0x7f8d6c06d040 2024-09-22T08:37:04.406 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.403+0000 7f8d79781640 1 -- 172.21.15.142:0/4275839061 <== osd.0 v2:172.21.15.31:6800/168281188 26 ==== osd_op_reply(115 gc.7 [call out=15b] v0'0 uv8 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f8d6403b040 con 0x7f8d6c06d040 2024-09-22T08:37:04.406 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.403+0000 7f8d7c498800 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:116 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558d91acd200 con 0x7f8d6c06d040 2024-09-22T08:37:04.406 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.403+0000 7f8d79781640 1 -- 172.21.15.142:0/4275839061 <== osd.0 v2:172.21.15.31:6800/168281188 27 ==== osd_op_reply(116 gc.7 [call out=24b] v0'0 uv8 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f8d6403b040 con 0x7f8d6c06d040 2024-09-22T08:37:04.406 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.403+0000 7f8d7c498800 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:117 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558d91acd200 con 0x7f8d6c06d040 2024-09-22T08:37:04.406 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.403+0000 7f8d79781640 1 -- 172.21.15.142:0/4275839061 <== osd.0 v2:172.21.15.31:6800/168281188 28 ==== osd_op_reply(117 gc.7 [call out=15b] v0'0 uv8 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f8d6403b040 con 0x7f8d6c06d040 2024-09-22T08:37:04.407 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.403+0000 7f8d7c498800 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:118 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558d91acd200 con 0x7f8d74021020 2024-09-22T08:37:04.407 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.404+0000 7f8d79f82640 1 -- 172.21.15.142:0/4275839061 <== osd.2 v2:172.21.15.142:6808/279438927 21 ==== osd_op_reply(118 gc.8 [call out=15b] v0'0 uv3 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f8d6c07d070 con 0x7f8d74021020 2024-09-22T08:37:04.407 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.404+0000 7f8d7c498800 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:119 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558d91acd200 con 0x7f8d74021020 2024-09-22T08:37:04.407 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.404+0000 7f8d79f82640 1 -- 172.21.15.142:0/4275839061 <== osd.2 v2:172.21.15.142:6808/279438927 22 ==== osd_op_reply(119 gc.8 [call out=24b] v0'0 uv3 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f8d6c07d070 con 0x7f8d74021020 2024-09-22T08:37:04.407 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.404+0000 7f8d7c498800 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:120 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558d91acd200 con 0x7f8d74021020 2024-09-22T08:37:04.411 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.404+0000 7f8d79f82640 1 -- 172.21.15.142:0/4275839061 <== osd.2 v2:172.21.15.142:6808/279438927 23 ==== osd_op_reply(120 gc.8 [call out=15b] v0'0 uv3 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f8d6c07d070 con 0x7f8d74021020 2024-09-22T08:37:04.411 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.404+0000 7f8d7c498800 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:121 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558d91acd200 con 0x558d91a88ed0 2024-09-22T08:37:04.411 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.404+0000 7f8d7a783640 1 -- 172.21.15.142:0/4275839061 <== osd.3 v2:172.21.15.142:6800/1064901393 34 ==== osd_op_reply(121 gc.9 [call out=15b] v0'0 uv9 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f8d7403a070 con 0x558d91a88ed0 2024-09-22T08:37:04.411 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.404+0000 7f8d7c498800 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:122 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558d91acd200 con 0x558d91a88ed0 2024-09-22T08:37:04.411 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.405+0000 7f8d7a783640 1 -- 172.21.15.142:0/4275839061 <== osd.3 v2:172.21.15.142:6800/1064901393 35 ==== osd_op_reply(122 gc.9 [call out=24b] v0'0 uv9 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f8d7403a070 con 0x558d91a88ed0 2024-09-22T08:37:04.412 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.405+0000 7f8d7c498800 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:123 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558d91acd200 con 0x558d91a88ed0 2024-09-22T08:37:04.412 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.405+0000 7f8d7a783640 1 -- 172.21.15.142:0/4275839061 <== osd.3 v2:172.21.15.142:6800/1064901393 36 ==== osd_op_reply(123 gc.9 [call out=15b] v0'0 uv9 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f8d7403a070 con 0x558d91a88ed0 2024-09-22T08:37:04.412 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.405+0000 7f8d7c498800 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:124 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558d91acd200 con 0x7f8d74021020 2024-09-22T08:37:04.412 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.405+0000 7f8d79f82640 1 -- 172.21.15.142:0/4275839061 <== osd.2 v2:172.21.15.142:6808/279438927 24 ==== osd_op_reply(124 gc.10 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8d6c07d070 con 0x7f8d74021020 2024-09-22T08:37:04.412 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.405+0000 7f8d7c498800 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:125 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558d91acd200 con 0x7f8d74021020 2024-09-22T08:37:04.412 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.405+0000 7f8d79f82640 1 -- 172.21.15.142:0/4275839061 <== osd.2 v2:172.21.15.142:6808/279438927 25 ==== osd_op_reply(125 gc.10 [call out=24b] v0'0 uv5 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f8d6c07d070 con 0x7f8d74021020 2024-09-22T08:37:04.412 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.405+0000 7f8d7c498800 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:126 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558d91acd200 con 0x7f8d74021020 2024-09-22T08:37:04.412 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.406+0000 7f8d79f82640 1 -- 172.21.15.142:0/4275839061 <== osd.2 v2:172.21.15.142:6808/279438927 26 ==== osd_op_reply(126 gc.10 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8d6c07d070 con 0x7f8d74021020 2024-09-22T08:37:04.412 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.406+0000 7f8d7c498800 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:127 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558d91acd200 con 0x7f8d6c06d040 2024-09-22T08:37:04.412 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.406+0000 7f8d79781640 1 -- 172.21.15.142:0/4275839061 <== osd.0 v2:172.21.15.31:6800/168281188 29 ==== osd_op_reply(127 gc.11 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8d6403b040 con 0x7f8d6c06d040 2024-09-22T08:37:04.412 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.406+0000 7f8d7c498800 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:128 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558d91acd200 con 0x7f8d6c06d040 2024-09-22T08:37:04.412 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.407+0000 7f8d79781640 1 -- 172.21.15.142:0/4275839061 <== osd.0 v2:172.21.15.31:6800/168281188 30 ==== osd_op_reply(128 gc.11 [call out=24b] v0'0 uv3 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f8d6403b040 con 0x7f8d6c06d040 2024-09-22T08:37:04.412 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.407+0000 7f8d7c498800 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:129 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558d91acd200 con 0x7f8d6c06d040 2024-09-22T08:37:04.413 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.407+0000 7f8d79781640 1 -- 172.21.15.142:0/4275839061 <== osd.0 v2:172.21.15.31:6800/168281188 31 ==== osd_op_reply(129 gc.11 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8d6403b040 con 0x7f8d6c06d040 2024-09-22T08:37:04.413 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.407+0000 7f8d7c498800 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:130 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558d91acd200 con 0x7f8d74021020 2024-09-22T08:37:04.413 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.407+0000 7f8d79f82640 1 -- 172.21.15.142:0/4275839061 <== osd.2 v2:172.21.15.142:6808/279438927 27 ==== osd_op_reply(130 gc.12 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8d6c07d070 con 0x7f8d74021020 2024-09-22T08:37:04.413 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.407+0000 7f8d7c498800 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:131 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558d91acd200 con 0x7f8d74021020 2024-09-22T08:37:04.413 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.407+0000 7f8d79f82640 1 -- 172.21.15.142:0/4275839061 <== osd.2 v2:172.21.15.142:6808/279438927 28 ==== osd_op_reply(131 gc.12 [call out=24b] v0'0 uv3 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f8d6c07d070 con 0x7f8d74021020 2024-09-22T08:37:04.413 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.407+0000 7f8d7c498800 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:132 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558d91acd200 con 0x7f8d74021020 2024-09-22T08:37:04.413 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.407+0000 7f8d79f82640 1 -- 172.21.15.142:0/4275839061 <== osd.2 v2:172.21.15.142:6808/279438927 29 ==== osd_op_reply(132 gc.12 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8d6c07d070 con 0x7f8d74021020 2024-09-22T08:37:04.413 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.408+0000 7f8d7c498800 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:133 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558d91acd200 con 0x7f8d6c06d040 2024-09-22T08:37:04.413 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.408+0000 7f8d79781640 1 -- 172.21.15.142:0/4275839061 <== osd.0 v2:172.21.15.31:6800/168281188 32 ==== osd_op_reply(133 gc.13 [call out=15b] v0'0 uv4 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8d6403b040 con 0x7f8d6c06d040 2024-09-22T08:37:04.413 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.408+0000 7f8d7c498800 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:134 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558d91acd200 con 0x7f8d6c06d040 2024-09-22T08:37:04.413 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.408+0000 7f8d79781640 1 -- 172.21.15.142:0/4275839061 <== osd.0 v2:172.21.15.31:6800/168281188 33 ==== osd_op_reply(134 gc.13 [call out=24b] v0'0 uv4 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f8d6403b040 con 0x7f8d6c06d040 2024-09-22T08:37:04.413 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.408+0000 7f8d7c498800 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:135 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558d91acd200 con 0x7f8d6c06d040 2024-09-22T08:37:04.413 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.408+0000 7f8d79781640 1 -- 172.21.15.142:0/4275839061 <== osd.0 v2:172.21.15.31:6800/168281188 34 ==== osd_op_reply(135 gc.13 [call out=15b] v0'0 uv4 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8d6403b040 con 0x7f8d6c06d040 2024-09-22T08:37:04.414 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.408+0000 7f8d7c498800 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:136 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558d91acd200 con 0x558d91a84600 2024-09-22T08:37:04.414 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.409+0000 7f8d79781640 1 -- 172.21.15.142:0/4275839061 <== osd.1 v2:172.21.15.142:6816/3192108003 37 ==== osd_op_reply(136 gc.14 [call out=15b] v0'0 uv8 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8d6403b040 con 0x558d91a84600 2024-09-22T08:37:04.414 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.409+0000 7f8d7c498800 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:137 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558d91acd200 con 0x558d91a84600 2024-09-22T08:37:04.414 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.409+0000 7f8d79781640 1 -- 172.21.15.142:0/4275839061 <== osd.1 v2:172.21.15.142:6816/3192108003 38 ==== osd_op_reply(137 gc.14 [call out=24b] v0'0 uv8 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f8d6403b040 con 0x558d91a84600 2024-09-22T08:37:04.414 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.409+0000 7f8d7c498800 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:138 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558d91acd200 con 0x558d91a84600 2024-09-22T08:37:04.414 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.409+0000 7f8d79781640 1 -- 172.21.15.142:0/4275839061 <== osd.1 v2:172.21.15.142:6816/3192108003 39 ==== osd_op_reply(138 gc.14 [call out=15b] v0'0 uv8 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8d6403b040 con 0x558d91a84600 2024-09-22T08:37:04.414 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.409+0000 7f8d7c498800 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:139 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558d91acd200 con 0x558d91a88ed0 2024-09-22T08:37:04.414 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.409+0000 7f8d7a783640 1 -- 172.21.15.142:0/4275839061 <== osd.3 v2:172.21.15.142:6800/1064901393 37 ==== osd_op_reply(139 gc.15 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8d7403a070 con 0x558d91a88ed0 2024-09-22T08:37:04.414 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.409+0000 7f8d7c498800 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:140 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558d91acd200 con 0x558d91a88ed0 2024-09-22T08:37:04.414 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.410+0000 7f8d7a783640 1 -- 172.21.15.142:0/4275839061 <== osd.3 v2:172.21.15.142:6800/1064901393 38 ==== osd_op_reply(140 gc.15 [call out=24b] v0'0 uv5 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f8d7403a070 con 0x558d91a88ed0 2024-09-22T08:37:04.414 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.410+0000 7f8d7c498800 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:141 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558d91acd200 con 0x558d91a88ed0 2024-09-22T08:37:04.414 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.410+0000 7f8d7a783640 1 -- 172.21.15.142:0/4275839061 <== osd.3 v2:172.21.15.142:6800/1064901393 39 ==== osd_op_reply(141 gc.15 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8d7403a070 con 0x558d91a88ed0 2024-09-22T08:37:04.414 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.410+0000 7f8d7c498800 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:142 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558d91acd200 con 0x7f8d74021020 2024-09-22T08:37:04.415 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.410+0000 7f8d79f82640 1 -- 172.21.15.142:0/4275839061 <== osd.2 v2:172.21.15.142:6808/279438927 30 ==== osd_op_reply(142 gc.16 [call out=15b] v0'0 uv9 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8d6c07d070 con 0x7f8d74021020 2024-09-22T08:37:04.415 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.410+0000 7f8d7c498800 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:143 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558d91acd200 con 0x7f8d74021020 2024-09-22T08:37:04.415 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.410+0000 7f8d79f82640 1 -- 172.21.15.142:0/4275839061 <== osd.2 v2:172.21.15.142:6808/279438927 31 ==== osd_op_reply(143 gc.16 [call out=24b] v0'0 uv9 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f8d6c07d070 con 0x7f8d74021020 2024-09-22T08:37:04.415 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.410+0000 7f8d7c498800 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:144 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558d91acd200 con 0x7f8d74021020 2024-09-22T08:37:04.422 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.410+0000 7f8d79f82640 1 -- 172.21.15.142:0/4275839061 <== osd.2 v2:172.21.15.142:6808/279438927 32 ==== osd_op_reply(144 gc.16 [call out=15b] v0'0 uv9 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8d6c07d070 con 0x7f8d74021020 2024-09-22T08:37:04.422 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.411+0000 7f8d7c498800 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:145 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558d91acd200 con 0x558d91a88ed0 2024-09-22T08:37:04.422 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.411+0000 7f8d7a783640 1 -- 172.21.15.142:0/4275839061 <== osd.3 v2:172.21.15.142:6800/1064901393 40 ==== osd_op_reply(145 gc.17 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8d7403a070 con 0x558d91a88ed0 2024-09-22T08:37:04.422 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.411+0000 7f8d7c498800 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:146 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558d91acd200 con 0x558d91a88ed0 2024-09-22T08:37:04.422 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.411+0000 7f8d7a783640 1 -- 172.21.15.142:0/4275839061 <== osd.3 v2:172.21.15.142:6800/1064901393 41 ==== osd_op_reply(146 gc.17 [call out=24b] v0'0 uv7 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f8d7403a070 con 0x558d91a88ed0 2024-09-22T08:37:04.422 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.411+0000 7f8d7c498800 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:147 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558d91acd200 con 0x558d91a88ed0 2024-09-22T08:37:04.422 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.411+0000 7f8d7a783640 1 -- 172.21.15.142:0/4275839061 <== osd.3 v2:172.21.15.142:6800/1064901393 42 ==== osd_op_reply(147 gc.17 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8d7403a070 con 0x558d91a88ed0 2024-09-22T08:37:04.423 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.411+0000 7f8d7c498800 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:148 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558d91acd200 con 0x558d91a84600 2024-09-22T08:37:04.423 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.411+0000 7f8d79781640 1 -- 172.21.15.142:0/4275839061 <== osd.1 v2:172.21.15.142:6816/3192108003 40 ==== osd_op_reply(148 gc.18 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8d6403b040 con 0x558d91a84600 2024-09-22T08:37:04.423 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.412+0000 7f8d7c498800 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:149 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558d91acd200 con 0x558d91a84600 2024-09-22T08:37:04.423 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.412+0000 7f8d79781640 1 -- 172.21.15.142:0/4275839061 <== osd.1 v2:172.21.15.142:6816/3192108003 41 ==== osd_op_reply(149 gc.18 [call out=24b] v0'0 uv3 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f8d6403b040 con 0x558d91a84600 2024-09-22T08:37:04.423 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.412+0000 7f8d7c498800 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:150 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558d91acd200 con 0x558d91a84600 2024-09-22T08:37:04.423 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.412+0000 7f8d79781640 1 -- 172.21.15.142:0/4275839061 <== osd.1 v2:172.21.15.142:6816/3192108003 42 ==== osd_op_reply(150 gc.18 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8d6403b040 con 0x558d91a84600 2024-09-22T08:37:04.423 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.412+0000 7f8d7c498800 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:151 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558d91acd200 con 0x558d91a84600 2024-09-22T08:37:04.423 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.412+0000 7f8d79781640 1 -- 172.21.15.142:0/4275839061 <== osd.1 v2:172.21.15.142:6816/3192108003 43 ==== osd_op_reply(151 gc.19 [call out=15b] v0'0 uv13 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8d6403b040 con 0x558d91a84600 2024-09-22T08:37:04.423 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.412+0000 7f8d7c498800 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:152 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558d91acd200 con 0x558d91a84600 2024-09-22T08:37:04.423 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.412+0000 7f8d79781640 1 -- 172.21.15.142:0/4275839061 <== osd.1 v2:172.21.15.142:6816/3192108003 44 ==== osd_op_reply(152 gc.19 [call out=24b] v0'0 uv13 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f8d6403b040 con 0x558d91a84600 2024-09-22T08:37:04.423 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.412+0000 7f8d7c498800 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:153 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558d91acd200 con 0x558d91a84600 2024-09-22T08:37:04.423 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.413+0000 7f8d79781640 1 -- 172.21.15.142:0/4275839061 <== osd.1 v2:172.21.15.142:6816/3192108003 45 ==== osd_op_reply(153 gc.19 [call out=15b] v0'0 uv13 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8d6403b040 con 0x558d91a84600 2024-09-22T08:37:04.423 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.413+0000 7f8d7c498800 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:154 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558d91acd200 con 0x558d91a88ed0 2024-09-22T08:37:04.424 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.413+0000 7f8d7a783640 1 -- 172.21.15.142:0/4275839061 <== osd.3 v2:172.21.15.142:6800/1064901393 43 ==== osd_op_reply(154 gc.20 [call out=15b] v0'0 uv9 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8d7403a070 con 0x558d91a88ed0 2024-09-22T08:37:04.424 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.413+0000 7f8d7c498800 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:155 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558d91acd200 con 0x558d91a88ed0 2024-09-22T08:37:04.424 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.413+0000 7f8d7a783640 1 -- 172.21.15.142:0/4275839061 <== osd.3 v2:172.21.15.142:6800/1064901393 44 ==== osd_op_reply(155 gc.20 [call out=24b] v0'0 uv9 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f8d7403a070 con 0x558d91a88ed0 2024-09-22T08:37:04.424 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.413+0000 7f8d7c498800 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:156 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558d91ace210 con 0x558d91a88ed0 2024-09-22T08:37:04.424 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.413+0000 7f8d7a783640 1 -- 172.21.15.142:0/4275839061 <== osd.3 v2:172.21.15.142:6800/1064901393 45 ==== osd_op_reply(156 gc.20 [call out=15b] v0'0 uv9 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8d7403a070 con 0x558d91a88ed0 2024-09-22T08:37:04.424 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.413+0000 7f8d7c498800 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:157 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558d91ace210 con 0x7f8d74021020 2024-09-22T08:37:04.424 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.414+0000 7f8d79f82640 1 -- 172.21.15.142:0/4275839061 <== osd.2 v2:172.21.15.142:6808/279438927 33 ==== osd_op_reply(157 gc.21 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8d6c07d070 con 0x7f8d74021020 2024-09-22T08:37:04.424 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.414+0000 7f8d7c498800 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:158 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558d91acd200 con 0x7f8d74021020 2024-09-22T08:37:04.424 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.414+0000 7f8d79f82640 1 -- 172.21.15.142:0/4275839061 <== osd.2 v2:172.21.15.142:6808/279438927 34 ==== osd_op_reply(158 gc.21 [call out=24b] v0'0 uv7 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f8d6c07d070 con 0x7f8d74021020 2024-09-22T08:37:04.424 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.414+0000 7f8d7c498800 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:159 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558d91ace210 con 0x7f8d74021020 2024-09-22T08:37:04.424 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.414+0000 7f8d79f82640 1 -- 172.21.15.142:0/4275839061 <== osd.2 v2:172.21.15.142:6808/279438927 35 ==== osd_op_reply(159 gc.21 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8d6c07d070 con 0x7f8d74021020 2024-09-22T08:37:04.424 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.414+0000 7f8d7c498800 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:160 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558d91ace210 con 0x558d91a88ed0 2024-09-22T08:37:04.424 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.414+0000 7f8d7a783640 1 -- 172.21.15.142:0/4275839061 <== osd.3 v2:172.21.15.142:6800/1064901393 46 ==== osd_op_reply(160 gc.22 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8d7403a070 con 0x558d91a88ed0 2024-09-22T08:37:04.424 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.414+0000 7f8d7c498800 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:161 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558d91acd200 con 0x558d91a88ed0 2024-09-22T08:37:04.425 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.415+0000 7f8d7a783640 1 -- 172.21.15.142:0/4275839061 <== osd.3 v2:172.21.15.142:6800/1064901393 47 ==== osd_op_reply(161 gc.22 [call out=24b] v0'0 uv3 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f8d7403a070 con 0x558d91a88ed0 2024-09-22T08:37:04.425 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.415+0000 7f8d7c498800 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:162 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558d91ace210 con 0x558d91a88ed0 2024-09-22T08:37:04.425 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.415+0000 7f8d7a783640 1 -- 172.21.15.142:0/4275839061 <== osd.3 v2:172.21.15.142:6800/1064901393 48 ==== osd_op_reply(162 gc.22 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8d7403a070 con 0x558d91a88ed0 2024-09-22T08:37:04.425 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.415+0000 7f8d7c498800 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:163 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558d91ace210 con 0x558d91a88ed0 2024-09-22T08:37:04.425 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.415+0000 7f8d7a783640 1 -- 172.21.15.142:0/4275839061 <== osd.3 v2:172.21.15.142:6800/1064901393 49 ==== osd_op_reply(163 gc.23 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8d7403a070 con 0x558d91a88ed0 2024-09-22T08:37:04.425 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.415+0000 7f8d7c498800 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:164 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558d91acd200 con 0x558d91a88ed0 2024-09-22T08:37:04.425 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.415+0000 7f8d7a783640 1 -- 172.21.15.142:0/4275839061 <== osd.3 v2:172.21.15.142:6800/1064901393 50 ==== osd_op_reply(164 gc.23 [call out=24b] v0'0 uv5 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f8d7403a070 con 0x558d91a88ed0 2024-09-22T08:37:04.425 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.415+0000 7f8d7c498800 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:165 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558d91ace210 con 0x558d91a88ed0 2024-09-22T08:37:04.425 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.416+0000 7f8d7a783640 1 -- 172.21.15.142:0/4275839061 <== osd.3 v2:172.21.15.142:6800/1064901393 51 ==== osd_op_reply(165 gc.23 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8d7403a070 con 0x558d91a88ed0 2024-09-22T08:37:04.425 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.416+0000 7f8d7c498800 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:166 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558d91ace210 con 0x558d91a88ed0 2024-09-22T08:37:04.425 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.416+0000 7f8d7a783640 1 -- 172.21.15.142:0/4275839061 <== osd.3 v2:172.21.15.142:6800/1064901393 52 ==== osd_op_reply(166 gc.24 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8d7403a070 con 0x558d91a88ed0 2024-09-22T08:37:04.425 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.416+0000 7f8d7c498800 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:167 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558d91acd200 con 0x558d91a88ed0 2024-09-22T08:37:04.425 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.416+0000 7f8d7a783640 1 -- 172.21.15.142:0/4275839061 <== osd.3 v2:172.21.15.142:6800/1064901393 53 ==== osd_op_reply(167 gc.24 [call out=24b] v0'0 uv3 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f8d7403a070 con 0x558d91a88ed0 2024-09-22T08:37:04.425 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.416+0000 7f8d7c498800 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:168 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558d91ace210 con 0x558d91a88ed0 2024-09-22T08:37:04.426 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.416+0000 7f8d7a783640 1 -- 172.21.15.142:0/4275839061 <== osd.3 v2:172.21.15.142:6800/1064901393 54 ==== osd_op_reply(168 gc.24 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8d7403a070 con 0x558d91a88ed0 2024-09-22T08:37:04.426 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.416+0000 7f8d7c498800 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:169 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558d91ace210 con 0x558d91a88ed0 2024-09-22T08:37:04.426 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.417+0000 7f8d7a783640 1 -- 172.21.15.142:0/4275839061 <== osd.3 v2:172.21.15.142:6800/1064901393 55 ==== osd_op_reply(169 gc.25 [call out=15b] v0'0 uv4 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8d7403a070 con 0x558d91a88ed0 2024-09-22T08:37:04.426 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.417+0000 7f8d7c498800 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:170 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558d91acd200 con 0x558d91a88ed0 2024-09-22T08:37:04.426 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.417+0000 7f8d7a783640 1 -- 172.21.15.142:0/4275839061 <== osd.3 v2:172.21.15.142:6800/1064901393 56 ==== osd_op_reply(170 gc.25 [call out=24b] v0'0 uv4 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f8d7403a070 con 0x558d91a88ed0 2024-09-22T08:37:04.426 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.417+0000 7f8d7c498800 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:171 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558d91ace210 con 0x558d91a88ed0 2024-09-22T08:37:04.426 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.417+0000 7f8d7a783640 1 -- 172.21.15.142:0/4275839061 <== osd.3 v2:172.21.15.142:6800/1064901393 57 ==== osd_op_reply(171 gc.25 [call out=15b] v0'0 uv4 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8d7403a070 con 0x558d91a88ed0 2024-09-22T08:37:04.426 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.417+0000 7f8d7c498800 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:172 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558d91ace210 con 0x7f8d6c06d040 2024-09-22T08:37:04.426 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.417+0000 7f8d79781640 1 -- 172.21.15.142:0/4275839061 <== osd.0 v2:172.21.15.31:6800/168281188 35 ==== osd_op_reply(172 gc.26 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8d6403b040 con 0x7f8d6c06d040 2024-09-22T08:37:04.426 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.417+0000 7f8d7c498800 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:173 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558d91acd200 con 0x7f8d6c06d040 2024-09-22T08:37:04.426 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.418+0000 7f8d79781640 1 -- 172.21.15.142:0/4275839061 <== osd.0 v2:172.21.15.31:6800/168281188 36 ==== osd_op_reply(173 gc.26 [call out=24b] v0'0 uv3 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f8d6403b040 con 0x7f8d6c06d040 2024-09-22T08:37:04.426 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.418+0000 7f8d7c498800 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:174 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558d91ace210 con 0x7f8d6c06d040 2024-09-22T08:37:04.426 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.418+0000 7f8d79781640 1 -- 172.21.15.142:0/4275839061 <== osd.0 v2:172.21.15.31:6800/168281188 37 ==== osd_op_reply(174 gc.26 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8d6403b040 con 0x7f8d6c06d040 2024-09-22T08:37:04.427 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.418+0000 7f8d7c498800 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:175 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558d91ace210 con 0x558d91a88ed0 2024-09-22T08:37:04.427 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.418+0000 7f8d7a783640 1 -- 172.21.15.142:0/4275839061 <== osd.3 v2:172.21.15.142:6800/1064901393 58 ==== osd_op_reply(175 gc.27 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8d7403a070 con 0x558d91a88ed0 2024-09-22T08:37:04.427 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.418+0000 7f8d7c498800 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:176 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558d91acd200 con 0x558d91a88ed0 2024-09-22T08:37:04.427 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.419+0000 7f8d7a783640 1 -- 172.21.15.142:0/4275839061 <== osd.3 v2:172.21.15.142:6800/1064901393 59 ==== osd_op_reply(176 gc.27 [call out=24b] v0'0 uv5 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f8d7403a070 con 0x558d91a88ed0 2024-09-22T08:37:04.427 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.419+0000 7f8d7c498800 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:177 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558d91ace210 con 0x558d91a88ed0 2024-09-22T08:37:04.427 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.419+0000 7f8d7a783640 1 -- 172.21.15.142:0/4275839061 <== osd.3 v2:172.21.15.142:6800/1064901393 60 ==== osd_op_reply(177 gc.27 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8d7403a070 con 0x558d91a88ed0 2024-09-22T08:37:04.427 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.419+0000 7f8d7c498800 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:178 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558d91ace210 con 0x7f8d6c06d040 2024-09-22T08:37:04.427 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.419+0000 7f8d79781640 1 -- 172.21.15.142:0/4275839061 <== osd.0 v2:172.21.15.31:6800/168281188 38 ==== osd_op_reply(178 gc.28 [call out=15b] v0'0 uv4 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8d6403b040 con 0x7f8d6c06d040 2024-09-22T08:37:04.427 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.419+0000 7f8d7c498800 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:179 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558d91acd200 con 0x7f8d6c06d040 2024-09-22T08:37:04.427 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.419+0000 7f8d79781640 1 -- 172.21.15.142:0/4275839061 <== osd.0 v2:172.21.15.31:6800/168281188 39 ==== osd_op_reply(179 gc.28 [call out=24b] v0'0 uv4 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f8d6403b040 con 0x7f8d6c06d040 2024-09-22T08:37:04.427 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.420+0000 7f8d7c498800 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:180 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558d91ace210 con 0x7f8d6c06d040 2024-09-22T08:37:04.427 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.420+0000 7f8d79781640 1 -- 172.21.15.142:0/4275839061 <== osd.0 v2:172.21.15.31:6800/168281188 40 ==== osd_op_reply(180 gc.28 [call out=15b] v0'0 uv4 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8d6403b040 con 0x7f8d6c06d040 2024-09-22T08:37:04.427 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.420+0000 7f8d7c498800 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:181 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558d91ace210 con 0x558d91a88ed0 2024-09-22T08:37:04.427 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.420+0000 7f8d7a783640 1 -- 172.21.15.142:0/4275839061 <== osd.3 v2:172.21.15.142:6800/1064901393 61 ==== osd_op_reply(181 gc.29 [call out=15b] v0'0 uv11 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8d7403a070 con 0x558d91a88ed0 2024-09-22T08:37:04.428 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.420+0000 7f8d7c498800 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:182 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558d91acd200 con 0x558d91a88ed0 2024-09-22T08:37:04.428 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.421+0000 7f8d7a783640 1 -- 172.21.15.142:0/4275839061 <== osd.3 v2:172.21.15.142:6800/1064901393 62 ==== osd_op_reply(182 gc.29 [call out=24b] v0'0 uv11 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f8d7403a070 con 0x558d91a88ed0 2024-09-22T08:37:04.428 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.421+0000 7f8d7c498800 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:183 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558d91ace210 con 0x558d91a88ed0 2024-09-22T08:37:04.428 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.421+0000 7f8d7a783640 1 -- 172.21.15.142:0/4275839061 <== osd.3 v2:172.21.15.142:6800/1064901393 63 ==== osd_op_reply(183 gc.29 [call out=15b] v0'0 uv11 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8d7403a070 con 0x558d91a88ed0 2024-09-22T08:37:04.428 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.421+0000 7f8d7c498800 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:184 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558d91ace210 con 0x7f8d6c06d040 2024-09-22T08:37:04.428 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.421+0000 7f8d79781640 1 -- 172.21.15.142:0/4275839061 <== osd.0 v2:172.21.15.31:6800/168281188 41 ==== osd_op_reply(184 gc.30 [call out=15b] v0'0 uv8 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8d6403b040 con 0x7f8d6c06d040 2024-09-22T08:37:04.428 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.421+0000 7f8d7c498800 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:185 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558d91acd200 con 0x7f8d6c06d040 2024-09-22T08:37:04.430 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.421+0000 7f8d79781640 1 -- 172.21.15.142:0/4275839061 <== osd.0 v2:172.21.15.31:6800/168281188 42 ==== osd_op_reply(185 gc.30 [call out=24b] v0'0 uv8 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f8d6403b040 con 0x7f8d6c06d040 2024-09-22T08:37:04.431 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.421+0000 7f8d7c498800 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:186 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558d91ace210 con 0x7f8d6c06d040 2024-09-22T08:37:04.431 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.422+0000 7f8d79781640 1 -- 172.21.15.142:0/4275839061 <== osd.0 v2:172.21.15.31:6800/168281188 43 ==== osd_op_reply(186 gc.30 [call out=15b] v0'0 uv8 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8d6403b040 con 0x7f8d6c06d040 2024-09-22T08:37:04.431 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.422+0000 7f8d7c498800 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:187 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558d91ace210 con 0x7f8d74021020 2024-09-22T08:37:04.431 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.422+0000 7f8d79f82640 1 -- 172.21.15.142:0/4275839061 <== osd.2 v2:172.21.15.142:6808/279438927 36 ==== osd_op_reply(187 gc.31 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8d6c07d070 con 0x7f8d74021020 2024-09-22T08:37:04.431 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.422+0000 7f8d7c498800 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:188 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558d91acd200 con 0x7f8d74021020 2024-09-22T08:37:04.431 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.422+0000 7f8d79f82640 1 -- 172.21.15.142:0/4275839061 <== osd.2 v2:172.21.15.142:6808/279438927 37 ==== osd_op_reply(188 gc.31 [call out=24b] v0'0 uv5 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f8d6c07d070 con 0x7f8d74021020 2024-09-22T08:37:04.431 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.422+0000 7f8d7c498800 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:189 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558d91ace210 con 0x7f8d74021020 2024-09-22T08:37:04.431 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.422+0000 7f8d79f82640 1 -- 172.21.15.142:0/4275839061 <== osd.2 v2:172.21.15.142:6808/279438927 38 ==== osd_op_reply(189 gc.31 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8d6c07d070 con 0x7f8d74021020 2024-09-22T08:37:04.431 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.423+0000 7f8c2ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:37:04.431 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.423+0000 7f8d7c498800 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:190 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94066522552560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558d91a9d9c0 con 0x558d91a84600 2024-09-22T08:37:04.431 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.424+0000 7f8d79781640 1 -- 172.21.15.142:0/4275839061 <== osd.1 v2:172.21.15.142:6816/3192108003 46 ==== osd_op_reply(190 data_loggenerations_metadata [watch unwatch cookie 94066522552560] v32'156 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8d6403b040 con 0x558d91a84600 2024-09-22T08:37:04.431 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.424+0000 7f8d7c498800 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:191 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94066522515296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558d91a978f0 con 0x7f8d74021020 2024-09-22T08:37:04.431 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.425+0000 7f8d79f82640 1 -- 172.21.15.142:0/4275839061 <== osd.2 v2:172.21.15.142:6808/279438927 39 ==== osd_op_reply(191 notify.0 [watch unwatch cookie 94066522515296] v32'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8d6c07d070 con 0x7f8d74021020 2024-09-22T08:37:04.432 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.425+0000 7f8d7c498800 20 remove_watcher() i=0 2024-09-22T08:37:04.432 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.425+0000 7f8d7c498800 2 removed watcher, disabling cache 2024-09-22T08:37:04.432 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.425+0000 7f8d7c498800 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:192 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94066522521712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558d91a8e760 con 0x558d91a84600 2024-09-22T08:37:04.432 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.426+0000 7f8d79781640 1 -- 172.21.15.142:0/4275839061 <== osd.1 v2:172.21.15.142:6816/3192108003 47 ==== osd_op_reply(192 notify.1 [watch unwatch cookie 94066522521712] v32'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8d6403b040 con 0x558d91a84600 2024-09-22T08:37:04.432 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.426+0000 7f8d7c498800 20 remove_watcher() i=1 2024-09-22T08:37:04.432 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.426+0000 7f8d7c498800 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:193 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94066522522768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558d91a8e760 con 0x558d91a88ed0 2024-09-22T08:37:04.432 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.428+0000 7f8d7a783640 1 -- 172.21.15.142:0/4275839061 <== osd.3 v2:172.21.15.142:6800/1064901393 64 ==== osd_op_reply(193 notify.2 [watch unwatch cookie 94066522522768] v32'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8d7403a070 con 0x558d91a88ed0 2024-09-22T08:37:04.432 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.428+0000 7f8d7c498800 20 remove_watcher() i=2 2024-09-22T08:37:04.432 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.428+0000 7f8d7c498800 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:194 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94066522527664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558d91a8e760 con 0x7f8d74021020 2024-09-22T08:37:04.432 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.429+0000 7f8d79f82640 1 -- 172.21.15.142:0/4275839061 <== osd.2 v2:172.21.15.142:6808/279438927 40 ==== osd_op_reply(194 notify.3 [watch unwatch cookie 94066522527664] v32'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8d6c07d070 con 0x7f8d74021020 2024-09-22T08:37:04.432 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.429+0000 7f8d7c498800 20 remove_watcher() i=3 2024-09-22T08:37:04.432 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.429+0000 7f8d7c498800 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:195 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94066522532624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558d91a8e760 con 0x558d91a84600 2024-09-22T08:37:04.433 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.430+0000 7f8d79781640 1 -- 172.21.15.142:0/4275839061 <== osd.1 v2:172.21.15.142:6816/3192108003 48 ==== osd_op_reply(195 notify.4 [watch unwatch cookie 94066522532624] v32'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8d6403b040 con 0x558d91a84600 2024-09-22T08:37:04.433 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.430+0000 7f8d7c498800 20 remove_watcher() i=4 2024-09-22T08:37:04.434 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.430+0000 7f8d7c498800 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:196 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94066522534912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558d91a8e760 con 0x7f8d6c06d040 2024-09-22T08:37:04.434 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.431+0000 7f8d79781640 1 -- 172.21.15.142:0/4275839061 <== osd.0 v2:172.21.15.31:6800/168281188 44 ==== osd_op_reply(196 notify.5 [watch unwatch cookie 94066522534912] v32'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8d6403b040 con 0x7f8d6c06d040 2024-09-22T08:37:04.434 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.431+0000 7f8d7c498800 20 remove_watcher() i=5 2024-09-22T08:37:04.434 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.431+0000 7f8d7c498800 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:197 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94066522523824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558d91a8e760 con 0x7f8d6c06d040 2024-09-22T08:37:04.434 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.432+0000 7f8d79781640 1 -- 172.21.15.142:0/4275839061 <== osd.0 v2:172.21.15.31:6800/168281188 45 ==== osd_op_reply(197 notify.6 [watch unwatch cookie 94066522523824] v32'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8d6403b040 con 0x7f8d6c06d040 2024-09-22T08:37:04.434 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.432+0000 7f8d7c498800 20 remove_watcher() i=6 2024-09-22T08:37:04.434 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.432+0000 7f8d7c498800 1 -- 172.21.15.142:0/4275839061 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:198 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94066522535968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558d91a8e760 con 0x7f8d6c06d040 2024-09-22T08:37:04.437 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.433+0000 7f8d79781640 1 -- 172.21.15.142:0/4275839061 <== osd.0 v2:172.21.15.31:6800/168281188 46 ==== osd_op_reply(198 notify.7 [watch unwatch cookie 94066522535968] v32'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8d6403b040 con 0x7f8d6c06d040 2024-09-22T08:37:04.437 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.433+0000 7f8d7c498800 20 remove_watcher() i=7 2024-09-22T08:37:04.437 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.433+0000 7f8d7c498800 1 -- 172.21.15.142:0/4275839061 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f8d6c06d040 msgr2=0x7f8d6c0974e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:04.437 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.433+0000 7f8d7c498800 1 --2- 172.21.15.142:0/4275839061 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f8d6c06d040 0x7f8d6c0974e0 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:04.437 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.433+0000 7f8d7c498800 1 -- 172.21.15.142:0/4275839061 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x558d91a84600 msgr2=0x558d91a86a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:04.437 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.433+0000 7f8d7c498800 1 --2- 172.21.15.142:0/4275839061 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x558d91a84600 0x558d91a86a90 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:04.437 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.433+0000 7f8d7c498800 1 -- 172.21.15.142:0/4275839061 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f8d74021020 msgr2=0x7f8d74016510 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:04.437 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.433+0000 7f8d7c498800 1 --2- 172.21.15.142:0/4275839061 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f8d74021020 0x7f8d74016510 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:04.437 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.433+0000 7f8d7c498800 1 -- 172.21.15.142:0/4275839061 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x558d91a88ed0 msgr2=0x558d91a8b2c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:04.437 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.433+0000 7f8d7c498800 1 --2- 172.21.15.142:0/4275839061 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x558d91a88ed0 0x558d91a8b2c0 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:04.437 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.433+0000 7f8d7c498800 1 -- 172.21.15.142:0/4275839061 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f8c4403cfb0 msgr2=0x7f8c4403f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:04.437 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.433+0000 7f8d7c498800 1 --2- 172.21.15.142:0/4275839061 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f8c4403cfb0 0x7f8c4403f470 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f8d6c061fd0 tx=0x7f8d6c088000 comp rx=0 tx=0).stop 2024-09-22T08:37:04.437 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.433+0000 7f8d7c498800 1 -- 172.21.15.142:0/4275839061 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558d91a716d0 msgr2=0x558d91a78cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:04.438 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.433+0000 7f8d7c498800 1 --2- 172.21.15.142:0/4275839061 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558d91a716d0 0x558d91a78cf0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f8d740540f0 tx=0x7f8d74053ce0 comp rx=0 tx=0).stop 2024-09-22T08:37:04.438 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.433+0000 7f8d79781640 1 -- 172.21.15.142:0/4275839061 reap_dead start 2024-09-22T08:37:04.438 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.433+0000 7f8d7c498800 1 -- 172.21.15.142:0/4275839061 shutdown_connections 2024-09-22T08:37:04.438 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.433+0000 7f8d7c498800 1 -- 172.21.15.142:0/4275839061 >> 172.21.15.142:0/4275839061 conn(0x558d91a6dad0 msgr2=0x558d91a6bce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:37:04.438 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.434+0000 7f8d7c498800 1 -- 172.21.15.142:0/4275839061 shutdown_connections 2024-09-22T08:37:04.438 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.434+0000 7f8d7c498800 1 -- 172.21.15.142:0/4275839061 wait complete. 2024-09-22T08:37:04.438 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.434+0000 7f8d7c498800 1 -- 172.21.15.142:0/1494371791 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f8c5403d000 msgr2=0x7f8c5403f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:04.438 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.434+0000 7f8d7c498800 1 --2- 172.21.15.142:0/1494371791 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f8c5403d000 0x7f8c5403f4c0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x558d91a526d0 tx=0x7f8d6c06ab60 comp rx=0 tx=0).stop 2024-09-22T08:37:04.438 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.434+0000 7f8d7c498800 1 -- 172.21.15.142:0/1494371791 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558d91a64c10 msgr2=0x558d91a65030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:04.438 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.434+0000 7f8d7c498800 1 --2- 172.21.15.142:0/1494371791 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558d91a64c10 0x558d91a65030 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x558d91a4abb0 tx=0x7f8d7400bf30 comp rx=0 tx=0).stop 2024-09-22T08:37:04.438 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.434+0000 7f8d7c498800 1 -- 172.21.15.142:0/1494371791 shutdown_connections 2024-09-22T08:37:04.438 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.434+0000 7f8d7c498800 1 --2- 172.21.15.142:0/1494371791 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f8c5403d000 0x7f8c5403f4c0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:04.438 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.434+0000 7f8d7c498800 1 --2- 172.21.15.142:0/1494371791 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558d91a64c10 0x558d91a65030 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:04.439 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.434+0000 7f8d7c498800 1 -- 172.21.15.142:0/1494371791 >> 172.21.15.142:0/1494371791 conn(0x558d91a58fc0 msgr2=0x558d91a593a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:37:04.439 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.434+0000 7f8d7c498800 1 -- 172.21.15.142:0/1494371791 shutdown_connections 2024-09-22T08:37:04.439 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.434+0000 7f8d7c498800 1 -- 172.21.15.142:0/1494371791 wait complete. 2024-09-22T08:37:04.439 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.434+0000 7f8d7c498800 1 -- 172.21.15.142:0/2186023671 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x558d91955a30 msgr2=0x558d91a51200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:04.439 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.434+0000 7f8d7c498800 1 --2- 172.21.15.142:0/2186023671 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x558d91955a30 0x558d91a51200 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:04.439 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.434+0000 7f8d7c498800 1 -- 172.21.15.142:0/2186023671 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x558d91a535e0 msgr2=0x558d91a55a60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:04.439 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.434+0000 7f8d7c498800 1 --2- 172.21.15.142:0/2186023671 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x558d91a535e0 0x558d91a55a60 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:04.439 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.434+0000 7f8d7c498800 1 -- 172.21.15.142:0/2186023671 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f8c6003cfb0 msgr2=0x7f8c6003f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:04.439 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.434+0000 7f8d7c498800 1 --2- 172.21.15.142:0/2186023671 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f8c6003cfb0 0x7f8c6003f470 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f8d64001e30 tx=0x7f8d64001390 comp rx=0 tx=0).stop 2024-09-22T08:37:04.439 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.434+0000 7f8d7c498800 1 -- 172.21.15.142:0/2186023671 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558d918c44f0 msgr2=0x558d91a49bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:04.439 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.434+0000 7f8d7c498800 1 --2- 172.21.15.142:0/2186023671 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558d918c44f0 0x558d91a49bb0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f8d6c063040 tx=0x7f8d6c003330 comp rx=0 tx=0).stop 2024-09-22T08:37:04.439 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.434+0000 7f8d7c498800 1 -- 172.21.15.142:0/2186023671 shutdown_connections 2024-09-22T08:37:04.439 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.434+0000 7f8d7c498800 1 --2- 172.21.15.142:0/2186023671 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x558d91a535e0 0x558d91a55a60 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:04.440 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.434+0000 7f8d7c498800 1 --2- 172.21.15.142:0/2186023671 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x558d91955a30 0x558d91a51200 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:04.440 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.434+0000 7f8d7c498800 1 --2- 172.21.15.142:0/2186023671 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f8c6003cfb0 0x7f8c6003f470 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:04.440 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.434+0000 7f8d7c498800 1 --2- 172.21.15.142:0/2186023671 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558d918c44f0 0x558d91a49bb0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:04.440 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.434+0000 7f8d7c498800 1 -- 172.21.15.142:0/2186023671 >> 172.21.15.142:0/2186023671 conn(0x558d9194abe0 msgr2=0x558d91a3c350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:37:04.440 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.435+0000 7f8d7c498800 1 -- 172.21.15.142:0/2186023671 shutdown_connections 2024-09-22T08:37:04.440 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.435+0000 7f8d7c498800 1 -- 172.21.15.142:0/2186023671 wait complete. 2024-09-22T08:37:04.444 INFO:teuthology.orchestra.run.smithi142.stdout:[{"tag":"e239248c-0bee-4e41-803a-24b288d3eb8f.4226.2852554931933460347\u0000","time":"2024-09-22T08:37:04.251280+0000","objs":[{"pool":"default.rgw.buckets.data","oid":"e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1__shadow_.wi5xbGxXkIpIKDMhzzk54xjbDBcgsQ9_1","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1__shadow_.wi5xbGxXkIpIKDMhzzk54xjbDBcgsQ9_2","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1__shadow_.wi5xbGxXkIpIKDMhzzk54xjbDBcgsQ9_3","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1__shadow_.wi5xbGxXkIpIKDMhzzk54xjbDBcgsQ9_4","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1__shadow_.wi5xbGxXkIpIKDMhzzk54xjbDBcgsQ9_5","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1__shadow_.wi5xbGxXkIpIKDMhzzk54xjbDBcgsQ9_6","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1__shadow_.wi5xbGxXkIpIKDMhzzk54xjbDBcgsQ9_7","key":"","instance":""}]}] 2024-09-22T08:37:04.445 DEBUG:tasks.util.rgw: json result: [{'tag': 'e239248c-0bee-4e41-803a-24b288d3eb8f.4226.2852554931933460347\x00', 'time': '2024-09-22T08:37:04.251280+0000', 'objs': [{'pool': 'default.rgw.buckets.data', 'oid': 'e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1__shadow_.wi5xbGxXkIpIKDMhzzk54xjbDBcgsQ9_1', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': 'e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1__shadow_.wi5xbGxXkIpIKDMhzzk54xjbDBcgsQ9_2', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': 'e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1__shadow_.wi5xbGxXkIpIKDMhzzk54xjbDBcgsQ9_3', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': 'e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1__shadow_.wi5xbGxXkIpIKDMhzzk54xjbDBcgsQ9_4', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': 'e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1__shadow_.wi5xbGxXkIpIKDMhzzk54xjbDBcgsQ9_5', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': 'e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1__shadow_.wi5xbGxXkIpIKDMhzzk54xjbDBcgsQ9_6', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': 'e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1__shadow_.wi5xbGxXkIpIKDMhzzk54xjbDBcgsQ9_7', 'key': '', 'instance': ''}]}] 2024-09-22T08:37:04.445 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process'] 2024-09-22T08:37:04.445 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process'] 2024-09-22T08:37:04.445 DEBUG:teuthology.orchestra.run.smithi142:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process 2024-09-22T08:37:04.487 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:37:04.487 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:37:04.488 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.487+0000 7f325d92e800 1 Processor -- start 2024-09-22T08:37:04.488 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.487+0000 7f325d92e800 1 -- start start 2024-09-22T08:37:04.488 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.487+0000 7f325d92e800 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55fe4b990500 0x55fe4ba214c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:04.488 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.487+0000 7f325d92e800 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55fe4b8a7a20 con 0x55fe4ba21a00 2024-09-22T08:37:04.488 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.487+0000 7f325d92e800 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x55fe4b8a77d0 con 0x55fe4b990500 2024-09-22T08:37:04.489 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.487+0000 7f3259564640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55fe4b990500 0x55fe4ba214c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:04.489 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.487+0000 7f3259564640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55fe4b990500 0x55fe4ba214c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:59278/0 (socket says 172.21.15.142:59278) 2024-09-22T08:37:04.489 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.487+0000 7f3259564640 1 -- 172.21.15.142:0/1403212217 learned_addr learned my addr 172.21.15.142:0/1403212217 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:37:04.489 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.487+0000 7f3258d63640 1 --1- 172.21.15.142:0/1403212217 >> v1:172.21.15.31:6789/0 conn(0x55fe4ba21a00 0x55fe4ba23ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.142:56314/0 (socket says 172.21.15.142:56314) 2024-09-22T08:37:04.489 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.488+0000 7f3259564640 1 -- 172.21.15.142:0/1403212217 >> v1:172.21.15.31:6789/0 conn(0x55fe4ba21a00 legacy=0x55fe4ba23ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:04.489 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.488+0000 7f3259564640 1 -- 172.21.15.142:0/1403212217 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fe4ba26780 con 0x55fe4b990500 2024-09-22T08:37:04.491 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.490+0000 7f3259564640 1 --2- 172.21.15.142:0/1403212217 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fe4b990500 0x55fe4ba214c0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f324c00a520 tx=0x7f324c045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf57973fa1ba49f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:04.491 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.490+0000 7f324bfff640 1 -- 172.21.15.142:0/1403212217 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f324c055070 con 0x55fe4b990500 2024-09-22T08:37:04.491 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.490+0000 7f324bfff640 1 -- 172.21.15.142:0/1403212217 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f324c0515b0 con 0x55fe4b990500 2024-09-22T08:37:04.491 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.490+0000 7f324bfff640 1 -- 172.21.15.142:0/1403212217 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f324c0518d0 con 0x55fe4b990500 2024-09-22T08:37:04.492 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.490+0000 7f325d92e800 1 -- 172.21.15.142:0/1403212217 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fe4b990500 msgr2=0x55fe4ba214c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:04.492 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.490+0000 7f325d92e800 1 --2- 172.21.15.142:0/1403212217 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fe4b990500 0x55fe4ba214c0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f324c00a520 tx=0x7f324c045ba0 comp rx=0 tx=0).stop 2024-09-22T08:37:04.492 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.490+0000 7f325d92e800 1 -- 172.21.15.142:0/1403212217 shutdown_connections 2024-09-22T08:37:04.492 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.490+0000 7f325d92e800 1 --2- 172.21.15.142:0/1403212217 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fe4b990500 0x55fe4ba214c0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:04.492 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.490+0000 7f325d92e800 1 -- 172.21.15.142:0/1403212217 >> 172.21.15.142:0/1403212217 conn(0x55fe4ba16bd0 msgr2=0x55fe4ba19010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:37:04.492 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.490+0000 7f325d92e800 1 -- 172.21.15.142:0/1403212217 shutdown_connections 2024-09-22T08:37:04.492 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.490+0000 7f325d92e800 1 -- 172.21.15.142:0/1403212217 wait complete. 2024-09-22T08:37:04.505 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.504+0000 7f325d92e800 1 Processor -- start 2024-09-22T08:37:04.505 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.504+0000 7f325d92e800 1 -- start start 2024-09-22T08:37:04.506 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.504+0000 7f325d92e800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fe4b990500 0x55fe4bb0e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:04.506 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.504+0000 7f325d92e800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55fe4b8b4dd0 con 0x55fe4b990500 2024-09-22T08:37:04.506 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.504+0000 7f3259564640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fe4b990500 0x55fe4bb0e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:04.506 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.504+0000 7f3259564640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fe4b990500 0x55fe4bb0e1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:59292/0 (socket says 172.21.15.142:59292) 2024-09-22T08:37:04.506 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.504+0000 7f3259564640 1 -- 172.21.15.142:0/919383342 learned_addr learned my addr 172.21.15.142:0/919383342 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:37:04.508 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.505+0000 7f3259564640 1 -- 172.21.15.142:0/919383342 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fe4bb0e7c0 con 0x55fe4b990500 2024-09-22T08:37:04.508 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.505+0000 7f3259564640 1 --2- 172.21.15.142:0/919383342 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fe4b990500 0x55fe4bb0e1d0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f324c025da0 tx=0x7f324c051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8bb7d56d759916c server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:04.508 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.505+0000 7f3147606640 1 -- 172.21.15.142:0/919383342 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f324c051ac0 con 0x55fe4b990500 2024-09-22T08:37:04.508 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.505+0000 7f3147606640 1 -- 172.21.15.142:0/919383342 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f324c051c60 con 0x55fe4b990500 2024-09-22T08:37:04.508 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.505+0000 7f3147606640 1 -- 172.21.15.142:0/919383342 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f324c05a450 con 0x55fe4b990500 2024-09-22T08:37:04.508 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.506+0000 7f325d92e800 1 -- 172.21.15.142:0/919383342 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fe4b990500 msgr2=0x55fe4bb0e1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:04.508 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.506+0000 7f325d92e800 1 --2- 172.21.15.142:0/919383342 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fe4b990500 0x55fe4bb0e1d0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f324c025da0 tx=0x7f324c051000 comp rx=0 tx=0).stop 2024-09-22T08:37:04.508 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.506+0000 7f325d92e800 1 -- 172.21.15.142:0/919383342 shutdown_connections 2024-09-22T08:37:04.508 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.506+0000 7f325d92e800 1 --2- 172.21.15.142:0/919383342 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fe4b990500 0x55fe4bb0e1d0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:04.508 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.506+0000 7f325d92e800 1 -- 172.21.15.142:0/919383342 >> 172.21.15.142:0/919383342 conn(0x55fe4ba16bd0 msgr2=0x55fe4bb09b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:37:04.508 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.506+0000 7f325d92e800 1 -- 172.21.15.142:0/919383342 shutdown_connections 2024-09-22T08:37:04.508 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.506+0000 7f325d92e800 1 -- 172.21.15.142:0/919383342 wait complete. 2024-09-22T08:37:04.508 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.506+0000 7f325d92e800 1 Processor -- start 2024-09-22T08:37:04.509 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.506+0000 7f325d92e800 1 -- start start 2024-09-22T08:37:04.509 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.506+0000 7f325d92e800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fe4b990500 0x55fe4bb15b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:04.509 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.506+0000 7f325d92e800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55fe4ba25a20 con 0x55fe4b990500 2024-09-22T08:37:04.509 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.507+0000 7f3259564640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fe4b990500 0x55fe4bb15b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:04.509 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.507+0000 7f3259564640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fe4b990500 0x55fe4bb15b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:59302/0 (socket says 172.21.15.142:59302) 2024-09-22T08:37:04.509 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.507+0000 7f3259564640 1 -- 172.21.15.142:0/1237533381 learned_addr learned my addr 172.21.15.142:0/1237533381 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:37:04.511 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.507+0000 7f3259564640 1 -- 172.21.15.142:0/1237533381 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fe4bb16070 con 0x55fe4b990500 2024-09-22T08:37:04.511 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.507+0000 7f3259564640 1 --2- 172.21.15.142:0/1237533381 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fe4b990500 0x55fe4bb15b10 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f324c025da0 tx=0x7f324c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:04.511 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.507+0000 7f3145e03640 1 -- 172.21.15.142:0/1237533381 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f324c073070 con 0x55fe4b990500 2024-09-22T08:37:04.511 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.507+0000 7f3145e03640 1 -- 172.21.15.142:0/1237533381 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f324c05a640 con 0x55fe4b990500 2024-09-22T08:37:04.512 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.507+0000 7f325d92e800 1 -- 172.21.15.142:0/1237533381 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fe4bb16300 con 0x55fe4b990500 2024-09-22T08:37:04.512 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.507+0000 7f3145e03640 1 -- 172.21.15.142:0/1237533381 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f324c05a920 con 0x55fe4b990500 2024-09-22T08:37:04.512 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.507+0000 7f325d92e800 1 -- 172.21.15.142:0/1237533381 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fe4bb16f10 con 0x55fe4b990500 2024-09-22T08:37:04.512 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.508+0000 7f3145e03640 1 -- 172.21.15.142:0/1237533381 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f324c076070 con 0x55fe4b990500 2024-09-22T08:37:04.512 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.509+0000 7f3145e03640 1 --2- 172.21.15.142:0/1237533381 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f314003d000 0x7f314003f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:04.512 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.509+0000 7f3145e03640 1 -- 172.21.15.142:0/1237533381 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5938+0+0 (secure 0 0 0) 0x7f324c062070 con 0x55fe4b990500 2024-09-22T08:37:04.512 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.509+0000 7f3258d63640 1 --2- 172.21.15.142:0/1237533381 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f314003d000 0x7f314003f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:04.512 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.509+0000 7f325d92e800 1 --2- 172.21.15.142:0/1237533381 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55fe4ba21a00 0x55fe4bb1d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:04.512 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.509+0000 7f325d92e800 1 -- 172.21.15.142:0/1237533381 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bb1d6a0 con 0x55fe4ba21a00 2024-09-22T08:37:04.512 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.509+0000 7f3259d65640 1 --2- 172.21.15.142:0/1237533381 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55fe4ba21a00 0x55fe4bb1d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:04.512 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.509+0000 7f3258d63640 1 --2- 172.21.15.142:0/1237533381 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f314003d000 0x7f314003f4c0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f3250001e30 tx=0x7f3250001390 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:04.512 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.509+0000 7f3259d65640 1 --2- 172.21.15.142:0/1237533381 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55fe4ba21a00 0x55fe4bb1d160 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:04.512 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.509+0000 7f3259d65640 1 -- 172.21.15.142:0/1237533381 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f325400a4d0 con 0x55fe4ba21a00 2024-09-22T08:37:04.512 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.509+0000 7f325d92e800 1 -- 172.21.15.142:0/1237533381 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bb1da40 con 0x55fe4ba21a00 2024-09-22T08:37:04.513 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.510+0000 7f3259d65640 1 -- 172.21.15.142:0/1237533381 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f325400a4d0 con 0x55fe4ba21a00 2024-09-22T08:37:04.513 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.510+0000 7f325d92e800 1 --2- 172.21.15.142:0/1237533381 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55fe4bb1f540 0x55fe4bb219e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:04.513 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.510+0000 7f325d92e800 1 -- 172.21.15.142:0/1237533381 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:3 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bb22170 con 0x55fe4bb1f540 2024-09-22T08:37:04.513 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.510+0000 7f3259564640 1 --2- 172.21.15.142:0/1237533381 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55fe4bb1f540 0x55fe4bb219e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:04.513 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.510+0000 7f3259564640 1 --2- 172.21.15.142:0/1237533381 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55fe4bb1f540 0x55fe4bb219e0 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:04.513 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.510+0000 7f3259564640 1 -- 172.21.15.142:0/1237533381 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(3 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f324c07f070 con 0x55fe4bb1f540 2024-09-22T08:37:04.513 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.510+0000 7f325d92e800 1 -- 172.21.15.142:0/1237533381 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bb1e290 con 0x55fe4ba21a00 2024-09-22T08:37:04.516 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.511+0000 7f3259d65640 1 -- 172.21.15.142:0/1237533381 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f325400a4d0 con 0x55fe4ba21a00 2024-09-22T08:37:04.516 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.511+0000 7f325d92e800 1 -- 172.21.15.142:0/1237533381 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bb1e6e0 con 0x55fe4bb1f540 2024-09-22T08:37:04.516 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.511+0000 7f3259564640 1 -- 172.21.15.142:0/1237533381 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(5 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f324c07f070 con 0x55fe4bb1f540 2024-09-22T08:37:04.516 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.511+0000 7f325d92e800 1 Processor -- start 2024-09-22T08:37:04.516 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.511+0000 7f325d92e800 1 -- start start 2024-09-22T08:37:04.516 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.511+0000 7f325d92e800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fe4bb30b30 0x55fe4bb30f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:04.516 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.511+0000 7f325d92e800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55fe4b913d50 con 0x55fe4bb30b30 2024-09-22T08:37:04.517 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.512+0000 7f3259d65640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fe4bb30b30 0x55fe4bb30f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:04.517 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.512+0000 7f3259d65640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fe4bb30b30 0x55fe4bb30f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:59312/0 (socket says 172.21.15.142:59312) 2024-09-22T08:37:04.517 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.512+0000 7f3259d65640 1 -- 172.21.15.142:0/1644876412 learned_addr learned my addr 172.21.15.142:0/1644876412 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:37:04.517 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.512+0000 7f3259d65640 1 -- 172.21.15.142:0/1644876412 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fe4bb31590 con 0x55fe4bb30b30 2024-09-22T08:37:04.517 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.512+0000 7f3259d65640 1 --2- 172.21.15.142:0/1644876412 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fe4bb30b30 0x55fe4bb30f50 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x55fe4bb169a0 tx=0x7f32540167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:04.517 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.512+0000 7f313effd640 1 -- 172.21.15.142:0/1644876412 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3254013640 con 0x55fe4bb30b30 2024-09-22T08:37:04.517 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.512+0000 7f313effd640 1 -- 172.21.15.142:0/1644876412 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32540137e0 con 0x55fe4bb30b30 2024-09-22T08:37:04.517 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.512+0000 7f313effd640 1 -- 172.21.15.142:0/1644876412 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3254013ae0 con 0x55fe4bb30b30 2024-09-22T08:37:04.517 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.512+0000 7f325d92e800 1 -- 172.21.15.142:0/1644876412 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fe4bb31dc0 con 0x55fe4bb30b30 2024-09-22T08:37:04.517 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.513+0000 7f325d92e800 1 -- 172.21.15.142:0/1644876412 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fe4bb32360 con 0x55fe4bb30b30 2024-09-22T08:37:04.517 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.513+0000 7f313effd640 1 -- 172.21.15.142:0/1644876412 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f3254011040 con 0x55fe4bb30b30 2024-09-22T08:37:04.517 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.514+0000 7f313effd640 1 --2- 172.21.15.142:0/1644876412 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f313003cfb0 0x7f313003f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:04.517 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.514+0000 7f313effd640 1 -- 172.21.15.142:0/1644876412 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5938+0+0 (secure 0 0 0) 0x7f325400e040 con 0x55fe4bb30b30 2024-09-22T08:37:04.517 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.514+0000 7f3259564640 1 --2- 172.21.15.142:0/1644876412 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f313003cfb0 0x7f313003f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:04.518 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.514+0000 7f325d92e800 1 Processor -- start 2024-09-22T08:37:04.518 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.514+0000 7f3259564640 1 --2- 172.21.15.142:0/1644876412 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f313003cfb0 0x7f313003f470 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f324c076520 tx=0x7f324c06ff10 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:04.518 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.514+0000 7f325d92e800 1 -- start start 2024-09-22T08:37:04.518 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.514+0000 7f325d92e800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fe4bb3d5f0 0x55fe4bb3d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:04.518 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.514+0000 7f325d92e800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55fe4bb0eb30 con 0x55fe4bb3d5f0 2024-09-22T08:37:04.518 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.514+0000 7f3259d65640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fe4bb3d5f0 0x55fe4bb3d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:04.518 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.514+0000 7f3259d65640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fe4bb3d5f0 0x55fe4bb3d9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:59328/0 (socket says 172.21.15.142:59328) 2024-09-22T08:37:04.518 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.514+0000 7f3259d65640 1 -- 172.21.15.142:0/1804201082 learned_addr learned my addr 172.21.15.142:0/1804201082 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:37:04.518 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.515+0000 7f3259d65640 1 -- 172.21.15.142:0/1804201082 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fe4bb3dfe0 con 0x55fe4bb3d5f0 2024-09-22T08:37:04.518 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.515+0000 7f3259d65640 1 --2- 172.21.15.142:0/1804201082 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fe4bb3d5f0 0x55fe4bb3d9f0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f3254005a30 tx=0x7f325401fee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=784aa58b784c0075 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:04.518 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.515+0000 7f313cff9640 1 -- 172.21.15.142:0/1804201082 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3254021a90 con 0x55fe4bb3d5f0 2024-09-22T08:37:04.518 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.515+0000 7f313cff9640 1 -- 172.21.15.142:0/1804201082 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3254052070 con 0x55fe4bb3d5f0 2024-09-22T08:37:04.518 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.515+0000 7f313cff9640 1 -- 172.21.15.142:0/1804201082 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f325401f490 con 0x55fe4bb3d5f0 2024-09-22T08:37:04.525 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.515+0000 7f325d92e800 1 -- 172.21.15.142:0/1804201082 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fe4bb3d5f0 msgr2=0x55fe4bb3d9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:04.525 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.515+0000 7f325d92e800 1 --2- 172.21.15.142:0/1804201082 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fe4bb3d5f0 0x55fe4bb3d9f0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f3254005a30 tx=0x7f325401fee0 comp rx=0 tx=0).stop 2024-09-22T08:37:04.525 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.515+0000 7f325d92e800 1 -- 172.21.15.142:0/1804201082 shutdown_connections 2024-09-22T08:37:04.525 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.515+0000 7f325d92e800 1 --2- 172.21.15.142:0/1804201082 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fe4bb3d5f0 0x55fe4bb3d9f0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:04.525 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.515+0000 7f325d92e800 1 -- 172.21.15.142:0/1804201082 >> 172.21.15.142:0/1804201082 conn(0x55fe4bb399f0 msgr2=0x55fe4bb37c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:37:04.525 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.516+0000 7f325d92e800 1 -- 172.21.15.142:0/1804201082 shutdown_connections 2024-09-22T08:37:04.525 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.516+0000 7f325d92e800 1 -- 172.21.15.142:0/1804201082 wait complete. 2024-09-22T08:37:04.525 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.516+0000 7f325d92e800 1 Processor -- start 2024-09-22T08:37:04.525 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.516+0000 7f325d92e800 1 -- start start 2024-09-22T08:37:04.525 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.516+0000 7f325d92e800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fe4bb3d5f0 0x55fe4bb44bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:04.526 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.516+0000 7f325d92e800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55fe4bb3e600 con 0x55fe4bb3d5f0 2024-09-22T08:37:04.526 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.516+0000 7f3259d65640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fe4bb3d5f0 0x55fe4bb44bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:04.526 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.516+0000 7f3259d65640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fe4bb3d5f0 0x55fe4bb44bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:59342/0 (socket says 172.21.15.142:59342) 2024-09-22T08:37:04.526 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.516+0000 7f3259d65640 1 -- 172.21.15.142:0/2421614479 learned_addr learned my addr 172.21.15.142:0/2421614479 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:37:04.526 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.516+0000 7f3259d65640 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fe4bb45150 con 0x55fe4bb3d5f0 2024-09-22T08:37:04.526 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.517+0000 7f3259d65640 1 --2- 172.21.15.142:0/2421614479 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fe4bb3d5f0 0x55fe4bb44bf0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f325401ff20 tx=0x7f32540547a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:04.526 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.517+0000 7f312effd640 1 -- 172.21.15.142:0/2421614479 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3254013db0 con 0x55fe4bb3d5f0 2024-09-22T08:37:04.526 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.517+0000 7f312effd640 1 -- 172.21.15.142:0/2421614479 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3254021440 con 0x55fe4bb3d5f0 2024-09-22T08:37:04.526 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.517+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fe4bb453e0 con 0x55fe4bb3d5f0 2024-09-22T08:37:04.526 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.517+0000 7f312effd640 1 -- 172.21.15.142:0/2421614479 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32540459e0 con 0x55fe4bb3d5f0 2024-09-22T08:37:04.526 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.517+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fe4bb45f70 con 0x55fe4bb3d5f0 2024-09-22T08:37:04.526 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.518+0000 7f312effd640 1 -- 172.21.15.142:0/2421614479 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f3254045b80 con 0x55fe4bb3d5f0 2024-09-22T08:37:04.526 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.518+0000 7f312effd640 1 --2- 172.21.15.142:0/2421614479 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f312403cfb0 0x7f312403f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:04.527 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.518+0000 7f312effd640 1 -- 172.21.15.142:0/2421614479 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5938+0+0 (secure 0 0 0) 0x7f325404c030 con 0x55fe4bb3d5f0 2024-09-22T08:37:04.527 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.518+0000 7f3259564640 1 --2- 172.21.15.142:0/2421614479 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f312403cfb0 0x7f312403f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:04.527 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.518+0000 7f3259564640 1 --2- 172.21.15.142:0/2421614479 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f312403cfb0 0x7f312403f470 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f324c06f5e0 tx=0x7f324c08f000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:04.527 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.518+0000 7f325d92e800 20 rados->read ofs=0 len=0 2024-09-22T08:37:04.527 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.518+0000 7f325d92e800 1 --2- 172.21.15.142:0/2421614479 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55fe4bb50500 0x55fe4bb529c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:04.527 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.518+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bb53110 con 0x55fe4bb50500 2024-09-22T08:37:04.527 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.518+0000 7f3258d63640 1 --2- 172.21.15.142:0/2421614479 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55fe4bb50500 0x55fe4bb529c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:04.527 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.519+0000 7f3258d63640 1 --2- 172.21.15.142:0/2421614479 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55fe4bb50500 0x55fe4bb529c0 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:04.527 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.519+0000 7f3258d63640 1 -- 172.21.15.142:0/2421614479 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f325000f610 con 0x55fe4bb50500 2024-09-22T08:37:04.527 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.519+0000 7f325d92e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:04.527 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.519+0000 7f325d92e800 20 realm 2024-09-22T08:37:04.527 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.519+0000 7f325d92e800 20 rados->read ofs=0 len=0 2024-09-22T08:37:04.527 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.519+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bb4f850 con 0x55fe4bb50500 2024-09-22T08:37:04.527 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.519+0000 7f3258d63640 1 -- 172.21.15.142:0/2421614479 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f325000f610 con 0x55fe4bb50500 2024-09-22T08:37:04.528 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.519+0000 7f325d92e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:04.528 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.519+0000 7f325d92e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:37:04.528 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.519+0000 7f325d92e800 20 rados->read ofs=0 len=0 2024-09-22T08:37:04.528 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.519+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bb53c00 con 0x55fe4bb50500 2024-09-22T08:37:04.528 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.519+0000 7f3258d63640 1 -- 172.21.15.142:0/2421614479 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f325000f610 con 0x55fe4bb50500 2024-09-22T08:37:04.528 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.519+0000 7f325d92e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:04.528 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.519+0000 7f325d92e800 20 rados->read ofs=0 len=0 2024-09-22T08:37:04.528 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.519+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bb544d0 con 0x55fe4bb50500 2024-09-22T08:37:04.528 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.520+0000 7f3258d63640 1 -- 172.21.15.142:0/2421614479 <== osd.1 v2:172.21.15.142:6816/3192108003 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f325000f610 con 0x55fe4bb50500 2024-09-22T08:37:04.528 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.520+0000 7f325d92e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:37:04.528 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.520+0000 7f325d92e800 20 rados->read ofs=0 len=0 2024-09-22T08:37:04.528 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.520+0000 7f325d92e800 1 --2- 172.21.15.142:0/2421614479 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55fe4bb54ef0 0x55fe4bb572e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:04.528 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.520+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bb57a20 con 0x55fe4bb54ef0 2024-09-22T08:37:04.528 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.520+0000 7f3259d65640 1 --2- 172.21.15.142:0/2421614479 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55fe4bb54ef0 0x55fe4bb572e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:04.529 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.520+0000 7f3259d65640 1 --2- 172.21.15.142:0/2421614479 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55fe4bb54ef0 0x55fe4bb572e0 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:04.529 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.520+0000 7f3259d65640 1 -- 172.21.15.142:0/2421614479 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(5 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f325400a4d0 con 0x55fe4bb54ef0 2024-09-22T08:37:04.529 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.520+0000 7f325d92e800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:37:04.529 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.520+0000 7f325d92e800 20 searching for the correct realm 2024-09-22T08:37:04.529 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.520+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bb59350 con 0x55fe4bb54ef0 2024-09-22T08:37:04.529 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.521+0000 7f3259d65640 1 -- 172.21.15.142:0/2421614479 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f325400a4d0 con 0x55fe4bb54ef0 2024-09-22T08:37:04.529 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.521+0000 7f3259d65640 1 --2- 172.21.15.142:0/2421614479 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f3254054c20 0x7f3254056540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:04.529 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.521+0000 7f3259d65640 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bb59350 con 0x7f3254054c20 2024-09-22T08:37:04.529 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.521+0000 7f3259564640 1 --2- 172.21.15.142:0/2421614479 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f3254054c20 0x7f3254056540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:04.529 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.521+0000 7f3259564640 1 --2- 172.21.15.142:0/2421614479 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f3254054c20 0x7f3254056540 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:04.529 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.521+0000 7f3259564640 1 -- 172.21.15.142:0/2421614479 <== osd.2 v2:172.21.15.142:6808/279438927 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f324c07f070 con 0x7f3254054c20 2024-09-22T08:37:04.529 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.521+0000 7f3259564640 1 --2- 172.21.15.142:0/2421614479 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f324c0a5040 0x7f324c0645d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:04.529 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.521+0000 7f3259564640 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bb59350 con 0x7f324c0a5040 2024-09-22T08:37:04.529 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.521+0000 7f3258d63640 1 --2- 172.21.15.142:0/2421614479 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f324c0a5040 0x7f324c0645d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:04.530 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.522+0000 7f3258d63640 1 --2- 172.21.15.142:0/2421614479 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f324c0a5040 0x7f324c0645d0 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:04.530 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.522+0000 7f3258d63640 1 -- 172.21.15.142:0/2421614479 <== osd.0 v2:172.21.15.31:6800/168281188 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f325000f610 con 0x7f324c0a5040 2024-09-22T08:37:04.530 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.522+0000 7f3258d63640 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bb59350 con 0x55fe4bb50500 2024-09-22T08:37:04.530 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.522+0000 7f3258d63640 1 -- 172.21.15.142:0/2421614479 <== osd.1 v2:172.21.15.142:6816/3192108003 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f325000f610 con 0x55fe4bb50500 2024-09-22T08:37:04.530 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.522+0000 7f3258d63640 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bb59350 con 0x55fe4bb50500 2024-09-22T08:37:04.530 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.523+0000 7f3258d63640 1 -- 172.21.15.142:0/2421614479 <== osd.1 v2:172.21.15.142:6816/3192108003 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f325002b040 con 0x55fe4bb50500 2024-09-22T08:37:04.530 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.523+0000 7f3258d63640 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bb59350 con 0x55fe4bb50500 2024-09-22T08:37:04.530 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.523+0000 7f3258d63640 1 -- 172.21.15.142:0/2421614479 <== osd.1 v2:172.21.15.142:6816/3192108003 7 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f325002b040 con 0x55fe4bb50500 2024-09-22T08:37:04.530 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.523+0000 7f3258d63640 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bb59350 con 0x7f324c0a5040 2024-09-22T08:37:04.530 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.523+0000 7f3258d63640 1 -- 172.21.15.142:0/2421614479 <== osd.0 v2:172.21.15.31:6800/168281188 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f325002b040 con 0x7f324c0a5040 2024-09-22T08:37:04.530 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.523+0000 7f3258d63640 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bb59350 con 0x7f3254054c20 2024-09-22T08:37:04.530 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.523+0000 7f3259564640 1 -- 172.21.15.142:0/2421614479 <== osd.2 v2:172.21.15.142:6808/279438927 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f324c07f070 con 0x7f3254054c20 2024-09-22T08:37:04.530 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.523+0000 7f3259564640 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bb59350 con 0x55fe4bb54ef0 2024-09-22T08:37:04.530 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.524+0000 7f3259d65640 1 -- 172.21.15.142:0/2421614479 <== osd.3 v2:172.21.15.142:6800/1064901393 3 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f325400a4d0 con 0x55fe4bb54ef0 2024-09-22T08:37:04.531 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.524+0000 7f3259d65640 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bb59350 con 0x55fe4bb50500 2024-09-22T08:37:04.531 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.524+0000 7f3258d63640 1 -- 172.21.15.142:0/2421614479 <== osd.1 v2:172.21.15.142:6816/3192108003 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f325002b040 con 0x55fe4bb50500 2024-09-22T08:37:04.531 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.524+0000 7f3258d63640 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bb59350 con 0x7f324c0a5040 2024-09-22T08:37:04.538 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.524+0000 7f3258d63640 1 -- 172.21.15.142:0/2421614479 <== osd.0 v2:172.21.15.31:6800/168281188 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f325002b040 con 0x7f324c0a5040 2024-09-22T08:37:04.538 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.524+0000 7f3258d63640 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bb59350 con 0x55fe4bb50500 2024-09-22T08:37:04.538 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.524+0000 7f3258d63640 1 -- 172.21.15.142:0/2421614479 <== osd.1 v2:172.21.15.142:6816/3192108003 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f325002b040 con 0x55fe4bb50500 2024-09-22T08:37:04.538 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.524+0000 7f3258d63640 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bb59350 con 0x7f3254054c20 2024-09-22T08:37:04.538 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.525+0000 7f3259564640 1 -- 172.21.15.142:0/2421614479 <== osd.2 v2:172.21.15.142:6808/279438927 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f324c07f070 con 0x7f3254054c20 2024-09-22T08:37:04.538 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.525+0000 7f3259564640 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bb59350 con 0x55fe4bb54ef0 2024-09-22T08:37:04.538 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.525+0000 7f3259d65640 1 -- 172.21.15.142:0/2421614479 <== osd.3 v2:172.21.15.142:6800/1064901393 4 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f325400a4d0 con 0x55fe4bb54ef0 2024-09-22T08:37:04.539 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.525+0000 7f3259d65640 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bb59350 con 0x55fe4bb54ef0 2024-09-22T08:37:04.539 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.525+0000 7f3259d65640 1 -- 172.21.15.142:0/2421614479 <== osd.3 v2:172.21.15.142:6800/1064901393 5 ==== osd_op_reply(20 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f325400a4d0 con 0x55fe4bb54ef0 2024-09-22T08:37:04.539 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.525+0000 7f3259d65640 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bb59350 con 0x7f324c0a5040 2024-09-22T08:37:04.539 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.525+0000 7f3258d63640 1 -- 172.21.15.142:0/2421614479 <== osd.0 v2:172.21.15.31:6800/168281188 4 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f325002b040 con 0x7f324c0a5040 2024-09-22T08:37:04.539 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.525+0000 7f3258d63640 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bb59350 con 0x55fe4bb54ef0 2024-09-22T08:37:04.539 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.526+0000 7f3259d65640 1 -- 172.21.15.142:0/2421614479 <== osd.3 v2:172.21.15.142:6800/1064901393 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f325400a4d0 con 0x55fe4bb54ef0 2024-09-22T08:37:04.539 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.526+0000 7f3259d65640 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bb59350 con 0x55fe4bb54ef0 2024-09-22T08:37:04.539 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.526+0000 7f3259d65640 1 -- 172.21.15.142:0/2421614479 <== osd.3 v2:172.21.15.142:6800/1064901393 7 ==== osd_op_reply(23 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f325400a4d0 con 0x55fe4bb54ef0 2024-09-22T08:37:04.539 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.526+0000 7f3259d65640 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bb59350 con 0x55fe4bb50500 2024-09-22T08:37:04.539 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.526+0000 7f3258d63640 1 -- 172.21.15.142:0/2421614479 <== osd.1 v2:172.21.15.142:6816/3192108003 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f325002b040 con 0x55fe4bb50500 2024-09-22T08:37:04.539 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.526+0000 7f3258d63640 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bb59350 con 0x55fe4bb50500 2024-09-22T08:37:04.539 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.526+0000 7f3258d63640 1 -- 172.21.15.142:0/2421614479 <== osd.1 v2:172.21.15.142:6816/3192108003 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f325002b040 con 0x55fe4bb50500 2024-09-22T08:37:04.539 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.526+0000 7f3258d63640 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bb59350 con 0x7f324c0a5040 2024-09-22T08:37:04.539 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.527+0000 7f3258d63640 1 -- 172.21.15.142:0/2421614479 <== osd.0 v2:172.21.15.31:6800/168281188 5 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f325002b040 con 0x7f324c0a5040 2024-09-22T08:37:04.540 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.527+0000 7f3258d63640 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bb59350 con 0x55fe4bb54ef0 2024-09-22T08:37:04.540 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.527+0000 7f3259d65640 1 -- 172.21.15.142:0/2421614479 <== osd.3 v2:172.21.15.142:6800/1064901393 8 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f325400a4d0 con 0x55fe4bb54ef0 2024-09-22T08:37:04.540 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.527+0000 7f3259d65640 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bb59350 con 0x7f3254054c20 2024-09-22T08:37:04.540 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.527+0000 7f3259564640 1 -- 172.21.15.142:0/2421614479 <== osd.2 v2:172.21.15.142:6808/279438927 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f324c07f070 con 0x7f3254054c20 2024-09-22T08:37:04.540 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.527+0000 7f3259564640 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bb59350 con 0x55fe4bb50500 2024-09-22T08:37:04.540 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.527+0000 7f3258d63640 1 -- 172.21.15.142:0/2421614479 <== osd.1 v2:172.21.15.142:6816/3192108003 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f325002b040 con 0x55fe4bb50500 2024-09-22T08:37:04.540 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.527+0000 7f3258d63640 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bb59350 con 0x7f324c0a5040 2024-09-22T08:37:04.540 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.528+0000 7f3258d63640 1 -- 172.21.15.142:0/2421614479 <== osd.0 v2:172.21.15.31:6800/168281188 6 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f325003b040 con 0x7f324c0a5040 2024-09-22T08:37:04.540 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.528+0000 7f3258d63640 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bb59350 con 0x55fe4bb54ef0 2024-09-22T08:37:04.540 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.528+0000 7f3259d65640 1 -- 172.21.15.142:0/2421614479 <== osd.3 v2:172.21.15.142:6800/1064901393 9 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f325400a4d0 con 0x55fe4bb54ef0 2024-09-22T08:37:04.540 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.528+0000 7f3259d65640 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bb59350 con 0x7f324c0a5040 2024-09-22T08:37:04.540 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.528+0000 7f3258d63640 1 -- 172.21.15.142:0/2421614479 <== osd.0 v2:172.21.15.31:6800/168281188 7 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f325003b040 con 0x7f324c0a5040 2024-09-22T08:37:04.540 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.528+0000 7f3258d63640 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bb59350 con 0x7f3254054c20 2024-09-22T08:37:04.541 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.529+0000 7f3259564640 1 -- 172.21.15.142:0/2421614479 <== osd.2 v2:172.21.15.142:6808/279438927 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f324c07f070 con 0x7f3254054c20 2024-09-22T08:37:04.541 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.529+0000 7f3259564640 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bb59350 con 0x55fe4bb54ef0 2024-09-22T08:37:04.541 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.529+0000 7f3259d65640 1 -- 172.21.15.142:0/2421614479 <== osd.3 v2:172.21.15.142:6800/1064901393 10 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f325400a4d0 con 0x55fe4bb54ef0 2024-09-22T08:37:04.541 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.529+0000 7f3259d65640 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bb59350 con 0x7f324c0a5040 2024-09-22T08:37:04.541 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.529+0000 7f3258d63640 1 -- 172.21.15.142:0/2421614479 <== osd.0 v2:172.21.15.31:6800/168281188 8 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f325003b040 con 0x7f324c0a5040 2024-09-22T08:37:04.541 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.529+0000 7f3258d63640 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bb59350 con 0x55fe4bb50500 2024-09-22T08:37:04.541 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.529+0000 7f3258d63640 1 -- 172.21.15.142:0/2421614479 <== osd.1 v2:172.21.15.142:6816/3192108003 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f325003b040 con 0x55fe4bb50500 2024-09-22T08:37:04.541 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.529+0000 7f3258d63640 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bb59350 con 0x7f3254054c20 2024-09-22T08:37:04.541 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.530+0000 7f3259564640 1 -- 172.21.15.142:0/2421614479 <== osd.2 v2:172.21.15.142:6808/279438927 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f324c07f070 con 0x7f3254054c20 2024-09-22T08:37:04.541 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.530+0000 7f325d92e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:37:04.541 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.530+0000 7f325d92e800 20 RGWRados::pool_iterate: got zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec 2024-09-22T08:37:04.541 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.530+0000 7f325d92e800 20 RGWRados::pool_iterate: got zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f 2024-09-22T08:37:04.541 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.530+0000 7f325d92e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:37:04.541 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.530+0000 7f325d92e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:37:04.542 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.530+0000 7f325d92e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:37:04.542 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.530+0000 7f325d92e800 20 rados->read ofs=0 len=0 2024-09-22T08:37:04.542 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.530+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bb58410 con 0x55fe4bb50500 2024-09-22T08:37:04.542 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.530+0000 7f3258d63640 1 -- 172.21.15.142:0/2421614479 <== osd.1 v2:172.21.15.142:6816/3192108003 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f325003b040 con 0x55fe4bb50500 2024-09-22T08:37:04.542 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.530+0000 7f325d92e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:04.542 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.530+0000 7f325d92e800 20 rados->read ofs=0 len=0 2024-09-22T08:37:04.542 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.530+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bb58c60 con 0x55fe4bb50500 2024-09-22T08:37:04.542 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.530+0000 7f3258d63640 1 -- 172.21.15.142:0/2421614479 <== osd.1 v2:172.21.15.142:6816/3192108003 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f325003b040 con 0x55fe4bb50500 2024-09-22T08:37:04.542 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.530+0000 7f325d92e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:37:04.542 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.530+0000 7f325d92e800 20 rados->read ofs=0 len=0 2024-09-22T08:37:04.542 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.530+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:40 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bb597d0 con 0x55fe4bb54ef0 2024-09-22T08:37:04.542 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.530+0000 7f3259d65640 1 -- 172.21.15.142:0/2421614479 <== osd.3 v2:172.21.15.142:6800/1064901393 11 ==== osd_op_reply(40 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f325400a4d0 con 0x55fe4bb54ef0 2024-09-22T08:37:04.542 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.530+0000 7f325d92e800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:37:04.542 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.530+0000 7f325d92e800 20 zone default found 2024-09-22T08:37:04.543 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.530+0000 7f325d92e800 4 Realm: () 2024-09-22T08:37:04.543 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.530+0000 7f325d92e800 4 ZoneGroup: default (d89f6f57-1007-47dd-9065-f486c7b01aec) 2024-09-22T08:37:04.543 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.530+0000 7f325d92e800 4 Zone: default (e239248c-0bee-4e41-803a-24b288d3eb8f) 2024-09-22T08:37:04.543 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.530+0000 7f325d92e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:37:04.543 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.530+0000 7f325d92e800 20 zonegroup default 2024-09-22T08:37:04.543 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.530+0000 7f325d92e800 20 rados->read ofs=0 len=0 2024-09-22T08:37:04.543 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.530+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bb59b70 con 0x7f324c0a5040 2024-09-22T08:37:04.543 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.531+0000 7f3258d63640 1 -- 172.21.15.142:0/2421614479 <== osd.0 v2:172.21.15.31:6800/168281188 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f325003b040 con 0x7f324c0a5040 2024-09-22T08:37:04.543 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.531+0000 7f325d92e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:04.543 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.531+0000 7f325d92e800 20 rados->read ofs=0 len=0 2024-09-22T08:37:04.543 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.531+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bb5b9d0 con 0x55fe4bb54ef0 2024-09-22T08:37:04.543 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.531+0000 7f3259d65640 1 -- 172.21.15.142:0/2421614479 <== osd.3 v2:172.21.15.142:6800/1064901393 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f325400a4d0 con 0x55fe4bb54ef0 2024-09-22T08:37:04.543 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.531+0000 7f325d92e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:04.543 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.531+0000 7f325d92e800 20 rados->read ofs=0 len=0 2024-09-22T08:37:04.544 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.531+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bb5be30 con 0x55fe4bb54ef0 2024-09-22T08:37:04.544 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.532+0000 7f3259d65640 1 -- 172.21.15.142:0/2421614479 <== osd.3 v2:172.21.15.142:6800/1064901393 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f325400a4d0 con 0x55fe4bb54ef0 2024-09-22T08:37:04.544 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.532+0000 7f325d92e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:04.544 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.532+0000 7f325d92e800 20 started sync module instance, tier type = 2024-09-22T08:37:04.544 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.532+0000 7f325d92e800 20 started zone id=e239248c-0bee-4e41-803a-24b288d3eb8f (name=default) with tier type = 2024-09-22T08:37:04.544 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.532+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bb5ae40 con 0x7f3254054c20 2024-09-22T08:37:04.544 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.533+0000 7f3259564640 1 -- 172.21.15.142:0/2421614479 <== osd.2 v2:172.21.15.142:6808/279438927 7 ==== osd_op_reply(44 notify.0 [create] v32'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f324c07f070 con 0x7f3254054c20 2024-09-22T08:37:04.544 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.533+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94550680252976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bb5aaa0 con 0x7f3254054c20 2024-09-22T08:37:04.544 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.533+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bb5cd60 con 0x55fe4bb50500 2024-09-22T08:37:04.544 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.534+0000 7f3259564640 1 -- 172.21.15.142:0/2421614479 <== osd.2 v2:172.21.15.142:6808/279438927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94550680252976] v32'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f324c07f070 con 0x7f3254054c20 2024-09-22T08:37:04.544 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.534+0000 7f3258d63640 1 -- 172.21.15.142:0/2421614479 <== osd.1 v2:172.21.15.142:6816/3192108003 16 ==== osd_op_reply(46 notify.1 [create] v32'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f325003b040 con 0x55fe4bb50500 2024-09-22T08:37:04.544 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.534+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94550680258736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bb5d180 con 0x55fe4bb50500 2024-09-22T08:37:04.544 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.534+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bb5db40 con 0x55fe4bb54ef0 2024-09-22T08:37:04.544 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.535+0000 7f3259d65640 1 -- 172.21.15.142:0/2421614479 <== osd.3 v2:172.21.15.142:6800/1064901393 14 ==== osd_op_reply(48 notify.2 [create] v32'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f325400a4d0 con 0x55fe4bb54ef0 2024-09-22T08:37:04.545 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.535+0000 7f3258d63640 1 -- 172.21.15.142:0/2421614479 <== osd.1 v2:172.21.15.142:6816/3192108003 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94550680258736] v32'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f325003b040 con 0x55fe4bb50500 2024-09-22T08:37:04.545 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.535+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94550680262288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bb5daf0 con 0x55fe4bb54ef0 2024-09-22T08:37:04.545 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.535+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bb5ccf0 con 0x7f3254054c20 2024-09-22T08:37:04.545 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.536+0000 7f3259564640 1 -- 172.21.15.142:0/2421614479 <== osd.2 v2:172.21.15.142:6808/279438927 9 ==== osd_op_reply(50 notify.3 [create] v32'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f324c07f070 con 0x7f3254054c20 2024-09-22T08:37:04.545 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.536+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94550680266192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bb5eea0 con 0x7f3254054c20 2024-09-22T08:37:04.545 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.536+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bb5f950 con 0x55fe4bb50500 2024-09-22T08:37:04.545 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.536+0000 7f3259d65640 1 -- 172.21.15.142:0/2421614479 <== osd.3 v2:172.21.15.142:6800/1064901393 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94550680262288] v32'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f325400a4d0 con 0x55fe4bb54ef0 2024-09-22T08:37:04.548 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.537+0000 7f3258d63640 1 -- 172.21.15.142:0/2421614479 <== osd.1 v2:172.21.15.142:6816/3192108003 18 ==== osd_op_reply(52 notify.4 [create] v32'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f325003b040 con 0x55fe4bb50500 2024-09-22T08:37:04.548 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.537+0000 7f3259564640 1 -- 172.21.15.142:0/2421614479 <== osd.2 v2:172.21.15.142:6808/279438927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94550680266192] v32'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f324c07f070 con 0x7f3254054c20 2024-09-22T08:37:04.548 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.537+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94550680264496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bb5fd70 con 0x55fe4bb50500 2024-09-22T08:37:04.548 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.537+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bb5e9f0 con 0x7f324c0a5040 2024-09-22T08:37:04.548 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.539+0000 7f3258d63640 1 -- 172.21.15.142:0/2421614479 <== osd.1 v2:172.21.15.142:6816/3192108003 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94550680264496] v32'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f325003b040 con 0x55fe4bb50500 2024-09-22T08:37:04.549 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.539+0000 7f3258d63640 1 -- 172.21.15.142:0/2421614479 <== osd.0 v2:172.21.15.31:6800/168281188 10 ==== osd_op_reply(54 notify.5 [create] v32'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f325003b040 con 0x7f324c0a5040 2024-09-22T08:37:04.549 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.539+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94550680269920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bb5fd20 con 0x7f324c0a5040 2024-09-22T08:37:04.549 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.539+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bb60c30 con 0x7f324c0a5040 2024-09-22T08:37:04.549 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.539+0000 7f3258d63640 1 -- 172.21.15.142:0/2421614479 <== osd.0 v2:172.21.15.31:6800/168281188 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94550680269920] v32'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f325003b040 con 0x7f324c0a5040 2024-09-22T08:37:04.549 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.540+0000 7f3258d63640 1 -- 172.21.15.142:0/2421614479 <== osd.0 v2:172.21.15.31:6800/168281188 12 ==== osd_op_reply(56 notify.6 [create] v32'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f325003b040 con 0x7f324c0a5040 2024-09-22T08:37:04.549 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.540+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94550680273584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bb60c30 con 0x7f324c0a5040 2024-09-22T08:37:04.549 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.540+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bb615f0 con 0x7f324c0a5040 2024-09-22T08:37:04.549 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.541+0000 7f3258d63640 1 -- 172.21.15.142:0/2421614479 <== osd.0 v2:172.21.15.31:6800/168281188 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94550680273584] v32'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f325003b040 con 0x7f324c0a5040 2024-09-22T08:37:04.549 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.541+0000 7f3258d63640 1 -- 172.21.15.142:0/2421614479 <== osd.0 v2:172.21.15.31:6800/168281188 14 ==== osd_op_reply(58 notify.7 [create] v32'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f325003b040 con 0x7f324c0a5040 2024-09-22T08:37:04.549 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.541+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94550680274640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bb615f0 con 0x7f324c0a5040 2024-09-22T08:37:04.549 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.541+0000 7f325d92e800 20 add_watcher() i=0 2024-09-22T08:37:04.549 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.541+0000 7f325d92e800 20 add_watcher() i=1 2024-09-22T08:37:04.549 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.541+0000 7f325d92e800 20 add_watcher() i=2 2024-09-22T08:37:04.549 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.541+0000 7f325d92e800 20 add_watcher() i=3 2024-09-22T08:37:04.550 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.541+0000 7f325d92e800 20 add_watcher() i=4 2024-09-22T08:37:04.550 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.541+0000 7f325d92e800 20 add_watcher() i=5 2024-09-22T08:37:04.550 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.541+0000 7f325d92e800 20 add_watcher() i=6 2024-09-22T08:37:04.550 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.542+0000 7f3258d63640 1 -- 172.21.15.142:0/2421614479 <== osd.0 v2:172.21.15.31:6800/168281188 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94550680274640] v32'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f325003b040 con 0x7f324c0a5040 2024-09-22T08:37:04.550 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.542+0000 7f325d92e800 20 add_watcher() i=7 2024-09-22T08:37:04.550 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.542+0000 7f325d92e800 2 all 8 watchers are set, enabling cache 2024-09-22T08:37:04.550 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.542+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bb64b20 con 0x55fe4bb50500 2024-09-22T08:37:04.550 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.542+0000 7f3258d63640 1 -- 172.21.15.142:0/2421614479 <== osd.1 v2:172.21.15.142:6816/3192108003 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f325003b040 con 0x55fe4bb50500 2024-09-22T08:37:04.550 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.542+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94550680278240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bb61ed0 con 0x55fe4bb50500 2024-09-22T08:37:04.550 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.543+0000 7f3258d63640 1 -- 172.21.15.142:0/2421614479 <== osd.1 v2:172.21.15.142:6816/3192108003 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94550680278240] v32'157 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f325003b040 con 0x55fe4bb50500 2024-09-22T08:37:04.550 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.543+0000 7f310ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:37:04.550 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.543+0000 7f325d92e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:37:04.550 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.543+0000 7f325d92e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:37:04.550 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.543+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bb6d670 con 0x55fe4bb50500 2024-09-22T08:37:04.551 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.544+0000 7f3258d63640 1 -- 172.21.15.142:0/2421614479 <== osd.1 v2:172.21.15.142:6816/3192108003 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'25 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f325003b040 con 0x55fe4bb50500 2024-09-22T08:37:04.551 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.544+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bb6dcc0 con 0x7f324c0a5040 2024-09-22T08:37:04.551 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.545+0000 7f3258d63640 1 -- 172.21.15.142:0/2421614479 <== osd.0 v2:172.21.15.31:6800/168281188 16 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'19 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f325003b040 con 0x7f324c0a5040 2024-09-22T08:37:04.551 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.545+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bb6e120 con 0x55fe4bb54ef0 2024-09-22T08:37:04.551 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.546+0000 7f3259d65640 1 -- 172.21.15.142:0/2421614479 <== osd.3 v2:172.21.15.142:6800/1064901393 16 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f325400a4d0 con 0x55fe4bb54ef0 2024-09-22T08:37:04.551 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.546+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bb6dfb0 con 0x55fe4bb50500 2024-09-22T08:37:04.551 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.547+0000 7f3258d63640 1 -- 172.21.15.142:0/2421614479 <== osd.1 v2:172.21.15.142:6816/3192108003 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'158 uv15 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f325003b040 con 0x55fe4bb50500 2024-09-22T08:37:04.551 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.547+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bb6e020 con 0x7f3254054c20 2024-09-22T08:37:04.552 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.548+0000 7f3259564640 1 -- 172.21.15.142:0/2421614479 <== osd.2 v2:172.21.15.142:6808/279438927 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'48 uv44 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f324c07f070 con 0x7f3254054c20 2024-09-22T08:37:04.552 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.548+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bb6e520 con 0x55fe4bb54ef0 2024-09-22T08:37:04.552 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.549+0000 7f3259d65640 1 -- 172.21.15.142:0/2421614479 <== osd.3 v2:172.21.15.142:6800/1064901393 17 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'31 uv10 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f325400a4d0 con 0x55fe4bb54ef0 2024-09-22T08:37:04.552 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.549+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bb6e520 con 0x55fe4bb50500 2024-09-22T08:37:04.552 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.551+0000 7f3258d63640 1 -- 172.21.15.142:0/2421614479 <== osd.1 v2:172.21.15.142:6816/3192108003 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f325003b040 con 0x55fe4bb50500 2024-09-22T08:37:04.552 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.551+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bb6e5b0 con 0x7f324c0a5040 2024-09-22T08:37:04.553 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.552+0000 7f3258d63640 1 -- 172.21.15.142:0/2421614479 <== osd.0 v2:172.21.15.31:6800/168281188 17 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'31 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f325003b040 con 0x7f324c0a5040 2024-09-22T08:37:04.553 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.552+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bb6e5b0 con 0x7f3254054c20 2024-09-22T08:37:04.555 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.554+0000 7f3259564640 1 -- 172.21.15.142:0/2421614479 <== osd.2 v2:172.21.15.142:6808/279438927 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f324c07f070 con 0x7f3254054c20 2024-09-22T08:37:04.555 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.554+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bb6eb60 con 0x55fe4bb54ef0 2024-09-22T08:37:04.555 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.554+0000 7f3259d65640 1 -- 172.21.15.142:0/2421614479 <== osd.3 v2:172.21.15.142:6800/1064901393 18 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'25 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f325400a4d0 con 0x55fe4bb54ef0 2024-09-22T08:37:04.556 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.555+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bb6eb20 con 0x7f3254054c20 2024-09-22T08:37:04.556 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.555+0000 7f3259564640 1 -- 172.21.15.142:0/2421614479 <== osd.2 v2:172.21.15.142:6808/279438927 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'49 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f324c07f070 con 0x7f3254054c20 2024-09-22T08:37:04.557 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.556+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bb6eaf0 con 0x7f324c0a5040 2024-09-22T08:37:04.558 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.557+0000 7f3258d63640 1 -- 172.21.15.142:0/2421614479 <== osd.0 v2:172.21.15.31:6800/168281188 18 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'21 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f325003b040 con 0x7f324c0a5040 2024-09-22T08:37:04.558 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.557+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bb6eaf0 con 0x7f3254054c20 2024-09-22T08:37:04.559 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.558+0000 7f3259564640 1 -- 172.21.15.142:0/2421614479 <== osd.2 v2:172.21.15.142:6808/279438927 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f324c07f070 con 0x7f3254054c20 2024-09-22T08:37:04.559 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.558+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bb6ea60 con 0x7f324c0a5040 2024-09-22T08:37:04.560 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.559+0000 7f3258d63640 1 -- 172.21.15.142:0/2421614479 <== osd.0 v2:172.21.15.31:6800/168281188 19 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'39 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f325003b040 con 0x7f324c0a5040 2024-09-22T08:37:04.560 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.559+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bb6ea60 con 0x55fe4bb50500 2024-09-22T08:37:04.561 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.560+0000 7f3258d63640 1 -- 172.21.15.142:0/2421614479 <== osd.1 v2:172.21.15.142:6816/3192108003 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'159 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f325003b040 con 0x55fe4bb50500 2024-09-22T08:37:04.561 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.560+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bb6eaa0 con 0x55fe4bb54ef0 2024-09-22T08:37:04.562 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.561+0000 7f3259d65640 1 -- 172.21.15.142:0/2421614479 <== osd.3 v2:172.21.15.142:6800/1064901393 19 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'41 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f325400a4d0 con 0x55fe4bb54ef0 2024-09-22T08:37:04.562 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.561+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bb6eaa0 con 0x7f3254054c20 2024-09-22T08:37:04.563 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.562+0000 7f3259564640 1 -- 172.21.15.142:0/2421614479 <== osd.2 v2:172.21.15.142:6808/279438927 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'50 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f324c07f070 con 0x7f3254054c20 2024-09-22T08:37:04.563 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.562+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bb6eaa0 con 0x55fe4bb54ef0 2024-09-22T08:37:04.564 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.563+0000 7f3259d65640 1 -- 172.21.15.142:0/2421614479 <== osd.3 v2:172.21.15.142:6800/1064901393 20 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'19 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f325400a4d0 con 0x55fe4bb54ef0 2024-09-22T08:37:04.564 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.563+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bb6eaa0 con 0x55fe4bb50500 2024-09-22T08:37:04.565 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.564+0000 7f3258d63640 1 -- 172.21.15.142:0/2421614479 <== osd.1 v2:172.21.15.142:6816/3192108003 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'27 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f325003b040 con 0x55fe4bb50500 2024-09-22T08:37:04.565 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.564+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bb6eaa0 con 0x55fe4bb50500 2024-09-22T08:37:04.566 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.565+0000 7f3258d63640 1 -- 172.21.15.142:0/2421614479 <== osd.1 v2:172.21.15.142:6816/3192108003 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'160 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f325003b040 con 0x55fe4bb50500 2024-09-22T08:37:04.566 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.565+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bb6eaa0 con 0x55fe4bb54ef0 2024-09-22T08:37:04.567 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.566+0000 7f3259d65640 1 -- 172.21.15.142:0/2421614479 <== osd.3 v2:172.21.15.142:6800/1064901393 21 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'42 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f325400a4d0 con 0x55fe4bb54ef0 2024-09-22T08:37:04.567 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.566+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bb6eaa0 con 0x7f3254054c20 2024-09-22T08:37:04.568 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.567+0000 7f3259564640 1 -- 172.21.15.142:0/2421614479 <== osd.2 v2:172.21.15.142:6808/279438927 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'29 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f324c07f070 con 0x7f3254054c20 2024-09-22T08:37:04.568 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.567+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bb6eaa0 con 0x55fe4bb54ef0 2024-09-22T08:37:04.569 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.568+0000 7f3259d65640 1 -- 172.21.15.142:0/2421614479 <== osd.3 v2:172.21.15.142:6800/1064901393 22 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'21 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f325400a4d0 con 0x55fe4bb54ef0 2024-09-22T08:37:04.569 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.568+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bb6eaa0 con 0x55fe4bb54ef0 2024-09-22T08:37:04.570 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.569+0000 7f3259d65640 1 -- 172.21.15.142:0/2421614479 <== osd.3 v2:172.21.15.142:6800/1064901393 23 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'25 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f325400a4d0 con 0x55fe4bb54ef0 2024-09-22T08:37:04.570 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.569+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bb6eaa0 con 0x55fe4bb54ef0 2024-09-22T08:37:04.571 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.570+0000 7f3259d65640 1 -- 172.21.15.142:0/2421614479 <== osd.3 v2:172.21.15.142:6800/1064901393 24 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f325400a4d0 con 0x55fe4bb54ef0 2024-09-22T08:37:04.571 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.570+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bb6eaa0 con 0x55fe4bb54ef0 2024-09-22T08:37:04.571 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.570+0000 7f3259d65640 1 -- 172.21.15.142:0/2421614479 <== osd.3 v2:172.21.15.142:6800/1064901393 25 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'32 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f325400a4d0 con 0x55fe4bb54ef0 2024-09-22T08:37:04.571 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.570+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bb6eaa0 con 0x7f324c0a5040 2024-09-22T08:37:04.573 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.572+0000 7f3258d63640 1 -- 172.21.15.142:0/2421614479 <== osd.0 v2:172.21.15.31:6800/168281188 20 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'21 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f325003b040 con 0x7f324c0a5040 2024-09-22T08:37:04.573 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.572+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bb6eaa0 con 0x55fe4bb54ef0 2024-09-22T08:37:04.573 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.572+0000 7f3259d65640 1 -- 172.21.15.142:0/2421614479 <== osd.3 v2:172.21.15.142:6800/1064901393 26 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f325400a4d0 con 0x55fe4bb54ef0 2024-09-22T08:37:04.574 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.572+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bb6eaa0 con 0x7f324c0a5040 2024-09-22T08:37:04.574 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.573+0000 7f3258d63640 1 -- 172.21.15.142:0/2421614479 <== osd.0 v2:172.21.15.31:6800/168281188 21 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'32 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f325003b040 con 0x7f324c0a5040 2024-09-22T08:37:04.575 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.574+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bb6eaa0 con 0x55fe4bb54ef0 2024-09-22T08:37:04.576 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.575+0000 7f3259d65640 1 -- 172.21.15.142:0/2421614479 <== osd.3 v2:172.21.15.142:6800/1064901393 27 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'43 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f325400a4d0 con 0x55fe4bb54ef0 2024-09-22T08:37:04.576 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.575+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bb6ead0 con 0x7f324c0a5040 2024-09-22T08:37:04.577 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.576+0000 7f3258d63640 1 -- 172.21.15.142:0/2421614479 <== osd.0 v2:172.21.15.31:6800/168281188 22 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'40 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f325003b040 con 0x7f324c0a5040 2024-09-22T08:37:04.577 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.576+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bb6f4a0 con 0x7f3254054c20 2024-09-22T08:37:04.578 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.577+0000 7f3259564640 1 -- 172.21.15.142:0/2421614479 <== osd.2 v2:172.21.15.142:6808/279438927 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'25 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f324c07f070 con 0x7f3254054c20 2024-09-22T08:37:04.579 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.577+0000 7f310efe5640 20 reqs_thread_entry: start 2024-09-22T08:37:04.579 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.577+0000 7f325d92e800 20 init_complete bucket index max shards: 11 2024-09-22T08:37:04.579 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.577+0000 7f325d92e800 20 Filter name: none 2024-09-22T08:37:04.579 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.577+0000 7f310cfe1640 20 reqs_thread_entry: start 2024-09-22T08:37:04.579 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.578+0000 7f325d92e800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=1 2024-09-22T08:37:04.579 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.578+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:94 6.1a 6:5909e671:gc::gc.27:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bb6b890 con 0x55fe4bb54ef0 2024-09-22T08:37:04.580 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.578+0000 7f3259d65640 1 -- 172.21.15.142:0/2421614479 <== osd.3 v2:172.21.15.142:6800/1064901393 28 ==== osd_op_reply(94 gc.27 [call] v32'20 uv20 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f325400a4d0 con 0x55fe4bb54ef0 2024-09-22T08:37:04.580 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.579+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:95 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bb6b890 con 0x55fe4bb54ef0 2024-09-22T08:37:04.581 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.579+0000 7f3259d65640 1 -- 172.21.15.142:0/2421614479 <== osd.3 v2:172.21.15.142:6800/1064901393 29 ==== osd_op_reply(95 gc.27 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f325400a4d0 con 0x55fe4bb54ef0 2024-09-22T08:37:04.581 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.579+0000 7f325d92e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:37:04.581 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.579+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:96 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bb6b890 con 0x55fe4bb54ef0 2024-09-22T08:37:04.581 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.579+0000 7f3259d65640 1 -- 172.21.15.142:0/2421614479 <== osd.3 v2:172.21.15.142:6800/1064901393 30 ==== osd_op_reply(96 gc.27 [call out=24b] v0'0 uv20 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f325400a4d0 con 0x55fe4bb54ef0 2024-09-22T08:37:04.581 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.579+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:97 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bb6b890 con 0x55fe4bb54ef0 2024-09-22T08:37:04.581 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.579+0000 7f3259d65640 1 -- 172.21.15.142:0/2421614479 <== osd.3 v2:172.21.15.142:6800/1064901393 31 ==== osd_op_reply(97 gc.27 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f325400a4d0 con 0x55fe4bb54ef0 2024-09-22T08:37:04.581 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.579+0000 7f325d92e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:37:04.581 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.579+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:98 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bb6b890 con 0x55fe4bb54ef0 2024-09-22T08:37:04.581 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.579+0000 7f3259d65640 1 -- 172.21.15.142:0/2421614479 <== osd.3 v2:172.21.15.142:6800/1064901393 32 ==== osd_op_reply(98 gc.27 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f325400a4d0 con 0x55fe4bb54ef0 2024-09-22T08:37:04.581 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.579+0000 7f325d92e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:37:04.581 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.579+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:99 6.1a 6:5909e671:gc::gc.27:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bb6b890 con 0x55fe4bb54ef0 2024-09-22T08:37:04.582 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.580+0000 7f3259d65640 1 -- 172.21.15.142:0/2421614479 <== osd.3 v2:172.21.15.142:6800/1064901393 33 ==== osd_op_reply(99 gc.27 [call] v32'21 uv21 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f325400a4d0 con 0x55fe4bb54ef0 2024-09-22T08:37:04.582 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.580+0000 7f325d92e800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=1 2024-09-22T08:37:04.582 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.580+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:100 6.1d 6:b88e3271:gc::gc.28:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bb6b890 con 0x7f324c0a5040 2024-09-22T08:37:04.584 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.582+0000 7f3258d63640 1 -- 172.21.15.142:0/2421614479 <== osd.0 v2:172.21.15.31:6800/168281188 23 ==== osd_op_reply(100 gc.28 [call] v32'33 uv33 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f325003b040 con 0x7f324c0a5040 2024-09-22T08:37:04.584 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.582+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:101 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bb6b890 con 0x7f324c0a5040 2024-09-22T08:37:04.584 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.582+0000 7f3258d63640 1 -- 172.21.15.142:0/2421614479 <== osd.0 v2:172.21.15.31:6800/168281188 24 ==== osd_op_reply(101 gc.28 [call out=15b] v0'0 uv33 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f325003b040 con 0x7f324c0a5040 2024-09-22T08:37:04.584 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.582+0000 7f325d92e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:37:04.584 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.582+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:102 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bb6b890 con 0x7f324c0a5040 2024-09-22T08:37:04.584 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.582+0000 7f3258d63640 1 -- 172.21.15.142:0/2421614479 <== osd.0 v2:172.21.15.31:6800/168281188 25 ==== osd_op_reply(102 gc.28 [call out=24b] v0'0 uv33 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f325003b040 con 0x7f324c0a5040 2024-09-22T08:37:04.584 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.582+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:103 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bb6b890 con 0x7f324c0a5040 2024-09-22T08:37:04.584 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.583+0000 7f3258d63640 1 -- 172.21.15.142:0/2421614479 <== osd.0 v2:172.21.15.31:6800/168281188 26 ==== osd_op_reply(103 gc.28 [call out=15b] v0'0 uv33 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f325003b040 con 0x7f324c0a5040 2024-09-22T08:37:04.584 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.583+0000 7f325d92e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:37:04.584 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.583+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:104 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bb6b890 con 0x7f324c0a5040 2024-09-22T08:37:04.585 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.583+0000 7f3258d63640 1 -- 172.21.15.142:0/2421614479 <== osd.0 v2:172.21.15.31:6800/168281188 27 ==== osd_op_reply(104 gc.28 [call out=15b] v0'0 uv33 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f325003b040 con 0x7f324c0a5040 2024-09-22T08:37:04.585 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.583+0000 7f325d92e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:37:04.585 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.583+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:105 6.1d 6:b88e3271:gc::gc.28:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bb6b890 con 0x7f324c0a5040 2024-09-22T08:37:04.585 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.584+0000 7f3258d63640 1 -- 172.21.15.142:0/2421614479 <== osd.0 v2:172.21.15.31:6800/168281188 28 ==== osd_op_reply(105 gc.28 [call] v32'34 uv34 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f325003b040 con 0x7f324c0a5040 2024-09-22T08:37:04.585 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.584+0000 7f325d92e800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=1 2024-09-22T08:37:04.586 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.584+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:106 6.7 6:e47c9322:gc::gc.29:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bb6b890 con 0x55fe4bb54ef0 2024-09-22T08:37:04.587 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.585+0000 7f3259d65640 1 -- 172.21.15.142:0/2421614479 <== osd.3 v2:172.21.15.142:6800/1064901393 34 ==== osd_op_reply(106 gc.29 [call] v32'44 uv44 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f325400a4d0 con 0x55fe4bb54ef0 2024-09-22T08:37:04.587 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.585+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:107 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bb6b890 con 0x55fe4bb54ef0 2024-09-22T08:37:04.588 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.586+0000 7f3259d65640 1 -- 172.21.15.142:0/2421614479 <== osd.3 v2:172.21.15.142:6800/1064901393 35 ==== osd_op_reply(107 gc.29 [call out=15b] v0'0 uv44 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f325400a4d0 con 0x55fe4bb54ef0 2024-09-22T08:37:04.588 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.586+0000 7f325d92e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:37:04.588 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.586+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:108 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bb6b890 con 0x55fe4bb54ef0 2024-09-22T08:37:04.588 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.586+0000 7f3259d65640 1 -- 172.21.15.142:0/2421614479 <== osd.3 v2:172.21.15.142:6800/1064901393 36 ==== osd_op_reply(108 gc.29 [call out=24b] v0'0 uv44 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f325400a4d0 con 0x55fe4bb54ef0 2024-09-22T08:37:04.588 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.586+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:109 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bb6b890 con 0x55fe4bb54ef0 2024-09-22T08:37:04.588 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.586+0000 7f3259d65640 1 -- 172.21.15.142:0/2421614479 <== osd.3 v2:172.21.15.142:6800/1064901393 37 ==== osd_op_reply(109 gc.29 [call out=15b] v0'0 uv44 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f325400a4d0 con 0x55fe4bb54ef0 2024-09-22T08:37:04.588 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.586+0000 7f325d92e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:37:04.588 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.586+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:110 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bb6b890 con 0x55fe4bb54ef0 2024-09-22T08:37:04.588 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.586+0000 7f3259d65640 1 -- 172.21.15.142:0/2421614479 <== osd.3 v2:172.21.15.142:6800/1064901393 38 ==== osd_op_reply(110 gc.29 [call out=15b] v0'0 uv44 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f325400a4d0 con 0x55fe4bb54ef0 2024-09-22T08:37:04.588 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.586+0000 7f325d92e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:37:04.588 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.586+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:111 6.7 6:e47c9322:gc::gc.29:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bb6b890 con 0x55fe4bb54ef0 2024-09-22T08:37:04.589 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.588+0000 7f3259d65640 1 -- 172.21.15.142:0/2421614479 <== osd.3 v2:172.21.15.142:6800/1064901393 39 ==== osd_op_reply(111 gc.29 [call] v32'45 uv45 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f325400a4d0 con 0x55fe4bb54ef0 2024-09-22T08:37:04.589 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.588+0000 7f325d92e800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=1 2024-09-22T08:37:04.589 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.588+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:112 6.0 6:013d6c33:gc::gc.30:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bb6b890 con 0x7f324c0a5040 2024-09-22T08:37:04.590 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.589+0000 7f3258d63640 1 -- 172.21.15.142:0/2421614479 <== osd.0 v2:172.21.15.31:6800/168281188 29 ==== osd_op_reply(112 gc.30 [call] v32'41 uv41 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f325003b040 con 0x7f324c0a5040 2024-09-22T08:37:04.590 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.589+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:113 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bb6b890 con 0x7f324c0a5040 2024-09-22T08:37:04.590 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.589+0000 7f3258d63640 1 -- 172.21.15.142:0/2421614479 <== osd.0 v2:172.21.15.31:6800/168281188 30 ==== osd_op_reply(113 gc.30 [call out=15b] v0'0 uv41 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f325003b040 con 0x7f324c0a5040 2024-09-22T08:37:04.590 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.589+0000 7f325d92e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:37:04.591 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.589+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:114 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bb6b890 con 0x7f324c0a5040 2024-09-22T08:37:04.591 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.589+0000 7f3258d63640 1 -- 172.21.15.142:0/2421614479 <== osd.0 v2:172.21.15.31:6800/168281188 31 ==== osd_op_reply(114 gc.30 [call out=24b] v0'0 uv41 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f325003b040 con 0x7f324c0a5040 2024-09-22T08:37:04.591 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.589+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:115 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bb6b890 con 0x7f324c0a5040 2024-09-22T08:37:04.596 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.590+0000 7f3258d63640 1 -- 172.21.15.142:0/2421614479 <== osd.0 v2:172.21.15.31:6800/168281188 32 ==== osd_op_reply(115 gc.30 [call out=15b] v0'0 uv41 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f325003b040 con 0x7f324c0a5040 2024-09-22T08:37:04.596 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.590+0000 7f325d92e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:37:04.596 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.590+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:116 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bb6b890 con 0x7f324c0a5040 2024-09-22T08:37:04.596 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.590+0000 7f3258d63640 1 -- 172.21.15.142:0/2421614479 <== osd.0 v2:172.21.15.31:6800/168281188 33 ==== osd_op_reply(116 gc.30 [call out=15b] v0'0 uv41 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f325003b040 con 0x7f324c0a5040 2024-09-22T08:37:04.596 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.590+0000 7f325d92e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:37:04.596 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.590+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:117 6.0 6:013d6c33:gc::gc.30:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bb6b890 con 0x7f324c0a5040 2024-09-22T08:37:04.596 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.591+0000 7f3258d63640 1 -- 172.21.15.142:0/2421614479 <== osd.0 v2:172.21.15.31:6800/168281188 34 ==== osd_op_reply(117 gc.30 [call] v32'42 uv42 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f325003b040 con 0x7f324c0a5040 2024-09-22T08:37:04.596 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.591+0000 7f325d92e800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=1 2024-09-22T08:37:04.596 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.591+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:118 6.f 6:f24cb4a8:gc::gc.31:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bb6b890 con 0x7f3254054c20 2024-09-22T08:37:04.596 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.592+0000 7f3259564640 1 -- 172.21.15.142:0/2421614479 <== osd.2 v2:172.21.15.142:6808/279438927 18 ==== osd_op_reply(118 gc.31 [call] v32'26 uv26 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f324c07f070 con 0x7f3254054c20 2024-09-22T08:37:04.596 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.592+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:119 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bb6b890 con 0x7f3254054c20 2024-09-22T08:37:04.596 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.592+0000 7f3259564640 1 -- 172.21.15.142:0/2421614479 <== osd.2 v2:172.21.15.142:6808/279438927 19 ==== osd_op_reply(119 gc.31 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f324c07f070 con 0x7f3254054c20 2024-09-22T08:37:04.597 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.592+0000 7f325d92e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:37:04.597 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.592+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:120 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bb6b890 con 0x7f3254054c20 2024-09-22T08:37:04.597 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.592+0000 7f3259564640 1 -- 172.21.15.142:0/2421614479 <== osd.2 v2:172.21.15.142:6808/279438927 20 ==== osd_op_reply(120 gc.31 [call out=24b] v0'0 uv26 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f324c07f070 con 0x7f3254054c20 2024-09-22T08:37:04.597 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.593+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:121 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bb6b890 con 0x7f3254054c20 2024-09-22T08:37:04.597 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.593+0000 7f3259564640 1 -- 172.21.15.142:0/2421614479 <== osd.2 v2:172.21.15.142:6808/279438927 21 ==== osd_op_reply(121 gc.31 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f324c07f070 con 0x7f3254054c20 2024-09-22T08:37:04.597 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.593+0000 7f325d92e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:37:04.597 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.593+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:122 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bb6b890 con 0x7f3254054c20 2024-09-22T08:37:04.597 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.593+0000 7f3259564640 1 -- 172.21.15.142:0/2421614479 <== osd.2 v2:172.21.15.142:6808/279438927 22 ==== osd_op_reply(122 gc.31 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f324c07f070 con 0x7f3254054c20 2024-09-22T08:37:04.597 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.593+0000 7f325d92e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:37:04.597 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.593+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:123 6.f 6:f24cb4a8:gc::gc.31:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bb6b890 con 0x7f3254054c20 2024-09-22T08:37:04.597 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.594+0000 7f3259564640 1 -- 172.21.15.142:0/2421614479 <== osd.2 v2:172.21.15.142:6808/279438927 23 ==== osd_op_reply(123 gc.31 [call] v32'27 uv27 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f324c07f070 con 0x7f3254054c20 2024-09-22T08:37:04.597 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.594+0000 7f325d92e800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=1 2024-09-22T08:37:04.597 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.594+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:124 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bb6b890 con 0x55fe4bb50500 2024-09-22T08:37:04.599 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.595+0000 7f3258d63640 1 -- 172.21.15.142:0/2421614479 <== osd.1 v2:172.21.15.142:6816/3192108003 28 ==== osd_op_reply(124 gc.0 [call] v32'26 uv26 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f325003b040 con 0x55fe4bb50500 2024-09-22T08:37:04.599 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.595+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:125 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bb6b890 con 0x55fe4bb50500 2024-09-22T08:37:04.599 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.595+0000 7f3258d63640 1 -- 172.21.15.142:0/2421614479 <== osd.1 v2:172.21.15.142:6816/3192108003 29 ==== osd_op_reply(125 gc.0 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f325003b040 con 0x55fe4bb50500 2024-09-22T08:37:04.599 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.595+0000 7f325d92e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:37:04.599 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.595+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:126 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bb6b890 con 0x55fe4bb50500 2024-09-22T08:37:04.599 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.596+0000 7f3258d63640 1 -- 172.21.15.142:0/2421614479 <== osd.1 v2:172.21.15.142:6816/3192108003 30 ==== osd_op_reply(126 gc.0 [call out=24b] v0'0 uv26 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f325003b040 con 0x55fe4bb50500 2024-09-22T08:37:04.600 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.596+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:127 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bb6b890 con 0x55fe4bb50500 2024-09-22T08:37:04.600 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.596+0000 7f3258d63640 1 -- 172.21.15.142:0/2421614479 <== osd.1 v2:172.21.15.142:6816/3192108003 31 ==== osd_op_reply(127 gc.0 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f325003b040 con 0x55fe4bb50500 2024-09-22T08:37:04.600 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.596+0000 7f325d92e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:37:04.600 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.596+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:128 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bb6b890 con 0x55fe4bb50500 2024-09-22T08:37:04.600 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.596+0000 7f3258d63640 1 -- 172.21.15.142:0/2421614479 <== osd.1 v2:172.21.15.142:6816/3192108003 32 ==== osd_op_reply(128 gc.0 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f325003b040 con 0x55fe4bb50500 2024-09-22T08:37:04.600 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.596+0000 7f325d92e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:37:04.600 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.596+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:129 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bb6b890 con 0x55fe4bb50500 2024-09-22T08:37:04.600 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.597+0000 7f3258d63640 1 -- 172.21.15.142:0/2421614479 <== osd.1 v2:172.21.15.142:6816/3192108003 33 ==== osd_op_reply(129 gc.0 [call] v32'27 uv27 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f325003b040 con 0x55fe4bb50500 2024-09-22T08:37:04.600 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.598+0000 7f325d92e800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=1 2024-09-22T08:37:04.600 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.598+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:130 6.18 6:1e85421f:gc::gc.1:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bb6b890 con 0x7f324c0a5040 2024-09-22T08:37:04.602 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.599+0000 7f3258d63640 1 -- 172.21.15.142:0/2421614479 <== osd.0 v2:172.21.15.31:6800/168281188 35 ==== osd_op_reply(130 gc.1 [call] v32'20 uv20 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f325003b040 con 0x7f324c0a5040 2024-09-22T08:37:04.602 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.599+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:131 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bb6b890 con 0x7f324c0a5040 2024-09-22T08:37:04.602 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.599+0000 7f3258d63640 1 -- 172.21.15.142:0/2421614479 <== osd.0 v2:172.21.15.31:6800/168281188 36 ==== osd_op_reply(131 gc.1 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f325003b040 con 0x7f324c0a5040 2024-09-22T08:37:04.602 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.599+0000 7f325d92e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:37:04.602 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.599+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:132 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bb6b890 con 0x7f324c0a5040 2024-09-22T08:37:04.602 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.599+0000 7f3258d63640 1 -- 172.21.15.142:0/2421614479 <== osd.0 v2:172.21.15.31:6800/168281188 37 ==== osd_op_reply(132 gc.1 [call out=24b] v0'0 uv20 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f325003b040 con 0x7f324c0a5040 2024-09-22T08:37:04.602 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.599+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:133 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bb6b890 con 0x7f324c0a5040 2024-09-22T08:37:04.602 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.599+0000 7f3258d63640 1 -- 172.21.15.142:0/2421614479 <== osd.0 v2:172.21.15.31:6800/168281188 38 ==== osd_op_reply(133 gc.1 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f325003b040 con 0x7f324c0a5040 2024-09-22T08:37:04.602 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.599+0000 7f325d92e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:37:04.602 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.599+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:134 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bb6b890 con 0x7f324c0a5040 2024-09-22T08:37:04.602 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.600+0000 7f3258d63640 1 -- 172.21.15.142:0/2421614479 <== osd.0 v2:172.21.15.31:6800/168281188 39 ==== osd_op_reply(134 gc.1 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f325003b040 con 0x7f324c0a5040 2024-09-22T08:37:04.602 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.600+0000 7f325d92e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:37:04.603 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.600+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:135 6.18 6:1e85421f:gc::gc.1:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bb6b890 con 0x7f324c0a5040 2024-09-22T08:37:04.604 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.601+0000 7f3258d63640 1 -- 172.21.15.142:0/2421614479 <== osd.0 v2:172.21.15.31:6800/168281188 40 ==== osd_op_reply(135 gc.1 [call] v32'21 uv21 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f325003b040 con 0x7f324c0a5040 2024-09-22T08:37:04.604 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.601+0000 7f325d92e800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=1 2024-09-22T08:37:04.604 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.601+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:136 6.b 6:d242335b:gc::gc.2:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bb6b890 con 0x55fe4bb54ef0 2024-09-22T08:37:04.604 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.602+0000 7f3259d65640 1 -- 172.21.15.142:0/2421614479 <== osd.3 v2:172.21.15.142:6800/1064901393 40 ==== osd_op_reply(136 gc.2 [call] v32'20 uv20 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f325400a4d0 con 0x55fe4bb54ef0 2024-09-22T08:37:04.604 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.602+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:137 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bb6b890 con 0x55fe4bb54ef0 2024-09-22T08:37:04.605 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.602+0000 7f3259d65640 1 -- 172.21.15.142:0/2421614479 <== osd.3 v2:172.21.15.142:6800/1064901393 41 ==== osd_op_reply(137 gc.2 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f325400a4d0 con 0x55fe4bb54ef0 2024-09-22T08:37:04.605 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.602+0000 7f325d92e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:37:04.605 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.602+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:138 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bb6b890 con 0x55fe4bb54ef0 2024-09-22T08:37:04.605 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.602+0000 7f3259d65640 1 -- 172.21.15.142:0/2421614479 <== osd.3 v2:172.21.15.142:6800/1064901393 42 ==== osd_op_reply(138 gc.2 [call out=24b] v0'0 uv20 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f325400a4d0 con 0x55fe4bb54ef0 2024-09-22T08:37:04.605 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.602+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:139 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bb6b890 con 0x55fe4bb54ef0 2024-09-22T08:37:04.605 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.603+0000 7f3259d65640 1 -- 172.21.15.142:0/2421614479 <== osd.3 v2:172.21.15.142:6800/1064901393 43 ==== osd_op_reply(139 gc.2 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f325400a4d0 con 0x55fe4bb54ef0 2024-09-22T08:37:04.605 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.603+0000 7f325d92e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:37:04.605 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.603+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:140 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bb6b890 con 0x55fe4bb54ef0 2024-09-22T08:37:04.605 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.603+0000 7f3259d65640 1 -- 172.21.15.142:0/2421614479 <== osd.3 v2:172.21.15.142:6800/1064901393 44 ==== osd_op_reply(140 gc.2 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f325400a4d0 con 0x55fe4bb54ef0 2024-09-22T08:37:04.605 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.603+0000 7f325d92e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:37:04.605 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.603+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:141 6.b 6:d242335b:gc::gc.2:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bb6b890 con 0x55fe4bb54ef0 2024-09-22T08:37:04.607 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.604+0000 7f3259d65640 1 -- 172.21.15.142:0/2421614479 <== osd.3 v2:172.21.15.142:6800/1064901393 45 ==== osd_op_reply(141 gc.2 [call] v32'21 uv21 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f325400a4d0 con 0x55fe4bb54ef0 2024-09-22T08:37:04.607 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.604+0000 7f325d92e800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=1 2024-09-22T08:37:04.607 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.604+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:142 6.4 6:2166d8e1:gc::gc.3:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bb6b890 con 0x55fe4bb50500 2024-09-22T08:37:04.607 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.605+0000 7f3258d63640 1 -- 172.21.15.142:0/2421614479 <== osd.1 v2:172.21.15.142:6816/3192108003 34 ==== osd_op_reply(142 gc.3 [call] v32'161 uv161 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f325003b040 con 0x55fe4bb50500 2024-09-22T08:37:04.607 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.605+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:143 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bb6b890 con 0x55fe4bb50500 2024-09-22T08:37:04.607 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.605+0000 7f3258d63640 1 -- 172.21.15.142:0/2421614479 <== osd.1 v2:172.21.15.142:6816/3192108003 35 ==== osd_op_reply(143 gc.3 [call out=15b] v0'0 uv161 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f325003b040 con 0x55fe4bb50500 2024-09-22T08:37:04.607 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.605+0000 7f325d92e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:37:04.607 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.605+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:144 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bb6b890 con 0x55fe4bb50500 2024-09-22T08:37:04.607 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.605+0000 7f3258d63640 1 -- 172.21.15.142:0/2421614479 <== osd.1 v2:172.21.15.142:6816/3192108003 36 ==== osd_op_reply(144 gc.3 [call out=24b] v0'0 uv161 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f325003b040 con 0x55fe4bb50500 2024-09-22T08:37:04.607 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.605+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:145 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bb6b890 con 0x55fe4bb50500 2024-09-22T08:37:04.608 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.605+0000 7f3258d63640 1 -- 172.21.15.142:0/2421614479 <== osd.1 v2:172.21.15.142:6816/3192108003 37 ==== osd_op_reply(145 gc.3 [call out=15b] v0'0 uv161 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f325003b040 con 0x55fe4bb50500 2024-09-22T08:37:04.608 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.606+0000 7f325d92e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:37:04.608 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.606+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:146 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bb6b890 con 0x55fe4bb50500 2024-09-22T08:37:04.608 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.606+0000 7f3258d63640 1 -- 172.21.15.142:0/2421614479 <== osd.1 v2:172.21.15.142:6816/3192108003 38 ==== osd_op_reply(146 gc.3 [call out=15b] v0'0 uv161 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f325003b040 con 0x55fe4bb50500 2024-09-22T08:37:04.608 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.606+0000 7f325d92e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:37:04.608 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.606+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:147 6.4 6:2166d8e1:gc::gc.3:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bb6b890 con 0x55fe4bb50500 2024-09-22T08:37:04.611 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.607+0000 7f3258d63640 1 -- 172.21.15.142:0/2421614479 <== osd.1 v2:172.21.15.142:6816/3192108003 39 ==== osd_op_reply(147 gc.3 [call] v32'162 uv162 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f325003b040 con 0x55fe4bb50500 2024-09-22T08:37:04.611 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.607+0000 7f325d92e800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=1 2024-09-22T08:37:04.611 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.607+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:148 6.3 6:c60da066:gc::gc.4:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bb6b890 con 0x7f3254054c20 2024-09-22T08:37:04.611 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.608+0000 7f3259564640 1 -- 172.21.15.142:0/2421614479 <== osd.2 v2:172.21.15.142:6808/279438927 24 ==== osd_op_reply(148 gc.4 [call] v32'51 uv51 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f324c07f070 con 0x7f3254054c20 2024-09-22T08:37:04.611 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.608+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:149 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bb6b890 con 0x7f3254054c20 2024-09-22T08:37:04.611 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.608+0000 7f3259564640 1 -- 172.21.15.142:0/2421614479 <== osd.2 v2:172.21.15.142:6808/279438927 25 ==== osd_op_reply(149 gc.4 [call out=15b] v0'0 uv51 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f324c07f070 con 0x7f3254054c20 2024-09-22T08:37:04.611 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.608+0000 7f325d92e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:37:04.611 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.608+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:150 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bb6b890 con 0x7f3254054c20 2024-09-22T08:37:04.611 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.608+0000 7f3259564640 1 -- 172.21.15.142:0/2421614479 <== osd.2 v2:172.21.15.142:6808/279438927 26 ==== osd_op_reply(150 gc.4 [call out=24b] v0'0 uv51 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f324c07f070 con 0x7f3254054c20 2024-09-22T08:37:04.611 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.608+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:151 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bb6b890 con 0x7f3254054c20 2024-09-22T08:37:04.611 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.608+0000 7f3259564640 1 -- 172.21.15.142:0/2421614479 <== osd.2 v2:172.21.15.142:6808/279438927 27 ==== osd_op_reply(151 gc.4 [call out=15b] v0'0 uv51 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f324c07f070 con 0x7f3254054c20 2024-09-22T08:37:04.611 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.608+0000 7f325d92e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:37:04.612 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.608+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:152 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bb6b890 con 0x7f3254054c20 2024-09-22T08:37:04.612 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.609+0000 7f3259564640 1 -- 172.21.15.142:0/2421614479 <== osd.2 v2:172.21.15.142:6808/279438927 28 ==== osd_op_reply(152 gc.4 [call out=1701b] v0'0 uv51 ondisk = 0) ==== 148+0+1701 (crc 0 0 0) 0x7f324c07f070 con 0x7f3254054c20 2024-09-22T08:37:04.612 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.609+0000 7f325d92e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-22T08:37:04.612 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.609+0000 7f325d92e800 20 garbage collection: RGWGC::process iterating over entry tag='e239248c-0bee-4e41-803a-24b288d3eb8f.4226.2852554931933460347', time=2024-09-22T08:37:04.251280+0000, chain.objs.size()=7 2024-09-22T08:37:04.612 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.609+0000 7f325d92e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1__shadow_.wi5xbGxXkIpIKDMhzzk54xjbDBcgsQ9_1 2024-09-22T08:37:04.612 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.609+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:153 3.34 3:2e588039:::e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1__shadow_.wi5xbGxXkIpIKDMhzzk54xjbDBcgsQ9_1:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bb9b830 con 0x55fe4bb50500 2024-09-22T08:37:04.612 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.609+0000 7f325d92e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1__shadow_.wi5xbGxXkIpIKDMhzzk54xjbDBcgsQ9_2 2024-09-22T08:37:04.612 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.609+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:154 3.29 3:976fcb6a:::e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1__shadow_.wi5xbGxXkIpIKDMhzzk54xjbDBcgsQ9_2:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bb9e4a0 con 0x7f324c0a5040 2024-09-22T08:37:04.612 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.609+0000 7f325d92e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1__shadow_.wi5xbGxXkIpIKDMhzzk54xjbDBcgsQ9_3 2024-09-22T08:37:04.612 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.609+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:155 3.4 3:21a50b1b:::e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1__shadow_.wi5xbGxXkIpIKDMhzzk54xjbDBcgsQ9_3:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bb9e4a0 con 0x7f324c0a5040 2024-09-22T08:37:04.612 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.609+0000 7f325d92e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1__shadow_.wi5xbGxXkIpIKDMhzzk54xjbDBcgsQ9_4 2024-09-22T08:37:04.612 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.609+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:156 3.24 3:243d940a:::e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1__shadow_.wi5xbGxXkIpIKDMhzzk54xjbDBcgsQ9_4:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bba34b0 con 0x7f324c0a5040 2024-09-22T08:37:04.612 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.609+0000 7f325d92e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1__shadow_.wi5xbGxXkIpIKDMhzzk54xjbDBcgsQ9_5 2024-09-22T08:37:04.612 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.609+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:157 3.16 3:68748170:::e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1__shadow_.wi5xbGxXkIpIKDMhzzk54xjbDBcgsQ9_5:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bba5de0 con 0x7f3254054c20 2024-09-22T08:37:04.613 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.609+0000 7f325d92e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1__shadow_.wi5xbGxXkIpIKDMhzzk54xjbDBcgsQ9_6 2024-09-22T08:37:04.613 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.609+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:158 3.1f 3:faf7a904:::e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1__shadow_.wi5xbGxXkIpIKDMhzzk54xjbDBcgsQ9_6:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bba8650 con 0x55fe4bb50500 2024-09-22T08:37:04.613 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.609+0000 7f325d92e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1__shadow_.wi5xbGxXkIpIKDMhzzk54xjbDBcgsQ9_7 2024-09-22T08:37:04.613 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.609+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:159 3.21 3:864d42af:::e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1__shadow_.wi5xbGxXkIpIKDMhzzk54xjbDBcgsQ9_7:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bbaaec0 con 0x7f324c0a5040 2024-09-22T08:37:04.614 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.611+0000 7f3258d63640 1 -- 172.21.15.142:0/2421614479 <== osd.0 v2:172.21.15.31:6800/168281188 41 ==== osd_op_reply(159 e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1__shadow_.wi5xbGxXkIpIKDMhzzk54xjbDBcgsQ9_7 [call] v32'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7f325003b040 con 0x7f324c0a5040 2024-09-22T08:37:04.614 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.611+0000 7f3258d63640 1 -- 172.21.15.142:0/2421614479 <== osd.1 v2:172.21.15.142:6816/3192108003 40 ==== osd_op_reply(158 e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1__shadow_.wi5xbGxXkIpIKDMhzzk54xjbDBcgsQ9_6 [call] v32'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7f325003b040 con 0x55fe4bb50500 2024-09-22T08:37:04.614 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.612+0000 7f3258d63640 1 -- 172.21.15.142:0/2421614479 <== osd.0 v2:172.21.15.31:6800/168281188 42 ==== osd_op_reply(154 e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1__shadow_.wi5xbGxXkIpIKDMhzzk54xjbDBcgsQ9_2 [call] v32'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7f325003b040 con 0x7f324c0a5040 2024-09-22T08:37:04.614 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.612+0000 7f3259564640 1 -- 172.21.15.142:0/2421614479 <== osd.2 v2:172.21.15.142:6808/279438927 29 ==== osd_op_reply(157 e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1__shadow_.wi5xbGxXkIpIKDMhzzk54xjbDBcgsQ9_5 [call] v32'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7f324c07f070 con 0x7f3254054c20 2024-09-22T08:37:04.614 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.612+0000 7f3258d63640 1 -- 172.21.15.142:0/2421614479 <== osd.1 v2:172.21.15.142:6816/3192108003 41 ==== osd_op_reply(153 e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1__shadow_.wi5xbGxXkIpIKDMhzzk54xjbDBcgsQ9_1 [call] v32'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7f325003b040 con 0x55fe4bb50500 2024-09-22T08:37:04.614 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.613+0000 7f3258d63640 1 -- 172.21.15.142:0/2421614479 <== osd.0 v2:172.21.15.31:6800/168281188 43 ==== osd_op_reply(155 e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1__shadow_.wi5xbGxXkIpIKDMhzzk54xjbDBcgsQ9_3 [call] v32'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7f325003b040 con 0x7f324c0a5040 2024-09-22T08:37:04.614 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.613+0000 7f3258d63640 1 -- 172.21.15.142:0/2421614479 <== osd.0 v2:172.21.15.31:6800/168281188 44 ==== osd_op_reply(156 e239248c-0bee-4e41-803a-24b288d3eb8f.4226.1__shadow_.wi5xbGxXkIpIKDMhzzk54xjbDBcgsQ9_4 [call] v32'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7f325003b040 con 0x7f324c0a5040 2024-09-22T08:37:04.614 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.613+0000 7f325d92e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T08:37:04.614 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.613+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:160 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_remove_entries in=47b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bb99240 con 0x7f3254054c20 2024-09-22T08:37:04.615 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.614+0000 7f3259564640 1 -- 172.21.15.142:0/2421614479 <== osd.2 v2:172.21.15.142:6808/279438927 30 ==== osd_op_reply(160 gc.4 [call] v32'52 uv52 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f324c07f070 con 0x7f3254054c20 2024-09-22T08:37:04.615 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.614+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:161 6.3 6:c60da066:gc::gc.4:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bb99240 con 0x7f3254054c20 2024-09-22T08:37:04.616 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.615+0000 7f3259564640 1 -- 172.21.15.142:0/2421614479 <== osd.2 v2:172.21.15.142:6808/279438927 31 ==== osd_op_reply(161 gc.4 [call] v32'53 uv53 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f324c07f070 con 0x7f3254054c20 2024-09-22T08:37:04.616 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.615+0000 7f325d92e800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=1 2024-09-22T08:37:04.616 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.615+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:162 6.9 6:954be8d2:gc::gc.5:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bb99240 con 0x55fe4bb54ef0 2024-09-22T08:37:04.618 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.616+0000 7f3259d65640 1 -- 172.21.15.142:0/2421614479 <== osd.3 v2:172.21.15.142:6800/1064901393 46 ==== osd_op_reply(162 gc.5 [call] v32'33 uv33 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f325400a4d0 con 0x55fe4bb54ef0 2024-09-22T08:37:04.618 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.616+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:163 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bb99240 con 0x55fe4bb54ef0 2024-09-22T08:37:04.618 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.616+0000 7f3259d65640 1 -- 172.21.15.142:0/2421614479 <== osd.3 v2:172.21.15.142:6800/1064901393 47 ==== osd_op_reply(163 gc.5 [call out=15b] v0'0 uv33 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f325400a4d0 con 0x55fe4bb54ef0 2024-09-22T08:37:04.618 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.616+0000 7f325d92e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:37:04.618 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.616+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:164 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bba4db0 con 0x55fe4bb54ef0 2024-09-22T08:37:04.618 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.616+0000 7f3259d65640 1 -- 172.21.15.142:0/2421614479 <== osd.3 v2:172.21.15.142:6800/1064901393 48 ==== osd_op_reply(164 gc.5 [call out=24b] v0'0 uv33 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f325400a4d0 con 0x55fe4bb54ef0 2024-09-22T08:37:04.618 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.616+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:165 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bb99240 con 0x55fe4bb54ef0 2024-09-22T08:37:04.618 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.617+0000 7f3259d65640 1 -- 172.21.15.142:0/2421614479 <== osd.3 v2:172.21.15.142:6800/1064901393 49 ==== osd_op_reply(165 gc.5 [call out=15b] v0'0 uv33 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f325400a4d0 con 0x55fe4bb54ef0 2024-09-22T08:37:04.618 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.617+0000 7f325d92e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:37:04.618 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.617+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:166 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bb99240 con 0x55fe4bb54ef0 2024-09-22T08:37:04.619 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.617+0000 7f3259d65640 1 -- 172.21.15.142:0/2421614479 <== osd.3 v2:172.21.15.142:6800/1064901393 50 ==== osd_op_reply(166 gc.5 [call out=15b] v0'0 uv33 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f325400a4d0 con 0x55fe4bb54ef0 2024-09-22T08:37:04.619 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.617+0000 7f325d92e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:37:04.619 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.617+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:167 6.9 6:954be8d2:gc::gc.5:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bb99240 con 0x55fe4bb54ef0 2024-09-22T08:37:04.619 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.618+0000 7f3259d65640 1 -- 172.21.15.142:0/2421614479 <== osd.3 v2:172.21.15.142:6800/1064901393 51 ==== osd_op_reply(167 gc.5 [call] v32'34 uv34 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f325400a4d0 con 0x55fe4bb54ef0 2024-09-22T08:37:04.619 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.618+0000 7f325d92e800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=1 2024-09-22T08:37:04.619 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.618+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:168 6.e 6:748722ff:gc::gc.6:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bb99240 con 0x55fe4bb50500 2024-09-22T08:37:04.621 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.619+0000 7f3258d63640 1 -- 172.21.15.142:0/2421614479 <== osd.1 v2:172.21.15.142:6816/3192108003 42 ==== osd_op_reply(168 gc.6 [call] v32'22 uv22 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f325003b040 con 0x55fe4bb50500 2024-09-22T08:37:04.621 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.619+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:169 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bb99240 con 0x55fe4bb50500 2024-09-22T08:37:04.621 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.620+0000 7f3258d63640 1 -- 172.21.15.142:0/2421614479 <== osd.1 v2:172.21.15.142:6816/3192108003 43 ==== osd_op_reply(169 gc.6 [call out=15b] v0'0 uv22 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f325003b040 con 0x55fe4bb50500 2024-09-22T08:37:04.622 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.620+0000 7f325d92e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:37:04.622 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.620+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:170 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bb99240 con 0x55fe4bb50500 2024-09-22T08:37:04.622 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.620+0000 7f3258d63640 1 -- 172.21.15.142:0/2421614479 <== osd.1 v2:172.21.15.142:6816/3192108003 44 ==== osd_op_reply(170 gc.6 [call out=24b] v0'0 uv22 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f325003b040 con 0x55fe4bb50500 2024-09-22T08:37:04.622 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.620+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:171 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bb99240 con 0x55fe4bb50500 2024-09-22T08:37:04.622 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.620+0000 7f3258d63640 1 -- 172.21.15.142:0/2421614479 <== osd.1 v2:172.21.15.142:6816/3192108003 45 ==== osd_op_reply(171 gc.6 [call out=15b] v0'0 uv22 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f325003b040 con 0x55fe4bb50500 2024-09-22T08:37:04.622 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.620+0000 7f325d92e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:37:04.622 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.620+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:172 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bba3850 con 0x55fe4bb50500 2024-09-22T08:37:04.622 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.620+0000 7f3258d63640 1 -- 172.21.15.142:0/2421614479 <== osd.1 v2:172.21.15.142:6816/3192108003 46 ==== osd_op_reply(172 gc.6 [call out=15b] v0'0 uv22 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f325003b040 con 0x55fe4bb50500 2024-09-22T08:37:04.622 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.620+0000 7f325d92e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:37:04.622 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.620+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:173 6.e 6:748722ff:gc::gc.6:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bba3850 con 0x55fe4bb50500 2024-09-22T08:37:04.623 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.622+0000 7f3258d63640 1 -- 172.21.15.142:0/2421614479 <== osd.1 v2:172.21.15.142:6816/3192108003 47 ==== osd_op_reply(173 gc.6 [call] v32'23 uv23 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f325003b040 con 0x55fe4bb50500 2024-09-22T08:37:04.624 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.622+0000 7f325d92e800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=1 2024-09-22T08:37:04.624 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.622+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:174 6.1d 6:beaa4be4:gc::gc.7:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bba3850 con 0x7f324c0a5040 2024-09-22T08:37:04.625 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.624+0000 7f3258d63640 1 -- 172.21.15.142:0/2421614479 <== osd.0 v2:172.21.15.31:6800/168281188 45 ==== osd_op_reply(174 gc.7 [call] v32'35 uv35 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f325003b040 con 0x7f324c0a5040 2024-09-22T08:37:04.625 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.624+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:175 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bba3850 con 0x7f324c0a5040 2024-09-22T08:37:04.626 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.624+0000 7f3258d63640 1 -- 172.21.15.142:0/2421614479 <== osd.0 v2:172.21.15.31:6800/168281188 46 ==== osd_op_reply(175 gc.7 [call out=15b] v0'0 uv35 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f325003b040 con 0x7f324c0a5040 2024-09-22T08:37:04.626 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.624+0000 7f325d92e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:37:04.626 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.624+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:176 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bba3850 con 0x7f324c0a5040 2024-09-22T08:37:04.626 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.624+0000 7f3258d63640 1 -- 172.21.15.142:0/2421614479 <== osd.0 v2:172.21.15.31:6800/168281188 47 ==== osd_op_reply(176 gc.7 [call out=24b] v0'0 uv35 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f325003b040 con 0x7f324c0a5040 2024-09-22T08:37:04.626 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.624+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:177 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bba3850 con 0x7f324c0a5040 2024-09-22T08:37:04.626 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.625+0000 7f3258d63640 1 -- 172.21.15.142:0/2421614479 <== osd.0 v2:172.21.15.31:6800/168281188 48 ==== osd_op_reply(177 gc.7 [call out=15b] v0'0 uv35 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f325003b040 con 0x7f324c0a5040 2024-09-22T08:37:04.626 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.625+0000 7f325d92e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:37:04.626 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.625+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:178 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bba3850 con 0x7f324c0a5040 2024-09-22T08:37:04.627 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.625+0000 7f3258d63640 1 -- 172.21.15.142:0/2421614479 <== osd.0 v2:172.21.15.31:6800/168281188 49 ==== osd_op_reply(178 gc.7 [call out=15b] v0'0 uv35 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f325003b040 con 0x7f324c0a5040 2024-09-22T08:37:04.627 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.625+0000 7f325d92e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:37:04.627 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.625+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:179 6.1d 6:beaa4be4:gc::gc.7:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bba3850 con 0x7f324c0a5040 2024-09-22T08:37:04.627 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.626+0000 7f3258d63640 1 -- 172.21.15.142:0/2421614479 <== osd.0 v2:172.21.15.31:6800/168281188 50 ==== osd_op_reply(179 gc.7 [call] v32'36 uv36 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f325003b040 con 0x7f324c0a5040 2024-09-22T08:37:04.627 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.626+0000 7f325d92e800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=1 2024-09-22T08:37:04.627 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.626+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:180 6.12 6:4f78e9a2:gc::gc.8:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bba3850 con 0x7f3254054c20 2024-09-22T08:37:04.629 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.627+0000 7f3259564640 1 -- 172.21.15.142:0/2421614479 <== osd.2 v2:172.21.15.142:6808/279438927 32 ==== osd_op_reply(180 gc.8 [call] v32'20 uv20 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f324c07f070 con 0x7f3254054c20 2024-09-22T08:37:04.629 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.627+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:181 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bba3850 con 0x7f3254054c20 2024-09-22T08:37:04.630 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.628+0000 7f3259564640 1 -- 172.21.15.142:0/2421614479 <== osd.2 v2:172.21.15.142:6808/279438927 33 ==== osd_op_reply(181 gc.8 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f324c07f070 con 0x7f3254054c20 2024-09-22T08:37:04.630 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.628+0000 7f325d92e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:37:04.630 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.628+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:182 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bba3850 con 0x7f3254054c20 2024-09-22T08:37:04.630 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.628+0000 7f3259564640 1 -- 172.21.15.142:0/2421614479 <== osd.2 v2:172.21.15.142:6808/279438927 34 ==== osd_op_reply(182 gc.8 [call out=24b] v0'0 uv20 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f324c07f070 con 0x7f3254054c20 2024-09-22T08:37:04.630 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.628+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:183 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bba3850 con 0x7f3254054c20 2024-09-22T08:37:04.630 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.628+0000 7f3259564640 1 -- 172.21.15.142:0/2421614479 <== osd.2 v2:172.21.15.142:6808/279438927 35 ==== osd_op_reply(183 gc.8 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f324c07f070 con 0x7f3254054c20 2024-09-22T08:37:04.630 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.628+0000 7f325d92e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:37:04.630 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.628+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:184 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bba3850 con 0x7f3254054c20 2024-09-22T08:37:04.630 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.628+0000 7f3259564640 1 -- 172.21.15.142:0/2421614479 <== osd.2 v2:172.21.15.142:6808/279438927 36 ==== osd_op_reply(184 gc.8 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f324c07f070 con 0x7f3254054c20 2024-09-22T08:37:04.630 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.628+0000 7f325d92e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:37:04.630 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.628+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:185 6.12 6:4f78e9a2:gc::gc.8:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bba3850 con 0x7f3254054c20 2024-09-22T08:37:04.631 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.629+0000 7f3259564640 1 -- 172.21.15.142:0/2421614479 <== osd.2 v2:172.21.15.142:6808/279438927 37 ==== osd_op_reply(185 gc.8 [call] v32'21 uv21 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f324c07f070 con 0x7f3254054c20 2024-09-22T08:37:04.631 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.629+0000 7f325d92e800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=1 2024-09-22T08:37:04.631 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.629+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:186 6.1c 6:3e426232:gc::gc.9:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bba3850 con 0x55fe4bb54ef0 2024-09-22T08:37:04.631 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.630+0000 7f3259d65640 1 -- 172.21.15.142:0/2421614479 <== osd.3 v2:172.21.15.142:6800/1064901393 52 ==== osd_op_reply(186 gc.9 [call] v32'26 uv26 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f325400a4d0 con 0x55fe4bb54ef0 2024-09-22T08:37:04.631 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.630+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:187 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bba3850 con 0x55fe4bb54ef0 2024-09-22T08:37:04.632 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.630+0000 7f3259d65640 1 -- 172.21.15.142:0/2421614479 <== osd.3 v2:172.21.15.142:6800/1064901393 53 ==== osd_op_reply(187 gc.9 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f325400a4d0 con 0x55fe4bb54ef0 2024-09-22T08:37:04.633 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.630+0000 7f325d92e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:37:04.633 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.631+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:188 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bba3850 con 0x55fe4bb54ef0 2024-09-22T08:37:04.633 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.631+0000 7f3259d65640 1 -- 172.21.15.142:0/2421614479 <== osd.3 v2:172.21.15.142:6800/1064901393 54 ==== osd_op_reply(188 gc.9 [call out=24b] v0'0 uv26 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f325400a4d0 con 0x55fe4bb54ef0 2024-09-22T08:37:04.633 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.631+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:189 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bba3850 con 0x55fe4bb54ef0 2024-09-22T08:37:04.633 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.631+0000 7f3259d65640 1 -- 172.21.15.142:0/2421614479 <== osd.3 v2:172.21.15.142:6800/1064901393 55 ==== osd_op_reply(189 gc.9 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f325400a4d0 con 0x55fe4bb54ef0 2024-09-22T08:37:04.633 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.631+0000 7f325d92e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:37:04.633 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.631+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:190 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bba3850 con 0x55fe4bb54ef0 2024-09-22T08:37:04.633 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.631+0000 7f3259d65640 1 -- 172.21.15.142:0/2421614479 <== osd.3 v2:172.21.15.142:6800/1064901393 56 ==== osd_op_reply(190 gc.9 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f325400a4d0 con 0x55fe4bb54ef0 2024-09-22T08:37:04.633 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.631+0000 7f325d92e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:37:04.633 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.631+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:191 6.1c 6:3e426232:gc::gc.9:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bba3850 con 0x55fe4bb54ef0 2024-09-22T08:37:04.634 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.632+0000 7f3259d65640 1 -- 172.21.15.142:0/2421614479 <== osd.3 v2:172.21.15.142:6800/1064901393 57 ==== osd_op_reply(191 gc.9 [call] v32'27 uv27 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f325400a4d0 con 0x55fe4bb54ef0 2024-09-22T08:37:04.634 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.632+0000 7f325d92e800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=1 2024-09-22T08:37:04.634 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.632+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:192 6.3 6:c31f41d7:gc::gc.10:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bba3850 con 0x7f3254054c20 2024-09-22T08:37:04.635 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.633+0000 7f3259564640 1 -- 172.21.15.142:0/2421614479 <== osd.2 v2:172.21.15.142:6808/279438927 38 ==== osd_op_reply(192 gc.10 [call] v32'54 uv54 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f324c07f070 con 0x7f3254054c20 2024-09-22T08:37:04.635 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.633+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:193 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bba3850 con 0x7f3254054c20 2024-09-22T08:37:04.635 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.633+0000 7f3259564640 1 -- 172.21.15.142:0/2421614479 <== osd.2 v2:172.21.15.142:6808/279438927 39 ==== osd_op_reply(193 gc.10 [call out=15b] v0'0 uv54 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f324c07f070 con 0x7f3254054c20 2024-09-22T08:37:04.636 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.633+0000 7f325d92e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:37:04.636 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.633+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:194 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bba3850 con 0x7f3254054c20 2024-09-22T08:37:04.636 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.634+0000 7f3259564640 1 -- 172.21.15.142:0/2421614479 <== osd.2 v2:172.21.15.142:6808/279438927 40 ==== osd_op_reply(194 gc.10 [call out=24b] v0'0 uv54 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f324c07f070 con 0x7f3254054c20 2024-09-22T08:37:04.636 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.634+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:195 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bba3850 con 0x7f3254054c20 2024-09-22T08:37:04.636 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.634+0000 7f3259564640 1 -- 172.21.15.142:0/2421614479 <== osd.2 v2:172.21.15.142:6808/279438927 41 ==== osd_op_reply(195 gc.10 [call out=15b] v0'0 uv54 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f324c07f070 con 0x7f3254054c20 2024-09-22T08:37:04.636 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.634+0000 7f325d92e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:37:04.636 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.634+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:196 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bba3850 con 0x7f3254054c20 2024-09-22T08:37:04.636 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.634+0000 7f3259564640 1 -- 172.21.15.142:0/2421614479 <== osd.2 v2:172.21.15.142:6808/279438927 42 ==== osd_op_reply(196 gc.10 [call out=15b] v0'0 uv54 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f324c07f070 con 0x7f3254054c20 2024-09-22T08:37:04.636 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.634+0000 7f325d92e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:37:04.636 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.634+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:197 6.3 6:c31f41d7:gc::gc.10:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bba3850 con 0x7f3254054c20 2024-09-22T08:37:04.637 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.635+0000 7f3259564640 1 -- 172.21.15.142:0/2421614479 <== osd.2 v2:172.21.15.142:6808/279438927 43 ==== osd_op_reply(197 gc.10 [call] v32'55 uv55 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f324c07f070 con 0x7f3254054c20 2024-09-22T08:37:04.637 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.635+0000 7f325d92e800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=1 2024-09-22T08:37:04.637 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.635+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:198 6.13 6:c8333aab:gc::gc.11:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bba3850 con 0x7f324c0a5040 2024-09-22T08:37:04.637 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.636+0000 7f3258d63640 1 -- 172.21.15.142:0/2421614479 <== osd.0 v2:172.21.15.31:6800/168281188 51 ==== osd_op_reply(198 gc.11 [call] v32'22 uv22 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f325003b040 con 0x7f324c0a5040 2024-09-22T08:37:04.638 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.636+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:199 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bba3850 con 0x7f324c0a5040 2024-09-22T08:37:04.638 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.636+0000 7f3258d63640 1 -- 172.21.15.142:0/2421614479 <== osd.0 v2:172.21.15.31:6800/168281188 52 ==== osd_op_reply(199 gc.11 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f325003b040 con 0x7f324c0a5040 2024-09-22T08:37:04.638 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.636+0000 7f325d92e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:37:04.638 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.636+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:200 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bba3850 con 0x7f324c0a5040 2024-09-22T08:37:04.639 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.637+0000 7f3258d63640 1 -- 172.21.15.142:0/2421614479 <== osd.0 v2:172.21.15.31:6800/168281188 53 ==== osd_op_reply(200 gc.11 [call out=24b] v0'0 uv22 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f325003b040 con 0x7f324c0a5040 2024-09-22T08:37:04.639 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.637+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:201 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bba3850 con 0x7f324c0a5040 2024-09-22T08:37:04.639 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.637+0000 7f3258d63640 1 -- 172.21.15.142:0/2421614479 <== osd.0 v2:172.21.15.31:6800/168281188 54 ==== osd_op_reply(201 gc.11 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f325003b040 con 0x7f324c0a5040 2024-09-22T08:37:04.639 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.637+0000 7f325d92e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:37:04.639 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.637+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:202 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bba3850 con 0x7f324c0a5040 2024-09-22T08:37:04.639 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.637+0000 7f3258d63640 1 -- 172.21.15.142:0/2421614479 <== osd.0 v2:172.21.15.31:6800/168281188 55 ==== osd_op_reply(202 gc.11 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f325003b040 con 0x7f324c0a5040 2024-09-22T08:37:04.640 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.637+0000 7f325d92e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:37:04.640 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.637+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:203 6.13 6:c8333aab:gc::gc.11:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bba3850 con 0x7f324c0a5040 2024-09-22T08:37:04.640 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.638+0000 7f3258d63640 1 -- 172.21.15.142:0/2421614479 <== osd.0 v2:172.21.15.31:6800/168281188 56 ==== osd_op_reply(203 gc.11 [call] v32'23 uv23 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f325003b040 con 0x7f324c0a5040 2024-09-22T08:37:04.640 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.638+0000 7f325d92e800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=1 2024-09-22T08:37:04.640 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.638+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:204 6.15 6:ab569f81:gc::gc.12:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bba3850 con 0x7f3254054c20 2024-09-22T08:37:04.641 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.639+0000 7f3259564640 1 -- 172.21.15.142:0/2421614479 <== osd.2 v2:172.21.15.142:6808/279438927 44 ==== osd_op_reply(204 gc.12 [call] v32'20 uv20 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f324c07f070 con 0x7f3254054c20 2024-09-22T08:37:04.641 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.639+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:205 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bba3850 con 0x7f3254054c20 2024-09-22T08:37:04.641 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.639+0000 7f3259564640 1 -- 172.21.15.142:0/2421614479 <== osd.2 v2:172.21.15.142:6808/279438927 45 ==== osd_op_reply(205 gc.12 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f324c07f070 con 0x7f3254054c20 2024-09-22T08:37:04.641 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.639+0000 7f325d92e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:37:04.642 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.639+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:206 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bba3850 con 0x7f3254054c20 2024-09-22T08:37:04.642 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.639+0000 7f3259564640 1 -- 172.21.15.142:0/2421614479 <== osd.2 v2:172.21.15.142:6808/279438927 46 ==== osd_op_reply(206 gc.12 [call out=24b] v0'0 uv20 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f324c07f070 con 0x7f3254054c20 2024-09-22T08:37:04.642 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.639+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:207 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bba3850 con 0x7f3254054c20 2024-09-22T08:37:04.642 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.640+0000 7f3259564640 1 -- 172.21.15.142:0/2421614479 <== osd.2 v2:172.21.15.142:6808/279438927 47 ==== osd_op_reply(207 gc.12 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f324c07f070 con 0x7f3254054c20 2024-09-22T08:37:04.642 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.640+0000 7f325d92e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:37:04.642 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.640+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:208 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bba3850 con 0x7f3254054c20 2024-09-22T08:37:04.642 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.640+0000 7f3259564640 1 -- 172.21.15.142:0/2421614479 <== osd.2 v2:172.21.15.142:6808/279438927 48 ==== osd_op_reply(208 gc.12 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f324c07f070 con 0x7f3254054c20 2024-09-22T08:37:04.642 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.640+0000 7f325d92e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:37:04.642 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.640+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:209 6.15 6:ab569f81:gc::gc.12:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bba3850 con 0x7f3254054c20 2024-09-22T08:37:04.643 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.641+0000 7f3259564640 1 -- 172.21.15.142:0/2421614479 <== osd.2 v2:172.21.15.142:6808/279438927 49 ==== osd_op_reply(209 gc.12 [call] v32'21 uv21 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f324c07f070 con 0x7f3254054c20 2024-09-22T08:37:04.643 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.641+0000 7f325d92e800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=1 2024-09-22T08:37:04.643 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.641+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:210 6.0 6:0667bb13:gc::gc.13:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bba3850 con 0x7f324c0a5040 2024-09-22T08:37:04.643 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.642+0000 7f3258d63640 1 -- 172.21.15.142:0/2421614479 <== osd.0 v2:172.21.15.31:6800/168281188 57 ==== osd_op_reply(210 gc.13 [call] v32'43 uv43 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f325003b040 con 0x7f324c0a5040 2024-09-22T08:37:04.643 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.642+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:211 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bba3850 con 0x7f324c0a5040 2024-09-22T08:37:04.644 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.642+0000 7f3258d63640 1 -- 172.21.15.142:0/2421614479 <== osd.0 v2:172.21.15.31:6800/168281188 58 ==== osd_op_reply(211 gc.13 [call out=15b] v0'0 uv43 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f325003b040 con 0x7f324c0a5040 2024-09-22T08:37:04.644 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.642+0000 7f325d92e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:37:04.644 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.642+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:212 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bba3850 con 0x7f324c0a5040 2024-09-22T08:37:04.645 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.643+0000 7f3258d63640 1 -- 172.21.15.142:0/2421614479 <== osd.0 v2:172.21.15.31:6800/168281188 59 ==== osd_op_reply(212 gc.13 [call out=24b] v0'0 uv43 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f325003b040 con 0x7f324c0a5040 2024-09-22T08:37:04.645 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.643+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:213 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bba3850 con 0x7f324c0a5040 2024-09-22T08:37:04.645 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.643+0000 7f3258d63640 1 -- 172.21.15.142:0/2421614479 <== osd.0 v2:172.21.15.31:6800/168281188 60 ==== osd_op_reply(213 gc.13 [call out=15b] v0'0 uv43 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f325003b040 con 0x7f324c0a5040 2024-09-22T08:37:04.645 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.643+0000 7f325d92e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:37:04.645 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.643+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:214 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bba3850 con 0x7f324c0a5040 2024-09-22T08:37:04.645 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.643+0000 7f3258d63640 1 -- 172.21.15.142:0/2421614479 <== osd.0 v2:172.21.15.31:6800/168281188 61 ==== osd_op_reply(214 gc.13 [call out=15b] v0'0 uv43 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f325003b040 con 0x7f324c0a5040 2024-09-22T08:37:04.645 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.643+0000 7f325d92e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:37:04.645 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.643+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:215 6.0 6:0667bb13:gc::gc.13:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bba3850 con 0x7f324c0a5040 2024-09-22T08:37:04.646 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.644+0000 7f3258d63640 1 -- 172.21.15.142:0/2421614479 <== osd.0 v2:172.21.15.31:6800/168281188 62 ==== osd_op_reply(215 gc.13 [call] v32'44 uv44 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f325003b040 con 0x7f324c0a5040 2024-09-22T08:37:04.646 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.644+0000 7f325d92e800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=1 2024-09-22T08:37:04.646 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.644+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:216 6.4 6:227f63b5:gc::gc.14:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bba3850 con 0x55fe4bb50500 2024-09-22T08:37:04.647 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.645+0000 7f3258d63640 1 -- 172.21.15.142:0/2421614479 <== osd.1 v2:172.21.15.142:6816/3192108003 48 ==== osd_op_reply(216 gc.14 [call] v32'163 uv163 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f325003b040 con 0x55fe4bb50500 2024-09-22T08:37:04.647 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.645+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:217 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bba3850 con 0x55fe4bb50500 2024-09-22T08:37:04.647 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.645+0000 7f3258d63640 1 -- 172.21.15.142:0/2421614479 <== osd.1 v2:172.21.15.142:6816/3192108003 49 ==== osd_op_reply(217 gc.14 [call out=15b] v0'0 uv163 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f325003b040 con 0x55fe4bb50500 2024-09-22T08:37:04.647 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.646+0000 7f325d92e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:37:04.648 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.646+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:218 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bba3850 con 0x55fe4bb50500 2024-09-22T08:37:04.648 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.646+0000 7f3258d63640 1 -- 172.21.15.142:0/2421614479 <== osd.1 v2:172.21.15.142:6816/3192108003 50 ==== osd_op_reply(218 gc.14 [call out=24b] v0'0 uv163 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f325003b040 con 0x55fe4bb50500 2024-09-22T08:37:04.648 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.646+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:219 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bba3850 con 0x55fe4bb50500 2024-09-22T08:37:04.648 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.646+0000 7f3258d63640 1 -- 172.21.15.142:0/2421614479 <== osd.1 v2:172.21.15.142:6816/3192108003 51 ==== osd_op_reply(219 gc.14 [call out=15b] v0'0 uv163 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f325003b040 con 0x55fe4bb50500 2024-09-22T08:37:04.648 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.646+0000 7f325d92e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:37:04.648 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.646+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:220 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bba3850 con 0x55fe4bb50500 2024-09-22T08:37:04.648 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.646+0000 7f3258d63640 1 -- 172.21.15.142:0/2421614479 <== osd.1 v2:172.21.15.142:6816/3192108003 52 ==== osd_op_reply(220 gc.14 [call out=15b] v0'0 uv163 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f325003b040 con 0x55fe4bb50500 2024-09-22T08:37:04.648 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.646+0000 7f325d92e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:37:04.648 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.646+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:221 6.4 6:227f63b5:gc::gc.14:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bba3850 con 0x55fe4bb50500 2024-09-22T08:37:04.649 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.647+0000 7f3258d63640 1 -- 172.21.15.142:0/2421614479 <== osd.1 v2:172.21.15.142:6816/3192108003 53 ==== osd_op_reply(221 gc.14 [call] v32'164 uv164 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f325003b040 con 0x55fe4bb50500 2024-09-22T08:37:04.649 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.647+0000 7f325d92e800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=1 2024-09-22T08:37:04.649 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.647+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:222 6.7 6:e07a6548:gc::gc.15:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bba3850 con 0x55fe4bb54ef0 2024-09-22T08:37:04.650 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.648+0000 7f3259d65640 1 -- 172.21.15.142:0/2421614479 <== osd.3 v2:172.21.15.142:6800/1064901393 58 ==== osd_op_reply(222 gc.15 [call] v32'46 uv46 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f325400a4d0 con 0x55fe4bb54ef0 2024-09-22T08:37:04.650 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.648+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:223 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bba3850 con 0x55fe4bb54ef0 2024-09-22T08:37:04.650 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.649+0000 7f3259d65640 1 -- 172.21.15.142:0/2421614479 <== osd.3 v2:172.21.15.142:6800/1064901393 59 ==== osd_op_reply(223 gc.15 [call out=15b] v0'0 uv46 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f325400a4d0 con 0x55fe4bb54ef0 2024-09-22T08:37:04.650 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.649+0000 7f325d92e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:37:04.651 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.649+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:224 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bba3850 con 0x55fe4bb54ef0 2024-09-22T08:37:04.651 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.649+0000 7f3259d65640 1 -- 172.21.15.142:0/2421614479 <== osd.3 v2:172.21.15.142:6800/1064901393 60 ==== osd_op_reply(224 gc.15 [call out=24b] v0'0 uv46 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f325400a4d0 con 0x55fe4bb54ef0 2024-09-22T08:37:04.651 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.649+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:225 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bba3850 con 0x55fe4bb54ef0 2024-09-22T08:37:04.651 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.649+0000 7f3259d65640 1 -- 172.21.15.142:0/2421614479 <== osd.3 v2:172.21.15.142:6800/1064901393 61 ==== osd_op_reply(225 gc.15 [call out=15b] v0'0 uv46 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f325400a4d0 con 0x55fe4bb54ef0 2024-09-22T08:37:04.651 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.649+0000 7f325d92e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:37:04.651 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.649+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:226 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bba3850 con 0x55fe4bb54ef0 2024-09-22T08:37:04.651 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.649+0000 7f3259d65640 1 -- 172.21.15.142:0/2421614479 <== osd.3 v2:172.21.15.142:6800/1064901393 62 ==== osd_op_reply(226 gc.15 [call out=15b] v0'0 uv46 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f325400a4d0 con 0x55fe4bb54ef0 2024-09-22T08:37:04.651 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.649+0000 7f325d92e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:37:04.651 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.649+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:227 6.7 6:e07a6548:gc::gc.15:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bba3850 con 0x55fe4bb54ef0 2024-09-22T08:37:04.651 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.650+0000 7f3259d65640 1 -- 172.21.15.142:0/2421614479 <== osd.3 v2:172.21.15.142:6800/1064901393 63 ==== osd_op_reply(227 gc.15 [call] v32'47 uv47 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f325400a4d0 con 0x55fe4bb54ef0 2024-09-22T08:37:04.652 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.650+0000 7f325d92e800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=1 2024-09-22T08:37:04.652 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.650+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:228 6.3 6:c623b173:gc::gc.16:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bba3850 con 0x7f3254054c20 2024-09-22T08:37:04.653 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.651+0000 7f3259564640 1 -- 172.21.15.142:0/2421614479 <== osd.2 v2:172.21.15.142:6808/279438927 50 ==== osd_op_reply(228 gc.16 [call] v32'56 uv56 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f324c07f070 con 0x7f3254054c20 2024-09-22T08:37:04.653 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.651+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:229 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bba3850 con 0x7f3254054c20 2024-09-22T08:37:04.653 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.652+0000 7f3259564640 1 -- 172.21.15.142:0/2421614479 <== osd.2 v2:172.21.15.142:6808/279438927 51 ==== osd_op_reply(229 gc.16 [call out=15b] v0'0 uv56 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f324c07f070 con 0x7f3254054c20 2024-09-22T08:37:04.653 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.652+0000 7f325d92e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:37:04.653 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.652+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:230 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bba3850 con 0x7f3254054c20 2024-09-22T08:37:04.653 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.652+0000 7f3259564640 1 -- 172.21.15.142:0/2421614479 <== osd.2 v2:172.21.15.142:6808/279438927 52 ==== osd_op_reply(230 gc.16 [call out=24b] v0'0 uv56 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f324c07f070 con 0x7f3254054c20 2024-09-22T08:37:04.653 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.652+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:231 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bba3850 con 0x7f3254054c20 2024-09-22T08:37:04.653 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.652+0000 7f3259564640 1 -- 172.21.15.142:0/2421614479 <== osd.2 v2:172.21.15.142:6808/279438927 53 ==== osd_op_reply(231 gc.16 [call out=15b] v0'0 uv56 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f324c07f070 con 0x7f3254054c20 2024-09-22T08:37:04.654 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.652+0000 7f325d92e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:37:04.654 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.652+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:232 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bba3850 con 0x7f3254054c20 2024-09-22T08:37:04.654 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.652+0000 7f3259564640 1 -- 172.21.15.142:0/2421614479 <== osd.2 v2:172.21.15.142:6808/279438927 54 ==== osd_op_reply(232 gc.16 [call out=15b] v0'0 uv56 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f324c07f070 con 0x7f3254054c20 2024-09-22T08:37:04.655 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.652+0000 7f325d92e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:37:04.655 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.652+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:233 6.3 6:c623b173:gc::gc.16:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bba3850 con 0x7f3254054c20 2024-09-22T08:37:04.655 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.653+0000 7f3259564640 1 -- 172.21.15.142:0/2421614479 <== osd.2 v2:172.21.15.142:6808/279438927 55 ==== osd_op_reply(233 gc.16 [call] v32'57 uv57 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f324c07f070 con 0x7f3254054c20 2024-09-22T08:37:04.655 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.653+0000 7f325d92e800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=1 2024-09-22T08:37:04.655 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.653+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:234 6.16 6:6849fd06:gc::gc.17:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bba3850 con 0x55fe4bb54ef0 2024-09-22T08:37:04.656 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.654+0000 7f3259d65640 1 -- 172.21.15.142:0/2421614479 <== osd.3 v2:172.21.15.142:6800/1064901393 64 ==== osd_op_reply(234 gc.17 [call] v32'20 uv20 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f325400a4d0 con 0x55fe4bb54ef0 2024-09-22T08:37:04.656 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.654+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:235 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bba3850 con 0x55fe4bb54ef0 2024-09-22T08:37:04.656 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.654+0000 7f3259d65640 1 -- 172.21.15.142:0/2421614479 <== osd.3 v2:172.21.15.142:6800/1064901393 65 ==== osd_op_reply(235 gc.17 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f325400a4d0 con 0x55fe4bb54ef0 2024-09-22T08:37:04.656 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.654+0000 7f325d92e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:37:04.656 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.654+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:236 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bba3850 con 0x55fe4bb54ef0 2024-09-22T08:37:04.657 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.655+0000 7f3259d65640 1 -- 172.21.15.142:0/2421614479 <== osd.3 v2:172.21.15.142:6800/1064901393 66 ==== osd_op_reply(236 gc.17 [call out=24b] v0'0 uv20 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f325400a4d0 con 0x55fe4bb54ef0 2024-09-22T08:37:04.657 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.655+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:237 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bba3850 con 0x55fe4bb54ef0 2024-09-22T08:37:04.657 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.655+0000 7f3259d65640 1 -- 172.21.15.142:0/2421614479 <== osd.3 v2:172.21.15.142:6800/1064901393 67 ==== osd_op_reply(237 gc.17 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f325400a4d0 con 0x55fe4bb54ef0 2024-09-22T08:37:04.657 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.655+0000 7f325d92e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:37:04.657 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.655+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:238 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bba3850 con 0x55fe4bb54ef0 2024-09-22T08:37:04.657 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.655+0000 7f3259d65640 1 -- 172.21.15.142:0/2421614479 <== osd.3 v2:172.21.15.142:6800/1064901393 68 ==== osd_op_reply(238 gc.17 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f325400a4d0 con 0x55fe4bb54ef0 2024-09-22T08:37:04.657 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.655+0000 7f325d92e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:37:04.657 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.655+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:239 6.16 6:6849fd06:gc::gc.17:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bba3850 con 0x55fe4bb54ef0 2024-09-22T08:37:04.657 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.656+0000 7f3259d65640 1 -- 172.21.15.142:0/2421614479 <== osd.3 v2:172.21.15.142:6800/1064901393 69 ==== osd_op_reply(239 gc.17 [call] v32'21 uv21 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f325400a4d0 con 0x55fe4bb54ef0 2024-09-22T08:37:04.657 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.656+0000 7f325d92e800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=1 2024-09-22T08:37:04.658 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.656+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:240 6.d 6:b019ea83:gc::gc.18:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bba3850 con 0x55fe4bb50500 2024-09-22T08:37:04.659 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.657+0000 7f3258d63640 1 -- 172.21.15.142:0/2421614479 <== osd.1 v2:172.21.15.142:6816/3192108003 54 ==== osd_op_reply(240 gc.18 [call] v32'28 uv28 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f325003b040 con 0x55fe4bb50500 2024-09-22T08:37:04.659 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.657+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:241 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bba3850 con 0x55fe4bb50500 2024-09-22T08:37:04.659 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.657+0000 7f3258d63640 1 -- 172.21.15.142:0/2421614479 <== osd.1 v2:172.21.15.142:6816/3192108003 55 ==== osd_op_reply(241 gc.18 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f325003b040 con 0x55fe4bb50500 2024-09-22T08:37:04.659 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.657+0000 7f325d92e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:37:04.659 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.657+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:242 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bba3850 con 0x55fe4bb50500 2024-09-22T08:37:04.660 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.658+0000 7f3258d63640 1 -- 172.21.15.142:0/2421614479 <== osd.1 v2:172.21.15.142:6816/3192108003 56 ==== osd_op_reply(242 gc.18 [call out=24b] v0'0 uv28 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f325003b040 con 0x55fe4bb50500 2024-09-22T08:37:04.660 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.658+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:243 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bba3850 con 0x55fe4bb50500 2024-09-22T08:37:04.660 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.658+0000 7f3258d63640 1 -- 172.21.15.142:0/2421614479 <== osd.1 v2:172.21.15.142:6816/3192108003 57 ==== osd_op_reply(243 gc.18 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f325003b040 con 0x55fe4bb50500 2024-09-22T08:37:04.660 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.658+0000 7f325d92e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:37:04.660 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.658+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:244 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bba3850 con 0x55fe4bb50500 2024-09-22T08:37:04.660 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.658+0000 7f3258d63640 1 -- 172.21.15.142:0/2421614479 <== osd.1 v2:172.21.15.142:6816/3192108003 58 ==== osd_op_reply(244 gc.18 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f325003b040 con 0x55fe4bb50500 2024-09-22T08:37:04.660 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.658+0000 7f325d92e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:37:04.660 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.658+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:245 6.d 6:b019ea83:gc::gc.18:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bba3850 con 0x55fe4bb50500 2024-09-22T08:37:04.660 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.659+0000 7f3258d63640 1 -- 172.21.15.142:0/2421614479 <== osd.1 v2:172.21.15.142:6816/3192108003 59 ==== osd_op_reply(245 gc.18 [call] v32'29 uv29 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f325003b040 con 0x55fe4bb50500 2024-09-22T08:37:04.661 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.659+0000 7f325d92e800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=1 2024-09-22T08:37:04.661 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.659+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:246 6.4 6:24c8e1ae:gc::gc.19:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bba3850 con 0x55fe4bb50500 2024-09-22T08:37:04.662 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.660+0000 7f3258d63640 1 -- 172.21.15.142:0/2421614479 <== osd.1 v2:172.21.15.142:6816/3192108003 60 ==== osd_op_reply(246 gc.19 [call] v32'165 uv165 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f325003b040 con 0x55fe4bb50500 2024-09-22T08:37:04.662 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.660+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:247 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bba3850 con 0x55fe4bb50500 2024-09-22T08:37:04.662 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.660+0000 7f3258d63640 1 -- 172.21.15.142:0/2421614479 <== osd.1 v2:172.21.15.142:6816/3192108003 61 ==== osd_op_reply(247 gc.19 [call out=15b] v0'0 uv165 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f325003b040 con 0x55fe4bb50500 2024-09-22T08:37:04.662 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.661+0000 7f325d92e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:37:04.663 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.661+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:248 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bb9a700 con 0x55fe4bb50500 2024-09-22T08:37:04.663 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.661+0000 7f3258d63640 1 -- 172.21.15.142:0/2421614479 <== osd.1 v2:172.21.15.142:6816/3192108003 62 ==== osd_op_reply(248 gc.19 [call out=24b] v0'0 uv165 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f325003b040 con 0x55fe4bb50500 2024-09-22T08:37:04.663 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.661+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:249 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bb9a700 con 0x55fe4bb50500 2024-09-22T08:37:04.663 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.661+0000 7f3258d63640 1 -- 172.21.15.142:0/2421614479 <== osd.1 v2:172.21.15.142:6816/3192108003 63 ==== osd_op_reply(249 gc.19 [call out=15b] v0'0 uv165 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f325003b040 con 0x55fe4bb50500 2024-09-22T08:37:04.663 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.661+0000 7f325d92e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:37:04.663 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.661+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:250 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bb9a700 con 0x55fe4bb50500 2024-09-22T08:37:04.663 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.661+0000 7f3258d63640 1 -- 172.21.15.142:0/2421614479 <== osd.1 v2:172.21.15.142:6816/3192108003 64 ==== osd_op_reply(250 gc.19 [call out=15b] v0'0 uv165 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f325003b040 con 0x55fe4bb50500 2024-09-22T08:37:04.663 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.661+0000 7f325d92e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:37:04.663 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.661+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:251 6.4 6:24c8e1ae:gc::gc.19:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bba3850 con 0x55fe4bb50500 2024-09-22T08:37:04.664 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.662+0000 7f3258d63640 1 -- 172.21.15.142:0/2421614479 <== osd.1 v2:172.21.15.142:6816/3192108003 65 ==== osd_op_reply(251 gc.19 [call] v32'166 uv166 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f325003b040 con 0x55fe4bb50500 2024-09-22T08:37:04.664 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.662+0000 7f325d92e800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=1 2024-09-22T08:37:04.664 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.662+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:252 6.7 6:e622f76a:gc::gc.20:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bba3850 con 0x55fe4bb54ef0 2024-09-22T08:37:04.665 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.663+0000 7f3259d65640 1 -- 172.21.15.142:0/2421614479 <== osd.3 v2:172.21.15.142:6800/1064901393 70 ==== osd_op_reply(252 gc.20 [call] v32'48 uv48 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f325400a4d0 con 0x55fe4bb54ef0 2024-09-22T08:37:04.666 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.663+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:253 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bba3850 con 0x55fe4bb54ef0 2024-09-22T08:37:04.666 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.663+0000 7f3259d65640 1 -- 172.21.15.142:0/2421614479 <== osd.3 v2:172.21.15.142:6800/1064901393 71 ==== osd_op_reply(253 gc.20 [call out=15b] v0'0 uv48 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f325400a4d0 con 0x55fe4bb54ef0 2024-09-22T08:37:04.666 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.664+0000 7f325d92e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:37:04.666 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.664+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:254 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bba3850 con 0x55fe4bb54ef0 2024-09-22T08:37:04.666 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.664+0000 7f3259d65640 1 -- 172.21.15.142:0/2421614479 <== osd.3 v2:172.21.15.142:6800/1064901393 72 ==== osd_op_reply(254 gc.20 [call out=24b] v0'0 uv48 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f325400a4d0 con 0x55fe4bb54ef0 2024-09-22T08:37:04.666 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.664+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:255 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bba3850 con 0x55fe4bb54ef0 2024-09-22T08:37:04.666 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.664+0000 7f3259d65640 1 -- 172.21.15.142:0/2421614479 <== osd.3 v2:172.21.15.142:6800/1064901393 73 ==== osd_op_reply(255 gc.20 [call out=15b] v0'0 uv48 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f325400a4d0 con 0x55fe4bb54ef0 2024-09-22T08:37:04.666 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.664+0000 7f325d92e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:37:04.666 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.664+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:256 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bba3850 con 0x55fe4bb54ef0 2024-09-22T08:37:04.666 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.664+0000 7f3259d65640 1 -- 172.21.15.142:0/2421614479 <== osd.3 v2:172.21.15.142:6800/1064901393 74 ==== osd_op_reply(256 gc.20 [call out=15b] v0'0 uv48 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f325400a4d0 con 0x55fe4bb54ef0 2024-09-22T08:37:04.666 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.664+0000 7f325d92e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:37:04.666 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.664+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:257 6.7 6:e622f76a:gc::gc.20:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bba3850 con 0x55fe4bb54ef0 2024-09-22T08:37:04.668 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.665+0000 7f3259d65640 1 -- 172.21.15.142:0/2421614479 <== osd.3 v2:172.21.15.142:6800/1064901393 75 ==== osd_op_reply(257 gc.20 [call] v32'49 uv49 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f325400a4d0 con 0x55fe4bb54ef0 2024-09-22T08:37:04.668 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.665+0000 7f325d92e800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=1 2024-09-22T08:37:04.668 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.665+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:258 6.a 6:5127e642:gc::gc.21:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bba3850 con 0x7f3254054c20 2024-09-22T08:37:04.668 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.666+0000 7f3259564640 1 -- 172.21.15.142:0/2421614479 <== osd.2 v2:172.21.15.142:6808/279438927 56 ==== osd_op_reply(258 gc.21 [call] v32'30 uv30 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f324c07f070 con 0x7f3254054c20 2024-09-22T08:37:04.668 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.666+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:259 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bba3850 con 0x7f3254054c20 2024-09-22T08:37:04.669 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.666+0000 7f3259564640 1 -- 172.21.15.142:0/2421614479 <== osd.2 v2:172.21.15.142:6808/279438927 57 ==== osd_op_reply(259 gc.21 [call out=15b] v0'0 uv30 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f324c07f070 con 0x7f3254054c20 2024-09-22T08:37:04.669 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.666+0000 7f325d92e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:37:04.669 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.667+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:260 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bba3850 con 0x7f3254054c20 2024-09-22T08:37:04.669 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.667+0000 7f3259564640 1 -- 172.21.15.142:0/2421614479 <== osd.2 v2:172.21.15.142:6808/279438927 58 ==== osd_op_reply(260 gc.21 [call out=24b] v0'0 uv30 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f324c07f070 con 0x7f3254054c20 2024-09-22T08:37:04.669 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.667+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:261 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bba3850 con 0x7f3254054c20 2024-09-22T08:37:04.669 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.667+0000 7f3259564640 1 -- 172.21.15.142:0/2421614479 <== osd.2 v2:172.21.15.142:6808/279438927 59 ==== osd_op_reply(261 gc.21 [call out=15b] v0'0 uv30 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f324c07f070 con 0x7f3254054c20 2024-09-22T08:37:04.669 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.667+0000 7f325d92e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:37:04.669 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.667+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:262 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bba3850 con 0x7f3254054c20 2024-09-22T08:37:04.669 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.667+0000 7f3259564640 1 -- 172.21.15.142:0/2421614479 <== osd.2 v2:172.21.15.142:6808/279438927 60 ==== osd_op_reply(262 gc.21 [call out=15b] v0'0 uv30 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f324c07f070 con 0x7f3254054c20 2024-09-22T08:37:04.669 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.667+0000 7f325d92e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:37:04.669 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.667+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:263 6.a 6:5127e642:gc::gc.21:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bba3850 con 0x7f3254054c20 2024-09-22T08:37:04.671 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.668+0000 7f3259564640 1 -- 172.21.15.142:0/2421614479 <== osd.2 v2:172.21.15.142:6808/279438927 61 ==== osd_op_reply(263 gc.21 [call] v32'31 uv31 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f324c07f070 con 0x7f3254054c20 2024-09-22T08:37:04.671 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.668+0000 7f325d92e800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=1 2024-09-22T08:37:04.671 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.668+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:264 6.11 6:8eb99c53:gc::gc.22:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bba3850 con 0x55fe4bb54ef0 2024-09-22T08:37:04.671 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.669+0000 7f3259d65640 1 -- 172.21.15.142:0/2421614479 <== osd.3 v2:172.21.15.142:6800/1064901393 76 ==== osd_op_reply(264 gc.22 [call] v32'22 uv22 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f325400a4d0 con 0x55fe4bb54ef0 2024-09-22T08:37:04.671 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.669+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:265 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bba3850 con 0x55fe4bb54ef0 2024-09-22T08:37:04.671 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.669+0000 7f3259d65640 1 -- 172.21.15.142:0/2421614479 <== osd.3 v2:172.21.15.142:6800/1064901393 77 ==== osd_op_reply(265 gc.22 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f325400a4d0 con 0x55fe4bb54ef0 2024-09-22T08:37:04.671 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.669+0000 7f325d92e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:37:04.671 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.669+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:266 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bba3850 con 0x55fe4bb54ef0 2024-09-22T08:37:04.672 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.669+0000 7f3259d65640 1 -- 172.21.15.142:0/2421614479 <== osd.3 v2:172.21.15.142:6800/1064901393 78 ==== osd_op_reply(266 gc.22 [call out=24b] v0'0 uv22 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f325400a4d0 con 0x55fe4bb54ef0 2024-09-22T08:37:04.672 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.669+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:267 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bba3850 con 0x55fe4bb54ef0 2024-09-22T08:37:04.672 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.670+0000 7f3259d65640 1 -- 172.21.15.142:0/2421614479 <== osd.3 v2:172.21.15.142:6800/1064901393 79 ==== osd_op_reply(267 gc.22 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f325400a4d0 con 0x55fe4bb54ef0 2024-09-22T08:37:04.672 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.670+0000 7f325d92e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:37:04.672 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.670+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:268 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bba3850 con 0x55fe4bb54ef0 2024-09-22T08:37:04.672 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.670+0000 7f3259d65640 1 -- 172.21.15.142:0/2421614479 <== osd.3 v2:172.21.15.142:6800/1064901393 80 ==== osd_op_reply(268 gc.22 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f325400a4d0 con 0x55fe4bb54ef0 2024-09-22T08:37:04.672 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.670+0000 7f325d92e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:37:04.672 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.670+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:269 6.11 6:8eb99c53:gc::gc.22:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bba3850 con 0x55fe4bb54ef0 2024-09-22T08:37:04.674 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.671+0000 7f3259d65640 1 -- 172.21.15.142:0/2421614479 <== osd.3 v2:172.21.15.142:6800/1064901393 81 ==== osd_op_reply(269 gc.22 [call] v32'23 uv23 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f325400a4d0 con 0x55fe4bb54ef0 2024-09-22T08:37:04.674 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.671+0000 7f325d92e800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=1 2024-09-22T08:37:04.674 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.671+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:270 6.8 6:17d7e8ed:gc::gc.23:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bba3850 con 0x55fe4bb54ef0 2024-09-22T08:37:04.674 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.672+0000 7f3259d65640 1 -- 172.21.15.142:0/2421614479 <== osd.3 v2:172.21.15.142:6800/1064901393 82 ==== osd_op_reply(270 gc.23 [call] v32'26 uv26 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f325400a4d0 con 0x55fe4bb54ef0 2024-09-22T08:37:04.674 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.672+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:271 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bba3850 con 0x55fe4bb54ef0 2024-09-22T08:37:04.674 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.672+0000 7f3259d65640 1 -- 172.21.15.142:0/2421614479 <== osd.3 v2:172.21.15.142:6800/1064901393 83 ==== osd_op_reply(271 gc.23 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f325400a4d0 con 0x55fe4bb54ef0 2024-09-22T08:37:04.674 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.672+0000 7f325d92e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:37:04.674 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.672+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:272 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bba3850 con 0x55fe4bb54ef0 2024-09-22T08:37:04.674 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.672+0000 7f3259d65640 1 -- 172.21.15.142:0/2421614479 <== osd.3 v2:172.21.15.142:6800/1064901393 84 ==== osd_op_reply(272 gc.23 [call out=24b] v0'0 uv26 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f325400a4d0 con 0x55fe4bb54ef0 2024-09-22T08:37:04.674 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.672+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:273 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bba3850 con 0x55fe4bb54ef0 2024-09-22T08:37:04.674 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.672+0000 7f3259d65640 1 -- 172.21.15.142:0/2421614479 <== osd.3 v2:172.21.15.142:6800/1064901393 85 ==== osd_op_reply(273 gc.23 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f325400a4d0 con 0x55fe4bb54ef0 2024-09-22T08:37:04.675 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.672+0000 7f325d92e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:37:04.675 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.673+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:274 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bba3850 con 0x55fe4bb54ef0 2024-09-22T08:37:04.675 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.673+0000 7f3259d65640 1 -- 172.21.15.142:0/2421614479 <== osd.3 v2:172.21.15.142:6800/1064901393 86 ==== osd_op_reply(274 gc.23 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f325400a4d0 con 0x55fe4bb54ef0 2024-09-22T08:37:04.675 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.673+0000 7f325d92e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:37:04.675 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.673+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:275 6.8 6:17d7e8ed:gc::gc.23:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bba3850 con 0x55fe4bb54ef0 2024-09-22T08:37:04.676 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.674+0000 7f3259d65640 1 -- 172.21.15.142:0/2421614479 <== osd.3 v2:172.21.15.142:6800/1064901393 87 ==== osd_op_reply(275 gc.23 [call] v32'27 uv27 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f325400a4d0 con 0x55fe4bb54ef0 2024-09-22T08:37:04.676 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.674+0000 7f325d92e800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=1 2024-09-22T08:37:04.676 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.674+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:276 6.1b 6:db9d130d:gc::gc.24:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bba3850 con 0x55fe4bb54ef0 2024-09-22T08:37:04.676 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.675+0000 7f3259d65640 1 -- 172.21.15.142:0/2421614479 <== osd.3 v2:172.21.15.142:6800/1064901393 88 ==== osd_op_reply(276 gc.24 [call] v32'16 uv16 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f325400a4d0 con 0x55fe4bb54ef0 2024-09-22T08:37:04.676 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.675+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:277 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bba3850 con 0x55fe4bb54ef0 2024-09-22T08:37:04.677 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.675+0000 7f3259d65640 1 -- 172.21.15.142:0/2421614479 <== osd.3 v2:172.21.15.142:6800/1064901393 89 ==== osd_op_reply(277 gc.24 [call out=15b] v0'0 uv16 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f325400a4d0 con 0x55fe4bb54ef0 2024-09-22T08:37:04.677 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.675+0000 7f325d92e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:37:04.677 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.675+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:278 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bba3850 con 0x55fe4bb54ef0 2024-09-22T08:37:04.677 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.675+0000 7f3259d65640 1 -- 172.21.15.142:0/2421614479 <== osd.3 v2:172.21.15.142:6800/1064901393 90 ==== osd_op_reply(278 gc.24 [call out=24b] v0'0 uv16 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f325400a4d0 con 0x55fe4bb54ef0 2024-09-22T08:37:04.677 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.675+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:279 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bba3850 con 0x55fe4bb54ef0 2024-09-22T08:37:04.677 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.675+0000 7f3259d65640 1 -- 172.21.15.142:0/2421614479 <== osd.3 v2:172.21.15.142:6800/1064901393 91 ==== osd_op_reply(279 gc.24 [call out=15b] v0'0 uv16 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f325400a4d0 con 0x55fe4bb54ef0 2024-09-22T08:37:04.677 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.675+0000 7f325d92e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:37:04.678 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.675+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:280 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bba3850 con 0x55fe4bb54ef0 2024-09-22T08:37:04.678 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.676+0000 7f3259d65640 1 -- 172.21.15.142:0/2421614479 <== osd.3 v2:172.21.15.142:6800/1064901393 92 ==== osd_op_reply(280 gc.24 [call out=15b] v0'0 uv16 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f325400a4d0 con 0x55fe4bb54ef0 2024-09-22T08:37:04.678 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.676+0000 7f325d92e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:37:04.678 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.676+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:281 6.1b 6:db9d130d:gc::gc.24:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bba3850 con 0x55fe4bb54ef0 2024-09-22T08:37:04.678 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.677+0000 7f3259d65640 1 -- 172.21.15.142:0/2421614479 <== osd.3 v2:172.21.15.142:6800/1064901393 93 ==== osd_op_reply(281 gc.24 [call] v32'17 uv17 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f325400a4d0 con 0x55fe4bb54ef0 2024-09-22T08:37:04.678 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.677+0000 7f325d92e800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=1 2024-09-22T08:37:04.679 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.677+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:282 6.9 6:921ecdb1:gc::gc.25:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bba3850 con 0x55fe4bb54ef0 2024-09-22T08:37:04.679 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.677+0000 7f3259d65640 1 -- 172.21.15.142:0/2421614479 <== osd.3 v2:172.21.15.142:6800/1064901393 94 ==== osd_op_reply(282 gc.25 [call] v32'35 uv35 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f325400a4d0 con 0x55fe4bb54ef0 2024-09-22T08:37:04.679 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.677+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:283 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bba3850 con 0x55fe4bb54ef0 2024-09-22T08:37:04.680 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.678+0000 7f3259d65640 1 -- 172.21.15.142:0/2421614479 <== osd.3 v2:172.21.15.142:6800/1064901393 95 ==== osd_op_reply(283 gc.25 [call out=15b] v0'0 uv35 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f325400a4d0 con 0x55fe4bb54ef0 2024-09-22T08:37:04.680 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.678+0000 7f325d92e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:37:04.680 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.678+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:284 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bba3850 con 0x55fe4bb54ef0 2024-09-22T08:37:04.680 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.678+0000 7f3259d65640 1 -- 172.21.15.142:0/2421614479 <== osd.3 v2:172.21.15.142:6800/1064901393 96 ==== osd_op_reply(284 gc.25 [call out=24b] v0'0 uv35 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f325400a4d0 con 0x55fe4bb54ef0 2024-09-22T08:37:04.680 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.678+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:285 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bba3850 con 0x55fe4bb54ef0 2024-09-22T08:37:04.680 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.678+0000 7f3259d65640 1 -- 172.21.15.142:0/2421614479 <== osd.3 v2:172.21.15.142:6800/1064901393 97 ==== osd_op_reply(285 gc.25 [call out=15b] v0'0 uv35 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f325400a4d0 con 0x55fe4bb54ef0 2024-09-22T08:37:04.680 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.678+0000 7f325d92e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:37:04.680 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.678+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:286 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bba3850 con 0x55fe4bb54ef0 2024-09-22T08:37:04.680 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.678+0000 7f3259d65640 1 -- 172.21.15.142:0/2421614479 <== osd.3 v2:172.21.15.142:6800/1064901393 98 ==== osd_op_reply(286 gc.25 [call out=15b] v0'0 uv35 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f325400a4d0 con 0x55fe4bb54ef0 2024-09-22T08:37:04.681 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.678+0000 7f325d92e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:37:04.681 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.678+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:287 6.9 6:921ecdb1:gc::gc.25:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bba3850 con 0x55fe4bb54ef0 2024-09-22T08:37:04.681 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.679+0000 7f3259d65640 1 -- 172.21.15.142:0/2421614479 <== osd.3 v2:172.21.15.142:6800/1064901393 99 ==== osd_op_reply(287 gc.25 [call] v32'36 uv36 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f325400a4d0 con 0x55fe4bb54ef0 2024-09-22T08:37:04.681 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.679+0000 7f325d92e800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=1 2024-09-22T08:37:04.681 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.679+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:288 6.1f 6:fde4dd55:gc::gc.26:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bba3850 con 0x7f324c0a5040 2024-09-22T08:37:04.682 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.681+0000 7f3258d63640 1 -- 172.21.15.142:0/2421614479 <== osd.0 v2:172.21.15.31:6800/168281188 63 ==== osd_op_reply(288 gc.26 [call] v32'22 uv22 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f325003b040 con 0x7f324c0a5040 2024-09-22T08:37:04.682 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.681+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:289 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bba3850 con 0x7f324c0a5040 2024-09-22T08:37:04.683 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.681+0000 7f3258d63640 1 -- 172.21.15.142:0/2421614479 <== osd.0 v2:172.21.15.31:6800/168281188 64 ==== osd_op_reply(289 gc.26 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f325003b040 con 0x7f324c0a5040 2024-09-22T08:37:04.683 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.681+0000 7f325d92e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:37:04.683 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.681+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:290 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bb9a700 con 0x7f324c0a5040 2024-09-22T08:37:04.683 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.681+0000 7f3258d63640 1 -- 172.21.15.142:0/2421614479 <== osd.0 v2:172.21.15.31:6800/168281188 65 ==== osd_op_reply(290 gc.26 [call out=24b] v0'0 uv22 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f325003b040 con 0x7f324c0a5040 2024-09-22T08:37:04.683 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.681+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:291 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bb9a700 con 0x7f324c0a5040 2024-09-22T08:37:04.683 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.681+0000 7f3258d63640 1 -- 172.21.15.142:0/2421614479 <== osd.0 v2:172.21.15.31:6800/168281188 66 ==== osd_op_reply(291 gc.26 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f325003b040 con 0x7f324c0a5040 2024-09-22T08:37:04.683 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.681+0000 7f325d92e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:37:04.684 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.681+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:292 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bb9a700 con 0x7f324c0a5040 2024-09-22T08:37:04.684 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.682+0000 7f3258d63640 1 -- 172.21.15.142:0/2421614479 <== osd.0 v2:172.21.15.31:6800/168281188 67 ==== osd_op_reply(292 gc.26 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f325003b040 con 0x7f324c0a5040 2024-09-22T08:37:04.684 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.682+0000 7f325d92e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:37:04.684 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.682+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:293 6.1f 6:fde4dd55:gc::gc.26:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bba3850 con 0x7f324c0a5040 2024-09-22T08:37:04.684 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.683+0000 7f3258d63640 1 -- 172.21.15.142:0/2421614479 <== osd.0 v2:172.21.15.31:6800/168281188 68 ==== osd_op_reply(293 gc.26 [call] v32'23 uv23 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f325003b040 con 0x7f324c0a5040 2024-09-22T08:37:04.685 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.684+0000 7f310ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:37:04.685 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.684+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:294 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94550680278240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bba3850 con 0x55fe4bb50500 2024-09-22T08:37:04.686 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.685+0000 7f3258d63640 1 -- 172.21.15.142:0/2421614479 <== osd.1 v2:172.21.15.142:6816/3192108003 66 ==== osd_op_reply(294 data_loggenerations_metadata [watch unwatch cookie 94550680278240] v32'167 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f325003b040 con 0x55fe4bb50500 2024-09-22T08:37:04.686 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.685+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:295 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94550680252976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bba3850 con 0x7f3254054c20 2024-09-22T08:37:04.687 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.686+0000 7f3259564640 1 -- 172.21.15.142:0/2421614479 <== osd.2 v2:172.21.15.142:6808/279438927 62 ==== osd_op_reply(295 notify.0 [watch unwatch cookie 94550680252976] v32'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f324c07f070 con 0x7f3254054c20 2024-09-22T08:37:04.687 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.686+0000 7f325d92e800 20 remove_watcher() i=0 2024-09-22T08:37:04.687 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.686+0000 7f325d92e800 2 removed watcher, disabling cache 2024-09-22T08:37:04.687 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.686+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:296 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94550680258736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bba3850 con 0x55fe4bb50500 2024-09-22T08:37:04.688 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.687+0000 7f3258d63640 1 -- 172.21.15.142:0/2421614479 <== osd.1 v2:172.21.15.142:6816/3192108003 67 ==== osd_op_reply(296 notify.1 [watch unwatch cookie 94550680258736] v32'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f325003b040 con 0x55fe4bb50500 2024-09-22T08:37:04.688 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.687+0000 7f325d92e800 20 remove_watcher() i=1 2024-09-22T08:37:04.688 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.687+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:297 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94550680262288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bb5c8b0 con 0x55fe4bb54ef0 2024-09-22T08:37:04.689 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.688+0000 7f3259d65640 1 -- 172.21.15.142:0/2421614479 <== osd.3 v2:172.21.15.142:6800/1064901393 100 ==== osd_op_reply(297 notify.2 [watch unwatch cookie 94550680262288] v32'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f325400a4d0 con 0x55fe4bb54ef0 2024-09-22T08:37:04.689 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.688+0000 7f325d92e800 20 remove_watcher() i=2 2024-09-22T08:37:04.689 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.688+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:298 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94550680266192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bb5d690 con 0x7f3254054c20 2024-09-22T08:37:04.690 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.689+0000 7f3259564640 1 -- 172.21.15.142:0/2421614479 <== osd.2 v2:172.21.15.142:6808/279438927 63 ==== osd_op_reply(298 notify.3 [watch unwatch cookie 94550680266192] v32'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f324c07f070 con 0x7f3254054c20 2024-09-22T08:37:04.690 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.689+0000 7f325d92e800 20 remove_watcher() i=3 2024-09-22T08:37:04.690 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.689+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:299 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94550680264496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bb5c8b0 con 0x55fe4bb50500 2024-09-22T08:37:04.691 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.690+0000 7f3258d63640 1 -- 172.21.15.142:0/2421614479 <== osd.1 v2:172.21.15.142:6816/3192108003 68 ==== osd_op_reply(299 notify.4 [watch unwatch cookie 94550680264496] v32'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f325003b040 con 0x55fe4bb50500 2024-09-22T08:37:04.691 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.690+0000 7f325d92e800 20 remove_watcher() i=4 2024-09-22T08:37:04.691 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.690+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:300 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94550680269920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bb5e5d0 con 0x7f324c0a5040 2024-09-22T08:37:04.692 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.691+0000 7f3258d63640 1 -- 172.21.15.142:0/2421614479 <== osd.0 v2:172.21.15.31:6800/168281188 69 ==== osd_op_reply(300 notify.5 [watch unwatch cookie 94550680269920] v32'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f325003b040 con 0x7f324c0a5040 2024-09-22T08:37:04.692 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.691+0000 7f325d92e800 20 remove_watcher() i=5 2024-09-22T08:37:04.692 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.691+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:301 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94550680273584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bb5df30 con 0x7f324c0a5040 2024-09-22T08:37:04.693 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.692+0000 7f3258d63640 1 -- 172.21.15.142:0/2421614479 <== osd.0 v2:172.21.15.31:6800/168281188 70 ==== osd_op_reply(301 notify.6 [watch unwatch cookie 94550680273584] v32'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f325003b040 con 0x7f324c0a5040 2024-09-22T08:37:04.693 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.692+0000 7f325d92e800 20 remove_watcher() i=6 2024-09-22T08:37:04.693 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.692+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:302 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94550680274640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe4bb5c8b0 con 0x7f324c0a5040 2024-09-22T08:37:04.696 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.693+0000 7f3258d63640 1 -- 172.21.15.142:0/2421614479 <== osd.0 v2:172.21.15.31:6800/168281188 71 ==== osd_op_reply(302 notify.7 [watch unwatch cookie 94550680274640] v32'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f325003b040 con 0x7f324c0a5040 2024-09-22T08:37:04.696 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.693+0000 7f325d92e800 20 remove_watcher() i=7 2024-09-22T08:37:04.696 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.693+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f324c0a5040 msgr2=0x7f324c0645d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:04.696 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.693+0000 7f325d92e800 1 --2- 172.21.15.142:0/2421614479 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f324c0a5040 0x7f324c0645d0 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:04.696 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.693+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55fe4bb50500 msgr2=0x55fe4bb529c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:04.696 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.693+0000 7f325d92e800 1 --2- 172.21.15.142:0/2421614479 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55fe4bb50500 0x55fe4bb529c0 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:04.697 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.693+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f3254054c20 msgr2=0x7f3254056540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:04.697 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.693+0000 7f325d92e800 1 --2- 172.21.15.142:0/2421614479 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f3254054c20 0x7f3254056540 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:04.697 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.693+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55fe4bb54ef0 msgr2=0x55fe4bb572e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:04.697 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.693+0000 7f325d92e800 1 --2- 172.21.15.142:0/2421614479 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55fe4bb54ef0 0x55fe4bb572e0 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:04.697 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.693+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f312403cfb0 msgr2=0x7f312403f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:04.697 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.693+0000 7f325d92e800 1 --2- 172.21.15.142:0/2421614479 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f312403cfb0 0x7f312403f470 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f324c06f5e0 tx=0x7f324c08f000 comp rx=0 tx=0).stop 2024-09-22T08:37:04.697 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.693+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fe4bb3d5f0 msgr2=0x55fe4bb44bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:04.697 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.693+0000 7f325d92e800 1 --2- 172.21.15.142:0/2421614479 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fe4bb3d5f0 0x55fe4bb44bf0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f325401ff20 tx=0x7f32540547a0 comp rx=0 tx=0).stop 2024-09-22T08:37:04.697 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.693+0000 7f3258d63640 1 -- 172.21.15.142:0/2421614479 reap_dead start 2024-09-22T08:37:04.697 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.693+0000 7f3258d63640 1 -- 172.21.15.142:0/2421614479 reap_dead start 2024-09-22T08:37:04.697 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.693+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 shutdown_connections 2024-09-22T08:37:04.697 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.693+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 >> 172.21.15.142:0/2421614479 conn(0x55fe4bb399f0 msgr2=0x55fe4bb37c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:37:04.697 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.694+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 shutdown_connections 2024-09-22T08:37:04.697 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.694+0000 7f325d92e800 1 -- 172.21.15.142:0/2421614479 wait complete. 2024-09-22T08:37:04.698 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.694+0000 7f325d92e800 1 -- 172.21.15.142:0/1644876412 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f313003cfb0 msgr2=0x7f313003f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:04.698 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.694+0000 7f325d92e800 1 --2- 172.21.15.142:0/1644876412 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f313003cfb0 0x7f313003f470 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f324c076520 tx=0x7f324c06ff10 comp rx=0 tx=0).stop 2024-09-22T08:37:04.698 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.694+0000 7f325d92e800 1 -- 172.21.15.142:0/1644876412 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fe4bb30b30 msgr2=0x55fe4bb30f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:04.698 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.694+0000 7f325d92e800 1 --2- 172.21.15.142:0/1644876412 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fe4bb30b30 0x55fe4bb30f50 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x55fe4bb169a0 tx=0x7f32540167b0 comp rx=0 tx=0).stop 2024-09-22T08:37:04.698 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.694+0000 7f325d92e800 1 -- 172.21.15.142:0/1644876412 shutdown_connections 2024-09-22T08:37:04.698 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.694+0000 7f325d92e800 1 --2- 172.21.15.142:0/1644876412 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f313003cfb0 0x7f313003f470 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:04.698 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.694+0000 7f325d92e800 1 --2- 172.21.15.142:0/1644876412 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fe4bb30b30 0x55fe4bb30f50 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:04.698 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.694+0000 7f325d92e800 1 -- 172.21.15.142:0/1644876412 >> 172.21.15.142:0/1644876412 conn(0x55fe4bb24ee0 msgr2=0x55fe4bb252c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:37:04.698 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.694+0000 7f325d92e800 1 -- 172.21.15.142:0/1644876412 shutdown_connections 2024-09-22T08:37:04.698 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.694+0000 7f325d92e800 1 -- 172.21.15.142:0/1644876412 wait complete. 2024-09-22T08:37:04.698 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.694+0000 7f325d92e800 1 -- 172.21.15.142:0/1237533381 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55fe4ba21a00 msgr2=0x55fe4bb1d160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:04.698 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.694+0000 7f325d92e800 1 --2- 172.21.15.142:0/1237533381 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55fe4ba21a00 0x55fe4bb1d160 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:04.698 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.694+0000 7f325d92e800 1 -- 172.21.15.142:0/1237533381 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55fe4bb1f540 msgr2=0x55fe4bb219e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:04.698 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.694+0000 7f325d92e800 1 --2- 172.21.15.142:0/1237533381 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55fe4bb1f540 0x55fe4bb219e0 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:04.699 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.694+0000 7f325d92e800 1 -- 172.21.15.142:0/1237533381 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f314003d000 msgr2=0x7f314003f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:04.699 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.694+0000 7f325d92e800 1 --2- 172.21.15.142:0/1237533381 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f314003d000 0x7f314003f4c0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f3250001e30 tx=0x7f3250001390 comp rx=0 tx=0).stop 2024-09-22T08:37:04.699 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.694+0000 7f325d92e800 1 -- 172.21.15.142:0/1237533381 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fe4b990500 msgr2=0x55fe4bb15b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:04.699 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.694+0000 7f325d92e800 1 --2- 172.21.15.142:0/1237533381 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fe4b990500 0x55fe4bb15b10 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f324c025da0 tx=0x7f324c002fb0 comp rx=0 tx=0).stop 2024-09-22T08:37:04.699 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.694+0000 7f325d92e800 1 -- 172.21.15.142:0/1237533381 shutdown_connections 2024-09-22T08:37:04.699 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.694+0000 7f325d92e800 1 --2- 172.21.15.142:0/1237533381 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55fe4bb1f540 0x55fe4bb219e0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:04.699 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.694+0000 7f325d92e800 1 --2- 172.21.15.142:0/1237533381 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55fe4ba21a00 0x55fe4bb1d160 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:04.699 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.694+0000 7f325d92e800 1 --2- 172.21.15.142:0/1237533381 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f314003d000 0x7f314003f4c0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:04.699 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.694+0000 7f325d92e800 1 --2- 172.21.15.142:0/1237533381 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fe4b990500 0x55fe4bb15b10 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:04.699 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.694+0000 7f325d92e800 1 -- 172.21.15.142:0/1237533381 >> 172.21.15.142:0/1237533381 conn(0x55fe4ba16bd0 msgr2=0x55fe4bb08340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:37:04.699 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.694+0000 7f325d92e800 1 -- 172.21.15.142:0/1237533381 shutdown_connections 2024-09-22T08:37:04.699 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.695+0000 7f325d92e800 1 -- 172.21.15.142:0/1237533381 wait complete. 2024-09-22T08:37:04.704 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'list', '--include-all'] 2024-09-22T08:37:04.704 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'list', '--include-all'] 2024-09-22T08:37:04.705 DEBUG:teuthology.orchestra.run.smithi142:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc list --include-all 2024-09-22T08:37:04.789 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:37:04.789 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:37:04.790 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.788+0000 7f34c1726800 1 Processor -- start 2024-09-22T08:37:04.790 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.788+0000 7f34c1726800 1 -- start start 2024-09-22T08:37:04.790 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.788+0000 7f34c1726800 1 --2- >> v2:172.21.15.31:3300/0 conn(0x5585d5953be0 0x5585d5953fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:04.791 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.788+0000 7f34c1726800 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5585d57e0a20 con 0x5585d5958850 2024-09-22T08:37:04.791 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.788+0000 7f34c1726800 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x5585d57e07d0 con 0x5585d5953be0 2024-09-22T08:37:04.791 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.789+0000 7f34bd309640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x5585d5953be0 0x5585d5953fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:04.791 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.789+0000 7f34b4b08640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x5585d5958850 0x5585d595acc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.142:56330/0 (socket says 172.21.15.142:56330) 2024-09-22T08:37:04.791 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.789+0000 7f34b4b08640 1 -- 172.21.15.142:0/2271333957 learned_addr learned my addr 172.21.15.142:0/2271333957 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-09-22T08:37:04.791 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.789+0000 7f34bd309640 1 -- 172.21.15.142:0/2271333957 >> v1:172.21.15.31:6789/0 conn(0x5585d5958850 legacy=0x5585d595acc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:04.791 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.789+0000 7f34bd309640 1 -- 172.21.15.142:0/2271333957 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5585d595d580 con 0x5585d5953be0 2024-09-22T08:37:04.793 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.791+0000 7f34bd309640 1 --2- 172.21.15.142:0/2271333957 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5585d5953be0 0x5585d5953fe0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f34b000a470 tx=0x7f34b0045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2213a709e82b9db server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:04.793 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.791+0000 7f34bcb08640 1 -- 172.21.15.142:0/2271333957 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34b0053570 con 0x5585d5953be0 2024-09-22T08:37:04.793 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.791+0000 7f34bcb08640 1 -- 172.21.15.142:0/2271333957 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34b0058070 con 0x5585d5953be0 2024-09-22T08:37:04.793 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.791+0000 7f34bcb08640 1 -- 172.21.15.142:0/2271333957 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34b0053880 con 0x5585d5953be0 2024-09-22T08:37:04.793 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.792+0000 7f34c1726800 1 -- 172.21.15.142:0/2271333957 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5585d5953be0 msgr2=0x5585d5953fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:04.793 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.792+0000 7f34c1726800 1 --2- 172.21.15.142:0/2271333957 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5585d5953be0 0x5585d5953fe0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f34b000a470 tx=0x7f34b0045a20 comp rx=0 tx=0).stop 2024-09-22T08:37:04.793 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.792+0000 7f34c1726800 1 -- 172.21.15.142:0/2271333957 shutdown_connections 2024-09-22T08:37:04.793 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.792+0000 7f34c1726800 1 --2- 172.21.15.142:0/2271333957 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5585d5953be0 0x5585d5953fe0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:04.794 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.792+0000 7f34c1726800 1 -- 172.21.15.142:0/2271333957 >> 172.21.15.142:0/2271333957 conn(0x5585d594f310 msgr2=0x5585d5951790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:37:04.794 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.792+0000 7f34c1726800 1 -- 172.21.15.142:0/2271333957 shutdown_connections 2024-09-22T08:37:04.794 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.792+0000 7f34c1726800 1 -- 172.21.15.142:0/2271333957 wait complete. 2024-09-22T08:37:04.807 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.805+0000 7f34c1726800 1 Processor -- start 2024-09-22T08:37:04.807 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.805+0000 7f34c1726800 1 -- start start 2024-09-22T08:37:04.807 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.805+0000 7f34c1726800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5585d5953be0 0x5585d5955fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:04.807 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.805+0000 7f34c1726800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5585d57eddd0 con 0x5585d5953be0 2024-09-22T08:37:04.808 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.806+0000 7f34bd309640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5585d5953be0 0x5585d5955fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:04.808 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.806+0000 7f34bd309640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5585d5953be0 0x5585d5955fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:59348/0 (socket says 172.21.15.142:59348) 2024-09-22T08:37:04.808 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.806+0000 7f34bd309640 1 -- 172.21.15.142:0/4037900846 learned_addr learned my addr 172.21.15.142:0/4037900846 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:37:04.808 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.806+0000 7f34bd309640 1 -- 172.21.15.142:0/4037900846 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5585d59565c0 con 0x5585d5953be0 2024-09-22T08:37:04.808 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.806+0000 7f34bd309640 1 --2- 172.21.15.142:0/4037900846 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5585d5953be0 0x5585d5955fd0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f34b0025c20 tx=0x7f34b0051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68d17fe98107370 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:04.810 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.806+0000 7f33ab606640 1 -- 172.21.15.142:0/4037900846 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34b0053570 con 0x5585d5953be0 2024-09-22T08:37:04.811 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.806+0000 7f33ab606640 1 -- 172.21.15.142:0/4037900846 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34b0063070 con 0x5585d5953be0 2024-09-22T08:37:04.811 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.806+0000 7f33ab606640 1 -- 172.21.15.142:0/4037900846 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34b0053840 con 0x5585d5953be0 2024-09-22T08:37:04.811 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.807+0000 7f34c1726800 1 -- 172.21.15.142:0/4037900846 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5585d5953be0 msgr2=0x5585d5955fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:04.811 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.807+0000 7f34c1726800 1 --2- 172.21.15.142:0/4037900846 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5585d5953be0 0x5585d5955fd0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f34b0025c20 tx=0x7f34b0051000 comp rx=0 tx=0).stop 2024-09-22T08:37:04.811 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.807+0000 7f34c1726800 1 -- 172.21.15.142:0/4037900846 shutdown_connections 2024-09-22T08:37:04.811 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.807+0000 7f34c1726800 1 --2- 172.21.15.142:0/4037900846 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5585d5953be0 0x5585d5955fd0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:04.811 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.807+0000 7f34c1726800 1 -- 172.21.15.142:0/4037900846 >> 172.21.15.142:0/4037900846 conn(0x5585d594f310 msgr2=0x5585d5a409c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:37:04.811 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.807+0000 7f34c1726800 1 -- 172.21.15.142:0/4037900846 shutdown_connections 2024-09-22T08:37:04.811 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.807+0000 7f34c1726800 1 -- 172.21.15.142:0/4037900846 wait complete. 2024-09-22T08:37:04.811 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.807+0000 7f34c1726800 1 Processor -- start 2024-09-22T08:37:04.811 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.808+0000 7f34c1726800 1 -- start start 2024-09-22T08:37:04.811 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.808+0000 7f34c1726800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5585d5953be0 0x5585d5a4ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:04.812 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.808+0000 7f34c1726800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5585d595c820 con 0x5585d5953be0 2024-09-22T08:37:04.812 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.808+0000 7f34bd309640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5585d5953be0 0x5585d5a4ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:04.812 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.808+0000 7f34bd309640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5585d5953be0 0x5585d5a4ed10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:59350/0 (socket says 172.21.15.142:59350) 2024-09-22T08:37:04.812 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.808+0000 7f34bd309640 1 -- 172.21.15.142:0/3578058620 learned_addr learned my addr 172.21.15.142:0/3578058620 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:37:04.812 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.808+0000 7f34bd309640 1 -- 172.21.15.142:0/3578058620 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5585d5a4f270 con 0x5585d5953be0 2024-09-22T08:37:04.812 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.809+0000 7f34bd309640 1 --2- 172.21.15.142:0/3578058620 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5585d5953be0 0x5585d5a4ed10 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f34b0025c20 tx=0x7f34b0002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:04.812 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.809+0000 7f33a9e03640 1 -- 172.21.15.142:0/3578058620 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34b0074480 con 0x5585d5953be0 2024-09-22T08:37:04.812 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.809+0000 7f33a9e03640 1 -- 172.21.15.142:0/3578058620 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34b0074620 con 0x5585d5953be0 2024-09-22T08:37:04.812 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.809+0000 7f34c1726800 1 -- 172.21.15.142:0/3578058620 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5585d5a4f500 con 0x5585d5953be0 2024-09-22T08:37:04.812 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.809+0000 7f33a9e03640 1 -- 172.21.15.142:0/3578058620 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34b0074900 con 0x5585d5953be0 2024-09-22T08:37:04.812 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.809+0000 7f34c1726800 1 -- 172.21.15.142:0/3578058620 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5585d5a50110 con 0x5585d5953be0 2024-09-22T08:37:04.819 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.810+0000 7f33a9e03640 1 -- 172.21.15.142:0/3578058620 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f34b0074aa0 con 0x5585d5953be0 2024-09-22T08:37:04.819 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.810+0000 7f33a9e03640 1 --2- 172.21.15.142:0/3578058620 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f33a403d000 0x7f33a403f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:04.819 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.810+0000 7f33a9e03640 1 -- 172.21.15.142:0/3578058620 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5938+0+0 (secure 0 0 0) 0x7f34b0098b10 con 0x5585d5953be0 2024-09-22T08:37:04.820 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.810+0000 7f34b4b08640 1 --2- 172.21.15.142:0/3578058620 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f33a403d000 0x7f33a403f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:04.820 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.810+0000 7f34c1726800 1 --2- 172.21.15.142:0/3578058620 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5585d5958850 0x5585d5a56360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:04.820 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.810+0000 7f34c1726800 1 -- 172.21.15.142:0/3578058620 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5585d5a568a0 con 0x5585d5958850 2024-09-22T08:37:04.820 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.811+0000 7f34bdb0a640 1 --2- 172.21.15.142:0/3578058620 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5585d5958850 0x5585d5a56360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:04.820 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.811+0000 7f34b4b08640 1 --2- 172.21.15.142:0/3578058620 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f33a403d000 0x7f33a403f4c0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f34a8001d70 tx=0x7f34a80012d0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:04.820 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.811+0000 7f34bdb0a640 1 --2- 172.21.15.142:0/3578058620 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5585d5958850 0x5585d5a56360 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:04.820 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.811+0000 7f34bdb0a640 1 -- 172.21.15.142:0/3578058620 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f34b800a4d0 con 0x5585d5958850 2024-09-22T08:37:04.820 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.811+0000 7f34c1726800 1 -- 172.21.15.142:0/3578058620 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5585d5a56c40 con 0x5585d5958850 2024-09-22T08:37:04.820 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.811+0000 7f34bdb0a640 1 -- 172.21.15.142:0/3578058620 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f34b800a4d0 con 0x5585d5958850 2024-09-22T08:37:04.820 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.811+0000 7f34c1726800 1 --2- 172.21.15.142:0/3578058620 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5585d5a58740 0x5585d5a5abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:04.820 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.811+0000 7f34c1726800 1 -- 172.21.15.142:0/3578058620 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:3 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5585d5a5b370 con 0x5585d5a58740 2024-09-22T08:37:04.820 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.811+0000 7f34bd309640 1 --2- 172.21.15.142:0/3578058620 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5585d5a58740 0x5585d5a5abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:04.820 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.812+0000 7f34bd309640 1 --2- 172.21.15.142:0/3578058620 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5585d5a58740 0x5585d5a5abe0 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:04.821 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.812+0000 7f34bd309640 1 -- 172.21.15.142:0/3578058620 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(3 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f34b0051070 con 0x5585d5a58740 2024-09-22T08:37:04.821 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.812+0000 7f34c1726800 1 -- 172.21.15.142:0/3578058620 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5585d5a57490 con 0x5585d5958850 2024-09-22T08:37:04.821 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.812+0000 7f34bdb0a640 1 -- 172.21.15.142:0/3578058620 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f34b800a4d0 con 0x5585d5958850 2024-09-22T08:37:04.821 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.812+0000 7f34c1726800 1 -- 172.21.15.142:0/3578058620 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5585d5a578b0 con 0x5585d5a58740 2024-09-22T08:37:04.821 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.813+0000 7f34bd309640 1 -- 172.21.15.142:0/3578058620 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(5 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f34b0051070 con 0x5585d5a58740 2024-09-22T08:37:04.821 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.813+0000 7f34c1726800 1 Processor -- start 2024-09-22T08:37:04.821 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.813+0000 7f34c1726800 1 -- start start 2024-09-22T08:37:04.821 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.813+0000 7f34c1726800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5585d5a69cc0 0x5585d5a6a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:04.821 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.813+0000 7f34c1726800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5585d584cd50 con 0x5585d5a69cc0 2024-09-22T08:37:04.821 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.813+0000 7f34bdb0a640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5585d5a69cc0 0x5585d5a6a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:04.822 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.813+0000 7f34bdb0a640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5585d5a69cc0 0x5585d5a6a0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:59362/0 (socket says 172.21.15.142:59362) 2024-09-22T08:37:04.822 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.813+0000 7f34bdb0a640 1 -- 172.21.15.142:0/2332505303 learned_addr learned my addr 172.21.15.142:0/2332505303 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:37:04.822 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.814+0000 7f34bdb0a640 1 -- 172.21.15.142:0/2332505303 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5585d5a6a720 con 0x5585d5a69cc0 2024-09-22T08:37:04.822 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.814+0000 7f34bdb0a640 1 --2- 172.21.15.142:0/2332505303 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5585d5a69cc0 0x5585d5a6a0e0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x5585d5a4fa20 tx=0x7f34b80167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:04.822 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.814+0000 7f33a2ffd640 1 -- 172.21.15.142:0/2332505303 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34b8013640 con 0x5585d5a69cc0 2024-09-22T08:37:04.822 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.814+0000 7f33a2ffd640 1 -- 172.21.15.142:0/2332505303 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34b80137e0 con 0x5585d5a69cc0 2024-09-22T08:37:04.822 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.814+0000 7f34c1726800 1 -- 172.21.15.142:0/2332505303 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5585d5a6af50 con 0x5585d5a69cc0 2024-09-22T08:37:04.822 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.814+0000 7f33a2ffd640 1 -- 172.21.15.142:0/2332505303 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34b8013ae0 con 0x5585d5a69cc0 2024-09-22T08:37:04.822 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.814+0000 7f34c1726800 1 -- 172.21.15.142:0/2332505303 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5585d5a6b4f0 con 0x5585d5a69cc0 2024-09-22T08:37:04.822 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.815+0000 7f33a2ffd640 1 -- 172.21.15.142:0/2332505303 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f34b8011040 con 0x5585d5a69cc0 2024-09-22T08:37:04.822 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.815+0000 7f33a2ffd640 1 --2- 172.21.15.142:0/2332505303 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f339403cfb0 0x7f339403f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:04.822 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.815+0000 7f33a2ffd640 1 -- 172.21.15.142:0/2332505303 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5938+0+0 (secure 0 0 0) 0x7f34b800e040 con 0x5585d5a69cc0 2024-09-22T08:37:04.823 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.815+0000 7f34bd309640 1 --2- 172.21.15.142:0/2332505303 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f339403cfb0 0x7f339403f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:04.823 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.815+0000 7f34c1726800 1 Processor -- start 2024-09-22T08:37:04.823 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.815+0000 7f34bd309640 1 --2- 172.21.15.142:0/2332505303 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f339403cfb0 0x7f339403f470 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x5585d5a5b710 tx=0x7f34b005ce20 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:04.823 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.815+0000 7f34c1726800 1 -- start start 2024-09-22T08:37:04.823 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.816+0000 7f34c1726800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5585d5a76780 0x5585d5a76b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:04.823 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.816+0000 7f34c1726800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5585d59549c0 con 0x5585d5a76780 2024-09-22T08:37:04.823 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.816+0000 7f34bdb0a640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5585d5a76780 0x5585d5a76b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:04.823 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.816+0000 7f34bdb0a640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5585d5a76780 0x5585d5a76b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:59370/0 (socket says 172.21.15.142:59370) 2024-09-22T08:37:04.823 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.816+0000 7f34bdb0a640 1 -- 172.21.15.142:0/1419183416 learned_addr learned my addr 172.21.15.142:0/1419183416 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:37:04.823 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.816+0000 7f34bdb0a640 1 -- 172.21.15.142:0/1419183416 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5585d5a77170 con 0x5585d5a76780 2024-09-22T08:37:04.823 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.816+0000 7f34bdb0a640 1 --2- 172.21.15.142:0/1419183416 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5585d5a76780 0x5585d5a76b80 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f34b8054840 tx=0x7f34b8020460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=535b889f6f6078b5 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:04.823 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.816+0000 7f33a0ff9640 1 -- 172.21.15.142:0/1419183416 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34b80143c0 con 0x5585d5a76780 2024-09-22T08:37:04.824 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.816+0000 7f33a0ff9640 1 -- 172.21.15.142:0/1419183416 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34b8052070 con 0x5585d5a76780 2024-09-22T08:37:04.824 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.816+0000 7f33a0ff9640 1 -- 172.21.15.142:0/1419183416 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34b8021a80 con 0x5585d5a76780 2024-09-22T08:37:04.824 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.817+0000 7f34c1726800 1 -- 172.21.15.142:0/1419183416 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5585d5a76780 msgr2=0x5585d5a76b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:04.824 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.817+0000 7f34c1726800 1 --2- 172.21.15.142:0/1419183416 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5585d5a76780 0x5585d5a76b80 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f34b8054840 tx=0x7f34b8020460 comp rx=0 tx=0).stop 2024-09-22T08:37:04.824 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.817+0000 7f34c1726800 1 -- 172.21.15.142:0/1419183416 shutdown_connections 2024-09-22T08:37:04.824 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.817+0000 7f34c1726800 1 --2- 172.21.15.142:0/1419183416 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5585d5a76780 0x5585d5a76b80 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:04.824 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.817+0000 7f34c1726800 1 -- 172.21.15.142:0/1419183416 >> 172.21.15.142:0/1419183416 conn(0x5585d5a72b80 msgr2=0x5585d5a70dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:37:04.824 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.817+0000 7f34c1726800 1 -- 172.21.15.142:0/1419183416 shutdown_connections 2024-09-22T08:37:04.824 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.817+0000 7f34c1726800 1 -- 172.21.15.142:0/1419183416 wait complete. 2024-09-22T08:37:04.824 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.817+0000 7f34c1726800 1 Processor -- start 2024-09-22T08:37:04.824 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.817+0000 7f34c1726800 1 -- start start 2024-09-22T08:37:04.824 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.817+0000 7f34c1726800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5585d5a76780 0x5585d5a7dd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:04.825 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.817+0000 7f34c1726800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5585d5a77790 con 0x5585d5a76780 2024-09-22T08:37:04.825 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.818+0000 7f34bdb0a640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5585d5a76780 0x5585d5a7dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:04.825 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.818+0000 7f34bdb0a640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5585d5a76780 0x5585d5a7dd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:59376/0 (socket says 172.21.15.142:59376) 2024-09-22T08:37:04.825 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.818+0000 7f34bdb0a640 1 -- 172.21.15.142:0/4222915014 learned_addr learned my addr 172.21.15.142:0/4222915014 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:37:04.825 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.818+0000 7f34bdb0a640 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5585d5a7e2c0 con 0x5585d5a76780 2024-09-22T08:37:04.825 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.818+0000 7f34bdb0a640 1 --2- 172.21.15.142:0/4222915014 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5585d5a76780 0x5585d5a7dd60 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f34b801ff70 tx=0x7f34b80547d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:04.825 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.818+0000 7f3392ffd640 1 -- 172.21.15.142:0/4222915014 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34b80143c0 con 0x5585d5a76780 2024-09-22T08:37:04.825 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.818+0000 7f3392ffd640 1 -- 172.21.15.142:0/4222915014 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34b8045a10 con 0x5585d5a76780 2024-09-22T08:37:04.825 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.818+0000 7f34c1726800 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5585d5a7e550 con 0x5585d5a76780 2024-09-22T08:37:04.825 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.818+0000 7f3392ffd640 1 -- 172.21.15.142:0/4222915014 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34b8045d10 con 0x5585d5a76780 2024-09-22T08:37:04.825 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.818+0000 7f34c1726800 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5585d5a7eed0 con 0x5585d5a76780 2024-09-22T08:37:04.839 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.819+0000 7f3392ffd640 1 -- 172.21.15.142:0/4222915014 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f34b8054980 con 0x5585d5a76780 2024-09-22T08:37:04.839 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.819+0000 7f3392ffd640 1 --2- 172.21.15.142:0/4222915014 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f338803cfb0 0x7f338803f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:04.839 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.819+0000 7f34c1726800 20 rados->read ofs=0 len=0 2024-09-22T08:37:04.839 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.819+0000 7f3392ffd640 1 -- 172.21.15.142:0/4222915014 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5938+0+0 (secure 0 0 0) 0x7f34b804d050 con 0x5585d5a76780 2024-09-22T08:37:04.839 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.820+0000 7f34bd309640 1 --2- 172.21.15.142:0/4222915014 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f338803cfb0 0x7f338803f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:04.839 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.820+0000 7f34c1726800 1 --2- 172.21.15.142:0/4222915014 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5585d5a89700 0x5585d5a8bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:04.839 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.820+0000 7f34c1726800 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5585d5a8c2e0 con 0x5585d5a89700 2024-09-22T08:37:04.839 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.820+0000 7f34b4b08640 1 --2- 172.21.15.142:0/4222915014 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5585d5a89700 0x5585d5a8bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:04.840 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.820+0000 7f34bd309640 1 --2- 172.21.15.142:0/4222915014 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f338803cfb0 0x7f338803f470 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f34b0074fd0 tx=0x7f34b0089000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:04.840 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.820+0000 7f34b4b08640 1 --2- 172.21.15.142:0/4222915014 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5585d5a89700 0x5585d5a8bb90 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:04.840 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.820+0000 7f34b4b08640 1 -- 172.21.15.142:0/4222915014 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f34a8009050 con 0x5585d5a89700 2024-09-22T08:37:04.840 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.820+0000 7f34c1726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:04.840 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.820+0000 7f34c1726800 20 realm 2024-09-22T08:37:04.840 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.820+0000 7f34c1726800 20 rados->read ofs=0 len=0 2024-09-22T08:37:04.840 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.820+0000 7f34c1726800 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5585d5a88ab0 con 0x5585d5a89700 2024-09-22T08:37:04.840 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.821+0000 7f34b4b08640 1 -- 172.21.15.142:0/4222915014 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f34a8009050 con 0x5585d5a89700 2024-09-22T08:37:04.840 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.821+0000 7f34c1726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:04.840 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.821+0000 7f34c1726800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:37:04.840 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.821+0000 7f34c1726800 20 rados->read ofs=0 len=0 2024-09-22T08:37:04.840 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.821+0000 7f34c1726800 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5585d5a8cdc0 con 0x5585d5a89700 2024-09-22T08:37:04.840 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.821+0000 7f34b4b08640 1 -- 172.21.15.142:0/4222915014 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f34a8009050 con 0x5585d5a89700 2024-09-22T08:37:04.841 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.821+0000 7f34c1726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:04.841 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.821+0000 7f34c1726800 20 rados->read ofs=0 len=0 2024-09-22T08:37:04.841 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.821+0000 7f34c1726800 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5585d5a8d690 con 0x5585d5a89700 2024-09-22T08:37:04.841 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.821+0000 7f34b4b08640 1 -- 172.21.15.142:0/4222915014 <== osd.1 v2:172.21.15.142:6816/3192108003 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f34a8009050 con 0x5585d5a89700 2024-09-22T08:37:04.841 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.821+0000 7f34c1726800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:37:04.841 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.821+0000 7f34c1726800 20 rados->read ofs=0 len=0 2024-09-22T08:37:04.841 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.821+0000 7f34c1726800 1 --2- 172.21.15.142:0/4222915014 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5585d5a8dfd0 0x5585d5a903c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:04.841 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.821+0000 7f34c1726800 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5585d5a90b00 con 0x5585d5a8dfd0 2024-09-22T08:37:04.841 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.821+0000 7f34bdb0a640 1 --2- 172.21.15.142:0/4222915014 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5585d5a8dfd0 0x5585d5a903c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:04.841 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.821+0000 7f34bdb0a640 1 --2- 172.21.15.142:0/4222915014 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5585d5a8dfd0 0x5585d5a903c0 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:04.841 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.822+0000 7f34bdb0a640 1 -- 172.21.15.142:0/4222915014 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(5 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f34b803a070 con 0x5585d5a8dfd0 2024-09-22T08:37:04.841 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.822+0000 7f34c1726800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:37:04.842 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.822+0000 7f34c1726800 20 searching for the correct realm 2024-09-22T08:37:04.842 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.822+0000 7f34c1726800 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5585d5a924b0 con 0x5585d5a8dfd0 2024-09-22T08:37:04.842 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.822+0000 7f34bdb0a640 1 -- 172.21.15.142:0/4222915014 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34b803a070 con 0x5585d5a8dfd0 2024-09-22T08:37:04.842 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.822+0000 7f34bdb0a640 1 --2- 172.21.15.142:0/4222915014 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f34b8012ab0 0x7f34b80123d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:04.842 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.822+0000 7f34bdb0a640 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5585d5a924b0 con 0x7f34b8012ab0 2024-09-22T08:37:04.842 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.822+0000 7f34bd309640 1 --2- 172.21.15.142:0/4222915014 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f34b8012ab0 0x7f34b80123d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:04.842 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.823+0000 7f34bd309640 1 --2- 172.21.15.142:0/4222915014 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f34b8012ab0 0x7f34b80123d0 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:04.842 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.823+0000 7f34bd309640 1 -- 172.21.15.142:0/4222915014 <== osd.2 v2:172.21.15.142:6808/279438927 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34b0051070 con 0x7f34b8012ab0 2024-09-22T08:37:04.842 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.823+0000 7f34bd309640 1 --2- 172.21.15.142:0/4222915014 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f34b00a5040 0x7f34b0052820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:04.842 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.823+0000 7f34bd309640 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5585d5a924b0 con 0x7f34b00a5040 2024-09-22T08:37:04.842 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.823+0000 7f34b4b08640 1 --2- 172.21.15.142:0/4222915014 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f34b00a5040 0x7f34b0052820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:04.842 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.823+0000 7f34b4b08640 1 --2- 172.21.15.142:0/4222915014 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f34b00a5040 0x7f34b0052820 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:04.842 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.824+0000 7f34b4b08640 1 -- 172.21.15.142:0/4222915014 <== osd.0 v2:172.21.15.31:6800/168281188 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34a8009050 con 0x7f34b00a5040 2024-09-22T08:37:04.843 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.824+0000 7f34b4b08640 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5585d5a924b0 con 0x5585d5a89700 2024-09-22T08:37:04.843 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.824+0000 7f34b4b08640 1 -- 172.21.15.142:0/4222915014 <== osd.1 v2:172.21.15.142:6816/3192108003 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34a8009050 con 0x5585d5a89700 2024-09-22T08:37:04.843 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.824+0000 7f34b4b08640 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5585d5a924b0 con 0x5585d5a89700 2024-09-22T08:37:04.843 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.824+0000 7f34b4b08640 1 -- 172.21.15.142:0/4222915014 <== osd.1 v2:172.21.15.142:6816/3192108003 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34a8029040 con 0x5585d5a89700 2024-09-22T08:37:04.843 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.824+0000 7f34b4b08640 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5585d5a924b0 con 0x5585d5a89700 2024-09-22T08:37:04.843 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.824+0000 7f34b4b08640 1 -- 172.21.15.142:0/4222915014 <== osd.1 v2:172.21.15.142:6816/3192108003 7 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34a8029040 con 0x5585d5a89700 2024-09-22T08:37:04.843 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.824+0000 7f34b4b08640 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5585d5a924b0 con 0x7f34b00a5040 2024-09-22T08:37:04.843 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.825+0000 7f34b4b08640 1 -- 172.21.15.142:0/4222915014 <== osd.0 v2:172.21.15.31:6800/168281188 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34a8029040 con 0x7f34b00a5040 2024-09-22T08:37:04.843 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.825+0000 7f34b4b08640 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5585d5a924b0 con 0x7f34b8012ab0 2024-09-22T08:37:04.843 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.825+0000 7f34bd309640 1 -- 172.21.15.142:0/4222915014 <== osd.2 v2:172.21.15.142:6808/279438927 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34b0051070 con 0x7f34b8012ab0 2024-09-22T08:37:04.843 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.825+0000 7f34bd309640 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5585d5a924b0 con 0x5585d5a8dfd0 2024-09-22T08:37:04.843 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.825+0000 7f34bdb0a640 1 -- 172.21.15.142:0/4222915014 <== osd.3 v2:172.21.15.142:6800/1064901393 3 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34b803a070 con 0x5585d5a8dfd0 2024-09-22T08:37:04.843 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.825+0000 7f34bdb0a640 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5585d5a924b0 con 0x5585d5a89700 2024-09-22T08:37:04.844 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.825+0000 7f34b4b08640 1 -- 172.21.15.142:0/4222915014 <== osd.1 v2:172.21.15.142:6816/3192108003 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34a8029040 con 0x5585d5a89700 2024-09-22T08:37:04.844 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.825+0000 7f34b4b08640 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5585d5a924b0 con 0x7f34b00a5040 2024-09-22T08:37:04.844 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.826+0000 7f34b4b08640 1 -- 172.21.15.142:0/4222915014 <== osd.0 v2:172.21.15.31:6800/168281188 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34a8029040 con 0x7f34b00a5040 2024-09-22T08:37:04.844 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.826+0000 7f34b4b08640 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5585d5a924b0 con 0x5585d5a89700 2024-09-22T08:37:04.844 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.826+0000 7f34b4b08640 1 -- 172.21.15.142:0/4222915014 <== osd.1 v2:172.21.15.142:6816/3192108003 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34a8029040 con 0x5585d5a89700 2024-09-22T08:37:04.844 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.826+0000 7f34b4b08640 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5585d5a924b0 con 0x7f34b8012ab0 2024-09-22T08:37:04.844 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.826+0000 7f34bd309640 1 -- 172.21.15.142:0/4222915014 <== osd.2 v2:172.21.15.142:6808/279438927 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f34b0051070 con 0x7f34b8012ab0 2024-09-22T08:37:04.844 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.826+0000 7f34bd309640 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5585d5a924b0 con 0x5585d5a8dfd0 2024-09-22T08:37:04.844 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.826+0000 7f34bdb0a640 1 -- 172.21.15.142:0/4222915014 <== osd.3 v2:172.21.15.142:6800/1064901393 4 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34b803a070 con 0x5585d5a8dfd0 2024-09-22T08:37:04.844 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.826+0000 7f34bdb0a640 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5585d5a924b0 con 0x5585d5a8dfd0 2024-09-22T08:37:04.844 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.827+0000 7f34bdb0a640 1 -- 172.21.15.142:0/4222915014 <== osd.3 v2:172.21.15.142:6800/1064901393 5 ==== osd_op_reply(20 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f34b803a070 con 0x5585d5a8dfd0 2024-09-22T08:37:04.844 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.827+0000 7f34bdb0a640 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5585d5a924b0 con 0x7f34b00a5040 2024-09-22T08:37:04.844 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.827+0000 7f34b4b08640 1 -- 172.21.15.142:0/4222915014 <== osd.0 v2:172.21.15.31:6800/168281188 4 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34a8029040 con 0x7f34b00a5040 2024-09-22T08:37:04.845 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.827+0000 7f34b4b08640 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5585d5a924b0 con 0x5585d5a8dfd0 2024-09-22T08:37:04.845 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.827+0000 7f34bdb0a640 1 -- 172.21.15.142:0/4222915014 <== osd.3 v2:172.21.15.142:6800/1064901393 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34b803a070 con 0x5585d5a8dfd0 2024-09-22T08:37:04.845 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.827+0000 7f34bdb0a640 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5585d5a924b0 con 0x5585d5a8dfd0 2024-09-22T08:37:04.845 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.827+0000 7f34bdb0a640 1 -- 172.21.15.142:0/4222915014 <== osd.3 v2:172.21.15.142:6800/1064901393 7 ==== osd_op_reply(23 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f34b803a070 con 0x5585d5a8dfd0 2024-09-22T08:37:04.845 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.827+0000 7f34bdb0a640 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5585d5a924b0 con 0x5585d5a89700 2024-09-22T08:37:04.845 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.827+0000 7f34b4b08640 1 -- 172.21.15.142:0/4222915014 <== osd.1 v2:172.21.15.142:6816/3192108003 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34a8029040 con 0x5585d5a89700 2024-09-22T08:37:04.845 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.828+0000 7f34b4b08640 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5585d5a924b0 con 0x5585d5a89700 2024-09-22T08:37:04.845 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.828+0000 7f34b4b08640 1 -- 172.21.15.142:0/4222915014 <== osd.1 v2:172.21.15.142:6816/3192108003 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f34a8029040 con 0x5585d5a89700 2024-09-22T08:37:04.845 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.828+0000 7f34b4b08640 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5585d5a924b0 con 0x7f34b00a5040 2024-09-22T08:37:04.845 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.828+0000 7f34b4b08640 1 -- 172.21.15.142:0/4222915014 <== osd.0 v2:172.21.15.31:6800/168281188 5 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34a8029040 con 0x7f34b00a5040 2024-09-22T08:37:04.845 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.828+0000 7f34b4b08640 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5585d5a924b0 con 0x5585d5a8dfd0 2024-09-22T08:37:04.845 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.829+0000 7f34bdb0a640 1 -- 172.21.15.142:0/4222915014 <== osd.3 v2:172.21.15.142:6800/1064901393 8 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34b803a070 con 0x5585d5a8dfd0 2024-09-22T08:37:04.845 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.829+0000 7f34bdb0a640 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5585d5a924b0 con 0x7f34b8012ab0 2024-09-22T08:37:04.846 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.829+0000 7f34bd309640 1 -- 172.21.15.142:0/4222915014 <== osd.2 v2:172.21.15.142:6808/279438927 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34b0051070 con 0x7f34b8012ab0 2024-09-22T08:37:04.846 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.829+0000 7f34bd309640 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5585d5a924b0 con 0x5585d5a89700 2024-09-22T08:37:04.846 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.829+0000 7f34b4b08640 1 -- 172.21.15.142:0/4222915014 <== osd.1 v2:172.21.15.142:6816/3192108003 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34a8029040 con 0x5585d5a89700 2024-09-22T08:37:04.846 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.829+0000 7f34b4b08640 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5585d5a924b0 con 0x7f34b00a5040 2024-09-22T08:37:04.846 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.829+0000 7f34b4b08640 1 -- 172.21.15.142:0/4222915014 <== osd.0 v2:172.21.15.31:6800/168281188 6 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34a8029040 con 0x7f34b00a5040 2024-09-22T08:37:04.846 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.829+0000 7f34b4b08640 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5585d5a924b0 con 0x5585d5a8dfd0 2024-09-22T08:37:04.846 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.830+0000 7f34bdb0a640 1 -- 172.21.15.142:0/4222915014 <== osd.3 v2:172.21.15.142:6800/1064901393 9 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34b803a070 con 0x5585d5a8dfd0 2024-09-22T08:37:04.846 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.830+0000 7f34bdb0a640 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5585d5a924b0 con 0x7f34b00a5040 2024-09-22T08:37:04.846 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.830+0000 7f34b4b08640 1 -- 172.21.15.142:0/4222915014 <== osd.0 v2:172.21.15.31:6800/168281188 7 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34a8029040 con 0x7f34b00a5040 2024-09-22T08:37:04.846 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.830+0000 7f34b4b08640 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5585d5a924b0 con 0x7f34b8012ab0 2024-09-22T08:37:04.846 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.830+0000 7f34bd309640 1 -- 172.21.15.142:0/4222915014 <== osd.2 v2:172.21.15.142:6808/279438927 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34b0051070 con 0x7f34b8012ab0 2024-09-22T08:37:04.846 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.830+0000 7f34bd309640 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5585d5a924b0 con 0x5585d5a8dfd0 2024-09-22T08:37:04.847 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.830+0000 7f34bdb0a640 1 -- 172.21.15.142:0/4222915014 <== osd.3 v2:172.21.15.142:6800/1064901393 10 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34b803a070 con 0x5585d5a8dfd0 2024-09-22T08:37:04.847 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.830+0000 7f34bdb0a640 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5585d5a924b0 con 0x7f34b00a5040 2024-09-22T08:37:04.847 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.831+0000 7f34b4b08640 1 -- 172.21.15.142:0/4222915014 <== osd.0 v2:172.21.15.31:6800/168281188 8 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34a8029040 con 0x7f34b00a5040 2024-09-22T08:37:04.847 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.831+0000 7f34b4b08640 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5585d5a924b0 con 0x5585d5a89700 2024-09-22T08:37:04.847 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.831+0000 7f34b4b08640 1 -- 172.21.15.142:0/4222915014 <== osd.1 v2:172.21.15.142:6816/3192108003 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f34a8029040 con 0x5585d5a89700 2024-09-22T08:37:04.847 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.831+0000 7f34b4b08640 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5585d5a924b0 con 0x7f34b8012ab0 2024-09-22T08:37:04.847 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.831+0000 7f34bd309640 1 -- 172.21.15.142:0/4222915014 <== osd.2 v2:172.21.15.142:6808/279438927 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34b0051070 con 0x7f34b8012ab0 2024-09-22T08:37:04.847 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.831+0000 7f34c1726800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:37:04.847 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.831+0000 7f34c1726800 20 RGWRados::pool_iterate: got zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec 2024-09-22T08:37:04.847 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.831+0000 7f34c1726800 20 RGWRados::pool_iterate: got zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f 2024-09-22T08:37:04.847 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.831+0000 7f34c1726800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:37:04.847 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.831+0000 7f34c1726800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:37:04.847 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.831+0000 7f34c1726800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:37:04.847 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.831+0000 7f34c1726800 20 rados->read ofs=0 len=0 2024-09-22T08:37:04.848 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.831+0000 7f34c1726800 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5585d5a91580 con 0x5585d5a89700 2024-09-22T08:37:04.848 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.831+0000 7f34b4b08640 1 -- 172.21.15.142:0/4222915014 <== osd.1 v2:172.21.15.142:6816/3192108003 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f34a8029040 con 0x5585d5a89700 2024-09-22T08:37:04.848 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.831+0000 7f34c1726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:04.848 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.831+0000 7f34c1726800 20 rados->read ofs=0 len=0 2024-09-22T08:37:04.848 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.831+0000 7f34c1726800 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5585d5a911c0 con 0x5585d5a89700 2024-09-22T08:37:04.848 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.832+0000 7f34b4b08640 1 -- 172.21.15.142:0/4222915014 <== osd.1 v2:172.21.15.142:6816/3192108003 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f34a8029040 con 0x5585d5a89700 2024-09-22T08:37:04.848 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.832+0000 7f34c1726800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:37:04.848 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.832+0000 7f34c1726800 20 rados->read ofs=0 len=0 2024-09-22T08:37:04.848 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.832+0000 7f34c1726800 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:40 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5585d5a91ee0 con 0x5585d5a8dfd0 2024-09-22T08:37:04.848 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.832+0000 7f34bdb0a640 1 -- 172.21.15.142:0/4222915014 <== osd.3 v2:172.21.15.142:6800/1064901393 11 ==== osd_op_reply(40 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f34b803a070 con 0x5585d5a8dfd0 2024-09-22T08:37:04.848 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.832+0000 7f34c1726800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:37:04.848 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.832+0000 7f34c1726800 20 zone default found 2024-09-22T08:37:04.849 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.832+0000 7f34c1726800 4 Realm: () 2024-09-22T08:37:04.849 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.832+0000 7f34c1726800 4 ZoneGroup: default (d89f6f57-1007-47dd-9065-f486c7b01aec) 2024-09-22T08:37:04.849 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.832+0000 7f34c1726800 4 Zone: default (e239248c-0bee-4e41-803a-24b288d3eb8f) 2024-09-22T08:37:04.849 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.832+0000 7f34c1726800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:37:04.849 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.832+0000 7f34c1726800 20 zonegroup default 2024-09-22T08:37:04.849 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.832+0000 7f34c1726800 20 rados->read ofs=0 len=0 2024-09-22T08:37:04.849 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.832+0000 7f34c1726800 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5585d5a91a50 con 0x7f34b00a5040 2024-09-22T08:37:04.849 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.832+0000 7f34b4b08640 1 -- 172.21.15.142:0/4222915014 <== osd.0 v2:172.21.15.31:6800/168281188 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f34a8029040 con 0x7f34b00a5040 2024-09-22T08:37:04.849 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.832+0000 7f34c1726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:04.849 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.832+0000 7f34c1726800 20 rados->read ofs=0 len=0 2024-09-22T08:37:04.849 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.832+0000 7f34c1726800 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5585d5a94d50 con 0x5585d5a8dfd0 2024-09-22T08:37:04.849 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.832+0000 7f34bdb0a640 1 -- 172.21.15.142:0/4222915014 <== osd.3 v2:172.21.15.142:6800/1064901393 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f34b803a070 con 0x5585d5a8dfd0 2024-09-22T08:37:04.850 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.832+0000 7f34c1726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:04.850 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.832+0000 7f34c1726800 20 rados->read ofs=0 len=0 2024-09-22T08:37:04.850 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.832+0000 7f34c1726800 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5585d5a950f0 con 0x5585d5a8dfd0 2024-09-22T08:37:04.850 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.833+0000 7f34bdb0a640 1 -- 172.21.15.142:0/4222915014 <== osd.3 v2:172.21.15.142:6800/1064901393 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f34b803a070 con 0x5585d5a8dfd0 2024-09-22T08:37:04.850 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.833+0000 7f34c1726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:04.850 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.833+0000 7f34c1726800 20 started sync module instance, tier type = 2024-09-22T08:37:04.850 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.833+0000 7f34c1726800 20 started zone id=e239248c-0bee-4e41-803a-24b288d3eb8f (name=default) with tier type = 2024-09-22T08:37:04.850 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.833+0000 7f34c1726800 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5585d5a941e0 con 0x7f34b8012ab0 2024-09-22T08:37:04.850 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.834+0000 7f34bd309640 1 -- 172.21.15.142:0/4222915014 <== osd.2 v2:172.21.15.142:6808/279438927 7 ==== osd_op_reply(44 notify.0 [create] v32'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34b0051070 con 0x7f34b8012ab0 2024-09-22T08:37:04.850 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.834+0000 7f34c1726800 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94033303651840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5585d5a93e40 con 0x7f34b8012ab0 2024-09-22T08:37:04.850 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.834+0000 7f34c1726800 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5585d5a96020 con 0x5585d5a89700 2024-09-22T08:37:04.850 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.835+0000 7f34bd309640 1 -- 172.21.15.142:0/4222915014 <== osd.2 v2:172.21.15.142:6808/279438927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94033303651840] v32'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34b0051070 con 0x7f34b8012ab0 2024-09-22T08:37:04.851 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.835+0000 7f34b4b08640 1 -- 172.21.15.142:0/4222915014 <== osd.1 v2:172.21.15.142:6816/3192108003 16 ==== osd_op_reply(46 notify.1 [create] v32'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34a8029040 con 0x5585d5a89700 2024-09-22T08:37:04.851 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.835+0000 7f34c1726800 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94033303657328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5585d5a96440 con 0x5585d5a89700 2024-09-22T08:37:04.851 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.835+0000 7f34c1726800 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5585d5a96e00 con 0x5585d5a8dfd0 2024-09-22T08:37:04.851 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.836+0000 7f34bdb0a640 1 -- 172.21.15.142:0/4222915014 <== osd.3 v2:172.21.15.142:6800/1064901393 14 ==== osd_op_reply(48 notify.2 [create] v32'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34b803a070 con 0x5585d5a8dfd0 2024-09-22T08:37:04.851 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.836+0000 7f34c1726800 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94033303660880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5585d5a96d70 con 0x5585d5a8dfd0 2024-09-22T08:37:04.851 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.836+0000 7f34c1726800 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5585d5a97df0 con 0x7f34b8012ab0 2024-09-22T08:37:04.851 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.837+0000 7f34b4b08640 1 -- 172.21.15.142:0/4222915014 <== osd.1 v2:172.21.15.142:6816/3192108003 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94033303657328] v32'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34a8029040 con 0x5585d5a89700 2024-09-22T08:37:04.851 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.837+0000 7f34bd309640 1 -- 172.21.15.142:0/4222915014 <== osd.2 v2:172.21.15.142:6808/279438927 9 ==== osd_op_reply(50 notify.3 [create] v32'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34b0051070 con 0x7f34b8012ab0 2024-09-22T08:37:04.851 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.837+0000 7f34c1726800 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94033303664832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5585d5a97db0 con 0x7f34b8012ab0 2024-09-22T08:37:04.851 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.837+0000 7f34c1726800 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5585d5a988a0 con 0x5585d5a89700 2024-09-22T08:37:04.851 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.838+0000 7f34bdb0a640 1 -- 172.21.15.142:0/4222915014 <== osd.3 v2:172.21.15.142:6800/1064901393 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94033303660880] v32'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34b803a070 con 0x5585d5a8dfd0 2024-09-22T08:37:04.856 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.838+0000 7f34bd309640 1 -- 172.21.15.142:0/4222915014 <== osd.2 v2:172.21.15.142:6808/279438927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94033303664832] v32'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34b0051070 con 0x7f34b8012ab0 2024-09-22T08:37:04.856 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.839+0000 7f34b4b08640 1 -- 172.21.15.142:0/4222915014 <== osd.1 v2:172.21.15.142:6816/3192108003 18 ==== osd_op_reply(52 notify.4 [create] v32'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34a8029040 con 0x5585d5a89700 2024-09-22T08:37:04.856 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.839+0000 7f34c1726800 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94033303658384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5585d5a988a0 con 0x5585d5a89700 2024-09-22T08:37:04.856 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.839+0000 7f34c1726800 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5585d5a99170 con 0x7f34b00a5040 2024-09-22T08:37:04.856 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.840+0000 7f34b4b08640 1 -- 172.21.15.142:0/4222915014 <== osd.0 v2:172.21.15.31:6800/168281188 10 ==== osd_op_reply(54 notify.5 [create] v32'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34a8029040 con 0x7f34b00a5040 2024-09-22T08:37:04.856 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.840+0000 7f34c1726800 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94033303668896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5585d5a99210 con 0x7f34b00a5040 2024-09-22T08:37:04.856 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.840+0000 7f34c1726800 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5585d5a99d30 con 0x7f34b00a5040 2024-09-22T08:37:04.856 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.840+0000 7f34b4b08640 1 -- 172.21.15.142:0/4222915014 <== osd.1 v2:172.21.15.142:6816/3192108003 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94033303658384] v32'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34a8029040 con 0x5585d5a89700 2024-09-22T08:37:04.856 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.841+0000 7f34b4b08640 1 -- 172.21.15.142:0/4222915014 <== osd.0 v2:172.21.15.31:6800/168281188 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94033303668896] v32'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34a8029040 con 0x7f34b00a5040 2024-09-22T08:37:04.856 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.841+0000 7f34b4b08640 1 -- 172.21.15.142:0/4222915014 <== osd.0 v2:172.21.15.31:6800/168281188 12 ==== osd_op_reply(56 notify.6 [create] v32'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34a8029040 con 0x7f34b00a5040 2024-09-22T08:37:04.857 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.841+0000 7f34c1726800 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94033303669952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5585d5a983b0 con 0x7f34b00a5040 2024-09-22T08:37:04.857 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.841+0000 7f34c1726800 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5585d5a9a1a0 con 0x7f34b00a5040 2024-09-22T08:37:04.857 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.842+0000 7f34b4b08640 1 -- 172.21.15.142:0/4222915014 <== osd.0 v2:172.21.15.31:6800/168281188 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94033303669952] v32'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34a8029040 con 0x7f34b00a5040 2024-09-22T08:37:04.857 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.842+0000 7f34b4b08640 1 -- 172.21.15.142:0/4222915014 <== osd.0 v2:172.21.15.31:6800/168281188 14 ==== osd_op_reply(58 notify.7 [create] v32'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34a8029040 con 0x7f34b00a5040 2024-09-22T08:37:04.857 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.842+0000 7f34c1726800 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94033303672832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5585d5a9a1a0 con 0x7f34b00a5040 2024-09-22T08:37:04.857 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.842+0000 7f34c1726800 20 add_watcher() i=0 2024-09-22T08:37:04.857 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.842+0000 7f34c1726800 20 add_watcher() i=1 2024-09-22T08:37:04.857 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.842+0000 7f34c1726800 20 add_watcher() i=2 2024-09-22T08:37:04.857 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.842+0000 7f34c1726800 20 add_watcher() i=3 2024-09-22T08:37:04.857 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.842+0000 7f34c1726800 20 add_watcher() i=4 2024-09-22T08:37:04.857 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.842+0000 7f34c1726800 20 add_watcher() i=5 2024-09-22T08:37:04.857 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.842+0000 7f34c1726800 20 add_watcher() i=6 2024-09-22T08:37:04.857 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.843+0000 7f34b4b08640 1 -- 172.21.15.142:0/4222915014 <== osd.0 v2:172.21.15.31:6800/168281188 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94033303672832] v32'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34a8029040 con 0x7f34b00a5040 2024-09-22T08:37:04.858 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.843+0000 7f34c1726800 20 add_watcher() i=7 2024-09-22T08:37:04.858 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.843+0000 7f34c1726800 2 all 8 watchers are set, enabling cache 2024-09-22T08:37:04.858 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.843+0000 7f34c1726800 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5585d5a9d6f0 con 0x5585d5a89700 2024-09-22T08:37:04.858 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.843+0000 7f34b4b08640 1 -- 172.21.15.142:0/4222915014 <== osd.1 v2:172.21.15.142:6816/3192108003 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f34a8029040 con 0x5585d5a89700 2024-09-22T08:37:04.858 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.843+0000 7f34c1726800 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94033303675024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5585d5a9aa50 con 0x5585d5a89700 2024-09-22T08:37:04.858 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.844+0000 7f34b4b08640 1 -- 172.21.15.142:0/4222915014 <== osd.1 v2:172.21.15.142:6816/3192108003 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94033303675024] v32'168 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f34a8029040 con 0x5585d5a89700 2024-09-22T08:37:04.858 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.844+0000 7f3373fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:37:04.858 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.844+0000 7f34c1726800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:37:04.858 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.844+0000 7f34c1726800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:37:04.858 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.844+0000 7f34c1726800 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5585d5aa61d0 con 0x5585d5a89700 2024-09-22T08:37:04.858 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.846+0000 7f34b4b08640 1 -- 172.21.15.142:0/4222915014 <== osd.1 v2:172.21.15.142:6816/3192108003 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'28 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f34a8029040 con 0x5585d5a89700 2024-09-22T08:37:04.858 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.846+0000 7f34c1726800 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5585d5aa6680 con 0x7f34b00a5040 2024-09-22T08:37:04.858 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.847+0000 7f34b4b08640 1 -- 172.21.15.142:0/4222915014 <== osd.0 v2:172.21.15.31:6800/168281188 16 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'22 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f34a8029040 con 0x7f34b00a5040 2024-09-22T08:37:04.859 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.847+0000 7f34c1726800 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5585d5aa6850 con 0x5585d5a8dfd0 2024-09-22T08:37:04.859 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.848+0000 7f34bdb0a640 1 -- 172.21.15.142:0/4222915014 <== osd.3 v2:172.21.15.142:6800/1064901393 16 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'22 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f34b803a070 con 0x5585d5a8dfd0 2024-09-22T08:37:04.859 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.848+0000 7f34c1726800 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5585d5aa6850 con 0x5585d5a89700 2024-09-22T08:37:04.859 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.849+0000 7f34b4b08640 1 -- 172.21.15.142:0/4222915014 <== osd.1 v2:172.21.15.142:6816/3192108003 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'169 uv162 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f34a8029040 con 0x5585d5a89700 2024-09-22T08:37:04.859 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.849+0000 7f34c1726800 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5585d5aa6de0 con 0x7f34b8012ab0 2024-09-22T08:37:04.859 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.850+0000 7f34bd309640 1 -- 172.21.15.142:0/4222915014 <== osd.2 v2:172.21.15.142:6808/279438927 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'58 uv53 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f34b0051070 con 0x7f34b8012ab0 2024-09-22T08:37:04.859 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.850+0000 7f34c1726800 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5585d5aa7270 con 0x5585d5a8dfd0 2024-09-22T08:37:04.859 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.851+0000 7f34bdb0a640 1 -- 172.21.15.142:0/4222915014 <== osd.3 v2:172.21.15.142:6800/1064901393 17 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'37 uv34 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f34b803a070 con 0x5585d5a8dfd0 2024-09-22T08:37:04.859 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.851+0000 7f34c1726800 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5585d5aa7270 con 0x5585d5a89700 2024-09-22T08:37:04.859 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.852+0000 7f34b4b08640 1 -- 172.21.15.142:0/4222915014 <== osd.1 v2:172.21.15.142:6816/3192108003 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'24 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f34a8029040 con 0x5585d5a89700 2024-09-22T08:37:04.859 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.852+0000 7f34c1726800 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5585d5aa7270 con 0x7f34b00a5040 2024-09-22T08:37:04.859 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.853+0000 7f34b4b08640 1 -- 172.21.15.142:0/4222915014 <== osd.0 v2:172.21.15.31:6800/168281188 17 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'37 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f34a8029040 con 0x7f34b00a5040 2024-09-22T08:37:04.859 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.853+0000 7f34c1726800 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5585d5aa7270 con 0x7f34b8012ab0 2024-09-22T08:37:04.859 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.854+0000 7f34bd309640 1 -- 172.21.15.142:0/4222915014 <== osd.2 v2:172.21.15.142:6808/279438927 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'22 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f34b0051070 con 0x7f34b8012ab0 2024-09-22T08:37:04.860 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.854+0000 7f34c1726800 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5585d5aa7270 con 0x5585d5a8dfd0 2024-09-22T08:37:04.861 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.855+0000 7f34bdb0a640 1 -- 172.21.15.142:0/4222915014 <== osd.3 v2:172.21.15.142:6800/1064901393 18 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'28 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f34b803a070 con 0x5585d5a8dfd0 2024-09-22T08:37:04.861 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.855+0000 7f34c1726800 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5585d5aa77d0 con 0x7f34b8012ab0 2024-09-22T08:37:04.861 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.856+0000 7f34bd309640 1 -- 172.21.15.142:0/4222915014 <== osd.2 v2:172.21.15.142:6808/279438927 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'59 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f34b0051070 con 0x7f34b8012ab0 2024-09-22T08:37:04.861 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.856+0000 7f34c1726800 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5585d5aa77d0 con 0x7f34b00a5040 2024-09-22T08:37:04.861 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.857+0000 7f34b4b08640 1 -- 172.21.15.142:0/4222915014 <== osd.0 v2:172.21.15.31:6800/168281188 18 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'24 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f34a8029040 con 0x7f34b00a5040 2024-09-22T08:37:04.861 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.857+0000 7f34c1726800 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5585d5aa77d0 con 0x7f34b8012ab0 2024-09-22T08:37:04.861 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.858+0000 7f34bd309640 1 -- 172.21.15.142:0/4222915014 <== osd.2 v2:172.21.15.142:6808/279438927 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'22 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f34b0051070 con 0x7f34b8012ab0 2024-09-22T08:37:04.861 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.858+0000 7f34c1726800 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5585d5aa77d0 con 0x7f34b00a5040 2024-09-22T08:37:04.861 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.859+0000 7f34b4b08640 1 -- 172.21.15.142:0/4222915014 <== osd.0 v2:172.21.15.31:6800/168281188 19 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'45 uv44 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f34a8029040 con 0x7f34b00a5040 2024-09-22T08:37:04.862 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.859+0000 7f34c1726800 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5585d5aa77d0 con 0x5585d5a89700 2024-09-22T08:37:04.862 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.860+0000 7f34b4b08640 1 -- 172.21.15.142:0/4222915014 <== osd.1 v2:172.21.15.142:6816/3192108003 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'170 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f34a8029040 con 0x5585d5a89700 2024-09-22T08:37:04.862 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.860+0000 7f34c1726800 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5585d5aa77d0 con 0x5585d5a8dfd0 2024-09-22T08:37:04.863 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.861+0000 7f34bdb0a640 1 -- 172.21.15.142:0/4222915014 <== osd.3 v2:172.21.15.142:6800/1064901393 19 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'50 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f34b803a070 con 0x5585d5a8dfd0 2024-09-22T08:37:04.863 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.861+0000 7f34c1726800 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5585d5aa7860 con 0x7f34b8012ab0 2024-09-22T08:37:04.863 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.862+0000 7f34bd309640 1 -- 172.21.15.142:0/4222915014 <== osd.2 v2:172.21.15.142:6808/279438927 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'60 uv57 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f34b0051070 con 0x7f34b8012ab0 2024-09-22T08:37:04.863 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.862+0000 7f34c1726800 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5585d5aa7860 con 0x5585d5a8dfd0 2024-09-22T08:37:04.864 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.863+0000 7f34bdb0a640 1 -- 172.21.15.142:0/4222915014 <== osd.3 v2:172.21.15.142:6800/1064901393 20 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'22 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f34b803a070 con 0x5585d5a8dfd0 2024-09-22T08:37:04.864 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.863+0000 7f34c1726800 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5585d5aa7860 con 0x5585d5a89700 2024-09-22T08:37:04.865 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.864+0000 7f34b4b08640 1 -- 172.21.15.142:0/4222915014 <== osd.1 v2:172.21.15.142:6816/3192108003 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'30 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f34a8029040 con 0x5585d5a89700 2024-09-22T08:37:04.866 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.864+0000 7f34c1726800 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5585d5aa7860 con 0x5585d5a89700 2024-09-22T08:37:04.866 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.865+0000 7f34b4b08640 1 -- 172.21.15.142:0/4222915014 <== osd.1 v2:172.21.15.142:6816/3192108003 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'171 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f34a8029040 con 0x5585d5a89700 2024-09-22T08:37:04.867 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.865+0000 7f34c1726800 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5585d5aa7860 con 0x5585d5a8dfd0 2024-09-22T08:37:04.867 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.866+0000 7f34bdb0a640 1 -- 172.21.15.142:0/4222915014 <== osd.3 v2:172.21.15.142:6800/1064901393 21 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'51 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f34b803a070 con 0x5585d5a8dfd0 2024-09-22T08:37:04.868 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.866+0000 7f34c1726800 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5585d5aa79a0 con 0x7f34b8012ab0 2024-09-22T08:37:04.868 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.867+0000 7f34bd309640 1 -- 172.21.15.142:0/4222915014 <== osd.2 v2:172.21.15.142:6808/279438927 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'32 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f34b0051070 con 0x7f34b8012ab0 2024-09-22T08:37:04.869 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.867+0000 7f34c1726800 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5585d5aa79a0 con 0x5585d5a8dfd0 2024-09-22T08:37:04.869 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.868+0000 7f34bdb0a640 1 -- 172.21.15.142:0/4222915014 <== osd.3 v2:172.21.15.142:6800/1064901393 22 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'24 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f34b803a070 con 0x5585d5a8dfd0 2024-09-22T08:37:04.870 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.868+0000 7f34c1726800 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5585d5aa79a0 con 0x5585d5a8dfd0 2024-09-22T08:37:04.870 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.869+0000 7f34bdb0a640 1 -- 172.21.15.142:0/4222915014 <== osd.3 v2:172.21.15.142:6800/1064901393 23 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'28 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f34b803a070 con 0x5585d5a8dfd0 2024-09-22T08:37:04.870 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.869+0000 7f34c1726800 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5585d5aa6bf0 con 0x5585d5a8dfd0 2024-09-22T08:37:04.871 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.870+0000 7f34bdb0a640 1 -- 172.21.15.142:0/4222915014 <== osd.3 v2:172.21.15.142:6800/1064901393 24 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'18 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f34b803a070 con 0x5585d5a8dfd0 2024-09-22T08:37:04.871 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.870+0000 7f34c1726800 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5585d5aa6bf0 con 0x5585d5a8dfd0 2024-09-22T08:37:04.872 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.871+0000 7f34bdb0a640 1 -- 172.21.15.142:0/4222915014 <== osd.3 v2:172.21.15.142:6800/1064901393 25 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'38 uv36 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f34b803a070 con 0x5585d5a8dfd0 2024-09-22T08:37:04.872 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.871+0000 7f34c1726800 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5585d5aa6bf0 con 0x7f34b00a5040 2024-09-22T08:37:04.873 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.872+0000 7f34b4b08640 1 -- 172.21.15.142:0/4222915014 <== osd.0 v2:172.21.15.31:6800/168281188 20 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'24 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f34a8029040 con 0x7f34b00a5040 2024-09-22T08:37:04.873 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.872+0000 7f34c1726800 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5585d5aa6bf0 con 0x5585d5a8dfd0 2024-09-22T08:37:04.874 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.873+0000 7f34bdb0a640 1 -- 172.21.15.142:0/4222915014 <== osd.3 v2:172.21.15.142:6800/1064901393 26 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'22 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f34b803a070 con 0x5585d5a8dfd0 2024-09-22T08:37:04.874 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.873+0000 7f34c1726800 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5585d5aa79a0 con 0x7f34b00a5040 2024-09-22T08:37:04.875 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.874+0000 7f34b4b08640 1 -- 172.21.15.142:0/4222915014 <== osd.0 v2:172.21.15.31:6800/168281188 21 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'38 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f34a8029040 con 0x7f34b00a5040 2024-09-22T08:37:04.875 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.874+0000 7f34c1726800 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5585d5aa79d0 con 0x5585d5a8dfd0 2024-09-22T08:37:04.876 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.875+0000 7f34bdb0a640 1 -- 172.21.15.142:0/4222915014 <== osd.3 v2:172.21.15.142:6800/1064901393 27 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'52 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f34b803a070 con 0x5585d5a8dfd0 2024-09-22T08:37:04.876 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.875+0000 7f34c1726800 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5585d5aa79d0 con 0x7f34b00a5040 2024-09-22T08:37:04.877 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.876+0000 7f34b4b08640 1 -- 172.21.15.142:0/4222915014 <== osd.0 v2:172.21.15.31:6800/168281188 22 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'46 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f34a8029040 con 0x7f34b00a5040 2024-09-22T08:37:04.877 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.876+0000 7f34c1726800 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5585d5aa79e0 con 0x7f34b8012ab0 2024-09-22T08:37:04.878 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.877+0000 7f34bd309640 1 -- 172.21.15.142:0/4222915014 <== osd.2 v2:172.21.15.142:6808/279438927 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'28 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f34b0051070 con 0x7f34b8012ab0 2024-09-22T08:37:04.879 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.878+0000 7f3372fe5640 20 reqs_thread_entry: start 2024-09-22T08:37:04.879 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.878+0000 7f34c1726800 20 init_complete bucket index max shards: 11 2024-09-22T08:37:04.880 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.878+0000 7f34c1726800 20 Filter name: none 2024-09-22T08:37:04.880 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.878+0000 7f3370fe1640 20 reqs_thread_entry: start 2024-09-22T08:37:04.880 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.878+0000 7f34c1726800 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:94 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5585d5aa5c50 con 0x5585d5a89700 2024-09-22T08:37:04.880 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.878+0000 7f34b4b08640 1 -- 172.21.15.142:0/4222915014 <== osd.1 v2:172.21.15.142:6816/3192108003 28 ==== osd_op_reply(94 gc.0 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f34a8029040 con 0x5585d5a89700 2024-09-22T08:37:04.880 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.878+0000 7f34c1726800 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:95 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5585d5aa5c50 con 0x5585d5a89700 2024-09-22T08:37:04.880 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.878+0000 7f34b4b08640 1 -- 172.21.15.142:0/4222915014 <== osd.1 v2:172.21.15.142:6816/3192108003 29 ==== osd_op_reply(95 gc.0 [call out=24b] v0'0 uv27 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f34a8029040 con 0x5585d5a89700 2024-09-22T08:37:04.880 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.878+0000 7f34c1726800 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:96 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5585d5aa5c50 con 0x5585d5a89700 2024-09-22T08:37:04.883 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.879+0000 7f34b4b08640 1 -- 172.21.15.142:0/4222915014 <== osd.1 v2:172.21.15.142:6816/3192108003 30 ==== osd_op_reply(96 gc.0 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f34a8029040 con 0x5585d5a89700 2024-09-22T08:37:04.883 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.879+0000 7f34c1726800 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:97 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5585d5aa5c50 con 0x7f34b00a5040 2024-09-22T08:37:04.883 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.879+0000 7f34b4b08640 1 -- 172.21.15.142:0/4222915014 <== osd.0 v2:172.21.15.31:6800/168281188 23 ==== osd_op_reply(97 gc.1 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f34a8029040 con 0x7f34b00a5040 2024-09-22T08:37:04.883 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.879+0000 7f34c1726800 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:98 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5585d5aa5c50 con 0x7f34b00a5040 2024-09-22T08:37:04.883 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.879+0000 7f34b4b08640 1 -- 172.21.15.142:0/4222915014 <== osd.0 v2:172.21.15.31:6800/168281188 24 ==== osd_op_reply(98 gc.1 [call out=24b] v0'0 uv21 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f34a8029040 con 0x7f34b00a5040 2024-09-22T08:37:04.883 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.879+0000 7f34c1726800 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:99 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5585d5aa5c50 con 0x7f34b00a5040 2024-09-22T08:37:04.883 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.880+0000 7f34b4b08640 1 -- 172.21.15.142:0/4222915014 <== osd.0 v2:172.21.15.31:6800/168281188 25 ==== osd_op_reply(99 gc.1 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f34a8029040 con 0x7f34b00a5040 2024-09-22T08:37:04.883 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.880+0000 7f34c1726800 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:100 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5585d5aa5c50 con 0x5585d5a8dfd0 2024-09-22T08:37:04.883 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.880+0000 7f34bdb0a640 1 -- 172.21.15.142:0/4222915014 <== osd.3 v2:172.21.15.142:6800/1064901393 28 ==== osd_op_reply(100 gc.2 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f34b803a070 con 0x5585d5a8dfd0 2024-09-22T08:37:04.883 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.880+0000 7f34c1726800 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:101 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5585d5aa5c50 con 0x5585d5a8dfd0 2024-09-22T08:37:04.883 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.880+0000 7f34bdb0a640 1 -- 172.21.15.142:0/4222915014 <== osd.3 v2:172.21.15.142:6800/1064901393 29 ==== osd_op_reply(101 gc.2 [call out=24b] v0'0 uv21 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f34b803a070 con 0x5585d5a8dfd0 2024-09-22T08:37:04.884 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.880+0000 7f34c1726800 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:102 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5585d5aa5c50 con 0x5585d5a8dfd0 2024-09-22T08:37:04.884 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.880+0000 7f34bdb0a640 1 -- 172.21.15.142:0/4222915014 <== osd.3 v2:172.21.15.142:6800/1064901393 30 ==== osd_op_reply(102 gc.2 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f34b803a070 con 0x5585d5a8dfd0 2024-09-22T08:37:04.884 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.880+0000 7f34c1726800 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:103 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5585d5aa5c50 con 0x5585d5a89700 2024-09-22T08:37:04.884 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.881+0000 7f34b4b08640 1 -- 172.21.15.142:0/4222915014 <== osd.1 v2:172.21.15.142:6816/3192108003 31 ==== osd_op_reply(103 gc.3 [call out=15b] v0'0 uv162 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f34a8029040 con 0x5585d5a89700 2024-09-22T08:37:04.884 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.881+0000 7f34c1726800 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:104 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5585d5aa5c50 con 0x5585d5a89700 2024-09-22T08:37:04.884 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.881+0000 7f34b4b08640 1 -- 172.21.15.142:0/4222915014 <== osd.1 v2:172.21.15.142:6816/3192108003 32 ==== osd_op_reply(104 gc.3 [call out=24b] v0'0 uv162 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f34a8029040 con 0x5585d5a89700 2024-09-22T08:37:04.884 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.881+0000 7f34c1726800 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:105 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5585d5aa5c50 con 0x5585d5a89700 2024-09-22T08:37:04.884 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.881+0000 7f34b4b08640 1 -- 172.21.15.142:0/4222915014 <== osd.1 v2:172.21.15.142:6816/3192108003 33 ==== osd_op_reply(105 gc.3 [call out=15b] v0'0 uv162 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f34a8029040 con 0x5585d5a89700 2024-09-22T08:37:04.884 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.881+0000 7f34c1726800 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:106 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5585d5aa5c50 con 0x7f34b8012ab0 2024-09-22T08:37:04.884 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.881+0000 7f34bd309640 1 -- 172.21.15.142:0/4222915014 <== osd.2 v2:172.21.15.142:6808/279438927 18 ==== osd_op_reply(106 gc.4 [call out=15b] v0'0 uv53 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f34b0051070 con 0x7f34b8012ab0 2024-09-22T08:37:04.884 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.881+0000 7f34c1726800 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:107 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5585d5aa5c50 con 0x7f34b8012ab0 2024-09-22T08:37:04.885 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.882+0000 7f34bd309640 1 -- 172.21.15.142:0/4222915014 <== osd.2 v2:172.21.15.142:6808/279438927 19 ==== osd_op_reply(107 gc.4 [call out=24b] v0'0 uv53 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f34b0051070 con 0x7f34b8012ab0 2024-09-22T08:37:04.885 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.882+0000 7f34c1726800 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:108 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5585d5aa5c50 con 0x7f34b8012ab0 2024-09-22T08:37:04.890 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.882+0000 7f34bd309640 1 -- 172.21.15.142:0/4222915014 <== osd.2 v2:172.21.15.142:6808/279438927 20 ==== osd_op_reply(108 gc.4 [call out=15b] v0'0 uv53 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f34b0051070 con 0x7f34b8012ab0 2024-09-22T08:37:04.890 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.882+0000 7f34c1726800 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:109 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5585d5aa5c50 con 0x5585d5a8dfd0 2024-09-22T08:37:04.890 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.882+0000 7f34bdb0a640 1 -- 172.21.15.142:0/4222915014 <== osd.3 v2:172.21.15.142:6800/1064901393 31 ==== osd_op_reply(109 gc.5 [call out=15b] v0'0 uv34 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f34b803a070 con 0x5585d5a8dfd0 2024-09-22T08:37:04.890 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.882+0000 7f34c1726800 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:110 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5585d5aa5c50 con 0x5585d5a8dfd0 2024-09-22T08:37:04.890 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.882+0000 7f34bdb0a640 1 -- 172.21.15.142:0/4222915014 <== osd.3 v2:172.21.15.142:6800/1064901393 32 ==== osd_op_reply(110 gc.5 [call out=24b] v0'0 uv34 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f34b803a070 con 0x5585d5a8dfd0 2024-09-22T08:37:04.890 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.882+0000 7f34c1726800 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:111 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5585d5aa5c50 con 0x5585d5a8dfd0 2024-09-22T08:37:04.890 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.883+0000 7f34bdb0a640 1 -- 172.21.15.142:0/4222915014 <== osd.3 v2:172.21.15.142:6800/1064901393 33 ==== osd_op_reply(111 gc.5 [call out=15b] v0'0 uv34 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f34b803a070 con 0x5585d5a8dfd0 2024-09-22T08:37:04.891 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.883+0000 7f34c1726800 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:112 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5585d5aa5c50 con 0x5585d5a89700 2024-09-22T08:37:04.891 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.883+0000 7f34b4b08640 1 -- 172.21.15.142:0/4222915014 <== osd.1 v2:172.21.15.142:6816/3192108003 34 ==== osd_op_reply(112 gc.6 [call out=15b] v0'0 uv23 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f34a8029040 con 0x5585d5a89700 2024-09-22T08:37:04.891 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.883+0000 7f34c1726800 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:113 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5585d5aa5c50 con 0x5585d5a89700 2024-09-22T08:37:04.891 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.883+0000 7f34b4b08640 1 -- 172.21.15.142:0/4222915014 <== osd.1 v2:172.21.15.142:6816/3192108003 35 ==== osd_op_reply(113 gc.6 [call out=24b] v0'0 uv23 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f34a8029040 con 0x5585d5a89700 2024-09-22T08:37:04.891 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.883+0000 7f34c1726800 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:114 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5585d5aa5c50 con 0x5585d5a89700 2024-09-22T08:37:04.891 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.883+0000 7f34b4b08640 1 -- 172.21.15.142:0/4222915014 <== osd.1 v2:172.21.15.142:6816/3192108003 36 ==== osd_op_reply(114 gc.6 [call out=15b] v0'0 uv23 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f34a8029040 con 0x5585d5a89700 2024-09-22T08:37:04.891 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.883+0000 7f34c1726800 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:115 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5585d5aa5c50 con 0x7f34b00a5040 2024-09-22T08:37:04.891 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.884+0000 7f34b4b08640 1 -- 172.21.15.142:0/4222915014 <== osd.0 v2:172.21.15.31:6800/168281188 26 ==== osd_op_reply(115 gc.7 [call out=15b] v0'0 uv36 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f34a8029040 con 0x7f34b00a5040 2024-09-22T08:37:04.891 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.884+0000 7f34c1726800 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:116 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5585d5aa5c50 con 0x7f34b00a5040 2024-09-22T08:37:04.891 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.884+0000 7f34b4b08640 1 -- 172.21.15.142:0/4222915014 <== osd.0 v2:172.21.15.31:6800/168281188 27 ==== osd_op_reply(116 gc.7 [call out=24b] v0'0 uv36 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f34a8029040 con 0x7f34b00a5040 2024-09-22T08:37:04.891 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.884+0000 7f34c1726800 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:117 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5585d5aa5c50 con 0x7f34b00a5040 2024-09-22T08:37:04.891 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.884+0000 7f34b4b08640 1 -- 172.21.15.142:0/4222915014 <== osd.0 v2:172.21.15.31:6800/168281188 28 ==== osd_op_reply(117 gc.7 [call out=15b] v0'0 uv36 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f34a8029040 con 0x7f34b00a5040 2024-09-22T08:37:04.892 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.884+0000 7f34c1726800 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:118 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5585d5aa5c50 con 0x7f34b8012ab0 2024-09-22T08:37:04.892 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.885+0000 7f34bd309640 1 -- 172.21.15.142:0/4222915014 <== osd.2 v2:172.21.15.142:6808/279438927 21 ==== osd_op_reply(118 gc.8 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f34b0051070 con 0x7f34b8012ab0 2024-09-22T08:37:04.892 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.885+0000 7f34c1726800 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:119 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5585d5aa5c50 con 0x7f34b8012ab0 2024-09-22T08:37:04.892 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.885+0000 7f34bd309640 1 -- 172.21.15.142:0/4222915014 <== osd.2 v2:172.21.15.142:6808/279438927 22 ==== osd_op_reply(119 gc.8 [call out=24b] v0'0 uv21 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f34b0051070 con 0x7f34b8012ab0 2024-09-22T08:37:04.892 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.885+0000 7f34c1726800 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:120 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5585d5aa5c50 con 0x7f34b8012ab0 2024-09-22T08:37:04.892 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.885+0000 7f34bd309640 1 -- 172.21.15.142:0/4222915014 <== osd.2 v2:172.21.15.142:6808/279438927 23 ==== osd_op_reply(120 gc.8 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f34b0051070 con 0x7f34b8012ab0 2024-09-22T08:37:04.892 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.885+0000 7f34c1726800 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:121 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5585d5aa5c50 con 0x5585d5a8dfd0 2024-09-22T08:37:04.892 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.885+0000 7f34bdb0a640 1 -- 172.21.15.142:0/4222915014 <== osd.3 v2:172.21.15.142:6800/1064901393 34 ==== osd_op_reply(121 gc.9 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f34b803a070 con 0x5585d5a8dfd0 2024-09-22T08:37:04.892 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.885+0000 7f34c1726800 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:122 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5585d5aa5c50 con 0x5585d5a8dfd0 2024-09-22T08:37:04.892 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.886+0000 7f34bdb0a640 1 -- 172.21.15.142:0/4222915014 <== osd.3 v2:172.21.15.142:6800/1064901393 35 ==== osd_op_reply(122 gc.9 [call out=24b] v0'0 uv27 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f34b803a070 con 0x5585d5a8dfd0 2024-09-22T08:37:04.892 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.886+0000 7f34c1726800 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:123 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5585d5aa5c50 con 0x5585d5a8dfd0 2024-09-22T08:37:04.892 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.886+0000 7f34bdb0a640 1 -- 172.21.15.142:0/4222915014 <== osd.3 v2:172.21.15.142:6800/1064901393 36 ==== osd_op_reply(123 gc.9 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f34b803a070 con 0x5585d5a8dfd0 2024-09-22T08:37:04.893 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.886+0000 7f34c1726800 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:124 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5585d5aa5c50 con 0x7f34b8012ab0 2024-09-22T08:37:04.893 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.886+0000 7f34bd309640 1 -- 172.21.15.142:0/4222915014 <== osd.2 v2:172.21.15.142:6808/279438927 24 ==== osd_op_reply(124 gc.10 [call out=15b] v0'0 uv55 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f34b0051070 con 0x7f34b8012ab0 2024-09-22T08:37:04.893 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.886+0000 7f34c1726800 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:125 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5585d5aa5c50 con 0x7f34b8012ab0 2024-09-22T08:37:04.893 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.886+0000 7f34bd309640 1 -- 172.21.15.142:0/4222915014 <== osd.2 v2:172.21.15.142:6808/279438927 25 ==== osd_op_reply(125 gc.10 [call out=24b] v0'0 uv55 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f34b0051070 con 0x7f34b8012ab0 2024-09-22T08:37:04.893 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.886+0000 7f34c1726800 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:126 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5585d5aa5c50 con 0x7f34b8012ab0 2024-09-22T08:37:04.893 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.887+0000 7f34bd309640 1 -- 172.21.15.142:0/4222915014 <== osd.2 v2:172.21.15.142:6808/279438927 26 ==== osd_op_reply(126 gc.10 [call out=15b] v0'0 uv55 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f34b0051070 con 0x7f34b8012ab0 2024-09-22T08:37:04.893 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.887+0000 7f34c1726800 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:127 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5585d5aa5c50 con 0x7f34b00a5040 2024-09-22T08:37:04.893 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.887+0000 7f34b4b08640 1 -- 172.21.15.142:0/4222915014 <== osd.0 v2:172.21.15.31:6800/168281188 29 ==== osd_op_reply(127 gc.11 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f34a8029040 con 0x7f34b00a5040 2024-09-22T08:37:04.893 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.887+0000 7f34c1726800 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:128 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5585d5aa5c50 con 0x7f34b00a5040 2024-09-22T08:37:04.893 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.887+0000 7f34b4b08640 1 -- 172.21.15.142:0/4222915014 <== osd.0 v2:172.21.15.31:6800/168281188 30 ==== osd_op_reply(128 gc.11 [call out=24b] v0'0 uv23 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f34a8029040 con 0x7f34b00a5040 2024-09-22T08:37:04.893 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.887+0000 7f34c1726800 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:129 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5585d5aa5c50 con 0x7f34b00a5040 2024-09-22T08:37:04.893 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.888+0000 7f34b4b08640 1 -- 172.21.15.142:0/4222915014 <== osd.0 v2:172.21.15.31:6800/168281188 31 ==== osd_op_reply(129 gc.11 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f34a8029040 con 0x7f34b00a5040 2024-09-22T08:37:04.893 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.888+0000 7f34c1726800 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:130 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5585d5aa5c50 con 0x7f34b8012ab0 2024-09-22T08:37:04.894 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.888+0000 7f34bd309640 1 -- 172.21.15.142:0/4222915014 <== osd.2 v2:172.21.15.142:6808/279438927 27 ==== osd_op_reply(130 gc.12 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f34b0051070 con 0x7f34b8012ab0 2024-09-22T08:37:04.894 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.888+0000 7f34c1726800 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:131 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5585d5aa5c50 con 0x7f34b8012ab0 2024-09-22T08:37:04.894 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.888+0000 7f34bd309640 1 -- 172.21.15.142:0/4222915014 <== osd.2 v2:172.21.15.142:6808/279438927 28 ==== osd_op_reply(131 gc.12 [call out=24b] v0'0 uv21 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f34b0051070 con 0x7f34b8012ab0 2024-09-22T08:37:04.894 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.888+0000 7f34c1726800 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:132 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5585d5aa5c50 con 0x7f34b8012ab0 2024-09-22T08:37:04.894 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.888+0000 7f34bd309640 1 -- 172.21.15.142:0/4222915014 <== osd.2 v2:172.21.15.142:6808/279438927 29 ==== osd_op_reply(132 gc.12 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f34b0051070 con 0x7f34b8012ab0 2024-09-22T08:37:04.894 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.888+0000 7f34c1726800 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:133 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5585d5aa5c50 con 0x7f34b00a5040 2024-09-22T08:37:04.894 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.889+0000 7f34b4b08640 1 -- 172.21.15.142:0/4222915014 <== osd.0 v2:172.21.15.31:6800/168281188 32 ==== osd_op_reply(133 gc.13 [call out=15b] v0'0 uv44 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f34a8029040 con 0x7f34b00a5040 2024-09-22T08:37:04.894 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.889+0000 7f34c1726800 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:134 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5585d5aa5c50 con 0x7f34b00a5040 2024-09-22T08:37:04.894 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.889+0000 7f34b4b08640 1 -- 172.21.15.142:0/4222915014 <== osd.0 v2:172.21.15.31:6800/168281188 33 ==== osd_op_reply(134 gc.13 [call out=24b] v0'0 uv44 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f34a8029040 con 0x7f34b00a5040 2024-09-22T08:37:04.894 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.889+0000 7f34c1726800 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:135 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5585d5aa5c50 con 0x7f34b00a5040 2024-09-22T08:37:04.905 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.889+0000 7f34b4b08640 1 -- 172.21.15.142:0/4222915014 <== osd.0 v2:172.21.15.31:6800/168281188 34 ==== osd_op_reply(135 gc.13 [call out=15b] v0'0 uv44 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f34a8029040 con 0x7f34b00a5040 2024-09-22T08:37:04.905 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.889+0000 7f34c1726800 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:136 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5585d5aa5c50 con 0x5585d5a89700 2024-09-22T08:37:04.905 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.890+0000 7f34b4b08640 1 -- 172.21.15.142:0/4222915014 <== osd.1 v2:172.21.15.142:6816/3192108003 37 ==== osd_op_reply(136 gc.14 [call out=15b] v0'0 uv164 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f34a8029040 con 0x5585d5a89700 2024-09-22T08:37:04.905 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.890+0000 7f34c1726800 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:137 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5585d5aa5c50 con 0x5585d5a89700 2024-09-22T08:37:04.905 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.890+0000 7f34b4b08640 1 -- 172.21.15.142:0/4222915014 <== osd.1 v2:172.21.15.142:6816/3192108003 38 ==== osd_op_reply(137 gc.14 [call out=24b] v0'0 uv164 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f34a8029040 con 0x5585d5a89700 2024-09-22T08:37:04.905 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.890+0000 7f34c1726800 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:138 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5585d5aa5c50 con 0x5585d5a89700 2024-09-22T08:37:04.905 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.890+0000 7f34b4b08640 1 -- 172.21.15.142:0/4222915014 <== osd.1 v2:172.21.15.142:6816/3192108003 39 ==== osd_op_reply(138 gc.14 [call out=15b] v0'0 uv164 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f34a8029040 con 0x5585d5a89700 2024-09-22T08:37:04.905 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.890+0000 7f34c1726800 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:139 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5585d5aa5c50 con 0x5585d5a8dfd0 2024-09-22T08:37:04.905 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.890+0000 7f34bdb0a640 1 -- 172.21.15.142:0/4222915014 <== osd.3 v2:172.21.15.142:6800/1064901393 37 ==== osd_op_reply(139 gc.15 [call out=15b] v0'0 uv47 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f34b803a070 con 0x5585d5a8dfd0 2024-09-22T08:37:04.905 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.890+0000 7f34c1726800 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:140 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5585d5aa5c50 con 0x5585d5a8dfd0 2024-09-22T08:37:04.906 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.891+0000 7f34bdb0a640 1 -- 172.21.15.142:0/4222915014 <== osd.3 v2:172.21.15.142:6800/1064901393 38 ==== osd_op_reply(140 gc.15 [call out=24b] v0'0 uv47 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f34b803a070 con 0x5585d5a8dfd0 2024-09-22T08:37:04.906 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.891+0000 7f34c1726800 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:141 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5585d5aa5c50 con 0x5585d5a8dfd0 2024-09-22T08:37:04.906 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.891+0000 7f34bdb0a640 1 -- 172.21.15.142:0/4222915014 <== osd.3 v2:172.21.15.142:6800/1064901393 39 ==== osd_op_reply(141 gc.15 [call out=15b] v0'0 uv47 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f34b803a070 con 0x5585d5a8dfd0 2024-09-22T08:37:04.906 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.891+0000 7f34c1726800 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:142 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5585d5aa5c50 con 0x7f34b8012ab0 2024-09-22T08:37:04.906 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.891+0000 7f34bd309640 1 -- 172.21.15.142:0/4222915014 <== osd.2 v2:172.21.15.142:6808/279438927 30 ==== osd_op_reply(142 gc.16 [call out=15b] v0'0 uv57 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f34b0051070 con 0x7f34b8012ab0 2024-09-22T08:37:04.906 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.891+0000 7f34c1726800 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:143 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5585d5aa5c50 con 0x7f34b8012ab0 2024-09-22T08:37:04.906 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.891+0000 7f34bd309640 1 -- 172.21.15.142:0/4222915014 <== osd.2 v2:172.21.15.142:6808/279438927 31 ==== osd_op_reply(143 gc.16 [call out=24b] v0'0 uv57 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f34b0051070 con 0x7f34b8012ab0 2024-09-22T08:37:04.906 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.891+0000 7f34c1726800 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:144 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5585d5aa5c50 con 0x7f34b8012ab0 2024-09-22T08:37:04.906 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.892+0000 7f34bd309640 1 -- 172.21.15.142:0/4222915014 <== osd.2 v2:172.21.15.142:6808/279438927 32 ==== osd_op_reply(144 gc.16 [call out=15b] v0'0 uv57 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f34b0051070 con 0x7f34b8012ab0 2024-09-22T08:37:04.906 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.892+0000 7f34c1726800 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:145 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5585d5aa5c50 con 0x5585d5a8dfd0 2024-09-22T08:37:04.906 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.892+0000 7f34bdb0a640 1 -- 172.21.15.142:0/4222915014 <== osd.3 v2:172.21.15.142:6800/1064901393 40 ==== osd_op_reply(145 gc.17 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f34b803a070 con 0x5585d5a8dfd0 2024-09-22T08:37:04.906 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.892+0000 7f34c1726800 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:146 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5585d5aa5c50 con 0x5585d5a8dfd0 2024-09-22T08:37:04.907 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.892+0000 7f34bdb0a640 1 -- 172.21.15.142:0/4222915014 <== osd.3 v2:172.21.15.142:6800/1064901393 41 ==== osd_op_reply(146 gc.17 [call out=24b] v0'0 uv21 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f34b803a070 con 0x5585d5a8dfd0 2024-09-22T08:37:04.907 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.892+0000 7f34c1726800 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:147 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5585d5aa5c50 con 0x5585d5a8dfd0 2024-09-22T08:37:04.907 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.892+0000 7f34bdb0a640 1 -- 172.21.15.142:0/4222915014 <== osd.3 v2:172.21.15.142:6800/1064901393 42 ==== osd_op_reply(147 gc.17 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f34b803a070 con 0x5585d5a8dfd0 2024-09-22T08:37:04.907 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.892+0000 7f34c1726800 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:148 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5585d5aa5c50 con 0x5585d5a89700 2024-09-22T08:37:04.907 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.893+0000 7f34b4b08640 1 -- 172.21.15.142:0/4222915014 <== osd.1 v2:172.21.15.142:6816/3192108003 40 ==== osd_op_reply(148 gc.18 [call out=15b] v0'0 uv29 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f34a8029040 con 0x5585d5a89700 2024-09-22T08:37:04.907 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.893+0000 7f34c1726800 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:149 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5585d5aa5c50 con 0x5585d5a89700 2024-09-22T08:37:04.907 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.893+0000 7f34b4b08640 1 -- 172.21.15.142:0/4222915014 <== osd.1 v2:172.21.15.142:6816/3192108003 41 ==== osd_op_reply(149 gc.18 [call out=24b] v0'0 uv29 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f34a8029040 con 0x5585d5a89700 2024-09-22T08:37:04.907 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.893+0000 7f34c1726800 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:150 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5585d5aa5c50 con 0x5585d5a89700 2024-09-22T08:37:04.907 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.893+0000 7f34b4b08640 1 -- 172.21.15.142:0/4222915014 <== osd.1 v2:172.21.15.142:6816/3192108003 42 ==== osd_op_reply(150 gc.18 [call out=15b] v0'0 uv29 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f34a8029040 con 0x5585d5a89700 2024-09-22T08:37:04.907 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.893+0000 7f34c1726800 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:151 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5585d5aa5c50 con 0x5585d5a89700 2024-09-22T08:37:04.907 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.893+0000 7f34b4b08640 1 -- 172.21.15.142:0/4222915014 <== osd.1 v2:172.21.15.142:6816/3192108003 43 ==== osd_op_reply(151 gc.19 [call out=15b] v0'0 uv166 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f34a8029040 con 0x5585d5a89700 2024-09-22T08:37:04.907 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.893+0000 7f34c1726800 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:152 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5585d5aa5c50 con 0x5585d5a89700 2024-09-22T08:37:04.907 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.894+0000 7f34b4b08640 1 -- 172.21.15.142:0/4222915014 <== osd.1 v2:172.21.15.142:6816/3192108003 44 ==== osd_op_reply(152 gc.19 [call out=24b] v0'0 uv166 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f34a8029040 con 0x5585d5a89700 2024-09-22T08:37:04.908 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.894+0000 7f34c1726800 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:153 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5585d5aa5c50 con 0x5585d5a89700 2024-09-22T08:37:04.908 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.894+0000 7f34b4b08640 1 -- 172.21.15.142:0/4222915014 <== osd.1 v2:172.21.15.142:6816/3192108003 45 ==== osd_op_reply(153 gc.19 [call out=15b] v0'0 uv166 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f34a8029040 con 0x5585d5a89700 2024-09-22T08:37:04.908 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.894+0000 7f34c1726800 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:154 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5585d5aa5c50 con 0x5585d5a8dfd0 2024-09-22T08:37:04.908 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.894+0000 7f34bdb0a640 1 -- 172.21.15.142:0/4222915014 <== osd.3 v2:172.21.15.142:6800/1064901393 43 ==== osd_op_reply(154 gc.20 [call out=15b] v0'0 uv49 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f34b803a070 con 0x5585d5a8dfd0 2024-09-22T08:37:04.908 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.894+0000 7f34c1726800 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:155 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5585d5aa5c50 con 0x5585d5a8dfd0 2024-09-22T08:37:04.908 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.894+0000 7f34bdb0a640 1 -- 172.21.15.142:0/4222915014 <== osd.3 v2:172.21.15.142:6800/1064901393 44 ==== osd_op_reply(155 gc.20 [call out=24b] v0'0 uv49 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f34b803a070 con 0x5585d5a8dfd0 2024-09-22T08:37:04.908 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.894+0000 7f34c1726800 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:156 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5585d5aa5c50 con 0x5585d5a8dfd0 2024-09-22T08:37:04.908 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.895+0000 7f34bdb0a640 1 -- 172.21.15.142:0/4222915014 <== osd.3 v2:172.21.15.142:6800/1064901393 45 ==== osd_op_reply(156 gc.20 [call out=15b] v0'0 uv49 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f34b803a070 con 0x5585d5a8dfd0 2024-09-22T08:37:04.908 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.895+0000 7f34c1726800 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:157 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5585d5aa5c50 con 0x7f34b8012ab0 2024-09-22T08:37:04.908 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.895+0000 7f34bd309640 1 -- 172.21.15.142:0/4222915014 <== osd.2 v2:172.21.15.142:6808/279438927 33 ==== osd_op_reply(157 gc.21 [call out=15b] v0'0 uv31 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f34b0051070 con 0x7f34b8012ab0 2024-09-22T08:37:04.908 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.895+0000 7f34c1726800 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:158 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5585d5aa5c50 con 0x7f34b8012ab0 2024-09-22T08:37:04.908 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.895+0000 7f34bd309640 1 -- 172.21.15.142:0/4222915014 <== osd.2 v2:172.21.15.142:6808/279438927 34 ==== osd_op_reply(158 gc.21 [call out=24b] v0'0 uv31 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f34b0051070 con 0x7f34b8012ab0 2024-09-22T08:37:04.909 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.895+0000 7f34c1726800 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:159 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5585d5aa5c50 con 0x7f34b8012ab0 2024-09-22T08:37:04.909 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.895+0000 7f34bd309640 1 -- 172.21.15.142:0/4222915014 <== osd.2 v2:172.21.15.142:6808/279438927 35 ==== osd_op_reply(159 gc.21 [call out=15b] v0'0 uv31 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f34b0051070 con 0x7f34b8012ab0 2024-09-22T08:37:04.909 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.895+0000 7f34c1726800 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:160 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5585d5aa5c50 con 0x5585d5a8dfd0 2024-09-22T08:37:04.909 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.896+0000 7f34bdb0a640 1 -- 172.21.15.142:0/4222915014 <== osd.3 v2:172.21.15.142:6800/1064901393 46 ==== osd_op_reply(160 gc.22 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f34b803a070 con 0x5585d5a8dfd0 2024-09-22T08:37:04.909 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.896+0000 7f34c1726800 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:161 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5585d5aa5c50 con 0x5585d5a8dfd0 2024-09-22T08:37:04.909 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.896+0000 7f34bdb0a640 1 -- 172.21.15.142:0/4222915014 <== osd.3 v2:172.21.15.142:6800/1064901393 47 ==== osd_op_reply(161 gc.22 [call out=24b] v0'0 uv23 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f34b803a070 con 0x5585d5a8dfd0 2024-09-22T08:37:04.909 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.896+0000 7f34c1726800 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:162 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5585d5aa5c50 con 0x5585d5a8dfd0 2024-09-22T08:37:04.909 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.896+0000 7f34bdb0a640 1 -- 172.21.15.142:0/4222915014 <== osd.3 v2:172.21.15.142:6800/1064901393 48 ==== osd_op_reply(162 gc.22 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f34b803a070 con 0x5585d5a8dfd0 2024-09-22T08:37:04.909 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.896+0000 7f34c1726800 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:163 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5585d5aa5c50 con 0x5585d5a8dfd0 2024-09-22T08:37:04.909 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.896+0000 7f34bdb0a640 1 -- 172.21.15.142:0/4222915014 <== osd.3 v2:172.21.15.142:6800/1064901393 49 ==== osd_op_reply(163 gc.23 [call out=15b] v0'0 uv27 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f34b803a070 con 0x5585d5a8dfd0 2024-09-22T08:37:04.909 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.896+0000 7f34c1726800 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:164 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5585d5aa5c50 con 0x5585d5a8dfd0 2024-09-22T08:37:04.910 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.897+0000 7f34bdb0a640 1 -- 172.21.15.142:0/4222915014 <== osd.3 v2:172.21.15.142:6800/1064901393 50 ==== osd_op_reply(164 gc.23 [call out=24b] v0'0 uv27 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f34b803a070 con 0x5585d5a8dfd0 2024-09-22T08:37:04.910 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.897+0000 7f34c1726800 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:165 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5585d5aa5c50 con 0x5585d5a8dfd0 2024-09-22T08:37:04.910 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.897+0000 7f34bdb0a640 1 -- 172.21.15.142:0/4222915014 <== osd.3 v2:172.21.15.142:6800/1064901393 51 ==== osd_op_reply(165 gc.23 [call out=15b] v0'0 uv27 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f34b803a070 con 0x5585d5a8dfd0 2024-09-22T08:37:04.910 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.897+0000 7f34c1726800 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:166 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5585d5aa5c50 con 0x5585d5a8dfd0 2024-09-22T08:37:04.910 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.897+0000 7f34bdb0a640 1 -- 172.21.15.142:0/4222915014 <== osd.3 v2:172.21.15.142:6800/1064901393 52 ==== osd_op_reply(166 gc.24 [call out=15b] v0'0 uv17 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f34b803a070 con 0x5585d5a8dfd0 2024-09-22T08:37:04.910 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.897+0000 7f34c1726800 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:167 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5585d5aa5c50 con 0x5585d5a8dfd0 2024-09-22T08:37:04.910 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.897+0000 7f34bdb0a640 1 -- 172.21.15.142:0/4222915014 <== osd.3 v2:172.21.15.142:6800/1064901393 53 ==== osd_op_reply(167 gc.24 [call out=24b] v0'0 uv17 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f34b803a070 con 0x5585d5a8dfd0 2024-09-22T08:37:04.910 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.897+0000 7f34c1726800 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:168 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5585d5aa5c50 con 0x5585d5a8dfd0 2024-09-22T08:37:04.910 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.897+0000 7f34bdb0a640 1 -- 172.21.15.142:0/4222915014 <== osd.3 v2:172.21.15.142:6800/1064901393 54 ==== osd_op_reply(168 gc.24 [call out=15b] v0'0 uv17 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f34b803a070 con 0x5585d5a8dfd0 2024-09-22T08:37:04.910 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.897+0000 7f34c1726800 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:169 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5585d5aa5c50 con 0x5585d5a8dfd0 2024-09-22T08:37:04.910 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.898+0000 7f34bdb0a640 1 -- 172.21.15.142:0/4222915014 <== osd.3 v2:172.21.15.142:6800/1064901393 55 ==== osd_op_reply(169 gc.25 [call out=15b] v0'0 uv36 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f34b803a070 con 0x5585d5a8dfd0 2024-09-22T08:37:04.910 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.898+0000 7f34c1726800 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:170 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5585d5aa5c50 con 0x5585d5a8dfd0 2024-09-22T08:37:04.911 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.898+0000 7f34bdb0a640 1 -- 172.21.15.142:0/4222915014 <== osd.3 v2:172.21.15.142:6800/1064901393 56 ==== osd_op_reply(170 gc.25 [call out=24b] v0'0 uv36 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f34b803a070 con 0x5585d5a8dfd0 2024-09-22T08:37:04.911 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.898+0000 7f34c1726800 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:171 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5585d5aa5c50 con 0x5585d5a8dfd0 2024-09-22T08:37:04.911 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.898+0000 7f34bdb0a640 1 -- 172.21.15.142:0/4222915014 <== osd.3 v2:172.21.15.142:6800/1064901393 57 ==== osd_op_reply(171 gc.25 [call out=15b] v0'0 uv36 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f34b803a070 con 0x5585d5a8dfd0 2024-09-22T08:37:04.911 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.898+0000 7f34c1726800 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:172 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5585d5aa5c50 con 0x7f34b00a5040 2024-09-22T08:37:04.911 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.898+0000 7f34b4b08640 1 -- 172.21.15.142:0/4222915014 <== osd.0 v2:172.21.15.31:6800/168281188 35 ==== osd_op_reply(172 gc.26 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f34a8029040 con 0x7f34b00a5040 2024-09-22T08:37:04.911 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.899+0000 7f34c1726800 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:173 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5585d5aa5c50 con 0x7f34b00a5040 2024-09-22T08:37:04.911 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.899+0000 7f34b4b08640 1 -- 172.21.15.142:0/4222915014 <== osd.0 v2:172.21.15.31:6800/168281188 36 ==== osd_op_reply(173 gc.26 [call out=24b] v0'0 uv23 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f34a8029040 con 0x7f34b00a5040 2024-09-22T08:37:04.911 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.899+0000 7f34c1726800 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:174 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5585d5aa5c50 con 0x7f34b00a5040 2024-09-22T08:37:04.911 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.899+0000 7f34b4b08640 1 -- 172.21.15.142:0/4222915014 <== osd.0 v2:172.21.15.31:6800/168281188 37 ==== osd_op_reply(174 gc.26 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f34a8029040 con 0x7f34b00a5040 2024-09-22T08:37:04.911 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.899+0000 7f34c1726800 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:175 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5585d5aa5c50 con 0x5585d5a8dfd0 2024-09-22T08:37:04.911 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.899+0000 7f34bdb0a640 1 -- 172.21.15.142:0/4222915014 <== osd.3 v2:172.21.15.142:6800/1064901393 58 ==== osd_op_reply(175 gc.27 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f34b803a070 con 0x5585d5a8dfd0 2024-09-22T08:37:04.911 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.899+0000 7f34c1726800 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:176 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5585d5aa5c50 con 0x5585d5a8dfd0 2024-09-22T08:37:04.911 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.899+0000 7f34bdb0a640 1 -- 172.21.15.142:0/4222915014 <== osd.3 v2:172.21.15.142:6800/1064901393 59 ==== osd_op_reply(176 gc.27 [call out=24b] v0'0 uv21 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f34b803a070 con 0x5585d5a8dfd0 2024-09-22T08:37:04.912 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.900+0000 7f34c1726800 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:177 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5585d5aa5c50 con 0x5585d5a8dfd0 2024-09-22T08:37:04.912 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.900+0000 7f34bdb0a640 1 -- 172.21.15.142:0/4222915014 <== osd.3 v2:172.21.15.142:6800/1064901393 60 ==== osd_op_reply(177 gc.27 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f34b803a070 con 0x5585d5a8dfd0 2024-09-22T08:37:04.912 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.900+0000 7f34c1726800 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:178 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5585d5aa5c50 con 0x7f34b00a5040 2024-09-22T08:37:04.912 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.900+0000 7f34b4b08640 1 -- 172.21.15.142:0/4222915014 <== osd.0 v2:172.21.15.31:6800/168281188 38 ==== osd_op_reply(178 gc.28 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f34a8029040 con 0x7f34b00a5040 2024-09-22T08:37:04.912 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.900+0000 7f34c1726800 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:179 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5585d5aa5c50 con 0x7f34b00a5040 2024-09-22T08:37:04.912 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.901+0000 7f34b4b08640 1 -- 172.21.15.142:0/4222915014 <== osd.0 v2:172.21.15.31:6800/168281188 39 ==== osd_op_reply(179 gc.28 [call out=24b] v0'0 uv34 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f34a8029040 con 0x7f34b00a5040 2024-09-22T08:37:04.912 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.901+0000 7f34c1726800 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:180 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5585d5aa5c50 con 0x7f34b00a5040 2024-09-22T08:37:04.912 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.901+0000 7f34b4b08640 1 -- 172.21.15.142:0/4222915014 <== osd.0 v2:172.21.15.31:6800/168281188 40 ==== osd_op_reply(180 gc.28 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f34a8029040 con 0x7f34b00a5040 2024-09-22T08:37:04.912 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.901+0000 7f34c1726800 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:181 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5585d5aa5c50 con 0x5585d5a8dfd0 2024-09-22T08:37:04.912 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.901+0000 7f34bdb0a640 1 -- 172.21.15.142:0/4222915014 <== osd.3 v2:172.21.15.142:6800/1064901393 61 ==== osd_op_reply(181 gc.29 [call out=15b] v0'0 uv45 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f34b803a070 con 0x5585d5a8dfd0 2024-09-22T08:37:04.912 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.901+0000 7f34c1726800 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:182 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5585d5aa5c50 con 0x5585d5a8dfd0 2024-09-22T08:37:04.912 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.902+0000 7f34bdb0a640 1 -- 172.21.15.142:0/4222915014 <== osd.3 v2:172.21.15.142:6800/1064901393 62 ==== osd_op_reply(182 gc.29 [call out=24b] v0'0 uv45 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f34b803a070 con 0x5585d5a8dfd0 2024-09-22T08:37:04.913 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.902+0000 7f34c1726800 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:183 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5585d5aa5c50 con 0x5585d5a8dfd0 2024-09-22T08:37:04.913 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.902+0000 7f34bdb0a640 1 -- 172.21.15.142:0/4222915014 <== osd.3 v2:172.21.15.142:6800/1064901393 63 ==== osd_op_reply(183 gc.29 [call out=15b] v0'0 uv45 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f34b803a070 con 0x5585d5a8dfd0 2024-09-22T08:37:04.913 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.902+0000 7f34c1726800 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:184 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5585d5aa5c50 con 0x7f34b00a5040 2024-09-22T08:37:04.913 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.902+0000 7f34b4b08640 1 -- 172.21.15.142:0/4222915014 <== osd.0 v2:172.21.15.31:6800/168281188 41 ==== osd_op_reply(184 gc.30 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f34a8029040 con 0x7f34b00a5040 2024-09-22T08:37:04.913 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.902+0000 7f34c1726800 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:185 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5585d5aa5c50 con 0x7f34b00a5040 2024-09-22T08:37:04.913 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.902+0000 7f34b4b08640 1 -- 172.21.15.142:0/4222915014 <== osd.0 v2:172.21.15.31:6800/168281188 42 ==== osd_op_reply(185 gc.30 [call out=24b] v0'0 uv42 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f34a8029040 con 0x7f34b00a5040 2024-09-22T08:37:04.913 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.902+0000 7f34c1726800 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:186 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5585d5aa5c50 con 0x7f34b00a5040 2024-09-22T08:37:04.913 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.903+0000 7f34b4b08640 1 -- 172.21.15.142:0/4222915014 <== osd.0 v2:172.21.15.31:6800/168281188 43 ==== osd_op_reply(186 gc.30 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f34a8029040 con 0x7f34b00a5040 2024-09-22T08:37:04.913 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.903+0000 7f34c1726800 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:187 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5585d5aa5c50 con 0x7f34b8012ab0 2024-09-22T08:37:04.913 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.903+0000 7f34bd309640 1 -- 172.21.15.142:0/4222915014 <== osd.2 v2:172.21.15.142:6808/279438927 36 ==== osd_op_reply(187 gc.31 [call out=15b] v0'0 uv27 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f34b0051070 con 0x7f34b8012ab0 2024-09-22T08:37:04.913 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.903+0000 7f34c1726800 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:188 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5585d5aa5c50 con 0x7f34b8012ab0 2024-09-22T08:37:04.913 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.903+0000 7f34bd309640 1 -- 172.21.15.142:0/4222915014 <== osd.2 v2:172.21.15.142:6808/279438927 37 ==== osd_op_reply(188 gc.31 [call out=24b] v0'0 uv27 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f34b0051070 con 0x7f34b8012ab0 2024-09-22T08:37:04.914 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.903+0000 7f34c1726800 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:189 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5585d5aa5c50 con 0x7f34b8012ab0 2024-09-22T08:37:04.914 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.903+0000 7f34bd309640 1 -- 172.21.15.142:0/4222915014 <== osd.2 v2:172.21.15.142:6808/279438927 38 ==== osd_op_reply(189 gc.31 [call out=15b] v0'0 uv27 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f34b0051070 con 0x7f34b8012ab0 2024-09-22T08:37:04.918 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.904+0000 7f3373fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:37:04.919 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.904+0000 7f34c1726800 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:190 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94033303675024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5585d5aa5bf0 con 0x5585d5a89700 2024-09-22T08:37:04.919 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.905+0000 7f34b4b08640 1 -- 172.21.15.142:0/4222915014 <== osd.1 v2:172.21.15.142:6816/3192108003 46 ==== osd_op_reply(190 data_loggenerations_metadata [watch unwatch cookie 94033303675024] v32'172 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f34a8029040 con 0x5585d5a89700 2024-09-22T08:37:04.919 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.905+0000 7f34c1726800 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:191 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94033303651840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5585d5a9a090 con 0x7f34b8012ab0 2024-09-22T08:37:04.919 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.906+0000 7f34bd309640 1 -- 172.21.15.142:0/4222915014 <== osd.2 v2:172.21.15.142:6808/279438927 39 ==== osd_op_reply(191 notify.0 [watch unwatch cookie 94033303651840] v32'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34b0051070 con 0x7f34b8012ab0 2024-09-22T08:37:04.919 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.906+0000 7f34c1726800 20 remove_watcher() i=0 2024-09-22T08:37:04.919 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.906+0000 7f34c1726800 2 removed watcher, disabling cache 2024-09-22T08:37:04.919 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.906+0000 7f34c1726800 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:192 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94033303657328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5585d5a94600 con 0x5585d5a89700 2024-09-22T08:37:04.919 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.907+0000 7f34b4b08640 1 -- 172.21.15.142:0/4222915014 <== osd.1 v2:172.21.15.142:6816/3192108003 47 ==== osd_op_reply(192 notify.1 [watch unwatch cookie 94033303657328] v32'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34a8029040 con 0x5585d5a89700 2024-09-22T08:37:04.919 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.907+0000 7f34c1726800 20 remove_watcher() i=1 2024-09-22T08:37:04.919 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.907+0000 7f34c1726800 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:193 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94033303660880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5585d5a94600 con 0x5585d5a8dfd0 2024-09-22T08:37:04.919 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.908+0000 7f34bdb0a640 1 -- 172.21.15.142:0/4222915014 <== osd.3 v2:172.21.15.142:6800/1064901393 64 ==== osd_op_reply(193 notify.2 [watch unwatch cookie 94033303660880] v32'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34b803a070 con 0x5585d5a8dfd0 2024-09-22T08:37:04.919 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.908+0000 7f34c1726800 20 remove_watcher() i=2 2024-09-22T08:37:04.920 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.908+0000 7f34c1726800 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:194 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94033303664832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5585d5a96950 con 0x7f34b8012ab0 2024-09-22T08:37:04.920 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.909+0000 7f34bd309640 1 -- 172.21.15.142:0/4222915014 <== osd.2 v2:172.21.15.142:6808/279438927 40 ==== osd_op_reply(194 notify.3 [watch unwatch cookie 94033303664832] v32'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34b0051070 con 0x7f34b8012ab0 2024-09-22T08:37:04.920 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.909+0000 7f34c1726800 20 remove_watcher() i=3 2024-09-22T08:37:04.920 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.909+0000 7f34c1726800 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:195 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94033303658384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5585d5a94600 con 0x5585d5a89700 2024-09-22T08:37:04.920 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.910+0000 7f34b4b08640 1 -- 172.21.15.142:0/4222915014 <== osd.1 v2:172.21.15.142:6816/3192108003 48 ==== osd_op_reply(195 notify.4 [watch unwatch cookie 94033303658384] v32'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34a8029040 con 0x5585d5a89700 2024-09-22T08:37:04.920 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.910+0000 7f34c1726800 20 remove_watcher() i=4 2024-09-22T08:37:04.920 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.910+0000 7f34c1726800 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:196 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94033303668896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5585d5a978c0 con 0x7f34b00a5040 2024-09-22T08:37:04.920 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.911+0000 7f34b4b08640 1 -- 172.21.15.142:0/4222915014 <== osd.0 v2:172.21.15.31:6800/168281188 44 ==== osd_op_reply(196 notify.5 [watch unwatch cookie 94033303668896] v32'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34a8029040 con 0x7f34b00a5040 2024-09-22T08:37:04.920 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.911+0000 7f34c1726800 20 remove_watcher() i=5 2024-09-22T08:37:04.920 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.911+0000 7f34c1726800 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:197 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94033303669952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5585d5a94600 con 0x7f34b00a5040 2024-09-22T08:37:04.920 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.912+0000 7f34b4b08640 1 -- 172.21.15.142:0/4222915014 <== osd.0 v2:172.21.15.31:6800/168281188 45 ==== osd_op_reply(197 notify.6 [watch unwatch cookie 94033303669952] v32'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34a8029040 con 0x7f34b00a5040 2024-09-22T08:37:04.920 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.912+0000 7f34c1726800 20 remove_watcher() i=6 2024-09-22T08:37:04.920 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.912+0000 7f34c1726800 1 -- 172.21.15.142:0/4222915014 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:198 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94033303672832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5585d5a978c0 con 0x7f34b00a5040 2024-09-22T08:37:04.921 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.913+0000 7f34b4b08640 1 -- 172.21.15.142:0/4222915014 <== osd.0 v2:172.21.15.31:6800/168281188 46 ==== osd_op_reply(198 notify.7 [watch unwatch cookie 94033303672832] v32'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34a8029040 con 0x7f34b00a5040 2024-09-22T08:37:04.921 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.913+0000 7f34c1726800 20 remove_watcher() i=7 2024-09-22T08:37:04.921 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.914+0000 7f34c1726800 1 -- 172.21.15.142:0/4222915014 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f34b00a5040 msgr2=0x7f34b0052820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:04.921 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.914+0000 7f34c1726800 1 --2- 172.21.15.142:0/4222915014 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f34b00a5040 0x7f34b0052820 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:04.921 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.914+0000 7f34c1726800 1 -- 172.21.15.142:0/4222915014 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5585d5a89700 msgr2=0x5585d5a8bb90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:04.921 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.914+0000 7f34c1726800 1 --2- 172.21.15.142:0/4222915014 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5585d5a89700 0x5585d5a8bb90 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:04.921 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.914+0000 7f34c1726800 1 -- 172.21.15.142:0/4222915014 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f34b8012ab0 msgr2=0x7f34b80123d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:04.921 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.914+0000 7f34c1726800 1 --2- 172.21.15.142:0/4222915014 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f34b8012ab0 0x7f34b80123d0 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:04.921 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.914+0000 7f34c1726800 1 -- 172.21.15.142:0/4222915014 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5585d5a8dfd0 msgr2=0x5585d5a903c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:04.921 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.914+0000 7f34c1726800 1 --2- 172.21.15.142:0/4222915014 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5585d5a8dfd0 0x5585d5a903c0 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:04.921 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.914+0000 7f34c1726800 1 -- 172.21.15.142:0/4222915014 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f338803cfb0 msgr2=0x7f338803f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:04.921 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.914+0000 7f34c1726800 1 --2- 172.21.15.142:0/4222915014 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f338803cfb0 0x7f338803f470 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f34b0074fd0 tx=0x7f34b0089000 comp rx=0 tx=0).stop 2024-09-22T08:37:04.921 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.914+0000 7f34b4b08640 1 -- 172.21.15.142:0/4222915014 reap_dead start 2024-09-22T08:37:04.922 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.914+0000 7f34c1726800 1 -- 172.21.15.142:0/4222915014 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5585d5a76780 msgr2=0x5585d5a7dd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:04.922 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.914+0000 7f34c1726800 1 --2- 172.21.15.142:0/4222915014 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5585d5a76780 0x5585d5a7dd60 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f34b801ff70 tx=0x7f34b80547d0 comp rx=0 tx=0).stop 2024-09-22T08:37:04.922 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.914+0000 7f34c1726800 1 -- 172.21.15.142:0/4222915014 shutdown_connections 2024-09-22T08:37:04.922 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.914+0000 7f34c1726800 1 --2- 172.21.15.142:0/4222915014 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5585d5a76780 0x5585d5a7dd60 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:04.922 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.914+0000 7f34c1726800 1 -- 172.21.15.142:0/4222915014 >> 172.21.15.142:0/4222915014 conn(0x5585d5a72b80 msgr2=0x5585d5a70d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:37:04.922 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.914+0000 7f34c1726800 1 -- 172.21.15.142:0/4222915014 shutdown_connections 2024-09-22T08:37:04.922 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.914+0000 7f34c1726800 1 -- 172.21.15.142:0/4222915014 wait complete. 2024-09-22T08:37:04.922 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.914+0000 7f34c1726800 1 -- 172.21.15.142:0/2332505303 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f339403cfb0 msgr2=0x7f339403f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:04.922 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.914+0000 7f34c1726800 1 --2- 172.21.15.142:0/2332505303 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f339403cfb0 0x7f339403f470 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x5585d5a5b710 tx=0x7f34b005ce20 comp rx=0 tx=0).stop 2024-09-22T08:37:04.922 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.914+0000 7f34c1726800 1 -- 172.21.15.142:0/2332505303 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5585d5a69cc0 msgr2=0x5585d5a6a0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:04.922 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.914+0000 7f34c1726800 1 --2- 172.21.15.142:0/2332505303 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5585d5a69cc0 0x5585d5a6a0e0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x5585d5a4fa20 tx=0x7f34b80167b0 comp rx=0 tx=0).stop 2024-09-22T08:37:04.922 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.914+0000 7f34c1726800 1 -- 172.21.15.142:0/2332505303 shutdown_connections 2024-09-22T08:37:04.922 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.914+0000 7f34c1726800 1 --2- 172.21.15.142:0/2332505303 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f339403cfb0 0x7f339403f470 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:04.923 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.914+0000 7f34c1726800 1 --2- 172.21.15.142:0/2332505303 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5585d5a69cc0 0x5585d5a6a0e0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:04.923 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.914+0000 7f34c1726800 1 -- 172.21.15.142:0/2332505303 >> 172.21.15.142:0/2332505303 conn(0x5585d5a5e070 msgr2=0x5585d5a5e450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:37:04.923 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.914+0000 7f34c1726800 1 -- 172.21.15.142:0/2332505303 shutdown_connections 2024-09-22T08:37:04.923 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.914+0000 7f34c1726800 1 -- 172.21.15.142:0/2332505303 wait complete. 2024-09-22T08:37:04.923 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.915+0000 7f34c1726800 1 -- 172.21.15.142:0/3578058620 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5585d5958850 msgr2=0x5585d5a56360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:04.923 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.915+0000 7f34c1726800 1 --2- 172.21.15.142:0/3578058620 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5585d5958850 0x5585d5a56360 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:04.923 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.915+0000 7f34c1726800 1 -- 172.21.15.142:0/3578058620 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5585d5a58740 msgr2=0x5585d5a5abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:04.923 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.915+0000 7f34c1726800 1 --2- 172.21.15.142:0/3578058620 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5585d5a58740 0x5585d5a5abe0 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:04.923 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.915+0000 7f34c1726800 1 -- 172.21.15.142:0/3578058620 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f33a403d000 msgr2=0x7f33a403f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:04.923 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.915+0000 7f34c1726800 1 --2- 172.21.15.142:0/3578058620 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f33a403d000 0x7f33a403f4c0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f34a8001d70 tx=0x7f34a80012d0 comp rx=0 tx=0).stop 2024-09-22T08:37:04.923 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.915+0000 7f34c1726800 1 -- 172.21.15.142:0/3578058620 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5585d5953be0 msgr2=0x5585d5a4ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:04.923 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.915+0000 7f34c1726800 1 --2- 172.21.15.142:0/3578058620 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5585d5953be0 0x5585d5a4ed10 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f34b0025c20 tx=0x7f34b0002fb0 comp rx=0 tx=0).stop 2024-09-22T08:37:04.923 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.915+0000 7f34c1726800 1 -- 172.21.15.142:0/3578058620 shutdown_connections 2024-09-22T08:37:04.923 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.915+0000 7f34c1726800 1 --2- 172.21.15.142:0/3578058620 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5585d5a58740 0x5585d5a5abe0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:04.924 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.915+0000 7f34c1726800 1 --2- 172.21.15.142:0/3578058620 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5585d5958850 0x5585d5a56360 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:04.924 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.915+0000 7f34c1726800 1 --2- 172.21.15.142:0/3578058620 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f33a403d000 0x7f33a403f4c0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:04.924 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.915+0000 7f34c1726800 1 --2- 172.21.15.142:0/3578058620 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5585d5953be0 0x5585d5a4ed10 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:04.924 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.915+0000 7f34c1726800 1 -- 172.21.15.142:0/3578058620 >> 172.21.15.142:0/3578058620 conn(0x5585d594f310 msgr2=0x5585d5a40510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:37:04.924 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.915+0000 7f34c1726800 1 -- 172.21.15.142:0/3578058620 shutdown_connections 2024-09-22T08:37:04.924 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.915+0000 7f34c1726800 1 -- 172.21.15.142:0/3578058620 wait complete. 2024-09-22T08:37:04.925 INFO:teuthology.orchestra.run.smithi142.stdout:[] 2024-09-22T08:37:04.925 DEBUG:tasks.util.rgw: json result: [] 2024-09-22T08:37:04.925 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo'] 2024-09-22T08:37:04.925 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo'] 2024-09-22T08:37:04.925 DEBUG:teuthology.orchestra.run.smithi142:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo 2024-09-22T08:37:04.971 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:37:04.972 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:37:04.973 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.971+0000 7fc03f40f800 1 Processor -- start 2024-09-22T08:37:04.973 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.971+0000 7fc03f40f800 1 -- start start 2024-09-22T08:37:04.973 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.971+0000 7fc03f40f800 1 --2- >> v2:172.21.15.31:3300/0 conn(0x561dcd115d10 0x561dcd1a74a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:04.973 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.971+0000 7fc03f40f800 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x561dcd02da20 con 0x561dcd1a7a10 2024-09-22T08:37:04.973 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.971+0000 7fc03f40f800 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x561dcd02d7d0 con 0x561dcd115d10 2024-09-22T08:37:04.973 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.972+0000 7fc03cef9640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x561dcd115d10 0x561dcd1a74a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:04.973 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.972+0000 7fc03cef9640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x561dcd115d10 0x561dcd1a74a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:59392/0 (socket says 172.21.15.142:59392) 2024-09-22T08:37:04.974 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.972+0000 7fc03cef9640 1 -- 172.21.15.142:0/67899695 learned_addr learned my addr 172.21.15.142:0/67899695 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:37:04.974 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.972+0000 7fc03c6f8640 1 --1- 172.21.15.142:0/67899695 >> v1:172.21.15.31:6789/0 conn(0x561dcd1a7a10 0x561dcd1a9ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.142:56336/0 (socket says 172.21.15.142:56336) 2024-09-22T08:37:04.974 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.972+0000 7fc03cef9640 1 -- 172.21.15.142:0/67899695 >> v1:172.21.15.31:6789/0 conn(0x561dcd1a7a10 legacy=0x561dcd1a9ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:04.974 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.972+0000 7fc03cef9640 1 -- 172.21.15.142:0/67899695 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x561dcd1ac7c0 con 0x561dcd115d10 2024-09-22T08:37:04.976 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.974+0000 7fc03cef9640 1 --2- 172.21.15.142:0/67899695 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561dcd115d10 0x561dcd1a74a0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fc02c005fd0 tx=0x7fc02c045cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49fb04eb5614ff69 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:04.976 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.974+0000 7fc03bef7640 1 -- 172.21.15.142:0/67899695 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc02c04e600 con 0x561dcd115d10 2024-09-22T08:37:04.976 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.974+0000 7fc03bef7640 1 -- 172.21.15.142:0/67899695 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc02c04e7a0 con 0x561dcd115d10 2024-09-22T08:37:04.976 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.974+0000 7fc03bef7640 1 -- 172.21.15.142:0/67899695 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc02c04eaa0 con 0x561dcd115d10 2024-09-22T08:37:04.976 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.974+0000 7fc03f40f800 1 -- 172.21.15.142:0/67899695 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561dcd115d10 msgr2=0x561dcd1a74a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:04.976 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.974+0000 7fc03f40f800 1 --2- 172.21.15.142:0/67899695 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561dcd115d10 0x561dcd1a74a0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fc02c005fd0 tx=0x7fc02c045cf0 comp rx=0 tx=0).stop 2024-09-22T08:37:04.976 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.975+0000 7fc03f40f800 1 -- 172.21.15.142:0/67899695 shutdown_connections 2024-09-22T08:37:04.977 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.975+0000 7fc03f40f800 1 --2- 172.21.15.142:0/67899695 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561dcd115d10 0x561dcd1a74a0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:04.977 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.975+0000 7fc03f40f800 1 -- 172.21.15.142:0/67899695 >> 172.21.15.142:0/67899695 conn(0x561dcd19cbb0 msgr2=0x561dcd19f010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:37:04.977 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.975+0000 7fc03f40f800 1 -- 172.21.15.142:0/67899695 shutdown_connections 2024-09-22T08:37:04.977 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.975+0000 7fc03f40f800 1 -- 172.21.15.142:0/67899695 wait complete. 2024-09-22T08:37:04.989 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.988+0000 7fc03f40f800 1 Processor -- start 2024-09-22T08:37:04.990 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.988+0000 7fc03f40f800 1 -- start start 2024-09-22T08:37:04.990 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.988+0000 7fc03f40f800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561dcd115d10 0x561dcd294230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:04.990 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.988+0000 7fc03f40f800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x561dcd03add0 con 0x561dcd115d10 2024-09-22T08:37:04.991 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.989+0000 7fc03cef9640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561dcd115d10 0x561dcd294230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:04.991 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.989+0000 7fc03cef9640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561dcd115d10 0x561dcd294230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:59398/0 (socket says 172.21.15.142:59398) 2024-09-22T08:37:04.991 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.989+0000 7fc03cef9640 1 -- 172.21.15.142:0/727878807 learned_addr learned my addr 172.21.15.142:0/727878807 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:37:04.991 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.989+0000 7fc03cef9640 1 -- 172.21.15.142:0/727878807 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561dcd294820 con 0x561dcd115d10 2024-09-22T08:37:04.991 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.989+0000 7fc03cef9640 1 --2- 172.21.15.142:0/727878807 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561dcd115d10 0x561dcd294230 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fc02c005fd0 tx=0x7fc02c050000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c48e59f22930300f server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:04.991 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.989+0000 7fbf2ae0d640 1 -- 172.21.15.142:0/727878807 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc02c04ea80 con 0x561dcd115d10 2024-09-22T08:37:04.991 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.989+0000 7fbf2ae0d640 1 -- 172.21.15.142:0/727878807 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc02c066070 con 0x561dcd115d10 2024-09-22T08:37:04.991 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.989+0000 7fbf2ae0d640 1 -- 172.21.15.142:0/727878807 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc02c04edc0 con 0x561dcd115d10 2024-09-22T08:37:04.993 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.990+0000 7fc03f40f800 1 -- 172.21.15.142:0/727878807 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561dcd115d10 msgr2=0x561dcd294230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:04.993 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.990+0000 7fc03f40f800 1 --2- 172.21.15.142:0/727878807 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561dcd115d10 0x561dcd294230 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fc02c005fd0 tx=0x7fc02c050000 comp rx=0 tx=0).stop 2024-09-22T08:37:04.993 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.990+0000 7fc03f40f800 1 -- 172.21.15.142:0/727878807 shutdown_connections 2024-09-22T08:37:04.994 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.990+0000 7fc03f40f800 1 --2- 172.21.15.142:0/727878807 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561dcd115d10 0x561dcd294230 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:04.994 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.990+0000 7fc03f40f800 1 -- 172.21.15.142:0/727878807 >> 172.21.15.142:0/727878807 conn(0x561dcd19cbb0 msgr2=0x561dcd28fbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:37:04.994 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.990+0000 7fc03f40f800 1 -- 172.21.15.142:0/727878807 shutdown_connections 2024-09-22T08:37:04.994 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.990+0000 7fc03f40f800 1 -- 172.21.15.142:0/727878807 wait complete. 2024-09-22T08:37:04.994 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.990+0000 7fc03f40f800 1 Processor -- start 2024-09-22T08:37:04.994 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.991+0000 7fc03f40f800 1 -- start start 2024-09-22T08:37:04.994 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.991+0000 7fc03f40f800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561dcd115d10 0x561dcd29bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:04.994 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.991+0000 7fc03f40f800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x561dcd1aba60 con 0x561dcd115d10 2024-09-22T08:37:04.994 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.991+0000 7fc03cef9640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561dcd115d10 0x561dcd29bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:04.994 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.991+0000 7fc03cef9640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561dcd115d10 0x561dcd29bbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:59402/0 (socket says 172.21.15.142:59402) 2024-09-22T08:37:04.994 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.991+0000 7fc03cef9640 1 -- 172.21.15.142:0/1540849961 learned_addr learned my addr 172.21.15.142:0/1540849961 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:37:04.994 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.991+0000 7fc03cef9640 1 -- 172.21.15.142:0/1540849961 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561dcd29c120 con 0x561dcd115d10 2024-09-22T08:37:04.995 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.992+0000 7fc03cef9640 1 --2- 172.21.15.142:0/1540849961 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561dcd115d10 0x561dcd29bbc0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fc02c063040 tx=0x7fc02c003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:04.995 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.992+0000 7fbf2960a640 1 -- 172.21.15.142:0/1540849961 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc02c06d610 con 0x561dcd115d10 2024-09-22T08:37:04.995 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.992+0000 7fbf2960a640 1 -- 172.21.15.142:0/1540849961 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc02c071030 con 0x561dcd115d10 2024-09-22T08:37:04.995 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.992+0000 7fc03f40f800 1 -- 172.21.15.142:0/1540849961 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561dcd29c3b0 con 0x561dcd115d10 2024-09-22T08:37:04.995 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.992+0000 7fbf2960a640 1 -- 172.21.15.142:0/1540849961 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc02c06d900 con 0x561dcd115d10 2024-09-22T08:37:04.995 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.992+0000 7fc03f40f800 1 -- 172.21.15.142:0/1540849961 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561dcd29cdb0 con 0x561dcd115d10 2024-09-22T08:37:04.999 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.993+0000 7fbf2960a640 1 -- 172.21.15.142:0/1540849961 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fc02c06db30 con 0x561dcd115d10 2024-09-22T08:37:04.999 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.993+0000 7fbf2960a640 1 --2- 172.21.15.142:0/1540849961 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fbf2403cfb0 0x7fbf2403f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:04.999 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.993+0000 7fbf2960a640 1 -- 172.21.15.142:0/1540849961 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5938+0+0 (secure 0 0 0) 0x7fc02c098d30 con 0x561dcd115d10 2024-09-22T08:37:04.999 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.993+0000 7fc03c6f8640 1 --2- 172.21.15.142:0/1540849961 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fbf2403cfb0 0x7fbf2403f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:04.999 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.993+0000 7fc03f40f800 1 --2- 172.21.15.142:0/1540849961 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x561dcd1a7a10 0x561dcd2a3210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:04.999 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.993+0000 7fc03f40f800 1 -- 172.21.15.142:0/1540849961 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561dcd2a3750 con 0x561dcd1a7a10 2024-09-22T08:37:04.999 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.993+0000 7fc03d6fa640 1 --2- 172.21.15.142:0/1540849961 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x561dcd1a7a10 0x561dcd2a3210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:04.999 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.993+0000 7fc03c6f8640 1 --2- 172.21.15.142:0/1540849961 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fbf2403cfb0 0x7fbf2403f470 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fc030001e30 tx=0x7fc030001390 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:05.000 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.994+0000 7fc03d6fa640 1 --2- 172.21.15.142:0/1540849961 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x561dcd1a7a10 0x561dcd2a3210 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:05.000 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.994+0000 7fc03d6fa640 1 -- 172.21.15.142:0/1540849961 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc0340083e0 con 0x561dcd1a7a10 2024-09-22T08:37:05.000 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.994+0000 7fc03f40f800 1 -- 172.21.15.142:0/1540849961 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561dcd2a3af0 con 0x561dcd1a7a10 2024-09-22T08:37:05.000 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.994+0000 7fc03d6fa640 1 -- 172.21.15.142:0/1540849961 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc0340083e0 con 0x561dcd1a7a10 2024-09-22T08:37:05.000 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.994+0000 7fc03f40f800 1 --2- 172.21.15.142:0/1540849961 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x561dcd2a55f0 0x561dcd2a7a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:05.000 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.994+0000 7fc03f40f800 1 -- 172.21.15.142:0/1540849961 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:3 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561dcd2a8200 con 0x561dcd2a55f0 2024-09-22T08:37:05.000 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.994+0000 7fc03cef9640 1 --2- 172.21.15.142:0/1540849961 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x561dcd2a55f0 0x561dcd2a7a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:05.000 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.994+0000 7fc03cef9640 1 --2- 172.21.15.142:0/1540849961 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x561dcd2a55f0 0x561dcd2a7a70 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:05.000 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.995+0000 7fc03cef9640 1 -- 172.21.15.142:0/1540849961 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(3 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fc02c07d070 con 0x561dcd2a55f0 2024-09-22T08:37:05.000 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.995+0000 7fc03f40f800 1 -- 172.21.15.142:0/1540849961 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561dcd2a4340 con 0x561dcd1a7a10 2024-09-22T08:37:05.000 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.995+0000 7fc03d6fa640 1 -- 172.21.15.142:0/1540849961 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc0340083e0 con 0x561dcd1a7a10 2024-09-22T08:37:05.000 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.995+0000 7fc03f40f800 1 -- 172.21.15.142:0/1540849961 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561dcd2a4790 con 0x561dcd2a55f0 2024-09-22T08:37:05.000 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.995+0000 7fc03cef9640 1 -- 172.21.15.142:0/1540849961 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(5 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fc02c07d070 con 0x561dcd2a55f0 2024-09-22T08:37:05.001 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.996+0000 7fc03f40f800 1 Processor -- start 2024-09-22T08:37:05.001 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.996+0000 7fc03f40f800 1 -- start start 2024-09-22T08:37:05.001 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.996+0000 7fc03f40f800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561dcd2b6c20 0x561dcd2b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:05.001 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.996+0000 7fc03f40f800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x561dcd099d50 con 0x561dcd2b6c20 2024-09-22T08:37:05.001 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.996+0000 7fc03d6fa640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561dcd2b6c20 0x561dcd2b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:05.001 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.996+0000 7fc03d6fa640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561dcd2b6c20 0x561dcd2b7040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:59412/0 (socket says 172.21.15.142:59412) 2024-09-22T08:37:05.001 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.996+0000 7fc03d6fa640 1 -- 172.21.15.142:0/1982308256 learned_addr learned my addr 172.21.15.142:0/1982308256 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:37:05.001 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.996+0000 7fc03d6fa640 1 -- 172.21.15.142:0/1982308256 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561dcd2b7680 con 0x561dcd2b6c20 2024-09-22T08:37:05.001 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.996+0000 7fc03d6fa640 1 --2- 172.21.15.142:0/1982308256 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561dcd2b6c20 0x561dcd2b7040 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x561dcd29cbc0 tx=0x7fc03400bf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:05.001 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.997+0000 7fbf227fc640 1 -- 172.21.15.142:0/1982308256 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc03401c020 con 0x561dcd2b6c20 2024-09-22T08:37:05.001 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.997+0000 7fbf227fc640 1 -- 172.21.15.142:0/1982308256 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc034007c90 con 0x561dcd2b6c20 2024-09-22T08:37:05.001 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.997+0000 7fc03f40f800 1 -- 172.21.15.142:0/1982308256 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561dcd2b7eb0 con 0x561dcd2b6c20 2024-09-22T08:37:05.002 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.997+0000 7fbf227fc640 1 -- 172.21.15.142:0/1982308256 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc034018440 con 0x561dcd2b6c20 2024-09-22T08:37:05.002 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.997+0000 7fc03f40f800 1 -- 172.21.15.142:0/1982308256 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561dcd2b8450 con 0x561dcd2b6c20 2024-09-22T08:37:05.002 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.998+0000 7fbf227fc640 1 -- 172.21.15.142:0/1982308256 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fc03401f020 con 0x561dcd2b6c20 2024-09-22T08:37:05.002 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.998+0000 7fbf227fc640 1 --2- 172.21.15.142:0/1982308256 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fbf1403cfb0 0x7fbf1403f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:05.002 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.998+0000 7fbf227fc640 1 -- 172.21.15.142:0/1982308256 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5938+0+0 (secure 0 0 0) 0x7fc034055990 con 0x561dcd2b6c20 2024-09-22T08:37:05.002 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.998+0000 7fc03cef9640 1 --2- 172.21.15.142:0/1982308256 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fbf1403cfb0 0x7fbf1403f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:05.020 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.998+0000 7fc03f40f800 1 Processor -- start 2024-09-22T08:37:05.020 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.998+0000 7fc03cef9640 1 --2- 172.21.15.142:0/1982308256 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fbf1403cfb0 0x7fbf1403f470 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x561dcd2a46e0 tx=0x7fc02c075c20 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:05.021 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.998+0000 7fc03f40f800 1 -- start start 2024-09-22T08:37:05.021 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.998+0000 7fc03f40f800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561dcd2c3680 0x561dcd2c3a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:05.021 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.998+0000 7fc03f40f800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x561dcd294b90 con 0x561dcd2c3680 2024-09-22T08:37:05.021 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.999+0000 7fc03d6fa640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561dcd2c3680 0x561dcd2c3a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:05.021 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.999+0000 7fc03d6fa640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561dcd2c3680 0x561dcd2c3a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:59418/0 (socket says 172.21.15.142:59418) 2024-09-22T08:37:05.021 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.999+0000 7fc03d6fa640 1 -- 172.21.15.142:0/328770866 learned_addr learned my addr 172.21.15.142:0/328770866 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:37:05.021 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.999+0000 7fc03d6fa640 1 -- 172.21.15.142:0/328770866 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561dcd2c4070 con 0x561dcd2c3680 2024-09-22T08:37:05.021 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.999+0000 7fc03d6fa640 1 --2- 172.21.15.142:0/328770866 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561dcd2c3680 0x561dcd2c3a80 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fc034053df0 tx=0x7fc0340158b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=593207cc627548b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:05.021 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.999+0000 7fbf13fff640 1 -- 172.21.15.142:0/328770866 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc03404a070 con 0x561dcd2c3680 2024-09-22T08:37:05.021 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.999+0000 7fbf13fff640 1 -- 172.21.15.142:0/328770866 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc034015e70 con 0x561dcd2c3680 2024-09-22T08:37:05.022 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:04.999+0000 7fbf13fff640 1 -- 172.21.15.142:0/328770866 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc0340174d0 con 0x561dcd2c3680 2024-09-22T08:37:05.022 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.000+0000 7fc03f40f800 1 -- 172.21.15.142:0/328770866 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561dcd2c3680 msgr2=0x561dcd2c3a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:05.022 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.000+0000 7fc03f40f800 1 --2- 172.21.15.142:0/328770866 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561dcd2c3680 0x561dcd2c3a80 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fc034053df0 tx=0x7fc0340158b0 comp rx=0 tx=0).stop 2024-09-22T08:37:05.022 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.000+0000 7fc03f40f800 1 -- 172.21.15.142:0/328770866 shutdown_connections 2024-09-22T08:37:05.022 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.000+0000 7fc03f40f800 1 --2- 172.21.15.142:0/328770866 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561dcd2c3680 0x561dcd2c3a80 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:05.022 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.000+0000 7fc03f40f800 1 -- 172.21.15.142:0/328770866 >> 172.21.15.142:0/328770866 conn(0x561dcd2bfaa0 msgr2=0x561dcd2bdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:37:05.022 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.000+0000 7fc03f40f800 1 -- 172.21.15.142:0/328770866 shutdown_connections 2024-09-22T08:37:05.022 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.000+0000 7fc03f40f800 1 -- 172.21.15.142:0/328770866 wait complete. 2024-09-22T08:37:05.022 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.000+0000 7fc03f40f800 1 Processor -- start 2024-09-22T08:37:05.022 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.000+0000 7fc03f40f800 1 -- start start 2024-09-22T08:37:05.022 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.001+0000 7fc03f40f800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561dcd2c3680 0x561dcd2cabf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:05.022 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.001+0000 7fc03f40f800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x561dcd2c4690 con 0x561dcd2c3680 2024-09-22T08:37:05.023 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.001+0000 7fc03d6fa640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561dcd2c3680 0x561dcd2cabf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:05.023 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.001+0000 7fc03d6fa640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561dcd2c3680 0x561dcd2cabf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:59422/0 (socket says 172.21.15.142:59422) 2024-09-22T08:37:05.023 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.001+0000 7fc03d6fa640 1 -- 172.21.15.142:0/1047240250 learned_addr learned my addr 172.21.15.142:0/1047240250 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:37:05.023 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.001+0000 7fc03d6fa640 1 -- 172.21.15.142:0/1047240250 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561dcd2cb150 con 0x561dcd2c3680 2024-09-22T08:37:05.023 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.001+0000 7fc03d6fa640 1 --2- 172.21.15.142:0/1047240250 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561dcd2c3680 0x561dcd2cabf0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fc0340154a0 tx=0x7fc034053d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:05.023 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.001+0000 7fbf127fc640 1 -- 172.21.15.142:0/1047240250 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc03402e070 con 0x561dcd2c3680 2024-09-22T08:37:05.023 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.001+0000 7fbf127fc640 1 -- 172.21.15.142:0/1047240250 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc03404b040 con 0x561dcd2c3680 2024-09-22T08:37:05.023 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.001+0000 7fbf127fc640 1 -- 172.21.15.142:0/1047240250 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc03404a070 con 0x561dcd2c3680 2024-09-22T08:37:05.023 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.002+0000 7fc03f40f800 1 -- 172.21.15.142:0/1047240250 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561dcd2cb3e0 con 0x561dcd2c3680 2024-09-22T08:37:05.023 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.002+0000 7fc03f40f800 1 -- 172.21.15.142:0/1047240250 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561dcd2cbf70 con 0x561dcd2c3680 2024-09-22T08:37:05.023 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.002+0000 7fbf127fc640 1 -- 172.21.15.142:0/1047240250 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fc034016040 con 0x561dcd2c3680 2024-09-22T08:37:05.024 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.003+0000 7fbf127fc640 1 --2- 172.21.15.142:0/1047240250 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fbf0803cf60 0x7fbf0803f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:05.024 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.003+0000 7fbf127fc640 1 -- 172.21.15.142:0/1047240250 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5938+0+0 (secure 0 0 0) 0x7fc03403d3a0 con 0x561dcd2c3680 2024-09-22T08:37:05.024 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.003+0000 7fc03cef9640 1 --2- 172.21.15.142:0/1047240250 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fbf0803cf60 0x7fbf0803f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:05.024 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.003+0000 7fc03f40f800 20 rados->read ofs=0 len=0 2024-09-22T08:37:05.024 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.003+0000 7fc03f40f800 1 --2- 172.21.15.142:0/1047240250 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x561dcd2d6550 0x561dcd2d8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:05.024 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.003+0000 7fc03f40f800 1 -- 172.21.15.142:0/1047240250 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561dcd2d9160 con 0x561dcd2d6550 2024-09-22T08:37:05.024 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.003+0000 7fc03cef9640 1 --2- 172.21.15.142:0/1047240250 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fbf0803cf60 0x7fbf0803f420 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fc02c06d010 tx=0x7fc02c089000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:05.024 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.003+0000 7fc03c6f8640 1 --2- 172.21.15.142:0/1047240250 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x561dcd2d6550 0x561dcd2d8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:05.024 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.004+0000 7fc03c6f8640 1 --2- 172.21.15.142:0/1047240250 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x561dcd2d6550 0x561dcd2d8a10 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:05.024 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.004+0000 7fc03c6f8640 1 -- 172.21.15.142:0/1047240250 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc03000f610 con 0x561dcd2d6550 2024-09-22T08:37:05.024 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.004+0000 7fc03f40f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:05.025 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.004+0000 7fc03f40f800 20 realm 2024-09-22T08:37:05.025 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.004+0000 7fc03f40f800 20 rados->read ofs=0 len=0 2024-09-22T08:37:05.025 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.004+0000 7fc03f40f800 1 -- 172.21.15.142:0/1047240250 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561dcd2d58a0 con 0x561dcd2d6550 2024-09-22T08:37:05.025 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.004+0000 7fc03c6f8640 1 -- 172.21.15.142:0/1047240250 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc03000f610 con 0x561dcd2d6550 2024-09-22T08:37:05.025 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.004+0000 7fc03f40f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:05.025 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.004+0000 7fc03f40f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:37:05.025 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.004+0000 7fc03f40f800 20 rados->read ofs=0 len=0 2024-09-22T08:37:05.025 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.004+0000 7fc03f40f800 1 -- 172.21.15.142:0/1047240250 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561dcd2d9c50 con 0x561dcd2d6550 2024-09-22T08:37:05.025 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.004+0000 7fc03c6f8640 1 -- 172.21.15.142:0/1047240250 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc03000f610 con 0x561dcd2d6550 2024-09-22T08:37:05.025 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.004+0000 7fc03f40f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:05.025 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.004+0000 7fc03f40f800 20 rados->read ofs=0 len=0 2024-09-22T08:37:05.026 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.004+0000 7fc03f40f800 1 -- 172.21.15.142:0/1047240250 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561dcd2da520 con 0x561dcd2d6550 2024-09-22T08:37:05.026 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.005+0000 7fc03c6f8640 1 -- 172.21.15.142:0/1047240250 <== osd.1 v2:172.21.15.142:6816/3192108003 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc03000f610 con 0x561dcd2d6550 2024-09-22T08:37:05.026 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.005+0000 7fc03f40f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:37:05.026 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.005+0000 7fc03f40f800 20 rados->read ofs=0 len=0 2024-09-22T08:37:05.026 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.005+0000 7fc03f40f800 1 --2- 172.21.15.142:0/1047240250 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x561dcd2daf40 0x561dcd2dd330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:05.026 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.005+0000 7fc03f40f800 1 -- 172.21.15.142:0/1047240250 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561dcd2dda70 con 0x561dcd2daf40 2024-09-22T08:37:05.026 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.005+0000 7fc03d6fa640 1 --2- 172.21.15.142:0/1047240250 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x561dcd2daf40 0x561dcd2dd330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:05.026 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.005+0000 7fc03d6fa640 1 --2- 172.21.15.142:0/1047240250 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x561dcd2daf40 0x561dcd2dd330 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:05.026 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.005+0000 7fc03d6fa640 1 -- 172.21.15.142:0/1047240250 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(5 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fc0340083e0 con 0x561dcd2daf40 2024-09-22T08:37:05.026 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.005+0000 7fc03f40f800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:37:05.027 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.005+0000 7fc03f40f800 20 searching for the correct realm 2024-09-22T08:37:05.027 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.005+0000 7fc03f40f800 1 -- 172.21.15.142:0/1047240250 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561dcd2df3a0 con 0x561dcd2daf40 2024-09-22T08:37:05.027 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.005+0000 7fc03d6fa640 1 -- 172.21.15.142:0/1047240250 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc0340083e0 con 0x561dcd2daf40 2024-09-22T08:37:05.027 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.006+0000 7fc03d6fa640 1 --2- 172.21.15.142:0/1047240250 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7fc034032020 0x7fc03401e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:05.027 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.006+0000 7fc03d6fa640 1 -- 172.21.15.142:0/1047240250 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561dcd2df3a0 con 0x7fc034032020 2024-09-22T08:37:05.027 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.006+0000 7fc03cef9640 1 --2- 172.21.15.142:0/1047240250 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7fc034032020 0x7fc03401e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:05.027 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.006+0000 7fc03cef9640 1 --2- 172.21.15.142:0/1047240250 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7fc034032020 0x7fc03401e2c0 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:05.027 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.006+0000 7fc03cef9640 1 -- 172.21.15.142:0/1047240250 <== osd.2 v2:172.21.15.142:6808/279438927 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc02c07d070 con 0x7fc034032020 2024-09-22T08:37:05.027 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.006+0000 7fc03cef9640 1 --2- 172.21.15.142:0/1047240250 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7fc02c06d040 0x7fc02c06a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:05.027 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.006+0000 7fc03cef9640 1 -- 172.21.15.142:0/1047240250 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561dcd2df3a0 con 0x7fc02c06d040 2024-09-22T08:37:05.027 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.006+0000 7fc03c6f8640 1 --2- 172.21.15.142:0/1047240250 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7fc02c06d040 0x7fc02c06a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:05.028 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.007+0000 7fc03c6f8640 1 --2- 172.21.15.142:0/1047240250 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7fc02c06d040 0x7fc02c06a630 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:05.028 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.007+0000 7fc03c6f8640 1 -- 172.21.15.142:0/1047240250 <== osd.0 v2:172.21.15.31:6800/168281188 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc03000f610 con 0x7fc02c06d040 2024-09-22T08:37:05.028 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.007+0000 7fc03c6f8640 1 -- 172.21.15.142:0/1047240250 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561dcd2df3a0 con 0x561dcd2d6550 2024-09-22T08:37:05.028 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.007+0000 7fc03c6f8640 1 -- 172.21.15.142:0/1047240250 <== osd.1 v2:172.21.15.142:6816/3192108003 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc03000f610 con 0x561dcd2d6550 2024-09-22T08:37:05.028 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.007+0000 7fc03c6f8640 1 -- 172.21.15.142:0/1047240250 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561dcd2df3a0 con 0x561dcd2d6550 2024-09-22T08:37:05.028 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.008+0000 7fc03c6f8640 1 -- 172.21.15.142:0/1047240250 <== osd.1 v2:172.21.15.142:6816/3192108003 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc03002b040 con 0x561dcd2d6550 2024-09-22T08:37:05.028 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.008+0000 7fc03c6f8640 1 -- 172.21.15.142:0/1047240250 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561dcd2df3a0 con 0x561dcd2d6550 2024-09-22T08:37:05.028 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.008+0000 7fc03c6f8640 1 -- 172.21.15.142:0/1047240250 <== osd.1 v2:172.21.15.142:6816/3192108003 7 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc03002b040 con 0x561dcd2d6550 2024-09-22T08:37:05.028 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.008+0000 7fc03c6f8640 1 -- 172.21.15.142:0/1047240250 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561dcd2df3a0 con 0x7fc02c06d040 2024-09-22T08:37:05.028 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.008+0000 7fc03c6f8640 1 -- 172.21.15.142:0/1047240250 <== osd.0 v2:172.21.15.31:6800/168281188 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc03002b040 con 0x7fc02c06d040 2024-09-22T08:37:05.029 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.008+0000 7fc03c6f8640 1 -- 172.21.15.142:0/1047240250 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561dcd2df3a0 con 0x7fc034032020 2024-09-22T08:37:05.029 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.008+0000 7fc03cef9640 1 -- 172.21.15.142:0/1047240250 <== osd.2 v2:172.21.15.142:6808/279438927 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc02c07d070 con 0x7fc034032020 2024-09-22T08:37:05.029 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.008+0000 7fc03cef9640 1 -- 172.21.15.142:0/1047240250 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561dcd2df3a0 con 0x561dcd2daf40 2024-09-22T08:37:05.029 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.008+0000 7fc03d6fa640 1 -- 172.21.15.142:0/1047240250 <== osd.3 v2:172.21.15.142:6800/1064901393 3 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc0340083e0 con 0x561dcd2daf40 2024-09-22T08:37:05.029 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.008+0000 7fc03d6fa640 1 -- 172.21.15.142:0/1047240250 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561dcd2df3a0 con 0x561dcd2d6550 2024-09-22T08:37:05.029 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.009+0000 7fc03c6f8640 1 -- 172.21.15.142:0/1047240250 <== osd.1 v2:172.21.15.142:6816/3192108003 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc03002b040 con 0x561dcd2d6550 2024-09-22T08:37:05.029 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.009+0000 7fc03c6f8640 1 -- 172.21.15.142:0/1047240250 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561dcd2df3a0 con 0x7fc02c06d040 2024-09-22T08:37:05.029 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.009+0000 7fc03c6f8640 1 -- 172.21.15.142:0/1047240250 <== osd.0 v2:172.21.15.31:6800/168281188 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc03002b040 con 0x7fc02c06d040 2024-09-22T08:37:05.029 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.009+0000 7fc03c6f8640 1 -- 172.21.15.142:0/1047240250 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561dcd2df3a0 con 0x561dcd2d6550 2024-09-22T08:37:05.029 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.009+0000 7fc03c6f8640 1 -- 172.21.15.142:0/1047240250 <== osd.1 v2:172.21.15.142:6816/3192108003 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc03002b040 con 0x561dcd2d6550 2024-09-22T08:37:05.029 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.009+0000 7fc03c6f8640 1 -- 172.21.15.142:0/1047240250 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561dcd2df3a0 con 0x7fc034032020 2024-09-22T08:37:05.029 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.009+0000 7fc03cef9640 1 -- 172.21.15.142:0/1047240250 <== osd.2 v2:172.21.15.142:6808/279438927 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fc02c07d070 con 0x7fc034032020 2024-09-22T08:37:05.030 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.009+0000 7fc03cef9640 1 -- 172.21.15.142:0/1047240250 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561dcd2df3a0 con 0x561dcd2daf40 2024-09-22T08:37:05.030 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.010+0000 7fc03d6fa640 1 -- 172.21.15.142:0/1047240250 <== osd.3 v2:172.21.15.142:6800/1064901393 4 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc0340083e0 con 0x561dcd2daf40 2024-09-22T08:37:05.030 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.010+0000 7fc03d6fa640 1 -- 172.21.15.142:0/1047240250 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561dcd2df3a0 con 0x561dcd2daf40 2024-09-22T08:37:05.030 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.010+0000 7fc03d6fa640 1 -- 172.21.15.142:0/1047240250 <== osd.3 v2:172.21.15.142:6800/1064901393 5 ==== osd_op_reply(20 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fc0340083e0 con 0x561dcd2daf40 2024-09-22T08:37:05.030 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.010+0000 7fc03d6fa640 1 -- 172.21.15.142:0/1047240250 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561dcd2df3a0 con 0x7fc02c06d040 2024-09-22T08:37:05.030 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.010+0000 7fc03c6f8640 1 -- 172.21.15.142:0/1047240250 <== osd.0 v2:172.21.15.31:6800/168281188 4 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc03002b040 con 0x7fc02c06d040 2024-09-22T08:37:05.030 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.010+0000 7fc03c6f8640 1 -- 172.21.15.142:0/1047240250 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561dcd2df3a0 con 0x561dcd2daf40 2024-09-22T08:37:05.030 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.010+0000 7fc03d6fa640 1 -- 172.21.15.142:0/1047240250 <== osd.3 v2:172.21.15.142:6800/1064901393 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc0340083e0 con 0x561dcd2daf40 2024-09-22T08:37:05.030 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.010+0000 7fc03d6fa640 1 -- 172.21.15.142:0/1047240250 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561dcd2df3a0 con 0x561dcd2daf40 2024-09-22T08:37:05.030 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.011+0000 7fc03d6fa640 1 -- 172.21.15.142:0/1047240250 <== osd.3 v2:172.21.15.142:6800/1064901393 7 ==== osd_op_reply(23 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fc0340083e0 con 0x561dcd2daf40 2024-09-22T08:37:05.031 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.011+0000 7fc03d6fa640 1 -- 172.21.15.142:0/1047240250 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561dcd2df3a0 con 0x561dcd2d6550 2024-09-22T08:37:05.031 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.011+0000 7fc03c6f8640 1 -- 172.21.15.142:0/1047240250 <== osd.1 v2:172.21.15.142:6816/3192108003 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc03002b040 con 0x561dcd2d6550 2024-09-22T08:37:05.031 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.011+0000 7fc03c6f8640 1 -- 172.21.15.142:0/1047240250 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561dcd2df3a0 con 0x561dcd2d6550 2024-09-22T08:37:05.031 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.011+0000 7fc03c6f8640 1 -- 172.21.15.142:0/1047240250 <== osd.1 v2:172.21.15.142:6816/3192108003 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fc03002b040 con 0x561dcd2d6550 2024-09-22T08:37:05.031 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.011+0000 7fc03c6f8640 1 -- 172.21.15.142:0/1047240250 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561dcd2df3a0 con 0x7fc02c06d040 2024-09-22T08:37:05.031 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.011+0000 7fc03c6f8640 1 -- 172.21.15.142:0/1047240250 <== osd.0 v2:172.21.15.31:6800/168281188 5 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc03002b040 con 0x7fc02c06d040 2024-09-22T08:37:05.031 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.011+0000 7fc03c6f8640 1 -- 172.21.15.142:0/1047240250 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561dcd2df3a0 con 0x561dcd2daf40 2024-09-22T08:37:05.031 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.012+0000 7fc03d6fa640 1 -- 172.21.15.142:0/1047240250 <== osd.3 v2:172.21.15.142:6800/1064901393 8 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc0340083e0 con 0x561dcd2daf40 2024-09-22T08:37:05.031 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.012+0000 7fc03d6fa640 1 -- 172.21.15.142:0/1047240250 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561dcd2df3a0 con 0x7fc034032020 2024-09-22T08:37:05.031 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.012+0000 7fc03cef9640 1 -- 172.21.15.142:0/1047240250 <== osd.2 v2:172.21.15.142:6808/279438927 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc02c07d070 con 0x7fc034032020 2024-09-22T08:37:05.031 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.012+0000 7fc03cef9640 1 -- 172.21.15.142:0/1047240250 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561dcd2df3a0 con 0x561dcd2d6550 2024-09-22T08:37:05.032 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.012+0000 7fc03c6f8640 1 -- 172.21.15.142:0/1047240250 <== osd.1 v2:172.21.15.142:6816/3192108003 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc03002b040 con 0x561dcd2d6550 2024-09-22T08:37:05.032 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.012+0000 7fc03c6f8640 1 -- 172.21.15.142:0/1047240250 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561dcd2df3a0 con 0x7fc02c06d040 2024-09-22T08:37:05.032 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.013+0000 7fc03c6f8640 1 -- 172.21.15.142:0/1047240250 <== osd.0 v2:172.21.15.31:6800/168281188 6 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc03003b040 con 0x7fc02c06d040 2024-09-22T08:37:05.032 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.013+0000 7fc03c6f8640 1 -- 172.21.15.142:0/1047240250 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561dcd2df3a0 con 0x561dcd2daf40 2024-09-22T08:37:05.032 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.013+0000 7fc03d6fa640 1 -- 172.21.15.142:0/1047240250 <== osd.3 v2:172.21.15.142:6800/1064901393 9 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc0340083e0 con 0x561dcd2daf40 2024-09-22T08:37:05.032 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.013+0000 7fc03d6fa640 1 -- 172.21.15.142:0/1047240250 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561dcd2df3a0 con 0x7fc02c06d040 2024-09-22T08:37:05.032 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.013+0000 7fc03c6f8640 1 -- 172.21.15.142:0/1047240250 <== osd.0 v2:172.21.15.31:6800/168281188 7 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc03003b040 con 0x7fc02c06d040 2024-09-22T08:37:05.032 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.013+0000 7fc03c6f8640 1 -- 172.21.15.142:0/1047240250 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561dcd2df3a0 con 0x7fc034032020 2024-09-22T08:37:05.032 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.013+0000 7fc03cef9640 1 -- 172.21.15.142:0/1047240250 <== osd.2 v2:172.21.15.142:6808/279438927 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc02c07d070 con 0x7fc034032020 2024-09-22T08:37:05.032 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.013+0000 7fc03cef9640 1 -- 172.21.15.142:0/1047240250 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561dcd2df3a0 con 0x561dcd2daf40 2024-09-22T08:37:05.033 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.014+0000 7fc03d6fa640 1 -- 172.21.15.142:0/1047240250 <== osd.3 v2:172.21.15.142:6800/1064901393 10 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc0340083e0 con 0x561dcd2daf40 2024-09-22T08:37:05.033 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.014+0000 7fc03d6fa640 1 -- 172.21.15.142:0/1047240250 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561dcd2df3a0 con 0x7fc02c06d040 2024-09-22T08:37:05.033 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.014+0000 7fc03c6f8640 1 -- 172.21.15.142:0/1047240250 <== osd.0 v2:172.21.15.31:6800/168281188 8 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc03003b040 con 0x7fc02c06d040 2024-09-22T08:37:05.033 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.014+0000 7fc03c6f8640 1 -- 172.21.15.142:0/1047240250 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561dcd2df3a0 con 0x561dcd2d6550 2024-09-22T08:37:05.033 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.014+0000 7fc03c6f8640 1 -- 172.21.15.142:0/1047240250 <== osd.1 v2:172.21.15.142:6816/3192108003 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fc03003b040 con 0x561dcd2d6550 2024-09-22T08:37:05.033 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.014+0000 7fc03c6f8640 1 -- 172.21.15.142:0/1047240250 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561dcd2df3a0 con 0x7fc034032020 2024-09-22T08:37:05.033 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.015+0000 7fc03cef9640 1 -- 172.21.15.142:0/1047240250 <== osd.2 v2:172.21.15.142:6808/279438927 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc02c07d070 con 0x7fc034032020 2024-09-22T08:37:05.033 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.015+0000 7fc03f40f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:37:05.033 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.015+0000 7fc03f40f800 20 RGWRados::pool_iterate: got zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec 2024-09-22T08:37:05.033 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.015+0000 7fc03f40f800 20 RGWRados::pool_iterate: got zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f 2024-09-22T08:37:05.033 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.015+0000 7fc03f40f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:37:05.034 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.015+0000 7fc03f40f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:37:05.034 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.015+0000 7fc03f40f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:37:05.034 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.015+0000 7fc03f40f800 20 rados->read ofs=0 len=0 2024-09-22T08:37:05.034 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.015+0000 7fc03f40f800 1 -- 172.21.15.142:0/1047240250 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561dcd2de430 con 0x561dcd2d6550 2024-09-22T08:37:05.034 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.015+0000 7fc03c6f8640 1 -- 172.21.15.142:0/1047240250 <== osd.1 v2:172.21.15.142:6816/3192108003 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc03003b040 con 0x561dcd2d6550 2024-09-22T08:37:05.034 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.015+0000 7fc03f40f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:05.034 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.015+0000 7fc03f40f800 20 rados->read ofs=0 len=0 2024-09-22T08:37:05.034 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.015+0000 7fc03f40f800 1 -- 172.21.15.142:0/1047240250 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561dcd2dec80 con 0x561dcd2d6550 2024-09-22T08:37:05.034 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.015+0000 7fc03c6f8640 1 -- 172.21.15.142:0/1047240250 <== osd.1 v2:172.21.15.142:6816/3192108003 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc03003b040 con 0x561dcd2d6550 2024-09-22T08:37:05.034 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.015+0000 7fc03f40f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:37:05.034 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.015+0000 7fc03f40f800 20 rados->read ofs=0 len=0 2024-09-22T08:37:05.034 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.015+0000 7fc03f40f800 1 -- 172.21.15.142:0/1047240250 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:40 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561dcd2df820 con 0x561dcd2daf40 2024-09-22T08:37:05.035 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.015+0000 7fc03d6fa640 1 -- 172.21.15.142:0/1047240250 <== osd.3 v2:172.21.15.142:6800/1064901393 11 ==== osd_op_reply(40 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fc0340083e0 con 0x561dcd2daf40 2024-09-22T08:37:05.035 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.015+0000 7fc03f40f800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:37:05.035 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.015+0000 7fc03f40f800 20 zone default found 2024-09-22T08:37:05.035 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.015+0000 7fc03f40f800 4 Realm: () 2024-09-22T08:37:05.035 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.015+0000 7fc03f40f800 4 ZoneGroup: default (d89f6f57-1007-47dd-9065-f486c7b01aec) 2024-09-22T08:37:05.035 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.015+0000 7fc03f40f800 4 Zone: default (e239248c-0bee-4e41-803a-24b288d3eb8f) 2024-09-22T08:37:05.035 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.015+0000 7fc03f40f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:37:05.035 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.015+0000 7fc03f40f800 20 zonegroup default 2024-09-22T08:37:05.035 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.015+0000 7fc03f40f800 20 rados->read ofs=0 len=0 2024-09-22T08:37:05.035 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.015+0000 7fc03f40f800 1 -- 172.21.15.142:0/1047240250 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561dcd2dfbc0 con 0x7fc02c06d040 2024-09-22T08:37:05.035 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.016+0000 7fc03c6f8640 1 -- 172.21.15.142:0/1047240250 <== osd.0 v2:172.21.15.31:6800/168281188 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fc03003b040 con 0x7fc02c06d040 2024-09-22T08:37:05.035 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.016+0000 7fc03f40f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:05.036 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.016+0000 7fc03f40f800 20 rados->read ofs=0 len=0 2024-09-22T08:37:05.036 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.016+0000 7fc03f40f800 1 -- 172.21.15.142:0/1047240250 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561dcd2e1a20 con 0x561dcd2daf40 2024-09-22T08:37:05.036 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.016+0000 7fc03d6fa640 1 -- 172.21.15.142:0/1047240250 <== osd.3 v2:172.21.15.142:6800/1064901393 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc0340083e0 con 0x561dcd2daf40 2024-09-22T08:37:05.036 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.016+0000 7fc03f40f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:05.036 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.016+0000 7fc03f40f800 20 rados->read ofs=0 len=0 2024-09-22T08:37:05.036 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.016+0000 7fc03f40f800 1 -- 172.21.15.142:0/1047240250 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561dcd2e1eb0 con 0x561dcd2daf40 2024-09-22T08:37:05.036 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.016+0000 7fc03d6fa640 1 -- 172.21.15.142:0/1047240250 <== osd.3 v2:172.21.15.142:6800/1064901393 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc0340083e0 con 0x561dcd2daf40 2024-09-22T08:37:05.036 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.016+0000 7fc03f40f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:05.036 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.016+0000 7fc03f40f800 20 started sync module instance, tier type = 2024-09-22T08:37:05.036 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.016+0000 7fc03f40f800 20 started zone id=e239248c-0bee-4e41-803a-24b288d3eb8f (name=default) with tier type = 2024-09-22T08:37:05.036 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.016+0000 7fc03f40f800 1 -- 172.21.15.142:0/1047240250 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561dcd2e0e90 con 0x7fc034032020 2024-09-22T08:37:05.037 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.017+0000 7fc03cef9640 1 -- 172.21.15.142:0/1047240250 <== osd.2 v2:172.21.15.142:6808/279438927 7 ==== osd_op_reply(44 notify.0 [create] v32'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc02c07d070 con 0x7fc034032020 2024-09-22T08:37:05.037 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.017+0000 7fc03f40f800 1 -- 172.21.15.142:0/1047240250 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94685996386784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561dcd2e2310 con 0x7fc034032020 2024-09-22T08:37:05.037 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.017+0000 7fc03f40f800 1 -- 172.21.15.142:0/1047240250 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561dcd2e2b60 con 0x561dcd2d6550 2024-09-22T08:37:05.037 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.018+0000 7fc03cef9640 1 -- 172.21.15.142:0/1047240250 <== osd.2 v2:172.21.15.142:6808/279438927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94685996386784] v32'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc02c07d070 con 0x7fc034032020 2024-09-22T08:37:05.037 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.019+0000 7fc03c6f8640 1 -- 172.21.15.142:0/1047240250 <== osd.1 v2:172.21.15.142:6816/3192108003 16 ==== osd_op_reply(46 notify.1 [create] v32'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc03003b040 con 0x561dcd2d6550 2024-09-22T08:37:05.037 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.019+0000 7fc03f40f800 1 -- 172.21.15.142:0/1047240250 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94685996394160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561dcd2e2f80 con 0x561dcd2d6550 2024-09-22T08:37:05.037 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.019+0000 7fc03f40f800 1 -- 172.21.15.142:0/1047240250 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561dcd2e37d0 con 0x561dcd2daf40 2024-09-22T08:37:05.043 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.020+0000 7fc03c6f8640 1 -- 172.21.15.142:0/1047240250 <== osd.1 v2:172.21.15.142:6816/3192108003 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94685996394160] v32'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc03003b040 con 0x561dcd2d6550 2024-09-22T08:37:05.044 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.020+0000 7fc03d6fa640 1 -- 172.21.15.142:0/1047240250 <== osd.3 v2:172.21.15.142:6800/1064901393 14 ==== osd_op_reply(48 notify.2 [create] v32'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc0340083e0 con 0x561dcd2daf40 2024-09-22T08:37:05.044 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.020+0000 7fc03f40f800 1 -- 172.21.15.142:0/1047240250 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94685996395696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561dcd2e3700 con 0x561dcd2daf40 2024-09-22T08:37:05.044 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.020+0000 7fc03f40f800 1 -- 172.21.15.142:0/1047240250 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561dcd2e4250 con 0x7fc034032020 2024-09-22T08:37:05.044 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.021+0000 7fc03d6fa640 1 -- 172.21.15.142:0/1047240250 <== osd.3 v2:172.21.15.142:6800/1064901393 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94685996395696] v32'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc0340083e0 con 0x561dcd2daf40 2024-09-22T08:37:05.044 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.021+0000 7fc03cef9640 1 -- 172.21.15.142:0/1047240250 <== osd.2 v2:172.21.15.142:6808/279438927 9 ==== osd_op_reply(50 notify.3 [create] v32'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc02c07d070 con 0x7fc034032020 2024-09-22T08:37:05.044 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.021+0000 7fc03f40f800 1 -- 172.21.15.142:0/1047240250 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94685996396944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561dcd2e45f0 con 0x7fc034032020 2024-09-22T08:37:05.044 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.021+0000 7fc03f40f800 1 -- 172.21.15.142:0/1047240250 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561dcd2e50b0 con 0x561dcd2d6550 2024-09-22T08:37:05.044 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.022+0000 7fc03c6f8640 1 -- 172.21.15.142:0/1047240250 <== osd.1 v2:172.21.15.142:6816/3192108003 18 ==== osd_op_reply(52 notify.4 [create] v32'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc03003b040 con 0x561dcd2d6550 2024-09-22T08:37:05.044 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.022+0000 7fc03cef9640 1 -- 172.21.15.142:0/1047240250 <== osd.2 v2:172.21.15.142:6808/279438927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94685996396944] v32'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc02c07d070 con 0x7fc034032020 2024-09-22T08:37:05.044 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.022+0000 7fc03f40f800 1 -- 172.21.15.142:0/1047240250 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94685996403584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561dcd2e5070 con 0x561dcd2d6550 2024-09-22T08:37:05.044 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.022+0000 7fc03f40f800 1 -- 172.21.15.142:0/1047240250 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561dcd2e5070 con 0x7fc02c06d040 2024-09-22T08:37:05.045 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.023+0000 7fc03c6f8640 1 -- 172.21.15.142:0/1047240250 <== osd.0 v2:172.21.15.31:6800/168281188 10 ==== osd_op_reply(54 notify.5 [create] v32'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc03003b040 con 0x7fc02c06d040 2024-09-22T08:37:05.045 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.023+0000 7fc03f40f800 1 -- 172.21.15.142:0/1047240250 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94685996400080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561dcd2e6050 con 0x7fc02c06d040 2024-09-22T08:37:05.045 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.023+0000 7fc03f40f800 1 -- 172.21.15.142:0/1047240250 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561dcd2e6a90 con 0x7fc02c06d040 2024-09-22T08:37:05.045 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.023+0000 7fc03c6f8640 1 -- 172.21.15.142:0/1047240250 <== osd.1 v2:172.21.15.142:6816/3192108003 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94685996403584] v32'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc03003b040 con 0x561dcd2d6550 2024-09-22T08:37:05.045 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.024+0000 7fc03c6f8640 1 -- 172.21.15.142:0/1047240250 <== osd.0 v2:172.21.15.31:6800/168281188 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94685996400080] v32'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc03003b040 con 0x7fc02c06d040 2024-09-22T08:37:05.045 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.024+0000 7fc03c6f8640 1 -- 172.21.15.142:0/1047240250 <== osd.0 v2:172.21.15.31:6800/168281188 12 ==== osd_op_reply(56 notify.6 [create] v32'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc03003b040 con 0x7fc02c06d040 2024-09-22T08:37:05.045 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.024+0000 7fc03f40f800 1 -- 172.21.15.142:0/1047240250 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94685996410208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561dcd2e5ba0 con 0x7fc02c06d040 2024-09-22T08:37:05.045 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.024+0000 7fc03f40f800 1 -- 172.21.15.142:0/1047240250 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561dcd2e7120 con 0x7fc02c06d040 2024-09-22T08:37:05.045 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.025+0000 7fc03c6f8640 1 -- 172.21.15.142:0/1047240250 <== osd.0 v2:172.21.15.31:6800/168281188 13 ==== osd_op_reply(58 notify.7 [create] v32'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc03003b040 con 0x7fc02c06d040 2024-09-22T08:37:05.045 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.025+0000 7fc03c6f8640 1 -- 172.21.15.142:0/1047240250 <== osd.0 v2:172.21.15.31:6800/168281188 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94685996410208] v32'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc03003b040 con 0x7fc02c06d040 2024-09-22T08:37:05.045 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.025+0000 7fc03f40f800 1 -- 172.21.15.142:0/1047240250 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94685996412016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561dcd2e7540 con 0x7fc02c06d040 2024-09-22T08:37:05.046 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.025+0000 7fc03f40f800 20 add_watcher() i=0 2024-09-22T08:37:05.046 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.025+0000 7fc03f40f800 20 add_watcher() i=1 2024-09-22T08:37:05.046 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.025+0000 7fc03f40f800 20 add_watcher() i=2 2024-09-22T08:37:05.046 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.025+0000 7fc03f40f800 20 add_watcher() i=3 2024-09-22T08:37:05.046 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.025+0000 7fc03f40f800 20 add_watcher() i=4 2024-09-22T08:37:05.046 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.025+0000 7fc03f40f800 20 add_watcher() i=5 2024-09-22T08:37:05.046 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.025+0000 7fc03f40f800 20 add_watcher() i=6 2024-09-22T08:37:05.046 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.026+0000 7fc03c6f8640 1 -- 172.21.15.142:0/1047240250 <== osd.0 v2:172.21.15.31:6800/168281188 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94685996412016] v32'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc03003b040 con 0x7fc02c06d040 2024-09-22T08:37:05.046 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.026+0000 7fc03f40f800 20 add_watcher() i=7 2024-09-22T08:37:05.046 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.026+0000 7fc03f40f800 2 all 8 watchers are set, enabling cache 2024-09-22T08:37:05.046 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.026+0000 7fc03f40f800 1 -- 172.21.15.142:0/1047240250 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561dcd2ea570 con 0x561dcd2d6550 2024-09-22T08:37:05.047 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.027+0000 7fc03c6f8640 1 -- 172.21.15.142:0/1047240250 <== osd.1 v2:172.21.15.142:6816/3192108003 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fc03003b040 con 0x561dcd2d6550 2024-09-22T08:37:05.047 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.027+0000 7fc03f40f800 1 -- 172.21.15.142:0/1047240250 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94685996413072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561dcd2e7990 con 0x561dcd2d6550 2024-09-22T08:37:05.047 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.028+0000 7fc03c6f8640 1 -- 172.21.15.142:0/1047240250 <== osd.1 v2:172.21.15.142:6816/3192108003 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94685996413072] v32'173 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc03003b040 con 0x561dcd2d6550 2024-09-22T08:37:05.047 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.028+0000 7fbef37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:37:05.047 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.028+0000 7fc03f40f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:37:05.047 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.028+0000 7fc03f40f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:37:05.047 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.028+0000 7fc03f40f800 1 -- 172.21.15.142:0/1047240250 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561dcd2f2f80 con 0x561dcd2d6550 2024-09-22T08:37:05.047 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.029+0000 7fc03c6f8640 1 -- 172.21.15.142:0/1047240250 <== osd.1 v2:172.21.15.142:6816/3192108003 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'29 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc03003b040 con 0x561dcd2d6550 2024-09-22T08:37:05.047 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.029+0000 7fc03f40f800 1 -- 172.21.15.142:0/1047240250 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561dcd2f3590 con 0x7fc02c06d040 2024-09-22T08:37:05.047 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.030+0000 7fc03c6f8640 1 -- 172.21.15.142:0/1047240250 <== osd.0 v2:172.21.15.31:6800/168281188 16 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'23 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc03003b040 con 0x7fc02c06d040 2024-09-22T08:37:05.047 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.030+0000 7fc03f40f800 1 -- 172.21.15.142:0/1047240250 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561dcd2f39f0 con 0x561dcd2daf40 2024-09-22T08:37:05.048 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.031+0000 7fc03d6fa640 1 -- 172.21.15.142:0/1047240250 <== osd.3 v2:172.21.15.142:6800/1064901393 16 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'23 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc0340083e0 con 0x561dcd2daf40 2024-09-22T08:37:05.048 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.031+0000 7fc03f40f800 1 -- 172.21.15.142:0/1047240250 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561dcd2f3950 con 0x561dcd2d6550 2024-09-22T08:37:05.048 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.032+0000 7fc03c6f8640 1 -- 172.21.15.142:0/1047240250 <== osd.1 v2:172.21.15.142:6816/3192108003 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'174 uv162 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc03003b040 con 0x561dcd2d6550 2024-09-22T08:37:05.048 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.032+0000 7fc03f40f800 1 -- 172.21.15.142:0/1047240250 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561dcd2f3a60 con 0x7fc034032020 2024-09-22T08:37:05.048 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.033+0000 7fc03cef9640 1 -- 172.21.15.142:0/1047240250 <== osd.2 v2:172.21.15.142:6808/279438927 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'61 uv53 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc02c07d070 con 0x7fc034032020 2024-09-22T08:37:05.048 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.033+0000 7fc03f40f800 1 -- 172.21.15.142:0/1047240250 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561dcd2f3e80 con 0x561dcd2daf40 2024-09-22T08:37:05.048 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.034+0000 7fc03d6fa640 1 -- 172.21.15.142:0/1047240250 <== osd.3 v2:172.21.15.142:6800/1064901393 17 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'39 uv34 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc0340083e0 con 0x561dcd2daf40 2024-09-22T08:37:05.048 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.034+0000 7fc03f40f800 1 -- 172.21.15.142:0/1047240250 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561dcd2f3e80 con 0x561dcd2d6550 2024-09-22T08:37:05.048 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.035+0000 7fc03c6f8640 1 -- 172.21.15.142:0/1047240250 <== osd.1 v2:172.21.15.142:6816/3192108003 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'25 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc03003b040 con 0x561dcd2d6550 2024-09-22T08:37:05.048 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.035+0000 7fc03f40f800 1 -- 172.21.15.142:0/1047240250 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561dcd2f3e80 con 0x7fc02c06d040 2024-09-22T08:37:05.048 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.036+0000 7fc03c6f8640 1 -- 172.21.15.142:0/1047240250 <== osd.0 v2:172.21.15.31:6800/168281188 17 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'39 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc03003b040 con 0x7fc02c06d040 2024-09-22T08:37:05.049 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.036+0000 7fc03f40f800 1 -- 172.21.15.142:0/1047240250 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561dcd2f3fb0 con 0x7fc034032020 2024-09-22T08:37:05.049 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.037+0000 7fc03cef9640 1 -- 172.21.15.142:0/1047240250 <== osd.2 v2:172.21.15.142:6808/279438927 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'23 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc02c07d070 con 0x7fc034032020 2024-09-22T08:37:05.049 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.037+0000 7fc03f40f800 1 -- 172.21.15.142:0/1047240250 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561dcd2f4390 con 0x561dcd2daf40 2024-09-22T08:37:05.049 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.038+0000 7fc03d6fa640 1 -- 172.21.15.142:0/1047240250 <== osd.3 v2:172.21.15.142:6800/1064901393 18 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'29 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc0340083e0 con 0x561dcd2daf40 2024-09-22T08:37:05.049 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.038+0000 7fc03f40f800 1 -- 172.21.15.142:0/1047240250 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561dcd2f4170 con 0x7fc034032020 2024-09-22T08:37:05.049 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.039+0000 7fc03cef9640 1 -- 172.21.15.142:0/1047240250 <== osd.2 v2:172.21.15.142:6808/279438927 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'62 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc02c07d070 con 0x7fc034032020 2024-09-22T08:37:05.049 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.039+0000 7fc03f40f800 1 -- 172.21.15.142:0/1047240250 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561dcd2f42a0 con 0x7fc02c06d040 2024-09-22T08:37:05.049 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.040+0000 7fc03c6f8640 1 -- 172.21.15.142:0/1047240250 <== osd.0 v2:172.21.15.31:6800/168281188 18 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'25 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc03003b040 con 0x7fc02c06d040 2024-09-22T08:37:05.049 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.040+0000 7fc03f40f800 1 -- 172.21.15.142:0/1047240250 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561dcd2f42a0 con 0x7fc034032020 2024-09-22T08:37:05.049 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.041+0000 7fc03cef9640 1 -- 172.21.15.142:0/1047240250 <== osd.2 v2:172.21.15.142:6808/279438927 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'23 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc02c07d070 con 0x7fc034032020 2024-09-22T08:37:05.050 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.041+0000 7fc03f40f800 1 -- 172.21.15.142:0/1047240250 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561dcd2f4330 con 0x7fc02c06d040 2024-09-22T08:37:05.050 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.042+0000 7fc03c6f8640 1 -- 172.21.15.142:0/1047240250 <== osd.0 v2:172.21.15.31:6800/168281188 19 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'47 uv44 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc03003b040 con 0x7fc02c06d040 2024-09-22T08:37:05.050 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.042+0000 7fc03f40f800 1 -- 172.21.15.142:0/1047240250 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561dcd2f4330 con 0x561dcd2d6550 2024-09-22T08:37:05.052 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.043+0000 7fc03c6f8640 1 -- 172.21.15.142:0/1047240250 <== osd.1 v2:172.21.15.142:6816/3192108003 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'175 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc03003b040 con 0x561dcd2d6550 2024-09-22T08:37:05.052 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.043+0000 7fc03f40f800 1 -- 172.21.15.142:0/1047240250 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561dcd2f4330 con 0x561dcd2daf40 2024-09-22T08:37:05.052 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.044+0000 7fc03d6fa640 1 -- 172.21.15.142:0/1047240250 <== osd.3 v2:172.21.15.142:6800/1064901393 19 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'53 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc0340083e0 con 0x561dcd2daf40 2024-09-22T08:37:05.052 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.044+0000 7fc03f40f800 1 -- 172.21.15.142:0/1047240250 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561dcd2f4420 con 0x7fc034032020 2024-09-22T08:37:05.052 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.045+0000 7fc03cef9640 1 -- 172.21.15.142:0/1047240250 <== osd.2 v2:172.21.15.142:6808/279438927 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'63 uv57 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc02c07d070 con 0x7fc034032020 2024-09-22T08:37:05.052 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.045+0000 7fc03f40f800 1 -- 172.21.15.142:0/1047240250 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561dcd2f4420 con 0x561dcd2daf40 2024-09-22T08:37:05.052 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.046+0000 7fc03d6fa640 1 -- 172.21.15.142:0/1047240250 <== osd.3 v2:172.21.15.142:6800/1064901393 20 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'23 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc0340083e0 con 0x561dcd2daf40 2024-09-22T08:37:05.052 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.046+0000 7fc03f40f800 1 -- 172.21.15.142:0/1047240250 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561dcd2f4510 con 0x561dcd2d6550 2024-09-22T08:37:05.052 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.048+0000 7fc03c6f8640 1 -- 172.21.15.142:0/1047240250 <== osd.1 v2:172.21.15.142:6816/3192108003 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'31 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc03003b040 con 0x561dcd2d6550 2024-09-22T08:37:05.052 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.048+0000 7fc03f40f800 1 -- 172.21.15.142:0/1047240250 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561dcd2f4510 con 0x561dcd2d6550 2024-09-22T08:37:05.053 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.048+0000 7fc03c6f8640 1 -- 172.21.15.142:0/1047240250 <== osd.1 v2:172.21.15.142:6816/3192108003 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'176 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc03003b040 con 0x561dcd2d6550 2024-09-22T08:37:05.053 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.049+0000 7fc03f40f800 1 -- 172.21.15.142:0/1047240250 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561dcd2f4510 con 0x561dcd2daf40 2024-09-22T08:37:05.053 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.050+0000 7fc03d6fa640 1 -- 172.21.15.142:0/1047240250 <== osd.3 v2:172.21.15.142:6800/1064901393 21 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'54 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc0340083e0 con 0x561dcd2daf40 2024-09-22T08:37:05.053 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.050+0000 7fc03f40f800 1 -- 172.21.15.142:0/1047240250 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561dcd2f4510 con 0x7fc034032020 2024-09-22T08:37:05.053 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.051+0000 7fc03cef9640 1 -- 172.21.15.142:0/1047240250 <== osd.2 v2:172.21.15.142:6808/279438927 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'33 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc02c07d070 con 0x7fc034032020 2024-09-22T08:37:05.053 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.051+0000 7fc03f40f800 1 -- 172.21.15.142:0/1047240250 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561dcd2f4510 con 0x561dcd2daf40 2024-09-22T08:37:05.054 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.051+0000 7fc03d6fa640 1 -- 172.21.15.142:0/1047240250 <== osd.3 v2:172.21.15.142:6800/1064901393 22 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'25 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc0340083e0 con 0x561dcd2daf40 2024-09-22T08:37:05.054 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.052+0000 7fc03f40f800 1 -- 172.21.15.142:0/1047240250 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561dcd2f4510 con 0x561dcd2daf40 2024-09-22T08:37:05.054 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.052+0000 7fc03d6fa640 1 -- 172.21.15.142:0/1047240250 <== osd.3 v2:172.21.15.142:6800/1064901393 23 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'29 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc0340083e0 con 0x561dcd2daf40 2024-09-22T08:37:05.054 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.052+0000 7fc03f40f800 1 -- 172.21.15.142:0/1047240250 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561dcd2f4510 con 0x561dcd2daf40 2024-09-22T08:37:05.054 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.053+0000 7fc03d6fa640 1 -- 172.21.15.142:0/1047240250 <== osd.3 v2:172.21.15.142:6800/1064901393 24 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'19 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc0340083e0 con 0x561dcd2daf40 2024-09-22T08:37:05.055 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.053+0000 7fc03f40f800 1 -- 172.21.15.142:0/1047240250 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561dcd2f4510 con 0x561dcd2daf40 2024-09-22T08:37:05.055 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.054+0000 7fc03d6fa640 1 -- 172.21.15.142:0/1047240250 <== osd.3 v2:172.21.15.142:6800/1064901393 25 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'40 uv36 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc0340083e0 con 0x561dcd2daf40 2024-09-22T08:37:05.055 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.054+0000 7fc03f40f800 1 -- 172.21.15.142:0/1047240250 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561dcd2f4550 con 0x7fc02c06d040 2024-09-22T08:37:05.056 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.055+0000 7fc03c6f8640 1 -- 172.21.15.142:0/1047240250 <== osd.0 v2:172.21.15.31:6800/168281188 20 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'25 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc03003b040 con 0x7fc02c06d040 2024-09-22T08:37:05.056 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.055+0000 7fc03f40f800 1 -- 172.21.15.142:0/1047240250 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561dcd2f4590 con 0x561dcd2daf40 2024-09-22T08:37:05.057 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.056+0000 7fc03d6fa640 1 -- 172.21.15.142:0/1047240250 <== osd.3 v2:172.21.15.142:6800/1064901393 26 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'23 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc0340083e0 con 0x561dcd2daf40 2024-09-22T08:37:05.057 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.056+0000 7fc03f40f800 1 -- 172.21.15.142:0/1047240250 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561dcd2f4590 con 0x7fc02c06d040 2024-09-22T08:37:05.059 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.057+0000 7fc03c6f8640 1 -- 172.21.15.142:0/1047240250 <== osd.0 v2:172.21.15.31:6800/168281188 21 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'40 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc03003b040 con 0x7fc02c06d040 2024-09-22T08:37:05.059 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.057+0000 7fc03f40f800 1 -- 172.21.15.142:0/1047240250 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561dcd2f4590 con 0x561dcd2daf40 2024-09-22T08:37:05.060 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.058+0000 7fc03d6fa640 1 -- 172.21.15.142:0/1047240250 <== osd.3 v2:172.21.15.142:6800/1064901393 27 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'55 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc0340083e0 con 0x561dcd2daf40 2024-09-22T08:37:05.060 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.058+0000 7fc03f40f800 1 -- 172.21.15.142:0/1047240250 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561dcd2f4590 con 0x7fc02c06d040 2024-09-22T08:37:05.061 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.060+0000 7fc03c6f8640 1 -- 172.21.15.142:0/1047240250 <== osd.0 v2:172.21.15.31:6800/168281188 22 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'48 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc03003b040 con 0x7fc02c06d040 2024-09-22T08:37:05.061 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.060+0000 7fc03f40f800 1 -- 172.21.15.142:0/1047240250 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561dcd2f45d0 con 0x7fc034032020 2024-09-22T08:37:05.062 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.061+0000 7fc03cef9640 1 -- 172.21.15.142:0/1047240250 <== osd.2 v2:172.21.15.142:6808/279438927 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'29 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc02c07d070 con 0x7fc034032020 2024-09-22T08:37:05.063 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.061+0000 7fbef27e4640 20 reqs_thread_entry: start 2024-09-22T08:37:05.063 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.061+0000 7fc03f40f800 20 init_complete bucket index max shards: 11 2024-09-22T08:37:05.063 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.061+0000 7fc03f40f800 20 Filter name: none 2024-09-22T08:37:05.063 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.061+0000 7fbeebfff640 20 reqs_thread_entry: start 2024-09-22T08:37:05.063 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.061+0000 7fc03f40f800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-22T08:37:05.063 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.061+0000 7fc03f40f800 20 rados->read ofs=0 len=0 2024-09-22T08:37:05.063 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.061+0000 7fc03f40f800 1 -- 172.21.15.142:0/1047240250 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561dcd31f4f0 con 0x561dcd2d6550 2024-09-22T08:37:05.064 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.062+0000 7fc03c6f8640 1 -- 172.21.15.142:0/1047240250 <== osd.1 v2:172.21.15.142:6816/3192108003 28 ==== osd_op_reply(94 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv13 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fc03003b040 con 0x561dcd2d6550 2024-09-22T08:37:05.064 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.062+0000 7fc03f40f800 20 rados_obj.operate() r=0 bl.length=391 2024-09-22T08:37:05.064 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.062+0000 7fc03f40f800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-22T08:37:05.064 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.062+0000 7fc03f40f800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-22T08:37:05.064 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.062+0000 7fc03f40f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:37:05.064 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.062+0000 7fc03f40f800 1 -- 172.21.15.142:0/1047240250 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:95 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561dcd31f4a0 con 0x7fc034032020 2024-09-22T08:37:05.064 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.062+0000 7fc03cef9640 1 -- 172.21.15.142:0/1047240250 <== osd.2 v2:172.21.15.142:6808/279438927 18 ==== osd_op_reply(95 foo.buckets [call out=183b] v0'0 uv26 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7fc02c07d070 con 0x7fc034032020 2024-09-22T08:37:05.064 INFO:teuthology.orchestra.run.smithi142.stderr:could not remove user: unable to remove user, must specify purge data to remove user with buckets 2024-09-22T08:37:05.065 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.063+0000 7fbef37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:37:05.065 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.063+0000 7fc03f40f800 1 -- 172.21.15.142:0/1047240250 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:96 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94685996413072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561dcd2e9590 con 0x561dcd2d6550 2024-09-22T08:37:05.065 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.064+0000 7fc03c6f8640 1 -- 172.21.15.142:0/1047240250 <== osd.1 v2:172.21.15.142:6816/3192108003 29 ==== osd_op_reply(96 data_loggenerations_metadata [watch unwatch cookie 94685996413072] v32'177 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc03003b040 con 0x561dcd2d6550 2024-09-22T08:37:05.065 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.064+0000 7fc03f40f800 1 -- 172.21.15.142:0/1047240250 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:97 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94685996386784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561dcd2e7090 con 0x7fc034032020 2024-09-22T08:37:05.066 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.065+0000 7fc03cef9640 1 -- 172.21.15.142:0/1047240250 <== osd.2 v2:172.21.15.142:6808/279438927 19 ==== osd_op_reply(97 notify.0 [watch unwatch cookie 94685996386784] v32'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc02c07d070 con 0x7fc034032020 2024-09-22T08:37:05.066 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.065+0000 7fc03f40f800 20 remove_watcher() i=0 2024-09-22T08:37:05.066 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.065+0000 7fc03f40f800 2 removed watcher, disabling cache 2024-09-22T08:37:05.066 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.065+0000 7fc03f40f800 1 -- 172.21.15.142:0/1047240250 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94685996394160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561dcd2e7090 con 0x561dcd2d6550 2024-09-22T08:37:05.067 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.066+0000 7fc03c6f8640 1 -- 172.21.15.142:0/1047240250 <== osd.1 v2:172.21.15.142:6816/3192108003 30 ==== osd_op_reply(98 notify.1 [watch unwatch cookie 94685996394160] v32'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc03003b040 con 0x561dcd2d6550 2024-09-22T08:37:05.068 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.066+0000 7fc03f40f800 20 remove_watcher() i=1 2024-09-22T08:37:05.068 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.066+0000 7fc03f40f800 1 -- 172.21.15.142:0/1047240250 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:99 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94685996395696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561dcd2e7090 con 0x561dcd2daf40 2024-09-22T08:37:05.068 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.067+0000 7fc03d6fa640 1 -- 172.21.15.142:0/1047240250 <== osd.3 v2:172.21.15.142:6800/1064901393 28 ==== osd_op_reply(99 notify.2 [watch unwatch cookie 94685996395696] v32'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc0340083e0 con 0x561dcd2daf40 2024-09-22T08:37:05.068 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.067+0000 7fc03f40f800 20 remove_watcher() i=2 2024-09-22T08:37:05.069 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.067+0000 7fc03f40f800 1 -- 172.21.15.142:0/1047240250 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:100 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94685996396944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561dcd2e2cb0 con 0x7fc034032020 2024-09-22T08:37:05.069 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.068+0000 7fc03cef9640 1 -- 172.21.15.142:0/1047240250 <== osd.2 v2:172.21.15.142:6808/279438927 20 ==== osd_op_reply(100 notify.3 [watch unwatch cookie 94685996396944] v32'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc02c07d070 con 0x7fc034032020 2024-09-22T08:37:05.069 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.068+0000 7fc03f40f800 20 remove_watcher() i=3 2024-09-22T08:37:05.069 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.068+0000 7fc03f40f800 1 -- 172.21.15.142:0/1047240250 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94685996403584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561dcd2e7090 con 0x561dcd2d6550 2024-09-22T08:37:05.071 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.070+0000 7fc03c6f8640 1 -- 172.21.15.142:0/1047240250 <== osd.1 v2:172.21.15.142:6816/3192108003 31 ==== osd_op_reply(101 notify.4 [watch unwatch cookie 94685996403584] v32'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc03003b040 con 0x561dcd2d6550 2024-09-22T08:37:05.071 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.070+0000 7fc03f40f800 20 remove_watcher() i=4 2024-09-22T08:37:05.071 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.070+0000 7fc03f40f800 1 -- 172.21.15.142:0/1047240250 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:102 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94685996400080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561dcd2e2cb0 con 0x7fc02c06d040 2024-09-22T08:37:05.072 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.071+0000 7fc03c6f8640 1 -- 172.21.15.142:0/1047240250 <== osd.0 v2:172.21.15.31:6800/168281188 23 ==== osd_op_reply(102 notify.5 [watch unwatch cookie 94685996400080] v32'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc03003b040 con 0x7fc02c06d040 2024-09-22T08:37:05.072 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.071+0000 7fc03f40f800 20 remove_watcher() i=5 2024-09-22T08:37:05.072 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.071+0000 7fc03f40f800 1 -- 172.21.15.142:0/1047240250 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:103 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94685996410208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561dcd2e4b80 con 0x7fc02c06d040 2024-09-22T08:37:05.073 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.071+0000 7fc03c6f8640 1 -- 172.21.15.142:0/1047240250 <== osd.0 v2:172.21.15.31:6800/168281188 24 ==== osd_op_reply(103 notify.6 [watch unwatch cookie 94685996410208] v32'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc03003b040 con 0x7fc02c06d040 2024-09-22T08:37:05.073 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.071+0000 7fc03f40f800 20 remove_watcher() i=6 2024-09-22T08:37:05.073 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.072+0000 7fc03f40f800 1 -- 172.21.15.142:0/1047240250 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:104 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94685996412016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561dcd2e7090 con 0x7fc02c06d040 2024-09-22T08:37:05.076 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.073+0000 7fc03c6f8640 1 -- 172.21.15.142:0/1047240250 <== osd.0 v2:172.21.15.31:6800/168281188 25 ==== osd_op_reply(104 notify.7 [watch unwatch cookie 94685996412016] v32'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc03003b040 con 0x7fc02c06d040 2024-09-22T08:37:05.076 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.073+0000 7fc03f40f800 20 remove_watcher() i=7 2024-09-22T08:37:05.076 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.073+0000 7fc03f40f800 1 -- 172.21.15.142:0/1047240250 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7fc02c06d040 msgr2=0x7fc02c06a630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:05.077 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.073+0000 7fc03f40f800 1 --2- 172.21.15.142:0/1047240250 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7fc02c06d040 0x7fc02c06a630 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:05.077 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.073+0000 7fc03f40f800 1 -- 172.21.15.142:0/1047240250 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x561dcd2d6550 msgr2=0x561dcd2d8a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:05.077 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.073+0000 7fc03f40f800 1 --2- 172.21.15.142:0/1047240250 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x561dcd2d6550 0x561dcd2d8a10 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:05.077 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.073+0000 7fc03f40f800 1 -- 172.21.15.142:0/1047240250 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7fc034032020 msgr2=0x7fc03401e2c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:05.077 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.073+0000 7fc03f40f800 1 --2- 172.21.15.142:0/1047240250 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7fc034032020 0x7fc03401e2c0 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:05.077 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.073+0000 7fc03f40f800 1 -- 172.21.15.142:0/1047240250 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x561dcd2daf40 msgr2=0x561dcd2dd330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:05.077 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.073+0000 7fc03f40f800 1 --2- 172.21.15.142:0/1047240250 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x561dcd2daf40 0x561dcd2dd330 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:05.077 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.073+0000 7fc03f40f800 1 -- 172.21.15.142:0/1047240250 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fbf0803cf60 msgr2=0x7fbf0803f420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:05.077 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.073+0000 7fc03f40f800 1 --2- 172.21.15.142:0/1047240250 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fbf0803cf60 0x7fbf0803f420 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fc02c06d010 tx=0x7fc02c089000 comp rx=0 tx=0).stop 2024-09-22T08:37:05.077 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.073+0000 7fc03f40f800 1 -- 172.21.15.142:0/1047240250 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561dcd2c3680 msgr2=0x561dcd2cabf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:05.077 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.073+0000 7fc03f40f800 1 --2- 172.21.15.142:0/1047240250 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561dcd2c3680 0x561dcd2cabf0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fc0340154a0 tx=0x7fc034053d50 comp rx=0 tx=0).stop 2024-09-22T08:37:05.077 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.073+0000 7fc03c6f8640 1 -- 172.21.15.142:0/1047240250 reap_dead start 2024-09-22T08:37:05.078 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.073+0000 7fc03c6f8640 1 -- 172.21.15.142:0/1047240250 reap_dead start 2024-09-22T08:37:05.078 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.073+0000 7fc03f40f800 1 -- 172.21.15.142:0/1047240250 shutdown_connections 2024-09-22T08:37:05.078 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.073+0000 7fc03f40f800 1 -- 172.21.15.142:0/1047240250 >> 172.21.15.142:0/1047240250 conn(0x561dcd2bfaa0 msgr2=0x561dcd2bdcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:37:05.078 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.073+0000 7fc03f40f800 1 -- 172.21.15.142:0/1047240250 shutdown_connections 2024-09-22T08:37:05.078 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.073+0000 7fc03f40f800 1 -- 172.21.15.142:0/1047240250 wait complete. 2024-09-22T08:37:05.078 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.073+0000 7fc03f40f800 1 -- 172.21.15.142:0/1982308256 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fbf1403cfb0 msgr2=0x7fbf1403f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:05.078 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.073+0000 7fc03f40f800 1 --2- 172.21.15.142:0/1982308256 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fbf1403cfb0 0x7fbf1403f470 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x561dcd2a46e0 tx=0x7fc02c075c20 comp rx=0 tx=0).stop 2024-09-22T08:37:05.078 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.073+0000 7fc03f40f800 1 -- 172.21.15.142:0/1982308256 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561dcd2b6c20 msgr2=0x561dcd2b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:05.078 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.073+0000 7fc03f40f800 1 --2- 172.21.15.142:0/1982308256 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561dcd2b6c20 0x561dcd2b7040 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x561dcd29cbc0 tx=0x7fc03400bf30 comp rx=0 tx=0).stop 2024-09-22T08:37:05.078 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.073+0000 7fc03f40f800 1 -- 172.21.15.142:0/1982308256 shutdown_connections 2024-09-22T08:37:05.078 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.073+0000 7fc03f40f800 1 --2- 172.21.15.142:0/1982308256 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fbf1403cfb0 0x7fbf1403f470 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:05.078 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.073+0000 7fc03f40f800 1 --2- 172.21.15.142:0/1982308256 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561dcd2b6c20 0x561dcd2b7040 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:05.079 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.073+0000 7fc03f40f800 1 -- 172.21.15.142:0/1982308256 >> 172.21.15.142:0/1982308256 conn(0x561dcd2aafd0 msgr2=0x561dcd2ab3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:37:05.079 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.073+0000 7fc03f40f800 1 -- 172.21.15.142:0/1982308256 shutdown_connections 2024-09-22T08:37:05.079 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.073+0000 7fc03f40f800 1 -- 172.21.15.142:0/1982308256 wait complete. 2024-09-22T08:37:05.079 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.074+0000 7fc03f40f800 1 -- 172.21.15.142:0/1540849961 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x561dcd1a7a10 msgr2=0x561dcd2a3210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:05.079 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.074+0000 7fc03f40f800 1 --2- 172.21.15.142:0/1540849961 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x561dcd1a7a10 0x561dcd2a3210 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:05.079 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.074+0000 7fc03f40f800 1 -- 172.21.15.142:0/1540849961 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x561dcd2a55f0 msgr2=0x561dcd2a7a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:05.079 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.074+0000 7fc03f40f800 1 --2- 172.21.15.142:0/1540849961 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x561dcd2a55f0 0x561dcd2a7a70 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:05.079 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.074+0000 7fc03f40f800 1 -- 172.21.15.142:0/1540849961 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fbf2403cfb0 msgr2=0x7fbf2403f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:05.079 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.074+0000 7fc03f40f800 1 --2- 172.21.15.142:0/1540849961 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fbf2403cfb0 0x7fbf2403f470 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fc030001e30 tx=0x7fc030001390 comp rx=0 tx=0).stop 2024-09-22T08:37:05.079 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.074+0000 7fc03f40f800 1 -- 172.21.15.142:0/1540849961 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561dcd115d10 msgr2=0x561dcd29bbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:05.079 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.074+0000 7fc03f40f800 1 --2- 172.21.15.142:0/1540849961 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561dcd115d10 0x561dcd29bbc0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fc02c063040 tx=0x7fc02c003330 comp rx=0 tx=0).stop 2024-09-22T08:37:05.079 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.074+0000 7fc03f40f800 1 -- 172.21.15.142:0/1540849961 shutdown_connections 2024-09-22T08:37:05.079 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.074+0000 7fc03f40f800 1 --2- 172.21.15.142:0/1540849961 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x561dcd2a55f0 0x561dcd2a7a70 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:05.079 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.074+0000 7fc03f40f800 1 --2- 172.21.15.142:0/1540849961 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x561dcd1a7a10 0x561dcd2a3210 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:05.080 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.074+0000 7fc03f40f800 1 --2- 172.21.15.142:0/1540849961 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fbf2403cfb0 0x7fbf2403f470 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:05.080 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.074+0000 7fc03f40f800 1 --2- 172.21.15.142:0/1540849961 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561dcd115d10 0x561dcd29bbc0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:05.080 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.074+0000 7fc03f40f800 1 -- 172.21.15.142:0/1540849961 >> 172.21.15.142:0/1540849961 conn(0x561dcd19cbb0 msgr2=0x561dcd28e3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:37:05.080 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.074+0000 7fc03f40f800 1 -- 172.21.15.142:0/1540849961 shutdown_connections 2024-09-22T08:37:05.080 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.074+0000 7fc03f40f800 1 -- 172.21.15.142:0/1540849961 wait complete. 2024-09-22T08:37:05.083 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-09-22T08:37:05.092 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo foo bytes_out=0 bytes_in=236 failed=True 2024-09-22T08:37:05.096 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-22T08:37:05.122 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-22T08:37:05.138 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-22T08:37:05.183 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=5 bytes_in=0 failed=False 2024-09-22T08:37:05.188 INFO:tasks.radosgw_admin:RL: put_acls myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-22T08:37:05.188 INFO:tasks.util.rgw:rgwadmin: client.0 : ['policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-09-22T08:37:05.188 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'xml', '-n', 'client.0', '--cluster', 'ceph', 'policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-09-22T08:37:05.188 DEBUG:teuthology.orchestra.run.smithi142:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format xml -n client.0 --cluster ceph policy --bucket myfoo --object bb3aec0fdcdbc2974890f805c585d432 2024-09-22T08:37:05.234 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:37:05.234 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:37:05.235 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.233+0000 7f7424939800 1 Processor -- start 2024-09-22T08:37:05.235 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.233+0000 7f7424939800 1 -- start start 2024-09-22T08:37:05.235 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.233+0000 7f7424939800 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55732f8ddc00 0x55732f8e00c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:05.235 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.233+0000 7f7424939800 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55732f762a20 con 0x55732f84b530 2024-09-22T08:37:05.235 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.233+0000 7f7424939800 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x55732f7627d0 con 0x55732f8ddc00 2024-09-22T08:37:05.235 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.234+0000 7f7417dc6640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55732f8ddc00 0x55732f8e00c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:05.235 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.234+0000 7f74205c7640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x55732f84b530 0x55732f8dc4b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.142:56346/0 (socket says 172.21.15.142:56346) 2024-09-22T08:37:05.235 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.234+0000 7f74205c7640 1 -- 172.21.15.142:0/2535958488 learned_addr learned my addr 172.21.15.142:0/2535958488 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-09-22T08:37:05.236 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.234+0000 7f7417dc6640 1 -- 172.21.15.142:0/2535958488 >> v1:172.21.15.31:6789/0 conn(0x55732f84b530 legacy=0x55732f8dc4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:05.236 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.234+0000 7f7417dc6640 1 -- 172.21.15.142:0/2535958488 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55732f8e17d0 con 0x55732f8ddc00 2024-09-22T08:37:05.238 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.236+0000 7f7417dc6640 1 --2- 172.21.15.142:0/2535958488 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55732f8ddc00 0x55732f8e00c0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f740800a470 tx=0x7f7408045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=673837ef9ae47fb server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:05.238 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.236+0000 7f741fdc6640 1 -- 172.21.15.142:0/2535958488 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7408053570 con 0x55732f8ddc00 2024-09-22T08:37:05.238 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.236+0000 7f741fdc6640 1 -- 172.21.15.142:0/2535958488 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7408058070 con 0x55732f8ddc00 2024-09-22T08:37:05.238 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.236+0000 7f741fdc6640 1 -- 172.21.15.142:0/2535958488 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7408053880 con 0x55732f8ddc00 2024-09-22T08:37:05.238 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.236+0000 7f7424939800 1 -- 172.21.15.142:0/2535958488 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55732f8ddc00 msgr2=0x55732f8e00c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:05.238 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.236+0000 7f7424939800 1 --2- 172.21.15.142:0/2535958488 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55732f8ddc00 0x55732f8e00c0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f740800a470 tx=0x7f7408045a20 comp rx=0 tx=0).stop 2024-09-22T08:37:05.238 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.236+0000 7f7424939800 1 -- 172.21.15.142:0/2535958488 shutdown_connections 2024-09-22T08:37:05.238 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.236+0000 7f7424939800 1 --2- 172.21.15.142:0/2535958488 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55732f8ddc00 0x55732f8e00c0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:05.239 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.236+0000 7f7424939800 1 -- 172.21.15.142:0/2535958488 >> 172.21.15.142:0/2535958488 conn(0x55732f8d1be0 msgr2=0x55732f8d4020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:37:05.239 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.237+0000 7f7424939800 1 -- 172.21.15.142:0/2535958488 shutdown_connections 2024-09-22T08:37:05.239 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.237+0000 7f7424939800 1 -- 172.21.15.142:0/2535958488 wait complete. 2024-09-22T08:37:05.252 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.250+0000 7f7424939800 1 Processor -- start 2024-09-22T08:37:05.252 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.250+0000 7f7424939800 1 -- start start 2024-09-22T08:37:05.252 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.250+0000 7f7424939800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55732f84b530 0x55732f9c9230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:05.252 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.250+0000 7f7424939800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55732f76fdd0 con 0x55732f84b530 2024-09-22T08:37:05.252 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.251+0000 7f74205c7640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55732f84b530 0x55732f9c9230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:05.252 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.251+0000 7f74205c7640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55732f84b530 0x55732f9c9230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:59438/0 (socket says 172.21.15.142:59438) 2024-09-22T08:37:05.252 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.251+0000 7f74205c7640 1 -- 172.21.15.142:0/1760925414 learned_addr learned my addr 172.21.15.142:0/1760925414 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:37:05.252 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.251+0000 7f74205c7640 1 -- 172.21.15.142:0/1760925414 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55732f9c9820 con 0x55732f84b530 2024-09-22T08:37:05.255 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.251+0000 7f74205c7640 1 --2- 172.21.15.142:0/1760925414 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55732f84b530 0x55732f9c9230 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f7410001df0 tx=0x7f741000b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ceaf87779124e8a server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:05.255 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.251+0000 7f730e60c640 1 -- 172.21.15.142:0/1760925414 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7410012020 con 0x55732f84b530 2024-09-22T08:37:05.255 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.251+0000 7f730e60c640 1 -- 172.21.15.142:0/1760925414 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f741000e470 con 0x55732f84b530 2024-09-22T08:37:05.255 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.251+0000 7f730e60c640 1 -- 172.21.15.142:0/1760925414 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f741000e7f0 con 0x55732f84b530 2024-09-22T08:37:05.255 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.252+0000 7f7424939800 1 -- 172.21.15.142:0/1760925414 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55732f84b530 msgr2=0x55732f9c9230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:05.255 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.252+0000 7f7424939800 1 --2- 172.21.15.142:0/1760925414 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55732f84b530 0x55732f9c9230 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f7410001df0 tx=0x7f741000b6c0 comp rx=0 tx=0).stop 2024-09-22T08:37:05.255 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.252+0000 7f7424939800 1 -- 172.21.15.142:0/1760925414 shutdown_connections 2024-09-22T08:37:05.255 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.252+0000 7f7424939800 1 --2- 172.21.15.142:0/1760925414 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55732f84b530 0x55732f9c9230 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:05.255 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.252+0000 7f7424939800 1 -- 172.21.15.142:0/1760925414 >> 172.21.15.142:0/1760925414 conn(0x55732f8d1be0 msgr2=0x55732f9c4bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:37:05.255 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.252+0000 7f7424939800 1 -- 172.21.15.142:0/1760925414 shutdown_connections 2024-09-22T08:37:05.255 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.252+0000 7f7424939800 1 -- 172.21.15.142:0/1760925414 wait complete. 2024-09-22T08:37:05.255 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.252+0000 7f7424939800 1 Processor -- start 2024-09-22T08:37:05.255 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.253+0000 7f7424939800 1 -- start start 2024-09-22T08:37:05.255 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.253+0000 7f7424939800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55732f84b530 0x55732f9d0d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:05.256 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.253+0000 7f7424939800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55732f8e0a70 con 0x55732f84b530 2024-09-22T08:37:05.256 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.253+0000 7f74205c7640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55732f84b530 0x55732f9d0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:05.256 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.253+0000 7f74205c7640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55732f84b530 0x55732f9d0d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:59442/0 (socket says 172.21.15.142:59442) 2024-09-22T08:37:05.256 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.253+0000 7f74205c7640 1 -- 172.21.15.142:0/61988549 learned_addr learned my addr 172.21.15.142:0/61988549 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:37:05.256 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.253+0000 7f74205c7640 1 -- 172.21.15.142:0/61988549 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55732f9d12a0 con 0x55732f84b530 2024-09-22T08:37:05.256 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.253+0000 7f74205c7640 1 --2- 172.21.15.142:0/61988549 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55732f84b530 0x55732f9d0d40 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x55732f9ca1c0 tx=0x7f7410000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:05.256 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.253+0000 7f730ce09640 1 -- 172.21.15.142:0/61988549 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7410012030 con 0x55732f84b530 2024-09-22T08:37:05.256 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.253+0000 7f730ce09640 1 -- 172.21.15.142:0/61988549 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f741001a6d0 con 0x55732f84b530 2024-09-22T08:37:05.256 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.253+0000 7f730ce09640 1 -- 172.21.15.142:0/61988549 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f741001a9d0 con 0x55732f84b530 2024-09-22T08:37:05.256 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.254+0000 7f7424939800 1 -- 172.21.15.142:0/61988549 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55732f9d1530 con 0x55732f84b530 2024-09-22T08:37:05.256 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.254+0000 7f7424939800 1 -- 172.21.15.142:0/61988549 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55732f9d1f30 con 0x55732f84b530 2024-09-22T08:37:05.259 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.254+0000 7f730ce09640 1 -- 172.21.15.142:0/61988549 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f7410015020 con 0x55732f84b530 2024-09-22T08:37:05.260 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.255+0000 7f730ce09640 1 --2- 172.21.15.142:0/61988549 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f730803cfb0 0x7f730803f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:05.260 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.255+0000 7f730ce09640 1 -- 172.21.15.142:0/61988549 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5938+0+0 (secure 0 0 0) 0x7f7410020030 con 0x55732f84b530 2024-09-22T08:37:05.260 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.255+0000 7f7417dc6640 1 --2- 172.21.15.142:0/61988549 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f730803cfb0 0x7f730803f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:05.260 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.255+0000 7f7424939800 1 --2- 172.21.15.142:0/61988549 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55732f8ddc00 0x55732f9d8390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:05.260 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.255+0000 7f7424939800 1 -- 172.21.15.142:0/61988549 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55732f9d88d0 con 0x55732f8ddc00 2024-09-22T08:37:05.260 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.255+0000 7f7420dc8640 1 --2- 172.21.15.142:0/61988549 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55732f8ddc00 0x55732f9d8390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:05.260 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.255+0000 7f7417dc6640 1 --2- 172.21.15.142:0/61988549 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f730803cfb0 0x7f730803f470 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f7408057000 tx=0x7f7408052000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:05.260 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.255+0000 7f7420dc8640 1 --2- 172.21.15.142:0/61988549 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55732f8ddc00 0x55732f9d8390 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:05.260 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.255+0000 7f7420dc8640 1 -- 172.21.15.142:0/61988549 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f741800a4d0 con 0x55732f8ddc00 2024-09-22T08:37:05.260 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.255+0000 7f7424939800 1 -- 172.21.15.142:0/61988549 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55732f9d8c70 con 0x55732f8ddc00 2024-09-22T08:37:05.260 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.256+0000 7f7420dc8640 1 -- 172.21.15.142:0/61988549 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f741800a4d0 con 0x55732f8ddc00 2024-09-22T08:37:05.260 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.256+0000 7f7424939800 1 --2- 172.21.15.142:0/61988549 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55732f9da7b0 0x55732f9dcc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:05.261 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.256+0000 7f7424939800 1 -- 172.21.15.142:0/61988549 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:3 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55732f9dd3b0 con 0x55732f9da7b0 2024-09-22T08:37:05.261 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.256+0000 7f74205c7640 1 --2- 172.21.15.142:0/61988549 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55732f9da7b0 0x55732f9dcc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:05.261 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.256+0000 7f74205c7640 1 --2- 172.21.15.142:0/61988549 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55732f9da7b0 0x55732f9dcc20 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:05.261 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.256+0000 7f74205c7640 1 -- 172.21.15.142:0/61988549 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(3 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f741001ad50 con 0x55732f9da7b0 2024-09-22T08:37:05.261 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.256+0000 7f7424939800 1 -- 172.21.15.142:0/61988549 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55732f9d94c0 con 0x55732f8ddc00 2024-09-22T08:37:05.261 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.257+0000 7f7420dc8640 1 -- 172.21.15.142:0/61988549 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f741800a4d0 con 0x55732f8ddc00 2024-09-22T08:37:05.261 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.257+0000 7f7424939800 1 -- 172.21.15.142:0/61988549 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55732f9d9920 con 0x55732f9da7b0 2024-09-22T08:37:05.261 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.257+0000 7f74205c7640 1 -- 172.21.15.142:0/61988549 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(5 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f741001ad50 con 0x55732f9da7b0 2024-09-22T08:37:05.261 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.257+0000 7f7424939800 1 Processor -- start 2024-09-22T08:37:05.261 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.257+0000 7f7424939800 1 -- start start 2024-09-22T08:37:05.261 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.258+0000 7f7424939800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55732f9ebd40 0x55732f9ec160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:05.261 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.258+0000 7f7424939800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55732f7ced50 con 0x55732f9ebd40 2024-09-22T08:37:05.261 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.258+0000 7f7420dc8640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55732f9ebd40 0x55732f9ec160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:05.261 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.258+0000 7f7420dc8640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55732f9ebd40 0x55732f9ec160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:59444/0 (socket says 172.21.15.142:59444) 2024-09-22T08:37:05.262 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.258+0000 7f7420dc8640 1 -- 172.21.15.142:0/3734688183 learned_addr learned my addr 172.21.15.142:0/3734688183 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:37:05.262 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.258+0000 7f7420dc8640 1 -- 172.21.15.142:0/3734688183 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55732f9ec7a0 con 0x55732f9ebd40 2024-09-22T08:37:05.262 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.258+0000 7f7420dc8640 1 --2- 172.21.15.142:0/3734688183 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55732f9ebd40 0x55732f9ec160 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x55732f9d2100 tx=0x7f74180167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:05.262 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.258+0000 7f7305ffb640 1 -- 172.21.15.142:0/3734688183 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7418013640 con 0x55732f9ebd40 2024-09-22T08:37:05.262 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.258+0000 7f7305ffb640 1 -- 172.21.15.142:0/3734688183 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74180137e0 con 0x55732f9ebd40 2024-09-22T08:37:05.262 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.258+0000 7f7305ffb640 1 -- 172.21.15.142:0/3734688183 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7418013b00 con 0x55732f9ebd40 2024-09-22T08:37:05.262 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.258+0000 7f7424939800 1 -- 172.21.15.142:0/3734688183 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55732f9ecfd0 con 0x55732f9ebd40 2024-09-22T08:37:05.262 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.258+0000 7f7424939800 1 -- 172.21.15.142:0/3734688183 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55732f9ed570 con 0x55732f9ebd40 2024-09-22T08:37:05.268 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.259+0000 7f7305ffb640 1 -- 172.21.15.142:0/3734688183 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f7418011040 con 0x55732f9ebd40 2024-09-22T08:37:05.268 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.259+0000 7f7305ffb640 1 --2- 172.21.15.142:0/3734688183 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f72f803cfb0 0x7f72f803f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:05.268 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.260+0000 7f7305ffb640 1 -- 172.21.15.142:0/3734688183 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5938+0+0 (secure 0 0 0) 0x7f741800e040 con 0x55732f9ebd40 2024-09-22T08:37:05.268 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.260+0000 7f74205c7640 1 --2- 172.21.15.142:0/3734688183 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f72f803cfb0 0x7f72f803f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:05.268 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.260+0000 7f7424939800 1 Processor -- start 2024-09-22T08:37:05.268 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.260+0000 7f74205c7640 1 --2- 172.21.15.142:0/3734688183 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f72f803cfb0 0x7f72f803f470 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f7410052b90 tx=0x7f741000ef30 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:05.268 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.260+0000 7f7424939800 1 -- start start 2024-09-22T08:37:05.268 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.260+0000 7f7424939800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55732f9f87e0 0x55732f9f8be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:05.268 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.260+0000 7f7424939800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55732f9c9c50 con 0x55732f9f87e0 2024-09-22T08:37:05.268 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.260+0000 7f7420dc8640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55732f9f87e0 0x55732f9f8be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:05.268 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.260+0000 7f7420dc8640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55732f9f87e0 0x55732f9f8be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:59448/0 (socket says 172.21.15.142:59448) 2024-09-22T08:37:05.269 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.260+0000 7f7420dc8640 1 -- 172.21.15.142:0/3556620466 learned_addr learned my addr 172.21.15.142:0/3556620466 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:37:05.269 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.261+0000 7f7420dc8640 1 -- 172.21.15.142:0/3556620466 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55732f9f91d0 con 0x55732f9f87e0 2024-09-22T08:37:05.269 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.261+0000 7f7420dc8640 1 --2- 172.21.15.142:0/3556620466 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55732f9f87e0 0x55732f9f8be0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f7418054840 tx=0x7f741801f340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3400041c8a1c7e60 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:05.269 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.261+0000 7f72f77fe640 1 -- 172.21.15.142:0/3556620466 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7418051030 con 0x55732f9f87e0 2024-09-22T08:37:05.269 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.261+0000 7f72f77fe640 1 -- 172.21.15.142:0/3556620466 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f741802aa40 con 0x55732f9f87e0 2024-09-22T08:37:05.269 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.261+0000 7f72f77fe640 1 -- 172.21.15.142:0/3556620466 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7418013dd0 con 0x55732f9f87e0 2024-09-22T08:37:05.269 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.261+0000 7f7424939800 1 -- 172.21.15.142:0/3556620466 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55732f9f87e0 msgr2=0x55732f9f8be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:05.269 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.261+0000 7f7424939800 1 --2- 172.21.15.142:0/3556620466 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55732f9f87e0 0x55732f9f8be0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f7418054840 tx=0x7f741801f340 comp rx=0 tx=0).stop 2024-09-22T08:37:05.269 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.261+0000 7f7424939800 1 -- 172.21.15.142:0/3556620466 shutdown_connections 2024-09-22T08:37:05.269 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.261+0000 7f7424939800 1 --2- 172.21.15.142:0/3556620466 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55732f9f87e0 0x55732f9f8be0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:05.269 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.261+0000 7f7424939800 1 -- 172.21.15.142:0/3556620466 >> 172.21.15.142:0/3556620466 conn(0x55732f9f4c00 msgr2=0x55732f9f2e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:37:05.269 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.262+0000 7f7424939800 1 -- 172.21.15.142:0/3556620466 shutdown_connections 2024-09-22T08:37:05.269 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.262+0000 7f7424939800 1 -- 172.21.15.142:0/3556620466 wait complete. 2024-09-22T08:37:05.269 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.262+0000 7f7424939800 1 Processor -- start 2024-09-22T08:37:05.270 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.262+0000 7f7424939800 1 -- start start 2024-09-22T08:37:05.270 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.262+0000 7f7424939800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55732f9f87e0 0x55732f9ffde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:05.270 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.262+0000 7f7424939800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55732f9f97f0 con 0x55732f9f87e0 2024-09-22T08:37:05.270 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.262+0000 7f7420dc8640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55732f9f87e0 0x55732f9ffde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:05.270 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.262+0000 7f7420dc8640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55732f9f87e0 0x55732f9ffde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:59462/0 (socket says 172.21.15.142:59462) 2024-09-22T08:37:05.270 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.262+0000 7f7420dc8640 1 -- 172.21.15.142:0/4017004008 learned_addr learned my addr 172.21.15.142:0/4017004008 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:37:05.270 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.262+0000 7f7420dc8640 1 -- 172.21.15.142:0/4017004008 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55732fa00340 con 0x55732f9f87e0 2024-09-22T08:37:05.270 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.263+0000 7f7420dc8640 1 --2- 172.21.15.142:0/4017004008 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55732f9f87e0 0x55732f9ffde0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f7418054840 tx=0x7f7418054870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:05.270 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.263+0000 7f72f5ffb640 1 -- 172.21.15.142:0/4017004008 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7418051040 con 0x55732f9f87e0 2024-09-22T08:37:05.270 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.263+0000 7f72f5ffb640 1 -- 172.21.15.142:0/4017004008 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7418045cc0 con 0x55732f9f87e0 2024-09-22T08:37:05.270 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.263+0000 7f7424939800 1 -- 172.21.15.142:0/4017004008 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55732fa005d0 con 0x55732f9f87e0 2024-09-22T08:37:05.270 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.263+0000 7f72f5ffb640 1 -- 172.21.15.142:0/4017004008 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f74180203a0 con 0x55732f9f87e0 2024-09-22T08:37:05.270 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.263+0000 7f7424939800 1 -- 172.21.15.142:0/4017004008 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55732fa01160 con 0x55732f9f87e0 2024-09-22T08:37:05.270 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.264+0000 7f72f5ffb640 1 -- 172.21.15.142:0/4017004008 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f7418020650 con 0x55732f9f87e0 2024-09-22T08:37:05.271 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.264+0000 7f72f5ffb640 1 --2- 172.21.15.142:0/4017004008 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f72e803cfb0 0x7f72e803f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:05.271 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.264+0000 7f72f5ffb640 1 -- 172.21.15.142:0/4017004008 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5938+0+0 (secure 0 0 0) 0x7f741804c030 con 0x55732f9f87e0 2024-09-22T08:37:05.271 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.264+0000 7f74205c7640 1 --2- 172.21.15.142:0/4017004008 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f72e803cfb0 0x7f72e803f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:05.271 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.264+0000 7f74205c7640 1 --2- 172.21.15.142:0/4017004008 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f72e803cfb0 0x7f72e803f470 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f7410052df0 tx=0x7f7410045000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:05.271 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.264+0000 7f7424939800 20 rados->read ofs=0 len=0 2024-09-22T08:37:05.271 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.264+0000 7f7424939800 1 --2- 172.21.15.142:0/4017004008 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55732fa0b760 0x55732fa0dc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:05.271 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.264+0000 7f7424939800 1 -- 172.21.15.142:0/4017004008 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55732fa0e370 con 0x55732fa0b760 2024-09-22T08:37:05.271 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.265+0000 7f7417dc6640 1 --2- 172.21.15.142:0/4017004008 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55732fa0b760 0x55732fa0dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:05.271 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.265+0000 7f7417dc6640 1 --2- 172.21.15.142:0/4017004008 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55732fa0b760 0x55732fa0dc20 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:05.271 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.265+0000 7f7417dc6640 1 -- 172.21.15.142:0/4017004008 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7408051070 con 0x55732fa0b760 2024-09-22T08:37:05.271 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.265+0000 7f7424939800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:05.271 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.265+0000 7f7424939800 20 realm 2024-09-22T08:37:05.271 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.265+0000 7f7424939800 20 rados->read ofs=0 len=0 2024-09-22T08:37:05.272 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.265+0000 7f7424939800 1 -- 172.21.15.142:0/4017004008 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55732fa0e7a0 con 0x55732fa0b760 2024-09-22T08:37:05.272 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.265+0000 7f7417dc6640 1 -- 172.21.15.142:0/4017004008 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7408051070 con 0x55732fa0b760 2024-09-22T08:37:05.272 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.265+0000 7f7424939800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:05.272 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.265+0000 7f7424939800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:37:05.272 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.265+0000 7f7424939800 20 rados->read ofs=0 len=0 2024-09-22T08:37:05.272 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.265+0000 7f7424939800 1 -- 172.21.15.142:0/4017004008 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55732fa0f070 con 0x55732fa0b760 2024-09-22T08:37:05.272 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.265+0000 7f7417dc6640 1 -- 172.21.15.142:0/4017004008 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7408051070 con 0x55732fa0b760 2024-09-22T08:37:05.272 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.265+0000 7f7424939800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:05.272 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.265+0000 7f7424939800 20 rados->read ofs=0 len=0 2024-09-22T08:37:05.272 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.265+0000 7f7424939800 1 -- 172.21.15.142:0/4017004008 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55732fa0f410 con 0x55732fa0b760 2024-09-22T08:37:05.272 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.266+0000 7f7417dc6640 1 -- 172.21.15.142:0/4017004008 <== osd.1 v2:172.21.15.142:6816/3192108003 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7408051070 con 0x55732fa0b760 2024-09-22T08:37:05.272 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.266+0000 7f7424939800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:37:05.272 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.266+0000 7f7424939800 20 rados->read ofs=0 len=0 2024-09-22T08:37:05.272 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.266+0000 7f7424939800 1 --2- 172.21.15.142:0/4017004008 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55732fa10170 0x55732fa12560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:05.273 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.266+0000 7f7424939800 1 -- 172.21.15.142:0/4017004008 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55732fa12b70 con 0x55732fa10170 2024-09-22T08:37:05.273 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.266+0000 7f7420dc8640 1 --2- 172.21.15.142:0/4017004008 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55732fa10170 0x55732fa12560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:05.273 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.266+0000 7f7420dc8640 1 --2- 172.21.15.142:0/4017004008 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55732fa10170 0x55732fa12560 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:05.273 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.266+0000 7f7420dc8640 1 -- 172.21.15.142:0/4017004008 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(5 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f741803a070 con 0x55732fa10170 2024-09-22T08:37:05.273 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.266+0000 7f7424939800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:37:05.273 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.266+0000 7f7424939800 20 searching for the correct realm 2024-09-22T08:37:05.273 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.266+0000 7f7424939800 1 -- 172.21.15.142:0/4017004008 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55732fa144a0 con 0x55732fa10170 2024-09-22T08:37:05.273 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.267+0000 7f7420dc8640 1 -- 172.21.15.142:0/4017004008 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f741803a070 con 0x55732fa10170 2024-09-22T08:37:05.273 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.267+0000 7f7420dc8640 1 --2- 172.21.15.142:0/4017004008 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f741801fa40 0x7f74180358a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:05.273 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.267+0000 7f7420dc8640 1 -- 172.21.15.142:0/4017004008 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55732fa144a0 con 0x7f741801fa40 2024-09-22T08:37:05.273 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.267+0000 7f74205c7640 1 --2- 172.21.15.142:0/4017004008 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f741801fa40 0x7f74180358a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:05.282 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.267+0000 7f74205c7640 1 --2- 172.21.15.142:0/4017004008 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f741801fa40 0x7f74180358a0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:05.282 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.267+0000 7f74205c7640 1 -- 172.21.15.142:0/4017004008 <== osd.2 v2:172.21.15.142:6808/279438927 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f741001ad50 con 0x7f741801fa40 2024-09-22T08:37:05.282 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.267+0000 7f74205c7640 1 --2- 172.21.15.142:0/4017004008 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f7410017050 0x7f741001b040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:05.282 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.267+0000 7f74205c7640 1 -- 172.21.15.142:0/4017004008 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55732fa144a0 con 0x7f7410017050 2024-09-22T08:37:05.282 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.268+0000 7f7417dc6640 1 --2- 172.21.15.142:0/4017004008 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f7410017050 0x7f741001b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:05.282 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.268+0000 7f7417dc6640 1 --2- 172.21.15.142:0/4017004008 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f7410017050 0x7f741001b040 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:05.283 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.268+0000 7f7417dc6640 1 -- 172.21.15.142:0/4017004008 <== osd.0 v2:172.21.15.31:6800/168281188 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7408051070 con 0x7f7410017050 2024-09-22T08:37:05.283 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.268+0000 7f7417dc6640 1 -- 172.21.15.142:0/4017004008 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55732fa144a0 con 0x55732fa0b760 2024-09-22T08:37:05.283 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.268+0000 7f7417dc6640 1 -- 172.21.15.142:0/4017004008 <== osd.1 v2:172.21.15.142:6816/3192108003 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7408051070 con 0x55732fa0b760 2024-09-22T08:37:05.283 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.268+0000 7f7417dc6640 1 -- 172.21.15.142:0/4017004008 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55732fa144a0 con 0x55732fa0b760 2024-09-22T08:37:05.283 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.269+0000 7f7417dc6640 1 -- 172.21.15.142:0/4017004008 <== osd.1 v2:172.21.15.142:6816/3192108003 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7408051070 con 0x55732fa0b760 2024-09-22T08:37:05.283 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.269+0000 7f7417dc6640 1 -- 172.21.15.142:0/4017004008 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55732fa144a0 con 0x55732fa0b760 2024-09-22T08:37:05.283 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.269+0000 7f7417dc6640 1 -- 172.21.15.142:0/4017004008 <== osd.1 v2:172.21.15.142:6816/3192108003 7 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7408051070 con 0x55732fa0b760 2024-09-22T08:37:05.283 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.269+0000 7f7417dc6640 1 -- 172.21.15.142:0/4017004008 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55732fa144a0 con 0x7f7410017050 2024-09-22T08:37:05.283 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.269+0000 7f7417dc6640 1 -- 172.21.15.142:0/4017004008 <== osd.0 v2:172.21.15.31:6800/168281188 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7408051070 con 0x7f7410017050 2024-09-22T08:37:05.283 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.269+0000 7f7417dc6640 1 -- 172.21.15.142:0/4017004008 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55732fa144a0 con 0x7f741801fa40 2024-09-22T08:37:05.283 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.269+0000 7f74205c7640 1 -- 172.21.15.142:0/4017004008 <== osd.2 v2:172.21.15.142:6808/279438927 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f741001ad50 con 0x7f741801fa40 2024-09-22T08:37:05.283 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.269+0000 7f74205c7640 1 -- 172.21.15.142:0/4017004008 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55732fa144a0 con 0x55732fa10170 2024-09-22T08:37:05.283 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.270+0000 7f7420dc8640 1 -- 172.21.15.142:0/4017004008 <== osd.3 v2:172.21.15.142:6800/1064901393 3 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f741803a070 con 0x55732fa10170 2024-09-22T08:37:05.283 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.270+0000 7f7420dc8640 1 -- 172.21.15.142:0/4017004008 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55732fa144a0 con 0x55732fa0b760 2024-09-22T08:37:05.284 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.270+0000 7f7417dc6640 1 -- 172.21.15.142:0/4017004008 <== osd.1 v2:172.21.15.142:6816/3192108003 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7408051070 con 0x55732fa0b760 2024-09-22T08:37:05.284 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.270+0000 7f7417dc6640 1 -- 172.21.15.142:0/4017004008 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55732fa144a0 con 0x7f7410017050 2024-09-22T08:37:05.284 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.270+0000 7f7417dc6640 1 -- 172.21.15.142:0/4017004008 <== osd.0 v2:172.21.15.31:6800/168281188 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7408051070 con 0x7f7410017050 2024-09-22T08:37:05.284 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.270+0000 7f7417dc6640 1 -- 172.21.15.142:0/4017004008 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55732fa144a0 con 0x55732fa0b760 2024-09-22T08:37:05.284 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.270+0000 7f7417dc6640 1 -- 172.21.15.142:0/4017004008 <== osd.1 v2:172.21.15.142:6816/3192108003 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7408051070 con 0x55732fa0b760 2024-09-22T08:37:05.284 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.270+0000 7f7417dc6640 1 -- 172.21.15.142:0/4017004008 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55732fa144a0 con 0x7f741801fa40 2024-09-22T08:37:05.284 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.271+0000 7f74205c7640 1 -- 172.21.15.142:0/4017004008 <== osd.2 v2:172.21.15.142:6808/279438927 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f741001ad50 con 0x7f741801fa40 2024-09-22T08:37:05.284 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.271+0000 7f74205c7640 1 -- 172.21.15.142:0/4017004008 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55732fa144a0 con 0x55732fa10170 2024-09-22T08:37:05.284 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.271+0000 7f7420dc8640 1 -- 172.21.15.142:0/4017004008 <== osd.3 v2:172.21.15.142:6800/1064901393 4 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f741803a070 con 0x55732fa10170 2024-09-22T08:37:05.284 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.271+0000 7f7420dc8640 1 -- 172.21.15.142:0/4017004008 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55732fa144a0 con 0x55732fa10170 2024-09-22T08:37:05.284 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.271+0000 7f7420dc8640 1 -- 172.21.15.142:0/4017004008 <== osd.3 v2:172.21.15.142:6800/1064901393 5 ==== osd_op_reply(20 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f741803a070 con 0x55732fa10170 2024-09-22T08:37:05.284 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.271+0000 7f7420dc8640 1 -- 172.21.15.142:0/4017004008 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55732fa144a0 con 0x7f7410017050 2024-09-22T08:37:05.284 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.271+0000 7f7417dc6640 1 -- 172.21.15.142:0/4017004008 <== osd.0 v2:172.21.15.31:6800/168281188 4 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7408051070 con 0x7f7410017050 2024-09-22T08:37:05.285 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.271+0000 7f7417dc6640 1 -- 172.21.15.142:0/4017004008 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55732fa144a0 con 0x55732fa10170 2024-09-22T08:37:05.285 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.271+0000 7f7420dc8640 1 -- 172.21.15.142:0/4017004008 <== osd.3 v2:172.21.15.142:6800/1064901393 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f741803a070 con 0x55732fa10170 2024-09-22T08:37:05.285 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.271+0000 7f7420dc8640 1 -- 172.21.15.142:0/4017004008 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55732fa144a0 con 0x55732fa10170 2024-09-22T08:37:05.285 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.272+0000 7f7420dc8640 1 -- 172.21.15.142:0/4017004008 <== osd.3 v2:172.21.15.142:6800/1064901393 7 ==== osd_op_reply(23 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f741803a070 con 0x55732fa10170 2024-09-22T08:37:05.285 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.272+0000 7f7420dc8640 1 -- 172.21.15.142:0/4017004008 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55732fa144a0 con 0x55732fa0b760 2024-09-22T08:37:05.285 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.272+0000 7f7417dc6640 1 -- 172.21.15.142:0/4017004008 <== osd.1 v2:172.21.15.142:6816/3192108003 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7408051070 con 0x55732fa0b760 2024-09-22T08:37:05.285 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.272+0000 7f7417dc6640 1 -- 172.21.15.142:0/4017004008 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55732fa144a0 con 0x55732fa0b760 2024-09-22T08:37:05.285 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.272+0000 7f7417dc6640 1 -- 172.21.15.142:0/4017004008 <== osd.1 v2:172.21.15.142:6816/3192108003 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f7408051070 con 0x55732fa0b760 2024-09-22T08:37:05.285 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.272+0000 7f7417dc6640 1 -- 172.21.15.142:0/4017004008 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55732fa144a0 con 0x7f7410017050 2024-09-22T08:37:05.285 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.272+0000 7f7417dc6640 1 -- 172.21.15.142:0/4017004008 <== osd.0 v2:172.21.15.31:6800/168281188 5 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7408051070 con 0x7f7410017050 2024-09-22T08:37:05.285 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.272+0000 7f7417dc6640 1 -- 172.21.15.142:0/4017004008 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55732fa144a0 con 0x55732fa10170 2024-09-22T08:37:05.285 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.273+0000 7f7420dc8640 1 -- 172.21.15.142:0/4017004008 <== osd.3 v2:172.21.15.142:6800/1064901393 8 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f741803a070 con 0x55732fa10170 2024-09-22T08:37:05.285 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.273+0000 7f7420dc8640 1 -- 172.21.15.142:0/4017004008 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55732fa144a0 con 0x7f741801fa40 2024-09-22T08:37:05.286 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.273+0000 7f74205c7640 1 -- 172.21.15.142:0/4017004008 <== osd.2 v2:172.21.15.142:6808/279438927 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f741001ad50 con 0x7f741801fa40 2024-09-22T08:37:05.286 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.273+0000 7f74205c7640 1 -- 172.21.15.142:0/4017004008 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55732fa144a0 con 0x55732fa0b760 2024-09-22T08:37:05.286 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.273+0000 7f7417dc6640 1 -- 172.21.15.142:0/4017004008 <== osd.1 v2:172.21.15.142:6816/3192108003 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7408051070 con 0x55732fa0b760 2024-09-22T08:37:05.286 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.273+0000 7f7417dc6640 1 -- 172.21.15.142:0/4017004008 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55732fa144a0 con 0x7f7410017050 2024-09-22T08:37:05.286 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.273+0000 7f7417dc6640 1 -- 172.21.15.142:0/4017004008 <== osd.0 v2:172.21.15.31:6800/168281188 6 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7408051070 con 0x7f7410017050 2024-09-22T08:37:05.286 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.273+0000 7f7417dc6640 1 -- 172.21.15.142:0/4017004008 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55732fa144a0 con 0x55732fa10170 2024-09-22T08:37:05.286 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.274+0000 7f7420dc8640 1 -- 172.21.15.142:0/4017004008 <== osd.3 v2:172.21.15.142:6800/1064901393 9 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f741803a070 con 0x55732fa10170 2024-09-22T08:37:05.286 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.274+0000 7f7420dc8640 1 -- 172.21.15.142:0/4017004008 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55732fa144a0 con 0x7f7410017050 2024-09-22T08:37:05.286 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.274+0000 7f7417dc6640 1 -- 172.21.15.142:0/4017004008 <== osd.0 v2:172.21.15.31:6800/168281188 7 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7408051070 con 0x7f7410017050 2024-09-22T08:37:05.286 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.274+0000 7f7417dc6640 1 -- 172.21.15.142:0/4017004008 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55732fa144a0 con 0x7f741801fa40 2024-09-22T08:37:05.286 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.274+0000 7f74205c7640 1 -- 172.21.15.142:0/4017004008 <== osd.2 v2:172.21.15.142:6808/279438927 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f741001ad50 con 0x7f741801fa40 2024-09-22T08:37:05.286 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.274+0000 7f74205c7640 1 -- 172.21.15.142:0/4017004008 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55732fa144a0 con 0x55732fa10170 2024-09-22T08:37:05.287 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.274+0000 7f7420dc8640 1 -- 172.21.15.142:0/4017004008 <== osd.3 v2:172.21.15.142:6800/1064901393 10 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f741803a070 con 0x55732fa10170 2024-09-22T08:37:05.287 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.274+0000 7f7420dc8640 1 -- 172.21.15.142:0/4017004008 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55732fa144a0 con 0x7f7410017050 2024-09-22T08:37:05.287 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.275+0000 7f7417dc6640 1 -- 172.21.15.142:0/4017004008 <== osd.0 v2:172.21.15.31:6800/168281188 8 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7408051070 con 0x7f7410017050 2024-09-22T08:37:05.287 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.275+0000 7f7417dc6640 1 -- 172.21.15.142:0/4017004008 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55732fa144a0 con 0x55732fa0b760 2024-09-22T08:37:05.287 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.275+0000 7f7417dc6640 1 -- 172.21.15.142:0/4017004008 <== osd.1 v2:172.21.15.142:6816/3192108003 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f7408051070 con 0x55732fa0b760 2024-09-22T08:37:05.287 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.275+0000 7f7417dc6640 1 -- 172.21.15.142:0/4017004008 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55732fa144a0 con 0x7f741801fa40 2024-09-22T08:37:05.287 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.275+0000 7f74205c7640 1 -- 172.21.15.142:0/4017004008 <== osd.2 v2:172.21.15.142:6808/279438927 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f741001ad50 con 0x7f741801fa40 2024-09-22T08:37:05.287 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.275+0000 7f7424939800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:37:05.287 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.275+0000 7f7424939800 20 RGWRados::pool_iterate: got zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec 2024-09-22T08:37:05.287 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.275+0000 7f7424939800 20 RGWRados::pool_iterate: got zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f 2024-09-22T08:37:05.287 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.275+0000 7f7424939800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:37:05.287 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.275+0000 7f7424939800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:37:05.287 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.275+0000 7f7424939800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:37:05.288 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.275+0000 7f7424939800 20 rados->read ofs=0 len=0 2024-09-22T08:37:05.288 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.275+0000 7f7424939800 1 -- 172.21.15.142:0/4017004008 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55732fa13560 con 0x55732fa0b760 2024-09-22T08:37:05.288 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.275+0000 7f7417dc6640 1 -- 172.21.15.142:0/4017004008 <== osd.1 v2:172.21.15.142:6816/3192108003 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7408051070 con 0x55732fa0b760 2024-09-22T08:37:05.288 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.275+0000 7f7424939800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:05.288 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.276+0000 7f7424939800 20 rados->read ofs=0 len=0 2024-09-22T08:37:05.288 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.276+0000 7f7424939800 1 -- 172.21.15.142:0/4017004008 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55732fa13db0 con 0x55732fa0b760 2024-09-22T08:37:05.288 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.276+0000 7f7417dc6640 1 -- 172.21.15.142:0/4017004008 <== osd.1 v2:172.21.15.142:6816/3192108003 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7408051070 con 0x55732fa0b760 2024-09-22T08:37:05.288 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.276+0000 7f7424939800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:37:05.288 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.276+0000 7f7424939800 20 rados->read ofs=0 len=0 2024-09-22T08:37:05.288 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.276+0000 7f7424939800 1 -- 172.21.15.142:0/4017004008 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:40 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55732fa14920 con 0x55732fa10170 2024-09-22T08:37:05.288 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.276+0000 7f7420dc8640 1 -- 172.21.15.142:0/4017004008 <== osd.3 v2:172.21.15.142:6800/1064901393 11 ==== osd_op_reply(40 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f741803a070 con 0x55732fa10170 2024-09-22T08:37:05.288 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.276+0000 7f7424939800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:37:05.288 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.276+0000 7f7424939800 20 zone default found 2024-09-22T08:37:05.288 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.276+0000 7f7424939800 4 Realm: () 2024-09-22T08:37:05.289 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.276+0000 7f7424939800 4 ZoneGroup: default (d89f6f57-1007-47dd-9065-f486c7b01aec) 2024-09-22T08:37:05.289 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.276+0000 7f7424939800 4 Zone: default (e239248c-0bee-4e41-803a-24b288d3eb8f) 2024-09-22T08:37:05.289 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.276+0000 7f7424939800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:37:05.289 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.276+0000 7f7424939800 20 zonegroup default 2024-09-22T08:37:05.289 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.276+0000 7f7424939800 20 rados->read ofs=0 len=0 2024-09-22T08:37:05.289 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.276+0000 7f7424939800 1 -- 172.21.15.142:0/4017004008 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55732fa14ce0 con 0x7f7410017050 2024-09-22T08:37:05.289 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.276+0000 7f7417dc6640 1 -- 172.21.15.142:0/4017004008 <== osd.0 v2:172.21.15.31:6800/168281188 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f7408051070 con 0x7f7410017050 2024-09-22T08:37:05.289 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.276+0000 7f7424939800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:05.289 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.276+0000 7f7424939800 20 rados->read ofs=0 len=0 2024-09-22T08:37:05.289 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.276+0000 7f7424939800 1 -- 172.21.15.142:0/4017004008 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55732fa16fc0 con 0x55732fa10170 2024-09-22T08:37:05.289 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.276+0000 7f7420dc8640 1 -- 172.21.15.142:0/4017004008 <== osd.3 v2:172.21.15.142:6800/1064901393 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f741803a070 con 0x55732fa10170 2024-09-22T08:37:05.289 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.277+0000 7f7424939800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:05.289 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.277+0000 7f7424939800 20 rados->read ofs=0 len=0 2024-09-22T08:37:05.289 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.277+0000 7f7424939800 1 -- 172.21.15.142:0/4017004008 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55732fa17380 con 0x55732fa10170 2024-09-22T08:37:05.290 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.277+0000 7f7420dc8640 1 -- 172.21.15.142:0/4017004008 <== osd.3 v2:172.21.15.142:6800/1064901393 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f741803a070 con 0x55732fa10170 2024-09-22T08:37:05.290 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.277+0000 7f7424939800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:05.290 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.277+0000 7f7424939800 20 started sync module instance, tier type = 2024-09-22T08:37:05.290 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.277+0000 7f7424939800 20 started zone id=e239248c-0bee-4e41-803a-24b288d3eb8f (name=default) with tier type = 2024-09-22T08:37:05.290 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.277+0000 7f7424939800 1 -- 172.21.15.142:0/4017004008 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55732fa16450 con 0x7f741801fa40 2024-09-22T08:37:05.290 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.278+0000 7f74205c7640 1 -- 172.21.15.142:0/4017004008 <== osd.2 v2:172.21.15.142:6808/279438927 7 ==== osd_op_reply(44 notify.0 [create] v32'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f741001ad50 con 0x7f741801fa40 2024-09-22T08:37:05.290 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.278+0000 7f7424939800 1 -- 172.21.15.142:0/4017004008 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93953208707136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55732fa160b0 con 0x7f741801fa40 2024-09-22T08:37:05.290 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.278+0000 7f7424939800 1 -- 172.21.15.142:0/4017004008 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55732fa182b0 con 0x55732fa0b760 2024-09-22T08:37:05.290 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.279+0000 7f74205c7640 1 -- 172.21.15.142:0/4017004008 <== osd.2 v2:172.21.15.142:6808/279438927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93953208707136] v32'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f741001ad50 con 0x7f741801fa40 2024-09-22T08:37:05.290 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.279+0000 7f7417dc6640 1 -- 172.21.15.142:0/4017004008 <== osd.1 v2:172.21.15.142:6816/3192108003 16 ==== osd_op_reply(46 notify.1 [create] v32'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7408051070 con 0x55732fa0b760 2024-09-22T08:37:05.290 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.279+0000 7f7424939800 1 -- 172.21.15.142:0/4017004008 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93953208712704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55732fa186d0 con 0x55732fa0b760 2024-09-22T08:37:05.290 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.279+0000 7f7424939800 1 -- 172.21.15.142:0/4017004008 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55732fa19090 con 0x55732fa10170 2024-09-22T08:37:05.290 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.280+0000 7f7417dc6640 1 -- 172.21.15.142:0/4017004008 <== osd.1 v2:172.21.15.142:6816/3192108003 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93953208712704] v32'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7408051070 con 0x55732fa0b760 2024-09-22T08:37:05.291 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.280+0000 7f7420dc8640 1 -- 172.21.15.142:0/4017004008 <== osd.3 v2:172.21.15.142:6800/1064901393 14 ==== osd_op_reply(48 notify.2 [create] v32'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f741803a070 con 0x55732fa10170 2024-09-22T08:37:05.291 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.281+0000 7f7424939800 1 -- 172.21.15.142:0/4017004008 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93953208714240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55732fa19090 con 0x55732fa10170 2024-09-22T08:37:05.291 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.281+0000 7f7424939800 1 -- 172.21.15.142:0/4017004008 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55732fa19ab0 con 0x7f741801fa40 2024-09-22T08:37:05.296 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.282+0000 7f74205c7640 1 -- 172.21.15.142:0/4017004008 <== osd.2 v2:172.21.15.142:6808/279438927 9 ==== osd_op_reply(50 notify.3 [create] v32'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f741001ad50 con 0x7f741801fa40 2024-09-22T08:37:05.296 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.282+0000 7f7420dc8640 1 -- 172.21.15.142:0/4017004008 <== osd.3 v2:172.21.15.142:6800/1064901393 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 93953208714240] v32'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f741803a070 con 0x55732fa10170 2024-09-22T08:37:05.296 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.282+0000 7f7424939800 1 -- 172.21.15.142:0/4017004008 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93953208716256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55732fa19000 con 0x7f741801fa40 2024-09-22T08:37:05.296 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.282+0000 7f7424939800 1 -- 172.21.15.142:0/4017004008 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55732fa1a970 con 0x55732fa0b760 2024-09-22T08:37:05.296 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.283+0000 7f7417dc6640 1 -- 172.21.15.142:0/4017004008 <== osd.1 v2:172.21.15.142:6816/3192108003 18 ==== osd_op_reply(52 notify.4 [create] v32'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7408051070 con 0x55732fa0b760 2024-09-22T08:37:05.296 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.283+0000 7f7424939800 1 -- 172.21.15.142:0/4017004008 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93953208723104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55732fa1b0f0 con 0x55732fa0b760 2024-09-22T08:37:05.297 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.283+0000 7f7424939800 1 -- 172.21.15.142:0/4017004008 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55732fa1bc10 con 0x7f7410017050 2024-09-22T08:37:05.297 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.284+0000 7f74205c7640 1 -- 172.21.15.142:0/4017004008 <== osd.2 v2:172.21.15.142:6808/279438927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93953208716256] v32'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f741001ad50 con 0x7f741801fa40 2024-09-22T08:37:05.297 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.284+0000 7f7417dc6640 1 -- 172.21.15.142:0/4017004008 <== osd.1 v2:172.21.15.142:6816/3192108003 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93953208723104] v32'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7408051070 con 0x55732fa0b760 2024-09-22T08:37:05.297 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.284+0000 7f7417dc6640 1 -- 172.21.15.142:0/4017004008 <== osd.0 v2:172.21.15.31:6800/168281188 10 ==== osd_op_reply(54 notify.5 [create] v32'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7408051070 con 0x7f7410017050 2024-09-22T08:37:05.297 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.284+0000 7f7424939800 1 -- 172.21.15.142:0/4017004008 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93953208727264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55732fa1bbd0 con 0x7f7410017050 2024-09-22T08:37:05.297 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.284+0000 7f7424939800 1 -- 172.21.15.142:0/4017004008 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55732fa1c4b0 con 0x7f7410017050 2024-09-22T08:37:05.297 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.285+0000 7f7417dc6640 1 -- 172.21.15.142:0/4017004008 <== osd.0 v2:172.21.15.31:6800/168281188 11 ==== osd_op_reply(56 notify.6 [create] v32'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7408051070 con 0x7f7410017050 2024-09-22T08:37:05.297 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.285+0000 7f7424939800 1 -- 172.21.15.142:0/4017004008 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93953208729600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55732fa1bc10 con 0x7f7410017050 2024-09-22T08:37:05.297 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.285+0000 7f7424939800 1 -- 172.21.15.142:0/4017004008 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55732fa1d030 con 0x7f7410017050 2024-09-22T08:37:05.297 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.285+0000 7f7417dc6640 1 -- 172.21.15.142:0/4017004008 <== osd.0 v2:172.21.15.31:6800/168281188 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93953208727264] v32'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7408051070 con 0x7f7410017050 2024-09-22T08:37:05.297 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.286+0000 7f7417dc6640 1 -- 172.21.15.142:0/4017004008 <== osd.0 v2:172.21.15.31:6800/168281188 13 ==== osd_op_reply(58 notify.7 [create] v32'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7408051070 con 0x7f7410017050 2024-09-22T08:37:05.297 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.286+0000 7f7424939800 1 -- 172.21.15.142:0/4017004008 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93953208732448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55732fa1cff0 con 0x7f7410017050 2024-09-22T08:37:05.297 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.286+0000 7f7424939800 20 add_watcher() i=0 2024-09-22T08:37:05.298 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.286+0000 7f7424939800 20 add_watcher() i=1 2024-09-22T08:37:05.298 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.286+0000 7f7424939800 20 add_watcher() i=2 2024-09-22T08:37:05.298 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.286+0000 7f7424939800 20 add_watcher() i=3 2024-09-22T08:37:05.298 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.286+0000 7f7424939800 20 add_watcher() i=4 2024-09-22T08:37:05.298 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.286+0000 7f7424939800 20 add_watcher() i=5 2024-09-22T08:37:05.298 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.287+0000 7f7417dc6640 1 -- 172.21.15.142:0/4017004008 <== osd.0 v2:172.21.15.31:6800/168281188 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93953208729600] v32'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7408051070 con 0x7f7410017050 2024-09-22T08:37:05.298 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.287+0000 7f7424939800 20 add_watcher() i=6 2024-09-22T08:37:05.298 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.287+0000 7f7417dc6640 1 -- 172.21.15.142:0/4017004008 <== osd.0 v2:172.21.15.31:6800/168281188 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 93953208732448] v32'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7408051070 con 0x7f7410017050 2024-09-22T08:37:05.298 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.287+0000 7f7424939800 20 add_watcher() i=7 2024-09-22T08:37:05.298 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.287+0000 7f7424939800 2 all 8 watchers are set, enabling cache 2024-09-22T08:37:05.298 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.287+0000 7f7424939800 1 -- 172.21.15.142:0/4017004008 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55732fa1c530 con 0x55732fa0b760 2024-09-22T08:37:05.298 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.288+0000 7f7417dc6640 1 -- 172.21.15.142:0/4017004008 <== osd.1 v2:172.21.15.142:6816/3192108003 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f7408051070 con 0x55732fa0b760 2024-09-22T08:37:05.298 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.288+0000 7f7424939800 1 -- 172.21.15.142:0/4017004008 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93953208721056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55732fa1d8a0 con 0x55732fa0b760 2024-09-22T08:37:05.299 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.289+0000 7f7417dc6640 1 -- 172.21.15.142:0/4017004008 <== osd.1 v2:172.21.15.142:6816/3192108003 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93953208721056] v32'178 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7408051070 con 0x55732fa0b760 2024-09-22T08:37:05.299 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.289+0000 7f72d67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:37:05.299 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.289+0000 7f7424939800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:37:05.299 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.289+0000 7f7424939800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:37:05.299 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.289+0000 7f7424939800 5 note: GC not initialized 2024-09-22T08:37:05.299 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.289+0000 7f72d57e2640 20 reqs_thread_entry: start 2024-09-22T08:37:05.299 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.289+0000 7f7424939800 20 init_complete bucket index max shards: 11 2024-09-22T08:37:05.299 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.289+0000 7f7424939800 20 Filter name: none 2024-09-22T08:37:05.299 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.289+0000 7f7246ffd640 20 reqs_thread_entry: start 2024-09-22T08:37:05.299 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.289+0000 7f7424939800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-22T08:37:05.299 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.289+0000 7f7424939800 20 rados->read ofs=0 len=0 2024-09-22T08:37:05.299 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.289+0000 7f7424939800 1 -- 172.21.15.142:0/4017004008 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55732fa53870 con 0x7f741801fa40 2024-09-22T08:37:05.299 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.290+0000 7f74205c7640 1 -- 172.21.15.142:0/4017004008 <== osd.2 v2:172.21.15.142:6808/279438927 11 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv33 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f741001ad50 con 0x7f741801fa40 2024-09-22T08:37:05.299 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.290+0000 7f7424939800 20 rados_obj.operate() r=0 bl.length=165 2024-09-22T08:37:05.300 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.290+0000 7f7424939800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-22T08:37:05.300 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.290+0000 7f7424939800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-22T08:37:05.300 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.290+0000 7f7424939800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:e239248c-0bee-4e41-803a-24b288d3eb8f.4226.5 : miss 2024-09-22T08:37:05.300 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.290+0000 7f7424939800 20 rados->read ofs=0 len=0 2024-09-22T08:37:05.300 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.290+0000 7f7424939800 1 -- 172.21.15.142:0/4017004008 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:63 8.1d 8:b89fd42a:root::.bucket.meta.myfoo%3ae239248c-0bee-4e41-803a-24b288d3eb8f.4226.5:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55732fa55480 con 0x7f7410017050 2024-09-22T08:37:05.300 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.290+0000 7f7417dc6640 1 -- 172.21.15.142:0/4017004008 <== osd.0 v2:172.21.15.31:6800/168281188 16 ==== osd_op_reply(63 .bucket.meta.myfoo:e239248c-0bee-4e41-803a-24b288d3eb8f.4226.5 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7f7408051070 con 0x7f7410017050 2024-09-22T08:37:05.300 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.290+0000 7f7424939800 20 rados_obj.operate() r=0 bl.length=387 2024-09-22T08:37:05.300 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.290+0000 7f7424939800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:e239248c-0bee-4e41-803a-24b288d3eb8f.4226.5 info.flags=0x17 2024-09-22T08:37:05.300 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.290+0000 7f7424939800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:e239248c-0bee-4e41-803a-24b288d3eb8f.4226.5 to cache LRU end 2024-09-22T08:37:05.300 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.290+0000 7f7424939800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:37:05.300 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.290+0000 7f7424939800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-22T08:37:05.300 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.290+0000 7f7424939800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:e239248c-0bee-4e41-803a-24b288d3eb8f.4226.5 2024-09-22T08:37:05.300 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.290+0000 7f7424939800 20 get_obj_state: octx=0x7f7410017e10 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x55732fa57b88 s->prefetch_data=0 2024-09-22T08:37:05.300 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.291+0000 7f7424939800 1 -- 172.21.15.142:0/4017004008 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:64 3.3a 3:5da07612:::e239248c-0bee-4e41-803a-24b288d3eb8f.4226.5_bb3aec0fdcdbc2974890f805c585d432:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55732fa59c60 con 0x7f741801fa40 2024-09-22T08:37:05.301 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.291+0000 7f74205c7640 1 -- 172.21.15.142:0/4017004008 <== osd.2 v2:172.21.15.142:6808/279438927 12 ==== osd_op_reply(64 e239248c-0bee-4e41-803a-24b288d3eb8f.4226.5_bb3aec0fdcdbc2974890f805c585d432 [call out=24b,getxattrs out=857b,stat out=16b] v0'0 uv2 ondisk = 0) ==== 304+0+897 (crc 0 0 0) 0x7f741001ad50 con 0x7f741801fa40 2024-09-22T08:37:05.301 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.291+0000 7f7424939800 10 manifest: total_size = 5 2024-09-22T08:37:05.301 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.291+0000 7f7424939800 20 get_obj_state: setting s->obj_tag to _-4P6jHpxMA-jZZSOcS-_DPSbjeOTw9d 2024-09-22T08:37:05.301 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.292+0000 7f72d67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:37:05.301 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.292+0000 7f7424939800 1 -- 172.21.15.142:0/4017004008 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93953208721056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55732fa59c60 con 0x55732fa0b760 2024-09-22T08:37:05.301 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.293+0000 7f7417dc6640 1 -- 172.21.15.142:0/4017004008 <== osd.1 v2:172.21.15.142:6816/3192108003 22 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 93953208721056] v32'179 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7408051070 con 0x55732fa0b760 2024-09-22T08:37:05.301 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.293+0000 7f7424939800 1 -- 172.21.15.142:0/4017004008 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93953208707136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55732fa59c60 con 0x7f741801fa40 2024-09-22T08:37:05.301 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.294+0000 7f74205c7640 1 -- 172.21.15.142:0/4017004008 <== osd.2 v2:172.21.15.142:6808/279438927 13 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 93953208707136] v32'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f741001ad50 con 0x7f741801fa40 2024-09-22T08:37:05.301 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.294+0000 7f7424939800 20 remove_watcher() i=0 2024-09-22T08:37:05.301 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.294+0000 7f7424939800 2 removed watcher, disabling cache 2024-09-22T08:37:05.301 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.294+0000 7f7424939800 1 -- 172.21.15.142:0/4017004008 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93953208712704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55732fa59c60 con 0x55732fa0b760 2024-09-22T08:37:05.301 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.295+0000 7f7417dc6640 1 -- 172.21.15.142:0/4017004008 <== osd.1 v2:172.21.15.142:6816/3192108003 23 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 93953208712704] v32'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7408051070 con 0x55732fa0b760 2024-09-22T08:37:05.301 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.295+0000 7f7424939800 20 remove_watcher() i=1 2024-09-22T08:37:05.301 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.295+0000 7f7424939800 1 -- 172.21.15.142:0/4017004008 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93953208714240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55732fa59c60 con 0x55732fa10170 2024-09-22T08:37:05.305 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.296+0000 7f7420dc8640 1 -- 172.21.15.142:0/4017004008 <== osd.3 v2:172.21.15.142:6800/1064901393 16 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 93953208714240] v32'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f741803a070 con 0x55732fa10170 2024-09-22T08:37:05.305 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.296+0000 7f7424939800 20 remove_watcher() i=2 2024-09-22T08:37:05.306 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.296+0000 7f7424939800 1 -- 172.21.15.142:0/4017004008 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93953208716256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55732fa59c60 con 0x7f741801fa40 2024-09-22T08:37:05.306 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.297+0000 7f74205c7640 1 -- 172.21.15.142:0/4017004008 <== osd.2 v2:172.21.15.142:6808/279438927 14 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 93953208716256] v32'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f741001ad50 con 0x7f741801fa40 2024-09-22T08:37:05.306 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.297+0000 7f7424939800 20 remove_watcher() i=3 2024-09-22T08:37:05.306 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.297+0000 7f7424939800 1 -- 172.21.15.142:0/4017004008 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93953208723104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55732fa59c60 con 0x55732fa0b760 2024-09-22T08:37:05.306 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.298+0000 7f7417dc6640 1 -- 172.21.15.142:0/4017004008 <== osd.1 v2:172.21.15.142:6816/3192108003 24 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 93953208723104] v32'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7408051070 con 0x55732fa0b760 2024-09-22T08:37:05.306 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.298+0000 7f7424939800 20 remove_watcher() i=4 2024-09-22T08:37:05.306 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.298+0000 7f7424939800 1 -- 172.21.15.142:0/4017004008 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93953208727264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55732fa59c60 con 0x7f7410017050 2024-09-22T08:37:05.306 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.299+0000 7f7417dc6640 1 -- 172.21.15.142:0/4017004008 <== osd.0 v2:172.21.15.31:6800/168281188 17 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 93953208727264] v32'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7408051070 con 0x7f7410017050 2024-09-22T08:37:05.306 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.299+0000 7f7424939800 20 remove_watcher() i=5 2024-09-22T08:37:05.306 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.299+0000 7f7424939800 1 -- 172.21.15.142:0/4017004008 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93953208729600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55732fa59c60 con 0x7f7410017050 2024-09-22T08:37:05.306 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.300+0000 7f7417dc6640 1 -- 172.21.15.142:0/4017004008 <== osd.0 v2:172.21.15.31:6800/168281188 18 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 93953208729600] v32'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7408051070 con 0x7f7410017050 2024-09-22T08:37:05.306 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.300+0000 7f7424939800 20 remove_watcher() i=6 2024-09-22T08:37:05.306 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.300+0000 7f7424939800 1 -- 172.21.15.142:0/4017004008 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93953208732448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55732fa59c60 con 0x7f7410017050 2024-09-22T08:37:05.307 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.301+0000 7f7417dc6640 1 -- 172.21.15.142:0/4017004008 <== osd.0 v2:172.21.15.31:6800/168281188 19 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 93953208732448] v32'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7408051070 con 0x7f7410017050 2024-09-22T08:37:05.307 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.301+0000 7f7424939800 20 remove_watcher() i=7 2024-09-22T08:37:05.307 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.301+0000 7f7424939800 1 -- 172.21.15.142:0/4017004008 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f7410017050 msgr2=0x7f741001b040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:05.307 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.301+0000 7f7424939800 1 --2- 172.21.15.142:0/4017004008 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f7410017050 0x7f741001b040 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:05.307 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.301+0000 7f7424939800 1 -- 172.21.15.142:0/4017004008 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55732fa0b760 msgr2=0x55732fa0dc20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:05.307 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.301+0000 7f7424939800 1 --2- 172.21.15.142:0/4017004008 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55732fa0b760 0x55732fa0dc20 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:05.307 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.301+0000 7f7424939800 1 -- 172.21.15.142:0/4017004008 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f741801fa40 msgr2=0x7f74180358a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:05.307 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.301+0000 7f7424939800 1 --2- 172.21.15.142:0/4017004008 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f741801fa40 0x7f74180358a0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:05.307 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.301+0000 7f7424939800 1 -- 172.21.15.142:0/4017004008 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55732fa10170 msgr2=0x55732fa12560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:05.307 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.301+0000 7f7424939800 1 --2- 172.21.15.142:0/4017004008 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55732fa10170 0x55732fa12560 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:05.307 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.301+0000 7f7424939800 1 -- 172.21.15.142:0/4017004008 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f72e803cfb0 msgr2=0x7f72e803f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:05.307 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.301+0000 7f7424939800 1 --2- 172.21.15.142:0/4017004008 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f72e803cfb0 0x7f72e803f470 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f7410052df0 tx=0x7f7410045000 comp rx=0 tx=0).stop 2024-09-22T08:37:05.307 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.301+0000 7f7424939800 1 -- 172.21.15.142:0/4017004008 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55732f9f87e0 msgr2=0x55732f9ffde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:05.308 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.301+0000 7f7417dc6640 1 -- 172.21.15.142:0/4017004008 reap_dead start 2024-09-22T08:37:05.308 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.301+0000 7f7424939800 1 --2- 172.21.15.142:0/4017004008 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55732f9f87e0 0x55732f9ffde0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f7418054840 tx=0x7f7418054870 comp rx=0 tx=0).stop 2024-09-22T08:37:05.308 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.301+0000 7f7424939800 1 -- 172.21.15.142:0/4017004008 shutdown_connections 2024-09-22T08:37:05.308 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.301+0000 7f7424939800 1 --2- 172.21.15.142:0/4017004008 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55732f9f87e0 0x55732f9ffde0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:05.308 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.301+0000 7f7424939800 1 -- 172.21.15.142:0/4017004008 >> 172.21.15.142:0/4017004008 conn(0x55732f9f4c00 msgr2=0x55732f9f2e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:37:05.308 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.301+0000 7f7424939800 1 -- 172.21.15.142:0/4017004008 shutdown_connections 2024-09-22T08:37:05.308 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.301+0000 7f7424939800 1 -- 172.21.15.142:0/4017004008 wait complete. 2024-09-22T08:37:05.308 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.301+0000 7f7424939800 1 -- 172.21.15.142:0/3734688183 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f72f803cfb0 msgr2=0x7f72f803f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:05.308 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.301+0000 7f7424939800 1 --2- 172.21.15.142:0/3734688183 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f72f803cfb0 0x7f72f803f470 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f7410052b90 tx=0x7f741000ef30 comp rx=0 tx=0).stop 2024-09-22T08:37:05.308 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.301+0000 7f7424939800 1 -- 172.21.15.142:0/3734688183 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55732f9ebd40 msgr2=0x55732f9ec160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:05.308 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.301+0000 7f7424939800 1 --2- 172.21.15.142:0/3734688183 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55732f9ebd40 0x55732f9ec160 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x55732f9d2100 tx=0x7f74180167b0 comp rx=0 tx=0).stop 2024-09-22T08:37:05.308 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.301+0000 7f7424939800 1 -- 172.21.15.142:0/3734688183 shutdown_connections 2024-09-22T08:37:05.308 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.301+0000 7f7424939800 1 --2- 172.21.15.142:0/3734688183 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f72f803cfb0 0x7f72f803f470 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:05.308 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.301+0000 7f7424939800 1 --2- 172.21.15.142:0/3734688183 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55732f9ebd40 0x55732f9ec160 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:05.309 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.302+0000 7f7424939800 1 -- 172.21.15.142:0/3734688183 >> 172.21.15.142:0/3734688183 conn(0x55732f9e00f0 msgr2=0x55732f9e04d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:37:05.309 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.302+0000 7f7424939800 1 -- 172.21.15.142:0/3734688183 shutdown_connections 2024-09-22T08:37:05.309 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.302+0000 7f7424939800 1 -- 172.21.15.142:0/3734688183 wait complete. 2024-09-22T08:37:05.309 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.302+0000 7f7424939800 1 -- 172.21.15.142:0/61988549 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55732f8ddc00 msgr2=0x55732f9d8390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:05.309 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.302+0000 7f7424939800 1 --2- 172.21.15.142:0/61988549 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55732f8ddc00 0x55732f9d8390 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:05.309 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.302+0000 7f7424939800 1 -- 172.21.15.142:0/61988549 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55732f9da7b0 msgr2=0x55732f9dcc20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:05.309 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.302+0000 7f7424939800 1 --2- 172.21.15.142:0/61988549 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55732f9da7b0 0x55732f9dcc20 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:05.309 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.302+0000 7f7424939800 1 -- 172.21.15.142:0/61988549 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f730803cfb0 msgr2=0x7f730803f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:05.309 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.302+0000 7f7424939800 1 --2- 172.21.15.142:0/61988549 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f730803cfb0 0x7f730803f470 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f7408057000 tx=0x7f7408052000 comp rx=0 tx=0).stop 2024-09-22T08:37:05.309 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.302+0000 7f7424939800 1 -- 172.21.15.142:0/61988549 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55732f84b530 msgr2=0x55732f9d0d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:05.309 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.302+0000 7f7424939800 1 --2- 172.21.15.142:0/61988549 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55732f84b530 0x55732f9d0d40 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x55732f9ca1c0 tx=0x7f7410000bc0 comp rx=0 tx=0).stop 2024-09-22T08:37:05.309 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.302+0000 7f7424939800 1 -- 172.21.15.142:0/61988549 shutdown_connections 2024-09-22T08:37:05.309 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.302+0000 7f7424939800 1 --2- 172.21.15.142:0/61988549 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55732f9da7b0 0x55732f9dcc20 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:05.309 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.302+0000 7f7424939800 1 --2- 172.21.15.142:0/61988549 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55732f8ddc00 0x55732f9d8390 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:05.310 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.302+0000 7f7424939800 1 --2- 172.21.15.142:0/61988549 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f730803cfb0 0x7f730803f470 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:05.310 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.302+0000 7f7424939800 1 --2- 172.21.15.142:0/61988549 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55732f84b530 0x55732f9d0d40 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:05.310 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.302+0000 7f7424939800 1 -- 172.21.15.142:0/61988549 >> 172.21.15.142:0/61988549 conn(0x55732f8d1be0 msgr2=0x55732f9ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:37:05.310 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.302+0000 7f7424939800 1 -- 172.21.15.142:0/61988549 shutdown_connections 2024-09-22T08:37:05.310 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.302+0000 7f7424939800 1 -- 172.21.15.142:0/61988549 wait complete. 2024-09-22T08:37:05.312 INFO:teuthology.orchestra.run.smithi142.stdout:fooFoofooFooFULL_CONTROL 2024-09-22T08:37:05.312 DEBUG:tasks.util.rgw: raw result: fooFoofooFooFULL_CONTROL 2024-09-22T08:37:05.314 INFO:tasks.radosgw_admin:RL: get_acls myfoo foo bytes_out=0 bytes_in=417 failed=False 2024-09-22T08:37:05.319 INFO:tasks.radosgw_admin:RL: put_acls myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-22T08:37:05.319 INFO:tasks.util.rgw:rgwadmin: client.0 : ['policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-09-22T08:37:05.319 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'xml', '-n', 'client.0', '--cluster', 'ceph', 'policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-09-22T08:37:05.319 DEBUG:teuthology.orchestra.run.smithi142:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format xml -n client.0 --cluster ceph policy --bucket myfoo --object bb3aec0fdcdbc2974890f805c585d432 2024-09-22T08:37:05.364 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:37:05.364 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:37:05.365 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.363+0000 7fa96092e800 1 Processor -- start 2024-09-22T08:37:05.365 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.364+0000 7fa96092e800 1 -- start start 2024-09-22T08:37:05.365 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.364+0000 7fa96092e800 1 --2- >> v2:172.21.15.31:3300/0 conn(0x56315bc9b7e0 0x56315bc9c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:05.365 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.364+0000 7fa96092e800 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56315bb27a20 con 0x56315bc9ca20 2024-09-22T08:37:05.365 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.364+0000 7fa96092e800 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x56315bb277d0 con 0x56315bc9b7e0 2024-09-22T08:37:05.366 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.364+0000 7fa95c6dd640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x56315bc9b7e0 0x56315bc9c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:05.366 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.364+0000 7fa95bedc640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x56315bc9ca20 0x56315bca1570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.142:56360/0 (socket says 172.21.15.142:56360) 2024-09-22T08:37:05.366 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.364+0000 7fa95bedc640 1 -- 172.21.15.142:0/1558447109 learned_addr learned my addr 172.21.15.142:0/1558447109 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-09-22T08:37:05.366 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.364+0000 7fa95c6dd640 1 -- 172.21.15.142:0/1558447109 >> v1:172.21.15.31:6789/0 conn(0x56315bc9ca20 legacy=0x56315bca1570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:05.366 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.364+0000 7fa95c6dd640 1 -- 172.21.15.142:0/1558447109 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56315bc9bee0 con 0x56315bc9b7e0 2024-09-22T08:37:05.367 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.366+0000 7fa95c6dd640 1 --2- 172.21.15.142:0/1558447109 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56315bc9b7e0 0x56315bc9c4e0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fa94c00a470 tx=0x7fa94c045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a45159332047ccd server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:05.367 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.366+0000 7fa95b6db640 1 -- 172.21.15.142:0/1558447109 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa94c053570 con 0x56315bc9b7e0 2024-09-22T08:37:05.368 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.366+0000 7fa95b6db640 1 -- 172.21.15.142:0/1558447109 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa94c058070 con 0x56315bc9b7e0 2024-09-22T08:37:05.368 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.366+0000 7fa95b6db640 1 -- 172.21.15.142:0/1558447109 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa94c053880 con 0x56315bc9b7e0 2024-09-22T08:37:05.368 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.367+0000 7fa96092e800 1 -- 172.21.15.142:0/1558447109 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56315bc9b7e0 msgr2=0x56315bc9c4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:05.368 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.367+0000 7fa96092e800 1 --2- 172.21.15.142:0/1558447109 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56315bc9b7e0 0x56315bc9c4e0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fa94c00a470 tx=0x7fa94c045a20 comp rx=0 tx=0).stop 2024-09-22T08:37:05.369 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.367+0000 7fa96092e800 1 -- 172.21.15.142:0/1558447109 shutdown_connections 2024-09-22T08:37:05.369 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.367+0000 7fa96092e800 1 --2- 172.21.15.142:0/1558447109 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56315bc9b7e0 0x56315bc9c4e0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:05.369 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.367+0000 7fa96092e800 1 -- 172.21.15.142:0/1558447109 >> 172.21.15.142:0/1558447109 conn(0x56315bc96bb0 msgr2=0x56315bc99010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:37:05.369 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.367+0000 7fa96092e800 1 -- 172.21.15.142:0/1558447109 shutdown_connections 2024-09-22T08:37:05.369 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.367+0000 7fa96092e800 1 -- 172.21.15.142:0/1558447109 wait complete. 2024-09-22T08:37:05.383 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.381+0000 7fa96092e800 1 Processor -- start 2024-09-22T08:37:05.383 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.381+0000 7fa96092e800 1 -- start start 2024-09-22T08:37:05.383 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.381+0000 7fa96092e800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56315bc9b7e0 0x56315bc0f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:05.383 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.381+0000 7fa96092e800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x56315bb34dd0 con 0x56315bc9b7e0 2024-09-22T08:37:05.383 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.381+0000 7fa95c6dd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56315bc9b7e0 0x56315bc0f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:05.383 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.381+0000 7fa95c6dd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56315bc9b7e0 0x56315bc0f9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:59476/0 (socket says 172.21.15.142:59476) 2024-09-22T08:37:05.383 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.381+0000 7fa95c6dd640 1 -- 172.21.15.142:0/3405443575 learned_addr learned my addr 172.21.15.142:0/3405443575 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:37:05.383 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.381+0000 7fa95c6dd640 1 -- 172.21.15.142:0/3405443575 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56315bd8ec30 con 0x56315bc9b7e0 2024-09-22T08:37:05.383 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.382+0000 7fa95c6dd640 1 --2- 172.21.15.142:0/3405443575 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56315bc9b7e0 0x56315bc0f9b0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fa94c025c20 tx=0x7fa94c051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c47ce47335043c47 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:05.383 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.382+0000 7fa84a60c640 1 -- 172.21.15.142:0/3405443575 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa94c053a20 con 0x56315bc9b7e0 2024-09-22T08:37:05.384 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.382+0000 7fa84a60c640 1 -- 172.21.15.142:0/3405443575 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa94c063070 con 0x56315bc9b7e0 2024-09-22T08:37:05.384 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.382+0000 7fa84a60c640 1 -- 172.21.15.142:0/3405443575 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa94c053cf0 con 0x56315bc9b7e0 2024-09-22T08:37:05.385 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.382+0000 7fa96092e800 1 -- 172.21.15.142:0/3405443575 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56315bc9b7e0 msgr2=0x56315bc0f9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:05.385 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.382+0000 7fa96092e800 1 --2- 172.21.15.142:0/3405443575 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56315bc9b7e0 0x56315bc0f9b0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fa94c025c20 tx=0x7fa94c051000 comp rx=0 tx=0).stop 2024-09-22T08:37:05.386 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.383+0000 7fa96092e800 1 -- 172.21.15.142:0/3405443575 shutdown_connections 2024-09-22T08:37:05.386 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.383+0000 7fa96092e800 1 --2- 172.21.15.142:0/3405443575 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56315bc9b7e0 0x56315bc0f9b0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:05.386 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.383+0000 7fa96092e800 1 -- 172.21.15.142:0/3405443575 >> 172.21.15.142:0/3405443575 conn(0x56315bc96bb0 msgr2=0x56315bd868f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:37:05.386 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.383+0000 7fa96092e800 1 -- 172.21.15.142:0/3405443575 shutdown_connections 2024-09-22T08:37:05.386 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.383+0000 7fa96092e800 1 -- 172.21.15.142:0/3405443575 wait complete. 2024-09-22T08:37:05.386 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.383+0000 7fa96092e800 1 Processor -- start 2024-09-22T08:37:05.386 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.383+0000 7fa96092e800 1 -- start start 2024-09-22T08:37:05.386 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.383+0000 7fa96092e800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56315bc9b7e0 0x56315bd8c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:05.386 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.383+0000 7fa96092e800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x56315bc9d290 con 0x56315bc9b7e0 2024-09-22T08:37:05.386 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.383+0000 7fa95c6dd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56315bc9b7e0 0x56315bd8c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:05.386 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.383+0000 7fa95c6dd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56315bc9b7e0 0x56315bd8c340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:59492/0 (socket says 172.21.15.142:59492) 2024-09-22T08:37:05.386 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.383+0000 7fa95c6dd640 1 -- 172.21.15.142:0/1369271953 learned_addr learned my addr 172.21.15.142:0/1369271953 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:37:05.386 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.384+0000 7fa95c6dd640 1 -- 172.21.15.142:0/1369271953 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56315bd8c8a0 con 0x56315bc9b7e0 2024-09-22T08:37:05.387 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.384+0000 7fa95c6dd640 1 --2- 172.21.15.142:0/1369271953 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56315bc9b7e0 0x56315bd8c340 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fa94c025c20 tx=0x7fa94c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:05.387 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.384+0000 7fa848e09640 1 -- 172.21.15.142:0/1369271953 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa94c06c030 con 0x56315bc9b7e0 2024-09-22T08:37:05.387 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.384+0000 7fa848e09640 1 -- 172.21.15.142:0/1369271953 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa94c068660 con 0x56315bc9b7e0 2024-09-22T08:37:05.387 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.384+0000 7fa96092e800 1 -- 172.21.15.142:0/1369271953 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56315bd8ac50 con 0x56315bc9b7e0 2024-09-22T08:37:05.387 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.384+0000 7fa848e09640 1 -- 172.21.15.142:0/1369271953 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa94c068940 con 0x56315bc9b7e0 2024-09-22T08:37:05.387 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.384+0000 7fa96092e800 1 -- 172.21.15.142:0/1369271953 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56315bd8b210 con 0x56315bc9b7e0 2024-09-22T08:37:05.389 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.385+0000 7fa848e09640 1 -- 172.21.15.142:0/1369271953 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fa94c068ae0 con 0x56315bc9b7e0 2024-09-22T08:37:05.389 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.385+0000 7fa848e09640 1 --2- 172.21.15.142:0/1369271953 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fa84403cfb0 0x7fa84403f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:05.390 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.385+0000 7fa848e09640 1 -- 172.21.15.142:0/1369271953 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5938+0+0 (secure 0 0 0) 0x7fa94c098ab0 con 0x56315bc9b7e0 2024-09-22T08:37:05.390 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.385+0000 7fa95bedc640 1 --2- 172.21.15.142:0/1369271953 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fa84403cfb0 0x7fa84403f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:05.390 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.385+0000 7fa96092e800 1 --2- 172.21.15.142:0/1369271953 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x56315bc9ca20 0x56315bd9cf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:05.390 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.385+0000 7fa96092e800 1 -- 172.21.15.142:0/1369271953 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56315bd9d4d0 con 0x56315bc9ca20 2024-09-22T08:37:05.390 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.385+0000 7fa95cede640 1 --2- 172.21.15.142:0/1369271953 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x56315bc9ca20 0x56315bd9cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:05.390 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.386+0000 7fa95bedc640 1 --2- 172.21.15.142:0/1369271953 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fa84403cfb0 0x7fa84403f470 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fa944001d70 tx=0x7fa9440012d0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:05.390 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.386+0000 7fa95cede640 1 --2- 172.21.15.142:0/1369271953 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x56315bc9ca20 0x56315bd9cf90 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:05.390 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.386+0000 7fa95cede640 1 -- 172.21.15.142:0/1369271953 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa95400a4d0 con 0x56315bc9ca20 2024-09-22T08:37:05.390 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.386+0000 7fa96092e800 1 -- 172.21.15.142:0/1369271953 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56315bd9dd90 con 0x56315bc9ca20 2024-09-22T08:37:05.390 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.386+0000 7fa95cede640 1 -- 172.21.15.142:0/1369271953 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa95400a4d0 con 0x56315bc9ca20 2024-09-22T08:37:05.390 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.386+0000 7fa96092e800 1 --2- 172.21.15.142:0/1369271953 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x56315bd9f6a0 0x56315bda1b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:05.390 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.386+0000 7fa96092e800 1 -- 172.21.15.142:0/1369271953 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:3 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56315bda22d0 con 0x56315bd9f6a0 2024-09-22T08:37:05.390 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.386+0000 7fa95c6dd640 1 --2- 172.21.15.142:0/1369271953 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x56315bd9f6a0 0x56315bda1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:05.390 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.387+0000 7fa95c6dd640 1 --2- 172.21.15.142:0/1369271953 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x56315bd9f6a0 0x56315bda1b40 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:05.391 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.387+0000 7fa95c6dd640 1 -- 172.21.15.142:0/1369271953 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(3 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fa94c051070 con 0x56315bd9f6a0 2024-09-22T08:37:05.391 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.387+0000 7fa96092e800 1 -- 172.21.15.142:0/1369271953 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56315bd9e5e0 con 0x56315bc9ca20 2024-09-22T08:37:05.391 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.387+0000 7fa95cede640 1 -- 172.21.15.142:0/1369271953 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa95400a4d0 con 0x56315bc9ca20 2024-09-22T08:37:05.391 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.387+0000 7fa96092e800 1 -- 172.21.15.142:0/1369271953 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56315bd9e9c0 con 0x56315bd9f6a0 2024-09-22T08:37:05.391 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.388+0000 7fa95c6dd640 1 -- 172.21.15.142:0/1369271953 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(5 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fa94c051070 con 0x56315bd9f6a0 2024-09-22T08:37:05.391 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.388+0000 7fa96092e800 1 Processor -- start 2024-09-22T08:37:05.391 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.388+0000 7fa96092e800 1 -- start start 2024-09-22T08:37:05.391 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.388+0000 7fa96092e800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56315bdb0c60 0x56315bdb1080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:05.391 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.388+0000 7fa96092e800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x56315bb93d50 con 0x56315bdb0c60 2024-09-22T08:37:05.391 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.388+0000 7fa95cede640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56315bdb0c60 0x56315bdb1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:05.391 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.388+0000 7fa95cede640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56315bdb0c60 0x56315bdb1080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:59504/0 (socket says 172.21.15.142:59504) 2024-09-22T08:37:05.391 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.388+0000 7fa95cede640 1 -- 172.21.15.142:0/3523404089 learned_addr learned my addr 172.21.15.142:0/3523404089 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:37:05.396 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.389+0000 7fa95cede640 1 -- 172.21.15.142:0/3523404089 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56315bdb16c0 con 0x56315bdb0c60 2024-09-22T08:37:05.396 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.389+0000 7fa95cede640 1 --2- 172.21.15.142:0/3523404089 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56315bdb0c60 0x56315bdb1080 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x56315bd8bee0 tx=0x7fa9540167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:05.396 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.389+0000 7fa841ffb640 1 -- 172.21.15.142:0/3523404089 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa954013640 con 0x56315bdb0c60 2024-09-22T08:37:05.396 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.389+0000 7fa841ffb640 1 -- 172.21.15.142:0/3523404089 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9540137e0 con 0x56315bdb0c60 2024-09-22T08:37:05.396 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.389+0000 7fa96092e800 1 -- 172.21.15.142:0/3523404089 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56315bdb1ef0 con 0x56315bdb0c60 2024-09-22T08:37:05.396 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.389+0000 7fa841ffb640 1 -- 172.21.15.142:0/3523404089 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa954013ae0 con 0x56315bdb0c60 2024-09-22T08:37:05.396 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.389+0000 7fa96092e800 1 -- 172.21.15.142:0/3523404089 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56315bdb2490 con 0x56315bdb0c60 2024-09-22T08:37:05.396 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.390+0000 7fa841ffb640 1 -- 172.21.15.142:0/3523404089 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fa954011040 con 0x56315bdb0c60 2024-09-22T08:37:05.396 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.390+0000 7fa841ffb640 1 --2- 172.21.15.142:0/3523404089 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fa83403d000 0x7fa83403f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:05.396 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.390+0000 7fa841ffb640 1 -- 172.21.15.142:0/3523404089 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5938+0+0 (secure 0 0 0) 0x7fa95400e040 con 0x56315bdb0c60 2024-09-22T08:37:05.396 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.390+0000 7fa95c6dd640 1 --2- 172.21.15.142:0/3523404089 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fa83403d000 0x7fa83403f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:05.396 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.390+0000 7fa96092e800 1 Processor -- start 2024-09-22T08:37:05.397 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.390+0000 7fa95c6dd640 1 --2- 172.21.15.142:0/3523404089 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fa83403d000 0x7fa83403f4c0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fa94c07bb60 tx=0x7fa94c07b9a0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:05.397 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.391+0000 7fa96092e800 1 -- start start 2024-09-22T08:37:05.397 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.391+0000 7fa96092e800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56315bdbd720 0x56315bdbdb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:05.397 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.391+0000 7fa96092e800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x56315bd8eeb0 con 0x56315bdbd720 2024-09-22T08:37:05.397 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.391+0000 7fa95cede640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56315bdbd720 0x56315bdbdb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:05.397 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.391+0000 7fa95cede640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56315bdbd720 0x56315bdbdb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:59518/0 (socket says 172.21.15.142:59518) 2024-09-22T08:37:05.397 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.391+0000 7fa95cede640 1 -- 172.21.15.142:0/1342878580 learned_addr learned my addr 172.21.15.142:0/1342878580 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:37:05.397 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.391+0000 7fa95cede640 1 -- 172.21.15.142:0/1342878580 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56315bdbe110 con 0x56315bdbd720 2024-09-22T08:37:05.397 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.391+0000 7fa95cede640 1 --2- 172.21.15.142:0/1342878580 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56315bdbd720 0x56315bdbdb20 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fa954054860 tx=0x7fa95401f400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae0e362995d5a439 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:05.397 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.391+0000 7fa83b7fe640 1 -- 172.21.15.142:0/1342878580 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa954044030 con 0x56315bdbd720 2024-09-22T08:37:05.397 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.391+0000 7fa83b7fe640 1 -- 172.21.15.142:0/1342878580 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa954021e20 con 0x56315bdbd720 2024-09-22T08:37:05.397 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.391+0000 7fa83b7fe640 1 -- 172.21.15.142:0/1342878580 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa95404de60 con 0x56315bdbd720 2024-09-22T08:37:05.397 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.392+0000 7fa96092e800 1 -- 172.21.15.142:0/1342878580 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56315bdbd720 msgr2=0x56315bdbdb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:05.397 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.392+0000 7fa96092e800 1 --2- 172.21.15.142:0/1342878580 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56315bdbd720 0x56315bdbdb20 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fa954054860 tx=0x7fa95401f400 comp rx=0 tx=0).stop 2024-09-22T08:37:05.398 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.392+0000 7fa96092e800 1 -- 172.21.15.142:0/1342878580 shutdown_connections 2024-09-22T08:37:05.398 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.392+0000 7fa96092e800 1 --2- 172.21.15.142:0/1342878580 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56315bdbd720 0x56315bdbdb20 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:05.398 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.392+0000 7fa96092e800 1 -- 172.21.15.142:0/1342878580 >> 172.21.15.142:0/1342878580 conn(0x56315bdb9b40 msgr2=0x56315bdb7d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:37:05.398 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.392+0000 7fa96092e800 1 -- 172.21.15.142:0/1342878580 shutdown_connections 2024-09-22T08:37:05.398 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.392+0000 7fa96092e800 1 -- 172.21.15.142:0/1342878580 wait complete. 2024-09-22T08:37:05.398 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.392+0000 7fa96092e800 1 Processor -- start 2024-09-22T08:37:05.398 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.392+0000 7fa96092e800 1 -- start start 2024-09-22T08:37:05.398 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.392+0000 7fa96092e800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56315bdbd720 0x56315bdc4d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:05.398 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.392+0000 7fa96092e800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x56315bdbe730 con 0x56315bdbd720 2024-09-22T08:37:05.398 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.392+0000 7fa95cede640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56315bdbd720 0x56315bdc4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:05.398 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.392+0000 7fa95cede640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56315bdbd720 0x56315bdc4d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:59526/0 (socket says 172.21.15.142:59526) 2024-09-22T08:37:05.398 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.392+0000 7fa95cede640 1 -- 172.21.15.142:0/3813133965 learned_addr learned my addr 172.21.15.142:0/3813133965 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:37:05.398 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.393+0000 7fa95cede640 1 -- 172.21.15.142:0/3813133965 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56315bdc52b0 con 0x56315bdbd720 2024-09-22T08:37:05.399 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.393+0000 7fa95cede640 1 --2- 172.21.15.142:0/3813133965 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56315bdbd720 0x56315bdc4d50 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fa954054790 tx=0x7fa9540547c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:05.399 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.393+0000 7fa839ffb640 1 -- 172.21.15.142:0/3813133965 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa954021570 con 0x56315bdbd720 2024-09-22T08:37:05.399 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.393+0000 7fa839ffb640 1 -- 172.21.15.142:0/3813133965 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9540143c0 con 0x56315bdbd720 2024-09-22T08:37:05.399 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.393+0000 7fa839ffb640 1 -- 172.21.15.142:0/3813133965 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa954020bd0 con 0x56315bdbd720 2024-09-22T08:37:05.399 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.393+0000 7fa96092e800 1 -- 172.21.15.142:0/3813133965 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56315bdc5540 con 0x56315bdbd720 2024-09-22T08:37:05.399 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.393+0000 7fa96092e800 1 -- 172.21.15.142:0/3813133965 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56315bdc5ec0 con 0x56315bdbd720 2024-09-22T08:37:05.399 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.394+0000 7fa839ffb640 1 -- 172.21.15.142:0/3813133965 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fa95401fa90 con 0x56315bdbd720 2024-09-22T08:37:05.399 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.394+0000 7fa839ffb640 1 --2- 172.21.15.142:0/3813133965 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fa82c03cf60 0x7fa82c03f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:05.399 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.394+0000 7fa839ffb640 1 -- 172.21.15.142:0/3813133965 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5938+0+0 (secure 0 0 0) 0x7fa95404b030 con 0x56315bdbd720 2024-09-22T08:37:05.399 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.394+0000 7fa95c6dd640 1 --2- 172.21.15.142:0/3813133965 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fa82c03cf60 0x7fa82c03f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:05.399 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.394+0000 7fa95c6dd640 1 --2- 172.21.15.142:0/3813133965 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fa82c03cf60 0x7fa82c03f420 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fa94c0075e0 tx=0x7fa94c081000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:05.399 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.395+0000 7fa96092e800 20 rados->read ofs=0 len=0 2024-09-22T08:37:05.399 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.395+0000 7fa96092e800 1 --2- 172.21.15.142:0/3813133965 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x56315bdd0650 0x56315bdd2b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:05.399 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.395+0000 7fa96092e800 1 -- 172.21.15.142:0/3813133965 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56315bdd3260 con 0x56315bdd0650 2024-09-22T08:37:05.400 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.395+0000 7fa95bedc640 1 --2- 172.21.15.142:0/3813133965 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x56315bdd0650 0x56315bdd2b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:05.410 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.395+0000 7fa95bedc640 1 --2- 172.21.15.142:0/3813133965 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x56315bdd0650 0x56315bdd2b10 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:05.410 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.395+0000 7fa95bedc640 1 -- 172.21.15.142:0/3813133965 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa944009050 con 0x56315bdd0650 2024-09-22T08:37:05.410 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.395+0000 7fa96092e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:05.410 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.395+0000 7fa96092e800 20 realm 2024-09-22T08:37:05.410 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.395+0000 7fa96092e800 20 rados->read ofs=0 len=0 2024-09-22T08:37:05.410 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.395+0000 7fa96092e800 1 -- 172.21.15.142:0/3813133965 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56315bdcf9a0 con 0x56315bdd0650 2024-09-22T08:37:05.410 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.396+0000 7fa95bedc640 1 -- 172.21.15.142:0/3813133965 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa944009050 con 0x56315bdd0650 2024-09-22T08:37:05.410 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.396+0000 7fa96092e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:05.410 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.396+0000 7fa96092e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:37:05.410 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.396+0000 7fa96092e800 20 rados->read ofs=0 len=0 2024-09-22T08:37:05.410 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.396+0000 7fa96092e800 1 -- 172.21.15.142:0/3813133965 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56315bdd3d50 con 0x56315bdd0650 2024-09-22T08:37:05.411 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.396+0000 7fa95bedc640 1 -- 172.21.15.142:0/3813133965 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa944009050 con 0x56315bdd0650 2024-09-22T08:37:05.411 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.396+0000 7fa96092e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:05.411 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.396+0000 7fa96092e800 20 rados->read ofs=0 len=0 2024-09-22T08:37:05.411 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.396+0000 7fa96092e800 1 -- 172.21.15.142:0/3813133965 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56315bdd4620 con 0x56315bdd0650 2024-09-22T08:37:05.411 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.396+0000 7fa95bedc640 1 -- 172.21.15.142:0/3813133965 <== osd.1 v2:172.21.15.142:6816/3192108003 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa944009050 con 0x56315bdd0650 2024-09-22T08:37:05.411 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.396+0000 7fa96092e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:37:05.411 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.396+0000 7fa96092e800 20 rados->read ofs=0 len=0 2024-09-22T08:37:05.411 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.396+0000 7fa96092e800 1 --2- 172.21.15.142:0/3813133965 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x56315bdd5040 0x56315bdd7430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:05.411 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.396+0000 7fa96092e800 1 -- 172.21.15.142:0/3813133965 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56315bdd7b70 con 0x56315bdd5040 2024-09-22T08:37:05.411 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.396+0000 7fa95cede640 1 --2- 172.21.15.142:0/3813133965 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x56315bdd5040 0x56315bdd7430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:05.411 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.396+0000 7fa95cede640 1 --2- 172.21.15.142:0/3813133965 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x56315bdd5040 0x56315bdd7430 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:05.411 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.397+0000 7fa95cede640 1 -- 172.21.15.142:0/3813133965 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(5 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fa95403a070 con 0x56315bdd5040 2024-09-22T08:37:05.411 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.397+0000 7fa96092e800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:37:05.411 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.397+0000 7fa96092e800 20 searching for the correct realm 2024-09-22T08:37:05.412 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.397+0000 7fa96092e800 1 -- 172.21.15.142:0/3813133965 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56315bdd94a0 con 0x56315bdd5040 2024-09-22T08:37:05.412 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.397+0000 7fa95cede640 1 -- 172.21.15.142:0/3813133965 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa95403a070 con 0x56315bdd5040 2024-09-22T08:37:05.412 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.397+0000 7fa95cede640 1 --2- 172.21.15.142:0/3813133965 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7fa954011b10 0x7fa954045130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:05.412 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.397+0000 7fa95cede640 1 -- 172.21.15.142:0/3813133965 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56315bdd94a0 con 0x7fa954011b10 2024-09-22T08:37:05.412 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.397+0000 7fa95c6dd640 1 --2- 172.21.15.142:0/3813133965 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7fa954011b10 0x7fa954045130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:05.412 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.397+0000 7fa95c6dd640 1 --2- 172.21.15.142:0/3813133965 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7fa954011b10 0x7fa954045130 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:05.412 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.398+0000 7fa95c6dd640 1 -- 172.21.15.142:0/3813133965 <== osd.2 v2:172.21.15.142:6808/279438927 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa94c051070 con 0x7fa954011b10 2024-09-22T08:37:05.412 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.398+0000 7fa95c6dd640 1 --2- 172.21.15.142:0/3813133965 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7fa94c05f040 0x7fa94c05f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:05.412 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.398+0000 7fa95c6dd640 1 -- 172.21.15.142:0/3813133965 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56315bdd94a0 con 0x7fa94c05f040 2024-09-22T08:37:05.412 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.398+0000 7fa95bedc640 1 --2- 172.21.15.142:0/3813133965 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7fa94c05f040 0x7fa94c05f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:05.412 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.398+0000 7fa95bedc640 1 --2- 172.21.15.142:0/3813133965 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7fa94c05f040 0x7fa94c05f420 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:05.412 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.398+0000 7fa95bedc640 1 -- 172.21.15.142:0/3813133965 <== osd.0 v2:172.21.15.31:6800/168281188 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa944009050 con 0x7fa94c05f040 2024-09-22T08:37:05.412 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.398+0000 7fa95bedc640 1 -- 172.21.15.142:0/3813133965 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56315bdd94a0 con 0x56315bdd0650 2024-09-22T08:37:05.412 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.399+0000 7fa95bedc640 1 -- 172.21.15.142:0/3813133965 <== osd.1 v2:172.21.15.142:6816/3192108003 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa944009050 con 0x56315bdd0650 2024-09-22T08:37:05.413 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.399+0000 7fa95bedc640 1 -- 172.21.15.142:0/3813133965 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56315bdd94a0 con 0x56315bdd0650 2024-09-22T08:37:05.413 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.399+0000 7fa95bedc640 1 -- 172.21.15.142:0/3813133965 <== osd.1 v2:172.21.15.142:6816/3192108003 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa944029040 con 0x56315bdd0650 2024-09-22T08:37:05.413 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.399+0000 7fa95bedc640 1 -- 172.21.15.142:0/3813133965 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56315bdd94a0 con 0x56315bdd0650 2024-09-22T08:37:05.413 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.399+0000 7fa95bedc640 1 -- 172.21.15.142:0/3813133965 <== osd.1 v2:172.21.15.142:6816/3192108003 7 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa944029040 con 0x56315bdd0650 2024-09-22T08:37:05.413 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.399+0000 7fa95bedc640 1 -- 172.21.15.142:0/3813133965 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56315bdd94a0 con 0x7fa94c05f040 2024-09-22T08:37:05.413 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.399+0000 7fa95bedc640 1 -- 172.21.15.142:0/3813133965 <== osd.0 v2:172.21.15.31:6800/168281188 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa944029040 con 0x7fa94c05f040 2024-09-22T08:37:05.413 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.399+0000 7fa95bedc640 1 -- 172.21.15.142:0/3813133965 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56315bdd94a0 con 0x7fa954011b10 2024-09-22T08:37:05.413 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.400+0000 7fa95c6dd640 1 -- 172.21.15.142:0/3813133965 <== osd.2 v2:172.21.15.142:6808/279438927 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa94c051070 con 0x7fa954011b10 2024-09-22T08:37:05.413 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.400+0000 7fa95c6dd640 1 -- 172.21.15.142:0/3813133965 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56315bdd94a0 con 0x56315bdd5040 2024-09-22T08:37:05.413 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.400+0000 7fa95cede640 1 -- 172.21.15.142:0/3813133965 <== osd.3 v2:172.21.15.142:6800/1064901393 3 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa95403a070 con 0x56315bdd5040 2024-09-22T08:37:05.413 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.400+0000 7fa95cede640 1 -- 172.21.15.142:0/3813133965 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56315bdd94a0 con 0x56315bdd0650 2024-09-22T08:37:05.413 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.400+0000 7fa95bedc640 1 -- 172.21.15.142:0/3813133965 <== osd.1 v2:172.21.15.142:6816/3192108003 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa944029040 con 0x56315bdd0650 2024-09-22T08:37:05.413 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.400+0000 7fa95bedc640 1 -- 172.21.15.142:0/3813133965 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56315bdd94a0 con 0x7fa94c05f040 2024-09-22T08:37:05.413 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.400+0000 7fa95bedc640 1 -- 172.21.15.142:0/3813133965 <== osd.0 v2:172.21.15.31:6800/168281188 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa944029040 con 0x7fa94c05f040 2024-09-22T08:37:05.414 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.400+0000 7fa95bedc640 1 -- 172.21.15.142:0/3813133965 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56315bdd94a0 con 0x56315bdd0650 2024-09-22T08:37:05.414 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.401+0000 7fa95bedc640 1 -- 172.21.15.142:0/3813133965 <== osd.1 v2:172.21.15.142:6816/3192108003 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa944029040 con 0x56315bdd0650 2024-09-22T08:37:05.414 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.401+0000 7fa95bedc640 1 -- 172.21.15.142:0/3813133965 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56315bdd94a0 con 0x7fa954011b10 2024-09-22T08:37:05.414 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.401+0000 7fa95c6dd640 1 -- 172.21.15.142:0/3813133965 <== osd.2 v2:172.21.15.142:6808/279438927 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fa94c051070 con 0x7fa954011b10 2024-09-22T08:37:05.414 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.401+0000 7fa95c6dd640 1 -- 172.21.15.142:0/3813133965 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56315bdd94a0 con 0x56315bdd5040 2024-09-22T08:37:05.414 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.401+0000 7fa95cede640 1 -- 172.21.15.142:0/3813133965 <== osd.3 v2:172.21.15.142:6800/1064901393 4 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa95403a070 con 0x56315bdd5040 2024-09-22T08:37:05.414 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.401+0000 7fa95cede640 1 -- 172.21.15.142:0/3813133965 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56315bdd94a0 con 0x56315bdd5040 2024-09-22T08:37:05.414 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.401+0000 7fa95cede640 1 -- 172.21.15.142:0/3813133965 <== osd.3 v2:172.21.15.142:6800/1064901393 5 ==== osd_op_reply(20 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fa95403a070 con 0x56315bdd5040 2024-09-22T08:37:05.414 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.401+0000 7fa95cede640 1 -- 172.21.15.142:0/3813133965 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56315bdd94a0 con 0x7fa94c05f040 2024-09-22T08:37:05.414 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.402+0000 7fa95bedc640 1 -- 172.21.15.142:0/3813133965 <== osd.0 v2:172.21.15.31:6800/168281188 4 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa944029040 con 0x7fa94c05f040 2024-09-22T08:37:05.414 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.402+0000 7fa95bedc640 1 -- 172.21.15.142:0/3813133965 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56315bdd94a0 con 0x56315bdd5040 2024-09-22T08:37:05.414 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.402+0000 7fa95cede640 1 -- 172.21.15.142:0/3813133965 <== osd.3 v2:172.21.15.142:6800/1064901393 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa95403a070 con 0x56315bdd5040 2024-09-22T08:37:05.414 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.402+0000 7fa95cede640 1 -- 172.21.15.142:0/3813133965 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56315bdd94a0 con 0x56315bdd5040 2024-09-22T08:37:05.415 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.402+0000 7fa95cede640 1 -- 172.21.15.142:0/3813133965 <== osd.3 v2:172.21.15.142:6800/1064901393 7 ==== osd_op_reply(23 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fa95403a070 con 0x56315bdd5040 2024-09-22T08:37:05.415 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.402+0000 7fa95cede640 1 -- 172.21.15.142:0/3813133965 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56315bdd94a0 con 0x56315bdd0650 2024-09-22T08:37:05.415 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.402+0000 7fa95bedc640 1 -- 172.21.15.142:0/3813133965 <== osd.1 v2:172.21.15.142:6816/3192108003 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa944029040 con 0x56315bdd0650 2024-09-22T08:37:05.415 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.402+0000 7fa95bedc640 1 -- 172.21.15.142:0/3813133965 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56315bdd94a0 con 0x56315bdd0650 2024-09-22T08:37:05.415 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.402+0000 7fa95bedc640 1 -- 172.21.15.142:0/3813133965 <== osd.1 v2:172.21.15.142:6816/3192108003 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fa944029040 con 0x56315bdd0650 2024-09-22T08:37:05.415 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.402+0000 7fa95bedc640 1 -- 172.21.15.142:0/3813133965 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56315bdd94a0 con 0x7fa94c05f040 2024-09-22T08:37:05.415 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.403+0000 7fa95bedc640 1 -- 172.21.15.142:0/3813133965 <== osd.0 v2:172.21.15.31:6800/168281188 5 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa944029040 con 0x7fa94c05f040 2024-09-22T08:37:05.415 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.403+0000 7fa95bedc640 1 -- 172.21.15.142:0/3813133965 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56315bdd94a0 con 0x56315bdd5040 2024-09-22T08:37:05.415 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.403+0000 7fa95cede640 1 -- 172.21.15.142:0/3813133965 <== osd.3 v2:172.21.15.142:6800/1064901393 8 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa95403a070 con 0x56315bdd5040 2024-09-22T08:37:05.415 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.403+0000 7fa95cede640 1 -- 172.21.15.142:0/3813133965 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56315bdd94a0 con 0x7fa954011b10 2024-09-22T08:37:05.415 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.403+0000 7fa95c6dd640 1 -- 172.21.15.142:0/3813133965 <== osd.2 v2:172.21.15.142:6808/279438927 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa94c051070 con 0x7fa954011b10 2024-09-22T08:37:05.415 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.403+0000 7fa95c6dd640 1 -- 172.21.15.142:0/3813133965 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56315bdd94a0 con 0x56315bdd0650 2024-09-22T08:37:05.415 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.403+0000 7fa95bedc640 1 -- 172.21.15.142:0/3813133965 <== osd.1 v2:172.21.15.142:6816/3192108003 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa944029040 con 0x56315bdd0650 2024-09-22T08:37:05.415 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.403+0000 7fa95bedc640 1 -- 172.21.15.142:0/3813133965 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56315bdd94a0 con 0x7fa94c05f040 2024-09-22T08:37:05.416 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.404+0000 7fa95bedc640 1 -- 172.21.15.142:0/3813133965 <== osd.0 v2:172.21.15.31:6800/168281188 6 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa944029040 con 0x7fa94c05f040 2024-09-22T08:37:05.416 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.404+0000 7fa95bedc640 1 -- 172.21.15.142:0/3813133965 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56315bdd94a0 con 0x56315bdd5040 2024-09-22T08:37:05.416 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.404+0000 7fa95cede640 1 -- 172.21.15.142:0/3813133965 <== osd.3 v2:172.21.15.142:6800/1064901393 9 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa95403a070 con 0x56315bdd5040 2024-09-22T08:37:05.416 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.404+0000 7fa95cede640 1 -- 172.21.15.142:0/3813133965 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56315bdd94a0 con 0x7fa94c05f040 2024-09-22T08:37:05.416 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.404+0000 7fa95bedc640 1 -- 172.21.15.142:0/3813133965 <== osd.0 v2:172.21.15.31:6800/168281188 7 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa944029040 con 0x7fa94c05f040 2024-09-22T08:37:05.416 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.404+0000 7fa95bedc640 1 -- 172.21.15.142:0/3813133965 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56315bdd94a0 con 0x7fa954011b10 2024-09-22T08:37:05.416 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.404+0000 7fa95c6dd640 1 -- 172.21.15.142:0/3813133965 <== osd.2 v2:172.21.15.142:6808/279438927 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa94c051070 con 0x7fa954011b10 2024-09-22T08:37:05.416 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.404+0000 7fa95c6dd640 1 -- 172.21.15.142:0/3813133965 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56315bdd94a0 con 0x56315bdd5040 2024-09-22T08:37:05.416 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.405+0000 7fa95cede640 1 -- 172.21.15.142:0/3813133965 <== osd.3 v2:172.21.15.142:6800/1064901393 10 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa95403a070 con 0x56315bdd5040 2024-09-22T08:37:05.416 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.405+0000 7fa95cede640 1 -- 172.21.15.142:0/3813133965 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56315bdd94a0 con 0x7fa94c05f040 2024-09-22T08:37:05.416 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.405+0000 7fa95bedc640 1 -- 172.21.15.142:0/3813133965 <== osd.0 v2:172.21.15.31:6800/168281188 8 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa944029040 con 0x7fa94c05f040 2024-09-22T08:37:05.416 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.405+0000 7fa95bedc640 1 -- 172.21.15.142:0/3813133965 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56315bdd94a0 con 0x56315bdd0650 2024-09-22T08:37:05.416 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.405+0000 7fa95bedc640 1 -- 172.21.15.142:0/3813133965 <== osd.1 v2:172.21.15.142:6816/3192108003 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fa944029040 con 0x56315bdd0650 2024-09-22T08:37:05.416 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.405+0000 7fa95bedc640 1 -- 172.21.15.142:0/3813133965 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56315bdd94a0 con 0x7fa954011b10 2024-09-22T08:37:05.417 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.405+0000 7fa95c6dd640 1 -- 172.21.15.142:0/3813133965 <== osd.2 v2:172.21.15.142:6808/279438927 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa94c051070 con 0x7fa954011b10 2024-09-22T08:37:05.417 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.405+0000 7fa96092e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:37:05.417 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.405+0000 7fa96092e800 20 RGWRados::pool_iterate: got zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec 2024-09-22T08:37:05.417 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.405+0000 7fa96092e800 20 RGWRados::pool_iterate: got zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f 2024-09-22T08:37:05.417 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.405+0000 7fa96092e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:37:05.417 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.405+0000 7fa96092e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:37:05.417 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.405+0000 7fa96092e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:37:05.417 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.405+0000 7fa96092e800 20 rados->read ofs=0 len=0 2024-09-22T08:37:05.417 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.405+0000 7fa96092e800 1 -- 172.21.15.142:0/3813133965 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56315bdd8530 con 0x56315bdd0650 2024-09-22T08:37:05.417 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.406+0000 7fa95bedc640 1 -- 172.21.15.142:0/3813133965 <== osd.1 v2:172.21.15.142:6816/3192108003 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa944029040 con 0x56315bdd0650 2024-09-22T08:37:05.417 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.406+0000 7fa96092e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:05.417 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.406+0000 7fa96092e800 20 rados->read ofs=0 len=0 2024-09-22T08:37:05.417 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.406+0000 7fa96092e800 1 -- 172.21.15.142:0/3813133965 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56315bdd8d80 con 0x56315bdd0650 2024-09-22T08:37:05.417 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.406+0000 7fa95bedc640 1 -- 172.21.15.142:0/3813133965 <== osd.1 v2:172.21.15.142:6816/3192108003 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa944029040 con 0x56315bdd0650 2024-09-22T08:37:05.418 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.406+0000 7fa96092e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:37:05.418 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.406+0000 7fa96092e800 20 rados->read ofs=0 len=0 2024-09-22T08:37:05.418 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.406+0000 7fa96092e800 1 -- 172.21.15.142:0/3813133965 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:40 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56315bdd9920 con 0x56315bdd5040 2024-09-22T08:37:05.418 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.406+0000 7fa95cede640 1 -- 172.21.15.142:0/3813133965 <== osd.3 v2:172.21.15.142:6800/1064901393 11 ==== osd_op_reply(40 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fa95403a070 con 0x56315bdd5040 2024-09-22T08:37:05.418 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.406+0000 7fa96092e800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:37:05.418 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.406+0000 7fa96092e800 20 zone default found 2024-09-22T08:37:05.418 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.406+0000 7fa96092e800 4 Realm: () 2024-09-22T08:37:05.418 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.406+0000 7fa96092e800 4 ZoneGroup: default (d89f6f57-1007-47dd-9065-f486c7b01aec) 2024-09-22T08:37:05.418 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.406+0000 7fa96092e800 4 Zone: default (e239248c-0bee-4e41-803a-24b288d3eb8f) 2024-09-22T08:37:05.418 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.406+0000 7fa96092e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:37:05.418 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.406+0000 7fa96092e800 20 zonegroup default 2024-09-22T08:37:05.418 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.406+0000 7fa96092e800 20 rados->read ofs=0 len=0 2024-09-22T08:37:05.418 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.406+0000 7fa96092e800 1 -- 172.21.15.142:0/3813133965 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56315bdd9ce0 con 0x7fa94c05f040 2024-09-22T08:37:05.419 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.406+0000 7fa95bedc640 1 -- 172.21.15.142:0/3813133965 <== osd.0 v2:172.21.15.31:6800/168281188 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fa944029040 con 0x7fa94c05f040 2024-09-22T08:37:05.419 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.406+0000 7fa96092e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:05.419 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.406+0000 7fa96092e800 20 rados->read ofs=0 len=0 2024-09-22T08:37:05.419 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.406+0000 7fa96092e800 1 -- 172.21.15.142:0/3813133965 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56315bddbfc0 con 0x56315bdd5040 2024-09-22T08:37:05.419 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.407+0000 7fa95cede640 1 -- 172.21.15.142:0/3813133965 <== osd.3 v2:172.21.15.142:6800/1064901393 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa95403a070 con 0x56315bdd5040 2024-09-22T08:37:05.419 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.407+0000 7fa96092e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:05.419 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.407+0000 7fa96092e800 20 rados->read ofs=0 len=0 2024-09-22T08:37:05.419 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.407+0000 7fa96092e800 1 -- 172.21.15.142:0/3813133965 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56315bddc3b0 con 0x56315bdd5040 2024-09-22T08:37:05.419 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.407+0000 7fa95cede640 1 -- 172.21.15.142:0/3813133965 <== osd.3 v2:172.21.15.142:6800/1064901393 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa95403a070 con 0x56315bdd5040 2024-09-22T08:37:05.419 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.407+0000 7fa96092e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:05.419 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.407+0000 7fa96092e800 20 started sync module instance, tier type = 2024-09-22T08:37:05.419 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.407+0000 7fa96092e800 20 started zone id=e239248c-0bee-4e41-803a-24b288d3eb8f (name=default) with tier type = 2024-09-22T08:37:05.419 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.407+0000 7fa96092e800 1 -- 172.21.15.142:0/3813133965 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56315bddb450 con 0x7fa954011b10 2024-09-22T08:37:05.419 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.408+0000 7fa95c6dd640 1 -- 172.21.15.142:0/3813133965 <== osd.2 v2:172.21.15.142:6808/279438927 7 ==== osd_op_reply(44 notify.0 [create] v32'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa94c051070 con 0x7fa954011b10 2024-09-22T08:37:05.420 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.408+0000 7fa96092e800 1 -- 172.21.15.142:0/3813133965 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94769994643520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56315bddb0b0 con 0x7fa954011b10 2024-09-22T08:37:05.420 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.408+0000 7fa96092e800 1 -- 172.21.15.142:0/3813133965 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56315bddd2e0 con 0x56315bdd0650 2024-09-22T08:37:05.427 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.409+0000 7fa95bedc640 1 -- 172.21.15.142:0/3813133965 <== osd.1 v2:172.21.15.142:6816/3192108003 16 ==== osd_op_reply(46 notify.1 [create] v32'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa944029040 con 0x56315bdd0650 2024-09-22T08:37:05.427 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.409+0000 7fa96092e800 1 -- 172.21.15.142:0/3813133965 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94769994649616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56315bddda80 con 0x56315bdd0650 2024-09-22T08:37:05.427 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.409+0000 7fa96092e800 1 -- 172.21.15.142:0/3813133965 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56315bdde580 con 0x56315bdd5040 2024-09-22T08:37:05.427 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.409+0000 7fa95c6dd640 1 -- 172.21.15.142:0/3813133965 <== osd.2 v2:172.21.15.142:6808/279438927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94769994643520] v32'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa94c051070 con 0x7fa954011b10 2024-09-22T08:37:05.427 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.410+0000 7fa95cede640 1 -- 172.21.15.142:0/3813133965 <== osd.3 v2:172.21.15.142:6800/1064901393 14 ==== osd_op_reply(48 notify.2 [create] v32'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa95403a070 con 0x56315bdd5040 2024-09-22T08:37:05.427 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.410+0000 7fa96092e800 1 -- 172.21.15.142:0/3813133965 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94769994653808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56315bddda80 con 0x56315bdd5040 2024-09-22T08:37:05.427 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.410+0000 7fa96092e800 1 -- 172.21.15.142:0/3813133965 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56315bddf020 con 0x7fa954011b10 2024-09-22T08:37:05.427 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.410+0000 7fa95bedc640 1 -- 172.21.15.142:0/3813133965 <== osd.1 v2:172.21.15.142:6816/3192108003 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94769994649616] v32'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa944029040 con 0x56315bdd0650 2024-09-22T08:37:05.427 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.411+0000 7fa95cede640 1 -- 172.21.15.142:0/3813133965 <== osd.3 v2:172.21.15.142:6800/1064901393 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94769994653808] v32'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa95403a070 con 0x56315bdd5040 2024-09-22T08:37:05.427 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.411+0000 7fa95c6dd640 1 -- 172.21.15.142:0/3813133965 <== osd.2 v2:172.21.15.142:6808/279438927 9 ==== osd_op_reply(50 notify.3 [create] v32'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa94c051070 con 0x7fa954011b10 2024-09-22T08:37:05.427 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.411+0000 7fa96092e800 1 -- 172.21.15.142:0/3813133965 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94769994647568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56315bddefe0 con 0x7fa954011b10 2024-09-22T08:37:05.428 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.411+0000 7fa96092e800 1 -- 172.21.15.142:0/3813133965 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56315bddf8c0 con 0x56315bdd0650 2024-09-22T08:37:05.428 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.412+0000 7fa95bedc640 1 -- 172.21.15.142:0/3813133965 <== osd.1 v2:172.21.15.142:6816/3192108003 18 ==== osd_op_reply(52 notify.4 [create] v32'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa944029040 con 0x56315bdd0650 2024-09-22T08:37:05.428 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.412+0000 7fa96092e800 1 -- 172.21.15.142:0/3813133965 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94769994658832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56315bddfce0 con 0x56315bdd0650 2024-09-22T08:37:05.428 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.412+0000 7fa95c6dd640 1 -- 172.21.15.142:0/3813133965 <== osd.2 v2:172.21.15.142:6808/279438927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94769994647568] v32'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa94c051070 con 0x7fa954011b10 2024-09-22T08:37:05.428 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.412+0000 7fa96092e800 1 -- 172.21.15.142:0/3813133965 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56315bde0570 con 0x7fa94c05f040 2024-09-22T08:37:05.428 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.413+0000 7fa95bedc640 1 -- 172.21.15.142:0/3813133965 <== osd.0 v2:172.21.15.31:6800/168281188 10 ==== osd_op_reply(54 notify.5 [create] v32'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa944029040 con 0x7fa94c05f040 2024-09-22T08:37:05.428 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.413+0000 7fa95bedc640 1 -- 172.21.15.142:0/3813133965 <== osd.1 v2:172.21.15.142:6816/3192108003 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94769994658832] v32'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa944029040 con 0x56315bdd0650 2024-09-22T08:37:05.428 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.413+0000 7fa96092e800 1 -- 172.21.15.142:0/3813133965 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94769994656528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56315bde0190 con 0x7fa94c05f040 2024-09-22T08:37:05.428 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.413+0000 7fa96092e800 1 -- 172.21.15.142:0/3813133965 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56315bddf870 con 0x7fa94c05f040 2024-09-22T08:37:05.428 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.414+0000 7fa95bedc640 1 -- 172.21.15.142:0/3813133965 <== osd.0 v2:172.21.15.31:6800/168281188 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94769994656528] v32'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa944029040 con 0x7fa94c05f040 2024-09-22T08:37:05.428 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.415+0000 7fa95bedc640 1 -- 172.21.15.142:0/3813133965 <== osd.0 v2:172.21.15.31:6800/168281188 12 ==== osd_op_reply(56 notify.6 [create] v32'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa944029040 con 0x7fa94c05f040 2024-09-22T08:37:05.428 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.415+0000 7fa96092e800 1 -- 172.21.15.142:0/3813133965 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94769994661488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56315bddf870 con 0x7fa94c05f040 2024-09-22T08:37:05.428 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.415+0000 7fa96092e800 1 -- 172.21.15.142:0/3813133965 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56315bde1460 con 0x7fa94c05f040 2024-09-22T08:37:05.428 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.415+0000 7fa95bedc640 1 -- 172.21.15.142:0/3813133965 <== osd.0 v2:172.21.15.31:6800/168281188 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94769994661488] v32'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa944029040 con 0x7fa94c05f040 2024-09-22T08:37:05.429 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.416+0000 7fa95bedc640 1 -- 172.21.15.142:0/3813133965 <== osd.0 v2:172.21.15.31:6800/168281188 14 ==== osd_op_reply(58 notify.7 [create] v32'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa944029040 con 0x7fa94c05f040 2024-09-22T08:37:05.429 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.416+0000 7fa96092e800 1 -- 172.21.15.142:0/3813133965 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94769994664704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56315bde13d0 con 0x7fa94c05f040 2024-09-22T08:37:05.429 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.416+0000 7fa96092e800 20 add_watcher() i=0 2024-09-22T08:37:05.429 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.416+0000 7fa96092e800 20 add_watcher() i=1 2024-09-22T08:37:05.429 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.416+0000 7fa96092e800 20 add_watcher() i=2 2024-09-22T08:37:05.429 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.416+0000 7fa96092e800 20 add_watcher() i=3 2024-09-22T08:37:05.429 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.416+0000 7fa96092e800 20 add_watcher() i=4 2024-09-22T08:37:05.429 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.416+0000 7fa96092e800 20 add_watcher() i=5 2024-09-22T08:37:05.429 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.416+0000 7fa96092e800 20 add_watcher() i=6 2024-09-22T08:37:05.429 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.416+0000 7fa95bedc640 1 -- 172.21.15.142:0/3813133965 <== osd.0 v2:172.21.15.31:6800/168281188 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94769994664704] v32'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa944029040 con 0x7fa94c05f040 2024-09-22T08:37:05.429 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.416+0000 7fa96092e800 20 add_watcher() i=7 2024-09-22T08:37:05.429 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.416+0000 7fa96092e800 2 all 8 watchers are set, enabling cache 2024-09-22T08:37:05.429 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.417+0000 7fa96092e800 1 -- 172.21.15.142:0/3813133965 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56315bde4950 con 0x56315bdd0650 2024-09-22T08:37:05.429 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.417+0000 7fa95bedc640 1 -- 172.21.15.142:0/3813133965 <== osd.1 v2:172.21.15.142:6816/3192108003 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fa944029040 con 0x56315bdd0650 2024-09-22T08:37:05.430 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.417+0000 7fa96092e800 1 -- 172.21.15.142:0/3813133965 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94769994666688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56315bde1cb0 con 0x56315bdd0650 2024-09-22T08:37:05.430 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.418+0000 7fa95bedc640 1 -- 172.21.15.142:0/3813133965 <== osd.1 v2:172.21.15.142:6816/3192108003 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94769994666688] v32'180 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa944029040 con 0x56315bdd0650 2024-09-22T08:37:05.430 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.418+0000 7fa812fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:37:05.430 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.418+0000 7fa96092e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:37:05.430 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.418+0000 7fa96092e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:37:05.430 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.418+0000 7fa96092e800 5 note: GC not initialized 2024-09-22T08:37:05.430 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.418+0000 7fa811fe3640 20 reqs_thread_entry: start 2024-09-22T08:37:05.430 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.418+0000 7fa96092e800 20 init_complete bucket index max shards: 11 2024-09-22T08:37:05.430 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.418+0000 7fa96092e800 20 Filter name: none 2024-09-22T08:37:05.430 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.419+0000 7fa80affd640 20 reqs_thread_entry: start 2024-09-22T08:37:05.430 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.419+0000 7fa96092e800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-22T08:37:05.430 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.419+0000 7fa96092e800 20 rados->read ofs=0 len=0 2024-09-22T08:37:05.430 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.419+0000 7fa96092e800 1 -- 172.21.15.142:0/3813133965 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56315be18220 con 0x7fa954011b10 2024-09-22T08:37:05.431 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.419+0000 7fa95c6dd640 1 -- 172.21.15.142:0/3813133965 <== osd.2 v2:172.21.15.142:6808/279438927 11 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv33 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fa94c051070 con 0x7fa954011b10 2024-09-22T08:37:05.431 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.419+0000 7fa96092e800 20 rados_obj.operate() r=0 bl.length=165 2024-09-22T08:37:05.431 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.419+0000 7fa96092e800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-22T08:37:05.431 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.419+0000 7fa96092e800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-22T08:37:05.431 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.419+0000 7fa96092e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:e239248c-0bee-4e41-803a-24b288d3eb8f.4226.5 : miss 2024-09-22T08:37:05.431 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.419+0000 7fa96092e800 20 rados->read ofs=0 len=0 2024-09-22T08:37:05.431 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.419+0000 7fa96092e800 1 -- 172.21.15.142:0/3813133965 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:63 8.1d 8:b89fd42a:root::.bucket.meta.myfoo%3ae239248c-0bee-4e41-803a-24b288d3eb8f.4226.5:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56315be19e40 con 0x7fa94c05f040 2024-09-22T08:37:05.431 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.420+0000 7fa95bedc640 1 -- 172.21.15.142:0/3813133965 <== osd.0 v2:172.21.15.31:6800/168281188 16 ==== osd_op_reply(63 .bucket.meta.myfoo:e239248c-0bee-4e41-803a-24b288d3eb8f.4226.5 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7fa944029040 con 0x7fa94c05f040 2024-09-22T08:37:05.431 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.420+0000 7fa96092e800 20 rados_obj.operate() r=0 bl.length=387 2024-09-22T08:37:05.431 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.420+0000 7fa96092e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:e239248c-0bee-4e41-803a-24b288d3eb8f.4226.5 info.flags=0x17 2024-09-22T08:37:05.431 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.420+0000 7fa96092e800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:e239248c-0bee-4e41-803a-24b288d3eb8f.4226.5 to cache LRU end 2024-09-22T08:37:05.431 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.420+0000 7fa96092e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:37:05.431 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.420+0000 7fa96092e800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-22T08:37:05.431 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.420+0000 7fa96092e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:e239248c-0bee-4e41-803a-24b288d3eb8f.4226.5 2024-09-22T08:37:05.431 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.420+0000 7fa96092e800 20 get_obj_state: octx=0x7fa95401f880 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x56315be1c548 s->prefetch_data=0 2024-09-22T08:37:05.432 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.420+0000 7fa96092e800 1 -- 172.21.15.142:0/3813133965 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:64 3.3a 3:5da07612:::e239248c-0bee-4e41-803a-24b288d3eb8f.4226.5_bb3aec0fdcdbc2974890f805c585d432:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56315be1e6a0 con 0x7fa954011b10 2024-09-22T08:37:05.432 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.420+0000 7fa95c6dd640 1 -- 172.21.15.142:0/3813133965 <== osd.2 v2:172.21.15.142:6808/279438927 12 ==== osd_op_reply(64 e239248c-0bee-4e41-803a-24b288d3eb8f.4226.5_bb3aec0fdcdbc2974890f805c585d432 [call out=24b,getxattrs out=919b,stat out=16b] v0'0 uv3 ondisk = 0) ==== 304+0+959 (crc 0 0 0) 0x7fa94c051070 con 0x7fa954011b10 2024-09-22T08:37:05.432 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.420+0000 7fa96092e800 10 manifest: total_size = 5 2024-09-22T08:37:05.432 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.420+0000 7fa96092e800 20 get_obj_state: setting s->obj_tag to _z3ovj-gs1ORUxcb84k_78n2WxeQutKT 2024-09-22T08:37:05.432 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.421+0000 7fa812fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:37:05.432 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.421+0000 7fa96092e800 1 -- 172.21.15.142:0/3813133965 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94769994666688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56315be1e6a0 con 0x56315bdd0650 2024-09-22T08:37:05.432 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.422+0000 7fa95bedc640 1 -- 172.21.15.142:0/3813133965 <== osd.1 v2:172.21.15.142:6816/3192108003 22 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94769994666688] v32'181 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa944029040 con 0x56315bdd0650 2024-09-22T08:37:05.432 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.422+0000 7fa96092e800 1 -- 172.21.15.142:0/3813133965 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94769994643520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56315be1e6a0 con 0x7fa954011b10 2024-09-22T08:37:05.432 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.423+0000 7fa95c6dd640 1 -- 172.21.15.142:0/3813133965 <== osd.2 v2:172.21.15.142:6808/279438927 13 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94769994643520] v32'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa94c051070 con 0x7fa954011b10 2024-09-22T08:37:05.432 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.423+0000 7fa96092e800 20 remove_watcher() i=0 2024-09-22T08:37:05.432 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.423+0000 7fa96092e800 2 removed watcher, disabling cache 2024-09-22T08:37:05.432 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.423+0000 7fa96092e800 1 -- 172.21.15.142:0/3813133965 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94769994649616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56315be1e6a0 con 0x56315bdd0650 2024-09-22T08:37:05.432 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.424+0000 7fa95bedc640 1 -- 172.21.15.142:0/3813133965 <== osd.1 v2:172.21.15.142:6816/3192108003 23 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94769994649616] v32'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa944029040 con 0x56315bdd0650 2024-09-22T08:37:05.433 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.424+0000 7fa96092e800 20 remove_watcher() i=1 2024-09-22T08:37:05.433 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.424+0000 7fa96092e800 1 -- 172.21.15.142:0/3813133965 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94769994653808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56315be1e6a0 con 0x56315bdd5040 2024-09-22T08:37:05.433 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.425+0000 7fa95cede640 1 -- 172.21.15.142:0/3813133965 <== osd.3 v2:172.21.15.142:6800/1064901393 16 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94769994653808] v32'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa95403a070 con 0x56315bdd5040 2024-09-22T08:37:05.433 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.425+0000 7fa96092e800 20 remove_watcher() i=2 2024-09-22T08:37:05.433 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.425+0000 7fa96092e800 1 -- 172.21.15.142:0/3813133965 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94769994647568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56315be1e6a0 con 0x7fa954011b10 2024-09-22T08:37:05.436 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.426+0000 7fa95c6dd640 1 -- 172.21.15.142:0/3813133965 <== osd.2 v2:172.21.15.142:6808/279438927 14 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94769994647568] v32'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa94c051070 con 0x7fa954011b10 2024-09-22T08:37:05.436 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.426+0000 7fa96092e800 20 remove_watcher() i=3 2024-09-22T08:37:05.436 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.426+0000 7fa96092e800 1 -- 172.21.15.142:0/3813133965 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94769994658832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56315be1e6a0 con 0x56315bdd0650 2024-09-22T08:37:05.436 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.427+0000 7fa95bedc640 1 -- 172.21.15.142:0/3813133965 <== osd.1 v2:172.21.15.142:6816/3192108003 24 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94769994658832] v32'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa944029040 con 0x56315bdd0650 2024-09-22T08:37:05.437 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.427+0000 7fa96092e800 20 remove_watcher() i=4 2024-09-22T08:37:05.437 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.427+0000 7fa96092e800 1 -- 172.21.15.142:0/3813133965 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94769994656528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56315be1e6a0 con 0x7fa94c05f040 2024-09-22T08:37:05.437 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.428+0000 7fa95bedc640 1 -- 172.21.15.142:0/3813133965 <== osd.0 v2:172.21.15.31:6800/168281188 17 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94769994656528] v32'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa944029040 con 0x7fa94c05f040 2024-09-22T08:37:05.437 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.428+0000 7fa96092e800 20 remove_watcher() i=5 2024-09-22T08:37:05.437 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.428+0000 7fa96092e800 1 -- 172.21.15.142:0/3813133965 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94769994661488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56315be1e6a0 con 0x7fa94c05f040 2024-09-22T08:37:05.437 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.429+0000 7fa95bedc640 1 -- 172.21.15.142:0/3813133965 <== osd.0 v2:172.21.15.31:6800/168281188 18 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94769994661488] v32'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa944029040 con 0x7fa94c05f040 2024-09-22T08:37:05.437 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.429+0000 7fa96092e800 20 remove_watcher() i=6 2024-09-22T08:37:05.437 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.429+0000 7fa96092e800 1 -- 172.21.15.142:0/3813133965 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94769994664704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56315be1e6a0 con 0x7fa94c05f040 2024-09-22T08:37:05.437 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.430+0000 7fa95bedc640 1 -- 172.21.15.142:0/3813133965 <== osd.0 v2:172.21.15.31:6800/168281188 19 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94769994664704] v32'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa944029040 con 0x7fa94c05f040 2024-09-22T08:37:05.437 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.430+0000 7fa96092e800 20 remove_watcher() i=7 2024-09-22T08:37:05.437 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.430+0000 7fa96092e800 1 -- 172.21.15.142:0/3813133965 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7fa94c05f040 msgr2=0x7fa94c05f420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:05.437 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.430+0000 7fa96092e800 1 --2- 172.21.15.142:0/3813133965 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7fa94c05f040 0x7fa94c05f420 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:05.437 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.430+0000 7fa96092e800 1 -- 172.21.15.142:0/3813133965 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x56315bdd0650 msgr2=0x56315bdd2b10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:05.438 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.430+0000 7fa96092e800 1 --2- 172.21.15.142:0/3813133965 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x56315bdd0650 0x56315bdd2b10 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:05.438 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.430+0000 7fa96092e800 1 -- 172.21.15.142:0/3813133965 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7fa954011b10 msgr2=0x7fa954045130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:05.438 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.430+0000 7fa96092e800 1 --2- 172.21.15.142:0/3813133965 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7fa954011b10 0x7fa954045130 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:05.438 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.430+0000 7fa96092e800 1 -- 172.21.15.142:0/3813133965 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x56315bdd5040 msgr2=0x56315bdd7430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:05.438 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.430+0000 7fa96092e800 1 --2- 172.21.15.142:0/3813133965 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x56315bdd5040 0x56315bdd7430 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:05.438 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.430+0000 7fa96092e800 1 -- 172.21.15.142:0/3813133965 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fa82c03cf60 msgr2=0x7fa82c03f420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:05.438 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.430+0000 7fa96092e800 1 --2- 172.21.15.142:0/3813133965 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fa82c03cf60 0x7fa82c03f420 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fa94c0075e0 tx=0x7fa94c081000 comp rx=0 tx=0).stop 2024-09-22T08:37:05.438 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.430+0000 7fa96092e800 1 -- 172.21.15.142:0/3813133965 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56315bdbd720 msgr2=0x56315bdc4d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:05.438 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.430+0000 7fa95bedc640 1 -- 172.21.15.142:0/3813133965 reap_dead start 2024-09-22T08:37:05.438 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.430+0000 7fa96092e800 1 --2- 172.21.15.142:0/3813133965 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56315bdbd720 0x56315bdc4d50 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fa954054790 tx=0x7fa9540547c0 comp rx=0 tx=0).stop 2024-09-22T08:37:05.438 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.430+0000 7fa96092e800 1 -- 172.21.15.142:0/3813133965 shutdown_connections 2024-09-22T08:37:05.438 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.430+0000 7fa96092e800 1 --2- 172.21.15.142:0/3813133965 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56315bdbd720 0x56315bdc4d50 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:05.438 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.430+0000 7fa96092e800 1 -- 172.21.15.142:0/3813133965 >> 172.21.15.142:0/3813133965 conn(0x56315bdb9b40 msgr2=0x56315bdb7d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:37:05.438 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.430+0000 7fa96092e800 1 -- 172.21.15.142:0/3813133965 shutdown_connections 2024-09-22T08:37:05.439 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.430+0000 7fa96092e800 1 -- 172.21.15.142:0/3813133965 wait complete. 2024-09-22T08:37:05.439 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.431+0000 7fa96092e800 1 -- 172.21.15.142:0/3523404089 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fa83403d000 msgr2=0x7fa83403f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:05.439 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.431+0000 7fa96092e800 1 --2- 172.21.15.142:0/3523404089 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fa83403d000 0x7fa83403f4c0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fa94c07bb60 tx=0x7fa94c07b9a0 comp rx=0 tx=0).stop 2024-09-22T08:37:05.439 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.431+0000 7fa96092e800 1 -- 172.21.15.142:0/3523404089 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56315bdb0c60 msgr2=0x56315bdb1080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:05.439 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.431+0000 7fa96092e800 1 --2- 172.21.15.142:0/3523404089 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56315bdb0c60 0x56315bdb1080 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x56315bd8bee0 tx=0x7fa9540167b0 comp rx=0 tx=0).stop 2024-09-22T08:37:05.439 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.431+0000 7fa96092e800 1 -- 172.21.15.142:0/3523404089 shutdown_connections 2024-09-22T08:37:05.439 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.431+0000 7fa96092e800 1 --2- 172.21.15.142:0/3523404089 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fa83403d000 0x7fa83403f4c0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:05.439 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.431+0000 7fa96092e800 1 --2- 172.21.15.142:0/3523404089 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56315bdb0c60 0x56315bdb1080 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:05.439 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.431+0000 7fa96092e800 1 -- 172.21.15.142:0/3523404089 >> 172.21.15.142:0/3523404089 conn(0x56315bda5010 msgr2=0x56315bda53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:37:05.439 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.431+0000 7fa96092e800 1 -- 172.21.15.142:0/3523404089 shutdown_connections 2024-09-22T08:37:05.439 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.431+0000 7fa96092e800 1 -- 172.21.15.142:0/3523404089 wait complete. 2024-09-22T08:37:05.439 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.431+0000 7fa96092e800 1 -- 172.21.15.142:0/1369271953 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x56315bc9ca20 msgr2=0x56315bd9cf90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:05.439 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.431+0000 7fa96092e800 1 --2- 172.21.15.142:0/1369271953 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x56315bc9ca20 0x56315bd9cf90 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:05.439 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.431+0000 7fa96092e800 1 -- 172.21.15.142:0/1369271953 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x56315bd9f6a0 msgr2=0x56315bda1b40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:05.440 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.431+0000 7fa96092e800 1 --2- 172.21.15.142:0/1369271953 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x56315bd9f6a0 0x56315bda1b40 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:05.440 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.431+0000 7fa96092e800 1 -- 172.21.15.142:0/1369271953 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fa84403cfb0 msgr2=0x7fa84403f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:05.440 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.431+0000 7fa96092e800 1 --2- 172.21.15.142:0/1369271953 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fa84403cfb0 0x7fa84403f470 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fa944001d70 tx=0x7fa9440012d0 comp rx=0 tx=0).stop 2024-09-22T08:37:05.440 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.431+0000 7fa96092e800 1 -- 172.21.15.142:0/1369271953 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56315bc9b7e0 msgr2=0x56315bd8c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:05.440 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.431+0000 7fa96092e800 1 --2- 172.21.15.142:0/1369271953 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56315bc9b7e0 0x56315bd8c340 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fa94c025c20 tx=0x7fa94c002fb0 comp rx=0 tx=0).stop 2024-09-22T08:37:05.440 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.431+0000 7fa96092e800 1 -- 172.21.15.142:0/1369271953 shutdown_connections 2024-09-22T08:37:05.440 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.431+0000 7fa96092e800 1 --2- 172.21.15.142:0/1369271953 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x56315bd9f6a0 0x56315bda1b40 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:05.440 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.431+0000 7fa96092e800 1 --2- 172.21.15.142:0/1369271953 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x56315bc9ca20 0x56315bd9cf90 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:05.440 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.431+0000 7fa96092e800 1 --2- 172.21.15.142:0/1369271953 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fa84403cfb0 0x7fa84403f470 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:05.440 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.431+0000 7fa96092e800 1 --2- 172.21.15.142:0/1369271953 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56315bc9b7e0 0x56315bd8c340 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:05.440 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.431+0000 7fa96092e800 1 -- 172.21.15.142:0/1369271953 >> 172.21.15.142:0/1369271953 conn(0x56315bc96bb0 msgr2=0x56315bd850e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:37:05.440 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.431+0000 7fa96092e800 1 -- 172.21.15.142:0/1369271953 shutdown_connections 2024-09-22T08:37:05.440 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.431+0000 7fa96092e800 1 -- 172.21.15.142:0/1369271953 wait complete. 2024-09-22T08:37:05.441 INFO:teuthology.orchestra.run.smithi142.stdout:fooFoohttp://acs.amazonaws.com/groups/global/AllUsersREADfooFooFULL_CONTROL 2024-09-22T08:37:05.441 DEBUG:tasks.util.rgw: raw result: fooFoohttp://acs.amazonaws.com/groups/global/AllUsersREADfooFooFULL_CONTROL 2024-09-22T08:37:05.444 INFO:tasks.radosgw_admin:RL: get_acls myfoo foo bytes_out=0 bytes_in=609 failed=False 2024-09-22T08:37:05.458 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-22T08:37:05.555 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=5 bytes_in=0 failed=False 2024-09-22T08:37:05.555 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=4 bytes_in=0 failed=False 2024-09-22T08:37:05.555 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-09-22T08:37:05.555 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=6 bytes_in=0 failed=False 2024-09-22T08:37:05.555 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'rm', '--bucket', 'myfoo', '--purge-objects'] 2024-09-22T08:37:05.556 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'rm', '--bucket', 'myfoo', '--purge-objects'] 2024-09-22T08:37:05.556 DEBUG:teuthology.orchestra.run.smithi142:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket rm --bucket myfoo --purge-objects 2024-09-22T08:37:05.602 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:37:05.602 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:37:05.603 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.601+0000 7feeac640800 1 Processor -- start 2024-09-22T08:37:05.603 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.601+0000 7feeac640800 1 -- start start 2024-09-22T08:37:05.603 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.601+0000 7feeac640800 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55ab36ea88f0 0x55ab36eaad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:05.603 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.601+0000 7feeac640800 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55ab36d30a20 con 0x55ab36ea4d80 2024-09-22T08:37:05.603 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.601+0000 7feeac640800 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x55ab36d307d0 con 0x55ab36ea88f0 2024-09-22T08:37:05.603 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.602+0000 7feea9929640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55ab36ea88f0 0x55ab36eaad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:05.604 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.602+0000 7feeaa12a640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x55ab36ea4d80 0x55ab36ea7170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.142:56368/0 (socket says 172.21.15.142:56368) 2024-09-22T08:37:05.604 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.602+0000 7feeaa12a640 1 -- 172.21.15.142:0/1722691687 learned_addr learned my addr 172.21.15.142:0/1722691687 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-09-22T08:37:05.604 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.602+0000 7feea9929640 1 -- 172.21.15.142:0/1722691687 >> v1:172.21.15.31:6789/0 conn(0x55ab36ea4d80 legacy=0x55ab36ea7170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:05.604 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.602+0000 7feea9929640 1 -- 172.21.15.142:0/1722691687 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ab36eac470 con 0x55ab36ea88f0 2024-09-22T08:37:05.604 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.602+0000 7feea9128640 1 -- 172.21.15.142:0/1722691687 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 242109296 0 0) 0x55ab36d30a20 con 0x55ab36ea4d80 2024-09-22T08:37:05.605 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.604+0000 7feea9929640 1 --2- 172.21.15.142:0/1722691687 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ab36ea88f0 0x55ab36eaad90 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fee9400a470 tx=0x7fee94045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=172e5a636bb5c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:05.605 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.604+0000 7feea9128640 1 -- 172.21.15.142:0/1722691687 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee94053570 con 0x55ab36ea88f0 2024-09-22T08:37:05.605 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.604+0000 7feea9128640 1 -- 172.21.15.142:0/1722691687 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee94058070 con 0x55ab36ea88f0 2024-09-22T08:37:05.605 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.604+0000 7feea9128640 1 -- 172.21.15.142:0/1722691687 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee94053880 con 0x55ab36ea88f0 2024-09-22T08:37:05.606 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.605+0000 7feeac640800 1 -- 172.21.15.142:0/1722691687 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ab36ea88f0 msgr2=0x55ab36eaad90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:05.606 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.605+0000 7feeac640800 1 --2- 172.21.15.142:0/1722691687 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ab36ea88f0 0x55ab36eaad90 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fee9400a470 tx=0x7fee94045a20 comp rx=0 tx=0).stop 2024-09-22T08:37:05.606 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.605+0000 7feeac640800 1 -- 172.21.15.142:0/1722691687 shutdown_connections 2024-09-22T08:37:05.607 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.605+0000 7feeac640800 1 --2- 172.21.15.142:0/1722691687 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ab36ea88f0 0x55ab36eaad90 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:05.607 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.605+0000 7feeac640800 1 -- 172.21.15.142:0/1722691687 >> 172.21.15.142:0/1722691687 conn(0x55ab36e9f310 msgr2=0x55ab36ea1790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:37:05.607 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.605+0000 7feeac640800 1 -- 172.21.15.142:0/1722691687 shutdown_connections 2024-09-22T08:37:05.607 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.605+0000 7feeac640800 1 -- 172.21.15.142:0/1722691687 wait complete. 2024-09-22T08:37:05.628 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.618+0000 7feeac640800 1 Processor -- start 2024-09-22T08:37:05.628 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.618+0000 7feeac640800 1 -- start start 2024-09-22T08:37:05.628 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.618+0000 7feeac640800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ab36ea4d80 0x55ab36ea3f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:05.628 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.619+0000 7feeac640800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55ab36d3ddd0 con 0x55ab36ea4d80 2024-09-22T08:37:05.628 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.619+0000 7feeaa12a640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ab36ea4d80 0x55ab36ea3f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:05.628 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.619+0000 7feeaa12a640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ab36ea4d80 0x55ab36ea3f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:59532/0 (socket says 172.21.15.142:59532) 2024-09-22T08:37:05.628 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.619+0000 7feeaa12a640 1 -- 172.21.15.142:0/3623083424 learned_addr learned my addr 172.21.15.142:0/3623083424 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:37:05.628 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.619+0000 7feeaa12a640 1 -- 172.21.15.142:0/3623083424 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ab36ea4580 con 0x55ab36ea4d80 2024-09-22T08:37:05.629 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.619+0000 7feeaa12a640 1 --2- 172.21.15.142:0/3623083424 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ab36ea4d80 0x55ab36ea3f90 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fee9c006fa0 tx=0x7fee9c001b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=defd8ef83577f28e server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:05.629 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.619+0000 7fed98608640 1 -- 172.21.15.142:0/3623083424 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee9c003450 con 0x55ab36ea4d80 2024-09-22T08:37:05.629 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.619+0000 7fed98608640 1 -- 172.21.15.142:0/3623083424 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee9c003610 con 0x55ab36ea4d80 2024-09-22T08:37:05.629 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.619+0000 7fed98608640 1 -- 172.21.15.142:0/3623083424 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee9c003970 con 0x55ab36ea4d80 2024-09-22T08:37:05.629 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.620+0000 7feeac640800 1 -- 172.21.15.142:0/3623083424 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ab36ea4d80 msgr2=0x55ab36ea3f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:05.629 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.620+0000 7feeac640800 1 --2- 172.21.15.142:0/3623083424 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ab36ea4d80 0x55ab36ea3f90 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fee9c006fa0 tx=0x7fee9c001b00 comp rx=0 tx=0).stop 2024-09-22T08:37:05.629 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.620+0000 7feeac640800 1 -- 172.21.15.142:0/3623083424 shutdown_connections 2024-09-22T08:37:05.629 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.620+0000 7feeac640800 1 --2- 172.21.15.142:0/3623083424 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ab36ea4d80 0x55ab36ea3f90 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:05.629 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.620+0000 7feeac640800 1 -- 172.21.15.142:0/3623083424 >> 172.21.15.142:0/3623083424 conn(0x55ab36e9f310 msgr2=0x55ab36f8f690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:37:05.629 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.620+0000 7feeac640800 1 -- 172.21.15.142:0/3623083424 shutdown_connections 2024-09-22T08:37:05.629 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.620+0000 7feeac640800 1 -- 172.21.15.142:0/3623083424 wait complete. 2024-09-22T08:37:05.629 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.620+0000 7feeac640800 1 Processor -- start 2024-09-22T08:37:05.630 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.620+0000 7feeac640800 1 -- start start 2024-09-22T08:37:05.630 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.621+0000 7feeac640800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ab36ea4d80 0x55ab36f9c960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:05.630 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.621+0000 7feeac640800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55ab36eab710 con 0x55ab36ea4d80 2024-09-22T08:37:05.630 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.621+0000 7feeaa12a640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ab36ea4d80 0x55ab36f9c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:05.630 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.621+0000 7feeaa12a640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ab36ea4d80 0x55ab36f9c960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:59542/0 (socket says 172.21.15.142:59542) 2024-09-22T08:37:05.630 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.621+0000 7feeaa12a640 1 -- 172.21.15.142:0/3525667636 learned_addr learned my addr 172.21.15.142:0/3525667636 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:37:05.630 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.621+0000 7feeaa12a640 1 -- 172.21.15.142:0/3525667636 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ab36f9cec0 con 0x55ab36ea4d80 2024-09-22T08:37:05.630 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.621+0000 7feeaa12a640 1 --2- 172.21.15.142:0/3525667636 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ab36ea4d80 0x55ab36f9c960 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x55ab36ea3ac0 tx=0x7fee9c001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:05.630 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.622+0000 7fed96e05640 1 -- 172.21.15.142:0/3525667636 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee9c014a10 con 0x55ab36ea4d80 2024-09-22T08:37:05.630 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.622+0000 7fed96e05640 1 -- 172.21.15.142:0/3525667636 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee9c014bb0 con 0x55ab36ea4d80 2024-09-22T08:37:05.630 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.622+0000 7feeac640800 1 -- 172.21.15.142:0/3525667636 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ab36f9d150 con 0x55ab36ea4d80 2024-09-22T08:37:05.630 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.622+0000 7fed96e05640 1 -- 172.21.15.142:0/3525667636 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee9c01e3f0 con 0x55ab36ea4d80 2024-09-22T08:37:05.631 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.622+0000 7feeac640800 1 -- 172.21.15.142:0/3525667636 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ab36f9db50 con 0x55ab36ea4d80 2024-09-22T08:37:05.631 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.623+0000 7fed96e05640 1 -- 172.21.15.142:0/3525667636 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fee9c010070 con 0x55ab36ea4d80 2024-09-22T08:37:05.631 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.623+0000 7fed96e05640 1 --2- 172.21.15.142:0/3525667636 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fed9003cfb0 0x7fed9003f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:05.631 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.623+0000 7fed96e05640 1 -- 172.21.15.142:0/3525667636 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5938+0+0 (secure 0 0 0) 0x7fee9c018070 con 0x55ab36ea4d80 2024-09-22T08:37:05.631 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.623+0000 7feea9929640 1 --2- 172.21.15.142:0/3525667636 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fed9003cfb0 0x7fed9003f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:05.631 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.623+0000 7feeac640800 1 --2- 172.21.15.142:0/3525667636 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55ab36ea88f0 0x55ab36fa3fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:05.631 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.623+0000 7feeac640800 1 -- 172.21.15.142:0/3525667636 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ab36fa44f0 con 0x55ab36ea88f0 2024-09-22T08:37:05.631 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.623+0000 7feeaa92b640 1 --2- 172.21.15.142:0/3525667636 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55ab36ea88f0 0x55ab36fa3fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:05.631 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.623+0000 7feea9929640 1 --2- 172.21.15.142:0/3525667636 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fed9003cfb0 0x7fed9003f470 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fee94057000 tx=0x7fee94052000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:05.631 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.623+0000 7feeaa92b640 1 --2- 172.21.15.142:0/3525667636 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55ab36ea88f0 0x55ab36fa3fb0 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:05.632 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.624+0000 7feeaa92b640 1 -- 172.21.15.142:0/3525667636 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7feea40083e0 con 0x55ab36ea88f0 2024-09-22T08:37:05.632 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.624+0000 7feeac640800 1 -- 172.21.15.142:0/3525667636 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ab36fa4890 con 0x55ab36ea88f0 2024-09-22T08:37:05.632 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.624+0000 7feeaa92b640 1 -- 172.21.15.142:0/3525667636 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7feea40083e0 con 0x55ab36ea88f0 2024-09-22T08:37:05.632 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.624+0000 7feeac640800 1 --2- 172.21.15.142:0/3525667636 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55ab36fa6390 0x55ab36fa8810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:05.632 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.624+0000 7feeac640800 1 -- 172.21.15.142:0/3525667636 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:3 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ab36fa8fa0 con 0x55ab36fa6390 2024-09-22T08:37:05.632 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.624+0000 7feeaa12a640 1 --2- 172.21.15.142:0/3525667636 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55ab36fa6390 0x55ab36fa8810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:05.632 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.624+0000 7feeaa12a640 1 --2- 172.21.15.142:0/3525667636 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55ab36fa6390 0x55ab36fa8810 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:05.632 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.625+0000 7feeaa12a640 1 -- 172.21.15.142:0/3525667636 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(3 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fee9c01b070 con 0x55ab36fa6390 2024-09-22T08:37:05.632 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.625+0000 7feeac640800 1 -- 172.21.15.142:0/3525667636 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ab36fa50e0 con 0x55ab36ea88f0 2024-09-22T08:37:05.632 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.625+0000 7feeaa92b640 1 -- 172.21.15.142:0/3525667636 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7feea40083e0 con 0x55ab36ea88f0 2024-09-22T08:37:05.632 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.625+0000 7feeac640800 1 -- 172.21.15.142:0/3525667636 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ab36fa5530 con 0x55ab36fa6390 2024-09-22T08:37:05.632 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.625+0000 7feeaa12a640 1 -- 172.21.15.142:0/3525667636 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(5 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fee9c01b070 con 0x55ab36fa6390 2024-09-22T08:37:05.632 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.625+0000 7feeac640800 1 Processor -- start 2024-09-22T08:37:05.632 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.625+0000 7feeac640800 1 -- start start 2024-09-22T08:37:05.633 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.626+0000 7feeac640800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ab36fb79c0 0x55ab36fb7de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:05.633 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.626+0000 7feeac640800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55ab36d9cd50 con 0x55ab36fb79c0 2024-09-22T08:37:05.633 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.626+0000 7feeaa92b640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ab36fb79c0 0x55ab36fb7de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:05.633 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.626+0000 7feeaa92b640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ab36fb79c0 0x55ab36fb7de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:59558/0 (socket says 172.21.15.142:59558) 2024-09-22T08:37:05.633 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.626+0000 7feeaa92b640 1 -- 172.21.15.142:0/4263006875 learned_addr learned my addr 172.21.15.142:0/4263006875 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:37:05.633 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.626+0000 7feeaa92b640 1 -- 172.21.15.142:0/4263006875 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ab36fb8420 con 0x55ab36fb79c0 2024-09-22T08:37:05.633 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.626+0000 7feeaa92b640 1 --2- 172.21.15.142:0/4263006875 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ab36fb79c0 0x55ab36fb7de0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x55ab36f9d960 tx=0x7feea400bf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:05.633 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.626+0000 7fed8ffff640 1 -- 172.21.15.142:0/4263006875 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feea401c020 con 0x55ab36fb79c0 2024-09-22T08:37:05.633 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.626+0000 7fed8ffff640 1 -- 172.21.15.142:0/4263006875 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feea4007c90 con 0x55ab36fb79c0 2024-09-22T08:37:05.633 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.626+0000 7feeac640800 1 -- 172.21.15.142:0/4263006875 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ab36fb8c50 con 0x55ab36fb79c0 2024-09-22T08:37:05.633 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.627+0000 7fed8ffff640 1 -- 172.21.15.142:0/4263006875 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feea4018440 con 0x55ab36fb79c0 2024-09-22T08:37:05.633 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.627+0000 7feeac640800 1 -- 172.21.15.142:0/4263006875 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ab36fb91f0 con 0x55ab36fb79c0 2024-09-22T08:37:05.651 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.627+0000 7fed8ffff640 1 -- 172.21.15.142:0/4263006875 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7feea401f020 con 0x55ab36fb79c0 2024-09-22T08:37:05.651 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.628+0000 7fed8ffff640 1 --2- 172.21.15.142:0/4263006875 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fed8403cfb0 0x7fed8403f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:05.651 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.628+0000 7fed8ffff640 1 -- 172.21.15.142:0/4263006875 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5938+0+0 (secure 0 0 0) 0x7feea4055990 con 0x55ab36fb79c0 2024-09-22T08:37:05.651 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.628+0000 7feeaa12a640 1 --2- 172.21.15.142:0/4263006875 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fed8403cfb0 0x7fed8403f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:05.651 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.628+0000 7feeac640800 1 Processor -- start 2024-09-22T08:37:05.651 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.628+0000 7feeaa12a640 1 --2- 172.21.15.142:0/4263006875 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fed8403cfb0 0x7fed8403f470 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x55ab36fa5480 tx=0x7fee9c001530 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:05.652 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.628+0000 7feeac640800 1 -- start start 2024-09-22T08:37:05.652 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.628+0000 7feeac640800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ab36fc4440 0x55ab36fc4820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:05.652 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.628+0000 7feeac640800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55ab36f97c90 con 0x55ab36fc4440 2024-09-22T08:37:05.652 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.628+0000 7feeaa92b640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ab36fc4440 0x55ab36fc4820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:05.652 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.628+0000 7feeaa92b640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ab36fc4440 0x55ab36fc4820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:59560/0 (socket says 172.21.15.142:59560) 2024-09-22T08:37:05.652 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.628+0000 7feeaa92b640 1 -- 172.21.15.142:0/2607757219 learned_addr learned my addr 172.21.15.142:0/2607757219 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:37:05.652 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.628+0000 7feeaa92b640 1 -- 172.21.15.142:0/2607757219 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ab36fc4e10 con 0x55ab36fc4440 2024-09-22T08:37:05.652 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.629+0000 7feeaa92b640 1 --2- 172.21.15.142:0/2607757219 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ab36fc4440 0x55ab36fc4820 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7feea4053df0 tx=0x7feea40158b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=453dd53aa7ffaba server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:05.652 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.629+0000 7fed8dffb640 1 -- 172.21.15.142:0/2607757219 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feea404a070 con 0x55ab36fc4440 2024-09-22T08:37:05.652 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.629+0000 7fed8dffb640 1 -- 172.21.15.142:0/2607757219 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feea4015e70 con 0x55ab36fc4440 2024-09-22T08:37:05.652 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.629+0000 7fed8dffb640 1 -- 172.21.15.142:0/2607757219 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feea40174d0 con 0x55ab36fc4440 2024-09-22T08:37:05.652 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.629+0000 7feeac640800 1 -- 172.21.15.142:0/2607757219 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ab36fc4440 msgr2=0x55ab36fc4820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:05.653 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.629+0000 7feeac640800 1 --2- 172.21.15.142:0/2607757219 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ab36fc4440 0x55ab36fc4820 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7feea4053df0 tx=0x7feea40158b0 comp rx=0 tx=0).stop 2024-09-22T08:37:05.653 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.629+0000 7feeac640800 1 -- 172.21.15.142:0/2607757219 shutdown_connections 2024-09-22T08:37:05.653 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.629+0000 7feeac640800 1 --2- 172.21.15.142:0/2607757219 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ab36fc4440 0x55ab36fc4820 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:05.653 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.629+0000 7feeac640800 1 -- 172.21.15.142:0/2607757219 >> 172.21.15.142:0/2607757219 conn(0x55ab36fc0840 msgr2=0x55ab36fbea80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:37:05.653 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.629+0000 7feeac640800 1 -- 172.21.15.142:0/2607757219 shutdown_connections 2024-09-22T08:37:05.653 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.629+0000 7feeac640800 1 -- 172.21.15.142:0/2607757219 wait complete. 2024-09-22T08:37:05.653 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.630+0000 7feeac640800 1 Processor -- start 2024-09-22T08:37:05.653 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.630+0000 7feeac640800 1 -- start start 2024-09-22T08:37:05.653 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.630+0000 7feeac640800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ab36fc4440 0x55ab36f95140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:05.653 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.630+0000 7feeac640800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55ab36fc5450 con 0x55ab36fc4440 2024-09-22T08:37:05.653 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.630+0000 7feeaa92b640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ab36fc4440 0x55ab36f95140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:05.653 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.630+0000 7feeaa92b640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ab36fc4440 0x55ab36f95140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:59568/0 (socket says 172.21.15.142:59568) 2024-09-22T08:37:05.653 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.630+0000 7feeaa92b640 1 -- 172.21.15.142:0/2486159387 learned_addr learned my addr 172.21.15.142:0/2486159387 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:37:05.654 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.630+0000 7feeaa92b640 1 -- 172.21.15.142:0/2486159387 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ab36f956a0 con 0x55ab36fc4440 2024-09-22T08:37:05.654 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.630+0000 7feeaa92b640 1 --2- 172.21.15.142:0/2486159387 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ab36fc4440 0x55ab36f95140 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7feea40154a0 tx=0x7feea4053d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:05.654 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.631+0000 7fed7bfff640 1 -- 172.21.15.142:0/2486159387 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feea402e070 con 0x55ab36fc4440 2024-09-22T08:37:05.654 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.631+0000 7fed7bfff640 1 -- 172.21.15.142:0/2486159387 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feea404b040 con 0x55ab36fc4440 2024-09-22T08:37:05.654 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.631+0000 7feeac640800 1 -- 172.21.15.142:0/2486159387 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ab36f93a50 con 0x55ab36fc4440 2024-09-22T08:37:05.654 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.631+0000 7fed7bfff640 1 -- 172.21.15.142:0/2486159387 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feea404a070 con 0x55ab36fc4440 2024-09-22T08:37:05.654 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.631+0000 7feeac640800 1 -- 172.21.15.142:0/2486159387 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ab36f93ff0 con 0x55ab36fc4440 2024-09-22T08:37:05.654 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.631+0000 7fed7bfff640 1 -- 172.21.15.142:0/2486159387 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7feea4016040 con 0x55ab36fc4440 2024-09-22T08:37:05.654 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.632+0000 7fed7bfff640 1 --2- 172.21.15.142:0/2486159387 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fed7403cf60 0x7fed7403f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:05.654 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.632+0000 7fed7bfff640 1 -- 172.21.15.142:0/2486159387 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5938+0+0 (secure 0 0 0) 0x7feea403d460 con 0x55ab36fc4440 2024-09-22T08:37:05.654 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.632+0000 7feeaa12a640 1 --2- 172.21.15.142:0/2486159387 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fed7403cf60 0x7fed7403f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:05.655 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.632+0000 7feeaa12a640 1 --2- 172.21.15.142:0/2486159387 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fed7403cf60 0x7fed7403f420 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fee9c052ec0 tx=0x7fee9c037420 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:05.655 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.632+0000 7feeac640800 20 rados->read ofs=0 len=0 2024-09-22T08:37:05.655 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.632+0000 7feeac640800 1 --2- 172.21.15.142:0/2486159387 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55ab36fd94e0 0x55ab36fdb9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:05.655 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.632+0000 7feeac640800 1 -- 172.21.15.142:0/2486159387 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ab36fdc0f0 con 0x55ab36fd94e0 2024-09-22T08:37:05.655 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.632+0000 7feea9929640 1 --2- 172.21.15.142:0/2486159387 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55ab36fd94e0 0x55ab36fdb9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:05.655 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.633+0000 7feea9929640 1 --2- 172.21.15.142:0/2486159387 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55ab36fd94e0 0x55ab36fdb9a0 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:05.655 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.633+0000 7feea9929640 1 -- 172.21.15.142:0/2486159387 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fee94051070 con 0x55ab36fd94e0 2024-09-22T08:37:05.655 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.633+0000 7feeac640800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:05.655 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.633+0000 7feeac640800 20 realm 2024-09-22T08:37:05.655 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.633+0000 7feeac640800 20 rados->read ofs=0 len=0 2024-09-22T08:37:05.655 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.633+0000 7feeac640800 1 -- 172.21.15.142:0/2486159387 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ab36fdc520 con 0x55ab36fd94e0 2024-09-22T08:37:05.655 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.633+0000 7feea9929640 1 -- 172.21.15.142:0/2486159387 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fee94051070 con 0x55ab36fd94e0 2024-09-22T08:37:05.656 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.633+0000 7feeac640800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:05.656 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.633+0000 7feeac640800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:37:05.656 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.633+0000 7feeac640800 20 rados->read ofs=0 len=0 2024-09-22T08:37:05.656 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.633+0000 7feeac640800 1 -- 172.21.15.142:0/2486159387 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ab36fdcdf0 con 0x55ab36fd94e0 2024-09-22T08:37:05.656 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.633+0000 7feea9929640 1 -- 172.21.15.142:0/2486159387 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fee94051070 con 0x55ab36fd94e0 2024-09-22T08:37:05.656 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.633+0000 7feeac640800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:05.656 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.633+0000 7feeac640800 20 rados->read ofs=0 len=0 2024-09-22T08:37:05.656 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.633+0000 7feeac640800 1 -- 172.21.15.142:0/2486159387 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ab36fdd190 con 0x55ab36fd94e0 2024-09-22T08:37:05.656 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.634+0000 7feea9929640 1 -- 172.21.15.142:0/2486159387 <== osd.1 v2:172.21.15.142:6816/3192108003 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fee94051070 con 0x55ab36fd94e0 2024-09-22T08:37:05.656 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.634+0000 7feeac640800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:37:05.656 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.634+0000 7feeac640800 20 rados->read ofs=0 len=0 2024-09-22T08:37:05.656 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.634+0000 7feeac640800 1 --2- 172.21.15.142:0/2486159387 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55ab36fddef0 0x55ab36fe02e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:05.656 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.634+0000 7feeac640800 1 -- 172.21.15.142:0/2486159387 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ab36fe08f0 con 0x55ab36fddef0 2024-09-22T08:37:05.657 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.634+0000 7feeaa92b640 1 --2- 172.21.15.142:0/2486159387 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55ab36fddef0 0x55ab36fe02e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:05.657 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.634+0000 7feeaa92b640 1 --2- 172.21.15.142:0/2486159387 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55ab36fddef0 0x55ab36fe02e0 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:05.657 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.634+0000 7feeaa92b640 1 -- 172.21.15.142:0/2486159387 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(5 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7feea40083e0 con 0x55ab36fddef0 2024-09-22T08:37:05.657 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.634+0000 7feeac640800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:37:05.657 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.634+0000 7feeac640800 20 searching for the correct realm 2024-09-22T08:37:05.657 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.634+0000 7feeac640800 1 -- 172.21.15.142:0/2486159387 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ab36fe2220 con 0x55ab36fddef0 2024-09-22T08:37:05.657 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.634+0000 7feeaa92b640 1 -- 172.21.15.142:0/2486159387 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feea40083e0 con 0x55ab36fddef0 2024-09-22T08:37:05.657 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.635+0000 7feeaa92b640 1 --2- 172.21.15.142:0/2486159387 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7feea4032020 0x7feea401e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:05.657 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.635+0000 7feeaa92b640 1 -- 172.21.15.142:0/2486159387 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ab36fe2220 con 0x7feea4032020 2024-09-22T08:37:05.657 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.635+0000 7feeaa12a640 1 --2- 172.21.15.142:0/2486159387 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7feea4032020 0x7feea401e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:05.657 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.635+0000 7feeaa12a640 1 --2- 172.21.15.142:0/2486159387 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7feea4032020 0x7feea401e2c0 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:05.657 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.635+0000 7feeaa12a640 1 -- 172.21.15.142:0/2486159387 <== osd.2 v2:172.21.15.142:6808/279438927 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee9c01b070 con 0x7feea4032020 2024-09-22T08:37:05.658 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.635+0000 7feeaa12a640 1 --2- 172.21.15.142:0/2486159387 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7fee9c01d530 0x7fee9c052290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:05.658 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.635+0000 7feeaa12a640 1 -- 172.21.15.142:0/2486159387 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ab36fe2220 con 0x7fee9c01d530 2024-09-22T08:37:05.658 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.635+0000 7feea9929640 1 --2- 172.21.15.142:0/2486159387 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7fee9c01d530 0x7fee9c052290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:05.658 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.636+0000 7feea9929640 1 --2- 172.21.15.142:0/2486159387 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7fee9c01d530 0x7fee9c052290 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:05.658 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.636+0000 7feea9929640 1 -- 172.21.15.142:0/2486159387 <== osd.0 v2:172.21.15.31:6800/168281188 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee94051070 con 0x7fee9c01d530 2024-09-22T08:37:05.658 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.636+0000 7feea9929640 1 -- 172.21.15.142:0/2486159387 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ab36fe2220 con 0x55ab36fd94e0 2024-09-22T08:37:05.658 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.636+0000 7feea9929640 1 -- 172.21.15.142:0/2486159387 <== osd.1 v2:172.21.15.142:6816/3192108003 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee94051070 con 0x55ab36fd94e0 2024-09-22T08:37:05.658 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.636+0000 7feea9929640 1 -- 172.21.15.142:0/2486159387 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ab36fe2220 con 0x55ab36fd94e0 2024-09-22T08:37:05.658 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.636+0000 7feea9929640 1 -- 172.21.15.142:0/2486159387 <== osd.1 v2:172.21.15.142:6816/3192108003 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee94051070 con 0x55ab36fd94e0 2024-09-22T08:37:05.658 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.636+0000 7feea9929640 1 -- 172.21.15.142:0/2486159387 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ab36fe2220 con 0x55ab36fd94e0 2024-09-22T08:37:05.658 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.637+0000 7feea9929640 1 -- 172.21.15.142:0/2486159387 <== osd.1 v2:172.21.15.142:6816/3192108003 7 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee94051070 con 0x55ab36fd94e0 2024-09-22T08:37:05.658 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.637+0000 7feea9929640 1 -- 172.21.15.142:0/2486159387 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ab36fe2220 con 0x7fee9c01d530 2024-09-22T08:37:05.658 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.637+0000 7feea9929640 1 -- 172.21.15.142:0/2486159387 <== osd.0 v2:172.21.15.31:6800/168281188 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee94051070 con 0x7fee9c01d530 2024-09-22T08:37:05.659 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.637+0000 7feea9929640 1 -- 172.21.15.142:0/2486159387 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ab36fe2220 con 0x7feea4032020 2024-09-22T08:37:05.659 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.637+0000 7feeaa12a640 1 -- 172.21.15.142:0/2486159387 <== osd.2 v2:172.21.15.142:6808/279438927 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee9c01b070 con 0x7feea4032020 2024-09-22T08:37:05.659 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.637+0000 7feeaa12a640 1 -- 172.21.15.142:0/2486159387 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ab36fe2220 con 0x55ab36fddef0 2024-09-22T08:37:05.659 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.637+0000 7feeaa92b640 1 -- 172.21.15.142:0/2486159387 <== osd.3 v2:172.21.15.142:6800/1064901393 3 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feea40083e0 con 0x55ab36fddef0 2024-09-22T08:37:05.659 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.637+0000 7feeaa92b640 1 -- 172.21.15.142:0/2486159387 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ab36fe2220 con 0x55ab36fd94e0 2024-09-22T08:37:05.659 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.638+0000 7feea9929640 1 -- 172.21.15.142:0/2486159387 <== osd.1 v2:172.21.15.142:6816/3192108003 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee94051070 con 0x55ab36fd94e0 2024-09-22T08:37:05.659 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.638+0000 7feea9929640 1 -- 172.21.15.142:0/2486159387 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ab36fe2220 con 0x7fee9c01d530 2024-09-22T08:37:05.659 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.638+0000 7feea9929640 1 -- 172.21.15.142:0/2486159387 <== osd.0 v2:172.21.15.31:6800/168281188 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee94051070 con 0x7fee9c01d530 2024-09-22T08:37:05.659 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.638+0000 7feea9929640 1 -- 172.21.15.142:0/2486159387 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ab36fe2220 con 0x55ab36fd94e0 2024-09-22T08:37:05.659 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.638+0000 7feea9929640 1 -- 172.21.15.142:0/2486159387 <== osd.1 v2:172.21.15.142:6816/3192108003 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee94051070 con 0x55ab36fd94e0 2024-09-22T08:37:05.659 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.638+0000 7feea9929640 1 -- 172.21.15.142:0/2486159387 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ab36fe2220 con 0x7feea4032020 2024-09-22T08:37:05.660 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.638+0000 7feeaa12a640 1 -- 172.21.15.142:0/2486159387 <== osd.2 v2:172.21.15.142:6808/279438927 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fee9c01b070 con 0x7feea4032020 2024-09-22T08:37:05.660 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.638+0000 7feeaa12a640 1 -- 172.21.15.142:0/2486159387 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ab36fe2220 con 0x55ab36fddef0 2024-09-22T08:37:05.660 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.638+0000 7feeaa92b640 1 -- 172.21.15.142:0/2486159387 <== osd.3 v2:172.21.15.142:6800/1064901393 4 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feea40083e0 con 0x55ab36fddef0 2024-09-22T08:37:05.660 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.638+0000 7feeaa92b640 1 -- 172.21.15.142:0/2486159387 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ab36fe2220 con 0x55ab36fddef0 2024-09-22T08:37:05.660 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.639+0000 7feeaa92b640 1 -- 172.21.15.142:0/2486159387 <== osd.3 v2:172.21.15.142:6800/1064901393 5 ==== osd_op_reply(20 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7feea40083e0 con 0x55ab36fddef0 2024-09-22T08:37:05.660 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.639+0000 7feeaa92b640 1 -- 172.21.15.142:0/2486159387 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ab36fe2220 con 0x7fee9c01d530 2024-09-22T08:37:05.660 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.639+0000 7feea9929640 1 -- 172.21.15.142:0/2486159387 <== osd.0 v2:172.21.15.31:6800/168281188 4 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee94051070 con 0x7fee9c01d530 2024-09-22T08:37:05.660 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.639+0000 7feea9929640 1 -- 172.21.15.142:0/2486159387 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ab36fe2220 con 0x55ab36fddef0 2024-09-22T08:37:05.660 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.639+0000 7feeaa92b640 1 -- 172.21.15.142:0/2486159387 <== osd.3 v2:172.21.15.142:6800/1064901393 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feea40083e0 con 0x55ab36fddef0 2024-09-22T08:37:05.660 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.639+0000 7feeaa92b640 1 -- 172.21.15.142:0/2486159387 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ab36fe2220 con 0x55ab36fddef0 2024-09-22T08:37:05.660 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.639+0000 7feeaa92b640 1 -- 172.21.15.142:0/2486159387 <== osd.3 v2:172.21.15.142:6800/1064901393 7 ==== osd_op_reply(23 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7feea40083e0 con 0x55ab36fddef0 2024-09-22T08:37:05.660 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.639+0000 7feeaa92b640 1 -- 172.21.15.142:0/2486159387 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ab36fe2220 con 0x55ab36fd94e0 2024-09-22T08:37:05.661 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.639+0000 7feea9929640 1 -- 172.21.15.142:0/2486159387 <== osd.1 v2:172.21.15.142:6816/3192108003 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee94051070 con 0x55ab36fd94e0 2024-09-22T08:37:05.661 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.640+0000 7feea9929640 1 -- 172.21.15.142:0/2486159387 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ab36fe2220 con 0x55ab36fd94e0 2024-09-22T08:37:05.661 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.640+0000 7feea9929640 1 -- 172.21.15.142:0/2486159387 <== osd.1 v2:172.21.15.142:6816/3192108003 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fee94051070 con 0x55ab36fd94e0 2024-09-22T08:37:05.661 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.640+0000 7feea9929640 1 -- 172.21.15.142:0/2486159387 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ab36fe2220 con 0x7fee9c01d530 2024-09-22T08:37:05.661 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.640+0000 7feea9929640 1 -- 172.21.15.142:0/2486159387 <== osd.0 v2:172.21.15.31:6800/168281188 5 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee94051070 con 0x7fee9c01d530 2024-09-22T08:37:05.661 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.640+0000 7feea9929640 1 -- 172.21.15.142:0/2486159387 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ab36fe2220 con 0x55ab36fddef0 2024-09-22T08:37:05.661 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.640+0000 7feeaa92b640 1 -- 172.21.15.142:0/2486159387 <== osd.3 v2:172.21.15.142:6800/1064901393 8 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feea40083e0 con 0x55ab36fddef0 2024-09-22T08:37:05.661 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.640+0000 7feeaa92b640 1 -- 172.21.15.142:0/2486159387 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ab36fe2220 con 0x7feea4032020 2024-09-22T08:37:05.661 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.641+0000 7feeaa12a640 1 -- 172.21.15.142:0/2486159387 <== osd.2 v2:172.21.15.142:6808/279438927 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee9c01b070 con 0x7feea4032020 2024-09-22T08:37:05.661 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.641+0000 7feeaa12a640 1 -- 172.21.15.142:0/2486159387 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ab36fe2220 con 0x55ab36fd94e0 2024-09-22T08:37:05.661 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.641+0000 7feea9929640 1 -- 172.21.15.142:0/2486159387 <== osd.1 v2:172.21.15.142:6816/3192108003 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee94051070 con 0x55ab36fd94e0 2024-09-22T08:37:05.661 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.641+0000 7feea9929640 1 -- 172.21.15.142:0/2486159387 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ab36fe2220 con 0x7fee9c01d530 2024-09-22T08:37:05.661 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.641+0000 7feea9929640 1 -- 172.21.15.142:0/2486159387 <== osd.0 v2:172.21.15.31:6800/168281188 6 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee94051070 con 0x7fee9c01d530 2024-09-22T08:37:05.661 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.641+0000 7feea9929640 1 -- 172.21.15.142:0/2486159387 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ab36fe2220 con 0x55ab36fddef0 2024-09-22T08:37:05.662 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.641+0000 7feeaa92b640 1 -- 172.21.15.142:0/2486159387 <== osd.3 v2:172.21.15.142:6800/1064901393 9 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feea40083e0 con 0x55ab36fddef0 2024-09-22T08:37:05.662 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.641+0000 7feeaa92b640 1 -- 172.21.15.142:0/2486159387 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ab36fe2220 con 0x7fee9c01d530 2024-09-22T08:37:05.662 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.642+0000 7feea9929640 1 -- 172.21.15.142:0/2486159387 <== osd.0 v2:172.21.15.31:6800/168281188 7 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee94051070 con 0x7fee9c01d530 2024-09-22T08:37:05.662 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.642+0000 7feea9929640 1 -- 172.21.15.142:0/2486159387 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ab36fe2220 con 0x7feea4032020 2024-09-22T08:37:05.662 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.642+0000 7feeaa12a640 1 -- 172.21.15.142:0/2486159387 <== osd.2 v2:172.21.15.142:6808/279438927 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee9c01b070 con 0x7feea4032020 2024-09-22T08:37:05.662 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.642+0000 7feeaa12a640 1 -- 172.21.15.142:0/2486159387 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ab36fe2220 con 0x55ab36fddef0 2024-09-22T08:37:05.662 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.642+0000 7feeaa92b640 1 -- 172.21.15.142:0/2486159387 <== osd.3 v2:172.21.15.142:6800/1064901393 10 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feea40083e0 con 0x55ab36fddef0 2024-09-22T08:37:05.662 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.642+0000 7feeaa92b640 1 -- 172.21.15.142:0/2486159387 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ab36fe2220 con 0x7fee9c01d530 2024-09-22T08:37:05.662 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.642+0000 7feea9929640 1 -- 172.21.15.142:0/2486159387 <== osd.0 v2:172.21.15.31:6800/168281188 8 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee94051070 con 0x7fee9c01d530 2024-09-22T08:37:05.662 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.642+0000 7feea9929640 1 -- 172.21.15.142:0/2486159387 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ab36fe2220 con 0x55ab36fd94e0 2024-09-22T08:37:05.662 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.643+0000 7feea9929640 1 -- 172.21.15.142:0/2486159387 <== osd.1 v2:172.21.15.142:6816/3192108003 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fee94051070 con 0x55ab36fd94e0 2024-09-22T08:37:05.662 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.643+0000 7feea9929640 1 -- 172.21.15.142:0/2486159387 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ab36fe2220 con 0x7feea4032020 2024-09-22T08:37:05.662 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.643+0000 7feeaa12a640 1 -- 172.21.15.142:0/2486159387 <== osd.2 v2:172.21.15.142:6808/279438927 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee9c01b070 con 0x7feea4032020 2024-09-22T08:37:05.663 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.643+0000 7feeac640800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:37:05.663 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.643+0000 7feeac640800 20 RGWRados::pool_iterate: got zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec 2024-09-22T08:37:05.663 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.643+0000 7feeac640800 20 RGWRados::pool_iterate: got zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f 2024-09-22T08:37:05.663 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.643+0000 7feeac640800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:37:05.663 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.643+0000 7feeac640800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:37:05.663 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.643+0000 7feeac640800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:37:05.663 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.643+0000 7feeac640800 20 rados->read ofs=0 len=0 2024-09-22T08:37:05.663 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.643+0000 7feeac640800 1 -- 172.21.15.142:0/2486159387 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ab36fe12b0 con 0x55ab36fd94e0 2024-09-22T08:37:05.663 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.643+0000 7feea9929640 1 -- 172.21.15.142:0/2486159387 <== osd.1 v2:172.21.15.142:6816/3192108003 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fee94051070 con 0x55ab36fd94e0 2024-09-22T08:37:05.663 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.643+0000 7feeac640800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:05.663 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.643+0000 7feeac640800 20 rados->read ofs=0 len=0 2024-09-22T08:37:05.663 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.643+0000 7feeac640800 1 -- 172.21.15.142:0/2486159387 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ab36fe1b00 con 0x55ab36fd94e0 2024-09-22T08:37:05.663 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.643+0000 7feea9929640 1 -- 172.21.15.142:0/2486159387 <== osd.1 v2:172.21.15.142:6816/3192108003 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fee94051070 con 0x55ab36fd94e0 2024-09-22T08:37:05.664 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.643+0000 7feeac640800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:37:05.664 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.643+0000 7feeac640800 20 rados->read ofs=0 len=0 2024-09-22T08:37:05.664 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.643+0000 7feeac640800 1 -- 172.21.15.142:0/2486159387 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:40 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ab36fe26a0 con 0x55ab36fddef0 2024-09-22T08:37:05.664 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.644+0000 7feeaa92b640 1 -- 172.21.15.142:0/2486159387 <== osd.3 v2:172.21.15.142:6800/1064901393 11 ==== osd_op_reply(40 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7feea40083e0 con 0x55ab36fddef0 2024-09-22T08:37:05.664 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.644+0000 7feeac640800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:37:05.664 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.644+0000 7feeac640800 20 zone default found 2024-09-22T08:37:05.664 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.644+0000 7feeac640800 4 Realm: () 2024-09-22T08:37:05.664 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.644+0000 7feeac640800 4 ZoneGroup: default (d89f6f57-1007-47dd-9065-f486c7b01aec) 2024-09-22T08:37:05.664 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.644+0000 7feeac640800 4 Zone: default (e239248c-0bee-4e41-803a-24b288d3eb8f) 2024-09-22T08:37:05.664 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.644+0000 7feeac640800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:37:05.664 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.644+0000 7feeac640800 20 zonegroup default 2024-09-22T08:37:05.664 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.644+0000 7feeac640800 20 rados->read ofs=0 len=0 2024-09-22T08:37:05.664 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.644+0000 7feeac640800 1 -- 172.21.15.142:0/2486159387 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ab36fe2a60 con 0x7fee9c01d530 2024-09-22T08:37:05.665 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.644+0000 7feea9929640 1 -- 172.21.15.142:0/2486159387 <== osd.0 v2:172.21.15.31:6800/168281188 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fee94051070 con 0x7fee9c01d530 2024-09-22T08:37:05.665 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.644+0000 7feeac640800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:05.665 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.644+0000 7feeac640800 20 rados->read ofs=0 len=0 2024-09-22T08:37:05.665 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.644+0000 7feeac640800 1 -- 172.21.15.142:0/2486159387 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ab36fe48c0 con 0x55ab36fddef0 2024-09-22T08:37:05.665 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.644+0000 7feeaa92b640 1 -- 172.21.15.142:0/2486159387 <== osd.3 v2:172.21.15.142:6800/1064901393 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7feea40083e0 con 0x55ab36fddef0 2024-09-22T08:37:05.665 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.644+0000 7feeac640800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:05.665 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.644+0000 7feeac640800 20 rados->read ofs=0 len=0 2024-09-22T08:37:05.665 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.644+0000 7feeac640800 1 -- 172.21.15.142:0/2486159387 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ab36fe4d50 con 0x55ab36fddef0 2024-09-22T08:37:05.665 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.645+0000 7feeaa92b640 1 -- 172.21.15.142:0/2486159387 <== osd.3 v2:172.21.15.142:6800/1064901393 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7feea40083e0 con 0x55ab36fddef0 2024-09-22T08:37:05.665 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.645+0000 7feeac640800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:05.665 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.645+0000 7feeac640800 20 started sync module instance, tier type = 2024-09-22T08:37:05.666 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.645+0000 7feeac640800 20 started zone id=e239248c-0bee-4e41-803a-24b288d3eb8f (name=default) with tier type = 2024-09-22T08:37:05.666 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.645+0000 7feeac640800 1 -- 172.21.15.142:0/2486159387 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ab36fe3d30 con 0x7feea4032020 2024-09-22T08:37:05.666 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.646+0000 7feeaa12a640 1 -- 172.21.15.142:0/2486159387 <== osd.2 v2:172.21.15.142:6808/279438927 7 ==== osd_op_reply(44 notify.0 [create] v32'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee9c01b070 con 0x7feea4032020 2024-09-22T08:37:05.666 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.646+0000 7feeac640800 1 -- 172.21.15.142:0/2486159387 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94193850398848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ab36fe51b0 con 0x7feea4032020 2024-09-22T08:37:05.666 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.646+0000 7feeac640800 1 -- 172.21.15.142:0/2486159387 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ab36fe5a00 con 0x55ab36fd94e0 2024-09-22T08:37:05.666 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.647+0000 7feeaa12a640 1 -- 172.21.15.142:0/2486159387 <== osd.2 v2:172.21.15.142:6808/279438927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94193850398848] v32'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee9c01b070 con 0x7feea4032020 2024-09-22T08:37:05.666 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.647+0000 7feea9929640 1 -- 172.21.15.142:0/2486159387 <== osd.1 v2:172.21.15.142:6816/3192108003 16 ==== osd_op_reply(46 notify.1 [create] v32'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee94051070 con 0x55ab36fd94e0 2024-09-22T08:37:05.666 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.647+0000 7feeac640800 1 -- 172.21.15.142:0/2486159387 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94193850406224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ab36fe5e20 con 0x55ab36fd94e0 2024-09-22T08:37:05.666 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.647+0000 7feeac640800 1 -- 172.21.15.142:0/2486159387 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ab36fe6670 con 0x55ab36fddef0 2024-09-22T08:37:05.666 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.648+0000 7feeaa92b640 1 -- 172.21.15.142:0/2486159387 <== osd.3 v2:172.21.15.142:6800/1064901393 14 ==== osd_op_reply(48 notify.2 [create] v32'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feea40083e0 con 0x55ab36fddef0 2024-09-22T08:37:05.666 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.648+0000 7feeac640800 1 -- 172.21.15.142:0/2486159387 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94193850408960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ab36fe6ad0 con 0x55ab36fddef0 2024-09-22T08:37:05.666 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.648+0000 7feeac640800 1 -- 172.21.15.142:0/2486159387 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ab36fe75d0 con 0x7feea4032020 2024-09-22T08:37:05.667 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.648+0000 7feea9929640 1 -- 172.21.15.142:0/2486159387 <== osd.1 v2:172.21.15.142:6816/3192108003 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94193850406224] v32'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee94051070 con 0x55ab36fd94e0 2024-09-22T08:37:05.667 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.649+0000 7feeaa92b640 1 -- 172.21.15.142:0/2486159387 <== osd.3 v2:172.21.15.142:6800/1064901393 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94193850408960] v32'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feea40083e0 con 0x55ab36fddef0 2024-09-22T08:37:05.667 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.649+0000 7feeaa12a640 1 -- 172.21.15.142:0/2486159387 <== osd.2 v2:172.21.15.142:6808/279438927 9 ==== osd_op_reply(50 notify.3 [create] v32'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee9c01b070 con 0x7feea4032020 2024-09-22T08:37:05.667 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.649+0000 7feeac640800 1 -- 172.21.15.142:0/2486159387 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94193850413248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ab36fe6520 con 0x7feea4032020 2024-09-22T08:37:05.667 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.649+0000 7feeac640800 1 -- 172.21.15.142:0/2486159387 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ab36fe7bb0 con 0x55ab36fd94e0 2024-09-22T08:37:05.667 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.650+0000 7feeaa12a640 1 -- 172.21.15.142:0/2486159387 <== osd.2 v2:172.21.15.142:6808/279438927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94193850413248] v32'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee9c01b070 con 0x7feea4032020 2024-09-22T08:37:05.672 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.650+0000 7feea9929640 1 -- 172.21.15.142:0/2486159387 <== osd.1 v2:172.21.15.142:6816/3192108003 18 ==== osd_op_reply(52 notify.4 [create] v32'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee94051070 con 0x55ab36fd94e0 2024-09-22T08:37:05.672 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.650+0000 7feeac640800 1 -- 172.21.15.142:0/2486159387 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94193850407280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ab36fe7bb0 con 0x55ab36fd94e0 2024-09-22T08:37:05.672 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.650+0000 7feeac640800 1 -- 172.21.15.142:0/2486159387 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ab36fe85c0 con 0x7fee9c01d530 2024-09-22T08:37:05.672 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.651+0000 7feea9929640 1 -- 172.21.15.142:0/2486159387 <== osd.1 v2:172.21.15.142:6816/3192108003 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94193850407280] v32'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee94051070 con 0x55ab36fd94e0 2024-09-22T08:37:05.672 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.651+0000 7feea9929640 1 -- 172.21.15.142:0/2486159387 <== osd.0 v2:172.21.15.31:6800/168281188 10 ==== osd_op_reply(54 notify.5 [create] v32'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee94051070 con 0x7fee9c01d530 2024-09-22T08:37:05.672 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.651+0000 7feeac640800 1 -- 172.21.15.142:0/2486159387 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94193850417904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ab36fe7bb0 con 0x7fee9c01d530 2024-09-22T08:37:05.673 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.652+0000 7feeac640800 1 -- 172.21.15.142:0/2486159387 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ab36fe9000 con 0x7fee9c01d530 2024-09-22T08:37:05.673 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.653+0000 7feea9929640 1 -- 172.21.15.142:0/2486159387 <== osd.0 v2:172.21.15.31:6800/168281188 11 ==== osd_op_reply(56 notify.6 [create] v32'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee94051070 con 0x7fee9c01d530 2024-09-22T08:37:05.673 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.653+0000 7feeac640800 1 -- 172.21.15.142:0/2486159387 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94193850420048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ab36fe9460 con 0x7fee9c01d530 2024-09-22T08:37:05.673 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.653+0000 7feeac640800 1 -- 172.21.15.142:0/2486159387 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ab36fe9f50 con 0x7fee9c01d530 2024-09-22T08:37:05.673 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.653+0000 7feea9929640 1 -- 172.21.15.142:0/2486159387 <== osd.0 v2:172.21.15.31:6800/168281188 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94193850417904] v32'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee94051070 con 0x7fee9c01d530 2024-09-22T08:37:05.673 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.654+0000 7feea9929640 1 -- 172.21.15.142:0/2486159387 <== osd.0 v2:172.21.15.31:6800/168281188 13 ==== osd_op_reply(58 notify.7 [create] v32'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee94051070 con 0x7fee9c01d530 2024-09-22T08:37:05.673 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.654+0000 7feeac640800 1 -- 172.21.15.142:0/2486159387 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94193850423840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ab36fe9f10 con 0x7fee9c01d530 2024-09-22T08:37:05.673 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.654+0000 7feeac640800 20 add_watcher() i=0 2024-09-22T08:37:05.673 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.654+0000 7feeac640800 20 add_watcher() i=1 2024-09-22T08:37:05.673 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.654+0000 7feeac640800 20 add_watcher() i=2 2024-09-22T08:37:05.673 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.654+0000 7feeac640800 20 add_watcher() i=3 2024-09-22T08:37:05.673 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.654+0000 7feeac640800 20 add_watcher() i=4 2024-09-22T08:37:05.673 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.654+0000 7feeac640800 20 add_watcher() i=5 2024-09-22T08:37:05.673 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.655+0000 7feea9929640 1 -- 172.21.15.142:0/2486159387 <== osd.0 v2:172.21.15.31:6800/168281188 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94193850420048] v32'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee94051070 con 0x7fee9c01d530 2024-09-22T08:37:05.674 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.655+0000 7feeac640800 20 add_watcher() i=6 2024-09-22T08:37:05.674 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.655+0000 7feea9929640 1 -- 172.21.15.142:0/2486159387 <== osd.0 v2:172.21.15.31:6800/168281188 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94193850423840] v32'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee94051070 con 0x7fee9c01d530 2024-09-22T08:37:05.674 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.655+0000 7feeac640800 20 add_watcher() i=7 2024-09-22T08:37:05.674 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.655+0000 7feeac640800 2 all 8 watchers are set, enabling cache 2024-09-22T08:37:05.674 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.655+0000 7feeac640800 1 -- 172.21.15.142:0/2486159387 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ab36fe9000 con 0x55ab36fd94e0 2024-09-22T08:37:05.674 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.656+0000 7feea9929640 1 -- 172.21.15.142:0/2486159387 <== osd.1 v2:172.21.15.142:6816/3192108003 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fee94051070 con 0x55ab36fd94e0 2024-09-22T08:37:05.674 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.656+0000 7feeac640800 1 -- 172.21.15.142:0/2486159387 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94193850414848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ab36fea7f0 con 0x55ab36fd94e0 2024-09-22T08:37:05.674 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.657+0000 7feea9929640 1 -- 172.21.15.142:0/2486159387 <== osd.1 v2:172.21.15.142:6816/3192108003 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94193850414848] v32'182 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fee94051070 con 0x55ab36fd94e0 2024-09-22T08:37:05.674 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.657+0000 7fed60fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:37:05.674 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.657+0000 7feeac640800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:37:05.674 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.657+0000 7feeac640800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:37:05.674 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.657+0000 7feeac640800 1 -- 172.21.15.142:0/2486159387 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ab36ff5ab0 con 0x55ab36fd94e0 2024-09-22T08:37:05.675 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.658+0000 7feea9929640 1 -- 172.21.15.142:0/2486159387 <== osd.1 v2:172.21.15.142:6816/3192108003 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'30 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fee9407f040 con 0x55ab36fd94e0 2024-09-22T08:37:05.675 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.658+0000 7feeac640800 1 -- 172.21.15.142:0/2486159387 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ab36ff6140 con 0x7fee9c01d530 2024-09-22T08:37:05.675 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.659+0000 7feea9929640 1 -- 172.21.15.142:0/2486159387 <== osd.0 v2:172.21.15.31:6800/168281188 16 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'24 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fee9407f040 con 0x7fee9c01d530 2024-09-22T08:37:05.675 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.659+0000 7feeac640800 1 -- 172.21.15.142:0/2486159387 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ab36ff66b0 con 0x55ab36fddef0 2024-09-22T08:37:05.675 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.660+0000 7feeaa92b640 1 -- 172.21.15.142:0/2486159387 <== osd.3 v2:172.21.15.142:6800/1064901393 16 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'25 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7feea40083e0 con 0x55ab36fddef0 2024-09-22T08:37:05.675 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.660+0000 7feeac640800 1 -- 172.21.15.142:0/2486159387 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ab36ff66b0 con 0x55ab36fd94e0 2024-09-22T08:37:05.675 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.661+0000 7feea9929640 1 -- 172.21.15.142:0/2486159387 <== osd.1 v2:172.21.15.142:6816/3192108003 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'183 uv162 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fee9407f040 con 0x55ab36fd94e0 2024-09-22T08:37:05.675 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.661+0000 7feeac640800 1 -- 172.21.15.142:0/2486159387 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ab36ff6a70 con 0x7feea4032020 2024-09-22T08:37:05.675 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.662+0000 7feeaa12a640 1 -- 172.21.15.142:0/2486159387 <== osd.2 v2:172.21.15.142:6808/279438927 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'64 uv53 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fee9c01b070 con 0x7feea4032020 2024-09-22T08:37:05.675 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.662+0000 7feeac640800 1 -- 172.21.15.142:0/2486159387 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ab36ff6fe0 con 0x55ab36fddef0 2024-09-22T08:37:05.675 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.663+0000 7feeaa92b640 1 -- 172.21.15.142:0/2486159387 <== osd.3 v2:172.21.15.142:6800/1064901393 17 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'41 uv34 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7feea40083e0 con 0x55ab36fddef0 2024-09-22T08:37:05.675 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.663+0000 7feeac640800 1 -- 172.21.15.142:0/2486159387 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ab36ff6fe0 con 0x55ab36fd94e0 2024-09-22T08:37:05.675 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.664+0000 7feea9929640 1 -- 172.21.15.142:0/2486159387 <== osd.1 v2:172.21.15.142:6816/3192108003 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'26 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fee9407f040 con 0x55ab36fd94e0 2024-09-22T08:37:05.676 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.664+0000 7feeac640800 1 -- 172.21.15.142:0/2486159387 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ab36ff7070 con 0x7fee9c01d530 2024-09-22T08:37:05.676 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.665+0000 7feea9929640 1 -- 172.21.15.142:0/2486159387 <== osd.0 v2:172.21.15.31:6800/168281188 17 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'41 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fee9407f040 con 0x7fee9c01d530 2024-09-22T08:37:05.676 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.665+0000 7feeac640800 1 -- 172.21.15.142:0/2486159387 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ab36ff70e0 con 0x7feea4032020 2024-09-22T08:37:05.676 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.666+0000 7feeaa12a640 1 -- 172.21.15.142:0/2486159387 <== osd.2 v2:172.21.15.142:6808/279438927 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'24 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fee9c01b070 con 0x7feea4032020 2024-09-22T08:37:05.676 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.666+0000 7feeac640800 1 -- 172.21.15.142:0/2486159387 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ab36ff75e0 con 0x55ab36fddef0 2024-09-22T08:37:05.676 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.667+0000 7feeaa92b640 1 -- 172.21.15.142:0/2486159387 <== osd.3 v2:172.21.15.142:6800/1064901393 18 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'30 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7feea40083e0 con 0x55ab36fddef0 2024-09-22T08:37:05.676 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.667+0000 7feeac640800 1 -- 172.21.15.142:0/2486159387 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ab36ff75e0 con 0x7feea4032020 2024-09-22T08:37:05.676 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.668+0000 7feeaa12a640 1 -- 172.21.15.142:0/2486159387 <== osd.2 v2:172.21.15.142:6808/279438927 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'65 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fee9c01b070 con 0x7feea4032020 2024-09-22T08:37:05.676 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.668+0000 7feeac640800 1 -- 172.21.15.142:0/2486159387 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ab36ff7670 con 0x7fee9c01d530 2024-09-22T08:37:05.676 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.670+0000 7feea9929640 1 -- 172.21.15.142:0/2486159387 <== osd.0 v2:172.21.15.31:6800/168281188 18 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'27 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fee9407f040 con 0x7fee9c01d530 2024-09-22T08:37:05.676 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.670+0000 7feeac640800 1 -- 172.21.15.142:0/2486159387 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ab36ff7670 con 0x7feea4032020 2024-09-22T08:37:05.676 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.670+0000 7feeaa12a640 1 -- 172.21.15.142:0/2486159387 <== osd.2 v2:172.21.15.142:6808/279438927 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'24 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fee9c01b070 con 0x7feea4032020 2024-09-22T08:37:05.676 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.670+0000 7feeac640800 1 -- 172.21.15.142:0/2486159387 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ab36ff77c0 con 0x7fee9c01d530 2024-09-22T08:37:05.678 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.672+0000 7feea9929640 1 -- 172.21.15.142:0/2486159387 <== osd.0 v2:172.21.15.31:6800/168281188 19 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'49 uv44 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fee9407f040 con 0x7fee9c01d530 2024-09-22T08:37:05.678 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.672+0000 7feeac640800 1 -- 172.21.15.142:0/2486159387 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ab36ff77c0 con 0x55ab36fd94e0 2024-09-22T08:37:05.678 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.673+0000 7feea9929640 1 -- 172.21.15.142:0/2486159387 <== osd.1 v2:172.21.15.142:6816/3192108003 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'184 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fee9407f040 con 0x55ab36fd94e0 2024-09-22T08:37:05.678 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.673+0000 7feeac640800 1 -- 172.21.15.142:0/2486159387 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ab36ff77c0 con 0x55ab36fddef0 2024-09-22T08:37:05.678 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.674+0000 7feeaa92b640 1 -- 172.21.15.142:0/2486159387 <== osd.3 v2:172.21.15.142:6800/1064901393 19 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'56 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7feea40083e0 con 0x55ab36fddef0 2024-09-22T08:37:05.678 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.674+0000 7feeac640800 1 -- 172.21.15.142:0/2486159387 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ab36ff78b0 con 0x7feea4032020 2024-09-22T08:37:05.678 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.675+0000 7feeaa12a640 1 -- 172.21.15.142:0/2486159387 <== osd.2 v2:172.21.15.142:6808/279438927 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'66 uv57 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fee9c01b070 con 0x7feea4032020 2024-09-22T08:37:05.678 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.675+0000 7feeac640800 1 -- 172.21.15.142:0/2486159387 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ab36ff78b0 con 0x55ab36fddef0 2024-09-22T08:37:05.678 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.676+0000 7feeaa92b640 1 -- 172.21.15.142:0/2486159387 <== osd.3 v2:172.21.15.142:6800/1064901393 20 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'24 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7feea40083e0 con 0x55ab36fddef0 2024-09-22T08:37:05.678 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.676+0000 7feeac640800 1 -- 172.21.15.142:0/2486159387 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ab36ff7980 con 0x55ab36fd94e0 2024-09-22T08:37:05.679 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.677+0000 7feea9929640 1 -- 172.21.15.142:0/2486159387 <== osd.1 v2:172.21.15.142:6816/3192108003 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'32 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fee9407f040 con 0x55ab36fd94e0 2024-09-22T08:37:05.679 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.677+0000 7feeac640800 1 -- 172.21.15.142:0/2486159387 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ab36ff7980 con 0x55ab36fd94e0 2024-09-22T08:37:05.679 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.678+0000 7feea9929640 1 -- 172.21.15.142:0/2486159387 <== osd.1 v2:172.21.15.142:6816/3192108003 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'185 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fee9407f040 con 0x55ab36fd94e0 2024-09-22T08:37:05.680 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.678+0000 7feeac640800 1 -- 172.21.15.142:0/2486159387 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ab36ff7980 con 0x55ab36fddef0 2024-09-22T08:37:05.680 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.679+0000 7feeaa92b640 1 -- 172.21.15.142:0/2486159387 <== osd.3 v2:172.21.15.142:6800/1064901393 21 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'57 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7feea40083e0 con 0x55ab36fddef0 2024-09-22T08:37:05.680 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.679+0000 7feeac640800 1 -- 172.21.15.142:0/2486159387 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ab36ff7980 con 0x7feea4032020 2024-09-22T08:37:05.681 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.680+0000 7feeaa12a640 1 -- 172.21.15.142:0/2486159387 <== osd.2 v2:172.21.15.142:6808/279438927 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'34 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fee9c01b070 con 0x7feea4032020 2024-09-22T08:37:05.681 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.680+0000 7feeac640800 1 -- 172.21.15.142:0/2486159387 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ab36ff7980 con 0x55ab36fddef0 2024-09-22T08:37:05.682 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.681+0000 7feeaa92b640 1 -- 172.21.15.142:0/2486159387 <== osd.3 v2:172.21.15.142:6800/1064901393 22 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'26 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7feea40083e0 con 0x55ab36fddef0 2024-09-22T08:37:05.682 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.681+0000 7feeac640800 1 -- 172.21.15.142:0/2486159387 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ab36ff79e0 con 0x55ab36fddef0 2024-09-22T08:37:05.683 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.682+0000 7feeaa92b640 1 -- 172.21.15.142:0/2486159387 <== osd.3 v2:172.21.15.142:6800/1064901393 23 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'30 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7feea40083e0 con 0x55ab36fddef0 2024-09-22T08:37:05.683 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.682+0000 7feeac640800 1 -- 172.21.15.142:0/2486159387 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ab36ff7a20 con 0x55ab36fddef0 2024-09-22T08:37:05.684 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.683+0000 7feeaa92b640 1 -- 172.21.15.142:0/2486159387 <== osd.3 v2:172.21.15.142:6800/1064901393 24 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'20 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7feea40083e0 con 0x55ab36fddef0 2024-09-22T08:37:05.684 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.683+0000 7feeac640800 1 -- 172.21.15.142:0/2486159387 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ab36ff7a50 con 0x55ab36fddef0 2024-09-22T08:37:05.685 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.684+0000 7feeaa92b640 1 -- 172.21.15.142:0/2486159387 <== osd.3 v2:172.21.15.142:6800/1064901393 25 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'42 uv36 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7feea40083e0 con 0x55ab36fddef0 2024-09-22T08:37:05.685 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.684+0000 7feeac640800 1 -- 172.21.15.142:0/2486159387 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ab36ff7a50 con 0x7fee9c01d530 2024-09-22T08:37:05.686 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.685+0000 7feea9929640 1 -- 172.21.15.142:0/2486159387 <== osd.0 v2:172.21.15.31:6800/168281188 20 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'26 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fee9407f040 con 0x7fee9c01d530 2024-09-22T08:37:05.686 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.685+0000 7feeac640800 1 -- 172.21.15.142:0/2486159387 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ab36ff7a90 con 0x55ab36fddef0 2024-09-22T08:37:05.687 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.686+0000 7feeaa92b640 1 -- 172.21.15.142:0/2486159387 <== osd.3 v2:172.21.15.142:6800/1064901393 26 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'24 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7feea40083e0 con 0x55ab36fddef0 2024-09-22T08:37:05.687 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.686+0000 7feeac640800 1 -- 172.21.15.142:0/2486159387 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ab36ff7a90 con 0x7fee9c01d530 2024-09-22T08:37:05.688 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.687+0000 7feea9929640 1 -- 172.21.15.142:0/2486159387 <== osd.0 v2:172.21.15.31:6800/168281188 21 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'42 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fee9407f040 con 0x7fee9c01d530 2024-09-22T08:37:05.688 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.687+0000 7feeac640800 1 -- 172.21.15.142:0/2486159387 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ab36ff7a90 con 0x55ab36fddef0 2024-09-22T08:37:05.689 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.688+0000 7feeaa92b640 1 -- 172.21.15.142:0/2486159387 <== osd.3 v2:172.21.15.142:6800/1064901393 27 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'58 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7feea40083e0 con 0x55ab36fddef0 2024-09-22T08:37:05.689 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.688+0000 7feeac640800 1 -- 172.21.15.142:0/2486159387 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ab36ff7a90 con 0x7fee9c01d530 2024-09-22T08:37:05.690 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.689+0000 7feea9929640 1 -- 172.21.15.142:0/2486159387 <== osd.0 v2:172.21.15.31:6800/168281188 22 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'50 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fee9407f040 con 0x7fee9c01d530 2024-09-22T08:37:05.690 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.689+0000 7feeac640800 1 -- 172.21.15.142:0/2486159387 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ab36ff7a90 con 0x7feea4032020 2024-09-22T08:37:05.691 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.690+0000 7feeaa12a640 1 -- 172.21.15.142:0/2486159387 <== osd.2 v2:172.21.15.142:6808/279438927 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'30 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fee9c01b070 con 0x7feea4032020 2024-09-22T08:37:05.692 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.691+0000 7fecdb7fe640 20 reqs_thread_entry: start 2024-09-22T08:37:05.693 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.691+0000 7feeac640800 20 init_complete bucket index max shards: 11 2024-09-22T08:37:05.693 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.691+0000 7feeac640800 20 Filter name: none 2024-09-22T08:37:05.693 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.691+0000 7fecd97fa640 20 reqs_thread_entry: start 2024-09-22T08:37:05.693 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.691+0000 7feeac640800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-22T08:37:05.693 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.691+0000 7feeac640800 20 rados->read ofs=0 len=0 2024-09-22T08:37:05.693 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.691+0000 7feeac640800 1 -- 172.21.15.142:0/2486159387 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:94 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ab37022950 con 0x7feea4032020 2024-09-22T08:37:05.693 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.691+0000 7feeaa12a640 1 -- 172.21.15.142:0/2486159387 <== osd.2 v2:172.21.15.142:6808/279438927 18 ==== osd_op_reply(94 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv33 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fee9c01b070 con 0x7feea4032020 2024-09-22T08:37:05.693 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.691+0000 7feeac640800 20 rados_obj.operate() r=0 bl.length=165 2024-09-22T08:37:05.693 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.691+0000 7feeac640800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-22T08:37:05.693 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.691+0000 7feeac640800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-22T08:37:05.693 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.691+0000 7feeac640800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:e239248c-0bee-4e41-803a-24b288d3eb8f.4226.5 : miss 2024-09-22T08:37:05.693 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.691+0000 7feeac640800 20 rados->read ofs=0 len=0 2024-09-22T08:37:05.693 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.691+0000 7feeac640800 1 -- 172.21.15.142:0/2486159387 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:95 8.1d 8:b89fd42a:root::.bucket.meta.myfoo%3ae239248c-0bee-4e41-803a-24b288d3eb8f.4226.5:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ab370242a0 con 0x7fee9c01d530 2024-09-22T08:37:05.695 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.692+0000 7feea9929640 1 -- 172.21.15.142:0/2486159387 <== osd.0 v2:172.21.15.31:6800/168281188 23 ==== osd_op_reply(95 .bucket.meta.myfoo:e239248c-0bee-4e41-803a-24b288d3eb8f.4226.5 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7fee9407f040 con 0x7fee9c01d530 2024-09-22T08:37:05.696 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.692+0000 7feeac640800 20 rados_obj.operate() r=0 bl.length=387 2024-09-22T08:37:05.696 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.692+0000 7feeac640800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:e239248c-0bee-4e41-803a-24b288d3eb8f.4226.5 info.flags=0x17 2024-09-22T08:37:05.696 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.692+0000 7feeac640800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:e239248c-0bee-4e41-803a-24b288d3eb8f.4226.5 to cache LRU end 2024-09-22T08:37:05.696 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.692+0000 7feeac640800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:37:05.696 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.692+0000 7feeac640800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-22T08:37:05.696 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.692+0000 7feeac640800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:e239248c-0bee-4e41-803a-24b288d3eb8f.4226.5 2024-09-22T08:37:05.696 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.692+0000 7feeac640800 1 -- 172.21.15.142:0/2486159387 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:96 4.8 4:10814eaa:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.5.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ab370a1790 con 0x55ab36fddef0 2024-09-22T08:37:05.696 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.692+0000 7feeaa92b640 1 -- 172.21.15.142:0/2486159387 <== osd.3 v2:172.21.15.142:6800/1064901393 28 ==== osd_op_reply(96 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.5.0 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7feea40083e0 con 0x55ab36fddef0 2024-09-22T08:37:05.696 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.692+0000 7feeac640800 1 -- 172.21.15.142:0/2486159387 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:97 4.9 4:91092a20:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.5.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ab370a1790 con 0x55ab36fd94e0 2024-09-22T08:37:05.696 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.693+0000 7feea9929640 1 -- 172.21.15.142:0/2486159387 <== osd.1 v2:172.21.15.142:6816/3192108003 28 ==== osd_op_reply(97 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.5.1 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fee9407f040 con 0x55ab36fd94e0 2024-09-22T08:37:05.696 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.693+0000 7feeac640800 1 -- 172.21.15.142:0/2486159387 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:98 4.20 4:07be7700:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.5.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ab370a1790 con 0x55ab36fd94e0 2024-09-22T08:37:05.696 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.693+0000 7feea9929640 1 -- 172.21.15.142:0/2486159387 <== osd.1 v2:172.21.15.142:6816/3192108003 29 ==== osd_op_reply(98 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.5.2 [call out=429b] v0'0 uv9 ondisk = 0) ==== 194+0+429 (crc 0 0 0) 0x7fee9407f040 con 0x55ab36fd94e0 2024-09-22T08:37:05.697 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.693+0000 7feeac640800 10 cls_bucket_list_unordered: got 9c8454ddf7aa50116496bac348d7550d 2024-09-22T08:37:05.697 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.693+0000 7feeac640800 1 -- 172.21.15.142:0/2486159387 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:99 4.32 4:4ebfd397:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.5.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ab370a17d0 con 0x55ab36fd94e0 2024-09-22T08:37:05.697 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.693+0000 7feea9929640 1 -- 172.21.15.142:0/2486159387 <== osd.1 v2:172.21.15.142:6816/3192108003 30 ==== osd_op_reply(99 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.5.3 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fee9407f040 con 0x55ab36fd94e0 2024-09-22T08:37:05.697 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.693+0000 7feeac640800 1 -- 172.21.15.142:0/2486159387 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:100 4.d 4:b174ed58:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.5.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ab370a1da0 con 0x55ab36fddef0 2024-09-22T08:37:05.697 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.694+0000 7feeaa92b640 1 -- 172.21.15.142:0/2486159387 <== osd.3 v2:172.21.15.142:6800/1064901393 29 ==== osd_op_reply(100 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.5.4 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7feea40083e0 con 0x55ab36fddef0 2024-09-22T08:37:05.697 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.694+0000 7feeac640800 1 -- 172.21.15.142:0/2486159387 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:101 4.7 4:e1335082:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.5.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ab370a1da0 con 0x7fee9c01d530 2024-09-22T08:37:05.697 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.694+0000 7feea9929640 1 -- 172.21.15.142:0/2486159387 <== osd.0 v2:172.21.15.31:6800/168281188 24 ==== osd_op_reply(101 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.5.5 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fee9407f040 con 0x7fee9c01d530 2024-09-22T08:37:05.697 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.694+0000 7feeac640800 1 -- 172.21.15.142:0/2486159387 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:102 4.36 4:6da4bf79:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.5.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ab370a1da0 con 0x55ab36fd94e0 2024-09-22T08:37:05.697 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.694+0000 7feea9929640 1 -- 172.21.15.142:0/2486159387 <== osd.1 v2:172.21.15.142:6816/3192108003 31 ==== osd_op_reply(102 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.5.6 [call out=429b] v0'0 uv7 ondisk = 0) ==== 194+0+429 (crc 0 0 0) 0x7fee9407f040 con 0x55ab36fd94e0 2024-09-22T08:37:05.697 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.694+0000 7feeac640800 10 cls_bucket_list_unordered: got b1b9a972ccd8c962a473909b97007eb4 2024-09-22T08:37:05.697 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.694+0000 7feeac640800 1 -- 172.21.15.142:0/2486159387 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:103 4.2d 4:b433ba7a:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.5.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ab370a1da0 con 0x7fee9c01d530 2024-09-22T08:37:05.699 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.695+0000 7feea9929640 1 -- 172.21.15.142:0/2486159387 <== osd.0 v2:172.21.15.31:6800/168281188 25 ==== osd_op_reply(103 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.5.7 [call out=89b] v0'0 uv7 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fee94088070 con 0x7fee9c01d530 2024-09-22T08:37:05.699 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.695+0000 7feeac640800 1 -- 172.21.15.142:0/2486159387 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:104 4.2f 4:f4785f7d:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.5.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ab370a1da0 con 0x55ab36fd94e0 2024-09-22T08:37:05.699 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.695+0000 7feea9929640 1 -- 172.21.15.142:0/2486159387 <== osd.1 v2:172.21.15.142:6816/3192108003 32 ==== osd_op_reply(104 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.5.8 [call out=430b] v0'0 uv3 ondisk = 0) ==== 194+0+430 (crc 0 0 0) 0x7fee94088070 con 0x55ab36fd94e0 2024-09-22T08:37:05.699 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.695+0000 7feeac640800 10 cls_bucket_list_unordered: got c785e1ed2950e3e36b1e2ca01f299a54 2024-09-22T08:37:05.700 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.695+0000 7feeac640800 1 -- 172.21.15.142:0/2486159387 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:105 4.31 4:8ccad44b:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.5.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ab370a1da0 con 0x55ab36fd94e0 2024-09-22T08:37:05.700 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.696+0000 7feea9929640 1 -- 172.21.15.142:0/2486159387 <== osd.1 v2:172.21.15.142:6816/3192108003 33 ==== osd_op_reply(105 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.5.9 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fee94088070 con 0x55ab36fd94e0 2024-09-22T08:37:05.700 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.696+0000 7feeac640800 1 -- 172.21.15.142:0/2486159387 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:106 4.2a 4:5772fba3:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.5.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ab370a1da0 con 0x55ab36fd94e0 2024-09-22T08:37:05.700 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.696+0000 7feea9929640 1 -- 172.21.15.142:0/2486159387 <== osd.1 v2:172.21.15.142:6816/3192108003 34 ==== osd_op_reply(106 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.5.10 [call out=700b] v0'0 uv11 ondisk = 0) ==== 195+0+700 (crc 0 0 0) 0x7fee94088070 con 0x55ab36fd94e0 2024-09-22T08:37:05.700 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.696+0000 7feeac640800 10 cls_bucket_list_unordered: got 24d27c169c2c881eb09a065116f2aa5c 2024-09-22T08:37:05.700 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.696+0000 7feeac640800 10 cls_bucket_list_unordered: got bb3aec0fdcdbc2974890f805c585d432 2024-09-22T08:37:05.700 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.696+0000 7feeac640800 20 get_obj_state: octx=0x7fee9c010b50 obj=myfoo:9c8454ddf7aa50116496bac348d7550d state=0x55ab370a0c88 s->prefetch_data=0 2024-09-22T08:37:05.700 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.696+0000 7feeac640800 1 -- 172.21.15.142:0/2486159387 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:107 3.29 3:966a1b38:::e239248c-0bee-4e41-803a-24b288d3eb8f.4226.5_9c8454ddf7aa50116496bac348d7550d:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ab3709f180 con 0x7fee9c01d530 2024-09-22T08:37:05.700 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.697+0000 7feea9929640 1 -- 172.21.15.142:0/2486159387 <== osd.0 v2:172.21.15.31:6800/168281188 26 ==== osd_op_reply(107 e239248c-0bee-4e41-803a-24b288d3eb8f.4226.5_9c8454ddf7aa50116496bac348d7550d [call out=24b,getxattrs out=886b,stat out=16b] v0'0 uv3 ondisk = 0) ==== 304+0+926 (crc 0 0 0) 0x7fee94088070 con 0x7fee9c01d530 2024-09-22T08:37:05.700 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.697+0000 7feeac640800 10 manifest: total_size = 6 2024-09-22T08:37:05.700 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.697+0000 7feeac640800 20 get_obj_state: setting s->obj_tag to e239248c-0bee-4e41-803a-24b288d3eb8f.4226.7329342275544244382 2024-09-22T08:37:05.700 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.697+0000 7feeac640800 20 get_obj_state: octx=0x7fee9c010b50 obj=myfoo:9c8454ddf7aa50116496bac348d7550d state=0x55ab370a0c88 s->prefetch_data=0 2024-09-22T08:37:05.700 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.697+0000 7feeac640800 20 prepare_atomic_modification: state is not atomic. state=0x55ab370a0c88 2024-09-22T08:37:05.700 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.697+0000 7feeac640800 20 bucket index object: :.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.5.2 2024-09-22T08:37:05.701 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.697+0000 7feeac640800 1 -- 172.21.15.142:0/2486159387 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:108 4.20 4:07be7700:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.5.2:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ab37025730 con 0x55ab36fd94e0 2024-09-22T08:37:05.701 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.698+0000 7feea9929640 1 -- 172.21.15.142:0/2486159387 <== osd.1 v2:172.21.15.142:6816/3192108003 35 ==== osd_op_reply(108 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.5.2 [stat,call,call] v32'10 uv10 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fee94088070 con 0x55ab36fd94e0 2024-09-22T08:37:05.701 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.698+0000 7feeac640800 1 -- 172.21.15.142:0/2486159387 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:109 3.29 3:966a1b38:::e239248c-0bee-4e41-803a-24b288d3eb8f.4226.5_9c8454ddf7aa50116496bac348d7550d:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ab37025730 con 0x7fee9c01d530 2024-09-22T08:37:05.702 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.699+0000 7feea9929640 1 -- 172.21.15.142:0/2486159387 <== osd.0 v2:172.21.15.31:6800/168281188 27 ==== osd_op_reply(109 e239248c-0bee-4e41-803a-24b288d3eb8f.4226.5_9c8454ddf7aa50116496bac348d7550d [call] v32'4 uv4 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7fee94088070 con 0x7fee9c01d530 2024-09-22T08:37:05.702 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.699+0000 7feeac640800 1 -- 172.21.15.142:0/2486159387 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:110 4.20 4:07be7700:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.5.2:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ab3702a520 con 0x55ab36fd94e0 2024-09-22T08:37:05.702 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.699+0000 7feeac640800 20 get_obj_state: octx=0x7fee9c010b50 obj=myfoo:b1b9a972ccd8c962a473909b97007eb4 state=0x55ab370a0c88 s->prefetch_data=0 2024-09-22T08:37:05.702 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.699+0000 7feeac640800 1 -- 172.21.15.142:0/2486159387 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:111 3.1b 3:da500b6b:::e239248c-0bee-4e41-803a-24b288d3eb8f.4226.5_b1b9a972ccd8c962a473909b97007eb4:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ab3702bc70 con 0x7fee9c01d530 2024-09-22T08:37:05.702 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.700+0000 7feea9929640 1 -- 172.21.15.142:0/2486159387 <== osd.0 v2:172.21.15.31:6800/168281188 28 ==== osd_op_reply(111 e239248c-0bee-4e41-803a-24b288d3eb8f.4226.5_b1b9a972ccd8c962a473909b97007eb4 [call out=24b,getxattrs out=886b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 304+0+926 (crc 0 0 0) 0x7fee94088070 con 0x7fee9c01d530 2024-09-22T08:37:05.703 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.700+0000 7feeac640800 10 manifest: total_size = 3 2024-09-22T08:37:05.703 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.700+0000 7feeac640800 20 get_obj_state: setting s->obj_tag to e239248c-0bee-4e41-803a-24b288d3eb8f.4226.7720896950146409975 2024-09-22T08:37:05.703 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.700+0000 7feeac640800 20 get_obj_state: octx=0x7fee9c010b50 obj=myfoo:b1b9a972ccd8c962a473909b97007eb4 state=0x55ab370a0c88 s->prefetch_data=0 2024-09-22T08:37:05.703 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.700+0000 7feeac640800 20 prepare_atomic_modification: state is not atomic. state=0x55ab370a0c88 2024-09-22T08:37:05.703 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.700+0000 7feeac640800 20 bucket index object: :.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.5.6 2024-09-22T08:37:05.703 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.700+0000 7feeac640800 1 -- 172.21.15.142:0/2486159387 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:112 4.36 4:6da4bf79:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.5.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ab3702eca0 con 0x55ab36fd94e0 2024-09-22T08:37:05.703 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.700+0000 7feea9929640 1 -- 172.21.15.142:0/2486159387 <== osd.1 v2:172.21.15.142:6816/3192108003 36 ==== osd_op_reply(110 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.5.2 [stat,call,call] v32'11 uv11 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fee94088070 con 0x55ab36fd94e0 2024-09-22T08:37:05.703 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.700+0000 7fed8dffb640 20 handle_completion(): completion ok for obj=9c8454ddf7aa50116496bac348d7550d 2024-09-22T08:37:05.703 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.701+0000 7feea9929640 1 -- 172.21.15.142:0/2486159387 <== osd.1 v2:172.21.15.142:6816/3192108003 37 ==== osd_op_reply(112 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.5.6 [stat,call,call] v32'8 uv8 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fee94088070 con 0x55ab36fd94e0 2024-09-22T08:37:05.703 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.701+0000 7feeac640800 1 -- 172.21.15.142:0/2486159387 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:113 3.1b 3:da500b6b:::e239248c-0bee-4e41-803a-24b288d3eb8f.4226.5_b1b9a972ccd8c962a473909b97007eb4:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ab3702d130 con 0x7fee9c01d530 2024-09-22T08:37:05.705 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.702+0000 7feea9929640 1 -- 172.21.15.142:0/2486159387 <== osd.0 v2:172.21.15.31:6800/168281188 29 ==== osd_op_reply(113 e239248c-0bee-4e41-803a-24b288d3eb8f.4226.5_b1b9a972ccd8c962a473909b97007eb4 [call] v32'2 uv2 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7fee94088070 con 0x7fee9c01d530 2024-09-22T08:37:05.705 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.702+0000 7feeac640800 1 -- 172.21.15.142:0/2486159387 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:114 4.36 4:6da4bf79:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.5.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ab370264e0 con 0x55ab36fd94e0 2024-09-22T08:37:05.705 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.702+0000 7feeac640800 20 get_obj_state: octx=0x7fee9c010b50 obj=myfoo:c785e1ed2950e3e36b1e2ca01f299a54 state=0x55ab370a0c88 s->prefetch_data=0 2024-09-22T08:37:05.705 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.702+0000 7feeac640800 1 -- 172.21.15.142:0/2486159387 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:115 3.2 3:40ab12b2:::e239248c-0bee-4e41-803a-24b288d3eb8f.4226.5_c785e1ed2950e3e36b1e2ca01f299a54:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ab370264e0 con 0x55ab36fddef0 2024-09-22T08:37:05.705 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.702+0000 7feeaa92b640 1 -- 172.21.15.142:0/2486159387 <== osd.3 v2:172.21.15.142:6800/1064901393 30 ==== osd_op_reply(115 e239248c-0bee-4e41-803a-24b288d3eb8f.4226.5_c785e1ed2950e3e36b1e2ca01f299a54 [call out=24b,getxattrs out=888b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 304+0+928 (crc 0 0 0) 0x7feea40083e0 con 0x55ab36fddef0 2024-09-22T08:37:05.705 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.702+0000 7feeac640800 10 manifest: total_size = 4 2024-09-22T08:37:05.705 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.702+0000 7feeac640800 20 get_obj_state: setting s->obj_tag to e239248c-0bee-4e41-803a-24b288d3eb8f.4226.10780285147645070276 2024-09-22T08:37:05.705 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.702+0000 7feeac640800 20 get_obj_state: octx=0x7fee9c010b50 obj=myfoo:c785e1ed2950e3e36b1e2ca01f299a54 state=0x55ab370a0c88 s->prefetch_data=0 2024-09-22T08:37:05.705 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.702+0000 7feeac640800 20 prepare_atomic_modification: state is not atomic. state=0x55ab370a0c88 2024-09-22T08:37:05.705 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.702+0000 7feeac640800 20 bucket index object: :.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.5.8 2024-09-22T08:37:05.705 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.702+0000 7feeac640800 1 -- 172.21.15.142:0/2486159387 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:116 4.2f 4:f4785f7d:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.5.8:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ab370264e0 con 0x55ab36fd94e0 2024-09-22T08:37:05.705 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.703+0000 7feea9929640 1 -- 172.21.15.142:0/2486159387 <== osd.1 v2:172.21.15.142:6816/3192108003 38 ==== osd_op_reply(114 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.5.6 [stat,call,call] v32'9 uv9 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fee94088070 con 0x55ab36fd94e0 2024-09-22T08:37:05.706 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.703+0000 7fed8d7fa640 20 handle_completion(): completion ok for obj=b1b9a972ccd8c962a473909b97007eb4 2024-09-22T08:37:05.706 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.704+0000 7feea9929640 1 -- 172.21.15.142:0/2486159387 <== osd.1 v2:172.21.15.142:6816/3192108003 39 ==== osd_op_reply(116 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.5.8 [stat,call,call] v32'4 uv4 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fee94088070 con 0x55ab36fd94e0 2024-09-22T08:37:05.706 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.704+0000 7feeac640800 1 -- 172.21.15.142:0/2486159387 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:117 3.2 3:40ab12b2:::e239248c-0bee-4e41-803a-24b288d3eb8f.4226.5_c785e1ed2950e3e36b1e2ca01f299a54:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ab37026010 con 0x55ab36fddef0 2024-09-22T08:37:05.707 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.705+0000 7feeaa92b640 1 -- 172.21.15.142:0/2486159387 <== osd.3 v2:172.21.15.142:6800/1064901393 31 ==== osd_op_reply(117 e239248c-0bee-4e41-803a-24b288d3eb8f.4226.5_c785e1ed2950e3e36b1e2ca01f299a54 [call] v32'2 uv2 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7feea40083e0 con 0x55ab36fddef0 2024-09-22T08:37:05.707 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.705+0000 7feeac640800 1 -- 172.21.15.142:0/2486159387 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:118 4.2f 4:f4785f7d:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.5.8:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ab37029d10 con 0x55ab36fd94e0 2024-09-22T08:37:05.707 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.705+0000 7feeac640800 20 get_obj_state: octx=0x7fee9c010b50 obj=myfoo:24d27c169c2c881eb09a065116f2aa5c state=0x55ab370a0c88 s->prefetch_data=0 2024-09-22T08:37:05.707 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.705+0000 7feeac640800 1 -- 172.21.15.142:0/2486159387 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:119 3.d 3:b0eb2c4d:::e239248c-0bee-4e41-803a-24b288d3eb8f.4226.5_24d27c169c2c881eb09a065116f2aa5c:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ab3702cc80 con 0x55ab36fddef0 2024-09-22T08:37:05.707 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.705+0000 7feeaa92b640 1 -- 172.21.15.142:0/2486159387 <== osd.3 v2:172.21.15.142:6800/1064901393 32 ==== osd_op_reply(119 e239248c-0bee-4e41-803a-24b288d3eb8f.4226.5_24d27c169c2c881eb09a065116f2aa5c [call out=24b,getxattrs out=884b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 304+0+924 (crc 0 0 0) 0x7feea40083e0 con 0x55ab36fddef0 2024-09-22T08:37:05.708 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.705+0000 7feeac640800 10 manifest: total_size = 5 2024-09-22T08:37:05.708 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.705+0000 7feeac640800 20 get_obj_state: setting s->obj_tag to e239248c-0bee-4e41-803a-24b288d3eb8f.4226.815222531957862591 2024-09-22T08:37:05.708 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.705+0000 7feeac640800 20 get_obj_state: octx=0x7fee9c010b50 obj=myfoo:24d27c169c2c881eb09a065116f2aa5c state=0x55ab370a0c88 s->prefetch_data=0 2024-09-22T08:37:05.708 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.705+0000 7feeac640800 20 prepare_atomic_modification: state is not atomic. state=0x55ab370a0c88 2024-09-22T08:37:05.708 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.705+0000 7feeac640800 20 bucket index object: :.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.5.10 2024-09-22T08:37:05.708 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.705+0000 7feeac640800 1 -- 172.21.15.142:0/2486159387 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:120 4.2a 4:5772fba3:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ab3702e1f0 con 0x55ab36fd94e0 2024-09-22T08:37:05.708 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.706+0000 7feea9929640 1 -- 172.21.15.142:0/2486159387 <== osd.1 v2:172.21.15.142:6816/3192108003 40 ==== osd_op_reply(118 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.5.8 [stat,call,call] v32'5 uv5 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fee94088070 con 0x55ab36fd94e0 2024-09-22T08:37:05.708 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.706+0000 7fed8dffb640 20 handle_completion(): completion ok for obj=c785e1ed2950e3e36b1e2ca01f299a54 2024-09-22T08:37:05.708 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.706+0000 7feea9929640 1 -- 172.21.15.142:0/2486159387 <== osd.1 v2:172.21.15.142:6816/3192108003 41 ==== osd_op_reply(120 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.5.10 [stat,call,call] v32'12 uv12 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7fee94088070 con 0x55ab36fd94e0 2024-09-22T08:37:05.708 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.706+0000 7feeac640800 1 -- 172.21.15.142:0/2486159387 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:121 3.d 3:b0eb2c4d:::e239248c-0bee-4e41-803a-24b288d3eb8f.4226.5_24d27c169c2c881eb09a065116f2aa5c:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ab3702e7d0 con 0x55ab36fddef0 2024-09-22T08:37:05.709 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.707+0000 7feeaa92b640 1 -- 172.21.15.142:0/2486159387 <== osd.3 v2:172.21.15.142:6800/1064901393 33 ==== osd_op_reply(121 e239248c-0bee-4e41-803a-24b288d3eb8f.4226.5_24d27c169c2c881eb09a065116f2aa5c [call] v32'2 uv2 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7feea40083e0 con 0x55ab36fddef0 2024-09-22T08:37:05.710 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.707+0000 7feeac640800 1 -- 172.21.15.142:0/2486159387 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:122 4.2a 4:5772fba3:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ab3702e1f0 con 0x55ab36fd94e0 2024-09-22T08:37:05.710 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.707+0000 7feeac640800 20 get_obj_state: octx=0x7fee9c010b50 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x55ab370a0c88 s->prefetch_data=0 2024-09-22T08:37:05.710 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.707+0000 7feeac640800 1 -- 172.21.15.142:0/2486159387 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:123 3.3a 3:5da07612:::e239248c-0bee-4e41-803a-24b288d3eb8f.4226.5_bb3aec0fdcdbc2974890f805c585d432:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ab3702e1f0 con 0x7feea4032020 2024-09-22T08:37:05.710 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.708+0000 7feeaa12a640 1 -- 172.21.15.142:0/2486159387 <== osd.2 v2:172.21.15.142:6808/279438927 19 ==== osd_op_reply(123 e239248c-0bee-4e41-803a-24b288d3eb8f.4226.5_bb3aec0fdcdbc2974890f805c585d432 [call out=24b,getxattrs out=919b,stat out=16b] v0'0 uv3 ondisk = 0) ==== 304+0+959 (crc 0 0 0) 0x7fee9c01b070 con 0x7feea4032020 2024-09-22T08:37:05.710 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.708+0000 7feeac640800 10 manifest: total_size = 5 2024-09-22T08:37:05.710 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.708+0000 7feeac640800 20 get_obj_state: setting s->obj_tag to _z3ovj-gs1ORUxcb84k_78n2WxeQutKT 2024-09-22T08:37:05.710 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.708+0000 7feeac640800 20 get_obj_state: octx=0x7fee9c010b50 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x55ab370a0c88 s->prefetch_data=0 2024-09-22T08:37:05.710 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.708+0000 7feeac640800 20 prepare_atomic_modification: state is not atomic. state=0x55ab370a0c88 2024-09-22T08:37:05.710 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.708+0000 7feeac640800 20 bucket index object: :.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.5.10 2024-09-22T08:37:05.710 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.708+0000 7feeac640800 1 -- 172.21.15.142:0/2486159387 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:124 4.2a 4:5772fba3:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ab3702e1f0 con 0x55ab36fd94e0 2024-09-22T08:37:05.710 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.709+0000 7feea9929640 1 -- 172.21.15.142:0/2486159387 <== osd.1 v2:172.21.15.142:6816/3192108003 42 ==== osd_op_reply(122 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.5.10 [stat,call,call] v32'13 uv13 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7fee94088070 con 0x55ab36fd94e0 2024-09-22T08:37:05.710 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.709+0000 7fed8d7fa640 20 handle_completion(): completion ok for obj=24d27c169c2c881eb09a065116f2aa5c 2024-09-22T08:37:05.711 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.709+0000 7feea9929640 1 -- 172.21.15.142:0/2486159387 <== osd.1 v2:172.21.15.142:6816/3192108003 43 ==== osd_op_reply(124 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.5.10 [stat,call,call] v32'14 uv14 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7fee94088070 con 0x55ab36fd94e0 2024-09-22T08:37:05.711 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.709+0000 7feeac640800 1 -- 172.21.15.142:0/2486159387 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:125 3.3a 3:5da07612:::e239248c-0bee-4e41-803a-24b288d3eb8f.4226.5_bb3aec0fdcdbc2974890f805c585d432:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ab3702e1f0 con 0x7feea4032020 2024-09-22T08:37:05.715 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.710+0000 7feeaa12a640 1 -- 172.21.15.142:0/2486159387 <== osd.2 v2:172.21.15.142:6808/279438927 20 ==== osd_op_reply(125 e239248c-0bee-4e41-803a-24b288d3eb8f.4226.5_bb3aec0fdcdbc2974890f805c585d432 [call] v32'4 uv4 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7fee9c01b070 con 0x7feea4032020 2024-09-22T08:37:05.715 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.710+0000 7feeac640800 1 -- 172.21.15.142:0/2486159387 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:126 4.2a 4:5772fba3:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ab3702e1f0 con 0x55ab36fd94e0 2024-09-22T08:37:05.715 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.710+0000 7feeac640800 20 list_objects_ordered: starting attempt 1 2024-09-22T08:37:05.715 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.710+0000 7feeac640800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-22T08:37:05.715 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.710+0000 7feeac640800 1 -- 172.21.15.142:0/2486159387 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:127 4.8 4:10814eaa:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.5.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ab3702e1f0 con 0x55ab36fddef0 2024-09-22T08:37:05.715 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.710+0000 7feeac640800 1 -- 172.21.15.142:0/2486159387 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:128 4.9 4:91092a20:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.5.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ab370a0aa0 con 0x55ab36fd94e0 2024-09-22T08:37:05.715 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.710+0000 7feeac640800 1 -- 172.21.15.142:0/2486159387 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:129 4.20 4:07be7700:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.5.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ab3702e1f0 con 0x55ab36fd94e0 2024-09-22T08:37:05.715 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.710+0000 7feeac640800 1 -- 172.21.15.142:0/2486159387 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:130 4.32 4:4ebfd397:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.5.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ab37030cf0 con 0x55ab36fd94e0 2024-09-22T08:37:05.715 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.711+0000 7feeac640800 1 -- 172.21.15.142:0/2486159387 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:131 4.d 4:b174ed58:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.5.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ab37030cf0 con 0x55ab36fddef0 2024-09-22T08:37:05.715 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.711+0000 7feea9929640 1 -- 172.21.15.142:0/2486159387 <== osd.1 v2:172.21.15.142:6816/3192108003 44 ==== osd_op_reply(128 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.5.1 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fee94088070 con 0x55ab36fd94e0 2024-09-22T08:37:05.716 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.711+0000 7feea9929640 1 -- 172.21.15.142:0/2486159387 <== osd.1 v2:172.21.15.142:6816/3192108003 45 ==== osd_op_reply(129 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.5.2 [call out=128b] v0'0 uv11 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7fee94088070 con 0x55ab36fd94e0 2024-09-22T08:37:05.716 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.711+0000 7feeac640800 1 -- 172.21.15.142:0/2486159387 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:132 4.7 4:e1335082:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.5.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ab370388a0 con 0x7fee9c01d530 2024-09-22T08:37:05.716 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.711+0000 7feeaa92b640 1 -- 172.21.15.142:0/2486159387 <== osd.3 v2:172.21.15.142:6800/1064901393 34 ==== osd_op_reply(127 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.5.0 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7feea40083e0 con 0x55ab36fddef0 2024-09-22T08:37:05.716 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.711+0000 7feea9929640 1 -- 172.21.15.142:0/2486159387 <== osd.1 v2:172.21.15.142:6816/3192108003 46 ==== osd_op_reply(130 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.5.3 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fee94088070 con 0x55ab36fd94e0 2024-09-22T08:37:05.716 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.711+0000 7feeac640800 1 -- 172.21.15.142:0/2486159387 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:133 4.36 4:6da4bf79:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.5.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ab37030cf0 con 0x55ab36fd94e0 2024-09-22T08:37:05.716 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.711+0000 7feeac640800 1 -- 172.21.15.142:0/2486159387 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:134 4.2d 4:b433ba7a:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.5.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ab37030870 con 0x7fee9c01d530 2024-09-22T08:37:05.716 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.711+0000 7feeac640800 1 -- 172.21.15.142:0/2486159387 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:135 4.2f 4:f4785f7d:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.5.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ab37030870 con 0x55ab36fd94e0 2024-09-22T08:37:05.716 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.711+0000 7feeac640800 1 -- 172.21.15.142:0/2486159387 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:136 4.31 4:8ccad44b:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.5.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ab37028890 con 0x55ab36fd94e0 2024-09-22T08:37:05.716 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.711+0000 7feeac640800 1 -- 172.21.15.142:0/2486159387 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:137 4.2a 4:5772fba3:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.5.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ab3703e350 con 0x55ab36fd94e0 2024-09-22T08:37:05.716 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.711+0000 7feeaa92b640 1 -- 172.21.15.142:0/2486159387 <== osd.3 v2:172.21.15.142:6800/1064901393 35 ==== osd_op_reply(131 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.5.4 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7feea40083e0 con 0x55ab36fddef0 2024-09-22T08:37:05.716 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.711+0000 7feea9929640 1 -- 172.21.15.142:0/2486159387 <== osd.0 v2:172.21.15.31:6800/168281188 30 ==== osd_op_reply(132 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.5.5 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fee94088070 con 0x7fee9c01d530 2024-09-22T08:37:05.716 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.711+0000 7feea9929640 1 -- 172.21.15.142:0/2486159387 <== osd.0 v2:172.21.15.31:6800/168281188 31 ==== osd_op_reply(134 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.5.7 [call out=89b] v0'0 uv7 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fee94088070 con 0x7fee9c01d530 2024-09-22T08:37:05.716 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.711+0000 7feea9929640 1 -- 172.21.15.142:0/2486159387 <== osd.1 v2:172.21.15.142:6816/3192108003 47 ==== osd_op_reply(133 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.5.6 [call out=128b] v0'0 uv9 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7fee94088070 con 0x55ab36fd94e0 2024-09-22T08:37:05.716 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.712+0000 7feea9929640 1 -- 172.21.15.142:0/2486159387 <== osd.1 v2:172.21.15.142:6816/3192108003 48 ==== osd_op_reply(135 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.5.8 [call out=128b] v0'0 uv5 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7fee94088070 con 0x55ab36fd94e0 2024-09-22T08:37:05.717 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.712+0000 7feea9929640 1 -- 172.21.15.142:0/2486159387 <== osd.1 v2:172.21.15.142:6816/3192108003 49 ==== osd_op_reply(136 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.5.9 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fee94088070 con 0x55ab36fd94e0 2024-09-22T08:37:05.717 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.712+0000 7feea9929640 1 -- 172.21.15.142:0/2486159387 <== osd.1 v2:172.21.15.142:6816/3192108003 50 ==== osd_op_reply(126 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.5.10 [stat,call,call] v32'15 uv15 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7fee94088070 con 0x55ab36fd94e0 2024-09-22T08:37:05.717 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.712+0000 7fed8d7fa640 20 handle_completion(): completion ok for obj=bb3aec0fdcdbc2974890f805c585d432 2024-09-22T08:37:05.717 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.712+0000 7feea9929640 1 -- 172.21.15.142:0/2486159387 <== osd.1 v2:172.21.15.142:6816/3192108003 51 ==== osd_op_reply(137 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.5.10 [call out=128b] v0'0 uv15 ondisk = 0) ==== 195+0+128 (crc 0 0 0) 0x7fee94088070 con 0x55ab36fd94e0 2024-09-22T08:37:05.717 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.712+0000 7feeac640800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-22T08:37:05.717 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.712+0000 7feeac640800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-22T08:37:05.717 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.712+0000 7feeac640800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-22T08:37:05.717 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.712+0000 7feeac640800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-22T08:37:05.717 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.712+0000 7feeac640800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo[e239248c-0bee-4e41-803a-24b288d3eb8f.4226.5])"; uploads.size()=0; is_truncated=0 2024-09-22T08:37:05.717 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.712+0000 7feeac640800 1 -- 172.21.15.142:0/2486159387 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:138 4.8 4:10814eaa:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.5.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ab37030870 con 0x55ab36fddef0 2024-09-22T08:37:05.717 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.712+0000 7feeac640800 1 -- 172.21.15.142:0/2486159387 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:139 4.9 4:91092a20:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.5.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ab37029d10 con 0x55ab36fd94e0 2024-09-22T08:37:05.717 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.712+0000 7feeac640800 1 -- 172.21.15.142:0/2486159387 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:140 4.20 4:07be7700:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.5.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ab37027ec0 con 0x55ab36fd94e0 2024-09-22T08:37:05.717 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.712+0000 7feeac640800 1 -- 172.21.15.142:0/2486159387 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:141 4.32 4:4ebfd397:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.5.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ab3703adb0 con 0x55ab36fd94e0 2024-09-22T08:37:05.717 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.712+0000 7feeac640800 1 -- 172.21.15.142:0/2486159387 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:142 4.d 4:b174ed58:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.5.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ab3703d710 con 0x55ab36fddef0 2024-09-22T08:37:05.718 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.712+0000 7feeac640800 1 -- 172.21.15.142:0/2486159387 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:143 4.7 4:e1335082:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.5.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ab370333a0 con 0x7fee9c01d530 2024-09-22T08:37:05.718 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.712+0000 7feeac640800 1 -- 172.21.15.142:0/2486159387 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:144 4.36 4:6da4bf79:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.5.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ab37029d10 con 0x55ab36fd94e0 2024-09-22T08:37:05.718 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.712+0000 7feeac640800 1 -- 172.21.15.142:0/2486159387 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:145 4.2d 4:b433ba7a:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.5.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ab37030870 con 0x7fee9c01d530 2024-09-22T08:37:05.718 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.712+0000 7feeac640800 1 -- 172.21.15.142:0/2486159387 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:146 4.2f 4:f4785f7d:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.5.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ab37027ec0 con 0x55ab36fd94e0 2024-09-22T08:37:05.718 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.712+0000 7feeac640800 1 -- 172.21.15.142:0/2486159387 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:147 4.31 4:8ccad44b:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.5.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ab37029d10 con 0x55ab36fd94e0 2024-09-22T08:37:05.718 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.712+0000 7feeac640800 1 -- 172.21.15.142:0/2486159387 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:148 4.2a 4:5772fba3:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.5.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ab3703d710 con 0x55ab36fd94e0 2024-09-22T08:37:05.718 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.712+0000 7feeaa92b640 1 -- 172.21.15.142:0/2486159387 <== osd.3 v2:172.21.15.142:6800/1064901393 36 ==== osd_op_reply(138 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.5.0 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7feea40083e0 con 0x55ab36fddef0 2024-09-22T08:37:05.718 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.712+0000 7feea9929640 1 -- 172.21.15.142:0/2486159387 <== osd.1 v2:172.21.15.142:6816/3192108003 52 ==== osd_op_reply(139 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.5.1 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fee94088070 con 0x55ab36fd94e0 2024-09-22T08:37:05.718 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.712+0000 7feea9929640 1 -- 172.21.15.142:0/2486159387 <== osd.1 v2:172.21.15.142:6816/3192108003 53 ==== osd_op_reply(141 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.5.3 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fee94088070 con 0x55ab36fd94e0 2024-09-22T08:37:05.718 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.713+0000 7feea9929640 1 -- 172.21.15.142:0/2486159387 <== osd.1 v2:172.21.15.142:6816/3192108003 54 ==== osd_op_reply(140 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.5.2 [call out=128b] v0'0 uv11 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7fee94088070 con 0x55ab36fd94e0 2024-09-22T08:37:05.718 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.713+0000 7feea9929640 1 -- 172.21.15.142:0/2486159387 <== osd.1 v2:172.21.15.142:6816/3192108003 55 ==== osd_op_reply(144 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.5.6 [call out=128b] v0'0 uv9 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7fee94088070 con 0x55ab36fd94e0 2024-09-22T08:37:05.718 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.713+0000 7feea9929640 1 -- 172.21.15.142:0/2486159387 <== osd.1 v2:172.21.15.142:6816/3192108003 56 ==== osd_op_reply(146 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.5.8 [call out=128b] v0'0 uv5 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7fee94088070 con 0x55ab36fd94e0 2024-09-22T08:37:05.718 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.713+0000 7feeaa92b640 1 -- 172.21.15.142:0/2486159387 <== osd.3 v2:172.21.15.142:6800/1064901393 37 ==== osd_op_reply(142 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.5.4 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7feea40083e0 con 0x55ab36fddef0 2024-09-22T08:37:05.719 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.713+0000 7feea9929640 1 -- 172.21.15.142:0/2486159387 <== osd.0 v2:172.21.15.31:6800/168281188 32 ==== osd_op_reply(143 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.5.5 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fee94088070 con 0x7fee9c01d530 2024-09-22T08:37:05.719 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.713+0000 7feea9929640 1 -- 172.21.15.142:0/2486159387 <== osd.0 v2:172.21.15.31:6800/168281188 33 ==== osd_op_reply(145 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.5.7 [call out=89b] v0'0 uv7 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fee94088070 con 0x7fee9c01d530 2024-09-22T08:37:05.719 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.713+0000 7feea9929640 1 -- 172.21.15.142:0/2486159387 <== osd.1 v2:172.21.15.142:6816/3192108003 57 ==== osd_op_reply(147 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.5.9 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fee94088070 con 0x55ab36fd94e0 2024-09-22T08:37:05.719 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.713+0000 7feea9929640 1 -- 172.21.15.142:0/2486159387 <== osd.1 v2:172.21.15.142:6816/3192108003 58 ==== osd_op_reply(148 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.5.10 [call out=128b] v0'0 uv15 ondisk = 0) ==== 195+0+128 (crc 0 0 0) 0x7fee94088070 con 0x55ab36fd94e0 2024-09-22T08:37:05.719 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.713+0000 7feeac640800 1 -- 172.21.15.142:0/2486159387 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:149 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ab37027ec0 con 0x7feea4032020 2024-09-22T08:37:05.723 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.714+0000 7feeaa12a640 1 -- 172.21.15.142:0/2486159387 <== osd.2 v2:172.21.15.142:6808/279438927 21 ==== osd_op_reply(149 foo.buckets [call] v32'37 uv37 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fee9c01b070 con 0x7feea4032020 2024-09-22T08:37:05.723 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.714+0000 7feeac640800 10 cache get: name=default.rgw.meta+root+myfoo : hit (requested=0x11, cached=0x11) 2024-09-22T08:37:05.723 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.714+0000 7feeac640800 1 -- 172.21.15.142:0/2486159387 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:150 8.9 8:91b71841:root::myfoo:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ab3709f440 con 0x7feea4032020 2024-09-22T08:37:05.723 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.715+0000 7feeaa12a640 1 -- 172.21.15.142:0/2486159387 <== osd.2 v2:172.21.15.142:6808/279438927 22 ==== osd_op_reply(150 myfoo [call,call,delete] v32'38 uv38 ondisk = 0) ==== 233+0+0 (crc 0 0 0) 0x7fee9c01b070 con 0x7feea4032020 2024-09-22T08:37:05.723 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.715+0000 7feeac640800 10 removing default.rgw.meta+root+myfoo from cache 2024-09-22T08:37:05.723 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.715+0000 7feeac640800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-22T08:37:05.724 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.715+0000 7feeac640800 1 -- 172.21.15.142:0/2486159387 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:151 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94193851167808 in=161b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ab3703db10 con 0x7fee9c01d530 2024-09-22T08:37:05.724 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.716+0000 7feea9929640 1 -- 172.21.15.142:0/2486159387 <== osd.0 v2:172.21.15.31:6800/168281188 34 ==== watch-notify(notify (1) cookie 94193850420048 notify 137438953490 ret 0) ==== 191+0+0 (crc 0 0 0) 0x55ab370237b0 con 0x7fee9c01d530 2024-09-22T08:37:05.724 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.716+0000 7fed8d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953490 cookie 94193850420048 notifier 4646 bl.length()=149 2024-09-22T08:37:05.724 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.716+0000 7feea9929640 1 -- 172.21.15.142:0/2486159387 <== osd.0 v2:172.21.15.31:6800/168281188 35 ==== osd_op_reply(151 notify.6 [notify cookie 94193851167808 out=8b] v0'0 uv177 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fee94088070 con 0x7fee9c01d530 2024-09-22T08:37:05.724 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.716+0000 7fed8d7fa640 1 -- 172.21.15.142:0/2486159387 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:152 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fece00032c0 con 0x7fee9c01d530 2024-09-22T08:37:05.724 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.716+0000 7feea9929640 1 -- 172.21.15.142:0/2486159387 <== osd.0 v2:172.21.15.31:6800/168281188 36 ==== osd_op_reply(152 notify.6 [notify-ack] v0'0 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee94088070 con 0x7fee9c01d530 2024-09-22T08:37:05.724 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.716+0000 7feea9929640 1 -- 172.21.15.142:0/2486159387 <== osd.0 v2:172.21.15.31:6800/168281188 37 ==== watch-notify(notify_complete (2) cookie 94193851167808 notify 137438953490 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55ab36ff6310 con 0x7fee9c01d530 2024-09-22T08:37:05.724 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.716+0000 7feeac640800 1 -- 172.21.15.142:0/2486159387 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:153 8.1d 8:b89fd42a:root::.bucket.meta.myfoo%3ae239248c-0bee-4e41-803a-24b288d3eb8f.4226.5:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ab3709f440 con 0x7fee9c01d530 2024-09-22T08:37:05.724 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.717+0000 7feea9929640 1 -- 172.21.15.142:0/2486159387 <== osd.0 v2:172.21.15.31:6800/168281188 38 ==== osd_op_reply(153 .bucket.meta.myfoo:e239248c-0bee-4e41-803a-24b288d3eb8f.4226.5 [call,call,delete] v32'2 uv2 ondisk = 0) ==== 290+0+0 (crc 0 0 0) 0x7fee94088070 con 0x7fee9c01d530 2024-09-22T08:37:05.724 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.717+0000 7feeac640800 10 removing default.rgw.meta+root+.bucket.meta.myfoo:e239248c-0bee-4e41-803a-24b288d3eb8f.4226.5 from cache 2024-09-22T08:37:05.724 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.717+0000 7feeac640800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo:e239248c-0bee-4e41-803a-24b288d3eb8f.4226.5, ofs0, ns] 2024-09-22T08:37:05.724 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.717+0000 7feeac640800 1 -- 172.21.15.142:0/2486159387 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:154 7.e 7:7759931f:::notify.3:head [notify cookie 94193850663440 in=218b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ab3709f440 con 0x7feea4032020 2024-09-22T08:37:05.724 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.717+0000 7feeaa12a640 1 -- 172.21.15.142:0/2486159387 <== osd.2 v2:172.21.15.142:6808/279438927 23 ==== watch-notify(notify (1) cookie 94193850413248 notify 137438953497 ret 0) ==== 248+0+0 (crc 0 0 0) 0x55ab36ff6a30 con 0x7feea4032020 2024-09-22T08:37:05.724 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.717+0000 7fed8dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953497 cookie 94193850413248 notifier 4646 bl.length()=206 2024-09-22T08:37:05.725 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.717+0000 7fed8dffb640 1 -- 172.21.15.142:0/2486159387 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:155 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fed70003d60 con 0x7feea4032020 2024-09-22T08:37:05.725 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.717+0000 7feeaa12a640 1 -- 172.21.15.142:0/2486159387 <== osd.2 v2:172.21.15.142:6808/279438927 24 ==== osd_op_reply(154 notify.3 [notify cookie 94193850663440 out=8b] v0'0 uv177 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fee9c01b070 con 0x7feea4032020 2024-09-22T08:37:05.725 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.718+0000 7feeaa12a640 1 -- 172.21.15.142:0/2486159387 <== osd.2 v2:172.21.15.142:6808/279438927 25 ==== osd_op_reply(155 notify.3 [notify-ack] v0'0 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee9c01b070 con 0x7feea4032020 2024-09-22T08:37:05.725 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.718+0000 7feeaa12a640 1 -- 172.21.15.142:0/2486159387 <== osd.2 v2:172.21.15.142:6808/279438927 26 ==== watch-notify(notify_complete (2) cookie 94193850663440 notify 137438953497 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55ab36ff6e10 con 0x7feea4032020 2024-09-22T08:37:05.725 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.718+0000 7feeac640800 1 -- 172.21.15.142:0/2486159387 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:156 4.8 4:10814eaa:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.5.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ab3709f440 con 0x55ab36fddef0 2024-09-22T08:37:05.725 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.718+0000 7feeac640800 1 -- 172.21.15.142:0/2486159387 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:157 4.9 4:91092a20:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.5.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ab3703db10 con 0x55ab36fd94e0 2024-09-22T08:37:05.725 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.718+0000 7feeac640800 1 -- 172.21.15.142:0/2486159387 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:158 4.20 4:07be7700:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.5.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ab37028370 con 0x55ab36fd94e0 2024-09-22T08:37:05.725 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.718+0000 7feeac640800 1 -- 172.21.15.142:0/2486159387 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:159 4.32 4:4ebfd397:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.5.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ab37027190 con 0x55ab36fd94e0 2024-09-22T08:37:05.725 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.718+0000 7feeac640800 1 -- 172.21.15.142:0/2486159387 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:160 4.d 4:b174ed58:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.5.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ab3709f440 con 0x55ab36fddef0 2024-09-22T08:37:05.725 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.718+0000 7feeac640800 1 -- 172.21.15.142:0/2486159387 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:161 4.7 4:e1335082:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.5.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ab37028370 con 0x7fee9c01d530 2024-09-22T08:37:05.725 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.718+0000 7feeac640800 1 -- 172.21.15.142:0/2486159387 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:162 4.36 4:6da4bf79:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.5.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ab37027190 con 0x55ab36fd94e0 2024-09-22T08:37:05.725 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.718+0000 7feeac640800 1 -- 172.21.15.142:0/2486159387 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:163 4.2d 4:b433ba7a:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.5.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ab37028370 con 0x7fee9c01d530 2024-09-22T08:37:05.725 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.718+0000 7feeac640800 1 -- 172.21.15.142:0/2486159387 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:164 4.2f 4:f4785f7d:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.5.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ab3709f440 con 0x55ab36fd94e0 2024-09-22T08:37:05.725 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.718+0000 7feeac640800 1 -- 172.21.15.142:0/2486159387 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:165 4.31 4:8ccad44b:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.5.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ab37028370 con 0x55ab36fd94e0 2024-09-22T08:37:05.726 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.718+0000 7feeac640800 1 -- 172.21.15.142:0/2486159387 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:166 4.2a 4:5772fba3:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.5.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ab37027190 con 0x55ab36fd94e0 2024-09-22T08:37:05.726 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.719+0000 7feea9929640 1 -- 172.21.15.142:0/2486159387 <== osd.0 v2:172.21.15.31:6800/168281188 39 ==== osd_op_reply(163 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.5.7 [delete] v32'8 uv8 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fee94088070 con 0x7fee9c01d530 2024-09-22T08:37:05.726 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.720+0000 7feea9929640 1 -- 172.21.15.142:0/2486159387 <== osd.0 v2:172.21.15.31:6800/168281188 40 ==== osd_op_reply(161 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.5.5 [delete] v32'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fee94088070 con 0x7fee9c01d530 2024-09-22T08:37:05.726 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.720+0000 7feeaa92b640 1 -- 172.21.15.142:0/2486159387 <== osd.3 v2:172.21.15.142:6800/1064901393 38 ==== osd_op_reply(156 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.5.0 [delete] v32'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7feea40083e0 con 0x55ab36fddef0 2024-09-22T08:37:05.726 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.720+0000 7feea9929640 1 -- 172.21.15.142:0/2486159387 <== osd.1 v2:172.21.15.142:6816/3192108003 59 ==== osd_op_reply(157 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.5.1 [delete] v32'8 uv8 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fee94088070 con 0x55ab36fd94e0 2024-09-22T08:37:05.726 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.720+0000 7feeaa92b640 1 -- 172.21.15.142:0/2486159387 <== osd.3 v2:172.21.15.142:6800/1064901393 39 ==== osd_op_reply(160 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.5.4 [delete] v32'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7feea40083e0 con 0x55ab36fddef0 2024-09-22T08:37:05.726 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.720+0000 7feea9929640 1 -- 172.21.15.142:0/2486159387 <== osd.1 v2:172.21.15.142:6816/3192108003 60 ==== osd_op_reply(162 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.5.6 [delete] v32'10 uv10 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fee94088070 con 0x55ab36fd94e0 2024-09-22T08:37:05.726 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.720+0000 7feea9929640 1 -- 172.21.15.142:0/2486159387 <== osd.1 v2:172.21.15.142:6816/3192108003 61 ==== osd_op_reply(159 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.5.3 [delete] v32'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fee94088070 con 0x55ab36fd94e0 2024-09-22T08:37:05.726 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.720+0000 7feea9929640 1 -- 172.21.15.142:0/2486159387 <== osd.1 v2:172.21.15.142:6816/3192108003 62 ==== osd_op_reply(164 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.5.8 [delete] v32'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fee94088070 con 0x55ab36fd94e0 2024-09-22T08:37:05.726 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.720+0000 7feea9929640 1 -- 172.21.15.142:0/2486159387 <== osd.1 v2:172.21.15.142:6816/3192108003 63 ==== osd_op_reply(165 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.5.9 [delete] v32'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fee94088070 con 0x55ab36fd94e0 2024-09-22T08:37:05.726 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.721+0000 7feea9929640 1 -- 172.21.15.142:0/2486159387 <== osd.1 v2:172.21.15.142:6816/3192108003 64 ==== osd_op_reply(166 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.5.10 [delete] v32'16 uv16 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7fee94088070 con 0x55ab36fd94e0 2024-09-22T08:37:05.726 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.722+0000 7feea9929640 1 -- 172.21.15.142:0/2486159387 <== osd.1 v2:172.21.15.142:6816/3192108003 65 ==== osd_op_reply(158 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.5.2 [delete] v32'12 uv12 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fee94088070 con 0x55ab36fd94e0 2024-09-22T08:37:05.726 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.722+0000 7feeac640800 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo/e239248c-0bee-4e41-803a-24b288d3eb8f.4226.5 : miss 2024-09-22T08:37:05.726 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.722+0000 7feeac640800 20 rados->read ofs=0 len=0 2024-09-22T08:37:05.727 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.722+0000 7feeac640800 1 -- 172.21.15.142:0/2486159387 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:167 6.9 6:91e8edb6:::pubsub..bucket.myfoo%2fe239248c-0bee-4e41-803a-24b288d3eb8f.4226.5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ab3709f440 con 0x55ab36fddef0 2024-09-22T08:37:05.727 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.722+0000 7feeaa92b640 1 -- 172.21.15.142:0/2486159387 <== osd.3 v2:172.21.15.142:6800/1064901393 40 ==== osd_op_reply(167 pubsub..bucket.myfoo/e239248c-0bee-4e41-803a-24b288d3eb8f.4226.5 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 208+0+0 (crc 0 0 0) 0x7feea40083e0 con 0x55ab36fddef0 2024-09-22T08:37:05.727 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.722+0000 7feeac640800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:05.727 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.722+0000 7feeac640800 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo/e239248c-0bee-4e41-803a-24b288d3eb8f.4226.5 info.flags=0x0 2024-09-22T08:37:05.727 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.722+0000 7feeac640800 10 adding default.rgw.log++pubsub..bucket.myfoo/e239248c-0bee-4e41-803a-24b288d3eb8f.4226.5 to cache LRU end 2024-09-22T08:37:05.727 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.722+0000 7feeac640800 1 -- 172.21.15.142:0/2486159387 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:168 6.9 6:91e8edb6:::pubsub..bucket.myfoo%2fe239248c-0bee-4e41-803a-24b288d3eb8f.4226.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ab3709f440 con 0x55ab36fddef0 2024-09-22T08:37:05.728 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.723+0000 7feeaa92b640 1 -- 172.21.15.142:0/2486159387 <== osd.3 v2:172.21.15.142:6800/1064901393 41 ==== osd_op_reply(168 pubsub..bucket.myfoo/e239248c-0bee-4e41-803a-24b288d3eb8f.4226.5 [delete] v32'43 uv36 ondisk = -2 ((2) No such file or directory)) ==== 208+0+0 (crc 0 0 0) 0x7feea40083e0 con 0x55ab36fddef0 2024-09-22T08:37:05.728 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.723+0000 7feeac640800 1 -- 172.21.15.142:0/2486159387 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:169 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ab3709f440 con 0x7feea4032020 2024-09-22T08:37:05.728 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.724+0000 7feeaa12a640 1 -- 172.21.15.142:0/2486159387 <== osd.2 v2:172.21.15.142:6808/279438927 27 ==== osd_op_reply(169 foo.buckets [call] v32'39 uv39 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fee9c01b070 con 0x7feea4032020 2024-09-22T08:37:05.728 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.725+0000 7fed60fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:37:05.728 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.725+0000 7feeac640800 1 -- 172.21.15.142:0/2486159387 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:170 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94193850414848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ab3709f440 con 0x55ab36fd94e0 2024-09-22T08:37:05.728 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.726+0000 7feea9929640 1 -- 172.21.15.142:0/2486159387 <== osd.1 v2:172.21.15.142:6816/3192108003 66 ==== osd_op_reply(170 data_loggenerations_metadata [watch unwatch cookie 94193850414848] v32'186 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fee94088070 con 0x55ab36fd94e0 2024-09-22T08:37:05.729 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.726+0000 7feeac640800 1 -- 172.21.15.142:0/2486159387 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:171 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94193850398848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ab3709f440 con 0x7feea4032020 2024-09-22T08:37:05.729 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.727+0000 7feeaa12a640 1 -- 172.21.15.142:0/2486159387 <== osd.2 v2:172.21.15.142:6808/279438927 28 ==== osd_op_reply(171 notify.0 [watch unwatch cookie 94193850398848] v32'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee9c01b070 con 0x7feea4032020 2024-09-22T08:37:05.729 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.727+0000 7feeac640800 20 remove_watcher() i=0 2024-09-22T08:37:05.729 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.727+0000 7feeac640800 2 removed watcher, disabling cache 2024-09-22T08:37:05.729 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.727+0000 7feeac640800 1 -- 172.21.15.142:0/2486159387 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:172 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94193850406224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ab3709f440 con 0x55ab36fd94e0 2024-09-22T08:37:05.729 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.728+0000 7feea9929640 1 -- 172.21.15.142:0/2486159387 <== osd.1 v2:172.21.15.142:6816/3192108003 67 ==== osd_op_reply(172 notify.1 [watch unwatch cookie 94193850406224] v32'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee94088070 con 0x55ab36fd94e0 2024-09-22T08:37:05.729 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.728+0000 7feeac640800 20 remove_watcher() i=1 2024-09-22T08:37:05.729 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.728+0000 7feeac640800 1 -- 172.21.15.142:0/2486159387 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:173 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94193850408960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ab3709f440 con 0x55ab36fddef0 2024-09-22T08:37:05.730 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.729+0000 7feeaa92b640 1 -- 172.21.15.142:0/2486159387 <== osd.3 v2:172.21.15.142:6800/1064901393 42 ==== osd_op_reply(173 notify.2 [watch unwatch cookie 94193850408960] v32'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feea40083e0 con 0x55ab36fddef0 2024-09-22T08:37:05.730 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.729+0000 7feeac640800 20 remove_watcher() i=2 2024-09-22T08:37:05.730 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.729+0000 7feeac640800 1 -- 172.21.15.142:0/2486159387 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:174 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94193850413248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ab3709f440 con 0x7feea4032020 2024-09-22T08:37:05.731 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.730+0000 7feeaa12a640 1 -- 172.21.15.142:0/2486159387 <== osd.2 v2:172.21.15.142:6808/279438927 29 ==== osd_op_reply(174 notify.3 [watch unwatch cookie 94193850413248] v32'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee9c01b070 con 0x7feea4032020 2024-09-22T08:37:05.731 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.730+0000 7feeac640800 20 remove_watcher() i=3 2024-09-22T08:37:05.731 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.730+0000 7feeac640800 1 -- 172.21.15.142:0/2486159387 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:175 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94193850407280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ab3709f440 con 0x55ab36fd94e0 2024-09-22T08:37:05.732 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.731+0000 7feea9929640 1 -- 172.21.15.142:0/2486159387 <== osd.1 v2:172.21.15.142:6816/3192108003 68 ==== osd_op_reply(175 notify.4 [watch unwatch cookie 94193850407280] v32'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee94088070 con 0x55ab36fd94e0 2024-09-22T08:37:05.732 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.731+0000 7feeac640800 20 remove_watcher() i=4 2024-09-22T08:37:05.732 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.731+0000 7feeac640800 1 -- 172.21.15.142:0/2486159387 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:176 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94193850417904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ab3709f440 con 0x7fee9c01d530 2024-09-22T08:37:05.733 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.732+0000 7feea9929640 1 -- 172.21.15.142:0/2486159387 <== osd.0 v2:172.21.15.31:6800/168281188 41 ==== osd_op_reply(176 notify.5 [watch unwatch cookie 94193850417904] v32'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee94088070 con 0x7fee9c01d530 2024-09-22T08:37:05.733 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.732+0000 7feeac640800 20 remove_watcher() i=5 2024-09-22T08:37:05.733 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.732+0000 7feeac640800 1 -- 172.21.15.142:0/2486159387 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:177 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94193850420048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ab3709f440 con 0x7fee9c01d530 2024-09-22T08:37:05.734 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.733+0000 7feea9929640 1 -- 172.21.15.142:0/2486159387 <== osd.0 v2:172.21.15.31:6800/168281188 42 ==== osd_op_reply(177 notify.6 [watch unwatch cookie 94193850420048] v32'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee94088070 con 0x7fee9c01d530 2024-09-22T08:37:05.734 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.733+0000 7feeac640800 20 remove_watcher() i=6 2024-09-22T08:37:05.734 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.733+0000 7feeac640800 1 -- 172.21.15.142:0/2486159387 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:178 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94193850423840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ab3709f440 con 0x7fee9c01d530 2024-09-22T08:37:05.737 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.734+0000 7feea9929640 1 -- 172.21.15.142:0/2486159387 <== osd.0 v2:172.21.15.31:6800/168281188 43 ==== osd_op_reply(178 notify.7 [watch unwatch cookie 94193850423840] v32'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee94088070 con 0x7fee9c01d530 2024-09-22T08:37:05.737 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.734+0000 7feeac640800 20 remove_watcher() i=7 2024-09-22T08:37:05.737 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.734+0000 7feeac640800 1 -- 172.21.15.142:0/2486159387 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7fee9c01d530 msgr2=0x7fee9c052290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:05.737 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.734+0000 7feeac640800 1 --2- 172.21.15.142:0/2486159387 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7fee9c01d530 0x7fee9c052290 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:05.737 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.734+0000 7feeac640800 1 -- 172.21.15.142:0/2486159387 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55ab36fd94e0 msgr2=0x55ab36fdb9a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:05.738 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.734+0000 7feeac640800 1 --2- 172.21.15.142:0/2486159387 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55ab36fd94e0 0x55ab36fdb9a0 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:05.738 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.734+0000 7feeac640800 1 -- 172.21.15.142:0/2486159387 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7feea4032020 msgr2=0x7feea401e2c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:05.738 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.734+0000 7feeac640800 1 --2- 172.21.15.142:0/2486159387 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7feea4032020 0x7feea401e2c0 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:05.738 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.734+0000 7feeac640800 1 -- 172.21.15.142:0/2486159387 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55ab36fddef0 msgr2=0x55ab36fe02e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:05.738 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.734+0000 7feeac640800 1 --2- 172.21.15.142:0/2486159387 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55ab36fddef0 0x55ab36fe02e0 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:05.738 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.734+0000 7feeac640800 1 -- 172.21.15.142:0/2486159387 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fed7403cf60 msgr2=0x7fed7403f420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:05.738 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.734+0000 7feeac640800 1 --2- 172.21.15.142:0/2486159387 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fed7403cf60 0x7fed7403f420 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fee9c052ec0 tx=0x7fee9c037420 comp rx=0 tx=0).stop 2024-09-22T08:37:05.738 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.734+0000 7feeac640800 1 -- 172.21.15.142:0/2486159387 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ab36fc4440 msgr2=0x55ab36f95140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:05.738 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.734+0000 7feea9929640 1 -- 172.21.15.142:0/2486159387 reap_dead start 2024-09-22T08:37:05.738 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.734+0000 7feeac640800 1 --2- 172.21.15.142:0/2486159387 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ab36fc4440 0x55ab36f95140 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7feea40154a0 tx=0x7feea4053d50 comp rx=0 tx=0).stop 2024-09-22T08:37:05.738 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.734+0000 7feeac640800 1 -- 172.21.15.142:0/2486159387 shutdown_connections 2024-09-22T08:37:05.738 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.734+0000 7feeac640800 1 --2- 172.21.15.142:0/2486159387 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ab36fc4440 0x55ab36f95140 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:05.738 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.734+0000 7feeac640800 1 -- 172.21.15.142:0/2486159387 >> 172.21.15.142:0/2486159387 conn(0x55ab36fc0840 msgr2=0x55ab36fbea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:37:05.739 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.734+0000 7feeac640800 1 -- 172.21.15.142:0/2486159387 shutdown_connections 2024-09-22T08:37:05.739 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.734+0000 7feeac640800 1 -- 172.21.15.142:0/2486159387 wait complete. 2024-09-22T08:37:05.739 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.735+0000 7feeac640800 1 -- 172.21.15.142:0/4263006875 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fed8403cfb0 msgr2=0x7fed8403f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:05.739 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.735+0000 7feeac640800 1 --2- 172.21.15.142:0/4263006875 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fed8403cfb0 0x7fed8403f470 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x55ab36fa5480 tx=0x7fee9c001530 comp rx=0 tx=0).stop 2024-09-22T08:37:05.739 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.735+0000 7feeac640800 1 -- 172.21.15.142:0/4263006875 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ab36fb79c0 msgr2=0x55ab36fb7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:05.739 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.735+0000 7feeac640800 1 --2- 172.21.15.142:0/4263006875 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ab36fb79c0 0x55ab36fb7de0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x55ab36f9d960 tx=0x7feea400bf30 comp rx=0 tx=0).stop 2024-09-22T08:37:05.739 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.735+0000 7feeac640800 1 -- 172.21.15.142:0/4263006875 shutdown_connections 2024-09-22T08:37:05.739 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.735+0000 7feeac640800 1 --2- 172.21.15.142:0/4263006875 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fed8403cfb0 0x7fed8403f470 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:05.739 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.735+0000 7feeac640800 1 --2- 172.21.15.142:0/4263006875 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ab36fb79c0 0x55ab36fb7de0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:05.739 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.735+0000 7feeac640800 1 -- 172.21.15.142:0/4263006875 >> 172.21.15.142:0/4263006875 conn(0x55ab36fabd70 msgr2=0x55ab36fac150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:37:05.739 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.735+0000 7feeac640800 1 -- 172.21.15.142:0/4263006875 shutdown_connections 2024-09-22T08:37:05.739 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.735+0000 7feeac640800 1 -- 172.21.15.142:0/4263006875 wait complete. 2024-09-22T08:37:05.739 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.735+0000 7feeac640800 1 -- 172.21.15.142:0/3525667636 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55ab36ea88f0 msgr2=0x55ab36fa3fb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:05.739 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.735+0000 7feeac640800 1 --2- 172.21.15.142:0/3525667636 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55ab36ea88f0 0x55ab36fa3fb0 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:05.740 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.735+0000 7feeac640800 1 -- 172.21.15.142:0/3525667636 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55ab36fa6390 msgr2=0x55ab36fa8810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:05.740 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.735+0000 7feeac640800 1 --2- 172.21.15.142:0/3525667636 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55ab36fa6390 0x55ab36fa8810 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:05.740 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.735+0000 7feeac640800 1 -- 172.21.15.142:0/3525667636 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fed9003cfb0 msgr2=0x7fed9003f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:05.740 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.735+0000 7feeac640800 1 --2- 172.21.15.142:0/3525667636 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fed9003cfb0 0x7fed9003f470 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fee94057000 tx=0x7fee94052000 comp rx=0 tx=0).stop 2024-09-22T08:37:05.740 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.735+0000 7feeac640800 1 -- 172.21.15.142:0/3525667636 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ab36ea4d80 msgr2=0x55ab36f9c960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:05.740 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.735+0000 7feeac640800 1 --2- 172.21.15.142:0/3525667636 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ab36ea4d80 0x55ab36f9c960 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x55ab36ea3ac0 tx=0x7fee9c001250 comp rx=0 tx=0).stop 2024-09-22T08:37:05.740 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.735+0000 7feeac640800 1 -- 172.21.15.142:0/3525667636 shutdown_connections 2024-09-22T08:37:05.740 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.735+0000 7feeac640800 1 --2- 172.21.15.142:0/3525667636 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55ab36fa6390 0x55ab36fa8810 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:05.740 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.735+0000 7feeac640800 1 --2- 172.21.15.142:0/3525667636 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55ab36ea88f0 0x55ab36fa3fb0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:05.740 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.735+0000 7feeac640800 1 --2- 172.21.15.142:0/3525667636 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fed9003cfb0 0x7fed9003f470 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:05.740 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.735+0000 7feeac640800 1 --2- 172.21.15.142:0/3525667636 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ab36ea4d80 0x55ab36f9c960 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:05.740 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.735+0000 7feeac640800 1 -- 172.21.15.142:0/3525667636 >> 172.21.15.142:0/3525667636 conn(0x55ab36e9f310 msgr2=0x55ab36f8de80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:37:05.740 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.735+0000 7feeac640800 1 -- 172.21.15.142:0/3525667636 shutdown_connections 2024-09-22T08:37:05.740 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.735+0000 7feeac640800 1 -- 172.21.15.142:0/3525667636 wait complete. 2024-09-22T08:37:05.745 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'foo', '--caps', 'user=read'] 2024-09-22T08:37:05.745 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'foo', '--caps', 'user=read'] 2024-09-22T08:37:05.745 DEBUG:teuthology.orchestra.run.smithi142:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid foo --caps user=read 2024-09-22T08:37:05.792 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:37:05.792 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:37:05.793 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.792+0000 7f49bea98800 1 Processor -- start 2024-09-22T08:37:05.793 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.792+0000 7f49bea98800 1 -- start start 2024-09-22T08:37:05.793 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.792+0000 7f49bea98800 1 --2- >> v2:172.21.15.31:3300/0 conn(0x562cdd90dd80 0x562cdd910170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:05.794 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.792+0000 7f49bea98800 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x562cdd799a20 con 0x562cdd910710 2024-09-22T08:37:05.794 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.792+0000 7f49bea98800 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x562cdd7997d0 con 0x562cdd90dd80 2024-09-22T08:37:05.794 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.792+0000 7f49bc582640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x562cdd90dd80 0x562cdd910170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:05.794 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.792+0000 7f49bbd81640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x562cdd910710 0x562cdd912bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.142:56384/0 (socket says 172.21.15.142:56384) 2024-09-22T08:37:05.794 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.792+0000 7f49bbd81640 1 -- 172.21.15.142:0/295133700 learned_addr learned my addr 172.21.15.142:0/295133700 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-09-22T08:37:05.794 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.792+0000 7f49bc582640 1 -- 172.21.15.142:0/295133700 >> v1:172.21.15.31:6789/0 conn(0x562cdd910710 legacy=0x562cdd912bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:05.794 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.792+0000 7f49bc582640 1 -- 172.21.15.142:0/295133700 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x562cdd915470 con 0x562cdd90dd80 2024-09-22T08:37:05.795 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.794+0000 7f49bc582640 1 --2- 172.21.15.142:0/295133700 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562cdd90dd80 0x562cdd910170 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f49ac005fd0 tx=0x7f49ac045c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1c2052f0ac0464b server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:05.796 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.794+0000 7f49bb580640 1 -- 172.21.15.142:0/295133700 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f49ac058530 con 0x562cdd90dd80 2024-09-22T08:37:05.796 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.794+0000 7f49bb580640 1 -- 172.21.15.142:0/295133700 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49ac0586d0 con 0x562cdd90dd80 2024-09-22T08:37:05.796 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.795+0000 7f49bb580640 1 -- 172.21.15.142:0/295133700 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f49ac0589d0 con 0x562cdd90dd80 2024-09-22T08:37:05.796 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.795+0000 7f49bea98800 1 -- 172.21.15.142:0/295133700 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562cdd90dd80 msgr2=0x562cdd910170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:05.796 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.795+0000 7f49bea98800 1 --2- 172.21.15.142:0/295133700 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562cdd90dd80 0x562cdd910170 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f49ac005fd0 tx=0x7f49ac045c30 comp rx=0 tx=0).stop 2024-09-22T08:37:05.797 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.795+0000 7f49bea98800 1 -- 172.21.15.142:0/295133700 shutdown_connections 2024-09-22T08:37:05.797 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.795+0000 7f49bea98800 1 --2- 172.21.15.142:0/295133700 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562cdd90dd80 0x562cdd910170 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:05.797 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.795+0000 7f49bea98800 1 -- 172.21.15.142:0/295133700 >> 172.21.15.142:0/295133700 conn(0x562cdd908310 msgr2=0x562cdd90a790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:37:05.797 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.795+0000 7f49bea98800 1 -- 172.21.15.142:0/295133700 shutdown_connections 2024-09-22T08:37:05.797 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.795+0000 7f49bea98800 1 -- 172.21.15.142:0/295133700 wait complete. 2024-09-22T08:37:05.810 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.809+0000 7f49bea98800 1 Processor -- start 2024-09-22T08:37:05.810 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.809+0000 7f49bea98800 1 -- start start 2024-09-22T08:37:05.810 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.809+0000 7f49bea98800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562cdd90dd80 0x562cdd90cff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:05.810 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.809+0000 7f49bea98800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x562cdd7a6dd0 con 0x562cdd90dd80 2024-09-22T08:37:05.811 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.809+0000 7f49bc582640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562cdd90dd80 0x562cdd90cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:05.811 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.809+0000 7f49bc582640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562cdd90dd80 0x562cdd90cff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:59582/0 (socket says 172.21.15.142:59582) 2024-09-22T08:37:05.811 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.809+0000 7f49bc582640 1 -- 172.21.15.142:0/3626154042 learned_addr learned my addr 172.21.15.142:0/3626154042 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:37:05.811 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.809+0000 7f49bc582640 1 -- 172.21.15.142:0/3626154042 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562cdda00c30 con 0x562cdd90dd80 2024-09-22T08:37:05.813 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.810+0000 7f49bc582640 1 --2- 172.21.15.142:0/3626154042 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562cdd90dd80 0x562cdd90cff0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f49ac025a60 tx=0x7f49ac051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf960bc9a96a981a server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:05.813 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.810+0000 7f48aa60c640 1 -- 172.21.15.142:0/3626154042 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f49ac0589b0 con 0x562cdd90dd80 2024-09-22T08:37:05.813 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.810+0000 7f48aa60c640 1 -- 172.21.15.142:0/3626154042 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49ac068070 con 0x562cdd90dd80 2024-09-22T08:37:05.813 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.810+0000 7f48aa60c640 1 -- 172.21.15.142:0/3626154042 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f49ac058c80 con 0x562cdd90dd80 2024-09-22T08:37:05.813 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.811+0000 7f49bea98800 1 -- 172.21.15.142:0/3626154042 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562cdd90dd80 msgr2=0x562cdd90cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:05.813 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.811+0000 7f49bea98800 1 --2- 172.21.15.142:0/3626154042 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562cdd90dd80 0x562cdd90cff0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f49ac025a60 tx=0x7f49ac051000 comp rx=0 tx=0).stop 2024-09-22T08:37:05.814 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.811+0000 7f49bea98800 1 -- 172.21.15.142:0/3626154042 shutdown_connections 2024-09-22T08:37:05.814 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.811+0000 7f49bea98800 1 --2- 172.21.15.142:0/3626154042 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562cdd90dd80 0x562cdd90cff0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:05.814 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.811+0000 7f49bea98800 1 -- 172.21.15.142:0/3626154042 >> 172.21.15.142:0/3626154042 conn(0x562cdd908310 msgr2=0x562cdd9f88f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:37:05.814 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.811+0000 7f49bea98800 1 -- 172.21.15.142:0/3626154042 shutdown_connections 2024-09-22T08:37:05.814 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.811+0000 7f49bea98800 1 -- 172.21.15.142:0/3626154042 wait complete. 2024-09-22T08:37:05.814 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.811+0000 7f49bea98800 1 Processor -- start 2024-09-22T08:37:05.814 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.811+0000 7f49bea98800 1 -- start start 2024-09-22T08:37:05.814 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.811+0000 7f49bea98800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562cdd90dd80 0x562cdda059d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:05.814 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.811+0000 7f49bea98800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x562cdd914710 con 0x562cdd90dd80 2024-09-22T08:37:05.814 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.811+0000 7f49bc582640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562cdd90dd80 0x562cdda059d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:05.814 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.811+0000 7f49bc582640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562cdd90dd80 0x562cdda059d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:59596/0 (socket says 172.21.15.142:59596) 2024-09-22T08:37:05.814 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.811+0000 7f49bc582640 1 -- 172.21.15.142:0/4080545814 learned_addr learned my addr 172.21.15.142:0/4080545814 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:37:05.814 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.812+0000 7f49bc582640 1 -- 172.21.15.142:0/4080545814 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562cdda05f30 con 0x562cdd90dd80 2024-09-22T08:37:05.814 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.812+0000 7f49bc582640 1 --2- 172.21.15.142:0/4080545814 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562cdd90dd80 0x562cdda059d0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f49ac025a60 tx=0x7f49ac003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:05.815 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.812+0000 7f48a8e09640 1 -- 172.21.15.142:0/4080545814 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f49ac0635f0 con 0x562cdd90dd80 2024-09-22T08:37:05.815 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.812+0000 7f48a8e09640 1 -- 172.21.15.142:0/4080545814 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49ac063790 con 0x562cdd90dd80 2024-09-22T08:37:05.815 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.812+0000 7f49bea98800 1 -- 172.21.15.142:0/4080545814 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562cdda061c0 con 0x562cdd90dd80 2024-09-22T08:37:05.815 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.812+0000 7f48a8e09640 1 -- 172.21.15.142:0/4080545814 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f49ac063a90 con 0x562cdd90dd80 2024-09-22T08:37:05.815 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.812+0000 7f49bea98800 1 -- 172.21.15.142:0/4080545814 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562cdda06bc0 con 0x562cdd90dd80 2024-09-22T08:37:05.817 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.813+0000 7f48a8e09640 1 -- 172.21.15.142:0/4080545814 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f49ac075020 con 0x562cdd90dd80 2024-09-22T08:37:05.817 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.813+0000 7f48a8e09640 1 --2- 172.21.15.142:0/4080545814 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f48a403d000 0x7f48a403f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:05.818 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.813+0000 7f48a8e09640 1 -- 172.21.15.142:0/4080545814 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5938+0+0 (secure 0 0 0) 0x7f49ac098840 con 0x562cdd90dd80 2024-09-22T08:37:05.818 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.813+0000 7f49bbd81640 1 --2- 172.21.15.142:0/4080545814 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f48a403d000 0x7f48a403f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:05.818 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.813+0000 7f49bea98800 1 --2- 172.21.15.142:0/4080545814 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x562cdd910710 0x562cdda0d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:05.818 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.813+0000 7f49bea98800 1 -- 172.21.15.142:0/4080545814 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562cdda0d560 con 0x562cdd910710 2024-09-22T08:37:05.818 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.813+0000 7f49bcd83640 1 --2- 172.21.15.142:0/4080545814 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x562cdd910710 0x562cdda0d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:05.818 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.814+0000 7f49bbd81640 1 --2- 172.21.15.142:0/4080545814 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f48a403d000 0x7f48a403f4c0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f49a4001d70 tx=0x7f49a40012d0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:05.818 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.814+0000 7f49bcd83640 1 --2- 172.21.15.142:0/4080545814 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x562cdd910710 0x562cdda0d020 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:05.818 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.814+0000 7f49bcd83640 1 -- 172.21.15.142:0/4080545814 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f49b40083e0 con 0x562cdd910710 2024-09-22T08:37:05.818 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.814+0000 7f49bea98800 1 -- 172.21.15.142:0/4080545814 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562cdda0d900 con 0x562cdd910710 2024-09-22T08:37:05.818 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.814+0000 7f49bcd83640 1 -- 172.21.15.142:0/4080545814 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f49b40083e0 con 0x562cdd910710 2024-09-22T08:37:05.818 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.814+0000 7f49bea98800 1 --2- 172.21.15.142:0/4080545814 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x562cdda0f3c0 0x562cdda11860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:05.818 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.814+0000 7f49bea98800 1 -- 172.21.15.142:0/4080545814 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:3 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562cdda11ff0 con 0x562cdda0f3c0 2024-09-22T08:37:05.818 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.814+0000 7f49bc582640 1 --2- 172.21.15.142:0/4080545814 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x562cdda0f3c0 0x562cdda11860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:05.819 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.815+0000 7f49bc582640 1 --2- 172.21.15.142:0/4080545814 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x562cdda0f3c0 0x562cdda11860 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:05.819 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.815+0000 7f49bc582640 1 -- 172.21.15.142:0/4080545814 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(3 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f49ac096d70 con 0x562cdda0f3c0 2024-09-22T08:37:05.819 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.815+0000 7f49bea98800 1 -- 172.21.15.142:0/4080545814 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562cdda0e150 con 0x562cdd910710 2024-09-22T08:37:05.819 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.815+0000 7f49bcd83640 1 -- 172.21.15.142:0/4080545814 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f49b40083e0 con 0x562cdd910710 2024-09-22T08:37:05.819 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.815+0000 7f49bea98800 1 -- 172.21.15.142:0/4080545814 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562cdda0e530 con 0x562cdda0f3c0 2024-09-22T08:37:05.819 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.816+0000 7f49bc582640 1 -- 172.21.15.142:0/4080545814 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(5 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f49ac096d70 con 0x562cdda0f3c0 2024-09-22T08:37:05.819 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.816+0000 7f49bea98800 1 Processor -- start 2024-09-22T08:37:05.819 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.816+0000 7f49bea98800 1 -- start start 2024-09-22T08:37:05.819 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.816+0000 7f49bea98800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562cdda209d0 0x562cdda20df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:05.819 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.816+0000 7f49bea98800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x562cdd805d50 con 0x562cdda209d0 2024-09-22T08:37:05.819 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.816+0000 7f49bcd83640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562cdda209d0 0x562cdda20df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:05.819 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.816+0000 7f49bcd83640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562cdda209d0 0x562cdda20df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:59598/0 (socket says 172.21.15.142:59598) 2024-09-22T08:37:05.819 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.816+0000 7f49bcd83640 1 -- 172.21.15.142:0/541698809 learned_addr learned my addr 172.21.15.142:0/541698809 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:37:05.823 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.817+0000 7f49bcd83640 1 -- 172.21.15.142:0/541698809 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562cdda21430 con 0x562cdda209d0 2024-09-22T08:37:05.823 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.817+0000 7f49bcd83640 1 --2- 172.21.15.142:0/541698809 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562cdda209d0 0x562cdda20df0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x562cdda078c0 tx=0x7f49b400bf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:05.823 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.817+0000 7f48a1ffb640 1 -- 172.21.15.142:0/541698809 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f49b401c020 con 0x562cdda209d0 2024-09-22T08:37:05.824 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.817+0000 7f48a1ffb640 1 -- 172.21.15.142:0/541698809 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49b4007c90 con 0x562cdda209d0 2024-09-22T08:37:05.824 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.817+0000 7f49bea98800 1 -- 172.21.15.142:0/541698809 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562cdda21c60 con 0x562cdda209d0 2024-09-22T08:37:05.824 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.817+0000 7f48a1ffb640 1 -- 172.21.15.142:0/541698809 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f49b4018440 con 0x562cdda209d0 2024-09-22T08:37:05.824 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.817+0000 7f49bea98800 1 -- 172.21.15.142:0/541698809 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562cdda22200 con 0x562cdda209d0 2024-09-22T08:37:05.824 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.818+0000 7f48a1ffb640 1 -- 172.21.15.142:0/541698809 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f49b401f020 con 0x562cdda209d0 2024-09-22T08:37:05.824 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.818+0000 7f48a1ffb640 1 --2- 172.21.15.142:0/541698809 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f489403cfb0 0x7f489403f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:05.824 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.818+0000 7f48a1ffb640 1 -- 172.21.15.142:0/541698809 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5938+0+0 (secure 0 0 0) 0x7f49b40559e0 con 0x562cdda209d0 2024-09-22T08:37:05.824 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.818+0000 7f49bc582640 1 --2- 172.21.15.142:0/541698809 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f489403cfb0 0x7f489403f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:05.824 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.818+0000 7f49bea98800 1 Processor -- start 2024-09-22T08:37:05.824 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.819+0000 7f49bea98800 1 -- start start 2024-09-22T08:37:05.824 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.819+0000 7f49bc582640 1 --2- 172.21.15.142:0/541698809 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f489403cfb0 0x7f489403f470 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x562cdda12390 tx=0x7f49ac06b5c0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:05.824 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.819+0000 7f49bea98800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562cdda2d430 0x562cdda2d830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:05.824 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.819+0000 7f49bea98800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x562cdda00e30 con 0x562cdda2d430 2024-09-22T08:37:05.824 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.819+0000 7f49bcd83640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562cdda2d430 0x562cdda2d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:05.825 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.819+0000 7f49bcd83640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562cdda2d430 0x562cdda2d830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:59610/0 (socket says 172.21.15.142:59610) 2024-09-22T08:37:05.825 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.819+0000 7f49bcd83640 1 -- 172.21.15.142:0/1183387076 learned_addr learned my addr 172.21.15.142:0/1183387076 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:37:05.825 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.819+0000 7f49bcd83640 1 -- 172.21.15.142:0/1183387076 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562cdda2de20 con 0x562cdda2d430 2024-09-22T08:37:05.825 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.819+0000 7f49bcd83640 1 --2- 172.21.15.142:0/1183387076 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562cdda2d430 0x562cdda2d830 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f49b4053e10 tx=0x7f49b40156f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3fe8c31e9553456 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:05.825 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.819+0000 7f489b7fe640 1 -- 172.21.15.142:0/1183387076 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f49b4051070 con 0x562cdda2d430 2024-09-22T08:37:05.825 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.819+0000 7f489b7fe640 1 -- 172.21.15.142:0/1183387076 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49b404a070 con 0x562cdda2d430 2024-09-22T08:37:05.825 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.819+0000 7f489b7fe640 1 -- 172.21.15.142:0/1183387076 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f49b40173a0 con 0x562cdda2d430 2024-09-22T08:37:05.825 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.820+0000 7f49bea98800 1 -- 172.21.15.142:0/1183387076 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562cdda2d430 msgr2=0x562cdda2d830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:05.825 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.820+0000 7f49bea98800 1 --2- 172.21.15.142:0/1183387076 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562cdda2d430 0x562cdda2d830 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f49b4053e10 tx=0x7f49b40156f0 comp rx=0 tx=0).stop 2024-09-22T08:37:05.825 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.820+0000 7f49bea98800 1 -- 172.21.15.142:0/1183387076 shutdown_connections 2024-09-22T08:37:05.825 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.820+0000 7f49bea98800 1 --2- 172.21.15.142:0/1183387076 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562cdda2d430 0x562cdda2d830 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:05.825 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.820+0000 7f49bea98800 1 -- 172.21.15.142:0/1183387076 >> 172.21.15.142:0/1183387076 conn(0x562cdda29830 msgr2=0x562cdda27a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:37:05.825 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.820+0000 7f49bea98800 1 -- 172.21.15.142:0/1183387076 shutdown_connections 2024-09-22T08:37:05.825 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.820+0000 7f49bea98800 1 -- 172.21.15.142:0/1183387076 wait complete. 2024-09-22T08:37:05.826 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.820+0000 7f49bea98800 1 Processor -- start 2024-09-22T08:37:05.826 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.820+0000 7f49bea98800 1 -- start start 2024-09-22T08:37:05.826 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.820+0000 7f49bea98800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562cdda2d430 0x562cdd9fe340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:05.826 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.820+0000 7f49bea98800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x562cdda2e440 con 0x562cdda2d430 2024-09-22T08:37:05.826 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.821+0000 7f49bcd83640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562cdda2d430 0x562cdd9fe340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:05.826 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.821+0000 7f49bcd83640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562cdda2d430 0x562cdd9fe340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:59622/0 (socket says 172.21.15.142:59622) 2024-09-22T08:37:05.826 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.821+0000 7f49bcd83640 1 -- 172.21.15.142:0/2714298570 learned_addr learned my addr 172.21.15.142:0/2714298570 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:37:05.826 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.821+0000 7f49bcd83640 1 -- 172.21.15.142:0/2714298570 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562cdd9fe8a0 con 0x562cdda2d430 2024-09-22T08:37:05.826 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.821+0000 7f49bcd83640 1 --2- 172.21.15.142:0/2714298570 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562cdda2d430 0x562cdd9fe340 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f49b4016010 tx=0x7f49b4053da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:05.826 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.821+0000 7f4899ffb640 1 -- 172.21.15.142:0/2714298570 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f49b4013450 con 0x562cdda2d430 2024-09-22T08:37:05.826 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.821+0000 7f4899ffb640 1 -- 172.21.15.142:0/2714298570 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49b40135f0 con 0x562cdda2d430 2024-09-22T08:37:05.826 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.821+0000 7f49bea98800 1 -- 172.21.15.142:0/2714298570 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562cdd9fcc50 con 0x562cdda2d430 2024-09-22T08:37:05.826 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.821+0000 7f4899ffb640 1 -- 172.21.15.142:0/2714298570 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f49b40139e0 con 0x562cdda2d430 2024-09-22T08:37:05.826 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.821+0000 7f49bea98800 1 -- 172.21.15.142:0/2714298570 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562cdd9fd1f0 con 0x562cdda2d430 2024-09-22T08:37:05.827 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.822+0000 7f4899ffb640 1 -- 172.21.15.142:0/2714298570 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f49b4016040 con 0x562cdda2d430 2024-09-22T08:37:05.827 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.822+0000 7f4899ffb640 1 --2- 172.21.15.142:0/2714298570 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f488c03cfb0 0x7f488c03f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:05.827 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.822+0000 7f4899ffb640 1 -- 172.21.15.142:0/2714298570 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5938+0+0 (secure 0 0 0) 0x7f49b4036bd0 con 0x562cdda2d430 2024-09-22T08:37:05.827 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.822+0000 7f49bc582640 1 --2- 172.21.15.142:0/2714298570 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f488c03cfb0 0x7f488c03f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:05.839 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.823+0000 7f49bc582640 1 --2- 172.21.15.142:0/2714298570 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f488c03cfb0 0x7f488c03f470 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f49ac06b780 tx=0x7f49ac08c000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:05.839 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.823+0000 7f49bea98800 20 rados->read ofs=0 len=0 2024-09-22T08:37:05.839 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.823+0000 7f49bea98800 1 --2- 172.21.15.142:0/2714298570 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x562cdda42560 0x562cdda44a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:05.839 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.823+0000 7f49bea98800 1 -- 172.21.15.142:0/2714298570 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562cdda45170 con 0x562cdda42560 2024-09-22T08:37:05.839 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.823+0000 7f49bbd81640 1 --2- 172.21.15.142:0/2714298570 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x562cdda42560 0x562cdda44a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:05.839 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.823+0000 7f49bbd81640 1 --2- 172.21.15.142:0/2714298570 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x562cdda42560 0x562cdda44a20 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:05.839 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.824+0000 7f49bbd81640 1 -- 172.21.15.142:0/2714298570 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f49a4009050 con 0x562cdda42560 2024-09-22T08:37:05.840 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.824+0000 7f49bea98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:05.840 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.824+0000 7f49bea98800 20 realm 2024-09-22T08:37:05.840 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.824+0000 7f49bea98800 20 rados->read ofs=0 len=0 2024-09-22T08:37:05.840 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.824+0000 7f49bea98800 1 -- 172.21.15.142:0/2714298570 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562cdda418b0 con 0x562cdda42560 2024-09-22T08:37:05.840 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.824+0000 7f49bbd81640 1 -- 172.21.15.142:0/2714298570 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f49a4009050 con 0x562cdda42560 2024-09-22T08:37:05.840 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.824+0000 7f49bea98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:05.840 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.824+0000 7f49bea98800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:37:05.840 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.824+0000 7f49bea98800 20 rados->read ofs=0 len=0 2024-09-22T08:37:05.840 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.824+0000 7f49bea98800 1 -- 172.21.15.142:0/2714298570 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562cdda45c60 con 0x562cdda42560 2024-09-22T08:37:05.840 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.824+0000 7f49bbd81640 1 -- 172.21.15.142:0/2714298570 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f49a4009050 con 0x562cdda42560 2024-09-22T08:37:05.840 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.824+0000 7f49bea98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:05.840 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.824+0000 7f49bea98800 20 rados->read ofs=0 len=0 2024-09-22T08:37:05.840 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.824+0000 7f49bea98800 1 -- 172.21.15.142:0/2714298570 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562cdda46530 con 0x562cdda42560 2024-09-22T08:37:05.840 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.824+0000 7f49bbd81640 1 -- 172.21.15.142:0/2714298570 <== osd.1 v2:172.21.15.142:6816/3192108003 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f49a4009050 con 0x562cdda42560 2024-09-22T08:37:05.841 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.824+0000 7f49bea98800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:37:05.841 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.824+0000 7f49bea98800 20 rados->read ofs=0 len=0 2024-09-22T08:37:05.841 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.824+0000 7f49bea98800 1 --2- 172.21.15.142:0/2714298570 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x562cdda46f50 0x562cdda49340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:05.841 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.824+0000 7f49bea98800 1 -- 172.21.15.142:0/2714298570 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562cdda49a80 con 0x562cdda46f50 2024-09-22T08:37:05.841 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.824+0000 7f49bcd83640 1 --2- 172.21.15.142:0/2714298570 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x562cdda46f50 0x562cdda49340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:05.841 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.825+0000 7f49bcd83640 1 --2- 172.21.15.142:0/2714298570 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x562cdda46f50 0x562cdda49340 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:05.841 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.825+0000 7f49bcd83640 1 -- 172.21.15.142:0/2714298570 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(5 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f49b403c070 con 0x562cdda46f50 2024-09-22T08:37:05.841 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.825+0000 7f49bea98800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:37:05.841 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.825+0000 7f49bea98800 20 searching for the correct realm 2024-09-22T08:37:05.841 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.825+0000 7f49bea98800 1 -- 172.21.15.142:0/2714298570 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562cdda4b3b0 con 0x562cdda46f50 2024-09-22T08:37:05.841 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.825+0000 7f49bcd83640 1 -- 172.21.15.142:0/2714298570 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49b403c070 con 0x562cdda46f50 2024-09-22T08:37:05.841 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.825+0000 7f49bcd83640 1 --2- 172.21.15.142:0/2714298570 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f49b4021020 0x7f49b402ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:05.841 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.825+0000 7f49bcd83640 1 -- 172.21.15.142:0/2714298570 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562cdda4b3b0 con 0x7f49b4021020 2024-09-22T08:37:05.841 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.825+0000 7f49bc582640 1 --2- 172.21.15.142:0/2714298570 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f49b4021020 0x7f49b402ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:05.842 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.825+0000 7f49bc582640 1 --2- 172.21.15.142:0/2714298570 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f49b4021020 0x7f49b402ca40 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:05.842 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.826+0000 7f49bc582640 1 -- 172.21.15.142:0/2714298570 <== osd.2 v2:172.21.15.142:6808/279438927 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49ac085040 con 0x7f49b4021020 2024-09-22T08:37:05.842 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.826+0000 7f49bc582640 1 --2- 172.21.15.142:0/2714298570 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f49ac088070 0x7f49ac0953e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:05.842 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.826+0000 7f49bc582640 1 -- 172.21.15.142:0/2714298570 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562cdda4b3b0 con 0x7f49ac088070 2024-09-22T08:37:05.842 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.826+0000 7f49bbd81640 1 --2- 172.21.15.142:0/2714298570 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f49ac088070 0x7f49ac0953e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:05.842 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.826+0000 7f49bbd81640 1 --2- 172.21.15.142:0/2714298570 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f49ac088070 0x7f49ac0953e0 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:05.842 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.827+0000 7f49bbd81640 1 -- 172.21.15.142:0/2714298570 <== osd.0 v2:172.21.15.31:6800/168281188 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49a4009050 con 0x7f49ac088070 2024-09-22T08:37:05.842 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.827+0000 7f49bbd81640 1 -- 172.21.15.142:0/2714298570 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562cdda4b3b0 con 0x562cdda42560 2024-09-22T08:37:05.842 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.827+0000 7f49bbd81640 1 -- 172.21.15.142:0/2714298570 <== osd.1 v2:172.21.15.142:6816/3192108003 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49a4009050 con 0x562cdda42560 2024-09-22T08:37:05.842 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.827+0000 7f49bbd81640 1 -- 172.21.15.142:0/2714298570 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562cdda4b3b0 con 0x562cdda42560 2024-09-22T08:37:05.842 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.827+0000 7f49bbd81640 1 -- 172.21.15.142:0/2714298570 <== osd.1 v2:172.21.15.142:6816/3192108003 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49a4029040 con 0x562cdda42560 2024-09-22T08:37:05.842 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.827+0000 7f49bbd81640 1 -- 172.21.15.142:0/2714298570 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562cdda4b3b0 con 0x562cdda42560 2024-09-22T08:37:05.842 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.827+0000 7f49bbd81640 1 -- 172.21.15.142:0/2714298570 <== osd.1 v2:172.21.15.142:6816/3192108003 7 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49a4029040 con 0x562cdda42560 2024-09-22T08:37:05.843 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.827+0000 7f49bbd81640 1 -- 172.21.15.142:0/2714298570 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562cdda4b3b0 con 0x7f49ac088070 2024-09-22T08:37:05.843 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.827+0000 7f49bbd81640 1 -- 172.21.15.142:0/2714298570 <== osd.0 v2:172.21.15.31:6800/168281188 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49a4029040 con 0x7f49ac088070 2024-09-22T08:37:05.843 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.827+0000 7f49bbd81640 1 -- 172.21.15.142:0/2714298570 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562cdda4b3b0 con 0x7f49b4021020 2024-09-22T08:37:05.843 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.828+0000 7f49bc582640 1 -- 172.21.15.142:0/2714298570 <== osd.2 v2:172.21.15.142:6808/279438927 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49ac085040 con 0x7f49b4021020 2024-09-22T08:37:05.843 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.828+0000 7f49bc582640 1 -- 172.21.15.142:0/2714298570 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562cdda4b3b0 con 0x562cdda46f50 2024-09-22T08:37:05.843 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.828+0000 7f49bcd83640 1 -- 172.21.15.142:0/2714298570 <== osd.3 v2:172.21.15.142:6800/1064901393 3 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49b403c070 con 0x562cdda46f50 2024-09-22T08:37:05.843 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.828+0000 7f49bcd83640 1 -- 172.21.15.142:0/2714298570 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562cdda4b3b0 con 0x562cdda42560 2024-09-22T08:37:05.843 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.828+0000 7f49bbd81640 1 -- 172.21.15.142:0/2714298570 <== osd.1 v2:172.21.15.142:6816/3192108003 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49a4029040 con 0x562cdda42560 2024-09-22T08:37:05.843 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.828+0000 7f49bbd81640 1 -- 172.21.15.142:0/2714298570 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562cdda4b3b0 con 0x7f49ac088070 2024-09-22T08:37:05.843 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.828+0000 7f49bbd81640 1 -- 172.21.15.142:0/2714298570 <== osd.0 v2:172.21.15.31:6800/168281188 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49a4029040 con 0x7f49ac088070 2024-09-22T08:37:05.843 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.828+0000 7f49bbd81640 1 -- 172.21.15.142:0/2714298570 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562cdda4b3b0 con 0x562cdda42560 2024-09-22T08:37:05.843 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.829+0000 7f49bbd81640 1 -- 172.21.15.142:0/2714298570 <== osd.1 v2:172.21.15.142:6816/3192108003 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49a4029040 con 0x562cdda42560 2024-09-22T08:37:05.843 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.829+0000 7f49bbd81640 1 -- 172.21.15.142:0/2714298570 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562cdda4b3b0 con 0x7f49b4021020 2024-09-22T08:37:05.844 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.829+0000 7f49bc582640 1 -- 172.21.15.142:0/2714298570 <== osd.2 v2:172.21.15.142:6808/279438927 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f49ac085040 con 0x7f49b4021020 2024-09-22T08:37:05.844 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.829+0000 7f49bc582640 1 -- 172.21.15.142:0/2714298570 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562cdda4b3b0 con 0x562cdda46f50 2024-09-22T08:37:05.844 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.829+0000 7f49bcd83640 1 -- 172.21.15.142:0/2714298570 <== osd.3 v2:172.21.15.142:6800/1064901393 4 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49b403c070 con 0x562cdda46f50 2024-09-22T08:37:05.844 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.829+0000 7f49bcd83640 1 -- 172.21.15.142:0/2714298570 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562cdda4b3b0 con 0x562cdda46f50 2024-09-22T08:37:05.844 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.829+0000 7f49bcd83640 1 -- 172.21.15.142:0/2714298570 <== osd.3 v2:172.21.15.142:6800/1064901393 5 ==== osd_op_reply(20 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f49b403c070 con 0x562cdda46f50 2024-09-22T08:37:05.844 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.829+0000 7f49bcd83640 1 -- 172.21.15.142:0/2714298570 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562cdda4b3b0 con 0x7f49ac088070 2024-09-22T08:37:05.844 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.829+0000 7f49bbd81640 1 -- 172.21.15.142:0/2714298570 <== osd.0 v2:172.21.15.31:6800/168281188 4 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49a4029040 con 0x7f49ac088070 2024-09-22T08:37:05.844 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.830+0000 7f49bbd81640 1 -- 172.21.15.142:0/2714298570 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562cdda4b3b0 con 0x562cdda46f50 2024-09-22T08:37:05.844 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.830+0000 7f49bcd83640 1 -- 172.21.15.142:0/2714298570 <== osd.3 v2:172.21.15.142:6800/1064901393 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49b403c070 con 0x562cdda46f50 2024-09-22T08:37:05.844 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.830+0000 7f49bcd83640 1 -- 172.21.15.142:0/2714298570 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562cdda4b3b0 con 0x562cdda46f50 2024-09-22T08:37:05.844 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.830+0000 7f49bcd83640 1 -- 172.21.15.142:0/2714298570 <== osd.3 v2:172.21.15.142:6800/1064901393 7 ==== osd_op_reply(23 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f49b403c070 con 0x562cdda46f50 2024-09-22T08:37:05.844 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.830+0000 7f49bcd83640 1 -- 172.21.15.142:0/2714298570 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562cdda4b3b0 con 0x562cdda42560 2024-09-22T08:37:05.844 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.830+0000 7f49bbd81640 1 -- 172.21.15.142:0/2714298570 <== osd.1 v2:172.21.15.142:6816/3192108003 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49a4029040 con 0x562cdda42560 2024-09-22T08:37:05.845 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.830+0000 7f49bbd81640 1 -- 172.21.15.142:0/2714298570 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562cdda4b3b0 con 0x562cdda42560 2024-09-22T08:37:05.845 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.830+0000 7f49bbd81640 1 -- 172.21.15.142:0/2714298570 <== osd.1 v2:172.21.15.142:6816/3192108003 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f49a4029040 con 0x562cdda42560 2024-09-22T08:37:05.845 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.830+0000 7f49bbd81640 1 -- 172.21.15.142:0/2714298570 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562cdda4b3b0 con 0x7f49ac088070 2024-09-22T08:37:05.845 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.831+0000 7f49bbd81640 1 -- 172.21.15.142:0/2714298570 <== osd.0 v2:172.21.15.31:6800/168281188 5 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49a4029040 con 0x7f49ac088070 2024-09-22T08:37:05.845 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.831+0000 7f49bbd81640 1 -- 172.21.15.142:0/2714298570 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562cdda4b3b0 con 0x562cdda46f50 2024-09-22T08:37:05.845 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.831+0000 7f49bcd83640 1 -- 172.21.15.142:0/2714298570 <== osd.3 v2:172.21.15.142:6800/1064901393 8 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49b403c070 con 0x562cdda46f50 2024-09-22T08:37:05.845 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.831+0000 7f49bcd83640 1 -- 172.21.15.142:0/2714298570 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562cdda4b3b0 con 0x7f49b4021020 2024-09-22T08:37:05.845 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.831+0000 7f49bc582640 1 -- 172.21.15.142:0/2714298570 <== osd.2 v2:172.21.15.142:6808/279438927 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49ac085040 con 0x7f49b4021020 2024-09-22T08:37:05.845 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.831+0000 7f49bc582640 1 -- 172.21.15.142:0/2714298570 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562cdda4b3b0 con 0x562cdda42560 2024-09-22T08:37:05.845 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.831+0000 7f49bbd81640 1 -- 172.21.15.142:0/2714298570 <== osd.1 v2:172.21.15.142:6816/3192108003 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49a4029040 con 0x562cdda42560 2024-09-22T08:37:05.845 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.831+0000 7f49bbd81640 1 -- 172.21.15.142:0/2714298570 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562cdda4b3b0 con 0x7f49ac088070 2024-09-22T08:37:05.845 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.832+0000 7f49bbd81640 1 -- 172.21.15.142:0/2714298570 <== osd.0 v2:172.21.15.31:6800/168281188 6 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49a4029040 con 0x7f49ac088070 2024-09-22T08:37:05.845 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.832+0000 7f49bbd81640 1 -- 172.21.15.142:0/2714298570 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562cdda4b3b0 con 0x562cdda46f50 2024-09-22T08:37:05.845 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.832+0000 7f49bcd83640 1 -- 172.21.15.142:0/2714298570 <== osd.3 v2:172.21.15.142:6800/1064901393 9 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49b403c070 con 0x562cdda46f50 2024-09-22T08:37:05.846 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.832+0000 7f49bcd83640 1 -- 172.21.15.142:0/2714298570 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562cdda4b3b0 con 0x7f49ac088070 2024-09-22T08:37:05.846 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.832+0000 7f49bbd81640 1 -- 172.21.15.142:0/2714298570 <== osd.0 v2:172.21.15.31:6800/168281188 7 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49a4029040 con 0x7f49ac088070 2024-09-22T08:37:05.846 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.832+0000 7f49bbd81640 1 -- 172.21.15.142:0/2714298570 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562cdda4b3b0 con 0x7f49b4021020 2024-09-22T08:37:05.846 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.832+0000 7f49bc582640 1 -- 172.21.15.142:0/2714298570 <== osd.2 v2:172.21.15.142:6808/279438927 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49ac085040 con 0x7f49b4021020 2024-09-22T08:37:05.846 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.833+0000 7f49bc582640 1 -- 172.21.15.142:0/2714298570 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562cdda4b3b0 con 0x562cdda46f50 2024-09-22T08:37:05.846 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.833+0000 7f49bcd83640 1 -- 172.21.15.142:0/2714298570 <== osd.3 v2:172.21.15.142:6800/1064901393 10 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49b403c070 con 0x562cdda46f50 2024-09-22T08:37:05.846 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.833+0000 7f49bcd83640 1 -- 172.21.15.142:0/2714298570 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562cdda4b3b0 con 0x7f49ac088070 2024-09-22T08:37:05.846 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.833+0000 7f49bbd81640 1 -- 172.21.15.142:0/2714298570 <== osd.0 v2:172.21.15.31:6800/168281188 8 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49a4029040 con 0x7f49ac088070 2024-09-22T08:37:05.846 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.833+0000 7f49bbd81640 1 -- 172.21.15.142:0/2714298570 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562cdda4b3b0 con 0x562cdda42560 2024-09-22T08:37:05.846 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.833+0000 7f49bbd81640 1 -- 172.21.15.142:0/2714298570 <== osd.1 v2:172.21.15.142:6816/3192108003 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f49a4029040 con 0x562cdda42560 2024-09-22T08:37:05.846 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.833+0000 7f49bbd81640 1 -- 172.21.15.142:0/2714298570 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562cdda4b3b0 con 0x7f49b4021020 2024-09-22T08:37:05.846 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.834+0000 7f49bc582640 1 -- 172.21.15.142:0/2714298570 <== osd.2 v2:172.21.15.142:6808/279438927 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49ac085040 con 0x7f49b4021020 2024-09-22T08:37:05.846 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.834+0000 7f49bea98800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:37:05.847 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.834+0000 7f49bea98800 20 RGWRados::pool_iterate: got zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec 2024-09-22T08:37:05.847 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.834+0000 7f49bea98800 20 RGWRados::pool_iterate: got zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f 2024-09-22T08:37:05.847 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.834+0000 7f49bea98800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:37:05.847 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.834+0000 7f49bea98800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:37:05.847 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.834+0000 7f49bea98800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:37:05.847 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.834+0000 7f49bea98800 20 rados->read ofs=0 len=0 2024-09-22T08:37:05.847 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.834+0000 7f49bea98800 1 -- 172.21.15.142:0/2714298570 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562cdda4a440 con 0x562cdda42560 2024-09-22T08:37:05.847 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.834+0000 7f49bbd81640 1 -- 172.21.15.142:0/2714298570 <== osd.1 v2:172.21.15.142:6816/3192108003 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f49a4029040 con 0x562cdda42560 2024-09-22T08:37:05.847 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.834+0000 7f49bea98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:05.847 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.834+0000 7f49bea98800 20 rados->read ofs=0 len=0 2024-09-22T08:37:05.847 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.834+0000 7f49bea98800 1 -- 172.21.15.142:0/2714298570 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562cdda4ac90 con 0x562cdda42560 2024-09-22T08:37:05.847 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.834+0000 7f49bbd81640 1 -- 172.21.15.142:0/2714298570 <== osd.1 v2:172.21.15.142:6816/3192108003 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f49a4029040 con 0x562cdda42560 2024-09-22T08:37:05.847 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.834+0000 7f49bea98800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:37:05.847 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.834+0000 7f49bea98800 20 rados->read ofs=0 len=0 2024-09-22T08:37:05.848 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.834+0000 7f49bea98800 1 -- 172.21.15.142:0/2714298570 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:40 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562cdda4b830 con 0x562cdda46f50 2024-09-22T08:37:05.848 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.834+0000 7f49bcd83640 1 -- 172.21.15.142:0/2714298570 <== osd.3 v2:172.21.15.142:6800/1064901393 11 ==== osd_op_reply(40 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f49b403c070 con 0x562cdda46f50 2024-09-22T08:37:05.848 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.834+0000 7f49bea98800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:37:05.848 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.834+0000 7f49bea98800 20 zone default found 2024-09-22T08:37:05.848 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.834+0000 7f49bea98800 4 Realm: () 2024-09-22T08:37:05.848 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.834+0000 7f49bea98800 4 ZoneGroup: default (d89f6f57-1007-47dd-9065-f486c7b01aec) 2024-09-22T08:37:05.848 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.834+0000 7f49bea98800 4 Zone: default (e239248c-0bee-4e41-803a-24b288d3eb8f) 2024-09-22T08:37:05.848 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.834+0000 7f49bea98800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:37:05.848 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.834+0000 7f49bea98800 20 zonegroup default 2024-09-22T08:37:05.848 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.834+0000 7f49bea98800 20 rados->read ofs=0 len=0 2024-09-22T08:37:05.848 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.834+0000 7f49bea98800 1 -- 172.21.15.142:0/2714298570 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562cdda4bbd0 con 0x7f49ac088070 2024-09-22T08:37:05.848 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.835+0000 7f49bbd81640 1 -- 172.21.15.142:0/2714298570 <== osd.0 v2:172.21.15.31:6800/168281188 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f49a4029040 con 0x7f49ac088070 2024-09-22T08:37:05.848 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.835+0000 7f49bea98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:05.848 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.835+0000 7f49bea98800 20 rados->read ofs=0 len=0 2024-09-22T08:37:05.849 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.835+0000 7f49bea98800 1 -- 172.21.15.142:0/2714298570 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562cdda4deb0 con 0x562cdda46f50 2024-09-22T08:37:05.849 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.835+0000 7f49bcd83640 1 -- 172.21.15.142:0/2714298570 <== osd.3 v2:172.21.15.142:6800/1064901393 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f49b403c070 con 0x562cdda46f50 2024-09-22T08:37:05.849 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.835+0000 7f49bea98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:05.849 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.835+0000 7f49bea98800 20 rados->read ofs=0 len=0 2024-09-22T08:37:05.849 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.835+0000 7f49bea98800 1 -- 172.21.15.142:0/2714298570 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562cdda4e250 con 0x562cdda46f50 2024-09-22T08:37:05.849 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.835+0000 7f49bcd83640 1 -- 172.21.15.142:0/2714298570 <== osd.3 v2:172.21.15.142:6800/1064901393 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f49b403c070 con 0x562cdda46f50 2024-09-22T08:37:05.849 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.835+0000 7f49bea98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:05.849 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.835+0000 7f49bea98800 20 started sync module instance, tier type = 2024-09-22T08:37:05.849 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.835+0000 7f49bea98800 20 started zone id=e239248c-0bee-4e41-803a-24b288d3eb8f (name=default) with tier type = 2024-09-22T08:37:05.849 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.835+0000 7f49bea98800 1 -- 172.21.15.142:0/2714298570 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562cdda4d2f0 con 0x7f49b4021020 2024-09-22T08:37:05.849 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.836+0000 7f49bc582640 1 -- 172.21.15.142:0/2714298570 <== osd.2 v2:172.21.15.142:6808/279438927 7 ==== osd_op_reply(44 notify.0 [create] v32'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49ac085040 con 0x7f49b4021020 2024-09-22T08:37:05.849 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.836+0000 7f49bea98800 1 -- 172.21.15.142:0/2714298570 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94750697115200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562cdda4e6b0 con 0x7f49b4021020 2024-09-22T08:37:05.849 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.836+0000 7f49bea98800 1 -- 172.21.15.142:0/2714298570 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562cdda4ef00 con 0x562cdda42560 2024-09-22T08:37:05.850 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.837+0000 7f49bc582640 1 -- 172.21.15.142:0/2714298570 <== osd.2 v2:172.21.15.142:6808/279438927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94750697115200] v32'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49ac085040 con 0x7f49b4021020 2024-09-22T08:37:05.850 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.837+0000 7f49bbd81640 1 -- 172.21.15.142:0/2714298570 <== osd.1 v2:172.21.15.142:6816/3192108003 16 ==== osd_op_reply(46 notify.1 [create] v32'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49a4029040 con 0x562cdda42560 2024-09-22T08:37:05.850 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.838+0000 7f49bea98800 1 -- 172.21.15.142:0/2714298570 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94750697122384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562cdda4f320 con 0x562cdda42560 2024-09-22T08:37:05.850 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.838+0000 7f49bea98800 1 -- 172.21.15.142:0/2714298570 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562cdda4fbb0 con 0x562cdda46f50 2024-09-22T08:37:05.854 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.839+0000 7f49bbd81640 1 -- 172.21.15.142:0/2714298570 <== osd.1 v2:172.21.15.142:6816/3192108003 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94750697122384] v32'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49a4029040 con 0x562cdda42560 2024-09-22T08:37:05.854 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.839+0000 7f49bcd83640 1 -- 172.21.15.142:0/2714298570 <== osd.3 v2:172.21.15.142:6800/1064901393 14 ==== osd_op_reply(48 notify.2 [create] v32'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49b403c070 con 0x562cdda46f50 2024-09-22T08:37:05.854 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.839+0000 7f49bea98800 1 -- 172.21.15.142:0/2714298570 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94750697123440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562cdda4f740 con 0x562cdda46f50 2024-09-22T08:37:05.854 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.839+0000 7f49bea98800 1 -- 172.21.15.142:0/2714298570 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562cdda50620 con 0x7f49b4021020 2024-09-22T08:37:05.855 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.840+0000 7f49bcd83640 1 -- 172.21.15.142:0/2714298570 <== osd.3 v2:172.21.15.142:6800/1064901393 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94750697123440] v32'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49b403c070 con 0x562cdda46f50 2024-09-22T08:37:05.855 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.840+0000 7f49bc582640 1 -- 172.21.15.142:0/2714298570 <== osd.2 v2:172.21.15.142:6808/279438927 9 ==== osd_op_reply(50 notify.3 [create] v32'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49ac085040 con 0x7f49b4021020 2024-09-22T08:37:05.855 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.840+0000 7f49bea98800 1 -- 172.21.15.142:0/2714298570 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94750697128208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562cdda505e0 con 0x7f49b4021020 2024-09-22T08:37:05.855 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.840+0000 7f49bea98800 1 -- 172.21.15.142:0/2714298570 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562cdda510b0 con 0x562cdda42560 2024-09-22T08:37:05.855 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.841+0000 7f49bbd81640 1 -- 172.21.15.142:0/2714298570 <== osd.1 v2:172.21.15.142:6816/3192108003 18 ==== osd_op_reply(52 notify.4 [create] v32'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49a4029040 con 0x562cdda42560 2024-09-22T08:37:05.855 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.841+0000 7f49bea98800 1 -- 172.21.15.142:0/2714298570 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94750697130912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562cdda510b0 con 0x562cdda42560 2024-09-22T08:37:05.855 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.841+0000 7f49bea98800 1 -- 172.21.15.142:0/2714298570 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562cdda52090 con 0x7f49ac088070 2024-09-22T08:37:05.855 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.841+0000 7f49bc582640 1 -- 172.21.15.142:0/2714298570 <== osd.2 v2:172.21.15.142:6808/279438927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94750697128208] v32'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49ac085040 con 0x7f49b4021020 2024-09-22T08:37:05.855 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.842+0000 7f49bbd81640 1 -- 172.21.15.142:0/2714298570 <== osd.1 v2:172.21.15.142:6816/3192108003 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94750697130912] v32'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49a4029040 con 0x562cdda42560 2024-09-22T08:37:05.855 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.842+0000 7f49bbd81640 1 -- 172.21.15.142:0/2714298570 <== osd.0 v2:172.21.15.31:6800/168281188 10 ==== osd_op_reply(54 notify.5 [create] v32'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49a4029040 con 0x7f49ac088070 2024-09-22T08:37:05.855 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.842+0000 7f49bea98800 1 -- 172.21.15.142:0/2714298570 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94750697124496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562cdda51ba0 con 0x7f49ac088070 2024-09-22T08:37:05.855 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.842+0000 7f49bea98800 1 -- 172.21.15.142:0/2714298570 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562cdda52560 con 0x7f49ac088070 2024-09-22T08:37:05.855 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.843+0000 7f49bbd81640 1 -- 172.21.15.142:0/2714298570 <== osd.0 v2:172.21.15.31:6800/168281188 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94750697124496] v32'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49a4029040 con 0x7f49ac088070 2024-09-22T08:37:05.855 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.843+0000 7f49bbd81640 1 -- 172.21.15.142:0/2714298570 <== osd.0 v2:172.21.15.31:6800/168281188 12 ==== osd_op_reply(56 notify.6 [create] v32'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49a4029040 con 0x7f49ac088070 2024-09-22T08:37:05.856 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.843+0000 7f49bea98800 1 -- 172.21.15.142:0/2714298570 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94750697132816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562cdda52560 con 0x7f49ac088070 2024-09-22T08:37:05.856 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.843+0000 7f49bea98800 1 -- 172.21.15.142:0/2714298570 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562cdda52f60 con 0x7f49ac088070 2024-09-22T08:37:05.856 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.844+0000 7f49bbd81640 1 -- 172.21.15.142:0/2714298570 <== osd.0 v2:172.21.15.31:6800/168281188 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94750697132816] v32'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49a4029040 con 0x7f49ac088070 2024-09-22T08:37:05.856 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.844+0000 7f49bbd81640 1 -- 172.21.15.142:0/2714298570 <== osd.0 v2:172.21.15.31:6800/168281188 14 ==== osd_op_reply(58 notify.7 [create] v32'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49a4029040 con 0x7f49ac088070 2024-09-22T08:37:05.856 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.844+0000 7f49bea98800 1 -- 172.21.15.142:0/2714298570 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94750697138800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562cdda52560 con 0x7f49ac088070 2024-09-22T08:37:05.856 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.844+0000 7f49bea98800 20 add_watcher() i=0 2024-09-22T08:37:05.856 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.844+0000 7f49bea98800 20 add_watcher() i=1 2024-09-22T08:37:05.856 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.844+0000 7f49bea98800 20 add_watcher() i=2 2024-09-22T08:37:05.856 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.844+0000 7f49bea98800 20 add_watcher() i=3 2024-09-22T08:37:05.856 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.844+0000 7f49bea98800 20 add_watcher() i=4 2024-09-22T08:37:05.856 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.844+0000 7f49bea98800 20 add_watcher() i=5 2024-09-22T08:37:05.856 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.844+0000 7f49bea98800 20 add_watcher() i=6 2024-09-22T08:37:05.856 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.845+0000 7f49bbd81640 1 -- 172.21.15.142:0/2714298570 <== osd.0 v2:172.21.15.31:6800/168281188 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94750697138800] v32'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49a4029040 con 0x7f49ac088070 2024-09-22T08:37:05.856 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.845+0000 7f49bea98800 20 add_watcher() i=7 2024-09-22T08:37:05.857 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.845+0000 7f49bea98800 2 all 8 watchers are set, enabling cache 2024-09-22T08:37:05.857 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.845+0000 7f49bea98800 1 -- 172.21.15.142:0/2714298570 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562cdda564a0 con 0x562cdda42560 2024-09-22T08:37:05.857 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.846+0000 7f49bbd81640 1 -- 172.21.15.142:0/2714298570 <== osd.1 v2:172.21.15.142:6816/3192108003 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f49a4029040 con 0x562cdda42560 2024-09-22T08:37:05.857 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.846+0000 7f49bea98800 1 -- 172.21.15.142:0/2714298570 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94750697137232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562cdda537b0 con 0x562cdda42560 2024-09-22T08:37:05.857 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.847+0000 7f49bbd81640 1 -- 172.21.15.142:0/2714298570 <== osd.1 v2:172.21.15.142:6816/3192108003 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94750697137232] v32'187 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f49a4029040 con 0x562cdda42560 2024-09-22T08:37:05.857 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.847+0000 7f48727e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:37:05.857 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.847+0000 7f49bea98800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:37:05.857 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.847+0000 7f49bea98800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:37:05.857 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.847+0000 7f49bea98800 5 note: GC not initialized 2024-09-22T08:37:05.857 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.847+0000 7f48717e2640 20 reqs_thread_entry: start 2024-09-22T08:37:05.857 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.847+0000 7f49bea98800 20 init_complete bucket index max shards: 11 2024-09-22T08:37:05.857 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.847+0000 7f49bea98800 20 Filter name: none 2024-09-22T08:37:05.857 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.848+0000 7f47e2ffd640 20 reqs_thread_entry: start 2024-09-22T08:37:05.857 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.848+0000 7f49bea98800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-22T08:37:05.858 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.848+0000 7f49bea98800 20 rados->read ofs=0 len=0 2024-09-22T08:37:05.858 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.848+0000 7f49bea98800 1 -- 172.21.15.142:0/2714298570 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562cdda89830 con 0x562cdda42560 2024-09-22T08:37:05.858 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.848+0000 7f49bbd81640 1 -- 172.21.15.142:0/2714298570 <== osd.1 v2:172.21.15.142:6816/3192108003 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv13 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f49a4029040 con 0x562cdda42560 2024-09-22T08:37:05.858 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.848+0000 7f49bea98800 20 rados_obj.operate() r=0 bl.length=391 2024-09-22T08:37:05.858 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.848+0000 7f49bea98800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-22T08:37:05.858 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.848+0000 7f49bea98800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-22T08:37:05.858 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.848+0000 7f49bea98800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:37:05.858 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.848+0000 7f49bea98800 1 -- 172.21.15.142:0/2714298570 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~403 in=403b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562cdda8f9b0 con 0x562cdda42560 2024-09-22T08:37:05.858 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.849+0000 7f49bbd81640 1 -- 172.21.15.142:0/2714298570 <== osd.1 v2:172.21.15.142:6816/3192108003 23 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~403] v32'14 uv14 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f49a4029040 con 0x562cdda42560 2024-09-22T08:37:05.858 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.849+0000 7f49bea98800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-22T08:37:05.858 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.849+0000 7f49bea98800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-22T08:37:05.858 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.849+0000 7f49bea98800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-22T08:37:05.858 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.849+0000 7f49bea98800 1 -- 172.21.15.142:0/2714298570 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94750697386896 in=591b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562cdda8b2b0 con 0x562cdda42560 2024-09-22T08:37:05.858 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.849+0000 7f49bbd81640 1 -- 172.21.15.142:0/2714298570 <== osd.1 v2:172.21.15.142:6816/3192108003 24 ==== watch-notify(notify (1) cookie 94750697130912 notify 137438953488 ret 0) ==== 621+0+0 (crc 0 0 0) 0x562cdd799a20 con 0x562cdda42560 2024-09-22T08:37:05.859 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.849+0000 7f489b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953488 cookie 94750697130912 notifier 4653 bl.length()=579 2024-09-22T08:37:05.859 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.849+0000 7f489b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-22T08:37:05.859 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.849+0000 7f489b7fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-22T08:37:05.859 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.850+0000 7f489b7fe640 1 -- 172.21.15.142:0/2714298570 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f4880003ea0 con 0x562cdda42560 2024-09-22T08:37:05.859 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.850+0000 7f49bbd81640 1 -- 172.21.15.142:0/2714298570 <== osd.1 v2:172.21.15.142:6816/3192108003 25 ==== osd_op_reply(64 notify.4 [notify cookie 94750697386896 out=8b] v0'0 uv180 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f49a4029040 con 0x562cdda42560 2024-09-22T08:37:05.859 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.850+0000 7f49bbd81640 1 -- 172.21.15.142:0/2714298570 <== osd.1 v2:172.21.15.142:6816/3192108003 26 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49a4029040 con 0x562cdda42560 2024-09-22T08:37:05.859 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.850+0000 7f49bbd81640 1 -- 172.21.15.142:0/2714298570 <== osd.1 v2:172.21.15.142:6816/3192108003 27 ==== watch-notify(notify_complete (2) cookie 94750697386896 notify 137438953488 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f49a402d8e0 con 0x562cdda42560 2024-09-22T08:37:05.859 INFO:teuthology.orchestra.run.smithi142.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-22T08:36:42.661297Z"}],"swift_keys":[],"caps":[{"type":"user","perm":"read"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-22T08:36:42.661288Z","tags":[],"group_ids":[]} 2024-09-22T08:37:05.864 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.851+0000 7f48727e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:37:05.864 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.851+0000 7f49bea98800 1 -- 172.21.15.142:0/2714298570 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94750697137232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562cdda87590 con 0x562cdda42560 2024-09-22T08:37:05.864 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.852+0000 7f49bbd81640 1 -- 172.21.15.142:0/2714298570 <== osd.1 v2:172.21.15.142:6816/3192108003 28 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94750697137232] v32'188 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f49a4029040 con 0x562cdda42560 2024-09-22T08:37:05.864 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.852+0000 7f49bea98800 1 -- 172.21.15.142:0/2714298570 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94750697115200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562cdda87590 con 0x7f49b4021020 2024-09-22T08:37:05.864 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.853+0000 7f49bc582640 1 -- 172.21.15.142:0/2714298570 <== osd.2 v2:172.21.15.142:6808/279438927 11 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94750697115200] v32'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49ac085040 con 0x7f49b4021020 2024-09-22T08:37:05.864 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.853+0000 7f49bea98800 20 remove_watcher() i=0 2024-09-22T08:37:05.864 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.853+0000 7f49bea98800 2 removed watcher, disabling cache 2024-09-22T08:37:05.864 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.853+0000 7f49bea98800 1 -- 172.21.15.142:0/2714298570 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94750697122384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562cdda87590 con 0x562cdda42560 2024-09-22T08:37:05.865 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.854+0000 7f49bbd81640 1 -- 172.21.15.142:0/2714298570 <== osd.1 v2:172.21.15.142:6816/3192108003 29 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94750697122384] v32'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49a4029040 con 0x562cdda42560 2024-09-22T08:37:05.865 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.854+0000 7f49bea98800 20 remove_watcher() i=1 2024-09-22T08:37:05.865 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.854+0000 7f49bea98800 1 -- 172.21.15.142:0/2714298570 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94750697123440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562cdda87590 con 0x562cdda46f50 2024-09-22T08:37:05.865 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.855+0000 7f49bcd83640 1 -- 172.21.15.142:0/2714298570 <== osd.3 v2:172.21.15.142:6800/1064901393 16 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94750697123440] v32'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49b403c070 con 0x562cdda46f50 2024-09-22T08:37:05.865 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.855+0000 7f49bea98800 20 remove_watcher() i=2 2024-09-22T08:37:05.865 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.855+0000 7f49bea98800 1 -- 172.21.15.142:0/2714298570 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94750697128208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562cdda87590 con 0x7f49b4021020 2024-09-22T08:37:05.865 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.856+0000 7f49bc582640 1 -- 172.21.15.142:0/2714298570 <== osd.2 v2:172.21.15.142:6808/279438927 12 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94750697128208] v32'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49ac085040 con 0x7f49b4021020 2024-09-22T08:37:05.865 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.856+0000 7f49bea98800 20 remove_watcher() i=3 2024-09-22T08:37:05.865 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.856+0000 7f49bea98800 1 -- 172.21.15.142:0/2714298570 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94750697130912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562cdda87590 con 0x562cdda42560 2024-09-22T08:37:05.865 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.857+0000 7f49bbd81640 1 -- 172.21.15.142:0/2714298570 <== osd.1 v2:172.21.15.142:6816/3192108003 30 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94750697130912] v32'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49a4029040 con 0x562cdda42560 2024-09-22T08:37:05.865 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.857+0000 7f49bea98800 20 remove_watcher() i=4 2024-09-22T08:37:05.865 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.857+0000 7f49bea98800 1 -- 172.21.15.142:0/2714298570 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94750697124496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562cdda87590 con 0x7f49ac088070 2024-09-22T08:37:05.865 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.858+0000 7f49bbd81640 1 -- 172.21.15.142:0/2714298570 <== osd.0 v2:172.21.15.31:6800/168281188 16 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94750697124496] v32'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49a4029040 con 0x7f49ac088070 2024-09-22T08:37:05.865 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.858+0000 7f49bea98800 20 remove_watcher() i=5 2024-09-22T08:37:05.866 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.858+0000 7f49bea98800 1 -- 172.21.15.142:0/2714298570 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94750697132816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562cdda87590 con 0x7f49ac088070 2024-09-22T08:37:05.866 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.859+0000 7f49bbd81640 1 -- 172.21.15.142:0/2714298570 <== osd.0 v2:172.21.15.31:6800/168281188 17 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94750697132816] v32'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49a4029040 con 0x7f49ac088070 2024-09-22T08:37:05.866 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.859+0000 7f49bea98800 20 remove_watcher() i=6 2024-09-22T08:37:05.866 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.859+0000 7f49bea98800 1 -- 172.21.15.142:0/2714298570 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94750697138800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562cdda87590 con 0x7f49ac088070 2024-09-22T08:37:05.866 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.860+0000 7f49bbd81640 1 -- 172.21.15.142:0/2714298570 <== osd.0 v2:172.21.15.31:6800/168281188 18 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94750697138800] v32'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49a4029040 con 0x7f49ac088070 2024-09-22T08:37:05.866 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.860+0000 7f49bea98800 20 remove_watcher() i=7 2024-09-22T08:37:05.866 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.860+0000 7f49bea98800 1 -- 172.21.15.142:0/2714298570 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f49ac088070 msgr2=0x7f49ac0953e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:05.866 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.860+0000 7f49bea98800 1 --2- 172.21.15.142:0/2714298570 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f49ac088070 0x7f49ac0953e0 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:05.866 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.860+0000 7f49bea98800 1 -- 172.21.15.142:0/2714298570 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x562cdda42560 msgr2=0x562cdda44a20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:05.866 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.860+0000 7f49bea98800 1 --2- 172.21.15.142:0/2714298570 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x562cdda42560 0x562cdda44a20 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:05.866 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.860+0000 7f49bea98800 1 -- 172.21.15.142:0/2714298570 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f49b4021020 msgr2=0x7f49b402ca40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:05.866 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.860+0000 7f49bea98800 1 --2- 172.21.15.142:0/2714298570 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f49b4021020 0x7f49b402ca40 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:05.866 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.860+0000 7f49bea98800 1 -- 172.21.15.142:0/2714298570 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x562cdda46f50 msgr2=0x562cdda49340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:05.866 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.860+0000 7f49bea98800 1 --2- 172.21.15.142:0/2714298570 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x562cdda46f50 0x562cdda49340 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:05.867 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.860+0000 7f49bea98800 1 -- 172.21.15.142:0/2714298570 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f488c03cfb0 msgr2=0x7f488c03f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:05.867 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.860+0000 7f49bea98800 1 --2- 172.21.15.142:0/2714298570 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f488c03cfb0 0x7f488c03f470 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f49ac06b780 tx=0x7f49ac08c000 comp rx=0 tx=0).stop 2024-09-22T08:37:05.867 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.860+0000 7f49bea98800 1 -- 172.21.15.142:0/2714298570 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562cdda2d430 msgr2=0x562cdd9fe340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:05.867 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.860+0000 7f49bea98800 1 --2- 172.21.15.142:0/2714298570 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562cdda2d430 0x562cdd9fe340 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f49b4016010 tx=0x7f49b4053da0 comp rx=0 tx=0).stop 2024-09-22T08:37:05.867 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.860+0000 7f49bbd81640 1 -- 172.21.15.142:0/2714298570 reap_dead start 2024-09-22T08:37:05.867 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.860+0000 7f49bbd81640 1 -- 172.21.15.142:0/2714298570 reap_dead start 2024-09-22T08:37:05.867 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.860+0000 7f49bea98800 1 -- 172.21.15.142:0/2714298570 shutdown_connections 2024-09-22T08:37:05.867 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.860+0000 7f49bea98800 1 -- 172.21.15.142:0/2714298570 >> 172.21.15.142:0/2714298570 conn(0x562cdda29830 msgr2=0x562cdda27a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:37:05.867 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.860+0000 7f49bea98800 1 -- 172.21.15.142:0/2714298570 shutdown_connections 2024-09-22T08:37:05.867 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.861+0000 7f49bea98800 1 -- 172.21.15.142:0/2714298570 wait complete. 2024-09-22T08:37:05.867 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.861+0000 7f49bea98800 1 -- 172.21.15.142:0/541698809 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f489403cfb0 msgr2=0x7f489403f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:05.867 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.861+0000 7f49bea98800 1 --2- 172.21.15.142:0/541698809 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f489403cfb0 0x7f489403f470 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x562cdda12390 tx=0x7f49ac06b5c0 comp rx=0 tx=0).stop 2024-09-22T08:37:05.867 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.861+0000 7f49bea98800 1 -- 172.21.15.142:0/541698809 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562cdda209d0 msgr2=0x562cdda20df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:05.867 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.861+0000 7f49bea98800 1 --2- 172.21.15.142:0/541698809 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562cdda209d0 0x562cdda20df0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x562cdda078c0 tx=0x7f49b400bf30 comp rx=0 tx=0).stop 2024-09-22T08:37:05.868 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.861+0000 7f49bea98800 1 -- 172.21.15.142:0/541698809 shutdown_connections 2024-09-22T08:37:05.868 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.861+0000 7f49bea98800 1 --2- 172.21.15.142:0/541698809 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f489403cfb0 0x7f489403f470 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:05.868 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.861+0000 7f49bea98800 1 --2- 172.21.15.142:0/541698809 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562cdda209d0 0x562cdda20df0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:05.868 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.861+0000 7f49bea98800 1 -- 172.21.15.142:0/541698809 >> 172.21.15.142:0/541698809 conn(0x562cdda14d80 msgr2=0x562cdda15160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:37:05.868 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.861+0000 7f49bea98800 1 -- 172.21.15.142:0/541698809 shutdown_connections 2024-09-22T08:37:05.868 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.861+0000 7f49bea98800 1 -- 172.21.15.142:0/541698809 wait complete. 2024-09-22T08:37:05.868 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.861+0000 7f49bea98800 1 -- 172.21.15.142:0/4080545814 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x562cdd910710 msgr2=0x562cdda0d020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:05.868 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.861+0000 7f49bea98800 1 --2- 172.21.15.142:0/4080545814 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x562cdd910710 0x562cdda0d020 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:05.868 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.861+0000 7f49bea98800 1 -- 172.21.15.142:0/4080545814 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x562cdda0f3c0 msgr2=0x562cdda11860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:05.868 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.861+0000 7f49bea98800 1 --2- 172.21.15.142:0/4080545814 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x562cdda0f3c0 0x562cdda11860 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:05.868 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.861+0000 7f49bea98800 1 -- 172.21.15.142:0/4080545814 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f48a403d000 msgr2=0x7f48a403f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:05.868 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.861+0000 7f49bea98800 1 --2- 172.21.15.142:0/4080545814 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f48a403d000 0x7f48a403f4c0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f49a4001d70 tx=0x7f49a40012d0 comp rx=0 tx=0).stop 2024-09-22T08:37:05.868 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.861+0000 7f49bea98800 1 -- 172.21.15.142:0/4080545814 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562cdd90dd80 msgr2=0x562cdda059d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:05.868 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.861+0000 7f49bea98800 1 --2- 172.21.15.142:0/4080545814 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562cdd90dd80 0x562cdda059d0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f49ac025a60 tx=0x7f49ac003330 comp rx=0 tx=0).stop 2024-09-22T08:37:05.869 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.861+0000 7f49bea98800 1 -- 172.21.15.142:0/4080545814 shutdown_connections 2024-09-22T08:37:05.869 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.861+0000 7f49bea98800 1 --2- 172.21.15.142:0/4080545814 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x562cdda0f3c0 0x562cdda11860 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:05.869 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.861+0000 7f49bea98800 1 --2- 172.21.15.142:0/4080545814 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x562cdd910710 0x562cdda0d020 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:05.869 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.861+0000 7f49bea98800 1 --2- 172.21.15.142:0/4080545814 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f48a403d000 0x7f48a403f4c0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:05.869 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.861+0000 7f49bea98800 1 --2- 172.21.15.142:0/4080545814 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562cdd90dd80 0x562cdda059d0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:05.869 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.861+0000 7f49bea98800 1 -- 172.21.15.142:0/4080545814 >> 172.21.15.142:0/4080545814 conn(0x562cdd908310 msgr2=0x562cdd9f70e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:37:05.869 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.861+0000 7f49bea98800 1 -- 172.21.15.142:0/4080545814 shutdown_connections 2024-09-22T08:37:05.869 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.861+0000 7f49bea98800 1 -- 172.21.15.142:0/4080545814 wait complete. 2024-09-22T08:37:05.871 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-22T08:36:42.661297Z'}], 'swift_keys': [], 'caps': [{'type': 'user', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-22T08:36:42.661288Z', 'tags': [], 'group_ids': []} 2024-09-22T08:37:05.871 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'rm', '--uid', 'foo', '--caps', 'user=read'] 2024-09-22T08:37:05.871 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'rm', '--uid', 'foo', '--caps', 'user=read'] 2024-09-22T08:37:05.872 DEBUG:teuthology.orchestra.run.smithi142:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps rm --uid foo --caps user=read 2024-09-22T08:37:05.918 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:37:05.918 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:37:05.919 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.918+0000 7fce2ec87800 1 Processor -- start 2024-09-22T08:37:05.919 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.918+0000 7fce2ec87800 1 -- start start 2024-09-22T08:37:05.919 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.918+0000 7fce2ec87800 1 --2- >> v2:172.21.15.31:3300/0 conn(0x5579306febb0 0x557930700fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:05.919 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.918+0000 7fce2ec87800 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x557930585a20 con 0x5579306fb0a0 2024-09-22T08:37:05.919 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.918+0000 7fce2ec87800 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x5579305857d0 con 0x5579306febb0 2024-09-22T08:37:05.920 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.918+0000 7fce2bf70640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x5579306febb0 0x557930700fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:05.920 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.918+0000 7fce2c771640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x5579306fb0a0 0x5579306fd490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.142:56386/0 (socket says 172.21.15.142:56386) 2024-09-22T08:37:05.920 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.918+0000 7fce2c771640 1 -- 172.21.15.142:0/987929727 learned_addr learned my addr 172.21.15.142:0/987929727 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-09-22T08:37:05.920 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.918+0000 7fce2bf70640 1 -- 172.21.15.142:0/987929727 >> v1:172.21.15.31:6789/0 conn(0x5579306fb0a0 legacy=0x5579306fd490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:05.920 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.918+0000 7fce2bf70640 1 -- 172.21.15.142:0/987929727 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x557930702580 con 0x5579306febb0 2024-09-22T08:37:05.921 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.920+0000 7fce2bf70640 1 --2- 172.21.15.142:0/987929727 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5579306febb0 0x557930700fa0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fce2000a470 tx=0x7fce20045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=328916d842521b38 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:05.921 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.920+0000 7fce2b76f640 1 -- 172.21.15.142:0/987929727 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce20053570 con 0x5579306febb0 2024-09-22T08:37:05.921 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.920+0000 7fce2b76f640 1 -- 172.21.15.142:0/987929727 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce20058070 con 0x5579306febb0 2024-09-22T08:37:05.922 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.920+0000 7fce2b76f640 1 -- 172.21.15.142:0/987929727 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce20053880 con 0x5579306febb0 2024-09-22T08:37:05.922 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.921+0000 7fce2ec87800 1 -- 172.21.15.142:0/987929727 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5579306febb0 msgr2=0x557930700fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:05.922 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.921+0000 7fce2ec87800 1 --2- 172.21.15.142:0/987929727 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5579306febb0 0x557930700fa0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fce2000a470 tx=0x7fce20045a20 comp rx=0 tx=0).stop 2024-09-22T08:37:05.922 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.921+0000 7fce2ec87800 1 -- 172.21.15.142:0/987929727 shutdown_connections 2024-09-22T08:37:05.922 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.921+0000 7fce2ec87800 1 --2- 172.21.15.142:0/987929727 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5579306febb0 0x557930700fa0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:05.923 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.921+0000 7fce2ec87800 1 -- 172.21.15.142:0/987929727 >> 172.21.15.142:0/987929727 conn(0x5579306f4be0 msgr2=0x5579306f7020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:37:05.923 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.921+0000 7fce2ec87800 1 -- 172.21.15.142:0/987929727 shutdown_connections 2024-09-22T08:37:05.923 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.921+0000 7fce2ec87800 1 -- 172.21.15.142:0/987929727 wait complete. 2024-09-22T08:37:05.936 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.934+0000 7fce2ec87800 1 Processor -- start 2024-09-22T08:37:05.936 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.934+0000 7fce2ec87800 1 -- start start 2024-09-22T08:37:05.936 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.935+0000 7fce2ec87800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5579306fb0a0 0x5579307e9fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:05.936 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.935+0000 7fce2ec87800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x557930592dd0 con 0x5579306fb0a0 2024-09-22T08:37:05.937 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.935+0000 7fce2c771640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5579306fb0a0 0x5579307e9fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:05.937 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.935+0000 7fce2c771640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5579306fb0a0 0x5579307e9fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:59638/0 (socket says 172.21.15.142:59638) 2024-09-22T08:37:05.937 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.935+0000 7fce2c771640 1 -- 172.21.15.142:0/901169970 learned_addr learned my addr 172.21.15.142:0/901169970 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:37:05.937 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.935+0000 7fce2c771640 1 -- 172.21.15.142:0/901169970 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5579307ea5d0 con 0x5579306fb0a0 2024-09-22T08:37:05.937 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.935+0000 7fce2c771640 1 --2- 172.21.15.142:0/901169970 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5579306fb0a0 0x5579307e9fe0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fce1c001df0 tx=0x7fce1c00b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1470e58aae189027 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:05.937 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.936+0000 7fcd1a60c640 1 -- 172.21.15.142:0/901169970 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce1c012020 con 0x5579306fb0a0 2024-09-22T08:37:05.937 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.936+0000 7fcd1a60c640 1 -- 172.21.15.142:0/901169970 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce1c00e470 con 0x5579306fb0a0 2024-09-22T08:37:05.937 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.936+0000 7fcd1a60c640 1 -- 172.21.15.142:0/901169970 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce1c00e7f0 con 0x5579306fb0a0 2024-09-22T08:37:05.939 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.936+0000 7fce2ec87800 1 -- 172.21.15.142:0/901169970 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5579306fb0a0 msgr2=0x5579307e9fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:05.939 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.936+0000 7fce2ec87800 1 --2- 172.21.15.142:0/901169970 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5579306fb0a0 0x5579307e9fe0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fce1c001df0 tx=0x7fce1c00b6c0 comp rx=0 tx=0).stop 2024-09-22T08:37:05.939 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.936+0000 7fce2ec87800 1 -- 172.21.15.142:0/901169970 shutdown_connections 2024-09-22T08:37:05.939 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.936+0000 7fce2ec87800 1 --2- 172.21.15.142:0/901169970 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5579306fb0a0 0x5579307e9fe0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:05.939 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.936+0000 7fce2ec87800 1 -- 172.21.15.142:0/901169970 >> 172.21.15.142:0/901169970 conn(0x5579306f4be0 msgr2=0x5579307e5960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:37:05.939 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.936+0000 7fce2ec87800 1 -- 172.21.15.142:0/901169970 shutdown_connections 2024-09-22T08:37:05.940 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.936+0000 7fce2ec87800 1 -- 172.21.15.142:0/901169970 wait complete. 2024-09-22T08:37:05.940 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.937+0000 7fce2ec87800 1 Processor -- start 2024-09-22T08:37:05.940 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.937+0000 7fce2ec87800 1 -- start start 2024-09-22T08:37:05.940 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.937+0000 7fce2ec87800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5579306fb0a0 0x5579307f1b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:05.940 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.937+0000 7fce2ec87800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x557930701870 con 0x5579306fb0a0 2024-09-22T08:37:05.940 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.937+0000 7fce2c771640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5579306fb0a0 0x5579307f1b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:05.940 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.937+0000 7fce2c771640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5579306fb0a0 0x5579307f1b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:59654/0 (socket says 172.21.15.142:59654) 2024-09-22T08:37:05.940 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.937+0000 7fce2c771640 1 -- 172.21.15.142:0/3211063161 learned_addr learned my addr 172.21.15.142:0/3211063161 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:37:05.940 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.937+0000 7fce2c771640 1 -- 172.21.15.142:0/3211063161 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5579307f2080 con 0x5579306fb0a0 2024-09-22T08:37:05.940 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.937+0000 7fce2c771640 1 --2- 172.21.15.142:0/3211063161 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5579306fb0a0 0x5579307f1b20 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x5579307eaf70 tx=0x7fce1c000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:05.940 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.938+0000 7fcd18e09640 1 -- 172.21.15.142:0/3211063161 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce1c012030 con 0x5579306fb0a0 2024-09-22T08:37:05.940 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.938+0000 7fcd18e09640 1 -- 172.21.15.142:0/3211063161 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce1c01a6d0 con 0x5579306fb0a0 2024-09-22T08:37:05.941 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.938+0000 7fce2ec87800 1 -- 172.21.15.142:0/3211063161 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5579307f2310 con 0x5579306fb0a0 2024-09-22T08:37:05.941 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.938+0000 7fcd18e09640 1 -- 172.21.15.142:0/3211063161 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce1c01a9d0 con 0x5579306fb0a0 2024-09-22T08:37:05.941 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.938+0000 7fce2ec87800 1 -- 172.21.15.142:0/3211063161 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5579307f2d10 con 0x5579306fb0a0 2024-09-22T08:37:05.944 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.939+0000 7fcd18e09640 1 -- 172.21.15.142:0/3211063161 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fce1c015020 con 0x5579306fb0a0 2024-09-22T08:37:05.944 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.939+0000 7fcd18e09640 1 --2- 172.21.15.142:0/3211063161 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fcd1403cfb0 0x7fcd1403f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:05.944 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.939+0000 7fcd18e09640 1 -- 172.21.15.142:0/3211063161 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5938+0+0 (secure 0 0 0) 0x7fce1c020030 con 0x5579306fb0a0 2024-09-22T08:37:05.944 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.939+0000 7fce2bf70640 1 --2- 172.21.15.142:0/3211063161 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fcd1403cfb0 0x7fcd1403f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:05.944 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.939+0000 7fce2ec87800 1 --2- 172.21.15.142:0/3211063161 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5579306febb0 0x5579307f9170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:05.944 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.939+0000 7fce2ec87800 1 -- 172.21.15.142:0/3211063161 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5579307f96b0 con 0x5579306febb0 2024-09-22T08:37:05.944 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.939+0000 7fce2cf72640 1 --2- 172.21.15.142:0/3211063161 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5579306febb0 0x5579307f9170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:05.944 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.939+0000 7fce2bf70640 1 --2- 172.21.15.142:0/3211063161 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fcd1403cfb0 0x7fcd1403f470 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fce20057000 tx=0x7fce20052000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:05.944 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.939+0000 7fce2cf72640 1 --2- 172.21.15.142:0/3211063161 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5579306febb0 0x5579307f9170 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:05.945 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.940+0000 7fce2cf72640 1 -- 172.21.15.142:0/3211063161 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fce2400a4d0 con 0x5579306febb0 2024-09-22T08:37:05.945 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.940+0000 7fce2ec87800 1 -- 172.21.15.142:0/3211063161 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5579307f9a50 con 0x5579306febb0 2024-09-22T08:37:05.945 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.940+0000 7fce2cf72640 1 -- 172.21.15.142:0/3211063161 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fce2400a4d0 con 0x5579306febb0 2024-09-22T08:37:05.945 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.940+0000 7fce2ec87800 1 --2- 172.21.15.142:0/3211063161 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5579307fb590 0x5579307fda00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:05.945 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.940+0000 7fce2ec87800 1 -- 172.21.15.142:0/3211063161 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:3 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5579307fe190 con 0x5579307fb590 2024-09-22T08:37:05.945 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.940+0000 7fce2c771640 1 --2- 172.21.15.142:0/3211063161 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5579307fb590 0x5579307fda00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:05.945 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.940+0000 7fce2c771640 1 --2- 172.21.15.142:0/3211063161 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5579307fb590 0x5579307fda00 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:05.945 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.941+0000 7fce2c771640 1 -- 172.21.15.142:0/3211063161 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(3 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fce1c01ad50 con 0x5579307fb590 2024-09-22T08:37:05.945 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.941+0000 7fce2ec87800 1 -- 172.21.15.142:0/3211063161 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5579307fa2a0 con 0x5579306febb0 2024-09-22T08:37:05.945 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.941+0000 7fce2cf72640 1 -- 172.21.15.142:0/3211063161 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fce2400a4d0 con 0x5579306febb0 2024-09-22T08:37:05.945 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.941+0000 7fce2ec87800 1 -- 172.21.15.142:0/3211063161 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5579307fa700 con 0x5579307fb590 2024-09-22T08:37:05.945 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.941+0000 7fce2c771640 1 -- 172.21.15.142:0/3211063161 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(5 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fce1c01ad50 con 0x5579307fb590 2024-09-22T08:37:05.945 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.942+0000 7fce2ec87800 1 Processor -- start 2024-09-22T08:37:05.946 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.942+0000 7fce2ec87800 1 -- start start 2024-09-22T08:37:05.946 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.942+0000 7fce2ec87800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55793080cb20 0x55793080cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:05.946 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.942+0000 7fce2ec87800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5579305f1d50 con 0x55793080cb20 2024-09-22T08:37:05.946 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.942+0000 7fce2cf72640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55793080cb20 0x55793080cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:05.946 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.942+0000 7fce2cf72640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55793080cb20 0x55793080cf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:59664/0 (socket says 172.21.15.142:59664) 2024-09-22T08:37:05.946 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.942+0000 7fce2cf72640 1 -- 172.21.15.142:0/143386620 learned_addr learned my addr 172.21.15.142:0/143386620 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:37:05.946 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.942+0000 7fce2cf72640 1 -- 172.21.15.142:0/143386620 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55793080d580 con 0x55793080cb20 2024-09-22T08:37:05.946 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.942+0000 7fce2cf72640 1 --2- 172.21.15.142:0/143386620 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55793080cb20 0x55793080cf40 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x5579307f2ee0 tx=0x7fce240167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:05.946 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.943+0000 7fcd11ffb640 1 -- 172.21.15.142:0/143386620 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce24013640 con 0x55793080cb20 2024-09-22T08:37:05.946 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.943+0000 7fcd11ffb640 1 -- 172.21.15.142:0/143386620 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce240137e0 con 0x55793080cb20 2024-09-22T08:37:05.946 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.943+0000 7fce2ec87800 1 -- 172.21.15.142:0/143386620 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55793080ddb0 con 0x55793080cb20 2024-09-22T08:37:05.946 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.943+0000 7fcd11ffb640 1 -- 172.21.15.142:0/143386620 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce24013b00 con 0x55793080cb20 2024-09-22T08:37:05.946 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.943+0000 7fce2ec87800 1 -- 172.21.15.142:0/143386620 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55793080e350 con 0x55793080cb20 2024-09-22T08:37:05.953 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.943+0000 7fcd11ffb640 1 -- 172.21.15.142:0/143386620 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fce24011040 con 0x55793080cb20 2024-09-22T08:37:05.953 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.944+0000 7fcd11ffb640 1 --2- 172.21.15.142:0/143386620 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fcd0403cfb0 0x7fcd0403f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:05.953 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.944+0000 7fcd11ffb640 1 -- 172.21.15.142:0/143386620 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5938+0+0 (secure 0 0 0) 0x7fce2400e040 con 0x55793080cb20 2024-09-22T08:37:05.953 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.944+0000 7fce2c771640 1 --2- 172.21.15.142:0/143386620 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fcd0403cfb0 0x7fcd0403f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:05.953 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.944+0000 7fce2ec87800 1 Processor -- start 2024-09-22T08:37:05.953 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.944+0000 7fce2c771640 1 --2- 172.21.15.142:0/143386620 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fcd0403cfb0 0x7fcd0403f470 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fce1c052b90 tx=0x7fce1c00ef30 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:05.953 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.944+0000 7fce2ec87800 1 -- start start 2024-09-22T08:37:05.953 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.944+0000 7fce2ec87800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5579308195c0 0x5579308199c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:05.953 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.944+0000 7fce2ec87800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5579307eaa00 con 0x5579308195c0 2024-09-22T08:37:05.954 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.945+0000 7fce2cf72640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5579308195c0 0x5579308199c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:05.954 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.945+0000 7fce2cf72640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5579308195c0 0x5579308199c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:59676/0 (socket says 172.21.15.142:59676) 2024-09-22T08:37:05.954 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.945+0000 7fce2cf72640 1 -- 172.21.15.142:0/3109452113 learned_addr learned my addr 172.21.15.142:0/3109452113 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:37:05.954 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.945+0000 7fce2cf72640 1 -- 172.21.15.142:0/3109452113 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557930819fb0 con 0x5579308195c0 2024-09-22T08:37:05.954 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.945+0000 7fce2cf72640 1 --2- 172.21.15.142:0/3109452113 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5579308195c0 0x5579308199c0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fce24054830 tx=0x7fce24054b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96f49d054f119a7a server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:05.954 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.945+0000 7fcd037fe640 1 -- 172.21.15.142:0/3109452113 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce24051030 con 0x5579308195c0 2024-09-22T08:37:05.954 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.945+0000 7fcd037fe640 1 -- 172.21.15.142:0/3109452113 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce24013ca0 con 0x5579308195c0 2024-09-22T08:37:05.954 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.945+0000 7fcd037fe640 1 -- 172.21.15.142:0/3109452113 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce24021440 con 0x5579308195c0 2024-09-22T08:37:05.954 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.945+0000 7fce2ec87800 1 -- 172.21.15.142:0/3109452113 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5579308195c0 msgr2=0x5579308199c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:05.954 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.945+0000 7fce2ec87800 1 --2- 172.21.15.142:0/3109452113 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5579308195c0 0x5579308199c0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fce24054830 tx=0x7fce24054b80 comp rx=0 tx=0).stop 2024-09-22T08:37:05.954 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.946+0000 7fce2ec87800 1 -- 172.21.15.142:0/3109452113 shutdown_connections 2024-09-22T08:37:05.954 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.946+0000 7fce2ec87800 1 --2- 172.21.15.142:0/3109452113 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5579308195c0 0x5579308199c0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:05.954 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.946+0000 7fce2ec87800 1 -- 172.21.15.142:0/3109452113 >> 172.21.15.142:0/3109452113 conn(0x5579308159c0 msgr2=0x557930813c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:37:05.955 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.946+0000 7fce2ec87800 1 -- 172.21.15.142:0/3109452113 shutdown_connections 2024-09-22T08:37:05.955 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.946+0000 7fce2ec87800 1 -- 172.21.15.142:0/3109452113 wait complete. 2024-09-22T08:37:05.955 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.946+0000 7fce2ec87800 1 Processor -- start 2024-09-22T08:37:05.955 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.946+0000 7fce2ec87800 1 -- start start 2024-09-22T08:37:05.955 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.946+0000 7fce2ec87800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5579308195c0 0x557930820b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:05.955 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.946+0000 7fce2ec87800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55793081a5d0 con 0x5579308195c0 2024-09-22T08:37:05.955 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.946+0000 7fce2cf72640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5579308195c0 0x557930820b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:05.955 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.946+0000 7fce2cf72640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5579308195c0 0x557930820b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:59680/0 (socket says 172.21.15.142:59680) 2024-09-22T08:37:05.955 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.946+0000 7fce2cf72640 1 -- 172.21.15.142:0/916064780 learned_addr learned my addr 172.21.15.142:0/916064780 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:37:05.955 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.946+0000 7fce2cf72640 1 -- 172.21.15.142:0/916064780 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5579308210e0 con 0x5579308195c0 2024-09-22T08:37:05.955 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.947+0000 7fce2cf72640 1 --2- 172.21.15.142:0/916064780 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5579308195c0 0x557930820b80 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fce24020b60 tx=0x7fce24054860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:05.955 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.947+0000 7fcd01ffb640 1 -- 172.21.15.142:0/916064780 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce24051040 con 0x5579308195c0 2024-09-22T08:37:05.955 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.947+0000 7fcd01ffb640 1 -- 172.21.15.142:0/916064780 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce240534f0 con 0x5579308195c0 2024-09-22T08:37:05.956 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.947+0000 7fce2ec87800 1 -- 172.21.15.142:0/916064780 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557930821370 con 0x5579308195c0 2024-09-22T08:37:05.956 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.947+0000 7fcd01ffb640 1 -- 172.21.15.142:0/916064780 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce24020d00 con 0x5579308195c0 2024-09-22T08:37:05.956 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.947+0000 7fce2ec87800 1 -- 172.21.15.142:0/916064780 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557930821cf0 con 0x5579308195c0 2024-09-22T08:37:05.956 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.948+0000 7fcd01ffb640 1 -- 172.21.15.142:0/916064780 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fce2401fa90 con 0x5579308195c0 2024-09-22T08:37:05.956 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.948+0000 7fcd01ffb640 1 --2- 172.21.15.142:0/916064780 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fccf403cf60 0x7fccf403f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:05.956 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.948+0000 7fcd01ffb640 1 -- 172.21.15.142:0/916064780 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5938+0+0 (secure 0 0 0) 0x7fce2404b030 con 0x5579308195c0 2024-09-22T08:37:05.956 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.948+0000 7fce2c771640 1 --2- 172.21.15.142:0/916064780 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fccf403cf60 0x7fccf403f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:05.956 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.948+0000 7fce2c771640 1 --2- 172.21.15.142:0/916064780 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fccf403cf60 0x7fccf403f420 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x5579307f3c40 tx=0x7fce1c045000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:05.956 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.948+0000 7fce2ec87800 20 rados->read ofs=0 len=0 2024-09-22T08:37:05.956 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.948+0000 7fce2ec87800 1 --2- 172.21.15.142:0/916064780 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55793082c4a0 0x55793082e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:05.956 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.949+0000 7fce2ec87800 1 -- 172.21.15.142:0/916064780 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55793082f0b0 con 0x55793082c4a0 2024-09-22T08:37:05.956 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.949+0000 7fce2bf70640 1 --2- 172.21.15.142:0/916064780 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55793082c4a0 0x55793082e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:05.956 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.949+0000 7fce2bf70640 1 --2- 172.21.15.142:0/916064780 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55793082c4a0 0x55793082e960 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:05.957 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.949+0000 7fce2bf70640 1 -- 172.21.15.142:0/916064780 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fce20051070 con 0x55793082c4a0 2024-09-22T08:37:05.957 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.949+0000 7fce2ec87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:05.957 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.949+0000 7fce2ec87800 20 realm 2024-09-22T08:37:05.957 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.949+0000 7fce2ec87800 20 rados->read ofs=0 len=0 2024-09-22T08:37:05.957 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.949+0000 7fce2ec87800 1 -- 172.21.15.142:0/916064780 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55793082f4e0 con 0x55793082c4a0 2024-09-22T08:37:05.957 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.949+0000 7fce2bf70640 1 -- 172.21.15.142:0/916064780 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fce20051070 con 0x55793082c4a0 2024-09-22T08:37:05.957 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.949+0000 7fce2ec87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:05.957 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.949+0000 7fce2ec87800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:37:05.957 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.949+0000 7fce2ec87800 20 rados->read ofs=0 len=0 2024-09-22T08:37:05.957 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.949+0000 7fce2ec87800 1 -- 172.21.15.142:0/916064780 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55793082fdb0 con 0x55793082c4a0 2024-09-22T08:37:05.957 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.950+0000 7fce2bf70640 1 -- 172.21.15.142:0/916064780 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fce20051070 con 0x55793082c4a0 2024-09-22T08:37:05.957 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.950+0000 7fce2ec87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:05.957 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.950+0000 7fce2ec87800 20 rados->read ofs=0 len=0 2024-09-22T08:37:05.957 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.950+0000 7fce2ec87800 1 -- 172.21.15.142:0/916064780 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557930830150 con 0x55793082c4a0 2024-09-22T08:37:05.958 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.950+0000 7fce2bf70640 1 -- 172.21.15.142:0/916064780 <== osd.1 v2:172.21.15.142:6816/3192108003 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fce20051070 con 0x55793082c4a0 2024-09-22T08:37:05.958 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.950+0000 7fce2ec87800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:37:05.958 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.950+0000 7fce2ec87800 20 rados->read ofs=0 len=0 2024-09-22T08:37:05.958 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.950+0000 7fce2ec87800 1 --2- 172.21.15.142:0/916064780 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x557930830eb0 0x5579308332a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:05.958 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.950+0000 7fce2ec87800 1 -- 172.21.15.142:0/916064780 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5579308338b0 con 0x557930830eb0 2024-09-22T08:37:05.958 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.950+0000 7fce2cf72640 1 --2- 172.21.15.142:0/916064780 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x557930830eb0 0x5579308332a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:05.958 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.950+0000 7fce2cf72640 1 --2- 172.21.15.142:0/916064780 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x557930830eb0 0x5579308332a0 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:05.958 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.950+0000 7fce2cf72640 1 -- 172.21.15.142:0/916064780 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(5 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fce2403a070 con 0x557930830eb0 2024-09-22T08:37:05.958 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.950+0000 7fce2ec87800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:37:05.958 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.951+0000 7fce2ec87800 20 searching for the correct realm 2024-09-22T08:37:05.958 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.951+0000 7fce2ec87800 1 -- 172.21.15.142:0/916064780 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5579308351e0 con 0x557930830eb0 2024-09-22T08:37:05.958 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.951+0000 7fce2cf72640 1 -- 172.21.15.142:0/916064780 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce2403a070 con 0x557930830eb0 2024-09-22T08:37:05.958 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.951+0000 7fce2cf72640 1 --2- 172.21.15.142:0/916064780 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7fce240358a0 0x7fce2403b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:05.958 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.951+0000 7fce2cf72640 1 -- 172.21.15.142:0/916064780 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5579308351e0 con 0x7fce240358a0 2024-09-22T08:37:05.959 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.951+0000 7fce2c771640 1 --2- 172.21.15.142:0/916064780 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7fce240358a0 0x7fce2403b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:05.959 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.951+0000 7fce2c771640 1 --2- 172.21.15.142:0/916064780 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7fce240358a0 0x7fce2403b770 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:05.959 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.951+0000 7fce2c771640 1 -- 172.21.15.142:0/916064780 <== osd.2 v2:172.21.15.142:6808/279438927 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce1c01ad50 con 0x7fce240358a0 2024-09-22T08:37:05.959 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.951+0000 7fce2c771640 1 --2- 172.21.15.142:0/916064780 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7fce1c017050 0x7fce1c04b930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:05.959 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.951+0000 7fce2c771640 1 -- 172.21.15.142:0/916064780 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5579308351e0 con 0x7fce1c017050 2024-09-22T08:37:05.959 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.952+0000 7fce2bf70640 1 --2- 172.21.15.142:0/916064780 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7fce1c017050 0x7fce1c04b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:05.959 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.952+0000 7fce2bf70640 1 --2- 172.21.15.142:0/916064780 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7fce1c017050 0x7fce1c04b930 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:05.968 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.952+0000 7fce2bf70640 1 -- 172.21.15.142:0/916064780 <== osd.0 v2:172.21.15.31:6800/168281188 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce20051070 con 0x7fce1c017050 2024-09-22T08:37:05.968 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.952+0000 7fce2bf70640 1 -- 172.21.15.142:0/916064780 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5579308351e0 con 0x55793082c4a0 2024-09-22T08:37:05.968 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.952+0000 7fce2bf70640 1 -- 172.21.15.142:0/916064780 <== osd.1 v2:172.21.15.142:6816/3192108003 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce20051070 con 0x55793082c4a0 2024-09-22T08:37:05.968 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.952+0000 7fce2bf70640 1 -- 172.21.15.142:0/916064780 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5579308351e0 con 0x55793082c4a0 2024-09-22T08:37:05.968 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.953+0000 7fce2bf70640 1 -- 172.21.15.142:0/916064780 <== osd.1 v2:172.21.15.142:6816/3192108003 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce20051070 con 0x55793082c4a0 2024-09-22T08:37:05.968 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.953+0000 7fce2bf70640 1 -- 172.21.15.142:0/916064780 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5579308351e0 con 0x55793082c4a0 2024-09-22T08:37:05.968 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.953+0000 7fce2bf70640 1 -- 172.21.15.142:0/916064780 <== osd.1 v2:172.21.15.142:6816/3192108003 7 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce20051070 con 0x55793082c4a0 2024-09-22T08:37:05.968 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.953+0000 7fce2bf70640 1 -- 172.21.15.142:0/916064780 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5579308351e0 con 0x7fce1c017050 2024-09-22T08:37:05.968 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.953+0000 7fce2bf70640 1 -- 172.21.15.142:0/916064780 <== osd.0 v2:172.21.15.31:6800/168281188 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce20051070 con 0x7fce1c017050 2024-09-22T08:37:05.968 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.953+0000 7fce2bf70640 1 -- 172.21.15.142:0/916064780 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5579308351e0 con 0x7fce240358a0 2024-09-22T08:37:05.968 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.953+0000 7fce2c771640 1 -- 172.21.15.142:0/916064780 <== osd.2 v2:172.21.15.142:6808/279438927 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce1c01ad50 con 0x7fce240358a0 2024-09-22T08:37:05.968 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.953+0000 7fce2c771640 1 -- 172.21.15.142:0/916064780 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5579308351e0 con 0x557930830eb0 2024-09-22T08:37:05.969 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.954+0000 7fce2cf72640 1 -- 172.21.15.142:0/916064780 <== osd.3 v2:172.21.15.142:6800/1064901393 3 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce2403a070 con 0x557930830eb0 2024-09-22T08:37:05.969 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.954+0000 7fce2cf72640 1 -- 172.21.15.142:0/916064780 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5579308351e0 con 0x55793082c4a0 2024-09-22T08:37:05.969 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.954+0000 7fce2bf70640 1 -- 172.21.15.142:0/916064780 <== osd.1 v2:172.21.15.142:6816/3192108003 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce20051070 con 0x55793082c4a0 2024-09-22T08:37:05.969 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.954+0000 7fce2bf70640 1 -- 172.21.15.142:0/916064780 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5579308351e0 con 0x7fce1c017050 2024-09-22T08:37:05.969 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.954+0000 7fce2bf70640 1 -- 172.21.15.142:0/916064780 <== osd.0 v2:172.21.15.31:6800/168281188 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce20051070 con 0x7fce1c017050 2024-09-22T08:37:05.969 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.954+0000 7fce2bf70640 1 -- 172.21.15.142:0/916064780 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5579308351e0 con 0x55793082c4a0 2024-09-22T08:37:05.969 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.954+0000 7fce2bf70640 1 -- 172.21.15.142:0/916064780 <== osd.1 v2:172.21.15.142:6816/3192108003 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce20051070 con 0x55793082c4a0 2024-09-22T08:37:05.969 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.954+0000 7fce2bf70640 1 -- 172.21.15.142:0/916064780 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5579308351e0 con 0x7fce240358a0 2024-09-22T08:37:05.969 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.954+0000 7fce2c771640 1 -- 172.21.15.142:0/916064780 <== osd.2 v2:172.21.15.142:6808/279438927 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fce1c01ad50 con 0x7fce240358a0 2024-09-22T08:37:05.969 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.954+0000 7fce2c771640 1 -- 172.21.15.142:0/916064780 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5579308351e0 con 0x557930830eb0 2024-09-22T08:37:05.969 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.955+0000 7fce2cf72640 1 -- 172.21.15.142:0/916064780 <== osd.3 v2:172.21.15.142:6800/1064901393 4 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce2403a070 con 0x557930830eb0 2024-09-22T08:37:05.969 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.955+0000 7fce2cf72640 1 -- 172.21.15.142:0/916064780 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5579308351e0 con 0x557930830eb0 2024-09-22T08:37:05.969 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.955+0000 7fce2cf72640 1 -- 172.21.15.142:0/916064780 <== osd.3 v2:172.21.15.142:6800/1064901393 5 ==== osd_op_reply(20 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fce2403a070 con 0x557930830eb0 2024-09-22T08:37:05.969 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.955+0000 7fce2cf72640 1 -- 172.21.15.142:0/916064780 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5579308351e0 con 0x7fce1c017050 2024-09-22T08:37:05.970 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.955+0000 7fce2bf70640 1 -- 172.21.15.142:0/916064780 <== osd.0 v2:172.21.15.31:6800/168281188 4 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce20051070 con 0x7fce1c017050 2024-09-22T08:37:05.970 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.955+0000 7fce2bf70640 1 -- 172.21.15.142:0/916064780 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5579308351e0 con 0x557930830eb0 2024-09-22T08:37:05.970 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.955+0000 7fce2cf72640 1 -- 172.21.15.142:0/916064780 <== osd.3 v2:172.21.15.142:6800/1064901393 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce2403a070 con 0x557930830eb0 2024-09-22T08:37:05.970 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.956+0000 7fce2cf72640 1 -- 172.21.15.142:0/916064780 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5579308351e0 con 0x557930830eb0 2024-09-22T08:37:05.970 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.956+0000 7fce2cf72640 1 -- 172.21.15.142:0/916064780 <== osd.3 v2:172.21.15.142:6800/1064901393 7 ==== osd_op_reply(23 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fce2403a070 con 0x557930830eb0 2024-09-22T08:37:05.970 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.956+0000 7fce2cf72640 1 -- 172.21.15.142:0/916064780 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5579308351e0 con 0x55793082c4a0 2024-09-22T08:37:05.970 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.956+0000 7fce2bf70640 1 -- 172.21.15.142:0/916064780 <== osd.1 v2:172.21.15.142:6816/3192108003 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce20051070 con 0x55793082c4a0 2024-09-22T08:37:05.970 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.956+0000 7fce2bf70640 1 -- 172.21.15.142:0/916064780 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5579308351e0 con 0x55793082c4a0 2024-09-22T08:37:05.970 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.956+0000 7fce2bf70640 1 -- 172.21.15.142:0/916064780 <== osd.1 v2:172.21.15.142:6816/3192108003 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fce20051070 con 0x55793082c4a0 2024-09-22T08:37:05.970 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.956+0000 7fce2bf70640 1 -- 172.21.15.142:0/916064780 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5579308351e0 con 0x7fce1c017050 2024-09-22T08:37:05.970 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.956+0000 7fce2bf70640 1 -- 172.21.15.142:0/916064780 <== osd.0 v2:172.21.15.31:6800/168281188 5 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce20051070 con 0x7fce1c017050 2024-09-22T08:37:05.970 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.956+0000 7fce2bf70640 1 -- 172.21.15.142:0/916064780 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5579308351e0 con 0x557930830eb0 2024-09-22T08:37:05.971 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.957+0000 7fce2cf72640 1 -- 172.21.15.142:0/916064780 <== osd.3 v2:172.21.15.142:6800/1064901393 8 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce2403a070 con 0x557930830eb0 2024-09-22T08:37:05.971 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.957+0000 7fce2cf72640 1 -- 172.21.15.142:0/916064780 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5579308351e0 con 0x7fce240358a0 2024-09-22T08:37:05.971 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.957+0000 7fce2c771640 1 -- 172.21.15.142:0/916064780 <== osd.2 v2:172.21.15.142:6808/279438927 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce1c01ad50 con 0x7fce240358a0 2024-09-22T08:37:05.971 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.957+0000 7fce2c771640 1 -- 172.21.15.142:0/916064780 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5579308351e0 con 0x55793082c4a0 2024-09-22T08:37:05.971 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.957+0000 7fce2bf70640 1 -- 172.21.15.142:0/916064780 <== osd.1 v2:172.21.15.142:6816/3192108003 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce20051070 con 0x55793082c4a0 2024-09-22T08:37:05.971 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.957+0000 7fce2bf70640 1 -- 172.21.15.142:0/916064780 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5579308351e0 con 0x7fce1c017050 2024-09-22T08:37:05.971 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.957+0000 7fce2bf70640 1 -- 172.21.15.142:0/916064780 <== osd.0 v2:172.21.15.31:6800/168281188 6 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce20051070 con 0x7fce1c017050 2024-09-22T08:37:05.971 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.957+0000 7fce2bf70640 1 -- 172.21.15.142:0/916064780 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5579308351e0 con 0x557930830eb0 2024-09-22T08:37:05.971 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.958+0000 7fce2cf72640 1 -- 172.21.15.142:0/916064780 <== osd.3 v2:172.21.15.142:6800/1064901393 9 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce2403a070 con 0x557930830eb0 2024-09-22T08:37:05.971 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.958+0000 7fce2cf72640 1 -- 172.21.15.142:0/916064780 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5579308351e0 con 0x7fce1c017050 2024-09-22T08:37:05.971 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.958+0000 7fce2bf70640 1 -- 172.21.15.142:0/916064780 <== osd.0 v2:172.21.15.31:6800/168281188 7 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce20051070 con 0x7fce1c017050 2024-09-22T08:37:05.971 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.958+0000 7fce2bf70640 1 -- 172.21.15.142:0/916064780 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5579308351e0 con 0x7fce240358a0 2024-09-22T08:37:05.971 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.958+0000 7fce2c771640 1 -- 172.21.15.142:0/916064780 <== osd.2 v2:172.21.15.142:6808/279438927 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce1c01ad50 con 0x7fce240358a0 2024-09-22T08:37:05.971 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.958+0000 7fce2c771640 1 -- 172.21.15.142:0/916064780 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5579308351e0 con 0x557930830eb0 2024-09-22T08:37:05.972 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.958+0000 7fce2cf72640 1 -- 172.21.15.142:0/916064780 <== osd.3 v2:172.21.15.142:6800/1064901393 10 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce2403a070 con 0x557930830eb0 2024-09-22T08:37:05.972 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.958+0000 7fce2cf72640 1 -- 172.21.15.142:0/916064780 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5579308351e0 con 0x7fce1c017050 2024-09-22T08:37:05.972 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.959+0000 7fce2bf70640 1 -- 172.21.15.142:0/916064780 <== osd.0 v2:172.21.15.31:6800/168281188 8 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce20051070 con 0x7fce1c017050 2024-09-22T08:37:05.972 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.959+0000 7fce2bf70640 1 -- 172.21.15.142:0/916064780 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5579308351e0 con 0x55793082c4a0 2024-09-22T08:37:05.972 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.959+0000 7fce2bf70640 1 -- 172.21.15.142:0/916064780 <== osd.1 v2:172.21.15.142:6816/3192108003 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fce20051070 con 0x55793082c4a0 2024-09-22T08:37:05.972 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.959+0000 7fce2bf70640 1 -- 172.21.15.142:0/916064780 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5579308351e0 con 0x7fce240358a0 2024-09-22T08:37:05.972 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.959+0000 7fce2c771640 1 -- 172.21.15.142:0/916064780 <== osd.2 v2:172.21.15.142:6808/279438927 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce1c01ad50 con 0x7fce240358a0 2024-09-22T08:37:05.972 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.959+0000 7fce2ec87800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:37:05.972 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.959+0000 7fce2ec87800 20 RGWRados::pool_iterate: got zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec 2024-09-22T08:37:05.972 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.959+0000 7fce2ec87800 20 RGWRados::pool_iterate: got zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f 2024-09-22T08:37:05.972 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.959+0000 7fce2ec87800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:37:05.972 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.959+0000 7fce2ec87800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:37:05.972 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.959+0000 7fce2ec87800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:37:05.973 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.959+0000 7fce2ec87800 20 rados->read ofs=0 len=0 2024-09-22T08:37:05.973 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.959+0000 7fce2ec87800 1 -- 172.21.15.142:0/916064780 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5579308342a0 con 0x55793082c4a0 2024-09-22T08:37:05.973 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.959+0000 7fce2bf70640 1 -- 172.21.15.142:0/916064780 <== osd.1 v2:172.21.15.142:6816/3192108003 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fce20051070 con 0x55793082c4a0 2024-09-22T08:37:05.973 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.959+0000 7fce2ec87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:05.973 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.959+0000 7fce2ec87800 20 rados->read ofs=0 len=0 2024-09-22T08:37:05.973 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.959+0000 7fce2ec87800 1 -- 172.21.15.142:0/916064780 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557930834af0 con 0x55793082c4a0 2024-09-22T08:37:05.973 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.960+0000 7fce2bf70640 1 -- 172.21.15.142:0/916064780 <== osd.1 v2:172.21.15.142:6816/3192108003 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fce20051070 con 0x55793082c4a0 2024-09-22T08:37:05.973 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.960+0000 7fce2ec87800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:37:05.973 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.960+0000 7fce2ec87800 20 rados->read ofs=0 len=0 2024-09-22T08:37:05.973 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.960+0000 7fce2ec87800 1 -- 172.21.15.142:0/916064780 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:40 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557930835660 con 0x557930830eb0 2024-09-22T08:37:05.973 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.960+0000 7fce2cf72640 1 -- 172.21.15.142:0/916064780 <== osd.3 v2:172.21.15.142:6800/1064901393 11 ==== osd_op_reply(40 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fce2403a070 con 0x557930830eb0 2024-09-22T08:37:05.973 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.960+0000 7fce2ec87800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:37:05.973 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.960+0000 7fce2ec87800 20 zone default found 2024-09-22T08:37:05.973 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.960+0000 7fce2ec87800 4 Realm: () 2024-09-22T08:37:05.974 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.960+0000 7fce2ec87800 4 ZoneGroup: default (d89f6f57-1007-47dd-9065-f486c7b01aec) 2024-09-22T08:37:05.974 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.960+0000 7fce2ec87800 4 Zone: default (e239248c-0bee-4e41-803a-24b288d3eb8f) 2024-09-22T08:37:05.974 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.960+0000 7fce2ec87800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:37:05.974 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.960+0000 7fce2ec87800 20 zonegroup default 2024-09-22T08:37:05.974 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.960+0000 7fce2ec87800 20 rados->read ofs=0 len=0 2024-09-22T08:37:05.974 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.960+0000 7fce2ec87800 1 -- 172.21.15.142:0/916064780 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557930835a20 con 0x7fce1c017050 2024-09-22T08:37:05.974 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.960+0000 7fce2bf70640 1 -- 172.21.15.142:0/916064780 <== osd.0 v2:172.21.15.31:6800/168281188 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fce20051070 con 0x7fce1c017050 2024-09-22T08:37:05.974 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.960+0000 7fce2ec87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:05.974 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.960+0000 7fce2ec87800 20 rados->read ofs=0 len=0 2024-09-22T08:37:05.974 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.960+0000 7fce2ec87800 1 -- 172.21.15.142:0/916064780 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557930837d00 con 0x557930830eb0 2024-09-22T08:37:05.974 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.961+0000 7fce2cf72640 1 -- 172.21.15.142:0/916064780 <== osd.3 v2:172.21.15.142:6800/1064901393 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fce2403a070 con 0x557930830eb0 2024-09-22T08:37:05.974 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.961+0000 7fce2ec87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:05.974 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.961+0000 7fce2ec87800 20 rados->read ofs=0 len=0 2024-09-22T08:37:05.974 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.961+0000 7fce2ec87800 1 -- 172.21.15.142:0/916064780 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5579308380c0 con 0x557930830eb0 2024-09-22T08:37:05.975 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.961+0000 7fce2cf72640 1 -- 172.21.15.142:0/916064780 <== osd.3 v2:172.21.15.142:6800/1064901393 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fce2403a070 con 0x557930830eb0 2024-09-22T08:37:05.975 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.961+0000 7fce2ec87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:05.975 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.961+0000 7fce2ec87800 20 started sync module instance, tier type = 2024-09-22T08:37:05.975 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.961+0000 7fce2ec87800 20 started zone id=e239248c-0bee-4e41-803a-24b288d3eb8f (name=default) with tier type = 2024-09-22T08:37:05.975 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.961+0000 7fce2ec87800 1 -- 172.21.15.142:0/916064780 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557930837190 con 0x7fce240358a0 2024-09-22T08:37:05.975 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.962+0000 7fce2c771640 1 -- 172.21.15.142:0/916064780 <== osd.2 v2:172.21.15.142:6808/279438927 7 ==== osd_op_reply(44 notify.0 [create] v32'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce1c01ad50 con 0x7fce240358a0 2024-09-22T08:37:05.975 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.962+0000 7fce2ec87800 1 -- 172.21.15.142:0/916064780 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93978993325440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557930836df0 con 0x7fce240358a0 2024-09-22T08:37:05.975 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.962+0000 7fce2ec87800 1 -- 172.21.15.142:0/916064780 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557930838ff0 con 0x55793082c4a0 2024-09-22T08:37:05.975 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.963+0000 7fce2c771640 1 -- 172.21.15.142:0/916064780 <== osd.2 v2:172.21.15.142:6808/279438927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93978993325440] v32'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce1c01ad50 con 0x7fce240358a0 2024-09-22T08:37:05.975 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.963+0000 7fce2bf70640 1 -- 172.21.15.142:0/916064780 <== osd.1 v2:172.21.15.142:6816/3192108003 16 ==== osd_op_reply(46 notify.1 [create] v32'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce20051070 con 0x55793082c4a0 2024-09-22T08:37:05.975 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.963+0000 7fce2ec87800 1 -- 172.21.15.142:0/916064780 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93978993331008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557930839410 con 0x55793082c4a0 2024-09-22T08:37:05.975 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.963+0000 7fce2ec87800 1 -- 172.21.15.142:0/916064780 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557930839dd0 con 0x557930830eb0 2024-09-22T08:37:05.975 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.964+0000 7fce2cf72640 1 -- 172.21.15.142:0/916064780 <== osd.3 v2:172.21.15.142:6800/1064901393 14 ==== osd_op_reply(48 notify.2 [create] v32'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce2403a070 con 0x557930830eb0 2024-09-22T08:37:05.975 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.964+0000 7fce2ec87800 1 -- 172.21.15.142:0/916064780 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93978993334560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55793083a230 con 0x557930830eb0 2024-09-22T08:37:05.976 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.964+0000 7fce2ec87800 1 -- 172.21.15.142:0/916064780 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55793083ad20 con 0x7fce240358a0 2024-09-22T08:37:05.976 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.964+0000 7fce2bf70640 1 -- 172.21.15.142:0/916064780 <== osd.1 v2:172.21.15.142:6816/3192108003 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93978993331008] v32'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce20051070 con 0x55793082c4a0 2024-09-22T08:37:05.976 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.965+0000 7fce2cf72640 1 -- 172.21.15.142:0/916064780 <== osd.3 v2:172.21.15.142:6800/1064901393 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 93978993334560] v32'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce2403a070 con 0x557930830eb0 2024-09-22T08:37:05.976 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.965+0000 7fce2c771640 1 -- 172.21.15.142:0/916064780 <== osd.2 v2:172.21.15.142:6808/279438927 9 ==== osd_op_reply(50 notify.3 [create] v32'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce1c01ad50 con 0x7fce240358a0 2024-09-22T08:37:05.976 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.965+0000 7fce2ec87800 1 -- 172.21.15.142:0/916064780 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93978993338352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557930839d40 con 0x7fce240358a0 2024-09-22T08:37:05.976 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.965+0000 7fce2ec87800 1 -- 172.21.15.142:0/916064780 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55793083b730 con 0x55793082c4a0 2024-09-22T08:37:05.976 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.966+0000 7fce2c771640 1 -- 172.21.15.142:0/916064780 <== osd.2 v2:172.21.15.142:6808/279438927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93978993338352] v32'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce1c01ad50 con 0x7fce240358a0 2024-09-22T08:37:05.976 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.966+0000 7fce2bf70640 1 -- 172.21.15.142:0/916064780 <== osd.1 v2:172.21.15.142:6816/3192108003 18 ==== osd_op_reply(52 notify.4 [create] v32'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce20051070 con 0x55793082c4a0 2024-09-22T08:37:05.976 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.966+0000 7fce2ec87800 1 -- 172.21.15.142:0/916064780 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93978993341056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55793083bb50 con 0x55793082c4a0 2024-09-22T08:37:05.976 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.966+0000 7fce2ec87800 1 -- 172.21.15.142:0/916064780 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55793083c3e0 con 0x7fce1c017050 2024-09-22T08:37:05.980 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.968+0000 7fce2bf70640 1 -- 172.21.15.142:0/916064780 <== osd.1 v2:172.21.15.142:6816/3192108003 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93978993341056] v32'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce20051070 con 0x55793082c4a0 2024-09-22T08:37:05.980 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.968+0000 7fce2bf70640 1 -- 172.21.15.142:0/916064780 <== osd.0 v2:172.21.15.31:6800/168281188 10 ==== osd_op_reply(54 notify.5 [create] v32'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce20051070 con 0x7fce1c017050 2024-09-22T08:37:05.980 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.968+0000 7fce2ec87800 1 -- 172.21.15.142:0/916064780 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93978993342112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55793083bf70 con 0x7fce1c017050 2024-09-22T08:37:05.980 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.968+0000 7fce2ec87800 1 -- 172.21.15.142:0/916064780 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55793083ce30 con 0x7fce1c017050 2024-09-22T08:37:05.980 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.969+0000 7fce2bf70640 1 -- 172.21.15.142:0/916064780 <== osd.0 v2:172.21.15.31:6800/168281188 11 ==== osd_op_reply(56 notify.6 [create] v32'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce20051070 con 0x7fce1c017050 2024-09-22T08:37:05.980 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.969+0000 7fce2ec87800 1 -- 172.21.15.142:0/916064780 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93978993346880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55793083d250 con 0x7fce1c017050 2024-09-22T08:37:05.980 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.969+0000 7fce2ec87800 1 -- 172.21.15.142:0/916064780 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55793083dd70 con 0x7fce1c017050 2024-09-22T08:37:05.980 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.969+0000 7fce2bf70640 1 -- 172.21.15.142:0/916064780 <== osd.0 v2:172.21.15.31:6800/168281188 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93978993342112] v32'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce20051070 con 0x7fce1c017050 2024-09-22T08:37:05.981 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.970+0000 7fce2bf70640 1 -- 172.21.15.142:0/916064780 <== osd.0 v2:172.21.15.31:6800/168281188 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 93978993346880] v32'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce20051070 con 0x7fce1c017050 2024-09-22T08:37:05.981 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.970+0000 7fce2bf70640 1 -- 172.21.15.142:0/916064780 <== osd.0 v2:172.21.15.31:6800/168281188 14 ==== osd_op_reply(58 notify.7 [create] v32'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce20051070 con 0x7fce1c017050 2024-09-22T08:37:05.981 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.970+0000 7fce2ec87800 1 -- 172.21.15.142:0/916064780 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93978993350720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55793083cd60 con 0x7fce1c017050 2024-09-22T08:37:05.981 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.970+0000 7fce2ec87800 20 add_watcher() i=0 2024-09-22T08:37:05.981 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.970+0000 7fce2ec87800 20 add_watcher() i=1 2024-09-22T08:37:05.981 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.970+0000 7fce2ec87800 20 add_watcher() i=2 2024-09-22T08:37:05.981 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.970+0000 7fce2ec87800 20 add_watcher() i=3 2024-09-22T08:37:05.981 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.970+0000 7fce2ec87800 20 add_watcher() i=4 2024-09-22T08:37:05.981 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.970+0000 7fce2ec87800 20 add_watcher() i=5 2024-09-22T08:37:05.981 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.970+0000 7fce2ec87800 20 add_watcher() i=6 2024-09-22T08:37:05.981 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.971+0000 7fce2bf70640 1 -- 172.21.15.142:0/916064780 <== osd.0 v2:172.21.15.31:6800/168281188 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 93978993350720] v32'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce20051070 con 0x7fce1c017050 2024-09-22T08:37:05.981 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.971+0000 7fce2ec87800 20 add_watcher() i=7 2024-09-22T08:37:05.981 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.971+0000 7fce2ec87800 2 all 8 watchers are set, enabling cache 2024-09-22T08:37:05.981 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.971+0000 7fce2ec87800 1 -- 172.21.15.142:0/916064780 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557930840d60 con 0x55793082c4a0 2024-09-22T08:37:05.982 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.971+0000 7fce2bf70640 1 -- 172.21.15.142:0/916064780 <== osd.1 v2:172.21.15.142:6816/3192108003 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fce20051070 con 0x55793082c4a0 2024-09-22T08:37:05.982 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.971+0000 7fce2ec87800 1 -- 172.21.15.142:0/916064780 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93978993343168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55793083e2b0 con 0x55793082c4a0 2024-09-22T08:37:05.982 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.972+0000 7fce2bf70640 1 -- 172.21.15.142:0/916064780 <== osd.1 v2:172.21.15.142:6816/3192108003 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93978993343168] v32'189 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fce20051070 con 0x55793082c4a0 2024-09-22T08:37:05.982 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.972+0000 7fcce37de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:37:05.982 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.973+0000 7fce2ec87800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:37:05.982 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.973+0000 7fce2ec87800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:37:05.982 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.973+0000 7fce2ec87800 5 note: GC not initialized 2024-09-22T08:37:05.982 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.973+0000 7fcce27dc640 20 reqs_thread_entry: start 2024-09-22T08:37:05.982 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.973+0000 7fce2ec87800 20 init_complete bucket index max shards: 11 2024-09-22T08:37:05.982 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.973+0000 7fce2ec87800 20 Filter name: none 2024-09-22T08:37:05.982 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.973+0000 7fccdb7fe640 20 reqs_thread_entry: start 2024-09-22T08:37:05.982 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.973+0000 7fce2ec87800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-22T08:37:05.982 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.973+0000 7fce2ec87800 20 rados->read ofs=0 len=0 2024-09-22T08:37:05.982 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.973+0000 7fce2ec87800 1 -- 172.21.15.142:0/916064780 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557930874070 con 0x55793082c4a0 2024-09-22T08:37:05.983 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.974+0000 7fce2bf70640 1 -- 172.21.15.142:0/916064780 <== osd.1 v2:172.21.15.142:6816/3192108003 22 ==== osd_op_reply(62 foo [call out=48b,read 0~403 out=403b,getxattrs out=75b] v0'0 uv14 ondisk = 0) ==== 231+0+526 (crc 0 0 0) 0x7fce20051070 con 0x55793082c4a0 2024-09-22T08:37:05.983 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.974+0000 7fce2ec87800 20 rados_obj.operate() r=0 bl.length=403 2024-09-22T08:37:05.983 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.974+0000 7fce2ec87800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-22T08:37:05.983 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.974+0000 7fce2ec87800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-22T08:37:05.983 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.974+0000 7fce2ec87800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:37:05.983 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.974+0000 7fce2ec87800 1 -- 172.21.15.142:0/916064780 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55793087a240 con 0x55793082c4a0 2024-09-22T08:37:05.983 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.975+0000 7fce2bf70640 1 -- 172.21.15.142:0/916064780 <== osd.1 v2:172.21.15.142:6816/3192108003 23 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~391] v32'15 uv15 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fce20051070 con 0x55793082c4a0 2024-09-22T08:37:05.983 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.975+0000 7fce2ec87800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-22T08:37:05.983 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.975+0000 7fce2ec87800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-22T08:37:05.983 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.975+0000 7fce2ec87800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-22T08:37:05.983 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.975+0000 7fce2ec87800 1 -- 172.21.15.142:0/916064780 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 93978993597440 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557930875af0 con 0x55793082c4a0 2024-09-22T08:37:05.983 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.975+0000 7fce2bf70640 1 -- 172.21.15.142:0/916064780 <== osd.1 v2:172.21.15.142:6816/3192108003 24 ==== watch-notify(notify (1) cookie 93978993341056 notify 137438953489 ret 0) ==== 609+0+0 (crc 0 0 0) 0x7fce20081040 con 0x55793082c4a0 2024-09-22T08:37:05.983 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.975+0000 7fcd037fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953489 cookie 93978993341056 notifier 4660 bl.length()=567 2024-09-22T08:37:05.983 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.975+0000 7fcd037fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-22T08:37:05.984 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.975+0000 7fcd037fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-22T08:37:05.984 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.975+0000 7fce2bf70640 1 -- 172.21.15.142:0/916064780 <== osd.1 v2:172.21.15.142:6816/3192108003 25 ==== osd_op_reply(64 notify.4 [notify cookie 93978993597440 out=8b] v0'0 uv183 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fce20051070 con 0x55793082c4a0 2024-09-22T08:37:05.984 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.975+0000 7fcd037fe640 1 -- 172.21.15.142:0/916064780 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fccf8003ea0 con 0x55793082c4a0 2024-09-22T08:37:05.984 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.975+0000 7fce2bf70640 1 -- 172.21.15.142:0/916064780 <== osd.1 v2:172.21.15.142:6816/3192108003 26 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce20051070 con 0x55793082c4a0 2024-09-22T08:37:05.984 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.976+0000 7fce2bf70640 1 -- 172.21.15.142:0/916064780 <== osd.1 v2:172.21.15.142:6816/3192108003 27 ==== watch-notify(notify_complete (2) cookie 93978993597440 notify 137438953489 ret 0) ==== 42+0+48 (crc 0 0 0) 0x557930702580 con 0x55793082c4a0 2024-09-22T08:37:05.984 INFO:teuthology.orchestra.run.smithi142.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-22T08:36:42.661297Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-22T08:36:42.661288Z","tags":[],"group_ids":[]} 2024-09-22T08:37:05.986 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.977+0000 7fcce37de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:37:05.986 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.977+0000 7fce2ec87800 1 -- 172.21.15.142:0/916064780 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93978993343168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557930871db0 con 0x55793082c4a0 2024-09-22T08:37:05.986 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.978+0000 7fce2bf70640 1 -- 172.21.15.142:0/916064780 <== osd.1 v2:172.21.15.142:6816/3192108003 28 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 93978993343168] v32'190 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fce20051070 con 0x55793082c4a0 2024-09-22T08:37:05.987 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.978+0000 7fce2ec87800 1 -- 172.21.15.142:0/916064780 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93978993325440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557930871db0 con 0x7fce240358a0 2024-09-22T08:37:05.987 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.979+0000 7fce2c771640 1 -- 172.21.15.142:0/916064780 <== osd.2 v2:172.21.15.142:6808/279438927 11 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 93978993325440] v32'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce1c01ad50 con 0x7fce240358a0 2024-09-22T08:37:05.987 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.979+0000 7fce2ec87800 20 remove_watcher() i=0 2024-09-22T08:37:05.987 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.979+0000 7fce2ec87800 2 removed watcher, disabling cache 2024-09-22T08:37:05.987 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.979+0000 7fce2ec87800 1 -- 172.21.15.142:0/916064780 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93978993331008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557930871db0 con 0x55793082c4a0 2024-09-22T08:37:05.987 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.980+0000 7fce2bf70640 1 -- 172.21.15.142:0/916064780 <== osd.1 v2:172.21.15.142:6816/3192108003 29 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 93978993331008] v32'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce20051070 con 0x55793082c4a0 2024-09-22T08:37:05.987 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.980+0000 7fce2ec87800 20 remove_watcher() i=1 2024-09-22T08:37:05.987 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.980+0000 7fce2ec87800 1 -- 172.21.15.142:0/916064780 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93978993334560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557930871db0 con 0x557930830eb0 2024-09-22T08:37:05.987 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.981+0000 7fce2cf72640 1 -- 172.21.15.142:0/916064780 <== osd.3 v2:172.21.15.142:6800/1064901393 16 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 93978993334560] v32'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce2403a070 con 0x557930830eb0 2024-09-22T08:37:05.987 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.981+0000 7fce2ec87800 20 remove_watcher() i=2 2024-09-22T08:37:05.987 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.981+0000 7fce2ec87800 1 -- 172.21.15.142:0/916064780 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93978993338352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557930871db0 con 0x7fce240358a0 2024-09-22T08:37:05.987 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.982+0000 7fce2c771640 1 -- 172.21.15.142:0/916064780 <== osd.2 v2:172.21.15.142:6808/279438927 12 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 93978993338352] v32'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce1c01ad50 con 0x7fce240358a0 2024-09-22T08:37:05.987 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.982+0000 7fce2ec87800 20 remove_watcher() i=3 2024-09-22T08:37:05.987 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.982+0000 7fce2ec87800 1 -- 172.21.15.142:0/916064780 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93978993341056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557930871db0 con 0x55793082c4a0 2024-09-22T08:37:05.988 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.983+0000 7fce2bf70640 1 -- 172.21.15.142:0/916064780 <== osd.1 v2:172.21.15.142:6816/3192108003 30 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 93978993341056] v32'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce20051070 con 0x55793082c4a0 2024-09-22T08:37:05.988 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.983+0000 7fce2ec87800 20 remove_watcher() i=4 2024-09-22T08:37:05.988 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.983+0000 7fce2ec87800 1 -- 172.21.15.142:0/916064780 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93978993342112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557930871db0 con 0x7fce1c017050 2024-09-22T08:37:05.988 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.984+0000 7fce2bf70640 1 -- 172.21.15.142:0/916064780 <== osd.0 v2:172.21.15.31:6800/168281188 16 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 93978993342112] v32'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce20051070 con 0x7fce1c017050 2024-09-22T08:37:05.988 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.984+0000 7fce2ec87800 20 remove_watcher() i=5 2024-09-22T08:37:05.988 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.984+0000 7fce2ec87800 1 -- 172.21.15.142:0/916064780 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93978993346880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557930871db0 con 0x7fce1c017050 2024-09-22T08:37:05.988 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.985+0000 7fce2bf70640 1 -- 172.21.15.142:0/916064780 <== osd.0 v2:172.21.15.31:6800/168281188 17 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 93978993346880] v32'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce20051070 con 0x7fce1c017050 2024-09-22T08:37:05.988 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.985+0000 7fce2ec87800 20 remove_watcher() i=6 2024-09-22T08:37:05.988 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.985+0000 7fce2ec87800 1 -- 172.21.15.142:0/916064780 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93978993350720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557930871db0 con 0x7fce1c017050 2024-09-22T08:37:05.991 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.986+0000 7fce2bf70640 1 -- 172.21.15.142:0/916064780 <== osd.0 v2:172.21.15.31:6800/168281188 18 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 93978993350720] v32'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce20051070 con 0x7fce1c017050 2024-09-22T08:37:05.991 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.986+0000 7fce2ec87800 20 remove_watcher() i=7 2024-09-22T08:37:05.991 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.986+0000 7fce2ec87800 1 -- 172.21.15.142:0/916064780 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7fce1c017050 msgr2=0x7fce1c04b930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:05.991 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.986+0000 7fce2ec87800 1 --2- 172.21.15.142:0/916064780 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7fce1c017050 0x7fce1c04b930 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:05.991 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.986+0000 7fce2ec87800 1 -- 172.21.15.142:0/916064780 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55793082c4a0 msgr2=0x55793082e960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:05.991 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.986+0000 7fce2ec87800 1 --2- 172.21.15.142:0/916064780 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55793082c4a0 0x55793082e960 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:05.991 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.986+0000 7fce2ec87800 1 -- 172.21.15.142:0/916064780 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7fce240358a0 msgr2=0x7fce2403b770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:05.991 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.986+0000 7fce2ec87800 1 --2- 172.21.15.142:0/916064780 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7fce240358a0 0x7fce2403b770 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:05.991 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.986+0000 7fce2ec87800 1 -- 172.21.15.142:0/916064780 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x557930830eb0 msgr2=0x5579308332a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:05.991 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.986+0000 7fce2ec87800 1 --2- 172.21.15.142:0/916064780 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x557930830eb0 0x5579308332a0 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:05.991 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.986+0000 7fce2ec87800 1 -- 172.21.15.142:0/916064780 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fccf403cf60 msgr2=0x7fccf403f420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:05.992 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.986+0000 7fce2ec87800 1 --2- 172.21.15.142:0/916064780 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fccf403cf60 0x7fccf403f420 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x5579307f3c40 tx=0x7fce1c045000 comp rx=0 tx=0).stop 2024-09-22T08:37:05.992 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.986+0000 7fce2bf70640 1 -- 172.21.15.142:0/916064780 reap_dead start 2024-09-22T08:37:05.992 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.986+0000 7fce2ec87800 1 -- 172.21.15.142:0/916064780 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5579308195c0 msgr2=0x557930820b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:05.992 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.986+0000 7fce2ec87800 1 --2- 172.21.15.142:0/916064780 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5579308195c0 0x557930820b80 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fce24020b60 tx=0x7fce24054860 comp rx=0 tx=0).stop 2024-09-22T08:37:05.992 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.986+0000 7fce2ec87800 1 -- 172.21.15.142:0/916064780 shutdown_connections 2024-09-22T08:37:05.992 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.986+0000 7fce2ec87800 1 --2- 172.21.15.142:0/916064780 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5579308195c0 0x557930820b80 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:05.992 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.986+0000 7fce2ec87800 1 -- 172.21.15.142:0/916064780 >> 172.21.15.142:0/916064780 conn(0x5579308159c0 msgr2=0x557930813bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:37:05.992 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.987+0000 7fce2ec87800 1 -- 172.21.15.142:0/916064780 shutdown_connections 2024-09-22T08:37:05.992 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.987+0000 7fce2ec87800 1 -- 172.21.15.142:0/916064780 wait complete. 2024-09-22T08:37:05.992 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.987+0000 7fce2ec87800 1 -- 172.21.15.142:0/143386620 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fcd0403cfb0 msgr2=0x7fcd0403f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:05.992 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.987+0000 7fce2ec87800 1 --2- 172.21.15.142:0/143386620 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fcd0403cfb0 0x7fcd0403f470 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fce1c052b90 tx=0x7fce1c00ef30 comp rx=0 tx=0).stop 2024-09-22T08:37:05.992 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.987+0000 7fce2ec87800 1 -- 172.21.15.142:0/143386620 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55793080cb20 msgr2=0x55793080cf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:05.992 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.987+0000 7fce2ec87800 1 --2- 172.21.15.142:0/143386620 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55793080cb20 0x55793080cf40 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x5579307f2ee0 tx=0x7fce240167b0 comp rx=0 tx=0).stop 2024-09-22T08:37:05.992 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.987+0000 7fce2ec87800 1 -- 172.21.15.142:0/143386620 shutdown_connections 2024-09-22T08:37:05.993 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.987+0000 7fce2ec87800 1 --2- 172.21.15.142:0/143386620 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fcd0403cfb0 0x7fcd0403f470 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:05.993 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.987+0000 7fce2ec87800 1 --2- 172.21.15.142:0/143386620 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55793080cb20 0x55793080cf40 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:05.993 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.987+0000 7fce2ec87800 1 -- 172.21.15.142:0/143386620 >> 172.21.15.142:0/143386620 conn(0x557930800ed0 msgr2=0x5579308012b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:37:05.993 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.987+0000 7fce2ec87800 1 -- 172.21.15.142:0/143386620 shutdown_connections 2024-09-22T08:37:05.993 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.987+0000 7fce2ec87800 1 -- 172.21.15.142:0/143386620 wait complete. 2024-09-22T08:37:05.993 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.987+0000 7fce2ec87800 1 -- 172.21.15.142:0/3211063161 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5579306febb0 msgr2=0x5579307f9170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:05.993 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.987+0000 7fce2ec87800 1 --2- 172.21.15.142:0/3211063161 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5579306febb0 0x5579307f9170 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:05.993 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.987+0000 7fce2ec87800 1 -- 172.21.15.142:0/3211063161 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5579307fb590 msgr2=0x5579307fda00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:05.993 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.987+0000 7fce2ec87800 1 --2- 172.21.15.142:0/3211063161 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5579307fb590 0x5579307fda00 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:05.993 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.987+0000 7fce2ec87800 1 -- 172.21.15.142:0/3211063161 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fcd1403cfb0 msgr2=0x7fcd1403f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:05.993 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.987+0000 7fce2ec87800 1 --2- 172.21.15.142:0/3211063161 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fcd1403cfb0 0x7fcd1403f470 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fce20057000 tx=0x7fce20052000 comp rx=0 tx=0).stop 2024-09-22T08:37:05.993 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.988+0000 7fce2ec87800 1 -- 172.21.15.142:0/3211063161 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5579306fb0a0 msgr2=0x5579307f1b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:05.993 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.988+0000 7fce2ec87800 1 --2- 172.21.15.142:0/3211063161 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5579306fb0a0 0x5579307f1b20 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x5579307eaf70 tx=0x7fce1c000bc0 comp rx=0 tx=0).stop 2024-09-22T08:37:05.993 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.988+0000 7fce2ec87800 1 -- 172.21.15.142:0/3211063161 shutdown_connections 2024-09-22T08:37:05.994 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.988+0000 7fce2ec87800 1 --2- 172.21.15.142:0/3211063161 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5579307fb590 0x5579307fda00 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:05.994 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.988+0000 7fce2ec87800 1 --2- 172.21.15.142:0/3211063161 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5579306febb0 0x5579307f9170 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:05.994 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.988+0000 7fce2ec87800 1 --2- 172.21.15.142:0/3211063161 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fcd1403cfb0 0x7fcd1403f470 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:05.994 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.988+0000 7fce2ec87800 1 --2- 172.21.15.142:0/3211063161 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5579306fb0a0 0x5579307f1b20 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:05.994 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.988+0000 7fce2ec87800 1 -- 172.21.15.142:0/3211063161 >> 172.21.15.142:0/3211063161 conn(0x5579306f4be0 msgr2=0x5579307eb4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:37:05.994 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.988+0000 7fce2ec87800 1 -- 172.21.15.142:0/3211063161 shutdown_connections 2024-09-22T08:37:05.994 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:05.988+0000 7fce2ec87800 1 -- 172.21.15.142:0/3211063161 wait complete. 2024-09-22T08:37:05.998 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-22T08:36:42.661297Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-22T08:36:42.661288Z', 'tags': [], 'group_ids': []} 2024-09-22T08:37:06.011 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-22T08:37:06.011 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo'] 2024-09-22T08:37:06.011 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo'] 2024-09-22T08:37:06.012 DEBUG:teuthology.orchestra.run.smithi142:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo 2024-09-22T08:37:06.056 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:37:06.056 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:37:06.057 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.056+0000 7f6e31326800 1 Processor -- start 2024-09-22T08:37:06.057 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.056+0000 7f6e31326800 1 -- start start 2024-09-22T08:37:06.057 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.056+0000 7f6e31326800 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55fa57a45bb0 0x55fa57a47fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:06.057 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.056+0000 7f6e31326800 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55fa578cca20 con 0x55fa57a420a0 2024-09-22T08:37:06.057 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.056+0000 7f6e31326800 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x55fa578cc7d0 con 0x55fa57a45bb0 2024-09-22T08:37:06.058 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.056+0000 7f6e2c708640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55fa57a45bb0 0x55fa57a47fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:06.058 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.056+0000 7f6e2c708640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55fa57a45bb0 0x55fa57a47fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:59684/0 (socket says 172.21.15.142:59684) 2024-09-22T08:37:06.058 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.056+0000 7f6e2cf09640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x55fa57a420a0 0x55fa57a44490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.142:56400/0 (socket says 172.21.15.142:56400) 2024-09-22T08:37:06.058 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.056+0000 7f6e2c708640 1 -- 172.21.15.142:0/1818647639 learned_addr learned my addr 172.21.15.142:0/1818647639 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:37:06.058 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.057+0000 7f6e2c708640 1 -- 172.21.15.142:0/1818647639 >> v1:172.21.15.31:6789/0 conn(0x55fa57a420a0 legacy=0x55fa57a44490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:06.058 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.057+0000 7f6e2c708640 1 -- 172.21.15.142:0/1818647639 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fa57a49580 con 0x55fa57a45bb0 2024-09-22T08:37:06.060 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.058+0000 7f6e2c708640 1 --2- 172.21.15.142:0/1818647639 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fa57a45bb0 0x55fa57a47fa0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f6e2000a520 tx=0x7f6e20045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d96a57604388c4b server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:06.060 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.058+0000 7f6e2bf07640 1 -- 172.21.15.142:0/1818647639 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e20055070 con 0x55fa57a45bb0 2024-09-22T08:37:06.060 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.059+0000 7f6e2bf07640 1 -- 172.21.15.142:0/1818647639 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e200515b0 con 0x55fa57a45bb0 2024-09-22T08:37:06.060 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.059+0000 7f6e2bf07640 1 -- 172.21.15.142:0/1818647639 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e200518d0 con 0x55fa57a45bb0 2024-09-22T08:37:06.060 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.059+0000 7f6e31326800 1 -- 172.21.15.142:0/1818647639 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fa57a45bb0 msgr2=0x55fa57a47fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:06.061 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.059+0000 7f6e31326800 1 --2- 172.21.15.142:0/1818647639 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fa57a45bb0 0x55fa57a47fa0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f6e2000a520 tx=0x7f6e20045ba0 comp rx=0 tx=0).stop 2024-09-22T08:37:06.061 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.059+0000 7f6e31326800 1 -- 172.21.15.142:0/1818647639 shutdown_connections 2024-09-22T08:37:06.061 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.059+0000 7f6e31326800 1 --2- 172.21.15.142:0/1818647639 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fa57a45bb0 0x55fa57a47fa0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:06.061 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.059+0000 7f6e31326800 1 -- 172.21.15.142:0/1818647639 >> 172.21.15.142:0/1818647639 conn(0x55fa57a3bbe0 msgr2=0x55fa57a3e020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:37:06.061 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.059+0000 7f6e31326800 1 -- 172.21.15.142:0/1818647639 shutdown_connections 2024-09-22T08:37:06.061 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.059+0000 7f6e31326800 1 -- 172.21.15.142:0/1818647639 wait complete. 2024-09-22T08:37:06.074 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.072+0000 7f6e31326800 1 Processor -- start 2024-09-22T08:37:06.074 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.073+0000 7f6e31326800 1 -- start start 2024-09-22T08:37:06.074 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.073+0000 7f6e31326800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fa57a420a0 0x55fa57a41830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:06.074 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.073+0000 7f6e31326800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55fa578d9dd0 con 0x55fa57a420a0 2024-09-22T08:37:06.075 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.073+0000 7f6e2cf09640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fa57a420a0 0x55fa57a41830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:06.075 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.073+0000 7f6e2cf09640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fa57a420a0 0x55fa57a41830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:59692/0 (socket says 172.21.15.142:59692) 2024-09-22T08:37:06.075 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.073+0000 7f6e2cf09640 1 -- 172.21.15.142:0/1390188511 learned_addr learned my addr 172.21.15.142:0/1390188511 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:37:06.075 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.073+0000 7f6e2cf09640 1 -- 172.21.15.142:0/1390188511 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fa57a41e20 con 0x55fa57a420a0 2024-09-22T08:37:06.077 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.073+0000 7f6e2cf09640 1 --2- 172.21.15.142:0/1390188511 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fa57a420a0 0x55fa57a41830 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f6e1c0016e0 tx=0x7f6e1c001ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fc28ae31b4fa707 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:06.077 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.074+0000 7f6d1ae0d640 1 -- 172.21.15.142:0/1390188511 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e1c013420 con 0x55fa57a420a0 2024-09-22T08:37:06.077 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.074+0000 7f6d1ae0d640 1 -- 172.21.15.142:0/1390188511 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e1c0135e0 con 0x55fa57a420a0 2024-09-22T08:37:06.077 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.074+0000 7f6d1ae0d640 1 -- 172.21.15.142:0/1390188511 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e1c013900 con 0x55fa57a420a0 2024-09-22T08:37:06.077 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.074+0000 7f6e31326800 1 -- 172.21.15.142:0/1390188511 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fa57a420a0 msgr2=0x55fa57a41830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:06.077 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.074+0000 7f6e31326800 1 --2- 172.21.15.142:0/1390188511 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fa57a420a0 0x55fa57a41830 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f6e1c0016e0 tx=0x7f6e1c001ba0 comp rx=0 tx=0).stop 2024-09-22T08:37:06.077 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.074+0000 7f6e31326800 1 -- 172.21.15.142:0/1390188511 shutdown_connections 2024-09-22T08:37:06.078 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.074+0000 7f6e31326800 1 --2- 172.21.15.142:0/1390188511 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fa57a420a0 0x55fa57a41830 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:06.078 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.074+0000 7f6e31326800 1 -- 172.21.15.142:0/1390188511 >> 172.21.15.142:0/1390188511 conn(0x55fa57a3bbe0 msgr2=0x55fa57b2c960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:37:06.078 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.074+0000 7f6e31326800 1 -- 172.21.15.142:0/1390188511 shutdown_connections 2024-09-22T08:37:06.078 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.074+0000 7f6e31326800 1 -- 172.21.15.142:0/1390188511 wait complete. 2024-09-22T08:37:06.078 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.075+0000 7f6e31326800 1 Processor -- start 2024-09-22T08:37:06.078 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.075+0000 7f6e31326800 1 -- start start 2024-09-22T08:37:06.078 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.075+0000 7f6e31326800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fa57a420a0 0x55fa57b3acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:06.078 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.075+0000 7f6e31326800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55fa57a48870 con 0x55fa57a420a0 2024-09-22T08:37:06.078 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.075+0000 7f6e2cf09640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fa57a420a0 0x55fa57b3acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:06.078 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.075+0000 7f6e2cf09640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fa57a420a0 0x55fa57b3acf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:59698/0 (socket says 172.21.15.142:59698) 2024-09-22T08:37:06.078 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.075+0000 7f6e2cf09640 1 -- 172.21.15.142:0/2807101082 learned_addr learned my addr 172.21.15.142:0/2807101082 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:37:06.078 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.075+0000 7f6e2cf09640 1 -- 172.21.15.142:0/2807101082 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fa57b3b250 con 0x55fa57a420a0 2024-09-22T08:37:06.078 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.076+0000 7f6e2cf09640 1 --2- 172.21.15.142:0/2807101082 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fa57a420a0 0x55fa57b3acf0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f6e1c000f80 tx=0x7f6e1c001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:06.078 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.076+0000 7f6d1960a640 1 -- 172.21.15.142:0/2807101082 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e1c022020 con 0x55fa57a420a0 2024-09-22T08:37:06.079 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.076+0000 7f6d1960a640 1 -- 172.21.15.142:0/2807101082 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e1c019040 con 0x55fa57a420a0 2024-09-22T08:37:06.079 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.076+0000 7f6e31326800 1 -- 172.21.15.142:0/2807101082 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fa57b3b4e0 con 0x55fa57a420a0 2024-09-22T08:37:06.079 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.076+0000 7f6d1960a640 1 -- 172.21.15.142:0/2807101082 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e1c004a40 con 0x55fa57a420a0 2024-09-22T08:37:06.079 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.076+0000 7f6e31326800 1 -- 172.21.15.142:0/2807101082 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fa57b3bee0 con 0x55fa57a420a0 2024-09-22T08:37:06.081 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.077+0000 7f6d1960a640 1 -- 172.21.15.142:0/2807101082 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f6e1c025020 con 0x55fa57a420a0 2024-09-22T08:37:06.082 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.077+0000 7f6d1960a640 1 --2- 172.21.15.142:0/2807101082 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f6d1403cfb0 0x7f6d1403f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:06.082 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.077+0000 7f6d1960a640 1 -- 172.21.15.142:0/2807101082 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5938+0+0 (secure 0 0 0) 0x7f6e1c054480 con 0x55fa57a420a0 2024-09-22T08:37:06.082 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.077+0000 7f6e2c708640 1 --2- 172.21.15.142:0/2807101082 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f6d1403cfb0 0x7f6d1403f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:06.082 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.077+0000 7f6e31326800 1 --2- 172.21.15.142:0/2807101082 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55fa57a45bb0 0x55fa57b42340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:06.082 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.077+0000 7f6e31326800 1 -- 172.21.15.142:0/2807101082 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fa57b42880 con 0x55fa57a45bb0 2024-09-22T08:37:06.082 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.077+0000 7f6e2d70a640 1 --2- 172.21.15.142:0/2807101082 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55fa57a45bb0 0x55fa57b42340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:06.082 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.078+0000 7f6e2c708640 1 --2- 172.21.15.142:0/2807101082 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f6d1403cfb0 0x7f6d1403f470 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f6e20057000 tx=0x7f6e20052000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:06.082 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.078+0000 7f6e2d70a640 1 --2- 172.21.15.142:0/2807101082 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55fa57a45bb0 0x55fa57b42340 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:06.082 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.078+0000 7f6e2d70a640 1 -- 172.21.15.142:0/2807101082 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6e240083e0 con 0x55fa57a45bb0 2024-09-22T08:37:06.082 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.078+0000 7f6e31326800 1 -- 172.21.15.142:0/2807101082 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fa57b42c20 con 0x55fa57a45bb0 2024-09-22T08:37:06.082 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.078+0000 7f6e2d70a640 1 -- 172.21.15.142:0/2807101082 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6e240083e0 con 0x55fa57a45bb0 2024-09-22T08:37:06.082 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.078+0000 7f6e31326800 1 --2- 172.21.15.142:0/2807101082 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55fa57b44720 0x55fa57b46bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:06.083 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.078+0000 7f6e31326800 1 -- 172.21.15.142:0/2807101082 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:3 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fa57b47350 con 0x55fa57b44720 2024-09-22T08:37:06.083 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.078+0000 7f6e2cf09640 1 --2- 172.21.15.142:0/2807101082 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55fa57b44720 0x55fa57b46bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:06.083 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.079+0000 7f6e2cf09640 1 --2- 172.21.15.142:0/2807101082 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55fa57b44720 0x55fa57b46bc0 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:06.083 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.079+0000 7f6e2cf09640 1 -- 172.21.15.142:0/2807101082 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(3 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f6e1c00f030 con 0x55fa57b44720 2024-09-22T08:37:06.083 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.079+0000 7f6e31326800 1 -- 172.21.15.142:0/2807101082 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fa57b43470 con 0x55fa57a45bb0 2024-09-22T08:37:06.083 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.079+0000 7f6e2d70a640 1 -- 172.21.15.142:0/2807101082 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6e240083e0 con 0x55fa57a45bb0 2024-09-22T08:37:06.083 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.079+0000 7f6e31326800 1 -- 172.21.15.142:0/2807101082 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fa57b438c0 con 0x55fa57b44720 2024-09-22T08:37:06.083 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.079+0000 7f6e2cf09640 1 -- 172.21.15.142:0/2807101082 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(5 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f6e1c00f030 con 0x55fa57b44720 2024-09-22T08:37:06.083 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.080+0000 7f6e31326800 1 Processor -- start 2024-09-22T08:37:06.083 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.080+0000 7f6e31326800 1 -- start start 2024-09-22T08:37:06.083 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.080+0000 7f6e31326800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fa57b55d10 0x55fa57b56130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:06.083 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.080+0000 7f6e31326800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55fa57938d50 con 0x55fa57b55d10 2024-09-22T08:37:06.083 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.080+0000 7f6e2d70a640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fa57b55d10 0x55fa57b56130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:06.083 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.080+0000 7f6e2d70a640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fa57b55d10 0x55fa57b56130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:59712/0 (socket says 172.21.15.142:59712) 2024-09-22T08:37:06.084 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.080+0000 7f6e2d70a640 1 -- 172.21.15.142:0/353382518 learned_addr learned my addr 172.21.15.142:0/353382518 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:37:06.084 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.081+0000 7f6e2d70a640 1 -- 172.21.15.142:0/353382518 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fa57b56770 con 0x55fa57b55d10 2024-09-22T08:37:06.084 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.081+0000 7f6e2d70a640 1 --2- 172.21.15.142:0/353382518 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fa57b55d10 0x55fa57b56130 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x55fa57b3cc60 tx=0x7f6e2400bf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:06.087 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.081+0000 7f6d127fc640 1 -- 172.21.15.142:0/353382518 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e2401c020 con 0x55fa57b55d10 2024-09-22T08:37:06.087 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.081+0000 7f6d127fc640 1 -- 172.21.15.142:0/353382518 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e24007c90 con 0x55fa57b55d10 2024-09-22T08:37:06.087 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.081+0000 7f6e31326800 1 -- 172.21.15.142:0/353382518 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fa57b56fa0 con 0x55fa57b55d10 2024-09-22T08:37:06.087 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.081+0000 7f6d127fc640 1 -- 172.21.15.142:0/353382518 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e24018440 con 0x55fa57b55d10 2024-09-22T08:37:06.088 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.081+0000 7f6e31326800 1 -- 172.21.15.142:0/353382518 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fa57b57540 con 0x55fa57b55d10 2024-09-22T08:37:06.088 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.082+0000 7f6d127fc640 1 -- 172.21.15.142:0/353382518 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f6e2401f020 con 0x55fa57b55d10 2024-09-22T08:37:06.088 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.082+0000 7f6d127fc640 1 --2- 172.21.15.142:0/353382518 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f6d0403cfb0 0x7f6d0403f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:06.088 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.082+0000 7f6d127fc640 1 -- 172.21.15.142:0/353382518 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5938+0+0 (secure 0 0 0) 0x7f6e24055a00 con 0x55fa57b55d10 2024-09-22T08:37:06.088 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.082+0000 7f6e2cf09640 1 --2- 172.21.15.142:0/353382518 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f6d0403cfb0 0x7f6d0403f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:06.088 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.082+0000 7f6e31326800 1 Processor -- start 2024-09-22T08:37:06.088 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.082+0000 7f6e2cf09640 1 --2- 172.21.15.142:0/353382518 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f6d0403cfb0 0x7f6d0403f470 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x55fa57b43810 tx=0x7f6e1c006980 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:06.088 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.082+0000 7f6e31326800 1 -- start start 2024-09-22T08:37:06.088 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.083+0000 7f6e31326800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fa57b62770 0x55fa57b62b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:06.088 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.083+0000 7f6e31326800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55fa57a40280 con 0x55fa57b62770 2024-09-22T08:37:06.088 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.083+0000 7f6e2d70a640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fa57b62770 0x55fa57b62b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:06.088 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.083+0000 7f6e2d70a640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fa57b62770 0x55fa57b62b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:59722/0 (socket says 172.21.15.142:59722) 2024-09-22T08:37:06.088 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.083+0000 7f6e2d70a640 1 -- 172.21.15.142:0/3373770327 learned_addr learned my addr 172.21.15.142:0/3373770327 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:37:06.089 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.083+0000 7f6e2d70a640 1 -- 172.21.15.142:0/3373770327 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fa57b63160 con 0x55fa57b62770 2024-09-22T08:37:06.089 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.083+0000 7f6e2d70a640 1 --2- 172.21.15.142:0/3373770327 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fa57b62770 0x55fa57b62b70 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f6e24053e30 tx=0x7f6e24015970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=968b48df4a8fd512 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:06.089 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.083+0000 7f6d03fff640 1 -- 172.21.15.142:0/3373770327 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e240187c0 con 0x55fa57b62770 2024-09-22T08:37:06.089 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.083+0000 7f6d03fff640 1 -- 172.21.15.142:0/3373770327 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e24051070 con 0x55fa57b62770 2024-09-22T08:37:06.089 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.083+0000 7f6d03fff640 1 -- 172.21.15.142:0/3373770327 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e240173a0 con 0x55fa57b62770 2024-09-22T08:37:06.089 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.084+0000 7f6e31326800 1 -- 172.21.15.142:0/3373770327 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fa57b62770 msgr2=0x55fa57b62b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:06.089 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.084+0000 7f6e31326800 1 --2- 172.21.15.142:0/3373770327 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fa57b62770 0x55fa57b62b70 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f6e24053e30 tx=0x7f6e24015970 comp rx=0 tx=0).stop 2024-09-22T08:37:06.089 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.084+0000 7f6e31326800 1 -- 172.21.15.142:0/3373770327 shutdown_connections 2024-09-22T08:37:06.089 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.084+0000 7f6e31326800 1 --2- 172.21.15.142:0/3373770327 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fa57b62770 0x55fa57b62b70 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:06.089 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.084+0000 7f6e31326800 1 -- 172.21.15.142:0/3373770327 >> 172.21.15.142:0/3373770327 conn(0x55fa57b5eb70 msgr2=0x55fa57b5cdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:37:06.089 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.084+0000 7f6e31326800 1 -- 172.21.15.142:0/3373770327 shutdown_connections 2024-09-22T08:37:06.089 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.084+0000 7f6e31326800 1 -- 172.21.15.142:0/3373770327 wait complete. 2024-09-22T08:37:06.089 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.084+0000 7f6e31326800 1 Processor -- start 2024-09-22T08:37:06.089 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.084+0000 7f6e31326800 1 -- start start 2024-09-22T08:37:06.090 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.084+0000 7f6e31326800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fa57b62770 0x55fa57b69da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:06.090 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.084+0000 7f6e31326800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55fa57b63780 con 0x55fa57b62770 2024-09-22T08:37:06.090 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.085+0000 7f6e2d70a640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fa57b62770 0x55fa57b69da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:06.090 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.085+0000 7f6e2d70a640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fa57b62770 0x55fa57b69da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:59728/0 (socket says 172.21.15.142:59728) 2024-09-22T08:37:06.090 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.085+0000 7f6e2d70a640 1 -- 172.21.15.142:0/1359827600 learned_addr learned my addr 172.21.15.142:0/1359827600 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:37:06.090 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.085+0000 7f6e2d70a640 1 -- 172.21.15.142:0/1359827600 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fa57b6a300 con 0x55fa57b62770 2024-09-22T08:37:06.090 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.085+0000 7f6e2d70a640 1 --2- 172.21.15.142:0/1359827600 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fa57b62770 0x55fa57b69da0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f6e24047040 tx=0x7f6e24053dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:06.090 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.085+0000 7f6d027fc640 1 -- 172.21.15.142:0/1359827600 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e240173a0 con 0x55fa57b62770 2024-09-22T08:37:06.090 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.085+0000 7f6d027fc640 1 -- 172.21.15.142:0/1359827600 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e2402f030 con 0x55fa57b62770 2024-09-22T08:37:06.090 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.085+0000 7f6e31326800 1 -- 172.21.15.142:0/1359827600 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fa57b6a590 con 0x55fa57b62770 2024-09-22T08:37:06.090 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.085+0000 7f6d027fc640 1 -- 172.21.15.142:0/1359827600 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e24028300 con 0x55fa57b62770 2024-09-22T08:37:06.090 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.085+0000 7f6e31326800 1 -- 172.21.15.142:0/1359827600 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fa57b6af10 con 0x55fa57b62770 2024-09-22T08:37:06.090 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.086+0000 7f6d027fc640 1 -- 172.21.15.142:0/1359827600 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f6e24016040 con 0x55fa57b62770 2024-09-22T08:37:06.091 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.086+0000 7f6d027fc640 1 --2- 172.21.15.142:0/1359827600 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f6cf803cfb0 0x7f6cf803f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:06.091 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.086+0000 7f6d027fc640 1 -- 172.21.15.142:0/1359827600 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5938+0+0 (secure 0 0 0) 0x7f6e24035c00 con 0x55fa57b62770 2024-09-22T08:37:06.091 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.086+0000 7f6e2cf09640 1 --2- 172.21.15.142:0/1359827600 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f6cf803cfb0 0x7f6cf803f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:06.101 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.087+0000 7f6e2cf09640 1 --2- 172.21.15.142:0/1359827600 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f6cf803cfb0 0x7f6cf803f470 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f6e1c01efd0 tx=0x7f6e1c050000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:06.101 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.087+0000 7f6e31326800 20 rados->read ofs=0 len=0 2024-09-22T08:37:06.101 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.087+0000 7f6e31326800 1 --2- 172.21.15.142:0/1359827600 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55fa57b75600 0x55fa57b77ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:06.101 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.087+0000 7f6e31326800 1 -- 172.21.15.142:0/1359827600 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fa57b78210 con 0x55fa57b75600 2024-09-22T08:37:06.101 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.087+0000 7f6e2c708640 1 --2- 172.21.15.142:0/1359827600 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55fa57b75600 0x55fa57b77ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:06.102 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.087+0000 7f6e2c708640 1 --2- 172.21.15.142:0/1359827600 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55fa57b75600 0x55fa57b77ac0 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:06.102 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.088+0000 7f6e2c708640 1 -- 172.21.15.142:0/1359827600 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6e20057030 con 0x55fa57b75600 2024-09-22T08:37:06.102 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.088+0000 7f6e31326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:06.102 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.088+0000 7f6e31326800 20 realm 2024-09-22T08:37:06.102 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.088+0000 7f6e31326800 20 rados->read ofs=0 len=0 2024-09-22T08:37:06.102 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.088+0000 7f6e31326800 1 -- 172.21.15.142:0/1359827600 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fa57b78640 con 0x55fa57b75600 2024-09-22T08:37:06.102 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.088+0000 7f6e2c708640 1 -- 172.21.15.142:0/1359827600 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6e20057030 con 0x55fa57b75600 2024-09-22T08:37:06.102 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.088+0000 7f6e31326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:06.102 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.088+0000 7f6e31326800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:37:06.102 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.088+0000 7f6e31326800 20 rados->read ofs=0 len=0 2024-09-22T08:37:06.102 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.088+0000 7f6e31326800 1 -- 172.21.15.142:0/1359827600 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fa57b78f10 con 0x55fa57b75600 2024-09-22T08:37:06.102 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.088+0000 7f6e2c708640 1 -- 172.21.15.142:0/1359827600 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6e20057030 con 0x55fa57b75600 2024-09-22T08:37:06.102 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.088+0000 7f6e31326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:06.103 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.088+0000 7f6e31326800 20 rados->read ofs=0 len=0 2024-09-22T08:37:06.103 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.088+0000 7f6e31326800 1 -- 172.21.15.142:0/1359827600 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fa57b792b0 con 0x55fa57b75600 2024-09-22T08:37:06.103 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.088+0000 7f6e2c708640 1 -- 172.21.15.142:0/1359827600 <== osd.1 v2:172.21.15.142:6816/3192108003 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6e20057030 con 0x55fa57b75600 2024-09-22T08:37:06.103 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.088+0000 7f6e31326800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:37:06.103 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.088+0000 7f6e31326800 20 rados->read ofs=0 len=0 2024-09-22T08:37:06.103 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.088+0000 7f6e31326800 1 --2- 172.21.15.142:0/1359827600 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55fa57b7a010 0x55fa57b7c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:06.103 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.088+0000 7f6e31326800 1 -- 172.21.15.142:0/1359827600 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fa57b7ca10 con 0x55fa57b7a010 2024-09-22T08:37:06.103 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.088+0000 7f6e2d70a640 1 --2- 172.21.15.142:0/1359827600 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55fa57b7a010 0x55fa57b7c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:06.103 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.089+0000 7f6e2d70a640 1 --2- 172.21.15.142:0/1359827600 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55fa57b7a010 0x55fa57b7c400 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:06.103 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.089+0000 7f6e2d70a640 1 -- 172.21.15.142:0/1359827600 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(5 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f6e2403b070 con 0x55fa57b7a010 2024-09-22T08:37:06.103 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.089+0000 7f6e31326800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:37:06.103 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.089+0000 7f6e31326800 20 searching for the correct realm 2024-09-22T08:37:06.103 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.089+0000 7f6e31326800 1 -- 172.21.15.142:0/1359827600 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fa57b7e340 con 0x55fa57b7a010 2024-09-22T08:37:06.103 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.089+0000 7f6e2d70a640 1 -- 172.21.15.142:0/1359827600 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e2403b070 con 0x55fa57b7a010 2024-09-22T08:37:06.104 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.089+0000 7f6e2d70a640 1 --2- 172.21.15.142:0/1359827600 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f6e24021020 0x7f6e24028690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:06.104 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.089+0000 7f6e2d70a640 1 -- 172.21.15.142:0/1359827600 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fa57b7e340 con 0x7f6e24021020 2024-09-22T08:37:06.104 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.089+0000 7f6e2cf09640 1 --2- 172.21.15.142:0/1359827600 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f6e24021020 0x7f6e24028690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:06.104 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.089+0000 7f6e2cf09640 1 --2- 172.21.15.142:0/1359827600 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f6e24021020 0x7f6e24028690 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:06.104 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.090+0000 7f6e2cf09640 1 -- 172.21.15.142:0/1359827600 <== osd.2 v2:172.21.15.142:6808/279438927 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e1c00f030 con 0x7f6e24021020 2024-09-22T08:37:06.104 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.090+0000 7f6e2cf09640 1 --2- 172.21.15.142:0/1359827600 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f6e1c03d040 0x7f6e1c04b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:06.104 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.090+0000 7f6e2cf09640 1 -- 172.21.15.142:0/1359827600 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fa57b7e340 con 0x7f6e1c03d040 2024-09-22T08:37:06.104 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.090+0000 7f6e2c708640 1 --2- 172.21.15.142:0/1359827600 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f6e1c03d040 0x7f6e1c04b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:06.104 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.090+0000 7f6e2c708640 1 --2- 172.21.15.142:0/1359827600 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f6e1c03d040 0x7f6e1c04b6d0 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:06.104 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.091+0000 7f6e2c708640 1 -- 172.21.15.142:0/1359827600 <== osd.0 v2:172.21.15.31:6800/168281188 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e20057030 con 0x7f6e1c03d040 2024-09-22T08:37:06.104 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.091+0000 7f6e2c708640 1 -- 172.21.15.142:0/1359827600 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fa57b7e340 con 0x55fa57b75600 2024-09-22T08:37:06.104 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.091+0000 7f6e2c708640 1 -- 172.21.15.142:0/1359827600 <== osd.1 v2:172.21.15.142:6816/3192108003 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e20057030 con 0x55fa57b75600 2024-09-22T08:37:06.104 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.091+0000 7f6e2c708640 1 -- 172.21.15.142:0/1359827600 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fa57b7e340 con 0x55fa57b75600 2024-09-22T08:37:06.105 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.091+0000 7f6e2c708640 1 -- 172.21.15.142:0/1359827600 <== osd.1 v2:172.21.15.142:6816/3192108003 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e20057030 con 0x55fa57b75600 2024-09-22T08:37:06.105 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.091+0000 7f6e2c708640 1 -- 172.21.15.142:0/1359827600 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fa57b7e340 con 0x55fa57b75600 2024-09-22T08:37:06.105 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.091+0000 7f6e2c708640 1 -- 172.21.15.142:0/1359827600 <== osd.1 v2:172.21.15.142:6816/3192108003 7 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e20057030 con 0x55fa57b75600 2024-09-22T08:37:06.105 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.091+0000 7f6e2c708640 1 -- 172.21.15.142:0/1359827600 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fa57b7e340 con 0x7f6e1c03d040 2024-09-22T08:37:06.105 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.092+0000 7f6e2c708640 1 -- 172.21.15.142:0/1359827600 <== osd.0 v2:172.21.15.31:6800/168281188 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e20057030 con 0x7f6e1c03d040 2024-09-22T08:37:06.105 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.092+0000 7f6e2c708640 1 -- 172.21.15.142:0/1359827600 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fa57b7e340 con 0x7f6e24021020 2024-09-22T08:37:06.105 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.092+0000 7f6e2cf09640 1 -- 172.21.15.142:0/1359827600 <== osd.2 v2:172.21.15.142:6808/279438927 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e1c00f030 con 0x7f6e24021020 2024-09-22T08:37:06.105 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.092+0000 7f6e2cf09640 1 -- 172.21.15.142:0/1359827600 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fa57b7e340 con 0x55fa57b7a010 2024-09-22T08:37:06.105 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.092+0000 7f6e2d70a640 1 -- 172.21.15.142:0/1359827600 <== osd.3 v2:172.21.15.142:6800/1064901393 3 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e2403b070 con 0x55fa57b7a010 2024-09-22T08:37:06.105 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.092+0000 7f6e2d70a640 1 -- 172.21.15.142:0/1359827600 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fa57b7e340 con 0x55fa57b75600 2024-09-22T08:37:06.105 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.092+0000 7f6e2c708640 1 -- 172.21.15.142:0/1359827600 <== osd.1 v2:172.21.15.142:6816/3192108003 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e20057030 con 0x55fa57b75600 2024-09-22T08:37:06.105 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.092+0000 7f6e2c708640 1 -- 172.21.15.142:0/1359827600 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fa57b7e340 con 0x7f6e1c03d040 2024-09-22T08:37:06.105 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.092+0000 7f6e2c708640 1 -- 172.21.15.142:0/1359827600 <== osd.0 v2:172.21.15.31:6800/168281188 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e20057030 con 0x7f6e1c03d040 2024-09-22T08:37:06.105 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.093+0000 7f6e2c708640 1 -- 172.21.15.142:0/1359827600 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fa57b7e340 con 0x55fa57b75600 2024-09-22T08:37:06.105 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.093+0000 7f6e2c708640 1 -- 172.21.15.142:0/1359827600 <== osd.1 v2:172.21.15.142:6816/3192108003 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e20057030 con 0x55fa57b75600 2024-09-22T08:37:06.106 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.093+0000 7f6e2c708640 1 -- 172.21.15.142:0/1359827600 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fa57b7e340 con 0x7f6e24021020 2024-09-22T08:37:06.106 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.093+0000 7f6e2cf09640 1 -- 172.21.15.142:0/1359827600 <== osd.2 v2:172.21.15.142:6808/279438927 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f6e1c00f030 con 0x7f6e24021020 2024-09-22T08:37:06.106 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.093+0000 7f6e2cf09640 1 -- 172.21.15.142:0/1359827600 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fa57b7e340 con 0x55fa57b7a010 2024-09-22T08:37:06.106 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.093+0000 7f6e2d70a640 1 -- 172.21.15.142:0/1359827600 <== osd.3 v2:172.21.15.142:6800/1064901393 4 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e2403b070 con 0x55fa57b7a010 2024-09-22T08:37:06.106 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.093+0000 7f6e2d70a640 1 -- 172.21.15.142:0/1359827600 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fa57b7e340 con 0x55fa57b7a010 2024-09-22T08:37:06.106 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.093+0000 7f6e2d70a640 1 -- 172.21.15.142:0/1359827600 <== osd.3 v2:172.21.15.142:6800/1064901393 5 ==== osd_op_reply(20 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f6e2403b070 con 0x55fa57b7a010 2024-09-22T08:37:06.106 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.093+0000 7f6e2d70a640 1 -- 172.21.15.142:0/1359827600 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fa57b7e340 con 0x7f6e1c03d040 2024-09-22T08:37:06.106 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.094+0000 7f6e2c708640 1 -- 172.21.15.142:0/1359827600 <== osd.0 v2:172.21.15.31:6800/168281188 4 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e20057030 con 0x7f6e1c03d040 2024-09-22T08:37:06.106 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.094+0000 7f6e2c708640 1 -- 172.21.15.142:0/1359827600 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fa57b7e340 con 0x55fa57b7a010 2024-09-22T08:37:06.106 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.094+0000 7f6e2d70a640 1 -- 172.21.15.142:0/1359827600 <== osd.3 v2:172.21.15.142:6800/1064901393 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e2403b070 con 0x55fa57b7a010 2024-09-22T08:37:06.106 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.094+0000 7f6e2d70a640 1 -- 172.21.15.142:0/1359827600 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fa57b7e340 con 0x55fa57b7a010 2024-09-22T08:37:06.106 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.094+0000 7f6e2d70a640 1 -- 172.21.15.142:0/1359827600 <== osd.3 v2:172.21.15.142:6800/1064901393 7 ==== osd_op_reply(23 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f6e2403b070 con 0x55fa57b7a010 2024-09-22T08:37:06.107 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.094+0000 7f6e2d70a640 1 -- 172.21.15.142:0/1359827600 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fa57b7e340 con 0x55fa57b75600 2024-09-22T08:37:06.107 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.094+0000 7f6e2c708640 1 -- 172.21.15.142:0/1359827600 <== osd.1 v2:172.21.15.142:6816/3192108003 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e20057030 con 0x55fa57b75600 2024-09-22T08:37:06.107 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.095+0000 7f6e2c708640 1 -- 172.21.15.142:0/1359827600 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fa57b7e340 con 0x55fa57b75600 2024-09-22T08:37:06.107 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.095+0000 7f6e2c708640 1 -- 172.21.15.142:0/1359827600 <== osd.1 v2:172.21.15.142:6816/3192108003 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f6e20057030 con 0x55fa57b75600 2024-09-22T08:37:06.107 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.095+0000 7f6e2c708640 1 -- 172.21.15.142:0/1359827600 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fa57b7e340 con 0x7f6e1c03d040 2024-09-22T08:37:06.107 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.095+0000 7f6e2c708640 1 -- 172.21.15.142:0/1359827600 <== osd.0 v2:172.21.15.31:6800/168281188 5 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e20057030 con 0x7f6e1c03d040 2024-09-22T08:37:06.107 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.095+0000 7f6e2c708640 1 -- 172.21.15.142:0/1359827600 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fa57b7e340 con 0x55fa57b7a010 2024-09-22T08:37:06.107 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.095+0000 7f6e2d70a640 1 -- 172.21.15.142:0/1359827600 <== osd.3 v2:172.21.15.142:6800/1064901393 8 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e2403b070 con 0x55fa57b7a010 2024-09-22T08:37:06.107 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.095+0000 7f6e2d70a640 1 -- 172.21.15.142:0/1359827600 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fa57b7e340 con 0x7f6e24021020 2024-09-22T08:37:06.107 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.095+0000 7f6e2cf09640 1 -- 172.21.15.142:0/1359827600 <== osd.2 v2:172.21.15.142:6808/279438927 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e1c00f030 con 0x7f6e24021020 2024-09-22T08:37:06.107 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.095+0000 7f6e2cf09640 1 -- 172.21.15.142:0/1359827600 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fa57b7e340 con 0x55fa57b75600 2024-09-22T08:37:06.107 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.096+0000 7f6e2c708640 1 -- 172.21.15.142:0/1359827600 <== osd.1 v2:172.21.15.142:6816/3192108003 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e20057030 con 0x55fa57b75600 2024-09-22T08:37:06.107 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.096+0000 7f6e2c708640 1 -- 172.21.15.142:0/1359827600 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fa57b7e340 con 0x7f6e1c03d040 2024-09-22T08:37:06.107 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.096+0000 7f6e2c708640 1 -- 172.21.15.142:0/1359827600 <== osd.0 v2:172.21.15.31:6800/168281188 6 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e20057030 con 0x7f6e1c03d040 2024-09-22T08:37:06.108 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.096+0000 7f6e2c708640 1 -- 172.21.15.142:0/1359827600 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fa57b7e340 con 0x55fa57b7a010 2024-09-22T08:37:06.108 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.096+0000 7f6e2d70a640 1 -- 172.21.15.142:0/1359827600 <== osd.3 v2:172.21.15.142:6800/1064901393 9 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e2403b070 con 0x55fa57b7a010 2024-09-22T08:37:06.108 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.096+0000 7f6e2d70a640 1 -- 172.21.15.142:0/1359827600 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fa57b7e340 con 0x7f6e1c03d040 2024-09-22T08:37:06.108 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.096+0000 7f6e2c708640 1 -- 172.21.15.142:0/1359827600 <== osd.0 v2:172.21.15.31:6800/168281188 7 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e20057030 con 0x7f6e1c03d040 2024-09-22T08:37:06.108 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.096+0000 7f6e2c708640 1 -- 172.21.15.142:0/1359827600 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fa57b7e340 con 0x7f6e24021020 2024-09-22T08:37:06.108 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.097+0000 7f6e2cf09640 1 -- 172.21.15.142:0/1359827600 <== osd.2 v2:172.21.15.142:6808/279438927 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e1c00f030 con 0x7f6e24021020 2024-09-22T08:37:06.108 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.097+0000 7f6e2cf09640 1 -- 172.21.15.142:0/1359827600 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fa57b7e340 con 0x55fa57b7a010 2024-09-22T08:37:06.108 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.097+0000 7f6e2d70a640 1 -- 172.21.15.142:0/1359827600 <== osd.3 v2:172.21.15.142:6800/1064901393 10 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e2403b070 con 0x55fa57b7a010 2024-09-22T08:37:06.108 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.097+0000 7f6e2d70a640 1 -- 172.21.15.142:0/1359827600 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fa57b7e340 con 0x7f6e1c03d040 2024-09-22T08:37:06.108 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.097+0000 7f6e2c708640 1 -- 172.21.15.142:0/1359827600 <== osd.0 v2:172.21.15.31:6800/168281188 8 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e20057030 con 0x7f6e1c03d040 2024-09-22T08:37:06.108 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.097+0000 7f6e2c708640 1 -- 172.21.15.142:0/1359827600 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fa57b7e340 con 0x55fa57b75600 2024-09-22T08:37:06.108 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.097+0000 7f6e2c708640 1 -- 172.21.15.142:0/1359827600 <== osd.1 v2:172.21.15.142:6816/3192108003 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f6e20057030 con 0x55fa57b75600 2024-09-22T08:37:06.108 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.097+0000 7f6e2c708640 1 -- 172.21.15.142:0/1359827600 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fa57b7e340 con 0x7f6e24021020 2024-09-22T08:37:06.108 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.098+0000 7f6e2cf09640 1 -- 172.21.15.142:0/1359827600 <== osd.2 v2:172.21.15.142:6808/279438927 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e1c00f030 con 0x7f6e24021020 2024-09-22T08:37:06.109 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.098+0000 7f6e31326800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:37:06.109 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.098+0000 7f6e31326800 20 RGWRados::pool_iterate: got zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec 2024-09-22T08:37:06.109 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.098+0000 7f6e31326800 20 RGWRados::pool_iterate: got zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f 2024-09-22T08:37:06.109 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.098+0000 7f6e31326800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:37:06.109 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.098+0000 7f6e31326800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:37:06.109 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.098+0000 7f6e31326800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:37:06.109 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.098+0000 7f6e31326800 20 rados->read ofs=0 len=0 2024-09-22T08:37:06.109 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.098+0000 7f6e31326800 1 -- 172.21.15.142:0/1359827600 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fa57b7d3d0 con 0x55fa57b75600 2024-09-22T08:37:06.109 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.098+0000 7f6e2c708640 1 -- 172.21.15.142:0/1359827600 <== osd.1 v2:172.21.15.142:6816/3192108003 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6e20057030 con 0x55fa57b75600 2024-09-22T08:37:06.109 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.098+0000 7f6e31326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:06.109 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.098+0000 7f6e31326800 20 rados->read ofs=0 len=0 2024-09-22T08:37:06.109 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.098+0000 7f6e31326800 1 -- 172.21.15.142:0/1359827600 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fa57b7dc20 con 0x55fa57b75600 2024-09-22T08:37:06.109 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.098+0000 7f6e2c708640 1 -- 172.21.15.142:0/1359827600 <== osd.1 v2:172.21.15.142:6816/3192108003 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6e20057030 con 0x55fa57b75600 2024-09-22T08:37:06.109 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.098+0000 7f6e31326800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:37:06.110 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.098+0000 7f6e31326800 20 rados->read ofs=0 len=0 2024-09-22T08:37:06.110 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.098+0000 7f6e31326800 1 -- 172.21.15.142:0/1359827600 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:40 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fa57b7e7c0 con 0x55fa57b7a010 2024-09-22T08:37:06.110 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.098+0000 7f6e2d70a640 1 -- 172.21.15.142:0/1359827600 <== osd.3 v2:172.21.15.142:6800/1064901393 11 ==== osd_op_reply(40 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f6e2403b070 con 0x55fa57b7a010 2024-09-22T08:37:06.110 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.098+0000 7f6e31326800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:37:06.110 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.098+0000 7f6e31326800 20 zone default found 2024-09-22T08:37:06.110 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.098+0000 7f6e31326800 4 Realm: () 2024-09-22T08:37:06.110 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.098+0000 7f6e31326800 4 ZoneGroup: default (d89f6f57-1007-47dd-9065-f486c7b01aec) 2024-09-22T08:37:06.110 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.098+0000 7f6e31326800 4 Zone: default (e239248c-0bee-4e41-803a-24b288d3eb8f) 2024-09-22T08:37:06.110 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.098+0000 7f6e31326800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:37:06.110 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.098+0000 7f6e31326800 20 zonegroup default 2024-09-22T08:37:06.110 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.098+0000 7f6e31326800 20 rados->read ofs=0 len=0 2024-09-22T08:37:06.110 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.098+0000 7f6e31326800 1 -- 172.21.15.142:0/1359827600 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fa57b7ebd0 con 0x7f6e1c03d040 2024-09-22T08:37:06.110 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.099+0000 7f6e2c708640 1 -- 172.21.15.142:0/1359827600 <== osd.0 v2:172.21.15.31:6800/168281188 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f6e20057030 con 0x7f6e1c03d040 2024-09-22T08:37:06.110 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.099+0000 7f6e31326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:06.111 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.099+0000 7f6e31326800 20 rados->read ofs=0 len=0 2024-09-22T08:37:06.111 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.099+0000 7f6e31326800 1 -- 172.21.15.142:0/1359827600 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fa57b80eb0 con 0x55fa57b7a010 2024-09-22T08:37:06.111 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.099+0000 7f6e2d70a640 1 -- 172.21.15.142:0/1359827600 <== osd.3 v2:172.21.15.142:6800/1064901393 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6e2403b070 con 0x55fa57b7a010 2024-09-22T08:37:06.111 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.099+0000 7f6e31326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:06.111 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.099+0000 7f6e31326800 20 rados->read ofs=0 len=0 2024-09-22T08:37:06.111 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.099+0000 7f6e31326800 1 -- 172.21.15.142:0/1359827600 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fa57b81250 con 0x55fa57b7a010 2024-09-22T08:37:06.111 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.099+0000 7f6e2d70a640 1 -- 172.21.15.142:0/1359827600 <== osd.3 v2:172.21.15.142:6800/1064901393 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6e2403b070 con 0x55fa57b7a010 2024-09-22T08:37:06.111 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.099+0000 7f6e31326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:06.111 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.099+0000 7f6e31326800 20 started sync module instance, tier type = 2024-09-22T08:37:06.111 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.099+0000 7f6e31326800 20 started zone id=e239248c-0bee-4e41-803a-24b288d3eb8f (name=default) with tier type = 2024-09-22T08:37:06.111 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.099+0000 7f6e31326800 1 -- 172.21.15.142:0/1359827600 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fa57b802f0 con 0x7f6e24021020 2024-09-22T08:37:06.111 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.100+0000 7f6e2cf09640 1 -- 172.21.15.142:0/1359827600 <== osd.2 v2:172.21.15.142:6808/279438927 7 ==== osd_op_reply(44 notify.0 [create] v32'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e1c00f030 con 0x7f6e24021020 2024-09-22T08:37:06.111 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.100+0000 7f6e31326800 1 -- 172.21.15.142:0/1359827600 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94533701860928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fa57b81660 con 0x7f6e24021020 2024-09-22T08:37:06.111 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.100+0000 7f6e31326800 1 -- 172.21.15.142:0/1359827600 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fa57b81eb0 con 0x55fa57b75600 2024-09-22T08:37:06.115 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.101+0000 7f6e2cf09640 1 -- 172.21.15.142:0/1359827600 <== osd.2 v2:172.21.15.142:6808/279438927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94533701860928] v32'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e1c00f030 con 0x7f6e24021020 2024-09-22T08:37:06.115 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.101+0000 7f6e2c708640 1 -- 172.21.15.142:0/1359827600 <== osd.1 v2:172.21.15.142:6816/3192108003 16 ==== osd_op_reply(46 notify.1 [create] v32'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e20057030 con 0x55fa57b75600 2024-09-22T08:37:06.115 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.101+0000 7f6e31326800 1 -- 172.21.15.142:0/1359827600 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94533701868032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fa57b822d0 con 0x55fa57b75600 2024-09-22T08:37:06.115 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.102+0000 7f6e31326800 1 -- 172.21.15.142:0/1359827600 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fa57b82b20 con 0x55fa57b7a010 2024-09-22T08:37:06.115 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.103+0000 7f6e2c708640 1 -- 172.21.15.142:0/1359827600 <== osd.1 v2:172.21.15.142:6816/3192108003 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94533701868032] v32'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e20057030 con 0x55fa57b75600 2024-09-22T08:37:06.116 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.103+0000 7f6e2d70a640 1 -- 172.21.15.142:0/1359827600 <== osd.3 v2:172.21.15.142:6800/1064901393 14 ==== osd_op_reply(48 notify.2 [create] v32'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e2403b070 con 0x55fa57b7a010 2024-09-22T08:37:06.116 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.103+0000 7f6e31326800 1 -- 172.21.15.142:0/1359827600 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94533701869568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fa57b829d0 con 0x55fa57b7a010 2024-09-22T08:37:06.116 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.103+0000 7f6e31326800 1 -- 172.21.15.142:0/1359827600 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fa57b83530 con 0x7f6e24021020 2024-09-22T08:37:06.116 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.104+0000 7f6e2d70a640 1 -- 172.21.15.142:0/1359827600 <== osd.3 v2:172.21.15.142:6800/1064901393 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94533701869568] v32'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e2403b070 con 0x55fa57b7a010 2024-09-22T08:37:06.116 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.104+0000 7f6e2cf09640 1 -- 172.21.15.142:0/1359827600 <== osd.2 v2:172.21.15.142:6808/279438927 9 ==== osd_op_reply(50 notify.3 [create] v32'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e1c00f030 con 0x7f6e24021020 2024-09-22T08:37:06.116 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.104+0000 7f6e31326800 1 -- 172.21.15.142:0/1359827600 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94533701873792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fa57b83950 con 0x7f6e24021020 2024-09-22T08:37:06.116 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.104+0000 7f6e31326800 1 -- 172.21.15.142:0/1359827600 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fa57b843c0 con 0x55fa57b75600 2024-09-22T08:37:06.116 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.105+0000 7f6e2c708640 1 -- 172.21.15.142:0/1359827600 <== osd.1 v2:172.21.15.142:6816/3192108003 18 ==== osd_op_reply(52 notify.4 [create] v32'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e20057030 con 0x55fa57b75600 2024-09-22T08:37:06.116 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.105+0000 7f6e31326800 1 -- 172.21.15.142:0/1359827600 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94533701877392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fa57b843c0 con 0x55fa57b75600 2024-09-22T08:37:06.116 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.105+0000 7f6e31326800 1 -- 172.21.15.142:0/1359827600 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fa57b853c0 con 0x7f6e1c03d040 2024-09-22T08:37:06.116 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.105+0000 7f6e2cf09640 1 -- 172.21.15.142:0/1359827600 <== osd.2 v2:172.21.15.142:6808/279438927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94533701873792] v32'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e1c00f030 con 0x7f6e24021020 2024-09-22T08:37:06.116 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.106+0000 7f6e2c708640 1 -- 172.21.15.142:0/1359827600 <== osd.0 v2:172.21.15.31:6800/168281188 10 ==== osd_op_reply(54 notify.5 [create] v32'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e20057030 con 0x7f6e1c03d040 2024-09-22T08:37:06.116 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.106+0000 7f6e31326800 1 -- 172.21.15.142:0/1359827600 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94533701881520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fa57b85380 con 0x7f6e1c03d040 2024-09-22T08:37:06.117 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.106+0000 7f6e2c708640 1 -- 172.21.15.142:0/1359827600 <== osd.1 v2:172.21.15.142:6816/3192108003 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94533701877392] v32'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e20057030 con 0x55fa57b75600 2024-09-22T08:37:06.117 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.106+0000 7f6e31326800 1 -- 172.21.15.142:0/1359827600 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fa57b85920 con 0x7f6e1c03d040 2024-09-22T08:37:06.117 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.107+0000 7f6e2c708640 1 -- 172.21.15.142:0/1359827600 <== osd.0 v2:172.21.15.31:6800/168281188 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94533701881520] v32'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e20057030 con 0x7f6e1c03d040 2024-09-22T08:37:06.117 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.107+0000 7f6e2c708640 1 -- 172.21.15.142:0/1359827600 <== osd.0 v2:172.21.15.31:6800/168281188 12 ==== osd_op_reply(56 notify.6 [create] v32'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e20057030 con 0x7f6e1c03d040 2024-09-22T08:37:06.117 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.107+0000 7f6e31326800 1 -- 172.21.15.142:0/1359827600 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94533701870688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fa57b84940 con 0x7f6e1c03d040 2024-09-22T08:37:06.117 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.107+0000 7f6e31326800 1 -- 172.21.15.142:0/1359827600 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fa57b86280 con 0x7f6e1c03d040 2024-09-22T08:37:06.117 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.108+0000 7f6e2c708640 1 -- 172.21.15.142:0/1359827600 <== osd.0 v2:172.21.15.31:6800/168281188 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94533701870688] v32'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e20057030 con 0x7f6e1c03d040 2024-09-22T08:37:06.117 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.108+0000 7f6e2c708640 1 -- 172.21.15.142:0/1359827600 <== osd.0 v2:172.21.15.31:6800/168281188 14 ==== osd_op_reply(58 notify.7 [create] v32'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e20057030 con 0x7f6e1c03d040 2024-09-22T08:37:06.117 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.108+0000 7f6e31326800 1 -- 172.21.15.142:0/1359827600 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94533701884192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fa57b861f0 con 0x7f6e1c03d040 2024-09-22T08:37:06.117 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.108+0000 7f6e31326800 20 add_watcher() i=0 2024-09-22T08:37:06.117 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.108+0000 7f6e31326800 20 add_watcher() i=1 2024-09-22T08:37:06.117 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.108+0000 7f6e31326800 20 add_watcher() i=2 2024-09-22T08:37:06.117 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.108+0000 7f6e31326800 20 add_watcher() i=3 2024-09-22T08:37:06.117 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.108+0000 7f6e31326800 20 add_watcher() i=4 2024-09-22T08:37:06.118 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.108+0000 7f6e31326800 20 add_watcher() i=5 2024-09-22T08:37:06.118 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.108+0000 7f6e31326800 20 add_watcher() i=6 2024-09-22T08:37:06.118 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.109+0000 7f6e2c708640 1 -- 172.21.15.142:0/1359827600 <== osd.0 v2:172.21.15.31:6800/168281188 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94533701884192] v32'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e20057030 con 0x7f6e1c03d040 2024-09-22T08:37:06.118 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.109+0000 7f6e31326800 20 add_watcher() i=7 2024-09-22T08:37:06.118 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.109+0000 7f6e31326800 2 all 8 watchers are set, enabling cache 2024-09-22T08:37:06.118 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.109+0000 7f6e31326800 1 -- 172.21.15.142:0/1359827600 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fa57b897b0 con 0x55fa57b75600 2024-09-22T08:37:06.118 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.109+0000 7f6e2c708640 1 -- 172.21.15.142:0/1359827600 <== osd.1 v2:172.21.15.142:6816/3192108003 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f6e20057030 con 0x55fa57b75600 2024-09-22T08:37:06.118 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.109+0000 7f6e31326800 1 -- 172.21.15.142:0/1359827600 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94533701886176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fa57b86b60 con 0x55fa57b75600 2024-09-22T08:37:06.118 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.110+0000 7f6e2c708640 1 -- 172.21.15.142:0/1359827600 <== osd.1 v2:172.21.15.142:6816/3192108003 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94533701886176] v32'191 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6e20057030 con 0x55fa57b75600 2024-09-22T08:37:06.118 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.110+0000 7f6ce37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:37:06.118 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.111+0000 7f6e31326800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:37:06.118 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.111+0000 7f6e31326800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:37:06.118 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.111+0000 7f6e31326800 1 -- 172.21.15.142:0/1359827600 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fa57b922a0 con 0x55fa57b75600 2024-09-22T08:37:06.118 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.112+0000 7f6e2c708640 1 -- 172.21.15.142:0/1359827600 <== osd.1 v2:172.21.15.142:6816/3192108003 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'31 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6e20057030 con 0x55fa57b75600 2024-09-22T08:37:06.119 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.112+0000 7f6e31326800 1 -- 172.21.15.142:0/1359827600 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fa57b92930 con 0x7f6e1c03d040 2024-09-22T08:37:06.119 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.113+0000 7f6e2c708640 1 -- 172.21.15.142:0/1359827600 <== osd.0 v2:172.21.15.31:6800/168281188 16 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'25 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6e20057030 con 0x7f6e1c03d040 2024-09-22T08:37:06.119 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.113+0000 7f6e31326800 1 -- 172.21.15.142:0/1359827600 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fa57b92d50 con 0x55fa57b7a010 2024-09-22T08:37:06.119 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.114+0000 7f6e2d70a640 1 -- 172.21.15.142:0/1359827600 <== osd.3 v2:172.21.15.142:6800/1064901393 16 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'26 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6e2403b070 con 0x55fa57b7a010 2024-09-22T08:37:06.119 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.114+0000 7f6e31326800 1 -- 172.21.15.142:0/1359827600 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fa57b92cd0 con 0x55fa57b75600 2024-09-22T08:37:06.120 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.115+0000 7f6e2c708640 1 -- 172.21.15.142:0/1359827600 <== osd.1 v2:172.21.15.142:6816/3192108003 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'192 uv162 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6e20057030 con 0x55fa57b75600 2024-09-22T08:37:06.120 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.115+0000 7f6e31326800 1 -- 172.21.15.142:0/1359827600 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fa57b93240 con 0x7f6e24021020 2024-09-22T08:37:06.120 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.116+0000 7f6e2cf09640 1 -- 172.21.15.142:0/1359827600 <== osd.2 v2:172.21.15.142:6808/279438927 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'67 uv53 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6e1c00f030 con 0x7f6e24021020 2024-09-22T08:37:06.120 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.116+0000 7f6e31326800 1 -- 172.21.15.142:0/1359827600 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fa57b936f0 con 0x55fa57b7a010 2024-09-22T08:37:06.120 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.117+0000 7f6e2d70a640 1 -- 172.21.15.142:0/1359827600 <== osd.3 v2:172.21.15.142:6800/1064901393 17 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'44 uv34 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6e2403b070 con 0x55fa57b7a010 2024-09-22T08:37:06.120 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.117+0000 7f6e31326800 1 -- 172.21.15.142:0/1359827600 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fa57b936f0 con 0x55fa57b75600 2024-09-22T08:37:06.120 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.119+0000 7f6e2c708640 1 -- 172.21.15.142:0/1359827600 <== osd.1 v2:172.21.15.142:6816/3192108003 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'27 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6e20057030 con 0x55fa57b75600 2024-09-22T08:37:06.120 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.119+0000 7f6e31326800 1 -- 172.21.15.142:0/1359827600 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fa57b90020 con 0x7f6e1c03d040 2024-09-22T08:37:06.121 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.120+0000 7f6e2c708640 1 -- 172.21.15.142:0/1359827600 <== osd.0 v2:172.21.15.31:6800/168281188 17 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'43 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6e20057030 con 0x7f6e1c03d040 2024-09-22T08:37:06.121 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.120+0000 7f6e31326800 1 -- 172.21.15.142:0/1359827600 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fa57b90020 con 0x7f6e24021020 2024-09-22T08:37:06.122 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.121+0000 7f6e2cf09640 1 -- 172.21.15.142:0/1359827600 <== osd.2 v2:172.21.15.142:6808/279438927 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'25 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6e1c00f030 con 0x7f6e24021020 2024-09-22T08:37:06.123 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.121+0000 7f6e31326800 1 -- 172.21.15.142:0/1359827600 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fa57b90020 con 0x55fa57b7a010 2024-09-22T08:37:06.124 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.123+0000 7f6e2d70a640 1 -- 172.21.15.142:0/1359827600 <== osd.3 v2:172.21.15.142:6800/1064901393 18 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'31 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6e2403b070 con 0x55fa57b7a010 2024-09-22T08:37:06.124 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.123+0000 7f6e31326800 1 -- 172.21.15.142:0/1359827600 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fa57b90020 con 0x7f6e24021020 2024-09-22T08:37:06.124 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.123+0000 7f6e2cf09640 1 -- 172.21.15.142:0/1359827600 <== osd.2 v2:172.21.15.142:6808/279438927 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'68 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6e1c00f030 con 0x7f6e24021020 2024-09-22T08:37:06.125 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.123+0000 7f6e31326800 1 -- 172.21.15.142:0/1359827600 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fa57b90120 con 0x7f6e1c03d040 2024-09-22T08:37:06.126 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.125+0000 7f6e2c708640 1 -- 172.21.15.142:0/1359827600 <== osd.0 v2:172.21.15.31:6800/168281188 18 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'28 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6e20057030 con 0x7f6e1c03d040 2024-09-22T08:37:06.126 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.125+0000 7f6e31326800 1 -- 172.21.15.142:0/1359827600 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fa57b94080 con 0x7f6e24021020 2024-09-22T08:37:06.127 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.126+0000 7f6e2cf09640 1 -- 172.21.15.142:0/1359827600 <== osd.2 v2:172.21.15.142:6808/279438927 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'25 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6e1c00f030 con 0x7f6e24021020 2024-09-22T08:37:06.127 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.126+0000 7f6e31326800 1 -- 172.21.15.142:0/1359827600 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fa57b94080 con 0x7f6e1c03d040 2024-09-22T08:37:06.128 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.127+0000 7f6e2c708640 1 -- 172.21.15.142:0/1359827600 <== osd.0 v2:172.21.15.31:6800/168281188 19 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'51 uv44 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6e20057030 con 0x7f6e1c03d040 2024-09-22T08:37:06.128 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.127+0000 7f6e31326800 1 -- 172.21.15.142:0/1359827600 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fa57b94080 con 0x55fa57b75600 2024-09-22T08:37:06.129 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.128+0000 7f6e2c708640 1 -- 172.21.15.142:0/1359827600 <== osd.1 v2:172.21.15.142:6816/3192108003 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'193 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6e20057030 con 0x55fa57b75600 2024-09-22T08:37:06.129 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.128+0000 7f6e31326800 1 -- 172.21.15.142:0/1359827600 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fa57b94080 con 0x55fa57b7a010 2024-09-22T08:37:06.130 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.129+0000 7f6e2d70a640 1 -- 172.21.15.142:0/1359827600 <== osd.3 v2:172.21.15.142:6800/1064901393 19 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'59 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6e2403b070 con 0x55fa57b7a010 2024-09-22T08:37:06.130 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.129+0000 7f6e31326800 1 -- 172.21.15.142:0/1359827600 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fa57b94080 con 0x7f6e24021020 2024-09-22T08:37:06.131 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.130+0000 7f6e2cf09640 1 -- 172.21.15.142:0/1359827600 <== osd.2 v2:172.21.15.142:6808/279438927 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'69 uv57 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6e1c00f030 con 0x7f6e24021020 2024-09-22T08:37:06.131 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.130+0000 7f6e31326800 1 -- 172.21.15.142:0/1359827600 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fa57b94080 con 0x55fa57b7a010 2024-09-22T08:37:06.132 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.131+0000 7f6e2d70a640 1 -- 172.21.15.142:0/1359827600 <== osd.3 v2:172.21.15.142:6800/1064901393 20 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'25 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6e2403b070 con 0x55fa57b7a010 2024-09-22T08:37:06.132 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.131+0000 7f6e31326800 1 -- 172.21.15.142:0/1359827600 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fa57b94080 con 0x55fa57b75600 2024-09-22T08:37:06.133 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.132+0000 7f6e2c708640 1 -- 172.21.15.142:0/1359827600 <== osd.1 v2:172.21.15.142:6816/3192108003 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'33 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6e20057030 con 0x55fa57b75600 2024-09-22T08:37:06.133 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.132+0000 7f6e31326800 1 -- 172.21.15.142:0/1359827600 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fa57b94080 con 0x55fa57b75600 2024-09-22T08:37:06.134 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.133+0000 7f6e2c708640 1 -- 172.21.15.142:0/1359827600 <== osd.1 v2:172.21.15.142:6816/3192108003 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'194 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6e20057030 con 0x55fa57b75600 2024-09-22T08:37:06.134 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.133+0000 7f6e31326800 1 -- 172.21.15.142:0/1359827600 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fa57b94080 con 0x55fa57b7a010 2024-09-22T08:37:06.135 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.134+0000 7f6e2d70a640 1 -- 172.21.15.142:0/1359827600 <== osd.3 v2:172.21.15.142:6800/1064901393 21 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'60 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6e2403b070 con 0x55fa57b7a010 2024-09-22T08:37:06.135 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.134+0000 7f6e31326800 1 -- 172.21.15.142:0/1359827600 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fa57b94080 con 0x7f6e24021020 2024-09-22T08:37:06.136 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.135+0000 7f6e2cf09640 1 -- 172.21.15.142:0/1359827600 <== osd.2 v2:172.21.15.142:6808/279438927 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'35 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6e1c00f030 con 0x7f6e24021020 2024-09-22T08:37:06.136 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.135+0000 7f6e31326800 1 -- 172.21.15.142:0/1359827600 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fa57b94080 con 0x55fa57b7a010 2024-09-22T08:37:06.137 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.136+0000 7f6e2d70a640 1 -- 172.21.15.142:0/1359827600 <== osd.3 v2:172.21.15.142:6800/1064901393 22 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'27 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6e2403b070 con 0x55fa57b7a010 2024-09-22T08:37:06.137 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.136+0000 7f6e31326800 1 -- 172.21.15.142:0/1359827600 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fa57b94080 con 0x55fa57b7a010 2024-09-22T08:37:06.138 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.137+0000 7f6e2d70a640 1 -- 172.21.15.142:0/1359827600 <== osd.3 v2:172.21.15.142:6800/1064901393 23 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'31 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6e2403b070 con 0x55fa57b7a010 2024-09-22T08:37:06.138 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.137+0000 7f6e31326800 1 -- 172.21.15.142:0/1359827600 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fa57b94080 con 0x55fa57b7a010 2024-09-22T08:37:06.139 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.138+0000 7f6e2d70a640 1 -- 172.21.15.142:0/1359827600 <== osd.3 v2:172.21.15.142:6800/1064901393 24 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'21 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6e2403b070 con 0x55fa57b7a010 2024-09-22T08:37:06.139 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.138+0000 7f6e31326800 1 -- 172.21.15.142:0/1359827600 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fa57b94080 con 0x55fa57b7a010 2024-09-22T08:37:06.140 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.139+0000 7f6e2d70a640 1 -- 172.21.15.142:0/1359827600 <== osd.3 v2:172.21.15.142:6800/1064901393 25 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'45 uv36 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6e2403b070 con 0x55fa57b7a010 2024-09-22T08:37:06.140 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.139+0000 7f6e31326800 1 -- 172.21.15.142:0/1359827600 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fa57b94080 con 0x7f6e1c03d040 2024-09-22T08:37:06.141 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.140+0000 7f6e2c708640 1 -- 172.21.15.142:0/1359827600 <== osd.0 v2:172.21.15.31:6800/168281188 20 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'27 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6e20057030 con 0x7f6e1c03d040 2024-09-22T08:37:06.141 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.140+0000 7f6e31326800 1 -- 172.21.15.142:0/1359827600 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fa57b94080 con 0x55fa57b7a010 2024-09-22T08:37:06.142 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.141+0000 7f6e2d70a640 1 -- 172.21.15.142:0/1359827600 <== osd.3 v2:172.21.15.142:6800/1064901393 26 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'25 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6e2403b070 con 0x55fa57b7a010 2024-09-22T08:37:06.142 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.141+0000 7f6e31326800 1 -- 172.21.15.142:0/1359827600 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fa57b94080 con 0x7f6e1c03d040 2024-09-22T08:37:06.143 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.142+0000 7f6e2c708640 1 -- 172.21.15.142:0/1359827600 <== osd.0 v2:172.21.15.31:6800/168281188 21 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'44 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6e20057030 con 0x7f6e1c03d040 2024-09-22T08:37:06.143 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.142+0000 7f6e31326800 1 -- 172.21.15.142:0/1359827600 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fa57b94080 con 0x55fa57b7a010 2024-09-22T08:37:06.144 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.143+0000 7f6e2d70a640 1 -- 172.21.15.142:0/1359827600 <== osd.3 v2:172.21.15.142:6800/1064901393 27 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'61 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6e2403b070 con 0x55fa57b7a010 2024-09-22T08:37:06.144 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.143+0000 7f6e31326800 1 -- 172.21.15.142:0/1359827600 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fa57b94080 con 0x7f6e1c03d040 2024-09-22T08:37:06.145 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.144+0000 7f6e2c708640 1 -- 172.21.15.142:0/1359827600 <== osd.0 v2:172.21.15.31:6800/168281188 22 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'52 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6e20057030 con 0x7f6e1c03d040 2024-09-22T08:37:06.145 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.144+0000 7f6e31326800 1 -- 172.21.15.142:0/1359827600 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fa57b94080 con 0x7f6e24021020 2024-09-22T08:37:06.146 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.145+0000 7f6e2cf09640 1 -- 172.21.15.142:0/1359827600 <== osd.2 v2:172.21.15.142:6808/279438927 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'31 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6e1c00f030 con 0x7f6e24021020 2024-09-22T08:37:06.147 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.145+0000 7f6ce27e4640 20 reqs_thread_entry: start 2024-09-22T08:37:06.147 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.145+0000 7f6e31326800 20 init_complete bucket index max shards: 11 2024-09-22T08:37:06.147 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.145+0000 7f6e31326800 20 Filter name: none 2024-09-22T08:37:06.147 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.145+0000 7f6cdb7fe640 20 reqs_thread_entry: start 2024-09-22T08:37:06.147 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.145+0000 7f6e31326800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-22T08:37:06.147 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.145+0000 7f6e31326800 20 rados->read ofs=0 len=0 2024-09-22T08:37:06.147 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.145+0000 7f6e31326800 1 -- 172.21.15.142:0/1359827600 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fa57bbf130 con 0x55fa57b75600 2024-09-22T08:37:06.148 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.146+0000 7f6e2c708640 1 -- 172.21.15.142:0/1359827600 <== osd.1 v2:172.21.15.142:6816/3192108003 28 ==== osd_op_reply(94 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f6e20057030 con 0x55fa57b75600 2024-09-22T08:37:06.148 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.146+0000 7f6e31326800 20 rados_obj.operate() r=0 bl.length=391 2024-09-22T08:37:06.148 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.146+0000 7f6e31326800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-22T08:37:06.148 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.146+0000 7f6e31326800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-22T08:37:06.148 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.146+0000 7f6e31326800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:37:06.148 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.146+0000 7f6e31326800 1 -- 172.21.15.142:0/1359827600 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:95 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fa57bc1250 con 0x7f6e24021020 2024-09-22T08:37:06.149 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.146+0000 7f6e2cf09640 1 -- 172.21.15.142:0/1359827600 <== osd.2 v2:172.21.15.142:6808/279438927 18 ==== osd_op_reply(95 foo.buckets [call out=183b] v0'0 uv41 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f6e1c00f030 con 0x7f6e24021020 2024-09-22T08:37:06.149 INFO:teuthology.orchestra.run.smithi142.stderr:could not remove user: unable to remove user, must specify purge data to remove user with buckets 2024-09-22T08:37:06.149 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.147+0000 7f6ce37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:37:06.149 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.147+0000 7f6e31326800 1 -- 172.21.15.142:0/1359827600 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:96 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94533701886176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fa57b91030 con 0x55fa57b75600 2024-09-22T08:37:06.149 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.148+0000 7f6e2c708640 1 -- 172.21.15.142:0/1359827600 <== osd.1 v2:172.21.15.142:6816/3192108003 29 ==== osd_op_reply(96 data_loggenerations_metadata [watch unwatch cookie 94533701886176] v32'195 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6e20089040 con 0x55fa57b75600 2024-09-22T08:37:06.149 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.148+0000 7f6e31326800 1 -- 172.21.15.142:0/1359827600 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:97 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94533701860928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fa57b860e0 con 0x7f6e24021020 2024-09-22T08:37:06.150 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.149+0000 7f6e2cf09640 1 -- 172.21.15.142:0/1359827600 <== osd.2 v2:172.21.15.142:6808/279438927 19 ==== osd_op_reply(97 notify.0 [watch unwatch cookie 94533701860928] v32'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e1c00f030 con 0x7f6e24021020 2024-09-22T08:37:06.150 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.149+0000 7f6e31326800 20 remove_watcher() i=0 2024-09-22T08:37:06.150 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.149+0000 7f6e31326800 2 removed watcher, disabling cache 2024-09-22T08:37:06.151 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.149+0000 7f6e31326800 1 -- 172.21.15.142:0/1359827600 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94533701868032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fa57b7fe40 con 0x55fa57b75600 2024-09-22T08:37:06.151 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.150+0000 7f6e2c708640 1 -- 172.21.15.142:0/1359827600 <== osd.1 v2:172.21.15.142:6816/3192108003 30 ==== osd_op_reply(98 notify.1 [watch unwatch cookie 94533701868032] v32'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e20089040 con 0x55fa57b75600 2024-09-22T08:37:06.152 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.150+0000 7f6e31326800 20 remove_watcher() i=1 2024-09-22T08:37:06.152 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.150+0000 7f6e31326800 1 -- 172.21.15.142:0/1359827600 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:99 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94533701869568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fa57b7fe40 con 0x55fa57b7a010 2024-09-22T08:37:06.153 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.151+0000 7f6e2d70a640 1 -- 172.21.15.142:0/1359827600 <== osd.3 v2:172.21.15.142:6800/1064901393 28 ==== osd_op_reply(99 notify.2 [watch unwatch cookie 94533701869568] v32'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e2403b070 con 0x55fa57b7a010 2024-09-22T08:37:06.153 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.151+0000 7f6e31326800 20 remove_watcher() i=2 2024-09-22T08:37:06.153 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.151+0000 7f6e31326800 1 -- 172.21.15.142:0/1359827600 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:100 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94533701873792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fa57b82000 con 0x7f6e24021020 2024-09-22T08:37:06.153 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.152+0000 7f6e2cf09640 1 -- 172.21.15.142:0/1359827600 <== osd.2 v2:172.21.15.142:6808/279438927 20 ==== osd_op_reply(100 notify.3 [watch unwatch cookie 94533701873792] v32'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e1c00f030 con 0x7f6e24021020 2024-09-22T08:37:06.154 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.152+0000 7f6e31326800 20 remove_watcher() i=3 2024-09-22T08:37:06.154 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.152+0000 7f6e31326800 1 -- 172.21.15.142:0/1359827600 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94533701877392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fa57b7fe40 con 0x55fa57b75600 2024-09-22T08:37:06.155 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.153+0000 7f6e2c708640 1 -- 172.21.15.142:0/1359827600 <== osd.1 v2:172.21.15.142:6816/3192108003 31 ==== osd_op_reply(101 notify.4 [watch unwatch cookie 94533701877392] v32'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e20089040 con 0x55fa57b75600 2024-09-22T08:37:06.155 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.153+0000 7f6e31326800 20 remove_watcher() i=4 2024-09-22T08:37:06.155 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.154+0000 7f6e31326800 1 -- 172.21.15.142:0/1359827600 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:102 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94533701881520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fa57b7fe40 con 0x7f6e1c03d040 2024-09-22T08:37:06.156 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.154+0000 7f6e2c708640 1 -- 172.21.15.142:0/1359827600 <== osd.0 v2:172.21.15.31:6800/168281188 23 ==== osd_op_reply(102 notify.5 [watch unwatch cookie 94533701881520] v32'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e20089040 con 0x7f6e1c03d040 2024-09-22T08:37:06.156 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.155+0000 7f6e31326800 20 remove_watcher() i=5 2024-09-22T08:37:06.156 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.155+0000 7f6e31326800 1 -- 172.21.15.142:0/1359827600 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:103 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94533701870688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fa57b84eb0 con 0x7f6e1c03d040 2024-09-22T08:37:06.157 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.155+0000 7f6e2c708640 1 -- 172.21.15.142:0/1359827600 <== osd.0 v2:172.21.15.31:6800/168281188 24 ==== osd_op_reply(103 notify.6 [watch unwatch cookie 94533701870688] v32'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e20089040 con 0x7f6e1c03d040 2024-09-22T08:37:06.157 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.156+0000 7f6e31326800 20 remove_watcher() i=6 2024-09-22T08:37:06.157 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.156+0000 7f6e31326800 1 -- 172.21.15.142:0/1359827600 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:104 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94533701884192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fa57b824b0 con 0x7f6e1c03d040 2024-09-22T08:37:06.162 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.157+0000 7f6e2c708640 1 -- 172.21.15.142:0/1359827600 <== osd.0 v2:172.21.15.31:6800/168281188 25 ==== osd_op_reply(104 notify.7 [watch unwatch cookie 94533701884192] v32'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e20089040 con 0x7f6e1c03d040 2024-09-22T08:37:06.162 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.157+0000 7f6e31326800 20 remove_watcher() i=7 2024-09-22T08:37:06.162 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.157+0000 7f6e31326800 1 -- 172.21.15.142:0/1359827600 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f6e1c03d040 msgr2=0x7f6e1c04b6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:06.162 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.157+0000 7f6e31326800 1 --2- 172.21.15.142:0/1359827600 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f6e1c03d040 0x7f6e1c04b6d0 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:06.162 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.157+0000 7f6e31326800 1 -- 172.21.15.142:0/1359827600 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55fa57b75600 msgr2=0x55fa57b77ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:06.162 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.157+0000 7f6e31326800 1 --2- 172.21.15.142:0/1359827600 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55fa57b75600 0x55fa57b77ac0 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:06.162 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.157+0000 7f6e31326800 1 -- 172.21.15.142:0/1359827600 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f6e24021020 msgr2=0x7f6e24028690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:06.162 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.157+0000 7f6e31326800 1 --2- 172.21.15.142:0/1359827600 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f6e24021020 0x7f6e24028690 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:06.162 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.157+0000 7f6e31326800 1 -- 172.21.15.142:0/1359827600 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55fa57b7a010 msgr2=0x55fa57b7c400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:06.162 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.157+0000 7f6e31326800 1 --2- 172.21.15.142:0/1359827600 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55fa57b7a010 0x55fa57b7c400 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:06.162 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.157+0000 7f6e31326800 1 -- 172.21.15.142:0/1359827600 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f6cf803cfb0 msgr2=0x7f6cf803f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:06.163 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.157+0000 7f6e31326800 1 --2- 172.21.15.142:0/1359827600 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f6cf803cfb0 0x7f6cf803f470 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f6e1c01efd0 tx=0x7f6e1c050000 comp rx=0 tx=0).stop 2024-09-22T08:37:06.163 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.157+0000 7f6e31326800 1 -- 172.21.15.142:0/1359827600 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fa57b62770 msgr2=0x55fa57b69da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:06.163 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.157+0000 7f6e31326800 1 --2- 172.21.15.142:0/1359827600 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fa57b62770 0x55fa57b69da0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f6e24047040 tx=0x7f6e24053dc0 comp rx=0 tx=0).stop 2024-09-22T08:37:06.163 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.157+0000 7f6e2c708640 1 -- 172.21.15.142:0/1359827600 reap_dead start 2024-09-22T08:37:06.163 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.157+0000 7f6e2c708640 1 -- 172.21.15.142:0/1359827600 reap_dead start 2024-09-22T08:37:06.163 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.157+0000 7f6e31326800 1 -- 172.21.15.142:0/1359827600 shutdown_connections 2024-09-22T08:37:06.163 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.157+0000 7f6e31326800 1 -- 172.21.15.142:0/1359827600 >> 172.21.15.142:0/1359827600 conn(0x55fa57b5eb70 msgr2=0x55fa57b5cd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:37:06.163 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.157+0000 7f6e31326800 1 -- 172.21.15.142:0/1359827600 shutdown_connections 2024-09-22T08:37:06.163 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.157+0000 7f6e31326800 1 -- 172.21.15.142:0/1359827600 wait complete. 2024-09-22T08:37:06.163 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.157+0000 7f6e31326800 1 -- 172.21.15.142:0/353382518 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f6d0403cfb0 msgr2=0x7f6d0403f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:06.163 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.157+0000 7f6e31326800 1 --2- 172.21.15.142:0/353382518 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f6d0403cfb0 0x7f6d0403f470 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x55fa57b43810 tx=0x7f6e1c006980 comp rx=0 tx=0).stop 2024-09-22T08:37:06.163 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.157+0000 7f6e31326800 1 -- 172.21.15.142:0/353382518 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fa57b55d10 msgr2=0x55fa57b56130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:06.163 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.157+0000 7f6e31326800 1 --2- 172.21.15.142:0/353382518 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fa57b55d10 0x55fa57b56130 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x55fa57b3cc60 tx=0x7f6e2400bf30 comp rx=0 tx=0).stop 2024-09-22T08:37:06.163 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.158+0000 7f6e31326800 1 -- 172.21.15.142:0/353382518 shutdown_connections 2024-09-22T08:37:06.164 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.158+0000 7f6e31326800 1 --2- 172.21.15.142:0/353382518 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f6d0403cfb0 0x7f6d0403f470 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:06.164 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.158+0000 7f6e31326800 1 --2- 172.21.15.142:0/353382518 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fa57b55d10 0x55fa57b56130 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:06.164 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.158+0000 7f6e31326800 1 -- 172.21.15.142:0/353382518 >> 172.21.15.142:0/353382518 conn(0x55fa57b4a0c0 msgr2=0x55fa57b4a4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:37:06.164 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.158+0000 7f6e31326800 1 -- 172.21.15.142:0/353382518 shutdown_connections 2024-09-22T08:37:06.164 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.158+0000 7f6e31326800 1 -- 172.21.15.142:0/353382518 wait complete. 2024-09-22T08:37:06.164 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.158+0000 7f6e31326800 1 -- 172.21.15.142:0/2807101082 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55fa57a45bb0 msgr2=0x55fa57b42340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:06.164 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.158+0000 7f6e31326800 1 --2- 172.21.15.142:0/2807101082 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55fa57a45bb0 0x55fa57b42340 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:06.164 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.158+0000 7f6e31326800 1 -- 172.21.15.142:0/2807101082 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55fa57b44720 msgr2=0x55fa57b46bc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:06.164 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.158+0000 7f6e31326800 1 --2- 172.21.15.142:0/2807101082 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55fa57b44720 0x55fa57b46bc0 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:06.164 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.158+0000 7f6e31326800 1 -- 172.21.15.142:0/2807101082 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f6d1403cfb0 msgr2=0x7f6d1403f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:06.164 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.158+0000 7f6e31326800 1 --2- 172.21.15.142:0/2807101082 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f6d1403cfb0 0x7f6d1403f470 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f6e20057000 tx=0x7f6e20052000 comp rx=0 tx=0).stop 2024-09-22T08:37:06.164 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.158+0000 7f6e31326800 1 -- 172.21.15.142:0/2807101082 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fa57a420a0 msgr2=0x55fa57b3acf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:06.164 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.158+0000 7f6e31326800 1 --2- 172.21.15.142:0/2807101082 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fa57a420a0 0x55fa57b3acf0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f6e1c000f80 tx=0x7f6e1c001250 comp rx=0 tx=0).stop 2024-09-22T08:37:06.164 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.158+0000 7f6e31326800 1 -- 172.21.15.142:0/2807101082 shutdown_connections 2024-09-22T08:37:06.164 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.158+0000 7f6e31326800 1 --2- 172.21.15.142:0/2807101082 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55fa57b44720 0x55fa57b46bc0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:06.165 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.158+0000 7f6e31326800 1 --2- 172.21.15.142:0/2807101082 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55fa57a45bb0 0x55fa57b42340 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:06.165 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.158+0000 7f6e31326800 1 --2- 172.21.15.142:0/2807101082 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f6d1403cfb0 0x7f6d1403f470 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:06.165 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.158+0000 7f6e31326800 1 --2- 172.21.15.142:0/2807101082 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fa57a420a0 0x55fa57b3acf0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:06.165 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.158+0000 7f6e31326800 1 -- 172.21.15.142:0/2807101082 >> 172.21.15.142:0/2807101082 conn(0x55fa57a3bbe0 msgr2=0x55fa57b2c4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:37:06.165 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.158+0000 7f6e31326800 1 -- 172.21.15.142:0/2807101082 shutdown_connections 2024-09-22T08:37:06.165 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:06.158+0000 7f6e31326800 1 -- 172.21.15.142:0/2807101082 wait complete. 2024-09-22T08:37:06.167 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-09-22T08:37:06.183 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-22T08:37:06.188 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=6 bytes_in=0 failed=False 2024-09-22T08:37:41.189 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--categories', 'delete_obj'] 2024-09-22T08:37:41.189 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--categories', 'delete_obj'] 2024-09-22T08:37:41.189 DEBUG:teuthology.orchestra.run.smithi142:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --categories delete_obj 2024-09-22T08:37:41.241 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:37:41.242 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:37:41.243 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.241+0000 7efd4be14800 1 Processor -- start 2024-09-22T08:37:41.243 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.241+0000 7efd4be14800 1 -- start start 2024-09-22T08:37:41.243 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.241+0000 7efd4be14800 1 --2- >> v2:172.21.15.31:3300/0 conn(0x560b7c48acf0 0x560b7c51c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:41.243 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.241+0000 7efd4be14800 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x560b7c3a2a20 con 0x560b7c51ca00 2024-09-22T08:37:41.243 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.241+0000 7efd4be14800 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x560b7c3a27d0 con 0x560b7c48acf0 2024-09-22T08:37:41.243 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.242+0000 7efd475e0640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x560b7c48acf0 0x560b7c51c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:41.243 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.242+0000 7efd475e0640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x560b7c48acf0 0x560b7c51c4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:55514/0 (socket says 172.21.15.142:55514) 2024-09-22T08:37:41.243 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.242+0000 7efd475e0640 1 -- 172.21.15.142:0/2523973091 learned_addr learned my addr 172.21.15.142:0/2523973091 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:37:41.244 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.242+0000 7efd475e0640 1 -- 172.21.15.142:0/2523973091 >> v1:172.21.15.31:6789/0 conn(0x560b7c51ca00 legacy=0x560b7c51eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:41.244 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.242+0000 7efd475e0640 1 -- 172.21.15.142:0/2523973091 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x560b7c521780 con 0x560b7c48acf0 2024-09-22T08:37:41.245 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.244+0000 7efd475e0640 1 --2- 172.21.15.142:0/2523973091 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560b7c48acf0 0x560b7c51c4c0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7efd38005fd0 tx=0x7efd38045cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2311e7cf4ccc961b server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:41.245 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.244+0000 7efd465de640 1 -- 172.21.15.142:0/2523973091 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd3804e600 con 0x560b7c48acf0 2024-09-22T08:37:41.245 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.244+0000 7efd465de640 1 -- 172.21.15.142:0/2523973091 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd3804e7a0 con 0x560b7c48acf0 2024-09-22T08:37:41.246 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.244+0000 7efd465de640 1 -- 172.21.15.142:0/2523973091 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd3804eaa0 con 0x560b7c48acf0 2024-09-22T08:37:41.246 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.245+0000 7efd4be14800 1 -- 172.21.15.142:0/2523973091 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560b7c48acf0 msgr2=0x560b7c51c4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:41.246 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.245+0000 7efd4be14800 1 --2- 172.21.15.142:0/2523973091 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560b7c48acf0 0x560b7c51c4c0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7efd38005fd0 tx=0x7efd38045cf0 comp rx=0 tx=0).stop 2024-09-22T08:37:41.247 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.245+0000 7efd4be14800 1 -- 172.21.15.142:0/2523973091 shutdown_connections 2024-09-22T08:37:41.247 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.245+0000 7efd4be14800 1 --2- 172.21.15.142:0/2523973091 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560b7c48acf0 0x560b7c51c4c0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:41.247 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.245+0000 7efd4be14800 1 -- 172.21.15.142:0/2523973091 >> 172.21.15.142:0/2523973091 conn(0x560b7c511bb0 msgr2=0x560b7c514010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:37:41.247 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.245+0000 7efd4be14800 1 -- 172.21.15.142:0/2523973091 shutdown_connections 2024-09-22T08:37:41.247 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.245+0000 7efd4be14800 1 -- 172.21.15.142:0/2523973091 wait complete. 2024-09-22T08:37:41.262 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.261+0000 7efd4be14800 1 Processor -- start 2024-09-22T08:37:41.262 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.261+0000 7efd4be14800 1 -- start start 2024-09-22T08:37:41.262 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.261+0000 7efd4be14800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560b7c48acf0 0x560b7c609280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:41.262 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.261+0000 7efd4be14800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x560b7c3afdd0 con 0x560b7c48acf0 2024-09-22T08:37:41.262 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.261+0000 7efd475e0640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560b7c48acf0 0x560b7c609280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:41.263 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.261+0000 7efd475e0640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560b7c48acf0 0x560b7c609280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:55528/0 (socket says 172.21.15.142:55528) 2024-09-22T08:37:41.263 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.261+0000 7efd475e0640 1 -- 172.21.15.142:0/2320561599 learned_addr learned my addr 172.21.15.142:0/2320561599 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:37:41.263 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.261+0000 7efd475e0640 1 -- 172.21.15.142:0/2320561599 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560b7c609870 con 0x560b7c48acf0 2024-09-22T08:37:41.263 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.262+0000 7efd475e0640 1 --2- 172.21.15.142:0/2320561599 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560b7c48acf0 0x560b7c609280 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7efd38005fd0 tx=0x7efd38050000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bf205faed069077 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:41.263 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.262+0000 7efc3560a640 1 -- 172.21.15.142:0/2320561599 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd3804eb40 con 0x560b7c48acf0 2024-09-22T08:37:41.263 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.262+0000 7efc3560a640 1 -- 172.21.15.142:0/2320561599 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd38066070 con 0x560b7c48acf0 2024-09-22T08:37:41.264 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.262+0000 7efc3560a640 1 -- 172.21.15.142:0/2320561599 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd3804ee50 con 0x560b7c48acf0 2024-09-22T08:37:41.265 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.263+0000 7efd4be14800 1 -- 172.21.15.142:0/2320561599 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560b7c48acf0 msgr2=0x560b7c609280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:41.265 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.263+0000 7efd4be14800 1 --2- 172.21.15.142:0/2320561599 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560b7c48acf0 0x560b7c609280 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7efd38005fd0 tx=0x7efd38050000 comp rx=0 tx=0).stop 2024-09-22T08:37:41.265 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.263+0000 7efd4be14800 1 -- 172.21.15.142:0/2320561599 shutdown_connections 2024-09-22T08:37:41.266 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.263+0000 7efd4be14800 1 --2- 172.21.15.142:0/2320561599 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560b7c48acf0 0x560b7c609280 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:41.266 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.263+0000 7efd4be14800 1 -- 172.21.15.142:0/2320561599 >> 172.21.15.142:0/2320561599 conn(0x560b7c511bb0 msgr2=0x560b7c604c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:37:41.266 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.263+0000 7efd4be14800 1 -- 172.21.15.142:0/2320561599 shutdown_connections 2024-09-22T08:37:41.266 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.263+0000 7efd4be14800 1 -- 172.21.15.142:0/2320561599 wait complete. 2024-09-22T08:37:41.266 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.263+0000 7efd4be14800 1 Processor -- start 2024-09-22T08:37:41.266 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.263+0000 7efd4be14800 1 -- start start 2024-09-22T08:37:41.266 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.263+0000 7efd4be14800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560b7c48acf0 0x560b7c610cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:41.266 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.263+0000 7efd4be14800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x560b7c520a20 con 0x560b7c48acf0 2024-09-22T08:37:41.266 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.264+0000 7efd475e0640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560b7c48acf0 0x560b7c610cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:41.266 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.264+0000 7efd475e0640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560b7c48acf0 0x560b7c610cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:55532/0 (socket says 172.21.15.142:55532) 2024-09-22T08:37:41.266 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.264+0000 7efd475e0640 1 -- 172.21.15.142:0/278664518 learned_addr learned my addr 172.21.15.142:0/278664518 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:37:41.266 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.264+0000 7efd475e0640 1 -- 172.21.15.142:0/278664518 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560b7c611230 con 0x560b7c48acf0 2024-09-22T08:37:41.266 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.264+0000 7efd475e0640 1 --2- 172.21.15.142:0/278664518 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560b7c48acf0 0x560b7c610cd0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7efd38063040 tx=0x7efd38003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:41.267 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.264+0000 7efc33e07640 1 -- 172.21.15.142:0/278664518 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd3806d550 con 0x560b7c48acf0 2024-09-22T08:37:41.267 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.264+0000 7efc33e07640 1 -- 172.21.15.142:0/278664518 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd38071030 con 0x560b7c48acf0 2024-09-22T08:37:41.267 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.264+0000 7efd4be14800 1 -- 172.21.15.142:0/278664518 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560b7c6114c0 con 0x560b7c48acf0 2024-09-22T08:37:41.267 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.264+0000 7efc33e07640 1 -- 172.21.15.142:0/278664518 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd3806d820 con 0x560b7c48acf0 2024-09-22T08:37:41.267 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.264+0000 7efd4be14800 1 -- 172.21.15.142:0/278664518 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560b7c611ec0 con 0x560b7c48acf0 2024-09-22T08:37:41.268 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.265+0000 7efc33e07640 1 -- 172.21.15.142:0/278664518 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7efd3806da50 con 0x560b7c48acf0 2024-09-22T08:37:41.269 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.265+0000 7efc33e07640 1 --2- 172.21.15.142:0/278664518 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7efc2c03cfb0 0x7efc2c03f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:41.269 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.266+0000 7efc33e07640 1 -- 172.21.15.142:0/278664518 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5938+0+0 (secure 0 0 0) 0x7efd38098cd0 con 0x560b7c48acf0 2024-09-22T08:37:41.269 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.266+0000 7efd46ddf640 1 --2- 172.21.15.142:0/278664518 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7efc2c03cfb0 0x7efc2c03f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:41.269 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.266+0000 7efd4be14800 1 --2- 172.21.15.142:0/278664518 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x560b7c51ca00 0x560b7c618320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:41.269 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.266+0000 7efd4be14800 1 -- 172.21.15.142:0/278664518 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560b7c618860 con 0x560b7c51ca00 2024-09-22T08:37:41.269 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.266+0000 7efd47de1640 1 --2- 172.21.15.142:0/278664518 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x560b7c51ca00 0x560b7c618320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:41.269 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.266+0000 7efd46ddf640 1 --2- 172.21.15.142:0/278664518 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7efc2c03cfb0 0x7efc2c03f470 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7efd30001e50 tx=0x7efd300013d0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:41.269 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.266+0000 7efd47de1640 1 --2- 172.21.15.142:0/278664518 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x560b7c51ca00 0x560b7c618320 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:41.269 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.266+0000 7efd47de1640 1 -- 172.21.15.142:0/278664518 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efd400083e0 con 0x560b7c51ca00 2024-09-22T08:37:41.269 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.266+0000 7efd4be14800 1 -- 172.21.15.142:0/278664518 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560b7c618c00 con 0x560b7c51ca00 2024-09-22T08:37:41.269 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.267+0000 7efd47de1640 1 -- 172.21.15.142:0/278664518 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7efd400083e0 con 0x560b7c51ca00 2024-09-22T08:37:41.269 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.267+0000 7efd4be14800 1 --2- 172.21.15.142:0/278664518 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x560b7c61a6c0 0x560b7c61cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:41.270 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.267+0000 7efd4be14800 1 -- 172.21.15.142:0/278664518 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:3 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560b7c61d2f0 con 0x560b7c61a6c0 2024-09-22T08:37:41.270 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.267+0000 7efd475e0640 1 --2- 172.21.15.142:0/278664518 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x560b7c61a6c0 0x560b7c61cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:41.270 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.267+0000 7efd475e0640 1 --2- 172.21.15.142:0/278664518 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x560b7c61a6c0 0x560b7c61cb60 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:41.270 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.268+0000 7efd475e0640 1 -- 172.21.15.142:0/278664518 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(3 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7efd3807d070 con 0x560b7c61a6c0 2024-09-22T08:37:41.270 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.268+0000 7efd4be14800 1 -- 172.21.15.142:0/278664518 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560b7c619450 con 0x560b7c51ca00 2024-09-22T08:37:41.272 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.268+0000 7efd47de1640 1 -- 172.21.15.142:0/278664518 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7efd400083e0 con 0x560b7c51ca00 2024-09-22T08:37:41.272 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.268+0000 7efd4be14800 1 -- 172.21.15.142:0/278664518 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560b7c619830 con 0x560b7c61a6c0 2024-09-22T08:37:41.272 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.268+0000 7efd475e0640 1 -- 172.21.15.142:0/278664518 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(5 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7efd3807d070 con 0x560b7c61a6c0 2024-09-22T08:37:41.272 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.269+0000 7efd4be14800 1 Processor -- start 2024-09-22T08:37:41.272 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.269+0000 7efd4be14800 1 -- start start 2024-09-22T08:37:41.272 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.269+0000 7efd4be14800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560b7c62bcb0 0x560b7c62c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:41.272 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.269+0000 7efd4be14800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x560b7c40ed50 con 0x560b7c62bcb0 2024-09-22T08:37:41.272 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.269+0000 7efd47de1640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560b7c62bcb0 0x560b7c62c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:41.272 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.269+0000 7efd47de1640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560b7c62bcb0 0x560b7c62c0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:55546/0 (socket says 172.21.15.142:55546) 2024-09-22T08:37:41.272 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.269+0000 7efd47de1640 1 -- 172.21.15.142:0/755184990 learned_addr learned my addr 172.21.15.142:0/755184990 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:37:41.272 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.270+0000 7efd47de1640 1 -- 172.21.15.142:0/755184990 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560b7c62c710 con 0x560b7c62bcb0 2024-09-22T08:37:41.273 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.270+0000 7efd47de1640 1 --2- 172.21.15.142:0/755184990 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560b7c62bcb0 0x560b7c62c0d0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x560b7c612be0 tx=0x7efd4000bf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:41.273 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.270+0000 7efc31602640 1 -- 172.21.15.142:0/755184990 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd4001c020 con 0x560b7c62bcb0 2024-09-22T08:37:41.273 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.270+0000 7efc31602640 1 -- 172.21.15.142:0/755184990 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd40007c90 con 0x560b7c62bcb0 2024-09-22T08:37:41.273 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.270+0000 7efd4be14800 1 -- 172.21.15.142:0/755184990 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560b7c62cf40 con 0x560b7c62bcb0 2024-09-22T08:37:41.273 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.270+0000 7efc31602640 1 -- 172.21.15.142:0/755184990 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd40018440 con 0x560b7c62bcb0 2024-09-22T08:37:41.273 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.270+0000 7efd4be14800 1 -- 172.21.15.142:0/755184990 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560b7c62d4e0 con 0x560b7c62bcb0 2024-09-22T08:37:41.276 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.271+0000 7efc31602640 1 -- 172.21.15.142:0/755184990 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7efd4001f020 con 0x560b7c62bcb0 2024-09-22T08:37:41.276 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.271+0000 7efc31602640 1 --2- 172.21.15.142:0/755184990 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7efc2003d000 0x7efc2003f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:41.276 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.271+0000 7efc31602640 1 -- 172.21.15.142:0/755184990 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5938+0+0 (secure 0 0 0) 0x7efd40055990 con 0x560b7c62bcb0 2024-09-22T08:37:41.276 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.271+0000 7efd475e0640 1 --2- 172.21.15.142:0/755184990 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7efc2003d000 0x7efc2003f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:41.276 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.272+0000 7efd4be14800 1 Processor -- start 2024-09-22T08:37:41.277 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.272+0000 7efd4be14800 1 -- start start 2024-09-22T08:37:41.277 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.272+0000 7efd475e0640 1 --2- 172.21.15.142:0/755184990 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7efc2003d000 0x7efc2003f4c0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7efd3806b790 tx=0x7efd38061db0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:41.277 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.272+0000 7efd4be14800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560b7c6387d0 0x560b7c638bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:41.277 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.272+0000 7efd4be14800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x560b7c609be0 con 0x560b7c6387d0 2024-09-22T08:37:41.277 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.272+0000 7efd47de1640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560b7c6387d0 0x560b7c638bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:41.277 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.272+0000 7efd47de1640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560b7c6387d0 0x560b7c638bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:55548/0 (socket says 172.21.15.142:55548) 2024-09-22T08:37:41.277 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.272+0000 7efd47de1640 1 -- 172.21.15.142:0/1997584187 learned_addr learned my addr 172.21.15.142:0/1997584187 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:37:41.277 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.273+0000 7efd47de1640 1 -- 172.21.15.142:0/1997584187 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560b7c6391c0 con 0x560b7c6387d0 2024-09-22T08:37:41.277 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.273+0000 7efd47de1640 1 --2- 172.21.15.142:0/1997584187 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560b7c6387d0 0x560b7c638bd0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7efd40053d80 tx=0x7efd40054050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1582c9622510c95 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:41.277 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.273+0000 7efc2affd640 1 -- 172.21.15.142:0/1997584187 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd40052070 con 0x560b7c6387d0 2024-09-22T08:37:41.277 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.273+0000 7efc2affd640 1 -- 172.21.15.142:0/1997584187 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd400156f0 con 0x560b7c6387d0 2024-09-22T08:37:41.277 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.273+0000 7efc2affd640 1 -- 172.21.15.142:0/1997584187 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd40016c50 con 0x560b7c6387d0 2024-09-22T08:37:41.277 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.273+0000 7efd4be14800 1 -- 172.21.15.142:0/1997584187 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560b7c6387d0 msgr2=0x560b7c638bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:41.277 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.273+0000 7efd4be14800 1 --2- 172.21.15.142:0/1997584187 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560b7c6387d0 0x560b7c638bd0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7efd40053d80 tx=0x7efd40054050 comp rx=0 tx=0).stop 2024-09-22T08:37:41.278 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.273+0000 7efd4be14800 1 -- 172.21.15.142:0/1997584187 shutdown_connections 2024-09-22T08:37:41.278 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.273+0000 7efd4be14800 1 --2- 172.21.15.142:0/1997584187 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560b7c6387d0 0x560b7c638bd0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:41.278 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.273+0000 7efd4be14800 1 -- 172.21.15.142:0/1997584187 >> 172.21.15.142:0/1997584187 conn(0x560b7c634bd0 msgr2=0x560b7c632e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:37:41.278 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.274+0000 7efd4be14800 1 -- 172.21.15.142:0/1997584187 shutdown_connections 2024-09-22T08:37:41.278 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.274+0000 7efd4be14800 1 -- 172.21.15.142:0/1997584187 wait complete. 2024-09-22T08:37:41.278 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.274+0000 7efd4be14800 1 Processor -- start 2024-09-22T08:37:41.278 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.274+0000 7efd4be14800 1 -- start start 2024-09-22T08:37:41.278 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.274+0000 7efd4be14800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560b7c6387d0 0x560b7c63fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:41.278 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.274+0000 7efd4be14800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x560b7c6397b0 con 0x560b7c6387d0 2024-09-22T08:37:41.278 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.274+0000 7efd47de1640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560b7c6387d0 0x560b7c63fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:41.278 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.274+0000 7efd47de1640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560b7c6387d0 0x560b7c63fd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:55550/0 (socket says 172.21.15.142:55550) 2024-09-22T08:37:41.278 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.274+0000 7efd47de1640 1 -- 172.21.15.142:0/3690725229 learned_addr learned my addr 172.21.15.142:0/3690725229 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:37:41.278 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.275+0000 7efd47de1640 1 -- 172.21.15.142:0/3690725229 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560b7c640270 con 0x560b7c6387d0 2024-09-22T08:37:41.279 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.275+0000 7efd47de1640 1 --2- 172.21.15.142:0/3690725229 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560b7c6387d0 0x560b7c63fd10 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7efd40015a80 tx=0x7efd40053d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:41.279 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.275+0000 7efc297fa640 1 -- 172.21.15.142:0/3690725229 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd40013660 con 0x560b7c6387d0 2024-09-22T08:37:41.279 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.275+0000 7efc297fa640 1 -- 172.21.15.142:0/3690725229 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd4002e070 con 0x560b7c6387d0 2024-09-22T08:37:41.279 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.275+0000 7efd4be14800 1 -- 172.21.15.142:0/3690725229 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560b7c640500 con 0x560b7c6387d0 2024-09-22T08:37:41.279 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.275+0000 7efc297fa640 1 -- 172.21.15.142:0/3690725229 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd400139e0 con 0x560b7c6387d0 2024-09-22T08:37:41.279 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.275+0000 7efd4be14800 1 -- 172.21.15.142:0/3690725229 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560b7c641090 con 0x560b7c6387d0 2024-09-22T08:37:41.284 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.276+0000 7efc297fa640 1 -- 172.21.15.142:0/3690725229 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7efd40016040 con 0x560b7c6387d0 2024-09-22T08:37:41.284 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.276+0000 7efc297fa640 1 --2- 172.21.15.142:0/3690725229 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7efc1003cfb0 0x7efc1003f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:41.284 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.276+0000 7efc297fa640 1 -- 172.21.15.142:0/3690725229 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5938+0+0 (secure 0 0 0) 0x7efd40034c10 con 0x560b7c6387d0 2024-09-22T08:37:41.285 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.276+0000 7efd475e0640 1 --2- 172.21.15.142:0/3690725229 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7efc1003cfb0 0x7efc1003f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:41.285 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.276+0000 7efd4be14800 20 rados->read ofs=0 len=0 2024-09-22T08:37:41.285 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.277+0000 7efd4be14800 1 --2- 172.21.15.142:0/3690725229 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x560b7c64b6a0 0x560b7c64db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:41.285 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.277+0000 7efd4be14800 1 -- 172.21.15.142:0/3690725229 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560b7c64e2b0 con 0x560b7c64b6a0 2024-09-22T08:37:41.285 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.277+0000 7efd46ddf640 1 --2- 172.21.15.142:0/3690725229 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x560b7c64b6a0 0x560b7c64db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:41.285 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.277+0000 7efd475e0640 1 --2- 172.21.15.142:0/3690725229 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7efc1003cfb0 0x7efc1003f470 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7efd380973e0 tx=0x7efd38088000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:41.285 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.277+0000 7efd46ddf640 1 --2- 172.21.15.142:0/3690725229 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x560b7c64b6a0 0x560b7c64db60 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:41.285 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.277+0000 7efd46ddf640 1 -- 172.21.15.142:0/3690725229 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efd30010580 con 0x560b7c64b6a0 2024-09-22T08:37:41.285 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.277+0000 7efd4be14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:41.285 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.277+0000 7efd4be14800 20 realm 2024-09-22T08:37:41.285 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.277+0000 7efd4be14800 20 rados->read ofs=0 len=0 2024-09-22T08:37:41.285 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.277+0000 7efd4be14800 1 -- 172.21.15.142:0/3690725229 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560b7c64a9f0 con 0x560b7c64b6a0 2024-09-22T08:37:41.286 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.278+0000 7efd46ddf640 1 -- 172.21.15.142:0/3690725229 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efd30010580 con 0x560b7c64b6a0 2024-09-22T08:37:41.286 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.278+0000 7efd4be14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:41.286 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.278+0000 7efd4be14800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:37:41.286 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.278+0000 7efd4be14800 20 rados->read ofs=0 len=0 2024-09-22T08:37:41.286 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.278+0000 7efd4be14800 1 -- 172.21.15.142:0/3690725229 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560b7c64ed90 con 0x560b7c64b6a0 2024-09-22T08:37:41.286 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.278+0000 7efd46ddf640 1 -- 172.21.15.142:0/3690725229 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efd30010580 con 0x560b7c64b6a0 2024-09-22T08:37:41.286 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.278+0000 7efd4be14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:41.286 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.278+0000 7efd4be14800 20 rados->read ofs=0 len=0 2024-09-22T08:37:41.286 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.278+0000 7efd4be14800 1 -- 172.21.15.142:0/3690725229 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560b7c64f660 con 0x560b7c64b6a0 2024-09-22T08:37:41.286 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.278+0000 7efd46ddf640 1 -- 172.21.15.142:0/3690725229 <== osd.1 v2:172.21.15.142:6816/3192108003 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7efd30010580 con 0x560b7c64b6a0 2024-09-22T08:37:41.286 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.278+0000 7efd4be14800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:37:41.286 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.278+0000 7efd4be14800 20 rados->read ofs=0 len=0 2024-09-22T08:37:41.287 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.278+0000 7efd4be14800 1 --2- 172.21.15.142:0/3690725229 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x560b7c64ffa0 0x560b7c652390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:41.287 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.278+0000 7efd4be14800 1 -- 172.21.15.142:0/3690725229 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560b7c652ad0 con 0x560b7c64ffa0 2024-09-22T08:37:41.287 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.278+0000 7efd47de1640 1 --2- 172.21.15.142:0/3690725229 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x560b7c64ffa0 0x560b7c652390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:41.287 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.278+0000 7efd47de1640 1 --2- 172.21.15.142:0/3690725229 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x560b7c64ffa0 0x560b7c652390 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:41.287 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.279+0000 7efd47de1640 1 -- 172.21.15.142:0/3690725229 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(5 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7efd400083e0 con 0x560b7c64ffa0 2024-09-22T08:37:41.287 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.279+0000 7efd4be14800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:37:41.287 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.279+0000 7efd4be14800 20 searching for the correct realm 2024-09-22T08:37:41.287 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.279+0000 7efd4be14800 1 -- 172.21.15.142:0/3690725229 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560b7c6544b0 con 0x560b7c64ffa0 2024-09-22T08:37:41.287 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.279+0000 7efd47de1640 1 -- 172.21.15.142:0/3690725229 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd400083e0 con 0x560b7c64ffa0 2024-09-22T08:37:41.287 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.279+0000 7efd47de1640 1 --2- 172.21.15.142:0/3690725229 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7efd4004e070 0x7efd40016330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:41.287 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.279+0000 7efd47de1640 1 -- 172.21.15.142:0/3690725229 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560b7c6544b0 con 0x7efd4004e070 2024-09-22T08:37:41.287 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.279+0000 7efd475e0640 1 --2- 172.21.15.142:0/3690725229 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7efd4004e070 0x7efd40016330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:41.287 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.280+0000 7efd475e0640 1 --2- 172.21.15.142:0/3690725229 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7efd4004e070 0x7efd40016330 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:41.288 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.280+0000 7efd475e0640 1 -- 172.21.15.142:0/3690725229 <== osd.2 v2:172.21.15.142:6808/279438927 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd3807d070 con 0x7efd4004e070 2024-09-22T08:37:41.288 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.280+0000 7efd475e0640 1 --2- 172.21.15.142:0/3690725229 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7efd3806d040 0x7efd38056910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:41.288 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.280+0000 7efd475e0640 1 -- 172.21.15.142:0/3690725229 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560b7c6544b0 con 0x7efd3806d040 2024-09-22T08:37:41.288 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.280+0000 7efd46ddf640 1 --2- 172.21.15.142:0/3690725229 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7efd3806d040 0x7efd38056910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:41.288 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.280+0000 7efd46ddf640 1 --2- 172.21.15.142:0/3690725229 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7efd3806d040 0x7efd38056910 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:41.288 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.281+0000 7efd46ddf640 1 -- 172.21.15.142:0/3690725229 <== osd.0 v2:172.21.15.31:6800/168281188 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd30010580 con 0x7efd3806d040 2024-09-22T08:37:41.288 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.281+0000 7efd46ddf640 1 -- 172.21.15.142:0/3690725229 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560b7c6544b0 con 0x560b7c64b6a0 2024-09-22T08:37:41.288 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.281+0000 7efd46ddf640 1 -- 172.21.15.142:0/3690725229 <== osd.1 v2:172.21.15.142:6816/3192108003 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd30010580 con 0x560b7c64b6a0 2024-09-22T08:37:41.288 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.281+0000 7efd46ddf640 1 -- 172.21.15.142:0/3690725229 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560b7c6544b0 con 0x560b7c64b6a0 2024-09-22T08:37:41.288 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.281+0000 7efd46ddf640 1 -- 172.21.15.142:0/3690725229 <== osd.1 v2:172.21.15.142:6816/3192108003 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd3002a040 con 0x560b7c64b6a0 2024-09-22T08:37:41.288 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.281+0000 7efd46ddf640 1 -- 172.21.15.142:0/3690725229 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560b7c6544b0 con 0x560b7c64b6a0 2024-09-22T08:37:41.288 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.282+0000 7efd46ddf640 1 -- 172.21.15.142:0/3690725229 <== osd.1 v2:172.21.15.142:6816/3192108003 7 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd3002a040 con 0x560b7c64b6a0 2024-09-22T08:37:41.288 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.282+0000 7efd46ddf640 1 -- 172.21.15.142:0/3690725229 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560b7c6544b0 con 0x7efd3806d040 2024-09-22T08:37:41.288 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.282+0000 7efd46ddf640 1 -- 172.21.15.142:0/3690725229 <== osd.0 v2:172.21.15.31:6800/168281188 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd3002a040 con 0x7efd3806d040 2024-09-22T08:37:41.288 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.282+0000 7efd46ddf640 1 -- 172.21.15.142:0/3690725229 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560b7c6544b0 con 0x7efd4004e070 2024-09-22T08:37:41.289 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.282+0000 7efd475e0640 1 -- 172.21.15.142:0/3690725229 <== osd.2 v2:172.21.15.142:6808/279438927 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd3807d070 con 0x7efd4004e070 2024-09-22T08:37:41.289 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.282+0000 7efd475e0640 1 -- 172.21.15.142:0/3690725229 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560b7c6544b0 con 0x560b7c64ffa0 2024-09-22T08:37:41.289 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.282+0000 7efd47de1640 1 -- 172.21.15.142:0/3690725229 <== osd.3 v2:172.21.15.142:6800/1064901393 3 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd400083e0 con 0x560b7c64ffa0 2024-09-22T08:37:41.289 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.282+0000 7efd47de1640 1 -- 172.21.15.142:0/3690725229 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560b7c6544b0 con 0x560b7c64b6a0 2024-09-22T08:37:41.289 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.283+0000 7efd46ddf640 1 -- 172.21.15.142:0/3690725229 <== osd.1 v2:172.21.15.142:6816/3192108003 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd3002a040 con 0x560b7c64b6a0 2024-09-22T08:37:41.289 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.283+0000 7efd46ddf640 1 -- 172.21.15.142:0/3690725229 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560b7c6544b0 con 0x7efd3806d040 2024-09-22T08:37:41.289 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.283+0000 7efd46ddf640 1 -- 172.21.15.142:0/3690725229 <== osd.0 v2:172.21.15.31:6800/168281188 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd3002a040 con 0x7efd3806d040 2024-09-22T08:37:41.289 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.283+0000 7efd46ddf640 1 -- 172.21.15.142:0/3690725229 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560b7c6544b0 con 0x560b7c64b6a0 2024-09-22T08:37:41.289 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.283+0000 7efd46ddf640 1 -- 172.21.15.142:0/3690725229 <== osd.1 v2:172.21.15.142:6816/3192108003 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd3002a040 con 0x560b7c64b6a0 2024-09-22T08:37:41.289 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.283+0000 7efd46ddf640 1 -- 172.21.15.142:0/3690725229 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560b7c6544b0 con 0x7efd4004e070 2024-09-22T08:37:41.295 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.284+0000 7efd475e0640 1 -- 172.21.15.142:0/3690725229 <== osd.2 v2:172.21.15.142:6808/279438927 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7efd3807d070 con 0x7efd4004e070 2024-09-22T08:37:41.295 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.284+0000 7efd475e0640 1 -- 172.21.15.142:0/3690725229 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560b7c6544b0 con 0x560b7c64ffa0 2024-09-22T08:37:41.295 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.284+0000 7efd47de1640 1 -- 172.21.15.142:0/3690725229 <== osd.3 v2:172.21.15.142:6800/1064901393 4 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd400083e0 con 0x560b7c64ffa0 2024-09-22T08:37:41.295 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.284+0000 7efd47de1640 1 -- 172.21.15.142:0/3690725229 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560b7c6544b0 con 0x560b7c64ffa0 2024-09-22T08:37:41.295 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.284+0000 7efd47de1640 1 -- 172.21.15.142:0/3690725229 <== osd.3 v2:172.21.15.142:6800/1064901393 5 ==== osd_op_reply(20 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7efd400083e0 con 0x560b7c64ffa0 2024-09-22T08:37:41.296 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.284+0000 7efd47de1640 1 -- 172.21.15.142:0/3690725229 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560b7c6544b0 con 0x7efd3806d040 2024-09-22T08:37:41.296 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.285+0000 7efd46ddf640 1 -- 172.21.15.142:0/3690725229 <== osd.0 v2:172.21.15.31:6800/168281188 4 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd3002a040 con 0x7efd3806d040 2024-09-22T08:37:41.296 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.285+0000 7efd46ddf640 1 -- 172.21.15.142:0/3690725229 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560b7c6544b0 con 0x560b7c64ffa0 2024-09-22T08:37:41.296 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.285+0000 7efd47de1640 1 -- 172.21.15.142:0/3690725229 <== osd.3 v2:172.21.15.142:6800/1064901393 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd400083e0 con 0x560b7c64ffa0 2024-09-22T08:37:41.296 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.285+0000 7efd47de1640 1 -- 172.21.15.142:0/3690725229 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560b7c6544b0 con 0x560b7c64ffa0 2024-09-22T08:37:41.296 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.285+0000 7efd47de1640 1 -- 172.21.15.142:0/3690725229 <== osd.3 v2:172.21.15.142:6800/1064901393 7 ==== osd_op_reply(23 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7efd400083e0 con 0x560b7c64ffa0 2024-09-22T08:37:41.296 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.285+0000 7efd47de1640 1 -- 172.21.15.142:0/3690725229 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560b7c6544b0 con 0x560b7c64b6a0 2024-09-22T08:37:41.296 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.285+0000 7efd46ddf640 1 -- 172.21.15.142:0/3690725229 <== osd.1 v2:172.21.15.142:6816/3192108003 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd3002a040 con 0x560b7c64b6a0 2024-09-22T08:37:41.296 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.285+0000 7efd46ddf640 1 -- 172.21.15.142:0/3690725229 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560b7c6544b0 con 0x560b7c64b6a0 2024-09-22T08:37:41.296 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.286+0000 7efd46ddf640 1 -- 172.21.15.142:0/3690725229 <== osd.1 v2:172.21.15.142:6816/3192108003 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7efd3002a040 con 0x560b7c64b6a0 2024-09-22T08:37:41.296 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.286+0000 7efd46ddf640 1 -- 172.21.15.142:0/3690725229 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560b7c6544b0 con 0x7efd3806d040 2024-09-22T08:37:41.296 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.286+0000 7efd46ddf640 1 -- 172.21.15.142:0/3690725229 <== osd.0 v2:172.21.15.31:6800/168281188 5 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd3002a040 con 0x7efd3806d040 2024-09-22T08:37:41.296 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.286+0000 7efd46ddf640 1 -- 172.21.15.142:0/3690725229 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560b7c6544b0 con 0x560b7c64ffa0 2024-09-22T08:37:41.296 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.286+0000 7efd47de1640 1 -- 172.21.15.142:0/3690725229 <== osd.3 v2:172.21.15.142:6800/1064901393 8 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd400083e0 con 0x560b7c64ffa0 2024-09-22T08:37:41.297 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.286+0000 7efd47de1640 1 -- 172.21.15.142:0/3690725229 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560b7c6544b0 con 0x7efd4004e070 2024-09-22T08:37:41.297 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.287+0000 7efd475e0640 1 -- 172.21.15.142:0/3690725229 <== osd.2 v2:172.21.15.142:6808/279438927 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd3807d070 con 0x7efd4004e070 2024-09-22T08:37:41.297 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.287+0000 7efd475e0640 1 -- 172.21.15.142:0/3690725229 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560b7c6544b0 con 0x560b7c64b6a0 2024-09-22T08:37:41.297 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.287+0000 7efd46ddf640 1 -- 172.21.15.142:0/3690725229 <== osd.1 v2:172.21.15.142:6816/3192108003 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd3002a040 con 0x560b7c64b6a0 2024-09-22T08:37:41.297 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.287+0000 7efd46ddf640 1 -- 172.21.15.142:0/3690725229 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560b7c6544b0 con 0x7efd3806d040 2024-09-22T08:37:41.297 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.287+0000 7efd46ddf640 1 -- 172.21.15.142:0/3690725229 <== osd.0 v2:172.21.15.31:6800/168281188 6 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd3002a040 con 0x7efd3806d040 2024-09-22T08:37:41.297 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.287+0000 7efd46ddf640 1 -- 172.21.15.142:0/3690725229 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560b7c6544b0 con 0x560b7c64ffa0 2024-09-22T08:37:41.297 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.287+0000 7efd47de1640 1 -- 172.21.15.142:0/3690725229 <== osd.3 v2:172.21.15.142:6800/1064901393 9 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd400083e0 con 0x560b7c64ffa0 2024-09-22T08:37:41.297 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.287+0000 7efd47de1640 1 -- 172.21.15.142:0/3690725229 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560b7c6544b0 con 0x7efd3806d040 2024-09-22T08:37:41.297 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.288+0000 7efd46ddf640 1 -- 172.21.15.142:0/3690725229 <== osd.0 v2:172.21.15.31:6800/168281188 7 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd3002a040 con 0x7efd3806d040 2024-09-22T08:37:41.297 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.288+0000 7efd46ddf640 1 -- 172.21.15.142:0/3690725229 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560b7c6544b0 con 0x7efd4004e070 2024-09-22T08:37:41.297 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.288+0000 7efd475e0640 1 -- 172.21.15.142:0/3690725229 <== osd.2 v2:172.21.15.142:6808/279438927 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd3807d070 con 0x7efd4004e070 2024-09-22T08:37:41.297 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.288+0000 7efd475e0640 1 -- 172.21.15.142:0/3690725229 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560b7c6544b0 con 0x560b7c64ffa0 2024-09-22T08:37:41.297 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.288+0000 7efd47de1640 1 -- 172.21.15.142:0/3690725229 <== osd.3 v2:172.21.15.142:6800/1064901393 10 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd400083e0 con 0x560b7c64ffa0 2024-09-22T08:37:41.297 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.288+0000 7efd47de1640 1 -- 172.21.15.142:0/3690725229 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560b7c6544b0 con 0x7efd3806d040 2024-09-22T08:37:41.298 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.289+0000 7efd46ddf640 1 -- 172.21.15.142:0/3690725229 <== osd.0 v2:172.21.15.31:6800/168281188 8 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd3002a040 con 0x7efd3806d040 2024-09-22T08:37:41.298 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.289+0000 7efd46ddf640 1 -- 172.21.15.142:0/3690725229 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560b7c6544b0 con 0x560b7c64b6a0 2024-09-22T08:37:41.298 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.289+0000 7efd46ddf640 1 -- 172.21.15.142:0/3690725229 <== osd.1 v2:172.21.15.142:6816/3192108003 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7efd3002a040 con 0x560b7c64b6a0 2024-09-22T08:37:41.298 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.289+0000 7efd46ddf640 1 -- 172.21.15.142:0/3690725229 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560b7c6544b0 con 0x7efd4004e070 2024-09-22T08:37:41.298 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.289+0000 7efd475e0640 1 -- 172.21.15.142:0/3690725229 <== osd.2 v2:172.21.15.142:6808/279438927 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd3807d070 con 0x7efd4004e070 2024-09-22T08:37:41.298 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.289+0000 7efd4be14800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:37:41.298 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.289+0000 7efd4be14800 20 RGWRados::pool_iterate: got zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec 2024-09-22T08:37:41.298 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.289+0000 7efd4be14800 20 RGWRados::pool_iterate: got zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f 2024-09-22T08:37:41.298 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.289+0000 7efd4be14800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:37:41.298 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.289+0000 7efd4be14800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:37:41.298 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.289+0000 7efd4be14800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:37:41.298 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.289+0000 7efd4be14800 20 rados->read ofs=0 len=0 2024-09-22T08:37:41.298 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.289+0000 7efd4be14800 1 -- 172.21.15.142:0/3690725229 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560b7c653580 con 0x560b7c64b6a0 2024-09-22T08:37:41.299 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.289+0000 7efd46ddf640 1 -- 172.21.15.142:0/3690725229 <== osd.1 v2:172.21.15.142:6816/3192108003 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efd3002a040 con 0x560b7c64b6a0 2024-09-22T08:37:41.299 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.289+0000 7efd4be14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:41.299 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.289+0000 7efd4be14800 20 rados->read ofs=0 len=0 2024-09-22T08:37:41.299 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.289+0000 7efd4be14800 1 -- 172.21.15.142:0/3690725229 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560b7c653e20 con 0x560b7c64b6a0 2024-09-22T08:37:41.299 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.290+0000 7efd46ddf640 1 -- 172.21.15.142:0/3690725229 <== osd.1 v2:172.21.15.142:6816/3192108003 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7efd3002a040 con 0x560b7c64b6a0 2024-09-22T08:37:41.299 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.290+0000 7efd4be14800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:37:41.299 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.290+0000 7efd4be14800 20 rados->read ofs=0 len=0 2024-09-22T08:37:41.299 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.290+0000 7efd4be14800 1 -- 172.21.15.142:0/3690725229 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:40 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560b7c6531c0 con 0x560b7c64ffa0 2024-09-22T08:37:41.299 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.290+0000 7efd47de1640 1 -- 172.21.15.142:0/3690725229 <== osd.3 v2:172.21.15.142:6800/1064901393 11 ==== osd_op_reply(40 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7efd400083e0 con 0x560b7c64ffa0 2024-09-22T08:37:41.299 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.290+0000 7efd4be14800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:37:41.299 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.290+0000 7efd4be14800 20 zone default found 2024-09-22T08:37:41.299 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.290+0000 7efd4be14800 4 Realm: () 2024-09-22T08:37:41.299 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.290+0000 7efd4be14800 4 ZoneGroup: default (d89f6f57-1007-47dd-9065-f486c7b01aec) 2024-09-22T08:37:41.300 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.290+0000 7efd4be14800 4 Zone: default (e239248c-0bee-4e41-803a-24b288d3eb8f) 2024-09-22T08:37:41.300 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.290+0000 7efd4be14800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:37:41.300 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.290+0000 7efd4be14800 20 zonegroup default 2024-09-22T08:37:41.300 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.290+0000 7efd4be14800 20 rados->read ofs=0 len=0 2024-09-22T08:37:41.300 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.290+0000 7efd4be14800 1 -- 172.21.15.142:0/3690725229 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560b7c653a50 con 0x7efd3806d040 2024-09-22T08:37:41.300 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.290+0000 7efd46ddf640 1 -- 172.21.15.142:0/3690725229 <== osd.0 v2:172.21.15.31:6800/168281188 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7efd3002a040 con 0x7efd3806d040 2024-09-22T08:37:41.300 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.290+0000 7efd4be14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:41.300 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.290+0000 7efd4be14800 20 rados->read ofs=0 len=0 2024-09-22T08:37:41.300 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.290+0000 7efd4be14800 1 -- 172.21.15.142:0/3690725229 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560b7c656970 con 0x560b7c64ffa0 2024-09-22T08:37:41.300 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.291+0000 7efd47de1640 1 -- 172.21.15.142:0/3690725229 <== osd.3 v2:172.21.15.142:6800/1064901393 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7efd400083e0 con 0x560b7c64ffa0 2024-09-22T08:37:41.300 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.291+0000 7efd4be14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:41.300 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.291+0000 7efd4be14800 20 rados->read ofs=0 len=0 2024-09-22T08:37:41.300 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.291+0000 7efd4be14800 1 -- 172.21.15.142:0/3690725229 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560b7c656970 con 0x560b7c64ffa0 2024-09-22T08:37:41.301 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.291+0000 7efd47de1640 1 -- 172.21.15.142:0/3690725229 <== osd.3 v2:172.21.15.142:6800/1064901393 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7efd400083e0 con 0x560b7c64ffa0 2024-09-22T08:37:41.301 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.291+0000 7efd4be14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:41.301 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.291+0000 7efd4be14800 20 started sync module instance, tier type = 2024-09-22T08:37:41.301 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.291+0000 7efd4be14800 20 started zone id=e239248c-0bee-4e41-803a-24b288d3eb8f (name=default) with tier type = 2024-09-22T08:37:41.301 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.291+0000 7efd4be14800 1 -- 172.21.15.142:0/3690725229 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560b7c655d10 con 0x7efd4004e070 2024-09-22T08:37:41.301 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.292+0000 7efd475e0640 1 -- 172.21.15.142:0/3690725229 <== osd.2 v2:172.21.15.142:6808/279438927 7 ==== osd_op_reply(44 notify.0 [create] v32'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd3807d070 con 0x7efd4004e070 2024-09-22T08:37:41.301 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.292+0000 7efd4be14800 1 -- 172.21.15.142:0/3690725229 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94607331645536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560b7c656df0 con 0x7efd4004e070 2024-09-22T08:37:41.301 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.292+0000 7efd4be14800 1 -- 172.21.15.142:0/3690725229 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560b7c657640 con 0x560b7c64b6a0 2024-09-22T08:37:41.301 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.293+0000 7efd475e0640 1 -- 172.21.15.142:0/3690725229 <== osd.2 v2:172.21.15.142:6808/279438927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94607331645536] v32'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd3807d070 con 0x7efd4004e070 2024-09-22T08:37:41.301 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.293+0000 7efd46ddf640 1 -- 172.21.15.142:0/3690725229 <== osd.1 v2:172.21.15.142:6816/3192108003 16 ==== osd_op_reply(46 notify.1 [create] v32'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd3002a040 con 0x560b7c64b6a0 2024-09-22T08:37:41.301 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.294+0000 7efd4be14800 1 -- 172.21.15.142:0/3690725229 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94607331651984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560b7c657a60 con 0x560b7c64b6a0 2024-09-22T08:37:41.301 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.294+0000 7efd4be14800 1 -- 172.21.15.142:0/3690725229 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560b7c658420 con 0x560b7c64ffa0 2024-09-22T08:37:41.304 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.295+0000 7efd46ddf640 1 -- 172.21.15.142:0/3690725229 <== osd.1 v2:172.21.15.142:6816/3192108003 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94607331651984] v32'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd3002a040 con 0x560b7c64b6a0 2024-09-22T08:37:41.304 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.295+0000 7efd47de1640 1 -- 172.21.15.142:0/3690725229 <== osd.3 v2:172.21.15.142:6800/1064901393 14 ==== osd_op_reply(48 notify.2 [create] v32'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd400083e0 con 0x560b7c64ffa0 2024-09-22T08:37:41.304 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.295+0000 7efd4be14800 1 -- 172.21.15.142:0/3690725229 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94607331653520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560b7c658420 con 0x560b7c64ffa0 2024-09-22T08:37:41.304 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.295+0000 7efd4be14800 1 -- 172.21.15.142:0/3690725229 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560b7c658de0 con 0x7efd4004e070 2024-09-22T08:37:41.304 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.296+0000 7efd47de1640 1 -- 172.21.15.142:0/3690725229 <== osd.3 v2:172.21.15.142:6800/1064901393 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94607331653520] v32'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd400083e0 con 0x560b7c64ffa0 2024-09-22T08:37:41.304 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.296+0000 7efd475e0640 1 -- 172.21.15.142:0/3690725229 <== osd.2 v2:172.21.15.142:6808/279438927 9 ==== osd_op_reply(50 notify.3 [create] v32'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd3807d070 con 0x7efd4004e070 2024-09-22T08:37:41.304 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.296+0000 7efd4be14800 1 -- 172.21.15.142:0/3690725229 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94607331655536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560b7c658390 con 0x7efd4004e070 2024-09-22T08:37:41.304 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.296+0000 7efd4be14800 1 -- 172.21.15.142:0/3690725229 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560b7c659ce0 con 0x560b7c64b6a0 2024-09-22T08:37:41.304 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.297+0000 7efd475e0640 1 -- 172.21.15.142:0/3690725229 <== osd.2 v2:172.21.15.142:6808/279438927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94607331655536] v32'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd3807d070 con 0x7efd4004e070 2024-09-22T08:37:41.304 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.297+0000 7efd46ddf640 1 -- 172.21.15.142:0/3690725229 <== osd.1 v2:172.21.15.142:6816/3192108003 18 ==== osd_op_reply(52 notify.4 [create] v32'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd3002a040 con 0x560b7c64b6a0 2024-09-22T08:37:41.304 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.297+0000 7efd4be14800 1 -- 172.21.15.142:0/3690725229 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94607331660240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560b7c659ca0 con 0x560b7c64b6a0 2024-09-22T08:37:41.304 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.297+0000 7efd4be14800 1 -- 172.21.15.142:0/3690725229 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560b7c65a750 con 0x7efd3806d040 2024-09-22T08:37:41.304 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.299+0000 7efd46ddf640 1 -- 172.21.15.142:0/3690725229 <== osd.1 v2:172.21.15.142:6816/3192108003 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94607331660240] v32'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd3002a040 con 0x560b7c64b6a0 2024-09-22T08:37:41.305 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.299+0000 7efd46ddf640 1 -- 172.21.15.142:0/3690725229 <== osd.0 v2:172.21.15.31:6800/168281188 10 ==== osd_op_reply(54 notify.5 [create] v32'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd3002a040 con 0x7efd3806d040 2024-09-22T08:37:41.305 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.299+0000 7efd4be14800 1 -- 172.21.15.142:0/3690725229 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94607331665024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560b7c659ca0 con 0x7efd3806d040 2024-09-22T08:37:41.305 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.299+0000 7efd4be14800 1 -- 172.21.15.142:0/3690725229 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560b7c659ca0 con 0x7efd3806d040 2024-09-22T08:37:41.305 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.300+0000 7efd46ddf640 1 -- 172.21.15.142:0/3690725229 <== osd.0 v2:172.21.15.31:6800/168281188 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94607331665024] v32'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd3002a040 con 0x7efd3806d040 2024-09-22T08:37:41.305 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.300+0000 7efd46ddf640 1 -- 172.21.15.142:0/3690725229 <== osd.0 v2:172.21.15.31:6800/168281188 12 ==== osd_op_reply(56 notify.6 [create] v32'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd3002a040 con 0x7efd3806d040 2024-09-22T08:37:41.305 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.300+0000 7efd4be14800 1 -- 172.21.15.142:0/3690725229 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94607331661808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560b7c65b370 con 0x7efd3806d040 2024-09-22T08:37:41.305 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.300+0000 7efd4be14800 1 -- 172.21.15.142:0/3690725229 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560b7c65bbc0 con 0x7efd3806d040 2024-09-22T08:37:41.305 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.301+0000 7efd46ddf640 1 -- 172.21.15.142:0/3690725229 <== osd.0 v2:172.21.15.31:6800/168281188 13 ==== osd_op_reply(58 notify.7 [create] v32'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd3002a040 con 0x7efd3806d040 2024-09-22T08:37:41.305 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.301+0000 7efd4be14800 1 -- 172.21.15.142:0/3690725229 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94607331669120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560b7c65bf70 con 0x7efd3806d040 2024-09-22T08:37:41.305 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.301+0000 7efd4be14800 20 add_watcher() i=0 2024-09-22T08:37:41.305 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.301+0000 7efd4be14800 20 add_watcher() i=1 2024-09-22T08:37:41.305 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.301+0000 7efd4be14800 20 add_watcher() i=2 2024-09-22T08:37:41.305 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.301+0000 7efd4be14800 20 add_watcher() i=3 2024-09-22T08:37:41.305 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.301+0000 7efd4be14800 20 add_watcher() i=4 2024-09-22T08:37:41.305 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.301+0000 7efd4be14800 20 add_watcher() i=5 2024-09-22T08:37:41.306 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.301+0000 7efd46ddf640 1 -- 172.21.15.142:0/3690725229 <== osd.0 v2:172.21.15.31:6800/168281188 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94607331661808] v32'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd3002a040 con 0x7efd3806d040 2024-09-22T08:37:41.306 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.301+0000 7efd4be14800 20 add_watcher() i=6 2024-09-22T08:37:41.306 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.302+0000 7efd46ddf640 1 -- 172.21.15.142:0/3690725229 <== osd.0 v2:172.21.15.31:6800/168281188 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94607331669120] v32'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd3002a040 con 0x7efd3806d040 2024-09-22T08:37:41.306 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.302+0000 7efd4be14800 20 add_watcher() i=7 2024-09-22T08:37:41.306 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.302+0000 7efd4be14800 2 all 8 watchers are set, enabling cache 2024-09-22T08:37:41.306 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.302+0000 7efd4be14800 1 -- 172.21.15.142:0/3690725229 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560b7c65b020 con 0x560b7c64b6a0 2024-09-22T08:37:41.309 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.303+0000 7efd46ddf640 1 -- 172.21.15.142:0/3690725229 <== osd.1 v2:172.21.15.142:6816/3192108003 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7efd3002a040 con 0x560b7c64b6a0 2024-09-22T08:37:41.309 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.303+0000 7efd4be14800 1 -- 172.21.15.142:0/3690725229 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94607331670528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560b7c65b020 con 0x560b7c64b6a0 2024-09-22T08:37:41.310 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.304+0000 7efd46ddf640 1 -- 172.21.15.142:0/3690725229 <== osd.1 v2:172.21.15.142:6816/3192108003 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94607331670528] v32'196 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7efd3002a040 con 0x560b7c64b6a0 2024-09-22T08:37:41.310 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.304+0000 7efbfdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:37:41.310 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.304+0000 7efd4be14800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:37:41.310 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.304+0000 7efd4be14800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:37:41.310 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.304+0000 7efd4be14800 5 note: GC not initialized 2024-09-22T08:37:41.310 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.304+0000 7efbfcfe1640 20 reqs_thread_entry: start 2024-09-22T08:37:41.310 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.304+0000 7efd4be14800 20 init_complete bucket index max shards: 11 2024-09-22T08:37:41.310 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.305+0000 7efd4be14800 20 Filter name: none 2024-09-22T08:37:41.310 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.305+0000 7efb767fc640 20 reqs_thread_entry: start 2024-09-22T08:37:41.310 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.305+0000 7efd4be14800 1 -- 172.21.15.142:0/3690725229 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:62 6.e 6:74cd889a:usage::usage.0:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560b7c692950 con 0x560b7c64b6a0 2024-09-22T08:37:41.310 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.305+0000 7efd46ddf640 1 -- 172.21.15.142:0/3690725229 <== osd.1 v2:172.21.15.142:6816/3192108003 22 ==== osd_op_reply(62 usage.0 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7efd3002a040 con 0x560b7c64b6a0 2024-09-22T08:37:41.310 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.305+0000 7efd4be14800 1 -- 172.21.15.142:0/3690725229 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:63 6.3 6:c0e78a64:usage::usage.1:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560b7c692950 con 0x7efd4004e070 2024-09-22T08:37:41.311 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.305+0000 7efd475e0640 1 -- 172.21.15.142:0/3690725229 <== osd.2 v2:172.21.15.142:6808/279438927 11 ==== osd_op_reply(63 usage.1 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7efd3807d070 con 0x7efd4004e070 2024-09-22T08:37:41.311 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.305+0000 7efd4be14800 1 -- 172.21.15.142:0/3690725229 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:64 6.d 6:b564efa4:usage::usage.2:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560b7c692910 con 0x560b7c64b6a0 2024-09-22T08:37:41.311 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.305+0000 7efd46ddf640 1 -- 172.21.15.142:0/3690725229 <== osd.1 v2:172.21.15.142:6816/3192108003 23 ==== osd_op_reply(64 usage.2 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7efd3002a040 con 0x560b7c64b6a0 2024-09-22T08:37:41.311 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.306+0000 7efd4be14800 1 -- 172.21.15.142:0/3690725229 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:65 6.2 6:42d64401:usage::usage.3:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560b7c692910 con 0x560b7c64ffa0 2024-09-22T08:37:41.311 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.306+0000 7efd47de1640 1 -- 172.21.15.142:0/3690725229 <== osd.3 v2:172.21.15.142:6800/1064901393 16 ==== osd_op_reply(65 usage.3 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7efd400083e0 con 0x560b7c64ffa0 2024-09-22T08:37:41.311 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.306+0000 7efd4be14800 1 -- 172.21.15.142:0/3690725229 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:66 6.7 6:e09b6f01:usage::usage.4:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560b7c692910 con 0x560b7c64ffa0 2024-09-22T08:37:41.311 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.306+0000 7efd47de1640 1 -- 172.21.15.142:0/3690725229 <== osd.3 v2:172.21.15.142:6800/1064901393 17 ==== osd_op_reply(66 usage.4 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7efd400083e0 con 0x560b7c64ffa0 2024-09-22T08:37:41.311 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.306+0000 7efd4be14800 1 -- 172.21.15.142:0/3690725229 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:67 6.6 6:672810f1:usage::usage.5:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560b7c692910 con 0x560b7c64ffa0 2024-09-22T08:37:41.311 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.306+0000 7efd47de1640 1 -- 172.21.15.142:0/3690725229 <== osd.3 v2:172.21.15.142:6800/1064901393 18 ==== osd_op_reply(67 usage.5 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7efd400083e0 con 0x560b7c64ffa0 2024-09-22T08:37:41.311 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.306+0000 7efd4be14800 1 -- 172.21.15.142:0/3690725229 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:68 6.4 6:25a86931:usage::usage.6:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560b7c692910 con 0x560b7c64b6a0 2024-09-22T08:37:41.311 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.306+0000 7efd46ddf640 1 -- 172.21.15.142:0/3690725229 <== osd.1 v2:172.21.15.142:6816/3192108003 24 ==== osd_op_reply(68 usage.6 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7efd3002a040 con 0x560b7c64b6a0 2024-09-22T08:37:41.311 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.306+0000 7efd4be14800 1 -- 172.21.15.142:0/3690725229 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:69 6.17 6:ebbe7322:usage::usage.7:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560b7c692910 con 0x560b7c64b6a0 2024-09-22T08:37:41.311 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.307+0000 7efd46ddf640 1 -- 172.21.15.142:0/3690725229 <== osd.1 v2:172.21.15.142:6816/3192108003 25 ==== osd_op_reply(69 usage.7 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7efd3002a040 con 0x560b7c64b6a0 2024-09-22T08:37:41.312 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.307+0000 7efd4be14800 1 -- 172.21.15.142:0/3690725229 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:70 6.6 6:607e1922:usage::usage.8:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560b7c692910 con 0x560b7c64ffa0 2024-09-22T08:37:41.312 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.307+0000 7efd47de1640 1 -- 172.21.15.142:0/3690725229 <== osd.3 v2:172.21.15.142:6800/1064901393 19 ==== osd_op_reply(70 usage.8 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7efd400083e0 con 0x560b7c64ffa0 2024-09-22T08:37:41.312 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.307+0000 7efd4be14800 1 -- 172.21.15.142:0/3690725229 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:71 6.b 6:d7809252:usage::usage.9:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560b7c692910 con 0x560b7c64ffa0 2024-09-22T08:37:41.312 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.307+0000 7efd47de1640 1 -- 172.21.15.142:0/3690725229 <== osd.3 v2:172.21.15.142:6800/1064901393 20 ==== osd_op_reply(71 usage.9 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7efd400083e0 con 0x560b7c64ffa0 2024-09-22T08:37:41.312 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.307+0000 7efd4be14800 1 -- 172.21.15.142:0/3690725229 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:72 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560b7c692910 con 0x7efd3806d040 2024-09-22T08:37:41.312 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.308+0000 7efd46ddf640 1 -- 172.21.15.142:0/3690725229 <== osd.0 v2:172.21.15.31:6800/168281188 16 ==== osd_op_reply(72 usage.10 [call out=1378b] v0'0 uv29 ondisk = 0) ==== 152+0+1378 (crc 0 0 0) 0x7efd3002a040 con 0x7efd3806d040 2024-09-22T08:37:41.312 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.308+0000 7efd4be14800 1 -- 172.21.15.142:0/3690725229 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:73 6.4 6:21f845ae:usage::usage.11:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560b7c692320 con 0x560b7c64b6a0 2024-09-22T08:37:41.312 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.308+0000 7efd46ddf640 1 -- 172.21.15.142:0/3690725229 <== osd.1 v2:172.21.15.142:6816/3192108003 26 ==== osd_op_reply(73 usage.11 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7efd3002a040 con 0x560b7c64b6a0 2024-09-22T08:37:41.312 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.308+0000 7efd4be14800 1 -- 172.21.15.142:0/3690725229 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:74 6.f 6:f0386354:usage::usage.12:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560b7c692320 con 0x7efd4004e070 2024-09-22T08:37:41.312 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.308+0000 7efd475e0640 1 -- 172.21.15.142:0/3690725229 <== osd.2 v2:172.21.15.142:6808/279438927 12 ==== osd_op_reply(74 usage.12 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7efd3807d070 con 0x7efd4004e070 2024-09-22T08:37:41.312 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.308+0000 7efd4be14800 1 -- 172.21.15.142:0/3690725229 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:75 6.c 6:3735eec4:usage::usage.13:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560b7c692320 con 0x560b7c64ffa0 2024-09-22T08:37:41.312 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.308+0000 7efd47de1640 1 -- 172.21.15.142:0/3690725229 <== osd.3 v2:172.21.15.142:6800/1064901393 21 ==== osd_op_reply(75 usage.13 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7efd400083e0 con 0x560b7c64ffa0 2024-09-22T08:37:41.312 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.308+0000 7efd4be14800 1 -- 172.21.15.142:0/3690725229 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:76 6.18 6:1f520d0a:usage::usage.14:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560b7c692320 con 0x7efd3806d040 2024-09-22T08:37:41.316 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.309+0000 7efd46ddf640 1 -- 172.21.15.142:0/3690725229 <== osd.0 v2:172.21.15.31:6800/168281188 17 ==== osd_op_reply(76 usage.14 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7efd3002a040 con 0x7efd3806d040 2024-09-22T08:37:41.316 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.309+0000 7efd4be14800 1 -- 172.21.15.142:0/3690725229 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:77 6.0 6:029cee12:usage::usage.15:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560b7c692320 con 0x7efd3806d040 2024-09-22T08:37:41.316 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.309+0000 7efd46ddf640 1 -- 172.21.15.142:0/3690725229 <== osd.0 v2:172.21.15.31:6800/168281188 18 ==== osd_op_reply(77 usage.15 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7efd3002a040 con 0x7efd3806d040 2024-09-22T08:37:41.316 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.309+0000 7efd4be14800 1 -- 172.21.15.142:0/3690725229 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:78 6.1e 6:7f3e030e:usage::usage.16:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560b7c692320 con 0x560b7c64ffa0 2024-09-22T08:37:41.317 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.309+0000 7efd47de1640 1 -- 172.21.15.142:0/3690725229 <== osd.3 v2:172.21.15.142:6800/1064901393 22 ==== osd_op_reply(78 usage.16 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7efd400083e0 con 0x560b7c64ffa0 2024-09-22T08:37:41.317 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.309+0000 7efd4be14800 1 -- 172.21.15.142:0/3690725229 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:79 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560b7c692320 con 0x7efd3806d040 2024-09-22T08:37:41.317 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.310+0000 7efd46ddf640 1 -- 172.21.15.142:0/3690725229 <== osd.0 v2:172.21.15.31:6800/168281188 19 ==== osd_op_reply(79 usage.17 [call out=185b] v0'0 uv5 ondisk = 0) ==== 152+0+185 (crc 0 0 0) 0x7efd3002a040 con 0x7efd3806d040 2024-09-22T08:37:41.317 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.310+0000 7efd4be14800 1 -- 172.21.15.142:0/3690725229 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:80 6.19 6:993b03e9:usage::usage.18:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560b7c692320 con 0x560b7c64b6a0 2024-09-22T08:37:41.317 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.310+0000 7efd46ddf640 1 -- 172.21.15.142:0/3690725229 <== osd.1 v2:172.21.15.142:6816/3192108003 27 ==== osd_op_reply(80 usage.18 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7efd3002a040 con 0x560b7c64b6a0 2024-09-22T08:37:41.317 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.310+0000 7efd4be14800 1 -- 172.21.15.142:0/3690725229 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:81 6.1a 6:58fcd270:usage::usage.19:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560b7c692320 con 0x560b7c64ffa0 2024-09-22T08:37:41.317 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.311+0000 7efd47de1640 1 -- 172.21.15.142:0/3690725229 <== osd.3 v2:172.21.15.142:6800/1064901393 23 ==== osd_op_reply(81 usage.19 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7efd400083e0 con 0x560b7c64ffa0 2024-09-22T08:37:41.317 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.311+0000 7efd4be14800 1 -- 172.21.15.142:0/3690725229 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:82 6.1f 6:fcd63d49:usage::usage.20:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560b7c692320 con 0x7efd3806d040 2024-09-22T08:37:41.317 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.311+0000 7efd46ddf640 1 -- 172.21.15.142:0/3690725229 <== osd.0 v2:172.21.15.31:6800/168281188 20 ==== osd_op_reply(82 usage.20 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7efd3002a040 con 0x7efd3806d040 2024-09-22T08:37:41.317 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.311+0000 7efd4be14800 1 -- 172.21.15.142:0/3690725229 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:83 6.5 6:a2c1a412:usage::usage.21:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560b7c692320 con 0x7efd4004e070 2024-09-22T08:37:41.317 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.311+0000 7efd475e0640 1 -- 172.21.15.142:0/3690725229 <== osd.2 v2:172.21.15.142:6808/279438927 13 ==== osd_op_reply(83 usage.21 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7efd3807d070 con 0x7efd4004e070 2024-09-22T08:37:41.317 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.311+0000 7efd4be14800 1 -- 172.21.15.142:0/3690725229 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:84 6.13 6:cdb71d68:usage::usage.22:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560b7c692320 con 0x7efd3806d040 2024-09-22T08:37:41.317 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.311+0000 7efd46ddf640 1 -- 172.21.15.142:0/3690725229 <== osd.0 v2:172.21.15.31:6800/168281188 21 ==== osd_op_reply(84 usage.22 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7efd3002a040 con 0x7efd3806d040 2024-09-22T08:37:41.318 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.311+0000 7efd4be14800 1 -- 172.21.15.142:0/3690725229 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:85 6.17 6:ef3bca03:usage::usage.23:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560b7c692320 con 0x560b7c64b6a0 2024-09-22T08:37:41.318 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.312+0000 7efd46ddf640 1 -- 172.21.15.142:0/3690725229 <== osd.1 v2:172.21.15.142:6816/3192108003 28 ==== osd_op_reply(85 usage.23 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7efd3002a040 con 0x560b7c64b6a0 2024-09-22T08:37:41.318 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.312+0000 7efd4be14800 1 -- 172.21.15.142:0/3690725229 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:86 6.e 6:7412960a:usage::usage.24:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560b7c692320 con 0x560b7c64b6a0 2024-09-22T08:37:41.318 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.312+0000 7efd46ddf640 1 -- 172.21.15.142:0/3690725229 <== osd.1 v2:172.21.15.142:6816/3192108003 29 ==== osd_op_reply(86 usage.24 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7efd3002a040 con 0x560b7c64b6a0 2024-09-22T08:37:41.318 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.312+0000 7efd4be14800 1 -- 172.21.15.142:0/3690725229 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:87 6.7 6:e62d1024:usage::usage.25:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560b7c692320 con 0x560b7c64ffa0 2024-09-22T08:37:41.318 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.312+0000 7efd47de1640 1 -- 172.21.15.142:0/3690725229 <== osd.3 v2:172.21.15.142:6800/1064901393 24 ==== osd_op_reply(87 usage.25 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7efd400083e0 con 0x560b7c64ffa0 2024-09-22T08:37:41.318 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.312+0000 7efd4be14800 1 -- 172.21.15.142:0/3690725229 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:88 6.d 6:b172cd59:usage::usage.26:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560b7c692320 con 0x560b7c64b6a0 2024-09-22T08:37:41.318 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.312+0000 7efd46ddf640 1 -- 172.21.15.142:0/3690725229 <== osd.1 v2:172.21.15.142:6816/3192108003 30 ==== osd_op_reply(88 usage.26 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7efd3002a040 con 0x560b7c64b6a0 2024-09-22T08:37:41.318 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.312+0000 7efd4be14800 1 -- 172.21.15.142:0/3690725229 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:89 6.1 6:83912023:usage::usage.27:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560b7c692320 con 0x560b7c64b6a0 2024-09-22T08:37:41.318 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.312+0000 7efd46ddf640 1 -- 172.21.15.142:0/3690725229 <== osd.1 v2:172.21.15.142:6816/3192108003 31 ==== osd_op_reply(89 usage.27 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7efd3002a040 con 0x560b7c64b6a0 2024-09-22T08:37:41.318 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.313+0000 7efd4be14800 1 -- 172.21.15.142:0/3690725229 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:90 6.1e 6:7c73bdb3:usage::usage.28:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560b7c692320 con 0x560b7c64ffa0 2024-09-22T08:37:41.318 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.313+0000 7efd47de1640 1 -- 172.21.15.142:0/3690725229 <== osd.3 v2:172.21.15.142:6800/1064901393 25 ==== osd_op_reply(90 usage.28 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7efd400083e0 con 0x560b7c64ffa0 2024-09-22T08:37:41.319 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.313+0000 7efd4be14800 1 -- 172.21.15.142:0/3690725229 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:91 6.16 6:6e59fa35:usage::usage.29:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560b7c692320 con 0x560b7c64ffa0 2024-09-22T08:37:41.319 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.313+0000 7efd47de1640 1 -- 172.21.15.142:0/3690725229 <== osd.3 v2:172.21.15.142:6800/1064901393 26 ==== osd_op_reply(91 usage.29 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7efd400083e0 con 0x560b7c64ffa0 2024-09-22T08:37:41.319 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.313+0000 7efd4be14800 1 -- 172.21.15.142:0/3690725229 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:92 6.1c 6:38fe6885:usage::usage.30:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560b7c692320 con 0x560b7c64ffa0 2024-09-22T08:37:41.319 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.313+0000 7efd47de1640 1 -- 172.21.15.142:0/3690725229 <== osd.3 v2:172.21.15.142:6800/1064901393 27 ==== osd_op_reply(92 usage.30 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7efd400083e0 con 0x560b7c64ffa0 2024-09-22T08:37:41.319 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.313+0000 7efd4be14800 1 -- 172.21.15.142:0/3690725229 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:93 6.1d 6:bb28dff0:usage::usage.31:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560b7c692320 con 0x7efd3806d040 2024-09-22T08:37:41.319 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.314+0000 7efd46ddf640 1 -- 172.21.15.142:0/3690725229 <== osd.0 v2:172.21.15.31:6800/168281188 22 ==== osd_op_reply(93 usage.31 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7efd3002a040 con 0x7efd3806d040 2024-09-22T08:37:41.319 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.315+0000 7efbfdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:37:41.319 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.315+0000 7efd4be14800 1 -- 172.21.15.142:0/3690725229 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94607331670528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560b7c65e1d0 con 0x560b7c64b6a0 2024-09-22T08:37:41.320 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.316+0000 7efd46ddf640 1 -- 172.21.15.142:0/3690725229 <== osd.1 v2:172.21.15.142:6816/3192108003 32 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94607331670528] v32'197 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7efd3002a040 con 0x560b7c64b6a0 2024-09-22T08:37:41.320 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.316+0000 7efd4be14800 1 -- 172.21.15.142:0/3690725229 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94607331645536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560b7c68fd00 con 0x7efd4004e070 2024-09-22T08:37:41.321 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.317+0000 7efd475e0640 1 -- 172.21.15.142:0/3690725229 <== osd.2 v2:172.21.15.142:6808/279438927 14 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94607331645536] v32'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd3807d070 con 0x7efd4004e070 2024-09-22T08:37:41.321 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.317+0000 7efd4be14800 20 remove_watcher() i=0 2024-09-22T08:37:41.321 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.317+0000 7efd4be14800 2 removed watcher, disabling cache 2024-09-22T08:37:41.321 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.317+0000 7efd4be14800 1 -- 172.21.15.142:0/3690725229 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94607331651984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560b7c68fd00 con 0x560b7c64b6a0 2024-09-22T08:37:41.321 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.318+0000 7efd46ddf640 1 -- 172.21.15.142:0/3690725229 <== osd.1 v2:172.21.15.142:6816/3192108003 33 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94607331651984] v32'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd3002a040 con 0x560b7c64b6a0 2024-09-22T08:37:41.321 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.318+0000 7efd4be14800 20 remove_watcher() i=1 2024-09-22T08:37:41.321 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.318+0000 7efd4be14800 1 -- 172.21.15.142:0/3690725229 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94607331653520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560b7c68fd00 con 0x560b7c64ffa0 2024-09-22T08:37:41.321 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.319+0000 7efd47de1640 1 -- 172.21.15.142:0/3690725229 <== osd.3 v2:172.21.15.142:6800/1064901393 28 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94607331653520] v32'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd400083e0 con 0x560b7c64ffa0 2024-09-22T08:37:41.321 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.319+0000 7efd4be14800 20 remove_watcher() i=2 2024-09-22T08:37:41.321 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.319+0000 7efd4be14800 1 -- 172.21.15.142:0/3690725229 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94607331655536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560b7c68fd00 con 0x7efd4004e070 2024-09-22T08:37:41.322 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.320+0000 7efd475e0640 1 -- 172.21.15.142:0/3690725229 <== osd.2 v2:172.21.15.142:6808/279438927 15 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94607331655536] v32'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd3807d070 con 0x7efd4004e070 2024-09-22T08:37:41.322 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.320+0000 7efd4be14800 20 remove_watcher() i=3 2024-09-22T08:37:41.322 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.320+0000 7efd4be14800 1 -- 172.21.15.142:0/3690725229 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94607331660240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560b7c68fd00 con 0x560b7c64b6a0 2024-09-22T08:37:41.323 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.322+0000 7efd46ddf640 1 -- 172.21.15.142:0/3690725229 <== osd.1 v2:172.21.15.142:6816/3192108003 34 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94607331660240] v32'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd3002a040 con 0x560b7c64b6a0 2024-09-22T08:37:41.323 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.322+0000 7efd4be14800 20 remove_watcher() i=4 2024-09-22T08:37:41.323 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.322+0000 7efd4be14800 1 -- 172.21.15.142:0/3690725229 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94607331665024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560b7c68fd00 con 0x7efd3806d040 2024-09-22T08:37:41.324 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.323+0000 7efd46ddf640 1 -- 172.21.15.142:0/3690725229 <== osd.0 v2:172.21.15.31:6800/168281188 23 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94607331665024] v32'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd3002a040 con 0x7efd3806d040 2024-09-22T08:37:41.324 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.323+0000 7efd4be14800 20 remove_watcher() i=5 2024-09-22T08:37:41.324 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.323+0000 7efd4be14800 1 -- 172.21.15.142:0/3690725229 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94607331661808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560b7c68fd00 con 0x7efd3806d040 2024-09-22T08:37:41.325 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.324+0000 7efd46ddf640 1 -- 172.21.15.142:0/3690725229 <== osd.0 v2:172.21.15.31:6800/168281188 24 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94607331661808] v32'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd3002a040 con 0x7efd3806d040 2024-09-22T08:37:41.325 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.324+0000 7efd4be14800 20 remove_watcher() i=6 2024-09-22T08:37:41.325 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.324+0000 7efd4be14800 1 -- 172.21.15.142:0/3690725229 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94607331669120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560b7c68fd00 con 0x7efd3806d040 2024-09-22T08:37:41.328 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.325+0000 7efd46ddf640 1 -- 172.21.15.142:0/3690725229 <== osd.0 v2:172.21.15.31:6800/168281188 25 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94607331669120] v32'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd3002a040 con 0x7efd3806d040 2024-09-22T08:37:41.328 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.325+0000 7efd4be14800 20 remove_watcher() i=7 2024-09-22T08:37:41.328 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.325+0000 7efd4be14800 1 -- 172.21.15.142:0/3690725229 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7efd3806d040 msgr2=0x7efd38056910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:41.328 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.325+0000 7efd4be14800 1 --2- 172.21.15.142:0/3690725229 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7efd3806d040 0x7efd38056910 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:41.328 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.325+0000 7efd4be14800 1 -- 172.21.15.142:0/3690725229 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x560b7c64b6a0 msgr2=0x560b7c64db60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:41.328 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.325+0000 7efd4be14800 1 --2- 172.21.15.142:0/3690725229 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x560b7c64b6a0 0x560b7c64db60 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:41.329 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.325+0000 7efd4be14800 1 -- 172.21.15.142:0/3690725229 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7efd4004e070 msgr2=0x7efd40016330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:41.329 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.325+0000 7efd4be14800 1 --2- 172.21.15.142:0/3690725229 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7efd4004e070 0x7efd40016330 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:41.329 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.325+0000 7efd4be14800 1 -- 172.21.15.142:0/3690725229 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x560b7c64ffa0 msgr2=0x560b7c652390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:41.329 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.325+0000 7efd4be14800 1 --2- 172.21.15.142:0/3690725229 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x560b7c64ffa0 0x560b7c652390 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:41.329 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.325+0000 7efd4be14800 1 -- 172.21.15.142:0/3690725229 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7efc1003cfb0 msgr2=0x7efc1003f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:41.329 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.325+0000 7efd4be14800 1 --2- 172.21.15.142:0/3690725229 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7efc1003cfb0 0x7efc1003f470 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7efd380973e0 tx=0x7efd38088000 comp rx=0 tx=0).stop 2024-09-22T08:37:41.329 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.325+0000 7efd4be14800 1 -- 172.21.15.142:0/3690725229 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560b7c6387d0 msgr2=0x560b7c63fd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:41.329 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.325+0000 7efd46ddf640 1 -- 172.21.15.142:0/3690725229 reap_dead start 2024-09-22T08:37:41.329 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.325+0000 7efd4be14800 1 --2- 172.21.15.142:0/3690725229 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560b7c6387d0 0x560b7c63fd10 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7efd40015a80 tx=0x7efd40053d10 comp rx=0 tx=0).stop 2024-09-22T08:37:41.329 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.325+0000 7efd4be14800 1 -- 172.21.15.142:0/3690725229 shutdown_connections 2024-09-22T08:37:41.329 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.325+0000 7efd4be14800 1 --2- 172.21.15.142:0/3690725229 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560b7c6387d0 0x560b7c63fd10 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:41.329 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.325+0000 7efd4be14800 1 -- 172.21.15.142:0/3690725229 >> 172.21.15.142:0/3690725229 conn(0x560b7c634bd0 msgr2=0x560b7c639f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:37:41.329 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.325+0000 7efd4be14800 1 -- 172.21.15.142:0/3690725229 shutdown_connections 2024-09-22T08:37:41.329 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.325+0000 7efd4be14800 1 -- 172.21.15.142:0/3690725229 wait complete. 2024-09-22T08:37:41.329 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.326+0000 7efd4be14800 1 -- 172.21.15.142:0/755184990 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7efc2003d000 msgr2=0x7efc2003f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:41.330 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.326+0000 7efd4be14800 1 --2- 172.21.15.142:0/755184990 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7efc2003d000 0x7efc2003f4c0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7efd3806b790 tx=0x7efd38061db0 comp rx=0 tx=0).stop 2024-09-22T08:37:41.330 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.326+0000 7efd4be14800 1 -- 172.21.15.142:0/755184990 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560b7c62bcb0 msgr2=0x560b7c62c0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:41.330 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.326+0000 7efd4be14800 1 --2- 172.21.15.142:0/755184990 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560b7c62bcb0 0x560b7c62c0d0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x560b7c612be0 tx=0x7efd4000bf30 comp rx=0 tx=0).stop 2024-09-22T08:37:41.330 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.326+0000 7efd4be14800 1 -- 172.21.15.142:0/755184990 shutdown_connections 2024-09-22T08:37:41.330 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.326+0000 7efd4be14800 1 --2- 172.21.15.142:0/755184990 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7efc2003d000 0x7efc2003f4c0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:41.330 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.326+0000 7efd4be14800 1 --2- 172.21.15.142:0/755184990 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560b7c62bcb0 0x560b7c62c0d0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:41.330 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.326+0000 7efd4be14800 1 -- 172.21.15.142:0/755184990 >> 172.21.15.142:0/755184990 conn(0x560b7c620060 msgr2=0x560b7c620440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:37:41.330 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.326+0000 7efd4be14800 1 -- 172.21.15.142:0/755184990 shutdown_connections 2024-09-22T08:37:41.330 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.326+0000 7efd4be14800 1 -- 172.21.15.142:0/755184990 wait complete. 2024-09-22T08:37:41.330 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.326+0000 7efd4be14800 1 -- 172.21.15.142:0/278664518 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x560b7c51ca00 msgr2=0x560b7c618320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:41.330 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.326+0000 7efd4be14800 1 --2- 172.21.15.142:0/278664518 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x560b7c51ca00 0x560b7c618320 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:41.330 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.326+0000 7efd4be14800 1 -- 172.21.15.142:0/278664518 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x560b7c61a6c0 msgr2=0x560b7c61cb60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:41.330 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.326+0000 7efd4be14800 1 --2- 172.21.15.142:0/278664518 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x560b7c61a6c0 0x560b7c61cb60 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:41.330 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.326+0000 7efd4be14800 1 -- 172.21.15.142:0/278664518 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7efc2c03cfb0 msgr2=0x7efc2c03f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:41.330 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.326+0000 7efd4be14800 1 --2- 172.21.15.142:0/278664518 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7efc2c03cfb0 0x7efc2c03f470 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7efd30001e50 tx=0x7efd300013d0 comp rx=0 tx=0).stop 2024-09-22T08:37:41.331 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.326+0000 7efd4be14800 1 -- 172.21.15.142:0/278664518 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560b7c48acf0 msgr2=0x560b7c610cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:41.331 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.326+0000 7efd4be14800 1 --2- 172.21.15.142:0/278664518 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560b7c48acf0 0x560b7c610cd0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7efd38063040 tx=0x7efd38003330 comp rx=0 tx=0).stop 2024-09-22T08:37:41.331 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.326+0000 7efd4be14800 1 -- 172.21.15.142:0/278664518 shutdown_connections 2024-09-22T08:37:41.331 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.326+0000 7efd4be14800 1 --2- 172.21.15.142:0/278664518 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x560b7c61a6c0 0x560b7c61cb60 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:41.331 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.326+0000 7efd4be14800 1 --2- 172.21.15.142:0/278664518 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x560b7c51ca00 0x560b7c618320 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:41.331 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.326+0000 7efd4be14800 1 --2- 172.21.15.142:0/278664518 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7efc2c03cfb0 0x7efc2c03f470 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:41.331 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.326+0000 7efd4be14800 1 --2- 172.21.15.142:0/278664518 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560b7c48acf0 0x560b7c610cd0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:41.331 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.326+0000 7efd4be14800 1 -- 172.21.15.142:0/278664518 >> 172.21.15.142:0/278664518 conn(0x560b7c511bb0 msgr2=0x560b7c60a670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:37:41.331 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.326+0000 7efd4be14800 1 -- 172.21.15.142:0/278664518 shutdown_connections 2024-09-22T08:37:41.331 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.326+0000 7efd4be14800 1 -- 172.21.15.142:0/278664518 wait complete. 2024-09-22T08:37:41.336 INFO:teuthology.orchestra.run.smithi142.stdout:{"entries":[{"user":"anonymous","buckets":[{"bucket":"","time":"2024-09-22T08:00:00.000000Z","epoch":1726992000,"owner":"anonymous","categories":[],"s3select":{}}]},{"user":"foo","buckets":[{"bucket":"","time":"2024-09-22T08:00:00.000000Z","epoch":1726992000,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo","time":"2024-09-22T08:00:00.000000Z","epoch":1726992000,"owner":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}],"s3select":{}},{"bucket":"myfoo2","time":"2024-09-22T08:00:00.000000Z","epoch":1726992000,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo3","time":"2024-09-22T08:00:00.000000Z","epoch":1726992000,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo4","time":"2024-09-22T08:00:00.000000Z","epoch":1726992000,"owner":"foo","categories":[],"s3select":{}}]}],"summary":[{"user":"anonymous","categories":[],"total":{"bytes_sent":0,"bytes_received":0,"ops":0,"successful_ops":0,"bytes_processed":0,"bytes_returned":0}},{"user":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}],"total":{"bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4,"bytes_processed":0,"bytes_returned":0}}]} 2024-09-22T08:37:41.336 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-09-22T08:00:00.000000Z', 'epoch': 1726992000, 'owner': 'anonymous', 'categories': [], 's3select': {}}]}, {'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-22T08:00:00.000000Z', 'epoch': 1726992000, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo', 'time': '2024-09-22T08:00:00.000000Z', 'epoch': 1726992000, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}], 's3select': {}}, {'bucket': 'myfoo2', 'time': '2024-09-22T08:00:00.000000Z', 'epoch': 1726992000, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo3', 'time': '2024-09-22T08:00:00.000000Z', 'epoch': 1726992000, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo4', 'time': '2024-09-22T08:00:00.000000Z', 'epoch': 1726992000, 'owner': 'foo', 'categories': [], 's3select': {}}]}], 'summary': [{'user': 'anonymous', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-22T08:37:41.337 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show'] 2024-09-22T08:37:41.337 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show'] 2024-09-22T08:37:41.337 DEBUG:teuthology.orchestra.run.smithi142:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show 2024-09-22T08:37:41.379 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:37:41.379 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:37:41.380 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.379+0000 7fc50af46800 1 Processor -- start 2024-09-22T08:37:41.380 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.379+0000 7fc50af46800 1 -- start start 2024-09-22T08:37:41.380 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.379+0000 7fc50af46800 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55cce04de8e0 0x55cce04e0d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:41.380 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.379+0000 7fc50af46800 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55cce0366a20 con 0x55cce04dad70 2024-09-22T08:37:41.380 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.379+0000 7fc50af46800 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x55cce03667d0 con 0x55cce04de8e0 2024-09-22T08:37:41.381 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.379+0000 7fc508236640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55cce04de8e0 0x55cce04e0d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:41.381 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.379+0000 7fc508a37640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x55cce04dad70 0x55cce04dd160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.142:50242/0 (socket says 172.21.15.142:50242) 2024-09-22T08:37:41.381 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.379+0000 7fc508a37640 1 -- 172.21.15.142:0/1931699247 learned_addr learned my addr 172.21.15.142:0/1931699247 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-09-22T08:37:41.381 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.380+0000 7fc508236640 1 -- 172.21.15.142:0/1931699247 >> v1:172.21.15.31:6789/0 conn(0x55cce04dad70 legacy=0x55cce04dd160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:41.381 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.380+0000 7fc508236640 1 -- 172.21.15.142:0/1931699247 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cce04e2460 con 0x55cce04de8e0 2024-09-22T08:37:41.383 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.381+0000 7fc508236640 1 --2- 172.21.15.142:0/1931699247 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cce04de8e0 0x55cce04e0d80 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fc4f000a470 tx=0x7fc4f0045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=833dabd3fec37972 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:41.383 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.382+0000 7fc507a35640 1 -- 172.21.15.142:0/1931699247 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc4f0053570 con 0x55cce04de8e0 2024-09-22T08:37:41.383 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.382+0000 7fc507a35640 1 -- 172.21.15.142:0/1931699247 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4f0058070 con 0x55cce04de8e0 2024-09-22T08:37:41.383 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.382+0000 7fc507a35640 1 -- 172.21.15.142:0/1931699247 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc4f0053880 con 0x55cce04de8e0 2024-09-22T08:37:41.384 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.382+0000 7fc50af46800 1 -- 172.21.15.142:0/1931699247 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cce04de8e0 msgr2=0x55cce04e0d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:41.384 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.382+0000 7fc50af46800 1 --2- 172.21.15.142:0/1931699247 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cce04de8e0 0x55cce04e0d80 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fc4f000a470 tx=0x7fc4f0045a20 comp rx=0 tx=0).stop 2024-09-22T08:37:41.384 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.382+0000 7fc50af46800 1 -- 172.21.15.142:0/1931699247 shutdown_connections 2024-09-22T08:37:41.384 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.382+0000 7fc50af46800 1 --2- 172.21.15.142:0/1931699247 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cce04de8e0 0x55cce04e0d80 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:41.384 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.382+0000 7fc50af46800 1 -- 172.21.15.142:0/1931699247 >> 172.21.15.142:0/1931699247 conn(0x55cce04d5300 msgr2=0x55cce04d7780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:37:41.384 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.382+0000 7fc50af46800 1 -- 172.21.15.142:0/1931699247 shutdown_connections 2024-09-22T08:37:41.384 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.382+0000 7fc50af46800 1 -- 172.21.15.142:0/1931699247 wait complete. 2024-09-22T08:37:41.428 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.396+0000 7fc50af46800 1 Processor -- start 2024-09-22T08:37:41.428 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.396+0000 7fc50af46800 1 -- start start 2024-09-22T08:37:41.428 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.396+0000 7fc50af46800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cce04dad70 0x55cce04d9fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:41.428 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.396+0000 7fc50af46800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55cce0373dd0 con 0x55cce04dad70 2024-09-22T08:37:41.428 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.397+0000 7fc508a37640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cce04dad70 0x55cce04d9fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:41.429 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.397+0000 7fc508a37640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cce04dad70 0x55cce04d9fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:55568/0 (socket says 172.21.15.142:55568) 2024-09-22T08:37:41.429 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.397+0000 7fc508a37640 1 -- 172.21.15.142:0/1243947611 learned_addr learned my addr 172.21.15.142:0/1243947611 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:37:41.429 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.397+0000 7fc508a37640 1 -- 172.21.15.142:0/1243947611 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cce05cdbe0 con 0x55cce04dad70 2024-09-22T08:37:41.429 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.397+0000 7fc508a37640 1 --2- 172.21.15.142:0/1243947611 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cce04dad70 0x55cce04d9fe0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fc4f80017a0 tx=0x7fc4f8001c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9db918904f157899 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:41.429 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.397+0000 7fc3f6e0d640 1 -- 172.21.15.142:0/1243947611 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc4f80044e0 con 0x55cce04dad70 2024-09-22T08:37:41.429 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.397+0000 7fc3f6e0d640 1 -- 172.21.15.142:0/1243947611 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4f80046a0 con 0x55cce04dad70 2024-09-22T08:37:41.429 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.397+0000 7fc3f6e0d640 1 -- 172.21.15.142:0/1243947611 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc4f8004a00 con 0x55cce04dad70 2024-09-22T08:37:41.429 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.398+0000 7fc50af46800 1 -- 172.21.15.142:0/1243947611 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cce04dad70 msgr2=0x55cce04d9fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:41.429 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.398+0000 7fc50af46800 1 --2- 172.21.15.142:0/1243947611 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cce04dad70 0x55cce04d9fe0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fc4f80017a0 tx=0x7fc4f8001c60 comp rx=0 tx=0).stop 2024-09-22T08:37:41.429 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.398+0000 7fc50af46800 1 -- 172.21.15.142:0/1243947611 shutdown_connections 2024-09-22T08:37:41.429 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.398+0000 7fc50af46800 1 --2- 172.21.15.142:0/1243947611 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cce04dad70 0x55cce04d9fe0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:41.429 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.398+0000 7fc50af46800 1 -- 172.21.15.142:0/1243947611 >> 172.21.15.142:0/1243947611 conn(0x55cce04d5300 msgr2=0x55cce05c58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:37:41.429 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.398+0000 7fc50af46800 1 -- 172.21.15.142:0/1243947611 shutdown_connections 2024-09-22T08:37:41.430 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.398+0000 7fc50af46800 1 -- 172.21.15.142:0/1243947611 wait complete. 2024-09-22T08:37:41.430 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.398+0000 7fc50af46800 1 Processor -- start 2024-09-22T08:37:41.430 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.398+0000 7fc50af46800 1 -- start start 2024-09-22T08:37:41.430 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.398+0000 7fc50af46800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cce04de8e0 0x55cce05cb2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:41.430 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.398+0000 7fc50af46800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55cce04e1700 con 0x55cce04de8e0 2024-09-22T08:37:41.430 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.399+0000 7fc508a37640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cce04de8e0 0x55cce05cb2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:41.430 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.399+0000 7fc508a37640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cce04de8e0 0x55cce05cb2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:55576/0 (socket says 172.21.15.142:55576) 2024-09-22T08:37:41.430 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.399+0000 7fc508a37640 1 -- 172.21.15.142:0/2673085935 learned_addr learned my addr 172.21.15.142:0/2673085935 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:37:41.430 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.399+0000 7fc508a37640 1 -- 172.21.15.142:0/2673085935 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cce05cb850 con 0x55cce04de8e0 2024-09-22T08:37:41.430 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.399+0000 7fc508a37640 1 --2- 172.21.15.142:0/2673085935 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cce04de8e0 0x55cce05cb2f0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x55cce04d9b10 tx=0x7fc4f8000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:41.430 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.399+0000 7fc3f560a640 1 -- 172.21.15.142:0/2673085935 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc4f8022020 con 0x55cce04de8e0 2024-09-22T08:37:41.430 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.399+0000 7fc3f560a640 1 -- 172.21.15.142:0/2673085935 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4f8019040 con 0x55cce04de8e0 2024-09-22T08:37:41.430 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.399+0000 7fc3f560a640 1 -- 172.21.15.142:0/2673085935 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc4f80149e0 con 0x55cce04de8e0 2024-09-22T08:37:41.431 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.399+0000 7fc50af46800 1 -- 172.21.15.142:0/2673085935 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55cce05c9c00 con 0x55cce04de8e0 2024-09-22T08:37:41.431 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.400+0000 7fc50af46800 1 -- 172.21.15.142:0/2673085935 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cce05ca1c0 con 0x55cce04de8e0 2024-09-22T08:37:41.431 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.400+0000 7fc3f560a640 1 -- 172.21.15.142:0/2673085935 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fc4f8025020 con 0x55cce04de8e0 2024-09-22T08:37:41.431 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.401+0000 7fc3f560a640 1 --2- 172.21.15.142:0/2673085935 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fc3f003cfb0 0x7fc3f003f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:41.431 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.401+0000 7fc3f560a640 1 -- 172.21.15.142:0/2673085935 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5938+0+0 (secure 0 0 0) 0x7fc4f80542c0 con 0x55cce04de8e0 2024-09-22T08:37:41.431 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.401+0000 7fc508236640 1 --2- 172.21.15.142:0/2673085935 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fc3f003cfb0 0x7fc3f003f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:41.431 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.401+0000 7fc50af46800 1 --2- 172.21.15.142:0/2673085935 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55cce05da2a0 0x55cce05dc690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:41.431 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.401+0000 7fc50af46800 1 -- 172.21.15.142:0/2673085935 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cce05dcbd0 con 0x55cce05da2a0 2024-09-22T08:37:41.431 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.401+0000 7fc509238640 1 --2- 172.21.15.142:0/2673085935 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55cce05da2a0 0x55cce05dc690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:41.431 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.401+0000 7fc508236640 1 --2- 172.21.15.142:0/2673085935 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fc3f003cfb0 0x7fc3f003f470 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fc4f0057000 tx=0x7fc4f0052000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:41.431 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.401+0000 7fc509238640 1 --2- 172.21.15.142:0/2673085935 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55cce05da2a0 0x55cce05dc690 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:41.431 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.402+0000 7fc509238640 1 -- 172.21.15.142:0/2673085935 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc5000083e0 con 0x55cce05da2a0 2024-09-22T08:37:41.431 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.402+0000 7fc50af46800 1 -- 172.21.15.142:0/2673085935 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cce05ca6d0 con 0x55cce05da2a0 2024-09-22T08:37:41.431 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.402+0000 7fc509238640 1 -- 172.21.15.142:0/2673085935 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc5000083e0 con 0x55cce05da2a0 2024-09-22T08:37:41.432 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.402+0000 7fc50af46800 1 --2- 172.21.15.142:0/2673085935 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55cce05deea0 0x55cce05e1290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:41.432 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.402+0000 7fc50af46800 1 -- 172.21.15.142:0/2673085935 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:3 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cce05e1960 con 0x55cce05deea0 2024-09-22T08:37:41.432 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.402+0000 7fc508a37640 1 --2- 172.21.15.142:0/2673085935 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55cce05deea0 0x55cce05e1290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:41.432 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.402+0000 7fc508a37640 1 --2- 172.21.15.142:0/2673085935 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55cce05deea0 0x55cce05e1290 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:41.432 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.402+0000 7fc508a37640 1 -- 172.21.15.142:0/2673085935 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(3 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fc4f800f030 con 0x55cce05deea0 2024-09-22T08:37:41.432 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.403+0000 7fc50af46800 1 -- 172.21.15.142:0/2673085935 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cce05ddd40 con 0x55cce05da2a0 2024-09-22T08:37:41.432 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.403+0000 7fc509238640 1 -- 172.21.15.142:0/2673085935 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc5000083e0 con 0x55cce05da2a0 2024-09-22T08:37:41.432 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.403+0000 7fc50af46800 1 -- 172.21.15.142:0/2673085935 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cce05de220 con 0x55cce05deea0 2024-09-22T08:37:41.432 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.403+0000 7fc508a37640 1 -- 172.21.15.142:0/2673085935 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(5 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fc4f800f030 con 0x55cce05deea0 2024-09-22T08:37:41.432 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.403+0000 7fc50af46800 1 Processor -- start 2024-09-22T08:37:41.432 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.403+0000 7fc50af46800 1 -- start start 2024-09-22T08:37:41.432 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.404+0000 7fc50af46800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cce05f0300 0x55cce05f0720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:41.432 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.404+0000 7fc50af46800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55cce03d2d50 con 0x55cce05f0300 2024-09-22T08:37:41.433 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.404+0000 7fc509238640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cce05f0300 0x55cce05f0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:41.433 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.404+0000 7fc509238640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cce05f0300 0x55cce05f0720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:55586/0 (socket says 172.21.15.142:55586) 2024-09-22T08:37:41.433 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.404+0000 7fc509238640 1 -- 172.21.15.142:0/1941047511 learned_addr learned my addr 172.21.15.142:0/1941047511 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:37:41.433 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.404+0000 7fc509238640 1 -- 172.21.15.142:0/1941047511 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cce05f0d60 con 0x55cce05f0300 2024-09-22T08:37:41.433 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.405+0000 7fc509238640 1 --2- 172.21.15.142:0/1941047511 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cce05f0300 0x55cce05f0720 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x55cce05ca3e0 tx=0x7fc50000bf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:41.433 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.405+0000 7fc3ee7fc640 1 -- 172.21.15.142:0/1941047511 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc50001c020 con 0x55cce05f0300 2024-09-22T08:37:41.433 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.405+0000 7fc3ee7fc640 1 -- 172.21.15.142:0/1941047511 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc500007c90 con 0x55cce05f0300 2024-09-22T08:37:41.433 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.405+0000 7fc3ee7fc640 1 -- 172.21.15.142:0/1941047511 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc500018440 con 0x55cce05f0300 2024-09-22T08:37:41.433 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.405+0000 7fc50af46800 1 -- 172.21.15.142:0/1941047511 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55cce05f1590 con 0x55cce05f0300 2024-09-22T08:37:41.433 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.405+0000 7fc50af46800 1 -- 172.21.15.142:0/1941047511 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cce05f1b30 con 0x55cce05f0300 2024-09-22T08:37:41.433 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.406+0000 7fc3ee7fc640 1 -- 172.21.15.142:0/1941047511 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fc50001f020 con 0x55cce05f0300 2024-09-22T08:37:41.433 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.406+0000 7fc3ee7fc640 1 --2- 172.21.15.142:0/1941047511 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fc3e003cfb0 0x7fc3e003f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:41.434 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.406+0000 7fc3ee7fc640 1 -- 172.21.15.142:0/1941047511 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5938+0+0 (secure 0 0 0) 0x7fc500055990 con 0x55cce05f0300 2024-09-22T08:37:41.434 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.406+0000 7fc508a37640 1 --2- 172.21.15.142:0/1941047511 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fc3e003cfb0 0x7fc3e003f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:41.434 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.406+0000 7fc50af46800 1 Processor -- start 2024-09-22T08:37:41.434 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.406+0000 7fc508a37640 1 --2- 172.21.15.142:0/1941047511 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fc3e003cfb0 0x7fc3e003f470 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fc4f8052770 tx=0x7fc4f8026ed0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:41.434 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.406+0000 7fc50af46800 1 -- start start 2024-09-22T08:37:41.434 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.407+0000 7fc50af46800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cce05fcd40 0x55cce05fd140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:41.434 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.407+0000 7fc50af46800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55cce05cdec0 con 0x55cce05fcd40 2024-09-22T08:37:41.434 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.407+0000 7fc509238640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cce05fcd40 0x55cce05fd140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:41.434 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.407+0000 7fc509238640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cce05fcd40 0x55cce05fd140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:55588/0 (socket says 172.21.15.142:55588) 2024-09-22T08:37:41.434 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.407+0000 7fc509238640 1 -- 172.21.15.142:0/3555771314 learned_addr learned my addr 172.21.15.142:0/3555771314 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:37:41.435 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.407+0000 7fc509238640 1 -- 172.21.15.142:0/3555771314 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cce05fd730 con 0x55cce05fcd40 2024-09-22T08:37:41.435 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.407+0000 7fc509238640 1 --2- 172.21.15.142:0/3555771314 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cce05fcd40 0x55cce05fd140 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fc500053df0 tx=0x7fc500015970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae46f6f6b0e646b5 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:41.435 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.407+0000 7fc3dffff640 1 -- 172.21.15.142:0/3555771314 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc50004a070 con 0x55cce05fcd40 2024-09-22T08:37:41.435 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.407+0000 7fc3dffff640 1 -- 172.21.15.142:0/3555771314 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc500015e70 con 0x55cce05fcd40 2024-09-22T08:37:41.435 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.407+0000 7fc3dffff640 1 -- 172.21.15.142:0/3555771314 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc5000174d0 con 0x55cce05fcd40 2024-09-22T08:37:41.435 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.408+0000 7fc50af46800 1 -- 172.21.15.142:0/3555771314 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cce05fcd40 msgr2=0x55cce05fd140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:41.435 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.408+0000 7fc50af46800 1 --2- 172.21.15.142:0/3555771314 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cce05fcd40 0x55cce05fd140 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fc500053df0 tx=0x7fc500015970 comp rx=0 tx=0).stop 2024-09-22T08:37:41.435 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.408+0000 7fc50af46800 1 -- 172.21.15.142:0/3555771314 shutdown_connections 2024-09-22T08:37:41.435 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.408+0000 7fc50af46800 1 --2- 172.21.15.142:0/3555771314 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cce05fcd40 0x55cce05fd140 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:41.435 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.408+0000 7fc50af46800 1 -- 172.21.15.142:0/3555771314 >> 172.21.15.142:0/3555771314 conn(0x55cce05f9160 msgr2=0x55cce05f73a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:37:41.435 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.408+0000 7fc50af46800 1 -- 172.21.15.142:0/3555771314 shutdown_connections 2024-09-22T08:37:41.435 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.408+0000 7fc50af46800 1 -- 172.21.15.142:0/3555771314 wait complete. 2024-09-22T08:37:41.435 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.408+0000 7fc50af46800 1 Processor -- start 2024-09-22T08:37:41.435 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.408+0000 7fc50af46800 1 -- start start 2024-09-22T08:37:41.436 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.408+0000 7fc50af46800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cce05fcd40 0x55cce0604340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:41.436 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.408+0000 7fc50af46800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55cce05fdd50 con 0x55cce05fcd40 2024-09-22T08:37:41.436 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.409+0000 7fc509238640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cce05fcd40 0x55cce0604340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:41.436 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.409+0000 7fc509238640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cce05fcd40 0x55cce0604340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:55600/0 (socket says 172.21.15.142:55600) 2024-09-22T08:37:41.436 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.409+0000 7fc509238640 1 -- 172.21.15.142:0/3591613122 learned_addr learned my addr 172.21.15.142:0/3591613122 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:37:41.436 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.409+0000 7fc509238640 1 -- 172.21.15.142:0/3591613122 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cce06048a0 con 0x55cce05fcd40 2024-09-22T08:37:41.436 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.409+0000 7fc509238640 1 --2- 172.21.15.142:0/3591613122 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cce05fcd40 0x55cce0604340 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fc5000206f0 tx=0x7fc500053d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:41.436 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.409+0000 7fc3de7fc640 1 -- 172.21.15.142:0/3591613122 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc50002e070 con 0x55cce05fcd40 2024-09-22T08:37:41.436 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.409+0000 7fc3de7fc640 1 -- 172.21.15.142:0/3591613122 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc50004b040 con 0x55cce05fcd40 2024-09-22T08:37:41.436 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.409+0000 7fc50af46800 1 -- 172.21.15.142:0/3591613122 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55cce0604b30 con 0x55cce05fcd40 2024-09-22T08:37:41.436 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.409+0000 7fc3de7fc640 1 -- 172.21.15.142:0/3591613122 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc50004a070 con 0x55cce05fcd40 2024-09-22T08:37:41.436 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.409+0000 7fc50af46800 1 -- 172.21.15.142:0/3591613122 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cce06056c0 con 0x55cce05fcd40 2024-09-22T08:37:41.437 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.410+0000 7fc3de7fc640 1 -- 172.21.15.142:0/3591613122 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fc500016040 con 0x55cce05fcd40 2024-09-22T08:37:41.437 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.410+0000 7fc3de7fc640 1 --2- 172.21.15.142:0/3591613122 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fc3d403cf60 0x7fc3d403f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:41.437 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.410+0000 7fc3de7fc640 1 -- 172.21.15.142:0/3591613122 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5938+0+0 (secure 0 0 0) 0x7fc500032d60 con 0x55cce05fcd40 2024-09-22T08:37:41.437 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.411+0000 7fc50af46800 20 rados->read ofs=0 len=0 2024-09-22T08:37:41.437 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.411+0000 7fc508a37640 1 --2- 172.21.15.142:0/3591613122 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fc3d403cf60 0x7fc3d403f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:41.437 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.411+0000 7fc50af46800 1 --2- 172.21.15.142:0/3591613122 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55cce060fc70 0x55cce0612100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:41.437 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.411+0000 7fc50af46800 1 -- 172.21.15.142:0/3591613122 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cce0612850 con 0x55cce060fc70 2024-09-22T08:37:41.437 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.411+0000 7fc508236640 1 --2- 172.21.15.142:0/3591613122 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55cce060fc70 0x55cce0612100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:41.437 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.411+0000 7fc508a37640 1 --2- 172.21.15.142:0/3591613122 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fc3d403cf60 0x7fc3d403f420 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fc4f8012f70 tx=0x7fc4f8052f90 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:41.437 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.411+0000 7fc508236640 1 --2- 172.21.15.142:0/3591613122 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55cce060fc70 0x55cce0612100 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:41.437 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.411+0000 7fc508236640 1 -- 172.21.15.142:0/3591613122 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc4f0051070 con 0x55cce060fc70 2024-09-22T08:37:41.437 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.411+0000 7fc50af46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:41.437 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.411+0000 7fc50af46800 20 realm 2024-09-22T08:37:41.438 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.411+0000 7fc50af46800 20 rados->read ofs=0 len=0 2024-09-22T08:37:41.438 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.411+0000 7fc50af46800 1 -- 172.21.15.142:0/3591613122 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cce0612c80 con 0x55cce060fc70 2024-09-22T08:37:41.438 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.412+0000 7fc508236640 1 -- 172.21.15.142:0/3591613122 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc4f0051070 con 0x55cce060fc70 2024-09-22T08:37:41.438 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.412+0000 7fc50af46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:41.438 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.412+0000 7fc50af46800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:37:41.438 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.412+0000 7fc50af46800 20 rados->read ofs=0 len=0 2024-09-22T08:37:41.438 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.412+0000 7fc50af46800 1 -- 172.21.15.142:0/3591613122 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cce0613550 con 0x55cce060fc70 2024-09-22T08:37:41.438 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.412+0000 7fc508236640 1 -- 172.21.15.142:0/3591613122 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc4f0051070 con 0x55cce060fc70 2024-09-22T08:37:41.438 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.412+0000 7fc50af46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:41.438 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.412+0000 7fc50af46800 20 rados->read ofs=0 len=0 2024-09-22T08:37:41.438 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.412+0000 7fc50af46800 1 -- 172.21.15.142:0/3591613122 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cce06138f0 con 0x55cce060fc70 2024-09-22T08:37:41.438 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.412+0000 7fc508236640 1 -- 172.21.15.142:0/3591613122 <== osd.1 v2:172.21.15.142:6816/3192108003 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc4f0051070 con 0x55cce060fc70 2024-09-22T08:37:41.438 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.412+0000 7fc50af46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:37:41.439 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.412+0000 7fc50af46800 20 rados->read ofs=0 len=0 2024-09-22T08:37:41.439 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.412+0000 7fc50af46800 1 --2- 172.21.15.142:0/3591613122 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55cce0614650 0x55cce0616a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:41.439 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.412+0000 7fc50af46800 1 -- 172.21.15.142:0/3591613122 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cce0616f80 con 0x55cce0614650 2024-09-22T08:37:41.439 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.412+0000 7fc509238640 1 --2- 172.21.15.142:0/3591613122 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55cce0614650 0x55cce0616a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:41.439 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.412+0000 7fc509238640 1 --2- 172.21.15.142:0/3591613122 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55cce0614650 0x55cce0616a40 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:41.439 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.413+0000 7fc509238640 1 -- 172.21.15.142:0/3591613122 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(5 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fc5000083e0 con 0x55cce0614650 2024-09-22T08:37:41.439 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.413+0000 7fc50af46800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:37:41.439 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.413+0000 7fc50af46800 20 searching for the correct realm 2024-09-22T08:37:41.439 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.413+0000 7fc50af46800 1 -- 172.21.15.142:0/3591613122 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cce06188f0 con 0x55cce0614650 2024-09-22T08:37:41.439 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.413+0000 7fc509238640 1 -- 172.21.15.142:0/3591613122 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc5000083e0 con 0x55cce0614650 2024-09-22T08:37:41.439 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.413+0000 7fc509238640 1 --2- 172.21.15.142:0/3591613122 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7fc500021020 0x7fc50003ba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:41.439 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.413+0000 7fc509238640 1 -- 172.21.15.142:0/3591613122 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cce06188f0 con 0x7fc500021020 2024-09-22T08:37:41.439 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.413+0000 7fc508a37640 1 --2- 172.21.15.142:0/3591613122 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7fc500021020 0x7fc50003ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:41.440 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.413+0000 7fc508a37640 1 --2- 172.21.15.142:0/3591613122 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7fc500021020 0x7fc50003ba90 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:41.440 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.414+0000 7fc508a37640 1 -- 172.21.15.142:0/3591613122 <== osd.2 v2:172.21.15.142:6808/279438927 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4f800f030 con 0x7fc500021020 2024-09-22T08:37:41.440 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.414+0000 7fc508a37640 1 --2- 172.21.15.142:0/3591613122 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7fc4f8027020 0x7fc4f803e050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:41.440 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.414+0000 7fc508a37640 1 -- 172.21.15.142:0/3591613122 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cce06188f0 con 0x7fc4f8027020 2024-09-22T08:37:41.440 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.414+0000 7fc508236640 1 --2- 172.21.15.142:0/3591613122 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7fc4f8027020 0x7fc4f803e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:41.440 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.414+0000 7fc508236640 1 --2- 172.21.15.142:0/3591613122 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7fc4f8027020 0x7fc4f803e050 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:41.440 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.414+0000 7fc508236640 1 -- 172.21.15.142:0/3591613122 <== osd.0 v2:172.21.15.31:6800/168281188 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4f0051070 con 0x7fc4f8027020 2024-09-22T08:37:41.440 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.414+0000 7fc508236640 1 -- 172.21.15.142:0/3591613122 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cce06188f0 con 0x55cce060fc70 2024-09-22T08:37:41.440 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.415+0000 7fc508236640 1 -- 172.21.15.142:0/3591613122 <== osd.1 v2:172.21.15.142:6816/3192108003 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4f0051070 con 0x55cce060fc70 2024-09-22T08:37:41.440 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.415+0000 7fc508236640 1 -- 172.21.15.142:0/3591613122 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cce06188f0 con 0x55cce060fc70 2024-09-22T08:37:41.440 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.415+0000 7fc508236640 1 -- 172.21.15.142:0/3591613122 <== osd.1 v2:172.21.15.142:6816/3192108003 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4f0051070 con 0x55cce060fc70 2024-09-22T08:37:41.440 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.415+0000 7fc508236640 1 -- 172.21.15.142:0/3591613122 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cce06188f0 con 0x55cce060fc70 2024-09-22T08:37:41.440 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.415+0000 7fc508236640 1 -- 172.21.15.142:0/3591613122 <== osd.1 v2:172.21.15.142:6816/3192108003 7 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4f0051070 con 0x55cce060fc70 2024-09-22T08:37:41.441 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.415+0000 7fc508236640 1 -- 172.21.15.142:0/3591613122 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cce06188f0 con 0x7fc4f8027020 2024-09-22T08:37:41.441 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.415+0000 7fc508236640 1 -- 172.21.15.142:0/3591613122 <== osd.0 v2:172.21.15.31:6800/168281188 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4f0051070 con 0x7fc4f8027020 2024-09-22T08:37:41.441 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.415+0000 7fc508236640 1 -- 172.21.15.142:0/3591613122 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cce06188f0 con 0x7fc500021020 2024-09-22T08:37:41.441 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.416+0000 7fc508a37640 1 -- 172.21.15.142:0/3591613122 <== osd.2 v2:172.21.15.142:6808/279438927 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4f800f030 con 0x7fc500021020 2024-09-22T08:37:41.441 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.416+0000 7fc508a37640 1 -- 172.21.15.142:0/3591613122 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cce06188f0 con 0x55cce0614650 2024-09-22T08:37:41.441 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.416+0000 7fc509238640 1 -- 172.21.15.142:0/3591613122 <== osd.3 v2:172.21.15.142:6800/1064901393 3 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc5000083e0 con 0x55cce0614650 2024-09-22T08:37:41.441 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.416+0000 7fc509238640 1 -- 172.21.15.142:0/3591613122 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cce06188f0 con 0x55cce060fc70 2024-09-22T08:37:41.441 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.416+0000 7fc508236640 1 -- 172.21.15.142:0/3591613122 <== osd.1 v2:172.21.15.142:6816/3192108003 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4f0051070 con 0x55cce060fc70 2024-09-22T08:37:41.441 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.416+0000 7fc508236640 1 -- 172.21.15.142:0/3591613122 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cce06188f0 con 0x7fc4f8027020 2024-09-22T08:37:41.441 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.416+0000 7fc508236640 1 -- 172.21.15.142:0/3591613122 <== osd.0 v2:172.21.15.31:6800/168281188 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4f0051070 con 0x7fc4f8027020 2024-09-22T08:37:41.441 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.416+0000 7fc508236640 1 -- 172.21.15.142:0/3591613122 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cce06188f0 con 0x55cce060fc70 2024-09-22T08:37:41.441 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.417+0000 7fc508236640 1 -- 172.21.15.142:0/3591613122 <== osd.1 v2:172.21.15.142:6816/3192108003 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4f0051070 con 0x55cce060fc70 2024-09-22T08:37:41.441 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.417+0000 7fc508236640 1 -- 172.21.15.142:0/3591613122 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cce06188f0 con 0x7fc500021020 2024-09-22T08:37:41.441 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.417+0000 7fc508a37640 1 -- 172.21.15.142:0/3591613122 <== osd.2 v2:172.21.15.142:6808/279438927 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fc4f800f030 con 0x7fc500021020 2024-09-22T08:37:41.442 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.417+0000 7fc508a37640 1 -- 172.21.15.142:0/3591613122 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cce06188f0 con 0x55cce0614650 2024-09-22T08:37:41.442 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.417+0000 7fc509238640 1 -- 172.21.15.142:0/3591613122 <== osd.3 v2:172.21.15.142:6800/1064901393 4 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc5000083e0 con 0x55cce0614650 2024-09-22T08:37:41.442 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.417+0000 7fc509238640 1 -- 172.21.15.142:0/3591613122 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cce06188f0 con 0x55cce0614650 2024-09-22T08:37:41.442 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.417+0000 7fc509238640 1 -- 172.21.15.142:0/3591613122 <== osd.3 v2:172.21.15.142:6800/1064901393 5 ==== osd_op_reply(20 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fc5000083e0 con 0x55cce0614650 2024-09-22T08:37:41.442 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.417+0000 7fc509238640 1 -- 172.21.15.142:0/3591613122 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cce06188f0 con 0x7fc4f8027020 2024-09-22T08:37:41.442 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.418+0000 7fc508236640 1 -- 172.21.15.142:0/3591613122 <== osd.0 v2:172.21.15.31:6800/168281188 4 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4f0051070 con 0x7fc4f8027020 2024-09-22T08:37:41.442 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.418+0000 7fc508236640 1 -- 172.21.15.142:0/3591613122 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cce06188f0 con 0x55cce0614650 2024-09-22T08:37:41.442 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.418+0000 7fc509238640 1 -- 172.21.15.142:0/3591613122 <== osd.3 v2:172.21.15.142:6800/1064901393 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc5000083e0 con 0x55cce0614650 2024-09-22T08:37:41.442 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.418+0000 7fc509238640 1 -- 172.21.15.142:0/3591613122 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cce06188f0 con 0x55cce0614650 2024-09-22T08:37:41.442 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.418+0000 7fc509238640 1 -- 172.21.15.142:0/3591613122 <== osd.3 v2:172.21.15.142:6800/1064901393 7 ==== osd_op_reply(23 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fc5000083e0 con 0x55cce0614650 2024-09-22T08:37:41.442 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.418+0000 7fc509238640 1 -- 172.21.15.142:0/3591613122 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cce06188f0 con 0x55cce060fc70 2024-09-22T08:37:41.442 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.418+0000 7fc508236640 1 -- 172.21.15.142:0/3591613122 <== osd.1 v2:172.21.15.142:6816/3192108003 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4f0051070 con 0x55cce060fc70 2024-09-22T08:37:41.443 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.418+0000 7fc508236640 1 -- 172.21.15.142:0/3591613122 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cce06188f0 con 0x55cce060fc70 2024-09-22T08:37:41.443 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.418+0000 7fc508236640 1 -- 172.21.15.142:0/3591613122 <== osd.1 v2:172.21.15.142:6816/3192108003 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fc4f0051070 con 0x55cce060fc70 2024-09-22T08:37:41.443 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.418+0000 7fc508236640 1 -- 172.21.15.142:0/3591613122 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cce06188f0 con 0x7fc4f8027020 2024-09-22T08:37:41.443 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.419+0000 7fc508236640 1 -- 172.21.15.142:0/3591613122 <== osd.0 v2:172.21.15.31:6800/168281188 5 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4f0051070 con 0x7fc4f8027020 2024-09-22T08:37:41.443 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.419+0000 7fc508236640 1 -- 172.21.15.142:0/3591613122 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cce06188f0 con 0x55cce0614650 2024-09-22T08:37:41.443 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.419+0000 7fc509238640 1 -- 172.21.15.142:0/3591613122 <== osd.3 v2:172.21.15.142:6800/1064901393 8 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc5000083e0 con 0x55cce0614650 2024-09-22T08:37:41.443 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.419+0000 7fc509238640 1 -- 172.21.15.142:0/3591613122 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cce06188f0 con 0x7fc500021020 2024-09-22T08:37:41.443 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.419+0000 7fc508a37640 1 -- 172.21.15.142:0/3591613122 <== osd.2 v2:172.21.15.142:6808/279438927 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4f800f030 con 0x7fc500021020 2024-09-22T08:37:41.443 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.419+0000 7fc508a37640 1 -- 172.21.15.142:0/3591613122 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cce06188f0 con 0x55cce060fc70 2024-09-22T08:37:41.443 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.419+0000 7fc508236640 1 -- 172.21.15.142:0/3591613122 <== osd.1 v2:172.21.15.142:6816/3192108003 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4f0051070 con 0x55cce060fc70 2024-09-22T08:37:41.443 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.419+0000 7fc508236640 1 -- 172.21.15.142:0/3591613122 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cce06188f0 con 0x7fc4f8027020 2024-09-22T08:37:41.443 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.420+0000 7fc508236640 1 -- 172.21.15.142:0/3591613122 <== osd.0 v2:172.21.15.31:6800/168281188 6 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4f0051070 con 0x7fc4f8027020 2024-09-22T08:37:41.443 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.420+0000 7fc508236640 1 -- 172.21.15.142:0/3591613122 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cce06188f0 con 0x55cce0614650 2024-09-22T08:37:41.444 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.420+0000 7fc509238640 1 -- 172.21.15.142:0/3591613122 <== osd.3 v2:172.21.15.142:6800/1064901393 9 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc5000083e0 con 0x55cce0614650 2024-09-22T08:37:41.444 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.420+0000 7fc509238640 1 -- 172.21.15.142:0/3591613122 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cce06188f0 con 0x7fc4f8027020 2024-09-22T08:37:41.444 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.420+0000 7fc508236640 1 -- 172.21.15.142:0/3591613122 <== osd.0 v2:172.21.15.31:6800/168281188 7 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4f0051070 con 0x7fc4f8027020 2024-09-22T08:37:41.444 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.420+0000 7fc508236640 1 -- 172.21.15.142:0/3591613122 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cce06188f0 con 0x7fc500021020 2024-09-22T08:37:41.444 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.420+0000 7fc508a37640 1 -- 172.21.15.142:0/3591613122 <== osd.2 v2:172.21.15.142:6808/279438927 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4f800f030 con 0x7fc500021020 2024-09-22T08:37:41.444 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.420+0000 7fc508a37640 1 -- 172.21.15.142:0/3591613122 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cce06188f0 con 0x55cce0614650 2024-09-22T08:37:41.444 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.421+0000 7fc509238640 1 -- 172.21.15.142:0/3591613122 <== osd.3 v2:172.21.15.142:6800/1064901393 10 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc5000083e0 con 0x55cce0614650 2024-09-22T08:37:41.444 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.421+0000 7fc509238640 1 -- 172.21.15.142:0/3591613122 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cce06188f0 con 0x7fc4f8027020 2024-09-22T08:37:41.444 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.421+0000 7fc508236640 1 -- 172.21.15.142:0/3591613122 <== osd.0 v2:172.21.15.31:6800/168281188 8 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4f0051070 con 0x7fc4f8027020 2024-09-22T08:37:41.444 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.421+0000 7fc508236640 1 -- 172.21.15.142:0/3591613122 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cce06188f0 con 0x55cce060fc70 2024-09-22T08:37:41.444 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.421+0000 7fc508236640 1 -- 172.21.15.142:0/3591613122 <== osd.1 v2:172.21.15.142:6816/3192108003 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fc4f0051070 con 0x55cce060fc70 2024-09-22T08:37:41.444 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.421+0000 7fc508236640 1 -- 172.21.15.142:0/3591613122 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cce06188f0 con 0x7fc500021020 2024-09-22T08:37:41.444 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.421+0000 7fc508a37640 1 -- 172.21.15.142:0/3591613122 <== osd.2 v2:172.21.15.142:6808/279438927 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4f800f030 con 0x7fc500021020 2024-09-22T08:37:41.444 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.421+0000 7fc50af46800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:37:41.445 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.421+0000 7fc50af46800 20 RGWRados::pool_iterate: got zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec 2024-09-22T08:37:41.445 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.421+0000 7fc50af46800 20 RGWRados::pool_iterate: got zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f 2024-09-22T08:37:41.445 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.421+0000 7fc50af46800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:37:41.445 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.421+0000 7fc50af46800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:37:41.445 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.421+0000 7fc50af46800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:37:41.445 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.421+0000 7fc50af46800 20 rados->read ofs=0 len=0 2024-09-22T08:37:41.445 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.421+0000 7fc50af46800 1 -- 172.21.15.142:0/3591613122 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cce06179c0 con 0x55cce060fc70 2024-09-22T08:37:41.445 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.422+0000 7fc508236640 1 -- 172.21.15.142:0/3591613122 <== osd.1 v2:172.21.15.142:6816/3192108003 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc4f0051070 con 0x55cce060fc70 2024-09-22T08:37:41.445 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.422+0000 7fc50af46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:41.445 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.422+0000 7fc50af46800 20 rados->read ofs=0 len=0 2024-09-22T08:37:41.445 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.422+0000 7fc50af46800 1 -- 172.21.15.142:0/3591613122 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cce0618260 con 0x55cce060fc70 2024-09-22T08:37:41.445 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.422+0000 7fc508236640 1 -- 172.21.15.142:0/3591613122 <== osd.1 v2:172.21.15.142:6816/3192108003 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc4f0051070 con 0x55cce060fc70 2024-09-22T08:37:41.445 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.422+0000 7fc50af46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:37:41.446 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.422+0000 7fc50af46800 20 rados->read ofs=0 len=0 2024-09-22T08:37:41.446 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.422+0000 7fc50af46800 1 -- 172.21.15.142:0/3591613122 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:40 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cce0617600 con 0x55cce0614650 2024-09-22T08:37:41.446 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.422+0000 7fc509238640 1 -- 172.21.15.142:0/3591613122 <== osd.3 v2:172.21.15.142:6800/1064901393 11 ==== osd_op_reply(40 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fc5000083e0 con 0x55cce0614650 2024-09-22T08:37:41.446 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.422+0000 7fc50af46800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:37:41.446 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.422+0000 7fc50af46800 20 zone default found 2024-09-22T08:37:41.446 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.422+0000 7fc50af46800 4 Realm: () 2024-09-22T08:37:41.446 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.422+0000 7fc50af46800 4 ZoneGroup: default (d89f6f57-1007-47dd-9065-f486c7b01aec) 2024-09-22T08:37:41.446 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.422+0000 7fc50af46800 4 Zone: default (e239248c-0bee-4e41-803a-24b288d3eb8f) 2024-09-22T08:37:41.446 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.422+0000 7fc50af46800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:37:41.446 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.422+0000 7fc50af46800 20 zonegroup default 2024-09-22T08:37:41.446 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.422+0000 7fc50af46800 20 rados->read ofs=0 len=0 2024-09-22T08:37:41.446 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.422+0000 7fc50af46800 1 -- 172.21.15.142:0/3591613122 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cce0617e90 con 0x7fc4f8027020 2024-09-22T08:37:41.446 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.423+0000 7fc508236640 1 -- 172.21.15.142:0/3591613122 <== osd.0 v2:172.21.15.31:6800/168281188 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fc4f0051070 con 0x7fc4f8027020 2024-09-22T08:37:41.446 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.423+0000 7fc50af46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:41.446 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.423+0000 7fc50af46800 20 rados->read ofs=0 len=0 2024-09-22T08:37:41.447 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.423+0000 7fc50af46800 1 -- 172.21.15.142:0/3591613122 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cce061b190 con 0x55cce0614650 2024-09-22T08:37:41.447 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.423+0000 7fc509238640 1 -- 172.21.15.142:0/3591613122 <== osd.3 v2:172.21.15.142:6800/1064901393 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc5000083e0 con 0x55cce0614650 2024-09-22T08:37:41.447 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.423+0000 7fc50af46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:41.447 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.423+0000 7fc50af46800 20 rados->read ofs=0 len=0 2024-09-22T08:37:41.447 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.423+0000 7fc50af46800 1 -- 172.21.15.142:0/3591613122 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cce061b530 con 0x55cce0614650 2024-09-22T08:37:41.447 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.423+0000 7fc509238640 1 -- 172.21.15.142:0/3591613122 <== osd.3 v2:172.21.15.142:6800/1064901393 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc5000083e0 con 0x55cce0614650 2024-09-22T08:37:41.447 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.423+0000 7fc50af46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:41.447 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.423+0000 7fc50af46800 20 started sync module instance, tier type = 2024-09-22T08:37:41.447 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.423+0000 7fc50af46800 20 started zone id=e239248c-0bee-4e41-803a-24b288d3eb8f (name=default) with tier type = 2024-09-22T08:37:41.447 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.423+0000 7fc50af46800 1 -- 172.21.15.142:0/3591613122 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cce061a5d0 con 0x7fc500021020 2024-09-22T08:37:41.447 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.424+0000 7fc508a37640 1 -- 172.21.15.142:0/3591613122 <== osd.2 v2:172.21.15.142:6808/279438927 7 ==== osd_op_reply(44 notify.0 [create] v32'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4f800f030 con 0x7fc500021020 2024-09-22T08:37:41.447 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.424+0000 7fc50af46800 1 -- 172.21.15.142:0/3591613122 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94338426183968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cce061b990 con 0x7fc500021020 2024-09-22T08:37:41.447 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.424+0000 7fc50af46800 1 -- 172.21.15.142:0/3591613122 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cce061c1e0 con 0x55cce060fc70 2024-09-22T08:37:41.447 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.425+0000 7fc508a37640 1 -- 172.21.15.142:0/3591613122 <== osd.2 v2:172.21.15.142:6808/279438927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94338426183968] v32'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4f800f030 con 0x7fc500021020 2024-09-22T08:37:41.448 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.425+0000 7fc508236640 1 -- 172.21.15.142:0/3591613122 <== osd.1 v2:172.21.15.142:6816/3192108003 16 ==== osd_op_reply(46 notify.1 [create] v32'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4f0051070 con 0x55cce060fc70 2024-09-22T08:37:41.448 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.425+0000 7fc50af46800 1 -- 172.21.15.142:0/3591613122 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94338426191152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cce061c600 con 0x55cce060fc70 2024-09-22T08:37:41.448 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.425+0000 7fc50af46800 1 -- 172.21.15.142:0/3591613122 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cce061cfc0 con 0x55cce0614650 2024-09-22T08:37:41.448 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.427+0000 7fc508236640 1 -- 172.21.15.142:0/3591613122 <== osd.1 v2:172.21.15.142:6816/3192108003 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94338426191152] v32'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4f0051070 con 0x55cce060fc70 2024-09-22T08:37:41.448 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.427+0000 7fc509238640 1 -- 172.21.15.142:0/3591613122 <== osd.3 v2:172.21.15.142:6800/1064901393 14 ==== osd_op_reply(48 notify.2 [create] v32'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc5000083e0 con 0x55cce0614650 2024-09-22T08:37:41.448 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.427+0000 7fc50af46800 1 -- 172.21.15.142:0/3591613122 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94338426192688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cce061cfc0 con 0x55cce0614650 2024-09-22T08:37:41.448 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.427+0000 7fc50af46800 1 -- 172.21.15.142:0/3591613122 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cce061d9c0 con 0x7fc500021020 2024-09-22T08:37:41.462 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.428+0000 7fc508a37640 1 -- 172.21.15.142:0/3591613122 <== osd.2 v2:172.21.15.142:6808/279438927 9 ==== osd_op_reply(50 notify.3 [create] v32'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4f800f030 con 0x7fc500021020 2024-09-22T08:37:41.462 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.428+0000 7fc50af46800 1 -- 172.21.15.142:0/3591613122 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94338426197200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cce061e260 con 0x7fc500021020 2024-09-22T08:37:41.462 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.428+0000 7fc50af46800 1 -- 172.21.15.142:0/3591613122 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cce061ed00 con 0x55cce060fc70 2024-09-22T08:37:41.462 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.428+0000 7fc509238640 1 -- 172.21.15.142:0/3591613122 <== osd.3 v2:172.21.15.142:6800/1064901393 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94338426192688] v32'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc5000083e0 con 0x55cce0614650 2024-09-22T08:37:41.462 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.429+0000 7fc508a37640 1 -- 172.21.15.142:0/3591613122 <== osd.2 v2:172.21.15.142:6808/279438927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94338426197200] v32'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4f800f030 con 0x7fc500021020 2024-09-22T08:37:41.462 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.429+0000 7fc508236640 1 -- 172.21.15.142:0/3591613122 <== osd.1 v2:172.21.15.142:6816/3192108003 18 ==== osd_op_reply(52 notify.4 [create] v32'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4f0051070 con 0x55cce060fc70 2024-09-22T08:37:41.462 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.429+0000 7fc50af46800 1 -- 172.21.15.142:0/3591613122 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94338426202096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cce061ddb0 con 0x55cce060fc70 2024-09-22T08:37:41.462 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.429+0000 7fc50af46800 1 -- 172.21.15.142:0/3591613122 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cce061f5d0 con 0x7fc4f8027020 2024-09-22T08:37:41.462 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.430+0000 7fc508236640 1 -- 172.21.15.142:0/3591613122 <== osd.0 v2:172.21.15.31:6800/168281188 10 ==== osd_op_reply(54 notify.5 [create] v32'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4f0051070 con 0x7fc4f8027020 2024-09-22T08:37:41.463 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.430+0000 7fc50af46800 1 -- 172.21.15.142:0/3591613122 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94338426204208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cce061f900 con 0x7fc4f8027020 2024-09-22T08:37:41.463 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.430+0000 7fc50af46800 1 -- 172.21.15.142:0/3591613122 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cce06202c0 con 0x7fc4f8027020 2024-09-22T08:37:41.463 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.431+0000 7fc508236640 1 -- 172.21.15.142:0/3591613122 <== osd.1 v2:172.21.15.142:6816/3192108003 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94338426202096] v32'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4f0051070 con 0x55cce060fc70 2024-09-22T08:37:41.463 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.431+0000 7fc508236640 1 -- 172.21.15.142:0/3591613122 <== osd.0 v2:172.21.15.31:6800/168281188 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94338426204208] v32'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4f0051070 con 0x7fc4f8027020 2024-09-22T08:37:41.463 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.431+0000 7fc508236640 1 -- 172.21.15.142:0/3591613122 <== osd.0 v2:172.21.15.31:6800/168281188 12 ==== osd_op_reply(56 notify.6 [create] v32'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4f0051070 con 0x7fc4f8027020 2024-09-22T08:37:41.463 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.431+0000 7fc50af46800 1 -- 172.21.15.142:0/3591613122 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94338426205264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cce061f870 con 0x7fc4f8027020 2024-09-22T08:37:41.463 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.432+0000 7fc50af46800 1 -- 172.21.15.142:0/3591613122 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cce0620770 con 0x7fc4f8027020 2024-09-22T08:37:41.463 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.433+0000 7fc508236640 1 -- 172.21.15.142:0/3591613122 <== osd.0 v2:172.21.15.31:6800/168281188 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94338426205264] v32'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4f0051070 con 0x7fc4f8027020 2024-09-22T08:37:41.463 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.433+0000 7fc508236640 1 -- 172.21.15.142:0/3591613122 <== osd.0 v2:172.21.15.31:6800/168281188 14 ==== osd_op_reply(58 notify.7 [create] v32'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4f0051070 con 0x7fc4f8027020 2024-09-22T08:37:41.463 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.433+0000 7fc50af46800 1 -- 172.21.15.142:0/3591613122 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94338426207760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cce06206e0 con 0x7fc4f8027020 2024-09-22T08:37:41.463 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.433+0000 7fc50af46800 20 add_watcher() i=0 2024-09-22T08:37:41.463 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.433+0000 7fc50af46800 20 add_watcher() i=1 2024-09-22T08:37:41.463 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.433+0000 7fc50af46800 20 add_watcher() i=2 2024-09-22T08:37:41.463 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.433+0000 7fc50af46800 20 add_watcher() i=3 2024-09-22T08:37:41.464 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.433+0000 7fc50af46800 20 add_watcher() i=4 2024-09-22T08:37:41.464 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.433+0000 7fc50af46800 20 add_watcher() i=5 2024-09-22T08:37:41.464 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.433+0000 7fc50af46800 20 add_watcher() i=6 2024-09-22T08:37:41.464 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.435+0000 7fc508236640 1 -- 172.21.15.142:0/3591613122 <== osd.0 v2:172.21.15.31:6800/168281188 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94338426207760] v32'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4f0051070 con 0x7fc4f8027020 2024-09-22T08:37:41.464 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.435+0000 7fc50af46800 20 add_watcher() i=7 2024-09-22T08:37:41.464 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.435+0000 7fc50af46800 2 all 8 watchers are set, enabling cache 2024-09-22T08:37:41.464 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.435+0000 7fc50af46800 1 -- 172.21.15.142:0/3591613122 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cce0623bc0 con 0x55cce060fc70 2024-09-22T08:37:41.464 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.435+0000 7fc508236640 1 -- 172.21.15.142:0/3591613122 <== osd.1 v2:172.21.15.142:6816/3192108003 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fc4f0051070 con 0x55cce060fc70 2024-09-22T08:37:41.464 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.435+0000 7fc50af46800 1 -- 172.21.15.142:0/3591613122 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94338426209744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cce0620f60 con 0x55cce060fc70 2024-09-22T08:37:41.464 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.436+0000 7fc508236640 1 -- 172.21.15.142:0/3591613122 <== osd.1 v2:172.21.15.142:6816/3192108003 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94338426209744] v32'198 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc4f0051070 con 0x55cce060fc70 2024-09-22T08:37:41.464 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.436+0000 7fc3befe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:37:41.464 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.436+0000 7fc50af46800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:37:41.464 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.436+0000 7fc50af46800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:37:41.465 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.436+0000 7fc50af46800 5 note: GC not initialized 2024-09-22T08:37:41.465 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.437+0000 7fc3bdfe3640 20 reqs_thread_entry: start 2024-09-22T08:37:41.465 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.437+0000 7fc50af46800 20 init_complete bucket index max shards: 11 2024-09-22T08:37:41.465 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.437+0000 7fc50af46800 20 Filter name: none 2024-09-22T08:37:41.465 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.437+0000 7fc32f7fe640 20 reqs_thread_entry: start 2024-09-22T08:37:41.465 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.437+0000 7fc50af46800 1 -- 172.21.15.142:0/3591613122 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:62 6.e 6:74cd889a:usage::usage.0:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cce06574c0 con 0x55cce060fc70 2024-09-22T08:37:41.465 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.437+0000 7fc508236640 1 -- 172.21.15.142:0/3591613122 <== osd.1 v2:172.21.15.142:6816/3192108003 22 ==== osd_op_reply(62 usage.0 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fc4f0051070 con 0x55cce060fc70 2024-09-22T08:37:41.465 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.437+0000 7fc50af46800 1 -- 172.21.15.142:0/3591613122 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:63 6.3 6:c0e78a64:usage::usage.1:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cce06574c0 con 0x7fc500021020 2024-09-22T08:37:41.465 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.437+0000 7fc508a37640 1 -- 172.21.15.142:0/3591613122 <== osd.2 v2:172.21.15.142:6808/279438927 11 ==== osd_op_reply(63 usage.1 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fc4f800f030 con 0x7fc500021020 2024-09-22T08:37:41.465 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.437+0000 7fc50af46800 1 -- 172.21.15.142:0/3591613122 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:64 6.d 6:b564efa4:usage::usage.2:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cce0657940 con 0x55cce060fc70 2024-09-22T08:37:41.465 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.438+0000 7fc508236640 1 -- 172.21.15.142:0/3591613122 <== osd.1 v2:172.21.15.142:6816/3192108003 23 ==== osd_op_reply(64 usage.2 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fc4f0051070 con 0x55cce060fc70 2024-09-22T08:37:41.465 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.438+0000 7fc50af46800 1 -- 172.21.15.142:0/3591613122 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:65 6.2 6:42d64401:usage::usage.3:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cce0657940 con 0x55cce0614650 2024-09-22T08:37:41.465 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.438+0000 7fc509238640 1 -- 172.21.15.142:0/3591613122 <== osd.3 v2:172.21.15.142:6800/1064901393 16 ==== osd_op_reply(65 usage.3 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fc5000083e0 con 0x55cce0614650 2024-09-22T08:37:41.465 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.438+0000 7fc50af46800 1 -- 172.21.15.142:0/3591613122 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:66 6.7 6:e09b6f01:usage::usage.4:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cce0657940 con 0x55cce0614650 2024-09-22T08:37:41.466 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.438+0000 7fc509238640 1 -- 172.21.15.142:0/3591613122 <== osd.3 v2:172.21.15.142:6800/1064901393 17 ==== osd_op_reply(66 usage.4 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fc5000083e0 con 0x55cce0614650 2024-09-22T08:37:41.466 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.438+0000 7fc50af46800 1 -- 172.21.15.142:0/3591613122 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:67 6.6 6:672810f1:usage::usage.5:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cce0657940 con 0x55cce0614650 2024-09-22T08:37:41.466 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.438+0000 7fc509238640 1 -- 172.21.15.142:0/3591613122 <== osd.3 v2:172.21.15.142:6800/1064901393 18 ==== osd_op_reply(67 usage.5 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fc5000083e0 con 0x55cce0614650 2024-09-22T08:37:41.466 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.438+0000 7fc50af46800 1 -- 172.21.15.142:0/3591613122 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:68 6.4 6:25a86931:usage::usage.6:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cce0657940 con 0x55cce060fc70 2024-09-22T08:37:41.466 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.439+0000 7fc508236640 1 -- 172.21.15.142:0/3591613122 <== osd.1 v2:172.21.15.142:6816/3192108003 24 ==== osd_op_reply(68 usage.6 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fc4f0051070 con 0x55cce060fc70 2024-09-22T08:37:41.466 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.439+0000 7fc50af46800 1 -- 172.21.15.142:0/3591613122 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:69 6.17 6:ebbe7322:usage::usage.7:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cce0657940 con 0x55cce060fc70 2024-09-22T08:37:41.466 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.439+0000 7fc508236640 1 -- 172.21.15.142:0/3591613122 <== osd.1 v2:172.21.15.142:6816/3192108003 25 ==== osd_op_reply(69 usage.7 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fc4f0051070 con 0x55cce060fc70 2024-09-22T08:37:41.466 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.439+0000 7fc50af46800 1 -- 172.21.15.142:0/3591613122 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:70 6.6 6:607e1922:usage::usage.8:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cce0657940 con 0x55cce0614650 2024-09-22T08:37:41.466 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.439+0000 7fc509238640 1 -- 172.21.15.142:0/3591613122 <== osd.3 v2:172.21.15.142:6800/1064901393 19 ==== osd_op_reply(70 usage.8 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fc5000083e0 con 0x55cce0614650 2024-09-22T08:37:41.466 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.439+0000 7fc50af46800 1 -- 172.21.15.142:0/3591613122 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:71 6.b 6:d7809252:usage::usage.9:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cce0657940 con 0x55cce0614650 2024-09-22T08:37:41.466 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.439+0000 7fc509238640 1 -- 172.21.15.142:0/3591613122 <== osd.3 v2:172.21.15.142:6800/1064901393 20 ==== osd_op_reply(71 usage.9 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fc5000083e0 con 0x55cce0614650 2024-09-22T08:37:41.467 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.439+0000 7fc50af46800 1 -- 172.21.15.142:0/3591613122 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:72 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cce0657940 con 0x7fc4f8027020 2024-09-22T08:37:41.467 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.440+0000 7fc508236640 1 -- 172.21.15.142:0/3591613122 <== osd.0 v2:172.21.15.31:6800/168281188 16 ==== osd_op_reply(72 usage.10 [call out=1378b] v0'0 uv29 ondisk = 0) ==== 152+0+1378 (crc 0 0 0) 0x7fc4f0051070 con 0x7fc4f8027020 2024-09-22T08:37:41.467 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.440+0000 7fc50af46800 1 -- 172.21.15.142:0/3591613122 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:73 6.4 6:21f845ae:usage::usage.11:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cce0658e00 con 0x55cce060fc70 2024-09-22T08:37:41.467 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.440+0000 7fc508236640 1 -- 172.21.15.142:0/3591613122 <== osd.1 v2:172.21.15.142:6816/3192108003 26 ==== osd_op_reply(73 usage.11 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fc4f0051070 con 0x55cce060fc70 2024-09-22T08:37:41.467 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.440+0000 7fc50af46800 1 -- 172.21.15.142:0/3591613122 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:74 6.f 6:f0386354:usage::usage.12:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cce0658e00 con 0x7fc500021020 2024-09-22T08:37:41.467 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.440+0000 7fc508a37640 1 -- 172.21.15.142:0/3591613122 <== osd.2 v2:172.21.15.142:6808/279438927 12 ==== osd_op_reply(74 usage.12 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fc4f800f030 con 0x7fc500021020 2024-09-22T08:37:41.467 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.440+0000 7fc50af46800 1 -- 172.21.15.142:0/3591613122 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:75 6.c 6:3735eec4:usage::usage.13:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cce0658e00 con 0x55cce0614650 2024-09-22T08:37:41.467 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.440+0000 7fc509238640 1 -- 172.21.15.142:0/3591613122 <== osd.3 v2:172.21.15.142:6800/1064901393 21 ==== osd_op_reply(75 usage.13 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fc5000083e0 con 0x55cce0614650 2024-09-22T08:37:41.468 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.440+0000 7fc50af46800 1 -- 172.21.15.142:0/3591613122 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:76 6.18 6:1f520d0a:usage::usage.14:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cce0658e00 con 0x7fc4f8027020 2024-09-22T08:37:41.468 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.441+0000 7fc508236640 1 -- 172.21.15.142:0/3591613122 <== osd.0 v2:172.21.15.31:6800/168281188 17 ==== osd_op_reply(76 usage.14 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fc4f0051070 con 0x7fc4f8027020 2024-09-22T08:37:41.468 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.441+0000 7fc50af46800 1 -- 172.21.15.142:0/3591613122 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:77 6.0 6:029cee12:usage::usage.15:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cce0658e00 con 0x7fc4f8027020 2024-09-22T08:37:41.468 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.441+0000 7fc508236640 1 -- 172.21.15.142:0/3591613122 <== osd.0 v2:172.21.15.31:6800/168281188 18 ==== osd_op_reply(77 usage.15 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fc4f0051070 con 0x7fc4f8027020 2024-09-22T08:37:41.468 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.441+0000 7fc50af46800 1 -- 172.21.15.142:0/3591613122 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:78 6.1e 6:7f3e030e:usage::usage.16:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cce0658e00 con 0x55cce0614650 2024-09-22T08:37:41.468 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.441+0000 7fc509238640 1 -- 172.21.15.142:0/3591613122 <== osd.3 v2:172.21.15.142:6800/1064901393 22 ==== osd_op_reply(78 usage.16 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fc5000083e0 con 0x55cce0614650 2024-09-22T08:37:41.468 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.441+0000 7fc50af46800 1 -- 172.21.15.142:0/3591613122 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:79 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cce0658e00 con 0x7fc4f8027020 2024-09-22T08:37:41.468 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.441+0000 7fc508236640 1 -- 172.21.15.142:0/3591613122 <== osd.0 v2:172.21.15.31:6800/168281188 19 ==== osd_op_reply(79 usage.17 [call out=185b] v0'0 uv5 ondisk = 0) ==== 152+0+185 (crc 0 0 0) 0x7fc4f0051070 con 0x7fc4f8027020 2024-09-22T08:37:41.468 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.442+0000 7fc50af46800 1 -- 172.21.15.142:0/3591613122 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:80 6.19 6:993b03e9:usage::usage.18:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cce0658e00 con 0x55cce060fc70 2024-09-22T08:37:41.468 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.442+0000 7fc508236640 1 -- 172.21.15.142:0/3591613122 <== osd.1 v2:172.21.15.142:6816/3192108003 27 ==== osd_op_reply(80 usage.18 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fc4f0051070 con 0x55cce060fc70 2024-09-22T08:37:41.468 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.442+0000 7fc50af46800 1 -- 172.21.15.142:0/3591613122 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:81 6.1a 6:58fcd270:usage::usage.19:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cce0658e00 con 0x55cce0614650 2024-09-22T08:37:41.468 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.442+0000 7fc509238640 1 -- 172.21.15.142:0/3591613122 <== osd.3 v2:172.21.15.142:6800/1064901393 23 ==== osd_op_reply(81 usage.19 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fc5000083e0 con 0x55cce0614650 2024-09-22T08:37:41.469 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.442+0000 7fc50af46800 1 -- 172.21.15.142:0/3591613122 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:82 6.1f 6:fcd63d49:usage::usage.20:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cce0658e00 con 0x7fc4f8027020 2024-09-22T08:37:41.469 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.442+0000 7fc508236640 1 -- 172.21.15.142:0/3591613122 <== osd.0 v2:172.21.15.31:6800/168281188 20 ==== osd_op_reply(82 usage.20 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fc4f0051070 con 0x7fc4f8027020 2024-09-22T08:37:41.469 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.442+0000 7fc50af46800 1 -- 172.21.15.142:0/3591613122 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:83 6.5 6:a2c1a412:usage::usage.21:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cce0658e00 con 0x7fc500021020 2024-09-22T08:37:41.469 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.442+0000 7fc508a37640 1 -- 172.21.15.142:0/3591613122 <== osd.2 v2:172.21.15.142:6808/279438927 13 ==== osd_op_reply(83 usage.21 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fc4f800f030 con 0x7fc500021020 2024-09-22T08:37:41.469 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.443+0000 7fc50af46800 1 -- 172.21.15.142:0/3591613122 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:84 6.13 6:cdb71d68:usage::usage.22:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cce0658e00 con 0x7fc4f8027020 2024-09-22T08:37:41.469 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.443+0000 7fc508236640 1 -- 172.21.15.142:0/3591613122 <== osd.0 v2:172.21.15.31:6800/168281188 21 ==== osd_op_reply(84 usage.22 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fc4f0051070 con 0x7fc4f8027020 2024-09-22T08:37:41.469 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.443+0000 7fc50af46800 1 -- 172.21.15.142:0/3591613122 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:85 6.17 6:ef3bca03:usage::usage.23:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cce0658e00 con 0x55cce060fc70 2024-09-22T08:37:41.469 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.443+0000 7fc508236640 1 -- 172.21.15.142:0/3591613122 <== osd.1 v2:172.21.15.142:6816/3192108003 28 ==== osd_op_reply(85 usage.23 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fc4f0051070 con 0x55cce060fc70 2024-09-22T08:37:41.469 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.443+0000 7fc50af46800 1 -- 172.21.15.142:0/3591613122 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:86 6.e 6:7412960a:usage::usage.24:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cce0658e00 con 0x55cce060fc70 2024-09-22T08:37:41.469 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.443+0000 7fc508236640 1 -- 172.21.15.142:0/3591613122 <== osd.1 v2:172.21.15.142:6816/3192108003 29 ==== osd_op_reply(86 usage.24 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fc4f0051070 con 0x55cce060fc70 2024-09-22T08:37:41.469 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.443+0000 7fc50af46800 1 -- 172.21.15.142:0/3591613122 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:87 6.7 6:e62d1024:usage::usage.25:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cce0658e00 con 0x55cce0614650 2024-09-22T08:37:41.469 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.443+0000 7fc509238640 1 -- 172.21.15.142:0/3591613122 <== osd.3 v2:172.21.15.142:6800/1064901393 24 ==== osd_op_reply(87 usage.25 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fc5000083e0 con 0x55cce0614650 2024-09-22T08:37:41.469 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.443+0000 7fc50af46800 1 -- 172.21.15.142:0/3591613122 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:88 6.d 6:b172cd59:usage::usage.26:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cce0658e00 con 0x55cce060fc70 2024-09-22T08:37:41.469 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.444+0000 7fc508236640 1 -- 172.21.15.142:0/3591613122 <== osd.1 v2:172.21.15.142:6816/3192108003 30 ==== osd_op_reply(88 usage.26 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fc4f0051070 con 0x55cce060fc70 2024-09-22T08:37:41.470 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.444+0000 7fc50af46800 1 -- 172.21.15.142:0/3591613122 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:89 6.1 6:83912023:usage::usage.27:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cce0658e00 con 0x55cce060fc70 2024-09-22T08:37:41.470 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.444+0000 7fc508236640 1 -- 172.21.15.142:0/3591613122 <== osd.1 v2:172.21.15.142:6816/3192108003 31 ==== osd_op_reply(89 usage.27 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fc4f0051070 con 0x55cce060fc70 2024-09-22T08:37:41.470 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.444+0000 7fc50af46800 1 -- 172.21.15.142:0/3591613122 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:90 6.1e 6:7c73bdb3:usage::usage.28:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cce0658e00 con 0x55cce0614650 2024-09-22T08:37:41.470 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.444+0000 7fc509238640 1 -- 172.21.15.142:0/3591613122 <== osd.3 v2:172.21.15.142:6800/1064901393 25 ==== osd_op_reply(90 usage.28 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fc5000083e0 con 0x55cce0614650 2024-09-22T08:37:41.470 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.444+0000 7fc50af46800 1 -- 172.21.15.142:0/3591613122 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:91 6.16 6:6e59fa35:usage::usage.29:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cce0658e00 con 0x55cce0614650 2024-09-22T08:37:41.470 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.444+0000 7fc509238640 1 -- 172.21.15.142:0/3591613122 <== osd.3 v2:172.21.15.142:6800/1064901393 26 ==== osd_op_reply(91 usage.29 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fc5000083e0 con 0x55cce0614650 2024-09-22T08:37:41.470 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.444+0000 7fc50af46800 1 -- 172.21.15.142:0/3591613122 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:92 6.1c 6:38fe6885:usage::usage.30:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cce0658e00 con 0x55cce0614650 2024-09-22T08:37:41.470 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.444+0000 7fc509238640 1 -- 172.21.15.142:0/3591613122 <== osd.3 v2:172.21.15.142:6800/1064901393 27 ==== osd_op_reply(92 usage.30 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fc5000083e0 con 0x55cce0614650 2024-09-22T08:37:41.470 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.444+0000 7fc50af46800 1 -- 172.21.15.142:0/3591613122 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:93 6.1d 6:bb28dff0:usage::usage.31:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cce0658e00 con 0x7fc4f8027020 2024-09-22T08:37:41.470 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.445+0000 7fc508236640 1 -- 172.21.15.142:0/3591613122 <== osd.0 v2:172.21.15.31:6800/168281188 22 ==== osd_op_reply(93 usage.31 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fc4f0051070 con 0x7fc4f8027020 2024-09-22T08:37:41.470 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.446+0000 7fc3befe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:37:41.470 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.446+0000 7fc50af46800 1 -- 172.21.15.142:0/3591613122 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94338426209744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cce0622430 con 0x55cce060fc70 2024-09-22T08:37:41.470 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.447+0000 7fc508236640 1 -- 172.21.15.142:0/3591613122 <== osd.1 v2:172.21.15.142:6816/3192108003 32 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94338426209744] v32'199 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc4f0051070 con 0x55cce060fc70 2024-09-22T08:37:41.471 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.447+0000 7fc50af46800 1 -- 172.21.15.142:0/3591613122 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94338426183968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cce06205d0 con 0x7fc500021020 2024-09-22T08:37:41.471 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.448+0000 7fc508a37640 1 -- 172.21.15.142:0/3591613122 <== osd.2 v2:172.21.15.142:6808/279438927 14 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94338426183968] v32'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4f800f030 con 0x7fc500021020 2024-09-22T08:37:41.471 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.448+0000 7fc50af46800 20 remove_watcher() i=0 2024-09-22T08:37:41.471 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.448+0000 7fc50af46800 2 removed watcher, disabling cache 2024-09-22T08:37:41.471 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.448+0000 7fc50af46800 1 -- 172.21.15.142:0/3591613122 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94338426191152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cce06205d0 con 0x55cce060fc70 2024-09-22T08:37:41.471 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.449+0000 7fc508236640 1 -- 172.21.15.142:0/3591613122 <== osd.1 v2:172.21.15.142:6816/3192108003 33 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94338426191152] v32'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4f0051070 con 0x55cce060fc70 2024-09-22T08:37:41.471 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.449+0000 7fc50af46800 20 remove_watcher() i=1 2024-09-22T08:37:41.471 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.449+0000 7fc50af46800 1 -- 172.21.15.142:0/3591613122 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94338426192688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cce061bd30 con 0x55cce0614650 2024-09-22T08:37:41.471 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.450+0000 7fc509238640 1 -- 172.21.15.142:0/3591613122 <== osd.3 v2:172.21.15.142:6800/1064901393 28 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94338426192688] v32'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc5000083e0 con 0x55cce0614650 2024-09-22T08:37:41.471 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.450+0000 7fc50af46800 20 remove_watcher() i=2 2024-09-22T08:37:41.471 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.450+0000 7fc50af46800 1 -- 172.21.15.142:0/3591613122 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94338426197200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cce06205d0 con 0x7fc500021020 2024-09-22T08:37:41.471 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.451+0000 7fc508a37640 1 -- 172.21.15.142:0/3591613122 <== osd.2 v2:172.21.15.142:6808/279438927 15 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94338426197200] v32'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4f800f030 con 0x7fc500021020 2024-09-22T08:37:41.471 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.451+0000 7fc50af46800 20 remove_watcher() i=3 2024-09-22T08:37:41.472 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.451+0000 7fc50af46800 1 -- 172.21.15.142:0/3591613122 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94338426202096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cce061c330 con 0x55cce060fc70 2024-09-22T08:37:41.472 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.453+0000 7fc508236640 1 -- 172.21.15.142:0/3591613122 <== osd.1 v2:172.21.15.142:6816/3192108003 34 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94338426202096] v32'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4f0051070 con 0x55cce060fc70 2024-09-22T08:37:41.472 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.453+0000 7fc50af46800 20 remove_watcher() i=4 2024-09-22T08:37:41.472 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.453+0000 7fc50af46800 1 -- 172.21.15.142:0/3591613122 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94338426204208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cce061bd30 con 0x7fc4f8027020 2024-09-22T08:37:41.472 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.454+0000 7fc508236640 1 -- 172.21.15.142:0/3591613122 <== osd.0 v2:172.21.15.31:6800/168281188 23 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94338426204208] v32'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4f0051070 con 0x7fc4f8027020 2024-09-22T08:37:41.472 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.454+0000 7fc50af46800 20 remove_watcher() i=5 2024-09-22T08:37:41.472 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.454+0000 7fc50af46800 1 -- 172.21.15.142:0/3591613122 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94338426205264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cce06205d0 con 0x7fc4f8027020 2024-09-22T08:37:41.472 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.455+0000 7fc508236640 1 -- 172.21.15.142:0/3591613122 <== osd.0 v2:172.21.15.31:6800/168281188 24 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94338426205264] v32'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4f0051070 con 0x7fc4f8027020 2024-09-22T08:37:41.472 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.455+0000 7fc50af46800 20 remove_watcher() i=6 2024-09-22T08:37:41.472 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.455+0000 7fc50af46800 1 -- 172.21.15.142:0/3591613122 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94338426207760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cce06205d0 con 0x7fc4f8027020 2024-09-22T08:37:41.472 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.456+0000 7fc508236640 1 -- 172.21.15.142:0/3591613122 <== osd.0 v2:172.21.15.31:6800/168281188 25 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94338426207760] v32'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4f0051070 con 0x7fc4f8027020 2024-09-22T08:37:41.472 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.456+0000 7fc50af46800 20 remove_watcher() i=7 2024-09-22T08:37:41.472 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.456+0000 7fc50af46800 1 -- 172.21.15.142:0/3591613122 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7fc4f8027020 msgr2=0x7fc4f803e050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:41.473 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.456+0000 7fc50af46800 1 --2- 172.21.15.142:0/3591613122 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7fc4f8027020 0x7fc4f803e050 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:41.473 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.456+0000 7fc50af46800 1 -- 172.21.15.142:0/3591613122 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55cce060fc70 msgr2=0x55cce0612100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:41.473 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.456+0000 7fc50af46800 1 --2- 172.21.15.142:0/3591613122 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55cce060fc70 0x55cce0612100 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:41.473 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.456+0000 7fc50af46800 1 -- 172.21.15.142:0/3591613122 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7fc500021020 msgr2=0x7fc50003ba90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:41.473 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.456+0000 7fc50af46800 1 --2- 172.21.15.142:0/3591613122 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7fc500021020 0x7fc50003ba90 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:41.473 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.456+0000 7fc50af46800 1 -- 172.21.15.142:0/3591613122 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55cce0614650 msgr2=0x55cce0616a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:41.473 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.456+0000 7fc50af46800 1 --2- 172.21.15.142:0/3591613122 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55cce0614650 0x55cce0616a40 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:41.473 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.456+0000 7fc50af46800 1 -- 172.21.15.142:0/3591613122 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fc3d403cf60 msgr2=0x7fc3d403f420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:41.473 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.456+0000 7fc50af46800 1 --2- 172.21.15.142:0/3591613122 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fc3d403cf60 0x7fc3d403f420 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fc4f8012f70 tx=0x7fc4f8052f90 comp rx=0 tx=0).stop 2024-09-22T08:37:41.473 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.456+0000 7fc508236640 1 -- 172.21.15.142:0/3591613122 reap_dead start 2024-09-22T08:37:41.473 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.456+0000 7fc50af46800 1 -- 172.21.15.142:0/3591613122 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cce05fcd40 msgr2=0x55cce0604340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:41.473 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.456+0000 7fc50af46800 1 --2- 172.21.15.142:0/3591613122 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cce05fcd40 0x55cce0604340 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fc5000206f0 tx=0x7fc500053d50 comp rx=0 tx=0).stop 2024-09-22T08:37:41.473 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.456+0000 7fc50af46800 1 -- 172.21.15.142:0/3591613122 shutdown_connections 2024-09-22T08:37:41.473 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.456+0000 7fc50af46800 1 --2- 172.21.15.142:0/3591613122 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cce05fcd40 0x55cce0604340 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:41.474 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.456+0000 7fc50af46800 1 -- 172.21.15.142:0/3591613122 >> 172.21.15.142:0/3591613122 conn(0x55cce05f9160 msgr2=0x55cce05f7370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:37:41.474 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.456+0000 7fc50af46800 1 -- 172.21.15.142:0/3591613122 shutdown_connections 2024-09-22T08:37:41.474 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.456+0000 7fc50af46800 1 -- 172.21.15.142:0/3591613122 wait complete. 2024-09-22T08:37:41.474 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.457+0000 7fc50af46800 1 -- 172.21.15.142:0/1941047511 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fc3e003cfb0 msgr2=0x7fc3e003f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:41.474 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.457+0000 7fc50af46800 1 --2- 172.21.15.142:0/1941047511 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fc3e003cfb0 0x7fc3e003f470 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fc4f8052770 tx=0x7fc4f8026ed0 comp rx=0 tx=0).stop 2024-09-22T08:37:41.474 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.457+0000 7fc50af46800 1 -- 172.21.15.142:0/1941047511 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cce05f0300 msgr2=0x55cce05f0720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:41.474 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.457+0000 7fc50af46800 1 --2- 172.21.15.142:0/1941047511 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cce05f0300 0x55cce05f0720 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x55cce05ca3e0 tx=0x7fc50000bf30 comp rx=0 tx=0).stop 2024-09-22T08:37:41.474 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.457+0000 7fc50af46800 1 -- 172.21.15.142:0/1941047511 shutdown_connections 2024-09-22T08:37:41.474 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.457+0000 7fc50af46800 1 --2- 172.21.15.142:0/1941047511 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fc3e003cfb0 0x7fc3e003f470 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:41.474 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.457+0000 7fc50af46800 1 --2- 172.21.15.142:0/1941047511 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cce05f0300 0x55cce05f0720 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:41.474 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.457+0000 7fc50af46800 1 -- 172.21.15.142:0/1941047511 >> 172.21.15.142:0/1941047511 conn(0x55cce05e46b0 msgr2=0x55cce05e4a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:37:41.474 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.457+0000 7fc50af46800 1 -- 172.21.15.142:0/1941047511 shutdown_connections 2024-09-22T08:37:41.474 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.457+0000 7fc50af46800 1 -- 172.21.15.142:0/1941047511 wait complete. 2024-09-22T08:37:41.475 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.457+0000 7fc50af46800 1 -- 172.21.15.142:0/2673085935 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55cce05da2a0 msgr2=0x55cce05dc690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:41.475 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.457+0000 7fc50af46800 1 --2- 172.21.15.142:0/2673085935 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55cce05da2a0 0x55cce05dc690 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:41.475 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.457+0000 7fc50af46800 1 -- 172.21.15.142:0/2673085935 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55cce05deea0 msgr2=0x55cce05e1290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:41.475 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.457+0000 7fc50af46800 1 --2- 172.21.15.142:0/2673085935 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55cce05deea0 0x55cce05e1290 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:41.475 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.457+0000 7fc50af46800 1 -- 172.21.15.142:0/2673085935 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fc3f003cfb0 msgr2=0x7fc3f003f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:41.475 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.457+0000 7fc50af46800 1 --2- 172.21.15.142:0/2673085935 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fc3f003cfb0 0x7fc3f003f470 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fc4f0057000 tx=0x7fc4f0052000 comp rx=0 tx=0).stop 2024-09-22T08:37:41.475 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.457+0000 7fc50af46800 1 -- 172.21.15.142:0/2673085935 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cce04de8e0 msgr2=0x55cce05cb2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:41.475 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.457+0000 7fc50af46800 1 --2- 172.21.15.142:0/2673085935 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cce04de8e0 0x55cce05cb2f0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x55cce04d9b10 tx=0x7fc4f8000f40 comp rx=0 tx=0).stop 2024-09-22T08:37:41.475 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.457+0000 7fc50af46800 1 -- 172.21.15.142:0/2673085935 shutdown_connections 2024-09-22T08:37:41.475 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.457+0000 7fc50af46800 1 --2- 172.21.15.142:0/2673085935 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55cce05deea0 0x55cce05e1290 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:41.475 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.457+0000 7fc50af46800 1 --2- 172.21.15.142:0/2673085935 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55cce05da2a0 0x55cce05dc690 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:41.475 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.457+0000 7fc50af46800 1 --2- 172.21.15.142:0/2673085935 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fc3f003cfb0 0x7fc3f003f470 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:41.475 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.457+0000 7fc50af46800 1 --2- 172.21.15.142:0/2673085935 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cce04de8e0 0x55cce05cb2f0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:41.475 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.457+0000 7fc50af46800 1 -- 172.21.15.142:0/2673085935 >> 172.21.15.142:0/2673085935 conn(0x55cce04d5300 msgr2=0x55cce05c4090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:37:41.476 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.457+0000 7fc50af46800 1 -- 172.21.15.142:0/2673085935 shutdown_connections 2024-09-22T08:37:41.476 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.457+0000 7fc50af46800 1 -- 172.21.15.142:0/2673085935 wait complete. 2024-09-22T08:37:41.476 INFO:teuthology.orchestra.run.smithi142.stdout:{"entries":[{"user":"anonymous","buckets":[{"bucket":"","time":"2024-09-22T08:00:00.000000Z","epoch":1726992000,"owner":"anonymous","categories":[{"category":"list_buckets","bytes_sent":204,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}}]},{"user":"foo","buckets":[{"bucket":"","time":"2024-09-22T08:00:00.000000Z","epoch":1726992000,"owner":"foo","categories":[{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}},{"bucket":"myfoo","time":"2024-09-22T08:00:00.000000Z","epoch":1726992000,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":5,"successful_ops":5},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":2,"successful_ops":1},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"s3select":{"bytes_processed":0,"bytes_returned":0}},{"bucket":"myfoo2","time":"2024-09-22T08:00:00.000000Z","epoch":1726992000,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}},{"bucket":"myfoo3","time":"2024-09-22T08:00:00.000000Z","epoch":1726992000,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}},{"bucket":"myfoo4","time":"2024-09-22T08:00:00.000000Z","epoch":1726992000,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}}]}],"summary":[{"user":"anonymous","categories":[{"category":"list_buckets","bytes_sent":204,"bytes_received":0,"ops":1,"successful_ops":1}],"total":{"bytes_sent":204,"bytes_received":0,"ops":1,"successful_ops":1,"bytes_processed":0,"bytes_returned":0}},{"user":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"total":{"bytes_sent":2103,"bytes_received":30000042,"ops":35,"successful_ops":34,"bytes_processed":0,"bytes_returned":0}}]} 2024-09-22T08:37:41.477 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-09-22T08:00:00.000000Z', 'epoch': 1726992000, 'owner': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}, {'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-22T08:00:00.000000Z', 'epoch': 1726992000, 'owner': 'foo', 'categories': [{'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo', 'time': '2024-09-22T08:00:00.000000Z', 'epoch': 1726992000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 5, 'successful_ops': 5}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 2, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo2', 'time': '2024-09-22T08:00:00.000000Z', 'epoch': 1726992000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo3', 'time': '2024-09-22T08:00:00.000000Z', 'epoch': 1726992000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo4', 'time': '2024-09-22T08:00:00.000000Z', 'epoch': 1726992000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}], 'summary': [{'user': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 'total': {'bytes_sent': 2103, 'bytes_received': 30000042, 'ops': 35, 'successful_ops': 34, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-22T08:37:41.477 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo'] 2024-09-22T08:37:41.477 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo'] 2024-09-22T08:37:41.477 DEBUG:teuthology.orchestra.run.smithi142:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo 2024-09-22T08:37:41.561 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:37:41.561 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:37:41.562 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.561+0000 7f5f49e2f800 1 Processor -- start 2024-09-22T08:37:41.562 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.561+0000 7f5f49e2f800 1 -- start start 2024-09-22T08:37:41.562 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.561+0000 7f5f49e2f800 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55994a9f27f0 0x55994a9f34f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:41.562 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.561+0000 7f5f49e2f800 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55994a87ea20 con 0x55994a9f3a30 2024-09-22T08:37:41.562 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.561+0000 7f5f49e2f800 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x55994a87e7d0 con 0x55994a9f27f0 2024-09-22T08:37:41.563 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.561+0000 7f5f47919640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55994a9f27f0 0x55994a9f34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:41.563 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.562+0000 7f5f47118640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x55994a9f3a30 0x55994a9f8580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.142:50250/0 (socket says 172.21.15.142:50250) 2024-09-22T08:37:41.563 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.562+0000 7f5f47118640 1 -- 172.21.15.142:0/1597427257 learned_addr learned my addr 172.21.15.142:0/1597427257 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-09-22T08:37:41.563 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.562+0000 7f5f47919640 1 -- 172.21.15.142:0/1597427257 >> v1:172.21.15.31:6789/0 conn(0x55994a9f3a30 legacy=0x55994a9f8580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:41.563 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.562+0000 7f5f47919640 1 -- 172.21.15.142:0/1597427257 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55994a9f2ef0 con 0x55994a9f27f0 2024-09-22T08:37:41.565 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.564+0000 7f5f47919640 1 --2- 172.21.15.142:0/1597427257 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55994a9f27f0 0x55994a9f34f0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f5f3800a470 tx=0x7f5f38045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b759a0e1dd65eb3 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:41.565 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.564+0000 7f5f46917640 1 -- 172.21.15.142:0/1597427257 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f38053570 con 0x55994a9f27f0 2024-09-22T08:37:41.565 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.564+0000 7f5f46917640 1 -- 172.21.15.142:0/1597427257 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f38058070 con 0x55994a9f27f0 2024-09-22T08:37:41.565 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.564+0000 7f5f46917640 1 -- 172.21.15.142:0/1597427257 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f38053880 con 0x55994a9f27f0 2024-09-22T08:37:41.566 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.564+0000 7f5f49e2f800 1 -- 172.21.15.142:0/1597427257 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55994a9f27f0 msgr2=0x55994a9f34f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:41.566 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.564+0000 7f5f49e2f800 1 --2- 172.21.15.142:0/1597427257 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55994a9f27f0 0x55994a9f34f0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f5f3800a470 tx=0x7f5f38045a20 comp rx=0 tx=0).stop 2024-09-22T08:37:41.566 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.564+0000 7f5f49e2f800 1 -- 172.21.15.142:0/1597427257 shutdown_connections 2024-09-22T08:37:41.566 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.564+0000 7f5f49e2f800 1 --2- 172.21.15.142:0/1597427257 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55994a9f27f0 0x55994a9f34f0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:41.566 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.564+0000 7f5f49e2f800 1 -- 172.21.15.142:0/1597427257 >> 172.21.15.142:0/1597427257 conn(0x55994a9edbe0 msgr2=0x55994a9f0020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:37:41.566 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.564+0000 7f5f49e2f800 1 -- 172.21.15.142:0/1597427257 shutdown_connections 2024-09-22T08:37:41.566 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.564+0000 7f5f49e2f800 1 -- 172.21.15.142:0/1597427257 wait complete. 2024-09-22T08:37:41.580 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.578+0000 7f5f49e2f800 1 Processor -- start 2024-09-22T08:37:41.580 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.578+0000 7f5f49e2f800 1 -- start start 2024-09-22T08:37:41.580 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.578+0000 7f5f49e2f800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55994a9f27f0 0x55994aae1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:41.580 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.578+0000 7f5f49e2f800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55994a88bdd0 con 0x55994a9f27f0 2024-09-22T08:37:41.580 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.579+0000 7f5f47919640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55994a9f27f0 0x55994aae1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:41.580 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.579+0000 7f5f47919640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55994a9f27f0 0x55994aae1ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:55614/0 (socket says 172.21.15.142:55614) 2024-09-22T08:37:41.580 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.579+0000 7f5f47919640 1 -- 172.21.15.142:0/3596994781 learned_addr learned my addr 172.21.15.142:0/3596994781 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:37:41.581 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.579+0000 7f5f47919640 1 -- 172.21.15.142:0/3596994781 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55994aae24c0 con 0x55994a9f27f0 2024-09-22T08:37:41.581 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.579+0000 7f5f47919640 1 --2- 172.21.15.142:0/3596994781 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55994a9f27f0 0x55994aae1ed0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f5f38025c20 tx=0x7f5f38051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8bcafe4548f3e2d server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:41.581 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.579+0000 7f5e35e0b640 1 -- 172.21.15.142:0/3596994781 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f38053a20 con 0x55994a9f27f0 2024-09-22T08:37:41.581 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.579+0000 7f5e35e0b640 1 -- 172.21.15.142:0/3596994781 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f38063070 con 0x55994a9f27f0 2024-09-22T08:37:41.581 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.579+0000 7f5e35e0b640 1 -- 172.21.15.142:0/3596994781 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f38053cf0 con 0x55994a9f27f0 2024-09-22T08:37:41.582 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.580+0000 7f5f49e2f800 1 -- 172.21.15.142:0/3596994781 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55994a9f27f0 msgr2=0x55994aae1ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:41.583 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.580+0000 7f5f49e2f800 1 --2- 172.21.15.142:0/3596994781 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55994a9f27f0 0x55994aae1ed0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f5f38025c20 tx=0x7f5f38051000 comp rx=0 tx=0).stop 2024-09-22T08:37:41.583 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.580+0000 7f5f49e2f800 1 -- 172.21.15.142:0/3596994781 shutdown_connections 2024-09-22T08:37:41.583 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.580+0000 7f5f49e2f800 1 --2- 172.21.15.142:0/3596994781 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55994a9f27f0 0x55994aae1ed0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:41.583 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.580+0000 7f5f49e2f800 1 -- 172.21.15.142:0/3596994781 >> 172.21.15.142:0/3596994781 conn(0x55994a9edbe0 msgr2=0x55994aadd850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:37:41.583 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.580+0000 7f5f49e2f800 1 -- 172.21.15.142:0/3596994781 shutdown_connections 2024-09-22T08:37:41.583 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.580+0000 7f5f49e2f800 1 -- 172.21.15.142:0/3596994781 wait complete. 2024-09-22T08:37:41.583 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.581+0000 7f5f49e2f800 1 Processor -- start 2024-09-22T08:37:41.583 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.581+0000 7f5f49e2f800 1 -- start start 2024-09-22T08:37:41.583 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.581+0000 7f5f49e2f800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55994a9f27f0 0x55994a967180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:41.583 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.581+0000 7f5f49e2f800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55994a9f42a0 con 0x55994a9f27f0 2024-09-22T08:37:41.583 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.581+0000 7f5f47919640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55994a9f27f0 0x55994a967180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:41.583 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.581+0000 7f5f47919640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55994a9f27f0 0x55994a967180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:55624/0 (socket says 172.21.15.142:55624) 2024-09-22T08:37:41.583 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.581+0000 7f5f47919640 1 -- 172.21.15.142:0/2356386888 learned_addr learned my addr 172.21.15.142:0/2356386888 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:37:41.584 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.582+0000 7f5f47919640 1 -- 172.21.15.142:0/2356386888 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55994a9676e0 con 0x55994a9f27f0 2024-09-22T08:37:41.584 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.582+0000 7f5f47919640 1 --2- 172.21.15.142:0/2356386888 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55994a9f27f0 0x55994a967180 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f5f38025c20 tx=0x7f5f38002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:41.586 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.582+0000 7f5e2ffff640 1 -- 172.21.15.142:0/2356386888 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f38068660 con 0x55994a9f27f0 2024-09-22T08:37:41.586 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.582+0000 7f5e2ffff640 1 -- 172.21.15.142:0/2356386888 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f38068800 con 0x55994a9f27f0 2024-09-22T08:37:41.586 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.582+0000 7f5e2ffff640 1 -- 172.21.15.142:0/2356386888 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f38068ae0 con 0x55994a9f27f0 2024-09-22T08:37:41.586 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.582+0000 7f5f49e2f800 1 -- 172.21.15.142:0/2356386888 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55994aaed6f0 con 0x55994a9f27f0 2024-09-22T08:37:41.586 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.582+0000 7f5f49e2f800 1 -- 172.21.15.142:0/2356386888 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55994aaedd10 con 0x55994a9f27f0 2024-09-22T08:37:41.586 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.583+0000 7f5e2ffff640 1 -- 172.21.15.142:0/2356386888 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f5f38068c80 con 0x55994a9f27f0 2024-09-22T08:37:41.586 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.583+0000 7f5e2ffff640 1 --2- 172.21.15.142:0/2356386888 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f5e3003cfb0 0x7f5e3003f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:41.586 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.583+0000 7f5e2ffff640 1 -- 172.21.15.142:0/2356386888 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5938+0+0 (secure 0 0 0) 0x7f5f38098ce0 con 0x55994a9f27f0 2024-09-22T08:37:41.586 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.583+0000 7f5f47118640 1 --2- 172.21.15.142:0/2356386888 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f5e3003cfb0 0x7f5e3003f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:41.586 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.583+0000 7f5f49e2f800 1 --2- 172.21.15.142:0/2356386888 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55994a9f3a30 0x55994aaf1ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:41.587 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.583+0000 7f5f49e2f800 1 -- 172.21.15.142:0/2356386888 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55994aaf22c0 con 0x55994a9f3a30 2024-09-22T08:37:41.587 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.583+0000 7f5f4811a640 1 --2- 172.21.15.142:0/2356386888 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55994a9f3a30 0x55994aaf1ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:41.587 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.584+0000 7f5f47118640 1 --2- 172.21.15.142:0/2356386888 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f5e3003cfb0 0x7f5e3003f470 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f5f30004170 tx=0x7f5f30001330 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:41.587 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.584+0000 7f5f4811a640 1 --2- 172.21.15.142:0/2356386888 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55994a9f3a30 0x55994aaf1ca0 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:41.587 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.584+0000 7f5f4811a640 1 -- 172.21.15.142:0/2356386888 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5f4000a4d0 con 0x55994a9f3a30 2024-09-22T08:37:41.587 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.584+0000 7f5f49e2f800 1 -- 172.21.15.142:0/2356386888 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55994aaf2bf0 con 0x55994a9f3a30 2024-09-22T08:37:41.587 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.584+0000 7f5f4811a640 1 -- 172.21.15.142:0/2356386888 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5f4000a4d0 con 0x55994a9f3a30 2024-09-22T08:37:41.587 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.584+0000 7f5f49e2f800 1 --2- 172.21.15.142:0/2356386888 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55994aaf4540 0x55994aaf69d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:41.587 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.584+0000 7f5f49e2f800 1 -- 172.21.15.142:0/2356386888 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:3 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55994aaf7160 con 0x55994aaf4540 2024-09-22T08:37:41.587 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.584+0000 7f5f47919640 1 --2- 172.21.15.142:0/2356386888 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55994aaf4540 0x55994aaf69d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:41.587 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.585+0000 7f5f47919640 1 --2- 172.21.15.142:0/2356386888 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55994aaf4540 0x55994aaf69d0 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:41.587 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.585+0000 7f5f47919640 1 -- 172.21.15.142:0/2356386888 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(3 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f5f38051070 con 0x55994aaf4540 2024-09-22T08:37:41.587 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.585+0000 7f5f49e2f800 1 -- 172.21.15.142:0/2356386888 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55994aaf3440 con 0x55994a9f3a30 2024-09-22T08:37:41.589 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.585+0000 7f5f4811a640 1 -- 172.21.15.142:0/2356386888 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5f4000a4d0 con 0x55994a9f3a30 2024-09-22T08:37:41.589 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.585+0000 7f5f49e2f800 1 -- 172.21.15.142:0/2356386888 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55994aaf3820 con 0x55994aaf4540 2024-09-22T08:37:41.589 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.586+0000 7f5f47919640 1 -- 172.21.15.142:0/2356386888 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(5 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f5f38051070 con 0x55994aaf4540 2024-09-22T08:37:41.589 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.586+0000 7f5f49e2f800 1 Processor -- start 2024-09-22T08:37:41.590 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.586+0000 7f5f49e2f800 1 -- start start 2024-09-22T08:37:41.590 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.586+0000 7f5f49e2f800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55994aaeae20 0x55994aae9690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:41.590 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.586+0000 7f5f49e2f800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55994a8ead50 con 0x55994aaeae20 2024-09-22T08:37:41.590 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.586+0000 7f5f4811a640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55994aaeae20 0x55994aae9690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:41.590 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.586+0000 7f5f4811a640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55994aaeae20 0x55994aae9690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:55634/0 (socket says 172.21.15.142:55634) 2024-09-22T08:37:41.590 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.586+0000 7f5f4811a640 1 -- 172.21.15.142:0/407505952 learned_addr learned my addr 172.21.15.142:0/407505952 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:37:41.590 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.587+0000 7f5f4811a640 1 -- 172.21.15.142:0/407505952 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55994aaeb340 con 0x55994aaeae20 2024-09-22T08:37:41.590 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.587+0000 7f5f4811a640 1 --2- 172.21.15.142:0/407505952 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55994aaeae20 0x55994aae9690 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x55994aaf26c0 tx=0x7f5f400163e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:41.590 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.587+0000 7f5e2d7fa640 1 -- 172.21.15.142:0/407505952 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f40013450 con 0x55994aaeae20 2024-09-22T08:37:41.590 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.587+0000 7f5e2d7fa640 1 -- 172.21.15.142:0/407505952 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f400135f0 con 0x55994aaeae20 2024-09-22T08:37:41.590 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.587+0000 7f5f49e2f800 1 -- 172.21.15.142:0/407505952 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55994aae9bd0 con 0x55994aaeae20 2024-09-22T08:37:41.590 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.587+0000 7f5e2d7fa640 1 -- 172.21.15.142:0/407505952 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f400138d0 con 0x55994aaeae20 2024-09-22T08:37:41.590 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.587+0000 7f5f49e2f800 1 -- 172.21.15.142:0/407505952 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55994aaea120 con 0x55994aaeae20 2024-09-22T08:37:41.591 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.588+0000 7f5e2d7fa640 1 -- 172.21.15.142:0/407505952 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f5f40011040 con 0x55994aaeae20 2024-09-22T08:37:41.591 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.588+0000 7f5e2d7fa640 1 --2- 172.21.15.142:0/407505952 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f5e2003cfb0 0x7f5e2003f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:41.591 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.588+0000 7f5e2d7fa640 1 -- 172.21.15.142:0/407505952 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5938+0+0 (secure 0 0 0) 0x7f5f4000e040 con 0x55994aaeae20 2024-09-22T08:37:41.591 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.588+0000 7f5f47919640 1 --2- 172.21.15.142:0/407505952 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f5e2003cfb0 0x7f5e2003f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:41.594 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.589+0000 7f5f49e2f800 1 Processor -- start 2024-09-22T08:37:41.594 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.589+0000 7f5f47919640 1 --2- 172.21.15.142:0/407505952 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f5e2003cfb0 0x7f5e2003f470 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x55994aaef1b0 tx=0x7f5f3805d640 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:41.594 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.589+0000 7f5f49e2f800 1 -- start start 2024-09-22T08:37:41.594 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.589+0000 7f5f49e2f800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55994ab14720 0x55994ab14b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:41.594 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.589+0000 7f5f49e2f800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55994aae2890 con 0x55994ab14720 2024-09-22T08:37:41.594 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.589+0000 7f5f4811a640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55994ab14720 0x55994ab14b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:41.594 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.589+0000 7f5f4811a640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55994ab14720 0x55994ab14b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:55644/0 (socket says 172.21.15.142:55644) 2024-09-22T08:37:41.594 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.589+0000 7f5f4811a640 1 -- 172.21.15.142:0/1033263687 learned_addr learned my addr 172.21.15.142:0/1033263687 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:37:41.595 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.589+0000 7f5f4811a640 1 -- 172.21.15.142:0/1033263687 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55994ab15110 con 0x55994ab14720 2024-09-22T08:37:41.595 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.589+0000 7f5f4811a640 1 --2- 172.21.15.142:0/1033263687 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55994ab14720 0x55994ab14b20 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f5f400294e0 tx=0x7f5f4001f450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e36bdb936e8d6ce7 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:41.595 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.590+0000 7f5e26ffd640 1 -- 172.21.15.142:0/1033263687 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f40052070 con 0x55994ab14720 2024-09-22T08:37:41.595 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.590+0000 7f5e26ffd640 1 -- 172.21.15.142:0/1033263687 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f4002aa90 con 0x55994ab14720 2024-09-22T08:37:41.595 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.590+0000 7f5e26ffd640 1 -- 172.21.15.142:0/1033263687 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f4002a570 con 0x55994ab14720 2024-09-22T08:37:41.595 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.590+0000 7f5f49e2f800 1 -- 172.21.15.142:0/1033263687 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55994ab14720 msgr2=0x55994ab14b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:41.595 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.590+0000 7f5f49e2f800 1 --2- 172.21.15.142:0/1033263687 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55994ab14720 0x55994ab14b20 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f5f400294e0 tx=0x7f5f4001f450 comp rx=0 tx=0).stop 2024-09-22T08:37:41.595 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.590+0000 7f5f49e2f800 1 -- 172.21.15.142:0/1033263687 shutdown_connections 2024-09-22T08:37:41.595 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.590+0000 7f5f49e2f800 1 --2- 172.21.15.142:0/1033263687 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55994ab14720 0x55994ab14b20 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:41.595 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.590+0000 7f5f49e2f800 1 -- 172.21.15.142:0/1033263687 >> 172.21.15.142:0/1033263687 conn(0x55994ab10b20 msgr2=0x55994ab0ed60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:37:41.595 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.590+0000 7f5f49e2f800 1 -- 172.21.15.142:0/1033263687 shutdown_connections 2024-09-22T08:37:41.595 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.590+0000 7f5f49e2f800 1 -- 172.21.15.142:0/1033263687 wait complete. 2024-09-22T08:37:41.595 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.590+0000 7f5f49e2f800 1 Processor -- start 2024-09-22T08:37:41.595 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.590+0000 7f5f49e2f800 1 -- start start 2024-09-22T08:37:41.596 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.591+0000 7f5f49e2f800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55994ab14720 0x55994ab1bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:41.596 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.591+0000 7f5f49e2f800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55994ab15730 con 0x55994ab14720 2024-09-22T08:37:41.596 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.591+0000 7f5f4811a640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55994ab14720 0x55994ab1bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:41.596 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.591+0000 7f5f4811a640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55994ab14720 0x55994ab1bcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:55650/0 (socket says 172.21.15.142:55650) 2024-09-22T08:37:41.596 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.591+0000 7f5f4811a640 1 -- 172.21.15.142:0/4242929127 learned_addr learned my addr 172.21.15.142:0/4242929127 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:37:41.596 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.591+0000 7f5f4811a640 1 -- 172.21.15.142:0/4242929127 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55994ab1c250 con 0x55994ab14720 2024-09-22T08:37:41.596 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.591+0000 7f5f4811a640 1 --2- 172.21.15.142:0/4242929127 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55994ab14720 0x55994ab1bcf0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f5f400294e0 tx=0x7f5f400548f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:41.596 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.591+0000 7f5e257fa640 1 -- 172.21.15.142:0/4242929127 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f40052030 con 0x55994ab14720 2024-09-22T08:37:41.596 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.591+0000 7f5e257fa640 1 -- 172.21.15.142:0/4242929127 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f4001fcf0 con 0x55994ab14720 2024-09-22T08:37:41.596 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.591+0000 7f5e257fa640 1 -- 172.21.15.142:0/4242929127 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f40045c80 con 0x55994ab14720 2024-09-22T08:37:41.596 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.591+0000 7f5f49e2f800 1 -- 172.21.15.142:0/4242929127 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55994ab1c4e0 con 0x55994ab14720 2024-09-22T08:37:41.596 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.591+0000 7f5f49e2f800 1 -- 172.21.15.142:0/4242929127 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55994ab1d070 con 0x55994ab14720 2024-09-22T08:37:41.596 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.592+0000 7f5e257fa640 1 -- 172.21.15.142:0/4242929127 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f5f40029ba0 con 0x55994ab14720 2024-09-22T08:37:41.596 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.592+0000 7f5e257fa640 1 --2- 172.21.15.142:0/4242929127 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f5e1003cfb0 0x7f5e1003f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:41.596 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.593+0000 7f5e257fa640 1 -- 172.21.15.142:0/4242929127 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5938+0+0 (secure 0 0 0) 0x7f5f40053070 con 0x55994ab14720 2024-09-22T08:37:41.597 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.593+0000 7f5f49e2f800 20 rados->read ofs=0 len=0 2024-09-22T08:37:41.597 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.593+0000 7f5f47919640 1 --2- 172.21.15.142:0/4242929127 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f5e1003cfb0 0x7f5e1003f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:41.597 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.593+0000 7f5f49e2f800 1 --2- 172.21.15.142:0/4242929127 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55994ab27610 0x55994ab29ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:41.597 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.593+0000 7f5f49e2f800 1 -- 172.21.15.142:0/4242929127 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55994ab2a220 con 0x55994ab27610 2024-09-22T08:37:41.597 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.593+0000 7f5f47118640 1 --2- 172.21.15.142:0/4242929127 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55994ab27610 0x55994ab29ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:41.597 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.593+0000 7f5f47919640 1 --2- 172.21.15.142:0/4242929127 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f5e1003cfb0 0x7f5e1003f470 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f5f3805d6f0 tx=0x7f5f38089000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:41.604 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.593+0000 7f5f47118640 1 --2- 172.21.15.142:0/4242929127 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55994ab27610 0x55994ab29ad0 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:41.604 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.593+0000 7f5f47118640 1 -- 172.21.15.142:0/4242929127 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5f30009050 con 0x55994ab27610 2024-09-22T08:37:41.605 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.593+0000 7f5f49e2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:41.605 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.593+0000 7f5f49e2f800 20 realm 2024-09-22T08:37:41.605 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.593+0000 7f5f49e2f800 20 rados->read ofs=0 len=0 2024-09-22T08:37:41.605 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.593+0000 7f5f49e2f800 1 -- 172.21.15.142:0/4242929127 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55994ab26960 con 0x55994ab27610 2024-09-22T08:37:41.605 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.594+0000 7f5f47118640 1 -- 172.21.15.142:0/4242929127 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5f30009050 con 0x55994ab27610 2024-09-22T08:37:41.605 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.594+0000 7f5f49e2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:41.605 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.594+0000 7f5f49e2f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:37:41.605 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.594+0000 7f5f49e2f800 20 rados->read ofs=0 len=0 2024-09-22T08:37:41.605 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.594+0000 7f5f49e2f800 1 -- 172.21.15.142:0/4242929127 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55994ab2ad00 con 0x55994ab27610 2024-09-22T08:37:41.605 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.594+0000 7f5f47118640 1 -- 172.21.15.142:0/4242929127 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5f30009050 con 0x55994ab27610 2024-09-22T08:37:41.605 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.594+0000 7f5f49e2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:41.605 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.594+0000 7f5f49e2f800 20 rados->read ofs=0 len=0 2024-09-22T08:37:41.605 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.594+0000 7f5f49e2f800 1 -- 172.21.15.142:0/4242929127 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55994ab2b5d0 con 0x55994ab27610 2024-09-22T08:37:41.605 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.594+0000 7f5f47118640 1 -- 172.21.15.142:0/4242929127 <== osd.1 v2:172.21.15.142:6816/3192108003 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5f30009050 con 0x55994ab27610 2024-09-22T08:37:41.606 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.594+0000 7f5f49e2f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:37:41.606 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.594+0000 7f5f49e2f800 20 rados->read ofs=0 len=0 2024-09-22T08:37:41.606 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.594+0000 7f5f49e2f800 1 --2- 172.21.15.142:0/4242929127 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55994ab2be80 0x55994ab2e270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:41.606 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.594+0000 7f5f49e2f800 1 -- 172.21.15.142:0/4242929127 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55994ab2e9d0 con 0x55994ab2be80 2024-09-22T08:37:41.606 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.594+0000 7f5f4811a640 1 --2- 172.21.15.142:0/4242929127 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55994ab2be80 0x55994ab2e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:41.606 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.595+0000 7f5f4811a640 1 --2- 172.21.15.142:0/4242929127 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55994ab2be80 0x55994ab2e270 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:41.606 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.595+0000 7f5f4811a640 1 -- 172.21.15.142:0/4242929127 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(5 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f5f40054d70 con 0x55994ab2be80 2024-09-22T08:37:41.606 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.595+0000 7f5f49e2f800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:37:41.606 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.595+0000 7f5f49e2f800 20 searching for the correct realm 2024-09-22T08:37:41.606 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.595+0000 7f5f49e2f800 1 -- 172.21.15.142:0/4242929127 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55994ab30400 con 0x55994ab2be80 2024-09-22T08:37:41.606 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.595+0000 7f5f4811a640 1 -- 172.21.15.142:0/4242929127 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f40054d70 con 0x55994ab2be80 2024-09-22T08:37:41.607 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.595+0000 7f5f4811a640 1 --2- 172.21.15.142:0/4242929127 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f5f40013070 0x7f5f40034440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:41.607 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.595+0000 7f5f4811a640 1 -- 172.21.15.142:0/4242929127 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55994ab30400 con 0x7f5f40013070 2024-09-22T08:37:41.607 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.595+0000 7f5f47919640 1 --2- 172.21.15.142:0/4242929127 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f5f40013070 0x7f5f40034440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:41.607 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.595+0000 7f5f47919640 1 --2- 172.21.15.142:0/4242929127 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f5f40013070 0x7f5f40034440 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:41.607 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.596+0000 7f5f47919640 1 -- 172.21.15.142:0/4242929127 <== osd.2 v2:172.21.15.142:6808/279438927 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f38051070 con 0x7f5f40013070 2024-09-22T08:37:41.607 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.596+0000 7f5f47919640 1 --2- 172.21.15.142:0/4242929127 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f5f380a5040 0x7f5f38074480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:41.607 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.596+0000 7f5f47919640 1 -- 172.21.15.142:0/4242929127 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55994ab30400 con 0x7f5f380a5040 2024-09-22T08:37:41.607 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.596+0000 7f5f47118640 1 --2- 172.21.15.142:0/4242929127 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f5f380a5040 0x7f5f38074480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:41.607 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.596+0000 7f5f47118640 1 --2- 172.21.15.142:0/4242929127 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f5f380a5040 0x7f5f38074480 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:41.607 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.597+0000 7f5f47118640 1 -- 172.21.15.142:0/4242929127 <== osd.0 v2:172.21.15.31:6800/168281188 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f30009050 con 0x7f5f380a5040 2024-09-22T08:37:41.607 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.597+0000 7f5f47118640 1 -- 172.21.15.142:0/4242929127 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55994ab30400 con 0x55994ab27610 2024-09-22T08:37:41.607 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.597+0000 7f5f47118640 1 -- 172.21.15.142:0/4242929127 <== osd.1 v2:172.21.15.142:6816/3192108003 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f30009050 con 0x55994ab27610 2024-09-22T08:37:41.607 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.597+0000 7f5f47118640 1 -- 172.21.15.142:0/4242929127 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55994ab30400 con 0x55994ab27610 2024-09-22T08:37:41.608 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.597+0000 7f5f47118640 1 -- 172.21.15.142:0/4242929127 <== osd.1 v2:172.21.15.142:6816/3192108003 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f30029040 con 0x55994ab27610 2024-09-22T08:37:41.608 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.597+0000 7f5f47118640 1 -- 172.21.15.142:0/4242929127 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55994ab30400 con 0x55994ab27610 2024-09-22T08:37:41.608 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.597+0000 7f5f47118640 1 -- 172.21.15.142:0/4242929127 <== osd.1 v2:172.21.15.142:6816/3192108003 7 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f30029040 con 0x55994ab27610 2024-09-22T08:37:41.608 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.597+0000 7f5f47118640 1 -- 172.21.15.142:0/4242929127 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55994ab30400 con 0x7f5f380a5040 2024-09-22T08:37:41.608 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.598+0000 7f5f47118640 1 -- 172.21.15.142:0/4242929127 <== osd.0 v2:172.21.15.31:6800/168281188 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f30029040 con 0x7f5f380a5040 2024-09-22T08:37:41.608 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.598+0000 7f5f47118640 1 -- 172.21.15.142:0/4242929127 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55994ab30400 con 0x7f5f40013070 2024-09-22T08:37:41.608 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.598+0000 7f5f47919640 1 -- 172.21.15.142:0/4242929127 <== osd.2 v2:172.21.15.142:6808/279438927 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f38051070 con 0x7f5f40013070 2024-09-22T08:37:41.608 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.598+0000 7f5f47919640 1 -- 172.21.15.142:0/4242929127 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55994ab30400 con 0x55994ab2be80 2024-09-22T08:37:41.608 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.598+0000 7f5f4811a640 1 -- 172.21.15.142:0/4242929127 <== osd.3 v2:172.21.15.142:6800/1064901393 3 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f40054d70 con 0x55994ab2be80 2024-09-22T08:37:41.608 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.598+0000 7f5f4811a640 1 -- 172.21.15.142:0/4242929127 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55994ab30400 con 0x55994ab27610 2024-09-22T08:37:41.608 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.598+0000 7f5f47118640 1 -- 172.21.15.142:0/4242929127 <== osd.1 v2:172.21.15.142:6816/3192108003 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f30029040 con 0x55994ab27610 2024-09-22T08:37:41.608 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.598+0000 7f5f47118640 1 -- 172.21.15.142:0/4242929127 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55994ab30400 con 0x7f5f380a5040 2024-09-22T08:37:41.608 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.599+0000 7f5f47118640 1 -- 172.21.15.142:0/4242929127 <== osd.0 v2:172.21.15.31:6800/168281188 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f30029040 con 0x7f5f380a5040 2024-09-22T08:37:41.608 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.599+0000 7f5f47118640 1 -- 172.21.15.142:0/4242929127 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55994ab30400 con 0x55994ab27610 2024-09-22T08:37:41.609 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.599+0000 7f5f47118640 1 -- 172.21.15.142:0/4242929127 <== osd.1 v2:172.21.15.142:6816/3192108003 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f30029040 con 0x55994ab27610 2024-09-22T08:37:41.609 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.599+0000 7f5f47118640 1 -- 172.21.15.142:0/4242929127 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55994ab30400 con 0x7f5f40013070 2024-09-22T08:37:41.609 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.599+0000 7f5f47919640 1 -- 172.21.15.142:0/4242929127 <== osd.2 v2:172.21.15.142:6808/279438927 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f5f38051070 con 0x7f5f40013070 2024-09-22T08:37:41.609 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.599+0000 7f5f47919640 1 -- 172.21.15.142:0/4242929127 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55994ab30400 con 0x55994ab2be80 2024-09-22T08:37:41.609 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.599+0000 7f5f4811a640 1 -- 172.21.15.142:0/4242929127 <== osd.3 v2:172.21.15.142:6800/1064901393 4 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f40054d70 con 0x55994ab2be80 2024-09-22T08:37:41.609 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.599+0000 7f5f4811a640 1 -- 172.21.15.142:0/4242929127 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55994ab30400 con 0x55994ab2be80 2024-09-22T08:37:41.609 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.599+0000 7f5f4811a640 1 -- 172.21.15.142:0/4242929127 <== osd.3 v2:172.21.15.142:6800/1064901393 5 ==== osd_op_reply(20 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f5f40054d70 con 0x55994ab2be80 2024-09-22T08:37:41.609 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.600+0000 7f5f4811a640 1 -- 172.21.15.142:0/4242929127 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55994ab30400 con 0x7f5f380a5040 2024-09-22T08:37:41.609 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.600+0000 7f5f47118640 1 -- 172.21.15.142:0/4242929127 <== osd.0 v2:172.21.15.31:6800/168281188 4 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f30029040 con 0x7f5f380a5040 2024-09-22T08:37:41.609 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.600+0000 7f5f47118640 1 -- 172.21.15.142:0/4242929127 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55994ab30400 con 0x55994ab2be80 2024-09-22T08:37:41.609 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.600+0000 7f5f4811a640 1 -- 172.21.15.142:0/4242929127 <== osd.3 v2:172.21.15.142:6800/1064901393 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f40054d70 con 0x55994ab2be80 2024-09-22T08:37:41.609 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.600+0000 7f5f4811a640 1 -- 172.21.15.142:0/4242929127 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55994ab30400 con 0x55994ab2be80 2024-09-22T08:37:41.609 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.600+0000 7f5f4811a640 1 -- 172.21.15.142:0/4242929127 <== osd.3 v2:172.21.15.142:6800/1064901393 7 ==== osd_op_reply(23 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f5f40054d70 con 0x55994ab2be80 2024-09-22T08:37:41.609 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.600+0000 7f5f4811a640 1 -- 172.21.15.142:0/4242929127 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55994ab30400 con 0x55994ab27610 2024-09-22T08:37:41.610 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.600+0000 7f5f47118640 1 -- 172.21.15.142:0/4242929127 <== osd.1 v2:172.21.15.142:6816/3192108003 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f30029040 con 0x55994ab27610 2024-09-22T08:37:41.610 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.600+0000 7f5f47118640 1 -- 172.21.15.142:0/4242929127 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55994ab30400 con 0x55994ab27610 2024-09-22T08:37:41.610 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.601+0000 7f5f47118640 1 -- 172.21.15.142:0/4242929127 <== osd.1 v2:172.21.15.142:6816/3192108003 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f5f30029040 con 0x55994ab27610 2024-09-22T08:37:41.610 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.601+0000 7f5f47118640 1 -- 172.21.15.142:0/4242929127 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55994ab30400 con 0x7f5f380a5040 2024-09-22T08:37:41.610 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.601+0000 7f5f47118640 1 -- 172.21.15.142:0/4242929127 <== osd.0 v2:172.21.15.31:6800/168281188 5 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f30029040 con 0x7f5f380a5040 2024-09-22T08:37:41.610 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.601+0000 7f5f47118640 1 -- 172.21.15.142:0/4242929127 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55994ab30400 con 0x55994ab2be80 2024-09-22T08:37:41.610 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.601+0000 7f5f4811a640 1 -- 172.21.15.142:0/4242929127 <== osd.3 v2:172.21.15.142:6800/1064901393 8 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f40054d70 con 0x55994ab2be80 2024-09-22T08:37:41.610 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.601+0000 7f5f4811a640 1 -- 172.21.15.142:0/4242929127 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55994ab30400 con 0x7f5f40013070 2024-09-22T08:37:41.610 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.601+0000 7f5f47919640 1 -- 172.21.15.142:0/4242929127 <== osd.2 v2:172.21.15.142:6808/279438927 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f38051070 con 0x7f5f40013070 2024-09-22T08:37:41.610 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.601+0000 7f5f47919640 1 -- 172.21.15.142:0/4242929127 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55994ab30400 con 0x55994ab27610 2024-09-22T08:37:41.610 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.602+0000 7f5f47118640 1 -- 172.21.15.142:0/4242929127 <== osd.1 v2:172.21.15.142:6816/3192108003 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f30029040 con 0x55994ab27610 2024-09-22T08:37:41.610 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.602+0000 7f5f47118640 1 -- 172.21.15.142:0/4242929127 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55994ab30400 con 0x7f5f380a5040 2024-09-22T08:37:41.610 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.602+0000 7f5f47118640 1 -- 172.21.15.142:0/4242929127 <== osd.0 v2:172.21.15.31:6800/168281188 6 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f30029040 con 0x7f5f380a5040 2024-09-22T08:37:41.610 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.602+0000 7f5f47118640 1 -- 172.21.15.142:0/4242929127 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55994ab30400 con 0x55994ab2be80 2024-09-22T08:37:41.611 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.602+0000 7f5f4811a640 1 -- 172.21.15.142:0/4242929127 <== osd.3 v2:172.21.15.142:6800/1064901393 9 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f40054d70 con 0x55994ab2be80 2024-09-22T08:37:41.611 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.602+0000 7f5f4811a640 1 -- 172.21.15.142:0/4242929127 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55994ab30400 con 0x7f5f380a5040 2024-09-22T08:37:41.611 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.603+0000 7f5f47118640 1 -- 172.21.15.142:0/4242929127 <== osd.0 v2:172.21.15.31:6800/168281188 7 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f30029040 con 0x7f5f380a5040 2024-09-22T08:37:41.611 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.603+0000 7f5f47118640 1 -- 172.21.15.142:0/4242929127 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55994ab30400 con 0x7f5f40013070 2024-09-22T08:37:41.611 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.603+0000 7f5f47919640 1 -- 172.21.15.142:0/4242929127 <== osd.2 v2:172.21.15.142:6808/279438927 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f38051070 con 0x7f5f40013070 2024-09-22T08:37:41.611 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.603+0000 7f5f47919640 1 -- 172.21.15.142:0/4242929127 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55994ab30400 con 0x55994ab2be80 2024-09-22T08:37:41.611 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.603+0000 7f5f4811a640 1 -- 172.21.15.142:0/4242929127 <== osd.3 v2:172.21.15.142:6800/1064901393 10 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f40054d70 con 0x55994ab2be80 2024-09-22T08:37:41.611 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.603+0000 7f5f4811a640 1 -- 172.21.15.142:0/4242929127 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55994ab30400 con 0x7f5f380a5040 2024-09-22T08:37:41.611 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.603+0000 7f5f47118640 1 -- 172.21.15.142:0/4242929127 <== osd.0 v2:172.21.15.31:6800/168281188 8 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f30029040 con 0x7f5f380a5040 2024-09-22T08:37:41.611 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.603+0000 7f5f47118640 1 -- 172.21.15.142:0/4242929127 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55994ab30400 con 0x55994ab27610 2024-09-22T08:37:41.626 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.604+0000 7f5f47118640 1 -- 172.21.15.142:0/4242929127 <== osd.1 v2:172.21.15.142:6816/3192108003 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f5f30029040 con 0x55994ab27610 2024-09-22T08:37:41.626 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.604+0000 7f5f47118640 1 -- 172.21.15.142:0/4242929127 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55994ab30400 con 0x7f5f40013070 2024-09-22T08:37:41.626 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.604+0000 7f5f47919640 1 -- 172.21.15.142:0/4242929127 <== osd.2 v2:172.21.15.142:6808/279438927 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f38051070 con 0x7f5f40013070 2024-09-22T08:37:41.626 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.604+0000 7f5f49e2f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:37:41.626 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.604+0000 7f5f49e2f800 20 RGWRados::pool_iterate: got zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec 2024-09-22T08:37:41.626 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.604+0000 7f5f49e2f800 20 RGWRados::pool_iterate: got zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f 2024-09-22T08:37:41.627 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.604+0000 7f5f49e2f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:37:41.627 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.604+0000 7f5f49e2f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:37:41.627 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.604+0000 7f5f49e2f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:37:41.627 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.604+0000 7f5f49e2f800 20 rados->read ofs=0 len=0 2024-09-22T08:37:41.627 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.604+0000 7f5f49e2f800 1 -- 172.21.15.142:0/4242929127 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55994ab2f500 con 0x55994ab27610 2024-09-22T08:37:41.627 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.604+0000 7f5f47118640 1 -- 172.21.15.142:0/4242929127 <== osd.1 v2:172.21.15.142:6816/3192108003 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5f30029040 con 0x55994ab27610 2024-09-22T08:37:41.628 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.604+0000 7f5f49e2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:41.628 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.604+0000 7f5f49e2f800 20 rados->read ofs=0 len=0 2024-09-22T08:37:41.628 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.604+0000 7f5f49e2f800 1 -- 172.21.15.142:0/4242929127 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55994ab2fda0 con 0x55994ab27610 2024-09-22T08:37:41.628 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.604+0000 7f5f47118640 1 -- 172.21.15.142:0/4242929127 <== osd.1 v2:172.21.15.142:6816/3192108003 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5f30029040 con 0x55994ab27610 2024-09-22T08:37:41.628 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.604+0000 7f5f49e2f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:37:41.628 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.604+0000 7f5f49e2f800 20 rados->read ofs=0 len=0 2024-09-22T08:37:41.628 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.604+0000 7f5f49e2f800 1 -- 172.21.15.142:0/4242929127 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:40 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55994ab2f140 con 0x55994ab2be80 2024-09-22T08:37:41.629 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.605+0000 7f5f4811a640 1 -- 172.21.15.142:0/4242929127 <== osd.3 v2:172.21.15.142:6800/1064901393 11 ==== osd_op_reply(40 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f5f40054d70 con 0x55994ab2be80 2024-09-22T08:37:41.629 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.605+0000 7f5f49e2f800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:37:41.629 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.605+0000 7f5f49e2f800 20 zone default found 2024-09-22T08:37:41.629 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.605+0000 7f5f49e2f800 4 Realm: () 2024-09-22T08:37:41.629 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.605+0000 7f5f49e2f800 4 ZoneGroup: default (d89f6f57-1007-47dd-9065-f486c7b01aec) 2024-09-22T08:37:41.629 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.605+0000 7f5f49e2f800 4 Zone: default (e239248c-0bee-4e41-803a-24b288d3eb8f) 2024-09-22T08:37:41.630 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.605+0000 7f5f49e2f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:37:41.630 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.605+0000 7f5f49e2f800 20 zonegroup default 2024-09-22T08:37:41.630 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.605+0000 7f5f49e2f800 20 rados->read ofs=0 len=0 2024-09-22T08:37:41.630 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.605+0000 7f5f49e2f800 1 -- 172.21.15.142:0/4242929127 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55994ab30d80 con 0x7f5f380a5040 2024-09-22T08:37:41.630 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.605+0000 7f5f47118640 1 -- 172.21.15.142:0/4242929127 <== osd.0 v2:172.21.15.31:6800/168281188 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f5f30029040 con 0x7f5f380a5040 2024-09-22T08:37:41.630 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.605+0000 7f5f49e2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:41.631 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.605+0000 7f5f49e2f800 20 rados->read ofs=0 len=0 2024-09-22T08:37:41.631 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.605+0000 7f5f49e2f800 1 -- 172.21.15.142:0/4242929127 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55994ab32c10 con 0x55994ab2be80 2024-09-22T08:37:41.631 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.605+0000 7f5f4811a640 1 -- 172.21.15.142:0/4242929127 <== osd.3 v2:172.21.15.142:6800/1064901393 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5f40054d70 con 0x55994ab2be80 2024-09-22T08:37:41.631 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.605+0000 7f5f49e2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:41.631 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.605+0000 7f5f49e2f800 20 rados->read ofs=0 len=0 2024-09-22T08:37:41.631 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.605+0000 7f5f49e2f800 1 -- 172.21.15.142:0/4242929127 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55994ab330d0 con 0x55994ab2be80 2024-09-22T08:37:41.632 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.606+0000 7f5f4811a640 1 -- 172.21.15.142:0/4242929127 <== osd.3 v2:172.21.15.142:6800/1064901393 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5f40054d70 con 0x55994ab2be80 2024-09-22T08:37:41.632 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.606+0000 7f5f49e2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:41.632 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.606+0000 7f5f49e2f800 20 started sync module instance, tier type = 2024-09-22T08:37:41.632 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.606+0000 7f5f49e2f800 20 started zone id=e239248c-0bee-4e41-803a-24b288d3eb8f (name=default) with tier type = 2024-09-22T08:37:41.632 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.606+0000 7f5f49e2f800 1 -- 172.21.15.142:0/4242929127 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55994ab31fb0 con 0x7f5f40013070 2024-09-22T08:37:41.632 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.607+0000 7f5f47919640 1 -- 172.21.15.142:0/4242929127 <== osd.2 v2:172.21.15.142:6808/279438927 7 ==== osd_op_reply(44 notify.0 [create] v32'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f38051070 con 0x7f5f40013070 2024-09-22T08:37:41.633 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.607+0000 7f5f49e2f800 1 -- 172.21.15.142:0/4242929127 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94116871611296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55994ab339c0 con 0x7f5f40013070 2024-09-22T08:37:41.633 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.607+0000 7f5f49e2f800 1 -- 172.21.15.142:0/4242929127 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55994ab34210 con 0x55994ab27610 2024-09-22T08:37:41.633 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.608+0000 7f5f47919640 1 -- 172.21.15.142:0/4242929127 <== osd.2 v2:172.21.15.142:6808/279438927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94116871611296] v32'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f38051070 con 0x7f5f40013070 2024-09-22T08:37:41.633 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.608+0000 7f5f47118640 1 -- 172.21.15.142:0/4242929127 <== osd.1 v2:172.21.15.142:6816/3192108003 16 ==== osd_op_reply(46 notify.1 [create] v32'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f30029040 con 0x55994ab27610 2024-09-22T08:37:41.633 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.608+0000 7f5f49e2f800 1 -- 172.21.15.142:0/4242929127 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94116871615760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55994ab342d0 con 0x55994ab27610 2024-09-22T08:37:41.633 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.608+0000 7f5f49e2f800 1 -- 172.21.15.142:0/4242929127 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55994ab34df0 con 0x55994ab2be80 2024-09-22T08:37:41.634 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.609+0000 7f5f47118640 1 -- 172.21.15.142:0/4242929127 <== osd.1 v2:172.21.15.142:6816/3192108003 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94116871615760] v32'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f30029040 con 0x55994ab27610 2024-09-22T08:37:41.634 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.609+0000 7f5f4811a640 1 -- 172.21.15.142:0/4242929127 <== osd.3 v2:172.21.15.142:6800/1064901393 14 ==== osd_op_reply(48 notify.2 [create] v32'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f40054d70 con 0x55994ab2be80 2024-09-22T08:37:41.634 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.609+0000 7f5f49e2f800 1 -- 172.21.15.142:0/4242929127 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94116871620800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55994ab34db0 con 0x55994ab2be80 2024-09-22T08:37:41.634 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.609+0000 7f5f49e2f800 1 -- 172.21.15.142:0/4242929127 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55994ab358a0 con 0x7f5f40013070 2024-09-22T08:37:41.634 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.610+0000 7f5f47919640 1 -- 172.21.15.142:0/4242929127 <== osd.2 v2:172.21.15.142:6808/279438927 9 ==== osd_op_reply(50 notify.3 [create] v32'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f38051070 con 0x7f5f40013070 2024-09-22T08:37:41.634 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.610+0000 7f5f49e2f800 1 -- 172.21.15.142:0/4242929127 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94116871623600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55994ab358a0 con 0x7f5f40013070 2024-09-22T08:37:41.635 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.610+0000 7f5f49e2f800 1 -- 172.21.15.142:0/4242929127 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55994ab36880 con 0x55994ab27610 2024-09-22T08:37:41.635 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.610+0000 7f5f4811a640 1 -- 172.21.15.142:0/4242929127 <== osd.3 v2:172.21.15.142:6800/1064901393 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94116871620800] v32'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f40054d70 con 0x55994ab2be80 2024-09-22T08:37:41.635 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.611+0000 7f5f47919640 1 -- 172.21.15.142:0/4242929127 <== osd.2 v2:172.21.15.142:6808/279438927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94116871623600] v32'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f38051070 con 0x7f5f40013070 2024-09-22T08:37:41.635 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.612+0000 7f5f47118640 1 -- 172.21.15.142:0/4242929127 <== osd.1 v2:172.21.15.142:6816/3192108003 18 ==== osd_op_reply(52 notify.4 [create] v32'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f30029040 con 0x55994ab27610 2024-09-22T08:37:41.635 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.612+0000 7f5f49e2f800 1 -- 172.21.15.142:0/4242929127 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94116871625920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55994ab36880 con 0x55994ab27610 2024-09-22T08:37:41.635 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.612+0000 7f5f49e2f800 1 -- 172.21.15.142:0/4242929127 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55994ab37120 con 0x7f5f380a5040 2024-09-22T08:37:41.635 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.613+0000 7f5f47118640 1 -- 172.21.15.142:0/4242929127 <== osd.0 v2:172.21.15.31:6800/168281188 10 ==== osd_op_reply(54 notify.5 [create] v32'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f30029040 con 0x7f5f380a5040 2024-09-22T08:37:41.636 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.613+0000 7f5f49e2f800 1 -- 172.21.15.142:0/4242929127 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94116871628928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55994ab371f0 con 0x7f5f380a5040 2024-09-22T08:37:41.636 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.613+0000 7f5f49e2f800 1 -- 172.21.15.142:0/4242929127 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55994ab37d10 con 0x7f5f380a5040 2024-09-22T08:37:41.636 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.613+0000 7f5f47118640 1 -- 172.21.15.142:0/4242929127 <== osd.1 v2:172.21.15.142:6816/3192108003 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94116871625920] v32'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f30029040 con 0x55994ab27610 2024-09-22T08:37:41.636 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.614+0000 7f5f47118640 1 -- 172.21.15.142:0/4242929127 <== osd.0 v2:172.21.15.31:6800/168281188 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94116871628928] v32'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f30029040 con 0x7f5f380a5040 2024-09-22T08:37:41.636 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.615+0000 7f5f47118640 1 -- 172.21.15.142:0/4242929127 <== osd.0 v2:172.21.15.31:6800/168281188 12 ==== osd_op_reply(56 notify.6 [create] v32'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f30029040 con 0x7f5f380a5040 2024-09-22T08:37:41.636 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.615+0000 7f5f49e2f800 1 -- 172.21.15.142:0/4242929127 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94116871629984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55994ab33d60 con 0x7f5f380a5040 2024-09-22T08:37:41.637 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.615+0000 7f5f49e2f800 1 -- 172.21.15.142:0/4242929127 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55994ab38180 con 0x7f5f380a5040 2024-09-22T08:37:41.637 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.616+0000 7f5f47118640 1 -- 172.21.15.142:0/4242929127 <== osd.0 v2:172.21.15.31:6800/168281188 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94116871629984] v32'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f30029040 con 0x7f5f380a5040 2024-09-22T08:37:41.637 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.616+0000 7f5f47118640 1 -- 172.21.15.142:0/4242929127 <== osd.0 v2:172.21.15.31:6800/168281188 14 ==== osd_op_reply(58 notify.7 [create] v32'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f30029040 con 0x7f5f380a5040 2024-09-22T08:37:41.637 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.616+0000 7f5f49e2f800 1 -- 172.21.15.142:0/4242929127 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94116871632864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55994ab38180 con 0x7f5f380a5040 2024-09-22T08:37:41.637 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.616+0000 7f5f49e2f800 20 add_watcher() i=0 2024-09-22T08:37:41.637 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.616+0000 7f5f49e2f800 20 add_watcher() i=1 2024-09-22T08:37:41.638 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.616+0000 7f5f49e2f800 20 add_watcher() i=2 2024-09-22T08:37:41.638 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.616+0000 7f5f49e2f800 20 add_watcher() i=3 2024-09-22T08:37:41.638 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.616+0000 7f5f49e2f800 20 add_watcher() i=4 2024-09-22T08:37:41.638 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.616+0000 7f5f49e2f800 20 add_watcher() i=5 2024-09-22T08:37:41.638 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.616+0000 7f5f49e2f800 20 add_watcher() i=6 2024-09-22T08:37:41.638 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.617+0000 7f5f47118640 1 -- 172.21.15.142:0/4242929127 <== osd.0 v2:172.21.15.31:6800/168281188 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94116871632864] v32'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f30029040 con 0x7f5f380a5040 2024-09-22T08:37:41.639 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.617+0000 7f5f49e2f800 20 add_watcher() i=7 2024-09-22T08:37:41.639 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.617+0000 7f5f49e2f800 2 all 8 watchers are set, enabling cache 2024-09-22T08:37:41.639 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.617+0000 7f5f49e2f800 1 -- 172.21.15.142:0/4242929127 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55994ab3b660 con 0x55994ab27610 2024-09-22T08:37:41.639 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.617+0000 7f5f47118640 1 -- 172.21.15.142:0/4242929127 <== osd.1 v2:172.21.15.142:6816/3192108003 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f5f30029040 con 0x55994ab27610 2024-09-22T08:37:41.639 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.617+0000 7f5f49e2f800 1 -- 172.21.15.142:0/4242929127 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94116871635056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55994ab38a30 con 0x55994ab27610 2024-09-22T08:37:41.639 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.618+0000 7f5f47118640 1 -- 172.21.15.142:0/4242929127 <== osd.1 v2:172.21.15.142:6816/3192108003 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94116871635056] v32'200 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5f30029040 con 0x55994ab27610 2024-09-22T08:37:41.639 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.619+0000 7f5dfdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:37:41.640 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.619+0000 7f5f49e2f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:37:41.640 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.619+0000 7f5f49e2f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:37:41.640 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.619+0000 7f5f49e2f800 5 note: GC not initialized 2024-09-22T08:37:41.640 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.619+0000 7f5dfcfe1640 20 reqs_thread_entry: start 2024-09-22T08:37:41.640 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.619+0000 7f5f49e2f800 20 init_complete bucket index max shards: 11 2024-09-22T08:37:41.640 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.619+0000 7f5f49e2f800 20 Filter name: none 2024-09-22T08:37:41.640 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.619+0000 7f5d767fc640 20 reqs_thread_entry: start 2024-09-22T08:37:41.641 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.619+0000 7f5f49e2f800 20 rados->read ofs=0 len=0 2024-09-22T08:37:41.641 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.619+0000 7f5f49e2f800 1 -- 172.21.15.142:0/4242929127 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55994ab6e550 con 0x55994ab27610 2024-09-22T08:37:41.641 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.620+0000 7f5f47118640 1 -- 172.21.15.142:0/4242929127 <== osd.1 v2:172.21.15.142:6816/3192108003 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f5f30029040 con 0x55994ab27610 2024-09-22T08:37:41.641 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.620+0000 7f5f49e2f800 20 rados_obj.operate() r=0 bl.length=391 2024-09-22T08:37:41.641 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.620+0000 7f5f49e2f800 1 -- 172.21.15.142:0/4242929127 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55994ab6fad0 con 0x7f5f380a5040 2024-09-22T08:37:41.641 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.620+0000 7f5f47118640 1 -- 172.21.15.142:0/4242929127 <== osd.0 v2:172.21.15.31:6800/168281188 16 ==== osd_op_reply(63 usage.10 [call out=1378b] v0'0 uv29 ondisk = 0) ==== 152+0+1378 (crc 0 0 0) 0x7f5f30029040 con 0x7f5f380a5040 2024-09-22T08:37:41.641 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.621+0000 7f5dfdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:37:41.641 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.621+0000 7f5f49e2f800 1 -- 172.21.15.142:0/4242929127 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94116871635056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55994ab6de70 con 0x55994ab27610 2024-09-22T08:37:41.641 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.622+0000 7f5f47118640 1 -- 172.21.15.142:0/4242929127 <== osd.1 v2:172.21.15.142:6816/3192108003 23 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94116871635056] v32'201 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5f30029040 con 0x55994ab27610 2024-09-22T08:37:41.641 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.622+0000 7f5f49e2f800 1 -- 172.21.15.142:0/4242929127 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94116871611296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55994ab6de70 con 0x7f5f40013070 2024-09-22T08:37:41.641 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.623+0000 7f5f47919640 1 -- 172.21.15.142:0/4242929127 <== osd.2 v2:172.21.15.142:6808/279438927 11 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94116871611296] v32'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f38051070 con 0x7f5f40013070 2024-09-22T08:37:41.641 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.623+0000 7f5f49e2f800 20 remove_watcher() i=0 2024-09-22T08:37:41.642 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.623+0000 7f5f49e2f800 2 removed watcher, disabling cache 2024-09-22T08:37:41.642 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.623+0000 7f5f49e2f800 1 -- 172.21.15.142:0/4242929127 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94116871615760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55994ab323a0 con 0x55994ab27610 2024-09-22T08:37:41.642 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.624+0000 7f5f47118640 1 -- 172.21.15.142:0/4242929127 <== osd.1 v2:172.21.15.142:6816/3192108003 24 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94116871615760] v32'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f30029040 con 0x55994ab27610 2024-09-22T08:37:41.642 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.624+0000 7f5f49e2f800 20 remove_watcher() i=1 2024-09-22T08:37:41.642 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.624+0000 7f5f49e2f800 1 -- 172.21.15.142:0/4242929127 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94116871620800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55994ab323a0 con 0x55994ab2be80 2024-09-22T08:37:41.646 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.625+0000 7f5f4811a640 1 -- 172.21.15.142:0/4242929127 <== osd.3 v2:172.21.15.142:6800/1064901393 16 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94116871620800] v32'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f40054d70 con 0x55994ab2be80 2024-09-22T08:37:41.646 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.625+0000 7f5f49e2f800 20 remove_watcher() i=2 2024-09-22T08:37:41.646 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.625+0000 7f5f49e2f800 1 -- 172.21.15.142:0/4242929127 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94116871623600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55994ab323a0 con 0x7f5f40013070 2024-09-22T08:37:41.646 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.626+0000 7f5f47919640 1 -- 172.21.15.142:0/4242929127 <== osd.2 v2:172.21.15.142:6808/279438927 12 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94116871623600] v32'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f38051070 con 0x7f5f40013070 2024-09-22T08:37:41.646 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.626+0000 7f5f49e2f800 20 remove_watcher() i=3 2024-09-22T08:37:41.646 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.626+0000 7f5f49e2f800 1 -- 172.21.15.142:0/4242929127 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94116871625920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55994ab323a0 con 0x55994ab27610 2024-09-22T08:37:41.646 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.628+0000 7f5f47118640 1 -- 172.21.15.142:0/4242929127 <== osd.1 v2:172.21.15.142:6816/3192108003 25 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94116871625920] v32'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f30029040 con 0x55994ab27610 2024-09-22T08:37:41.647 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.628+0000 7f5f49e2f800 20 remove_watcher() i=4 2024-09-22T08:37:41.647 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.628+0000 7f5f49e2f800 1 -- 172.21.15.142:0/4242929127 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94116871628928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55994ab35cc0 con 0x7f5f380a5040 2024-09-22T08:37:41.647 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.629+0000 7f5f47118640 1 -- 172.21.15.142:0/4242929127 <== osd.0 v2:172.21.15.31:6800/168281188 17 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94116871628928] v32'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f30029040 con 0x7f5f380a5040 2024-09-22T08:37:41.647 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.629+0000 7f5f49e2f800 20 remove_watcher() i=5 2024-09-22T08:37:41.647 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.629+0000 7f5f49e2f800 1 -- 172.21.15.142:0/4242929127 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94116871629984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55994ab323a0 con 0x7f5f380a5040 2024-09-22T08:37:41.647 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.630+0000 7f5f47118640 1 -- 172.21.15.142:0/4242929127 <== osd.0 v2:172.21.15.31:6800/168281188 18 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94116871629984] v32'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f30029040 con 0x7f5f380a5040 2024-09-22T08:37:41.647 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.630+0000 7f5f49e2f800 20 remove_watcher() i=6 2024-09-22T08:37:41.647 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.630+0000 7f5f49e2f800 1 -- 172.21.15.142:0/4242929127 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94116871632864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55994ab323a0 con 0x7f5f380a5040 2024-09-22T08:37:41.647 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.631+0000 7f5f47118640 1 -- 172.21.15.142:0/4242929127 <== osd.0 v2:172.21.15.31:6800/168281188 19 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94116871632864] v32'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f30029040 con 0x7f5f380a5040 2024-09-22T08:37:41.647 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.631+0000 7f5f49e2f800 20 remove_watcher() i=7 2024-09-22T08:37:41.647 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.631+0000 7f5f49e2f800 1 -- 172.21.15.142:0/4242929127 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f5f380a5040 msgr2=0x7f5f38074480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:41.647 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.631+0000 7f5f49e2f800 1 --2- 172.21.15.142:0/4242929127 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f5f380a5040 0x7f5f38074480 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:41.647 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.631+0000 7f5f49e2f800 1 -- 172.21.15.142:0/4242929127 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55994ab27610 msgr2=0x55994ab29ad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:41.647 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.631+0000 7f5f49e2f800 1 --2- 172.21.15.142:0/4242929127 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55994ab27610 0x55994ab29ad0 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:41.648 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.631+0000 7f5f49e2f800 1 -- 172.21.15.142:0/4242929127 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f5f40013070 msgr2=0x7f5f40034440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:41.648 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.631+0000 7f5f49e2f800 1 --2- 172.21.15.142:0/4242929127 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f5f40013070 0x7f5f40034440 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:41.648 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.631+0000 7f5f49e2f800 1 -- 172.21.15.142:0/4242929127 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55994ab2be80 msgr2=0x55994ab2e270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:41.648 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.631+0000 7f5f49e2f800 1 --2- 172.21.15.142:0/4242929127 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55994ab2be80 0x55994ab2e270 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:41.648 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.631+0000 7f5f49e2f800 1 -- 172.21.15.142:0/4242929127 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f5e1003cfb0 msgr2=0x7f5e1003f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:41.648 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.631+0000 7f5f49e2f800 1 --2- 172.21.15.142:0/4242929127 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f5e1003cfb0 0x7f5e1003f470 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f5f3805d6f0 tx=0x7f5f38089000 comp rx=0 tx=0).stop 2024-09-22T08:37:41.648 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.631+0000 7f5f49e2f800 1 -- 172.21.15.142:0/4242929127 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55994ab14720 msgr2=0x55994ab1bcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:41.648 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.631+0000 7f5f49e2f800 1 --2- 172.21.15.142:0/4242929127 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55994ab14720 0x55994ab1bcf0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f5f400294e0 tx=0x7f5f400548f0 comp rx=0 tx=0).stop 2024-09-22T08:37:41.648 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.631+0000 7f5f47118640 1 -- 172.21.15.142:0/4242929127 reap_dead start 2024-09-22T08:37:41.648 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.632+0000 7f5f47118640 1 -- 172.21.15.142:0/4242929127 reap_dead start 2024-09-22T08:37:41.648 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.632+0000 7f5f49e2f800 1 -- 172.21.15.142:0/4242929127 shutdown_connections 2024-09-22T08:37:41.648 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.632+0000 7f5f49e2f800 1 -- 172.21.15.142:0/4242929127 >> 172.21.15.142:0/4242929127 conn(0x55994ab10b20 msgr2=0x55994ab0ed30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:37:41.648 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.632+0000 7f5f49e2f800 1 -- 172.21.15.142:0/4242929127 shutdown_connections 2024-09-22T08:37:41.649 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.632+0000 7f5f49e2f800 1 -- 172.21.15.142:0/4242929127 wait complete. 2024-09-22T08:37:41.649 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.632+0000 7f5f49e2f800 1 -- 172.21.15.142:0/407505952 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f5e2003cfb0 msgr2=0x7f5e2003f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:41.649 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.632+0000 7f5f49e2f800 1 --2- 172.21.15.142:0/407505952 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f5e2003cfb0 0x7f5e2003f470 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x55994aaef1b0 tx=0x7f5f3805d640 comp rx=0 tx=0).stop 2024-09-22T08:37:41.649 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.632+0000 7f5f49e2f800 1 -- 172.21.15.142:0/407505952 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55994aaeae20 msgr2=0x55994aae9690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:41.649 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.632+0000 7f5f49e2f800 1 --2- 172.21.15.142:0/407505952 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55994aaeae20 0x55994aae9690 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x55994aaf26c0 tx=0x7f5f400163e0 comp rx=0 tx=0).stop 2024-09-22T08:37:41.649 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.632+0000 7f5f49e2f800 1 -- 172.21.15.142:0/407505952 shutdown_connections 2024-09-22T08:37:41.649 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.632+0000 7f5f49e2f800 1 --2- 172.21.15.142:0/407505952 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f5e2003cfb0 0x7f5e2003f470 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:41.649 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.632+0000 7f5f49e2f800 1 --2- 172.21.15.142:0/407505952 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55994aaeae20 0x55994aae9690 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:41.649 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.632+0000 7f5f49e2f800 1 -- 172.21.15.142:0/407505952 >> 172.21.15.142:0/407505952 conn(0x55994aaf9e20 msgr2=0x55994aafa200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:37:41.649 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.632+0000 7f5f49e2f800 1 -- 172.21.15.142:0/407505952 shutdown_connections 2024-09-22T08:37:41.649 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.632+0000 7f5f49e2f800 1 -- 172.21.15.142:0/407505952 wait complete. 2024-09-22T08:37:41.649 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.632+0000 7f5f49e2f800 1 -- 172.21.15.142:0/2356386888 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55994a9f3a30 msgr2=0x55994aaf1ca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:41.649 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.632+0000 7f5f49e2f800 1 --2- 172.21.15.142:0/2356386888 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55994a9f3a30 0x55994aaf1ca0 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:41.650 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.632+0000 7f5f49e2f800 1 -- 172.21.15.142:0/2356386888 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55994aaf4540 msgr2=0x55994aaf69d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:41.650 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.632+0000 7f5f49e2f800 1 --2- 172.21.15.142:0/2356386888 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55994aaf4540 0x55994aaf69d0 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:41.650 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.632+0000 7f5f49e2f800 1 -- 172.21.15.142:0/2356386888 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f5e3003cfb0 msgr2=0x7f5e3003f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:41.650 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.632+0000 7f5f49e2f800 1 --2- 172.21.15.142:0/2356386888 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f5e3003cfb0 0x7f5e3003f470 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f5f30004170 tx=0x7f5f30001330 comp rx=0 tx=0).stop 2024-09-22T08:37:41.650 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.632+0000 7f5f49e2f800 1 -- 172.21.15.142:0/2356386888 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55994a9f27f0 msgr2=0x55994a967180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:41.650 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.632+0000 7f5f49e2f800 1 --2- 172.21.15.142:0/2356386888 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55994a9f27f0 0x55994a967180 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f5f38025c20 tx=0x7f5f38002fb0 comp rx=0 tx=0).stop 2024-09-22T08:37:41.650 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.633+0000 7f5f49e2f800 1 -- 172.21.15.142:0/2356386888 shutdown_connections 2024-09-22T08:37:41.650 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.633+0000 7f5f49e2f800 1 --2- 172.21.15.142:0/2356386888 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55994aaf4540 0x55994aaf69d0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:41.650 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.633+0000 7f5f49e2f800 1 --2- 172.21.15.142:0/2356386888 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55994a9f3a30 0x55994aaf1ca0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:41.650 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.633+0000 7f5f49e2f800 1 --2- 172.21.15.142:0/2356386888 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f5e3003cfb0 0x7f5e3003f470 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:41.650 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.633+0000 7f5f49e2f800 1 --2- 172.21.15.142:0/2356386888 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55994a9f27f0 0x55994a967180 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:41.650 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.633+0000 7f5f49e2f800 1 -- 172.21.15.142:0/2356386888 >> 172.21.15.142:0/2356386888 conn(0x55994a9edbe0 msgr2=0x55994aadc040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:37:41.650 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.633+0000 7f5f49e2f800 1 -- 172.21.15.142:0/2356386888 shutdown_connections 2024-09-22T08:37:41.651 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.633+0000 7f5f49e2f800 1 -- 172.21.15.142:0/2356386888 wait complete. 2024-09-22T08:37:41.651 INFO:teuthology.orchestra.run.smithi142.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-09-22T08:00:00.000000Z","epoch":1726992000,"owner":"foo","categories":[{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}},{"bucket":"myfoo","time":"2024-09-22T08:00:00.000000Z","epoch":1726992000,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":5,"successful_ops":5},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":2,"successful_ops":1},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"s3select":{"bytes_processed":0,"bytes_returned":0}},{"bucket":"myfoo2","time":"2024-09-22T08:00:00.000000Z","epoch":1726992000,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}},{"bucket":"myfoo3","time":"2024-09-22T08:00:00.000000Z","epoch":1726992000,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}},{"bucket":"myfoo4","time":"2024-09-22T08:00:00.000000Z","epoch":1726992000,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}}]}],"summary":[{"user":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"total":{"bytes_sent":2103,"bytes_received":30000042,"ops":35,"successful_ops":34,"bytes_processed":0,"bytes_returned":0}}]} 2024-09-22T08:37:41.652 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-22T08:00:00.000000Z', 'epoch': 1726992000, 'owner': 'foo', 'categories': [{'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo', 'time': '2024-09-22T08:00:00.000000Z', 'epoch': 1726992000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 5, 'successful_ops': 5}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 2, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo2', 'time': '2024-09-22T08:00:00.000000Z', 'epoch': 1726992000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo3', 'time': '2024-09-22T08:00:00.000000Z', 'epoch': 1726992000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo4', 'time': '2024-09-22T08:00:00.000000Z', 'epoch': 1726992000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 'total': {'bytes_sent': 2103, 'bytes_received': 30000042, 'ops': 35, 'successful_ops': 34, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-22T08:37:41.652 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'create_bucket'] 2024-09-22T08:37:41.652 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'create_bucket'] 2024-09-22T08:37:41.652 DEBUG:teuthology.orchestra.run.smithi142:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories create_bucket 2024-09-22T08:37:41.698 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:37:41.699 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:37:41.700 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.698+0000 7f61a192f800 1 Processor -- start 2024-09-22T08:37:41.700 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.698+0000 7f61a192f800 1 -- start start 2024-09-22T08:37:41.700 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.698+0000 7f61a192f800 1 --2- >> v2:172.21.15.31:3300/0 conn(0x5619dd325bf0 0x5619dd3280b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:41.700 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.698+0000 7f61a192f800 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5619dd1aaa20 con 0x5619dd293510 2024-09-22T08:37:41.700 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.698+0000 7f61a192f800 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x5619dd1aa7d0 con 0x5619dd325bf0 2024-09-22T08:37:41.700 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.699+0000 7f619ce75640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x5619dd325bf0 0x5619dd3280b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:41.700 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.699+0000 7f619d676640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x5619dd293510 0x5619dd3244d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.142:50260/0 (socket says 172.21.15.142:50260) 2024-09-22T08:37:41.700 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.699+0000 7f619d676640 1 -- 172.21.15.142:0/1521056585 learned_addr learned my addr 172.21.15.142:0/1521056585 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-09-22T08:37:41.700 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.699+0000 7f619ce75640 1 -- 172.21.15.142:0/1521056585 >> v1:172.21.15.31:6789/0 conn(0x5619dd293510 legacy=0x5619dd3244d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:41.700 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.699+0000 7f619ce75640 1 -- 172.21.15.142:0/1521056585 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5619dd329790 con 0x5619dd325bf0 2024-09-22T08:37:41.702 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.701+0000 7f619ce75640 1 --2- 172.21.15.142:0/1521056585 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5619dd325bf0 0x5619dd3280b0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f619400a470 tx=0x7f6194045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=749d42a1ae8fe8b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:41.702 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.701+0000 7f618ffff640 1 -- 172.21.15.142:0/1521056585 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6194053570 con 0x5619dd325bf0 2024-09-22T08:37:41.702 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.701+0000 7f618ffff640 1 -- 172.21.15.142:0/1521056585 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6194058070 con 0x5619dd325bf0 2024-09-22T08:37:41.702 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.701+0000 7f618ffff640 1 -- 172.21.15.142:0/1521056585 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6194053880 con 0x5619dd325bf0 2024-09-22T08:37:41.703 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.701+0000 7f61a192f800 1 -- 172.21.15.142:0/1521056585 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5619dd325bf0 msgr2=0x5619dd3280b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:41.703 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.701+0000 7f61a192f800 1 --2- 172.21.15.142:0/1521056585 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5619dd325bf0 0x5619dd3280b0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f619400a470 tx=0x7f6194045a20 comp rx=0 tx=0).stop 2024-09-22T08:37:41.703 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.701+0000 7f61a192f800 1 -- 172.21.15.142:0/1521056585 shutdown_connections 2024-09-22T08:37:41.703 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.701+0000 7f61a192f800 1 --2- 172.21.15.142:0/1521056585 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5619dd325bf0 0x5619dd3280b0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:41.703 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.701+0000 7f61a192f800 1 -- 172.21.15.142:0/1521056585 >> 172.21.15.142:0/1521056585 conn(0x5619dd319be0 msgr2=0x5619dd31c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:37:41.703 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.701+0000 7f61a192f800 1 -- 172.21.15.142:0/1521056585 shutdown_connections 2024-09-22T08:37:41.703 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.701+0000 7f61a192f800 1 -- 172.21.15.142:0/1521056585 wait complete. 2024-09-22T08:37:41.716 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.715+0000 7f61a192f800 1 Processor -- start 2024-09-22T08:37:41.716 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.715+0000 7f61a192f800 1 -- start start 2024-09-22T08:37:41.716 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.715+0000 7f61a192f800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5619dd293510 0x5619dd411240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:41.716 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.715+0000 7f61a192f800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5619dd1b7dd0 con 0x5619dd293510 2024-09-22T08:37:41.717 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.716+0000 7f619d676640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5619dd293510 0x5619dd411240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:41.717 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.716+0000 7f619d676640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5619dd293510 0x5619dd411240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:55674/0 (socket says 172.21.15.142:55674) 2024-09-22T08:37:41.717 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.716+0000 7f619d676640 1 -- 172.21.15.142:0/1743894734 learned_addr learned my addr 172.21.15.142:0/1743894734 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:37:41.717 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.716+0000 7f619d676640 1 -- 172.21.15.142:0/1743894734 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5619dd411830 con 0x5619dd293510 2024-09-22T08:37:41.717 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.716+0000 7f619d676640 1 --2- 172.21.15.142:0/1743894734 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5619dd293510 0x5619dd411240 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f6190001e40 tx=0x7f6190001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d696904a935f41a3 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:41.718 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.716+0000 7f608b606640 1 -- 172.21.15.142:0/1743894734 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6190012020 con 0x5619dd293510 2024-09-22T08:37:41.718 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.716+0000 7f608b606640 1 -- 172.21.15.142:0/1743894734 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f619000e5a0 con 0x5619dd293510 2024-09-22T08:37:41.718 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.716+0000 7f608b606640 1 -- 172.21.15.142:0/1743894734 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f619000e8a0 con 0x5619dd293510 2024-09-22T08:37:41.720 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.717+0000 7f61a192f800 1 -- 172.21.15.142:0/1743894734 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5619dd293510 msgr2=0x5619dd411240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:41.720 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.717+0000 7f61a192f800 1 --2- 172.21.15.142:0/1743894734 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5619dd293510 0x5619dd411240 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f6190001e40 tx=0x7f6190001e70 comp rx=0 tx=0).stop 2024-09-22T08:37:41.720 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.717+0000 7f61a192f800 1 -- 172.21.15.142:0/1743894734 shutdown_connections 2024-09-22T08:37:41.720 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.717+0000 7f61a192f800 1 --2- 172.21.15.142:0/1743894734 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5619dd293510 0x5619dd411240 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:41.720 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.717+0000 7f61a192f800 1 -- 172.21.15.142:0/1743894734 >> 172.21.15.142:0/1743894734 conn(0x5619dd319be0 msgr2=0x5619dd40cbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:37:41.720 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.717+0000 7f61a192f800 1 -- 172.21.15.142:0/1743894734 shutdown_connections 2024-09-22T08:37:41.720 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.717+0000 7f61a192f800 1 -- 172.21.15.142:0/1743894734 wait complete. 2024-09-22T08:37:41.720 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.717+0000 7f61a192f800 1 Processor -- start 2024-09-22T08:37:41.720 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.717+0000 7f61a192f800 1 -- start start 2024-09-22T08:37:41.720 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.717+0000 7f61a192f800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5619dd293510 0x5619dd418d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:41.720 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.717+0000 7f61a192f800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5619dd328a30 con 0x5619dd293510 2024-09-22T08:37:41.720 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.718+0000 7f619d676640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5619dd293510 0x5619dd418d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:41.720 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.718+0000 7f619d676640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5619dd293510 0x5619dd418d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:55676/0 (socket says 172.21.15.142:55676) 2024-09-22T08:37:41.721 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.718+0000 7f619d676640 1 -- 172.21.15.142:0/196442788 learned_addr learned my addr 172.21.15.142:0/196442788 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:37:41.721 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.718+0000 7f619d676640 1 -- 172.21.15.142:0/196442788 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5619dd4192c0 con 0x5619dd293510 2024-09-22T08:37:41.721 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.718+0000 7f619d676640 1 --2- 172.21.15.142:0/196442788 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5619dd293510 0x5619dd418d60 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f61900012b0 tx=0x7f6190000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:41.721 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.718+0000 7f6089e03640 1 -- 172.21.15.142:0/196442788 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6190012030 con 0x5619dd293510 2024-09-22T08:37:41.721 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.718+0000 7f61a192f800 1 -- 172.21.15.142:0/196442788 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5619dd419550 con 0x5619dd293510 2024-09-22T08:37:41.721 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.718+0000 7f6089e03640 1 -- 172.21.15.142:0/196442788 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f619001a750 con 0x5619dd293510 2024-09-22T08:37:41.721 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.718+0000 7f6089e03640 1 -- 172.21.15.142:0/196442788 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f619001aa70 con 0x5619dd293510 2024-09-22T08:37:41.721 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.718+0000 7f61a192f800 1 -- 172.21.15.142:0/196442788 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5619dd419f50 con 0x5619dd293510 2024-09-22T08:37:41.724 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.719+0000 7f6089e03640 1 -- 172.21.15.142:0/196442788 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f6190015020 con 0x5619dd293510 2024-09-22T08:37:41.724 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.720+0000 7f6089e03640 1 --2- 172.21.15.142:0/196442788 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f608403d000 0x7f608403f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:41.724 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.720+0000 7f6089e03640 1 -- 172.21.15.142:0/196442788 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5938+0+0 (secure 0 0 0) 0x7f6190020030 con 0x5619dd293510 2024-09-22T08:37:41.724 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.720+0000 7f619ce75640 1 --2- 172.21.15.142:0/196442788 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f608403d000 0x7f608403f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:41.724 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.720+0000 7f61a192f800 1 --2- 172.21.15.142:0/196442788 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5619dd325bf0 0x5619dd4203b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:41.724 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.720+0000 7f61a192f800 1 -- 172.21.15.142:0/196442788 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5619dd4208f0 con 0x5619dd325bf0 2024-09-22T08:37:41.724 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.720+0000 7f619de77640 1 --2- 172.21.15.142:0/196442788 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5619dd325bf0 0x5619dd4203b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:41.724 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.720+0000 7f619ce75640 1 --2- 172.21.15.142:0/196442788 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f608403d000 0x7f608403f4c0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f6194057000 tx=0x7f6194052000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:41.724 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.720+0000 7f619de77640 1 --2- 172.21.15.142:0/196442788 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5619dd325bf0 0x5619dd4203b0 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:41.724 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.720+0000 7f619de77640 1 -- 172.21.15.142:0/196442788 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f619800a4d0 con 0x5619dd325bf0 2024-09-22T08:37:41.724 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.720+0000 7f61a192f800 1 -- 172.21.15.142:0/196442788 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5619dd420c90 con 0x5619dd325bf0 2024-09-22T08:37:41.725 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.721+0000 7f619de77640 1 -- 172.21.15.142:0/196442788 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f619800a4d0 con 0x5619dd325bf0 2024-09-22T08:37:41.725 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.721+0000 7f61a192f800 1 --2- 172.21.15.142:0/196442788 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5619dd422750 0x5619dd424bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:41.725 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.721+0000 7f61a192f800 1 -- 172.21.15.142:0/196442788 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:3 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5619dd425380 con 0x5619dd422750 2024-09-22T08:37:41.725 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.721+0000 7f619d676640 1 --2- 172.21.15.142:0/196442788 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5619dd422750 0x5619dd424bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:41.725 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.721+0000 7f619d676640 1 --2- 172.21.15.142:0/196442788 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5619dd422750 0x5619dd424bf0 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:41.725 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.721+0000 7f619d676640 1 -- 172.21.15.142:0/196442788 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(3 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f6190018ce0 con 0x5619dd422750 2024-09-22T08:37:41.725 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.721+0000 7f61a192f800 1 -- 172.21.15.142:0/196442788 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5619dd4214e0 con 0x5619dd325bf0 2024-09-22T08:37:41.725 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.722+0000 7f619de77640 1 -- 172.21.15.142:0/196442788 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f619800a4d0 con 0x5619dd325bf0 2024-09-22T08:37:41.725 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.722+0000 7f61a192f800 1 -- 172.21.15.142:0/196442788 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5619dd4218c0 con 0x5619dd422750 2024-09-22T08:37:41.725 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.722+0000 7f619d676640 1 -- 172.21.15.142:0/196442788 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(5 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f6190018ce0 con 0x5619dd422750 2024-09-22T08:37:41.725 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.722+0000 7f61a192f800 1 Processor -- start 2024-09-22T08:37:41.725 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.722+0000 7f61a192f800 1 -- start start 2024-09-22T08:37:41.725 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.723+0000 7f61a192f800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5619dd433d40 0x5619dd434160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:41.725 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.723+0000 7f61a192f800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5619dd216d50 con 0x5619dd433d40 2024-09-22T08:37:41.725 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.723+0000 7f619de77640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5619dd433d40 0x5619dd434160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:41.726 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.723+0000 7f619de77640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5619dd433d40 0x5619dd434160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:55692/0 (socket says 172.21.15.142:55692) 2024-09-22T08:37:41.726 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.723+0000 7f619de77640 1 -- 172.21.15.142:0/3883655982 learned_addr learned my addr 172.21.15.142:0/3883655982 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:37:41.734 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.723+0000 7f619de77640 1 -- 172.21.15.142:0/3883655982 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5619dd4347a0 con 0x5619dd433d40 2024-09-22T08:37:41.734 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.723+0000 7f619de77640 1 --2- 172.21.15.142:0/3883655982 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5619dd433d40 0x5619dd434160 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x5619dd419bf0 tx=0x7f61980167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:41.734 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.723+0000 7f6082ffd640 1 -- 172.21.15.142:0/3883655982 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6198013640 con 0x5619dd433d40 2024-09-22T08:37:41.734 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.723+0000 7f6082ffd640 1 -- 172.21.15.142:0/3883655982 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61980137e0 con 0x5619dd433d40 2024-09-22T08:37:41.735 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.723+0000 7f61a192f800 1 -- 172.21.15.142:0/3883655982 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5619dd434fd0 con 0x5619dd433d40 2024-09-22T08:37:41.735 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.723+0000 7f6082ffd640 1 -- 172.21.15.142:0/3883655982 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6198013ae0 con 0x5619dd433d40 2024-09-22T08:37:41.735 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.724+0000 7f61a192f800 1 -- 172.21.15.142:0/3883655982 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5619dd435570 con 0x5619dd433d40 2024-09-22T08:37:41.735 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.724+0000 7f6082ffd640 1 -- 172.21.15.142:0/3883655982 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f6198011040 con 0x5619dd433d40 2024-09-22T08:37:41.735 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.725+0000 7f6082ffd640 1 --2- 172.21.15.142:0/3883655982 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f607403d000 0x7f607403f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:41.735 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.725+0000 7f6082ffd640 1 -- 172.21.15.142:0/3883655982 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5938+0+0 (secure 0 0 0) 0x7f619800e040 con 0x5619dd433d40 2024-09-22T08:37:41.735 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.725+0000 7f619d676640 1 --2- 172.21.15.142:0/3883655982 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f607403d000 0x7f607403f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:41.735 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.725+0000 7f61a192f800 1 Processor -- start 2024-09-22T08:37:41.735 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.725+0000 7f619d676640 1 --2- 172.21.15.142:0/3883655982 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f607403d000 0x7f607403f4c0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x5619dd41ae60 tx=0x7f6190052a40 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:41.735 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.725+0000 7f61a192f800 1 -- start start 2024-09-22T08:37:41.735 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.725+0000 7f61a192f800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5619dd440820 0x5619dd440c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:41.736 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.725+0000 7f61a192f800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5619dd411c60 con 0x5619dd440820 2024-09-22T08:37:41.736 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.725+0000 7f619de77640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5619dd440820 0x5619dd440c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:41.736 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.725+0000 7f619de77640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5619dd440820 0x5619dd440c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:55700/0 (socket says 172.21.15.142:55700) 2024-09-22T08:37:41.736 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.725+0000 7f619de77640 1 -- 172.21.15.142:0/562897606 learned_addr learned my addr 172.21.15.142:0/562897606 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:37:41.736 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.726+0000 7f619de77640 1 -- 172.21.15.142:0/562897606 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5619dd441210 con 0x5619dd440820 2024-09-22T08:37:41.736 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.726+0000 7f619de77640 1 --2- 172.21.15.142:0/562897606 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5619dd440820 0x5619dd440c20 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f6198054860 tx=0x7f6198020ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27d58e694b9b9182 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:41.736 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.726+0000 7f6080ff9640 1 -- 172.21.15.142:0/562897606 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6198044030 con 0x5619dd440820 2024-09-22T08:37:41.736 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.726+0000 7f6080ff9640 1 -- 172.21.15.142:0/562897606 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6198021960 con 0x5619dd440820 2024-09-22T08:37:41.736 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.726+0000 7f6080ff9640 1 -- 172.21.15.142:0/562897606 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f619804de60 con 0x5619dd440820 2024-09-22T08:37:41.736 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.726+0000 7f61a192f800 1 -- 172.21.15.142:0/562897606 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5619dd440820 msgr2=0x5619dd440c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:41.736 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.726+0000 7f61a192f800 1 --2- 172.21.15.142:0/562897606 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5619dd440820 0x5619dd440c20 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f6198054860 tx=0x7f6198020ad0 comp rx=0 tx=0).stop 2024-09-22T08:37:41.736 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.726+0000 7f61a192f800 1 -- 172.21.15.142:0/562897606 shutdown_connections 2024-09-22T08:37:41.736 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.726+0000 7f61a192f800 1 --2- 172.21.15.142:0/562897606 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5619dd440820 0x5619dd440c20 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:41.737 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.726+0000 7f61a192f800 1 -- 172.21.15.142:0/562897606 >> 172.21.15.142:0/562897606 conn(0x5619dd43cc20 msgr2=0x5619dd43ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:37:41.737 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.726+0000 7f61a192f800 1 -- 172.21.15.142:0/562897606 shutdown_connections 2024-09-22T08:37:41.737 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.726+0000 7f61a192f800 1 -- 172.21.15.142:0/562897606 wait complete. 2024-09-22T08:37:41.737 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.727+0000 7f61a192f800 1 Processor -- start 2024-09-22T08:37:41.737 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.727+0000 7f61a192f800 1 -- start start 2024-09-22T08:37:41.737 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.727+0000 7f61a192f800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5619dd440820 0x5619dd447de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:41.737 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.727+0000 7f61a192f800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5619dd441830 con 0x5619dd440820 2024-09-22T08:37:41.737 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.727+0000 7f619de77640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5619dd440820 0x5619dd447de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:41.737 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.727+0000 7f619de77640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5619dd440820 0x5619dd447de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:55706/0 (socket says 172.21.15.142:55706) 2024-09-22T08:37:41.737 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.727+0000 7f619de77640 1 -- 172.21.15.142:0/2981544073 learned_addr learned my addr 172.21.15.142:0/2981544073 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:37:41.737 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.727+0000 7f619de77640 1 -- 172.21.15.142:0/2981544073 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5619dd448340 con 0x5619dd440820 2024-09-22T08:37:41.737 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.727+0000 7f619de77640 1 --2- 172.21.15.142:0/2981544073 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5619dd440820 0x5619dd447de0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f6198020510 tx=0x7f61980547c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:41.737 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.728+0000 7f6072ffd640 1 -- 172.21.15.142:0/2981544073 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6198054a30 con 0x5619dd440820 2024-09-22T08:37:41.737 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.728+0000 7f6072ffd640 1 -- 172.21.15.142:0/2981544073 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61980532b0 con 0x5619dd440820 2024-09-22T08:37:41.738 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.728+0000 7f61a192f800 1 -- 172.21.15.142:0/2981544073 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5619dd4485d0 con 0x5619dd440820 2024-09-22T08:37:41.738 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.728+0000 7f6072ffd640 1 -- 172.21.15.142:0/2981544073 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6198020bd0 con 0x5619dd440820 2024-09-22T08:37:41.738 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.728+0000 7f61a192f800 1 -- 172.21.15.142:0/2981544073 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5619dd449160 con 0x5619dd440820 2024-09-22T08:37:41.738 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.728+0000 7f6072ffd640 1 -- 172.21.15.142:0/2981544073 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f619801fa90 con 0x5619dd440820 2024-09-22T08:37:41.738 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.729+0000 7f6072ffd640 1 --2- 172.21.15.142:0/2981544073 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f606803cfb0 0x7f606803f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:41.738 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.729+0000 7f61a192f800 20 rados->read ofs=0 len=0 2024-09-22T08:37:41.738 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.729+0000 7f6072ffd640 1 -- 172.21.15.142:0/2981544073 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5938+0+0 (secure 0 0 0) 0x7f619804b070 con 0x5619dd440820 2024-09-22T08:37:41.738 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.729+0000 7f619d676640 1 --2- 172.21.15.142:0/2981544073 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f606803cfb0 0x7f606803f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:41.738 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.729+0000 7f61a192f800 1 --2- 172.21.15.142:0/2981544073 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5619dd4536d0 0x5619dd455b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:41.738 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.729+0000 7f61a192f800 1 -- 172.21.15.142:0/2981544073 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5619dd4562b0 con 0x5619dd4536d0 2024-09-22T08:37:41.739 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.729+0000 7f619ce75640 1 --2- 172.21.15.142:0/2981544073 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5619dd4536d0 0x5619dd455b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:41.739 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.729+0000 7f619d676640 1 --2- 172.21.15.142:0/2981544073 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f606803cfb0 0x7f606803f470 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f619003f010 tx=0x7f6190046000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:41.739 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.729+0000 7f619ce75640 1 --2- 172.21.15.142:0/2981544073 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5619dd4536d0 0x5619dd455b60 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:41.739 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.730+0000 7f619ce75640 1 -- 172.21.15.142:0/2981544073 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6194051070 con 0x5619dd4536d0 2024-09-22T08:37:41.739 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.730+0000 7f61a192f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:41.739 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.730+0000 7f61a192f800 20 realm 2024-09-22T08:37:41.739 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.730+0000 7f61a192f800 20 rados->read ofs=0 len=0 2024-09-22T08:37:41.739 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.730+0000 7f61a192f800 1 -- 172.21.15.142:0/2981544073 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5619dd456730 con 0x5619dd4536d0 2024-09-22T08:37:41.739 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.730+0000 7f619ce75640 1 -- 172.21.15.142:0/2981544073 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6194051070 con 0x5619dd4536d0 2024-09-22T08:37:41.739 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.730+0000 7f61a192f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:41.739 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.730+0000 7f61a192f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:37:41.739 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.730+0000 7f61a192f800 20 rados->read ofs=0 len=0 2024-09-22T08:37:41.739 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.730+0000 7f61a192f800 1 -- 172.21.15.142:0/2981544073 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5619dd457000 con 0x5619dd4536d0 2024-09-22T08:37:41.739 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.730+0000 7f619ce75640 1 -- 172.21.15.142:0/2981544073 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6194051070 con 0x5619dd4536d0 2024-09-22T08:37:41.740 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.730+0000 7f61a192f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:41.740 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.730+0000 7f61a192f800 20 rados->read ofs=0 len=0 2024-09-22T08:37:41.740 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.730+0000 7f61a192f800 1 -- 172.21.15.142:0/2981544073 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5619dd4573a0 con 0x5619dd4536d0 2024-09-22T08:37:41.740 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.730+0000 7f619ce75640 1 -- 172.21.15.142:0/2981544073 <== osd.1 v2:172.21.15.142:6816/3192108003 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6194051070 con 0x5619dd4536d0 2024-09-22T08:37:41.740 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.730+0000 7f61a192f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:37:41.740 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.730+0000 7f61a192f800 20 rados->read ofs=0 len=0 2024-09-22T08:37:41.740 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.730+0000 7f61a192f800 1 --2- 172.21.15.142:0/2981544073 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5619dd458100 0x5619dd45a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:41.740 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.730+0000 7f61a192f800 1 -- 172.21.15.142:0/2981544073 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5619dd45aa30 con 0x5619dd458100 2024-09-22T08:37:41.740 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.730+0000 7f619de77640 1 --2- 172.21.15.142:0/2981544073 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5619dd458100 0x5619dd45a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:41.740 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.731+0000 7f619de77640 1 --2- 172.21.15.142:0/2981544073 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5619dd458100 0x5619dd45a4f0 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:41.740 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.731+0000 7f619de77640 1 -- 172.21.15.142:0/2981544073 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(5 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f6198031070 con 0x5619dd458100 2024-09-22T08:37:41.740 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.731+0000 7f61a192f800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:37:41.740 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.731+0000 7f61a192f800 20 searching for the correct realm 2024-09-22T08:37:41.741 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.731+0000 7f61a192f800 1 -- 172.21.15.142:0/2981544073 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5619dd45c3a0 con 0x5619dd458100 2024-09-22T08:37:41.741 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.731+0000 7f619de77640 1 -- 172.21.15.142:0/2981544073 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6198031070 con 0x5619dd458100 2024-09-22T08:37:41.741 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.731+0000 7f619de77640 1 --2- 172.21.15.142:0/2981544073 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f6198022050 0x7f619803c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:41.741 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.731+0000 7f619de77640 1 -- 172.21.15.142:0/2981544073 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5619dd45c3a0 con 0x7f6198022050 2024-09-22T08:37:41.741 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.731+0000 7f619d676640 1 --2- 172.21.15.142:0/2981544073 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f6198022050 0x7f619803c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:41.741 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.732+0000 7f619d676640 1 --2- 172.21.15.142:0/2981544073 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f6198022050 0x7f619803c3a0 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:41.741 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.732+0000 7f619d676640 1 -- 172.21.15.142:0/2981544073 <== osd.2 v2:172.21.15.142:6808/279438927 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6190018ce0 con 0x7f6198022050 2024-09-22T08:37:41.741 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.732+0000 7f619d676640 1 --2- 172.21.15.142:0/2981544073 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f6190017050 0x7f61900167e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:41.741 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.732+0000 7f619d676640 1 -- 172.21.15.142:0/2981544073 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5619dd45c3a0 con 0x7f6190017050 2024-09-22T08:37:41.741 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.732+0000 7f619ce75640 1 --2- 172.21.15.142:0/2981544073 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f6190017050 0x7f61900167e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:41.741 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.733+0000 7f619ce75640 1 --2- 172.21.15.142:0/2981544073 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f6190017050 0x7f61900167e0 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:41.741 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.733+0000 7f619ce75640 1 -- 172.21.15.142:0/2981544073 <== osd.0 v2:172.21.15.31:6800/168281188 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6194051070 con 0x7f6190017050 2024-09-22T08:37:41.741 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.733+0000 7f619ce75640 1 -- 172.21.15.142:0/2981544073 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5619dd45c3a0 con 0x5619dd4536d0 2024-09-22T08:37:41.741 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.733+0000 7f619ce75640 1 -- 172.21.15.142:0/2981544073 <== osd.1 v2:172.21.15.142:6816/3192108003 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6194051070 con 0x5619dd4536d0 2024-09-22T08:37:41.742 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.733+0000 7f619ce75640 1 -- 172.21.15.142:0/2981544073 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5619dd45c3a0 con 0x5619dd4536d0 2024-09-22T08:37:41.742 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.733+0000 7f619ce75640 1 -- 172.21.15.142:0/2981544073 <== osd.1 v2:172.21.15.142:6816/3192108003 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6194051070 con 0x5619dd4536d0 2024-09-22T08:37:41.742 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.733+0000 7f619ce75640 1 -- 172.21.15.142:0/2981544073 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5619dd45c3a0 con 0x5619dd4536d0 2024-09-22T08:37:41.750 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.734+0000 7f619ce75640 1 -- 172.21.15.142:0/2981544073 <== osd.1 v2:172.21.15.142:6816/3192108003 7 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6194051070 con 0x5619dd4536d0 2024-09-22T08:37:41.751 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.734+0000 7f619ce75640 1 -- 172.21.15.142:0/2981544073 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5619dd45c3a0 con 0x7f6190017050 2024-09-22T08:37:41.751 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.734+0000 7f619ce75640 1 -- 172.21.15.142:0/2981544073 <== osd.0 v2:172.21.15.31:6800/168281188 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6194051070 con 0x7f6190017050 2024-09-22T08:37:41.751 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.734+0000 7f619ce75640 1 -- 172.21.15.142:0/2981544073 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5619dd45c3a0 con 0x7f6198022050 2024-09-22T08:37:41.751 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.734+0000 7f619d676640 1 -- 172.21.15.142:0/2981544073 <== osd.2 v2:172.21.15.142:6808/279438927 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6190018ce0 con 0x7f6198022050 2024-09-22T08:37:41.751 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.734+0000 7f619d676640 1 -- 172.21.15.142:0/2981544073 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5619dd45c3a0 con 0x5619dd458100 2024-09-22T08:37:41.751 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.734+0000 7f619de77640 1 -- 172.21.15.142:0/2981544073 <== osd.3 v2:172.21.15.142:6800/1064901393 3 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6198031070 con 0x5619dd458100 2024-09-22T08:37:41.751 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.734+0000 7f619de77640 1 -- 172.21.15.142:0/2981544073 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5619dd45c3a0 con 0x5619dd4536d0 2024-09-22T08:37:41.751 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.734+0000 7f619ce75640 1 -- 172.21.15.142:0/2981544073 <== osd.1 v2:172.21.15.142:6816/3192108003 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6194051070 con 0x5619dd4536d0 2024-09-22T08:37:41.751 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.734+0000 7f619ce75640 1 -- 172.21.15.142:0/2981544073 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5619dd45c3a0 con 0x7f6190017050 2024-09-22T08:37:41.751 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.735+0000 7f619ce75640 1 -- 172.21.15.142:0/2981544073 <== osd.0 v2:172.21.15.31:6800/168281188 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6194051070 con 0x7f6190017050 2024-09-22T08:37:41.751 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.735+0000 7f619ce75640 1 -- 172.21.15.142:0/2981544073 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5619dd45c3a0 con 0x5619dd4536d0 2024-09-22T08:37:41.751 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.735+0000 7f619ce75640 1 -- 172.21.15.142:0/2981544073 <== osd.1 v2:172.21.15.142:6816/3192108003 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6194051070 con 0x5619dd4536d0 2024-09-22T08:37:41.752 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.735+0000 7f619ce75640 1 -- 172.21.15.142:0/2981544073 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5619dd45c3a0 con 0x7f6198022050 2024-09-22T08:37:41.752 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.735+0000 7f619d676640 1 -- 172.21.15.142:0/2981544073 <== osd.2 v2:172.21.15.142:6808/279438927 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f6190018ce0 con 0x7f6198022050 2024-09-22T08:37:41.752 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.735+0000 7f619d676640 1 -- 172.21.15.142:0/2981544073 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5619dd45c3a0 con 0x5619dd458100 2024-09-22T08:37:41.752 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.735+0000 7f619de77640 1 -- 172.21.15.142:0/2981544073 <== osd.3 v2:172.21.15.142:6800/1064901393 4 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6198031070 con 0x5619dd458100 2024-09-22T08:37:41.752 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.735+0000 7f619de77640 1 -- 172.21.15.142:0/2981544073 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5619dd45c3a0 con 0x5619dd458100 2024-09-22T08:37:41.752 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.736+0000 7f619de77640 1 -- 172.21.15.142:0/2981544073 <== osd.3 v2:172.21.15.142:6800/1064901393 5 ==== osd_op_reply(20 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f6198031070 con 0x5619dd458100 2024-09-22T08:37:41.752 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.736+0000 7f619de77640 1 -- 172.21.15.142:0/2981544073 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5619dd45c3a0 con 0x7f6190017050 2024-09-22T08:37:41.752 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.736+0000 7f619ce75640 1 -- 172.21.15.142:0/2981544073 <== osd.0 v2:172.21.15.31:6800/168281188 4 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6194051070 con 0x7f6190017050 2024-09-22T08:37:41.752 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.736+0000 7f619ce75640 1 -- 172.21.15.142:0/2981544073 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5619dd45c3a0 con 0x5619dd458100 2024-09-22T08:37:41.752 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.736+0000 7f619de77640 1 -- 172.21.15.142:0/2981544073 <== osd.3 v2:172.21.15.142:6800/1064901393 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6198031070 con 0x5619dd458100 2024-09-22T08:37:41.753 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.736+0000 7f619de77640 1 -- 172.21.15.142:0/2981544073 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5619dd45c3a0 con 0x5619dd458100 2024-09-22T08:37:41.753 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.736+0000 7f619de77640 1 -- 172.21.15.142:0/2981544073 <== osd.3 v2:172.21.15.142:6800/1064901393 7 ==== osd_op_reply(23 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f6198031070 con 0x5619dd458100 2024-09-22T08:37:41.753 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.736+0000 7f619de77640 1 -- 172.21.15.142:0/2981544073 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5619dd45c3a0 con 0x5619dd4536d0 2024-09-22T08:37:41.753 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.737+0000 7f619ce75640 1 -- 172.21.15.142:0/2981544073 <== osd.1 v2:172.21.15.142:6816/3192108003 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6194051070 con 0x5619dd4536d0 2024-09-22T08:37:41.753 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.737+0000 7f619ce75640 1 -- 172.21.15.142:0/2981544073 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5619dd45c3a0 con 0x5619dd4536d0 2024-09-22T08:37:41.753 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.737+0000 7f619ce75640 1 -- 172.21.15.142:0/2981544073 <== osd.1 v2:172.21.15.142:6816/3192108003 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f6194051070 con 0x5619dd4536d0 2024-09-22T08:37:41.753 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.737+0000 7f619ce75640 1 -- 172.21.15.142:0/2981544073 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5619dd45c3a0 con 0x7f6190017050 2024-09-22T08:37:41.753 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.737+0000 7f619ce75640 1 -- 172.21.15.142:0/2981544073 <== osd.0 v2:172.21.15.31:6800/168281188 5 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6194051070 con 0x7f6190017050 2024-09-22T08:37:41.753 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.737+0000 7f619ce75640 1 -- 172.21.15.142:0/2981544073 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5619dd45c3a0 con 0x5619dd458100 2024-09-22T08:37:41.753 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.737+0000 7f619de77640 1 -- 172.21.15.142:0/2981544073 <== osd.3 v2:172.21.15.142:6800/1064901393 8 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6198031070 con 0x5619dd458100 2024-09-22T08:37:41.753 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.737+0000 7f619de77640 1 -- 172.21.15.142:0/2981544073 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5619dd45c3a0 con 0x7f6198022050 2024-09-22T08:37:41.753 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.737+0000 7f619d676640 1 -- 172.21.15.142:0/2981544073 <== osd.2 v2:172.21.15.142:6808/279438927 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6190018ce0 con 0x7f6198022050 2024-09-22T08:37:41.753 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.738+0000 7f619d676640 1 -- 172.21.15.142:0/2981544073 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5619dd45c3a0 con 0x5619dd4536d0 2024-09-22T08:37:41.753 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.738+0000 7f619ce75640 1 -- 172.21.15.142:0/2981544073 <== osd.1 v2:172.21.15.142:6816/3192108003 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6194051070 con 0x5619dd4536d0 2024-09-22T08:37:41.754 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.738+0000 7f619ce75640 1 -- 172.21.15.142:0/2981544073 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5619dd45c3a0 con 0x7f6190017050 2024-09-22T08:37:41.754 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.738+0000 7f619ce75640 1 -- 172.21.15.142:0/2981544073 <== osd.0 v2:172.21.15.31:6800/168281188 6 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6194051070 con 0x7f6190017050 2024-09-22T08:37:41.754 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.738+0000 7f619ce75640 1 -- 172.21.15.142:0/2981544073 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5619dd45c3a0 con 0x5619dd458100 2024-09-22T08:37:41.754 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.738+0000 7f619de77640 1 -- 172.21.15.142:0/2981544073 <== osd.3 v2:172.21.15.142:6800/1064901393 9 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6198031070 con 0x5619dd458100 2024-09-22T08:37:41.754 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.738+0000 7f619de77640 1 -- 172.21.15.142:0/2981544073 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5619dd45c3a0 con 0x7f6190017050 2024-09-22T08:37:41.754 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.739+0000 7f619ce75640 1 -- 172.21.15.142:0/2981544073 <== osd.0 v2:172.21.15.31:6800/168281188 7 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6194051070 con 0x7f6190017050 2024-09-22T08:37:41.754 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.739+0000 7f619ce75640 1 -- 172.21.15.142:0/2981544073 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5619dd45c3a0 con 0x7f6198022050 2024-09-22T08:37:41.754 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.739+0000 7f619d676640 1 -- 172.21.15.142:0/2981544073 <== osd.2 v2:172.21.15.142:6808/279438927 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6190018ce0 con 0x7f6198022050 2024-09-22T08:37:41.754 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.739+0000 7f619d676640 1 -- 172.21.15.142:0/2981544073 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5619dd45c3a0 con 0x5619dd458100 2024-09-22T08:37:41.754 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.739+0000 7f619de77640 1 -- 172.21.15.142:0/2981544073 <== osd.3 v2:172.21.15.142:6800/1064901393 10 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6198031070 con 0x5619dd458100 2024-09-22T08:37:41.754 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.739+0000 7f619de77640 1 -- 172.21.15.142:0/2981544073 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5619dd45c3a0 con 0x7f6190017050 2024-09-22T08:37:41.754 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.739+0000 7f619ce75640 1 -- 172.21.15.142:0/2981544073 <== osd.0 v2:172.21.15.31:6800/168281188 8 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6194051070 con 0x7f6190017050 2024-09-22T08:37:41.754 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.739+0000 7f619ce75640 1 -- 172.21.15.142:0/2981544073 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5619dd45c3a0 con 0x5619dd4536d0 2024-09-22T08:37:41.754 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.740+0000 7f619ce75640 1 -- 172.21.15.142:0/2981544073 <== osd.1 v2:172.21.15.142:6816/3192108003 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f6194051070 con 0x5619dd4536d0 2024-09-22T08:37:41.755 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.740+0000 7f619ce75640 1 -- 172.21.15.142:0/2981544073 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5619dd45c3a0 con 0x7f6198022050 2024-09-22T08:37:41.755 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.740+0000 7f619d676640 1 -- 172.21.15.142:0/2981544073 <== osd.2 v2:172.21.15.142:6808/279438927 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6190018ce0 con 0x7f6198022050 2024-09-22T08:37:41.755 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.740+0000 7f61a192f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:37:41.755 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.740+0000 7f61a192f800 20 RGWRados::pool_iterate: got zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec 2024-09-22T08:37:41.755 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.740+0000 7f61a192f800 20 RGWRados::pool_iterate: got zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f 2024-09-22T08:37:41.755 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.740+0000 7f61a192f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:37:41.755 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.740+0000 7f61a192f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:37:41.755 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.740+0000 7f61a192f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:37:41.755 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.740+0000 7f61a192f800 20 rados->read ofs=0 len=0 2024-09-22T08:37:41.755 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.740+0000 7f61a192f800 1 -- 172.21.15.142:0/2981544073 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5619dd45b4a0 con 0x5619dd4536d0 2024-09-22T08:37:41.755 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.740+0000 7f619ce75640 1 -- 172.21.15.142:0/2981544073 <== osd.1 v2:172.21.15.142:6816/3192108003 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6194051070 con 0x5619dd4536d0 2024-09-22T08:37:41.755 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.740+0000 7f61a192f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:41.755 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.740+0000 7f61a192f800 20 rados->read ofs=0 len=0 2024-09-22T08:37:41.755 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.740+0000 7f61a192f800 1 -- 172.21.15.142:0/2981544073 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5619dd45bd40 con 0x5619dd4536d0 2024-09-22T08:37:41.756 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.740+0000 7f619ce75640 1 -- 172.21.15.142:0/2981544073 <== osd.1 v2:172.21.15.142:6816/3192108003 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6194051070 con 0x5619dd4536d0 2024-09-22T08:37:41.756 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.740+0000 7f61a192f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:37:41.756 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.740+0000 7f61a192f800 20 rados->read ofs=0 len=0 2024-09-22T08:37:41.756 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.740+0000 7f61a192f800 1 -- 172.21.15.142:0/2981544073 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:40 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5619dd45b0e0 con 0x5619dd458100 2024-09-22T08:37:41.756 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.741+0000 7f619de77640 1 -- 172.21.15.142:0/2981544073 <== osd.3 v2:172.21.15.142:6800/1064901393 11 ==== osd_op_reply(40 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f6198031070 con 0x5619dd458100 2024-09-22T08:37:41.756 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.741+0000 7f61a192f800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:37:41.756 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.741+0000 7f61a192f800 20 zone default found 2024-09-22T08:37:41.756 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.741+0000 7f61a192f800 4 Realm: () 2024-09-22T08:37:41.756 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.741+0000 7f61a192f800 4 ZoneGroup: default (d89f6f57-1007-47dd-9065-f486c7b01aec) 2024-09-22T08:37:41.756 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.741+0000 7f61a192f800 4 Zone: default (e239248c-0bee-4e41-803a-24b288d3eb8f) 2024-09-22T08:37:41.756 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.741+0000 7f61a192f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:37:41.756 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.741+0000 7f61a192f800 20 zonegroup default 2024-09-22T08:37:41.756 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.741+0000 7f61a192f800 20 rados->read ofs=0 len=0 2024-09-22T08:37:41.756 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.741+0000 7f61a192f800 1 -- 172.21.15.142:0/2981544073 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5619dd45cd20 con 0x7f6190017050 2024-09-22T08:37:41.756 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.741+0000 7f619ce75640 1 -- 172.21.15.142:0/2981544073 <== osd.0 v2:172.21.15.31:6800/168281188 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f6194051070 con 0x7f6190017050 2024-09-22T08:37:41.757 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.741+0000 7f61a192f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:41.757 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.741+0000 7f61a192f800 20 rados->read ofs=0 len=0 2024-09-22T08:37:41.757 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.741+0000 7f61a192f800 1 -- 172.21.15.142:0/2981544073 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5619dd45ebb0 con 0x5619dd458100 2024-09-22T08:37:41.757 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.741+0000 7f619de77640 1 -- 172.21.15.142:0/2981544073 <== osd.3 v2:172.21.15.142:6800/1064901393 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6198031070 con 0x5619dd458100 2024-09-22T08:37:41.757 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.741+0000 7f61a192f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:41.757 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.741+0000 7f61a192f800 20 rados->read ofs=0 len=0 2024-09-22T08:37:41.757 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.741+0000 7f61a192f800 1 -- 172.21.15.142:0/2981544073 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5619dd45f050 con 0x5619dd458100 2024-09-22T08:37:41.757 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.741+0000 7f619de77640 1 -- 172.21.15.142:0/2981544073 <== osd.3 v2:172.21.15.142:6800/1064901393 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6198031070 con 0x5619dd458100 2024-09-22T08:37:41.757 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.741+0000 7f61a192f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:41.757 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.741+0000 7f61a192f800 20 started sync module instance, tier type = 2024-09-22T08:37:41.757 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.741+0000 7f61a192f800 20 started zone id=e239248c-0bee-4e41-803a-24b288d3eb8f (name=default) with tier type = 2024-09-22T08:37:41.757 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.741+0000 7f61a192f800 1 -- 172.21.15.142:0/2981544073 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5619dd45df50 con 0x7f6198022050 2024-09-22T08:37:41.757 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.742+0000 7f619d676640 1 -- 172.21.15.142:0/2981544073 <== osd.2 v2:172.21.15.142:6808/279438927 7 ==== osd_op_reply(44 notify.0 [create] v32'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6190018ce0 con 0x7f6198022050 2024-09-22T08:37:41.758 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.742+0000 7f61a192f800 1 -- 172.21.15.142:0/2981544073 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94669086516032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5619dd45dbb0 con 0x7f6198022050 2024-09-22T08:37:41.758 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.742+0000 7f61a192f800 1 -- 172.21.15.142:0/2981544073 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5619dd45ff80 con 0x5619dd4536d0 2024-09-22T08:37:41.758 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.743+0000 7f619d676640 1 -- 172.21.15.142:0/2981544073 <== osd.2 v2:172.21.15.142:6808/279438927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94669086516032] v32'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6190018ce0 con 0x7f6198022050 2024-09-22T08:37:41.758 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.744+0000 7f619ce75640 1 -- 172.21.15.142:0/2981544073 <== osd.1 v2:172.21.15.142:6816/3192108003 16 ==== osd_op_reply(46 notify.1 [create] v32'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6194051070 con 0x5619dd4536d0 2024-09-22T08:37:41.758 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.744+0000 7f61a192f800 1 -- 172.21.15.142:0/2981544073 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94669086522064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5619dd4603a0 con 0x5619dd4536d0 2024-09-22T08:37:41.758 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.744+0000 7f61a192f800 1 -- 172.21.15.142:0/2981544073 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5619dd460d60 con 0x5619dd458100 2024-09-22T08:37:41.758 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.745+0000 7f619ce75640 1 -- 172.21.15.142:0/2981544073 <== osd.1 v2:172.21.15.142:6816/3192108003 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94669086522064] v32'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6194051070 con 0x5619dd4536d0 2024-09-22T08:37:41.758 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.746+0000 7f619de77640 1 -- 172.21.15.142:0/2981544073 <== osd.3 v2:172.21.15.142:6800/1064901393 14 ==== osd_op_reply(48 notify.2 [create] v32'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6198031070 con 0x5619dd458100 2024-09-22T08:37:41.758 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.746+0000 7f61a192f800 1 -- 172.21.15.142:0/2981544073 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94669086523632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5619dd460d60 con 0x5619dd458100 2024-09-22T08:37:41.759 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.746+0000 7f61a192f800 1 -- 172.21.15.142:0/2981544073 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5619dd4617d0 con 0x7f6198022050 2024-09-22T08:37:41.759 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.747+0000 7f619d676640 1 -- 172.21.15.142:0/2981544073 <== osd.2 v2:172.21.15.142:6808/279438927 9 ==== osd_op_reply(50 notify.3 [create] v32'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6190018ce0 con 0x7f6198022050 2024-09-22T08:37:41.759 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.747+0000 7f61a192f800 1 -- 172.21.15.142:0/2981544073 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94669086528160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5619dd462070 con 0x7f6198022050 2024-09-22T08:37:41.759 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.747+0000 7f61a192f800 1 -- 172.21.15.142:0/2981544073 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5619dd462b70 con 0x5619dd4536d0 2024-09-22T08:37:41.759 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.747+0000 7f619de77640 1 -- 172.21.15.142:0/2981544073 <== osd.3 v2:172.21.15.142:6800/1064901393 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94669086523632] v32'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6198031070 con 0x5619dd458100 2024-09-22T08:37:41.759 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.748+0000 7f619d676640 1 -- 172.21.15.142:0/2981544073 <== osd.2 v2:172.21.15.142:6808/279438927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94669086528160] v32'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6190018ce0 con 0x7f6198022050 2024-09-22T08:37:41.759 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.748+0000 7f619ce75640 1 -- 172.21.15.142:0/2981544073 <== osd.1 v2:172.21.15.142:6816/3192108003 18 ==== osd_op_reply(52 notify.4 [create] v32'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6194051070 con 0x5619dd4536d0 2024-09-22T08:37:41.759 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.748+0000 7f61a192f800 1 -- 172.21.15.142:0/2981544073 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94669086533216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5619dd461bc0 con 0x5619dd4536d0 2024-09-22T08:37:41.759 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.748+0000 7f61a192f800 1 -- 172.21.15.142:0/2981544073 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5619dd463410 con 0x7f6190017050 2024-09-22T08:37:41.759 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.749+0000 7f619ce75640 1 -- 172.21.15.142:0/2981544073 <== osd.0 v2:172.21.15.31:6800/168281188 10 ==== osd_op_reply(54 notify.5 [create] v32'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6194051070 con 0x7f6190017050 2024-09-22T08:37:41.759 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.749+0000 7f61a192f800 1 -- 172.21.15.142:0/2981544073 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94669086535328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5619dd463770 con 0x7f6190017050 2024-09-22T08:37:41.759 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.749+0000 7f61a192f800 1 -- 172.21.15.142:0/2981544073 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5619dd464040 con 0x7f6190017050 2024-09-22T08:37:41.759 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.749+0000 7f619ce75640 1 -- 172.21.15.142:0/2981544073 <== osd.1 v2:172.21.15.142:6816/3192108003 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94669086533216] v32'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6194051070 con 0x5619dd4536d0 2024-09-22T08:37:41.764 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.750+0000 7f619ce75640 1 -- 172.21.15.142:0/2981544073 <== osd.0 v2:172.21.15.31:6800/168281188 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94669086535328] v32'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6194051070 con 0x7f6190017050 2024-09-22T08:37:41.764 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.750+0000 7f619ce75640 1 -- 172.21.15.142:0/2981544073 <== osd.0 v2:172.21.15.31:6800/168281188 12 ==== osd_op_reply(56 notify.6 [create] v32'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6194051070 con 0x7f6190017050 2024-09-22T08:37:41.764 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.750+0000 7f61a192f800 1 -- 172.21.15.142:0/2981544073 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94669086525616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5619dd463770 con 0x7f6190017050 2024-09-22T08:37:41.764 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.750+0000 7f61a192f800 1 -- 172.21.15.142:0/2981544073 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5619dd4646d0 con 0x7f6190017050 2024-09-22T08:37:41.764 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.751+0000 7f619ce75640 1 -- 172.21.15.142:0/2981544073 <== osd.0 v2:172.21.15.31:6800/168281188 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94669086525616] v32'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6194051070 con 0x7f6190017050 2024-09-22T08:37:41.764 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.751+0000 7f619ce75640 1 -- 172.21.15.142:0/2981544073 <== osd.0 v2:172.21.15.31:6800/168281188 14 ==== osd_op_reply(58 notify.7 [create] v32'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6194051070 con 0x7f6190017050 2024-09-22T08:37:41.764 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.751+0000 7f61a192f800 1 -- 172.21.15.142:0/2981544073 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94669086536656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5619dd4646d0 con 0x7f6190017050 2024-09-22T08:37:41.764 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.751+0000 7f61a192f800 20 add_watcher() i=0 2024-09-22T08:37:41.764 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.751+0000 7f61a192f800 20 add_watcher() i=1 2024-09-22T08:37:41.764 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.751+0000 7f61a192f800 20 add_watcher() i=2 2024-09-22T08:37:41.764 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.751+0000 7f61a192f800 20 add_watcher() i=3 2024-09-22T08:37:41.765 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.751+0000 7f61a192f800 20 add_watcher() i=4 2024-09-22T08:37:41.765 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.751+0000 7f61a192f800 20 add_watcher() i=5 2024-09-22T08:37:41.765 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.751+0000 7f61a192f800 20 add_watcher() i=6 2024-09-22T08:37:41.765 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.752+0000 7f619ce75640 1 -- 172.21.15.142:0/2981544073 <== osd.0 v2:172.21.15.31:6800/168281188 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94669086536656] v32'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6194051070 con 0x7f6190017050 2024-09-22T08:37:41.765 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.752+0000 7f61a192f800 20 add_watcher() i=7 2024-09-22T08:37:41.765 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.752+0000 7f61a192f800 2 all 8 watchers are set, enabling cache 2024-09-22T08:37:41.765 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.752+0000 7f61a192f800 1 -- 172.21.15.142:0/2981544073 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5619dd467a20 con 0x5619dd4536d0 2024-09-22T08:37:41.765 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.753+0000 7f619ce75640 1 -- 172.21.15.142:0/2981544073 <== osd.1 v2:172.21.15.142:6816/3192108003 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f6194051070 con 0x5619dd4536d0 2024-09-22T08:37:41.765 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.753+0000 7f61a192f800 1 -- 172.21.15.142:0/2981544073 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94669086553120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5619dd4646d0 con 0x5619dd4536d0 2024-09-22T08:37:41.765 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.753+0000 7f619ce75640 1 -- 172.21.15.142:0/2981544073 <== osd.1 v2:172.21.15.142:6816/3192108003 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94669086553120] v32'202 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6194051070 con 0x5619dd4536d0 2024-09-22T08:37:41.765 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.754+0000 7f6053fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:37:41.765 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.754+0000 7f61a192f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:37:41.765 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.754+0000 7f61a192f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:37:41.765 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.754+0000 7f61a192f800 5 note: GC not initialized 2024-09-22T08:37:41.766 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.754+0000 7f6052fe5640 20 reqs_thread_entry: start 2024-09-22T08:37:41.766 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.754+0000 7f61a192f800 20 init_complete bucket index max shards: 11 2024-09-22T08:37:41.766 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.754+0000 7f61a192f800 20 Filter name: none 2024-09-22T08:37:41.766 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.754+0000 7f6050fe1640 20 reqs_thread_entry: start 2024-09-22T08:37:41.766 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.754+0000 7f61a192f800 20 rados->read ofs=0 len=0 2024-09-22T08:37:41.766 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.754+0000 7f61a192f800 1 -- 172.21.15.142:0/2981544073 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5619dd49a850 con 0x5619dd4536d0 2024-09-22T08:37:41.766 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.755+0000 7f619ce75640 1 -- 172.21.15.142:0/2981544073 <== osd.1 v2:172.21.15.142:6816/3192108003 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f6194051070 con 0x5619dd4536d0 2024-09-22T08:37:41.766 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.755+0000 7f61a192f800 20 rados_obj.operate() r=0 bl.length=391 2024-09-22T08:37:41.766 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.755+0000 7f61a192f800 1 -- 172.21.15.142:0/2981544073 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5619dd49bdd0 con 0x7f6190017050 2024-09-22T08:37:41.766 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.756+0000 7f619ce75640 1 -- 172.21.15.142:0/2981544073 <== osd.0 v2:172.21.15.31:6800/168281188 16 ==== osd_op_reply(63 usage.10 [call out=1378b] v0'0 uv29 ondisk = 0) ==== 152+0+1378 (crc 0 0 0) 0x7f6194051070 con 0x7f6190017050 2024-09-22T08:37:41.766 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.756+0000 7f6053fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:37:41.766 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.756+0000 7f61a192f800 1 -- 172.21.15.142:0/2981544073 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94669086553120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5619dd498dd0 con 0x5619dd4536d0 2024-09-22T08:37:41.766 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.757+0000 7f619ce75640 1 -- 172.21.15.142:0/2981544073 <== osd.1 v2:172.21.15.142:6816/3192108003 23 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94669086553120] v32'203 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6194051070 con 0x5619dd4536d0 2024-09-22T08:37:41.766 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.757+0000 7f61a192f800 1 -- 172.21.15.142:0/2981544073 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94669086516032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5619dd467420 con 0x7f6198022050 2024-09-22T08:37:41.767 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.758+0000 7f619d676640 1 -- 172.21.15.142:0/2981544073 <== osd.2 v2:172.21.15.142:6808/279438927 11 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94669086516032] v32'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6190018ce0 con 0x7f6198022050 2024-09-22T08:37:41.767 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.758+0000 7f61a192f800 20 remove_watcher() i=0 2024-09-22T08:37:41.767 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.758+0000 7f61a192f800 2 removed watcher, disabling cache 2024-09-22T08:37:41.767 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.758+0000 7f61a192f800 1 -- 172.21.15.142:0/2981544073 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94669086522064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5619dd45e340 con 0x5619dd4536d0 2024-09-22T08:37:41.767 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.759+0000 7f619ce75640 1 -- 172.21.15.142:0/2981544073 <== osd.1 v2:172.21.15.142:6816/3192108003 24 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94669086522064] v32'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6194051070 con 0x5619dd4536d0 2024-09-22T08:37:41.767 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.759+0000 7f61a192f800 20 remove_watcher() i=1 2024-09-22T08:37:41.767 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.759+0000 7f61a192f800 1 -- 172.21.15.142:0/2981544073 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94669086523632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5619dd45e340 con 0x5619dd458100 2024-09-22T08:37:41.767 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.761+0000 7f619de77640 1 -- 172.21.15.142:0/2981544073 <== osd.3 v2:172.21.15.142:6800/1064901393 16 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94669086523632] v32'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6198031070 con 0x5619dd458100 2024-09-22T08:37:41.767 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.761+0000 7f61a192f800 20 remove_watcher() i=2 2024-09-22T08:37:41.767 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.761+0000 7f61a192f800 1 -- 172.21.15.142:0/2981544073 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94669086528160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5619dd45e340 con 0x7f6198022050 2024-09-22T08:37:41.767 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.761+0000 7f619d676640 1 -- 172.21.15.142:0/2981544073 <== osd.2 v2:172.21.15.142:6808/279438927 12 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94669086528160] v32'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6190018ce0 con 0x7f6198022050 2024-09-22T08:37:41.767 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.762+0000 7f61a192f800 20 remove_watcher() i=3 2024-09-22T08:37:41.767 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.762+0000 7f61a192f800 1 -- 172.21.15.142:0/2981544073 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94669086533216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5619dd45e340 con 0x5619dd4536d0 2024-09-22T08:37:41.768 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.763+0000 7f619ce75640 1 -- 172.21.15.142:0/2981544073 <== osd.1 v2:172.21.15.142:6816/3192108003 25 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94669086533216] v32'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6194051070 con 0x5619dd4536d0 2024-09-22T08:37:41.768 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.763+0000 7f61a192f800 20 remove_watcher() i=4 2024-09-22T08:37:41.768 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.763+0000 7f61a192f800 1 -- 172.21.15.142:0/2981544073 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94669086535328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5619dd462660 con 0x7f6190017050 2024-09-22T08:37:41.771 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.764+0000 7f619ce75640 1 -- 172.21.15.142:0/2981544073 <== osd.0 v2:172.21.15.31:6800/168281188 17 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94669086535328] v32'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6194051070 con 0x7f6190017050 2024-09-22T08:37:41.771 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.764+0000 7f61a192f800 20 remove_watcher() i=5 2024-09-22T08:37:41.771 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.764+0000 7f61a192f800 1 -- 172.21.15.142:0/2981544073 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94669086525616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5619dd462ea0 con 0x7f6190017050 2024-09-22T08:37:41.771 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.765+0000 7f619ce75640 1 -- 172.21.15.142:0/2981544073 <== osd.0 v2:172.21.15.31:6800/168281188 18 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94669086525616] v32'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6194051070 con 0x7f6190017050 2024-09-22T08:37:41.771 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.765+0000 7f61a192f800 20 remove_watcher() i=6 2024-09-22T08:37:41.771 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.765+0000 7f61a192f800 1 -- 172.21.15.142:0/2981544073 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94669086536656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5619dd462ea0 con 0x7f6190017050 2024-09-22T08:37:41.771 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.766+0000 7f619ce75640 1 -- 172.21.15.142:0/2981544073 <== osd.0 v2:172.21.15.31:6800/168281188 19 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94669086536656] v32'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6194051070 con 0x7f6190017050 2024-09-22T08:37:41.771 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.766+0000 7f61a192f800 20 remove_watcher() i=7 2024-09-22T08:37:41.771 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.766+0000 7f61a192f800 1 -- 172.21.15.142:0/2981544073 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f6190017050 msgr2=0x7f61900167e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:41.772 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.766+0000 7f61a192f800 1 --2- 172.21.15.142:0/2981544073 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f6190017050 0x7f61900167e0 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:41.772 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.766+0000 7f61a192f800 1 -- 172.21.15.142:0/2981544073 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5619dd4536d0 msgr2=0x5619dd455b60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:41.772 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.766+0000 7f61a192f800 1 --2- 172.21.15.142:0/2981544073 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5619dd4536d0 0x5619dd455b60 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:41.772 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.766+0000 7f61a192f800 1 -- 172.21.15.142:0/2981544073 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f6198022050 msgr2=0x7f619803c3a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:41.772 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.766+0000 7f61a192f800 1 --2- 172.21.15.142:0/2981544073 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f6198022050 0x7f619803c3a0 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:41.772 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.766+0000 7f61a192f800 1 -- 172.21.15.142:0/2981544073 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5619dd458100 msgr2=0x5619dd45a4f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:41.772 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.766+0000 7f61a192f800 1 --2- 172.21.15.142:0/2981544073 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5619dd458100 0x5619dd45a4f0 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:41.772 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.766+0000 7f61a192f800 1 -- 172.21.15.142:0/2981544073 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f606803cfb0 msgr2=0x7f606803f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:41.772 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.766+0000 7f61a192f800 1 --2- 172.21.15.142:0/2981544073 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f606803cfb0 0x7f606803f470 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f619003f010 tx=0x7f6190046000 comp rx=0 tx=0).stop 2024-09-22T08:37:41.772 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.766+0000 7f61a192f800 1 -- 172.21.15.142:0/2981544073 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5619dd440820 msgr2=0x5619dd447de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:41.772 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.766+0000 7f619ce75640 1 -- 172.21.15.142:0/2981544073 reap_dead start 2024-09-22T08:37:41.772 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.766+0000 7f61a192f800 1 --2- 172.21.15.142:0/2981544073 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5619dd440820 0x5619dd447de0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f6198020510 tx=0x7f61980547c0 comp rx=0 tx=0).stop 2024-09-22T08:37:41.772 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.766+0000 7f61a192f800 1 -- 172.21.15.142:0/2981544073 shutdown_connections 2024-09-22T08:37:41.772 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.766+0000 7f61a192f800 1 --2- 172.21.15.142:0/2981544073 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5619dd440820 0x5619dd447de0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:41.773 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.766+0000 7f61a192f800 1 -- 172.21.15.142:0/2981544073 >> 172.21.15.142:0/2981544073 conn(0x5619dd43cc20 msgr2=0x5619dd43ae30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:37:41.773 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.766+0000 7f61a192f800 1 -- 172.21.15.142:0/2981544073 shutdown_connections 2024-09-22T08:37:41.773 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.766+0000 7f61a192f800 1 -- 172.21.15.142:0/2981544073 wait complete. 2024-09-22T08:37:41.773 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.767+0000 7f61a192f800 1 -- 172.21.15.142:0/3883655982 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f607403d000 msgr2=0x7f607403f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:41.773 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.767+0000 7f61a192f800 1 --2- 172.21.15.142:0/3883655982 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f607403d000 0x7f607403f4c0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x5619dd41ae60 tx=0x7f6190052a40 comp rx=0 tx=0).stop 2024-09-22T08:37:41.773 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.767+0000 7f61a192f800 1 -- 172.21.15.142:0/3883655982 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5619dd433d40 msgr2=0x5619dd434160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:41.773 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.767+0000 7f61a192f800 1 --2- 172.21.15.142:0/3883655982 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5619dd433d40 0x5619dd434160 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x5619dd419bf0 tx=0x7f61980167b0 comp rx=0 tx=0).stop 2024-09-22T08:37:41.773 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.767+0000 7f61a192f800 1 -- 172.21.15.142:0/3883655982 shutdown_connections 2024-09-22T08:37:41.773 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.767+0000 7f61a192f800 1 --2- 172.21.15.142:0/3883655982 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f607403d000 0x7f607403f4c0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:41.773 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.767+0000 7f61a192f800 1 --2- 172.21.15.142:0/3883655982 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5619dd433d40 0x5619dd434160 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:41.773 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.767+0000 7f61a192f800 1 -- 172.21.15.142:0/3883655982 >> 172.21.15.142:0/3883655982 conn(0x5619dd4280f0 msgr2=0x5619dd4284d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:37:41.773 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.767+0000 7f61a192f800 1 -- 172.21.15.142:0/3883655982 shutdown_connections 2024-09-22T08:37:41.773 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.767+0000 7f61a192f800 1 -- 172.21.15.142:0/3883655982 wait complete. 2024-09-22T08:37:41.773 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.767+0000 7f61a192f800 1 -- 172.21.15.142:0/196442788 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5619dd325bf0 msgr2=0x5619dd4203b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:41.774 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.767+0000 7f61a192f800 1 --2- 172.21.15.142:0/196442788 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5619dd325bf0 0x5619dd4203b0 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:41.774 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.767+0000 7f61a192f800 1 -- 172.21.15.142:0/196442788 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5619dd422750 msgr2=0x5619dd424bf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:41.774 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.767+0000 7f61a192f800 1 --2- 172.21.15.142:0/196442788 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5619dd422750 0x5619dd424bf0 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:41.774 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.767+0000 7f61a192f800 1 -- 172.21.15.142:0/196442788 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f608403d000 msgr2=0x7f608403f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:41.774 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.767+0000 7f61a192f800 1 --2- 172.21.15.142:0/196442788 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f608403d000 0x7f608403f4c0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f6194057000 tx=0x7f6194052000 comp rx=0 tx=0).stop 2024-09-22T08:37:41.774 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.767+0000 7f61a192f800 1 -- 172.21.15.142:0/196442788 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5619dd293510 msgr2=0x5619dd418d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:41.774 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.767+0000 7f61a192f800 1 --2- 172.21.15.142:0/196442788 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5619dd293510 0x5619dd418d60 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f61900012b0 tx=0x7f6190000ed0 comp rx=0 tx=0).stop 2024-09-22T08:37:41.774 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.767+0000 7f61a192f800 1 -- 172.21.15.142:0/196442788 shutdown_connections 2024-09-22T08:37:41.774 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.767+0000 7f61a192f800 1 --2- 172.21.15.142:0/196442788 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5619dd422750 0x5619dd424bf0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:41.774 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.767+0000 7f61a192f800 1 --2- 172.21.15.142:0/196442788 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5619dd325bf0 0x5619dd4203b0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:41.774 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.767+0000 7f61a192f800 1 --2- 172.21.15.142:0/196442788 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f608403d000 0x7f608403f4c0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:41.774 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.767+0000 7f61a192f800 1 --2- 172.21.15.142:0/196442788 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5619dd293510 0x5619dd418d60 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:41.774 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.767+0000 7f61a192f800 1 -- 172.21.15.142:0/196442788 >> 172.21.15.142:0/196442788 conn(0x5619dd319be0 msgr2=0x5619dd412730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:37:41.775 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.767+0000 7f61a192f800 1 -- 172.21.15.142:0/196442788 shutdown_connections 2024-09-22T08:37:41.775 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.767+0000 7f61a192f800 1 -- 172.21.15.142:0/196442788 wait complete. 2024-09-22T08:37:41.777 INFO:teuthology.orchestra.run.smithi142.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-09-22T08:00:00.000000Z","epoch":1726992000,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo","time":"2024-09-22T08:00:00.000000Z","epoch":1726992000,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":5,"successful_ops":5}],"s3select":{}},{"bucket":"myfoo2","time":"2024-09-22T08:00:00.000000Z","epoch":1726992000,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{}},{"bucket":"myfoo3","time":"2024-09-22T08:00:00.000000Z","epoch":1726992000,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{}},{"bucket":"myfoo4","time":"2024-09-22T08:00:00.000000Z","epoch":1726992000,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{}}]}],"summary":[{"user":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8}],"total":{"bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8,"bytes_processed":0,"bytes_returned":0}}]} 2024-09-22T08:37:41.777 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-22T08:00:00.000000Z', 'epoch': 1726992000, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo', 'time': '2024-09-22T08:00:00.000000Z', 'epoch': 1726992000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 5, 'successful_ops': 5}], 's3select': {}}, {'bucket': 'myfoo2', 'time': '2024-09-22T08:00:00.000000Z', 'epoch': 1726992000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}, {'bucket': 'myfoo3', 'time': '2024-09-22T08:00:00.000000Z', 'epoch': 1726992000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}, {'bucket': 'myfoo4', 'time': '2024-09-22T08:00:00.000000Z', 'epoch': 1726992000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-22T08:37:41.777 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'put_obj'] 2024-09-22T08:37:41.777 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'put_obj'] 2024-09-22T08:37:41.778 DEBUG:teuthology.orchestra.run.smithi142:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories put_obj 2024-09-22T08:37:41.824 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:37:41.824 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:37:41.826 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.823+0000 7f6da9a87800 1 Processor -- start 2024-09-22T08:37:41.826 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.824+0000 7f6da9a87800 1 -- start start 2024-09-22T08:37:41.826 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.824+0000 7f6da9a87800 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55a885026080 0x55a885028470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:41.826 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.824+0000 7f6da9a87800 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55a884eb0a20 con 0x55a8850289b0 2024-09-22T08:37:41.826 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.824+0000 7f6da9a87800 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x55a884eb07d0 con 0x55a885026080 2024-09-22T08:37:41.826 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.824+0000 7f6da7578640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55a885026080 0x55a885028470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:41.826 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.824+0000 7f6da6d77640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x55a8850289b0 0x55a88502ada0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.142:50262/0 (socket says 172.21.15.142:50262) 2024-09-22T08:37:41.826 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.824+0000 7f6da6d77640 1 -- 172.21.15.142:0/731875691 learned_addr learned my addr 172.21.15.142:0/731875691 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-09-22T08:37:41.827 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.824+0000 7f6da7578640 1 -- 172.21.15.142:0/731875691 >> v1:172.21.15.31:6789/0 conn(0x55a8850289b0 legacy=0x55a88502ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:41.827 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.824+0000 7f6da7578640 1 -- 172.21.15.142:0/731875691 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a88502d560 con 0x55a885026080 2024-09-22T08:37:41.829 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.826+0000 7f6da7578640 1 --2- 172.21.15.142:0/731875691 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a885026080 0x55a885028470 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f6d9800a470 tx=0x7f6d98045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17939e2ada9c1344 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:41.829 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.827+0000 7f6da6576640 1 -- 172.21.15.142:0/731875691 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d98053570 con 0x55a885026080 2024-09-22T08:37:41.829 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.827+0000 7f6da6576640 1 -- 172.21.15.142:0/731875691 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d98058070 con 0x55a885026080 2024-09-22T08:37:41.829 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.827+0000 7f6da6576640 1 -- 172.21.15.142:0/731875691 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d98053880 con 0x55a885026080 2024-09-22T08:37:41.829 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.827+0000 7f6da9a87800 1 -- 172.21.15.142:0/731875691 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a885026080 msgr2=0x55a885028470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:41.829 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.827+0000 7f6da9a87800 1 --2- 172.21.15.142:0/731875691 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a885026080 0x55a885028470 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f6d9800a470 tx=0x7f6d98045a20 comp rx=0 tx=0).stop 2024-09-22T08:37:41.830 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.827+0000 7f6da9a87800 1 -- 172.21.15.142:0/731875691 shutdown_connections 2024-09-22T08:37:41.830 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.827+0000 7f6da9a87800 1 --2- 172.21.15.142:0/731875691 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a885026080 0x55a885028470 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:41.830 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.827+0000 7f6da9a87800 1 -- 172.21.15.142:0/731875691 >> 172.21.15.142:0/731875691 conn(0x55a88501fbe0 msgr2=0x55a885022020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:37:41.830 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.827+0000 7f6da9a87800 1 -- 172.21.15.142:0/731875691 shutdown_connections 2024-09-22T08:37:41.830 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.827+0000 7f6da9a87800 1 -- 172.21.15.142:0/731875691 wait complete. 2024-09-22T08:37:41.842 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.841+0000 7f6da9a87800 1 Processor -- start 2024-09-22T08:37:41.842 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.841+0000 7f6da9a87800 1 -- start start 2024-09-22T08:37:41.842 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.841+0000 7f6da9a87800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a885026080 0x55a885115030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:41.843 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.841+0000 7f6da9a87800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55a884ebddd0 con 0x55a885026080 2024-09-22T08:37:41.843 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.841+0000 7f6da7578640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a885026080 0x55a885115030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:41.843 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.841+0000 7f6da7578640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a885026080 0x55a885115030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:55716/0 (socket says 172.21.15.142:55716) 2024-09-22T08:37:41.843 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.841+0000 7f6da7578640 1 -- 172.21.15.142:0/3230501924 learned_addr learned my addr 172.21.15.142:0/3230501924 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:37:41.843 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.842+0000 7f6da7578640 1 -- 172.21.15.142:0/3230501924 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a885115620 con 0x55a885026080 2024-09-22T08:37:41.843 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.842+0000 7f6da7578640 1 --2- 172.21.15.142:0/3230501924 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a885026080 0x55a885115030 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f6d98025c20 tx=0x7f6d98051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c332ac855b16339 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:41.844 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.842+0000 7f6c9560a640 1 -- 172.21.15.142:0/3230501924 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d98053a20 con 0x55a885026080 2024-09-22T08:37:41.844 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.842+0000 7f6c9560a640 1 -- 172.21.15.142:0/3230501924 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d98063070 con 0x55a885026080 2024-09-22T08:37:41.844 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.842+0000 7f6c9560a640 1 -- 172.21.15.142:0/3230501924 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d98053cf0 con 0x55a885026080 2024-09-22T08:37:41.846 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.843+0000 7f6da9a87800 1 -- 172.21.15.142:0/3230501924 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a885026080 msgr2=0x55a885115030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:41.846 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.843+0000 7f6da9a87800 1 --2- 172.21.15.142:0/3230501924 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a885026080 0x55a885115030 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f6d98025c20 tx=0x7f6d98051000 comp rx=0 tx=0).stop 2024-09-22T08:37:41.846 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.843+0000 7f6da9a87800 1 -- 172.21.15.142:0/3230501924 shutdown_connections 2024-09-22T08:37:41.846 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.843+0000 7f6da9a87800 1 --2- 172.21.15.142:0/3230501924 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a885026080 0x55a885115030 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:41.846 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.843+0000 7f6da9a87800 1 -- 172.21.15.142:0/3230501924 >> 172.21.15.142:0/3230501924 conn(0x55a88501fbe0 msgr2=0x55a8851109b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:37:41.846 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.843+0000 7f6da9a87800 1 -- 172.21.15.142:0/3230501924 shutdown_connections 2024-09-22T08:37:41.846 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.843+0000 7f6da9a87800 1 -- 172.21.15.142:0/3230501924 wait complete. 2024-09-22T08:37:41.846 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.843+0000 7f6da9a87800 1 Processor -- start 2024-09-22T08:37:41.846 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.843+0000 7f6da9a87800 1 -- start start 2024-09-22T08:37:41.846 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.843+0000 7f6da9a87800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a885026080 0x55a88511cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:41.846 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.843+0000 7f6da9a87800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55a88502c850 con 0x55a885026080 2024-09-22T08:37:41.846 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.843+0000 7f6da7578640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a885026080 0x55a88511cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:41.847 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.844+0000 7f6da7578640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a885026080 0x55a88511cb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:55722/0 (socket says 172.21.15.142:55722) 2024-09-22T08:37:41.847 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.844+0000 7f6da7578640 1 -- 172.21.15.142:0/1769604270 learned_addr learned my addr 172.21.15.142:0/1769604270 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:37:41.847 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.844+0000 7f6da7578640 1 -- 172.21.15.142:0/1769604270 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a88511d090 con 0x55a885026080 2024-09-22T08:37:41.847 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.844+0000 7f6da7578640 1 --2- 172.21.15.142:0/1769604270 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a885026080 0x55a88511cb30 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f6d98025c20 tx=0x7f6d98002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:41.847 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.844+0000 7f6c93e07640 1 -- 172.21.15.142:0/1769604270 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d98068660 con 0x55a885026080 2024-09-22T08:37:41.847 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.844+0000 7f6c93e07640 1 -- 172.21.15.142:0/1769604270 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d98068800 con 0x55a885026080 2024-09-22T08:37:41.847 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.844+0000 7f6c93e07640 1 -- 172.21.15.142:0/1769604270 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d98068ae0 con 0x55a885026080 2024-09-22T08:37:41.847 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.844+0000 7f6da9a87800 1 -- 172.21.15.142:0/1769604270 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a88511d320 con 0x55a885026080 2024-09-22T08:37:41.847 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.844+0000 7f6da9a87800 1 -- 172.21.15.142:0/1769604270 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a88511df30 con 0x55a885026080 2024-09-22T08:37:41.850 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.845+0000 7f6c93e07640 1 -- 172.21.15.142:0/1769604270 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f6d98068c80 con 0x55a885026080 2024-09-22T08:37:41.850 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.845+0000 7f6c93e07640 1 --2- 172.21.15.142:0/1769604270 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f6c8c03d000 0x7f6c8c03f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:41.850 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.845+0000 7f6c93e07640 1 -- 172.21.15.142:0/1769604270 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5938+0+0 (secure 0 0 0) 0x7f6d98098d20 con 0x55a885026080 2024-09-22T08:37:41.850 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.845+0000 7f6da6d77640 1 --2- 172.21.15.142:0/1769604270 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f6c8c03d000 0x7f6c8c03f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:41.850 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.845+0000 7f6da9a87800 1 --2- 172.21.15.142:0/1769604270 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55a8850289b0 0x55a885124180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:41.850 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.846+0000 7f6da9a87800 1 -- 172.21.15.142:0/1769604270 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a88511e8f0 con 0x55a8850289b0 2024-09-22T08:37:41.850 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.846+0000 7f6da7d79640 1 --2- 172.21.15.142:0/1769604270 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55a8850289b0 0x55a885124180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:41.850 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.846+0000 7f6da6d77640 1 --2- 172.21.15.142:0/1769604270 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f6c8c03d000 0x7f6c8c03f4c0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f6d9c001d70 tx=0x7f6d9c0012d0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:41.850 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.846+0000 7f6da7d79640 1 --2- 172.21.15.142:0/1769604270 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55a8850289b0 0x55a885124180 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:41.850 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.846+0000 7f6da7d79640 1 -- 172.21.15.142:0/1769604270 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6da000a4d0 con 0x55a8850289b0 2024-09-22T08:37:41.850 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.846+0000 7f6da9a87800 1 -- 172.21.15.142:0/1769604270 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a885124ba0 con 0x55a8850289b0 2024-09-22T08:37:41.851 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.846+0000 7f6da7d79640 1 -- 172.21.15.142:0/1769604270 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6da000a4d0 con 0x55a8850289b0 2024-09-22T08:37:41.851 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.847+0000 7f6da9a87800 1 --2- 172.21.15.142:0/1769604270 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55a8851264b0 0x55a885128950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:41.851 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.847+0000 7f6da9a87800 1 -- 172.21.15.142:0/1769604270 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:3 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a8851290e0 con 0x55a8851264b0 2024-09-22T08:37:41.851 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.847+0000 7f6da7578640 1 --2- 172.21.15.142:0/1769604270 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55a8851264b0 0x55a885128950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:41.851 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.847+0000 7f6da7578640 1 --2- 172.21.15.142:0/1769604270 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55a8851264b0 0x55a885128950 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:41.851 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.847+0000 7f6da7578640 1 -- 172.21.15.142:0/1769604270 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(3 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f6d98051070 con 0x55a8851264b0 2024-09-22T08:37:41.851 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.847+0000 7f6da9a87800 1 -- 172.21.15.142:0/1769604270 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a8851253f0 con 0x55a8850289b0 2024-09-22T08:37:41.851 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.847+0000 7f6da7d79640 1 -- 172.21.15.142:0/1769604270 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6da000a4d0 con 0x55a8850289b0 2024-09-22T08:37:41.851 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.847+0000 7f6da9a87800 1 -- 172.21.15.142:0/1769604270 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a8851257d0 con 0x55a8851264b0 2024-09-22T08:37:41.851 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.848+0000 7f6da7578640 1 -- 172.21.15.142:0/1769604270 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(5 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f6d98051070 con 0x55a8851264b0 2024-09-22T08:37:41.851 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.848+0000 7f6da9a87800 1 Processor -- start 2024-09-22T08:37:41.851 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.848+0000 7f6da9a87800 1 -- start start 2024-09-22T08:37:41.851 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.848+0000 7f6da9a87800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a885137a20 0x55a885137e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:41.851 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.848+0000 7f6da9a87800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55a884f1cd50 con 0x55a885137a20 2024-09-22T08:37:41.852 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.849+0000 7f6da7d79640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a885137a20 0x55a885137e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:41.852 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.849+0000 7f6da7d79640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a885137a20 0x55a885137e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:55728/0 (socket says 172.21.15.142:55728) 2024-09-22T08:37:41.852 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.849+0000 7f6da7d79640 1 -- 172.21.15.142:0/3245508670 learned_addr learned my addr 172.21.15.142:0/3245508670 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:37:41.860 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.849+0000 7f6da7d79640 1 -- 172.21.15.142:0/3245508670 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a885138480 con 0x55a885137a20 2024-09-22T08:37:41.860 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.849+0000 7f6da7d79640 1 --2- 172.21.15.142:0/3245508670 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a885137a20 0x55a885137e40 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x55a88511db30 tx=0x7f6da00167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:41.860 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.849+0000 7f6c91602640 1 -- 172.21.15.142:0/3245508670 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6da0013640 con 0x55a885137a20 2024-09-22T08:37:41.860 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.849+0000 7f6c91602640 1 -- 172.21.15.142:0/3245508670 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6da00137e0 con 0x55a885137a20 2024-09-22T08:37:41.860 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.849+0000 7f6c91602640 1 -- 172.21.15.142:0/3245508670 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6da0013ae0 con 0x55a885137a20 2024-09-22T08:37:41.860 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.849+0000 7f6da9a87800 1 -- 172.21.15.142:0/3245508670 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a885138cb0 con 0x55a885137a20 2024-09-22T08:37:41.861 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.849+0000 7f6da9a87800 1 -- 172.21.15.142:0/3245508670 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a885139250 con 0x55a885137a20 2024-09-22T08:37:41.861 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.850+0000 7f6c91602640 1 -- 172.21.15.142:0/3245508670 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f6da0011040 con 0x55a885137a20 2024-09-22T08:37:41.861 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.850+0000 7f6c91602640 1 --2- 172.21.15.142:0/3245508670 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f6c8003cfb0 0x7f6c8003f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:41.861 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.850+0000 7f6c91602640 1 -- 172.21.15.142:0/3245508670 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5938+0+0 (secure 0 0 0) 0x7f6da000e040 con 0x55a885137a20 2024-09-22T08:37:41.861 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.850+0000 7f6da7578640 1 --2- 172.21.15.142:0/3245508670 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f6c8003cfb0 0x7f6c8003f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:41.861 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.851+0000 7f6da9a87800 1 Processor -- start 2024-09-22T08:37:41.861 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.851+0000 7f6da7578640 1 --2- 172.21.15.142:0/3245508670 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f6c8003cfb0 0x7f6c8003f470 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f6d98068fd0 tx=0x7f6d9805d620 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:41.861 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.851+0000 7f6da9a87800 1 -- start start 2024-09-22T08:37:41.861 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.851+0000 7f6da9a87800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a885024080 0x55a885024480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:41.861 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.851+0000 7f6da9a87800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55a8851159f0 con 0x55a885024080 2024-09-22T08:37:41.861 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.851+0000 7f6da7d79640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a885024080 0x55a885024480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:41.861 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.851+0000 7f6da7d79640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a885024080 0x55a885024480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:55734/0 (socket says 172.21.15.142:55734) 2024-09-22T08:37:41.861 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.851+0000 7f6da7d79640 1 -- 172.21.15.142:0/4231541865 learned_addr learned my addr 172.21.15.142:0/4231541865 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:37:41.862 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.851+0000 7f6da7d79640 1 -- 172.21.15.142:0/4231541865 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a885024a70 con 0x55a885024080 2024-09-22T08:37:41.862 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.852+0000 7f6da7d79640 1 --2- 172.21.15.142:0/4231541865 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a885024080 0x55a885024480 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f6da0020000 tx=0x7f6da001f400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71705eab4aeedcae server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:41.862 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.852+0000 7f6c8affd640 1 -- 172.21.15.142:0/4231541865 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6da0051070 con 0x55a885024080 2024-09-22T08:37:41.862 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.852+0000 7f6c8affd640 1 -- 172.21.15.142:0/4231541865 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6da0021960 con 0x55a885024080 2024-09-22T08:37:41.862 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.852+0000 7f6c8affd640 1 -- 172.21.15.142:0/4231541865 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6da0021440 con 0x55a885024080 2024-09-22T08:37:41.862 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.852+0000 7f6da9a87800 1 -- 172.21.15.142:0/4231541865 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a885024080 msgr2=0x55a885024480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:41.862 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.852+0000 7f6da9a87800 1 --2- 172.21.15.142:0/4231541865 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a885024080 0x55a885024480 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f6da0020000 tx=0x7f6da001f400 comp rx=0 tx=0).stop 2024-09-22T08:37:41.862 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.852+0000 7f6da9a87800 1 -- 172.21.15.142:0/4231541865 shutdown_connections 2024-09-22T08:37:41.862 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.852+0000 7f6da9a87800 1 --2- 172.21.15.142:0/4231541865 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a885024080 0x55a885024480 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:41.862 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.852+0000 7f6da9a87800 1 -- 172.21.15.142:0/4231541865 >> 172.21.15.142:0/4231541865 conn(0x55a885140940 msgr2=0x55a88513eb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:37:41.862 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.852+0000 7f6da9a87800 1 -- 172.21.15.142:0/4231541865 shutdown_connections 2024-09-22T08:37:41.862 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.852+0000 7f6da9a87800 1 -- 172.21.15.142:0/4231541865 wait complete. 2024-09-22T08:37:41.863 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.852+0000 7f6da9a87800 1 Processor -- start 2024-09-22T08:37:41.863 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.853+0000 7f6da9a87800 1 -- start start 2024-09-22T08:37:41.863 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.853+0000 7f6da9a87800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a885024080 0x55a88514dd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:41.863 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.853+0000 7f6da9a87800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55a8850250e0 con 0x55a885024080 2024-09-22T08:37:41.863 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.853+0000 7f6da7d79640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a885024080 0x55a88514dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:41.863 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.853+0000 7f6da7d79640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a885024080 0x55a88514dd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:55742/0 (socket says 172.21.15.142:55742) 2024-09-22T08:37:41.863 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.853+0000 7f6da7d79640 1 -- 172.21.15.142:0/419643312 learned_addr learned my addr 172.21.15.142:0/419643312 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:37:41.863 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.853+0000 7f6da7d79640 1 -- 172.21.15.142:0/419643312 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a88514e270 con 0x55a885024080 2024-09-22T08:37:41.863 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.853+0000 7f6da7d79640 1 --2- 172.21.15.142:0/419643312 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a885024080 0x55a88514dd10 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f6da0020000 tx=0x7f6da0054860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:41.863 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.854+0000 7f6c897fa640 1 -- 172.21.15.142:0/419643312 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6da0054ad0 con 0x55a885024080 2024-09-22T08:37:41.863 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.854+0000 7f6c897fa640 1 -- 172.21.15.142:0/419643312 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6da0020de0 con 0x55a885024080 2024-09-22T08:37:41.863 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.854+0000 7f6da9a87800 1 -- 172.21.15.142:0/419643312 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a88514e500 con 0x55a885024080 2024-09-22T08:37:41.863 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.854+0000 7f6c897fa640 1 -- 172.21.15.142:0/419643312 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6da001fbc0 con 0x55a885024080 2024-09-22T08:37:41.864 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.854+0000 7f6da9a87800 1 -- 172.21.15.142:0/419643312 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a88514f090 con 0x55a885024080 2024-09-22T08:37:41.864 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.855+0000 7f6c897fa640 1 -- 172.21.15.142:0/419643312 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f6da001f500 con 0x55a885024080 2024-09-22T08:37:41.864 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.855+0000 7f6c897fa640 1 --2- 172.21.15.142:0/419643312 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f6c7003d000 0x7f6c7003f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:41.864 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.855+0000 7f6c897fa640 1 -- 172.21.15.142:0/419643312 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5938+0+0 (secure 0 0 0) 0x7f6da004c030 con 0x55a885024080 2024-09-22T08:37:41.864 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.855+0000 7f6da7578640 1 --2- 172.21.15.142:0/419643312 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f6c7003d000 0x7f6c7003f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:41.864 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.855+0000 7f6da9a87800 20 rados->read ofs=0 len=0 2024-09-22T08:37:41.864 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.855+0000 7f6da9a87800 1 --2- 172.21.15.142:0/419643312 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55a885159630 0x55a88515baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:41.864 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.855+0000 7f6da9a87800 1 -- 172.21.15.142:0/419643312 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a88515c240 con 0x55a885159630 2024-09-22T08:37:41.864 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.855+0000 7f6da7578640 1 --2- 172.21.15.142:0/419643312 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f6c7003d000 0x7f6c7003f4c0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f6d98045a60 tx=0x7f6d98082000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:41.864 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.855+0000 7f6da6d77640 1 --2- 172.21.15.142:0/419643312 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55a885159630 0x55a88515baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:41.864 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.856+0000 7f6da6d77640 1 --2- 172.21.15.142:0/419643312 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55a885159630 0x55a88515baf0 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:41.864 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.856+0000 7f6da6d77640 1 -- 172.21.15.142:0/419643312 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6d9c009050 con 0x55a885159630 2024-09-22T08:37:41.864 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.856+0000 7f6da9a87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:41.865 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.856+0000 7f6da9a87800 20 realm 2024-09-22T08:37:41.865 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.856+0000 7f6da9a87800 20 rados->read ofs=0 len=0 2024-09-22T08:37:41.865 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.856+0000 7f6da9a87800 1 -- 172.21.15.142:0/419643312 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a885158980 con 0x55a885159630 2024-09-22T08:37:41.865 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.856+0000 7f6da6d77640 1 -- 172.21.15.142:0/419643312 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6d9c009050 con 0x55a885159630 2024-09-22T08:37:41.865 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.856+0000 7f6da9a87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:41.865 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.856+0000 7f6da9a87800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:37:41.865 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.856+0000 7f6da9a87800 20 rados->read ofs=0 len=0 2024-09-22T08:37:41.865 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.856+0000 7f6da9a87800 1 -- 172.21.15.142:0/419643312 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a88515cd20 con 0x55a885159630 2024-09-22T08:37:41.866 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.856+0000 7f6da6d77640 1 -- 172.21.15.142:0/419643312 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6d9c009050 con 0x55a885159630 2024-09-22T08:37:41.866 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.856+0000 7f6da9a87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:41.866 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.856+0000 7f6da9a87800 20 rados->read ofs=0 len=0 2024-09-22T08:37:41.866 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.856+0000 7f6da9a87800 1 -- 172.21.15.142:0/419643312 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a88515d5f0 con 0x55a885159630 2024-09-22T08:37:41.866 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.857+0000 7f6da6d77640 1 -- 172.21.15.142:0/419643312 <== osd.1 v2:172.21.15.142:6816/3192108003 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6d9c009050 con 0x55a885159630 2024-09-22T08:37:41.866 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.857+0000 7f6da9a87800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:37:41.866 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.857+0000 7f6da9a87800 20 rados->read ofs=0 len=0 2024-09-22T08:37:41.866 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.857+0000 7f6da9a87800 1 --2- 172.21.15.142:0/419643312 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55a88515df30 0x55a885160320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:41.867 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.857+0000 7f6da9a87800 1 -- 172.21.15.142:0/419643312 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a885160a60 con 0x55a88515df30 2024-09-22T08:37:41.867 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.857+0000 7f6da7d79640 1 --2- 172.21.15.142:0/419643312 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55a88515df30 0x55a885160320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:41.867 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.857+0000 7f6da7d79640 1 --2- 172.21.15.142:0/419643312 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55a88515df30 0x55a885160320 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:41.867 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.857+0000 7f6da7d79640 1 -- 172.21.15.142:0/419643312 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(5 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f6da000a4d0 con 0x55a88515df30 2024-09-22T08:37:41.867 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.857+0000 7f6da9a87800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:37:41.867 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.857+0000 7f6da9a87800 20 searching for the correct realm 2024-09-22T08:37:41.867 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.857+0000 7f6da9a87800 1 -- 172.21.15.142:0/419643312 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a885162410 con 0x55a88515df30 2024-09-22T08:37:41.867 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.858+0000 7f6da7d79640 1 -- 172.21.15.142:0/419643312 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6da000a4d0 con 0x55a88515df30 2024-09-22T08:37:41.868 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.858+0000 7f6da7d79640 1 --2- 172.21.15.142:0/419643312 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f6da002b7f0 0x7f6da0032800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:41.868 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.858+0000 7f6da7d79640 1 -- 172.21.15.142:0/419643312 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a885162410 con 0x7f6da002b7f0 2024-09-22T08:37:41.868 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.858+0000 7f6da7578640 1 --2- 172.21.15.142:0/419643312 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f6da002b7f0 0x7f6da0032800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:41.868 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.858+0000 7f6da7578640 1 --2- 172.21.15.142:0/419643312 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f6da002b7f0 0x7f6da0032800 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:41.868 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.858+0000 7f6da7578640 1 -- 172.21.15.142:0/419643312 <== osd.2 v2:172.21.15.142:6808/279438927 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d98051070 con 0x7f6da002b7f0 2024-09-22T08:37:41.868 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.858+0000 7f6da7578640 1 --2- 172.21.15.142:0/419643312 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f6d9805f040 0x7f6d9808ff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:41.868 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.858+0000 7f6da7578640 1 -- 172.21.15.142:0/419643312 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a885162410 con 0x7f6d9805f040 2024-09-22T08:37:41.869 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.859+0000 7f6da6d77640 1 --2- 172.21.15.142:0/419643312 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f6d9805f040 0x7f6d9808ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:41.869 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.859+0000 7f6da6d77640 1 --2- 172.21.15.142:0/419643312 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f6d9805f040 0x7f6d9808ff70 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:41.889 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.859+0000 7f6da6d77640 1 -- 172.21.15.142:0/419643312 <== osd.0 v2:172.21.15.31:6800/168281188 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d9c009050 con 0x7f6d9805f040 2024-09-22T08:37:41.890 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.859+0000 7f6da6d77640 1 -- 172.21.15.142:0/419643312 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a885162410 con 0x55a885159630 2024-09-22T08:37:41.890 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.860+0000 7f6da6d77640 1 -- 172.21.15.142:0/419643312 <== osd.1 v2:172.21.15.142:6816/3192108003 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d9c009050 con 0x55a885159630 2024-09-22T08:37:41.890 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.860+0000 7f6da6d77640 1 -- 172.21.15.142:0/419643312 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a885162410 con 0x55a885159630 2024-09-22T08:37:41.890 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.860+0000 7f6da6d77640 1 -- 172.21.15.142:0/419643312 <== osd.1 v2:172.21.15.142:6816/3192108003 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d9c029040 con 0x55a885159630 2024-09-22T08:37:41.890 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.860+0000 7f6da6d77640 1 -- 172.21.15.142:0/419643312 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a885162410 con 0x55a885159630 2024-09-22T08:37:41.890 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.860+0000 7f6da6d77640 1 -- 172.21.15.142:0/419643312 <== osd.1 v2:172.21.15.142:6816/3192108003 7 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d9c029040 con 0x55a885159630 2024-09-22T08:37:41.890 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.860+0000 7f6da6d77640 1 -- 172.21.15.142:0/419643312 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a885162410 con 0x7f6d9805f040 2024-09-22T08:37:41.890 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.860+0000 7f6da6d77640 1 -- 172.21.15.142:0/419643312 <== osd.0 v2:172.21.15.31:6800/168281188 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d9c029040 con 0x7f6d9805f040 2024-09-22T08:37:41.891 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.860+0000 7f6da6d77640 1 -- 172.21.15.142:0/419643312 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a885162410 con 0x7f6da002b7f0 2024-09-22T08:37:41.891 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.860+0000 7f6da7578640 1 -- 172.21.15.142:0/419643312 <== osd.2 v2:172.21.15.142:6808/279438927 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d98051070 con 0x7f6da002b7f0 2024-09-22T08:37:41.891 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.861+0000 7f6da7578640 1 -- 172.21.15.142:0/419643312 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a885162410 con 0x55a88515df30 2024-09-22T08:37:41.891 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.861+0000 7f6da7d79640 1 -- 172.21.15.142:0/419643312 <== osd.3 v2:172.21.15.142:6800/1064901393 3 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6da000a4d0 con 0x55a88515df30 2024-09-22T08:37:41.891 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.861+0000 7f6da7d79640 1 -- 172.21.15.142:0/419643312 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a885162410 con 0x55a885159630 2024-09-22T08:37:41.891 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.861+0000 7f6da6d77640 1 -- 172.21.15.142:0/419643312 <== osd.1 v2:172.21.15.142:6816/3192108003 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d9c029040 con 0x55a885159630 2024-09-22T08:37:41.891 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.861+0000 7f6da6d77640 1 -- 172.21.15.142:0/419643312 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a885162410 con 0x7f6d9805f040 2024-09-22T08:37:41.891 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.861+0000 7f6da6d77640 1 -- 172.21.15.142:0/419643312 <== osd.0 v2:172.21.15.31:6800/168281188 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d9c029040 con 0x7f6d9805f040 2024-09-22T08:37:41.892 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.861+0000 7f6da6d77640 1 -- 172.21.15.142:0/419643312 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a885162410 con 0x55a885159630 2024-09-22T08:37:41.892 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.862+0000 7f6da6d77640 1 -- 172.21.15.142:0/419643312 <== osd.1 v2:172.21.15.142:6816/3192108003 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d9c029040 con 0x55a885159630 2024-09-22T08:37:41.892 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.862+0000 7f6da6d77640 1 -- 172.21.15.142:0/419643312 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a885162410 con 0x7f6da002b7f0 2024-09-22T08:37:41.892 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.862+0000 7f6da7578640 1 -- 172.21.15.142:0/419643312 <== osd.2 v2:172.21.15.142:6808/279438927 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f6d98051070 con 0x7f6da002b7f0 2024-09-22T08:37:41.892 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.862+0000 7f6da7578640 1 -- 172.21.15.142:0/419643312 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a885162410 con 0x55a88515df30 2024-09-22T08:37:41.892 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.862+0000 7f6da7d79640 1 -- 172.21.15.142:0/419643312 <== osd.3 v2:172.21.15.142:6800/1064901393 4 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6da000a4d0 con 0x55a88515df30 2024-09-22T08:37:41.892 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.862+0000 7f6da7d79640 1 -- 172.21.15.142:0/419643312 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a885162410 con 0x55a88515df30 2024-09-22T08:37:41.892 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.862+0000 7f6da7d79640 1 -- 172.21.15.142:0/419643312 <== osd.3 v2:172.21.15.142:6800/1064901393 5 ==== osd_op_reply(20 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f6da000a4d0 con 0x55a88515df30 2024-09-22T08:37:41.892 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.862+0000 7f6da7d79640 1 -- 172.21.15.142:0/419643312 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a885162410 con 0x7f6d9805f040 2024-09-22T08:37:41.893 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.863+0000 7f6da6d77640 1 -- 172.21.15.142:0/419643312 <== osd.0 v2:172.21.15.31:6800/168281188 4 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d9c029040 con 0x7f6d9805f040 2024-09-22T08:37:41.893 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.863+0000 7f6da6d77640 1 -- 172.21.15.142:0/419643312 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a885162410 con 0x55a88515df30 2024-09-22T08:37:41.893 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.863+0000 7f6da7d79640 1 -- 172.21.15.142:0/419643312 <== osd.3 v2:172.21.15.142:6800/1064901393 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6da000a4d0 con 0x55a88515df30 2024-09-22T08:37:41.893 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.863+0000 7f6da7d79640 1 -- 172.21.15.142:0/419643312 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a885162410 con 0x55a88515df30 2024-09-22T08:37:41.893 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.863+0000 7f6da7d79640 1 -- 172.21.15.142:0/419643312 <== osd.3 v2:172.21.15.142:6800/1064901393 7 ==== osd_op_reply(23 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f6da000a4d0 con 0x55a88515df30 2024-09-22T08:37:41.893 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.863+0000 7f6da7d79640 1 -- 172.21.15.142:0/419643312 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a885162410 con 0x55a885159630 2024-09-22T08:37:41.893 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.863+0000 7f6da6d77640 1 -- 172.21.15.142:0/419643312 <== osd.1 v2:172.21.15.142:6816/3192108003 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d9c029040 con 0x55a885159630 2024-09-22T08:37:41.893 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.863+0000 7f6da6d77640 1 -- 172.21.15.142:0/419643312 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a885162410 con 0x55a885159630 2024-09-22T08:37:41.893 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.863+0000 7f6da6d77640 1 -- 172.21.15.142:0/419643312 <== osd.1 v2:172.21.15.142:6816/3192108003 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f6d9c029040 con 0x55a885159630 2024-09-22T08:37:41.893 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.863+0000 7f6da6d77640 1 -- 172.21.15.142:0/419643312 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a885162410 con 0x7f6d9805f040 2024-09-22T08:37:41.893 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.864+0000 7f6da6d77640 1 -- 172.21.15.142:0/419643312 <== osd.0 v2:172.21.15.31:6800/168281188 5 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d9c029040 con 0x7f6d9805f040 2024-09-22T08:37:41.893 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.864+0000 7f6da6d77640 1 -- 172.21.15.142:0/419643312 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a885162410 con 0x55a88515df30 2024-09-22T08:37:41.893 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.864+0000 7f6da7d79640 1 -- 172.21.15.142:0/419643312 <== osd.3 v2:172.21.15.142:6800/1064901393 8 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6da000a4d0 con 0x55a88515df30 2024-09-22T08:37:41.894 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.864+0000 7f6da7d79640 1 -- 172.21.15.142:0/419643312 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a885162410 con 0x7f6da002b7f0 2024-09-22T08:37:41.894 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.864+0000 7f6da7578640 1 -- 172.21.15.142:0/419643312 <== osd.2 v2:172.21.15.142:6808/279438927 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d98051070 con 0x7f6da002b7f0 2024-09-22T08:37:41.894 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.864+0000 7f6da7578640 1 -- 172.21.15.142:0/419643312 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a885162410 con 0x55a885159630 2024-09-22T08:37:41.894 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.865+0000 7f6da6d77640 1 -- 172.21.15.142:0/419643312 <== osd.1 v2:172.21.15.142:6816/3192108003 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d9c029040 con 0x55a885159630 2024-09-22T08:37:41.894 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.865+0000 7f6da6d77640 1 -- 172.21.15.142:0/419643312 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a885162410 con 0x7f6d9805f040 2024-09-22T08:37:41.894 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.865+0000 7f6da6d77640 1 -- 172.21.15.142:0/419643312 <== osd.0 v2:172.21.15.31:6800/168281188 6 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d9c029040 con 0x7f6d9805f040 2024-09-22T08:37:41.894 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.865+0000 7f6da6d77640 1 -- 172.21.15.142:0/419643312 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a885162410 con 0x55a88515df30 2024-09-22T08:37:41.894 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.865+0000 7f6da7d79640 1 -- 172.21.15.142:0/419643312 <== osd.3 v2:172.21.15.142:6800/1064901393 9 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6da000a4d0 con 0x55a88515df30 2024-09-22T08:37:41.894 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.865+0000 7f6da7d79640 1 -- 172.21.15.142:0/419643312 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a885162410 con 0x7f6d9805f040 2024-09-22T08:37:41.894 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.865+0000 7f6da6d77640 1 -- 172.21.15.142:0/419643312 <== osd.0 v2:172.21.15.31:6800/168281188 7 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d9c029040 con 0x7f6d9805f040 2024-09-22T08:37:41.894 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.865+0000 7f6da6d77640 1 -- 172.21.15.142:0/419643312 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a885162410 con 0x7f6da002b7f0 2024-09-22T08:37:41.894 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.866+0000 7f6da7578640 1 -- 172.21.15.142:0/419643312 <== osd.2 v2:172.21.15.142:6808/279438927 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d98051070 con 0x7f6da002b7f0 2024-09-22T08:37:41.894 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.866+0000 7f6da7578640 1 -- 172.21.15.142:0/419643312 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a885162410 con 0x55a88515df30 2024-09-22T08:37:41.894 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.866+0000 7f6da7d79640 1 -- 172.21.15.142:0/419643312 <== osd.3 v2:172.21.15.142:6800/1064901393 10 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6da000a4d0 con 0x55a88515df30 2024-09-22T08:37:41.895 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.866+0000 7f6da7d79640 1 -- 172.21.15.142:0/419643312 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a885162410 con 0x7f6d9805f040 2024-09-22T08:37:41.895 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.866+0000 7f6da6d77640 1 -- 172.21.15.142:0/419643312 <== osd.0 v2:172.21.15.31:6800/168281188 8 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d9c029040 con 0x7f6d9805f040 2024-09-22T08:37:41.895 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.866+0000 7f6da6d77640 1 -- 172.21.15.142:0/419643312 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a885162410 con 0x55a885159630 2024-09-22T08:37:41.895 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.866+0000 7f6da6d77640 1 -- 172.21.15.142:0/419643312 <== osd.1 v2:172.21.15.142:6816/3192108003 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f6d9c029040 con 0x55a885159630 2024-09-22T08:37:41.895 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.866+0000 7f6da6d77640 1 -- 172.21.15.142:0/419643312 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a885162410 con 0x7f6da002b7f0 2024-09-22T08:37:41.895 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.867+0000 7f6da7578640 1 -- 172.21.15.142:0/419643312 <== osd.2 v2:172.21.15.142:6808/279438927 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d98051070 con 0x7f6da002b7f0 2024-09-22T08:37:41.895 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.867+0000 7f6da9a87800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:37:41.895 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.867+0000 7f6da9a87800 20 RGWRados::pool_iterate: got zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec 2024-09-22T08:37:41.895 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.867+0000 7f6da9a87800 20 RGWRados::pool_iterate: got zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f 2024-09-22T08:37:41.895 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.867+0000 7f6da9a87800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:37:41.895 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.867+0000 7f6da9a87800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:37:41.895 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.867+0000 7f6da9a87800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:37:41.895 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.867+0000 7f6da9a87800 20 rados->read ofs=0 len=0 2024-09-22T08:37:41.896 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.867+0000 7f6da9a87800 1 -- 172.21.15.142:0/419643312 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a8851614e0 con 0x55a885159630 2024-09-22T08:37:41.896 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.867+0000 7f6da6d77640 1 -- 172.21.15.142:0/419643312 <== osd.1 v2:172.21.15.142:6816/3192108003 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6d9c029040 con 0x55a885159630 2024-09-22T08:37:41.896 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.867+0000 7f6da9a87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:41.896 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.867+0000 7f6da9a87800 20 rados->read ofs=0 len=0 2024-09-22T08:37:41.896 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.867+0000 7f6da9a87800 1 -- 172.21.15.142:0/419643312 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a8851610f0 con 0x55a885159630 2024-09-22T08:37:41.896 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.867+0000 7f6da6d77640 1 -- 172.21.15.142:0/419643312 <== osd.1 v2:172.21.15.142:6816/3192108003 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6d9c029040 con 0x55a885159630 2024-09-22T08:37:41.896 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.867+0000 7f6da9a87800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:37:41.896 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.867+0000 7f6da9a87800 20 rados->read ofs=0 len=0 2024-09-22T08:37:41.896 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.867+0000 7f6da9a87800 1 -- 172.21.15.142:0/419643312 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:40 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a885161dd0 con 0x55a88515df30 2024-09-22T08:37:41.896 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.868+0000 7f6da7d79640 1 -- 172.21.15.142:0/419643312 <== osd.3 v2:172.21.15.142:6800/1064901393 11 ==== osd_op_reply(40 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f6da000a4d0 con 0x55a88515df30 2024-09-22T08:37:41.896 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.868+0000 7f6da9a87800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:37:41.896 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.868+0000 7f6da9a87800 20 zone default found 2024-09-22T08:37:41.896 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.868+0000 7f6da9a87800 4 Realm: () 2024-09-22T08:37:41.896 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.868+0000 7f6da9a87800 4 ZoneGroup: default (d89f6f57-1007-47dd-9065-f486c7b01aec) 2024-09-22T08:37:41.897 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.868+0000 7f6da9a87800 4 Zone: default (e239248c-0bee-4e41-803a-24b288d3eb8f) 2024-09-22T08:37:41.897 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.868+0000 7f6da9a87800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:37:41.897 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.868+0000 7f6da9a87800 20 zonegroup default 2024-09-22T08:37:41.897 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.868+0000 7f6da9a87800 20 rados->read ofs=0 len=0 2024-09-22T08:37:41.897 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.868+0000 7f6da9a87800 1 -- 172.21.15.142:0/419643312 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a885161990 con 0x7f6d9805f040 2024-09-22T08:37:41.897 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.868+0000 7f6da6d77640 1 -- 172.21.15.142:0/419643312 <== osd.0 v2:172.21.15.31:6800/168281188 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f6d9c029040 con 0x7f6d9805f040 2024-09-22T08:37:41.897 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.868+0000 7f6da9a87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:41.897 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.868+0000 7f6da9a87800 20 rados->read ofs=0 len=0 2024-09-22T08:37:41.897 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.868+0000 7f6da9a87800 1 -- 172.21.15.142:0/419643312 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a885164c80 con 0x55a88515df30 2024-09-22T08:37:41.897 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.868+0000 7f6da7d79640 1 -- 172.21.15.142:0/419643312 <== osd.3 v2:172.21.15.142:6800/1064901393 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6da000a4d0 con 0x55a88515df30 2024-09-22T08:37:41.897 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.868+0000 7f6da9a87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:41.897 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.868+0000 7f6da9a87800 20 rados->read ofs=0 len=0 2024-09-22T08:37:41.897 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.868+0000 7f6da9a87800 1 -- 172.21.15.142:0/419643312 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a885165020 con 0x55a88515df30 2024-09-22T08:37:41.897 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.868+0000 7f6da7d79640 1 -- 172.21.15.142:0/419643312 <== osd.3 v2:172.21.15.142:6800/1064901393 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6da000a4d0 con 0x55a88515df30 2024-09-22T08:37:41.897 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.868+0000 7f6da9a87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:41.898 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.868+0000 7f6da9a87800 20 started sync module instance, tier type = 2024-09-22T08:37:41.898 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.868+0000 7f6da9a87800 20 started zone id=e239248c-0bee-4e41-803a-24b288d3eb8f (name=default) with tier type = 2024-09-22T08:37:41.898 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.868+0000 7f6da9a87800 1 -- 172.21.15.142:0/419643312 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a8851640c0 con 0x7f6da002b7f0 2024-09-22T08:37:41.898 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.869+0000 7f6da7578640 1 -- 172.21.15.142:0/419643312 <== osd.2 v2:172.21.15.142:6808/279438927 7 ==== osd_op_reply(44 notify.0 [create] v32'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d98051070 con 0x7f6da002b7f0 2024-09-22T08:37:41.898 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.870+0000 7f6da9a87800 1 -- 172.21.15.142:0/419643312 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94182275695840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a885163d20 con 0x7f6da002b7f0 2024-09-22T08:37:41.898 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.870+0000 7f6da9a87800 1 -- 172.21.15.142:0/419643312 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a885165f50 con 0x55a885159630 2024-09-22T08:37:41.898 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.871+0000 7f6da7578640 1 -- 172.21.15.142:0/419643312 <== osd.2 v2:172.21.15.142:6808/279438927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94182275695840] v32'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d98051070 con 0x7f6da002b7f0 2024-09-22T08:37:41.898 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.871+0000 7f6da6d77640 1 -- 172.21.15.142:0/419643312 <== osd.1 v2:172.21.15.142:6816/3192108003 16 ==== osd_op_reply(46 notify.1 [create] v32'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d9c029040 con 0x55a885159630 2024-09-22T08:37:41.898 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.871+0000 7f6da9a87800 1 -- 172.21.15.142:0/419643312 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94182275701408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a885166370 con 0x55a885159630 2024-09-22T08:37:41.898 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.871+0000 7f6da9a87800 1 -- 172.21.15.142:0/419643312 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a885166d30 con 0x55a88515df30 2024-09-22T08:37:41.898 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.872+0000 7f6da7d79640 1 -- 172.21.15.142:0/419643312 <== osd.3 v2:172.21.15.142:6800/1064901393 14 ==== osd_op_reply(48 notify.2 [create] v32'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6da000a4d0 con 0x55a88515df30 2024-09-22T08:37:41.898 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.872+0000 7f6da9a87800 1 -- 172.21.15.142:0/419643312 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94182275704960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a885166ce0 con 0x55a88515df30 2024-09-22T08:37:41.898 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.872+0000 7f6da9a87800 1 -- 172.21.15.142:0/419643312 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a885167ce0 con 0x7f6da002b7f0 2024-09-22T08:37:41.899 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.872+0000 7f6da6d77640 1 -- 172.21.15.142:0/419643312 <== osd.1 v2:172.21.15.142:6816/3192108003 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94182275701408] v32'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d9c029040 con 0x55a885159630 2024-09-22T08:37:41.899 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.873+0000 7f6da7578640 1 -- 172.21.15.142:0/419643312 <== osd.2 v2:172.21.15.142:6808/279438927 9 ==== osd_op_reply(50 notify.3 [create] v32'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d98051070 con 0x7f6da002b7f0 2024-09-22T08:37:41.899 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.873+0000 7f6da9a87800 1 -- 172.21.15.142:0/419643312 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94182275702464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a885167ca0 con 0x7f6da002b7f0 2024-09-22T08:37:41.899 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.873+0000 7f6da9a87800 1 -- 172.21.15.142:0/419643312 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a885168760 con 0x55a885159630 2024-09-22T08:37:41.899 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.873+0000 7f6da7d79640 1 -- 172.21.15.142:0/419643312 <== osd.3 v2:172.21.15.142:6800/1064901393 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94182275704960] v32'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6da000a4d0 con 0x55a88515df30 2024-09-22T08:37:41.899 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.874+0000 7f6da7578640 1 -- 172.21.15.142:0/419643312 <== osd.2 v2:172.21.15.142:6808/279438927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94182275702464] v32'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d98051070 con 0x7f6da002b7f0 2024-09-22T08:37:41.899 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.874+0000 7f6da6d77640 1 -- 172.21.15.142:0/419643312 <== osd.1 v2:172.21.15.142:6816/3192108003 18 ==== osd_op_reply(52 notify.4 [create] v32'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d9c029040 con 0x55a885159630 2024-09-22T08:37:41.899 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.874+0000 7f6da9a87800 1 -- 172.21.15.142:0/419643312 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94182275707168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a8851677f0 con 0x55a885159630 2024-09-22T08:37:41.899 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.874+0000 7f6da9a87800 1 -- 172.21.15.142:0/419643312 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a885169030 con 0x7f6d9805f040 2024-09-22T08:37:41.899 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.876+0000 7f6da6d77640 1 -- 172.21.15.142:0/419643312 <== osd.0 v2:172.21.15.31:6800/168281188 10 ==== osd_op_reply(54 notify.5 [create] v32'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d9c029040 con 0x7f6d9805f040 2024-09-22T08:37:41.899 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.876+0000 7f6da9a87800 1 -- 172.21.15.142:0/419643312 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94182275713648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a885169340 con 0x7f6d9805f040 2024-09-22T08:37:41.899 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.876+0000 7f6da9a87800 1 -- 172.21.15.142:0/419643312 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a885169c10 con 0x7f6d9805f040 2024-09-22T08:37:41.899 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.876+0000 7f6da6d77640 1 -- 172.21.15.142:0/419643312 <== osd.1 v2:172.21.15.142:6816/3192108003 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94182275707168] v32'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d9c029040 con 0x55a885159630 2024-09-22T08:37:41.899 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.876+0000 7f6da6d77640 1 -- 172.21.15.142:0/419643312 <== osd.0 v2:172.21.15.31:6800/168281188 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94182275713648] v32'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d9c029040 con 0x7f6d9805f040 2024-09-22T08:37:41.899 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.877+0000 7f6da6d77640 1 -- 172.21.15.142:0/419643312 <== osd.0 v2:172.21.15.31:6800/168281188 12 ==== osd_op_reply(56 notify.6 [create] v32'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d9c029040 con 0x7f6d9805f040 2024-09-22T08:37:41.900 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.877+0000 7f6da9a87800 1 -- 172.21.15.142:0/419643312 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94182275711600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a885169340 con 0x7f6d9805f040 2024-09-22T08:37:41.900 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.877+0000 7f6da9a87800 1 -- 172.21.15.142:0/419643312 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a88516a2a0 con 0x7f6d9805f040 2024-09-22T08:37:41.900 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.878+0000 7f6da6d77640 1 -- 172.21.15.142:0/419643312 <== osd.0 v2:172.21.15.31:6800/168281188 13 ==== osd_op_reply(58 notify.7 [create] v32'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d9c029040 con 0x7f6d9805f040 2024-09-22T08:37:41.900 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.878+0000 7f6da6d77640 1 -- 172.21.15.142:0/419643312 <== osd.0 v2:172.21.15.31:6800/168281188 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94182275711600] v32'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d9c029040 con 0x7f6d9805f040 2024-09-22T08:37:41.900 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.878+0000 7f6da9a87800 1 -- 172.21.15.142:0/419643312 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94182275718640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a88516a6c0 con 0x7f6d9805f040 2024-09-22T08:37:41.900 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.878+0000 7f6da9a87800 20 add_watcher() i=0 2024-09-22T08:37:41.900 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.878+0000 7f6da9a87800 20 add_watcher() i=1 2024-09-22T08:37:41.900 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.878+0000 7f6da9a87800 20 add_watcher() i=2 2024-09-22T08:37:41.900 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.878+0000 7f6da9a87800 20 add_watcher() i=3 2024-09-22T08:37:41.900 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.878+0000 7f6da9a87800 20 add_watcher() i=4 2024-09-22T08:37:41.900 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.878+0000 7f6da9a87800 20 add_watcher() i=5 2024-09-22T08:37:41.900 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.878+0000 7f6da9a87800 20 add_watcher() i=6 2024-09-22T08:37:41.900 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.879+0000 7f6da6d77640 1 -- 172.21.15.142:0/419643312 <== osd.0 v2:172.21.15.31:6800/168281188 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94182275718640] v32'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d9c029040 con 0x7f6d9805f040 2024-09-22T08:37:41.900 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.879+0000 7f6da9a87800 20 add_watcher() i=7 2024-09-22T08:37:41.901 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.879+0000 7f6da9a87800 2 all 8 watchers are set, enabling cache 2024-09-22T08:37:41.901 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.879+0000 7f6da9a87800 1 -- 172.21.15.142:0/419643312 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a88516d6f0 con 0x55a885159630 2024-09-22T08:37:41.901 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.879+0000 7f6da6d77640 1 -- 172.21.15.142:0/419643312 <== osd.1 v2:172.21.15.142:6816/3192108003 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f6d9c029040 con 0x55a885159630 2024-09-22T08:37:41.901 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.879+0000 7f6da9a87800 1 -- 172.21.15.142:0/419643312 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94182275719696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a88516ab80 con 0x55a885159630 2024-09-22T08:37:41.901 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.880+0000 7f6da6d77640 1 -- 172.21.15.142:0/419643312 <== osd.1 v2:172.21.15.142:6816/3192108003 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94182275719696] v32'204 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6d9c029040 con 0x55a885159630 2024-09-22T08:37:41.901 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.880+0000 7f6c5dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:37:41.901 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.880+0000 7f6da9a87800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:37:41.901 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.880+0000 7f6da9a87800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:37:41.901 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.880+0000 7f6da9a87800 5 note: GC not initialized 2024-09-22T08:37:41.901 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.881+0000 7f6c5cfe1640 20 reqs_thread_entry: start 2024-09-22T08:37:41.901 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.881+0000 7f6da9a87800 20 init_complete bucket index max shards: 11 2024-09-22T08:37:41.901 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.881+0000 7f6da9a87800 20 Filter name: none 2024-09-22T08:37:41.901 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.881+0000 7f6bd67fc640 20 reqs_thread_entry: start 2024-09-22T08:37:41.901 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.881+0000 7f6da9a87800 20 rados->read ofs=0 len=0 2024-09-22T08:37:41.901 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.881+0000 7f6da9a87800 1 -- 172.21.15.142:0/419643312 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a8851a04e0 con 0x55a885159630 2024-09-22T08:37:41.901 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.881+0000 7f6da6d77640 1 -- 172.21.15.142:0/419643312 <== osd.1 v2:172.21.15.142:6816/3192108003 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f6d9c029040 con 0x55a885159630 2024-09-22T08:37:41.902 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.881+0000 7f6da9a87800 20 rados_obj.operate() r=0 bl.length=391 2024-09-22T08:37:41.902 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.881+0000 7f6da9a87800 1 -- 172.21.15.142:0/419643312 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a8851a1a60 con 0x7f6d9805f040 2024-09-22T08:37:41.902 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.882+0000 7f6da6d77640 1 -- 172.21.15.142:0/419643312 <== osd.0 v2:172.21.15.31:6800/168281188 16 ==== osd_op_reply(63 usage.10 [call out=1378b] v0'0 uv29 ondisk = 0) ==== 152+0+1378 (crc 0 0 0) 0x7f6d9c029040 con 0x7f6d9805f040 2024-09-22T08:37:41.902 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.883+0000 7f6c5dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:37:41.902 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.883+0000 7f6da9a87800 1 -- 172.21.15.142:0/419643312 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94182275719696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a88519fe00 con 0x55a885159630 2024-09-22T08:37:41.902 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.884+0000 7f6da6d77640 1 -- 172.21.15.142:0/419643312 <== osd.1 v2:172.21.15.142:6816/3192108003 23 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94182275719696] v32'205 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6d9c029040 con 0x55a885159630 2024-09-22T08:37:41.902 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.884+0000 7f6da9a87800 1 -- 172.21.15.142:0/419643312 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94182275695840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a88516a210 con 0x7f6da002b7f0 2024-09-22T08:37:41.902 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.885+0000 7f6da7578640 1 -- 172.21.15.142:0/419643312 <== osd.2 v2:172.21.15.142:6808/279438927 11 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94182275695840] v32'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d98051070 con 0x7f6da002b7f0 2024-09-22T08:37:41.902 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.885+0000 7f6da9a87800 20 remove_watcher() i=0 2024-09-22T08:37:41.902 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.885+0000 7f6da9a87800 2 removed watcher, disabling cache 2024-09-22T08:37:41.902 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.885+0000 7f6da9a87800 1 -- 172.21.15.142:0/419643312 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94182275701408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a8851644e0 con 0x55a885159630 2024-09-22T08:37:41.902 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.886+0000 7f6da6d77640 1 -- 172.21.15.142:0/419643312 <== osd.1 v2:172.21.15.142:6816/3192108003 24 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94182275701408] v32'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d9c029040 con 0x55a885159630 2024-09-22T08:37:41.902 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.886+0000 7f6da9a87800 20 remove_watcher() i=1 2024-09-22T08:37:41.902 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.886+0000 7f6da9a87800 1 -- 172.21.15.142:0/419643312 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94182275704960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a8851644e0 con 0x55a88515df30 2024-09-22T08:37:41.903 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.887+0000 7f6da7d79640 1 -- 172.21.15.142:0/419643312 <== osd.3 v2:172.21.15.142:6800/1064901393 16 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94182275704960] v32'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6da000a4d0 con 0x55a88515df30 2024-09-22T08:37:41.903 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.887+0000 7f6da9a87800 20 remove_watcher() i=2 2024-09-22T08:37:41.903 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.887+0000 7f6da9a87800 1 -- 172.21.15.142:0/419643312 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94182275702464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a885166880 con 0x7f6da002b7f0 2024-09-22T08:37:41.903 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.888+0000 7f6da7578640 1 -- 172.21.15.142:0/419643312 <== osd.2 v2:172.21.15.142:6808/279438927 12 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94182275702464] v32'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d98051070 con 0x7f6da002b7f0 2024-09-22T08:37:41.903 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.888+0000 7f6da9a87800 20 remove_watcher() i=3 2024-09-22T08:37:41.903 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.888+0000 7f6da9a87800 1 -- 172.21.15.142:0/419643312 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94182275707168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a885165f50 con 0x55a885159630 2024-09-22T08:37:41.907 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.889+0000 7f6da6d77640 1 -- 172.21.15.142:0/419643312 <== osd.1 v2:172.21.15.142:6816/3192108003 25 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94182275707168] v32'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d9c029040 con 0x55a885159630 2024-09-22T08:37:41.907 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.889+0000 7f6da9a87800 20 remove_watcher() i=4 2024-09-22T08:37:41.907 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.889+0000 7f6da9a87800 1 -- 172.21.15.142:0/419643312 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94182275713648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a8851644e0 con 0x7f6d9805f040 2024-09-22T08:37:41.907 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.890+0000 7f6da6d77640 1 -- 172.21.15.142:0/419643312 <== osd.0 v2:172.21.15.31:6800/168281188 17 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94182275713648] v32'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d9c029040 con 0x7f6d9805f040 2024-09-22T08:37:41.907 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.890+0000 7f6da9a87800 20 remove_watcher() i=5 2024-09-22T08:37:41.907 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.890+0000 7f6da9a87800 1 -- 172.21.15.142:0/419643312 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94182275711600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a8851644e0 con 0x7f6d9805f040 2024-09-22T08:37:41.907 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.891+0000 7f6da6d77640 1 -- 172.21.15.142:0/419643312 <== osd.0 v2:172.21.15.31:6800/168281188 18 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94182275711600] v32'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d9c029040 con 0x7f6d9805f040 2024-09-22T08:37:41.907 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.891+0000 7f6da9a87800 20 remove_watcher() i=6 2024-09-22T08:37:41.907 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.891+0000 7f6da9a87800 1 -- 172.21.15.142:0/419643312 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94182275718640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a8851644e0 con 0x7f6d9805f040 2024-09-22T08:37:41.907 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.892+0000 7f6da6d77640 1 -- 172.21.15.142:0/419643312 <== osd.0 v2:172.21.15.31:6800/168281188 19 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94182275718640] v32'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d9c029040 con 0x7f6d9805f040 2024-09-22T08:37:41.907 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.892+0000 7f6da9a87800 20 remove_watcher() i=7 2024-09-22T08:37:41.907 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.892+0000 7f6da9a87800 1 -- 172.21.15.142:0/419643312 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f6d9805f040 msgr2=0x7f6d9808ff70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:41.908 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.892+0000 7f6da9a87800 1 --2- 172.21.15.142:0/419643312 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f6d9805f040 0x7f6d9808ff70 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:41.908 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.892+0000 7f6da9a87800 1 -- 172.21.15.142:0/419643312 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55a885159630 msgr2=0x55a88515baf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:41.908 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.892+0000 7f6da9a87800 1 --2- 172.21.15.142:0/419643312 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55a885159630 0x55a88515baf0 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:41.908 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.892+0000 7f6da9a87800 1 -- 172.21.15.142:0/419643312 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f6da002b7f0 msgr2=0x7f6da0032800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:41.908 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.892+0000 7f6da9a87800 1 --2- 172.21.15.142:0/419643312 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f6da002b7f0 0x7f6da0032800 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:41.908 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.893+0000 7f6da9a87800 1 -- 172.21.15.142:0/419643312 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55a88515df30 msgr2=0x55a885160320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:41.908 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.893+0000 7f6da9a87800 1 --2- 172.21.15.142:0/419643312 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55a88515df30 0x55a885160320 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:41.908 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.893+0000 7f6da9a87800 1 -- 172.21.15.142:0/419643312 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f6c7003d000 msgr2=0x7f6c7003f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:41.908 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.893+0000 7f6da9a87800 1 --2- 172.21.15.142:0/419643312 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f6c7003d000 0x7f6c7003f4c0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f6d98045a60 tx=0x7f6d98082000 comp rx=0 tx=0).stop 2024-09-22T08:37:41.908 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.893+0000 7f6da9a87800 1 -- 172.21.15.142:0/419643312 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a885024080 msgr2=0x55a88514dd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:41.908 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.893+0000 7f6da6d77640 1 -- 172.21.15.142:0/419643312 reap_dead start 2024-09-22T08:37:41.908 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.893+0000 7f6da9a87800 1 --2- 172.21.15.142:0/419643312 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a885024080 0x55a88514dd10 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f6da0020000 tx=0x7f6da0054860 comp rx=0 tx=0).stop 2024-09-22T08:37:41.908 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.893+0000 7f6da9a87800 1 -- 172.21.15.142:0/419643312 shutdown_connections 2024-09-22T08:37:41.908 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.893+0000 7f6da9a87800 1 --2- 172.21.15.142:0/419643312 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a885024080 0x55a88514dd10 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:41.908 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.893+0000 7f6da9a87800 1 -- 172.21.15.142:0/419643312 >> 172.21.15.142:0/419643312 conn(0x55a885140940 msgr2=0x55a88513eb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:37:41.909 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.893+0000 7f6da9a87800 1 -- 172.21.15.142:0/419643312 shutdown_connections 2024-09-22T08:37:41.909 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.893+0000 7f6da9a87800 1 -- 172.21.15.142:0/419643312 wait complete. 2024-09-22T08:37:41.909 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.893+0000 7f6da9a87800 1 -- 172.21.15.142:0/3245508670 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f6c8003cfb0 msgr2=0x7f6c8003f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:41.909 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.893+0000 7f6da9a87800 1 --2- 172.21.15.142:0/3245508670 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f6c8003cfb0 0x7f6c8003f470 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f6d98068fd0 tx=0x7f6d9805d620 comp rx=0 tx=0).stop 2024-09-22T08:37:41.909 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.893+0000 7f6da9a87800 1 -- 172.21.15.142:0/3245508670 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a885137a20 msgr2=0x55a885137e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:41.909 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.893+0000 7f6da9a87800 1 --2- 172.21.15.142:0/3245508670 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a885137a20 0x55a885137e40 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x55a88511db30 tx=0x7f6da00167b0 comp rx=0 tx=0).stop 2024-09-22T08:37:41.909 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.893+0000 7f6da9a87800 1 -- 172.21.15.142:0/3245508670 shutdown_connections 2024-09-22T08:37:41.909 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.893+0000 7f6da9a87800 1 --2- 172.21.15.142:0/3245508670 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f6c8003cfb0 0x7f6c8003f470 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:41.909 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.893+0000 7f6da9a87800 1 --2- 172.21.15.142:0/3245508670 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a885137a20 0x55a885137e40 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:41.909 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.893+0000 7f6da9a87800 1 -- 172.21.15.142:0/3245508670 >> 172.21.15.142:0/3245508670 conn(0x55a88512bdd0 msgr2=0x55a88512c1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:37:41.909 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.893+0000 7f6da9a87800 1 -- 172.21.15.142:0/3245508670 shutdown_connections 2024-09-22T08:37:41.909 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.893+0000 7f6da9a87800 1 -- 172.21.15.142:0/3245508670 wait complete. 2024-09-22T08:37:41.909 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.893+0000 7f6da9a87800 1 -- 172.21.15.142:0/1769604270 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55a8850289b0 msgr2=0x55a885124180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:41.909 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.893+0000 7f6da9a87800 1 --2- 172.21.15.142:0/1769604270 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55a8850289b0 0x55a885124180 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:41.909 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.894+0000 7f6da9a87800 1 -- 172.21.15.142:0/1769604270 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55a8851264b0 msgr2=0x55a885128950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:41.910 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.894+0000 7f6da9a87800 1 --2- 172.21.15.142:0/1769604270 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55a8851264b0 0x55a885128950 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:41.910 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.894+0000 7f6da9a87800 1 -- 172.21.15.142:0/1769604270 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f6c8c03d000 msgr2=0x7f6c8c03f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:41.910 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.894+0000 7f6da9a87800 1 --2- 172.21.15.142:0/1769604270 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f6c8c03d000 0x7f6c8c03f4c0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f6d9c001d70 tx=0x7f6d9c0012d0 comp rx=0 tx=0).stop 2024-09-22T08:37:41.910 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.894+0000 7f6da9a87800 1 -- 172.21.15.142:0/1769604270 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a885026080 msgr2=0x55a88511cb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:41.910 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.894+0000 7f6da9a87800 1 --2- 172.21.15.142:0/1769604270 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a885026080 0x55a88511cb30 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f6d98025c20 tx=0x7f6d98002fb0 comp rx=0 tx=0).stop 2024-09-22T08:37:41.910 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.894+0000 7f6da9a87800 1 -- 172.21.15.142:0/1769604270 shutdown_connections 2024-09-22T08:37:41.910 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.894+0000 7f6da9a87800 1 --2- 172.21.15.142:0/1769604270 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55a8851264b0 0x55a885128950 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:41.910 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.894+0000 7f6da9a87800 1 --2- 172.21.15.142:0/1769604270 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55a8850289b0 0x55a885124180 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:41.910 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.894+0000 7f6da9a87800 1 --2- 172.21.15.142:0/1769604270 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f6c8c03d000 0x7f6c8c03f4c0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:41.910 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.894+0000 7f6da9a87800 1 --2- 172.21.15.142:0/1769604270 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a885026080 0x55a88511cb30 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:41.910 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.894+0000 7f6da9a87800 1 -- 172.21.15.142:0/1769604270 >> 172.21.15.142:0/1769604270 conn(0x55a88501fbe0 msgr2=0x55a88510f1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:37:41.910 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.894+0000 7f6da9a87800 1 -- 172.21.15.142:0/1769604270 shutdown_connections 2024-09-22T08:37:41.910 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.894+0000 7f6da9a87800 1 -- 172.21.15.142:0/1769604270 wait complete. 2024-09-22T08:37:41.911 INFO:teuthology.orchestra.run.smithi142.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-09-22T08:00:00.000000Z","epoch":1726992000,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo","time":"2024-09-22T08:00:00.000000Z","epoch":1726992000,"owner":"foo","categories":[{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"s3select":{}},{"bucket":"myfoo2","time":"2024-09-22T08:00:00.000000Z","epoch":1726992000,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo3","time":"2024-09-22T08:00:00.000000Z","epoch":1726992000,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo4","time":"2024-09-22T08:00:00.000000Z","epoch":1726992000,"owner":"foo","categories":[],"s3select":{}}]}],"summary":[{"user":"foo","categories":[{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"total":{"bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11,"bytes_processed":0,"bytes_returned":0}}]} 2024-09-22T08:37:41.911 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-22T08:00:00.000000Z', 'epoch': 1726992000, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo', 'time': '2024-09-22T08:00:00.000000Z', 'epoch': 1726992000, 'owner': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 's3select': {}}, {'bucket': 'myfoo2', 'time': '2024-09-22T08:00:00.000000Z', 'epoch': 1726992000, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo3', 'time': '2024-09-22T08:00:00.000000Z', 'epoch': 1726992000, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo4', 'time': '2024-09-22T08:00:00.000000Z', 'epoch': 1726992000, 'owner': 'foo', 'categories': [], 's3select': {}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 'total': {'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-22T08:37:41.911 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'delete_obj'] 2024-09-22T08:37:41.911 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'delete_obj'] 2024-09-22T08:37:41.912 DEBUG:teuthology.orchestra.run.smithi142:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories delete_obj 2024-09-22T08:37:41.958 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:37:41.958 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:37:41.959 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.958+0000 7f2aee3af800 1 Processor -- start 2024-09-22T08:37:41.959 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.958+0000 7f2aee3af800 1 -- start start 2024-09-22T08:37:41.959 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.958+0000 7f2aee3af800 1 --2- >> v2:172.21.15.31:3300/0 conn(0x5573260347e0 0x5573260354e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:41.959 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.958+0000 7f2aee3af800 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x557325ec0a20 con 0x557326035a20 2024-09-22T08:37:41.959 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.958+0000 7f2aee3af800 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x557325ec07d0 con 0x5573260347e0 2024-09-22T08:37:41.960 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.958+0000 7f2aebea0640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x5573260347e0 0x5573260354e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:41.960 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.958+0000 7f2aebea0640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x5573260347e0 0x5573260354e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:55748/0 (socket says 172.21.15.142:55748) 2024-09-22T08:37:41.960 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.958+0000 7f2aebea0640 1 -- 172.21.15.142:0/819524396 learned_addr learned my addr 172.21.15.142:0/819524396 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:37:41.960 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.958+0000 7f2aeb69f640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x557326035a20 0x55732603a570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.142:50274/0 (socket says 172.21.15.142:50274) 2024-09-22T08:37:41.960 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.959+0000 7f2aebea0640 1 -- 172.21.15.142:0/819524396 >> v1:172.21.15.31:6789/0 conn(0x557326035a20 legacy=0x55732603a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:41.960 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.959+0000 7f2aeae9e640 1 -- 172.21.15.142:0/819524396 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1759408377 0 0) 0x557325ec0a20 con 0x557326035a20 2024-09-22T08:37:41.960 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.959+0000 7f2aebea0640 1 -- 172.21.15.142:0/819524396 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x557326034ee0 con 0x5573260347e0 2024-09-22T08:37:41.962 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.960+0000 7f2aebea0640 1 --2- 172.21.15.142:0/819524396 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5573260347e0 0x5573260354e0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f2adc00a6b0 tx=0x7f2adc047e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2de15b519514e1b server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:41.962 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.961+0000 7f2aeae9e640 1 -- 172.21.15.142:0/819524396 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2adc00a200 con 0x5573260347e0 2024-09-22T08:37:41.962 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.961+0000 7f2aeae9e640 1 -- 172.21.15.142:0/819524396 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2adc00a3a0 con 0x5573260347e0 2024-09-22T08:37:41.962 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.961+0000 7f2aeae9e640 1 -- 172.21.15.142:0/819524396 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2adc008700 con 0x5573260347e0 2024-09-22T08:37:41.963 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.961+0000 7f2aee3af800 1 -- 172.21.15.142:0/819524396 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5573260347e0 msgr2=0x5573260354e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:41.963 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.961+0000 7f2aee3af800 1 --2- 172.21.15.142:0/819524396 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5573260347e0 0x5573260354e0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f2adc00a6b0 tx=0x7f2adc047e30 comp rx=0 tx=0).stop 2024-09-22T08:37:41.963 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.961+0000 7f2aee3af800 1 -- 172.21.15.142:0/819524396 shutdown_connections 2024-09-22T08:37:41.963 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.961+0000 7f2aee3af800 1 --2- 172.21.15.142:0/819524396 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5573260347e0 0x5573260354e0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:41.963 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.961+0000 7f2aee3af800 1 -- 172.21.15.142:0/819524396 >> 172.21.15.142:0/819524396 conn(0x55732602fbb0 msgr2=0x557326032010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:37:41.963 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.961+0000 7f2aee3af800 1 -- 172.21.15.142:0/819524396 shutdown_connections 2024-09-22T08:37:41.963 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.961+0000 7f2aee3af800 1 -- 172.21.15.142:0/819524396 wait complete. 2024-09-22T08:37:41.977 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.975+0000 7f2aee3af800 1 Processor -- start 2024-09-22T08:37:41.977 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.975+0000 7f2aee3af800 1 -- start start 2024-09-22T08:37:41.977 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.975+0000 7f2aee3af800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5573260347e0 0x557326122c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:41.977 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.975+0000 7f2aee3af800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x557325ecddd0 con 0x5573260347e0 2024-09-22T08:37:41.977 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.975+0000 7f2aebea0640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5573260347e0 0x557326122c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:41.977 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.975+0000 7f2aebea0640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5573260347e0 0x557326122c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:55758/0 (socket says 172.21.15.142:55758) 2024-09-22T08:37:41.977 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.975+0000 7f2aebea0640 1 -- 172.21.15.142:0/995145677 learned_addr learned my addr 172.21.15.142:0/995145677 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:37:41.978 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.976+0000 7f2aebea0640 1 -- 172.21.15.142:0/995145677 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5573261231f0 con 0x5573260347e0 2024-09-22T08:37:41.978 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.976+0000 7f2aebea0640 1 --2- 172.21.15.142:0/995145677 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5573260347e0 0x557326122c00 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f2adc027c60 tx=0x7f2adc051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1a5a0e8bb3ad3d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:41.978 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.976+0000 7f29d9e0b640 1 -- 172.21.15.142:0/995145677 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2adc008590 con 0x5573260347e0 2024-09-22T08:37:41.978 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.976+0000 7f29d9e0b640 1 -- 172.21.15.142:0/995145677 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2adc0088f0 con 0x5573260347e0 2024-09-22T08:37:41.978 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.976+0000 7f29d9e0b640 1 -- 172.21.15.142:0/995145677 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2adc008bf0 con 0x5573260347e0 2024-09-22T08:37:41.985 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.977+0000 7f2aee3af800 1 -- 172.21.15.142:0/995145677 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5573260347e0 msgr2=0x557326122c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:41.985 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.977+0000 7f2aee3af800 1 --2- 172.21.15.142:0/995145677 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5573260347e0 0x557326122c00 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f2adc027c60 tx=0x7f2adc051000 comp rx=0 tx=0).stop 2024-09-22T08:37:41.985 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.977+0000 7f2aee3af800 1 -- 172.21.15.142:0/995145677 shutdown_connections 2024-09-22T08:37:41.985 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.977+0000 7f2aee3af800 1 --2- 172.21.15.142:0/995145677 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5573260347e0 0x557326122c00 secure :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f2adc027c60 tx=0x7f2adc051000 comp rx=0 tx=0).stop 2024-09-22T08:37:41.985 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.977+0000 7f2aee3af800 1 -- 172.21.15.142:0/995145677 >> 172.21.15.142:0/995145677 conn(0x55732602fbb0 msgr2=0x55732611e580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:37:41.986 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.977+0000 7f2aee3af800 1 -- 172.21.15.142:0/995145677 shutdown_connections 2024-09-22T08:37:41.986 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.977+0000 7f2aee3af800 1 -- 172.21.15.142:0/995145677 wait complete. 2024-09-22T08:37:41.986 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.977+0000 7f2aee3af800 1 Processor -- start 2024-09-22T08:37:41.986 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.977+0000 7f2aee3af800 1 -- start start 2024-09-22T08:37:41.986 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.977+0000 7f2aee3af800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557326035a20 0x55732612a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:41.986 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.977+0000 7f2aee3af800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x557326036230 con 0x557326035a20 2024-09-22T08:37:41.986 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.978+0000 7f2aebea0640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557326035a20 0x55732612a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:41.986 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.978+0000 7f2aebea0640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557326035a20 0x55732612a880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:55762/0 (socket says 172.21.15.142:55762) 2024-09-22T08:37:41.986 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.978+0000 7f2aebea0640 1 -- 172.21.15.142:0/166881566 learned_addr learned my addr 172.21.15.142:0/166881566 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:37:41.987 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.978+0000 7f2aebea0640 1 -- 172.21.15.142:0/166881566 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55732612ade0 con 0x557326035a20 2024-09-22T08:37:41.987 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.978+0000 7f2aebea0640 1 --2- 172.21.15.142:0/166881566 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557326035a20 0x55732612a880 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f2adc027c60 tx=0x7f2adc002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:41.987 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.978+0000 7f29d3fff640 1 -- 172.21.15.142:0/166881566 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2adc070070 con 0x557326035a20 2024-09-22T08:37:41.987 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.978+0000 7f29d3fff640 1 -- 172.21.15.142:0/166881566 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2adc008590 con 0x557326035a20 2024-09-22T08:37:41.987 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.978+0000 7f2aee3af800 1 -- 172.21.15.142:0/166881566 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55732612b070 con 0x557326035a20 2024-09-22T08:37:41.987 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.978+0000 7f29d3fff640 1 -- 172.21.15.142:0/166881566 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2adc008aa0 con 0x557326035a20 2024-09-22T08:37:41.987 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.978+0000 7f2aee3af800 1 -- 172.21.15.142:0/166881566 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55732612ba70 con 0x557326035a20 2024-09-22T08:37:41.988 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.979+0000 7f29d3fff640 1 -- 172.21.15.142:0/166881566 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f2adc067030 con 0x557326035a20 2024-09-22T08:37:41.988 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.979+0000 7f29d3fff640 1 --2- 172.21.15.142:0/166881566 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f29d403cfb0 0x7f29d403f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:41.988 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.979+0000 7f29d3fff640 1 -- 172.21.15.142:0/166881566 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5938+0+0 (secure 0 0 0) 0x7f2adc065020 con 0x557326035a20 2024-09-22T08:37:41.988 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.979+0000 7f2aeb69f640 1 --2- 172.21.15.142:0/166881566 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f29d403cfb0 0x7f29d403f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:41.988 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.980+0000 7f2aee3af800 1 --2- 172.21.15.142:0/166881566 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55732612c590 0x557326131ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:41.988 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.980+0000 7f2aee3af800 1 -- 172.21.15.142:0/166881566 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557326132450 con 0x55732612c590 2024-09-22T08:37:41.988 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.980+0000 7f2aec6a1640 1 --2- 172.21.15.142:0/166881566 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55732612c590 0x557326131ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:41.988 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.980+0000 7f2aeb69f640 1 --2- 172.21.15.142:0/166881566 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f29d403cfb0 0x7f29d403f470 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f2ad4000c00 tx=0x7f2ad40013b0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:41.988 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.980+0000 7f2aec6a1640 1 --2- 172.21.15.142:0/166881566 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55732612c590 0x557326131ed0 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:41.989 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.980+0000 7f2aec6a1640 1 -- 172.21.15.142:0/166881566 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2ae400a4d0 con 0x55732612c590 2024-09-22T08:37:41.989 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.980+0000 7f2aee3af800 1 -- 172.21.15.142:0/166881566 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55732612bf00 con 0x55732612c590 2024-09-22T08:37:41.989 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.980+0000 7f2aec6a1640 1 -- 172.21.15.142:0/166881566 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2ae400a4d0 con 0x55732612c590 2024-09-22T08:37:41.989 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.981+0000 7f2aee3af800 1 --2- 172.21.15.142:0/166881566 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x557326134760 0x557326136b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:41.989 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.981+0000 7f2aee3af800 1 -- 172.21.15.142:0/166881566 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:3 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557326137220 con 0x557326134760 2024-09-22T08:37:41.989 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.981+0000 7f2aebea0640 1 --2- 172.21.15.142:0/166881566 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x557326134760 0x557326136b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:41.989 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.981+0000 7f2aebea0640 1 --2- 172.21.15.142:0/166881566 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x557326134760 0x557326136b50 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:41.989 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.981+0000 7f2aebea0640 1 -- 172.21.15.142:0/166881566 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(3 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f2adc06ccf0 con 0x557326134760 2024-09-22T08:37:41.989 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.981+0000 7f2aee3af800 1 -- 172.21.15.142:0/166881566 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557326133600 con 0x55732612c590 2024-09-22T08:37:41.989 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.981+0000 7f2aec6a1640 1 -- 172.21.15.142:0/166881566 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2ae400a4d0 con 0x55732612c590 2024-09-22T08:37:41.989 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.981+0000 7f2aee3af800 1 -- 172.21.15.142:0/166881566 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557326133aa0 con 0x557326134760 2024-09-22T08:37:41.989 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.982+0000 7f2aebea0640 1 -- 172.21.15.142:0/166881566 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(5 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f2adc06ccf0 con 0x557326134760 2024-09-22T08:37:41.989 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.982+0000 7f2aee3af800 1 Processor -- start 2024-09-22T08:37:41.989 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.982+0000 7f2aee3af800 1 -- start start 2024-09-22T08:37:41.989 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.982+0000 7f2aee3af800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557326145b40 0x557326145f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:41.990 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.982+0000 7f2aee3af800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x557325f2cd50 con 0x557326145b40 2024-09-22T08:37:41.990 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.983+0000 7f2aec6a1640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557326145b40 0x557326145f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:41.990 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.983+0000 7f2aec6a1640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557326145b40 0x557326145f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:55774/0 (socket says 172.21.15.142:55774) 2024-09-22T08:37:41.990 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.983+0000 7f2aec6a1640 1 -- 172.21.15.142:0/4010140511 learned_addr learned my addr 172.21.15.142:0/4010140511 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:37:41.990 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.983+0000 7f2aec6a1640 1 -- 172.21.15.142:0/4010140511 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5573261465a0 con 0x557326145b40 2024-09-22T08:37:41.990 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.983+0000 7f2aec6a1640 1 --2- 172.21.15.142:0/4010140511 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557326145b40 0x557326145f60 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x55732612b710 tx=0x7f2ae40167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:41.990 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.983+0000 7f29d17fa640 1 -- 172.21.15.142:0/4010140511 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ae4013640 con 0x557326145b40 2024-09-22T08:37:41.990 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.983+0000 7f29d17fa640 1 -- 172.21.15.142:0/4010140511 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ae40137e0 con 0x557326145b40 2024-09-22T08:37:41.990 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.984+0000 7f2aee3af800 1 -- 172.21.15.142:0/4010140511 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557326146dd0 con 0x557326145b40 2024-09-22T08:37:41.990 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.984+0000 7f29d17fa640 1 -- 172.21.15.142:0/4010140511 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ae4013ac0 con 0x557326145b40 2024-09-22T08:37:41.990 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.984+0000 7f2aee3af800 1 -- 172.21.15.142:0/4010140511 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557326147370 con 0x557326145b40 2024-09-22T08:37:42.000 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.985+0000 7f29d17fa640 1 -- 172.21.15.142:0/4010140511 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f2ae4011040 con 0x557326145b40 2024-09-22T08:37:42.000 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.985+0000 7f29d17fa640 1 --2- 172.21.15.142:0/4010140511 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f29c403d000 0x7f29c403f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:42.000 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.985+0000 7f29d17fa640 1 -- 172.21.15.142:0/4010140511 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5938+0+0 (secure 0 0 0) 0x7f2ae400e040 con 0x557326145b40 2024-09-22T08:37:42.001 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.985+0000 7f2aebea0640 1 --2- 172.21.15.142:0/4010140511 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f29c403d000 0x7f29c403f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:42.001 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.985+0000 7f2aee3af800 1 Processor -- start 2024-09-22T08:37:42.001 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.985+0000 7f2aebea0640 1 --2- 172.21.15.142:0/4010140511 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f29c403d000 0x7f29c403f4c0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f2adc072ff0 tx=0x7f2adc005700 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:42.001 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.985+0000 7f2aee3af800 1 -- start start 2024-09-22T08:37:42.001 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.985+0000 7f2aee3af800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5573261569b0 0x557326156db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:42.001 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.985+0000 7f2aee3af800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5573261235c0 con 0x5573261569b0 2024-09-22T08:37:42.001 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.986+0000 7f2aec6a1640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5573261569b0 0x557326156db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:42.001 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.986+0000 7f2aec6a1640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5573261569b0 0x557326156db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:55790/0 (socket says 172.21.15.142:55790) 2024-09-22T08:37:42.001 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.986+0000 7f2aec6a1640 1 -- 172.21.15.142:0/3326507255 learned_addr learned my addr 172.21.15.142:0/3326507255 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:37:42.001 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.986+0000 7f2aec6a1640 1 -- 172.21.15.142:0/3326507255 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5573261573a0 con 0x5573261569b0 2024-09-22T08:37:42.001 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.986+0000 7f2aec6a1640 1 --2- 172.21.15.142:0/3326507255 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5573261569b0 0x557326156db0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f2ae4054890 tx=0x7f2ae4013f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6c8c5f9f35be721 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:42.001 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.987+0000 7f29caffd640 1 -- 172.21.15.142:0/3326507255 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ae4044030 con 0x5573261569b0 2024-09-22T08:37:42.001 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.987+0000 7f29caffd640 1 -- 172.21.15.142:0/3326507255 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ae4021a90 con 0x5573261569b0 2024-09-22T08:37:42.002 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.987+0000 7f29caffd640 1 -- 172.21.15.142:0/3326507255 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ae4021570 con 0x5573261569b0 2024-09-22T08:37:42.002 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.987+0000 7f2aee3af800 1 -- 172.21.15.142:0/3326507255 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5573261569b0 msgr2=0x557326156db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:42.002 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.987+0000 7f2aee3af800 1 --2- 172.21.15.142:0/3326507255 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5573261569b0 0x557326156db0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f2ae4054890 tx=0x7f2ae4013f00 comp rx=0 tx=0).stop 2024-09-22T08:37:42.002 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.987+0000 7f2aee3af800 1 -- 172.21.15.142:0/3326507255 shutdown_connections 2024-09-22T08:37:42.002 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.987+0000 7f2aee3af800 1 --2- 172.21.15.142:0/3326507255 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5573261569b0 0x557326156db0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:42.002 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.987+0000 7f2aee3af800 1 -- 172.21.15.142:0/3326507255 >> 172.21.15.142:0/3326507255 conn(0x55732614e9c0 msgr2=0x55732614cc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:37:42.002 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.987+0000 7f2aee3af800 1 -- 172.21.15.142:0/3326507255 shutdown_connections 2024-09-22T08:37:42.002 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.987+0000 7f2aee3af800 1 -- 172.21.15.142:0/3326507255 wait complete. 2024-09-22T08:37:42.002 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.987+0000 7f2aee3af800 1 Processor -- start 2024-09-22T08:37:42.002 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.987+0000 7f2aee3af800 1 -- start start 2024-09-22T08:37:42.002 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.988+0000 7f2aee3af800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5573261569b0 0x55732615dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:42.002 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.988+0000 7f2aee3af800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5573261579c0 con 0x5573261569b0 2024-09-22T08:37:42.002 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.988+0000 7f2aec6a1640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5573261569b0 0x55732615dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:42.003 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.988+0000 7f2aec6a1640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5573261569b0 0x55732615dfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:55794/0 (socket says 172.21.15.142:55794) 2024-09-22T08:37:42.003 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.988+0000 7f2aec6a1640 1 -- 172.21.15.142:0/1904242500 learned_addr learned my addr 172.21.15.142:0/1904242500 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:37:42.003 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.988+0000 7f2aec6a1640 1 -- 172.21.15.142:0/1904242500 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55732615e540 con 0x5573261569b0 2024-09-22T08:37:42.003 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.988+0000 7f2aec6a1640 1 --2- 172.21.15.142:0/1904242500 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5573261569b0 0x55732615dfe0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f2ae40547c0 tx=0x7f2ae40547f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:42.003 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.988+0000 7f29c97fa640 1 -- 172.21.15.142:0/1904242500 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ae4020de0 con 0x5573261569b0 2024-09-22T08:37:42.003 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.988+0000 7f29c97fa640 1 -- 172.21.15.142:0/1904242500 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ae401fa90 con 0x5573261569b0 2024-09-22T08:37:42.003 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.988+0000 7f2aee3af800 1 -- 172.21.15.142:0/1904242500 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55732615e7d0 con 0x5573261569b0 2024-09-22T08:37:42.003 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.988+0000 7f29c97fa640 1 -- 172.21.15.142:0/1904242500 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ae401fd90 con 0x5573261569b0 2024-09-22T08:37:42.003 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.988+0000 7f2aee3af800 1 -- 172.21.15.142:0/1904242500 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55732615f360 con 0x5573261569b0 2024-09-22T08:37:42.003 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.989+0000 7f29c97fa640 1 -- 172.21.15.142:0/1904242500 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f2ae401f500 con 0x5573261569b0 2024-09-22T08:37:42.003 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.989+0000 7f29c97fa640 1 --2- 172.21.15.142:0/1904242500 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f29b403cfb0 0x7f29b403f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:42.003 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.990+0000 7f29c97fa640 1 -- 172.21.15.142:0/1904242500 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5938+0+0 (secure 0 0 0) 0x7f2ae4017450 con 0x5573261569b0 2024-09-22T08:37:42.003 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.990+0000 7f2aebea0640 1 --2- 172.21.15.142:0/1904242500 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f29b403cfb0 0x7f29b403f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:42.003 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.990+0000 7f2aee3af800 20 rados->read ofs=0 len=0 2024-09-22T08:37:42.004 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.990+0000 7f2aee3af800 1 --2- 172.21.15.142:0/1904242500 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5573261698c0 0x55732616bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:42.004 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.990+0000 7f2aee3af800 1 -- 172.21.15.142:0/1904242500 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55732616c4d0 con 0x5573261698c0 2024-09-22T08:37:42.004 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.990+0000 7f2aeb69f640 1 --2- 172.21.15.142:0/1904242500 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5573261698c0 0x55732616bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:42.004 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.990+0000 7f2aebea0640 1 --2- 172.21.15.142:0/1904242500 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f29b403cfb0 0x7f29b403f470 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f2adc001eb0 tx=0x7f2adc087000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:42.004 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.990+0000 7f2aeb69f640 1 --2- 172.21.15.142:0/1904242500 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5573261698c0 0x55732616bd80 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:42.004 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.990+0000 7f2aeb69f640 1 -- 172.21.15.142:0/1904242500 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2ad400f5f0 con 0x5573261698c0 2024-09-22T08:37:42.004 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.990+0000 7f2aee3af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:42.004 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.990+0000 7f2aee3af800 20 realm 2024-09-22T08:37:42.004 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.990+0000 7f2aee3af800 20 rados->read ofs=0 len=0 2024-09-22T08:37:42.004 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.990+0000 7f2aee3af800 1 -- 172.21.15.142:0/1904242500 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557326168c10 con 0x5573261698c0 2024-09-22T08:37:42.004 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.991+0000 7f2aeb69f640 1 -- 172.21.15.142:0/1904242500 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2ad400f5f0 con 0x5573261698c0 2024-09-22T08:37:42.004 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.991+0000 7f2aee3af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:42.004 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.991+0000 7f2aee3af800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:37:42.004 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.991+0000 7f2aee3af800 20 rados->read ofs=0 len=0 2024-09-22T08:37:42.005 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.991+0000 7f2aee3af800 1 -- 172.21.15.142:0/1904242500 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55732616cfb0 con 0x5573261698c0 2024-09-22T08:37:42.005 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.991+0000 7f2aeb69f640 1 -- 172.21.15.142:0/1904242500 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2ad400f5f0 con 0x5573261698c0 2024-09-22T08:37:42.005 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.991+0000 7f2aee3af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:42.005 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.991+0000 7f2aee3af800 20 rados->read ofs=0 len=0 2024-09-22T08:37:42.005 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.991+0000 7f2aee3af800 1 -- 172.21.15.142:0/1904242500 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55732616d880 con 0x5573261698c0 2024-09-22T08:37:42.005 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.991+0000 7f2aeb69f640 1 -- 172.21.15.142:0/1904242500 <== osd.1 v2:172.21.15.142:6816/3192108003 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2ad400f5f0 con 0x5573261698c0 2024-09-22T08:37:42.005 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.991+0000 7f2aee3af800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:37:42.005 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.991+0000 7f2aee3af800 20 rados->read ofs=0 len=0 2024-09-22T08:37:42.005 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.991+0000 7f2aee3af800 1 --2- 172.21.15.142:0/1904242500 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55732616e180 0x557326170590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:42.005 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.991+0000 7f2aee3af800 1 -- 172.21.15.142:0/1904242500 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557326170cf0 con 0x55732616e180 2024-09-22T08:37:42.005 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.992+0000 7f2aec6a1640 1 --2- 172.21.15.142:0/1904242500 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55732616e180 0x557326170590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:42.005 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.992+0000 7f2aec6a1640 1 --2- 172.21.15.142:0/1904242500 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55732616e180 0x557326170590 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:42.005 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.992+0000 7f2aec6a1640 1 -- 172.21.15.142:0/1904242500 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(5 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f2ae4053020 con 0x55732616e180 2024-09-22T08:37:42.006 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.992+0000 7f2aee3af800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:37:42.006 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.992+0000 7f2aee3af800 20 searching for the correct realm 2024-09-22T08:37:42.006 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.992+0000 7f2aee3af800 1 -- 172.21.15.142:0/1904242500 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5573261726d0 con 0x55732616e180 2024-09-22T08:37:42.006 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.992+0000 7f2aec6a1640 1 -- 172.21.15.142:0/1904242500 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ae4053020 con 0x55732616e180 2024-09-22T08:37:42.006 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.992+0000 7f2aec6a1640 1 --2- 172.21.15.142:0/1904242500 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f2ae4015f40 0x7f2ae4045a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:42.006 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.992+0000 7f2aec6a1640 1 -- 172.21.15.142:0/1904242500 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5573261726d0 con 0x7f2ae4015f40 2024-09-22T08:37:42.006 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.992+0000 7f2aebea0640 1 --2- 172.21.15.142:0/1904242500 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f2ae4015f40 0x7f2ae4045a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:42.006 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.993+0000 7f2aebea0640 1 --2- 172.21.15.142:0/1904242500 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f2ae4015f40 0x7f2ae4045a30 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:42.006 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.993+0000 7f2aebea0640 1 -- 172.21.15.142:0/1904242500 <== osd.2 v2:172.21.15.142:6808/279438927 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2adc06ccf0 con 0x7f2ae4015f40 2024-09-22T08:37:42.006 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.993+0000 7f2aebea0640 1 --2- 172.21.15.142:0/1904242500 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f2adc09c040 0x7f2adc06a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:42.006 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.993+0000 7f2aebea0640 1 -- 172.21.15.142:0/1904242500 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5573261726d0 con 0x7f2adc09c040 2024-09-22T08:37:42.006 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.993+0000 7f2aeb69f640 1 --2- 172.21.15.142:0/1904242500 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f2adc09c040 0x7f2adc06a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:42.007 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.994+0000 7f2aeb69f640 1 --2- 172.21.15.142:0/1904242500 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f2adc09c040 0x7f2adc06a610 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:42.007 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.994+0000 7f2aeb69f640 1 -- 172.21.15.142:0/1904242500 <== osd.0 v2:172.21.15.31:6800/168281188 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ad400f5f0 con 0x7f2adc09c040 2024-09-22T08:37:42.007 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.994+0000 7f2aeb69f640 1 -- 172.21.15.142:0/1904242500 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5573261726d0 con 0x5573261698c0 2024-09-22T08:37:42.007 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.994+0000 7f2aeb69f640 1 -- 172.21.15.142:0/1904242500 <== osd.1 v2:172.21.15.142:6816/3192108003 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ad400f5f0 con 0x5573261698c0 2024-09-22T08:37:42.007 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.994+0000 7f2aeb69f640 1 -- 172.21.15.142:0/1904242500 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5573261726d0 con 0x5573261698c0 2024-09-22T08:37:42.007 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.994+0000 7f2aeb69f640 1 -- 172.21.15.142:0/1904242500 <== osd.1 v2:172.21.15.142:6816/3192108003 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ad402b040 con 0x5573261698c0 2024-09-22T08:37:42.007 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.994+0000 7f2aeb69f640 1 -- 172.21.15.142:0/1904242500 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5573261726d0 con 0x5573261698c0 2024-09-22T08:37:42.007 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.994+0000 7f2aeb69f640 1 -- 172.21.15.142:0/1904242500 <== osd.1 v2:172.21.15.142:6816/3192108003 7 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ad402b040 con 0x5573261698c0 2024-09-22T08:37:42.007 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.994+0000 7f2aeb69f640 1 -- 172.21.15.142:0/1904242500 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5573261726d0 con 0x7f2adc09c040 2024-09-22T08:37:42.007 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.995+0000 7f2aeb69f640 1 -- 172.21.15.142:0/1904242500 <== osd.0 v2:172.21.15.31:6800/168281188 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ad402b040 con 0x7f2adc09c040 2024-09-22T08:37:42.007 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.995+0000 7f2aeb69f640 1 -- 172.21.15.142:0/1904242500 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5573261726d0 con 0x7f2ae4015f40 2024-09-22T08:37:42.007 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.995+0000 7f2aebea0640 1 -- 172.21.15.142:0/1904242500 <== osd.2 v2:172.21.15.142:6808/279438927 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2adc06ccf0 con 0x7f2ae4015f40 2024-09-22T08:37:42.007 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.995+0000 7f2aebea0640 1 -- 172.21.15.142:0/1904242500 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5573261726d0 con 0x55732616e180 2024-09-22T08:37:42.007 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.995+0000 7f2aec6a1640 1 -- 172.21.15.142:0/1904242500 <== osd.3 v2:172.21.15.142:6800/1064901393 3 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ae4053020 con 0x55732616e180 2024-09-22T08:37:42.007 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.995+0000 7f2aec6a1640 1 -- 172.21.15.142:0/1904242500 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5573261726d0 con 0x5573261698c0 2024-09-22T08:37:42.008 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.996+0000 7f2aeb69f640 1 -- 172.21.15.142:0/1904242500 <== osd.1 v2:172.21.15.142:6816/3192108003 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ad402b040 con 0x5573261698c0 2024-09-22T08:37:42.008 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.996+0000 7f2aeb69f640 1 -- 172.21.15.142:0/1904242500 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5573261726d0 con 0x7f2adc09c040 2024-09-22T08:37:42.008 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.996+0000 7f2aeb69f640 1 -- 172.21.15.142:0/1904242500 <== osd.0 v2:172.21.15.31:6800/168281188 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ad402b040 con 0x7f2adc09c040 2024-09-22T08:37:42.008 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.996+0000 7f2aeb69f640 1 -- 172.21.15.142:0/1904242500 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5573261726d0 con 0x5573261698c0 2024-09-22T08:37:42.008 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.996+0000 7f2aeb69f640 1 -- 172.21.15.142:0/1904242500 <== osd.1 v2:172.21.15.142:6816/3192108003 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ad402b040 con 0x5573261698c0 2024-09-22T08:37:42.008 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.996+0000 7f2aeb69f640 1 -- 172.21.15.142:0/1904242500 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5573261726d0 con 0x7f2ae4015f40 2024-09-22T08:37:42.008 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.997+0000 7f2aebea0640 1 -- 172.21.15.142:0/1904242500 <== osd.2 v2:172.21.15.142:6808/279438927 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f2adc06ccf0 con 0x7f2ae4015f40 2024-09-22T08:37:42.008 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.997+0000 7f2aebea0640 1 -- 172.21.15.142:0/1904242500 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5573261726d0 con 0x55732616e180 2024-09-22T08:37:42.008 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.997+0000 7f2aec6a1640 1 -- 172.21.15.142:0/1904242500 <== osd.3 v2:172.21.15.142:6800/1064901393 4 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ae4053020 con 0x55732616e180 2024-09-22T08:37:42.008 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.997+0000 7f2aec6a1640 1 -- 172.21.15.142:0/1904242500 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5573261726d0 con 0x55732616e180 2024-09-22T08:37:42.008 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.997+0000 7f2aec6a1640 1 -- 172.21.15.142:0/1904242500 <== osd.3 v2:172.21.15.142:6800/1064901393 5 ==== osd_op_reply(20 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f2ae4053020 con 0x55732616e180 2024-09-22T08:37:42.008 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.997+0000 7f2aec6a1640 1 -- 172.21.15.142:0/1904242500 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5573261726d0 con 0x7f2adc09c040 2024-09-22T08:37:42.008 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.997+0000 7f2aeb69f640 1 -- 172.21.15.142:0/1904242500 <== osd.0 v2:172.21.15.31:6800/168281188 4 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ad402b040 con 0x7f2adc09c040 2024-09-22T08:37:42.009 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.997+0000 7f2aeb69f640 1 -- 172.21.15.142:0/1904242500 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5573261726d0 con 0x55732616e180 2024-09-22T08:37:42.009 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.998+0000 7f2aec6a1640 1 -- 172.21.15.142:0/1904242500 <== osd.3 v2:172.21.15.142:6800/1064901393 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ae4053020 con 0x55732616e180 2024-09-22T08:37:42.009 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.998+0000 7f2aec6a1640 1 -- 172.21.15.142:0/1904242500 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5573261726d0 con 0x55732616e180 2024-09-22T08:37:42.009 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.998+0000 7f2aec6a1640 1 -- 172.21.15.142:0/1904242500 <== osd.3 v2:172.21.15.142:6800/1064901393 7 ==== osd_op_reply(23 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f2ae4053020 con 0x55732616e180 2024-09-22T08:37:42.009 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.998+0000 7f2aec6a1640 1 -- 172.21.15.142:0/1904242500 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5573261726d0 con 0x5573261698c0 2024-09-22T08:37:42.009 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.998+0000 7f2aeb69f640 1 -- 172.21.15.142:0/1904242500 <== osd.1 v2:172.21.15.142:6816/3192108003 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ad402b040 con 0x5573261698c0 2024-09-22T08:37:42.009 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.998+0000 7f2aeb69f640 1 -- 172.21.15.142:0/1904242500 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5573261726d0 con 0x5573261698c0 2024-09-22T08:37:42.009 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.998+0000 7f2aeb69f640 1 -- 172.21.15.142:0/1904242500 <== osd.1 v2:172.21.15.142:6816/3192108003 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f2ad402b040 con 0x5573261698c0 2024-09-22T08:37:42.009 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.999+0000 7f2aeb69f640 1 -- 172.21.15.142:0/1904242500 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5573261726d0 con 0x7f2adc09c040 2024-09-22T08:37:42.009 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.999+0000 7f2aeb69f640 1 -- 172.21.15.142:0/1904242500 <== osd.0 v2:172.21.15.31:6800/168281188 5 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ad402b040 con 0x7f2adc09c040 2024-09-22T08:37:42.009 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.999+0000 7f2aeb69f640 1 -- 172.21.15.142:0/1904242500 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5573261726d0 con 0x55732616e180 2024-09-22T08:37:42.009 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.999+0000 7f2aec6a1640 1 -- 172.21.15.142:0/1904242500 <== osd.3 v2:172.21.15.142:6800/1064901393 8 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ae4053020 con 0x55732616e180 2024-09-22T08:37:42.009 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:41.999+0000 7f2aec6a1640 1 -- 172.21.15.142:0/1904242500 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5573261726d0 con 0x7f2ae4015f40 2024-09-22T08:37:42.016 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.000+0000 7f2aebea0640 1 -- 172.21.15.142:0/1904242500 <== osd.2 v2:172.21.15.142:6808/279438927 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2adc06ccf0 con 0x7f2ae4015f40 2024-09-22T08:37:42.016 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.000+0000 7f2aebea0640 1 -- 172.21.15.142:0/1904242500 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5573261726d0 con 0x5573261698c0 2024-09-22T08:37:42.017 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.000+0000 7f2aeb69f640 1 -- 172.21.15.142:0/1904242500 <== osd.1 v2:172.21.15.142:6816/3192108003 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ad402b040 con 0x5573261698c0 2024-09-22T08:37:42.017 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.000+0000 7f2aeb69f640 1 -- 172.21.15.142:0/1904242500 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5573261726d0 con 0x7f2adc09c040 2024-09-22T08:37:42.017 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.000+0000 7f2aeb69f640 1 -- 172.21.15.142:0/1904242500 <== osd.0 v2:172.21.15.31:6800/168281188 6 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ad403b040 con 0x7f2adc09c040 2024-09-22T08:37:42.017 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.000+0000 7f2aeb69f640 1 -- 172.21.15.142:0/1904242500 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5573261726d0 con 0x55732616e180 2024-09-22T08:37:42.017 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.000+0000 7f2aec6a1640 1 -- 172.21.15.142:0/1904242500 <== osd.3 v2:172.21.15.142:6800/1064901393 9 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ae4053020 con 0x55732616e180 2024-09-22T08:37:42.017 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.000+0000 7f2aec6a1640 1 -- 172.21.15.142:0/1904242500 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5573261726d0 con 0x7f2adc09c040 2024-09-22T08:37:42.017 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.001+0000 7f2aeb69f640 1 -- 172.21.15.142:0/1904242500 <== osd.0 v2:172.21.15.31:6800/168281188 7 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ad403b040 con 0x7f2adc09c040 2024-09-22T08:37:42.017 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.001+0000 7f2aeb69f640 1 -- 172.21.15.142:0/1904242500 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5573261726d0 con 0x7f2ae4015f40 2024-09-22T08:37:42.017 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.001+0000 7f2aebea0640 1 -- 172.21.15.142:0/1904242500 <== osd.2 v2:172.21.15.142:6808/279438927 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2adc06ccf0 con 0x7f2ae4015f40 2024-09-22T08:37:42.017 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.001+0000 7f2aebea0640 1 -- 172.21.15.142:0/1904242500 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5573261726d0 con 0x55732616e180 2024-09-22T08:37:42.017 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.001+0000 7f2aec6a1640 1 -- 172.21.15.142:0/1904242500 <== osd.3 v2:172.21.15.142:6800/1064901393 10 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ae4053020 con 0x55732616e180 2024-09-22T08:37:42.017 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.001+0000 7f2aec6a1640 1 -- 172.21.15.142:0/1904242500 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5573261726d0 con 0x7f2adc09c040 2024-09-22T08:37:42.017 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.001+0000 7f2aeb69f640 1 -- 172.21.15.142:0/1904242500 <== osd.0 v2:172.21.15.31:6800/168281188 8 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ad403b040 con 0x7f2adc09c040 2024-09-22T08:37:42.017 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.001+0000 7f2aeb69f640 1 -- 172.21.15.142:0/1904242500 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5573261726d0 con 0x5573261698c0 2024-09-22T08:37:42.018 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.002+0000 7f2aeb69f640 1 -- 172.21.15.142:0/1904242500 <== osd.1 v2:172.21.15.142:6816/3192108003 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f2ad403b040 con 0x5573261698c0 2024-09-22T08:37:42.018 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.002+0000 7f2aeb69f640 1 -- 172.21.15.142:0/1904242500 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5573261726d0 con 0x7f2ae4015f40 2024-09-22T08:37:42.018 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.002+0000 7f2aebea0640 1 -- 172.21.15.142:0/1904242500 <== osd.2 v2:172.21.15.142:6808/279438927 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2adc06ccf0 con 0x7f2ae4015f40 2024-09-22T08:37:42.018 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.002+0000 7f2aee3af800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:37:42.018 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.002+0000 7f2aee3af800 20 RGWRados::pool_iterate: got zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec 2024-09-22T08:37:42.018 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.002+0000 7f2aee3af800 20 RGWRados::pool_iterate: got zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f 2024-09-22T08:37:42.018 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.002+0000 7f2aee3af800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:37:42.018 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.002+0000 7f2aee3af800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:37:42.018 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.002+0000 7f2aee3af800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:37:42.018 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.002+0000 7f2aee3af800 20 rados->read ofs=0 len=0 2024-09-22T08:37:42.018 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.002+0000 7f2aee3af800 1 -- 172.21.15.142:0/1904242500 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5573261717a0 con 0x5573261698c0 2024-09-22T08:37:42.018 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.002+0000 7f2aeb69f640 1 -- 172.21.15.142:0/1904242500 <== osd.1 v2:172.21.15.142:6816/3192108003 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2ad403b040 con 0x5573261698c0 2024-09-22T08:37:42.019 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.002+0000 7f2aee3af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:42.019 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.002+0000 7f2aee3af800 20 rados->read ofs=0 len=0 2024-09-22T08:37:42.019 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.002+0000 7f2aee3af800 1 -- 172.21.15.142:0/1904242500 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557326172040 con 0x5573261698c0 2024-09-22T08:37:42.019 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.002+0000 7f2aeb69f640 1 -- 172.21.15.142:0/1904242500 <== osd.1 v2:172.21.15.142:6816/3192108003 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2ad403b040 con 0x5573261698c0 2024-09-22T08:37:42.019 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.002+0000 7f2aee3af800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:37:42.019 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.002+0000 7f2aee3af800 20 rados->read ofs=0 len=0 2024-09-22T08:37:42.019 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.002+0000 7f2aee3af800 1 -- 172.21.15.142:0/1904242500 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:40 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5573261713e0 con 0x55732616e180 2024-09-22T08:37:42.019 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.003+0000 7f2aec6a1640 1 -- 172.21.15.142:0/1904242500 <== osd.3 v2:172.21.15.142:6800/1064901393 11 ==== osd_op_reply(40 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f2ae4071040 con 0x55732616e180 2024-09-22T08:37:42.019 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.003+0000 7f2aee3af800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:37:42.019 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.003+0000 7f2aee3af800 20 zone default found 2024-09-22T08:37:42.019 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.003+0000 7f2aee3af800 4 Realm: () 2024-09-22T08:37:42.019 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.003+0000 7f2aee3af800 4 ZoneGroup: default (d89f6f57-1007-47dd-9065-f486c7b01aec) 2024-09-22T08:37:42.019 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.003+0000 7f2aee3af800 4 Zone: default (e239248c-0bee-4e41-803a-24b288d3eb8f) 2024-09-22T08:37:42.020 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.003+0000 7f2aee3af800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:37:42.020 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.003+0000 7f2aee3af800 20 zonegroup default 2024-09-22T08:37:42.020 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.003+0000 7f2aee3af800 20 rados->read ofs=0 len=0 2024-09-22T08:37:42.020 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.003+0000 7f2aee3af800 1 -- 172.21.15.142:0/1904242500 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557326171c40 con 0x7f2adc09c040 2024-09-22T08:37:42.020 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.003+0000 7f2aeb69f640 1 -- 172.21.15.142:0/1904242500 <== osd.0 v2:172.21.15.31:6800/168281188 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f2ad403b040 con 0x7f2adc09c040 2024-09-22T08:37:42.020 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.003+0000 7f2aee3af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:42.020 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.003+0000 7f2aee3af800 20 rados->read ofs=0 len=0 2024-09-22T08:37:42.020 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.003+0000 7f2aee3af800 1 -- 172.21.15.142:0/1904242500 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557326174ac0 con 0x55732616e180 2024-09-22T08:37:42.020 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.003+0000 7f2aec6a1640 1 -- 172.21.15.142:0/1904242500 <== osd.3 v2:172.21.15.142:6800/1064901393 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2ae4071040 con 0x55732616e180 2024-09-22T08:37:42.020 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.003+0000 7f2aee3af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:42.020 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.003+0000 7f2aee3af800 20 rados->read ofs=0 len=0 2024-09-22T08:37:42.020 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.003+0000 7f2aee3af800 1 -- 172.21.15.142:0/1904242500 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557326175020 con 0x55732616e180 2024-09-22T08:37:42.021 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.004+0000 7f2aec6a1640 1 -- 172.21.15.142:0/1904242500 <== osd.3 v2:172.21.15.142:6800/1064901393 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2ae4071040 con 0x55732616e180 2024-09-22T08:37:42.021 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.004+0000 7f2aee3af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:42.021 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.004+0000 7f2aee3af800 20 started sync module instance, tier type = 2024-09-22T08:37:42.021 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.004+0000 7f2aee3af800 20 started zone id=e239248c-0bee-4e41-803a-24b288d3eb8f (name=default) with tier type = 2024-09-22T08:37:42.021 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.004+0000 7f2aee3af800 1 -- 172.21.15.142:0/1904242500 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557326173f30 con 0x7f2ae4015f40 2024-09-22T08:37:42.021 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.005+0000 7f2aebea0640 1 -- 172.21.15.142:0/1904242500 <== osd.2 v2:172.21.15.142:6808/279438927 7 ==== osd_op_reply(44 notify.0 [create] v32'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2adc06ccf0 con 0x7f2ae4015f40 2024-09-22T08:37:42.021 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.005+0000 7f2aee3af800 1 -- 172.21.15.142:0/1904242500 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93953048656512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557326175480 con 0x7f2ae4015f40 2024-09-22T08:37:42.021 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.005+0000 7f2aee3af800 1 -- 172.21.15.142:0/1904242500 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557326175e40 con 0x5573261698c0 2024-09-22T08:37:42.021 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.006+0000 7f2aebea0640 1 -- 172.21.15.142:0/1904242500 <== osd.2 v2:172.21.15.142:6808/279438927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93953048656512] v32'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2adc06ccf0 con 0x7f2ae4015f40 2024-09-22T08:37:42.021 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.006+0000 7f2aeb69f640 1 -- 172.21.15.142:0/1904242500 <== osd.1 v2:172.21.15.142:6816/3192108003 16 ==== osd_op_reply(46 notify.1 [create] v32'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ad403b040 con 0x5573261698c0 2024-09-22T08:37:42.021 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.006+0000 7f2aee3af800 1 -- 172.21.15.142:0/1904242500 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93953048664464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557326176260 con 0x5573261698c0 2024-09-22T08:37:42.021 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.006+0000 7f2aee3af800 1 -- 172.21.15.142:0/1904242500 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557326176c20 con 0x55732616e180 2024-09-22T08:37:42.021 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.007+0000 7f2aeb69f640 1 -- 172.21.15.142:0/1904242500 <== osd.1 v2:172.21.15.142:6816/3192108003 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93953048664464] v32'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ad403b040 con 0x5573261698c0 2024-09-22T08:37:42.021 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.007+0000 7f2aec6a1640 1 -- 172.21.15.142:0/1904242500 <== osd.3 v2:172.21.15.142:6800/1064901393 14 ==== osd_op_reply(48 notify.2 [create] v32'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ae4071040 con 0x55732616e180 2024-09-22T08:37:42.022 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.007+0000 7f2aee3af800 1 -- 172.21.15.142:0/1904242500 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93953048668496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557326176260 con 0x55732616e180 2024-09-22T08:37:42.022 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.007+0000 7f2aee3af800 1 -- 172.21.15.142:0/1904242500 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5573261776b0 con 0x7f2ae4015f40 2024-09-22T08:37:42.022 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.008+0000 7f2aebea0640 1 -- 172.21.15.142:0/1904242500 <== osd.2 v2:172.21.15.142:6808/279438927 9 ==== osd_op_reply(50 notify.3 [create] v32'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2adc06ccf0 con 0x7f2ae4015f40 2024-09-22T08:37:42.022 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.008+0000 7f2aee3af800 1 -- 172.21.15.142:0/1904242500 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93953048670592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557326177f50 con 0x7f2ae4015f40 2024-09-22T08:37:42.022 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.009+0000 7f2aee3af800 1 -- 172.21.15.142:0/1904242500 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557326178a50 con 0x5573261698c0 2024-09-22T08:37:42.022 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.009+0000 7f2aec6a1640 1 -- 172.21.15.142:0/1904242500 <== osd.3 v2:172.21.15.142:6800/1064901393 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 93953048668496] v32'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ae4071040 con 0x55732616e180 2024-09-22T08:37:42.022 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.010+0000 7f2aeb69f640 1 -- 172.21.15.142:0/1904242500 <== osd.1 v2:172.21.15.142:6816/3192108003 18 ==== osd_op_reply(52 notify.4 [create] v32'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ad403b040 con 0x5573261698c0 2024-09-22T08:37:42.022 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.010+0000 7f2aebea0640 1 -- 172.21.15.142:0/1904242500 <== osd.2 v2:172.21.15.142:6808/279438927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93953048670592] v32'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2adc06ccf0 con 0x7f2ae4015f40 2024-09-22T08:37:42.022 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.010+0000 7f2aee3af800 1 -- 172.21.15.142:0/1904242500 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93953048675648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557326178e40 con 0x5573261698c0 2024-09-22T08:37:42.022 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.010+0000 7f2aee3af800 1 -- 172.21.15.142:0/1904242500 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557326179380 con 0x7f2adc09c040 2024-09-22T08:37:42.023 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.011+0000 7f2aeb69f640 1 -- 172.21.15.142:0/1904242500 <== osd.1 v2:172.21.15.142:6816/3192108003 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93953048675648] v32'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ad403b040 con 0x5573261698c0 2024-09-22T08:37:42.023 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.011+0000 7f2aeb69f640 1 -- 172.21.15.142:0/1904242500 <== osd.0 v2:172.21.15.31:6800/168281188 10 ==== osd_op_reply(54 notify.5 [create] v32'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ad403b040 con 0x7f2adc09c040 2024-09-22T08:37:42.023 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.011+0000 7f2aee3af800 1 -- 172.21.15.142:0/1904242500 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93953048672928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557326179380 con 0x7f2adc09c040 2024-09-22T08:37:42.023 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.011+0000 7f2aee3af800 1 -- 172.21.15.142:0/1904242500 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557326179dc0 con 0x7f2adc09c040 2024-09-22T08:37:42.023 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.012+0000 7f2aeb69f640 1 -- 172.21.15.142:0/1904242500 <== osd.0 v2:172.21.15.31:6800/168281188 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 93953048672928] v32'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ad403b040 con 0x7f2adc09c040 2024-09-22T08:37:42.023 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.012+0000 7f2aeb69f640 1 -- 172.21.15.142:0/1904242500 <== osd.0 v2:172.21.15.31:6800/168281188 12 ==== osd_op_reply(56 notify.6 [create] v32'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ad403b040 con 0x7f2adc09c040 2024-09-22T08:37:42.023 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.012+0000 7f2aee3af800 1 -- 172.21.15.142:0/1904242500 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93953048665520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557326179dc0 con 0x7f2adc09c040 2024-09-22T08:37:42.023 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.012+0000 7f2aee3af800 1 -- 172.21.15.142:0/1904242500 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55732617a780 con 0x7f2adc09c040 2024-09-22T08:37:42.023 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.014+0000 7f2aeb69f640 1 -- 172.21.15.142:0/1904242500 <== osd.0 v2:172.21.15.31:6800/168281188 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 93953048665520] v32'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ad403b040 con 0x7f2adc09c040 2024-09-22T08:37:42.023 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.014+0000 7f2aeb69f640 1 -- 172.21.15.142:0/1904242500 <== osd.0 v2:172.21.15.31:6800/168281188 14 ==== osd_op_reply(58 notify.7 [create] v32'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ad403b040 con 0x7f2adc09c040 2024-09-22T08:37:42.023 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.014+0000 7f2aee3af800 1 -- 172.21.15.142:0/1904242500 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93953048681200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55732617a780 con 0x7f2adc09c040 2024-09-22T08:37:42.023 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.014+0000 7f2aee3af800 20 add_watcher() i=0 2024-09-22T08:37:42.023 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.014+0000 7f2aee3af800 20 add_watcher() i=1 2024-09-22T08:37:42.023 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.014+0000 7f2aee3af800 20 add_watcher() i=2 2024-09-22T08:37:42.024 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.014+0000 7f2aee3af800 20 add_watcher() i=3 2024-09-22T08:37:42.024 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.014+0000 7f2aee3af800 20 add_watcher() i=4 2024-09-22T08:37:42.024 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.014+0000 7f2aee3af800 20 add_watcher() i=5 2024-09-22T08:37:42.024 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.014+0000 7f2aee3af800 20 add_watcher() i=6 2024-09-22T08:37:42.024 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.015+0000 7f2aeb69f640 1 -- 172.21.15.142:0/1904242500 <== osd.0 v2:172.21.15.31:6800/168281188 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 93953048681200] v32'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ad403b040 con 0x7f2adc09c040 2024-09-22T08:37:42.024 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.015+0000 7f2aee3af800 20 add_watcher() i=7 2024-09-22T08:37:42.024 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.015+0000 7f2aee3af800 2 all 8 watchers are set, enabling cache 2024-09-22T08:37:42.024 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.015+0000 7f2aee3af800 1 -- 172.21.15.142:0/1904242500 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55732617dc50 con 0x5573261698c0 2024-09-22T08:37:42.024 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.015+0000 7f2aeb69f640 1 -- 172.21.15.142:0/1904242500 <== osd.1 v2:172.21.15.142:6816/3192108003 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f2ad403b040 con 0x5573261698c0 2024-09-22T08:37:42.024 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.015+0000 7f2aee3af800 1 -- 172.21.15.142:0/1904242500 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93953048696272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55732617a8f0 con 0x5573261698c0 2024-09-22T08:37:42.028 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.016+0000 7f2aeb69f640 1 -- 172.21.15.142:0/1904242500 <== osd.1 v2:172.21.15.142:6816/3192108003 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93953048696272] v32'206 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2ad403b040 con 0x5573261698c0 2024-09-22T08:37:42.028 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.016+0000 7f29a1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:37:42.028 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.016+0000 7f2aee3af800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:37:42.028 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.016+0000 7f2aee3af800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:37:42.028 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.016+0000 7f2aee3af800 5 note: GC not initialized 2024-09-22T08:37:42.028 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.016+0000 7f29a0fe1640 20 reqs_thread_entry: start 2024-09-22T08:37:42.028 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.017+0000 7f2aee3af800 20 init_complete bucket index max shards: 11 2024-09-22T08:37:42.028 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.017+0000 7f2aee3af800 20 Filter name: none 2024-09-22T08:37:42.028 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.017+0000 7f291a7fc640 20 reqs_thread_entry: start 2024-09-22T08:37:42.028 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.017+0000 7f2aee3af800 20 rados->read ofs=0 len=0 2024-09-22T08:37:42.029 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.017+0000 7f2aee3af800 1 -- 172.21.15.142:0/1904242500 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5573261b0b80 con 0x5573261698c0 2024-09-22T08:37:42.029 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.017+0000 7f2aeb69f640 1 -- 172.21.15.142:0/1904242500 <== osd.1 v2:172.21.15.142:6816/3192108003 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f2ad403b040 con 0x5573261698c0 2024-09-22T08:37:42.029 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.017+0000 7f2aee3af800 20 rados_obj.operate() r=0 bl.length=391 2024-09-22T08:37:42.029 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.017+0000 7f2aee3af800 1 -- 172.21.15.142:0/1904242500 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5573261b20d0 con 0x7f2adc09c040 2024-09-22T08:37:42.029 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.018+0000 7f2aeb69f640 1 -- 172.21.15.142:0/1904242500 <== osd.0 v2:172.21.15.31:6800/168281188 16 ==== osd_op_reply(63 usage.10 [call out=1378b] v0'0 uv29 ondisk = 0) ==== 152+0+1378 (crc 0 0 0) 0x7f2ad403b040 con 0x7f2adc09c040 2024-09-22T08:37:42.029 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.018+0000 7f29a1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:37:42.029 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.018+0000 7f2aee3af800 1 -- 172.21.15.142:0/1904242500 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93953048696272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5573261b04a0 con 0x5573261698c0 2024-09-22T08:37:42.029 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.019+0000 7f2aeb69f640 1 -- 172.21.15.142:0/1904242500 <== osd.1 v2:172.21.15.142:6816/3192108003 23 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 93953048696272] v32'207 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2ad403b040 con 0x5573261698c0 2024-09-22T08:37:42.029 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.020+0000 7f2aee3af800 1 -- 172.21.15.142:0/1904242500 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93953048656512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55732617d5d0 con 0x7f2ae4015f40 2024-09-22T08:37:42.029 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.020+0000 7f2aebea0640 1 -- 172.21.15.142:0/1904242500 <== osd.2 v2:172.21.15.142:6808/279438927 11 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 93953048656512] v32'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2adc06ccf0 con 0x7f2ae4015f40 2024-09-22T08:37:42.029 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.020+0000 7f2aee3af800 20 remove_watcher() i=0 2024-09-22T08:37:42.029 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.021+0000 7f2aee3af800 2 removed watcher, disabling cache 2024-09-22T08:37:42.029 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.021+0000 7f2aee3af800 1 -- 172.21.15.142:0/1904242500 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93953048664464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55732617d5d0 con 0x5573261698c0 2024-09-22T08:37:42.030 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.022+0000 7f2aeb69f640 1 -- 172.21.15.142:0/1904242500 <== osd.1 v2:172.21.15.142:6816/3192108003 24 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 93953048664464] v32'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ad403b040 con 0x5573261698c0 2024-09-22T08:37:42.030 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.022+0000 7f2aee3af800 20 remove_watcher() i=1 2024-09-22T08:37:42.030 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.022+0000 7f2aee3af800 1 -- 172.21.15.142:0/1904242500 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93953048668496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55732617d5d0 con 0x55732616e180 2024-09-22T08:37:42.030 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.023+0000 7f2aec6a1640 1 -- 172.21.15.142:0/1904242500 <== osd.3 v2:172.21.15.142:6800/1064901393 16 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 93953048668496] v32'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ae4071040 con 0x55732616e180 2024-09-22T08:37:42.030 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.023+0000 7f2aee3af800 20 remove_watcher() i=2 2024-09-22T08:37:42.030 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.023+0000 7f2aee3af800 1 -- 172.21.15.142:0/1904242500 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93953048670592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557326176950 con 0x7f2ae4015f40 2024-09-22T08:37:42.030 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.024+0000 7f2aebea0640 1 -- 172.21.15.142:0/1904242500 <== osd.2 v2:172.21.15.142:6808/279438927 12 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 93953048670592] v32'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2adc06ccf0 con 0x7f2ae4015f40 2024-09-22T08:37:42.030 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.024+0000 7f2aee3af800 20 remove_watcher() i=3 2024-09-22T08:37:42.030 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.024+0000 7f2aee3af800 1 -- 172.21.15.142:0/1904242500 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93953048675648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55732617d5d0 con 0x5573261698c0 2024-09-22T08:37:42.030 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.025+0000 7f2aeb69f640 1 -- 172.21.15.142:0/1904242500 <== osd.1 v2:172.21.15.142:6816/3192108003 25 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 93953048675648] v32'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ad403b040 con 0x5573261698c0 2024-09-22T08:37:42.030 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.025+0000 7f2aee3af800 20 remove_watcher() i=4 2024-09-22T08:37:42.030 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.025+0000 7f2aee3af800 1 -- 172.21.15.142:0/1904242500 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93953048672928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557326176950 con 0x7f2adc09c040 2024-09-22T08:37:42.030 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.026+0000 7f2aeb69f640 1 -- 172.21.15.142:0/1904242500 <== osd.0 v2:172.21.15.31:6800/168281188 17 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 93953048672928] v32'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ad403b040 con 0x7f2adc09c040 2024-09-22T08:37:42.031 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.026+0000 7f2aee3af800 20 remove_watcher() i=5 2024-09-22T08:37:42.031 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.026+0000 7f2aee3af800 1 -- 172.21.15.142:0/1904242500 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93953048665520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557326178540 con 0x7f2adc09c040 2024-09-22T08:37:42.034 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.027+0000 7f2aeb69f640 1 -- 172.21.15.142:0/1904242500 <== osd.0 v2:172.21.15.31:6800/168281188 18 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 93953048665520] v32'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ad403b040 con 0x7f2adc09c040 2024-09-22T08:37:42.034 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.027+0000 7f2aee3af800 20 remove_watcher() i=6 2024-09-22T08:37:42.034 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.027+0000 7f2aee3af800 1 -- 172.21.15.142:0/1904242500 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93953048681200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55732617d5d0 con 0x7f2adc09c040 2024-09-22T08:37:42.034 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.028+0000 7f2aeb69f640 1 -- 172.21.15.142:0/1904242500 <== osd.0 v2:172.21.15.31:6800/168281188 19 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 93953048681200] v32'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ad403b040 con 0x7f2adc09c040 2024-09-22T08:37:42.034 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.028+0000 7f2aee3af800 20 remove_watcher() i=7 2024-09-22T08:37:42.034 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.028+0000 7f2aee3af800 1 -- 172.21.15.142:0/1904242500 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f2adc09c040 msgr2=0x7f2adc06a610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:42.034 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.028+0000 7f2aee3af800 1 --2- 172.21.15.142:0/1904242500 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f2adc09c040 0x7f2adc06a610 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:42.034 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.028+0000 7f2aee3af800 1 -- 172.21.15.142:0/1904242500 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5573261698c0 msgr2=0x55732616bd80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:42.034 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.028+0000 7f2aee3af800 1 --2- 172.21.15.142:0/1904242500 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5573261698c0 0x55732616bd80 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:42.034 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.028+0000 7f2aee3af800 1 -- 172.21.15.142:0/1904242500 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f2ae4015f40 msgr2=0x7f2ae4045a30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:42.034 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.028+0000 7f2aee3af800 1 --2- 172.21.15.142:0/1904242500 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f2ae4015f40 0x7f2ae4045a30 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:42.035 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.028+0000 7f2aee3af800 1 -- 172.21.15.142:0/1904242500 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55732616e180 msgr2=0x557326170590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:42.035 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.028+0000 7f2aee3af800 1 --2- 172.21.15.142:0/1904242500 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55732616e180 0x557326170590 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:42.035 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.028+0000 7f2aee3af800 1 -- 172.21.15.142:0/1904242500 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f29b403cfb0 msgr2=0x7f29b403f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:42.035 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.028+0000 7f2aee3af800 1 --2- 172.21.15.142:0/1904242500 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f29b403cfb0 0x7f29b403f470 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f2adc001eb0 tx=0x7f2adc087000 comp rx=0 tx=0).stop 2024-09-22T08:37:42.035 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.028+0000 7f2aee3af800 1 -- 172.21.15.142:0/1904242500 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5573261569b0 msgr2=0x55732615dfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:42.035 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.028+0000 7f2aeb69f640 1 -- 172.21.15.142:0/1904242500 reap_dead start 2024-09-22T08:37:42.035 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.028+0000 7f2aee3af800 1 --2- 172.21.15.142:0/1904242500 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5573261569b0 0x55732615dfe0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f2ae40547c0 tx=0x7f2ae40547f0 comp rx=0 tx=0).stop 2024-09-22T08:37:42.035 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.028+0000 7f2aee3af800 1 -- 172.21.15.142:0/1904242500 shutdown_connections 2024-09-22T08:37:42.035 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.029+0000 7f2aee3af800 1 --2- 172.21.15.142:0/1904242500 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5573261569b0 0x55732615dfe0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:42.035 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.029+0000 7f2aee3af800 1 -- 172.21.15.142:0/1904242500 >> 172.21.15.142:0/1904242500 conn(0x55732614e9c0 msgr2=0x55732614cbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:37:42.035 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.029+0000 7f2aee3af800 1 -- 172.21.15.142:0/1904242500 shutdown_connections 2024-09-22T08:37:42.035 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.029+0000 7f2aee3af800 1 -- 172.21.15.142:0/1904242500 wait complete. 2024-09-22T08:37:42.036 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.029+0000 7f2aee3af800 1 -- 172.21.15.142:0/4010140511 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f29c403d000 msgr2=0x7f29c403f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:42.036 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.029+0000 7f2aee3af800 1 --2- 172.21.15.142:0/4010140511 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f29c403d000 0x7f29c403f4c0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f2adc072ff0 tx=0x7f2adc005700 comp rx=0 tx=0).stop 2024-09-22T08:37:42.036 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.029+0000 7f2aee3af800 1 -- 172.21.15.142:0/4010140511 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557326145b40 msgr2=0x557326145f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:42.036 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.029+0000 7f2aee3af800 1 --2- 172.21.15.142:0/4010140511 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557326145b40 0x557326145f60 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x55732612b710 tx=0x7f2ae40167b0 comp rx=0 tx=0).stop 2024-09-22T08:37:42.036 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.029+0000 7f2aee3af800 1 -- 172.21.15.142:0/4010140511 shutdown_connections 2024-09-22T08:37:42.036 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.029+0000 7f2aee3af800 1 --2- 172.21.15.142:0/4010140511 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f29c403d000 0x7f29c403f4c0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:42.036 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.029+0000 7f2aee3af800 1 --2- 172.21.15.142:0/4010140511 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557326145b40 0x557326145f60 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:42.036 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.029+0000 7f2aee3af800 1 -- 172.21.15.142:0/4010140511 >> 172.21.15.142:0/4010140511 conn(0x557326139ef0 msgr2=0x55732613a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:37:42.036 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.029+0000 7f2aee3af800 1 -- 172.21.15.142:0/4010140511 shutdown_connections 2024-09-22T08:37:42.036 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.029+0000 7f2aee3af800 1 -- 172.21.15.142:0/4010140511 wait complete. 2024-09-22T08:37:42.036 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.029+0000 7f2aee3af800 1 -- 172.21.15.142:0/166881566 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55732612c590 msgr2=0x557326131ed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:42.036 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.029+0000 7f2aee3af800 1 --2- 172.21.15.142:0/166881566 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55732612c590 0x557326131ed0 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:42.036 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.029+0000 7f2aee3af800 1 -- 172.21.15.142:0/166881566 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x557326134760 msgr2=0x557326136b50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:42.036 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.029+0000 7f2aee3af800 1 --2- 172.21.15.142:0/166881566 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x557326134760 0x557326136b50 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:42.036 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.029+0000 7f2aee3af800 1 -- 172.21.15.142:0/166881566 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f29d403cfb0 msgr2=0x7f29d403f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:42.037 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.029+0000 7f2aee3af800 1 --2- 172.21.15.142:0/166881566 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f29d403cfb0 0x7f29d403f470 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f2ad4000c00 tx=0x7f2ad40013b0 comp rx=0 tx=0).stop 2024-09-22T08:37:42.037 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.029+0000 7f2aee3af800 1 -- 172.21.15.142:0/166881566 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557326035a20 msgr2=0x55732612a880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:42.037 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.029+0000 7f2aee3af800 1 --2- 172.21.15.142:0/166881566 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557326035a20 0x55732612a880 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f2adc027c60 tx=0x7f2adc002fb0 comp rx=0 tx=0).stop 2024-09-22T08:37:42.037 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.029+0000 7f2aee3af800 1 -- 172.21.15.142:0/166881566 shutdown_connections 2024-09-22T08:37:42.037 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.029+0000 7f2aee3af800 1 --2- 172.21.15.142:0/166881566 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x557326134760 0x557326136b50 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:42.037 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.029+0000 7f2aee3af800 1 --2- 172.21.15.142:0/166881566 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55732612c590 0x557326131ed0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:42.037 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.029+0000 7f2aee3af800 1 --2- 172.21.15.142:0/166881566 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f29d403cfb0 0x7f29d403f470 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:42.037 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.029+0000 7f2aee3af800 1 --2- 172.21.15.142:0/166881566 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557326035a20 0x55732612a880 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:42.037 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.029+0000 7f2aee3af800 1 -- 172.21.15.142:0/166881566 >> 172.21.15.142:0/166881566 conn(0x55732602fbb0 msgr2=0x557326124070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:37:42.037 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.030+0000 7f2aee3af800 1 -- 172.21.15.142:0/166881566 shutdown_connections 2024-09-22T08:37:42.037 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.030+0000 7f2aee3af800 1 -- 172.21.15.142:0/166881566 wait complete. 2024-09-22T08:37:42.039 INFO:teuthology.orchestra.run.smithi142.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-09-22T08:00:00.000000Z","epoch":1726992000,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo","time":"2024-09-22T08:00:00.000000Z","epoch":1726992000,"owner":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}],"s3select":{}},{"bucket":"myfoo2","time":"2024-09-22T08:00:00.000000Z","epoch":1726992000,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo3","time":"2024-09-22T08:00:00.000000Z","epoch":1726992000,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo4","time":"2024-09-22T08:00:00.000000Z","epoch":1726992000,"owner":"foo","categories":[],"s3select":{}}]}],"summary":[{"user":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}],"total":{"bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4,"bytes_processed":0,"bytes_returned":0}}]} 2024-09-22T08:37:42.039 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-22T08:00:00.000000Z', 'epoch': 1726992000, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo', 'time': '2024-09-22T08:00:00.000000Z', 'epoch': 1726992000, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}], 's3select': {}}, {'bucket': 'myfoo2', 'time': '2024-09-22T08:00:00.000000Z', 'epoch': 1726992000, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo3', 'time': '2024-09-22T08:00:00.000000Z', 'epoch': 1726992000, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo4', 'time': '2024-09-22T08:00:00.000000Z', 'epoch': 1726992000, 'owner': 'foo', 'categories': [], 's3select': {}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-22T08:37:42.039 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'delete_bucket'] 2024-09-22T08:37:42.040 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'delete_bucket'] 2024-09-22T08:37:42.040 DEBUG:teuthology.orchestra.run.smithi142:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories delete_bucket 2024-09-22T08:37:42.086 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:37:42.086 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:37:42.087 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.085+0000 7f98c2a1d800 1 Processor -- start 2024-09-22T08:37:42.087 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.085+0000 7f98c2a1d800 1 -- start start 2024-09-22T08:37:42.087 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.086+0000 7f98c2a1d800 1 --2- >> v2:172.21.15.31:3300/0 conn(0x5565e4c82c00 0x5565e4c850c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:42.087 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.086+0000 7f98c2a1d800 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5565e4b07a20 con 0x5565e4bf0530 2024-09-22T08:37:42.087 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.086+0000 7f98c2a1d800 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x5565e4b077d0 con 0x5565e4c82c00 2024-09-22T08:37:42.088 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.086+0000 7f98b59ea640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x5565e4c82c00 0x5565e4c850c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:42.088 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.086+0000 7f98be1eb640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x5565e4bf0530 0x5565e4c814b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.142:50282/0 (socket says 172.21.15.142:50282) 2024-09-22T08:37:42.088 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.086+0000 7f98b59ea640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x5565e4c82c00 0x5565e4c850c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:55808/0 (socket says 172.21.15.142:55808) 2024-09-22T08:37:42.088 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.086+0000 7f98be1eb640 1 -- 172.21.15.142:0/1287736496 learned_addr learned my addr 172.21.15.142:0/1287736496 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-09-22T08:37:42.088 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.086+0000 7f98b59ea640 1 -- 172.21.15.142:0/1287736496 >> v1:172.21.15.31:6789/0 conn(0x5565e4bf0530 legacy=0x5565e4c814b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:42.088 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.086+0000 7f98b59ea640 1 -- 172.21.15.142:0/1287736496 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5565e4c867d0 con 0x5565e4c82c00 2024-09-22T08:37:42.089 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.088+0000 7f98b59ea640 1 --2- 172.21.15.142:0/1287736496 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5565e4c82c00 0x5565e4c850c0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f98a800a470 tx=0x7f98a8045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4020cab551367fb2 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:42.089 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.088+0000 7f98bd9ea640 1 -- 172.21.15.142:0/1287736496 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98a8053570 con 0x5565e4c82c00 2024-09-22T08:37:42.090 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.088+0000 7f98bd9ea640 1 -- 172.21.15.142:0/1287736496 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98a8058070 con 0x5565e4c82c00 2024-09-22T08:37:42.090 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.088+0000 7f98bd9ea640 1 -- 172.21.15.142:0/1287736496 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98a8053880 con 0x5565e4c82c00 2024-09-22T08:37:42.091 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.089+0000 7f98c2a1d800 1 -- 172.21.15.142:0/1287736496 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5565e4c82c00 msgr2=0x5565e4c850c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:42.091 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.089+0000 7f98c2a1d800 1 --2- 172.21.15.142:0/1287736496 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5565e4c82c00 0x5565e4c850c0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f98a800a470 tx=0x7f98a8045a20 comp rx=0 tx=0).stop 2024-09-22T08:37:42.091 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.089+0000 7f98c2a1d800 1 -- 172.21.15.142:0/1287736496 shutdown_connections 2024-09-22T08:37:42.091 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.089+0000 7f98c2a1d800 1 --2- 172.21.15.142:0/1287736496 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5565e4c82c00 0x5565e4c850c0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:42.091 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.089+0000 7f98c2a1d800 1 -- 172.21.15.142:0/1287736496 >> 172.21.15.142:0/1287736496 conn(0x5565e4c76be0 msgr2=0x5565e4c79020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:37:42.091 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.089+0000 7f98c2a1d800 1 -- 172.21.15.142:0/1287736496 shutdown_connections 2024-09-22T08:37:42.091 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.089+0000 7f98c2a1d800 1 -- 172.21.15.142:0/1287736496 wait complete. 2024-09-22T08:37:42.104 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.102+0000 7f98c2a1d800 1 Processor -- start 2024-09-22T08:37:42.104 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.103+0000 7f98c2a1d800 1 -- start start 2024-09-22T08:37:42.104 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.103+0000 7f98c2a1d800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5565e4bf0530 0x5565e4d6e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:42.105 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.103+0000 7f98c2a1d800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5565e4b14dd0 con 0x5565e4bf0530 2024-09-22T08:37:42.105 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.103+0000 7f98be1eb640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5565e4bf0530 0x5565e4d6e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:42.105 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.103+0000 7f98be1eb640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5565e4bf0530 0x5565e4d6e220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:55818/0 (socket says 172.21.15.142:55818) 2024-09-22T08:37:42.105 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.103+0000 7f98be1eb640 1 -- 172.21.15.142:0/2493388560 learned_addr learned my addr 172.21.15.142:0/2493388560 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:37:42.105 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.103+0000 7f98be1eb640 1 -- 172.21.15.142:0/2493388560 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5565e4d6e810 con 0x5565e4bf0530 2024-09-22T08:37:42.107 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.104+0000 7f98be1eb640 1 --2- 172.21.15.142:0/2493388560 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5565e4bf0530 0x5565e4d6e220 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f98b0001e40 tx=0x7f98b0001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c1ea9f411d705bd server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:42.107 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.104+0000 7f97ac608640 1 -- 172.21.15.142:0/2493388560 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98b0012020 con 0x5565e4bf0530 2024-09-22T08:37:42.107 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.104+0000 7f97ac608640 1 -- 172.21.15.142:0/2493388560 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98b000e5a0 con 0x5565e4bf0530 2024-09-22T08:37:42.107 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.104+0000 7f97ac608640 1 -- 172.21.15.142:0/2493388560 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98b000e8a0 con 0x5565e4bf0530 2024-09-22T08:37:42.107 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.104+0000 7f98c2a1d800 1 -- 172.21.15.142:0/2493388560 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5565e4bf0530 msgr2=0x5565e4d6e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:42.107 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.104+0000 7f98c2a1d800 1 --2- 172.21.15.142:0/2493388560 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5565e4bf0530 0x5565e4d6e220 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f98b0001e40 tx=0x7f98b0001e70 comp rx=0 tx=0).stop 2024-09-22T08:37:42.107 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.104+0000 7f98c2a1d800 1 -- 172.21.15.142:0/2493388560 shutdown_connections 2024-09-22T08:37:42.107 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.104+0000 7f98c2a1d800 1 --2- 172.21.15.142:0/2493388560 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5565e4bf0530 0x5565e4d6e220 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:42.108 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.104+0000 7f98c2a1d800 1 -- 172.21.15.142:0/2493388560 >> 172.21.15.142:0/2493388560 conn(0x5565e4c76be0 msgr2=0x5565e4d69ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:37:42.108 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.104+0000 7f98c2a1d800 1 -- 172.21.15.142:0/2493388560 shutdown_connections 2024-09-22T08:37:42.108 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.104+0000 7f98c2a1d800 1 -- 172.21.15.142:0/2493388560 wait complete. 2024-09-22T08:37:42.108 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.105+0000 7f98c2a1d800 1 Processor -- start 2024-09-22T08:37:42.108 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.105+0000 7f98c2a1d800 1 -- start start 2024-09-22T08:37:42.108 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.105+0000 7f98c2a1d800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5565e4bf0530 0x5565e4d75d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:42.108 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.105+0000 7f98c2a1d800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5565e4c85a70 con 0x5565e4bf0530 2024-09-22T08:37:42.108 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.105+0000 7f98be1eb640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5565e4bf0530 0x5565e4d75d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:42.108 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.105+0000 7f98be1eb640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5565e4bf0530 0x5565e4d75d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:55832/0 (socket says 172.21.15.142:55832) 2024-09-22T08:37:42.108 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.105+0000 7f98be1eb640 1 -- 172.21.15.142:0/2081757711 learned_addr learned my addr 172.21.15.142:0/2081757711 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:37:42.108 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.105+0000 7f98be1eb640 1 -- 172.21.15.142:0/2081757711 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5565e4d762a0 con 0x5565e4bf0530 2024-09-22T08:37:42.108 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.106+0000 7f98be1eb640 1 --2- 172.21.15.142:0/2081757711 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5565e4bf0530 0x5565e4d75d40 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f98b000c010 tx=0x7f98b0000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:42.108 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.106+0000 7f97aae05640 1 -- 172.21.15.142:0/2081757711 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98b0012030 con 0x5565e4bf0530 2024-09-22T08:37:42.108 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.106+0000 7f97aae05640 1 -- 172.21.15.142:0/2081757711 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98b00014a0 con 0x5565e4bf0530 2024-09-22T08:37:42.109 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.106+0000 7f98c2a1d800 1 -- 172.21.15.142:0/2081757711 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5565e4d76530 con 0x5565e4bf0530 2024-09-22T08:37:42.109 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.106+0000 7f97aae05640 1 -- 172.21.15.142:0/2081757711 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98b001a7a0 con 0x5565e4bf0530 2024-09-22T08:37:42.109 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.106+0000 7f98c2a1d800 1 -- 172.21.15.142:0/2081757711 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5565e4d76f30 con 0x5565e4bf0530 2024-09-22T08:37:42.112 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.107+0000 7f97aae05640 1 -- 172.21.15.142:0/2081757711 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f98b0015020 con 0x5565e4bf0530 2024-09-22T08:37:42.112 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.107+0000 7f97aae05640 1 --2- 172.21.15.142:0/2081757711 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f97a403cfb0 0x7f97a403f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:42.112 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.107+0000 7f97aae05640 1 -- 172.21.15.142:0/2081757711 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5938+0+0 (secure 0 0 0) 0x7f98b0020030 con 0x5565e4bf0530 2024-09-22T08:37:42.112 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.107+0000 7f98b59ea640 1 --2- 172.21.15.142:0/2081757711 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f97a403cfb0 0x7f97a403f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:42.112 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.107+0000 7f98c2a1d800 1 --2- 172.21.15.142:0/2081757711 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5565e4c82c00 0x5565e4d7d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:42.112 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.107+0000 7f98c2a1d800 1 -- 172.21.15.142:0/2081757711 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5565e4d7d8d0 con 0x5565e4c82c00 2024-09-22T08:37:42.112 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.107+0000 7f98be9ec640 1 --2- 172.21.15.142:0/2081757711 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5565e4c82c00 0x5565e4d7d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:42.112 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.107+0000 7f98b59ea640 1 --2- 172.21.15.142:0/2081757711 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f97a403cfb0 0x7f97a403f470 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f98a8057000 tx=0x7f98a8052000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:42.112 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.108+0000 7f98be9ec640 1 --2- 172.21.15.142:0/2081757711 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5565e4c82c00 0x5565e4d7d390 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:42.113 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.108+0000 7f98be9ec640 1 -- 172.21.15.142:0/2081757711 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f98b800a4d0 con 0x5565e4c82c00 2024-09-22T08:37:42.113 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.108+0000 7f98c2a1d800 1 -- 172.21.15.142:0/2081757711 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5565e4d7dc70 con 0x5565e4c82c00 2024-09-22T08:37:42.113 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.108+0000 7f98be9ec640 1 -- 172.21.15.142:0/2081757711 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f98b800a4d0 con 0x5565e4c82c00 2024-09-22T08:37:42.113 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.108+0000 7f98c2a1d800 1 --2- 172.21.15.142:0/2081757711 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5565e4d7f730 0x5565e4d81bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:42.113 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.108+0000 7f98c2a1d800 1 -- 172.21.15.142:0/2081757711 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:3 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5565e4d82360 con 0x5565e4d7f730 2024-09-22T08:37:42.113 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.108+0000 7f98be1eb640 1 --2- 172.21.15.142:0/2081757711 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5565e4d7f730 0x5565e4d81bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:42.113 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.108+0000 7f98be1eb640 1 --2- 172.21.15.142:0/2081757711 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5565e4d7f730 0x5565e4d81bd0 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:42.113 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.109+0000 7f98be1eb640 1 -- 172.21.15.142:0/2081757711 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(3 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f98b001ab20 con 0x5565e4d7f730 2024-09-22T08:37:42.113 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.109+0000 7f98c2a1d800 1 -- 172.21.15.142:0/2081757711 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5565e4d7e4c0 con 0x5565e4c82c00 2024-09-22T08:37:42.113 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.109+0000 7f98be9ec640 1 -- 172.21.15.142:0/2081757711 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f98b800a4d0 con 0x5565e4c82c00 2024-09-22T08:37:42.113 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.109+0000 7f98c2a1d800 1 -- 172.21.15.142:0/2081757711 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5565e4d7e8a0 con 0x5565e4d7f730 2024-09-22T08:37:42.113 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.109+0000 7f98be1eb640 1 -- 172.21.15.142:0/2081757711 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(5 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f98b001ab20 con 0x5565e4d7f730 2024-09-22T08:37:42.113 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.110+0000 7f98c2a1d800 1 Processor -- start 2024-09-22T08:37:42.113 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.110+0000 7f98c2a1d800 1 -- start start 2024-09-22T08:37:42.114 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.110+0000 7f98c2a1d800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5565e4d90d30 0x5565e4d91150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:42.114 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.110+0000 7f98c2a1d800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5565e4b73d50 con 0x5565e4d90d30 2024-09-22T08:37:42.114 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.110+0000 7f98be9ec640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5565e4d90d30 0x5565e4d91150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:42.114 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.110+0000 7f98be9ec640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5565e4d90d30 0x5565e4d91150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:55844/0 (socket says 172.21.15.142:55844) 2024-09-22T08:37:42.114 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.110+0000 7f98be9ec640 1 -- 172.21.15.142:0/1375444648 learned_addr learned my addr 172.21.15.142:0/1375444648 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:37:42.114 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.110+0000 7f98be9ec640 1 -- 172.21.15.142:0/1375444648 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5565e4d91790 con 0x5565e4d90d30 2024-09-22T08:37:42.114 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.111+0000 7f98be9ec640 1 --2- 172.21.15.142:0/1375444648 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5565e4d90d30 0x5565e4d91150 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x5565e4d76bd0 tx=0x7f98b80167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:42.114 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.111+0000 7f97a3fff640 1 -- 172.21.15.142:0/1375444648 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98b8013640 con 0x5565e4d90d30 2024-09-22T08:37:42.114 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.111+0000 7f97a3fff640 1 -- 172.21.15.142:0/1375444648 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98b80137e0 con 0x5565e4d90d30 2024-09-22T08:37:42.114 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.111+0000 7f98c2a1d800 1 -- 172.21.15.142:0/1375444648 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5565e4d91fc0 con 0x5565e4d90d30 2024-09-22T08:37:42.114 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.111+0000 7f97a3fff640 1 -- 172.21.15.142:0/1375444648 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98b8013b00 con 0x5565e4d90d30 2024-09-22T08:37:42.114 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.111+0000 7f98c2a1d800 1 -- 172.21.15.142:0/1375444648 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5565e4d92560 con 0x5565e4d90d30 2024-09-22T08:37:42.121 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.112+0000 7f97a3fff640 1 -- 172.21.15.142:0/1375444648 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f98b8011040 con 0x5565e4d90d30 2024-09-22T08:37:42.121 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.112+0000 7f97a3fff640 1 --2- 172.21.15.142:0/1375444648 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f979803cfb0 0x7f979803f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:42.121 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.112+0000 7f97a3fff640 1 -- 172.21.15.142:0/1375444648 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5938+0+0 (secure 0 0 0) 0x7f98b800e040 con 0x5565e4d90d30 2024-09-22T08:37:42.121 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.112+0000 7f98be1eb640 1 --2- 172.21.15.142:0/1375444648 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f979803cfb0 0x7f979803f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:42.122 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.112+0000 7f98c2a1d800 1 Processor -- start 2024-09-22T08:37:42.122 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.112+0000 7f98be1eb640 1 --2- 172.21.15.142:0/1375444648 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f979803cfb0 0x7f979803f470 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x5565e4d77e40 tx=0x7f98b00529c0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:42.122 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.112+0000 7f98c2a1d800 1 -- start start 2024-09-22T08:37:42.122 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.112+0000 7f98c2a1d800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5565e4d9d7f0 0x5565e4d9dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:42.122 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.112+0000 7f98c2a1d800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5565e4d6ec40 con 0x5565e4d9d7f0 2024-09-22T08:37:42.122 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.113+0000 7f98be9ec640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5565e4d9d7f0 0x5565e4d9dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:42.122 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.113+0000 7f98be9ec640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5565e4d9d7f0 0x5565e4d9dbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:55848/0 (socket says 172.21.15.142:55848) 2024-09-22T08:37:42.122 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.113+0000 7f98be9ec640 1 -- 172.21.15.142:0/1286220005 learned_addr learned my addr 172.21.15.142:0/1286220005 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:37:42.122 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.113+0000 7f98be9ec640 1 -- 172.21.15.142:0/1286220005 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5565e4d9e1e0 con 0x5565e4d9d7f0 2024-09-22T08:37:42.122 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.113+0000 7f98be9ec640 1 --2- 172.21.15.142:0/1286220005 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5565e4d9d7f0 0x5565e4d9dbf0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f98b8054840 tx=0x7f98b801f340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60925f74d129e07a server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:42.122 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.113+0000 7f97a1ffb640 1 -- 172.21.15.142:0/1286220005 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98b8051030 con 0x5565e4d9d7f0 2024-09-22T08:37:42.122 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.113+0000 7f97a1ffb640 1 -- 172.21.15.142:0/1286220005 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98b802aa40 con 0x5565e4d9d7f0 2024-09-22T08:37:42.122 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.113+0000 7f97a1ffb640 1 -- 172.21.15.142:0/1286220005 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98b8013dd0 con 0x5565e4d9d7f0 2024-09-22T08:37:42.123 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.114+0000 7f98c2a1d800 1 -- 172.21.15.142:0/1286220005 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5565e4d9d7f0 msgr2=0x5565e4d9dbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:42.123 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.114+0000 7f98c2a1d800 1 --2- 172.21.15.142:0/1286220005 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5565e4d9d7f0 0x5565e4d9dbf0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f98b8054840 tx=0x7f98b801f340 comp rx=0 tx=0).stop 2024-09-22T08:37:42.123 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.114+0000 7f98c2a1d800 1 -- 172.21.15.142:0/1286220005 shutdown_connections 2024-09-22T08:37:42.123 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.114+0000 7f98c2a1d800 1 --2- 172.21.15.142:0/1286220005 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5565e4d9d7f0 0x5565e4d9dbf0 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:42.123 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.114+0000 7f98c2a1d800 1 -- 172.21.15.142:0/1286220005 >> 172.21.15.142:0/1286220005 conn(0x5565e4d99bf0 msgr2=0x5565e4d97e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:37:42.123 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.114+0000 7f98c2a1d800 1 -- 172.21.15.142:0/1286220005 shutdown_connections 2024-09-22T08:37:42.123 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.114+0000 7f98c2a1d800 1 -- 172.21.15.142:0/1286220005 wait complete. 2024-09-22T08:37:42.123 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.114+0000 7f98c2a1d800 1 Processor -- start 2024-09-22T08:37:42.123 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.114+0000 7f98c2a1d800 1 -- start start 2024-09-22T08:37:42.123 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.114+0000 7f98c2a1d800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5565e4d9d7f0 0x5565e4da4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:42.123 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.114+0000 7f98c2a1d800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5565e4d9e800 con 0x5565e4d9d7f0 2024-09-22T08:37:42.123 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.114+0000 7f98be9ec640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5565e4d9d7f0 0x5565e4da4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:42.123 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.114+0000 7f98be9ec640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5565e4d9d7f0 0x5565e4da4dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:55854/0 (socket says 172.21.15.142:55854) 2024-09-22T08:37:42.123 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.114+0000 7f98be9ec640 1 -- 172.21.15.142:0/1676135916 learned_addr learned my addr 172.21.15.142:0/1676135916 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:37:42.124 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.115+0000 7f98be9ec640 1 -- 172.21.15.142:0/1676135916 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5565e4da5330 con 0x5565e4d9d7f0 2024-09-22T08:37:42.124 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.115+0000 7f98be9ec640 1 --2- 172.21.15.142:0/1676135916 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5565e4d9d7f0 0x5565e4da4dd0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f98b80114f0 tx=0x7f98b8054870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:42.124 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.115+0000 7f978ffff640 1 -- 172.21.15.142:0/1676135916 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98b8051070 con 0x5565e4d9d7f0 2024-09-22T08:37:42.124 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.115+0000 7f978ffff640 1 -- 172.21.15.142:0/1676135916 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98b8045ab0 con 0x5565e4d9d7f0 2024-09-22T08:37:42.124 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.115+0000 7f98c2a1d800 1 -- 172.21.15.142:0/1676135916 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5565e4da55c0 con 0x5565e4d9d7f0 2024-09-22T08:37:42.124 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.115+0000 7f978ffff640 1 -- 172.21.15.142:0/1676135916 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98b8045d90 con 0x5565e4d9d7f0 2024-09-22T08:37:42.124 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.115+0000 7f98c2a1d800 1 -- 172.21.15.142:0/1676135916 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5565e4da5f40 con 0x5565e4d9d7f0 2024-09-22T08:37:42.124 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.116+0000 7f978ffff640 1 -- 172.21.15.142:0/1676135916 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f98b80203a0 con 0x5565e4d9d7f0 2024-09-22T08:37:42.124 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.116+0000 7f978ffff640 1 --2- 172.21.15.142:0/1676135916 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f978803cfb0 0x7f978803f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:42.124 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.116+0000 7f978ffff640 1 -- 172.21.15.142:0/1676135916 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5938+0+0 (secure 0 0 0) 0x7f98b804b070 con 0x5565e4d9d7f0 2024-09-22T08:37:42.124 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.116+0000 7f98be1eb640 1 --2- 172.21.15.142:0/1676135916 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f978803cfb0 0x7f978803f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:42.124 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.116+0000 7f98c2a1d800 20 rados->read ofs=0 len=0 2024-09-22T08:37:42.124 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.116+0000 7f98c2a1d800 1 --2- 172.21.15.142:0/1676135916 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5565e4db06c0 0x5565e4db2b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:42.125 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.116+0000 7f98c2a1d800 1 -- 172.21.15.142:0/1676135916 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5565e4db32d0 con 0x5565e4db06c0 2024-09-22T08:37:42.125 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.116+0000 7f98be1eb640 1 --2- 172.21.15.142:0/1676135916 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f978803cfb0 0x7f978803f470 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f98b0001250 tx=0x7f98b0051000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:42.125 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.117+0000 7f98b59ea640 1 --2- 172.21.15.142:0/1676135916 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5565e4db06c0 0x5565e4db2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:42.125 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.117+0000 7f98b59ea640 1 --2- 172.21.15.142:0/1676135916 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5565e4db06c0 0x5565e4db2b80 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:42.125 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.117+0000 7f98b59ea640 1 -- 172.21.15.142:0/1676135916 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f98a8051070 con 0x5565e4db06c0 2024-09-22T08:37:42.125 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.117+0000 7f98c2a1d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:42.125 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.117+0000 7f98c2a1d800 20 realm 2024-09-22T08:37:42.125 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.117+0000 7f98c2a1d800 20 rados->read ofs=0 len=0 2024-09-22T08:37:42.125 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.117+0000 7f98c2a1d800 1 -- 172.21.15.142:0/1676135916 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5565e4db3700 con 0x5565e4db06c0 2024-09-22T08:37:42.125 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.117+0000 7f98b59ea640 1 -- 172.21.15.142:0/1676135916 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f98a8051070 con 0x5565e4db06c0 2024-09-22T08:37:42.125 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.117+0000 7f98c2a1d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:42.125 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.117+0000 7f98c2a1d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:37:42.125 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.117+0000 7f98c2a1d800 20 rados->read ofs=0 len=0 2024-09-22T08:37:42.125 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.117+0000 7f98c2a1d800 1 -- 172.21.15.142:0/1676135916 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5565e4db3fd0 con 0x5565e4db06c0 2024-09-22T08:37:42.126 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.118+0000 7f98b59ea640 1 -- 172.21.15.142:0/1676135916 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f98a8051070 con 0x5565e4db06c0 2024-09-22T08:37:42.126 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.118+0000 7f98c2a1d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:42.126 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.118+0000 7f98c2a1d800 20 rados->read ofs=0 len=0 2024-09-22T08:37:42.126 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.118+0000 7f98c2a1d800 1 -- 172.21.15.142:0/1676135916 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5565e4db4370 con 0x5565e4db06c0 2024-09-22T08:37:42.126 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.118+0000 7f98b59ea640 1 -- 172.21.15.142:0/1676135916 <== osd.1 v2:172.21.15.142:6816/3192108003 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f98a8051070 con 0x5565e4db06c0 2024-09-22T08:37:42.126 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.118+0000 7f98c2a1d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:37:42.126 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.118+0000 7f98c2a1d800 20 rados->read ofs=0 len=0 2024-09-22T08:37:42.126 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.118+0000 7f98c2a1d800 1 --2- 172.21.15.142:0/1676135916 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5565e4db50d0 0x5565e4db74c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:42.126 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.118+0000 7f98c2a1d800 1 -- 172.21.15.142:0/1676135916 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5565e4db7a00 con 0x5565e4db50d0 2024-09-22T08:37:42.126 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.118+0000 7f98be9ec640 1 --2- 172.21.15.142:0/1676135916 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5565e4db50d0 0x5565e4db74c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:42.126 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.118+0000 7f98be9ec640 1 --2- 172.21.15.142:0/1676135916 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5565e4db50d0 0x5565e4db74c0 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:42.126 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.118+0000 7f98be9ec640 1 -- 172.21.15.142:0/1676135916 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(5 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f98b803a070 con 0x5565e4db50d0 2024-09-22T08:37:42.126 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.118+0000 7f98c2a1d800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:37:42.127 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.118+0000 7f98c2a1d800 20 searching for the correct realm 2024-09-22T08:37:42.127 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.118+0000 7f98c2a1d800 1 -- 172.21.15.142:0/1676135916 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5565e4db9370 con 0x5565e4db50d0 2024-09-22T08:37:42.127 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.119+0000 7f98be9ec640 1 -- 172.21.15.142:0/1676135916 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98b803a070 con 0x5565e4db50d0 2024-09-22T08:37:42.127 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.119+0000 7f98be9ec640 1 --2- 172.21.15.142:0/1676135916 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f98b801f560 0x7f98b8047a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:42.127 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.119+0000 7f98be9ec640 1 -- 172.21.15.142:0/1676135916 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5565e4db9370 con 0x7f98b801f560 2024-09-22T08:37:42.127 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.119+0000 7f98be1eb640 1 --2- 172.21.15.142:0/1676135916 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f98b801f560 0x7f98b8047a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:42.127 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.119+0000 7f98be1eb640 1 --2- 172.21.15.142:0/1676135916 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f98b801f560 0x7f98b8047a60 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:42.127 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.119+0000 7f98be1eb640 1 -- 172.21.15.142:0/1676135916 <== osd.2 v2:172.21.15.142:6808/279438927 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98b001ab20 con 0x7f98b801f560 2024-09-22T08:37:42.127 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.119+0000 7f98be1eb640 1 --2- 172.21.15.142:0/1676135916 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f98b0017050 0x7f98b004b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:42.127 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.119+0000 7f98be1eb640 1 -- 172.21.15.142:0/1676135916 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5565e4db9370 con 0x7f98b0017050 2024-09-22T08:37:42.127 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.120+0000 7f98b59ea640 1 --2- 172.21.15.142:0/1676135916 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f98b0017050 0x7f98b004b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:42.127 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.120+0000 7f98b59ea640 1 --2- 172.21.15.142:0/1676135916 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f98b0017050 0x7f98b004b890 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:42.127 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.120+0000 7f98b59ea640 1 -- 172.21.15.142:0/1676135916 <== osd.0 v2:172.21.15.31:6800/168281188 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98a8051070 con 0x7f98b0017050 2024-09-22T08:37:42.128 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.120+0000 7f98b59ea640 1 -- 172.21.15.142:0/1676135916 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5565e4db9370 con 0x5565e4db06c0 2024-09-22T08:37:42.128 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.120+0000 7f98b59ea640 1 -- 172.21.15.142:0/1676135916 <== osd.1 v2:172.21.15.142:6816/3192108003 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98a8051070 con 0x5565e4db06c0 2024-09-22T08:37:42.128 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.120+0000 7f98b59ea640 1 -- 172.21.15.142:0/1676135916 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5565e4db9370 con 0x5565e4db06c0 2024-09-22T08:37:42.136 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.121+0000 7f98b59ea640 1 -- 172.21.15.142:0/1676135916 <== osd.1 v2:172.21.15.142:6816/3192108003 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98a8051070 con 0x5565e4db06c0 2024-09-22T08:37:42.137 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.121+0000 7f98b59ea640 1 -- 172.21.15.142:0/1676135916 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5565e4db9370 con 0x5565e4db06c0 2024-09-22T08:37:42.137 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.121+0000 7f98b59ea640 1 -- 172.21.15.142:0/1676135916 <== osd.1 v2:172.21.15.142:6816/3192108003 7 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98a8051070 con 0x5565e4db06c0 2024-09-22T08:37:42.137 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.121+0000 7f98b59ea640 1 -- 172.21.15.142:0/1676135916 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5565e4db9370 con 0x7f98b0017050 2024-09-22T08:37:42.137 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.121+0000 7f98b59ea640 1 -- 172.21.15.142:0/1676135916 <== osd.0 v2:172.21.15.31:6800/168281188 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98a8051070 con 0x7f98b0017050 2024-09-22T08:37:42.137 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.121+0000 7f98b59ea640 1 -- 172.21.15.142:0/1676135916 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5565e4db9370 con 0x7f98b801f560 2024-09-22T08:37:42.137 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.121+0000 7f98be1eb640 1 -- 172.21.15.142:0/1676135916 <== osd.2 v2:172.21.15.142:6808/279438927 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98b001ab20 con 0x7f98b801f560 2024-09-22T08:37:42.137 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.121+0000 7f98be1eb640 1 -- 172.21.15.142:0/1676135916 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5565e4db9370 con 0x5565e4db50d0 2024-09-22T08:37:42.137 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.122+0000 7f98be9ec640 1 -- 172.21.15.142:0/1676135916 <== osd.3 v2:172.21.15.142:6800/1064901393 3 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98b803a070 con 0x5565e4db50d0 2024-09-22T08:37:42.137 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.122+0000 7f98be9ec640 1 -- 172.21.15.142:0/1676135916 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5565e4db9370 con 0x5565e4db06c0 2024-09-22T08:37:42.137 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.122+0000 7f98b59ea640 1 -- 172.21.15.142:0/1676135916 <== osd.1 v2:172.21.15.142:6816/3192108003 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98a8051070 con 0x5565e4db06c0 2024-09-22T08:37:42.137 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.122+0000 7f98b59ea640 1 -- 172.21.15.142:0/1676135916 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5565e4db9370 con 0x7f98b0017050 2024-09-22T08:37:42.137 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.122+0000 7f98b59ea640 1 -- 172.21.15.142:0/1676135916 <== osd.0 v2:172.21.15.31:6800/168281188 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98a8051070 con 0x7f98b0017050 2024-09-22T08:37:42.138 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.122+0000 7f98b59ea640 1 -- 172.21.15.142:0/1676135916 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5565e4db9370 con 0x5565e4db06c0 2024-09-22T08:37:42.138 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.122+0000 7f98b59ea640 1 -- 172.21.15.142:0/1676135916 <== osd.1 v2:172.21.15.142:6816/3192108003 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98a8051070 con 0x5565e4db06c0 2024-09-22T08:37:42.138 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.122+0000 7f98b59ea640 1 -- 172.21.15.142:0/1676135916 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5565e4db9370 con 0x7f98b801f560 2024-09-22T08:37:42.138 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.123+0000 7f98be1eb640 1 -- 172.21.15.142:0/1676135916 <== osd.2 v2:172.21.15.142:6808/279438927 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f98b001ab20 con 0x7f98b801f560 2024-09-22T08:37:42.138 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.123+0000 7f98be1eb640 1 -- 172.21.15.142:0/1676135916 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5565e4db9370 con 0x5565e4db50d0 2024-09-22T08:37:42.138 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.123+0000 7f98be9ec640 1 -- 172.21.15.142:0/1676135916 <== osd.3 v2:172.21.15.142:6800/1064901393 4 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98b803a070 con 0x5565e4db50d0 2024-09-22T08:37:42.138 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.123+0000 7f98be9ec640 1 -- 172.21.15.142:0/1676135916 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5565e4db9370 con 0x5565e4db50d0 2024-09-22T08:37:42.138 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.123+0000 7f98be9ec640 1 -- 172.21.15.142:0/1676135916 <== osd.3 v2:172.21.15.142:6800/1064901393 5 ==== osd_op_reply(20 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f98b803a070 con 0x5565e4db50d0 2024-09-22T08:37:42.138 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.123+0000 7f98be9ec640 1 -- 172.21.15.142:0/1676135916 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5565e4db9370 con 0x7f98b0017050 2024-09-22T08:37:42.138 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.123+0000 7f98b59ea640 1 -- 172.21.15.142:0/1676135916 <== osd.0 v2:172.21.15.31:6800/168281188 4 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98a8051070 con 0x7f98b0017050 2024-09-22T08:37:42.138 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.123+0000 7f98b59ea640 1 -- 172.21.15.142:0/1676135916 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5565e4db9370 con 0x5565e4db50d0 2024-09-22T08:37:42.138 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.124+0000 7f98be9ec640 1 -- 172.21.15.142:0/1676135916 <== osd.3 v2:172.21.15.142:6800/1064901393 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98b803a070 con 0x5565e4db50d0 2024-09-22T08:37:42.138 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.124+0000 7f98be9ec640 1 -- 172.21.15.142:0/1676135916 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5565e4db9370 con 0x5565e4db50d0 2024-09-22T08:37:42.138 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.124+0000 7f98be9ec640 1 -- 172.21.15.142:0/1676135916 <== osd.3 v2:172.21.15.142:6800/1064901393 7 ==== osd_op_reply(23 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f98b803a070 con 0x5565e4db50d0 2024-09-22T08:37:42.139 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.124+0000 7f98be9ec640 1 -- 172.21.15.142:0/1676135916 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5565e4db9370 con 0x5565e4db06c0 2024-09-22T08:37:42.139 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.124+0000 7f98b59ea640 1 -- 172.21.15.142:0/1676135916 <== osd.1 v2:172.21.15.142:6816/3192108003 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98a8051070 con 0x5565e4db06c0 2024-09-22T08:37:42.139 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.124+0000 7f98b59ea640 1 -- 172.21.15.142:0/1676135916 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5565e4db9370 con 0x5565e4db06c0 2024-09-22T08:37:42.139 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.124+0000 7f98b59ea640 1 -- 172.21.15.142:0/1676135916 <== osd.1 v2:172.21.15.142:6816/3192108003 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f98a8051070 con 0x5565e4db06c0 2024-09-22T08:37:42.139 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.124+0000 7f98b59ea640 1 -- 172.21.15.142:0/1676135916 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5565e4db9370 con 0x7f98b0017050 2024-09-22T08:37:42.139 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.124+0000 7f98b59ea640 1 -- 172.21.15.142:0/1676135916 <== osd.0 v2:172.21.15.31:6800/168281188 5 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98a8051070 con 0x7f98b0017050 2024-09-22T08:37:42.139 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.125+0000 7f98b59ea640 1 -- 172.21.15.142:0/1676135916 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5565e4db9370 con 0x5565e4db50d0 2024-09-22T08:37:42.139 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.125+0000 7f98be9ec640 1 -- 172.21.15.142:0/1676135916 <== osd.3 v2:172.21.15.142:6800/1064901393 8 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98b803a070 con 0x5565e4db50d0 2024-09-22T08:37:42.139 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.125+0000 7f98be9ec640 1 -- 172.21.15.142:0/1676135916 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5565e4db9370 con 0x7f98b801f560 2024-09-22T08:37:42.139 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.125+0000 7f98be1eb640 1 -- 172.21.15.142:0/1676135916 <== osd.2 v2:172.21.15.142:6808/279438927 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98b001ab20 con 0x7f98b801f560 2024-09-22T08:37:42.139 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.125+0000 7f98be1eb640 1 -- 172.21.15.142:0/1676135916 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5565e4db9370 con 0x5565e4db06c0 2024-09-22T08:37:42.139 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.125+0000 7f98b59ea640 1 -- 172.21.15.142:0/1676135916 <== osd.1 v2:172.21.15.142:6816/3192108003 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98a8051070 con 0x5565e4db06c0 2024-09-22T08:37:42.140 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.125+0000 7f98b59ea640 1 -- 172.21.15.142:0/1676135916 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5565e4db9370 con 0x7f98b0017050 2024-09-22T08:37:42.140 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.125+0000 7f98b59ea640 1 -- 172.21.15.142:0/1676135916 <== osd.0 v2:172.21.15.31:6800/168281188 6 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98a8051070 con 0x7f98b0017050 2024-09-22T08:37:42.140 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.125+0000 7f98b59ea640 1 -- 172.21.15.142:0/1676135916 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5565e4db9370 con 0x5565e4db50d0 2024-09-22T08:37:42.140 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.126+0000 7f98be9ec640 1 -- 172.21.15.142:0/1676135916 <== osd.3 v2:172.21.15.142:6800/1064901393 9 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98b803a070 con 0x5565e4db50d0 2024-09-22T08:37:42.140 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.126+0000 7f98be9ec640 1 -- 172.21.15.142:0/1676135916 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5565e4db9370 con 0x7f98b0017050 2024-09-22T08:37:42.140 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.126+0000 7f98b59ea640 1 -- 172.21.15.142:0/1676135916 <== osd.0 v2:172.21.15.31:6800/168281188 7 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98a8051070 con 0x7f98b0017050 2024-09-22T08:37:42.140 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.126+0000 7f98b59ea640 1 -- 172.21.15.142:0/1676135916 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5565e4db9370 con 0x7f98b801f560 2024-09-22T08:37:42.140 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.126+0000 7f98be1eb640 1 -- 172.21.15.142:0/1676135916 <== osd.2 v2:172.21.15.142:6808/279438927 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98b001ab20 con 0x7f98b801f560 2024-09-22T08:37:42.140 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.126+0000 7f98be1eb640 1 -- 172.21.15.142:0/1676135916 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5565e4db9370 con 0x5565e4db50d0 2024-09-22T08:37:42.140 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.126+0000 7f98be9ec640 1 -- 172.21.15.142:0/1676135916 <== osd.3 v2:172.21.15.142:6800/1064901393 10 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98b803a070 con 0x5565e4db50d0 2024-09-22T08:37:42.140 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.127+0000 7f98be9ec640 1 -- 172.21.15.142:0/1676135916 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5565e4db9370 con 0x7f98b0017050 2024-09-22T08:37:42.140 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.127+0000 7f98b59ea640 1 -- 172.21.15.142:0/1676135916 <== osd.0 v2:172.21.15.31:6800/168281188 8 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98a8051070 con 0x7f98b0017050 2024-09-22T08:37:42.140 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.127+0000 7f98b59ea640 1 -- 172.21.15.142:0/1676135916 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5565e4db9370 con 0x5565e4db06c0 2024-09-22T08:37:42.140 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.127+0000 7f98b59ea640 1 -- 172.21.15.142:0/1676135916 <== osd.1 v2:172.21.15.142:6816/3192108003 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f98a8051070 con 0x5565e4db06c0 2024-09-22T08:37:42.141 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.127+0000 7f98b59ea640 1 -- 172.21.15.142:0/1676135916 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5565e4db9370 con 0x7f98b801f560 2024-09-22T08:37:42.141 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.127+0000 7f98be1eb640 1 -- 172.21.15.142:0/1676135916 <== osd.2 v2:172.21.15.142:6808/279438927 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98b001ab20 con 0x7f98b801f560 2024-09-22T08:37:42.141 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.127+0000 7f98c2a1d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:37:42.141 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.127+0000 7f98c2a1d800 20 RGWRados::pool_iterate: got zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec 2024-09-22T08:37:42.141 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.127+0000 7f98c2a1d800 20 RGWRados::pool_iterate: got zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f 2024-09-22T08:37:42.141 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.127+0000 7f98c2a1d800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:37:42.141 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.127+0000 7f98c2a1d800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:37:42.141 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.127+0000 7f98c2a1d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:37:42.141 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.127+0000 7f98c2a1d800 20 rados->read ofs=0 len=0 2024-09-22T08:37:42.141 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.127+0000 7f98c2a1d800 1 -- 172.21.15.142:0/1676135916 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5565e4db8470 con 0x5565e4db06c0 2024-09-22T08:37:42.141 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.127+0000 7f98b59ea640 1 -- 172.21.15.142:0/1676135916 <== osd.1 v2:172.21.15.142:6816/3192108003 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f98a8051070 con 0x5565e4db06c0 2024-09-22T08:37:42.141 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.127+0000 7f98c2a1d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:42.141 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.127+0000 7f98c2a1d800 20 rados->read ofs=0 len=0 2024-09-22T08:37:42.141 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.127+0000 7f98c2a1d800 1 -- 172.21.15.142:0/1676135916 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5565e4db8d10 con 0x5565e4db06c0 2024-09-22T08:37:42.142 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.128+0000 7f98b59ea640 1 -- 172.21.15.142:0/1676135916 <== osd.1 v2:172.21.15.142:6816/3192108003 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f98a8051070 con 0x5565e4db06c0 2024-09-22T08:37:42.142 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.128+0000 7f98c2a1d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:37:42.142 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.128+0000 7f98c2a1d800 20 rados->read ofs=0 len=0 2024-09-22T08:37:42.142 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.128+0000 7f98c2a1d800 1 -- 172.21.15.142:0/1676135916 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:40 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5565e4db80b0 con 0x5565e4db50d0 2024-09-22T08:37:42.142 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.128+0000 7f98be9ec640 1 -- 172.21.15.142:0/1676135916 <== osd.3 v2:172.21.15.142:6800/1064901393 11 ==== osd_op_reply(40 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f98b803a070 con 0x5565e4db50d0 2024-09-22T08:37:42.142 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.128+0000 7f98c2a1d800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:37:42.142 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.128+0000 7f98c2a1d800 20 zone default found 2024-09-22T08:37:42.142 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.128+0000 7f98c2a1d800 4 Realm: () 2024-09-22T08:37:42.142 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.128+0000 7f98c2a1d800 4 ZoneGroup: default (d89f6f57-1007-47dd-9065-f486c7b01aec) 2024-09-22T08:37:42.142 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.128+0000 7f98c2a1d800 4 Zone: default (e239248c-0bee-4e41-803a-24b288d3eb8f) 2024-09-22T08:37:42.142 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.128+0000 7f98c2a1d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:37:42.142 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.128+0000 7f98c2a1d800 20 zonegroup default 2024-09-22T08:37:42.142 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.128+0000 7f98c2a1d800 20 rados->read ofs=0 len=0 2024-09-22T08:37:42.143 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.128+0000 7f98c2a1d800 1 -- 172.21.15.142:0/1676135916 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5565e4db9cf0 con 0x7f98b0017050 2024-09-22T08:37:42.143 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.128+0000 7f98b59ea640 1 -- 172.21.15.142:0/1676135916 <== osd.0 v2:172.21.15.31:6800/168281188 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f98a8051070 con 0x7f98b0017050 2024-09-22T08:37:42.143 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.128+0000 7f98c2a1d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:42.143 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.128+0000 7f98c2a1d800 20 rados->read ofs=0 len=0 2024-09-22T08:37:42.143 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.128+0000 7f98c2a1d800 1 -- 172.21.15.142:0/1676135916 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5565e4dbbb80 con 0x5565e4db50d0 2024-09-22T08:37:42.143 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.129+0000 7f98be9ec640 1 -- 172.21.15.142:0/1676135916 <== osd.3 v2:172.21.15.142:6800/1064901393 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f98b803a070 con 0x5565e4db50d0 2024-09-22T08:37:42.143 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.129+0000 7f98c2a1d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:42.143 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.129+0000 7f98c2a1d800 20 rados->read ofs=0 len=0 2024-09-22T08:37:42.143 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.129+0000 7f98c2a1d800 1 -- 172.21.15.142:0/1676135916 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5565e4dbc040 con 0x5565e4db50d0 2024-09-22T08:37:42.143 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.129+0000 7f98be9ec640 1 -- 172.21.15.142:0/1676135916 <== osd.3 v2:172.21.15.142:6800/1064901393 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f98b803a070 con 0x5565e4db50d0 2024-09-22T08:37:42.143 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.129+0000 7f98c2a1d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:42.143 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.129+0000 7f98c2a1d800 20 started sync module instance, tier type = 2024-09-22T08:37:42.143 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.129+0000 7f98c2a1d800 20 started zone id=e239248c-0bee-4e41-803a-24b288d3eb8f (name=default) with tier type = 2024-09-22T08:37:42.143 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.129+0000 7f98c2a1d800 1 -- 172.21.15.142:0/1676135916 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5565e4dbaf20 con 0x7f98b801f560 2024-09-22T08:37:42.144 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.130+0000 7f98be1eb640 1 -- 172.21.15.142:0/1676135916 <== osd.2 v2:172.21.15.142:6808/279438927 7 ==== osd_op_reply(44 notify.0 [create] v32'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98b001ab20 con 0x7f98b801f560 2024-09-22T08:37:42.144 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.130+0000 7f98c2a1d800 1 -- 172.21.15.142:0/1676135916 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93896119661328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5565e4dbab80 con 0x7f98b801f560 2024-09-22T08:37:42.144 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.130+0000 7f98c2a1d800 1 -- 172.21.15.142:0/1676135916 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5565e4dbcf50 con 0x5565e4db06c0 2024-09-22T08:37:42.144 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.131+0000 7f98be1eb640 1 -- 172.21.15.142:0/1676135916 <== osd.2 v2:172.21.15.142:6808/279438927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93896119661328] v32'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98b001ab20 con 0x7f98b801f560 2024-09-22T08:37:42.144 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.131+0000 7f98b59ea640 1 -- 172.21.15.142:0/1676135916 <== osd.1 v2:172.21.15.142:6816/3192108003 16 ==== osd_op_reply(46 notify.1 [create] v32'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98a8051070 con 0x5565e4db06c0 2024-09-22T08:37:42.144 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.131+0000 7f98c2a1d800 1 -- 172.21.15.142:0/1676135916 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93896119667360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5565e4dbcec0 con 0x5565e4db06c0 2024-09-22T08:37:42.144 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.131+0000 7f98c2a1d800 1 -- 172.21.15.142:0/1676135916 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5565e4dbde10 con 0x5565e4db50d0 2024-09-22T08:37:42.144 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.132+0000 7f98b59ea640 1 -- 172.21.15.142:0/1676135916 <== osd.1 v2:172.21.15.142:6816/3192108003 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93896119667360] v32'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98a8051070 con 0x5565e4db06c0 2024-09-22T08:37:42.144 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.132+0000 7f98be9ec640 1 -- 172.21.15.142:0/1676135916 <== osd.3 v2:172.21.15.142:6800/1064901393 14 ==== osd_op_reply(48 notify.2 [create] v32'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98b803a070 con 0x5565e4db50d0 2024-09-22T08:37:42.144 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.132+0000 7f98c2a1d800 1 -- 172.21.15.142:0/1676135916 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93896119669568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5565e4dbde10 con 0x5565e4db50d0 2024-09-22T08:37:42.144 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.133+0000 7f98c2a1d800 1 -- 172.21.15.142:0/1676135916 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5565e4dbe880 con 0x7f98b801f560 2024-09-22T08:37:42.144 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.133+0000 7f98be1eb640 1 -- 172.21.15.142:0/1676135916 <== osd.2 v2:172.21.15.142:6808/279438927 9 ==== osd_op_reply(50 notify.3 [create] v32'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98b001ab20 con 0x7f98b801f560 2024-09-22T08:37:42.144 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.133+0000 7f98c2a1d800 1 -- 172.21.15.142:0/1676135916 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93896119673712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5565e4dbf120 con 0x7f98b801f560 2024-09-22T08:37:42.145 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.134+0000 7f98c2a1d800 1 -- 172.21.15.142:0/1676135916 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5565e4dbfc00 con 0x5565e4db06c0 2024-09-22T08:37:42.145 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.134+0000 7f98be9ec640 1 -- 172.21.15.142:0/1676135916 <== osd.3 v2:172.21.15.142:6800/1064901393 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 93896119669568] v32'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98b803a070 con 0x5565e4db50d0 2024-09-22T08:37:42.145 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.135+0000 7f98be1eb640 1 -- 172.21.15.142:0/1676135916 <== osd.2 v2:172.21.15.142:6808/279438927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93896119673712] v32'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98b001ab20 con 0x7f98b801f560 2024-09-22T08:37:42.145 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.135+0000 7f98b59ea640 1 -- 172.21.15.142:0/1676135916 <== osd.1 v2:172.21.15.142:6816/3192108003 18 ==== osd_op_reply(52 notify.4 [create] v32'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98a8051070 con 0x5565e4db06c0 2024-09-22T08:37:42.145 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.135+0000 7f98c2a1d800 1 -- 172.21.15.142:0/1676135916 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93896119676016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5565e4dbd960 con 0x5565e4db06c0 2024-09-22T08:37:42.145 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.135+0000 7f98c2a1d800 1 -- 172.21.15.142:0/1676135916 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5565e4dc04e0 con 0x7f98b0017050 2024-09-22T08:37:42.149 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.136+0000 7f98b59ea640 1 -- 172.21.15.142:0/1676135916 <== osd.0 v2:172.21.15.31:6800/168281188 10 ==== osd_op_reply(54 notify.5 [create] v32'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98a8051070 con 0x7f98b0017050 2024-09-22T08:37:42.149 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.136+0000 7f98c2a1d800 1 -- 172.21.15.142:0/1676135916 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93896119680880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5565e4dc0910 con 0x7f98b0017050 2024-09-22T08:37:42.150 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.136+0000 7f98c2a1d800 1 -- 172.21.15.142:0/1676135916 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5565e4dc1430 con 0x7f98b0017050 2024-09-22T08:37:42.150 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.136+0000 7f98b59ea640 1 -- 172.21.15.142:0/1676135916 <== osd.1 v2:172.21.15.142:6816/3192108003 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93896119676016] v32'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98a8051070 con 0x5565e4db06c0 2024-09-22T08:37:42.150 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.137+0000 7f98b59ea640 1 -- 172.21.15.142:0/1676135916 <== osd.0 v2:172.21.15.31:6800/168281188 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 93896119680880] v32'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98a8051070 con 0x7f98b0017050 2024-09-22T08:37:42.150 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.137+0000 7f98b59ea640 1 -- 172.21.15.142:0/1676135916 <== osd.0 v2:172.21.15.31:6800/168281188 12 ==== osd_op_reply(56 notify.6 [create] v32'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98a8051070 con 0x7f98b0017050 2024-09-22T08:37:42.150 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.137+0000 7f98c2a1d800 1 -- 172.21.15.142:0/1676135916 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93896119681936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5565e4dc13f0 con 0x7f98b0017050 2024-09-22T08:37:42.150 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.137+0000 7f98c2a1d800 1 -- 172.21.15.142:0/1676135916 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5565e4dc1860 con 0x7f98b0017050 2024-09-22T08:37:42.150 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.138+0000 7f98b59ea640 1 -- 172.21.15.142:0/1676135916 <== osd.0 v2:172.21.15.31:6800/168281188 13 ==== osd_op_reply(58 notify.7 [create] v32'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98a8051070 con 0x7f98b0017050 2024-09-22T08:37:42.150 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.138+0000 7f98c2a1d800 1 -- 172.21.15.142:0/1676135916 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93896119678736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5565e4dc1cc0 con 0x7f98b0017050 2024-09-22T08:37:42.150 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.138+0000 7f98c2a1d800 20 add_watcher() i=0 2024-09-22T08:37:42.150 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.138+0000 7f98c2a1d800 20 add_watcher() i=1 2024-09-22T08:37:42.150 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.138+0000 7f98c2a1d800 20 add_watcher() i=2 2024-09-22T08:37:42.150 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.138+0000 7f98c2a1d800 20 add_watcher() i=3 2024-09-22T08:37:42.150 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.138+0000 7f98c2a1d800 20 add_watcher() i=4 2024-09-22T08:37:42.151 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.138+0000 7f98c2a1d800 20 add_watcher() i=5 2024-09-22T08:37:42.151 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.138+0000 7f98b59ea640 1 -- 172.21.15.142:0/1676135916 <== osd.0 v2:172.21.15.31:6800/168281188 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93896119681936] v32'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98a8051070 con 0x7f98b0017050 2024-09-22T08:37:42.151 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.138+0000 7f98c2a1d800 20 add_watcher() i=6 2024-09-22T08:37:42.151 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.139+0000 7f98b59ea640 1 -- 172.21.15.142:0/1676135916 <== osd.0 v2:172.21.15.31:6800/168281188 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 93896119678736] v32'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98a8051070 con 0x7f98b0017050 2024-09-22T08:37:42.151 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.139+0000 7f98c2a1d800 20 add_watcher() i=7 2024-09-22T08:37:42.151 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.139+0000 7f98c2a1d800 2 all 8 watchers are set, enabling cache 2024-09-22T08:37:42.151 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.139+0000 7f98c2a1d800 1 -- 172.21.15.142:0/1676135916 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5565e4dc1870 con 0x5565e4db06c0 2024-09-22T08:37:42.151 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.139+0000 7f98b59ea640 1 -- 172.21.15.142:0/1676135916 <== osd.1 v2:172.21.15.142:6816/3192108003 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f98a8051070 con 0x5565e4db06c0 2024-09-22T08:37:42.151 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.139+0000 7f98c2a1d800 1 -- 172.21.15.142:0/1676135916 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93896119684864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5565e4dc2680 con 0x5565e4db06c0 2024-09-22T08:37:42.151 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.140+0000 7f98b59ea640 1 -- 172.21.15.142:0/1676135916 <== osd.1 v2:172.21.15.142:6816/3192108003 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93896119684864] v32'208 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f98a8051070 con 0x5565e4db06c0 2024-09-22T08:37:42.151 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.140+0000 7f9774fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:37:42.151 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.140+0000 7f98c2a1d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:37:42.151 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.140+0000 7f98c2a1d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:37:42.151 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.140+0000 7f98c2a1d800 5 note: GC not initialized 2024-09-22T08:37:42.152 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.141+0000 7f96ef7fe640 20 reqs_thread_entry: start 2024-09-22T08:37:42.152 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.141+0000 7f98c2a1d800 20 init_complete bucket index max shards: 11 2024-09-22T08:37:42.152 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.141+0000 7f98c2a1d800 20 Filter name: none 2024-09-22T08:37:42.152 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.141+0000 7f96ed7fa640 20 reqs_thread_entry: start 2024-09-22T08:37:42.152 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.141+0000 7f98c2a1d800 20 rados->read ofs=0 len=0 2024-09-22T08:37:42.152 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.141+0000 7f98c2a1d800 1 -- 172.21.15.142:0/1676135916 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5565e4df7cf0 con 0x5565e4db06c0 2024-09-22T08:37:42.152 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.141+0000 7f98b59ea640 1 -- 172.21.15.142:0/1676135916 <== osd.1 v2:172.21.15.142:6816/3192108003 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f98a8051070 con 0x5565e4db06c0 2024-09-22T08:37:42.152 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.141+0000 7f98c2a1d800 20 rados_obj.operate() r=0 bl.length=391 2024-09-22T08:37:42.152 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.141+0000 7f98c2a1d800 1 -- 172.21.15.142:0/1676135916 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5565e4df9270 con 0x7f98b0017050 2024-09-22T08:37:42.152 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.142+0000 7f98b59ea640 1 -- 172.21.15.142:0/1676135916 <== osd.0 v2:172.21.15.31:6800/168281188 16 ==== osd_op_reply(63 usage.10 [call out=1378b] v0'0 uv29 ondisk = 0) ==== 152+0+1378 (crc 0 0 0) 0x7f98a8051070 con 0x7f98b0017050 2024-09-22T08:37:42.152 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.143+0000 7f9774fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:37:42.152 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.143+0000 7f98c2a1d800 1 -- 172.21.15.142:0/1676135916 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93896119684864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5565e4df6230 con 0x5565e4db06c0 2024-09-22T08:37:42.152 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.144+0000 7f98b59ea640 1 -- 172.21.15.142:0/1676135916 <== osd.1 v2:172.21.15.142:6816/3192108003 23 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 93896119684864] v32'209 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f98a8051070 con 0x5565e4db06c0 2024-09-22T08:37:42.152 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.144+0000 7f98c2a1d800 1 -- 172.21.15.142:0/1676135916 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93896119661328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5565e4dc0f00 con 0x7f98b801f560 2024-09-22T08:37:42.153 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.145+0000 7f98be1eb640 1 -- 172.21.15.142:0/1676135916 <== osd.2 v2:172.21.15.142:6808/279438927 11 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 93896119661328] v32'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98b001ab20 con 0x7f98b801f560 2024-09-22T08:37:42.153 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.145+0000 7f98c2a1d800 20 remove_watcher() i=0 2024-09-22T08:37:42.153 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.145+0000 7f98c2a1d800 2 removed watcher, disabling cache 2024-09-22T08:37:42.153 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.145+0000 7f98c2a1d800 1 -- 172.21.15.142:0/1676135916 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93896119667360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5565e4dc0f00 con 0x5565e4db06c0 2024-09-22T08:37:42.153 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.146+0000 7f98b59ea640 1 -- 172.21.15.142:0/1676135916 <== osd.1 v2:172.21.15.142:6816/3192108003 24 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 93896119667360] v32'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98a8051070 con 0x5565e4db06c0 2024-09-22T08:37:42.153 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.146+0000 7f98c2a1d800 20 remove_watcher() i=1 2024-09-22T08:37:42.153 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.146+0000 7f98c2a1d800 1 -- 172.21.15.142:0/1676135916 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93896119669568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5565e4dbcaa0 con 0x5565e4db50d0 2024-09-22T08:37:42.153 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.147+0000 7f98be9ec640 1 -- 172.21.15.142:0/1676135916 <== osd.3 v2:172.21.15.142:6800/1064901393 16 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 93896119669568] v32'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98b803a070 con 0x5565e4db50d0 2024-09-22T08:37:42.153 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.147+0000 7f98c2a1d800 20 remove_watcher() i=2 2024-09-22T08:37:42.153 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.147+0000 7f98c2a1d800 1 -- 172.21.15.142:0/1676135916 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93896119673712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5565e4dc0f00 con 0x7f98b801f560 2024-09-22T08:37:42.153 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.148+0000 7f98be1eb640 1 -- 172.21.15.142:0/1676135916 <== osd.2 v2:172.21.15.142:6808/279438927 12 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 93896119673712] v32'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98b001ab20 con 0x7f98b801f560 2024-09-22T08:37:42.153 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.148+0000 7f98c2a1d800 20 remove_watcher() i=3 2024-09-22T08:37:42.153 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.148+0000 7f98c2a1d800 1 -- 172.21.15.142:0/1676135916 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93896119676016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5565e4dbd340 con 0x5565e4db06c0 2024-09-22T08:37:42.157 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.149+0000 7f98b59ea640 1 -- 172.21.15.142:0/1676135916 <== osd.1 v2:172.21.15.142:6816/3192108003 25 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 93896119676016] v32'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98a8051070 con 0x5565e4db06c0 2024-09-22T08:37:42.157 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.149+0000 7f98c2a1d800 20 remove_watcher() i=4 2024-09-22T08:37:42.157 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.149+0000 7f98c2a1d800 1 -- 172.21.15.142:0/1676135916 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93896119680880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5565e4dbcaa0 con 0x7f98b0017050 2024-09-22T08:37:42.157 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.150+0000 7f98b59ea640 1 -- 172.21.15.142:0/1676135916 <== osd.0 v2:172.21.15.31:6800/168281188 17 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 93896119680880] v32'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98a8051070 con 0x7f98b0017050 2024-09-22T08:37:42.157 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.150+0000 7f98c2a1d800 20 remove_watcher() i=5 2024-09-22T08:37:42.157 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.150+0000 7f98c2a1d800 1 -- 172.21.15.142:0/1676135916 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93896119681936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5565e4dc0f00 con 0x7f98b0017050 2024-09-22T08:37:42.157 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.151+0000 7f98b59ea640 1 -- 172.21.15.142:0/1676135916 <== osd.0 v2:172.21.15.31:6800/168281188 18 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 93896119681936] v32'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98a8051070 con 0x7f98b0017050 2024-09-22T08:37:42.157 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.151+0000 7f98c2a1d800 20 remove_watcher() i=6 2024-09-22T08:37:42.157 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.151+0000 7f98c2a1d800 1 -- 172.21.15.142:0/1676135916 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93896119678736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5565e4dbd340 con 0x7f98b0017050 2024-09-22T08:37:42.157 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.152+0000 7f98b59ea640 1 -- 172.21.15.142:0/1676135916 <== osd.0 v2:172.21.15.31:6800/168281188 19 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 93896119678736] v32'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98a8051070 con 0x7f98b0017050 2024-09-22T08:37:42.158 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.152+0000 7f98c2a1d800 20 remove_watcher() i=7 2024-09-22T08:37:42.158 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.152+0000 7f98c2a1d800 1 -- 172.21.15.142:0/1676135916 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f98b0017050 msgr2=0x7f98b004b890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:42.158 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.152+0000 7f98c2a1d800 1 --2- 172.21.15.142:0/1676135916 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f98b0017050 0x7f98b004b890 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:42.158 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.152+0000 7f98c2a1d800 1 -- 172.21.15.142:0/1676135916 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5565e4db06c0 msgr2=0x5565e4db2b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:42.158 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.152+0000 7f98c2a1d800 1 --2- 172.21.15.142:0/1676135916 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5565e4db06c0 0x5565e4db2b80 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:42.158 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.152+0000 7f98c2a1d800 1 -- 172.21.15.142:0/1676135916 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f98b801f560 msgr2=0x7f98b8047a60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:42.158 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.152+0000 7f98c2a1d800 1 --2- 172.21.15.142:0/1676135916 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f98b801f560 0x7f98b8047a60 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:42.158 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.152+0000 7f98c2a1d800 1 -- 172.21.15.142:0/1676135916 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5565e4db50d0 msgr2=0x5565e4db74c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:42.158 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.152+0000 7f98c2a1d800 1 --2- 172.21.15.142:0/1676135916 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5565e4db50d0 0x5565e4db74c0 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:42.158 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.153+0000 7f98c2a1d800 1 -- 172.21.15.142:0/1676135916 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f978803cfb0 msgr2=0x7f978803f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:42.158 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.153+0000 7f98c2a1d800 1 --2- 172.21.15.142:0/1676135916 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f978803cfb0 0x7f978803f470 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f98b0001250 tx=0x7f98b0051000 comp rx=0 tx=0).stop 2024-09-22T08:37:42.158 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.153+0000 7f98c2a1d800 1 -- 172.21.15.142:0/1676135916 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5565e4d9d7f0 msgr2=0x5565e4da4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:42.158 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.153+0000 7f98b59ea640 1 -- 172.21.15.142:0/1676135916 reap_dead start 2024-09-22T08:37:42.158 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.153+0000 7f98c2a1d800 1 --2- 172.21.15.142:0/1676135916 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5565e4d9d7f0 0x5565e4da4dd0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f98b80114f0 tx=0x7f98b8054870 comp rx=0 tx=0).stop 2024-09-22T08:37:42.159 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.153+0000 7f98c2a1d800 1 -- 172.21.15.142:0/1676135916 shutdown_connections 2024-09-22T08:37:42.159 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.153+0000 7f98c2a1d800 1 --2- 172.21.15.142:0/1676135916 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5565e4d9d7f0 0x5565e4da4dd0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:42.159 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.153+0000 7f98c2a1d800 1 -- 172.21.15.142:0/1676135916 >> 172.21.15.142:0/1676135916 conn(0x5565e4d99bf0 msgr2=0x5565e4d97e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:37:42.159 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.153+0000 7f98c2a1d800 1 -- 172.21.15.142:0/1676135916 shutdown_connections 2024-09-22T08:37:42.159 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.153+0000 7f98c2a1d800 1 -- 172.21.15.142:0/1676135916 wait complete. 2024-09-22T08:37:42.159 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.153+0000 7f98c2a1d800 1 -- 172.21.15.142:0/1375444648 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f979803cfb0 msgr2=0x7f979803f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:42.159 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.153+0000 7f98c2a1d800 1 --2- 172.21.15.142:0/1375444648 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f979803cfb0 0x7f979803f470 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x5565e4d77e40 tx=0x7f98b00529c0 comp rx=0 tx=0).stop 2024-09-22T08:37:42.159 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.153+0000 7f98c2a1d800 1 -- 172.21.15.142:0/1375444648 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5565e4d90d30 msgr2=0x5565e4d91150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:42.159 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.153+0000 7f98c2a1d800 1 --2- 172.21.15.142:0/1375444648 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5565e4d90d30 0x5565e4d91150 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x5565e4d76bd0 tx=0x7f98b80167b0 comp rx=0 tx=0).stop 2024-09-22T08:37:42.159 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.153+0000 7f98c2a1d800 1 -- 172.21.15.142:0/1375444648 shutdown_connections 2024-09-22T08:37:42.159 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.153+0000 7f98c2a1d800 1 --2- 172.21.15.142:0/1375444648 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f979803cfb0 0x7f979803f470 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:42.159 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.153+0000 7f98c2a1d800 1 --2- 172.21.15.142:0/1375444648 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5565e4d90d30 0x5565e4d91150 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:42.159 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.153+0000 7f98c2a1d800 1 -- 172.21.15.142:0/1375444648 >> 172.21.15.142:0/1375444648 conn(0x5565e4d850e0 msgr2=0x5565e4d854c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:37:42.160 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.153+0000 7f98c2a1d800 1 -- 172.21.15.142:0/1375444648 shutdown_connections 2024-09-22T08:37:42.160 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.153+0000 7f98c2a1d800 1 -- 172.21.15.142:0/1375444648 wait complete. 2024-09-22T08:37:42.160 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.153+0000 7f98c2a1d800 1 -- 172.21.15.142:0/2081757711 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5565e4c82c00 msgr2=0x5565e4d7d390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:42.160 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.153+0000 7f98c2a1d800 1 --2- 172.21.15.142:0/2081757711 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5565e4c82c00 0x5565e4d7d390 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:42.160 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.153+0000 7f98c2a1d800 1 -- 172.21.15.142:0/2081757711 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5565e4d7f730 msgr2=0x5565e4d81bd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:42.160 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.153+0000 7f98c2a1d800 1 --2- 172.21.15.142:0/2081757711 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5565e4d7f730 0x5565e4d81bd0 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:42.160 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.154+0000 7f98c2a1d800 1 -- 172.21.15.142:0/2081757711 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f97a403cfb0 msgr2=0x7f97a403f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:42.160 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.154+0000 7f98c2a1d800 1 --2- 172.21.15.142:0/2081757711 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f97a403cfb0 0x7f97a403f470 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f98a8057000 tx=0x7f98a8052000 comp rx=0 tx=0).stop 2024-09-22T08:37:42.160 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.154+0000 7f98c2a1d800 1 -- 172.21.15.142:0/2081757711 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5565e4bf0530 msgr2=0x5565e4d75d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:42.160 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.154+0000 7f98c2a1d800 1 --2- 172.21.15.142:0/2081757711 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5565e4bf0530 0x5565e4d75d40 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f98b000c010 tx=0x7f98b0000ed0 comp rx=0 tx=0).stop 2024-09-22T08:37:42.160 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.154+0000 7f98c2a1d800 1 -- 172.21.15.142:0/2081757711 shutdown_connections 2024-09-22T08:37:42.160 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.154+0000 7f98c2a1d800 1 --2- 172.21.15.142:0/2081757711 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5565e4d7f730 0x5565e4d81bd0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:42.160 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.154+0000 7f98c2a1d800 1 --2- 172.21.15.142:0/2081757711 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5565e4c82c00 0x5565e4d7d390 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:42.160 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.154+0000 7f98c2a1d800 1 --2- 172.21.15.142:0/2081757711 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f97a403cfb0 0x7f97a403f470 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:42.160 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.154+0000 7f98c2a1d800 1 --2- 172.21.15.142:0/2081757711 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5565e4bf0530 0x5565e4d75d40 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:42.160 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.154+0000 7f98c2a1d800 1 -- 172.21.15.142:0/2081757711 >> 172.21.15.142:0/2081757711 conn(0x5565e4c76be0 msgr2=0x5565e4d6f710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:37:42.161 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.154+0000 7f98c2a1d800 1 -- 172.21.15.142:0/2081757711 shutdown_connections 2024-09-22T08:37:42.161 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.154+0000 7f98c2a1d800 1 -- 172.21.15.142:0/2081757711 wait complete. 2024-09-22T08:37:42.164 INFO:teuthology.orchestra.run.smithi142.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-09-22T08:00:00.000000Z","epoch":1726992000,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo","time":"2024-09-22T08:00:00.000000Z","epoch":1726992000,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":2,"successful_ops":1}],"s3select":{}},{"bucket":"myfoo2","time":"2024-09-22T08:00:00.000000Z","epoch":1726992000,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{}},{"bucket":"myfoo3","time":"2024-09-22T08:00:00.000000Z","epoch":1726992000,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{}},{"bucket":"myfoo4","time":"2024-09-22T08:00:00.000000Z","epoch":1726992000,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{}}]}],"summary":[{"user":"foo","categories":[{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4}],"total":{"bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4,"bytes_processed":0,"bytes_returned":0}}]} 2024-09-22T08:37:42.164 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-22T08:00:00.000000Z', 'epoch': 1726992000, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo', 'time': '2024-09-22T08:00:00.000000Z', 'epoch': 1726992000, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 2, 'successful_ops': 1}], 's3select': {}}, {'bucket': 'myfoo2', 'time': '2024-09-22T08:00:00.000000Z', 'epoch': 1726992000, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}, {'bucket': 'myfoo3', 'time': '2024-09-22T08:00:00.000000Z', 'epoch': 1726992000, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}, {'bucket': 'myfoo4', 'time': '2024-09-22T08:00:00.000000Z', 'epoch': 1726992000, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}], 'total': {'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-22T08:37:42.164 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'bar', '--display-name', 'Bar', '--access-key', 'NX5QOQKC6BH2IDN8HC7A', '--secret', 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', '--max-buckets', '4'] 2024-09-22T08:37:42.164 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'bar', '--display-name', 'Bar', '--access-key', 'NX5QOQKC6BH2IDN8HC7A', '--secret', 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', '--max-buckets', '4'] 2024-09-22T08:37:42.164 DEBUG:teuthology.orchestra.run.smithi142:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid bar --display-name Bar --access-key NX5QOQKC6BH2IDN8HC7A --secret LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn --max-buckets 4 2024-09-22T08:37:42.217 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:37:42.217 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:37:42.218 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.216+0000 7fc2c8b75800 1 Processor -- start 2024-09-22T08:37:42.218 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.217+0000 7fc2c8b75800 1 -- start start 2024-09-22T08:37:42.218 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.217+0000 7fc2c8b75800 1 --2- >> v2:172.21.15.31:3300/0 conn(0x559a98b4a820 0x559a98b4b520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:42.218 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.217+0000 7fc2c8b75800 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x559a989d6a20 con 0x559a98b4ba60 2024-09-22T08:37:42.218 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.217+0000 7fc2c8b75800 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x559a989d67d0 con 0x559a98b4a820 2024-09-22T08:37:42.218 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.217+0000 7fc2c665f640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x559a98b4a820 0x559a98b4b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:42.219 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.217+0000 7fc2bde5e640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x559a98b4ba60 0x559a98b505b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.142:50290/0 (socket says 172.21.15.142:50290) 2024-09-22T08:37:42.219 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.217+0000 7fc2bde5e640 1 -- 172.21.15.142:0/430520278 learned_addr learned my addr 172.21.15.142:0/430520278 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-09-22T08:37:42.219 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.217+0000 7fc2c665f640 1 -- 172.21.15.142:0/430520278 >> v1:172.21.15.31:6789/0 conn(0x559a98b4ba60 legacy=0x559a98b505b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:42.219 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.217+0000 7fc2c665f640 1 -- 172.21.15.142:0/430520278 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x559a98b4af20 con 0x559a98b4a820 2024-09-22T08:37:42.221 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.219+0000 7fc2c665f640 1 --2- 172.21.15.142:0/430520278 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559a98b4a820 0x559a98b4b520 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fc2b800a470 tx=0x7fc2b8045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=628e37b3c39ea1b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:42.221 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.219+0000 7fc2c5e5e640 1 -- 172.21.15.142:0/430520278 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2b8053570 con 0x559a98b4a820 2024-09-22T08:37:42.221 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.219+0000 7fc2c5e5e640 1 -- 172.21.15.142:0/430520278 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2b8058070 con 0x559a98b4a820 2024-09-22T08:37:42.221 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.219+0000 7fc2c5e5e640 1 -- 172.21.15.142:0/430520278 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2b8053880 con 0x559a98b4a820 2024-09-22T08:37:42.221 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.220+0000 7fc2c8b75800 1 -- 172.21.15.142:0/430520278 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559a98b4a820 msgr2=0x559a98b4b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:42.221 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.220+0000 7fc2c8b75800 1 --2- 172.21.15.142:0/430520278 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559a98b4a820 0x559a98b4b520 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fc2b800a470 tx=0x7fc2b8045a20 comp rx=0 tx=0).stop 2024-09-22T08:37:42.222 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.220+0000 7fc2c8b75800 1 -- 172.21.15.142:0/430520278 shutdown_connections 2024-09-22T08:37:42.222 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.220+0000 7fc2c8b75800 1 --2- 172.21.15.142:0/430520278 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559a98b4a820 0x559a98b4b520 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:42.222 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.220+0000 7fc2c8b75800 1 -- 172.21.15.142:0/430520278 >> 172.21.15.142:0/430520278 conn(0x559a98b45bf0 msgr2=0x559a98b48050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:37:42.222 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.220+0000 7fc2c8b75800 1 -- 172.21.15.142:0/430520278 shutdown_connections 2024-09-22T08:37:42.222 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.220+0000 7fc2c8b75800 1 -- 172.21.15.142:0/430520278 wait complete. 2024-09-22T08:37:42.235 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.234+0000 7fc2c8b75800 1 Processor -- start 2024-09-22T08:37:42.235 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.234+0000 7fc2c8b75800 1 -- start start 2024-09-22T08:37:42.236 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.234+0000 7fc2c8b75800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559a98b4a820 0x559a98c3a010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:42.236 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.234+0000 7fc2c8b75800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x559a989e3dd0 con 0x559a98b4a820 2024-09-22T08:37:42.236 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.234+0000 7fc2c665f640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559a98b4a820 0x559a98c3a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:42.236 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.234+0000 7fc2c665f640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559a98b4a820 0x559a98c3a010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:55864/0 (socket says 172.21.15.142:55864) 2024-09-22T08:37:42.236 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.234+0000 7fc2c665f640 1 -- 172.21.15.142:0/1699112185 learned_addr learned my addr 172.21.15.142:0/1699112185 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:37:42.236 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.235+0000 7fc2c665f640 1 -- 172.21.15.142:0/1699112185 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559a98c3a600 con 0x559a98b4a820 2024-09-22T08:37:42.238 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.235+0000 7fc2c665f640 1 --2- 172.21.15.142:0/1699112185 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559a98b4a820 0x559a98c3a010 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fc2b8025c20 tx=0x7fc2b8051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5c6941dc9354462 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:42.238 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.235+0000 7fc1b4608640 1 -- 172.21.15.142:0/1699112185 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2b805e2c0 con 0x559a98b4a820 2024-09-22T08:37:42.238 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.235+0000 7fc1b4608640 1 -- 172.21.15.142:0/1699112185 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2b805e8b0 con 0x559a98b4a820 2024-09-22T08:37:42.238 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.235+0000 7fc1b4608640 1 -- 172.21.15.142:0/1699112185 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2b805eb90 con 0x559a98b4a820 2024-09-22T08:37:42.238 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.236+0000 7fc2c8b75800 1 -- 172.21.15.142:0/1699112185 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559a98b4a820 msgr2=0x559a98c3a010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:42.238 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.236+0000 7fc2c8b75800 1 --2- 172.21.15.142:0/1699112185 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559a98b4a820 0x559a98c3a010 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fc2b8025c20 tx=0x7fc2b8051000 comp rx=0 tx=0).stop 2024-09-22T08:37:42.238 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.236+0000 7fc2c8b75800 1 -- 172.21.15.142:0/1699112185 shutdown_connections 2024-09-22T08:37:42.238 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.236+0000 7fc2c8b75800 1 --2- 172.21.15.142:0/1699112185 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559a98b4a820 0x559a98c3a010 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:42.238 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.236+0000 7fc2c8b75800 1 -- 172.21.15.142:0/1699112185 >> 172.21.15.142:0/1699112185 conn(0x559a98b45bf0 msgr2=0x559a98c35990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:37:42.238 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.236+0000 7fc2c8b75800 1 -- 172.21.15.142:0/1699112185 shutdown_connections 2024-09-22T08:37:42.239 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.236+0000 7fc2c8b75800 1 -- 172.21.15.142:0/1699112185 wait complete. 2024-09-22T08:37:42.239 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.236+0000 7fc2c8b75800 1 Processor -- start 2024-09-22T08:37:42.239 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.236+0000 7fc2c8b75800 1 -- start start 2024-09-22T08:37:42.239 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.236+0000 7fc2c8b75800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559a98b4a820 0x559a98c40910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:42.239 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.236+0000 7fc2c8b75800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x559a98b4c2d0 con 0x559a98b4a820 2024-09-22T08:37:42.239 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.236+0000 7fc2c665f640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559a98b4a820 0x559a98c40910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:42.239 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.236+0000 7fc2c665f640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559a98b4a820 0x559a98c40910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:55872/0 (socket says 172.21.15.142:55872) 2024-09-22T08:37:42.239 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.236+0000 7fc2c665f640 1 -- 172.21.15.142:0/1510099019 learned_addr learned my addr 172.21.15.142:0/1510099019 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:37:42.239 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.237+0000 7fc2c665f640 1 -- 172.21.15.142:0/1510099019 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559a98c40e70 con 0x559a98b4a820 2024-09-22T08:37:42.239 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.237+0000 7fc2c665f640 1 --2- 172.21.15.142:0/1510099019 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559a98b4a820 0x559a98c40910 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fc2b8025c20 tx=0x7fc2b8002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:42.242 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.237+0000 7fc1b2e05640 1 -- 172.21.15.142:0/1510099019 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2b805ed50 con 0x559a98b4a820 2024-09-22T08:37:42.242 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.237+0000 7fc1b2e05640 1 -- 172.21.15.142:0/1510099019 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2b8075070 con 0x559a98b4a820 2024-09-22T08:37:42.242 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.237+0000 7fc2c8b75800 1 -- 172.21.15.142:0/1510099019 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559a98c41100 con 0x559a98b4a820 2024-09-22T08:37:42.242 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.237+0000 7fc1b2e05640 1 -- 172.21.15.142:0/1510099019 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2b805c650 con 0x559a98b4a820 2024-09-22T08:37:42.242 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.237+0000 7fc2c8b75800 1 -- 172.21.15.142:0/1510099019 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559a98c41a80 con 0x559a98b4a820 2024-09-22T08:37:42.242 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.238+0000 7fc1b2e05640 1 -- 172.21.15.142:0/1510099019 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fc2b805c7f0 con 0x559a98b4a820 2024-09-22T08:37:42.242 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.238+0000 7fc1b2e05640 1 --2- 172.21.15.142:0/1510099019 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fc1ac03d000 0x7fc1ac03f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:42.242 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.238+0000 7fc1b2e05640 1 -- 172.21.15.142:0/1510099019 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5938+0+0 (secure 0 0 0) 0x7fc2b806d040 con 0x559a98b4a820 2024-09-22T08:37:42.242 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.238+0000 7fc2bde5e640 1 --2- 172.21.15.142:0/1510099019 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fc1ac03d000 0x7fc1ac03f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:42.243 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.238+0000 7fc2c8b75800 1 --2- 172.21.15.142:0/1510099019 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x559a98b4ba60 0x559a98c47f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:42.243 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.238+0000 7fc2c8b75800 1 -- 172.21.15.142:0/1510099019 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559a98c484a0 con 0x559a98b4ba60 2024-09-22T08:37:42.243 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.239+0000 7fc2c6e60640 1 --2- 172.21.15.142:0/1510099019 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x559a98b4ba60 0x559a98c47f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:42.243 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.239+0000 7fc2bde5e640 1 --2- 172.21.15.142:0/1510099019 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fc1ac03d000 0x7fc1ac03f4c0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fc2b0001d70 tx=0x7fc2b00012d0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:42.243 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.239+0000 7fc2c6e60640 1 --2- 172.21.15.142:0/1510099019 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x559a98b4ba60 0x559a98c47f60 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:42.243 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.239+0000 7fc2c6e60640 1 -- 172.21.15.142:0/1510099019 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc2c000a4d0 con 0x559a98b4ba60 2024-09-22T08:37:42.243 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.239+0000 7fc2c8b75800 1 -- 172.21.15.142:0/1510099019 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559a98c48840 con 0x559a98b4ba60 2024-09-22T08:37:42.243 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.239+0000 7fc2c6e60640 1 -- 172.21.15.142:0/1510099019 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc2c000a4d0 con 0x559a98b4ba60 2024-09-22T08:37:42.243 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.239+0000 7fc2c8b75800 1 --2- 172.21.15.142:0/1510099019 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x559a98c4a340 0x559a98c4c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:42.243 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.239+0000 7fc2c8b75800 1 -- 172.21.15.142:0/1510099019 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:3 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559a98c4cf50 con 0x559a98c4a340 2024-09-22T08:37:42.243 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.240+0000 7fc2c665f640 1 --2- 172.21.15.142:0/1510099019 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x559a98c4a340 0x559a98c4c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:42.243 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.240+0000 7fc2c665f640 1 --2- 172.21.15.142:0/1510099019 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x559a98c4a340 0x559a98c4c7c0 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:42.243 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.240+0000 7fc2c665f640 1 -- 172.21.15.142:0/1510099019 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(3 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fc2b8051070 con 0x559a98c4a340 2024-09-22T08:37:42.244 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.240+0000 7fc2c8b75800 1 -- 172.21.15.142:0/1510099019 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559a98c49090 con 0x559a98b4ba60 2024-09-22T08:37:42.244 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.240+0000 7fc2c6e60640 1 -- 172.21.15.142:0/1510099019 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc2c000a4d0 con 0x559a98b4ba60 2024-09-22T08:37:42.244 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.240+0000 7fc2c8b75800 1 -- 172.21.15.142:0/1510099019 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559a98c494e0 con 0x559a98c4a340 2024-09-22T08:37:42.244 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.241+0000 7fc2c665f640 1 -- 172.21.15.142:0/1510099019 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(5 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fc2b8051070 con 0x559a98c4a340 2024-09-22T08:37:42.244 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.241+0000 7fc2c8b75800 1 Processor -- start 2024-09-22T08:37:42.244 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.241+0000 7fc2c8b75800 1 -- start start 2024-09-22T08:37:42.248 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.241+0000 7fc2c8b75800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559a98c5fd20 0x559a98c60140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:42.248 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.241+0000 7fc2c8b75800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x559a98a42d50 con 0x559a98c5fd20 2024-09-22T08:37:42.248 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.241+0000 7fc2c6e60640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559a98c5fd20 0x559a98c60140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:42.248 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.242+0000 7fc2c6e60640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559a98c5fd20 0x559a98c60140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:55884/0 (socket says 172.21.15.142:55884) 2024-09-22T08:37:42.248 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.242+0000 7fc2c6e60640 1 -- 172.21.15.142:0/4241343373 learned_addr learned my addr 172.21.15.142:0/4241343373 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:37:42.248 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.242+0000 7fc2c6e60640 1 -- 172.21.15.142:0/4241343373 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559a98c60780 con 0x559a98c5fd20 2024-09-22T08:37:42.248 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.242+0000 7fc2c6e60640 1 --2- 172.21.15.142:0/4241343373 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559a98c5fd20 0x559a98c60140 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x559a98c41910 tx=0x7fc2c00167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:42.248 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.242+0000 7fc1abfff640 1 -- 172.21.15.142:0/4241343373 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2c0013640 con 0x559a98c5fd20 2024-09-22T08:37:42.248 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.242+0000 7fc1abfff640 1 -- 172.21.15.142:0/4241343373 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2c00137e0 con 0x559a98c5fd20 2024-09-22T08:37:42.248 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.242+0000 7fc1abfff640 1 -- 172.21.15.142:0/4241343373 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2c0013ae0 con 0x559a98c5fd20 2024-09-22T08:37:42.248 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.242+0000 7fc2c8b75800 1 -- 172.21.15.142:0/4241343373 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559a98c60fb0 con 0x559a98c5fd20 2024-09-22T08:37:42.249 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.242+0000 7fc2c8b75800 1 -- 172.21.15.142:0/4241343373 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559a98c61550 con 0x559a98c5fd20 2024-09-22T08:37:42.249 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.243+0000 7fc1abfff640 1 -- 172.21.15.142:0/4241343373 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fc2c0011040 con 0x559a98c5fd20 2024-09-22T08:37:42.249 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.243+0000 7fc1abfff640 1 --2- 172.21.15.142:0/4241343373 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fc1a003cfb0 0x7fc1a003f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:42.249 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.243+0000 7fc1abfff640 1 -- 172.21.15.142:0/4241343373 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5938+0+0 (secure 0 0 0) 0x7fc2c000e040 con 0x559a98c5fd20 2024-09-22T08:37:42.249 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.243+0000 7fc2c665f640 1 --2- 172.21.15.142:0/4241343373 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fc1a003cfb0 0x7fc1a003f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:42.249 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.243+0000 7fc2c8b75800 1 Processor -- start 2024-09-22T08:37:42.249 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.244+0000 7fc2c665f640 1 --2- 172.21.15.142:0/4241343373 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fc1a003cfb0 0x7fc1a003f470 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fc2b807b030 tx=0x7fc2b805eef0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:42.249 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.244+0000 7fc2c8b75800 1 -- start start 2024-09-22T08:37:42.249 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.244+0000 7fc2c8b75800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559a98c6c7a0 0x559a98c6cba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:42.249 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.244+0000 7fc2c8b75800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x559a98c3a970 con 0x559a98c6c7a0 2024-09-22T08:37:42.249 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.244+0000 7fc2c6e60640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559a98c6c7a0 0x559a98c6cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:42.249 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.244+0000 7fc2c6e60640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559a98c6c7a0 0x559a98c6cba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:55900/0 (socket says 172.21.15.142:55900) 2024-09-22T08:37:42.249 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.244+0000 7fc2c6e60640 1 -- 172.21.15.142:0/324956979 learned_addr learned my addr 172.21.15.142:0/324956979 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:37:42.249 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.244+0000 7fc2c6e60640 1 -- 172.21.15.142:0/324956979 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559a98c6d190 con 0x559a98c6c7a0 2024-09-22T08:37:42.249 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.244+0000 7fc2c6e60640 1 --2- 172.21.15.142:0/324956979 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559a98c6c7a0 0x559a98c6cba0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fc2c0054840 tx=0x7fc2c0014480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80cb06d21f2fbe5b server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:42.250 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.245+0000 7fc1a9ffb640 1 -- 172.21.15.142:0/324956979 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2c00561a0 con 0x559a98c6c7a0 2024-09-22T08:37:42.250 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.245+0000 7fc1a9ffb640 1 -- 172.21.15.142:0/324956979 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2c0052070 con 0x559a98c6c7a0 2024-09-22T08:37:42.250 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.245+0000 7fc1a9ffb640 1 -- 172.21.15.142:0/324956979 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2c0021a80 con 0x559a98c6c7a0 2024-09-22T08:37:42.250 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.245+0000 7fc2c8b75800 1 -- 172.21.15.142:0/324956979 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559a98c6c7a0 msgr2=0x559a98c6cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:42.250 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.245+0000 7fc2c8b75800 1 --2- 172.21.15.142:0/324956979 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559a98c6c7a0 0x559a98c6cba0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fc2c0054840 tx=0x7fc2c0014480 comp rx=0 tx=0).stop 2024-09-22T08:37:42.250 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.245+0000 7fc2c8b75800 1 -- 172.21.15.142:0/324956979 shutdown_connections 2024-09-22T08:37:42.250 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.245+0000 7fc2c8b75800 1 --2- 172.21.15.142:0/324956979 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559a98c6c7a0 0x559a98c6cba0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:42.250 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.245+0000 7fc2c8b75800 1 -- 172.21.15.142:0/324956979 >> 172.21.15.142:0/324956979 conn(0x559a98c68be0 msgr2=0x559a98c66e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:37:42.250 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.245+0000 7fc2c8b75800 1 -- 172.21.15.142:0/324956979 shutdown_connections 2024-09-22T08:37:42.250 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.245+0000 7fc2c8b75800 1 -- 172.21.15.142:0/324956979 wait complete. 2024-09-22T08:37:42.250 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.245+0000 7fc2c8b75800 1 Processor -- start 2024-09-22T08:37:42.250 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.245+0000 7fc2c8b75800 1 -- start start 2024-09-22T08:37:42.250 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.245+0000 7fc2c8b75800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559a98c6c7a0 0x559a98c73d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:42.250 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.245+0000 7fc2c8b75800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x559a98c6d780 con 0x559a98c6c7a0 2024-09-22T08:37:42.251 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.246+0000 7fc2c6e60640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559a98c6c7a0 0x559a98c73d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:42.251 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.246+0000 7fc2c6e60640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559a98c6c7a0 0x559a98c73d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:55902/0 (socket says 172.21.15.142:55902) 2024-09-22T08:37:42.251 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.246+0000 7fc2c6e60640 1 -- 172.21.15.142:0/396702845 learned_addr learned my addr 172.21.15.142:0/396702845 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:37:42.251 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.246+0000 7fc2c6e60640 1 -- 172.21.15.142:0/396702845 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559a98c742d0 con 0x559a98c6c7a0 2024-09-22T08:37:42.251 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.246+0000 7fc2c6e60640 1 --2- 172.21.15.142:0/396702845 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559a98c6c7a0 0x559a98c73d70 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fc2c0020790 tx=0x7fc2c00547a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:42.251 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.246+0000 7fc197fff640 1 -- 172.21.15.142:0/396702845 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2c0013c80 con 0x559a98c6c7a0 2024-09-22T08:37:42.251 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.246+0000 7fc2c8b75800 1 -- 172.21.15.142:0/396702845 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559a98c74560 con 0x559a98c6c7a0 2024-09-22T08:37:42.251 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.246+0000 7fc197fff640 1 -- 172.21.15.142:0/396702845 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2c0013e40 con 0x559a98c6c7a0 2024-09-22T08:37:42.251 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.246+0000 7fc2c8b75800 1 -- 172.21.15.142:0/396702845 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559a98c750f0 con 0x559a98c6c7a0 2024-09-22T08:37:42.251 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.246+0000 7fc197fff640 1 -- 172.21.15.142:0/396702845 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2c001f830 con 0x559a98c6c7a0 2024-09-22T08:37:42.252 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.248+0000 7fc2c8b75800 20 rados->read ofs=0 len=0 2024-09-22T08:37:42.256 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.251+0000 7fc197fff640 1 -- 172.21.15.142:0/396702845 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fc2c00459e0 con 0x559a98c6c7a0 2024-09-22T08:37:42.256 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.251+0000 7fc197fff640 1 --2- 172.21.15.142:0/396702845 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fc19003cf60 0x7fc19003f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:42.256 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.251+0000 7fc197fff640 1 -- 172.21.15.142:0/396702845 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5938+0+0 (secure 0 0 0) 0x7fc2c0004a80 con 0x559a98c6c7a0 2024-09-22T08:37:42.256 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.252+0000 7fc2c665f640 1 --2- 172.21.15.142:0/396702845 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fc19003cf60 0x7fc19003f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:42.256 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.252+0000 7fc2c8b75800 1 --2- 172.21.15.142:0/396702845 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x559a98c7f720 0x559a98c81bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:42.256 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.252+0000 7fc2c8b75800 1 -- 172.21.15.142:0/396702845 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559a98c82300 con 0x559a98c7f720 2024-09-22T08:37:42.257 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.252+0000 7fc2bde5e640 1 --2- 172.21.15.142:0/396702845 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x559a98c7f720 0x559a98c81bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:42.257 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.252+0000 7fc2c665f640 1 --2- 172.21.15.142:0/396702845 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fc19003cf60 0x7fc19003f420 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fc2b8052f70 tx=0x7fc2b8088000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:42.257 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.252+0000 7fc2bde5e640 1 --2- 172.21.15.142:0/396702845 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x559a98c7f720 0x559a98c81bb0 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:42.257 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.252+0000 7fc2bde5e640 1 -- 172.21.15.142:0/396702845 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc2b0009050 con 0x559a98c7f720 2024-09-22T08:37:42.257 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.252+0000 7fc2c8b75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:42.257 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.252+0000 7fc2c8b75800 20 realm 2024-09-22T08:37:42.257 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.252+0000 7fc2c8b75800 20 rados->read ofs=0 len=0 2024-09-22T08:37:42.257 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.252+0000 7fc2c8b75800 1 -- 172.21.15.142:0/396702845 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559a98c7eaf0 con 0x559a98c7f720 2024-09-22T08:37:42.257 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.252+0000 7fc2bde5e640 1 -- 172.21.15.142:0/396702845 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc2b0009050 con 0x559a98c7f720 2024-09-22T08:37:42.257 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.252+0000 7fc2c8b75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:42.257 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.252+0000 7fc2c8b75800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:37:42.257 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.252+0000 7fc2c8b75800 20 rados->read ofs=0 len=0 2024-09-22T08:37:42.257 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.252+0000 7fc2c8b75800 1 -- 172.21.15.142:0/396702845 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559a98c82df0 con 0x559a98c7f720 2024-09-22T08:37:42.257 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.253+0000 7fc2bde5e640 1 -- 172.21.15.142:0/396702845 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc2b0009050 con 0x559a98c7f720 2024-09-22T08:37:42.258 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.253+0000 7fc2c8b75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:42.258 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.253+0000 7fc2c8b75800 20 rados->read ofs=0 len=0 2024-09-22T08:37:42.258 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.253+0000 7fc2c8b75800 1 -- 172.21.15.142:0/396702845 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559a98c836c0 con 0x559a98c7f720 2024-09-22T08:37:42.258 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.253+0000 7fc2bde5e640 1 -- 172.21.15.142:0/396702845 <== osd.1 v2:172.21.15.142:6816/3192108003 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc2b0009050 con 0x559a98c7f720 2024-09-22T08:37:42.258 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.253+0000 7fc2c8b75800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:37:42.258 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.253+0000 7fc2c8b75800 20 rados->read ofs=0 len=0 2024-09-22T08:37:42.258 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.253+0000 7fc2c8b75800 1 --2- 172.21.15.142:0/396702845 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x559a98c840e0 0x559a98c864d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:42.258 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.253+0000 7fc2c8b75800 1 -- 172.21.15.142:0/396702845 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559a98c86c10 con 0x559a98c840e0 2024-09-22T08:37:42.258 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.253+0000 7fc2c6e60640 1 --2- 172.21.15.142:0/396702845 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x559a98c840e0 0x559a98c864d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:42.258 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.253+0000 7fc2c6e60640 1 --2- 172.21.15.142:0/396702845 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x559a98c840e0 0x559a98c864d0 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:42.258 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.253+0000 7fc2c6e60640 1 -- 172.21.15.142:0/396702845 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(5 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fc2c000a4d0 con 0x559a98c840e0 2024-09-22T08:37:42.258 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.253+0000 7fc2c8b75800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:37:42.258 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.254+0000 7fc2c8b75800 20 searching for the correct realm 2024-09-22T08:37:42.259 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.254+0000 7fc2c8b75800 1 -- 172.21.15.142:0/396702845 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559a98c88540 con 0x559a98c840e0 2024-09-22T08:37:42.259 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.254+0000 7fc2c6e60640 1 -- 172.21.15.142:0/396702845 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2c000a4d0 con 0x559a98c840e0 2024-09-22T08:37:42.259 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.254+0000 7fc2c6e60640 1 --2- 172.21.15.142:0/396702845 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7fc2c0033440 0x7fc2c00451d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:42.259 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.254+0000 7fc2c6e60640 1 -- 172.21.15.142:0/396702845 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559a98c88540 con 0x7fc2c0033440 2024-09-22T08:37:42.259 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.254+0000 7fc2c665f640 1 --2- 172.21.15.142:0/396702845 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7fc2c0033440 0x7fc2c00451d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:42.259 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.254+0000 7fc2c665f640 1 --2- 172.21.15.142:0/396702845 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7fc2c0033440 0x7fc2c00451d0 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:42.259 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.254+0000 7fc2c665f640 1 -- 172.21.15.142:0/396702845 <== osd.2 v2:172.21.15.142:6808/279438927 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2b808e040 con 0x7fc2c0033440 2024-09-22T08:37:42.259 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.254+0000 7fc2c665f640 1 --2- 172.21.15.142:0/396702845 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7fc2b8067020 0x7fc2b8098ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:42.259 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.254+0000 7fc2c665f640 1 -- 172.21.15.142:0/396702845 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559a98c88540 con 0x7fc2b8067020 2024-09-22T08:37:42.259 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.255+0000 7fc2bde5e640 1 --2- 172.21.15.142:0/396702845 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7fc2b8067020 0x7fc2b8098ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:42.267 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.255+0000 7fc2bde5e640 1 --2- 172.21.15.142:0/396702845 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7fc2b8067020 0x7fc2b8098ab0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:42.268 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.255+0000 7fc2bde5e640 1 -- 172.21.15.142:0/396702845 <== osd.0 v2:172.21.15.31:6800/168281188 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2b0009050 con 0x7fc2b8067020 2024-09-22T08:37:42.268 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.255+0000 7fc2bde5e640 1 -- 172.21.15.142:0/396702845 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559a98c88540 con 0x559a98c7f720 2024-09-22T08:37:42.268 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.256+0000 7fc2bde5e640 1 -- 172.21.15.142:0/396702845 <== osd.1 v2:172.21.15.142:6816/3192108003 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2b0009050 con 0x559a98c7f720 2024-09-22T08:37:42.268 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.256+0000 7fc2bde5e640 1 -- 172.21.15.142:0/396702845 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559a98c88540 con 0x559a98c7f720 2024-09-22T08:37:42.268 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.256+0000 7fc2bde5e640 1 -- 172.21.15.142:0/396702845 <== osd.1 v2:172.21.15.142:6816/3192108003 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2b0029040 con 0x559a98c7f720 2024-09-22T08:37:42.268 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.256+0000 7fc2bde5e640 1 -- 172.21.15.142:0/396702845 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559a98c88540 con 0x559a98c7f720 2024-09-22T08:37:42.268 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.256+0000 7fc2bde5e640 1 -- 172.21.15.142:0/396702845 <== osd.1 v2:172.21.15.142:6816/3192108003 7 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2b0029040 con 0x559a98c7f720 2024-09-22T08:37:42.268 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.256+0000 7fc2bde5e640 1 -- 172.21.15.142:0/396702845 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559a98c88540 con 0x7fc2b8067020 2024-09-22T08:37:42.268 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.256+0000 7fc2bde5e640 1 -- 172.21.15.142:0/396702845 <== osd.0 v2:172.21.15.31:6800/168281188 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2b0029040 con 0x7fc2b8067020 2024-09-22T08:37:42.268 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.256+0000 7fc2bde5e640 1 -- 172.21.15.142:0/396702845 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559a98c88540 con 0x7fc2c0033440 2024-09-22T08:37:42.268 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.256+0000 7fc2c665f640 1 -- 172.21.15.142:0/396702845 <== osd.2 v2:172.21.15.142:6808/279438927 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2b808e040 con 0x7fc2c0033440 2024-09-22T08:37:42.268 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.256+0000 7fc2c665f640 1 -- 172.21.15.142:0/396702845 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559a98c88540 con 0x559a98c840e0 2024-09-22T08:37:42.269 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.257+0000 7fc2c6e60640 1 -- 172.21.15.142:0/396702845 <== osd.3 v2:172.21.15.142:6800/1064901393 3 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2c000a4d0 con 0x559a98c840e0 2024-09-22T08:37:42.269 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.257+0000 7fc2c6e60640 1 -- 172.21.15.142:0/396702845 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559a98c88540 con 0x559a98c7f720 2024-09-22T08:37:42.269 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.257+0000 7fc2bde5e640 1 -- 172.21.15.142:0/396702845 <== osd.1 v2:172.21.15.142:6816/3192108003 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2b0029040 con 0x559a98c7f720 2024-09-22T08:37:42.269 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.257+0000 7fc2bde5e640 1 -- 172.21.15.142:0/396702845 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559a98c88540 con 0x7fc2b8067020 2024-09-22T08:37:42.269 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.258+0000 7fc2bde5e640 1 -- 172.21.15.142:0/396702845 <== osd.0 v2:172.21.15.31:6800/168281188 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2b0029040 con 0x7fc2b8067020 2024-09-22T08:37:42.269 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.258+0000 7fc2bde5e640 1 -- 172.21.15.142:0/396702845 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559a98c88540 con 0x559a98c7f720 2024-09-22T08:37:42.269 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.258+0000 7fc2bde5e640 1 -- 172.21.15.142:0/396702845 <== osd.1 v2:172.21.15.142:6816/3192108003 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2b0029040 con 0x559a98c7f720 2024-09-22T08:37:42.269 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.258+0000 7fc2bde5e640 1 -- 172.21.15.142:0/396702845 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559a98c88540 con 0x7fc2c0033440 2024-09-22T08:37:42.269 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.258+0000 7fc2c665f640 1 -- 172.21.15.142:0/396702845 <== osd.2 v2:172.21.15.142:6808/279438927 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fc2b808e040 con 0x7fc2c0033440 2024-09-22T08:37:42.269 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.258+0000 7fc2c665f640 1 -- 172.21.15.142:0/396702845 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559a98c88540 con 0x559a98c840e0 2024-09-22T08:37:42.269 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.258+0000 7fc2c6e60640 1 -- 172.21.15.142:0/396702845 <== osd.3 v2:172.21.15.142:6800/1064901393 4 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2c000a4d0 con 0x559a98c840e0 2024-09-22T08:37:42.269 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.258+0000 7fc2c6e60640 1 -- 172.21.15.142:0/396702845 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559a98c88540 con 0x559a98c840e0 2024-09-22T08:37:42.269 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.258+0000 7fc2c6e60640 1 -- 172.21.15.142:0/396702845 <== osd.3 v2:172.21.15.142:6800/1064901393 5 ==== osd_op_reply(20 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fc2c000a4d0 con 0x559a98c840e0 2024-09-22T08:37:42.269 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.258+0000 7fc2c6e60640 1 -- 172.21.15.142:0/396702845 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559a98c88540 con 0x7fc2b8067020 2024-09-22T08:37:42.270 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.259+0000 7fc2bde5e640 1 -- 172.21.15.142:0/396702845 <== osd.0 v2:172.21.15.31:6800/168281188 4 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2b0029040 con 0x7fc2b8067020 2024-09-22T08:37:42.270 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.259+0000 7fc2bde5e640 1 -- 172.21.15.142:0/396702845 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559a98c88540 con 0x559a98c840e0 2024-09-22T08:37:42.270 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.259+0000 7fc2c6e60640 1 -- 172.21.15.142:0/396702845 <== osd.3 v2:172.21.15.142:6800/1064901393 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2c000a4d0 con 0x559a98c840e0 2024-09-22T08:37:42.270 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.259+0000 7fc2c6e60640 1 -- 172.21.15.142:0/396702845 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559a98c88540 con 0x559a98c840e0 2024-09-22T08:37:42.270 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.259+0000 7fc2c6e60640 1 -- 172.21.15.142:0/396702845 <== osd.3 v2:172.21.15.142:6800/1064901393 7 ==== osd_op_reply(23 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fc2c000a4d0 con 0x559a98c840e0 2024-09-22T08:37:42.270 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.259+0000 7fc2c6e60640 1 -- 172.21.15.142:0/396702845 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559a98c88540 con 0x559a98c7f720 2024-09-22T08:37:42.270 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.259+0000 7fc2bde5e640 1 -- 172.21.15.142:0/396702845 <== osd.1 v2:172.21.15.142:6816/3192108003 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2b0029040 con 0x559a98c7f720 2024-09-22T08:37:42.270 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.259+0000 7fc2bde5e640 1 -- 172.21.15.142:0/396702845 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559a98c88540 con 0x559a98c7f720 2024-09-22T08:37:42.270 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.260+0000 7fc2bde5e640 1 -- 172.21.15.142:0/396702845 <== osd.1 v2:172.21.15.142:6816/3192108003 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fc2b0029040 con 0x559a98c7f720 2024-09-22T08:37:42.270 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.260+0000 7fc2bde5e640 1 -- 172.21.15.142:0/396702845 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559a98c88540 con 0x7fc2b8067020 2024-09-22T08:37:42.270 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.260+0000 7fc2bde5e640 1 -- 172.21.15.142:0/396702845 <== osd.0 v2:172.21.15.31:6800/168281188 5 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2b0029040 con 0x7fc2b8067020 2024-09-22T08:37:42.270 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.260+0000 7fc2bde5e640 1 -- 172.21.15.142:0/396702845 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559a98c88540 con 0x559a98c840e0 2024-09-22T08:37:42.271 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.260+0000 7fc2c6e60640 1 -- 172.21.15.142:0/396702845 <== osd.3 v2:172.21.15.142:6800/1064901393 8 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2c000a4d0 con 0x559a98c840e0 2024-09-22T08:37:42.271 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.260+0000 7fc2c6e60640 1 -- 172.21.15.142:0/396702845 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559a98c88540 con 0x7fc2c0033440 2024-09-22T08:37:42.271 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.260+0000 7fc2c665f640 1 -- 172.21.15.142:0/396702845 <== osd.2 v2:172.21.15.142:6808/279438927 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2b808e040 con 0x7fc2c0033440 2024-09-22T08:37:42.271 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.260+0000 7fc2c665f640 1 -- 172.21.15.142:0/396702845 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559a98c88540 con 0x559a98c7f720 2024-09-22T08:37:42.271 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.261+0000 7fc2bde5e640 1 -- 172.21.15.142:0/396702845 <== osd.1 v2:172.21.15.142:6816/3192108003 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2b0029040 con 0x559a98c7f720 2024-09-22T08:37:42.271 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.261+0000 7fc2bde5e640 1 -- 172.21.15.142:0/396702845 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559a98c88540 con 0x7fc2b8067020 2024-09-22T08:37:42.271 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.261+0000 7fc2bde5e640 1 -- 172.21.15.142:0/396702845 <== osd.0 v2:172.21.15.31:6800/168281188 6 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2b0029040 con 0x7fc2b8067020 2024-09-22T08:37:42.271 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.261+0000 7fc2bde5e640 1 -- 172.21.15.142:0/396702845 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559a98c88540 con 0x559a98c840e0 2024-09-22T08:37:42.271 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.261+0000 7fc2c6e60640 1 -- 172.21.15.142:0/396702845 <== osd.3 v2:172.21.15.142:6800/1064901393 9 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2c000a4d0 con 0x559a98c840e0 2024-09-22T08:37:42.271 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.261+0000 7fc2c6e60640 1 -- 172.21.15.142:0/396702845 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559a98c88540 con 0x7fc2b8067020 2024-09-22T08:37:42.271 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.261+0000 7fc2bde5e640 1 -- 172.21.15.142:0/396702845 <== osd.0 v2:172.21.15.31:6800/168281188 7 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2b0029040 con 0x7fc2b8067020 2024-09-22T08:37:42.271 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.261+0000 7fc2bde5e640 1 -- 172.21.15.142:0/396702845 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559a98c88540 con 0x7fc2c0033440 2024-09-22T08:37:42.271 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.262+0000 7fc2c665f640 1 -- 172.21.15.142:0/396702845 <== osd.2 v2:172.21.15.142:6808/279438927 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2b808e040 con 0x7fc2c0033440 2024-09-22T08:37:42.272 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.262+0000 7fc2c665f640 1 -- 172.21.15.142:0/396702845 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559a98c88540 con 0x559a98c840e0 2024-09-22T08:37:42.272 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.262+0000 7fc2c6e60640 1 -- 172.21.15.142:0/396702845 <== osd.3 v2:172.21.15.142:6800/1064901393 10 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2c000a4d0 con 0x559a98c840e0 2024-09-22T08:37:42.272 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.262+0000 7fc2c6e60640 1 -- 172.21.15.142:0/396702845 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559a98c88540 con 0x7fc2b8067020 2024-09-22T08:37:42.272 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.262+0000 7fc2bde5e640 1 -- 172.21.15.142:0/396702845 <== osd.0 v2:172.21.15.31:6800/168281188 8 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2b0029040 con 0x7fc2b8067020 2024-09-22T08:37:42.272 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.262+0000 7fc2bde5e640 1 -- 172.21.15.142:0/396702845 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559a98c88540 con 0x559a98c7f720 2024-09-22T08:37:42.272 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.262+0000 7fc2bde5e640 1 -- 172.21.15.142:0/396702845 <== osd.1 v2:172.21.15.142:6816/3192108003 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fc2b0029040 con 0x559a98c7f720 2024-09-22T08:37:42.272 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.262+0000 7fc2bde5e640 1 -- 172.21.15.142:0/396702845 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559a98c88540 con 0x7fc2c0033440 2024-09-22T08:37:42.272 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.263+0000 7fc2c665f640 1 -- 172.21.15.142:0/396702845 <== osd.2 v2:172.21.15.142:6808/279438927 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2b808e040 con 0x7fc2c0033440 2024-09-22T08:37:42.272 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.263+0000 7fc2c8b75800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:37:42.272 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.263+0000 7fc2c8b75800 20 RGWRados::pool_iterate: got zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec 2024-09-22T08:37:42.272 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.263+0000 7fc2c8b75800 20 RGWRados::pool_iterate: got zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f 2024-09-22T08:37:42.272 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.263+0000 7fc2c8b75800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:37:42.272 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.263+0000 7fc2c8b75800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:37:42.272 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.263+0000 7fc2c8b75800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:37:42.273 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.263+0000 7fc2c8b75800 20 rados->read ofs=0 len=0 2024-09-22T08:37:42.273 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.263+0000 7fc2c8b75800 1 -- 172.21.15.142:0/396702845 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559a98c87600 con 0x559a98c7f720 2024-09-22T08:37:42.273 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.263+0000 7fc2bde5e640 1 -- 172.21.15.142:0/396702845 <== osd.1 v2:172.21.15.142:6816/3192108003 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc2b0029040 con 0x559a98c7f720 2024-09-22T08:37:42.273 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.263+0000 7fc2c8b75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:42.273 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.263+0000 7fc2c8b75800 20 rados->read ofs=0 len=0 2024-09-22T08:37:42.273 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.263+0000 7fc2c8b75800 1 -- 172.21.15.142:0/396702845 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559a98c87e50 con 0x559a98c7f720 2024-09-22T08:37:42.273 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.263+0000 7fc2bde5e640 1 -- 172.21.15.142:0/396702845 <== osd.1 v2:172.21.15.142:6816/3192108003 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc2b0029040 con 0x559a98c7f720 2024-09-22T08:37:42.273 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.263+0000 7fc2c8b75800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:37:42.273 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.263+0000 7fc2c8b75800 20 rados->read ofs=0 len=0 2024-09-22T08:37:42.273 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.263+0000 7fc2c8b75800 1 -- 172.21.15.142:0/396702845 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:40 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559a98c889c0 con 0x559a98c840e0 2024-09-22T08:37:42.273 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.263+0000 7fc2c6e60640 1 -- 172.21.15.142:0/396702845 <== osd.3 v2:172.21.15.142:6800/1064901393 11 ==== osd_op_reply(40 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fc2c000a4d0 con 0x559a98c840e0 2024-09-22T08:37:42.273 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.263+0000 7fc2c8b75800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:37:42.273 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.264+0000 7fc2c8b75800 20 zone default found 2024-09-22T08:37:42.273 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.264+0000 7fc2c8b75800 4 Realm: () 2024-09-22T08:37:42.274 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.264+0000 7fc2c8b75800 4 ZoneGroup: default (d89f6f57-1007-47dd-9065-f486c7b01aec) 2024-09-22T08:37:42.274 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.264+0000 7fc2c8b75800 4 Zone: default (e239248c-0bee-4e41-803a-24b288d3eb8f) 2024-09-22T08:37:42.274 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.264+0000 7fc2c8b75800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:37:42.274 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.264+0000 7fc2c8b75800 20 zonegroup default 2024-09-22T08:37:42.274 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.264+0000 7fc2c8b75800 20 rados->read ofs=0 len=0 2024-09-22T08:37:42.274 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.264+0000 7fc2c8b75800 1 -- 172.21.15.142:0/396702845 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559a98c88dc0 con 0x7fc2b8067020 2024-09-22T08:37:42.274 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.264+0000 7fc2bde5e640 1 -- 172.21.15.142:0/396702845 <== osd.0 v2:172.21.15.31:6800/168281188 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fc2b0029040 con 0x7fc2b8067020 2024-09-22T08:37:42.274 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.264+0000 7fc2c8b75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:42.274 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.264+0000 7fc2c8b75800 20 rados->read ofs=0 len=0 2024-09-22T08:37:42.274 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.264+0000 7fc2c8b75800 1 -- 172.21.15.142:0/396702845 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559a98c8b0a0 con 0x559a98c840e0 2024-09-22T08:37:42.274 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.264+0000 7fc2c6e60640 1 -- 172.21.15.142:0/396702845 <== osd.3 v2:172.21.15.142:6800/1064901393 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc2c000a4d0 con 0x559a98c840e0 2024-09-22T08:37:42.274 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.264+0000 7fc2c8b75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:42.274 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.264+0000 7fc2c8b75800 20 rados->read ofs=0 len=0 2024-09-22T08:37:42.275 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.264+0000 7fc2c8b75800 1 -- 172.21.15.142:0/396702845 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559a98c8b440 con 0x559a98c840e0 2024-09-22T08:37:42.275 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.264+0000 7fc2c6e60640 1 -- 172.21.15.142:0/396702845 <== osd.3 v2:172.21.15.142:6800/1064901393 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc2c000a4d0 con 0x559a98c840e0 2024-09-22T08:37:42.275 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.264+0000 7fc2c8b75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:42.275 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.264+0000 7fc2c8b75800 20 started sync module instance, tier type = 2024-09-22T08:37:42.275 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.264+0000 7fc2c8b75800 20 started zone id=e239248c-0bee-4e41-803a-24b288d3eb8f (name=default) with tier type = 2024-09-22T08:37:42.275 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.264+0000 7fc2c8b75800 1 -- 172.21.15.142:0/396702845 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559a98c8a530 con 0x7fc2c0033440 2024-09-22T08:37:42.275 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.266+0000 7fc2c665f640 1 -- 172.21.15.142:0/396702845 <== osd.2 v2:172.21.15.142:6808/279438927 7 ==== osd_op_reply(44 notify.0 [create] v32'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2b808e040 con 0x7fc2c0033440 2024-09-22T08:37:42.275 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.266+0000 7fc2c8b75800 1 -- 172.21.15.142:0/396702845 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94122476611920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559a98c8a190 con 0x7fc2c0033440 2024-09-22T08:37:42.275 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.266+0000 7fc2c8b75800 1 -- 172.21.15.142:0/396702845 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559a98c8c340 con 0x559a98c7f720 2024-09-22T08:37:42.275 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.267+0000 7fc2c665f640 1 -- 172.21.15.142:0/396702845 <== osd.2 v2:172.21.15.142:6808/279438927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94122476611920] v32'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2b808e040 con 0x7fc2c0033440 2024-09-22T08:37:42.280 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.267+0000 7fc2bde5e640 1 -- 172.21.15.142:0/396702845 <== osd.1 v2:172.21.15.142:6816/3192108003 16 ==== osd_op_reply(46 notify.1 [create] v32'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2b0029040 con 0x559a98c7f720 2024-09-22T08:37:42.280 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.267+0000 7fc2c8b75800 1 -- 172.21.15.142:0/396702845 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94122476617360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559a98c8c760 con 0x559a98c7f720 2024-09-22T08:37:42.280 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.267+0000 7fc2c8b75800 1 -- 172.21.15.142:0/396702845 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559a98c8d120 con 0x559a98c840e0 2024-09-22T08:37:42.280 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.268+0000 7fc2bde5e640 1 -- 172.21.15.142:0/396702845 <== osd.1 v2:172.21.15.142:6816/3192108003 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94122476617360] v32'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2b0029040 con 0x559a98c7f720 2024-09-22T08:37:42.280 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.268+0000 7fc2c6e60640 1 -- 172.21.15.142:0/396702845 <== osd.3 v2:172.21.15.142:6800/1064901393 14 ==== osd_op_reply(48 notify.2 [create] v32'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2c000a4d0 con 0x559a98c840e0 2024-09-22T08:37:42.281 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.268+0000 7fc2c8b75800 1 -- 172.21.15.142:0/396702845 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94122476618896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559a98c8d120 con 0x559a98c840e0 2024-09-22T08:37:42.281 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.268+0000 7fc2c8b75800 1 -- 172.21.15.142:0/396702845 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559a98c8db20 con 0x7fc2c0033440 2024-09-22T08:37:42.281 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.269+0000 7fc2c665f640 1 -- 172.21.15.142:0/396702845 <== osd.2 v2:172.21.15.142:6808/279438927 9 ==== osd_op_reply(50 notify.3 [create] v32'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2b808e040 con 0x7fc2c0033440 2024-09-22T08:37:42.281 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.269+0000 7fc2c8b75800 1 -- 172.21.15.142:0/396702845 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94122476623408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559a98c8e3c0 con 0x7fc2c0033440 2024-09-22T08:37:42.281 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.269+0000 7fc2c8b75800 1 -- 172.21.15.142:0/396702845 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559a98c8eee0 con 0x559a98c7f720 2024-09-22T08:37:42.281 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.269+0000 7fc2c6e60640 1 -- 172.21.15.142:0/396702845 <== osd.3 v2:172.21.15.142:6800/1064901393 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94122476618896] v32'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2c000a4d0 con 0x559a98c840e0 2024-09-22T08:37:42.281 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.270+0000 7fc2bde5e640 1 -- 172.21.15.142:0/396702845 <== osd.1 v2:172.21.15.142:6816/3192108003 18 ==== osd_op_reply(52 notify.4 [create] v32'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2b0029040 con 0x559a98c7f720 2024-09-22T08:37:42.281 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.270+0000 7fc2c8b75800 1 -- 172.21.15.142:0/396702845 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94122476628400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559a98c8eea0 con 0x559a98c7f720 2024-09-22T08:37:42.281 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.270+0000 7fc2c8b75800 1 -- 172.21.15.142:0/396702845 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559a98c8f960 con 0x7fc2b8067020 2024-09-22T08:37:42.281 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.270+0000 7fc2c665f640 1 -- 172.21.15.142:0/396702845 <== osd.2 v2:172.21.15.142:6808/279438927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94122476623408] v32'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2b808e040 con 0x7fc2c0033440 2024-09-22T08:37:42.281 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.271+0000 7fc2bde5e640 1 -- 172.21.15.142:0/396702845 <== osd.1 v2:172.21.15.142:6816/3192108003 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94122476628400] v32'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2b0029040 con 0x559a98c7f720 2024-09-22T08:37:42.281 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.272+0000 7fc2bde5e640 1 -- 172.21.15.142:0/396702845 <== osd.0 v2:172.21.15.31:6800/168281188 10 ==== osd_op_reply(54 notify.5 [create] v32'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2b0029040 con 0x7fc2b8067020 2024-09-22T08:37:42.281 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.272+0000 7fc2c8b75800 1 -- 172.21.15.142:0/396702845 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94122476620912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559a98c8f960 con 0x7fc2b8067020 2024-09-22T08:37:42.282 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.272+0000 7fc2c8b75800 1 -- 172.21.15.142:0/396702845 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559a98c8fdf0 con 0x7fc2b8067020 2024-09-22T08:37:42.282 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.273+0000 7fc2bde5e640 1 -- 172.21.15.142:0/396702845 <== osd.0 v2:172.21.15.31:6800/168281188 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94122476620912] v32'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2b0029040 con 0x7fc2b8067020 2024-09-22T08:37:42.282 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.273+0000 7fc2bde5e640 1 -- 172.21.15.142:0/396702845 <== osd.0 v2:172.21.15.31:6800/168281188 12 ==== osd_op_reply(56 notify.6 [create] v32'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2b0029040 con 0x7fc2b8067020 2024-09-22T08:37:42.282 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.273+0000 7fc2c8b75800 1 -- 172.21.15.142:0/396702845 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94122476625680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559a98c8fdb0 con 0x7fc2b8067020 2024-09-22T08:37:42.282 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.273+0000 7fc2c8b75800 1 -- 172.21.15.142:0/396702845 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559a98c90800 con 0x7fc2b8067020 2024-09-22T08:37:42.282 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.274+0000 7fc2bde5e640 1 -- 172.21.15.142:0/396702845 <== osd.0 v2:172.21.15.31:6800/168281188 13 ==== osd_op_reply(58 notify.7 [create] v32'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2b0029040 con 0x7fc2b8067020 2024-09-22T08:37:42.282 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.274+0000 7fc2bde5e640 1 -- 172.21.15.142:0/396702845 <== osd.0 v2:172.21.15.31:6800/168281188 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94122476625680] v32'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2b0029040 con 0x7fc2b8067020 2024-09-22T08:37:42.282 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.274+0000 7fc2c8b75800 1 -- 172.21.15.142:0/396702845 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94122476634960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559a98c90770 con 0x7fc2b8067020 2024-09-22T08:37:42.282 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.274+0000 7fc2c8b75800 20 add_watcher() i=0 2024-09-22T08:37:42.282 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.274+0000 7fc2c8b75800 20 add_watcher() i=1 2024-09-22T08:37:42.282 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.274+0000 7fc2c8b75800 20 add_watcher() i=2 2024-09-22T08:37:42.282 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.274+0000 7fc2c8b75800 20 add_watcher() i=3 2024-09-22T08:37:42.282 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.274+0000 7fc2c8b75800 20 add_watcher() i=4 2024-09-22T08:37:42.283 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.274+0000 7fc2c8b75800 20 add_watcher() i=5 2024-09-22T08:37:42.283 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.274+0000 7fc2c8b75800 20 add_watcher() i=6 2024-09-22T08:37:42.283 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.275+0000 7fc2bde5e640 1 -- 172.21.15.142:0/396702845 <== osd.0 v2:172.21.15.31:6800/168281188 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94122476634960] v32'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2b0029040 con 0x7fc2b8067020 2024-09-22T08:37:42.283 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.275+0000 7fc2c8b75800 20 add_watcher() i=7 2024-09-22T08:37:42.283 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.275+0000 7fc2c8b75800 2 all 8 watchers are set, enabling cache 2024-09-22T08:37:42.283 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.275+0000 7fc2c8b75800 1 -- 172.21.15.142:0/396702845 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559a98c93cd0 con 0x559a98c7f720 2024-09-22T08:37:42.283 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.276+0000 7fc2bde5e640 1 -- 172.21.15.142:0/396702845 <== osd.1 v2:172.21.15.142:6816/3192108003 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fc2b0029040 con 0x559a98c7f720 2024-09-22T08:37:42.283 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.276+0000 7fc2c8b75800 1 -- 172.21.15.142:0/396702845 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94122476631152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559a98c91080 con 0x559a98c7f720 2024-09-22T08:37:42.283 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.276+0000 7fc2bde5e640 1 -- 172.21.15.142:0/396702845 <== osd.1 v2:172.21.15.142:6816/3192108003 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94122476631152] v32'210 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc2b0029040 con 0x559a98c7f720 2024-09-22T08:37:42.283 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.277+0000 7fc17cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:37:42.283 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.277+0000 7fc2c8b75800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:37:42.283 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.277+0000 7fc2c8b75800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:37:42.283 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.277+0000 7fc2c8b75800 5 note: GC not initialized 2024-09-22T08:37:42.284 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.277+0000 7fc0f77fe640 20 reqs_thread_entry: start 2024-09-22T08:37:42.284 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.277+0000 7fc2c8b75800 20 init_complete bucket index max shards: 11 2024-09-22T08:37:42.284 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.277+0000 7fc2c8b75800 20 Filter name: none 2024-09-22T08:37:42.284 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.277+0000 7fc0f57fa640 20 reqs_thread_entry: start 2024-09-22T08:37:42.284 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.277+0000 7fc2c8b75800 10 cache get: name=default.rgw.meta+users.uid+bar : miss 2024-09-22T08:37:42.284 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.277+0000 7fc2c8b75800 20 rados->read ofs=0 len=0 2024-09-22T08:37:42.284 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.277+0000 7fc2c8b75800 1 -- 172.21.15.142:0/396702845 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:62 8.e 8:718f6a54:users.uid::bar:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559a98cc70e0 con 0x7fc2b8067020 2024-09-22T08:37:42.284 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.278+0000 7fc2bde5e640 1 -- 172.21.15.142:0/396702845 <== osd.0 v2:172.21.15.31:6800/168281188 16 ==== osd_op_reply(62 bar [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7fc2b0029040 con 0x7fc2b8067020 2024-09-22T08:37:42.284 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.278+0000 7fc2c8b75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:42.284 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.278+0000 7fc2c8b75800 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x0 2024-09-22T08:37:42.284 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.278+0000 7fc2c8b75800 10 adding default.rgw.meta+users.uid+bar to cache LRU end 2024-09-22T08:37:42.284 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.278+0000 7fc2c8b75800 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : miss 2024-09-22T08:37:42.284 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.278+0000 7fc2c8b75800 20 rados->read ofs=0 len=0 2024-09-22T08:37:42.284 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.278+0000 7fc2c8b75800 1 -- 172.21.15.142:0/396702845 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:63 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559a98cc5640 con 0x559a98c7f720 2024-09-22T08:37:42.285 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.278+0000 7fc2bde5e640 1 -- 172.21.15.142:0/396702845 <== osd.1 v2:172.21.15.142:6816/3192108003 22 ==== osd_op_reply(63 NX5QOQKC6BH2IDN8HC7A [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7fc2b0029040 con 0x559a98c7f720 2024-09-22T08:37:42.285 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.278+0000 7fc2c8b75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:42.285 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.278+0000 7fc2c8b75800 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x0 2024-09-22T08:37:42.285 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.278+0000 7fc2c8b75800 10 adding default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-22T08:37:42.285 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.278+0000 7fc2c8b75800 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : hit (negative entry) 2024-09-22T08:37:42.285 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.278+0000 7fc2c8b75800 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : hit (negative entry) 2024-09-22T08:37:42.285 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.278+0000 7fc2c8b75800 1 -- 172.21.15.142:0/396702845 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:64 8.e 8:718f6a54:users.uid::bar:head [delete,create,call version.set in=58b,writefull 0~380 in=380b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559a98cc5ee0 con 0x7fc2b8067020 2024-09-22T08:37:42.285 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.279+0000 7fc2bde5e640 1 -- 172.21.15.142:0/396702845 <== osd.0 v2:172.21.15.31:6800/168281188 17 ==== osd_op_reply(64 bar [delete,create,call,writefull 0~380] v32'7 uv7 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7fc2b0029040 con 0x7fc2b8067020 2024-09-22T08:37:42.285 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.279+0000 7fc2c8b75800 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x17 2024-09-22T08:37:42.285 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.279+0000 7fc2c8b75800 10 moving default.rgw.meta+users.uid+bar to cache LRU end 2024-09-22T08:37:42.285 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.279+0000 7fc2c8b75800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:bar, ofs0, ns] 2024-09-22T08:37:42.285 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.279+0000 7fc2c8b75800 1 -- 172.21.15.142:0/396702845 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:65 7.9 7:93e5b521:::notify.7:head [notify cookie 94122476853808 in=568b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559a98ccab80 con 0x7fc2b8067020 2024-09-22T08:37:42.287 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.279+0000 7fc2bde5e640 1 -- 172.21.15.142:0/396702845 <== osd.0 v2:172.21.15.31:6800/168281188 18 ==== watch-notify(notify (1) cookie 94122476634960 notify 137438953492 ret 0) ==== 598+0+0 (crc 0 0 0) 0x559a98cc6280 con 0x7fc2b8067020 2024-09-22T08:37:42.287 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.279+0000 7fc1a9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953492 cookie 94122476634960 notifier 4723 bl.length()=556 2024-09-22T08:37:42.287 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.279+0000 7fc1a9ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bar info.flags=0x17 2024-09-22T08:37:42.287 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.279+0000 7fc1a9ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bar to cache LRU end 2024-09-22T08:37:42.287 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.279+0000 7fc1a9ffb640 1 -- 172.21.15.142:0/396702845 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:66 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fc18c003ea0 con 0x7fc2b8067020 2024-09-22T08:37:42.287 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.280+0000 7fc2bde5e640 1 -- 172.21.15.142:0/396702845 <== osd.0 v2:172.21.15.31:6800/168281188 19 ==== osd_op_reply(65 notify.7 [notify cookie 94122476853808 out=8b] v0'0 uv210 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fc2b0029040 con 0x7fc2b8067020 2024-09-22T08:37:42.288 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.280+0000 7fc2bde5e640 1 -- 172.21.15.142:0/396702845 <== osd.0 v2:172.21.15.31:6800/168281188 20 ==== osd_op_reply(66 notify.7 [notify-ack] v0'0 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2b0029040 con 0x7fc2b8067020 2024-09-22T08:37:42.288 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.280+0000 7fc2bde5e640 1 -- 172.21.15.142:0/396702845 <== osd.0 v2:172.21.15.31:6800/168281188 21 ==== watch-notify(notify_complete (2) cookie 94122476853808 notify 137438953492 ret 0) ==== 42+0+48 (crc 0 0 0) 0x559a98cc6a30 con 0x7fc2b8067020 2024-09-22T08:37:42.288 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.280+0000 7fc2c8b75800 1 -- 172.21.15.142:0/396702845 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:67 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559a98cc86b0 con 0x559a98c7f720 2024-09-22T08:37:42.288 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.281+0000 7fc2bde5e640 1 -- 172.21.15.142:0/396702845 <== osd.1 v2:172.21.15.142:6816/3192108003 23 ==== osd_op_reply(67 NX5QOQKC6BH2IDN8HC7A [delete,create,writefull 0~7] v32'2 uv2 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7fc2b0029040 con 0x559a98c7f720 2024-09-22T08:37:42.288 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.281+0000 7fc2c8b75800 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-09-22T08:37:42.288 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.281+0000 7fc2c8b75800 10 moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-22T08:37:42.288 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.281+0000 7fc2c8b75800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-09-22T08:37:42.288 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.281+0000 7fc2c8b75800 1 -- 172.21.15.142:0/396702845 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:68 7.3 7:c609908c:::notify.5:head [notify cookie 94122476853728 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559a98ccab80 con 0x7fc2b8067020 2024-09-22T08:37:42.288 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.281+0000 7fc2bde5e640 1 -- 172.21.15.142:0/396702845 <== osd.0 v2:172.21.15.31:6800/168281188 22 ==== watch-notify(notify (1) cookie 94122476620912 notify 137438953493 ret 0) ==== 219+0+0 (crc 0 0 0) 0x559a98cc6a30 con 0x7fc2b8067020 2024-09-22T08:37:42.288 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.281+0000 7fc1a97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953493 cookie 94122476620912 notifier 4723 bl.length()=177 2024-09-22T08:37:42.288 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.281+0000 7fc1a97fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-09-22T08:37:42.288 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.281+0000 7fc1a97fa640 10 rgw watcher librados: moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-22T08:37:42.288 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.281+0000 7fc1a97fa640 1 -- 172.21.15.142:0/396702845 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fc0fc003400 con 0x7fc2b8067020 2024-09-22T08:37:42.288 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.281+0000 7fc2bde5e640 1 -- 172.21.15.142:0/396702845 <== osd.0 v2:172.21.15.31:6800/168281188 23 ==== osd_op_reply(68 notify.5 [notify cookie 94122476853728 out=8b] v0'0 uv210 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fc2b0029040 con 0x7fc2b8067020 2024-09-22T08:37:42.289 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.282+0000 7fc2bde5e640 1 -- 172.21.15.142:0/396702845 <== osd.0 v2:172.21.15.31:6800/168281188 24 ==== osd_op_reply(69 notify.5 [notify-ack] v0'0 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2b0029040 con 0x7fc2b8067020 2024-09-22T08:37:42.289 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.282+0000 7fc2bde5e640 1 -- 172.21.15.142:0/396702845 <== osd.0 v2:172.21.15.31:6800/168281188 25 ==== watch-notify(notify_complete (2) cookie 94122476853728 notify 137438953493 ret 0) ==== 42+0+48 (crc 0 0 0) 0x559a989d6a20 con 0x7fc2b8067020 2024-09-22T08:37:42.289 INFO:teuthology.orchestra.run.smithi142.stdout:{"user_id":"bar","display_name":"Bar","email":"","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"bar","access_key":"NX5QOQKC6BH2IDN8HC7A","secret_key":"LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn","active":true,"create_date":"2024-09-22T08:37:42.279413Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-22T08:37:42.279403Z","tags":[],"group_ids":[]} 2024-09-22T08:37:42.291 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.283+0000 7fc17cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:37:42.291 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.283+0000 7fc2c8b75800 1 -- 172.21.15.142:0/396702845 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94122476631152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559a98cc4db0 con 0x559a98c7f720 2024-09-22T08:37:42.291 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.284+0000 7fc2bde5e640 1 -- 172.21.15.142:0/396702845 <== osd.1 v2:172.21.15.142:6816/3192108003 24 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94122476631152] v32'211 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc2b0029040 con 0x559a98c7f720 2024-09-22T08:37:42.291 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.284+0000 7fc2c8b75800 1 -- 172.21.15.142:0/396702845 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94122476611920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559a98cc4db0 con 0x7fc2c0033440 2024-09-22T08:37:42.291 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.285+0000 7fc2c665f640 1 -- 172.21.15.142:0/396702845 <== osd.2 v2:172.21.15.142:6808/279438927 11 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94122476611920] v32'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2b808e040 con 0x7fc2c0033440 2024-09-22T08:37:42.291 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.285+0000 7fc2c8b75800 20 remove_watcher() i=0 2024-09-22T08:37:42.291 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.285+0000 7fc2c8b75800 2 removed watcher, disabling cache 2024-09-22T08:37:42.291 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.285+0000 7fc2c8b75800 1 -- 172.21.15.142:0/396702845 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94122476617360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559a98cc4db0 con 0x559a98c7f720 2024-09-22T08:37:42.291 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.286+0000 7fc2bde5e640 1 -- 172.21.15.142:0/396702845 <== osd.1 v2:172.21.15.142:6816/3192108003 25 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94122476617360] v32'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2b0029040 con 0x559a98c7f720 2024-09-22T08:37:42.291 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.286+0000 7fc2c8b75800 20 remove_watcher() i=1 2024-09-22T08:37:42.291 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.286+0000 7fc2c8b75800 1 -- 172.21.15.142:0/396702845 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94122476618896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559a98cc4db0 con 0x559a98c840e0 2024-09-22T08:37:42.291 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.287+0000 7fc2c6e60640 1 -- 172.21.15.142:0/396702845 <== osd.3 v2:172.21.15.142:6800/1064901393 16 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94122476618896] v32'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2c000a4d0 con 0x559a98c840e0 2024-09-22T08:37:42.291 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.287+0000 7fc2c8b75800 20 remove_watcher() i=2 2024-09-22T08:37:42.292 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.287+0000 7fc2c8b75800 1 -- 172.21.15.142:0/396702845 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94122476623408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559a98cc4db0 con 0x7fc2c0033440 2024-09-22T08:37:42.292 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.288+0000 7fc2c665f640 1 -- 172.21.15.142:0/396702845 <== osd.2 v2:172.21.15.142:6808/279438927 12 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94122476623408] v32'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2b808e040 con 0x7fc2c0033440 2024-09-22T08:37:42.292 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.288+0000 7fc2c8b75800 20 remove_watcher() i=3 2024-09-22T08:37:42.292 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.288+0000 7fc2c8b75800 1 -- 172.21.15.142:0/396702845 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94122476628400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559a98cc4db0 con 0x559a98c7f720 2024-09-22T08:37:42.292 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.289+0000 7fc2bde5e640 1 -- 172.21.15.142:0/396702845 <== osd.1 v2:172.21.15.142:6816/3192108003 26 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94122476628400] v32'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2b0029040 con 0x559a98c7f720 2024-09-22T08:37:42.292 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.289+0000 7fc2c8b75800 20 remove_watcher() i=4 2024-09-22T08:37:42.292 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.289+0000 7fc2c8b75800 1 -- 172.21.15.142:0/396702845 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94122476620912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559a98cc4db0 con 0x7fc2b8067020 2024-09-22T08:37:42.293 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.290+0000 7fc2bde5e640 1 -- 172.21.15.142:0/396702845 <== osd.0 v2:172.21.15.31:6800/168281188 26 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94122476620912] v32'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2b0029040 con 0x7fc2b8067020 2024-09-22T08:37:42.293 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.290+0000 7fc2c8b75800 20 remove_watcher() i=5 2024-09-22T08:37:42.293 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.290+0000 7fc2c8b75800 1 -- 172.21.15.142:0/396702845 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94122476625680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559a98cc4db0 con 0x7fc2b8067020 2024-09-22T08:37:42.293 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.291+0000 7fc2bde5e640 1 -- 172.21.15.142:0/396702845 <== osd.0 v2:172.21.15.31:6800/168281188 27 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94122476625680] v32'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2b0029040 con 0x7fc2b8067020 2024-09-22T08:37:42.293 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.291+0000 7fc2c8b75800 20 remove_watcher() i=6 2024-09-22T08:37:42.293 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.291+0000 7fc2c8b75800 1 -- 172.21.15.142:0/396702845 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94122476634960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559a98cc4db0 con 0x7fc2b8067020 2024-09-22T08:37:42.296 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.293+0000 7fc2bde5e640 1 -- 172.21.15.142:0/396702845 <== osd.0 v2:172.21.15.31:6800/168281188 28 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94122476634960] v32'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2b0029040 con 0x7fc2b8067020 2024-09-22T08:37:42.296 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.293+0000 7fc2c8b75800 20 remove_watcher() i=7 2024-09-22T08:37:42.296 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.293+0000 7fc2c8b75800 1 -- 172.21.15.142:0/396702845 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7fc2b8067020 msgr2=0x7fc2b8098ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:42.296 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.293+0000 7fc2c8b75800 1 --2- 172.21.15.142:0/396702845 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7fc2b8067020 0x7fc2b8098ab0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:42.296 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.293+0000 7fc2c8b75800 1 -- 172.21.15.142:0/396702845 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x559a98c7f720 msgr2=0x559a98c81bb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:42.296 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.293+0000 7fc2c8b75800 1 --2- 172.21.15.142:0/396702845 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x559a98c7f720 0x559a98c81bb0 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:42.296 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.293+0000 7fc2c8b75800 1 -- 172.21.15.142:0/396702845 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7fc2c0033440 msgr2=0x7fc2c00451d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:42.296 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.293+0000 7fc2c8b75800 1 --2- 172.21.15.142:0/396702845 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7fc2c0033440 0x7fc2c00451d0 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:42.296 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.293+0000 7fc2c8b75800 1 -- 172.21.15.142:0/396702845 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x559a98c840e0 msgr2=0x559a98c864d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:42.296 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.293+0000 7fc2c8b75800 1 --2- 172.21.15.142:0/396702845 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x559a98c840e0 0x559a98c864d0 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:42.296 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.293+0000 7fc2c8b75800 1 -- 172.21.15.142:0/396702845 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fc19003cf60 msgr2=0x7fc19003f420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:42.296 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.293+0000 7fc2c8b75800 1 --2- 172.21.15.142:0/396702845 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fc19003cf60 0x7fc19003f420 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fc2b8052f70 tx=0x7fc2b8088000 comp rx=0 tx=0).stop 2024-09-22T08:37:42.296 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.293+0000 7fc2c8b75800 1 -- 172.21.15.142:0/396702845 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559a98c6c7a0 msgr2=0x559a98c73d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:42.297 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.293+0000 7fc2bde5e640 1 -- 172.21.15.142:0/396702845 reap_dead start 2024-09-22T08:37:42.297 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.293+0000 7fc2c8b75800 1 --2- 172.21.15.142:0/396702845 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559a98c6c7a0 0x559a98c73d70 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fc2c0020790 tx=0x7fc2c00547a0 comp rx=0 tx=0).stop 2024-09-22T08:37:42.297 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.293+0000 7fc2c8b75800 1 -- 172.21.15.142:0/396702845 shutdown_connections 2024-09-22T08:37:42.297 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.293+0000 7fc2c8b75800 1 --2- 172.21.15.142:0/396702845 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559a98c6c7a0 0x559a98c73d70 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:42.297 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.293+0000 7fc2c8b75800 1 -- 172.21.15.142:0/396702845 >> 172.21.15.142:0/396702845 conn(0x559a98c68be0 msgr2=0x559a98c66df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:37:42.297 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.293+0000 7fc2c8b75800 1 -- 172.21.15.142:0/396702845 shutdown_connections 2024-09-22T08:37:42.297 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.293+0000 7fc2c8b75800 1 -- 172.21.15.142:0/396702845 wait complete. 2024-09-22T08:37:42.297 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.293+0000 7fc2c8b75800 1 -- 172.21.15.142:0/4241343373 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fc1a003cfb0 msgr2=0x7fc1a003f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:42.297 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.293+0000 7fc2c8b75800 1 --2- 172.21.15.142:0/4241343373 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fc1a003cfb0 0x7fc1a003f470 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fc2b807b030 tx=0x7fc2b805eef0 comp rx=0 tx=0).stop 2024-09-22T08:37:42.297 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.293+0000 7fc2c8b75800 1 -- 172.21.15.142:0/4241343373 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559a98c5fd20 msgr2=0x559a98c60140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:42.297 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.293+0000 7fc2c8b75800 1 --2- 172.21.15.142:0/4241343373 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559a98c5fd20 0x559a98c60140 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x559a98c41910 tx=0x7fc2c00167b0 comp rx=0 tx=0).stop 2024-09-22T08:37:42.297 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.293+0000 7fc2c8b75800 1 -- 172.21.15.142:0/4241343373 shutdown_connections 2024-09-22T08:37:42.297 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.293+0000 7fc2c8b75800 1 --2- 172.21.15.142:0/4241343373 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fc1a003cfb0 0x7fc1a003f470 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:42.297 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.293+0000 7fc2c8b75800 1 --2- 172.21.15.142:0/4241343373 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559a98c5fd20 0x559a98c60140 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:42.298 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.293+0000 7fc2c8b75800 1 -- 172.21.15.142:0/4241343373 >> 172.21.15.142:0/4241343373 conn(0x559a98c4fcc0 msgr2=0x559a98c500a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:37:42.298 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.293+0000 7fc2c8b75800 1 -- 172.21.15.142:0/4241343373 shutdown_connections 2024-09-22T08:37:42.298 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.294+0000 7fc2c8b75800 1 -- 172.21.15.142:0/4241343373 wait complete. 2024-09-22T08:37:42.298 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.294+0000 7fc2c8b75800 1 -- 172.21.15.142:0/1510099019 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x559a98b4ba60 msgr2=0x559a98c47f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:42.298 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.294+0000 7fc2c8b75800 1 --2- 172.21.15.142:0/1510099019 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x559a98b4ba60 0x559a98c47f60 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:42.298 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.294+0000 7fc2c8b75800 1 -- 172.21.15.142:0/1510099019 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x559a98c4a340 msgr2=0x559a98c4c7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:42.298 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.294+0000 7fc2c8b75800 1 --2- 172.21.15.142:0/1510099019 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x559a98c4a340 0x559a98c4c7c0 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:42.298 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.294+0000 7fc2c8b75800 1 -- 172.21.15.142:0/1510099019 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fc1ac03d000 msgr2=0x7fc1ac03f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:42.298 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.294+0000 7fc2c8b75800 1 --2- 172.21.15.142:0/1510099019 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fc1ac03d000 0x7fc1ac03f4c0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fc2b0001d70 tx=0x7fc2b00012d0 comp rx=0 tx=0).stop 2024-09-22T08:37:42.298 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.294+0000 7fc2c8b75800 1 -- 172.21.15.142:0/1510099019 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559a98b4a820 msgr2=0x559a98c40910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:42.298 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.294+0000 7fc2c8b75800 1 --2- 172.21.15.142:0/1510099019 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559a98b4a820 0x559a98c40910 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fc2b8025c20 tx=0x7fc2b8002fb0 comp rx=0 tx=0).stop 2024-09-22T08:37:42.298 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.294+0000 7fc2c8b75800 1 -- 172.21.15.142:0/1510099019 shutdown_connections 2024-09-22T08:37:42.298 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.294+0000 7fc2c8b75800 1 --2- 172.21.15.142:0/1510099019 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x559a98c4a340 0x559a98c4c7c0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:42.299 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.294+0000 7fc2c8b75800 1 --2- 172.21.15.142:0/1510099019 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x559a98b4ba60 0x559a98c47f60 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:42.299 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.294+0000 7fc2c8b75800 1 --2- 172.21.15.142:0/1510099019 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fc1ac03d000 0x7fc1ac03f4c0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:42.299 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.294+0000 7fc2c8b75800 1 --2- 172.21.15.142:0/1510099019 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559a98b4a820 0x559a98c40910 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:42.299 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.294+0000 7fc2c8b75800 1 -- 172.21.15.142:0/1510099019 >> 172.21.15.142:0/1510099019 conn(0x559a98b45bf0 msgr2=0x559a98c34180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:37:42.299 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.294+0000 7fc2c8b75800 1 -- 172.21.15.142:0/1510099019 shutdown_connections 2024-09-22T08:37:42.299 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.294+0000 7fc2c8b75800 1 -- 172.21.15.142:0/1510099019 wait complete. 2024-09-22T08:37:42.306 DEBUG:tasks.util.rgw: json result: {'user_id': 'bar', 'display_name': 'Bar', 'email': '', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'bar', 'access_key': 'NX5QOQKC6BH2IDN8HC7A', 'secret_key': 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', 'active': True, 'create_date': '2024-09-22T08:37:42.279413Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-22T08:37:42.279403Z', 'tags': [], 'group_ids': []} 2024-09-22T08:37:42.319 INFO:tasks.radosgw_admin:RL: create_bucket myfoo6 bar bytes_out=0 bytes_in=0 failed=False 2024-09-22T08:37:42.324 INFO:tasks.radosgw_admin:RL: put_obj myfoo6 bar bytes_out=8 bytes_in=0 failed=False 2024-09-22T08:37:42.324 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rename', '--uid', 'bar', '--new-uid', 'bud'] 2024-09-22T08:37:42.324 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rename', '--uid', 'bar', '--new-uid', 'bud'] 2024-09-22T08:37:42.324 DEBUG:teuthology.orchestra.run.smithi142:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rename --uid bar --new-uid bud 2024-09-22T08:37:42.370 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:37:42.370 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:37:42.371 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.369+0000 7f98cff26800 1 Processor -- start 2024-09-22T08:37:42.371 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.370+0000 7f98cff26800 1 -- start start 2024-09-22T08:37:42.371 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.370+0000 7f98cff26800 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55d3faf49be0 0x55d3faf4f570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:42.371 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.370+0000 7f98cff26800 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55d3fadd4a20 con 0x55d3faf487d0 2024-09-22T08:37:42.371 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.370+0000 7f98cff26800 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x55d3fadd47d0 con 0x55d3faf49be0 2024-09-22T08:37:42.372 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.370+0000 7f98cb3d8640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55d3faf49be0 0x55d3faf4f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:42.372 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.370+0000 7f98cbbd9640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x55d3faf487d0 0x55d3faf494d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.142:50294/0 (socket says 172.21.15.142:50294) 2024-09-22T08:37:42.372 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.370+0000 7f98cbbd9640 1 -- 172.21.15.142:0/351050151 learned_addr learned my addr 172.21.15.142:0/351050151 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-09-22T08:37:42.372 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.370+0000 7f98cb3d8640 1 -- 172.21.15.142:0/351050151 >> v1:172.21.15.31:6789/0 conn(0x55d3faf487d0 legacy=0x55d3faf494d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:42.372 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.370+0000 7f98cb3d8640 1 -- 172.21.15.142:0/351050151 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d3faf48ed0 con 0x55d3faf49be0 2024-09-22T08:37:42.373 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.372+0000 7f98cb3d8640 1 --2- 172.21.15.142:0/351050151 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d3faf49be0 0x55d3faf4f570 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f98c000a470 tx=0x7f98c0045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84cc662ffb626da3 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:42.374 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.372+0000 7f98cabd7640 1 -- 172.21.15.142:0/351050151 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98c0053570 con 0x55d3faf49be0 2024-09-22T08:37:42.374 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.372+0000 7f98cabd7640 1 -- 172.21.15.142:0/351050151 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98c0058070 con 0x55d3faf49be0 2024-09-22T08:37:42.374 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.372+0000 7f98cabd7640 1 -- 172.21.15.142:0/351050151 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98c0053880 con 0x55d3faf49be0 2024-09-22T08:37:42.375 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.373+0000 7f98cff26800 1 -- 172.21.15.142:0/351050151 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d3faf49be0 msgr2=0x55d3faf4f570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:42.375 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.373+0000 7f98cff26800 1 --2- 172.21.15.142:0/351050151 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d3faf49be0 0x55d3faf4f570 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f98c000a470 tx=0x7f98c0045a20 comp rx=0 tx=0).stop 2024-09-22T08:37:42.375 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.373+0000 7f98cff26800 1 -- 172.21.15.142:0/351050151 shutdown_connections 2024-09-22T08:37:42.375 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.373+0000 7f98cff26800 1 --2- 172.21.15.142:0/351050151 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d3faf49be0 0x55d3faf4f570 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:42.375 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.373+0000 7f98cff26800 1 -- 172.21.15.142:0/351050151 >> 172.21.15.142:0/351050151 conn(0x55d3faf43ba0 msgr2=0x55d3faf46000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:37:42.375 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.373+0000 7f98cff26800 1 -- 172.21.15.142:0/351050151 shutdown_connections 2024-09-22T08:37:42.375 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.373+0000 7f98cff26800 1 -- 172.21.15.142:0/351050151 wait complete. 2024-09-22T08:37:42.388 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.387+0000 7f98cff26800 1 Processor -- start 2024-09-22T08:37:42.388 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.387+0000 7f98cff26800 1 -- start start 2024-09-22T08:37:42.388 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.387+0000 7f98cff26800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d3faf487d0 0x55d3faebd1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:42.388 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.387+0000 7f98cff26800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55d3fade1dd0 con 0x55d3faf487d0 2024-09-22T08:37:42.389 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.388+0000 7f98cbbd9640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d3faf487d0 0x55d3faebd1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:42.390 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.388+0000 7f98cbbd9640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d3faf487d0 0x55d3faebd1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:55920/0 (socket says 172.21.15.142:55920) 2024-09-22T08:37:42.390 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.388+0000 7f98cbbd9640 1 -- 172.21.15.142:0/1353131341 learned_addr learned my addr 172.21.15.142:0/1353131341 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:37:42.390 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.388+0000 7f98cbbd9640 1 -- 172.21.15.142:0/1353131341 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d3fb03bbc0 con 0x55d3faf487d0 2024-09-22T08:37:42.390 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.388+0000 7f98cbbd9640 1 --2- 172.21.15.142:0/1353131341 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d3faf487d0 0x55d3faebd1d0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f98bc001df0 tx=0x7f98bc00b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=289c5fb5422df646 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:42.390 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.388+0000 7f97b9e0b640 1 -- 172.21.15.142:0/1353131341 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98bc012020 con 0x55d3faf487d0 2024-09-22T08:37:42.390 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.388+0000 7f97b9e0b640 1 -- 172.21.15.142:0/1353131341 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98bc00e470 con 0x55d3faf487d0 2024-09-22T08:37:42.390 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.388+0000 7f97b9e0b640 1 -- 172.21.15.142:0/1353131341 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98bc00e7f0 con 0x55d3faf487d0 2024-09-22T08:37:42.392 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.389+0000 7f98cff26800 1 -- 172.21.15.142:0/1353131341 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d3faf487d0 msgr2=0x55d3faebd1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:42.392 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.389+0000 7f98cff26800 1 --2- 172.21.15.142:0/1353131341 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d3faf487d0 0x55d3faebd1d0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f98bc001df0 tx=0x7f98bc00b6c0 comp rx=0 tx=0).stop 2024-09-22T08:37:42.392 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.389+0000 7f98cff26800 1 -- 172.21.15.142:0/1353131341 shutdown_connections 2024-09-22T08:37:42.392 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.389+0000 7f98cff26800 1 --2- 172.21.15.142:0/1353131341 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d3faf487d0 0x55d3faebd1d0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:42.392 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.389+0000 7f98cff26800 1 -- 172.21.15.142:0/1353131341 >> 172.21.15.142:0/1353131341 conn(0x55d3faf43ba0 msgr2=0x55d3fb033880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:37:42.392 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.389+0000 7f98cff26800 1 -- 172.21.15.142:0/1353131341 shutdown_connections 2024-09-22T08:37:42.392 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.389+0000 7f98cff26800 1 -- 172.21.15.142:0/1353131341 wait complete. 2024-09-22T08:37:42.393 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.389+0000 7f98cff26800 1 Processor -- start 2024-09-22T08:37:42.393 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.389+0000 7f98cff26800 1 -- start start 2024-09-22T08:37:42.393 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.390+0000 7f98cff26800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d3faf487d0 0x55d3fb0392d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:42.393 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.390+0000 7f98cff26800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55d3faf4fab0 con 0x55d3faf487d0 2024-09-22T08:37:42.393 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.390+0000 7f98cbbd9640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d3faf487d0 0x55d3fb0392d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:42.393 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.390+0000 7f98cbbd9640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d3faf487d0 0x55d3fb0392d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:55924/0 (socket says 172.21.15.142:55924) 2024-09-22T08:37:42.393 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.390+0000 7f98cbbd9640 1 -- 172.21.15.142:0/3386246350 learned_addr learned my addr 172.21.15.142:0/3386246350 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:37:42.393 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.390+0000 7f98cbbd9640 1 -- 172.21.15.142:0/3386246350 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d3fb039830 con 0x55d3faf487d0 2024-09-22T08:37:42.393 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.390+0000 7f98cbbd9640 1 --2- 172.21.15.142:0/3386246350 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d3faf487d0 0x55d3fb0392d0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x55d3faebcd00 tx=0x7f98bc000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:42.393 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.390+0000 7f97b3fff640 1 -- 172.21.15.142:0/3386246350 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98bc012030 con 0x55d3faf487d0 2024-09-22T08:37:42.393 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.390+0000 7f97b3fff640 1 -- 172.21.15.142:0/3386246350 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98bc01a6d0 con 0x55d3faf487d0 2024-09-22T08:37:42.393 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.390+0000 7f98cff26800 1 -- 172.21.15.142:0/3386246350 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d3fb037be0 con 0x55d3faf487d0 2024-09-22T08:37:42.393 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.390+0000 7f97b3fff640 1 -- 172.21.15.142:0/3386246350 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98bc01a9d0 con 0x55d3faf487d0 2024-09-22T08:37:42.393 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.391+0000 7f98cff26800 1 -- 172.21.15.142:0/3386246350 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d3fb0381a0 con 0x55d3faf487d0 2024-09-22T08:37:42.396 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.391+0000 7f97b3fff640 1 -- 172.21.15.142:0/3386246350 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f98bc015020 con 0x55d3faf487d0 2024-09-22T08:37:42.396 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.392+0000 7f97b3fff640 1 --2- 172.21.15.142:0/3386246350 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f97b403cfb0 0x7f97b403f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:42.397 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.392+0000 7f97b3fff640 1 -- 172.21.15.142:0/3386246350 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5938+0+0 (secure 0 0 0) 0x7f98bc020030 con 0x55d3faf487d0 2024-09-22T08:37:42.397 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.392+0000 7f98cb3d8640 1 --2- 172.21.15.142:0/3386246350 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f97b403cfb0 0x7f97b403f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:42.397 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.392+0000 7f98cff26800 1 --2- 172.21.15.142:0/3386246350 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55d3faf49be0 0x55d3fb04a030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:42.397 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.392+0000 7f98cff26800 1 -- 172.21.15.142:0/3386246350 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d3fb04a5c0 con 0x55d3faf49be0 2024-09-22T08:37:42.397 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.392+0000 7f98cc3da640 1 --2- 172.21.15.142:0/3386246350 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55d3faf49be0 0x55d3fb04a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:42.397 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.392+0000 7f98cb3d8640 1 --2- 172.21.15.142:0/3386246350 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f97b403cfb0 0x7f97b403f470 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f98c0057000 tx=0x7f98c0052000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:42.397 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.392+0000 7f98cc3da640 1 --2- 172.21.15.142:0/3386246350 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55d3faf49be0 0x55d3fb04a030 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:42.397 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.392+0000 7f98cc3da640 1 -- 172.21.15.142:0/3386246350 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f98c400a4d0 con 0x55d3faf49be0 2024-09-22T08:37:42.397 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.393+0000 7f98cff26800 1 -- 172.21.15.142:0/3386246350 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d3fb0386b0 con 0x55d3faf49be0 2024-09-22T08:37:42.397 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.393+0000 7f98cc3da640 1 -- 172.21.15.142:0/3386246350 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f98c400a4d0 con 0x55d3faf49be0 2024-09-22T08:37:42.397 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.393+0000 7f98cff26800 1 --2- 172.21.15.142:0/3386246350 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55d3fb04c8f0 0x55d3fb04ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:42.397 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.393+0000 7f98cff26800 1 -- 172.21.15.142:0/3386246350 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:3 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d3fb04f3b0 con 0x55d3fb04c8f0 2024-09-22T08:37:42.397 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.393+0000 7f98cbbd9640 1 --2- 172.21.15.142:0/3386246350 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55d3fb04c8f0 0x55d3fb04ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:42.398 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.393+0000 7f98cbbd9640 1 --2- 172.21.15.142:0/3386246350 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55d3fb04c8f0 0x55d3fb04ece0 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:42.398 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.394+0000 7f98cbbd9640 1 -- 172.21.15.142:0/3386246350 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(3 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f98bc01ad50 con 0x55d3fb04c8f0 2024-09-22T08:37:42.398 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.394+0000 7f98cff26800 1 -- 172.21.15.142:0/3386246350 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d3fb04b790 con 0x55d3faf49be0 2024-09-22T08:37:42.398 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.394+0000 7f98cc3da640 1 -- 172.21.15.142:0/3386246350 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f98c400a4d0 con 0x55d3faf49be0 2024-09-22T08:37:42.398 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.394+0000 7f98cff26800 1 -- 172.21.15.142:0/3386246350 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d3fb04bc30 con 0x55d3fb04c8f0 2024-09-22T08:37:42.398 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.394+0000 7f98cbbd9640 1 -- 172.21.15.142:0/3386246350 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(5 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f98bc01ad50 con 0x55d3fb04c8f0 2024-09-22T08:37:42.398 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.394+0000 7f98cff26800 1 Processor -- start 2024-09-22T08:37:42.398 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.395+0000 7f98cff26800 1 -- start start 2024-09-22T08:37:42.398 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.395+0000 7f98cff26800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d3fb05dd50 0x55d3fb05e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:42.398 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.395+0000 7f98cff26800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55d3fae40d50 con 0x55d3fb05dd50 2024-09-22T08:37:42.398 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.395+0000 7f98cc3da640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d3fb05dd50 0x55d3fb05e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:42.398 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.395+0000 7f98cc3da640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d3fb05dd50 0x55d3fb05e170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:55932/0 (socket says 172.21.15.142:55932) 2024-09-22T08:37:42.398 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.395+0000 7f98cc3da640 1 -- 172.21.15.142:0/25440620 learned_addr learned my addr 172.21.15.142:0/25440620 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:37:42.399 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.395+0000 7f98cc3da640 1 -- 172.21.15.142:0/25440620 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d3fb05e7b0 con 0x55d3fb05dd50 2024-09-22T08:37:42.399 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.396+0000 7f98cc3da640 1 --2- 172.21.15.142:0/25440620 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d3fb05dd50 0x55d3fb05e170 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x55d3fb0383c0 tx=0x7f98c40167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:42.406 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.396+0000 7f97b17fa640 1 -- 172.21.15.142:0/25440620 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98c4013640 con 0x55d3fb05dd50 2024-09-22T08:37:42.406 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.396+0000 7f97b17fa640 1 -- 172.21.15.142:0/25440620 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98c40137e0 con 0x55d3fb05dd50 2024-09-22T08:37:42.406 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.396+0000 7f97b17fa640 1 -- 172.21.15.142:0/25440620 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98c4013ae0 con 0x55d3fb05dd50 2024-09-22T08:37:42.406 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.396+0000 7f98cff26800 1 -- 172.21.15.142:0/25440620 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d3fb05efe0 con 0x55d3fb05dd50 2024-09-22T08:37:42.406 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.396+0000 7f98cff26800 1 -- 172.21.15.142:0/25440620 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d3fb05f580 con 0x55d3fb05dd50 2024-09-22T08:37:42.406 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.397+0000 7f97b17fa640 1 -- 172.21.15.142:0/25440620 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f98c4011040 con 0x55d3fb05dd50 2024-09-22T08:37:42.406 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.397+0000 7f97b17fa640 1 --2- 172.21.15.142:0/25440620 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f97a403cfb0 0x7f97a403f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:42.406 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.397+0000 7f97b17fa640 1 -- 172.21.15.142:0/25440620 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5938+0+0 (secure 0 0 0) 0x7f98c400e040 con 0x55d3fb05dd50 2024-09-22T08:37:42.406 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.397+0000 7f98cbbd9640 1 --2- 172.21.15.142:0/25440620 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f97a403cfb0 0x7f97a403f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:42.406 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.397+0000 7f98cff26800 1 Processor -- start 2024-09-22T08:37:42.407 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.397+0000 7f98cbbd9640 1 --2- 172.21.15.142:0/25440620 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f97a403cfb0 0x7f97a403f470 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f98bc052a50 tx=0x7f98bc041040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:42.407 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.397+0000 7f98cff26800 1 -- start start 2024-09-22T08:37:42.407 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.397+0000 7f98cff26800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d3fb06a7f0 0x55d3fb06abf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:42.407 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.397+0000 7f98cff26800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55d3fb03bea0 con 0x55d3fb06a7f0 2024-09-22T08:37:42.407 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.398+0000 7f98cc3da640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d3fb06a7f0 0x55d3fb06abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:42.407 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.398+0000 7f98cc3da640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d3fb06a7f0 0x55d3fb06abf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:55946/0 (socket says 172.21.15.142:55946) 2024-09-22T08:37:42.407 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.398+0000 7f98cc3da640 1 -- 172.21.15.142:0/201680501 learned_addr learned my addr 172.21.15.142:0/201680501 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:37:42.407 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.398+0000 7f98cc3da640 1 -- 172.21.15.142:0/201680501 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d3fb06b1e0 con 0x55d3fb06a7f0 2024-09-22T08:37:42.407 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.398+0000 7f98cc3da640 1 --2- 172.21.15.142:0/201680501 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d3fb06a7f0 0x55d3fb06abf0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f98c4054840 tx=0x7f98c4014480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2a9f0357b0e8a9a server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:42.407 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.398+0000 7f97aaffd640 1 -- 172.21.15.142:0/201680501 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98c4021a40 con 0x55d3fb06a7f0 2024-09-22T08:37:42.407 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.398+0000 7f97aaffd640 1 -- 172.21.15.142:0/201680501 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98c4052070 con 0x55d3fb06a7f0 2024-09-22T08:37:42.407 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.398+0000 7f97aaffd640 1 -- 172.21.15.142:0/201680501 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98c40215b0 con 0x55d3fb06a7f0 2024-09-22T08:37:42.407 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.399+0000 7f98cff26800 1 -- 172.21.15.142:0/201680501 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d3fb06a7f0 msgr2=0x55d3fb06abf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:42.408 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.399+0000 7f98cff26800 1 --2- 172.21.15.142:0/201680501 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d3fb06a7f0 0x55d3fb06abf0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f98c4054840 tx=0x7f98c4014480 comp rx=0 tx=0).stop 2024-09-22T08:37:42.408 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.399+0000 7f98cff26800 1 -- 172.21.15.142:0/201680501 shutdown_connections 2024-09-22T08:37:42.408 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.399+0000 7f98cff26800 1 --2- 172.21.15.142:0/201680501 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d3fb06a7f0 0x55d3fb06abf0 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:42.408 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.399+0000 7f98cff26800 1 -- 172.21.15.142:0/201680501 >> 172.21.15.142:0/201680501 conn(0x55d3fb066c10 msgr2=0x55d3fb064e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:37:42.408 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.399+0000 7f98cff26800 1 -- 172.21.15.142:0/201680501 shutdown_connections 2024-09-22T08:37:42.408 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.399+0000 7f98cff26800 1 -- 172.21.15.142:0/201680501 wait complete. 2024-09-22T08:37:42.408 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.399+0000 7f98cff26800 1 Processor -- start 2024-09-22T08:37:42.408 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.399+0000 7f98cff26800 1 -- start start 2024-09-22T08:37:42.408 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.399+0000 7f98cff26800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d3fb06a7f0 0x55d3fb071d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:42.408 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.399+0000 7f98cff26800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55d3fb06b7d0 con 0x55d3fb06a7f0 2024-09-22T08:37:42.408 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.399+0000 7f98cc3da640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d3fb06a7f0 0x55d3fb071d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:42.408 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.399+0000 7f98cc3da640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d3fb06a7f0 0x55d3fb071d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:55948/0 (socket says 172.21.15.142:55948) 2024-09-22T08:37:42.408 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.399+0000 7f98cc3da640 1 -- 172.21.15.142:0/773279257 learned_addr learned my addr 172.21.15.142:0/773279257 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:37:42.408 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.400+0000 7f98cc3da640 1 -- 172.21.15.142:0/773279257 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d3fb0722f0 con 0x55d3fb06a7f0 2024-09-22T08:37:42.408 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.400+0000 7f98cc3da640 1 --2- 172.21.15.142:0/773279257 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d3fb06a7f0 0x55d3fb071d90 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f98c4020790 tx=0x7f98c40547a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:42.409 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.400+0000 7f97a97fa640 1 -- 172.21.15.142:0/773279257 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98c4013c80 con 0x55d3fb06a7f0 2024-09-22T08:37:42.409 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.400+0000 7f97a97fa640 1 -- 172.21.15.142:0/773279257 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98c4013e20 con 0x55d3fb06a7f0 2024-09-22T08:37:42.409 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.400+0000 7f98cff26800 1 -- 172.21.15.142:0/773279257 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d3fb072580 con 0x55d3fb06a7f0 2024-09-22T08:37:42.409 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.400+0000 7f97a97fa640 1 -- 172.21.15.142:0/773279257 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98c4045b30 con 0x55d3fb06a7f0 2024-09-22T08:37:42.409 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.400+0000 7f98cff26800 1 -- 172.21.15.142:0/773279257 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d3fb073110 con 0x55d3fb06a7f0 2024-09-22T08:37:42.409 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.401+0000 7f97a97fa640 1 -- 172.21.15.142:0/773279257 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f98c40451d0 con 0x55d3fb06a7f0 2024-09-22T08:37:42.409 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.401+0000 7f97a97fa640 1 --2- 172.21.15.142:0/773279257 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f979403cfb0 0x7f979403f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:42.409 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.401+0000 7f97a97fa640 1 -- 172.21.15.142:0/773279257 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5938+0+0 (secure 0 0 0) 0x7f98c404c030 con 0x55d3fb06a7f0 2024-09-22T08:37:42.409 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.401+0000 7f98cbbd9640 1 --2- 172.21.15.142:0/773279257 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f979403cfb0 0x7f979403f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:42.409 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.401+0000 7f98cbbd9640 1 --2- 172.21.15.142:0/773279257 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f979403cfb0 0x7f979403f470 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f98bc022a80 tx=0x7f98bc054420 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:42.409 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.402+0000 7f98cff26800 20 rados->read ofs=0 len=0 2024-09-22T08:37:42.409 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.402+0000 7f98cff26800 1 --2- 172.21.15.142:0/773279257 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55d3fb07d710 0x55d3fb07fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:42.409 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.402+0000 7f98cff26800 1 -- 172.21.15.142:0/773279257 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d3fb080320 con 0x55d3fb07d710 2024-09-22T08:37:42.410 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.402+0000 7f98cb3d8640 1 --2- 172.21.15.142:0/773279257 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55d3fb07d710 0x55d3fb07fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:42.410 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.402+0000 7f98cb3d8640 1 --2- 172.21.15.142:0/773279257 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55d3fb07d710 0x55d3fb07fbd0 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:42.410 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.402+0000 7f98cb3d8640 1 -- 172.21.15.142:0/773279257 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f98c0051070 con 0x55d3fb07d710 2024-09-22T08:37:42.410 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.402+0000 7f98cff26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:42.410 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.402+0000 7f98cff26800 20 realm 2024-09-22T08:37:42.410 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.402+0000 7f98cff26800 20 rados->read ofs=0 len=0 2024-09-22T08:37:42.410 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.402+0000 7f98cff26800 1 -- 172.21.15.142:0/773279257 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d3fb080750 con 0x55d3fb07d710 2024-09-22T08:37:42.410 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.403+0000 7f98cb3d8640 1 -- 172.21.15.142:0/773279257 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f98c0051070 con 0x55d3fb07d710 2024-09-22T08:37:42.410 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.403+0000 7f98cff26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:42.410 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.403+0000 7f98cff26800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:37:42.410 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.403+0000 7f98cff26800 20 rados->read ofs=0 len=0 2024-09-22T08:37:42.410 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.403+0000 7f98cff26800 1 -- 172.21.15.142:0/773279257 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d3fb081020 con 0x55d3fb07d710 2024-09-22T08:37:42.410 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.403+0000 7f98cb3d8640 1 -- 172.21.15.142:0/773279257 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f98c0051070 con 0x55d3fb07d710 2024-09-22T08:37:42.410 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.403+0000 7f98cff26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:42.411 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.403+0000 7f98cff26800 20 rados->read ofs=0 len=0 2024-09-22T08:37:42.411 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.403+0000 7f98cff26800 1 -- 172.21.15.142:0/773279257 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d3fb0813c0 con 0x55d3fb07d710 2024-09-22T08:37:42.411 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.403+0000 7f98cb3d8640 1 -- 172.21.15.142:0/773279257 <== osd.1 v2:172.21.15.142:6816/3192108003 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f98c0051070 con 0x55d3fb07d710 2024-09-22T08:37:42.411 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.403+0000 7f98cff26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:37:42.411 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.403+0000 7f98cff26800 20 rados->read ofs=0 len=0 2024-09-22T08:37:42.411 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.403+0000 7f98cff26800 1 --2- 172.21.15.142:0/773279257 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55d3fb082120 0x55d3fb084510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:42.411 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.403+0000 7f98cff26800 1 -- 172.21.15.142:0/773279257 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d3fb084b20 con 0x55d3fb082120 2024-09-22T08:37:42.411 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.403+0000 7f98cc3da640 1 --2- 172.21.15.142:0/773279257 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55d3fb082120 0x55d3fb084510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:42.411 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.403+0000 7f98cc3da640 1 --2- 172.21.15.142:0/773279257 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55d3fb082120 0x55d3fb084510 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:42.411 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.404+0000 7f98cc3da640 1 -- 172.21.15.142:0/773279257 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(5 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f98c403a070 con 0x55d3fb082120 2024-09-22T08:37:42.411 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.404+0000 7f98cff26800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:37:42.411 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.404+0000 7f98cff26800 20 searching for the correct realm 2024-09-22T08:37:42.411 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.404+0000 7f98cff26800 1 -- 172.21.15.142:0/773279257 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d3fb086450 con 0x55d3fb082120 2024-09-22T08:37:42.411 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.404+0000 7f98cc3da640 1 -- 172.21.15.142:0/773279257 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98c403a070 con 0x55d3fb082120 2024-09-22T08:37:42.412 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.404+0000 7f98cc3da640 1 --2- 172.21.15.142:0/773279257 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f98c4054c20 0x7f98c4035080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:42.412 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.404+0000 7f98cc3da640 1 -- 172.21.15.142:0/773279257 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d3fb086450 con 0x7f98c4054c20 2024-09-22T08:37:42.412 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.404+0000 7f98cbbd9640 1 --2- 172.21.15.142:0/773279257 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f98c4054c20 0x7f98c4035080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:42.412 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.404+0000 7f98cbbd9640 1 --2- 172.21.15.142:0/773279257 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f98c4054c20 0x7f98c4035080 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:42.412 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.405+0000 7f98cbbd9640 1 -- 172.21.15.142:0/773279257 <== osd.2 v2:172.21.15.142:6808/279438927 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98bc01ad50 con 0x7f98c4054c20 2024-09-22T08:37:42.412 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.405+0000 7f98cbbd9640 1 --2- 172.21.15.142:0/773279257 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f98bc017050 0x7f98bc04b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:42.412 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.405+0000 7f98cbbd9640 1 -- 172.21.15.142:0/773279257 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d3fb086450 con 0x7f98bc017050 2024-09-22T08:37:42.412 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.405+0000 7f98cb3d8640 1 --2- 172.21.15.142:0/773279257 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f98bc017050 0x7f98bc04b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:42.421 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.405+0000 7f98cb3d8640 1 --2- 172.21.15.142:0/773279257 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f98bc017050 0x7f98bc04b950 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:42.421 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.405+0000 7f98cb3d8640 1 -- 172.21.15.142:0/773279257 <== osd.0 v2:172.21.15.31:6800/168281188 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98c0051070 con 0x7f98bc017050 2024-09-22T08:37:42.421 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.405+0000 7f98cb3d8640 1 -- 172.21.15.142:0/773279257 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d3fb086450 con 0x55d3fb07d710 2024-09-22T08:37:42.421 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.406+0000 7f98cb3d8640 1 -- 172.21.15.142:0/773279257 <== osd.1 v2:172.21.15.142:6816/3192108003 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98c0051070 con 0x55d3fb07d710 2024-09-22T08:37:42.421 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.406+0000 7f98cb3d8640 1 -- 172.21.15.142:0/773279257 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d3fb086450 con 0x55d3fb07d710 2024-09-22T08:37:42.421 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.406+0000 7f98cb3d8640 1 -- 172.21.15.142:0/773279257 <== osd.1 v2:172.21.15.142:6816/3192108003 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98c0051070 con 0x55d3fb07d710 2024-09-22T08:37:42.422 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.406+0000 7f98cb3d8640 1 -- 172.21.15.142:0/773279257 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d3fb086450 con 0x55d3fb07d710 2024-09-22T08:37:42.422 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.406+0000 7f98cb3d8640 1 -- 172.21.15.142:0/773279257 <== osd.1 v2:172.21.15.142:6816/3192108003 7 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98c0051070 con 0x55d3fb07d710 2024-09-22T08:37:42.422 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.406+0000 7f98cb3d8640 1 -- 172.21.15.142:0/773279257 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d3fb086450 con 0x7f98bc017050 2024-09-22T08:37:42.422 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.406+0000 7f98cb3d8640 1 -- 172.21.15.142:0/773279257 <== osd.0 v2:172.21.15.31:6800/168281188 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98c0051070 con 0x7f98bc017050 2024-09-22T08:37:42.422 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.406+0000 7f98cb3d8640 1 -- 172.21.15.142:0/773279257 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d3fb086450 con 0x7f98c4054c20 2024-09-22T08:37:42.422 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.407+0000 7f98cbbd9640 1 -- 172.21.15.142:0/773279257 <== osd.2 v2:172.21.15.142:6808/279438927 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98bc01ad50 con 0x7f98c4054c20 2024-09-22T08:37:42.422 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.407+0000 7f98cbbd9640 1 -- 172.21.15.142:0/773279257 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d3fb086450 con 0x55d3fb082120 2024-09-22T08:37:42.422 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.407+0000 7f98cc3da640 1 -- 172.21.15.142:0/773279257 <== osd.3 v2:172.21.15.142:6800/1064901393 3 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98c403a070 con 0x55d3fb082120 2024-09-22T08:37:42.422 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.407+0000 7f98cc3da640 1 -- 172.21.15.142:0/773279257 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d3fb086450 con 0x55d3fb07d710 2024-09-22T08:37:42.422 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.407+0000 7f98cb3d8640 1 -- 172.21.15.142:0/773279257 <== osd.1 v2:172.21.15.142:6816/3192108003 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98c0051070 con 0x55d3fb07d710 2024-09-22T08:37:42.422 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.407+0000 7f98cb3d8640 1 -- 172.21.15.142:0/773279257 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d3fb086450 con 0x7f98bc017050 2024-09-22T08:37:42.422 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.407+0000 7f98cb3d8640 1 -- 172.21.15.142:0/773279257 <== osd.0 v2:172.21.15.31:6800/168281188 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98c0051070 con 0x7f98bc017050 2024-09-22T08:37:42.422 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.407+0000 7f98cb3d8640 1 -- 172.21.15.142:0/773279257 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d3fb086450 con 0x55d3fb07d710 2024-09-22T08:37:42.423 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.407+0000 7f98cb3d8640 1 -- 172.21.15.142:0/773279257 <== osd.1 v2:172.21.15.142:6816/3192108003 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98c0051070 con 0x55d3fb07d710 2024-09-22T08:37:42.423 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.407+0000 7f98cb3d8640 1 -- 172.21.15.142:0/773279257 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d3fb086450 con 0x7f98c4054c20 2024-09-22T08:37:42.423 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.408+0000 7f98cbbd9640 1 -- 172.21.15.142:0/773279257 <== osd.2 v2:172.21.15.142:6808/279438927 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f98bc01ad50 con 0x7f98c4054c20 2024-09-22T08:37:42.423 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.408+0000 7f98cbbd9640 1 -- 172.21.15.142:0/773279257 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d3fb086450 con 0x55d3fb082120 2024-09-22T08:37:42.423 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.408+0000 7f98cc3da640 1 -- 172.21.15.142:0/773279257 <== osd.3 v2:172.21.15.142:6800/1064901393 4 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98c403a070 con 0x55d3fb082120 2024-09-22T08:37:42.423 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.408+0000 7f98cc3da640 1 -- 172.21.15.142:0/773279257 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d3fb086450 con 0x55d3fb082120 2024-09-22T08:37:42.423 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.408+0000 7f98cc3da640 1 -- 172.21.15.142:0/773279257 <== osd.3 v2:172.21.15.142:6800/1064901393 5 ==== osd_op_reply(20 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f98c403a070 con 0x55d3fb082120 2024-09-22T08:37:42.423 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.408+0000 7f98cc3da640 1 -- 172.21.15.142:0/773279257 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d3fb086450 con 0x7f98bc017050 2024-09-22T08:37:42.423 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.408+0000 7f98cb3d8640 1 -- 172.21.15.142:0/773279257 <== osd.0 v2:172.21.15.31:6800/168281188 4 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98c0051070 con 0x7f98bc017050 2024-09-22T08:37:42.423 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.408+0000 7f98cb3d8640 1 -- 172.21.15.142:0/773279257 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d3fb086450 con 0x55d3fb082120 2024-09-22T08:37:42.423 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.409+0000 7f98cc3da640 1 -- 172.21.15.142:0/773279257 <== osd.3 v2:172.21.15.142:6800/1064901393 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98c403a070 con 0x55d3fb082120 2024-09-22T08:37:42.423 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.409+0000 7f98cc3da640 1 -- 172.21.15.142:0/773279257 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d3fb086450 con 0x55d3fb082120 2024-09-22T08:37:42.423 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.409+0000 7f98cc3da640 1 -- 172.21.15.142:0/773279257 <== osd.3 v2:172.21.15.142:6800/1064901393 7 ==== osd_op_reply(23 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f98c403a070 con 0x55d3fb082120 2024-09-22T08:37:42.423 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.409+0000 7f98cc3da640 1 -- 172.21.15.142:0/773279257 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d3fb086450 con 0x55d3fb07d710 2024-09-22T08:37:42.424 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.409+0000 7f98cb3d8640 1 -- 172.21.15.142:0/773279257 <== osd.1 v2:172.21.15.142:6816/3192108003 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98c0051070 con 0x55d3fb07d710 2024-09-22T08:37:42.424 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.409+0000 7f98cb3d8640 1 -- 172.21.15.142:0/773279257 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d3fb086450 con 0x55d3fb07d710 2024-09-22T08:37:42.424 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.409+0000 7f98cb3d8640 1 -- 172.21.15.142:0/773279257 <== osd.1 v2:172.21.15.142:6816/3192108003 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f98c0051070 con 0x55d3fb07d710 2024-09-22T08:37:42.424 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.409+0000 7f98cb3d8640 1 -- 172.21.15.142:0/773279257 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d3fb086450 con 0x7f98bc017050 2024-09-22T08:37:42.424 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.410+0000 7f98cb3d8640 1 -- 172.21.15.142:0/773279257 <== osd.0 v2:172.21.15.31:6800/168281188 5 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98c0051070 con 0x7f98bc017050 2024-09-22T08:37:42.424 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.410+0000 7f98cb3d8640 1 -- 172.21.15.142:0/773279257 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d3fb086450 con 0x55d3fb082120 2024-09-22T08:37:42.424 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.410+0000 7f98cc3da640 1 -- 172.21.15.142:0/773279257 <== osd.3 v2:172.21.15.142:6800/1064901393 8 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98c403a070 con 0x55d3fb082120 2024-09-22T08:37:42.424 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.410+0000 7f98cc3da640 1 -- 172.21.15.142:0/773279257 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d3fb086450 con 0x7f98c4054c20 2024-09-22T08:37:42.424 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.410+0000 7f98cbbd9640 1 -- 172.21.15.142:0/773279257 <== osd.2 v2:172.21.15.142:6808/279438927 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98bc01ad50 con 0x7f98c4054c20 2024-09-22T08:37:42.424 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.410+0000 7f98cbbd9640 1 -- 172.21.15.142:0/773279257 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d3fb086450 con 0x55d3fb07d710 2024-09-22T08:37:42.424 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.410+0000 7f98cb3d8640 1 -- 172.21.15.142:0/773279257 <== osd.1 v2:172.21.15.142:6816/3192108003 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98c0051070 con 0x55d3fb07d710 2024-09-22T08:37:42.424 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.410+0000 7f98cb3d8640 1 -- 172.21.15.142:0/773279257 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d3fb086450 con 0x7f98bc017050 2024-09-22T08:37:42.425 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.411+0000 7f98cb3d8640 1 -- 172.21.15.142:0/773279257 <== osd.0 v2:172.21.15.31:6800/168281188 6 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98c0051070 con 0x7f98bc017050 2024-09-22T08:37:42.425 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.411+0000 7f98cb3d8640 1 -- 172.21.15.142:0/773279257 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d3fb086450 con 0x55d3fb082120 2024-09-22T08:37:42.425 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.411+0000 7f98cc3da640 1 -- 172.21.15.142:0/773279257 <== osd.3 v2:172.21.15.142:6800/1064901393 9 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98c403a070 con 0x55d3fb082120 2024-09-22T08:37:42.425 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.411+0000 7f98cc3da640 1 -- 172.21.15.142:0/773279257 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d3fb086450 con 0x7f98bc017050 2024-09-22T08:37:42.425 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.411+0000 7f98cb3d8640 1 -- 172.21.15.142:0/773279257 <== osd.0 v2:172.21.15.31:6800/168281188 7 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98c0051070 con 0x7f98bc017050 2024-09-22T08:37:42.425 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.411+0000 7f98cb3d8640 1 -- 172.21.15.142:0/773279257 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d3fb086450 con 0x7f98c4054c20 2024-09-22T08:37:42.425 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.411+0000 7f98cbbd9640 1 -- 172.21.15.142:0/773279257 <== osd.2 v2:172.21.15.142:6808/279438927 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98bc01ad50 con 0x7f98c4054c20 2024-09-22T08:37:42.425 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.411+0000 7f98cbbd9640 1 -- 172.21.15.142:0/773279257 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d3fb086450 con 0x55d3fb082120 2024-09-22T08:37:42.425 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.412+0000 7f98cc3da640 1 -- 172.21.15.142:0/773279257 <== osd.3 v2:172.21.15.142:6800/1064901393 10 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98c403a070 con 0x55d3fb082120 2024-09-22T08:37:42.425 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.412+0000 7f98cc3da640 1 -- 172.21.15.142:0/773279257 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d3fb086450 con 0x7f98bc017050 2024-09-22T08:37:42.425 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.412+0000 7f98cb3d8640 1 -- 172.21.15.142:0/773279257 <== osd.0 v2:172.21.15.31:6800/168281188 8 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98c0051070 con 0x7f98bc017050 2024-09-22T08:37:42.425 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.412+0000 7f98cb3d8640 1 -- 172.21.15.142:0/773279257 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d3fb086450 con 0x55d3fb07d710 2024-09-22T08:37:42.425 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.412+0000 7f98cb3d8640 1 -- 172.21.15.142:0/773279257 <== osd.1 v2:172.21.15.142:6816/3192108003 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f98c0051070 con 0x55d3fb07d710 2024-09-22T08:37:42.426 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.412+0000 7f98cb3d8640 1 -- 172.21.15.142:0/773279257 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d3fb086450 con 0x7f98c4054c20 2024-09-22T08:37:42.426 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.412+0000 7f98cbbd9640 1 -- 172.21.15.142:0/773279257 <== osd.2 v2:172.21.15.142:6808/279438927 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98bc01ad50 con 0x7f98c4054c20 2024-09-22T08:37:42.426 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.412+0000 7f98cff26800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:37:42.426 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.412+0000 7f98cff26800 20 RGWRados::pool_iterate: got zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec 2024-09-22T08:37:42.426 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.412+0000 7f98cff26800 20 RGWRados::pool_iterate: got zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f 2024-09-22T08:37:42.426 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.412+0000 7f98cff26800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:37:42.426 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.412+0000 7f98cff26800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:37:42.426 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.412+0000 7f98cff26800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:37:42.426 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.412+0000 7f98cff26800 20 rados->read ofs=0 len=0 2024-09-22T08:37:42.426 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.412+0000 7f98cff26800 1 -- 172.21.15.142:0/773279257 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d3fb0854e0 con 0x55d3fb07d710 2024-09-22T08:37:42.426 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.412+0000 7f98cb3d8640 1 -- 172.21.15.142:0/773279257 <== osd.1 v2:172.21.15.142:6816/3192108003 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f98c0051070 con 0x55d3fb07d710 2024-09-22T08:37:42.426 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.413+0000 7f98cff26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:42.427 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.413+0000 7f98cff26800 20 rados->read ofs=0 len=0 2024-09-22T08:37:42.427 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.413+0000 7f98cff26800 1 -- 172.21.15.142:0/773279257 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d3fb085d30 con 0x55d3fb07d710 2024-09-22T08:37:42.427 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.413+0000 7f98cb3d8640 1 -- 172.21.15.142:0/773279257 <== osd.1 v2:172.21.15.142:6816/3192108003 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f98c0051070 con 0x55d3fb07d710 2024-09-22T08:37:42.427 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.413+0000 7f98cff26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:37:42.427 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.413+0000 7f98cff26800 20 rados->read ofs=0 len=0 2024-09-22T08:37:42.427 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.413+0000 7f98cff26800 1 -- 172.21.15.142:0/773279257 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:40 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d3fb0868d0 con 0x55d3fb082120 2024-09-22T08:37:42.427 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.413+0000 7f98cc3da640 1 -- 172.21.15.142:0/773279257 <== osd.3 v2:172.21.15.142:6800/1064901393 11 ==== osd_op_reply(40 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f98c403a070 con 0x55d3fb082120 2024-09-22T08:37:42.427 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.413+0000 7f98cff26800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:37:42.427 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.413+0000 7f98cff26800 20 zone default found 2024-09-22T08:37:42.427 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.413+0000 7f98cff26800 4 Realm: () 2024-09-22T08:37:42.427 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.413+0000 7f98cff26800 4 ZoneGroup: default (d89f6f57-1007-47dd-9065-f486c7b01aec) 2024-09-22T08:37:42.427 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.413+0000 7f98cff26800 4 Zone: default (e239248c-0bee-4e41-803a-24b288d3eb8f) 2024-09-22T08:37:42.427 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.413+0000 7f98cff26800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:37:42.428 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.413+0000 7f98cff26800 20 zonegroup default 2024-09-22T08:37:42.428 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.413+0000 7f98cff26800 20 rados->read ofs=0 len=0 2024-09-22T08:37:42.428 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.413+0000 7f98cff26800 1 -- 172.21.15.142:0/773279257 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d3fb086cb0 con 0x7f98bc017050 2024-09-22T08:37:42.428 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.413+0000 7f98cb3d8640 1 -- 172.21.15.142:0/773279257 <== osd.0 v2:172.21.15.31:6800/168281188 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f98c0051070 con 0x7f98bc017050 2024-09-22T08:37:42.428 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.413+0000 7f98cff26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:42.428 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.413+0000 7f98cff26800 20 rados->read ofs=0 len=0 2024-09-22T08:37:42.428 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.413+0000 7f98cff26800 1 -- 172.21.15.142:0/773279257 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d3fb088f90 con 0x55d3fb082120 2024-09-22T08:37:42.428 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.414+0000 7f98cc3da640 1 -- 172.21.15.142:0/773279257 <== osd.3 v2:172.21.15.142:6800/1064901393 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f98c403a070 con 0x55d3fb082120 2024-09-22T08:37:42.428 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.414+0000 7f98cff26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:42.428 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.414+0000 7f98cff26800 20 rados->read ofs=0 len=0 2024-09-22T08:37:42.428 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.414+0000 7f98cff26800 1 -- 172.21.15.142:0/773279257 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d3fb089330 con 0x55d3fb082120 2024-09-22T08:37:42.428 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.414+0000 7f98cc3da640 1 -- 172.21.15.142:0/773279257 <== osd.3 v2:172.21.15.142:6800/1064901393 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f98c403a070 con 0x55d3fb082120 2024-09-22T08:37:42.428 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.414+0000 7f98cff26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:42.429 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.414+0000 7f98cff26800 20 started sync module instance, tier type = 2024-09-22T08:37:42.429 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.414+0000 7f98cff26800 20 started zone id=e239248c-0bee-4e41-803a-24b288d3eb8f (name=default) with tier type = 2024-09-22T08:37:42.429 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.414+0000 7f98cff26800 1 -- 172.21.15.142:0/773279257 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d3fb088420 con 0x7f98c4054c20 2024-09-22T08:37:42.429 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.415+0000 7f98cbbd9640 1 -- 172.21.15.142:0/773279257 <== osd.2 v2:172.21.15.142:6808/279438927 7 ==== osd_op_reply(44 notify.0 [create] v32'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98bc01ad50 con 0x7f98c4054c20 2024-09-22T08:37:42.429 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.415+0000 7f98cff26800 1 -- 172.21.15.142:0/773279257 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94368938100800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d3fb089c20 con 0x7f98c4054c20 2024-09-22T08:37:42.429 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.415+0000 7f98cff26800 1 -- 172.21.15.142:0/773279257 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d3fb08a470 con 0x55d3fb07d710 2024-09-22T08:37:42.429 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.416+0000 7f98cbbd9640 1 -- 172.21.15.142:0/773279257 <== osd.2 v2:172.21.15.142:6808/279438927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94368938100800] v32'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98bc01ad50 con 0x7f98c4054c20 2024-09-22T08:37:42.429 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.416+0000 7f98cb3d8640 1 -- 172.21.15.142:0/773279257 <== osd.1 v2:172.21.15.142:6816/3192108003 16 ==== osd_op_reply(46 notify.1 [create] v32'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98c0051070 con 0x55d3fb07d710 2024-09-22T08:37:42.429 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.416+0000 7f98cff26800 1 -- 172.21.15.142:0/773279257 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94368938104688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d3fb08a470 con 0x55d3fb07d710 2024-09-22T08:37:42.429 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.416+0000 7f98cff26800 1 -- 172.21.15.142:0/773279257 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d3fb08af70 con 0x55d3fb082120 2024-09-22T08:37:42.429 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.417+0000 7f98cc3da640 1 -- 172.21.15.142:0/773279257 <== osd.3 v2:172.21.15.142:6800/1064901393 14 ==== osd_op_reply(48 notify.2 [create] v32'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98c403a070 con 0x55d3fb082120 2024-09-22T08:37:42.429 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.417+0000 7f98cff26800 1 -- 172.21.15.142:0/773279257 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94368938109536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d3fb08af70 con 0x55d3fb082120 2024-09-22T08:37:42.429 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.418+0000 7f98cff26800 1 -- 172.21.15.142:0/773279257 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d3fb08bf60 con 0x7f98c4054c20 2024-09-22T08:37:42.430 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.418+0000 7f98cb3d8640 1 -- 172.21.15.142:0/773279257 <== osd.1 v2:172.21.15.142:6816/3192108003 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94368938104688] v32'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98c0051070 con 0x55d3fb07d710 2024-09-22T08:37:42.430 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.419+0000 7f98cbbd9640 1 -- 172.21.15.142:0/773279257 <== osd.2 v2:172.21.15.142:6808/279438927 9 ==== osd_op_reply(50 notify.3 [create] v32'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98bc01ad50 con 0x7f98c4054c20 2024-09-22T08:37:42.430 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.419+0000 7f98cc3da640 1 -- 172.21.15.142:0/773279257 <== osd.3 v2:172.21.15.142:6800/1064901393 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94368938109536] v32'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98c403a070 con 0x55d3fb082120 2024-09-22T08:37:42.430 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.419+0000 7f98cff26800 1 -- 172.21.15.142:0/773279257 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94368938113584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d3fb08bf20 con 0x7f98c4054c20 2024-09-22T08:37:42.430 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.419+0000 7f98cff26800 1 -- 172.21.15.142:0/773279257 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d3fb08b390 con 0x55d3fb07d710 2024-09-22T08:37:42.430 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.420+0000 7f98cbbd9640 1 -- 172.21.15.142:0/773279257 <== osd.2 v2:172.21.15.142:6808/279438927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94368938113584] v32'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98bc01ad50 con 0x7f98c4054c20 2024-09-22T08:37:42.430 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.420+0000 7f98cb3d8640 1 -- 172.21.15.142:0/773279257 <== osd.1 v2:172.21.15.142:6816/3192108003 18 ==== osd_op_reply(52 notify.4 [create] v32'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98c0051070 con 0x55d3fb07d710 2024-09-22T08:37:42.430 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.420+0000 7f98cff26800 1 -- 172.21.15.142:0/773279257 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94368938106816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d3fb08b390 con 0x55d3fb07d710 2024-09-22T08:37:42.430 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.420+0000 7f98cff26800 1 -- 172.21.15.142:0/773279257 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d3fb08cfc0 con 0x7f98bc017050 2024-09-22T08:37:42.436 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.421+0000 7f98cb3d8640 1 -- 172.21.15.142:0/773279257 <== osd.1 v2:172.21.15.142:6816/3192108003 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94368938106816] v32'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98c0051070 con 0x55d3fb07d710 2024-09-22T08:37:42.436 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.421+0000 7f98cb3d8640 1 -- 172.21.15.142:0/773279257 <== osd.0 v2:172.21.15.31:6800/168281188 10 ==== osd_op_reply(54 notify.5 [create] v32'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98c0051070 con 0x7f98bc017050 2024-09-22T08:37:42.436 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.421+0000 7f98cff26800 1 -- 172.21.15.142:0/773279257 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94368938116336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d3fb08cfc0 con 0x7f98bc017050 2024-09-22T08:37:42.436 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.421+0000 7f98cff26800 1 -- 172.21.15.142:0/773279257 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d3fb08d980 con 0x7f98bc017050 2024-09-22T08:37:42.436 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.422+0000 7f98cb3d8640 1 -- 172.21.15.142:0/773279257 <== osd.0 v2:172.21.15.31:6800/168281188 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94368938116336] v32'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98c0051070 con 0x7f98bc017050 2024-09-22T08:37:42.436 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.422+0000 7f98cb3d8640 1 -- 172.21.15.142:0/773279257 <== osd.0 v2:172.21.15.31:6800/168281188 12 ==== osd_op_reply(56 notify.6 [create] v32'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98c0051070 con 0x7f98bc017050 2024-09-22T08:37:42.436 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.422+0000 7f98cff26800 1 -- 172.21.15.142:0/773279257 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94368938117904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d3fb08db60 con 0x7f98bc017050 2024-09-22T08:37:42.436 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.422+0000 7f98cff26800 1 -- 172.21.15.142:0/773279257 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d3fb08e3b0 con 0x7f98bc017050 2024-09-22T08:37:42.436 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.424+0000 7f98cb3d8640 1 -- 172.21.15.142:0/773279257 <== osd.0 v2:172.21.15.31:6800/168281188 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94368938117904] v32'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98c0051070 con 0x7f98bc017050 2024-09-22T08:37:42.436 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.424+0000 7f98cb3d8640 1 -- 172.21.15.142:0/773279257 <== osd.0 v2:172.21.15.31:6800/168281188 14 ==== osd_op_reply(58 notify.7 [create] v32'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98c0051070 con 0x7f98bc017050 2024-09-22T08:37:42.436 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.424+0000 7f98cff26800 1 -- 172.21.15.142:0/773279257 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94368938121360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d3fb08e220 con 0x7f98bc017050 2024-09-22T08:37:42.436 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.424+0000 7f98cff26800 20 add_watcher() i=0 2024-09-22T08:37:42.436 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.424+0000 7f98cff26800 20 add_watcher() i=1 2024-09-22T08:37:42.437 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.424+0000 7f98cff26800 20 add_watcher() i=2 2024-09-22T08:37:42.437 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.424+0000 7f98cff26800 20 add_watcher() i=3 2024-09-22T08:37:42.437 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.424+0000 7f98cff26800 20 add_watcher() i=4 2024-09-22T08:37:42.437 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.424+0000 7f98cff26800 20 add_watcher() i=5 2024-09-22T08:37:42.437 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.424+0000 7f98cff26800 20 add_watcher() i=6 2024-09-22T08:37:42.437 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.425+0000 7f98cb3d8640 1 -- 172.21.15.142:0/773279257 <== osd.0 v2:172.21.15.31:6800/168281188 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94368938121360] v32'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98c0051070 con 0x7f98bc017050 2024-09-22T08:37:42.437 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.425+0000 7f98cff26800 20 add_watcher() i=7 2024-09-22T08:37:42.437 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.425+0000 7f98cff26800 2 all 8 watchers are set, enabling cache 2024-09-22T08:37:42.437 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.425+0000 7f98cff26800 1 -- 172.21.15.142:0/773279257 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d3fb091850 con 0x55d3fb07d710 2024-09-22T08:37:42.437 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.425+0000 7f98cb3d8640 1 -- 172.21.15.142:0/773279257 <== osd.1 v2:172.21.15.142:6816/3192108003 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f98c0051070 con 0x55d3fb07d710 2024-09-22T08:37:42.437 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.425+0000 7f98cff26800 1 -- 172.21.15.142:0/773279257 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94368938122480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d3fb08ebe0 con 0x55d3fb07d710 2024-09-22T08:37:42.437 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.426+0000 7f98cb3d8640 1 -- 172.21.15.142:0/773279257 <== osd.1 v2:172.21.15.142:6816/3192108003 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94368938122480] v32'212 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f98c0051070 con 0x55d3fb07d710 2024-09-22T08:37:42.437 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.426+0000 7f9781fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:37:42.438 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.426+0000 7f98cff26800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:37:42.438 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.426+0000 7f98cff26800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:37:42.438 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.426+0000 7f98cff26800 5 note: GC not initialized 2024-09-22T08:37:42.438 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.427+0000 7f9780fe1640 20 reqs_thread_entry: start 2024-09-22T08:37:42.438 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.427+0000 7f98cff26800 20 init_complete bucket index max shards: 11 2024-09-22T08:37:42.438 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.427+0000 7f98cff26800 20 Filter name: none 2024-09-22T08:37:42.438 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.427+0000 7f96fa7fc640 20 reqs_thread_entry: start 2024-09-22T08:37:42.438 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.427+0000 7f98cff26800 10 cache get: name=default.rgw.meta+users.uid+bar : miss 2024-09-22T08:37:42.438 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.427+0000 7f98cff26800 20 rados->read ofs=0 len=0 2024-09-22T08:37:42.438 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.427+0000 7f98cff26800 1 -- 172.21.15.142:0/773279257 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:62 8.e 8:718f6a54:users.uid::bar:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d3fb0c4bc0 con 0x7f98bc017050 2024-09-22T08:37:42.438 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.428+0000 7f98cb3d8640 1 -- 172.21.15.142:0/773279257 <== osd.0 v2:172.21.15.31:6800/168281188 16 ==== osd_op_reply(62 bar [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv7 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f98c0051070 con 0x7f98bc017050 2024-09-22T08:37:42.438 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.428+0000 7f98cff26800 20 rados_obj.operate() r=0 bl.length=380 2024-09-22T08:37:42.438 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.428+0000 7f98cff26800 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x13 2024-09-22T08:37:42.439 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.428+0000 7f98cff26800 10 adding default.rgw.meta+users.uid+bar to cache LRU end 2024-09-22T08:37:42.439 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.428+0000 7f98cff26800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:37:42.439 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.428+0000 7f98cff26800 1 -- 172.21.15.142:0/773279257 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:63 8.4 8:267425a8:users.uid::bud:head [create,call version.set in=58b,writefull 0~206 in=206b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d3fb0c8eb0 con 0x7f98c4054c20 2024-09-22T08:37:42.439 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.429+0000 7f98cbbd9640 1 -- 172.21.15.142:0/773279257 <== osd.2 v2:172.21.15.142:6808/279438927 11 ==== osd_op_reply(63 bud [create,call,writefull 0~206] v32'1 uv1 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f98bc01ad50 con 0x7f98c4054c20 2024-09-22T08:37:42.439 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.429+0000 7f98cff26800 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-09-22T08:37:42.439 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.429+0000 7f98cff26800 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-09-22T08:37:42.439 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.429+0000 7f98cff26800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:bud, ofs0, ns] 2024-09-22T08:37:42.439 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.429+0000 7f98cff26800 1 -- 172.21.15.142:0/773279257 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:64 7.3 7:c609908c:::notify.5:head [notify cookie 94368938358976 in=394b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d3fb0c9b80 con 0x7f98bc017050 2024-09-22T08:37:42.439 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.429+0000 7f98cb3d8640 1 -- 172.21.15.142:0/773279257 <== osd.0 v2:172.21.15.31:6800/168281188 17 ==== watch-notify(notify (1) cookie 94368938116336 notify 137438953495 ret 0) ==== 424+0+0 (crc 0 0 0) 0x7f98c0081040 con 0x7f98bc017050 2024-09-22T08:37:42.439 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.429+0000 7f97aaffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953495 cookie 94368938116336 notifier 4730 bl.length()=382 2024-09-22T08:37:42.439 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.429+0000 7f97aaffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-09-22T08:37:42.439 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.429+0000 7f97aaffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bud to cache LRU end 2024-09-22T08:37:42.439 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.429+0000 7f97aaffd640 1 -- 172.21.15.142:0/773279257 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:65 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f9790003ea0 con 0x7f98bc017050 2024-09-22T08:37:42.440 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.429+0000 7f98cb3d8640 1 -- 172.21.15.142:0/773279257 <== osd.0 v2:172.21.15.31:6800/168281188 18 ==== osd_op_reply(64 notify.5 [notify cookie 94368938358976 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f98c0051070 con 0x7f98bc017050 2024-09-22T08:37:42.440 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.430+0000 7f98cb3d8640 1 -- 172.21.15.142:0/773279257 <== osd.0 v2:172.21.15.31:6800/168281188 19 ==== osd_op_reply(65 notify.5 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98c0051070 con 0x7f98bc017050 2024-09-22T08:37:42.440 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.430+0000 7f98cb3d8640 1 -- 172.21.15.142:0/773279257 <== osd.0 v2:172.21.15.31:6800/168281188 20 ==== watch-notify(notify_complete (2) cookie 94368938358976 notify 137438953495 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55d3faf48ed0 con 0x7f98bc017050 2024-09-22T08:37:42.440 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.430+0000 7f98cff26800 1 -- 172.21.15.142:0/773279257 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:66 8.5 8:a00000ee:users.uid::bar.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d3fb0c9a80 con 0x55d3fb07d710 2024-09-22T08:37:42.440 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.430+0000 7f98cb3d8640 1 -- 172.21.15.142:0/773279257 <== osd.1 v2:172.21.15.142:6816/3192108003 22 ==== osd_op_reply(66 bar.buckets [call out=184b] v0'0 uv3 ondisk = 0) ==== 155+0+184 (crc 0 0 0) 0x7f98c0051070 con 0x55d3fb07d710 2024-09-22T08:37:42.440 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.430+0000 7f98cff26800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:e239248c-0bee-4e41-803a-24b288d3eb8f.4226.9 : miss 2024-09-22T08:37:42.440 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.430+0000 7f98cff26800 20 rados->read ofs=0 len=0 2024-09-22T08:37:42.440 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.430+0000 7f98cff26800 1 -- 172.21.15.142:0/773279257 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:67 8.15 8:ab657e42:root::.bucket.meta.myfoo6%3ae239248c-0bee-4e41-803a-24b288d3eb8f.4226.9:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d3fb0c70f0 con 0x55d3fb082120 2024-09-22T08:37:42.440 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.431+0000 7f98cc3da640 1 -- 172.21.15.142:0/773279257 <== osd.3 v2:172.21.15.142:6800/1064901393 16 ==== osd_op_reply(67 .bucket.meta.myfoo6:e239248c-0bee-4e41-803a-24b288d3eb8f.4226.9 [call out=48b,stat out=16b,read 0~388 out=388b,getxattrs out=218b] v0'0 uv11 ondisk = 0) ==== 333+0+670 (crc 0 0 0) 0x7f98c403a070 con 0x55d3fb082120 2024-09-22T08:37:42.440 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.431+0000 7f98cff26800 20 rados_obj.operate() r=0 bl.length=388 2024-09-22T08:37:42.440 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.431+0000 7f98cff26800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:e239248c-0bee-4e41-803a-24b288d3eb8f.4226.9 info.flags=0x17 2024-09-22T08:37:42.440 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.431+0000 7f98cff26800 10 adding default.rgw.meta+root+.bucket.meta.myfoo6:e239248c-0bee-4e41-803a-24b288d3eb8f.4226.9 to cache LRU end 2024-09-22T08:37:42.440 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.431+0000 7f98cff26800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:37:42.441 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.431+0000 7f98cff26800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-22T08:37:42.441 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.431+0000 7f98cff26800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:e239248c-0bee-4e41-803a-24b288d3eb8f.4226.9 2024-09-22T08:37:42.441 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.431+0000 7f98cff26800 1 -- 172.21.15.142:0/773279257 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:68 8.15 8:ab657e42:root::.bucket.meta.myfoo6%3ae239248c-0bee-4e41-803a-24b288d3eb8f.4226.9:head [delete,create,call version.check_conds in=122b,call version.inc in=38b,writefull 0~388 in=388b,setxattr user.rgw.acl (117) in=129b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d3fb0d0920 con 0x55d3fb082120 2024-09-22T08:37:42.441 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.432+0000 7f98cc3da640 1 -- 172.21.15.142:0/773279257 <== osd.3 v2:172.21.15.142:6800/1064901393 17 ==== osd_op_reply(68 .bucket.meta.myfoo6:e239248c-0bee-4e41-803a-24b288d3eb8f.4226.9 [delete,create,call,call,writefull 0~388,setxattr (117)] v32'12 uv12 ondisk = 0) ==== 417+0+0 (crc 0 0 0) 0x7f98c403a070 con 0x55d3fb082120 2024-09-22T08:37:42.441 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.432+0000 7f98cff26800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:e239248c-0bee-4e41-803a-24b288d3eb8f.4226.9 info.flags=0x17 2024-09-22T08:37:42.441 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.432+0000 7f98cff26800 10 moving default.rgw.meta+root+.bucket.meta.myfoo6:e239248c-0bee-4e41-803a-24b288d3eb8f.4226.9 to cache LRU end 2024-09-22T08:37:42.441 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.432+0000 7f98cff26800 10 updating xattr: name=user.rgw.acl bl.length()=117 2024-09-22T08:37:42.441 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.432+0000 7f98cff26800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo6:e239248c-0bee-4e41-803a-24b288d3eb8f.4226.9, ofs0, ns] 2024-09-22T08:37:42.441 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.432+0000 7f98cff26800 1 -- 172.21.15.142:0/773279257 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:69 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94368938356832 in=768b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d3fb0cafc0 con 0x7f98bc017050 2024-09-22T08:37:42.441 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.433+0000 7f98cb3d8640 1 -- 172.21.15.142:0/773279257 <== osd.0 v2:172.21.15.31:6800/168281188 21 ==== watch-notify(notify (1) cookie 94368938117904 notify 137438953496 ret 0) ==== 798+0+0 (crc 0 0 0) 0x55d3faf48ed0 con 0x7f98bc017050 2024-09-22T08:37:42.441 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.433+0000 7f97aa7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953496 cookie 94368938117904 notifier 4730 bl.length()=756 2024-09-22T08:37:42.441 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.433+0000 7f98cb3d8640 1 -- 172.21.15.142:0/773279257 <== osd.0 v2:172.21.15.31:6800/168281188 22 ==== osd_op_reply(69 notify.6 [notify cookie 94368938356832 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f98c0051070 con 0x7f98bc017050 2024-09-22T08:37:42.441 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.433+0000 7f97aa7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:e239248c-0bee-4e41-803a-24b288d3eb8f.4226.9 info.flags=0x17 2024-09-22T08:37:42.442 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.433+0000 7f97aa7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo6:e239248c-0bee-4e41-803a-24b288d3eb8f.4226.9 to cache LRU end 2024-09-22T08:37:42.442 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.433+0000 7f97aa7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=117 2024-09-22T08:37:42.442 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.433+0000 7f97aa7fc640 1 -- 172.21.15.142:0/773279257 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f9700003530 con 0x7f98bc017050 2024-09-22T08:37:42.442 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.433+0000 7f98cb3d8640 1 -- 172.21.15.142:0/773279257 <== osd.0 v2:172.21.15.31:6800/168281188 23 ==== osd_op_reply(70 notify.6 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98c0051070 con 0x7f98bc017050 2024-09-22T08:37:42.442 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.433+0000 7f98cb3d8640 1 -- 172.21.15.142:0/773279257 <== osd.0 v2:172.21.15.31:6800/168281188 24 ==== watch-notify(notify_complete (2) cookie 94368938356832 notify 137438953496 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f98c007adc0 con 0x7f98bc017050 2024-09-22T08:37:42.442 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.433+0000 7f98cff26800 20 handle_bi_update(): bucket=:myfoo6[e239248c-0bee-4e41-803a-24b288d3eb8f.4226.9]): orig_sources= new_sources= 2024-09-22T08:37:42.442 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.433+0000 7f98cff26800 20 handle_bi_update(): bucket=:myfoo6[e239248c-0bee-4e41-803a-24b288d3eb8f.4226.9]): potential sources added=[] removed=[] 2024-09-22T08:37:42.442 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.433+0000 7f98cff26800 20 handle_bi_update(): bucket=:myfoo6[e239248c-0bee-4e41-803a-24b288d3eb8f.4226.9]): orig_dests= new_dests= 2024-09-22T08:37:42.442 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.433+0000 7f98cff26800 20 handle_bi_update(): bucket=:myfoo6[e239248c-0bee-4e41-803a-24b288d3eb8f.4226.9]): potential dests added=[] removed=[] 2024-09-22T08:37:42.442 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.433+0000 7f98cff26800 1 -- 172.21.15.142:0/773279257 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:71 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.remove_bucket in=145b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d3fb0c7060 con 0x55d3fb07d710 2024-09-22T08:37:42.442 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.434+0000 7f98cb3d8640 1 -- 172.21.15.142:0/773279257 <== osd.1 v2:172.21.15.142:6816/3192108003 23 ==== osd_op_reply(71 bud.buckets [call] v32'3 uv0 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f98c008e040 con 0x55d3fb07d710 2024-09-22T08:37:42.442 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.434+0000 7f98cff26800 1 -- 172.21.15.142:0/773279257 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:72 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.set_buckets_info in=208b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d3fb0c7060 con 0x55d3fb07d710 2024-09-22T08:37:42.448 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.435+0000 7f98cb3d8640 1 -- 172.21.15.142:0/773279257 <== osd.1 v2:172.21.15.142:6816/3192108003 24 ==== osd_op_reply(72 bud.buckets [call] v32'4 uv4 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f98c008e040 con 0x55d3fb07d710 2024-09-22T08:37:42.448 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.435+0000 7f98cff26800 1 -- 172.21.15.142:0/773279257 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:73 8.18 8:1944a257:root::myfoo6:head [delete,create,call version.inc in=38b,writefull 0~166 in=166b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d3fb0c7060 con 0x55d3fb07d710 2024-09-22T08:37:42.448 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.436+0000 7f98cb3d8640 1 -- 172.21.15.142:0/773279257 <== osd.1 v2:172.21.15.142:6816/3192108003 25 ==== osd_op_reply(73 myfoo6 [delete,create,call,writefull 0~166] v32'17 uv17 ondisk = 0) ==== 276+0+0 (crc 0 0 0) 0x7f98c008e040 con 0x55d3fb07d710 2024-09-22T08:37:42.448 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.436+0000 7f98cff26800 10 cache put: name=default.rgw.meta+root+myfoo6 info.flags=0x7 2024-09-22T08:37:42.449 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.436+0000 7f98cff26800 10 adding default.rgw.meta+root+myfoo6 to cache LRU end 2024-09-22T08:37:42.450 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.436+0000 7f98cff26800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:myfoo6, ofs0, ns] 2024-09-22T08:37:42.450 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.436+0000 7f98cff26800 1 -- 172.21.15.142:0/773279257 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [notify cookie 94368938356832 in=328b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d3fb0cb1e0 con 0x7f98c4054c20 2024-09-22T08:37:42.450 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.437+0000 7f98cbbd9640 1 -- 172.21.15.142:0/773279257 <== osd.2 v2:172.21.15.142:6808/279438927 12 ==== watch-notify(notify (1) cookie 94368938113584 notify 137438953502 ret 0) ==== 358+0+0 (crc 0 0 0) 0x55d3fb0381a0 con 0x7f98c4054c20 2024-09-22T08:37:42.450 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.437+0000 7f97aa7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953502 cookie 94368938113584 notifier 4730 bl.length()=316 2024-09-22T08:37:42.450 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.437+0000 7f97aa7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo6 info.flags=0x7 2024-09-22T08:37:42.450 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.437+0000 7f97aa7fc640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo6 to cache LRU end 2024-09-22T08:37:42.450 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.437+0000 7f98cbbd9640 1 -- 172.21.15.142:0/773279257 <== osd.2 v2:172.21.15.142:6808/279438927 13 ==== osd_op_reply(74 notify.3 [notify cookie 94368938356832 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f98bc01ad50 con 0x7f98c4054c20 2024-09-22T08:37:42.450 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.437+0000 7f97aa7fc640 1 -- 172.21.15.142:0/773279257 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:75 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f9700003560 con 0x7f98c4054c20 2024-09-22T08:37:42.450 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.437+0000 7f98cbbd9640 1 -- 172.21.15.142:0/773279257 <== osd.2 v2:172.21.15.142:6808/279438927 14 ==== osd_op_reply(75 notify.3 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98bc01ad50 con 0x7f98c4054c20 2024-09-22T08:37:42.450 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.437+0000 7f98cbbd9640 1 -- 172.21.15.142:0/773279257 <== osd.2 v2:172.21.15.142:6808/279438927 15 ==== watch-notify(notify_complete (2) cookie 94368938356832 notify 137438953502 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55d3fb037be0 con 0x7f98c4054c20 2024-09-22T08:37:42.450 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.437+0000 7f98cff26800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:e239248c-0bee-4e41-803a-24b288d3eb8f.4226.9 : hit (requested=0x17, cached=0x17) 2024-09-22T08:37:42.450 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.437+0000 7f98cff26800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:e239248c-0bee-4e41-803a-24b288d3eb8f.4226.9 2024-09-22T08:37:42.450 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.437+0000 7f98cff26800 1 -- 172.21.15.142:0/773279257 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:76 8.15 8:ab657e42:root::.bucket.meta.myfoo6%3ae239248c-0bee-4e41-803a-24b288d3eb8f.4226.9:head [delete,create,call version.check_conds in=122b,call version.inc in=38b,writefull 0~388 in=388b,setxattr user.rgw.acl (117) in=129b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d3fb0ce690 con 0x55d3fb082120 2024-09-22T08:37:42.451 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.438+0000 7f98cc3da640 1 -- 172.21.15.142:0/773279257 <== osd.3 v2:172.21.15.142:6800/1064901393 18 ==== osd_op_reply(76 .bucket.meta.myfoo6:e239248c-0bee-4e41-803a-24b288d3eb8f.4226.9 [delete,create,call,call,writefull 0~388,setxattr (117)] v32'13 uv13 ondisk = 0) ==== 417+0+0 (crc 0 0 0) 0x7f98c403a070 con 0x55d3fb082120 2024-09-22T08:37:42.451 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.438+0000 7f98cff26800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:e239248c-0bee-4e41-803a-24b288d3eb8f.4226.9 info.flags=0x17 2024-09-22T08:37:42.451 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.438+0000 7f98cff26800 10 moving default.rgw.meta+root+.bucket.meta.myfoo6:e239248c-0bee-4e41-803a-24b288d3eb8f.4226.9 to cache LRU end 2024-09-22T08:37:42.451 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.438+0000 7f98cff26800 10 updating xattr: name=user.rgw.acl bl.length()=117 2024-09-22T08:37:42.451 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.438+0000 7f98cff26800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo6:e239248c-0bee-4e41-803a-24b288d3eb8f.4226.9, ofs0, ns] 2024-09-22T08:37:42.451 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.438+0000 7f98cff26800 1 -- 172.21.15.142:0/773279257 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94368938356752 in=768b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d3fb0cb660 con 0x7f98bc017050 2024-09-22T08:37:42.451 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.439+0000 7f98cb3d8640 1 -- 172.21.15.142:0/773279257 <== osd.0 v2:172.21.15.31:6800/168281188 25 ==== watch-notify(notify (1) cookie 94368938117904 notify 137438953497 ret 0) ==== 798+0+0 (crc 0 0 0) 0x55d3fb0cafc0 con 0x7f98bc017050 2024-09-22T08:37:42.451 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.439+0000 7f97aaffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953497 cookie 94368938117904 notifier 4730 bl.length()=756 2024-09-22T08:37:42.451 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.439+0000 7f97aaffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:e239248c-0bee-4e41-803a-24b288d3eb8f.4226.9 info.flags=0x17 2024-09-22T08:37:42.451 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.439+0000 7f97aaffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo6:e239248c-0bee-4e41-803a-24b288d3eb8f.4226.9 to cache LRU end 2024-09-22T08:37:42.451 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.439+0000 7f97aaffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=117 2024-09-22T08:37:42.451 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.439+0000 7f97aaffd640 1 -- 172.21.15.142:0/773279257 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:78 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f9790003ea0 con 0x7f98bc017050 2024-09-22T08:37:42.451 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.439+0000 7f98cb3d8640 1 -- 172.21.15.142:0/773279257 <== osd.0 v2:172.21.15.31:6800/168281188 26 ==== osd_op_reply(77 notify.6 [notify cookie 94368938356752 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f98c008e040 con 0x7f98bc017050 2024-09-22T08:37:42.451 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.439+0000 7f98cb3d8640 1 -- 172.21.15.142:0/773279257 <== osd.0 v2:172.21.15.31:6800/168281188 27 ==== osd_op_reply(78 notify.6 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98c008e040 con 0x7f98bc017050 2024-09-22T08:37:42.451 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.439+0000 7f98cb3d8640 1 -- 172.21.15.142:0/773279257 <== osd.0 v2:172.21.15.31:6800/168281188 28 ==== watch-notify(notify_complete (2) cookie 94368938356752 notify 137438953497 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55d3fb0c88e0 con 0x7f98bc017050 2024-09-22T08:37:42.452 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.439+0000 7f98cff26800 20 handle_bi_update(): bucket=:myfoo6[e239248c-0bee-4e41-803a-24b288d3eb8f.4226.9]): orig_sources= new_sources= 2024-09-22T08:37:42.452 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.439+0000 7f98cff26800 20 handle_bi_update(): bucket=:myfoo6[e239248c-0bee-4e41-803a-24b288d3eb8f.4226.9]): potential sources added=[] removed=[] 2024-09-22T08:37:42.452 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.439+0000 7f98cff26800 20 handle_bi_update(): bucket=:myfoo6[e239248c-0bee-4e41-803a-24b288d3eb8f.4226.9]): orig_dests= new_dests= 2024-09-22T08:37:42.452 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.439+0000 7f98cff26800 20 handle_bi_update(): bucket=:myfoo6[e239248c-0bee-4e41-803a-24b288d3eb8f.4226.9]): potential dests added=[] removed=[] 2024-09-22T08:37:42.452 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.439+0000 7f98cff26800 1 -- 172.21.15.142:0/773279257 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:79 4.23 4:c5e6b267:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.9.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d3fb0c9f10 con 0x7f98bc017050 2024-09-22T08:37:42.452 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.440+0000 7f98cb3d8640 1 -- 172.21.15.142:0/773279257 <== osd.0 v2:172.21.15.31:6800/168281188 29 ==== osd_op_reply(79 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.9.0 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f98c008e040 con 0x7f98bc017050 2024-09-22T08:37:42.452 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.440+0000 7f98cff26800 1 -- 172.21.15.142:0/773279257 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:80 4.20 4:0568296f:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.9.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d3fb0c9f10 con 0x55d3fb07d710 2024-09-22T08:37:42.452 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.440+0000 7f98cb3d8640 1 -- 172.21.15.142:0/773279257 <== osd.1 v2:172.21.15.142:6816/3192108003 26 ==== osd_op_reply(80 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.9.1 [call out=89b] v0'0 uv13 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f98c008e040 con 0x55d3fb07d710 2024-09-22T08:37:42.452 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.440+0000 7f98cff26800 1 -- 172.21.15.142:0/773279257 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:81 4.c 4:3134bd73:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.9.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d3fb0c9f10 con 0x55d3fb07d710 2024-09-22T08:37:42.452 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.440+0000 7f98cb3d8640 1 -- 172.21.15.142:0/773279257 <== osd.1 v2:172.21.15.142:6816/3192108003 27 ==== osd_op_reply(81 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.9.2 [call out=89b] v0'0 uv9 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f98c008e040 con 0x55d3fb07d710 2024-09-22T08:37:42.452 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.440+0000 7f98cff26800 1 -- 172.21.15.142:0/773279257 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:82 4.2f 4:f59797e0:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.9.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d3fb0c9f10 con 0x55d3fb07d710 2024-09-22T08:37:42.452 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.440+0000 7f98cb3d8640 1 -- 172.21.15.142:0/773279257 <== osd.1 v2:172.21.15.142:6816/3192108003 28 ==== osd_op_reply(82 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.9.3 [call out=89b] v0'0 uv7 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f98c008e040 con 0x55d3fb07d710 2024-09-22T08:37:42.452 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.440+0000 7f98cff26800 1 -- 172.21.15.142:0/773279257 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:83 4.b 4:d0ed73cf:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.9.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d3fb0c9f10 con 0x7f98c4054c20 2024-09-22T08:37:42.452 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.441+0000 7f98cbbd9640 1 -- 172.21.15.142:0/773279257 <== osd.2 v2:172.21.15.142:6808/279438927 16 ==== osd_op_reply(83 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.9.4 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f98bc01ad50 con 0x7f98c4054c20 2024-09-22T08:37:42.453 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.441+0000 7f98cff26800 1 -- 172.21.15.142:0/773279257 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:84 4.1f 4:f9395f8a:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.9.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d3fb0c9f10 con 0x55d3fb082120 2024-09-22T08:37:42.453 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.441+0000 7f98cc3da640 1 -- 172.21.15.142:0/773279257 <== osd.3 v2:172.21.15.142:6800/1064901393 19 ==== osd_op_reply(84 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.9.5 [call out=89b] v0'0 uv6 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f98c403a070 con 0x55d3fb082120 2024-09-22T08:37:42.453 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.441+0000 7f98cff26800 1 -- 172.21.15.142:0/773279257 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:85 4.16 4:68dcb4be:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.9.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d3fb0c9f10 con 0x55d3fb082120 2024-09-22T08:37:42.453 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.441+0000 7f98cc3da640 1 -- 172.21.15.142:0/773279257 <== osd.3 v2:172.21.15.142:6800/1064901393 20 ==== osd_op_reply(85 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.9.6 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f98c403a070 con 0x55d3fb082120 2024-09-22T08:37:42.453 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.441+0000 7f98cff26800 1 -- 172.21.15.142:0/773279257 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:86 4.1d 4:bb447876:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.9.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d3fb0c9f10 con 0x55d3fb082120 2024-09-22T08:37:42.453 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.442+0000 7f98cc3da640 1 -- 172.21.15.142:0/773279257 <== osd.3 v2:172.21.15.142:6800/1064901393 21 ==== osd_op_reply(86 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.9.7 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f98c403a070 con 0x55d3fb082120 2024-09-22T08:37:42.453 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.442+0000 7f98cff26800 1 -- 172.21.15.142:0/773279257 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:87 4.37 4:edc9c648:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.9.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d3fb0c9f10 con 0x7f98bc017050 2024-09-22T08:37:42.453 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.442+0000 7f98cb3d8640 1 -- 172.21.15.142:0/773279257 <== osd.0 v2:172.21.15.31:6800/168281188 30 ==== osd_op_reply(87 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.9.8 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f98c008e040 con 0x7f98bc017050 2024-09-22T08:37:42.453 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.442+0000 7f98cff26800 1 -- 172.21.15.142:0/773279257 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:88 4.35 4:acb4e751:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.9.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d3fb0c9f10 con 0x55d3fb07d710 2024-09-22T08:37:42.453 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.443+0000 7f98cb3d8640 1 -- 172.21.15.142:0/773279257 <== osd.1 v2:172.21.15.142:6816/3192108003 29 ==== osd_op_reply(88 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.9.9 [call out=380b] v0'0 uv3 ondisk = 0) ==== 194+0+380 (crc 0 0 0) 0x7f98c008e040 con 0x55d3fb07d710 2024-09-22T08:37:42.453 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.443+0000 7f98cff26800 10 cls_bucket_list_unordered: got thirteen 2024-09-22T08:37:42.453 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.443+0000 7f98cff26800 1 -- 172.21.15.142:0/773279257 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:89 4.26 4:66f493f1:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.9.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d3fb0c9f10 con 0x7f98bc017050 2024-09-22T08:37:42.453 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.443+0000 7f98cb3d8640 1 -- 172.21.15.142:0/773279257 <== osd.0 v2:172.21.15.31:6800/168281188 31 ==== osd_op_reply(89 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.9.10 [call out=89b] v0'0 uv11 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f98c008e040 con 0x7f98bc017050 2024-09-22T08:37:42.453 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.443+0000 7f98cff26800 20 get_obj_state: octx=0x7f98bc0229c0 obj=myfoo6:thirteen state=0x55d3fb0ca4e8 s->prefetch_data=0 2024-09-22T08:37:42.453 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.443+0000 7f98cff26800 1 -- 172.21.15.142:0/773279257 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:90 3.6 3:61c0b0b1:::e239248c-0bee-4e41-803a-24b288d3eb8f.4226.9_thirteen:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d3fb0c9f10 con 0x55d3fb07d710 2024-09-22T08:37:42.454 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.444+0000 7f98cb3d8640 1 -- 172.21.15.142:0/773279257 <== osd.1 v2:172.21.15.142:6816/3192108003 30 ==== osd_op_reply(90 e239248c-0bee-4e41-803a-24b288d3eb8f.4226.9_thirteen [call out=24b,getxattrs out=861b,stat out=16b] v0'0 uv3 ondisk = 0) ==== 280+0+901 (crc 0 0 0) 0x7f98c008e040 con 0x55d3fb07d710 2024-09-22T08:37:42.454 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.444+0000 7f98cff26800 10 manifest: total_size = 8 2024-09-22T08:37:42.454 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.444+0000 7f98cff26800 20 get_obj_state: setting s->obj_tag to e239248c-0bee-4e41-803a-24b288d3eb8f.4226.100688913140780388 2024-09-22T08:37:42.454 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.444+0000 7f98cff26800 20 Read xattr rgw_rados: user.rgw.acl 2024-09-22T08:37:42.454 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.444+0000 7f98cff26800 20 Read xattr rgw_rados: user.rgw.content_type 2024-09-22T08:37:42.454 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.444+0000 7f98cff26800 20 Read xattr rgw_rados: user.rgw.etag 2024-09-22T08:37:42.454 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.444+0000 7f98cff26800 20 Read xattr rgw_rados: user.rgw.idtag 2024-09-22T08:37:42.454 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.444+0000 7f98cff26800 20 Read xattr rgw_rados: user.rgw.manifest 2024-09-22T08:37:42.454 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.444+0000 7f98cff26800 20 Read xattr rgw_rados: user.rgw.pg_ver 2024-09-22T08:37:42.454 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.444+0000 7f98cff26800 20 Read xattr rgw_rados: user.rgw.source_zone 2024-09-22T08:37:42.454 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.444+0000 7f98cff26800 20 Read xattr rgw_rados: user.rgw.tail_tag 2024-09-22T08:37:42.454 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.444+0000 7f98cff26800 20 get_obj_state: octx=0x7f98bc0229c0 obj=myfoo6:thirteen state=0x55d3fb0ca4e8 s->prefetch_data=0 2024-09-22T08:37:42.454 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.444+0000 7f98cff26800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:e239248c-0bee-4e41-803a-24b288d3eb8f.4226.9 : hit (requested=0x17, cached=0x17) 2024-09-22T08:37:42.454 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.444+0000 7f98cff26800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:e239248c-0bee-4e41-803a-24b288d3eb8f.4226.9 2024-09-22T08:37:42.454 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.444+0000 7f98cff26800 20 bucket index object: :.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.9.9 2024-09-22T08:37:42.455 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.444+0000 7f98cff26800 1 -- 172.21.15.142:0/773279257 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:91 4.35 4:acb4e751:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=187b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d3fb0d3ff0 con 0x55d3fb07d710 2024-09-22T08:37:42.455 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.445+0000 7f98cb3d8640 1 -- 172.21.15.142:0/773279257 <== osd.1 v2:172.21.15.142:6816/3192108003 31 ==== osd_op_reply(91 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.9.9 [stat,call,call] v32'4 uv4 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f98c008e040 con 0x55d3fb07d710 2024-09-22T08:37:42.455 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.445+0000 7f98cff26800 1 -- 172.21.15.142:0/773279257 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:92 3.6 3:61c0b0b1:::e239248c-0bee-4e41-803a-24b288d3eb8f.4226.9_thirteen:head [cmpxattr user.rgw.idtag (61) op 1 mode 1 in=75b,setxattr user.rgw.acl (117) in=129b,setxattr user.rgw.idtag (33) in=47b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d3fb0d1fd0 con 0x55d3fb07d710 2024-09-22T08:37:42.455 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.446+0000 7f98cb3d8640 1 -- 172.21.15.142:0/773279257 <== osd.1 v2:172.21.15.142:6816/3192108003 32 ==== osd_op_reply(92 e239248c-0bee-4e41-803a-24b288d3eb8f.4226.9_thirteen [cmpxattr (61) op 1 mode 1,setxattr (117),setxattr (33)] v32'4 uv4 ondisk = 0) ==== 280+0+0 (crc 0 0 0) 0x7f98c008e040 con 0x55d3fb07d710 2024-09-22T08:37:42.455 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.446+0000 7f98cff26800 1 -- 172.21.15.142:0/773279257 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:93 4.35 4:acb4e751:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=323b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d3fb0d35c0 con 0x55d3fb07d710 2024-09-22T08:37:42.455 INFO:teuthology.orchestra.run.smithi142.stderr:1 objects processed in :myfoo6[e239248c-0bee-4e41-803a-24b288d3eb8f.4226.9]). Next marker thirteen 2024-09-22T08:37:42.455 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.446+0000 7f98cff26800 1 -- 172.21.15.142:0/773279257 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:94 8.4 8:267425a8:users.uid::bud:head [delete,create,call version.set in=58b,writefull 0~380 in=380b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d3fb0c94d0 con 0x7f98c4054c20 2024-09-22T08:37:42.458 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.448+0000 7f98cbbd9640 1 -- 172.21.15.142:0/773279257 <== osd.2 v2:172.21.15.142:6808/279438927 17 ==== osd_op_reply(94 bud [delete,create,call,writefull 0~380] v32'2 uv2 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7f98bc01ad50 con 0x7f98c4054c20 2024-09-22T08:37:42.458 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.448+0000 7f98cff26800 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-09-22T08:37:42.458 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.448+0000 7f98cff26800 10 moving default.rgw.meta+users.uid+bud to cache LRU end 2024-09-22T08:37:42.458 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.448+0000 7f98cb3d8640 1 -- 172.21.15.142:0/773279257 <== osd.1 v2:172.21.15.142:6816/3192108003 33 ==== osd_op_reply(93 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.9.9 [stat,call,call] v32'5 uv5 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f98c008e040 con 0x55d3fb07d710 2024-09-22T08:37:42.458 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.448+0000 7f98cff26800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:bud, ofs0, ns] 2024-09-22T08:37:42.458 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.448+0000 7f97aa7fc640 20 handle_completion(): completion ok for obj=thirteen 2024-09-22T08:37:42.458 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.448+0000 7f98cff26800 1 -- 172.21.15.142:0/773279257 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [notify cookie 94368938356640 in=568b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d3fb0c94d0 con 0x7f98bc017050 2024-09-22T08:37:42.458 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.448+0000 7f98cb3d8640 1 -- 172.21.15.142:0/773279257 <== osd.0 v2:172.21.15.31:6800/168281188 32 ==== watch-notify(notify (1) cookie 94368938116336 notify 137438953498 ret 0) ==== 598+0+0 (crc 0 0 0) 0x55d3fb0c88e0 con 0x7f98bc017050 2024-09-22T08:37:42.458 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.448+0000 7f97aaffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953498 cookie 94368938116336 notifier 4730 bl.length()=556 2024-09-22T08:37:42.458 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.448+0000 7f97aaffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-09-22T08:37:42.458 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.448+0000 7f97aaffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bud to cache LRU end 2024-09-22T08:37:42.458 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.448+0000 7f97aaffd640 1 -- 172.21.15.142:0/773279257 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:96 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f9790003ea0 con 0x7f98bc017050 2024-09-22T08:37:42.458 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.448+0000 7f98cb3d8640 1 -- 172.21.15.142:0/773279257 <== osd.0 v2:172.21.15.31:6800/168281188 33 ==== osd_op_reply(95 notify.5 [notify cookie 94368938356640 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f98c008e040 con 0x7f98bc017050 2024-09-22T08:37:42.459 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.448+0000 7f98cb3d8640 1 -- 172.21.15.142:0/773279257 <== osd.0 v2:172.21.15.31:6800/168281188 34 ==== osd_op_reply(96 notify.5 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98c008e040 con 0x7f98bc017050 2024-09-22T08:37:42.459 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.448+0000 7f98cb3d8640 1 -- 172.21.15.142:0/773279257 <== osd.0 v2:172.21.15.31:6800/168281188 35 ==== watch-notify(notify_complete (2) cookie 94368938356640 notify 137438953498 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f98c009d040 con 0x7f98bc017050 2024-09-22T08:37:42.459 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.448+0000 7f98cff26800 1 -- 172.21.15.142:0/773279257 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:97 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d3fb0c94d0 con 0x55d3fb07d710 2024-09-22T08:37:42.459 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.449+0000 7f98cb3d8640 1 -- 172.21.15.142:0/773279257 <== osd.1 v2:172.21.15.142:6816/3192108003 34 ==== osd_op_reply(97 NX5QOQKC6BH2IDN8HC7A [delete,create,writefull 0~7] v32'3 uv3 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f98c008e040 con 0x55d3fb07d710 2024-09-22T08:37:42.459 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.449+0000 7f98cff26800 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-09-22T08:37:42.459 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.449+0000 7f98cff26800 10 adding default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-22T08:37:42.459 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.449+0000 7f98cff26800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-09-22T08:37:42.459 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.449+0000 7f98cff26800 1 -- 172.21.15.142:0/773279257 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:98 7.3 7:c609908c:::notify.5:head [notify cookie 94368938356640 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d3fb0c94d0 con 0x7f98bc017050 2024-09-22T08:37:42.459 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.450+0000 7f98cb3d8640 1 -- 172.21.15.142:0/773279257 <== osd.0 v2:172.21.15.31:6800/168281188 36 ==== watch-notify(notify (1) cookie 94368938116336 notify 137438953499 ret 0) ==== 219+0+0 (crc 0 0 0) 0x7f98c009d040 con 0x7f98bc017050 2024-09-22T08:37:42.459 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.450+0000 7f97aa7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953499 cookie 94368938116336 notifier 4730 bl.length()=177 2024-09-22T08:37:42.459 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.450+0000 7f97aa7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-09-22T08:37:42.459 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.450+0000 7f97aa7fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-22T08:37:42.460 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.450+0000 7f97aa7fc640 1 -- 172.21.15.142:0/773279257 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:99 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f9700003560 con 0x7f98bc017050 2024-09-22T08:37:42.460 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.450+0000 7f98cb3d8640 1 -- 172.21.15.142:0/773279257 <== osd.0 v2:172.21.15.31:6800/168281188 37 ==== osd_op_reply(98 notify.5 [notify cookie 94368938356640 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f98c008e040 con 0x7f98bc017050 2024-09-22T08:37:42.460 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.450+0000 7f98cb3d8640 1 -- 172.21.15.142:0/773279257 <== osd.0 v2:172.21.15.31:6800/168281188 38 ==== osd_op_reply(99 notify.5 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98c008e040 con 0x7f98bc017050 2024-09-22T08:37:42.460 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.450+0000 7f98cb3d8640 1 -- 172.21.15.142:0/773279257 <== osd.0 v2:172.21.15.31:6800/168281188 39 ==== watch-notify(notify_complete (2) cookie 94368938356640 notify 137438953499 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f98c007adc0 con 0x7f98bc017050 2024-09-22T08:37:42.460 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.450+0000 7f98cff26800 10 removing user index: bar 2024-09-22T08:37:42.460 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.450+0000 7f98cff26800 1 -- 172.21.15.142:0/773279257 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:100 8.e 8:718f6a54:users.uid::bar:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d3fb0c94d0 con 0x7f98bc017050 2024-09-22T08:37:42.460 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.451+0000 7f98cb3d8640 1 -- 172.21.15.142:0/773279257 <== osd.0 v2:172.21.15.31:6800/168281188 40 ==== osd_op_reply(100 bar [delete] v32'8 uv8 ondisk = 0) ==== 147+0+0 (crc 0 0 0) 0x7f98c008e040 con 0x7f98bc017050 2024-09-22T08:37:42.460 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.451+0000 7f98cff26800 10 removing default.rgw.meta+users.uid+bar from cache 2024-09-22T08:37:42.460 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.451+0000 7f98cff26800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:users.uid:bar, ofs0, ns] 2024-09-22T08:37:42.460 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.451+0000 7f98cff26800 1 -- 172.21.15.142:0/773279257 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:101 7.9 7:93e5b521:::notify.7:head [notify cookie 94368938356640 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d3fb0c94d0 con 0x7f98bc017050 2024-09-22T08:37:42.460 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.451+0000 7f98cb3d8640 1 -- 172.21.15.142:0/773279257 <== osd.0 v2:172.21.15.31:6800/168281188 41 ==== watch-notify(notify (1) cookie 94368938121360 notify 137438953500 ret 0) ==== 194+0+0 (crc 0 0 0) 0x7f98c007adc0 con 0x7f98bc017050 2024-09-22T08:37:42.460 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.451+0000 7f97aaffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953500 cookie 94368938121360 notifier 4730 bl.length()=152 2024-09-22T08:37:42.460 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.451+0000 7f97aaffd640 1 -- 172.21.15.142:0/773279257 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f9790003ea0 con 0x7f98bc017050 2024-09-22T08:37:42.461 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.451+0000 7f98cb3d8640 1 -- 172.21.15.142:0/773279257 <== osd.0 v2:172.21.15.31:6800/168281188 42 ==== osd_op_reply(101 notify.7 [notify cookie 94368938356640 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f98c008e040 con 0x7f98bc017050 2024-09-22T08:37:42.461 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.452+0000 7f98cb3d8640 1 -- 172.21.15.142:0/773279257 <== osd.0 v2:172.21.15.31:6800/168281188 43 ==== osd_op_reply(102 notify.7 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98c008e040 con 0x7f98bc017050 2024-09-22T08:37:42.461 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.452+0000 7f98cb3d8640 1 -- 172.21.15.142:0/773279257 <== osd.0 v2:172.21.15.31:6800/168281188 44 ==== watch-notify(notify_complete (2) cookie 94368938356640 notify 137438953500 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f98c005fc40 con 0x7f98bc017050 2024-09-22T08:37:42.461 INFO:teuthology.orchestra.run.smithi142.stdout:{"user_id":"bud","display_name":"Bar","email":"","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"bud","access_key":"NX5QOQKC6BH2IDN8HC7A","secret_key":"LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn","active":true,"create_date":"2024-09-22T08:37:42.279413Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-22T08:37:42.279403Z","tags":[],"group_ids":[]} 2024-09-22T08:37:42.466 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.453+0000 7f9781fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:37:42.466 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.453+0000 7f98cff26800 1 -- 172.21.15.142:0/773279257 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:103 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94368938122480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d3fb0c94d0 con 0x55d3fb07d710 2024-09-22T08:37:42.466 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.454+0000 7f98cb3d8640 1 -- 172.21.15.142:0/773279257 <== osd.1 v2:172.21.15.142:6816/3192108003 35 ==== osd_op_reply(103 data_loggenerations_metadata [watch unwatch cookie 94368938122480] v32'213 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f98c008e040 con 0x55d3fb07d710 2024-09-22T08:37:42.466 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.454+0000 7f98cff26800 1 -- 172.21.15.142:0/773279257 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:104 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94368938100800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d3fb0c94d0 con 0x7f98c4054c20 2024-09-22T08:37:42.466 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.455+0000 7f98cbbd9640 1 -- 172.21.15.142:0/773279257 <== osd.2 v2:172.21.15.142:6808/279438927 18 ==== osd_op_reply(104 notify.0 [watch unwatch cookie 94368938100800] v32'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98bc01ad50 con 0x7f98c4054c20 2024-09-22T08:37:42.466 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.455+0000 7f98cff26800 20 remove_watcher() i=0 2024-09-22T08:37:42.466 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.455+0000 7f98cff26800 2 removed watcher, disabling cache 2024-09-22T08:37:42.466 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.455+0000 7f98cff26800 1 -- 172.21.15.142:0/773279257 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:105 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94368938104688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d3fb0c94d0 con 0x55d3fb07d710 2024-09-22T08:37:42.467 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.456+0000 7f98cb3d8640 1 -- 172.21.15.142:0/773279257 <== osd.1 v2:172.21.15.142:6816/3192108003 36 ==== osd_op_reply(105 notify.1 [watch unwatch cookie 94368938104688] v32'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98c008e040 con 0x55d3fb07d710 2024-09-22T08:37:42.467 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.456+0000 7f98cff26800 20 remove_watcher() i=1 2024-09-22T08:37:42.467 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.456+0000 7f98cff26800 1 -- 172.21.15.142:0/773279257 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:106 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94368938109536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d3fb0c94d0 con 0x55d3fb082120 2024-09-22T08:37:42.467 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.457+0000 7f98cc3da640 1 -- 172.21.15.142:0/773279257 <== osd.3 v2:172.21.15.142:6800/1064901393 22 ==== osd_op_reply(106 notify.2 [watch unwatch cookie 94368938109536] v32'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98c403a070 con 0x55d3fb082120 2024-09-22T08:37:42.467 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.457+0000 7f98cff26800 20 remove_watcher() i=2 2024-09-22T08:37:42.467 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.457+0000 7f98cff26800 1 -- 172.21.15.142:0/773279257 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:107 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94368938113584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d3fb0c94d0 con 0x7f98c4054c20 2024-09-22T08:37:42.467 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.458+0000 7f98cbbd9640 1 -- 172.21.15.142:0/773279257 <== osd.2 v2:172.21.15.142:6808/279438927 19 ==== osd_op_reply(107 notify.3 [watch unwatch cookie 94368938113584] v32'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98bc01ad50 con 0x7f98c4054c20 2024-09-22T08:37:42.467 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.458+0000 7f98cff26800 20 remove_watcher() i=3 2024-09-22T08:37:42.467 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.458+0000 7f98cff26800 1 -- 172.21.15.142:0/773279257 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:108 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94368938106816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d3fb0c94d0 con 0x55d3fb07d710 2024-09-22T08:37:42.467 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.459+0000 7f98cb3d8640 1 -- 172.21.15.142:0/773279257 <== osd.1 v2:172.21.15.142:6816/3192108003 37 ==== osd_op_reply(108 notify.4 [watch unwatch cookie 94368938106816] v32'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98c008e040 con 0x55d3fb07d710 2024-09-22T08:37:42.467 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.459+0000 7f98cff26800 20 remove_watcher() i=4 2024-09-22T08:37:42.467 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.459+0000 7f98cff26800 1 -- 172.21.15.142:0/773279257 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:109 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94368938116336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d3fb0c94d0 con 0x7f98bc017050 2024-09-22T08:37:42.467 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.460+0000 7f98cb3d8640 1 -- 172.21.15.142:0/773279257 <== osd.0 v2:172.21.15.31:6800/168281188 45 ==== osd_op_reply(109 notify.5 [watch unwatch cookie 94368938116336] v32'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98c008e040 con 0x7f98bc017050 2024-09-22T08:37:42.467 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.460+0000 7f98cff26800 20 remove_watcher() i=5 2024-09-22T08:37:42.468 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.460+0000 7f98cff26800 1 -- 172.21.15.142:0/773279257 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:110 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94368938117904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d3fb0c94d0 con 0x7f98bc017050 2024-09-22T08:37:42.468 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.461+0000 7f98cb3d8640 1 -- 172.21.15.142:0/773279257 <== osd.0 v2:172.21.15.31:6800/168281188 46 ==== osd_op_reply(110 notify.6 [watch unwatch cookie 94368938117904] v32'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98c008e040 con 0x7f98bc017050 2024-09-22T08:37:42.468 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.461+0000 7f98cff26800 20 remove_watcher() i=6 2024-09-22T08:37:42.468 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.461+0000 7f98cff26800 1 -- 172.21.15.142:0/773279257 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:111 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94368938121360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d3fb0c94d0 con 0x7f98bc017050 2024-09-22T08:37:42.468 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.462+0000 7f98cb3d8640 1 -- 172.21.15.142:0/773279257 <== osd.0 v2:172.21.15.31:6800/168281188 47 ==== osd_op_reply(111 notify.7 [watch unwatch cookie 94368938121360] v32'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98c008e040 con 0x7f98bc017050 2024-09-22T08:37:42.468 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.462+0000 7f98cff26800 20 remove_watcher() i=7 2024-09-22T08:37:42.468 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.462+0000 7f98cff26800 1 -- 172.21.15.142:0/773279257 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f98bc017050 msgr2=0x7f98bc04b950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:42.468 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.462+0000 7f98cff26800 1 --2- 172.21.15.142:0/773279257 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f98bc017050 0x7f98bc04b950 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:42.468 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.462+0000 7f98cff26800 1 -- 172.21.15.142:0/773279257 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55d3fb07d710 msgr2=0x55d3fb07fbd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:42.468 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.462+0000 7f98cff26800 1 --2- 172.21.15.142:0/773279257 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55d3fb07d710 0x55d3fb07fbd0 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:42.468 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.462+0000 7f98cff26800 1 -- 172.21.15.142:0/773279257 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f98c4054c20 msgr2=0x7f98c4035080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:42.468 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.462+0000 7f98cff26800 1 --2- 172.21.15.142:0/773279257 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f98c4054c20 0x7f98c4035080 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:42.468 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.463+0000 7f98cff26800 1 -- 172.21.15.142:0/773279257 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55d3fb082120 msgr2=0x55d3fb084510 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:42.469 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.463+0000 7f98cff26800 1 --2- 172.21.15.142:0/773279257 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55d3fb082120 0x55d3fb084510 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:42.469 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.463+0000 7f98cff26800 1 -- 172.21.15.142:0/773279257 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f979403cfb0 msgr2=0x7f979403f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:42.469 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.463+0000 7f98cff26800 1 --2- 172.21.15.142:0/773279257 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f979403cfb0 0x7f979403f470 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f98bc022a80 tx=0x7f98bc054420 comp rx=0 tx=0).stop 2024-09-22T08:37:42.469 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.463+0000 7f98cff26800 1 -- 172.21.15.142:0/773279257 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d3fb06a7f0 msgr2=0x55d3fb071d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:42.469 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.463+0000 7f98cb3d8640 1 -- 172.21.15.142:0/773279257 reap_dead start 2024-09-22T08:37:42.469 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.463+0000 7f98cff26800 1 --2- 172.21.15.142:0/773279257 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d3fb06a7f0 0x55d3fb071d90 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f98c4020790 tx=0x7f98c40547a0 comp rx=0 tx=0).stop 2024-09-22T08:37:42.469 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.463+0000 7f98cff26800 1 -- 172.21.15.142:0/773279257 shutdown_connections 2024-09-22T08:37:42.469 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.463+0000 7f98cff26800 1 --2- 172.21.15.142:0/773279257 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d3fb06a7f0 0x55d3fb071d90 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:42.469 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.463+0000 7f98cff26800 1 -- 172.21.15.142:0/773279257 >> 172.21.15.142:0/773279257 conn(0x55d3fb066c10 msgr2=0x55d3fb064e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:37:42.469 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.463+0000 7f98cff26800 1 -- 172.21.15.142:0/773279257 shutdown_connections 2024-09-22T08:37:42.469 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.463+0000 7f98cff26800 1 -- 172.21.15.142:0/773279257 wait complete. 2024-09-22T08:37:42.469 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.463+0000 7f98cff26800 1 -- 172.21.15.142:0/25440620 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f97a403cfb0 msgr2=0x7f97a403f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:42.469 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.463+0000 7f98cff26800 1 --2- 172.21.15.142:0/25440620 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f97a403cfb0 0x7f97a403f470 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f98bc052a50 tx=0x7f98bc041040 comp rx=0 tx=0).stop 2024-09-22T08:37:42.470 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.463+0000 7f98cff26800 1 -- 172.21.15.142:0/25440620 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d3fb05dd50 msgr2=0x55d3fb05e170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:42.470 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.463+0000 7f98cff26800 1 --2- 172.21.15.142:0/25440620 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d3fb05dd50 0x55d3fb05e170 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x55d3fb0383c0 tx=0x7f98c40167b0 comp rx=0 tx=0).stop 2024-09-22T08:37:42.470 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.463+0000 7f98cff26800 1 -- 172.21.15.142:0/25440620 shutdown_connections 2024-09-22T08:37:42.470 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.463+0000 7f98cff26800 1 --2- 172.21.15.142:0/25440620 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f97a403cfb0 0x7f97a403f470 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:42.470 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.463+0000 7f98cff26800 1 --2- 172.21.15.142:0/25440620 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d3fb05dd50 0x55d3fb05e170 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:42.470 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.463+0000 7f98cff26800 1 -- 172.21.15.142:0/25440620 >> 172.21.15.142:0/25440620 conn(0x55d3fb052100 msgr2=0x55d3fb0524e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:37:42.470 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.463+0000 7f98cff26800 1 -- 172.21.15.142:0/25440620 shutdown_connections 2024-09-22T08:37:42.470 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.463+0000 7f98cff26800 1 -- 172.21.15.142:0/25440620 wait complete. 2024-09-22T08:37:42.470 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.464+0000 7f98cff26800 1 -- 172.21.15.142:0/3386246350 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55d3faf49be0 msgr2=0x55d3fb04a030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:42.470 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.464+0000 7f98cff26800 1 --2- 172.21.15.142:0/3386246350 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55d3faf49be0 0x55d3fb04a030 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:42.470 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.464+0000 7f98cff26800 1 -- 172.21.15.142:0/3386246350 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55d3fb04c8f0 msgr2=0x55d3fb04ece0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:42.470 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.464+0000 7f98cff26800 1 --2- 172.21.15.142:0/3386246350 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55d3fb04c8f0 0x55d3fb04ece0 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:42.470 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.464+0000 7f98cff26800 1 -- 172.21.15.142:0/3386246350 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f97b403cfb0 msgr2=0x7f97b403f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:42.470 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.464+0000 7f98cff26800 1 --2- 172.21.15.142:0/3386246350 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f97b403cfb0 0x7f97b403f470 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f98c0057000 tx=0x7f98c0052000 comp rx=0 tx=0).stop 2024-09-22T08:37:42.471 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.464+0000 7f98cff26800 1 -- 172.21.15.142:0/3386246350 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d3faf487d0 msgr2=0x55d3fb0392d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:42.471 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.464+0000 7f98cff26800 1 --2- 172.21.15.142:0/3386246350 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d3faf487d0 0x55d3fb0392d0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x55d3faebcd00 tx=0x7f98bc000bc0 comp rx=0 tx=0).stop 2024-09-22T08:37:42.471 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.464+0000 7f98cff26800 1 -- 172.21.15.142:0/3386246350 shutdown_connections 2024-09-22T08:37:42.471 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.464+0000 7f98cff26800 1 --2- 172.21.15.142:0/3386246350 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55d3fb04c8f0 0x55d3fb04ece0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:42.471 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.464+0000 7f98cff26800 1 --2- 172.21.15.142:0/3386246350 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55d3faf49be0 0x55d3fb04a030 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:42.471 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.464+0000 7f98cff26800 1 --2- 172.21.15.142:0/3386246350 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f97b403cfb0 0x7f97b403f470 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:42.471 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.464+0000 7f98cff26800 1 --2- 172.21.15.142:0/3386246350 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d3faf487d0 0x55d3fb0392d0 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:42.471 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.464+0000 7f98cff26800 1 -- 172.21.15.142:0/3386246350 >> 172.21.15.142:0/3386246350 conn(0x55d3faf43ba0 msgr2=0x55d3fb032070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:37:42.471 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.464+0000 7f98cff26800 1 -- 172.21.15.142:0/3386246350 shutdown_connections 2024-09-22T08:37:42.471 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:42.464+0000 7f98cff26800 1 -- 172.21.15.142:0/3386246350 wait complete. 2024-09-22T08:37:42.473 DEBUG:tasks.util.rgw: json result: {'user_id': 'bud', 'display_name': 'Bar', 'email': '', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'bud', 'access_key': 'NX5QOQKC6BH2IDN8HC7A', 'secret_key': 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', 'active': True, 'create_date': '2024-09-22T08:37:42.279413Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-22T08:37:42.279403Z', 'tags': [], 'group_ids': []} 2024-09-22T08:37:47.480 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=0 failed=False 2024-09-22T08:37:47.480 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=8 failed=False 2024-09-22T08:37:47.480 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '4'] 2024-09-22T08:37:47.480 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '4'] 2024-09-22T08:37:47.481 DEBUG:teuthology.orchestra.run.smithi142:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid fud --display-name Fud --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh --max-buckets 4 2024-09-22T08:37:47.540 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:37:47.540 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:37:47.541 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.540+0000 7f19da52e800 1 Processor -- start 2024-09-22T08:37:47.541 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.540+0000 7f19da52e800 1 -- start start 2024-09-22T08:37:47.541 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.540+0000 7f19da52e800 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55fb5a55bc30 0x55fb5a5615c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:47.541 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.540+0000 7f19da52e800 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55fb5a3e6a20 con 0x55fb5a55a820 2024-09-22T08:37:47.541 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.540+0000 7f19da52e800 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x55fb5a3e67d0 con 0x55fb5a55bc30 2024-09-22T08:37:47.542 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.540+0000 7f19d5963640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55fb5a55bc30 0x55fb5a5615c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:47.542 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.540+0000 7f19d6164640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x55fb5a55a820 0x55fb5a55b520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.142:50300/0 (socket says 172.21.15.142:50300) 2024-09-22T08:37:47.542 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.540+0000 7f19d6164640 1 -- 172.21.15.142:0/1997276075 learned_addr learned my addr 172.21.15.142:0/1997276075 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-09-22T08:37:47.542 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.541+0000 7f19d5963640 1 -- 172.21.15.142:0/1997276075 >> v1:172.21.15.31:6789/0 conn(0x55fb5a55a820 legacy=0x55fb5a55b520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:47.542 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.541+0000 7f19d5963640 1 -- 172.21.15.142:0/1997276075 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fb5a55af20 con 0x55fb5a55bc30 2024-09-22T08:37:47.545 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.542+0000 7f19d5963640 1 --2- 172.21.15.142:0/1997276075 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fb5a55bc30 0x55fb5a5615c0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f19cc00a470 tx=0x7f19cc045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a9e9ca6dc035bf server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:47.545 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.543+0000 7f19d5162640 1 -- 172.21.15.142:0/1997276075 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f19cc053570 con 0x55fb5a55bc30 2024-09-22T08:37:47.545 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.543+0000 7f19d5162640 1 -- 172.21.15.142:0/1997276075 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19cc058070 con 0x55fb5a55bc30 2024-09-22T08:37:47.545 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.543+0000 7f19d5162640 1 -- 172.21.15.142:0/1997276075 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f19cc053880 con 0x55fb5a55bc30 2024-09-22T08:37:47.545 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.543+0000 7f19da52e800 1 -- 172.21.15.142:0/1997276075 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fb5a55bc30 msgr2=0x55fb5a5615c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:47.546 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.543+0000 7f19da52e800 1 --2- 172.21.15.142:0/1997276075 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fb5a55bc30 0x55fb5a5615c0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f19cc00a470 tx=0x7f19cc045a20 comp rx=0 tx=0).stop 2024-09-22T08:37:47.546 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.543+0000 7f19da52e800 1 -- 172.21.15.142:0/1997276075 shutdown_connections 2024-09-22T08:37:47.546 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.543+0000 7f19da52e800 1 --2- 172.21.15.142:0/1997276075 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fb5a55bc30 0x55fb5a5615c0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:47.546 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.543+0000 7f19da52e800 1 -- 172.21.15.142:0/1997276075 >> 172.21.15.142:0/1997276075 conn(0x55fb5a555bf0 msgr2=0x55fb5a558050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:37:47.546 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.543+0000 7f19da52e800 1 -- 172.21.15.142:0/1997276075 shutdown_connections 2024-09-22T08:37:47.546 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.543+0000 7f19da52e800 1 -- 172.21.15.142:0/1997276075 wait complete. 2024-09-22T08:37:47.561 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.559+0000 7f19da52e800 1 Processor -- start 2024-09-22T08:37:47.562 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.559+0000 7f19da52e800 1 -- start start 2024-09-22T08:37:47.562 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.559+0000 7f19da52e800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fb5a55a820 0x55fb5a4ce930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:47.562 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.559+0000 7f19da52e800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55fb5a3f3dd0 con 0x55fb5a55a820 2024-09-22T08:37:47.562 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.559+0000 7f19d6164640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fb5a55a820 0x55fb5a4ce930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:47.562 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.559+0000 7f19d6164640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fb5a55a820 0x55fb5a4ce930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:55976/0 (socket says 172.21.15.142:55976) 2024-09-22T08:37:47.562 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.559+0000 7f19d6164640 1 -- 172.21.15.142:0/2449167548 learned_addr learned my addr 172.21.15.142:0/2449167548 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:37:47.562 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.560+0000 7f19d6164640 1 -- 172.21.15.142:0/2449167548 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fb5a4cee70 con 0x55fb5a55a820 2024-09-22T08:37:47.562 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.560+0000 7f19d6164640 1 --2- 172.21.15.142:0/2449167548 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fb5a55a820 0x55fb5a4ce930 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f19c8001800 tx=0x7f19c8001cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccfe6fca74c452cc server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:47.562 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.560+0000 7f18c4608640 1 -- 172.21.15.142:0/2449167548 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f19c8004520 con 0x55fb5a55a820 2024-09-22T08:37:47.562 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.560+0000 7f18c4608640 1 -- 172.21.15.142:0/2449167548 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19c80046c0 con 0x55fb5a55a820 2024-09-22T08:37:47.563 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.560+0000 7f18c4608640 1 -- 172.21.15.142:0/2449167548 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f19c80049e0 con 0x55fb5a55a820 2024-09-22T08:37:47.564 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.561+0000 7f19da52e800 1 -- 172.21.15.142:0/2449167548 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fb5a55a820 msgr2=0x55fb5a4ce930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:47.564 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.561+0000 7f19da52e800 1 --2- 172.21.15.142:0/2449167548 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fb5a55a820 0x55fb5a4ce930 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f19c8001800 tx=0x7f19c8001cc0 comp rx=0 tx=0).stop 2024-09-22T08:37:47.564 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.561+0000 7f19da52e800 1 -- 172.21.15.142:0/2449167548 shutdown_connections 2024-09-22T08:37:47.564 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.561+0000 7f19da52e800 1 --2- 172.21.15.142:0/2449167548 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fb5a55a820 0x55fb5a4ce930 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:47.565 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.561+0000 7f19da52e800 1 -- 172.21.15.142:0/2449167548 >> 172.21.15.142:0/2449167548 conn(0x55fb5a555bf0 msgr2=0x55fb5a645980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:37:47.565 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.561+0000 7f19da52e800 1 -- 172.21.15.142:0/2449167548 shutdown_connections 2024-09-22T08:37:47.565 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.561+0000 7f19da52e800 1 -- 172.21.15.142:0/2449167548 wait complete. 2024-09-22T08:37:47.565 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.561+0000 7f19da52e800 1 Processor -- start 2024-09-22T08:37:47.565 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.561+0000 7f19da52e800 1 -- start start 2024-09-22T08:37:47.565 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.562+0000 7f19da52e800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fb5a55a820 0x55fb5a654e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:47.565 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.562+0000 7f19da52e800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55fb5a561b00 con 0x55fb5a55a820 2024-09-22T08:37:47.565 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.562+0000 7f19d6164640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fb5a55a820 0x55fb5a654e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:47.565 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.562+0000 7f19d6164640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fb5a55a820 0x55fb5a654e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:55990/0 (socket says 172.21.15.142:55990) 2024-09-22T08:37:47.565 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.562+0000 7f19d6164640 1 -- 172.21.15.142:0/4138034035 learned_addr learned my addr 172.21.15.142:0/4138034035 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:37:47.565 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.562+0000 7f19d6164640 1 -- 172.21.15.142:0/4138034035 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fb5a6553c0 con 0x55fb5a55a820 2024-09-22T08:37:47.566 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.562+0000 7f19d6164640 1 --2- 172.21.15.142:0/4138034035 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fb5a55a820 0x55fb5a654e60 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f19c8000f80 tx=0x7f19c8001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:47.566 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.563+0000 7f18c2e05640 1 -- 172.21.15.142:0/4138034035 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f19c8022020 con 0x55fb5a55a820 2024-09-22T08:37:47.566 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.563+0000 7f18c2e05640 1 -- 172.21.15.142:0/4138034035 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19c8014890 con 0x55fb5a55a820 2024-09-22T08:37:47.566 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.563+0000 7f19da52e800 1 -- 172.21.15.142:0/4138034035 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fb5a655650 con 0x55fb5a55a820 2024-09-22T08:37:47.566 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.563+0000 7f18c2e05640 1 -- 172.21.15.142:0/4138034035 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f19c8014bb0 con 0x55fb5a55a820 2024-09-22T08:37:47.566 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.563+0000 7f19da52e800 1 -- 172.21.15.142:0/4138034035 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fb5a656050 con 0x55fb5a55a820 2024-09-22T08:37:47.569 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.564+0000 7f18c2e05640 1 -- 172.21.15.142:0/4138034035 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f19c8025020 con 0x55fb5a55a820 2024-09-22T08:37:47.570 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.564+0000 7f18c2e05640 1 --2- 172.21.15.142:0/4138034035 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f18bc03cfb0 0x7f18bc03f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:47.570 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.564+0000 7f18c2e05640 1 -- 172.21.15.142:0/4138034035 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5938+0+0 (secure 0 0 0) 0x7f19c8018030 con 0x55fb5a55a820 2024-09-22T08:37:47.570 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.564+0000 7f19d5963640 1 --2- 172.21.15.142:0/4138034035 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f18bc03cfb0 0x7f18bc03f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:47.570 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.564+0000 7f19da52e800 1 --2- 172.21.15.142:0/4138034035 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55fb5a55bc30 0x55fb5a65c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:47.570 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.564+0000 7f19da52e800 1 -- 172.21.15.142:0/4138034035 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fb5a65c9f0 con 0x55fb5a55bc30 2024-09-22T08:37:47.570 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.564+0000 7f19d6965640 1 --2- 172.21.15.142:0/4138034035 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55fb5a55bc30 0x55fb5a65c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:47.570 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.564+0000 7f19d5963640 1 --2- 172.21.15.142:0/4138034035 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f18bc03cfb0 0x7f18bc03f470 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f19cc057000 tx=0x7f19cc052000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:47.570 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.565+0000 7f19d6965640 1 --2- 172.21.15.142:0/4138034035 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55fb5a55bc30 0x55fb5a65c4b0 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:47.571 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.565+0000 7f19d6965640 1 -- 172.21.15.142:0/4138034035 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f19d00083e0 con 0x55fb5a55bc30 2024-09-22T08:37:47.571 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.565+0000 7f19da52e800 1 -- 172.21.15.142:0/4138034035 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fb5a65cd90 con 0x55fb5a55bc30 2024-09-22T08:37:47.571 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.565+0000 7f19d6965640 1 -- 172.21.15.142:0/4138034035 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f19d00083e0 con 0x55fb5a55bc30 2024-09-22T08:37:47.571 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.565+0000 7f19da52e800 1 --2- 172.21.15.142:0/4138034035 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55fb5a65e890 0x55fb5a660d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:47.571 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.565+0000 7f19da52e800 1 -- 172.21.15.142:0/4138034035 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:3 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fb5a6614a0 con 0x55fb5a65e890 2024-09-22T08:37:47.571 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.565+0000 7f19d6164640 1 --2- 172.21.15.142:0/4138034035 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55fb5a65e890 0x55fb5a660d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:47.571 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.566+0000 7f19d6164640 1 --2- 172.21.15.142:0/4138034035 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55fb5a65e890 0x55fb5a660d10 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:47.572 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.566+0000 7f19d6164640 1 -- 172.21.15.142:0/4138034035 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(3 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f19c801b070 con 0x55fb5a65e890 2024-09-22T08:37:47.572 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.566+0000 7f19da52e800 1 -- 172.21.15.142:0/4138034035 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fb5a65d5e0 con 0x55fb5a55bc30 2024-09-22T08:37:47.572 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.566+0000 7f19d6965640 1 -- 172.21.15.142:0/4138034035 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f19d00083e0 con 0x55fb5a55bc30 2024-09-22T08:37:47.572 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.566+0000 7f19da52e800 1 -- 172.21.15.142:0/4138034035 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fb5a65da30 con 0x55fb5a65e890 2024-09-22T08:37:47.572 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.567+0000 7f19d6164640 1 -- 172.21.15.142:0/4138034035 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(5 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f19c801b070 con 0x55fb5a65e890 2024-09-22T08:37:47.572 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.567+0000 7f19da52e800 1 Processor -- start 2024-09-22T08:37:47.573 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.567+0000 7f19da52e800 1 -- start start 2024-09-22T08:37:47.573 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.567+0000 7f19da52e800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fb5a66fea0 0x55fb5a6702c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:47.573 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.567+0000 7f19da52e800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55fb5a452d50 con 0x55fb5a66fea0 2024-09-22T08:37:47.573 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.568+0000 7f19d6965640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fb5a66fea0 0x55fb5a6702c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:47.573 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.568+0000 7f19d6965640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fb5a66fea0 0x55fb5a6702c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:56004/0 (socket says 172.21.15.142:56004) 2024-09-22T08:37:47.573 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.568+0000 7f19d6965640 1 -- 172.21.15.142:0/609975436 learned_addr learned my addr 172.21.15.142:0/609975436 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:37:47.573 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.568+0000 7f19d6965640 1 -- 172.21.15.142:0/609975436 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fb5a670900 con 0x55fb5a66fea0 2024-09-22T08:37:47.573 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.568+0000 7f19d6965640 1 --2- 172.21.15.142:0/609975436 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fb5a66fea0 0x55fb5a6702c0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x55fb5a655e60 tx=0x7f19d000bf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:47.573 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.568+0000 7f18bbfff640 1 -- 172.21.15.142:0/609975436 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f19d001c020 con 0x55fb5a66fea0 2024-09-22T08:37:47.573 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.568+0000 7f18bbfff640 1 -- 172.21.15.142:0/609975436 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19d0007c90 con 0x55fb5a66fea0 2024-09-22T08:37:47.573 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.568+0000 7f19da52e800 1 -- 172.21.15.142:0/609975436 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fb5a671130 con 0x55fb5a66fea0 2024-09-22T08:37:47.574 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.568+0000 7f18bbfff640 1 -- 172.21.15.142:0/609975436 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f19d0018440 con 0x55fb5a66fea0 2024-09-22T08:37:47.574 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.568+0000 7f19da52e800 1 -- 172.21.15.142:0/609975436 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fb5a6716d0 con 0x55fb5a66fea0 2024-09-22T08:37:47.583 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.569+0000 7f18bbfff640 1 -- 172.21.15.142:0/609975436 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f19d001f020 con 0x55fb5a66fea0 2024-09-22T08:37:47.583 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.570+0000 7f18bbfff640 1 --2- 172.21.15.142:0/609975436 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f18b003cfb0 0x7f18b003f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:47.583 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.570+0000 7f18bbfff640 1 -- 172.21.15.142:0/609975436 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5938+0+0 (secure 0 0 0) 0x7f19d00559d0 con 0x55fb5a66fea0 2024-09-22T08:37:47.583 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.570+0000 7f19d6164640 1 --2- 172.21.15.142:0/609975436 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f18b003cfb0 0x7f18b003f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:47.583 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.570+0000 7f19da52e800 1 Processor -- start 2024-09-22T08:37:47.583 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.570+0000 7f19da52e800 1 -- start start 2024-09-22T08:37:47.583 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.570+0000 7f19d6164640 1 --2- 172.21.15.142:0/609975436 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f18b003cfb0 0x7f18b003f470 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f19c8052b50 tx=0x7f19c8011f40 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:47.583 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.570+0000 7f19da52e800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fb5a67c900 0x55fb5a67cd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:47.583 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.570+0000 7f19da52e800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55fb5a6501f0 con 0x55fb5a67c900 2024-09-22T08:37:47.583 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.570+0000 7f19d6965640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fb5a67c900 0x55fb5a67cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:47.584 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.570+0000 7f19d6965640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fb5a67c900 0x55fb5a67cd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:56012/0 (socket says 172.21.15.142:56012) 2024-09-22T08:37:47.584 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.570+0000 7f19d6965640 1 -- 172.21.15.142:0/202358565 learned_addr learned my addr 172.21.15.142:0/202358565 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:37:47.584 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.571+0000 7f19d6965640 1 -- 172.21.15.142:0/202358565 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fb5a67d2f0 con 0x55fb5a67c900 2024-09-22T08:37:47.584 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.571+0000 7f19d6965640 1 --2- 172.21.15.142:0/202358565 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fb5a67c900 0x55fb5a67cd00 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f19d0053df0 tx=0x7f19d0015970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5eb24bcc9c7cb5e server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:47.584 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.571+0000 7f18b9ffb640 1 -- 172.21.15.142:0/202358565 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f19d004a070 con 0x55fb5a67c900 2024-09-22T08:37:47.584 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.571+0000 7f18b9ffb640 1 -- 172.21.15.142:0/202358565 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19d0015e70 con 0x55fb5a67c900 2024-09-22T08:37:47.584 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.571+0000 7f18b9ffb640 1 -- 172.21.15.142:0/202358565 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f19d00174d0 con 0x55fb5a67c900 2024-09-22T08:37:47.584 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.571+0000 7f19da52e800 1 -- 172.21.15.142:0/202358565 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fb5a67c900 msgr2=0x55fb5a67cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:47.584 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.571+0000 7f19da52e800 1 --2- 172.21.15.142:0/202358565 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fb5a67c900 0x55fb5a67cd00 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f19d0053df0 tx=0x7f19d0015970 comp rx=0 tx=0).stop 2024-09-22T08:37:47.585 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.572+0000 7f19da52e800 1 -- 172.21.15.142:0/202358565 shutdown_connections 2024-09-22T08:37:47.585 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.572+0000 7f19da52e800 1 --2- 172.21.15.142:0/202358565 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fb5a67c900 0x55fb5a67cd00 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:47.585 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.572+0000 7f19da52e800 1 -- 172.21.15.142:0/202358565 >> 172.21.15.142:0/202358565 conn(0x55fb5a678d00 msgr2=0x55fb5a676f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:37:47.585 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.572+0000 7f19da52e800 1 -- 172.21.15.142:0/202358565 shutdown_connections 2024-09-22T08:37:47.585 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.572+0000 7f19da52e800 1 -- 172.21.15.142:0/202358565 wait complete. 2024-09-22T08:37:47.585 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.572+0000 7f19da52e800 1 Processor -- start 2024-09-22T08:37:47.585 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.572+0000 7f19da52e800 1 -- start start 2024-09-22T08:37:47.585 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.572+0000 7f19da52e800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fb5a67c900 0x55fb5a683f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:47.585 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.572+0000 7f19da52e800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55fb5a67d910 con 0x55fb5a67c900 2024-09-22T08:37:47.585 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.572+0000 7f19d6965640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fb5a67c900 0x55fb5a683f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:47.585 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.572+0000 7f19d6965640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fb5a67c900 0x55fb5a683f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:56028/0 (socket says 172.21.15.142:56028) 2024-09-22T08:37:47.585 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.572+0000 7f19d6965640 1 -- 172.21.15.142:0/4247517988 learned_addr learned my addr 172.21.15.142:0/4247517988 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:37:47.586 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.573+0000 7f19d6965640 1 -- 172.21.15.142:0/4247517988 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fb5a684460 con 0x55fb5a67c900 2024-09-22T08:37:47.586 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.573+0000 7f19d6965640 1 --2- 172.21.15.142:0/4247517988 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fb5a67c900 0x55fb5a683f00 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f19d0008fd0 tx=0x7f19d0053d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:47.586 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.573+0000 7f18a7fff640 1 -- 172.21.15.142:0/4247517988 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f19d004a070 con 0x55fb5a67c900 2024-09-22T08:37:47.586 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.573+0000 7f18a7fff640 1 -- 172.21.15.142:0/4247517988 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19d004b040 con 0x55fb5a67c900 2024-09-22T08:37:47.586 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.573+0000 7f18a7fff640 1 -- 172.21.15.142:0/4247517988 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f19d0017730 con 0x55fb5a67c900 2024-09-22T08:37:47.586 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.573+0000 7f19da52e800 1 -- 172.21.15.142:0/4247517988 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fb5a6846f0 con 0x55fb5a67c900 2024-09-22T08:37:47.586 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.573+0000 7f19da52e800 1 -- 172.21.15.142:0/4247517988 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fb5a685280 con 0x55fb5a67c900 2024-09-22T08:37:47.586 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.574+0000 7f18a7fff640 1 -- 172.21.15.142:0/4247517988 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f19d0016040 con 0x55fb5a67c900 2024-09-22T08:37:47.586 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.574+0000 7f18a7fff640 1 --2- 172.21.15.142:0/4247517988 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f18a003cf10 0x7f18a003f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:47.586 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.574+0000 7f18a7fff640 1 -- 172.21.15.142:0/4247517988 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5938+0+0 (secure 0 0 0) 0x7f19d0055040 con 0x55fb5a67c900 2024-09-22T08:37:47.587 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.574+0000 7f19d6164640 1 --2- 172.21.15.142:0/4247517988 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f18a003cf10 0x7f18a003f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:47.587 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.575+0000 7f19d6164640 1 --2- 172.21.15.142:0/4247517988 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f18a003cf10 0x7f18a003f3d0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f19c8052db0 tx=0x7f19c8046000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:47.587 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.575+0000 7f19da52e800 20 rados->read ofs=0 len=0 2024-09-22T08:37:47.587 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.575+0000 7f19da52e800 1 --2- 172.21.15.142:0/4247517988 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55fb5a68f820 0x55fb5a691ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:47.587 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.575+0000 7f19da52e800 1 -- 172.21.15.142:0/4247517988 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fb5a692430 con 0x55fb5a68f820 2024-09-22T08:37:47.587 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.575+0000 7f19d5963640 1 --2- 172.21.15.142:0/4247517988 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55fb5a68f820 0x55fb5a691ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:47.587 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.575+0000 7f19d5963640 1 --2- 172.21.15.142:0/4247517988 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55fb5a68f820 0x55fb5a691ce0 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:47.587 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.576+0000 7f19d5963640 1 -- 172.21.15.142:0/4247517988 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f19cc051070 con 0x55fb5a68f820 2024-09-22T08:37:47.587 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.576+0000 7f19da52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:47.587 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.576+0000 7f19da52e800 20 realm 2024-09-22T08:37:47.587 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.576+0000 7f19da52e800 20 rados->read ofs=0 len=0 2024-09-22T08:37:47.587 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.576+0000 7f19da52e800 1 -- 172.21.15.142:0/4247517988 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fb5a692860 con 0x55fb5a68f820 2024-09-22T08:37:47.587 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.576+0000 7f19d5963640 1 -- 172.21.15.142:0/4247517988 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f19cc051070 con 0x55fb5a68f820 2024-09-22T08:37:47.587 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.576+0000 7f19da52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:47.588 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.576+0000 7f19da52e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:37:47.588 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.576+0000 7f19da52e800 20 rados->read ofs=0 len=0 2024-09-22T08:37:47.588 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.576+0000 7f19da52e800 1 -- 172.21.15.142:0/4247517988 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fb5a693130 con 0x55fb5a68f820 2024-09-22T08:37:47.588 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.576+0000 7f19d5963640 1 -- 172.21.15.142:0/4247517988 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f19cc051070 con 0x55fb5a68f820 2024-09-22T08:37:47.588 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.576+0000 7f19da52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:47.588 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.576+0000 7f19da52e800 20 rados->read ofs=0 len=0 2024-09-22T08:37:47.588 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.576+0000 7f19da52e800 1 -- 172.21.15.142:0/4247517988 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fb5a6934d0 con 0x55fb5a68f820 2024-09-22T08:37:47.588 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.576+0000 7f19d5963640 1 -- 172.21.15.142:0/4247517988 <== osd.1 v2:172.21.15.142:6816/3192108003 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f19cc051070 con 0x55fb5a68f820 2024-09-22T08:37:47.588 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.576+0000 7f19da52e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:37:47.588 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.576+0000 7f19da52e800 20 rados->read ofs=0 len=0 2024-09-22T08:37:47.588 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.576+0000 7f19da52e800 1 --2- 172.21.15.142:0/4247517988 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55fb5a694230 0x55fb5a696620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:47.588 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.576+0000 7f19da52e800 1 -- 172.21.15.142:0/4247517988 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fb5a696c30 con 0x55fb5a694230 2024-09-22T08:37:47.588 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.576+0000 7f19d6965640 1 --2- 172.21.15.142:0/4247517988 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55fb5a694230 0x55fb5a696620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:47.588 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.577+0000 7f19d6965640 1 --2- 172.21.15.142:0/4247517988 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55fb5a694230 0x55fb5a696620 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:47.589 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.577+0000 7f19d6965640 1 -- 172.21.15.142:0/4247517988 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(5 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f19d00083e0 con 0x55fb5a694230 2024-09-22T08:37:47.589 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.577+0000 7f19da52e800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:37:47.589 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.577+0000 7f19da52e800 20 searching for the correct realm 2024-09-22T08:37:47.589 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.577+0000 7f19da52e800 1 -- 172.21.15.142:0/4247517988 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fb5a698560 con 0x55fb5a694230 2024-09-22T08:37:47.589 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.577+0000 7f19d6965640 1 -- 172.21.15.142:0/4247517988 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19d00083e0 con 0x55fb5a694230 2024-09-22T08:37:47.589 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.577+0000 7f19d6965640 1 --2- 172.21.15.142:0/4247517988 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f19d0021020 0x7f19d002a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:47.589 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.577+0000 7f19d6965640 1 -- 172.21.15.142:0/4247517988 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fb5a698560 con 0x7f19d0021020 2024-09-22T08:37:47.589 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.577+0000 7f19d6164640 1 --2- 172.21.15.142:0/4247517988 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f19d0021020 0x7f19d002a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:47.589 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.578+0000 7f19d6164640 1 --2- 172.21.15.142:0/4247517988 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f19d0021020 0x7f19d002a790 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:47.589 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.578+0000 7f19d6164640 1 -- 172.21.15.142:0/4247517988 <== osd.2 v2:172.21.15.142:6808/279438927 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19c801b070 con 0x7f19d0021020 2024-09-22T08:37:47.589 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.578+0000 7f19d6164640 1 --2- 172.21.15.142:0/4247517988 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f19c8027020 0x7f19c801e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:47.589 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.578+0000 7f19d6164640 1 -- 172.21.15.142:0/4247517988 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fb5a698560 con 0x7f19c8027020 2024-09-22T08:37:47.589 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.578+0000 7f19d5963640 1 --2- 172.21.15.142:0/4247517988 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f19c8027020 0x7f19c801e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:47.589 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.579+0000 7f19d5963640 1 --2- 172.21.15.142:0/4247517988 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f19c8027020 0x7f19c801e3f0 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:47.590 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.579+0000 7f19d5963640 1 -- 172.21.15.142:0/4247517988 <== osd.0 v2:172.21.15.31:6800/168281188 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19cc051070 con 0x7f19c8027020 2024-09-22T08:37:47.590 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.579+0000 7f19d5963640 1 -- 172.21.15.142:0/4247517988 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fb5a698560 con 0x55fb5a68f820 2024-09-22T08:37:47.590 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.579+0000 7f19d5963640 1 -- 172.21.15.142:0/4247517988 <== osd.1 v2:172.21.15.142:6816/3192108003 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19cc051070 con 0x55fb5a68f820 2024-09-22T08:37:47.590 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.579+0000 7f19d5963640 1 -- 172.21.15.142:0/4247517988 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fb5a698560 con 0x55fb5a68f820 2024-09-22T08:37:47.590 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.580+0000 7f19d5963640 1 -- 172.21.15.142:0/4247517988 <== osd.1 v2:172.21.15.142:6816/3192108003 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19cc051070 con 0x55fb5a68f820 2024-09-22T08:37:47.590 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.580+0000 7f19d5963640 1 -- 172.21.15.142:0/4247517988 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fb5a698560 con 0x55fb5a68f820 2024-09-22T08:37:47.590 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.580+0000 7f19d5963640 1 -- 172.21.15.142:0/4247517988 <== osd.1 v2:172.21.15.142:6816/3192108003 7 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19cc051070 con 0x55fb5a68f820 2024-09-22T08:37:47.590 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.580+0000 7f19d5963640 1 -- 172.21.15.142:0/4247517988 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fb5a698560 con 0x7f19c8027020 2024-09-22T08:37:47.590 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.580+0000 7f19d5963640 1 -- 172.21.15.142:0/4247517988 <== osd.0 v2:172.21.15.31:6800/168281188 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19cc051070 con 0x7f19c8027020 2024-09-22T08:37:47.590 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.580+0000 7f19d5963640 1 -- 172.21.15.142:0/4247517988 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fb5a698560 con 0x7f19d0021020 2024-09-22T08:37:47.590 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.580+0000 7f19d6164640 1 -- 172.21.15.142:0/4247517988 <== osd.2 v2:172.21.15.142:6808/279438927 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19c801b070 con 0x7f19d0021020 2024-09-22T08:37:47.590 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.580+0000 7f19d6164640 1 -- 172.21.15.142:0/4247517988 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fb5a698560 con 0x55fb5a694230 2024-09-22T08:37:47.590 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.581+0000 7f19d6965640 1 -- 172.21.15.142:0/4247517988 <== osd.3 v2:172.21.15.142:6800/1064901393 3 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19d00083e0 con 0x55fb5a694230 2024-09-22T08:37:47.591 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.581+0000 7f19d6965640 1 -- 172.21.15.142:0/4247517988 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fb5a698560 con 0x55fb5a68f820 2024-09-22T08:37:47.591 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.581+0000 7f19d5963640 1 -- 172.21.15.142:0/4247517988 <== osd.1 v2:172.21.15.142:6816/3192108003 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19cc051070 con 0x55fb5a68f820 2024-09-22T08:37:47.591 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.581+0000 7f19d5963640 1 -- 172.21.15.142:0/4247517988 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fb5a698560 con 0x7f19c8027020 2024-09-22T08:37:47.591 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.581+0000 7f19d5963640 1 -- 172.21.15.142:0/4247517988 <== osd.0 v2:172.21.15.31:6800/168281188 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19cc051070 con 0x7f19c8027020 2024-09-22T08:37:47.591 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.581+0000 7f19d5963640 1 -- 172.21.15.142:0/4247517988 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fb5a698560 con 0x55fb5a68f820 2024-09-22T08:37:47.591 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.581+0000 7f19d5963640 1 -- 172.21.15.142:0/4247517988 <== osd.1 v2:172.21.15.142:6816/3192108003 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19cc051070 con 0x55fb5a68f820 2024-09-22T08:37:47.591 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.581+0000 7f19d5963640 1 -- 172.21.15.142:0/4247517988 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fb5a698560 con 0x7f19d0021020 2024-09-22T08:37:47.591 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.582+0000 7f19d6164640 1 -- 172.21.15.142:0/4247517988 <== osd.2 v2:172.21.15.142:6808/279438927 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f19c801b070 con 0x7f19d0021020 2024-09-22T08:37:47.591 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.582+0000 7f19d6164640 1 -- 172.21.15.142:0/4247517988 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fb5a698560 con 0x55fb5a694230 2024-09-22T08:37:47.599 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.582+0000 7f19d6965640 1 -- 172.21.15.142:0/4247517988 <== osd.3 v2:172.21.15.142:6800/1064901393 4 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19d00083e0 con 0x55fb5a694230 2024-09-22T08:37:47.599 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.582+0000 7f19d6965640 1 -- 172.21.15.142:0/4247517988 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fb5a698560 con 0x55fb5a694230 2024-09-22T08:37:47.599 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.582+0000 7f19d6965640 1 -- 172.21.15.142:0/4247517988 <== osd.3 v2:172.21.15.142:6800/1064901393 5 ==== osd_op_reply(20 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f19d00083e0 con 0x55fb5a694230 2024-09-22T08:37:47.599 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.582+0000 7f19d6965640 1 -- 172.21.15.142:0/4247517988 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fb5a698560 con 0x7f19c8027020 2024-09-22T08:37:47.599 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.583+0000 7f19d5963640 1 -- 172.21.15.142:0/4247517988 <== osd.0 v2:172.21.15.31:6800/168281188 4 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19cc051070 con 0x7f19c8027020 2024-09-22T08:37:47.599 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.583+0000 7f19d5963640 1 -- 172.21.15.142:0/4247517988 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fb5a698560 con 0x55fb5a694230 2024-09-22T08:37:47.599 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.583+0000 7f19d6965640 1 -- 172.21.15.142:0/4247517988 <== osd.3 v2:172.21.15.142:6800/1064901393 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19d00083e0 con 0x55fb5a694230 2024-09-22T08:37:47.599 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.583+0000 7f19d6965640 1 -- 172.21.15.142:0/4247517988 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fb5a698560 con 0x55fb5a694230 2024-09-22T08:37:47.600 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.583+0000 7f19d6965640 1 -- 172.21.15.142:0/4247517988 <== osd.3 v2:172.21.15.142:6800/1064901393 7 ==== osd_op_reply(23 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f19d00083e0 con 0x55fb5a694230 2024-09-22T08:37:47.600 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.583+0000 7f19d6965640 1 -- 172.21.15.142:0/4247517988 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fb5a698560 con 0x55fb5a68f820 2024-09-22T08:37:47.600 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.583+0000 7f19d5963640 1 -- 172.21.15.142:0/4247517988 <== osd.1 v2:172.21.15.142:6816/3192108003 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19cc051070 con 0x55fb5a68f820 2024-09-22T08:37:47.600 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.583+0000 7f19d5963640 1 -- 172.21.15.142:0/4247517988 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fb5a698560 con 0x55fb5a68f820 2024-09-22T08:37:47.600 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.584+0000 7f19d5963640 1 -- 172.21.15.142:0/4247517988 <== osd.1 v2:172.21.15.142:6816/3192108003 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f19cc051070 con 0x55fb5a68f820 2024-09-22T08:37:47.600 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.584+0000 7f19d5963640 1 -- 172.21.15.142:0/4247517988 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fb5a698560 con 0x7f19c8027020 2024-09-22T08:37:47.600 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.584+0000 7f19d5963640 1 -- 172.21.15.142:0/4247517988 <== osd.0 v2:172.21.15.31:6800/168281188 5 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19cc051070 con 0x7f19c8027020 2024-09-22T08:37:47.600 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.584+0000 7f19d5963640 1 -- 172.21.15.142:0/4247517988 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fb5a698560 con 0x55fb5a694230 2024-09-22T08:37:47.600 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.584+0000 7f19d6965640 1 -- 172.21.15.142:0/4247517988 <== osd.3 v2:172.21.15.142:6800/1064901393 8 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19d00083e0 con 0x55fb5a694230 2024-09-22T08:37:47.600 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.584+0000 7f19d6965640 1 -- 172.21.15.142:0/4247517988 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fb5a698560 con 0x7f19d0021020 2024-09-22T08:37:47.600 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.585+0000 7f19d6164640 1 -- 172.21.15.142:0/4247517988 <== osd.2 v2:172.21.15.142:6808/279438927 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19c801b070 con 0x7f19d0021020 2024-09-22T08:37:47.600 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.585+0000 7f19d6164640 1 -- 172.21.15.142:0/4247517988 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fb5a698560 con 0x55fb5a68f820 2024-09-22T08:37:47.600 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.585+0000 7f19d5963640 1 -- 172.21.15.142:0/4247517988 <== osd.1 v2:172.21.15.142:6816/3192108003 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19cc051070 con 0x55fb5a68f820 2024-09-22T08:37:47.600 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.585+0000 7f19d5963640 1 -- 172.21.15.142:0/4247517988 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fb5a698560 con 0x7f19c8027020 2024-09-22T08:37:47.601 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.585+0000 7f19d5963640 1 -- 172.21.15.142:0/4247517988 <== osd.0 v2:172.21.15.31:6800/168281188 6 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19cc051070 con 0x7f19c8027020 2024-09-22T08:37:47.601 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.585+0000 7f19d5963640 1 -- 172.21.15.142:0/4247517988 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fb5a698560 con 0x55fb5a694230 2024-09-22T08:37:47.601 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.585+0000 7f19d6965640 1 -- 172.21.15.142:0/4247517988 <== osd.3 v2:172.21.15.142:6800/1064901393 9 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19d00083e0 con 0x55fb5a694230 2024-09-22T08:37:47.601 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.585+0000 7f19d6965640 1 -- 172.21.15.142:0/4247517988 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fb5a698560 con 0x7f19c8027020 2024-09-22T08:37:47.601 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.586+0000 7f19d5963640 1 -- 172.21.15.142:0/4247517988 <== osd.0 v2:172.21.15.31:6800/168281188 7 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19cc051070 con 0x7f19c8027020 2024-09-22T08:37:47.601 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.586+0000 7f19d5963640 1 -- 172.21.15.142:0/4247517988 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fb5a698560 con 0x7f19d0021020 2024-09-22T08:37:47.601 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.586+0000 7f19d6164640 1 -- 172.21.15.142:0/4247517988 <== osd.2 v2:172.21.15.142:6808/279438927 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19c801b070 con 0x7f19d0021020 2024-09-22T08:37:47.601 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.586+0000 7f19d6164640 1 -- 172.21.15.142:0/4247517988 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fb5a698560 con 0x55fb5a694230 2024-09-22T08:37:47.601 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.586+0000 7f19d6965640 1 -- 172.21.15.142:0/4247517988 <== osd.3 v2:172.21.15.142:6800/1064901393 10 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19d00083e0 con 0x55fb5a694230 2024-09-22T08:37:47.601 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.586+0000 7f19d6965640 1 -- 172.21.15.142:0/4247517988 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fb5a698560 con 0x7f19c8027020 2024-09-22T08:37:47.601 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.587+0000 7f19d5963640 1 -- 172.21.15.142:0/4247517988 <== osd.0 v2:172.21.15.31:6800/168281188 8 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19cc051070 con 0x7f19c8027020 2024-09-22T08:37:47.601 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.587+0000 7f19d5963640 1 -- 172.21.15.142:0/4247517988 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fb5a698560 con 0x55fb5a68f820 2024-09-22T08:37:47.602 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.587+0000 7f19d5963640 1 -- 172.21.15.142:0/4247517988 <== osd.1 v2:172.21.15.142:6816/3192108003 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f19cc051070 con 0x55fb5a68f820 2024-09-22T08:37:47.602 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.587+0000 7f19d5963640 1 -- 172.21.15.142:0/4247517988 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fb5a698560 con 0x7f19d0021020 2024-09-22T08:37:47.602 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.587+0000 7f19d6164640 1 -- 172.21.15.142:0/4247517988 <== osd.2 v2:172.21.15.142:6808/279438927 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19c801b070 con 0x7f19d0021020 2024-09-22T08:37:47.602 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.587+0000 7f19da52e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:37:47.602 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.587+0000 7f19da52e800 20 RGWRados::pool_iterate: got zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec 2024-09-22T08:37:47.602 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.587+0000 7f19da52e800 20 RGWRados::pool_iterate: got zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f 2024-09-22T08:37:47.602 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.587+0000 7f19da52e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:37:47.602 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.587+0000 7f19da52e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:37:47.603 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.587+0000 7f19da52e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:37:47.603 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.587+0000 7f19da52e800 20 rados->read ofs=0 len=0 2024-09-22T08:37:47.603 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.587+0000 7f19da52e800 1 -- 172.21.15.142:0/4247517988 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fb5a6975f0 con 0x55fb5a68f820 2024-09-22T08:37:47.603 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.587+0000 7f19d5963640 1 -- 172.21.15.142:0/4247517988 <== osd.1 v2:172.21.15.142:6816/3192108003 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f19cc051070 con 0x55fb5a68f820 2024-09-22T08:37:47.603 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.587+0000 7f19da52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:47.603 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.587+0000 7f19da52e800 20 rados->read ofs=0 len=0 2024-09-22T08:37:47.603 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.588+0000 7f19da52e800 1 -- 172.21.15.142:0/4247517988 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fb5a697e40 con 0x55fb5a68f820 2024-09-22T08:37:47.603 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.588+0000 7f19d5963640 1 -- 172.21.15.142:0/4247517988 <== osd.1 v2:172.21.15.142:6816/3192108003 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f19cc051070 con 0x55fb5a68f820 2024-09-22T08:37:47.603 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.588+0000 7f19da52e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:37:47.603 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.588+0000 7f19da52e800 20 rados->read ofs=0 len=0 2024-09-22T08:37:47.603 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.588+0000 7f19da52e800 1 -- 172.21.15.142:0/4247517988 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:40 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fb5a6989e0 con 0x55fb5a694230 2024-09-22T08:37:47.604 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.588+0000 7f19d6965640 1 -- 172.21.15.142:0/4247517988 <== osd.3 v2:172.21.15.142:6800/1064901393 11 ==== osd_op_reply(40 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f19d00083e0 con 0x55fb5a694230 2024-09-22T08:37:47.604 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.588+0000 7f19da52e800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:37:47.604 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.588+0000 7f19da52e800 20 zone default found 2024-09-22T08:37:47.604 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.588+0000 7f19da52e800 4 Realm: () 2024-09-22T08:37:47.604 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.588+0000 7f19da52e800 4 ZoneGroup: default (d89f6f57-1007-47dd-9065-f486c7b01aec) 2024-09-22T08:37:47.604 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.588+0000 7f19da52e800 4 Zone: default (e239248c-0bee-4e41-803a-24b288d3eb8f) 2024-09-22T08:37:47.604 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.588+0000 7f19da52e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:37:47.604 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.588+0000 7f19da52e800 20 zonegroup default 2024-09-22T08:37:47.604 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.588+0000 7f19da52e800 20 rados->read ofs=0 len=0 2024-09-22T08:37:47.604 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.588+0000 7f19da52e800 1 -- 172.21.15.142:0/4247517988 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fb5a698da0 con 0x7f19c8027020 2024-09-22T08:37:47.604 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.588+0000 7f19d5963640 1 -- 172.21.15.142:0/4247517988 <== osd.0 v2:172.21.15.31:6800/168281188 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f19cc051070 con 0x7f19c8027020 2024-09-22T08:37:47.604 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.588+0000 7f19da52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:47.604 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.588+0000 7f19da52e800 20 rados->read ofs=0 len=0 2024-09-22T08:37:47.604 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.588+0000 7f19da52e800 1 -- 172.21.15.142:0/4247517988 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fb5a69b080 con 0x55fb5a694230 2024-09-22T08:37:47.604 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.589+0000 7f19d6965640 1 -- 172.21.15.142:0/4247517988 <== osd.3 v2:172.21.15.142:6800/1064901393 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f19d00083e0 con 0x55fb5a694230 2024-09-22T08:37:47.605 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.589+0000 7f19da52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:47.605 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.589+0000 7f19da52e800 20 rados->read ofs=0 len=0 2024-09-22T08:37:47.605 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.589+0000 7f19da52e800 1 -- 172.21.15.142:0/4247517988 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fb5a69b450 con 0x55fb5a694230 2024-09-22T08:37:47.605 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.589+0000 7f19d6965640 1 -- 172.21.15.142:0/4247517988 <== osd.3 v2:172.21.15.142:6800/1064901393 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f19d00083e0 con 0x55fb5a694230 2024-09-22T08:37:47.605 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.589+0000 7f19da52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:47.605 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.589+0000 7f19da52e800 20 started sync module instance, tier type = 2024-09-22T08:37:47.605 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.589+0000 7f19da52e800 20 started zone id=e239248c-0bee-4e41-803a-24b288d3eb8f (name=default) with tier type = 2024-09-22T08:37:47.605 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.589+0000 7f19da52e800 1 -- 172.21.15.142:0/4247517988 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fb5a69a4c0 con 0x7f19d0021020 2024-09-22T08:37:47.605 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.590+0000 7f19d6164640 1 -- 172.21.15.142:0/4247517988 <== osd.2 v2:172.21.15.142:6808/279438927 7 ==== osd_op_reply(44 notify.0 [create] v32'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19c801b070 con 0x7f19d0021020 2024-09-22T08:37:47.605 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.590+0000 7f19da52e800 1 -- 172.21.15.142:0/4247517988 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94538042023952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fb5a69b8b0 con 0x7f19d0021020 2024-09-22T08:37:47.605 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.590+0000 7f19da52e800 1 -- 172.21.15.142:0/4247517988 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fb5a69c100 con 0x55fb5a68f820 2024-09-22T08:37:47.605 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.591+0000 7f19d6164640 1 -- 172.21.15.142:0/4247517988 <== osd.2 v2:172.21.15.142:6808/279438927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94538042023952] v32'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19c801b070 con 0x7f19d0021020 2024-09-22T08:37:47.605 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.592+0000 7f19d5963640 1 -- 172.21.15.142:0/4247517988 <== osd.1 v2:172.21.15.142:6816/3192108003 16 ==== osd_op_reply(46 notify.1 [create] v32'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19cc051070 con 0x55fb5a68f820 2024-09-22T08:37:47.605 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.592+0000 7f19da52e800 1 -- 172.21.15.142:0/4247517988 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94538042031184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fb5a69c520 con 0x55fb5a68f820 2024-09-22T08:37:47.606 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.592+0000 7f19da52e800 1 -- 172.21.15.142:0/4247517988 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fb5a69cd70 con 0x55fb5a694230 2024-09-22T08:37:47.606 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.593+0000 7f19d5963640 1 -- 172.21.15.142:0/4247517988 <== osd.1 v2:172.21.15.142:6816/3192108003 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94538042031184] v32'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19cc051070 con 0x55fb5a68f820 2024-09-22T08:37:47.606 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.594+0000 7f19d6965640 1 -- 172.21.15.142:0/4247517988 <== osd.3 v2:172.21.15.142:6800/1064901393 14 ==== osd_op_reply(48 notify.2 [create] v32'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19d00083e0 con 0x55fb5a694230 2024-09-22T08:37:47.606 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.594+0000 7f19da52e800 1 -- 172.21.15.142:0/4247517988 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94538042032720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fb5a69cc40 con 0x55fb5a694230 2024-09-22T08:37:47.606 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.594+0000 7f19da52e800 1 -- 172.21.15.142:0/4247517988 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fb5a69d760 con 0x7f19d0021020 2024-09-22T08:37:47.606 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.595+0000 7f19d6164640 1 -- 172.21.15.142:0/4247517988 <== osd.2 v2:172.21.15.142:6808/279438927 9 ==== osd_op_reply(50 notify.3 [create] v32'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19c801b070 con 0x7f19d0021020 2024-09-22T08:37:47.606 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.595+0000 7f19da52e800 1 -- 172.21.15.142:0/4247517988 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94538042036784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fb5a69e000 con 0x7f19d0021020 2024-09-22T08:37:47.606 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.595+0000 7f19da52e800 1 -- 172.21.15.142:0/4247517988 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fb5a69eb20 con 0x55fb5a68f820 2024-09-22T08:37:47.606 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.595+0000 7f19d6965640 1 -- 172.21.15.142:0/4247517988 <== osd.3 v2:172.21.15.142:6800/1064901393 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94538042032720] v32'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19d00083e0 con 0x55fb5a694230 2024-09-22T08:37:47.606 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.596+0000 7f19d6164640 1 -- 172.21.15.142:0/4247517988 <== osd.2 v2:172.21.15.142:6808/279438927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94538042036784] v32'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19c801b070 con 0x7f19d0021020 2024-09-22T08:37:47.606 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.596+0000 7f19d5963640 1 -- 172.21.15.142:0/4247517988 <== osd.1 v2:172.21.15.142:6816/3192108003 18 ==== osd_op_reply(52 notify.4 [create] v32'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19cc051070 con 0x55fb5a68f820 2024-09-22T08:37:47.606 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.596+0000 7f19da52e800 1 -- 172.21.15.142:0/4247517988 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94538042041840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fb5a69db50 con 0x55fb5a68f820 2024-09-22T08:37:47.606 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.596+0000 7f19da52e800 1 -- 172.21.15.142:0/4247517988 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fb5a69f3c0 con 0x7f19c8027020 2024-09-22T08:37:47.606 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.597+0000 7f19d5963640 1 -- 172.21.15.142:0/4247517988 <== osd.1 v2:172.21.15.142:6816/3192108003 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94538042041840] v32'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19cc051070 con 0x55fb5a68f820 2024-09-22T08:37:47.607 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.597+0000 7f19d5963640 1 -- 172.21.15.142:0/4247517988 <== osd.0 v2:172.21.15.31:6800/168281188 10 ==== osd_op_reply(54 notify.5 [create] v32'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19cc051070 con 0x7f19c8027020 2024-09-22T08:37:47.607 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.597+0000 7f19da52e800 1 -- 172.21.15.142:0/4247517988 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94538042033840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fb5a69db50 con 0x7f19c8027020 2024-09-22T08:37:47.607 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.597+0000 7f19da52e800 1 -- 172.21.15.142:0/4247517988 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fb5a69fa90 con 0x7f19c8027020 2024-09-22T08:37:47.611 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.598+0000 7f19d5963640 1 -- 172.21.15.142:0/4247517988 <== osd.0 v2:172.21.15.31:6800/168281188 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94538042033840] v32'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19cc051070 con 0x7f19c8027020 2024-09-22T08:37:47.612 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.598+0000 7f19d5963640 1 -- 172.21.15.142:0/4247517988 <== osd.0 v2:172.21.15.31:6800/168281188 12 ==== osd_op_reply(56 notify.6 [create] v32'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19cc051070 con 0x7f19c8027020 2024-09-22T08:37:47.612 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.599+0000 7f19da52e800 1 -- 172.21.15.142:0/4247517988 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94538042045792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fb5a69fa50 con 0x7f19c8027020 2024-09-22T08:37:47.612 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.599+0000 7f19da52e800 1 -- 172.21.15.142:0/4247517988 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fb5a6a0450 con 0x7f19c8027020 2024-09-22T08:37:47.612 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.600+0000 7f19d5963640 1 -- 172.21.15.142:0/4247517988 <== osd.0 v2:172.21.15.31:6800/168281188 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94538042045792] v32'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19cc051070 con 0x7f19c8027020 2024-09-22T08:37:47.612 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.600+0000 7f19d5963640 1 -- 172.21.15.142:0/4247517988 <== osd.0 v2:172.21.15.31:6800/168281188 14 ==== osd_op_reply(58 notify.7 [create] v32'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19cc051070 con 0x7f19c8027020 2024-09-22T08:37:47.612 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.600+0000 7f19da52e800 1 -- 172.21.15.142:0/4247517988 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94538042043968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fb5a6a0410 con 0x7f19c8027020 2024-09-22T08:37:47.612 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.600+0000 7f19da52e800 20 add_watcher() i=0 2024-09-22T08:37:47.612 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.600+0000 7f19da52e800 20 add_watcher() i=1 2024-09-22T08:37:47.612 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.600+0000 7f19da52e800 20 add_watcher() i=2 2024-09-22T08:37:47.612 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.600+0000 7f19da52e800 20 add_watcher() i=3 2024-09-22T08:37:47.612 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.600+0000 7f19da52e800 20 add_watcher() i=4 2024-09-22T08:37:47.613 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.600+0000 7f19da52e800 20 add_watcher() i=5 2024-09-22T08:37:47.613 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.600+0000 7f19da52e800 20 add_watcher() i=6 2024-09-22T08:37:47.613 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.601+0000 7f19d5963640 1 -- 172.21.15.142:0/4247517988 <== osd.0 v2:172.21.15.31:6800/168281188 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94538042043968] v32'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19cc051070 con 0x7f19c8027020 2024-09-22T08:37:47.613 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.601+0000 7f19da52e800 20 add_watcher() i=7 2024-09-22T08:37:47.613 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.601+0000 7f19da52e800 2 all 8 watchers are set, enabling cache 2024-09-22T08:37:47.613 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.601+0000 7f19da52e800 1 -- 172.21.15.142:0/4247517988 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fb5a6a3940 con 0x55fb5a68f820 2024-09-22T08:37:47.613 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.602+0000 7f19d5963640 1 -- 172.21.15.142:0/4247517988 <== osd.1 v2:172.21.15.142:6816/3192108003 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f19cc051070 con 0x55fb5a68f820 2024-09-22T08:37:47.613 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.602+0000 7f19da52e800 1 -- 172.21.15.142:0/4247517988 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94538042049280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fb5a6a0cc0 con 0x55fb5a68f820 2024-09-22T08:37:47.613 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.603+0000 7f19d5963640 1 -- 172.21.15.142:0/4247517988 <== osd.1 v2:172.21.15.142:6816/3192108003 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94538042049280] v32'214 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f19cc051070 con 0x55fb5a68f820 2024-09-22T08:37:47.614 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.603+0000 7f188cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:37:47.614 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.603+0000 7f19da52e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:37:47.614 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.603+0000 7f19da52e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:37:47.614 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.603+0000 7f19da52e800 5 note: GC not initialized 2024-09-22T08:37:47.614 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.603+0000 7f18077fe640 20 reqs_thread_entry: start 2024-09-22T08:37:47.614 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.603+0000 7f19da52e800 20 init_complete bucket index max shards: 11 2024-09-22T08:37:47.614 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.603+0000 7f19da52e800 20 Filter name: none 2024-09-22T08:37:47.614 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.603+0000 7f18057fa640 20 reqs_thread_entry: start 2024-09-22T08:37:47.614 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.603+0000 7f19da52e800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-22T08:37:47.614 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.603+0000 7f19da52e800 20 rados->read ofs=0 len=0 2024-09-22T08:37:47.614 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.603+0000 7f19da52e800 1 -- 172.21.15.142:0/4247517988 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fb5a6d6d30 con 0x7f19c8027020 2024-09-22T08:37:47.614 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.604+0000 7f19d5963640 1 -- 172.21.15.142:0/4247517988 <== osd.0 v2:172.21.15.31:6800/168281188 16 ==== osd_op_reply(62 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f19cc051070 con 0x7f19c8027020 2024-09-22T08:37:47.614 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.604+0000 7f19da52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:47.615 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.604+0000 7f19da52e800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-09-22T08:37:47.615 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.604+0000 7f19da52e800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-22T08:37:47.615 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.604+0000 7f19da52e800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-09-22T08:37:47.615 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.604+0000 7f19da52e800 20 rados->read ofs=0 len=0 2024-09-22T08:37:47.615 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.604+0000 7f19da52e800 1 -- 172.21.15.142:0/4247517988 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fb5a6d5270 con 0x7f19c8027020 2024-09-22T08:37:47.615 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.604+0000 7f19d5963640 1 -- 172.21.15.142:0/4247517988 <== osd.0 v2:172.21.15.31:6800/168281188 17 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7f19cc051070 con 0x7f19c8027020 2024-09-22T08:37:47.615 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.604+0000 7f19da52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:47.615 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.604+0000 7f19da52e800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-09-22T08:37:47.615 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.604+0000 7f19da52e800 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-22T08:37:47.615 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.604+0000 7f19da52e800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-22T08:37:47.615 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.604+0000 7f19da52e800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-22T08:37:47.615 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.604+0000 7f19da52e800 1 -- 172.21.15.142:0/4247517988 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:64 8.e 8:75f48285:users.uid::fud:head [delete,create,call version.set in=58b,writefull 0~380 in=380b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fb5a6d5b10 con 0x7f19c8027020 2024-09-22T08:37:47.615 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.605+0000 7f19d5963640 1 -- 172.21.15.142:0/4247517988 <== osd.0 v2:172.21.15.31:6800/168281188 18 ==== osd_op_reply(64 fud [delete,create,call,writefull 0~380] v32'9 uv9 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7f19cc051070 con 0x7f19c8027020 2024-09-22T08:37:47.616 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.605+0000 7f19da52e800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-09-22T08:37:47.616 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.605+0000 7f19da52e800 10 moving default.rgw.meta+users.uid+fud to cache LRU end 2024-09-22T08:37:47.616 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.605+0000 7f19da52e800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-09-22T08:37:47.616 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.605+0000 7f19da52e800 1 -- 172.21.15.142:0/4247517988 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:65 7.3 7:c609908c:::notify.5:head [notify cookie 94538042267232 in=568b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fb5a6da7d0 con 0x7f19c8027020 2024-09-22T08:37:47.616 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.606+0000 7f19d5963640 1 -- 172.21.15.142:0/4247517988 <== osd.0 v2:172.21.15.31:6800/168281188 19 ==== watch-notify(notify (1) cookie 94538042033840 notify 137438953501 ret 0) ==== 598+0+0 (crc 0 0 0) 0x55fb5a6d5eb0 con 0x7f19c8027020 2024-09-22T08:37:47.616 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.606+0000 7f18b9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953501 cookie 94538042033840 notifier 4737 bl.length()=556 2024-09-22T08:37:47.616 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.606+0000 7f18b9ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-09-22T08:37:47.616 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.606+0000 7f18b9ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+fud to cache LRU end 2024-09-22T08:37:47.616 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.606+0000 7f18b9ffb640 1 -- 172.21.15.142:0/4247517988 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:66 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f189c003ea0 con 0x7f19c8027020 2024-09-22T08:37:47.616 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.606+0000 7f19d5963640 1 -- 172.21.15.142:0/4247517988 <== osd.0 v2:172.21.15.31:6800/168281188 20 ==== osd_op_reply(65 notify.5 [notify cookie 94538042267232 out=8b] v0'0 uv216 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f19cc051070 con 0x7f19c8027020 2024-09-22T08:37:47.616 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.606+0000 7f19d5963640 1 -- 172.21.15.142:0/4247517988 <== osd.0 v2:172.21.15.31:6800/168281188 21 ==== osd_op_reply(66 notify.5 [notify-ack] v0'0 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19cc051070 con 0x7f19c8027020 2024-09-22T08:37:47.616 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.606+0000 7f19d5963640 1 -- 172.21.15.142:0/4247517988 <== osd.0 v2:172.21.15.31:6800/168281188 22 ==== watch-notify(notify_complete (2) cookie 94538042267232 notify 137438953501 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55fb5a6d6680 con 0x7f19c8027020 2024-09-22T08:37:47.617 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.606+0000 7f19da52e800 1 -- 172.21.15.142:0/4247517988 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fb5a6d8300 con 0x7f19c8027020 2024-09-22T08:37:47.617 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.607+0000 7f19d5963640 1 -- 172.21.15.142:0/4247517988 <== osd.0 v2:172.21.15.31:6800/168281188 23 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~7] v32'9 uv9 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f19cc051070 con 0x7f19c8027020 2024-09-22T08:37:47.617 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.607+0000 7f19da52e800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-22T08:37:47.617 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.607+0000 7f19da52e800 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-22T08:37:47.617 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.607+0000 7f19da52e800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-22T08:37:47.617 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.607+0000 7f19da52e800 1 -- 172.21.15.142:0/4247517988 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94538042267152 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fb5a6da7d0 con 0x55fb5a694230 2024-09-22T08:37:47.617 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.608+0000 7f19d6965640 1 -- 172.21.15.142:0/4247517988 <== osd.3 v2:172.21.15.142:6800/1064901393 16 ==== watch-notify(notify (1) cookie 94538042032720 notify 137438953480 ret 0) ==== 219+0+0 (crc 0 0 0) 0x55fb5a6846f0 con 0x55fb5a694230 2024-09-22T08:37:47.617 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.608+0000 7f18b97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953480 cookie 94538042032720 notifier 4737 bl.length()=177 2024-09-22T08:37:47.617 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.608+0000 7f18b97fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-22T08:37:47.617 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.608+0000 7f18b97fa640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-22T08:37:47.617 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.608+0000 7f19d6965640 1 -- 172.21.15.142:0/4247517988 <== osd.3 v2:172.21.15.142:6800/1064901393 17 ==== osd_op_reply(68 notify.2 [notify cookie 94538042267152 out=8b] v0'0 uv216 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f19d00083e0 con 0x55fb5a694230 2024-09-22T08:37:47.617 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.608+0000 7f18b97fa640 1 -- 172.21.15.142:0/4247517988 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f180c003400 con 0x55fb5a694230 2024-09-22T08:37:47.617 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.608+0000 7f19d6965640 1 -- 172.21.15.142:0/4247517988 <== osd.3 v2:172.21.15.142:6800/1064901393 18 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19d00083e0 con 0x55fb5a694230 2024-09-22T08:37:47.618 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.608+0000 7f19d6965640 1 -- 172.21.15.142:0/4247517988 <== osd.3 v2:172.21.15.142:6800/1064901393 19 ==== watch-notify(notify_complete (2) cookie 94538042267152 notify 137438953480 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55fb5a684460 con 0x55fb5a694230 2024-09-22T08:37:47.618 INFO:teuthology.orchestra.run.smithi142.stdout:{"user_id":"fud","display_name":"Fud","email":"","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"fud","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-09-22T08:37:47.605595Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-22T08:37:47.605582Z","tags":[],"group_ids":[]} 2024-09-22T08:37:47.623 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.609+0000 7f188cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:37:47.623 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.609+0000 7f19da52e800 1 -- 172.21.15.142:0/4247517988 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94538042049280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fb5a6d49e0 con 0x55fb5a68f820 2024-09-22T08:37:47.623 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.610+0000 7f19d5963640 1 -- 172.21.15.142:0/4247517988 <== osd.1 v2:172.21.15.142:6816/3192108003 22 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94538042049280] v32'215 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f19cc051070 con 0x55fb5a68f820 2024-09-22T08:37:47.623 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.610+0000 7f19da52e800 1 -- 172.21.15.142:0/4247517988 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94538042023952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fb5a6d49e0 con 0x7f19d0021020 2024-09-22T08:37:47.624 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.611+0000 7f19d6164640 1 -- 172.21.15.142:0/4247517988 <== osd.2 v2:172.21.15.142:6808/279438927 11 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94538042023952] v32'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19c801b070 con 0x7f19d0021020 2024-09-22T08:37:47.624 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.611+0000 7f19da52e800 20 remove_watcher() i=0 2024-09-22T08:37:47.624 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.611+0000 7f19da52e800 2 removed watcher, disabling cache 2024-09-22T08:37:47.624 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.611+0000 7f19da52e800 1 -- 172.21.15.142:0/4247517988 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94538042031184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fb5a6d49e0 con 0x55fb5a68f820 2024-09-22T08:37:47.624 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.612+0000 7f19d5963640 1 -- 172.21.15.142:0/4247517988 <== osd.1 v2:172.21.15.142:6816/3192108003 23 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94538042031184] v32'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19cc051070 con 0x55fb5a68f820 2024-09-22T08:37:47.624 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.612+0000 7f19da52e800 20 remove_watcher() i=1 2024-09-22T08:37:47.624 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.612+0000 7f19da52e800 1 -- 172.21.15.142:0/4247517988 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94538042032720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fb5a6d49e0 con 0x55fb5a694230 2024-09-22T08:37:47.624 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.614+0000 7f19d6965640 1 -- 172.21.15.142:0/4247517988 <== osd.3 v2:172.21.15.142:6800/1064901393 20 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94538042032720] v32'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19d00083e0 con 0x55fb5a694230 2024-09-22T08:37:47.624 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.614+0000 7f19da52e800 20 remove_watcher() i=2 2024-09-22T08:37:47.624 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.614+0000 7f19da52e800 1 -- 172.21.15.142:0/4247517988 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94538042036784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fb5a6d49e0 con 0x7f19d0021020 2024-09-22T08:37:47.624 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.614+0000 7f19d6164640 1 -- 172.21.15.142:0/4247517988 <== osd.2 v2:172.21.15.142:6808/279438927 12 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94538042036784] v32'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19c801b070 con 0x7f19d0021020 2024-09-22T08:37:47.624 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.615+0000 7f19da52e800 20 remove_watcher() i=3 2024-09-22T08:37:47.624 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.615+0000 7f19da52e800 1 -- 172.21.15.142:0/4247517988 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94538042041840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fb5a6d49e0 con 0x55fb5a68f820 2024-09-22T08:37:47.624 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.616+0000 7f19d5963640 1 -- 172.21.15.142:0/4247517988 <== osd.1 v2:172.21.15.142:6816/3192108003 24 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94538042041840] v32'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19cc051070 con 0x55fb5a68f820 2024-09-22T08:37:47.625 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.616+0000 7f19da52e800 20 remove_watcher() i=4 2024-09-22T08:37:47.625 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.616+0000 7f19da52e800 1 -- 172.21.15.142:0/4247517988 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94538042033840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fb5a6d49e0 con 0x7f19c8027020 2024-09-22T08:37:47.625 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.617+0000 7f19d5963640 1 -- 172.21.15.142:0/4247517988 <== osd.0 v2:172.21.15.31:6800/168281188 24 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94538042033840] v32'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19cc051070 con 0x7f19c8027020 2024-09-22T08:37:47.625 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.617+0000 7f19da52e800 20 remove_watcher() i=5 2024-09-22T08:37:47.625 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.617+0000 7f19da52e800 1 -- 172.21.15.142:0/4247517988 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94538042045792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fb5a6d49e0 con 0x7f19c8027020 2024-09-22T08:37:47.625 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.618+0000 7f19d5963640 1 -- 172.21.15.142:0/4247517988 <== osd.0 v2:172.21.15.31:6800/168281188 25 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94538042045792] v32'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19cc051070 con 0x7f19c8027020 2024-09-22T08:37:47.625 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.618+0000 7f19da52e800 20 remove_watcher() i=6 2024-09-22T08:37:47.625 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.618+0000 7f19da52e800 1 -- 172.21.15.142:0/4247517988 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94538042043968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fb5a6d49e0 con 0x7f19c8027020 2024-09-22T08:37:47.625 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.619+0000 7f19d5963640 1 -- 172.21.15.142:0/4247517988 <== osd.0 v2:172.21.15.31:6800/168281188 26 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94538042043968] v32'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19cc051070 con 0x7f19c8027020 2024-09-22T08:37:47.625 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.619+0000 7f19da52e800 20 remove_watcher() i=7 2024-09-22T08:37:47.625 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.619+0000 7f19da52e800 1 -- 172.21.15.142:0/4247517988 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f19c8027020 msgr2=0x7f19c801e3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:47.625 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.619+0000 7f19da52e800 1 --2- 172.21.15.142:0/4247517988 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f19c8027020 0x7f19c801e3f0 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:47.625 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.619+0000 7f19da52e800 1 -- 172.21.15.142:0/4247517988 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55fb5a68f820 msgr2=0x55fb5a691ce0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:47.625 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.619+0000 7f19da52e800 1 --2- 172.21.15.142:0/4247517988 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55fb5a68f820 0x55fb5a691ce0 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:47.625 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.619+0000 7f19da52e800 1 -- 172.21.15.142:0/4247517988 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f19d0021020 msgr2=0x7f19d002a790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:47.626 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.619+0000 7f19da52e800 1 --2- 172.21.15.142:0/4247517988 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f19d0021020 0x7f19d002a790 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:47.626 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.619+0000 7f19da52e800 1 -- 172.21.15.142:0/4247517988 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55fb5a694230 msgr2=0x55fb5a696620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:47.626 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.619+0000 7f19da52e800 1 --2- 172.21.15.142:0/4247517988 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55fb5a694230 0x55fb5a696620 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:47.626 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.619+0000 7f19da52e800 1 -- 172.21.15.142:0/4247517988 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f18a003cf10 msgr2=0x7f18a003f3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:47.626 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.619+0000 7f19da52e800 1 --2- 172.21.15.142:0/4247517988 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f18a003cf10 0x7f18a003f3d0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f19c8052db0 tx=0x7f19c8046000 comp rx=0 tx=0).stop 2024-09-22T08:37:47.626 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.619+0000 7f19da52e800 1 -- 172.21.15.142:0/4247517988 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fb5a67c900 msgr2=0x55fb5a683f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:47.626 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.619+0000 7f19da52e800 1 --2- 172.21.15.142:0/4247517988 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fb5a67c900 0x55fb5a683f00 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f19d0008fd0 tx=0x7f19d0053d50 comp rx=0 tx=0).stop 2024-09-22T08:37:47.626 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.619+0000 7f19d5963640 1 -- 172.21.15.142:0/4247517988 reap_dead start 2024-09-22T08:37:47.626 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.619+0000 7f19d5963640 1 -- 172.21.15.142:0/4247517988 reap_dead start 2024-09-22T08:37:47.626 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.619+0000 7f19da52e800 1 -- 172.21.15.142:0/4247517988 shutdown_connections 2024-09-22T08:37:47.626 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.619+0000 7f19da52e800 1 -- 172.21.15.142:0/4247517988 >> 172.21.15.142:0/4247517988 conn(0x55fb5a678d00 msgr2=0x55fb5a676f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:37:47.626 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.620+0000 7f19da52e800 1 -- 172.21.15.142:0/4247517988 shutdown_connections 2024-09-22T08:37:47.626 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.620+0000 7f19da52e800 1 -- 172.21.15.142:0/4247517988 wait complete. 2024-09-22T08:37:47.627 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.620+0000 7f19da52e800 1 -- 172.21.15.142:0/609975436 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f18b003cfb0 msgr2=0x7f18b003f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:47.627 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.620+0000 7f19da52e800 1 --2- 172.21.15.142:0/609975436 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f18b003cfb0 0x7f18b003f470 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f19c8052b50 tx=0x7f19c8011f40 comp rx=0 tx=0).stop 2024-09-22T08:37:47.627 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.620+0000 7f19da52e800 1 -- 172.21.15.142:0/609975436 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fb5a66fea0 msgr2=0x55fb5a6702c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:47.627 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.620+0000 7f19da52e800 1 --2- 172.21.15.142:0/609975436 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fb5a66fea0 0x55fb5a6702c0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x55fb5a655e60 tx=0x7f19d000bf30 comp rx=0 tx=0).stop 2024-09-22T08:37:47.627 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.620+0000 7f19da52e800 1 -- 172.21.15.142:0/609975436 shutdown_connections 2024-09-22T08:37:47.627 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.620+0000 7f19da52e800 1 --2- 172.21.15.142:0/609975436 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f18b003cfb0 0x7f18b003f470 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:47.627 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.620+0000 7f19da52e800 1 --2- 172.21.15.142:0/609975436 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fb5a66fea0 0x55fb5a6702c0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:47.627 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.620+0000 7f19da52e800 1 -- 172.21.15.142:0/609975436 >> 172.21.15.142:0/609975436 conn(0x55fb5a664250 msgr2=0x55fb5a664630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:37:47.627 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.620+0000 7f19da52e800 1 -- 172.21.15.142:0/609975436 shutdown_connections 2024-09-22T08:37:47.627 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.620+0000 7f19da52e800 1 -- 172.21.15.142:0/609975436 wait complete. 2024-09-22T08:37:47.627 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.620+0000 7f19da52e800 1 -- 172.21.15.142:0/4138034035 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55fb5a55bc30 msgr2=0x55fb5a65c4b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:47.627 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.620+0000 7f19da52e800 1 --2- 172.21.15.142:0/4138034035 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55fb5a55bc30 0x55fb5a65c4b0 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:47.627 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.620+0000 7f19da52e800 1 -- 172.21.15.142:0/4138034035 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55fb5a65e890 msgr2=0x55fb5a660d10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:47.627 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.620+0000 7f19da52e800 1 --2- 172.21.15.142:0/4138034035 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55fb5a65e890 0x55fb5a660d10 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:47.628 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.620+0000 7f19da52e800 1 -- 172.21.15.142:0/4138034035 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f18bc03cfb0 msgr2=0x7f18bc03f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:47.628 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.620+0000 7f19da52e800 1 --2- 172.21.15.142:0/4138034035 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f18bc03cfb0 0x7f18bc03f470 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f19cc057000 tx=0x7f19cc052000 comp rx=0 tx=0).stop 2024-09-22T08:37:47.628 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.620+0000 7f19da52e800 1 -- 172.21.15.142:0/4138034035 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fb5a55a820 msgr2=0x55fb5a654e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:47.628 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.620+0000 7f19da52e800 1 --2- 172.21.15.142:0/4138034035 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fb5a55a820 0x55fb5a654e60 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f19c8000f80 tx=0x7f19c8001250 comp rx=0 tx=0).stop 2024-09-22T08:37:47.628 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.620+0000 7f19da52e800 1 -- 172.21.15.142:0/4138034035 shutdown_connections 2024-09-22T08:37:47.628 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.620+0000 7f19da52e800 1 --2- 172.21.15.142:0/4138034035 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55fb5a65e890 0x55fb5a660d10 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:47.628 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.620+0000 7f19da52e800 1 --2- 172.21.15.142:0/4138034035 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55fb5a55bc30 0x55fb5a65c4b0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:47.628 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.620+0000 7f19da52e800 1 --2- 172.21.15.142:0/4138034035 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f18bc03cfb0 0x7f18bc03f470 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:47.628 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.620+0000 7f19da52e800 1 --2- 172.21.15.142:0/4138034035 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fb5a55a820 0x55fb5a654e60 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:47.628 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.620+0000 7f19da52e800 1 -- 172.21.15.142:0/4138034035 >> 172.21.15.142:0/4138034035 conn(0x55fb5a555bf0 msgr2=0x55fb5a644170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:37:47.628 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.621+0000 7f19da52e800 1 -- 172.21.15.142:0/4138034035 shutdown_connections 2024-09-22T08:37:47.629 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.621+0000 7f19da52e800 1 -- 172.21.15.142:0/4138034035 wait complete. 2024-09-22T08:37:47.630 DEBUG:tasks.util.rgw: json result: {'user_id': 'fud', 'display_name': 'Fud', 'email': '', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'fud', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-09-22T08:37:47.605595Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-22T08:37:47.605582Z', 'tags': [], 'group_ids': []} 2024-09-22T08:37:47.642 INFO:tasks.radosgw_admin:RL: create_bucket myfoo7 fud bytes_out=0 bytes_in=0 failed=False 2024-09-22T08:37:47.647 INFO:tasks.radosgw_admin:RL: put_obj myfoo7 fud bytes_out=8 bytes_in=0 failed=False 2024-09-22T08:37:47.647 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rename', '--uid', 'bud', '--new-uid', 'fud'] 2024-09-22T08:37:47.647 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rename', '--uid', 'bud', '--new-uid', 'fud'] 2024-09-22T08:37:47.648 DEBUG:teuthology.orchestra.run.smithi142:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rename --uid bud --new-uid fud 2024-09-22T08:37:47.693 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:37:47.694 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:37:47.695 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.693+0000 7f83c9e14800 1 Processor -- start 2024-09-22T08:37:47.695 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.693+0000 7f83c9e14800 1 -- start start 2024-09-22T08:37:47.695 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.693+0000 7f83c9e14800 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55a1662699e0 0x55a16626a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:47.695 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.693+0000 7f83c9e14800 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55a1660f4a20 con 0x55a16626aae0 2024-09-22T08:37:47.695 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.693+0000 7f83c9e14800 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x55a1660f47d0 con 0x55a1662699e0 2024-09-22T08:37:47.695 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.694+0000 7f83c55e0640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55a1662699e0 0x55a16626a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:47.695 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.694+0000 7f83c55e0640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55a1662699e0 0x55a16626a5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:56038/0 (socket says 172.21.15.142:56038) 2024-09-22T08:37:47.696 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.694+0000 7f83c55e0640 1 -- 172.21.15.142:0/508856998 learned_addr learned my addr 172.21.15.142:0/508856998 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:37:47.696 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.694+0000 7f83c55e0640 1 -- 172.21.15.142:0/508856998 >> v1:172.21.15.31:6789/0 conn(0x55a16626aae0 legacy=0x55a16626f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:47.696 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.694+0000 7f83c55e0640 1 -- 172.21.15.142:0/508856998 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a16626a0e0 con 0x55a1662699e0 2024-09-22T08:37:47.697 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.696+0000 7f83c55e0640 1 --2- 172.21.15.142:0/508856998 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a1662699e0 0x55a16626a5a0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f83b800a520 tx=0x7f83b8045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=783d35da1443ae3 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:47.697 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.696+0000 7f83b7fff640 1 -- 172.21.15.142:0/508856998 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83b8055070 con 0x55a1662699e0 2024-09-22T08:37:47.697 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.696+0000 7f83b7fff640 1 -- 172.21.15.142:0/508856998 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83b80515b0 con 0x55a1662699e0 2024-09-22T08:37:47.697 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.696+0000 7f83b7fff640 1 -- 172.21.15.142:0/508856998 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83b80518d0 con 0x55a1662699e0 2024-09-22T08:37:47.698 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.696+0000 7f83c9e14800 1 -- 172.21.15.142:0/508856998 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a1662699e0 msgr2=0x55a16626a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:47.698 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.696+0000 7f83c9e14800 1 --2- 172.21.15.142:0/508856998 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a1662699e0 0x55a16626a5a0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f83b800a520 tx=0x7f83b8045ba0 comp rx=0 tx=0).stop 2024-09-22T08:37:47.698 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.696+0000 7f83c9e14800 1 -- 172.21.15.142:0/508856998 shutdown_connections 2024-09-22T08:37:47.698 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.696+0000 7f83c9e14800 1 --2- 172.21.15.142:0/508856998 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a1662699e0 0x55a16626a5a0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:47.698 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.696+0000 7f83c9e14800 1 -- 172.21.15.142:0/508856998 >> 172.21.15.142:0/508856998 conn(0x55a166264db0 msgr2=0x55a166267210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:37:47.698 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.696+0000 7f83c9e14800 1 -- 172.21.15.142:0/508856998 shutdown_connections 2024-09-22T08:37:47.698 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.696+0000 7f83c9e14800 1 -- 172.21.15.142:0/508856998 wait complete. 2024-09-22T08:37:47.711 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.710+0000 7f83c9e14800 1 Processor -- start 2024-09-22T08:37:47.711 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.710+0000 7f83c9e14800 1 -- start start 2024-09-22T08:37:47.712 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.710+0000 7f83c9e14800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a1662699e0 0x55a166358fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:47.712 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.710+0000 7f83c9e14800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55a166101dd0 con 0x55a1662699e0 2024-09-22T08:37:47.713 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.711+0000 7f83c55e0640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a1662699e0 0x55a166358fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:47.713 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.711+0000 7f83c55e0640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a1662699e0 0x55a166358fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:56050/0 (socket says 172.21.15.142:56050) 2024-09-22T08:37:47.713 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.711+0000 7f83c55e0640 1 -- 172.21.15.142:0/792280073 learned_addr learned my addr 172.21.15.142:0/792280073 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:37:47.713 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.711+0000 7f83c55e0640 1 -- 172.21.15.142:0/792280073 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a166359590 con 0x55a1662699e0 2024-09-22T08:37:47.713 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.711+0000 7f83c55e0640 1 --2- 172.21.15.142:0/792280073 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a1662699e0 0x55a166358fa0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f83b80460d0 tx=0x7f83b8051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36a09b53f9eb279 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:47.713 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.711+0000 7f82b3606640 1 -- 172.21.15.142:0/792280073 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83b80519d0 con 0x55a1662699e0 2024-09-22T08:37:47.713 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.711+0000 7f82b3606640 1 -- 172.21.15.142:0/792280073 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83b8051b70 con 0x55a1662699e0 2024-09-22T08:37:47.713 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.711+0000 7f82b3606640 1 -- 172.21.15.142:0/792280073 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83b8051e50 con 0x55a1662699e0 2024-09-22T08:37:47.715 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.712+0000 7f83c9e14800 1 -- 172.21.15.142:0/792280073 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a1662699e0 msgr2=0x55a166358fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:47.715 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.712+0000 7f83c9e14800 1 --2- 172.21.15.142:0/792280073 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a1662699e0 0x55a166358fa0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f83b80460d0 tx=0x7f83b8051000 comp rx=0 tx=0).stop 2024-09-22T08:37:47.715 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.712+0000 7f83c9e14800 1 -- 172.21.15.142:0/792280073 shutdown_connections 2024-09-22T08:37:47.715 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.712+0000 7f83c9e14800 1 --2- 172.21.15.142:0/792280073 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a1662699e0 0x55a166358fa0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:47.715 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.712+0000 7f83c9e14800 1 -- 172.21.15.142:0/792280073 >> 172.21.15.142:0/792280073 conn(0x55a166264db0 msgr2=0x55a166354920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:37:47.715 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.712+0000 7f83c9e14800 1 -- 172.21.15.142:0/792280073 shutdown_connections 2024-09-22T08:37:47.715 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.712+0000 7f83c9e14800 1 -- 172.21.15.142:0/792280073 wait complete. 2024-09-22T08:37:47.716 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.712+0000 7f83c9e14800 1 Processor -- start 2024-09-22T08:37:47.716 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.712+0000 7f83c9e14800 1 -- start start 2024-09-22T08:37:47.716 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.713+0000 7f83c9e14800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a1662699e0 0x55a1661df260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:47.716 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.713+0000 7f83c9e14800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55a16626b350 con 0x55a1662699e0 2024-09-22T08:37:47.716 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.713+0000 7f83c55e0640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a1662699e0 0x55a1661df260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:47.716 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.713+0000 7f83c55e0640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a1662699e0 0x55a1661df260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:56054/0 (socket says 172.21.15.142:56054) 2024-09-22T08:37:47.716 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.713+0000 7f83c55e0640 1 -- 172.21.15.142:0/182719882 learned_addr learned my addr 172.21.15.142:0/182719882 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:37:47.716 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.713+0000 7f83c55e0640 1 -- 172.21.15.142:0/182719882 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a1661df7c0 con 0x55a1662699e0 2024-09-22T08:37:47.717 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.713+0000 7f83c55e0640 1 --2- 172.21.15.142:0/182719882 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a1662699e0 0x55a1661df260 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f83b80460d0 tx=0x7f83b8002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:47.717 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.714+0000 7f82b1e03640 1 -- 172.21.15.142:0/182719882 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83b8073020 con 0x55a1662699e0 2024-09-22T08:37:47.717 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.714+0000 7f82b1e03640 1 -- 172.21.15.142:0/182719882 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83b806f580 con 0x55a1662699e0 2024-09-22T08:37:47.717 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.714+0000 7f83c9e14800 1 -- 172.21.15.142:0/182719882 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a1661ddb70 con 0x55a1662699e0 2024-09-22T08:37:47.717 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.714+0000 7f82b1e03640 1 -- 172.21.15.142:0/182719882 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83b806f8a0 con 0x55a1662699e0 2024-09-22T08:37:47.717 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.714+0000 7f83c9e14800 1 -- 172.21.15.142:0/182719882 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a1661de190 con 0x55a1662699e0 2024-09-22T08:37:47.720 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.715+0000 7f82b1e03640 1 -- 172.21.15.142:0/182719882 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f83b8076020 con 0x55a1662699e0 2024-09-22T08:37:47.720 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.715+0000 7f82b1e03640 1 --2- 172.21.15.142:0/182719882 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f82ac03cfb0 0x7f82ac03f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:47.720 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.715+0000 7f82b1e03640 1 -- 172.21.15.142:0/182719882 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5938+0+0 (secure 0 0 0) 0x7f83b806b040 con 0x55a1662699e0 2024-09-22T08:37:47.721 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.715+0000 7f83c4ddf640 1 --2- 172.21.15.142:0/182719882 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f82ac03cfb0 0x7f82ac03f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:47.721 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.715+0000 7f83c9e14800 1 --2- 172.21.15.142:0/182719882 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55a16626aae0 0x55a166369dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:47.721 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.715+0000 7f83c9e14800 1 -- 172.21.15.142:0/182719882 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a16636a340 con 0x55a16626aae0 2024-09-22T08:37:47.721 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.715+0000 7f83c5de1640 1 --2- 172.21.15.142:0/182719882 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55a16626aae0 0x55a166369dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:47.721 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.715+0000 7f83c4ddf640 1 --2- 172.21.15.142:0/182719882 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f82ac03cfb0 0x7f82ac03f470 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f83bc001eb0 tx=0x7f83bc001430 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:47.721 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.715+0000 7f83c5de1640 1 --2- 172.21.15.142:0/182719882 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55a16626aae0 0x55a166369dc0 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:47.721 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.716+0000 7f83c5de1640 1 -- 172.21.15.142:0/182719882 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f83c000a4d0 con 0x55a16626aae0 2024-09-22T08:37:47.721 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.716+0000 7f83c9e14800 1 -- 172.21.15.142:0/182719882 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a16636ac00 con 0x55a16626aae0 2024-09-22T08:37:47.721 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.716+0000 7f83c5de1640 1 -- 172.21.15.142:0/182719882 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f83c000a4d0 con 0x55a16626aae0 2024-09-22T08:37:47.721 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.716+0000 7f83c9e14800 1 --2- 172.21.15.142:0/182719882 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55a16636c510 0x55a16636e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:47.721 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.716+0000 7f83c9e14800 1 -- 172.21.15.142:0/182719882 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:3 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a16636f140 con 0x55a16636c510 2024-09-22T08:37:47.721 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.716+0000 7f83c55e0640 1 --2- 172.21.15.142:0/182719882 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55a16636c510 0x55a16636e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:47.721 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.716+0000 7f83c55e0640 1 --2- 172.21.15.142:0/182719882 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55a16636c510 0x55a16636e9b0 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:47.722 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.717+0000 7f83c55e0640 1 -- 172.21.15.142:0/182719882 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(3 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f83b8057030 con 0x55a16636c510 2024-09-22T08:37:47.722 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.717+0000 7f83c9e14800 1 -- 172.21.15.142:0/182719882 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a16636b450 con 0x55a16626aae0 2024-09-22T08:37:47.722 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.717+0000 7f83c5de1640 1 -- 172.21.15.142:0/182719882 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f83c000a4d0 con 0x55a16626aae0 2024-09-22T08:37:47.722 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.717+0000 7f83c9e14800 1 -- 172.21.15.142:0/182719882 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a16636b870 con 0x55a16636c510 2024-09-22T08:37:47.722 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.717+0000 7f83c55e0640 1 -- 172.21.15.142:0/182719882 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(5 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f83b8057030 con 0x55a16636c510 2024-09-22T08:37:47.722 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.718+0000 7f83c9e14800 1 Processor -- start 2024-09-22T08:37:47.722 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.718+0000 7f83c9e14800 1 -- start start 2024-09-22T08:37:47.722 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.718+0000 7f83c9e14800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a16637dad0 0x55a16637def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:47.722 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.718+0000 7f83c9e14800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55a166160d50 con 0x55a16637dad0 2024-09-22T08:37:47.722 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.718+0000 7f83c5de1640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a16637dad0 0x55a16637def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:47.722 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.718+0000 7f83c5de1640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a16637dad0 0x55a16637def0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:56060/0 (socket says 172.21.15.142:56060) 2024-09-22T08:37:47.722 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.718+0000 7f83c5de1640 1 -- 172.21.15.142:0/2240324705 learned_addr learned my addr 172.21.15.142:0/2240324705 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:37:47.723 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.718+0000 7f83c5de1640 1 -- 172.21.15.142:0/2240324705 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a16637e530 con 0x55a16637dad0 2024-09-22T08:37:47.723 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.719+0000 7f83c5de1640 1 --2- 172.21.15.142:0/2240324705 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a16637dad0 0x55a16637def0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x55a1661dee00 tx=0x7f83c00167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:47.723 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.719+0000 7f82aaffd640 1 -- 172.21.15.142:0/2240324705 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83c0013640 con 0x55a16637dad0 2024-09-22T08:37:47.723 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.719+0000 7f82aaffd640 1 -- 172.21.15.142:0/2240324705 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83c00137e0 con 0x55a16637dad0 2024-09-22T08:37:47.723 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.719+0000 7f83c9e14800 1 -- 172.21.15.142:0/2240324705 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a16637ed60 con 0x55a16637dad0 2024-09-22T08:37:47.723 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.719+0000 7f82aaffd640 1 -- 172.21.15.142:0/2240324705 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83c0013ae0 con 0x55a16637dad0 2024-09-22T08:37:47.723 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.719+0000 7f83c9e14800 1 -- 172.21.15.142:0/2240324705 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a16637f300 con 0x55a16637dad0 2024-09-22T08:37:47.731 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.720+0000 7f82aaffd640 1 -- 172.21.15.142:0/2240324705 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f83c0011040 con 0x55a16637dad0 2024-09-22T08:37:47.731 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.720+0000 7f82aaffd640 1 --2- 172.21.15.142:0/2240324705 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f829c03cfb0 0x7f829c03f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:47.732 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.720+0000 7f82aaffd640 1 -- 172.21.15.142:0/2240324705 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5938+0+0 (secure 0 0 0) 0x7f83c000e040 con 0x55a16637dad0 2024-09-22T08:37:47.732 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.720+0000 7f83c55e0640 1 --2- 172.21.15.142:0/2240324705 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f829c03cfb0 0x7f829c03f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:47.732 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.720+0000 7f83c9e14800 1 Processor -- start 2024-09-22T08:37:47.732 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.720+0000 7f83c9e14800 1 -- start start 2024-09-22T08:37:47.732 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.720+0000 7f83c55e0640 1 --2- 172.21.15.142:0/2240324705 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f829c03cfb0 0x7f829c03f470 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x55a16636f510 tx=0x7f83b8096970 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:47.732 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.720+0000 7f83c9e14800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a16638a5b0 0x55a16638a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:47.732 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.720+0000 7f83c9e14800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55a166359900 con 0x55a16638a5b0 2024-09-22T08:37:47.732 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.721+0000 7f83c5de1640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a16638a5b0 0x55a16638a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:47.732 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.721+0000 7f83c5de1640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a16638a5b0 0x55a16638a9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:56068/0 (socket says 172.21.15.142:56068) 2024-09-22T08:37:47.732 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.721+0000 7f83c5de1640 1 -- 172.21.15.142:0/1983305307 learned_addr learned my addr 172.21.15.142:0/1983305307 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:37:47.732 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.721+0000 7f83c5de1640 1 -- 172.21.15.142:0/1983305307 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a16638afa0 con 0x55a16638a5b0 2024-09-22T08:37:47.732 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.721+0000 7f83c5de1640 1 --2- 172.21.15.142:0/1983305307 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a16638a5b0 0x55a16638a9b0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f83c0054840 tx=0x7f83c00204d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=651c3d802da3f6f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:47.732 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.721+0000 7f82a8ff9640 1 -- 172.21.15.142:0/1983305307 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83c00561a0 con 0x55a16638a5b0 2024-09-22T08:37:47.732 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.721+0000 7f82a8ff9640 1 -- 172.21.15.142:0/1983305307 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83c0052070 con 0x55a16638a5b0 2024-09-22T08:37:47.733 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.721+0000 7f82a8ff9640 1 -- 172.21.15.142:0/1983305307 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83c0021a80 con 0x55a16638a5b0 2024-09-22T08:37:47.733 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.722+0000 7f83c9e14800 1 -- 172.21.15.142:0/1983305307 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a16638a5b0 msgr2=0x55a16638a9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:47.733 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.722+0000 7f83c9e14800 1 --2- 172.21.15.142:0/1983305307 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a16638a5b0 0x55a16638a9b0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f83c0054840 tx=0x7f83c00204d0 comp rx=0 tx=0).stop 2024-09-22T08:37:47.733 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.722+0000 7f83c9e14800 1 -- 172.21.15.142:0/1983305307 shutdown_connections 2024-09-22T08:37:47.733 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.722+0000 7f83c9e14800 1 --2- 172.21.15.142:0/1983305307 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a16638a5b0 0x55a16638a9b0 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:47.733 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.722+0000 7f83c9e14800 1 -- 172.21.15.142:0/1983305307 >> 172.21.15.142:0/1983305307 conn(0x55a1663869b0 msgr2=0x55a166384bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:37:47.733 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.722+0000 7f83c9e14800 1 -- 172.21.15.142:0/1983305307 shutdown_connections 2024-09-22T08:37:47.733 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.722+0000 7f83c9e14800 1 -- 172.21.15.142:0/1983305307 wait complete. 2024-09-22T08:37:47.733 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.722+0000 7f83c9e14800 1 Processor -- start 2024-09-22T08:37:47.733 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.722+0000 7f83c9e14800 1 -- start start 2024-09-22T08:37:47.733 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.722+0000 7f83c9e14800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a16638a5b0 0x55a166391b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:47.734 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.722+0000 7f83c9e14800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55a16638b590 con 0x55a16638a5b0 2024-09-22T08:37:47.734 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.722+0000 7f83c5de1640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a16638a5b0 0x55a166391b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:47.734 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.722+0000 7f83c5de1640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a16638a5b0 0x55a166391b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:56082/0 (socket says 172.21.15.142:56082) 2024-09-22T08:37:47.734 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.722+0000 7f83c5de1640 1 -- 172.21.15.142:0/419179682 learned_addr learned my addr 172.21.15.142:0/419179682 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:37:47.734 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.723+0000 7f83c5de1640 1 -- 172.21.15.142:0/419179682 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a1663920a0 con 0x55a16638a5b0 2024-09-22T08:37:47.734 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.723+0000 7f83c5de1640 1 --2- 172.21.15.142:0/419179682 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a16638a5b0 0x55a166391b40 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f83c001fcf0 tx=0x7f83c00547a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:47.734 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.723+0000 7f829affd640 1 -- 172.21.15.142:0/419179682 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83c0013db0 con 0x55a16638a5b0 2024-09-22T08:37:47.734 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.723+0000 7f829affd640 1 -- 172.21.15.142:0/419179682 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83c001f6c0 con 0x55a16638a5b0 2024-09-22T08:37:47.734 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.723+0000 7f83c9e14800 1 -- 172.21.15.142:0/419179682 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a166392330 con 0x55a16638a5b0 2024-09-22T08:37:47.734 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.723+0000 7f829affd640 1 -- 172.21.15.142:0/419179682 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83c00459e0 con 0x55a16638a5b0 2024-09-22T08:37:47.734 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.723+0000 7f83c9e14800 1 -- 172.21.15.142:0/419179682 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a166392ec0 con 0x55a16638a5b0 2024-09-22T08:37:47.734 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.724+0000 7f829affd640 1 -- 172.21.15.142:0/419179682 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f83c0045b80 con 0x55a16638a5b0 2024-09-22T08:37:47.734 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.724+0000 7f829affd640 1 --2- 172.21.15.142:0/419179682 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f829003d000 0x7f829003f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:47.735 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.724+0000 7f829affd640 1 -- 172.21.15.142:0/419179682 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5938+0+0 (secure 0 0 0) 0x7f83c0053b90 con 0x55a16638a5b0 2024-09-22T08:37:47.735 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.724+0000 7f83c55e0640 1 --2- 172.21.15.142:0/419179682 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f829003d000 0x7f829003f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:47.735 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.724+0000 7f83c55e0640 1 --2- 172.21.15.142:0/419179682 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f829003d000 0x7f829003f4c0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f83b8065fd0 tx=0x7f83b8084070 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:47.735 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.725+0000 7f83c9e14800 20 rados->read ofs=0 len=0 2024-09-22T08:37:47.735 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.725+0000 7f83c9e14800 1 --2- 172.21.15.142:0/419179682 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55a16639d480 0x55a16639f940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:47.735 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.725+0000 7f83c9e14800 1 -- 172.21.15.142:0/419179682 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a1663a0090 con 0x55a16639d480 2024-09-22T08:37:47.735 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.725+0000 7f83c4ddf640 1 --2- 172.21.15.142:0/419179682 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55a16639d480 0x55a16639f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:47.735 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.725+0000 7f83c4ddf640 1 --2- 172.21.15.142:0/419179682 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55a16639d480 0x55a16639f940 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:47.735 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.725+0000 7f83c4ddf640 1 -- 172.21.15.142:0/419179682 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f83bc010620 con 0x55a16639d480 2024-09-22T08:37:47.735 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.725+0000 7f83c9e14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:47.735 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.725+0000 7f83c9e14800 20 realm 2024-09-22T08:37:47.735 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.725+0000 7f83c9e14800 20 rados->read ofs=0 len=0 2024-09-22T08:37:47.735 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.725+0000 7f83c9e14800 1 -- 172.21.15.142:0/419179682 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a16639c7d0 con 0x55a16639d480 2024-09-22T08:37:47.735 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.725+0000 7f83c4ddf640 1 -- 172.21.15.142:0/419179682 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f83bc010620 con 0x55a16639d480 2024-09-22T08:37:47.736 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.725+0000 7f83c9e14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:47.736 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.725+0000 7f83c9e14800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:37:47.736 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.725+0000 7f83c9e14800 20 rados->read ofs=0 len=0 2024-09-22T08:37:47.736 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.725+0000 7f83c9e14800 1 -- 172.21.15.142:0/419179682 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a1663a0b80 con 0x55a16639d480 2024-09-22T08:37:47.736 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.726+0000 7f83c4ddf640 1 -- 172.21.15.142:0/419179682 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f83bc010620 con 0x55a16639d480 2024-09-22T08:37:47.736 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.726+0000 7f83c9e14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:47.736 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.726+0000 7f83c9e14800 20 rados->read ofs=0 len=0 2024-09-22T08:37:47.736 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.726+0000 7f83c9e14800 1 -- 172.21.15.142:0/419179682 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a1663a1450 con 0x55a16639d480 2024-09-22T08:37:47.736 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.726+0000 7f83c4ddf640 1 -- 172.21.15.142:0/419179682 <== osd.1 v2:172.21.15.142:6816/3192108003 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f83bc010620 con 0x55a16639d480 2024-09-22T08:37:47.736 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.726+0000 7f83c9e14800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:37:47.736 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.726+0000 7f83c9e14800 20 rados->read ofs=0 len=0 2024-09-22T08:37:47.736 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.726+0000 7f83c9e14800 1 --2- 172.21.15.142:0/419179682 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55a1663a1e70 0x55a1663a4260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:47.736 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.726+0000 7f83c9e14800 1 -- 172.21.15.142:0/419179682 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a1663a49d0 con 0x55a1663a1e70 2024-09-22T08:37:47.736 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.726+0000 7f83c5de1640 1 --2- 172.21.15.142:0/419179682 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55a1663a1e70 0x55a1663a4260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:47.737 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.726+0000 7f83c5de1640 1 --2- 172.21.15.142:0/419179682 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55a1663a1e70 0x55a1663a4260 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:47.737 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.726+0000 7f83c5de1640 1 -- 172.21.15.142:0/419179682 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(5 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f83c000a4d0 con 0x55a1663a1e70 2024-09-22T08:37:47.737 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.726+0000 7f83c9e14800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:37:47.737 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.727+0000 7f83c9e14800 20 searching for the correct realm 2024-09-22T08:37:47.737 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.727+0000 7f83c9e14800 1 -- 172.21.15.142:0/419179682 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a1663a6320 con 0x55a1663a1e70 2024-09-22T08:37:47.737 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.727+0000 7f83c5de1640 1 -- 172.21.15.142:0/419179682 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83c000a4d0 con 0x55a1663a1e70 2024-09-22T08:37:47.737 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.727+0000 7f83c5de1640 1 --2- 172.21.15.142:0/419179682 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f83c0035ba0 0x7f83c0012810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:47.737 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.727+0000 7f83c5de1640 1 -- 172.21.15.142:0/419179682 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a1663a6320 con 0x7f83c0035ba0 2024-09-22T08:37:47.737 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.727+0000 7f83c55e0640 1 --2- 172.21.15.142:0/419179682 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f83c0035ba0 0x7f83c0012810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:47.737 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.727+0000 7f83c55e0640 1 --2- 172.21.15.142:0/419179682 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f83c0035ba0 0x7f83c0012810 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:47.737 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.727+0000 7f83c55e0640 1 -- 172.21.15.142:0/419179682 <== osd.2 v2:172.21.15.142:6808/279438927 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83b8057030 con 0x7f83c0035ba0 2024-09-22T08:37:47.737 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.727+0000 7f83c55e0640 1 --2- 172.21.15.142:0/419179682 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f83b8082040 0x7f83b80507d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:47.737 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.727+0000 7f83c55e0640 1 -- 172.21.15.142:0/419179682 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a1663a6320 con 0x7f83b8082040 2024-09-22T08:37:47.738 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.728+0000 7f83c4ddf640 1 --2- 172.21.15.142:0/419179682 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f83b8082040 0x7f83b80507d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:47.738 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.728+0000 7f83c4ddf640 1 --2- 172.21.15.142:0/419179682 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f83b8082040 0x7f83b80507d0 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:47.738 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.728+0000 7f83c4ddf640 1 -- 172.21.15.142:0/419179682 <== osd.0 v2:172.21.15.31:6800/168281188 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83bc010620 con 0x7f83b8082040 2024-09-22T08:37:47.738 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.728+0000 7f83c4ddf640 1 -- 172.21.15.142:0/419179682 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a1663a6320 con 0x55a16639d480 2024-09-22T08:37:47.738 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.728+0000 7f83c4ddf640 1 -- 172.21.15.142:0/419179682 <== osd.1 v2:172.21.15.142:6816/3192108003 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83bc010620 con 0x55a16639d480 2024-09-22T08:37:47.738 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.729+0000 7f83c4ddf640 1 -- 172.21.15.142:0/419179682 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a1663a6320 con 0x55a16639d480 2024-09-22T08:37:47.738 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.729+0000 7f83c4ddf640 1 -- 172.21.15.142:0/419179682 <== osd.1 v2:172.21.15.142:6816/3192108003 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83bc02a040 con 0x55a16639d480 2024-09-22T08:37:47.738 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.729+0000 7f83c4ddf640 1 -- 172.21.15.142:0/419179682 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a1663a6320 con 0x55a16639d480 2024-09-22T08:37:47.738 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.729+0000 7f83c4ddf640 1 -- 172.21.15.142:0/419179682 <== osd.1 v2:172.21.15.142:6816/3192108003 7 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83bc02a040 con 0x55a16639d480 2024-09-22T08:37:47.738 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.729+0000 7f83c4ddf640 1 -- 172.21.15.142:0/419179682 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a1663a6320 con 0x7f83b8082040 2024-09-22T08:37:47.738 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.729+0000 7f83c4ddf640 1 -- 172.21.15.142:0/419179682 <== osd.0 v2:172.21.15.31:6800/168281188 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83bc02a040 con 0x7f83b8082040 2024-09-22T08:37:47.738 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.729+0000 7f83c4ddf640 1 -- 172.21.15.142:0/419179682 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a1663a6320 con 0x7f83c0035ba0 2024-09-22T08:37:47.738 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.729+0000 7f83c55e0640 1 -- 172.21.15.142:0/419179682 <== osd.2 v2:172.21.15.142:6808/279438927 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83b8057030 con 0x7f83c0035ba0 2024-09-22T08:37:47.739 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.729+0000 7f83c55e0640 1 -- 172.21.15.142:0/419179682 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a1663a6320 con 0x55a1663a1e70 2024-09-22T08:37:47.739 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.730+0000 7f83c5de1640 1 -- 172.21.15.142:0/419179682 <== osd.3 v2:172.21.15.142:6800/1064901393 3 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83c000a4d0 con 0x55a1663a1e70 2024-09-22T08:37:47.739 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.730+0000 7f83c5de1640 1 -- 172.21.15.142:0/419179682 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a1663a6320 con 0x55a16639d480 2024-09-22T08:37:47.739 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.730+0000 7f83c4ddf640 1 -- 172.21.15.142:0/419179682 <== osd.1 v2:172.21.15.142:6816/3192108003 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83bc02a040 con 0x55a16639d480 2024-09-22T08:37:47.739 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.730+0000 7f83c4ddf640 1 -- 172.21.15.142:0/419179682 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a1663a6320 con 0x7f83b8082040 2024-09-22T08:37:47.739 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.730+0000 7f83c4ddf640 1 -- 172.21.15.142:0/419179682 <== osd.0 v2:172.21.15.31:6800/168281188 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83bc02a040 con 0x7f83b8082040 2024-09-22T08:37:47.739 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.730+0000 7f83c4ddf640 1 -- 172.21.15.142:0/419179682 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a1663a6320 con 0x55a16639d480 2024-09-22T08:37:47.739 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.730+0000 7f83c4ddf640 1 -- 172.21.15.142:0/419179682 <== osd.1 v2:172.21.15.142:6816/3192108003 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83bc02a040 con 0x55a16639d480 2024-09-22T08:37:47.739 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.730+0000 7f83c4ddf640 1 -- 172.21.15.142:0/419179682 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a1663a6320 con 0x7f83c0035ba0 2024-09-22T08:37:47.747 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.731+0000 7f83c55e0640 1 -- 172.21.15.142:0/419179682 <== osd.2 v2:172.21.15.142:6808/279438927 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f83b8057030 con 0x7f83c0035ba0 2024-09-22T08:37:47.747 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.731+0000 7f83c55e0640 1 -- 172.21.15.142:0/419179682 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a1663a6320 con 0x55a1663a1e70 2024-09-22T08:37:47.747 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.731+0000 7f83c5de1640 1 -- 172.21.15.142:0/419179682 <== osd.3 v2:172.21.15.142:6800/1064901393 4 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83c000a4d0 con 0x55a1663a1e70 2024-09-22T08:37:47.747 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.731+0000 7f83c5de1640 1 -- 172.21.15.142:0/419179682 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a1663a6320 con 0x55a1663a1e70 2024-09-22T08:37:47.747 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.731+0000 7f83c5de1640 1 -- 172.21.15.142:0/419179682 <== osd.3 v2:172.21.15.142:6800/1064901393 5 ==== osd_op_reply(20 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f83c000a4d0 con 0x55a1663a1e70 2024-09-22T08:37:47.747 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.731+0000 7f83c5de1640 1 -- 172.21.15.142:0/419179682 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a1663a6320 con 0x7f83b8082040 2024-09-22T08:37:47.747 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.731+0000 7f83c4ddf640 1 -- 172.21.15.142:0/419179682 <== osd.0 v2:172.21.15.31:6800/168281188 4 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83bc02a040 con 0x7f83b8082040 2024-09-22T08:37:47.748 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.732+0000 7f83c4ddf640 1 -- 172.21.15.142:0/419179682 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a1663a6320 con 0x55a1663a1e70 2024-09-22T08:37:47.748 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.732+0000 7f83c5de1640 1 -- 172.21.15.142:0/419179682 <== osd.3 v2:172.21.15.142:6800/1064901393 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83c000a4d0 con 0x55a1663a1e70 2024-09-22T08:37:47.748 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.732+0000 7f83c5de1640 1 -- 172.21.15.142:0/419179682 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a1663a6320 con 0x55a1663a1e70 2024-09-22T08:37:47.748 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.732+0000 7f83c5de1640 1 -- 172.21.15.142:0/419179682 <== osd.3 v2:172.21.15.142:6800/1064901393 7 ==== osd_op_reply(23 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f83c000a4d0 con 0x55a1663a1e70 2024-09-22T08:37:47.748 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.732+0000 7f83c5de1640 1 -- 172.21.15.142:0/419179682 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a1663a6320 con 0x55a16639d480 2024-09-22T08:37:47.748 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.732+0000 7f83c4ddf640 1 -- 172.21.15.142:0/419179682 <== osd.1 v2:172.21.15.142:6816/3192108003 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83bc02a040 con 0x55a16639d480 2024-09-22T08:37:47.748 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.732+0000 7f83c4ddf640 1 -- 172.21.15.142:0/419179682 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a1663a6320 con 0x55a16639d480 2024-09-22T08:37:47.748 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.732+0000 7f83c4ddf640 1 -- 172.21.15.142:0/419179682 <== osd.1 v2:172.21.15.142:6816/3192108003 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f83bc02a040 con 0x55a16639d480 2024-09-22T08:37:47.748 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.732+0000 7f83c4ddf640 1 -- 172.21.15.142:0/419179682 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a1663a6320 con 0x7f83b8082040 2024-09-22T08:37:47.748 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.733+0000 7f83c4ddf640 1 -- 172.21.15.142:0/419179682 <== osd.0 v2:172.21.15.31:6800/168281188 5 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83bc02a040 con 0x7f83b8082040 2024-09-22T08:37:47.748 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.733+0000 7f83c4ddf640 1 -- 172.21.15.142:0/419179682 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a1663a6320 con 0x55a1663a1e70 2024-09-22T08:37:47.748 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.733+0000 7f83c5de1640 1 -- 172.21.15.142:0/419179682 <== osd.3 v2:172.21.15.142:6800/1064901393 8 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83c000a4d0 con 0x55a1663a1e70 2024-09-22T08:37:47.748 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.733+0000 7f83c5de1640 1 -- 172.21.15.142:0/419179682 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a1663a6320 con 0x7f83c0035ba0 2024-09-22T08:37:47.749 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.733+0000 7f83c55e0640 1 -- 172.21.15.142:0/419179682 <== osd.2 v2:172.21.15.142:6808/279438927 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83b8057030 con 0x7f83c0035ba0 2024-09-22T08:37:47.749 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.733+0000 7f83c55e0640 1 -- 172.21.15.142:0/419179682 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a1663a6320 con 0x55a16639d480 2024-09-22T08:37:47.749 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.733+0000 7f83c4ddf640 1 -- 172.21.15.142:0/419179682 <== osd.1 v2:172.21.15.142:6816/3192108003 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83bc02a040 con 0x55a16639d480 2024-09-22T08:37:47.749 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.733+0000 7f83c4ddf640 1 -- 172.21.15.142:0/419179682 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a1663a6320 con 0x7f83b8082040 2024-09-22T08:37:47.749 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.734+0000 7f83c4ddf640 1 -- 172.21.15.142:0/419179682 <== osd.0 v2:172.21.15.31:6800/168281188 6 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83bc02a040 con 0x7f83b8082040 2024-09-22T08:37:47.749 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.734+0000 7f83c4ddf640 1 -- 172.21.15.142:0/419179682 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a1663a6320 con 0x55a1663a1e70 2024-09-22T08:37:47.749 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.734+0000 7f83c5de1640 1 -- 172.21.15.142:0/419179682 <== osd.3 v2:172.21.15.142:6800/1064901393 9 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83c000a4d0 con 0x55a1663a1e70 2024-09-22T08:37:47.749 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.734+0000 7f83c5de1640 1 -- 172.21.15.142:0/419179682 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a1663a6320 con 0x7f83b8082040 2024-09-22T08:37:47.749 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.734+0000 7f83c4ddf640 1 -- 172.21.15.142:0/419179682 <== osd.0 v2:172.21.15.31:6800/168281188 7 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83bc02a040 con 0x7f83b8082040 2024-09-22T08:37:47.749 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.734+0000 7f83c4ddf640 1 -- 172.21.15.142:0/419179682 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a1663a6320 con 0x7f83c0035ba0 2024-09-22T08:37:47.749 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.735+0000 7f83c55e0640 1 -- 172.21.15.142:0/419179682 <== osd.2 v2:172.21.15.142:6808/279438927 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83b8057030 con 0x7f83c0035ba0 2024-09-22T08:37:47.749 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.735+0000 7f83c55e0640 1 -- 172.21.15.142:0/419179682 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a1663a6320 con 0x55a1663a1e70 2024-09-22T08:37:47.749 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.735+0000 7f83c5de1640 1 -- 172.21.15.142:0/419179682 <== osd.3 v2:172.21.15.142:6800/1064901393 10 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83c000a4d0 con 0x55a1663a1e70 2024-09-22T08:37:47.750 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.735+0000 7f83c5de1640 1 -- 172.21.15.142:0/419179682 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a1663a6320 con 0x7f83b8082040 2024-09-22T08:37:47.750 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.735+0000 7f83c4ddf640 1 -- 172.21.15.142:0/419179682 <== osd.0 v2:172.21.15.31:6800/168281188 8 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83bc02a040 con 0x7f83b8082040 2024-09-22T08:37:47.750 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.735+0000 7f83c4ddf640 1 -- 172.21.15.142:0/419179682 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a1663a6320 con 0x55a16639d480 2024-09-22T08:37:47.750 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.735+0000 7f83c4ddf640 1 -- 172.21.15.142:0/419179682 <== osd.1 v2:172.21.15.142:6816/3192108003 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f83bc02a040 con 0x55a16639d480 2024-09-22T08:37:47.750 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.736+0000 7f83c4ddf640 1 -- 172.21.15.142:0/419179682 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a1663a6320 con 0x7f83c0035ba0 2024-09-22T08:37:47.750 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.736+0000 7f83c55e0640 1 -- 172.21.15.142:0/419179682 <== osd.2 v2:172.21.15.142:6808/279438927 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83b8057030 con 0x7f83c0035ba0 2024-09-22T08:37:47.750 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.736+0000 7f83c9e14800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:37:47.750 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.736+0000 7f83c9e14800 20 RGWRados::pool_iterate: got zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec 2024-09-22T08:37:47.750 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.736+0000 7f83c9e14800 20 RGWRados::pool_iterate: got zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f 2024-09-22T08:37:47.750 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.736+0000 7f83c9e14800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:37:47.750 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.736+0000 7f83c9e14800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:37:47.750 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.736+0000 7f83c9e14800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:37:47.750 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.736+0000 7f83c9e14800 20 rados->read ofs=0 len=0 2024-09-22T08:37:47.751 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.736+0000 7f83c9e14800 1 -- 172.21.15.142:0/419179682 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a1663a5390 con 0x55a16639d480 2024-09-22T08:37:47.751 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.736+0000 7f83c4ddf640 1 -- 172.21.15.142:0/419179682 <== osd.1 v2:172.21.15.142:6816/3192108003 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f83bc02a040 con 0x55a16639d480 2024-09-22T08:37:47.751 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.736+0000 7f83c9e14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:47.751 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.736+0000 7f83c9e14800 20 rados->read ofs=0 len=0 2024-09-22T08:37:47.751 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.736+0000 7f83c9e14800 1 -- 172.21.15.142:0/419179682 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a1663a5c30 con 0x55a16639d480 2024-09-22T08:37:47.751 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.736+0000 7f83c4ddf640 1 -- 172.21.15.142:0/419179682 <== osd.1 v2:172.21.15.142:6816/3192108003 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f83bc02a040 con 0x55a16639d480 2024-09-22T08:37:47.751 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.736+0000 7f83c9e14800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:37:47.751 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.736+0000 7f83c9e14800 20 rados->read ofs=0 len=0 2024-09-22T08:37:47.751 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.736+0000 7f83c9e14800 1 -- 172.21.15.142:0/419179682 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:40 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a1663a67a0 con 0x55a1663a1e70 2024-09-22T08:37:47.751 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.737+0000 7f83c5de1640 1 -- 172.21.15.142:0/419179682 <== osd.3 v2:172.21.15.142:6800/1064901393 11 ==== osd_op_reply(40 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f83c000a4d0 con 0x55a1663a1e70 2024-09-22T08:37:47.751 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.737+0000 7f83c9e14800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:37:47.751 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.737+0000 7f83c9e14800 20 zone default found 2024-09-22T08:37:47.751 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.737+0000 7f83c9e14800 4 Realm: () 2024-09-22T08:37:47.751 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.737+0000 7f83c9e14800 4 ZoneGroup: default (d89f6f57-1007-47dd-9065-f486c7b01aec) 2024-09-22T08:37:47.752 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.737+0000 7f83c9e14800 4 Zone: default (e239248c-0bee-4e41-803a-24b288d3eb8f) 2024-09-22T08:37:47.752 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.737+0000 7f83c9e14800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:37:47.752 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.737+0000 7f83c9e14800 20 zonegroup default 2024-09-22T08:37:47.752 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.737+0000 7f83c9e14800 20 rados->read ofs=0 len=0 2024-09-22T08:37:47.752 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.737+0000 7f83c9e14800 1 -- 172.21.15.142:0/419179682 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a1663a6b40 con 0x7f83b8082040 2024-09-22T08:37:47.752 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.737+0000 7f83c4ddf640 1 -- 172.21.15.142:0/419179682 <== osd.0 v2:172.21.15.31:6800/168281188 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f83bc02a040 con 0x7f83b8082040 2024-09-22T08:37:47.752 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.737+0000 7f83c9e14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:47.752 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.737+0000 7f83c9e14800 20 rados->read ofs=0 len=0 2024-09-22T08:37:47.752 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.737+0000 7f83c9e14800 1 -- 172.21.15.142:0/419179682 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a1663a8970 con 0x55a1663a1e70 2024-09-22T08:37:47.752 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.737+0000 7f83c5de1640 1 -- 172.21.15.142:0/419179682 <== osd.3 v2:172.21.15.142:6800/1064901393 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f83c000a4d0 con 0x55a1663a1e70 2024-09-22T08:37:47.752 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.737+0000 7f83c9e14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:47.752 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.737+0000 7f83c9e14800 20 rados->read ofs=0 len=0 2024-09-22T08:37:47.752 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.737+0000 7f83c9e14800 1 -- 172.21.15.142:0/419179682 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a1663a8d80 con 0x55a1663a1e70 2024-09-22T08:37:47.752 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.737+0000 7f83c5de1640 1 -- 172.21.15.142:0/419179682 <== osd.3 v2:172.21.15.142:6800/1064901393 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f83c000a4d0 con 0x55a1663a1e70 2024-09-22T08:37:47.753 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.737+0000 7f83c9e14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:47.753 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.737+0000 7f83c9e14800 20 started sync module instance, tier type = 2024-09-22T08:37:47.753 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.737+0000 7f83c9e14800 20 started zone id=e239248c-0bee-4e41-803a-24b288d3eb8f (name=default) with tier type = 2024-09-22T08:37:47.753 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.737+0000 7f83c9e14800 1 -- 172.21.15.142:0/419179682 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a1663a7e10 con 0x7f83c0035ba0 2024-09-22T08:37:47.753 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.738+0000 7f83c55e0640 1 -- 172.21.15.142:0/419179682 <== osd.2 v2:172.21.15.142:6808/279438927 7 ==== osd_op_reply(44 notify.0 [create] v32'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83b8057030 con 0x7f83c0035ba0 2024-09-22T08:37:47.753 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.739+0000 7f83c9e14800 1 -- 172.21.15.142:0/419179682 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94151693203808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a1663a91e0 con 0x7f83c0035ba0 2024-09-22T08:37:47.753 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.739+0000 7f83c9e14800 1 -- 172.21.15.142:0/419179682 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a1663a9a30 con 0x55a16639d480 2024-09-22T08:37:47.753 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.740+0000 7f83c55e0640 1 -- 172.21.15.142:0/419179682 <== osd.2 v2:172.21.15.142:6808/279438927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94151693203808] v32'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83b8057030 con 0x7f83c0035ba0 2024-09-22T08:37:47.753 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.740+0000 7f83c4ddf640 1 -- 172.21.15.142:0/419179682 <== osd.1 v2:172.21.15.142:6816/3192108003 16 ==== osd_op_reply(46 notify.1 [create] v32'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83bc02a040 con 0x55a16639d480 2024-09-22T08:37:47.753 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.740+0000 7f83c9e14800 1 -- 172.21.15.142:0/419179682 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94151693211008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a1663a9e50 con 0x55a16639d480 2024-09-22T08:37:47.753 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.740+0000 7f83c9e14800 1 -- 172.21.15.142:0/419179682 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a1663aa6e0 con 0x55a1663a1e70 2024-09-22T08:37:47.753 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.741+0000 7f83c4ddf640 1 -- 172.21.15.142:0/419179682 <== osd.1 v2:172.21.15.142:6816/3192108003 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94151693211008] v32'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83bc02a040 con 0x55a16639d480 2024-09-22T08:37:47.753 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.741+0000 7f83c5de1640 1 -- 172.21.15.142:0/419179682 <== osd.3 v2:172.21.15.142:6800/1064901393 14 ==== osd_op_reply(48 notify.2 [create] v32'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83c000a4d0 con 0x55a1663a1e70 2024-09-22T08:37:47.753 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.741+0000 7f83c9e14800 1 -- 172.21.15.142:0/419179682 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94151693212064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a1663aa270 con 0x55a1663a1e70 2024-09-22T08:37:47.753 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.741+0000 7f83c9e14800 1 -- 172.21.15.142:0/419179682 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a1663ab160 con 0x7f83c0035ba0 2024-09-22T08:37:47.754 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.742+0000 7f83c55e0640 1 -- 172.21.15.142:0/419179682 <== osd.2 v2:172.21.15.142:6808/279438927 9 ==== osd_op_reply(50 notify.3 [create] v32'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83b8057030 con 0x7f83c0035ba0 2024-09-22T08:37:47.754 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.742+0000 7f83c9e14800 1 -- 172.21.15.142:0/419179682 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94151693216880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a1663aba00 con 0x7f83c0035ba0 2024-09-22T08:37:47.754 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.742+0000 7f83c9e14800 1 -- 172.21.15.142:0/419179682 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a1663ac520 con 0x55a16639d480 2024-09-22T08:37:47.754 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.742+0000 7f83c5de1640 1 -- 172.21.15.142:0/419179682 <== osd.3 v2:172.21.15.142:6800/1064901393 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94151693212064] v32'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83c000a4d0 con 0x55a1663a1e70 2024-09-22T08:37:47.754 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.743+0000 7f83c4ddf640 1 -- 172.21.15.142:0/419179682 <== osd.1 v2:172.21.15.142:6816/3192108003 18 ==== osd_op_reply(52 notify.4 [create] v32'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83bc02a040 con 0x55a16639d480 2024-09-22T08:37:47.754 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.743+0000 7f83c9e14800 1 -- 172.21.15.142:0/419179682 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94151693221872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a1663ac910 con 0x55a16639d480 2024-09-22T08:37:47.754 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.743+0000 7f83c55e0640 1 -- 172.21.15.142:0/419179682 <== osd.2 v2:172.21.15.142:6808/279438927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94151693216880] v32'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83b8057030 con 0x7f83c0035ba0 2024-09-22T08:37:47.754 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.743+0000 7f83c9e14800 1 -- 172.21.15.142:0/419179682 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a1663ab590 con 0x7f83b8082040 2024-09-22T08:37:47.754 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.744+0000 7f83c4ddf640 1 -- 172.21.15.142:0/419179682 <== osd.1 v2:172.21.15.142:6816/3192108003 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94151693221872] v32'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83bc02a040 con 0x55a16639d480 2024-09-22T08:37:47.754 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.745+0000 7f83c4ddf640 1 -- 172.21.15.142:0/419179682 <== osd.0 v2:172.21.15.31:6800/168281188 10 ==== osd_op_reply(54 notify.5 [create] v32'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83bc02a040 con 0x7f83b8082040 2024-09-22T08:37:47.754 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.745+0000 7f83c9e14800 1 -- 172.21.15.142:0/419179682 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94151693213120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a1663ab590 con 0x7f83b8082040 2024-09-22T08:37:47.754 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.745+0000 7f83c9e14800 1 -- 172.21.15.142:0/419179682 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a1663ad8f0 con 0x7f83b8082040 2024-09-22T08:37:47.755 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.746+0000 7f83c4ddf640 1 -- 172.21.15.142:0/419179682 <== osd.0 v2:172.21.15.31:6800/168281188 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94151693213120] v32'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83bc02a040 con 0x7f83b8082040 2024-09-22T08:37:47.758 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.746+0000 7f83c4ddf640 1 -- 172.21.15.142:0/419179682 <== osd.0 v2:172.21.15.31:6800/168281188 12 ==== osd_op_reply(56 notify.6 [create] v32'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83bc02a040 con 0x7f83b8082040 2024-09-22T08:37:47.758 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.746+0000 7f83c9e14800 1 -- 172.21.15.142:0/419179682 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94151693225504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a1663ad8f0 con 0x7f83b8082040 2024-09-22T08:37:47.758 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.746+0000 7f83c9e14800 1 -- 172.21.15.142:0/419179682 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a1663ae2b0 con 0x7f83b8082040 2024-09-22T08:37:47.758 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.747+0000 7f83c4ddf640 1 -- 172.21.15.142:0/419179682 <== osd.0 v2:172.21.15.31:6800/168281188 13 ==== osd_op_reply(58 notify.7 [create] v32'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83bc02a040 con 0x7f83b8082040 2024-09-22T08:37:47.758 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.747+0000 7f83c9e14800 1 -- 172.21.15.142:0/419179682 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94151693229568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a1663ae6d0 con 0x7f83b8082040 2024-09-22T08:37:47.759 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.747+0000 7f83c9e14800 20 add_watcher() i=0 2024-09-22T08:37:47.759 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.747+0000 7f83c9e14800 20 add_watcher() i=1 2024-09-22T08:37:47.759 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.747+0000 7f83c9e14800 20 add_watcher() i=2 2024-09-22T08:37:47.759 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.747+0000 7f83c9e14800 20 add_watcher() i=3 2024-09-22T08:37:47.759 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.747+0000 7f83c9e14800 20 add_watcher() i=4 2024-09-22T08:37:47.759 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.747+0000 7f83c9e14800 20 add_watcher() i=5 2024-09-22T08:37:47.759 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.748+0000 7f83c4ddf640 1 -- 172.21.15.142:0/419179682 <== osd.0 v2:172.21.15.31:6800/168281188 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94151693225504] v32'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83bc02a040 con 0x7f83b8082040 2024-09-22T08:37:47.759 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.748+0000 7f83c9e14800 20 add_watcher() i=6 2024-09-22T08:37:47.759 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.748+0000 7f83c4ddf640 1 -- 172.21.15.142:0/419179682 <== osd.0 v2:172.21.15.31:6800/168281188 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94151693229568] v32'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83bc02a040 con 0x7f83b8082040 2024-09-22T08:37:47.759 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.748+0000 7f83c9e14800 20 add_watcher() i=7 2024-09-22T08:37:47.759 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.748+0000 7f83c9e14800 2 all 8 watchers are set, enabling cache 2024-09-22T08:37:47.759 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.748+0000 7f83c9e14800 1 -- 172.21.15.142:0/419179682 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a1663ae6d0 con 0x55a16639d480 2024-09-22T08:37:47.759 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.749+0000 7f83c4ddf640 1 -- 172.21.15.142:0/419179682 <== osd.1 v2:172.21.15.142:6816/3192108003 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f83bc02a040 con 0x55a16639d480 2024-09-22T08:37:47.760 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.749+0000 7f83c9e14800 1 -- 172.21.15.142:0/419179682 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94151693230624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a1663ae6b0 con 0x55a16639d480 2024-09-22T08:37:47.760 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.750+0000 7f83c4ddf640 1 -- 172.21.15.142:0/419179682 <== osd.1 v2:172.21.15.142:6816/3192108003 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94151693230624] v32'216 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f83bc02a040 con 0x55a16639d480 2024-09-22T08:37:47.760 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.750+0000 7f827b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:37:47.760 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.750+0000 7f83c9e14800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:37:47.760 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.750+0000 7f83c9e14800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:37:47.760 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.750+0000 7f83c9e14800 5 note: GC not initialized 2024-09-22T08:37:47.760 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.750+0000 7f827a7e4640 20 reqs_thread_entry: start 2024-09-22T08:37:47.760 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.750+0000 7f83c9e14800 20 init_complete bucket index max shards: 11 2024-09-22T08:37:47.760 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.750+0000 7f83c9e14800 20 Filter name: none 2024-09-22T08:37:47.761 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.750+0000 7f81ebfff640 20 reqs_thread_entry: start 2024-09-22T08:37:47.761 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.750+0000 7f83c9e14800 10 cache get: name=default.rgw.meta+users.uid+bud : miss 2024-09-22T08:37:47.761 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.750+0000 7f83c9e14800 20 rados->read ofs=0 len=0 2024-09-22T08:37:47.761 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.750+0000 7f83c9e14800 1 -- 172.21.15.142:0/419179682 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:62 8.4 8:267425a8:users.uid::bud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a1663e4b80 con 0x7f83c0035ba0 2024-09-22T08:37:47.761 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.753+0000 7f83c55e0640 1 -- 172.21.15.142:0/419179682 <== osd.2 v2:172.21.15.142:6808/279438927 11 ==== osd_op_reply(62 bud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv2 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f83b8057030 con 0x7f83c0035ba0 2024-09-22T08:37:47.761 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.753+0000 7f83c9e14800 20 rados_obj.operate() r=0 bl.length=380 2024-09-22T08:37:47.761 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.753+0000 7f83c9e14800 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x13 2024-09-22T08:37:47.761 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.753+0000 7f83c9e14800 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-09-22T08:37:47.761 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.753+0000 7f83c9e14800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:37:47.761 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.753+0000 7f83c9e14800 1 -- 172.21.15.142:0/419179682 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:63 8.e 8:75f48285:users.uid::fud:head [create,call version.set in=58b,writefull 0~206 in=206b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a1663e8f00 con 0x7f83b8082040 2024-09-22T08:37:47.761 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.754+0000 7f83c4ddf640 1 -- 172.21.15.142:0/419179682 <== osd.0 v2:172.21.15.31:6800/168281188 16 ==== osd_op_reply(63 fud [create,call,writefull 0~206] v32'10 uv9 ondisk = -17 ((17) File exists)) ==== 231+0+0 (crc 0 0 0) 0x7f83bc02a040 con 0x7f83b8082040 2024-09-22T08:37:47.761 INFO:teuthology.orchestra.run.smithi142.stderr:could not rename user: unable to rename user, user name given by --new-uid already exists. to overwrite this user, add --yes-i-really-mean-it 2024-09-22T08:37:47.761 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.754+0000 7f827b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:37:47.761 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.754+0000 7f83c9e14800 1 -- 172.21.15.142:0/419179682 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94151693230624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a1663e2880 con 0x55a16639d480 2024-09-22T08:37:47.762 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.756+0000 7f83c4ddf640 1 -- 172.21.15.142:0/419179682 <== osd.1 v2:172.21.15.142:6816/3192108003 22 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94151693230624] v32'217 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f83bc02a040 con 0x55a16639d480 2024-09-22T08:37:47.762 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.756+0000 7f83c9e14800 1 -- 172.21.15.142:0/419179682 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94151693203808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a1663e2880 con 0x7f83c0035ba0 2024-09-22T08:37:47.762 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.756+0000 7f83c55e0640 1 -- 172.21.15.142:0/419179682 <== osd.2 v2:172.21.15.142:6808/279438927 12 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94151693203808] v32'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83b8057030 con 0x7f83c0035ba0 2024-09-22T08:37:47.762 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.756+0000 7f83c9e14800 20 remove_watcher() i=0 2024-09-22T08:37:47.762 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.756+0000 7f83c9e14800 2 removed watcher, disabling cache 2024-09-22T08:37:47.762 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.757+0000 7f83c9e14800 1 -- 172.21.15.142:0/419179682 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94151693211008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a1663e2880 con 0x55a16639d480 2024-09-22T08:37:47.763 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.758+0000 7f83c4ddf640 1 -- 172.21.15.142:0/419179682 <== osd.1 v2:172.21.15.142:6816/3192108003 23 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94151693211008] v32'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83bc02a040 con 0x55a16639d480 2024-09-22T08:37:47.764 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.758+0000 7f83c9e14800 20 remove_watcher() i=1 2024-09-22T08:37:47.764 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.758+0000 7f83c9e14800 1 -- 172.21.15.142:0/419179682 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94151693212064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a1663e2880 con 0x55a1663a1e70 2024-09-22T08:37:47.764 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.759+0000 7f83c5de1640 1 -- 172.21.15.142:0/419179682 <== osd.3 v2:172.21.15.142:6800/1064901393 16 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94151693212064] v32'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83c000a4d0 con 0x55a1663a1e70 2024-09-22T08:37:47.764 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.759+0000 7f83c9e14800 20 remove_watcher() i=2 2024-09-22T08:37:47.764 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.759+0000 7f83c9e14800 1 -- 172.21.15.142:0/419179682 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94151693216880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a1663e2880 con 0x7f83c0035ba0 2024-09-22T08:37:47.764 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.760+0000 7f83c55e0640 1 -- 172.21.15.142:0/419179682 <== osd.2 v2:172.21.15.142:6808/279438927 13 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94151693216880] v32'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83b8057030 con 0x7f83c0035ba0 2024-09-22T08:37:47.764 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.760+0000 7f83c9e14800 20 remove_watcher() i=3 2024-09-22T08:37:47.764 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.760+0000 7f83c9e14800 1 -- 172.21.15.142:0/419179682 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94151693221872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a1663e2880 con 0x55a16639d480 2024-09-22T08:37:47.764 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.761+0000 7f83c4ddf640 1 -- 172.21.15.142:0/419179682 <== osd.1 v2:172.21.15.142:6816/3192108003 24 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94151693221872] v32'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83bc02a040 con 0x55a16639d480 2024-09-22T08:37:47.764 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.761+0000 7f83c9e14800 20 remove_watcher() i=4 2024-09-22T08:37:47.764 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.761+0000 7f83c9e14800 1 -- 172.21.15.142:0/419179682 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94151693213120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a1663e2880 con 0x7f83b8082040 2024-09-22T08:37:47.764 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.762+0000 7f83c4ddf640 1 -- 172.21.15.142:0/419179682 <== osd.0 v2:172.21.15.31:6800/168281188 17 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94151693213120] v32'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83bc02a040 con 0x7f83b8082040 2024-09-22T08:37:47.764 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.762+0000 7f83c9e14800 20 remove_watcher() i=5 2024-09-22T08:37:47.765 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.762+0000 7f83c9e14800 1 -- 172.21.15.142:0/419179682 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94151693225504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a1663e2880 con 0x7f83b8082040 2024-09-22T08:37:47.765 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.763+0000 7f83c4ddf640 1 -- 172.21.15.142:0/419179682 <== osd.0 v2:172.21.15.31:6800/168281188 18 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94151693225504] v32'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83bc02a040 con 0x7f83b8082040 2024-09-22T08:37:47.765 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.763+0000 7f83c9e14800 20 remove_watcher() i=6 2024-09-22T08:37:47.765 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.763+0000 7f83c9e14800 1 -- 172.21.15.142:0/419179682 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94151693229568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a1663e2880 con 0x7f83b8082040 2024-09-22T08:37:47.768 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.765+0000 7f83c4ddf640 1 -- 172.21.15.142:0/419179682 <== osd.0 v2:172.21.15.31:6800/168281188 19 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94151693229568] v32'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83bc02a040 con 0x7f83b8082040 2024-09-22T08:37:47.768 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.765+0000 7f83c9e14800 20 remove_watcher() i=7 2024-09-22T08:37:47.768 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.765+0000 7f83c9e14800 1 -- 172.21.15.142:0/419179682 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f83b8082040 msgr2=0x7f83b80507d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:47.768 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.765+0000 7f83c9e14800 1 --2- 172.21.15.142:0/419179682 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f83b8082040 0x7f83b80507d0 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:47.768 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.765+0000 7f83c9e14800 1 -- 172.21.15.142:0/419179682 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55a16639d480 msgr2=0x55a16639f940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:47.768 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.765+0000 7f83c9e14800 1 --2- 172.21.15.142:0/419179682 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55a16639d480 0x55a16639f940 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:47.768 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.765+0000 7f83c9e14800 1 -- 172.21.15.142:0/419179682 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f83c0035ba0 msgr2=0x7f83c0012810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:47.768 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.765+0000 7f83c9e14800 1 --2- 172.21.15.142:0/419179682 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f83c0035ba0 0x7f83c0012810 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:47.768 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.765+0000 7f83c9e14800 1 -- 172.21.15.142:0/419179682 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55a1663a1e70 msgr2=0x55a1663a4260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:47.768 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.765+0000 7f83c9e14800 1 --2- 172.21.15.142:0/419179682 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55a1663a1e70 0x55a1663a4260 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:47.768 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.765+0000 7f83c9e14800 1 -- 172.21.15.142:0/419179682 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f829003d000 msgr2=0x7f829003f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:47.769 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.765+0000 7f83c9e14800 1 --2- 172.21.15.142:0/419179682 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f829003d000 0x7f829003f4c0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f83b8065fd0 tx=0x7f83b8084070 comp rx=0 tx=0).stop 2024-09-22T08:37:47.769 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.765+0000 7f83c9e14800 1 -- 172.21.15.142:0/419179682 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a16638a5b0 msgr2=0x55a166391b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:47.769 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.765+0000 7f83c9e14800 1 --2- 172.21.15.142:0/419179682 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a16638a5b0 0x55a166391b40 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f83c001fcf0 tx=0x7f83c00547a0 comp rx=0 tx=0).stop 2024-09-22T08:37:47.769 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.765+0000 7f83c4ddf640 1 -- 172.21.15.142:0/419179682 reap_dead start 2024-09-22T08:37:47.769 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.765+0000 7f83c4ddf640 1 -- 172.21.15.142:0/419179682 reap_dead start 2024-09-22T08:37:47.769 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.765+0000 7f83c9e14800 1 -- 172.21.15.142:0/419179682 shutdown_connections 2024-09-22T08:37:47.769 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.765+0000 7f83c9e14800 1 -- 172.21.15.142:0/419179682 >> 172.21.15.142:0/419179682 conn(0x55a1663869b0 msgr2=0x55a166384bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:37:47.769 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.765+0000 7f83c9e14800 1 -- 172.21.15.142:0/419179682 shutdown_connections 2024-09-22T08:37:47.769 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.765+0000 7f83c9e14800 1 -- 172.21.15.142:0/419179682 wait complete. 2024-09-22T08:37:47.769 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.765+0000 7f83c9e14800 1 -- 172.21.15.142:0/2240324705 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f829c03cfb0 msgr2=0x7f829c03f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:47.769 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.765+0000 7f83c9e14800 1 --2- 172.21.15.142:0/2240324705 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f829c03cfb0 0x7f829c03f470 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x55a16636f510 tx=0x7f83b8096970 comp rx=0 tx=0).stop 2024-09-22T08:37:47.769 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.765+0000 7f83c9e14800 1 -- 172.21.15.142:0/2240324705 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a16637dad0 msgr2=0x55a16637def0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:47.769 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.765+0000 7f83c9e14800 1 --2- 172.21.15.142:0/2240324705 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a16637dad0 0x55a16637def0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x55a1661dee00 tx=0x7f83c00167b0 comp rx=0 tx=0).stop 2024-09-22T08:37:47.769 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.765+0000 7f83c9e14800 1 -- 172.21.15.142:0/2240324705 shutdown_connections 2024-09-22T08:37:47.770 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.765+0000 7f83c9e14800 1 --2- 172.21.15.142:0/2240324705 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f829c03cfb0 0x7f829c03f470 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:47.770 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.765+0000 7f83c9e14800 1 --2- 172.21.15.142:0/2240324705 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a16637dad0 0x55a16637def0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:47.770 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.765+0000 7f83c9e14800 1 -- 172.21.15.142:0/2240324705 >> 172.21.15.142:0/2240324705 conn(0x55a166371e80 msgr2=0x55a166372260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:37:47.770 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.765+0000 7f83c9e14800 1 -- 172.21.15.142:0/2240324705 shutdown_connections 2024-09-22T08:37:47.770 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.765+0000 7f83c9e14800 1 -- 172.21.15.142:0/2240324705 wait complete. 2024-09-22T08:37:47.770 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.766+0000 7f83c9e14800 1 -- 172.21.15.142:0/182719882 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55a16626aae0 msgr2=0x55a166369dc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:47.770 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.766+0000 7f83c9e14800 1 --2- 172.21.15.142:0/182719882 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55a16626aae0 0x55a166369dc0 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:47.770 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.766+0000 7f83c9e14800 1 -- 172.21.15.142:0/182719882 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55a16636c510 msgr2=0x55a16636e9b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:47.770 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.766+0000 7f83c9e14800 1 --2- 172.21.15.142:0/182719882 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55a16636c510 0x55a16636e9b0 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:47.770 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.766+0000 7f83c9e14800 1 -- 172.21.15.142:0/182719882 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f82ac03cfb0 msgr2=0x7f82ac03f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:47.770 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.766+0000 7f83c9e14800 1 --2- 172.21.15.142:0/182719882 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f82ac03cfb0 0x7f82ac03f470 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f83bc001eb0 tx=0x7f83bc001430 comp rx=0 tx=0).stop 2024-09-22T08:37:47.770 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.766+0000 7f83c9e14800 1 -- 172.21.15.142:0/182719882 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a1662699e0 msgr2=0x55a1661df260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:47.770 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.766+0000 7f83c9e14800 1 --2- 172.21.15.142:0/182719882 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a1662699e0 0x55a1661df260 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f83b80460d0 tx=0x7f83b8002fb0 comp rx=0 tx=0).stop 2024-09-22T08:37:47.771 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.766+0000 7f83c9e14800 1 -- 172.21.15.142:0/182719882 shutdown_connections 2024-09-22T08:37:47.771 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.766+0000 7f83c9e14800 1 --2- 172.21.15.142:0/182719882 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55a16636c510 0x55a16636e9b0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:47.771 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.766+0000 7f83c9e14800 1 --2- 172.21.15.142:0/182719882 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55a16626aae0 0x55a166369dc0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:47.771 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.766+0000 7f83c9e14800 1 --2- 172.21.15.142:0/182719882 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f82ac03cfb0 0x7f82ac03f470 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:47.771 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.766+0000 7f83c9e14800 1 --2- 172.21.15.142:0/182719882 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a1662699e0 0x55a1661df260 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:47.771 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.766+0000 7f83c9e14800 1 -- 172.21.15.142:0/182719882 >> 172.21.15.142:0/182719882 conn(0x55a166264db0 msgr2=0x55a16635a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:37:47.771 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.766+0000 7f83c9e14800 1 -- 172.21.15.142:0/182719882 shutdown_connections 2024-09-22T08:37:47.771 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.766+0000 7f83c9e14800 1 -- 172.21.15.142:0/182719882 wait complete. 2024-09-22T08:37:47.775 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-09-22T08:37:47.780 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=0 failed=False 2024-09-22T08:37:47.780 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=8 failed=False 2024-09-22T08:37:47.783 INFO:tasks.radosgw_admin:RL: get_obj myfoo7 fud bytes_out=0 bytes_in=0 failed=False 2024-09-22T08:37:47.783 INFO:tasks.radosgw_admin:RL: get_obj myfoo7 fud bytes_out=0 bytes_in=8 failed=False 2024-09-22T08:37:47.783 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'bud', '--purge-data'] 2024-09-22T08:37:47.784 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'bud', '--purge-data'] 2024-09-22T08:37:47.784 DEBUG:teuthology.orchestra.run.smithi142:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid bud --purge-data 2024-09-22T08:37:47.829 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:37:47.829 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:37:47.831 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.829+0000 7f6c03139800 1 Processor -- start 2024-09-22T08:37:47.831 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.829+0000 7f6c03139800 1 -- start start 2024-09-22T08:37:47.831 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.829+0000 7f6c03139800 1 --2- >> v2:172.21.15.31:3300/0 conn(0x559d29bb1c00 0x559d29bb40c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:47.831 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.829+0000 7f6c03139800 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x559d29a36a20 con 0x559d29b1f530 2024-09-22T08:37:47.831 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.829+0000 7f6c03139800 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x559d29a367d0 con 0x559d29bb1c00 2024-09-22T08:37:47.831 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.829+0000 7f6bfe5c6640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x559d29bb1c00 0x559d29bb40c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:47.831 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.829+0000 7f6bfe5c6640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x559d29bb1c00 0x559d29bb40c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:56088/0 (socket says 172.21.15.142:56088) 2024-09-22T08:37:47.831 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.829+0000 7f6bfe5c6640 1 -- 172.21.15.142:0/2720368681 learned_addr learned my addr 172.21.15.142:0/2720368681 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:37:47.831 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.829+0000 7f6bfe5c6640 1 -- 172.21.15.142:0/2720368681 >> v1:172.21.15.31:6789/0 conn(0x559d29b1f530 legacy=0x559d29bb04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:47.831 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.830+0000 7f6bfe5c6640 1 -- 172.21.15.142:0/2720368681 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d29bb57d0 con 0x559d29bb1c00 2024-09-22T08:37:47.833 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.831+0000 7f6bfe5c6640 1 --2- 172.21.15.142:0/2720368681 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559d29bb1c00 0x559d29bb40c0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f6bf400a520 tx=0x7f6bf4045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce4c12738f71d3fc server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:47.833 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.831+0000 7f6bfddc5640 1 -- 172.21.15.142:0/2720368681 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6bf4055070 con 0x559d29bb1c00 2024-09-22T08:37:47.833 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.832+0000 7f6bfddc5640 1 -- 172.21.15.142:0/2720368681 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6bf40515b0 con 0x559d29bb1c00 2024-09-22T08:37:47.833 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.832+0000 7f6bfddc5640 1 -- 172.21.15.142:0/2720368681 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6bf40518d0 con 0x559d29bb1c00 2024-09-22T08:37:47.834 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.832+0000 7f6c03139800 1 -- 172.21.15.142:0/2720368681 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559d29bb1c00 msgr2=0x559d29bb40c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:47.834 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.832+0000 7f6c03139800 1 --2- 172.21.15.142:0/2720368681 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559d29bb1c00 0x559d29bb40c0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f6bf400a520 tx=0x7f6bf4045ba0 comp rx=0 tx=0).stop 2024-09-22T08:37:47.834 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.832+0000 7f6c03139800 1 -- 172.21.15.142:0/2720368681 shutdown_connections 2024-09-22T08:37:47.834 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.832+0000 7f6c03139800 1 --2- 172.21.15.142:0/2720368681 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559d29bb1c00 0x559d29bb40c0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:47.834 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.832+0000 7f6c03139800 1 -- 172.21.15.142:0/2720368681 >> 172.21.15.142:0/2720368681 conn(0x559d29ba5be0 msgr2=0x559d29ba8020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:37:47.834 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.832+0000 7f6c03139800 1 -- 172.21.15.142:0/2720368681 shutdown_connections 2024-09-22T08:37:47.834 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.832+0000 7f6c03139800 1 -- 172.21.15.142:0/2720368681 wait complete. 2024-09-22T08:37:47.847 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.846+0000 7f6c03139800 1 Processor -- start 2024-09-22T08:37:47.847 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.846+0000 7f6c03139800 1 -- start start 2024-09-22T08:37:47.847 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.846+0000 7f6c03139800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559d29b1f530 0x559d29c9d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:47.848 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.846+0000 7f6c03139800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x559d29a43dd0 con 0x559d29b1f530 2024-09-22T08:37:47.848 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.846+0000 7f6bfedc7640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559d29b1f530 0x559d29c9d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:47.849 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.846+0000 7f6bfedc7640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559d29b1f530 0x559d29c9d1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:56100/0 (socket says 172.21.15.142:56100) 2024-09-22T08:37:47.849 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.846+0000 7f6bfedc7640 1 -- 172.21.15.142:0/3021606804 learned_addr learned my addr 172.21.15.142:0/3021606804 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:37:47.849 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.847+0000 7f6bfedc7640 1 -- 172.21.15.142:0/3021606804 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d29c9d7c0 con 0x559d29b1f530 2024-09-22T08:37:47.849 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.847+0000 7f6bfedc7640 1 --2- 172.21.15.142:0/3021606804 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559d29b1f530 0x559d29c9d1d0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f6bf0001680 tx=0x7f6bf0001b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbe13f6fb295c659 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:47.849 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.847+0000 7f6aece09640 1 -- 172.21.15.142:0/3021606804 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6bf0016070 con 0x559d29b1f530 2024-09-22T08:37:47.849 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.847+0000 7f6aece09640 1 -- 172.21.15.142:0/3021606804 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6bf000f640 con 0x559d29b1f530 2024-09-22T08:37:47.849 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.847+0000 7f6aece09640 1 -- 172.21.15.142:0/3021606804 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6bf000f960 con 0x559d29b1f530 2024-09-22T08:37:47.851 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.848+0000 7f6c03139800 1 -- 172.21.15.142:0/3021606804 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559d29b1f530 msgr2=0x559d29c9d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:47.851 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.848+0000 7f6c03139800 1 --2- 172.21.15.142:0/3021606804 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559d29b1f530 0x559d29c9d1d0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f6bf0001680 tx=0x7f6bf0001b40 comp rx=0 tx=0).stop 2024-09-22T08:37:47.851 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.848+0000 7f6c03139800 1 -- 172.21.15.142:0/3021606804 shutdown_connections 2024-09-22T08:37:47.851 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.848+0000 7f6c03139800 1 --2- 172.21.15.142:0/3021606804 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559d29b1f530 0x559d29c9d1d0 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:47.851 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.848+0000 7f6c03139800 1 -- 172.21.15.142:0/3021606804 >> 172.21.15.142:0/3021606804 conn(0x559d29ba5be0 msgr2=0x559d29c98b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:37:47.851 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.848+0000 7f6c03139800 1 -- 172.21.15.142:0/3021606804 shutdown_connections 2024-09-22T08:37:47.852 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.848+0000 7f6c03139800 1 -- 172.21.15.142:0/3021606804 wait complete. 2024-09-22T08:37:47.852 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.848+0000 7f6c03139800 1 Processor -- start 2024-09-22T08:37:47.852 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.848+0000 7f6c03139800 1 -- start start 2024-09-22T08:37:47.852 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.848+0000 7f6c03139800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559d29b1f530 0x559d29ca4d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:47.852 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.848+0000 7f6c03139800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x559d29bb4a70 con 0x559d29b1f530 2024-09-22T08:37:47.852 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.849+0000 7f6bfedc7640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559d29b1f530 0x559d29ca4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:47.852 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.849+0000 7f6bfedc7640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559d29b1f530 0x559d29ca4d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:56104/0 (socket says 172.21.15.142:56104) 2024-09-22T08:37:47.852 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.849+0000 7f6bfedc7640 1 -- 172.21.15.142:0/797717325 learned_addr learned my addr 172.21.15.142:0/797717325 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:37:47.853 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.849+0000 7f6bfedc7640 1 -- 172.21.15.142:0/797717325 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d29ca52c0 con 0x559d29b1f530 2024-09-22T08:37:47.853 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.849+0000 7f6bfedc7640 1 --2- 172.21.15.142:0/797717325 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559d29b1f530 0x559d29ca4d60 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x559d29c9e160 tx=0x7f6bf0001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:47.853 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.849+0000 7f6aeb606640 1 -- 172.21.15.142:0/797717325 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6bf0021020 con 0x559d29b1f530 2024-09-22T08:37:47.853 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.849+0000 7f6aeb606640 1 -- 172.21.15.142:0/797717325 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6bf00117c0 con 0x559d29b1f530 2024-09-22T08:37:47.853 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.849+0000 7f6c03139800 1 -- 172.21.15.142:0/797717325 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559d29ca5550 con 0x559d29b1f530 2024-09-22T08:37:47.853 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.849+0000 7f6aeb606640 1 -- 172.21.15.142:0/797717325 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6bf0016040 con 0x559d29b1f530 2024-09-22T08:37:47.853 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.849+0000 7f6c03139800 1 -- 172.21.15.142:0/797717325 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559d29ca5f50 con 0x559d29b1f530 2024-09-22T08:37:47.860 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.850+0000 7f6aeb606640 1 -- 172.21.15.142:0/797717325 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f6bf0024020 con 0x559d29b1f530 2024-09-22T08:37:47.860 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.850+0000 7f6aeb606640 1 --2- 172.21.15.142:0/797717325 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f6ae403d000 0x7f6ae403f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:47.860 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.851+0000 7f6aeb606640 1 -- 172.21.15.142:0/797717325 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5938+0+0 (secure 0 0 0) 0x7f6bf0053cc0 con 0x559d29b1f530 2024-09-22T08:37:47.860 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.851+0000 7f6bfe5c6640 1 --2- 172.21.15.142:0/797717325 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f6ae403d000 0x7f6ae403f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:47.860 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.851+0000 7f6c03139800 1 --2- 172.21.15.142:0/797717325 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x559d29bb1c00 0x559d29cac3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:47.860 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.851+0000 7f6c03139800 1 -- 172.21.15.142:0/797717325 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559d29cac8f0 con 0x559d29bb1c00 2024-09-22T08:37:47.860 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.851+0000 7f6bff5c8640 1 --2- 172.21.15.142:0/797717325 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x559d29bb1c00 0x559d29cac3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:47.860 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.851+0000 7f6bfe5c6640 1 --2- 172.21.15.142:0/797717325 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f6ae403d000 0x7f6ae403f4c0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f6bf4057000 tx=0x7f6bf4052000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:47.860 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.851+0000 7f6bff5c8640 1 --2- 172.21.15.142:0/797717325 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x559d29bb1c00 0x559d29cac3b0 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:47.860 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.852+0000 7f6bff5c8640 1 -- 172.21.15.142:0/797717325 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6bf80083e0 con 0x559d29bb1c00 2024-09-22T08:37:47.860 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.852+0000 7f6c03139800 1 -- 172.21.15.142:0/797717325 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559d29cacc90 con 0x559d29bb1c00 2024-09-22T08:37:47.860 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.852+0000 7f6bff5c8640 1 -- 172.21.15.142:0/797717325 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6bf80083e0 con 0x559d29bb1c00 2024-09-22T08:37:47.861 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.852+0000 7f6c03139800 1 --2- 172.21.15.142:0/797717325 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x559d29cae750 0x559d29cb0bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:47.861 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.852+0000 7f6c03139800 1 -- 172.21.15.142:0/797717325 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:3 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559d29cb1380 con 0x559d29cae750 2024-09-22T08:37:47.861 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.852+0000 7f6bfedc7640 1 --2- 172.21.15.142:0/797717325 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x559d29cae750 0x559d29cb0bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:47.861 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.852+0000 7f6bfedc7640 1 --2- 172.21.15.142:0/797717325 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x559d29cae750 0x559d29cb0bf0 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:47.861 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.853+0000 7f6bfedc7640 1 -- 172.21.15.142:0/797717325 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(3 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f6bf000f070 con 0x559d29cae750 2024-09-22T08:37:47.861 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.853+0000 7f6c03139800 1 -- 172.21.15.142:0/797717325 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559d29cad4e0 con 0x559d29bb1c00 2024-09-22T08:37:47.861 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.853+0000 7f6bff5c8640 1 -- 172.21.15.142:0/797717325 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6bf80083e0 con 0x559d29bb1c00 2024-09-22T08:37:47.861 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.853+0000 7f6c03139800 1 -- 172.21.15.142:0/797717325 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559d29cad910 con 0x559d29cae750 2024-09-22T08:37:47.861 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.853+0000 7f6bfedc7640 1 -- 172.21.15.142:0/797717325 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(5 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f6bf000f070 con 0x559d29cae750 2024-09-22T08:37:47.861 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.853+0000 7f6c03139800 1 Processor -- start 2024-09-22T08:37:47.861 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.854+0000 7f6c03139800 1 -- start start 2024-09-22T08:37:47.861 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.854+0000 7f6c03139800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559d29cbfda0 0x559d29cc01c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:47.861 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.854+0000 7f6c03139800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x559d29aa2d50 con 0x559d29cbfda0 2024-09-22T08:37:47.862 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.854+0000 7f6bff5c8640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559d29cbfda0 0x559d29cc01c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:47.862 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.854+0000 7f6bff5c8640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559d29cbfda0 0x559d29cc01c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:56114/0 (socket says 172.21.15.142:56114) 2024-09-22T08:37:47.862 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.854+0000 7f6bff5c8640 1 -- 172.21.15.142:0/3862701450 learned_addr learned my addr 172.21.15.142:0/3862701450 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:37:47.862 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.854+0000 7f6bff5c8640 1 -- 172.21.15.142:0/3862701450 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d29cc0800 con 0x559d29cbfda0 2024-09-22T08:37:47.862 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.854+0000 7f6bff5c8640 1 --2- 172.21.15.142:0/3862701450 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559d29cbfda0 0x559d29cc01c0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x559d29ca5bf0 tx=0x7f6bf800bf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:47.862 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.855+0000 7f6ae8e01640 1 -- 172.21.15.142:0/3862701450 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6bf801c020 con 0x559d29cbfda0 2024-09-22T08:37:47.862 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.855+0000 7f6ae8e01640 1 -- 172.21.15.142:0/3862701450 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6bf8007c90 con 0x559d29cbfda0 2024-09-22T08:37:47.862 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.855+0000 7f6c03139800 1 -- 172.21.15.142:0/3862701450 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559d29cc1030 con 0x559d29cbfda0 2024-09-22T08:37:47.862 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.855+0000 7f6ae8e01640 1 -- 172.21.15.142:0/3862701450 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6bf8018440 con 0x559d29cbfda0 2024-09-22T08:37:47.862 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.855+0000 7f6c03139800 1 -- 172.21.15.142:0/3862701450 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559d29cc15d0 con 0x559d29cbfda0 2024-09-22T08:37:47.862 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.855+0000 7f6ae8e01640 1 -- 172.21.15.142:0/3862701450 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f6bf801f020 con 0x559d29cbfda0 2024-09-22T08:37:47.862 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.856+0000 7f6ae8e01640 1 --2- 172.21.15.142:0/3862701450 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f6ad803d000 0x7f6ad803f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:47.863 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.856+0000 7f6ae8e01640 1 -- 172.21.15.142:0/3862701450 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5938+0+0 (secure 0 0 0) 0x7f6bf8055960 con 0x559d29cbfda0 2024-09-22T08:37:47.863 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.856+0000 7f6bfedc7640 1 --2- 172.21.15.142:0/3862701450 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f6ad803d000 0x7f6ad803f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:47.863 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.856+0000 7f6c03139800 1 Processor -- start 2024-09-22T08:37:47.863 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.856+0000 7f6bfedc7640 1 --2- 172.21.15.142:0/3862701450 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f6ad803d000 0x7f6ad803f4c0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x559d29ca6eb0 tx=0x7f6bf0025e80 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:47.863 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.856+0000 7f6c03139800 1 -- start start 2024-09-22T08:37:47.863 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.856+0000 7f6c03139800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559d29ccc860 0x559d29cccc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:47.863 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.856+0000 7f6c03139800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x559d29c9dbf0 con 0x559d29ccc860 2024-09-22T08:37:47.863 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.856+0000 7f6bff5c8640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559d29ccc860 0x559d29cccc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:47.863 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.856+0000 7f6bff5c8640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559d29ccc860 0x559d29cccc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:56120/0 (socket says 172.21.15.142:56120) 2024-09-22T08:37:47.863 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.856+0000 7f6bff5c8640 1 -- 172.21.15.142:0/722396747 learned_addr learned my addr 172.21.15.142:0/722396747 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:37:47.863 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.857+0000 7f6bff5c8640 1 -- 172.21.15.142:0/722396747 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d29ccd250 con 0x559d29ccc860 2024-09-22T08:37:47.863 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.857+0000 7f6bff5c8640 1 --2- 172.21.15.142:0/722396747 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559d29ccc860 0x559d29cccc60 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f6bf8053d80 tx=0x7f6bf80153e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3afec5a6ecca5716 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:47.863 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.857+0000 7f6ae27fc640 1 -- 172.21.15.142:0/722396747 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6bf804a070 con 0x559d29ccc860 2024-09-22T08:37:47.864 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.857+0000 7f6ae27fc640 1 -- 172.21.15.142:0/722396747 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6bf80174d0 con 0x559d29ccc860 2024-09-22T08:37:47.864 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.857+0000 7f6ae27fc640 1 -- 172.21.15.142:0/722396747 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6bf8052070 con 0x559d29ccc860 2024-09-22T08:37:47.864 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.857+0000 7f6c03139800 1 -- 172.21.15.142:0/722396747 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559d29ccc860 msgr2=0x559d29cccc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:47.864 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.857+0000 7f6c03139800 1 --2- 172.21.15.142:0/722396747 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559d29ccc860 0x559d29cccc60 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f6bf8053d80 tx=0x7f6bf80153e0 comp rx=0 tx=0).stop 2024-09-22T08:37:47.864 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.858+0000 7f6c03139800 1 -- 172.21.15.142:0/722396747 shutdown_connections 2024-09-22T08:37:47.864 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.858+0000 7f6c03139800 1 --2- 172.21.15.142:0/722396747 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559d29ccc860 0x559d29cccc60 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:47.864 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.858+0000 7f6c03139800 1 -- 172.21.15.142:0/722396747 >> 172.21.15.142:0/722396747 conn(0x559d29cc8c60 msgr2=0x559d29cc6ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:37:47.864 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.858+0000 7f6c03139800 1 -- 172.21.15.142:0/722396747 shutdown_connections 2024-09-22T08:37:47.864 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.858+0000 7f6c03139800 1 -- 172.21.15.142:0/722396747 wait complete. 2024-09-22T08:37:47.864 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.858+0000 7f6c03139800 1 Processor -- start 2024-09-22T08:37:47.864 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.858+0000 7f6c03139800 1 -- start start 2024-09-22T08:37:47.864 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.858+0000 7f6c03139800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559d29ccc860 0x559d29cd3e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:47.864 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.858+0000 7f6c03139800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x559d29ccd870 con 0x559d29ccc860 2024-09-22T08:37:47.865 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.858+0000 7f6bff5c8640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559d29ccc860 0x559d29cd3e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:47.865 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.858+0000 7f6bff5c8640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559d29ccc860 0x559d29cd3e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:56136/0 (socket says 172.21.15.142:56136) 2024-09-22T08:37:47.865 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.858+0000 7f6bff5c8640 1 -- 172.21.15.142:0/2654175921 learned_addr learned my addr 172.21.15.142:0/2654175921 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:37:47.865 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.859+0000 7f6bff5c8640 1 -- 172.21.15.142:0/2654175921 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d29cd43c0 con 0x559d29ccc860 2024-09-22T08:37:47.877 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.859+0000 7f6bff5c8640 1 --2- 172.21.15.142:0/2654175921 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559d29ccc860 0x559d29cd3e60 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f6bf80540f0 tx=0x7f6bf8053ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:47.877 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.859+0000 7f6ae0ff9640 1 -- 172.21.15.142:0/2654175921 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6bf8030020 con 0x559d29ccc860 2024-09-22T08:37:47.877 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.859+0000 7f6ae0ff9640 1 -- 172.21.15.142:0/2654175921 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6bf804b040 con 0x559d29ccc860 2024-09-22T08:37:47.877 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.859+0000 7f6c03139800 1 -- 172.21.15.142:0/2654175921 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559d29cd4650 con 0x559d29ccc860 2024-09-22T08:37:47.877 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.859+0000 7f6ae0ff9640 1 -- 172.21.15.142:0/2654175921 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6bf804a050 con 0x559d29ccc860 2024-09-22T08:37:47.877 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.859+0000 7f6c03139800 1 -- 172.21.15.142:0/2654175921 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559d29cd4fd0 con 0x559d29ccc860 2024-09-22T08:37:47.877 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.860+0000 7f6ae0ff9640 1 -- 172.21.15.142:0/2654175921 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f6bf8033020 con 0x559d29ccc860 2024-09-22T08:37:47.877 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.860+0000 7f6ae0ff9640 1 --2- 172.21.15.142:0/2654175921 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f6ac803cfb0 0x7f6ac803f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:47.877 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.860+0000 7f6ae0ff9640 1 -- 172.21.15.142:0/2654175921 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5938+0+0 (secure 0 0 0) 0x7f6bf8036be0 con 0x559d29ccc860 2024-09-22T08:37:47.877 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.860+0000 7f6bfedc7640 1 --2- 172.21.15.142:0/2654175921 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f6ac803cfb0 0x7f6ac803f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:47.878 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.860+0000 7f6bfedc7640 1 --2- 172.21.15.142:0/2654175921 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f6ac803cfb0 0x7f6ac803f470 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f6bf0010550 tx=0x7f6bf0043000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:47.878 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.861+0000 7f6c03139800 20 rados->read ofs=0 len=0 2024-09-22T08:37:47.878 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.861+0000 7f6c03139800 1 --2- 172.21.15.142:0/2654175921 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x559d29cdf7e0 0x559d29ce1ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:47.878 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.861+0000 7f6c03139800 1 -- 172.21.15.142:0/2654175921 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559d29ce23f0 con 0x559d29cdf7e0 2024-09-22T08:37:47.878 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.861+0000 7f6bfe5c6640 1 --2- 172.21.15.142:0/2654175921 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x559d29cdf7e0 0x559d29ce1ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:47.878 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.861+0000 7f6bfe5c6640 1 --2- 172.21.15.142:0/2654175921 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x559d29cdf7e0 0x559d29ce1ca0 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:47.878 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.861+0000 7f6bfe5c6640 1 -- 172.21.15.142:0/2654175921 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6bf4057030 con 0x559d29cdf7e0 2024-09-22T08:37:47.879 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.861+0000 7f6c03139800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:47.879 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.861+0000 7f6c03139800 20 realm 2024-09-22T08:37:47.879 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.861+0000 7f6c03139800 20 rados->read ofs=0 len=0 2024-09-22T08:37:47.879 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.861+0000 7f6c03139800 1 -- 172.21.15.142:0/2654175921 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559d29ce2820 con 0x559d29cdf7e0 2024-09-22T08:37:47.879 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.862+0000 7f6bfe5c6640 1 -- 172.21.15.142:0/2654175921 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6bf4057030 con 0x559d29cdf7e0 2024-09-22T08:37:47.880 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.862+0000 7f6c03139800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:47.880 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.862+0000 7f6c03139800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:37:47.880 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.862+0000 7f6c03139800 20 rados->read ofs=0 len=0 2024-09-22T08:37:47.880 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.862+0000 7f6c03139800 1 -- 172.21.15.142:0/2654175921 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559d29ce30f0 con 0x559d29cdf7e0 2024-09-22T08:37:47.880 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.862+0000 7f6bfe5c6640 1 -- 172.21.15.142:0/2654175921 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6bf4057030 con 0x559d29cdf7e0 2024-09-22T08:37:47.880 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.862+0000 7f6c03139800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:47.880 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.862+0000 7f6c03139800 20 rados->read ofs=0 len=0 2024-09-22T08:37:47.881 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.862+0000 7f6c03139800 1 -- 172.21.15.142:0/2654175921 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559d29ce3490 con 0x559d29cdf7e0 2024-09-22T08:37:47.881 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.862+0000 7f6bfe5c6640 1 -- 172.21.15.142:0/2654175921 <== osd.1 v2:172.21.15.142:6816/3192108003 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6bf4057030 con 0x559d29cdf7e0 2024-09-22T08:37:47.881 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.862+0000 7f6c03139800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:37:47.881 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.862+0000 7f6c03139800 20 rados->read ofs=0 len=0 2024-09-22T08:37:47.881 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.862+0000 7f6c03139800 1 --2- 172.21.15.142:0/2654175921 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x559d29ce41f0 0x559d29ce65e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:47.881 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.862+0000 7f6c03139800 1 -- 172.21.15.142:0/2654175921 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559d29ce6bf0 con 0x559d29ce41f0 2024-09-22T08:37:47.881 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.862+0000 7f6bff5c8640 1 --2- 172.21.15.142:0/2654175921 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x559d29ce41f0 0x559d29ce65e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:47.881 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.863+0000 7f6bff5c8640 1 --2- 172.21.15.142:0/2654175921 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x559d29ce41f0 0x559d29ce65e0 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:47.882 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.863+0000 7f6bff5c8640 1 -- 172.21.15.142:0/2654175921 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(5 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f6bf804d070 con 0x559d29ce41f0 2024-09-22T08:37:47.882 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.863+0000 7f6c03139800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:37:47.882 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.863+0000 7f6c03139800 20 searching for the correct realm 2024-09-22T08:37:47.882 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.863+0000 7f6c03139800 1 -- 172.21.15.142:0/2654175921 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559d29ce8540 con 0x559d29ce41f0 2024-09-22T08:37:47.882 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.863+0000 7f6bff5c8640 1 -- 172.21.15.142:0/2654175921 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6bf804d070 con 0x559d29ce41f0 2024-09-22T08:37:47.882 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.863+0000 7f6bff5c8640 1 --2- 172.21.15.142:0/2654175921 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f6bf8040040 0x7f6bf8037a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:47.882 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.863+0000 7f6bff5c8640 1 -- 172.21.15.142:0/2654175921 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559d29ce8540 con 0x7f6bf8040040 2024-09-22T08:37:47.882 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.863+0000 7f6bfedc7640 1 --2- 172.21.15.142:0/2654175921 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f6bf8040040 0x7f6bf8037a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:47.883 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.864+0000 7f6bfedc7640 1 --2- 172.21.15.142:0/2654175921 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f6bf8040040 0x7f6bf8037a90 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:47.883 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.864+0000 7f6bfedc7640 1 -- 172.21.15.142:0/2654175921 <== osd.2 v2:172.21.15.142:6808/279438927 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6bf000f070 con 0x7f6bf8040040 2024-09-22T08:37:47.883 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.864+0000 7f6bfedc7640 1 --2- 172.21.15.142:0/2654175921 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f6bf0031040 0x7f6bf0032430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:47.883 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.864+0000 7f6bfedc7640 1 -- 172.21.15.142:0/2654175921 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559d29ce8540 con 0x7f6bf0031040 2024-09-22T08:37:47.883 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.864+0000 7f6bfe5c6640 1 --2- 172.21.15.142:0/2654175921 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f6bf0031040 0x7f6bf0032430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:47.883 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.865+0000 7f6bfe5c6640 1 --2- 172.21.15.142:0/2654175921 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f6bf0031040 0x7f6bf0032430 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:47.883 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.865+0000 7f6bfe5c6640 1 -- 172.21.15.142:0/2654175921 <== osd.0 v2:172.21.15.31:6800/168281188 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6bf4057030 con 0x7f6bf0031040 2024-09-22T08:37:47.883 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.865+0000 7f6bfe5c6640 1 -- 172.21.15.142:0/2654175921 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559d29ce8540 con 0x559d29cdf7e0 2024-09-22T08:37:47.884 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.865+0000 7f6bfe5c6640 1 -- 172.21.15.142:0/2654175921 <== osd.1 v2:172.21.15.142:6816/3192108003 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6bf4057030 con 0x559d29cdf7e0 2024-09-22T08:37:47.884 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.865+0000 7f6bfe5c6640 1 -- 172.21.15.142:0/2654175921 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559d29ce8540 con 0x559d29cdf7e0 2024-09-22T08:37:47.884 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.865+0000 7f6bfe5c6640 1 -- 172.21.15.142:0/2654175921 <== osd.1 v2:172.21.15.142:6816/3192108003 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6bf4057030 con 0x559d29cdf7e0 2024-09-22T08:37:47.884 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.865+0000 7f6bfe5c6640 1 -- 172.21.15.142:0/2654175921 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559d29ce8540 con 0x559d29cdf7e0 2024-09-22T08:37:47.884 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.866+0000 7f6bfe5c6640 1 -- 172.21.15.142:0/2654175921 <== osd.1 v2:172.21.15.142:6816/3192108003 7 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6bf4057030 con 0x559d29cdf7e0 2024-09-22T08:37:47.884 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.866+0000 7f6bfe5c6640 1 -- 172.21.15.142:0/2654175921 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559d29ce8540 con 0x7f6bf0031040 2024-09-22T08:37:47.884 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.866+0000 7f6bfe5c6640 1 -- 172.21.15.142:0/2654175921 <== osd.0 v2:172.21.15.31:6800/168281188 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6bf4057030 con 0x7f6bf0031040 2024-09-22T08:37:47.884 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.866+0000 7f6bfe5c6640 1 -- 172.21.15.142:0/2654175921 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559d29ce8540 con 0x7f6bf8040040 2024-09-22T08:37:47.885 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.866+0000 7f6bfedc7640 1 -- 172.21.15.142:0/2654175921 <== osd.2 v2:172.21.15.142:6808/279438927 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6bf000f070 con 0x7f6bf8040040 2024-09-22T08:37:47.885 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.866+0000 7f6bfedc7640 1 -- 172.21.15.142:0/2654175921 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559d29ce8540 con 0x559d29ce41f0 2024-09-22T08:37:47.885 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.866+0000 7f6bff5c8640 1 -- 172.21.15.142:0/2654175921 <== osd.3 v2:172.21.15.142:6800/1064901393 3 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6bf804d070 con 0x559d29ce41f0 2024-09-22T08:37:47.885 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.866+0000 7f6bff5c8640 1 -- 172.21.15.142:0/2654175921 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559d29ce8540 con 0x559d29cdf7e0 2024-09-22T08:37:47.885 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.867+0000 7f6bfe5c6640 1 -- 172.21.15.142:0/2654175921 <== osd.1 v2:172.21.15.142:6816/3192108003 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6bf4057030 con 0x559d29cdf7e0 2024-09-22T08:37:47.885 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.867+0000 7f6bfe5c6640 1 -- 172.21.15.142:0/2654175921 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559d29ce8540 con 0x7f6bf0031040 2024-09-22T08:37:47.885 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.867+0000 7f6bfe5c6640 1 -- 172.21.15.142:0/2654175921 <== osd.0 v2:172.21.15.31:6800/168281188 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6bf4057030 con 0x7f6bf0031040 2024-09-22T08:37:47.885 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.867+0000 7f6bfe5c6640 1 -- 172.21.15.142:0/2654175921 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559d29ce8540 con 0x559d29cdf7e0 2024-09-22T08:37:47.886 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.867+0000 7f6bfe5c6640 1 -- 172.21.15.142:0/2654175921 <== osd.1 v2:172.21.15.142:6816/3192108003 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6bf4057030 con 0x559d29cdf7e0 2024-09-22T08:37:47.886 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.867+0000 7f6bfe5c6640 1 -- 172.21.15.142:0/2654175921 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559d29ce8540 con 0x7f6bf8040040 2024-09-22T08:37:47.886 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.867+0000 7f6bfedc7640 1 -- 172.21.15.142:0/2654175921 <== osd.2 v2:172.21.15.142:6808/279438927 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f6bf000f070 con 0x7f6bf8040040 2024-09-22T08:37:47.886 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.868+0000 7f6bfedc7640 1 -- 172.21.15.142:0/2654175921 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559d29ce8540 con 0x559d29ce41f0 2024-09-22T08:37:47.886 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.868+0000 7f6bff5c8640 1 -- 172.21.15.142:0/2654175921 <== osd.3 v2:172.21.15.142:6800/1064901393 4 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6bf804d070 con 0x559d29ce41f0 2024-09-22T08:37:47.886 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.868+0000 7f6bff5c8640 1 -- 172.21.15.142:0/2654175921 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559d29ce8540 con 0x559d29ce41f0 2024-09-22T08:37:47.886 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.868+0000 7f6bff5c8640 1 -- 172.21.15.142:0/2654175921 <== osd.3 v2:172.21.15.142:6800/1064901393 5 ==== osd_op_reply(20 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f6bf804d070 con 0x559d29ce41f0 2024-09-22T08:37:47.887 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.868+0000 7f6bff5c8640 1 -- 172.21.15.142:0/2654175921 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559d29ce8540 con 0x7f6bf0031040 2024-09-22T08:37:47.887 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.868+0000 7f6bfe5c6640 1 -- 172.21.15.142:0/2654175921 <== osd.0 v2:172.21.15.31:6800/168281188 4 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6bf4057030 con 0x7f6bf0031040 2024-09-22T08:37:47.887 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.868+0000 7f6bfe5c6640 1 -- 172.21.15.142:0/2654175921 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559d29ce8540 con 0x559d29ce41f0 2024-09-22T08:37:47.887 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.868+0000 7f6bff5c8640 1 -- 172.21.15.142:0/2654175921 <== osd.3 v2:172.21.15.142:6800/1064901393 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6bf804d070 con 0x559d29ce41f0 2024-09-22T08:37:47.887 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.868+0000 7f6bff5c8640 1 -- 172.21.15.142:0/2654175921 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559d29ce8540 con 0x559d29ce41f0 2024-09-22T08:37:47.887 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.869+0000 7f6bff5c8640 1 -- 172.21.15.142:0/2654175921 <== osd.3 v2:172.21.15.142:6800/1064901393 7 ==== osd_op_reply(23 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f6bf804d070 con 0x559d29ce41f0 2024-09-22T08:37:47.887 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.869+0000 7f6bff5c8640 1 -- 172.21.15.142:0/2654175921 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559d29ce8540 con 0x559d29cdf7e0 2024-09-22T08:37:47.887 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.869+0000 7f6bfe5c6640 1 -- 172.21.15.142:0/2654175921 <== osd.1 v2:172.21.15.142:6816/3192108003 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6bf4057030 con 0x559d29cdf7e0 2024-09-22T08:37:47.888 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.869+0000 7f6bfe5c6640 1 -- 172.21.15.142:0/2654175921 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559d29ce8540 con 0x559d29cdf7e0 2024-09-22T08:37:47.888 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.869+0000 7f6bfe5c6640 1 -- 172.21.15.142:0/2654175921 <== osd.1 v2:172.21.15.142:6816/3192108003 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f6bf4057030 con 0x559d29cdf7e0 2024-09-22T08:37:47.888 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.869+0000 7f6bfe5c6640 1 -- 172.21.15.142:0/2654175921 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559d29ce8540 con 0x7f6bf0031040 2024-09-22T08:37:47.888 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.870+0000 7f6bfe5c6640 1 -- 172.21.15.142:0/2654175921 <== osd.0 v2:172.21.15.31:6800/168281188 5 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6bf4057030 con 0x7f6bf0031040 2024-09-22T08:37:47.888 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.870+0000 7f6bfe5c6640 1 -- 172.21.15.142:0/2654175921 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559d29ce8540 con 0x559d29ce41f0 2024-09-22T08:37:47.888 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.870+0000 7f6bff5c8640 1 -- 172.21.15.142:0/2654175921 <== osd.3 v2:172.21.15.142:6800/1064901393 8 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6bf804d070 con 0x559d29ce41f0 2024-09-22T08:37:47.888 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.870+0000 7f6bff5c8640 1 -- 172.21.15.142:0/2654175921 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559d29ce8540 con 0x7f6bf8040040 2024-09-22T08:37:47.888 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.870+0000 7f6bfedc7640 1 -- 172.21.15.142:0/2654175921 <== osd.2 v2:172.21.15.142:6808/279438927 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6bf000f070 con 0x7f6bf8040040 2024-09-22T08:37:47.889 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.870+0000 7f6bfedc7640 1 -- 172.21.15.142:0/2654175921 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559d29ce8540 con 0x559d29cdf7e0 2024-09-22T08:37:47.889 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.870+0000 7f6bfe5c6640 1 -- 172.21.15.142:0/2654175921 <== osd.1 v2:172.21.15.142:6816/3192108003 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6bf4057030 con 0x559d29cdf7e0 2024-09-22T08:37:47.889 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.870+0000 7f6bfe5c6640 1 -- 172.21.15.142:0/2654175921 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559d29ce8540 con 0x7f6bf0031040 2024-09-22T08:37:47.889 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.871+0000 7f6bfe5c6640 1 -- 172.21.15.142:0/2654175921 <== osd.0 v2:172.21.15.31:6800/168281188 6 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6bf4057030 con 0x7f6bf0031040 2024-09-22T08:37:47.889 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.871+0000 7f6bfe5c6640 1 -- 172.21.15.142:0/2654175921 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559d29ce8540 con 0x559d29ce41f0 2024-09-22T08:37:47.889 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.871+0000 7f6bff5c8640 1 -- 172.21.15.142:0/2654175921 <== osd.3 v2:172.21.15.142:6800/1064901393 9 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6bf804d070 con 0x559d29ce41f0 2024-09-22T08:37:47.889 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.871+0000 7f6bff5c8640 1 -- 172.21.15.142:0/2654175921 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559d29ce8540 con 0x7f6bf0031040 2024-09-22T08:37:47.890 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.871+0000 7f6bfe5c6640 1 -- 172.21.15.142:0/2654175921 <== osd.0 v2:172.21.15.31:6800/168281188 7 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6bf4057030 con 0x7f6bf0031040 2024-09-22T08:37:47.890 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.871+0000 7f6bfe5c6640 1 -- 172.21.15.142:0/2654175921 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559d29ce8540 con 0x7f6bf8040040 2024-09-22T08:37:47.890 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.871+0000 7f6bfedc7640 1 -- 172.21.15.142:0/2654175921 <== osd.2 v2:172.21.15.142:6808/279438927 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6bf000f070 con 0x7f6bf8040040 2024-09-22T08:37:47.890 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.872+0000 7f6bfedc7640 1 -- 172.21.15.142:0/2654175921 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559d29ce8540 con 0x559d29ce41f0 2024-09-22T08:37:47.890 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.872+0000 7f6bff5c8640 1 -- 172.21.15.142:0/2654175921 <== osd.3 v2:172.21.15.142:6800/1064901393 10 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6bf804d070 con 0x559d29ce41f0 2024-09-22T08:37:47.890 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.872+0000 7f6bff5c8640 1 -- 172.21.15.142:0/2654175921 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559d29ce8540 con 0x7f6bf0031040 2024-09-22T08:37:47.890 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.872+0000 7f6bfe5c6640 1 -- 172.21.15.142:0/2654175921 <== osd.0 v2:172.21.15.31:6800/168281188 8 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6bf4057030 con 0x7f6bf0031040 2024-09-22T08:37:47.890 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.872+0000 7f6bfe5c6640 1 -- 172.21.15.142:0/2654175921 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559d29ce8540 con 0x559d29cdf7e0 2024-09-22T08:37:47.891 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.872+0000 7f6bfe5c6640 1 -- 172.21.15.142:0/2654175921 <== osd.1 v2:172.21.15.142:6816/3192108003 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f6bf4057030 con 0x559d29cdf7e0 2024-09-22T08:37:47.891 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.872+0000 7f6bfe5c6640 1 -- 172.21.15.142:0/2654175921 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559d29ce8540 con 0x7f6bf8040040 2024-09-22T08:37:47.891 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.873+0000 7f6bfedc7640 1 -- 172.21.15.142:0/2654175921 <== osd.2 v2:172.21.15.142:6808/279438927 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6bf000f070 con 0x7f6bf8040040 2024-09-22T08:37:47.891 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.873+0000 7f6c03139800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:37:47.891 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.873+0000 7f6c03139800 20 RGWRados::pool_iterate: got zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec 2024-09-22T08:37:47.891 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.873+0000 7f6c03139800 20 RGWRados::pool_iterate: got zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f 2024-09-22T08:37:47.891 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.873+0000 7f6c03139800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:37:47.891 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.873+0000 7f6c03139800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:37:47.892 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.873+0000 7f6c03139800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:37:47.892 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.873+0000 7f6c03139800 20 rados->read ofs=0 len=0 2024-09-22T08:37:47.892 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.873+0000 7f6c03139800 1 -- 172.21.15.142:0/2654175921 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559d29ce75e0 con 0x559d29cdf7e0 2024-09-22T08:37:47.892 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.873+0000 7f6bfe5c6640 1 -- 172.21.15.142:0/2654175921 <== osd.1 v2:172.21.15.142:6816/3192108003 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6bf4057030 con 0x559d29cdf7e0 2024-09-22T08:37:47.892 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.873+0000 7f6c03139800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:47.892 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.873+0000 7f6c03139800 20 rados->read ofs=0 len=0 2024-09-22T08:37:47.892 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.873+0000 7f6c03139800 1 -- 172.21.15.142:0/2654175921 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559d29ce7e30 con 0x559d29cdf7e0 2024-09-22T08:37:47.893 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.873+0000 7f6bfe5c6640 1 -- 172.21.15.142:0/2654175921 <== osd.1 v2:172.21.15.142:6816/3192108003 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6bf4057030 con 0x559d29cdf7e0 2024-09-22T08:37:47.893 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.873+0000 7f6c03139800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:37:47.893 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.873+0000 7f6c03139800 20 rados->read ofs=0 len=0 2024-09-22T08:37:47.893 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.873+0000 7f6c03139800 1 -- 172.21.15.142:0/2654175921 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:40 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559d29ce89c0 con 0x559d29ce41f0 2024-09-22T08:37:47.893 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.873+0000 7f6bff5c8640 1 -- 172.21.15.142:0/2654175921 <== osd.3 v2:172.21.15.142:6800/1064901393 11 ==== osd_op_reply(40 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f6bf804d070 con 0x559d29ce41f0 2024-09-22T08:37:47.893 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.873+0000 7f6c03139800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:37:47.893 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.873+0000 7f6c03139800 20 zone default found 2024-09-22T08:37:47.893 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.873+0000 7f6c03139800 4 Realm: () 2024-09-22T08:37:47.894 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.873+0000 7f6c03139800 4 ZoneGroup: default (d89f6f57-1007-47dd-9065-f486c7b01aec) 2024-09-22T08:37:47.894 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.873+0000 7f6c03139800 4 Zone: default (e239248c-0bee-4e41-803a-24b288d3eb8f) 2024-09-22T08:37:47.894 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.873+0000 7f6c03139800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:37:47.894 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.873+0000 7f6c03139800 20 zonegroup default 2024-09-22T08:37:47.894 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.874+0000 7f6c03139800 20 rados->read ofs=0 len=0 2024-09-22T08:37:47.894 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.874+0000 7f6c03139800 1 -- 172.21.15.142:0/2654175921 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559d29ce8dc0 con 0x7f6bf0031040 2024-09-22T08:37:47.894 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.874+0000 7f6bfe5c6640 1 -- 172.21.15.142:0/2654175921 <== osd.0 v2:172.21.15.31:6800/168281188 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f6bf4057030 con 0x7f6bf0031040 2024-09-22T08:37:47.895 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.874+0000 7f6c03139800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:47.895 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.874+0000 7f6c03139800 20 rados->read ofs=0 len=0 2024-09-22T08:37:47.895 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.874+0000 7f6c03139800 1 -- 172.21.15.142:0/2654175921 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559d29ceb0a0 con 0x559d29ce41f0 2024-09-22T08:37:47.895 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.874+0000 7f6bff5c8640 1 -- 172.21.15.142:0/2654175921 <== osd.3 v2:172.21.15.142:6800/1064901393 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6bf804d070 con 0x559d29ce41f0 2024-09-22T08:37:47.895 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.874+0000 7f6c03139800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:47.895 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.874+0000 7f6c03139800 20 rados->read ofs=0 len=0 2024-09-22T08:37:47.895 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.874+0000 7f6c03139800 1 -- 172.21.15.142:0/2654175921 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559d29ceb440 con 0x559d29ce41f0 2024-09-22T08:37:47.896 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.874+0000 7f6bff5c8640 1 -- 172.21.15.142:0/2654175921 <== osd.3 v2:172.21.15.142:6800/1064901393 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6bf804d070 con 0x559d29ce41f0 2024-09-22T08:37:47.896 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.874+0000 7f6c03139800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:47.896 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.874+0000 7f6c03139800 20 started sync module instance, tier type = 2024-09-22T08:37:47.896 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.874+0000 7f6c03139800 20 started zone id=e239248c-0bee-4e41-803a-24b288d3eb8f (name=default) with tier type = 2024-09-22T08:37:47.896 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.874+0000 7f6c03139800 1 -- 172.21.15.142:0/2654175921 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559d29cea4e0 con 0x7f6bf8040040 2024-09-22T08:37:47.896 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.875+0000 7f6bfedc7640 1 -- 172.21.15.142:0/2654175921 <== osd.2 v2:172.21.15.142:6808/279438927 7 ==== osd_op_reply(44 notify.0 [create] v32'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6bf000f070 con 0x7f6bf8040040 2024-09-22T08:37:47.896 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.876+0000 7f6c03139800 1 -- 172.21.15.142:0/2654175921 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94133499633712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559d29ceb870 con 0x7f6bf8040040 2024-09-22T08:37:47.896 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.876+0000 7f6c03139800 1 -- 172.21.15.142:0/2654175921 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559d29cec0c0 con 0x559d29cdf7e0 2024-09-22T08:37:47.906 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.877+0000 7f6bfedc7640 1 -- 172.21.15.142:0/2654175921 <== osd.2 v2:172.21.15.142:6808/279438927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94133499633712] v32'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6bf000f070 con 0x7f6bf8040040 2024-09-22T08:37:47.907 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.877+0000 7f6bfe5c6640 1 -- 172.21.15.142:0/2654175921 <== osd.1 v2:172.21.15.142:6816/3192108003 16 ==== osd_op_reply(46 notify.1 [create] v32'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6bf4057030 con 0x559d29cdf7e0 2024-09-22T08:37:47.907 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.877+0000 7f6c03139800 1 -- 172.21.15.142:0/2654175921 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94133499640848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559d29cec4e0 con 0x559d29cdf7e0 2024-09-22T08:37:47.907 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.877+0000 7f6c03139800 1 -- 172.21.15.142:0/2654175921 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559d29cecd30 con 0x559d29ce41f0 2024-09-22T08:37:47.907 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.878+0000 7f6bff5c8640 1 -- 172.21.15.142:0/2654175921 <== osd.3 v2:172.21.15.142:6800/1064901393 14 ==== osd_op_reply(48 notify.2 [create] v32'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6bf804d070 con 0x559d29ce41f0 2024-09-22T08:37:47.907 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.878+0000 7f6c03139800 1 -- 172.21.15.142:0/2654175921 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94133499643584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559d29ced1e0 con 0x559d29ce41f0 2024-09-22T08:37:47.907 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.878+0000 7f6c03139800 1 -- 172.21.15.142:0/2654175921 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559d29cedd00 con 0x7f6bf8040040 2024-09-22T08:37:47.907 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.878+0000 7f6bfe5c6640 1 -- 172.21.15.142:0/2654175921 <== osd.1 v2:172.21.15.142:6816/3192108003 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94133499640848] v32'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6bf4057030 con 0x559d29cdf7e0 2024-09-22T08:37:47.907 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.879+0000 7f6bff5c8640 1 -- 172.21.15.142:0/2654175921 <== osd.3 v2:172.21.15.142:6800/1064901393 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94133499643584] v32'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6bf804d070 con 0x559d29ce41f0 2024-09-22T08:37:47.907 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.879+0000 7f6bfedc7640 1 -- 172.21.15.142:0/2654175921 <== osd.2 v2:172.21.15.142:6808/279438927 9 ==== osd_op_reply(50 notify.3 [create] v32'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6bf000f070 con 0x7f6bf8040040 2024-09-22T08:37:47.907 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.879+0000 7f6c03139800 1 -- 172.21.15.142:0/2654175921 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94133499647952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559d29cecbe0 con 0x7f6bf8040040 2024-09-22T08:37:47.907 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.879+0000 7f6c03139800 1 -- 172.21.15.142:0/2654175921 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559d29cee710 con 0x559d29cdf7e0 2024-09-22T08:37:47.907 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.880+0000 7f6bfedc7640 1 -- 172.21.15.142:0/2654175921 <== osd.2 v2:172.21.15.142:6808/279438927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94133499647952] v32'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6bf000f070 con 0x7f6bf8040040 2024-09-22T08:37:47.908 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.881+0000 7f6bfe5c6640 1 -- 172.21.15.142:0/2654175921 <== osd.1 v2:172.21.15.142:6816/3192108003 18 ==== osd_op_reply(52 notify.4 [create] v32'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6bf4057030 con 0x559d29cdf7e0 2024-09-22T08:37:47.908 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.881+0000 7f6c03139800 1 -- 172.21.15.142:0/2654175921 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94133499650656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559d29ceeb30 con 0x559d29cdf7e0 2024-09-22T08:37:47.908 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.881+0000 7f6c03139800 1 -- 172.21.15.142:0/2654175921 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559d29cef4f0 con 0x7f6bf0031040 2024-09-22T08:37:47.908 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.882+0000 7f6bfe5c6640 1 -- 172.21.15.142:0/2654175921 <== osd.0 v2:172.21.15.31:6800/168281188 10 ==== osd_op_reply(54 notify.5 [create] v32'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6bf4057030 con 0x7f6bf0031040 2024-09-22T08:37:47.908 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.882+0000 7f6bfe5c6640 1 -- 172.21.15.142:0/2654175921 <== osd.1 v2:172.21.15.142:6816/3192108003 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94133499650656] v32'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6bf4057030 con 0x559d29cdf7e0 2024-09-22T08:37:47.908 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.882+0000 7f6c03139800 1 -- 172.21.15.142:0/2654175921 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94133499654208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559d29cef460 con 0x7f6bf0031040 2024-09-22T08:37:47.908 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.882+0000 7f6c03139800 1 -- 172.21.15.142:0/2654175921 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559d29cee6c0 con 0x7f6bf0031040 2024-09-22T08:37:47.908 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.883+0000 7f6bfe5c6640 1 -- 172.21.15.142:0/2654175921 <== osd.0 v2:172.21.15.31:6800/168281188 11 ==== osd_op_reply(56 notify.6 [create] v32'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6bf4057030 con 0x7f6bf0031040 2024-09-22T08:37:47.908 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.883+0000 7f6c03139800 1 -- 172.21.15.142:0/2654175921 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94133499651776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559d29cf0460 con 0x7f6bf0031040 2024-09-22T08:37:47.908 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.883+0000 7f6c03139800 1 -- 172.21.15.142:0/2654175921 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559d29cf0eb0 con 0x7f6bf0031040 2024-09-22T08:37:47.908 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.883+0000 7f6bfe5c6640 1 -- 172.21.15.142:0/2654175921 <== osd.0 v2:172.21.15.31:6800/168281188 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94133499654208] v32'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6bf4057030 con 0x7f6bf0031040 2024-09-22T08:37:47.908 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.884+0000 7f6bfe5c6640 1 -- 172.21.15.142:0/2654175921 <== osd.0 v2:172.21.15.31:6800/168281188 13 ==== osd_op_reply(58 notify.7 [create] v32'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6bf4057030 con 0x7f6bf0031040 2024-09-22T08:37:47.909 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.884+0000 7f6c03139800 1 -- 172.21.15.142:0/2654175921 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94133499660704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559d29cf0e70 con 0x7f6bf0031040 2024-09-22T08:37:47.909 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.884+0000 7f6c03139800 20 add_watcher() i=0 2024-09-22T08:37:47.909 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.884+0000 7f6c03139800 20 add_watcher() i=1 2024-09-22T08:37:47.909 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.884+0000 7f6c03139800 20 add_watcher() i=2 2024-09-22T08:37:47.909 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.884+0000 7f6c03139800 20 add_watcher() i=3 2024-09-22T08:37:47.909 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.884+0000 7f6c03139800 20 add_watcher() i=4 2024-09-22T08:37:47.909 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.884+0000 7f6c03139800 20 add_watcher() i=5 2024-09-22T08:37:47.909 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.884+0000 7f6bfe5c6640 1 -- 172.21.15.142:0/2654175921 <== osd.0 v2:172.21.15.31:6800/168281188 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94133499651776] v32'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6bf4057030 con 0x7f6bf0031040 2024-09-22T08:37:47.909 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.884+0000 7f6c03139800 20 add_watcher() i=6 2024-09-22T08:37:47.909 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.885+0000 7f6bfe5c6640 1 -- 172.21.15.142:0/2654175921 <== osd.0 v2:172.21.15.31:6800/168281188 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94133499660704] v32'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6bf4057030 con 0x7f6bf0031040 2024-09-22T08:37:47.909 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.885+0000 7f6c03139800 20 add_watcher() i=7 2024-09-22T08:37:47.909 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.885+0000 7f6c03139800 2 all 8 watchers are set, enabling cache 2024-09-22T08:37:47.909 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.885+0000 7f6c03139800 1 -- 172.21.15.142:0/2654175921 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559d29cf0040 con 0x559d29cdf7e0 2024-09-22T08:37:47.910 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.886+0000 7f6bfe5c6640 1 -- 172.21.15.142:0/2654175921 <== osd.1 v2:172.21.15.142:6816/3192108003 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f6bf4057030 con 0x559d29cdf7e0 2024-09-22T08:37:47.910 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.886+0000 7f6c03139800 1 -- 172.21.15.142:0/2654175921 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94133499656336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559d29cf1720 con 0x559d29cdf7e0 2024-09-22T08:37:47.910 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.887+0000 7f6bfe5c6640 1 -- 172.21.15.142:0/2654175921 <== osd.1 v2:172.21.15.142:6816/3192108003 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94133499656336] v32'218 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6bf4057030 con 0x559d29cdf7e0 2024-09-22T08:37:47.910 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.887+0000 7f6ab57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:37:47.910 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.887+0000 7f6c03139800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:37:47.910 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.887+0000 7f6c03139800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:37:47.910 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.887+0000 7f6c03139800 1 -- 172.21.15.142:0/2654175921 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559d29cfc9c0 con 0x559d29cdf7e0 2024-09-22T08:37:47.910 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.888+0000 7f6bfe5c6640 1 -- 172.21.15.142:0/2654175921 <== osd.1 v2:172.21.15.142:6816/3192108003 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'32 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6bf4057030 con 0x559d29cdf7e0 2024-09-22T08:37:47.910 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.888+0000 7f6c03139800 1 -- 172.21.15.142:0/2654175921 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559d29cfd050 con 0x7f6bf0031040 2024-09-22T08:37:47.910 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.890+0000 7f6bfe5c6640 1 -- 172.21.15.142:0/2654175921 <== osd.0 v2:172.21.15.31:6800/168281188 16 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'26 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6bf4057030 con 0x7f6bf0031040 2024-09-22T08:37:47.910 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.890+0000 7f6c03139800 1 -- 172.21.15.142:0/2654175921 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559d29cfd470 con 0x559d29ce41f0 2024-09-22T08:37:47.910 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.891+0000 7f6bff5c8640 1 -- 172.21.15.142:0/2654175921 <== osd.3 v2:172.21.15.142:6800/1064901393 16 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'27 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6bf804d070 con 0x559d29ce41f0 2024-09-22T08:37:47.911 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.891+0000 7f6c03139800 1 -- 172.21.15.142:0/2654175921 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559d29cfd2e0 con 0x559d29cdf7e0 2024-09-22T08:37:47.911 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.892+0000 7f6bfe5c6640 1 -- 172.21.15.142:0/2654175921 <== osd.1 v2:172.21.15.142:6816/3192108003 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'219 uv162 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6bf4057030 con 0x559d29cdf7e0 2024-09-22T08:37:47.911 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.892+0000 7f6c03139800 1 -- 172.21.15.142:0/2654175921 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559d29cfd950 con 0x7f6bf8040040 2024-09-22T08:37:47.911 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.893+0000 7f6bfedc7640 1 -- 172.21.15.142:0/2654175921 <== osd.2 v2:172.21.15.142:6808/279438927 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'70 uv53 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6bf000f070 con 0x7f6bf8040040 2024-09-22T08:37:47.911 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.893+0000 7f6c03139800 1 -- 172.21.15.142:0/2654175921 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559d29cfddd0 con 0x559d29ce41f0 2024-09-22T08:37:47.911 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.894+0000 7f6bff5c8640 1 -- 172.21.15.142:0/2654175921 <== osd.3 v2:172.21.15.142:6800/1064901393 17 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'46 uv34 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6bf804d070 con 0x559d29ce41f0 2024-09-22T08:37:47.911 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.894+0000 7f6c03139800 1 -- 172.21.15.142:0/2654175921 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559d29cfdd30 con 0x559d29cdf7e0 2024-09-22T08:37:47.911 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.895+0000 7f6bfe5c6640 1 -- 172.21.15.142:0/2654175921 <== osd.1 v2:172.21.15.142:6816/3192108003 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'28 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6bf4057030 con 0x559d29cdf7e0 2024-09-22T08:37:47.911 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.895+0000 7f6c03139800 1 -- 172.21.15.142:0/2654175921 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559d29cfdc40 con 0x7f6bf0031040 2024-09-22T08:37:47.911 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.896+0000 7f6bfe5c6640 1 -- 172.21.15.142:0/2654175921 <== osd.0 v2:172.21.15.31:6800/168281188 17 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'45 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6bf4057030 con 0x7f6bf0031040 2024-09-22T08:37:47.911 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.896+0000 7f6c03139800 1 -- 172.21.15.142:0/2654175921 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559d29cfdd40 con 0x7f6bf8040040 2024-09-22T08:37:47.911 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.898+0000 7f6bfedc7640 1 -- 172.21.15.142:0/2654175921 <== osd.2 v2:172.21.15.142:6808/279438927 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'26 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6bf000f070 con 0x7f6bf8040040 2024-09-22T08:37:47.911 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.898+0000 7f6c03139800 1 -- 172.21.15.142:0/2654175921 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559d29cfe160 con 0x559d29ce41f0 2024-09-22T08:37:47.911 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.899+0000 7f6bff5c8640 1 -- 172.21.15.142:0/2654175921 <== osd.3 v2:172.21.15.142:6800/1064901393 18 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'32 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6bf804d070 con 0x559d29ce41f0 2024-09-22T08:37:47.912 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.899+0000 7f6c03139800 1 -- 172.21.15.142:0/2654175921 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559d29cfe140 con 0x7f6bf8040040 2024-09-22T08:37:47.912 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.899+0000 7f6bfedc7640 1 -- 172.21.15.142:0/2654175921 <== osd.2 v2:172.21.15.142:6808/279438927 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'71 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6bf000f070 con 0x7f6bf8040040 2024-09-22T08:37:47.912 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.899+0000 7f6c03139800 1 -- 172.21.15.142:0/2654175921 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559d29cfe140 con 0x7f6bf0031040 2024-09-22T08:37:47.912 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.901+0000 7f6bfe5c6640 1 -- 172.21.15.142:0/2654175921 <== osd.0 v2:172.21.15.31:6800/168281188 18 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'30 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6bf4057030 con 0x7f6bf0031040 2024-09-22T08:37:47.912 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.901+0000 7f6c03139800 1 -- 172.21.15.142:0/2654175921 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559d29cfe140 con 0x7f6bf8040040 2024-09-22T08:37:47.912 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.902+0000 7f6bfedc7640 1 -- 172.21.15.142:0/2654175921 <== osd.2 v2:172.21.15.142:6808/279438927 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'26 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6bf000f070 con 0x7f6bf8040040 2024-09-22T08:37:47.912 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.902+0000 7f6c03139800 1 -- 172.21.15.142:0/2654175921 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559d29cfe140 con 0x7f6bf0031040 2024-09-22T08:37:47.912 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.903+0000 7f6bfe5c6640 1 -- 172.21.15.142:0/2654175921 <== osd.0 v2:172.21.15.31:6800/168281188 19 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'53 uv44 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6bf4057030 con 0x7f6bf0031040 2024-09-22T08:37:47.912 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.903+0000 7f6c03139800 1 -- 172.21.15.142:0/2654175921 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559d29cfe140 con 0x559d29cdf7e0 2024-09-22T08:37:47.912 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.904+0000 7f6bfe5c6640 1 -- 172.21.15.142:0/2654175921 <== osd.1 v2:172.21.15.142:6816/3192108003 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'220 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6bf4057030 con 0x559d29cdf7e0 2024-09-22T08:37:47.912 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.904+0000 7f6c03139800 1 -- 172.21.15.142:0/2654175921 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559d29cfe140 con 0x559d29ce41f0 2024-09-22T08:37:47.913 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.905+0000 7f6bff5c8640 1 -- 172.21.15.142:0/2654175921 <== osd.3 v2:172.21.15.142:6800/1064901393 19 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'62 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6bf804d070 con 0x559d29ce41f0 2024-09-22T08:37:47.913 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.905+0000 7f6c03139800 1 -- 172.21.15.142:0/2654175921 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559d29cfe140 con 0x7f6bf8040040 2024-09-22T08:37:47.914 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.906+0000 7f6bfedc7640 1 -- 172.21.15.142:0/2654175921 <== osd.2 v2:172.21.15.142:6808/279438927 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'72 uv57 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6bf000f070 con 0x7f6bf8040040 2024-09-22T08:37:47.914 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.906+0000 7f6c03139800 1 -- 172.21.15.142:0/2654175921 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559d29cfe210 con 0x559d29ce41f0 2024-09-22T08:37:47.915 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.908+0000 7f6bff5c8640 1 -- 172.21.15.142:0/2654175921 <== osd.3 v2:172.21.15.142:6800/1064901393 20 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'26 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6bf804d070 con 0x559d29ce41f0 2024-09-22T08:37:47.915 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.908+0000 7f6c03139800 1 -- 172.21.15.142:0/2654175921 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559d29cfe210 con 0x559d29cdf7e0 2024-09-22T08:37:47.915 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.909+0000 7f6bfe5c6640 1 -- 172.21.15.142:0/2654175921 <== osd.1 v2:172.21.15.142:6816/3192108003 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'34 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6bf4057030 con 0x559d29cdf7e0 2024-09-22T08:37:47.915 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.909+0000 7f6c03139800 1 -- 172.21.15.142:0/2654175921 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559d29cfe210 con 0x559d29cdf7e0 2024-09-22T08:37:47.915 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.910+0000 7f6bfe5c6640 1 -- 172.21.15.142:0/2654175921 <== osd.1 v2:172.21.15.142:6816/3192108003 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'221 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6bf4057030 con 0x559d29cdf7e0 2024-09-22T08:37:47.915 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.910+0000 7f6c03139800 1 -- 172.21.15.142:0/2654175921 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559d29cfe210 con 0x559d29ce41f0 2024-09-22T08:37:47.915 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.911+0000 7f6bff5c8640 1 -- 172.21.15.142:0/2654175921 <== osd.3 v2:172.21.15.142:6800/1064901393 21 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'63 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6bf804d070 con 0x559d29ce41f0 2024-09-22T08:37:47.915 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.911+0000 7f6c03139800 1 -- 172.21.15.142:0/2654175921 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559d29cfe210 con 0x7f6bf8040040 2024-09-22T08:37:47.915 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.912+0000 7f6bfedc7640 1 -- 172.21.15.142:0/2654175921 <== osd.2 v2:172.21.15.142:6808/279438927 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'36 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6bf000f070 con 0x7f6bf8040040 2024-09-22T08:37:47.915 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.912+0000 7f6c03139800 1 -- 172.21.15.142:0/2654175921 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559d29cfe210 con 0x559d29ce41f0 2024-09-22T08:37:47.915 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.913+0000 7f6bff5c8640 1 -- 172.21.15.142:0/2654175921 <== osd.3 v2:172.21.15.142:6800/1064901393 22 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'28 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6bf804d070 con 0x559d29ce41f0 2024-09-22T08:37:47.915 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.913+0000 7f6c03139800 1 -- 172.21.15.142:0/2654175921 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559d29cfe210 con 0x559d29ce41f0 2024-09-22T08:37:47.916 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.914+0000 7f6bff5c8640 1 -- 172.21.15.142:0/2654175921 <== osd.3 v2:172.21.15.142:6800/1064901393 23 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'32 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6bf804d070 con 0x559d29ce41f0 2024-09-22T08:37:47.916 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.914+0000 7f6c03139800 1 -- 172.21.15.142:0/2654175921 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559d29cfe230 con 0x559d29ce41f0 2024-09-22T08:37:47.916 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.915+0000 7f6bff5c8640 1 -- 172.21.15.142:0/2654175921 <== osd.3 v2:172.21.15.142:6800/1064901393 24 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'22 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6bf804d070 con 0x559d29ce41f0 2024-09-22T08:37:47.916 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.915+0000 7f6c03139800 1 -- 172.21.15.142:0/2654175921 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559d29cfe230 con 0x559d29ce41f0 2024-09-22T08:37:47.917 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.916+0000 7f6bff5c8640 1 -- 172.21.15.142:0/2654175921 <== osd.3 v2:172.21.15.142:6800/1064901393 25 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'47 uv36 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6bf804d070 con 0x559d29ce41f0 2024-09-22T08:37:47.917 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.916+0000 7f6c03139800 1 -- 172.21.15.142:0/2654175921 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559d29cfe230 con 0x7f6bf0031040 2024-09-22T08:37:47.918 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.917+0000 7f6bfe5c6640 1 -- 172.21.15.142:0/2654175921 <== osd.0 v2:172.21.15.31:6800/168281188 20 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'28 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6bf4057030 con 0x7f6bf0031040 2024-09-22T08:37:47.919 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.918+0000 7f6c03139800 1 -- 172.21.15.142:0/2654175921 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559d29cfe270 con 0x559d29ce41f0 2024-09-22T08:37:47.919 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.918+0000 7f6bff5c8640 1 -- 172.21.15.142:0/2654175921 <== osd.3 v2:172.21.15.142:6800/1064901393 26 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'26 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6bf804d070 con 0x559d29ce41f0 2024-09-22T08:37:47.919 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.918+0000 7f6c03139800 1 -- 172.21.15.142:0/2654175921 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559d29cfe270 con 0x7f6bf0031040 2024-09-22T08:37:47.921 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.920+0000 7f6bfe5c6640 1 -- 172.21.15.142:0/2654175921 <== osd.0 v2:172.21.15.31:6800/168281188 21 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'46 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6bf4057030 con 0x7f6bf0031040 2024-09-22T08:37:47.921 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.920+0000 7f6c03139800 1 -- 172.21.15.142:0/2654175921 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559d29cfe270 con 0x559d29ce41f0 2024-09-22T08:37:47.922 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.921+0000 7f6bff5c8640 1 -- 172.21.15.142:0/2654175921 <== osd.3 v2:172.21.15.142:6800/1064901393 27 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'64 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6bf804d070 con 0x559d29ce41f0 2024-09-22T08:37:47.922 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.921+0000 7f6c03139800 1 -- 172.21.15.142:0/2654175921 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559d29cfe270 con 0x7f6bf0031040 2024-09-22T08:37:47.923 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.922+0000 7f6bfe5c6640 1 -- 172.21.15.142:0/2654175921 <== osd.0 v2:172.21.15.31:6800/168281188 22 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'54 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6bf4057030 con 0x7f6bf0031040 2024-09-22T08:37:47.923 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.922+0000 7f6c03139800 1 -- 172.21.15.142:0/2654175921 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559d29cfe2b0 con 0x7f6bf8040040 2024-09-22T08:37:47.924 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.923+0000 7f6bfedc7640 1 -- 172.21.15.142:0/2654175921 <== osd.2 v2:172.21.15.142:6808/279438927 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'32 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6bf000f070 con 0x7f6bf8040040 2024-09-22T08:37:47.926 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.924+0000 7f6a2ffff640 20 reqs_thread_entry: start 2024-09-22T08:37:47.926 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.924+0000 7f6c03139800 20 init_complete bucket index max shards: 11 2024-09-22T08:37:47.926 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.924+0000 7f6c03139800 20 Filter name: none 2024-09-22T08:37:47.926 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.924+0000 7f6a2dffb640 20 reqs_thread_entry: start 2024-09-22T08:37:47.926 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.924+0000 7f6c03139800 10 cache get: name=default.rgw.meta+users.uid+bud : miss 2024-09-22T08:37:47.926 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.924+0000 7f6c03139800 20 rados->read ofs=0 len=0 2024-09-22T08:37:47.926 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.924+0000 7f6c03139800 1 -- 172.21.15.142:0/2654175921 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:94 8.4 8:267425a8:users.uid::bud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559d29d291d0 con 0x7f6bf8040040 2024-09-22T08:37:47.927 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.924+0000 7f6bfedc7640 1 -- 172.21.15.142:0/2654175921 <== osd.2 v2:172.21.15.142:6808/279438927 18 ==== osd_op_reply(94 bud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv2 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f6bf000f070 con 0x7f6bf8040040 2024-09-22T08:37:47.927 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.924+0000 7f6c03139800 20 rados_obj.operate() r=0 bl.length=380 2024-09-22T08:37:47.927 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.924+0000 7f6c03139800 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x13 2024-09-22T08:37:47.927 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.924+0000 7f6c03139800 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-09-22T08:37:47.927 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.924+0000 7f6c03139800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:37:47.927 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.924+0000 7f6c03139800 1 -- 172.21.15.142:0/2654175921 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:95 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559d29d2ba90 con 0x559d29cdf7e0 2024-09-22T08:37:47.927 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.925+0000 7f6bfe5c6640 1 -- 172.21.15.142:0/2654175921 <== osd.1 v2:172.21.15.142:6816/3192108003 28 ==== osd_op_reply(95 bud.buckets [call out=184b] v0'0 uv4 ondisk = 0) ==== 155+0+184 (crc 0 0 0) 0x7f6bf4057030 con 0x559d29cdf7e0 2024-09-22T08:37:47.927 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.925+0000 7f6c03139800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:e239248c-0bee-4e41-803a-24b288d3eb8f.4226.9 : miss 2024-09-22T08:37:47.927 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.925+0000 7f6c03139800 20 rados->read ofs=0 len=0 2024-09-22T08:37:47.927 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.925+0000 7f6c03139800 1 -- 172.21.15.142:0/2654175921 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:96 8.15 8:ab657e42:root::.bucket.meta.myfoo6%3ae239248c-0bee-4e41-803a-24b288d3eb8f.4226.9:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559d29d2b940 con 0x559d29ce41f0 2024-09-22T08:37:47.930 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.925+0000 7f6bff5c8640 1 -- 172.21.15.142:0/2654175921 <== osd.3 v2:172.21.15.142:6800/1064901393 28 ==== osd_op_reply(96 .bucket.meta.myfoo6:e239248c-0bee-4e41-803a-24b288d3eb8f.4226.9 [call out=48b,stat out=16b,read 0~388 out=388b,getxattrs out=212b] v0'0 uv13 ondisk = 0) ==== 333+0+664 (crc 0 0 0) 0x7f6bf804d070 con 0x559d29ce41f0 2024-09-22T08:37:47.930 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.925+0000 7f6c03139800 20 rados_obj.operate() r=0 bl.length=388 2024-09-22T08:37:47.930 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.925+0000 7f6c03139800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:e239248c-0bee-4e41-803a-24b288d3eb8f.4226.9 info.flags=0x17 2024-09-22T08:37:47.930 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.925+0000 7f6c03139800 10 adding default.rgw.meta+root+.bucket.meta.myfoo6:e239248c-0bee-4e41-803a-24b288d3eb8f.4226.9 to cache LRU end 2024-09-22T08:37:47.930 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.925+0000 7f6c03139800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:37:47.930 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.925+0000 7f6c03139800 10 updating xattr: name=user.rgw.acl bl.length()=117 2024-09-22T08:37:47.930 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.925+0000 7f6c03139800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:e239248c-0bee-4e41-803a-24b288d3eb8f.4226.9 2024-09-22T08:37:47.930 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.925+0000 7f6c03139800 1 -- 172.21.15.142:0/2654175921 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:97 4.23 4:c5e6b267:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.9.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559d29da8ed0 con 0x7f6bf0031040 2024-09-22T08:37:47.930 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.926+0000 7f6bfe5c6640 1 -- 172.21.15.142:0/2654175921 <== osd.0 v2:172.21.15.31:6800/168281188 23 ==== osd_op_reply(97 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.9.0 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f6bf4057030 con 0x7f6bf0031040 2024-09-22T08:37:47.930 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.926+0000 7f6c03139800 1 -- 172.21.15.142:0/2654175921 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:98 4.20 4:0568296f:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.9.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559d29da8ed0 con 0x559d29cdf7e0 2024-09-22T08:37:47.931 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.926+0000 7f6bfe5c6640 1 -- 172.21.15.142:0/2654175921 <== osd.1 v2:172.21.15.142:6816/3192108003 29 ==== osd_op_reply(98 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.9.1 [call out=89b] v0'0 uv13 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f6bf4057030 con 0x559d29cdf7e0 2024-09-22T08:37:47.931 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.926+0000 7f6c03139800 1 -- 172.21.15.142:0/2654175921 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:99 4.c 4:3134bd73:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.9.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559d29da8ed0 con 0x559d29cdf7e0 2024-09-22T08:37:47.931 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.927+0000 7f6bfe5c6640 1 -- 172.21.15.142:0/2654175921 <== osd.1 v2:172.21.15.142:6816/3192108003 30 ==== osd_op_reply(99 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.9.2 [call out=89b] v0'0 uv9 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f6bf4057030 con 0x559d29cdf7e0 2024-09-22T08:37:47.931 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.927+0000 7f6c03139800 1 -- 172.21.15.142:0/2654175921 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:100 4.2f 4:f59797e0:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.9.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559d29da8ed0 con 0x559d29cdf7e0 2024-09-22T08:37:47.931 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.927+0000 7f6bfe5c6640 1 -- 172.21.15.142:0/2654175921 <== osd.1 v2:172.21.15.142:6816/3192108003 31 ==== osd_op_reply(100 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.9.3 [call out=89b] v0'0 uv7 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f6bf4057030 con 0x559d29cdf7e0 2024-09-22T08:37:47.931 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.927+0000 7f6c03139800 1 -- 172.21.15.142:0/2654175921 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:101 4.b 4:d0ed73cf:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.9.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559d29da8ed0 con 0x7f6bf8040040 2024-09-22T08:37:47.931 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.928+0000 7f6bfedc7640 1 -- 172.21.15.142:0/2654175921 <== osd.2 v2:172.21.15.142:6808/279438927 19 ==== osd_op_reply(101 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.9.4 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f6bf000f070 con 0x7f6bf8040040 2024-09-22T08:37:47.931 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.928+0000 7f6c03139800 1 -- 172.21.15.142:0/2654175921 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:102 4.1f 4:f9395f8a:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.9.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559d29da8ed0 con 0x559d29ce41f0 2024-09-22T08:37:47.931 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.928+0000 7f6bff5c8640 1 -- 172.21.15.142:0/2654175921 <== osd.3 v2:172.21.15.142:6800/1064901393 29 ==== osd_op_reply(102 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.9.5 [call out=89b] v0'0 uv6 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f6bf804d070 con 0x559d29ce41f0 2024-09-22T08:37:47.931 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.928+0000 7f6c03139800 1 -- 172.21.15.142:0/2654175921 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:103 4.16 4:68dcb4be:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.9.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559d29da8ed0 con 0x559d29ce41f0 2024-09-22T08:37:47.931 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.928+0000 7f6bff5c8640 1 -- 172.21.15.142:0/2654175921 <== osd.3 v2:172.21.15.142:6800/1064901393 30 ==== osd_op_reply(103 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.9.6 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f6bf804d070 con 0x559d29ce41f0 2024-09-22T08:37:47.931 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.928+0000 7f6c03139800 1 -- 172.21.15.142:0/2654175921 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:104 4.1d 4:bb447876:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.9.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559d29da8f10 con 0x559d29ce41f0 2024-09-22T08:37:47.932 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.928+0000 7f6bff5c8640 1 -- 172.21.15.142:0/2654175921 <== osd.3 v2:172.21.15.142:6800/1064901393 31 ==== osd_op_reply(104 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.9.7 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f6bf804d070 con 0x559d29ce41f0 2024-09-22T08:37:47.932 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.928+0000 7f6c03139800 1 -- 172.21.15.142:0/2654175921 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:105 4.37 4:edc9c648:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.9.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559d29da8f10 con 0x7f6bf0031040 2024-09-22T08:37:47.933 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.929+0000 7f6bfe5c6640 1 -- 172.21.15.142:0/2654175921 <== osd.0 v2:172.21.15.31:6800/168281188 24 ==== osd_op_reply(105 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.9.8 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f6bf4057030 con 0x7f6bf0031040 2024-09-22T08:37:47.933 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.929+0000 7f6c03139800 1 -- 172.21.15.142:0/2654175921 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:106 4.35 4:acb4e751:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.9.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559d29da8f10 con 0x559d29cdf7e0 2024-09-22T08:37:47.933 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.929+0000 7f6bfe5c6640 1 -- 172.21.15.142:0/2654175921 <== osd.1 v2:172.21.15.142:6816/3192108003 32 ==== osd_op_reply(106 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.9.9 [call out=349b] v0'0 uv5 ondisk = 0) ==== 194+0+349 (crc 0 0 0) 0x7f6bf4057030 con 0x559d29cdf7e0 2024-09-22T08:37:47.934 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.929+0000 7f6c03139800 10 cls_bucket_list_unordered: got thirteen 2024-09-22T08:37:47.934 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.929+0000 7f6c03139800 1 -- 172.21.15.142:0/2654175921 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:107 4.26 4:66f493f1:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.9.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559d29da8f10 con 0x7f6bf0031040 2024-09-22T08:37:47.934 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.930+0000 7f6bfe5c6640 1 -- 172.21.15.142:0/2654175921 <== osd.0 v2:172.21.15.31:6800/168281188 25 ==== osd_op_reply(107 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.9.10 [call out=89b] v0'0 uv11 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f6bf4089040 con 0x7f6bf0031040 2024-09-22T08:37:47.934 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.930+0000 7f6c03139800 20 get_obj_state: octx=0x7f6bf0018c30 obj=myfoo6:thirteen state=0x559d29da6f38 s->prefetch_data=0 2024-09-22T08:37:47.934 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.930+0000 7f6c03139800 1 -- 172.21.15.142:0/2654175921 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:108 3.6 3:61c0b0b1:::e239248c-0bee-4e41-803a-24b288d3eb8f.4226.9_thirteen:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559d29da7940 con 0x559d29cdf7e0 2024-09-22T08:37:47.934 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.930+0000 7f6bfe5c6640 1 -- 172.21.15.142:0/2654175921 <== osd.1 v2:172.21.15.142:6816/3192108003 33 ==== osd_op_reply(108 e239248c-0bee-4e41-803a-24b288d3eb8f.4226.9_thirteen [call out=24b,getxattrs out=827b,stat out=16b] v0'0 uv4 ondisk = 0) ==== 280+0+867 (crc 0 0 0) 0x7f6bf4089040 con 0x559d29cdf7e0 2024-09-22T08:37:47.934 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.930+0000 7f6c03139800 10 manifest: total_size = 8 2024-09-22T08:37:47.934 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.930+0000 7f6c03139800 20 get_obj_state: setting s->obj_tag to _QK-lnaMIDpzP79DuWSN9Sn-gmHQmyRE 2024-09-22T08:37:47.934 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.930+0000 7f6c03139800 20 get_obj_state: octx=0x7f6bf0018c30 obj=myfoo6:thirteen state=0x559d29da6f38 s->prefetch_data=0 2024-09-22T08:37:47.934 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.930+0000 7f6c03139800 20 prepare_atomic_modification: state is not atomic. state=0x559d29da6f38 2024-09-22T08:37:47.935 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.930+0000 7f6c03139800 20 bucket index object: :.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.9.9 2024-09-22T08:37:47.935 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.930+0000 7f6c03139800 1 -- 172.21.15.142:0/2654175921 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:109 4.35 4:acb4e751:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=187b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559d29d30040 con 0x559d29cdf7e0 2024-09-22T08:37:47.935 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.931+0000 7f6bfe5c6640 1 -- 172.21.15.142:0/2654175921 <== osd.1 v2:172.21.15.142:6816/3192108003 34 ==== osd_op_reply(109 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.9.9 [stat,call,call] v32'6 uv6 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f6bf4089040 con 0x559d29cdf7e0 2024-09-22T08:37:47.935 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.932+0000 7f6c03139800 1 -- 172.21.15.142:0/2654175921 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:110 3.6 3:61c0b0b1:::e239248c-0bee-4e41-803a-24b288d3eb8f.4226.9_thirteen:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559d29d2e020 con 0x559d29cdf7e0 2024-09-22T08:37:47.942 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.933+0000 7f6bfe5c6640 1 -- 172.21.15.142:0/2654175921 <== osd.1 v2:172.21.15.142:6816/3192108003 35 ==== osd_op_reply(110 e239248c-0bee-4e41-803a-24b288d3eb8f.4226.9_thirteen [call] v32'5 uv5 ondisk = 0) ==== 196+0+0 (crc 0 0 0) 0x7f6bf4089040 con 0x559d29cdf7e0 2024-09-22T08:37:47.942 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.933+0000 7f6c03139800 1 -- 172.21.15.142:0/2654175921 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:111 4.35 4:acb4e751:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=264b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559d29d30620 con 0x559d29cdf7e0 2024-09-22T08:37:47.942 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.933+0000 7f6c03139800 20 list_objects_ordered: starting attempt 1 2024-09-22T08:37:47.943 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.933+0000 7f6c03139800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-22T08:37:47.943 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.933+0000 7f6c03139800 1 -- 172.21.15.142:0/2654175921 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:112 4.23 4:c5e6b267:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.9.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559d29d31ff0 con 0x7f6bf0031040 2024-09-22T08:37:47.943 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.933+0000 7f6c03139800 1 -- 172.21.15.142:0/2654175921 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:113 4.20 4:0568296f:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.9.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559d29d348f0 con 0x559d29cdf7e0 2024-09-22T08:37:47.943 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.933+0000 7f6c03139800 1 -- 172.21.15.142:0/2654175921 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:114 4.c 4:3134bd73:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.9.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559d29d31ff0 con 0x559d29cdf7e0 2024-09-22T08:37:47.943 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.933+0000 7f6c03139800 1 -- 172.21.15.142:0/2654175921 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:115 4.2f 4:f59797e0:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.9.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559d29d39720 con 0x559d29cdf7e0 2024-09-22T08:37:47.943 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.933+0000 7f6c03139800 1 -- 172.21.15.142:0/2654175921 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:116 4.b 4:d0ed73cf:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.9.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559d29d3bfd0 con 0x7f6bf8040040 2024-09-22T08:37:47.943 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.933+0000 7f6c03139800 1 -- 172.21.15.142:0/2654175921 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:117 4.1f 4:f9395f8a:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.9.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559d29d3eaa0 con 0x559d29ce41f0 2024-09-22T08:37:47.943 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.933+0000 7f6c03139800 1 -- 172.21.15.142:0/2654175921 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:118 4.16 4:68dcb4be:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.9.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559d29d41720 con 0x559d29ce41f0 2024-09-22T08:37:47.943 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.933+0000 7f6c03139800 1 -- 172.21.15.142:0/2654175921 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:119 4.1d 4:bb447876:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.9.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559d29d445a0 con 0x559d29ce41f0 2024-09-22T08:37:47.943 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.933+0000 7f6c03139800 1 -- 172.21.15.142:0/2654175921 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:120 4.37 4:edc9c648:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.9.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559d29d473d0 con 0x7f6bf0031040 2024-09-22T08:37:47.943 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.933+0000 7f6c03139800 1 -- 172.21.15.142:0/2654175921 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:121 4.35 4:acb4e751:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.9.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559d29d49d90 con 0x559d29cdf7e0 2024-09-22T08:37:47.943 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.933+0000 7f6c03139800 1 -- 172.21.15.142:0/2654175921 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:122 4.26 4:66f493f1:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.9.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559d29d4cbf0 con 0x7f6bf0031040 2024-09-22T08:37:47.944 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.933+0000 7f6bfe5c6640 1 -- 172.21.15.142:0/2654175921 <== osd.1 v2:172.21.15.142:6816/3192108003 36 ==== osd_op_reply(113 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.9.1 [call out=89b] v0'0 uv13 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f6bf4089040 con 0x559d29cdf7e0 2024-09-22T08:37:47.944 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.933+0000 7f6bfe5c6640 1 -- 172.21.15.142:0/2654175921 <== osd.1 v2:172.21.15.142:6816/3192108003 37 ==== osd_op_reply(114 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.9.2 [call out=89b] v0'0 uv9 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f6bf4089040 con 0x559d29cdf7e0 2024-09-22T08:37:47.944 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.933+0000 7f6bfedc7640 1 -- 172.21.15.142:0/2654175921 <== osd.2 v2:172.21.15.142:6808/279438927 20 ==== osd_op_reply(116 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.9.4 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f6bf000f070 con 0x7f6bf8040040 2024-09-22T08:37:47.944 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.933+0000 7f6bfe5c6640 1 -- 172.21.15.142:0/2654175921 <== osd.1 v2:172.21.15.142:6816/3192108003 38 ==== osd_op_reply(115 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.9.3 [call out=89b] v0'0 uv7 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f6bf4089040 con 0x559d29cdf7e0 2024-09-22T08:37:47.944 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.933+0000 7f6bfe5c6640 1 -- 172.21.15.142:0/2654175921 <== osd.0 v2:172.21.15.31:6800/168281188 26 ==== osd_op_reply(120 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.9.8 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f6bf4089040 con 0x7f6bf0031040 2024-09-22T08:37:47.944 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.933+0000 7f6bfe5c6640 1 -- 172.21.15.142:0/2654175921 <== osd.0 v2:172.21.15.31:6800/168281188 27 ==== osd_op_reply(112 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.9.0 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f6bf4089040 con 0x7f6bf0031040 2024-09-22T08:37:47.944 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.933+0000 7f6bfe5c6640 1 -- 172.21.15.142:0/2654175921 <== osd.0 v2:172.21.15.31:6800/168281188 28 ==== osd_op_reply(122 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.9.10 [call out=89b] v0'0 uv11 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f6bf4089040 con 0x7f6bf0031040 2024-09-22T08:37:47.944 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.934+0000 7f6bff5c8640 1 -- 172.21.15.142:0/2654175921 <== osd.3 v2:172.21.15.142:6800/1064901393 32 ==== osd_op_reply(117 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.9.5 [call out=89b] v0'0 uv6 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f6bf804d070 con 0x559d29ce41f0 2024-09-22T08:37:47.944 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.934+0000 7f6bff5c8640 1 -- 172.21.15.142:0/2654175921 <== osd.3 v2:172.21.15.142:6800/1064901393 33 ==== osd_op_reply(118 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.9.6 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f6bf804d070 con 0x559d29ce41f0 2024-09-22T08:37:47.944 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.934+0000 7f6bff5c8640 1 -- 172.21.15.142:0/2654175921 <== osd.3 v2:172.21.15.142:6800/1064901393 34 ==== osd_op_reply(119 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.9.7 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f6bf8077070 con 0x559d29ce41f0 2024-09-22T08:37:47.944 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.934+0000 7f6bfe5c6640 1 -- 172.21.15.142:0/2654175921 <== osd.1 v2:172.21.15.142:6816/3192108003 39 ==== osd_op_reply(111 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.9.9 [stat,call,call] v32'7 uv7 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f6bf4089040 con 0x559d29cdf7e0 2024-09-22T08:37:47.944 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.934+0000 7f6ae1ffb640 20 handle_completion(): completion ok for obj=thirteen 2024-09-22T08:37:47.944 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.934+0000 7f6bfe5c6640 1 -- 172.21.15.142:0/2654175921 <== osd.1 v2:172.21.15.142:6816/3192108003 40 ==== osd_op_reply(121 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.9.9 [call out=128b] v0'0 uv7 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7f6bf4089040 con 0x559d29cdf7e0 2024-09-22T08:37:47.945 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.934+0000 7f6c03139800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-22T08:37:47.945 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.934+0000 7f6c03139800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-22T08:37:47.945 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.934+0000 7f6c03139800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-22T08:37:47.945 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.934+0000 7f6c03139800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-22T08:37:47.945 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.934+0000 7f6c03139800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo6[e239248c-0bee-4e41-803a-24b288d3eb8f.4226.9])"; uploads.size()=0; is_truncated=0 2024-09-22T08:37:47.945 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.934+0000 7f6c03139800 1 -- 172.21.15.142:0/2654175921 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:123 4.23 4:c5e6b267:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.9.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559d29d4cbf0 con 0x7f6bf0031040 2024-09-22T08:37:47.945 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.934+0000 7f6c03139800 1 -- 172.21.15.142:0/2654175921 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:124 4.20 4:0568296f:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.9.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559d29d49d90 con 0x559d29cdf7e0 2024-09-22T08:37:47.945 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.934+0000 7f6c03139800 1 -- 172.21.15.142:0/2654175921 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:125 4.c 4:3134bd73:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.9.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559d29d41720 con 0x559d29cdf7e0 2024-09-22T08:37:47.945 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.934+0000 7f6c03139800 1 -- 172.21.15.142:0/2654175921 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:126 4.2f 4:f59797e0:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.9.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559d29d4cbf0 con 0x559d29cdf7e0 2024-09-22T08:37:47.945 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.934+0000 7f6c03139800 1 -- 172.21.15.142:0/2654175921 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:127 4.b 4:d0ed73cf:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.9.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559d29d44520 con 0x7f6bf8040040 2024-09-22T08:37:47.945 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.934+0000 7f6c03139800 1 -- 172.21.15.142:0/2654175921 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:128 4.1f 4:f9395f8a:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.9.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559d29d41720 con 0x559d29ce41f0 2024-09-22T08:37:47.945 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.934+0000 7f6c03139800 1 -- 172.21.15.142:0/2654175921 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:129 4.16 4:68dcb4be:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.9.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559d29d49d90 con 0x559d29ce41f0 2024-09-22T08:37:47.945 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.934+0000 7f6c03139800 1 -- 172.21.15.142:0/2654175921 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:130 4.1d 4:bb447876:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.9.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559d29d4cbf0 con 0x559d29ce41f0 2024-09-22T08:37:47.945 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.934+0000 7f6c03139800 1 -- 172.21.15.142:0/2654175921 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:131 4.37 4:edc9c648:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.9.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559d29d44520 con 0x7f6bf0031040 2024-09-22T08:37:47.946 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.935+0000 7f6c03139800 1 -- 172.21.15.142:0/2654175921 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:132 4.35 4:acb4e751:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.9.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559d29d41720 con 0x559d29cdf7e0 2024-09-22T08:37:47.946 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.935+0000 7f6c03139800 1 -- 172.21.15.142:0/2654175921 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:133 4.26 4:66f493f1:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.9.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559d29d44520 con 0x7f6bf0031040 2024-09-22T08:37:47.946 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.935+0000 7f6bfe5c6640 1 -- 172.21.15.142:0/2654175921 <== osd.0 v2:172.21.15.31:6800/168281188 29 ==== osd_op_reply(123 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.9.0 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f6bf4089040 con 0x7f6bf0031040 2024-09-22T08:37:47.946 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.935+0000 7f6bfe5c6640 1 -- 172.21.15.142:0/2654175921 <== osd.0 v2:172.21.15.31:6800/168281188 30 ==== osd_op_reply(131 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.9.8 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f6bf4089040 con 0x7f6bf0031040 2024-09-22T08:37:47.946 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.935+0000 7f6bfedc7640 1 -- 172.21.15.142:0/2654175921 <== osd.2 v2:172.21.15.142:6808/279438927 21 ==== osd_op_reply(127 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.9.4 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f6bf000f070 con 0x7f6bf8040040 2024-09-22T08:37:47.946 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.935+0000 7f6bfe5c6640 1 -- 172.21.15.142:0/2654175921 <== osd.0 v2:172.21.15.31:6800/168281188 31 ==== osd_op_reply(133 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.9.10 [call out=89b] v0'0 uv11 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f6bf4089040 con 0x7f6bf0031040 2024-09-22T08:37:47.946 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.935+0000 7f6bfe5c6640 1 -- 172.21.15.142:0/2654175921 <== osd.1 v2:172.21.15.142:6816/3192108003 41 ==== osd_op_reply(124 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.9.1 [call out=89b] v0'0 uv13 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f6bf4089040 con 0x559d29cdf7e0 2024-09-22T08:37:47.946 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.935+0000 7f6bfe5c6640 1 -- 172.21.15.142:0/2654175921 <== osd.1 v2:172.21.15.142:6816/3192108003 42 ==== osd_op_reply(125 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.9.2 [call out=89b] v0'0 uv9 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f6bf4089040 con 0x559d29cdf7e0 2024-09-22T08:37:47.946 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.935+0000 7f6bfe5c6640 1 -- 172.21.15.142:0/2654175921 <== osd.1 v2:172.21.15.142:6816/3192108003 43 ==== osd_op_reply(126 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.9.3 [call out=89b] v0'0 uv7 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f6bf4089040 con 0x559d29cdf7e0 2024-09-22T08:37:47.946 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.935+0000 7f6bff5c8640 1 -- 172.21.15.142:0/2654175921 <== osd.3 v2:172.21.15.142:6800/1064901393 35 ==== osd_op_reply(128 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.9.5 [call out=89b] v0'0 uv6 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f6bf8077070 con 0x559d29ce41f0 2024-09-22T08:37:47.946 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.935+0000 7f6bff5c8640 1 -- 172.21.15.142:0/2654175921 <== osd.3 v2:172.21.15.142:6800/1064901393 36 ==== osd_op_reply(130 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.9.7 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f6bf8077070 con 0x559d29ce41f0 2024-09-22T08:37:47.946 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.935+0000 7f6bff5c8640 1 -- 172.21.15.142:0/2654175921 <== osd.3 v2:172.21.15.142:6800/1064901393 37 ==== osd_op_reply(129 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.9.6 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f6bf8077070 con 0x559d29ce41f0 2024-09-22T08:37:47.947 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.935+0000 7f6bfe5c6640 1 -- 172.21.15.142:0/2654175921 <== osd.1 v2:172.21.15.142:6816/3192108003 44 ==== osd_op_reply(132 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.9.9 [call out=128b] v0'0 uv7 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7f6bf4089040 con 0x559d29cdf7e0 2024-09-22T08:37:47.947 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.935+0000 7f6c03139800 1 -- 172.21.15.142:0/2654175921 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:134 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.set_buckets_info in=208b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559d29d41720 con 0x559d29cdf7e0 2024-09-22T08:37:47.947 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.936+0000 7f6bfe5c6640 1 -- 172.21.15.142:0/2654175921 <== osd.1 v2:172.21.15.142:6816/3192108003 45 ==== osd_op_reply(134 bud.buckets [call] v32'5 uv5 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f6bf4089040 con 0x559d29cdf7e0 2024-09-22T08:37:47.947 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.936+0000 7f6c03139800 10 cache get: name=default.rgw.meta+root+myfoo6 : miss 2024-09-22T08:37:47.947 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.936+0000 7f6c03139800 20 rados->read ofs=0 len=0 2024-09-22T08:37:47.947 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.936+0000 7f6c03139800 1 -- 172.21.15.142:0/2654175921 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:135 8.18 8:1944a257:root::myfoo6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559d29d41720 con 0x559d29cdf7e0 2024-09-22T08:37:47.947 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.937+0000 7f6bfe5c6640 1 -- 172.21.15.142:0/2654175921 <== osd.1 v2:172.21.15.142:6816/3192108003 46 ==== osd_op_reply(135 myfoo6 [call out=48b,read 0~166 out=166b] v0'0 uv17 ondisk = 0) ==== 192+0+214 (crc 0 0 0) 0x7f6bf4089040 con 0x559d29cdf7e0 2024-09-22T08:37:47.947 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.937+0000 7f6c03139800 20 rados_obj.operate() r=0 bl.length=166 2024-09-22T08:37:47.947 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.937+0000 7f6c03139800 10 cache put: name=default.rgw.meta+root+myfoo6 info.flags=0x11 2024-09-22T08:37:47.947 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.937+0000 7f6c03139800 10 adding default.rgw.meta+root+myfoo6 to cache LRU end 2024-09-22T08:37:47.947 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.937+0000 7f6c03139800 1 -- 172.21.15.142:0/2654175921 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:136 8.18 8:1944a257:root::myfoo6:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559d29d41720 con 0x559d29cdf7e0 2024-09-22T08:37:47.947 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.938+0000 7f6bfe5c6640 1 -- 172.21.15.142:0/2654175921 <== osd.1 v2:172.21.15.142:6816/3192108003 47 ==== osd_op_reply(136 myfoo6 [call,call,delete] v32'18 uv18 ondisk = 0) ==== 234+0+0 (crc 0 0 0) 0x7f6bf4089040 con 0x559d29cdf7e0 2024-09-22T08:37:47.947 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.938+0000 7f6c03139800 10 removing default.rgw.meta+root+myfoo6 from cache 2024-09-22T08:37:47.947 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.938+0000 7f6c03139800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:myfoo6, ofs0, ns] 2024-09-22T08:37:47.948 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.938+0000 7f6c03139800 1 -- 172.21.15.142:0/2654175921 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:137 7.e 7:7759931f:::notify.3:head [notify cookie 94133500038128 in=162b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559d29d41720 con 0x7f6bf8040040 2024-09-22T08:37:47.948 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.938+0000 7f6bfedc7640 1 -- 172.21.15.142:0/2654175921 <== osd.2 v2:172.21.15.142:6808/279438927 22 ==== watch-notify(notify (1) cookie 94133499647952 notify 137438953505 ret 0) ==== 192+0+0 (crc 0 0 0) 0x559d29cfd4b0 con 0x7f6bf8040040 2024-09-22T08:37:47.948 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.938+0000 7f6ae1ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953505 cookie 94133499647952 notifier 4751 bl.length()=150 2024-09-22T08:37:47.948 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.938+0000 7f6ae1ffb640 1 -- 172.21.15.142:0/2654175921 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:138 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f6a340032c0 con 0x7f6bf8040040 2024-09-22T08:37:47.948 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.938+0000 7f6bfedc7640 1 -- 172.21.15.142:0/2654175921 <== osd.2 v2:172.21.15.142:6808/279438927 23 ==== osd_op_reply(137 notify.3 [notify cookie 94133500038128 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f6bf000f070 con 0x7f6bf8040040 2024-09-22T08:37:47.948 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.938+0000 7f6bfedc7640 1 -- 172.21.15.142:0/2654175921 <== osd.2 v2:172.21.15.142:6808/279438927 24 ==== osd_op_reply(138 notify.3 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6bf000f070 con 0x7f6bf8040040 2024-09-22T08:37:47.948 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.938+0000 7f6bfedc7640 1 -- 172.21.15.142:0/2654175921 <== osd.2 v2:172.21.15.142:6808/279438927 25 ==== watch-notify(notify_complete (2) cookie 94133500038128 notify 137438953505 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f6bf005b040 con 0x7f6bf8040040 2024-09-22T08:37:47.948 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.938+0000 7f6c03139800 1 -- 172.21.15.142:0/2654175921 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:139 8.15 8:ab657e42:root::.bucket.meta.myfoo6%3ae239248c-0bee-4e41-803a-24b288d3eb8f.4226.9:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559d29d4cbf0 con 0x559d29ce41f0 2024-09-22T08:37:47.948 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.939+0000 7f6bff5c8640 1 -- 172.21.15.142:0/2654175921 <== osd.3 v2:172.21.15.142:6800/1064901393 38 ==== osd_op_reply(139 .bucket.meta.myfoo6:e239248c-0bee-4e41-803a-24b288d3eb8f.4226.9 [call,call,delete] v32'14 uv14 ondisk = 0) ==== 291+0+0 (crc 0 0 0) 0x7f6bf8077070 con 0x559d29ce41f0 2024-09-22T08:37:47.948 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.939+0000 7f6c03139800 10 removing default.rgw.meta+root+.bucket.meta.myfoo6:e239248c-0bee-4e41-803a-24b288d3eb8f.4226.9 from cache 2024-09-22T08:37:47.948 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.939+0000 7f6c03139800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo6:e239248c-0bee-4e41-803a-24b288d3eb8f.4226.9, ofs0, ns] 2024-09-22T08:37:47.948 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.939+0000 7f6c03139800 1 -- 172.21.15.142:0/2654175921 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:140 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94133499991840 in=219b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559d29d4cbf0 con 0x7f6bf0031040 2024-09-22T08:37:47.949 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.940+0000 7f6bfe5c6640 1 -- 172.21.15.142:0/2654175921 <== osd.0 v2:172.21.15.31:6800/168281188 32 ==== watch-notify(notify (1) cookie 94133499651776 notify 137438953502 ret 0) ==== 249+0+0 (crc 0 0 0) 0x559d29cfd050 con 0x7f6bf0031040 2024-09-22T08:37:47.949 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.940+0000 7f6ae27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953502 cookie 94133499651776 notifier 4751 bl.length()=207 2024-09-22T08:37:47.949 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.940+0000 7f6ae27fc640 1 -- 172.21.15.142:0/2654175921 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:141 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f6ac4003d60 con 0x7f6bf0031040 2024-09-22T08:37:47.949 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.940+0000 7f6bfe5c6640 1 -- 172.21.15.142:0/2654175921 <== osd.0 v2:172.21.15.31:6800/168281188 33 ==== osd_op_reply(140 notify.6 [notify cookie 94133499991840 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f6bf4089040 con 0x7f6bf0031040 2024-09-22T08:37:47.949 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.940+0000 7f6bfe5c6640 1 -- 172.21.15.142:0/2654175921 <== osd.0 v2:172.21.15.31:6800/168281188 34 ==== osd_op_reply(141 notify.6 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6bf4089040 con 0x7f6bf0031040 2024-09-22T08:37:47.949 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.940+0000 7f6bfe5c6640 1 -- 172.21.15.142:0/2654175921 <== osd.0 v2:172.21.15.31:6800/168281188 35 ==== watch-notify(notify_complete (2) cookie 94133499991840 notify 137438953502 ret 0) ==== 42+0+48 (crc 0 0 0) 0x559d29cd4650 con 0x7f6bf0031040 2024-09-22T08:37:47.949 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.940+0000 7f6c03139800 1 -- 172.21.15.142:0/2654175921 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:142 4.23 4:c5e6b267:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.9.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559d29d4cbf0 con 0x7f6bf0031040 2024-09-22T08:37:47.949 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.940+0000 7f6c03139800 1 -- 172.21.15.142:0/2654175921 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:143 4.20 4:0568296f:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.9.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559d29d41720 con 0x559d29cdf7e0 2024-09-22T08:37:47.949 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.940+0000 7f6c03139800 1 -- 172.21.15.142:0/2654175921 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:144 4.c 4:3134bd73:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.9.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559d29d30420 con 0x559d29cdf7e0 2024-09-22T08:37:47.949 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.940+0000 7f6c03139800 1 -- 172.21.15.142:0/2654175921 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:145 4.2f 4:f59797e0:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.9.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559d29d4cbf0 con 0x559d29cdf7e0 2024-09-22T08:37:47.949 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.940+0000 7f6c03139800 1 -- 172.21.15.142:0/2654175921 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:146 4.b 4:d0ed73cf:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.9.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559d29d41720 con 0x7f6bf8040040 2024-09-22T08:37:47.949 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.940+0000 7f6c03139800 1 -- 172.21.15.142:0/2654175921 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:147 4.1f 4:f9395f8a:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.9.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559d29d30420 con 0x559d29ce41f0 2024-09-22T08:37:47.950 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.940+0000 7f6c03139800 1 -- 172.21.15.142:0/2654175921 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:148 4.16 4:68dcb4be:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.9.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559d29d4cbf0 con 0x559d29ce41f0 2024-09-22T08:37:47.950 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.940+0000 7f6c03139800 1 -- 172.21.15.142:0/2654175921 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:149 4.1d 4:bb447876:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.9.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559d29d41720 con 0x559d29ce41f0 2024-09-22T08:37:47.950 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.940+0000 7f6c03139800 1 -- 172.21.15.142:0/2654175921 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:150 4.37 4:edc9c648:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.9.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559d29d4ab70 con 0x7f6bf0031040 2024-09-22T08:37:47.950 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.940+0000 7f6c03139800 1 -- 172.21.15.142:0/2654175921 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:151 4.35 4:acb4e751:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.9.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559d29d2a160 con 0x559d29cdf7e0 2024-09-22T08:37:47.950 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.940+0000 7f6c03139800 1 -- 172.21.15.142:0/2654175921 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:152 4.26 4:66f493f1:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.9.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559d29d30420 con 0x7f6bf0031040 2024-09-22T08:37:47.955 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.942+0000 7f6bfedc7640 1 -- 172.21.15.142:0/2654175921 <== osd.2 v2:172.21.15.142:6808/279438927 26 ==== osd_op_reply(146 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.9.4 [delete] v32'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f6bf000f070 con 0x7f6bf8040040 2024-09-22T08:37:47.955 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.942+0000 7f6bfe5c6640 1 -- 172.21.15.142:0/2654175921 <== osd.0 v2:172.21.15.31:6800/168281188 36 ==== osd_op_reply(142 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.9.0 [delete] v32'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f6bf4089040 con 0x7f6bf0031040 2024-09-22T08:37:47.955 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.942+0000 7f6bfe5c6640 1 -- 172.21.15.142:0/2654175921 <== osd.0 v2:172.21.15.31:6800/168281188 37 ==== osd_op_reply(150 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.9.8 [delete] v32'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f6bf4089040 con 0x7f6bf0031040 2024-09-22T08:37:47.955 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.942+0000 7f6bfe5c6640 1 -- 172.21.15.142:0/2654175921 <== osd.0 v2:172.21.15.31:6800/168281188 38 ==== osd_op_reply(152 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.9.10 [delete] v32'12 uv12 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f6bf4089040 con 0x7f6bf0031040 2024-09-22T08:37:47.955 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.942+0000 7f6bfe5c6640 1 -- 172.21.15.142:0/2654175921 <== osd.1 v2:172.21.15.142:6816/3192108003 48 ==== osd_op_reply(144 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.9.2 [delete] v32'11 uv11 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f6bf4089040 con 0x559d29cdf7e0 2024-09-22T08:37:47.955 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.942+0000 7f6bff5c8640 1 -- 172.21.15.142:0/2654175921 <== osd.3 v2:172.21.15.142:6800/1064901393 39 ==== osd_op_reply(148 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.9.6 [delete] v32'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f6bf8077070 con 0x559d29ce41f0 2024-09-22T08:37:47.955 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.942+0000 7f6bfe5c6640 1 -- 172.21.15.142:0/2654175921 <== osd.1 v2:172.21.15.142:6816/3192108003 49 ==== osd_op_reply(143 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.9.1 [delete] v32'15 uv15 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f6bf4089040 con 0x559d29cdf7e0 2024-09-22T08:37:47.955 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.942+0000 7f6bff5c8640 1 -- 172.21.15.142:0/2654175921 <== osd.3 v2:172.21.15.142:6800/1064901393 40 ==== osd_op_reply(147 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.9.5 [delete] v32'7 uv7 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f6bf8077070 con 0x559d29ce41f0 2024-09-22T08:37:47.955 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.942+0000 7f6bff5c8640 1 -- 172.21.15.142:0/2654175921 <== osd.3 v2:172.21.15.142:6800/1064901393 41 ==== osd_op_reply(149 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.9.7 [delete] v32'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f6bf8077070 con 0x559d29ce41f0 2024-09-22T08:37:47.955 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.943+0000 7f6bfe5c6640 1 -- 172.21.15.142:0/2654175921 <== osd.1 v2:172.21.15.142:6816/3192108003 50 ==== osd_op_reply(151 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.9.9 [delete] v32'8 uv8 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f6bf4089040 con 0x559d29cdf7e0 2024-09-22T08:37:47.955 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.943+0000 7f6bfe5c6640 1 -- 172.21.15.142:0/2654175921 <== osd.1 v2:172.21.15.142:6816/3192108003 51 ==== osd_op_reply(145 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.9.3 [delete] v32'8 uv8 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f6bf4089040 con 0x559d29cdf7e0 2024-09-22T08:37:47.955 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.943+0000 7f6c03139800 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo6/e239248c-0bee-4e41-803a-24b288d3eb8f.4226.9 : miss 2024-09-22T08:37:47.956 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.943+0000 7f6c03139800 20 rados->read ofs=0 len=0 2024-09-22T08:37:47.956 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.943+0000 7f6c03139800 1 -- 172.21.15.142:0/2654175921 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:153 6.4 6:23f80417:::pubsub..bucket.myfoo6%2fe239248c-0bee-4e41-803a-24b288d3eb8f.4226.9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559d29d4cbf0 con 0x559d29cdf7e0 2024-09-22T08:37:47.956 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.943+0000 7f6bfe5c6640 1 -- 172.21.15.142:0/2654175921 <== osd.1 v2:172.21.15.142:6816/3192108003 52 ==== osd_op_reply(153 pubsub..bucket.myfoo6/e239248c-0bee-4e41-803a-24b288d3eb8f.4226.9 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 209+0+0 (crc 0 0 0) 0x7f6bf4089040 con 0x559d29cdf7e0 2024-09-22T08:37:47.956 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.943+0000 7f6c03139800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:47.956 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.943+0000 7f6c03139800 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo6/e239248c-0bee-4e41-803a-24b288d3eb8f.4226.9 info.flags=0x0 2024-09-22T08:37:47.956 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.943+0000 7f6c03139800 10 adding default.rgw.log++pubsub..bucket.myfoo6/e239248c-0bee-4e41-803a-24b288d3eb8f.4226.9 to cache LRU end 2024-09-22T08:37:47.956 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.943+0000 7f6c03139800 1 -- 172.21.15.142:0/2654175921 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:154 6.4 6:23f80417:::pubsub..bucket.myfoo6%2fe239248c-0bee-4e41-803a-24b288d3eb8f.4226.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559d29d30420 con 0x559d29cdf7e0 2024-09-22T08:37:47.956 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.944+0000 7f6bfe5c6640 1 -- 172.21.15.142:0/2654175921 <== osd.1 v2:172.21.15.142:6816/3192108003 53 ==== osd_op_reply(154 pubsub..bucket.myfoo6/e239248c-0bee-4e41-803a-24b288d3eb8f.4226.9 [delete] v32'222 uv166 ondisk = -2 ((2) No such file or directory)) ==== 209+0+0 (crc 0 0 0) 0x7f6bf4089040 con 0x559d29cdf7e0 2024-09-22T08:37:47.956 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.944+0000 7f6c03139800 1 -- 172.21.15.142:0/2654175921 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:155 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.remove_bucket in=145b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559d29d4cbf0 con 0x559d29cdf7e0 2024-09-22T08:37:47.956 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.945+0000 7f6bfe5c6640 1 -- 172.21.15.142:0/2654175921 <== osd.1 v2:172.21.15.142:6816/3192108003 54 ==== osd_op_reply(155 bud.buckets [call] v32'6 uv6 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f6bf4089040 con 0x559d29cdf7e0 2024-09-22T08:37:47.956 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.945+0000 7f6c03139800 10 removing key index: NX5QOQKC6BH2IDN8HC7A 2024-09-22T08:37:47.956 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.945+0000 7f6c03139800 1 -- 172.21.15.142:0/2654175921 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:156 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559d29d30420 con 0x559d29cdf7e0 2024-09-22T08:37:47.956 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.946+0000 7f6bfe5c6640 1 -- 172.21.15.142:0/2654175921 <== osd.1 v2:172.21.15.142:6816/3192108003 55 ==== osd_op_reply(156 NX5QOQKC6BH2IDN8HC7A [delete] v32'4 uv4 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f6bf4089040 con 0x559d29cdf7e0 2024-09-22T08:37:47.957 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.946+0000 7f6c03139800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-09-22T08:37:47.957 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.946+0000 7f6c03139800 1 -- 172.21.15.142:0/2654175921 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:157 7.3 7:c609908c:::notify.5:head [notify cookie 94133499921440 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559d29d4cbf0 con 0x7f6bf0031040 2024-09-22T08:37:47.957 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.947+0000 7f6bfe5c6640 1 -- 172.21.15.142:0/2654175921 <== osd.0 v2:172.21.15.31:6800/168281188 39 ==== watch-notify(notify (1) cookie 94133499654208 notify 137438953503 ret 0) ==== 212+0+0 (crc 0 0 0) 0x559d29cd4650 con 0x7f6bf0031040 2024-09-22T08:37:47.957 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.947+0000 7f6ae1ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953503 cookie 94133499654208 notifier 4751 bl.length()=170 2024-09-22T08:37:47.957 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.947+0000 7f6bfe5c6640 1 -- 172.21.15.142:0/2654175921 <== osd.0 v2:172.21.15.31:6800/168281188 40 ==== osd_op_reply(157 notify.5 [notify cookie 94133499921440 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f6bf4089040 con 0x7f6bf0031040 2024-09-22T08:37:47.957 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.947+0000 7f6ae1ffb640 1 -- 172.21.15.142:0/2654175921 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:158 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f6a340032c0 con 0x7f6bf0031040 2024-09-22T08:37:47.957 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.947+0000 7f6bfe5c6640 1 -- 172.21.15.142:0/2654175921 <== osd.0 v2:172.21.15.31:6800/168281188 41 ==== osd_op_reply(158 notify.5 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6bf4089040 con 0x7f6bf0031040 2024-09-22T08:37:47.957 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.947+0000 7f6bfe5c6640 1 -- 172.21.15.142:0/2654175921 <== osd.0 v2:172.21.15.31:6800/168281188 42 ==== watch-notify(notify_complete (2) cookie 94133499921440 notify 137438953503 ret 0) ==== 42+0+48 (crc 0 0 0) 0x559d29cfcb50 con 0x7f6bf0031040 2024-09-22T08:37:47.957 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.947+0000 7f6c03139800 10 removing email index: 2024-09-22T08:37:47.957 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.947+0000 7f6c03139800 10 removing user buckets index 2024-09-22T08:37:47.957 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.947+0000 7f6c03139800 1 -- 172.21.15.142:0/2654175921 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:159 8.19 8:99adfd5d:users.uid::bud.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559d29d4cbf0 con 0x559d29cdf7e0 2024-09-22T08:37:47.957 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.948+0000 7f6bfe5c6640 1 -- 172.21.15.142:0/2654175921 <== osd.1 v2:172.21.15.142:6816/3192108003 56 ==== osd_op_reply(159 bud.buckets [delete] v32'7 uv7 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f6bf4089040 con 0x559d29cdf7e0 2024-09-22T08:37:47.958 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.948+0000 7f6c03139800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:bud.buckets, ofs0, ns] 2024-09-22T08:37:47.958 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.948+0000 7f6c03139800 1 -- 172.21.15.142:0/2654175921 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:160 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94133499991840 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559d29d4cbf0 con 0x7f6bf0031040 2024-09-22T08:37:47.958 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.949+0000 7f6bfe5c6640 1 -- 172.21.15.142:0/2654175921 <== osd.0 v2:172.21.15.31:6800/168281188 43 ==== watch-notify(notify (1) cookie 94133499651776 notify 137438953504 ret 0) ==== 202+0+0 (crc 0 0 0) 0x559d29cfcb50 con 0x7f6bf0031040 2024-09-22T08:37:47.958 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.949+0000 7f6ae27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953504 cookie 94133499651776 notifier 4751 bl.length()=160 2024-09-22T08:37:47.958 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.949+0000 7f6ae27fc640 1 -- 172.21.15.142:0/2654175921 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:161 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f6ac4003d60 con 0x7f6bf0031040 2024-09-22T08:37:47.958 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.949+0000 7f6bfe5c6640 1 -- 172.21.15.142:0/2654175921 <== osd.0 v2:172.21.15.31:6800/168281188 44 ==== osd_op_reply(160 notify.6 [notify cookie 94133499991840 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f6bf4089040 con 0x7f6bf0031040 2024-09-22T08:37:47.958 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.949+0000 7f6bfe5c6640 1 -- 172.21.15.142:0/2654175921 <== osd.0 v2:172.21.15.31:6800/168281188 45 ==== osd_op_reply(161 notify.6 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6bf4089040 con 0x7f6bf0031040 2024-09-22T08:37:47.958 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.949+0000 7f6bfe5c6640 1 -- 172.21.15.142:0/2654175921 <== osd.0 v2:172.21.15.31:6800/168281188 46 ==== watch-notify(notify_complete (2) cookie 94133499991840 notify 137438953504 ret 0) ==== 42+0+48 (crc 0 0 0) 0x559d29cfc980 con 0x7f6bf0031040 2024-09-22T08:37:47.958 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.949+0000 7f6c03139800 10 removing user index: bud 2024-09-22T08:37:47.958 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.949+0000 7f6c03139800 1 -- 172.21.15.142:0/2654175921 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:162 8.4 8:267425a8:users.uid::bud:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559d29d4cbf0 con 0x7f6bf8040040 2024-09-22T08:37:47.958 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.950+0000 7f6bfedc7640 1 -- 172.21.15.142:0/2654175921 <== osd.2 v2:172.21.15.142:6808/279438927 27 ==== osd_op_reply(162 bud [call,call,delete] v32'4 uv4 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f6bf000f070 con 0x7f6bf8040040 2024-09-22T08:37:47.958 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.950+0000 7f6c03139800 10 removing default.rgw.meta+users.uid+bud from cache 2024-09-22T08:37:47.959 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.950+0000 7f6c03139800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:bud, ofs0, ns] 2024-09-22T08:37:47.959 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.950+0000 7f6c03139800 1 -- 172.21.15.142:0/2654175921 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:163 7.3 7:c609908c:::notify.5:head [notify cookie 94133499991840 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559d29d4cbf0 con 0x7f6bf0031040 2024-09-22T08:37:47.959 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.951+0000 7f6bfe5c6640 1 -- 172.21.15.142:0/2654175921 <== osd.0 v2:172.21.15.31:6800/168281188 47 ==== watch-notify(notify (1) cookie 94133499654208 notify 137438953505 ret 0) ==== 194+0+0 (crc 0 0 0) 0x559d29cfc980 con 0x7f6bf0031040 2024-09-22T08:37:47.959 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.951+0000 7f6ae1ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953505 cookie 94133499654208 notifier 4751 bl.length()=152 2024-09-22T08:37:47.959 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.951+0000 7f6ae1ffb640 1 -- 172.21.15.142:0/2654175921 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:164 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f6a340032c0 con 0x7f6bf0031040 2024-09-22T08:37:47.959 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.951+0000 7f6bfe5c6640 1 -- 172.21.15.142:0/2654175921 <== osd.0 v2:172.21.15.31:6800/168281188 48 ==== osd_op_reply(163 notify.5 [notify cookie 94133499991840 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f6bf4089040 con 0x7f6bf0031040 2024-09-22T08:37:47.959 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.951+0000 7f6bfe5c6640 1 -- 172.21.15.142:0/2654175921 <== osd.0 v2:172.21.15.31:6800/168281188 49 ==== osd_op_reply(164 notify.5 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6bf4089040 con 0x7f6bf0031040 2024-09-22T08:37:47.959 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.951+0000 7f6bfe5c6640 1 -- 172.21.15.142:0/2654175921 <== osd.0 v2:172.21.15.31:6800/168281188 50 ==== watch-notify(notify_complete (2) cookie 94133499991840 notify 137438953505 ret 0) ==== 42+0+48 (crc 0 0 0) 0x559d29cfcd60 con 0x7f6bf0031040 2024-09-22T08:37:47.959 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.952+0000 7f6ab57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:37:47.959 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.952+0000 7f6c03139800 1 -- 172.21.15.142:0/2654175921 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:165 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94133499656336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559d29d4cbf0 con 0x559d29cdf7e0 2024-09-22T08:37:47.959 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.953+0000 7f6bfe5c6640 1 -- 172.21.15.142:0/2654175921 <== osd.1 v2:172.21.15.142:6816/3192108003 57 ==== osd_op_reply(165 data_loggenerations_metadata [watch unwatch cookie 94133499656336] v32'223 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6bf4089040 con 0x559d29cdf7e0 2024-09-22T08:37:47.959 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.953+0000 7f6c03139800 1 -- 172.21.15.142:0/2654175921 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:166 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94133499633712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559d29d4cbf0 con 0x7f6bf8040040 2024-09-22T08:37:47.961 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.954+0000 7f6bfedc7640 1 -- 172.21.15.142:0/2654175921 <== osd.2 v2:172.21.15.142:6808/279438927 28 ==== osd_op_reply(166 notify.0 [watch unwatch cookie 94133499633712] v32'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6bf000f070 con 0x7f6bf8040040 2024-09-22T08:37:47.961 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.954+0000 7f6c03139800 20 remove_watcher() i=0 2024-09-22T08:37:47.962 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.954+0000 7f6c03139800 2 removed watcher, disabling cache 2024-09-22T08:37:47.962 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.954+0000 7f6c03139800 1 -- 172.21.15.142:0/2654175921 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:167 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94133499640848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559d29d4cbf0 con 0x559d29cdf7e0 2024-09-22T08:37:47.962 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.955+0000 7f6bfe5c6640 1 -- 172.21.15.142:0/2654175921 <== osd.1 v2:172.21.15.142:6816/3192108003 58 ==== osd_op_reply(167 notify.1 [watch unwatch cookie 94133499640848] v32'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6bf4089040 con 0x559d29cdf7e0 2024-09-22T08:37:47.962 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.955+0000 7f6c03139800 20 remove_watcher() i=1 2024-09-22T08:37:47.962 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.955+0000 7f6c03139800 1 -- 172.21.15.142:0/2654175921 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:168 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94133499643584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559d29d4cbf0 con 0x559d29ce41f0 2024-09-22T08:37:47.962 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.956+0000 7f6bff5c8640 1 -- 172.21.15.142:0/2654175921 <== osd.3 v2:172.21.15.142:6800/1064901393 42 ==== osd_op_reply(168 notify.2 [watch unwatch cookie 94133499643584] v32'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6bf8077070 con 0x559d29ce41f0 2024-09-22T08:37:47.962 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.956+0000 7f6c03139800 20 remove_watcher() i=2 2024-09-22T08:37:47.962 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.956+0000 7f6c03139800 1 -- 172.21.15.142:0/2654175921 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:169 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94133499647952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559d29d4cbf0 con 0x7f6bf8040040 2024-09-22T08:37:47.962 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.958+0000 7f6bfedc7640 1 -- 172.21.15.142:0/2654175921 <== osd.2 v2:172.21.15.142:6808/279438927 29 ==== osd_op_reply(169 notify.3 [watch unwatch cookie 94133499647952] v32'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6bf000f070 con 0x7f6bf8040040 2024-09-22T08:37:47.962 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.958+0000 7f6c03139800 20 remove_watcher() i=3 2024-09-22T08:37:47.962 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.958+0000 7f6c03139800 1 -- 172.21.15.142:0/2654175921 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:170 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94133499650656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559d29d4cbf0 con 0x559d29cdf7e0 2024-09-22T08:37:47.962 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.959+0000 7f6bfe5c6640 1 -- 172.21.15.142:0/2654175921 <== osd.1 v2:172.21.15.142:6816/3192108003 59 ==== osd_op_reply(170 notify.4 [watch unwatch cookie 94133499650656] v32'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6bf4089040 con 0x559d29cdf7e0 2024-09-22T08:37:47.963 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.959+0000 7f6c03139800 20 remove_watcher() i=4 2024-09-22T08:37:47.963 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.959+0000 7f6c03139800 1 -- 172.21.15.142:0/2654175921 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:171 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94133499654208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559d29d4cbf0 con 0x7f6bf0031040 2024-09-22T08:37:47.963 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.960+0000 7f6bfe5c6640 1 -- 172.21.15.142:0/2654175921 <== osd.0 v2:172.21.15.31:6800/168281188 51 ==== osd_op_reply(171 notify.5 [watch unwatch cookie 94133499654208] v32'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6bf4089040 con 0x7f6bf0031040 2024-09-22T08:37:47.963 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.960+0000 7f6c03139800 20 remove_watcher() i=5 2024-09-22T08:37:47.963 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.960+0000 7f6c03139800 1 -- 172.21.15.142:0/2654175921 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:172 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94133499651776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559d29d4cbf0 con 0x7f6bf0031040 2024-09-22T08:37:47.966 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.961+0000 7f6bfe5c6640 1 -- 172.21.15.142:0/2654175921 <== osd.0 v2:172.21.15.31:6800/168281188 52 ==== osd_op_reply(172 notify.6 [watch unwatch cookie 94133499651776] v32'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6bf4089040 con 0x7f6bf0031040 2024-09-22T08:37:47.966 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.961+0000 7f6c03139800 20 remove_watcher() i=6 2024-09-22T08:37:47.966 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.961+0000 7f6c03139800 1 -- 172.21.15.142:0/2654175921 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:173 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94133499660704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559d29d4cbf0 con 0x7f6bf0031040 2024-09-22T08:37:47.966 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.962+0000 7f6bfe5c6640 1 -- 172.21.15.142:0/2654175921 <== osd.0 v2:172.21.15.31:6800/168281188 53 ==== osd_op_reply(173 notify.7 [watch unwatch cookie 94133499660704] v32'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6bf4089040 con 0x7f6bf0031040 2024-09-22T08:37:47.966 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.962+0000 7f6c03139800 20 remove_watcher() i=7 2024-09-22T08:37:47.967 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.962+0000 7f6c03139800 1 -- 172.21.15.142:0/2654175921 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f6bf0031040 msgr2=0x7f6bf0032430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:47.967 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.962+0000 7f6c03139800 1 --2- 172.21.15.142:0/2654175921 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f6bf0031040 0x7f6bf0032430 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:47.967 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.962+0000 7f6c03139800 1 -- 172.21.15.142:0/2654175921 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x559d29cdf7e0 msgr2=0x559d29ce1ca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:47.967 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.963+0000 7f6c03139800 1 --2- 172.21.15.142:0/2654175921 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x559d29cdf7e0 0x559d29ce1ca0 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:47.967 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.963+0000 7f6c03139800 1 -- 172.21.15.142:0/2654175921 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f6bf8040040 msgr2=0x7f6bf8037a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:47.967 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.963+0000 7f6c03139800 1 --2- 172.21.15.142:0/2654175921 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f6bf8040040 0x7f6bf8037a90 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:47.967 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.963+0000 7f6c03139800 1 -- 172.21.15.142:0/2654175921 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x559d29ce41f0 msgr2=0x559d29ce65e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:47.967 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.963+0000 7f6c03139800 1 --2- 172.21.15.142:0/2654175921 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x559d29ce41f0 0x559d29ce65e0 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:47.967 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.963+0000 7f6c03139800 1 -- 172.21.15.142:0/2654175921 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f6ac803cfb0 msgr2=0x7f6ac803f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:47.967 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.963+0000 7f6c03139800 1 --2- 172.21.15.142:0/2654175921 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f6ac803cfb0 0x7f6ac803f470 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f6bf0010550 tx=0x7f6bf0043000 comp rx=0 tx=0).stop 2024-09-22T08:37:47.967 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.963+0000 7f6c03139800 1 -- 172.21.15.142:0/2654175921 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559d29ccc860 msgr2=0x559d29cd3e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:47.967 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.963+0000 7f6c03139800 1 --2- 172.21.15.142:0/2654175921 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559d29ccc860 0x559d29cd3e60 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f6bf80540f0 tx=0x7f6bf8053ce0 comp rx=0 tx=0).stop 2024-09-22T08:37:47.968 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.963+0000 7f6bfe5c6640 1 -- 172.21.15.142:0/2654175921 reap_dead start 2024-09-22T08:37:47.968 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.963+0000 7f6c03139800 1 -- 172.21.15.142:0/2654175921 shutdown_connections 2024-09-22T08:37:47.968 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.963+0000 7f6c03139800 1 --2- 172.21.15.142:0/2654175921 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559d29ccc860 0x559d29cd3e60 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:47.968 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.963+0000 7f6c03139800 1 -- 172.21.15.142:0/2654175921 >> 172.21.15.142:0/2654175921 conn(0x559d29cc8c60 msgr2=0x559d29cc6e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:37:47.968 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.963+0000 7f6c03139800 1 -- 172.21.15.142:0/2654175921 shutdown_connections 2024-09-22T08:37:47.968 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.963+0000 7f6c03139800 1 -- 172.21.15.142:0/2654175921 wait complete. 2024-09-22T08:37:47.968 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.963+0000 7f6c03139800 1 -- 172.21.15.142:0/3862701450 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f6ad803d000 msgr2=0x7f6ad803f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:47.968 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.963+0000 7f6c03139800 1 --2- 172.21.15.142:0/3862701450 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f6ad803d000 0x7f6ad803f4c0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x559d29ca6eb0 tx=0x7f6bf0025e80 comp rx=0 tx=0).stop 2024-09-22T08:37:47.968 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.963+0000 7f6c03139800 1 -- 172.21.15.142:0/3862701450 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559d29cbfda0 msgr2=0x559d29cc01c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:47.968 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.963+0000 7f6c03139800 1 --2- 172.21.15.142:0/3862701450 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559d29cbfda0 0x559d29cc01c0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x559d29ca5bf0 tx=0x7f6bf800bf30 comp rx=0 tx=0).stop 2024-09-22T08:37:47.968 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.963+0000 7f6c03139800 1 -- 172.21.15.142:0/3862701450 shutdown_connections 2024-09-22T08:37:47.968 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.963+0000 7f6c03139800 1 --2- 172.21.15.142:0/3862701450 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f6ad803d000 0x7f6ad803f4c0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:47.969 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.963+0000 7f6c03139800 1 --2- 172.21.15.142:0/3862701450 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559d29cbfda0 0x559d29cc01c0 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:47.969 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.963+0000 7f6c03139800 1 -- 172.21.15.142:0/3862701450 >> 172.21.15.142:0/3862701450 conn(0x559d29cb4150 msgr2=0x559d29cb4530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:37:47.969 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.963+0000 7f6c03139800 1 -- 172.21.15.142:0/3862701450 shutdown_connections 2024-09-22T08:37:47.969 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.963+0000 7f6c03139800 1 -- 172.21.15.142:0/3862701450 wait complete. 2024-09-22T08:37:47.969 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.964+0000 7f6c03139800 1 -- 172.21.15.142:0/797717325 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x559d29bb1c00 msgr2=0x559d29cac3b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:47.969 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.964+0000 7f6c03139800 1 --2- 172.21.15.142:0/797717325 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x559d29bb1c00 0x559d29cac3b0 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:47.969 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.964+0000 7f6c03139800 1 -- 172.21.15.142:0/797717325 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x559d29cae750 msgr2=0x559d29cb0bf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:47.969 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.964+0000 7f6c03139800 1 --2- 172.21.15.142:0/797717325 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x559d29cae750 0x559d29cb0bf0 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:47.969 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.964+0000 7f6c03139800 1 -- 172.21.15.142:0/797717325 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f6ae403d000 msgr2=0x7f6ae403f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:47.969 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.964+0000 7f6c03139800 1 --2- 172.21.15.142:0/797717325 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f6ae403d000 0x7f6ae403f4c0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f6bf4057000 tx=0x7f6bf4052000 comp rx=0 tx=0).stop 2024-09-22T08:37:47.969 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.964+0000 7f6c03139800 1 -- 172.21.15.142:0/797717325 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559d29b1f530 msgr2=0x559d29ca4d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:47.969 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.964+0000 7f6c03139800 1 --2- 172.21.15.142:0/797717325 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559d29b1f530 0x559d29ca4d60 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x559d29c9e160 tx=0x7f6bf0001250 comp rx=0 tx=0).stop 2024-09-22T08:37:47.969 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.964+0000 7f6c03139800 1 -- 172.21.15.142:0/797717325 shutdown_connections 2024-09-22T08:37:47.970 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.964+0000 7f6c03139800 1 --2- 172.21.15.142:0/797717325 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x559d29cae750 0x559d29cb0bf0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:47.970 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.964+0000 7f6c03139800 1 --2- 172.21.15.142:0/797717325 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x559d29bb1c00 0x559d29cac3b0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:47.970 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.964+0000 7f6c03139800 1 --2- 172.21.15.142:0/797717325 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f6ae403d000 0x7f6ae403f4c0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:47.970 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.964+0000 7f6c03139800 1 --2- 172.21.15.142:0/797717325 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559d29b1f530 0x559d29ca4d60 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:47.970 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.964+0000 7f6c03139800 1 -- 172.21.15.142:0/797717325 >> 172.21.15.142:0/797717325 conn(0x559d29ba5be0 msgr2=0x559d29c9e6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:37:47.970 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.964+0000 7f6c03139800 1 -- 172.21.15.142:0/797717325 shutdown_connections 2024-09-22T08:37:47.970 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:47.964+0000 7f6c03139800 1 -- 172.21.15.142:0/797717325 wait complete. 2024-09-22T08:37:47.973 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud', '--purge-data'] 2024-09-22T08:37:47.974 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud', '--purge-data'] 2024-09-22T08:37:47.974 DEBUG:teuthology.orchestra.run.smithi142:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud --purge-data 2024-09-22T08:37:48.019 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:37:48.019 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:37:48.021 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.019+0000 7fa34c62f800 1 Processor -- start 2024-09-22T08:37:48.021 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.019+0000 7fa34c62f800 1 -- start start 2024-09-22T08:37:48.021 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.019+0000 7fa34c62f800 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55e4843ddbe0 0x55e4843ddfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:48.021 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.019+0000 7fa34c62f800 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55e48426aa20 con 0x55e4843e2850 2024-09-22T08:37:48.021 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.019+0000 7fa34c62f800 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x55e48426a7d0 con 0x55e4843ddbe0 2024-09-22T08:37:48.021 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.019+0000 7fa34a119640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55e4843ddbe0 0x55e4843ddfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:48.021 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.019+0000 7fa343fff640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x55e4843e2850 0x55e4843e4cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.142:50328/0 (socket says 172.21.15.142:50328) 2024-09-22T08:37:48.021 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.019+0000 7fa34a119640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55e4843ddbe0 0x55e4843ddfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:56144/0 (socket says 172.21.15.142:56144) 2024-09-22T08:37:48.021 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.019+0000 7fa343fff640 1 -- 172.21.15.142:0/3576547796 learned_addr learned my addr 172.21.15.142:0/3576547796 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-09-22T08:37:48.021 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.020+0000 7fa34a119640 1 -- 172.21.15.142:0/3576547796 >> v1:172.21.15.31:6789/0 conn(0x55e4843e2850 legacy=0x55e4843e4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:48.021 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.020+0000 7fa34a119640 1 -- 172.21.15.142:0/3576547796 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e4843e7580 con 0x55e4843ddbe0 2024-09-22T08:37:48.023 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.021+0000 7fa34a119640 1 --2- 172.21.15.142:0/3576547796 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e4843ddbe0 0x55e4843ddfe0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fa33c00a470 tx=0x7fa33c045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a22206c1474d6a49 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:48.023 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.022+0000 7fa349918640 1 -- 172.21.15.142:0/3576547796 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa33c053570 con 0x55e4843ddbe0 2024-09-22T08:37:48.023 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.022+0000 7fa349918640 1 -- 172.21.15.142:0/3576547796 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa33c058070 con 0x55e4843ddbe0 2024-09-22T08:37:48.023 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.022+0000 7fa349918640 1 -- 172.21.15.142:0/3576547796 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa33c053880 con 0x55e4843ddbe0 2024-09-22T08:37:48.024 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.022+0000 7fa34c62f800 1 -- 172.21.15.142:0/3576547796 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e4843ddbe0 msgr2=0x55e4843ddfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:48.024 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.022+0000 7fa34c62f800 1 --2- 172.21.15.142:0/3576547796 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e4843ddbe0 0x55e4843ddfe0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fa33c00a470 tx=0x7fa33c045a20 comp rx=0 tx=0).stop 2024-09-22T08:37:48.024 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.022+0000 7fa34c62f800 1 -- 172.21.15.142:0/3576547796 shutdown_connections 2024-09-22T08:37:48.024 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.022+0000 7fa34c62f800 1 --2- 172.21.15.142:0/3576547796 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e4843ddbe0 0x55e4843ddfe0 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:48.024 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.022+0000 7fa34c62f800 1 -- 172.21.15.142:0/3576547796 >> 172.21.15.142:0/3576547796 conn(0x55e4843d9310 msgr2=0x55e4843db790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:37:48.024 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.022+0000 7fa34c62f800 1 -- 172.21.15.142:0/3576547796 shutdown_connections 2024-09-22T08:37:48.024 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.022+0000 7fa34c62f800 1 -- 172.21.15.142:0/3576547796 wait complete. 2024-09-22T08:37:48.038 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.036+0000 7fa34c62f800 1 Processor -- start 2024-09-22T08:37:48.039 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.036+0000 7fa34c62f800 1 -- start start 2024-09-22T08:37:48.039 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.036+0000 7fa34c62f800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e4843ddbe0 0x55e4843dffb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:48.039 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.036+0000 7fa34c62f800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55e484277dd0 con 0x55e4843ddbe0 2024-09-22T08:37:48.039 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.036+0000 7fa34a119640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e4843ddbe0 0x55e4843dffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:48.039 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.036+0000 7fa34a119640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e4843ddbe0 0x55e4843dffb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:56150/0 (socket says 172.21.15.142:56150) 2024-09-22T08:37:48.039 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.036+0000 7fa34a119640 1 -- 172.21.15.142:0/925259284 learned_addr learned my addr 172.21.15.142:0/925259284 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:37:48.039 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.037+0000 7fa34a119640 1 -- 172.21.15.142:0/925259284 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e4843e05a0 con 0x55e4843ddbe0 2024-09-22T08:37:48.039 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.037+0000 7fa34a119640 1 --2- 172.21.15.142:0/925259284 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e4843ddbe0 0x55e4843dffb0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fa33c025c20 tx=0x7fa33c051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc772c1576048d39 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:48.039 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.037+0000 7fa238608640 1 -- 172.21.15.142:0/925259284 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa33c053a20 con 0x55e4843ddbe0 2024-09-22T08:37:48.039 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.037+0000 7fa238608640 1 -- 172.21.15.142:0/925259284 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa33c063070 con 0x55e4843ddbe0 2024-09-22T08:37:48.040 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.037+0000 7fa238608640 1 -- 172.21.15.142:0/925259284 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa33c053cf0 con 0x55e4843ddbe0 2024-09-22T08:37:48.044 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.038+0000 7fa34c62f800 1 -- 172.21.15.142:0/925259284 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e4843ddbe0 msgr2=0x55e4843dffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:48.044 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.038+0000 7fa34c62f800 1 --2- 172.21.15.142:0/925259284 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e4843ddbe0 0x55e4843dffb0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fa33c025c20 tx=0x7fa33c051000 comp rx=0 tx=0).stop 2024-09-22T08:37:48.044 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.038+0000 7fa34c62f800 1 -- 172.21.15.142:0/925259284 shutdown_connections 2024-09-22T08:37:48.044 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.038+0000 7fa34c62f800 1 --2- 172.21.15.142:0/925259284 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e4843ddbe0 0x55e4843dffb0 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:48.045 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.038+0000 7fa34c62f800 1 -- 172.21.15.142:0/925259284 >> 172.21.15.142:0/925259284 conn(0x55e4843d9310 msgr2=0x55e4844ca9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:37:48.045 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.038+0000 7fa34c62f800 1 -- 172.21.15.142:0/925259284 shutdown_connections 2024-09-22T08:37:48.045 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.038+0000 7fa34c62f800 1 -- 172.21.15.142:0/925259284 wait complete. 2024-09-22T08:37:48.045 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.038+0000 7fa34c62f800 1 Processor -- start 2024-09-22T08:37:48.045 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.038+0000 7fa34c62f800 1 -- start start 2024-09-22T08:37:48.045 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.038+0000 7fa34c62f800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e4843ddbe0 0x55e4844d8d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:48.045 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.038+0000 7fa34c62f800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55e4843e6820 con 0x55e4843ddbe0 2024-09-22T08:37:48.045 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.039+0000 7fa34a119640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e4843ddbe0 0x55e4844d8d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:48.045 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.039+0000 7fa34a119640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e4843ddbe0 0x55e4844d8d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:56162/0 (socket says 172.21.15.142:56162) 2024-09-22T08:37:48.045 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.039+0000 7fa34a119640 1 -- 172.21.15.142:0/1862155703 learned_addr learned my addr 172.21.15.142:0/1862155703 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:37:48.045 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.039+0000 7fa34a119640 1 -- 172.21.15.142:0/1862155703 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e4844d9270 con 0x55e4843ddbe0 2024-09-22T08:37:48.045 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.039+0000 7fa34a119640 1 --2- 172.21.15.142:0/1862155703 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e4843ddbe0 0x55e4844d8d10 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fa33c025c20 tx=0x7fa33c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:48.046 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.039+0000 7fa236e05640 1 -- 172.21.15.142:0/1862155703 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa33c068660 con 0x55e4843ddbe0 2024-09-22T08:37:48.046 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.039+0000 7fa236e05640 1 -- 172.21.15.142:0/1862155703 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa33c068800 con 0x55e4843ddbe0 2024-09-22T08:37:48.046 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.039+0000 7fa236e05640 1 -- 172.21.15.142:0/1862155703 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa33c068ae0 con 0x55e4843ddbe0 2024-09-22T08:37:48.046 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.039+0000 7fa34c62f800 1 -- 172.21.15.142:0/1862155703 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e4844d9500 con 0x55e4843ddbe0 2024-09-22T08:37:48.046 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.039+0000 7fa34c62f800 1 -- 172.21.15.142:0/1862155703 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e4844da110 con 0x55e4843ddbe0 2024-09-22T08:37:48.046 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.040+0000 7fa236e05640 1 -- 172.21.15.142:0/1862155703 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fa33c068c80 con 0x55e4843ddbe0 2024-09-22T08:37:48.046 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.040+0000 7fa236e05640 1 --2- 172.21.15.142:0/1862155703 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fa23003cfb0 0x7fa23003f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:48.046 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.040+0000 7fa236e05640 1 -- 172.21.15.142:0/1862155703 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5938+0+0 (secure 0 0 0) 0x7fa33c098d20 con 0x55e4843ddbe0 2024-09-22T08:37:48.046 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.040+0000 7fa343fff640 1 --2- 172.21.15.142:0/1862155703 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fa23003cfb0 0x7fa23003f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:48.046 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.041+0000 7fa34c62f800 1 --2- 172.21.15.142:0/1862155703 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55e4843e2850 0x55e4844e0360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:48.046 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.041+0000 7fa34c62f800 1 -- 172.21.15.142:0/1862155703 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e4844e08a0 con 0x55e4843e2850 2024-09-22T08:37:48.047 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.041+0000 7fa34a91a640 1 --2- 172.21.15.142:0/1862155703 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55e4843e2850 0x55e4844e0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:48.047 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.041+0000 7fa343fff640 1 --2- 172.21.15.142:0/1862155703 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fa23003cfb0 0x7fa23003f470 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fa334001d70 tx=0x7fa3340012d0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:48.047 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.041+0000 7fa34a91a640 1 --2- 172.21.15.142:0/1862155703 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55e4843e2850 0x55e4844e0360 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:48.047 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.041+0000 7fa34a91a640 1 -- 172.21.15.142:0/1862155703 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa34400a4d0 con 0x55e4843e2850 2024-09-22T08:37:48.047 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.041+0000 7fa34c62f800 1 -- 172.21.15.142:0/1862155703 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e4844e0c40 con 0x55e4843e2850 2024-09-22T08:37:48.047 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.042+0000 7fa34a91a640 1 -- 172.21.15.142:0/1862155703 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa34400a4d0 con 0x55e4843e2850 2024-09-22T08:37:48.047 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.042+0000 7fa34c62f800 1 --2- 172.21.15.142:0/1862155703 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55e4844e2700 0x55e4844e4ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:48.047 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.042+0000 7fa34c62f800 1 -- 172.21.15.142:0/1862155703 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:3 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e4844e5330 con 0x55e4844e2700 2024-09-22T08:37:48.047 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.042+0000 7fa34a119640 1 --2- 172.21.15.142:0/1862155703 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55e4844e2700 0x55e4844e4ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:48.047 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.042+0000 7fa34a119640 1 --2- 172.21.15.142:0/1862155703 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55e4844e2700 0x55e4844e4ba0 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:48.047 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.042+0000 7fa34a119640 1 -- 172.21.15.142:0/1862155703 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(3 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fa33c051070 con 0x55e4844e2700 2024-09-22T08:37:48.048 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.042+0000 7fa34c62f800 1 -- 172.21.15.142:0/1862155703 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e4844e1490 con 0x55e4843e2850 2024-09-22T08:37:48.060 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.043+0000 7fa34a91a640 1 -- 172.21.15.142:0/1862155703 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa34400a4d0 con 0x55e4843e2850 2024-09-22T08:37:48.061 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.043+0000 7fa34c62f800 1 -- 172.21.15.142:0/1862155703 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e4844e1870 con 0x55e4844e2700 2024-09-22T08:37:48.061 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.043+0000 7fa34a119640 1 -- 172.21.15.142:0/1862155703 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(5 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fa33c051070 con 0x55e4844e2700 2024-09-22T08:37:48.061 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.043+0000 7fa34c62f800 1 Processor -- start 2024-09-22T08:37:48.061 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.043+0000 7fa34c62f800 1 -- start start 2024-09-22T08:37:48.061 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.043+0000 7fa34c62f800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e4844f3cf0 0x55e4844f4110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:48.061 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.043+0000 7fa34c62f800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55e4842d6d50 con 0x55e4844f3cf0 2024-09-22T08:37:48.061 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.043+0000 7fa34a91a640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e4844f3cf0 0x55e4844f4110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:48.061 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.043+0000 7fa34a91a640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e4844f3cf0 0x55e4844f4110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:56172/0 (socket says 172.21.15.142:56172) 2024-09-22T08:37:48.061 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.044+0000 7fa34a91a640 1 -- 172.21.15.142:0/1403157973 learned_addr learned my addr 172.21.15.142:0/1403157973 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:37:48.061 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.044+0000 7fa34a91a640 1 -- 172.21.15.142:0/1403157973 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e4844f4750 con 0x55e4844f3cf0 2024-09-22T08:37:48.062 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.044+0000 7fa34a91a640 1 --2- 172.21.15.142:0/1403157973 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e4844f3cf0 0x55e4844f4110 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x55e4844d9d10 tx=0x7fa3440167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:48.062 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.044+0000 7fa22ffff640 1 -- 172.21.15.142:0/1403157973 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa344013640 con 0x55e4844f3cf0 2024-09-22T08:37:48.062 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.044+0000 7fa22ffff640 1 -- 172.21.15.142:0/1403157973 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3440137e0 con 0x55e4844f3cf0 2024-09-22T08:37:48.062 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.044+0000 7fa34c62f800 1 -- 172.21.15.142:0/1403157973 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e4844f4f80 con 0x55e4844f3cf0 2024-09-22T08:37:48.062 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.044+0000 7fa22ffff640 1 -- 172.21.15.142:0/1403157973 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa344013ae0 con 0x55e4844f3cf0 2024-09-22T08:37:48.062 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.044+0000 7fa34c62f800 1 -- 172.21.15.142:0/1403157973 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e4844f5520 con 0x55e4844f3cf0 2024-09-22T08:37:48.062 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.045+0000 7fa22ffff640 1 -- 172.21.15.142:0/1403157973 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fa344011040 con 0x55e4844f3cf0 2024-09-22T08:37:48.062 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.045+0000 7fa22ffff640 1 --2- 172.21.15.142:0/1403157973 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fa22403cfb0 0x7fa22403f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:48.062 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.045+0000 7fa22ffff640 1 -- 172.21.15.142:0/1403157973 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5938+0+0 (secure 0 0 0) 0x7fa34400e040 con 0x55e4844f3cf0 2024-09-22T08:37:48.062 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.045+0000 7fa34a119640 1 --2- 172.21.15.142:0/1403157973 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fa22403cfb0 0x7fa22403f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:48.062 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.045+0000 7fa34c62f800 1 Processor -- start 2024-09-22T08:37:48.062 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.046+0000 7fa34c62f800 1 -- start start 2024-09-22T08:37:48.063 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.046+0000 7fa34a119640 1 --2- 172.21.15.142:0/1403157973 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fa22403cfb0 0x7fa22403f470 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x55e4844dae10 tx=0x7fa33c05da60 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:48.063 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.046+0000 7fa34c62f800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e484500810 0x55e484500c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:48.063 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.046+0000 7fa34c62f800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55e4843de9f0 con 0x55e484500810 2024-09-22T08:37:48.063 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.046+0000 7fa34a91a640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e484500810 0x55e484500c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:48.063 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.046+0000 7fa34a91a640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e484500810 0x55e484500c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:56174/0 (socket says 172.21.15.142:56174) 2024-09-22T08:37:48.063 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.046+0000 7fa34a91a640 1 -- 172.21.15.142:0/2174066849 learned_addr learned my addr 172.21.15.142:0/2174066849 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:37:48.063 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.046+0000 7fa34a91a640 1 -- 172.21.15.142:0/2174066849 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e484501200 con 0x55e484500810 2024-09-22T08:37:48.063 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.046+0000 7fa34a91a640 1 --2- 172.21.15.142:0/2174066849 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e484500810 0x55e484500c10 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fa344020000 tx=0x7fa34401f400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9cff0759e2aafe6 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:48.063 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.046+0000 7fa22dffb640 1 -- 172.21.15.142:0/2174066849 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa344051070 con 0x55e484500810 2024-09-22T08:37:48.063 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.046+0000 7fa22dffb640 1 -- 172.21.15.142:0/2174066849 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa344021960 con 0x55e484500810 2024-09-22T08:37:48.063 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.046+0000 7fa22dffb640 1 -- 172.21.15.142:0/2174066849 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa344021440 con 0x55e484500810 2024-09-22T08:37:48.064 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.047+0000 7fa34c62f800 1 -- 172.21.15.142:0/2174066849 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e484500810 msgr2=0x55e484500c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:48.064 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.047+0000 7fa34c62f800 1 --2- 172.21.15.142:0/2174066849 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e484500810 0x55e484500c10 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fa344020000 tx=0x7fa34401f400 comp rx=0 tx=0).stop 2024-09-22T08:37:48.064 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.047+0000 7fa34c62f800 1 -- 172.21.15.142:0/2174066849 shutdown_connections 2024-09-22T08:37:48.064 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.047+0000 7fa34c62f800 1 --2- 172.21.15.142:0/2174066849 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e484500810 0x55e484500c10 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:48.064 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.047+0000 7fa34c62f800 1 -- 172.21.15.142:0/2174066849 >> 172.21.15.142:0/2174066849 conn(0x55e4844fcc10 msgr2=0x55e4844fae50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:37:48.064 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.047+0000 7fa34c62f800 1 -- 172.21.15.142:0/2174066849 shutdown_connections 2024-09-22T08:37:48.064 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.047+0000 7fa34c62f800 1 -- 172.21.15.142:0/2174066849 wait complete. 2024-09-22T08:37:48.064 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.047+0000 7fa34c62f800 1 Processor -- start 2024-09-22T08:37:48.064 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.047+0000 7fa34c62f800 1 -- start start 2024-09-22T08:37:48.064 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.047+0000 7fa34c62f800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e484500810 0x55e484507df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:48.064 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.047+0000 7fa34c62f800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55e484501820 con 0x55e484500810 2024-09-22T08:37:48.064 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.048+0000 7fa34a91a640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e484500810 0x55e484507df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:48.065 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.048+0000 7fa34a91a640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e484500810 0x55e484507df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:56186/0 (socket says 172.21.15.142:56186) 2024-09-22T08:37:48.065 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.048+0000 7fa34a91a640 1 -- 172.21.15.142:0/3008570934 learned_addr learned my addr 172.21.15.142:0/3008570934 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:37:48.065 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.048+0000 7fa34a91a640 1 -- 172.21.15.142:0/3008570934 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e484508350 con 0x55e484500810 2024-09-22T08:37:48.065 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.048+0000 7fa34a91a640 1 --2- 172.21.15.142:0/3008570934 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e484500810 0x55e484507df0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fa344054800 tx=0x7fa344054860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:48.065 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.049+0000 7fa21bfff640 1 -- 172.21.15.142:0/3008570934 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa344054ad0 con 0x55e484500810 2024-09-22T08:37:48.065 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.049+0000 7fa21bfff640 1 -- 172.21.15.142:0/3008570934 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa344020de0 con 0x55e484500810 2024-09-22T08:37:48.065 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.049+0000 7fa34c62f800 1 -- 172.21.15.142:0/3008570934 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e4845085e0 con 0x55e484500810 2024-09-22T08:37:48.065 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.049+0000 7fa21bfff640 1 -- 172.21.15.142:0/3008570934 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa34401fbc0 con 0x55e484500810 2024-09-22T08:37:48.065 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.049+0000 7fa34c62f800 1 -- 172.21.15.142:0/3008570934 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e484509170 con 0x55e484500810 2024-09-22T08:37:48.065 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.049+0000 7fa21bfff640 1 -- 172.21.15.142:0/3008570934 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fa34401f500 con 0x55e484500810 2024-09-22T08:37:48.065 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.050+0000 7fa21bfff640 1 --2- 172.21.15.142:0/3008570934 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fa21403d000 0x7fa21403f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:48.065 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.050+0000 7fa21bfff640 1 -- 172.21.15.142:0/3008570934 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5938+0+0 (secure 0 0 0) 0x7fa344033b90 con 0x55e484500810 2024-09-22T08:37:48.065 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.050+0000 7fa34a119640 1 --2- 172.21.15.142:0/3008570934 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fa21403d000 0x7fa21403f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:48.065 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.050+0000 7fa34a119640 1 --2- 172.21.15.142:0/3008570934 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fa21403d000 0x7fa21403f4c0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fa33c097430 tx=0x7fa33c089000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:48.066 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.050+0000 7fa34c62f800 20 rados->read ofs=0 len=0 2024-09-22T08:37:48.066 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.050+0000 7fa34c62f800 1 --2- 172.21.15.142:0/3008570934 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55e484513720 0x55e484515be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:48.066 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.050+0000 7fa34c62f800 1 -- 172.21.15.142:0/3008570934 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e484516330 con 0x55e484513720 2024-09-22T08:37:48.066 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.051+0000 7fa343fff640 1 --2- 172.21.15.142:0/3008570934 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55e484513720 0x55e484515be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:48.066 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.051+0000 7fa343fff640 1 --2- 172.21.15.142:0/3008570934 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55e484513720 0x55e484515be0 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:48.066 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.051+0000 7fa343fff640 1 -- 172.21.15.142:0/3008570934 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa334009050 con 0x55e484513720 2024-09-22T08:37:48.066 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.051+0000 7fa34c62f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:48.066 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.051+0000 7fa34c62f800 20 realm 2024-09-22T08:37:48.066 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.051+0000 7fa34c62f800 20 rados->read ofs=0 len=0 2024-09-22T08:37:48.066 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.051+0000 7fa34c62f800 1 -- 172.21.15.142:0/3008570934 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e484512a70 con 0x55e484513720 2024-09-22T08:37:48.066 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.051+0000 7fa343fff640 1 -- 172.21.15.142:0/3008570934 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa334009050 con 0x55e484513720 2024-09-22T08:37:48.066 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.051+0000 7fa34c62f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:48.067 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.051+0000 7fa34c62f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:37:48.067 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.051+0000 7fa34c62f800 20 rados->read ofs=0 len=0 2024-09-22T08:37:48.067 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.051+0000 7fa34c62f800 1 -- 172.21.15.142:0/3008570934 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e484516e20 con 0x55e484513720 2024-09-22T08:37:48.067 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.052+0000 7fa343fff640 1 -- 172.21.15.142:0/3008570934 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa334009050 con 0x55e484513720 2024-09-22T08:37:48.067 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.052+0000 7fa34c62f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:48.067 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.052+0000 7fa34c62f800 20 rados->read ofs=0 len=0 2024-09-22T08:37:48.067 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.052+0000 7fa34c62f800 1 -- 172.21.15.142:0/3008570934 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e4845176f0 con 0x55e484513720 2024-09-22T08:37:48.067 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.052+0000 7fa343fff640 1 -- 172.21.15.142:0/3008570934 <== osd.1 v2:172.21.15.142:6816/3192108003 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa334009050 con 0x55e484513720 2024-09-22T08:37:48.067 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.052+0000 7fa34c62f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:37:48.067 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.052+0000 7fa34c62f800 20 rados->read ofs=0 len=0 2024-09-22T08:37:48.067 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.052+0000 7fa34c62f800 1 --2- 172.21.15.142:0/3008570934 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55e484518110 0x55e48451a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:48.067 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.052+0000 7fa34c62f800 1 -- 172.21.15.142:0/3008570934 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e48451ac40 con 0x55e484518110 2024-09-22T08:37:48.067 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.052+0000 7fa34a91a640 1 --2- 172.21.15.142:0/3008570934 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55e484518110 0x55e48451a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:48.068 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.052+0000 7fa34a91a640 1 --2- 172.21.15.142:0/3008570934 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55e484518110 0x55e48451a500 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:48.068 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.052+0000 7fa34a91a640 1 -- 172.21.15.142:0/3008570934 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(5 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fa34403a070 con 0x55e484518110 2024-09-22T08:37:48.068 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.052+0000 7fa34c62f800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:37:48.068 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.052+0000 7fa34c62f800 20 searching for the correct realm 2024-09-22T08:37:48.068 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.052+0000 7fa34c62f800 1 -- 172.21.15.142:0/3008570934 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e48451c570 con 0x55e484518110 2024-09-22T08:37:48.068 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.053+0000 7fa34a91a640 1 -- 172.21.15.142:0/3008570934 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa34403a070 con 0x55e484518110 2024-09-22T08:37:48.068 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.053+0000 7fa34a91a640 1 --2- 172.21.15.142:0/3008570934 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7fa3440333f0 0x7fa34403b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:48.068 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.053+0000 7fa34a91a640 1 -- 172.21.15.142:0/3008570934 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e48451c570 con 0x7fa3440333f0 2024-09-22T08:37:48.068 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.053+0000 7fa34a119640 1 --2- 172.21.15.142:0/3008570934 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7fa3440333f0 0x7fa34403b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:48.068 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.053+0000 7fa34a119640 1 --2- 172.21.15.142:0/3008570934 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7fa3440333f0 0x7fa34403b7b0 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:48.068 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.053+0000 7fa34a119640 1 -- 172.21.15.142:0/3008570934 <== osd.2 v2:172.21.15.142:6808/279438927 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa33c051070 con 0x7fa3440333f0 2024-09-22T08:37:48.068 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.053+0000 7fa34a119640 1 --2- 172.21.15.142:0/3008570934 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7fa33c0a5040 0x7fa33c07d760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:37:48.068 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.053+0000 7fa34a119640 1 -- 172.21.15.142:0/3008570934 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e48451c570 con 0x7fa33c0a5040 2024-09-22T08:37:48.068 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.054+0000 7fa343fff640 1 --2- 172.21.15.142:0/3008570934 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7fa33c0a5040 0x7fa33c07d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:37:48.069 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.054+0000 7fa343fff640 1 --2- 172.21.15.142:0/3008570934 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7fa33c0a5040 0x7fa33c07d760 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:37:48.069 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.054+0000 7fa343fff640 1 -- 172.21.15.142:0/3008570934 <== osd.0 v2:172.21.15.31:6800/168281188 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa334009050 con 0x7fa33c0a5040 2024-09-22T08:37:48.069 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.054+0000 7fa343fff640 1 -- 172.21.15.142:0/3008570934 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e48451c570 con 0x55e484513720 2024-09-22T08:37:48.069 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.054+0000 7fa343fff640 1 -- 172.21.15.142:0/3008570934 <== osd.1 v2:172.21.15.142:6816/3192108003 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa334009050 con 0x55e484513720 2024-09-22T08:37:48.069 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.055+0000 7fa343fff640 1 -- 172.21.15.142:0/3008570934 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e48451c570 con 0x55e484513720 2024-09-22T08:37:48.069 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.055+0000 7fa343fff640 1 -- 172.21.15.142:0/3008570934 <== osd.1 v2:172.21.15.142:6816/3192108003 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa334029040 con 0x55e484513720 2024-09-22T08:37:48.069 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.055+0000 7fa343fff640 1 -- 172.21.15.142:0/3008570934 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e48451c570 con 0x55e484513720 2024-09-22T08:37:48.069 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.055+0000 7fa343fff640 1 -- 172.21.15.142:0/3008570934 <== osd.1 v2:172.21.15.142:6816/3192108003 7 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa334029040 con 0x55e484513720 2024-09-22T08:37:48.069 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.055+0000 7fa343fff640 1 -- 172.21.15.142:0/3008570934 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e48451c570 con 0x7fa33c0a5040 2024-09-22T08:37:48.069 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.055+0000 7fa343fff640 1 -- 172.21.15.142:0/3008570934 <== osd.0 v2:172.21.15.31:6800/168281188 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa334029040 con 0x7fa33c0a5040 2024-09-22T08:37:48.069 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.055+0000 7fa343fff640 1 -- 172.21.15.142:0/3008570934 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e48451c570 con 0x7fa3440333f0 2024-09-22T08:37:48.069 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.055+0000 7fa34a119640 1 -- 172.21.15.142:0/3008570934 <== osd.2 v2:172.21.15.142:6808/279438927 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa33c051070 con 0x7fa3440333f0 2024-09-22T08:37:48.069 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.055+0000 7fa34a119640 1 -- 172.21.15.142:0/3008570934 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e48451c570 con 0x55e484518110 2024-09-22T08:37:48.070 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.056+0000 7fa34a91a640 1 -- 172.21.15.142:0/3008570934 <== osd.3 v2:172.21.15.142:6800/1064901393 3 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa34403a070 con 0x55e484518110 2024-09-22T08:37:48.070 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.056+0000 7fa34a91a640 1 -- 172.21.15.142:0/3008570934 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e48451c570 con 0x55e484513720 2024-09-22T08:37:48.070 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.056+0000 7fa343fff640 1 -- 172.21.15.142:0/3008570934 <== osd.1 v2:172.21.15.142:6816/3192108003 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa334029040 con 0x55e484513720 2024-09-22T08:37:48.070 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.056+0000 7fa343fff640 1 -- 172.21.15.142:0/3008570934 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e48451c570 con 0x7fa33c0a5040 2024-09-22T08:37:48.070 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.056+0000 7fa343fff640 1 -- 172.21.15.142:0/3008570934 <== osd.0 v2:172.21.15.31:6800/168281188 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa334029040 con 0x7fa33c0a5040 2024-09-22T08:37:48.070 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.056+0000 7fa343fff640 1 -- 172.21.15.142:0/3008570934 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e48451c570 con 0x55e484513720 2024-09-22T08:37:48.070 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.056+0000 7fa343fff640 1 -- 172.21.15.142:0/3008570934 <== osd.1 v2:172.21.15.142:6816/3192108003 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa334029040 con 0x55e484513720 2024-09-22T08:37:48.070 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.056+0000 7fa343fff640 1 -- 172.21.15.142:0/3008570934 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e48451c570 con 0x7fa3440333f0 2024-09-22T08:37:48.070 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.057+0000 7fa34a119640 1 -- 172.21.15.142:0/3008570934 <== osd.2 v2:172.21.15.142:6808/279438927 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fa33c051070 con 0x7fa3440333f0 2024-09-22T08:37:48.070 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.057+0000 7fa34a119640 1 -- 172.21.15.142:0/3008570934 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e48451c570 con 0x55e484518110 2024-09-22T08:37:48.070 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.057+0000 7fa34a91a640 1 -- 172.21.15.142:0/3008570934 <== osd.3 v2:172.21.15.142:6800/1064901393 4 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa34403a070 con 0x55e484518110 2024-09-22T08:37:48.070 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.057+0000 7fa34a91a640 1 -- 172.21.15.142:0/3008570934 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e48451c570 con 0x55e484518110 2024-09-22T08:37:48.071 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.057+0000 7fa34a91a640 1 -- 172.21.15.142:0/3008570934 <== osd.3 v2:172.21.15.142:6800/1064901393 5 ==== osd_op_reply(20 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fa34403a070 con 0x55e484518110 2024-09-22T08:37:48.071 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.057+0000 7fa34a91a640 1 -- 172.21.15.142:0/3008570934 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e48451c570 con 0x7fa33c0a5040 2024-09-22T08:37:48.071 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.058+0000 7fa343fff640 1 -- 172.21.15.142:0/3008570934 <== osd.0 v2:172.21.15.31:6800/168281188 4 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa334029040 con 0x7fa33c0a5040 2024-09-22T08:37:48.071 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.058+0000 7fa343fff640 1 -- 172.21.15.142:0/3008570934 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e48451c570 con 0x55e484518110 2024-09-22T08:37:48.071 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.058+0000 7fa34a91a640 1 -- 172.21.15.142:0/3008570934 <== osd.3 v2:172.21.15.142:6800/1064901393 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa34403a070 con 0x55e484518110 2024-09-22T08:37:48.071 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.058+0000 7fa34a91a640 1 -- 172.21.15.142:0/3008570934 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e48451c570 con 0x55e484518110 2024-09-22T08:37:48.071 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.058+0000 7fa34a91a640 1 -- 172.21.15.142:0/3008570934 <== osd.3 v2:172.21.15.142:6800/1064901393 7 ==== osd_op_reply(23 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fa34403a070 con 0x55e484518110 2024-09-22T08:37:48.071 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.058+0000 7fa34a91a640 1 -- 172.21.15.142:0/3008570934 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e48451c570 con 0x55e484513720 2024-09-22T08:37:48.071 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.058+0000 7fa343fff640 1 -- 172.21.15.142:0/3008570934 <== osd.1 v2:172.21.15.142:6816/3192108003 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa334029040 con 0x55e484513720 2024-09-22T08:37:48.071 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.058+0000 7fa343fff640 1 -- 172.21.15.142:0/3008570934 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e48451c570 con 0x55e484513720 2024-09-22T08:37:48.071 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.058+0000 7fa343fff640 1 -- 172.21.15.142:0/3008570934 <== osd.1 v2:172.21.15.142:6816/3192108003 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fa334029040 con 0x55e484513720 2024-09-22T08:37:48.071 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.058+0000 7fa343fff640 1 -- 172.21.15.142:0/3008570934 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e48451c570 con 0x7fa33c0a5040 2024-09-22T08:37:48.071 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.059+0000 7fa343fff640 1 -- 172.21.15.142:0/3008570934 <== osd.0 v2:172.21.15.31:6800/168281188 5 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa334029040 con 0x7fa33c0a5040 2024-09-22T08:37:48.072 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.059+0000 7fa343fff640 1 -- 172.21.15.142:0/3008570934 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e48451c570 con 0x55e484518110 2024-09-22T08:37:48.072 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.059+0000 7fa34a91a640 1 -- 172.21.15.142:0/3008570934 <== osd.3 v2:172.21.15.142:6800/1064901393 8 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa34403a070 con 0x55e484518110 2024-09-22T08:37:48.072 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.059+0000 7fa34a91a640 1 -- 172.21.15.142:0/3008570934 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e48451c570 con 0x7fa3440333f0 2024-09-22T08:37:48.072 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.059+0000 7fa34a119640 1 -- 172.21.15.142:0/3008570934 <== osd.2 v2:172.21.15.142:6808/279438927 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa33c051070 con 0x7fa3440333f0 2024-09-22T08:37:48.072 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.059+0000 7fa34a119640 1 -- 172.21.15.142:0/3008570934 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e48451c570 con 0x55e484513720 2024-09-22T08:37:48.072 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.059+0000 7fa343fff640 1 -- 172.21.15.142:0/3008570934 <== osd.1 v2:172.21.15.142:6816/3192108003 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa334029040 con 0x55e484513720 2024-09-22T08:37:48.072 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.059+0000 7fa343fff640 1 -- 172.21.15.142:0/3008570934 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e48451c570 con 0x7fa33c0a5040 2024-09-22T08:37:48.080 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.060+0000 7fa343fff640 1 -- 172.21.15.142:0/3008570934 <== osd.0 v2:172.21.15.31:6800/168281188 6 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa334029040 con 0x7fa33c0a5040 2024-09-22T08:37:48.080 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.060+0000 7fa343fff640 1 -- 172.21.15.142:0/3008570934 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e48451c570 con 0x55e484518110 2024-09-22T08:37:48.080 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.060+0000 7fa34a91a640 1 -- 172.21.15.142:0/3008570934 <== osd.3 v2:172.21.15.142:6800/1064901393 9 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa34403a070 con 0x55e484518110 2024-09-22T08:37:48.080 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.060+0000 7fa34a91a640 1 -- 172.21.15.142:0/3008570934 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e48451c570 con 0x7fa33c0a5040 2024-09-22T08:37:48.080 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.060+0000 7fa343fff640 1 -- 172.21.15.142:0/3008570934 <== osd.0 v2:172.21.15.31:6800/168281188 7 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa334029040 con 0x7fa33c0a5040 2024-09-22T08:37:48.080 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.060+0000 7fa343fff640 1 -- 172.21.15.142:0/3008570934 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e48451c570 con 0x7fa3440333f0 2024-09-22T08:37:48.080 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.061+0000 7fa34a119640 1 -- 172.21.15.142:0/3008570934 <== osd.2 v2:172.21.15.142:6808/279438927 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa33c051070 con 0x7fa3440333f0 2024-09-22T08:37:48.081 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.061+0000 7fa34a119640 1 -- 172.21.15.142:0/3008570934 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e48451c570 con 0x55e484518110 2024-09-22T08:37:48.081 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.061+0000 7fa34a91a640 1 -- 172.21.15.142:0/3008570934 <== osd.3 v2:172.21.15.142:6800/1064901393 10 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa34403a070 con 0x55e484518110 2024-09-22T08:37:48.081 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.061+0000 7fa34a91a640 1 -- 172.21.15.142:0/3008570934 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e48451c570 con 0x7fa33c0a5040 2024-09-22T08:37:48.081 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.061+0000 7fa343fff640 1 -- 172.21.15.142:0/3008570934 <== osd.0 v2:172.21.15.31:6800/168281188 8 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa334029040 con 0x7fa33c0a5040 2024-09-22T08:37:48.081 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.061+0000 7fa343fff640 1 -- 172.21.15.142:0/3008570934 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e48451c570 con 0x55e484513720 2024-09-22T08:37:48.081 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.061+0000 7fa343fff640 1 -- 172.21.15.142:0/3008570934 <== osd.1 v2:172.21.15.142:6816/3192108003 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fa334029040 con 0x55e484513720 2024-09-22T08:37:48.081 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.061+0000 7fa343fff640 1 -- 172.21.15.142:0/3008570934 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e48451c570 con 0x7fa3440333f0 2024-09-22T08:37:48.081 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.062+0000 7fa34a119640 1 -- 172.21.15.142:0/3008570934 <== osd.2 v2:172.21.15.142:6808/279438927 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa33c051070 con 0x7fa3440333f0 2024-09-22T08:37:48.081 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.062+0000 7fa34c62f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:37:48.081 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.062+0000 7fa34c62f800 20 RGWRados::pool_iterate: got zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec 2024-09-22T08:37:48.081 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.062+0000 7fa34c62f800 20 RGWRados::pool_iterate: got zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f 2024-09-22T08:37:48.081 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.062+0000 7fa34c62f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:37:48.081 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.062+0000 7fa34c62f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:37:48.082 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.062+0000 7fa34c62f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:37:48.082 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.062+0000 7fa34c62f800 20 rados->read ofs=0 len=0 2024-09-22T08:37:48.082 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.062+0000 7fa34c62f800 1 -- 172.21.15.142:0/3008570934 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e48451b600 con 0x55e484513720 2024-09-22T08:37:48.082 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.062+0000 7fa343fff640 1 -- 172.21.15.142:0/3008570934 <== osd.1 v2:172.21.15.142:6816/3192108003 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa334029040 con 0x55e484513720 2024-09-22T08:37:48.082 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.062+0000 7fa34c62f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:48.082 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.062+0000 7fa34c62f800 20 rados->read ofs=0 len=0 2024-09-22T08:37:48.082 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.062+0000 7fa34c62f800 1 -- 172.21.15.142:0/3008570934 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e48451be50 con 0x55e484513720 2024-09-22T08:37:48.082 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.062+0000 7fa343fff640 1 -- 172.21.15.142:0/3008570934 <== osd.1 v2:172.21.15.142:6816/3192108003 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa334029040 con 0x55e484513720 2024-09-22T08:37:48.082 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.062+0000 7fa34c62f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:37:48.082 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.062+0000 7fa34c62f800 20 rados->read ofs=0 len=0 2024-09-22T08:37:48.082 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.062+0000 7fa34c62f800 1 -- 172.21.15.142:0/3008570934 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:40 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e48451c9f0 con 0x55e484518110 2024-09-22T08:37:48.082 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.062+0000 7fa34a91a640 1 -- 172.21.15.142:0/3008570934 <== osd.3 v2:172.21.15.142:6800/1064901393 11 ==== osd_op_reply(40 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fa34403a070 con 0x55e484518110 2024-09-22T08:37:48.083 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.062+0000 7fa34c62f800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:37:48.083 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.062+0000 7fa34c62f800 20 zone default found 2024-09-22T08:37:48.083 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.062+0000 7fa34c62f800 4 Realm: () 2024-09-22T08:37:48.083 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.062+0000 7fa34c62f800 4 ZoneGroup: default (d89f6f57-1007-47dd-9065-f486c7b01aec) 2024-09-22T08:37:48.083 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.062+0000 7fa34c62f800 4 Zone: default (e239248c-0bee-4e41-803a-24b288d3eb8f) 2024-09-22T08:37:48.083 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.062+0000 7fa34c62f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:37:48.083 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.062+0000 7fa34c62f800 20 zonegroup default 2024-09-22T08:37:48.083 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.062+0000 7fa34c62f800 20 rados->read ofs=0 len=0 2024-09-22T08:37:48.083 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.062+0000 7fa34c62f800 1 -- 172.21.15.142:0/3008570934 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e48451cd90 con 0x7fa33c0a5040 2024-09-22T08:37:48.083 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.063+0000 7fa343fff640 1 -- 172.21.15.142:0/3008570934 <== osd.0 v2:172.21.15.31:6800/168281188 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fa334029040 con 0x7fa33c0a5040 2024-09-22T08:37:48.083 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.063+0000 7fa34c62f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:48.083 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.063+0000 7fa34c62f800 20 rados->read ofs=0 len=0 2024-09-22T08:37:48.084 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.063+0000 7fa34c62f800 1 -- 172.21.15.142:0/3008570934 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e48451f070 con 0x55e484518110 2024-09-22T08:37:48.084 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.063+0000 7fa34a91a640 1 -- 172.21.15.142:0/3008570934 <== osd.3 v2:172.21.15.142:6800/1064901393 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa34403a070 con 0x55e484518110 2024-09-22T08:37:48.084 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.063+0000 7fa34c62f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:48.084 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.063+0000 7fa34c62f800 20 rados->read ofs=0 len=0 2024-09-22T08:37:48.084 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.063+0000 7fa34c62f800 1 -- 172.21.15.142:0/3008570934 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e48451f410 con 0x55e484518110 2024-09-22T08:37:48.084 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.063+0000 7fa34a91a640 1 -- 172.21.15.142:0/3008570934 <== osd.3 v2:172.21.15.142:6800/1064901393 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa34403a070 con 0x55e484518110 2024-09-22T08:37:48.084 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.063+0000 7fa34c62f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:48.084 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.063+0000 7fa34c62f800 20 started sync module instance, tier type = 2024-09-22T08:37:48.084 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.063+0000 7fa34c62f800 20 started zone id=e239248c-0bee-4e41-803a-24b288d3eb8f (name=default) with tier type = 2024-09-22T08:37:48.084 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.063+0000 7fa34c62f800 1 -- 172.21.15.142:0/3008570934 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e48451e500 con 0x7fa3440333f0 2024-09-22T08:37:48.084 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.064+0000 7fa34a119640 1 -- 172.21.15.142:0/3008570934 <== osd.2 v2:172.21.15.142:6808/279438927 7 ==== osd_op_reply(44 notify.0 [create] v32'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa33c051070 con 0x7fa3440333f0 2024-09-22T08:37:48.084 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.064+0000 7fa34c62f800 1 -- 172.21.15.142:0/3008570934 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94439960865008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e48451e160 con 0x7fa3440333f0 2024-09-22T08:37:48.084 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.064+0000 7fa34c62f800 1 -- 172.21.15.142:0/3008570934 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e484520310 con 0x55e484513720 2024-09-22T08:37:48.085 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.065+0000 7fa34a119640 1 -- 172.21.15.142:0/3008570934 <== osd.2 v2:172.21.15.142:6808/279438927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94439960865008] v32'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa33c051070 con 0x7fa3440333f0 2024-09-22T08:37:48.085 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.066+0000 7fa343fff640 1 -- 172.21.15.142:0/3008570934 <== osd.1 v2:172.21.15.142:6816/3192108003 16 ==== osd_op_reply(46 notify.1 [create] v32'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa334029040 con 0x55e484513720 2024-09-22T08:37:48.085 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.066+0000 7fa34c62f800 1 -- 172.21.15.142:0/3008570934 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94439960870496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e484520730 con 0x55e484513720 2024-09-22T08:37:48.085 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.066+0000 7fa34c62f800 1 -- 172.21.15.142:0/3008570934 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e4845210f0 con 0x55e484518110 2024-09-22T08:37:48.085 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.067+0000 7fa34a91a640 1 -- 172.21.15.142:0/3008570934 <== osd.3 v2:172.21.15.142:6800/1064901393 14 ==== osd_op_reply(48 notify.2 [create] v32'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa34403a070 con 0x55e484518110 2024-09-22T08:37:48.085 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.067+0000 7fa34c62f800 1 -- 172.21.15.142:0/3008570934 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94439960874048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e484521550 con 0x55e484518110 2024-09-22T08:37:48.085 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.067+0000 7fa34c62f800 1 -- 172.21.15.142:0/3008570934 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e484522040 con 0x7fa3440333f0 2024-09-22T08:37:48.085 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.067+0000 7fa343fff640 1 -- 172.21.15.142:0/3008570934 <== osd.1 v2:172.21.15.142:6816/3192108003 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94439960870496] v32'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa334029040 con 0x55e484513720 2024-09-22T08:37:48.085 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.068+0000 7fa34a119640 1 -- 172.21.15.142:0/3008570934 <== osd.2 v2:172.21.15.142:6808/279438927 9 ==== osd_op_reply(50 notify.3 [create] v32'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa33c051070 con 0x7fa3440333f0 2024-09-22T08:37:48.085 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.068+0000 7fa34a91a640 1 -- 172.21.15.142:0/3008570934 <== osd.3 v2:172.21.15.142:6800/1064901393 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94439960874048] v32'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa34403a070 con 0x55e484518110 2024-09-22T08:37:48.085 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.068+0000 7fa34c62f800 1 -- 172.21.15.142:0/3008570934 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94439960877840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e484522000 con 0x7fa3440333f0 2024-09-22T08:37:48.085 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.068+0000 7fa34c62f800 1 -- 172.21.15.142:0/3008570934 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e4845210a0 con 0x55e484513720 2024-09-22T08:37:48.085 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.069+0000 7fa34a119640 1 -- 172.21.15.142:0/3008570934 <== osd.2 v2:172.21.15.142:6808/279438927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94439960877840] v32'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa33c051070 con 0x7fa3440333f0 2024-09-22T08:37:48.086 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.069+0000 7fa343fff640 1 -- 172.21.15.142:0/3008570934 <== osd.1 v2:172.21.15.142:6816/3192108003 18 ==== osd_op_reply(52 notify.4 [create] v32'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa334029040 con 0x55e484513720 2024-09-22T08:37:48.086 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.069+0000 7fa34c62f800 1 -- 172.21.15.142:0/3008570934 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94439960871552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e484522000 con 0x55e484513720 2024-09-22T08:37:48.086 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.069+0000 7fa34c62f800 1 -- 172.21.15.142:0/3008570934 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e4845230a0 con 0x7fa33c0a5040 2024-09-22T08:37:48.086 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.070+0000 7fa343fff640 1 -- 172.21.15.142:0/3008570934 <== osd.0 v2:172.21.15.31:6800/168281188 10 ==== osd_op_reply(54 notify.5 [create] v32'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa334029040 con 0x7fa33c0a5040 2024-09-22T08:37:48.086 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.070+0000 7fa343fff640 1 -- 172.21.15.142:0/3008570934 <== osd.1 v2:172.21.15.142:6816/3192108003 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94439960871552] v32'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa334029040 con 0x55e484513720 2024-09-22T08:37:48.086 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.070+0000 7fa34c62f800 1 -- 172.21.15.142:0/3008570934 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94439960882160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e4845234c0 con 0x7fa33c0a5040 2024-09-22T08:37:48.086 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.070+0000 7fa34c62f800 1 -- 172.21.15.142:0/3008570934 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e4845225f0 con 0x7fa33c0a5040 2024-09-22T08:37:48.086 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.071+0000 7fa343fff640 1 -- 172.21.15.142:0/3008570934 <== osd.0 v2:172.21.15.31:6800/168281188 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94439960882160] v32'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa334029040 con 0x7fa33c0a5040 2024-09-22T08:37:48.086 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.071+0000 7fa343fff640 1 -- 172.21.15.142:0/3008570934 <== osd.0 v2:172.21.15.31:6800/168281188 12 ==== osd_op_reply(56 notify.6 [create] v32'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa334029040 con 0x7fa33c0a5040 2024-09-22T08:37:48.086 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.072+0000 7fa34c62f800 1 -- 172.21.15.142:0/3008570934 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94439960883216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e484523430 con 0x7fa33c0a5040 2024-09-22T08:37:48.086 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.072+0000 7fa34c62f800 1 -- 172.21.15.142:0/3008570934 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e484524550 con 0x7fa33c0a5040 2024-09-22T08:37:48.086 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.072+0000 7fa343fff640 1 -- 172.21.15.142:0/3008570934 <== osd.0 v2:172.21.15.31:6800/168281188 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94439960883216] v32'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa334029040 con 0x7fa33c0a5040 2024-09-22T08:37:48.086 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.073+0000 7fa343fff640 1 -- 172.21.15.142:0/3008570934 <== osd.0 v2:172.21.15.31:6800/168281188 14 ==== osd_op_reply(58 notify.7 [create] v32'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa334029040 con 0x7fa33c0a5040 2024-09-22T08:37:48.087 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.073+0000 7fa34c62f800 1 -- 172.21.15.142:0/3008570934 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94439960885888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e484524550 con 0x7fa33c0a5040 2024-09-22T08:37:48.087 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.073+0000 7fa34c62f800 20 add_watcher() i=0 2024-09-22T08:37:48.087 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.073+0000 7fa34c62f800 20 add_watcher() i=1 2024-09-22T08:37:48.087 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.073+0000 7fa34c62f800 20 add_watcher() i=2 2024-09-22T08:37:48.087 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.073+0000 7fa34c62f800 20 add_watcher() i=3 2024-09-22T08:37:48.087 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.073+0000 7fa34c62f800 20 add_watcher() i=4 2024-09-22T08:37:48.087 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.073+0000 7fa34c62f800 20 add_watcher() i=5 2024-09-22T08:37:48.087 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.073+0000 7fa34c62f800 20 add_watcher() i=6 2024-09-22T08:37:48.087 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.073+0000 7fa343fff640 1 -- 172.21.15.142:0/3008570934 <== osd.0 v2:172.21.15.31:6800/168281188 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94439960885888] v32'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa334029040 con 0x7fa33c0a5040 2024-09-22T08:37:48.087 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.073+0000 7fa34c62f800 20 add_watcher() i=7 2024-09-22T08:37:48.087 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.073+0000 7fa34c62f800 2 all 8 watchers are set, enabling cache 2024-09-22T08:37:48.087 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.074+0000 7fa34c62f800 1 -- 172.21.15.142:0/3008570934 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e484527970 con 0x55e484513720 2024-09-22T08:37:48.087 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.074+0000 7fa343fff640 1 -- 172.21.15.142:0/3008570934 <== osd.1 v2:172.21.15.142:6816/3192108003 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fa334029040 con 0x55e484513720 2024-09-22T08:37:48.087 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.074+0000 7fa34c62f800 1 -- 172.21.15.142:0/3008570934 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94439960900512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e4845246c0 con 0x55e484513720 2024-09-22T08:37:48.088 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.075+0000 7fa343fff640 1 -- 172.21.15.142:0/3008570934 <== osd.1 v2:172.21.15.142:6816/3192108003 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94439960900512] v32'224 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa334029040 con 0x55e484513720 2024-09-22T08:37:48.088 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.075+0000 7fa200fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:37:48.088 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.075+0000 7fa34c62f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:37:48.088 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.075+0000 7fa34c62f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:37:48.088 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.075+0000 7fa34c62f800 1 -- 172.21.15.142:0/3008570934 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e484530500 con 0x55e484513720 2024-09-22T08:37:48.088 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.076+0000 7fa343fff640 1 -- 172.21.15.142:0/3008570934 <== osd.1 v2:172.21.15.142:6816/3192108003 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'33 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa334029040 con 0x55e484513720 2024-09-22T08:37:48.088 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.076+0000 7fa34c62f800 1 -- 172.21.15.142:0/3008570934 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e484530b10 con 0x7fa33c0a5040 2024-09-22T08:37:48.088 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.078+0000 7fa343fff640 1 -- 172.21.15.142:0/3008570934 <== osd.0 v2:172.21.15.31:6800/168281188 16 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'27 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa334029040 con 0x7fa33c0a5040 2024-09-22T08:37:48.088 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.078+0000 7fa34c62f800 1 -- 172.21.15.142:0/3008570934 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e484530f70 con 0x55e484518110 2024-09-22T08:37:48.088 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.078+0000 7fa34a91a640 1 -- 172.21.15.142:0/3008570934 <== osd.3 v2:172.21.15.142:6800/1064901393 16 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'28 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa34403a070 con 0x55e484518110 2024-09-22T08:37:48.088 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.078+0000 7fa34c62f800 1 -- 172.21.15.142:0/3008570934 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e484530ed0 con 0x55e484513720 2024-09-22T08:37:48.090 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.079+0000 7fa343fff640 1 -- 172.21.15.142:0/3008570934 <== osd.1 v2:172.21.15.142:6816/3192108003 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'225 uv162 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa334029040 con 0x55e484513720 2024-09-22T08:37:48.090 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.079+0000 7fa34c62f800 1 -- 172.21.15.142:0/3008570934 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e484531460 con 0x7fa3440333f0 2024-09-22T08:37:48.091 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.080+0000 7fa34a119640 1 -- 172.21.15.142:0/3008570934 <== osd.2 v2:172.21.15.142:6808/279438927 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'73 uv53 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa33c051070 con 0x7fa3440333f0 2024-09-22T08:37:48.091 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.080+0000 7fa34c62f800 1 -- 172.21.15.142:0/3008570934 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e4845318f0 con 0x55e484518110 2024-09-22T08:37:48.091 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.081+0000 7fa34a91a640 1 -- 172.21.15.142:0/3008570934 <== osd.3 v2:172.21.15.142:6800/1064901393 17 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'48 uv34 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa34403a070 con 0x55e484518110 2024-09-22T08:37:48.091 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.081+0000 7fa34c62f800 1 -- 172.21.15.142:0/3008570934 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e4845318f0 con 0x55e484513720 2024-09-22T08:37:48.091 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.083+0000 7fa343fff640 1 -- 172.21.15.142:0/3008570934 <== osd.1 v2:172.21.15.142:6816/3192108003 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'29 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa334029040 con 0x55e484513720 2024-09-22T08:37:48.091 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.083+0000 7fa34c62f800 1 -- 172.21.15.142:0/3008570934 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e48452c1c0 con 0x7fa33c0a5040 2024-09-22T08:37:48.091 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.084+0000 7fa343fff640 1 -- 172.21.15.142:0/3008570934 <== osd.0 v2:172.21.15.31:6800/168281188 17 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'47 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa334029040 con 0x7fa33c0a5040 2024-09-22T08:37:48.091 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.084+0000 7fa34c62f800 1 -- 172.21.15.142:0/3008570934 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e48452c1c0 con 0x7fa3440333f0 2024-09-22T08:37:48.091 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.085+0000 7fa34a119640 1 -- 172.21.15.142:0/3008570934 <== osd.2 v2:172.21.15.142:6808/279438927 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'27 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa33c051070 con 0x7fa3440333f0 2024-09-22T08:37:48.091 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.085+0000 7fa34c62f800 1 -- 172.21.15.142:0/3008570934 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e48452c1c0 con 0x55e484518110 2024-09-22T08:37:48.091 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.086+0000 7fa34a91a640 1 -- 172.21.15.142:0/3008570934 <== osd.3 v2:172.21.15.142:6800/1064901393 18 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'33 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa34403a070 con 0x55e484518110 2024-09-22T08:37:48.091 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.086+0000 7fa34c62f800 1 -- 172.21.15.142:0/3008570934 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e48452c1c0 con 0x7fa3440333f0 2024-09-22T08:37:48.092 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.086+0000 7fa34a119640 1 -- 172.21.15.142:0/3008570934 <== osd.2 v2:172.21.15.142:6808/279438927 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'74 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa33c051070 con 0x7fa3440333f0 2024-09-22T08:37:48.092 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.087+0000 7fa34c62f800 1 -- 172.21.15.142:0/3008570934 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e48452c2b0 con 0x7fa33c0a5040 2024-09-22T08:37:48.092 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.088+0000 7fa343fff640 1 -- 172.21.15.142:0/3008570934 <== osd.0 v2:172.21.15.31:6800/168281188 18 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'31 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa334029040 con 0x7fa33c0a5040 2024-09-22T08:37:48.092 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.088+0000 7fa34c62f800 1 -- 172.21.15.142:0/3008570934 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e484532260 con 0x7fa3440333f0 2024-09-22T08:37:48.092 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.088+0000 7fa34a119640 1 -- 172.21.15.142:0/3008570934 <== osd.2 v2:172.21.15.142:6808/279438927 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'27 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa33c051070 con 0x7fa3440333f0 2024-09-22T08:37:48.092 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.089+0000 7fa34c62f800 1 -- 172.21.15.142:0/3008570934 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e484532260 con 0x7fa33c0a5040 2024-09-22T08:37:48.092 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.090+0000 7fa343fff640 1 -- 172.21.15.142:0/3008570934 <== osd.0 v2:172.21.15.31:6800/168281188 19 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'55 uv44 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa334029040 con 0x7fa33c0a5040 2024-09-22T08:37:48.093 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.090+0000 7fa34c62f800 1 -- 172.21.15.142:0/3008570934 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e484532260 con 0x55e484513720 2024-09-22T08:37:48.093 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.091+0000 7fa343fff640 1 -- 172.21.15.142:0/3008570934 <== osd.1 v2:172.21.15.142:6816/3192108003 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'226 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa334029040 con 0x55e484513720 2024-09-22T08:37:48.093 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.091+0000 7fa34c62f800 1 -- 172.21.15.142:0/3008570934 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e484532260 con 0x55e484518110 2024-09-22T08:37:48.093 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.092+0000 7fa34a91a640 1 -- 172.21.15.142:0/3008570934 <== osd.3 v2:172.21.15.142:6800/1064901393 19 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'65 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa34403a070 con 0x55e484518110 2024-09-22T08:37:48.093 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.092+0000 7fa34c62f800 1 -- 172.21.15.142:0/3008570934 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e484532260 con 0x7fa3440333f0 2024-09-22T08:37:48.094 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.093+0000 7fa34a119640 1 -- 172.21.15.142:0/3008570934 <== osd.2 v2:172.21.15.142:6808/279438927 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'75 uv57 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa33c051070 con 0x7fa3440333f0 2024-09-22T08:37:48.094 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.093+0000 7fa34c62f800 1 -- 172.21.15.142:0/3008570934 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e484532260 con 0x55e484518110 2024-09-22T08:37:48.095 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.094+0000 7fa34a91a640 1 -- 172.21.15.142:0/3008570934 <== osd.3 v2:172.21.15.142:6800/1064901393 20 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'27 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa34403a070 con 0x55e484518110 2024-09-22T08:37:48.095 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.094+0000 7fa34c62f800 1 -- 172.21.15.142:0/3008570934 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e484532260 con 0x55e484513720 2024-09-22T08:37:48.096 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.095+0000 7fa343fff640 1 -- 172.21.15.142:0/3008570934 <== osd.1 v2:172.21.15.142:6816/3192108003 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'35 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa334029040 con 0x55e484513720 2024-09-22T08:37:48.096 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.095+0000 7fa34c62f800 1 -- 172.21.15.142:0/3008570934 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e484532260 con 0x55e484513720 2024-09-22T08:37:48.097 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.096+0000 7fa343fff640 1 -- 172.21.15.142:0/3008570934 <== osd.1 v2:172.21.15.142:6816/3192108003 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'227 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa334029040 con 0x55e484513720 2024-09-22T08:37:48.097 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.096+0000 7fa34c62f800 1 -- 172.21.15.142:0/3008570934 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e484532260 con 0x55e484518110 2024-09-22T08:37:48.098 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.097+0000 7fa34a91a640 1 -- 172.21.15.142:0/3008570934 <== osd.3 v2:172.21.15.142:6800/1064901393 21 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'66 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa34403a070 con 0x55e484518110 2024-09-22T08:37:48.098 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.097+0000 7fa34c62f800 1 -- 172.21.15.142:0/3008570934 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e484532260 con 0x7fa3440333f0 2024-09-22T08:37:48.099 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.098+0000 7fa34a119640 1 -- 172.21.15.142:0/3008570934 <== osd.2 v2:172.21.15.142:6808/279438927 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'37 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa33c051070 con 0x7fa3440333f0 2024-09-22T08:37:48.099 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.098+0000 7fa34c62f800 1 -- 172.21.15.142:0/3008570934 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e484532260 con 0x55e484518110 2024-09-22T08:37:48.100 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.099+0000 7fa34a91a640 1 -- 172.21.15.142:0/3008570934 <== osd.3 v2:172.21.15.142:6800/1064901393 22 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'29 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa34403a070 con 0x55e484518110 2024-09-22T08:37:48.100 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.099+0000 7fa34c62f800 1 -- 172.21.15.142:0/3008570934 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e484532260 con 0x55e484518110 2024-09-22T08:37:48.101 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.100+0000 7fa34a91a640 1 -- 172.21.15.142:0/3008570934 <== osd.3 v2:172.21.15.142:6800/1064901393 23 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'33 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa34403a070 con 0x55e484518110 2024-09-22T08:37:48.101 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.100+0000 7fa34c62f800 1 -- 172.21.15.142:0/3008570934 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e484532260 con 0x55e484518110 2024-09-22T08:37:48.102 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.101+0000 7fa34a91a640 1 -- 172.21.15.142:0/3008570934 <== osd.3 v2:172.21.15.142:6800/1064901393 24 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'23 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa34403a070 con 0x55e484518110 2024-09-22T08:37:48.102 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.101+0000 7fa34c62f800 1 -- 172.21.15.142:0/3008570934 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e484532260 con 0x55e484518110 2024-09-22T08:37:48.103 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.102+0000 7fa34a91a640 1 -- 172.21.15.142:0/3008570934 <== osd.3 v2:172.21.15.142:6800/1064901393 25 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'49 uv36 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa34403a070 con 0x55e484518110 2024-09-22T08:37:48.103 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.102+0000 7fa34c62f800 1 -- 172.21.15.142:0/3008570934 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e484532260 con 0x7fa33c0a5040 2024-09-22T08:37:48.104 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.103+0000 7fa343fff640 1 -- 172.21.15.142:0/3008570934 <== osd.0 v2:172.21.15.31:6800/168281188 20 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'29 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa334029040 con 0x7fa33c0a5040 2024-09-22T08:37:48.104 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.103+0000 7fa34c62f800 1 -- 172.21.15.142:0/3008570934 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e484532260 con 0x55e484518110 2024-09-22T08:37:48.105 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.104+0000 7fa34a91a640 1 -- 172.21.15.142:0/3008570934 <== osd.3 v2:172.21.15.142:6800/1064901393 26 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'27 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa34403a070 con 0x55e484518110 2024-09-22T08:37:48.105 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.104+0000 7fa34c62f800 1 -- 172.21.15.142:0/3008570934 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e484532260 con 0x7fa33c0a5040 2024-09-22T08:37:48.106 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.105+0000 7fa343fff640 1 -- 172.21.15.142:0/3008570934 <== osd.0 v2:172.21.15.31:6800/168281188 21 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'48 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa334029040 con 0x7fa33c0a5040 2024-09-22T08:37:48.106 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.105+0000 7fa34c62f800 1 -- 172.21.15.142:0/3008570934 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e484532260 con 0x55e484518110 2024-09-22T08:37:48.107 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.106+0000 7fa34a91a640 1 -- 172.21.15.142:0/3008570934 <== osd.3 v2:172.21.15.142:6800/1064901393 27 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'67 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa34403a070 con 0x55e484518110 2024-09-22T08:37:48.107 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.106+0000 7fa34c62f800 1 -- 172.21.15.142:0/3008570934 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e484532260 con 0x7fa33c0a5040 2024-09-22T08:37:48.108 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.107+0000 7fa343fff640 1 -- 172.21.15.142:0/3008570934 <== osd.0 v2:172.21.15.31:6800/168281188 22 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'56 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa334029040 con 0x7fa33c0a5040 2024-09-22T08:37:48.109 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.107+0000 7fa34c62f800 1 -- 172.21.15.142:0/3008570934 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e484532260 con 0x7fa3440333f0 2024-09-22T08:37:48.110 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.109+0000 7fa34a119640 1 -- 172.21.15.142:0/3008570934 <== osd.2 v2:172.21.15.142:6808/279438927 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'33 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa33c051070 con 0x7fa3440333f0 2024-09-22T08:37:48.110 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.109+0000 7fa17b7fe640 20 reqs_thread_entry: start 2024-09-22T08:37:48.111 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.109+0000 7fa34c62f800 20 init_complete bucket index max shards: 11 2024-09-22T08:37:48.111 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.109+0000 7fa34c62f800 20 Filter name: none 2024-09-22T08:37:48.111 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.109+0000 7fa1797fa640 20 reqs_thread_entry: start 2024-09-22T08:37:48.111 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.109+0000 7fa34c62f800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-22T08:37:48.111 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.109+0000 7fa34c62f800 20 rados->read ofs=0 len=0 2024-09-22T08:37:48.111 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.109+0000 7fa34c62f800 1 -- 172.21.15.142:0/3008570934 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e48455cdc0 con 0x7fa33c0a5040 2024-09-22T08:37:48.113 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.110+0000 7fa343fff640 1 -- 172.21.15.142:0/3008570934 <== osd.0 v2:172.21.15.31:6800/168281188 23 ==== osd_op_reply(94 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv9 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7fa334029040 con 0x7fa33c0a5040 2024-09-22T08:37:48.113 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.110+0000 7fa34c62f800 20 rados_obj.operate() r=0 bl.length=380 2024-09-22T08:37:48.113 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.110+0000 7fa34c62f800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-09-22T08:37:48.113 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.110+0000 7fa34c62f800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-22T08:37:48.113 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.110+0000 7fa34c62f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:37:48.113 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.110+0000 7fa34c62f800 1 -- 172.21.15.142:0/3008570934 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:95 8.1 8:810902b1:users.uid::fud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e48455f850 con 0x7fa33c0a5040 2024-09-22T08:37:48.113 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.111+0000 7fa343fff640 1 -- 172.21.15.142:0/3008570934 <== osd.0 v2:172.21.15.31:6800/168281188 24 ==== osd_op_reply(95 fud.buckets [call out=186b] v0'0 uv5 ondisk = 0) ==== 155+0+186 (crc 0 0 0) 0x7fa334029040 con 0x7fa33c0a5040 2024-09-22T08:37:48.113 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.111+0000 7fa34c62f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo7:e239248c-0bee-4e41-803a-24b288d3eb8f.4226.10 : miss 2024-09-22T08:37:48.113 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.111+0000 7fa34c62f800 20 rados->read ofs=0 len=0 2024-09-22T08:37:48.113 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.111+0000 7fa34c62f800 1 -- 172.21.15.142:0/3008570934 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:96 8.4 8:21bf25a9:root::.bucket.meta.myfoo7%3ae239248c-0bee-4e41-803a-24b288d3eb8f.4226.10:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e48455f680 con 0x7fa3440333f0 2024-09-22T08:37:48.113 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.111+0000 7fa34a119640 1 -- 172.21.15.142:0/3008570934 <== osd.2 v2:172.21.15.142:6808/279438927 18 ==== osd_op_reply(96 .bucket.meta.myfoo7:e239248c-0bee-4e41-803a-24b288d3eb8f.4226.10 [call out=48b,stat out=16b,read 0~390 out=390b,getxattrs out=218b] v0'0 uv3 ondisk = 0) ==== 334+0+672 (crc 0 0 0) 0x7fa33c051070 con 0x7fa3440333f0 2024-09-22T08:37:48.113 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.111+0000 7fa34c62f800 20 rados_obj.operate() r=0 bl.length=390 2024-09-22T08:37:48.114 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.111+0000 7fa34c62f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo7:e239248c-0bee-4e41-803a-24b288d3eb8f.4226.10 info.flags=0x17 2024-09-22T08:37:48.114 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.111+0000 7fa34c62f800 10 adding default.rgw.meta+root+.bucket.meta.myfoo7:e239248c-0bee-4e41-803a-24b288d3eb8f.4226.10 to cache LRU end 2024-09-22T08:37:48.114 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.111+0000 7fa34c62f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:37:48.114 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.111+0000 7fa34c62f800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-22T08:37:48.114 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.111+0000 7fa34c62f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo7:e239248c-0bee-4e41-803a-24b288d3eb8f.4226.10 2024-09-22T08:37:48.114 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.111+0000 7fa34c62f800 1 -- 172.21.15.142:0/3008570934 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:97 4.15 4:a98274ca:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.10.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e4845dcbb0 con 0x55e484518110 2024-09-22T08:37:48.114 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.111+0000 7fa34a91a640 1 -- 172.21.15.142:0/3008570934 <== osd.3 v2:172.21.15.142:6800/1064901393 28 ==== osd_op_reply(97 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.10.0 [call out=89b] v0'0 uv1 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7fa34403a070 con 0x55e484518110 2024-09-22T08:37:48.114 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.111+0000 7fa34c62f800 1 -- 172.21.15.142:0/3008570934 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:98 4.13 4:c907482d:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.10.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e4845dcbb0 con 0x7fa3440333f0 2024-09-22T08:37:48.114 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.112+0000 7fa34a119640 1 -- 172.21.15.142:0/3008570934 <== osd.2 v2:172.21.15.142:6808/279438927 19 ==== osd_op_reply(98 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.10.1 [call out=89b] v0'0 uv1 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7fa33c051070 con 0x7fa3440333f0 2024-09-22T08:37:48.114 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.112+0000 7fa34c62f800 1 -- 172.21.15.142:0/3008570934 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:99 4.14 4:28489bb7:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.10.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e4845dcbb0 con 0x55e484518110 2024-09-22T08:37:48.117 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.112+0000 7fa34a91a640 1 -- 172.21.15.142:0/3008570934 <== osd.3 v2:172.21.15.142:6800/1064901393 29 ==== osd_op_reply(99 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.10.2 [call out=89b] v0'0 uv1 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7fa34403a070 con 0x55e484518110 2024-09-22T08:37:48.117 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.112+0000 7fa34c62f800 1 -- 172.21.15.142:0/3008570934 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:100 4.c 4:31bf9291:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.10.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e4845dcbf0 con 0x55e484513720 2024-09-22T08:37:48.117 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.112+0000 7fa343fff640 1 -- 172.21.15.142:0/3008570934 <== osd.1 v2:172.21.15.142:6816/3192108003 28 ==== osd_op_reply(100 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.10.3 [call out=89b] v0'0 uv10 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7fa334029040 con 0x55e484513720 2024-09-22T08:37:48.117 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.112+0000 7fa34c62f800 1 -- 172.21.15.142:0/3008570934 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:101 4.36 4:6f220b3b:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.10.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e4845dcbf0 con 0x55e484513720 2024-09-22T08:37:48.117 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.113+0000 7fa343fff640 1 -- 172.21.15.142:0/3008570934 <== osd.1 v2:172.21.15.142:6816/3192108003 29 ==== osd_op_reply(101 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.10.4 [call out=89b] v0'0 uv11 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7fa334029040 con 0x55e484513720 2024-09-22T08:37:48.117 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.113+0000 7fa34c62f800 1 -- 172.21.15.142:0/3008570934 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:102 4.25 4:a6cd7013:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.10.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e4845dcbf0 con 0x55e484518110 2024-09-22T08:37:48.117 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.113+0000 7fa34a91a640 1 -- 172.21.15.142:0/3008570934 <== osd.3 v2:172.21.15.142:6800/1064901393 30 ==== osd_op_reply(102 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.10.5 [call out=382b] v0'0 uv6 ondisk = 0) ==== 195+0+382 (crc 0 0 0) 0x7fa34403a070 con 0x55e484518110 2024-09-22T08:37:48.117 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.113+0000 7fa34c62f800 10 cls_bucket_list_unordered: got fourteen 2024-09-22T08:37:48.117 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.113+0000 7fa34c62f800 1 -- 172.21.15.142:0/3008570934 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:103 4.11 4:8b847176:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.10.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e4845dcbf0 con 0x7fa33c0a5040 2024-09-22T08:37:48.117 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.114+0000 7fa343fff640 1 -- 172.21.15.142:0/3008570934 <== osd.0 v2:172.21.15.31:6800/168281188 25 ==== osd_op_reply(103 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.10.6 [call out=89b] v0'0 uv2 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7fa334029040 con 0x7fa33c0a5040 2024-09-22T08:37:48.117 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.114+0000 7fa34c62f800 1 -- 172.21.15.142:0/3008570934 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:104 4.3d 4:be0ad17a:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.10.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e4845dcbf0 con 0x55e484518110 2024-09-22T08:37:48.117 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.114+0000 7fa34a91a640 1 -- 172.21.15.142:0/3008570934 <== osd.3 v2:172.21.15.142:6800/1064901393 31 ==== osd_op_reply(104 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.10.7 [call out=89b] v0'0 uv5 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7fa34403a070 con 0x55e484518110 2024-09-22T08:37:48.117 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.114+0000 7fa34c62f800 1 -- 172.21.15.142:0/3008570934 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:105 4.3c 4:3dc76c6d:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.10.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e4845dcbf0 con 0x55e484513720 2024-09-22T08:37:48.118 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.114+0000 7fa343fff640 1 -- 172.21.15.142:0/3008570934 <== osd.1 v2:172.21.15.142:6816/3192108003 30 ==== osd_op_reply(105 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.10.8 [call out=89b] v0'0 uv1 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7fa334029040 con 0x55e484513720 2024-09-22T08:37:48.118 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.114+0000 7fa34c62f800 1 -- 172.21.15.142:0/3008570934 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:106 4.3b 4:dd021643:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.10.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e4845dcbf0 con 0x55e484518110 2024-09-22T08:37:48.118 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.114+0000 7fa34a91a640 1 -- 172.21.15.142:0/3008570934 <== osd.3 v2:172.21.15.142:6800/1064901393 32 ==== osd_op_reply(106 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.10.9 [call out=89b] v0'0 uv11 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7fa34403a070 con 0x55e484518110 2024-09-22T08:37:48.118 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.114+0000 7fa34c62f800 1 -- 172.21.15.142:0/3008570934 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:107 4.20 4:06311907:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.10.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e4845dcbf0 con 0x55e484513720 2024-09-22T08:37:48.118 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.115+0000 7fa343fff640 1 -- 172.21.15.142:0/3008570934 <== osd.1 v2:172.21.15.142:6816/3192108003 31 ==== osd_op_reply(107 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.10.10 [call out=89b] v0'0 uv14 ondisk = 0) ==== 196+0+89 (crc 0 0 0) 0x7fa334029040 con 0x55e484513720 2024-09-22T08:37:48.118 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.115+0000 7fa34c62f800 20 get_obj_state: octx=0x7fa33c05d440 obj=myfoo7:fourteen state=0x55e4845dac58 s->prefetch_data=0 2024-09-22T08:37:48.118 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.115+0000 7fa34c62f800 1 -- 172.21.15.142:0/3008570934 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:108 3.8 3:11b449c9:::e239248c-0bee-4e41-803a-24b288d3eb8f.4226.10_fourteen:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e4845db620 con 0x55e484518110 2024-09-22T08:37:48.118 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.115+0000 7fa34a91a640 1 -- 172.21.15.142:0/3008570934 <== osd.3 v2:172.21.15.142:6800/1064901393 33 ==== osd_op_reply(108 e239248c-0bee-4e41-803a-24b288d3eb8f.4226.10_fourteen [call out=24b,getxattrs out=867b,stat out=16b] v0'0 uv2 ondisk = 0) ==== 281+0+907 (crc 0 0 0) 0x7fa34403a070 con 0x55e484518110 2024-09-22T08:37:48.118 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.115+0000 7fa34c62f800 10 manifest: total_size = 8 2024-09-22T08:37:48.118 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.115+0000 7fa34c62f800 20 get_obj_state: setting s->obj_tag to e239248c-0bee-4e41-803a-24b288d3eb8f.4226.10051741298149272104 2024-09-22T08:37:48.118 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.115+0000 7fa34c62f800 20 get_obj_state: octx=0x7fa33c05d440 obj=myfoo7:fourteen state=0x55e4845dac58 s->prefetch_data=0 2024-09-22T08:37:48.118 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.115+0000 7fa34c62f800 20 prepare_atomic_modification: state is not atomic. state=0x55e4845dac58 2024-09-22T08:37:48.118 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.115+0000 7fa34c62f800 20 bucket index object: :.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.10.5 2024-09-22T08:37:48.119 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.115+0000 7fa34c62f800 1 -- 172.21.15.142:0/3008570934 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:109 4.25 4:a6cd7013:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.10.5:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=188b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e4845dc140 con 0x55e484518110 2024-09-22T08:37:48.125 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.116+0000 7fa34a91a640 1 -- 172.21.15.142:0/3008570934 <== osd.3 v2:172.21.15.142:6800/1064901393 34 ==== osd_op_reply(109 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.10.5 [stat,call,call] v32'7 uv7 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7fa34403a070 con 0x55e484518110 2024-09-22T08:37:48.125 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.116+0000 7fa34c62f800 1 -- 172.21.15.142:0/3008570934 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:110 3.8 3:11b449c9:::e239248c-0bee-4e41-803a-24b288d3eb8f.4226.10_fourteen:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e4845dc140 con 0x55e484518110 2024-09-22T08:37:48.125 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.117+0000 7fa34a91a640 1 -- 172.21.15.142:0/3008570934 <== osd.3 v2:172.21.15.142:6800/1064901393 35 ==== osd_op_reply(110 e239248c-0bee-4e41-803a-24b288d3eb8f.4226.10_fourteen [call] v32'3 uv3 ondisk = 0) ==== 197+0+0 (crc 0 0 0) 0x7fa34403a070 con 0x55e484518110 2024-09-22T08:37:48.125 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.117+0000 7fa34c62f800 1 -- 172.21.15.142:0/3008570934 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:111 4.25 4:a6cd7013:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.10.5:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=265b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e484564410 con 0x55e484518110 2024-09-22T08:37:48.125 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.118+0000 7fa34c62f800 20 list_objects_ordered: starting attempt 1 2024-09-22T08:37:48.125 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.118+0000 7fa34c62f800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-22T08:37:48.125 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.118+0000 7fa34c62f800 1 -- 172.21.15.142:0/3008570934 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:112 4.15 4:a98274ca:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.10.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fa344072000 con 0x55e484518110 2024-09-22T08:37:48.125 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.118+0000 7fa34c62f800 1 -- 172.21.15.142:0/3008570934 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:113 4.13 4:c907482d:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.10.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e4845db530 con 0x7fa3440333f0 2024-09-22T08:37:48.125 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.118+0000 7fa34c62f800 1 -- 172.21.15.142:0/3008570934 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:114 4.14 4:28489bb7:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.10.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e48456ab10 con 0x55e484518110 2024-09-22T08:37:48.125 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.118+0000 7fa34c62f800 1 -- 172.21.15.142:0/3008570934 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:115 4.c 4:31bf9291:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.10.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e48456d660 con 0x55e484513720 2024-09-22T08:37:48.126 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.118+0000 7fa34c62f800 1 -- 172.21.15.142:0/3008570934 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:116 4.36 4:6f220b3b:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.10.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e48456ffd0 con 0x55e484513720 2024-09-22T08:37:48.126 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.118+0000 7fa34c62f800 1 -- 172.21.15.142:0/3008570934 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:117 4.25 4:a6cd7013:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.10.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e4845db530 con 0x55e484518110 2024-09-22T08:37:48.126 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.118+0000 7fa34c62f800 1 -- 172.21.15.142:0/3008570934 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:118 4.11 4:8b847176:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.10.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e4845752a0 con 0x7fa33c0a5040 2024-09-22T08:37:48.126 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.118+0000 7fa34c62f800 1 -- 172.21.15.142:0/3008570934 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:119 4.3d 4:be0ad17a:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.10.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e484578100 con 0x55e484518110 2024-09-22T08:37:48.126 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.118+0000 7fa34c62f800 1 -- 172.21.15.142:0/3008570934 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:120 4.3c 4:3dc76c6d:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.10.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e48457af80 con 0x55e484513720 2024-09-22T08:37:48.126 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.118+0000 7fa34c62f800 1 -- 172.21.15.142:0/3008570934 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:121 4.3b 4:dd021643:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.10.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e48457de00 con 0x55e484518110 2024-09-22T08:37:48.126 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.118+0000 7fa34c62f800 1 -- 172.21.15.142:0/3008570934 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:122 4.20 4:06311907:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.10.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e4845806f0 con 0x55e484513720 2024-09-22T08:37:48.126 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.118+0000 7fa34a119640 1 -- 172.21.15.142:0/3008570934 <== osd.2 v2:172.21.15.142:6808/279438927 20 ==== osd_op_reply(113 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.10.1 [call out=89b] v0'0 uv1 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7fa33c051070 con 0x7fa3440333f0 2024-09-22T08:37:48.126 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.118+0000 7fa34a91a640 1 -- 172.21.15.142:0/3008570934 <== osd.3 v2:172.21.15.142:6800/1064901393 36 ==== osd_op_reply(112 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.10.0 [call out=89b] v0'0 uv1 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7fa34403a070 con 0x55e484518110 2024-09-22T08:37:48.126 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.118+0000 7fa34a91a640 1 -- 172.21.15.142:0/3008570934 <== osd.3 v2:172.21.15.142:6800/1064901393 37 ==== osd_op_reply(114 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.10.2 [call out=89b] v0'0 uv1 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7fa34403a070 con 0x55e484518110 2024-09-22T08:37:48.126 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.118+0000 7fa34a91a640 1 -- 172.21.15.142:0/3008570934 <== osd.3 v2:172.21.15.142:6800/1064901393 38 ==== osd_op_reply(121 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.10.9 [call out=89b] v0'0 uv11 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7fa34403a070 con 0x55e484518110 2024-09-22T08:37:48.126 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.118+0000 7fa343fff640 1 -- 172.21.15.142:0/3008570934 <== osd.0 v2:172.21.15.31:6800/168281188 26 ==== osd_op_reply(118 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.10.6 [call out=89b] v0'0 uv2 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7fa334029040 con 0x7fa33c0a5040 2024-09-22T08:37:48.126 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.118+0000 7fa343fff640 1 -- 172.21.15.142:0/3008570934 <== osd.1 v2:172.21.15.142:6816/3192108003 32 ==== osd_op_reply(115 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.10.3 [call out=89b] v0'0 uv10 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7fa334029040 con 0x55e484513720 2024-09-22T08:37:48.126 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.119+0000 7fa343fff640 1 -- 172.21.15.142:0/3008570934 <== osd.1 v2:172.21.15.142:6816/3192108003 33 ==== osd_op_reply(116 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.10.4 [call out=89b] v0'0 uv11 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7fa334029040 con 0x55e484513720 2024-09-22T08:37:48.127 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.119+0000 7fa343fff640 1 -- 172.21.15.142:0/3008570934 <== osd.1 v2:172.21.15.142:6816/3192108003 34 ==== osd_op_reply(120 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.10.8 [call out=89b] v0'0 uv1 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7fa334029040 con 0x55e484513720 2024-09-22T08:37:48.127 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.119+0000 7fa34a91a640 1 -- 172.21.15.142:0/3008570934 <== osd.3 v2:172.21.15.142:6800/1064901393 39 ==== osd_op_reply(119 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.10.7 [call out=89b] v0'0 uv5 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7fa34403a070 con 0x55e484518110 2024-09-22T08:37:48.127 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.119+0000 7fa343fff640 1 -- 172.21.15.142:0/3008570934 <== osd.1 v2:172.21.15.142:6816/3192108003 35 ==== osd_op_reply(122 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.10.10 [call out=89b] v0'0 uv14 ondisk = 0) ==== 196+0+89 (crc 0 0 0) 0x7fa334029040 con 0x55e484513720 2024-09-22T08:37:48.127 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.119+0000 7fa34a91a640 1 -- 172.21.15.142:0/3008570934 <== osd.3 v2:172.21.15.142:6800/1064901393 40 ==== osd_op_reply(111 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.10.5 [stat,call,call] v32'8 uv8 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7fa34403a070 con 0x55e484518110 2024-09-22T08:37:48.127 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.119+0000 7fa22dffb640 20 handle_completion(): completion ok for obj=fourteen 2024-09-22T08:37:48.127 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.119+0000 7fa34a91a640 1 -- 172.21.15.142:0/3008570934 <== osd.3 v2:172.21.15.142:6800/1064901393 41 ==== osd_op_reply(117 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.10.5 [call out=128b] v0'0 uv8 ondisk = 0) ==== 195+0+128 (crc 0 0 0) 0x7fa34403a070 con 0x55e484518110 2024-09-22T08:37:48.127 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.119+0000 7fa34c62f800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-22T08:37:48.127 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.119+0000 7fa34c62f800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-22T08:37:48.127 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.119+0000 7fa34c62f800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-22T08:37:48.127 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.119+0000 7fa34c62f800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-22T08:37:48.127 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.119+0000 7fa34c62f800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo7[e239248c-0bee-4e41-803a-24b288d3eb8f.4226.10])"; uploads.size()=0; is_truncated=0 2024-09-22T08:37:48.127 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.119+0000 7fa34c62f800 1 -- 172.21.15.142:0/3008570934 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:123 4.15 4:a98274ca:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.10.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e484578100 con 0x55e484518110 2024-09-22T08:37:48.127 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.119+0000 7fa34c62f800 1 -- 172.21.15.142:0/3008570934 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:124 4.13 4:c907482d:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.10.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e4845752a0 con 0x7fa3440333f0 2024-09-22T08:37:48.127 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.119+0000 7fa34c62f800 1 -- 172.21.15.142:0/3008570934 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:125 4.14 4:28489bb7:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.10.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e48457a930 con 0x55e484518110 2024-09-22T08:37:48.128 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.119+0000 7fa34c62f800 1 -- 172.21.15.142:0/3008570934 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:126 4.c 4:31bf9291:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.10.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e48457ad70 con 0x55e484513720 2024-09-22T08:37:48.128 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.119+0000 7fa34c62f800 1 -- 172.21.15.142:0/3008570934 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:127 4.36 4:6f220b3b:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.10.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e484578100 con 0x55e484513720 2024-09-22T08:37:48.128 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.119+0000 7fa34c62f800 1 -- 172.21.15.142:0/3008570934 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:128 4.25 4:a6cd7013:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.10.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e4845752a0 con 0x55e484518110 2024-09-22T08:37:48.128 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.119+0000 7fa34c62f800 1 -- 172.21.15.142:0/3008570934 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:129 4.11 4:8b847176:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.10.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e48457a930 con 0x7fa33c0a5040 2024-09-22T08:37:48.128 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.119+0000 7fa34c62f800 1 -- 172.21.15.142:0/3008570934 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:130 4.3d 4:be0ad17a:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.10.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e484577c90 con 0x55e484518110 2024-09-22T08:37:48.128 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.119+0000 7fa34c62f800 1 -- 172.21.15.142:0/3008570934 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:131 4.3c 4:3dc76c6d:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.10.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e4845752a0 con 0x55e484513720 2024-09-22T08:37:48.128 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.119+0000 7fa34c62f800 1 -- 172.21.15.142:0/3008570934 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:132 4.3b 4:dd021643:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.10.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e484564cb0 con 0x55e484518110 2024-09-22T08:37:48.128 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.119+0000 7fa34c62f800 1 -- 172.21.15.142:0/3008570934 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:133 4.20 4:06311907:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.10.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e484577c90 con 0x55e484513720 2024-09-22T08:37:48.128 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.120+0000 7fa34a119640 1 -- 172.21.15.142:0/3008570934 <== osd.2 v2:172.21.15.142:6808/279438927 21 ==== osd_op_reply(124 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.10.1 [call out=89b] v0'0 uv1 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7fa33c051070 con 0x7fa3440333f0 2024-09-22T08:37:48.128 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.120+0000 7fa343fff640 1 -- 172.21.15.142:0/3008570934 <== osd.1 v2:172.21.15.142:6816/3192108003 36 ==== osd_op_reply(126 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.10.3 [call out=89b] v0'0 uv10 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7fa334029040 con 0x55e484513720 2024-09-22T08:37:48.128 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.120+0000 7fa343fff640 1 -- 172.21.15.142:0/3008570934 <== osd.1 v2:172.21.15.142:6816/3192108003 37 ==== osd_op_reply(127 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.10.4 [call out=89b] v0'0 uv11 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7fa334029040 con 0x55e484513720 2024-09-22T08:37:48.128 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.120+0000 7fa343fff640 1 -- 172.21.15.142:0/3008570934 <== osd.1 v2:172.21.15.142:6816/3192108003 38 ==== osd_op_reply(131 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.10.8 [call out=89b] v0'0 uv1 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7fa334029040 con 0x55e484513720 2024-09-22T08:37:48.128 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.120+0000 7fa343fff640 1 -- 172.21.15.142:0/3008570934 <== osd.1 v2:172.21.15.142:6816/3192108003 39 ==== osd_op_reply(133 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.10.10 [call out=89b] v0'0 uv14 ondisk = 0) ==== 196+0+89 (crc 0 0 0) 0x7fa334029040 con 0x55e484513720 2024-09-22T08:37:48.128 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.120+0000 7fa343fff640 1 -- 172.21.15.142:0/3008570934 <== osd.0 v2:172.21.15.31:6800/168281188 27 ==== osd_op_reply(129 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.10.6 [call out=89b] v0'0 uv2 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7fa334029040 con 0x7fa33c0a5040 2024-09-22T08:37:48.129 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.120+0000 7fa34a91a640 1 -- 172.21.15.142:0/3008570934 <== osd.3 v2:172.21.15.142:6800/1064901393 42 ==== osd_op_reply(125 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.10.2 [call out=89b] v0'0 uv1 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7fa34403a070 con 0x55e484518110 2024-09-22T08:37:48.129 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.120+0000 7fa34a91a640 1 -- 172.21.15.142:0/3008570934 <== osd.3 v2:172.21.15.142:6800/1064901393 43 ==== osd_op_reply(123 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.10.0 [call out=89b] v0'0 uv1 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7fa34403a070 con 0x55e484518110 2024-09-22T08:37:48.129 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.120+0000 7fa34a91a640 1 -- 172.21.15.142:0/3008570934 <== osd.3 v2:172.21.15.142:6800/1064901393 44 ==== osd_op_reply(130 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.10.7 [call out=89b] v0'0 uv5 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7fa34403a070 con 0x55e484518110 2024-09-22T08:37:48.129 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.120+0000 7fa34a91a640 1 -- 172.21.15.142:0/3008570934 <== osd.3 v2:172.21.15.142:6800/1064901393 45 ==== osd_op_reply(132 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.10.9 [call out=89b] v0'0 uv11 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7fa34403a070 con 0x55e484518110 2024-09-22T08:37:48.129 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.120+0000 7fa34a91a640 1 -- 172.21.15.142:0/3008570934 <== osd.3 v2:172.21.15.142:6800/1064901393 46 ==== osd_op_reply(128 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.10.5 [call out=128b] v0'0 uv8 ondisk = 0) ==== 195+0+128 (crc 0 0 0) 0x7fa34403a070 con 0x55e484518110 2024-09-22T08:37:48.129 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.120+0000 7fa34c62f800 1 -- 172.21.15.142:0/3008570934 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:134 8.1 8:810902b1:users.uid::fud.buckets:head [call user.set_buckets_info in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e484578100 con 0x7fa33c0a5040 2024-09-22T08:37:48.129 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.121+0000 7fa343fff640 1 -- 172.21.15.142:0/3008570934 <== osd.0 v2:172.21.15.31:6800/168281188 28 ==== osd_op_reply(134 fud.buckets [call] v32'6 uv6 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fa334029040 con 0x7fa33c0a5040 2024-09-22T08:37:48.129 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.121+0000 7fa34c62f800 10 cache get: name=default.rgw.meta+root+myfoo7 : miss 2024-09-22T08:37:48.129 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.121+0000 7fa34c62f800 20 rados->read ofs=0 len=0 2024-09-22T08:37:48.129 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.121+0000 7fa34c62f800 1 -- 172.21.15.142:0/3008570934 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:135 8.9 8:938c738d:root::myfoo7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e484578100 con 0x7fa3440333f0 2024-09-22T08:37:48.129 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.122+0000 7fa34a119640 1 -- 172.21.15.142:0/3008570934 <== osd.2 v2:172.21.15.142:6808/279438927 22 ==== osd_op_reply(135 myfoo7 [call out=48b,read 0~168 out=168b] v0'0 uv44 ondisk = 0) ==== 192+0+216 (crc 0 0 0) 0x7fa33c051070 con 0x7fa3440333f0 2024-09-22T08:37:48.129 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.122+0000 7fa34c62f800 20 rados_obj.operate() r=0 bl.length=168 2024-09-22T08:37:48.129 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.122+0000 7fa34c62f800 10 cache put: name=default.rgw.meta+root+myfoo7 info.flags=0x11 2024-09-22T08:37:48.129 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.122+0000 7fa34c62f800 10 adding default.rgw.meta+root+myfoo7 to cache LRU end 2024-09-22T08:37:48.130 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.122+0000 7fa34c62f800 1 -- 172.21.15.142:0/3008570934 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:136 8.9 8:938c738d:root::myfoo7:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e484578100 con 0x7fa3440333f0 2024-09-22T08:37:48.130 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.123+0000 7fa34a119640 1 -- 172.21.15.142:0/3008570934 <== osd.2 v2:172.21.15.142:6808/279438927 23 ==== osd_op_reply(136 myfoo7 [call,call,delete] v32'45 uv45 ondisk = 0) ==== 234+0+0 (crc 0 0 0) 0x7fa33c051070 con 0x7fa3440333f0 2024-09-22T08:37:48.130 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.123+0000 7fa34c62f800 10 removing default.rgw.meta+root+myfoo7 from cache 2024-09-22T08:37:48.130 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.123+0000 7fa34c62f800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:myfoo7, ofs0, ns] 2024-09-22T08:37:48.130 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.123+0000 7fa34c62f800 1 -- 172.21.15.142:0/3008570934 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:137 7.e 7:7759931f:::notify.3:head [notify cookie 94439961242992 in=162b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e484578100 con 0x7fa3440333f0 2024-09-22T08:37:48.130 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.123+0000 7fa34a119640 1 -- 172.21.15.142:0/3008570934 <== osd.2 v2:172.21.15.142:6808/279438927 24 ==== watch-notify(notify (1) cookie 94439960877840 notify 137438953506 ret 0) ==== 192+0+0 (crc 0 0 0) 0x55e48455ebf0 con 0x7fa3440333f0 2024-09-22T08:37:48.130 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.123+0000 7fa22d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953506 cookie 94439960877840 notifier 4758 bl.length()=150 2024-09-22T08:37:48.130 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.123+0000 7fa34a119640 1 -- 172.21.15.142:0/3008570934 <== osd.2 v2:172.21.15.142:6808/279438927 25 ==== osd_op_reply(137 notify.3 [notify cookie 94439961242992 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fa33c051070 con 0x7fa3440333f0 2024-09-22T08:37:48.130 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.123+0000 7fa22d7fa640 1 -- 172.21.15.142:0/3008570934 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:138 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fa1800032c0 con 0x7fa3440333f0 2024-09-22T08:37:48.130 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.123+0000 7fa34a119640 1 -- 172.21.15.142:0/3008570934 <== osd.2 v2:172.21.15.142:6808/279438927 26 ==== osd_op_reply(138 notify.3 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa33c051070 con 0x7fa3440333f0 2024-09-22T08:37:48.130 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.124+0000 7fa34a119640 1 -- 172.21.15.142:0/3008570934 <== osd.2 v2:172.21.15.142:6808/279438927 27 ==== watch-notify(notify_complete (2) cookie 94439961242992 notify 137438953506 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fa33c0ad060 con 0x7fa3440333f0 2024-09-22T08:37:48.130 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.124+0000 7fa34c62f800 1 -- 172.21.15.142:0/3008570934 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:139 8.4 8:21bf25a9:root::.bucket.meta.myfoo7%3ae239248c-0bee-4e41-803a-24b288d3eb8f.4226.10:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e48457ad50 con 0x7fa3440333f0 2024-09-22T08:37:48.134 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.125+0000 7fa34a119640 1 -- 172.21.15.142:0/3008570934 <== osd.2 v2:172.21.15.142:6808/279438927 28 ==== osd_op_reply(139 .bucket.meta.myfoo7:e239248c-0bee-4e41-803a-24b288d3eb8f.4226.10 [call,call,delete] v32'5 uv5 ondisk = 0) ==== 292+0+0 (crc 0 0 0) 0x7fa33c051070 con 0x7fa3440333f0 2024-09-22T08:37:48.134 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.125+0000 7fa34c62f800 10 removing default.rgw.meta+root+.bucket.meta.myfoo7:e239248c-0bee-4e41-803a-24b288d3eb8f.4226.10 from cache 2024-09-22T08:37:48.134 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.125+0000 7fa34c62f800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo7:e239248c-0bee-4e41-803a-24b288d3eb8f.4226.10, ofs0, ns] 2024-09-22T08:37:48.134 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.125+0000 7fa34c62f800 1 -- 172.21.15.142:0/3008570934 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:140 7.e 7:7759931f:::notify.3:head [notify cookie 94439961242960 in=220b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e484578100 con 0x7fa3440333f0 2024-09-22T08:37:48.134 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.125+0000 7fa34a119640 1 -- 172.21.15.142:0/3008570934 <== osd.2 v2:172.21.15.142:6808/279438927 29 ==== watch-notify(notify (1) cookie 94439960877840 notify 137438953507 ret 0) ==== 250+0+0 (crc 0 0 0) 0x7fa33c0ad060 con 0x7fa3440333f0 2024-09-22T08:37:48.134 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.125+0000 7fa22dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953507 cookie 94439960877840 notifier 4758 bl.length()=208 2024-09-22T08:37:48.134 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.125+0000 7fa22dffb640 1 -- 172.21.15.142:0/3008570934 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:141 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fa210003d60 con 0x7fa3440333f0 2024-09-22T08:37:48.134 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.125+0000 7fa34a119640 1 -- 172.21.15.142:0/3008570934 <== osd.2 v2:172.21.15.142:6808/279438927 30 ==== osd_op_reply(140 notify.3 [notify cookie 94439961242960 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fa33c051070 con 0x7fa3440333f0 2024-09-22T08:37:48.134 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.125+0000 7fa34a119640 1 -- 172.21.15.142:0/3008570934 <== osd.2 v2:172.21.15.142:6808/279438927 31 ==== osd_op_reply(141 notify.3 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa33c051070 con 0x7fa3440333f0 2024-09-22T08:37:48.134 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.125+0000 7fa34a119640 1 -- 172.21.15.142:0/3008570934 <== osd.2 v2:172.21.15.142:6808/279438927 32 ==== watch-notify(notify_complete (2) cookie 94439961242960 notify 137438953507 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55e4844da110 con 0x7fa3440333f0 2024-09-22T08:37:48.135 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.125+0000 7fa34c62f800 1 -- 172.21.15.142:0/3008570934 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:142 4.15 4:a98274ca:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.10.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e48457ad50 con 0x55e484518110 2024-09-22T08:37:48.135 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.125+0000 7fa34c62f800 1 -- 172.21.15.142:0/3008570934 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:143 4.13 4:c907482d:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.10.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e484578100 con 0x7fa3440333f0 2024-09-22T08:37:48.135 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.125+0000 7fa34c62f800 1 -- 172.21.15.142:0/3008570934 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:144 4.14 4:28489bb7:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.10.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e4845752a0 con 0x55e484518110 2024-09-22T08:37:48.135 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.125+0000 7fa34c62f800 1 -- 172.21.15.142:0/3008570934 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:145 4.c 4:31bf9291:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.10.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e48455da40 con 0x55e484513720 2024-09-22T08:37:48.135 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.125+0000 7fa34c62f800 1 -- 172.21.15.142:0/3008570934 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:146 4.36 4:6f220b3b:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.10.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e484578100 con 0x55e484513720 2024-09-22T08:37:48.135 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.125+0000 7fa34c62f800 1 -- 172.21.15.142:0/3008570934 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:147 4.25 4:a6cd7013:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.10.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e48457ad50 con 0x55e484518110 2024-09-22T08:37:48.135 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.125+0000 7fa34c62f800 1 -- 172.21.15.142:0/3008570934 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:148 4.11 4:8b847176:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.10.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e4845752a0 con 0x7fa33c0a5040 2024-09-22T08:37:48.135 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.125+0000 7fa34c62f800 1 -- 172.21.15.142:0/3008570934 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:149 4.3d 4:be0ad17a:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.10.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e48457bb90 con 0x55e484518110 2024-09-22T08:37:48.135 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.125+0000 7fa34c62f800 1 -- 172.21.15.142:0/3008570934 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:150 4.3c 4:3dc76c6d:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.10.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e48457ca70 con 0x55e484513720 2024-09-22T08:37:48.135 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.125+0000 7fa34c62f800 1 -- 172.21.15.142:0/3008570934 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:151 4.3b 4:dd021643:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.10.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e484565150 con 0x55e484518110 2024-09-22T08:37:48.135 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.125+0000 7fa34c62f800 1 -- 172.21.15.142:0/3008570934 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:152 4.20 4:06311907:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.10.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e48457ad50 con 0x55e484513720 2024-09-22T08:37:48.135 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.127+0000 7fa34a119640 1 -- 172.21.15.142:0/3008570934 <== osd.2 v2:172.21.15.142:6808/279438927 33 ==== osd_op_reply(143 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.10.1 [delete] v32'2 uv2 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7fa33c051070 con 0x7fa3440333f0 2024-09-22T08:37:48.136 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.127+0000 7fa343fff640 1 -- 172.21.15.142:0/3008570934 <== osd.1 v2:172.21.15.142:6816/3192108003 40 ==== osd_op_reply(145 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.10.3 [delete] v32'12 uv12 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7fa334029040 con 0x55e484513720 2024-09-22T08:37:48.136 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.127+0000 7fa343fff640 1 -- 172.21.15.142:0/3008570934 <== osd.1 v2:172.21.15.142:6816/3192108003 41 ==== osd_op_reply(150 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.10.8 [delete] v32'2 uv2 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7fa334029040 con 0x55e484513720 2024-09-22T08:37:48.136 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.127+0000 7fa343fff640 1 -- 172.21.15.142:0/3008570934 <== osd.1 v2:172.21.15.142:6816/3192108003 42 ==== osd_op_reply(152 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.10.10 [delete] v32'16 uv16 ondisk = 0) ==== 196+0+0 (crc 0 0 0) 0x7fa334029040 con 0x55e484513720 2024-09-22T08:37:48.136 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.127+0000 7fa343fff640 1 -- 172.21.15.142:0/3008570934 <== osd.1 v2:172.21.15.142:6816/3192108003 43 ==== osd_op_reply(146 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.10.4 [delete] v32'12 uv12 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7fa334029040 con 0x55e484513720 2024-09-22T08:37:48.136 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.128+0000 7fa34a91a640 1 -- 172.21.15.142:0/3008570934 <== osd.3 v2:172.21.15.142:6800/1064901393 47 ==== osd_op_reply(147 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.10.5 [delete] v32'9 uv9 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7fa34403a070 con 0x55e484518110 2024-09-22T08:37:48.136 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.128+0000 7fa34a91a640 1 -- 172.21.15.142:0/3008570934 <== osd.3 v2:172.21.15.142:6800/1064901393 48 ==== osd_op_reply(144 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.10.2 [delete] v32'2 uv2 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7fa34403a070 con 0x55e484518110 2024-09-22T08:37:48.136 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.128+0000 7fa34a91a640 1 -- 172.21.15.142:0/3008570934 <== osd.3 v2:172.21.15.142:6800/1064901393 49 ==== osd_op_reply(151 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.10.9 [delete] v32'12 uv12 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7fa34403a070 con 0x55e484518110 2024-09-22T08:37:48.136 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.128+0000 7fa34a91a640 1 -- 172.21.15.142:0/3008570934 <== osd.3 v2:172.21.15.142:6800/1064901393 50 ==== osd_op_reply(142 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.10.0 [delete] v32'2 uv2 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7fa34403a070 con 0x55e484518110 2024-09-22T08:37:48.136 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.130+0000 7fa34a91a640 1 -- 172.21.15.142:0/3008570934 <== osd.3 v2:172.21.15.142:6800/1064901393 51 ==== osd_op_reply(149 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.10.7 [delete] v32'6 uv6 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7fa34403a070 con 0x55e484518110 2024-09-22T08:37:48.136 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.130+0000 7fa343fff640 1 -- 172.21.15.142:0/3008570934 <== osd.0 v2:172.21.15.31:6800/168281188 29 ==== osd_op_reply(148 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.10.6 [delete] v32'3 uv3 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7fa334029040 con 0x7fa33c0a5040 2024-09-22T08:37:48.136 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.130+0000 7fa34c62f800 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo7/e239248c-0bee-4e41-803a-24b288d3eb8f.4226.10 : miss 2024-09-22T08:37:48.136 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.130+0000 7fa34c62f800 20 rados->read ofs=0 len=0 2024-09-22T08:37:48.136 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.130+0000 7fa34c62f800 1 -- 172.21.15.142:0/3008570934 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:153 6.8 6:1239fb47:::pubsub..bucket.myfoo7%2fe239248c-0bee-4e41-803a-24b288d3eb8f.4226.10:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e484563ec0 con 0x55e484518110 2024-09-22T08:37:48.136 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.130+0000 7fa34a91a640 1 -- 172.21.15.142:0/3008570934 <== osd.3 v2:172.21.15.142:6800/1064901393 52 ==== osd_op_reply(153 pubsub..bucket.myfoo7/e239248c-0bee-4e41-803a-24b288d3eb8f.4226.10 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 210+0+0 (crc 0 0 0) 0x7fa34403a070 con 0x55e484518110 2024-09-22T08:37:48.137 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.130+0000 7fa34c62f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:48.137 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.130+0000 7fa34c62f800 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo7/e239248c-0bee-4e41-803a-24b288d3eb8f.4226.10 info.flags=0x0 2024-09-22T08:37:48.137 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.130+0000 7fa34c62f800 10 adding default.rgw.log++pubsub..bucket.myfoo7/e239248c-0bee-4e41-803a-24b288d3eb8f.4226.10 to cache LRU end 2024-09-22T08:37:48.137 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.130+0000 7fa34c62f800 1 -- 172.21.15.142:0/3008570934 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:154 6.8 6:1239fb47:::pubsub..bucket.myfoo7%2fe239248c-0bee-4e41-803a-24b288d3eb8f.4226.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e484563ec0 con 0x55e484518110 2024-09-22T08:37:48.137 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.131+0000 7fa34a91a640 1 -- 172.21.15.142:0/3008570934 <== osd.3 v2:172.21.15.142:6800/1064901393 53 ==== osd_op_reply(154 pubsub..bucket.myfoo7/e239248c-0bee-4e41-803a-24b288d3eb8f.4226.10 [delete] v32'34 uv27 ondisk = -2 ((2) No such file or directory)) ==== 210+0+0 (crc 0 0 0) 0x7fa34403a070 con 0x55e484518110 2024-09-22T08:37:48.137 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.131+0000 7fa34c62f800 1 -- 172.21.15.142:0/3008570934 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:155 8.1 8:810902b1:users.uid::fud.buckets:head [call user.remove_bucket in=147b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e484563ec0 con 0x7fa33c0a5040 2024-09-22T08:37:48.137 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.132+0000 7fa343fff640 1 -- 172.21.15.142:0/3008570934 <== osd.0 v2:172.21.15.31:6800/168281188 30 ==== osd_op_reply(155 fud.buckets [call] v32'7 uv7 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fa334029040 con 0x7fa33c0a5040 2024-09-22T08:37:48.137 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.132+0000 7fa34c62f800 10 removing key index: p5YnriCv1nAtykxBrupQ 2024-09-22T08:37:48.137 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.132+0000 7fa34c62f800 1 -- 172.21.15.142:0/3008570934 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:156 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e484563ec0 con 0x7fa33c0a5040 2024-09-22T08:37:48.140 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.134+0000 7fa343fff640 1 -- 172.21.15.142:0/3008570934 <== osd.0 v2:172.21.15.31:6800/168281188 31 ==== osd_op_reply(156 p5YnriCv1nAtykxBrupQ [delete] v32'10 uv10 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fa334029040 con 0x7fa33c0a5040 2024-09-22T08:37:48.140 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.134+0000 7fa34c62f800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-22T08:37:48.140 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.134+0000 7fa34c62f800 1 -- 172.21.15.142:0/3008570934 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:157 7.15 7:a93a5511:::notify.2:head [notify cookie 94439961130480 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e48457d6a0 con 0x55e484518110 2024-09-22T08:37:48.140 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.134+0000 7fa34a91a640 1 -- 172.21.15.142:0/3008570934 <== osd.3 v2:172.21.15.142:6800/1064901393 54 ==== watch-notify(notify (1) cookie 94439960874048 notify 137438953481 ret 0) ==== 212+0+0 (crc 0 0 0) 0x55e484530ed0 con 0x55e484518110 2024-09-22T08:37:48.140 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.134+0000 7fa22dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953481 cookie 94439960874048 notifier 4758 bl.length()=170 2024-09-22T08:37:48.141 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.134+0000 7fa22dffb640 1 -- 172.21.15.142:0/3008570934 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:158 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fa210003d60 con 0x55e484518110 2024-09-22T08:37:48.141 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.134+0000 7fa34a91a640 1 -- 172.21.15.142:0/3008570934 <== osd.3 v2:172.21.15.142:6800/1064901393 55 ==== osd_op_reply(157 notify.2 [notify cookie 94439961130480 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fa34403a070 con 0x55e484518110 2024-09-22T08:37:48.141 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.134+0000 7fa34a91a640 1 -- 172.21.15.142:0/3008570934 <== osd.3 v2:172.21.15.142:6800/1064901393 56 ==== osd_op_reply(158 notify.2 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa34403a070 con 0x55e484518110 2024-09-22T08:37:48.141 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.135+0000 7fa34a91a640 1 -- 172.21.15.142:0/3008570934 <== osd.3 v2:172.21.15.142:6800/1064901393 57 ==== watch-notify(notify_complete (2) cookie 94439961130480 notify 137438953481 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55e484508350 con 0x55e484518110 2024-09-22T08:37:48.141 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.135+0000 7fa34c62f800 10 removing email index: 2024-09-22T08:37:48.141 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.135+0000 7fa34c62f800 10 removing user buckets index 2024-09-22T08:37:48.141 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.135+0000 7fa34c62f800 1 -- 172.21.15.142:0/3008570934 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:159 8.1 8:810902b1:users.uid::fud.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e48455f5f0 con 0x7fa33c0a5040 2024-09-22T08:37:48.141 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.136+0000 7fa343fff640 1 -- 172.21.15.142:0/3008570934 <== osd.0 v2:172.21.15.31:6800/168281188 32 ==== osd_op_reply(159 fud.buckets [delete] v32'8 uv8 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fa334029040 con 0x7fa33c0a5040 2024-09-22T08:37:48.141 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.136+0000 7fa34c62f800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:fud.buckets, ofs0, ns] 2024-09-22T08:37:48.141 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.136+0000 7fa34c62f800 1 -- 172.21.15.142:0/3008570934 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:160 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94439961150960 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e484563ec0 con 0x7fa33c0a5040 2024-09-22T08:37:48.141 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.136+0000 7fa343fff640 1 -- 172.21.15.142:0/3008570934 <== osd.0 v2:172.21.15.31:6800/168281188 33 ==== watch-notify(notify (1) cookie 94439960883216 notify 137438953506 ret 0) ==== 202+0+0 (crc 0 0 0) 0x55e484530a90 con 0x7fa33c0a5040 2024-09-22T08:37:48.141 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.136+0000 7fa22d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953506 cookie 94439960883216 notifier 4758 bl.length()=160 2024-09-22T08:37:48.141 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.136+0000 7fa343fff640 1 -- 172.21.15.142:0/3008570934 <== osd.0 v2:172.21.15.31:6800/168281188 34 ==== osd_op_reply(160 notify.6 [notify cookie 94439961150960 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fa334029040 con 0x7fa33c0a5040 2024-09-22T08:37:48.141 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.136+0000 7fa22d7fa640 1 -- 172.21.15.142:0/3008570934 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:161 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fa1800032a0 con 0x7fa33c0a5040 2024-09-22T08:37:48.142 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.136+0000 7fa343fff640 1 -- 172.21.15.142:0/3008570934 <== osd.0 v2:172.21.15.31:6800/168281188 35 ==== osd_op_reply(161 notify.6 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa334029040 con 0x7fa33c0a5040 2024-09-22T08:37:48.142 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.136+0000 7fa343fff640 1 -- 172.21.15.142:0/3008570934 <== osd.0 v2:172.21.15.31:6800/168281188 36 ==== watch-notify(notify_complete (2) cookie 94439961150960 notify 137438953506 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55e4845085e0 con 0x7fa33c0a5040 2024-09-22T08:37:48.142 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.137+0000 7fa34c62f800 10 removing user index: fud 2024-09-22T08:37:48.142 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.137+0000 7fa34c62f800 1 -- 172.21.15.142:0/3008570934 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:162 8.e 8:75f48285:users.uid::fud:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e48455f5f0 con 0x7fa33c0a5040 2024-09-22T08:37:48.142 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.138+0000 7fa343fff640 1 -- 172.21.15.142:0/3008570934 <== osd.0 v2:172.21.15.31:6800/168281188 37 ==== osd_op_reply(162 fud [call,call,delete] v32'11 uv11 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7fa334029040 con 0x7fa33c0a5040 2024-09-22T08:37:48.142 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.138+0000 7fa34c62f800 10 removing default.rgw.meta+users.uid+fud from cache 2024-09-22T08:37:48.142 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.138+0000 7fa34c62f800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-09-22T08:37:48.142 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.138+0000 7fa34c62f800 1 -- 172.21.15.142:0/3008570934 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:163 7.3 7:c609908c:::notify.5:head [notify cookie 94439961150960 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e48455f5f0 con 0x7fa33c0a5040 2024-09-22T08:37:48.142 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.138+0000 7fa343fff640 1 -- 172.21.15.142:0/3008570934 <== osd.0 v2:172.21.15.31:6800/168281188 38 ==== watch-notify(notify (1) cookie 94439960882160 notify 137438953507 ret 0) ==== 194+0+0 (crc 0 0 0) 0x55e4845085e0 con 0x7fa33c0a5040 2024-09-22T08:37:48.142 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.138+0000 7fa22d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953507 cookie 94439960882160 notifier 4758 bl.length()=152 2024-09-22T08:37:48.142 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.138+0000 7fa22d7fa640 1 -- 172.21.15.142:0/3008570934 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:164 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fa1800032a0 con 0x7fa33c0a5040 2024-09-22T08:37:48.142 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.138+0000 7fa343fff640 1 -- 172.21.15.142:0/3008570934 <== osd.0 v2:172.21.15.31:6800/168281188 39 ==== osd_op_reply(163 notify.5 [notify cookie 94439961150960 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fa334029040 con 0x7fa33c0a5040 2024-09-22T08:37:48.142 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.138+0000 7fa343fff640 1 -- 172.21.15.142:0/3008570934 <== osd.0 v2:172.21.15.31:6800/168281188 40 ==== osd_op_reply(164 notify.5 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa334029040 con 0x7fa33c0a5040 2024-09-22T08:37:48.143 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.138+0000 7fa343fff640 1 -- 172.21.15.142:0/3008570934 <== osd.0 v2:172.21.15.31:6800/168281188 41 ==== watch-notify(notify_complete (2) cookie 94439961150960 notify 137438953507 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55e4845306d0 con 0x7fa33c0a5040 2024-09-22T08:37:48.143 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.139+0000 7fa200fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:37:48.143 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.139+0000 7fa34c62f800 1 -- 172.21.15.142:0/3008570934 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:165 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94439960900512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e48455f5f0 con 0x55e484513720 2024-09-22T08:37:48.144 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.140+0000 7fa343fff640 1 -- 172.21.15.142:0/3008570934 <== osd.1 v2:172.21.15.142:6816/3192108003 44 ==== osd_op_reply(165 data_loggenerations_metadata [watch unwatch cookie 94439960900512] v32'228 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa334029040 con 0x55e484513720 2024-09-22T08:37:48.144 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.140+0000 7fa34c62f800 1 -- 172.21.15.142:0/3008570934 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:166 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94439960865008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e48455f5f0 con 0x7fa3440333f0 2024-09-22T08:37:48.144 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.141+0000 7fa34a119640 1 -- 172.21.15.142:0/3008570934 <== osd.2 v2:172.21.15.142:6808/279438927 34 ==== osd_op_reply(166 notify.0 [watch unwatch cookie 94439960865008] v32'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa33c051070 con 0x7fa3440333f0 2024-09-22T08:37:48.144 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.141+0000 7fa34c62f800 20 remove_watcher() i=0 2024-09-22T08:37:48.144 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.141+0000 7fa34c62f800 2 removed watcher, disabling cache 2024-09-22T08:37:48.144 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.141+0000 7fa34c62f800 1 -- 172.21.15.142:0/3008570934 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:167 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94439960870496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e48455f5f0 con 0x55e484513720 2024-09-22T08:37:48.144 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.142+0000 7fa343fff640 1 -- 172.21.15.142:0/3008570934 <== osd.1 v2:172.21.15.142:6816/3192108003 45 ==== osd_op_reply(167 notify.1 [watch unwatch cookie 94439960870496] v32'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa334029040 con 0x55e484513720 2024-09-22T08:37:48.144 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.142+0000 7fa34c62f800 20 remove_watcher() i=1 2024-09-22T08:37:48.144 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.142+0000 7fa34c62f800 1 -- 172.21.15.142:0/3008570934 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:168 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94439960874048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e48455f5f0 con 0x55e484518110 2024-09-22T08:37:48.145 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.143+0000 7fa34a91a640 1 -- 172.21.15.142:0/3008570934 <== osd.3 v2:172.21.15.142:6800/1064901393 58 ==== osd_op_reply(168 notify.2 [watch unwatch cookie 94439960874048] v32'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa34403a070 con 0x55e484518110 2024-09-22T08:37:48.145 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.143+0000 7fa34c62f800 20 remove_watcher() i=2 2024-09-22T08:37:48.145 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.143+0000 7fa34c62f800 1 -- 172.21.15.142:0/3008570934 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:169 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94439960877840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e48455f5f0 con 0x7fa3440333f0 2024-09-22T08:37:48.146 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.144+0000 7fa34a119640 1 -- 172.21.15.142:0/3008570934 <== osd.2 v2:172.21.15.142:6808/279438927 35 ==== osd_op_reply(169 notify.3 [watch unwatch cookie 94439960877840] v32'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa33c051070 con 0x7fa3440333f0 2024-09-22T08:37:48.146 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.144+0000 7fa34c62f800 20 remove_watcher() i=3 2024-09-22T08:37:48.146 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.144+0000 7fa34c62f800 1 -- 172.21.15.142:0/3008570934 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:170 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94439960871552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e48455f5f0 con 0x55e484513720 2024-09-22T08:37:48.147 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.146+0000 7fa343fff640 1 -- 172.21.15.142:0/3008570934 <== osd.1 v2:172.21.15.142:6816/3192108003 46 ==== osd_op_reply(170 notify.4 [watch unwatch cookie 94439960871552] v32'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa334029040 con 0x55e484513720 2024-09-22T08:37:48.147 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.146+0000 7fa34c62f800 20 remove_watcher() i=4 2024-09-22T08:37:48.147 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.146+0000 7fa34c62f800 1 -- 172.21.15.142:0/3008570934 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:171 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94439960882160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e48455f5f0 con 0x7fa33c0a5040 2024-09-22T08:37:48.148 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.147+0000 7fa343fff640 1 -- 172.21.15.142:0/3008570934 <== osd.0 v2:172.21.15.31:6800/168281188 42 ==== osd_op_reply(171 notify.5 [watch unwatch cookie 94439960882160] v32'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa334029040 con 0x7fa33c0a5040 2024-09-22T08:37:48.148 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.147+0000 7fa34c62f800 20 remove_watcher() i=5 2024-09-22T08:37:48.148 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.147+0000 7fa34c62f800 1 -- 172.21.15.142:0/3008570934 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:172 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94439960883216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e48455f5f0 con 0x7fa33c0a5040 2024-09-22T08:37:48.149 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.148+0000 7fa343fff640 1 -- 172.21.15.142:0/3008570934 <== osd.0 v2:172.21.15.31:6800/168281188 43 ==== osd_op_reply(172 notify.6 [watch unwatch cookie 94439960883216] v32'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa334029040 con 0x7fa33c0a5040 2024-09-22T08:37:48.149 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.148+0000 7fa34c62f800 20 remove_watcher() i=6 2024-09-22T08:37:48.149 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.148+0000 7fa34c62f800 1 -- 172.21.15.142:0/3008570934 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:173 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94439960885888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e48455f5f0 con 0x7fa33c0a5040 2024-09-22T08:37:48.152 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.149+0000 7fa343fff640 1 -- 172.21.15.142:0/3008570934 <== osd.0 v2:172.21.15.31:6800/168281188 44 ==== osd_op_reply(173 notify.7 [watch unwatch cookie 94439960885888] v32'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa334029040 con 0x7fa33c0a5040 2024-09-22T08:37:48.152 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.149+0000 7fa34c62f800 20 remove_watcher() i=7 2024-09-22T08:37:48.152 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.149+0000 7fa34c62f800 1 -- 172.21.15.142:0/3008570934 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7fa33c0a5040 msgr2=0x7fa33c07d760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:48.152 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.149+0000 7fa34c62f800 1 --2- 172.21.15.142:0/3008570934 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7fa33c0a5040 0x7fa33c07d760 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:48.152 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.149+0000 7fa34c62f800 1 -- 172.21.15.142:0/3008570934 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55e484513720 msgr2=0x55e484515be0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:48.152 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.149+0000 7fa34c62f800 1 --2- 172.21.15.142:0/3008570934 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55e484513720 0x55e484515be0 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:48.152 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.149+0000 7fa34c62f800 1 -- 172.21.15.142:0/3008570934 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7fa3440333f0 msgr2=0x7fa34403b7b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:48.152 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.149+0000 7fa34c62f800 1 --2- 172.21.15.142:0/3008570934 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7fa3440333f0 0x7fa34403b7b0 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:48.153 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.149+0000 7fa34c62f800 1 -- 172.21.15.142:0/3008570934 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55e484518110 msgr2=0x55e48451a500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:48.153 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.149+0000 7fa34c62f800 1 --2- 172.21.15.142:0/3008570934 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55e484518110 0x55e48451a500 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:48.153 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.149+0000 7fa34c62f800 1 -- 172.21.15.142:0/3008570934 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fa21403d000 msgr2=0x7fa21403f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:48.153 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.149+0000 7fa34c62f800 1 --2- 172.21.15.142:0/3008570934 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fa21403d000 0x7fa21403f4c0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fa33c097430 tx=0x7fa33c089000 comp rx=0 tx=0).stop 2024-09-22T08:37:48.153 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.149+0000 7fa34c62f800 1 -- 172.21.15.142:0/3008570934 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e484500810 msgr2=0x55e484507df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:48.153 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.149+0000 7fa343fff640 1 -- 172.21.15.142:0/3008570934 reap_dead start 2024-09-22T08:37:48.153 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.149+0000 7fa34c62f800 1 --2- 172.21.15.142:0/3008570934 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e484500810 0x55e484507df0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fa344054800 tx=0x7fa344054860 comp rx=0 tx=0).stop 2024-09-22T08:37:48.153 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.149+0000 7fa34c62f800 1 -- 172.21.15.142:0/3008570934 shutdown_connections 2024-09-22T08:37:48.153 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.149+0000 7fa34c62f800 1 --2- 172.21.15.142:0/3008570934 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e484500810 0x55e484507df0 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:48.153 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.149+0000 7fa34c62f800 1 -- 172.21.15.142:0/3008570934 >> 172.21.15.142:0/3008570934 conn(0x55e4844fcc10 msgr2=0x55e4844fae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:37:48.153 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.149+0000 7fa34c62f800 1 -- 172.21.15.142:0/3008570934 shutdown_connections 2024-09-22T08:37:48.153 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.149+0000 7fa34c62f800 1 -- 172.21.15.142:0/3008570934 wait complete. 2024-09-22T08:37:48.153 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.149+0000 7fa34c62f800 1 -- 172.21.15.142:0/1403157973 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fa22403cfb0 msgr2=0x7fa22403f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:48.153 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.149+0000 7fa34c62f800 1 --2- 172.21.15.142:0/1403157973 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fa22403cfb0 0x7fa22403f470 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x55e4844dae10 tx=0x7fa33c05da60 comp rx=0 tx=0).stop 2024-09-22T08:37:48.154 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.149+0000 7fa34c62f800 1 -- 172.21.15.142:0/1403157973 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e4844f3cf0 msgr2=0x55e4844f4110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:48.154 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.149+0000 7fa34c62f800 1 --2- 172.21.15.142:0/1403157973 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e4844f3cf0 0x55e4844f4110 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x55e4844d9d10 tx=0x7fa3440167b0 comp rx=0 tx=0).stop 2024-09-22T08:37:48.154 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.149+0000 7fa34c62f800 1 -- 172.21.15.142:0/1403157973 shutdown_connections 2024-09-22T08:37:48.154 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.149+0000 7fa34c62f800 1 --2- 172.21.15.142:0/1403157973 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fa22403cfb0 0x7fa22403f470 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:48.154 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.149+0000 7fa34c62f800 1 --2- 172.21.15.142:0/1403157973 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e4844f3cf0 0x55e4844f4110 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:48.154 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.149+0000 7fa34c62f800 1 -- 172.21.15.142:0/1403157973 >> 172.21.15.142:0/1403157973 conn(0x55e4844e80a0 msgr2=0x55e4844e8480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:37:48.154 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.150+0000 7fa34c62f800 1 -- 172.21.15.142:0/1403157973 shutdown_connections 2024-09-22T08:37:48.154 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.150+0000 7fa34c62f800 1 -- 172.21.15.142:0/1403157973 wait complete. 2024-09-22T08:37:48.154 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.150+0000 7fa34c62f800 1 -- 172.21.15.142:0/1862155703 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55e4843e2850 msgr2=0x55e4844e0360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:48.154 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.150+0000 7fa34c62f800 1 --2- 172.21.15.142:0/1862155703 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55e4843e2850 0x55e4844e0360 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:48.154 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.150+0000 7fa34c62f800 1 -- 172.21.15.142:0/1862155703 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55e4844e2700 msgr2=0x55e4844e4ba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:48.154 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.150+0000 7fa34c62f800 1 --2- 172.21.15.142:0/1862155703 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55e4844e2700 0x55e4844e4ba0 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:48.154 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.150+0000 7fa34c62f800 1 -- 172.21.15.142:0/1862155703 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fa23003cfb0 msgr2=0x7fa23003f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:48.155 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.150+0000 7fa34c62f800 1 --2- 172.21.15.142:0/1862155703 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fa23003cfb0 0x7fa23003f470 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fa334001d70 tx=0x7fa3340012d0 comp rx=0 tx=0).stop 2024-09-22T08:37:48.155 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.150+0000 7fa34c62f800 1 -- 172.21.15.142:0/1862155703 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e4843ddbe0 msgr2=0x55e4844d8d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:37:48.155 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.150+0000 7fa34c62f800 1 --2- 172.21.15.142:0/1862155703 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e4843ddbe0 0x55e4844d8d10 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fa33c025c20 tx=0x7fa33c002fb0 comp rx=0 tx=0).stop 2024-09-22T08:37:48.155 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.150+0000 7fa34c62f800 1 -- 172.21.15.142:0/1862155703 shutdown_connections 2024-09-22T08:37:48.155 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.150+0000 7fa34c62f800 1 --2- 172.21.15.142:0/1862155703 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55e4844e2700 0x55e4844e4ba0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:48.155 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.150+0000 7fa34c62f800 1 --2- 172.21.15.142:0/1862155703 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55e4843e2850 0x55e4844e0360 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:48.155 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.150+0000 7fa34c62f800 1 --2- 172.21.15.142:0/1862155703 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fa23003cfb0 0x7fa23003f470 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:48.155 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.150+0000 7fa34c62f800 1 --2- 172.21.15.142:0/1862155703 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e4843ddbe0 0x55e4844d8d10 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:37:48.155 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.150+0000 7fa34c62f800 1 -- 172.21.15.142:0/1862155703 >> 172.21.15.142:0/1862155703 conn(0x55e4843d9310 msgr2=0x55e4844ca510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:37:48.155 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.150+0000 7fa34c62f800 1 -- 172.21.15.142:0/1862155703 shutdown_connections 2024-09-22T08:37:48.155 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:37:48.150+0000 7fa34c62f800 1 -- 172.21.15.142:0/1862155703 wait complete. 2024-09-22T08:38:28.161 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'trim', '--uid', 'foo'] 2024-09-22T08:38:28.162 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'trim', '--uid', 'foo'] 2024-09-22T08:38:28.162 DEBUG:teuthology.orchestra.run.smithi142:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage trim --uid foo 2024-09-22T08:38:28.213 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:38:28.213 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:38:28.214 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.212+0000 7f4964f2c800 1 Processor -- start 2024-09-22T08:38:28.214 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.212+0000 7f4964f2c800 1 -- start start 2024-09-22T08:38:28.214 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.212+0000 7f4964f2c800 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55f5e2c31530 0x55f5e2cc2490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:28.214 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.212+0000 7f4964f2c800 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55f5e2b48a20 con 0x55f5e2cc2a00 2024-09-22T08:38:28.215 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.212+0000 7f4964f2c800 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x55f5e2b487d0 con 0x55f5e2c31530 2024-09-22T08:38:28.215 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.213+0000 7f4960c4f640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55f5e2c31530 0x55f5e2cc2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:28.215 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.213+0000 7f4960c4f640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55f5e2c31530 0x55f5e2cc2490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:58020/0 (socket says 172.21.15.142:58020) 2024-09-22T08:38:28.215 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.213+0000 7f4960c4f640 1 -- 172.21.15.142:0/677688897 learned_addr learned my addr 172.21.15.142:0/677688897 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:38:28.216 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.213+0000 7f495844e640 1 --1- 172.21.15.142:0/677688897 >> v1:172.21.15.31:6789/0 conn(0x55f5e2cc2a00 0x55f5e2cc4ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.142:39918/0 (socket says 172.21.15.142:39918) 2024-09-22T08:38:28.216 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.213+0000 7f4960c4f640 1 -- 172.21.15.142:0/677688897 >> v1:172.21.15.31:6789/0 conn(0x55f5e2cc2a00 legacy=0x55f5e2cc4ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:28.216 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.213+0000 7f4960c4f640 1 -- 172.21.15.142:0/677688897 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f5e2cc77b0 con 0x55f5e2c31530 2024-09-22T08:38:28.217 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.215+0000 7f4960c4f640 1 --2- 172.21.15.142:0/677688897 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f5e2c31530 0x55f5e2cc2490 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f495000a520 tx=0x7f4950045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f51bdc221bb6d562 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:28.217 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.215+0000 7f495bfff640 1 -- 172.21.15.142:0/677688897 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4950055070 con 0x55f5e2c31530 2024-09-22T08:38:28.217 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.215+0000 7f495bfff640 1 -- 172.21.15.142:0/677688897 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49500515b0 con 0x55f5e2c31530 2024-09-22T08:38:28.217 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.215+0000 7f495bfff640 1 -- 172.21.15.142:0/677688897 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f49500518d0 con 0x55f5e2c31530 2024-09-22T08:38:28.218 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.216+0000 7f4964f2c800 1 -- 172.21.15.142:0/677688897 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f5e2c31530 msgr2=0x55f5e2cc2490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:28.218 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.216+0000 7f4964f2c800 1 --2- 172.21.15.142:0/677688897 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f5e2c31530 0x55f5e2cc2490 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f495000a520 tx=0x7f4950045ba0 comp rx=0 tx=0).stop 2024-09-22T08:38:28.218 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.216+0000 7f4964f2c800 1 -- 172.21.15.142:0/677688897 shutdown_connections 2024-09-22T08:38:28.218 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.216+0000 7f4964f2c800 1 --2- 172.21.15.142:0/677688897 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f5e2c31530 0x55f5e2cc2490 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:28.218 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.216+0000 7f4964f2c800 1 -- 172.21.15.142:0/677688897 >> 172.21.15.142:0/677688897 conn(0x55f5e2cb7ba0 msgr2=0x55f5e2cba000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:38:28.218 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.216+0000 7f4964f2c800 1 -- 172.21.15.142:0/677688897 shutdown_connections 2024-09-22T08:38:28.219 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.216+0000 7f4964f2c800 1 -- 172.21.15.142:0/677688897 wait complete. 2024-09-22T08:38:28.234 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.231+0000 7f4964f2c800 1 Processor -- start 2024-09-22T08:38:28.234 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.232+0000 7f4964f2c800 1 -- start start 2024-09-22T08:38:28.234 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.232+0000 7f4964f2c800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f5e2c31530 0x55f5e2daf240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:28.234 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.232+0000 7f4964f2c800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55f5e2b55dd0 con 0x55f5e2c31530 2024-09-22T08:38:28.235 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.232+0000 7f4960c4f640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f5e2c31530 0x55f5e2daf240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:28.235 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.232+0000 7f4960c4f640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f5e2c31530 0x55f5e2daf240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:58036/0 (socket says 172.21.15.142:58036) 2024-09-22T08:38:28.235 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.232+0000 7f4960c4f640 1 -- 172.21.15.142:0/1834962600 learned_addr learned my addr 172.21.15.142:0/1834962600 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:38:28.235 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.233+0000 7f4960c4f640 1 -- 172.21.15.142:0/1834962600 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f5e2daf830 con 0x55f5e2c31530 2024-09-22T08:38:28.235 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.233+0000 7f4960c4f640 1 --2- 172.21.15.142:0/1834962600 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f5e2c31530 0x55f5e2daf240 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f49500460d0 tx=0x7f4950051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27d5da447282d176 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:28.236 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.233+0000 7f484ee0d640 1 -- 172.21.15.142:0/1834962600 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f49500519d0 con 0x55f5e2c31530 2024-09-22T08:38:28.236 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.233+0000 7f484ee0d640 1 -- 172.21.15.142:0/1834962600 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4950051b70 con 0x55f5e2c31530 2024-09-22T08:38:28.236 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.233+0000 7f484ee0d640 1 -- 172.21.15.142:0/1834962600 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4950051e50 con 0x55f5e2c31530 2024-09-22T08:38:28.238 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.234+0000 7f4964f2c800 1 -- 172.21.15.142:0/1834962600 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f5e2c31530 msgr2=0x55f5e2daf240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:28.238 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.234+0000 7f4964f2c800 1 --2- 172.21.15.142:0/1834962600 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f5e2c31530 0x55f5e2daf240 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f49500460d0 tx=0x7f4950051000 comp rx=0 tx=0).stop 2024-09-22T08:38:28.238 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.234+0000 7f4964f2c800 1 -- 172.21.15.142:0/1834962600 shutdown_connections 2024-09-22T08:38:28.238 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.234+0000 7f4964f2c800 1 --2- 172.21.15.142:0/1834962600 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f5e2c31530 0x55f5e2daf240 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:28.238 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.234+0000 7f4964f2c800 1 -- 172.21.15.142:0/1834962600 >> 172.21.15.142:0/1834962600 conn(0x55f5e2cb7ba0 msgr2=0x55f5e2daabc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:38:28.238 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.234+0000 7f4964f2c800 1 -- 172.21.15.142:0/1834962600 shutdown_connections 2024-09-22T08:38:28.238 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.234+0000 7f4964f2c800 1 -- 172.21.15.142:0/1834962600 wait complete. 2024-09-22T08:38:28.238 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.234+0000 7f4964f2c800 1 Processor -- start 2024-09-22T08:38:28.238 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.234+0000 7f4964f2c800 1 -- start start 2024-09-22T08:38:28.238 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.234+0000 7f4964f2c800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f5e2cc2a00 0x55f5e2db6e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:28.239 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.234+0000 7f4964f2c800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55f5e2cc6a50 con 0x55f5e2cc2a00 2024-09-22T08:38:28.239 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.235+0000 7f4960c4f640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f5e2cc2a00 0x55f5e2db6e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:28.239 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.235+0000 7f4960c4f640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f5e2cc2a00 0x55f5e2db6e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:58048/0 (socket says 172.21.15.142:58048) 2024-09-22T08:38:28.239 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.235+0000 7f4960c4f640 1 -- 172.21.15.142:0/70400226 learned_addr learned my addr 172.21.15.142:0/70400226 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:38:28.239 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.235+0000 7f4960c4f640 1 -- 172.21.15.142:0/70400226 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f5e2db73b0 con 0x55f5e2cc2a00 2024-09-22T08:38:28.239 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.235+0000 7f4960c4f640 1 --2- 172.21.15.142:0/70400226 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f5e2cc2a00 0x55f5e2db6e50 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f49500460d0 tx=0x7f4950002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:28.239 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.235+0000 7f484d60a640 1 -- 172.21.15.142:0/70400226 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4950072020 con 0x55f5e2cc2a00 2024-09-22T08:38:28.239 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.236+0000 7f484d60a640 1 -- 172.21.15.142:0/70400226 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f495005a450 con 0x55f5e2cc2a00 2024-09-22T08:38:28.239 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.236+0000 7f4964f2c800 1 -- 172.21.15.142:0/70400226 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f5e2db7640 con 0x55f5e2cc2a00 2024-09-22T08:38:28.239 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.236+0000 7f484d60a640 1 -- 172.21.15.142:0/70400226 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f495005a770 con 0x55f5e2cc2a00 2024-09-22T08:38:28.239 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.236+0000 7f4964f2c800 1 -- 172.21.15.142:0/70400226 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f5e2db8250 con 0x55f5e2cc2a00 2024-09-22T08:38:28.241 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.237+0000 7f484d60a640 1 -- 172.21.15.142:0/70400226 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f4950075020 con 0x55f5e2cc2a00 2024-09-22T08:38:28.241 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.237+0000 7f484d60a640 1 --2- 172.21.15.142:0/70400226 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f484803d000 0x7f484803f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:28.242 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.237+0000 7f484d60a640 1 -- 172.21.15.142:0/70400226 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5938+0+0 (secure 0 0 0) 0x7f495006b040 con 0x55f5e2cc2a00 2024-09-22T08:38:28.242 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.237+0000 7f495844e640 1 --2- 172.21.15.142:0/70400226 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f484803d000 0x7f484803f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:28.242 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.237+0000 7f4964f2c800 1 --2- 172.21.15.142:0/70400226 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55f5e2dbc490 0x55f5e2dbe880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:28.242 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.237+0000 7f4964f2c800 1 -- 172.21.15.142:0/70400226 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5e2dbedc0 con 0x55f5e2dbc490 2024-09-22T08:38:28.242 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.237+0000 7f4961450640 1 --2- 172.21.15.142:0/70400226 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55f5e2dbc490 0x55f5e2dbe880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:28.242 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.237+0000 7f495844e640 1 --2- 172.21.15.142:0/70400226 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f484803d000 0x7f484803f4c0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f4948001e30 tx=0x7f4948001390 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:28.242 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.237+0000 7f4961450640 1 --2- 172.21.15.142:0/70400226 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55f5e2dbc490 0x55f5e2dbe880 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:28.242 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.238+0000 7f4961450640 1 -- 172.21.15.142:0/70400226 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f495c00a4d0 con 0x55f5e2dbc490 2024-09-22T08:38:28.242 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.238+0000 7f4964f2c800 1 -- 172.21.15.142:0/70400226 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5e2dbf160 con 0x55f5e2dbc490 2024-09-22T08:38:28.242 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.238+0000 7f4961450640 1 -- 172.21.15.142:0/70400226 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f495c00a4d0 con 0x55f5e2dbc490 2024-09-22T08:38:28.242 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.238+0000 7f4964f2c800 1 --2- 172.21.15.142:0/70400226 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55f5e2dc0c60 0x55f5e2dc3100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:28.242 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.238+0000 7f4964f2c800 1 -- 172.21.15.142:0/70400226 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:3 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5e2dc3890 con 0x55f5e2dc0c60 2024-09-22T08:38:28.243 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.238+0000 7f4960c4f640 1 --2- 172.21.15.142:0/70400226 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55f5e2dc0c60 0x55f5e2dc3100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:28.243 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.239+0000 7f4960c4f640 1 --2- 172.21.15.142:0/70400226 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55f5e2dc0c60 0x55f5e2dc3100 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:28.243 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.239+0000 7f4960c4f640 1 -- 172.21.15.142:0/70400226 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(3 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f4950057030 con 0x55f5e2dc0c60 2024-09-22T08:38:28.243 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.239+0000 7f4964f2c800 1 -- 172.21.15.142:0/70400226 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5e2dbf9b0 con 0x55f5e2dbc490 2024-09-22T08:38:28.243 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.239+0000 7f4961450640 1 -- 172.21.15.142:0/70400226 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f495c00a4d0 con 0x55f5e2dbc490 2024-09-22T08:38:28.243 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.239+0000 7f4964f2c800 1 -- 172.21.15.142:0/70400226 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5e2dbfe10 con 0x55f5e2dc0c60 2024-09-22T08:38:28.243 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.240+0000 7f4960c4f640 1 -- 172.21.15.142:0/70400226 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(5 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f4950057030 con 0x55f5e2dc0c60 2024-09-22T08:38:28.245 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.240+0000 7f4964f2c800 1 Processor -- start 2024-09-22T08:38:28.245 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.240+0000 7f4964f2c800 1 -- start start 2024-09-22T08:38:28.245 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.240+0000 7f4964f2c800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f5e2dd2270 0x55f5e2dd2690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:28.245 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.240+0000 7f4964f2c800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55f5e2bb4d50 con 0x55f5e2dd2270 2024-09-22T08:38:28.245 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.240+0000 7f4961450640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f5e2dd2270 0x55f5e2dd2690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:28.245 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.240+0000 7f4961450640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f5e2dd2270 0x55f5e2dd2690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:58064/0 (socket says 172.21.15.142:58064) 2024-09-22T08:38:28.246 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.240+0000 7f4961450640 1 -- 172.21.15.142:0/1393470478 learned_addr learned my addr 172.21.15.142:0/1393470478 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:38:28.246 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.241+0000 7f4961450640 1 -- 172.21.15.142:0/1393470478 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f5e2dd2cd0 con 0x55f5e2dd2270 2024-09-22T08:38:28.246 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.241+0000 7f4961450640 1 --2- 172.21.15.142:0/1393470478 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f5e2dd2270 0x55f5e2dd2690 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x55f5e2db7e50 tx=0x7f495c0167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:28.246 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.241+0000 7f48467fc640 1 -- 172.21.15.142:0/1393470478 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f495c013640 con 0x55f5e2dd2270 2024-09-22T08:38:28.246 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.241+0000 7f48467fc640 1 -- 172.21.15.142:0/1393470478 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f495c0137e0 con 0x55f5e2dd2270 2024-09-22T08:38:28.246 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.241+0000 7f48467fc640 1 -- 172.21.15.142:0/1393470478 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f495c013ae0 con 0x55f5e2dd2270 2024-09-22T08:38:28.246 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.241+0000 7f4964f2c800 1 -- 172.21.15.142:0/1393470478 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f5e2dd3500 con 0x55f5e2dd2270 2024-09-22T08:38:28.246 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.241+0000 7f4964f2c800 1 -- 172.21.15.142:0/1393470478 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f5e2dd3aa0 con 0x55f5e2dd2270 2024-09-22T08:38:28.246 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.242+0000 7f48467fc640 1 -- 172.21.15.142:0/1393470478 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f495c011040 con 0x55f5e2dd2270 2024-09-22T08:38:28.246 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.242+0000 7f48467fc640 1 --2- 172.21.15.142:0/1393470478 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f483803cfb0 0x7f483803f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:28.246 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.243+0000 7f48467fc640 1 -- 172.21.15.142:0/1393470478 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5938+0+0 (secure 0 0 0) 0x7f495c00e040 con 0x55f5e2dd2270 2024-09-22T08:38:28.246 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.243+0000 7f4960c4f640 1 --2- 172.21.15.142:0/1393470478 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f483803cfb0 0x7f483803f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:28.246 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.243+0000 7f4964f2c800 1 Processor -- start 2024-09-22T08:38:28.247 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.243+0000 7f4960c4f640 1 --2- 172.21.15.142:0/1393470478 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f483803cfb0 0x7f483803f470 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x55f5e2dc3c30 tx=0x7f4950096640 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:28.247 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.243+0000 7f4964f2c800 1 -- start start 2024-09-22T08:38:28.247 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.243+0000 7f4964f2c800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f5e2dded90 0x55f5e2ddf190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:28.247 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.243+0000 7f4964f2c800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55f5e2dafba0 con 0x55f5e2dded90 2024-09-22T08:38:28.249 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.243+0000 7f4961450640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f5e2dded90 0x55f5e2ddf190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:28.250 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.244+0000 7f4961450640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f5e2dded90 0x55f5e2ddf190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:58076/0 (socket says 172.21.15.142:58076) 2024-09-22T08:38:28.250 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.244+0000 7f4961450640 1 -- 172.21.15.142:0/497445260 learned_addr learned my addr 172.21.15.142:0/497445260 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:38:28.250 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.244+0000 7f4961450640 1 -- 172.21.15.142:0/497445260 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f5e2ddf780 con 0x55f5e2dded90 2024-09-22T08:38:28.250 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.244+0000 7f4961450640 1 --2- 172.21.15.142:0/497445260 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f5e2dded90 0x55f5e2ddf190 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f495c020000 tx=0x7f495c01f400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=947daac3bab80c84 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:28.250 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.244+0000 7f4837fff640 1 -- 172.21.15.142:0/497445260 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f495c051070 con 0x55f5e2dded90 2024-09-22T08:38:28.250 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.244+0000 7f4837fff640 1 -- 172.21.15.142:0/497445260 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f495c021960 con 0x55f5e2dded90 2024-09-22T08:38:28.250 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.244+0000 7f4837fff640 1 -- 172.21.15.142:0/497445260 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f495c021440 con 0x55f5e2dded90 2024-09-22T08:38:28.250 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.245+0000 7f4964f2c800 1 -- 172.21.15.142:0/497445260 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f5e2dded90 msgr2=0x55f5e2ddf190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:28.250 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.245+0000 7f4964f2c800 1 --2- 172.21.15.142:0/497445260 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f5e2dded90 0x55f5e2ddf190 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f495c020000 tx=0x7f495c01f400 comp rx=0 tx=0).stop 2024-09-22T08:38:28.250 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.245+0000 7f4964f2c800 1 -- 172.21.15.142:0/497445260 shutdown_connections 2024-09-22T08:38:28.250 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.245+0000 7f4964f2c800 1 --2- 172.21.15.142:0/497445260 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f5e2dded90 0x55f5e2ddf190 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:28.250 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.245+0000 7f4964f2c800 1 -- 172.21.15.142:0/497445260 >> 172.21.15.142:0/497445260 conn(0x55f5e2ddb190 msgr2=0x55f5e2dd93d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:38:28.251 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.245+0000 7f4964f2c800 1 -- 172.21.15.142:0/497445260 shutdown_connections 2024-09-22T08:38:28.251 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.245+0000 7f4964f2c800 1 -- 172.21.15.142:0/497445260 wait complete. 2024-09-22T08:38:28.251 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.245+0000 7f4964f2c800 1 Processor -- start 2024-09-22T08:38:28.251 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.245+0000 7f4964f2c800 1 -- start start 2024-09-22T08:38:28.251 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.245+0000 7f4964f2c800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f5e2dded90 0x55f5e2de6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:28.251 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.245+0000 7f4964f2c800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55f5e2ddfda0 con 0x55f5e2dded90 2024-09-22T08:38:28.251 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.246+0000 7f4961450640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f5e2dded90 0x55f5e2de6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:28.251 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.246+0000 7f4961450640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f5e2dded90 0x55f5e2de6300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:58088/0 (socket says 172.21.15.142:58088) 2024-09-22T08:38:28.251 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.246+0000 7f4961450640 1 -- 172.21.15.142:0/2959699683 learned_addr learned my addr 172.21.15.142:0/2959699683 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:38:28.251 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.246+0000 7f4961450640 1 -- 172.21.15.142:0/2959699683 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f5e2de6860 con 0x55f5e2dded90 2024-09-22T08:38:28.251 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.246+0000 7f4961450640 1 --2- 172.21.15.142:0/2959699683 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f5e2dded90 0x55f5e2de6300 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f495c005a30 tx=0x7f495c054860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:28.251 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.246+0000 7f48367fc640 1 -- 172.21.15.142:0/2959699683 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f495c04b070 con 0x55f5e2dded90 2024-09-22T08:38:28.251 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.246+0000 7f48367fc640 1 -- 172.21.15.142:0/2959699683 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f495c054ad0 con 0x55f5e2dded90 2024-09-22T08:38:28.252 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.246+0000 7f48367fc640 1 -- 172.21.15.142:0/2959699683 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f495c01fa90 con 0x55f5e2dded90 2024-09-22T08:38:28.252 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.246+0000 7f4964f2c800 1 -- 172.21.15.142:0/2959699683 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f5e2de6af0 con 0x55f5e2dded90 2024-09-22T08:38:28.252 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.246+0000 7f4964f2c800 1 -- 172.21.15.142:0/2959699683 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f5e2de7470 con 0x55f5e2dded90 2024-09-22T08:38:28.252 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.247+0000 7f48367fc640 1 -- 172.21.15.142:0/2959699683 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f495c01f500 con 0x55f5e2dded90 2024-09-22T08:38:28.252 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.247+0000 7f48367fc640 1 --2- 172.21.15.142:0/2959699683 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f482c03cf60 0x7f482c03f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:28.252 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.248+0000 7f48367fc640 1 -- 172.21.15.142:0/2959699683 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5938+0+0 (secure 0 0 0) 0x7f495c033d90 con 0x55f5e2dded90 2024-09-22T08:38:28.252 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.248+0000 7f4960c4f640 1 --2- 172.21.15.142:0/2959699683 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f482c03cf60 0x7f482c03f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:28.257 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.248+0000 7f4960c4f640 1 --2- 172.21.15.142:0/2959699683 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f482c03cf60 0x7f482c03f420 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f4950095140 tx=0x7f4950065580 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:28.258 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.248+0000 7f4964f2c800 20 rados->read ofs=0 len=0 2024-09-22T08:38:28.258 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.248+0000 7f4964f2c800 1 --2- 172.21.15.142:0/2959699683 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55f5e2df1cc0 0x55f5e2df4180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:28.258 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.248+0000 7f4964f2c800 1 -- 172.21.15.142:0/2959699683 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5e2df48d0 con 0x55f5e2df1cc0 2024-09-22T08:38:28.258 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.248+0000 7f495844e640 1 --2- 172.21.15.142:0/2959699683 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55f5e2df1cc0 0x55f5e2df4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:28.258 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.249+0000 7f495844e640 1 --2- 172.21.15.142:0/2959699683 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55f5e2df1cc0 0x55f5e2df4180 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:28.258 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.249+0000 7f495844e640 1 -- 172.21.15.142:0/2959699683 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f494800f610 con 0x55f5e2df1cc0 2024-09-22T08:38:28.258 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.249+0000 7f4964f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:28.258 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.249+0000 7f4964f2c800 20 realm 2024-09-22T08:38:28.258 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.249+0000 7f4964f2c800 20 rados->read ofs=0 len=0 2024-09-22T08:38:28.258 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.249+0000 7f4964f2c800 1 -- 172.21.15.142:0/2959699683 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5e2df1050 con 0x55f5e2df1cc0 2024-09-22T08:38:28.258 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.249+0000 7f495844e640 1 -- 172.21.15.142:0/2959699683 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f494800f610 con 0x55f5e2df1cc0 2024-09-22T08:38:28.258 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.249+0000 7f4964f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:28.259 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.249+0000 7f4964f2c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:38:28.259 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.249+0000 7f4964f2c800 20 rados->read ofs=0 len=0 2024-09-22T08:38:28.259 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.249+0000 7f4964f2c800 1 -- 172.21.15.142:0/2959699683 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5e2df53c0 con 0x55f5e2df1cc0 2024-09-22T08:38:28.259 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.249+0000 7f495844e640 1 -- 172.21.15.142:0/2959699683 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f494800f610 con 0x55f5e2df1cc0 2024-09-22T08:38:28.259 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.249+0000 7f4964f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:28.259 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.249+0000 7f4964f2c800 20 rados->read ofs=0 len=0 2024-09-22T08:38:28.259 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.249+0000 7f4964f2c800 1 -- 172.21.15.142:0/2959699683 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5e2df5c90 con 0x55f5e2df1cc0 2024-09-22T08:38:28.259 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.250+0000 7f495844e640 1 -- 172.21.15.142:0/2959699683 <== osd.1 v2:172.21.15.142:6816/3192108003 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f494800f610 con 0x55f5e2df1cc0 2024-09-22T08:38:28.259 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.250+0000 7f4964f2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:38:28.259 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.250+0000 7f4964f2c800 20 rados->read ofs=0 len=0 2024-09-22T08:38:28.259 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.250+0000 7f4964f2c800 1 --2- 172.21.15.142:0/2959699683 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55f5e2df66b0 0x55f5e2df8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:28.259 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.250+0000 7f4964f2c800 1 -- 172.21.15.142:0/2959699683 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5e2df91e0 con 0x55f5e2df66b0 2024-09-22T08:38:28.260 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.250+0000 7f4961450640 1 --2- 172.21.15.142:0/2959699683 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55f5e2df66b0 0x55f5e2df8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:28.260 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.250+0000 7f4961450640 1 --2- 172.21.15.142:0/2959699683 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55f5e2df66b0 0x55f5e2df8aa0 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:28.260 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.250+0000 7f4961450640 1 -- 172.21.15.142:0/2959699683 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(5 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f495c03a070 con 0x55f5e2df66b0 2024-09-22T08:38:28.260 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.250+0000 7f4964f2c800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:38:28.260 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.250+0000 7f4964f2c800 20 searching for the correct realm 2024-09-22T08:38:28.260 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.250+0000 7f4964f2c800 1 -- 172.21.15.142:0/2959699683 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f5e2dfab10 con 0x55f5e2df66b0 2024-09-22T08:38:28.260 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.251+0000 7f4961450640 1 -- 172.21.15.142:0/2959699683 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f495c03a070 con 0x55f5e2df66b0 2024-09-22T08:38:28.260 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.251+0000 7f4961450640 1 --2- 172.21.15.142:0/2959699683 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f495c02b200 0x7f495c0323a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:28.260 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.251+0000 7f4961450640 1 -- 172.21.15.142:0/2959699683 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f5e2dfab10 con 0x7f495c02b200 2024-09-22T08:38:28.260 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.251+0000 7f4960c4f640 1 --2- 172.21.15.142:0/2959699683 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f495c02b200 0x7f495c0323a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:28.260 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.251+0000 7f4960c4f640 1 --2- 172.21.15.142:0/2959699683 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f495c02b200 0x7f495c0323a0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:28.260 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.251+0000 7f4960c4f640 1 -- 172.21.15.142:0/2959699683 <== osd.2 v2:172.21.15.142:6808/279438927 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4950057030 con 0x7f495c02b200 2024-09-22T08:38:28.260 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.251+0000 7f4960c4f640 1 --2- 172.21.15.142:0/2959699683 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f495008d040 0x7f4950096730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:28.261 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.251+0000 7f4960c4f640 1 -- 172.21.15.142:0/2959699683 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f5e2dfab10 con 0x7f495008d040 2024-09-22T08:38:28.261 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.252+0000 7f495844e640 1 --2- 172.21.15.142:0/2959699683 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f495008d040 0x7f4950096730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:28.261 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.252+0000 7f495844e640 1 --2- 172.21.15.142:0/2959699683 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f495008d040 0x7f4950096730 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:28.261 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.252+0000 7f495844e640 1 -- 172.21.15.142:0/2959699683 <== osd.0 v2:172.21.15.31:6800/168281188 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f494800f610 con 0x7f495008d040 2024-09-22T08:38:28.261 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.252+0000 7f495844e640 1 -- 172.21.15.142:0/2959699683 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f5e2dfab10 con 0x55f5e2df1cc0 2024-09-22T08:38:28.261 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.253+0000 7f495844e640 1 -- 172.21.15.142:0/2959699683 <== osd.1 v2:172.21.15.142:6816/3192108003 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f494800f610 con 0x55f5e2df1cc0 2024-09-22T08:38:28.261 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.253+0000 7f495844e640 1 -- 172.21.15.142:0/2959699683 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f5e2dfab10 con 0x55f5e2df1cc0 2024-09-22T08:38:28.261 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.253+0000 7f495844e640 1 -- 172.21.15.142:0/2959699683 <== osd.1 v2:172.21.15.142:6816/3192108003 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f494802b040 con 0x55f5e2df1cc0 2024-09-22T08:38:28.261 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.253+0000 7f495844e640 1 -- 172.21.15.142:0/2959699683 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f5e2dfab10 con 0x55f5e2df1cc0 2024-09-22T08:38:28.261 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.253+0000 7f495844e640 1 -- 172.21.15.142:0/2959699683 <== osd.1 v2:172.21.15.142:6816/3192108003 7 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f494802b040 con 0x55f5e2df1cc0 2024-09-22T08:38:28.261 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.253+0000 7f495844e640 1 -- 172.21.15.142:0/2959699683 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f5e2dfab10 con 0x7f495008d040 2024-09-22T08:38:28.261 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.253+0000 7f495844e640 1 -- 172.21.15.142:0/2959699683 <== osd.0 v2:172.21.15.31:6800/168281188 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f494802b040 con 0x7f495008d040 2024-09-22T08:38:28.261 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.253+0000 7f495844e640 1 -- 172.21.15.142:0/2959699683 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f5e2dfab10 con 0x7f495c02b200 2024-09-22T08:38:28.261 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.254+0000 7f4960c4f640 1 -- 172.21.15.142:0/2959699683 <== osd.2 v2:172.21.15.142:6808/279438927 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4950057030 con 0x7f495c02b200 2024-09-22T08:38:28.262 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.254+0000 7f4960c4f640 1 -- 172.21.15.142:0/2959699683 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f5e2dfab10 con 0x55f5e2df66b0 2024-09-22T08:38:28.262 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.254+0000 7f4961450640 1 -- 172.21.15.142:0/2959699683 <== osd.3 v2:172.21.15.142:6800/1064901393 3 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f495c03a070 con 0x55f5e2df66b0 2024-09-22T08:38:28.262 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.254+0000 7f4961450640 1 -- 172.21.15.142:0/2959699683 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f5e2dfab10 con 0x55f5e2df1cc0 2024-09-22T08:38:28.262 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.254+0000 7f495844e640 1 -- 172.21.15.142:0/2959699683 <== osd.1 v2:172.21.15.142:6816/3192108003 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f494802b040 con 0x55f5e2df1cc0 2024-09-22T08:38:28.262 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.254+0000 7f495844e640 1 -- 172.21.15.142:0/2959699683 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f5e2dfab10 con 0x7f495008d040 2024-09-22T08:38:28.262 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.255+0000 7f495844e640 1 -- 172.21.15.142:0/2959699683 <== osd.0 v2:172.21.15.31:6800/168281188 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f494802b040 con 0x7f495008d040 2024-09-22T08:38:28.262 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.255+0000 7f495844e640 1 -- 172.21.15.142:0/2959699683 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f5e2dfab10 con 0x55f5e2df1cc0 2024-09-22T08:38:28.262 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.255+0000 7f495844e640 1 -- 172.21.15.142:0/2959699683 <== osd.1 v2:172.21.15.142:6816/3192108003 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f494802b040 con 0x55f5e2df1cc0 2024-09-22T08:38:28.262 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.255+0000 7f495844e640 1 -- 172.21.15.142:0/2959699683 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f5e2dfab10 con 0x7f495c02b200 2024-09-22T08:38:28.262 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.255+0000 7f4960c4f640 1 -- 172.21.15.142:0/2959699683 <== osd.2 v2:172.21.15.142:6808/279438927 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f4950057030 con 0x7f495c02b200 2024-09-22T08:38:28.262 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.255+0000 7f4960c4f640 1 -- 172.21.15.142:0/2959699683 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f5e2dfab10 con 0x55f5e2df66b0 2024-09-22T08:38:28.262 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.255+0000 7f4961450640 1 -- 172.21.15.142:0/2959699683 <== osd.3 v2:172.21.15.142:6800/1064901393 4 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f495c03a070 con 0x55f5e2df66b0 2024-09-22T08:38:28.263 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.255+0000 7f4961450640 1 -- 172.21.15.142:0/2959699683 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f5e2dfab10 con 0x55f5e2df66b0 2024-09-22T08:38:28.263 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.255+0000 7f4961450640 1 -- 172.21.15.142:0/2959699683 <== osd.3 v2:172.21.15.142:6800/1064901393 5 ==== osd_op_reply(20 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f495c03a070 con 0x55f5e2df66b0 2024-09-22T08:38:28.263 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.255+0000 7f4961450640 1 -- 172.21.15.142:0/2959699683 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f5e2dfab10 con 0x7f495008d040 2024-09-22T08:38:28.269 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.256+0000 7f495844e640 1 -- 172.21.15.142:0/2959699683 <== osd.0 v2:172.21.15.31:6800/168281188 4 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f494802b040 con 0x7f495008d040 2024-09-22T08:38:28.269 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.256+0000 7f495844e640 1 -- 172.21.15.142:0/2959699683 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f5e2dfab10 con 0x55f5e2df66b0 2024-09-22T08:38:28.269 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.256+0000 7f4961450640 1 -- 172.21.15.142:0/2959699683 <== osd.3 v2:172.21.15.142:6800/1064901393 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f495c03a070 con 0x55f5e2df66b0 2024-09-22T08:38:28.270 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.256+0000 7f4961450640 1 -- 172.21.15.142:0/2959699683 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f5e2dfab10 con 0x55f5e2df66b0 2024-09-22T08:38:28.270 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.256+0000 7f4961450640 1 -- 172.21.15.142:0/2959699683 <== osd.3 v2:172.21.15.142:6800/1064901393 7 ==== osd_op_reply(23 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f495c03a070 con 0x55f5e2df66b0 2024-09-22T08:38:28.270 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.256+0000 7f4961450640 1 -- 172.21.15.142:0/2959699683 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f5e2dfab10 con 0x55f5e2df1cc0 2024-09-22T08:38:28.270 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.257+0000 7f495844e640 1 -- 172.21.15.142:0/2959699683 <== osd.1 v2:172.21.15.142:6816/3192108003 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f494802b040 con 0x55f5e2df1cc0 2024-09-22T08:38:28.270 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.257+0000 7f495844e640 1 -- 172.21.15.142:0/2959699683 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f5e2dfab10 con 0x55f5e2df1cc0 2024-09-22T08:38:28.270 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.257+0000 7f495844e640 1 -- 172.21.15.142:0/2959699683 <== osd.1 v2:172.21.15.142:6816/3192108003 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f494802b040 con 0x55f5e2df1cc0 2024-09-22T08:38:28.270 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.257+0000 7f495844e640 1 -- 172.21.15.142:0/2959699683 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f5e2dfab10 con 0x7f495008d040 2024-09-22T08:38:28.270 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.257+0000 7f495844e640 1 -- 172.21.15.142:0/2959699683 <== osd.0 v2:172.21.15.31:6800/168281188 5 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f494802b040 con 0x7f495008d040 2024-09-22T08:38:28.270 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.257+0000 7f495844e640 1 -- 172.21.15.142:0/2959699683 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f5e2dfab10 con 0x55f5e2df66b0 2024-09-22T08:38:28.270 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.257+0000 7f4961450640 1 -- 172.21.15.142:0/2959699683 <== osd.3 v2:172.21.15.142:6800/1064901393 8 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f495c03a070 con 0x55f5e2df66b0 2024-09-22T08:38:28.270 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.257+0000 7f4961450640 1 -- 172.21.15.142:0/2959699683 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f5e2dfab10 con 0x7f495c02b200 2024-09-22T08:38:28.270 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.258+0000 7f4960c4f640 1 -- 172.21.15.142:0/2959699683 <== osd.2 v2:172.21.15.142:6808/279438927 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4950057030 con 0x7f495c02b200 2024-09-22T08:38:28.270 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.258+0000 7f4960c4f640 1 -- 172.21.15.142:0/2959699683 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f5e2dfab10 con 0x55f5e2df1cc0 2024-09-22T08:38:28.271 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.258+0000 7f495844e640 1 -- 172.21.15.142:0/2959699683 <== osd.1 v2:172.21.15.142:6816/3192108003 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f494802b040 con 0x55f5e2df1cc0 2024-09-22T08:38:28.271 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.258+0000 7f495844e640 1 -- 172.21.15.142:0/2959699683 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f5e2dfab10 con 0x7f495008d040 2024-09-22T08:38:28.271 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.258+0000 7f495844e640 1 -- 172.21.15.142:0/2959699683 <== osd.0 v2:172.21.15.31:6800/168281188 6 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f494803b040 con 0x7f495008d040 2024-09-22T08:38:28.271 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.258+0000 7f495844e640 1 -- 172.21.15.142:0/2959699683 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f5e2dfab10 con 0x55f5e2df66b0 2024-09-22T08:38:28.271 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.259+0000 7f4961450640 1 -- 172.21.15.142:0/2959699683 <== osd.3 v2:172.21.15.142:6800/1064901393 9 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f495c03a070 con 0x55f5e2df66b0 2024-09-22T08:38:28.271 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.259+0000 7f4961450640 1 -- 172.21.15.142:0/2959699683 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f5e2dfab10 con 0x7f495008d040 2024-09-22T08:38:28.271 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.259+0000 7f495844e640 1 -- 172.21.15.142:0/2959699683 <== osd.0 v2:172.21.15.31:6800/168281188 7 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f494803b040 con 0x7f495008d040 2024-09-22T08:38:28.271 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.259+0000 7f495844e640 1 -- 172.21.15.142:0/2959699683 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f5e2dfab10 con 0x7f495c02b200 2024-09-22T08:38:28.271 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.259+0000 7f4960c4f640 1 -- 172.21.15.142:0/2959699683 <== osd.2 v2:172.21.15.142:6808/279438927 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4950057030 con 0x7f495c02b200 2024-09-22T08:38:28.271 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.259+0000 7f4960c4f640 1 -- 172.21.15.142:0/2959699683 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f5e2dfab10 con 0x55f5e2df66b0 2024-09-22T08:38:28.271 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.259+0000 7f4961450640 1 -- 172.21.15.142:0/2959699683 <== osd.3 v2:172.21.15.142:6800/1064901393 10 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f495c03a070 con 0x55f5e2df66b0 2024-09-22T08:38:28.271 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.259+0000 7f4961450640 1 -- 172.21.15.142:0/2959699683 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f5e2dfab10 con 0x7f495008d040 2024-09-22T08:38:28.271 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.260+0000 7f495844e640 1 -- 172.21.15.142:0/2959699683 <== osd.0 v2:172.21.15.31:6800/168281188 8 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f494803b040 con 0x7f495008d040 2024-09-22T08:38:28.272 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.260+0000 7f495844e640 1 -- 172.21.15.142:0/2959699683 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f5e2dfab10 con 0x55f5e2df1cc0 2024-09-22T08:38:28.272 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.260+0000 7f495844e640 1 -- 172.21.15.142:0/2959699683 <== osd.1 v2:172.21.15.142:6816/3192108003 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f494803b040 con 0x55f5e2df1cc0 2024-09-22T08:38:28.272 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.260+0000 7f495844e640 1 -- 172.21.15.142:0/2959699683 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f5e2dfab10 con 0x7f495c02b200 2024-09-22T08:38:28.272 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.260+0000 7f4960c4f640 1 -- 172.21.15.142:0/2959699683 <== osd.2 v2:172.21.15.142:6808/279438927 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4950057030 con 0x7f495c02b200 2024-09-22T08:38:28.272 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.260+0000 7f4964f2c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:38:28.272 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.260+0000 7f4964f2c800 20 RGWRados::pool_iterate: got zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec 2024-09-22T08:38:28.272 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.260+0000 7f4964f2c800 20 RGWRados::pool_iterate: got zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f 2024-09-22T08:38:28.272 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.260+0000 7f4964f2c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:38:28.272 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.260+0000 7f4964f2c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:38:28.272 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.260+0000 7f4964f2c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:38:28.272 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.260+0000 7f4964f2c800 20 rados->read ofs=0 len=0 2024-09-22T08:38:28.272 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.260+0000 7f4964f2c800 1 -- 172.21.15.142:0/2959699683 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5e2df9ba0 con 0x55f5e2df1cc0 2024-09-22T08:38:28.272 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.260+0000 7f495844e640 1 -- 172.21.15.142:0/2959699683 <== osd.1 v2:172.21.15.142:6816/3192108003 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f494803b040 con 0x55f5e2df1cc0 2024-09-22T08:38:28.272 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.260+0000 7f4964f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:28.273 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.260+0000 7f4964f2c800 20 rados->read ofs=0 len=0 2024-09-22T08:38:28.273 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.260+0000 7f4964f2c800 1 -- 172.21.15.142:0/2959699683 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5e2dfa3f0 con 0x55f5e2df1cc0 2024-09-22T08:38:28.273 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.261+0000 7f495844e640 1 -- 172.21.15.142:0/2959699683 <== osd.1 v2:172.21.15.142:6816/3192108003 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f494803b040 con 0x55f5e2df1cc0 2024-09-22T08:38:28.273 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.261+0000 7f4964f2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:38:28.273 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.261+0000 7f4964f2c800 20 rados->read ofs=0 len=0 2024-09-22T08:38:28.273 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.261+0000 7f4964f2c800 1 -- 172.21.15.142:0/2959699683 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:40 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5e2dfaf90 con 0x55f5e2df66b0 2024-09-22T08:38:28.273 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.261+0000 7f4961450640 1 -- 172.21.15.142:0/2959699683 <== osd.3 v2:172.21.15.142:6800/1064901393 11 ==== osd_op_reply(40 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f495c03a070 con 0x55f5e2df66b0 2024-09-22T08:38:28.273 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.261+0000 7f4964f2c800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:38:28.273 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.261+0000 7f4964f2c800 20 zone default found 2024-09-22T08:38:28.273 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.261+0000 7f4964f2c800 4 Realm: () 2024-09-22T08:38:28.273 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.261+0000 7f4964f2c800 4 ZoneGroup: default (d89f6f57-1007-47dd-9065-f486c7b01aec) 2024-09-22T08:38:28.273 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.261+0000 7f4964f2c800 4 Zone: default (e239248c-0bee-4e41-803a-24b288d3eb8f) 2024-09-22T08:38:28.273 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.261+0000 7f4964f2c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:38:28.274 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.261+0000 7f4964f2c800 20 zonegroup default 2024-09-22T08:38:28.274 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.261+0000 7f4964f2c800 20 rados->read ofs=0 len=0 2024-09-22T08:38:28.274 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.261+0000 7f4964f2c800 1 -- 172.21.15.142:0/2959699683 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5e2dfb330 con 0x7f495008d040 2024-09-22T08:38:28.274 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.261+0000 7f495844e640 1 -- 172.21.15.142:0/2959699683 <== osd.0 v2:172.21.15.31:6800/168281188 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f494803b040 con 0x7f495008d040 2024-09-22T08:38:28.274 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.261+0000 7f4964f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:28.274 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.261+0000 7f4964f2c800 20 rados->read ofs=0 len=0 2024-09-22T08:38:28.274 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.261+0000 7f4964f2c800 1 -- 172.21.15.142:0/2959699683 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5e2dfd160 con 0x55f5e2df66b0 2024-09-22T08:38:28.274 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.262+0000 7f4961450640 1 -- 172.21.15.142:0/2959699683 <== osd.3 v2:172.21.15.142:6800/1064901393 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f495c03a070 con 0x55f5e2df66b0 2024-09-22T08:38:28.274 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.262+0000 7f4964f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:28.274 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.262+0000 7f4964f2c800 20 rados->read ofs=0 len=0 2024-09-22T08:38:28.274 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.262+0000 7f4964f2c800 1 -- 172.21.15.142:0/2959699683 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5e2dfd5f0 con 0x55f5e2df66b0 2024-09-22T08:38:28.274 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.262+0000 7f4961450640 1 -- 172.21.15.142:0/2959699683 <== osd.3 v2:172.21.15.142:6800/1064901393 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f495c03a070 con 0x55f5e2df66b0 2024-09-22T08:38:28.274 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.262+0000 7f4964f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:28.275 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.262+0000 7f4964f2c800 20 started sync module instance, tier type = 2024-09-22T08:38:28.275 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.262+0000 7f4964f2c800 20 started zone id=e239248c-0bee-4e41-803a-24b288d3eb8f (name=default) with tier type = 2024-09-22T08:38:28.275 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.262+0000 7f4964f2c800 1 -- 172.21.15.142:0/2959699683 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5e2dfc600 con 0x7f495c02b200 2024-09-22T08:38:28.275 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.263+0000 7f4960c4f640 1 -- 172.21.15.142:0/2959699683 <== osd.2 v2:172.21.15.142:6808/279438927 7 ==== osd_op_reply(44 notify.0 [create] v32'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4950057030 con 0x7f495c02b200 2024-09-22T08:38:28.275 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.263+0000 7f4964f2c800 1 -- 172.21.15.142:0/2959699683 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94514561665520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5e2dfc260 con 0x7f495c02b200 2024-09-22T08:38:28.275 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.263+0000 7f4964f2c800 1 -- 172.21.15.142:0/2959699683 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5e2dfe520 con 0x55f5e2df1cc0 2024-09-22T08:38:28.275 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.264+0000 7f4960c4f640 1 -- 172.21.15.142:0/2959699683 <== osd.2 v2:172.21.15.142:6808/279438927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94514561665520] v32'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4950057030 con 0x7f495c02b200 2024-09-22T08:38:28.275 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.265+0000 7f495844e640 1 -- 172.21.15.142:0/2959699683 <== osd.1 v2:172.21.15.142:6816/3192108003 16 ==== osd_op_reply(46 notify.1 [create] v32'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f494803b040 con 0x55f5e2df1cc0 2024-09-22T08:38:28.275 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.265+0000 7f4964f2c800 1 -- 172.21.15.142:0/2959699683 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94514561671280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5e2dfe940 con 0x55f5e2df1cc0 2024-09-22T08:38:28.275 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.265+0000 7f4964f2c800 1 -- 172.21.15.142:0/2959699683 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5e2dff300 con 0x55f5e2df66b0 2024-09-22T08:38:28.275 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.266+0000 7f4961450640 1 -- 172.21.15.142:0/2959699683 <== osd.3 v2:172.21.15.142:6800/1064901393 14 ==== osd_op_reply(48 notify.2 [create] v32'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f495c03a070 con 0x55f5e2df66b0 2024-09-22T08:38:28.275 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.266+0000 7f4964f2c800 1 -- 172.21.15.142:0/2959699683 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94514561674832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5e2dff720 con 0x55f5e2df66b0 2024-09-22T08:38:28.275 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.266+0000 7f4964f2c800 1 -- 172.21.15.142:0/2959699683 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5e2e00240 con 0x7f495c02b200 2024-09-22T08:38:28.275 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.266+0000 7f495844e640 1 -- 172.21.15.142:0/2959699683 <== osd.1 v2:172.21.15.142:6816/3192108003 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94514561671280] v32'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f494803b040 con 0x55f5e2df1cc0 2024-09-22T08:38:28.276 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.267+0000 7f4960c4f640 1 -- 172.21.15.142:0/2959699683 <== osd.2 v2:172.21.15.142:6808/279438927 9 ==== osd_op_reply(50 notify.3 [create] v32'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4950057030 con 0x7f495c02b200 2024-09-22T08:38:28.276 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.267+0000 7f4964f2c800 1 -- 172.21.15.142:0/2959699683 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94514561678608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5e2e00630 con 0x7f495c02b200 2024-09-22T08:38:28.276 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.267+0000 7f4961450640 1 -- 172.21.15.142:0/2959699683 <== osd.3 v2:172.21.15.142:6800/1064901393 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94514561674832] v32'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f495c03a070 con 0x55f5e2df66b0 2024-09-22T08:38:28.276 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.267+0000 7f4964f2c800 1 -- 172.21.15.142:0/2959699683 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5e2e01080 con 0x55f5e2df1cc0 2024-09-22T08:38:28.279 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.268+0000 7f4960c4f640 1 -- 172.21.15.142:0/2959699683 <== osd.2 v2:172.21.15.142:6808/279438927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94514561678608] v32'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4950057030 con 0x7f495c02b200 2024-09-22T08:38:28.280 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.268+0000 7f495844e640 1 -- 172.21.15.142:0/2959699683 <== osd.1 v2:172.21.15.142:6816/3192108003 18 ==== osd_op_reply(52 notify.4 [create] v32'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f494803b040 con 0x55f5e2df1cc0 2024-09-22T08:38:28.280 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.268+0000 7f4964f2c800 1 -- 172.21.15.142:0/2959699683 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94514561682288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5e2e01040 con 0x55f5e2df1cc0 2024-09-22T08:38:28.280 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.268+0000 7f4964f2c800 1 -- 172.21.15.142:0/2959699683 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5e2e01a00 con 0x7f495008d040 2024-09-22T08:38:28.280 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.270+0000 7f495844e640 1 -- 172.21.15.142:0/2959699683 <== osd.1 v2:172.21.15.142:6816/3192108003 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94514561682288] v32'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f494803b040 con 0x55f5e2df1cc0 2024-09-22T08:38:28.280 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.270+0000 7f495844e640 1 -- 172.21.15.142:0/2959699683 <== osd.0 v2:172.21.15.31:6800/168281188 10 ==== osd_op_reply(54 notify.5 [create] v32'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f494803b040 con 0x7f495008d040 2024-09-22T08:38:28.280 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.270+0000 7f4964f2c800 1 -- 172.21.15.142:0/2959699683 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94514561672336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5e2e01a00 con 0x7f495008d040 2024-09-22T08:38:28.280 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.270+0000 7f4964f2c800 1 -- 172.21.15.142:0/2959699683 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5e2e023c0 con 0x7f495008d040 2024-09-22T08:38:28.280 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.271+0000 7f495844e640 1 -- 172.21.15.142:0/2959699683 <== osd.0 v2:172.21.15.31:6800/168281188 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94514561672336] v32'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f494803b040 con 0x7f495008d040 2024-09-22T08:38:28.280 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.271+0000 7f495844e640 1 -- 172.21.15.142:0/2959699683 <== osd.0 v2:172.21.15.31:6800/168281188 12 ==== osd_op_reply(56 notify.6 [create] v32'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f494803b040 con 0x7f495008d040 2024-09-22T08:38:28.280 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.271+0000 7f4964f2c800 1 -- 172.21.15.142:0/2959699683 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94514561685296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5e2e023c0 con 0x7f495008d040 2024-09-22T08:38:28.280 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.271+0000 7f4964f2c800 1 -- 172.21.15.142:0/2959699683 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5e2e02d80 con 0x7f495008d040 2024-09-22T08:38:28.280 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.272+0000 7f495844e640 1 -- 172.21.15.142:0/2959699683 <== osd.0 v2:172.21.15.31:6800/168281188 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94514561685296] v32'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f494803b040 con 0x7f495008d040 2024-09-22T08:38:28.281 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.272+0000 7f495844e640 1 -- 172.21.15.142:0/2959699683 <== osd.0 v2:172.21.15.31:6800/168281188 14 ==== osd_op_reply(58 notify.7 [create] v32'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f494803b040 con 0x7f495008d040 2024-09-22T08:38:28.281 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.272+0000 7f4964f2c800 1 -- 172.21.15.142:0/2959699683 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94514561687792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5e2e02d80 con 0x7f495008d040 2024-09-22T08:38:28.281 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.272+0000 7f4964f2c800 20 add_watcher() i=0 2024-09-22T08:38:28.281 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.272+0000 7f4964f2c800 20 add_watcher() i=1 2024-09-22T08:38:28.281 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.272+0000 7f4964f2c800 20 add_watcher() i=2 2024-09-22T08:38:28.281 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.272+0000 7f4964f2c800 20 add_watcher() i=3 2024-09-22T08:38:28.281 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.272+0000 7f4964f2c800 20 add_watcher() i=4 2024-09-22T08:38:28.281 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.272+0000 7f4964f2c800 20 add_watcher() i=5 2024-09-22T08:38:28.281 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.272+0000 7f4964f2c800 20 add_watcher() i=6 2024-09-22T08:38:28.281 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.273+0000 7f495844e640 1 -- 172.21.15.142:0/2959699683 <== osd.0 v2:172.21.15.31:6800/168281188 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94514561687792] v32'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f494803b040 con 0x7f495008d040 2024-09-22T08:38:28.281 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.273+0000 7f4964f2c800 20 add_watcher() i=7 2024-09-22T08:38:28.281 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.273+0000 7f4964f2c800 2 all 8 watchers are set, enabling cache 2024-09-22T08:38:28.281 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.273+0000 7f4964f2c800 1 -- 172.21.15.142:0/2959699683 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5e2e06210 con 0x55f5e2df1cc0 2024-09-22T08:38:28.281 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.274+0000 7f495844e640 1 -- 172.21.15.142:0/2959699683 <== osd.1 v2:172.21.15.142:6816/3192108003 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f494803b040 con 0x55f5e2df1cc0 2024-09-22T08:38:28.281 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.274+0000 7f4964f2c800 1 -- 172.21.15.142:0/2959699683 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94514561702864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5e2e02ef0 con 0x55f5e2df1cc0 2024-09-22T08:38:28.282 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.275+0000 7f495844e640 1 -- 172.21.15.142:0/2959699683 <== osd.1 v2:172.21.15.142:6816/3192108003 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94514561702864] v32'229 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f494803b040 con 0x55f5e2df1cc0 2024-09-22T08:38:28.282 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.275+0000 7f48177e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:38:28.282 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.275+0000 7f4964f2c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:38:28.282 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.275+0000 7f4964f2c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:38:28.282 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.275+0000 7f4964f2c800 5 note: GC not initialized 2024-09-22T08:38:28.282 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.275+0000 7f48167e4640 20 reqs_thread_entry: start 2024-09-22T08:38:28.282 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.276+0000 7f4964f2c800 20 init_complete bucket index max shards: 11 2024-09-22T08:38:28.282 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.276+0000 7f4964f2c800 20 Filter name: none 2024-09-22T08:38:28.282 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.276+0000 7f480f7fe640 20 reqs_thread_entry: start 2024-09-22T08:38:28.282 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.276+0000 7f4964f2c800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-22T08:38:28.282 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.276+0000 7f4964f2c800 20 rados->read ofs=0 len=0 2024-09-22T08:38:28.282 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.276+0000 7f4964f2c800 1 -- 172.21.15.142:0/2959699683 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5e2e395a0 con 0x55f5e2df1cc0 2024-09-22T08:38:28.282 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.276+0000 7f495844e640 1 -- 172.21.15.142:0/2959699683 <== osd.1 v2:172.21.15.142:6816/3192108003 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f494803b040 con 0x55f5e2df1cc0 2024-09-22T08:38:28.283 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.276+0000 7f4964f2c800 20 rados_obj.operate() r=0 bl.length=391 2024-09-22T08:38:28.283 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.276+0000 7f4964f2c800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-22T08:38:28.283 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.276+0000 7f4964f2c800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-22T08:38:28.283 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.276+0000 7f4964f2c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:38:28.283 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.276+0000 7f4964f2c800 1 -- 172.21.15.142:0/2959699683 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_trim in=55b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5e2e3c030 con 0x7f495008d040 2024-09-22T08:38:28.283 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.278+0000 7f495844e640 1 -- 172.21.15.142:0/2959699683 <== osd.0 v2:172.21.15.31:6800/168281188 16 ==== osd_op_reply(63 usage.10 [call] v32'32 uv32 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f494803b040 con 0x7f495008d040 2024-09-22T08:38:28.283 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.278+0000 7f4964f2c800 1 -- 172.21.15.142:0/2959699683 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:64 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_trim in=55b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5e2e3c030 con 0x7f495008d040 2024-09-22T08:38:28.284 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.279+0000 7f495844e640 1 -- 172.21.15.142:0/2959699683 <== osd.0 v2:172.21.15.31:6800/168281188 17 ==== osd_op_reply(64 usage.10 [call] v32'33 uv32 ondisk = -61 ((61) No data available)) ==== 152+0+0 (crc 0 0 0) 0x7f494803b040 con 0x7f495008d040 2024-09-22T08:38:28.284 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.280+0000 7f48177e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:38:28.284 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.280+0000 7f4964f2c800 1 -- 172.21.15.142:0/2959699683 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94514561702864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5e2e048f0 con 0x55f5e2df1cc0 2024-09-22T08:38:28.284 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.281+0000 7f495844e640 1 -- 172.21.15.142:0/2959699683 <== osd.1 v2:172.21.15.142:6816/3192108003 23 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94514561702864] v32'230 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f494803b040 con 0x55f5e2df1cc0 2024-09-22T08:38:28.284 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.281+0000 7f4964f2c800 1 -- 172.21.15.142:0/2959699683 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94514561665520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5e2e05bd0 con 0x7f495c02b200 2024-09-22T08:38:28.284 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.282+0000 7f4960c4f640 1 -- 172.21.15.142:0/2959699683 <== osd.2 v2:172.21.15.142:6808/279438927 11 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94514561665520] v32'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4950057030 con 0x7f495c02b200 2024-09-22T08:38:28.284 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.282+0000 7f4964f2c800 20 remove_watcher() i=0 2024-09-22T08:38:28.285 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.282+0000 7f4964f2c800 2 removed watcher, disabling cache 2024-09-22T08:38:28.285 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.282+0000 7f4964f2c800 1 -- 172.21.15.142:0/2959699683 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94514561671280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5e2e05bd0 con 0x55f5e2df1cc0 2024-09-22T08:38:28.285 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.283+0000 7f495844e640 1 -- 172.21.15.142:0/2959699683 <== osd.1 v2:172.21.15.142:6816/3192108003 24 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94514561671280] v32'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f494803b040 con 0x55f5e2df1cc0 2024-09-22T08:38:28.285 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.283+0000 7f4964f2c800 20 remove_watcher() i=1 2024-09-22T08:38:28.285 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.283+0000 7f4964f2c800 1 -- 172.21.15.142:0/2959699683 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94514561674832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5e2dfe070 con 0x55f5e2df66b0 2024-09-22T08:38:28.287 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.284+0000 7f4961450640 1 -- 172.21.15.142:0/2959699683 <== osd.3 v2:172.21.15.142:6800/1064901393 16 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94514561674832] v32'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f495c03a070 con 0x55f5e2df66b0 2024-09-22T08:38:28.287 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.284+0000 7f4964f2c800 20 remove_watcher() i=2 2024-09-22T08:38:28.287 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.284+0000 7f4964f2c800 1 -- 172.21.15.142:0/2959699683 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94514561678608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5e2e05bd0 con 0x7f495c02b200 2024-09-22T08:38:28.288 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.285+0000 7f4960c4f640 1 -- 172.21.15.142:0/2959699683 <== osd.2 v2:172.21.15.142:6808/279438927 12 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94514561678608] v32'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4950057030 con 0x7f495c02b200 2024-09-22T08:38:28.288 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.286+0000 7f4964f2c800 20 remove_watcher() i=3 2024-09-22T08:38:28.288 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.286+0000 7f4964f2c800 1 -- 172.21.15.142:0/2959699683 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94514561682288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5e2dfee50 con 0x55f5e2df1cc0 2024-09-22T08:38:28.289 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.287+0000 7f495844e640 1 -- 172.21.15.142:0/2959699683 <== osd.1 v2:172.21.15.142:6816/3192108003 25 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94514561682288] v32'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f494803b040 con 0x55f5e2df1cc0 2024-09-22T08:38:28.289 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.287+0000 7f4964f2c800 20 remove_watcher() i=4 2024-09-22T08:38:28.289 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.287+0000 7f4964f2c800 1 -- 172.21.15.142:0/2959699683 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94514561672336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5e2dfe070 con 0x7f495008d040 2024-09-22T08:38:28.290 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.288+0000 7f495844e640 1 -- 172.21.15.142:0/2959699683 <== osd.0 v2:172.21.15.31:6800/168281188 18 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94514561672336] v32'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f494803b040 con 0x7f495008d040 2024-09-22T08:38:28.290 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.288+0000 7f4964f2c800 20 remove_watcher() i=5 2024-09-22T08:38:28.290 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.288+0000 7f4964f2c800 1 -- 172.21.15.142:0/2959699683 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94514561685296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5e2dffd10 con 0x7f495008d040 2024-09-22T08:38:28.291 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.289+0000 7f495844e640 1 -- 172.21.15.142:0/2959699683 <== osd.0 v2:172.21.15.31:6800/168281188 19 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94514561685296] v32'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f494803b040 con 0x7f495008d040 2024-09-22T08:38:28.291 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.289+0000 7f4964f2c800 20 remove_watcher() i=6 2024-09-22T08:38:28.291 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.289+0000 7f4964f2c800 1 -- 172.21.15.142:0/2959699683 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94514561687792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5e2dfe520 con 0x7f495008d040 2024-09-22T08:38:28.294 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.290+0000 7f495844e640 1 -- 172.21.15.142:0/2959699683 <== osd.0 v2:172.21.15.31:6800/168281188 20 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94514561687792] v32'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f494803b040 con 0x7f495008d040 2024-09-22T08:38:28.294 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.290+0000 7f4964f2c800 20 remove_watcher() i=7 2024-09-22T08:38:28.294 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.290+0000 7f4964f2c800 1 -- 172.21.15.142:0/2959699683 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f495008d040 msgr2=0x7f4950096730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:28.294 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.290+0000 7f4964f2c800 1 --2- 172.21.15.142:0/2959699683 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f495008d040 0x7f4950096730 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:28.294 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.290+0000 7f4964f2c800 1 -- 172.21.15.142:0/2959699683 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55f5e2df1cc0 msgr2=0x55f5e2df4180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:28.294 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.290+0000 7f4964f2c800 1 --2- 172.21.15.142:0/2959699683 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55f5e2df1cc0 0x55f5e2df4180 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:28.295 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.290+0000 7f4964f2c800 1 -- 172.21.15.142:0/2959699683 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f495c02b200 msgr2=0x7f495c0323a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:28.295 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.290+0000 7f4964f2c800 1 --2- 172.21.15.142:0/2959699683 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f495c02b200 0x7f495c0323a0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:28.295 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.290+0000 7f4964f2c800 1 -- 172.21.15.142:0/2959699683 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55f5e2df66b0 msgr2=0x55f5e2df8aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:28.295 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.290+0000 7f4964f2c800 1 --2- 172.21.15.142:0/2959699683 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55f5e2df66b0 0x55f5e2df8aa0 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:28.295 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.290+0000 7f4964f2c800 1 -- 172.21.15.142:0/2959699683 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f482c03cf60 msgr2=0x7f482c03f420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:28.295 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.290+0000 7f4964f2c800 1 --2- 172.21.15.142:0/2959699683 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f482c03cf60 0x7f482c03f420 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f4950095140 tx=0x7f4950065580 comp rx=0 tx=0).stop 2024-09-22T08:38:28.295 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.290+0000 7f4964f2c800 1 -- 172.21.15.142:0/2959699683 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f5e2dded90 msgr2=0x55f5e2de6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:28.295 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.290+0000 7f495844e640 1 -- 172.21.15.142:0/2959699683 reap_dead start 2024-09-22T08:38:28.295 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.290+0000 7f4964f2c800 1 --2- 172.21.15.142:0/2959699683 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f5e2dded90 0x55f5e2de6300 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f495c005a30 tx=0x7f495c054860 comp rx=0 tx=0).stop 2024-09-22T08:38:28.295 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.290+0000 7f4964f2c800 1 -- 172.21.15.142:0/2959699683 shutdown_connections 2024-09-22T08:38:28.295 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.290+0000 7f4964f2c800 1 --2- 172.21.15.142:0/2959699683 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f5e2dded90 0x55f5e2de6300 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:28.295 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.290+0000 7f4964f2c800 1 -- 172.21.15.142:0/2959699683 >> 172.21.15.142:0/2959699683 conn(0x55f5e2ddb190 msgr2=0x55f5e2dd93a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:38:28.295 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.290+0000 7f4964f2c800 1 -- 172.21.15.142:0/2959699683 shutdown_connections 2024-09-22T08:38:28.295 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.290+0000 7f4964f2c800 1 -- 172.21.15.142:0/2959699683 wait complete. 2024-09-22T08:38:28.296 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.291+0000 7f4964f2c800 1 -- 172.21.15.142:0/1393470478 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f483803cfb0 msgr2=0x7f483803f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:28.296 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.291+0000 7f4964f2c800 1 --2- 172.21.15.142:0/1393470478 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f483803cfb0 0x7f483803f470 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x55f5e2dc3c30 tx=0x7f4950096640 comp rx=0 tx=0).stop 2024-09-22T08:38:28.296 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.291+0000 7f4964f2c800 1 -- 172.21.15.142:0/1393470478 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f5e2dd2270 msgr2=0x55f5e2dd2690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:28.296 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.291+0000 7f4964f2c800 1 --2- 172.21.15.142:0/1393470478 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f5e2dd2270 0x55f5e2dd2690 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x55f5e2db7e50 tx=0x7f495c0167b0 comp rx=0 tx=0).stop 2024-09-22T08:38:28.296 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.291+0000 7f4964f2c800 1 -- 172.21.15.142:0/1393470478 shutdown_connections 2024-09-22T08:38:28.296 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.291+0000 7f4964f2c800 1 --2- 172.21.15.142:0/1393470478 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f483803cfb0 0x7f483803f470 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:28.296 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.291+0000 7f4964f2c800 1 --2- 172.21.15.142:0/1393470478 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f5e2dd2270 0x55f5e2dd2690 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:28.296 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.291+0000 7f4964f2c800 1 -- 172.21.15.142:0/1393470478 >> 172.21.15.142:0/1393470478 conn(0x55f5e2dc6620 msgr2=0x55f5e2dc6a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:38:28.296 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.291+0000 7f4964f2c800 1 -- 172.21.15.142:0/1393470478 shutdown_connections 2024-09-22T08:38:28.296 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.291+0000 7f4964f2c800 1 -- 172.21.15.142:0/1393470478 wait complete. 2024-09-22T08:38:28.296 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.291+0000 7f4964f2c800 1 -- 172.21.15.142:0/70400226 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55f5e2dbc490 msgr2=0x55f5e2dbe880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:28.296 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.291+0000 7f4964f2c800 1 --2- 172.21.15.142:0/70400226 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55f5e2dbc490 0x55f5e2dbe880 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:28.296 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.291+0000 7f4964f2c800 1 -- 172.21.15.142:0/70400226 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55f5e2dc0c60 msgr2=0x55f5e2dc3100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:28.297 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.291+0000 7f4964f2c800 1 --2- 172.21.15.142:0/70400226 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55f5e2dc0c60 0x55f5e2dc3100 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:28.297 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.291+0000 7f4964f2c800 1 -- 172.21.15.142:0/70400226 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f484803d000 msgr2=0x7f484803f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:28.297 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.291+0000 7f4964f2c800 1 --2- 172.21.15.142:0/70400226 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f484803d000 0x7f484803f4c0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f4948001e30 tx=0x7f4948001390 comp rx=0 tx=0).stop 2024-09-22T08:38:28.297 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.291+0000 7f4964f2c800 1 -- 172.21.15.142:0/70400226 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f5e2cc2a00 msgr2=0x55f5e2db6e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:28.297 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.291+0000 7f4964f2c800 1 --2- 172.21.15.142:0/70400226 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f5e2cc2a00 0x55f5e2db6e50 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f49500460d0 tx=0x7f4950002fb0 comp rx=0 tx=0).stop 2024-09-22T08:38:28.297 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.291+0000 7f4964f2c800 1 -- 172.21.15.142:0/70400226 shutdown_connections 2024-09-22T08:38:28.297 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.291+0000 7f4964f2c800 1 --2- 172.21.15.142:0/70400226 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55f5e2dc0c60 0x55f5e2dc3100 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:28.297 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.291+0000 7f4964f2c800 1 --2- 172.21.15.142:0/70400226 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55f5e2dbc490 0x55f5e2dbe880 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:28.297 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.291+0000 7f4964f2c800 1 --2- 172.21.15.142:0/70400226 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f484803d000 0x7f484803f4c0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:28.297 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.291+0000 7f4964f2c800 1 --2- 172.21.15.142:0/70400226 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f5e2cc2a00 0x55f5e2db6e50 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:28.297 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.291+0000 7f4964f2c800 1 -- 172.21.15.142:0/70400226 >> 172.21.15.142:0/70400226 conn(0x55f5e2cb7ba0 msgr2=0x55f5e2db0570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:38:28.297 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.291+0000 7f4964f2c800 1 -- 172.21.15.142:0/70400226 shutdown_connections 2024-09-22T08:38:28.297 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.291+0000 7f4964f2c800 1 -- 172.21.15.142:0/70400226 wait complete. 2024-09-22T08:38:28.302 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo'] 2024-09-22T08:38:28.302 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo'] 2024-09-22T08:38:28.303 DEBUG:teuthology.orchestra.run.smithi142:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo 2024-09-22T08:38:28.347 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:38:28.347 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:38:28.348 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.346+0000 7fd2a781d800 1 Processor -- start 2024-09-22T08:38:28.348 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.346+0000 7fd2a781d800 1 -- start start 2024-09-22T08:38:28.348 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.346+0000 7fd2a781d800 1 --2- >> v2:172.21.15.31:3300/0 conn(0x5566c0ea6da0 0x5566c0ea9190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:28.348 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.346+0000 7fd2a781d800 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5566c0d32a20 con 0x5566c0ea9700 2024-09-22T08:38:28.348 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.346+0000 7fd2a781d800 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x5566c0d327d0 con 0x5566c0ea6da0 2024-09-22T08:38:28.349 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.346+0000 7fd2a2feb640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x5566c0ea6da0 0x5566c0ea9190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:28.349 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.346+0000 7fd2a27ea640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x5566c0ea9700 0x5566c0eabbc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.142:50394/0 (socket says 172.21.15.142:50394) 2024-09-22T08:38:28.349 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.346+0000 7fd2a27ea640 1 -- 172.21.15.142:0/3898341819 learned_addr learned my addr 172.21.15.142:0/3898341819 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-09-22T08:38:28.349 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.347+0000 7fd2a2feb640 1 -- 172.21.15.142:0/3898341819 >> v1:172.21.15.31:6789/0 conn(0x5566c0ea9700 legacy=0x5566c0eabbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:28.349 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.347+0000 7fd2a2feb640 1 -- 172.21.15.142:0/3898341819 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5566c0eae4b0 con 0x5566c0ea6da0 2024-09-22T08:38:28.351 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.348+0000 7fd2a2feb640 1 --2- 172.21.15.142:0/3898341819 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5566c0ea6da0 0x5566c0ea9190 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fd29400a470 tx=0x7fd294045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71e6ea7016b8d174 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:28.351 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.349+0000 7fd2a1fe9640 1 -- 172.21.15.142:0/3898341819 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd294053570 con 0x5566c0ea6da0 2024-09-22T08:38:28.351 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.349+0000 7fd2a1fe9640 1 -- 172.21.15.142:0/3898341819 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd294058070 con 0x5566c0ea6da0 2024-09-22T08:38:28.351 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.349+0000 7fd2a1fe9640 1 -- 172.21.15.142:0/3898341819 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd294053880 con 0x5566c0ea6da0 2024-09-22T08:38:28.352 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.349+0000 7fd2a781d800 1 -- 172.21.15.142:0/3898341819 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5566c0ea6da0 msgr2=0x5566c0ea9190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:28.352 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.349+0000 7fd2a781d800 1 --2- 172.21.15.142:0/3898341819 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5566c0ea6da0 0x5566c0ea9190 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fd29400a470 tx=0x7fd294045a20 comp rx=0 tx=0).stop 2024-09-22T08:38:28.352 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.349+0000 7fd2a781d800 1 -- 172.21.15.142:0/3898341819 shutdown_connections 2024-09-22T08:38:28.352 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.349+0000 7fd2a781d800 1 --2- 172.21.15.142:0/3898341819 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5566c0ea6da0 0x5566c0ea9190 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:28.352 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.349+0000 7fd2a781d800 1 -- 172.21.15.142:0/3898341819 >> 172.21.15.142:0/3898341819 conn(0x5566c0ea1310 msgr2=0x5566c0ea3790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:38:28.352 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.349+0000 7fd2a781d800 1 -- 172.21.15.142:0/3898341819 shutdown_connections 2024-09-22T08:38:28.352 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.349+0000 7fd2a781d800 1 -- 172.21.15.142:0/3898341819 wait complete. 2024-09-22T08:38:28.365 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.363+0000 7fd2a781d800 1 Processor -- start 2024-09-22T08:38:28.365 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.363+0000 7fd2a781d800 1 -- start start 2024-09-22T08:38:28.365 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.363+0000 7fd2a781d800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5566c0ea6da0 0x5566c0ea5f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:28.365 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.363+0000 7fd2a781d800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5566c0d3fdd0 con 0x5566c0ea6da0 2024-09-22T08:38:28.365 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.363+0000 7fd2a2feb640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5566c0ea6da0 0x5566c0ea5f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:28.365 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.363+0000 7fd2a2feb640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5566c0ea6da0 0x5566c0ea5f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:51140/0 (socket says 172.21.15.142:51140) 2024-09-22T08:38:28.366 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.363+0000 7fd2a2feb640 1 -- 172.21.15.142:0/2372116975 learned_addr learned my addr 172.21.15.142:0/2372116975 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:38:28.366 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.364+0000 7fd2a2feb640 1 -- 172.21.15.142:0/2372116975 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5566c0ea6580 con 0x5566c0ea6da0 2024-09-22T08:38:28.366 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.364+0000 7fd2a2feb640 1 --2- 172.21.15.142:0/2372116975 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5566c0ea6da0 0x5566c0ea5f90 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fd294025c20 tx=0x7fd294051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=336ef016a2eda20f server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:28.366 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.364+0000 7fd190e09640 1 -- 172.21.15.142:0/2372116975 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd294053a20 con 0x5566c0ea6da0 2024-09-22T08:38:28.367 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.364+0000 7fd190e09640 1 -- 172.21.15.142:0/2372116975 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd294063070 con 0x5566c0ea6da0 2024-09-22T08:38:28.367 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.364+0000 7fd190e09640 1 -- 172.21.15.142:0/2372116975 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd294053cf0 con 0x5566c0ea6da0 2024-09-22T08:38:28.368 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.365+0000 7fd2a781d800 1 -- 172.21.15.142:0/2372116975 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5566c0ea6da0 msgr2=0x5566c0ea5f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:28.368 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.365+0000 7fd2a781d800 1 --2- 172.21.15.142:0/2372116975 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5566c0ea6da0 0x5566c0ea5f90 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fd294025c20 tx=0x7fd294051000 comp rx=0 tx=0).stop 2024-09-22T08:38:28.368 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.365+0000 7fd2a781d800 1 -- 172.21.15.142:0/2372116975 shutdown_connections 2024-09-22T08:38:28.369 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.365+0000 7fd2a781d800 1 --2- 172.21.15.142:0/2372116975 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5566c0ea6da0 0x5566c0ea5f90 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:28.369 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.365+0000 7fd2a781d800 1 -- 172.21.15.142:0/2372116975 >> 172.21.15.142:0/2372116975 conn(0x5566c0ea1310 msgr2=0x5566c0f918d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:38:28.369 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.365+0000 7fd2a781d800 1 -- 172.21.15.142:0/2372116975 shutdown_connections 2024-09-22T08:38:28.369 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.365+0000 7fd2a781d800 1 -- 172.21.15.142:0/2372116975 wait complete. 2024-09-22T08:38:28.369 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.365+0000 7fd2a781d800 1 Processor -- start 2024-09-22T08:38:28.369 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.365+0000 7fd2a781d800 1 -- start start 2024-09-22T08:38:28.369 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.365+0000 7fd2a781d800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5566c0ea6da0 0x5566c0f9ea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:28.369 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.365+0000 7fd2a781d800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5566c0ead750 con 0x5566c0ea6da0 2024-09-22T08:38:28.369 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.366+0000 7fd2a2feb640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5566c0ea6da0 0x5566c0f9ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:28.369 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.366+0000 7fd2a2feb640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5566c0ea6da0 0x5566c0f9ea50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:51154/0 (socket says 172.21.15.142:51154) 2024-09-22T08:38:28.369 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.366+0000 7fd2a2feb640 1 -- 172.21.15.142:0/192194255 learned_addr learned my addr 172.21.15.142:0/192194255 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:38:28.369 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.366+0000 7fd2a2feb640 1 -- 172.21.15.142:0/192194255 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5566c0f9efb0 con 0x5566c0ea6da0 2024-09-22T08:38:28.369 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.366+0000 7fd2a2feb640 1 --2- 172.21.15.142:0/192194255 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5566c0ea6da0 0x5566c0f9ea50 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fd294025c20 tx=0x7fd294002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:28.370 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.366+0000 7fd18f606640 1 -- 172.21.15.142:0/192194255 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd29406c030 con 0x5566c0ea6da0 2024-09-22T08:38:28.370 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.366+0000 7fd18f606640 1 -- 172.21.15.142:0/192194255 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd294068660 con 0x5566c0ea6da0 2024-09-22T08:38:28.370 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.366+0000 7fd2a781d800 1 -- 172.21.15.142:0/192194255 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5566c0f9f240 con 0x5566c0ea6da0 2024-09-22T08:38:28.370 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.366+0000 7fd18f606640 1 -- 172.21.15.142:0/192194255 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd294068940 con 0x5566c0ea6da0 2024-09-22T08:38:28.370 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.366+0000 7fd2a781d800 1 -- 172.21.15.142:0/192194255 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5566c0f9fc40 con 0x5566c0ea6da0 2024-09-22T08:38:28.372 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.367+0000 7fd18f606640 1 -- 172.21.15.142:0/192194255 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fd294068ae0 con 0x5566c0ea6da0 2024-09-22T08:38:28.372 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.367+0000 7fd18f606640 1 --2- 172.21.15.142:0/192194255 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fd18803d000 0x7fd18803f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:28.372 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.367+0000 7fd18f606640 1 -- 172.21.15.142:0/192194255 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5938+0+0 (secure 0 0 0) 0x7fd294098ab0 con 0x5566c0ea6da0 2024-09-22T08:38:28.372 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.368+0000 7fd2a27ea640 1 --2- 172.21.15.142:0/192194255 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fd18803d000 0x7fd18803f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:28.373 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.368+0000 7fd2a781d800 1 --2- 172.21.15.142:0/192194255 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5566c0ea9700 0x5566c0fa60a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:28.373 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.368+0000 7fd2a781d800 1 -- 172.21.15.142:0/192194255 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5566c0fa65e0 con 0x5566c0ea9700 2024-09-22T08:38:28.373 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.368+0000 7fd2a37ec640 1 --2- 172.21.15.142:0/192194255 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5566c0ea9700 0x5566c0fa60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:28.373 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.368+0000 7fd2a27ea640 1 --2- 172.21.15.142:0/192194255 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fd18803d000 0x7fd18803f4c0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fd298001d70 tx=0x7fd2980012d0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:28.373 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.368+0000 7fd2a37ec640 1 --2- 172.21.15.142:0/192194255 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5566c0ea9700 0x5566c0fa60a0 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:28.373 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.368+0000 7fd2a37ec640 1 -- 172.21.15.142:0/192194255 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd29c00a4d0 con 0x5566c0ea9700 2024-09-22T08:38:28.373 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.368+0000 7fd2a781d800 1 -- 172.21.15.142:0/192194255 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5566c0fa6980 con 0x5566c0ea9700 2024-09-22T08:38:28.373 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.369+0000 7fd2a37ec640 1 -- 172.21.15.142:0/192194255 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd29c00a4d0 con 0x5566c0ea9700 2024-09-22T08:38:28.373 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.369+0000 7fd2a781d800 1 --2- 172.21.15.142:0/192194255 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5566c0fa8480 0x5566c0faa900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:28.373 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.369+0000 7fd2a781d800 1 -- 172.21.15.142:0/192194255 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:3 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5566c0fab090 con 0x5566c0fa8480 2024-09-22T08:38:28.373 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.369+0000 7fd2a2feb640 1 --2- 172.21.15.142:0/192194255 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5566c0fa8480 0x5566c0faa900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:28.373 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.369+0000 7fd2a2feb640 1 --2- 172.21.15.142:0/192194255 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5566c0fa8480 0x5566c0faa900 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:28.373 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.369+0000 7fd2a2feb640 1 -- 172.21.15.142:0/192194255 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(3 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fd294051070 con 0x5566c0fa8480 2024-09-22T08:38:28.374 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.369+0000 7fd2a781d800 1 -- 172.21.15.142:0/192194255 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5566c0fa71d0 con 0x5566c0ea9700 2024-09-22T08:38:28.374 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.370+0000 7fd2a37ec640 1 -- 172.21.15.142:0/192194255 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd29c00a4d0 con 0x5566c0ea9700 2024-09-22T08:38:28.374 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.370+0000 7fd2a781d800 1 -- 172.21.15.142:0/192194255 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5566c0fa7620 con 0x5566c0fa8480 2024-09-22T08:38:28.374 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.370+0000 7fd2a2feb640 1 -- 172.21.15.142:0/192194255 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(5 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fd294051070 con 0x5566c0fa8480 2024-09-22T08:38:28.374 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.370+0000 7fd2a781d800 1 Processor -- start 2024-09-22T08:38:28.374 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.370+0000 7fd2a781d800 1 -- start start 2024-09-22T08:38:28.374 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.370+0000 7fd2a781d800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5566c0fb9a20 0x5566c0fb9e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:28.374 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.370+0000 7fd2a781d800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5566c0d9ed50 con 0x5566c0fb9a20 2024-09-22T08:38:28.379 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.371+0000 7fd2a37ec640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5566c0fb9a20 0x5566c0fb9e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:28.379 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.371+0000 7fd2a37ec640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5566c0fb9a20 0x5566c0fb9e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:51156/0 (socket says 172.21.15.142:51156) 2024-09-22T08:38:28.379 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.371+0000 7fd2a37ec640 1 -- 172.21.15.142:0/467515906 learned_addr learned my addr 172.21.15.142:0/467515906 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:38:28.379 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.371+0000 7fd2a37ec640 1 -- 172.21.15.142:0/467515906 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5566c0fba480 con 0x5566c0fb9a20 2024-09-22T08:38:28.379 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.371+0000 7fd2a37ec640 1 --2- 172.21.15.142:0/467515906 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5566c0fb9a20 0x5566c0fb9e40 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x5566c0f9fa50 tx=0x7fd29c0167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:28.379 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.372+0000 7fd18ce01640 1 -- 172.21.15.142:0/467515906 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd29c013640 con 0x5566c0fb9a20 2024-09-22T08:38:28.379 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.372+0000 7fd18ce01640 1 -- 172.21.15.142:0/467515906 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd29c0137e0 con 0x5566c0fb9a20 2024-09-22T08:38:28.379 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.372+0000 7fd2a781d800 1 -- 172.21.15.142:0/467515906 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5566c0fbacb0 con 0x5566c0fb9a20 2024-09-22T08:38:28.379 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.372+0000 7fd18ce01640 1 -- 172.21.15.142:0/467515906 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd29c013ac0 con 0x5566c0fb9a20 2024-09-22T08:38:28.379 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.372+0000 7fd2a781d800 1 -- 172.21.15.142:0/467515906 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5566c0fbb250 con 0x5566c0fb9a20 2024-09-22T08:38:28.379 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.373+0000 7fd18ce01640 1 -- 172.21.15.142:0/467515906 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fd29c011040 con 0x5566c0fb9a20 2024-09-22T08:38:28.379 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.373+0000 7fd18ce01640 1 --2- 172.21.15.142:0/467515906 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fd17c03d070 0x7fd17c03f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:28.380 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.373+0000 7fd18ce01640 1 -- 172.21.15.142:0/467515906 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5938+0+0 (secure 0 0 0) 0x7fd29c00e040 con 0x5566c0fb9a20 2024-09-22T08:38:28.380 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.373+0000 7fd2a2feb640 1 --2- 172.21.15.142:0/467515906 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fd17c03d070 0x7fd17c03f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:28.380 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.373+0000 7fd2a781d800 1 Processor -- start 2024-09-22T08:38:28.380 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.373+0000 7fd2a781d800 1 -- start start 2024-09-22T08:38:28.380 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.373+0000 7fd2a2feb640 1 --2- 172.21.15.142:0/467515906 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fd17c03d070 0x7fd17c03f530 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fd29406c000 tx=0x7fd29407cf90 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:28.380 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.373+0000 7fd2a781d800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5566c0f96d30 0x5566c0f97130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:28.380 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.373+0000 7fd2a781d800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5566c0f99e90 con 0x5566c0f96d30 2024-09-22T08:38:28.380 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.373+0000 7fd2a37ec640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5566c0f96d30 0x5566c0f97130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:28.380 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.373+0000 7fd2a37ec640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5566c0f96d30 0x5566c0f97130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:51162/0 (socket says 172.21.15.142:51162) 2024-09-22T08:38:28.380 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.373+0000 7fd2a37ec640 1 -- 172.21.15.142:0/3162758782 learned_addr learned my addr 172.21.15.142:0/3162758782 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:38:28.380 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.374+0000 7fd2a37ec640 1 -- 172.21.15.142:0/3162758782 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5566c0f97670 con 0x5566c0f96d30 2024-09-22T08:38:28.380 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.374+0000 7fd2a37ec640 1 --2- 172.21.15.142:0/3162758782 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5566c0f96d30 0x5566c0f97130 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fd29c054860 tx=0x7fd29c056110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=626649aec94adc4 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:28.380 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.374+0000 7fd1867fc640 1 -- 172.21.15.142:0/3162758782 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd29c051020 con 0x5566c0f96d30 2024-09-22T08:38:28.381 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.374+0000 7fd1867fc640 1 -- 172.21.15.142:0/3162758782 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd29c021a90 con 0x5566c0f96d30 2024-09-22T08:38:28.381 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.374+0000 7fd1867fc640 1 -- 172.21.15.142:0/3162758782 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd29c04de60 con 0x5566c0f96d30 2024-09-22T08:38:28.381 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.374+0000 7fd2a781d800 1 -- 172.21.15.142:0/3162758782 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5566c0f96d30 msgr2=0x5566c0f97130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:28.381 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.374+0000 7fd2a781d800 1 --2- 172.21.15.142:0/3162758782 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5566c0f96d30 0x5566c0f97130 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fd29c054860 tx=0x7fd29c056110 comp rx=0 tx=0).stop 2024-09-22T08:38:28.381 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.374+0000 7fd2a781d800 1 -- 172.21.15.142:0/3162758782 shutdown_connections 2024-09-22T08:38:28.381 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.374+0000 7fd2a781d800 1 --2- 172.21.15.142:0/3162758782 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5566c0f96d30 0x5566c0f97130 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:28.381 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.375+0000 7fd2a781d800 1 -- 172.21.15.142:0/3162758782 >> 172.21.15.142:0/3162758782 conn(0x5566c0fc28a0 msgr2=0x5566c0fc0ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:38:28.381 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.375+0000 7fd2a781d800 1 -- 172.21.15.142:0/3162758782 shutdown_connections 2024-09-22T08:38:28.381 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.375+0000 7fd2a781d800 1 -- 172.21.15.142:0/3162758782 wait complete. 2024-09-22T08:38:28.381 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.375+0000 7fd2a781d800 1 Processor -- start 2024-09-22T08:38:28.381 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.375+0000 7fd2a781d800 1 -- start start 2024-09-22T08:38:28.381 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.375+0000 7fd2a781d800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5566c0f96d30 0x5566c0fcfd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:28.381 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.375+0000 7fd2a781d800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5566c0f95bf0 con 0x5566c0f96d30 2024-09-22T08:38:28.381 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.375+0000 7fd2a37ec640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5566c0f96d30 0x5566c0fcfd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:28.382 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.375+0000 7fd2a37ec640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5566c0f96d30 0x5566c0fcfd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:51166/0 (socket says 172.21.15.142:51166) 2024-09-22T08:38:28.382 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.375+0000 7fd2a37ec640 1 -- 172.21.15.142:0/1483081697 learned_addr learned my addr 172.21.15.142:0/1483081697 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:38:28.382 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.375+0000 7fd2a37ec640 1 -- 172.21.15.142:0/1483081697 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5566c0fd0260 con 0x5566c0f96d30 2024-09-22T08:38:28.382 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.376+0000 7fd2a37ec640 1 --2- 172.21.15.142:0/1483081697 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5566c0f96d30 0x5566c0fcfd00 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fd29c020930 tx=0x7fd29c0547c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:28.382 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.376+0000 7fd184ff9640 1 -- 172.21.15.142:0/1483081697 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd29c020bd0 con 0x5566c0f96d30 2024-09-22T08:38:28.382 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.376+0000 7fd184ff9640 1 -- 172.21.15.142:0/1483081697 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd29c020d70 con 0x5566c0f96d30 2024-09-22T08:38:28.382 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.376+0000 7fd2a781d800 1 -- 172.21.15.142:0/1483081697 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5566c0fd04f0 con 0x5566c0f96d30 2024-09-22T08:38:28.382 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.376+0000 7fd184ff9640 1 -- 172.21.15.142:0/1483081697 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd29c01fa90 con 0x5566c0f96d30 2024-09-22T08:38:28.382 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.376+0000 7fd2a781d800 1 -- 172.21.15.142:0/1483081697 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5566c0fd0e70 con 0x5566c0f96d30 2024-09-22T08:38:28.382 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.377+0000 7fd184ff9640 1 -- 172.21.15.142:0/1483081697 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fd29c01fc30 con 0x5566c0f96d30 2024-09-22T08:38:28.393 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.377+0000 7fd2a781d800 20 rados->read ofs=0 len=0 2024-09-22T08:38:28.393 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.377+0000 7fd184ff9640 1 --2- 172.21.15.142:0/1483081697 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fd16c03cfb0 0x7fd16c03f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:28.393 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.377+0000 7fd184ff9640 1 -- 172.21.15.142:0/1483081697 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5938+0+0 (secure 0 0 0) 0x7fd29c034c00 con 0x5566c0f96d30 2024-09-22T08:38:28.393 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.377+0000 7fd2a2feb640 1 --2- 172.21.15.142:0/1483081697 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fd16c03cfb0 0x7fd16c03f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:28.393 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.377+0000 7fd2a781d800 1 --2- 172.21.15.142:0/1483081697 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5566c0fdb5a0 0x5566c0fdda10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:28.393 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.377+0000 7fd2a781d800 1 -- 172.21.15.142:0/1483081697 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5566c0fde160 con 0x5566c0fdb5a0 2024-09-22T08:38:28.393 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.377+0000 7fd2a27ea640 1 --2- 172.21.15.142:0/1483081697 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5566c0fdb5a0 0x5566c0fdda10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:28.393 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.377+0000 7fd2a2feb640 1 --2- 172.21.15.142:0/1483081697 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fd16c03cfb0 0x7fd16c03f470 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fd294098010 tx=0x7fd294088000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:28.393 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.378+0000 7fd2a27ea640 1 --2- 172.21.15.142:0/1483081697 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5566c0fdb5a0 0x5566c0fdda10 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:28.393 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.378+0000 7fd2a27ea640 1 -- 172.21.15.142:0/1483081697 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd298009050 con 0x5566c0fdb5a0 2024-09-22T08:38:28.393 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.378+0000 7fd2a781d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:28.393 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.378+0000 7fd2a781d800 20 realm 2024-09-22T08:38:28.394 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.378+0000 7fd2a781d800 20 rados->read ofs=0 len=0 2024-09-22T08:38:28.394 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.378+0000 7fd2a781d800 1 -- 172.21.15.142:0/1483081697 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5566c0fda9b0 con 0x5566c0fdb5a0 2024-09-22T08:38:28.394 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.378+0000 7fd2a27ea640 1 -- 172.21.15.142:0/1483081697 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd298009050 con 0x5566c0fdb5a0 2024-09-22T08:38:28.394 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.378+0000 7fd2a781d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:28.394 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.378+0000 7fd2a781d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:38:28.394 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.378+0000 7fd2a781d800 20 rados->read ofs=0 len=0 2024-09-22T08:38:28.394 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.378+0000 7fd2a781d800 1 -- 172.21.15.142:0/1483081697 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5566c0fdec60 con 0x5566c0fdb5a0 2024-09-22T08:38:28.394 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.378+0000 7fd2a27ea640 1 -- 172.21.15.142:0/1483081697 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd298009050 con 0x5566c0fdb5a0 2024-09-22T08:38:28.394 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.378+0000 7fd2a781d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:28.394 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.378+0000 7fd2a781d800 20 rados->read ofs=0 len=0 2024-09-22T08:38:28.394 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.378+0000 7fd2a781d800 1 -- 172.21.15.142:0/1483081697 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5566c0fdf530 con 0x5566c0fdb5a0 2024-09-22T08:38:28.394 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.379+0000 7fd2a27ea640 1 -- 172.21.15.142:0/1483081697 <== osd.1 v2:172.21.15.142:6816/3192108003 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd298009050 con 0x5566c0fdb5a0 2024-09-22T08:38:28.394 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.379+0000 7fd2a781d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:38:28.394 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.379+0000 7fd2a781d800 20 rados->read ofs=0 len=0 2024-09-22T08:38:28.395 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.379+0000 7fd2a781d800 1 --2- 172.21.15.142:0/1483081697 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5566c0fdfe30 0x5566c0fe2220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:28.395 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.379+0000 7fd2a781d800 1 -- 172.21.15.142:0/1483081697 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5566c0fe2960 con 0x5566c0fdfe30 2024-09-22T08:38:28.395 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.379+0000 7fd2a37ec640 1 --2- 172.21.15.142:0/1483081697 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5566c0fdfe30 0x5566c0fe2220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:28.395 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.379+0000 7fd2a37ec640 1 --2- 172.21.15.142:0/1483081697 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5566c0fdfe30 0x5566c0fe2220 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:28.395 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.379+0000 7fd2a37ec640 1 -- 172.21.15.142:0/1483081697 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(5 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fd29c00a4d0 con 0x5566c0fdfe30 2024-09-22T08:38:28.395 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.379+0000 7fd2a781d800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:38:28.395 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.379+0000 7fd2a781d800 20 searching for the correct realm 2024-09-22T08:38:28.395 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.379+0000 7fd2a781d800 1 -- 172.21.15.142:0/1483081697 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5566c0fe4340 con 0x5566c0fdfe30 2024-09-22T08:38:28.395 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.379+0000 7fd2a37ec640 1 -- 172.21.15.142:0/1483081697 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd29c00a4d0 con 0x5566c0fdfe30 2024-09-22T08:38:28.395 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.379+0000 7fd2a37ec640 1 --2- 172.21.15.142:0/1483081697 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7fd29c017450 0x7fd29c051020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:28.395 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.380+0000 7fd2a37ec640 1 -- 172.21.15.142:0/1483081697 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5566c0fe4340 con 0x7fd29c017450 2024-09-22T08:38:28.395 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.380+0000 7fd2a2feb640 1 --2- 172.21.15.142:0/1483081697 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7fd29c017450 0x7fd29c051020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:28.395 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.380+0000 7fd2a2feb640 1 --2- 172.21.15.142:0/1483081697 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7fd29c017450 0x7fd29c051020 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:28.395 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.380+0000 7fd2a2feb640 1 -- 172.21.15.142:0/1483081697 <== osd.2 v2:172.21.15.142:6808/279438927 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd294051070 con 0x7fd29c017450 2024-09-22T08:38:28.396 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.380+0000 7fd2a2feb640 1 --2- 172.21.15.142:0/1483081697 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7fd29408a070 0x7fd29405f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:28.396 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.380+0000 7fd2a2feb640 1 -- 172.21.15.142:0/1483081697 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5566c0fe4340 con 0x7fd29408a070 2024-09-22T08:38:28.396 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.381+0000 7fd2a27ea640 1 --2- 172.21.15.142:0/1483081697 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7fd29408a070 0x7fd29405f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:28.396 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.381+0000 7fd2a27ea640 1 --2- 172.21.15.142:0/1483081697 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7fd29408a070 0x7fd29405f420 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:28.396 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.381+0000 7fd2a27ea640 1 -- 172.21.15.142:0/1483081697 <== osd.0 v2:172.21.15.31:6800/168281188 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd298009050 con 0x7fd29408a070 2024-09-22T08:38:28.396 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.381+0000 7fd2a27ea640 1 -- 172.21.15.142:0/1483081697 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5566c0fe4340 con 0x5566c0fdb5a0 2024-09-22T08:38:28.396 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.382+0000 7fd2a27ea640 1 -- 172.21.15.142:0/1483081697 <== osd.1 v2:172.21.15.142:6816/3192108003 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd298009050 con 0x5566c0fdb5a0 2024-09-22T08:38:28.396 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.382+0000 7fd2a27ea640 1 -- 172.21.15.142:0/1483081697 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5566c0fe4340 con 0x5566c0fdb5a0 2024-09-22T08:38:28.396 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.382+0000 7fd2a27ea640 1 -- 172.21.15.142:0/1483081697 <== osd.1 v2:172.21.15.142:6816/3192108003 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd298029040 con 0x5566c0fdb5a0 2024-09-22T08:38:28.396 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.382+0000 7fd2a27ea640 1 -- 172.21.15.142:0/1483081697 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5566c0fe4340 con 0x5566c0fdb5a0 2024-09-22T08:38:28.396 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.382+0000 7fd2a27ea640 1 -- 172.21.15.142:0/1483081697 <== osd.1 v2:172.21.15.142:6816/3192108003 7 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd298029040 con 0x5566c0fdb5a0 2024-09-22T08:38:28.396 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.382+0000 7fd2a27ea640 1 -- 172.21.15.142:0/1483081697 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5566c0fe4340 con 0x7fd29408a070 2024-09-22T08:38:28.396 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.382+0000 7fd2a27ea640 1 -- 172.21.15.142:0/1483081697 <== osd.0 v2:172.21.15.31:6800/168281188 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd298029040 con 0x7fd29408a070 2024-09-22T08:38:28.396 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.382+0000 7fd2a27ea640 1 -- 172.21.15.142:0/1483081697 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5566c0fe4340 con 0x7fd29c017450 2024-09-22T08:38:28.397 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.383+0000 7fd2a2feb640 1 -- 172.21.15.142:0/1483081697 <== osd.2 v2:172.21.15.142:6808/279438927 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd294051070 con 0x7fd29c017450 2024-09-22T08:38:28.397 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.383+0000 7fd2a2feb640 1 -- 172.21.15.142:0/1483081697 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5566c0fe4340 con 0x5566c0fdfe30 2024-09-22T08:38:28.397 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.383+0000 7fd2a37ec640 1 -- 172.21.15.142:0/1483081697 <== osd.3 v2:172.21.15.142:6800/1064901393 3 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd29c00a4d0 con 0x5566c0fdfe30 2024-09-22T08:38:28.397 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.383+0000 7fd2a37ec640 1 -- 172.21.15.142:0/1483081697 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5566c0fe4340 con 0x5566c0fdb5a0 2024-09-22T08:38:28.397 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.383+0000 7fd2a27ea640 1 -- 172.21.15.142:0/1483081697 <== osd.1 v2:172.21.15.142:6816/3192108003 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd298029040 con 0x5566c0fdb5a0 2024-09-22T08:38:28.397 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.383+0000 7fd2a27ea640 1 -- 172.21.15.142:0/1483081697 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5566c0fe4340 con 0x7fd29408a070 2024-09-22T08:38:28.397 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.383+0000 7fd2a27ea640 1 -- 172.21.15.142:0/1483081697 <== osd.0 v2:172.21.15.31:6800/168281188 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd298029040 con 0x7fd29408a070 2024-09-22T08:38:28.397 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.383+0000 7fd2a27ea640 1 -- 172.21.15.142:0/1483081697 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5566c0fe4340 con 0x5566c0fdb5a0 2024-09-22T08:38:28.397 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.384+0000 7fd2a27ea640 1 -- 172.21.15.142:0/1483081697 <== osd.1 v2:172.21.15.142:6816/3192108003 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd298029040 con 0x5566c0fdb5a0 2024-09-22T08:38:28.397 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.384+0000 7fd2a27ea640 1 -- 172.21.15.142:0/1483081697 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5566c0fe4340 con 0x7fd29c017450 2024-09-22T08:38:28.397 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.384+0000 7fd2a2feb640 1 -- 172.21.15.142:0/1483081697 <== osd.2 v2:172.21.15.142:6808/279438927 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fd294051070 con 0x7fd29c017450 2024-09-22T08:38:28.397 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.384+0000 7fd2a2feb640 1 -- 172.21.15.142:0/1483081697 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5566c0fe4340 con 0x5566c0fdfe30 2024-09-22T08:38:28.397 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.384+0000 7fd2a37ec640 1 -- 172.21.15.142:0/1483081697 <== osd.3 v2:172.21.15.142:6800/1064901393 4 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd29c00a4d0 con 0x5566c0fdfe30 2024-09-22T08:38:28.397 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.384+0000 7fd2a37ec640 1 -- 172.21.15.142:0/1483081697 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5566c0fe4340 con 0x5566c0fdfe30 2024-09-22T08:38:28.398 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.384+0000 7fd2a37ec640 1 -- 172.21.15.142:0/1483081697 <== osd.3 v2:172.21.15.142:6800/1064901393 5 ==== osd_op_reply(20 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fd29c00a4d0 con 0x5566c0fdfe30 2024-09-22T08:38:28.398 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.384+0000 7fd2a37ec640 1 -- 172.21.15.142:0/1483081697 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5566c0fe4340 con 0x7fd29408a070 2024-09-22T08:38:28.398 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.385+0000 7fd2a27ea640 1 -- 172.21.15.142:0/1483081697 <== osd.0 v2:172.21.15.31:6800/168281188 4 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd298029040 con 0x7fd29408a070 2024-09-22T08:38:28.398 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.385+0000 7fd2a27ea640 1 -- 172.21.15.142:0/1483081697 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5566c0fe4340 con 0x5566c0fdfe30 2024-09-22T08:38:28.398 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.385+0000 7fd2a37ec640 1 -- 172.21.15.142:0/1483081697 <== osd.3 v2:172.21.15.142:6800/1064901393 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd29c00a4d0 con 0x5566c0fdfe30 2024-09-22T08:38:28.398 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.385+0000 7fd2a37ec640 1 -- 172.21.15.142:0/1483081697 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5566c0fe4340 con 0x5566c0fdfe30 2024-09-22T08:38:28.398 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.385+0000 7fd2a37ec640 1 -- 172.21.15.142:0/1483081697 <== osd.3 v2:172.21.15.142:6800/1064901393 7 ==== osd_op_reply(23 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fd29c00a4d0 con 0x5566c0fdfe30 2024-09-22T08:38:28.398 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.385+0000 7fd2a37ec640 1 -- 172.21.15.142:0/1483081697 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5566c0fe4340 con 0x5566c0fdb5a0 2024-09-22T08:38:28.398 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.385+0000 7fd2a27ea640 1 -- 172.21.15.142:0/1483081697 <== osd.1 v2:172.21.15.142:6816/3192108003 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd298029040 con 0x5566c0fdb5a0 2024-09-22T08:38:28.398 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.385+0000 7fd2a27ea640 1 -- 172.21.15.142:0/1483081697 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5566c0fe4340 con 0x5566c0fdb5a0 2024-09-22T08:38:28.398 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.386+0000 7fd2a27ea640 1 -- 172.21.15.142:0/1483081697 <== osd.1 v2:172.21.15.142:6816/3192108003 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fd298029040 con 0x5566c0fdb5a0 2024-09-22T08:38:28.398 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.386+0000 7fd2a27ea640 1 -- 172.21.15.142:0/1483081697 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5566c0fe4340 con 0x7fd29408a070 2024-09-22T08:38:28.398 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.386+0000 7fd2a27ea640 1 -- 172.21.15.142:0/1483081697 <== osd.0 v2:172.21.15.31:6800/168281188 5 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd298029040 con 0x7fd29408a070 2024-09-22T08:38:28.399 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.386+0000 7fd2a27ea640 1 -- 172.21.15.142:0/1483081697 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5566c0fe4340 con 0x5566c0fdfe30 2024-09-22T08:38:28.399 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.386+0000 7fd2a37ec640 1 -- 172.21.15.142:0/1483081697 <== osd.3 v2:172.21.15.142:6800/1064901393 8 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd29c00a4d0 con 0x5566c0fdfe30 2024-09-22T08:38:28.399 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.386+0000 7fd2a37ec640 1 -- 172.21.15.142:0/1483081697 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5566c0fe4340 con 0x7fd29c017450 2024-09-22T08:38:28.399 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.386+0000 7fd2a2feb640 1 -- 172.21.15.142:0/1483081697 <== osd.2 v2:172.21.15.142:6808/279438927 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd294051070 con 0x7fd29c017450 2024-09-22T08:38:28.399 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.386+0000 7fd2a2feb640 1 -- 172.21.15.142:0/1483081697 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5566c0fe4340 con 0x5566c0fdb5a0 2024-09-22T08:38:28.399 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.387+0000 7fd2a27ea640 1 -- 172.21.15.142:0/1483081697 <== osd.1 v2:172.21.15.142:6816/3192108003 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd298029040 con 0x5566c0fdb5a0 2024-09-22T08:38:28.399 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.387+0000 7fd2a27ea640 1 -- 172.21.15.142:0/1483081697 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5566c0fe4340 con 0x7fd29408a070 2024-09-22T08:38:28.399 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.387+0000 7fd2a27ea640 1 -- 172.21.15.142:0/1483081697 <== osd.0 v2:172.21.15.31:6800/168281188 6 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd298029040 con 0x7fd29408a070 2024-09-22T08:38:28.399 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.387+0000 7fd2a27ea640 1 -- 172.21.15.142:0/1483081697 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5566c0fe4340 con 0x5566c0fdfe30 2024-09-22T08:38:28.399 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.387+0000 7fd2a37ec640 1 -- 172.21.15.142:0/1483081697 <== osd.3 v2:172.21.15.142:6800/1064901393 9 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd29c00a4d0 con 0x5566c0fdfe30 2024-09-22T08:38:28.399 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.387+0000 7fd2a37ec640 1 -- 172.21.15.142:0/1483081697 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5566c0fe4340 con 0x7fd29408a070 2024-09-22T08:38:28.399 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.387+0000 7fd2a27ea640 1 -- 172.21.15.142:0/1483081697 <== osd.0 v2:172.21.15.31:6800/168281188 7 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd298029040 con 0x7fd29408a070 2024-09-22T08:38:28.399 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.387+0000 7fd2a27ea640 1 -- 172.21.15.142:0/1483081697 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5566c0fe4340 con 0x7fd29c017450 2024-09-22T08:38:28.399 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.388+0000 7fd2a2feb640 1 -- 172.21.15.142:0/1483081697 <== osd.2 v2:172.21.15.142:6808/279438927 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd294051070 con 0x7fd29c017450 2024-09-22T08:38:28.400 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.388+0000 7fd2a2feb640 1 -- 172.21.15.142:0/1483081697 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5566c0fe4340 con 0x5566c0fdfe30 2024-09-22T08:38:28.400 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.388+0000 7fd2a37ec640 1 -- 172.21.15.142:0/1483081697 <== osd.3 v2:172.21.15.142:6800/1064901393 10 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd29c00a4d0 con 0x5566c0fdfe30 2024-09-22T08:38:28.400 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.388+0000 7fd2a37ec640 1 -- 172.21.15.142:0/1483081697 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5566c0fe4340 con 0x7fd29408a070 2024-09-22T08:38:28.400 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.388+0000 7fd2a27ea640 1 -- 172.21.15.142:0/1483081697 <== osd.0 v2:172.21.15.31:6800/168281188 8 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd298029040 con 0x7fd29408a070 2024-09-22T08:38:28.400 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.388+0000 7fd2a27ea640 1 -- 172.21.15.142:0/1483081697 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5566c0fe4340 con 0x5566c0fdb5a0 2024-09-22T08:38:28.400 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.388+0000 7fd2a27ea640 1 -- 172.21.15.142:0/1483081697 <== osd.1 v2:172.21.15.142:6816/3192108003 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fd298029040 con 0x5566c0fdb5a0 2024-09-22T08:38:28.400 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.388+0000 7fd2a27ea640 1 -- 172.21.15.142:0/1483081697 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5566c0fe4340 con 0x7fd29c017450 2024-09-22T08:38:28.400 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.389+0000 7fd2a2feb640 1 -- 172.21.15.142:0/1483081697 <== osd.2 v2:172.21.15.142:6808/279438927 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd294051070 con 0x7fd29c017450 2024-09-22T08:38:28.400 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.389+0000 7fd2a781d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:38:28.400 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.389+0000 7fd2a781d800 20 RGWRados::pool_iterate: got zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec 2024-09-22T08:38:28.400 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.389+0000 7fd2a781d800 20 RGWRados::pool_iterate: got zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f 2024-09-22T08:38:28.400 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.389+0000 7fd2a781d800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:38:28.400 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.389+0000 7fd2a781d800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:38:28.400 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.389+0000 7fd2a781d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:38:28.401 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.389+0000 7fd2a781d800 20 rados->read ofs=0 len=0 2024-09-22T08:38:28.401 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.389+0000 7fd2a781d800 1 -- 172.21.15.142:0/1483081697 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5566c0fe3410 con 0x5566c0fdb5a0 2024-09-22T08:38:28.401 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.389+0000 7fd2a27ea640 1 -- 172.21.15.142:0/1483081697 <== osd.1 v2:172.21.15.142:6816/3192108003 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd298029040 con 0x5566c0fdb5a0 2024-09-22T08:38:28.402 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.389+0000 7fd2a781d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:28.402 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.389+0000 7fd2a781d800 20 rados->read ofs=0 len=0 2024-09-22T08:38:28.402 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.389+0000 7fd2a781d800 1 -- 172.21.15.142:0/1483081697 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5566c0fe3cb0 con 0x5566c0fdb5a0 2024-09-22T08:38:28.402 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.389+0000 7fd2a27ea640 1 -- 172.21.15.142:0/1483081697 <== osd.1 v2:172.21.15.142:6816/3192108003 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd298029040 con 0x5566c0fdb5a0 2024-09-22T08:38:28.402 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.389+0000 7fd2a781d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:38:28.402 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.389+0000 7fd2a781d800 20 rados->read ofs=0 len=0 2024-09-22T08:38:28.402 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.389+0000 7fd2a781d800 1 -- 172.21.15.142:0/1483081697 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:40 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5566c0fe3050 con 0x5566c0fdfe30 2024-09-22T08:38:28.402 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.390+0000 7fd2a37ec640 1 -- 172.21.15.142:0/1483081697 <== osd.3 v2:172.21.15.142:6800/1064901393 11 ==== osd_op_reply(40 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fd29c00a4d0 con 0x5566c0fdfe30 2024-09-22T08:38:28.403 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.390+0000 7fd2a781d800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:38:28.403 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.390+0000 7fd2a781d800 20 zone default found 2024-09-22T08:38:28.403 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.390+0000 7fd2a781d800 4 Realm: () 2024-09-22T08:38:28.403 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.390+0000 7fd2a781d800 4 ZoneGroup: default (d89f6f57-1007-47dd-9065-f486c7b01aec) 2024-09-22T08:38:28.403 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.390+0000 7fd2a781d800 4 Zone: default (e239248c-0bee-4e41-803a-24b288d3eb8f) 2024-09-22T08:38:28.403 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.390+0000 7fd2a781d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:38:28.403 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.390+0000 7fd2a781d800 20 zonegroup default 2024-09-22T08:38:28.403 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.390+0000 7fd2a781d800 20 rados->read ofs=0 len=0 2024-09-22T08:38:28.403 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.390+0000 7fd2a781d800 1 -- 172.21.15.142:0/1483081697 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5566c0fe38b0 con 0x7fd29408a070 2024-09-22T08:38:28.403 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.390+0000 7fd2a27ea640 1 -- 172.21.15.142:0/1483081697 <== osd.0 v2:172.21.15.31:6800/168281188 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fd298029040 con 0x7fd29408a070 2024-09-22T08:38:28.403 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.390+0000 7fd2a781d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:28.403 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.390+0000 7fd2a781d800 20 rados->read ofs=0 len=0 2024-09-22T08:38:28.403 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.390+0000 7fd2a781d800 1 -- 172.21.15.142:0/1483081697 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5566c0fe6bb0 con 0x5566c0fdfe30 2024-09-22T08:38:28.403 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.390+0000 7fd2a37ec640 1 -- 172.21.15.142:0/1483081697 <== osd.3 v2:172.21.15.142:6800/1064901393 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd29c00a4d0 con 0x5566c0fdfe30 2024-09-22T08:38:28.404 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.390+0000 7fd2a781d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:28.404 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.390+0000 7fd2a781d800 20 rados->read ofs=0 len=0 2024-09-22T08:38:28.404 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.390+0000 7fd2a781d800 1 -- 172.21.15.142:0/1483081697 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5566c0fe6f50 con 0x5566c0fdfe30 2024-09-22T08:38:28.404 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.390+0000 7fd2a37ec640 1 -- 172.21.15.142:0/1483081697 <== osd.3 v2:172.21.15.142:6800/1064901393 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd29c00a4d0 con 0x5566c0fdfe30 2024-09-22T08:38:28.404 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.390+0000 7fd2a781d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:28.404 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.390+0000 7fd2a781d800 20 started sync module instance, tier type = 2024-09-22T08:38:28.404 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.390+0000 7fd2a781d800 20 started zone id=e239248c-0bee-4e41-803a-24b288d3eb8f (name=default) with tier type = 2024-09-22T08:38:28.404 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.390+0000 7fd2a781d800 1 -- 172.21.15.142:0/1483081697 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5566c0fe6040 con 0x7fd29c017450 2024-09-22T08:38:28.409 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.391+0000 7fd2a2feb640 1 -- 172.21.15.142:0/1483081697 <== osd.2 v2:172.21.15.142:6808/279438927 7 ==== osd_op_reply(44 notify.0 [create] v32'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd294051070 con 0x7fd29c017450 2024-09-22T08:38:28.409 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.391+0000 7fd2a781d800 1 -- 172.21.15.142:0/1483081697 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93899812922464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5566c0fe7810 con 0x7fd29c017450 2024-09-22T08:38:28.409 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.392+0000 7fd2a781d800 1 -- 172.21.15.142:0/1483081697 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5566c0fe8060 con 0x5566c0fdb5a0 2024-09-22T08:38:28.409 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.392+0000 7fd2a2feb640 1 -- 172.21.15.142:0/1483081697 <== osd.2 v2:172.21.15.142:6808/279438927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93899812922464] v32'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd294051070 con 0x7fd29c017450 2024-09-22T08:38:28.409 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.393+0000 7fd2a27ea640 1 -- 172.21.15.142:0/1483081697 <== osd.1 v2:172.21.15.142:6816/3192108003 16 ==== osd_op_reply(46 notify.1 [create] v32'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd298029040 con 0x5566c0fdb5a0 2024-09-22T08:38:28.409 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.393+0000 7fd2a781d800 1 -- 172.21.15.142:0/1483081697 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93899812928432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5566c0fe8480 con 0x5566c0fdb5a0 2024-09-22T08:38:28.409 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.393+0000 7fd2a781d800 1 -- 172.21.15.142:0/1483081697 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5566c0fe8cd0 con 0x5566c0fdfe30 2024-09-22T08:38:28.409 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.394+0000 7fd2a27ea640 1 -- 172.21.15.142:0/1483081697 <== osd.1 v2:172.21.15.142:6816/3192108003 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93899812928432] v32'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd298029040 con 0x5566c0fdb5a0 2024-09-22T08:38:28.409 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.395+0000 7fd2a37ec640 1 -- 172.21.15.142:0/1483081697 <== osd.3 v2:172.21.15.142:6800/1064901393 14 ==== osd_op_reply(48 notify.2 [create] v32'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd29c00a4d0 con 0x5566c0fdfe30 2024-09-22T08:38:28.410 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.395+0000 7fd2a781d800 1 -- 172.21.15.142:0/1483081697 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93899812929968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5566c0fe8be0 con 0x5566c0fdfe30 2024-09-22T08:38:28.410 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.395+0000 7fd2a781d800 1 -- 172.21.15.142:0/1483081697 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5566c0fe9700 con 0x7fd29c017450 2024-09-22T08:38:28.410 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.396+0000 7fd2a37ec640 1 -- 172.21.15.142:0/1483081697 <== osd.3 v2:172.21.15.142:6800/1064901393 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 93899812929968] v32'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd29c00a4d0 con 0x5566c0fdfe30 2024-09-22T08:38:28.410 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.396+0000 7fd2a2feb640 1 -- 172.21.15.142:0/1483081697 <== osd.2 v2:172.21.15.142:6808/279438927 9 ==== osd_op_reply(50 notify.3 [create] v32'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd294051070 con 0x7fd29c017450 2024-09-22T08:38:28.410 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.396+0000 7fd2a781d800 1 -- 172.21.15.142:0/1483081697 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93899812934096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5566c0fe96c0 con 0x7fd29c017450 2024-09-22T08:38:28.410 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.396+0000 7fd2a781d800 1 -- 172.21.15.142:0/1483081697 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5566c0fea180 con 0x5566c0fdb5a0 2024-09-22T08:38:28.410 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.397+0000 7fd2a2feb640 1 -- 172.21.15.142:0/1483081697 <== osd.2 v2:172.21.15.142:6808/279438927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93899812934096] v32'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd294051070 con 0x7fd29c017450 2024-09-22T08:38:28.410 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.397+0000 7fd2a27ea640 1 -- 172.21.15.142:0/1483081697 <== osd.1 v2:172.21.15.142:6816/3192108003 18 ==== osd_op_reply(52 notify.4 [create] v32'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd298029040 con 0x5566c0fdb5a0 2024-09-22T08:38:28.410 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.397+0000 7fd2a781d800 1 -- 172.21.15.142:0/1483081697 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93899812936848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5566c0fea180 con 0x5566c0fdb5a0 2024-09-22T08:38:28.410 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.397+0000 7fd2a781d800 1 -- 172.21.15.142:0/1483081697 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5566c0feac30 con 0x7fd29408a070 2024-09-22T08:38:28.410 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.398+0000 7fd2a27ea640 1 -- 172.21.15.142:0/1483081697 <== osd.1 v2:172.21.15.142:6816/3192108003 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93899812936848] v32'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd298029040 con 0x5566c0fdb5a0 2024-09-22T08:38:28.410 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.398+0000 7fd2a27ea640 1 -- 172.21.15.142:0/1483081697 <== osd.0 v2:172.21.15.31:6800/168281188 10 ==== osd_op_reply(54 notify.5 [create] v32'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd298029040 con 0x7fd29408a070 2024-09-22T08:38:28.410 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.398+0000 7fd2a781d800 1 -- 172.21.15.142:0/1483081697 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93899812931120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5566c0feac30 con 0x7fd29408a070 2024-09-22T08:38:28.411 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.398+0000 7fd2a781d800 1 -- 172.21.15.142:0/1483081697 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5566c0feb680 con 0x7fd29408a070 2024-09-22T08:38:28.411 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.399+0000 7fd2a27ea640 1 -- 172.21.15.142:0/1483081697 <== osd.0 v2:172.21.15.31:6800/168281188 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 93899812931120] v32'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd298029040 con 0x7fd29408a070 2024-09-22T08:38:28.411 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.399+0000 7fd2a27ea640 1 -- 172.21.15.142:0/1483081697 <== osd.0 v2:172.21.15.31:6800/168281188 12 ==== osd_op_reply(56 notify.6 [create] v32'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd298029040 con 0x7fd29408a070 2024-09-22T08:38:28.411 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.399+0000 7fd2a781d800 1 -- 172.21.15.142:0/1483081697 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93899812939536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5566c0feb640 con 0x7fd29408a070 2024-09-22T08:38:28.411 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.399+0000 7fd2a781d800 1 -- 172.21.15.142:0/1483081697 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5566c0fec040 con 0x7fd29408a070 2024-09-22T08:38:28.411 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.401+0000 7fd2a27ea640 1 -- 172.21.15.142:0/1483081697 <== osd.0 v2:172.21.15.31:6800/168281188 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 93899812939536] v32'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd298029040 con 0x7fd29408a070 2024-09-22T08:38:28.411 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.401+0000 7fd2a27ea640 1 -- 172.21.15.142:0/1483081697 <== osd.0 v2:172.21.15.31:6800/168281188 14 ==== osd_op_reply(58 notify.7 [create] v32'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd298029040 con 0x7fd29408a070 2024-09-22T08:38:28.411 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.401+0000 7fd2a781d800 1 -- 172.21.15.142:0/1483081697 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93899812944720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5566c0fec220 con 0x7fd29408a070 2024-09-22T08:38:28.411 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.401+0000 7fd2a781d800 20 add_watcher() i=0 2024-09-22T08:38:28.411 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.401+0000 7fd2a781d800 20 add_watcher() i=1 2024-09-22T08:38:28.411 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.401+0000 7fd2a781d800 20 add_watcher() i=2 2024-09-22T08:38:28.411 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.401+0000 7fd2a781d800 20 add_watcher() i=3 2024-09-22T08:38:28.411 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.401+0000 7fd2a781d800 20 add_watcher() i=4 2024-09-22T08:38:28.412 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.401+0000 7fd2a781d800 20 add_watcher() i=5 2024-09-22T08:38:28.412 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.401+0000 7fd2a781d800 20 add_watcher() i=6 2024-09-22T08:38:28.412 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.402+0000 7fd2a27ea640 1 -- 172.21.15.142:0/1483081697 <== osd.0 v2:172.21.15.31:6800/168281188 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 93899812944720] v32'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd298029040 con 0x7fd29408a070 2024-09-22T08:38:28.412 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.402+0000 7fd2a781d800 20 add_watcher() i=7 2024-09-22T08:38:28.412 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.402+0000 7fd2a781d800 2 all 8 watchers are set, enabling cache 2024-09-22T08:38:28.412 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.402+0000 7fd2a781d800 1 -- 172.21.15.142:0/1483081697 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5566c0fef5f0 con 0x5566c0fdb5a0 2024-09-22T08:38:28.412 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.402+0000 7fd2a27ea640 1 -- 172.21.15.142:0/1483081697 <== osd.1 v2:172.21.15.142:6816/3192108003 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fd298029040 con 0x5566c0fdb5a0 2024-09-22T08:38:28.412 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.402+0000 7fd2a781d800 1 -- 172.21.15.142:0/1483081697 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93899812946192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5566c0fecac0 con 0x5566c0fdb5a0 2024-09-22T08:38:28.412 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.403+0000 7fd2a27ea640 1 -- 172.21.15.142:0/1483081697 <== osd.1 v2:172.21.15.142:6816/3192108003 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93899812946192] v32'231 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd298029040 con 0x5566c0fdb5a0 2024-09-22T08:38:28.412 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.403+0000 7fd1597e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:38:28.412 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.404+0000 7fd2a781d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:38:28.412 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.404+0000 7fd2a781d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:38:28.412 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.404+0000 7fd2a781d800 5 note: GC not initialized 2024-09-22T08:38:28.412 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.404+0000 7fd0d3fff640 20 reqs_thread_entry: start 2024-09-22T08:38:28.412 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.404+0000 7fd2a781d800 20 init_complete bucket index max shards: 11 2024-09-22T08:38:28.413 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.404+0000 7fd2a781d800 20 Filter name: none 2024-09-22T08:38:28.413 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.404+0000 7fd0d1ffb640 20 reqs_thread_entry: start 2024-09-22T08:38:28.413 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.404+0000 7fd2a781d800 20 rados->read ofs=0 len=0 2024-09-22T08:38:28.413 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.404+0000 7fd2a781d800 1 -- 172.21.15.142:0/1483081697 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5566c1022470 con 0x5566c0fdb5a0 2024-09-22T08:38:28.413 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.404+0000 7fd2a27ea640 1 -- 172.21.15.142:0/1483081697 <== osd.1 v2:172.21.15.142:6816/3192108003 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fd298029040 con 0x5566c0fdb5a0 2024-09-22T08:38:28.413 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.404+0000 7fd2a781d800 20 rados_obj.operate() r=0 bl.length=391 2024-09-22T08:38:28.413 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.404+0000 7fd2a781d800 1 -- 172.21.15.142:0/1483081697 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5566c10239f0 con 0x7fd29408a070 2024-09-22T08:38:28.413 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.405+0000 7fd2a27ea640 1 -- 172.21.15.142:0/1483081697 <== osd.0 v2:172.21.15.31:6800/168281188 16 ==== osd_op_reply(63 usage.10 [call out=15b] v0'0 uv32 ondisk = 0) ==== 152+0+15 (crc 0 0 0) 0x7fd298029040 con 0x7fd29408a070 2024-09-22T08:38:28.413 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.406+0000 7fd1597e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:38:28.413 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.406+0000 7fd2a781d800 1 -- 172.21.15.142:0/1483081697 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93899812946192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5566c0fee250 con 0x5566c0fdb5a0 2024-09-22T08:38:28.413 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.407+0000 7fd2a27ea640 1 -- 172.21.15.142:0/1483081697 <== osd.1 v2:172.21.15.142:6816/3192108003 23 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 93899812946192] v32'232 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd298029040 con 0x5566c0fdb5a0 2024-09-22T08:38:28.413 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.407+0000 7fd2a781d800 1 -- 172.21.15.142:0/1483081697 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93899812922464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5566c0fec110 con 0x7fd29c017450 2024-09-22T08:38:28.415 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.408+0000 7fd2a2feb640 1 -- 172.21.15.142:0/1483081697 <== osd.2 v2:172.21.15.142:6808/279438927 11 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 93899812922464] v32'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd294051070 con 0x7fd29c017450 2024-09-22T08:38:28.415 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.408+0000 7fd2a781d800 20 remove_watcher() i=0 2024-09-22T08:38:28.415 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.408+0000 7fd2a781d800 2 removed watcher, disabling cache 2024-09-22T08:38:28.415 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.408+0000 7fd2a781d800 1 -- 172.21.15.142:0/1483081697 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93899812928432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5566c0fe6460 con 0x5566c0fdb5a0 2024-09-22T08:38:28.415 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.409+0000 7fd2a27ea640 1 -- 172.21.15.142:0/1483081697 <== osd.1 v2:172.21.15.142:6816/3192108003 24 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 93899812928432] v32'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd298029040 con 0x5566c0fdb5a0 2024-09-22T08:38:28.415 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.409+0000 7fd2a781d800 20 remove_watcher() i=1 2024-09-22T08:38:28.415 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.409+0000 7fd2a781d800 1 -- 172.21.15.142:0/1483081697 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93899812929968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5566c0fe6460 con 0x5566c0fdfe30 2024-09-22T08:38:28.415 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.410+0000 7fd2a37ec640 1 -- 172.21.15.142:0/1483081697 <== osd.3 v2:172.21.15.142:6800/1064901393 16 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 93899812929968] v32'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd29c00a4d0 con 0x5566c0fdfe30 2024-09-22T08:38:28.416 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.410+0000 7fd2a781d800 20 remove_watcher() i=2 2024-09-22T08:38:28.416 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.410+0000 7fd2a781d800 1 -- 172.21.15.142:0/1483081697 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93899812934096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5566c0fe81b0 con 0x7fd29c017450 2024-09-22T08:38:28.416 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.412+0000 7fd2a2feb640 1 -- 172.21.15.142:0/1483081697 <== osd.2 v2:172.21.15.142:6808/279438927 12 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 93899812934096] v32'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd294051070 con 0x7fd29c017450 2024-09-22T08:38:28.416 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.412+0000 7fd2a781d800 20 remove_watcher() i=3 2024-09-22T08:38:28.416 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.412+0000 7fd2a781d800 1 -- 172.21.15.142:0/1483081697 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93899812936848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5566c0fe6460 con 0x5566c0fdb5a0 2024-09-22T08:38:28.416 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.413+0000 7fd2a27ea640 1 -- 172.21.15.142:0/1483081697 <== osd.1 v2:172.21.15.142:6816/3192108003 25 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 93899812936848] v32'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd298029040 con 0x5566c0fdb5a0 2024-09-22T08:38:28.416 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.413+0000 7fd2a781d800 20 remove_watcher() i=4 2024-09-22T08:38:28.416 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.413+0000 7fd2a781d800 1 -- 172.21.15.142:0/1483081697 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93899812931120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5566c0fe81b0 con 0x7fd29408a070 2024-09-22T08:38:28.417 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.414+0000 7fd2a27ea640 1 -- 172.21.15.142:0/1483081697 <== osd.0 v2:172.21.15.31:6800/168281188 17 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 93899812931120] v32'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd298029040 con 0x7fd29408a070 2024-09-22T08:38:28.417 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.414+0000 7fd2a781d800 20 remove_watcher() i=5 2024-09-22T08:38:28.417 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.414+0000 7fd2a781d800 1 -- 172.21.15.142:0/1483081697 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93899812939536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5566c0fe6460 con 0x7fd29408a070 2024-09-22T08:38:28.417 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.415+0000 7fd2a27ea640 1 -- 172.21.15.142:0/1483081697 <== osd.0 v2:172.21.15.31:6800/168281188 18 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 93899812939536] v32'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd298029040 con 0x7fd29408a070 2024-09-22T08:38:28.417 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.415+0000 7fd2a781d800 20 remove_watcher() i=6 2024-09-22T08:38:28.417 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.415+0000 7fd2a781d800 1 -- 172.21.15.142:0/1483081697 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93899812944720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5566c0fe81b0 con 0x7fd29408a070 2024-09-22T08:38:28.420 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.416+0000 7fd2a27ea640 1 -- 172.21.15.142:0/1483081697 <== osd.0 v2:172.21.15.31:6800/168281188 19 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 93899812944720] v32'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd298029040 con 0x7fd29408a070 2024-09-22T08:38:28.420 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.416+0000 7fd2a781d800 20 remove_watcher() i=7 2024-09-22T08:38:28.420 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.416+0000 7fd2a781d800 1 -- 172.21.15.142:0/1483081697 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7fd29408a070 msgr2=0x7fd29405f420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:28.420 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.416+0000 7fd2a781d800 1 --2- 172.21.15.142:0/1483081697 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7fd29408a070 0x7fd29405f420 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:28.420 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.416+0000 7fd2a781d800 1 -- 172.21.15.142:0/1483081697 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5566c0fdb5a0 msgr2=0x5566c0fdda10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:28.420 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.416+0000 7fd2a781d800 1 --2- 172.21.15.142:0/1483081697 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5566c0fdb5a0 0x5566c0fdda10 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:28.420 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.416+0000 7fd2a781d800 1 -- 172.21.15.142:0/1483081697 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7fd29c017450 msgr2=0x7fd29c051020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:28.420 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.416+0000 7fd2a781d800 1 --2- 172.21.15.142:0/1483081697 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7fd29c017450 0x7fd29c051020 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:28.420 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.416+0000 7fd2a781d800 1 -- 172.21.15.142:0/1483081697 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5566c0fdfe30 msgr2=0x5566c0fe2220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:28.420 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.416+0000 7fd2a781d800 1 --2- 172.21.15.142:0/1483081697 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5566c0fdfe30 0x5566c0fe2220 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:28.421 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.416+0000 7fd2a781d800 1 -- 172.21.15.142:0/1483081697 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fd16c03cfb0 msgr2=0x7fd16c03f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:28.421 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.416+0000 7fd2a781d800 1 --2- 172.21.15.142:0/1483081697 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fd16c03cfb0 0x7fd16c03f470 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fd294098010 tx=0x7fd294088000 comp rx=0 tx=0).stop 2024-09-22T08:38:28.421 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.416+0000 7fd2a781d800 1 -- 172.21.15.142:0/1483081697 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5566c0f96d30 msgr2=0x5566c0fcfd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:28.421 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.416+0000 7fd2a781d800 1 --2- 172.21.15.142:0/1483081697 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5566c0f96d30 0x5566c0fcfd00 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fd29c020930 tx=0x7fd29c0547c0 comp rx=0 tx=0).stop 2024-09-22T08:38:28.421 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.416+0000 7fd2a27ea640 1 -- 172.21.15.142:0/1483081697 reap_dead start 2024-09-22T08:38:28.421 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.416+0000 7fd2a781d800 1 -- 172.21.15.142:0/1483081697 shutdown_connections 2024-09-22T08:38:28.421 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.416+0000 7fd2a781d800 1 --2- 172.21.15.142:0/1483081697 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5566c0f96d30 0x5566c0fcfd00 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:28.421 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.416+0000 7fd2a781d800 1 -- 172.21.15.142:0/1483081697 >> 172.21.15.142:0/1483081697 conn(0x5566c0fc28a0 msgr2=0x5566c0fc0ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:38:28.421 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.416+0000 7fd2a781d800 1 -- 172.21.15.142:0/1483081697 shutdown_connections 2024-09-22T08:38:28.421 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.416+0000 7fd2a781d800 1 -- 172.21.15.142:0/1483081697 wait complete. 2024-09-22T08:38:28.421 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.416+0000 7fd2a781d800 1 -- 172.21.15.142:0/467515906 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fd17c03d070 msgr2=0x7fd17c03f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:28.421 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.416+0000 7fd2a781d800 1 --2- 172.21.15.142:0/467515906 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fd17c03d070 0x7fd17c03f530 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fd29406c000 tx=0x7fd29407cf90 comp rx=0 tx=0).stop 2024-09-22T08:38:28.421 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.416+0000 7fd2a781d800 1 -- 172.21.15.142:0/467515906 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5566c0fb9a20 msgr2=0x5566c0fb9e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:28.421 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.416+0000 7fd2a781d800 1 --2- 172.21.15.142:0/467515906 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5566c0fb9a20 0x5566c0fb9e40 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x5566c0f9fa50 tx=0x7fd29c0167b0 comp rx=0 tx=0).stop 2024-09-22T08:38:28.421 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.416+0000 7fd2a781d800 1 -- 172.21.15.142:0/467515906 shutdown_connections 2024-09-22T08:38:28.422 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.416+0000 7fd2a781d800 1 --2- 172.21.15.142:0/467515906 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fd17c03d070 0x7fd17c03f530 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:28.422 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.416+0000 7fd2a781d800 1 --2- 172.21.15.142:0/467515906 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5566c0fb9a20 0x5566c0fb9e40 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:28.422 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.416+0000 7fd2a781d800 1 -- 172.21.15.142:0/467515906 >> 172.21.15.142:0/467515906 conn(0x5566c0faddd0 msgr2=0x5566c0fae1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:38:28.422 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.417+0000 7fd2a781d800 1 -- 172.21.15.142:0/467515906 shutdown_connections 2024-09-22T08:38:28.422 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.417+0000 7fd2a781d800 1 -- 172.21.15.142:0/467515906 wait complete. 2024-09-22T08:38:28.422 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.417+0000 7fd2a781d800 1 -- 172.21.15.142:0/192194255 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5566c0ea9700 msgr2=0x5566c0fa60a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:28.422 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.417+0000 7fd2a781d800 1 --2- 172.21.15.142:0/192194255 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5566c0ea9700 0x5566c0fa60a0 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:28.422 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.417+0000 7fd2a781d800 1 -- 172.21.15.142:0/192194255 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5566c0fa8480 msgr2=0x5566c0faa900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:28.422 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.417+0000 7fd2a781d800 1 --2- 172.21.15.142:0/192194255 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5566c0fa8480 0x5566c0faa900 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:28.422 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.417+0000 7fd2a781d800 1 -- 172.21.15.142:0/192194255 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fd18803d000 msgr2=0x7fd18803f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:28.422 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.417+0000 7fd2a781d800 1 --2- 172.21.15.142:0/192194255 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fd18803d000 0x7fd18803f4c0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fd298001d70 tx=0x7fd2980012d0 comp rx=0 tx=0).stop 2024-09-22T08:38:28.422 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.417+0000 7fd2a781d800 1 -- 172.21.15.142:0/192194255 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5566c0ea6da0 msgr2=0x5566c0f9ea50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:28.422 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.417+0000 7fd2a781d800 1 --2- 172.21.15.142:0/192194255 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5566c0ea6da0 0x5566c0f9ea50 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fd294025c20 tx=0x7fd294002fb0 comp rx=0 tx=0).stop 2024-09-22T08:38:28.422 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.417+0000 7fd2a781d800 1 -- 172.21.15.142:0/192194255 shutdown_connections 2024-09-22T08:38:28.423 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.417+0000 7fd2a781d800 1 --2- 172.21.15.142:0/192194255 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5566c0fa8480 0x5566c0faa900 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:28.423 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.417+0000 7fd2a781d800 1 --2- 172.21.15.142:0/192194255 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5566c0ea9700 0x5566c0fa60a0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:28.423 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.417+0000 7fd2a781d800 1 --2- 172.21.15.142:0/192194255 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fd18803d000 0x7fd18803f4c0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:28.423 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.417+0000 7fd2a781d800 1 --2- 172.21.15.142:0/192194255 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5566c0ea6da0 0x5566c0f9ea50 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:28.423 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.417+0000 7fd2a781d800 1 -- 172.21.15.142:0/192194255 >> 172.21.15.142:0/192194255 conn(0x5566c0ea1310 msgr2=0x5566c0f900c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:38:28.423 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.417+0000 7fd2a781d800 1 -- 172.21.15.142:0/192194255 shutdown_connections 2024-09-22T08:38:28.423 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.417+0000 7fd2a781d800 1 -- 172.21.15.142:0/192194255 wait complete. 2024-09-22T08:38:28.427 INFO:teuthology.orchestra.run.smithi142.stdout:{"entries":[],"summary":[]} 2024-09-22T08:38:28.428 DEBUG:tasks.util.rgw: json result: {'entries': [], 'summary': []} 2024-09-22T08:38:28.428 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo', '--purge-data'] 2024-09-22T08:38:28.428 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo', '--purge-data'] 2024-09-22T08:38:28.428 DEBUG:teuthology.orchestra.run.smithi142:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo --purge-data 2024-09-22T08:38:28.473 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:38:28.473 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:38:28.475 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.472+0000 7f520c698800 1 Processor -- start 2024-09-22T08:38:28.475 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.472+0000 7f520c698800 1 -- start start 2024-09-22T08:38:28.475 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.472+0000 7f520c698800 1 --2- >> v2:172.21.15.31:3300/0 conn(0x56171af0afe0 0x56171af12f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:28.475 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.472+0000 7f520c698800 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56171ad97a20 con 0x56171af0abe0 2024-09-22T08:38:28.475 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.472+0000 7f520c698800 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x56171ad977d0 con 0x56171af0afe0 2024-09-22T08:38:28.475 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.472+0000 7f5203fff640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x56171af0afe0 0x56171af12f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:28.475 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.472+0000 7f520a189640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x56171af0abe0 0x56171af0f850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.142:50398/0 (socket says 172.21.15.142:50398) 2024-09-22T08:38:28.475 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.472+0000 7f520a189640 1 -- 172.21.15.142:0/2120903086 learned_addr learned my addr 172.21.15.142:0/2120903086 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-09-22T08:38:28.475 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.472+0000 7f5203fff640 1 -- 172.21.15.142:0/2120903086 >> v1:172.21.15.31:6789/0 conn(0x56171af0abe0 legacy=0x56171af0f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:28.475 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.472+0000 7f5203fff640 1 -- 172.21.15.142:0/2120903086 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56171af14590 con 0x56171af0afe0 2024-09-22T08:38:28.477 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.474+0000 7f5203fff640 1 --2- 172.21.15.142:0/2120903086 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56171af0afe0 0x56171af12f80 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f51f400a470 tx=0x7f51f4045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=834d13d2e56ec492 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:28.477 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.474+0000 7f5209988640 1 -- 172.21.15.142:0/2120903086 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f51f4053570 con 0x56171af0afe0 2024-09-22T08:38:28.477 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.475+0000 7f5209988640 1 -- 172.21.15.142:0/2120903086 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51f4058070 con 0x56171af0afe0 2024-09-22T08:38:28.477 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.475+0000 7f5209988640 1 -- 172.21.15.142:0/2120903086 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f51f4053880 con 0x56171af0afe0 2024-09-22T08:38:28.477 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.475+0000 7f520c698800 1 -- 172.21.15.142:0/2120903086 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56171af0afe0 msgr2=0x56171af12f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:28.478 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.475+0000 7f520c698800 1 --2- 172.21.15.142:0/2120903086 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56171af0afe0 0x56171af12f80 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f51f400a470 tx=0x7f51f4045a20 comp rx=0 tx=0).stop 2024-09-22T08:38:28.478 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.475+0000 7f520c698800 1 -- 172.21.15.142:0/2120903086 shutdown_connections 2024-09-22T08:38:28.478 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.475+0000 7f520c698800 1 --2- 172.21.15.142:0/2120903086 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56171af0afe0 0x56171af12f80 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:28.478 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.475+0000 7f520c698800 1 -- 172.21.15.142:0/2120903086 >> 172.21.15.142:0/2120903086 conn(0x56171af06310 msgr2=0x56171af08790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:38:28.478 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.475+0000 7f520c698800 1 -- 172.21.15.142:0/2120903086 shutdown_connections 2024-09-22T08:38:28.478 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.475+0000 7f520c698800 1 -- 172.21.15.142:0/2120903086 wait complete. 2024-09-22T08:38:28.492 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.488+0000 7f520c698800 1 Processor -- start 2024-09-22T08:38:28.492 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.489+0000 7f520c698800 1 -- start start 2024-09-22T08:38:28.492 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.489+0000 7f520c698800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56171af0abe0 0x56171affc020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:28.492 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.489+0000 7f520c698800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x56171ada4dd0 con 0x56171af0abe0 2024-09-22T08:38:28.492 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.489+0000 7f520a189640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56171af0abe0 0x56171affc020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:28.492 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.489+0000 7f520a189640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56171af0abe0 0x56171affc020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:51184/0 (socket says 172.21.15.142:51184) 2024-09-22T08:38:28.492 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.489+0000 7f520a189640 1 -- 172.21.15.142:0/2807599576 learned_addr learned my addr 172.21.15.142:0/2807599576 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:38:28.492 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.489+0000 7f520a189640 1 -- 172.21.15.142:0/2807599576 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56171affc610 con 0x56171af0abe0 2024-09-22T08:38:28.492 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.490+0000 7f520a189640 1 --2- 172.21.15.142:0/2807599576 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56171af0abe0 0x56171affc020 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f51fc001e40 tx=0x7f51fc001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=915436081a3bd8 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:28.493 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.490+0000 7f50f8608640 1 -- 172.21.15.142:0/2807599576 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f51fc012020 con 0x56171af0abe0 2024-09-22T08:38:28.493 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.490+0000 7f50f8608640 1 -- 172.21.15.142:0/2807599576 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51fc00e5a0 con 0x56171af0abe0 2024-09-22T08:38:28.493 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.490+0000 7f50f8608640 1 -- 172.21.15.142:0/2807599576 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f51fc00e8a0 con 0x56171af0abe0 2024-09-22T08:38:28.494 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.491+0000 7f520c698800 1 -- 172.21.15.142:0/2807599576 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56171af0abe0 msgr2=0x56171affc020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:28.495 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.491+0000 7f520c698800 1 --2- 172.21.15.142:0/2807599576 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56171af0abe0 0x56171affc020 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f51fc001e40 tx=0x7f51fc001e70 comp rx=0 tx=0).stop 2024-09-22T08:38:28.495 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.491+0000 7f520c698800 1 -- 172.21.15.142:0/2807599576 shutdown_connections 2024-09-22T08:38:28.495 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.491+0000 7f520c698800 1 --2- 172.21.15.142:0/2807599576 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56171af0abe0 0x56171affc020 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:28.495 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.491+0000 7f520c698800 1 -- 172.21.15.142:0/2807599576 >> 172.21.15.142:0/2807599576 conn(0x56171af06310 msgr2=0x56171aff79a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:38:28.495 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.491+0000 7f520c698800 1 -- 172.21.15.142:0/2807599576 shutdown_connections 2024-09-22T08:38:28.495 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.491+0000 7f520c698800 1 -- 172.21.15.142:0/2807599576 wait complete. 2024-09-22T08:38:28.496 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.491+0000 7f520c698800 1 Processor -- start 2024-09-22T08:38:28.496 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.491+0000 7f520c698800 1 -- start start 2024-09-22T08:38:28.496 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.491+0000 7f520c698800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56171af0abe0 0x56171b003b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:28.496 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.491+0000 7f520c698800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x56171af13850 con 0x56171af0abe0 2024-09-22T08:38:28.496 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.491+0000 7f520a189640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56171af0abe0 0x56171b003b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:28.496 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.491+0000 7f520a189640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56171af0abe0 0x56171b003b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:51200/0 (socket says 172.21.15.142:51200) 2024-09-22T08:38:28.496 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.491+0000 7f520a189640 1 -- 172.21.15.142:0/1518073448 learned_addr learned my addr 172.21.15.142:0/1518073448 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:38:28.496 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.492+0000 7f520a189640 1 -- 172.21.15.142:0/1518073448 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56171b0040f0 con 0x56171af0abe0 2024-09-22T08:38:28.496 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.492+0000 7f520a189640 1 --2- 172.21.15.142:0/1518073448 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56171af0abe0 0x56171b003b90 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f51fc00c010 tx=0x7f51fc000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:28.496 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.492+0000 7f50f6e05640 1 -- 172.21.15.142:0/1518073448 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f51fc012030 con 0x56171af0abe0 2024-09-22T08:38:28.496 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.492+0000 7f50f6e05640 1 -- 172.21.15.142:0/1518073448 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51fc0014a0 con 0x56171af0abe0 2024-09-22T08:38:28.496 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.492+0000 7f520c698800 1 -- 172.21.15.142:0/1518073448 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56171b004380 con 0x56171af0abe0 2024-09-22T08:38:28.496 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.492+0000 7f50f6e05640 1 -- 172.21.15.142:0/1518073448 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f51fc01a7a0 con 0x56171af0abe0 2024-09-22T08:38:28.496 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.492+0000 7f520c698800 1 -- 172.21.15.142:0/1518073448 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56171b004d80 con 0x56171af0abe0 2024-09-22T08:38:28.500 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.493+0000 7f50f6e05640 1 -- 172.21.15.142:0/1518073448 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f51fc015020 con 0x56171af0abe0 2024-09-22T08:38:28.500 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.493+0000 7f50f6e05640 1 --2- 172.21.15.142:0/1518073448 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f50f003cfb0 0x7f50f003f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:28.500 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.493+0000 7f50f6e05640 1 -- 172.21.15.142:0/1518073448 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5938+0+0 (secure 0 0 0) 0x7f51fc020030 con 0x56171af0abe0 2024-09-22T08:38:28.500 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.493+0000 7f5203fff640 1 --2- 172.21.15.142:0/1518073448 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f50f003cfb0 0x7f50f003f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:28.500 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.493+0000 7f520c698800 1 --2- 172.21.15.142:0/1518073448 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x56171af0afe0 0x56171b00b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:28.500 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.493+0000 7f520c698800 1 -- 172.21.15.142:0/1518073448 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56171b00b720 con 0x56171af0afe0 2024-09-22T08:38:28.500 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.493+0000 7f520a98a640 1 --2- 172.21.15.142:0/1518073448 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x56171af0afe0 0x56171b00b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:28.500 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.494+0000 7f5203fff640 1 --2- 172.21.15.142:0/1518073448 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f50f003cfb0 0x7f50f003f470 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f51f4057000 tx=0x7f51f4052000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:28.500 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.494+0000 7f520a98a640 1 --2- 172.21.15.142:0/1518073448 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x56171af0afe0 0x56171b00b1e0 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:28.500 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.494+0000 7f520a98a640 1 -- 172.21.15.142:0/1518073448 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f520400a4d0 con 0x56171af0afe0 2024-09-22T08:38:28.500 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.494+0000 7f520c698800 1 -- 172.21.15.142:0/1518073448 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56171b00bac0 con 0x56171af0afe0 2024-09-22T08:38:28.500 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.494+0000 7f520a98a640 1 -- 172.21.15.142:0/1518073448 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f520400a4d0 con 0x56171af0afe0 2024-09-22T08:38:28.500 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.494+0000 7f520c698800 1 --2- 172.21.15.142:0/1518073448 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x56171b00d580 0x56171b00fa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:28.501 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.494+0000 7f520c698800 1 -- 172.21.15.142:0/1518073448 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:3 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56171b0101b0 con 0x56171b00d580 2024-09-22T08:38:28.501 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.495+0000 7f520a189640 1 --2- 172.21.15.142:0/1518073448 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x56171b00d580 0x56171b00fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:28.501 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.495+0000 7f520a189640 1 --2- 172.21.15.142:0/1518073448 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x56171b00d580 0x56171b00fa20 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:28.501 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.495+0000 7f520a189640 1 -- 172.21.15.142:0/1518073448 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(3 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f51fc01ab20 con 0x56171b00d580 2024-09-22T08:38:28.501 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.495+0000 7f520c698800 1 -- 172.21.15.142:0/1518073448 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56171b00c310 con 0x56171af0afe0 2024-09-22T08:38:28.501 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.495+0000 7f520a98a640 1 -- 172.21.15.142:0/1518073448 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f520400a4d0 con 0x56171af0afe0 2024-09-22T08:38:28.501 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.495+0000 7f520c698800 1 -- 172.21.15.142:0/1518073448 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56171b00c6f0 con 0x56171b00d580 2024-09-22T08:38:28.501 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.496+0000 7f520a189640 1 -- 172.21.15.142:0/1518073448 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(5 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f51fc01ab20 con 0x56171b00d580 2024-09-22T08:38:28.501 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.496+0000 7f520c698800 1 Processor -- start 2024-09-22T08:38:28.501 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.496+0000 7f520c698800 1 -- start start 2024-09-22T08:38:28.501 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.496+0000 7f520c698800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56171b01eb80 0x56171b01efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:28.501 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.496+0000 7f520c698800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x56171ae03d50 con 0x56171b01eb80 2024-09-22T08:38:28.501 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.496+0000 7f520a98a640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56171b01eb80 0x56171b01efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:28.501 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.496+0000 7f520a98a640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56171b01eb80 0x56171b01efa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:51206/0 (socket says 172.21.15.142:51206) 2024-09-22T08:38:28.502 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.496+0000 7f520a98a640 1 -- 172.21.15.142:0/2701820240 learned_addr learned my addr 172.21.15.142:0/2701820240 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:38:28.502 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.497+0000 7f520a98a640 1 -- 172.21.15.142:0/2701820240 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56171b01f5e0 con 0x56171b01eb80 2024-09-22T08:38:28.502 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.497+0000 7f520a98a640 1 --2- 172.21.15.142:0/2701820240 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56171b01eb80 0x56171b01efa0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x56171b004a20 tx=0x7f52040167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:28.502 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.497+0000 7f50effff640 1 -- 172.21.15.142:0/2701820240 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5204013640 con 0x56171b01eb80 2024-09-22T08:38:28.502 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.497+0000 7f50effff640 1 -- 172.21.15.142:0/2701820240 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52040137e0 con 0x56171b01eb80 2024-09-22T08:38:28.502 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.497+0000 7f50effff640 1 -- 172.21.15.142:0/2701820240 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5204013b00 con 0x56171b01eb80 2024-09-22T08:38:28.502 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.497+0000 7f520c698800 1 -- 172.21.15.142:0/2701820240 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56171b01fe10 con 0x56171b01eb80 2024-09-22T08:38:28.502 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.497+0000 7f520c698800 1 -- 172.21.15.142:0/2701820240 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56171b0203b0 con 0x56171b01eb80 2024-09-22T08:38:28.511 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.498+0000 7f50effff640 1 -- 172.21.15.142:0/2701820240 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f5204011040 con 0x56171b01eb80 2024-09-22T08:38:28.511 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.498+0000 7f50effff640 1 --2- 172.21.15.142:0/2701820240 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f50e403d000 0x7f50e403f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:28.511 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.498+0000 7f50effff640 1 -- 172.21.15.142:0/2701820240 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5938+0+0 (secure 0 0 0) 0x7f520400e040 con 0x56171b01eb80 2024-09-22T08:38:28.511 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.498+0000 7f520a189640 1 --2- 172.21.15.142:0/2701820240 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f50e403d000 0x7f50e403f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:28.511 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.499+0000 7f520c698800 1 Processor -- start 2024-09-22T08:38:28.511 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.499+0000 7f520a189640 1 --2- 172.21.15.142:0/2701820240 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f50e403d000 0x7f50e403f4c0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x56171b005c90 tx=0x7f51fc0529c0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:28.511 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.499+0000 7f520c698800 1 -- start start 2024-09-22T08:38:28.511 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.499+0000 7f520c698800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56171af0b840 0x56171af0bc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:28.511 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.499+0000 7f520c698800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x56171affca40 con 0x56171af0b840 2024-09-22T08:38:28.512 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.499+0000 7f520a98a640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56171af0b840 0x56171af0bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:28.512 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.499+0000 7f520a98a640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56171af0b840 0x56171af0bc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:51212/0 (socket says 172.21.15.142:51212) 2024-09-22T08:38:28.512 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.499+0000 7f520a98a640 1 -- 172.21.15.142:0/1618859125 learned_addr learned my addr 172.21.15.142:0/1618859125 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:38:28.512 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.499+0000 7f520a98a640 1 -- 172.21.15.142:0/1618859125 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56171af0c230 con 0x56171af0b840 2024-09-22T08:38:28.512 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.499+0000 7f520a98a640 1 --2- 172.21.15.142:0/1618859125 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56171af0b840 0x56171af0bc40 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f520400afe0 tx=0x7f5204020f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=329f70e938ded739 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:28.512 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.500+0000 7f50edffb640 1 -- 172.21.15.142:0/1618859125 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f520402aa40 con 0x56171af0b840 2024-09-22T08:38:28.512 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.500+0000 7f50edffb640 1 -- 172.21.15.142:0/1618859125 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f520404de50 con 0x56171af0b840 2024-09-22T08:38:28.512 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.500+0000 7f50edffb640 1 -- 172.21.15.142:0/1618859125 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5204013dd0 con 0x56171af0b840 2024-09-22T08:38:28.512 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.500+0000 7f520c698800 1 -- 172.21.15.142:0/1618859125 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56171af0b840 msgr2=0x56171af0bc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:28.512 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.500+0000 7f520c698800 1 --2- 172.21.15.142:0/1618859125 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56171af0b840 0x56171af0bc40 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f520400afe0 tx=0x7f5204020f00 comp rx=0 tx=0).stop 2024-09-22T08:38:28.512 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.500+0000 7f520c698800 1 -- 172.21.15.142:0/1618859125 shutdown_connections 2024-09-22T08:38:28.512 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.500+0000 7f520c698800 1 --2- 172.21.15.142:0/1618859125 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56171af0b840 0x56171af0bc40 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:28.512 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.500+0000 7f520c698800 1 -- 172.21.15.142:0/1618859125 >> 172.21.15.142:0/1618859125 conn(0x56171b027a00 msgr2=0x56171b025c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:38:28.513 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.500+0000 7f520c698800 1 -- 172.21.15.142:0/1618859125 shutdown_connections 2024-09-22T08:38:28.513 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.500+0000 7f520c698800 1 -- 172.21.15.142:0/1618859125 wait complete. 2024-09-22T08:38:28.513 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.500+0000 7f520c698800 1 Processor -- start 2024-09-22T08:38:28.513 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.501+0000 7f520c698800 1 -- start start 2024-09-22T08:38:28.513 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.501+0000 7f520c698800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56171af0b840 0x56171b034dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:28.513 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.501+0000 7f520c698800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x56171af0c8a0 con 0x56171af0b840 2024-09-22T08:38:28.513 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.501+0000 7f520a98a640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56171af0b840 0x56171b034dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:28.513 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.501+0000 7f520a98a640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56171af0b840 0x56171b034dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:51228/0 (socket says 172.21.15.142:51228) 2024-09-22T08:38:28.513 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.501+0000 7f520a98a640 1 -- 172.21.15.142:0/702206129 learned_addr learned my addr 172.21.15.142:0/702206129 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:38:28.513 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.501+0000 7f520a98a640 1 -- 172.21.15.142:0/702206129 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56171b035320 con 0x56171af0b840 2024-09-22T08:38:28.513 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.501+0000 7f520a98a640 1 --2- 172.21.15.142:0/702206129 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56171af0b840 0x56171b034dc0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f520400afe0 tx=0x7f52040547b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:28.513 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.501+0000 7f50dbfff640 1 -- 172.21.15.142:0/702206129 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f52040532b0 con 0x56171af0b840 2024-09-22T08:38:28.513 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.501+0000 7f50dbfff640 1 -- 172.21.15.142:0/702206129 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5204053450 con 0x56171af0b840 2024-09-22T08:38:28.514 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.501+0000 7f50dbfff640 1 -- 172.21.15.142:0/702206129 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f520402a520 con 0x56171af0b840 2024-09-22T08:38:28.514 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.501+0000 7f520c698800 1 -- 172.21.15.142:0/702206129 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56171b0355b0 con 0x56171af0b840 2024-09-22T08:38:28.514 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.502+0000 7f520c698800 1 -- 172.21.15.142:0/702206129 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56171b035f30 con 0x56171af0b840 2024-09-22T08:38:28.514 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.502+0000 7f50dbfff640 1 -- 172.21.15.142:0/702206129 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f52040451d0 con 0x56171af0b840 2024-09-22T08:38:28.514 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.503+0000 7f50dbfff640 1 --2- 172.21.15.142:0/702206129 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f50d403d000 0x7f50d403f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:28.514 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.503+0000 7f50dbfff640 1 -- 172.21.15.142:0/702206129 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5938+0+0 (secure 0 0 0) 0x7f5204004aa0 con 0x56171af0b840 2024-09-22T08:38:28.514 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.503+0000 7f520a189640 1 --2- 172.21.15.142:0/702206129 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f50d403d000 0x7f50d403f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:28.514 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.503+0000 7f520c698800 20 rados->read ofs=0 len=0 2024-09-22T08:38:28.514 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.503+0000 7f520c698800 1 --2- 172.21.15.142:0/702206129 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x56171b0406e0 0x56171b042ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:28.514 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.503+0000 7f520a189640 1 --2- 172.21.15.142:0/702206129 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f50d403d000 0x7f50d403f4c0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f51fc001250 tx=0x7f51fc051000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:28.514 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.503+0000 7f520c698800 1 -- 172.21.15.142:0/702206129 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56171b0432f0 con 0x56171b0406e0 2024-09-22T08:38:28.514 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.503+0000 7f5203fff640 1 --2- 172.21.15.142:0/702206129 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x56171b0406e0 0x56171b042ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:28.514 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.503+0000 7f5203fff640 1 --2- 172.21.15.142:0/702206129 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x56171b0406e0 0x56171b042ba0 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:28.515 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.504+0000 7f5203fff640 1 -- 172.21.15.142:0/702206129 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f51f4051070 con 0x56171b0406e0 2024-09-22T08:38:28.515 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.504+0000 7f520c698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:28.515 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.504+0000 7f520c698800 20 realm 2024-09-22T08:38:28.515 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.504+0000 7f520c698800 20 rados->read ofs=0 len=0 2024-09-22T08:38:28.515 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.504+0000 7f520c698800 1 -- 172.21.15.142:0/702206129 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56171b043720 con 0x56171b0406e0 2024-09-22T08:38:28.515 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.504+0000 7f5203fff640 1 -- 172.21.15.142:0/702206129 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f51f4051070 con 0x56171b0406e0 2024-09-22T08:38:28.515 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.504+0000 7f520c698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:28.515 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.504+0000 7f520c698800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:38:28.515 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.504+0000 7f520c698800 20 rados->read ofs=0 len=0 2024-09-22T08:38:28.515 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.504+0000 7f520c698800 1 -- 172.21.15.142:0/702206129 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56171b043ff0 con 0x56171b0406e0 2024-09-22T08:38:28.515 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.504+0000 7f5203fff640 1 -- 172.21.15.142:0/702206129 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f51f4051070 con 0x56171b0406e0 2024-09-22T08:38:28.515 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.504+0000 7f520c698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:28.516 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.504+0000 7f520c698800 20 rados->read ofs=0 len=0 2024-09-22T08:38:28.516 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.504+0000 7f520c698800 1 -- 172.21.15.142:0/702206129 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56171b044390 con 0x56171b0406e0 2024-09-22T08:38:28.516 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.504+0000 7f5203fff640 1 -- 172.21.15.142:0/702206129 <== osd.1 v2:172.21.15.142:6816/3192108003 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f51f4051070 con 0x56171b0406e0 2024-09-22T08:38:28.516 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.504+0000 7f520c698800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:38:28.516 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.504+0000 7f520c698800 20 rados->read ofs=0 len=0 2024-09-22T08:38:28.516 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.504+0000 7f520c698800 1 --2- 172.21.15.142:0/702206129 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x56171b0450f0 0x56171b0474e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:28.516 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.504+0000 7f520c698800 1 -- 172.21.15.142:0/702206129 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56171b047af0 con 0x56171b0450f0 2024-09-22T08:38:28.516 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.504+0000 7f520a98a640 1 --2- 172.21.15.142:0/702206129 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x56171b0450f0 0x56171b0474e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:28.516 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.505+0000 7f520a98a640 1 --2- 172.21.15.142:0/702206129 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x56171b0450f0 0x56171b0474e0 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:28.517 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.505+0000 7f520a98a640 1 -- 172.21.15.142:0/702206129 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(5 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f520400a4d0 con 0x56171b0450f0 2024-09-22T08:38:28.517 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.505+0000 7f520c698800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:38:28.517 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.505+0000 7f520c698800 20 searching for the correct realm 2024-09-22T08:38:28.517 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.505+0000 7f520c698800 1 -- 172.21.15.142:0/702206129 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56171b049420 con 0x56171b0450f0 2024-09-22T08:38:28.517 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.505+0000 7f520a98a640 1 -- 172.21.15.142:0/702206129 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f520400a4d0 con 0x56171b0450f0 2024-09-22T08:38:28.517 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.505+0000 7f520a98a640 1 --2- 172.21.15.142:0/702206129 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f520404fba0 0x7f52040429c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:28.517 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.505+0000 7f520a98a640 1 -- 172.21.15.142:0/702206129 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56171b049420 con 0x7f520404fba0 2024-09-22T08:38:28.517 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.505+0000 7f520a189640 1 --2- 172.21.15.142:0/702206129 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f520404fba0 0x7f52040429c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:28.517 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.506+0000 7f520a189640 1 --2- 172.21.15.142:0/702206129 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f520404fba0 0x7f52040429c0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:28.517 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.506+0000 7f520a189640 1 -- 172.21.15.142:0/702206129 <== osd.2 v2:172.21.15.142:6808/279438927 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51fc01ab20 con 0x7f520404fba0 2024-09-22T08:38:28.517 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.506+0000 7f520a189640 1 --2- 172.21.15.142:0/702206129 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f51fc017050 0x7f51fc04b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:28.517 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.506+0000 7f520a189640 1 -- 172.21.15.142:0/702206129 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56171b049420 con 0x7f51fc017050 2024-09-22T08:38:28.518 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.506+0000 7f5203fff640 1 --2- 172.21.15.142:0/702206129 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f51fc017050 0x7f51fc04b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:28.518 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.506+0000 7f5203fff640 1 --2- 172.21.15.142:0/702206129 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f51fc017050 0x7f51fc04b890 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:28.518 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.507+0000 7f5203fff640 1 -- 172.21.15.142:0/702206129 <== osd.0 v2:172.21.15.31:6800/168281188 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51f4051070 con 0x7f51fc017050 2024-09-22T08:38:28.518 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.507+0000 7f5203fff640 1 -- 172.21.15.142:0/702206129 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56171b049420 con 0x56171b0406e0 2024-09-22T08:38:28.518 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.507+0000 7f5203fff640 1 -- 172.21.15.142:0/702206129 <== osd.1 v2:172.21.15.142:6816/3192108003 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51f4051070 con 0x56171b0406e0 2024-09-22T08:38:28.518 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.507+0000 7f5203fff640 1 -- 172.21.15.142:0/702206129 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56171b049420 con 0x56171b0406e0 2024-09-22T08:38:28.518 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.507+0000 7f5203fff640 1 -- 172.21.15.142:0/702206129 <== osd.1 v2:172.21.15.142:6816/3192108003 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51f4051070 con 0x56171b0406e0 2024-09-22T08:38:28.518 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.507+0000 7f5203fff640 1 -- 172.21.15.142:0/702206129 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56171b049420 con 0x56171b0406e0 2024-09-22T08:38:28.518 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.507+0000 7f5203fff640 1 -- 172.21.15.142:0/702206129 <== osd.1 v2:172.21.15.142:6816/3192108003 7 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51f4051070 con 0x56171b0406e0 2024-09-22T08:38:28.518 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.507+0000 7f5203fff640 1 -- 172.21.15.142:0/702206129 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56171b049420 con 0x7f51fc017050 2024-09-22T08:38:28.518 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.508+0000 7f5203fff640 1 -- 172.21.15.142:0/702206129 <== osd.0 v2:172.21.15.31:6800/168281188 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51f4051070 con 0x7f51fc017050 2024-09-22T08:38:28.518 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.508+0000 7f5203fff640 1 -- 172.21.15.142:0/702206129 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56171b049420 con 0x7f520404fba0 2024-09-22T08:38:28.518 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.508+0000 7f520a189640 1 -- 172.21.15.142:0/702206129 <== osd.2 v2:172.21.15.142:6808/279438927 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51fc01ab20 con 0x7f520404fba0 2024-09-22T08:38:28.518 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.508+0000 7f520a189640 1 -- 172.21.15.142:0/702206129 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56171b049420 con 0x56171b0450f0 2024-09-22T08:38:28.519 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.508+0000 7f520a98a640 1 -- 172.21.15.142:0/702206129 <== osd.3 v2:172.21.15.142:6800/1064901393 3 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f520400a4d0 con 0x56171b0450f0 2024-09-22T08:38:28.519 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.508+0000 7f520a98a640 1 -- 172.21.15.142:0/702206129 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56171b049420 con 0x56171b0406e0 2024-09-22T08:38:28.519 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.508+0000 7f5203fff640 1 -- 172.21.15.142:0/702206129 <== osd.1 v2:172.21.15.142:6816/3192108003 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51f4051070 con 0x56171b0406e0 2024-09-22T08:38:28.519 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.508+0000 7f5203fff640 1 -- 172.21.15.142:0/702206129 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56171b049420 con 0x7f51fc017050 2024-09-22T08:38:28.519 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.509+0000 7f5203fff640 1 -- 172.21.15.142:0/702206129 <== osd.0 v2:172.21.15.31:6800/168281188 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51f4051070 con 0x7f51fc017050 2024-09-22T08:38:28.519 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.509+0000 7f5203fff640 1 -- 172.21.15.142:0/702206129 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56171b049420 con 0x56171b0406e0 2024-09-22T08:38:28.519 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.509+0000 7f5203fff640 1 -- 172.21.15.142:0/702206129 <== osd.1 v2:172.21.15.142:6816/3192108003 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51f4051070 con 0x56171b0406e0 2024-09-22T08:38:28.519 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.509+0000 7f5203fff640 1 -- 172.21.15.142:0/702206129 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56171b049420 con 0x7f520404fba0 2024-09-22T08:38:28.529 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.509+0000 7f520a189640 1 -- 172.21.15.142:0/702206129 <== osd.2 v2:172.21.15.142:6808/279438927 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f51fc01ab20 con 0x7f520404fba0 2024-09-22T08:38:28.529 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.509+0000 7f520a189640 1 -- 172.21.15.142:0/702206129 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56171b049420 con 0x56171b0450f0 2024-09-22T08:38:28.529 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.509+0000 7f520a98a640 1 -- 172.21.15.142:0/702206129 <== osd.3 v2:172.21.15.142:6800/1064901393 4 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f520400a4d0 con 0x56171b0450f0 2024-09-22T08:38:28.529 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.509+0000 7f520a98a640 1 -- 172.21.15.142:0/702206129 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56171b049420 con 0x56171b0450f0 2024-09-22T08:38:28.530 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.509+0000 7f520a98a640 1 -- 172.21.15.142:0/702206129 <== osd.3 v2:172.21.15.142:6800/1064901393 5 ==== osd_op_reply(20 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f520400a4d0 con 0x56171b0450f0 2024-09-22T08:38:28.530 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.509+0000 7f520a98a640 1 -- 172.21.15.142:0/702206129 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56171b049420 con 0x7f51fc017050 2024-09-22T08:38:28.530 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.510+0000 7f5203fff640 1 -- 172.21.15.142:0/702206129 <== osd.0 v2:172.21.15.31:6800/168281188 4 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51f4051070 con 0x7f51fc017050 2024-09-22T08:38:28.530 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.510+0000 7f5203fff640 1 -- 172.21.15.142:0/702206129 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56171b049420 con 0x56171b0450f0 2024-09-22T08:38:28.530 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.510+0000 7f520a98a640 1 -- 172.21.15.142:0/702206129 <== osd.3 v2:172.21.15.142:6800/1064901393 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f520400a4d0 con 0x56171b0450f0 2024-09-22T08:38:28.530 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.510+0000 7f520a98a640 1 -- 172.21.15.142:0/702206129 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56171b049420 con 0x56171b0450f0 2024-09-22T08:38:28.530 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.510+0000 7f520a98a640 1 -- 172.21.15.142:0/702206129 <== osd.3 v2:172.21.15.142:6800/1064901393 7 ==== osd_op_reply(23 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f520400a4d0 con 0x56171b0450f0 2024-09-22T08:38:28.530 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.510+0000 7f520a98a640 1 -- 172.21.15.142:0/702206129 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56171b049420 con 0x56171b0406e0 2024-09-22T08:38:28.530 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.510+0000 7f5203fff640 1 -- 172.21.15.142:0/702206129 <== osd.1 v2:172.21.15.142:6816/3192108003 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51f4051070 con 0x56171b0406e0 2024-09-22T08:38:28.530 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.510+0000 7f5203fff640 1 -- 172.21.15.142:0/702206129 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56171b049420 con 0x56171b0406e0 2024-09-22T08:38:28.530 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.511+0000 7f5203fff640 1 -- 172.21.15.142:0/702206129 <== osd.1 v2:172.21.15.142:6816/3192108003 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f51f4051070 con 0x56171b0406e0 2024-09-22T08:38:28.530 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.511+0000 7f5203fff640 1 -- 172.21.15.142:0/702206129 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56171b049420 con 0x7f51fc017050 2024-09-22T08:38:28.531 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.511+0000 7f5203fff640 1 -- 172.21.15.142:0/702206129 <== osd.0 v2:172.21.15.31:6800/168281188 5 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51f4051070 con 0x7f51fc017050 2024-09-22T08:38:28.531 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.511+0000 7f5203fff640 1 -- 172.21.15.142:0/702206129 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56171b049420 con 0x56171b0450f0 2024-09-22T08:38:28.531 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.511+0000 7f520a98a640 1 -- 172.21.15.142:0/702206129 <== osd.3 v2:172.21.15.142:6800/1064901393 8 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f520400a4d0 con 0x56171b0450f0 2024-09-22T08:38:28.531 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.511+0000 7f520a98a640 1 -- 172.21.15.142:0/702206129 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56171b049420 con 0x7f520404fba0 2024-09-22T08:38:28.531 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.511+0000 7f520a189640 1 -- 172.21.15.142:0/702206129 <== osd.2 v2:172.21.15.142:6808/279438927 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51fc01ab20 con 0x7f520404fba0 2024-09-22T08:38:28.531 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.511+0000 7f520a189640 1 -- 172.21.15.142:0/702206129 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56171b049420 con 0x56171b0406e0 2024-09-22T08:38:28.531 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.512+0000 7f5203fff640 1 -- 172.21.15.142:0/702206129 <== osd.1 v2:172.21.15.142:6816/3192108003 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51f4051070 con 0x56171b0406e0 2024-09-22T08:38:28.531 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.512+0000 7f5203fff640 1 -- 172.21.15.142:0/702206129 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56171b049420 con 0x7f51fc017050 2024-09-22T08:38:28.531 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.512+0000 7f5203fff640 1 -- 172.21.15.142:0/702206129 <== osd.0 v2:172.21.15.31:6800/168281188 6 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51f4051070 con 0x7f51fc017050 2024-09-22T08:38:28.531 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.512+0000 7f5203fff640 1 -- 172.21.15.142:0/702206129 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56171b049420 con 0x56171b0450f0 2024-09-22T08:38:28.531 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.512+0000 7f520a98a640 1 -- 172.21.15.142:0/702206129 <== osd.3 v2:172.21.15.142:6800/1064901393 9 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f520400a4d0 con 0x56171b0450f0 2024-09-22T08:38:28.531 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.512+0000 7f520a98a640 1 -- 172.21.15.142:0/702206129 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56171b049420 con 0x7f51fc017050 2024-09-22T08:38:28.531 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.512+0000 7f5203fff640 1 -- 172.21.15.142:0/702206129 <== osd.0 v2:172.21.15.31:6800/168281188 7 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51f4051070 con 0x7f51fc017050 2024-09-22T08:38:28.531 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.512+0000 7f5203fff640 1 -- 172.21.15.142:0/702206129 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56171b049420 con 0x7f520404fba0 2024-09-22T08:38:28.532 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.513+0000 7f520a189640 1 -- 172.21.15.142:0/702206129 <== osd.2 v2:172.21.15.142:6808/279438927 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51fc01ab20 con 0x7f520404fba0 2024-09-22T08:38:28.532 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.513+0000 7f520a189640 1 -- 172.21.15.142:0/702206129 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56171b049420 con 0x56171b0450f0 2024-09-22T08:38:28.532 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.513+0000 7f520a98a640 1 -- 172.21.15.142:0/702206129 <== osd.3 v2:172.21.15.142:6800/1064901393 10 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f520400a4d0 con 0x56171b0450f0 2024-09-22T08:38:28.532 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.513+0000 7f520a98a640 1 -- 172.21.15.142:0/702206129 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56171b049420 con 0x7f51fc017050 2024-09-22T08:38:28.532 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.513+0000 7f5203fff640 1 -- 172.21.15.142:0/702206129 <== osd.0 v2:172.21.15.31:6800/168281188 8 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51f4051070 con 0x7f51fc017050 2024-09-22T08:38:28.532 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.513+0000 7f5203fff640 1 -- 172.21.15.142:0/702206129 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56171b049420 con 0x56171b0406e0 2024-09-22T08:38:28.532 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.513+0000 7f5203fff640 1 -- 172.21.15.142:0/702206129 <== osd.1 v2:172.21.15.142:6816/3192108003 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f51f4051070 con 0x56171b0406e0 2024-09-22T08:38:28.532 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.513+0000 7f5203fff640 1 -- 172.21.15.142:0/702206129 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56171b049420 con 0x7f520404fba0 2024-09-22T08:38:28.532 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.514+0000 7f520a189640 1 -- 172.21.15.142:0/702206129 <== osd.2 v2:172.21.15.142:6808/279438927 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51fc01ab20 con 0x7f520404fba0 2024-09-22T08:38:28.532 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.514+0000 7f520c698800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:38:28.532 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.514+0000 7f520c698800 20 RGWRados::pool_iterate: got zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec 2024-09-22T08:38:28.532 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.514+0000 7f520c698800 20 RGWRados::pool_iterate: got zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f 2024-09-22T08:38:28.532 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.514+0000 7f520c698800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:38:28.532 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.514+0000 7f520c698800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:38:28.533 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.514+0000 7f520c698800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:38:28.533 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.514+0000 7f520c698800 20 rados->read ofs=0 len=0 2024-09-22T08:38:28.533 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.514+0000 7f520c698800 1 -- 172.21.15.142:0/702206129 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56171b0484e0 con 0x56171b0406e0 2024-09-22T08:38:28.533 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.514+0000 7f5203fff640 1 -- 172.21.15.142:0/702206129 <== osd.1 v2:172.21.15.142:6816/3192108003 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f51f4051070 con 0x56171b0406e0 2024-09-22T08:38:28.533 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.514+0000 7f520c698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:28.533 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.514+0000 7f520c698800 20 rados->read ofs=0 len=0 2024-09-22T08:38:28.533 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.514+0000 7f520c698800 1 -- 172.21.15.142:0/702206129 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56171b048d30 con 0x56171b0406e0 2024-09-22T08:38:28.533 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.514+0000 7f5203fff640 1 -- 172.21.15.142:0/702206129 <== osd.1 v2:172.21.15.142:6816/3192108003 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f51f4051070 con 0x56171b0406e0 2024-09-22T08:38:28.533 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.514+0000 7f520c698800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:38:28.533 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.514+0000 7f520c698800 20 rados->read ofs=0 len=0 2024-09-22T08:38:28.533 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.514+0000 7f520c698800 1 -- 172.21.15.142:0/702206129 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:40 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56171b0498a0 con 0x56171b0450f0 2024-09-22T08:38:28.533 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.514+0000 7f520a98a640 1 -- 172.21.15.142:0/702206129 <== osd.3 v2:172.21.15.142:6800/1064901393 11 ==== osd_op_reply(40 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f520400a4d0 con 0x56171b0450f0 2024-09-22T08:38:28.533 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.514+0000 7f520c698800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:38:28.534 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.514+0000 7f520c698800 20 zone default found 2024-09-22T08:38:28.534 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.514+0000 7f520c698800 4 Realm: () 2024-09-22T08:38:28.534 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.514+0000 7f520c698800 4 ZoneGroup: default (d89f6f57-1007-47dd-9065-f486c7b01aec) 2024-09-22T08:38:28.534 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.514+0000 7f520c698800 4 Zone: default (e239248c-0bee-4e41-803a-24b288d3eb8f) 2024-09-22T08:38:28.534 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.514+0000 7f520c698800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:38:28.534 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.514+0000 7f520c698800 20 zonegroup default 2024-09-22T08:38:28.534 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.514+0000 7f520c698800 20 rados->read ofs=0 len=0 2024-09-22T08:38:28.534 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.514+0000 7f520c698800 1 -- 172.21.15.142:0/702206129 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56171b049ca0 con 0x7f51fc017050 2024-09-22T08:38:28.534 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.515+0000 7f5203fff640 1 -- 172.21.15.142:0/702206129 <== osd.0 v2:172.21.15.31:6800/168281188 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f51f4051070 con 0x7f51fc017050 2024-09-22T08:38:28.534 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.515+0000 7f520c698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:28.534 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.515+0000 7f520c698800 20 rados->read ofs=0 len=0 2024-09-22T08:38:28.534 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.515+0000 7f520c698800 1 -- 172.21.15.142:0/702206129 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56171b04bf80 con 0x56171b0450f0 2024-09-22T08:38:28.534 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.515+0000 7f520a98a640 1 -- 172.21.15.142:0/702206129 <== osd.3 v2:172.21.15.142:6800/1064901393 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f520400a4d0 con 0x56171b0450f0 2024-09-22T08:38:28.535 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.515+0000 7f520c698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:28.535 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.515+0000 7f520c698800 20 rados->read ofs=0 len=0 2024-09-22T08:38:28.535 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.515+0000 7f520c698800 1 -- 172.21.15.142:0/702206129 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56171b04c320 con 0x56171b0450f0 2024-09-22T08:38:28.535 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.515+0000 7f520a98a640 1 -- 172.21.15.142:0/702206129 <== osd.3 v2:172.21.15.142:6800/1064901393 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f520400a4d0 con 0x56171b0450f0 2024-09-22T08:38:28.535 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.515+0000 7f520c698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:28.535 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.515+0000 7f520c698800 20 started sync module instance, tier type = 2024-09-22T08:38:28.535 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.515+0000 7f520c698800 20 started zone id=e239248c-0bee-4e41-803a-24b288d3eb8f (name=default) with tier type = 2024-09-22T08:38:28.535 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.515+0000 7f520c698800 1 -- 172.21.15.142:0/702206129 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56171b04b410 con 0x7f520404fba0 2024-09-22T08:38:28.535 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.516+0000 7f520a189640 1 -- 172.21.15.142:0/702206129 <== osd.2 v2:172.21.15.142:6808/279438927 7 ==== osd_op_reply(44 notify.0 [create] v32'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f51fc01ab20 con 0x7f520404fba0 2024-09-22T08:38:28.535 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.516+0000 7f520c698800 1 -- 172.21.15.142:0/702206129 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94657237530672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56171b04b070 con 0x7f520404fba0 2024-09-22T08:38:28.535 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.516+0000 7f520c698800 1 -- 172.21.15.142:0/702206129 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56171b04d220 con 0x56171b0406e0 2024-09-22T08:38:28.535 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.517+0000 7f520a189640 1 -- 172.21.15.142:0/702206129 <== osd.2 v2:172.21.15.142:6808/279438927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94657237530672] v32'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f51fc01ab20 con 0x7f520404fba0 2024-09-22T08:38:28.535 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.518+0000 7f5203fff640 1 -- 172.21.15.142:0/702206129 <== osd.1 v2:172.21.15.142:6816/3192108003 16 ==== osd_op_reply(46 notify.1 [create] v32'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f51f4051070 con 0x56171b0406e0 2024-09-22T08:38:28.535 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.518+0000 7f520c698800 1 -- 172.21.15.142:0/702206129 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94657237536112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56171b04d640 con 0x56171b0406e0 2024-09-22T08:38:28.536 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.518+0000 7f520c698800 1 -- 172.21.15.142:0/702206129 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56171b04e000 con 0x56171b0450f0 2024-09-22T08:38:28.536 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.519+0000 7f5203fff640 1 -- 172.21.15.142:0/702206129 <== osd.1 v2:172.21.15.142:6816/3192108003 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94657237536112] v32'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f51f4051070 con 0x56171b0406e0 2024-09-22T08:38:28.536 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.519+0000 7f520a98a640 1 -- 172.21.15.142:0/702206129 <== osd.3 v2:172.21.15.142:6800/1064901393 14 ==== osd_op_reply(48 notify.2 [create] v32'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f520400a4d0 con 0x56171b0450f0 2024-09-22T08:38:28.536 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.519+0000 7f520c698800 1 -- 172.21.15.142:0/702206129 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94657237540144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56171b04d640 con 0x56171b0450f0 2024-09-22T08:38:28.536 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.519+0000 7f520c698800 1 -- 172.21.15.142:0/702206129 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56171b04ea50 con 0x7f520404fba0 2024-09-22T08:38:28.536 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.520+0000 7f520a189640 1 -- 172.21.15.142:0/702206129 <== osd.2 v2:172.21.15.142:6808/279438927 9 ==== osd_op_reply(50 notify.3 [create] v32'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f51fc01ab20 con 0x7f520404fba0 2024-09-22T08:38:28.536 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.520+0000 7f520c698800 1 -- 172.21.15.142:0/702206129 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94657237542240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56171b04f2f0 con 0x7f520404fba0 2024-09-22T08:38:28.536 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.520+0000 7f520c698800 1 -- 172.21.15.142:0/702206129 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56171b04fdc0 con 0x56171b0406e0 2024-09-22T08:38:28.536 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.520+0000 7f520a98a640 1 -- 172.21.15.142:0/702206129 <== osd.3 v2:172.21.15.142:6800/1064901393 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94657237540144] v32'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f520400a4d0 con 0x56171b0450f0 2024-09-22T08:38:28.536 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.521+0000 7f520a189640 1 -- 172.21.15.142:0/702206129 <== osd.2 v2:172.21.15.142:6808/279438927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94657237542240] v32'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f51fc01ab20 con 0x7f520404fba0 2024-09-22T08:38:28.536 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.521+0000 7f5203fff640 1 -- 172.21.15.142:0/702206129 <== osd.1 v2:172.21.15.142:6816/3192108003 18 ==== osd_op_reply(52 notify.4 [create] v32'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f51f4051070 con 0x56171b0406e0 2024-09-22T08:38:28.536 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.521+0000 7f520c698800 1 -- 172.21.15.142:0/702206129 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94657237544512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56171b04f880 con 0x56171b0406e0 2024-09-22T08:38:28.536 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.521+0000 7f520c698800 1 -- 172.21.15.142:0/702206129 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56171b0507d0 con 0x7f51fc017050 2024-09-22T08:38:28.536 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.522+0000 7f5203fff640 1 -- 172.21.15.142:0/702206129 <== osd.0 v2:172.21.15.31:6800/168281188 10 ==== osd_op_reply(54 notify.5 [create] v32'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f51f4051070 con 0x7f51fc017050 2024-09-22T08:38:28.537 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.522+0000 7f520c698800 1 -- 172.21.15.142:0/702206129 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94657237549856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56171b050bf0 con 0x7f51fc017050 2024-09-22T08:38:28.537 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.522+0000 7f520c698800 1 -- 172.21.15.142:0/702206129 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56171b0515f0 con 0x7f51fc017050 2024-09-22T08:38:28.537 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.522+0000 7f5203fff640 1 -- 172.21.15.142:0/702206129 <== osd.1 v2:172.21.15.142:6816/3192108003 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94657237544512] v32'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f51f4051070 con 0x56171b0406e0 2024-09-22T08:38:28.537 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.523+0000 7f5203fff640 1 -- 172.21.15.142:0/702206129 <== osd.0 v2:172.21.15.31:6800/168281188 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94657237549856] v32'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f51f4051070 con 0x7f51fc017050 2024-09-22T08:38:28.537 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.524+0000 7f5203fff640 1 -- 172.21.15.142:0/702206129 <== osd.0 v2:172.21.15.31:6800/168281188 12 ==== osd_op_reply(56 notify.6 [create] v32'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f51f4051070 con 0x7f51fc017050 2024-09-22T08:38:28.537 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.524+0000 7f520c698800 1 -- 172.21.15.142:0/702206129 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94657237537168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56171b050740 con 0x7f51fc017050 2024-09-22T08:38:28.537 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.524+0000 7f520c698800 1 -- 172.21.15.142:0/702206129 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56171b051c80 con 0x7f51fc017050 2024-09-22T08:38:28.537 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.525+0000 7f5203fff640 1 -- 172.21.15.142:0/702206129 <== osd.0 v2:172.21.15.31:6800/168281188 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94657237537168] v32'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f51f4051070 con 0x7f51fc017050 2024-09-22T08:38:28.537 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.525+0000 7f5203fff640 1 -- 172.21.15.142:0/702206129 <== osd.0 v2:172.21.15.31:6800/168281188 14 ==== osd_op_reply(58 notify.7 [create] v32'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f51f4051070 con 0x7f51fc017050 2024-09-22T08:38:28.537 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.525+0000 7f520c698800 1 -- 172.21.15.142:0/702206129 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94657237553408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56171b051c80 con 0x7f51fc017050 2024-09-22T08:38:28.538 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.525+0000 7f520c698800 20 add_watcher() i=0 2024-09-22T08:38:28.538 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.525+0000 7f520c698800 20 add_watcher() i=1 2024-09-22T08:38:28.538 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.525+0000 7f520c698800 20 add_watcher() i=2 2024-09-22T08:38:28.538 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.525+0000 7f520c698800 20 add_watcher() i=3 2024-09-22T08:38:28.538 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.525+0000 7f520c698800 20 add_watcher() i=4 2024-09-22T08:38:28.538 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.525+0000 7f520c698800 20 add_watcher() i=5 2024-09-22T08:38:28.538 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.525+0000 7f520c698800 20 add_watcher() i=6 2024-09-22T08:38:28.538 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.526+0000 7f5203fff640 1 -- 172.21.15.142:0/702206129 <== osd.0 v2:172.21.15.31:6800/168281188 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94657237553408] v32'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f51f4051070 con 0x7f51fc017050 2024-09-22T08:38:28.538 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.526+0000 7f520c698800 20 add_watcher() i=7 2024-09-22T08:38:28.538 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.526+0000 7f520c698800 2 all 8 watchers are set, enabling cache 2024-09-22T08:38:28.538 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.526+0000 7f520c698800 1 -- 172.21.15.142:0/702206129 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56171b054fb0 con 0x56171b0406e0 2024-09-22T08:38:28.538 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.526+0000 7f5203fff640 1 -- 172.21.15.142:0/702206129 <== osd.1 v2:172.21.15.142:6816/3192108003 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f51f4051070 con 0x56171b0406e0 2024-09-22T08:38:28.538 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.526+0000 7f520c698800 1 -- 172.21.15.142:0/702206129 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94657237567840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56171b051c80 con 0x56171b0406e0 2024-09-22T08:38:28.538 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.527+0000 7f5203fff640 1 -- 172.21.15.142:0/702206129 <== osd.1 v2:172.21.15.142:6816/3192108003 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94657237567840] v32'233 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f51f4051070 con 0x56171b0406e0 2024-09-22T08:38:28.539 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.527+0000 7f50c17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:38:28.539 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.527+0000 7f520c698800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:38:28.539 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.527+0000 7f520c698800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:38:28.539 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.527+0000 7f520c698800 1 -- 172.21.15.142:0/702206129 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56171b05dab0 con 0x56171b0406e0 2024-09-22T08:38:28.541 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.528+0000 7f5203fff640 1 -- 172.21.15.142:0/702206129 <== osd.1 v2:172.21.15.142:6816/3192108003 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'34 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f51f4051070 con 0x56171b0406e0 2024-09-22T08:38:28.541 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.528+0000 7f520c698800 1 -- 172.21.15.142:0/702206129 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56171b05dab0 con 0x7f51fc017050 2024-09-22T08:38:28.541 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.529+0000 7f5203fff640 1 -- 172.21.15.142:0/702206129 <== osd.0 v2:172.21.15.31:6800/168281188 16 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'28 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f51f4051070 con 0x7f51fc017050 2024-09-22T08:38:28.541 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.530+0000 7f520c698800 1 -- 172.21.15.142:0/702206129 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56171b05e610 con 0x56171b0450f0 2024-09-22T08:38:28.542 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.530+0000 7f520a98a640 1 -- 172.21.15.142:0/702206129 <== osd.3 v2:172.21.15.142:6800/1064901393 16 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'29 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f520400a4d0 con 0x56171b0450f0 2024-09-22T08:38:28.542 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.530+0000 7f520c698800 1 -- 172.21.15.142:0/702206129 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56171b05e6a0 con 0x56171b0406e0 2024-09-22T08:38:28.542 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.531+0000 7f5203fff640 1 -- 172.21.15.142:0/702206129 <== osd.1 v2:172.21.15.142:6816/3192108003 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'234 uv162 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f51f4051070 con 0x56171b0406e0 2024-09-22T08:38:28.542 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.531+0000 7f520c698800 1 -- 172.21.15.142:0/702206129 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56171b05eb50 con 0x7f520404fba0 2024-09-22T08:38:28.542 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.532+0000 7f520a189640 1 -- 172.21.15.142:0/702206129 <== osd.2 v2:172.21.15.142:6808/279438927 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'76 uv53 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f51fc01ab20 con 0x7f520404fba0 2024-09-22T08:38:28.542 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.532+0000 7f520c698800 1 -- 172.21.15.142:0/702206129 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56171b05c110 con 0x56171b0450f0 2024-09-22T08:38:28.543 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.533+0000 7f520a98a640 1 -- 172.21.15.142:0/702206129 <== osd.3 v2:172.21.15.142:6800/1064901393 17 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'50 uv34 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f520400a4d0 con 0x56171b0450f0 2024-09-22T08:38:28.543 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.533+0000 7f520c698800 1 -- 172.21.15.142:0/702206129 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56171b05c110 con 0x56171b0406e0 2024-09-22T08:38:28.543 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.535+0000 7f5203fff640 1 -- 172.21.15.142:0/702206129 <== osd.1 v2:172.21.15.142:6816/3192108003 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'30 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f51f4051070 con 0x56171b0406e0 2024-09-22T08:38:28.543 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.535+0000 7f520c698800 1 -- 172.21.15.142:0/702206129 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56171b05c110 con 0x7f51fc017050 2024-09-22T08:38:28.543 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.536+0000 7f5203fff640 1 -- 172.21.15.142:0/702206129 <== osd.0 v2:172.21.15.31:6800/168281188 17 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'49 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f51f4051070 con 0x7f51fc017050 2024-09-22T08:38:28.543 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.536+0000 7f520c698800 1 -- 172.21.15.142:0/702206129 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56171b05c110 con 0x7f520404fba0 2024-09-22T08:38:28.543 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.537+0000 7f520a189640 1 -- 172.21.15.142:0/702206129 <== osd.2 v2:172.21.15.142:6808/279438927 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'28 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f51fc01ab20 con 0x7f520404fba0 2024-09-22T08:38:28.544 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.537+0000 7f520c698800 1 -- 172.21.15.142:0/702206129 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56171b05c1e0 con 0x56171b0450f0 2024-09-22T08:38:28.544 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.538+0000 7f520a98a640 1 -- 172.21.15.142:0/702206129 <== osd.3 v2:172.21.15.142:6800/1064901393 18 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'34 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f520400a4d0 con 0x56171b0450f0 2024-09-22T08:38:28.544 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.538+0000 7f520c698800 1 -- 172.21.15.142:0/702206129 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56171b05f6b0 con 0x7f520404fba0 2024-09-22T08:38:28.544 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.539+0000 7f520a189640 1 -- 172.21.15.142:0/702206129 <== osd.2 v2:172.21.15.142:6808/279438927 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'77 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f51fc01ab20 con 0x7f520404fba0 2024-09-22T08:38:28.544 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.539+0000 7f520c698800 1 -- 172.21.15.142:0/702206129 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56171b05f6b0 con 0x7f51fc017050 2024-09-22T08:38:28.546 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.540+0000 7f5203fff640 1 -- 172.21.15.142:0/702206129 <== osd.0 v2:172.21.15.31:6800/168281188 18 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'34 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f51f4051070 con 0x7f51fc017050 2024-09-22T08:38:28.546 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.540+0000 7f520c698800 1 -- 172.21.15.142:0/702206129 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56171b05f6b0 con 0x7f520404fba0 2024-09-22T08:38:28.547 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.541+0000 7f520a189640 1 -- 172.21.15.142:0/702206129 <== osd.2 v2:172.21.15.142:6808/279438927 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'28 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f51fc01ab20 con 0x7f520404fba0 2024-09-22T08:38:28.547 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.541+0000 7f520c698800 1 -- 172.21.15.142:0/702206129 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56171b05f6b0 con 0x7f51fc017050 2024-09-22T08:38:28.547 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.542+0000 7f5203fff640 1 -- 172.21.15.142:0/702206129 <== osd.0 v2:172.21.15.31:6800/168281188 19 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'57 uv44 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f51f4051070 con 0x7f51fc017050 2024-09-22T08:38:28.547 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.542+0000 7f520c698800 1 -- 172.21.15.142:0/702206129 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56171b05f6b0 con 0x56171b0406e0 2024-09-22T08:38:28.547 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.543+0000 7f5203fff640 1 -- 172.21.15.142:0/702206129 <== osd.1 v2:172.21.15.142:6816/3192108003 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'235 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f51f4051070 con 0x56171b0406e0 2024-09-22T08:38:28.547 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.543+0000 7f520c698800 1 -- 172.21.15.142:0/702206129 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56171b05f6b0 con 0x56171b0450f0 2024-09-22T08:38:28.548 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.544+0000 7f520a98a640 1 -- 172.21.15.142:0/702206129 <== osd.3 v2:172.21.15.142:6800/1064901393 19 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'68 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f520400a4d0 con 0x56171b0450f0 2024-09-22T08:38:28.548 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.544+0000 7f520c698800 1 -- 172.21.15.142:0/702206129 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56171b05f6b0 con 0x7f520404fba0 2024-09-22T08:38:28.549 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.545+0000 7f520a189640 1 -- 172.21.15.142:0/702206129 <== osd.2 v2:172.21.15.142:6808/279438927 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'78 uv57 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f51fc01ab20 con 0x7f520404fba0 2024-09-22T08:38:28.549 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.545+0000 7f520c698800 1 -- 172.21.15.142:0/702206129 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56171b05f6b0 con 0x56171b0450f0 2024-09-22T08:38:28.549 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.546+0000 7f520a98a640 1 -- 172.21.15.142:0/702206129 <== osd.3 v2:172.21.15.142:6800/1064901393 20 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'28 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f520400a4d0 con 0x56171b0450f0 2024-09-22T08:38:28.549 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.546+0000 7f520c698800 1 -- 172.21.15.142:0/702206129 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56171b05f6b0 con 0x56171b0406e0 2024-09-22T08:38:28.550 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.547+0000 7f5203fff640 1 -- 172.21.15.142:0/702206129 <== osd.1 v2:172.21.15.142:6816/3192108003 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'36 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f51f4051070 con 0x56171b0406e0 2024-09-22T08:38:28.551 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.547+0000 7f520c698800 1 -- 172.21.15.142:0/702206129 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56171b05f6b0 con 0x56171b0406e0 2024-09-22T08:38:28.551 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.548+0000 7f5203fff640 1 -- 172.21.15.142:0/702206129 <== osd.1 v2:172.21.15.142:6816/3192108003 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'236 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f51f4051070 con 0x56171b0406e0 2024-09-22T08:38:28.551 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.548+0000 7f520c698800 1 -- 172.21.15.142:0/702206129 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56171b05f6b0 con 0x56171b0450f0 2024-09-22T08:38:28.552 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.549+0000 7f520a98a640 1 -- 172.21.15.142:0/702206129 <== osd.3 v2:172.21.15.142:6800/1064901393 21 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'69 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f520400a4d0 con 0x56171b0450f0 2024-09-22T08:38:28.552 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.549+0000 7f520c698800 1 -- 172.21.15.142:0/702206129 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56171b05f6b0 con 0x7f520404fba0 2024-09-22T08:38:28.553 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.550+0000 7f520a189640 1 -- 172.21.15.142:0/702206129 <== osd.2 v2:172.21.15.142:6808/279438927 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'38 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f51fc01ab20 con 0x7f520404fba0 2024-09-22T08:38:28.553 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.550+0000 7f520c698800 1 -- 172.21.15.142:0/702206129 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56171b05f6b0 con 0x56171b0450f0 2024-09-22T08:38:28.553 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.551+0000 7f520a98a640 1 -- 172.21.15.142:0/702206129 <== osd.3 v2:172.21.15.142:6800/1064901393 22 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'30 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f520400a4d0 con 0x56171b0450f0 2024-09-22T08:38:28.554 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.551+0000 7f520c698800 1 -- 172.21.15.142:0/702206129 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56171b05f6b0 con 0x56171b0450f0 2024-09-22T08:38:28.554 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.552+0000 7f520a98a640 1 -- 172.21.15.142:0/702206129 <== osd.3 v2:172.21.15.142:6800/1064901393 23 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'35 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f520400a4d0 con 0x56171b0450f0 2024-09-22T08:38:28.555 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.552+0000 7f520c698800 1 -- 172.21.15.142:0/702206129 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56171b05f6b0 con 0x56171b0450f0 2024-09-22T08:38:28.555 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.553+0000 7f520a98a640 1 -- 172.21.15.142:0/702206129 <== osd.3 v2:172.21.15.142:6800/1064901393 24 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'24 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f520400a4d0 con 0x56171b0450f0 2024-09-22T08:38:28.556 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.553+0000 7f520c698800 1 -- 172.21.15.142:0/702206129 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56171b05f6b0 con 0x56171b0450f0 2024-09-22T08:38:28.556 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.554+0000 7f520a98a640 1 -- 172.21.15.142:0/702206129 <== osd.3 v2:172.21.15.142:6800/1064901393 25 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'51 uv36 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f520400a4d0 con 0x56171b0450f0 2024-09-22T08:38:28.557 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.554+0000 7f520c698800 1 -- 172.21.15.142:0/702206129 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56171b05f6b0 con 0x7f51fc017050 2024-09-22T08:38:28.557 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.555+0000 7f5203fff640 1 -- 172.21.15.142:0/702206129 <== osd.0 v2:172.21.15.31:6800/168281188 20 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'30 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f51f4051070 con 0x7f51fc017050 2024-09-22T08:38:28.558 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.555+0000 7f520c698800 1 -- 172.21.15.142:0/702206129 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56171b05f6b0 con 0x56171b0450f0 2024-09-22T08:38:28.558 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.556+0000 7f520a98a640 1 -- 172.21.15.142:0/702206129 <== osd.3 v2:172.21.15.142:6800/1064901393 26 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'29 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f520400a4d0 con 0x56171b0450f0 2024-09-22T08:38:28.559 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.556+0000 7f520c698800 1 -- 172.21.15.142:0/702206129 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56171b05f6b0 con 0x7f51fc017050 2024-09-22T08:38:28.559 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.557+0000 7f5203fff640 1 -- 172.21.15.142:0/702206129 <== osd.0 v2:172.21.15.31:6800/168281188 21 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'50 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f51f4051070 con 0x7f51fc017050 2024-09-22T08:38:28.560 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.557+0000 7f520c698800 1 -- 172.21.15.142:0/702206129 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56171b05f6b0 con 0x56171b0450f0 2024-09-22T08:38:28.560 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.558+0000 7f520a98a640 1 -- 172.21.15.142:0/702206129 <== osd.3 v2:172.21.15.142:6800/1064901393 27 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'70 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f520400a4d0 con 0x56171b0450f0 2024-09-22T08:38:28.561 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.558+0000 7f520c698800 1 -- 172.21.15.142:0/702206129 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56171b05f6b0 con 0x7f51fc017050 2024-09-22T08:38:28.562 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.559+0000 7f5203fff640 1 -- 172.21.15.142:0/702206129 <== osd.0 v2:172.21.15.31:6800/168281188 22 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'58 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f51f4051070 con 0x7f51fc017050 2024-09-22T08:38:28.562 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.559+0000 7f520c698800 1 -- 172.21.15.142:0/702206129 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56171b05f6b0 con 0x7f520404fba0 2024-09-22T08:38:28.570 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.560+0000 7f520a189640 1 -- 172.21.15.142:0/702206129 <== osd.2 v2:172.21.15.142:6808/279438927 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'34 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f51fc01ab20 con 0x7f520404fba0 2024-09-22T08:38:28.570 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.561+0000 7f50bb7fe640 20 reqs_thread_entry: start 2024-09-22T08:38:28.570 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.561+0000 7f520c698800 20 init_complete bucket index max shards: 11 2024-09-22T08:38:28.570 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.561+0000 7f520c698800 20 Filter name: none 2024-09-22T08:38:28.570 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.561+0000 7f50b97fa640 20 reqs_thread_entry: start 2024-09-22T08:38:28.570 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.561+0000 7f520c698800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-22T08:38:28.570 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.561+0000 7f520c698800 20 rados->read ofs=0 len=0 2024-09-22T08:38:28.570 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.561+0000 7f520c698800 1 -- 172.21.15.142:0/702206129 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56171b08a570 con 0x56171b0406e0 2024-09-22T08:38:28.570 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.561+0000 7f5203fff640 1 -- 172.21.15.142:0/702206129 <== osd.1 v2:172.21.15.142:6816/3192108003 28 ==== osd_op_reply(94 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f51f4051070 con 0x56171b0406e0 2024-09-22T08:38:28.571 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.561+0000 7f520c698800 20 rados_obj.operate() r=0 bl.length=391 2024-09-22T08:38:28.571 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.561+0000 7f520c698800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-22T08:38:28.571 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.561+0000 7f520c698800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-22T08:38:28.571 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.561+0000 7f520c698800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:38:28.571 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.562+0000 7f520c698800 1 -- 172.21.15.142:0/702206129 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:95 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56171b08ce30 con 0x7f520404fba0 2024-09-22T08:38:28.571 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.562+0000 7f520a189640 1 -- 172.21.15.142:0/702206129 <== osd.2 v2:172.21.15.142:6808/279438927 18 ==== osd_op_reply(95 foo.buckets [call out=183b] v0'0 uv43 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f51fc01ab20 con 0x7f520404fba0 2024-09-22T08:38:28.571 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.562+0000 7f520c698800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:e239248c-0bee-4e41-803a-24b288d3eb8f.4226.7 : miss 2024-09-22T08:38:28.571 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.562+0000 7f520c698800 20 rados->read ofs=0 len=0 2024-09-22T08:38:28.571 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.562+0000 7f520c698800 1 -- 172.21.15.142:0/702206129 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:96 8.a 8:54dff4b1:root::.bucket.meta.myfoo%3ae239248c-0bee-4e41-803a-24b288d3eb8f.4226.7:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56171b08cb40 con 0x56171b0406e0 2024-09-22T08:38:28.571 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.562+0000 7f5203fff640 1 -- 172.21.15.142:0/702206129 <== osd.1 v2:172.21.15.142:6816/3192108003 29 ==== osd_op_reply(96 .bucket.meta.myfoo:e239248c-0bee-4e41-803a-24b288d3eb8f.4226.7 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7f51f4051070 con 0x56171b0406e0 2024-09-22T08:38:28.571 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.562+0000 7f520c698800 20 rados_obj.operate() r=0 bl.length=387 2024-09-22T08:38:28.571 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.562+0000 7f520c698800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:e239248c-0bee-4e41-803a-24b288d3eb8f.4226.7 info.flags=0x17 2024-09-22T08:38:28.571 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.562+0000 7f520c698800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:e239248c-0bee-4e41-803a-24b288d3eb8f.4226.7 to cache LRU end 2024-09-22T08:38:28.572 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.562+0000 7f520c698800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:38:28.572 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.562+0000 7f520c698800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-22T08:38:28.572 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.562+0000 7f520c698800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:e239248c-0bee-4e41-803a-24b288d3eb8f.4226.7 2024-09-22T08:38:28.572 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.562+0000 7f520c698800 1 -- 172.21.15.142:0/702206129 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:97 4.f 4:f1cb2197:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.7.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56171b10a050 con 0x56171b0406e0 2024-09-22T08:38:28.572 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.563+0000 7f5203fff640 1 -- 172.21.15.142:0/702206129 <== osd.1 v2:172.21.15.142:6816/3192108003 30 ==== osd_op_reply(97 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.7.0 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f51f4051070 con 0x56171b0406e0 2024-09-22T08:38:28.572 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.563+0000 7f520c698800 1 -- 172.21.15.142:0/702206129 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:98 4.1b 4:db34e180:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.7.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56171b10a090 con 0x7f520404fba0 2024-09-22T08:38:28.572 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.563+0000 7f520a189640 1 -- 172.21.15.142:0/702206129 <== osd.2 v2:172.21.15.142:6808/279438927 19 ==== osd_op_reply(98 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.7.1 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f51fc01ab20 con 0x7f520404fba0 2024-09-22T08:38:28.572 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.563+0000 7f520c698800 1 -- 172.21.15.142:0/702206129 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:99 4.11 4:8a132748:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.7.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56171b10a090 con 0x7f51fc017050 2024-09-22T08:38:28.572 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.563+0000 7f5203fff640 1 -- 172.21.15.142:0/702206129 <== osd.0 v2:172.21.15.31:6800/168281188 23 ==== osd_op_reply(99 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.7.2 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f51f4051070 con 0x7f51fc017050 2024-09-22T08:38:28.572 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.563+0000 7f520c698800 1 -- 172.21.15.142:0/702206129 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:100 4.18 4:19399d23:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.7.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56171b10a0d0 con 0x7f520404fba0 2024-09-22T08:38:28.572 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.564+0000 7f520a189640 1 -- 172.21.15.142:0/702206129 <== osd.2 v2:172.21.15.142:6808/279438927 20 ==== osd_op_reply(100 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.7.3 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f51fc01ab20 con 0x7f520404fba0 2024-09-22T08:38:28.572 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.564+0000 7f520c698800 1 -- 172.21.15.142:0/702206129 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:101 4.3f 4:fe3cd964:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.7.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56171b10a0d0 con 0x7f520404fba0 2024-09-22T08:38:28.572 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.564+0000 7f520a189640 1 -- 172.21.15.142:0/702206129 <== osd.2 v2:172.21.15.142:6808/279438927 21 ==== osd_op_reply(101 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.7.4 [call out=430b] v0'0 uv3 ondisk = 0) ==== 194+0+430 (crc 0 0 0) 0x7f51fc01ab20 con 0x7f520404fba0 2024-09-22T08:38:28.572 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.564+0000 7f520c698800 10 cls_bucket_list_unordered: got 15f6f8dc036519d7fe15b39338f6e5db 2024-09-22T08:38:28.573 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.564+0000 7f520c698800 1 -- 172.21.15.142:0/702206129 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:102 4.10 4:0aadc9a7:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.7.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56171b10a0d0 con 0x56171b0450f0 2024-09-22T08:38:28.573 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.564+0000 7f520a98a640 1 -- 172.21.15.142:0/702206129 <== osd.3 v2:172.21.15.142:6800/1064901393 28 ==== osd_op_reply(102 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.7.5 [call out=89b] v0'0 uv5 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f520400a4d0 con 0x56171b0450f0 2024-09-22T08:38:28.573 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.564+0000 7f520c698800 1 -- 172.21.15.142:0/702206129 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:103 4.33 4:cce5f98b:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.7.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56171b10a0d0 con 0x7f51fc017050 2024-09-22T08:38:28.573 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.565+0000 7f5203fff640 1 -- 172.21.15.142:0/702206129 <== osd.0 v2:172.21.15.31:6800/168281188 24 ==== osd_op_reply(103 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.7.6 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f51f4051070 con 0x7f51fc017050 2024-09-22T08:38:28.573 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.565+0000 7f520c698800 1 -- 172.21.15.142:0/702206129 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:104 4.1f 4:fbeaf255:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.7.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56171b10a0d0 con 0x56171b0450f0 2024-09-22T08:38:28.573 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.565+0000 7f520a98a640 1 -- 172.21.15.142:0/702206129 <== osd.3 v2:172.21.15.142:6800/1064901393 29 ==== osd_op_reply(104 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.7.7 [call out=89b] v0'0 uv5 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f520400a4d0 con 0x56171b0450f0 2024-09-22T08:38:28.573 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.565+0000 7f520c698800 1 -- 172.21.15.142:0/702206129 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:105 4.25 4:a78ef44d:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.7.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56171b10a050 con 0x56171b0450f0 2024-09-22T08:38:28.573 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.566+0000 7f520a98a640 1 -- 172.21.15.142:0/702206129 <== osd.3 v2:172.21.15.142:6800/1064901393 30 ==== osd_op_reply(105 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.7.8 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f520400a4d0 con 0x56171b0450f0 2024-09-22T08:38:28.573 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.566+0000 7f520c698800 1 -- 172.21.15.142:0/702206129 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:106 4.5 4:a3e79208:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.7.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56171b10a010 con 0x7f520404fba0 2024-09-22T08:38:28.573 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.566+0000 7f520a189640 1 -- 172.21.15.142:0/702206129 <== osd.2 v2:172.21.15.142:6808/279438927 22 ==== osd_op_reply(106 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.7.9 [call out=89b] v0'0 uv7 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f51fc01ab20 con 0x7f520404fba0 2024-09-22T08:38:28.573 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.566+0000 7f520c698800 1 -- 172.21.15.142:0/702206129 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:107 4.1a 4:5bbb8402:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.7.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56171b10a050 con 0x7f520404fba0 2024-09-22T08:38:28.573 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.566+0000 7f520a189640 1 -- 172.21.15.142:0/702206129 <== osd.2 v2:172.21.15.142:6808/279438927 23 ==== osd_op_reply(107 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.7.10 [call out=89b] v0'0 uv1 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f51fc01ab20 con 0x7f520404fba0 2024-09-22T08:38:28.573 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.566+0000 7f520c698800 20 get_obj_state: octx=0x7f51fc052f40 obj=myfoo:15f6f8dc036519d7fe15b39338f6e5db state=0x56171b108118 s->prefetch_data=0 2024-09-22T08:38:28.573 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.566+0000 7f520c698800 1 -- 172.21.15.142:0/702206129 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:108 3.8 3:119a03ad:::e239248c-0bee-4e41-803a-24b288d3eb8f.4226.7_15f6f8dc036519d7fe15b39338f6e5db:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56171b08d690 con 0x56171b0450f0 2024-09-22T08:38:28.574 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.567+0000 7f520a98a640 1 -- 172.21.15.142:0/702206129 <== osd.3 v2:172.21.15.142:6800/1064901393 31 ==== osd_op_reply(108 e239248c-0bee-4e41-803a-24b288d3eb8f.4226.7_15f6f8dc036519d7fe15b39338f6e5db [call out=24b,getxattrs out=888b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 304+0+928 (crc 0 0 0) 0x7f520400a4d0 con 0x56171b0450f0 2024-09-22T08:38:28.574 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.567+0000 7f520c698800 10 manifest: total_size = 6 2024-09-22T08:38:28.574 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.567+0000 7f520c698800 20 get_obj_state: setting s->obj_tag to e239248c-0bee-4e41-803a-24b288d3eb8f.4226.17888899243424723930 2024-09-22T08:38:28.574 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.567+0000 7f520c698800 20 get_obj_state: octx=0x7f51fc052f40 obj=myfoo:15f6f8dc036519d7fe15b39338f6e5db state=0x56171b108118 s->prefetch_data=0 2024-09-22T08:38:28.574 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.567+0000 7f520c698800 20 prepare_atomic_modification: state is not atomic. state=0x56171b108118 2024-09-22T08:38:28.574 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.567+0000 7f520c698800 20 bucket index object: :.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.7.4 2024-09-22T08:38:28.574 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.567+0000 7f520c698800 1 -- 172.21.15.142:0/702206129 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:109 4.3f 4:fe3cd964:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.7.4:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56171b0911c0 con 0x7f520404fba0 2024-09-22T08:38:28.574 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.568+0000 7f520a189640 1 -- 172.21.15.142:0/702206129 <== osd.2 v2:172.21.15.142:6808/279438927 24 ==== osd_op_reply(109 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.7.4 [stat,call,call] v32'4 uv4 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f51fc01ab20 con 0x7f520404fba0 2024-09-22T08:38:28.574 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.568+0000 7f520c698800 1 -- 172.21.15.142:0/702206129 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:110 3.8 3:119a03ad:::e239248c-0bee-4e41-803a-24b288d3eb8f.4226.7_15f6f8dc036519d7fe15b39338f6e5db:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56171b0911c0 con 0x56171b0450f0 2024-09-22T08:38:28.583 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.569+0000 7f520a98a640 1 -- 172.21.15.142:0/702206129 <== osd.3 v2:172.21.15.142:6800/1064901393 32 ==== osd_op_reply(110 e239248c-0bee-4e41-803a-24b288d3eb8f.4226.7_15f6f8dc036519d7fe15b39338f6e5db [call] v32'4 uv4 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7f520400a4d0 con 0x56171b0450f0 2024-09-22T08:38:28.584 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.569+0000 7f520c698800 1 -- 172.21.15.142:0/702206129 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:111 4.3f 4:fe3cd964:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.7.4:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56171b091c30 con 0x7f520404fba0 2024-09-22T08:38:28.584 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.569+0000 7f520c698800 20 list_objects_ordered: starting attempt 1 2024-09-22T08:38:28.584 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.569+0000 7f520c698800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-22T08:38:28.584 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.569+0000 7f520c698800 1 -- 172.21.15.142:0/702206129 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:112 4.f 4:f1cb2197:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.7.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56171b091c30 con 0x56171b0406e0 2024-09-22T08:38:28.584 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.569+0000 7f520c698800 1 -- 172.21.15.142:0/702206129 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:113 4.1b 4:db34e180:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.7.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56171b095f30 con 0x7f520404fba0 2024-09-22T08:38:28.584 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.569+0000 7f520c698800 1 -- 172.21.15.142:0/702206129 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:114 4.11 4:8a132748:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.7.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56171b098890 con 0x7f51fc017050 2024-09-22T08:38:28.584 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.569+0000 7f520c698800 1 -- 172.21.15.142:0/702206129 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:115 4.18 4:19399d23:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.7.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56171b091c30 con 0x7f520404fba0 2024-09-22T08:38:28.585 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.569+0000 7f520c698800 1 -- 172.21.15.142:0/702206129 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:116 4.3f 4:fe3cd964:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.7.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56171b098890 con 0x7f520404fba0 2024-09-22T08:38:28.585 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.569+0000 7f520c698800 1 -- 172.21.15.142:0/702206129 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:117 4.10 4:0aadc9a7:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.7.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56171b098890 con 0x56171b0450f0 2024-09-22T08:38:28.585 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.569+0000 7f520c698800 1 -- 172.21.15.142:0/702206129 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:118 4.33 4:cce5f98b:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.7.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56171b0a24c0 con 0x7f51fc017050 2024-09-22T08:38:28.585 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.569+0000 7f520c698800 1 -- 172.21.15.142:0/702206129 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:119 4.1f 4:fbeaf255:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.7.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56171b0a5030 con 0x56171b0450f0 2024-09-22T08:38:28.585 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.569+0000 7f520c698800 1 -- 172.21.15.142:0/702206129 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:120 4.25 4:a78ef44d:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.7.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56171b0a7a60 con 0x56171b0450f0 2024-09-22T08:38:28.585 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.569+0000 7f520c698800 1 -- 172.21.15.142:0/702206129 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:121 4.5 4:a3e79208:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.7.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56171b0aa590 con 0x7f520404fba0 2024-09-22T08:38:28.585 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.569+0000 7f520c698800 1 -- 172.21.15.142:0/702206129 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:122 4.1a 4:5bbb8402:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.7.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56171b0acf20 con 0x7f520404fba0 2024-09-22T08:38:28.585 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.569+0000 7f5203fff640 1 -- 172.21.15.142:0/702206129 <== osd.1 v2:172.21.15.142:6816/3192108003 31 ==== osd_op_reply(112 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.7.0 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f51f4051070 con 0x56171b0406e0 2024-09-22T08:38:28.585 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.569+0000 7f5203fff640 1 -- 172.21.15.142:0/702206129 <== osd.0 v2:172.21.15.31:6800/168281188 25 ==== osd_op_reply(114 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.7.2 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f51f4051070 con 0x7f51fc017050 2024-09-22T08:38:28.585 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.569+0000 7f5203fff640 1 -- 172.21.15.142:0/702206129 <== osd.0 v2:172.21.15.31:6800/168281188 26 ==== osd_op_reply(118 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.7.6 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f51f4051070 con 0x7f51fc017050 2024-09-22T08:38:28.585 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.570+0000 7f520a189640 1 -- 172.21.15.142:0/702206129 <== osd.2 v2:172.21.15.142:6808/279438927 25 ==== osd_op_reply(113 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.7.1 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f51fc01ab20 con 0x7f520404fba0 2024-09-22T08:38:28.585 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.570+0000 7f520a189640 1 -- 172.21.15.142:0/702206129 <== osd.2 v2:172.21.15.142:6808/279438927 26 ==== osd_op_reply(115 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.7.3 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f51fc01ab20 con 0x7f520404fba0 2024-09-22T08:38:28.585 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.570+0000 7f520a189640 1 -- 172.21.15.142:0/702206129 <== osd.2 v2:172.21.15.142:6808/279438927 27 ==== osd_op_reply(121 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.7.9 [call out=89b] v0'0 uv7 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f51fc01ab20 con 0x7f520404fba0 2024-09-22T08:38:28.585 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.570+0000 7f520a189640 1 -- 172.21.15.142:0/702206129 <== osd.2 v2:172.21.15.142:6808/279438927 28 ==== osd_op_reply(122 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.7.10 [call out=89b] v0'0 uv1 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f51fc01ab20 con 0x7f520404fba0 2024-09-22T08:38:28.586 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.570+0000 7f520a98a640 1 -- 172.21.15.142:0/702206129 <== osd.3 v2:172.21.15.142:6800/1064901393 33 ==== osd_op_reply(117 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.7.5 [call out=89b] v0'0 uv5 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f520400a4d0 con 0x56171b0450f0 2024-09-22T08:38:28.586 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.570+0000 7f520a98a640 1 -- 172.21.15.142:0/702206129 <== osd.3 v2:172.21.15.142:6800/1064901393 34 ==== osd_op_reply(119 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.7.7 [call out=89b] v0'0 uv5 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f520400a4d0 con 0x56171b0450f0 2024-09-22T08:38:28.586 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.570+0000 7f520a98a640 1 -- 172.21.15.142:0/702206129 <== osd.3 v2:172.21.15.142:6800/1064901393 35 ==== osd_op_reply(120 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.7.8 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f520400a4d0 con 0x56171b0450f0 2024-09-22T08:38:28.586 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.570+0000 7f520a189640 1 -- 172.21.15.142:0/702206129 <== osd.2 v2:172.21.15.142:6808/279438927 29 ==== osd_op_reply(111 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.7.4 [stat,call,call] v32'5 uv5 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f51fc01ab20 con 0x7f520404fba0 2024-09-22T08:38:28.586 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.570+0000 7f50edffb640 20 handle_completion(): completion ok for obj=15f6f8dc036519d7fe15b39338f6e5db 2024-09-22T08:38:28.586 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.570+0000 7f520a189640 1 -- 172.21.15.142:0/702206129 <== osd.2 v2:172.21.15.142:6808/279438927 30 ==== osd_op_reply(116 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.7.4 [call out=128b] v0'0 uv5 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7f51fc01ab20 con 0x7f520404fba0 2024-09-22T08:38:28.586 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.570+0000 7f520c698800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-22T08:38:28.586 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.570+0000 7f520c698800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-22T08:38:28.586 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.570+0000 7f520c698800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-22T08:38:28.586 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.570+0000 7f520c698800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-22T08:38:28.586 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.570+0000 7f520c698800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo[e239248c-0bee-4e41-803a-24b288d3eb8f.4226.7])"; uploads.size()=0; is_truncated=0 2024-09-22T08:38:28.586 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.570+0000 7f520c698800 1 -- 172.21.15.142:0/702206129 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:123 4.f 4:f1cb2197:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.7.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56171b091780 con 0x56171b0406e0 2024-09-22T08:38:28.586 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.570+0000 7f520c698800 1 -- 172.21.15.142:0/702206129 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:124 4.1b 4:db34e180:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.7.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56171b0a2e40 con 0x7f520404fba0 2024-09-22T08:38:28.587 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.570+0000 7f520c698800 1 -- 172.21.15.142:0/702206129 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:125 4.11 4:8a132748:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.7.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56171b0a46f0 con 0x7f51fc017050 2024-09-22T08:38:28.587 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.570+0000 7f520c698800 1 -- 172.21.15.142:0/702206129 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:126 4.18 4:19399d23:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.7.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56171b091760 con 0x7f520404fba0 2024-09-22T08:38:28.587 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.570+0000 7f520c698800 1 -- 172.21.15.142:0/702206129 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:127 4.3f 4:fe3cd964:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.7.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56171b0a46f0 con 0x7f520404fba0 2024-09-22T08:38:28.587 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.570+0000 7f520c698800 1 -- 172.21.15.142:0/702206129 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:128 4.10 4:0aadc9a7:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.7.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56171b0a2e40 con 0x56171b0450f0 2024-09-22T08:38:28.587 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.570+0000 7f520c698800 1 -- 172.21.15.142:0/702206129 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:129 4.33 4:cce5f98b:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.7.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56171b098890 con 0x7f51fc017050 2024-09-22T08:38:28.587 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.570+0000 7f520c698800 1 -- 172.21.15.142:0/702206129 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:130 4.1f 4:fbeaf255:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.7.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56171b091740 con 0x56171b0450f0 2024-09-22T08:38:28.587 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.570+0000 7f520c698800 1 -- 172.21.15.142:0/702206129 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:131 4.25 4:a78ef44d:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.7.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56171b0a46f0 con 0x56171b0450f0 2024-09-22T08:38:28.587 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.570+0000 7f520c698800 1 -- 172.21.15.142:0/702206129 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:132 4.5 4:a3e79208:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.7.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56171b0acf00 con 0x7f520404fba0 2024-09-22T08:38:28.587 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.570+0000 7f520c698800 1 -- 172.21.15.142:0/702206129 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:133 4.1a 4:5bbb8402:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.7.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56171b09bed0 con 0x7f520404fba0 2024-09-22T08:38:28.587 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.571+0000 7f5203fff640 1 -- 172.21.15.142:0/702206129 <== osd.1 v2:172.21.15.142:6816/3192108003 32 ==== osd_op_reply(123 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.7.0 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f51f4051070 con 0x56171b0406e0 2024-09-22T08:38:28.587 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.571+0000 7f520a189640 1 -- 172.21.15.142:0/702206129 <== osd.2 v2:172.21.15.142:6808/279438927 31 ==== osd_op_reply(124 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.7.1 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f51fc01ab20 con 0x7f520404fba0 2024-09-22T08:38:28.587 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.571+0000 7f520a189640 1 -- 172.21.15.142:0/702206129 <== osd.2 v2:172.21.15.142:6808/279438927 32 ==== osd_op_reply(126 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.7.3 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f51fc01ab20 con 0x7f520404fba0 2024-09-22T08:38:28.587 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.571+0000 7f520a189640 1 -- 172.21.15.142:0/702206129 <== osd.2 v2:172.21.15.142:6808/279438927 33 ==== osd_op_reply(127 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.7.4 [call out=128b] v0'0 uv5 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7f51fc01ab20 con 0x7f520404fba0 2024-09-22T08:38:28.587 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.571+0000 7f520a98a640 1 -- 172.21.15.142:0/702206129 <== osd.3 v2:172.21.15.142:6800/1064901393 36 ==== osd_op_reply(128 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.7.5 [call out=89b] v0'0 uv5 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f520400a4d0 con 0x56171b0450f0 2024-09-22T08:38:28.588 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.571+0000 7f5203fff640 1 -- 172.21.15.142:0/702206129 <== osd.0 v2:172.21.15.31:6800/168281188 27 ==== osd_op_reply(125 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.7.2 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f51f4051070 con 0x7f51fc017050 2024-09-22T08:38:28.588 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.571+0000 7f520a98a640 1 -- 172.21.15.142:0/702206129 <== osd.3 v2:172.21.15.142:6800/1064901393 37 ==== osd_op_reply(131 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.7.8 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f520400a4d0 con 0x56171b0450f0 2024-09-22T08:38:28.588 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.571+0000 7f520a98a640 1 -- 172.21.15.142:0/702206129 <== osd.3 v2:172.21.15.142:6800/1064901393 38 ==== osd_op_reply(130 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.7.7 [call out=89b] v0'0 uv5 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f520400a4d0 con 0x56171b0450f0 2024-09-22T08:38:28.588 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.571+0000 7f5203fff640 1 -- 172.21.15.142:0/702206129 <== osd.0 v2:172.21.15.31:6800/168281188 28 ==== osd_op_reply(129 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.7.6 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f51f4051070 con 0x7f51fc017050 2024-09-22T08:38:28.588 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.571+0000 7f520a189640 1 -- 172.21.15.142:0/702206129 <== osd.2 v2:172.21.15.142:6808/279438927 34 ==== osd_op_reply(132 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.7.9 [call out=89b] v0'0 uv7 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f51fc01ab20 con 0x7f520404fba0 2024-09-22T08:38:28.588 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.571+0000 7f520a189640 1 -- 172.21.15.142:0/702206129 <== osd.2 v2:172.21.15.142:6808/279438927 35 ==== osd_op_reply(133 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.7.10 [call out=89b] v0'0 uv1 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f51fc01ab20 con 0x7f520404fba0 2024-09-22T08:38:28.588 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.571+0000 7f520c698800 1 -- 172.21.15.142:0/702206129 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:134 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56171b09bed0 con 0x7f520404fba0 2024-09-22T08:38:28.588 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.572+0000 7f520a189640 1 -- 172.21.15.142:0/702206129 <== osd.2 v2:172.21.15.142:6808/279438927 36 ==== osd_op_reply(134 foo.buckets [call] v32'46 uv46 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f51fc01ab20 con 0x7f520404fba0 2024-09-22T08:38:28.588 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.572+0000 7f520c698800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-22T08:38:28.588 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.572+0000 7f520c698800 20 rados->read ofs=0 len=0 2024-09-22T08:38:28.588 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.572+0000 7f520c698800 1 -- 172.21.15.142:0/702206129 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:135 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56171b09bed0 con 0x7f520404fba0 2024-09-22T08:38:28.588 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.573+0000 7f520a189640 1 -- 172.21.15.142:0/702206129 <== osd.2 v2:172.21.15.142:6808/279438927 37 ==== osd_op_reply(135 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv40 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f51fc01ab20 con 0x7f520404fba0 2024-09-22T08:38:28.588 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.573+0000 7f520c698800 20 rados_obj.operate() r=0 bl.length=165 2024-09-22T08:38:28.588 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.573+0000 7f520c698800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-22T08:38:28.588 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.573+0000 7f520c698800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-22T08:38:28.589 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.573+0000 7f520c698800 1 -- 172.21.15.142:0/702206129 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:136 8.9 8:91b71841:root::myfoo:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56171b09bed0 con 0x7f520404fba0 2024-09-22T08:38:28.589 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.574+0000 7f520a189640 1 -- 172.21.15.142:0/702206129 <== osd.2 v2:172.21.15.142:6808/279438927 38 ==== osd_op_reply(136 myfoo [call,call,delete] v32'47 uv47 ondisk = 0) ==== 233+0+0 (crc 0 0 0) 0x7f51fc01ab20 con 0x7f520404fba0 2024-09-22T08:38:28.589 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.574+0000 7f520c698800 10 removing default.rgw.meta+root+myfoo from cache 2024-09-22T08:38:28.589 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.574+0000 7f520c698800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-22T08:38:28.589 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.574+0000 7f520c698800 1 -- 172.21.15.142:0/702206129 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:137 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94657237895968 in=161b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56171b09bed0 con 0x7f51fc017050 2024-09-22T08:38:28.589 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.574+0000 7f5203fff640 1 -- 172.21.15.142:0/702206129 <== osd.0 v2:172.21.15.31:6800/168281188 29 ==== watch-notify(notify (1) cookie 94657237537168 notify 137438953508 ret 0) ==== 191+0+0 (crc 0 0 0) 0x56171b08c140 con 0x7f51fc017050 2024-09-22T08:38:28.589 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.574+0000 7f50edffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953508 cookie 94657237537168 notifier 4779 bl.length()=149 2024-09-22T08:38:28.589 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.574+0000 7f50edffb640 1 -- 172.21.15.142:0/702206129 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:138 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f50d0003d60 con 0x7f51fc017050 2024-09-22T08:38:28.589 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.574+0000 7f5203fff640 1 -- 172.21.15.142:0/702206129 <== osd.0 v2:172.21.15.31:6800/168281188 30 ==== osd_op_reply(137 notify.6 [notify cookie 94657237895968 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f51f4051070 con 0x7f51fc017050 2024-09-22T08:38:28.589 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.574+0000 7f5203fff640 1 -- 172.21.15.142:0/702206129 <== osd.0 v2:172.21.15.31:6800/168281188 31 ==== osd_op_reply(138 notify.6 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f51f4051070 con 0x7f51fc017050 2024-09-22T08:38:28.589 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.575+0000 7f5203fff640 1 -- 172.21.15.142:0/702206129 <== osd.0 v2:172.21.15.31:6800/168281188 32 ==== watch-notify(notify_complete (2) cookie 94657237895968 notify 137438953508 ret 0) ==== 42+0+48 (crc 0 0 0) 0x56171b0575a0 con 0x7f51fc017050 2024-09-22T08:38:28.589 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.575+0000 7f520c698800 1 -- 172.21.15.142:0/702206129 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:139 8.a 8:54dff4b1:root::.bucket.meta.myfoo%3ae239248c-0bee-4e41-803a-24b288d3eb8f.4226.7:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56171b09bed0 con 0x56171b0406e0 2024-09-22T08:38:28.589 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.576+0000 7f5203fff640 1 -- 172.21.15.142:0/702206129 <== osd.1 v2:172.21.15.142:6816/3192108003 33 ==== osd_op_reply(139 .bucket.meta.myfoo:e239248c-0bee-4e41-803a-24b288d3eb8f.4226.7 [call,call,delete] v32'5 uv5 ondisk = 0) ==== 290+0+0 (crc 0 0 0) 0x7f51f4051070 con 0x56171b0406e0 2024-09-22T08:38:28.589 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.576+0000 7f520c698800 10 removing default.rgw.meta+root+.bucket.meta.myfoo:e239248c-0bee-4e41-803a-24b288d3eb8f.4226.7 from cache 2024-09-22T08:38:28.590 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.576+0000 7f520c698800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo:e239248c-0bee-4e41-803a-24b288d3eb8f.4226.7, ofs0, ns] 2024-09-22T08:38:28.590 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.576+0000 7f520c698800 1 -- 172.21.15.142:0/702206129 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:140 7.e 7:7759931f:::notify.3:head [notify cookie 94657237895968 in=218b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56171b09bed0 con 0x7f520404fba0 2024-09-22T08:38:28.590 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.576+0000 7f520a189640 1 -- 172.21.15.142:0/702206129 <== osd.2 v2:172.21.15.142:6808/279438927 39 ==== watch-notify(notify (1) cookie 94657237542240 notify 137438953508 ret 0) ==== 248+0+0 (crc 0 0 0) 0x56171b05c1e0 con 0x7f520404fba0 2024-09-22T08:38:28.590 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.576+0000 7f50ed7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953508 cookie 94657237542240 notifier 4779 bl.length()=206 2024-09-22T08:38:28.590 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.576+0000 7f50ed7fa640 1 -- 172.21.15.142:0/702206129 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:141 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f50340032c0 con 0x7f520404fba0 2024-09-22T08:38:28.590 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.576+0000 7f520a189640 1 -- 172.21.15.142:0/702206129 <== osd.2 v2:172.21.15.142:6808/279438927 40 ==== osd_op_reply(140 notify.3 [notify cookie 94657237895968 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f51fc01ab20 con 0x7f520404fba0 2024-09-22T08:38:28.590 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.576+0000 7f520a189640 1 -- 172.21.15.142:0/702206129 <== osd.2 v2:172.21.15.142:6808/279438927 41 ==== watch-notify(notify_complete (2) cookie 94657237895968 notify 137438953508 ret 0) ==== 42+0+48 (crc 0 0 0) 0x56171b05e160 con 0x7f520404fba0 2024-09-22T08:38:28.590 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.576+0000 7f520a189640 1 -- 172.21.15.142:0/702206129 <== osd.2 v2:172.21.15.142:6808/279438927 42 ==== osd_op_reply(141 notify.3 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f51fc01ab20 con 0x7f520404fba0 2024-09-22T08:38:28.590 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.576+0000 7f520c698800 1 -- 172.21.15.142:0/702206129 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:142 4.f 4:f1cb2197:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.7.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56171b08cab0 con 0x56171b0406e0 2024-09-22T08:38:28.590 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.576+0000 7f520c698800 1 -- 172.21.15.142:0/702206129 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:143 4.1b 4:db34e180:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.7.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56171b08b480 con 0x7f520404fba0 2024-09-22T08:38:28.590 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.576+0000 7f520c698800 1 -- 172.21.15.142:0/702206129 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:144 4.11 4:8a132748:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.7.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56171b08cab0 con 0x7f51fc017050 2024-09-22T08:38:28.590 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.576+0000 7f520c698800 1 -- 172.21.15.142:0/702206129 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:145 4.18 4:19399d23:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.7.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56171b0a1310 con 0x7f520404fba0 2024-09-22T08:38:28.590 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.577+0000 7f520c698800 1 -- 172.21.15.142:0/702206129 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:146 4.3f 4:fe3cd964:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.7.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56171b08b480 con 0x7f520404fba0 2024-09-22T08:38:28.591 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.577+0000 7f520c698800 1 -- 172.21.15.142:0/702206129 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:147 4.10 4:0aadc9a7:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.7.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56171b0a1310 con 0x56171b0450f0 2024-09-22T08:38:28.591 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.577+0000 7f520c698800 1 -- 172.21.15.142:0/702206129 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:148 4.33 4:cce5f98b:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.7.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56171b08b480 con 0x7f51fc017050 2024-09-22T08:38:28.591 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.577+0000 7f520c698800 1 -- 172.21.15.142:0/702206129 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:149 4.1f 4:fbeaf255:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.7.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56171b0a2990 con 0x56171b0450f0 2024-09-22T08:38:28.591 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.577+0000 7f520c698800 1 -- 172.21.15.142:0/702206129 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:150 4.25 4:a78ef44d:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.7.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56171b0a3330 con 0x56171b0450f0 2024-09-22T08:38:28.591 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.577+0000 7f520c698800 1 -- 172.21.15.142:0/702206129 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:151 4.5 4:a3e79208:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.7.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56171b0a3d40 con 0x7f520404fba0 2024-09-22T08:38:28.591 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.577+0000 7f520c698800 1 -- 172.21.15.142:0/702206129 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:152 4.1a 4:5bbb8402:::.dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.7.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56171b08b480 con 0x7f520404fba0 2024-09-22T08:38:28.591 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.578+0000 7f5203fff640 1 -- 172.21.15.142:0/702206129 <== osd.1 v2:172.21.15.142:6816/3192108003 34 ==== osd_op_reply(142 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.7.0 [delete] v32'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f51f4051070 con 0x56171b0406e0 2024-09-22T08:38:28.591 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.578+0000 7f520a189640 1 -- 172.21.15.142:0/702206129 <== osd.2 v2:172.21.15.142:6808/279438927 43 ==== osd_op_reply(143 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.7.1 [delete] v32'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f51fc01ab20 con 0x7f520404fba0 2024-09-22T08:38:28.591 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.578+0000 7f520a189640 1 -- 172.21.15.142:0/702206129 <== osd.2 v2:172.21.15.142:6808/279438927 44 ==== osd_op_reply(145 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.7.3 [delete] v32'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f51fc01ab20 con 0x7f520404fba0 2024-09-22T08:38:28.591 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.578+0000 7f520a189640 1 -- 172.21.15.142:0/702206129 <== osd.2 v2:172.21.15.142:6808/279438927 45 ==== osd_op_reply(146 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.7.4 [delete] v32'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f51fc01ab20 con 0x7f520404fba0 2024-09-22T08:38:28.591 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.579+0000 7f520a189640 1 -- 172.21.15.142:0/702206129 <== osd.2 v2:172.21.15.142:6808/279438927 46 ==== osd_op_reply(151 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.7.9 [delete] v32'8 uv8 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f51fc01ab20 con 0x7f520404fba0 2024-09-22T08:38:28.592 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.579+0000 7f520a189640 1 -- 172.21.15.142:0/702206129 <== osd.2 v2:172.21.15.142:6808/279438927 47 ==== osd_op_reply(152 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.7.10 [delete] v32'2 uv2 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f51fc01ab20 con 0x7f520404fba0 2024-09-22T08:38:28.592 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.580+0000 7f520a98a640 1 -- 172.21.15.142:0/702206129 <== osd.3 v2:172.21.15.142:6800/1064901393 39 ==== osd_op_reply(149 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.7.7 [delete] v32'8 uv8 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f520400a4d0 con 0x56171b0450f0 2024-09-22T08:38:28.592 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.580+0000 7f520a98a640 1 -- 172.21.15.142:0/702206129 <== osd.3 v2:172.21.15.142:6800/1064901393 40 ==== osd_op_reply(150 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.7.8 [delete] v32'10 uv10 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f520400a4d0 con 0x56171b0450f0 2024-09-22T08:38:28.592 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.581+0000 7f520a98a640 1 -- 172.21.15.142:0/702206129 <== osd.3 v2:172.21.15.142:6800/1064901393 41 ==== osd_op_reply(147 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.7.5 [delete] v32'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f520400a4d0 con 0x56171b0450f0 2024-09-22T08:38:28.592 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.581+0000 7f5203fff640 1 -- 172.21.15.142:0/702206129 <== osd.0 v2:172.21.15.31:6800/168281188 33 ==== osd_op_reply(144 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.7.2 [delete] v32'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f51f4051070 con 0x7f51fc017050 2024-09-22T08:38:28.592 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.581+0000 7f5203fff640 1 -- 172.21.15.142:0/702206129 <== osd.0 v2:172.21.15.31:6800/168281188 34 ==== osd_op_reply(148 .dir.e239248c-0bee-4e41-803a-24b288d3eb8f.4226.7.6 [delete] v32'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f51f4051070 con 0x7f51fc017050 2024-09-22T08:38:28.592 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.581+0000 7f520c698800 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo/e239248c-0bee-4e41-803a-24b288d3eb8f.4226.7 : miss 2024-09-22T08:38:28.592 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.581+0000 7f520c698800 20 rados->read ofs=0 len=0 2024-09-22T08:38:28.592 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.581+0000 7f520c698800 1 -- 172.21.15.142:0/702206129 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:153 6.1 6:83440fc9:::pubsub..bucket.myfoo%2fe239248c-0bee-4e41-803a-24b288d3eb8f.4226.7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56171b08cab0 con 0x56171b0406e0 2024-09-22T08:38:28.592 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.581+0000 7f5203fff640 1 -- 172.21.15.142:0/702206129 <== osd.1 v2:172.21.15.142:6816/3192108003 35 ==== osd_op_reply(153 pubsub..bucket.myfoo/e239248c-0bee-4e41-803a-24b288d3eb8f.4226.7 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 208+0+0 (crc 0 0 0) 0x7f51f4051070 con 0x56171b0406e0 2024-09-22T08:38:28.593 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.581+0000 7f520c698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:28.593 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.581+0000 7f520c698800 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo/e239248c-0bee-4e41-803a-24b288d3eb8f.4226.7 info.flags=0x0 2024-09-22T08:38:28.593 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.581+0000 7f520c698800 10 adding default.rgw.log++pubsub..bucket.myfoo/e239248c-0bee-4e41-803a-24b288d3eb8f.4226.7 to cache LRU end 2024-09-22T08:38:28.593 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.581+0000 7f520c698800 1 -- 172.21.15.142:0/702206129 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:154 6.1 6:83440fc9:::pubsub..bucket.myfoo%2fe239248c-0bee-4e41-803a-24b288d3eb8f.4226.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56171b08cab0 con 0x56171b0406e0 2024-09-22T08:38:28.597 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.583+0000 7f5203fff640 1 -- 172.21.15.142:0/702206129 <== osd.1 v2:172.21.15.142:6816/3192108003 36 ==== osd_op_reply(154 pubsub..bucket.myfoo/e239248c-0bee-4e41-803a-24b288d3eb8f.4226.7 [delete] v32'15 uv14 ondisk = -2 ((2) No such file or directory)) ==== 208+0+0 (crc 0 0 0) 0x7f51f4051070 con 0x56171b0406e0 2024-09-22T08:38:28.597 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.583+0000 7f520c698800 1 -- 172.21.15.142:0/702206129 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:155 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56171b08cab0 con 0x7f520404fba0 2024-09-22T08:38:28.597 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.584+0000 7f520a189640 1 -- 172.21.15.142:0/702206129 <== osd.2 v2:172.21.15.142:6808/279438927 48 ==== osd_op_reply(155 foo.buckets [call] v32'48 uv48 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f51fc01ab20 con 0x7f520404fba0 2024-09-22T08:38:28.598 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.584+0000 7f520c698800 10 removing key index: 9te6NH5mcdcq0Tc5i8i1 2024-09-22T08:38:28.598 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.584+0000 7f520c698800 1 -- 172.21.15.142:0/702206129 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:156 8.7 8:e4e0e270:users.keys::9te6NH5mcdcq0Tc5i8i1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56171b08cab0 con 0x7f51fc017050 2024-09-22T08:38:28.598 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.586+0000 7f5203fff640 1 -- 172.21.15.142:0/702206129 <== osd.0 v2:172.21.15.31:6800/168281188 35 ==== osd_op_reply(156 9te6NH5mcdcq0Tc5i8i1 [delete] v32'2 uv2 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f51f4051070 con 0x7f51fc017050 2024-09-22T08:38:28.598 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.586+0000 7f520c698800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.keys:9te6NH5mcdcq0Tc5i8i1, ofs0, ns] 2024-09-22T08:38:28.598 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.586+0000 7f520c698800 1 -- 172.21.15.142:0/702206129 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:157 7.e 7:7759931f:::notify.3:head [notify cookie 94657237887152 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56171b08b920 con 0x7f520404fba0 2024-09-22T08:38:28.598 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.586+0000 7f520a189640 1 -- 172.21.15.142:0/702206129 <== osd.2 v2:172.21.15.142:6808/279438927 49 ==== watch-notify(notify (1) cookie 94657237542240 notify 137438953509 ret 0) ==== 212+0+0 (crc 0 0 0) 0x56171b05e160 con 0x7f520404fba0 2024-09-22T08:38:28.598 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.586+0000 7f50ed7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953509 cookie 94657237542240 notifier 4779 bl.length()=170 2024-09-22T08:38:28.598 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.586+0000 7f520a189640 1 -- 172.21.15.142:0/702206129 <== osd.2 v2:172.21.15.142:6808/279438927 50 ==== osd_op_reply(157 notify.3 [notify cookie 94657237887152 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f51fc01ab20 con 0x7f520404fba0 2024-09-22T08:38:28.598 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.586+0000 7f50ed7fa640 1 -- 172.21.15.142:0/702206129 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:158 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f50340032c0 con 0x7f520404fba0 2024-09-22T08:38:28.598 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.586+0000 7f520a189640 1 -- 172.21.15.142:0/702206129 <== osd.2 v2:172.21.15.142:6808/279438927 51 ==== osd_op_reply(158 notify.3 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f51fc01ab20 con 0x7f520404fba0 2024-09-22T08:38:28.598 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.586+0000 7f520a189640 1 -- 172.21.15.142:0/702206129 <== osd.2 v2:172.21.15.142:6808/279438927 52 ==== watch-notify(notify_complete (2) cookie 94657237887152 notify 137438953509 ret 0) ==== 42+0+48 (crc 0 0 0) 0x56171b004d80 con 0x7f520404fba0 2024-09-22T08:38:28.598 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.586+0000 7f520c698800 10 removing email index: foo@foo.com 2024-09-22T08:38:28.598 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.586+0000 7f520c698800 1 -- 172.21.15.142:0/702206129 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:159 8.3 8:c162d5d1:users.email::foo@foo.com:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56171b08ca80 con 0x56171b0406e0 2024-09-22T08:38:28.599 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.587+0000 7f5203fff640 1 -- 172.21.15.142:0/702206129 <== osd.1 v2:172.21.15.142:6816/3192108003 37 ==== osd_op_reply(159 foo@foo.com [delete] v32'2 uv2 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f51f4051070 con 0x56171b0406e0 2024-09-22T08:38:28.599 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.587+0000 7f520c698800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.email:foo@foo.com, ofs0, ns] 2024-09-22T08:38:28.599 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.587+0000 7f520c698800 1 -- 172.21.15.142:0/702206129 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:160 7.e 7:7759931f:::notify.3:head [notify cookie 94657237887152 in=174b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56171b08b920 con 0x7f520404fba0 2024-09-22T08:38:28.599 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.588+0000 7f520a189640 1 -- 172.21.15.142:0/702206129 <== osd.2 v2:172.21.15.142:6808/279438927 53 ==== watch-notify(notify (1) cookie 94657237542240 notify 137438953510 ret 0) ==== 204+0+0 (crc 0 0 0) 0x56171b004d80 con 0x7f520404fba0 2024-09-22T08:38:28.599 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.588+0000 7f50edffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953510 cookie 94657237542240 notifier 4779 bl.length()=162 2024-09-22T08:38:28.599 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.588+0000 7f520a189640 1 -- 172.21.15.142:0/702206129 <== osd.2 v2:172.21.15.142:6808/279438927 54 ==== osd_op_reply(160 notify.3 [notify cookie 94657237887152 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f51fc01ab20 con 0x7f520404fba0 2024-09-22T08:38:28.599 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.588+0000 7f50edffb640 1 -- 172.21.15.142:0/702206129 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:161 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f50d0003d60 con 0x7f520404fba0 2024-09-22T08:38:28.599 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.588+0000 7f520a189640 1 -- 172.21.15.142:0/702206129 <== osd.2 v2:172.21.15.142:6808/279438927 55 ==== osd_op_reply(161 notify.3 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f51fc01ab20 con 0x7f520404fba0 2024-09-22T08:38:28.599 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.588+0000 7f520a189640 1 -- 172.21.15.142:0/702206129 <== osd.2 v2:172.21.15.142:6808/279438927 56 ==== watch-notify(notify_complete (2) cookie 94657237887152 notify 137438953510 ret 0) ==== 42+0+48 (crc 0 0 0) 0x56171b004380 con 0x7f520404fba0 2024-09-22T08:38:28.599 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.588+0000 7f520c698800 10 removing user buckets index 2024-09-22T08:38:28.599 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.588+0000 7f520c698800 1 -- 172.21.15.142:0/702206129 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:162 8.9 8:96d98480:users.uid::foo.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56171b08ca80 con 0x7f520404fba0 2024-09-22T08:38:28.599 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.589+0000 7f520a189640 1 -- 172.21.15.142:0/702206129 <== osd.2 v2:172.21.15.142:6808/279438927 57 ==== osd_op_reply(162 foo.buckets [delete] v32'49 uv49 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f51fc01ab20 con 0x7f520404fba0 2024-09-22T08:38:28.599 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.589+0000 7f520c698800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:foo.buckets, ofs0, ns] 2024-09-22T08:38:28.600 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.589+0000 7f520c698800 1 -- 172.21.15.142:0/702206129 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:163 7.3 7:c609908c:::notify.5:head [notify cookie 94657237887152 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56171b08b920 con 0x7f51fc017050 2024-09-22T08:38:28.600 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.589+0000 7f5203fff640 1 -- 172.21.15.142:0/702206129 <== osd.0 v2:172.21.15.31:6800/168281188 36 ==== watch-notify(notify (1) cookie 94657237549856 notify 137438953509 ret 0) ==== 202+0+0 (crc 0 0 0) 0x56171b0575a0 con 0x7f51fc017050 2024-09-22T08:38:28.600 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.589+0000 7f50ed7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953509 cookie 94657237549856 notifier 4779 bl.length()=160 2024-09-22T08:38:28.600 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.589+0000 7f50ed7fa640 1 -- 172.21.15.142:0/702206129 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:164 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f50340032a0 con 0x7f51fc017050 2024-09-22T08:38:28.600 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.589+0000 7f5203fff640 1 -- 172.21.15.142:0/702206129 <== osd.0 v2:172.21.15.31:6800/168281188 37 ==== osd_op_reply(163 notify.5 [notify cookie 94657237887152 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f51f4051070 con 0x7f51fc017050 2024-09-22T08:38:28.600 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.590+0000 7f5203fff640 1 -- 172.21.15.142:0/702206129 <== osd.0 v2:172.21.15.31:6800/168281188 38 ==== osd_op_reply(164 notify.5 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f51f4051070 con 0x7f51fc017050 2024-09-22T08:38:28.600 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.590+0000 7f5203fff640 1 -- 172.21.15.142:0/702206129 <== osd.0 v2:172.21.15.31:6800/168281188 39 ==== watch-notify(notify_complete (2) cookie 94657237887152 notify 137438953509 ret 0) ==== 42+0+48 (crc 0 0 0) 0x56171b057360 con 0x7f51fc017050 2024-09-22T08:38:28.600 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.590+0000 7f520c698800 10 removing user index: foo 2024-09-22T08:38:28.600 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.590+0000 7f520c698800 1 -- 172.21.15.142:0/702206129 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:165 8.18 8:1e6ca5ed:users.uid::foo:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56171b08ca80 con 0x56171b0406e0 2024-09-22T08:38:28.600 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.591+0000 7f5203fff640 1 -- 172.21.15.142:0/702206129 <== osd.1 v2:172.21.15.142:6816/3192108003 38 ==== osd_op_reply(165 foo [call,call,delete] v32'19 uv19 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f51f4051070 con 0x56171b0406e0 2024-09-22T08:38:28.600 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.591+0000 7f520c698800 10 removing default.rgw.meta+users.uid+foo from cache 2024-09-22T08:38:28.600 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.591+0000 7f520c698800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-22T08:38:28.600 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.591+0000 7f520c698800 1 -- 172.21.15.142:0/702206129 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:166 7.d 7:b4812045:::notify.4:head [notify cookie 94657237887152 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56171b08b920 con 0x56171b0406e0 2024-09-22T08:38:28.601 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.591+0000 7f5203fff640 1 -- 172.21.15.142:0/702206129 <== osd.1 v2:172.21.15.142:6816/3192108003 39 ==== watch-notify(notify (1) cookie 94657237544512 notify 137438953490 ret 0) ==== 194+0+0 (crc 0 0 0) 0x56171b057360 con 0x56171b0406e0 2024-09-22T08:38:28.601 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.591+0000 7f50edffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953490 cookie 94657237544512 notifier 4779 bl.length()=152 2024-09-22T08:38:28.601 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.591+0000 7f5203fff640 1 -- 172.21.15.142:0/702206129 <== osd.1 v2:172.21.15.142:6816/3192108003 40 ==== osd_op_reply(166 notify.4 [notify cookie 94657237887152 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f51f4051070 con 0x56171b0406e0 2024-09-22T08:38:28.601 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.591+0000 7f50edffb640 1 -- 172.21.15.142:0/702206129 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:167 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f50d0003d60 con 0x56171b0406e0 2024-09-22T08:38:28.601 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.591+0000 7f5203fff640 1 -- 172.21.15.142:0/702206129 <== osd.1 v2:172.21.15.142:6816/3192108003 41 ==== osd_op_reply(167 notify.4 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f51f4051070 con 0x56171b0406e0 2024-09-22T08:38:28.601 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.591+0000 7f5203fff640 1 -- 172.21.15.142:0/702206129 <== osd.1 v2:172.21.15.142:6816/3192108003 42 ==== watch-notify(notify_complete (2) cookie 94657237887152 notify 137438953490 ret 0) ==== 42+0+48 (crc 0 0 0) 0x56171b05de50 con 0x56171b0406e0 2024-09-22T08:38:28.601 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.592+0000 7f50c17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:38:28.601 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.592+0000 7f520c698800 1 -- 172.21.15.142:0/702206129 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:168 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94657237567840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56171b05b1a0 con 0x56171b0406e0 2024-09-22T08:38:28.601 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.593+0000 7f5203fff640 1 -- 172.21.15.142:0/702206129 <== osd.1 v2:172.21.15.142:6816/3192108003 43 ==== osd_op_reply(168 data_loggenerations_metadata [watch unwatch cookie 94657237567840] v32'237 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f51f4051070 con 0x56171b0406e0 2024-09-22T08:38:28.601 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.593+0000 7f520c698800 1 -- 172.21.15.142:0/702206129 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:169 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94657237530672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56171b054960 con 0x7f520404fba0 2024-09-22T08:38:28.601 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.594+0000 7f520a189640 1 -- 172.21.15.142:0/702206129 <== osd.2 v2:172.21.15.142:6808/279438927 58 ==== osd_op_reply(169 notify.0 [watch unwatch cookie 94657237530672] v32'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f51fc01ab20 con 0x7f520404fba0 2024-09-22T08:38:28.601 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.594+0000 7f520c698800 20 remove_watcher() i=0 2024-09-22T08:38:28.601 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.594+0000 7f520c698800 2 removed watcher, disabling cache 2024-09-22T08:38:28.601 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.594+0000 7f520c698800 1 -- 172.21.15.142:0/702206129 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:170 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94657237536112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56171b04b830 con 0x56171b0406e0 2024-09-22T08:38:28.603 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.596+0000 7f5203fff640 1 -- 172.21.15.142:0/702206129 <== osd.1 v2:172.21.15.142:6816/3192108003 44 ==== osd_op_reply(170 notify.1 [watch unwatch cookie 94657237536112] v32'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f51f4051070 con 0x56171b0406e0 2024-09-22T08:38:28.605 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.596+0000 7f520c698800 20 remove_watcher() i=1 2024-09-22T08:38:28.606 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.596+0000 7f520c698800 1 -- 172.21.15.142:0/702206129 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:171 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94657237540144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56171b04cd70 con 0x56171b0450f0 2024-09-22T08:38:28.606 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.597+0000 7f520a98a640 1 -- 172.21.15.142:0/702206129 <== osd.3 v2:172.21.15.142:6800/1064901393 42 ==== osd_op_reply(171 notify.2 [watch unwatch cookie 94657237540144] v32'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f520400a4d0 con 0x56171b0450f0 2024-09-22T08:38:28.606 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.597+0000 7f520c698800 20 remove_watcher() i=2 2024-09-22T08:38:28.606 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.597+0000 7f520c698800 1 -- 172.21.15.142:0/702206129 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:172 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94657237542240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56171b04cd70 con 0x7f520404fba0 2024-09-22T08:38:28.606 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.598+0000 7f520a189640 1 -- 172.21.15.142:0/702206129 <== osd.2 v2:172.21.15.142:6808/279438927 59 ==== osd_op_reply(172 notify.3 [watch unwatch cookie 94657237542240] v32'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f51fc01ab20 con 0x7f520404fba0 2024-09-22T08:38:28.606 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.598+0000 7f520c698800 20 remove_watcher() i=3 2024-09-22T08:38:28.606 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.598+0000 7f520c698800 1 -- 172.21.15.142:0/702206129 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:173 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94657237544512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56171b04cd70 con 0x56171b0406e0 2024-09-22T08:38:28.606 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.599+0000 7f5203fff640 1 -- 172.21.15.142:0/702206129 <== osd.1 v2:172.21.15.142:6816/3192108003 45 ==== osd_op_reply(173 notify.4 [watch unwatch cookie 94657237544512] v32'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f51f4051070 con 0x56171b0406e0 2024-09-22T08:38:28.606 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.599+0000 7f520c698800 20 remove_watcher() i=4 2024-09-22T08:38:28.606 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.599+0000 7f520c698800 1 -- 172.21.15.142:0/702206129 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:174 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94657237549856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56171b04cd70 con 0x7f51fc017050 2024-09-22T08:38:28.606 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.600+0000 7f5203fff640 1 -- 172.21.15.142:0/702206129 <== osd.0 v2:172.21.15.31:6800/168281188 40 ==== osd_op_reply(174 notify.5 [watch unwatch cookie 94657237549856] v32'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f51f4051070 con 0x7f51fc017050 2024-09-22T08:38:28.607 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.600+0000 7f520c698800 20 remove_watcher() i=5 2024-09-22T08:38:28.607 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.600+0000 7f520c698800 1 -- 172.21.15.142:0/702206129 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:175 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94657237537168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56171b050320 con 0x7f51fc017050 2024-09-22T08:38:28.609 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.601+0000 7f5203fff640 1 -- 172.21.15.142:0/702206129 <== osd.0 v2:172.21.15.31:6800/168281188 41 ==== osd_op_reply(175 notify.6 [watch unwatch cookie 94657237537168] v32'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f51f4051070 con 0x7f51fc017050 2024-09-22T08:38:28.610 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.601+0000 7f520c698800 20 remove_watcher() i=6 2024-09-22T08:38:28.610 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.601+0000 7f520c698800 1 -- 172.21.15.142:0/702206129 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:176 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94657237553408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56171b050320 con 0x7f51fc017050 2024-09-22T08:38:28.610 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.602+0000 7f5203fff640 1 -- 172.21.15.142:0/702206129 <== osd.0 v2:172.21.15.31:6800/168281188 42 ==== osd_op_reply(176 notify.7 [watch unwatch cookie 94657237553408] v32'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f51f4051070 con 0x7f51fc017050 2024-09-22T08:38:28.610 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.602+0000 7f520c698800 20 remove_watcher() i=7 2024-09-22T08:38:28.610 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.603+0000 7f520c698800 1 -- 172.21.15.142:0/702206129 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f51fc017050 msgr2=0x7f51fc04b890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:28.610 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.603+0000 7f520c698800 1 --2- 172.21.15.142:0/702206129 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f51fc017050 0x7f51fc04b890 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:28.610 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.603+0000 7f520c698800 1 -- 172.21.15.142:0/702206129 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x56171b0406e0 msgr2=0x56171b042ba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:28.610 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.603+0000 7f520c698800 1 --2- 172.21.15.142:0/702206129 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x56171b0406e0 0x56171b042ba0 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:28.610 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.603+0000 7f520c698800 1 -- 172.21.15.142:0/702206129 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f520404fba0 msgr2=0x7f52040429c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:28.610 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.603+0000 7f520c698800 1 --2- 172.21.15.142:0/702206129 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f520404fba0 0x7f52040429c0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:28.610 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.603+0000 7f520c698800 1 -- 172.21.15.142:0/702206129 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x56171b0450f0 msgr2=0x56171b0474e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:28.610 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.603+0000 7f520c698800 1 --2- 172.21.15.142:0/702206129 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x56171b0450f0 0x56171b0474e0 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:28.610 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.603+0000 7f520c698800 1 -- 172.21.15.142:0/702206129 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f50d403d000 msgr2=0x7f50d403f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:28.611 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.603+0000 7f520c698800 1 --2- 172.21.15.142:0/702206129 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f50d403d000 0x7f50d403f4c0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f51fc001250 tx=0x7f51fc051000 comp rx=0 tx=0).stop 2024-09-22T08:38:28.611 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.603+0000 7f5203fff640 1 -- 172.21.15.142:0/702206129 reap_dead start 2024-09-22T08:38:28.611 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.603+0000 7f520c698800 1 -- 172.21.15.142:0/702206129 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56171af0b840 msgr2=0x56171b034dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:28.611 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.603+0000 7f520c698800 1 --2- 172.21.15.142:0/702206129 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56171af0b840 0x56171b034dc0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f520400afe0 tx=0x7f52040547b0 comp rx=0 tx=0).stop 2024-09-22T08:38:28.611 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.603+0000 7f520c698800 1 -- 172.21.15.142:0/702206129 shutdown_connections 2024-09-22T08:38:28.611 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.603+0000 7f520c698800 1 --2- 172.21.15.142:0/702206129 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56171af0b840 0x56171b034dc0 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:28.611 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.603+0000 7f520c698800 1 -- 172.21.15.142:0/702206129 >> 172.21.15.142:0/702206129 conn(0x56171b027a00 msgr2=0x56171b025c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:38:28.611 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.603+0000 7f520c698800 1 -- 172.21.15.142:0/702206129 shutdown_connections 2024-09-22T08:38:28.611 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.603+0000 7f520c698800 1 -- 172.21.15.142:0/702206129 wait complete. 2024-09-22T08:38:28.611 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.603+0000 7f520c698800 1 -- 172.21.15.142:0/2701820240 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f50e403d000 msgr2=0x7f50e403f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:28.611 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.603+0000 7f520c698800 1 --2- 172.21.15.142:0/2701820240 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f50e403d000 0x7f50e403f4c0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x56171b005c90 tx=0x7f51fc0529c0 comp rx=0 tx=0).stop 2024-09-22T08:38:28.611 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.603+0000 7f520c698800 1 -- 172.21.15.142:0/2701820240 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56171b01eb80 msgr2=0x56171b01efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:28.611 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.603+0000 7f520c698800 1 --2- 172.21.15.142:0/2701820240 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56171b01eb80 0x56171b01efa0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x56171b004a20 tx=0x7f52040167b0 comp rx=0 tx=0).stop 2024-09-22T08:38:28.611 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.603+0000 7f520c698800 1 -- 172.21.15.142:0/2701820240 shutdown_connections 2024-09-22T08:38:28.611 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.603+0000 7f520c698800 1 --2- 172.21.15.142:0/2701820240 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f50e403d000 0x7f50e403f4c0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:28.612 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.603+0000 7f520c698800 1 --2- 172.21.15.142:0/2701820240 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56171b01eb80 0x56171b01efa0 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:28.612 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.603+0000 7f520c698800 1 -- 172.21.15.142:0/2701820240 >> 172.21.15.142:0/2701820240 conn(0x56171b012f30 msgr2=0x56171b013310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:38:28.612 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.603+0000 7f520c698800 1 -- 172.21.15.142:0/2701820240 shutdown_connections 2024-09-22T08:38:28.612 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.603+0000 7f520c698800 1 -- 172.21.15.142:0/2701820240 wait complete. 2024-09-22T08:38:28.612 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.604+0000 7f520c698800 1 -- 172.21.15.142:0/1518073448 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x56171af0afe0 msgr2=0x56171b00b1e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:28.612 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.604+0000 7f520c698800 1 --2- 172.21.15.142:0/1518073448 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x56171af0afe0 0x56171b00b1e0 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:28.612 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.604+0000 7f520c698800 1 -- 172.21.15.142:0/1518073448 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x56171b00d580 msgr2=0x56171b00fa20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:28.612 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.604+0000 7f520c698800 1 --2- 172.21.15.142:0/1518073448 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x56171b00d580 0x56171b00fa20 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:28.612 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.604+0000 7f520c698800 1 -- 172.21.15.142:0/1518073448 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f50f003cfb0 msgr2=0x7f50f003f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:28.612 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.604+0000 7f520c698800 1 --2- 172.21.15.142:0/1518073448 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f50f003cfb0 0x7f50f003f470 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f51f4057000 tx=0x7f51f4052000 comp rx=0 tx=0).stop 2024-09-22T08:38:28.612 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.604+0000 7f520c698800 1 -- 172.21.15.142:0/1518073448 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56171af0abe0 msgr2=0x56171b003b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:28.612 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.604+0000 7f520c698800 1 --2- 172.21.15.142:0/1518073448 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56171af0abe0 0x56171b003b90 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f51fc00c010 tx=0x7f51fc000ed0 comp rx=0 tx=0).stop 2024-09-22T08:38:28.612 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.604+0000 7f520c698800 1 -- 172.21.15.142:0/1518073448 shutdown_connections 2024-09-22T08:38:28.612 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.604+0000 7f520c698800 1 --2- 172.21.15.142:0/1518073448 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x56171b00d580 0x56171b00fa20 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:28.612 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.604+0000 7f520c698800 1 --2- 172.21.15.142:0/1518073448 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x56171af0afe0 0x56171b00b1e0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:28.613 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.604+0000 7f520c698800 1 --2- 172.21.15.142:0/1518073448 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f50f003cfb0 0x7f50f003f470 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:28.613 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.604+0000 7f520c698800 1 --2- 172.21.15.142:0/1518073448 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56171af0abe0 0x56171b003b90 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:28.613 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.604+0000 7f520c698800 1 -- 172.21.15.142:0/1518073448 >> 172.21.15.142:0/1518073448 conn(0x56171af06310 msgr2=0x56171affd510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:38:28.613 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.604+0000 7f520c698800 1 -- 172.21.15.142:0/1518073448 shutdown_connections 2024-09-22T08:38:28.613 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.604+0000 7f520c698800 1 -- 172.21.15.142:0/1518073448 wait complete. 2024-09-22T08:38:28.615 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-22T08:38:28.615 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-22T08:38:28.615 DEBUG:teuthology.orchestra.run.smithi142:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-22T08:38:28.660 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:38:28.660 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:38:28.661 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.658+0000 7f434fe2b800 1 Processor -- start 2024-09-22T08:38:28.661 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.658+0000 7f434fe2b800 1 -- start start 2024-09-22T08:38:28.661 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.658+0000 7f434fe2b800 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55cd497c89e0 0x55cd497c95a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:28.661 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.658+0000 7f434fe2b800 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55cd49653a20 con 0x55cd497c9ae0 2024-09-22T08:38:28.661 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.658+0000 7f434fe2b800 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x55cd496537d0 con 0x55cd497c89e0 2024-09-22T08:38:28.661 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.659+0000 7f434d915640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55cd497c89e0 0x55cd497c95a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:28.661 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.659+0000 7f434d114640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x55cd497c9ae0 0x55cd497ce630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.142:50404/0 (socket says 172.21.15.142:50404) 2024-09-22T08:38:28.661 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.659+0000 7f434d114640 1 -- 172.21.15.142:0/3428075423 learned_addr learned my addr 172.21.15.142:0/3428075423 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-09-22T08:38:28.662 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.659+0000 7f434d915640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55cd497c89e0 0x55cd497c95a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:51234/0 (socket says 172.21.15.142:51234) 2024-09-22T08:38:28.662 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.659+0000 7f434d915640 1 -- 172.21.15.142:0/3428075423 >> v1:172.21.15.31:6789/0 conn(0x55cd497c9ae0 legacy=0x55cd497ce630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:28.662 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.659+0000 7f434d915640 1 -- 172.21.15.142:0/3428075423 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cd497c90e0 con 0x55cd497c89e0 2024-09-22T08:38:28.663 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.661+0000 7f434d915640 1 --2- 172.21.15.142:0/3428075423 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cd497c89e0 0x55cd497c95a0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f4340005fd0 tx=0x7f4340045c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=500e78ef8c12dc72 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:28.663 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.661+0000 7f434c913640 1 -- 172.21.15.142:0/3428075423 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4340058530 con 0x55cd497c89e0 2024-09-22T08:38:28.663 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.661+0000 7f434c913640 1 -- 172.21.15.142:0/3428075423 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43400586d0 con 0x55cd497c89e0 2024-09-22T08:38:28.663 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.661+0000 7f434c913640 1 -- 172.21.15.142:0/3428075423 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f43400589d0 con 0x55cd497c89e0 2024-09-22T08:38:28.664 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.661+0000 7f434fe2b800 1 -- 172.21.15.142:0/3428075423 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cd497c89e0 msgr2=0x55cd497c95a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:28.664 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.661+0000 7f434fe2b800 1 --2- 172.21.15.142:0/3428075423 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cd497c89e0 0x55cd497c95a0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f4340005fd0 tx=0x7f4340045c30 comp rx=0 tx=0).stop 2024-09-22T08:38:28.664 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.661+0000 7f434fe2b800 1 -- 172.21.15.142:0/3428075423 shutdown_connections 2024-09-22T08:38:28.664 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.661+0000 7f434fe2b800 1 --2- 172.21.15.142:0/3428075423 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cd497c89e0 0x55cd497c95a0 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:28.664 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.661+0000 7f434fe2b800 1 -- 172.21.15.142:0/3428075423 >> 172.21.15.142:0/3428075423 conn(0x55cd497c3db0 msgr2=0x55cd497c6210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:38:28.664 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.662+0000 7f434fe2b800 1 -- 172.21.15.142:0/3428075423 shutdown_connections 2024-09-22T08:38:28.664 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.662+0000 7f434fe2b800 1 -- 172.21.15.142:0/3428075423 wait complete. 2024-09-22T08:38:28.678 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.675+0000 7f434fe2b800 1 Processor -- start 2024-09-22T08:38:28.678 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.675+0000 7f434fe2b800 1 -- start start 2024-09-22T08:38:28.678 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.675+0000 7f434fe2b800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cd497c89e0 0x55cd498b7fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:28.678 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.675+0000 7f434fe2b800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55cd49660dd0 con 0x55cd497c89e0 2024-09-22T08:38:28.678 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.676+0000 7f434d915640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cd497c89e0 0x55cd498b7fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:28.678 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.676+0000 7f434d915640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cd497c89e0 0x55cd498b7fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:51250/0 (socket says 172.21.15.142:51250) 2024-09-22T08:38:28.679 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.676+0000 7f434d915640 1 -- 172.21.15.142:0/49161847 learned_addr learned my addr 172.21.15.142:0/49161847 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:38:28.679 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.676+0000 7f434d915640 1 -- 172.21.15.142:0/49161847 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cd498b85d0 con 0x55cd497c89e0 2024-09-22T08:38:28.681 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.676+0000 7f434d915640 1 --2- 172.21.15.142:0/49161847 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cd497c89e0 0x55cd498b7fe0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f4340025a60 tx=0x7f4340051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7fcf67e2144c5fc server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:28.681 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.677+0000 7f423be07640 1 -- 172.21.15.142:0/49161847 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f43400589b0 con 0x55cd497c89e0 2024-09-22T08:38:28.681 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.677+0000 7f423be07640 1 -- 172.21.15.142:0/49161847 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4340068070 con 0x55cd497c89e0 2024-09-22T08:38:28.681 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.677+0000 7f423be07640 1 -- 172.21.15.142:0/49161847 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4340058c80 con 0x55cd497c89e0 2024-09-22T08:38:28.681 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.677+0000 7f434fe2b800 1 -- 172.21.15.142:0/49161847 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cd497c89e0 msgr2=0x55cd498b7fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:28.682 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.677+0000 7f434fe2b800 1 --2- 172.21.15.142:0/49161847 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cd497c89e0 0x55cd498b7fe0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f4340025a60 tx=0x7f4340051000 comp rx=0 tx=0).stop 2024-09-22T08:38:28.682 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.677+0000 7f434fe2b800 1 -- 172.21.15.142:0/49161847 shutdown_connections 2024-09-22T08:38:28.682 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.677+0000 7f434fe2b800 1 --2- 172.21.15.142:0/49161847 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cd497c89e0 0x55cd498b7fe0 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:28.682 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.677+0000 7f434fe2b800 1 -- 172.21.15.142:0/49161847 >> 172.21.15.142:0/49161847 conn(0x55cd497c3db0 msgr2=0x55cd498b3960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:38:28.682 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.677+0000 7f434fe2b800 1 -- 172.21.15.142:0/49161847 shutdown_connections 2024-09-22T08:38:28.682 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.677+0000 7f434fe2b800 1 -- 172.21.15.142:0/49161847 wait complete. 2024-09-22T08:38:28.682 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.678+0000 7f434fe2b800 1 Processor -- start 2024-09-22T08:38:28.682 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.678+0000 7f434fe2b800 1 -- start start 2024-09-22T08:38:28.682 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.678+0000 7f434fe2b800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cd497c89e0 0x55cd498bfa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:28.682 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.678+0000 7f434fe2b800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55cd497ca350 con 0x55cd497c89e0 2024-09-22T08:38:28.682 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.678+0000 7f434d915640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cd497c89e0 0x55cd498bfa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:28.682 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.678+0000 7f434d915640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cd497c89e0 0x55cd498bfa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:51258/0 (socket says 172.21.15.142:51258) 2024-09-22T08:38:28.683 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.678+0000 7f434d915640 1 -- 172.21.15.142:0/3620839344 learned_addr learned my addr 172.21.15.142:0/3620839344 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:38:28.683 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.678+0000 7f434d915640 1 -- 172.21.15.142:0/3620839344 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cd498bff80 con 0x55cd497c89e0 2024-09-22T08:38:28.683 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.678+0000 7f434d915640 1 --2- 172.21.15.142:0/3620839344 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cd497c89e0 0x55cd498bfa20 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f4340025a60 tx=0x7f4340003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:28.683 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.679+0000 7f423a604640 1 -- 172.21.15.142:0/3620839344 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4340063650 con 0x55cd497c89e0 2024-09-22T08:38:28.683 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.679+0000 7f423a604640 1 -- 172.21.15.142:0/3620839344 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43400637f0 con 0x55cd497c89e0 2024-09-22T08:38:28.683 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.679+0000 7f434fe2b800 1 -- 172.21.15.142:0/3620839344 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55cd498c0210 con 0x55cd497c89e0 2024-09-22T08:38:28.683 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.679+0000 7f423a604640 1 -- 172.21.15.142:0/3620839344 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4340063af0 con 0x55cd497c89e0 2024-09-22T08:38:28.683 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.679+0000 7f434fe2b800 1 -- 172.21.15.142:0/3620839344 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cd498c0e20 con 0x55cd497c89e0 2024-09-22T08:38:28.686 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.679+0000 7f423a604640 1 -- 172.21.15.142:0/3620839344 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f4340063c90 con 0x55cd497c89e0 2024-09-22T08:38:28.686 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.680+0000 7f423a604640 1 --2- 172.21.15.142:0/3620839344 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f423403d000 0x7f423403f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:28.686 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.680+0000 7f423a604640 1 -- 172.21.15.142:0/3620839344 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5938+0+0 (secure 0 0 0) 0x7f43400987a0 con 0x55cd497c89e0 2024-09-22T08:38:28.687 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.680+0000 7f434d114640 1 --2- 172.21.15.142:0/3620839344 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f423403d000 0x7f423403f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:28.687 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.680+0000 7f434fe2b800 1 --2- 172.21.15.142:0/3620839344 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55cd497c9ae0 0x55cd498c7070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:28.687 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.680+0000 7f434fe2b800 1 -- 172.21.15.142:0/3620839344 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cd498c75b0 con 0x55cd497c9ae0 2024-09-22T08:38:28.687 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.680+0000 7f434e116640 1 --2- 172.21.15.142:0/3620839344 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55cd497c9ae0 0x55cd498c7070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:28.687 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.680+0000 7f434d114640 1 --2- 172.21.15.142:0/3620839344 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f423403d000 0x7f423403f4c0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f4338001d70 tx=0x7f43380012d0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:28.687 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.680+0000 7f434e116640 1 --2- 172.21.15.142:0/3620839344 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55cd497c9ae0 0x55cd498c7070 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:28.687 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.681+0000 7f434e116640 1 -- 172.21.15.142:0/3620839344 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f43480083e0 con 0x55cd497c9ae0 2024-09-22T08:38:28.687 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.681+0000 7f434fe2b800 1 -- 172.21.15.142:0/3620839344 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cd498c7950 con 0x55cd497c9ae0 2024-09-22T08:38:28.687 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.681+0000 7f434e116640 1 -- 172.21.15.142:0/3620839344 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f43480083e0 con 0x55cd497c9ae0 2024-09-22T08:38:28.687 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.681+0000 7f434fe2b800 1 --2- 172.21.15.142:0/3620839344 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55cd498c9410 0x55cd498cb8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:28.687 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.681+0000 7f434fe2b800 1 -- 172.21.15.142:0/3620839344 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:3 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cd498cc040 con 0x55cd498c9410 2024-09-22T08:38:28.687 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.681+0000 7f434d915640 1 --2- 172.21.15.142:0/3620839344 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55cd498c9410 0x55cd498cb8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:28.687 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.681+0000 7f434d915640 1 --2- 172.21.15.142:0/3620839344 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55cd498c9410 0x55cd498cb8b0 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:28.687 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.681+0000 7f434d915640 1 -- 172.21.15.142:0/3620839344 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(3 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f43400743e0 con 0x55cd498c9410 2024-09-22T08:38:28.688 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.682+0000 7f434fe2b800 1 -- 172.21.15.142:0/3620839344 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cd498c81a0 con 0x55cd497c9ae0 2024-09-22T08:38:28.688 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.682+0000 7f434e116640 1 -- 172.21.15.142:0/3620839344 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f43480083e0 con 0x55cd497c9ae0 2024-09-22T08:38:28.688 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.682+0000 7f434fe2b800 1 -- 172.21.15.142:0/3620839344 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cd498c8580 con 0x55cd498c9410 2024-09-22T08:38:28.688 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.682+0000 7f434d915640 1 -- 172.21.15.142:0/3620839344 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(5 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f43400743e0 con 0x55cd498c9410 2024-09-22T08:38:28.688 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.682+0000 7f434fe2b800 1 Processor -- start 2024-09-22T08:38:28.688 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.683+0000 7f434fe2b800 1 -- start start 2024-09-22T08:38:28.688 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.683+0000 7f434fe2b800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cd498daa20 0x55cd498dae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:28.688 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.683+0000 7f434fe2b800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55cd496bfd50 con 0x55cd498daa20 2024-09-22T08:38:28.688 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.683+0000 7f434e116640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cd498daa20 0x55cd498dae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:28.688 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.683+0000 7f434e116640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cd498daa20 0x55cd498dae40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:51274/0 (socket says 172.21.15.142:51274) 2024-09-22T08:38:28.688 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.683+0000 7f434e116640 1 -- 172.21.15.142:0/3925415877 learned_addr learned my addr 172.21.15.142:0/3925415877 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:38:28.688 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.683+0000 7f434e116640 1 -- 172.21.15.142:0/3925415877 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cd498db480 con 0x55cd498daa20 2024-09-22T08:38:28.688 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.684+0000 7f434e116640 1 --2- 172.21.15.142:0/3925415877 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cd498daa20 0x55cd498dae40 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x55cd498c1910 tx=0x7f434800bf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:28.688 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.684+0000 7f42337fe640 1 -- 172.21.15.142:0/3925415877 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f434801c020 con 0x55cd498daa20 2024-09-22T08:38:28.689 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.684+0000 7f42337fe640 1 -- 172.21.15.142:0/3925415877 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4348007c90 con 0x55cd498daa20 2024-09-22T08:38:28.689 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.684+0000 7f434fe2b800 1 -- 172.21.15.142:0/3925415877 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55cd498dbcb0 con 0x55cd498daa20 2024-09-22T08:38:28.689 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.684+0000 7f42337fe640 1 -- 172.21.15.142:0/3925415877 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4348018440 con 0x55cd498daa20 2024-09-22T08:38:28.689 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.684+0000 7f434fe2b800 1 -- 172.21.15.142:0/3925415877 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cd498dc250 con 0x55cd498daa20 2024-09-22T08:38:28.696 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.685+0000 7f42337fe640 1 -- 172.21.15.142:0/3925415877 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f434801f020 con 0x55cd498daa20 2024-09-22T08:38:28.696 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.685+0000 7f42337fe640 1 --2- 172.21.15.142:0/3925415877 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f422803d000 0x7f422803f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:28.696 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.685+0000 7f42337fe640 1 -- 172.21.15.142:0/3925415877 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5938+0+0 (secure 0 0 0) 0x7f43480559d0 con 0x55cd498daa20 2024-09-22T08:38:28.697 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.685+0000 7f434d915640 1 --2- 172.21.15.142:0/3925415877 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f422803d000 0x7f422803f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:28.697 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.685+0000 7f434fe2b800 1 Processor -- start 2024-09-22T08:38:28.697 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.686+0000 7f434fe2b800 1 -- start start 2024-09-22T08:38:28.697 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.686+0000 7f434d915640 1 --2- 172.21.15.142:0/3925415877 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f422803d000 0x7f422803f4c0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x55cd498cc3e0 tx=0x7f434007e600 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:28.697 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.686+0000 7f434fe2b800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cd4973cb40 0x55cd4973cf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:28.697 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.686+0000 7f434fe2b800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55cd498b8940 con 0x55cd4973cb40 2024-09-22T08:38:28.697 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.686+0000 7f434e116640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cd4973cb40 0x55cd4973cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:28.697 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.686+0000 7f434e116640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cd4973cb40 0x55cd4973cf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:51288/0 (socket says 172.21.15.142:51288) 2024-09-22T08:38:28.697 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.686+0000 7f434e116640 1 -- 172.21.15.142:0/383165580 learned_addr learned my addr 172.21.15.142:0/383165580 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:38:28.697 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.686+0000 7f434e116640 1 -- 172.21.15.142:0/383165580 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cd4973d530 con 0x55cd4973cb40 2024-09-22T08:38:28.697 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.686+0000 7f434e116640 1 --2- 172.21.15.142:0/383165580 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cd4973cb40 0x55cd4973cf40 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f4348017f70 tx=0x7f43480175a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f52cd9e4d29e9e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:28.697 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.686+0000 7f42317fa640 1 -- 172.21.15.142:0/383165580 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f434804a070 con 0x55cd4973cb40 2024-09-22T08:38:28.697 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.686+0000 7f42317fa640 1 -- 172.21.15.142:0/383165580 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4348015e80 con 0x55cd4973cb40 2024-09-22T08:38:28.697 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.686+0000 7f42317fa640 1 -- 172.21.15.142:0/383165580 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4348015820 con 0x55cd4973cb40 2024-09-22T08:38:28.698 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.687+0000 7f434fe2b800 1 -- 172.21.15.142:0/383165580 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cd4973cb40 msgr2=0x55cd4973cf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:28.698 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.687+0000 7f434fe2b800 1 --2- 172.21.15.142:0/383165580 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cd4973cb40 0x55cd4973cf40 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f4348017f70 tx=0x7f43480175a0 comp rx=0 tx=0).stop 2024-09-22T08:38:28.698 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.687+0000 7f434fe2b800 1 -- 172.21.15.142:0/383165580 shutdown_connections 2024-09-22T08:38:28.698 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.687+0000 7f434fe2b800 1 --2- 172.21.15.142:0/383165580 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cd4973cb40 0x55cd4973cf40 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:28.698 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.687+0000 7f434fe2b800 1 -- 172.21.15.142:0/383165580 >> 172.21.15.142:0/383165580 conn(0x55cd498e3880 msgr2=0x55cd498e1ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:38:28.698 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.687+0000 7f434fe2b800 1 -- 172.21.15.142:0/383165580 shutdown_connections 2024-09-22T08:38:28.698 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.687+0000 7f434fe2b800 1 -- 172.21.15.142:0/383165580 wait complete. 2024-09-22T08:38:28.698 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.687+0000 7f434fe2b800 1 Processor -- start 2024-09-22T08:38:28.698 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.687+0000 7f434fe2b800 1 -- start start 2024-09-22T08:38:28.698 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.687+0000 7f434fe2b800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cd4973cb40 0x55cd498f0c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:28.698 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.687+0000 7f434fe2b800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55cd4973dba0 con 0x55cd4973cb40 2024-09-22T08:38:28.698 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.688+0000 7f434e116640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cd4973cb40 0x55cd498f0c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:28.698 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.688+0000 7f434e116640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cd4973cb40 0x55cd498f0c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:51296/0 (socket says 172.21.15.142:51296) 2024-09-22T08:38:28.699 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.688+0000 7f434e116640 1 -- 172.21.15.142:0/2187719202 learned_addr learned my addr 172.21.15.142:0/2187719202 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:38:28.699 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.688+0000 7f434e116640 1 -- 172.21.15.142:0/2187719202 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cd498f1170 con 0x55cd4973cb40 2024-09-22T08:38:28.699 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.688+0000 7f434e116640 1 --2- 172.21.15.142:0/2187719202 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cd4973cb40 0x55cd498f0c10 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f4348052ce0 tx=0x7f4348053d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:28.699 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.688+0000 7f421f7fe640 1 -- 172.21.15.142:0/2187719202 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f434804a070 con 0x55cd4973cb40 2024-09-22T08:38:28.699 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.688+0000 7f421f7fe640 1 -- 172.21.15.142:0/2187719202 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f434804b040 con 0x55cd4973cb40 2024-09-22T08:38:28.699 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.688+0000 7f434fe2b800 1 -- 172.21.15.142:0/2187719202 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55cd498f1400 con 0x55cd4973cb40 2024-09-22T08:38:28.699 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.688+0000 7f421f7fe640 1 -- 172.21.15.142:0/2187719202 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4348013b10 con 0x55cd4973cb40 2024-09-22T08:38:28.699 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.688+0000 7f434fe2b800 1 -- 172.21.15.142:0/2187719202 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cd498f1f90 con 0x55cd4973cb40 2024-09-22T08:38:28.699 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.689+0000 7f421f7fe640 1 -- 172.21.15.142:0/2187719202 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f4348016040 con 0x55cd4973cb40 2024-09-22T08:38:28.699 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.689+0000 7f421f7fe640 1 --2- 172.21.15.142:0/2187719202 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f421803cf60 0x7f421803f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:28.699 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.689+0000 7f421f7fe640 1 -- 172.21.15.142:0/2187719202 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5938+0+0 (secure 0 0 0) 0x7f4348055040 con 0x55cd4973cb40 2024-09-22T08:38:28.699 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.690+0000 7f434fe2b800 20 rados->read ofs=0 len=0 2024-09-22T08:38:28.699 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.690+0000 7f434d915640 1 --2- 172.21.15.142:0/2187719202 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f421803cf60 0x7f421803f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:28.699 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.690+0000 7f434fe2b800 1 --2- 172.21.15.142:0/2187719202 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55cd498fc5a0 0x55cd498fea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:28.700 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.690+0000 7f434fe2b800 1 -- 172.21.15.142:0/2187719202 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cd498ff180 con 0x55cd498fc5a0 2024-09-22T08:38:28.700 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.690+0000 7f434d114640 1 --2- 172.21.15.142:0/2187719202 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55cd498fc5a0 0x55cd498fea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:28.700 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.690+0000 7f434d915640 1 --2- 172.21.15.142:0/2187719202 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f421803cf60 0x7f421803f420 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f4340098010 tx=0x7f434008e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:28.700 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.690+0000 7f434d114640 1 --2- 172.21.15.142:0/2187719202 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55cd498fc5a0 0x55cd498fea30 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:28.700 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.690+0000 7f434d114640 1 -- 172.21.15.142:0/2187719202 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4338009050 con 0x55cd498fc5a0 2024-09-22T08:38:28.700 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.690+0000 7f434fe2b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:28.700 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.690+0000 7f434fe2b800 20 realm 2024-09-22T08:38:28.700 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.690+0000 7f434fe2b800 20 rados->read ofs=0 len=0 2024-09-22T08:38:28.700 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.690+0000 7f434fe2b800 1 -- 172.21.15.142:0/2187719202 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cd498fb950 con 0x55cd498fc5a0 2024-09-22T08:38:28.700 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.691+0000 7f434d114640 1 -- 172.21.15.142:0/2187719202 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4338009050 con 0x55cd498fc5a0 2024-09-22T08:38:28.701 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.691+0000 7f434fe2b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:28.701 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.691+0000 7f434fe2b800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:38:28.701 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.691+0000 7f434fe2b800 20 rados->read ofs=0 len=0 2024-09-22T08:38:28.701 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.691+0000 7f434fe2b800 1 -- 172.21.15.142:0/2187719202 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cd498ffc60 con 0x55cd498fc5a0 2024-09-22T08:38:28.701 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.691+0000 7f434d114640 1 -- 172.21.15.142:0/2187719202 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4338009050 con 0x55cd498fc5a0 2024-09-22T08:38:28.701 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.691+0000 7f434fe2b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:28.701 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.691+0000 7f434fe2b800 20 rados->read ofs=0 len=0 2024-09-22T08:38:28.701 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.691+0000 7f434fe2b800 1 -- 172.21.15.142:0/2187719202 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cd49900530 con 0x55cd498fc5a0 2024-09-22T08:38:28.701 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.691+0000 7f434d114640 1 -- 172.21.15.142:0/2187719202 <== osd.1 v2:172.21.15.142:6816/3192108003 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4338009050 con 0x55cd498fc5a0 2024-09-22T08:38:28.701 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.691+0000 7f434fe2b800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:38:28.701 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.691+0000 7f434fe2b800 20 rados->read ofs=0 len=0 2024-09-22T08:38:28.701 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.691+0000 7f434fe2b800 1 --2- 172.21.15.142:0/2187719202 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55cd49900e70 0x55cd49903260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:28.702 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.691+0000 7f434fe2b800 1 -- 172.21.15.142:0/2187719202 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cd499039a0 con 0x55cd49900e70 2024-09-22T08:38:28.702 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.691+0000 7f434e116640 1 --2- 172.21.15.142:0/2187719202 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55cd49900e70 0x55cd49903260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:28.702 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.691+0000 7f434e116640 1 --2- 172.21.15.142:0/2187719202 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55cd49900e70 0x55cd49903260 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:28.702 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.692+0000 7f434e116640 1 -- 172.21.15.142:0/2187719202 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(5 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f43480083e0 con 0x55cd49900e70 2024-09-22T08:38:28.702 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.692+0000 7f434fe2b800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:38:28.702 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.692+0000 7f434fe2b800 20 searching for the correct realm 2024-09-22T08:38:28.702 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.692+0000 7f434fe2b800 1 -- 172.21.15.142:0/2187719202 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cd49905350 con 0x55cd49900e70 2024-09-22T08:38:28.702 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.692+0000 7f434e116640 1 -- 172.21.15.142:0/2187719202 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43480083e0 con 0x55cd49900e70 2024-09-22T08:38:28.702 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.692+0000 7f434e116640 1 --2- 172.21.15.142:0/2187719202 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f4348021020 0x7f434801aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:28.702 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.692+0000 7f434e116640 1 -- 172.21.15.142:0/2187719202 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cd49905350 con 0x7f4348021020 2024-09-22T08:38:28.702 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.692+0000 7f434d915640 1 --2- 172.21.15.142:0/2187719202 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f4348021020 0x7f434801aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:28.702 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.692+0000 7f434d915640 1 --2- 172.21.15.142:0/2187719202 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f4348021020 0x7f434801aa70 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:28.702 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.692+0000 7f434d915640 1 -- 172.21.15.142:0/2187719202 <== osd.2 v2:172.21.15.142:6808/279438927 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4340087040 con 0x7f4348021020 2024-09-22T08:38:28.703 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.692+0000 7f434d915640 1 --2- 172.21.15.142:0/2187719202 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f434008a070 0x7f43400980b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:28.703 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.692+0000 7f434d915640 1 -- 172.21.15.142:0/2187719202 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cd49905350 con 0x7f434008a070 2024-09-22T08:38:28.703 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.693+0000 7f434d114640 1 --2- 172.21.15.142:0/2187719202 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f434008a070 0x7f43400980b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:28.703 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.693+0000 7f434d114640 1 --2- 172.21.15.142:0/2187719202 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f434008a070 0x7f43400980b0 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:28.703 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.693+0000 7f434d114640 1 -- 172.21.15.142:0/2187719202 <== osd.0 v2:172.21.15.31:6800/168281188 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4338009050 con 0x7f434008a070 2024-09-22T08:38:28.703 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.693+0000 7f434d114640 1 -- 172.21.15.142:0/2187719202 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cd49905350 con 0x55cd498fc5a0 2024-09-22T08:38:28.703 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.694+0000 7f434d114640 1 -- 172.21.15.142:0/2187719202 <== osd.1 v2:172.21.15.142:6816/3192108003 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4338009050 con 0x55cd498fc5a0 2024-09-22T08:38:28.703 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.694+0000 7f434d114640 1 -- 172.21.15.142:0/2187719202 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cd49905350 con 0x55cd498fc5a0 2024-09-22T08:38:28.703 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.694+0000 7f434d114640 1 -- 172.21.15.142:0/2187719202 <== osd.1 v2:172.21.15.142:6816/3192108003 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4338029040 con 0x55cd498fc5a0 2024-09-22T08:38:28.703 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.694+0000 7f434d114640 1 -- 172.21.15.142:0/2187719202 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cd49905350 con 0x55cd498fc5a0 2024-09-22T08:38:28.703 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.694+0000 7f434d114640 1 -- 172.21.15.142:0/2187719202 <== osd.1 v2:172.21.15.142:6816/3192108003 7 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4338029040 con 0x55cd498fc5a0 2024-09-22T08:38:28.703 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.694+0000 7f434d114640 1 -- 172.21.15.142:0/2187719202 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cd49905350 con 0x7f434008a070 2024-09-22T08:38:28.703 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.694+0000 7f434d114640 1 -- 172.21.15.142:0/2187719202 <== osd.0 v2:172.21.15.31:6800/168281188 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4338029040 con 0x7f434008a070 2024-09-22T08:38:28.704 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.694+0000 7f434d114640 1 -- 172.21.15.142:0/2187719202 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cd49905350 con 0x7f4348021020 2024-09-22T08:38:28.713 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.695+0000 7f434d915640 1 -- 172.21.15.142:0/2187719202 <== osd.2 v2:172.21.15.142:6808/279438927 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4340087040 con 0x7f4348021020 2024-09-22T08:38:28.713 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.695+0000 7f434d915640 1 -- 172.21.15.142:0/2187719202 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cd49905350 con 0x55cd49900e70 2024-09-22T08:38:28.713 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.695+0000 7f434e116640 1 -- 172.21.15.142:0/2187719202 <== osd.3 v2:172.21.15.142:6800/1064901393 3 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43480083e0 con 0x55cd49900e70 2024-09-22T08:38:28.713 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.695+0000 7f434e116640 1 -- 172.21.15.142:0/2187719202 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cd49905350 con 0x55cd498fc5a0 2024-09-22T08:38:28.714 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.695+0000 7f434d114640 1 -- 172.21.15.142:0/2187719202 <== osd.1 v2:172.21.15.142:6816/3192108003 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4338029040 con 0x55cd498fc5a0 2024-09-22T08:38:28.714 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.695+0000 7f434d114640 1 -- 172.21.15.142:0/2187719202 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cd49905350 con 0x7f434008a070 2024-09-22T08:38:28.714 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.695+0000 7f434d114640 1 -- 172.21.15.142:0/2187719202 <== osd.0 v2:172.21.15.31:6800/168281188 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4338029040 con 0x7f434008a070 2024-09-22T08:38:28.714 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.695+0000 7f434d114640 1 -- 172.21.15.142:0/2187719202 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cd49905350 con 0x55cd498fc5a0 2024-09-22T08:38:28.714 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.696+0000 7f434d114640 1 -- 172.21.15.142:0/2187719202 <== osd.1 v2:172.21.15.142:6816/3192108003 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4338029040 con 0x55cd498fc5a0 2024-09-22T08:38:28.714 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.696+0000 7f434d114640 1 -- 172.21.15.142:0/2187719202 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cd49905350 con 0x7f4348021020 2024-09-22T08:38:28.714 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.696+0000 7f434d915640 1 -- 172.21.15.142:0/2187719202 <== osd.2 v2:172.21.15.142:6808/279438927 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f4340087040 con 0x7f4348021020 2024-09-22T08:38:28.714 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.696+0000 7f434d915640 1 -- 172.21.15.142:0/2187719202 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cd49905350 con 0x55cd49900e70 2024-09-22T08:38:28.714 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.696+0000 7f434e116640 1 -- 172.21.15.142:0/2187719202 <== osd.3 v2:172.21.15.142:6800/1064901393 4 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43480083e0 con 0x55cd49900e70 2024-09-22T08:38:28.714 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.696+0000 7f434e116640 1 -- 172.21.15.142:0/2187719202 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cd49905350 con 0x55cd49900e70 2024-09-22T08:38:28.714 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.696+0000 7f434e116640 1 -- 172.21.15.142:0/2187719202 <== osd.3 v2:172.21.15.142:6800/1064901393 5 ==== osd_op_reply(20 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f43480083e0 con 0x55cd49900e70 2024-09-22T08:38:28.714 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.696+0000 7f434e116640 1 -- 172.21.15.142:0/2187719202 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cd49905350 con 0x7f434008a070 2024-09-22T08:38:28.715 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.697+0000 7f434d114640 1 -- 172.21.15.142:0/2187719202 <== osd.0 v2:172.21.15.31:6800/168281188 4 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4338029040 con 0x7f434008a070 2024-09-22T08:38:28.715 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.697+0000 7f434d114640 1 -- 172.21.15.142:0/2187719202 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cd49905350 con 0x55cd49900e70 2024-09-22T08:38:28.715 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.697+0000 7f434e116640 1 -- 172.21.15.142:0/2187719202 <== osd.3 v2:172.21.15.142:6800/1064901393 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43480083e0 con 0x55cd49900e70 2024-09-22T08:38:28.715 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.697+0000 7f434e116640 1 -- 172.21.15.142:0/2187719202 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cd49905350 con 0x55cd49900e70 2024-09-22T08:38:28.715 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.697+0000 7f434e116640 1 -- 172.21.15.142:0/2187719202 <== osd.3 v2:172.21.15.142:6800/1064901393 7 ==== osd_op_reply(23 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f43480083e0 con 0x55cd49900e70 2024-09-22T08:38:28.715 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.697+0000 7f434e116640 1 -- 172.21.15.142:0/2187719202 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cd49905350 con 0x55cd498fc5a0 2024-09-22T08:38:28.715 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.697+0000 7f434d114640 1 -- 172.21.15.142:0/2187719202 <== osd.1 v2:172.21.15.142:6816/3192108003 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4338029040 con 0x55cd498fc5a0 2024-09-22T08:38:28.715 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.697+0000 7f434d114640 1 -- 172.21.15.142:0/2187719202 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cd49905350 con 0x55cd498fc5a0 2024-09-22T08:38:28.715 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.698+0000 7f434d114640 1 -- 172.21.15.142:0/2187719202 <== osd.1 v2:172.21.15.142:6816/3192108003 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f4338029040 con 0x55cd498fc5a0 2024-09-22T08:38:28.715 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.698+0000 7f434d114640 1 -- 172.21.15.142:0/2187719202 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cd49905350 con 0x7f434008a070 2024-09-22T08:38:28.715 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.698+0000 7f434d114640 1 -- 172.21.15.142:0/2187719202 <== osd.0 v2:172.21.15.31:6800/168281188 5 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4338029040 con 0x7f434008a070 2024-09-22T08:38:28.715 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.698+0000 7f434d114640 1 -- 172.21.15.142:0/2187719202 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cd49905350 con 0x55cd49900e70 2024-09-22T08:38:28.715 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.698+0000 7f434e116640 1 -- 172.21.15.142:0/2187719202 <== osd.3 v2:172.21.15.142:6800/1064901393 8 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43480083e0 con 0x55cd49900e70 2024-09-22T08:38:28.716 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.698+0000 7f434e116640 1 -- 172.21.15.142:0/2187719202 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cd49905350 con 0x7f4348021020 2024-09-22T08:38:28.716 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.698+0000 7f434d915640 1 -- 172.21.15.142:0/2187719202 <== osd.2 v2:172.21.15.142:6808/279438927 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4340087040 con 0x7f4348021020 2024-09-22T08:38:28.716 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.698+0000 7f434d915640 1 -- 172.21.15.142:0/2187719202 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cd49905350 con 0x55cd498fc5a0 2024-09-22T08:38:28.716 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.699+0000 7f434d114640 1 -- 172.21.15.142:0/2187719202 <== osd.1 v2:172.21.15.142:6816/3192108003 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4338029040 con 0x55cd498fc5a0 2024-09-22T08:38:28.716 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.699+0000 7f434d114640 1 -- 172.21.15.142:0/2187719202 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cd49905350 con 0x7f434008a070 2024-09-22T08:38:28.716 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.699+0000 7f434d114640 1 -- 172.21.15.142:0/2187719202 <== osd.0 v2:172.21.15.31:6800/168281188 6 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4338029040 con 0x7f434008a070 2024-09-22T08:38:28.716 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.699+0000 7f434d114640 1 -- 172.21.15.142:0/2187719202 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cd49905350 con 0x55cd49900e70 2024-09-22T08:38:28.716 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.699+0000 7f434e116640 1 -- 172.21.15.142:0/2187719202 <== osd.3 v2:172.21.15.142:6800/1064901393 9 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43480083e0 con 0x55cd49900e70 2024-09-22T08:38:28.716 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.699+0000 7f434e116640 1 -- 172.21.15.142:0/2187719202 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cd49905350 con 0x7f434008a070 2024-09-22T08:38:28.716 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.699+0000 7f434d114640 1 -- 172.21.15.142:0/2187719202 <== osd.0 v2:172.21.15.31:6800/168281188 7 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4338029040 con 0x7f434008a070 2024-09-22T08:38:28.716 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.699+0000 7f434d114640 1 -- 172.21.15.142:0/2187719202 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cd49905350 con 0x7f4348021020 2024-09-22T08:38:28.716 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.700+0000 7f434d915640 1 -- 172.21.15.142:0/2187719202 <== osd.2 v2:172.21.15.142:6808/279438927 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4340087040 con 0x7f4348021020 2024-09-22T08:38:28.717 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.700+0000 7f434d915640 1 -- 172.21.15.142:0/2187719202 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cd49905350 con 0x55cd49900e70 2024-09-22T08:38:28.717 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.700+0000 7f434e116640 1 -- 172.21.15.142:0/2187719202 <== osd.3 v2:172.21.15.142:6800/1064901393 10 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43480083e0 con 0x55cd49900e70 2024-09-22T08:38:28.717 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.700+0000 7f434e116640 1 -- 172.21.15.142:0/2187719202 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cd49905350 con 0x7f434008a070 2024-09-22T08:38:28.717 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.700+0000 7f434d114640 1 -- 172.21.15.142:0/2187719202 <== osd.0 v2:172.21.15.31:6800/168281188 8 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4338029040 con 0x7f434008a070 2024-09-22T08:38:28.717 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.700+0000 7f434d114640 1 -- 172.21.15.142:0/2187719202 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cd49905350 con 0x55cd498fc5a0 2024-09-22T08:38:28.717 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.700+0000 7f434d114640 1 -- 172.21.15.142:0/2187719202 <== osd.1 v2:172.21.15.142:6816/3192108003 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f4338029040 con 0x55cd498fc5a0 2024-09-22T08:38:28.717 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.700+0000 7f434d114640 1 -- 172.21.15.142:0/2187719202 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cd49905350 con 0x7f4348021020 2024-09-22T08:38:28.717 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.701+0000 7f434d915640 1 -- 172.21.15.142:0/2187719202 <== osd.2 v2:172.21.15.142:6808/279438927 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4340087040 con 0x7f4348021020 2024-09-22T08:38:28.717 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.701+0000 7f434fe2b800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:38:28.717 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.701+0000 7f434fe2b800 20 RGWRados::pool_iterate: got zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec 2024-09-22T08:38:28.717 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.701+0000 7f434fe2b800 20 RGWRados::pool_iterate: got zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f 2024-09-22T08:38:28.717 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.701+0000 7f434fe2b800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:38:28.717 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.701+0000 7f434fe2b800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:38:28.717 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.701+0000 7f434fe2b800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:38:28.717 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.701+0000 7f434fe2b800 20 rados->read ofs=0 len=0 2024-09-22T08:38:28.718 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.701+0000 7f434fe2b800 1 -- 172.21.15.142:0/2187719202 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cd49904420 con 0x55cd498fc5a0 2024-09-22T08:38:28.718 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.701+0000 7f434d114640 1 -- 172.21.15.142:0/2187719202 <== osd.1 v2:172.21.15.142:6816/3192108003 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4338029040 con 0x55cd498fc5a0 2024-09-22T08:38:28.718 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.701+0000 7f434fe2b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:28.718 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.701+0000 7f434fe2b800 20 rados->read ofs=0 len=0 2024-09-22T08:38:28.718 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.701+0000 7f434fe2b800 1 -- 172.21.15.142:0/2187719202 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cd49904060 con 0x55cd498fc5a0 2024-09-22T08:38:28.718 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.701+0000 7f434d114640 1 -- 172.21.15.142:0/2187719202 <== osd.1 v2:172.21.15.142:6816/3192108003 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4338029040 con 0x55cd498fc5a0 2024-09-22T08:38:28.718 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.701+0000 7f434fe2b800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:38:28.718 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.701+0000 7f434fe2b800 20 rados->read ofs=0 len=0 2024-09-22T08:38:28.718 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.701+0000 7f434fe2b800 1 -- 172.21.15.142:0/2187719202 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:40 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cd49904d80 con 0x55cd49900e70 2024-09-22T08:38:28.718 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.701+0000 7f434e116640 1 -- 172.21.15.142:0/2187719202 <== osd.3 v2:172.21.15.142:6800/1064901393 11 ==== osd_op_reply(40 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f43480083e0 con 0x55cd49900e70 2024-09-22T08:38:28.719 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.701+0000 7f434fe2b800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:38:28.719 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.701+0000 7f434fe2b800 20 zone default found 2024-09-22T08:38:28.719 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.701+0000 7f434fe2b800 4 Realm: () 2024-09-22T08:38:28.719 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.701+0000 7f434fe2b800 4 ZoneGroup: default (d89f6f57-1007-47dd-9065-f486c7b01aec) 2024-09-22T08:38:28.719 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.701+0000 7f434fe2b800 4 Zone: default (e239248c-0bee-4e41-803a-24b288d3eb8f) 2024-09-22T08:38:28.719 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.701+0000 7f434fe2b800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:38:28.719 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.701+0000 7f434fe2b800 20 zonegroup default 2024-09-22T08:38:28.719 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.701+0000 7f434fe2b800 20 rados->read ofs=0 len=0 2024-09-22T08:38:28.719 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.701+0000 7f434fe2b800 1 -- 172.21.15.142:0/2187719202 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cd499048c0 con 0x7f434008a070 2024-09-22T08:38:28.719 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.702+0000 7f434d114640 1 -- 172.21.15.142:0/2187719202 <== osd.0 v2:172.21.15.31:6800/168281188 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f4338029040 con 0x7f434008a070 2024-09-22T08:38:28.719 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.702+0000 7f434fe2b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:28.719 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.702+0000 7f434fe2b800 20 rados->read ofs=0 len=0 2024-09-22T08:38:28.719 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.702+0000 7f434fe2b800 1 -- 172.21.15.142:0/2187719202 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cd49907bc0 con 0x55cd49900e70 2024-09-22T08:38:28.719 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.702+0000 7f434e116640 1 -- 172.21.15.142:0/2187719202 <== osd.3 v2:172.21.15.142:6800/1064901393 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f43480083e0 con 0x55cd49900e70 2024-09-22T08:38:28.719 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.702+0000 7f434fe2b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:28.720 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.702+0000 7f434fe2b800 20 rados->read ofs=0 len=0 2024-09-22T08:38:28.720 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.702+0000 7f434fe2b800 1 -- 172.21.15.142:0/2187719202 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cd49907f60 con 0x55cd49900e70 2024-09-22T08:38:28.720 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.702+0000 7f434e116640 1 -- 172.21.15.142:0/2187719202 <== osd.3 v2:172.21.15.142:6800/1064901393 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f43480083e0 con 0x55cd49900e70 2024-09-22T08:38:28.720 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.702+0000 7f434fe2b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:28.720 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.702+0000 7f434fe2b800 20 started sync module instance, tier type = 2024-09-22T08:38:28.720 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.702+0000 7f434fe2b800 20 started zone id=e239248c-0bee-4e41-803a-24b288d3eb8f (name=default) with tier type = 2024-09-22T08:38:28.720 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.702+0000 7f434fe2b800 1 -- 172.21.15.142:0/2187719202 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cd49907000 con 0x7f4348021020 2024-09-22T08:38:28.720 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.703+0000 7f434d915640 1 -- 172.21.15.142:0/2187719202 <== osd.2 v2:172.21.15.142:6808/279438927 7 ==== osd_op_reply(44 notify.0 [create] v32'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4340087040 con 0x7f4348021020 2024-09-22T08:38:28.720 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.703+0000 7f434fe2b800 1 -- 172.21.15.142:0/2187719202 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94340190858064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cd49908390 con 0x7f4348021020 2024-09-22T08:38:28.720 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.703+0000 7f434fe2b800 1 -- 172.21.15.142:0/2187719202 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cd49908be0 con 0x55cd498fc5a0 2024-09-22T08:38:28.720 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.704+0000 7f434d915640 1 -- 172.21.15.142:0/2187719202 <== osd.2 v2:172.21.15.142:6808/279438927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94340190858064] v32'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4340087040 con 0x7f4348021020 2024-09-22T08:38:28.720 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.705+0000 7f434d114640 1 -- 172.21.15.142:0/2187719202 <== osd.1 v2:172.21.15.142:6816/3192108003 16 ==== osd_op_reply(46 notify.1 [create] v32'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4338029040 con 0x55cd498fc5a0 2024-09-22T08:38:28.720 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.705+0000 7f434fe2b800 1 -- 172.21.15.142:0/2187719202 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94340190865200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cd49909000 con 0x55cd498fc5a0 2024-09-22T08:38:28.720 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.705+0000 7f434fe2b800 1 -- 172.21.15.142:0/2187719202 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cd49909890 con 0x55cd49900e70 2024-09-22T08:38:28.721 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.706+0000 7f434d114640 1 -- 172.21.15.142:0/2187719202 <== osd.1 v2:172.21.15.142:6816/3192108003 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94340190865200] v32'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4338029040 con 0x55cd498fc5a0 2024-09-22T08:38:28.721 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.706+0000 7f434e116640 1 -- 172.21.15.142:0/2187719202 <== osd.3 v2:172.21.15.142:6800/1064901393 14 ==== osd_op_reply(48 notify.2 [create] v32'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f43480083e0 con 0x55cd49900e70 2024-09-22T08:38:28.721 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.706+0000 7f434fe2b800 1 -- 172.21.15.142:0/2187719202 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94340190866256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cd49909420 con 0x55cd49900e70 2024-09-22T08:38:28.721 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.706+0000 7f434fe2b800 1 -- 172.21.15.142:0/2187719202 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cd4990a330 con 0x7f4348021020 2024-09-22T08:38:28.721 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.707+0000 7f434e116640 1 -- 172.21.15.142:0/2187719202 <== osd.3 v2:172.21.15.142:6800/1064901393 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94340190866256] v32'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f43480083e0 con 0x55cd49900e70 2024-09-22T08:38:28.721 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.707+0000 7f434d915640 1 -- 172.21.15.142:0/2187719202 <== osd.2 v2:172.21.15.142:6808/279438927 9 ==== osd_op_reply(50 notify.3 [create] v32'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4340087040 con 0x7f4348021020 2024-09-22T08:38:28.721 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.707+0000 7f434fe2b800 1 -- 172.21.15.142:0/2187719202 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94340190867312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cd49909390 con 0x7f4348021020 2024-09-22T08:38:28.721 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.707+0000 7f434fe2b800 1 -- 172.21.15.142:0/2187719202 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cd4990b1f0 con 0x55cd498fc5a0 2024-09-22T08:38:28.721 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.708+0000 7f434d915640 1 -- 172.21.15.142:0/2187719202 <== osd.2 v2:172.21.15.142:6808/279438927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94340190867312] v32'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4340087040 con 0x7f4348021020 2024-09-22T08:38:28.721 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.708+0000 7f434d114640 1 -- 172.21.15.142:0/2187719202 <== osd.1 v2:172.21.15.142:6816/3192108003 18 ==== osd_op_reply(52 notify.4 [create] v32'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4338029040 con 0x55cd498fc5a0 2024-09-22T08:38:28.721 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.709+0000 7f434fe2b800 1 -- 172.21.15.142:0/2187719202 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94340190874944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cd4990b610 con 0x55cd498fc5a0 2024-09-22T08:38:28.721 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.709+0000 7f434fe2b800 1 -- 172.21.15.142:0/2187719202 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cd4990bfd0 con 0x7f434008a070 2024-09-22T08:38:28.721 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.710+0000 7f434d114640 1 -- 172.21.15.142:0/2187719202 <== osd.1 v2:172.21.15.142:6816/3192108003 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94340190874944] v32'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4338029040 con 0x55cd498fc5a0 2024-09-22T08:38:28.722 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.710+0000 7f434d114640 1 -- 172.21.15.142:0/2187719202 <== osd.0 v2:172.21.15.31:6800/168281188 10 ==== osd_op_reply(54 notify.5 [create] v32'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4338029040 con 0x7f434008a070 2024-09-22T08:38:28.722 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.710+0000 7f434fe2b800 1 -- 172.21.15.142:0/2187719202 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94340190878976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cd4990b610 con 0x7f434008a070 2024-09-22T08:38:28.722 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.710+0000 7f434fe2b800 1 -- 172.21.15.142:0/2187719202 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cd4990c9e0 con 0x7f434008a070 2024-09-22T08:38:28.722 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.711+0000 7f434d114640 1 -- 172.21.15.142:0/2187719202 <== osd.0 v2:172.21.15.31:6800/168281188 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94340190878976] v32'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4338029040 con 0x7f434008a070 2024-09-22T08:38:28.722 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.711+0000 7f434d114640 1 -- 172.21.15.142:0/2187719202 <== osd.0 v2:172.21.15.31:6800/168281188 12 ==== osd_op_reply(56 notify.6 [create] v32'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4338029040 con 0x7f434008a070 2024-09-22T08:38:28.722 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.711+0000 7f434fe2b800 1 -- 172.21.15.142:0/2187719202 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94340190876000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cd4990cbc0 con 0x7f434008a070 2024-09-22T08:38:28.722 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.711+0000 7f434fe2b800 1 -- 172.21.15.142:0/2187719202 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cd4990d410 con 0x7f434008a070 2024-09-22T08:38:28.726 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.712+0000 7f434d114640 1 -- 172.21.15.142:0/2187719202 <== osd.0 v2:172.21.15.31:6800/168281188 13 ==== osd_op_reply(58 notify.7 [create] v32'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4338029040 con 0x7f434008a070 2024-09-22T08:38:28.726 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.712+0000 7f434fe2b800 1 -- 172.21.15.142:0/2187719202 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94340190883232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cd4990d7d0 con 0x7f434008a070 2024-09-22T08:38:28.726 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.712+0000 7f434fe2b800 20 add_watcher() i=0 2024-09-22T08:38:28.726 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.712+0000 7f434fe2b800 20 add_watcher() i=1 2024-09-22T08:38:28.726 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.712+0000 7f434fe2b800 20 add_watcher() i=2 2024-09-22T08:38:28.726 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.712+0000 7f434fe2b800 20 add_watcher() i=3 2024-09-22T08:38:28.726 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.712+0000 7f434fe2b800 20 add_watcher() i=4 2024-09-22T08:38:28.726 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.712+0000 7f434fe2b800 20 add_watcher() i=5 2024-09-22T08:38:28.727 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.712+0000 7f434d114640 1 -- 172.21.15.142:0/2187719202 <== osd.0 v2:172.21.15.31:6800/168281188 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94340190876000] v32'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4338029040 con 0x7f434008a070 2024-09-22T08:38:28.727 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.712+0000 7f434fe2b800 20 add_watcher() i=6 2024-09-22T08:38:28.727 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.713+0000 7f434d114640 1 -- 172.21.15.142:0/2187719202 <== osd.0 v2:172.21.15.31:6800/168281188 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94340190883232] v32'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4338029040 con 0x7f434008a070 2024-09-22T08:38:28.727 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.713+0000 7f434fe2b800 20 add_watcher() i=7 2024-09-22T08:38:28.727 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.713+0000 7f434fe2b800 2 all 8 watchers are set, enabling cache 2024-09-22T08:38:28.727 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.713+0000 7f434fe2b800 1 -- 172.21.15.142:0/2187719202 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cd49910d10 con 0x55cd498fc5a0 2024-09-22T08:38:28.727 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.713+0000 7f434d114640 1 -- 172.21.15.142:0/2187719202 <== osd.1 v2:172.21.15.142:6816/3192108003 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f4338029040 con 0x55cd498fc5a0 2024-09-22T08:38:28.727 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.713+0000 7f434fe2b800 1 -- 172.21.15.142:0/2187719202 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94340190884448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cd4990e190 con 0x55cd498fc5a0 2024-09-22T08:38:28.727 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.714+0000 7f434d114640 1 -- 172.21.15.142:0/2187719202 <== osd.1 v2:172.21.15.142:6816/3192108003 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94340190884448] v32'238 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4338029040 con 0x55cd498fc5a0 2024-09-22T08:38:28.727 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.714+0000 7f41ff7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:38:28.727 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.714+0000 7f434fe2b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:38:28.727 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.714+0000 7f434fe2b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:38:28.727 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.714+0000 7f434fe2b800 5 note: GC not initialized 2024-09-22T08:38:28.727 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.715+0000 7f41fe7fc640 20 reqs_thread_entry: start 2024-09-22T08:38:28.728 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.715+0000 7f434fe2b800 20 init_complete bucket index max shards: 11 2024-09-22T08:38:28.728 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.715+0000 7f434fe2b800 20 Filter name: none 2024-09-22T08:38:28.728 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.715+0000 7f416ffff640 20 reqs_thread_entry: start 2024-09-22T08:38:28.728 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.715+0000 7f434fe2b800 20 rados->read ofs=0 len=0 2024-09-22T08:38:28.728 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.715+0000 7f434fe2b800 1 -- 172.21.15.142:0/2187719202 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cd49943830 con 0x55cd498fc5a0 2024-09-22T08:38:28.728 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.715+0000 7f434d114640 1 -- 172.21.15.142:0/2187719202 <== osd.1 v2:172.21.15.142:6816/3192108003 22 ==== osd_op_reply(62 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f4338029040 con 0x55cd498fc5a0 2024-09-22T08:38:28.728 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.715+0000 7f434fe2b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:28.728 INFO:teuthology.orchestra.run.smithi142.stderr:could not fetch user info: no user info saved 2024-09-22T08:38:28.728 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.716+0000 7f41ff7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:38:28.728 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.716+0000 7f434fe2b800 1 -- 172.21.15.142:0/2187719202 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94340190884448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cd499437f0 con 0x55cd498fc5a0 2024-09-22T08:38:28.728 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.717+0000 7f434d114640 1 -- 172.21.15.142:0/2187719202 <== osd.1 v2:172.21.15.142:6816/3192108003 23 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94340190884448] v32'239 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4338029040 con 0x55cd498fc5a0 2024-09-22T08:38:28.728 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.717+0000 7f434fe2b800 1 -- 172.21.15.142:0/2187719202 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94340190858064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cd499437f0 con 0x7f4348021020 2024-09-22T08:38:28.728 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.718+0000 7f434d915640 1 -- 172.21.15.142:0/2187719202 <== osd.2 v2:172.21.15.142:6808/279438927 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94340190858064] v32'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4340087040 con 0x7f4348021020 2024-09-22T08:38:28.729 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.718+0000 7f434fe2b800 20 remove_watcher() i=0 2024-09-22T08:38:28.729 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.718+0000 7f434fe2b800 2 removed watcher, disabling cache 2024-09-22T08:38:28.729 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.718+0000 7f434fe2b800 1 -- 172.21.15.142:0/2187719202 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94340190865200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cd499437f0 con 0x55cd498fc5a0 2024-09-22T08:38:28.729 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.719+0000 7f434d114640 1 -- 172.21.15.142:0/2187719202 <== osd.1 v2:172.21.15.142:6816/3192108003 24 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94340190865200] v32'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4338029040 con 0x55cd498fc5a0 2024-09-22T08:38:28.729 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.719+0000 7f434fe2b800 20 remove_watcher() i=1 2024-09-22T08:38:28.729 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.719+0000 7f434fe2b800 1 -- 172.21.15.142:0/2187719202 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94340190866256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cd499437f0 con 0x55cd49900e70 2024-09-22T08:38:28.729 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.721+0000 7f434e116640 1 -- 172.21.15.142:0/2187719202 <== osd.3 v2:172.21.15.142:6800/1064901393 16 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94340190866256] v32'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f43480083e0 con 0x55cd49900e70 2024-09-22T08:38:28.729 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.721+0000 7f434fe2b800 20 remove_watcher() i=2 2024-09-22T08:38:28.729 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.721+0000 7f434fe2b800 1 -- 172.21.15.142:0/2187719202 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94340190867312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cd499437f0 con 0x7f4348021020 2024-09-22T08:38:28.729 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.721+0000 7f434d915640 1 -- 172.21.15.142:0/2187719202 <== osd.2 v2:172.21.15.142:6808/279438927 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94340190867312] v32'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4340087040 con 0x7f4348021020 2024-09-22T08:38:28.729 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.721+0000 7f434fe2b800 20 remove_watcher() i=3 2024-09-22T08:38:28.729 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.721+0000 7f434fe2b800 1 -- 172.21.15.142:0/2187719202 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94340190874944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cd499437f0 con 0x55cd498fc5a0 2024-09-22T08:38:28.729 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.723+0000 7f434d114640 1 -- 172.21.15.142:0/2187719202 <== osd.1 v2:172.21.15.142:6816/3192108003 25 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94340190874944] v32'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4338029040 con 0x55cd498fc5a0 2024-09-22T08:38:28.729 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.723+0000 7f434fe2b800 20 remove_watcher() i=4 2024-09-22T08:38:28.730 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.723+0000 7f434fe2b800 1 -- 172.21.15.142:0/2187719202 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94340190878976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cd499437f0 con 0x7f434008a070 2024-09-22T08:38:28.730 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.724+0000 7f434d114640 1 -- 172.21.15.142:0/2187719202 <== osd.0 v2:172.21.15.31:6800/168281188 16 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94340190878976] v32'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4338029040 con 0x7f434008a070 2024-09-22T08:38:28.730 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.724+0000 7f434fe2b800 20 remove_watcher() i=5 2024-09-22T08:38:28.730 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.724+0000 7f434fe2b800 1 -- 172.21.15.142:0/2187719202 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94340190876000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cd499437f0 con 0x7f434008a070 2024-09-22T08:38:28.732 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.725+0000 7f434d114640 1 -- 172.21.15.142:0/2187719202 <== osd.0 v2:172.21.15.31:6800/168281188 17 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94340190876000] v32'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4338029040 con 0x7f434008a070 2024-09-22T08:38:28.733 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.725+0000 7f434fe2b800 20 remove_watcher() i=6 2024-09-22T08:38:28.733 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.725+0000 7f434fe2b800 1 -- 172.21.15.142:0/2187719202 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94340190883232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cd499437f0 con 0x7f434008a070 2024-09-22T08:38:28.733 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.726+0000 7f434d114640 1 -- 172.21.15.142:0/2187719202 <== osd.0 v2:172.21.15.31:6800/168281188 18 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94340190883232] v32'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4338029040 con 0x7f434008a070 2024-09-22T08:38:28.733 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.726+0000 7f434fe2b800 20 remove_watcher() i=7 2024-09-22T08:38:28.733 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.726+0000 7f434fe2b800 1 -- 172.21.15.142:0/2187719202 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f434008a070 msgr2=0x7f43400980b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:28.733 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.726+0000 7f434fe2b800 1 --2- 172.21.15.142:0/2187719202 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f434008a070 0x7f43400980b0 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:28.733 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.726+0000 7f434fe2b800 1 -- 172.21.15.142:0/2187719202 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55cd498fc5a0 msgr2=0x55cd498fea30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:28.733 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.726+0000 7f434fe2b800 1 --2- 172.21.15.142:0/2187719202 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55cd498fc5a0 0x55cd498fea30 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:28.733 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.726+0000 7f434fe2b800 1 -- 172.21.15.142:0/2187719202 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f4348021020 msgr2=0x7f434801aa70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:28.733 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.726+0000 7f434fe2b800 1 --2- 172.21.15.142:0/2187719202 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f4348021020 0x7f434801aa70 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:28.733 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.726+0000 7f434fe2b800 1 -- 172.21.15.142:0/2187719202 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55cd49900e70 msgr2=0x55cd49903260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:28.733 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.726+0000 7f434fe2b800 1 --2- 172.21.15.142:0/2187719202 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55cd49900e70 0x55cd49903260 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:28.733 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.726+0000 7f434fe2b800 1 -- 172.21.15.142:0/2187719202 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f421803cf60 msgr2=0x7f421803f420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:28.734 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.726+0000 7f434fe2b800 1 --2- 172.21.15.142:0/2187719202 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f421803cf60 0x7f421803f420 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f4340098010 tx=0x7f434008e000 comp rx=0 tx=0).stop 2024-09-22T08:38:28.734 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.726+0000 7f434fe2b800 1 -- 172.21.15.142:0/2187719202 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cd4973cb40 msgr2=0x55cd498f0c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:28.734 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.726+0000 7f434fe2b800 1 --2- 172.21.15.142:0/2187719202 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cd4973cb40 0x55cd498f0c10 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f4348052ce0 tx=0x7f4348053d50 comp rx=0 tx=0).stop 2024-09-22T08:38:28.734 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.726+0000 7f434d114640 1 -- 172.21.15.142:0/2187719202 reap_dead start 2024-09-22T08:38:28.734 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.726+0000 7f434fe2b800 1 -- 172.21.15.142:0/2187719202 shutdown_connections 2024-09-22T08:38:28.734 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.726+0000 7f434fe2b800 1 --2- 172.21.15.142:0/2187719202 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cd4973cb40 0x55cd498f0c10 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:28.734 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.726+0000 7f434fe2b800 1 -- 172.21.15.142:0/2187719202 >> 172.21.15.142:0/2187719202 conn(0x55cd498e3880 msgr2=0x55cd498e1a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:38:28.734 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.726+0000 7f434fe2b800 1 -- 172.21.15.142:0/2187719202 shutdown_connections 2024-09-22T08:38:28.734 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.726+0000 7f434fe2b800 1 -- 172.21.15.142:0/2187719202 wait complete. 2024-09-22T08:38:28.734 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.726+0000 7f434fe2b800 1 -- 172.21.15.142:0/3925415877 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f422803d000 msgr2=0x7f422803f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:28.734 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.726+0000 7f434fe2b800 1 --2- 172.21.15.142:0/3925415877 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f422803d000 0x7f422803f4c0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x55cd498cc3e0 tx=0x7f434007e600 comp rx=0 tx=0).stop 2024-09-22T08:38:28.734 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.726+0000 7f434fe2b800 1 -- 172.21.15.142:0/3925415877 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cd498daa20 msgr2=0x55cd498dae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:28.734 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.726+0000 7f434fe2b800 1 --2- 172.21.15.142:0/3925415877 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cd498daa20 0x55cd498dae40 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x55cd498c1910 tx=0x7f434800bf30 comp rx=0 tx=0).stop 2024-09-22T08:38:28.735 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.726+0000 7f434fe2b800 1 -- 172.21.15.142:0/3925415877 shutdown_connections 2024-09-22T08:38:28.735 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.726+0000 7f434fe2b800 1 --2- 172.21.15.142:0/3925415877 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f422803d000 0x7f422803f4c0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:28.735 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.726+0000 7f434fe2b800 1 --2- 172.21.15.142:0/3925415877 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cd498daa20 0x55cd498dae40 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:28.735 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.726+0000 7f434fe2b800 1 -- 172.21.15.142:0/3925415877 >> 172.21.15.142:0/3925415877 conn(0x55cd498cedd0 msgr2=0x55cd498cf1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:38:28.735 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.726+0000 7f434fe2b800 1 -- 172.21.15.142:0/3925415877 shutdown_connections 2024-09-22T08:38:28.735 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.726+0000 7f434fe2b800 1 -- 172.21.15.142:0/3925415877 wait complete. 2024-09-22T08:38:28.735 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.727+0000 7f434fe2b800 1 -- 172.21.15.142:0/3620839344 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55cd497c9ae0 msgr2=0x55cd498c7070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:28.735 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.727+0000 7f434fe2b800 1 --2- 172.21.15.142:0/3620839344 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55cd497c9ae0 0x55cd498c7070 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:28.735 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.727+0000 7f434fe2b800 1 -- 172.21.15.142:0/3620839344 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55cd498c9410 msgr2=0x55cd498cb8b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:28.735 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.727+0000 7f434fe2b800 1 --2- 172.21.15.142:0/3620839344 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55cd498c9410 0x55cd498cb8b0 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:28.735 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.727+0000 7f434fe2b800 1 -- 172.21.15.142:0/3620839344 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f423403d000 msgr2=0x7f423403f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:28.736 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.727+0000 7f434fe2b800 1 --2- 172.21.15.142:0/3620839344 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f423403d000 0x7f423403f4c0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f4338001d70 tx=0x7f43380012d0 comp rx=0 tx=0).stop 2024-09-22T08:38:28.736 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.727+0000 7f434fe2b800 1 -- 172.21.15.142:0/3620839344 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cd497c89e0 msgr2=0x55cd498bfa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:28.736 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.727+0000 7f434fe2b800 1 --2- 172.21.15.142:0/3620839344 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cd497c89e0 0x55cd498bfa20 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f4340025a60 tx=0x7f4340003330 comp rx=0 tx=0).stop 2024-09-22T08:38:28.736 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.727+0000 7f434fe2b800 1 -- 172.21.15.142:0/3620839344 shutdown_connections 2024-09-22T08:38:28.736 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.727+0000 7f434fe2b800 1 --2- 172.21.15.142:0/3620839344 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55cd498c9410 0x55cd498cb8b0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:28.736 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.727+0000 7f434fe2b800 1 --2- 172.21.15.142:0/3620839344 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55cd497c9ae0 0x55cd498c7070 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:28.736 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.727+0000 7f434fe2b800 1 --2- 172.21.15.142:0/3620839344 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f423403d000 0x7f423403f4c0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:28.736 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.727+0000 7f434fe2b800 1 --2- 172.21.15.142:0/3620839344 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cd497c89e0 0x55cd498bfa20 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:28.736 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.727+0000 7f434fe2b800 1 -- 172.21.15.142:0/3620839344 >> 172.21.15.142:0/3620839344 conn(0x55cd497c3db0 msgr2=0x55cd498b2150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:38:28.736 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.727+0000 7f434fe2b800 1 -- 172.21.15.142:0/3620839344 shutdown_connections 2024-09-22T08:38:28.736 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.727+0000 7f434fe2b800 1 -- 172.21.15.142:0/3620839344 wait complete. 2024-09-22T08:38:28.737 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T08:38:28.738 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'get', '--rgw-zone', 'default'] 2024-09-22T08:38:28.738 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'get', '--rgw-zone', 'default'] 2024-09-22T08:38:28.738 DEBUG:teuthology.orchestra.run.smithi142:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone get --rgw-zone default 2024-09-22T08:38:28.782 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:38:28.782 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:38:28.783 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.780+0000 7fca51016800 1 Processor -- start 2024-09-22T08:38:28.783 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.780+0000 7fca51016800 1 -- start start 2024-09-22T08:38:28.783 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.780+0000 7fca51016800 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55e09da560c0 0x55e09da584b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:28.783 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.780+0000 7fca51016800 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55e09d8e0a20 con 0x55e09da589f0 2024-09-22T08:38:28.783 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.780+0000 7fca51016800 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x55e09d8e07d0 con 0x55e09da560c0 2024-09-22T08:38:28.783 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.781+0000 7fca4c7e7640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55e09da560c0 0x55e09da584b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:28.783 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.781+0000 7fca4bfe6640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x55e09da589f0 0x55e09da5ade0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.142:50412/0 (socket says 172.21.15.142:50412) 2024-09-22T08:38:28.784 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.781+0000 7fca4bfe6640 1 -- 172.21.15.142:0/4285156247 learned_addr learned my addr 172.21.15.142:0/4285156247 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-09-22T08:38:28.784 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.781+0000 7fca4c7e7640 1 -- 172.21.15.142:0/4285156247 >> v1:172.21.15.31:6789/0 conn(0x55e09da589f0 legacy=0x55e09da5ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:28.784 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.781+0000 7fca4c7e7640 1 -- 172.21.15.142:0/4285156247 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e09da5d650 con 0x55e09da560c0 2024-09-22T08:38:28.785 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.784+0000 7fca4c7e7640 1 --2- 172.21.15.142:0/4285156247 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e09da560c0 0x55e09da584b0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fca3c00a470 tx=0x7fca3c045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fe4542c8f14c4f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:28.785 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.784+0000 7fca4b7e5640 1 -- 172.21.15.142:0/4285156247 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca3c053570 con 0x55e09da560c0 2024-09-22T08:38:28.785 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.784+0000 7fca4b7e5640 1 -- 172.21.15.142:0/4285156247 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca3c058070 con 0x55e09da560c0 2024-09-22T08:38:28.785 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.784+0000 7fca4b7e5640 1 -- 172.21.15.142:0/4285156247 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca3c053880 con 0x55e09da560c0 2024-09-22T08:38:28.786 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.784+0000 7fca51016800 1 -- 172.21.15.142:0/4285156247 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e09da560c0 msgr2=0x55e09da584b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:28.786 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.784+0000 7fca51016800 1 --2- 172.21.15.142:0/4285156247 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e09da560c0 0x55e09da584b0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fca3c00a470 tx=0x7fca3c045a20 comp rx=0 tx=0).stop 2024-09-22T08:38:28.786 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.784+0000 7fca51016800 1 -- 172.21.15.142:0/4285156247 shutdown_connections 2024-09-22T08:38:28.786 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.784+0000 7fca51016800 1 --2- 172.21.15.142:0/4285156247 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e09da560c0 0x55e09da584b0 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:28.786 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.784+0000 7fca51016800 1 -- 172.21.15.142:0/4285156247 >> 172.21.15.142:0/4285156247 conn(0x55e09da4fcc0 msgr2=0x55e09da520e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:38:28.787 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.784+0000 7fca51016800 1 -- 172.21.15.142:0/4285156247 shutdown_connections 2024-09-22T08:38:28.787 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.784+0000 7fca51016800 1 -- 172.21.15.142:0/4285156247 wait complete. 2024-09-22T08:38:28.800 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.797+0000 7fca51016800 1 Processor -- start 2024-09-22T08:38:28.800 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.797+0000 7fca51016800 1 -- start start 2024-09-22T08:38:28.800 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.798+0000 7fca51016800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e09da560c0 0x55e09db450d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:28.800 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.798+0000 7fca51016800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55e09d8eddd0 con 0x55e09da560c0 2024-09-22T08:38:28.801 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.798+0000 7fca4c7e7640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e09da560c0 0x55e09db450d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:28.801 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.798+0000 7fca4c7e7640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e09da560c0 0x55e09db450d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:51308/0 (socket says 172.21.15.142:51308) 2024-09-22T08:38:28.801 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.798+0000 7fca4c7e7640 1 -- 172.21.15.142:0/3394761988 learned_addr learned my addr 172.21.15.142:0/3394761988 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:38:28.801 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.798+0000 7fca4c7e7640 1 -- 172.21.15.142:0/3394761988 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e09db456c0 con 0x55e09da560c0 2024-09-22T08:38:28.801 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.798+0000 7fca4c7e7640 1 --2- 172.21.15.142:0/3394761988 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e09da560c0 0x55e09db450d0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fca3c025c20 tx=0x7fca3c051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44a52c2add59d0cb server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:28.801 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.798+0000 7fc93a60c640 1 -- 172.21.15.142:0/3394761988 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca3c053a20 con 0x55e09da560c0 2024-09-22T08:38:28.801 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.799+0000 7fc93a60c640 1 -- 172.21.15.142:0/3394761988 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca3c063070 con 0x55e09da560c0 2024-09-22T08:38:28.801 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.799+0000 7fc93a60c640 1 -- 172.21.15.142:0/3394761988 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca3c053cf0 con 0x55e09da560c0 2024-09-22T08:38:28.806 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.799+0000 7fca51016800 1 -- 172.21.15.142:0/3394761988 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e09da560c0 msgr2=0x55e09db450d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:28.807 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.799+0000 7fca51016800 1 --2- 172.21.15.142:0/3394761988 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e09da560c0 0x55e09db450d0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fca3c025c20 tx=0x7fca3c051000 comp rx=0 tx=0).stop 2024-09-22T08:38:28.807 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.799+0000 7fca51016800 1 -- 172.21.15.142:0/3394761988 shutdown_connections 2024-09-22T08:38:28.807 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.799+0000 7fca51016800 1 --2- 172.21.15.142:0/3394761988 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e09da560c0 0x55e09db450d0 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:28.807 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.799+0000 7fca51016800 1 -- 172.21.15.142:0/3394761988 >> 172.21.15.142:0/3394761988 conn(0x55e09da4fcc0 msgr2=0x55e09db40a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:38:28.807 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.799+0000 7fca51016800 1 -- 172.21.15.142:0/3394761988 shutdown_connections 2024-09-22T08:38:28.807 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.799+0000 7fca51016800 1 -- 172.21.15.142:0/3394761988 wait complete. 2024-09-22T08:38:28.807 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.800+0000 7fca51016800 1 Processor -- start 2024-09-22T08:38:28.807 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.800+0000 7fca51016800 1 -- start start 2024-09-22T08:38:28.807 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.800+0000 7fca51016800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e09da560c0 0x55e09db4cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:28.807 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.800+0000 7fca51016800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55e09da5c8f0 con 0x55e09da560c0 2024-09-22T08:38:28.807 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.800+0000 7fca4c7e7640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e09da560c0 0x55e09db4cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:28.807 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.800+0000 7fca4c7e7640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e09da560c0 0x55e09db4cb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:51312/0 (socket says 172.21.15.142:51312) 2024-09-22T08:38:28.807 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.800+0000 7fca4c7e7640 1 -- 172.21.15.142:0/3497190795 learned_addr learned my addr 172.21.15.142:0/3497190795 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:38:28.808 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.800+0000 7fca4c7e7640 1 -- 172.21.15.142:0/3497190795 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e09db4d0e0 con 0x55e09da560c0 2024-09-22T08:38:28.808 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.801+0000 7fca4c7e7640 1 --2- 172.21.15.142:0/3497190795 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e09da560c0 0x55e09db4cb80 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fca3c025c20 tx=0x7fca3c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:28.808 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.801+0000 7fc938e09640 1 -- 172.21.15.142:0/3497190795 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca3c068660 con 0x55e09da560c0 2024-09-22T08:38:28.808 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.801+0000 7fc938e09640 1 -- 172.21.15.142:0/3497190795 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca3c068800 con 0x55e09da560c0 2024-09-22T08:38:28.808 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.801+0000 7fca51016800 1 -- 172.21.15.142:0/3497190795 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e09db4d370 con 0x55e09da560c0 2024-09-22T08:38:28.808 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.801+0000 7fc938e09640 1 -- 172.21.15.142:0/3497190795 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca3c068ae0 con 0x55e09da560c0 2024-09-22T08:38:28.808 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.801+0000 7fca51016800 1 -- 172.21.15.142:0/3497190795 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e09db4df80 con 0x55e09da560c0 2024-09-22T08:38:28.808 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.801+0000 7fca51016800 1 Processor -- start 2024-09-22T08:38:28.808 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.801+0000 7fca51016800 1 -- start start 2024-09-22T08:38:28.808 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.802+0000 7fca51016800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e09db5a1d0 0x55e09db5c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:28.808 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.802+0000 7fca51016800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55e09d94cd50 con 0x55e09db5a1d0 2024-09-22T08:38:28.808 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.802+0000 7fc938e09640 1 -- 172.21.15.142:0/3497190795 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fca3c068c80 con 0x55e09da560c0 2024-09-22T08:38:28.808 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.802+0000 7fca4cfe8640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e09db5a1d0 0x55e09db5c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:28.809 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.802+0000 7fca4cfe8640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e09db5a1d0 0x55e09db5c5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:51322/0 (socket says 172.21.15.142:51322) 2024-09-22T08:38:28.809 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.802+0000 7fca4cfe8640 1 -- 172.21.15.142:0/357907005 learned_addr learned my addr 172.21.15.142:0/357907005 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:38:28.809 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.802+0000 7fc938e09640 1 --2- 172.21.15.142:0/3497190795 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fc93403cfb0 0x7fc93403f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:28.809 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.802+0000 7fc938e09640 1 -- 172.21.15.142:0/3497190795 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5938+0+0 (secure 0 0 0) 0x7fca3c098ce0 con 0x55e09da560c0 2024-09-22T08:38:28.809 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.802+0000 7fca4c7e7640 1 --2- 172.21.15.142:0/3497190795 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fc93403cfb0 0x7fc93403f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:28.809 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.802+0000 7fca4cfe8640 1 -- 172.21.15.142:0/357907005 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e09db5cb90 con 0x55e09db5a1d0 2024-09-22T08:38:28.809 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.802+0000 7fca4cfe8640 1 --2- 172.21.15.142:0/357907005 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e09db5a1d0 0x55e09db5c5c0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fca4400a3e0 tx=0x7fca4400a8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fac0724cf63ba7d server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:28.809 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.802+0000 7fca4c7e7640 1 --2- 172.21.15.142:0/3497190795 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fc93403cfb0 0x7fc93403f470 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fca3c045ed0 tx=0x7fca3c045e60 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:28.809 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.802+0000 7fc9327fc640 1 -- 172.21.15.142:0/357907005 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca44015070 con 0x55e09db5a1d0 2024-09-22T08:38:28.809 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.802+0000 7fc9327fc640 1 -- 172.21.15.142:0/357907005 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca44001670 con 0x55e09db5a1d0 2024-09-22T08:38:28.809 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.802+0000 7fc9327fc640 1 -- 172.21.15.142:0/357907005 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca44001990 con 0x55e09db5a1d0 2024-09-22T08:38:28.809 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.803+0000 7fca51016800 1 -- 172.21.15.142:0/357907005 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e09db5a1d0 msgr2=0x55e09db5c5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:28.809 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.803+0000 7fca51016800 1 --2- 172.21.15.142:0/357907005 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e09db5a1d0 0x55e09db5c5c0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fca4400a3e0 tx=0x7fca4400a8a0 comp rx=0 tx=0).stop 2024-09-22T08:38:28.809 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.803+0000 7fca51016800 1 -- 172.21.15.142:0/357907005 shutdown_connections 2024-09-22T08:38:28.810 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.803+0000 7fca51016800 1 --2- 172.21.15.142:0/357907005 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e09db5a1d0 0x55e09db5c5c0 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:28.810 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.803+0000 7fca51016800 1 -- 172.21.15.142:0/357907005 >> 172.21.15.142:0/357907005 conn(0x55e09da589f0 msgr2=0x55e09db54af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:38:28.810 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.803+0000 7fca51016800 1 -- 172.21.15.142:0/357907005 shutdown_connections 2024-09-22T08:38:28.810 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.803+0000 7fca51016800 1 -- 172.21.15.142:0/357907005 wait complete. 2024-09-22T08:38:28.810 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.803+0000 7fca51016800 1 Processor -- start 2024-09-22T08:38:28.810 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.803+0000 7fca51016800 1 -- start start 2024-09-22T08:38:28.810 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.803+0000 7fca51016800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e09db5a1d0 0x55e09db610b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:28.810 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.803+0000 7fca51016800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55e09db5ce80 con 0x55e09db5a1d0 2024-09-22T08:38:28.810 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.804+0000 7fca4cfe8640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e09db5a1d0 0x55e09db610b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:28.810 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.804+0000 7fca4cfe8640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e09db5a1d0 0x55e09db610b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:51336/0 (socket says 172.21.15.142:51336) 2024-09-22T08:38:28.810 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.804+0000 7fca4cfe8640 1 -- 172.21.15.142:0/3457656344 learned_addr learned my addr 172.21.15.142:0/3457656344 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:38:28.810 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.804+0000 7fca4cfe8640 1 -- 172.21.15.142:0/3457656344 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e09db61610 con 0x55e09db5a1d0 2024-09-22T08:38:28.810 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.804+0000 7fca4cfe8640 1 --2- 172.21.15.142:0/3457656344 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e09db5a1d0 0x55e09db610b0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fca44013040 tx=0x7fca44003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:28.811 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.804+0000 7fc930ff9640 1 -- 172.21.15.142:0/3457656344 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca44020020 con 0x55e09db5a1d0 2024-09-22T08:38:28.811 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.804+0000 7fc930ff9640 1 -- 172.21.15.142:0/3457656344 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca44010780 con 0x55e09db5a1d0 2024-09-22T08:38:28.811 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.804+0000 7fc930ff9640 1 -- 172.21.15.142:0/3457656344 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca44015040 con 0x55e09db5a1d0 2024-09-22T08:38:28.811 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.804+0000 7fca51016800 1 -- 172.21.15.142:0/3457656344 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e09db618a0 con 0x55e09db5a1d0 2024-09-22T08:38:28.811 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.804+0000 7fca51016800 1 -- 172.21.15.142:0/3457656344 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e09db62220 con 0x55e09db5a1d0 2024-09-22T08:38:28.816 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.805+0000 7fc930ff9640 1 -- 172.21.15.142:0/3457656344 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fca44023020 con 0x55e09db5a1d0 2024-09-22T08:38:28.816 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.805+0000 7fc930ff9640 1 --2- 172.21.15.142:0/3457656344 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fc92403d000 0x7fc92403f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:28.816 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.805+0000 7fc930ff9640 1 -- 172.21.15.142:0/3457656344 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5938+0+0 (secure 0 0 0) 0x7fca44053d20 con 0x55e09db5a1d0 2024-09-22T08:38:28.816 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.806+0000 7fca4bfe6640 1 --2- 172.21.15.142:0/3457656344 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fc92403d000 0x7fc92403f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:28.817 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.806+0000 7fca51016800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:38:28.818 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.806+0000 7fca51016800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:38:28.818 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.806+0000 7fca51016800 1 Processor -- start 2024-09-22T08:38:28.818 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.806+0000 7fca4bfe6640 1 --2- 172.21.15.142:0/3457656344 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fc92403d000 0x7fc92403f4c0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fca40001cf0 tx=0x7fca40001250 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:28.818 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.806+0000 7fca51016800 1 -- start start 2024-09-22T08:38:28.818 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.806+0000 7fca51016800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e09db7af40 0x55e09db7b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:28.818 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.806+0000 7fca51016800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55e09db45a90 con 0x55e09db7af40 2024-09-22T08:38:28.818 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.806+0000 7fca4c7e7640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e09db7af40 0x55e09db7b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:28.818 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.806+0000 7fca4c7e7640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e09db7af40 0x55e09db7b360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:51352/0 (socket says 172.21.15.142:51352) 2024-09-22T08:38:28.818 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.806+0000 7fca4c7e7640 1 -- 172.21.15.142:0/3871865916 learned_addr learned my addr 172.21.15.142:0/3871865916 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:38:28.818 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.807+0000 7fca4c7e7640 1 -- 172.21.15.142:0/3871865916 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e09db7b9a0 con 0x55e09db7af40 2024-09-22T08:38:28.818 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.807+0000 7fca4c7e7640 1 --2- 172.21.15.142:0/3871865916 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e09db7af40 0x55e09db7b360 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fca3c053780 tx=0x7fca3c05cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:28.818 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.807+0000 7fc910fe1640 1 -- 172.21.15.142:0/3871865916 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca3c05ddb0 con 0x55e09db7af40 2024-09-22T08:38:28.819 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.807+0000 7fc910fe1640 1 -- 172.21.15.142:0/3871865916 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca3c05cd10 con 0x55e09db7af40 2024-09-22T08:38:28.819 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.807+0000 7fca51016800 1 -- 172.21.15.142:0/3871865916 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e09db7c1d0 con 0x55e09db7af40 2024-09-22T08:38:28.819 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.807+0000 7fc910fe1640 1 -- 172.21.15.142:0/3871865916 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca3c07d760 con 0x55e09db7af40 2024-09-22T08:38:28.819 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.807+0000 7fca51016800 1 -- 172.21.15.142:0/3871865916 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e09db7c770 con 0x55e09db7af40 2024-09-22T08:38:28.819 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.808+0000 7fc910fe1640 1 -- 172.21.15.142:0/3871865916 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fca3c05c410 con 0x55e09db7af40 2024-09-22T08:38:28.819 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.808+0000 7fc910fe1640 1 --2- 172.21.15.142:0/3871865916 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fc88c03cf60 0x7fc88c03f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:28.819 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.808+0000 7fc910fe1640 1 -- 172.21.15.142:0/3871865916 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5938+0+0 (secure 0 0 0) 0x7fca3c092070 con 0x55e09db7af40 2024-09-22T08:38:28.819 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.808+0000 7fca4bfe6640 1 --2- 172.21.15.142:0/3871865916 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fc88c03cf60 0x7fc88c03f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:28.819 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.808+0000 7fc8ca7fc640 20 reqs_thread_entry: start 2024-09-22T08:38:28.819 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.808+0000 7fca4bfe6640 1 --2- 172.21.15.142:0/3871865916 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fc88c03cf60 0x7fc88c03f420 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fca40000f60 tx=0x7fca4000f000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:28.819 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.808+0000 7fca51016800 1 --2- 172.21.15.142:0/3497190795 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55e09db88800 0x55e09db8acc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:28.820 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.808+0000 7fca51016800 1 -- 172.21.15.142:0/3497190795 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e09db8b390 con 0x55e09db88800 2024-09-22T08:38:28.820 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.809+0000 7fca4cfe8640 1 --2- 172.21.15.142:0/3497190795 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55e09db88800 0x55e09db8acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:28.820 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.809+0000 7fca4cfe8640 1 --2- 172.21.15.142:0/3497190795 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55e09db88800 0x55e09db8acc0 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:28.820 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.809+0000 7fca4cfe8640 1 -- 172.21.15.142:0/3497190795 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fca4400e070 con 0x55e09db88800 2024-09-22T08:38:28.820 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.809+0000 7fca51016800 1 --2- 172.21.15.142:0/3497190795 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55e09db8d160 0x55e09db8f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:28.820 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.809+0000 7fca51016800 1 -- 172.21.15.142:0/3497190795 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:2 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e09db8fc90 con 0x55e09db8d160 2024-09-22T08:38:28.820 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.809+0000 7fca4c7e7640 1 --2- 172.21.15.142:0/3497190795 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55e09db8d160 0x55e09db8f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:28.820 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.809+0000 7fca4c7e7640 1 --2- 172.21.15.142:0/3497190795 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55e09db8d160 0x55e09db8f550 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:28.820 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.810+0000 7fca4c7e7640 1 -- 172.21.15.142:0/3497190795 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(2 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fca3c051070 con 0x55e09db8d160 2024-09-22T08:38:28.820 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.810+0000 7fca51016800 1 -- 172.21.15.142:0/3457656344 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fc92403d000 msgr2=0x7fc92403f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:28.820 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.810+0000 7fca51016800 1 --2- 172.21.15.142:0/3457656344 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fc92403d000 0x7fc92403f4c0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fca40001cf0 tx=0x7fca40001250 comp rx=0 tx=0).stop 2024-09-22T08:38:28.820 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.810+0000 7fca51016800 1 -- 172.21.15.142:0/3457656344 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e09db5a1d0 msgr2=0x55e09db610b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:28.821 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.811+0000 7fca51016800 1 --2- 172.21.15.142:0/3457656344 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e09db5a1d0 0x55e09db610b0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fca44013040 tx=0x7fca44003370 comp rx=0 tx=0).stop 2024-09-22T08:38:28.821 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.811+0000 7fca51016800 1 -- 172.21.15.142:0/3457656344 shutdown_connections 2024-09-22T08:38:28.821 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.811+0000 7fca51016800 1 --2- 172.21.15.142:0/3457656344 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fc92403d000 0x7fc92403f4c0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:28.821 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.811+0000 7fca51016800 1 --2- 172.21.15.142:0/3457656344 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e09db5a1d0 0x55e09db610b0 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:28.821 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.811+0000 7fca51016800 1 -- 172.21.15.142:0/3457656344 >> 172.21.15.142:0/3457656344 conn(0x55e09da589f0 msgr2=0x55e09db54ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:38:28.821 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.811+0000 7fca51016800 1 -- 172.21.15.142:0/3457656344 shutdown_connections 2024-09-22T08:38:28.821 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.811+0000 7fca51016800 1 -- 172.21.15.142:0/3457656344 wait complete. 2024-09-22T08:38:28.821 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.811+0000 7fca51016800 1 -- 172.21.15.142:0/3871865916 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fc88c03cf60 msgr2=0x7fc88c03f420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:28.821 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.811+0000 7fca51016800 1 --2- 172.21.15.142:0/3871865916 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fc88c03cf60 0x7fc88c03f420 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fca40000f60 tx=0x7fca4000f000 comp rx=0 tx=0).stop 2024-09-22T08:38:28.821 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.811+0000 7fca51016800 1 -- 172.21.15.142:0/3871865916 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e09db7af40 msgr2=0x55e09db7b360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:28.821 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.811+0000 7fca51016800 1 --2- 172.21.15.142:0/3871865916 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e09db7af40 0x55e09db7b360 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fca3c053780 tx=0x7fca3c05cbd0 comp rx=0 tx=0).stop 2024-09-22T08:38:28.821 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.811+0000 7fca51016800 1 -- 172.21.15.142:0/3871865916 shutdown_connections 2024-09-22T08:38:28.821 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.811+0000 7fca51016800 1 --2- 172.21.15.142:0/3871865916 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fc88c03cf60 0x7fc88c03f420 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:28.821 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.811+0000 7fca51016800 1 --2- 172.21.15.142:0/3871865916 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e09db7af40 0x55e09db7b360 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:28.822 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.811+0000 7fca51016800 1 -- 172.21.15.142:0/3871865916 >> 172.21.15.142:0/3871865916 conn(0x55e09db70480 msgr2=0x55e09db70860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:38:28.822 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.811+0000 7fca51016800 1 -- 172.21.15.142:0/3871865916 shutdown_connections 2024-09-22T08:38:28.822 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.811+0000 7fca51016800 1 -- 172.21.15.142:0/3871865916 wait complete. 2024-09-22T08:38:28.822 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.811+0000 7fca51016800 1 -- 172.21.15.142:0/3497190795 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55e09db88800 msgr2=0x55e09db8acc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:28.822 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.811+0000 7fca51016800 1 --2- 172.21.15.142:0/3497190795 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55e09db88800 0x55e09db8acc0 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:28.822 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.811+0000 7fca51016800 1 -- 172.21.15.142:0/3497190795 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55e09db8d160 msgr2=0x55e09db8f550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:28.822 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.811+0000 7fca51016800 1 --2- 172.21.15.142:0/3497190795 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55e09db8d160 0x55e09db8f550 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:28.822 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.811+0000 7fca51016800 1 -- 172.21.15.142:0/3497190795 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fc93403cfb0 msgr2=0x7fc93403f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:28.822 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.811+0000 7fca51016800 1 --2- 172.21.15.142:0/3497190795 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fc93403cfb0 0x7fc93403f470 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fca3c045ed0 tx=0x7fca3c045e60 comp rx=0 tx=0).stop 2024-09-22T08:38:28.822 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.811+0000 7fca51016800 1 -- 172.21.15.142:0/3497190795 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e09da560c0 msgr2=0x55e09db4cb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:28.822 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.811+0000 7fca51016800 1 --2- 172.21.15.142:0/3497190795 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e09da560c0 0x55e09db4cb80 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fca3c025c20 tx=0x7fca3c002fb0 comp rx=0 tx=0).stop 2024-09-22T08:38:28.822 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.811+0000 7fca51016800 1 -- 172.21.15.142:0/3497190795 shutdown_connections 2024-09-22T08:38:28.822 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.811+0000 7fca51016800 1 --2- 172.21.15.142:0/3497190795 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55e09db8d160 0x55e09db8f550 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:28.823 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.811+0000 7fca51016800 1 --2- 172.21.15.142:0/3497190795 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55e09db88800 0x55e09db8acc0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:28.823 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.811+0000 7fca51016800 1 --2- 172.21.15.142:0/3497190795 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fc93403cfb0 0x7fc93403f470 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:28.823 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.811+0000 7fca51016800 1 --2- 172.21.15.142:0/3497190795 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e09da560c0 0x55e09db4cb80 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:28.823 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.811+0000 7fca51016800 1 -- 172.21.15.142:0/3497190795 >> 172.21.15.142:0/3497190795 conn(0x55e09da4fcc0 msgr2=0x55e09db3f240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:38:28.823 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.812+0000 7fca51016800 1 -- 172.21.15.142:0/3497190795 shutdown_connections 2024-09-22T08:38:28.823 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.812+0000 7fca51016800 1 -- 172.21.15.142:0/3497190795 wait complete. 2024-09-22T08:38:28.824 INFO:teuthology.orchestra.run.smithi142.stdout:{"id":"e239248c-0bee-4e41-803a-24b288d3eb8f","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-09-22T08:38:28.824 DEBUG:tasks.util.rgw: json result: {'id': 'e239248c-0bee-4e41-803a-24b288d3eb8f', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-09-22T08:38:28.824 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'set'] 2024-09-22T08:38:28.824 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'set'] 2024-09-22T08:38:28.824 DEBUG:teuthology.orchestra.run.smithi142:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone set 2024-09-22T08:38:28.909 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:38:28.909 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:38:28.910 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.907+0000 7fd2ab939800 1 Processor -- start 2024-09-22T08:38:28.910 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.907+0000 7fd2ab939800 1 -- start start 2024-09-22T08:38:28.910 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.907+0000 7fd2ab939800 1 --2- >> v2:172.21.15.31:3300/0 conn(0x556803211540 0x55680320fb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:28.910 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.907+0000 7fd2ab939800 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x556803126a20 con 0x556803210060 2024-09-22T08:38:28.910 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.907+0000 7fd2ab939800 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x5568031267d0 con 0x556803211540 2024-09-22T08:38:28.910 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.908+0000 7fd2a75c7640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x556803211540 0x55680320fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:28.910 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.908+0000 7fd2a75c7640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x556803211540 0x55680320fb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:51360/0 (socket says 172.21.15.142:51360) 2024-09-22T08:38:28.910 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.908+0000 7fd2a75c7640 1 -- 172.21.15.142:0/637418224 learned_addr learned my addr 172.21.15.142:0/637418224 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:38:28.911 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.908+0000 7fd29edc6640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x556803210060 0x5568032a3500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.142:50428/0 (socket says 172.21.15.142:50428) 2024-09-22T08:38:28.911 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.908+0000 7fd2a75c7640 1 -- 172.21.15.142:0/637418224 >> v1:172.21.15.31:6789/0 conn(0x556803210060 legacy=0x5568032a3500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:28.911 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.908+0000 7fd2a75c7640 1 -- 172.21.15.142:0/637418224 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x556803210620 con 0x556803211540 2024-09-22T08:38:28.912 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.911+0000 7fd2a75c7640 1 --2- 172.21.15.142:0/637418224 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556803211540 0x55680320fb20 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fd29800a520 tx=0x7fd298045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b818dd81f09dc7c server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:28.912 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.911+0000 7fd2a6dc6640 1 -- 172.21.15.142:0/637418224 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd298055070 con 0x556803211540 2024-09-22T08:38:28.912 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.911+0000 7fd2a6dc6640 1 -- 172.21.15.142:0/637418224 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2980515b0 con 0x556803211540 2024-09-22T08:38:28.912 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.911+0000 7fd2a6dc6640 1 -- 172.21.15.142:0/637418224 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd2980518d0 con 0x556803211540 2024-09-22T08:38:28.913 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.911+0000 7fd2ab939800 1 -- 172.21.15.142:0/637418224 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556803211540 msgr2=0x55680320fb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:28.913 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.911+0000 7fd2ab939800 1 --2- 172.21.15.142:0/637418224 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556803211540 0x55680320fb20 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fd29800a520 tx=0x7fd298045ba0 comp rx=0 tx=0).stop 2024-09-22T08:38:28.913 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.911+0000 7fd2ab939800 1 -- 172.21.15.142:0/637418224 shutdown_connections 2024-09-22T08:38:28.913 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.911+0000 7fd2ab939800 1 --2- 172.21.15.142:0/637418224 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556803211540 0x55680320fb20 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:28.913 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.911+0000 7fd2ab939800 1 -- 172.21.15.142:0/637418224 >> 172.21.15.142:0/637418224 conn(0x556803296da0 msgr2=0x556803299200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:38:28.913 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.911+0000 7fd2ab939800 1 -- 172.21.15.142:0/637418224 shutdown_connections 2024-09-22T08:38:28.913 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.911+0000 7fd2ab939800 1 -- 172.21.15.142:0/637418224 wait complete. 2024-09-22T08:38:28.927 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.925+0000 7fd2ab939800 1 Processor -- start 2024-09-22T08:38:28.927 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.925+0000 7fd2ab939800 1 -- start start 2024-09-22T08:38:28.927 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.925+0000 7fd2ab939800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556803210060 0x55680338d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:28.927 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.925+0000 7fd2ab939800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x556803133dd0 con 0x556803210060 2024-09-22T08:38:28.927 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.925+0000 7fd2a75c7640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556803210060 0x55680338d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:28.927 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.925+0000 7fd2a75c7640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556803210060 0x55680338d1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:51364/0 (socket says 172.21.15.142:51364) 2024-09-22T08:38:28.927 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.925+0000 7fd2a75c7640 1 -- 172.21.15.142:0/830833592 learned_addr learned my addr 172.21.15.142:0/830833592 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:38:28.927 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.925+0000 7fd2a75c7640 1 -- 172.21.15.142:0/830833592 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55680338d790 con 0x556803210060 2024-09-22T08:38:28.930 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.925+0000 7fd2a75c7640 1 --2- 172.21.15.142:0/830833592 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556803210060 0x55680338d1a0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fd2980460d0 tx=0x7fd298051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cba6d872bf0089fb server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:28.930 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.925+0000 7fd19560a640 1 -- 172.21.15.142:0/830833592 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd2980519d0 con 0x556803210060 2024-09-22T08:38:28.930 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.925+0000 7fd19560a640 1 -- 172.21.15.142:0/830833592 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd298051b70 con 0x556803210060 2024-09-22T08:38:28.930 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.925+0000 7fd19560a640 1 -- 172.21.15.142:0/830833592 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd298051e50 con 0x556803210060 2024-09-22T08:38:28.930 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.926+0000 7fd2ab939800 1 -- 172.21.15.142:0/830833592 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556803210060 msgr2=0x55680338d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:28.930 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.926+0000 7fd2ab939800 1 --2- 172.21.15.142:0/830833592 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556803210060 0x55680338d1a0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fd2980460d0 tx=0x7fd298051000 comp rx=0 tx=0).stop 2024-09-22T08:38:28.930 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.926+0000 7fd2ab939800 1 -- 172.21.15.142:0/830833592 shutdown_connections 2024-09-22T08:38:28.930 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.926+0000 7fd2ab939800 1 --2- 172.21.15.142:0/830833592 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556803210060 0x55680338d1a0 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:28.930 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.926+0000 7fd2ab939800 1 -- 172.21.15.142:0/830833592 >> 172.21.15.142:0/830833592 conn(0x556803296da0 msgr2=0x556803388b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:38:28.931 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.926+0000 7fd2ab939800 1 -- 172.21.15.142:0/830833592 shutdown_connections 2024-09-22T08:38:28.931 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.926+0000 7fd2ab939800 1 -- 172.21.15.142:0/830833592 wait complete. 2024-09-22T08:38:28.931 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.926+0000 7fd2ab939800 1 Processor -- start 2024-09-22T08:38:28.931 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.926+0000 7fd2ab939800 1 -- start start 2024-09-22T08:38:28.931 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.927+0000 7fd2ab939800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556803211540 0x556803394f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:28.931 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.927+0000 7fd2ab939800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55680338db00 con 0x556803211540 2024-09-22T08:38:28.932 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.927+0000 7fd2a75c7640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556803211540 0x556803394f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:28.932 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.927+0000 7fd2a75c7640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556803211540 0x556803394f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:51368/0 (socket says 172.21.15.142:51368) 2024-09-22T08:38:28.932 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.927+0000 7fd2a75c7640 1 -- 172.21.15.142:0/2519360998 learned_addr learned my addr 172.21.15.142:0/2519360998 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:38:28.932 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.927+0000 7fd2a75c7640 1 -- 172.21.15.142:0/2519360998 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556803395470 con 0x556803211540 2024-09-22T08:38:28.932 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.927+0000 7fd2a75c7640 1 --2- 172.21.15.142:0/2519360998 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556803211540 0x556803394f10 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7fd2980460d0 tx=0x7fd298002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:28.932 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.927+0000 7fd193e07640 1 -- 172.21.15.142:0/2519360998 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd298072020 con 0x556803211540 2024-09-22T08:38:28.932 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.927+0000 7fd193e07640 1 -- 172.21.15.142:0/2519360998 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd29805a450 con 0x556803211540 2024-09-22T08:38:28.932 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.927+0000 7fd193e07640 1 -- 172.21.15.142:0/2519360998 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd29805a750 con 0x556803211540 2024-09-22T08:38:28.933 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.927+0000 7fd2ab939800 1 -- 172.21.15.142:0/2519360998 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556803395700 con 0x556803211540 2024-09-22T08:38:28.933 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.927+0000 7fd2ab939800 1 -- 172.21.15.142:0/2519360998 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556803396310 con 0x556803211540 2024-09-22T08:38:28.945 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.928+0000 7fd2ab939800 1 Processor -- start 2024-09-22T08:38:28.945 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.928+0000 7fd2ab939800 1 -- start start 2024-09-22T08:38:28.945 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.928+0000 7fd2ab939800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5568033a2550 0x5568033a2950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:28.945 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.928+0000 7fd2ab939800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x556803192d50 con 0x5568033a2550 2024-09-22T08:38:28.945 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.928+0000 7fd193e07640 1 -- 172.21.15.142:0/2519360998 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fd298075020 con 0x556803211540 2024-09-22T08:38:28.945 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.928+0000 7fd2a7dc8640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5568033a2550 0x5568033a2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:28.945 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.928+0000 7fd2a7dc8640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5568033a2550 0x5568033a2950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:51374/0 (socket says 172.21.15.142:51374) 2024-09-22T08:38:28.945 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.928+0000 7fd2a7dc8640 1 -- 172.21.15.142:0/2808332922 learned_addr learned my addr 172.21.15.142:0/2808332922 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:38:28.946 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.928+0000 7fd193e07640 1 --2- 172.21.15.142:0/2519360998 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fd18c03cfb0 0x7fd18c03f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:28.946 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.929+0000 7fd193e07640 1 -- 172.21.15.142:0/2519360998 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5938+0+0 (secure 0 0 0) 0x7fd29806b040 con 0x556803211540 2024-09-22T08:38:28.946 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.929+0000 7fd2a7dc8640 1 -- 172.21.15.142:0/2808332922 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5568033a2f40 con 0x5568033a2550 2024-09-22T08:38:28.946 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.929+0000 7fd2a75c7640 1 --2- 172.21.15.142:0/2519360998 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fd18c03cfb0 0x7fd18c03f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:28.946 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.929+0000 7fd2a7dc8640 1 --2- 172.21.15.142:0/2808332922 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5568033a2550 0x5568033a2950 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fd2a000a3e0 tx=0x7fd2a000a8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c7ab9b8e884af86 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:28.946 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.929+0000 7fd191e03640 1 -- 172.21.15.142:0/2808332922 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd2a0015070 con 0x5568033a2550 2024-09-22T08:38:28.946 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.929+0000 7fd191e03640 1 -- 172.21.15.142:0/2808332922 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2a0001670 con 0x5568033a2550 2024-09-22T08:38:28.946 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.929+0000 7fd191e03640 1 -- 172.21.15.142:0/2808332922 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd2a0001990 con 0x5568033a2550 2024-09-22T08:38:28.946 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.929+0000 7fd2ab939800 1 -- 172.21.15.142:0/2808332922 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5568033a2550 msgr2=0x5568033a2950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:28.946 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.929+0000 7fd2ab939800 1 --2- 172.21.15.142:0/2808332922 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5568033a2550 0x5568033a2950 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fd2a000a3e0 tx=0x7fd2a000a8a0 comp rx=0 tx=0).stop 2024-09-22T08:38:28.946 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.929+0000 7fd2a75c7640 1 --2- 172.21.15.142:0/2519360998 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fd18c03cfb0 0x7fd18c03f470 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fd29804f6d0 tx=0x7fd29804f640 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:28.946 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.929+0000 7fd2ab939800 1 -- 172.21.15.142:0/2808332922 shutdown_connections 2024-09-22T08:38:28.946 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.929+0000 7fd2ab939800 1 --2- 172.21.15.142:0/2808332922 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5568033a2550 0x5568033a2950 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:28.947 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.929+0000 7fd2ab939800 1 -- 172.21.15.142:0/2808332922 >> 172.21.15.142:0/2808332922 conn(0x55680339ebf0 msgr2=0x55680339ce30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:38:28.947 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.929+0000 7fd2ab939800 1 -- 172.21.15.142:0/2808332922 shutdown_connections 2024-09-22T08:38:28.947 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.929+0000 7fd2ab939800 1 -- 172.21.15.142:0/2808332922 wait complete. 2024-09-22T08:38:28.947 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.930+0000 7fd2ab939800 1 Processor -- start 2024-09-22T08:38:28.947 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.930+0000 7fd2ab939800 1 -- start start 2024-09-22T08:38:28.947 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.930+0000 7fd2ab939800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5568033a2550 0x5568033a9860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:28.947 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.930+0000 7fd2ab939800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5568033a33b0 con 0x5568033a2550 2024-09-22T08:38:28.947 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.930+0000 7fd2a7dc8640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5568033a2550 0x5568033a9860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:28.947 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.930+0000 7fd2a7dc8640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5568033a2550 0x5568033a9860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:51390/0 (socket says 172.21.15.142:51390) 2024-09-22T08:38:28.947 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.930+0000 7fd2a7dc8640 1 -- 172.21.15.142:0/2424173143 learned_addr learned my addr 172.21.15.142:0/2424173143 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:38:28.947 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.930+0000 7fd2a7dc8640 1 -- 172.21.15.142:0/2424173143 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5568033a9dc0 con 0x5568033a2550 2024-09-22T08:38:28.947 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.931+0000 7fd2a7dc8640 1 --2- 172.21.15.142:0/2424173143 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5568033a2550 0x5568033a9860 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fd2a0013040 tx=0x7fd2a0003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:28.947 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.931+0000 7fd183fff640 1 -- 172.21.15.142:0/2424173143 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd2a0020020 con 0x5568033a2550 2024-09-22T08:38:28.948 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.931+0000 7fd183fff640 1 -- 172.21.15.142:0/2424173143 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2a0010780 con 0x5568033a2550 2024-09-22T08:38:28.948 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.931+0000 7fd183fff640 1 -- 172.21.15.142:0/2424173143 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd2a0015040 con 0x5568033a2550 2024-09-22T08:38:28.948 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.931+0000 7fd2ab939800 1 -- 172.21.15.142:0/2424173143 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5568033aa050 con 0x5568033a2550 2024-09-22T08:38:28.948 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.931+0000 7fd2ab939800 1 -- 172.21.15.142:0/2424173143 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5568033aa9d0 con 0x5568033a2550 2024-09-22T08:38:28.948 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.932+0000 7fd183fff640 1 -- 172.21.15.142:0/2424173143 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fd2a0023020 con 0x5568033a2550 2024-09-22T08:38:28.948 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.932+0000 7fd183fff640 1 --2- 172.21.15.142:0/2424173143 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fd18803d000 0x7fd18803f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:28.948 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.932+0000 7fd183fff640 1 -- 172.21.15.142:0/2424173143 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5938+0+0 (secure 0 0 0) 0x7fd2a0053d20 con 0x5568033a2550 2024-09-22T08:38:28.948 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.932+0000 7fd29edc6640 1 --2- 172.21.15.142:0/2424173143 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fd18803d000 0x7fd18803f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:28.948 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.932+0000 7fd2ab939800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:38:28.948 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.932+0000 7fd2ab939800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:38:28.948 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.932+0000 7fd29edc6640 1 --2- 172.21.15.142:0/2424173143 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fd18803d000 0x7fd18803f4c0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fd290001db0 tx=0x7fd290001310 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:28.948 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.932+0000 7fd2ab939800 1 Processor -- start 2024-09-22T08:38:28.948 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.933+0000 7fd2ab939800 1 -- start start 2024-09-22T08:38:28.949 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.933+0000 7fd2ab939800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5568033c36f0 0x5568033c3b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:28.949 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.933+0000 7fd2ab939800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55680338dc80 con 0x5568033c36f0 2024-09-22T08:38:28.949 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.933+0000 7fd2a75c7640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5568033c36f0 0x5568033c3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:28.949 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.933+0000 7fd2a75c7640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5568033c36f0 0x5568033c3b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:51406/0 (socket says 172.21.15.142:51406) 2024-09-22T08:38:28.949 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.933+0000 7fd2a75c7640 1 -- 172.21.15.142:0/3138338655 learned_addr learned my addr 172.21.15.142:0/3138338655 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:38:28.949 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.933+0000 7fd2a75c7640 1 -- 172.21.15.142:0/3138338655 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5568033c4150 con 0x5568033c36f0 2024-09-22T08:38:28.949 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.933+0000 7fd2a75c7640 1 --2- 172.21.15.142:0/3138338655 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5568033c36f0 0x5568033c3b10 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fd298096550 tx=0x7fd29804fb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:28.949 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.933+0000 7fd117fff640 1 -- 172.21.15.142:0/3138338655 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd298093070 con 0x5568033c36f0 2024-09-22T08:38:28.949 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.933+0000 7fd117fff640 1 -- 172.21.15.142:0/3138338655 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd298065780 con 0x5568033c36f0 2024-09-22T08:38:28.949 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.933+0000 7fd2ab939800 1 -- 172.21.15.142:0/3138338655 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5568033c4980 con 0x5568033c36f0 2024-09-22T08:38:28.949 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.933+0000 7fd117fff640 1 -- 172.21.15.142:0/3138338655 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd2980503e0 con 0x5568033c36f0 2024-09-22T08:38:28.949 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.934+0000 7fd2ab939800 1 -- 172.21.15.142:0/3138338655 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5568033c4f20 con 0x5568033c36f0 2024-09-22T08:38:28.950 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.934+0000 7fd117fff640 1 -- 172.21.15.142:0/3138338655 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fd298096070 con 0x5568033c36f0 2024-09-22T08:38:28.950 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.934+0000 7fd117fff640 1 --2- 172.21.15.142:0/3138338655 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fd0e803cfb0 0x7fd0e803f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:28.950 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.935+0000 7fd117fff640 1 -- 172.21.15.142:0/3138338655 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5938+0+0 (secure 0 0 0) 0x7fd298062070 con 0x5568033c36f0 2024-09-22T08:38:28.950 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.935+0000 7fd29edc6640 1 --2- 172.21.15.142:0/3138338655 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fd0e803cfb0 0x7fd0e803f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:28.950 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.935+0000 7fd115ffb640 20 reqs_thread_entry: start 2024-09-22T08:38:28.950 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.935+0000 7fd29edc6640 1 --2- 172.21.15.142:0/3138338655 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fd0e803cfb0 0x7fd0e803f470 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fd290000f60 tx=0x7fd29000f000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:28.950 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.935+0000 7fd2ab939800 1 --2- 172.21.15.142:0/2519360998 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5568033d1050 0x5568033d34c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:28.950 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.935+0000 7fd2ab939800 1 -- 172.21.15.142:0/2519360998 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5568033d3b40 con 0x5568033d1050 2024-09-22T08:38:28.950 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.935+0000 7fd2a7dc8640 1 --2- 172.21.15.142:0/2519360998 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5568033d1050 0x5568033d34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:28.950 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.935+0000 7fd2a7dc8640 1 --2- 172.21.15.142:0/2519360998 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5568033d1050 0x5568033d34c0 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:28.950 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.936+0000 7fd2a7dc8640 1 -- 172.21.15.142:0/2519360998 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd2a000e070 con 0x5568033d1050 2024-09-22T08:38:28.950 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.936+0000 7fd2ab939800 1 -- 172.21.15.142:0/2519360998 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5568033d43f0 con 0x5568033d1050 2024-09-22T08:38:28.950 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.936+0000 7fd2a7dc8640 1 -- 172.21.15.142:0/2519360998 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd2a000e070 con 0x5568033d1050 2024-09-22T08:38:28.951 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.936+0000 7fd2ab939800 1 --2- 172.21.15.142:0/2519360998 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5568033d5d00 0x5568033d8150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:28.951 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.936+0000 7fd2ab939800 1 -- 172.21.15.142:0/2519360998 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:3 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5568033d88e0 con 0x5568033d5d00 2024-09-22T08:38:28.951 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.936+0000 7fd2a75c7640 1 --2- 172.21.15.142:0/2519360998 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5568033d5d00 0x5568033d8150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:28.951 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.936+0000 7fd2a75c7640 1 --2- 172.21.15.142:0/2519360998 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5568033d5d00 0x5568033d8150 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:28.951 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.936+0000 7fd2a75c7640 1 -- 172.21.15.142:0/2519360998 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(3 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fd29809d070 con 0x5568033d5d00 2024-09-22T08:38:28.951 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.937+0000 7fd2ab939800 1 -- 172.21.15.142:0/2519360998 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5568033e5a00 con 0x5568033d1050 2024-09-22T08:38:28.951 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.937+0000 7fd2a7dc8640 1 -- 172.21.15.142:0/2519360998 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(4 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd2a000e070 con 0x5568033d1050 2024-09-22T08:38:28.951 INFO:teuthology.orchestra.run.smithi142.stderr:NOTICE: set zone's realm_id= 2024-09-22T08:38:28.951 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.937+0000 7fd2ab939800 1 -- 172.21.15.142:0/2519360998 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5568033dcdc0 con 0x5568033d5d00 2024-09-22T08:38:28.951 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.937+0000 7fd2a75c7640 1 -- 172.21.15.142:0/2519360998 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(5 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd29809d070 con 0x5568033d5d00 2024-09-22T08:38:28.951 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.937+0000 7fd2a75c7640 1 --2- 172.21.15.142:0/2519360998 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7fd29808f070 0x7fd29806c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:28.951 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.937+0000 7fd2a75c7640 1 -- 172.21.15.142:0/2519360998 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:6 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5568033dcdc0 con 0x7fd29808f070 2024-09-22T08:38:28.951 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.937+0000 7fd29edc6640 1 --2- 172.21.15.142:0/2519360998 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7fd29808f070 0x7fd29806c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:28.952 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.938+0000 7fd29edc6640 1 --2- 172.21.15.142:0/2519360998 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7fd29808f070 0x7fd29806c8d0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:28.952 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.938+0000 7fd29edc6640 1 -- 172.21.15.142:0/2519360998 <== osd.2 v2:172.21.15.142:6808/279438927 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd29001e700 con 0x7fd29808f070 2024-09-22T08:38:28.952 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.938+0000 7fd29edc6640 1 --2- 172.21.15.142:0/2519360998 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7fd29000f070 0x7fd29000e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:28.952 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.938+0000 7fd29edc6640 1 -- 172.21.15.142:0/2519360998 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:7 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5568033dcdc0 con 0x7fd29000f070 2024-09-22T08:38:28.952 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.938+0000 7fd2a7dc8640 1 --2- 172.21.15.142:0/2519360998 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7fd29000f070 0x7fd29000e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:28.952 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.938+0000 7fd2a7dc8640 1 --2- 172.21.15.142:0/2519360998 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7fd29000f070 0x7fd29000e8c0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:28.952 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.939+0000 7fd2a7dc8640 1 -- 172.21.15.142:0/2519360998 <== osd.0 v2:172.21.15.31:6800/168281188 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2a000e070 con 0x7fd29000f070 2024-09-22T08:38:28.952 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.939+0000 7fd2a7dc8640 1 -- 172.21.15.142:0/2519360998 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:8 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5568033dcdc0 con 0x5568033d1050 2024-09-22T08:38:28.952 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.939+0000 7fd2a7dc8640 1 -- 172.21.15.142:0/2519360998 <== osd.1 v2:172.21.15.142:6816/3192108003 4 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2a000e070 con 0x5568033d1050 2024-09-22T08:38:28.952 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.939+0000 7fd2a7dc8640 1 -- 172.21.15.142:0/2519360998 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:9 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5568033dcdc0 con 0x5568033d1050 2024-09-22T08:38:28.952 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.939+0000 7fd2a7dc8640 1 -- 172.21.15.142:0/2519360998 <== osd.1 v2:172.21.15.142:6816/3192108003 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2a000e070 con 0x5568033d1050 2024-09-22T08:38:28.952 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.939+0000 7fd2a7dc8640 1 -- 172.21.15.142:0/2519360998 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:10 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5568033dcdc0 con 0x5568033d1050 2024-09-22T08:38:28.952 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.939+0000 7fd2a7dc8640 1 -- 172.21.15.142:0/2519360998 <== osd.1 v2:172.21.15.142:6816/3192108003 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2a000e070 con 0x5568033d1050 2024-09-22T08:38:28.953 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.939+0000 7fd2a7dc8640 1 -- 172.21.15.142:0/2519360998 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:11 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5568033dcdc0 con 0x7fd29000f070 2024-09-22T08:38:28.953 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.940+0000 7fd2a7dc8640 1 -- 172.21.15.142:0/2519360998 <== osd.0 v2:172.21.15.31:6800/168281188 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2a000e070 con 0x7fd29000f070 2024-09-22T08:38:28.953 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.940+0000 7fd2a7dc8640 1 -- 172.21.15.142:0/2519360998 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:12 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5568033dcdc0 con 0x7fd29808f070 2024-09-22T08:38:28.953 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.940+0000 7fd29edc6640 1 -- 172.21.15.142:0/2519360998 <== osd.2 v2:172.21.15.142:6808/279438927 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd29001e700 con 0x7fd29808f070 2024-09-22T08:38:28.953 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.940+0000 7fd29edc6640 1 -- 172.21.15.142:0/2519360998 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:13 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5568033dcdc0 con 0x5568033d5d00 2024-09-22T08:38:28.953 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.940+0000 7fd2a75c7640 1 -- 172.21.15.142:0/2519360998 <== osd.3 v2:172.21.15.142:6800/1064901393 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd29809d070 con 0x5568033d5d00 2024-09-22T08:38:28.953 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.940+0000 7fd2a75c7640 1 -- 172.21.15.142:0/2519360998 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:14 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5568033dcdc0 con 0x5568033d1050 2024-09-22T08:38:28.953 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.940+0000 7fd2a7dc8640 1 -- 172.21.15.142:0/2519360998 <== osd.1 v2:172.21.15.142:6816/3192108003 7 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2a000e070 con 0x5568033d1050 2024-09-22T08:38:28.953 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.940+0000 7fd2a7dc8640 1 -- 172.21.15.142:0/2519360998 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:15 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5568033dcdc0 con 0x7fd29000f070 2024-09-22T08:38:28.953 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.941+0000 7fd2a7dc8640 1 -- 172.21.15.142:0/2519360998 <== osd.0 v2:172.21.15.31:6800/168281188 3 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2a000e070 con 0x7fd29000f070 2024-09-22T08:38:28.953 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.941+0000 7fd2a7dc8640 1 -- 172.21.15.142:0/2519360998 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:16 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5568033dcdc0 con 0x5568033d1050 2024-09-22T08:38:28.954 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.941+0000 7fd2a7dc8640 1 -- 172.21.15.142:0/2519360998 <== osd.1 v2:172.21.15.142:6816/3192108003 8 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2a000e070 con 0x5568033d1050 2024-09-22T08:38:28.954 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.941+0000 7fd2a7dc8640 1 -- 172.21.15.142:0/2519360998 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:17 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5568033dcdc0 con 0x7fd29808f070 2024-09-22T08:38:28.954 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.941+0000 7fd29edc6640 1 -- 172.21.15.142:0/2519360998 <== osd.2 v2:172.21.15.142:6808/279438927 3 ==== osd_op_reply(17 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fd29001e700 con 0x7fd29808f070 2024-09-22T08:38:28.954 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.941+0000 7fd29edc6640 1 -- 172.21.15.142:0/2519360998 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:18 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5568033dcdc0 con 0x5568033d5d00 2024-09-22T08:38:28.954 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.941+0000 7fd2a75c7640 1 -- 172.21.15.142:0/2519360998 <== osd.3 v2:172.21.15.142:6800/1064901393 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd29809d070 con 0x5568033d5d00 2024-09-22T08:38:28.954 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.941+0000 7fd2a75c7640 1 -- 172.21.15.142:0/2519360998 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:19 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5568033dcdc0 con 0x5568033d5d00 2024-09-22T08:38:28.954 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.941+0000 7fd2a75c7640 1 -- 172.21.15.142:0/2519360998 <== osd.3 v2:172.21.15.142:6800/1064901393 5 ==== osd_op_reply(19 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fd29809d070 con 0x5568033d5d00 2024-09-22T08:38:28.954 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.941+0000 7fd2a75c7640 1 -- 172.21.15.142:0/2519360998 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:20 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5568033dcdc0 con 0x7fd29000f070 2024-09-22T08:38:28.954 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.942+0000 7fd2a7dc8640 1 -- 172.21.15.142:0/2519360998 <== osd.0 v2:172.21.15.31:6800/168281188 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2a000e070 con 0x7fd29000f070 2024-09-22T08:38:28.954 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.942+0000 7fd2a7dc8640 1 -- 172.21.15.142:0/2519360998 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:21 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5568033dcdc0 con 0x5568033d5d00 2024-09-22T08:38:28.954 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.942+0000 7fd2a75c7640 1 -- 172.21.15.142:0/2519360998 <== osd.3 v2:172.21.15.142:6800/1064901393 6 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd29809d070 con 0x5568033d5d00 2024-09-22T08:38:28.954 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.942+0000 7fd2a75c7640 1 -- 172.21.15.142:0/2519360998 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:22 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5568033dcdc0 con 0x5568033d5d00 2024-09-22T08:38:28.954 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.942+0000 7fd2a75c7640 1 -- 172.21.15.142:0/2519360998 <== osd.3 v2:172.21.15.142:6800/1064901393 7 ==== osd_op_reply(22 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fd29809d070 con 0x5568033d5d00 2024-09-22T08:38:28.955 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.942+0000 7fd2a75c7640 1 -- 172.21.15.142:0/2519360998 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:23 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5568033dcdc0 con 0x5568033d1050 2024-09-22T08:38:28.955 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.943+0000 7fd2a7dc8640 1 -- 172.21.15.142:0/2519360998 <== osd.1 v2:172.21.15.142:6816/3192108003 9 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2a000e070 con 0x5568033d1050 2024-09-22T08:38:28.955 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.943+0000 7fd2a7dc8640 1 -- 172.21.15.142:0/2519360998 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:24 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5568033dcdc0 con 0x5568033d1050 2024-09-22T08:38:28.955 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.943+0000 7fd2a7dc8640 1 -- 172.21.15.142:0/2519360998 <== osd.1 v2:172.21.15.142:6816/3192108003 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fd2a000e070 con 0x5568033d1050 2024-09-22T08:38:28.955 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.943+0000 7fd2a7dc8640 1 -- 172.21.15.142:0/2519360998 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:25 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5568033dcdc0 con 0x7fd29000f070 2024-09-22T08:38:28.955 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.943+0000 7fd2a7dc8640 1 -- 172.21.15.142:0/2519360998 <== osd.0 v2:172.21.15.31:6800/168281188 5 ==== osd_op_reply(25 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2a000e070 con 0x7fd29000f070 2024-09-22T08:38:28.955 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.943+0000 7fd2a7dc8640 1 -- 172.21.15.142:0/2519360998 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:26 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5568033dcdc0 con 0x5568033d5d00 2024-09-22T08:38:28.960 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.943+0000 7fd2a75c7640 1 -- 172.21.15.142:0/2519360998 <== osd.3 v2:172.21.15.142:6800/1064901393 8 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd29809d070 con 0x5568033d5d00 2024-09-22T08:38:28.960 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.943+0000 7fd2a75c7640 1 -- 172.21.15.142:0/2519360998 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:27 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5568033dcdc0 con 0x7fd29808f070 2024-09-22T08:38:28.960 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.944+0000 7fd29edc6640 1 -- 172.21.15.142:0/2519360998 <== osd.2 v2:172.21.15.142:6808/279438927 4 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd29001e700 con 0x7fd29808f070 2024-09-22T08:38:28.960 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.944+0000 7fd29edc6640 1 -- 172.21.15.142:0/2519360998 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:28 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5568033dcdc0 con 0x5568033d1050 2024-09-22T08:38:28.960 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.944+0000 7fd2a7dc8640 1 -- 172.21.15.142:0/2519360998 <== osd.1 v2:172.21.15.142:6816/3192108003 11 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2a000e070 con 0x5568033d1050 2024-09-22T08:38:28.960 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.944+0000 7fd2a7dc8640 1 -- 172.21.15.142:0/2519360998 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:29 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5568033dcdc0 con 0x7fd29000f070 2024-09-22T08:38:28.960 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.944+0000 7fd2a7dc8640 1 -- 172.21.15.142:0/2519360998 <== osd.0 v2:172.21.15.31:6800/168281188 6 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2a000e070 con 0x7fd29000f070 2024-09-22T08:38:28.960 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.944+0000 7fd2a7dc8640 1 -- 172.21.15.142:0/2519360998 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:30 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5568033dcdc0 con 0x5568033d5d00 2024-09-22T08:38:28.960 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.944+0000 7fd2a75c7640 1 -- 172.21.15.142:0/2519360998 <== osd.3 v2:172.21.15.142:6800/1064901393 9 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd29809d070 con 0x5568033d5d00 2024-09-22T08:38:28.961 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.944+0000 7fd2a75c7640 1 -- 172.21.15.142:0/2519360998 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:31 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5568033dcdc0 con 0x7fd29000f070 2024-09-22T08:38:28.961 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.945+0000 7fd2a7dc8640 1 -- 172.21.15.142:0/2519360998 <== osd.0 v2:172.21.15.31:6800/168281188 7 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2a000e070 con 0x7fd29000f070 2024-09-22T08:38:28.961 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.945+0000 7fd2a7dc8640 1 -- 172.21.15.142:0/2519360998 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:32 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5568033dcdc0 con 0x7fd29808f070 2024-09-22T08:38:28.961 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.945+0000 7fd29edc6640 1 -- 172.21.15.142:0/2519360998 <== osd.2 v2:172.21.15.142:6808/279438927 5 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd29001e700 con 0x7fd29808f070 2024-09-22T08:38:28.961 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.945+0000 7fd29edc6640 1 -- 172.21.15.142:0/2519360998 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:33 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5568033dcdc0 con 0x5568033d5d00 2024-09-22T08:38:28.961 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.945+0000 7fd2a75c7640 1 -- 172.21.15.142:0/2519360998 <== osd.3 v2:172.21.15.142:6800/1064901393 10 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd29809d070 con 0x5568033d5d00 2024-09-22T08:38:28.961 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.945+0000 7fd2a75c7640 1 -- 172.21.15.142:0/2519360998 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:34 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5568033dcdc0 con 0x7fd29000f070 2024-09-22T08:38:28.961 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.945+0000 7fd2a7dc8640 1 -- 172.21.15.142:0/2519360998 <== osd.0 v2:172.21.15.31:6800/168281188 8 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2a000e070 con 0x7fd29000f070 2024-09-22T08:38:28.961 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.945+0000 7fd2a7dc8640 1 -- 172.21.15.142:0/2519360998 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:35 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5568033dcdc0 con 0x5568033d1050 2024-09-22T08:38:28.961 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.946+0000 7fd2a7dc8640 1 -- 172.21.15.142:0/2519360998 <== osd.1 v2:172.21.15.142:6816/3192108003 12 ==== osd_op_reply(35 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fd2a000e070 con 0x5568033d1050 2024-09-22T08:38:28.961 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.946+0000 7fd2a7dc8640 1 -- 172.21.15.142:0/2519360998 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:36 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5568033dcdc0 con 0x7fd29808f070 2024-09-22T08:38:28.961 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.946+0000 7fd29edc6640 1 -- 172.21.15.142:0/2519360998 <== osd.2 v2:172.21.15.142:6808/279438927 6 ==== osd_op_reply(36 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd29001e700 con 0x7fd29808f070 2024-09-22T08:38:28.961 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.946+0000 7fd2ab939800 1 -- 172.21.15.142:0/2519360998 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:37 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5568033df870 con 0x5568033d1050 2024-09-22T08:38:28.962 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.946+0000 7fd2a7dc8640 1 -- 172.21.15.142:0/2519360998 <== osd.1 v2:172.21.15.142:6816/3192108003 13 ==== osd_op_reply(37 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd2a000e070 con 0x5568033d1050 2024-09-22T08:38:28.962 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.946+0000 7fd2ab939800 1 -- 172.21.15.142:0/2519360998 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:38 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5568033e38d0 con 0x5568033d5d00 2024-09-22T08:38:28.962 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.946+0000 7fd2a75c7640 1 -- 172.21.15.142:0/2519360998 <== osd.3 v2:172.21.15.142:6800/1064901393 11 ==== osd_op_reply(38 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fd29809d070 con 0x5568033d5d00 2024-09-22T08:38:28.962 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.946+0000 7fd2ab939800 1 -- 172.21.15.142:0/2519360998 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:39 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [create,call version.set in=58b,writefull 0~1155 in=1155b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5568033d8d10 con 0x5568033d5d00 2024-09-22T08:38:28.962 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.948+0000 7fd2a75c7640 1 -- 172.21.15.142:0/2519360998 <== osd.3 v2:172.21.15.142:6800/1064901393 12 ==== osd_op_reply(39 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [create,call,writefull 0~1155] v32'3 uv3 ondisk = 0) ==== 274+0+0 (crc 0 0 0) 0x7fd29809d070 con 0x5568033d5d00 2024-09-22T08:38:28.962 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.948+0000 7fd2ab939800 1 -- 172.21.15.142:0/2519360998 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:40 5.f 5:f43b6ece:::zone_names.default:head [create,call version.set in=58b,writefull 0~46 in=46b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5568033e2250 con 0x5568033d1050 2024-09-22T08:38:28.962 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.949+0000 7fd2a7dc8640 1 -- 172.21.15.142:0/2519360998 <== osd.1 v2:172.21.15.142:6816/3192108003 14 ==== osd_op_reply(40 zone_names.default [create,call,writefull 0~46] v32'3 uv3 ondisk = 0) ==== 246+0+0 (crc 0 0 0) 0x7fd2a000e070 con 0x5568033d1050 2024-09-22T08:38:28.962 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.949+0000 7fd2ab939800 1 -- 172.21.15.142:0/2519360998 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:41 5.19 5:9f02474b:::default.zone.:head [create,writefull 0~46 in=46b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5568033dfcf0 con 0x5568033d1050 2024-09-22T08:38:28.962 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.950+0000 7fd2a7dc8640 1 -- 172.21.15.142:0/2519360998 <== osd.1 v2:172.21.15.142:6816/3192108003 15 ==== osd_op_reply(41 default.zone. [create,writefull 0~46] v32'2 uv1 ondisk = -17 ((17) File exists)) ==== 199+0+0 (crc 0 0 0) 0x7fd2a000e070 con 0x5568033d1050 2024-09-22T08:38:28.962 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.951+0000 7fd2ab939800 1 -- 172.21.15.142:0/2424173143 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fd18803d000 msgr2=0x7fd18803f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:28.963 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.951+0000 7fd2ab939800 1 --2- 172.21.15.142:0/2424173143 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fd18803d000 0x7fd18803f4c0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fd290001db0 tx=0x7fd290001310 comp rx=0 tx=0).stop 2024-09-22T08:38:28.963 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.951+0000 7fd2ab939800 1 -- 172.21.15.142:0/2424173143 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5568033a2550 msgr2=0x5568033a9860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:28.963 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.951+0000 7fd2ab939800 1 --2- 172.21.15.142:0/2424173143 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5568033a2550 0x5568033a9860 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fd2a0013040 tx=0x7fd2a0003370 comp rx=0 tx=0).stop 2024-09-22T08:38:28.963 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.951+0000 7fd2ab939800 1 -- 172.21.15.142:0/2424173143 shutdown_connections 2024-09-22T08:38:28.963 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.951+0000 7fd2ab939800 1 --2- 172.21.15.142:0/2424173143 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fd18803d000 0x7fd18803f4c0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:28.963 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.951+0000 7fd2ab939800 1 --2- 172.21.15.142:0/2424173143 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5568033a2550 0x5568033a9860 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:28.963 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.951+0000 7fd2ab939800 1 -- 172.21.15.142:0/2424173143 >> 172.21.15.142:0/2424173143 conn(0x55680339ebf0 msgr2=0x55680339ce00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:38:28.963 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.951+0000 7fd2ab939800 1 -- 172.21.15.142:0/2424173143 shutdown_connections 2024-09-22T08:38:28.963 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.951+0000 7fd2ab939800 1 -- 172.21.15.142:0/2424173143 wait complete. 2024-09-22T08:38:28.963 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.951+0000 7fd2ab939800 1 -- 172.21.15.142:0/3138338655 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fd0e803cfb0 msgr2=0x7fd0e803f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:28.964 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.951+0000 7fd2ab939800 1 --2- 172.21.15.142:0/3138338655 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fd0e803cfb0 0x7fd0e803f470 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fd290000f60 tx=0x7fd29000f000 comp rx=0 tx=0).stop 2024-09-22T08:38:28.964 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.951+0000 7fd2ab939800 1 -- 172.21.15.142:0/3138338655 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5568033c36f0 msgr2=0x5568033c3b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:28.964 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.951+0000 7fd2ab939800 1 --2- 172.21.15.142:0/3138338655 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5568033c36f0 0x5568033c3b10 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fd298096550 tx=0x7fd29804fb60 comp rx=0 tx=0).stop 2024-09-22T08:38:28.964 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.951+0000 7fd2ab939800 1 -- 172.21.15.142:0/3138338655 shutdown_connections 2024-09-22T08:38:28.964 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.951+0000 7fd2ab939800 1 --2- 172.21.15.142:0/3138338655 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fd0e803cfb0 0x7fd0e803f470 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:28.964 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.951+0000 7fd2ab939800 1 --2- 172.21.15.142:0/3138338655 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5568033c36f0 0x5568033c3b10 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:28.964 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.951+0000 7fd2ab939800 1 -- 172.21.15.142:0/3138338655 >> 172.21.15.142:0/3138338655 conn(0x5568033b8c30 msgr2=0x5568033b9010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:38:28.964 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.951+0000 7fd2ab939800 1 -- 172.21.15.142:0/3138338655 shutdown_connections 2024-09-22T08:38:28.964 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.951+0000 7fd2ab939800 1 -- 172.21.15.142:0/3138338655 wait complete. 2024-09-22T08:38:28.964 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.952+0000 7fd2ab939800 1 -- 172.21.15.142:0/2519360998 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7fd29000f070 msgr2=0x7fd29000e8c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:28.964 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.952+0000 7fd2ab939800 1 --2- 172.21.15.142:0/2519360998 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7fd29000f070 0x7fd29000e8c0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:28.964 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.952+0000 7fd2ab939800 1 -- 172.21.15.142:0/2519360998 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5568033d1050 msgr2=0x5568033d34c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:28.964 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.952+0000 7fd2ab939800 1 --2- 172.21.15.142:0/2519360998 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5568033d1050 0x5568033d34c0 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:28.964 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.952+0000 7fd2ab939800 1 -- 172.21.15.142:0/2519360998 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7fd29808f070 msgr2=0x7fd29806c8d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:28.965 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.952+0000 7fd2ab939800 1 --2- 172.21.15.142:0/2519360998 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7fd29808f070 0x7fd29806c8d0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:28.965 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.952+0000 7fd2ab939800 1 -- 172.21.15.142:0/2519360998 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5568033d5d00 msgr2=0x5568033d8150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:28.965 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.952+0000 7fd2ab939800 1 --2- 172.21.15.142:0/2519360998 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5568033d5d00 0x5568033d8150 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:28.965 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.952+0000 7fd2ab939800 1 -- 172.21.15.142:0/2519360998 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fd18c03cfb0 msgr2=0x7fd18c03f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:28.965 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.952+0000 7fd2ab939800 1 --2- 172.21.15.142:0/2519360998 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fd18c03cfb0 0x7fd18c03f470 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fd29804f6d0 tx=0x7fd29804f640 comp rx=0 tx=0).stop 2024-09-22T08:38:28.965 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.952+0000 7fd2ab939800 1 -- 172.21.15.142:0/2519360998 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556803211540 msgr2=0x556803394f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:28.965 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.952+0000 7fd2ab939800 1 --2- 172.21.15.142:0/2519360998 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556803211540 0x556803394f10 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7fd2980460d0 tx=0x7fd298002fb0 comp rx=0 tx=0).stop 2024-09-22T08:38:28.965 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.952+0000 7fd2a7dc8640 1 -- 172.21.15.142:0/2519360998 reap_dead start 2024-09-22T08:38:28.965 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.952+0000 7fd2a7dc8640 1 -- 172.21.15.142:0/2519360998 reap_dead start 2024-09-22T08:38:28.965 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.952+0000 7fd2ab939800 1 -- 172.21.15.142:0/2519360998 shutdown_connections 2024-09-22T08:38:28.965 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.952+0000 7fd2ab939800 1 -- 172.21.15.142:0/2519360998 >> 172.21.15.142:0/2519360998 conn(0x556803296da0 msgr2=0x55680338e6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:38:28.965 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.952+0000 7fd2ab939800 1 -- 172.21.15.142:0/2519360998 shutdown_connections 2024-09-22T08:38:28.965 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:28.952+0000 7fd2ab939800 1 -- 172.21.15.142:0/2519360998 wait complete. 2024-09-22T08:38:28.966 INFO:teuthology.orchestra.run.smithi142.stdout:{"id":"e239248c-0bee-4e41-803a-24b288d3eb8f","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}},{"key":"new-placement","val":{"index_pool":".rgw.buckets.index.2","storage_classes":{"STANDARD":{"data_pool":".rgw.buckets.2"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-09-22T08:38:28.967 DEBUG:tasks.util.rgw: json result: {'id': 'e239248c-0bee-4e41-803a-24b288d3eb8f', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}, {'key': 'new-placement', 'val': {'index_pool': '.rgw.buckets.index.2', 'storage_classes': {'STANDARD': {'data_pool': '.rgw.buckets.2'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-09-22T08:38:28.967 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'get'] 2024-09-22T08:38:28.967 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'get'] 2024-09-22T08:38:28.967 DEBUG:teuthology.orchestra.run.smithi142:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone get 2024-09-22T08:38:29.049 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:38:29.049 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:38:29.050 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.048+0000 7f974e32e800 1 Processor -- start 2024-09-22T08:38:29.051 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.048+0000 7f974e32e800 1 -- start start 2024-09-22T08:38:29.051 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.048+0000 7f974e32e800 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55f3f19047e0 0x55f3f19054e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:29.051 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.048+0000 7f974e32e800 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55f3f1790a20 con 0x55f3f1905a20 2024-09-22T08:38:29.051 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.048+0000 7f974e32e800 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x55f3f17907d0 con 0x55f3f19047e0 2024-09-22T08:38:29.051 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.049+0000 7f974a0dd640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55f3f19047e0 0x55f3f19054e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:29.051 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.049+0000 7f9743fff640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x55f3f1905a20 0x55f3f190a570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.142:50432/0 (socket says 172.21.15.142:50432) 2024-09-22T08:38:29.051 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.049+0000 7f9743fff640 1 -- 172.21.15.142:0/3734432730 learned_addr learned my addr 172.21.15.142:0/3734432730 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-09-22T08:38:29.051 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.049+0000 7f974a0dd640 1 -- 172.21.15.142:0/3734432730 >> v1:172.21.15.31:6789/0 conn(0x55f3f1905a20 legacy=0x55f3f190a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:29.051 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.049+0000 7f974a0dd640 1 -- 172.21.15.142:0/3734432730 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f3f1904ee0 con 0x55f3f19047e0 2024-09-22T08:38:29.053 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.051+0000 7f974a0dd640 1 --2- 172.21.15.142:0/3734432730 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f3f19047e0 0x55f3f19054e0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f973c00a470 tx=0x7f973c045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fef7b7d276afb21 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:29.054 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.051+0000 7f97498dc640 1 -- 172.21.15.142:0/3734432730 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f973c053570 con 0x55f3f19047e0 2024-09-22T08:38:29.054 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.051+0000 7f97498dc640 1 -- 172.21.15.142:0/3734432730 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f973c058070 con 0x55f3f19047e0 2024-09-22T08:38:29.054 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.051+0000 7f97498dc640 1 -- 172.21.15.142:0/3734432730 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f973c053880 con 0x55f3f19047e0 2024-09-22T08:38:29.054 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.051+0000 7f974e32e800 1 -- 172.21.15.142:0/3734432730 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f3f19047e0 msgr2=0x55f3f19054e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:29.054 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.051+0000 7f974e32e800 1 --2- 172.21.15.142:0/3734432730 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f3f19047e0 0x55f3f19054e0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f973c00a470 tx=0x7f973c045a20 comp rx=0 tx=0).stop 2024-09-22T08:38:29.054 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.051+0000 7f974e32e800 1 -- 172.21.15.142:0/3734432730 shutdown_connections 2024-09-22T08:38:29.054 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.051+0000 7f974e32e800 1 --2- 172.21.15.142:0/3734432730 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f3f19047e0 0x55f3f19054e0 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:29.054 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.051+0000 7f974e32e800 1 -- 172.21.15.142:0/3734432730 >> 172.21.15.142:0/3734432730 conn(0x55f3f18ffbd0 msgr2=0x55f3f1902010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:38:29.054 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.051+0000 7f974e32e800 1 -- 172.21.15.142:0/3734432730 shutdown_connections 2024-09-22T08:38:29.054 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.051+0000 7f974e32e800 1 -- 172.21.15.142:0/3734432730 wait complete. 2024-09-22T08:38:29.067 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.065+0000 7f974e32e800 1 Processor -- start 2024-09-22T08:38:29.067 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.065+0000 7f974e32e800 1 -- start start 2024-09-22T08:38:29.067 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.065+0000 7f974e32e800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f3f19047e0 0x55f3f18791c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:29.067 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.065+0000 7f974e32e800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55f3f179ddd0 con 0x55f3f19047e0 2024-09-22T08:38:29.068 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.066+0000 7f974a0dd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f3f19047e0 0x55f3f18791c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:29.068 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.066+0000 7f974a0dd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f3f19047e0 0x55f3f18791c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:51420/0 (socket says 172.21.15.142:51420) 2024-09-22T08:38:29.069 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.066+0000 7f974a0dd640 1 -- 172.21.15.142:0/2362368738 learned_addr learned my addr 172.21.15.142:0/2362368738 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:38:29.069 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.066+0000 7f974a0dd640 1 -- 172.21.15.142:0/2362368738 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f3f19f7b80 con 0x55f3f19047e0 2024-09-22T08:38:29.069 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.066+0000 7f974a0dd640 1 --2- 172.21.15.142:0/2362368738 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f3f19047e0 0x55f3f18791c0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f973c025c20 tx=0x7f973c051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4af9685b4c8198c server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:29.069 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.066+0000 7f9638608640 1 -- 172.21.15.142:0/2362368738 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f973c053a20 con 0x55f3f19047e0 2024-09-22T08:38:29.069 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.066+0000 7f9638608640 1 -- 172.21.15.142:0/2362368738 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f973c063070 con 0x55f3f19047e0 2024-09-22T08:38:29.069 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.066+0000 7f9638608640 1 -- 172.21.15.142:0/2362368738 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f973c053cf0 con 0x55f3f19047e0 2024-09-22T08:38:29.072 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.067+0000 7f974e32e800 1 -- 172.21.15.142:0/2362368738 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f3f19047e0 msgr2=0x55f3f18791c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:29.072 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.067+0000 7f974e32e800 1 --2- 172.21.15.142:0/2362368738 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f3f19047e0 0x55f3f18791c0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f973c025c20 tx=0x7f973c051000 comp rx=0 tx=0).stop 2024-09-22T08:38:29.072 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.067+0000 7f974e32e800 1 -- 172.21.15.142:0/2362368738 shutdown_connections 2024-09-22T08:38:29.073 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.067+0000 7f974e32e800 1 --2- 172.21.15.142:0/2362368738 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f3f19047e0 0x55f3f18791c0 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:29.073 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.067+0000 7f974e32e800 1 -- 172.21.15.142:0/2362368738 >> 172.21.15.142:0/2362368738 conn(0x55f3f18ffbd0 msgr2=0x55f3f19ef840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:38:29.073 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.067+0000 7f974e32e800 1 -- 172.21.15.142:0/2362368738 shutdown_connections 2024-09-22T08:38:29.073 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.067+0000 7f974e32e800 1 -- 172.21.15.142:0/2362368738 wait complete. 2024-09-22T08:38:29.073 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.067+0000 7f974e32e800 1 Processor -- start 2024-09-22T08:38:29.073 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.067+0000 7f974e32e800 1 -- start start 2024-09-22T08:38:29.073 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.067+0000 7f974e32e800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f3f19047e0 0x55f3f19fcaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:29.073 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.067+0000 7f974e32e800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55f3f1906290 con 0x55f3f19047e0 2024-09-22T08:38:29.073 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.068+0000 7f974a0dd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f3f19047e0 0x55f3f19fcaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:29.073 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.068+0000 7f974a0dd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f3f19047e0 0x55f3f19fcaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:51436/0 (socket says 172.21.15.142:51436) 2024-09-22T08:38:29.073 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.068+0000 7f974a0dd640 1 -- 172.21.15.142:0/2856752154 learned_addr learned my addr 172.21.15.142:0/2856752154 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:38:29.073 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.068+0000 7f974a0dd640 1 -- 172.21.15.142:0/2856752154 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f3f19fd000 con 0x55f3f19047e0 2024-09-22T08:38:29.073 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.068+0000 7f974a0dd640 1 --2- 172.21.15.142:0/2856752154 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f3f19047e0 0x55f3f19fcaa0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f973c025c20 tx=0x7f973c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:29.073 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.068+0000 7f9636e05640 1 -- 172.21.15.142:0/2856752154 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f973c068660 con 0x55f3f19047e0 2024-09-22T08:38:29.074 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.068+0000 7f9636e05640 1 -- 172.21.15.142:0/2856752154 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f973c068800 con 0x55f3f19047e0 2024-09-22T08:38:29.074 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.068+0000 7f974e32e800 1 -- 172.21.15.142:0/2856752154 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f3f19fd290 con 0x55f3f19047e0 2024-09-22T08:38:29.074 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.068+0000 7f9636e05640 1 -- 172.21.15.142:0/2856752154 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f973c068ae0 con 0x55f3f19047e0 2024-09-22T08:38:29.074 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.068+0000 7f974e32e800 1 -- 172.21.15.142:0/2856752154 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f3f19fdea0 con 0x55f3f19047e0 2024-09-22T08:38:29.074 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.069+0000 7f974e32e800 1 Processor -- start 2024-09-22T08:38:29.074 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.069+0000 7f974e32e800 1 -- start start 2024-09-22T08:38:29.074 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.069+0000 7f974e32e800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f3f1a0a0f0 0x55f3f1a0c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:29.074 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.069+0000 7f974e32e800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55f3f17fcd50 con 0x55f3f1a0a0f0 2024-09-22T08:38:29.074 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.069+0000 7f9636e05640 1 -- 172.21.15.142:0/2856752154 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f973c068c80 con 0x55f3f19047e0 2024-09-22T08:38:29.074 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.069+0000 7f974a8de640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f3f1a0a0f0 0x55f3f1a0c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:29.074 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.069+0000 7f974a8de640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f3f1a0a0f0 0x55f3f1a0c4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:51444/0 (socket says 172.21.15.142:51444) 2024-09-22T08:38:29.074 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.069+0000 7f974a8de640 1 -- 172.21.15.142:0/1286562791 learned_addr learned my addr 172.21.15.142:0/1286562791 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:38:29.074 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.070+0000 7f9636e05640 1 --2- 172.21.15.142:0/2856752154 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f963003cfb0 0x7f963003f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:29.074 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.070+0000 7f9636e05640 1 -- 172.21.15.142:0/2856752154 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5938+0+0 (secure 0 0 0) 0x7f973c098c60 con 0x55f3f19047e0 2024-09-22T08:38:29.074 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.070+0000 7f974a0dd640 1 --2- 172.21.15.142:0/2856752154 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f963003cfb0 0x7f963003f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:29.075 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.070+0000 7f974a8de640 1 -- 172.21.15.142:0/1286562791 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f3f1a0cab0 con 0x55f3f1a0a0f0 2024-09-22T08:38:29.075 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.070+0000 7f974a8de640 1 --2- 172.21.15.142:0/1286562791 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f3f1a0a0f0 0x55f3f1a0c4e0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f974400a3e0 tx=0x7f974400a8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34539ced69799e20 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:29.075 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.070+0000 7f974a0dd640 1 --2- 172.21.15.142:0/2856752154 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f963003cfb0 0x7f963003f470 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f973c053780 tx=0x7f973c005390 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:29.075 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.070+0000 7f9634e01640 1 -- 172.21.15.142:0/1286562791 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9744015070 con 0x55f3f1a0a0f0 2024-09-22T08:38:29.075 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.070+0000 7f9634e01640 1 -- 172.21.15.142:0/1286562791 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9744001670 con 0x55f3f1a0a0f0 2024-09-22T08:38:29.075 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.070+0000 7f9634e01640 1 -- 172.21.15.142:0/1286562791 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9744001990 con 0x55f3f1a0a0f0 2024-09-22T08:38:29.080 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.071+0000 7f974e32e800 1 -- 172.21.15.142:0/1286562791 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f3f1a0a0f0 msgr2=0x55f3f1a0c4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:29.080 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.071+0000 7f974e32e800 1 --2- 172.21.15.142:0/1286562791 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f3f1a0a0f0 0x55f3f1a0c4e0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f974400a3e0 tx=0x7f974400a8a0 comp rx=0 tx=0).stop 2024-09-22T08:38:29.080 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.071+0000 7f974e32e800 1 -- 172.21.15.142:0/1286562791 shutdown_connections 2024-09-22T08:38:29.080 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.071+0000 7f974e32e800 1 --2- 172.21.15.142:0/1286562791 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f3f1a0a0f0 0x55f3f1a0c4e0 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:29.080 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.071+0000 7f974e32e800 1 -- 172.21.15.142:0/1286562791 >> 172.21.15.142:0/1286562791 conn(0x55f3f1905a20 msgr2=0x55f3f1a04a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:38:29.080 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.071+0000 7f974e32e800 1 -- 172.21.15.142:0/1286562791 shutdown_connections 2024-09-22T08:38:29.080 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.071+0000 7f974e32e800 1 -- 172.21.15.142:0/1286562791 wait complete. 2024-09-22T08:38:29.080 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.071+0000 7f974e32e800 1 Processor -- start 2024-09-22T08:38:29.080 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.071+0000 7f974e32e800 1 -- start start 2024-09-22T08:38:29.080 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.071+0000 7f974e32e800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f3f1a0a0f0 0x55f3f1a10ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:29.080 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.071+0000 7f974e32e800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55f3f1a0cda0 con 0x55f3f1a0a0f0 2024-09-22T08:38:29.081 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.071+0000 7f974a8de640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f3f1a0a0f0 0x55f3f1a10ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:29.081 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.071+0000 7f974a8de640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f3f1a0a0f0 0x55f3f1a10ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:51452/0 (socket says 172.21.15.142:51452) 2024-09-22T08:38:29.081 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.071+0000 7f974a8de640 1 -- 172.21.15.142:0/3616500478 learned_addr learned my addr 172.21.15.142:0/3616500478 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:38:29.081 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.071+0000 7f974a8de640 1 -- 172.21.15.142:0/3616500478 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f3f1a11450 con 0x55f3f1a0a0f0 2024-09-22T08:38:29.081 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.072+0000 7f974a8de640 1 --2- 172.21.15.142:0/3616500478 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f3f1a0a0f0 0x55f3f1a10ef0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x55f3f1a053f0 tx=0x7f9744003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:29.081 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.072+0000 7f962effd640 1 -- 172.21.15.142:0/3616500478 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9744020020 con 0x55f3f1a0a0f0 2024-09-22T08:38:29.081 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.072+0000 7f962effd640 1 -- 172.21.15.142:0/3616500478 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9744010780 con 0x55f3f1a0a0f0 2024-09-22T08:38:29.081 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.072+0000 7f974e32e800 1 -- 172.21.15.142:0/3616500478 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f3f1a116e0 con 0x55f3f1a0a0f0 2024-09-22T08:38:29.081 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.072+0000 7f962effd640 1 -- 172.21.15.142:0/3616500478 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9744015040 con 0x55f3f1a0a0f0 2024-09-22T08:38:29.081 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.072+0000 7f974e32e800 1 -- 172.21.15.142:0/3616500478 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f3f1a12060 con 0x55f3f1a0a0f0 2024-09-22T08:38:29.081 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.073+0000 7f962effd640 1 -- 172.21.15.142:0/3616500478 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f9744023020 con 0x55f3f1a0a0f0 2024-09-22T08:38:29.081 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.073+0000 7f962effd640 1 --2- 172.21.15.142:0/3616500478 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f962403cfb0 0x7f962403f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:29.081 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.073+0000 7f962effd640 1 -- 172.21.15.142:0/3616500478 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5938+0+0 (secure 0 0 0) 0x7f9744053dc0 con 0x55f3f1a0a0f0 2024-09-22T08:38:29.082 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.073+0000 7f9743fff640 1 --2- 172.21.15.142:0/3616500478 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f962403cfb0 0x7f962403f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:29.082 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.073+0000 7f974e32e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:38:29.082 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.073+0000 7f974e32e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:38:29.082 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.074+0000 7f9743fff640 1 --2- 172.21.15.142:0/3616500478 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f962403cfb0 0x7f962403f470 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f9734001cf0 tx=0x7f9734001250 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:29.082 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.074+0000 7f974e32e800 1 Processor -- start 2024-09-22T08:38:29.082 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.074+0000 7f974e32e800 1 -- start start 2024-09-22T08:38:29.082 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.074+0000 7f974e32e800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f3f19f5310 0x55f3f19f3b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:29.082 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.074+0000 7f974e32e800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55f3f19f7e00 con 0x55f3f19f5310 2024-09-22T08:38:29.082 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.074+0000 7f974a0dd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f3f19f5310 0x55f3f19f3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:29.082 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.074+0000 7f974a0dd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f3f19f5310 0x55f3f19f3b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:51460/0 (socket says 172.21.15.142:51460) 2024-09-22T08:38:29.082 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.074+0000 7f974a0dd640 1 -- 172.21.15.142:0/3357809391 learned_addr learned my addr 172.21.15.142:0/3357809391 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:38:29.082 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.075+0000 7f974a0dd640 1 -- 172.21.15.142:0/3357809391 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f3f19f5830 con 0x55f3f19f5310 2024-09-22T08:38:29.082 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.075+0000 7f974a0dd640 1 --2- 172.21.15.142:0/3357809391 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f3f19f5310 0x55f3f19f3b80 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f973c053ca0 tx=0x7f973c05cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:29.083 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.075+0000 7f960efe5640 1 -- 172.21.15.142:0/3357809391 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f973c04d480 con 0x55f3f19f5310 2024-09-22T08:38:29.083 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.075+0000 7f960efe5640 1 -- 172.21.15.142:0/3357809391 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f973c05cd10 con 0x55f3f19f5310 2024-09-22T08:38:29.083 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.075+0000 7f974e32e800 1 -- 172.21.15.142:0/3357809391 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f3f19f40c0 con 0x55f3f19f5310 2024-09-22T08:38:29.083 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.075+0000 7f960efe5640 1 -- 172.21.15.142:0/3357809391 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f973c05c410 con 0x55f3f19f5310 2024-09-22T08:38:29.083 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.075+0000 7f974e32e800 1 -- 172.21.15.142:0/3357809391 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f3f19f4610 con 0x55f3f19f5310 2024-09-22T08:38:29.083 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.076+0000 7f960efe5640 1 -- 172.21.15.142:0/3357809391 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f973c074480 con 0x55f3f19f5310 2024-09-22T08:38:29.083 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.076+0000 7f960efe5640 1 --2- 172.21.15.142:0/3357809391 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f958c03cfb0 0x7f958c03f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:29.083 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.076+0000 7f960efe5640 1 -- 172.21.15.142:0/3357809391 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5938+0+0 (secure 0 0 0) 0x7f973c092070 con 0x55f3f19f5310 2024-09-22T08:38:29.083 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.076+0000 7f9743fff640 1 --2- 172.21.15.142:0/3357809391 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f958c03cfb0 0x7f958c03f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:29.083 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.076+0000 7f960cfe1640 20 reqs_thread_entry: start 2024-09-22T08:38:29.083 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.076+0000 7f9743fff640 1 --2- 172.21.15.142:0/3357809391 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f958c03cfb0 0x7f958c03f470 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f9734000f60 tx=0x7f973400f000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:29.083 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.076+0000 7f974e32e800 1 --2- 172.21.15.142:0/2856752154 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55f3f1a3a8a0 0x55f3f1a3cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:29.083 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.076+0000 7f974e32e800 1 -- 172.21.15.142:0/2856752154 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f3f1a3d390 con 0x55f3f1a3a8a0 2024-09-22T08:38:29.083 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.077+0000 7f974a8de640 1 --2- 172.21.15.142:0/2856752154 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55f3f1a3a8a0 0x55f3f1a3cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:29.083 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.077+0000 7f974a8de640 1 --2- 172.21.15.142:0/2856752154 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55f3f1a3a8a0 0x55f3f1a3cd10 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:29.084 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.077+0000 7f974a8de640 1 -- 172.21.15.142:0/2856752154 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f974400e070 con 0x55f3f1a3a8a0 2024-09-22T08:38:29.084 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.077+0000 7f974e32e800 1 -- 172.21.15.142:0/2856752154 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f3f1a3dc70 con 0x55f3f1a3a8a0 2024-09-22T08:38:29.084 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.077+0000 7f974a8de640 1 -- 172.21.15.142:0/2856752154 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f974400e070 con 0x55f3f1a3a8a0 2024-09-22T08:38:29.084 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.077+0000 7f974e32e800 1 --2- 172.21.15.142:0/2856752154 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55f3f1a3f530 0x55f3f1a419c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:29.084 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.077+0000 7f974e32e800 1 -- 172.21.15.142:0/2856752154 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:3 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f3f1a42150 con 0x55f3f1a3f530 2024-09-22T08:38:29.084 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.078+0000 7f974a0dd640 1 --2- 172.21.15.142:0/2856752154 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55f3f1a3f530 0x55f3f1a419c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:29.084 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.078+0000 7f974a0dd640 1 --2- 172.21.15.142:0/2856752154 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55f3f1a3f530 0x55f3f1a419c0 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:29.086 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.078+0000 7f974a0dd640 1 -- 172.21.15.142:0/2856752154 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(3 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [call out=48b,read 0~1155 out=1155b] v0'0 uv3 ondisk = 0) ==== 232+0+1203 (crc 0 0 0) 0x7f973c051070 con 0x55f3f1a3f530 2024-09-22T08:38:29.086 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.079+0000 7f974e32e800 1 -- 172.21.15.142:0/3616500478 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f962403cfb0 msgr2=0x7f962403f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:29.086 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.079+0000 7f974e32e800 1 --2- 172.21.15.142:0/3616500478 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f962403cfb0 0x7f962403f470 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f9734001cf0 tx=0x7f9734001250 comp rx=0 tx=0).stop 2024-09-22T08:38:29.086 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.079+0000 7f974e32e800 1 -- 172.21.15.142:0/3616500478 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f3f1a0a0f0 msgr2=0x55f3f1a10ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:29.086 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.079+0000 7f974e32e800 1 --2- 172.21.15.142:0/3616500478 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f3f1a0a0f0 0x55f3f1a10ef0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x55f3f1a053f0 tx=0x7f9744003370 comp rx=0 tx=0).stop 2024-09-22T08:38:29.086 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.079+0000 7f974e32e800 1 -- 172.21.15.142:0/3616500478 shutdown_connections 2024-09-22T08:38:29.086 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.079+0000 7f974e32e800 1 --2- 172.21.15.142:0/3616500478 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f962403cfb0 0x7f962403f470 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:29.086 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.079+0000 7f974e32e800 1 --2- 172.21.15.142:0/3616500478 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f3f1a0a0f0 0x55f3f1a10ef0 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:29.087 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.079+0000 7f974e32e800 1 -- 172.21.15.142:0/3616500478 >> 172.21.15.142:0/3616500478 conn(0x55f3f1905a20 msgr2=0x55f3f1a049e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:38:29.087 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.079+0000 7f974e32e800 1 -- 172.21.15.142:0/3616500478 shutdown_connections 2024-09-22T08:38:29.087 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.079+0000 7f974e32e800 1 -- 172.21.15.142:0/3616500478 wait complete. 2024-09-22T08:38:29.087 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.079+0000 7f974e32e800 1 -- 172.21.15.142:0/3357809391 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f958c03cfb0 msgr2=0x7f958c03f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:29.087 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.079+0000 7f974e32e800 1 --2- 172.21.15.142:0/3357809391 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f958c03cfb0 0x7f958c03f470 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f9734000f60 tx=0x7f973400f000 comp rx=0 tx=0).stop 2024-09-22T08:38:29.087 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.079+0000 7f974e32e800 1 -- 172.21.15.142:0/3357809391 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f3f19f5310 msgr2=0x55f3f19f3b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:29.087 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.079+0000 7f974e32e800 1 --2- 172.21.15.142:0/3357809391 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f3f19f5310 0x55f3f19f3b80 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f973c053ca0 tx=0x7f973c05cc20 comp rx=0 tx=0).stop 2024-09-22T08:38:29.087 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.079+0000 7f974e32e800 1 -- 172.21.15.142:0/3357809391 shutdown_connections 2024-09-22T08:38:29.087 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.079+0000 7f974e32e800 1 --2- 172.21.15.142:0/3357809391 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f958c03cfb0 0x7f958c03f470 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:29.087 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.079+0000 7f974e32e800 1 --2- 172.21.15.142:0/3357809391 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f3f19f5310 0x55f3f19f3b80 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:29.087 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.079+0000 7f974e32e800 1 -- 172.21.15.142:0/3357809391 >> 172.21.15.142:0/3357809391 conn(0x55f3f1a202e0 msgr2=0x55f3f1a206c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:38:29.087 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.079+0000 7f974e32e800 1 -- 172.21.15.142:0/3357809391 shutdown_connections 2024-09-22T08:38:29.087 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.079+0000 7f974e32e800 1 -- 172.21.15.142:0/3357809391 wait complete. 2024-09-22T08:38:29.087 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.080+0000 7f974e32e800 1 -- 172.21.15.142:0/2856752154 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55f3f1a3a8a0 msgr2=0x55f3f1a3cd10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:29.087 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.080+0000 7f974e32e800 1 --2- 172.21.15.142:0/2856752154 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55f3f1a3a8a0 0x55f3f1a3cd10 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:29.088 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.080+0000 7f974e32e800 1 -- 172.21.15.142:0/2856752154 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55f3f1a3f530 msgr2=0x55f3f1a419c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:29.088 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.080+0000 7f974e32e800 1 --2- 172.21.15.142:0/2856752154 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55f3f1a3f530 0x55f3f1a419c0 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:29.088 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.080+0000 7f974e32e800 1 -- 172.21.15.142:0/2856752154 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f963003cfb0 msgr2=0x7f963003f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:29.088 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.080+0000 7f974e32e800 1 --2- 172.21.15.142:0/2856752154 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f963003cfb0 0x7f963003f470 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f973c053780 tx=0x7f973c005390 comp rx=0 tx=0).stop 2024-09-22T08:38:29.088 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.080+0000 7f974e32e800 1 -- 172.21.15.142:0/2856752154 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f3f19047e0 msgr2=0x55f3f19fcaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:29.088 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.080+0000 7f974e32e800 1 --2- 172.21.15.142:0/2856752154 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f3f19047e0 0x55f3f19fcaa0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f973c025c20 tx=0x7f973c002fb0 comp rx=0 tx=0).stop 2024-09-22T08:38:29.088 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.080+0000 7f974e32e800 1 -- 172.21.15.142:0/2856752154 shutdown_connections 2024-09-22T08:38:29.088 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.080+0000 7f974e32e800 1 --2- 172.21.15.142:0/2856752154 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55f3f1a3f530 0x55f3f1a419c0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:29.088 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.080+0000 7f974e32e800 1 --2- 172.21.15.142:0/2856752154 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55f3f1a3a8a0 0x55f3f1a3cd10 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:29.088 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.080+0000 7f974e32e800 1 --2- 172.21.15.142:0/2856752154 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f963003cfb0 0x7f963003f470 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:29.088 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.080+0000 7f974e32e800 1 --2- 172.21.15.142:0/2856752154 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f3f19047e0 0x55f3f19fcaa0 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:29.088 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.080+0000 7f974e32e800 1 -- 172.21.15.142:0/2856752154 >> 172.21.15.142:0/2856752154 conn(0x55f3f18ffbd0 msgr2=0x55f3f19ee030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:38:29.088 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.080+0000 7f974e32e800 1 -- 172.21.15.142:0/2856752154 shutdown_connections 2024-09-22T08:38:29.088 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.080+0000 7f974e32e800 1 -- 172.21.15.142:0/2856752154 wait complete. 2024-09-22T08:38:29.090 INFO:teuthology.orchestra.run.smithi142.stdout:{"id":"e239248c-0bee-4e41-803a-24b288d3eb8f","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}},{"key":"new-placement","val":{"index_pool":".rgw.buckets.index.2","storage_classes":{"STANDARD":{"data_pool":".rgw.buckets.2"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-09-22T08:38:29.091 DEBUG:tasks.util.rgw: json result: {'id': 'e239248c-0bee-4e41-803a-24b288d3eb8f', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}, {'key': 'new-placement', 'val': {'index_pool': '.rgw.buckets.index.2', 'storage_classes': {'STANDARD': {'data_pool': '.rgw.buckets.2'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-09-22T08:38:29.091 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-09-22T08:38:29.091 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-09-22T08:38:29.091 DEBUG:teuthology.orchestra.run.smithi142:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement rm --rgw-zone default --placement-id new-placement 2024-09-22T08:38:29.177 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:38:29.177 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:38:29.178 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.176+0000 7f9b93463800 1 Processor -- start 2024-09-22T08:38:29.178 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.176+0000 7f9b93463800 1 -- start start 2024-09-22T08:38:29.178 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.176+0000 7f9b93463800 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55c8d3374d30 0x55c8d337a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:29.178 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.176+0000 7f9b93463800 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55c8d31ffa20 con 0x55c8d3373920 2024-09-22T08:38:29.179 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.176+0000 7f9b93463800 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x55c8d31ff7d0 con 0x55c8d3374d30 2024-09-22T08:38:29.179 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.177+0000 7f9b8bfff640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55c8d3374d30 0x55c8d337a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:29.179 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.177+0000 7f9b90f54640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x55c8d3373920 0x55c8d3374620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.142:50434/0 (socket says 172.21.15.142:50434) 2024-09-22T08:38:29.180 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.177+0000 7f9b90f54640 1 -- 172.21.15.142:0/1336682531 learned_addr learned my addr 172.21.15.142:0/1336682531 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-09-22T08:38:29.180 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.177+0000 7f9b8bfff640 1 --2- 172.21.15.142:0/1336682531 >> v2:172.21.15.31:3300/0 conn(0x55c8d3374d30 0x55c8d337a6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:51474/0 (socket says 172.21.15.142:51474) 2024-09-22T08:38:29.180 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.177+0000 7f9b8bfff640 1 -- 172.21.15.142:0/1336682531 >> v1:172.21.15.31:6789/0 conn(0x55c8d3373920 legacy=0x55c8d3374620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:29.180 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.177+0000 7f9b8bfff640 1 -- 172.21.15.142:0/1336682531 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c8d3374020 con 0x55c8d3374d30 2024-09-22T08:38:29.181 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.179+0000 7f9b8bfff640 1 --2- 172.21.15.142:0/1336682531 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c8d3374d30 0x55c8d337a6c0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f9b7c00a470 tx=0x7f9b7c045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=129cd8a3a4329e81 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:29.181 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.179+0000 7f9b8b7fe640 1 -- 172.21.15.142:0/1336682531 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b7c053570 con 0x55c8d3374d30 2024-09-22T08:38:29.181 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.179+0000 7f9b8b7fe640 1 -- 172.21.15.142:0/1336682531 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b7c058070 con 0x55c8d3374d30 2024-09-22T08:38:29.181 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.179+0000 7f9b8b7fe640 1 -- 172.21.15.142:0/1336682531 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b7c053880 con 0x55c8d3374d30 2024-09-22T08:38:29.182 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.179+0000 7f9b93463800 1 -- 172.21.15.142:0/1336682531 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c8d3374d30 msgr2=0x55c8d337a6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:29.182 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.179+0000 7f9b93463800 1 --2- 172.21.15.142:0/1336682531 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c8d3374d30 0x55c8d337a6c0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f9b7c00a470 tx=0x7f9b7c045a20 comp rx=0 tx=0).stop 2024-09-22T08:38:29.182 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.179+0000 7f9b93463800 1 -- 172.21.15.142:0/1336682531 shutdown_connections 2024-09-22T08:38:29.182 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.179+0000 7f9b93463800 1 --2- 172.21.15.142:0/1336682531 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c8d3374d30 0x55c8d337a6c0 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:29.183 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.179+0000 7f9b93463800 1 -- 172.21.15.142:0/1336682531 >> 172.21.15.142:0/1336682531 conn(0x55c8d336ed10 msgr2=0x55c8d3371150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:38:29.183 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.180+0000 7f9b93463800 1 -- 172.21.15.142:0/1336682531 shutdown_connections 2024-09-22T08:38:29.183 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.180+0000 7f9b93463800 1 -- 172.21.15.142:0/1336682531 wait complete. 2024-09-22T08:38:29.195 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.194+0000 7f9b93463800 1 Processor -- start 2024-09-22T08:38:29.195 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.194+0000 7f9b93463800 1 -- start start 2024-09-22T08:38:29.196 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.194+0000 7f9b93463800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c8d3373920 0x55c8d3462fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:29.196 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.194+0000 7f9b93463800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55c8d320cdd0 con 0x55c8d3373920 2024-09-22T08:38:29.197 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.194+0000 7f9b90f54640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c8d3373920 0x55c8d3462fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:29.197 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.194+0000 7f9b90f54640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c8d3373920 0x55c8d3462fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:51490/0 (socket says 172.21.15.142:51490) 2024-09-22T08:38:29.197 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.194+0000 7f9b90f54640 1 -- 172.21.15.142:0/3764801192 learned_addr learned my addr 172.21.15.142:0/3764801192 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:38:29.197 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.194+0000 7f9b90f54640 1 -- 172.21.15.142:0/3764801192 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c8d34635c0 con 0x55c8d3373920 2024-09-22T08:38:29.197 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.194+0000 7f9b90f54640 1 --2- 172.21.15.142:0/3764801192 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c8d3373920 0x55c8d3462fd0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f9b84001e40 tx=0x7f9b84001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac8229eff918ad84 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:29.197 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.195+0000 7f9a7ee05640 1 -- 172.21.15.142:0/3764801192 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b84012020 con 0x55c8d3373920 2024-09-22T08:38:29.197 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.195+0000 7f9a7ee05640 1 -- 172.21.15.142:0/3764801192 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b8400e5a0 con 0x55c8d3373920 2024-09-22T08:38:29.198 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.195+0000 7f9a7ee05640 1 -- 172.21.15.142:0/3764801192 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b8400e8a0 con 0x55c8d3373920 2024-09-22T08:38:29.202 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.195+0000 7f9b93463800 1 -- 172.21.15.142:0/3764801192 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c8d3373920 msgr2=0x55c8d3462fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:29.202 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.195+0000 7f9b93463800 1 --2- 172.21.15.142:0/3764801192 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c8d3373920 0x55c8d3462fd0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f9b84001e40 tx=0x7f9b84001e70 comp rx=0 tx=0).stop 2024-09-22T08:38:29.202 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.195+0000 7f9b93463800 1 -- 172.21.15.142:0/3764801192 shutdown_connections 2024-09-22T08:38:29.202 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.195+0000 7f9b93463800 1 --2- 172.21.15.142:0/3764801192 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c8d3373920 0x55c8d3462fd0 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:29.202 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.195+0000 7f9b93463800 1 -- 172.21.15.142:0/3764801192 >> 172.21.15.142:0/3764801192 conn(0x55c8d336ed10 msgr2=0x55c8d345e950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:38:29.202 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.195+0000 7f9b93463800 1 -- 172.21.15.142:0/3764801192 shutdown_connections 2024-09-22T08:38:29.202 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.195+0000 7f9b93463800 1 -- 172.21.15.142:0/3764801192 wait complete. 2024-09-22T08:38:29.202 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.196+0000 7f9b93463800 1 Processor -- start 2024-09-22T08:38:29.202 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.196+0000 7f9b93463800 1 -- start start 2024-09-22T08:38:29.202 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.196+0000 7f9b93463800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c8d3373920 0x55c8d32e7a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:29.202 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.196+0000 7f9b93463800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55c8d337ac00 con 0x55c8d3373920 2024-09-22T08:38:29.202 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.196+0000 7f9b90f54640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c8d3373920 0x55c8d32e7a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:29.203 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.196+0000 7f9b90f54640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c8d3373920 0x55c8d32e7a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:51504/0 (socket says 172.21.15.142:51504) 2024-09-22T08:38:29.203 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.196+0000 7f9b90f54640 1 -- 172.21.15.142:0/2464824221 learned_addr learned my addr 172.21.15.142:0/2464824221 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:38:29.203 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.196+0000 7f9b90f54640 1 -- 172.21.15.142:0/2464824221 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c8d32e7fd0 con 0x55c8d3373920 2024-09-22T08:38:29.203 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.197+0000 7f9b90f54640 1 --2- 172.21.15.142:0/2464824221 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c8d3373920 0x55c8d32e7a70 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f9b840012b0 tx=0x7f9b84000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:29.203 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.197+0000 7f9a7d602640 1 -- 172.21.15.142:0/2464824221 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b84012030 con 0x55c8d3373920 2024-09-22T08:38:29.203 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.197+0000 7f9b93463800 1 -- 172.21.15.142:0/2464824221 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c8d346e840 con 0x55c8d3373920 2024-09-22T08:38:29.203 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.197+0000 7f9a7d602640 1 -- 172.21.15.142:0/2464824221 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b8401a750 con 0x55c8d3373920 2024-09-22T08:38:29.203 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.197+0000 7f9a7d602640 1 -- 172.21.15.142:0/2464824221 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b8401a900 con 0x55c8d3373920 2024-09-22T08:38:29.203 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.197+0000 7f9b93463800 1 -- 172.21.15.142:0/2464824221 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c8d346ee00 con 0x55c8d3373920 2024-09-22T08:38:29.203 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.198+0000 7f9b93463800 1 Processor -- start 2024-09-22T08:38:29.203 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.198+0000 7f9b93463800 1 -- start start 2024-09-22T08:38:29.203 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.198+0000 7f9b93463800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c8d34791d0 0x55c8d347b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:29.203 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.198+0000 7f9b93463800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55c8d326bd50 con 0x55c8d34791d0 2024-09-22T08:38:29.204 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.198+0000 7f9a7d602640 1 -- 172.21.15.142:0/2464824221 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f9b84015020 con 0x55c8d3373920 2024-09-22T08:38:29.204 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.198+0000 7f9b91755640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c8d34791d0 0x55c8d347b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:29.204 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.198+0000 7f9b91755640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c8d34791d0 0x55c8d347b5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:51506/0 (socket says 172.21.15.142:51506) 2024-09-22T08:38:29.204 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.198+0000 7f9b91755640 1 -- 172.21.15.142:0/802277418 learned_addr learned my addr 172.21.15.142:0/802277418 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:38:29.204 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.198+0000 7f9a7d602640 1 --2- 172.21.15.142:0/2464824221 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f9a7803cfb0 0x7f9a7803f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:29.204 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.198+0000 7f9a7d602640 1 -- 172.21.15.142:0/2464824221 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5938+0+0 (secure 0 0 0) 0x7f9b84020030 con 0x55c8d3373920 2024-09-22T08:38:29.204 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.198+0000 7f9b91755640 1 -- 172.21.15.142:0/802277418 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c8d347bb90 con 0x55c8d34791d0 2024-09-22T08:38:29.204 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.198+0000 7f9b90f54640 1 --2- 172.21.15.142:0/2464824221 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f9a7803cfb0 0x7f9a7803f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:29.204 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.199+0000 7f9b91755640 1 --2- 172.21.15.142:0/802277418 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c8d34791d0 0x55c8d347b5c0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f9b8c00a3e0 tx=0x7f9b8c00a8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=361c774035448a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:29.204 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.199+0000 7f9b90f54640 1 --2- 172.21.15.142:0/2464824221 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f9a7803cfb0 0x7f9a7803f470 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f9b84018e00 tx=0x7f9b84018d10 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:29.204 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.199+0000 7f9a76ffd640 1 -- 172.21.15.142:0/802277418 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b8c015070 con 0x55c8d34791d0 2024-09-22T08:38:29.204 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.199+0000 7f9a76ffd640 1 -- 172.21.15.142:0/802277418 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b8c001670 con 0x55c8d34791d0 2024-09-22T08:38:29.204 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.199+0000 7f9a76ffd640 1 -- 172.21.15.142:0/802277418 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b8c001990 con 0x55c8d34791d0 2024-09-22T08:38:29.204 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.199+0000 7f9b93463800 1 -- 172.21.15.142:0/802277418 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c8d34791d0 msgr2=0x55c8d347b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:29.205 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.199+0000 7f9b93463800 1 --2- 172.21.15.142:0/802277418 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c8d34791d0 0x55c8d347b5c0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f9b8c00a3e0 tx=0x7f9b8c00a8a0 comp rx=0 tx=0).stop 2024-09-22T08:38:29.205 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.199+0000 7f9b93463800 1 -- 172.21.15.142:0/802277418 shutdown_connections 2024-09-22T08:38:29.205 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.199+0000 7f9b93463800 1 --2- 172.21.15.142:0/802277418 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c8d34791d0 0x55c8d347b5c0 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:29.205 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.199+0000 7f9b93463800 1 -- 172.21.15.142:0/802277418 >> 172.21.15.142:0/802277418 conn(0x55c8d3374d30 msgr2=0x55c8d3473af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:38:29.205 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.199+0000 7f9b93463800 1 -- 172.21.15.142:0/802277418 shutdown_connections 2024-09-22T08:38:29.205 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.199+0000 7f9b93463800 1 -- 172.21.15.142:0/802277418 wait complete. 2024-09-22T08:38:29.205 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.199+0000 7f9b93463800 1 Processor -- start 2024-09-22T08:38:29.205 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.199+0000 7f9b93463800 1 -- start start 2024-09-22T08:38:29.205 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.200+0000 7f9b93463800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c8d34791d0 0x55c8d347ff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:29.205 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.200+0000 7f9b93463800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55c8d347be50 con 0x55c8d34791d0 2024-09-22T08:38:29.205 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.200+0000 7f9b91755640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c8d34791d0 0x55c8d347ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:29.205 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.200+0000 7f9b91755640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c8d34791d0 0x55c8d347ff70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:51518/0 (socket says 172.21.15.142:51518) 2024-09-22T08:38:29.205 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.200+0000 7f9b91755640 1 -- 172.21.15.142:0/2875941977 learned_addr learned my addr 172.21.15.142:0/2875941977 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:38:29.209 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.200+0000 7f9b91755640 1 -- 172.21.15.142:0/2875941977 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c8d34804d0 con 0x55c8d34791d0 2024-09-22T08:38:29.209 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.200+0000 7f9b91755640 1 --2- 172.21.15.142:0/2875941977 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c8d34791d0 0x55c8d347ff70 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x55c8d34744d0 tx=0x7f9b8c003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:29.209 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.200+0000 7f9a757fa640 1 -- 172.21.15.142:0/2875941977 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b8c020020 con 0x55c8d34791d0 2024-09-22T08:38:29.209 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.200+0000 7f9a757fa640 1 -- 172.21.15.142:0/2875941977 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b8c010780 con 0x55c8d34791d0 2024-09-22T08:38:29.209 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.200+0000 7f9b93463800 1 -- 172.21.15.142:0/2875941977 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c8d3480760 con 0x55c8d34791d0 2024-09-22T08:38:29.209 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.200+0000 7f9a757fa640 1 -- 172.21.15.142:0/2875941977 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b8c015040 con 0x55c8d34791d0 2024-09-22T08:38:29.209 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.200+0000 7f9b93463800 1 -- 172.21.15.142:0/2875941977 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c8d34810e0 con 0x55c8d34791d0 2024-09-22T08:38:29.209 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.201+0000 7f9a757fa640 1 -- 172.21.15.142:0/2875941977 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f9b8c023020 con 0x55c8d34791d0 2024-09-22T08:38:29.209 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.202+0000 7f9b93463800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:38:29.210 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.202+0000 7f9b93463800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:38:29.210 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.202+0000 7f9a757fa640 1 --2- 172.21.15.142:0/2875941977 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f9a6803cfb0 0x7f9a6803f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:29.210 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.202+0000 7f9a757fa640 1 -- 172.21.15.142:0/2875941977 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5938+0+0 (secure 0 0 0) 0x7f9b8c053e80 con 0x55c8d34791d0 2024-09-22T08:38:29.210 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.202+0000 7f9b8bfff640 1 --2- 172.21.15.142:0/2875941977 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f9a6803cfb0 0x7f9a6803f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:29.210 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.202+0000 7f9b93463800 1 Processor -- start 2024-09-22T08:38:29.210 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.202+0000 7f9b93463800 1 -- start start 2024-09-22T08:38:29.210 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.202+0000 7f9b8bfff640 1 --2- 172.21.15.142:0/2875941977 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f9a6803cfb0 0x7f9a6803f470 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f9b7c057000 tx=0x7f9b7c052000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:29.210 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.202+0000 7f9b93463800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c8d3499e20 0x55c8d349a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:29.210 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.202+0000 7f9b93463800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55c8d34639f0 con 0x55c8d3499e20 2024-09-22T08:38:29.210 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.203+0000 7f9b90f54640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c8d3499e20 0x55c8d349a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:29.210 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.203+0000 7f9b90f54640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c8d3499e20 0x55c8d349a240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:51532/0 (socket says 172.21.15.142:51532) 2024-09-22T08:38:29.210 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.203+0000 7f9b90f54640 1 -- 172.21.15.142:0/1265410368 learned_addr learned my addr 172.21.15.142:0/1265410368 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:38:29.210 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.203+0000 7f9b90f54640 1 -- 172.21.15.142:0/1265410368 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c8d349a880 con 0x55c8d3499e20 2024-09-22T08:38:29.211 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.203+0000 7f9b90f54640 1 --2- 172.21.15.142:0/1265410368 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c8d3499e20 0x55c8d349a240 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f9b84052b10 tx=0x7f9b8402ddb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:29.211 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.203+0000 7f9a557e2640 1 -- 172.21.15.142:0/1265410368 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b84046030 con 0x55c8d3499e20 2024-09-22T08:38:29.211 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.203+0000 7f9a557e2640 1 -- 172.21.15.142:0/1265410368 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b8400de00 con 0x55c8d3499e20 2024-09-22T08:38:29.211 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.203+0000 7f9b93463800 1 -- 172.21.15.142:0/1265410368 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c8d349b0b0 con 0x55c8d3499e20 2024-09-22T08:38:29.211 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.203+0000 7f9a557e2640 1 -- 172.21.15.142:0/1265410368 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b8400d7a0 con 0x55c8d3499e20 2024-09-22T08:38:29.211 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.203+0000 7f9b93463800 1 -- 172.21.15.142:0/1265410368 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c8d349b650 con 0x55c8d3499e20 2024-09-22T08:38:29.211 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.204+0000 7f9a557e2640 1 -- 172.21.15.142:0/1265410368 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f9b84049030 con 0x55c8d3499e20 2024-09-22T08:38:29.211 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.204+0000 7f9a557e2640 1 --2- 172.21.15.142:0/1265410368 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f99d003cfb0 0x7f99d003f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:29.211 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.204+0000 7f9a557e2640 1 -- 172.21.15.142:0/1265410368 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5938+0+0 (secure 0 0 0) 0x7f9b84047070 con 0x55c8d3499e20 2024-09-22T08:38:29.211 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.204+0000 7f9b8bfff640 1 --2- 172.21.15.142:0/1265410368 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f99d003cfb0 0x7f99d003f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:29.211 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.205+0000 7f99e6ffd640 20 reqs_thread_entry: start 2024-09-22T08:38:29.211 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.205+0000 7f9b8bfff640 1 --2- 172.21.15.142:0/1265410368 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f99d003cfb0 0x7f99d003f470 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f9b7c045a60 tx=0x7f9b7c005a00 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:29.211 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.205+0000 7f9b93463800 1 --2- 172.21.15.142:0/2464824221 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55c8d34a7770 0x55c8d34a9bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:29.212 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.205+0000 7f9b93463800 1 -- 172.21.15.142:0/2464824221 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c8d34aa2c0 con 0x55c8d34a7770 2024-09-22T08:38:29.212 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.205+0000 7f9b91755640 1 --2- 172.21.15.142:0/2464824221 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55c8d34a7770 0x55c8d34a9bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:29.212 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.205+0000 7f9b91755640 1 --2- 172.21.15.142:0/2464824221 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55c8d34a7770 0x55c8d34a9bf0 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:29.212 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.205+0000 7f9b91755640 1 -- 172.21.15.142:0/2464824221 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9b8c00e070 con 0x55c8d34a7770 2024-09-22T08:38:29.212 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.205+0000 7f9b93463800 1 --2- 172.21.15.142:0/2464824221 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55c8d34ac090 0x55c8d34ae480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:29.212 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.205+0000 7f9b93463800 1 -- 172.21.15.142:0/2464824221 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:2 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c8d34aeb70 con 0x55c8d34ac090 2024-09-22T08:38:29.212 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.205+0000 7f9b90f54640 1 --2- 172.21.15.142:0/2464824221 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55c8d34ac090 0x55c8d34ae480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:29.212 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.206+0000 7f9b90f54640 1 --2- 172.21.15.142:0/2464824221 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55c8d34ac090 0x55c8d34ae480 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:29.212 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.206+0000 7f9b90f54640 1 -- 172.21.15.142:0/2464824221 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(2 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [call out=48b,read 0~1155 out=1155b] v0'0 uv3 ondisk = 0) ==== 232+0+1203 (crc 0 0 0) 0x7f9b84052070 con 0x55c8d34ac090 2024-09-22T08:38:29.212 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.206+0000 7f9b93463800 1 -- 172.21.15.142:0/2464824221 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:3 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [stat,call version.check_conds in=122b,call version.inc in=38b,writefull 0~993 in=993b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c8d34b4010 con 0x55c8d34ac090 2024-09-22T08:38:29.214 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.207+0000 7f9b90f54640 1 -- 172.21.15.142:0/2464824221 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(3 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [stat,call,call,writefull 0~993] v32'4 uv4 ondisk = 0) ==== 316+0+0 (crc 0 0 0) 0x7f9b84052070 con 0x55c8d34ac090 2024-09-22T08:38:29.214 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.208+0000 7f9b93463800 1 -- 172.21.15.142:0/2875941977 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f9a6803cfb0 msgr2=0x7f9a6803f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:29.214 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.208+0000 7f9b93463800 1 --2- 172.21.15.142:0/2875941977 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f9a6803cfb0 0x7f9a6803f470 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f9b7c057000 tx=0x7f9b7c052000 comp rx=0 tx=0).stop 2024-09-22T08:38:29.214 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.208+0000 7f9b93463800 1 -- 172.21.15.142:0/2875941977 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c8d34791d0 msgr2=0x55c8d347ff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:29.215 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.208+0000 7f9b93463800 1 --2- 172.21.15.142:0/2875941977 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c8d34791d0 0x55c8d347ff70 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x55c8d34744d0 tx=0x7f9b8c003370 comp rx=0 tx=0).stop 2024-09-22T08:38:29.215 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.208+0000 7f9b93463800 1 -- 172.21.15.142:0/2875941977 shutdown_connections 2024-09-22T08:38:29.215 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.208+0000 7f9b93463800 1 --2- 172.21.15.142:0/2875941977 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f9a6803cfb0 0x7f9a6803f470 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:29.215 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.208+0000 7f9b93463800 1 --2- 172.21.15.142:0/2875941977 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c8d34791d0 0x55c8d347ff70 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:29.215 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.208+0000 7f9b93463800 1 -- 172.21.15.142:0/2875941977 >> 172.21.15.142:0/2875941977 conn(0x55c8d3374d30 msgr2=0x55c8d3473ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:38:29.215 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.208+0000 7f9b93463800 1 -- 172.21.15.142:0/2875941977 shutdown_connections 2024-09-22T08:38:29.215 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.208+0000 7f9b93463800 1 -- 172.21.15.142:0/2875941977 wait complete. 2024-09-22T08:38:29.215 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.209+0000 7f9b93463800 1 -- 172.21.15.142:0/1265410368 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f99d003cfb0 msgr2=0x7f99d003f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:29.215 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.209+0000 7f9b93463800 1 --2- 172.21.15.142:0/1265410368 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f99d003cfb0 0x7f99d003f470 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f9b7c045a60 tx=0x7f9b7c005a00 comp rx=0 tx=0).stop 2024-09-22T08:38:29.215 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.209+0000 7f9b93463800 1 -- 172.21.15.142:0/1265410368 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c8d3499e20 msgr2=0x55c8d349a240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:29.215 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.209+0000 7f9b93463800 1 --2- 172.21.15.142:0/1265410368 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c8d3499e20 0x55c8d349a240 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f9b84052b10 tx=0x7f9b8402ddb0 comp rx=0 tx=0).stop 2024-09-22T08:38:29.215 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.209+0000 7f9b93463800 1 -- 172.21.15.142:0/1265410368 shutdown_connections 2024-09-22T08:38:29.215 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.209+0000 7f9b93463800 1 --2- 172.21.15.142:0/1265410368 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f99d003cfb0 0x7f99d003f470 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:29.215 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.209+0000 7f9b93463800 1 --2- 172.21.15.142:0/1265410368 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c8d3499e20 0x55c8d349a240 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:29.215 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.209+0000 7f9b93463800 1 -- 172.21.15.142:0/1265410368 >> 172.21.15.142:0/1265410368 conn(0x55c8d348f3c0 msgr2=0x55c8d348f7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:38:29.216 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.209+0000 7f9b93463800 1 -- 172.21.15.142:0/1265410368 shutdown_connections 2024-09-22T08:38:29.216 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.209+0000 7f9b93463800 1 -- 172.21.15.142:0/1265410368 wait complete. 2024-09-22T08:38:29.216 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.209+0000 7f9b93463800 1 -- 172.21.15.142:0/2464824221 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55c8d34a7770 msgr2=0x55c8d34a9bf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:29.216 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.209+0000 7f9b93463800 1 --2- 172.21.15.142:0/2464824221 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55c8d34a7770 0x55c8d34a9bf0 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:29.216 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.209+0000 7f9b93463800 1 -- 172.21.15.142:0/2464824221 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55c8d34ac090 msgr2=0x55c8d34ae480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:29.216 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.209+0000 7f9b93463800 1 --2- 172.21.15.142:0/2464824221 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55c8d34ac090 0x55c8d34ae480 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:29.216 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.209+0000 7f9b93463800 1 -- 172.21.15.142:0/2464824221 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f9a7803cfb0 msgr2=0x7f9a7803f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:29.216 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.209+0000 7f9b93463800 1 --2- 172.21.15.142:0/2464824221 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f9a7803cfb0 0x7f9a7803f470 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f9b84018e00 tx=0x7f9b84018d10 comp rx=0 tx=0).stop 2024-09-22T08:38:29.216 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.209+0000 7f9b93463800 1 -- 172.21.15.142:0/2464824221 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c8d3373920 msgr2=0x55c8d32e7a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:29.216 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.209+0000 7f9b93463800 1 --2- 172.21.15.142:0/2464824221 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c8d3373920 0x55c8d32e7a70 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f9b840012b0 tx=0x7f9b84000ed0 comp rx=0 tx=0).stop 2024-09-22T08:38:29.216 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.209+0000 7f9b93463800 1 -- 172.21.15.142:0/2464824221 shutdown_connections 2024-09-22T08:38:29.216 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.209+0000 7f9b93463800 1 --2- 172.21.15.142:0/2464824221 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55c8d34ac090 0x55c8d34ae480 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:29.216 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.209+0000 7f9b93463800 1 --2- 172.21.15.142:0/2464824221 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55c8d34a7770 0x55c8d34a9bf0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:29.216 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.209+0000 7f9b93463800 1 --2- 172.21.15.142:0/2464824221 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f9a7803cfb0 0x7f9a7803f470 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:29.216 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.209+0000 7f9b93463800 1 --2- 172.21.15.142:0/2464824221 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c8d3373920 0x55c8d32e7a70 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:29.216 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.209+0000 7f9b93463800 1 -- 172.21.15.142:0/2464824221 >> 172.21.15.142:0/2464824221 conn(0x55c8d336ed10 msgr2=0x55c8d34644c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:38:29.217 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.209+0000 7f9b93463800 1 -- 172.21.15.142:0/2464824221 shutdown_connections 2024-09-22T08:38:29.217 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.209+0000 7f9b93463800 1 -- 172.21.15.142:0/2464824221 wait complete. 2024-09-22T08:38:29.219 INFO:teuthology.orchestra.run.smithi142.stdout:{"id":"e239248c-0bee-4e41-803a-24b288d3eb8f","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-09-22T08:38:29.220 DEBUG:tasks.util.rgw: json result: {'id': 'e239248c-0bee-4e41-803a-24b288d3eb8f', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-09-22T08:38:29.221 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'get'] 2024-09-22T08:38:29.221 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'get'] 2024-09-22T08:38:29.222 DEBUG:teuthology.orchestra.run.smithi142:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup get 2024-09-22T08:38:29.263 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:38:29.263 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:38:29.264 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.261+0000 7f2894332800 1 Processor -- start 2024-09-22T08:38:29.264 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.261+0000 7f2894332800 1 -- start start 2024-09-22T08:38:29.264 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.262+0000 7f2894332800 1 --2- >> v2:172.21.15.31:3300/0 conn(0x5652bef0e9c0 0x5652bef10e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:29.264 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.262+0000 7f2894332800 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5652bed95a20 con 0x5652bee7dd20 2024-09-22T08:38:29.264 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.262+0000 7f2894332800 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x5652bed957d0 con 0x5652bef0e9c0 2024-09-22T08:38:29.265 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.262+0000 7f288f7bb640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x5652bef0e9c0 0x5652bef10e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:29.265 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.262+0000 7f288ffbc640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x5652bee7dd20 0x5652bef0d130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.142:50448/0 (socket says 172.21.15.142:50448) 2024-09-22T08:38:29.265 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.262+0000 7f288ffbc640 1 -- 172.21.15.142:0/3910952793 learned_addr learned my addr 172.21.15.142:0/3910952793 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-09-22T08:38:29.265 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.262+0000 7f288f7bb640 1 -- 172.21.15.142:0/3910952793 >> v1:172.21.15.31:6789/0 conn(0x5652bee7dd20 legacy=0x5652bef0d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:29.265 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.262+0000 7f288efba640 1 -- 172.21.15.142:0/3910952793 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 680528836 0 0) 0x5652bed95a20 con 0x5652bee7dd20 2024-09-22T08:38:29.265 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.262+0000 7f288f7bb640 1 -- 172.21.15.142:0/3910952793 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5652bef12560 con 0x5652bef0e9c0 2024-09-22T08:38:29.266 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.264+0000 7f288f7bb640 1 --2- 172.21.15.142:0/3910952793 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5652bef0e9c0 0x5652bef10e80 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f288400a470 tx=0x7f2884045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8b9a9b607868efe server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:29.266 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.264+0000 7f288efba640 1 -- 172.21.15.142:0/3910952793 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2884053570 con 0x5652bef0e9c0 2024-09-22T08:38:29.266 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.264+0000 7f288efba640 1 -- 172.21.15.142:0/3910952793 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2884058070 con 0x5652bef0e9c0 2024-09-22T08:38:29.267 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.264+0000 7f288efba640 1 -- 172.21.15.142:0/3910952793 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2884053880 con 0x5652bef0e9c0 2024-09-22T08:38:29.267 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.265+0000 7f2894332800 1 -- 172.21.15.142:0/3910952793 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5652bef0e9c0 msgr2=0x5652bef10e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:29.267 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.265+0000 7f2894332800 1 --2- 172.21.15.142:0/3910952793 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5652bef0e9c0 0x5652bef10e80 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f288400a470 tx=0x7f2884045a20 comp rx=0 tx=0).stop 2024-09-22T08:38:29.268 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.265+0000 7f2894332800 1 -- 172.21.15.142:0/3910952793 shutdown_connections 2024-09-22T08:38:29.268 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.265+0000 7f2894332800 1 --2- 172.21.15.142:0/3910952793 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5652bef0e9c0 0x5652bef10e80 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:29.268 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.265+0000 7f2894332800 1 -- 172.21.15.142:0/3910952793 >> 172.21.15.142:0/3910952793 conn(0x5652bef04ba0 msgr2=0x5652bef07000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:38:29.268 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.265+0000 7f2894332800 1 -- 172.21.15.142:0/3910952793 shutdown_connections 2024-09-22T08:38:29.268 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.265+0000 7f2894332800 1 -- 172.21.15.142:0/3910952793 wait complete. 2024-09-22T08:38:29.281 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.279+0000 7f2894332800 1 Processor -- start 2024-09-22T08:38:29.281 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.279+0000 7f2894332800 1 -- start start 2024-09-22T08:38:29.281 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.279+0000 7f2894332800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5652bee7dd20 0x5652beff9e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:29.281 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.279+0000 7f2894332800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5652beda2dd0 con 0x5652bee7dd20 2024-09-22T08:38:29.282 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.279+0000 7f288ffbc640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5652bee7dd20 0x5652beff9e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:29.282 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.279+0000 7f288ffbc640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5652bee7dd20 0x5652beff9e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:51560/0 (socket says 172.21.15.142:51560) 2024-09-22T08:38:29.282 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.279+0000 7f288ffbc640 1 -- 172.21.15.142:0/1399604242 learned_addr learned my addr 172.21.15.142:0/1399604242 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:38:29.282 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.279+0000 7f288ffbc640 1 -- 172.21.15.142:0/1399604242 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5652beffa420 con 0x5652bee7dd20 2024-09-22T08:38:29.282 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.280+0000 7f288ffbc640 1 --2- 172.21.15.142:0/1399604242 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5652bee7dd20 0x5652beff9e30 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f2880006fa0 tx=0x7f2880001b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1169d618315c9a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:29.282 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.280+0000 7f277de0b640 1 -- 172.21.15.142:0/1399604242 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2880003450 con 0x5652bee7dd20 2024-09-22T08:38:29.283 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.280+0000 7f277de0b640 1 -- 172.21.15.142:0/1399604242 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2880003610 con 0x5652bee7dd20 2024-09-22T08:38:29.283 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.280+0000 7f277de0b640 1 -- 172.21.15.142:0/1399604242 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2880003970 con 0x5652bee7dd20 2024-09-22T08:38:29.286 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.281+0000 7f2894332800 1 -- 172.21.15.142:0/1399604242 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5652bee7dd20 msgr2=0x5652beff9e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:29.286 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.281+0000 7f2894332800 1 --2- 172.21.15.142:0/1399604242 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5652bee7dd20 0x5652beff9e30 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f2880006fa0 tx=0x7f2880001b00 comp rx=0 tx=0).stop 2024-09-22T08:38:29.286 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.281+0000 7f2894332800 1 -- 172.21.15.142:0/1399604242 shutdown_connections 2024-09-22T08:38:29.286 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.281+0000 7f2894332800 1 --2- 172.21.15.142:0/1399604242 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5652bee7dd20 0x5652beff9e30 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:29.286 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.281+0000 7f2894332800 1 -- 172.21.15.142:0/1399604242 >> 172.21.15.142:0/1399604242 conn(0x5652bef04ba0 msgr2=0x5652beff57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:38:29.286 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.281+0000 7f2894332800 1 -- 172.21.15.142:0/1399604242 shutdown_connections 2024-09-22T08:38:29.286 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.281+0000 7f2894332800 1 -- 172.21.15.142:0/1399604242 wait complete. 2024-09-22T08:38:29.286 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.281+0000 7f2894332800 1 Processor -- start 2024-09-22T08:38:29.286 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.281+0000 7f2894332800 1 -- start start 2024-09-22T08:38:29.287 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.281+0000 7f2894332800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5652bee7dd20 0x5652bf001940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:29.287 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.281+0000 7f2894332800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5652bef11800 con 0x5652bee7dd20 2024-09-22T08:38:29.287 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.281+0000 7f288ffbc640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5652bee7dd20 0x5652bf001940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:29.287 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.281+0000 7f288ffbc640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5652bee7dd20 0x5652bf001940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:51570/0 (socket says 172.21.15.142:51570) 2024-09-22T08:38:29.287 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.281+0000 7f288ffbc640 1 -- 172.21.15.142:0/1381842905 learned_addr learned my addr 172.21.15.142:0/1381842905 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:38:29.287 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.282+0000 7f288ffbc640 1 -- 172.21.15.142:0/1381842905 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5652bf001ea0 con 0x5652bee7dd20 2024-09-22T08:38:29.287 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.282+0000 7f288ffbc640 1 --2- 172.21.15.142:0/1381842905 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5652bee7dd20 0x5652bf001940 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x5652beffadc0 tx=0x7f2880001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:29.287 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.282+0000 7f2777fff640 1 -- 172.21.15.142:0/1381842905 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2880014a10 con 0x5652bee7dd20 2024-09-22T08:38:29.287 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.282+0000 7f2777fff640 1 -- 172.21.15.142:0/1381842905 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2880014bb0 con 0x5652bee7dd20 2024-09-22T08:38:29.287 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.282+0000 7f2894332800 1 -- 172.21.15.142:0/1381842905 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5652bf002130 con 0x5652bee7dd20 2024-09-22T08:38:29.287 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.282+0000 7f2777fff640 1 -- 172.21.15.142:0/1381842905 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f288001e3f0 con 0x5652bee7dd20 2024-09-22T08:38:29.287 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.282+0000 7f2894332800 1 -- 172.21.15.142:0/1381842905 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5652bf002b30 con 0x5652bee7dd20 2024-09-22T08:38:29.287 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.283+0000 7f2894332800 1 Processor -- start 2024-09-22T08:38:29.287 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.283+0000 7f2894332800 1 -- start start 2024-09-22T08:38:29.288 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.283+0000 7f2894332800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5652bf00ef30 0x5652bf011320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:29.288 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.283+0000 7f2894332800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5652bee01d50 con 0x5652bf00ef30 2024-09-22T08:38:29.288 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.283+0000 7f28907bd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5652bf00ef30 0x5652bf011320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:29.288 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.283+0000 7f2777fff640 1 -- 172.21.15.142:0/1381842905 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f2880010070 con 0x5652bee7dd20 2024-09-22T08:38:29.288 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.283+0000 7f28907bd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5652bf00ef30 0x5652bf011320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:51582/0 (socket says 172.21.15.142:51582) 2024-09-22T08:38:29.288 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.283+0000 7f28907bd640 1 -- 172.21.15.142:0/4175212981 learned_addr learned my addr 172.21.15.142:0/4175212981 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:38:29.288 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.283+0000 7f2777fff640 1 --2- 172.21.15.142:0/1381842905 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f277803cfb0 0x7f277803f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:29.288 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.283+0000 7f28907bd640 1 -- 172.21.15.142:0/4175212981 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5652bf0118f0 con 0x5652bf00ef30 2024-09-22T08:38:29.288 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.283+0000 7f2777fff640 1 -- 172.21.15.142:0/1381842905 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5938+0+0 (secure 0 0 0) 0x7f2880018070 con 0x5652bee7dd20 2024-09-22T08:38:29.288 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.283+0000 7f288ffbc640 1 --2- 172.21.15.142:0/1381842905 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f277803cfb0 0x7f277803f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:29.288 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.284+0000 7f28907bd640 1 --2- 172.21.15.142:0/4175212981 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5652bf00ef30 0x5652bf011320 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f288800a430 tx=0x7f288800a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48bb4455da1ad26a server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:29.288 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.284+0000 7f2775ffb640 1 -- 172.21.15.142:0/4175212981 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2888008840 con 0x5652bf00ef30 2024-09-22T08:38:29.288 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.284+0000 7f2775ffb640 1 -- 172.21.15.142:0/4175212981 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2888008a00 con 0x5652bf00ef30 2024-09-22T08:38:29.288 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.284+0000 7f2775ffb640 1 -- 172.21.15.142:0/4175212981 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2888008d20 con 0x5652bf00ef30 2024-09-22T08:38:29.293 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.284+0000 7f2894332800 1 -- 172.21.15.142:0/4175212981 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5652bf00ef30 msgr2=0x5652bf011320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:29.293 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.284+0000 7f288ffbc640 1 --2- 172.21.15.142:0/1381842905 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f277803cfb0 0x7f277803f470 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f2880011020 tx=0x7f2880003ac0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:29.293 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.284+0000 7f2894332800 1 --2- 172.21.15.142:0/4175212981 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5652bf00ef30 0x5652bf011320 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f288800a430 tx=0x7f288800a8f0 comp rx=0 tx=0).stop 2024-09-22T08:38:29.293 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.284+0000 7f2894332800 1 -- 172.21.15.142:0/4175212981 shutdown_connections 2024-09-22T08:38:29.293 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.284+0000 7f2894332800 1 --2- 172.21.15.142:0/4175212981 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5652bf00ef30 0x5652bf011320 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:29.294 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.284+0000 7f2894332800 1 -- 172.21.15.142:0/4175212981 >> 172.21.15.142:0/4175212981 conn(0x5652bef0e9c0 msgr2=0x5652bf009850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:38:29.294 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.284+0000 7f2894332800 1 -- 172.21.15.142:0/4175212981 shutdown_connections 2024-09-22T08:38:29.294 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.284+0000 7f2894332800 1 -- 172.21.15.142:0/4175212981 wait complete. 2024-09-22T08:38:29.294 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.285+0000 7f2894332800 1 Processor -- start 2024-09-22T08:38:29.294 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.285+0000 7f2894332800 1 -- start start 2024-09-22T08:38:29.294 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.285+0000 7f2894332800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5652bf00ef30 0x5652bf015da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:29.294 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.285+0000 7f2894332800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5652bf011be0 con 0x5652bf00ef30 2024-09-22T08:38:29.294 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.285+0000 7f28907bd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5652bf00ef30 0x5652bf015da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:29.294 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.285+0000 7f28907bd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5652bf00ef30 0x5652bf015da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:51584/0 (socket says 172.21.15.142:51584) 2024-09-22T08:38:29.294 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.285+0000 7f28907bd640 1 -- 172.21.15.142:0/1447675166 learned_addr learned my addr 172.21.15.142:0/1447675166 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:38:29.294 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.285+0000 7f28907bd640 1 -- 172.21.15.142:0/1447675166 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5652bf016300 con 0x5652bf00ef30 2024-09-22T08:38:29.294 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.285+0000 7f28907bd640 1 --2- 172.21.15.142:0/1447675166 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5652bf00ef30 0x5652bf015da0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x5652bf00a230 tx=0x7f2888002ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:29.294 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.286+0000 7f276ffff640 1 -- 172.21.15.142:0/1447675166 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2888022030 con 0x5652bf00ef30 2024-09-22T08:38:29.295 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.286+0000 7f276ffff640 1 -- 172.21.15.142:0/1447675166 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2888019040 con 0x5652bf00ef30 2024-09-22T08:38:29.295 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.286+0000 7f2894332800 1 -- 172.21.15.142:0/1447675166 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5652bf016590 con 0x5652bf00ef30 2024-09-22T08:38:29.295 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.286+0000 7f276ffff640 1 -- 172.21.15.142:0/1447675166 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2888013930 con 0x5652bf00ef30 2024-09-22T08:38:29.295 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.286+0000 7f2894332800 1 -- 172.21.15.142:0/1447675166 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5652bf016f10 con 0x5652bf00ef30 2024-09-22T08:38:29.295 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.287+0000 7f276ffff640 1 -- 172.21.15.142:0/1447675166 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f2888025070 con 0x5652bf00ef30 2024-09-22T08:38:29.295 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.287+0000 7f276ffff640 1 --2- 172.21.15.142:0/1447675166 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f276803cfb0 0x7f276803f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:29.295 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.287+0000 7f276ffff640 1 -- 172.21.15.142:0/1447675166 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5938+0+0 (secure 0 0 0) 0x7f2888023070 con 0x5652bf00ef30 2024-09-22T08:38:29.295 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.287+0000 7f288f7bb640 1 --2- 172.21.15.142:0/1447675166 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f276803cfb0 0x7f276803f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:29.295 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.287+0000 7f2894332800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:38:29.295 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.287+0000 7f2894332800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:38:29.295 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.287+0000 7f2894332800 1 Processor -- start 2024-09-22T08:38:29.295 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.287+0000 7f288f7bb640 1 --2- 172.21.15.142:0/1447675166 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f276803cfb0 0x7f276803f470 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f2884057000 tx=0x7f2884052000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:29.295 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.288+0000 7f2894332800 1 -- start start 2024-09-22T08:38:29.295 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.288+0000 7f2894332800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5652bf02fbd0 0x5652bf02fff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:29.296 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.288+0000 7f2894332800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5652beffa850 con 0x5652bf02fbd0 2024-09-22T08:38:29.296 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.288+0000 7f288ffbc640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5652bf02fbd0 0x5652bf02fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:29.296 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.288+0000 7f288ffbc640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5652bf02fbd0 0x5652bf02fff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:51594/0 (socket says 172.21.15.142:51594) 2024-09-22T08:38:29.296 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.288+0000 7f288ffbc640 1 -- 172.21.15.142:0/3089649827 learned_addr learned my addr 172.21.15.142:0/3089649827 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:38:29.296 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.288+0000 7f288ffbc640 1 -- 172.21.15.142:0/3089649827 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5652bf030630 con 0x5652bf02fbd0 2024-09-22T08:38:29.296 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.288+0000 7f288ffbc640 1 --2- 172.21.15.142:0/3089649827 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5652bf02fbd0 0x5652bf02fff0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f2880001360 tx=0x7f2880010b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:29.296 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.288+0000 7f270ffff640 1 -- 172.21.15.142:0/3089649827 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2880029470 con 0x5652bf02fbd0 2024-09-22T08:38:29.296 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.289+0000 7f270ffff640 1 -- 172.21.15.142:0/3089649827 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2880045070 con 0x5652bf02fbd0 2024-09-22T08:38:29.296 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.289+0000 7f270ffff640 1 -- 172.21.15.142:0/3089649827 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f288001eb40 con 0x5652bf02fbd0 2024-09-22T08:38:29.296 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.289+0000 7f2894332800 1 -- 172.21.15.142:0/3089649827 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5652bf030e60 con 0x5652bf02fbd0 2024-09-22T08:38:29.296 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.289+0000 7f2894332800 1 -- 172.21.15.142:0/3089649827 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5652bf031400 con 0x5652bf02fbd0 2024-09-22T08:38:29.296 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.289+0000 7f270ffff640 1 -- 172.21.15.142:0/3089649827 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f2880011cb0 con 0x5652bf02fbd0 2024-09-22T08:38:29.296 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.290+0000 7f270ffff640 1 --2- 172.21.15.142:0/3089649827 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f26c803cfb0 0x7f26c803f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:29.296 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.290+0000 7f270ffff640 1 -- 172.21.15.142:0/3089649827 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5938+0+0 (secure 0 0 0) 0x7f288004bc00 con 0x5652bf02fbd0 2024-09-22T08:38:29.296 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.290+0000 7f288f7bb640 1 --2- 172.21.15.142:0/3089649827 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f26c803cfb0 0x7f26c803f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:29.297 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.290+0000 7f270dffb640 20 reqs_thread_entry: start 2024-09-22T08:38:29.297 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.290+0000 7f288f7bb640 1 --2- 172.21.15.142:0/3089649827 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f26c803cfb0 0x7f26c803f470 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f2884045a60 tx=0x7f2884005a00 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:29.297 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.290+0000 7f2894332800 1 --2- 172.21.15.142:0/1381842905 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5652bf03d700 0x5652bf03fb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:29.297 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.290+0000 7f2894332800 1 -- 172.21.15.142:0/1381842905 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5652bf0401b0 con 0x5652bf03d700 2024-09-22T08:38:29.297 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.290+0000 7f28907bd640 1 --2- 172.21.15.142:0/1381842905 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5652bf03d700 0x5652bf03fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:29.297 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.290+0000 7f28907bd640 1 --2- 172.21.15.142:0/1381842905 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5652bf03d700 0x5652bf03fb30 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:29.297 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.291+0000 7f28907bd640 1 -- 172.21.15.142:0/1381842905 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f288801ed20 con 0x5652bf03d700 2024-09-22T08:38:29.297 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.291+0000 7f2894332800 1 -- 172.21.15.142:0/1381842905 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5652bf040700 con 0x5652bf03d700 2024-09-22T08:38:29.297 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.291+0000 7f28907bd640 1 -- 172.21.15.142:0/1381842905 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f288801ed20 con 0x5652bf03d700 2024-09-22T08:38:29.297 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.291+0000 7f2894332800 1 --2- 172.21.15.142:0/1381842905 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5652bf0424f0 0x5652bf0448e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:29.297 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.291+0000 7f2894332800 1 -- 172.21.15.142:0/1381842905 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:3 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5652bf044f80 con 0x5652bf0424f0 2024-09-22T08:38:29.297 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.291+0000 7f288ffbc640 1 --2- 172.21.15.142:0/1381842905 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5652bf0424f0 0x5652bf0448e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:29.297 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.291+0000 7f288ffbc640 1 --2- 172.21.15.142:0/1381842905 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5652bf0424f0 0x5652bf0448e0 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:29.299 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.292+0000 7f288ffbc640 1 -- 172.21.15.142:0/1381842905 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(3 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f2880051070 con 0x5652bf0424f0 2024-09-22T08:38:29.300 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.292+0000 7f2894332800 1 -- 172.21.15.142:0/1447675166 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f276803cfb0 msgr2=0x7f276803f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:29.300 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.292+0000 7f2894332800 1 --2- 172.21.15.142:0/1447675166 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f276803cfb0 0x7f276803f470 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f2884057000 tx=0x7f2884052000 comp rx=0 tx=0).stop 2024-09-22T08:38:29.300 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.292+0000 7f2894332800 1 -- 172.21.15.142:0/1447675166 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5652bf00ef30 msgr2=0x5652bf015da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:29.300 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.292+0000 7f2894332800 1 --2- 172.21.15.142:0/1447675166 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5652bf00ef30 0x5652bf015da0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x5652bf00a230 tx=0x7f2888002ff0 comp rx=0 tx=0).stop 2024-09-22T08:38:29.300 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.292+0000 7f2894332800 1 -- 172.21.15.142:0/1447675166 shutdown_connections 2024-09-22T08:38:29.300 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.292+0000 7f2894332800 1 --2- 172.21.15.142:0/1447675166 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f276803cfb0 0x7f276803f470 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:29.300 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.292+0000 7f2894332800 1 --2- 172.21.15.142:0/1447675166 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5652bf00ef30 0x5652bf015da0 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:29.300 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.292+0000 7f2894332800 1 -- 172.21.15.142:0/1447675166 >> 172.21.15.142:0/1447675166 conn(0x5652bef0e9c0 msgr2=0x5652bf009820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:38:29.300 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.292+0000 7f2894332800 1 -- 172.21.15.142:0/1447675166 shutdown_connections 2024-09-22T08:38:29.300 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.292+0000 7f2894332800 1 -- 172.21.15.142:0/1447675166 wait complete. 2024-09-22T08:38:29.300 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.293+0000 7f2894332800 1 -- 172.21.15.142:0/3089649827 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f26c803cfb0 msgr2=0x7f26c803f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:29.300 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.293+0000 7f2894332800 1 --2- 172.21.15.142:0/3089649827 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f26c803cfb0 0x7f26c803f470 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f2884045a60 tx=0x7f2884005a00 comp rx=0 tx=0).stop 2024-09-22T08:38:29.300 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.293+0000 7f2894332800 1 -- 172.21.15.142:0/3089649827 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5652bf02fbd0 msgr2=0x5652bf02fff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:29.301 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.293+0000 7f2894332800 1 --2- 172.21.15.142:0/3089649827 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5652bf02fbd0 0x5652bf02fff0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f2880001360 tx=0x7f2880010b00 comp rx=0 tx=0).stop 2024-09-22T08:38:29.301 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.293+0000 7f2894332800 1 -- 172.21.15.142:0/3089649827 shutdown_connections 2024-09-22T08:38:29.301 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.293+0000 7f2894332800 1 --2- 172.21.15.142:0/3089649827 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f26c803cfb0 0x7f26c803f470 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:29.301 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.293+0000 7f2894332800 1 --2- 172.21.15.142:0/3089649827 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5652bf02fbd0 0x5652bf02fff0 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:29.301 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.293+0000 7f2894332800 1 -- 172.21.15.142:0/3089649827 >> 172.21.15.142:0/3089649827 conn(0x5652bf025130 msgr2=0x5652bf025510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:38:29.301 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.293+0000 7f2894332800 1 -- 172.21.15.142:0/3089649827 shutdown_connections 2024-09-22T08:38:29.301 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.293+0000 7f2894332800 1 -- 172.21.15.142:0/3089649827 wait complete. 2024-09-22T08:38:29.301 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.293+0000 7f2894332800 1 -- 172.21.15.142:0/1381842905 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5652bf03d700 msgr2=0x5652bf03fb30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:29.301 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.293+0000 7f2894332800 1 --2- 172.21.15.142:0/1381842905 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5652bf03d700 0x5652bf03fb30 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:29.301 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.293+0000 7f2894332800 1 -- 172.21.15.142:0/1381842905 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5652bf0424f0 msgr2=0x5652bf0448e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:29.301 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.293+0000 7f2894332800 1 --2- 172.21.15.142:0/1381842905 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5652bf0424f0 0x5652bf0448e0 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:29.301 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.293+0000 7f2894332800 1 -- 172.21.15.142:0/1381842905 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f277803cfb0 msgr2=0x7f277803f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:29.301 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.293+0000 7f2894332800 1 --2- 172.21.15.142:0/1381842905 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f277803cfb0 0x7f277803f470 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f2880011020 tx=0x7f2880003ac0 comp rx=0 tx=0).stop 2024-09-22T08:38:29.302 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.293+0000 7f2894332800 1 -- 172.21.15.142:0/1381842905 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5652bee7dd20 msgr2=0x5652bf001940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:29.302 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.293+0000 7f2894332800 1 --2- 172.21.15.142:0/1381842905 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5652bee7dd20 0x5652bf001940 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x5652beffadc0 tx=0x7f2880001250 comp rx=0 tx=0).stop 2024-09-22T08:38:29.302 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.293+0000 7f2894332800 1 -- 172.21.15.142:0/1381842905 shutdown_connections 2024-09-22T08:38:29.302 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.293+0000 7f2894332800 1 --2- 172.21.15.142:0/1381842905 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5652bf0424f0 0x5652bf0448e0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:29.302 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.293+0000 7f2894332800 1 --2- 172.21.15.142:0/1381842905 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5652bf03d700 0x5652bf03fb30 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:29.302 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.293+0000 7f2894332800 1 --2- 172.21.15.142:0/1381842905 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f277803cfb0 0x7f277803f470 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:29.302 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.293+0000 7f2894332800 1 --2- 172.21.15.142:0/1381842905 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5652bee7dd20 0x5652bf001940 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:29.302 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.293+0000 7f2894332800 1 -- 172.21.15.142:0/1381842905 >> 172.21.15.142:0/1381842905 conn(0x5652bef04ba0 msgr2=0x5652beffb320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:38:29.302 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.293+0000 7f2894332800 1 -- 172.21.15.142:0/1381842905 shutdown_connections 2024-09-22T08:38:29.302 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.293+0000 7f2894332800 1 -- 172.21.15.142:0/1381842905 wait complete. 2024-09-22T08:38:29.304 INFO:teuthology.orchestra.run.smithi142.stdout:{"id":"d89f6f57-1007-47dd-9065-f486c7b01aec","name":"default","api_name":"default","is_master":true,"endpoints":[],"hostnames":[],"hostnames_s3website":[],"master_zone":"e239248c-0bee-4e41-803a-24b288d3eb8f","zones":[{"id":"e239248c-0bee-4e41-803a-24b288d3eb8f","name":"default","endpoints":[],"log_meta":false,"log_data":false,"bucket_index_max_shards":11,"read_only":false,"tier_type":"","sync_from_all":true,"sync_from":[],"redirect_zone":"","supported_features":["notification_v2","resharding"]}],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":["STANDARD"]}],"default_placement":"default-placement","realm_id":"","sync_policy":{"groups":[]},"enabled_features":["notification_v2","resharding"]} 2024-09-22T08:38:29.304 DEBUG:tasks.util.rgw: json result: {'id': 'd89f6f57-1007-47dd-9065-f486c7b01aec', 'name': 'default', 'api_name': 'default', 'is_master': True, 'endpoints': [], 'hostnames': [], 'hostnames_s3website': [], 'master_zone': 'e239248c-0bee-4e41-803a-24b288d3eb8f', 'zones': [{'id': 'e239248c-0bee-4e41-803a-24b288d3eb8f', 'name': 'default', 'endpoints': [], 'log_meta': False, 'log_data': False, 'bucket_index_max_shards': 11, 'read_only': False, 'tier_type': '', 'sync_from_all': True, 'sync_from': [], 'redirect_zone': '', 'supported_features': ['notification_v2', 'resharding']}], 'placement_targets': [{'name': 'default-placement', 'tags': [], 'storage_classes': ['STANDARD']}], 'default_placement': 'default-placement', 'realm_id': '', 'sync_policy': {'groups': []}, 'enabled_features': ['notification_v2', 'resharding']} 2024-09-22T08:38:29.307 INFO:teuthology.run_tasks:Running task radosgw-admin-rest... 2024-09-22T08:38:29.324 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'ada', '--display-name', 'Ms. Admin User', '--access-key', 'MH1WC2XQ1S8UISFDZC8W', '--secret', 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', '--max-buckets', '0', '--caps', 'users=read, write; usage=read, write; buckets=read, write; zone=read, write; info=read;ratelimit=read, write'] 2024-09-22T08:38:29.324 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'ada', '--display-name', 'Ms. Admin User', '--access-key', 'MH1WC2XQ1S8UISFDZC8W', '--secret', 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', '--max-buckets', '0', '--caps', 'users=read, write; usage=read, write; buckets=read, write; zone=read, write; info=read;ratelimit=read, write'] 2024-09-22T08:38:29.324 DEBUG:teuthology.orchestra.run.smithi142:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid ada --display-name 'Ms. Admin User' --access-key MH1WC2XQ1S8UISFDZC8W --secret dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG --max-buckets 0 --caps 'users=read, write; usage=read, write; buckets=read, write; zone=read, write; info=read;ratelimit=read, write' 2024-09-22T08:38:29.399 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:38:29.400 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:38:29.401 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.398+0000 7fdf0c728800 1 Processor -- start 2024-09-22T08:38:29.401 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.398+0000 7fdf0c728800 1 -- start start 2024-09-22T08:38:29.401 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.398+0000 7fdf0c728800 1 --2- >> v2:172.21.15.31:3300/0 conn(0x56296d919c30 0x56296d91a030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:29.401 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.398+0000 7fdf0c728800 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56296d7a6a20 con 0x56296d91e8a0 2024-09-22T08:38:29.401 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.398+0000 7fdf0c728800 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x56296d7a67d0 con 0x56296d919c30 2024-09-22T08:38:29.401 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.398+0000 7fdf0844b640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x56296d919c30 0x56296d91a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:29.401 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.398+0000 7fdf0844b640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x56296d919c30 0x56296d91a030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:51600/0 (socket says 172.21.15.142:51600) 2024-09-22T08:38:29.401 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.398+0000 7fdf07c4a640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x56296d91e8a0 0x56296d920d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.142:50456/0 (socket says 172.21.15.142:50456) 2024-09-22T08:38:29.401 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.398+0000 7fdf0844b640 1 -- 172.21.15.142:0/128841812 learned_addr learned my addr 172.21.15.142:0/128841812 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:38:29.401 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.399+0000 7fdf0844b640 1 -- 172.21.15.142:0/128841812 >> v1:172.21.15.31:6789/0 conn(0x56296d91e8a0 legacy=0x56296d920d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:29.402 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.399+0000 7fdf0844b640 1 -- 172.21.15.142:0/128841812 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56296d9235d0 con 0x56296d919c30 2024-09-22T08:38:29.403 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.401+0000 7fdf0844b640 1 --2- 172.21.15.142:0/128841812 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56296d919c30 0x56296d91a030 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fdef800a520 tx=0x7fdef8045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd090482c1ee2c8e server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:29.404 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.401+0000 7fdf07449640 1 -- 172.21.15.142:0/128841812 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdef8055070 con 0x56296d919c30 2024-09-22T08:38:29.404 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.401+0000 7fdf07449640 1 -- 172.21.15.142:0/128841812 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdef80515b0 con 0x56296d919c30 2024-09-22T08:38:29.404 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.401+0000 7fdf07449640 1 -- 172.21.15.142:0/128841812 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdef80518d0 con 0x56296d919c30 2024-09-22T08:38:29.404 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.401+0000 7fdf0c728800 1 -- 172.21.15.142:0/128841812 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56296d919c30 msgr2=0x56296d91a030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:29.404 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.401+0000 7fdf0c728800 1 --2- 172.21.15.142:0/128841812 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56296d919c30 0x56296d91a030 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fdef800a520 tx=0x7fdef8045ba0 comp rx=0 tx=0).stop 2024-09-22T08:38:29.404 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.401+0000 7fdf0c728800 1 -- 172.21.15.142:0/128841812 shutdown_connections 2024-09-22T08:38:29.404 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.401+0000 7fdf0c728800 1 --2- 172.21.15.142:0/128841812 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56296d919c30 0x56296d91a030 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:29.404 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.401+0000 7fdf0c728800 1 -- 172.21.15.142:0/128841812 >> 172.21.15.142:0/128841812 conn(0x56296d915360 msgr2=0x56296d9177e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:38:29.404 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.401+0000 7fdf0c728800 1 -- 172.21.15.142:0/128841812 shutdown_connections 2024-09-22T08:38:29.404 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.401+0000 7fdf0c728800 1 -- 172.21.15.142:0/128841812 wait complete. 2024-09-22T08:38:29.417 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.416+0000 7fdf0c728800 1 Processor -- start 2024-09-22T08:38:29.417 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.416+0000 7fdf0c728800 1 -- start start 2024-09-22T08:38:29.417 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.416+0000 7fdf0c728800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56296d919c30 0x56296d91c020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:29.417 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.416+0000 7fdf0c728800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x56296d7b3dd0 con 0x56296d919c30 2024-09-22T08:38:29.418 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.416+0000 7fdf0844b640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56296d919c30 0x56296d91c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:29.418 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.416+0000 7fdf0844b640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56296d919c30 0x56296d91c020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:51608/0 (socket says 172.21.15.142:51608) 2024-09-22T08:38:29.418 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.416+0000 7fdf0844b640 1 -- 172.21.15.142:0/719020406 learned_addr learned my addr 172.21.15.142:0/719020406 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:38:29.418 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.417+0000 7fdf0844b640 1 -- 172.21.15.142:0/719020406 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56296d91c610 con 0x56296d919c30 2024-09-22T08:38:29.418 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.417+0000 7fdf0844b640 1 --2- 172.21.15.142:0/719020406 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56296d919c30 0x56296d91c020 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fdef80460d0 tx=0x7fdef8051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74fca0db97589231 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:29.420 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.417+0000 7fddf660c640 1 -- 172.21.15.142:0/719020406 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdef80519d0 con 0x56296d919c30 2024-09-22T08:38:29.420 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.417+0000 7fddf660c640 1 -- 172.21.15.142:0/719020406 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdef8051b70 con 0x56296d919c30 2024-09-22T08:38:29.420 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.417+0000 7fddf660c640 1 -- 172.21.15.142:0/719020406 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdef8051e50 con 0x56296d919c30 2024-09-22T08:38:29.420 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.418+0000 7fdf0c728800 1 -- 172.21.15.142:0/719020406 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56296d919c30 msgr2=0x56296d91c020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:29.420 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.418+0000 7fdf0c728800 1 --2- 172.21.15.142:0/719020406 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56296d919c30 0x56296d91c020 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fdef80460d0 tx=0x7fdef8051000 comp rx=0 tx=0).stop 2024-09-22T08:38:29.420 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.418+0000 7fdf0c728800 1 -- 172.21.15.142:0/719020406 shutdown_connections 2024-09-22T08:38:29.420 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.418+0000 7fdf0c728800 1 --2- 172.21.15.142:0/719020406 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56296d919c30 0x56296d91c020 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:29.420 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.418+0000 7fdf0c728800 1 -- 172.21.15.142:0/719020406 >> 172.21.15.142:0/719020406 conn(0x56296d915360 msgr2=0x56296da06b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:38:29.420 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.418+0000 7fdf0c728800 1 -- 172.21.15.142:0/719020406 shutdown_connections 2024-09-22T08:38:29.420 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.418+0000 7fdf0c728800 1 -- 172.21.15.142:0/719020406 wait complete. 2024-09-22T08:38:29.420 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.418+0000 7fdf0c728800 1 Processor -- start 2024-09-22T08:38:29.420 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.418+0000 7fdf0c728800 1 -- start start 2024-09-22T08:38:29.421 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.418+0000 7fdf0c728800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56296d919c30 0x56296da14da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:29.421 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.418+0000 7fdf0c728800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x56296d922870 con 0x56296d919c30 2024-09-22T08:38:29.421 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.418+0000 7fdf0844b640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56296d919c30 0x56296da14da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:29.421 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.418+0000 7fdf0844b640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56296d919c30 0x56296da14da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:51610/0 (socket says 172.21.15.142:51610) 2024-09-22T08:38:29.421 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.418+0000 7fdf0844b640 1 -- 172.21.15.142:0/2162090127 learned_addr learned my addr 172.21.15.142:0/2162090127 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:38:29.422 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.418+0000 7fdf0844b640 1 -- 172.21.15.142:0/2162090127 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56296da15300 con 0x56296d919c30 2024-09-22T08:38:29.422 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.418+0000 7fdf0844b640 1 --2- 172.21.15.142:0/2162090127 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56296d919c30 0x56296da14da0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fdef80460d0 tx=0x7fdef8002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:29.422 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.418+0000 7fddf4e09640 1 -- 172.21.15.142:0/2162090127 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdef8073020 con 0x56296d919c30 2024-09-22T08:38:29.422 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.418+0000 7fddf4e09640 1 -- 172.21.15.142:0/2162090127 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdef806f580 con 0x56296d919c30 2024-09-22T08:38:29.423 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.418+0000 7fddf4e09640 1 -- 172.21.15.142:0/2162090127 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdef806f8a0 con 0x56296d919c30 2024-09-22T08:38:29.423 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.419+0000 7fdf0c728800 1 -- 172.21.15.142:0/2162090127 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56296da15590 con 0x56296d919c30 2024-09-22T08:38:29.423 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.419+0000 7fdf0c728800 1 -- 172.21.15.142:0/2162090127 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56296da161a0 con 0x56296d919c30 2024-09-22T08:38:29.423 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.419+0000 7fddf4e09640 1 -- 172.21.15.142:0/2162090127 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fdef8076020 con 0x56296d919c30 2024-09-22T08:38:29.423 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.420+0000 7fddf4e09640 1 --2- 172.21.15.142:0/2162090127 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fddf003d000 0x7fddf003f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:29.423 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.420+0000 7fddf4e09640 1 -- 172.21.15.142:0/2162090127 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5938+0+0 (secure 0 0 0) 0x7fdef806b040 con 0x56296d919c30 2024-09-22T08:38:29.423 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.420+0000 7fdf07c4a640 1 --2- 172.21.15.142:0/2162090127 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fddf003d000 0x7fddf003f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:29.423 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.420+0000 7fdf0c728800 1 --2- 172.21.15.142:0/2162090127 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x56296d91e8a0 0x56296da1c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:29.425 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.420+0000 7fdf0c728800 1 -- 172.21.15.142:0/2162090127 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56296da1c930 con 0x56296d91e8a0 2024-09-22T08:38:29.425 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.420+0000 7fdf08c4c640 1 --2- 172.21.15.142:0/2162090127 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x56296d91e8a0 0x56296da1c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:29.425 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.420+0000 7fdf07c4a640 1 --2- 172.21.15.142:0/2162090127 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fddf003d000 0x7fddf003f4c0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fdefc001e30 tx=0x7fdefc001390 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:29.425 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.420+0000 7fdf08c4c640 1 --2- 172.21.15.142:0/2162090127 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x56296d91e8a0 0x56296da1c3f0 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:29.431 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.420+0000 7fdf08c4c640 1 -- 172.21.15.142:0/2162090127 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdf0000a4d0 con 0x56296d91e8a0 2024-09-22T08:38:29.431 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.421+0000 7fdf0c728800 1 -- 172.21.15.142:0/2162090127 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56296da1ccd0 con 0x56296d91e8a0 2024-09-22T08:38:29.431 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.421+0000 7fdf08c4c640 1 -- 172.21.15.142:0/2162090127 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fdf0000a4d0 con 0x56296d91e8a0 2024-09-22T08:38:29.431 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.421+0000 7fdf0c728800 1 --2- 172.21.15.142:0/2162090127 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x56296da1e7d0 0x56296da20c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:29.431 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.421+0000 7fdf0c728800 1 -- 172.21.15.142:0/2162090127 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:3 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56296da21400 con 0x56296da1e7d0 2024-09-22T08:38:29.431 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.421+0000 7fdf0844b640 1 --2- 172.21.15.142:0/2162090127 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x56296da1e7d0 0x56296da20c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:29.432 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.421+0000 7fdf0844b640 1 --2- 172.21.15.142:0/2162090127 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x56296da1e7d0 0x56296da20c70 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:29.432 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.421+0000 7fdf0844b640 1 -- 172.21.15.142:0/2162090127 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(3 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fdef8057030 con 0x56296da1e7d0 2024-09-22T08:38:29.432 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.422+0000 7fdf0c728800 1 -- 172.21.15.142:0/2162090127 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56296da1d520 con 0x56296d91e8a0 2024-09-22T08:38:29.432 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.422+0000 7fdf08c4c640 1 -- 172.21.15.142:0/2162090127 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fdf0000a4d0 con 0x56296d91e8a0 2024-09-22T08:38:29.432 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.422+0000 7fdf0c728800 1 -- 172.21.15.142:0/2162090127 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56296da1d980 con 0x56296da1e7d0 2024-09-22T08:38:29.432 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.422+0000 7fdf0844b640 1 -- 172.21.15.142:0/2162090127 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(5 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fdef8057030 con 0x56296da1e7d0 2024-09-22T08:38:29.432 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.422+0000 7fdf0c728800 1 Processor -- start 2024-09-22T08:38:29.432 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.423+0000 7fdf0c728800 1 -- start start 2024-09-22T08:38:29.432 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.423+0000 7fdf0c728800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56296da2fdc0 0x56296da301e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:29.432 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.423+0000 7fdf0c728800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x56296d812d50 con 0x56296da2fdc0 2024-09-22T08:38:29.432 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.423+0000 7fdf08c4c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56296da2fdc0 0x56296da301e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:29.433 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.423+0000 7fdf08c4c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56296da2fdc0 0x56296da301e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:51620/0 (socket says 172.21.15.142:51620) 2024-09-22T08:38:29.433 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.423+0000 7fdf08c4c640 1 -- 172.21.15.142:0/3730819168 learned_addr learned my addr 172.21.15.142:0/3730819168 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:38:29.433 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.423+0000 7fdf08c4c640 1 -- 172.21.15.142:0/3730819168 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56296da30820 con 0x56296da2fdc0 2024-09-22T08:38:29.433 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.424+0000 7fdf08c4c640 1 --2- 172.21.15.142:0/3730819168 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56296da2fdc0 0x56296da301e0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x56296da15da0 tx=0x7fdf000167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:29.433 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.424+0000 7fddedffb640 1 -- 172.21.15.142:0/3730819168 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdf00013640 con 0x56296da2fdc0 2024-09-22T08:38:29.433 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.424+0000 7fddedffb640 1 -- 172.21.15.142:0/3730819168 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf000137e0 con 0x56296da2fdc0 2024-09-22T08:38:29.433 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.424+0000 7fdf0c728800 1 -- 172.21.15.142:0/3730819168 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56296da31050 con 0x56296da2fdc0 2024-09-22T08:38:29.433 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.424+0000 7fddedffb640 1 -- 172.21.15.142:0/3730819168 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdf00013ae0 con 0x56296da2fdc0 2024-09-22T08:38:29.433 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.424+0000 7fdf0c728800 1 -- 172.21.15.142:0/3730819168 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56296da315f0 con 0x56296da2fdc0 2024-09-22T08:38:29.433 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.425+0000 7fddedffb640 1 -- 172.21.15.142:0/3730819168 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fdf00011040 con 0x56296da2fdc0 2024-09-22T08:38:29.433 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.425+0000 7fddedffb640 1 --2- 172.21.15.142:0/3730819168 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fdde003cfb0 0x7fdde003f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:29.433 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.425+0000 7fddedffb640 1 -- 172.21.15.142:0/3730819168 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5938+0+0 (secure 0 0 0) 0x7fdf0000e040 con 0x56296da2fdc0 2024-09-22T08:38:29.433 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.425+0000 7fdf0844b640 1 --2- 172.21.15.142:0/3730819168 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fdde003cfb0 0x7fdde003f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:29.433 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.425+0000 7fdf0c728800 1 Processor -- start 2024-09-22T08:38:29.434 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.425+0000 7fdf0844b640 1 --2- 172.21.15.142:0/3730819168 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fdde003cfb0 0x7fdde003f470 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fdef8096a70 tx=0x7fdef8067040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:29.434 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.425+0000 7fdf0c728800 1 -- start start 2024-09-22T08:38:29.434 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.426+0000 7fdf0c728800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56296da3c8c0 0x56296da3ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:29.434 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.426+0000 7fdf0c728800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x56296d91a9b0 con 0x56296da3c8c0 2024-09-22T08:38:29.434 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.426+0000 7fdf08c4c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56296da3c8c0 0x56296da3ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:29.434 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.426+0000 7fdf08c4c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56296da3c8c0 0x56296da3ccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:51632/0 (socket says 172.21.15.142:51632) 2024-09-22T08:38:29.434 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.426+0000 7fdf08c4c640 1 -- 172.21.15.142:0/3099255327 learned_addr learned my addr 172.21.15.142:0/3099255327 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:38:29.434 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.426+0000 7fdf08c4c640 1 -- 172.21.15.142:0/3099255327 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56296da3d2b0 con 0x56296da3c8c0 2024-09-22T08:38:29.434 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.426+0000 7fdf08c4c640 1 --2- 172.21.15.142:0/3099255327 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56296da3c8c0 0x56296da3ccc0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7fdf00020000 tx=0x7fdf0001f400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59df461dbb6d0175 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:29.434 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.426+0000 7fdde77fe640 1 -- 172.21.15.142:0/3099255327 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdf00056200 con 0x56296da3c8c0 2024-09-22T08:38:29.434 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.426+0000 7fdde77fe640 1 -- 172.21.15.142:0/3099255327 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf00052070 con 0x56296da3c8c0 2024-09-22T08:38:29.434 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.426+0000 7fdde77fe640 1 -- 172.21.15.142:0/3099255327 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdf00021a90 con 0x56296da3c8c0 2024-09-22T08:38:29.434 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.427+0000 7fdf0c728800 1 -- 172.21.15.142:0/3099255327 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56296da3c8c0 msgr2=0x56296da3ccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:29.434 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.427+0000 7fdf0c728800 1 --2- 172.21.15.142:0/3099255327 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56296da3c8c0 0x56296da3ccc0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7fdf00020000 tx=0x7fdf0001f400 comp rx=0 tx=0).stop 2024-09-22T08:38:29.435 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.427+0000 7fdf0c728800 1 -- 172.21.15.142:0/3099255327 shutdown_connections 2024-09-22T08:38:29.435 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.427+0000 7fdf0c728800 1 --2- 172.21.15.142:0/3099255327 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56296da3c8c0 0x56296da3ccc0 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:29.435 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.427+0000 7fdf0c728800 1 -- 172.21.15.142:0/3099255327 >> 172.21.15.142:0/3099255327 conn(0x56296da38cc0 msgr2=0x56296da36f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:38:29.435 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.427+0000 7fdf0c728800 1 -- 172.21.15.142:0/3099255327 shutdown_connections 2024-09-22T08:38:29.435 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.427+0000 7fdf0c728800 1 -- 172.21.15.142:0/3099255327 wait complete. 2024-09-22T08:38:29.435 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.427+0000 7fdf0c728800 1 Processor -- start 2024-09-22T08:38:29.435 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.427+0000 7fdf0c728800 1 -- start start 2024-09-22T08:38:29.435 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.427+0000 7fdf0c728800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56296da3c8c0 0x56296da43e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:29.435 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.427+0000 7fdf0c728800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x56296da3d8d0 con 0x56296da3c8c0 2024-09-22T08:38:29.435 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.428+0000 7fdf08c4c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56296da3c8c0 0x56296da43e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:29.435 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.428+0000 7fdf08c4c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56296da3c8c0 0x56296da43e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:51638/0 (socket says 172.21.15.142:51638) 2024-09-22T08:38:29.435 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.428+0000 7fdf08c4c640 1 -- 172.21.15.142:0/1311789358 learned_addr learned my addr 172.21.15.142:0/1311789358 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:38:29.435 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.428+0000 7fdf08c4c640 1 -- 172.21.15.142:0/1311789358 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56296da443c0 con 0x56296da3c8c0 2024-09-22T08:38:29.435 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.428+0000 7fdf08c4c640 1 --2- 172.21.15.142:0/1311789358 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56296da3c8c0 0x56296da43e60 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7fdf000208e0 tx=0x7fdf00054860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:29.435 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.428+0000 7fdde5ffb640 1 -- 172.21.15.142:0/1311789358 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdf00053270 con 0x56296da3c8c0 2024-09-22T08:38:29.436 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.428+0000 7fdf0c728800 1 -- 172.21.15.142:0/1311789358 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56296da44650 con 0x56296da3c8c0 2024-09-22T08:38:29.436 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.428+0000 7fdde5ffb640 1 -- 172.21.15.142:0/1311789358 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf00053410 con 0x56296da3c8c0 2024-09-22T08:38:29.436 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.428+0000 7fdde5ffb640 1 -- 172.21.15.142:0/1311789358 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdf0001fa90 con 0x56296da3c8c0 2024-09-22T08:38:29.436 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.428+0000 7fdf0c728800 1 -- 172.21.15.142:0/1311789358 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56296da44fd0 con 0x56296da3c8c0 2024-09-22T08:38:29.436 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.429+0000 7fdde5ffb640 1 -- 172.21.15.142:0/1311789358 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fdf0001fc30 con 0x56296da3c8c0 2024-09-22T08:38:29.448 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.429+0000 7fdde5ffb640 1 --2- 172.21.15.142:0/1311789358 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fddd803cfb0 0x7fddd803f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:29.448 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.430+0000 7fdde5ffb640 1 -- 172.21.15.142:0/1311789358 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5938+0+0 (secure 0 0 0) 0x7fdf0004c030 con 0x56296da3c8c0 2024-09-22T08:38:29.449 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.430+0000 7fdf0844b640 1 --2- 172.21.15.142:0/1311789358 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fddd803cfb0 0x7fddd803f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:29.449 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.430+0000 7fdf0844b640 1 --2- 172.21.15.142:0/1311789358 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fddd803cfb0 0x7fddd803f470 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x56296da16ea0 tx=0x7fdef8086000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:29.449 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.430+0000 7fdf0c728800 20 rados->read ofs=0 len=0 2024-09-22T08:38:29.449 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.430+0000 7fdf0c728800 1 --2- 172.21.15.142:0/1311789358 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x56296da4f820 0x56296da51ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:29.449 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.430+0000 7fdf0c728800 1 -- 172.21.15.142:0/1311789358 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56296da52430 con 0x56296da4f820 2024-09-22T08:38:29.449 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.430+0000 7fdf07c4a640 1 --2- 172.21.15.142:0/1311789358 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x56296da4f820 0x56296da51ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:29.449 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.430+0000 7fdf07c4a640 1 --2- 172.21.15.142:0/1311789358 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x56296da4f820 0x56296da51ce0 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:29.449 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.431+0000 7fdf07c4a640 1 -- 172.21.15.142:0/1311789358 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdefc00f610 con 0x56296da4f820 2024-09-22T08:38:29.449 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.431+0000 7fdf0c728800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:29.449 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.431+0000 7fdf0c728800 20 realm 2024-09-22T08:38:29.449 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.431+0000 7fdf0c728800 20 rados->read ofs=0 len=0 2024-09-22T08:38:29.449 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.431+0000 7fdf0c728800 1 -- 172.21.15.142:0/1311789358 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56296da4ebb0 con 0x56296da4f820 2024-09-22T08:38:29.449 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.431+0000 7fdf07c4a640 1 -- 172.21.15.142:0/1311789358 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdefc00f610 con 0x56296da4f820 2024-09-22T08:38:29.449 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.431+0000 7fdf0c728800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:29.450 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.431+0000 7fdf0c728800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:38:29.450 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.431+0000 7fdf0c728800 20 rados->read ofs=0 len=0 2024-09-22T08:38:29.450 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.431+0000 7fdf0c728800 1 -- 172.21.15.142:0/1311789358 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56296da52f20 con 0x56296da4f820 2024-09-22T08:38:29.450 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.431+0000 7fdf07c4a640 1 -- 172.21.15.142:0/1311789358 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdefc00f610 con 0x56296da4f820 2024-09-22T08:38:29.450 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.431+0000 7fdf0c728800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:29.450 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.431+0000 7fdf0c728800 20 rados->read ofs=0 len=0 2024-09-22T08:38:29.450 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.431+0000 7fdf0c728800 1 -- 172.21.15.142:0/1311789358 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56296da537f0 con 0x56296da4f820 2024-09-22T08:38:29.450 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.431+0000 7fdf07c4a640 1 -- 172.21.15.142:0/1311789358 <== osd.1 v2:172.21.15.142:6816/3192108003 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fdefc00f610 con 0x56296da4f820 2024-09-22T08:38:29.450 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.431+0000 7fdf0c728800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:38:29.450 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.431+0000 7fdf0c728800 20 rados->read ofs=0 len=0 2024-09-22T08:38:29.450 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.431+0000 7fdf0c728800 1 --2- 172.21.15.142:0/1311789358 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x56296da54210 0x56296da56600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:29.450 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.431+0000 7fdf0c728800 1 -- 172.21.15.142:0/1311789358 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56296da56d40 con 0x56296da54210 2024-09-22T08:38:29.451 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.432+0000 7fdf08c4c640 1 --2- 172.21.15.142:0/1311789358 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x56296da54210 0x56296da56600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:29.451 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.432+0000 7fdf08c4c640 1 --2- 172.21.15.142:0/1311789358 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x56296da54210 0x56296da56600 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:29.451 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.432+0000 7fdf08c4c640 1 -- 172.21.15.142:0/1311789358 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(5 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fdf0003a070 con 0x56296da54210 2024-09-22T08:38:29.451 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.432+0000 7fdf0c728800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:38:29.451 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.432+0000 7fdf0c728800 20 searching for the correct realm 2024-09-22T08:38:29.451 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.432+0000 7fdf0c728800 1 -- 172.21.15.142:0/1311789358 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56296da58670 con 0x56296da54210 2024-09-22T08:38:29.451 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.432+0000 7fdf08c4c640 1 -- 172.21.15.142:0/1311789358 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdf0003a070 con 0x56296da54210 2024-09-22T08:38:29.451 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.432+0000 7fdf08c4c640 1 --2- 172.21.15.142:0/1311789358 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7fdf00012ae0 0x7fdf00045510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:29.451 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.432+0000 7fdf08c4c640 1 -- 172.21.15.142:0/1311789358 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56296da58670 con 0x7fdf00012ae0 2024-09-22T08:38:29.451 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.432+0000 7fdf0844b640 1 --2- 172.21.15.142:0/1311789358 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7fdf00012ae0 0x7fdf00045510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:29.451 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.433+0000 7fdf0844b640 1 --2- 172.21.15.142:0/1311789358 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7fdf00012ae0 0x7fdf00045510 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:29.452 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.433+0000 7fdf0844b640 1 -- 172.21.15.142:0/1311789358 <== osd.2 v2:172.21.15.142:6808/279438927 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdef8057030 con 0x7fdf00012ae0 2024-09-22T08:38:29.452 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.433+0000 7fdf0844b640 1 --2- 172.21.15.142:0/1311789358 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7fdef8082040 0x7fdef808f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:29.452 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.433+0000 7fdf0844b640 1 -- 172.21.15.142:0/1311789358 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56296da58670 con 0x7fdef8082040 2024-09-22T08:38:29.452 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.433+0000 7fdf07c4a640 1 --2- 172.21.15.142:0/1311789358 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7fdef8082040 0x7fdef808f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:29.452 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.434+0000 7fdf07c4a640 1 --2- 172.21.15.142:0/1311789358 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7fdef8082040 0x7fdef808f040 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:29.452 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.434+0000 7fdf07c4a640 1 -- 172.21.15.142:0/1311789358 <== osd.0 v2:172.21.15.31:6800/168281188 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdefc00f610 con 0x7fdef8082040 2024-09-22T08:38:29.452 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.434+0000 7fdf07c4a640 1 -- 172.21.15.142:0/1311789358 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56296da58670 con 0x56296da4f820 2024-09-22T08:38:29.452 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.434+0000 7fdf07c4a640 1 -- 172.21.15.142:0/1311789358 <== osd.1 v2:172.21.15.142:6816/3192108003 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdefc00f610 con 0x56296da4f820 2024-09-22T08:38:29.452 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.434+0000 7fdf07c4a640 1 -- 172.21.15.142:0/1311789358 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56296da58670 con 0x56296da4f820 2024-09-22T08:38:29.452 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.435+0000 7fdf07c4a640 1 -- 172.21.15.142:0/1311789358 <== osd.1 v2:172.21.15.142:6816/3192108003 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdefc02b040 con 0x56296da4f820 2024-09-22T08:38:29.452 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.435+0000 7fdf07c4a640 1 -- 172.21.15.142:0/1311789358 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56296da58670 con 0x56296da4f820 2024-09-22T08:38:29.452 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.435+0000 7fdf07c4a640 1 -- 172.21.15.142:0/1311789358 <== osd.1 v2:172.21.15.142:6816/3192108003 7 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdefc02b040 con 0x56296da4f820 2024-09-22T08:38:29.452 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.435+0000 7fdf07c4a640 1 -- 172.21.15.142:0/1311789358 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56296da58670 con 0x7fdef8082040 2024-09-22T08:38:29.453 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.435+0000 7fdf07c4a640 1 -- 172.21.15.142:0/1311789358 <== osd.0 v2:172.21.15.31:6800/168281188 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdefc02b040 con 0x7fdef8082040 2024-09-22T08:38:29.453 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.435+0000 7fdf07c4a640 1 -- 172.21.15.142:0/1311789358 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56296da58670 con 0x7fdf00012ae0 2024-09-22T08:38:29.453 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.435+0000 7fdf0844b640 1 -- 172.21.15.142:0/1311789358 <== osd.2 v2:172.21.15.142:6808/279438927 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdef8057030 con 0x7fdf00012ae0 2024-09-22T08:38:29.453 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.435+0000 7fdf0844b640 1 -- 172.21.15.142:0/1311789358 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56296da58670 con 0x56296da54210 2024-09-22T08:38:29.453 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.436+0000 7fdf08c4c640 1 -- 172.21.15.142:0/1311789358 <== osd.3 v2:172.21.15.142:6800/1064901393 3 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdf0003a070 con 0x56296da54210 2024-09-22T08:38:29.453 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.436+0000 7fdf08c4c640 1 -- 172.21.15.142:0/1311789358 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56296da58670 con 0x56296da4f820 2024-09-22T08:38:29.453 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.436+0000 7fdf07c4a640 1 -- 172.21.15.142:0/1311789358 <== osd.1 v2:172.21.15.142:6816/3192108003 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdefc02b040 con 0x56296da4f820 2024-09-22T08:38:29.453 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.436+0000 7fdf07c4a640 1 -- 172.21.15.142:0/1311789358 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56296da58670 con 0x7fdef8082040 2024-09-22T08:38:29.453 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.436+0000 7fdf07c4a640 1 -- 172.21.15.142:0/1311789358 <== osd.0 v2:172.21.15.31:6800/168281188 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdefc02b040 con 0x7fdef8082040 2024-09-22T08:38:29.453 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.436+0000 7fdf07c4a640 1 -- 172.21.15.142:0/1311789358 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56296da58670 con 0x56296da4f820 2024-09-22T08:38:29.453 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.436+0000 7fdf07c4a640 1 -- 172.21.15.142:0/1311789358 <== osd.1 v2:172.21.15.142:6816/3192108003 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdefc02b040 con 0x56296da4f820 2024-09-22T08:38:29.453 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.437+0000 7fdf07c4a640 1 -- 172.21.15.142:0/1311789358 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56296da58670 con 0x7fdf00012ae0 2024-09-22T08:38:29.453 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.437+0000 7fdf0844b640 1 -- 172.21.15.142:0/1311789358 <== osd.2 v2:172.21.15.142:6808/279438927 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fdef8057030 con 0x7fdf00012ae0 2024-09-22T08:38:29.453 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.437+0000 7fdf0844b640 1 -- 172.21.15.142:0/1311789358 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56296da58670 con 0x56296da54210 2024-09-22T08:38:29.454 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.437+0000 7fdf08c4c640 1 -- 172.21.15.142:0/1311789358 <== osd.3 v2:172.21.15.142:6800/1064901393 4 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdf0003a070 con 0x56296da54210 2024-09-22T08:38:29.454 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.437+0000 7fdf08c4c640 1 -- 172.21.15.142:0/1311789358 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56296da58670 con 0x56296da54210 2024-09-22T08:38:29.454 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.437+0000 7fdf08c4c640 1 -- 172.21.15.142:0/1311789358 <== osd.3 v2:172.21.15.142:6800/1064901393 5 ==== osd_op_reply(20 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fdf0003a070 con 0x56296da54210 2024-09-22T08:38:29.454 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.437+0000 7fdf08c4c640 1 -- 172.21.15.142:0/1311789358 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56296da58670 con 0x7fdef8082040 2024-09-22T08:38:29.454 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.438+0000 7fdf07c4a640 1 -- 172.21.15.142:0/1311789358 <== osd.0 v2:172.21.15.31:6800/168281188 4 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdefc02b040 con 0x7fdef8082040 2024-09-22T08:38:29.454 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.438+0000 7fdf07c4a640 1 -- 172.21.15.142:0/1311789358 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56296da58670 con 0x56296da54210 2024-09-22T08:38:29.454 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.438+0000 7fdf08c4c640 1 -- 172.21.15.142:0/1311789358 <== osd.3 v2:172.21.15.142:6800/1064901393 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdf0003a070 con 0x56296da54210 2024-09-22T08:38:29.454 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.438+0000 7fdf08c4c640 1 -- 172.21.15.142:0/1311789358 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56296da58670 con 0x56296da54210 2024-09-22T08:38:29.454 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.438+0000 7fdf08c4c640 1 -- 172.21.15.142:0/1311789358 <== osd.3 v2:172.21.15.142:6800/1064901393 7 ==== osd_op_reply(23 [pgnls start_epoch 32 out=107b] v32'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fdf0003a070 con 0x56296da54210 2024-09-22T08:38:29.454 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.438+0000 7fdf08c4c640 1 -- 172.21.15.142:0/1311789358 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56296da58670 con 0x56296da4f820 2024-09-22T08:38:29.454 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.438+0000 7fdf07c4a640 1 -- 172.21.15.142:0/1311789358 <== osd.1 v2:172.21.15.142:6816/3192108003 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdefc02b040 con 0x56296da4f820 2024-09-22T08:38:29.454 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.438+0000 7fdf07c4a640 1 -- 172.21.15.142:0/1311789358 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56296da58670 con 0x56296da4f820 2024-09-22T08:38:29.454 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.438+0000 7fdf07c4a640 1 -- 172.21.15.142:0/1311789358 <== osd.1 v2:172.21.15.142:6816/3192108003 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v32'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fdefc02b040 con 0x56296da4f820 2024-09-22T08:38:29.454 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.438+0000 7fdf07c4a640 1 -- 172.21.15.142:0/1311789358 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56296da58670 con 0x7fdef8082040 2024-09-22T08:38:29.455 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.439+0000 7fdf07c4a640 1 -- 172.21.15.142:0/1311789358 <== osd.0 v2:172.21.15.31:6800/168281188 5 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdefc02b040 con 0x7fdef8082040 2024-09-22T08:38:29.455 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.439+0000 7fdf07c4a640 1 -- 172.21.15.142:0/1311789358 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56296da58670 con 0x56296da54210 2024-09-22T08:38:29.455 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.439+0000 7fdf08c4c640 1 -- 172.21.15.142:0/1311789358 <== osd.3 v2:172.21.15.142:6800/1064901393 8 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdf0003a070 con 0x56296da54210 2024-09-22T08:38:29.455 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.439+0000 7fdf08c4c640 1 -- 172.21.15.142:0/1311789358 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56296da58670 con 0x7fdf00012ae0 2024-09-22T08:38:29.455 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.439+0000 7fdf0844b640 1 -- 172.21.15.142:0/1311789358 <== osd.2 v2:172.21.15.142:6808/279438927 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdef8057030 con 0x7fdf00012ae0 2024-09-22T08:38:29.455 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.439+0000 7fdf0844b640 1 -- 172.21.15.142:0/1311789358 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56296da58670 con 0x56296da4f820 2024-09-22T08:38:29.455 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.439+0000 7fdf07c4a640 1 -- 172.21.15.142:0/1311789358 <== osd.1 v2:172.21.15.142:6816/3192108003 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdefc02b040 con 0x56296da4f820 2024-09-22T08:38:29.455 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.440+0000 7fdf07c4a640 1 -- 172.21.15.142:0/1311789358 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56296da58670 con 0x7fdef8082040 2024-09-22T08:38:29.455 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.440+0000 7fdf07c4a640 1 -- 172.21.15.142:0/1311789358 <== osd.0 v2:172.21.15.31:6800/168281188 6 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdefc03b040 con 0x7fdef8082040 2024-09-22T08:38:29.455 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.440+0000 7fdf07c4a640 1 -- 172.21.15.142:0/1311789358 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56296da58670 con 0x56296da54210 2024-09-22T08:38:29.455 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.440+0000 7fdf08c4c640 1 -- 172.21.15.142:0/1311789358 <== osd.3 v2:172.21.15.142:6800/1064901393 9 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdf0003a070 con 0x56296da54210 2024-09-22T08:38:29.455 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.440+0000 7fdf08c4c640 1 -- 172.21.15.142:0/1311789358 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56296da58670 con 0x7fdef8082040 2024-09-22T08:38:29.455 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.440+0000 7fdf07c4a640 1 -- 172.21.15.142:0/1311789358 <== osd.0 v2:172.21.15.31:6800/168281188 7 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdefc03b040 con 0x7fdef8082040 2024-09-22T08:38:29.455 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.440+0000 7fdf07c4a640 1 -- 172.21.15.142:0/1311789358 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56296da58670 con 0x7fdf00012ae0 2024-09-22T08:38:29.455 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.441+0000 7fdf0844b640 1 -- 172.21.15.142:0/1311789358 <== osd.2 v2:172.21.15.142:6808/279438927 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdef8057030 con 0x7fdf00012ae0 2024-09-22T08:38:29.456 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.441+0000 7fdf0844b640 1 -- 172.21.15.142:0/1311789358 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56296da58670 con 0x56296da54210 2024-09-22T08:38:29.456 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.441+0000 7fdf08c4c640 1 -- 172.21.15.142:0/1311789358 <== osd.3 v2:172.21.15.142:6800/1064901393 10 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdf0003a070 con 0x56296da54210 2024-09-22T08:38:29.456 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.441+0000 7fdf08c4c640 1 -- 172.21.15.142:0/1311789358 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56296da58670 con 0x7fdef8082040 2024-09-22T08:38:29.456 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.441+0000 7fdf07c4a640 1 -- 172.21.15.142:0/1311789358 <== osd.0 v2:172.21.15.31:6800/168281188 8 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdefc03b040 con 0x7fdef8082040 2024-09-22T08:38:29.456 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.441+0000 7fdf07c4a640 1 -- 172.21.15.142:0/1311789358 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56296da58670 con 0x56296da4f820 2024-09-22T08:38:29.456 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.442+0000 7fdf07c4a640 1 -- 172.21.15.142:0/1311789358 <== osd.1 v2:172.21.15.142:6816/3192108003 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v32'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fdefc03b040 con 0x56296da4f820 2024-09-22T08:38:29.456 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.442+0000 7fdf07c4a640 1 -- 172.21.15.142:0/1311789358 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56296da58670 con 0x7fdf00012ae0 2024-09-22T08:38:29.456 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.442+0000 7fdf0844b640 1 -- 172.21.15.142:0/1311789358 <== osd.2 v2:172.21.15.142:6808/279438927 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdef8057030 con 0x7fdf00012ae0 2024-09-22T08:38:29.456 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.442+0000 7fdf0c728800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:38:29.456 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.442+0000 7fdf0c728800 20 RGWRados::pool_iterate: got zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec 2024-09-22T08:38:29.456 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.442+0000 7fdf0c728800 20 RGWRados::pool_iterate: got zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f 2024-09-22T08:38:29.456 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.442+0000 7fdf0c728800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:38:29.456 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.442+0000 7fdf0c728800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:38:29.456 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.442+0000 7fdf0c728800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:38:29.456 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.442+0000 7fdf0c728800 20 rados->read ofs=0 len=0 2024-09-22T08:38:29.457 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.442+0000 7fdf0c728800 1 -- 172.21.15.142:0/1311789358 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56296da57730 con 0x56296da4f820 2024-09-22T08:38:29.457 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.442+0000 7fdf07c4a640 1 -- 172.21.15.142:0/1311789358 <== osd.1 v2:172.21.15.142:6816/3192108003 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdefc03b040 con 0x56296da4f820 2024-09-22T08:38:29.457 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.442+0000 7fdf0c728800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:29.457 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.442+0000 7fdf0c728800 20 rados->read ofs=0 len=0 2024-09-22T08:38:29.457 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.442+0000 7fdf0c728800 1 -- 172.21.15.142:0/1311789358 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56296da57f80 con 0x56296da4f820 2024-09-22T08:38:29.457 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.442+0000 7fdf07c4a640 1 -- 172.21.15.142:0/1311789358 <== osd.1 v2:172.21.15.142:6816/3192108003 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fdefc03b040 con 0x56296da4f820 2024-09-22T08:38:29.457 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.442+0000 7fdf0c728800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:38:29.457 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.442+0000 7fdf0c728800 20 rados->read ofs=0 len=0 2024-09-22T08:38:29.457 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.442+0000 7fdf0c728800 1 -- 172.21.15.142:0/1311789358 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:40 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56296da58af0 con 0x56296da54210 2024-09-22T08:38:29.457 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.443+0000 7fdf08c4c640 1 -- 172.21.15.142:0/1311789358 <== osd.3 v2:172.21.15.142:6800/1064901393 11 ==== osd_op_reply(40 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fdf0003a070 con 0x56296da54210 2024-09-22T08:38:29.457 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.443+0000 7fdf0c728800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:38:29.457 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.443+0000 7fdf0c728800 20 zone default found 2024-09-22T08:38:29.457 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.443+0000 7fdf0c728800 4 Realm: () 2024-09-22T08:38:29.457 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.443+0000 7fdf0c728800 4 ZoneGroup: default (d89f6f57-1007-47dd-9065-f486c7b01aec) 2024-09-22T08:38:29.457 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.443+0000 7fdf0c728800 4 Zone: default (e239248c-0bee-4e41-803a-24b288d3eb8f) 2024-09-22T08:38:29.458 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.443+0000 7fdf0c728800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:38:29.458 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.443+0000 7fdf0c728800 20 zonegroup default 2024-09-22T08:38:29.458 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.443+0000 7fdf0c728800 20 rados->read ofs=0 len=0 2024-09-22T08:38:29.458 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.443+0000 7fdf0c728800 1 -- 172.21.15.142:0/1311789358 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56296da58ed0 con 0x7fdef8082040 2024-09-22T08:38:29.458 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.443+0000 7fdf07c4a640 1 -- 172.21.15.142:0/1311789358 <== osd.0 v2:172.21.15.31:6800/168281188 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fdefc03b040 con 0x7fdef8082040 2024-09-22T08:38:29.458 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.443+0000 7fdf0c728800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:29.458 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.443+0000 7fdf0c728800 20 rados->read ofs=0 len=0 2024-09-22T08:38:29.458 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.443+0000 7fdf0c728800 1 -- 172.21.15.142:0/1311789358 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56296da5ad00 con 0x56296da54210 2024-09-22T08:38:29.458 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.443+0000 7fdf08c4c640 1 -- 172.21.15.142:0/1311789358 <== osd.3 v2:172.21.15.142:6800/1064901393 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fdf0003a070 con 0x56296da54210 2024-09-22T08:38:29.458 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.443+0000 7fdf0c728800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:29.458 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.443+0000 7fdf0c728800 20 rados->read ofs=0 len=0 2024-09-22T08:38:29.458 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.443+0000 7fdf0c728800 1 -- 172.21.15.142:0/1311789358 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56296da5b150 con 0x56296da54210 2024-09-22T08:38:29.458 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.443+0000 7fdf08c4c640 1 -- 172.21.15.142:0/1311789358 <== osd.3 v2:172.21.15.142:6800/1064901393 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fdf0003a070 con 0x56296da54210 2024-09-22T08:38:29.459 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.444+0000 7fdf0c728800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:29.459 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.444+0000 7fdf0c728800 20 started sync module instance, tier type = 2024-09-22T08:38:29.459 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.444+0000 7fdf0c728800 20 started zone id=e239248c-0bee-4e41-803a-24b288d3eb8f (name=default) with tier type = 2024-09-22T08:38:29.459 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.444+0000 7fdf0c728800 1 -- 172.21.15.142:0/1311789358 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56296da5a1a0 con 0x7fdf00012ae0 2024-09-22T08:38:29.459 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.445+0000 7fdf0844b640 1 -- 172.21.15.142:0/1311789358 <== osd.2 v2:172.21.15.142:6808/279438927 7 ==== osd_op_reply(44 notify.0 [create] v32'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdef8057030 con 0x7fdf00012ae0 2024-09-22T08:38:29.459 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.445+0000 7fdf0c728800 1 -- 172.21.15.142:0/1311789358 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94735933220240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56296da5ba60 con 0x7fdf00012ae0 2024-09-22T08:38:29.459 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.445+0000 7fdf0c728800 1 -- 172.21.15.142:0/1311789358 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56296da5c2b0 con 0x56296da4f820 2024-09-22T08:38:29.459 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.446+0000 7fdf0844b640 1 -- 172.21.15.142:0/1311789358 <== osd.2 v2:172.21.15.142:6808/279438927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94735933220240] v32'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdef8057030 con 0x7fdf00012ae0 2024-09-22T08:38:29.459 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.446+0000 7fdf07c4a640 1 -- 172.21.15.142:0/1311789358 <== osd.1 v2:172.21.15.142:6816/3192108003 16 ==== osd_op_reply(46 notify.1 [create] v32'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdefc03b040 con 0x56296da4f820 2024-09-22T08:38:29.459 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.446+0000 7fdf0c728800 1 -- 172.21.15.142:0/1311789358 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94735933224368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56296da5c310 con 0x56296da4f820 2024-09-22T08:38:29.459 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.446+0000 7fdf0c728800 1 -- 172.21.15.142:0/1311789358 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56296da5ce20 con 0x56296da54210 2024-09-22T08:38:29.465 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.447+0000 7fdf07c4a640 1 -- 172.21.15.142:0/1311789358 <== osd.1 v2:172.21.15.142:6816/3192108003 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94735933224368] v32'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdefc03b040 con 0x56296da4f820 2024-09-22T08:38:29.465 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.448+0000 7fdf08c4c640 1 -- 172.21.15.142:0/1311789358 <== osd.3 v2:172.21.15.142:6800/1064901393 14 ==== osd_op_reply(48 notify.2 [create] v32'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdf0003a070 con 0x56296da54210 2024-09-22T08:38:29.465 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.448+0000 7fdf0c728800 1 -- 172.21.15.142:0/1311789358 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94735933229264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56296da5cde0 con 0x56296da54210 2024-09-22T08:38:29.465 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.448+0000 7fdf0c728800 1 -- 172.21.15.142:0/1311789358 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56296da5d8b0 con 0x7fdf00012ae0 2024-09-22T08:38:29.465 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.449+0000 7fdf0844b640 1 -- 172.21.15.142:0/1311789358 <== osd.2 v2:172.21.15.142:6808/279438927 9 ==== osd_op_reply(50 notify.3 [create] v32'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdef8057030 con 0x7fdf00012ae0 2024-09-22T08:38:29.465 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.449+0000 7fdf0c728800 1 -- 172.21.15.142:0/1311789358 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94735933232096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56296da5e150 con 0x7fdf00012ae0 2024-09-22T08:38:29.465 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.449+0000 7fdf0c728800 1 -- 172.21.15.142:0/1311789358 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56296da5ec50 con 0x56296da4f820 2024-09-22T08:38:29.465 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.449+0000 7fdf08c4c640 1 -- 172.21.15.142:0/1311789358 <== osd.3 v2:172.21.15.142:6800/1064901393 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94735933229264] v32'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdf0003a070 con 0x56296da54210 2024-09-22T08:38:29.465 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.450+0000 7fdf07c4a640 1 -- 172.21.15.142:0/1311789358 <== osd.1 v2:172.21.15.142:6816/3192108003 18 ==== osd_op_reply(52 notify.4 [create] v32'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdefc03b040 con 0x56296da4f820 2024-09-22T08:38:29.465 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.450+0000 7fdf0844b640 1 -- 172.21.15.142:0/1311789358 <== osd.2 v2:172.21.15.142:6808/279438927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94735933232096] v32'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdef8057030 con 0x7fdf00012ae0 2024-09-22T08:38:29.465 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.450+0000 7fdf0c728800 1 -- 172.21.15.142:0/1311789358 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94735933237056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56296da5ec10 con 0x56296da4f820 2024-09-22T08:38:29.465 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.450+0000 7fdf0c728800 1 -- 172.21.15.142:0/1311789358 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56296da5dce0 con 0x7fdef8082040 2024-09-22T08:38:29.465 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.451+0000 7fdf07c4a640 1 -- 172.21.15.142:0/1311789358 <== osd.1 v2:172.21.15.142:6816/3192108003 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94735933237056] v32'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdefc03b040 con 0x56296da4f820 2024-09-22T08:38:29.466 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.451+0000 7fdf07c4a640 1 -- 172.21.15.142:0/1311789358 <== osd.0 v2:172.21.15.31:6800/168281188 10 ==== osd_op_reply(54 notify.5 [create] v32'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdefc03b040 con 0x7fdef8082040 2024-09-22T08:38:29.466 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.451+0000 7fdf0c728800 1 -- 172.21.15.142:0/1311789358 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94735933238288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56296da5f1b0 con 0x7fdef8082040 2024-09-22T08:38:29.466 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.451+0000 7fdf0c728800 1 -- 172.21.15.142:0/1311789358 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56296da5fbb0 con 0x7fdef8082040 2024-09-22T08:38:29.466 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.452+0000 7fdf07c4a640 1 -- 172.21.15.142:0/1311789358 <== osd.0 v2:172.21.15.31:6800/168281188 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94735933238288] v32'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdefc03b040 con 0x7fdef8082040 2024-09-22T08:38:29.466 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.452+0000 7fdf07c4a640 1 -- 172.21.15.142:0/1311789358 <== osd.0 v2:172.21.15.31:6800/168281188 12 ==== osd_op_reply(56 notify.6 [create] v32'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdefc03b040 con 0x7fdef8082040 2024-09-22T08:38:29.466 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.452+0000 7fdf0c728800 1 -- 172.21.15.142:0/1311789358 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94735933226496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56296da5fb70 con 0x7fdef8082040 2024-09-22T08:38:29.466 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.452+0000 7fdf0c728800 1 -- 172.21.15.142:0/1311789358 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56296da60570 con 0x7fdef8082040 2024-09-22T08:38:29.466 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.454+0000 7fdf07c4a640 1 -- 172.21.15.142:0/1311789358 <== osd.0 v2:172.21.15.31:6800/168281188 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94735933226496] v32'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdefc03b040 con 0x7fdef8082040 2024-09-22T08:38:29.466 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.454+0000 7fdf07c4a640 1 -- 172.21.15.142:0/1311789358 <== osd.0 v2:172.21.15.31:6800/168281188 14 ==== osd_op_reply(58 notify.7 [create] v32'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdefc03b040 con 0x7fdef8082040 2024-09-22T08:38:29.466 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.454+0000 7fdf0c728800 1 -- 172.21.15.142:0/1311789358 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94735933243520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56296da5fb70 con 0x7fdef8082040 2024-09-22T08:38:29.466 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.454+0000 7fdf0c728800 20 add_watcher() i=0 2024-09-22T08:38:29.466 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.454+0000 7fdf0c728800 20 add_watcher() i=1 2024-09-22T08:38:29.466 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.454+0000 7fdf0c728800 20 add_watcher() i=2 2024-09-22T08:38:29.466 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.454+0000 7fdf0c728800 20 add_watcher() i=3 2024-09-22T08:38:29.467 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.454+0000 7fdf0c728800 20 add_watcher() i=4 2024-09-22T08:38:29.467 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.454+0000 7fdf0c728800 20 add_watcher() i=5 2024-09-22T08:38:29.467 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.454+0000 7fdf0c728800 20 add_watcher() i=6 2024-09-22T08:38:29.467 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.455+0000 7fdf07c4a640 1 -- 172.21.15.142:0/1311789358 <== osd.0 v2:172.21.15.31:6800/168281188 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94735933243520] v32'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdefc03b040 con 0x7fdef8082040 2024-09-22T08:38:29.467 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.455+0000 7fdf0c728800 20 add_watcher() i=7 2024-09-22T08:38:29.467 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.455+0000 7fdf0c728800 2 all 8 watchers are set, enabling cache 2024-09-22T08:38:29.467 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.455+0000 7fdf0c728800 1 -- 172.21.15.142:0/1311789358 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56296da63a90 con 0x56296da4f820 2024-09-22T08:38:29.467 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.455+0000 7fdf07c4a640 1 -- 172.21.15.142:0/1311789358 <== osd.1 v2:172.21.15.142:6816/3192108003 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fdefc03b040 con 0x56296da4f820 2024-09-22T08:38:29.467 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.455+0000 7fdf0c728800 1 -- 172.21.15.142:0/1311789358 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94735933241952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56296da60df0 con 0x56296da4f820 2024-09-22T08:38:29.467 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.456+0000 7fdf07c4a640 1 -- 172.21.15.142:0/1311789358 <== osd.1 v2:172.21.15.142:6816/3192108003 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94735933241952] v32'240 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fdefc03b040 con 0x56296da4f820 2024-09-22T08:38:29.467 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.456+0000 7fddbe7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:38:29.467 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.456+0000 7fdf0c728800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:38:29.467 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.456+0000 7fdf0c728800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:38:29.467 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.456+0000 7fdf0c728800 5 note: GC not initialized 2024-09-22T08:38:29.468 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.456+0000 7fddbd7e2640 20 reqs_thread_entry: start 2024-09-22T08:38:29.468 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.457+0000 7fdf0c728800 20 init_complete bucket index max shards: 11 2024-09-22T08:38:29.468 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.457+0000 7fdf0c728800 20 Filter name: none 2024-09-22T08:38:29.468 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.457+0000 7fdd2effd640 20 reqs_thread_entry: start 2024-09-22T08:38:29.468 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.457+0000 7fdf0c728800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-22T08:38:29.468 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.457+0000 7fdf0c728800 20 rados->read ofs=0 len=0 2024-09-22T08:38:29.468 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.457+0000 7fdf0c728800 1 -- 172.21.15.142:0/1311789358 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56296da96ea0 con 0x7fdef8082040 2024-09-22T08:38:29.468 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.457+0000 7fdf07c4a640 1 -- 172.21.15.142:0/1311789358 <== osd.0 v2:172.21.15.31:6800/168281188 16 ==== osd_op_reply(62 ada [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7fdefc03b040 con 0x7fdef8082040 2024-09-22T08:38:29.468 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.457+0000 7fdf0c728800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:29.468 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.457+0000 7fdf0c728800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x0 2024-09-22T08:38:29.468 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.457+0000 7fdf0c728800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-22T08:38:29.468 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.457+0000 7fdf0c728800 10 cache get: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W : miss 2024-09-22T08:38:29.468 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.457+0000 7fdf0c728800 20 rados->read ofs=0 len=0 2024-09-22T08:38:29.468 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.457+0000 7fdf0c728800 1 -- 172.21.15.142:0/1311789358 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:63 8.18 8:1f190392:users.keys::MH1WC2XQ1S8UISFDZC8W:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56296da95400 con 0x56296da4f820 2024-09-22T08:38:29.469 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.458+0000 7fdf07c4a640 1 -- 172.21.15.142:0/1311789358 <== osd.1 v2:172.21.15.142:6816/3192108003 22 ==== osd_op_reply(63 MH1WC2XQ1S8UISFDZC8W [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7fdefc03b040 con 0x56296da4f820 2024-09-22T08:38:29.469 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.458+0000 7fdf0c728800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:29.469 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.458+0000 7fdf0c728800 10 cache put: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W info.flags=0x0 2024-09-22T08:38:29.469 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.458+0000 7fdf0c728800 10 adding default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W to cache LRU end 2024-09-22T08:38:29.469 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.458+0000 7fdf0c728800 10 cache get: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W : hit (negative entry) 2024-09-22T08:38:29.469 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.458+0000 7fdf0c728800 10 cache get: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W : hit (negative entry) 2024-09-22T08:38:29.469 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.458+0000 7fdf0c728800 1 -- 172.21.15.142:0/1311789358 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:64 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.set in=58b,writefull 0~473 in=473b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56296da95cd0 con 0x7fdef8082040 2024-09-22T08:38:29.469 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.459+0000 7fdf07c4a640 1 -- 172.21.15.142:0/1311789358 <== osd.0 v2:172.21.15.31:6800/168281188 17 ==== osd_op_reply(64 ada [delete,create,call,writefull 0~473] v32'3 uv3 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7fdefc03b040 con 0x7fdef8082040 2024-09-22T08:38:29.469 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.459+0000 7fdf0c728800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-22T08:38:29.469 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.459+0000 7fdf0c728800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-22T08:38:29.469 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.459+0000 7fdf0c728800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-22T08:38:29.469 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.459+0000 7fdf0c728800 1 -- 172.21.15.142:0/1311789358 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94735933462560 in=661b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56296da9a940 con 0x56296da4f820 2024-09-22T08:38:29.469 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.459+0000 7fdf07c4a640 1 -- 172.21.15.142:0/1311789358 <== osd.1 v2:172.21.15.142:6816/3192108003 23 ==== watch-notify(notify (1) cookie 94735933237056 notify 137438953491 ret 0) ==== 691+0+0 (crc 0 0 0) 0x56296da96070 con 0x56296da4f820 2024-09-22T08:38:29.469 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.459+0000 7fdde77fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953491 cookie 94735933237056 notifier 4828 bl.length()=649 2024-09-22T08:38:29.469 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.459+0000 7fdde77fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-22T08:38:29.470 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.459+0000 7fdde77fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-22T08:38:29.470 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.459+0000 7fdf07c4a640 1 -- 172.21.15.142:0/1311789358 <== osd.1 v2:172.21.15.142:6816/3192108003 24 ==== osd_op_reply(65 notify.4 [notify cookie 94735933462560 out=8b] v0'0 uv240 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fdefc03b040 con 0x56296da4f820 2024-09-22T08:38:29.470 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.459+0000 7fdde77fe640 1 -- 172.21.15.142:0/1311789358 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fddcc003ea0 con 0x56296da4f820 2024-09-22T08:38:29.470 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.459+0000 7fdf07c4a640 1 -- 172.21.15.142:0/1311789358 <== osd.1 v2:172.21.15.142:6816/3192108003 25 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdefc03b040 con 0x56296da4f820 2024-09-22T08:38:29.470 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.459+0000 7fdf07c4a640 1 -- 172.21.15.142:0/1311789358 <== osd.1 v2:172.21.15.142:6816/3192108003 26 ==== watch-notify(notify_complete (2) cookie 94735933462560 notify 137438953491 ret 0) ==== 42+0+48 (crc 0 0 0) 0x56296da969c0 con 0x56296da4f820 2024-09-22T08:38:29.470 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.459+0000 7fdf0c728800 1 -- 172.21.15.142:0/1311789358 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:67 8.18 8:1f190392:users.keys::MH1WC2XQ1S8UISFDZC8W:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56296da957d0 con 0x56296da4f820 2024-09-22T08:38:29.470 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.461+0000 7fdf07c4a640 1 -- 172.21.15.142:0/1311789358 <== osd.1 v2:172.21.15.142:6816/3192108003 27 ==== osd_op_reply(67 MH1WC2XQ1S8UISFDZC8W [delete,create,writefull 0~7] v32'20 uv20 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7fdefc03b040 con 0x56296da4f820 2024-09-22T08:38:29.470 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.461+0000 7fdf0c728800 10 cache put: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W info.flags=0x7 2024-09-22T08:38:29.470 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.461+0000 7fdf0c728800 10 moving default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W to cache LRU end 2024-09-22T08:38:29.470 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.461+0000 7fdf0c728800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:MH1WC2XQ1S8UISFDZC8W, ofs0, ns] 2024-09-22T08:38:29.470 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.461+0000 7fdf0c728800 1 -- 172.21.15.142:0/1311789358 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94735933462480 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56296da9ab00 con 0x56296da54210 2024-09-22T08:38:29.470 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.461+0000 7fdf08c4c640 1 -- 172.21.15.142:0/1311789358 <== osd.3 v2:172.21.15.142:6800/1064901393 16 ==== watch-notify(notify (1) cookie 94735933229264 notify 137438953482 ret 0) ==== 219+0+0 (crc 0 0 0) 0x56296da44650 con 0x56296da54210 2024-09-22T08:38:29.470 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.461+0000 7fdde77fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953482 cookie 94735933229264 notifier 4828 bl.length()=177 2024-09-22T08:38:29.470 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.461+0000 7fdde77fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W info.flags=0x7 2024-09-22T08:38:29.471 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.461+0000 7fdde77fe640 10 rgw watcher librados: moving default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W to cache LRU end 2024-09-22T08:38:29.471 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.461+0000 7fdde77fe640 1 -- 172.21.15.142:0/1311789358 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fddcc003ea0 con 0x56296da54210 2024-09-22T08:38:29.471 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.461+0000 7fdf08c4c640 1 -- 172.21.15.142:0/1311789358 <== osd.3 v2:172.21.15.142:6800/1064901393 17 ==== osd_op_reply(68 notify.2 [notify cookie 94735933462480 out=8b] v0'0 uv240 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fdf0003a070 con 0x56296da54210 2024-09-22T08:38:29.471 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.461+0000 7fdf08c4c640 1 -- 172.21.15.142:0/1311789358 <== osd.3 v2:172.21.15.142:6800/1064901393 18 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdf0003a070 con 0x56296da54210 2024-09-22T08:38:29.471 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.461+0000 7fdf08c4c640 1 -- 172.21.15.142:0/1311789358 <== osd.3 v2:172.21.15.142:6800/1064901393 19 ==== watch-notify(notify_complete (2) cookie 94735933462480 notify 137438953482 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fdf0005d020 con 0x56296da54210 2024-09-22T08:38:29.471 INFO:teuthology.orchestra.run.smithi142.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-22T08:38:29.459914Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"users","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-22T08:38:29.459903Z","tags":[],"group_ids":[]} 2024-09-22T08:38:29.473 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.462+0000 7fddbe7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:38:29.473 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.462+0000 7fdf0c728800 1 -- 172.21.15.142:0/1311789358 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94735933241952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56296da94b70 con 0x56296da4f820 2024-09-22T08:38:29.473 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.463+0000 7fdf07c4a640 1 -- 172.21.15.142:0/1311789358 <== osd.1 v2:172.21.15.142:6816/3192108003 28 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94735933241952] v32'241 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fdefc03b040 con 0x56296da4f820 2024-09-22T08:38:29.473 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.463+0000 7fdf0c728800 1 -- 172.21.15.142:0/1311789358 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94735933220240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56296da94b70 con 0x7fdf00012ae0 2024-09-22T08:38:29.474 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.464+0000 7fdf0844b640 1 -- 172.21.15.142:0/1311789358 <== osd.2 v2:172.21.15.142:6808/279438927 11 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94735933220240] v32'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdef8057030 con 0x7fdf00012ae0 2024-09-22T08:38:29.474 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.464+0000 7fdf0c728800 20 remove_watcher() i=0 2024-09-22T08:38:29.474 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.464+0000 7fdf0c728800 2 removed watcher, disabling cache 2024-09-22T08:38:29.474 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.464+0000 7fdf0c728800 1 -- 172.21.15.142:0/1311789358 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94735933224368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56296da94b70 con 0x56296da4f820 2024-09-22T08:38:29.474 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.465+0000 7fdf07c4a640 1 -- 172.21.15.142:0/1311789358 <== osd.1 v2:172.21.15.142:6816/3192108003 29 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94735933224368] v32'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdefc03b040 con 0x56296da4f820 2024-09-22T08:38:29.474 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.466+0000 7fdf0c728800 20 remove_watcher() i=1 2024-09-22T08:38:29.474 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.466+0000 7fdf0c728800 1 -- 172.21.15.142:0/1311789358 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94735933229264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56296da94b70 con 0x56296da54210 2024-09-22T08:38:29.474 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.467+0000 7fdf08c4c640 1 -- 172.21.15.142:0/1311789358 <== osd.3 v2:172.21.15.142:6800/1064901393 20 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94735933229264] v32'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdf0003a070 con 0x56296da54210 2024-09-22T08:38:29.474 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.467+0000 7fdf0c728800 20 remove_watcher() i=2 2024-09-22T08:38:29.474 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.467+0000 7fdf0c728800 1 -- 172.21.15.142:0/1311789358 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94735933232096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56296da94b70 con 0x7fdf00012ae0 2024-09-22T08:38:29.474 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.468+0000 7fdf0844b640 1 -- 172.21.15.142:0/1311789358 <== osd.2 v2:172.21.15.142:6808/279438927 12 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94735933232096] v32'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdef8057030 con 0x7fdf00012ae0 2024-09-22T08:38:29.474 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.468+0000 7fdf0c728800 20 remove_watcher() i=3 2024-09-22T08:38:29.474 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.468+0000 7fdf0c728800 1 -- 172.21.15.142:0/1311789358 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94735933237056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56296da94b70 con 0x56296da4f820 2024-09-22T08:38:29.474 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.469+0000 7fdf07c4a640 1 -- 172.21.15.142:0/1311789358 <== osd.1 v2:172.21.15.142:6816/3192108003 30 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94735933237056] v32'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdefc03b040 con 0x56296da4f820 2024-09-22T08:38:29.475 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.469+0000 7fdf0c728800 20 remove_watcher() i=4 2024-09-22T08:38:29.475 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.469+0000 7fdf0c728800 1 -- 172.21.15.142:0/1311789358 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94735933238288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56296da94b70 con 0x7fdef8082040 2024-09-22T08:38:29.475 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.470+0000 7fdf07c4a640 1 -- 172.21.15.142:0/1311789358 <== osd.0 v2:172.21.15.31:6800/168281188 18 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94735933238288] v32'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdefc03b040 con 0x7fdef8082040 2024-09-22T08:38:29.475 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.470+0000 7fdf0c728800 20 remove_watcher() i=5 2024-09-22T08:38:29.475 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.470+0000 7fdf0c728800 1 -- 172.21.15.142:0/1311789358 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94735933226496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56296da94b70 con 0x7fdef8082040 2024-09-22T08:38:29.475 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.471+0000 7fdf07c4a640 1 -- 172.21.15.142:0/1311789358 <== osd.0 v2:172.21.15.31:6800/168281188 19 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94735933226496] v32'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdefc03b040 con 0x7fdef8082040 2024-09-22T08:38:29.475 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.471+0000 7fdf0c728800 20 remove_watcher() i=6 2024-09-22T08:38:29.475 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.471+0000 7fdf0c728800 1 -- 172.21.15.142:0/1311789358 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94735933243520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56296da94b70 con 0x7fdef8082040 2024-09-22T08:38:29.478 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.472+0000 7fdf07c4a640 1 -- 172.21.15.142:0/1311789358 <== osd.0 v2:172.21.15.31:6800/168281188 20 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94735933243520] v32'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdefc03b040 con 0x7fdef8082040 2024-09-22T08:38:29.478 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.472+0000 7fdf0c728800 20 remove_watcher() i=7 2024-09-22T08:38:29.478 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.472+0000 7fdf0c728800 1 -- 172.21.15.142:0/1311789358 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7fdef8082040 msgr2=0x7fdef808f040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:29.478 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.472+0000 7fdf0c728800 1 --2- 172.21.15.142:0/1311789358 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7fdef8082040 0x7fdef808f040 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:29.478 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.472+0000 7fdf0c728800 1 -- 172.21.15.142:0/1311789358 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x56296da4f820 msgr2=0x56296da51ce0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:29.478 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.472+0000 7fdf0c728800 1 --2- 172.21.15.142:0/1311789358 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x56296da4f820 0x56296da51ce0 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:29.478 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.472+0000 7fdf0c728800 1 -- 172.21.15.142:0/1311789358 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7fdf00012ae0 msgr2=0x7fdf00045510 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:29.478 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.472+0000 7fdf0c728800 1 --2- 172.21.15.142:0/1311789358 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7fdf00012ae0 0x7fdf00045510 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:29.479 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.472+0000 7fdf0c728800 1 -- 172.21.15.142:0/1311789358 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x56296da54210 msgr2=0x56296da56600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:29.479 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.472+0000 7fdf0c728800 1 --2- 172.21.15.142:0/1311789358 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x56296da54210 0x56296da56600 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:29.479 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.472+0000 7fdf0c728800 1 -- 172.21.15.142:0/1311789358 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fddd803cfb0 msgr2=0x7fddd803f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:29.479 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.472+0000 7fdf0c728800 1 --2- 172.21.15.142:0/1311789358 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fddd803cfb0 0x7fddd803f470 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x56296da16ea0 tx=0x7fdef8086000 comp rx=0 tx=0).stop 2024-09-22T08:38:29.479 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.472+0000 7fdf0c728800 1 -- 172.21.15.142:0/1311789358 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56296da3c8c0 msgr2=0x56296da43e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:29.479 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.472+0000 7fdf0c728800 1 --2- 172.21.15.142:0/1311789358 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56296da3c8c0 0x56296da43e60 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7fdf000208e0 tx=0x7fdf00054860 comp rx=0 tx=0).stop 2024-09-22T08:38:29.479 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.472+0000 7fdf07c4a640 1 -- 172.21.15.142:0/1311789358 reap_dead start 2024-09-22T08:38:29.479 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.473+0000 7fdf0c728800 1 -- 172.21.15.142:0/1311789358 shutdown_connections 2024-09-22T08:38:29.479 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.473+0000 7fdf0c728800 1 --2- 172.21.15.142:0/1311789358 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56296da3c8c0 0x56296da43e60 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:29.479 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.473+0000 7fdf0c728800 1 -- 172.21.15.142:0/1311789358 >> 172.21.15.142:0/1311789358 conn(0x56296da38cc0 msgr2=0x56296da36ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:38:29.479 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.473+0000 7fdf0c728800 1 -- 172.21.15.142:0/1311789358 shutdown_connections 2024-09-22T08:38:29.479 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.473+0000 7fdf0c728800 1 -- 172.21.15.142:0/1311789358 wait complete. 2024-09-22T08:38:29.479 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.473+0000 7fdf0c728800 1 -- 172.21.15.142:0/3730819168 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fdde003cfb0 msgr2=0x7fdde003f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:29.480 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.473+0000 7fdf0c728800 1 --2- 172.21.15.142:0/3730819168 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fdde003cfb0 0x7fdde003f470 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fdef8096a70 tx=0x7fdef8067040 comp rx=0 tx=0).stop 2024-09-22T08:38:29.480 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.473+0000 7fdf0c728800 1 -- 172.21.15.142:0/3730819168 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56296da2fdc0 msgr2=0x56296da301e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:29.480 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.473+0000 7fdf0c728800 1 --2- 172.21.15.142:0/3730819168 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56296da2fdc0 0x56296da301e0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x56296da15da0 tx=0x7fdf000167b0 comp rx=0 tx=0).stop 2024-09-22T08:38:29.480 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.473+0000 7fdf0c728800 1 -- 172.21.15.142:0/3730819168 shutdown_connections 2024-09-22T08:38:29.480 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.473+0000 7fdf0c728800 1 --2- 172.21.15.142:0/3730819168 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fdde003cfb0 0x7fdde003f470 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:29.480 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.473+0000 7fdf0c728800 1 --2- 172.21.15.142:0/3730819168 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56296da2fdc0 0x56296da301e0 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:29.480 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.473+0000 7fdf0c728800 1 -- 172.21.15.142:0/3730819168 >> 172.21.15.142:0/3730819168 conn(0x56296da24170 msgr2=0x56296da24550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:38:29.480 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.473+0000 7fdf0c728800 1 -- 172.21.15.142:0/3730819168 shutdown_connections 2024-09-22T08:38:29.480 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.473+0000 7fdf0c728800 1 -- 172.21.15.142:0/3730819168 wait complete. 2024-09-22T08:38:29.480 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.473+0000 7fdf0c728800 1 -- 172.21.15.142:0/2162090127 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x56296d91e8a0 msgr2=0x56296da1c3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:29.480 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.473+0000 7fdf0c728800 1 --2- 172.21.15.142:0/2162090127 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x56296d91e8a0 0x56296da1c3f0 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:29.480 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.473+0000 7fdf0c728800 1 -- 172.21.15.142:0/2162090127 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x56296da1e7d0 msgr2=0x56296da20c70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:29.480 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.473+0000 7fdf0c728800 1 --2- 172.21.15.142:0/2162090127 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x56296da1e7d0 0x56296da20c70 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:29.480 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.473+0000 7fdf0c728800 1 -- 172.21.15.142:0/2162090127 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fddf003d000 msgr2=0x7fddf003f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:29.480 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.473+0000 7fdf0c728800 1 --2- 172.21.15.142:0/2162090127 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fddf003d000 0x7fddf003f4c0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fdefc001e30 tx=0x7fdefc001390 comp rx=0 tx=0).stop 2024-09-22T08:38:29.481 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.473+0000 7fdf0c728800 1 -- 172.21.15.142:0/2162090127 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56296d919c30 msgr2=0x56296da14da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:29.481 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.473+0000 7fdf0c728800 1 --2- 172.21.15.142:0/2162090127 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56296d919c30 0x56296da14da0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fdef80460d0 tx=0x7fdef8002fb0 comp rx=0 tx=0).stop 2024-09-22T08:38:29.481 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.473+0000 7fdf0c728800 1 -- 172.21.15.142:0/2162090127 shutdown_connections 2024-09-22T08:38:29.481 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.473+0000 7fdf0c728800 1 --2- 172.21.15.142:0/2162090127 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x56296da1e7d0 0x56296da20c70 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:29.481 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.473+0000 7fdf0c728800 1 --2- 172.21.15.142:0/2162090127 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x56296d91e8a0 0x56296da1c3f0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:29.481 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.474+0000 7fdf0c728800 1 --2- 172.21.15.142:0/2162090127 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fddf003d000 0x7fddf003f4c0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:29.481 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.474+0000 7fdf0c728800 1 --2- 172.21.15.142:0/2162090127 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56296d919c30 0x56296da14da0 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:29.481 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.474+0000 7fdf0c728800 1 -- 172.21.15.142:0/2162090127 >> 172.21.15.142:0/2162090127 conn(0x56296d915360 msgr2=0x56296da066e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:38:29.481 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.474+0000 7fdf0c728800 1 -- 172.21.15.142:0/2162090127 shutdown_connections 2024-09-22T08:38:29.481 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.474+0000 7fdf0c728800 1 -- 172.21.15.142:0/2162090127 wait complete. 2024-09-22T08:38:29.484 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-22T08:38:29.459914Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-22T08:38:29.459903Z', 'tags': [], 'group_ids': []} 2024-09-22T08:38:29.484 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-22T08:38:29.459914Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-22T08:38:29.459903Z', 'tags': [], 'group_ids': []} 2024-09-22T08:38:29.485 ERROR:root:0 2024-09-22T08:38:29.485 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-22T08:38:29.490 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchUser', 'Message': '', 'RequestId': 'tx00000b1f22ad4dbee2449-0066efd785-4226-default', 'HostId': '4226-default-default'} 2024-09-22T08:38:29.491 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'create'] {'uid': 'foo', 'display-name': 'Foo', 'email': 'foo@foo.com', 'access-key': '9te6NH5mcdcq0Tc5i8i1', 'secret-key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'max-buckets': '4'} 2024-09-22T08:38:29.501 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-22T08:38:29.501 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'list'] {'list': '', 'max-entries': 0} 2024-09-22T08:38:29.514 INFO:tasks.radosgw_admin_rest: json result: {'keys': [], 'truncated': True, 'count': 0, 'marker': '8:1e6ca5ed:users.uid::foo:head'} 2024-09-22T08:38:29.514 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'list'] {'list': '', 'max-entries': 1} 2024-09-22T08:38:29.528 INFO:tasks.radosgw_admin_rest: json result: {'keys': ['foo'], 'truncated': True, 'count': 1, 'marker': '8:a00000ee:users.uid::bar.buckets:head'} 2024-09-22T08:38:29.529 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'list'] {'list': '', 'max-entries': 1, 'marker': '8:a00000ee:users.uid::bar.buckets:head'} 2024-09-22T08:38:29.536 INFO:tasks.radosgw_admin_rest: json result: {'keys': ['ada'], 'truncated': False, 'count': 1} 2024-09-22T08:38:29.536 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-22T08:38:29.540 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-22T08:38:29.540 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'access-key': '9te6NH5mcdcq0Tc5i8i1', 'uid': 'uid_not_exist'} 2024-09-22T08:38:29.544 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-22T08:38:29.544 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'rm', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-22T08:38:29.544 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'rm', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-22T08:38:29.544 DEBUG:teuthology.orchestra.run.smithi142:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps rm --uid ada --caps 'users=read, write' 2024-09-22T08:38:29.591 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:38:29.591 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:38:29.591 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.589+0000 7f7b8e211800 1 Processor -- start 2024-09-22T08:38:29.592 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.589+0000 7f7b8e211800 1 -- start start 2024-09-22T08:38:29.592 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.590+0000 7f7b8e211800 1 --2- >> v2:172.21.15.31:3300/0 conn(0x561cbc44cb70 0x561cbc44ef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:29.592 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.590+0000 7f7b8e211800 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x561cbc2d3a20 con 0x561cbc449060 2024-09-22T08:38:29.592 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.590+0000 7f7b8e211800 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x561cbc2d37d0 con 0x561cbc44cb70 2024-09-22T08:38:29.593 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.590+0000 7f7b89147640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x561cbc44cb70 0x561cbc44ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:29.593 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.590+0000 7f7b89948640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x561cbc449060 0x561cbc44b450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.142:50460/0 (socket says 172.21.15.142:50460) 2024-09-22T08:38:29.593 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.590+0000 7f7b89948640 1 -- 172.21.15.142:0/3049380340 learned_addr learned my addr 172.21.15.142:0/3049380340 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-09-22T08:38:29.593 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.590+0000 7f7b88946640 1 -- 172.21.15.142:0/3049380340 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1415585494 0 0) 0x561cbc2d3a20 con 0x561cbc449060 2024-09-22T08:38:29.593 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.590+0000 7f7b88946640 1 -- 172.21.15.142:0/3049380340 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7b74001e10 con 0x561cbc449060 2024-09-22T08:38:29.593 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.590+0000 7f7b89147640 1 -- 172.21.15.142:0/3049380340 >> v1:172.21.15.31:6789/0 conn(0x561cbc449060 legacy=0x561cbc44b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:29.593 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.590+0000 7f7b89147640 1 -- 172.21.15.142:0/3049380340 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x561cbc450540 con 0x561cbc44cb70 2024-09-22T08:38:29.595 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.592+0000 7f7b89147640 1 --2- 172.21.15.142:0/3049380340 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561cbc44cb70 0x561cbc44ef60 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f7b8000a470 tx=0x7f7b80045920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc9b3f0196215d4c server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:29.595 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.592+0000 7f7b88946640 1 -- 172.21.15.142:0/3049380340 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b80059070 con 0x561cbc44cb70 2024-09-22T08:38:29.595 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.593+0000 7f7b88946640 1 -- 172.21.15.142:0/3049380340 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b80054570 con 0x561cbc44cb70 2024-09-22T08:38:29.596 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.593+0000 7f7b88946640 1 -- 172.21.15.142:0/3049380340 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b80054870 con 0x561cbc44cb70 2024-09-22T08:38:29.596 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.593+0000 7f7b8e211800 1 -- 172.21.15.142:0/3049380340 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561cbc44cb70 msgr2=0x561cbc44ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:29.596 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.593+0000 7f7b8e211800 1 --2- 172.21.15.142:0/3049380340 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561cbc44cb70 0x561cbc44ef60 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f7b8000a470 tx=0x7f7b80045920 comp rx=0 tx=0).stop 2024-09-22T08:38:29.596 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.593+0000 7f7b8e211800 1 -- 172.21.15.142:0/3049380340 shutdown_connections 2024-09-22T08:38:29.596 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.593+0000 7f7b8e211800 1 --2- 172.21.15.142:0/3049380340 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561cbc44cb70 0x561cbc44ef60 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:29.596 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.593+0000 7f7b8e211800 1 -- 172.21.15.142:0/3049380340 >> 172.21.15.142:0/3049380340 conn(0x561cbc442ba0 msgr2=0x561cbc445000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:38:29.596 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.593+0000 7f7b8e211800 1 -- 172.21.15.142:0/3049380340 shutdown_connections 2024-09-22T08:38:29.596 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.593+0000 7f7b8e211800 1 -- 172.21.15.142:0/3049380340 wait complete. 2024-09-22T08:38:29.609 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.607+0000 7f7b8e211800 1 Processor -- start 2024-09-22T08:38:29.610 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.607+0000 7f7b8e211800 1 -- start start 2024-09-22T08:38:29.610 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.607+0000 7f7b8e211800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561cbc449060 0x561cbc4487d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:29.610 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.607+0000 7f7b8e211800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x561cbc2e0dd0 con 0x561cbc449060 2024-09-22T08:38:29.610 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.607+0000 7f7b89948640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561cbc449060 0x561cbc4487d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:29.610 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.607+0000 7f7b89948640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561cbc449060 0x561cbc4487d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:51658/0 (socket says 172.21.15.142:51658) 2024-09-22T08:38:29.610 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.607+0000 7f7b89948640 1 -- 172.21.15.142:0/2172529140 learned_addr learned my addr 172.21.15.142:0/2172529140 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:38:29.610 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.608+0000 7f7b89948640 1 -- 172.21.15.142:0/2172529140 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561cbc448dc0 con 0x561cbc449060 2024-09-22T08:38:29.610 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.608+0000 7f7b89948640 1 --2- 172.21.15.142:0/2172529140 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561cbc449060 0x561cbc4487d0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f7b7c001e30 tx=0x7f7b7c00b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da76c2ed6c1751bb server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:29.612 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.608+0000 7f7a77e07640 1 -- 172.21.15.142:0/2172529140 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b7c012020 con 0x561cbc449060 2024-09-22T08:38:29.613 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.608+0000 7f7a77e07640 1 -- 172.21.15.142:0/2172529140 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b7c00e470 con 0x561cbc449060 2024-09-22T08:38:29.613 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.608+0000 7f7a77e07640 1 -- 172.21.15.142:0/2172529140 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b7c00e790 con 0x561cbc449060 2024-09-22T08:38:29.613 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.609+0000 7f7b8e211800 1 -- 172.21.15.142:0/2172529140 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561cbc449060 msgr2=0x561cbc4487d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:29.613 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.609+0000 7f7b8e211800 1 --2- 172.21.15.142:0/2172529140 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561cbc449060 0x561cbc4487d0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f7b7c001e30 tx=0x7f7b7c00b780 comp rx=0 tx=0).stop 2024-09-22T08:38:29.613 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.609+0000 7f7b8e211800 1 -- 172.21.15.142:0/2172529140 shutdown_connections 2024-09-22T08:38:29.613 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.609+0000 7f7b8e211800 1 --2- 172.21.15.142:0/2172529140 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561cbc449060 0x561cbc4487d0 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:29.613 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.609+0000 7f7b8e211800 1 -- 172.21.15.142:0/2172529140 >> 172.21.15.142:0/2172529140 conn(0x561cbc442ba0 msgr2=0x561cbc533890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:38:29.613 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.609+0000 7f7b8e211800 1 -- 172.21.15.142:0/2172529140 shutdown_connections 2024-09-22T08:38:29.613 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.609+0000 7f7b8e211800 1 -- 172.21.15.142:0/2172529140 wait complete. 2024-09-22T08:38:29.613 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.609+0000 7f7b8e211800 1 Processor -- start 2024-09-22T08:38:29.613 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.609+0000 7f7b8e211800 1 -- start start 2024-09-22T08:38:29.613 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.609+0000 7f7b8e211800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561cbc449060 0x561cbc541bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:29.613 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.609+0000 7f7b8e211800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x561cbc44f830 con 0x561cbc449060 2024-09-22T08:38:29.613 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.609+0000 7f7b89948640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561cbc449060 0x561cbc541bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:29.614 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.610+0000 7f7b89948640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561cbc449060 0x561cbc541bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:51660/0 (socket says 172.21.15.142:51660) 2024-09-22T08:38:29.614 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.610+0000 7f7b89948640 1 -- 172.21.15.142:0/2741854053 learned_addr learned my addr 172.21.15.142:0/2741854053 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:38:29.614 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.610+0000 7f7b89948640 1 -- 172.21.15.142:0/2741854053 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561cbc542120 con 0x561cbc449060 2024-09-22T08:38:29.614 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.610+0000 7f7b89948640 1 --2- 172.21.15.142:0/2741854053 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561cbc449060 0x561cbc541bc0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x561cbc448300 tx=0x7f7b7c0040e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:29.614 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.610+0000 7f7a76604640 1 -- 172.21.15.142:0/2741854053 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b7c012030 con 0x561cbc449060 2024-09-22T08:38:29.614 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.610+0000 7f7a76604640 1 -- 172.21.15.142:0/2741854053 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b7c01a7a0 con 0x561cbc449060 2024-09-22T08:38:29.614 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.610+0000 7f7b8e211800 1 -- 172.21.15.142:0/2741854053 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561cbc5423b0 con 0x561cbc449060 2024-09-22T08:38:29.614 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.610+0000 7f7a76604640 1 -- 172.21.15.142:0/2741854053 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b7c01aaa0 con 0x561cbc449060 2024-09-22T08:38:29.614 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.610+0000 7f7b8e211800 1 -- 172.21.15.142:0/2741854053 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561cbc542fc0 con 0x561cbc449060 2024-09-22T08:38:29.617 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.611+0000 7f7a76604640 1 -- 172.21.15.142:0/2741854053 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f7b7c015020 con 0x561cbc449060 2024-09-22T08:38:29.617 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.612+0000 7f7a76604640 1 --2- 172.21.15.142:0/2741854053 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f7a7003d000 0x7f7a7003f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:29.617 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.612+0000 7f7a76604640 1 -- 172.21.15.142:0/2741854053 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5938+0+0 (secure 0 0 0) 0x7f7b7c020070 con 0x561cbc449060 2024-09-22T08:38:29.617 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.612+0000 7f7b89147640 1 --2- 172.21.15.142:0/2741854053 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f7a7003d000 0x7f7a7003f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:29.617 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.612+0000 7f7b8e211800 1 --2- 172.21.15.142:0/2741854053 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x561cbc44cb70 0x561cbc549210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:29.617 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.612+0000 7f7b8e211800 1 -- 172.21.15.142:0/2741854053 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561cbc549750 con 0x561cbc44cb70 2024-09-22T08:38:29.617 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.612+0000 7f7b8a149640 1 --2- 172.21.15.142:0/2741854053 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x561cbc44cb70 0x561cbc549210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:29.617 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.612+0000 7f7b89147640 1 --2- 172.21.15.142:0/2741854053 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f7a7003d000 0x7f7a7003f4c0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x561cbc3bb8e0 tx=0x7f7b80050000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:29.617 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.612+0000 7f7b8a149640 1 --2- 172.21.15.142:0/2741854053 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x561cbc44cb70 0x561cbc549210 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:29.617 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.612+0000 7f7b8a149640 1 -- 172.21.15.142:0/2741854053 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7b8400a4d0 con 0x561cbc44cb70 2024-09-22T08:38:29.617 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.612+0000 7f7b8e211800 1 -- 172.21.15.142:0/2741854053 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561cbc549af0 con 0x561cbc44cb70 2024-09-22T08:38:29.618 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.613+0000 7f7b8a149640 1 -- 172.21.15.142:0/2741854053 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7b8400a4d0 con 0x561cbc44cb70 2024-09-22T08:38:29.618 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.613+0000 7f7b8e211800 1 --2- 172.21.15.142:0/2741854053 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x561cbc54b630 0x561cbc54dab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:29.618 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.613+0000 7f7b8e211800 1 -- 172.21.15.142:0/2741854053 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:3 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561cbc54e240 con 0x561cbc54b630 2024-09-22T08:38:29.618 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.613+0000 7f7b89948640 1 --2- 172.21.15.142:0/2741854053 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x561cbc54b630 0x561cbc54dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:29.618 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.613+0000 7f7b89948640 1 --2- 172.21.15.142:0/2741854053 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x561cbc54b630 0x561cbc54dab0 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:29.618 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.613+0000 7f7b89948640 1 -- 172.21.15.142:0/2741854053 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(3 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f7b7c018950 con 0x561cbc54b630 2024-09-22T08:38:29.618 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.613+0000 7f7b8e211800 1 -- 172.21.15.142:0/2741854053 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561cbc54a340 con 0x561cbc44cb70 2024-09-22T08:38:29.618 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.614+0000 7f7b8a149640 1 -- 172.21.15.142:0/2741854053 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7b8400a4d0 con 0x561cbc44cb70 2024-09-22T08:38:29.618 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.614+0000 7f7b8e211800 1 -- 172.21.15.142:0/2741854053 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561cbc54a7a0 con 0x561cbc54b630 2024-09-22T08:38:29.618 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.614+0000 7f7b89948640 1 -- 172.21.15.142:0/2741854053 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(5 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f7b7c018950 con 0x561cbc54b630 2024-09-22T08:38:29.618 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.614+0000 7f7b8e211800 1 Processor -- start 2024-09-22T08:38:29.618 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.615+0000 7f7b8e211800 1 -- start start 2024-09-22T08:38:29.618 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.615+0000 7f7b8e211800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561cbc55cc00 0x561cbc55d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:29.618 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.615+0000 7f7b8e211800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x561cbc33fd50 con 0x561cbc55cc00 2024-09-22T08:38:29.619 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.615+0000 7f7b8a149640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561cbc55cc00 0x561cbc55d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:29.619 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.615+0000 7f7b8a149640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561cbc55cc00 0x561cbc55d020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:51664/0 (socket says 172.21.15.142:51664) 2024-09-22T08:38:29.619 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.615+0000 7f7b8a149640 1 -- 172.21.15.142:0/1802996046 learned_addr learned my addr 172.21.15.142:0/1802996046 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:38:29.622 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.615+0000 7f7b8a149640 1 -- 172.21.15.142:0/1802996046 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561cbc55d660 con 0x561cbc55cc00 2024-09-22T08:38:29.623 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.615+0000 7f7b8a149640 1 --2- 172.21.15.142:0/1802996046 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561cbc55cc00 0x561cbc55d020 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x561cbc5431e0 tx=0x7f7b840167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:29.623 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.615+0000 7f7a6f7fe640 1 -- 172.21.15.142:0/1802996046 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b84013640 con 0x561cbc55cc00 2024-09-22T08:38:29.623 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.616+0000 7f7a6f7fe640 1 -- 172.21.15.142:0/1802996046 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b840137e0 con 0x561cbc55cc00 2024-09-22T08:38:29.623 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.616+0000 7f7b8e211800 1 -- 172.21.15.142:0/1802996046 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561cbc55de90 con 0x561cbc55cc00 2024-09-22T08:38:29.623 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.616+0000 7f7a6f7fe640 1 -- 172.21.15.142:0/1802996046 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b84013ae0 con 0x561cbc55cc00 2024-09-22T08:38:29.623 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.616+0000 7f7b8e211800 1 -- 172.21.15.142:0/1802996046 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561cbc55e430 con 0x561cbc55cc00 2024-09-22T08:38:29.623 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.616+0000 7f7a6f7fe640 1 -- 172.21.15.142:0/1802996046 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f7b84011040 con 0x561cbc55cc00 2024-09-22T08:38:29.623 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.617+0000 7f7a6f7fe640 1 --2- 172.21.15.142:0/1802996046 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f7a6403d000 0x7f7a6403f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:29.623 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.617+0000 7f7a6f7fe640 1 -- 172.21.15.142:0/1802996046 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5938+0+0 (secure 0 0 0) 0x7f7b8400e040 con 0x561cbc55cc00 2024-09-22T08:38:29.623 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.617+0000 7f7b89948640 1 --2- 172.21.15.142:0/1802996046 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f7a6403d000 0x7f7a6403f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:29.623 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.617+0000 7f7b8e211800 1 Processor -- start 2024-09-22T08:38:29.623 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.617+0000 7f7b8e211800 1 -- start start 2024-09-22T08:38:29.623 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.617+0000 7f7b89948640 1 --2- 172.21.15.142:0/1802996046 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f7a6403d000 0x7f7a6403f4c0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x561cbc54e5e0 tx=0x7f7b7c00dec0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:29.624 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.617+0000 7f7b8e211800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561cbc5696a0 0x561cbc569a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:29.624 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.617+0000 7f7b8e211800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x561cbc447210 con 0x561cbc5696a0 2024-09-22T08:38:29.624 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.617+0000 7f7b8a149640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561cbc5696a0 0x561cbc569a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:29.624 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.617+0000 7f7b8a149640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561cbc5696a0 0x561cbc569a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:51676/0 (socket says 172.21.15.142:51676) 2024-09-22T08:38:29.624 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.617+0000 7f7b8a149640 1 -- 172.21.15.142:0/2024094405 learned_addr learned my addr 172.21.15.142:0/2024094405 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:38:29.624 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.618+0000 7f7b8a149640 1 -- 172.21.15.142:0/2024094405 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561cbc56a070 con 0x561cbc5696a0 2024-09-22T08:38:29.624 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.618+0000 7f7b8a149640 1 --2- 172.21.15.142:0/2024094405 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561cbc5696a0 0x561cbc569a80 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f7b84016cd0 tx=0x7f7b84020460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20294e546f064491 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:29.624 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.618+0000 7f7a6d7fa640 1 -- 172.21.15.142:0/2024094405 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b84044030 con 0x561cbc5696a0 2024-09-22T08:38:29.624 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.618+0000 7f7a6d7fa640 1 -- 172.21.15.142:0/2024094405 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b8402adb0 con 0x561cbc5696a0 2024-09-22T08:38:29.624 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.618+0000 7f7a6d7fa640 1 -- 172.21.15.142:0/2024094405 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b84021910 con 0x561cbc5696a0 2024-09-22T08:38:29.624 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.618+0000 7f7b8e211800 1 -- 172.21.15.142:0/2024094405 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561cbc5696a0 msgr2=0x561cbc569a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:29.624 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.618+0000 7f7b8e211800 1 --2- 172.21.15.142:0/2024094405 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561cbc5696a0 0x561cbc569a80 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f7b84016cd0 tx=0x7f7b84020460 comp rx=0 tx=0).stop 2024-09-22T08:38:29.624 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.618+0000 7f7b8e211800 1 -- 172.21.15.142:0/2024094405 shutdown_connections 2024-09-22T08:38:29.624 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.618+0000 7f7b8e211800 1 --2- 172.21.15.142:0/2024094405 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561cbc5696a0 0x561cbc569a80 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:29.624 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.618+0000 7f7b8e211800 1 -- 172.21.15.142:0/2024094405 >> 172.21.15.142:0/2024094405 conn(0x561cbc565aa0 msgr2=0x561cbc563ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:38:29.625 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.618+0000 7f7b8e211800 1 -- 172.21.15.142:0/2024094405 shutdown_connections 2024-09-22T08:38:29.625 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.618+0000 7f7b8e211800 1 -- 172.21.15.142:0/2024094405 wait complete. 2024-09-22T08:38:29.625 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.619+0000 7f7b8e211800 1 Processor -- start 2024-09-22T08:38:29.625 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.619+0000 7f7b8e211800 1 -- start start 2024-09-22T08:38:29.625 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.619+0000 7f7b8e211800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561cbc5696a0 0x561cbc570c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:29.625 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.619+0000 7f7b8e211800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x561cbc56a6b0 con 0x561cbc5696a0 2024-09-22T08:38:29.625 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.619+0000 7f7b8a149640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561cbc5696a0 0x561cbc570c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:29.625 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.619+0000 7f7b8a149640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561cbc5696a0 0x561cbc570c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:51678/0 (socket says 172.21.15.142:51678) 2024-09-22T08:38:29.625 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.619+0000 7f7b8a149640 1 -- 172.21.15.142:0/3814732203 learned_addr learned my addr 172.21.15.142:0/3814732203 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:38:29.625 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.619+0000 7f7b8a149640 1 -- 172.21.15.142:0/3814732203 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561cbc571190 con 0x561cbc5696a0 2024-09-22T08:38:29.625 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.620+0000 7f7b8a149640 1 --2- 172.21.15.142:0/3814732203 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561cbc5696a0 0x561cbc570c30 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f7b84020560 tx=0x7f7b84054790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:29.625 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.620+0000 7f7a5b7fe640 1 -- 172.21.15.142:0/3814732203 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b8401fe80 con 0x561cbc5696a0 2024-09-22T08:38:29.625 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.620+0000 7f7b8e211800 1 -- 172.21.15.142:0/3814732203 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561cbc571420 con 0x561cbc5696a0 2024-09-22T08:38:29.625 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.620+0000 7f7a5b7fe640 1 -- 172.21.15.142:0/3814732203 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b84021910 con 0x561cbc5696a0 2024-09-22T08:38:29.625 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.620+0000 7f7a5b7fe640 1 -- 172.21.15.142:0/3814732203 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b840459d0 con 0x561cbc5696a0 2024-09-22T08:38:29.626 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.620+0000 7f7b8e211800 1 -- 172.21.15.142:0/3814732203 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561cbc571420 con 0x561cbc5696a0 2024-09-22T08:38:29.626 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.621+0000 7f7a5b7fe640 1 -- 172.21.15.142:0/3814732203 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f7b84045b70 con 0x561cbc5696a0 2024-09-22T08:38:29.639 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.621+0000 7f7a5b7fe640 1 --2- 172.21.15.142:0/3814732203 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f7a5403d150 0x7f7a5403f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:29.639 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.621+0000 7f7a5b7fe640 1 -- 172.21.15.142:0/3814732203 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5938+0+0 (secure 0 0 0) 0x7f7b84004d90 con 0x561cbc5696a0 2024-09-22T08:38:29.639 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.621+0000 7f7b89948640 1 --2- 172.21.15.142:0/3814732203 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f7a5403d150 0x7f7a5403f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:29.639 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.621+0000 7f7b89948640 1 --2- 172.21.15.142:0/3814732203 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f7a5403d150 0x7f7a5403f610 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f7b7c052e80 tx=0x7f7b7c04f000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:29.639 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.621+0000 7f7b8e211800 20 rados->read ofs=0 len=0 2024-09-22T08:38:29.640 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.621+0000 7f7b8e211800 1 --2- 172.21.15.142:0/3814732203 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x561cbc57c3d0 0x561cbc57e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:29.640 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.621+0000 7f7b8e211800 1 -- 172.21.15.142:0/3814732203 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561cbc57efe0 con 0x561cbc57c3d0 2024-09-22T08:38:29.640 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.621+0000 7f7b89147640 1 --2- 172.21.15.142:0/3814732203 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x561cbc57c3d0 0x561cbc57e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:29.640 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.622+0000 7f7b89147640 1 --2- 172.21.15.142:0/3814732203 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x561cbc57c3d0 0x561cbc57e890 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:29.640 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.622+0000 7f7b89147640 1 -- 172.21.15.142:0/3814732203 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7b80061430 con 0x561cbc57c3d0 2024-09-22T08:38:29.640 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.622+0000 7f7b8e211800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:29.640 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.622+0000 7f7b8e211800 20 realm 2024-09-22T08:38:29.640 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.622+0000 7f7b8e211800 20 rados->read ofs=0 len=0 2024-09-22T08:38:29.640 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.622+0000 7f7b8e211800 1 -- 172.21.15.142:0/3814732203 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561cbc57f3b0 con 0x561cbc57c3d0 2024-09-22T08:38:29.640 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.622+0000 7f7b89147640 1 -- 172.21.15.142:0/3814732203 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7b80061430 con 0x561cbc57c3d0 2024-09-22T08:38:29.640 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.622+0000 7f7b8e211800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:29.640 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.622+0000 7f7b8e211800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:38:29.640 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.622+0000 7f7b8e211800 20 rados->read ofs=0 len=0 2024-09-22T08:38:29.641 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.622+0000 7f7b8e211800 1 -- 172.21.15.142:0/3814732203 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561cbc57fc80 con 0x561cbc57c3d0 2024-09-22T08:38:29.641 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.622+0000 7f7b89147640 1 -- 172.21.15.142:0/3814732203 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7b80061430 con 0x561cbc57c3d0 2024-09-22T08:38:29.641 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.622+0000 7f7b8e211800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:29.641 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.622+0000 7f7b8e211800 20 rados->read ofs=0 len=0 2024-09-22T08:38:29.641 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.622+0000 7f7b8e211800 1 -- 172.21.15.142:0/3814732203 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561cbc580020 con 0x561cbc57c3d0 2024-09-22T08:38:29.641 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.623+0000 7f7b89147640 1 -- 172.21.15.142:0/3814732203 <== osd.1 v2:172.21.15.142:6816/3192108003 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7b80061430 con 0x561cbc57c3d0 2024-09-22T08:38:29.641 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.623+0000 7f7b8e211800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:38:29.641 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.623+0000 7f7b8e211800 20 rados->read ofs=0 len=0 2024-09-22T08:38:29.641 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.623+0000 7f7b8e211800 1 --2- 172.21.15.142:0/3814732203 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x561cbc580d80 0x561cbc583170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:29.641 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.623+0000 7f7b8e211800 1 -- 172.21.15.142:0/3814732203 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561cbc583730 con 0x561cbc580d80 2024-09-22T08:38:29.641 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.623+0000 7f7b8a149640 1 --2- 172.21.15.142:0/3814732203 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x561cbc580d80 0x561cbc583170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:29.641 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.623+0000 7f7b8a149640 1 --2- 172.21.15.142:0/3814732203 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x561cbc580d80 0x561cbc583170 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:29.641 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.623+0000 7f7b8a149640 1 -- 172.21.15.142:0/3814732203 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(5 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f7b84053020 con 0x561cbc580d80 2024-09-22T08:38:29.642 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.623+0000 7f7b8e211800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:38:29.642 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.623+0000 7f7b8e211800 20 searching for the correct realm 2024-09-22T08:38:29.642 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.623+0000 7f7b8e211800 1 -- 172.21.15.142:0/3814732203 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561cbc585080 con 0x561cbc580d80 2024-09-22T08:38:29.642 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.624+0000 7f7b8a149640 1 -- 172.21.15.142:0/3814732203 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b84053020 con 0x561cbc580d80 2024-09-22T08:38:29.642 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.624+0000 7f7b8a149640 1 --2- 172.21.15.142:0/3814732203 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f7b8404d2d0 0x7f7b8404d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:29.642 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.624+0000 7f7b8a149640 1 -- 172.21.15.142:0/3814732203 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561cbc585080 con 0x7f7b8404d2d0 2024-09-22T08:38:29.642 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.624+0000 7f7b89948640 1 --2- 172.21.15.142:0/3814732203 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f7b8404d2d0 0x7f7b8404d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:29.642 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.624+0000 7f7b89948640 1 --2- 172.21.15.142:0/3814732203 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f7b8404d2d0 0x7f7b8404d710 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:29.642 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.624+0000 7f7b89948640 1 -- 172.21.15.142:0/3814732203 <== osd.2 v2:172.21.15.142:6808/279438927 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b7c018950 con 0x7f7b8404d2d0 2024-09-22T08:38:29.642 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.624+0000 7f7b89948640 1 --2- 172.21.15.142:0/3814732203 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f7b7c017050 0x7f7b7c0512a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:29.642 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.624+0000 7f7b89948640 1 -- 172.21.15.142:0/3814732203 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561cbc585080 con 0x7f7b7c017050 2024-09-22T08:38:29.642 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.625+0000 7f7b89147640 1 --2- 172.21.15.142:0/3814732203 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f7b7c017050 0x7f7b7c0512a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:29.642 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.625+0000 7f7b89147640 1 --2- 172.21.15.142:0/3814732203 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f7b7c017050 0x7f7b7c0512a0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:29.643 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.625+0000 7f7b89147640 1 -- 172.21.15.142:0/3814732203 <== osd.0 v2:172.21.15.31:6800/168281188 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b80061430 con 0x7f7b7c017050 2024-09-22T08:38:29.643 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.625+0000 7f7b89147640 1 -- 172.21.15.142:0/3814732203 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561cbc585080 con 0x561cbc57c3d0 2024-09-22T08:38:29.643 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.626+0000 7f7b89147640 1 -- 172.21.15.142:0/3814732203 <== osd.1 v2:172.21.15.142:6816/3192108003 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b80061430 con 0x561cbc57c3d0 2024-09-22T08:38:29.643 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.626+0000 7f7b89147640 1 -- 172.21.15.142:0/3814732203 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561cbc585080 con 0x561cbc57c3d0 2024-09-22T08:38:29.643 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.626+0000 7f7b89147640 1 -- 172.21.15.142:0/3814732203 <== osd.1 v2:172.21.15.142:6816/3192108003 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b80061430 con 0x561cbc57c3d0 2024-09-22T08:38:29.643 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.626+0000 7f7b89147640 1 -- 172.21.15.142:0/3814732203 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f7b80078040 con 0x561cbc57c3d0 2024-09-22T08:38:29.643 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.626+0000 7f7b89147640 1 -- 172.21.15.142:0/3814732203 <== osd.1 v2:172.21.15.142:6816/3192108003 7 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b80061430 con 0x561cbc57c3d0 2024-09-22T08:38:29.643 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.626+0000 7f7b89147640 1 -- 172.21.15.142:0/3814732203 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f7b80078040 con 0x7f7b7c017050 2024-09-22T08:38:29.643 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.626+0000 7f7b89147640 1 -- 172.21.15.142:0/3814732203 <== osd.0 v2:172.21.15.31:6800/168281188 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b80061430 con 0x7f7b7c017050 2024-09-22T08:38:29.643 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.626+0000 7f7b89147640 1 -- 172.21.15.142:0/3814732203 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f7b80078040 con 0x7f7b8404d2d0 2024-09-22T08:38:29.643 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.627+0000 7f7b89948640 1 -- 172.21.15.142:0/3814732203 <== osd.2 v2:172.21.15.142:6808/279438927 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b7c018950 con 0x7f7b8404d2d0 2024-09-22T08:38:29.643 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.627+0000 7f7b89948640 1 -- 172.21.15.142:0/3814732203 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f7b80078040 con 0x561cbc580d80 2024-09-22T08:38:29.643 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.627+0000 7f7b8a149640 1 -- 172.21.15.142:0/3814732203 <== osd.3 v2:172.21.15.142:6800/1064901393 3 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b84053020 con 0x561cbc580d80 2024-09-22T08:38:29.644 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.627+0000 7f7b8a149640 1 -- 172.21.15.142:0/3814732203 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f7b80078040 con 0x561cbc57c3d0 2024-09-22T08:38:29.644 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.627+0000 7f7b89147640 1 -- 172.21.15.142:0/3814732203 <== osd.1 v2:172.21.15.142:6816/3192108003 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b80061430 con 0x561cbc57c3d0 2024-09-22T08:38:29.644 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.627+0000 7f7b89147640 1 -- 172.21.15.142:0/3814732203 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f7b80078040 con 0x7f7b7c017050 2024-09-22T08:38:29.644 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.627+0000 7f7b89147640 1 -- 172.21.15.142:0/3814732203 <== osd.0 v2:172.21.15.31:6800/168281188 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b80061430 con 0x7f7b7c017050 2024-09-22T08:38:29.644 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.627+0000 7f7b89147640 1 -- 172.21.15.142:0/3814732203 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f7b80078040 con 0x561cbc57c3d0 2024-09-22T08:38:29.644 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.628+0000 7f7b89147640 1 -- 172.21.15.142:0/3814732203 <== osd.1 v2:172.21.15.142:6816/3192108003 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b80061430 con 0x561cbc57c3d0 2024-09-22T08:38:29.644 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.628+0000 7f7b89147640 1 -- 172.21.15.142:0/3814732203 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f7b80078040 con 0x7f7b8404d2d0 2024-09-22T08:38:29.644 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.628+0000 7f7b89948640 1 -- 172.21.15.142:0/3814732203 <== osd.2 v2:172.21.15.142:6808/279438927 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f7b7c018950 con 0x7f7b8404d2d0 2024-09-22T08:38:29.644 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.628+0000 7f7b89948640 1 -- 172.21.15.142:0/3814732203 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f7b80078040 con 0x561cbc580d80 2024-09-22T08:38:29.644 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.628+0000 7f7b8a149640 1 -- 172.21.15.142:0/3814732203 <== osd.3 v2:172.21.15.142:6800/1064901393 4 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b84053020 con 0x561cbc580d80 2024-09-22T08:38:29.644 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.628+0000 7f7b8a149640 1 -- 172.21.15.142:0/3814732203 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f7b80078040 con 0x561cbc580d80 2024-09-22T08:38:29.644 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.628+0000 7f7b8a149640 1 -- 172.21.15.142:0/3814732203 <== osd.3 v2:172.21.15.142:6800/1064901393 5 ==== osd_op_reply(20 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f7b84053020 con 0x561cbc580d80 2024-09-22T08:38:29.644 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.628+0000 7f7b8a149640 1 -- 172.21.15.142:0/3814732203 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f7b80078040 con 0x7f7b7c017050 2024-09-22T08:38:29.645 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.629+0000 7f7b89147640 1 -- 172.21.15.142:0/3814732203 <== osd.0 v2:172.21.15.31:6800/168281188 4 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b80061430 con 0x7f7b7c017050 2024-09-22T08:38:29.645 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.629+0000 7f7b89147640 1 -- 172.21.15.142:0/3814732203 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f7b80078040 con 0x561cbc580d80 2024-09-22T08:38:29.645 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.629+0000 7f7b8a149640 1 -- 172.21.15.142:0/3814732203 <== osd.3 v2:172.21.15.142:6800/1064901393 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b84053020 con 0x561cbc580d80 2024-09-22T08:38:29.645 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.629+0000 7f7b8a149640 1 -- 172.21.15.142:0/3814732203 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f7b80078040 con 0x561cbc580d80 2024-09-22T08:38:29.645 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.629+0000 7f7b8a149640 1 -- 172.21.15.142:0/3814732203 <== osd.3 v2:172.21.15.142:6800/1064901393 7 ==== osd_op_reply(23 [pgnls start_epoch 32 out=107b] v32'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f7b84053020 con 0x561cbc580d80 2024-09-22T08:38:29.645 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.629+0000 7f7b8a149640 1 -- 172.21.15.142:0/3814732203 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f7b80078040 con 0x561cbc57c3d0 2024-09-22T08:38:29.645 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.629+0000 7f7b89147640 1 -- 172.21.15.142:0/3814732203 <== osd.1 v2:172.21.15.142:6816/3192108003 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b80061430 con 0x561cbc57c3d0 2024-09-22T08:38:29.645 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.629+0000 7f7b89147640 1 -- 172.21.15.142:0/3814732203 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f7b80078040 con 0x561cbc57c3d0 2024-09-22T08:38:29.645 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.629+0000 7f7b89147640 1 -- 172.21.15.142:0/3814732203 <== osd.1 v2:172.21.15.142:6816/3192108003 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v32'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f7b80061430 con 0x561cbc57c3d0 2024-09-22T08:38:29.645 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.629+0000 7f7b89147640 1 -- 172.21.15.142:0/3814732203 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f7b80078040 con 0x7f7b7c017050 2024-09-22T08:38:29.645 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.630+0000 7f7b89147640 1 -- 172.21.15.142:0/3814732203 <== osd.0 v2:172.21.15.31:6800/168281188 5 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b80061430 con 0x7f7b7c017050 2024-09-22T08:38:29.645 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.630+0000 7f7b89147640 1 -- 172.21.15.142:0/3814732203 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f7b80078040 con 0x561cbc580d80 2024-09-22T08:38:29.645 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.630+0000 7f7b8a149640 1 -- 172.21.15.142:0/3814732203 <== osd.3 v2:172.21.15.142:6800/1064901393 8 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b84053020 con 0x561cbc580d80 2024-09-22T08:38:29.646 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.630+0000 7f7b8a149640 1 -- 172.21.15.142:0/3814732203 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f7b80078040 con 0x7f7b8404d2d0 2024-09-22T08:38:29.646 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.630+0000 7f7b89948640 1 -- 172.21.15.142:0/3814732203 <== osd.2 v2:172.21.15.142:6808/279438927 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b7c018950 con 0x7f7b8404d2d0 2024-09-22T08:38:29.646 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.630+0000 7f7b89948640 1 -- 172.21.15.142:0/3814732203 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f7b80078040 con 0x561cbc57c3d0 2024-09-22T08:38:29.646 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.630+0000 7f7b89147640 1 -- 172.21.15.142:0/3814732203 <== osd.1 v2:172.21.15.142:6816/3192108003 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b80061430 con 0x561cbc57c3d0 2024-09-22T08:38:29.646 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.630+0000 7f7b89147640 1 -- 172.21.15.142:0/3814732203 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f7b80078040 con 0x7f7b7c017050 2024-09-22T08:38:29.646 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.631+0000 7f7b89147640 1 -- 172.21.15.142:0/3814732203 <== osd.0 v2:172.21.15.31:6800/168281188 6 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b80061430 con 0x7f7b7c017050 2024-09-22T08:38:29.646 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.631+0000 7f7b89147640 1 -- 172.21.15.142:0/3814732203 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f7b80078040 con 0x561cbc580d80 2024-09-22T08:38:29.646 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.631+0000 7f7b8a149640 1 -- 172.21.15.142:0/3814732203 <== osd.3 v2:172.21.15.142:6800/1064901393 9 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b84053020 con 0x561cbc580d80 2024-09-22T08:38:29.646 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.631+0000 7f7b8a149640 1 -- 172.21.15.142:0/3814732203 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f7b80078040 con 0x7f7b7c017050 2024-09-22T08:38:29.646 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.631+0000 7f7b89147640 1 -- 172.21.15.142:0/3814732203 <== osd.0 v2:172.21.15.31:6800/168281188 7 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b80061430 con 0x7f7b7c017050 2024-09-22T08:38:29.646 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.631+0000 7f7b89147640 1 -- 172.21.15.142:0/3814732203 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f7b80078040 con 0x7f7b8404d2d0 2024-09-22T08:38:29.646 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.632+0000 7f7b89948640 1 -- 172.21.15.142:0/3814732203 <== osd.2 v2:172.21.15.142:6808/279438927 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b7c018950 con 0x7f7b8404d2d0 2024-09-22T08:38:29.647 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.632+0000 7f7b89948640 1 -- 172.21.15.142:0/3814732203 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f7b80078040 con 0x561cbc580d80 2024-09-22T08:38:29.647 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.632+0000 7f7b8a149640 1 -- 172.21.15.142:0/3814732203 <== osd.3 v2:172.21.15.142:6800/1064901393 10 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b84053020 con 0x561cbc580d80 2024-09-22T08:38:29.647 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.632+0000 7f7b8a149640 1 -- 172.21.15.142:0/3814732203 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f7b80078040 con 0x7f7b7c017050 2024-09-22T08:38:29.647 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.632+0000 7f7b89147640 1 -- 172.21.15.142:0/3814732203 <== osd.0 v2:172.21.15.31:6800/168281188 8 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b80061430 con 0x7f7b7c017050 2024-09-22T08:38:29.647 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.632+0000 7f7b89147640 1 -- 172.21.15.142:0/3814732203 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f7b80078040 con 0x561cbc57c3d0 2024-09-22T08:38:29.647 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.632+0000 7f7b89147640 1 -- 172.21.15.142:0/3814732203 <== osd.1 v2:172.21.15.142:6816/3192108003 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v32'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f7b80061430 con 0x561cbc57c3d0 2024-09-22T08:38:29.647 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.632+0000 7f7b89147640 1 -- 172.21.15.142:0/3814732203 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f7b80078040 con 0x7f7b8404d2d0 2024-09-22T08:38:29.647 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.633+0000 7f7b89948640 1 -- 172.21.15.142:0/3814732203 <== osd.2 v2:172.21.15.142:6808/279438927 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b7c018950 con 0x7f7b8404d2d0 2024-09-22T08:38:29.647 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.633+0000 7f7b8e211800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:38:29.647 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.633+0000 7f7b8e211800 20 RGWRados::pool_iterate: got zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec 2024-09-22T08:38:29.647 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.633+0000 7f7b8e211800 20 RGWRados::pool_iterate: got zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f 2024-09-22T08:38:29.647 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.633+0000 7f7b8e211800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:38:29.647 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.633+0000 7f7b8e211800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:38:29.647 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.633+0000 7f7b8e211800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:38:29.648 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.633+0000 7f7b8e211800 20 rados->read ofs=0 len=0 2024-09-22T08:38:29.648 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.633+0000 7f7b8e211800 1 -- 172.21.15.142:0/3814732203 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561cbc5840f0 con 0x561cbc57c3d0 2024-09-22T08:38:29.648 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.633+0000 7f7b89147640 1 -- 172.21.15.142:0/3814732203 <== osd.1 v2:172.21.15.142:6816/3192108003 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7b80061430 con 0x561cbc57c3d0 2024-09-22T08:38:29.648 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.633+0000 7f7b8e211800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:29.648 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.633+0000 7f7b8e211800 20 rados->read ofs=0 len=0 2024-09-22T08:38:29.648 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.633+0000 7f7b8e211800 1 -- 172.21.15.142:0/3814732203 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561cbc584990 con 0x561cbc57c3d0 2024-09-22T08:38:29.648 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.633+0000 7f7b89147640 1 -- 172.21.15.142:0/3814732203 <== osd.1 v2:172.21.15.142:6816/3192108003 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7b80061430 con 0x561cbc57c3d0 2024-09-22T08:38:29.648 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.633+0000 7f7b8e211800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:38:29.648 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.633+0000 7f7b8e211800 20 rados->read ofs=0 len=0 2024-09-22T08:38:29.648 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.633+0000 7f7b8e211800 1 -- 172.21.15.142:0/3814732203 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:40 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561cbc585500 con 0x561cbc580d80 2024-09-22T08:38:29.648 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.634+0000 7f7b8a149640 1 -- 172.21.15.142:0/3814732203 <== osd.3 v2:172.21.15.142:6800/1064901393 11 ==== osd_op_reply(40 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f7b84053020 con 0x561cbc580d80 2024-09-22T08:38:29.648 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.634+0000 7f7b8e211800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:38:29.648 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.634+0000 7f7b8e211800 20 zone default found 2024-09-22T08:38:29.648 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.634+0000 7f7b8e211800 4 Realm: () 2024-09-22T08:38:29.649 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.634+0000 7f7b8e211800 4 ZoneGroup: default (d89f6f57-1007-47dd-9065-f486c7b01aec) 2024-09-22T08:38:29.649 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.634+0000 7f7b8e211800 4 Zone: default (e239248c-0bee-4e41-803a-24b288d3eb8f) 2024-09-22T08:38:29.649 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.634+0000 7f7b8e211800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:38:29.649 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.634+0000 7f7b8e211800 20 zonegroup default 2024-09-22T08:38:29.649 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.634+0000 7f7b8e211800 20 rados->read ofs=0 len=0 2024-09-22T08:38:29.649 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.634+0000 7f7b8e211800 1 -- 172.21.15.142:0/3814732203 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561cbc585910 con 0x7f7b7c017050 2024-09-22T08:38:29.649 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.634+0000 7f7b89147640 1 -- 172.21.15.142:0/3814732203 <== osd.0 v2:172.21.15.31:6800/168281188 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f7b80061430 con 0x7f7b7c017050 2024-09-22T08:38:29.649 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.634+0000 7f7b8e211800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:29.649 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.634+0000 7f7b8e211800 20 rados->read ofs=0 len=0 2024-09-22T08:38:29.649 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.634+0000 7f7b8e211800 1 -- 172.21.15.142:0/3814732203 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561cbc587740 con 0x561cbc580d80 2024-09-22T08:38:29.649 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.634+0000 7f7b8a149640 1 -- 172.21.15.142:0/3814732203 <== osd.3 v2:172.21.15.142:6800/1064901393 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7b84053020 con 0x561cbc580d80 2024-09-22T08:38:29.649 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.634+0000 7f7b8e211800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:29.650 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.634+0000 7f7b8e211800 20 rados->read ofs=0 len=0 2024-09-22T08:38:29.650 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.634+0000 7f7b8e211800 1 -- 172.21.15.142:0/3814732203 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561cbc587ba0 con 0x561cbc580d80 2024-09-22T08:38:29.650 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.634+0000 7f7b8a149640 1 -- 172.21.15.142:0/3814732203 <== osd.3 v2:172.21.15.142:6800/1064901393 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7b84053020 con 0x561cbc580d80 2024-09-22T08:38:29.650 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.635+0000 7f7b8e211800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:29.650 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.635+0000 7f7b8e211800 20 started sync module instance, tier type = 2024-09-22T08:38:29.650 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.635+0000 7f7b8e211800 20 started zone id=e239248c-0bee-4e41-803a-24b288d3eb8f (name=default) with tier type = 2024-09-22T08:38:29.650 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.635+0000 7f7b8e211800 1 -- 172.21.15.142:0/3814732203 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561cbc586be0 con 0x7f7b8404d2d0 2024-09-22T08:38:29.650 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.636+0000 7f7b89948640 1 -- 172.21.15.142:0/3814732203 <== osd.2 v2:172.21.15.142:6808/279438927 7 ==== osd_op_reply(44 notify.0 [create] v32'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b7c018950 con 0x7f7b8404d2d0 2024-09-22T08:38:29.650 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.636+0000 7f7b8e211800 1 -- 172.21.15.142:0/3814732203 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94681418983216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561cbc588000 con 0x7f7b8404d2d0 2024-09-22T08:38:29.650 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.636+0000 7f7b8e211800 1 -- 172.21.15.142:0/3814732203 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561cbc588850 con 0x561cbc57c3d0 2024-09-22T08:38:29.650 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.637+0000 7f7b89147640 1 -- 172.21.15.142:0/3814732203 <== osd.1 v2:172.21.15.142:6816/3192108003 16 ==== osd_op_reply(46 notify.1 [create] v32'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b80061430 con 0x561cbc57c3d0 2024-09-22T08:38:29.650 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.637+0000 7f7b8e211800 1 -- 172.21.15.142:0/3814732203 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94681418990496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561cbc588e90 con 0x561cbc57c3d0 2024-09-22T08:38:29.650 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.637+0000 7f7b8e211800 1 -- 172.21.15.142:0/3814732203 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561cbc5899b0 con 0x561cbc580d80 2024-09-22T08:38:29.656 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.638+0000 7f7b89147640 1 -- 172.21.15.142:0/3814732203 <== osd.1 v2:172.21.15.142:6816/3192108003 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94681418990496] v32'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b80061430 con 0x561cbc57c3d0 2024-09-22T08:38:29.656 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.638+0000 7f7b89948640 1 -- 172.21.15.142:0/3814732203 <== osd.2 v2:172.21.15.142:6808/279438927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94681418983216] v32'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b7c018950 con 0x7f7b8404d2d0 2024-09-22T08:38:29.656 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.638+0000 7f7b8a149640 1 -- 172.21.15.142:0/3814732203 <== osd.3 v2:172.21.15.142:6800/1064901393 14 ==== osd_op_reply(48 notify.2 [create] v32'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b84053020 con 0x561cbc580d80 2024-09-22T08:38:29.656 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.638+0000 7f7b8e211800 1 -- 172.21.15.142:0/3814732203 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94681418985424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561cbc589970 con 0x561cbc580d80 2024-09-22T08:38:29.656 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.638+0000 7f7b8e211800 1 -- 172.21.15.142:0/3814732203 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561cbc58a250 con 0x7f7b8404d2d0 2024-09-22T08:38:29.656 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.639+0000 7f7b8a149640 1 -- 172.21.15.142:0/3814732203 <== osd.3 v2:172.21.15.142:6800/1064901393 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94681418985424] v32'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b84053020 con 0x561cbc580d80 2024-09-22T08:38:29.656 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.639+0000 7f7b89948640 1 -- 172.21.15.142:0/3814732203 <== osd.2 v2:172.21.15.142:6808/279438927 9 ==== osd_op_reply(50 notify.3 [create] v32'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b7c018950 con 0x7f7b8404d2d0 2024-09-22T08:38:29.656 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.639+0000 7f7b8e211800 1 -- 172.21.15.142:0/3814732203 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94681418997152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561cbc589970 con 0x7f7b8404d2d0 2024-09-22T08:38:29.656 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.639+0000 7f7b8e211800 1 -- 172.21.15.142:0/3814732203 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561cbc58acf0 con 0x561cbc57c3d0 2024-09-22T08:38:29.656 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.640+0000 7f7b89948640 1 -- 172.21.15.142:0/3814732203 <== osd.2 v2:172.21.15.142:6808/279438927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94681418997152] v32'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b7c018950 con 0x7f7b8404d2d0 2024-09-22T08:38:29.656 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.641+0000 7f7b89147640 1 -- 172.21.15.142:0/3814732203 <== osd.1 v2:172.21.15.142:6816/3192108003 18 ==== osd_op_reply(52 notify.4 [create] v32'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b80061430 con 0x561cbc57c3d0 2024-09-22T08:38:29.657 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.641+0000 7f7b8e211800 1 -- 172.21.15.142:0/3814732203 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94681418999872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561cbc58ac60 con 0x561cbc57c3d0 2024-09-22T08:38:29.657 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.641+0000 7f7b8e211800 1 -- 172.21.15.142:0/3814732203 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561cbc58bbe0 con 0x7f7b7c017050 2024-09-22T08:38:29.657 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.642+0000 7f7b89147640 1 -- 172.21.15.142:0/3814732203 <== osd.0 v2:172.21.15.31:6800/168281188 10 ==== osd_op_reply(54 notify.5 [create] v32'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b80061430 con 0x7f7b7c017050 2024-09-22T08:38:29.657 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.642+0000 7f7b8e211800 1 -- 172.21.15.142:0/3814732203 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94681419003696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561cbc58c000 con 0x7f7b7c017050 2024-09-22T08:38:29.657 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.642+0000 7f7b8e211800 1 -- 172.21.15.142:0/3814732203 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561cbc58cad0 con 0x7f7b7c017050 2024-09-22T08:38:29.657 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.642+0000 7f7b89147640 1 -- 172.21.15.142:0/3814732203 <== osd.1 v2:172.21.15.142:6816/3192108003 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94681418999872] v32'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b80061430 con 0x561cbc57c3d0 2024-09-22T08:38:29.657 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.643+0000 7f7b89147640 1 -- 172.21.15.142:0/3814732203 <== osd.0 v2:172.21.15.31:6800/168281188 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94681419003696] v32'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b80061430 con 0x7f7b7c017050 2024-09-22T08:38:29.657 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.643+0000 7f7b89147640 1 -- 172.21.15.142:0/3814732203 <== osd.0 v2:172.21.15.31:6800/168281188 12 ==== osd_op_reply(56 notify.6 [create] v32'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b80061430 con 0x7f7b7c017050 2024-09-22T08:38:29.657 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.643+0000 7f7b8e211800 1 -- 172.21.15.142:0/3814732203 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94681419007424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561cbc58bb50 con 0x7f7b7c017050 2024-09-22T08:38:29.657 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.643+0000 7f7b8e211800 1 -- 172.21.15.142:0/3814732203 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561cbc58d160 con 0x7f7b7c017050 2024-09-22T08:38:29.657 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.644+0000 7f7b89147640 1 -- 172.21.15.142:0/3814732203 <== osd.0 v2:172.21.15.31:6800/168281188 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94681419007424] v32'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b80061430 con 0x7f7b7c017050 2024-09-22T08:38:29.657 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.644+0000 7f7b89147640 1 -- 172.21.15.142:0/3814732203 <== osd.0 v2:172.21.15.31:6800/168281188 14 ==== osd_op_reply(58 notify.7 [create] v32'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b80061430 con 0x7f7b7c017050 2024-09-22T08:38:29.657 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.644+0000 7f7b8e211800 1 -- 172.21.15.142:0/3814732203 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94681419002128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561cbc58d160 con 0x7f7b7c017050 2024-09-22T08:38:29.658 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.644+0000 7f7b8e211800 20 add_watcher() i=0 2024-09-22T08:38:29.658 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.644+0000 7f7b8e211800 20 add_watcher() i=1 2024-09-22T08:38:29.658 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.644+0000 7f7b8e211800 20 add_watcher() i=2 2024-09-22T08:38:29.658 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.644+0000 7f7b8e211800 20 add_watcher() i=3 2024-09-22T08:38:29.658 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.644+0000 7f7b8e211800 20 add_watcher() i=4 2024-09-22T08:38:29.658 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.644+0000 7f7b8e211800 20 add_watcher() i=5 2024-09-22T08:38:29.658 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.644+0000 7f7b8e211800 20 add_watcher() i=6 2024-09-22T08:38:29.658 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.645+0000 7f7b89147640 1 -- 172.21.15.142:0/3814732203 <== osd.0 v2:172.21.15.31:6800/168281188 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94681419002128] v32'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b80061430 con 0x7f7b7c017050 2024-09-22T08:38:29.658 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.645+0000 7f7b8e211800 20 add_watcher() i=7 2024-09-22T08:38:29.658 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.645+0000 7f7b8e211800 2 all 8 watchers are set, enabling cache 2024-09-22T08:38:29.658 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.645+0000 7f7b8e211800 1 -- 172.21.15.142:0/3814732203 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561cbc590530 con 0x561cbc57c3d0 2024-09-22T08:38:29.658 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.646+0000 7f7b89147640 1 -- 172.21.15.142:0/3814732203 <== osd.1 v2:172.21.15.142:6816/3192108003 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f7b80061430 con 0x561cbc57c3d0 2024-09-22T08:38:29.658 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.646+0000 7f7b8e211800 1 -- 172.21.15.142:0/3814732203 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94681419022000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561cbc58d160 con 0x561cbc57c3d0 2024-09-22T08:38:29.658 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.647+0000 7f7b89147640 1 -- 172.21.15.142:0/3814732203 <== osd.1 v2:172.21.15.142:6816/3192108003 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94681419022000] v32'242 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7b80061430 con 0x561cbc57c3d0 2024-09-22T08:38:29.659 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.647+0000 7f7a3b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:38:29.659 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.647+0000 7f7b8e211800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:38:29.659 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.647+0000 7f7b8e211800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:38:29.659 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.647+0000 7f7b8e211800 5 note: GC not initialized 2024-09-22T08:38:29.659 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.647+0000 7f7a3a7fc640 20 reqs_thread_entry: start 2024-09-22T08:38:29.659 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.647+0000 7f7b8e211800 20 init_complete bucket index max shards: 11 2024-09-22T08:38:29.659 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.647+0000 7f7b8e211800 20 Filter name: none 2024-09-22T08:38:29.659 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.648+0000 7f79abfff640 20 reqs_thread_entry: start 2024-09-22T08:38:29.659 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.648+0000 7f7b8e211800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-22T08:38:29.659 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.648+0000 7f7b8e211800 20 rados->read ofs=0 len=0 2024-09-22T08:38:29.659 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.648+0000 7f7b8e211800 1 -- 172.21.15.142:0/3814732203 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561cbc5c37f0 con 0x7f7b7c017050 2024-09-22T08:38:29.659 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.648+0000 7f7b89147640 1 -- 172.21.15.142:0/3814732203 <== osd.0 v2:172.21.15.31:6800/168281188 16 ==== osd_op_reply(62 ada [call out=48b,read 0~473 out=473b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 231+0+596 (crc 0 0 0) 0x7f7b80061430 con 0x7f7b7c017050 2024-09-22T08:38:29.659 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.648+0000 7f7b8e211800 20 rados_obj.operate() r=0 bl.length=473 2024-09-22T08:38:29.659 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.649+0000 7f7b8e211800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-22T08:38:29.660 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.649+0000 7f7b8e211800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-22T08:38:29.660 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.649+0000 7f7b8e211800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:38:29.660 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.649+0000 7f7b8e211800 1 -- 172.21.15.142:0/3814732203 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~460 in=460b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561cbc5ca070 con 0x7f7b7c017050 2024-09-22T08:38:29.660 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.650+0000 7f7b89147640 1 -- 172.21.15.142:0/3814732203 <== osd.0 v2:172.21.15.31:6800/168281188 17 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~460] v32'5 uv5 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f7b80081040 con 0x7f7b7c017050 2024-09-22T08:38:29.660 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.650+0000 7f7b8e211800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-22T08:38:29.660 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.650+0000 7f7b8e211800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-22T08:38:29.660 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.650+0000 7f7b8e211800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-22T08:38:29.660 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.650+0000 7f7b8e211800 1 -- 172.21.15.142:0/3814732203 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94681419258480 in=648b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561cbc5c5770 con 0x561cbc57c3d0 2024-09-22T08:38:29.660 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.650+0000 7f7b89147640 1 -- 172.21.15.142:0/3814732203 <== osd.1 v2:172.21.15.142:6816/3192108003 22 ==== watch-notify(notify (1) cookie 94681418999872 notify 137438953493 ret 0) ==== 678+0+0 (crc 0 0 0) 0x561cbc450540 con 0x561cbc57c3d0 2024-09-22T08:38:29.660 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.650+0000 7f7a6d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953493 cookie 94681418999872 notifier 4835 bl.length()=636 2024-09-22T08:38:29.660 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.650+0000 7f7a6d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-22T08:38:29.660 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.650+0000 7f7b89147640 1 -- 172.21.15.142:0/3814732203 <== osd.1 v2:172.21.15.142:6816/3192108003 23 ==== osd_op_reply(64 notify.4 [notify cookie 94681419258480 out=8b] v0'0 uv243 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f7b80081040 con 0x561cbc57c3d0 2024-09-22T08:38:29.660 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.650+0000 7f7a6d7fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-22T08:38:29.660 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.650+0000 7f7a6d7fa640 1 -- 172.21.15.142:0/3814732203 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f7a4c003ea0 con 0x561cbc57c3d0 2024-09-22T08:38:29.660 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.650+0000 7f7b89147640 1 -- 172.21.15.142:0/3814732203 <== osd.1 v2:172.21.15.142:6816/3192108003 24 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b80081040 con 0x561cbc57c3d0 2024-09-22T08:38:29.661 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.650+0000 7f7b89147640 1 -- 172.21.15.142:0/3814732203 <== osd.1 v2:172.21.15.142:6816/3192108003 25 ==== watch-notify(notify_complete (2) cookie 94681419258480 notify 137438953493 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f7b80079450 con 0x561cbc57c3d0 2024-09-22T08:38:29.661 INFO:teuthology.orchestra.run.smithi142.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-22T08:38:29.459914Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-22T08:38:29.459903Z","tags":[],"group_ids":[]} 2024-09-22T08:38:29.663 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.651+0000 7f7a3b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:38:29.663 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.651+0000 7f7b8e211800 1 -- 172.21.15.142:0/3814732203 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94681419022000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561cbc5c1500 con 0x561cbc57c3d0 2024-09-22T08:38:29.663 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.652+0000 7f7b89147640 1 -- 172.21.15.142:0/3814732203 <== osd.1 v2:172.21.15.142:6816/3192108003 26 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94681419022000] v32'243 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7b80081040 con 0x561cbc57c3d0 2024-09-22T08:38:29.664 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.652+0000 7f7b8e211800 1 -- 172.21.15.142:0/3814732203 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94681418983216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561cbc5c1500 con 0x7f7b8404d2d0 2024-09-22T08:38:29.664 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.653+0000 7f7b89948640 1 -- 172.21.15.142:0/3814732203 <== osd.2 v2:172.21.15.142:6808/279438927 11 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94681418983216] v32'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b7c018950 con 0x7f7b8404d2d0 2024-09-22T08:38:29.664 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.653+0000 7f7b8e211800 20 remove_watcher() i=0 2024-09-22T08:38:29.664 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.653+0000 7f7b8e211800 2 removed watcher, disabling cache 2024-09-22T08:38:29.664 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.653+0000 7f7b8e211800 1 -- 172.21.15.142:0/3814732203 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94681418990496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561cbc5c1500 con 0x561cbc57c3d0 2024-09-22T08:38:29.664 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.655+0000 7f7b89147640 1 -- 172.21.15.142:0/3814732203 <== osd.1 v2:172.21.15.142:6816/3192108003 27 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94681418990496] v32'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b80081040 con 0x561cbc57c3d0 2024-09-22T08:38:29.664 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.655+0000 7f7b8e211800 20 remove_watcher() i=1 2024-09-22T08:38:29.664 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.655+0000 7f7b8e211800 1 -- 172.21.15.142:0/3814732203 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94681418985424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561cbc5c1500 con 0x561cbc580d80 2024-09-22T08:38:29.664 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.656+0000 7f7b8a149640 1 -- 172.21.15.142:0/3814732203 <== osd.3 v2:172.21.15.142:6800/1064901393 16 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94681418985424] v32'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b84053020 con 0x561cbc580d80 2024-09-22T08:38:29.664 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.656+0000 7f7b8e211800 20 remove_watcher() i=2 2024-09-22T08:38:29.664 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.656+0000 7f7b8e211800 1 -- 172.21.15.142:0/3814732203 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94681418997152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561cbc5c1500 con 0x7f7b8404d2d0 2024-09-22T08:38:29.664 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.657+0000 7f7b89948640 1 -- 172.21.15.142:0/3814732203 <== osd.2 v2:172.21.15.142:6808/279438927 12 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94681418997152] v32'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b7c018950 con 0x7f7b8404d2d0 2024-09-22T08:38:29.664 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.657+0000 7f7b8e211800 20 remove_watcher() i=3 2024-09-22T08:38:29.664 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.657+0000 7f7b8e211800 1 -- 172.21.15.142:0/3814732203 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94681418999872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561cbc5c1500 con 0x561cbc57c3d0 2024-09-22T08:38:29.665 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.658+0000 7f7b89147640 1 -- 172.21.15.142:0/3814732203 <== osd.1 v2:172.21.15.142:6816/3192108003 28 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94681418999872] v32'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b80081040 con 0x561cbc57c3d0 2024-09-22T08:38:29.665 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.658+0000 7f7b8e211800 20 remove_watcher() i=4 2024-09-22T08:38:29.665 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.658+0000 7f7b8e211800 1 -- 172.21.15.142:0/3814732203 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94681419003696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561cbc5c1500 con 0x7f7b7c017050 2024-09-22T08:38:29.665 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.659+0000 7f7b89147640 1 -- 172.21.15.142:0/3814732203 <== osd.0 v2:172.21.15.31:6800/168281188 18 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94681419003696] v32'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b80081040 con 0x7f7b7c017050 2024-09-22T08:38:29.665 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.659+0000 7f7b8e211800 20 remove_watcher() i=5 2024-09-22T08:38:29.665 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.659+0000 7f7b8e211800 1 -- 172.21.15.142:0/3814732203 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94681419007424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561cbc5c1500 con 0x7f7b7c017050 2024-09-22T08:38:29.665 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.660+0000 7f7b89147640 1 -- 172.21.15.142:0/3814732203 <== osd.0 v2:172.21.15.31:6800/168281188 19 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94681419007424] v32'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b80081040 con 0x7f7b7c017050 2024-09-22T08:38:29.665 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.660+0000 7f7b8e211800 20 remove_watcher() i=6 2024-09-22T08:38:29.665 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.660+0000 7f7b8e211800 1 -- 172.21.15.142:0/3814732203 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94681419002128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561cbc5c1500 con 0x7f7b7c017050 2024-09-22T08:38:29.668 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.661+0000 7f7b89147640 1 -- 172.21.15.142:0/3814732203 <== osd.0 v2:172.21.15.31:6800/168281188 20 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94681419002128] v32'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b80081040 con 0x7f7b7c017050 2024-09-22T08:38:29.668 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.662+0000 7f7b8e211800 20 remove_watcher() i=7 2024-09-22T08:38:29.668 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.662+0000 7f7b8e211800 1 -- 172.21.15.142:0/3814732203 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f7b7c017050 msgr2=0x7f7b7c0512a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:29.668 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.662+0000 7f7b8e211800 1 --2- 172.21.15.142:0/3814732203 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f7b7c017050 0x7f7b7c0512a0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:29.668 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.662+0000 7f7b8e211800 1 -- 172.21.15.142:0/3814732203 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x561cbc57c3d0 msgr2=0x561cbc57e890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:29.668 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.662+0000 7f7b8e211800 1 --2- 172.21.15.142:0/3814732203 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x561cbc57c3d0 0x561cbc57e890 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:29.668 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.662+0000 7f7b8e211800 1 -- 172.21.15.142:0/3814732203 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f7b8404d2d0 msgr2=0x7f7b8404d710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:29.668 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.662+0000 7f7b8e211800 1 --2- 172.21.15.142:0/3814732203 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f7b8404d2d0 0x7f7b8404d710 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:29.668 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.662+0000 7f7b8e211800 1 -- 172.21.15.142:0/3814732203 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x561cbc580d80 msgr2=0x561cbc583170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:29.668 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.662+0000 7f7b8e211800 1 --2- 172.21.15.142:0/3814732203 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x561cbc580d80 0x561cbc583170 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:29.668 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.662+0000 7f7b8e211800 1 -- 172.21.15.142:0/3814732203 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f7a5403d150 msgr2=0x7f7a5403f610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:29.669 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.662+0000 7f7b8e211800 1 --2- 172.21.15.142:0/3814732203 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f7a5403d150 0x7f7a5403f610 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f7b7c052e80 tx=0x7f7b7c04f000 comp rx=0 tx=0).stop 2024-09-22T08:38:29.669 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.662+0000 7f7b8e211800 1 -- 172.21.15.142:0/3814732203 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561cbc5696a0 msgr2=0x561cbc570c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:29.669 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.662+0000 7f7b89147640 1 -- 172.21.15.142:0/3814732203 reap_dead start 2024-09-22T08:38:29.669 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.662+0000 7f7b8e211800 1 --2- 172.21.15.142:0/3814732203 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561cbc5696a0 0x561cbc570c30 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f7b84020560 tx=0x7f7b84054790 comp rx=0 tx=0).stop 2024-09-22T08:38:29.669 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.662+0000 7f7b8e211800 1 -- 172.21.15.142:0/3814732203 shutdown_connections 2024-09-22T08:38:29.669 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.662+0000 7f7b8e211800 1 --2- 172.21.15.142:0/3814732203 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561cbc5696a0 0x561cbc570c30 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:29.669 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.662+0000 7f7b8e211800 1 -- 172.21.15.142:0/3814732203 >> 172.21.15.142:0/3814732203 conn(0x561cbc565aa0 msgr2=0x561cbc563cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:38:29.669 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.662+0000 7f7b8e211800 1 -- 172.21.15.142:0/3814732203 shutdown_connections 2024-09-22T08:38:29.669 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.662+0000 7f7b8e211800 1 -- 172.21.15.142:0/3814732203 wait complete. 2024-09-22T08:38:29.669 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.662+0000 7f7b8e211800 1 -- 172.21.15.142:0/1802996046 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f7a6403d000 msgr2=0x7f7a6403f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:29.669 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.662+0000 7f7b8e211800 1 --2- 172.21.15.142:0/1802996046 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f7a6403d000 0x7f7a6403f4c0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x561cbc54e5e0 tx=0x7f7b7c00dec0 comp rx=0 tx=0).stop 2024-09-22T08:38:29.669 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.662+0000 7f7b8e211800 1 -- 172.21.15.142:0/1802996046 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561cbc55cc00 msgr2=0x561cbc55d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:29.669 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.662+0000 7f7b8e211800 1 --2- 172.21.15.142:0/1802996046 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561cbc55cc00 0x561cbc55d020 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x561cbc5431e0 tx=0x7f7b840167b0 comp rx=0 tx=0).stop 2024-09-22T08:38:29.670 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.662+0000 7f7b8e211800 1 -- 172.21.15.142:0/1802996046 shutdown_connections 2024-09-22T08:38:29.670 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.662+0000 7f7b8e211800 1 --2- 172.21.15.142:0/1802996046 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f7a6403d000 0x7f7a6403f4c0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:29.670 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.662+0000 7f7b8e211800 1 --2- 172.21.15.142:0/1802996046 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561cbc55cc00 0x561cbc55d020 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:29.670 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.662+0000 7f7b8e211800 1 -- 172.21.15.142:0/1802996046 >> 172.21.15.142:0/1802996046 conn(0x561cbc550fb0 msgr2=0x561cbc551390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:38:29.670 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.662+0000 7f7b8e211800 1 -- 172.21.15.142:0/1802996046 shutdown_connections 2024-09-22T08:38:29.670 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.662+0000 7f7b8e211800 1 -- 172.21.15.142:0/1802996046 wait complete. 2024-09-22T08:38:29.670 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.663+0000 7f7b8e211800 1 -- 172.21.15.142:0/2741854053 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x561cbc44cb70 msgr2=0x561cbc549210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:29.670 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.663+0000 7f7b8e211800 1 --2- 172.21.15.142:0/2741854053 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x561cbc44cb70 0x561cbc549210 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:29.670 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.663+0000 7f7b8e211800 1 -- 172.21.15.142:0/2741854053 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x561cbc54b630 msgr2=0x561cbc54dab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:29.670 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.663+0000 7f7b8e211800 1 --2- 172.21.15.142:0/2741854053 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x561cbc54b630 0x561cbc54dab0 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:29.670 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.663+0000 7f7b8e211800 1 -- 172.21.15.142:0/2741854053 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f7a7003d000 msgr2=0x7f7a7003f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:29.670 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.663+0000 7f7b8e211800 1 --2- 172.21.15.142:0/2741854053 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f7a7003d000 0x7f7a7003f4c0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x561cbc3bb8e0 tx=0x7f7b80050000 comp rx=0 tx=0).stop 2024-09-22T08:38:29.670 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.663+0000 7f7b8e211800 1 -- 172.21.15.142:0/2741854053 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561cbc449060 msgr2=0x561cbc541bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:29.671 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.663+0000 7f7b8e211800 1 --2- 172.21.15.142:0/2741854053 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561cbc449060 0x561cbc541bc0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x561cbc448300 tx=0x7f7b7c0040e0 comp rx=0 tx=0).stop 2024-09-22T08:38:29.671 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.663+0000 7f7b8e211800 1 -- 172.21.15.142:0/2741854053 shutdown_connections 2024-09-22T08:38:29.671 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.663+0000 7f7b8e211800 1 --2- 172.21.15.142:0/2741854053 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x561cbc54b630 0x561cbc54dab0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:29.671 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.663+0000 7f7b8e211800 1 --2- 172.21.15.142:0/2741854053 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x561cbc44cb70 0x561cbc549210 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:29.671 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.663+0000 7f7b8e211800 1 --2- 172.21.15.142:0/2741854053 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f7a7003d000 0x7f7a7003f4c0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:29.671 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.663+0000 7f7b8e211800 1 --2- 172.21.15.142:0/2741854053 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561cbc449060 0x561cbc541bc0 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:29.671 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.663+0000 7f7b8e211800 1 -- 172.21.15.142:0/2741854053 >> 172.21.15.142:0/2741854053 conn(0x561cbc442ba0 msgr2=0x561cbc5333e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:38:29.671 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.663+0000 7f7b8e211800 1 -- 172.21.15.142:0/2741854053 shutdown_connections 2024-09-22T08:38:29.671 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.663+0000 7f7b8e211800 1 -- 172.21.15.142:0/2741854053 wait complete. 2024-09-22T08:38:29.674 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-22T08:38:29.459914Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-22T08:38:29.459903Z', 'tags': [], 'group_ids': []} 2024-09-22T08:38:29.674 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-22T08:38:29.459914Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-22T08:38:29.459903Z', 'tags': [], 'group_ids': []} 2024-09-22T08:38:29.674 ERROR:root:0 2024-09-22T08:38:29.674 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'system_user', '--display-name', 'System User', '--access-key', 'system_akey', '--secret', 'system_skey', '--caps', 'user-info-without-keys=read', '--system'] 2024-09-22T08:38:29.674 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'system_user', '--display-name', 'System User', '--access-key', 'system_akey', '--secret', 'system_skey', '--caps', 'user-info-without-keys=read', '--system'] 2024-09-22T08:38:29.674 DEBUG:teuthology.orchestra.run.smithi142:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid system_user --display-name 'System User' --access-key system_akey --secret system_skey --caps user-info-without-keys=read --system 2024-09-22T08:38:29.728 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:38:29.728 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:38:29.729 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.727+0000 7f340562f800 1 Processor -- start 2024-09-22T08:38:29.729 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.727+0000 7f340562f800 1 -- start start 2024-09-22T08:38:29.729 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.727+0000 7f340562f800 1 --2- >> v2:172.21.15.31:3300/0 conn(0x557a4d005540 0x557a4d096540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:29.729 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.727+0000 7f340562f800 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x557a4cf1ca20 con 0x557a4d096a80 2024-09-22T08:38:29.729 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.727+0000 7f340562f800 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x557a4cf1c7d0 con 0x557a4d005540 2024-09-22T08:38:29.730 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.727+0000 7f3403119640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x557a4d005540 0x557a4d096540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:29.730 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.727+0000 7f3402918640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x557a4d096a80 0x557a4d098f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.142:50472/0 (socket says 172.21.15.142:50472) 2024-09-22T08:38:29.730 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.727+0000 7f3403119640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x557a4d005540 0x557a4d096540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:51694/0 (socket says 172.21.15.142:51694) 2024-09-22T08:38:29.730 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.727+0000 7f3402918640 1 -- 172.21.15.142:0/2390145933 learned_addr learned my addr 172.21.15.142:0/2390145933 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-09-22T08:38:29.730 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.727+0000 7f3403119640 1 -- 172.21.15.142:0/2390145933 >> v1:172.21.15.31:6789/0 conn(0x557a4d096a80 legacy=0x557a4d098f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:29.730 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.727+0000 7f3403119640 1 -- 172.21.15.142:0/2390145933 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x557a4d09b7e0 con 0x557a4d005540 2024-09-22T08:38:29.731 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.729+0000 7f3403119640 1 --2- 172.21.15.142:0/2390145933 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557a4d005540 0x557a4d096540 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f33f400a470 tx=0x7f33f4045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e5a5c1f63451d2b server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:29.732 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.730+0000 7f3402117640 1 -- 172.21.15.142:0/2390145933 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f33f4053570 con 0x557a4d005540 2024-09-22T08:38:29.732 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.730+0000 7f3402117640 1 -- 172.21.15.142:0/2390145933 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33f4058070 con 0x557a4d005540 2024-09-22T08:38:29.732 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.730+0000 7f3402117640 1 -- 172.21.15.142:0/2390145933 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f33f4053880 con 0x557a4d005540 2024-09-22T08:38:29.732 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.730+0000 7f340562f800 1 -- 172.21.15.142:0/2390145933 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557a4d005540 msgr2=0x557a4d096540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:29.732 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.730+0000 7f340562f800 1 --2- 172.21.15.142:0/2390145933 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557a4d005540 0x557a4d096540 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f33f400a470 tx=0x7f33f4045a20 comp rx=0 tx=0).stop 2024-09-22T08:38:29.733 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.730+0000 7f340562f800 1 -- 172.21.15.142:0/2390145933 shutdown_connections 2024-09-22T08:38:29.733 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.730+0000 7f340562f800 1 --2- 172.21.15.142:0/2390145933 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557a4d005540 0x557a4d096540 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:29.733 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.730+0000 7f340562f800 1 -- 172.21.15.142:0/2390145933 >> 172.21.15.142:0/2390145933 conn(0x557a4d08bc30 msgr2=0x557a4d08e070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:38:29.733 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.730+0000 7f340562f800 1 -- 172.21.15.142:0/2390145933 shutdown_connections 2024-09-22T08:38:29.733 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.730+0000 7f340562f800 1 -- 172.21.15.142:0/2390145933 wait complete. 2024-09-22T08:38:29.746 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.744+0000 7f340562f800 1 Processor -- start 2024-09-22T08:38:29.746 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.744+0000 7f340562f800 1 -- start start 2024-09-22T08:38:29.746 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.744+0000 7f340562f800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557a4d005540 0x557a4d183290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:29.746 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.744+0000 7f340562f800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x557a4cf29dd0 con 0x557a4d005540 2024-09-22T08:38:29.747 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.744+0000 7f3403119640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557a4d005540 0x557a4d183290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:29.747 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.744+0000 7f3403119640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557a4d005540 0x557a4d183290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:51706/0 (socket says 172.21.15.142:51706) 2024-09-22T08:38:29.747 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.744+0000 7f3403119640 1 -- 172.21.15.142:0/1599517006 learned_addr learned my addr 172.21.15.142:0/1599517006 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:38:29.747 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.745+0000 7f3403119640 1 -- 172.21.15.142:0/1599517006 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557a4d183880 con 0x557a4d005540 2024-09-22T08:38:29.747 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.745+0000 7f3403119640 1 --2- 172.21.15.142:0/1599517006 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557a4d005540 0x557a4d183290 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f33f4025c20 tx=0x7f33f4051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=850b2d082d487053 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:29.747 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.745+0000 7f32f160a640 1 -- 172.21.15.142:0/1599517006 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f33f4053a20 con 0x557a4d005540 2024-09-22T08:38:29.748 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.745+0000 7f32f160a640 1 -- 172.21.15.142:0/1599517006 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33f4063070 con 0x557a4d005540 2024-09-22T08:38:29.748 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.745+0000 7f32f160a640 1 -- 172.21.15.142:0/1599517006 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f33f4053cf0 con 0x557a4d005540 2024-09-22T08:38:29.749 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.746+0000 7f340562f800 1 -- 172.21.15.142:0/1599517006 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557a4d005540 msgr2=0x557a4d183290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:29.749 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.746+0000 7f340562f800 1 --2- 172.21.15.142:0/1599517006 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557a4d005540 0x557a4d183290 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f33f4025c20 tx=0x7f33f4051000 comp rx=0 tx=0).stop 2024-09-22T08:38:29.749 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.746+0000 7f340562f800 1 -- 172.21.15.142:0/1599517006 shutdown_connections 2024-09-22T08:38:29.749 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.746+0000 7f340562f800 1 --2- 172.21.15.142:0/1599517006 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557a4d005540 0x557a4d183290 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:29.749 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.746+0000 7f340562f800 1 -- 172.21.15.142:0/1599517006 >> 172.21.15.142:0/1599517006 conn(0x557a4d08bc30 msgr2=0x557a4d17ec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:38:29.749 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.746+0000 7f340562f800 1 -- 172.21.15.142:0/1599517006 shutdown_connections 2024-09-22T08:38:29.749 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.746+0000 7f340562f800 1 -- 172.21.15.142:0/1599517006 wait complete. 2024-09-22T08:38:29.749 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.746+0000 7f340562f800 1 Processor -- start 2024-09-22T08:38:29.749 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.746+0000 7f340562f800 1 -- start start 2024-09-22T08:38:29.750 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.746+0000 7f340562f800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557a4d005540 0x557a4d18ad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:29.750 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.746+0000 7f340562f800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x557a4d09aa80 con 0x557a4d005540 2024-09-22T08:38:29.750 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.747+0000 7f3403119640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557a4d005540 0x557a4d18ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:29.750 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.747+0000 7f3403119640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557a4d005540 0x557a4d18ad50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:51718/0 (socket says 172.21.15.142:51718) 2024-09-22T08:38:29.750 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.747+0000 7f3403119640 1 -- 172.21.15.142:0/1926375050 learned_addr learned my addr 172.21.15.142:0/1926375050 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:38:29.750 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.747+0000 7f3403119640 1 -- 172.21.15.142:0/1926375050 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557a4d18b2b0 con 0x557a4d005540 2024-09-22T08:38:29.752 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.747+0000 7f3403119640 1 --2- 172.21.15.142:0/1926375050 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557a4d005540 0x557a4d18ad50 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f33f4025c20 tx=0x7f33f4002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:29.752 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.747+0000 7f32efe07640 1 -- 172.21.15.142:0/1926375050 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f33f4068660 con 0x557a4d005540 2024-09-22T08:38:29.752 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.747+0000 7f32efe07640 1 -- 172.21.15.142:0/1926375050 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33f4068800 con 0x557a4d005540 2024-09-22T08:38:29.752 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.747+0000 7f340562f800 1 -- 172.21.15.142:0/1926375050 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557a4d18b540 con 0x557a4d005540 2024-09-22T08:38:29.752 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.747+0000 7f32efe07640 1 -- 172.21.15.142:0/1926375050 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f33f4068ae0 con 0x557a4d005540 2024-09-22T08:38:29.752 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.747+0000 7f340562f800 1 -- 172.21.15.142:0/1926375050 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557a4d18c150 con 0x557a4d005540 2024-09-22T08:38:29.752 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.748+0000 7f32efe07640 1 -- 172.21.15.142:0/1926375050 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f33f4068c80 con 0x557a4d005540 2024-09-22T08:38:29.753 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.749+0000 7f32efe07640 1 --2- 172.21.15.142:0/1926375050 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f32e803d000 0x7f32e803f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:29.753 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.749+0000 7f32efe07640 1 -- 172.21.15.142:0/1926375050 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5938+0+0 (secure 0 0 0) 0x7f33f4098d20 con 0x557a4d005540 2024-09-22T08:38:29.753 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.749+0000 7f3402918640 1 --2- 172.21.15.142:0/1926375050 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f32e803d000 0x7f32e803f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:29.753 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.749+0000 7f340562f800 1 --2- 172.21.15.142:0/1926375050 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x557a4d096a80 0x557a4d1923a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:29.753 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.749+0000 7f340562f800 1 -- 172.21.15.142:0/1926375050 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557a4d18cb10 con 0x557a4d096a80 2024-09-22T08:38:29.753 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.749+0000 7f340391a640 1 --2- 172.21.15.142:0/1926375050 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x557a4d096a80 0x557a4d1923a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:29.753 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.749+0000 7f3402918640 1 --2- 172.21.15.142:0/1926375050 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f32e803d000 0x7f32e803f4c0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f33f8001d70 tx=0x7f33f80012d0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:29.753 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.749+0000 7f340391a640 1 --2- 172.21.15.142:0/1926375050 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x557a4d096a80 0x557a4d1923a0 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:29.753 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.749+0000 7f340391a640 1 -- 172.21.15.142:0/1926375050 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f33fc00a4d0 con 0x557a4d096a80 2024-09-22T08:38:29.753 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.749+0000 7f340562f800 1 -- 172.21.15.142:0/1926375050 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557a4d192dc0 con 0x557a4d096a80 2024-09-22T08:38:29.753 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.750+0000 7f340391a640 1 -- 172.21.15.142:0/1926375050 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f33fc00a4d0 con 0x557a4d096a80 2024-09-22T08:38:29.753 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.750+0000 7f340562f800 1 --2- 172.21.15.142:0/1926375050 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x557a4d1946d0 0x557a4d196b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:29.753 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.750+0000 7f340562f800 1 -- 172.21.15.142:0/1926375050 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:3 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557a4d197300 con 0x557a4d1946d0 2024-09-22T08:38:29.754 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.750+0000 7f3403119640 1 --2- 172.21.15.142:0/1926375050 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x557a4d1946d0 0x557a4d196b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:29.754 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.750+0000 7f3403119640 1 --2- 172.21.15.142:0/1926375050 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x557a4d1946d0 0x557a4d196b70 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:29.756 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.750+0000 7f3403119640 1 -- 172.21.15.142:0/1926375050 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(3 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f33f4051070 con 0x557a4d1946d0 2024-09-22T08:38:29.756 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.750+0000 7f340562f800 1 -- 172.21.15.142:0/1926375050 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557a4d193610 con 0x557a4d096a80 2024-09-22T08:38:29.756 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.751+0000 7f340391a640 1 -- 172.21.15.142:0/1926375050 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f33fc00a4d0 con 0x557a4d096a80 2024-09-22T08:38:29.756 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.751+0000 7f340562f800 1 -- 172.21.15.142:0/1926375050 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557a4d1939f0 con 0x557a4d1946d0 2024-09-22T08:38:29.757 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.751+0000 7f3403119640 1 -- 172.21.15.142:0/1926375050 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(5 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f33f4051070 con 0x557a4d1946d0 2024-09-22T08:38:29.757 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.751+0000 7f340562f800 1 Processor -- start 2024-09-22T08:38:29.757 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.751+0000 7f340562f800 1 -- start start 2024-09-22T08:38:29.757 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.752+0000 7f340562f800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557a4d1a5cb0 0x557a4d1a60d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:29.757 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.752+0000 7f340562f800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x557a4cf88d50 con 0x557a4d1a5cb0 2024-09-22T08:38:29.757 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.752+0000 7f340391a640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557a4d1a5cb0 0x557a4d1a60d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:29.757 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.752+0000 7f340391a640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557a4d1a5cb0 0x557a4d1a60d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:51728/0 (socket says 172.21.15.142:51728) 2024-09-22T08:38:29.757 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.752+0000 7f340391a640 1 -- 172.21.15.142:0/122207458 learned_addr learned my addr 172.21.15.142:0/122207458 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:38:29.757 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.752+0000 7f340391a640 1 -- 172.21.15.142:0/122207458 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557a4d1a6710 con 0x557a4d1a5cb0 2024-09-22T08:38:29.757 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.752+0000 7f340391a640 1 --2- 172.21.15.142:0/122207458 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557a4d1a5cb0 0x557a4d1a60d0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x557a4d18bd50 tx=0x7f33fc0167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:29.757 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.753+0000 7f32ed602640 1 -- 172.21.15.142:0/122207458 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f33fc013640 con 0x557a4d1a5cb0 2024-09-22T08:38:29.757 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.753+0000 7f32ed602640 1 -- 172.21.15.142:0/122207458 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33fc0137e0 con 0x557a4d1a5cb0 2024-09-22T08:38:29.757 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.753+0000 7f340562f800 1 -- 172.21.15.142:0/122207458 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557a4d1a6f40 con 0x557a4d1a5cb0 2024-09-22T08:38:29.758 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.753+0000 7f32ed602640 1 -- 172.21.15.142:0/122207458 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f33fc013ae0 con 0x557a4d1a5cb0 2024-09-22T08:38:29.758 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.753+0000 7f340562f800 1 -- 172.21.15.142:0/122207458 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557a4d1a74e0 con 0x557a4d1a5cb0 2024-09-22T08:38:29.758 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.753+0000 7f32ed602640 1 -- 172.21.15.142:0/122207458 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f33fc011040 con 0x557a4d1a5cb0 2024-09-22T08:38:29.758 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.754+0000 7f32ed602640 1 --2- 172.21.15.142:0/122207458 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f32dc03cfb0 0x7f32dc03f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:29.758 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.754+0000 7f32ed602640 1 -- 172.21.15.142:0/122207458 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5938+0+0 (secure 0 0 0) 0x7f33fc00e040 con 0x557a4d1a5cb0 2024-09-22T08:38:29.758 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.754+0000 7f3403119640 1 --2- 172.21.15.142:0/122207458 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f32dc03cfb0 0x7f32dc03f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:29.758 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.754+0000 7f340562f800 1 Processor -- start 2024-09-22T08:38:29.758 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.754+0000 7f3403119640 1 --2- 172.21.15.142:0/122207458 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f32dc03cfb0 0x7f32dc03f470 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f33f4068fd0 tx=0x7f33f405d620 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:29.758 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.754+0000 7f340562f800 1 -- start start 2024-09-22T08:38:29.758 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.754+0000 7f340562f800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557a4d1b27b0 0x557a4d1b2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:29.758 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.754+0000 7f340562f800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x557a4d183c50 con 0x557a4d1b27b0 2024-09-22T08:38:29.764 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.755+0000 7f340391a640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557a4d1b27b0 0x557a4d1b2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:29.764 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.755+0000 7f340391a640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557a4d1b27b0 0x557a4d1b2bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:51740/0 (socket says 172.21.15.142:51740) 2024-09-22T08:38:29.764 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.755+0000 7f340391a640 1 -- 172.21.15.142:0/3981127182 learned_addr learned my addr 172.21.15.142:0/3981127182 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:38:29.764 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.755+0000 7f340391a640 1 -- 172.21.15.142:0/3981127182 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557a4d1b31a0 con 0x557a4d1b27b0 2024-09-22T08:38:29.764 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.755+0000 7f340391a640 1 --2- 172.21.15.142:0/3981127182 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557a4d1b27b0 0x557a4d1b2bb0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f33fc020000 tx=0x7f33fc01f400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=908d423e91bd8162 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:29.764 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.755+0000 7f32e6ffd640 1 -- 172.21.15.142:0/3981127182 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f33fc051070 con 0x557a4d1b27b0 2024-09-22T08:38:29.765 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.755+0000 7f32e6ffd640 1 -- 172.21.15.142:0/3981127182 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33fc021960 con 0x557a4d1b27b0 2024-09-22T08:38:29.765 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.755+0000 7f32e6ffd640 1 -- 172.21.15.142:0/3981127182 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f33fc021440 con 0x557a4d1b27b0 2024-09-22T08:38:29.765 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.756+0000 7f340562f800 1 -- 172.21.15.142:0/3981127182 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557a4d1b27b0 msgr2=0x557a4d1b2bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:29.765 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.756+0000 7f340562f800 1 --2- 172.21.15.142:0/3981127182 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557a4d1b27b0 0x557a4d1b2bb0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f33fc020000 tx=0x7f33fc01f400 comp rx=0 tx=0).stop 2024-09-22T08:38:29.765 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.756+0000 7f340562f800 1 -- 172.21.15.142:0/3981127182 shutdown_connections 2024-09-22T08:38:29.765 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.756+0000 7f340562f800 1 --2- 172.21.15.142:0/3981127182 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557a4d1b27b0 0x557a4d1b2bb0 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:29.765 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.756+0000 7f340562f800 1 -- 172.21.15.142:0/3981127182 >> 172.21.15.142:0/3981127182 conn(0x557a4d1aebd0 msgr2=0x557a4d1ace10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:38:29.765 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.756+0000 7f340562f800 1 -- 172.21.15.142:0/3981127182 shutdown_connections 2024-09-22T08:38:29.765 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.756+0000 7f340562f800 1 -- 172.21.15.142:0/3981127182 wait complete. 2024-09-22T08:38:29.765 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.756+0000 7f340562f800 1 Processor -- start 2024-09-22T08:38:29.765 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.756+0000 7f340562f800 1 -- start start 2024-09-22T08:38:29.765 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.756+0000 7f340562f800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557a4d1b27b0 0x557a4d1b9d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:29.765 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.756+0000 7f340562f800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x557a4d1b37c0 con 0x557a4d1b27b0 2024-09-22T08:38:29.765 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.757+0000 7f340391a640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557a4d1b27b0 0x557a4d1b9d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:29.766 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.757+0000 7f340391a640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557a4d1b27b0 0x557a4d1b9d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:51750/0 (socket says 172.21.15.142:51750) 2024-09-22T08:38:29.766 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.757+0000 7f340391a640 1 -- 172.21.15.142:0/3326722031 learned_addr learned my addr 172.21.15.142:0/3326722031 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:38:29.766 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.757+0000 7f340391a640 1 -- 172.21.15.142:0/3326722031 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557a4d1ba2b0 con 0x557a4d1b27b0 2024-09-22T08:38:29.766 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.757+0000 7f340391a640 1 --2- 172.21.15.142:0/3326722031 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557a4d1b27b0 0x557a4d1b9d50 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f33fc020930 tx=0x7f33fc054860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:29.766 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.757+0000 7f32e57fa640 1 -- 172.21.15.142:0/3326722031 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f33fc054ad0 con 0x557a4d1b27b0 2024-09-22T08:38:29.766 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.757+0000 7f32e57fa640 1 -- 172.21.15.142:0/3326722031 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33fc020de0 con 0x557a4d1b27b0 2024-09-22T08:38:29.766 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.757+0000 7f340562f800 1 -- 172.21.15.142:0/3326722031 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557a4d1ba540 con 0x557a4d1b27b0 2024-09-22T08:38:29.766 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.757+0000 7f32e57fa640 1 -- 172.21.15.142:0/3326722031 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f33fc01fbc0 con 0x557a4d1b27b0 2024-09-22T08:38:29.766 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.759+0000 7f340562f800 1 -- 172.21.15.142:0/3326722031 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557a4d1bb0d0 con 0x557a4d1b27b0 2024-09-22T08:38:29.766 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.759+0000 7f32e57fa640 1 -- 172.21.15.142:0/3326722031 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f33fc01f500 con 0x557a4d1b27b0 2024-09-22T08:38:29.766 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.759+0000 7f32e57fa640 1 --2- 172.21.15.142:0/3326722031 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f32cc03d000 0x7f32cc03f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:29.766 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.759+0000 7f32e57fa640 1 -- 172.21.15.142:0/3326722031 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5938+0+0 (secure 0 0 0) 0x7f33fc04c030 con 0x557a4d1b27b0 2024-09-22T08:38:29.766 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.759+0000 7f3403119640 1 --2- 172.21.15.142:0/3326722031 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f32cc03d000 0x7f32cc03f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:29.767 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.759+0000 7f340562f800 20 rados->read ofs=0 len=0 2024-09-22T08:38:29.767 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.759+0000 7f340562f800 1 --2- 172.21.15.142:0/3326722031 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x557a4d1c56f0 0x557a4d1c7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:29.767 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.759+0000 7f340562f800 1 -- 172.21.15.142:0/3326722031 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557a4d1c8300 con 0x557a4d1c56f0 2024-09-22T08:38:29.767 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.759+0000 7f3402918640 1 --2- 172.21.15.142:0/3326722031 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x557a4d1c56f0 0x557a4d1c7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:29.767 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.759+0000 7f3403119640 1 --2- 172.21.15.142:0/3326722031 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f32cc03d000 0x7f32cc03f4c0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f33f4045a60 tx=0x7f33f4082000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:29.767 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.759+0000 7f3402918640 1 --2- 172.21.15.142:0/3326722031 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x557a4d1c56f0 0x557a4d1c7bb0 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:29.767 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.760+0000 7f3402918640 1 -- 172.21.15.142:0/3326722031 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f33f8009050 con 0x557a4d1c56f0 2024-09-22T08:38:29.767 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.760+0000 7f340562f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:29.767 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.760+0000 7f340562f800 20 realm 2024-09-22T08:38:29.767 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.760+0000 7f340562f800 20 rados->read ofs=0 len=0 2024-09-22T08:38:29.767 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.760+0000 7f340562f800 1 -- 172.21.15.142:0/3326722031 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557a4d1c4a80 con 0x557a4d1c56f0 2024-09-22T08:38:29.767 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.760+0000 7f3402918640 1 -- 172.21.15.142:0/3326722031 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f33f8009050 con 0x557a4d1c56f0 2024-09-22T08:38:29.767 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.760+0000 7f340562f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:29.768 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.760+0000 7f340562f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:38:29.768 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.760+0000 7f340562f800 20 rados->read ofs=0 len=0 2024-09-22T08:38:29.768 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.760+0000 7f340562f800 1 -- 172.21.15.142:0/3326722031 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557a4d1c8df0 con 0x557a4d1c56f0 2024-09-22T08:38:29.768 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.760+0000 7f3402918640 1 -- 172.21.15.142:0/3326722031 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f33f8009050 con 0x557a4d1c56f0 2024-09-22T08:38:29.768 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.760+0000 7f340562f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:29.768 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.760+0000 7f340562f800 20 rados->read ofs=0 len=0 2024-09-22T08:38:29.768 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.760+0000 7f340562f800 1 -- 172.21.15.142:0/3326722031 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557a4d1c96c0 con 0x557a4d1c56f0 2024-09-22T08:38:29.768 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.760+0000 7f3402918640 1 -- 172.21.15.142:0/3326722031 <== osd.1 v2:172.21.15.142:6816/3192108003 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f33f8009050 con 0x557a4d1c56f0 2024-09-22T08:38:29.768 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.760+0000 7f340562f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:38:29.768 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.760+0000 7f340562f800 20 rados->read ofs=0 len=0 2024-09-22T08:38:29.768 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.760+0000 7f340562f800 1 --2- 172.21.15.142:0/3326722031 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x557a4d1ca0e0 0x557a4d1cc4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:29.768 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.760+0000 7f340562f800 1 -- 172.21.15.142:0/3326722031 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557a4d1ccc10 con 0x557a4d1ca0e0 2024-09-22T08:38:29.768 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.761+0000 7f340391a640 1 --2- 172.21.15.142:0/3326722031 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x557a4d1ca0e0 0x557a4d1cc4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:29.769 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.761+0000 7f340391a640 1 --2- 172.21.15.142:0/3326722031 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x557a4d1ca0e0 0x557a4d1cc4d0 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:29.769 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.761+0000 7f340391a640 1 -- 172.21.15.142:0/3326722031 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(5 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f33fc00a4d0 con 0x557a4d1ca0e0 2024-09-22T08:38:29.769 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.761+0000 7f340562f800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:38:29.769 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.761+0000 7f340562f800 20 searching for the correct realm 2024-09-22T08:38:29.769 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.761+0000 7f340562f800 1 -- 172.21.15.142:0/3326722031 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557a4d1ce540 con 0x557a4d1ca0e0 2024-09-22T08:38:29.769 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.761+0000 7f340391a640 1 -- 172.21.15.142:0/3326722031 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f33fc00a4d0 con 0x557a4d1ca0e0 2024-09-22T08:38:29.769 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.761+0000 7f340391a640 1 --2- 172.21.15.142:0/3326722031 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f33fc03c720 0x7f33fc032800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:29.769 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.761+0000 7f340391a640 1 -- 172.21.15.142:0/3326722031 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557a4d1ce540 con 0x7f33fc03c720 2024-09-22T08:38:29.769 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.761+0000 7f3403119640 1 --2- 172.21.15.142:0/3326722031 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f33fc03c720 0x7f33fc032800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:29.769 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.762+0000 7f3403119640 1 --2- 172.21.15.142:0/3326722031 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f33fc03c720 0x7f33fc032800 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:29.769 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.762+0000 7f3403119640 1 -- 172.21.15.142:0/3326722031 <== osd.2 v2:172.21.15.142:6808/279438927 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f33f4051070 con 0x7f33fc03c720 2024-09-22T08:38:29.769 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.762+0000 7f3403119640 1 --2- 172.21.15.142:0/3326722031 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f33f405f040 0x7f33f408ff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:29.770 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.762+0000 7f3403119640 1 -- 172.21.15.142:0/3326722031 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557a4d1ce540 con 0x7f33f405f040 2024-09-22T08:38:29.770 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.762+0000 7f3402918640 1 --2- 172.21.15.142:0/3326722031 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f33f405f040 0x7f33f408ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:29.778 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.763+0000 7f3402918640 1 --2- 172.21.15.142:0/3326722031 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f33f405f040 0x7f33f408ff70 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:29.778 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.763+0000 7f3402918640 1 -- 172.21.15.142:0/3326722031 <== osd.0 v2:172.21.15.31:6800/168281188 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f33f8009050 con 0x7f33f405f040 2024-09-22T08:38:29.778 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.763+0000 7f3402918640 1 -- 172.21.15.142:0/3326722031 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557a4d1ce540 con 0x557a4d1c56f0 2024-09-22T08:38:29.779 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.763+0000 7f3402918640 1 -- 172.21.15.142:0/3326722031 <== osd.1 v2:172.21.15.142:6816/3192108003 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f33f8009050 con 0x557a4d1c56f0 2024-09-22T08:38:29.779 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.763+0000 7f3402918640 1 -- 172.21.15.142:0/3326722031 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557a4d1ce540 con 0x557a4d1c56f0 2024-09-22T08:38:29.779 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.763+0000 7f3402918640 1 -- 172.21.15.142:0/3326722031 <== osd.1 v2:172.21.15.142:6816/3192108003 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f33f8029040 con 0x557a4d1c56f0 2024-09-22T08:38:29.779 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.763+0000 7f3402918640 1 -- 172.21.15.142:0/3326722031 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557a4d1ce540 con 0x557a4d1c56f0 2024-09-22T08:38:29.779 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.764+0000 7f3402918640 1 -- 172.21.15.142:0/3326722031 <== osd.1 v2:172.21.15.142:6816/3192108003 7 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f33f8029040 con 0x557a4d1c56f0 2024-09-22T08:38:29.779 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.764+0000 7f3402918640 1 -- 172.21.15.142:0/3326722031 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557a4d1ce540 con 0x7f33f405f040 2024-09-22T08:38:29.779 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.764+0000 7f3402918640 1 -- 172.21.15.142:0/3326722031 <== osd.0 v2:172.21.15.31:6800/168281188 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f33f8029040 con 0x7f33f405f040 2024-09-22T08:38:29.779 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.764+0000 7f3402918640 1 -- 172.21.15.142:0/3326722031 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557a4d1ce540 con 0x7f33fc03c720 2024-09-22T08:38:29.779 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.764+0000 7f3403119640 1 -- 172.21.15.142:0/3326722031 <== osd.2 v2:172.21.15.142:6808/279438927 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f33f4051070 con 0x7f33fc03c720 2024-09-22T08:38:29.779 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.764+0000 7f3403119640 1 -- 172.21.15.142:0/3326722031 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557a4d1ce540 con 0x557a4d1ca0e0 2024-09-22T08:38:29.779 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.764+0000 7f340391a640 1 -- 172.21.15.142:0/3326722031 <== osd.3 v2:172.21.15.142:6800/1064901393 3 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f33fc00a4d0 con 0x557a4d1ca0e0 2024-09-22T08:38:29.779 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.764+0000 7f340391a640 1 -- 172.21.15.142:0/3326722031 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557a4d1ce540 con 0x557a4d1c56f0 2024-09-22T08:38:29.779 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.765+0000 7f3402918640 1 -- 172.21.15.142:0/3326722031 <== osd.1 v2:172.21.15.142:6816/3192108003 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f33f8029040 con 0x557a4d1c56f0 2024-09-22T08:38:29.779 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.765+0000 7f3402918640 1 -- 172.21.15.142:0/3326722031 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557a4d1ce540 con 0x7f33f405f040 2024-09-22T08:38:29.780 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.765+0000 7f3402918640 1 -- 172.21.15.142:0/3326722031 <== osd.0 v2:172.21.15.31:6800/168281188 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f33f8029040 con 0x7f33f405f040 2024-09-22T08:38:29.780 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.765+0000 7f3402918640 1 -- 172.21.15.142:0/3326722031 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557a4d1ce540 con 0x557a4d1c56f0 2024-09-22T08:38:29.780 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.765+0000 7f3402918640 1 -- 172.21.15.142:0/3326722031 <== osd.1 v2:172.21.15.142:6816/3192108003 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f33f8029040 con 0x557a4d1c56f0 2024-09-22T08:38:29.780 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.765+0000 7f3402918640 1 -- 172.21.15.142:0/3326722031 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557a4d1ce540 con 0x7f33fc03c720 2024-09-22T08:38:29.780 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.765+0000 7f3403119640 1 -- 172.21.15.142:0/3326722031 <== osd.2 v2:172.21.15.142:6808/279438927 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f33f4051070 con 0x7f33fc03c720 2024-09-22T08:38:29.780 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.765+0000 7f3403119640 1 -- 172.21.15.142:0/3326722031 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557a4d1ce540 con 0x557a4d1ca0e0 2024-09-22T08:38:29.780 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.766+0000 7f340391a640 1 -- 172.21.15.142:0/3326722031 <== osd.3 v2:172.21.15.142:6800/1064901393 4 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f33fc00a4d0 con 0x557a4d1ca0e0 2024-09-22T08:38:29.780 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.766+0000 7f340391a640 1 -- 172.21.15.142:0/3326722031 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557a4d1ce540 con 0x557a4d1ca0e0 2024-09-22T08:38:29.780 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.766+0000 7f340391a640 1 -- 172.21.15.142:0/3326722031 <== osd.3 v2:172.21.15.142:6800/1064901393 5 ==== osd_op_reply(20 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f33fc00a4d0 con 0x557a4d1ca0e0 2024-09-22T08:38:29.780 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.766+0000 7f340391a640 1 -- 172.21.15.142:0/3326722031 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557a4d1ce540 con 0x7f33f405f040 2024-09-22T08:38:29.780 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.766+0000 7f3402918640 1 -- 172.21.15.142:0/3326722031 <== osd.0 v2:172.21.15.31:6800/168281188 4 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f33f8029040 con 0x7f33f405f040 2024-09-22T08:38:29.780 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.766+0000 7f3402918640 1 -- 172.21.15.142:0/3326722031 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557a4d1ce540 con 0x557a4d1ca0e0 2024-09-22T08:38:29.780 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.766+0000 7f340391a640 1 -- 172.21.15.142:0/3326722031 <== osd.3 v2:172.21.15.142:6800/1064901393 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f33fc00a4d0 con 0x557a4d1ca0e0 2024-09-22T08:38:29.780 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.766+0000 7f340391a640 1 -- 172.21.15.142:0/3326722031 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557a4d1ce540 con 0x557a4d1ca0e0 2024-09-22T08:38:29.780 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.767+0000 7f340391a640 1 -- 172.21.15.142:0/3326722031 <== osd.3 v2:172.21.15.142:6800/1064901393 7 ==== osd_op_reply(23 [pgnls start_epoch 32 out=107b] v32'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f33fc00a4d0 con 0x557a4d1ca0e0 2024-09-22T08:38:29.781 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.767+0000 7f340391a640 1 -- 172.21.15.142:0/3326722031 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557a4d1ce540 con 0x557a4d1c56f0 2024-09-22T08:38:29.781 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.767+0000 7f3402918640 1 -- 172.21.15.142:0/3326722031 <== osd.1 v2:172.21.15.142:6816/3192108003 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f33f8029040 con 0x557a4d1c56f0 2024-09-22T08:38:29.781 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.767+0000 7f3402918640 1 -- 172.21.15.142:0/3326722031 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557a4d1ce540 con 0x557a4d1c56f0 2024-09-22T08:38:29.781 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.767+0000 7f3402918640 1 -- 172.21.15.142:0/3326722031 <== osd.1 v2:172.21.15.142:6816/3192108003 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v32'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f33f8029040 con 0x557a4d1c56f0 2024-09-22T08:38:29.781 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.767+0000 7f3402918640 1 -- 172.21.15.142:0/3326722031 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557a4d1ce540 con 0x7f33f405f040 2024-09-22T08:38:29.781 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.767+0000 7f3402918640 1 -- 172.21.15.142:0/3326722031 <== osd.0 v2:172.21.15.31:6800/168281188 5 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f33f8029040 con 0x7f33f405f040 2024-09-22T08:38:29.781 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.767+0000 7f3402918640 1 -- 172.21.15.142:0/3326722031 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557a4d1ce540 con 0x557a4d1ca0e0 2024-09-22T08:38:29.781 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.768+0000 7f340391a640 1 -- 172.21.15.142:0/3326722031 <== osd.3 v2:172.21.15.142:6800/1064901393 8 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f33fc00a4d0 con 0x557a4d1ca0e0 2024-09-22T08:38:29.781 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.768+0000 7f340391a640 1 -- 172.21.15.142:0/3326722031 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557a4d1ce540 con 0x7f33fc03c720 2024-09-22T08:38:29.781 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.768+0000 7f3403119640 1 -- 172.21.15.142:0/3326722031 <== osd.2 v2:172.21.15.142:6808/279438927 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f33f4051070 con 0x7f33fc03c720 2024-09-22T08:38:29.781 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.768+0000 7f3403119640 1 -- 172.21.15.142:0/3326722031 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557a4d1ce540 con 0x557a4d1c56f0 2024-09-22T08:38:29.781 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.768+0000 7f3402918640 1 -- 172.21.15.142:0/3326722031 <== osd.1 v2:172.21.15.142:6816/3192108003 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f33f8029040 con 0x557a4d1c56f0 2024-09-22T08:38:29.781 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.768+0000 7f3402918640 1 -- 172.21.15.142:0/3326722031 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557a4d1ce540 con 0x7f33f405f040 2024-09-22T08:38:29.782 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.768+0000 7f3402918640 1 -- 172.21.15.142:0/3326722031 <== osd.0 v2:172.21.15.31:6800/168281188 6 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f33f8029040 con 0x7f33f405f040 2024-09-22T08:38:29.782 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.768+0000 7f3402918640 1 -- 172.21.15.142:0/3326722031 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557a4d1ce540 con 0x557a4d1ca0e0 2024-09-22T08:38:29.782 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.769+0000 7f340391a640 1 -- 172.21.15.142:0/3326722031 <== osd.3 v2:172.21.15.142:6800/1064901393 9 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f33fc00a4d0 con 0x557a4d1ca0e0 2024-09-22T08:38:29.782 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.769+0000 7f340391a640 1 -- 172.21.15.142:0/3326722031 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557a4d1ce540 con 0x7f33f405f040 2024-09-22T08:38:29.782 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.769+0000 7f3402918640 1 -- 172.21.15.142:0/3326722031 <== osd.0 v2:172.21.15.31:6800/168281188 7 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f33f8029040 con 0x7f33f405f040 2024-09-22T08:38:29.782 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.769+0000 7f3402918640 1 -- 172.21.15.142:0/3326722031 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557a4d1ce540 con 0x7f33fc03c720 2024-09-22T08:38:29.782 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.769+0000 7f3403119640 1 -- 172.21.15.142:0/3326722031 <== osd.2 v2:172.21.15.142:6808/279438927 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f33f4051070 con 0x7f33fc03c720 2024-09-22T08:38:29.782 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.769+0000 7f3403119640 1 -- 172.21.15.142:0/3326722031 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557a4d1ce540 con 0x557a4d1ca0e0 2024-09-22T08:38:29.782 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.769+0000 7f340391a640 1 -- 172.21.15.142:0/3326722031 <== osd.3 v2:172.21.15.142:6800/1064901393 10 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f33fc00a4d0 con 0x557a4d1ca0e0 2024-09-22T08:38:29.782 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.769+0000 7f340391a640 1 -- 172.21.15.142:0/3326722031 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557a4d1ce540 con 0x7f33f405f040 2024-09-22T08:38:29.782 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.770+0000 7f3402918640 1 -- 172.21.15.142:0/3326722031 <== osd.0 v2:172.21.15.31:6800/168281188 8 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f33f8029040 con 0x7f33f405f040 2024-09-22T08:38:29.782 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.770+0000 7f3402918640 1 -- 172.21.15.142:0/3326722031 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557a4d1ce540 con 0x557a4d1c56f0 2024-09-22T08:38:29.782 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.770+0000 7f3402918640 1 -- 172.21.15.142:0/3326722031 <== osd.1 v2:172.21.15.142:6816/3192108003 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v32'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f33f8029040 con 0x557a4d1c56f0 2024-09-22T08:38:29.783 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.770+0000 7f3402918640 1 -- 172.21.15.142:0/3326722031 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557a4d1ce540 con 0x7f33fc03c720 2024-09-22T08:38:29.783 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.770+0000 7f3403119640 1 -- 172.21.15.142:0/3326722031 <== osd.2 v2:172.21.15.142:6808/279438927 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f33f4051070 con 0x7f33fc03c720 2024-09-22T08:38:29.783 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.770+0000 7f340562f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:38:29.783 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.770+0000 7f340562f800 20 RGWRados::pool_iterate: got zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec 2024-09-22T08:38:29.783 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.770+0000 7f340562f800 20 RGWRados::pool_iterate: got zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f 2024-09-22T08:38:29.783 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.770+0000 7f340562f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:38:29.783 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.770+0000 7f340562f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:38:29.783 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.770+0000 7f340562f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:38:29.783 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.770+0000 7f340562f800 20 rados->read ofs=0 len=0 2024-09-22T08:38:29.783 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.770+0000 7f340562f800 1 -- 172.21.15.142:0/3326722031 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557a4d1cd5d0 con 0x557a4d1c56f0 2024-09-22T08:38:29.783 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.770+0000 7f3402918640 1 -- 172.21.15.142:0/3326722031 <== osd.1 v2:172.21.15.142:6816/3192108003 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f33f8029040 con 0x557a4d1c56f0 2024-09-22T08:38:29.783 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.770+0000 7f340562f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:29.783 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.770+0000 7f340562f800 20 rados->read ofs=0 len=0 2024-09-22T08:38:29.784 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.770+0000 7f340562f800 1 -- 172.21.15.142:0/3326722031 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557a4d1cde20 con 0x557a4d1c56f0 2024-09-22T08:38:29.784 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.771+0000 7f3402918640 1 -- 172.21.15.142:0/3326722031 <== osd.1 v2:172.21.15.142:6816/3192108003 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f33f8029040 con 0x557a4d1c56f0 2024-09-22T08:38:29.784 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.771+0000 7f340562f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:38:29.784 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.771+0000 7f340562f800 20 rados->read ofs=0 len=0 2024-09-22T08:38:29.784 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.771+0000 7f340562f800 1 -- 172.21.15.142:0/3326722031 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:40 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557a4d1ce9c0 con 0x557a4d1ca0e0 2024-09-22T08:38:29.784 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.771+0000 7f340391a640 1 -- 172.21.15.142:0/3326722031 <== osd.3 v2:172.21.15.142:6800/1064901393 11 ==== osd_op_reply(40 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f33fc00a4d0 con 0x557a4d1ca0e0 2024-09-22T08:38:29.784 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.771+0000 7f340562f800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:38:29.784 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.771+0000 7f340562f800 20 zone default found 2024-09-22T08:38:29.784 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.771+0000 7f340562f800 4 Realm: () 2024-09-22T08:38:29.784 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.771+0000 7f340562f800 4 ZoneGroup: default (d89f6f57-1007-47dd-9065-f486c7b01aec) 2024-09-22T08:38:29.784 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.771+0000 7f340562f800 4 Zone: default (e239248c-0bee-4e41-803a-24b288d3eb8f) 2024-09-22T08:38:29.784 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.771+0000 7f340562f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:38:29.784 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.771+0000 7f340562f800 20 zonegroup default 2024-09-22T08:38:29.785 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.771+0000 7f340562f800 20 rados->read ofs=0 len=0 2024-09-22T08:38:29.785 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.771+0000 7f340562f800 1 -- 172.21.15.142:0/3326722031 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557a4d1ceda0 con 0x7f33f405f040 2024-09-22T08:38:29.785 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.771+0000 7f3402918640 1 -- 172.21.15.142:0/3326722031 <== osd.0 v2:172.21.15.31:6800/168281188 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f33f8029040 con 0x7f33f405f040 2024-09-22T08:38:29.785 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.771+0000 7f340562f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:29.785 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.771+0000 7f340562f800 20 rados->read ofs=0 len=0 2024-09-22T08:38:29.785 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.771+0000 7f340562f800 1 -- 172.21.15.142:0/3326722031 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557a4d1d1080 con 0x557a4d1ca0e0 2024-09-22T08:38:29.785 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.772+0000 7f340391a640 1 -- 172.21.15.142:0/3326722031 <== osd.3 v2:172.21.15.142:6800/1064901393 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f33fc00a4d0 con 0x557a4d1ca0e0 2024-09-22T08:38:29.785 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.772+0000 7f340562f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:29.785 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.772+0000 7f340562f800 20 rados->read ofs=0 len=0 2024-09-22T08:38:29.785 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.772+0000 7f340562f800 1 -- 172.21.15.142:0/3326722031 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557a4d1d1420 con 0x557a4d1ca0e0 2024-09-22T08:38:29.785 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.772+0000 7f340391a640 1 -- 172.21.15.142:0/3326722031 <== osd.3 v2:172.21.15.142:6800/1064901393 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f33fc00a4d0 con 0x557a4d1ca0e0 2024-09-22T08:38:29.785 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.772+0000 7f340562f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:29.785 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.772+0000 7f340562f800 20 started sync module instance, tier type = 2024-09-22T08:38:29.785 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.772+0000 7f340562f800 20 started zone id=e239248c-0bee-4e41-803a-24b288d3eb8f (name=default) with tier type = 2024-09-22T08:38:29.786 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.772+0000 7f340562f800 1 -- 172.21.15.142:0/3326722031 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557a4d1d0510 con 0x7f33fc03c720 2024-09-22T08:38:29.786 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.773+0000 7f3403119640 1 -- 172.21.15.142:0/3326722031 <== osd.2 v2:172.21.15.142:6808/279438927 7 ==== osd_op_reply(44 notify.0 [create] v32'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f33f4051070 con 0x7f33fc03c720 2024-09-22T08:38:29.786 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.773+0000 7f340562f800 1 -- 172.21.15.142:0/3326722031 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93983768119600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557a4d1d1d10 con 0x7f33fc03c720 2024-09-22T08:38:29.786 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.773+0000 7f340562f800 1 -- 172.21.15.142:0/3326722031 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557a4d1d2560 con 0x557a4d1c56f0 2024-09-22T08:38:29.786 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.774+0000 7f3403119640 1 -- 172.21.15.142:0/3326722031 <== osd.2 v2:172.21.15.142:6808/279438927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93983768119600] v32'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f33f4051070 con 0x7f33fc03c720 2024-09-22T08:38:29.786 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.774+0000 7f3402918640 1 -- 172.21.15.142:0/3326722031 <== osd.1 v2:172.21.15.142:6816/3192108003 16 ==== osd_op_reply(46 notify.1 [create] v32'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f33f8029040 con 0x557a4d1c56f0 2024-09-22T08:38:29.786 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.774+0000 7f340562f800 1 -- 172.21.15.142:0/3326722031 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93983768123488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557a4d1d2560 con 0x557a4d1c56f0 2024-09-22T08:38:29.786 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.774+0000 7f340562f800 1 -- 172.21.15.142:0/3326722031 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557a4d1d3080 con 0x557a4d1ca0e0 2024-09-22T08:38:29.786 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.776+0000 7f3402918640 1 -- 172.21.15.142:0/3326722031 <== osd.1 v2:172.21.15.142:6816/3192108003 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93983768123488] v32'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f33f8029040 con 0x557a4d1c56f0 2024-09-22T08:38:29.786 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.776+0000 7f340391a640 1 -- 172.21.15.142:0/3326722031 <== osd.3 v2:172.21.15.142:6800/1064901393 14 ==== osd_op_reply(48 notify.2 [create] v32'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f33fc00a4d0 con 0x557a4d1ca0e0 2024-09-22T08:38:29.786 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.776+0000 7f340562f800 1 -- 172.21.15.142:0/3326722031 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93983768128336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557a4d1d2560 con 0x557a4d1ca0e0 2024-09-22T08:38:29.786 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.776+0000 7f340562f800 1 -- 172.21.15.142:0/3326722031 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557a4d1d3ad0 con 0x7f33fc03c720 2024-09-22T08:38:29.791 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.777+0000 7f3403119640 1 -- 172.21.15.142:0/3326722031 <== osd.2 v2:172.21.15.142:6808/279438927 9 ==== osd_op_reply(50 notify.3 [create] v32'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f33f4051070 con 0x7f33fc03c720 2024-09-22T08:38:29.791 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.777+0000 7f340562f800 1 -- 172.21.15.142:0/3326722031 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93983768131040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557a4d1d3aa0 con 0x7f33fc03c720 2024-09-22T08:38:29.791 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.777+0000 7f340391a640 1 -- 172.21.15.142:0/3326722031 <== osd.3 v2:172.21.15.142:6800/1064901393 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 93983768128336] v32'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f33fc00a4d0 con 0x557a4d1ca0e0 2024-09-22T08:38:29.791 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.777+0000 7f340562f800 1 -- 172.21.15.142:0/3326722031 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557a4d1d4ac0 con 0x557a4d1c56f0 2024-09-22T08:38:29.791 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.778+0000 7f3403119640 1 -- 172.21.15.142:0/3326722031 <== osd.2 v2:172.21.15.142:6808/279438927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93983768131040] v32'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f33f4051070 con 0x7f33fc03c720 2024-09-22T08:38:29.792 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.778+0000 7f3402918640 1 -- 172.21.15.142:0/3326722031 <== osd.1 v2:172.21.15.142:6816/3192108003 18 ==== osd_op_reply(52 notify.4 [create] v32'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f33f8029040 con 0x557a4d1c56f0 2024-09-22T08:38:29.792 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.778+0000 7f340562f800 1 -- 172.21.15.142:0/3326722031 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93983768133312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557a4d1d4a80 con 0x557a4d1c56f0 2024-09-22T08:38:29.792 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.778+0000 7f340562f800 1 -- 172.21.15.142:0/3326722031 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557a4d1d5360 con 0x7f33f405f040 2024-09-22T08:38:29.792 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.779+0000 7f3402918640 1 -- 172.21.15.142:0/3326722031 <== osd.1 v2:172.21.15.142:6816/3192108003 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93983768133312] v32'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f33f8029040 con 0x557a4d1c56f0 2024-09-22T08:38:29.792 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.779+0000 7f3402918640 1 -- 172.21.15.142:0/3326722031 <== osd.0 v2:172.21.15.31:6800/168281188 10 ==== osd_op_reply(54 notify.5 [create] v32'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f33f8029040 con 0x7f33f405f040 2024-09-22T08:38:29.792 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.779+0000 7f340562f800 1 -- 172.21.15.142:0/3326722031 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93983768135056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557a4d1d4a80 con 0x7f33f405f040 2024-09-22T08:38:29.792 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.779+0000 7f340562f800 1 -- 172.21.15.142:0/3326722031 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557a4d1d5a00 con 0x7f33f405f040 2024-09-22T08:38:29.792 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.780+0000 7f3402918640 1 -- 172.21.15.142:0/3326722031 <== osd.0 v2:172.21.15.31:6800/168281188 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 93983768135056] v32'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f33f8029040 con 0x7f33f405f040 2024-09-22T08:38:29.792 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.782+0000 7f3402918640 1 -- 172.21.15.142:0/3326722031 <== osd.0 v2:172.21.15.31:6800/168281188 12 ==== osd_op_reply(56 notify.6 [create] v32'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f33f8029040 con 0x7f33f405f040 2024-09-22T08:38:29.792 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.782+0000 7f340562f800 1 -- 172.21.15.142:0/3326722031 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93983768138960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557a4d1d59c0 con 0x7f33f405f040 2024-09-22T08:38:29.792 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.782+0000 7f340562f800 1 -- 172.21.15.142:0/3326722031 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557a4d1d63e0 con 0x7f33f405f040 2024-09-22T08:38:29.792 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.783+0000 7f3402918640 1 -- 172.21.15.142:0/3326722031 <== osd.0 v2:172.21.15.31:6800/168281188 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 93983768138960] v32'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f33f8029040 con 0x7f33f405f040 2024-09-22T08:38:29.792 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.783+0000 7f3402918640 1 -- 172.21.15.142:0/3326722031 <== osd.0 v2:172.21.15.31:6800/168281188 14 ==== osd_op_reply(58 notify.7 [create] v32'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f33f8029040 con 0x7f33f405f040 2024-09-22T08:38:29.792 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.783+0000 7f340562f800 1 -- 172.21.15.142:0/3326722031 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93983768141520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557a4d1d63a0 con 0x7f33f405f040 2024-09-22T08:38:29.793 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.783+0000 7f340562f800 20 add_watcher() i=0 2024-09-22T08:38:29.793 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.783+0000 7f340562f800 20 add_watcher() i=1 2024-09-22T08:38:29.793 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.783+0000 7f340562f800 20 add_watcher() i=2 2024-09-22T08:38:29.793 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.783+0000 7f340562f800 20 add_watcher() i=3 2024-09-22T08:38:29.793 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.783+0000 7f340562f800 20 add_watcher() i=4 2024-09-22T08:38:29.793 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.783+0000 7f340562f800 20 add_watcher() i=5 2024-09-22T08:38:29.793 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.783+0000 7f340562f800 20 add_watcher() i=6 2024-09-22T08:38:29.793 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.784+0000 7f3402918640 1 -- 172.21.15.142:0/3326722031 <== osd.0 v2:172.21.15.31:6800/168281188 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 93983768141520] v32'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f33f8029040 con 0x7f33f405f040 2024-09-22T08:38:29.793 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.784+0000 7f340562f800 20 add_watcher() i=7 2024-09-22T08:38:29.793 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.784+0000 7f340562f800 2 all 8 watchers are set, enabling cache 2024-09-22T08:38:29.793 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.784+0000 7f340562f800 1 -- 172.21.15.142:0/3326722031 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557a4d1d9950 con 0x557a4d1c56f0 2024-09-22T08:38:29.793 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.785+0000 7f3402918640 1 -- 172.21.15.142:0/3326722031 <== osd.1 v2:172.21.15.142:6816/3192108003 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f33f8029040 con 0x557a4d1c56f0 2024-09-22T08:38:29.793 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.785+0000 7f340562f800 1 -- 172.21.15.142:0/3326722031 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93983768137280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557a4d1d6cb0 con 0x557a4d1c56f0 2024-09-22T08:38:29.793 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.786+0000 7f3402918640 1 -- 172.21.15.142:0/3326722031 <== osd.1 v2:172.21.15.142:6816/3192108003 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93983768137280] v32'244 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f33f8029040 con 0x557a4d1c56f0 2024-09-22T08:38:29.793 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.786+0000 7f32ba7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:38:29.794 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.786+0000 7f340562f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:38:29.794 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.786+0000 7f340562f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:38:29.794 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.786+0000 7f340562f800 5 note: GC not initialized 2024-09-22T08:38:29.794 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.786+0000 7f32b97e2640 20 reqs_thread_entry: start 2024-09-22T08:38:29.794 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.786+0000 7f340562f800 20 init_complete bucket index max shards: 11 2024-09-22T08:38:29.794 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.786+0000 7f340562f800 20 Filter name: none 2024-09-22T08:38:29.794 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.787+0000 7f32b27fc640 20 reqs_thread_entry: start 2024-09-22T08:38:29.794 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.787+0000 7f340562f800 10 cache get: name=default.rgw.meta+users.uid+system_user : miss 2024-09-22T08:38:29.794 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.787+0000 7f340562f800 20 rados->read ofs=0 len=0 2024-09-22T08:38:29.794 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.787+0000 7f340562f800 1 -- 172.21.15.142:0/3326722031 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:62 8.1e 8:78ce4db0:users.uid::system_user:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557a4d20cd00 con 0x7f33f405f040 2024-09-22T08:38:29.794 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.787+0000 7f3402918640 1 -- 172.21.15.142:0/3326722031 <== osd.0 v2:172.21.15.31:6800/168281188 16 ==== osd_op_reply(62 system_user [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 239+0+0 (crc 0 0 0) 0x7f33f8029040 con 0x7f33f405f040 2024-09-22T08:38:29.794 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.787+0000 7f340562f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:29.794 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.787+0000 7f340562f800 10 cache put: name=default.rgw.meta+users.uid+system_user info.flags=0x0 2024-09-22T08:38:29.795 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.787+0000 7f340562f800 10 adding default.rgw.meta+users.uid+system_user to cache LRU end 2024-09-22T08:38:29.795 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.787+0000 7f340562f800 10 cache get: name=default.rgw.meta+users.keys+system_akey : miss 2024-09-22T08:38:29.795 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.787+0000 7f340562f800 20 rados->read ofs=0 len=0 2024-09-22T08:38:29.795 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.787+0000 7f340562f800 1 -- 172.21.15.142:0/3326722031 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:63 8.0 8:01223cbf:users.keys::system_akey:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557a4d20b260 con 0x557a4d1ca0e0 2024-09-22T08:38:29.795 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.787+0000 7f340391a640 1 -- 172.21.15.142:0/3326722031 <== osd.3 v2:172.21.15.142:6800/1064901393 16 ==== osd_op_reply(63 system_akey [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 197+0+0 (crc 0 0 0) 0x7f33fc00a4d0 con 0x557a4d1ca0e0 2024-09-22T08:38:29.795 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.787+0000 7f340562f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:29.795 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.787+0000 7f340562f800 10 cache put: name=default.rgw.meta+users.keys+system_akey info.flags=0x0 2024-09-22T08:38:29.795 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.787+0000 7f340562f800 10 adding default.rgw.meta+users.keys+system_akey to cache LRU end 2024-09-22T08:38:29.795 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.787+0000 7f340562f800 10 cache get: name=default.rgw.meta+users.keys+system_akey : hit (negative entry) 2024-09-22T08:38:29.795 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.787+0000 7f340562f800 10 cache get: name=default.rgw.meta+users.keys+system_akey : hit (negative entry) 2024-09-22T08:38:29.795 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.787+0000 7f340562f800 1 -- 172.21.15.142:0/3326722031 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:64 8.1e 8:78ce4db0:users.uid::system_user:head [delete,create,call version.set in=58b,writefull 0~349 in=349b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557a4d20bb30 con 0x7f33f405f040 2024-09-22T08:38:29.795 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.788+0000 7f3402918640 1 -- 172.21.15.142:0/3326722031 <== osd.0 v2:172.21.15.31:6800/168281188 17 ==== osd_op_reply(64 system_user [delete,create,call,writefull 0~349] v32'1 uv1 ondisk = 0) ==== 281+0+0 (crc 0 0 0) 0x7f33f8029040 con 0x7f33f405f040 2024-09-22T08:38:29.795 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.789+0000 7f340562f800 10 cache put: name=default.rgw.meta+users.uid+system_user info.flags=0x17 2024-09-22T08:38:29.795 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.789+0000 7f340562f800 10 moving default.rgw.meta+users.uid+system_user to cache LRU end 2024-09-22T08:38:29.796 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.789+0000 7f340562f800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.uid:system_user, ofs0, ns] 2024-09-22T08:38:29.796 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.789+0000 7f340562f800 1 -- 172.21.15.142:0/3326722031 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [notify cookie 93983768360576 in=545b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557a4d2107a0 con 0x7f33fc03c720 2024-09-22T08:38:29.796 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.789+0000 7f3403119640 1 -- 172.21.15.142:0/3326722031 <== osd.2 v2:172.21.15.142:6808/279438927 11 ==== watch-notify(notify (1) cookie 93983768119600 notify 137438953513 ret 0) ==== 575+0+0 (crc 0 0 0) 0x7f33f40ac060 con 0x7f33fc03c720 2024-09-22T08:38:29.796 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.789+0000 7f32e6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953513 cookie 93983768119600 notifier 4842 bl.length()=533 2024-09-22T08:38:29.796 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.789+0000 7f32e6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+system_user info.flags=0x17 2024-09-22T08:38:29.796 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.789+0000 7f32e6ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+system_user to cache LRU end 2024-09-22T08:38:29.796 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.789+0000 7f32e6ffd640 1 -- 172.21.15.142:0/3326722031 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f32c8003ea0 con 0x7f33fc03c720 2024-09-22T08:38:29.796 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.789+0000 7f3403119640 1 -- 172.21.15.142:0/3326722031 <== osd.2 v2:172.21.15.142:6808/279438927 12 ==== osd_op_reply(65 notify.0 [notify cookie 93983768360576 out=8b] v0'0 uv246 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f33f4051070 con 0x7f33fc03c720 2024-09-22T08:38:29.796 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.789+0000 7f3403119640 1 -- 172.21.15.142:0/3326722031 <== osd.2 v2:172.21.15.142:6808/279438927 13 ==== osd_op_reply(66 notify.0 [notify-ack] v0'0 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f33f4051070 con 0x7f33fc03c720 2024-09-22T08:38:29.796 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.789+0000 7f3403119640 1 -- 172.21.15.142:0/3326722031 <== osd.2 v2:172.21.15.142:6808/279438927 14 ==== watch-notify(notify_complete (2) cookie 93983768360576 notify 137438953513 ret 0) ==== 42+0+48 (crc 0 0 0) 0x557a4d18c150 con 0x7f33fc03c720 2024-09-22T08:38:29.796 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.789+0000 7f340562f800 1 -- 172.21.15.142:0/3326722031 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:67 8.0 8:01223cbf:users.keys::system_akey:head [delete,create,writefull 0~15 in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557a4d20b680 con 0x557a4d1ca0e0 2024-09-22T08:38:29.797 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.790+0000 7f340391a640 1 -- 172.21.15.142:0/3326722031 <== osd.3 v2:172.21.15.142:6800/1064901393 17 ==== osd_op_reply(67 system_akey [delete,create,writefull 0~15] v32'1 uv1 ondisk = 0) ==== 239+0+0 (crc 0 0 0) 0x7f33fc00a4d0 con 0x557a4d1ca0e0 2024-09-22T08:38:29.797 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.790+0000 7f340562f800 10 cache put: name=default.rgw.meta+users.keys+system_akey info.flags=0x7 2024-09-22T08:38:29.797 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.790+0000 7f340562f800 10 moving default.rgw.meta+users.keys+system_akey to cache LRU end 2024-09-22T08:38:29.797 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.790+0000 7f340562f800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.keys:system_akey, ofs0, ns] 2024-09-22T08:38:29.798 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.790+0000 7f340562f800 1 -- 172.21.15.142:0/3326722031 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [notify cookie 93983768360576 in=188b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557a4d2107a0 con 0x557a4d1c56f0 2024-09-22T08:38:29.798 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.791+0000 7f3402918640 1 -- 172.21.15.142:0/3326722031 <== osd.1 v2:172.21.15.142:6816/3192108003 22 ==== watch-notify(notify (1) cookie 93983768123488 notify 137438953494 ret 0) ==== 218+0+0 (crc 0 0 0) 0x557a4d20bed0 con 0x557a4d1c56f0 2024-09-22T08:38:29.798 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.791+0000 7f32e67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953494 cookie 93983768123488 notifier 4842 bl.length()=176 2024-09-22T08:38:29.798 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.791+0000 7f32e67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+system_akey info.flags=0x7 2024-09-22T08:38:29.798 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.791+0000 7f32e67fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+system_akey to cache LRU end 2024-09-22T08:38:29.798 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.791+0000 7f3402918640 1 -- 172.21.15.142:0/3326722031 <== osd.1 v2:172.21.15.142:6816/3192108003 23 ==== osd_op_reply(68 notify.1 [notify cookie 93983768360576 out=8b] v0'0 uv246 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f33f8029040 con 0x557a4d1c56f0 2024-09-22T08:38:29.798 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.791+0000 7f32e67fc640 1 -- 172.21.15.142:0/3326722031 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:69 7.0 7:05bf5b68:::notify.1:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f322c003400 con 0x557a4d1c56f0 2024-09-22T08:38:29.798 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.791+0000 7f3402918640 1 -- 172.21.15.142:0/3326722031 <== osd.1 v2:172.21.15.142:6816/3192108003 24 ==== osd_op_reply(69 notify.1 [notify-ack] v0'0 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f33f8029040 con 0x557a4d1c56f0 2024-09-22T08:38:29.798 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.791+0000 7f3402918640 1 -- 172.21.15.142:0/3326722031 <== osd.1 v2:172.21.15.142:6816/3192108003 25 ==== watch-notify(notify_complete (2) cookie 93983768360576 notify 137438953494 ret 0) ==== 42+0+48 (crc 0 0 0) 0x557a4d20b430 con 0x557a4d1c56f0 2024-09-22T08:38:29.799 INFO:teuthology.orchestra.run.smithi142.stdout:{"user_id":"system_user","display_name":"System User","email":"","suspended":0,"max_buckets":1000,"subusers":[],"keys":[{"user":"system_user","access_key":"system_akey","secret_key":"system_skey","active":true,"create_date":"2024-09-22T08:38:29.789660Z"}],"swift_keys":[],"caps":[{"type":"user-info-without-keys","perm":"read"}],"op_mask":"read, write, delete","system":true,"default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-22T08:38:29.789651Z","tags":[],"group_ids":[]} 2024-09-22T08:38:29.800 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.792+0000 7f32ba7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:38:29.801 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.792+0000 7f340562f800 1 -- 172.21.15.142:0/3326722031 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93983768137280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557a4d20aa10 con 0x557a4d1c56f0 2024-09-22T08:38:29.801 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.793+0000 7f3402918640 1 -- 172.21.15.142:0/3326722031 <== osd.1 v2:172.21.15.142:6816/3192108003 26 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 93983768137280] v32'245 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f33f8029040 con 0x557a4d1c56f0 2024-09-22T08:38:29.801 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.793+0000 7f340562f800 1 -- 172.21.15.142:0/3326722031 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93983768119600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557a4d20aa10 con 0x7f33fc03c720 2024-09-22T08:38:29.801 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.794+0000 7f3403119640 1 -- 172.21.15.142:0/3326722031 <== osd.2 v2:172.21.15.142:6808/279438927 15 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 93983768119600] v32'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f33f4051070 con 0x7f33fc03c720 2024-09-22T08:38:29.801 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.794+0000 7f340562f800 20 remove_watcher() i=0 2024-09-22T08:38:29.801 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.794+0000 7f340562f800 2 removed watcher, disabling cache 2024-09-22T08:38:29.801 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.794+0000 7f340562f800 1 -- 172.21.15.142:0/3326722031 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93983768123488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557a4d20aa10 con 0x557a4d1c56f0 2024-09-22T08:38:29.801 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.795+0000 7f3402918640 1 -- 172.21.15.142:0/3326722031 <== osd.1 v2:172.21.15.142:6816/3192108003 27 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 93983768123488] v32'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f33f8029040 con 0x557a4d1c56f0 2024-09-22T08:38:29.801 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.795+0000 7f340562f800 20 remove_watcher() i=1 2024-09-22T08:38:29.801 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.795+0000 7f340562f800 1 -- 172.21.15.142:0/3326722031 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93983768128336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557a4d20aa10 con 0x557a4d1ca0e0 2024-09-22T08:38:29.801 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.796+0000 7f340391a640 1 -- 172.21.15.142:0/3326722031 <== osd.3 v2:172.21.15.142:6800/1064901393 18 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 93983768128336] v32'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f33fc00a4d0 con 0x557a4d1ca0e0 2024-09-22T08:38:29.801 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.796+0000 7f340562f800 20 remove_watcher() i=2 2024-09-22T08:38:29.801 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.796+0000 7f340562f800 1 -- 172.21.15.142:0/3326722031 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93983768131040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557a4d20aa10 con 0x7f33fc03c720 2024-09-22T08:38:29.802 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.797+0000 7f3403119640 1 -- 172.21.15.142:0/3326722031 <== osd.2 v2:172.21.15.142:6808/279438927 16 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 93983768131040] v32'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f33f4051070 con 0x7f33fc03c720 2024-09-22T08:38:29.802 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.797+0000 7f340562f800 20 remove_watcher() i=3 2024-09-22T08:38:29.802 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.797+0000 7f340562f800 1 -- 172.21.15.142:0/3326722031 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93983768133312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557a4d20aa10 con 0x557a4d1c56f0 2024-09-22T08:38:29.802 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.798+0000 7f3402918640 1 -- 172.21.15.142:0/3326722031 <== osd.1 v2:172.21.15.142:6816/3192108003 28 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 93983768133312] v32'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f33f8029040 con 0x557a4d1c56f0 2024-09-22T08:38:29.802 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.798+0000 7f340562f800 20 remove_watcher() i=4 2024-09-22T08:38:29.802 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.798+0000 7f340562f800 1 -- 172.21.15.142:0/3326722031 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93983768135056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557a4d20aa10 con 0x7f33f405f040 2024-09-22T08:38:29.803 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.799+0000 7f3402918640 1 -- 172.21.15.142:0/3326722031 <== osd.0 v2:172.21.15.31:6800/168281188 18 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 93983768135056] v32'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f33f8029040 con 0x7f33f405f040 2024-09-22T08:38:29.803 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.799+0000 7f340562f800 20 remove_watcher() i=5 2024-09-22T08:38:29.803 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.799+0000 7f340562f800 1 -- 172.21.15.142:0/3326722031 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93983768138960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557a4d20aa10 con 0x7f33f405f040 2024-09-22T08:38:29.803 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.800+0000 7f3402918640 1 -- 172.21.15.142:0/3326722031 <== osd.0 v2:172.21.15.31:6800/168281188 19 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 93983768138960] v32'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f33f8029040 con 0x7f33f405f040 2024-09-22T08:38:29.803 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.800+0000 7f340562f800 20 remove_watcher() i=6 2024-09-22T08:38:29.803 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.800+0000 7f340562f800 1 -- 172.21.15.142:0/3326722031 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93983768141520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557a4d20aa10 con 0x7f33f405f040 2024-09-22T08:38:29.806 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.801+0000 7f3402918640 1 -- 172.21.15.142:0/3326722031 <== osd.0 v2:172.21.15.31:6800/168281188 20 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 93983768141520] v32'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f33f8029040 con 0x7f33f405f040 2024-09-22T08:38:29.806 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.801+0000 7f340562f800 20 remove_watcher() i=7 2024-09-22T08:38:29.806 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.802+0000 7f340562f800 1 -- 172.21.15.142:0/3326722031 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f33f405f040 msgr2=0x7f33f408ff70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:29.806 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.802+0000 7f340562f800 1 --2- 172.21.15.142:0/3326722031 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f33f405f040 0x7f33f408ff70 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:29.806 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.802+0000 7f340562f800 1 -- 172.21.15.142:0/3326722031 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x557a4d1c56f0 msgr2=0x557a4d1c7bb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:29.806 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.802+0000 7f340562f800 1 --2- 172.21.15.142:0/3326722031 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x557a4d1c56f0 0x557a4d1c7bb0 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:29.806 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.802+0000 7f340562f800 1 -- 172.21.15.142:0/3326722031 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f33fc03c720 msgr2=0x7f33fc032800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:29.807 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.802+0000 7f340562f800 1 --2- 172.21.15.142:0/3326722031 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f33fc03c720 0x7f33fc032800 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:29.807 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.802+0000 7f340562f800 1 -- 172.21.15.142:0/3326722031 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x557a4d1ca0e0 msgr2=0x557a4d1cc4d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:29.807 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.802+0000 7f340562f800 1 --2- 172.21.15.142:0/3326722031 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x557a4d1ca0e0 0x557a4d1cc4d0 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:29.807 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.802+0000 7f340562f800 1 -- 172.21.15.142:0/3326722031 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f32cc03d000 msgr2=0x7f32cc03f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:29.807 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.802+0000 7f340562f800 1 --2- 172.21.15.142:0/3326722031 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f32cc03d000 0x7f32cc03f4c0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f33f4045a60 tx=0x7f33f4082000 comp rx=0 tx=0).stop 2024-09-22T08:38:29.807 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.802+0000 7f340562f800 1 -- 172.21.15.142:0/3326722031 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557a4d1b27b0 msgr2=0x557a4d1b9d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:29.807 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.802+0000 7f340562f800 1 --2- 172.21.15.142:0/3326722031 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557a4d1b27b0 0x557a4d1b9d50 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f33fc020930 tx=0x7f33fc054860 comp rx=0 tx=0).stop 2024-09-22T08:38:29.807 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.802+0000 7f3402918640 1 -- 172.21.15.142:0/3326722031 reap_dead start 2024-09-22T08:38:29.807 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.802+0000 7f3402918640 1 -- 172.21.15.142:0/3326722031 reap_dead start 2024-09-22T08:38:29.807 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.802+0000 7f340562f800 1 -- 172.21.15.142:0/3326722031 shutdown_connections 2024-09-22T08:38:29.807 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.802+0000 7f340562f800 1 -- 172.21.15.142:0/3326722031 >> 172.21.15.142:0/3326722031 conn(0x557a4d1aebd0 msgr2=0x557a4d1acde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:38:29.807 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.802+0000 7f340562f800 1 -- 172.21.15.142:0/3326722031 shutdown_connections 2024-09-22T08:38:29.807 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.802+0000 7f340562f800 1 -- 172.21.15.142:0/3326722031 wait complete. 2024-09-22T08:38:29.807 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.802+0000 7f340562f800 1 -- 172.21.15.142:0/122207458 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f32dc03cfb0 msgr2=0x7f32dc03f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:29.808 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.802+0000 7f340562f800 1 --2- 172.21.15.142:0/122207458 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f32dc03cfb0 0x7f32dc03f470 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f33f4068fd0 tx=0x7f33f405d620 comp rx=0 tx=0).stop 2024-09-22T08:38:29.808 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.802+0000 7f340562f800 1 -- 172.21.15.142:0/122207458 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557a4d1a5cb0 msgr2=0x557a4d1a60d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:29.808 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.802+0000 7f340562f800 1 --2- 172.21.15.142:0/122207458 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557a4d1a5cb0 0x557a4d1a60d0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x557a4d18bd50 tx=0x7f33fc0167b0 comp rx=0 tx=0).stop 2024-09-22T08:38:29.808 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.802+0000 7f340562f800 1 -- 172.21.15.142:0/122207458 shutdown_connections 2024-09-22T08:38:29.808 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.802+0000 7f340562f800 1 --2- 172.21.15.142:0/122207458 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f32dc03cfb0 0x7f32dc03f470 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:29.808 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.802+0000 7f340562f800 1 --2- 172.21.15.142:0/122207458 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557a4d1a5cb0 0x557a4d1a60d0 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:29.808 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.802+0000 7f340562f800 1 -- 172.21.15.142:0/122207458 >> 172.21.15.142:0/122207458 conn(0x557a4d19a060 msgr2=0x557a4d19a440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:38:29.808 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.802+0000 7f340562f800 1 -- 172.21.15.142:0/122207458 shutdown_connections 2024-09-22T08:38:29.808 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.802+0000 7f340562f800 1 -- 172.21.15.142:0/122207458 wait complete. 2024-09-22T08:38:29.808 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.803+0000 7f340562f800 1 -- 172.21.15.142:0/1926375050 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x557a4d096a80 msgr2=0x557a4d1923a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:29.808 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.803+0000 7f340562f800 1 --2- 172.21.15.142:0/1926375050 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x557a4d096a80 0x557a4d1923a0 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:29.808 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.803+0000 7f340562f800 1 -- 172.21.15.142:0/1926375050 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x557a4d1946d0 msgr2=0x557a4d196b70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:29.808 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.803+0000 7f340562f800 1 --2- 172.21.15.142:0/1926375050 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x557a4d1946d0 0x557a4d196b70 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:29.809 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.803+0000 7f340562f800 1 -- 172.21.15.142:0/1926375050 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f32e803d000 msgr2=0x7f32e803f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:29.809 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.803+0000 7f340562f800 1 --2- 172.21.15.142:0/1926375050 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f32e803d000 0x7f32e803f4c0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f33f8001d70 tx=0x7f33f80012d0 comp rx=0 tx=0).stop 2024-09-22T08:38:29.809 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.803+0000 7f340562f800 1 -- 172.21.15.142:0/1926375050 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557a4d005540 msgr2=0x557a4d18ad50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:29.809 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.803+0000 7f340562f800 1 --2- 172.21.15.142:0/1926375050 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557a4d005540 0x557a4d18ad50 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f33f4025c20 tx=0x7f33f4002fb0 comp rx=0 tx=0).stop 2024-09-22T08:38:29.809 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.803+0000 7f340562f800 1 -- 172.21.15.142:0/1926375050 shutdown_connections 2024-09-22T08:38:29.809 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.803+0000 7f340562f800 1 --2- 172.21.15.142:0/1926375050 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x557a4d1946d0 0x557a4d196b70 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:29.809 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.803+0000 7f340562f800 1 --2- 172.21.15.142:0/1926375050 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x557a4d096a80 0x557a4d1923a0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:29.809 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.803+0000 7f340562f800 1 --2- 172.21.15.142:0/1926375050 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f32e803d000 0x7f32e803f4c0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:29.809 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.803+0000 7f340562f800 1 --2- 172.21.15.142:0/1926375050 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557a4d005540 0x557a4d18ad50 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:29.809 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.803+0000 7f340562f800 1 -- 172.21.15.142:0/1926375050 >> 172.21.15.142:0/1926375050 conn(0x557a4d08bc30 msgr2=0x557a4d17d400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:38:29.809 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.803+0000 7f340562f800 1 -- 172.21.15.142:0/1926375050 shutdown_connections 2024-09-22T08:38:29.809 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.803+0000 7f340562f800 1 -- 172.21.15.142:0/1926375050 wait complete. 2024-09-22T08:38:29.813 DEBUG:tasks.util.rgw: json result: {'user_id': 'system_user', 'display_name': 'System User', 'email': '', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'system_user', 'access_key': 'system_akey', 'secret_key': 'system_skey', 'active': True, 'create_date': '2024-09-22T08:38:29.789660Z'}], 'swift_keys': [], 'caps': [{'type': 'user-info-without-keys', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'system': True, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-22T08:38:29.789651Z', 'tags': [], 'group_ids': []} 2024-09-22T08:38:29.813 ERROR:root:{'user_id': 'system_user', 'display_name': 'System User', 'email': '', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'system_user', 'access_key': 'system_akey', 'secret_key': 'system_skey', 'active': True, 'create_date': '2024-09-22T08:38:29.789660Z'}], 'swift_keys': [], 'caps': [{'type': 'user-info-without-keys', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'system': True, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-22T08:38:29.789651Z', 'tags': [], 'group_ids': []} 2024-09-22T08:38:29.814 ERROR:root:0 2024-09-22T08:38:29.814 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-22T08:38:29.818 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-22T08:38:29.819 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'system_user'] 2024-09-22T08:38:29.819 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'system_user'] 2024-09-22T08:38:29.819 DEBUG:teuthology.orchestra.run.smithi142:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid system_user 2024-09-22T08:38:29.863 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:38:29.863 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:38:29.864 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.862+0000 7f695f2bb800 1 Processor -- start 2024-09-22T08:38:29.864 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.862+0000 7f695f2bb800 1 -- start start 2024-09-22T08:38:29.864 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.862+0000 7f695f2bb800 1 --2- >> v2:172.21.15.31:3300/0 conn(0x56348be8d080 0x56348be8f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:29.864 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.862+0000 7f695f2bb800 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56348bd17a20 con 0x56348be8f9b0 2024-09-22T08:38:29.864 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.862+0000 7f695f2bb800 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x56348bd177d0 con 0x56348be8d080 2024-09-22T08:38:29.865 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.862+0000 7f695cda5640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x56348be8d080 0x56348be8f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:29.865 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.862+0000 7f695c5a4640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x56348be8f9b0 0x56348be91da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.142:50480/0 (socket says 172.21.15.142:50480) 2024-09-22T08:38:29.865 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.862+0000 7f695cda5640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x56348be8d080 0x56348be8f470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:51766/0 (socket says 172.21.15.142:51766) 2024-09-22T08:38:29.865 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.862+0000 7f695c5a4640 1 -- 172.21.15.142:0/1941993326 learned_addr learned my addr 172.21.15.142:0/1941993326 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-09-22T08:38:29.865 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.862+0000 7f695cda5640 1 -- 172.21.15.142:0/1941993326 >> v1:172.21.15.31:6789/0 conn(0x56348be8f9b0 legacy=0x56348be91da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:29.865 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.862+0000 7f695cda5640 1 -- 172.21.15.142:0/1941993326 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56348be94560 con 0x56348be8d080 2024-09-22T08:38:29.866 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.864+0000 7f695cda5640 1 --2- 172.21.15.142:0/1941993326 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56348be8d080 0x56348be8f470 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f694c005fd0 tx=0x7f694c045c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58a59befdeac44e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:29.867 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.864+0000 7f695bda3640 1 -- 172.21.15.142:0/1941993326 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f694c058530 con 0x56348be8d080 2024-09-22T08:38:29.867 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.864+0000 7f695bda3640 1 -- 172.21.15.142:0/1941993326 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f694c0586d0 con 0x56348be8d080 2024-09-22T08:38:29.867 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.864+0000 7f695bda3640 1 -- 172.21.15.142:0/1941993326 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f694c0589d0 con 0x56348be8d080 2024-09-22T08:38:29.867 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.865+0000 7f695f2bb800 1 -- 172.21.15.142:0/1941993326 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56348be8d080 msgr2=0x56348be8f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:29.868 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.865+0000 7f695f2bb800 1 --2- 172.21.15.142:0/1941993326 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56348be8d080 0x56348be8f470 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f694c005fd0 tx=0x7f694c045c30 comp rx=0 tx=0).stop 2024-09-22T08:38:29.868 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.865+0000 7f695f2bb800 1 -- 172.21.15.142:0/1941993326 shutdown_connections 2024-09-22T08:38:29.868 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.865+0000 7f695f2bb800 1 --2- 172.21.15.142:0/1941993326 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56348be8d080 0x56348be8f470 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:29.868 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.865+0000 7f695f2bb800 1 -- 172.21.15.142:0/1941993326 >> 172.21.15.142:0/1941993326 conn(0x56348be86be0 msgr2=0x56348be89020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:38:29.868 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.865+0000 7f695f2bb800 1 -- 172.21.15.142:0/1941993326 shutdown_connections 2024-09-22T08:38:29.868 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.865+0000 7f695f2bb800 1 -- 172.21.15.142:0/1941993326 wait complete. 2024-09-22T08:38:29.881 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.879+0000 7f695f2bb800 1 Processor -- start 2024-09-22T08:38:29.881 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.879+0000 7f695f2bb800 1 -- start start 2024-09-22T08:38:29.881 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.879+0000 7f695f2bb800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56348be8d080 0x56348be8c810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:29.881 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.879+0000 7f695f2bb800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x56348bd24dd0 con 0x56348be8d080 2024-09-22T08:38:29.882 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.879+0000 7f695cda5640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56348be8d080 0x56348be8c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:29.882 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.879+0000 7f695cda5640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56348be8d080 0x56348be8c810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:51768/0 (socket says 172.21.15.142:51768) 2024-09-22T08:38:29.882 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.879+0000 7f695cda5640 1 -- 172.21.15.142:0/556632630 learned_addr learned my addr 172.21.15.142:0/556632630 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:38:29.882 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.880+0000 7f695cda5640 1 -- 172.21.15.142:0/556632630 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56348be8ce00 con 0x56348be8d080 2024-09-22T08:38:29.882 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.880+0000 7f695cda5640 1 --2- 172.21.15.142:0/556632630 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56348be8d080 0x56348be8c810 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f694c025a60 tx=0x7f694c051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e74201319fd5c28 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:29.883 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.880+0000 7f684ae0d640 1 -- 172.21.15.142:0/556632630 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f694c0589b0 con 0x56348be8d080 2024-09-22T08:38:29.883 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.880+0000 7f684ae0d640 1 -- 172.21.15.142:0/556632630 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f694c068070 con 0x56348be8d080 2024-09-22T08:38:29.883 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.880+0000 7f684ae0d640 1 -- 172.21.15.142:0/556632630 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f694c058c80 con 0x56348be8d080 2024-09-22T08:38:29.884 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.881+0000 7f695f2bb800 1 -- 172.21.15.142:0/556632630 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56348be8d080 msgr2=0x56348be8c810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:29.884 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.881+0000 7f695f2bb800 1 --2- 172.21.15.142:0/556632630 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56348be8d080 0x56348be8c810 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f694c025a60 tx=0x7f694c051000 comp rx=0 tx=0).stop 2024-09-22T08:38:29.884 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.881+0000 7f695f2bb800 1 -- 172.21.15.142:0/556632630 shutdown_connections 2024-09-22T08:38:29.884 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.881+0000 7f695f2bb800 1 --2- 172.21.15.142:0/556632630 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56348be8d080 0x56348be8c810 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:29.884 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.881+0000 7f695f2bb800 1 -- 172.21.15.142:0/556632630 >> 172.21.15.142:0/556632630 conn(0x56348be86be0 msgr2=0x56348bf77990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:38:29.884 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.881+0000 7f695f2bb800 1 -- 172.21.15.142:0/556632630 shutdown_connections 2024-09-22T08:38:29.884 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.881+0000 7f695f2bb800 1 -- 172.21.15.142:0/556632630 wait complete. 2024-09-22T08:38:29.884 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.881+0000 7f695f2bb800 1 Processor -- start 2024-09-22T08:38:29.884 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.881+0000 7f695f2bb800 1 -- start start 2024-09-22T08:38:29.884 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.881+0000 7f695f2bb800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56348be8d080 0x56348bf85c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:29.884 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.881+0000 7f695f2bb800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x56348be93850 con 0x56348be8d080 2024-09-22T08:38:29.884 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.882+0000 7f695cda5640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56348be8d080 0x56348bf85c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:29.885 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.882+0000 7f695cda5640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56348be8d080 0x56348bf85c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:51782/0 (socket says 172.21.15.142:51782) 2024-09-22T08:38:29.885 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.882+0000 7f695cda5640 1 -- 172.21.15.142:0/433333830 learned_addr learned my addr 172.21.15.142:0/433333830 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:38:29.886 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.882+0000 7f695cda5640 1 -- 172.21.15.142:0/433333830 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56348bf861d0 con 0x56348be8d080 2024-09-22T08:38:29.886 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.882+0000 7f695cda5640 1 --2- 172.21.15.142:0/433333830 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56348be8d080 0x56348bf85c70 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f694c025a60 tx=0x7f694c003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:29.886 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.883+0000 7f684960a640 1 -- 172.21.15.142:0/433333830 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f694c063650 con 0x56348be8d080 2024-09-22T08:38:29.887 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.883+0000 7f695f2bb800 1 -- 172.21.15.142:0/433333830 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56348bf86460 con 0x56348be8d080 2024-09-22T08:38:29.887 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.883+0000 7f684960a640 1 -- 172.21.15.142:0/433333830 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f694c0637f0 con 0x56348be8d080 2024-09-22T08:38:29.887 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.883+0000 7f684960a640 1 -- 172.21.15.142:0/433333830 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f694c063af0 con 0x56348be8d080 2024-09-22T08:38:29.887 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.883+0000 7f695f2bb800 1 -- 172.21.15.142:0/433333830 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56348bf87070 con 0x56348be8d080 2024-09-22T08:38:29.887 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.884+0000 7f684960a640 1 -- 172.21.15.142:0/433333830 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f694c063c90 con 0x56348be8d080 2024-09-22T08:38:29.887 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.884+0000 7f684960a640 1 --2- 172.21.15.142:0/433333830 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f684403cfb0 0x7f684403f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:29.887 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.884+0000 7f684960a640 1 -- 172.21.15.142:0/433333830 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5938+0+0 (secure 0 0 0) 0x7f694c098700 con 0x56348be8d080 2024-09-22T08:38:29.887 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.884+0000 7f695c5a4640 1 --2- 172.21.15.142:0/433333830 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f684403cfb0 0x7f684403f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:29.887 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.884+0000 7f695f2bb800 1 --2- 172.21.15.142:0/433333830 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x56348be8f9b0 0x56348bf8d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:29.887 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.884+0000 7f695f2bb800 1 -- 172.21.15.142:0/433333830 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56348bf8d800 con 0x56348be8f9b0 2024-09-22T08:38:29.887 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.884+0000 7f695d5a6640 1 --2- 172.21.15.142:0/433333830 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x56348be8f9b0 0x56348bf8d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:29.887 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.884+0000 7f695c5a4640 1 --2- 172.21.15.142:0/433333830 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f684403cfb0 0x7f684403f470 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f6950001d70 tx=0x7f69500012d0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:29.887 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.884+0000 7f695d5a6640 1 --2- 172.21.15.142:0/433333830 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x56348be8f9b0 0x56348bf8d2c0 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:29.890 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.885+0000 7f695d5a6640 1 -- 172.21.15.142:0/433333830 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f69540083e0 con 0x56348be8f9b0 2024-09-22T08:38:29.890 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.885+0000 7f695f2bb800 1 -- 172.21.15.142:0/433333830 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56348bf8dba0 con 0x56348be8f9b0 2024-09-22T08:38:29.890 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.885+0000 7f695d5a6640 1 -- 172.21.15.142:0/433333830 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f69540083e0 con 0x56348be8f9b0 2024-09-22T08:38:29.890 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.885+0000 7f695f2bb800 1 --2- 172.21.15.142:0/433333830 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x56348bf8f6e0 0x56348bf91b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:29.890 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.885+0000 7f695f2bb800 1 -- 172.21.15.142:0/433333830 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:3 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56348bf922e0 con 0x56348bf8f6e0 2024-09-22T08:38:29.890 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.885+0000 7f695cda5640 1 --2- 172.21.15.142:0/433333830 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x56348bf8f6e0 0x56348bf91b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:29.890 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.885+0000 7f695cda5640 1 --2- 172.21.15.142:0/433333830 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x56348bf8f6e0 0x56348bf91b50 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:29.890 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.886+0000 7f695cda5640 1 -- 172.21.15.142:0/433333830 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(3 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f694c0743e0 con 0x56348bf8f6e0 2024-09-22T08:38:29.890 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.886+0000 7f695f2bb800 1 -- 172.21.15.142:0/433333830 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56348bf8e3f0 con 0x56348be8f9b0 2024-09-22T08:38:29.890 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.886+0000 7f695d5a6640 1 -- 172.21.15.142:0/433333830 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f69540083e0 con 0x56348be8f9b0 2024-09-22T08:38:29.890 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.886+0000 7f695f2bb800 1 -- 172.21.15.142:0/433333830 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56348bf8e890 con 0x56348bf8f6e0 2024-09-22T08:38:29.891 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.886+0000 7f695cda5640 1 -- 172.21.15.142:0/433333830 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(5 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f694c0743e0 con 0x56348bf8f6e0 2024-09-22T08:38:29.891 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.886+0000 7f695f2bb800 1 Processor -- start 2024-09-22T08:38:29.891 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.887+0000 7f695f2bb800 1 -- start start 2024-09-22T08:38:29.891 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.887+0000 7f695f2bb800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56348bfa0cd0 0x56348bfa10f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:29.891 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.887+0000 7f695f2bb800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x56348bd83d50 con 0x56348bfa0cd0 2024-09-22T08:38:29.891 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.887+0000 7f695d5a6640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56348bfa0cd0 0x56348bfa10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:29.891 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.887+0000 7f695d5a6640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56348bfa0cd0 0x56348bfa10f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:51788/0 (socket says 172.21.15.142:51788) 2024-09-22T08:38:29.891 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.887+0000 7f695d5a6640 1 -- 172.21.15.142:0/3081015956 learned_addr learned my addr 172.21.15.142:0/3081015956 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:38:29.891 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.887+0000 7f695d5a6640 1 -- 172.21.15.142:0/3081015956 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56348bfa1730 con 0x56348bfa0cd0 2024-09-22T08:38:29.891 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.887+0000 7f695d5a6640 1 --2- 172.21.15.142:0/3081015956 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56348bfa0cd0 0x56348bfa10f0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x56348bf87bb0 tx=0x7f695400bf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:29.891 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.888+0000 7f68427fc640 1 -- 172.21.15.142:0/3081015956 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f695401c020 con 0x56348bfa0cd0 2024-09-22T08:38:29.891 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.888+0000 7f68427fc640 1 -- 172.21.15.142:0/3081015956 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6954007c90 con 0x56348bfa0cd0 2024-09-22T08:38:29.891 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.888+0000 7f695f2bb800 1 -- 172.21.15.142:0/3081015956 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56348bfa1f60 con 0x56348bfa0cd0 2024-09-22T08:38:29.891 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.888+0000 7f68427fc640 1 -- 172.21.15.142:0/3081015956 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6954018440 con 0x56348bfa0cd0 2024-09-22T08:38:29.892 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.888+0000 7f695f2bb800 1 -- 172.21.15.142:0/3081015956 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56348bfa2500 con 0x56348bfa0cd0 2024-09-22T08:38:29.895 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.889+0000 7f68427fc640 1 -- 172.21.15.142:0/3081015956 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f695401f020 con 0x56348bfa0cd0 2024-09-22T08:38:29.895 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.889+0000 7f68427fc640 1 --2- 172.21.15.142:0/3081015956 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f683403d000 0x7f683403f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:29.895 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.889+0000 7f68427fc640 1 -- 172.21.15.142:0/3081015956 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5938+0+0 (secure 0 0 0) 0x7f6954055910 con 0x56348bfa0cd0 2024-09-22T08:38:29.895 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.889+0000 7f695cda5640 1 --2- 172.21.15.142:0/3081015956 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f683403d000 0x7f683403f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:29.895 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.889+0000 7f695f2bb800 1 Processor -- start 2024-09-22T08:38:29.895 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.889+0000 7f695cda5640 1 --2- 172.21.15.142:0/3081015956 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f683403d000 0x7f683403f4c0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f694c096c70 tx=0x7f694c07e600 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:29.895 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.889+0000 7f695f2bb800 1 -- start start 2024-09-22T08:38:29.895 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.889+0000 7f695f2bb800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56348bfad710 0x56348bfadb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:29.895 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.889+0000 7f695f2bb800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x56348be8b1a0 con 0x56348bfad710 2024-09-22T08:38:29.895 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.890+0000 7f695d5a6640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56348bfad710 0x56348bfadb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:29.895 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.890+0000 7f695d5a6640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56348bfad710 0x56348bfadb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:51790/0 (socket says 172.21.15.142:51790) 2024-09-22T08:38:29.895 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.890+0000 7f695d5a6640 1 -- 172.21.15.142:0/1835244587 learned_addr learned my addr 172.21.15.142:0/1835244587 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:38:29.896 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.890+0000 7f695d5a6640 1 -- 172.21.15.142:0/1835244587 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56348bfae100 con 0x56348bfad710 2024-09-22T08:38:29.896 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.890+0000 7f695d5a6640 1 --2- 172.21.15.142:0/1835244587 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56348bfad710 0x56348bfadb10 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f6954017f70 tx=0x7f6954017670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8baece1653ff70d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:29.896 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.890+0000 7f6833fff640 1 -- 172.21.15.142:0/1835244587 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f69540156f0 con 0x56348bfad710 2024-09-22T08:38:29.896 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.890+0000 7f6833fff640 1 -- 172.21.15.142:0/1835244587 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6954015890 con 0x56348bfad710 2024-09-22T08:38:29.896 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.890+0000 7f6833fff640 1 -- 172.21.15.142:0/1835244587 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f695400b150 con 0x56348bfad710 2024-09-22T08:38:29.896 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.891+0000 7f695f2bb800 1 -- 172.21.15.142:0/1835244587 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56348bfad710 msgr2=0x56348bfadb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:29.896 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.891+0000 7f695f2bb800 1 --2- 172.21.15.142:0/1835244587 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56348bfad710 0x56348bfadb10 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f6954017f70 tx=0x7f6954017670 comp rx=0 tx=0).stop 2024-09-22T08:38:29.896 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.891+0000 7f695f2bb800 1 -- 172.21.15.142:0/1835244587 shutdown_connections 2024-09-22T08:38:29.896 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.891+0000 7f695f2bb800 1 --2- 172.21.15.142:0/1835244587 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56348bfad710 0x56348bfadb10 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:29.896 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.891+0000 7f695f2bb800 1 -- 172.21.15.142:0/1835244587 >> 172.21.15.142:0/1835244587 conn(0x56348bfa9b30 msgr2=0x56348bfa7d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:38:29.896 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.891+0000 7f695f2bb800 1 -- 172.21.15.142:0/1835244587 shutdown_connections 2024-09-22T08:38:29.896 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.891+0000 7f695f2bb800 1 -- 172.21.15.142:0/1835244587 wait complete. 2024-09-22T08:38:29.896 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.891+0000 7f695f2bb800 1 Processor -- start 2024-09-22T08:38:29.897 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.891+0000 7f695f2bb800 1 -- start start 2024-09-22T08:38:29.897 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.891+0000 7f695f2bb800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56348bfad710 0x56348bfb4d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:29.897 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.891+0000 7f695f2bb800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x56348bfae720 con 0x56348bfad710 2024-09-22T08:38:29.897 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.891+0000 7f695d5a6640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56348bfad710 0x56348bfb4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:29.897 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.891+0000 7f695d5a6640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56348bfad710 0x56348bfb4d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:51804/0 (socket says 172.21.15.142:51804) 2024-09-22T08:38:29.897 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.891+0000 7f695d5a6640 1 -- 172.21.15.142:0/2432553217 learned_addr learned my addr 172.21.15.142:0/2432553217 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:38:29.897 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.892+0000 7f695d5a6640 1 -- 172.21.15.142:0/2432553217 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56348bfb5260 con 0x56348bfad710 2024-09-22T08:38:29.897 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.892+0000 7f695d5a6640 1 --2- 172.21.15.142:0/2432553217 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56348bfad710 0x56348bfb4d00 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f6954015a60 tx=0x7f6954053d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:29.897 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.892+0000 7f68327fc640 1 -- 172.21.15.142:0/2432553217 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6954013bf0 con 0x56348bfad710 2024-09-22T08:38:29.897 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.892+0000 7f68327fc640 1 -- 172.21.15.142:0/2432553217 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6954013d90 con 0x56348bfad710 2024-09-22T08:38:29.897 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.892+0000 7f695f2bb800 1 -- 172.21.15.142:0/2432553217 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56348bfb54f0 con 0x56348bfad710 2024-09-22T08:38:29.897 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.892+0000 7f68327fc640 1 -- 172.21.15.142:0/2432553217 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6954020a10 con 0x56348bfad710 2024-09-22T08:38:29.897 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.892+0000 7f695f2bb800 1 -- 172.21.15.142:0/2432553217 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56348bfb5e70 con 0x56348bfad710 2024-09-22T08:38:29.898 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.893+0000 7f68327fc640 1 -- 172.21.15.142:0/2432553217 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f6954031030 con 0x56348bfad710 2024-09-22T08:38:29.906 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.893+0000 7f68327fc640 1 --2- 172.21.15.142:0/2432553217 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f682803cfb0 0x7f682803f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:29.906 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.893+0000 7f68327fc640 1 -- 172.21.15.142:0/2432553217 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5938+0+0 (secure 0 0 0) 0x7f695402f070 con 0x56348bfad710 2024-09-22T08:38:29.906 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.893+0000 7f695cda5640 1 --2- 172.21.15.142:0/2432553217 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f682803cfb0 0x7f682803f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:29.906 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.894+0000 7f695cda5640 1 --2- 172.21.15.142:0/2432553217 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f682803cfb0 0x7f682803f470 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f694c04ef20 tx=0x7f694c08b000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:29.906 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.894+0000 7f695f2bb800 20 rados->read ofs=0 len=0 2024-09-22T08:38:29.906 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.894+0000 7f695f2bb800 1 --2- 172.21.15.142:0/2432553217 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x56348bfc0660 0x56348bfc2b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:29.906 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.894+0000 7f695f2bb800 1 -- 172.21.15.142:0/2432553217 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56348bfc3270 con 0x56348bfc0660 2024-09-22T08:38:29.906 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.894+0000 7f695c5a4640 1 --2- 172.21.15.142:0/2432553217 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x56348bfc0660 0x56348bfc2b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:29.906 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.894+0000 7f695c5a4640 1 --2- 172.21.15.142:0/2432553217 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x56348bfc0660 0x56348bfc2b20 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:29.907 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.894+0000 7f695c5a4640 1 -- 172.21.15.142:0/2432553217 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6950009050 con 0x56348bfc0660 2024-09-22T08:38:29.907 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.894+0000 7f695f2bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:29.907 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.894+0000 7f695f2bb800 20 realm 2024-09-22T08:38:29.907 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.894+0000 7f695f2bb800 20 rados->read ofs=0 len=0 2024-09-22T08:38:29.907 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.894+0000 7f695f2bb800 1 -- 172.21.15.142:0/2432553217 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56348bfbf9f0 con 0x56348bfc0660 2024-09-22T08:38:29.907 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.895+0000 7f695c5a4640 1 -- 172.21.15.142:0/2432553217 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6950009050 con 0x56348bfc0660 2024-09-22T08:38:29.907 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.895+0000 7f695f2bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:29.907 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.895+0000 7f695f2bb800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:38:29.907 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.895+0000 7f695f2bb800 20 rados->read ofs=0 len=0 2024-09-22T08:38:29.907 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.895+0000 7f695f2bb800 1 -- 172.21.15.142:0/2432553217 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56348bfc3d60 con 0x56348bfc0660 2024-09-22T08:38:29.907 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.895+0000 7f695c5a4640 1 -- 172.21.15.142:0/2432553217 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6950009050 con 0x56348bfc0660 2024-09-22T08:38:29.907 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.895+0000 7f695f2bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:29.907 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.895+0000 7f695f2bb800 20 rados->read ofs=0 len=0 2024-09-22T08:38:29.908 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.895+0000 7f695f2bb800 1 -- 172.21.15.142:0/2432553217 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56348bfc4630 con 0x56348bfc0660 2024-09-22T08:38:29.908 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.895+0000 7f695c5a4640 1 -- 172.21.15.142:0/2432553217 <== osd.1 v2:172.21.15.142:6816/3192108003 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6950009050 con 0x56348bfc0660 2024-09-22T08:38:29.908 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.895+0000 7f695f2bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:38:29.908 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.895+0000 7f695f2bb800 20 rados->read ofs=0 len=0 2024-09-22T08:38:29.908 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.895+0000 7f695f2bb800 1 --2- 172.21.15.142:0/2432553217 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x56348bfc5050 0x56348bfc7440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:29.908 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.895+0000 7f695f2bb800 1 -- 172.21.15.142:0/2432553217 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56348bfc7b80 con 0x56348bfc5050 2024-09-22T08:38:29.908 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.895+0000 7f695d5a6640 1 --2- 172.21.15.142:0/2432553217 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x56348bfc5050 0x56348bfc7440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:29.908 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.895+0000 7f695d5a6640 1 --2- 172.21.15.142:0/2432553217 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x56348bfc5050 0x56348bfc7440 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:29.908 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.896+0000 7f695d5a6640 1 -- 172.21.15.142:0/2432553217 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(5 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f69540083e0 con 0x56348bfc5050 2024-09-22T08:38:29.908 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.896+0000 7f695f2bb800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:38:29.908 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.896+0000 7f695f2bb800 20 searching for the correct realm 2024-09-22T08:38:29.908 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.896+0000 7f695f2bb800 1 -- 172.21.15.142:0/2432553217 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56348bfc94b0 con 0x56348bfc5050 2024-09-22T08:38:29.908 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.896+0000 7f695d5a6640 1 -- 172.21.15.142:0/2432553217 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69540083e0 con 0x56348bfc5050 2024-09-22T08:38:29.908 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.896+0000 7f695d5a6640 1 --2- 172.21.15.142:0/2432553217 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f6954021020 0x7f6954052220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:29.909 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.896+0000 7f695d5a6640 1 -- 172.21.15.142:0/2432553217 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56348bfc94b0 con 0x7f6954021020 2024-09-22T08:38:29.909 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.896+0000 7f695cda5640 1 --2- 172.21.15.142:0/2432553217 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f6954021020 0x7f6954052220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:29.909 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.896+0000 7f695cda5640 1 --2- 172.21.15.142:0/2432553217 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f6954021020 0x7f6954052220 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:29.909 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.897+0000 7f695cda5640 1 -- 172.21.15.142:0/2432553217 <== osd.2 v2:172.21.15.142:6808/279438927 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f694c090040 con 0x7f6954021020 2024-09-22T08:38:29.909 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.897+0000 7f695cda5640 1 --2- 172.21.15.142:0/2432553217 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f694c0a4040 0x7f694c073380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:29.909 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.897+0000 7f695cda5640 1 -- 172.21.15.142:0/2432553217 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56348bfc94b0 con 0x7f694c0a4040 2024-09-22T08:38:29.909 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.897+0000 7f695c5a4640 1 --2- 172.21.15.142:0/2432553217 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f694c0a4040 0x7f694c073380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:29.909 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.897+0000 7f695c5a4640 1 --2- 172.21.15.142:0/2432553217 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f694c0a4040 0x7f694c073380 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:29.909 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.898+0000 7f695c5a4640 1 -- 172.21.15.142:0/2432553217 <== osd.0 v2:172.21.15.31:6800/168281188 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6950009050 con 0x7f694c0a4040 2024-09-22T08:38:29.909 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.898+0000 7f695c5a4640 1 -- 172.21.15.142:0/2432553217 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56348bfc94b0 con 0x56348bfc0660 2024-09-22T08:38:29.909 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.898+0000 7f695c5a4640 1 -- 172.21.15.142:0/2432553217 <== osd.1 v2:172.21.15.142:6816/3192108003 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6950009050 con 0x56348bfc0660 2024-09-22T08:38:29.909 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.898+0000 7f695c5a4640 1 -- 172.21.15.142:0/2432553217 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56348bfc94b0 con 0x56348bfc0660 2024-09-22T08:38:29.909 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.898+0000 7f695c5a4640 1 -- 172.21.15.142:0/2432553217 <== osd.1 v2:172.21.15.142:6816/3192108003 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6950029040 con 0x56348bfc0660 2024-09-22T08:38:29.909 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.898+0000 7f695c5a4640 1 -- 172.21.15.142:0/2432553217 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56348bfc94b0 con 0x56348bfc0660 2024-09-22T08:38:29.909 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.898+0000 7f695c5a4640 1 -- 172.21.15.142:0/2432553217 <== osd.1 v2:172.21.15.142:6816/3192108003 7 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6950029040 con 0x56348bfc0660 2024-09-22T08:38:29.910 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.898+0000 7f695c5a4640 1 -- 172.21.15.142:0/2432553217 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56348bfc94b0 con 0x7f694c0a4040 2024-09-22T08:38:29.910 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.898+0000 7f695c5a4640 1 -- 172.21.15.142:0/2432553217 <== osd.0 v2:172.21.15.31:6800/168281188 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6950029040 con 0x7f694c0a4040 2024-09-22T08:38:29.910 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.898+0000 7f695c5a4640 1 -- 172.21.15.142:0/2432553217 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56348bfc94b0 con 0x7f6954021020 2024-09-22T08:38:29.910 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.899+0000 7f695cda5640 1 -- 172.21.15.142:0/2432553217 <== osd.2 v2:172.21.15.142:6808/279438927 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f694c090040 con 0x7f6954021020 2024-09-22T08:38:29.910 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.899+0000 7f695cda5640 1 -- 172.21.15.142:0/2432553217 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56348bfc94b0 con 0x56348bfc5050 2024-09-22T08:38:29.910 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.899+0000 7f695d5a6640 1 -- 172.21.15.142:0/2432553217 <== osd.3 v2:172.21.15.142:6800/1064901393 3 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69540083e0 con 0x56348bfc5050 2024-09-22T08:38:29.910 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.899+0000 7f695d5a6640 1 -- 172.21.15.142:0/2432553217 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56348bfc94b0 con 0x56348bfc0660 2024-09-22T08:38:29.910 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.899+0000 7f695c5a4640 1 -- 172.21.15.142:0/2432553217 <== osd.1 v2:172.21.15.142:6816/3192108003 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6950029040 con 0x56348bfc0660 2024-09-22T08:38:29.910 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.899+0000 7f695c5a4640 1 -- 172.21.15.142:0/2432553217 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56348bfc94b0 con 0x7f694c0a4040 2024-09-22T08:38:29.910 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.899+0000 7f695c5a4640 1 -- 172.21.15.142:0/2432553217 <== osd.0 v2:172.21.15.31:6800/168281188 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6950029040 con 0x7f694c0a4040 2024-09-22T08:38:29.910 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.899+0000 7f695c5a4640 1 -- 172.21.15.142:0/2432553217 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56348bfc94b0 con 0x56348bfc0660 2024-09-22T08:38:29.910 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.900+0000 7f695c5a4640 1 -- 172.21.15.142:0/2432553217 <== osd.1 v2:172.21.15.142:6816/3192108003 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6950029040 con 0x56348bfc0660 2024-09-22T08:38:29.910 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.900+0000 7f695c5a4640 1 -- 172.21.15.142:0/2432553217 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56348bfc94b0 con 0x7f6954021020 2024-09-22T08:38:29.911 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.900+0000 7f695cda5640 1 -- 172.21.15.142:0/2432553217 <== osd.2 v2:172.21.15.142:6808/279438927 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f694c090040 con 0x7f6954021020 2024-09-22T08:38:29.911 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.900+0000 7f695cda5640 1 -- 172.21.15.142:0/2432553217 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56348bfc94b0 con 0x56348bfc5050 2024-09-22T08:38:29.911 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.900+0000 7f695d5a6640 1 -- 172.21.15.142:0/2432553217 <== osd.3 v2:172.21.15.142:6800/1064901393 4 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69540083e0 con 0x56348bfc5050 2024-09-22T08:38:29.911 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.900+0000 7f695d5a6640 1 -- 172.21.15.142:0/2432553217 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56348bfc94b0 con 0x56348bfc5050 2024-09-22T08:38:29.911 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.900+0000 7f695d5a6640 1 -- 172.21.15.142:0/2432553217 <== osd.3 v2:172.21.15.142:6800/1064901393 5 ==== osd_op_reply(20 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f69540083e0 con 0x56348bfc5050 2024-09-22T08:38:29.911 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.900+0000 7f695d5a6640 1 -- 172.21.15.142:0/2432553217 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56348bfc94b0 con 0x7f694c0a4040 2024-09-22T08:38:29.911 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.901+0000 7f695c5a4640 1 -- 172.21.15.142:0/2432553217 <== osd.0 v2:172.21.15.31:6800/168281188 4 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6950029040 con 0x7f694c0a4040 2024-09-22T08:38:29.911 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.901+0000 7f695c5a4640 1 -- 172.21.15.142:0/2432553217 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56348bfc94b0 con 0x56348bfc5050 2024-09-22T08:38:29.911 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.901+0000 7f695d5a6640 1 -- 172.21.15.142:0/2432553217 <== osd.3 v2:172.21.15.142:6800/1064901393 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69540083e0 con 0x56348bfc5050 2024-09-22T08:38:29.911 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.901+0000 7f695d5a6640 1 -- 172.21.15.142:0/2432553217 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56348bfc94b0 con 0x56348bfc5050 2024-09-22T08:38:29.911 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.901+0000 7f695d5a6640 1 -- 172.21.15.142:0/2432553217 <== osd.3 v2:172.21.15.142:6800/1064901393 7 ==== osd_op_reply(23 [pgnls start_epoch 32 out=107b] v32'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f69540083e0 con 0x56348bfc5050 2024-09-22T08:38:29.911 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.901+0000 7f695d5a6640 1 -- 172.21.15.142:0/2432553217 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56348bfc94b0 con 0x56348bfc0660 2024-09-22T08:38:29.911 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.901+0000 7f695c5a4640 1 -- 172.21.15.142:0/2432553217 <== osd.1 v2:172.21.15.142:6816/3192108003 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6950029040 con 0x56348bfc0660 2024-09-22T08:38:29.911 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.901+0000 7f695c5a4640 1 -- 172.21.15.142:0/2432553217 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56348bfc94b0 con 0x56348bfc0660 2024-09-22T08:38:29.912 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.902+0000 7f695c5a4640 1 -- 172.21.15.142:0/2432553217 <== osd.1 v2:172.21.15.142:6816/3192108003 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v32'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f6950029040 con 0x56348bfc0660 2024-09-22T08:38:29.912 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.902+0000 7f695c5a4640 1 -- 172.21.15.142:0/2432553217 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56348bfc94b0 con 0x7f694c0a4040 2024-09-22T08:38:29.912 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.902+0000 7f695c5a4640 1 -- 172.21.15.142:0/2432553217 <== osd.0 v2:172.21.15.31:6800/168281188 5 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6950029040 con 0x7f694c0a4040 2024-09-22T08:38:29.912 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.902+0000 7f695c5a4640 1 -- 172.21.15.142:0/2432553217 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56348bfc94b0 con 0x56348bfc5050 2024-09-22T08:38:29.912 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.902+0000 7f695d5a6640 1 -- 172.21.15.142:0/2432553217 <== osd.3 v2:172.21.15.142:6800/1064901393 8 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69540083e0 con 0x56348bfc5050 2024-09-22T08:38:29.912 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.902+0000 7f695d5a6640 1 -- 172.21.15.142:0/2432553217 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56348bfc94b0 con 0x7f6954021020 2024-09-22T08:38:29.912 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.902+0000 7f695cda5640 1 -- 172.21.15.142:0/2432553217 <== osd.2 v2:172.21.15.142:6808/279438927 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f694c090040 con 0x7f6954021020 2024-09-22T08:38:29.912 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.902+0000 7f695cda5640 1 -- 172.21.15.142:0/2432553217 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56348bfc94b0 con 0x56348bfc0660 2024-09-22T08:38:29.912 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.903+0000 7f695c5a4640 1 -- 172.21.15.142:0/2432553217 <== osd.1 v2:172.21.15.142:6816/3192108003 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6950029040 con 0x56348bfc0660 2024-09-22T08:38:29.912 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.903+0000 7f695c5a4640 1 -- 172.21.15.142:0/2432553217 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56348bfc94b0 con 0x7f694c0a4040 2024-09-22T08:38:29.912 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.903+0000 7f695c5a4640 1 -- 172.21.15.142:0/2432553217 <== osd.0 v2:172.21.15.31:6800/168281188 6 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6950029040 con 0x7f694c0a4040 2024-09-22T08:38:29.912 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.903+0000 7f695c5a4640 1 -- 172.21.15.142:0/2432553217 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56348bfc94b0 con 0x56348bfc5050 2024-09-22T08:38:29.912 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.903+0000 7f695d5a6640 1 -- 172.21.15.142:0/2432553217 <== osd.3 v2:172.21.15.142:6800/1064901393 9 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69540083e0 con 0x56348bfc5050 2024-09-22T08:38:29.912 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.903+0000 7f695d5a6640 1 -- 172.21.15.142:0/2432553217 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56348bfc94b0 con 0x7f694c0a4040 2024-09-22T08:38:29.913 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.903+0000 7f695c5a4640 1 -- 172.21.15.142:0/2432553217 <== osd.0 v2:172.21.15.31:6800/168281188 7 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6950029040 con 0x7f694c0a4040 2024-09-22T08:38:29.913 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.903+0000 7f695c5a4640 1 -- 172.21.15.142:0/2432553217 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56348bfc94b0 con 0x7f6954021020 2024-09-22T08:38:29.913 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.904+0000 7f695cda5640 1 -- 172.21.15.142:0/2432553217 <== osd.2 v2:172.21.15.142:6808/279438927 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f694c090040 con 0x7f6954021020 2024-09-22T08:38:29.913 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.904+0000 7f695cda5640 1 -- 172.21.15.142:0/2432553217 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56348bfc94b0 con 0x56348bfc5050 2024-09-22T08:38:29.913 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.904+0000 7f695d5a6640 1 -- 172.21.15.142:0/2432553217 <== osd.3 v2:172.21.15.142:6800/1064901393 10 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69540083e0 con 0x56348bfc5050 2024-09-22T08:38:29.913 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.904+0000 7f695d5a6640 1 -- 172.21.15.142:0/2432553217 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56348bfc94b0 con 0x7f694c0a4040 2024-09-22T08:38:29.918 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.904+0000 7f695c5a4640 1 -- 172.21.15.142:0/2432553217 <== osd.0 v2:172.21.15.31:6800/168281188 8 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6950029040 con 0x7f694c0a4040 2024-09-22T08:38:29.918 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.904+0000 7f695c5a4640 1 -- 172.21.15.142:0/2432553217 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56348bfc94b0 con 0x56348bfc0660 2024-09-22T08:38:29.919 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.904+0000 7f695c5a4640 1 -- 172.21.15.142:0/2432553217 <== osd.1 v2:172.21.15.142:6816/3192108003 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v32'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f6950029040 con 0x56348bfc0660 2024-09-22T08:38:29.919 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.904+0000 7f695c5a4640 1 -- 172.21.15.142:0/2432553217 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56348bfc94b0 con 0x7f6954021020 2024-09-22T08:38:29.919 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.905+0000 7f695cda5640 1 -- 172.21.15.142:0/2432553217 <== osd.2 v2:172.21.15.142:6808/279438927 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f694c090040 con 0x7f6954021020 2024-09-22T08:38:29.919 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.905+0000 7f695f2bb800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:38:29.919 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.905+0000 7f695f2bb800 20 RGWRados::pool_iterate: got zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec 2024-09-22T08:38:29.919 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.905+0000 7f695f2bb800 20 RGWRados::pool_iterate: got zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f 2024-09-22T08:38:29.919 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.905+0000 7f695f2bb800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:38:29.919 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.905+0000 7f695f2bb800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:38:29.919 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.905+0000 7f695f2bb800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:38:29.919 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.905+0000 7f695f2bb800 20 rados->read ofs=0 len=0 2024-09-22T08:38:29.919 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.905+0000 7f695f2bb800 1 -- 172.21.15.142:0/2432553217 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56348bfc8570 con 0x56348bfc0660 2024-09-22T08:38:29.919 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.905+0000 7f695c5a4640 1 -- 172.21.15.142:0/2432553217 <== osd.1 v2:172.21.15.142:6816/3192108003 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6950029040 con 0x56348bfc0660 2024-09-22T08:38:29.919 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.905+0000 7f695f2bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:29.919 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.905+0000 7f695f2bb800 20 rados->read ofs=0 len=0 2024-09-22T08:38:29.919 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.905+0000 7f695f2bb800 1 -- 172.21.15.142:0/2432553217 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56348bfc8dc0 con 0x56348bfc0660 2024-09-22T08:38:29.920 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.905+0000 7f695c5a4640 1 -- 172.21.15.142:0/2432553217 <== osd.1 v2:172.21.15.142:6816/3192108003 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6950029040 con 0x56348bfc0660 2024-09-22T08:38:29.920 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.905+0000 7f695f2bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:38:29.920 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.905+0000 7f695f2bb800 20 rados->read ofs=0 len=0 2024-09-22T08:38:29.920 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.905+0000 7f695f2bb800 1 -- 172.21.15.142:0/2432553217 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:40 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56348bfc9930 con 0x56348bfc5050 2024-09-22T08:38:29.920 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.905+0000 7f695d5a6640 1 -- 172.21.15.142:0/2432553217 <== osd.3 v2:172.21.15.142:6800/1064901393 11 ==== osd_op_reply(40 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f69540083e0 con 0x56348bfc5050 2024-09-22T08:38:29.920 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.905+0000 7f695f2bb800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:38:29.920 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.905+0000 7f695f2bb800 20 zone default found 2024-09-22T08:38:29.920 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.905+0000 7f695f2bb800 4 Realm: () 2024-09-22T08:38:29.920 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.905+0000 7f695f2bb800 4 ZoneGroup: default (d89f6f57-1007-47dd-9065-f486c7b01aec) 2024-09-22T08:38:29.920 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.905+0000 7f695f2bb800 4 Zone: default (e239248c-0bee-4e41-803a-24b288d3eb8f) 2024-09-22T08:38:29.920 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.905+0000 7f695f2bb800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:38:29.920 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.905+0000 7f695f2bb800 20 zonegroup default 2024-09-22T08:38:29.920 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.905+0000 7f695f2bb800 20 rados->read ofs=0 len=0 2024-09-22T08:38:29.921 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.905+0000 7f695f2bb800 1 -- 172.21.15.142:0/2432553217 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56348bfc9cd0 con 0x7f694c0a4040 2024-09-22T08:38:29.921 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.906+0000 7f695c5a4640 1 -- 172.21.15.142:0/2432553217 <== osd.0 v2:172.21.15.31:6800/168281188 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f6950029040 con 0x7f694c0a4040 2024-09-22T08:38:29.921 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.906+0000 7f695f2bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:29.921 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.906+0000 7f695f2bb800 20 rados->read ofs=0 len=0 2024-09-22T08:38:29.921 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.906+0000 7f695f2bb800 1 -- 172.21.15.142:0/2432553217 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56348bfcbfb0 con 0x56348bfc5050 2024-09-22T08:38:29.921 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.906+0000 7f695d5a6640 1 -- 172.21.15.142:0/2432553217 <== osd.3 v2:172.21.15.142:6800/1064901393 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f69540083e0 con 0x56348bfc5050 2024-09-22T08:38:29.921 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.906+0000 7f695f2bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:29.921 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.906+0000 7f695f2bb800 20 rados->read ofs=0 len=0 2024-09-22T08:38:29.921 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.906+0000 7f695f2bb800 1 -- 172.21.15.142:0/2432553217 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56348bfcc350 con 0x56348bfc5050 2024-09-22T08:38:29.921 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.906+0000 7f695d5a6640 1 -- 172.21.15.142:0/2432553217 <== osd.3 v2:172.21.15.142:6800/1064901393 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f69540083e0 con 0x56348bfc5050 2024-09-22T08:38:29.921 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.906+0000 7f695f2bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:29.921 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.906+0000 7f695f2bb800 20 started sync module instance, tier type = 2024-09-22T08:38:29.921 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.906+0000 7f695f2bb800 20 started zone id=e239248c-0bee-4e41-803a-24b288d3eb8f (name=default) with tier type = 2024-09-22T08:38:29.921 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.906+0000 7f695f2bb800 1 -- 172.21.15.142:0/2432553217 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56348bfcb3f0 con 0x7f6954021020 2024-09-22T08:38:29.922 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.907+0000 7f695cda5640 1 -- 172.21.15.142:0/2432553217 <== osd.2 v2:172.21.15.142:6808/279438927 7 ==== osd_op_reply(44 notify.0 [create] v32'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f694c090040 con 0x7f6954021020 2024-09-22T08:38:29.922 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.907+0000 7f695f2bb800 1 -- 172.21.15.142:0/2432553217 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94783686881088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56348bfcc7b0 con 0x7f6954021020 2024-09-22T08:38:29.922 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.907+0000 7f695f2bb800 1 -- 172.21.15.142:0/2432553217 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56348bfcd000 con 0x56348bfc0660 2024-09-22T08:38:29.922 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.908+0000 7f695cda5640 1 -- 172.21.15.142:0/2432553217 <== osd.2 v2:172.21.15.142:6808/279438927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94783686881088] v32'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f694c090040 con 0x7f6954021020 2024-09-22T08:38:29.922 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.909+0000 7f695c5a4640 1 -- 172.21.15.142:0/2432553217 <== osd.1 v2:172.21.15.142:6816/3192108003 16 ==== osd_op_reply(46 notify.1 [create] v32'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6950029040 con 0x56348bfc0660 2024-09-22T08:38:29.922 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.909+0000 7f695f2bb800 1 -- 172.21.15.142:0/2432553217 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94783686888272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56348bfcd420 con 0x56348bfc0660 2024-09-22T08:38:29.922 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.909+0000 7f695f2bb800 1 -- 172.21.15.142:0/2432553217 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56348bfcdcd0 con 0x56348bfc5050 2024-09-22T08:38:29.922 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.910+0000 7f695c5a4640 1 -- 172.21.15.142:0/2432553217 <== osd.1 v2:172.21.15.142:6816/3192108003 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94783686888272] v32'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6950029040 con 0x56348bfc0660 2024-09-22T08:38:29.922 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.910+0000 7f695d5a6640 1 -- 172.21.15.142:0/2432553217 <== osd.3 v2:172.21.15.142:6800/1064901393 14 ==== osd_op_reply(48 notify.2 [create] v32'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69540083e0 con 0x56348bfc5050 2024-09-22T08:38:29.922 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.910+0000 7f695f2bb800 1 -- 172.21.15.142:0/2432553217 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94783686889328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56348bfcd840 con 0x56348bfc5050 2024-09-22T08:38:29.922 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.910+0000 7f695f2bb800 1 -- 172.21.15.142:0/2432553217 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56348bfce790 con 0x7f6954021020 2024-09-22T08:38:29.922 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.911+0000 7f695d5a6640 1 -- 172.21.15.142:0/2432553217 <== osd.3 v2:172.21.15.142:6800/1064901393 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94783686889328] v32'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69540083e0 con 0x56348bfc5050 2024-09-22T08:38:29.922 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.911+0000 7f695cda5640 1 -- 172.21.15.142:0/2432553217 <== osd.2 v2:172.21.15.142:6808/279438927 9 ==== osd_op_reply(50 notify.3 [create] v32'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f694c090040 con 0x7f6954021020 2024-09-22T08:38:29.922 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.911+0000 7f695f2bb800 1 -- 172.21.15.142:0/2432553217 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94783686890384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56348bfcd7b0 con 0x7f6954021020 2024-09-22T08:38:29.923 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.911+0000 7f695f2bb800 1 -- 172.21.15.142:0/2432553217 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56348bfcf650 con 0x56348bfc0660 2024-09-22T08:38:29.923 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.912+0000 7f695cda5640 1 -- 172.21.15.142:0/2432553217 <== osd.2 v2:172.21.15.142:6808/279438927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94783686890384] v32'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f694c090040 con 0x7f6954021020 2024-09-22T08:38:29.923 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.913+0000 7f695c5a4640 1 -- 172.21.15.142:0/2432553217 <== osd.1 v2:172.21.15.142:6816/3192108003 18 ==== osd_op_reply(52 notify.4 [create] v32'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6950029040 con 0x56348bfc0660 2024-09-22T08:38:29.923 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.913+0000 7f695f2bb800 1 -- 172.21.15.142:0/2432553217 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94783686898080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56348bfcfa70 con 0x56348bfc0660 2024-09-22T08:38:29.923 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.913+0000 7f695f2bb800 1 -- 172.21.15.142:0/2432553217 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56348bfd0430 con 0x7f694c0a4040 2024-09-22T08:38:29.923 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.914+0000 7f695c5a4640 1 -- 172.21.15.142:0/2432553217 <== osd.0 v2:172.21.15.31:6800/168281188 10 ==== osd_op_reply(54 notify.5 [create] v32'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6950029040 con 0x7f694c0a4040 2024-09-22T08:38:29.923 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.914+0000 7f695f2bb800 1 -- 172.21.15.142:0/2432553217 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94783686901632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56348bfd03a0 con 0x7f694c0a4040 2024-09-22T08:38:29.923 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.914+0000 7f695f2bb800 1 -- 172.21.15.142:0/2432553217 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56348bfd13e0 con 0x7f694c0a4040 2024-09-22T08:38:29.923 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.914+0000 7f695c5a4640 1 -- 172.21.15.142:0/2432553217 <== osd.1 v2:172.21.15.142:6816/3192108003 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94783686898080] v32'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6950029040 con 0x56348bfc0660 2024-09-22T08:38:29.923 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.915+0000 7f695c5a4640 1 -- 172.21.15.142:0/2432553217 <== osd.0 v2:172.21.15.31:6800/168281188 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94783686901632] v32'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6950029040 con 0x7f694c0a4040 2024-09-22T08:38:29.923 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.915+0000 7f695c5a4640 1 -- 172.21.15.142:0/2432553217 <== osd.0 v2:172.21.15.31:6800/168281188 12 ==== osd_op_reply(56 notify.6 [create] v32'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6950029040 con 0x7f694c0a4040 2024-09-22T08:38:29.923 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.915+0000 7f695f2bb800 1 -- 172.21.15.142:0/2432553217 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94783686899136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56348bfd07d0 con 0x7f694c0a4040 2024-09-22T08:38:29.923 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.915+0000 7f695f2bb800 1 -- 172.21.15.142:0/2432553217 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56348bfd1890 con 0x7f694c0a4040 2024-09-22T08:38:29.923 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.916+0000 7f695c5a4640 1 -- 172.21.15.142:0/2432553217 <== osd.0 v2:172.21.15.31:6800/168281188 13 ==== osd_op_reply(58 notify.7 [create] v32'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6950029040 con 0x7f694c0a4040 2024-09-22T08:38:29.924 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.916+0000 7f695c5a4640 1 -- 172.21.15.142:0/2432553217 <== osd.0 v2:172.21.15.31:6800/168281188 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94783686899136] v32'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6950029040 con 0x7f694c0a4040 2024-09-22T08:38:29.924 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.916+0000 7f695f2bb800 1 -- 172.21.15.142:0/2432553217 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94783686906848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56348bfd1800 con 0x7f694c0a4040 2024-09-22T08:38:29.924 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.916+0000 7f695f2bb800 20 add_watcher() i=0 2024-09-22T08:38:29.924 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.916+0000 7f695f2bb800 20 add_watcher() i=1 2024-09-22T08:38:29.924 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.916+0000 7f695f2bb800 20 add_watcher() i=2 2024-09-22T08:38:29.924 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.916+0000 7f695f2bb800 20 add_watcher() i=3 2024-09-22T08:38:29.924 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.916+0000 7f695f2bb800 20 add_watcher() i=4 2024-09-22T08:38:29.924 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.916+0000 7f695f2bb800 20 add_watcher() i=5 2024-09-22T08:38:29.924 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.916+0000 7f695f2bb800 20 add_watcher() i=6 2024-09-22T08:38:29.926 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.917+0000 7f695c5a4640 1 -- 172.21.15.142:0/2432553217 <== osd.0 v2:172.21.15.31:6800/168281188 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94783686906848] v32'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6950029040 con 0x7f694c0a4040 2024-09-22T08:38:29.926 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.917+0000 7f695f2bb800 20 add_watcher() i=7 2024-09-22T08:38:29.926 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.917+0000 7f695f2bb800 2 all 8 watchers are set, enabling cache 2024-09-22T08:38:29.926 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.917+0000 7f695f2bb800 1 -- 172.21.15.142:0/2432553217 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56348bfd4d80 con 0x56348bfc0660 2024-09-22T08:38:29.926 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.918+0000 7f695c5a4640 1 -- 172.21.15.142:0/2432553217 <== osd.1 v2:172.21.15.142:6816/3192108003 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f6950029040 con 0x56348bfc0660 2024-09-22T08:38:29.926 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.918+0000 7f695f2bb800 1 -- 172.21.15.142:0/2432553217 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94783686905536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56348bfd2110 con 0x56348bfc0660 2024-09-22T08:38:29.926 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.919+0000 7f695c5a4640 1 -- 172.21.15.142:0/2432553217 <== osd.1 v2:172.21.15.142:6816/3192108003 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94783686905536] v32'246 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6950029040 con 0x56348bfc0660 2024-09-22T08:38:29.926 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.919+0000 7f68137e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:38:29.926 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.919+0000 7f695f2bb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:38:29.926 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.919+0000 7f695f2bb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:38:29.927 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.919+0000 7f695f2bb800 1 -- 172.21.15.142:0/2432553217 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56348bfdd8d0 con 0x56348bfc0660 2024-09-22T08:38:29.927 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.920+0000 7f695c5a4640 1 -- 172.21.15.142:0/2432553217 <== osd.1 v2:172.21.15.142:6816/3192108003 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'35 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6950029040 con 0x56348bfc0660 2024-09-22T08:38:29.927 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.920+0000 7f695f2bb800 1 -- 172.21.15.142:0/2432553217 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56348bfddf00 con 0x7f694c0a4040 2024-09-22T08:38:29.927 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.921+0000 7f695c5a4640 1 -- 172.21.15.142:0/2432553217 <== osd.0 v2:172.21.15.31:6800/168281188 16 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'29 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6950029040 con 0x7f694c0a4040 2024-09-22T08:38:29.927 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.921+0000 7f695f2bb800 1 -- 172.21.15.142:0/2432553217 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56348bfde340 con 0x56348bfc5050 2024-09-22T08:38:29.927 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.922+0000 7f695d5a6640 1 -- 172.21.15.142:0/2432553217 <== osd.3 v2:172.21.15.142:6800/1064901393 16 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'30 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f69540083e0 con 0x56348bfc5050 2024-09-22T08:38:29.927 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.922+0000 7f695f2bb800 1 -- 172.21.15.142:0/2432553217 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56348bfde270 con 0x56348bfc0660 2024-09-22T08:38:29.927 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.923+0000 7f695c5a4640 1 -- 172.21.15.142:0/2432553217 <== osd.1 v2:172.21.15.142:6816/3192108003 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'247 uv162 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6950029040 con 0x56348bfc0660 2024-09-22T08:38:29.927 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.923+0000 7f695f2bb800 1 -- 172.21.15.142:0/2432553217 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56348bfde880 con 0x7f6954021020 2024-09-22T08:38:29.928 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.924+0000 7f695cda5640 1 -- 172.21.15.142:0/2432553217 <== osd.2 v2:172.21.15.142:6808/279438927 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'79 uv53 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f694c090040 con 0x7f6954021020 2024-09-22T08:38:29.928 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.924+0000 7f695f2bb800 1 -- 172.21.15.142:0/2432553217 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56348bfded10 con 0x56348bfc5050 2024-09-22T08:38:29.928 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.925+0000 7f695d5a6640 1 -- 172.21.15.142:0/2432553217 <== osd.3 v2:172.21.15.142:6800/1064901393 17 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'52 uv34 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f69540083e0 con 0x56348bfc5050 2024-09-22T08:38:29.928 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.925+0000 7f695f2bb800 1 -- 172.21.15.142:0/2432553217 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56348bfded10 con 0x56348bfc0660 2024-09-22T08:38:29.929 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.927+0000 7f695c5a4640 1 -- 172.21.15.142:0/2432553217 <== osd.1 v2:172.21.15.142:6816/3192108003 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'31 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6950029040 con 0x56348bfc0660 2024-09-22T08:38:29.929 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.927+0000 7f695f2bb800 1 -- 172.21.15.142:0/2432553217 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56348bfdeda0 con 0x7f694c0a4040 2024-09-22T08:38:29.930 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.928+0000 7f695c5a4640 1 -- 172.21.15.142:0/2432553217 <== osd.0 v2:172.21.15.31:6800/168281188 17 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'51 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6950029040 con 0x7f694c0a4040 2024-09-22T08:38:29.930 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.928+0000 7f695f2bb800 1 -- 172.21.15.142:0/2432553217 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56348bfdee30 con 0x7f6954021020 2024-09-22T08:38:29.931 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.929+0000 7f695cda5640 1 -- 172.21.15.142:0/2432553217 <== osd.2 v2:172.21.15.142:6808/279438927 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'29 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f694c090040 con 0x7f6954021020 2024-09-22T08:38:29.931 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.929+0000 7f695f2bb800 1 -- 172.21.15.142:0/2432553217 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56348bfdeec0 con 0x56348bfc5050 2024-09-22T08:38:29.932 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.930+0000 7f695d5a6640 1 -- 172.21.15.142:0/2432553217 <== osd.3 v2:172.21.15.142:6800/1064901393 18 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'35 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f69540083e0 con 0x56348bfc5050 2024-09-22T08:38:29.932 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.930+0000 7f695f2bb800 1 -- 172.21.15.142:0/2432553217 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56348bfdeec0 con 0x7f6954021020 2024-09-22T08:38:29.933 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.931+0000 7f695cda5640 1 -- 172.21.15.142:0/2432553217 <== osd.2 v2:172.21.15.142:6808/279438927 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'80 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f694c090040 con 0x7f6954021020 2024-09-22T08:38:29.933 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.931+0000 7f695f2bb800 1 -- 172.21.15.142:0/2432553217 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56348bfdef50 con 0x7f694c0a4040 2024-09-22T08:38:29.934 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.932+0000 7f695c5a4640 1 -- 172.21.15.142:0/2432553217 <== osd.0 v2:172.21.15.31:6800/168281188 18 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'35 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6950029040 con 0x7f694c0a4040 2024-09-22T08:38:29.934 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.932+0000 7f695f2bb800 1 -- 172.21.15.142:0/2432553217 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56348bfdef50 con 0x7f6954021020 2024-09-22T08:38:29.935 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.933+0000 7f695cda5640 1 -- 172.21.15.142:0/2432553217 <== osd.2 v2:172.21.15.142:6808/279438927 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'29 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f694c090040 con 0x7f6954021020 2024-09-22T08:38:29.935 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.933+0000 7f695f2bb800 1 -- 172.21.15.142:0/2432553217 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56348bfdf080 con 0x7f694c0a4040 2024-09-22T08:38:29.936 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.934+0000 7f695c5a4640 1 -- 172.21.15.142:0/2432553217 <== osd.0 v2:172.21.15.31:6800/168281188 19 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'59 uv44 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6950029040 con 0x7f694c0a4040 2024-09-22T08:38:29.936 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.934+0000 7f695f2bb800 1 -- 172.21.15.142:0/2432553217 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56348bfdf080 con 0x56348bfc0660 2024-09-22T08:38:29.937 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.935+0000 7f695c5a4640 1 -- 172.21.15.142:0/2432553217 <== osd.1 v2:172.21.15.142:6816/3192108003 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'248 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6950029040 con 0x56348bfc0660 2024-09-22T08:38:29.937 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.935+0000 7f695f2bb800 1 -- 172.21.15.142:0/2432553217 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56348bfdf080 con 0x56348bfc5050 2024-09-22T08:38:29.938 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.936+0000 7f695d5a6640 1 -- 172.21.15.142:0/2432553217 <== osd.3 v2:172.21.15.142:6800/1064901393 19 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'71 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f69540083e0 con 0x56348bfc5050 2024-09-22T08:38:29.938 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.936+0000 7f695f2bb800 1 -- 172.21.15.142:0/2432553217 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56348bfdf080 con 0x7f6954021020 2024-09-22T08:38:29.939 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.937+0000 7f695cda5640 1 -- 172.21.15.142:0/2432553217 <== osd.2 v2:172.21.15.142:6808/279438927 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'81 uv57 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f694c090040 con 0x7f6954021020 2024-09-22T08:38:29.939 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.937+0000 7f695f2bb800 1 -- 172.21.15.142:0/2432553217 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56348bfdf0a0 con 0x56348bfc5050 2024-09-22T08:38:29.940 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.938+0000 7f695d5a6640 1 -- 172.21.15.142:0/2432553217 <== osd.3 v2:172.21.15.142:6800/1064901393 20 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'29 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f69540083e0 con 0x56348bfc5050 2024-09-22T08:38:29.940 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.938+0000 7f695f2bb800 1 -- 172.21.15.142:0/2432553217 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56348bfdf0a0 con 0x56348bfc0660 2024-09-22T08:38:29.941 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.939+0000 7f695c5a4640 1 -- 172.21.15.142:0/2432553217 <== osd.1 v2:172.21.15.142:6816/3192108003 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'37 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6950029040 con 0x56348bfc0660 2024-09-22T08:38:29.942 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.939+0000 7f695f2bb800 1 -- 172.21.15.142:0/2432553217 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56348bfdf0a0 con 0x56348bfc0660 2024-09-22T08:38:29.942 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.940+0000 7f695c5a4640 1 -- 172.21.15.142:0/2432553217 <== osd.1 v2:172.21.15.142:6816/3192108003 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'249 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6950029040 con 0x56348bfc0660 2024-09-22T08:38:29.942 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.940+0000 7f695f2bb800 1 -- 172.21.15.142:0/2432553217 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56348bfdf0a0 con 0x56348bfc5050 2024-09-22T08:38:29.944 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.941+0000 7f695d5a6640 1 -- 172.21.15.142:0/2432553217 <== osd.3 v2:172.21.15.142:6800/1064901393 21 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'72 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f69540083e0 con 0x56348bfc5050 2024-09-22T08:38:29.944 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.942+0000 7f695f2bb800 1 -- 172.21.15.142:0/2432553217 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56348bfdf0e0 con 0x7f6954021020 2024-09-22T08:38:29.945 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.943+0000 7f695cda5640 1 -- 172.21.15.142:0/2432553217 <== osd.2 v2:172.21.15.142:6808/279438927 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'39 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f694c090040 con 0x7f6954021020 2024-09-22T08:38:29.945 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.943+0000 7f695f2bb800 1 -- 172.21.15.142:0/2432553217 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56348bfdf0e0 con 0x56348bfc5050 2024-09-22T08:38:29.946 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.943+0000 7f695d5a6640 1 -- 172.21.15.142:0/2432553217 <== osd.3 v2:172.21.15.142:6800/1064901393 22 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'31 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f69540083e0 con 0x56348bfc5050 2024-09-22T08:38:29.946 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.944+0000 7f695f2bb800 1 -- 172.21.15.142:0/2432553217 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56348bfdf0e0 con 0x56348bfc5050 2024-09-22T08:38:29.946 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.944+0000 7f695d5a6640 1 -- 172.21.15.142:0/2432553217 <== osd.3 v2:172.21.15.142:6800/1064901393 23 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'36 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f69540083e0 con 0x56348bfc5050 2024-09-22T08:38:29.946 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.944+0000 7f695f2bb800 1 -- 172.21.15.142:0/2432553217 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56348bfdf0e0 con 0x56348bfc5050 2024-09-22T08:38:29.947 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.945+0000 7f695d5a6640 1 -- 172.21.15.142:0/2432553217 <== osd.3 v2:172.21.15.142:6800/1064901393 24 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'25 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f69540083e0 con 0x56348bfc5050 2024-09-22T08:38:29.947 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.945+0000 7f695f2bb800 1 -- 172.21.15.142:0/2432553217 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56348bfdf0e0 con 0x56348bfc5050 2024-09-22T08:38:29.948 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.946+0000 7f695d5a6640 1 -- 172.21.15.142:0/2432553217 <== osd.3 v2:172.21.15.142:6800/1064901393 25 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'53 uv36 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f69540083e0 con 0x56348bfc5050 2024-09-22T08:38:29.948 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.946+0000 7f695f2bb800 1 -- 172.21.15.142:0/2432553217 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56348bfdf0e0 con 0x7f694c0a4040 2024-09-22T08:38:29.949 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.947+0000 7f695c5a4640 1 -- 172.21.15.142:0/2432553217 <== osd.0 v2:172.21.15.31:6800/168281188 20 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'31 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6950029040 con 0x7f694c0a4040 2024-09-22T08:38:29.950 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.948+0000 7f695f2bb800 1 -- 172.21.15.142:0/2432553217 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56348bfdf0e0 con 0x56348bfc5050 2024-09-22T08:38:29.950 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.948+0000 7f695d5a6640 1 -- 172.21.15.142:0/2432553217 <== osd.3 v2:172.21.15.142:6800/1064901393 26 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'30 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f69540083e0 con 0x56348bfc5050 2024-09-22T08:38:29.951 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.948+0000 7f695f2bb800 1 -- 172.21.15.142:0/2432553217 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56348bfdf0e0 con 0x7f694c0a4040 2024-09-22T08:38:29.952 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.950+0000 7f695c5a4640 1 -- 172.21.15.142:0/2432553217 <== osd.0 v2:172.21.15.31:6800/168281188 21 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'52 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6950029040 con 0x7f694c0a4040 2024-09-22T08:38:29.952 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.950+0000 7f695f2bb800 1 -- 172.21.15.142:0/2432553217 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56348bfdf0e0 con 0x56348bfc5050 2024-09-22T08:38:29.953 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.951+0000 7f695d5a6640 1 -- 172.21.15.142:0/2432553217 <== osd.3 v2:172.21.15.142:6800/1064901393 27 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'73 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f69540083e0 con 0x56348bfc5050 2024-09-22T08:38:29.953 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.951+0000 7f695f2bb800 1 -- 172.21.15.142:0/2432553217 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56348bfdf0e0 con 0x7f694c0a4040 2024-09-22T08:38:29.955 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.953+0000 7f695c5a4640 1 -- 172.21.15.142:0/2432553217 <== osd.0 v2:172.21.15.31:6800/168281188 22 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'60 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6950029040 con 0x7f694c0a4040 2024-09-22T08:38:29.955 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.953+0000 7f695f2bb800 1 -- 172.21.15.142:0/2432553217 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56348bfdf0e0 con 0x7f6954021020 2024-09-22T08:38:29.956 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.954+0000 7f695cda5640 1 -- 172.21.15.142:0/2432553217 <== osd.2 v2:172.21.15.142:6808/279438927 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'35 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f694c090040 con 0x7f6954021020 2024-09-22T08:38:29.957 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.954+0000 7f68127e4640 20 reqs_thread_entry: start 2024-09-22T08:38:29.957 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.954+0000 7f695f2bb800 20 init_complete bucket index max shards: 11 2024-09-22T08:38:29.957 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.954+0000 7f695f2bb800 20 Filter name: none 2024-09-22T08:38:29.957 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.954+0000 7f680bfff640 20 reqs_thread_entry: start 2024-09-22T08:38:29.957 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.954+0000 7f695f2bb800 10 cache get: name=default.rgw.meta+users.uid+system_user : miss 2024-09-22T08:38:29.957 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.954+0000 7f695f2bb800 20 rados->read ofs=0 len=0 2024-09-22T08:38:29.957 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.954+0000 7f695f2bb800 1 -- 172.21.15.142:0/2432553217 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:94 8.1e 8:78ce4db0:users.uid::system_user:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56348c009e40 con 0x7f694c0a4040 2024-09-22T08:38:29.958 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.955+0000 7f695c5a4640 1 -- 172.21.15.142:0/2432553217 <== osd.0 v2:172.21.15.31:6800/168281188 23 ==== osd_op_reply(94 system_user [call out=48b,read 0~349 out=349b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 239+0+472 (crc 0 0 0) 0x7f6950029040 con 0x7f694c0a4040 2024-09-22T08:38:29.958 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.955+0000 7f695f2bb800 20 rados_obj.operate() r=0 bl.length=349 2024-09-22T08:38:29.958 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.955+0000 7f695f2bb800 10 cache put: name=default.rgw.meta+users.uid+system_user info.flags=0x13 2024-09-22T08:38:29.958 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.955+0000 7f695f2bb800 10 adding default.rgw.meta+users.uid+system_user to cache LRU end 2024-09-22T08:38:29.958 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.955+0000 7f695f2bb800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:38:29.958 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.955+0000 7f695f2bb800 1 -- 172.21.15.142:0/2432553217 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:95 8.1e 8:79f34a7d:users.uid::system_user.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56348c00c8d0 con 0x7f694c0a4040 2024-09-22T08:38:29.958 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.955+0000 7f695c5a4640 1 -- 172.21.15.142:0/2432553217 <== osd.0 v2:172.21.15.31:6800/168281188 24 ==== osd_op_reply(95 system_user.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 163+0+0 (crc 0 0 0) 0x7f6950029040 con 0x7f694c0a4040 2024-09-22T08:38:29.958 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.955+0000 7f695f2bb800 10 removing key index: system_akey 2024-09-22T08:38:29.958 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.955+0000 7f695f2bb800 1 -- 172.21.15.142:0/2432553217 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:96 8.0 8:01223cbf:users.keys::system_akey:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56348c00a8b0 con 0x56348bfc5050 2024-09-22T08:38:29.959 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.956+0000 7f695d5a6640 1 -- 172.21.15.142:0/2432553217 <== osd.3 v2:172.21.15.142:6800/1064901393 28 ==== osd_op_reply(96 system_akey [delete] v32'2 uv2 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f69540083e0 con 0x56348bfc5050 2024-09-22T08:38:29.959 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.956+0000 7f695f2bb800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:users.keys:system_akey, ofs0, ns] 2024-09-22T08:38:29.960 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.956+0000 7f695f2bb800 1 -- 172.21.15.142:0/2432553217 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [notify cookie 94783687144464 in=173b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56348c00ccf0 con 0x56348bfc0660 2024-09-22T08:38:29.960 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.957+0000 7f695c5a4640 1 -- 172.21.15.142:0/2432553217 <== osd.1 v2:172.21.15.142:6816/3192108003 28 ==== watch-notify(notify (1) cookie 94783686888272 notify 137438953495 ret 0) ==== 203+0+0 (crc 0 0 0) 0x56348bfddee0 con 0x56348bfc0660 2024-09-22T08:38:29.960 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.957+0000 7f6833fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953495 cookie 94783686888272 notifier 4849 bl.length()=161 2024-09-22T08:38:29.960 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.957+0000 7f695c5a4640 1 -- 172.21.15.142:0/2432553217 <== osd.1 v2:172.21.15.142:6816/3192108003 29 ==== osd_op_reply(97 notify.1 [notify cookie 94783687144464 out=8b] v0'0 uv249 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f6950029040 con 0x56348bfc0660 2024-09-22T08:38:29.960 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.957+0000 7f6833fff640 1 -- 172.21.15.142:0/2432553217 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f6820003d60 con 0x56348bfc0660 2024-09-22T08:38:29.960 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.957+0000 7f695c5a4640 1 -- 172.21.15.142:0/2432553217 <== osd.1 v2:172.21.15.142:6816/3192108003 30 ==== osd_op_reply(98 notify.1 [notify-ack] v0'0 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6950029040 con 0x56348bfc0660 2024-09-22T08:38:29.960 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.957+0000 7f695c5a4640 1 -- 172.21.15.142:0/2432553217 <== osd.1 v2:172.21.15.142:6816/3192108003 31 ==== watch-notify(notify_complete (2) cookie 94783687144464 notify 137438953495 ret 0) ==== 42+0+48 (crc 0 0 0) 0x56348bfb54f0 con 0x56348bfc0660 2024-09-22T08:38:29.960 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.957+0000 7f695f2bb800 10 removing email index: 2024-09-22T08:38:29.960 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.957+0000 7f695f2bb800 10 removing user buckets index 2024-09-22T08:38:29.960 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.957+0000 7f695f2bb800 1 -- 172.21.15.142:0/2432553217 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:99 8.1e 8:79f34a7d:users.uid::system_user.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56348c00a860 con 0x7f694c0a4040 2024-09-22T08:38:29.961 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.958+0000 7f695c5a4640 1 -- 172.21.15.142:0/2432553217 <== osd.0 v2:172.21.15.31:6800/168281188 25 ==== osd_op_reply(99 system_user.buckets [delete] v32'2 uv1 ondisk = -2 ((2) No such file or directory)) ==== 163+0+0 (crc 0 0 0) 0x7f6950029040 con 0x7f694c0a4040 2024-09-22T08:38:29.961 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.958+0000 7f695f2bb800 10 removing user index: system_user 2024-09-22T08:38:29.961 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.958+0000 7f695f2bb800 1 -- 172.21.15.142:0/2432553217 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:100 8.1e 8:78ce4db0:users.uid::system_user:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56348c00a860 con 0x7f694c0a4040 2024-09-22T08:38:29.962 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.960+0000 7f695c5a4640 1 -- 172.21.15.142:0/2432553217 <== osd.0 v2:172.21.15.31:6800/168281188 26 ==== osd_op_reply(100 system_user [call,call,delete] v32'3 uv3 ondisk = 0) ==== 239+0+0 (crc 0 0 0) 0x7f6950029040 con 0x7f694c0a4040 2024-09-22T08:38:29.962 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.960+0000 7f695f2bb800 10 removing default.rgw.meta+users.uid+system_user from cache 2024-09-22T08:38:29.962 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.960+0000 7f695f2bb800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:users.uid:system_user, ofs0, ns] 2024-09-22T08:38:29.962 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.960+0000 7f695f2bb800 1 -- 172.21.15.142:0/2432553217 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:101 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94783687140272 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56348c00a7d0 con 0x7f6954021020 2024-09-22T08:38:29.962 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.960+0000 7f695cda5640 1 -- 172.21.15.142:0/2432553217 <== osd.2 v2:172.21.15.142:6808/279438927 18 ==== watch-notify(notify (1) cookie 94783686881088 notify 137438953514 ret 0) ==== 202+0+0 (crc 0 0 0) 0x56348bfdd160 con 0x7f6954021020 2024-09-22T08:38:29.962 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.960+0000 7f6833fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953514 cookie 94783686881088 notifier 4849 bl.length()=160 2024-09-22T08:38:29.963 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.960+0000 7f6833fff640 1 -- 172.21.15.142:0/2432553217 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:102 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f6820003d60 con 0x7f6954021020 2024-09-22T08:38:29.963 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.960+0000 7f695cda5640 1 -- 172.21.15.142:0/2432553217 <== osd.2 v2:172.21.15.142:6808/279438927 19 ==== osd_op_reply(101 notify.0 [notify cookie 94783687140272 out=8b] v0'0 uv249 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f694c090040 con 0x7f6954021020 2024-09-22T08:38:29.963 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.960+0000 7f695cda5640 1 -- 172.21.15.142:0/2432553217 <== osd.2 v2:172.21.15.142:6808/279438927 20 ==== watch-notify(notify_complete (2) cookie 94783687140272 notify 137438953514 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f694c09e070 con 0x7f6954021020 2024-09-22T08:38:29.963 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.960+0000 7f695cda5640 1 -- 172.21.15.142:0/2432553217 <== osd.2 v2:172.21.15.142:6808/279438927 21 ==== osd_op_reply(102 notify.0 [notify-ack] v0'0 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f694c090040 con 0x7f6954021020 2024-09-22T08:38:29.963 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.961+0000 7f68137e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:38:29.963 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.961+0000 7f695f2bb800 1 -- 172.21.15.142:0/2432553217 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:103 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94783686905536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56348c00a810 con 0x56348bfc0660 2024-09-22T08:38:29.964 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.962+0000 7f695c5a4640 1 -- 172.21.15.142:0/2432553217 <== osd.1 v2:172.21.15.142:6816/3192108003 32 ==== osd_op_reply(103 data_loggenerations_metadata [watch unwatch cookie 94783686905536] v32'250 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6950029040 con 0x56348bfc0660 2024-09-22T08:38:29.964 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.962+0000 7f695f2bb800 1 -- 172.21.15.142:0/2432553217 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:104 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94783686881088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56348c00a810 con 0x7f6954021020 2024-09-22T08:38:29.965 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.963+0000 7f695cda5640 1 -- 172.21.15.142:0/2432553217 <== osd.2 v2:172.21.15.142:6808/279438927 22 ==== osd_op_reply(104 notify.0 [watch unwatch cookie 94783686881088] v32'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f694c090040 con 0x7f6954021020 2024-09-22T08:38:29.965 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.963+0000 7f695f2bb800 20 remove_watcher() i=0 2024-09-22T08:38:29.966 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.963+0000 7f695f2bb800 2 removed watcher, disabling cache 2024-09-22T08:38:29.966 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.963+0000 7f695f2bb800 1 -- 172.21.15.142:0/2432553217 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:105 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94783686888272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56348c00a810 con 0x56348bfc0660 2024-09-22T08:38:29.967 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.966+0000 7f695c5a4640 1 -- 172.21.15.142:0/2432553217 <== osd.1 v2:172.21.15.142:6816/3192108003 33 ==== osd_op_reply(105 notify.1 [watch unwatch cookie 94783686888272] v32'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6950029040 con 0x56348bfc0660 2024-09-22T08:38:29.967 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.966+0000 7f695f2bb800 20 remove_watcher() i=1 2024-09-22T08:38:29.967 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.966+0000 7f695f2bb800 1 -- 172.21.15.142:0/2432553217 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:106 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94783686889328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56348c00a810 con 0x56348bfc5050 2024-09-22T08:38:29.968 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.967+0000 7f695d5a6640 1 -- 172.21.15.142:0/2432553217 <== osd.3 v2:172.21.15.142:6800/1064901393 29 ==== osd_op_reply(106 notify.2 [watch unwatch cookie 94783686889328] v32'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69540083e0 con 0x56348bfc5050 2024-09-22T08:38:29.968 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.967+0000 7f695f2bb800 20 remove_watcher() i=2 2024-09-22T08:38:29.968 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.967+0000 7f695f2bb800 1 -- 172.21.15.142:0/2432553217 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:107 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94783686890384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56348bfd0ec0 con 0x7f6954021020 2024-09-22T08:38:29.969 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.968+0000 7f695cda5640 1 -- 172.21.15.142:0/2432553217 <== osd.2 v2:172.21.15.142:6808/279438927 23 ==== osd_op_reply(107 notify.3 [watch unwatch cookie 94783686890384] v32'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f694c090040 con 0x7f6954021020 2024-09-22T08:38:29.969 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.968+0000 7f695f2bb800 20 remove_watcher() i=3 2024-09-22T08:38:29.969 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.968+0000 7f695f2bb800 1 -- 172.21.15.142:0/2432553217 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:108 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94783686898080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56348c00a810 con 0x56348bfc0660 2024-09-22T08:38:29.970 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.969+0000 7f695c5a4640 1 -- 172.21.15.142:0/2432553217 <== osd.1 v2:172.21.15.142:6816/3192108003 34 ==== osd_op_reply(108 notify.4 [watch unwatch cookie 94783686898080] v32'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6950029040 con 0x56348bfc0660 2024-09-22T08:38:29.970 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.969+0000 7f695f2bb800 20 remove_watcher() i=4 2024-09-22T08:38:29.970 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.969+0000 7f695f2bb800 1 -- 172.21.15.142:0/2432553217 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:109 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94783686901632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56348c00a810 con 0x7f694c0a4040 2024-09-22T08:38:29.971 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.970+0000 7f695c5a4640 1 -- 172.21.15.142:0/2432553217 <== osd.0 v2:172.21.15.31:6800/168281188 27 ==== osd_op_reply(109 notify.5 [watch unwatch cookie 94783686901632] v32'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6950029040 con 0x7f694c0a4040 2024-09-22T08:38:29.972 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.970+0000 7f695f2bb800 20 remove_watcher() i=5 2024-09-22T08:38:29.972 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.970+0000 7f695f2bb800 1 -- 172.21.15.142:0/2432553217 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:110 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94783686899136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56348c00a810 con 0x7f694c0a4040 2024-09-22T08:38:29.972 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.970+0000 7f695c5a4640 1 -- 172.21.15.142:0/2432553217 <== osd.0 v2:172.21.15.31:6800/168281188 28 ==== osd_op_reply(110 notify.6 [watch unwatch cookie 94783686899136] v32'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6950029040 con 0x7f694c0a4040 2024-09-22T08:38:29.972 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.970+0000 7f695f2bb800 20 remove_watcher() i=6 2024-09-22T08:38:29.973 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.970+0000 7f695f2bb800 1 -- 172.21.15.142:0/2432553217 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:111 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94783686906848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56348bfcff80 con 0x7f694c0a4040 2024-09-22T08:38:29.976 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.971+0000 7f695c5a4640 1 -- 172.21.15.142:0/2432553217 <== osd.0 v2:172.21.15.31:6800/168281188 29 ==== osd_op_reply(111 notify.7 [watch unwatch cookie 94783686906848] v32'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6950029040 con 0x7f694c0a4040 2024-09-22T08:38:29.976 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.971+0000 7f695f2bb800 20 remove_watcher() i=7 2024-09-22T08:38:29.976 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.972+0000 7f695f2bb800 1 -- 172.21.15.142:0/2432553217 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f694c0a4040 msgr2=0x7f694c073380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:29.976 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.972+0000 7f695f2bb800 1 --2- 172.21.15.142:0/2432553217 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f694c0a4040 0x7f694c073380 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:29.976 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.972+0000 7f695f2bb800 1 -- 172.21.15.142:0/2432553217 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x56348bfc0660 msgr2=0x56348bfc2b20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:29.976 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.972+0000 7f695f2bb800 1 --2- 172.21.15.142:0/2432553217 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x56348bfc0660 0x56348bfc2b20 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:29.976 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.972+0000 7f695f2bb800 1 -- 172.21.15.142:0/2432553217 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f6954021020 msgr2=0x7f6954052220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:29.976 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.972+0000 7f695f2bb800 1 --2- 172.21.15.142:0/2432553217 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f6954021020 0x7f6954052220 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:29.976 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.972+0000 7f695f2bb800 1 -- 172.21.15.142:0/2432553217 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x56348bfc5050 msgr2=0x56348bfc7440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:29.976 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.972+0000 7f695f2bb800 1 --2- 172.21.15.142:0/2432553217 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x56348bfc5050 0x56348bfc7440 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:29.976 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.972+0000 7f695f2bb800 1 -- 172.21.15.142:0/2432553217 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f682803cfb0 msgr2=0x7f682803f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:29.976 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.972+0000 7f695f2bb800 1 --2- 172.21.15.142:0/2432553217 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f682803cfb0 0x7f682803f470 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f694c04ef20 tx=0x7f694c08b000 comp rx=0 tx=0).stop 2024-09-22T08:38:29.977 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.972+0000 7f695f2bb800 1 -- 172.21.15.142:0/2432553217 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56348bfad710 msgr2=0x56348bfb4d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:29.977 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.972+0000 7f695f2bb800 1 --2- 172.21.15.142:0/2432553217 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56348bfad710 0x56348bfb4d00 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f6954015a60 tx=0x7f6954053d50 comp rx=0 tx=0).stop 2024-09-22T08:38:29.977 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.972+0000 7f695c5a4640 1 -- 172.21.15.142:0/2432553217 reap_dead start 2024-09-22T08:38:29.977 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.972+0000 7f695c5a4640 1 -- 172.21.15.142:0/2432553217 reap_dead start 2024-09-22T08:38:29.977 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.972+0000 7f695f2bb800 1 -- 172.21.15.142:0/2432553217 shutdown_connections 2024-09-22T08:38:29.977 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.972+0000 7f695f2bb800 1 -- 172.21.15.142:0/2432553217 >> 172.21.15.142:0/2432553217 conn(0x56348bfa9b30 msgr2=0x56348bfa7d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:38:29.977 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.972+0000 7f695f2bb800 1 -- 172.21.15.142:0/2432553217 shutdown_connections 2024-09-22T08:38:29.977 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.972+0000 7f695f2bb800 1 -- 172.21.15.142:0/2432553217 wait complete. 2024-09-22T08:38:29.977 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.972+0000 7f695f2bb800 1 -- 172.21.15.142:0/3081015956 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f683403d000 msgr2=0x7f683403f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:29.977 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.972+0000 7f695f2bb800 1 --2- 172.21.15.142:0/3081015956 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f683403d000 0x7f683403f4c0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f694c096c70 tx=0x7f694c07e600 comp rx=0 tx=0).stop 2024-09-22T08:38:29.977 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.972+0000 7f695f2bb800 1 -- 172.21.15.142:0/3081015956 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56348bfa0cd0 msgr2=0x56348bfa10f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:29.977 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.972+0000 7f695f2bb800 1 --2- 172.21.15.142:0/3081015956 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56348bfa0cd0 0x56348bfa10f0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x56348bf87bb0 tx=0x7f695400bf30 comp rx=0 tx=0).stop 2024-09-22T08:38:29.977 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.972+0000 7f695f2bb800 1 -- 172.21.15.142:0/3081015956 shutdown_connections 2024-09-22T08:38:29.978 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.972+0000 7f695f2bb800 1 --2- 172.21.15.142:0/3081015956 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f683403d000 0x7f683403f4c0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:29.978 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.972+0000 7f695f2bb800 1 --2- 172.21.15.142:0/3081015956 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56348bfa0cd0 0x56348bfa10f0 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:29.978 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.972+0000 7f695f2bb800 1 -- 172.21.15.142:0/3081015956 >> 172.21.15.142:0/3081015956 conn(0x56348bf95080 msgr2=0x56348bf95460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:38:29.978 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.972+0000 7f695f2bb800 1 -- 172.21.15.142:0/3081015956 shutdown_connections 2024-09-22T08:38:29.978 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.972+0000 7f695f2bb800 1 -- 172.21.15.142:0/3081015956 wait complete. 2024-09-22T08:38:29.978 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.973+0000 7f695f2bb800 1 -- 172.21.15.142:0/433333830 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x56348be8f9b0 msgr2=0x56348bf8d2c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:29.978 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.973+0000 7f695f2bb800 1 --2- 172.21.15.142:0/433333830 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x56348be8f9b0 0x56348bf8d2c0 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:29.978 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.973+0000 7f695f2bb800 1 -- 172.21.15.142:0/433333830 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x56348bf8f6e0 msgr2=0x56348bf91b50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:29.978 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.973+0000 7f695f2bb800 1 --2- 172.21.15.142:0/433333830 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x56348bf8f6e0 0x56348bf91b50 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:29.978 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.973+0000 7f695f2bb800 1 -- 172.21.15.142:0/433333830 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f684403cfb0 msgr2=0x7f684403f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:29.978 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.973+0000 7f695f2bb800 1 --2- 172.21.15.142:0/433333830 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f684403cfb0 0x7f684403f470 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f6950001d70 tx=0x7f69500012d0 comp rx=0 tx=0).stop 2024-09-22T08:38:29.978 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.973+0000 7f695f2bb800 1 -- 172.21.15.142:0/433333830 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56348be8d080 msgr2=0x56348bf85c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:29.978 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.973+0000 7f695f2bb800 1 --2- 172.21.15.142:0/433333830 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56348be8d080 0x56348bf85c70 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f694c025a60 tx=0x7f694c003330 comp rx=0 tx=0).stop 2024-09-22T08:38:29.978 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.973+0000 7f695f2bb800 1 -- 172.21.15.142:0/433333830 shutdown_connections 2024-09-22T08:38:29.979 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.973+0000 7f695f2bb800 1 --2- 172.21.15.142:0/433333830 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x56348bf8f6e0 0x56348bf91b50 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:29.979 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.973+0000 7f695f2bb800 1 --2- 172.21.15.142:0/433333830 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x56348be8f9b0 0x56348bf8d2c0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:29.979 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.973+0000 7f695f2bb800 1 --2- 172.21.15.142:0/433333830 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f684403cfb0 0x7f684403f470 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:29.979 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.973+0000 7f695f2bb800 1 --2- 172.21.15.142:0/433333830 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56348be8d080 0x56348bf85c70 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:29.979 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.973+0000 7f695f2bb800 1 -- 172.21.15.142:0/433333830 >> 172.21.15.142:0/433333830 conn(0x56348be86be0 msgr2=0x56348bf774e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:38:29.979 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.973+0000 7f695f2bb800 1 -- 172.21.15.142:0/433333830 shutdown_connections 2024-09-22T08:38:29.979 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:29.973+0000 7f695f2bb800 1 -- 172.21.15.142:0/433333830 wait complete. 2024-09-22T08:38:29.983 ERROR:root:None 2024-09-22T08:38:29.984 ERROR:root:0 2024-09-22T08:38:29.984 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'a_user', '--display-name', 'True Admin User', '--access-key', 'true_admin_akey', '--secret', 'true_admin_skey', '--caps', 'user-info-without-keys=read', '--admin'] 2024-09-22T08:38:29.984 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'a_user', '--display-name', 'True Admin User', '--access-key', 'true_admin_akey', '--secret', 'true_admin_skey', '--caps', 'user-info-without-keys=read', '--admin'] 2024-09-22T08:38:29.984 DEBUG:teuthology.orchestra.run.smithi142:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid a_user --display-name 'True Admin User' --access-key true_admin_akey --secret true_admin_skey --caps user-info-without-keys=read --admin 2024-09-22T08:38:30.038 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:38:30.038 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:38:30.039 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.038+0000 7f0f01b46800 1 Processor -- start 2024-09-22T08:38:30.039 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.038+0000 7f0f01b46800 1 -- start start 2024-09-22T08:38:30.039 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.038+0000 7f0f01b46800 1 --2- >> v2:172.21.15.31:3300/0 conn(0x56129b1db840 0x56129b1dc540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:30.039 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.038+0000 7f0f01b46800 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56129b067a20 con 0x56129b1dca80 2024-09-22T08:38:30.039 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.038+0000 7f0f01b46800 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x56129b0677d0 con 0x56129b1db840 2024-09-22T08:38:30.040 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.038+0000 7f0eff630640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x56129b1db840 0x56129b1dc540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:30.040 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.038+0000 7f0ef6e2f640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x56129b1dca80 0x56129b1e15d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.142:50484/0 (socket says 172.21.15.142:50484) 2024-09-22T08:38:30.040 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.038+0000 7f0ef6e2f640 1 -- 172.21.15.142:0/3757571217 learned_addr learned my addr 172.21.15.142:0/3757571217 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-09-22T08:38:30.040 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.039+0000 7f0efee2f640 1 -- 172.21.15.142:0/3757571217 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2670609046 0 0) 0x56129b067a20 con 0x56129b1dca80 2024-09-22T08:38:30.040 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.039+0000 7f0efee2f640 1 -- 172.21.15.142:0/3757571217 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0eec001e10 con 0x56129b1dca80 2024-09-22T08:38:30.041 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.039+0000 7f0eff630640 1 -- 172.21.15.142:0/3757571217 >> v1:172.21.15.31:6789/0 conn(0x56129b1dca80 legacy=0x56129b1e15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:30.041 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.039+0000 7f0eff630640 1 -- 172.21.15.142:0/3757571217 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56129b1dbf40 con 0x56129b1db840 2024-09-22T08:38:30.042 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.041+0000 7f0eff630640 1 --2- 172.21.15.142:0/3757571217 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56129b1db840 0x56129b1dc540 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f0ef000a470 tx=0x7f0ef0045920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2606b5a1ece31122 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:30.043 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.041+0000 7f0efee2f640 1 -- 172.21.15.142:0/3757571217 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ef0059070 con 0x56129b1db840 2024-09-22T08:38:30.043 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.041+0000 7f0efee2f640 1 -- 172.21.15.142:0/3757571217 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ef0054570 con 0x56129b1db840 2024-09-22T08:38:30.043 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.041+0000 7f0efee2f640 1 -- 172.21.15.142:0/3757571217 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ef0054870 con 0x56129b1db840 2024-09-22T08:38:30.043 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.041+0000 7f0f01b46800 1 -- 172.21.15.142:0/3757571217 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56129b1db840 msgr2=0x56129b1dc540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:30.043 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.041+0000 7f0f01b46800 1 --2- 172.21.15.142:0/3757571217 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56129b1db840 0x56129b1dc540 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f0ef000a470 tx=0x7f0ef0045920 comp rx=0 tx=0).stop 2024-09-22T08:38:30.043 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.041+0000 7f0f01b46800 1 -- 172.21.15.142:0/3757571217 shutdown_connections 2024-09-22T08:38:30.043 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.041+0000 7f0f01b46800 1 --2- 172.21.15.142:0/3757571217 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56129b1db840 0x56129b1dc540 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:30.043 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.041+0000 7f0f01b46800 1 -- 172.21.15.142:0/3757571217 >> 172.21.15.142:0/3757571217 conn(0x56129b1d6c30 msgr2=0x56129b1d9070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:38:30.043 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.041+0000 7f0f01b46800 1 -- 172.21.15.142:0/3757571217 shutdown_connections 2024-09-22T08:38:30.043 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.041+0000 7f0f01b46800 1 -- 172.21.15.142:0/3757571217 wait complete. 2024-09-22T08:38:30.056 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.055+0000 7f0f01b46800 1 Processor -- start 2024-09-22T08:38:30.056 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.055+0000 7f0f01b46800 1 -- start start 2024-09-22T08:38:30.056 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.055+0000 7f0f01b46800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56129b1db840 0x56129b2c9ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:30.056 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.055+0000 7f0f01b46800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x56129b074dd0 con 0x56129b1db840 2024-09-22T08:38:30.057 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.056+0000 7f0eff630640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56129b1db840 0x56129b2c9ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:30.057 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.056+0000 7f0eff630640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56129b1db840 0x56129b2c9ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:51824/0 (socket says 172.21.15.142:51824) 2024-09-22T08:38:30.058 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.056+0000 7f0eff630640 1 -- 172.21.15.142:0/5117377 learned_addr learned my addr 172.21.15.142:0/5117377 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:38:30.058 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.056+0000 7f0eff630640 1 -- 172.21.15.142:0/5117377 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56129b2ca2d0 con 0x56129b1db840 2024-09-22T08:38:30.058 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.056+0000 7f0eff630640 1 --2- 172.21.15.142:0/5117377 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56129b1db840 0x56129b2c9ce0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f0ef000a470 tx=0x7f0ef004e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdaa7fb632a6700f server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:30.058 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.056+0000 7f0ded60a640 1 -- 172.21.15.142:0/5117377 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ef0065070 con 0x56129b1db840 2024-09-22T08:38:30.058 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.056+0000 7f0ded60a640 1 -- 172.21.15.142:0/5117377 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ef005a040 con 0x56129b1db840 2024-09-22T08:38:30.058 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.056+0000 7f0ded60a640 1 -- 172.21.15.142:0/5117377 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ef0059070 con 0x56129b1db840 2024-09-22T08:38:30.059 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.057+0000 7f0f01b46800 1 -- 172.21.15.142:0/5117377 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56129b1db840 msgr2=0x56129b2c9ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:30.059 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.057+0000 7f0f01b46800 1 --2- 172.21.15.142:0/5117377 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56129b1db840 0x56129b2c9ce0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f0ef000a470 tx=0x7f0ef004e000 comp rx=0 tx=0).stop 2024-09-22T08:38:30.059 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.057+0000 7f0f01b46800 1 -- 172.21.15.142:0/5117377 shutdown_connections 2024-09-22T08:38:30.059 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.057+0000 7f0f01b46800 1 --2- 172.21.15.142:0/5117377 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56129b1db840 0x56129b2c9ce0 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:30.059 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.057+0000 7f0f01b46800 1 -- 172.21.15.142:0/5117377 >> 172.21.15.142:0/5117377 conn(0x56129b1d6c30 msgr2=0x56129b2c5660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:38:30.059 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.057+0000 7f0f01b46800 1 -- 172.21.15.142:0/5117377 shutdown_connections 2024-09-22T08:38:30.059 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.057+0000 7f0f01b46800 1 -- 172.21.15.142:0/5117377 wait complete. 2024-09-22T08:38:30.060 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.057+0000 7f0f01b46800 1 Processor -- start 2024-09-22T08:38:30.060 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.057+0000 7f0f01b46800 1 -- start start 2024-09-22T08:38:30.060 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.058+0000 7f0f01b46800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56129b1db840 0x56129b2d1790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:30.060 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.058+0000 7f0f01b46800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x56129b1dd2f0 con 0x56129b1db840 2024-09-22T08:38:30.060 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.058+0000 7f0eff630640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56129b1db840 0x56129b2d1790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:30.060 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.058+0000 7f0eff630640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56129b1db840 0x56129b2d1790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:51838/0 (socket says 172.21.15.142:51838) 2024-09-22T08:38:30.060 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.058+0000 7f0eff630640 1 -- 172.21.15.142:0/3738393730 learned_addr learned my addr 172.21.15.142:0/3738393730 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:38:30.060 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.058+0000 7f0eff630640 1 -- 172.21.15.142:0/3738393730 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56129b2d1cf0 con 0x56129b1db840 2024-09-22T08:38:30.062 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.058+0000 7f0eff630640 1 --2- 172.21.15.142:0/3738393730 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56129b1db840 0x56129b2d1790 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f0ef0025b20 tx=0x7f0ef0002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:30.062 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.058+0000 7f0debe07640 1 -- 172.21.15.142:0/3738393730 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ef0071070 con 0x56129b1db840 2024-09-22T08:38:30.062 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.059+0000 7f0debe07640 1 -- 172.21.15.142:0/3738393730 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ef0066040 con 0x56129b1db840 2024-09-22T08:38:30.062 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.059+0000 7f0debe07640 1 -- 172.21.15.142:0/3738393730 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ef0065050 con 0x56129b1db840 2024-09-22T08:38:30.062 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.059+0000 7f0f01b46800 1 -- 172.21.15.142:0/3738393730 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56129b2d1f80 con 0x56129b1db840 2024-09-22T08:38:30.063 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.059+0000 7f0f01b46800 1 -- 172.21.15.142:0/3738393730 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56129b2d2980 con 0x56129b1db840 2024-09-22T08:38:30.063 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.059+0000 7f0debe07640 1 -- 172.21.15.142:0/3738393730 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f0ef0074070 con 0x56129b1db840 2024-09-22T08:38:30.063 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.060+0000 7f0debe07640 1 --2- 172.21.15.142:0/3738393730 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f0de403cfb0 0x7f0de403f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:30.063 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.060+0000 7f0debe07640 1 -- 172.21.15.142:0/3738393730 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5938+0+0 (secure 0 0 0) 0x7f0ef0096fc0 con 0x56129b1db840 2024-09-22T08:38:30.063 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.060+0000 7f0ef6e2f640 1 --2- 172.21.15.142:0/3738393730 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f0de403cfb0 0x7f0de403f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:30.063 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.060+0000 7f0f01b46800 1 --2- 172.21.15.142:0/3738393730 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x56129b1dca80 0x56129b2d8de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:30.063 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.060+0000 7f0f01b46800 1 -- 172.21.15.142:0/3738393730 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56129b2d9320 con 0x56129b1dca80 2024-09-22T08:38:30.063 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.060+0000 7f0effe31640 1 --2- 172.21.15.142:0/3738393730 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x56129b1dca80 0x56129b2d8de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:30.063 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.060+0000 7f0ef6e2f640 1 --2- 172.21.15.142:0/3738393730 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f0de403cfb0 0x7f0de403f470 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f0ee8001db0 tx=0x7f0ee8001310 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:30.063 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.060+0000 7f0effe31640 1 --2- 172.21.15.142:0/3738393730 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x56129b1dca80 0x56129b2d8de0 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:30.063 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.061+0000 7f0effe31640 1 -- 172.21.15.142:0/3738393730 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0ef800a4d0 con 0x56129b1dca80 2024-09-22T08:38:30.063 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.061+0000 7f0f01b46800 1 -- 172.21.15.142:0/3738393730 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56129b2d96c0 con 0x56129b1dca80 2024-09-22T08:38:30.064 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.061+0000 7f0effe31640 1 -- 172.21.15.142:0/3738393730 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0ef800a4d0 con 0x56129b1dca80 2024-09-22T08:38:30.064 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.061+0000 7f0f01b46800 1 --2- 172.21.15.142:0/3738393730 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x56129b2db1c0 0x56129b2dd640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:30.064 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.061+0000 7f0f01b46800 1 -- 172.21.15.142:0/3738393730 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:3 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56129b2dddd0 con 0x56129b2db1c0 2024-09-22T08:38:30.064 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.061+0000 7f0eff630640 1 --2- 172.21.15.142:0/3738393730 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x56129b2db1c0 0x56129b2dd640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:30.064 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.061+0000 7f0eff630640 1 --2- 172.21.15.142:0/3738393730 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x56129b2db1c0 0x56129b2dd640 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:30.067 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.061+0000 7f0eff630640 1 -- 172.21.15.142:0/3738393730 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(3 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f0ef0073030 con 0x56129b2db1c0 2024-09-22T08:38:30.067 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.062+0000 7f0f01b46800 1 -- 172.21.15.142:0/3738393730 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56129b2d9f10 con 0x56129b1dca80 2024-09-22T08:38:30.067 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.062+0000 7f0effe31640 1 -- 172.21.15.142:0/3738393730 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0ef800a4d0 con 0x56129b1dca80 2024-09-22T08:38:30.067 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.062+0000 7f0f01b46800 1 -- 172.21.15.142:0/3738393730 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56129b2da360 con 0x56129b2db1c0 2024-09-22T08:38:30.067 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.062+0000 7f0eff630640 1 -- 172.21.15.142:0/3738393730 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(5 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f0ef0073030 con 0x56129b2db1c0 2024-09-22T08:38:30.067 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.062+0000 7f0f01b46800 1 Processor -- start 2024-09-22T08:38:30.067 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.062+0000 7f0f01b46800 1 -- start start 2024-09-22T08:38:30.067 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.063+0000 7f0f01b46800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56129b2f0b90 0x56129b2f0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:30.067 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.063+0000 7f0f01b46800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x56129b0d3d50 con 0x56129b2f0b90 2024-09-22T08:38:30.067 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.063+0000 7f0effe31640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56129b2f0b90 0x56129b2f0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:30.067 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.063+0000 7f0effe31640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56129b2f0b90 0x56129b2f0fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:51846/0 (socket says 172.21.15.142:51846) 2024-09-22T08:38:30.068 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.063+0000 7f0effe31640 1 -- 172.21.15.142:0/1104799216 learned_addr learned my addr 172.21.15.142:0/1104799216 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:38:30.068 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.063+0000 7f0effe31640 1 -- 172.21.15.142:0/1104799216 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56129b2f15f0 con 0x56129b2f0b90 2024-09-22T08:38:30.068 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.063+0000 7f0effe31640 1 --2- 172.21.15.142:0/1104799216 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56129b2f0b90 0x56129b2f0fb0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x56129b2d2790 tx=0x7f0ef80167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:30.068 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.064+0000 7f0de9602640 1 -- 172.21.15.142:0/1104799216 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ef8013640 con 0x56129b2f0b90 2024-09-22T08:38:30.068 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.064+0000 7f0de9602640 1 -- 172.21.15.142:0/1104799216 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ef80137e0 con 0x56129b2f0b90 2024-09-22T08:38:30.068 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.064+0000 7f0f01b46800 1 -- 172.21.15.142:0/1104799216 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56129b2f1e20 con 0x56129b2f0b90 2024-09-22T08:38:30.068 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.064+0000 7f0de9602640 1 -- 172.21.15.142:0/1104799216 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ef8013ae0 con 0x56129b2f0b90 2024-09-22T08:38:30.068 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.064+0000 7f0f01b46800 1 -- 172.21.15.142:0/1104799216 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56129b2f23c0 con 0x56129b2f0b90 2024-09-22T08:38:30.068 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.064+0000 7f0de9602640 1 -- 172.21.15.142:0/1104799216 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f0ef8011040 con 0x56129b2f0b90 2024-09-22T08:38:30.068 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.065+0000 7f0de9602640 1 --2- 172.21.15.142:0/1104799216 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f0dd803d070 0x7f0dd803f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:30.068 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.065+0000 7f0de9602640 1 -- 172.21.15.142:0/1104799216 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5938+0+0 (secure 0 0 0) 0x7f0ef800e040 con 0x56129b2f0b90 2024-09-22T08:38:30.068 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.065+0000 7f0eff630640 1 --2- 172.21.15.142:0/1104799216 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f0dd803d070 0x7f0dd803f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:30.068 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.065+0000 7f0f01b46800 1 Processor -- start 2024-09-22T08:38:30.069 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.065+0000 7f0eff630640 1 --2- 172.21.15.142:0/1104799216 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f0dd803d070 0x7f0dd803f530 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f0ef0095470 tx=0x7f0ef006a5f0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:30.069 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.065+0000 7f0f01b46800 1 -- start start 2024-09-22T08:38:30.069 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.065+0000 7f0f01b46800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56129b2fd5e0 0x56129b2fd9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:30.069 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.065+0000 7f0f01b46800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x56129b2ca640 con 0x56129b2fd5e0 2024-09-22T08:38:30.069 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.065+0000 7f0effe31640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56129b2fd5e0 0x56129b2fd9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:30.069 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.065+0000 7f0effe31640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56129b2fd5e0 0x56129b2fd9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:51848/0 (socket says 172.21.15.142:51848) 2024-09-22T08:38:30.069 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.066+0000 7f0effe31640 1 -- 172.21.15.142:0/22434528 learned_addr learned my addr 172.21.15.142:0/22434528 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:38:30.069 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.066+0000 7f0effe31640 1 -- 172.21.15.142:0/22434528 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56129b2fdfd0 con 0x56129b2fd5e0 2024-09-22T08:38:30.069 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.066+0000 7f0effe31640 1 --2- 172.21.15.142:0/22434528 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56129b2fd5e0 0x56129b2fd9e0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f0ef8054810 tx=0x7f0ef80143c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be55f26d7fe8ec94 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:30.076 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.066+0000 7f0de2ffd640 1 -- 172.21.15.142:0/22434528 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ef8044030 con 0x56129b2fd5e0 2024-09-22T08:38:30.076 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.066+0000 7f0de2ffd640 1 -- 172.21.15.142:0/22434528 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ef8056070 con 0x56129b2fd5e0 2024-09-22T08:38:30.076 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.066+0000 7f0de2ffd640 1 -- 172.21.15.142:0/22434528 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ef8021910 con 0x56129b2fd5e0 2024-09-22T08:38:30.076 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.067+0000 7f0f01b46800 1 -- 172.21.15.142:0/22434528 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56129b2fd5e0 msgr2=0x56129b2fd9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:30.076 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.067+0000 7f0f01b46800 1 --2- 172.21.15.142:0/22434528 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56129b2fd5e0 0x56129b2fd9e0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f0ef8054810 tx=0x7f0ef80143c0 comp rx=0 tx=0).stop 2024-09-22T08:38:30.076 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.067+0000 7f0f01b46800 1 -- 172.21.15.142:0/22434528 shutdown_connections 2024-09-22T08:38:30.077 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.067+0000 7f0f01b46800 1 --2- 172.21.15.142:0/22434528 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56129b2fd5e0 0x56129b2fd9e0 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:30.077 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.067+0000 7f0f01b46800 1 -- 172.21.15.142:0/22434528 >> 172.21.15.142:0/22434528 conn(0x56129b2f99e0 msgr2=0x56129b2f7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:38:30.077 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.067+0000 7f0f01b46800 1 -- 172.21.15.142:0/22434528 shutdown_connections 2024-09-22T08:38:30.077 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.067+0000 7f0f01b46800 1 -- 172.21.15.142:0/22434528 wait complete. 2024-09-22T08:38:30.077 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.067+0000 7f0f01b46800 1 Processor -- start 2024-09-22T08:38:30.077 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.067+0000 7f0f01b46800 1 -- start start 2024-09-22T08:38:30.077 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.067+0000 7f0f01b46800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56129b2fd5e0 0x56129b304b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:30.077 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.067+0000 7f0f01b46800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x56129b2fe5f0 con 0x56129b2fd5e0 2024-09-22T08:38:30.077 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.067+0000 7f0effe31640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56129b2fd5e0 0x56129b304b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:30.077 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.067+0000 7f0effe31640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56129b2fd5e0 0x56129b304b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:51858/0 (socket says 172.21.15.142:51858) 2024-09-22T08:38:30.077 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.067+0000 7f0effe31640 1 -- 172.21.15.142:0/2580588741 learned_addr learned my addr 172.21.15.142:0/2580588741 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:38:30.077 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.068+0000 7f0effe31640 1 -- 172.21.15.142:0/2580588741 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56129b305080 con 0x56129b2fd5e0 2024-09-22T08:38:30.077 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.068+0000 7f0effe31640 1 --2- 172.21.15.142:0/2580588741 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56129b2fd5e0 0x56129b304b20 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f0ef801fd40 tx=0x7f0ef8054770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:30.078 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.068+0000 7f0de17fa640 1 -- 172.21.15.142:0/2580588741 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ef8013c80 con 0x56129b2fd5e0 2024-09-22T08:38:30.078 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.068+0000 7f0de17fa640 1 -- 172.21.15.142:0/2580588741 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ef8013e20 con 0x56129b2fd5e0 2024-09-22T08:38:30.078 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.068+0000 7f0f01b46800 1 -- 172.21.15.142:0/2580588741 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56129b305310 con 0x56129b2fd5e0 2024-09-22T08:38:30.078 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.068+0000 7f0de17fa640 1 -- 172.21.15.142:0/2580588741 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ef8045ae0 con 0x56129b2fd5e0 2024-09-22T08:38:30.078 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.068+0000 7f0f01b46800 1 -- 172.21.15.142:0/2580588741 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56129b305ea0 con 0x56129b2fd5e0 2024-09-22T08:38:30.078 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.069+0000 7f0de17fa640 1 -- 172.21.15.142:0/2580588741 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f0ef8045c80 con 0x56129b2fd5e0 2024-09-22T08:38:30.078 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.069+0000 7f0de17fa640 1 --2- 172.21.15.142:0/2580588741 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f0dc803cfb0 0x7f0dc803f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:30.078 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.069+0000 7f0de17fa640 1 -- 172.21.15.142:0/2580588741 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5938+0+0 (secure 0 0 0) 0x7f0ef803d060 con 0x56129b2fd5e0 2024-09-22T08:38:30.078 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.069+0000 7f0eff630640 1 --2- 172.21.15.142:0/2580588741 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f0dc803cfb0 0x7f0dc803f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:30.078 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.069+0000 7f0eff630640 1 --2- 172.21.15.142:0/2580588741 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f0dc803cfb0 0x7f0dc803f470 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x56129b2d3880 tx=0x7f0ef007f000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:30.078 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.069+0000 7f0f01b46800 20 rados->read ofs=0 len=0 2024-09-22T08:38:30.078 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.069+0000 7f0f01b46800 1 --2- 172.21.15.142:0/2580588741 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x56129b310480 0x56129b312940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:30.079 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.069+0000 7f0f01b46800 1 -- 172.21.15.142:0/2580588741 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56129b313090 con 0x56129b310480 2024-09-22T08:38:30.079 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.070+0000 7f0ef6e2f640 1 --2- 172.21.15.142:0/2580588741 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x56129b310480 0x56129b312940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:30.079 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.070+0000 7f0ef6e2f640 1 --2- 172.21.15.142:0/2580588741 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x56129b310480 0x56129b312940 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:30.079 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.070+0000 7f0ef6e2f640 1 -- 172.21.15.142:0/2580588741 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0ee8009050 con 0x56129b310480 2024-09-22T08:38:30.079 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.070+0000 7f0f01b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:30.079 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.070+0000 7f0f01b46800 20 realm 2024-09-22T08:38:30.079 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.070+0000 7f0f01b46800 20 rados->read ofs=0 len=0 2024-09-22T08:38:30.079 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.070+0000 7f0f01b46800 1 -- 172.21.15.142:0/2580588741 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56129b30f7d0 con 0x56129b310480 2024-09-22T08:38:30.079 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.070+0000 7f0ef6e2f640 1 -- 172.21.15.142:0/2580588741 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0ee8009050 con 0x56129b310480 2024-09-22T08:38:30.079 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.070+0000 7f0f01b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:30.079 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.070+0000 7f0f01b46800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:38:30.079 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.070+0000 7f0f01b46800 20 rados->read ofs=0 len=0 2024-09-22T08:38:30.079 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.070+0000 7f0f01b46800 1 -- 172.21.15.142:0/2580588741 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56129b313b80 con 0x56129b310480 2024-09-22T08:38:30.079 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.070+0000 7f0ef6e2f640 1 -- 172.21.15.142:0/2580588741 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0ee8009050 con 0x56129b310480 2024-09-22T08:38:30.080 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.071+0000 7f0f01b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:30.080 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.071+0000 7f0f01b46800 20 rados->read ofs=0 len=0 2024-09-22T08:38:30.080 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.071+0000 7f0f01b46800 1 -- 172.21.15.142:0/2580588741 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56129b314450 con 0x56129b310480 2024-09-22T08:38:30.080 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.071+0000 7f0ef6e2f640 1 -- 172.21.15.142:0/2580588741 <== osd.1 v2:172.21.15.142:6816/3192108003 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0ee8009050 con 0x56129b310480 2024-09-22T08:38:30.080 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.071+0000 7f0f01b46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:38:30.080 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.071+0000 7f0f01b46800 20 rados->read ofs=0 len=0 2024-09-22T08:38:30.080 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.071+0000 7f0f01b46800 1 --2- 172.21.15.142:0/2580588741 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x56129b314e70 0x56129b317260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:30.080 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.071+0000 7f0f01b46800 1 -- 172.21.15.142:0/2580588741 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56129b3179a0 con 0x56129b314e70 2024-09-22T08:38:30.080 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.071+0000 7f0effe31640 1 --2- 172.21.15.142:0/2580588741 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x56129b314e70 0x56129b317260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:30.080 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.071+0000 7f0effe31640 1 --2- 172.21.15.142:0/2580588741 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x56129b314e70 0x56129b317260 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:30.080 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.071+0000 7f0effe31640 1 -- 172.21.15.142:0/2580588741 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(5 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f0ef8053020 con 0x56129b314e70 2024-09-22T08:38:30.080 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.071+0000 7f0f01b46800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:38:30.080 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.071+0000 7f0f01b46800 20 searching for the correct realm 2024-09-22T08:38:30.081 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.071+0000 7f0f01b46800 1 -- 172.21.15.142:0/2580588741 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56129b3192f0 con 0x56129b314e70 2024-09-22T08:38:30.081 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.072+0000 7f0effe31640 1 -- 172.21.15.142:0/2580588741 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ef8053020 con 0x56129b314e70 2024-09-22T08:38:30.081 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.072+0000 7f0effe31640 1 --2- 172.21.15.142:0/2580588741 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f0ef8012ae0 0x7f0ef80123d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:30.081 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.072+0000 7f0effe31640 1 -- 172.21.15.142:0/2580588741 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56129b3192f0 con 0x7f0ef8012ae0 2024-09-22T08:38:30.081 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.072+0000 7f0eff630640 1 --2- 172.21.15.142:0/2580588741 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f0ef8012ae0 0x7f0ef80123d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:30.081 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.072+0000 7f0eff630640 1 --2- 172.21.15.142:0/2580588741 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f0ef8012ae0 0x7f0ef80123d0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:30.081 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.072+0000 7f0eff630640 1 -- 172.21.15.142:0/2580588741 <== osd.2 v2:172.21.15.142:6808/279438927 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ef0073030 con 0x7f0ef8012ae0 2024-09-22T08:38:30.081 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.072+0000 7f0eff630640 1 --2- 172.21.15.142:0/2580588741 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f0ef0076060 0x7f0ef008e210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:30.081 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.072+0000 7f0eff630640 1 -- 172.21.15.142:0/2580588741 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56129b3192f0 con 0x7f0ef0076060 2024-09-22T08:38:30.081 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.073+0000 7f0ef6e2f640 1 --2- 172.21.15.142:0/2580588741 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f0ef0076060 0x7f0ef008e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:30.081 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.073+0000 7f0ef6e2f640 1 --2- 172.21.15.142:0/2580588741 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f0ef0076060 0x7f0ef008e210 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:30.081 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.073+0000 7f0ef6e2f640 1 -- 172.21.15.142:0/2580588741 <== osd.0 v2:172.21.15.31:6800/168281188 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ee8009050 con 0x7f0ef0076060 2024-09-22T08:38:30.081 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.073+0000 7f0ef6e2f640 1 -- 172.21.15.142:0/2580588741 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56129b3192f0 con 0x56129b310480 2024-09-22T08:38:30.082 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.074+0000 7f0ef6e2f640 1 -- 172.21.15.142:0/2580588741 <== osd.1 v2:172.21.15.142:6816/3192108003 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ee8009050 con 0x56129b310480 2024-09-22T08:38:30.082 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.074+0000 7f0ef6e2f640 1 -- 172.21.15.142:0/2580588741 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56129b3192f0 con 0x56129b310480 2024-09-22T08:38:30.082 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.074+0000 7f0ef6e2f640 1 -- 172.21.15.142:0/2580588741 <== osd.1 v2:172.21.15.142:6816/3192108003 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ee8029040 con 0x56129b310480 2024-09-22T08:38:30.082 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.074+0000 7f0ef6e2f640 1 -- 172.21.15.142:0/2580588741 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56129b3192f0 con 0x56129b310480 2024-09-22T08:38:30.082 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.074+0000 7f0ef6e2f640 1 -- 172.21.15.142:0/2580588741 <== osd.1 v2:172.21.15.142:6816/3192108003 7 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ee8029040 con 0x56129b310480 2024-09-22T08:38:30.082 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.074+0000 7f0ef6e2f640 1 -- 172.21.15.142:0/2580588741 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56129b3192f0 con 0x7f0ef0076060 2024-09-22T08:38:30.082 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.074+0000 7f0ef6e2f640 1 -- 172.21.15.142:0/2580588741 <== osd.0 v2:172.21.15.31:6800/168281188 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ee8029040 con 0x7f0ef0076060 2024-09-22T08:38:30.082 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.074+0000 7f0ef6e2f640 1 -- 172.21.15.142:0/2580588741 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56129b3192f0 con 0x7f0ef8012ae0 2024-09-22T08:38:30.082 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.075+0000 7f0eff630640 1 -- 172.21.15.142:0/2580588741 <== osd.2 v2:172.21.15.142:6808/279438927 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ef0073030 con 0x7f0ef8012ae0 2024-09-22T08:38:30.082 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.075+0000 7f0eff630640 1 -- 172.21.15.142:0/2580588741 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56129b3192f0 con 0x56129b314e70 2024-09-22T08:38:30.082 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.075+0000 7f0effe31640 1 -- 172.21.15.142:0/2580588741 <== osd.3 v2:172.21.15.142:6800/1064901393 3 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ef8053020 con 0x56129b314e70 2024-09-22T08:38:30.082 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.075+0000 7f0effe31640 1 -- 172.21.15.142:0/2580588741 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56129b3192f0 con 0x56129b310480 2024-09-22T08:38:30.083 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.075+0000 7f0ef6e2f640 1 -- 172.21.15.142:0/2580588741 <== osd.1 v2:172.21.15.142:6816/3192108003 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ee8029040 con 0x56129b310480 2024-09-22T08:38:30.083 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.075+0000 7f0ef6e2f640 1 -- 172.21.15.142:0/2580588741 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56129b3192f0 con 0x7f0ef0076060 2024-09-22T08:38:30.090 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.075+0000 7f0ef6e2f640 1 -- 172.21.15.142:0/2580588741 <== osd.0 v2:172.21.15.31:6800/168281188 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ee8029040 con 0x7f0ef0076060 2024-09-22T08:38:30.090 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.075+0000 7f0ef6e2f640 1 -- 172.21.15.142:0/2580588741 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56129b3192f0 con 0x56129b310480 2024-09-22T08:38:30.090 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.076+0000 7f0ef6e2f640 1 -- 172.21.15.142:0/2580588741 <== osd.1 v2:172.21.15.142:6816/3192108003 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ee8029040 con 0x56129b310480 2024-09-22T08:38:30.091 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.076+0000 7f0ef6e2f640 1 -- 172.21.15.142:0/2580588741 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56129b3192f0 con 0x7f0ef8012ae0 2024-09-22T08:38:30.091 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.076+0000 7f0eff630640 1 -- 172.21.15.142:0/2580588741 <== osd.2 v2:172.21.15.142:6808/279438927 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f0ef0073030 con 0x7f0ef8012ae0 2024-09-22T08:38:30.091 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.076+0000 7f0eff630640 1 -- 172.21.15.142:0/2580588741 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56129b3192f0 con 0x56129b314e70 2024-09-22T08:38:30.091 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.076+0000 7f0effe31640 1 -- 172.21.15.142:0/2580588741 <== osd.3 v2:172.21.15.142:6800/1064901393 4 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ef8053020 con 0x56129b314e70 2024-09-22T08:38:30.091 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.076+0000 7f0effe31640 1 -- 172.21.15.142:0/2580588741 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56129b3192f0 con 0x56129b314e70 2024-09-22T08:38:30.091 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.076+0000 7f0effe31640 1 -- 172.21.15.142:0/2580588741 <== osd.3 v2:172.21.15.142:6800/1064901393 5 ==== osd_op_reply(20 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f0ef8053020 con 0x56129b314e70 2024-09-22T08:38:30.091 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.076+0000 7f0effe31640 1 -- 172.21.15.142:0/2580588741 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56129b3192f0 con 0x7f0ef0076060 2024-09-22T08:38:30.091 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.077+0000 7f0ef6e2f640 1 -- 172.21.15.142:0/2580588741 <== osd.0 v2:172.21.15.31:6800/168281188 4 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ee8029040 con 0x7f0ef0076060 2024-09-22T08:38:30.091 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.077+0000 7f0ef6e2f640 1 -- 172.21.15.142:0/2580588741 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56129b3192f0 con 0x56129b314e70 2024-09-22T08:38:30.091 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.077+0000 7f0effe31640 1 -- 172.21.15.142:0/2580588741 <== osd.3 v2:172.21.15.142:6800/1064901393 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ef8053020 con 0x56129b314e70 2024-09-22T08:38:30.091 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.077+0000 7f0effe31640 1 -- 172.21.15.142:0/2580588741 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56129b3192f0 con 0x56129b314e70 2024-09-22T08:38:30.091 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.077+0000 7f0effe31640 1 -- 172.21.15.142:0/2580588741 <== osd.3 v2:172.21.15.142:6800/1064901393 7 ==== osd_op_reply(23 [pgnls start_epoch 32 out=107b] v32'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f0ef8053020 con 0x56129b314e70 2024-09-22T08:38:30.092 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.077+0000 7f0effe31640 1 -- 172.21.15.142:0/2580588741 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56129b3192f0 con 0x56129b310480 2024-09-22T08:38:30.092 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.077+0000 7f0ef6e2f640 1 -- 172.21.15.142:0/2580588741 <== osd.1 v2:172.21.15.142:6816/3192108003 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ee8029040 con 0x56129b310480 2024-09-22T08:38:30.092 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.077+0000 7f0ef6e2f640 1 -- 172.21.15.142:0/2580588741 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56129b3192f0 con 0x56129b310480 2024-09-22T08:38:30.092 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.077+0000 7f0ef6e2f640 1 -- 172.21.15.142:0/2580588741 <== osd.1 v2:172.21.15.142:6816/3192108003 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v32'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f0ee8029040 con 0x56129b310480 2024-09-22T08:38:30.092 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.077+0000 7f0ef6e2f640 1 -- 172.21.15.142:0/2580588741 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56129b3192f0 con 0x7f0ef0076060 2024-09-22T08:38:30.092 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.078+0000 7f0ef6e2f640 1 -- 172.21.15.142:0/2580588741 <== osd.0 v2:172.21.15.31:6800/168281188 5 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ee8029040 con 0x7f0ef0076060 2024-09-22T08:38:30.092 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.078+0000 7f0ef6e2f640 1 -- 172.21.15.142:0/2580588741 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56129b3192f0 con 0x56129b314e70 2024-09-22T08:38:30.092 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.078+0000 7f0effe31640 1 -- 172.21.15.142:0/2580588741 <== osd.3 v2:172.21.15.142:6800/1064901393 8 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ef8053020 con 0x56129b314e70 2024-09-22T08:38:30.092 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.078+0000 7f0effe31640 1 -- 172.21.15.142:0/2580588741 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56129b3192f0 con 0x7f0ef8012ae0 2024-09-22T08:38:30.092 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.078+0000 7f0eff630640 1 -- 172.21.15.142:0/2580588741 <== osd.2 v2:172.21.15.142:6808/279438927 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ef0073030 con 0x7f0ef8012ae0 2024-09-22T08:38:30.092 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.078+0000 7f0eff630640 1 -- 172.21.15.142:0/2580588741 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56129b3192f0 con 0x56129b310480 2024-09-22T08:38:30.092 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.078+0000 7f0ef6e2f640 1 -- 172.21.15.142:0/2580588741 <== osd.1 v2:172.21.15.142:6816/3192108003 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ee8029040 con 0x56129b310480 2024-09-22T08:38:30.092 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.078+0000 7f0ef6e2f640 1 -- 172.21.15.142:0/2580588741 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56129b3192f0 con 0x7f0ef0076060 2024-09-22T08:38:30.092 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.079+0000 7f0ef6e2f640 1 -- 172.21.15.142:0/2580588741 <== osd.0 v2:172.21.15.31:6800/168281188 6 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ee8029040 con 0x7f0ef0076060 2024-09-22T08:38:30.093 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.079+0000 7f0ef6e2f640 1 -- 172.21.15.142:0/2580588741 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56129b3192f0 con 0x56129b314e70 2024-09-22T08:38:30.093 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.079+0000 7f0effe31640 1 -- 172.21.15.142:0/2580588741 <== osd.3 v2:172.21.15.142:6800/1064901393 9 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ef8053020 con 0x56129b314e70 2024-09-22T08:38:30.093 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.079+0000 7f0effe31640 1 -- 172.21.15.142:0/2580588741 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56129b3192f0 con 0x7f0ef0076060 2024-09-22T08:38:30.093 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.079+0000 7f0ef6e2f640 1 -- 172.21.15.142:0/2580588741 <== osd.0 v2:172.21.15.31:6800/168281188 7 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ee8029040 con 0x7f0ef0076060 2024-09-22T08:38:30.093 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.079+0000 7f0ef6e2f640 1 -- 172.21.15.142:0/2580588741 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56129b3192f0 con 0x7f0ef8012ae0 2024-09-22T08:38:30.093 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.079+0000 7f0eff630640 1 -- 172.21.15.142:0/2580588741 <== osd.2 v2:172.21.15.142:6808/279438927 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ef0073030 con 0x7f0ef8012ae0 2024-09-22T08:38:30.093 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.079+0000 7f0eff630640 1 -- 172.21.15.142:0/2580588741 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56129b3192f0 con 0x56129b314e70 2024-09-22T08:38:30.093 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.080+0000 7f0effe31640 1 -- 172.21.15.142:0/2580588741 <== osd.3 v2:172.21.15.142:6800/1064901393 10 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ef8053020 con 0x56129b314e70 2024-09-22T08:38:30.093 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.080+0000 7f0effe31640 1 -- 172.21.15.142:0/2580588741 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56129b3192f0 con 0x7f0ef0076060 2024-09-22T08:38:30.093 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.080+0000 7f0ef6e2f640 1 -- 172.21.15.142:0/2580588741 <== osd.0 v2:172.21.15.31:6800/168281188 8 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ee8029040 con 0x7f0ef0076060 2024-09-22T08:38:30.093 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.080+0000 7f0ef6e2f640 1 -- 172.21.15.142:0/2580588741 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56129b3192f0 con 0x56129b310480 2024-09-22T08:38:30.093 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.080+0000 7f0ef6e2f640 1 -- 172.21.15.142:0/2580588741 <== osd.1 v2:172.21.15.142:6816/3192108003 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v32'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f0ee8029040 con 0x56129b310480 2024-09-22T08:38:30.093 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.081+0000 7f0ef6e2f640 1 -- 172.21.15.142:0/2580588741 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56129b3192f0 con 0x7f0ef8012ae0 2024-09-22T08:38:30.094 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.081+0000 7f0eff630640 1 -- 172.21.15.142:0/2580588741 <== osd.2 v2:172.21.15.142:6808/279438927 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ef0073030 con 0x7f0ef8012ae0 2024-09-22T08:38:30.094 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.081+0000 7f0f01b46800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:38:30.094 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.081+0000 7f0f01b46800 20 RGWRados::pool_iterate: got zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec 2024-09-22T08:38:30.094 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.081+0000 7f0f01b46800 20 RGWRados::pool_iterate: got zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f 2024-09-22T08:38:30.094 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.081+0000 7f0f01b46800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:38:30.094 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.081+0000 7f0f01b46800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:38:30.094 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.081+0000 7f0f01b46800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:38:30.094 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.081+0000 7f0f01b46800 20 rados->read ofs=0 len=0 2024-09-22T08:38:30.094 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.081+0000 7f0f01b46800 1 -- 172.21.15.142:0/2580588741 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56129b318360 con 0x56129b310480 2024-09-22T08:38:30.094 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.081+0000 7f0ef6e2f640 1 -- 172.21.15.142:0/2580588741 <== osd.1 v2:172.21.15.142:6816/3192108003 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0ee8029040 con 0x56129b310480 2024-09-22T08:38:30.094 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.081+0000 7f0f01b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:30.094 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.081+0000 7f0f01b46800 20 rados->read ofs=0 len=0 2024-09-22T08:38:30.094 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.081+0000 7f0f01b46800 1 -- 172.21.15.142:0/2580588741 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56129b318c00 con 0x56129b310480 2024-09-22T08:38:30.095 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.081+0000 7f0ef6e2f640 1 -- 172.21.15.142:0/2580588741 <== osd.1 v2:172.21.15.142:6816/3192108003 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0ee8029040 con 0x56129b310480 2024-09-22T08:38:30.095 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.081+0000 7f0f01b46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:38:30.095 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.081+0000 7f0f01b46800 20 rados->read ofs=0 len=0 2024-09-22T08:38:30.095 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.081+0000 7f0f01b46800 1 -- 172.21.15.142:0/2580588741 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:40 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56129b319770 con 0x56129b314e70 2024-09-22T08:38:30.095 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.082+0000 7f0effe31640 1 -- 172.21.15.142:0/2580588741 <== osd.3 v2:172.21.15.142:6800/1064901393 11 ==== osd_op_reply(40 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f0ef8053020 con 0x56129b314e70 2024-09-22T08:38:30.095 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.082+0000 7f0f01b46800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:38:30.095 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.082+0000 7f0f01b46800 20 zone default found 2024-09-22T08:38:30.095 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.082+0000 7f0f01b46800 4 Realm: () 2024-09-22T08:38:30.095 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.082+0000 7f0f01b46800 4 ZoneGroup: default (d89f6f57-1007-47dd-9065-f486c7b01aec) 2024-09-22T08:38:30.095 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.082+0000 7f0f01b46800 4 Zone: default (e239248c-0bee-4e41-803a-24b288d3eb8f) 2024-09-22T08:38:30.095 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.082+0000 7f0f01b46800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:38:30.095 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.082+0000 7f0f01b46800 20 zonegroup default 2024-09-22T08:38:30.095 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.082+0000 7f0f01b46800 20 rados->read ofs=0 len=0 2024-09-22T08:38:30.095 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.082+0000 7f0f01b46800 1 -- 172.21.15.142:0/2580588741 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56129b319b10 con 0x7f0ef0076060 2024-09-22T08:38:30.096 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.082+0000 7f0ef6e2f640 1 -- 172.21.15.142:0/2580588741 <== osd.0 v2:172.21.15.31:6800/168281188 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f0ee8029040 con 0x7f0ef0076060 2024-09-22T08:38:30.096 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.082+0000 7f0f01b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:30.096 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.082+0000 7f0f01b46800 20 rados->read ofs=0 len=0 2024-09-22T08:38:30.096 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.082+0000 7f0f01b46800 1 -- 172.21.15.142:0/2580588741 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56129b31bdd0 con 0x56129b314e70 2024-09-22T08:38:30.096 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.082+0000 7f0effe31640 1 -- 172.21.15.142:0/2580588741 <== osd.3 v2:172.21.15.142:6800/1064901393 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0ef8053020 con 0x56129b314e70 2024-09-22T08:38:30.096 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.082+0000 7f0f01b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:30.096 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.082+0000 7f0f01b46800 20 rados->read ofs=0 len=0 2024-09-22T08:38:30.096 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.082+0000 7f0f01b46800 1 -- 172.21.15.142:0/2580588741 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56129b31c170 con 0x56129b314e70 2024-09-22T08:38:30.096 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.082+0000 7f0effe31640 1 -- 172.21.15.142:0/2580588741 <== osd.3 v2:172.21.15.142:6800/1064901393 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0ef8053020 con 0x56129b314e70 2024-09-22T08:38:30.096 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.082+0000 7f0f01b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:30.096 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.083+0000 7f0f01b46800 20 started sync module instance, tier type = 2024-09-22T08:38:30.096 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.083+0000 7f0f01b46800 20 started zone id=e239248c-0bee-4e41-803a-24b288d3eb8f (name=default) with tier type = 2024-09-22T08:38:30.096 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.083+0000 7f0f01b46800 1 -- 172.21.15.142:0/2580588741 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56129b31b260 con 0x7f0ef8012ae0 2024-09-22T08:38:30.097 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.084+0000 7f0eff630640 1 -- 172.21.15.142:0/2580588741 <== osd.2 v2:172.21.15.142:6808/279438927 7 ==== osd_op_reply(44 notify.0 [create] v32'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ef0073030 con 0x7f0ef8012ae0 2024-09-22T08:38:30.097 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.084+0000 7f0f01b46800 1 -- 172.21.15.142:0/2580588741 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94637913126480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56129b31cab0 con 0x7f0ef8012ae0 2024-09-22T08:38:30.097 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.084+0000 7f0f01b46800 1 -- 172.21.15.142:0/2580588741 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56129b31d300 con 0x56129b310480 2024-09-22T08:38:30.097 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.085+0000 7f0eff630640 1 -- 172.21.15.142:0/2580588741 <== osd.2 v2:172.21.15.142:6808/279438927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94637913126480] v32'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ef0073030 con 0x7f0ef8012ae0 2024-09-22T08:38:30.097 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.085+0000 7f0ef6e2f640 1 -- 172.21.15.142:0/2580588741 <== osd.1 v2:172.21.15.142:6816/3192108003 16 ==== osd_op_reply(46 notify.1 [create] v32'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ee8029040 con 0x56129b310480 2024-09-22T08:38:30.097 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.085+0000 7f0f01b46800 1 -- 172.21.15.142:0/2580588741 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94637913130496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56129b31d300 con 0x56129b310480 2024-09-22T08:38:30.097 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.085+0000 7f0f01b46800 1 -- 172.21.15.142:0/2580588741 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56129b31ddb0 con 0x56129b314e70 2024-09-22T08:38:30.097 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.086+0000 7f0ef6e2f640 1 -- 172.21.15.142:0/2580588741 <== osd.1 v2:172.21.15.142:6816/3192108003 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94637913130496] v32'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ee8029040 con 0x56129b310480 2024-09-22T08:38:30.097 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.086+0000 7f0effe31640 1 -- 172.21.15.142:0/2580588741 <== osd.3 v2:172.21.15.142:6800/1064901393 14 ==== osd_op_reply(48 notify.2 [create] v32'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ef8053020 con 0x56129b314e70 2024-09-22T08:38:30.097 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.086+0000 7f0f01b46800 1 -- 172.21.15.142:0/2580588741 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94637913135248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56129b31d300 con 0x56129b314e70 2024-09-22T08:38:30.097 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.086+0000 7f0f01b46800 1 -- 172.21.15.142:0/2580588741 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56129b31e800 con 0x7f0ef8012ae0 2024-09-22T08:38:30.097 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.087+0000 7f0effe31640 1 -- 172.21.15.142:0/2580588741 <== osd.3 v2:172.21.15.142:6800/1064901393 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94637913135248] v32'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ef8053020 con 0x56129b314e70 2024-09-22T08:38:30.097 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.087+0000 7f0eff630640 1 -- 172.21.15.142:0/2580588741 <== osd.2 v2:172.21.15.142:6808/279438927 9 ==== osd_op_reply(50 notify.3 [create] v32'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ef0073030 con 0x7f0ef8012ae0 2024-09-22T08:38:30.097 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.087+0000 7f0f01b46800 1 -- 172.21.15.142:0/2580588741 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94637913132624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56129b31d270 con 0x7f0ef8012ae0 2024-09-22T08:38:30.098 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.087+0000 7f0f01b46800 1 -- 172.21.15.142:0/2580588741 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56129b31f6c0 con 0x56129b310480 2024-09-22T08:38:30.098 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.088+0000 7f0eff630640 1 -- 172.21.15.142:0/2580588741 <== osd.2 v2:172.21.15.142:6808/279438927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94637913132624] v32'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ef0073030 con 0x7f0ef8012ae0 2024-09-22T08:38:30.098 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.089+0000 7f0ef6e2f640 1 -- 172.21.15.142:0/2580588741 <== osd.1 v2:172.21.15.142:6816/3192108003 18 ==== osd_op_reply(52 notify.4 [create] v32'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ee8029040 con 0x56129b310480 2024-09-22T08:38:30.098 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.089+0000 7f0f01b46800 1 -- 172.21.15.142:0/2580588741 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94637913140208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56129b31f6c0 con 0x56129b310480 2024-09-22T08:38:30.098 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.089+0000 7f0f01b46800 1 -- 172.21.15.142:0/2580588741 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56129b320110 con 0x7f0ef0076060 2024-09-22T08:38:30.103 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.090+0000 7f0ef6e2f640 1 -- 172.21.15.142:0/2580588741 <== osd.0 v2:172.21.15.31:6800/168281188 10 ==== osd_op_reply(54 notify.5 [create] v32'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ee8029040 con 0x7f0ef0076060 2024-09-22T08:38:30.103 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.090+0000 7f0f01b46800 1 -- 172.21.15.142:0/2580588741 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94637913144352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56129b320080 con 0x7f0ef0076060 2024-09-22T08:38:30.103 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.090+0000 7f0ef6e2f640 1 -- 172.21.15.142:0/2580588741 <== osd.1 v2:172.21.15.142:6816/3192108003 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94637913140208] v32'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ee8029040 con 0x56129b310480 2024-09-22T08:38:30.103 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.090+0000 7f0f01b46800 1 -- 172.21.15.142:0/2580588741 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56129b31f270 con 0x7f0ef0076060 2024-09-22T08:38:30.103 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.091+0000 7f0ef6e2f640 1 -- 172.21.15.142:0/2580588741 <== osd.0 v2:172.21.15.31:6800/168281188 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94637913144352] v32'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ee8029040 con 0x7f0ef0076060 2024-09-22T08:38:30.104 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.091+0000 7f0ef6e2f640 1 -- 172.21.15.142:0/2580588741 <== osd.0 v2:172.21.15.31:6800/168281188 12 ==== osd_op_reply(56 notify.6 [create] v32'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ee8029040 con 0x7f0ef0076060 2024-09-22T08:38:30.104 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.091+0000 7f0f01b46800 1 -- 172.21.15.142:0/2580588741 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94637913141872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56129b320b50 con 0x7f0ef0076060 2024-09-22T08:38:30.104 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.091+0000 7f0f01b46800 1 -- 172.21.15.142:0/2580588741 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56129b321510 con 0x7f0ef0076060 2024-09-22T08:38:30.104 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.092+0000 7f0ef6e2f640 1 -- 172.21.15.142:0/2580588741 <== osd.0 v2:172.21.15.31:6800/168281188 13 ==== osd_op_reply(58 notify.7 [create] v32'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ee8029040 con 0x7f0ef0076060 2024-09-22T08:38:30.104 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.092+0000 7f0f01b46800 1 -- 172.21.15.142:0/2580588741 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94637913149536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56129b321930 con 0x7f0ef0076060 2024-09-22T08:38:30.104 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.092+0000 7f0f01b46800 20 add_watcher() i=0 2024-09-22T08:38:30.104 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.092+0000 7f0f01b46800 20 add_watcher() i=1 2024-09-22T08:38:30.104 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.092+0000 7f0f01b46800 20 add_watcher() i=2 2024-09-22T08:38:30.104 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.092+0000 7f0f01b46800 20 add_watcher() i=3 2024-09-22T08:38:30.104 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.092+0000 7f0f01b46800 20 add_watcher() i=4 2024-09-22T08:38:30.104 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.092+0000 7f0f01b46800 20 add_watcher() i=5 2024-09-22T08:38:30.104 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.092+0000 7f0ef6e2f640 1 -- 172.21.15.142:0/2580588741 <== osd.0 v2:172.21.15.31:6800/168281188 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94637913141872] v32'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ee8029040 con 0x7f0ef0076060 2024-09-22T08:38:30.104 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.092+0000 7f0f01b46800 20 add_watcher() i=6 2024-09-22T08:38:30.105 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.093+0000 7f0ef6e2f640 1 -- 172.21.15.142:0/2580588741 <== osd.0 v2:172.21.15.31:6800/168281188 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94637913149536] v32'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ee8029040 con 0x7f0ef0076060 2024-09-22T08:38:30.105 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.093+0000 7f0f01b46800 20 add_watcher() i=7 2024-09-22T08:38:30.105 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.093+0000 7f0f01b46800 2 all 8 watchers are set, enabling cache 2024-09-22T08:38:30.105 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.093+0000 7f0f01b46800 1 -- 172.21.15.142:0/2580588741 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56129b321930 con 0x56129b310480 2024-09-22T08:38:30.105 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.093+0000 7f0ef6e2f640 1 -- 172.21.15.142:0/2580588741 <== osd.1 v2:172.21.15.142:6816/3192108003 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f0ee8029040 con 0x56129b310480 2024-09-22T08:38:30.105 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.093+0000 7f0f01b46800 1 -- 172.21.15.142:0/2580588741 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94637913150592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56129b3218e0 con 0x56129b310480 2024-09-22T08:38:30.105 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.094+0000 7f0ef6e2f640 1 -- 172.21.15.142:0/2580588741 <== osd.1 v2:172.21.15.142:6816/3192108003 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94637913150592] v32'251 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0ee8029040 con 0x56129b310480 2024-09-22T08:38:30.105 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.095+0000 7f0db5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:38:30.105 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.095+0000 7f0f01b46800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:38:30.105 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.095+0000 7f0f01b46800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:38:30.105 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.095+0000 7f0f01b46800 5 note: GC not initialized 2024-09-22T08:38:30.105 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.095+0000 7f0db4fe1640 20 reqs_thread_entry: start 2024-09-22T08:38:30.105 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.095+0000 7f0f01b46800 20 init_complete bucket index max shards: 11 2024-09-22T08:38:30.106 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.095+0000 7f0f01b46800 20 Filter name: none 2024-09-22T08:38:30.106 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.095+0000 7f0d2e7fc640 20 reqs_thread_entry: start 2024-09-22T08:38:30.106 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.095+0000 7f0f01b46800 10 cache get: name=default.rgw.meta+users.uid+a_user : miss 2024-09-22T08:38:30.106 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.095+0000 7f0f01b46800 20 rados->read ofs=0 len=0 2024-09-22T08:38:30.106 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.095+0000 7f0f01b46800 1 -- 172.21.15.142:0/2580588741 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:62 8.14 8:2efb937b:users.uid::a_user:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56129b357e00 con 0x56129b314e70 2024-09-22T08:38:30.106 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.095+0000 7f0effe31640 1 -- 172.21.15.142:0/2580588741 <== osd.3 v2:172.21.15.142:6800/1064901393 16 ==== osd_op_reply(62 a_user [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 234+0+0 (crc 0 0 0) 0x7f0ef8053020 con 0x56129b314e70 2024-09-22T08:38:30.106 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.096+0000 7f0f01b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:30.106 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.096+0000 7f0f01b46800 10 cache put: name=default.rgw.meta+users.uid+a_user info.flags=0x0 2024-09-22T08:38:30.106 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.096+0000 7f0f01b46800 10 adding default.rgw.meta+users.uid+a_user to cache LRU end 2024-09-22T08:38:30.106 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.096+0000 7f0f01b46800 10 cache get: name=default.rgw.meta+users.keys+true_admin_akey : miss 2024-09-22T08:38:30.106 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.096+0000 7f0f01b46800 20 rados->read ofs=0 len=0 2024-09-22T08:38:30.106 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.096+0000 7f0f01b46800 1 -- 172.21.15.142:0/2580588741 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:63 8.15 8:afe09604:users.keys::true_admin_akey:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56129b356340 con 0x56129b314e70 2024-09-22T08:38:30.106 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.096+0000 7f0effe31640 1 -- 172.21.15.142:0/2580588741 <== osd.3 v2:172.21.15.142:6800/1064901393 17 ==== osd_op_reply(63 true_admin_akey [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 201+0+0 (crc 0 0 0) 0x7f0ef8053020 con 0x56129b314e70 2024-09-22T08:38:30.107 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.096+0000 7f0f01b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:30.107 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.096+0000 7f0f01b46800 10 cache put: name=default.rgw.meta+users.keys+true_admin_akey info.flags=0x0 2024-09-22T08:38:30.107 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.096+0000 7f0f01b46800 10 adding default.rgw.meta+users.keys+true_admin_akey to cache LRU end 2024-09-22T08:38:30.107 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.096+0000 7f0f01b46800 10 cache get: name=default.rgw.meta+users.keys+true_admin_akey : hit (negative entry) 2024-09-22T08:38:30.107 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.096+0000 7f0f01b46800 10 cache get: name=default.rgw.meta+users.keys+true_admin_akey : hit (negative entry) 2024-09-22T08:38:30.107 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.096+0000 7f0f01b46800 1 -- 172.21.15.142:0/2580588741 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:64 8.14 8:2efb937b:users.uid::a_user:head [delete,create,call version.set in=58b,writefull 0~363 in=363b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56129b356be0 con 0x56129b314e70 2024-09-22T08:38:30.107 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.097+0000 7f0effe31640 1 -- 172.21.15.142:0/2580588741 <== osd.3 v2:172.21.15.142:6800/1064901393 18 ==== osd_op_reply(64 a_user [delete,create,call,writefull 0~363] v32'3 uv3 ondisk = 0) ==== 276+0+0 (crc 0 0 0) 0x7f0ef8053020 con 0x56129b314e70 2024-09-22T08:38:30.107 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.097+0000 7f0f01b46800 10 cache put: name=default.rgw.meta+users.uid+a_user info.flags=0x17 2024-09-22T08:38:30.107 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.097+0000 7f0f01b46800 10 moving default.rgw.meta+users.uid+a_user to cache LRU end 2024-09-22T08:38:30.107 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.097+0000 7f0f01b46800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:a_user, ofs0, ns] 2024-09-22T08:38:30.107 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.097+0000 7f0f01b46800 1 -- 172.21.15.142:0/2580588741 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:65 7.15 7:a93a5511:::notify.2:head [notify cookie 94637913368368 in=554b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56129b35b3f0 con 0x56129b314e70 2024-09-22T08:38:30.107 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.097+0000 7f0effe31640 1 -- 172.21.15.142:0/2580588741 <== osd.3 v2:172.21.15.142:6800/1064901393 19 ==== watch-notify(notify (1) cookie 94637913135248 notify 137438953483 ret 0) ==== 584+0+0 (crc 0 0 0) 0x56129b357750 con 0x56129b314e70 2024-09-22T08:38:30.107 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.097+0000 7f0de2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953483 cookie 94637913135248 notifier 4856 bl.length()=542 2024-09-22T08:38:30.108 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.097+0000 7f0de2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+a_user info.flags=0x17 2024-09-22T08:38:30.108 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.097+0000 7f0de2ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+a_user to cache LRU end 2024-09-22T08:38:30.108 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.097+0000 7f0de2ffd640 1 -- 172.21.15.142:0/2580588741 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f0dc4003ea0 con 0x56129b314e70 2024-09-22T08:38:30.108 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.097+0000 7f0effe31640 1 -- 172.21.15.142:0/2580588741 <== osd.3 v2:172.21.15.142:6800/1064901393 20 ==== osd_op_reply(65 notify.2 [notify cookie 94637913368368 out=8b] v0'0 uv252 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f0ef8053020 con 0x56129b314e70 2024-09-22T08:38:30.108 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.098+0000 7f0effe31640 1 -- 172.21.15.142:0/2580588741 <== osd.3 v2:172.21.15.142:6800/1064901393 21 ==== osd_op_reply(66 notify.2 [notify-ack] v0'0 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ef8053020 con 0x56129b314e70 2024-09-22T08:38:30.108 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.098+0000 7f0effe31640 1 -- 172.21.15.142:0/2580588741 <== osd.3 v2:172.21.15.142:6800/1064901393 22 ==== watch-notify(notify_complete (2) cookie 94637913368368 notify 137438953483 ret 0) ==== 42+0+48 (crc 0 0 0) 0x56129b305080 con 0x56129b314e70 2024-09-22T08:38:30.108 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.098+0000 7f0f01b46800 1 -- 172.21.15.142:0/2580588741 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:67 8.15 8:afe09604:users.keys::true_admin_akey:head [delete,create,writefull 0~10 in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56129b356b90 con 0x56129b314e70 2024-09-22T08:38:30.108 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.099+0000 7f0effe31640 1 -- 172.21.15.142:0/2580588741 <== osd.3 v2:172.21.15.142:6800/1064901393 23 ==== osd_op_reply(67 true_admin_akey [delete,create,writefull 0~10] v32'15 uv15 ondisk = 0) ==== 243+0+0 (crc 0 0 0) 0x7f0ef8053020 con 0x56129b314e70 2024-09-22T08:38:30.108 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.099+0000 7f0f01b46800 10 cache put: name=default.rgw.meta+users.keys+true_admin_akey info.flags=0x7 2024-09-22T08:38:30.108 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.099+0000 7f0f01b46800 10 moving default.rgw.meta+users.keys+true_admin_akey to cache LRU end 2024-09-22T08:38:30.108 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.099+0000 7f0f01b46800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:true_admin_akey, ofs0, ns] 2024-09-22T08:38:30.108 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.099+0000 7f0f01b46800 1 -- 172.21.15.142:0/2580588741 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:68 7.3 7:c609908c:::notify.5:head [notify cookie 94637913368288 in=187b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56129b35b430 con 0x7f0ef0076060 2024-09-22T08:38:30.108 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.099+0000 7f0ef6e2f640 1 -- 172.21.15.142:0/2580588741 <== osd.0 v2:172.21.15.31:6800/168281188 16 ==== watch-notify(notify (1) cookie 94637913144352 notify 137438953510 ret 0) ==== 217+0+0 (crc 0 0 0) 0x7f0eec001e10 con 0x7f0ef0076060 2024-09-22T08:38:30.109 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.099+0000 7f0de27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953510 cookie 94637913144352 notifier 4856 bl.length()=175 2024-09-22T08:38:30.109 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.099+0000 7f0ef6e2f640 1 -- 172.21.15.142:0/2580588741 <== osd.0 v2:172.21.15.31:6800/168281188 17 ==== osd_op_reply(68 notify.5 [notify cookie 94637913368288 out=8b] v0'0 uv252 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f0ee8029040 con 0x7f0ef0076060 2024-09-22T08:38:30.109 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.099+0000 7f0de27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+true_admin_akey info.flags=0x7 2024-09-22T08:38:30.109 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.099+0000 7f0de27fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+true_admin_akey to cache LRU end 2024-09-22T08:38:30.109 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.099+0000 7f0de27fc640 1 -- 172.21.15.142:0/2580588741 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f0d34003400 con 0x7f0ef0076060 2024-09-22T08:38:30.109 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.099+0000 7f0ef6e2f640 1 -- 172.21.15.142:0/2580588741 <== osd.0 v2:172.21.15.31:6800/168281188 18 ==== osd_op_reply(69 notify.5 [notify-ack] v0'0 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ee8029040 con 0x7f0ef0076060 2024-09-22T08:38:30.109 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.099+0000 7f0ef6e2f640 1 -- 172.21.15.142:0/2580588741 <== osd.0 v2:172.21.15.31:6800/168281188 19 ==== watch-notify(notify_complete (2) cookie 94637913368288 notify 137438953510 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f0ee803d500 con 0x7f0ef0076060 2024-09-22T08:38:30.109 INFO:teuthology.orchestra.run.smithi142.stdout:{"user_id":"a_user","display_name":"True Admin User","email":"","suspended":0,"max_buckets":1000,"subusers":[],"keys":[{"user":"a_user","access_key":"true_admin_akey","secret_key":"true_admin_skey","active":true,"create_date":"2024-09-22T08:38:30.097142Z"}],"swift_keys":[],"caps":[{"type":"user-info-without-keys","perm":"read"}],"op_mask":"read, write, delete","admin":true,"default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-22T08:38:30.097130Z","tags":[],"group_ids":[]} 2024-09-22T08:38:30.114 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.100+0000 7f0db5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:38:30.114 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.100+0000 7f0f01b46800 1 -- 172.21.15.142:0/2580588741 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94637913150592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56129b355af0 con 0x56129b310480 2024-09-22T08:38:30.114 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.101+0000 7f0ef6e2f640 1 -- 172.21.15.142:0/2580588741 <== osd.1 v2:172.21.15.142:6816/3192108003 22 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94637913150592] v32'252 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0ee8029040 con 0x56129b310480 2024-09-22T08:38:30.114 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.101+0000 7f0f01b46800 1 -- 172.21.15.142:0/2580588741 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94637913126480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56129b355af0 con 0x7f0ef8012ae0 2024-09-22T08:38:30.114 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.102+0000 7f0eff630640 1 -- 172.21.15.142:0/2580588741 <== osd.2 v2:172.21.15.142:6808/279438927 11 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94637913126480] v32'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ef0073030 con 0x7f0ef8012ae0 2024-09-22T08:38:30.114 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.102+0000 7f0f01b46800 20 remove_watcher() i=0 2024-09-22T08:38:30.114 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.102+0000 7f0f01b46800 2 removed watcher, disabling cache 2024-09-22T08:38:30.114 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.102+0000 7f0f01b46800 1 -- 172.21.15.142:0/2580588741 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94637913130496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56129b355af0 con 0x56129b310480 2024-09-22T08:38:30.114 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.104+0000 7f0ef6e2f640 1 -- 172.21.15.142:0/2580588741 <== osd.1 v2:172.21.15.142:6816/3192108003 23 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94637913130496] v32'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ee8029040 con 0x56129b310480 2024-09-22T08:38:30.114 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.104+0000 7f0f01b46800 20 remove_watcher() i=1 2024-09-22T08:38:30.115 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.104+0000 7f0f01b46800 1 -- 172.21.15.142:0/2580588741 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94637913135248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56129b355af0 con 0x56129b314e70 2024-09-22T08:38:30.115 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.105+0000 7f0effe31640 1 -- 172.21.15.142:0/2580588741 <== osd.3 v2:172.21.15.142:6800/1064901393 24 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94637913135248] v32'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ef8053020 con 0x56129b314e70 2024-09-22T08:38:30.115 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.105+0000 7f0f01b46800 20 remove_watcher() i=2 2024-09-22T08:38:30.115 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.105+0000 7f0f01b46800 1 -- 172.21.15.142:0/2580588741 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94637913132624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56129b355af0 con 0x7f0ef8012ae0 2024-09-22T08:38:30.115 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.106+0000 7f0eff630640 1 -- 172.21.15.142:0/2580588741 <== osd.2 v2:172.21.15.142:6808/279438927 12 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94637913132624] v32'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ef0073030 con 0x7f0ef8012ae0 2024-09-22T08:38:30.115 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.106+0000 7f0f01b46800 20 remove_watcher() i=3 2024-09-22T08:38:30.115 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.106+0000 7f0f01b46800 1 -- 172.21.15.142:0/2580588741 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94637913140208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56129b355af0 con 0x56129b310480 2024-09-22T08:38:30.115 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.107+0000 7f0ef6e2f640 1 -- 172.21.15.142:0/2580588741 <== osd.1 v2:172.21.15.142:6816/3192108003 24 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94637913140208] v32'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ee8029040 con 0x56129b310480 2024-09-22T08:38:30.115 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.107+0000 7f0f01b46800 20 remove_watcher() i=4 2024-09-22T08:38:30.115 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.107+0000 7f0f01b46800 1 -- 172.21.15.142:0/2580588741 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94637913144352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56129b355af0 con 0x7f0ef0076060 2024-09-22T08:38:30.115 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.109+0000 7f0ef6e2f640 1 -- 172.21.15.142:0/2580588741 <== osd.0 v2:172.21.15.31:6800/168281188 20 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94637913144352] v32'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ee8029040 con 0x7f0ef0076060 2024-09-22T08:38:30.115 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.109+0000 7f0f01b46800 20 remove_watcher() i=5 2024-09-22T08:38:30.115 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.109+0000 7f0f01b46800 1 -- 172.21.15.142:0/2580588741 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94637913141872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56129b355af0 con 0x7f0ef0076060 2024-09-22T08:38:30.115 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.110+0000 7f0ef6e2f640 1 -- 172.21.15.142:0/2580588741 <== osd.0 v2:172.21.15.31:6800/168281188 21 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94637913141872] v32'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ee8029040 con 0x7f0ef0076060 2024-09-22T08:38:30.116 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.110+0000 7f0f01b46800 20 remove_watcher() i=6 2024-09-22T08:38:30.116 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.110+0000 7f0f01b46800 1 -- 172.21.15.142:0/2580588741 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94637913149536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56129b355af0 con 0x7f0ef0076060 2024-09-22T08:38:30.116 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.111+0000 7f0ef6e2f640 1 -- 172.21.15.142:0/2580588741 <== osd.0 v2:172.21.15.31:6800/168281188 22 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94637913149536] v32'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ee8029040 con 0x7f0ef0076060 2024-09-22T08:38:30.116 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.111+0000 7f0f01b46800 20 remove_watcher() i=7 2024-09-22T08:38:30.116 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.111+0000 7f0f01b46800 1 -- 172.21.15.142:0/2580588741 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f0ef0076060 msgr2=0x7f0ef008e210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:30.116 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.111+0000 7f0f01b46800 1 --2- 172.21.15.142:0/2580588741 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f0ef0076060 0x7f0ef008e210 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:30.116 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.111+0000 7f0f01b46800 1 -- 172.21.15.142:0/2580588741 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x56129b310480 msgr2=0x56129b312940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:30.116 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.111+0000 7f0f01b46800 1 --2- 172.21.15.142:0/2580588741 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x56129b310480 0x56129b312940 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:30.116 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.111+0000 7f0f01b46800 1 -- 172.21.15.142:0/2580588741 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f0ef8012ae0 msgr2=0x7f0ef80123d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:30.116 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.111+0000 7f0f01b46800 1 --2- 172.21.15.142:0/2580588741 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f0ef8012ae0 0x7f0ef80123d0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:30.116 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.111+0000 7f0f01b46800 1 -- 172.21.15.142:0/2580588741 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x56129b314e70 msgr2=0x56129b317260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:30.116 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.111+0000 7f0f01b46800 1 --2- 172.21.15.142:0/2580588741 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x56129b314e70 0x56129b317260 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:30.116 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.111+0000 7f0f01b46800 1 -- 172.21.15.142:0/2580588741 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f0dc803cfb0 msgr2=0x7f0dc803f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:30.116 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.111+0000 7f0f01b46800 1 --2- 172.21.15.142:0/2580588741 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f0dc803cfb0 0x7f0dc803f470 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x56129b2d3880 tx=0x7f0ef007f000 comp rx=0 tx=0).stop 2024-09-22T08:38:30.117 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.111+0000 7f0f01b46800 1 -- 172.21.15.142:0/2580588741 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56129b2fd5e0 msgr2=0x56129b304b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:30.117 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.111+0000 7f0f01b46800 1 --2- 172.21.15.142:0/2580588741 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56129b2fd5e0 0x56129b304b20 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f0ef801fd40 tx=0x7f0ef8054770 comp rx=0 tx=0).stop 2024-09-22T08:38:30.117 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.111+0000 7f0ef6e2f640 1 -- 172.21.15.142:0/2580588741 reap_dead start 2024-09-22T08:38:30.117 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.111+0000 7f0f01b46800 1 -- 172.21.15.142:0/2580588741 shutdown_connections 2024-09-22T08:38:30.117 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.111+0000 7f0f01b46800 1 --2- 172.21.15.142:0/2580588741 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56129b2fd5e0 0x56129b304b20 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:30.117 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.111+0000 7f0f01b46800 1 -- 172.21.15.142:0/2580588741 >> 172.21.15.142:0/2580588741 conn(0x56129b2f99e0 msgr2=0x56129b2f7bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:38:30.117 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.111+0000 7f0f01b46800 1 -- 172.21.15.142:0/2580588741 shutdown_connections 2024-09-22T08:38:30.117 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.111+0000 7f0f01b46800 1 -- 172.21.15.142:0/2580588741 wait complete. 2024-09-22T08:38:30.117 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.111+0000 7f0f01b46800 1 -- 172.21.15.142:0/1104799216 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f0dd803d070 msgr2=0x7f0dd803f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:30.117 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.111+0000 7f0f01b46800 1 --2- 172.21.15.142:0/1104799216 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f0dd803d070 0x7f0dd803f530 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f0ef0095470 tx=0x7f0ef006a5f0 comp rx=0 tx=0).stop 2024-09-22T08:38:30.117 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.111+0000 7f0f01b46800 1 -- 172.21.15.142:0/1104799216 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56129b2f0b90 msgr2=0x56129b2f0fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:30.117 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.111+0000 7f0f01b46800 1 --2- 172.21.15.142:0/1104799216 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56129b2f0b90 0x56129b2f0fb0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x56129b2d2790 tx=0x7f0ef80167b0 comp rx=0 tx=0).stop 2024-09-22T08:38:30.117 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.111+0000 7f0f01b46800 1 -- 172.21.15.142:0/1104799216 shutdown_connections 2024-09-22T08:38:30.117 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.111+0000 7f0f01b46800 1 --2- 172.21.15.142:0/1104799216 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f0dd803d070 0x7f0dd803f530 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:30.117 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.111+0000 7f0f01b46800 1 --2- 172.21.15.142:0/1104799216 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56129b2f0b90 0x56129b2f0fb0 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:30.118 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.111+0000 7f0f01b46800 1 -- 172.21.15.142:0/1104799216 >> 172.21.15.142:0/1104799216 conn(0x56129b2e0b30 msgr2=0x56129b2e0f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:38:30.118 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.111+0000 7f0f01b46800 1 -- 172.21.15.142:0/1104799216 shutdown_connections 2024-09-22T08:38:30.118 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.111+0000 7f0f01b46800 1 -- 172.21.15.142:0/1104799216 wait complete. 2024-09-22T08:38:30.118 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.112+0000 7f0f01b46800 1 -- 172.21.15.142:0/3738393730 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x56129b1dca80 msgr2=0x56129b2d8de0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:30.118 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.112+0000 7f0f01b46800 1 --2- 172.21.15.142:0/3738393730 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x56129b1dca80 0x56129b2d8de0 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:30.118 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.112+0000 7f0f01b46800 1 -- 172.21.15.142:0/3738393730 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x56129b2db1c0 msgr2=0x56129b2dd640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:30.118 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.112+0000 7f0f01b46800 1 --2- 172.21.15.142:0/3738393730 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x56129b2db1c0 0x56129b2dd640 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:30.118 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.112+0000 7f0f01b46800 1 -- 172.21.15.142:0/3738393730 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f0de403cfb0 msgr2=0x7f0de403f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:30.118 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.112+0000 7f0f01b46800 1 --2- 172.21.15.142:0/3738393730 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f0de403cfb0 0x7f0de403f470 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f0ee8001db0 tx=0x7f0ee8001310 comp rx=0 tx=0).stop 2024-09-22T08:38:30.118 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.112+0000 7f0f01b46800 1 -- 172.21.15.142:0/3738393730 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56129b1db840 msgr2=0x56129b2d1790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:30.118 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.112+0000 7f0f01b46800 1 --2- 172.21.15.142:0/3738393730 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56129b1db840 0x56129b2d1790 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f0ef0025b20 tx=0x7f0ef0002fb0 comp rx=0 tx=0).stop 2024-09-22T08:38:30.118 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.112+0000 7f0f01b46800 1 -- 172.21.15.142:0/3738393730 shutdown_connections 2024-09-22T08:38:30.118 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.112+0000 7f0f01b46800 1 --2- 172.21.15.142:0/3738393730 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x56129b2db1c0 0x56129b2dd640 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:30.118 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.112+0000 7f0f01b46800 1 --2- 172.21.15.142:0/3738393730 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x56129b1dca80 0x56129b2d8de0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:30.118 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.112+0000 7f0f01b46800 1 --2- 172.21.15.142:0/3738393730 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f0de403cfb0 0x7f0de403f470 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:30.119 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.112+0000 7f0f01b46800 1 --2- 172.21.15.142:0/3738393730 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56129b1db840 0x56129b2d1790 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:30.119 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.112+0000 7f0f01b46800 1 -- 172.21.15.142:0/3738393730 >> 172.21.15.142:0/3738393730 conn(0x56129b1d6c30 msgr2=0x56129b2cb0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:38:30.119 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.112+0000 7f0f01b46800 1 -- 172.21.15.142:0/3738393730 shutdown_connections 2024-09-22T08:38:30.119 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.112+0000 7f0f01b46800 1 -- 172.21.15.142:0/3738393730 wait complete. 2024-09-22T08:38:30.122 DEBUG:tasks.util.rgw: json result: {'user_id': 'a_user', 'display_name': 'True Admin User', 'email': '', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'a_user', 'access_key': 'true_admin_akey', 'secret_key': 'true_admin_skey', 'active': True, 'create_date': '2024-09-22T08:38:30.097142Z'}], 'swift_keys': [], 'caps': [{'type': 'user-info-without-keys', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'admin': True, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-22T08:38:30.097130Z', 'tags': [], 'group_ids': []} 2024-09-22T08:38:30.122 ERROR:root:{'user_id': 'a_user', 'display_name': 'True Admin User', 'email': '', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'a_user', 'access_key': 'true_admin_akey', 'secret_key': 'true_admin_skey', 'active': True, 'create_date': '2024-09-22T08:38:30.097142Z'}], 'swift_keys': [], 'caps': [{'type': 'user-info-without-keys', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'admin': True, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-22T08:38:30.097130Z', 'tags': [], 'group_ids': []} 2024-09-22T08:38:30.122 ERROR:root:0 2024-09-22T08:38:30.123 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-22T08:38:30.127 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-22T08:38:30.127 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'a_user'] 2024-09-22T08:38:30.127 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'a_user'] 2024-09-22T08:38:30.127 DEBUG:teuthology.orchestra.run.smithi142:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid a_user 2024-09-22T08:38:30.171 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:38:30.171 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:38:30.172 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.171+0000 7f20fc322800 1 Processor -- start 2024-09-22T08:38:30.172 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.171+0000 7f20fc322800 1 -- start start 2024-09-22T08:38:30.173 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.171+0000 7f20fc322800 1 --2- >> v2:172.21.15.31:3300/0 conn(0x556cf88ad9e0 0x556cf88afea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:30.173 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.171+0000 7f20fc322800 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x556cf8734a20 con 0x556cf88a7a90 2024-09-22T08:38:30.173 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.171+0000 7f20fc322800 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x556cf87347d0 con 0x556cf88ad9e0 2024-09-22T08:38:30.173 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.171+0000 7f20f7867640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x556cf88ad9e0 0x556cf88afea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:30.173 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.171+0000 7f20f8068640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x556cf88a7a90 0x556cf88a7e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.142:50490/0 (socket says 172.21.15.142:50490) 2024-09-22T08:38:30.173 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.171+0000 7f20f8068640 1 -- 172.21.15.142:0/2799924696 learned_addr learned my addr 172.21.15.142:0/2799924696 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-09-22T08:38:30.173 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.172+0000 7f20f7867640 1 -- 172.21.15.142:0/2799924696 >> v1:172.21.15.31:6789/0 conn(0x556cf88a7a90 legacy=0x556cf88a7e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:30.173 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.172+0000 7f20f7066640 1 -- 172.21.15.142:0/2799924696 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2228381941 0 0) 0x556cf8734a20 con 0x556cf88a7a90 2024-09-22T08:38:30.174 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.172+0000 7f20f7867640 1 -- 172.21.15.142:0/2799924696 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x556cf88b15b0 con 0x556cf88ad9e0 2024-09-22T08:38:30.175 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.173+0000 7f20f7867640 1 --2- 172.21.15.142:0/2799924696 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556cf88ad9e0 0x556cf88afea0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f20ec00a470 tx=0x7f20ec045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcf8cb096fd462de server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:30.175 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.174+0000 7f20f7066640 1 -- 172.21.15.142:0/2799924696 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20ec053570 con 0x556cf88ad9e0 2024-09-22T08:38:30.175 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.174+0000 7f20f7066640 1 -- 172.21.15.142:0/2799924696 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20ec058070 con 0x556cf88ad9e0 2024-09-22T08:38:30.175 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.174+0000 7f20f7066640 1 -- 172.21.15.142:0/2799924696 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20ec053880 con 0x556cf88ad9e0 2024-09-22T08:38:30.176 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.174+0000 7f20fc322800 1 -- 172.21.15.142:0/2799924696 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556cf88ad9e0 msgr2=0x556cf88afea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:30.176 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.174+0000 7f20fc322800 1 --2- 172.21.15.142:0/2799924696 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556cf88ad9e0 0x556cf88afea0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f20ec00a470 tx=0x7f20ec045a20 comp rx=0 tx=0).stop 2024-09-22T08:38:30.176 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.174+0000 7f20fc322800 1 -- 172.21.15.142:0/2799924696 shutdown_connections 2024-09-22T08:38:30.176 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.174+0000 7f20fc322800 1 --2- 172.21.15.142:0/2799924696 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556cf88ad9e0 0x556cf88afea0 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:30.176 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.174+0000 7f20fc322800 1 -- 172.21.15.142:0/2799924696 >> 172.21.15.142:0/2799924696 conn(0x556cf88a3310 msgr2=0x556cf88a5790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:38:30.176 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.174+0000 7f20fc322800 1 -- 172.21.15.142:0/2799924696 shutdown_connections 2024-09-22T08:38:30.176 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.174+0000 7f20fc322800 1 -- 172.21.15.142:0/2799924696 wait complete. 2024-09-22T08:38:30.190 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.188+0000 7f20fc322800 1 Processor -- start 2024-09-22T08:38:30.190 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.188+0000 7f20fc322800 1 -- start start 2024-09-22T08:38:30.190 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.189+0000 7f20fc322800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556cf88a7a90 0x556cf8998e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:30.190 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.189+0000 7f20fc322800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x556cf8741dd0 con 0x556cf88a7a90 2024-09-22T08:38:30.191 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.189+0000 7f20f8068640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556cf88a7a90 0x556cf8998e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:30.191 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.189+0000 7f20f8068640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556cf88a7a90 0x556cf8998e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:51886/0 (socket says 172.21.15.142:51886) 2024-09-22T08:38:30.191 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.189+0000 7f20f8068640 1 -- 172.21.15.142:0/3669685841 learned_addr learned my addr 172.21.15.142:0/3669685841 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:38:30.191 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.189+0000 7f20f8068640 1 -- 172.21.15.142:0/3669685841 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556cf8999460 con 0x556cf88a7a90 2024-09-22T08:38:30.191 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.190+0000 7f20f8068640 1 --2- 172.21.15.142:0/3669685841 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556cf88a7a90 0x556cf8998e70 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f20e8001ea0 tx=0x7f20e800b6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fdc6b2ce090dde server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:30.191 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.190+0000 7f1fe660c640 1 -- 172.21.15.142:0/3669685841 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20e8008070 con 0x556cf88a7a90 2024-09-22T08:38:30.191 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.190+0000 7f1fe660c640 1 -- 172.21.15.142:0/3669685841 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20e800d500 con 0x556cf88a7a90 2024-09-22T08:38:30.191 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.190+0000 7f1fe660c640 1 -- 172.21.15.142:0/3669685841 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20e800d880 con 0x556cf88a7a90 2024-09-22T08:38:30.193 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.190+0000 7f20fc322800 1 -- 172.21.15.142:0/3669685841 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556cf88a7a90 msgr2=0x556cf8998e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:30.193 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.190+0000 7f20fc322800 1 --2- 172.21.15.142:0/3669685841 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556cf88a7a90 0x556cf8998e70 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f20e8001ea0 tx=0x7f20e800b6a0 comp rx=0 tx=0).stop 2024-09-22T08:38:30.193 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.190+0000 7f20fc322800 1 -- 172.21.15.142:0/3669685841 shutdown_connections 2024-09-22T08:38:30.193 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.190+0000 7f20fc322800 1 --2- 172.21.15.142:0/3669685841 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556cf88a7a90 0x556cf8998e70 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:30.193 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.190+0000 7f20fc322800 1 -- 172.21.15.142:0/3669685841 >> 172.21.15.142:0/3669685841 conn(0x556cf88a3310 msgr2=0x556cf89947f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:38:30.193 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.190+0000 7f20fc322800 1 -- 172.21.15.142:0/3669685841 shutdown_connections 2024-09-22T08:38:30.193 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.190+0000 7f20fc322800 1 -- 172.21.15.142:0/3669685841 wait complete. 2024-09-22T08:38:30.193 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.191+0000 7f20fc322800 1 Processor -- start 2024-09-22T08:38:30.194 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.191+0000 7f20fc322800 1 -- start start 2024-09-22T08:38:30.194 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.191+0000 7f20fc322800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556cf88a7a90 0x556cf88aa020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:30.194 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.191+0000 7f20fc322800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x556cf88b0850 con 0x556cf88a7a90 2024-09-22T08:38:30.194 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.191+0000 7f20f8068640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556cf88a7a90 0x556cf88aa020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:30.194 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.191+0000 7f20f8068640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556cf88a7a90 0x556cf88aa020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:51898/0 (socket says 172.21.15.142:51898) 2024-09-22T08:38:30.194 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.191+0000 7f20f8068640 1 -- 172.21.15.142:0/4148289719 learned_addr learned my addr 172.21.15.142:0/4148289719 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:38:30.194 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.191+0000 7f20f8068640 1 -- 172.21.15.142:0/4148289719 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556cf88aa580 con 0x556cf88a7a90 2024-09-22T08:38:30.194 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.192+0000 7f20f8068640 1 --2- 172.21.15.142:0/4148289719 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556cf88a7a90 0x556cf88aa020 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f20e80012f0 tx=0x7f20e8000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:30.194 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.192+0000 7f1fe4e09640 1 -- 172.21.15.142:0/4148289719 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20e800f9d0 con 0x556cf88a7a90 2024-09-22T08:38:30.194 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.192+0000 7f1fe4e09640 1 -- 172.21.15.142:0/4148289719 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20e800fb70 con 0x556cf88a7a90 2024-09-22T08:38:30.194 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.192+0000 7f20fc322800 1 -- 172.21.15.142:0/4148289719 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556cf88a8930 con 0x556cf88a7a90 2024-09-22T08:38:30.194 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.192+0000 7f1fe4e09640 1 -- 172.21.15.142:0/4148289719 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20e800fe50 con 0x556cf88a7a90 2024-09-22T08:38:30.194 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.192+0000 7f20fc322800 1 -- 172.21.15.142:0/4148289719 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556cf88a8ef0 con 0x556cf88a7a90 2024-09-22T08:38:30.197 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.193+0000 7f1fe4e09640 1 -- 172.21.15.142:0/4148289719 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f20e8017040 con 0x556cf88a7a90 2024-09-22T08:38:30.197 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.193+0000 7f1fe4e09640 1 --2- 172.21.15.142:0/4148289719 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f1fe003d1a0 0x7f1fe003f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:30.197 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.193+0000 7f1fe4e09640 1 -- 172.21.15.142:0/4148289719 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5938+0+0 (secure 0 0 0) 0x7f20e8015020 con 0x556cf88a7a90 2024-09-22T08:38:30.197 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.193+0000 7f20f7867640 1 --2- 172.21.15.142:0/4148289719 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f1fe003d1a0 0x7f1fe003f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:30.197 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.193+0000 7f20fc322800 1 --2- 172.21.15.142:0/4148289719 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x556cf88ad9e0 0x556cf89a9e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:30.197 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.193+0000 7f20fc322800 1 -- 172.21.15.142:0/4148289719 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556cf89aa3b0 con 0x556cf88ad9e0 2024-09-22T08:38:30.197 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.193+0000 7f20f8869640 1 --2- 172.21.15.142:0/4148289719 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x556cf88ad9e0 0x556cf89a9e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:30.197 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.193+0000 7f20f7867640 1 --2- 172.21.15.142:0/4148289719 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f1fe003d1a0 0x7f1fe003f660 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f20ec057000 tx=0x7f20ec052000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:30.197 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.194+0000 7f20f8869640 1 --2- 172.21.15.142:0/4148289719 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x556cf88ad9e0 0x556cf89a9e70 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:30.198 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.194+0000 7f20f8869640 1 -- 172.21.15.142:0/4148289719 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f20f000a4d0 con 0x556cf88ad9e0 2024-09-22T08:38:30.198 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.194+0000 7f20fc322800 1 -- 172.21.15.142:0/4148289719 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556cf88a93f0 con 0x556cf88ad9e0 2024-09-22T08:38:30.198 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.194+0000 7f20f8869640 1 -- 172.21.15.142:0/4148289719 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f20f000a4d0 con 0x556cf88ad9e0 2024-09-22T08:38:30.198 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.194+0000 7f20fc322800 1 --2- 172.21.15.142:0/4148289719 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x556cf89ac700 0x556cf89aeaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:30.198 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.194+0000 7f20fc322800 1 -- 172.21.15.142:0/4148289719 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:3 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556cf89af1c0 con 0x556cf89ac700 2024-09-22T08:38:30.198 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.194+0000 7f20f8068640 1 --2- 172.21.15.142:0/4148289719 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x556cf89ac700 0x556cf89aeaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:30.198 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.194+0000 7f20f8068640 1 --2- 172.21.15.142:0/4148289719 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x556cf89ac700 0x556cf89aeaf0 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:30.198 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.195+0000 7f20f8068640 1 -- 172.21.15.142:0/4148289719 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(3 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f20e802d070 con 0x556cf89ac700 2024-09-22T08:38:30.198 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.195+0000 7f20fc322800 1 -- 172.21.15.142:0/4148289719 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556cf89ab5a0 con 0x556cf88ad9e0 2024-09-22T08:38:30.198 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.195+0000 7f20f8869640 1 -- 172.21.15.142:0/4148289719 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f20f000a4d0 con 0x556cf88ad9e0 2024-09-22T08:38:30.198 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.195+0000 7f20fc322800 1 -- 172.21.15.142:0/4148289719 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556cf89aba40 con 0x556cf89ac700 2024-09-22T08:38:30.198 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.195+0000 7f20f8068640 1 -- 172.21.15.142:0/4148289719 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(5 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f20e802d070 con 0x556cf89ac700 2024-09-22T08:38:30.198 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.196+0000 7f20fc322800 1 Processor -- start 2024-09-22T08:38:30.199 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.196+0000 7f20fc322800 1 -- start start 2024-09-22T08:38:30.199 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.196+0000 7f20fc322800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556cf89bdb30 0x556cf89bdf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:30.199 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.196+0000 7f20fc322800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x556cf87a0d50 con 0x556cf89bdb30 2024-09-22T08:38:30.203 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.196+0000 7f20f8869640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556cf89bdb30 0x556cf89bdf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:30.203 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.196+0000 7f20f8869640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556cf89bdb30 0x556cf89bdf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:51900/0 (socket says 172.21.15.142:51900) 2024-09-22T08:38:30.203 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.196+0000 7f20f8869640 1 -- 172.21.15.142:0/3041959728 learned_addr learned my addr 172.21.15.142:0/3041959728 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:38:30.203 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.196+0000 7f20f8869640 1 -- 172.21.15.142:0/3041959728 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556cf89be590 con 0x556cf89bdb30 2024-09-22T08:38:30.203 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.197+0000 7f20f8869640 1 --2- 172.21.15.142:0/3041959728 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556cf89bdb30 0x556cf89bdf50 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x556cf88a9bc0 tx=0x7f20f00167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:30.203 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.197+0000 7f1fddffb640 1 -- 172.21.15.142:0/3041959728 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20f0021570 con 0x556cf89bdb30 2024-09-22T08:38:30.203 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.197+0000 7f1fddffb640 1 -- 172.21.15.142:0/3041959728 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20f0021710 con 0x556cf89bdb30 2024-09-22T08:38:30.203 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.197+0000 7f20fc322800 1 -- 172.21.15.142:0/3041959728 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556cf89bedc0 con 0x556cf89bdb30 2024-09-22T08:38:30.203 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.197+0000 7f1fddffb640 1 -- 172.21.15.142:0/3041959728 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20f00219f0 con 0x556cf89bdb30 2024-09-22T08:38:30.203 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.197+0000 7f20fc322800 1 -- 172.21.15.142:0/3041959728 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556cf89bf360 con 0x556cf89bdb30 2024-09-22T08:38:30.203 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.198+0000 7f1fddffb640 1 -- 172.21.15.142:0/3041959728 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f20f0011040 con 0x556cf89bdb30 2024-09-22T08:38:30.204 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.198+0000 7f1fddffb640 1 --2- 172.21.15.142:0/3041959728 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f1fd003cfb0 0x7f1fd003f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:30.204 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.198+0000 7f1fddffb640 1 -- 172.21.15.142:0/3041959728 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5938+0+0 (secure 0 0 0) 0x7f20f000e040 con 0x556cf89bdb30 2024-09-22T08:38:30.204 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.198+0000 7f20f8068640 1 --2- 172.21.15.142:0/3041959728 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f1fd003cfb0 0x7f1fd003f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:30.204 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.198+0000 7f20fc322800 1 Processor -- start 2024-09-22T08:38:30.204 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.198+0000 7f20fc322800 1 -- start start 2024-09-22T08:38:30.204 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.198+0000 7f20f8068640 1 --2- 172.21.15.142:0/3041959728 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f1fd003cfb0 0x7f1fd003f470 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f20e8053200 tx=0x7f20e801b440 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:30.204 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.198+0000 7f20fc322800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556cf89ca5b0 0x556cf89ca9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:30.204 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.198+0000 7f20fc322800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x556cf8999890 con 0x556cf89ca5b0 2024-09-22T08:38:30.204 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.199+0000 7f20f8869640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556cf89ca5b0 0x556cf89ca9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:30.204 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.199+0000 7f20f8869640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556cf89ca5b0 0x556cf89ca9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:51906/0 (socket says 172.21.15.142:51906) 2024-09-22T08:38:30.204 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.199+0000 7f20f8869640 1 -- 172.21.15.142:0/1865186187 learned_addr learned my addr 172.21.15.142:0/1865186187 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:38:30.204 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.199+0000 7f20f8869640 1 -- 172.21.15.142:0/1865186187 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556cf89cafa0 con 0x556cf89ca5b0 2024-09-22T08:38:30.204 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.199+0000 7f20f8869640 1 --2- 172.21.15.142:0/1865186187 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556cf89ca5b0 0x556cf89ca9b0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f20f0054980 tx=0x7f20f0014da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eda93e57cdd6d35b server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:30.205 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.199+0000 7f1fd77fe640 1 -- 172.21.15.142:0/1865186187 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20f0044070 con 0x556cf89ca5b0 2024-09-22T08:38:30.205 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.199+0000 7f1fd77fe640 1 -- 172.21.15.142:0/1865186187 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20f001fb60 con 0x556cf89ca5b0 2024-09-22T08:38:30.205 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.199+0000 7f1fd77fe640 1 -- 172.21.15.142:0/1865186187 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20f0056240 con 0x556cf89ca5b0 2024-09-22T08:38:30.205 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.200+0000 7f20fc322800 1 -- 172.21.15.142:0/1865186187 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556cf89ca5b0 msgr2=0x556cf89ca9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:30.205 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.200+0000 7f20fc322800 1 --2- 172.21.15.142:0/1865186187 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556cf89ca5b0 0x556cf89ca9b0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f20f0054980 tx=0x7f20f0014da0 comp rx=0 tx=0).stop 2024-09-22T08:38:30.205 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.200+0000 7f20fc322800 1 -- 172.21.15.142:0/1865186187 shutdown_connections 2024-09-22T08:38:30.205 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.200+0000 7f20fc322800 1 --2- 172.21.15.142:0/1865186187 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556cf89ca5b0 0x556cf89ca9b0 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:30.205 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.200+0000 7f20fc322800 1 -- 172.21.15.142:0/1865186187 >> 172.21.15.142:0/1865186187 conn(0x556cf89c69b0 msgr2=0x556cf89c4bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:38:30.205 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.200+0000 7f20fc322800 1 -- 172.21.15.142:0/1865186187 shutdown_connections 2024-09-22T08:38:30.205 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.200+0000 7f20fc322800 1 -- 172.21.15.142:0/1865186187 wait complete. 2024-09-22T08:38:30.205 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.200+0000 7f20fc322800 1 Processor -- start 2024-09-22T08:38:30.205 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.200+0000 7f20fc322800 1 -- start start 2024-09-22T08:38:30.205 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.200+0000 7f20fc322800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556cf89ca5b0 0x556cf89d1b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:30.206 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.200+0000 7f20fc322800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x556cf89cb5c0 con 0x556cf89ca5b0 2024-09-22T08:38:30.206 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.200+0000 7f20f8869640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556cf89ca5b0 0x556cf89d1b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:30.206 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.200+0000 7f20f8869640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556cf89ca5b0 0x556cf89d1b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:51908/0 (socket says 172.21.15.142:51908) 2024-09-22T08:38:30.206 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.200+0000 7f20f8869640 1 -- 172.21.15.142:0/3109085313 learned_addr learned my addr 172.21.15.142:0/3109085313 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:38:30.206 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.201+0000 7f20f8869640 1 -- 172.21.15.142:0/3109085313 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556cf89d20f0 con 0x556cf89ca5b0 2024-09-22T08:38:30.206 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.201+0000 7f20f8869640 1 --2- 172.21.15.142:0/3109085313 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556cf89ca5b0 0x556cf89d1b90 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f20f0014de0 tx=0x7f20f00548e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:30.206 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.201+0000 7f1fd5ffb640 1 -- 172.21.15.142:0/3109085313 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20f00535b0 con 0x556cf89ca5b0 2024-09-22T08:38:30.206 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.201+0000 7f1fd5ffb640 1 -- 172.21.15.142:0/3109085313 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20f0046e30 con 0x556cf89ca5b0 2024-09-22T08:38:30.206 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.201+0000 7f20fc322800 1 -- 172.21.15.142:0/3109085313 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556cf89d2380 con 0x556cf89ca5b0 2024-09-22T08:38:30.206 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.201+0000 7f1fd5ffb640 1 -- 172.21.15.142:0/3109085313 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20f0054a90 con 0x556cf89ca5b0 2024-09-22T08:38:30.206 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.201+0000 7f20fc322800 1 -- 172.21.15.142:0/3109085313 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556cf89d2380 con 0x556cf89ca5b0 2024-09-22T08:38:30.206 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.202+0000 7f1fd5ffb640 1 -- 172.21.15.142:0/3109085313 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f20f0029ab0 con 0x556cf89ca5b0 2024-09-22T08:38:30.217 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.202+0000 7f1fd5ffb640 1 --2- 172.21.15.142:0/3109085313 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f1fc803d150 0x7f1fc803f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:30.217 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.202+0000 7f1fd5ffb640 1 -- 172.21.15.142:0/3109085313 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5938+0+0 (secure 0 0 0) 0x7f20f0033b90 con 0x556cf89ca5b0 2024-09-22T08:38:30.217 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.202+0000 7f20f8068640 1 --2- 172.21.15.142:0/3109085313 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f1fc803d150 0x7f1fc803f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:30.217 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.203+0000 7f20f8068640 1 --2- 172.21.15.142:0/3109085313 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f1fc803d150 0x7f1fc803f610 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f20e8018a00 tx=0x7f20e8041000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:30.218 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.203+0000 7f20fc322800 20 rados->read ofs=0 len=0 2024-09-22T08:38:30.218 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.203+0000 7f20fc322800 1 --2- 172.21.15.142:0/3109085313 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x556cf89dd310 0x556cf89df7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:30.218 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.203+0000 7f20fc322800 1 -- 172.21.15.142:0/3109085313 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556cf89dff20 con 0x556cf89dd310 2024-09-22T08:38:30.218 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.203+0000 7f20f7867640 1 --2- 172.21.15.142:0/3109085313 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x556cf89dd310 0x556cf89df7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:30.218 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.203+0000 7f20f7867640 1 --2- 172.21.15.142:0/3109085313 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x556cf89dd310 0x556cf89df7d0 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:30.218 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.203+0000 7f20f7867640 1 -- 172.21.15.142:0/3109085313 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f20ec051070 con 0x556cf89dd310 2024-09-22T08:38:30.218 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.203+0000 7f20fc322800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:30.218 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.203+0000 7f20fc322800 20 realm 2024-09-22T08:38:30.218 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.203+0000 7f20fc322800 20 rados->read ofs=0 len=0 2024-09-22T08:38:30.218 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.203+0000 7f20fc322800 1 -- 172.21.15.142:0/3109085313 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556cf89e0350 con 0x556cf89dd310 2024-09-22T08:38:30.218 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.203+0000 7f20f7867640 1 -- 172.21.15.142:0/3109085313 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f20ec051070 con 0x556cf89dd310 2024-09-22T08:38:30.218 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.203+0000 7f20fc322800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:30.218 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.203+0000 7f20fc322800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:38:30.219 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.203+0000 7f20fc322800 20 rados->read ofs=0 len=0 2024-09-22T08:38:30.219 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.203+0000 7f20fc322800 1 -- 172.21.15.142:0/3109085313 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556cf89e0c20 con 0x556cf89dd310 2024-09-22T08:38:30.219 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.204+0000 7f20f7867640 1 -- 172.21.15.142:0/3109085313 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f20ec051070 con 0x556cf89dd310 2024-09-22T08:38:30.219 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.204+0000 7f20fc322800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:30.219 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.204+0000 7f20fc322800 20 rados->read ofs=0 len=0 2024-09-22T08:38:30.219 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.204+0000 7f20fc322800 1 -- 172.21.15.142:0/3109085313 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556cf89e0fc0 con 0x556cf89dd310 2024-09-22T08:38:30.219 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.204+0000 7f20f7867640 1 -- 172.21.15.142:0/3109085313 <== osd.1 v2:172.21.15.142:6816/3192108003 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f20ec051070 con 0x556cf89dd310 2024-09-22T08:38:30.219 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.204+0000 7f20fc322800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:38:30.219 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.204+0000 7f20fc322800 20 rados->read ofs=0 len=0 2024-09-22T08:38:30.219 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.204+0000 7f20fc322800 1 --2- 172.21.15.142:0/3109085313 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x556cf89e1d20 0x556cf89e4110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:30.219 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.204+0000 7f20fc322800 1 -- 172.21.15.142:0/3109085313 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556cf89e4720 con 0x556cf89e1d20 2024-09-22T08:38:30.219 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.204+0000 7f20f8869640 1 --2- 172.21.15.142:0/3109085313 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x556cf89e1d20 0x556cf89e4110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:30.220 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.204+0000 7f20f8869640 1 --2- 172.21.15.142:0/3109085313 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x556cf89e1d20 0x556cf89e4110 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:30.220 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.205+0000 7f20f8869640 1 -- 172.21.15.142:0/3109085313 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(5 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f20f0038020 con 0x556cf89e1d20 2024-09-22T08:38:30.220 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.205+0000 7f20fc322800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:38:30.220 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.205+0000 7f20fc322800 20 searching for the correct realm 2024-09-22T08:38:30.220 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.205+0000 7f20fc322800 1 -- 172.21.15.142:0/3109085313 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556cf89e6050 con 0x556cf89e1d20 2024-09-22T08:38:30.220 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.205+0000 7f20f8869640 1 -- 172.21.15.142:0/3109085313 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20f0038020 con 0x556cf89e1d20 2024-09-22T08:38:30.220 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.205+0000 7f20f8869640 1 --2- 172.21.15.142:0/3109085313 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f20f0045130 0x7f20f0045550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:30.220 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.205+0000 7f20f8869640 1 -- 172.21.15.142:0/3109085313 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556cf89e6050 con 0x7f20f0045130 2024-09-22T08:38:30.220 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.205+0000 7f20f8068640 1 --2- 172.21.15.142:0/3109085313 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f20f0045130 0x7f20f0045550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:30.220 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.205+0000 7f20f8068640 1 --2- 172.21.15.142:0/3109085313 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f20f0045130 0x7f20f0045550 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:30.220 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.205+0000 7f20f8068640 1 -- 172.21.15.142:0/3109085313 <== osd.2 v2:172.21.15.142:6808/279438927 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20e8039070 con 0x7f20f0045130 2024-09-22T08:38:30.220 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.205+0000 7f20f8068640 1 --2- 172.21.15.142:0/3109085313 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f20e803c040 0x7f20e804c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:30.220 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.205+0000 7f20f8068640 1 -- 172.21.15.142:0/3109085313 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556cf89e6050 con 0x7f20e803c040 2024-09-22T08:38:30.220 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.206+0000 7f20f7867640 1 --2- 172.21.15.142:0/3109085313 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f20e803c040 0x7f20e804c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:30.220 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.206+0000 7f20f7867640 1 --2- 172.21.15.142:0/3109085313 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f20e803c040 0x7f20e804c580 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:30.221 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.206+0000 7f20f7867640 1 -- 172.21.15.142:0/3109085313 <== osd.0 v2:172.21.15.31:6800/168281188 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20ec051070 con 0x7f20e803c040 2024-09-22T08:38:30.221 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.206+0000 7f20f7867640 1 -- 172.21.15.142:0/3109085313 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556cf89e6050 con 0x556cf89dd310 2024-09-22T08:38:30.221 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.207+0000 7f20f7867640 1 -- 172.21.15.142:0/3109085313 <== osd.1 v2:172.21.15.142:6816/3192108003 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20ec051070 con 0x556cf89dd310 2024-09-22T08:38:30.221 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.207+0000 7f20f7867640 1 -- 172.21.15.142:0/3109085313 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556cf89e6050 con 0x556cf89dd310 2024-09-22T08:38:30.221 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.207+0000 7f20f7867640 1 -- 172.21.15.142:0/3109085313 <== osd.1 v2:172.21.15.142:6816/3192108003 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20ec051070 con 0x556cf89dd310 2024-09-22T08:38:30.221 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.207+0000 7f20f7867640 1 -- 172.21.15.142:0/3109085313 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556cf89e6050 con 0x556cf89dd310 2024-09-22T08:38:30.221 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.207+0000 7f20f7867640 1 -- 172.21.15.142:0/3109085313 <== osd.1 v2:172.21.15.142:6816/3192108003 7 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20ec051070 con 0x556cf89dd310 2024-09-22T08:38:30.221 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.207+0000 7f20f7867640 1 -- 172.21.15.142:0/3109085313 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556cf89e6050 con 0x7f20e803c040 2024-09-22T08:38:30.221 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.207+0000 7f20f7867640 1 -- 172.21.15.142:0/3109085313 <== osd.0 v2:172.21.15.31:6800/168281188 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20ec051070 con 0x7f20e803c040 2024-09-22T08:38:30.221 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.207+0000 7f20f7867640 1 -- 172.21.15.142:0/3109085313 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556cf89e6050 con 0x7f20f0045130 2024-09-22T08:38:30.221 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.208+0000 7f20f8068640 1 -- 172.21.15.142:0/3109085313 <== osd.2 v2:172.21.15.142:6808/279438927 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20e8039070 con 0x7f20f0045130 2024-09-22T08:38:30.221 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.208+0000 7f20f8068640 1 -- 172.21.15.142:0/3109085313 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556cf89e6050 con 0x556cf89e1d20 2024-09-22T08:38:30.221 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.208+0000 7f20f8869640 1 -- 172.21.15.142:0/3109085313 <== osd.3 v2:172.21.15.142:6800/1064901393 3 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20f0038020 con 0x556cf89e1d20 2024-09-22T08:38:30.221 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.208+0000 7f20f8869640 1 -- 172.21.15.142:0/3109085313 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556cf89e6050 con 0x556cf89dd310 2024-09-22T08:38:30.222 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.208+0000 7f20f7867640 1 -- 172.21.15.142:0/3109085313 <== osd.1 v2:172.21.15.142:6816/3192108003 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20ec051070 con 0x556cf89dd310 2024-09-22T08:38:30.222 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.208+0000 7f20f7867640 1 -- 172.21.15.142:0/3109085313 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556cf89e6050 con 0x7f20e803c040 2024-09-22T08:38:30.222 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.208+0000 7f20f7867640 1 -- 172.21.15.142:0/3109085313 <== osd.0 v2:172.21.15.31:6800/168281188 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20ec051070 con 0x7f20e803c040 2024-09-22T08:38:30.222 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.208+0000 7f20f7867640 1 -- 172.21.15.142:0/3109085313 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556cf89e6050 con 0x556cf89dd310 2024-09-22T08:38:30.222 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.208+0000 7f20f7867640 1 -- 172.21.15.142:0/3109085313 <== osd.1 v2:172.21.15.142:6816/3192108003 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20ec051070 con 0x556cf89dd310 2024-09-22T08:38:30.222 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.208+0000 7f20f7867640 1 -- 172.21.15.142:0/3109085313 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556cf89e6050 con 0x7f20f0045130 2024-09-22T08:38:30.222 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.209+0000 7f20f8068640 1 -- 172.21.15.142:0/3109085313 <== osd.2 v2:172.21.15.142:6808/279438927 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f20e8039070 con 0x7f20f0045130 2024-09-22T08:38:30.222 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.209+0000 7f20f8068640 1 -- 172.21.15.142:0/3109085313 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556cf89e6050 con 0x556cf89e1d20 2024-09-22T08:38:30.222 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.209+0000 7f20f8869640 1 -- 172.21.15.142:0/3109085313 <== osd.3 v2:172.21.15.142:6800/1064901393 4 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20f0038020 con 0x556cf89e1d20 2024-09-22T08:38:30.222 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.209+0000 7f20f8869640 1 -- 172.21.15.142:0/3109085313 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556cf89e6050 con 0x556cf89e1d20 2024-09-22T08:38:30.222 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.209+0000 7f20f8869640 1 -- 172.21.15.142:0/3109085313 <== osd.3 v2:172.21.15.142:6800/1064901393 5 ==== osd_op_reply(20 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f20f0038020 con 0x556cf89e1d20 2024-09-22T08:38:30.222 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.209+0000 7f20f8869640 1 -- 172.21.15.142:0/3109085313 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556cf89e6050 con 0x7f20e803c040 2024-09-22T08:38:30.222 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.209+0000 7f20f7867640 1 -- 172.21.15.142:0/3109085313 <== osd.0 v2:172.21.15.31:6800/168281188 4 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20ec051070 con 0x7f20e803c040 2024-09-22T08:38:30.222 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.209+0000 7f20f7867640 1 -- 172.21.15.142:0/3109085313 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556cf89e6050 con 0x556cf89e1d20 2024-09-22T08:38:30.223 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.210+0000 7f20f8869640 1 -- 172.21.15.142:0/3109085313 <== osd.3 v2:172.21.15.142:6800/1064901393 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20f0038020 con 0x556cf89e1d20 2024-09-22T08:38:30.223 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.210+0000 7f20f8869640 1 -- 172.21.15.142:0/3109085313 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556cf89e6050 con 0x556cf89e1d20 2024-09-22T08:38:30.223 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.210+0000 7f20f8869640 1 -- 172.21.15.142:0/3109085313 <== osd.3 v2:172.21.15.142:6800/1064901393 7 ==== osd_op_reply(23 [pgnls start_epoch 32 out=107b] v32'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f20f0038020 con 0x556cf89e1d20 2024-09-22T08:38:30.223 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.210+0000 7f20f8869640 1 -- 172.21.15.142:0/3109085313 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556cf89e6050 con 0x556cf89dd310 2024-09-22T08:38:30.223 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.210+0000 7f20f7867640 1 -- 172.21.15.142:0/3109085313 <== osd.1 v2:172.21.15.142:6816/3192108003 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20ec051070 con 0x556cf89dd310 2024-09-22T08:38:30.223 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.210+0000 7f20f7867640 1 -- 172.21.15.142:0/3109085313 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556cf89e6050 con 0x556cf89dd310 2024-09-22T08:38:30.223 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.210+0000 7f20f7867640 1 -- 172.21.15.142:0/3109085313 <== osd.1 v2:172.21.15.142:6816/3192108003 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v32'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f20ec051070 con 0x556cf89dd310 2024-09-22T08:38:30.223 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.210+0000 7f20f7867640 1 -- 172.21.15.142:0/3109085313 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556cf89e6050 con 0x7f20e803c040 2024-09-22T08:38:30.223 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.211+0000 7f20f7867640 1 -- 172.21.15.142:0/3109085313 <== osd.0 v2:172.21.15.31:6800/168281188 5 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20ec051070 con 0x7f20e803c040 2024-09-22T08:38:30.223 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.211+0000 7f20f7867640 1 -- 172.21.15.142:0/3109085313 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556cf89e6050 con 0x556cf89e1d20 2024-09-22T08:38:30.223 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.211+0000 7f20f8869640 1 -- 172.21.15.142:0/3109085313 <== osd.3 v2:172.21.15.142:6800/1064901393 8 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20f0038020 con 0x556cf89e1d20 2024-09-22T08:38:30.223 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.211+0000 7f20f8869640 1 -- 172.21.15.142:0/3109085313 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556cf89e6050 con 0x7f20f0045130 2024-09-22T08:38:30.223 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.211+0000 7f20f8068640 1 -- 172.21.15.142:0/3109085313 <== osd.2 v2:172.21.15.142:6808/279438927 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20e8039070 con 0x7f20f0045130 2024-09-22T08:38:30.223 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.211+0000 7f20f8068640 1 -- 172.21.15.142:0/3109085313 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556cf89e6050 con 0x556cf89dd310 2024-09-22T08:38:30.223 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.211+0000 7f20f7867640 1 -- 172.21.15.142:0/3109085313 <== osd.1 v2:172.21.15.142:6816/3192108003 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20ec051070 con 0x556cf89dd310 2024-09-22T08:38:30.224 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.211+0000 7f20f7867640 1 -- 172.21.15.142:0/3109085313 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556cf89e6050 con 0x7f20e803c040 2024-09-22T08:38:30.224 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.212+0000 7f20f7867640 1 -- 172.21.15.142:0/3109085313 <== osd.0 v2:172.21.15.31:6800/168281188 6 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20ec051070 con 0x7f20e803c040 2024-09-22T08:38:30.224 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.212+0000 7f20f7867640 1 -- 172.21.15.142:0/3109085313 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556cf89e6050 con 0x556cf89e1d20 2024-09-22T08:38:30.224 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.212+0000 7f20f8869640 1 -- 172.21.15.142:0/3109085313 <== osd.3 v2:172.21.15.142:6800/1064901393 9 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20f0038020 con 0x556cf89e1d20 2024-09-22T08:38:30.224 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.212+0000 7f20f8869640 1 -- 172.21.15.142:0/3109085313 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556cf89e6050 con 0x7f20e803c040 2024-09-22T08:38:30.224 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.212+0000 7f20f7867640 1 -- 172.21.15.142:0/3109085313 <== osd.0 v2:172.21.15.31:6800/168281188 7 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20ec051070 con 0x7f20e803c040 2024-09-22T08:38:30.224 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.212+0000 7f20f7867640 1 -- 172.21.15.142:0/3109085313 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556cf89e6050 con 0x7f20f0045130 2024-09-22T08:38:30.224 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.212+0000 7f20f8068640 1 -- 172.21.15.142:0/3109085313 <== osd.2 v2:172.21.15.142:6808/279438927 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20e8039070 con 0x7f20f0045130 2024-09-22T08:38:30.224 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.212+0000 7f20f8068640 1 -- 172.21.15.142:0/3109085313 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556cf89e6050 con 0x556cf89e1d20 2024-09-22T08:38:30.224 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.213+0000 7f20f8869640 1 -- 172.21.15.142:0/3109085313 <== osd.3 v2:172.21.15.142:6800/1064901393 10 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20f0038020 con 0x556cf89e1d20 2024-09-22T08:38:30.224 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.213+0000 7f20f8869640 1 -- 172.21.15.142:0/3109085313 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556cf89e6050 con 0x7f20e803c040 2024-09-22T08:38:30.224 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.213+0000 7f20f7867640 1 -- 172.21.15.142:0/3109085313 <== osd.0 v2:172.21.15.31:6800/168281188 8 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20ec051070 con 0x7f20e803c040 2024-09-22T08:38:30.224 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.213+0000 7f20f7867640 1 -- 172.21.15.142:0/3109085313 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556cf89e6050 con 0x556cf89dd310 2024-09-22T08:38:30.224 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.213+0000 7f20f7867640 1 -- 172.21.15.142:0/3109085313 <== osd.1 v2:172.21.15.142:6816/3192108003 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v32'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f20ec051070 con 0x556cf89dd310 2024-09-22T08:38:30.224 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.213+0000 7f20f7867640 1 -- 172.21.15.142:0/3109085313 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556cf89e6050 con 0x7f20f0045130 2024-09-22T08:38:30.225 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.213+0000 7f20f8068640 1 -- 172.21.15.142:0/3109085313 <== osd.2 v2:172.21.15.142:6808/279438927 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20e8039070 con 0x7f20f0045130 2024-09-22T08:38:30.225 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.213+0000 7f20fc322800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:38:30.225 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.213+0000 7f20fc322800 20 RGWRados::pool_iterate: got zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec 2024-09-22T08:38:30.225 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.213+0000 7f20fc322800 20 RGWRados::pool_iterate: got zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f 2024-09-22T08:38:30.225 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.213+0000 7f20fc322800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:38:30.225 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.213+0000 7f20fc322800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:38:30.225 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.213+0000 7f20fc322800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:38:30.225 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.213+0000 7f20fc322800 20 rados->read ofs=0 len=0 2024-09-22T08:38:30.225 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.213+0000 7f20fc322800 1 -- 172.21.15.142:0/3109085313 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556cf89e50e0 con 0x556cf89dd310 2024-09-22T08:38:30.225 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.214+0000 7f20f7867640 1 -- 172.21.15.142:0/3109085313 <== osd.1 v2:172.21.15.142:6816/3192108003 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f20ec051070 con 0x556cf89dd310 2024-09-22T08:38:30.225 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.214+0000 7f20fc322800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:30.225 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.214+0000 7f20fc322800 20 rados->read ofs=0 len=0 2024-09-22T08:38:30.225 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.214+0000 7f20fc322800 1 -- 172.21.15.142:0/3109085313 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556cf89e5930 con 0x556cf89dd310 2024-09-22T08:38:30.225 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.214+0000 7f20f7867640 1 -- 172.21.15.142:0/3109085313 <== osd.1 v2:172.21.15.142:6816/3192108003 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f20ec051070 con 0x556cf89dd310 2024-09-22T08:38:30.225 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.214+0000 7f20fc322800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:38:30.226 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.214+0000 7f20fc322800 20 rados->read ofs=0 len=0 2024-09-22T08:38:30.226 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.214+0000 7f20fc322800 1 -- 172.21.15.142:0/3109085313 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:40 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556cf89e64d0 con 0x556cf89e1d20 2024-09-22T08:38:30.226 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.214+0000 7f20f8869640 1 -- 172.21.15.142:0/3109085313 <== osd.3 v2:172.21.15.142:6800/1064901393 11 ==== osd_op_reply(40 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f20f0038020 con 0x556cf89e1d20 2024-09-22T08:38:30.226 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.214+0000 7f20fc322800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:38:30.226 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.214+0000 7f20fc322800 20 zone default found 2024-09-22T08:38:30.226 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.214+0000 7f20fc322800 4 Realm: () 2024-09-22T08:38:30.226 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.214+0000 7f20fc322800 4 ZoneGroup: default (d89f6f57-1007-47dd-9065-f486c7b01aec) 2024-09-22T08:38:30.226 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.214+0000 7f20fc322800 4 Zone: default (e239248c-0bee-4e41-803a-24b288d3eb8f) 2024-09-22T08:38:30.226 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.214+0000 7f20fc322800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:38:30.226 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.214+0000 7f20fc322800 20 zonegroup default 2024-09-22T08:38:30.226 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.214+0000 7f20fc322800 20 rados->read ofs=0 len=0 2024-09-22T08:38:30.226 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.214+0000 7f20fc322800 1 -- 172.21.15.142:0/3109085313 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556cf89e68d0 con 0x7f20e803c040 2024-09-22T08:38:30.226 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.214+0000 7f20f7867640 1 -- 172.21.15.142:0/3109085313 <== osd.0 v2:172.21.15.31:6800/168281188 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f20ec051070 con 0x7f20e803c040 2024-09-22T08:38:30.226 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.214+0000 7f20fc322800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:30.226 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.214+0000 7f20fc322800 20 rados->read ofs=0 len=0 2024-09-22T08:38:30.227 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.214+0000 7f20fc322800 1 -- 172.21.15.142:0/3109085313 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556cf89e8bb0 con 0x556cf89e1d20 2024-09-22T08:38:30.227 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.215+0000 7f20f8869640 1 -- 172.21.15.142:0/3109085313 <== osd.3 v2:172.21.15.142:6800/1064901393 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f20f0038020 con 0x556cf89e1d20 2024-09-22T08:38:30.227 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.215+0000 7f20fc322800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:30.227 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.215+0000 7f20fc322800 20 rados->read ofs=0 len=0 2024-09-22T08:38:30.227 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.215+0000 7f20fc322800 1 -- 172.21.15.142:0/3109085313 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556cf89e8f50 con 0x556cf89e1d20 2024-09-22T08:38:30.227 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.215+0000 7f20f8869640 1 -- 172.21.15.142:0/3109085313 <== osd.3 v2:172.21.15.142:6800/1064901393 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f20f0038020 con 0x556cf89e1d20 2024-09-22T08:38:30.227 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.215+0000 7f20fc322800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:30.227 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.215+0000 7f20fc322800 20 started sync module instance, tier type = 2024-09-22T08:38:30.227 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.215+0000 7f20fc322800 20 started zone id=e239248c-0bee-4e41-803a-24b288d3eb8f (name=default) with tier type = 2024-09-22T08:38:30.227 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.215+0000 7f20fc322800 1 -- 172.21.15.142:0/3109085313 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556cf89e8040 con 0x7f20f0045130 2024-09-22T08:38:30.227 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.216+0000 7f20f8068640 1 -- 172.21.15.142:0/3109085313 <== osd.2 v2:172.21.15.142:6808/279438927 7 ==== osd_op_reply(44 notify.0 [create] v32'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20e8039070 con 0x7f20f0045130 2024-09-22T08:38:30.227 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.216+0000 7f20fc322800 1 -- 172.21.15.142:0/3109085313 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93926515967024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556cf89e7ca0 con 0x7f20f0045130 2024-09-22T08:38:30.227 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.216+0000 7f20fc322800 1 -- 172.21.15.142:0/3109085313 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556cf89e9d40 con 0x556cf89dd310 2024-09-22T08:38:30.231 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.217+0000 7f20f8068640 1 -- 172.21.15.142:0/3109085313 <== osd.2 v2:172.21.15.142:6808/279438927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93926515967024] v32'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20e8039070 con 0x7f20f0045130 2024-09-22T08:38:30.231 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.217+0000 7f20f7867640 1 -- 172.21.15.142:0/3109085313 <== osd.1 v2:172.21.15.142:6816/3192108003 16 ==== osd_op_reply(46 notify.1 [create] v32'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20ec051070 con 0x556cf89dd310 2024-09-22T08:38:30.231 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.217+0000 7f20fc322800 1 -- 172.21.15.142:0/3109085313 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93926515970944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556cf89ea130 con 0x556cf89dd310 2024-09-22T08:38:30.231 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.217+0000 7f20fc322800 1 -- 172.21.15.142:0/3109085313 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556cf89eab90 con 0x556cf89e1d20 2024-09-22T08:38:30.231 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.219+0000 7f20f8869640 1 -- 172.21.15.142:0/3109085313 <== osd.3 v2:172.21.15.142:6800/1064901393 14 ==== osd_op_reply(48 notify.2 [create] v32'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20f0038020 con 0x556cf89e1d20 2024-09-22T08:38:30.231 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.219+0000 7f20fc322800 1 -- 172.21.15.142:0/3109085313 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93926515975744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556cf89eab50 con 0x556cf89e1d20 2024-09-22T08:38:30.232 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.219+0000 7f20fc322800 1 -- 172.21.15.142:0/3109085313 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556cf89ebb60 con 0x7f20f0045130 2024-09-22T08:38:30.232 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.219+0000 7f20f7867640 1 -- 172.21.15.142:0/3109085313 <== osd.1 v2:172.21.15.142:6816/3192108003 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93926515970944] v32'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20ec051070 con 0x556cf89dd310 2024-09-22T08:38:30.232 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.220+0000 7f20f8869640 1 -- 172.21.15.142:0/3109085313 <== osd.3 v2:172.21.15.142:6800/1064901393 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 93926515975744] v32'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20f0038020 con 0x556cf89e1d20 2024-09-22T08:38:30.232 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.220+0000 7f20f8068640 1 -- 172.21.15.142:0/3109085313 <== osd.2 v2:172.21.15.142:6808/279438927 9 ==== osd_op_reply(50 notify.3 [create] v32'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20e8039070 con 0x7f20f0045130 2024-09-22T08:38:30.232 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.220+0000 7f20fc322800 1 -- 172.21.15.142:0/3109085313 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93926515978112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556cf89eb620 con 0x7f20f0045130 2024-09-22T08:38:30.232 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.220+0000 7f20fc322800 1 -- 172.21.15.142:0/3109085313 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556cf89ec570 con 0x556cf89dd310 2024-09-22T08:38:30.232 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.221+0000 7f20f8068640 1 -- 172.21.15.142:0/3109085313 <== osd.2 v2:172.21.15.142:6808/279438927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93926515978112] v32'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20e8039070 con 0x7f20f0045130 2024-09-22T08:38:30.232 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.221+0000 7f20f7867640 1 -- 172.21.15.142:0/3109085313 <== osd.1 v2:172.21.15.142:6816/3192108003 18 ==== osd_op_reply(52 notify.4 [create] v32'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20ec051070 con 0x556cf89dd310 2024-09-22T08:38:30.232 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.221+0000 7f20fc322800 1 -- 172.21.15.142:0/3109085313 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93926515972000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556cf89ec570 con 0x556cf89dd310 2024-09-22T08:38:30.232 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.221+0000 7f20fc322800 1 -- 172.21.15.142:0/3109085313 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556cf89ecf30 con 0x7f20e803c040 2024-09-22T08:38:30.232 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.222+0000 7f20f7867640 1 -- 172.21.15.142:0/3109085313 <== osd.0 v2:172.21.15.31:6800/168281188 10 ==== osd_op_reply(54 notify.5 [create] v32'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20ec051070 con 0x7f20e803c040 2024-09-22T08:38:30.232 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.222+0000 7f20fc322800 1 -- 172.21.15.142:0/3109085313 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93926515985024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556cf89ecea0 con 0x7f20e803c040 2024-09-22T08:38:30.232 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.222+0000 7f20fc322800 1 -- 172.21.15.142:0/3109085313 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556cf89edf00 con 0x7f20e803c040 2024-09-22T08:38:30.232 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.223+0000 7f20f7867640 1 -- 172.21.15.142:0/3109085313 <== osd.1 v2:172.21.15.142:6816/3192108003 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93926515972000] v32'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20ec051070 con 0x556cf89dd310 2024-09-22T08:38:30.233 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.223+0000 7f20f7867640 1 -- 172.21.15.142:0/3109085313 <== osd.0 v2:172.21.15.31:6800/168281188 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 93926515985024] v32'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20ec051070 con 0x7f20e803c040 2024-09-22T08:38:30.233 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.224+0000 7f20f7867640 1 -- 172.21.15.142:0/3109085313 <== osd.0 v2:172.21.15.31:6800/168281188 12 ==== osd_op_reply(56 notify.6 [create] v32'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20ec051070 con 0x7f20e803c040 2024-09-22T08:38:30.233 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.224+0000 7f20fc322800 1 -- 172.21.15.142:0/3109085313 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93926515988976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556cf89edec0 con 0x7f20e803c040 2024-09-22T08:38:30.233 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.224+0000 7f20fc322800 1 -- 172.21.15.142:0/3109085313 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556cf89ee7a0 con 0x7f20e803c040 2024-09-22T08:38:30.233 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.225+0000 7f20f7867640 1 -- 172.21.15.142:0/3109085313 <== osd.0 v2:172.21.15.31:6800/168281188 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 93926515988976] v32'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20ec051070 con 0x7f20e803c040 2024-09-22T08:38:30.233 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.225+0000 7f20f7867640 1 -- 172.21.15.142:0/3109085313 <== osd.0 v2:172.21.15.31:6800/168281188 14 ==== osd_op_reply(58 notify.7 [create] v32'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20ec051070 con 0x7f20e803c040 2024-09-22T08:38:30.233 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.225+0000 7f20fc322800 1 -- 172.21.15.142:0/3109085313 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93926515982528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556cf89edec0 con 0x7f20e803c040 2024-09-22T08:38:30.233 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.225+0000 7f20fc322800 20 add_watcher() i=0 2024-09-22T08:38:30.233 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.225+0000 7f20fc322800 20 add_watcher() i=1 2024-09-22T08:38:30.233 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.225+0000 7f20fc322800 20 add_watcher() i=2 2024-09-22T08:38:30.233 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.225+0000 7f20fc322800 20 add_watcher() i=3 2024-09-22T08:38:30.233 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.225+0000 7f20fc322800 20 add_watcher() i=4 2024-09-22T08:38:30.233 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.225+0000 7f20fc322800 20 add_watcher() i=5 2024-09-22T08:38:30.233 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.225+0000 7f20fc322800 20 add_watcher() i=6 2024-09-22T08:38:30.233 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.226+0000 7f20f7867640 1 -- 172.21.15.142:0/3109085313 <== osd.0 v2:172.21.15.31:6800/168281188 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 93926515982528] v32'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20ec051070 con 0x7f20e803c040 2024-09-22T08:38:30.234 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.226+0000 7f20fc322800 20 add_watcher() i=7 2024-09-22T08:38:30.234 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.226+0000 7f20fc322800 2 all 8 watchers are set, enabling cache 2024-09-22T08:38:30.234 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.226+0000 7f20fc322800 1 -- 172.21.15.142:0/3109085313 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556cf89f18a0 con 0x556cf89dd310 2024-09-22T08:38:30.234 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.226+0000 7f20f7867640 1 -- 172.21.15.142:0/3109085313 <== osd.1 v2:172.21.15.142:6816/3192108003 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f20ec051070 con 0x556cf89dd310 2024-09-22T08:38:30.234 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.227+0000 7f20fc322800 1 -- 172.21.15.142:0/3109085313 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93926515991280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556cf89eebc0 con 0x556cf89dd310 2024-09-22T08:38:30.234 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.228+0000 7f20f7867640 1 -- 172.21.15.142:0/3109085313 <== osd.1 v2:172.21.15.142:6816/3192108003 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93926515991280] v32'253 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f20ec051070 con 0x556cf89dd310 2024-09-22T08:38:30.234 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.228+0000 7f1fae7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:38:30.234 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.228+0000 7f20fc322800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:38:30.234 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.228+0000 7f20fc322800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:38:30.234 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.228+0000 7f20fc322800 1 -- 172.21.15.142:0/3109085313 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556cf89fa3d0 con 0x556cf89dd310 2024-09-22T08:38:30.234 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.229+0000 7f20f7867640 1 -- 172.21.15.142:0/3109085313 <== osd.1 v2:172.21.15.142:6816/3192108003 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'36 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f20ec051070 con 0x556cf89dd310 2024-09-22T08:38:30.234 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.229+0000 7f20fc322800 1 -- 172.21.15.142:0/3109085313 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556cf89faa60 con 0x7f20e803c040 2024-09-22T08:38:30.235 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.231+0000 7f20f7867640 1 -- 172.21.15.142:0/3109085313 <== osd.0 v2:172.21.15.31:6800/168281188 16 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'30 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f20ec051070 con 0x7f20e803c040 2024-09-22T08:38:30.235 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.231+0000 7f20fc322800 1 -- 172.21.15.142:0/3109085313 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556cf89fae80 con 0x556cf89e1d20 2024-09-22T08:38:30.235 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.232+0000 7f20f8869640 1 -- 172.21.15.142:0/3109085313 <== osd.3 v2:172.21.15.142:6800/1064901393 16 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'31 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f20f0038020 con 0x556cf89e1d20 2024-09-22T08:38:30.236 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.232+0000 7f20fc322800 1 -- 172.21.15.142:0/3109085313 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556cf89fad50 con 0x556cf89dd310 2024-09-22T08:38:30.236 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.233+0000 7f20f7867640 1 -- 172.21.15.142:0/3109085313 <== osd.1 v2:172.21.15.142:6816/3192108003 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'254 uv162 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f20ec051070 con 0x556cf89dd310 2024-09-22T08:38:30.236 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.233+0000 7f20fc322800 1 -- 172.21.15.142:0/3109085313 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556cf89fb3a0 con 0x7f20f0045130 2024-09-22T08:38:30.236 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.234+0000 7f20f8068640 1 -- 172.21.15.142:0/3109085313 <== osd.2 v2:172.21.15.142:6808/279438927 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'82 uv53 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f20e8039070 con 0x7f20f0045130 2024-09-22T08:38:30.236 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.234+0000 7f20fc322800 1 -- 172.21.15.142:0/3109085313 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556cf89fb7d0 con 0x556cf89e1d20 2024-09-22T08:38:30.236 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.235+0000 7f20f8869640 1 -- 172.21.15.142:0/3109085313 <== osd.3 v2:172.21.15.142:6800/1064901393 17 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'54 uv34 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f20f0038020 con 0x556cf89e1d20 2024-09-22T08:38:30.236 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.235+0000 7f20fc322800 1 -- 172.21.15.142:0/3109085313 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556cf89fb7d0 con 0x556cf89dd310 2024-09-22T08:38:30.237 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.236+0000 7f20f7867640 1 -- 172.21.15.142:0/3109085313 <== osd.1 v2:172.21.15.142:6816/3192108003 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'32 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f20ec051070 con 0x556cf89dd310 2024-09-22T08:38:30.237 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.236+0000 7f20fc322800 1 -- 172.21.15.142:0/3109085313 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556cf89fb7d0 con 0x7f20e803c040 2024-09-22T08:38:30.238 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.237+0000 7f20f7867640 1 -- 172.21.15.142:0/3109085313 <== osd.0 v2:172.21.15.31:6800/168281188 17 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'53 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f20ec051070 con 0x7f20e803c040 2024-09-22T08:38:30.238 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.237+0000 7f20fc322800 1 -- 172.21.15.142:0/3109085313 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556cf89fb860 con 0x7f20f0045130 2024-09-22T08:38:30.239 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.238+0000 7f20f8068640 1 -- 172.21.15.142:0/3109085313 <== osd.2 v2:172.21.15.142:6808/279438927 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'30 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f20e8039070 con 0x7f20f0045130 2024-09-22T08:38:30.239 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.238+0000 7f20fc322800 1 -- 172.21.15.142:0/3109085313 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556cf89fbd10 con 0x556cf89e1d20 2024-09-22T08:38:30.240 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.239+0000 7f20f8869640 1 -- 172.21.15.142:0/3109085313 <== osd.3 v2:172.21.15.142:6800/1064901393 18 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'36 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f20f0038020 con 0x556cf89e1d20 2024-09-22T08:38:30.240 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.239+0000 7f20fc322800 1 -- 172.21.15.142:0/3109085313 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556cf89fbd10 con 0x7f20f0045130 2024-09-22T08:38:30.241 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.240+0000 7f20f8068640 1 -- 172.21.15.142:0/3109085313 <== osd.2 v2:172.21.15.142:6808/279438927 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'83 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f20e8039070 con 0x7f20f0045130 2024-09-22T08:38:30.241 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.240+0000 7f20fc322800 1 -- 172.21.15.142:0/3109085313 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556cf89fbd10 con 0x7f20e803c040 2024-09-22T08:38:30.242 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.241+0000 7f20f7867640 1 -- 172.21.15.142:0/3109085313 <== osd.0 v2:172.21.15.31:6800/168281188 18 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'36 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f20ec051070 con 0x7f20e803c040 2024-09-22T08:38:30.242 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.241+0000 7f20fc322800 1 -- 172.21.15.142:0/3109085313 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556cf89fbd10 con 0x7f20f0045130 2024-09-22T08:38:30.243 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.242+0000 7f20f8068640 1 -- 172.21.15.142:0/3109085313 <== osd.2 v2:172.21.15.142:6808/279438927 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'30 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f20e8039070 con 0x7f20f0045130 2024-09-22T08:38:30.243 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.242+0000 7f20fc322800 1 -- 172.21.15.142:0/3109085313 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556cf89fbd10 con 0x7f20e803c040 2024-09-22T08:38:30.245 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.244+0000 7f20f7867640 1 -- 172.21.15.142:0/3109085313 <== osd.0 v2:172.21.15.31:6800/168281188 19 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'61 uv44 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f20ec051070 con 0x7f20e803c040 2024-09-22T08:38:30.245 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.244+0000 7f20fc322800 1 -- 172.21.15.142:0/3109085313 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556cf89fbd10 con 0x556cf89dd310 2024-09-22T08:38:30.246 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.245+0000 7f20f7867640 1 -- 172.21.15.142:0/3109085313 <== osd.1 v2:172.21.15.142:6816/3192108003 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'255 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f20ec051070 con 0x556cf89dd310 2024-09-22T08:38:30.246 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.245+0000 7f20fc322800 1 -- 172.21.15.142:0/3109085313 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556cf89fbd10 con 0x556cf89e1d20 2024-09-22T08:38:30.247 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.246+0000 7f20f8869640 1 -- 172.21.15.142:0/3109085313 <== osd.3 v2:172.21.15.142:6800/1064901393 19 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'74 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f20f0038020 con 0x556cf89e1d20 2024-09-22T08:38:30.247 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.246+0000 7f20fc322800 1 -- 172.21.15.142:0/3109085313 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556cf89fbd40 con 0x7f20f0045130 2024-09-22T08:38:30.250 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.247+0000 7f20f8068640 1 -- 172.21.15.142:0/3109085313 <== osd.2 v2:172.21.15.142:6808/279438927 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'84 uv57 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f20e8039070 con 0x7f20f0045130 2024-09-22T08:38:30.250 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.247+0000 7f20fc322800 1 -- 172.21.15.142:0/3109085313 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556cf89fbd80 con 0x556cf89e1d20 2024-09-22T08:38:30.250 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.248+0000 7f20f8869640 1 -- 172.21.15.142:0/3109085313 <== osd.3 v2:172.21.15.142:6800/1064901393 20 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'30 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f20f0038020 con 0x556cf89e1d20 2024-09-22T08:38:30.250 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.248+0000 7f20fc322800 1 -- 172.21.15.142:0/3109085313 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556cf89fbe20 con 0x556cf89dd310 2024-09-22T08:38:30.251 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.249+0000 7f20f7867640 1 -- 172.21.15.142:0/3109085313 <== osd.1 v2:172.21.15.142:6816/3192108003 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'38 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f20ec051070 con 0x556cf89dd310 2024-09-22T08:38:30.251 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.249+0000 7f20fc322800 1 -- 172.21.15.142:0/3109085313 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556cf89fbe20 con 0x556cf89dd310 2024-09-22T08:38:30.251 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.250+0000 7f20f7867640 1 -- 172.21.15.142:0/3109085313 <== osd.1 v2:172.21.15.142:6816/3192108003 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'256 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f20ec051070 con 0x556cf89dd310 2024-09-22T08:38:30.251 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.250+0000 7f20fc322800 1 -- 172.21.15.142:0/3109085313 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556cf89fbe20 con 0x556cf89e1d20 2024-09-22T08:38:30.253 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.252+0000 7f20f8869640 1 -- 172.21.15.142:0/3109085313 <== osd.3 v2:172.21.15.142:6800/1064901393 21 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'75 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f20f0038020 con 0x556cf89e1d20 2024-09-22T08:38:30.253 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.252+0000 7f20fc322800 1 -- 172.21.15.142:0/3109085313 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556cf89fbe20 con 0x7f20f0045130 2024-09-22T08:38:30.254 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.252+0000 7f20f8068640 1 -- 172.21.15.142:0/3109085313 <== osd.2 v2:172.21.15.142:6808/279438927 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'40 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f20e8039070 con 0x7f20f0045130 2024-09-22T08:38:30.254 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.253+0000 7f20fc322800 1 -- 172.21.15.142:0/3109085313 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556cf89fbe20 con 0x556cf89e1d20 2024-09-22T08:38:30.254 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.253+0000 7f20f8869640 1 -- 172.21.15.142:0/3109085313 <== osd.3 v2:172.21.15.142:6800/1064901393 22 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'32 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f20f0038020 con 0x556cf89e1d20 2024-09-22T08:38:30.254 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.253+0000 7f20fc322800 1 -- 172.21.15.142:0/3109085313 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556cf89fbec0 con 0x556cf89e1d20 2024-09-22T08:38:30.255 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.254+0000 7f20f8869640 1 -- 172.21.15.142:0/3109085313 <== osd.3 v2:172.21.15.142:6800/1064901393 23 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'37 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f20f0038020 con 0x556cf89e1d20 2024-09-22T08:38:30.255 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.254+0000 7f20fc322800 1 -- 172.21.15.142:0/3109085313 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556cf89fbec0 con 0x556cf89e1d20 2024-09-22T08:38:30.256 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.255+0000 7f20f8869640 1 -- 172.21.15.142:0/3109085313 <== osd.3 v2:172.21.15.142:6800/1064901393 24 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'26 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f20f0038020 con 0x556cf89e1d20 2024-09-22T08:38:30.256 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.255+0000 7f20fc322800 1 -- 172.21.15.142:0/3109085313 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556cf89fbfb0 con 0x556cf89e1d20 2024-09-22T08:38:30.257 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.256+0000 7f20f8869640 1 -- 172.21.15.142:0/3109085313 <== osd.3 v2:172.21.15.142:6800/1064901393 25 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'55 uv36 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f20f0038020 con 0x556cf89e1d20 2024-09-22T08:38:30.258 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.256+0000 7f20fc322800 1 -- 172.21.15.142:0/3109085313 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556cf89fbfb0 con 0x7f20e803c040 2024-09-22T08:38:30.258 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.257+0000 7f20f7867640 1 -- 172.21.15.142:0/3109085313 <== osd.0 v2:172.21.15.31:6800/168281188 20 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'32 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f20ec051070 con 0x7f20e803c040 2024-09-22T08:38:30.259 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.257+0000 7f20fc322800 1 -- 172.21.15.142:0/3109085313 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556cf89fbf50 con 0x556cf89e1d20 2024-09-22T08:38:30.259 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.258+0000 7f20f8869640 1 -- 172.21.15.142:0/3109085313 <== osd.3 v2:172.21.15.142:6800/1064901393 26 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'31 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f20f0038020 con 0x556cf89e1d20 2024-09-22T08:38:30.260 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.258+0000 7f20fc322800 1 -- 172.21.15.142:0/3109085313 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556cf89fbf50 con 0x7f20e803c040 2024-09-22T08:38:30.261 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.260+0000 7f20f7867640 1 -- 172.21.15.142:0/3109085313 <== osd.0 v2:172.21.15.31:6800/168281188 21 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'54 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f20ec051070 con 0x7f20e803c040 2024-09-22T08:38:30.261 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.260+0000 7f20fc322800 1 -- 172.21.15.142:0/3109085313 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556cf89fbf80 con 0x556cf89e1d20 2024-09-22T08:38:30.262 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.261+0000 7f20f8869640 1 -- 172.21.15.142:0/3109085313 <== osd.3 v2:172.21.15.142:6800/1064901393 27 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'76 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f20f0038020 con 0x556cf89e1d20 2024-09-22T08:38:30.262 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.261+0000 7f20fc322800 1 -- 172.21.15.142:0/3109085313 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556cf89fbf80 con 0x7f20e803c040 2024-09-22T08:38:30.263 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.262+0000 7f20f7867640 1 -- 172.21.15.142:0/3109085313 <== osd.0 v2:172.21.15.31:6800/168281188 22 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'62 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f20ec051070 con 0x7f20e803c040 2024-09-22T08:38:30.263 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.262+0000 7f20fc322800 1 -- 172.21.15.142:0/3109085313 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556cf89fbf50 con 0x7f20f0045130 2024-09-22T08:38:30.265 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.264+0000 7f20f8068640 1 -- 172.21.15.142:0/3109085313 <== osd.2 v2:172.21.15.142:6808/279438927 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'36 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f20e8039070 con 0x7f20f0045130 2024-09-22T08:38:30.266 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.264+0000 7f1fad7e2640 20 reqs_thread_entry: start 2024-09-22T08:38:30.266 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.264+0000 7f20fc322800 20 init_complete bucket index max shards: 11 2024-09-22T08:38:30.266 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.264+0000 7f20fc322800 20 Filter name: none 2024-09-22T08:38:30.266 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.264+0000 7f1f1effd640 20 reqs_thread_entry: start 2024-09-22T08:38:30.266 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.264+0000 7f20fc322800 10 cache get: name=default.rgw.meta+users.uid+a_user : miss 2024-09-22T08:38:30.267 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.264+0000 7f20fc322800 20 rados->read ofs=0 len=0 2024-09-22T08:38:30.267 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.264+0000 7f20fc322800 1 -- 172.21.15.142:0/3109085313 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:94 8.14 8:2efb937b:users.uid::a_user:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556cf8a26f30 con 0x556cf89e1d20 2024-09-22T08:38:30.267 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.265+0000 7f20f8869640 1 -- 172.21.15.142:0/3109085313 <== osd.3 v2:172.21.15.142:6800/1064901393 28 ==== osd_op_reply(94 a_user [call out=48b,read 0~363 out=363b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 234+0+486 (crc 0 0 0) 0x7f20f0038020 con 0x556cf89e1d20 2024-09-22T08:38:30.267 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.265+0000 7f20fc322800 20 rados_obj.operate() r=0 bl.length=363 2024-09-22T08:38:30.267 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.265+0000 7f20fc322800 10 cache put: name=default.rgw.meta+users.uid+a_user info.flags=0x13 2024-09-22T08:38:30.267 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.265+0000 7f20fc322800 10 adding default.rgw.meta+users.uid+a_user to cache LRU end 2024-09-22T08:38:30.267 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.265+0000 7f20fc322800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:38:30.267 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.265+0000 7f20fc322800 1 -- 172.21.15.142:0/3109085313 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:95 8.11 8:8d3ad08f:users.uid::a_user.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556cf8a29600 con 0x556cf89e1d20 2024-09-22T08:38:30.267 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.265+0000 7f20f8869640 1 -- 172.21.15.142:0/3109085313 <== osd.3 v2:172.21.15.142:6800/1064901393 29 ==== osd_op_reply(95 a_user.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 158+0+0 (crc 0 0 0) 0x7f20f0038020 con 0x556cf89e1d20 2024-09-22T08:38:30.267 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.265+0000 7f20fc322800 10 removing key index: true_admin_akey 2024-09-22T08:38:30.267 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.265+0000 7f20fc322800 1 -- 172.21.15.142:0/3109085313 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:96 8.15 8:afe09604:users.keys::true_admin_akey:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556cf8a295c0 con 0x556cf89e1d20 2024-09-22T08:38:30.268 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.266+0000 7f20f8869640 1 -- 172.21.15.142:0/3109085313 <== osd.3 v2:172.21.15.142:6800/1064901393 30 ==== osd_op_reply(96 true_admin_akey [delete] v32'16 uv16 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f20f0038020 con 0x556cf89e1d20 2024-09-22T08:38:30.268 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.266+0000 7f20fc322800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.keys:true_admin_akey, ofs0, ns] 2024-09-22T08:38:30.269 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.266+0000 7f20fc322800 1 -- 172.21.15.142:0/3109085313 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:97 7.3 7:c609908c:::notify.5:head [notify cookie 93926516232528 in=177b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556cf8a285d0 con 0x7f20e803c040 2024-09-22T08:38:30.269 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.266+0000 7f20f7867640 1 -- 172.21.15.142:0/3109085313 <== osd.0 v2:172.21.15.31:6800/168281188 23 ==== watch-notify(notify (1) cookie 93926515985024 notify 137438953511 ret 0) ==== 207+0+0 (crc 0 0 0) 0x556cf89fa9a0 con 0x7f20e803c040 2024-09-22T08:38:30.269 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.266+0000 7f1fd77fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953511 cookie 93926515985024 notifier 4863 bl.length()=165 2024-09-22T08:38:30.269 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.266+0000 7f1fd77fe640 1 -- 172.21.15.142:0/3109085313 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:98 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f1fbc003d60 con 0x7f20e803c040 2024-09-22T08:38:30.269 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.266+0000 7f20f7867640 1 -- 172.21.15.142:0/3109085313 <== osd.0 v2:172.21.15.31:6800/168281188 24 ==== osd_op_reply(97 notify.5 [notify cookie 93926516232528 out=8b] v0'0 uv255 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f20ec051070 con 0x7f20e803c040 2024-09-22T08:38:30.269 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.267+0000 7f20f7867640 1 -- 172.21.15.142:0/3109085313 <== osd.0 v2:172.21.15.31:6800/168281188 25 ==== osd_op_reply(98 notify.5 [notify-ack] v0'0 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20ec051070 con 0x7f20e803c040 2024-09-22T08:38:30.269 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.267+0000 7f20f7867640 1 -- 172.21.15.142:0/3109085313 <== osd.0 v2:172.21.15.31:6800/168281188 26 ==== watch-notify(notify_complete (2) cookie 93926516232528 notify 137438953511 ret 0) ==== 42+0+48 (crc 0 0 0) 0x556cf89fa560 con 0x7f20e803c040 2024-09-22T08:38:30.269 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.267+0000 7f20fc322800 10 removing email index: 2024-09-22T08:38:30.269 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.267+0000 7f20fc322800 10 removing user buckets index 2024-09-22T08:38:30.269 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.267+0000 7f20fc322800 1 -- 172.21.15.142:0/3109085313 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:99 8.11 8:8d3ad08f:users.uid::a_user.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556cf8a29150 con 0x556cf89e1d20 2024-09-22T08:38:30.271 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.268+0000 7f20f8869640 1 -- 172.21.15.142:0/3109085313 <== osd.3 v2:172.21.15.142:6800/1064901393 31 ==== osd_op_reply(99 a_user.buckets [delete] v32'1 uv0 ondisk = -2 ((2) No such file or directory)) ==== 158+0+0 (crc 0 0 0) 0x7f20f0038020 con 0x556cf89e1d20 2024-09-22T08:38:30.271 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.268+0000 7f20fc322800 10 removing user index: a_user 2024-09-22T08:38:30.271 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.268+0000 7f20fc322800 1 -- 172.21.15.142:0/3109085313 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:100 8.14 8:2efb937b:users.uid::a_user:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556cf8a28120 con 0x556cf89e1d20 2024-09-22T08:38:30.271 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.269+0000 7f20f8869640 1 -- 172.21.15.142:0/3109085313 <== osd.3 v2:172.21.15.142:6800/1064901393 32 ==== osd_op_reply(100 a_user [call,call,delete] v32'4 uv4 ondisk = 0) ==== 234+0+0 (crc 0 0 0) 0x7f20f0038020 con 0x556cf89e1d20 2024-09-22T08:38:30.271 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.269+0000 7f20fc322800 10 removing default.rgw.meta+users.uid+a_user from cache 2024-09-22T08:38:30.271 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.269+0000 7f20fc322800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.uid:a_user, ofs0, ns] 2024-09-22T08:38:30.271 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.269+0000 7f20fc322800 1 -- 172.21.15.142:0/3109085313 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:101 7.15 7:a93a5511:::notify.2:head [notify cookie 93926516230592 in=167b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556cf8a296f0 con 0x556cf89e1d20 2024-09-22T08:38:30.271 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.269+0000 7f20f8869640 1 -- 172.21.15.142:0/3109085313 <== osd.3 v2:172.21.15.142:6800/1064901393 33 ==== watch-notify(notify (1) cookie 93926515975744 notify 137438953484 ret 0) ==== 197+0+0 (crc 0 0 0) 0x556cf89fb320 con 0x556cf89e1d20 2024-09-22T08:38:30.271 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.269+0000 7f1fd6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953484 cookie 93926515975744 notifier 4863 bl.length()=155 2024-09-22T08:38:30.271 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.269+0000 7f20f8869640 1 -- 172.21.15.142:0/3109085313 <== osd.3 v2:172.21.15.142:6800/1064901393 34 ==== osd_op_reply(101 notify.2 [notify cookie 93926516230592 out=8b] v0'0 uv255 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f20f0038020 con 0x556cf89e1d20 2024-09-22T08:38:30.271 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.269+0000 7f1fd6ffd640 1 -- 172.21.15.142:0/3109085313 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:102 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f1f2c0032c0 con 0x556cf89e1d20 2024-09-22T08:38:30.271 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.269+0000 7f20f8869640 1 -- 172.21.15.142:0/3109085313 <== osd.3 v2:172.21.15.142:6800/1064901393 35 ==== osd_op_reply(102 notify.2 [notify-ack] v0'0 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20f0038020 con 0x556cf89e1d20 2024-09-22T08:38:30.271 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.269+0000 7f20f8869640 1 -- 172.21.15.142:0/3109085313 <== osd.3 v2:172.21.15.142:6800/1064901393 36 ==== watch-notify(notify_complete (2) cookie 93926516230592 notify 137438953484 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f20f0062020 con 0x556cf89e1d20 2024-09-22T08:38:30.272 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.270+0000 7f1fae7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:38:30.272 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.270+0000 7f20fc322800 1 -- 172.21.15.142:0/3109085313 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:103 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93926515991280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556cf8a292c0 con 0x556cf89dd310 2024-09-22T08:38:30.272 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.271+0000 7f20f7867640 1 -- 172.21.15.142:0/3109085313 <== osd.1 v2:172.21.15.142:6816/3192108003 28 ==== osd_op_reply(103 data_loggenerations_metadata [watch unwatch cookie 93926515991280] v32'257 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f20ec051070 con 0x556cf89dd310 2024-09-22T08:38:30.272 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.271+0000 7f20fc322800 1 -- 172.21.15.142:0/3109085313 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:104 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93926515967024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556cf89ee2c0 con 0x7f20f0045130 2024-09-22T08:38:30.273 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.272+0000 7f20f8068640 1 -- 172.21.15.142:0/3109085313 <== osd.2 v2:172.21.15.142:6808/279438927 18 ==== osd_op_reply(104 notify.0 [watch unwatch cookie 93926515967024] v32'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20e8039070 con 0x7f20f0045130 2024-09-22T08:38:30.273 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.272+0000 7f20fc322800 20 remove_watcher() i=0 2024-09-22T08:38:30.273 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.272+0000 7f20fc322800 2 removed watcher, disabling cache 2024-09-22T08:38:30.274 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.272+0000 7f20fc322800 1 -- 172.21.15.142:0/3109085313 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:105 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93926515970944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556cf89e8430 con 0x556cf89dd310 2024-09-22T08:38:30.275 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.274+0000 7f20f7867640 1 -- 172.21.15.142:0/3109085313 <== osd.1 v2:172.21.15.142:6816/3192108003 29 ==== osd_op_reply(105 notify.1 [watch unwatch cookie 93926515970944] v32'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20ec051070 con 0x556cf89dd310 2024-09-22T08:38:30.275 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.274+0000 7f20fc322800 20 remove_watcher() i=1 2024-09-22T08:38:30.275 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.274+0000 7f20fc322800 1 -- 172.21.15.142:0/3109085313 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:106 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93926515975744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556cf89e8430 con 0x556cf89e1d20 2024-09-22T08:38:30.276 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.275+0000 7f20f8869640 1 -- 172.21.15.142:0/3109085313 <== osd.3 v2:172.21.15.142:6800/1064901393 37 ==== osd_op_reply(106 notify.2 [watch unwatch cookie 93926515975744] v32'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20f0038020 con 0x556cf89e1d20 2024-09-22T08:38:30.276 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.275+0000 7f20fc322800 20 remove_watcher() i=2 2024-09-22T08:38:30.276 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.275+0000 7f20fc322800 1 -- 172.21.15.142:0/3109085313 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:107 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93926515978112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556cf89e8430 con 0x7f20f0045130 2024-09-22T08:38:30.277 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.276+0000 7f20f8068640 1 -- 172.21.15.142:0/3109085313 <== osd.2 v2:172.21.15.142:6808/279438927 19 ==== osd_op_reply(107 notify.3 [watch unwatch cookie 93926515978112] v32'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20e8039070 con 0x7f20f0045130 2024-09-22T08:38:30.277 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.276+0000 7f20fc322800 20 remove_watcher() i=3 2024-09-22T08:38:30.277 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.276+0000 7f20fc322800 1 -- 172.21.15.142:0/3109085313 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:108 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93926515972000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556cf89e8430 con 0x556cf89dd310 2024-09-22T08:38:30.280 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.279+0000 7f20f7867640 1 -- 172.21.15.142:0/3109085313 <== osd.1 v2:172.21.15.142:6816/3192108003 30 ==== osd_op_reply(108 notify.4 [watch unwatch cookie 93926515972000] v32'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20ec051070 con 0x556cf89dd310 2024-09-22T08:38:30.280 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.279+0000 7f20fc322800 20 remove_watcher() i=4 2024-09-22T08:38:30.280 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.279+0000 7f20fc322800 1 -- 172.21.15.142:0/3109085313 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:109 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93926515985024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556cf89e8430 con 0x7f20e803c040 2024-09-22T08:38:30.281 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.280+0000 7f20f7867640 1 -- 172.21.15.142:0/3109085313 <== osd.0 v2:172.21.15.31:6800/168281188 27 ==== osd_op_reply(109 notify.5 [watch unwatch cookie 93926515985024] v32'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20ec051070 con 0x7f20e803c040 2024-09-22T08:38:30.281 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.280+0000 7f20fc322800 20 remove_watcher() i=5 2024-09-22T08:38:30.281 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.280+0000 7f20fc322800 1 -- 172.21.15.142:0/3109085313 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:110 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93926515988976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556cf89e8430 con 0x7f20e803c040 2024-09-22T08:38:30.284 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.283+0000 7f20f7867640 1 -- 172.21.15.142:0/3109085313 <== osd.0 v2:172.21.15.31:6800/168281188 28 ==== osd_op_reply(110 notify.6 [watch unwatch cookie 93926515988976] v32'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20ec051070 con 0x7f20e803c040 2024-09-22T08:38:30.284 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.283+0000 7f20fc322800 20 remove_watcher() i=6 2024-09-22T08:38:30.284 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.283+0000 7f20fc322800 1 -- 172.21.15.142:0/3109085313 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:111 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93926515982528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556cf89ed9f0 con 0x7f20e803c040 2024-09-22T08:38:30.287 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.284+0000 7f20f7867640 1 -- 172.21.15.142:0/3109085313 <== osd.0 v2:172.21.15.31:6800/168281188 29 ==== osd_op_reply(111 notify.7 [watch unwatch cookie 93926515982528] v32'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20ec051070 con 0x7f20e803c040 2024-09-22T08:38:30.287 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.284+0000 7f20fc322800 20 remove_watcher() i=7 2024-09-22T08:38:30.287 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.284+0000 7f20fc322800 1 -- 172.21.15.142:0/3109085313 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f20e803c040 msgr2=0x7f20e804c580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:30.287 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.284+0000 7f20fc322800 1 --2- 172.21.15.142:0/3109085313 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f20e803c040 0x7f20e804c580 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:30.287 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.284+0000 7f20fc322800 1 -- 172.21.15.142:0/3109085313 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x556cf89dd310 msgr2=0x556cf89df7d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:30.287 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.284+0000 7f20fc322800 1 --2- 172.21.15.142:0/3109085313 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x556cf89dd310 0x556cf89df7d0 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:30.287 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.284+0000 7f20fc322800 1 -- 172.21.15.142:0/3109085313 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f20f0045130 msgr2=0x7f20f0045550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:30.288 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.284+0000 7f20fc322800 1 --2- 172.21.15.142:0/3109085313 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f20f0045130 0x7f20f0045550 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:30.288 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.284+0000 7f20fc322800 1 -- 172.21.15.142:0/3109085313 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x556cf89e1d20 msgr2=0x556cf89e4110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:30.288 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.284+0000 7f20fc322800 1 --2- 172.21.15.142:0/3109085313 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x556cf89e1d20 0x556cf89e4110 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:30.288 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.284+0000 7f20fc322800 1 -- 172.21.15.142:0/3109085313 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f1fc803d150 msgr2=0x7f1fc803f610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:30.288 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.284+0000 7f20fc322800 1 --2- 172.21.15.142:0/3109085313 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f1fc803d150 0x7f1fc803f610 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f20e8018a00 tx=0x7f20e8041000 comp rx=0 tx=0).stop 2024-09-22T08:38:30.288 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.284+0000 7f20fc322800 1 -- 172.21.15.142:0/3109085313 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556cf89ca5b0 msgr2=0x556cf89d1b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:30.288 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.284+0000 7f20f7867640 1 -- 172.21.15.142:0/3109085313 reap_dead start 2024-09-22T08:38:30.288 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.284+0000 7f20fc322800 1 --2- 172.21.15.142:0/3109085313 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556cf89ca5b0 0x556cf89d1b90 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f20f0014de0 tx=0x7f20f00548e0 comp rx=0 tx=0).stop 2024-09-22T08:38:30.288 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.284+0000 7f20fc322800 1 -- 172.21.15.142:0/3109085313 shutdown_connections 2024-09-22T08:38:30.288 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.284+0000 7f20fc322800 1 --2- 172.21.15.142:0/3109085313 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556cf89ca5b0 0x556cf89d1b90 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:30.288 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.284+0000 7f20fc322800 1 -- 172.21.15.142:0/3109085313 >> 172.21.15.142:0/3109085313 conn(0x556cf89c69b0 msgr2=0x556cf89c4bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:38:30.288 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.284+0000 7f20fc322800 1 -- 172.21.15.142:0/3109085313 shutdown_connections 2024-09-22T08:38:30.288 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.284+0000 7f20fc322800 1 -- 172.21.15.142:0/3109085313 wait complete. 2024-09-22T08:38:30.288 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.285+0000 7f20fc322800 1 -- 172.21.15.142:0/3041959728 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f1fd003cfb0 msgr2=0x7f1fd003f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:30.289 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.285+0000 7f20fc322800 1 --2- 172.21.15.142:0/3041959728 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f1fd003cfb0 0x7f1fd003f470 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f20e8053200 tx=0x7f20e801b440 comp rx=0 tx=0).stop 2024-09-22T08:38:30.289 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.285+0000 7f20fc322800 1 -- 172.21.15.142:0/3041959728 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556cf89bdb30 msgr2=0x556cf89bdf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:30.289 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.285+0000 7f20fc322800 1 --2- 172.21.15.142:0/3041959728 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556cf89bdb30 0x556cf89bdf50 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x556cf88a9bc0 tx=0x7f20f00167b0 comp rx=0 tx=0).stop 2024-09-22T08:38:30.289 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.285+0000 7f20fc322800 1 -- 172.21.15.142:0/3041959728 shutdown_connections 2024-09-22T08:38:30.289 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.285+0000 7f20fc322800 1 --2- 172.21.15.142:0/3041959728 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f1fd003cfb0 0x7f1fd003f470 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:30.289 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.285+0000 7f20fc322800 1 --2- 172.21.15.142:0/3041959728 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556cf89bdb30 0x556cf89bdf50 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:30.289 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.285+0000 7f20fc322800 1 -- 172.21.15.142:0/3041959728 >> 172.21.15.142:0/3041959728 conn(0x556cf89b1ee0 msgr2=0x556cf89b22c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:38:30.289 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.285+0000 7f20fc322800 1 -- 172.21.15.142:0/3041959728 shutdown_connections 2024-09-22T08:38:30.289 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.285+0000 7f20fc322800 1 -- 172.21.15.142:0/3041959728 wait complete. 2024-09-22T08:38:30.289 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.285+0000 7f20fc322800 1 -- 172.21.15.142:0/4148289719 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x556cf88ad9e0 msgr2=0x556cf89a9e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:30.289 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.285+0000 7f20fc322800 1 --2- 172.21.15.142:0/4148289719 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x556cf88ad9e0 0x556cf89a9e70 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:30.289 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.285+0000 7f20fc322800 1 -- 172.21.15.142:0/4148289719 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x556cf89ac700 msgr2=0x556cf89aeaf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:30.289 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.285+0000 7f20fc322800 1 --2- 172.21.15.142:0/4148289719 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x556cf89ac700 0x556cf89aeaf0 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:30.289 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.285+0000 7f20fc322800 1 -- 172.21.15.142:0/4148289719 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f1fe003d1a0 msgr2=0x7f1fe003f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:30.290 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.285+0000 7f20fc322800 1 --2- 172.21.15.142:0/4148289719 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f1fe003d1a0 0x7f1fe003f660 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f20ec057000 tx=0x7f20ec052000 comp rx=0 tx=0).stop 2024-09-22T08:38:30.290 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.285+0000 7f20fc322800 1 -- 172.21.15.142:0/4148289719 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556cf88a7a90 msgr2=0x556cf88aa020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:30.290 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.285+0000 7f20fc322800 1 --2- 172.21.15.142:0/4148289719 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556cf88a7a90 0x556cf88aa020 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f20e80012f0 tx=0x7f20e8000ed0 comp rx=0 tx=0).stop 2024-09-22T08:38:30.290 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.285+0000 7f20fc322800 1 -- 172.21.15.142:0/4148289719 shutdown_connections 2024-09-22T08:38:30.290 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.285+0000 7f20fc322800 1 --2- 172.21.15.142:0/4148289719 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x556cf89ac700 0x556cf89aeaf0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:30.290 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.285+0000 7f20fc322800 1 --2- 172.21.15.142:0/4148289719 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x556cf88ad9e0 0x556cf89a9e70 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:30.290 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.285+0000 7f20fc322800 1 --2- 172.21.15.142:0/4148289719 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f1fe003d1a0 0x7f1fe003f660 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:30.290 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.285+0000 7f20fc322800 1 --2- 172.21.15.142:0/4148289719 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556cf88a7a90 0x556cf88aa020 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:30.290 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.285+0000 7f20fc322800 1 -- 172.21.15.142:0/4148289719 >> 172.21.15.142:0/4148289719 conn(0x556cf88a3310 msgr2=0x556cf899a360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:38:30.290 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.285+0000 7f20fc322800 1 -- 172.21.15.142:0/4148289719 shutdown_connections 2024-09-22T08:38:30.290 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.285+0000 7f20fc322800 1 -- 172.21.15.142:0/4148289719 wait complete. 2024-09-22T08:38:30.295 ERROR:root:None 2024-09-22T08:38:30.295 ERROR:root:0 2024-09-22T08:38:30.295 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=read'] 2024-09-22T08:38:30.295 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=read'] 2024-09-22T08:38:30.295 DEBUG:teuthology.orchestra.run.smithi142:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps user-info-without-keys=read 2024-09-22T08:38:30.342 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:38:30.342 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:38:30.342 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.341+0000 7fb67a12f800 1 Processor -- start 2024-09-22T08:38:30.343 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.341+0000 7fb67a12f800 1 -- start start 2024-09-22T08:38:30.343 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.341+0000 7fb67a12f800 1 --2- >> v2:172.21.15.31:3300/0 conn(0x561ccf11b060 0x561ccf11d450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:30.343 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.341+0000 7fb67a12f800 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x561ccefa5a20 con 0x561ccf11d990 2024-09-22T08:38:30.343 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.341+0000 7fb67a12f800 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x561ccefa57d0 con 0x561ccf11b060 2024-09-22T08:38:30.343 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.342+0000 7fb675e76640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x561ccf11b060 0x561ccf11d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:30.344 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.342+0000 7fb675675640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x561ccf11d990 0x561ccf11fd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.142:50494/0 (socket says 172.21.15.142:50494) 2024-09-22T08:38:30.344 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.342+0000 7fb675675640 1 -- 172.21.15.142:0/2169801161 learned_addr learned my addr 172.21.15.142:0/2169801161 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-09-22T08:38:30.344 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.342+0000 7fb675e76640 1 -- 172.21.15.142:0/2169801161 >> v1:172.21.15.31:6789/0 conn(0x561ccf11d990 legacy=0x561ccf11fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:30.344 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.342+0000 7fb675e76640 1 -- 172.21.15.142:0/2169801161 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x561ccf122540 con 0x561ccf11b060 2024-09-22T08:38:30.345 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.344+0000 7fb675e76640 1 --2- 172.21.15.142:0/2169801161 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561ccf11b060 0x561ccf11d450 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fb668005fd0 tx=0x7fb668045c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b085a2bae8e97d50 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:30.346 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.344+0000 7fb674e74640 1 -- 172.21.15.142:0/2169801161 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb668058530 con 0x561ccf11b060 2024-09-22T08:38:30.346 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.344+0000 7fb674e74640 1 -- 172.21.15.142:0/2169801161 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6680586d0 con 0x561ccf11b060 2024-09-22T08:38:30.346 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.344+0000 7fb674e74640 1 -- 172.21.15.142:0/2169801161 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb6680589d0 con 0x561ccf11b060 2024-09-22T08:38:30.346 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.345+0000 7fb67a12f800 1 -- 172.21.15.142:0/2169801161 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561ccf11b060 msgr2=0x561ccf11d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:30.346 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.345+0000 7fb67a12f800 1 --2- 172.21.15.142:0/2169801161 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561ccf11b060 0x561ccf11d450 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fb668005fd0 tx=0x7fb668045c30 comp rx=0 tx=0).stop 2024-09-22T08:38:30.346 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.345+0000 7fb67a12f800 1 -- 172.21.15.142:0/2169801161 shutdown_connections 2024-09-22T08:38:30.346 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.345+0000 7fb67a12f800 1 --2- 172.21.15.142:0/2169801161 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561ccf11b060 0x561ccf11d450 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:30.347 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.345+0000 7fb67a12f800 1 -- 172.21.15.142:0/2169801161 >> 172.21.15.142:0/2169801161 conn(0x561ccf114ba0 msgr2=0x561ccf117000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:38:30.347 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.345+0000 7fb67a12f800 1 -- 172.21.15.142:0/2169801161 shutdown_connections 2024-09-22T08:38:30.347 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.345+0000 7fb67a12f800 1 -- 172.21.15.142:0/2169801161 wait complete. 2024-09-22T08:38:30.360 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.359+0000 7fb67a12f800 1 Processor -- start 2024-09-22T08:38:30.360 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.359+0000 7fb67a12f800 1 -- start start 2024-09-22T08:38:30.361 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.359+0000 7fb67a12f800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561ccf11b060 0x561ccf20a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:30.361 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.359+0000 7fb67a12f800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x561ccefb2dd0 con 0x561ccf11b060 2024-09-22T08:38:30.361 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.359+0000 7fb675e76640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561ccf11b060 0x561ccf20a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:30.361 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.359+0000 7fb675e76640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561ccf11b060 0x561ccf20a0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:51922/0 (socket says 172.21.15.142:51922) 2024-09-22T08:38:30.361 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.359+0000 7fb675e76640 1 -- 172.21.15.142:0/3910451950 learned_addr learned my addr 172.21.15.142:0/3910451950 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:38:30.362 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.360+0000 7fb675e76640 1 -- 172.21.15.142:0/3910451950 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561ccf20a690 con 0x561ccf11b060 2024-09-22T08:38:30.362 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.360+0000 7fb675e76640 1 --2- 172.21.15.142:0/3910451950 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561ccf11b060 0x561ccf20a0a0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fb668025a60 tx=0x7fb668051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d01e7ac641a676d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:30.362 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.360+0000 7fb563e07640 1 -- 172.21.15.142:0/3910451950 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb668058a30 con 0x561ccf11b060 2024-09-22T08:38:30.362 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.360+0000 7fb563e07640 1 -- 172.21.15.142:0/3910451950 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb668068070 con 0x561ccf11b060 2024-09-22T08:38:30.362 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.360+0000 7fb563e07640 1 -- 172.21.15.142:0/3910451950 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb668058d00 con 0x561ccf11b060 2024-09-22T08:38:30.364 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.361+0000 7fb67a12f800 1 -- 172.21.15.142:0/3910451950 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561ccf11b060 msgr2=0x561ccf20a0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:30.364 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.361+0000 7fb67a12f800 1 --2- 172.21.15.142:0/3910451950 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561ccf11b060 0x561ccf20a0a0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fb668025a60 tx=0x7fb668051000 comp rx=0 tx=0).stop 2024-09-22T08:38:30.364 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.361+0000 7fb67a12f800 1 -- 172.21.15.142:0/3910451950 shutdown_connections 2024-09-22T08:38:30.364 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.361+0000 7fb67a12f800 1 --2- 172.21.15.142:0/3910451950 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561ccf11b060 0x561ccf20a0a0 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:30.364 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.361+0000 7fb67a12f800 1 -- 172.21.15.142:0/3910451950 >> 172.21.15.142:0/3910451950 conn(0x561ccf114ba0 msgr2=0x561ccf205a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:38:30.364 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.361+0000 7fb67a12f800 1 -- 172.21.15.142:0/3910451950 shutdown_connections 2024-09-22T08:38:30.364 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.361+0000 7fb67a12f800 1 -- 172.21.15.142:0/3910451950 wait complete. 2024-09-22T08:38:30.364 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.361+0000 7fb67a12f800 1 Processor -- start 2024-09-22T08:38:30.364 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.361+0000 7fb67a12f800 1 -- start start 2024-09-22T08:38:30.364 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.362+0000 7fb67a12f800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561ccf11b060 0x561ccf11a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:30.365 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.362+0000 7fb67a12f800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x561ccf121830 con 0x561ccf11b060 2024-09-22T08:38:30.365 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.362+0000 7fb675e76640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561ccf11b060 0x561ccf11a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:30.365 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.362+0000 7fb675e76640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561ccf11b060 0x561ccf11a780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:51926/0 (socket says 172.21.15.142:51926) 2024-09-22T08:38:30.365 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.362+0000 7fb675e76640 1 -- 172.21.15.142:0/2831905401 learned_addr learned my addr 172.21.15.142:0/2831905401 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:38:30.365 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.362+0000 7fb675e76640 1 -- 172.21.15.142:0/2831905401 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561ccf11ace0 con 0x561ccf11b060 2024-09-22T08:38:30.365 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.362+0000 7fb675e76640 1 --2- 172.21.15.142:0/2831905401 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561ccf11b060 0x561ccf11a780 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fb668025a60 tx=0x7fb668003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:30.365 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.362+0000 7fb562604640 1 -- 172.21.15.142:0/2831905401 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb668063650 con 0x561ccf11b060 2024-09-22T08:38:30.365 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.362+0000 7fb562604640 1 -- 172.21.15.142:0/2831905401 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6680637f0 con 0x561ccf11b060 2024-09-22T08:38:30.365 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.362+0000 7fb67a12f800 1 -- 172.21.15.142:0/2831905401 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561ccf119090 con 0x561ccf11b060 2024-09-22T08:38:30.365 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.363+0000 7fb562604640 1 -- 172.21.15.142:0/2831905401 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb668063b10 con 0x561ccf11b060 2024-09-22T08:38:30.365 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.363+0000 7fb67a12f800 1 -- 172.21.15.142:0/2831905401 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561ccf119590 con 0x561ccf11b060 2024-09-22T08:38:30.368 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.363+0000 7fb562604640 1 -- 172.21.15.142:0/2831905401 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fb668075020 con 0x561ccf11b060 2024-09-22T08:38:30.368 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.364+0000 7fb562604640 1 --2- 172.21.15.142:0/2831905401 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fb55c03d000 0x7fb55c03f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:30.368 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.364+0000 7fb562604640 1 -- 172.21.15.142:0/2831905401 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5938+0+0 (secure 0 0 0) 0x7fb6680987e0 con 0x561ccf11b060 2024-09-22T08:38:30.368 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.364+0000 7fb675675640 1 --2- 172.21.15.142:0/2831905401 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fb55c03d000 0x7fb55c03f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:30.368 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.364+0000 7fb67a12f800 1 --2- 172.21.15.142:0/2831905401 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x561ccf11d990 0x561ccf21af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:30.368 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.364+0000 7fb67a12f800 1 -- 172.21.15.142:0/2831905401 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561ccf21b490 con 0x561ccf11d990 2024-09-22T08:38:30.368 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.364+0000 7fb676677640 1 --2- 172.21.15.142:0/2831905401 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x561ccf11d990 0x561ccf21af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:30.368 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.364+0000 7fb675675640 1 --2- 172.21.15.142:0/2831905401 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fb55c03d000 0x7fb55c03f4c0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fb660001d70 tx=0x7fb6600012d0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:30.368 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.364+0000 7fb676677640 1 --2- 172.21.15.142:0/2831905401 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x561ccf11d990 0x561ccf21af50 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:30.369 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.364+0000 7fb676677640 1 -- 172.21.15.142:0/2831905401 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb6700083e0 con 0x561ccf11d990 2024-09-22T08:38:30.369 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.364+0000 7fb67a12f800 1 -- 172.21.15.142:0/2831905401 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561ccf119b40 con 0x561ccf11d990 2024-09-22T08:38:30.369 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.365+0000 7fb676677640 1 -- 172.21.15.142:0/2831905401 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb6700083e0 con 0x561ccf11d990 2024-09-22T08:38:30.369 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.365+0000 7fb67a12f800 1 --2- 172.21.15.142:0/2831905401 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x561ccf21d750 0x561ccf21fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:30.369 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.365+0000 7fb67a12f800 1 -- 172.21.15.142:0/2831905401 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:3 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561ccf220210 con 0x561ccf21d750 2024-09-22T08:38:30.369 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.365+0000 7fb675e76640 1 --2- 172.21.15.142:0/2831905401 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x561ccf21d750 0x561ccf21fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:30.369 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.365+0000 7fb675e76640 1 --2- 172.21.15.142:0/2831905401 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x561ccf21d750 0x561ccf21fb40 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:30.369 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.365+0000 7fb675e76640 1 -- 172.21.15.142:0/2831905401 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(3 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fb668077930 con 0x561ccf21d750 2024-09-22T08:38:30.369 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.366+0000 7fb67a12f800 1 -- 172.21.15.142:0/2831905401 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561ccf21c620 con 0x561ccf11d990 2024-09-22T08:38:30.369 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.366+0000 7fb676677640 1 -- 172.21.15.142:0/2831905401 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb6700083e0 con 0x561ccf11d990 2024-09-22T08:38:30.369 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.366+0000 7fb67a12f800 1 -- 172.21.15.142:0/2831905401 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561ccf21ca80 con 0x561ccf21d750 2024-09-22T08:38:30.369 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.366+0000 7fb675e76640 1 -- 172.21.15.142:0/2831905401 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(5 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fb668077930 con 0x561ccf21d750 2024-09-22T08:38:30.369 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.366+0000 7fb67a12f800 1 Processor -- start 2024-09-22T08:38:30.370 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.366+0000 7fb67a12f800 1 -- start start 2024-09-22T08:38:30.370 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.367+0000 7fb67a12f800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561ccf22eb60 0x561ccf22ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:30.370 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.367+0000 7fb67a12f800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x561ccf011d50 con 0x561ccf22eb60 2024-09-22T08:38:30.370 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.367+0000 7fb676677640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561ccf22eb60 0x561ccf22ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:30.370 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.367+0000 7fb676677640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561ccf22eb60 0x561ccf22ef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:51938/0 (socket says 172.21.15.142:51938) 2024-09-22T08:38:30.370 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.367+0000 7fb676677640 1 -- 172.21.15.142:0/1319370882 learned_addr learned my addr 172.21.15.142:0/1319370882 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:38:30.374 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.367+0000 7fb676677640 1 -- 172.21.15.142:0/1319370882 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561ccf22f5c0 con 0x561ccf22eb60 2024-09-22T08:38:30.374 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.367+0000 7fb676677640 1 --2- 172.21.15.142:0/1319370882 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561ccf22eb60 0x561ccf22ef80 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x561ccf119a70 tx=0x7fb67000af20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:30.374 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.368+0000 7fb55b7fe640 1 -- 172.21.15.142:0/1319370882 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb670007cf0 con 0x561ccf22eb60 2024-09-22T08:38:30.374 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.368+0000 7fb55b7fe640 1 -- 172.21.15.142:0/1319370882 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb67001e070 con 0x561ccf22eb60 2024-09-22T08:38:30.374 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.368+0000 7fb67a12f800 1 -- 172.21.15.142:0/1319370882 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561ccf22fdf0 con 0x561ccf22eb60 2024-09-22T08:38:30.374 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.368+0000 7fb55b7fe640 1 -- 172.21.15.142:0/1319370882 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb670019450 con 0x561ccf22eb60 2024-09-22T08:38:30.374 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.368+0000 7fb67a12f800 1 -- 172.21.15.142:0/1319370882 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561ccf230390 con 0x561ccf22eb60 2024-09-22T08:38:30.374 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.368+0000 7fb55b7fe640 1 -- 172.21.15.142:0/1319370882 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fb670016050 con 0x561ccf22eb60 2024-09-22T08:38:30.374 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.369+0000 7fb55b7fe640 1 --2- 172.21.15.142:0/1319370882 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fb55003cfb0 0x7fb55003f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:30.374 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.369+0000 7fb55b7fe640 1 -- 172.21.15.142:0/1319370882 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5938+0+0 (secure 0 0 0) 0x7fb670055b00 con 0x561ccf22eb60 2024-09-22T08:38:30.375 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.369+0000 7fb675e76640 1 --2- 172.21.15.142:0/1319370882 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fb55003cfb0 0x7fb55003f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:30.375 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.369+0000 7fb67a12f800 1 Processor -- start 2024-09-22T08:38:30.375 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.369+0000 7fb675e76640 1 --2- 172.21.15.142:0/1319370882 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fb55003cfb0 0x7fb55003f470 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fb66806b760 tx=0x7fb668002170 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:30.375 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.369+0000 7fb67a12f800 1 -- start start 2024-09-22T08:38:30.375 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.369+0000 7fb67a12f800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561ccf23b680 0x561ccf23ba80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:30.375 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.369+0000 7fb67a12f800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x561ccf20aa00 con 0x561ccf23b680 2024-09-22T08:38:30.375 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.369+0000 7fb676677640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561ccf23b680 0x561ccf23ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:30.375 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.369+0000 7fb676677640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561ccf23b680 0x561ccf23ba80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:51944/0 (socket says 172.21.15.142:51944) 2024-09-22T08:38:30.375 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.369+0000 7fb676677640 1 -- 172.21.15.142:0/2286549301 learned_addr learned my addr 172.21.15.142:0/2286549301 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:38:30.375 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.370+0000 7fb676677640 1 -- 172.21.15.142:0/2286549301 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561ccf23c070 con 0x561ccf23b680 2024-09-22T08:38:30.375 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.370+0000 7fb676677640 1 --2- 172.21.15.142:0/2286549301 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561ccf23b680 0x561ccf23ba80 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fb670008940 tx=0x7fb670018f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ceff2cf869c98e26 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:30.375 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.370+0000 7fb5597fa640 1 -- 172.21.15.142:0/2286549301 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb670023670 con 0x561ccf23b680 2024-09-22T08:38:30.375 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.370+0000 7fb5597fa640 1 -- 172.21.15.142:0/2286549301 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb670051030 con 0x561ccf23b680 2024-09-22T08:38:30.376 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.370+0000 7fb5597fa640 1 -- 172.21.15.142:0/2286549301 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb670017a50 con 0x561ccf23b680 2024-09-22T08:38:30.376 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.370+0000 7fb67a12f800 1 -- 172.21.15.142:0/2286549301 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561ccf23b680 msgr2=0x561ccf23ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:30.376 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.370+0000 7fb67a12f800 1 --2- 172.21.15.142:0/2286549301 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561ccf23b680 0x561ccf23ba80 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fb670008940 tx=0x7fb670018f90 comp rx=0 tx=0).stop 2024-09-22T08:38:30.376 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.370+0000 7fb67a12f800 1 -- 172.21.15.142:0/2286549301 shutdown_connections 2024-09-22T08:38:30.376 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.370+0000 7fb67a12f800 1 --2- 172.21.15.142:0/2286549301 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561ccf23b680 0x561ccf23ba80 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:30.376 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.370+0000 7fb67a12f800 1 -- 172.21.15.142:0/2286549301 >> 172.21.15.142:0/2286549301 conn(0x561ccf237a80 msgr2=0x561ccf235cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:38:30.376 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.370+0000 7fb67a12f800 1 -- 172.21.15.142:0/2286549301 shutdown_connections 2024-09-22T08:38:30.376 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.371+0000 7fb67a12f800 1 -- 172.21.15.142:0/2286549301 wait complete. 2024-09-22T08:38:30.376 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.371+0000 7fb67a12f800 1 Processor -- start 2024-09-22T08:38:30.376 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.371+0000 7fb67a12f800 1 -- start start 2024-09-22T08:38:30.376 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.371+0000 7fb67a12f800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561ccf23b680 0x561ccf242c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:30.376 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.371+0000 7fb67a12f800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x561ccf23c690 con 0x561ccf23b680 2024-09-22T08:38:30.376 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.371+0000 7fb676677640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561ccf23b680 0x561ccf242c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:30.376 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.371+0000 7fb676677640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561ccf23b680 0x561ccf242c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:51946/0 (socket says 172.21.15.142:51946) 2024-09-22T08:38:30.377 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.371+0000 7fb676677640 1 -- 172.21.15.142:0/3834809592 learned_addr learned my addr 172.21.15.142:0/3834809592 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:38:30.377 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.371+0000 7fb676677640 1 -- 172.21.15.142:0/3834809592 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561ccf2431d0 con 0x561ccf23b680 2024-09-22T08:38:30.377 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.372+0000 7fb676677640 1 --2- 172.21.15.142:0/3834809592 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561ccf23b680 0x561ccf242c70 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fb670008940 tx=0x7fb670053e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:30.377 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.372+0000 7fb5477fe640 1 -- 172.21.15.142:0/3834809592 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb670032070 con 0x561ccf23b680 2024-09-22T08:38:30.377 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.372+0000 7fb5477fe640 1 -- 172.21.15.142:0/3834809592 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb670017550 con 0x561ccf23b680 2024-09-22T08:38:30.377 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.372+0000 7fb67a12f800 1 -- 172.21.15.142:0/3834809592 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561ccf243460 con 0x561ccf23b680 2024-09-22T08:38:30.377 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.372+0000 7fb5477fe640 1 -- 172.21.15.142:0/3834809592 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb670017830 con 0x561ccf23b680 2024-09-22T08:38:30.377 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.372+0000 7fb67a12f800 1 -- 172.21.15.142:0/3834809592 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561ccf243de0 con 0x561ccf23b680 2024-09-22T08:38:30.377 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.373+0000 7fb5477fe640 1 -- 172.21.15.142:0/3834809592 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fb670035070 con 0x561ccf23b680 2024-09-22T08:38:30.389 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.373+0000 7fb5477fe640 1 --2- 172.21.15.142:0/3834809592 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fb54003cfb0 0x7fb54003f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:30.389 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.373+0000 7fb5477fe640 1 -- 172.21.15.142:0/3834809592 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5938+0+0 (secure 0 0 0) 0x7fb670038bf0 con 0x561ccf23b680 2024-09-22T08:38:30.389 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.373+0000 7fb675e76640 1 --2- 172.21.15.142:0/3834809592 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fb54003cfb0 0x7fb54003f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:30.389 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.373+0000 7fb675e76640 1 --2- 172.21.15.142:0/3834809592 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fb54003cfb0 0x7fb54003f470 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x561ccf21b8a0 tx=0x7fb668091000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:30.389 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.374+0000 7fb67a12f800 20 rados->read ofs=0 len=0 2024-09-22T08:38:30.389 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.374+0000 7fb67a12f800 1 --2- 172.21.15.142:0/3834809592 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x561ccf24e540 0x561ccf250a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:30.389 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.374+0000 7fb67a12f800 1 -- 172.21.15.142:0/3834809592 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561ccf251150 con 0x561ccf24e540 2024-09-22T08:38:30.389 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.374+0000 7fb675675640 1 --2- 172.21.15.142:0/3834809592 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x561ccf24e540 0x561ccf250a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:30.389 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.374+0000 7fb675675640 1 --2- 172.21.15.142:0/3834809592 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x561ccf24e540 0x561ccf250a00 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:30.389 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.374+0000 7fb675675640 1 -- 172.21.15.142:0/3834809592 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb660009050 con 0x561ccf24e540 2024-09-22T08:38:30.389 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.374+0000 7fb67a12f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:30.389 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.374+0000 7fb67a12f800 20 realm 2024-09-22T08:38:30.390 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.374+0000 7fb67a12f800 20 rados->read ofs=0 len=0 2024-09-22T08:38:30.390 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.374+0000 7fb67a12f800 1 -- 172.21.15.142:0/3834809592 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561ccf24d890 con 0x561ccf24e540 2024-09-22T08:38:30.390 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.374+0000 7fb675675640 1 -- 172.21.15.142:0/3834809592 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb660009050 con 0x561ccf24e540 2024-09-22T08:38:30.390 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.374+0000 7fb67a12f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:30.390 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.374+0000 7fb67a12f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:38:30.390 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.374+0000 7fb67a12f800 20 rados->read ofs=0 len=0 2024-09-22T08:38:30.390 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.374+0000 7fb67a12f800 1 -- 172.21.15.142:0/3834809592 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561ccf251c40 con 0x561ccf24e540 2024-09-22T08:38:30.390 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.375+0000 7fb675675640 1 -- 172.21.15.142:0/3834809592 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb660009050 con 0x561ccf24e540 2024-09-22T08:38:30.390 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.375+0000 7fb67a12f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:30.390 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.375+0000 7fb67a12f800 20 rados->read ofs=0 len=0 2024-09-22T08:38:30.390 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.375+0000 7fb67a12f800 1 -- 172.21.15.142:0/3834809592 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561ccf252510 con 0x561ccf24e540 2024-09-22T08:38:30.390 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.375+0000 7fb675675640 1 -- 172.21.15.142:0/3834809592 <== osd.1 v2:172.21.15.142:6816/3192108003 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb660009050 con 0x561ccf24e540 2024-09-22T08:38:30.391 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.375+0000 7fb67a12f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:38:30.391 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.375+0000 7fb67a12f800 20 rados->read ofs=0 len=0 2024-09-22T08:38:30.391 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.375+0000 7fb67a12f800 1 --2- 172.21.15.142:0/3834809592 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x561ccf252f30 0x561ccf255320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:30.391 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.375+0000 7fb67a12f800 1 -- 172.21.15.142:0/3834809592 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561ccf255a60 con 0x561ccf252f30 2024-09-22T08:38:30.391 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.375+0000 7fb676677640 1 --2- 172.21.15.142:0/3834809592 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x561ccf252f30 0x561ccf255320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:30.391 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.375+0000 7fb676677640 1 --2- 172.21.15.142:0/3834809592 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x561ccf252f30 0x561ccf255320 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:30.391 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.375+0000 7fb676677640 1 -- 172.21.15.142:0/3834809592 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(5 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fb67003e070 con 0x561ccf252f30 2024-09-22T08:38:30.391 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.375+0000 7fb67a12f800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:38:30.391 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.375+0000 7fb67a12f800 20 searching for the correct realm 2024-09-22T08:38:30.391 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.376+0000 7fb67a12f800 1 -- 172.21.15.142:0/3834809592 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561ccf257390 con 0x561ccf252f30 2024-09-22T08:38:30.391 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.376+0000 7fb676677640 1 -- 172.21.15.142:0/3834809592 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb67003e070 con 0x561ccf252f30 2024-09-22T08:38:30.391 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.376+0000 7fb676677640 1 --2- 172.21.15.142:0/3834809592 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7fb670037070 0x7fb6700199f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:30.391 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.376+0000 7fb676677640 1 -- 172.21.15.142:0/3834809592 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561ccf257390 con 0x7fb670037070 2024-09-22T08:38:30.391 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.376+0000 7fb675e76640 1 --2- 172.21.15.142:0/3834809592 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7fb670037070 0x7fb6700199f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:30.392 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.376+0000 7fb675e76640 1 --2- 172.21.15.142:0/3834809592 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7fb670037070 0x7fb6700199f0 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:30.392 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.376+0000 7fb675e76640 1 -- 172.21.15.142:0/3834809592 <== osd.2 v2:172.21.15.142:6808/279438927 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb668089050 con 0x7fb670037070 2024-09-22T08:38:30.392 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.376+0000 7fb675e76640 1 --2- 172.21.15.142:0/3834809592 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7fb6680951a0 0x7fb6680865f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:30.392 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.376+0000 7fb675e76640 1 -- 172.21.15.142:0/3834809592 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561ccf257390 con 0x7fb6680951a0 2024-09-22T08:38:30.392 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.377+0000 7fb675675640 1 --2- 172.21.15.142:0/3834809592 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7fb6680951a0 0x7fb6680865f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:30.392 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.377+0000 7fb675675640 1 --2- 172.21.15.142:0/3834809592 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7fb6680951a0 0x7fb6680865f0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:30.392 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.377+0000 7fb675675640 1 -- 172.21.15.142:0/3834809592 <== osd.0 v2:172.21.15.31:6800/168281188 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb660009050 con 0x7fb6680951a0 2024-09-22T08:38:30.392 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.377+0000 7fb675675640 1 -- 172.21.15.142:0/3834809592 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561ccf257390 con 0x561ccf24e540 2024-09-22T08:38:30.392 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.378+0000 7fb675675640 1 -- 172.21.15.142:0/3834809592 <== osd.1 v2:172.21.15.142:6816/3192108003 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb660009050 con 0x561ccf24e540 2024-09-22T08:38:30.392 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.378+0000 7fb675675640 1 -- 172.21.15.142:0/3834809592 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561ccf257390 con 0x561ccf24e540 2024-09-22T08:38:30.392 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.378+0000 7fb675675640 1 -- 172.21.15.142:0/3834809592 <== osd.1 v2:172.21.15.142:6816/3192108003 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb660029040 con 0x561ccf24e540 2024-09-22T08:38:30.392 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.378+0000 7fb675675640 1 -- 172.21.15.142:0/3834809592 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561ccf257390 con 0x561ccf24e540 2024-09-22T08:38:30.392 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.378+0000 7fb675675640 1 -- 172.21.15.142:0/3834809592 <== osd.1 v2:172.21.15.142:6816/3192108003 7 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb660029040 con 0x561ccf24e540 2024-09-22T08:38:30.393 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.378+0000 7fb675675640 1 -- 172.21.15.142:0/3834809592 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561ccf257390 con 0x7fb6680951a0 2024-09-22T08:38:30.393 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.378+0000 7fb675675640 1 -- 172.21.15.142:0/3834809592 <== osd.0 v2:172.21.15.31:6800/168281188 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb660029040 con 0x7fb6680951a0 2024-09-22T08:38:30.393 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.378+0000 7fb675675640 1 -- 172.21.15.142:0/3834809592 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561ccf257390 con 0x7fb670037070 2024-09-22T08:38:30.393 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.378+0000 7fb675e76640 1 -- 172.21.15.142:0/3834809592 <== osd.2 v2:172.21.15.142:6808/279438927 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb668089050 con 0x7fb670037070 2024-09-22T08:38:30.393 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.379+0000 7fb675e76640 1 -- 172.21.15.142:0/3834809592 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561ccf257390 con 0x561ccf252f30 2024-09-22T08:38:30.393 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.379+0000 7fb676677640 1 -- 172.21.15.142:0/3834809592 <== osd.3 v2:172.21.15.142:6800/1064901393 3 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb67003e070 con 0x561ccf252f30 2024-09-22T08:38:30.393 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.379+0000 7fb676677640 1 -- 172.21.15.142:0/3834809592 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561ccf257390 con 0x561ccf24e540 2024-09-22T08:38:30.393 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.379+0000 7fb675675640 1 -- 172.21.15.142:0/3834809592 <== osd.1 v2:172.21.15.142:6816/3192108003 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb660029040 con 0x561ccf24e540 2024-09-22T08:38:30.393 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.379+0000 7fb675675640 1 -- 172.21.15.142:0/3834809592 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561ccf257390 con 0x7fb6680951a0 2024-09-22T08:38:30.393 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.379+0000 7fb675675640 1 -- 172.21.15.142:0/3834809592 <== osd.0 v2:172.21.15.31:6800/168281188 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb660029040 con 0x7fb6680951a0 2024-09-22T08:38:30.393 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.379+0000 7fb675675640 1 -- 172.21.15.142:0/3834809592 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561ccf257390 con 0x561ccf24e540 2024-09-22T08:38:30.393 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.379+0000 7fb675675640 1 -- 172.21.15.142:0/3834809592 <== osd.1 v2:172.21.15.142:6816/3192108003 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb660029040 con 0x561ccf24e540 2024-09-22T08:38:30.393 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.379+0000 7fb675675640 1 -- 172.21.15.142:0/3834809592 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561ccf257390 con 0x7fb670037070 2024-09-22T08:38:30.394 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.380+0000 7fb675e76640 1 -- 172.21.15.142:0/3834809592 <== osd.2 v2:172.21.15.142:6808/279438927 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fb668089050 con 0x7fb670037070 2024-09-22T08:38:30.394 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.380+0000 7fb675e76640 1 -- 172.21.15.142:0/3834809592 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561ccf257390 con 0x561ccf252f30 2024-09-22T08:38:30.394 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.380+0000 7fb676677640 1 -- 172.21.15.142:0/3834809592 <== osd.3 v2:172.21.15.142:6800/1064901393 4 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb67003e070 con 0x561ccf252f30 2024-09-22T08:38:30.394 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.380+0000 7fb676677640 1 -- 172.21.15.142:0/3834809592 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561ccf257390 con 0x561ccf252f30 2024-09-22T08:38:30.394 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.380+0000 7fb676677640 1 -- 172.21.15.142:0/3834809592 <== osd.3 v2:172.21.15.142:6800/1064901393 5 ==== osd_op_reply(20 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fb67003e070 con 0x561ccf252f30 2024-09-22T08:38:30.394 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.380+0000 7fb676677640 1 -- 172.21.15.142:0/3834809592 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561ccf257390 con 0x7fb6680951a0 2024-09-22T08:38:30.394 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.380+0000 7fb675675640 1 -- 172.21.15.142:0/3834809592 <== osd.0 v2:172.21.15.31:6800/168281188 4 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb660029040 con 0x7fb6680951a0 2024-09-22T08:38:30.394 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.380+0000 7fb675675640 1 -- 172.21.15.142:0/3834809592 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561ccf257390 con 0x561ccf252f30 2024-09-22T08:38:30.394 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.381+0000 7fb676677640 1 -- 172.21.15.142:0/3834809592 <== osd.3 v2:172.21.15.142:6800/1064901393 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb67003e070 con 0x561ccf252f30 2024-09-22T08:38:30.394 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.381+0000 7fb676677640 1 -- 172.21.15.142:0/3834809592 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561ccf257390 con 0x561ccf252f30 2024-09-22T08:38:30.394 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.381+0000 7fb676677640 1 -- 172.21.15.142:0/3834809592 <== osd.3 v2:172.21.15.142:6800/1064901393 7 ==== osd_op_reply(23 [pgnls start_epoch 32 out=107b] v32'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fb67003e070 con 0x561ccf252f30 2024-09-22T08:38:30.394 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.381+0000 7fb676677640 1 -- 172.21.15.142:0/3834809592 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561ccf257390 con 0x561ccf24e540 2024-09-22T08:38:30.394 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.381+0000 7fb675675640 1 -- 172.21.15.142:0/3834809592 <== osd.1 v2:172.21.15.142:6816/3192108003 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb660029040 con 0x561ccf24e540 2024-09-22T08:38:30.395 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.381+0000 7fb675675640 1 -- 172.21.15.142:0/3834809592 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561ccf257390 con 0x561ccf24e540 2024-09-22T08:38:30.395 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.381+0000 7fb675675640 1 -- 172.21.15.142:0/3834809592 <== osd.1 v2:172.21.15.142:6816/3192108003 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v32'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fb660029040 con 0x561ccf24e540 2024-09-22T08:38:30.395 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.381+0000 7fb675675640 1 -- 172.21.15.142:0/3834809592 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561ccf257390 con 0x7fb6680951a0 2024-09-22T08:38:30.395 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.382+0000 7fb675675640 1 -- 172.21.15.142:0/3834809592 <== osd.0 v2:172.21.15.31:6800/168281188 5 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb660029040 con 0x7fb6680951a0 2024-09-22T08:38:30.395 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.382+0000 7fb675675640 1 -- 172.21.15.142:0/3834809592 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561ccf257390 con 0x561ccf252f30 2024-09-22T08:38:30.395 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.382+0000 7fb676677640 1 -- 172.21.15.142:0/3834809592 <== osd.3 v2:172.21.15.142:6800/1064901393 8 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb67003e070 con 0x561ccf252f30 2024-09-22T08:38:30.395 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.382+0000 7fb676677640 1 -- 172.21.15.142:0/3834809592 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561ccf257390 con 0x7fb670037070 2024-09-22T08:38:30.395 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.382+0000 7fb675e76640 1 -- 172.21.15.142:0/3834809592 <== osd.2 v2:172.21.15.142:6808/279438927 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb668089050 con 0x7fb670037070 2024-09-22T08:38:30.395 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.382+0000 7fb675e76640 1 -- 172.21.15.142:0/3834809592 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561ccf257390 con 0x561ccf24e540 2024-09-22T08:38:30.395 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.382+0000 7fb675675640 1 -- 172.21.15.142:0/3834809592 <== osd.1 v2:172.21.15.142:6816/3192108003 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb660029040 con 0x561ccf24e540 2024-09-22T08:38:30.395 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.382+0000 7fb675675640 1 -- 172.21.15.142:0/3834809592 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561ccf257390 con 0x7fb6680951a0 2024-09-22T08:38:30.395 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.382+0000 7fb675675640 1 -- 172.21.15.142:0/3834809592 <== osd.0 v2:172.21.15.31:6800/168281188 6 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb660029040 con 0x7fb6680951a0 2024-09-22T08:38:30.395 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.383+0000 7fb675675640 1 -- 172.21.15.142:0/3834809592 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561ccf257390 con 0x561ccf252f30 2024-09-22T08:38:30.395 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.383+0000 7fb676677640 1 -- 172.21.15.142:0/3834809592 <== osd.3 v2:172.21.15.142:6800/1064901393 9 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb67003e070 con 0x561ccf252f30 2024-09-22T08:38:30.396 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.383+0000 7fb676677640 1 -- 172.21.15.142:0/3834809592 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561ccf257390 con 0x7fb6680951a0 2024-09-22T08:38:30.396 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.383+0000 7fb675675640 1 -- 172.21.15.142:0/3834809592 <== osd.0 v2:172.21.15.31:6800/168281188 7 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb660029040 con 0x7fb6680951a0 2024-09-22T08:38:30.396 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.383+0000 7fb675675640 1 -- 172.21.15.142:0/3834809592 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561ccf257390 con 0x7fb670037070 2024-09-22T08:38:30.396 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.383+0000 7fb675e76640 1 -- 172.21.15.142:0/3834809592 <== osd.2 v2:172.21.15.142:6808/279438927 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb668089050 con 0x7fb670037070 2024-09-22T08:38:30.396 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.383+0000 7fb675e76640 1 -- 172.21.15.142:0/3834809592 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561ccf257390 con 0x561ccf252f30 2024-09-22T08:38:30.396 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.383+0000 7fb676677640 1 -- 172.21.15.142:0/3834809592 <== osd.3 v2:172.21.15.142:6800/1064901393 10 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb67003e070 con 0x561ccf252f30 2024-09-22T08:38:30.396 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.383+0000 7fb676677640 1 -- 172.21.15.142:0/3834809592 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561ccf257390 con 0x7fb6680951a0 2024-09-22T08:38:30.396 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.384+0000 7fb675675640 1 -- 172.21.15.142:0/3834809592 <== osd.0 v2:172.21.15.31:6800/168281188 8 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb660029040 con 0x7fb6680951a0 2024-09-22T08:38:30.396 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.384+0000 7fb675675640 1 -- 172.21.15.142:0/3834809592 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561ccf257390 con 0x561ccf24e540 2024-09-22T08:38:30.396 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.384+0000 7fb675675640 1 -- 172.21.15.142:0/3834809592 <== osd.1 v2:172.21.15.142:6816/3192108003 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v32'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fb660029040 con 0x561ccf24e540 2024-09-22T08:38:30.396 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.384+0000 7fb675675640 1 -- 172.21.15.142:0/3834809592 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561ccf257390 con 0x7fb670037070 2024-09-22T08:38:30.396 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.384+0000 7fb675e76640 1 -- 172.21.15.142:0/3834809592 <== osd.2 v2:172.21.15.142:6808/279438927 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb668089050 con 0x7fb670037070 2024-09-22T08:38:30.396 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.384+0000 7fb67a12f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:38:30.396 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.384+0000 7fb67a12f800 20 RGWRados::pool_iterate: got zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec 2024-09-22T08:38:30.397 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.384+0000 7fb67a12f800 20 RGWRados::pool_iterate: got zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f 2024-09-22T08:38:30.397 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.384+0000 7fb67a12f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:38:30.397 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.384+0000 7fb67a12f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:38:30.397 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.384+0000 7fb67a12f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:38:30.397 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.384+0000 7fb67a12f800 20 rados->read ofs=0 len=0 2024-09-22T08:38:30.397 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.384+0000 7fb67a12f800 1 -- 172.21.15.142:0/3834809592 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561ccf256420 con 0x561ccf24e540 2024-09-22T08:38:30.397 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.385+0000 7fb675675640 1 -- 172.21.15.142:0/3834809592 <== osd.1 v2:172.21.15.142:6816/3192108003 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb660029040 con 0x561ccf24e540 2024-09-22T08:38:30.397 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.385+0000 7fb67a12f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:30.397 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.385+0000 7fb67a12f800 20 rados->read ofs=0 len=0 2024-09-22T08:38:30.397 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.385+0000 7fb67a12f800 1 -- 172.21.15.142:0/3834809592 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561ccf256c70 con 0x561ccf24e540 2024-09-22T08:38:30.397 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.385+0000 7fb675675640 1 -- 172.21.15.142:0/3834809592 <== osd.1 v2:172.21.15.142:6816/3192108003 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb660029040 con 0x561ccf24e540 2024-09-22T08:38:30.397 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.385+0000 7fb67a12f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:38:30.397 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.385+0000 7fb67a12f800 20 rados->read ofs=0 len=0 2024-09-22T08:38:30.398 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.385+0000 7fb67a12f800 1 -- 172.21.15.142:0/3834809592 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:40 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561ccf257810 con 0x561ccf252f30 2024-09-22T08:38:30.398 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.385+0000 7fb676677640 1 -- 172.21.15.142:0/3834809592 <== osd.3 v2:172.21.15.142:6800/1064901393 11 ==== osd_op_reply(40 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fb67003e070 con 0x561ccf252f30 2024-09-22T08:38:30.398 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.385+0000 7fb67a12f800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:38:30.398 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.385+0000 7fb67a12f800 20 zone default found 2024-09-22T08:38:30.398 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.385+0000 7fb67a12f800 4 Realm: () 2024-09-22T08:38:30.398 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.385+0000 7fb67a12f800 4 ZoneGroup: default (d89f6f57-1007-47dd-9065-f486c7b01aec) 2024-09-22T08:38:30.398 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.385+0000 7fb67a12f800 4 Zone: default (e239248c-0bee-4e41-803a-24b288d3eb8f) 2024-09-22T08:38:30.398 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.385+0000 7fb67a12f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:38:30.398 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.385+0000 7fb67a12f800 20 zonegroup default 2024-09-22T08:38:30.398 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.385+0000 7fb67a12f800 20 rados->read ofs=0 len=0 2024-09-22T08:38:30.398 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.385+0000 7fb67a12f800 1 -- 172.21.15.142:0/3834809592 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561ccf257bd0 con 0x7fb6680951a0 2024-09-22T08:38:30.398 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.386+0000 7fb675675640 1 -- 172.21.15.142:0/3834809592 <== osd.0 v2:172.21.15.31:6800/168281188 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fb660029040 con 0x7fb6680951a0 2024-09-22T08:38:30.398 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.386+0000 7fb67a12f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:30.398 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.386+0000 7fb67a12f800 20 rados->read ofs=0 len=0 2024-09-22T08:38:30.399 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.386+0000 7fb67a12f800 1 -- 172.21.15.142:0/3834809592 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561ccf259eb0 con 0x561ccf252f30 2024-09-22T08:38:30.399 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.386+0000 7fb676677640 1 -- 172.21.15.142:0/3834809592 <== osd.3 v2:172.21.15.142:6800/1064901393 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb67003e070 con 0x561ccf252f30 2024-09-22T08:38:30.399 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.386+0000 7fb67a12f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:30.399 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.386+0000 7fb67a12f800 20 rados->read ofs=0 len=0 2024-09-22T08:38:30.399 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.386+0000 7fb67a12f800 1 -- 172.21.15.142:0/3834809592 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561ccf25a250 con 0x561ccf252f30 2024-09-22T08:38:30.399 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.386+0000 7fb676677640 1 -- 172.21.15.142:0/3834809592 <== osd.3 v2:172.21.15.142:6800/1064901393 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb67003e070 con 0x561ccf252f30 2024-09-22T08:38:30.399 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.386+0000 7fb67a12f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:30.399 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.386+0000 7fb67a12f800 20 started sync module instance, tier type = 2024-09-22T08:38:30.399 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.386+0000 7fb67a12f800 20 started zone id=e239248c-0bee-4e41-803a-24b288d3eb8f (name=default) with tier type = 2024-09-22T08:38:30.399 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.386+0000 7fb67a12f800 1 -- 172.21.15.142:0/3834809592 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561ccf259340 con 0x7fb670037070 2024-09-22T08:38:30.399 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.387+0000 7fb675e76640 1 -- 172.21.15.142:0/3834809592 <== osd.2 v2:172.21.15.142:6808/279438927 7 ==== osd_op_reply(44 notify.0 [create] v32'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb668089050 con 0x7fb670037070 2024-09-22T08:38:30.399 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.387+0000 7fb67a12f800 1 -- 172.21.15.142:0/3834809592 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94681734420272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561ccf258fa0 con 0x7fb670037070 2024-09-22T08:38:30.399 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.387+0000 7fb67a12f800 1 -- 172.21.15.142:0/3834809592 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561ccf25b070 con 0x561ccf24e540 2024-09-22T08:38:30.405 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.388+0000 7fb675e76640 1 -- 172.21.15.142:0/3834809592 <== osd.2 v2:172.21.15.142:6808/279438927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94681734420272] v32'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb668089050 con 0x7fb670037070 2024-09-22T08:38:30.405 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.389+0000 7fb675675640 1 -- 172.21.15.142:0/3834809592 <== osd.1 v2:172.21.15.142:6816/3192108003 16 ==== osd_op_reply(46 notify.1 [create] v32'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb660029040 con 0x561ccf24e540 2024-09-22T08:38:30.405 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.389+0000 7fb67a12f800 1 -- 172.21.15.142:0/3834809592 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94681734424240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561ccf25b490 con 0x561ccf24e540 2024-09-22T08:38:30.405 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.389+0000 7fb67a12f800 1 -- 172.21.15.142:0/3834809592 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561ccf25beb0 con 0x561ccf252f30 2024-09-22T08:38:30.405 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.390+0000 7fb676677640 1 -- 172.21.15.142:0/3834809592 <== osd.3 v2:172.21.15.142:6800/1064901393 14 ==== osd_op_reply(48 notify.2 [create] v32'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb67003e070 con 0x561ccf252f30 2024-09-22T08:38:30.405 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.390+0000 7fb67a12f800 1 -- 172.21.15.142:0/3834809592 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94681734429088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561ccf25beb0 con 0x561ccf252f30 2024-09-22T08:38:30.405 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.390+0000 7fb67a12f800 1 -- 172.21.15.142:0/3834809592 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561ccf25ce90 con 0x7fb670037070 2024-09-22T08:38:30.405 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.390+0000 7fb675675640 1 -- 172.21.15.142:0/3834809592 <== osd.1 v2:172.21.15.142:6816/3192108003 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94681734424240] v32'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb660029040 con 0x561ccf24e540 2024-09-22T08:38:30.405 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.391+0000 7fb675e76640 1 -- 172.21.15.142:0/3834809592 <== osd.2 v2:172.21.15.142:6808/279438927 9 ==== osd_op_reply(50 notify.3 [create] v32'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb668089050 con 0x7fb670037070 2024-09-22T08:38:30.405 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.391+0000 7fb67a12f800 1 -- 172.21.15.142:0/3834809592 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94681734425296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561ccf25d2b0 con 0x7fb670037070 2024-09-22T08:38:30.405 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.391+0000 7fb67a12f800 1 -- 172.21.15.142:0/3834809592 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561ccf25dd10 con 0x561ccf24e540 2024-09-22T08:38:30.405 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.391+0000 7fb676677640 1 -- 172.21.15.142:0/3834809592 <== osd.3 v2:172.21.15.142:6800/1064901393 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94681734429088] v32'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb67003e070 con 0x561ccf252f30 2024-09-22T08:38:30.406 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.392+0000 7fb675675640 1 -- 172.21.15.142:0/3834809592 <== osd.1 v2:172.21.15.142:6816/3192108003 18 ==== osd_op_reply(52 notify.4 [create] v32'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb660029040 con 0x561ccf24e540 2024-09-22T08:38:30.406 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.392+0000 7fb67a12f800 1 -- 172.21.15.142:0/3834809592 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94681734431392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561ccf25dd10 con 0x561ccf24e540 2024-09-22T08:38:30.406 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.392+0000 7fb67a12f800 1 -- 172.21.15.142:0/3834809592 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561ccf25e7a0 con 0x7fb6680951a0 2024-09-22T08:38:30.406 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.392+0000 7fb675e76640 1 -- 172.21.15.142:0/3834809592 <== osd.2 v2:172.21.15.142:6808/279438927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94681734425296] v32'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb668089050 con 0x7fb670037070 2024-09-22T08:38:30.406 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.393+0000 7fb675675640 1 -- 172.21.15.142:0/3834809592 <== osd.1 v2:172.21.15.142:6816/3192108003 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94681734431392] v32'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb660029040 con 0x561ccf24e540 2024-09-22T08:38:30.406 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.394+0000 7fb675675640 1 -- 172.21.15.142:0/3834809592 <== osd.0 v2:172.21.15.31:6800/168281188 10 ==== osd_op_reply(54 notify.5 [create] v32'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb660029040 con 0x7fb6680951a0 2024-09-22T08:38:30.406 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.394+0000 7fb67a12f800 1 -- 172.21.15.142:0/3834809592 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94681734439536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561ccf25e760 con 0x7fb6680951a0 2024-09-22T08:38:30.406 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.394+0000 7fb67a12f800 1 -- 172.21.15.142:0/3834809592 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561ccf25f040 con 0x7fb6680951a0 2024-09-22T08:38:30.406 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.395+0000 7fb675675640 1 -- 172.21.15.142:0/3834809592 <== osd.0 v2:172.21.15.31:6800/168281188 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94681734439536] v32'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb660029040 con 0x7fb6680951a0 2024-09-22T08:38:30.406 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.395+0000 7fb675675640 1 -- 172.21.15.142:0/3834809592 <== osd.0 v2:172.21.15.31:6800/168281188 12 ==== osd_op_reply(56 notify.6 [create] v32'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb660029040 con 0x7fb6680951a0 2024-09-22T08:38:30.406 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.395+0000 7fb67a12f800 1 -- 172.21.15.142:0/3834809592 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94681734433184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561ccf25e760 con 0x7fb6680951a0 2024-09-22T08:38:30.406 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.395+0000 7fb67a12f800 1 -- 172.21.15.142:0/3834809592 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561ccf25f610 con 0x7fb6680951a0 2024-09-22T08:38:30.406 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.396+0000 7fb675675640 1 -- 172.21.15.142:0/3834809592 <== osd.0 v2:172.21.15.31:6800/168281188 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94681734433184] v32'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb660029040 con 0x7fb6680951a0 2024-09-22T08:38:30.407 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.396+0000 7fb675675640 1 -- 172.21.15.142:0/3834809592 <== osd.0 v2:172.21.15.31:6800/168281188 14 ==== osd_op_reply(58 notify.7 [create] v32'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb660029040 con 0x7fb6680951a0 2024-09-22T08:38:30.407 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.396+0000 7fb67a12f800 1 -- 172.21.15.142:0/3834809592 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94681734441792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561ccf25f610 con 0x7fb6680951a0 2024-09-22T08:38:30.407 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.396+0000 7fb67a12f800 20 add_watcher() i=0 2024-09-22T08:38:30.407 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.396+0000 7fb67a12f800 20 add_watcher() i=1 2024-09-22T08:38:30.407 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.396+0000 7fb67a12f800 20 add_watcher() i=2 2024-09-22T08:38:30.407 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.396+0000 7fb67a12f800 20 add_watcher() i=3 2024-09-22T08:38:30.407 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.396+0000 7fb67a12f800 20 add_watcher() i=4 2024-09-22T08:38:30.407 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.396+0000 7fb67a12f800 20 add_watcher() i=5 2024-09-22T08:38:30.407 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.396+0000 7fb67a12f800 20 add_watcher() i=6 2024-09-22T08:38:30.407 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.397+0000 7fb675675640 1 -- 172.21.15.142:0/3834809592 <== osd.0 v2:172.21.15.31:6800/168281188 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94681734441792] v32'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb660029040 con 0x7fb6680951a0 2024-09-22T08:38:30.407 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.397+0000 7fb67a12f800 20 add_watcher() i=7 2024-09-22T08:38:30.407 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.397+0000 7fb67a12f800 2 all 8 watchers are set, enabling cache 2024-09-22T08:38:30.407 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.397+0000 7fb67a12f800 1 -- 172.21.15.142:0/3834809592 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561ccf262b00 con 0x561ccf24e540 2024-09-22T08:38:30.408 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.397+0000 7fb675675640 1 -- 172.21.15.142:0/3834809592 <== osd.1 v2:172.21.15.142:6816/3192108003 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fb660029040 con 0x561ccf24e540 2024-09-22T08:38:30.408 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.397+0000 7fb67a12f800 1 -- 172.21.15.142:0/3834809592 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94681734444288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561ccf25fe90 con 0x561ccf24e540 2024-09-22T08:38:30.408 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.398+0000 7fb675675640 1 -- 172.21.15.142:0/3834809592 <== osd.1 v2:172.21.15.142:6816/3192108003 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94681734444288] v32'258 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb660029040 con 0x561ccf24e540 2024-09-22T08:38:30.408 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.399+0000 7fb52bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:38:30.408 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.399+0000 7fb67a12f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:38:30.408 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.399+0000 7fb67a12f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:38:30.408 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.399+0000 7fb67a12f800 5 note: GC not initialized 2024-09-22T08:38:30.408 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.399+0000 7fb52afe5640 20 reqs_thread_entry: start 2024-09-22T08:38:30.408 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.399+0000 7fb67a12f800 20 init_complete bucket index max shards: 11 2024-09-22T08:38:30.408 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.399+0000 7fb67a12f800 20 Filter name: none 2024-09-22T08:38:30.408 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.399+0000 7fb528fe1640 20 reqs_thread_entry: start 2024-09-22T08:38:30.408 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.399+0000 7fb67a12f800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-22T08:38:30.408 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.399+0000 7fb67a12f800 20 rados->read ofs=0 len=0 2024-09-22T08:38:30.408 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.399+0000 7fb67a12f800 1 -- 172.21.15.142:0/3834809592 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561ccf295ee0 con 0x7fb6680951a0 2024-09-22T08:38:30.409 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.400+0000 7fb675675640 1 -- 172.21.15.142:0/3834809592 <== osd.0 v2:172.21.15.31:6800/168281188 16 ==== osd_op_reply(62 ada [call out=48b,read 0~460 out=460b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 231+0+583 (crc 0 0 0) 0x7fb660029040 con 0x7fb6680951a0 2024-09-22T08:38:30.409 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.400+0000 7fb67a12f800 20 rados_obj.operate() r=0 bl.length=460 2024-09-22T08:38:30.409 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.400+0000 7fb67a12f800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-22T08:38:30.409 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.400+0000 7fb67a12f800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-22T08:38:30.409 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.400+0000 7fb67a12f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:38:30.409 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.400+0000 7fb67a12f800 1 -- 172.21.15.142:0/3834809592 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~490 in=490b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561ccf29c4d0 con 0x7fb6680951a0 2024-09-22T08:38:30.409 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.401+0000 7fb675675640 1 -- 172.21.15.142:0/3834809592 <== osd.0 v2:172.21.15.31:6800/168281188 17 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~490] v32'6 uv6 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fb660029040 con 0x7fb6680951a0 2024-09-22T08:38:30.409 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.401+0000 7fb67a12f800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-22T08:38:30.409 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.401+0000 7fb67a12f800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-22T08:38:30.409 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.401+0000 7fb67a12f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-22T08:38:30.409 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.401+0000 7fb67a12f800 1 -- 172.21.15.142:0/3834809592 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94681734692496 in=678b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561ccf297af0 con 0x561ccf24e540 2024-09-22T08:38:30.409 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.401+0000 7fb675675640 1 -- 172.21.15.142:0/3834809592 <== osd.1 v2:172.21.15.142:6816/3192108003 22 ==== watch-notify(notify (1) cookie 94681734431392 notify 137438953496 ret 0) ==== 708+0+0 (crc 0 0 0) 0x561ccefa5a20 con 0x561ccf24e540 2024-09-22T08:38:30.409 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.402+0000 7fb5597fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953496 cookie 94681734431392 notifier 4870 bl.length()=666 2024-09-22T08:38:30.409 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.402+0000 7fb5597fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-22T08:38:30.410 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.402+0000 7fb5597fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-22T08:38:30.410 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.402+0000 7fb675675640 1 -- 172.21.15.142:0/3834809592 <== osd.1 v2:172.21.15.142:6816/3192108003 23 ==== osd_op_reply(64 notify.4 [notify cookie 94681734692496 out=8b] v0'0 uv258 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb660029040 con 0x561ccf24e540 2024-09-22T08:38:30.410 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.402+0000 7fb5597fa640 1 -- 172.21.15.142:0/3834809592 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fb538003ea0 con 0x561ccf24e540 2024-09-22T08:38:30.410 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.402+0000 7fb675675640 1 -- 172.21.15.142:0/3834809592 <== osd.1 v2:172.21.15.142:6816/3192108003 24 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb660029040 con 0x561ccf24e540 2024-09-22T08:38:30.410 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.402+0000 7fb675675640 1 -- 172.21.15.142:0/3834809592 <== osd.1 v2:172.21.15.142:6816/3192108003 25 ==== watch-notify(notify_complete (2) cookie 94681734692496 notify 137438953496 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fb66002d920 con 0x561ccf24e540 2024-09-22T08:38:30.410 INFO:teuthology.orchestra.run.smithi142.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-22T08:38:29.459914Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"user-info-without-keys","perm":"read"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-22T08:38:29.459903Z","tags":[],"group_ids":[]} 2024-09-22T08:38:30.412 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.403+0000 7fb52bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:38:30.412 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.403+0000 7fb67a12f800 1 -- 172.21.15.142:0/3834809592 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94681734444288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561ccf293c10 con 0x561ccf24e540 2024-09-22T08:38:30.412 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.404+0000 7fb675675640 1 -- 172.21.15.142:0/3834809592 <== osd.1 v2:172.21.15.142:6816/3192108003 26 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94681734444288] v32'259 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb660029040 con 0x561ccf24e540 2024-09-22T08:38:30.413 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.404+0000 7fb67a12f800 1 -- 172.21.15.142:0/3834809592 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94681734420272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561ccf293c10 con 0x7fb670037070 2024-09-22T08:38:30.413 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.405+0000 7fb675e76640 1 -- 172.21.15.142:0/3834809592 <== osd.2 v2:172.21.15.142:6808/279438927 11 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94681734420272] v32'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb668089050 con 0x7fb670037070 2024-09-22T08:38:30.413 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.405+0000 7fb67a12f800 20 remove_watcher() i=0 2024-09-22T08:38:30.413 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.405+0000 7fb67a12f800 2 removed watcher, disabling cache 2024-09-22T08:38:30.413 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.405+0000 7fb67a12f800 1 -- 172.21.15.142:0/3834809592 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94681734424240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561ccf293c10 con 0x561ccf24e540 2024-09-22T08:38:30.413 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.406+0000 7fb675675640 1 -- 172.21.15.142:0/3834809592 <== osd.1 v2:172.21.15.142:6816/3192108003 27 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94681734424240] v32'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb660029040 con 0x561ccf24e540 2024-09-22T08:38:30.413 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.406+0000 7fb67a12f800 20 remove_watcher() i=1 2024-09-22T08:38:30.413 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.406+0000 7fb67a12f800 1 -- 172.21.15.142:0/3834809592 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94681734429088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561ccf293c10 con 0x561ccf252f30 2024-09-22T08:38:30.413 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.407+0000 7fb676677640 1 -- 172.21.15.142:0/3834809592 <== osd.3 v2:172.21.15.142:6800/1064901393 16 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94681734429088] v32'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb67003e070 con 0x561ccf252f30 2024-09-22T08:38:30.413 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.407+0000 7fb67a12f800 20 remove_watcher() i=2 2024-09-22T08:38:30.413 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.407+0000 7fb67a12f800 1 -- 172.21.15.142:0/3834809592 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94681734425296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561ccf293c10 con 0x7fb670037070 2024-09-22T08:38:30.413 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.408+0000 7fb675e76640 1 -- 172.21.15.142:0/3834809592 <== osd.2 v2:172.21.15.142:6808/279438927 12 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94681734425296] v32'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb668089050 con 0x7fb670037070 2024-09-22T08:38:30.413 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.408+0000 7fb67a12f800 20 remove_watcher() i=3 2024-09-22T08:38:30.413 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.408+0000 7fb67a12f800 1 -- 172.21.15.142:0/3834809592 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94681734431392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561ccf293c10 con 0x561ccf24e540 2024-09-22T08:38:30.414 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.409+0000 7fb675675640 1 -- 172.21.15.142:0/3834809592 <== osd.1 v2:172.21.15.142:6816/3192108003 28 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94681734431392] v32'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb660029040 con 0x561ccf24e540 2024-09-22T08:38:30.414 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.409+0000 7fb67a12f800 20 remove_watcher() i=4 2024-09-22T08:38:30.414 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.409+0000 7fb67a12f800 1 -- 172.21.15.142:0/3834809592 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94681734439536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561ccf293c10 con 0x7fb6680951a0 2024-09-22T08:38:30.414 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.411+0000 7fb675675640 1 -- 172.21.15.142:0/3834809592 <== osd.0 v2:172.21.15.31:6800/168281188 18 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94681734439536] v32'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb660029040 con 0x7fb6680951a0 2024-09-22T08:38:30.414 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.411+0000 7fb67a12f800 20 remove_watcher() i=5 2024-09-22T08:38:30.414 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.411+0000 7fb67a12f800 1 -- 172.21.15.142:0/3834809592 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94681734433184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561ccf293c10 con 0x7fb6680951a0 2024-09-22T08:38:30.417 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.412+0000 7fb675675640 1 -- 172.21.15.142:0/3834809592 <== osd.0 v2:172.21.15.31:6800/168281188 19 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94681734433184] v32'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb660029040 con 0x7fb6680951a0 2024-09-22T08:38:30.417 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.412+0000 7fb67a12f800 20 remove_watcher() i=6 2024-09-22T08:38:30.417 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.412+0000 7fb67a12f800 1 -- 172.21.15.142:0/3834809592 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94681734441792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561ccf293c10 con 0x7fb6680951a0 2024-09-22T08:38:30.417 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.413+0000 7fb675675640 1 -- 172.21.15.142:0/3834809592 <== osd.0 v2:172.21.15.31:6800/168281188 20 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94681734441792] v32'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb660029040 con 0x7fb6680951a0 2024-09-22T08:38:30.417 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.413+0000 7fb67a12f800 20 remove_watcher() i=7 2024-09-22T08:38:30.417 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.413+0000 7fb67a12f800 1 -- 172.21.15.142:0/3834809592 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7fb6680951a0 msgr2=0x7fb6680865f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:30.417 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.413+0000 7fb67a12f800 1 --2- 172.21.15.142:0/3834809592 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7fb6680951a0 0x7fb6680865f0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:30.417 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.413+0000 7fb67a12f800 1 -- 172.21.15.142:0/3834809592 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x561ccf24e540 msgr2=0x561ccf250a00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:30.418 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.413+0000 7fb67a12f800 1 --2- 172.21.15.142:0/3834809592 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x561ccf24e540 0x561ccf250a00 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:30.418 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.413+0000 7fb67a12f800 1 -- 172.21.15.142:0/3834809592 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7fb670037070 msgr2=0x7fb6700199f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:30.418 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.413+0000 7fb67a12f800 1 --2- 172.21.15.142:0/3834809592 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7fb670037070 0x7fb6700199f0 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:30.418 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.413+0000 7fb67a12f800 1 -- 172.21.15.142:0/3834809592 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x561ccf252f30 msgr2=0x561ccf255320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:30.418 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.413+0000 7fb67a12f800 1 --2- 172.21.15.142:0/3834809592 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x561ccf252f30 0x561ccf255320 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:30.418 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.413+0000 7fb67a12f800 1 -- 172.21.15.142:0/3834809592 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fb54003cfb0 msgr2=0x7fb54003f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:30.418 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.413+0000 7fb67a12f800 1 --2- 172.21.15.142:0/3834809592 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fb54003cfb0 0x7fb54003f470 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x561ccf21b8a0 tx=0x7fb668091000 comp rx=0 tx=0).stop 2024-09-22T08:38:30.418 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.413+0000 7fb67a12f800 1 -- 172.21.15.142:0/3834809592 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561ccf23b680 msgr2=0x561ccf242c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:30.418 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.413+0000 7fb67a12f800 1 --2- 172.21.15.142:0/3834809592 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561ccf23b680 0x561ccf242c70 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fb670008940 tx=0x7fb670053e80 comp rx=0 tx=0).stop 2024-09-22T08:38:30.418 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.413+0000 7fb675675640 1 -- 172.21.15.142:0/3834809592 reap_dead start 2024-09-22T08:38:30.418 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.413+0000 7fb675675640 1 -- 172.21.15.142:0/3834809592 reap_dead start 2024-09-22T08:38:30.418 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.413+0000 7fb67a12f800 1 -- 172.21.15.142:0/3834809592 shutdown_connections 2024-09-22T08:38:30.418 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.413+0000 7fb67a12f800 1 -- 172.21.15.142:0/3834809592 >> 172.21.15.142:0/3834809592 conn(0x561ccf237a80 msgr2=0x561ccf235c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:38:30.418 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.413+0000 7fb67a12f800 1 -- 172.21.15.142:0/3834809592 shutdown_connections 2024-09-22T08:38:30.419 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.413+0000 7fb67a12f800 1 -- 172.21.15.142:0/3834809592 wait complete. 2024-09-22T08:38:30.419 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.413+0000 7fb67a12f800 1 -- 172.21.15.142:0/1319370882 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fb55003cfb0 msgr2=0x7fb55003f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:30.419 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.413+0000 7fb67a12f800 1 --2- 172.21.15.142:0/1319370882 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fb55003cfb0 0x7fb55003f470 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fb66806b760 tx=0x7fb668002170 comp rx=0 tx=0).stop 2024-09-22T08:38:30.419 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.413+0000 7fb67a12f800 1 -- 172.21.15.142:0/1319370882 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561ccf22eb60 msgr2=0x561ccf22ef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:30.419 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.413+0000 7fb67a12f800 1 --2- 172.21.15.142:0/1319370882 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561ccf22eb60 0x561ccf22ef80 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x561ccf119a70 tx=0x7fb67000af20 comp rx=0 tx=0).stop 2024-09-22T08:38:30.419 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.413+0000 7fb67a12f800 1 -- 172.21.15.142:0/1319370882 shutdown_connections 2024-09-22T08:38:30.419 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.413+0000 7fb67a12f800 1 --2- 172.21.15.142:0/1319370882 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fb55003cfb0 0x7fb55003f470 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:30.419 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.413+0000 7fb67a12f800 1 --2- 172.21.15.142:0/1319370882 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561ccf22eb60 0x561ccf22ef80 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:30.419 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.413+0000 7fb67a12f800 1 -- 172.21.15.142:0/1319370882 >> 172.21.15.142:0/1319370882 conn(0x561ccf222f10 msgr2=0x561ccf2232f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:38:30.419 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.413+0000 7fb67a12f800 1 -- 172.21.15.142:0/1319370882 shutdown_connections 2024-09-22T08:38:30.419 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.413+0000 7fb67a12f800 1 -- 172.21.15.142:0/1319370882 wait complete. 2024-09-22T08:38:30.419 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.414+0000 7fb67a12f800 1 -- 172.21.15.142:0/2831905401 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x561ccf11d990 msgr2=0x561ccf21af50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:30.419 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.414+0000 7fb67a12f800 1 --2- 172.21.15.142:0/2831905401 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x561ccf11d990 0x561ccf21af50 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:30.419 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.414+0000 7fb67a12f800 1 -- 172.21.15.142:0/2831905401 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x561ccf21d750 msgr2=0x561ccf21fb40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:30.420 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.414+0000 7fb67a12f800 1 --2- 172.21.15.142:0/2831905401 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x561ccf21d750 0x561ccf21fb40 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:30.420 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.414+0000 7fb67a12f800 1 -- 172.21.15.142:0/2831905401 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fb55c03d000 msgr2=0x7fb55c03f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:30.420 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.414+0000 7fb67a12f800 1 --2- 172.21.15.142:0/2831905401 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fb55c03d000 0x7fb55c03f4c0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fb660001d70 tx=0x7fb6600012d0 comp rx=0 tx=0).stop 2024-09-22T08:38:30.420 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.414+0000 7fb67a12f800 1 -- 172.21.15.142:0/2831905401 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561ccf11b060 msgr2=0x561ccf11a780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:30.420 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.414+0000 7fb67a12f800 1 --2- 172.21.15.142:0/2831905401 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561ccf11b060 0x561ccf11a780 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fb668025a60 tx=0x7fb668003330 comp rx=0 tx=0).stop 2024-09-22T08:38:30.420 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.414+0000 7fb67a12f800 1 -- 172.21.15.142:0/2831905401 shutdown_connections 2024-09-22T08:38:30.420 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.414+0000 7fb67a12f800 1 --2- 172.21.15.142:0/2831905401 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x561ccf21d750 0x561ccf21fb40 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:30.420 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.414+0000 7fb67a12f800 1 --2- 172.21.15.142:0/2831905401 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x561ccf11d990 0x561ccf21af50 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:30.420 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.414+0000 7fb67a12f800 1 --2- 172.21.15.142:0/2831905401 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fb55c03d000 0x7fb55c03f4c0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:30.420 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.414+0000 7fb67a12f800 1 --2- 172.21.15.142:0/2831905401 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561ccf11b060 0x561ccf11a780 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:30.420 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.414+0000 7fb67a12f800 1 -- 172.21.15.142:0/2831905401 >> 172.21.15.142:0/2831905401 conn(0x561ccf114ba0 msgr2=0x561ccf20b490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:38:30.420 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.414+0000 7fb67a12f800 1 -- 172.21.15.142:0/2831905401 shutdown_connections 2024-09-22T08:38:30.420 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.414+0000 7fb67a12f800 1 -- 172.21.15.142:0/2831905401 wait complete. 2024-09-22T08:38:30.424 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-22T08:38:29.459914Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': 'read'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-22T08:38:29.459903Z', 'tags': [], 'group_ids': []} 2024-09-22T08:38:30.424 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-22T08:38:29.459914Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': 'read'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-22T08:38:29.459903Z', 'tags': [], 'group_ids': []} 2024-09-22T08:38:30.424 ERROR:root:0 2024-09-22T08:38:30.424 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-22T08:38:30.428 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-22T08:38:30.428 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=*'] 2024-09-22T08:38:30.428 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=*'] 2024-09-22T08:38:30.429 DEBUG:teuthology.orchestra.run.smithi142:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps 'user-info-without-keys=*' 2024-09-22T08:38:30.475 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:38:30.475 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:38:30.476 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.474+0000 7f0651d1f800 1 Processor -- start 2024-09-22T08:38:30.476 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.474+0000 7f0651d1f800 1 -- start start 2024-09-22T08:38:30.476 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.475+0000 7f0651d1f800 1 --2- >> v2:172.21.15.31:3300/0 conn(0x562701127cb0 0x56270112d640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:30.476 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.475+0000 7f0651d1f800 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x562700fb1a20 con 0x5627011269e0 2024-09-22T08:38:30.476 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.475+0000 7f0651d1f800 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x562700fb17d0 con 0x562701127cb0 2024-09-22T08:38:30.477 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.475+0000 7f064d2a1640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x562701127cb0 0x56270112d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:30.477 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.475+0000 7f064d2a1640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x562701127cb0 0x56270112d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:51950/0 (socket says 172.21.15.142:51950) 2024-09-22T08:38:30.477 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.475+0000 7f064d2a1640 1 -- 172.21.15.142:0/3960711044 learned_addr learned my addr 172.21.15.142:0/3960711044 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:38:30.477 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.475+0000 7f064daa2640 1 --1- 172.21.15.142:0/3960711044 >> v1:172.21.15.31:6789/0 conn(0x5627011269e0 0x5627011275a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.142:50508/0 (socket says 172.21.15.142:50508) 2024-09-22T08:38:30.477 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.475+0000 7f064d2a1640 1 -- 172.21.15.142:0/3960711044 >> v1:172.21.15.31:6789/0 conn(0x5627011269e0 legacy=0x5627011275a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:30.477 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.475+0000 7f064caa0640 1 -- 172.21.15.142:0/3960711044 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 65579761 0 0) 0x562700fb1a20 con 0x5627011269e0 2024-09-22T08:38:30.477 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.475+0000 7f064d2a1640 1 -- 172.21.15.142:0/3960711044 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5627011270e0 con 0x562701127cb0 2024-09-22T08:38:30.478 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.477+0000 7f064d2a1640 1 --2- 172.21.15.142:0/3960711044 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562701127cb0 0x56270112d640 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f063800a520 tx=0x7f0638045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9271e9bd1f8ba964 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:30.478 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.477+0000 7f064caa0640 1 -- 172.21.15.142:0/3960711044 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0638055070 con 0x562701127cb0 2024-09-22T08:38:30.478 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.477+0000 7f064caa0640 1 -- 172.21.15.142:0/3960711044 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06380515b0 con 0x562701127cb0 2024-09-22T08:38:30.478 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.477+0000 7f064caa0640 1 -- 172.21.15.142:0/3960711044 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06380518d0 con 0x562701127cb0 2024-09-22T08:38:30.479 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.478+0000 7f0651d1f800 1 -- 172.21.15.142:0/3960711044 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562701127cb0 msgr2=0x56270112d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:30.479 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.478+0000 7f0651d1f800 1 --2- 172.21.15.142:0/3960711044 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562701127cb0 0x56270112d640 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f063800a520 tx=0x7f0638045ba0 comp rx=0 tx=0).stop 2024-09-22T08:38:30.479 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.478+0000 7f0651d1f800 1 -- 172.21.15.142:0/3960711044 shutdown_connections 2024-09-22T08:38:30.479 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.478+0000 7f0651d1f800 1 --2- 172.21.15.142:0/3960711044 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562701127cb0 0x56270112d640 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:30.480 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.478+0000 7f0651d1f800 1 -- 172.21.15.142:0/3960711044 >> 172.21.15.142:0/3960711044 conn(0x562701121db0 msgr2=0x562701124210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:38:30.480 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.478+0000 7f0651d1f800 1 -- 172.21.15.142:0/3960711044 shutdown_connections 2024-09-22T08:38:30.480 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.478+0000 7f0651d1f800 1 -- 172.21.15.142:0/3960711044 wait complete. 2024-09-22T08:38:30.492 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.491+0000 7f0651d1f800 1 Processor -- start 2024-09-22T08:38:30.492 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.491+0000 7f0651d1f800 1 -- start start 2024-09-22T08:38:30.492 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.491+0000 7f0651d1f800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5627011269e0 0x562701215e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:30.492 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.491+0000 7f0651d1f800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x562700fbedd0 con 0x5627011269e0 2024-09-22T08:38:30.493 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.492+0000 7f064daa2640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5627011269e0 0x562701215e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:30.494 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.492+0000 7f064daa2640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5627011269e0 0x562701215e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:51954/0 (socket says 172.21.15.142:51954) 2024-09-22T08:38:30.494 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.492+0000 7f064daa2640 1 -- 172.21.15.142:0/3174418596 learned_addr learned my addr 172.21.15.142:0/3174418596 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:38:30.494 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.492+0000 7f064daa2640 1 -- 172.21.15.142:0/3174418596 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562701216410 con 0x5627011269e0 2024-09-22T08:38:30.494 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.492+0000 7f064daa2640 1 --2- 172.21.15.142:0/3174418596 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5627011269e0 0x562701215e20 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f0640006fa0 tx=0x7f0640001b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e04e3cefdfcfe3f2 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:30.494 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.492+0000 7f053be07640 1 -- 172.21.15.142:0/3174418596 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0640003450 con 0x5627011269e0 2024-09-22T08:38:30.494 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.492+0000 7f053be07640 1 -- 172.21.15.142:0/3174418596 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0640003610 con 0x5627011269e0 2024-09-22T08:38:30.494 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.492+0000 7f053be07640 1 -- 172.21.15.142:0/3174418596 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0640003970 con 0x5627011269e0 2024-09-22T08:38:30.496 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.493+0000 7f0651d1f800 1 -- 172.21.15.142:0/3174418596 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5627011269e0 msgr2=0x562701215e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:30.496 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.493+0000 7f0651d1f800 1 --2- 172.21.15.142:0/3174418596 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5627011269e0 0x562701215e20 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f0640006fa0 tx=0x7f0640001b00 comp rx=0 tx=0).stop 2024-09-22T08:38:30.496 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.493+0000 7f0651d1f800 1 -- 172.21.15.142:0/3174418596 shutdown_connections 2024-09-22T08:38:30.496 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.493+0000 7f0651d1f800 1 --2- 172.21.15.142:0/3174418596 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5627011269e0 0x562701215e20 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:30.496 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.493+0000 7f0651d1f800 1 -- 172.21.15.142:0/3174418596 >> 172.21.15.142:0/3174418596 conn(0x562701121db0 msgr2=0x5627012117a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:38:30.496 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.493+0000 7f0651d1f800 1 -- 172.21.15.142:0/3174418596 shutdown_connections 2024-09-22T08:38:30.496 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.493+0000 7f0651d1f800 1 -- 172.21.15.142:0/3174418596 wait complete. 2024-09-22T08:38:30.496 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.493+0000 7f0651d1f800 1 Processor -- start 2024-09-22T08:38:30.496 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.493+0000 7f0651d1f800 1 -- start start 2024-09-22T08:38:30.496 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.494+0000 7f0651d1f800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5627011269e0 0x56270109c260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:30.497 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.494+0000 7f0651d1f800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x56270112db80 con 0x5627011269e0 2024-09-22T08:38:30.497 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.494+0000 7f064daa2640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5627011269e0 0x56270109c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:30.497 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.494+0000 7f064daa2640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5627011269e0 0x56270109c260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:51970/0 (socket says 172.21.15.142:51970) 2024-09-22T08:38:30.497 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.494+0000 7f064daa2640 1 -- 172.21.15.142:0/1553162748 learned_addr learned my addr 172.21.15.142:0/1553162748 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:38:30.497 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.494+0000 7f064daa2640 1 -- 172.21.15.142:0/1553162748 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56270109c7c0 con 0x5627011269e0 2024-09-22T08:38:30.497 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.494+0000 7f064daa2640 1 --2- 172.21.15.142:0/1553162748 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5627011269e0 0x56270109c260 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f0640001330 tx=0x7f0640001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:30.497 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.494+0000 7f053a604640 1 -- 172.21.15.142:0/1553162748 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0640014a10 con 0x5627011269e0 2024-09-22T08:38:30.497 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.494+0000 7f053a604640 1 -- 172.21.15.142:0/1553162748 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0640014bb0 con 0x5627011269e0 2024-09-22T08:38:30.497 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.494+0000 7f0651d1f800 1 -- 172.21.15.142:0/1553162748 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56270109ab70 con 0x5627011269e0 2024-09-22T08:38:30.497 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.494+0000 7f053a604640 1 -- 172.21.15.142:0/1553162748 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f064001e3f0 con 0x5627011269e0 2024-09-22T08:38:30.497 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.494+0000 7f0651d1f800 1 -- 172.21.15.142:0/1553162748 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56270109b130 con 0x5627011269e0 2024-09-22T08:38:30.500 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.495+0000 7f053a604640 1 -- 172.21.15.142:0/1553162748 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f0640010070 con 0x5627011269e0 2024-09-22T08:38:30.500 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.496+0000 7f053a604640 1 --2- 172.21.15.142:0/1553162748 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f053403cfb0 0x7f053403f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:30.500 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.496+0000 7f053a604640 1 -- 172.21.15.142:0/1553162748 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5938+0+0 (secure 0 0 0) 0x7f0640018070 con 0x5627011269e0 2024-09-22T08:38:30.500 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.496+0000 7f064d2a1640 1 --2- 172.21.15.142:0/1553162748 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f053403cfb0 0x7f053403f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:30.500 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.496+0000 7f0651d1f800 1 --2- 172.21.15.142:0/1553162748 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x562701127cb0 0x562701226e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:30.500 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.496+0000 7f0651d1f800 1 -- 172.21.15.142:0/1553162748 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5627012273b0 con 0x562701127cb0 2024-09-22T08:38:30.500 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.496+0000 7f064e2a3640 1 --2- 172.21.15.142:0/1553162748 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x562701127cb0 0x562701226e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:30.500 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.496+0000 7f064d2a1640 1 --2- 172.21.15.142:0/1553162748 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f053403cfb0 0x7f053403f470 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f0638057000 tx=0x7f0638052000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:30.501 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.496+0000 7f064e2a3640 1 --2- 172.21.15.142:0/1553162748 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x562701127cb0 0x562701226e70 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:30.501 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.496+0000 7f064e2a3640 1 -- 172.21.15.142:0/1553162748 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f06480083e0 con 0x562701127cb0 2024-09-22T08:38:30.501 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.497+0000 7f0651d1f800 1 -- 172.21.15.142:0/1553162748 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56270109b5e0 con 0x562701127cb0 2024-09-22T08:38:30.501 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.497+0000 7f064e2a3640 1 -- 172.21.15.142:0/1553162748 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f06480083e0 con 0x562701127cb0 2024-09-22T08:38:30.501 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.497+0000 7f0651d1f800 1 --2- 172.21.15.142:0/1553162748 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x562701229650 0x56270122ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:30.501 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.497+0000 7f0651d1f800 1 -- 172.21.15.142:0/1553162748 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:3 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56270122c110 con 0x562701229650 2024-09-22T08:38:30.501 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.497+0000 7f064daa2640 1 --2- 172.21.15.142:0/1553162748 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x562701229650 0x56270122ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:30.501 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.497+0000 7f064daa2640 1 --2- 172.21.15.142:0/1553162748 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x562701229650 0x56270122ba40 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:30.501 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.498+0000 7f064daa2640 1 -- 172.21.15.142:0/1553162748 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(3 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f064001b070 con 0x562701229650 2024-09-22T08:38:30.501 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.498+0000 7f0651d1f800 1 -- 172.21.15.142:0/1553162748 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5627012284f0 con 0x562701127cb0 2024-09-22T08:38:30.501 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.498+0000 7f064e2a3640 1 -- 172.21.15.142:0/1553162748 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f06480083e0 con 0x562701127cb0 2024-09-22T08:38:30.501 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.498+0000 7f0651d1f800 1 -- 172.21.15.142:0/1553162748 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5627012289d0 con 0x562701229650 2024-09-22T08:38:30.501 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.498+0000 7f064daa2640 1 -- 172.21.15.142:0/1553162748 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(5 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f064001b070 con 0x562701229650 2024-09-22T08:38:30.502 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.499+0000 7f0651d1f800 1 Processor -- start 2024-09-22T08:38:30.502 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.499+0000 7f0651d1f800 1 -- start start 2024-09-22T08:38:30.502 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.499+0000 7f0651d1f800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56270123aad0 0x56270123aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:30.502 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.499+0000 7f0651d1f800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x56270101dd50 con 0x56270123aad0 2024-09-22T08:38:30.502 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.499+0000 7f064e2a3640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56270123aad0 0x56270123aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:30.502 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.499+0000 7f064e2a3640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56270123aad0 0x56270123aef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:51974/0 (socket says 172.21.15.142:51974) 2024-09-22T08:38:30.502 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.499+0000 7f064e2a3640 1 -- 172.21.15.142:0/2817938040 learned_addr learned my addr 172.21.15.142:0/2817938040 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:38:30.506 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.499+0000 7f064e2a3640 1 -- 172.21.15.142:0/2817938040 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56270123b530 con 0x56270123aad0 2024-09-22T08:38:30.506 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.499+0000 7f064e2a3640 1 --2- 172.21.15.142:0/2817938040 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56270123aad0 0x56270123aef0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x562701128160 tx=0x7f064800bf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:30.506 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.500+0000 7f05337fe640 1 -- 172.21.15.142:0/2817938040 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f064801c020 con 0x56270123aad0 2024-09-22T08:38:30.506 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.500+0000 7f05337fe640 1 -- 172.21.15.142:0/2817938040 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0648007c90 con 0x56270123aad0 2024-09-22T08:38:30.506 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.500+0000 7f0651d1f800 1 -- 172.21.15.142:0/2817938040 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56270123bd60 con 0x56270123aad0 2024-09-22T08:38:30.507 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.500+0000 7f05337fe640 1 -- 172.21.15.142:0/2817938040 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0648018440 con 0x56270123aad0 2024-09-22T08:38:30.507 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.500+0000 7f0651d1f800 1 -- 172.21.15.142:0/2817938040 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56270123c300 con 0x56270123aad0 2024-09-22T08:38:30.507 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.501+0000 7f05337fe640 1 -- 172.21.15.142:0/2817938040 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f064801f020 con 0x56270123aad0 2024-09-22T08:38:30.507 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.501+0000 7f05337fe640 1 --2- 172.21.15.142:0/2817938040 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f052803cfb0 0x7f052803f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:30.507 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.501+0000 7f05337fe640 1 -- 172.21.15.142:0/2817938040 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5938+0+0 (secure 0 0 0) 0x7f0648055a00 con 0x56270123aad0 2024-09-22T08:38:30.507 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.501+0000 7f064daa2640 1 --2- 172.21.15.142:0/2817938040 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f052803cfb0 0x7f052803f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:30.507 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.501+0000 7f0651d1f800 1 Processor -- start 2024-09-22T08:38:30.507 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.501+0000 7f0651d1f800 1 -- start start 2024-09-22T08:38:30.507 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.501+0000 7f064daa2640 1 --2- 172.21.15.142:0/2817938040 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f052803cfb0 0x7f052803f470 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f0640029970 tx=0x7f0640003f60 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:30.507 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.501+0000 7f0651d1f800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562701247530 0x562701247930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:30.507 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.501+0000 7f0651d1f800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x562701216840 con 0x562701247530 2024-09-22T08:38:30.507 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.501+0000 7f064e2a3640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562701247530 0x562701247930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:30.508 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.501+0000 7f064e2a3640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562701247530 0x562701247930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:51990/0 (socket says 172.21.15.142:51990) 2024-09-22T08:38:30.508 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.501+0000 7f064e2a3640 1 -- 172.21.15.142:0/2423714023 learned_addr learned my addr 172.21.15.142:0/2423714023 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:38:30.508 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.502+0000 7f064e2a3640 1 -- 172.21.15.142:0/2423714023 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562701247f20 con 0x562701247530 2024-09-22T08:38:30.508 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.502+0000 7f064e2a3640 1 --2- 172.21.15.142:0/2423714023 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562701247530 0x562701247930 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f0648053e30 tx=0x7f0648054030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99be1d46b9f234c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:30.508 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.502+0000 7f05317fa640 1 -- 172.21.15.142:0/2423714023 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0648016c50 con 0x562701247530 2024-09-22T08:38:30.508 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.502+0000 7f05317fa640 1 -- 172.21.15.142:0/2423714023 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0648051070 con 0x562701247530 2024-09-22T08:38:30.508 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.502+0000 7f05317fa640 1 -- 172.21.15.142:0/2423714023 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f064800b020 con 0x562701247530 2024-09-22T08:38:30.508 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.502+0000 7f0651d1f800 1 -- 172.21.15.142:0/2423714023 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562701247530 msgr2=0x562701247930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:30.508 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.502+0000 7f0651d1f800 1 --2- 172.21.15.142:0/2423714023 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562701247530 0x562701247930 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f0648053e30 tx=0x7f0648054030 comp rx=0 tx=0).stop 2024-09-22T08:38:30.508 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.503+0000 7f0651d1f800 1 -- 172.21.15.142:0/2423714023 shutdown_connections 2024-09-22T08:38:30.508 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.503+0000 7f0651d1f800 1 --2- 172.21.15.142:0/2423714023 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562701247530 0x562701247930 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:30.508 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.503+0000 7f0651d1f800 1 -- 172.21.15.142:0/2423714023 >> 172.21.15.142:0/2423714023 conn(0x562701243930 msgr2=0x562701241b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:38:30.508 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.503+0000 7f0651d1f800 1 -- 172.21.15.142:0/2423714023 shutdown_connections 2024-09-22T08:38:30.509 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.503+0000 7f0651d1f800 1 -- 172.21.15.142:0/2423714023 wait complete. 2024-09-22T08:38:30.509 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.503+0000 7f0651d1f800 1 Processor -- start 2024-09-22T08:38:30.509 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.503+0000 7f0651d1f800 1 -- start start 2024-09-22T08:38:30.509 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.503+0000 7f0651d1f800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562701247530 0x56270124eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:30.509 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.503+0000 7f0651d1f800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x562701248540 con 0x562701247530 2024-09-22T08:38:30.509 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.503+0000 7f064e2a3640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562701247530 0x56270124eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:30.509 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.503+0000 7f064e2a3640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562701247530 0x56270124eb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:51996/0 (socket says 172.21.15.142:51996) 2024-09-22T08:38:30.509 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.503+0000 7f064e2a3640 1 -- 172.21.15.142:0/4130588905 learned_addr learned my addr 172.21.15.142:0/4130588905 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:38:30.509 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.503+0000 7f064e2a3640 1 -- 172.21.15.142:0/4130588905 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56270124f070 con 0x562701247530 2024-09-22T08:38:30.509 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.504+0000 7f064e2a3640 1 --2- 172.21.15.142:0/4130588905 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562701247530 0x56270124eb10 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f0648054070 tx=0x7f0648053dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:30.509 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.504+0000 7f051f7fe640 1 -- 172.21.15.142:0/4130588905 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0648015b10 con 0x562701247530 2024-09-22T08:38:30.509 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.504+0000 7f051f7fe640 1 -- 172.21.15.142:0/4130588905 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f064802f030 con 0x562701247530 2024-09-22T08:38:30.509 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.504+0000 7f0651d1f800 1 -- 172.21.15.142:0/4130588905 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56270124f300 con 0x562701247530 2024-09-22T08:38:30.510 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.504+0000 7f051f7fe640 1 -- 172.21.15.142:0/4130588905 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0648013b10 con 0x562701247530 2024-09-22T08:38:30.510 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.504+0000 7f0651d1f800 1 -- 172.21.15.142:0/4130588905 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56270124fc80 con 0x562701247530 2024-09-22T08:38:30.510 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.505+0000 7f051f7fe640 1 -- 172.21.15.142:0/4130588905 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f0648016040 con 0x562701247530 2024-09-22T08:38:30.510 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.505+0000 7f051f7fe640 1 --2- 172.21.15.142:0/4130588905 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f051803cfb0 0x7f051803f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:30.510 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.505+0000 7f051f7fe640 1 -- 172.21.15.142:0/4130588905 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5938+0+0 (secure 0 0 0) 0x7f0648035bc0 con 0x562701247530 2024-09-22T08:38:30.510 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.505+0000 7f064daa2640 1 --2- 172.21.15.142:0/4130588905 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f051803cfb0 0x7f051803f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:30.521 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.505+0000 7f064daa2640 1 --2- 172.21.15.142:0/4130588905 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f051803cfb0 0x7f051803f470 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f0640014ff0 tx=0x7f0640037420 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:30.521 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.505+0000 7f0651d1f800 20 rados->read ofs=0 len=0 2024-09-22T08:38:30.521 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.505+0000 7f0651d1f800 1 --2- 172.21.15.142:0/4130588905 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x56270125a440 0x56270125c900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:30.521 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.505+0000 7f0651d1f800 1 -- 172.21.15.142:0/4130588905 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56270125d050 con 0x56270125a440 2024-09-22T08:38:30.521 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.506+0000 7f064d2a1640 1 --2- 172.21.15.142:0/4130588905 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x56270125a440 0x56270125c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:30.521 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.506+0000 7f064d2a1640 1 --2- 172.21.15.142:0/4130588905 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x56270125a440 0x56270125c900 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:30.521 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.506+0000 7f064d2a1640 1 -- 172.21.15.142:0/4130588905 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0638057030 con 0x56270125a440 2024-09-22T08:38:30.521 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.506+0000 7f0651d1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:30.521 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.506+0000 7f0651d1f800 20 realm 2024-09-22T08:38:30.521 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.506+0000 7f0651d1f800 20 rados->read ofs=0 len=0 2024-09-22T08:38:30.521 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.506+0000 7f0651d1f800 1 -- 172.21.15.142:0/4130588905 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56270125d480 con 0x56270125a440 2024-09-22T08:38:30.521 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.506+0000 7f064d2a1640 1 -- 172.21.15.142:0/4130588905 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0638057030 con 0x56270125a440 2024-09-22T08:38:30.522 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.506+0000 7f0651d1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:30.522 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.506+0000 7f0651d1f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:38:30.522 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.506+0000 7f0651d1f800 20 rados->read ofs=0 len=0 2024-09-22T08:38:30.522 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.506+0000 7f0651d1f800 1 -- 172.21.15.142:0/4130588905 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56270125dd50 con 0x56270125a440 2024-09-22T08:38:30.522 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.507+0000 7f064d2a1640 1 -- 172.21.15.142:0/4130588905 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0638057030 con 0x56270125a440 2024-09-22T08:38:30.522 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.507+0000 7f0651d1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:30.522 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.507+0000 7f0651d1f800 20 rados->read ofs=0 len=0 2024-09-22T08:38:30.522 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.507+0000 7f0651d1f800 1 -- 172.21.15.142:0/4130588905 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56270125e0f0 con 0x56270125a440 2024-09-22T08:38:30.522 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.507+0000 7f064d2a1640 1 -- 172.21.15.142:0/4130588905 <== osd.1 v2:172.21.15.142:6816/3192108003 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0638057030 con 0x56270125a440 2024-09-22T08:38:30.522 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.507+0000 7f0651d1f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:38:30.522 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.507+0000 7f0651d1f800 20 rados->read ofs=0 len=0 2024-09-22T08:38:30.522 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.507+0000 7f0651d1f800 1 --2- 172.21.15.142:0/4130588905 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x56270125ee50 0x562701261240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:30.522 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.507+0000 7f0651d1f800 1 -- 172.21.15.142:0/4130588905 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562701261850 con 0x56270125ee50 2024-09-22T08:38:30.522 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.507+0000 7f064e2a3640 1 --2- 172.21.15.142:0/4130588905 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x56270125ee50 0x562701261240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:30.523 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.507+0000 7f064e2a3640 1 --2- 172.21.15.142:0/4130588905 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x56270125ee50 0x562701261240 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:30.523 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.507+0000 7f064e2a3640 1 -- 172.21.15.142:0/4130588905 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(5 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f064803b070 con 0x56270125ee50 2024-09-22T08:38:30.523 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.507+0000 7f0651d1f800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:38:30.523 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.507+0000 7f0651d1f800 20 searching for the correct realm 2024-09-22T08:38:30.523 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.507+0000 7f0651d1f800 1 -- 172.21.15.142:0/4130588905 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562701263180 con 0x56270125ee50 2024-09-22T08:38:30.523 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.508+0000 7f064e2a3640 1 -- 172.21.15.142:0/4130588905 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f064803b070 con 0x56270125ee50 2024-09-22T08:38:30.523 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.508+0000 7f064e2a3640 1 --2- 172.21.15.142:0/4130588905 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f0648021020 0x7f0648016330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:30.523 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.508+0000 7f064e2a3640 1 -- 172.21.15.142:0/4130588905 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562701263180 con 0x7f0648021020 2024-09-22T08:38:30.523 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.508+0000 7f064daa2640 1 --2- 172.21.15.142:0/4130588905 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f0648021020 0x7f0648016330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:30.523 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.508+0000 7f064daa2640 1 --2- 172.21.15.142:0/4130588905 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f0648021020 0x7f0648016330 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:30.523 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.508+0000 7f064daa2640 1 -- 172.21.15.142:0/4130588905 <== osd.2 v2:172.21.15.142:6808/279438927 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f064001b070 con 0x7f0648021020 2024-09-22T08:38:30.523 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.508+0000 7f064daa2640 1 --2- 172.21.15.142:0/4130588905 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f06400123c0 0x7f06400113e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:30.523 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.508+0000 7f064daa2640 1 -- 172.21.15.142:0/4130588905 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562701263180 con 0x7f06400123c0 2024-09-22T08:38:30.523 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.509+0000 7f064d2a1640 1 --2- 172.21.15.142:0/4130588905 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f06400123c0 0x7f06400113e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:30.524 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.509+0000 7f064d2a1640 1 --2- 172.21.15.142:0/4130588905 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f06400123c0 0x7f06400113e0 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:30.524 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.509+0000 7f064d2a1640 1 -- 172.21.15.142:0/4130588905 <== osd.0 v2:172.21.15.31:6800/168281188 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0638057030 con 0x7f06400123c0 2024-09-22T08:38:30.524 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.509+0000 7f064d2a1640 1 -- 172.21.15.142:0/4130588905 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562701263180 con 0x56270125a440 2024-09-22T08:38:30.524 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.509+0000 7f064d2a1640 1 -- 172.21.15.142:0/4130588905 <== osd.1 v2:172.21.15.142:6816/3192108003 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0638057030 con 0x56270125a440 2024-09-22T08:38:30.524 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.509+0000 7f064d2a1640 1 -- 172.21.15.142:0/4130588905 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562701263180 con 0x56270125a440 2024-09-22T08:38:30.524 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.510+0000 7f064d2a1640 1 -- 172.21.15.142:0/4130588905 <== osd.1 v2:172.21.15.142:6816/3192108003 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0638057030 con 0x56270125a440 2024-09-22T08:38:30.524 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.510+0000 7f064d2a1640 1 -- 172.21.15.142:0/4130588905 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562701263180 con 0x56270125a440 2024-09-22T08:38:30.524 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.510+0000 7f064d2a1640 1 -- 172.21.15.142:0/4130588905 <== osd.1 v2:172.21.15.142:6816/3192108003 7 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0638057030 con 0x56270125a440 2024-09-22T08:38:30.524 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.510+0000 7f064d2a1640 1 -- 172.21.15.142:0/4130588905 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562701263180 con 0x7f06400123c0 2024-09-22T08:38:30.524 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.510+0000 7f064d2a1640 1 -- 172.21.15.142:0/4130588905 <== osd.0 v2:172.21.15.31:6800/168281188 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0638057030 con 0x7f06400123c0 2024-09-22T08:38:30.524 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.510+0000 7f064d2a1640 1 -- 172.21.15.142:0/4130588905 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562701263180 con 0x7f0648021020 2024-09-22T08:38:30.524 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.510+0000 7f064daa2640 1 -- 172.21.15.142:0/4130588905 <== osd.2 v2:172.21.15.142:6808/279438927 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f064001b070 con 0x7f0648021020 2024-09-22T08:38:30.524 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.510+0000 7f064daa2640 1 -- 172.21.15.142:0/4130588905 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562701263180 con 0x56270125ee50 2024-09-22T08:38:30.525 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.511+0000 7f064e2a3640 1 -- 172.21.15.142:0/4130588905 <== osd.3 v2:172.21.15.142:6800/1064901393 3 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f064803b070 con 0x56270125ee50 2024-09-22T08:38:30.525 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.511+0000 7f064e2a3640 1 -- 172.21.15.142:0/4130588905 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562701263180 con 0x56270125a440 2024-09-22T08:38:30.525 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.511+0000 7f064d2a1640 1 -- 172.21.15.142:0/4130588905 <== osd.1 v2:172.21.15.142:6816/3192108003 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0638057030 con 0x56270125a440 2024-09-22T08:38:30.525 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.511+0000 7f064d2a1640 1 -- 172.21.15.142:0/4130588905 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562701263180 con 0x7f06400123c0 2024-09-22T08:38:30.525 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.511+0000 7f064d2a1640 1 -- 172.21.15.142:0/4130588905 <== osd.0 v2:172.21.15.31:6800/168281188 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0638057030 con 0x7f06400123c0 2024-09-22T08:38:30.525 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.511+0000 7f064d2a1640 1 -- 172.21.15.142:0/4130588905 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562701263180 con 0x56270125a440 2024-09-22T08:38:30.525 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.511+0000 7f064d2a1640 1 -- 172.21.15.142:0/4130588905 <== osd.1 v2:172.21.15.142:6816/3192108003 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0638057030 con 0x56270125a440 2024-09-22T08:38:30.525 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.511+0000 7f064d2a1640 1 -- 172.21.15.142:0/4130588905 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562701263180 con 0x7f0648021020 2024-09-22T08:38:30.525 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.512+0000 7f064daa2640 1 -- 172.21.15.142:0/4130588905 <== osd.2 v2:172.21.15.142:6808/279438927 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f064001b070 con 0x7f0648021020 2024-09-22T08:38:30.525 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.512+0000 7f064daa2640 1 -- 172.21.15.142:0/4130588905 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562701263180 con 0x56270125ee50 2024-09-22T08:38:30.525 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.512+0000 7f064e2a3640 1 -- 172.21.15.142:0/4130588905 <== osd.3 v2:172.21.15.142:6800/1064901393 4 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f064803b070 con 0x56270125ee50 2024-09-22T08:38:30.525 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.512+0000 7f064e2a3640 1 -- 172.21.15.142:0/4130588905 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562701263180 con 0x56270125ee50 2024-09-22T08:38:30.525 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.512+0000 7f064e2a3640 1 -- 172.21.15.142:0/4130588905 <== osd.3 v2:172.21.15.142:6800/1064901393 5 ==== osd_op_reply(20 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f064803b070 con 0x56270125ee50 2024-09-22T08:38:30.525 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.512+0000 7f064e2a3640 1 -- 172.21.15.142:0/4130588905 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562701263180 con 0x7f06400123c0 2024-09-22T08:38:30.526 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.512+0000 7f064d2a1640 1 -- 172.21.15.142:0/4130588905 <== osd.0 v2:172.21.15.31:6800/168281188 4 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0638057030 con 0x7f06400123c0 2024-09-22T08:38:30.526 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.512+0000 7f064d2a1640 1 -- 172.21.15.142:0/4130588905 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562701263180 con 0x56270125ee50 2024-09-22T08:38:30.526 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.512+0000 7f064e2a3640 1 -- 172.21.15.142:0/4130588905 <== osd.3 v2:172.21.15.142:6800/1064901393 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f064803b070 con 0x56270125ee50 2024-09-22T08:38:30.526 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.512+0000 7f064e2a3640 1 -- 172.21.15.142:0/4130588905 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562701263180 con 0x56270125ee50 2024-09-22T08:38:30.526 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.513+0000 7f064e2a3640 1 -- 172.21.15.142:0/4130588905 <== osd.3 v2:172.21.15.142:6800/1064901393 7 ==== osd_op_reply(23 [pgnls start_epoch 32 out=107b] v32'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f064803b070 con 0x56270125ee50 2024-09-22T08:38:30.526 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.513+0000 7f064e2a3640 1 -- 172.21.15.142:0/4130588905 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562701263180 con 0x56270125a440 2024-09-22T08:38:30.526 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.513+0000 7f064d2a1640 1 -- 172.21.15.142:0/4130588905 <== osd.1 v2:172.21.15.142:6816/3192108003 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0638057030 con 0x56270125a440 2024-09-22T08:38:30.526 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.513+0000 7f064d2a1640 1 -- 172.21.15.142:0/4130588905 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562701263180 con 0x56270125a440 2024-09-22T08:38:30.526 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.513+0000 7f064d2a1640 1 -- 172.21.15.142:0/4130588905 <== osd.1 v2:172.21.15.142:6816/3192108003 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v32'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f0638057030 con 0x56270125a440 2024-09-22T08:38:30.526 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.513+0000 7f064d2a1640 1 -- 172.21.15.142:0/4130588905 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562701263180 con 0x7f06400123c0 2024-09-22T08:38:30.526 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.513+0000 7f064d2a1640 1 -- 172.21.15.142:0/4130588905 <== osd.0 v2:172.21.15.31:6800/168281188 5 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0638057030 con 0x7f06400123c0 2024-09-22T08:38:30.526 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.513+0000 7f064d2a1640 1 -- 172.21.15.142:0/4130588905 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562701263180 con 0x56270125ee50 2024-09-22T08:38:30.526 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.514+0000 7f064e2a3640 1 -- 172.21.15.142:0/4130588905 <== osd.3 v2:172.21.15.142:6800/1064901393 8 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f064803b070 con 0x56270125ee50 2024-09-22T08:38:30.526 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.514+0000 7f064e2a3640 1 -- 172.21.15.142:0/4130588905 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562701263180 con 0x7f0648021020 2024-09-22T08:38:30.527 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.514+0000 7f064daa2640 1 -- 172.21.15.142:0/4130588905 <== osd.2 v2:172.21.15.142:6808/279438927 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f064001b070 con 0x7f0648021020 2024-09-22T08:38:30.527 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.514+0000 7f064daa2640 1 -- 172.21.15.142:0/4130588905 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562701263180 con 0x56270125a440 2024-09-22T08:38:30.527 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.514+0000 7f064d2a1640 1 -- 172.21.15.142:0/4130588905 <== osd.1 v2:172.21.15.142:6816/3192108003 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0638057030 con 0x56270125a440 2024-09-22T08:38:30.527 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.514+0000 7f064d2a1640 1 -- 172.21.15.142:0/4130588905 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562701263180 con 0x7f06400123c0 2024-09-22T08:38:30.527 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.514+0000 7f064d2a1640 1 -- 172.21.15.142:0/4130588905 <== osd.0 v2:172.21.15.31:6800/168281188 6 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0638057030 con 0x7f06400123c0 2024-09-22T08:38:30.527 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.514+0000 7f064d2a1640 1 -- 172.21.15.142:0/4130588905 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562701263180 con 0x56270125ee50 2024-09-22T08:38:30.527 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.515+0000 7f064e2a3640 1 -- 172.21.15.142:0/4130588905 <== osd.3 v2:172.21.15.142:6800/1064901393 9 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f064803b070 con 0x56270125ee50 2024-09-22T08:38:30.527 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.515+0000 7f064e2a3640 1 -- 172.21.15.142:0/4130588905 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562701263180 con 0x7f06400123c0 2024-09-22T08:38:30.527 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.515+0000 7f064d2a1640 1 -- 172.21.15.142:0/4130588905 <== osd.0 v2:172.21.15.31:6800/168281188 7 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0638057030 con 0x7f06400123c0 2024-09-22T08:38:30.527 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.515+0000 7f064d2a1640 1 -- 172.21.15.142:0/4130588905 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562701263180 con 0x7f0648021020 2024-09-22T08:38:30.527 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.515+0000 7f064daa2640 1 -- 172.21.15.142:0/4130588905 <== osd.2 v2:172.21.15.142:6808/279438927 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f064001b070 con 0x7f0648021020 2024-09-22T08:38:30.527 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.515+0000 7f064daa2640 1 -- 172.21.15.142:0/4130588905 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562701263180 con 0x56270125ee50 2024-09-22T08:38:30.527 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.515+0000 7f064e2a3640 1 -- 172.21.15.142:0/4130588905 <== osd.3 v2:172.21.15.142:6800/1064901393 10 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f064803b070 con 0x56270125ee50 2024-09-22T08:38:30.528 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.515+0000 7f064e2a3640 1 -- 172.21.15.142:0/4130588905 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562701263180 con 0x7f06400123c0 2024-09-22T08:38:30.528 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.516+0000 7f064d2a1640 1 -- 172.21.15.142:0/4130588905 <== osd.0 v2:172.21.15.31:6800/168281188 8 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0638057030 con 0x7f06400123c0 2024-09-22T08:38:30.528 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.516+0000 7f064d2a1640 1 -- 172.21.15.142:0/4130588905 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562701263180 con 0x56270125a440 2024-09-22T08:38:30.528 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.516+0000 7f064d2a1640 1 -- 172.21.15.142:0/4130588905 <== osd.1 v2:172.21.15.142:6816/3192108003 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v32'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f0638057030 con 0x56270125a440 2024-09-22T08:38:30.528 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.516+0000 7f064d2a1640 1 -- 172.21.15.142:0/4130588905 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562701263180 con 0x7f0648021020 2024-09-22T08:38:30.528 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.516+0000 7f064daa2640 1 -- 172.21.15.142:0/4130588905 <== osd.2 v2:172.21.15.142:6808/279438927 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f064001b070 con 0x7f0648021020 2024-09-22T08:38:30.528 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.516+0000 7f0651d1f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:38:30.528 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.516+0000 7f0651d1f800 20 RGWRados::pool_iterate: got zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec 2024-09-22T08:38:30.528 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.516+0000 7f0651d1f800 20 RGWRados::pool_iterate: got zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f 2024-09-22T08:38:30.528 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.516+0000 7f0651d1f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:38:30.528 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.516+0000 7f0651d1f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:38:30.528 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.516+0000 7f0651d1f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:38:30.528 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.516+0000 7f0651d1f800 20 rados->read ofs=0 len=0 2024-09-22T08:38:30.528 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.516+0000 7f0651d1f800 1 -- 172.21.15.142:0/4130588905 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562701262210 con 0x56270125a440 2024-09-22T08:38:30.529 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.516+0000 7f064d2a1640 1 -- 172.21.15.142:0/4130588905 <== osd.1 v2:172.21.15.142:6816/3192108003 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0638057030 con 0x56270125a440 2024-09-22T08:38:30.529 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.516+0000 7f0651d1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:30.529 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.516+0000 7f0651d1f800 20 rados->read ofs=0 len=0 2024-09-22T08:38:30.529 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.516+0000 7f0651d1f800 1 -- 172.21.15.142:0/4130588905 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562701262a60 con 0x56270125a440 2024-09-22T08:38:30.529 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.517+0000 7f064d2a1640 1 -- 172.21.15.142:0/4130588905 <== osd.1 v2:172.21.15.142:6816/3192108003 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0638057030 con 0x56270125a440 2024-09-22T08:38:30.529 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.517+0000 7f0651d1f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:38:30.529 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.517+0000 7f0651d1f800 20 rados->read ofs=0 len=0 2024-09-22T08:38:30.529 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.517+0000 7f0651d1f800 1 -- 172.21.15.142:0/4130588905 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:40 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562701263600 con 0x56270125ee50 2024-09-22T08:38:30.529 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.517+0000 7f064e2a3640 1 -- 172.21.15.142:0/4130588905 <== osd.3 v2:172.21.15.142:6800/1064901393 11 ==== osd_op_reply(40 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f064803b070 con 0x56270125ee50 2024-09-22T08:38:30.529 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.517+0000 7f0651d1f800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:38:30.529 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.517+0000 7f0651d1f800 20 zone default found 2024-09-22T08:38:30.529 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.517+0000 7f0651d1f800 4 Realm: () 2024-09-22T08:38:30.530 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.517+0000 7f0651d1f800 4 ZoneGroup: default (d89f6f57-1007-47dd-9065-f486c7b01aec) 2024-09-22T08:38:30.530 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.517+0000 7f0651d1f800 4 Zone: default (e239248c-0bee-4e41-803a-24b288d3eb8f) 2024-09-22T08:38:30.530 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.517+0000 7f0651d1f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:38:30.530 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.517+0000 7f0651d1f800 20 zonegroup default 2024-09-22T08:38:30.530 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.517+0000 7f0651d1f800 20 rados->read ofs=0 len=0 2024-09-22T08:38:30.530 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.517+0000 7f0651d1f800 1 -- 172.21.15.142:0/4130588905 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5627012639a0 con 0x7f06400123c0 2024-09-22T08:38:30.530 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.517+0000 7f064d2a1640 1 -- 172.21.15.142:0/4130588905 <== osd.0 v2:172.21.15.31:6800/168281188 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f0638057030 con 0x7f06400123c0 2024-09-22T08:38:30.530 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.517+0000 7f0651d1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:30.530 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.517+0000 7f0651d1f800 20 rados->read ofs=0 len=0 2024-09-22T08:38:30.530 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.517+0000 7f0651d1f800 1 -- 172.21.15.142:0/4130588905 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562701265c80 con 0x56270125ee50 2024-09-22T08:38:30.530 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.518+0000 7f064e2a3640 1 -- 172.21.15.142:0/4130588905 <== osd.3 v2:172.21.15.142:6800/1064901393 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f064803b070 con 0x56270125ee50 2024-09-22T08:38:30.530 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.518+0000 7f0651d1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:30.530 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.518+0000 7f0651d1f800 20 rados->read ofs=0 len=0 2024-09-22T08:38:30.530 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.518+0000 7f0651d1f800 1 -- 172.21.15.142:0/4130588905 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562701266020 con 0x56270125ee50 2024-09-22T08:38:30.531 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.518+0000 7f064e2a3640 1 -- 172.21.15.142:0/4130588905 <== osd.3 v2:172.21.15.142:6800/1064901393 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f064803b070 con 0x56270125ee50 2024-09-22T08:38:30.531 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.518+0000 7f0651d1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:30.531 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.518+0000 7f0651d1f800 20 started sync module instance, tier type = 2024-09-22T08:38:30.531 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.518+0000 7f0651d1f800 20 started zone id=e239248c-0bee-4e41-803a-24b288d3eb8f (name=default) with tier type = 2024-09-22T08:38:30.531 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.518+0000 7f0651d1f800 1 -- 172.21.15.142:0/4130588905 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5627012650c0 con 0x7f0648021020 2024-09-22T08:38:30.531 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.519+0000 7f064daa2640 1 -- 172.21.15.142:0/4130588905 <== osd.2 v2:172.21.15.142:6808/279438927 7 ==== osd_op_reply(44 notify.0 [create] v32'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f064001b070 con 0x7f0648021020 2024-09-22T08:38:30.531 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.519+0000 7f0651d1f800 1 -- 172.21.15.142:0/4130588905 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94725523000336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562701266480 con 0x7f0648021020 2024-09-22T08:38:30.531 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.519+0000 7f0651d1f800 1 -- 172.21.15.142:0/4130588905 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562701266cd0 con 0x56270125a440 2024-09-22T08:38:30.535 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.520+0000 7f064daa2640 1 -- 172.21.15.142:0/4130588905 <== osd.2 v2:172.21.15.142:6808/279438927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94725523000336] v32'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f064001b070 con 0x7f0648021020 2024-09-22T08:38:30.535 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.520+0000 7f064d2a1640 1 -- 172.21.15.142:0/4130588905 <== osd.1 v2:172.21.15.142:6816/3192108003 16 ==== osd_op_reply(46 notify.1 [create] v32'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0638057030 con 0x56270125a440 2024-09-22T08:38:30.535 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.520+0000 7f0651d1f800 1 -- 172.21.15.142:0/4130588905 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94725523007520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5627012670f0 con 0x56270125a440 2024-09-22T08:38:30.535 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.520+0000 7f0651d1f800 1 -- 172.21.15.142:0/4130588905 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562701267940 con 0x56270125ee50 2024-09-22T08:38:30.535 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.521+0000 7f064e2a3640 1 -- 172.21.15.142:0/4130588905 <== osd.3 v2:172.21.15.142:6800/1064901393 14 ==== osd_op_reply(48 notify.2 [create] v32'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f064803b070 con 0x56270125ee50 2024-09-22T08:38:30.536 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.521+0000 7f0651d1f800 1 -- 172.21.15.142:0/4130588905 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94725523010256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562701267da0 con 0x56270125ee50 2024-09-22T08:38:30.536 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.521+0000 7f0651d1f800 1 -- 172.21.15.142:0/4130588905 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5627012688c0 con 0x7f0648021020 2024-09-22T08:38:30.536 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.521+0000 7f064d2a1640 1 -- 172.21.15.142:0/4130588905 <== osd.1 v2:172.21.15.142:6816/3192108003 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94725523007520] v32'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0638057030 con 0x56270125a440 2024-09-22T08:38:30.536 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.522+0000 7f064daa2640 1 -- 172.21.15.142:0/4130588905 <== osd.2 v2:172.21.15.142:6808/279438927 9 ==== osd_op_reply(50 notify.3 [create] v32'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f064001b070 con 0x7f0648021020 2024-09-22T08:38:30.536 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.522+0000 7f0651d1f800 1 -- 172.21.15.142:0/4130588905 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94725523014544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562701268880 con 0x7f0648021020 2024-09-22T08:38:30.536 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.522+0000 7f0651d1f800 1 -- 172.21.15.142:0/4130588905 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562701269370 con 0x56270125a440 2024-09-22T08:38:30.536 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.522+0000 7f064e2a3640 1 -- 172.21.15.142:0/4130588905 <== osd.3 v2:172.21.15.142:6800/1064901393 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94725523010256] v32'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f064803b070 con 0x56270125ee50 2024-09-22T08:38:30.536 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.523+0000 7f064daa2640 1 -- 172.21.15.142:0/4130588905 <== osd.2 v2:172.21.15.142:6808/279438927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94725523014544] v32'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f064001b070 con 0x7f0648021020 2024-09-22T08:38:30.536 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.524+0000 7f064d2a1640 1 -- 172.21.15.142:0/4130588905 <== osd.1 v2:172.21.15.142:6816/3192108003 18 ==== osd_op_reply(52 notify.4 [create] v32'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0638057030 con 0x56270125a440 2024-09-22T08:38:30.536 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.524+0000 7f0651d1f800 1 -- 172.21.15.142:0/4130588905 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94725523008576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562701269370 con 0x56270125a440 2024-09-22T08:38:30.536 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.524+0000 7f0651d1f800 1 -- 172.21.15.142:0/4130588905 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562701269c40 con 0x7f06400123c0 2024-09-22T08:38:30.536 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.525+0000 7f064d2a1640 1 -- 172.21.15.142:0/4130588905 <== osd.1 v2:172.21.15.142:6816/3192108003 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94725523008576] v32'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0638057030 con 0x56270125a440 2024-09-22T08:38:30.536 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.525+0000 7f064d2a1640 1 -- 172.21.15.142:0/4130588905 <== osd.0 v2:172.21.15.31:6800/168281188 10 ==== osd_op_reply(54 notify.5 [create] v32'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0638057030 con 0x7f06400123c0 2024-09-22T08:38:30.537 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.525+0000 7f0651d1f800 1 -- 172.21.15.142:0/4130588905 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94725523017344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562701269820 con 0x7f06400123c0 2024-09-22T08:38:30.537 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.525+0000 7f0651d1f800 1 -- 172.21.15.142:0/4130588905 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56270126a2f0 con 0x7f06400123c0 2024-09-22T08:38:30.537 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.526+0000 7f064d2a1640 1 -- 172.21.15.142:0/4130588905 <== osd.0 v2:172.21.15.31:6800/168281188 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94725523017344] v32'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0638057030 con 0x7f06400123c0 2024-09-22T08:38:30.537 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.526+0000 7f064d2a1640 1 -- 172.21.15.142:0/4130588905 <== osd.0 v2:172.21.15.31:6800/168281188 12 ==== osd_op_reply(56 notify.6 [create] v32'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0638057030 con 0x7f06400123c0 2024-09-22T08:38:30.537 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.526+0000 7f0651d1f800 1 -- 172.21.15.142:0/4130588905 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94725523021280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56270126a4d0 con 0x7f06400123c0 2024-09-22T08:38:30.537 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.526+0000 7f0651d1f800 1 -- 172.21.15.142:0/4130588905 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56270126ad20 con 0x7f06400123c0 2024-09-22T08:38:30.537 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.527+0000 7f064d2a1640 1 -- 172.21.15.142:0/4130588905 <== osd.0 v2:172.21.15.31:6800/168281188 13 ==== osd_op_reply(58 notify.7 [create] v32'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0638057030 con 0x7f06400123c0 2024-09-22T08:38:30.537 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.527+0000 7f0651d1f800 1 -- 172.21.15.142:0/4130588905 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94725523023536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56270126b100 con 0x7f06400123c0 2024-09-22T08:38:30.537 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.527+0000 7f0651d1f800 20 add_watcher() i=0 2024-09-22T08:38:30.537 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.527+0000 7f064d2a1640 1 -- 172.21.15.142:0/4130588905 <== osd.0 v2:172.21.15.31:6800/168281188 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94725523021280] v32'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0638057030 con 0x7f06400123c0 2024-09-22T08:38:30.537 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.527+0000 7f0651d1f800 20 add_watcher() i=1 2024-09-22T08:38:30.537 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.527+0000 7f0651d1f800 20 add_watcher() i=2 2024-09-22T08:38:30.537 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.527+0000 7f0651d1f800 20 add_watcher() i=3 2024-09-22T08:38:30.537 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.527+0000 7f0651d1f800 20 add_watcher() i=4 2024-09-22T08:38:30.538 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.527+0000 7f0651d1f800 20 add_watcher() i=5 2024-09-22T08:38:30.538 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.527+0000 7f0651d1f800 20 add_watcher() i=6 2024-09-22T08:38:30.538 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.528+0000 7f064d2a1640 1 -- 172.21.15.142:0/4130588905 <== osd.0 v2:172.21.15.31:6800/168281188 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94725523023536] v32'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0638057030 con 0x7f06400123c0 2024-09-22T08:38:30.538 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.528+0000 7f0651d1f800 20 add_watcher() i=7 2024-09-22T08:38:30.538 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.528+0000 7f0651d1f800 2 all 8 watchers are set, enabling cache 2024-09-22T08:38:30.538 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.528+0000 7f0651d1f800 1 -- 172.21.15.142:0/4130588905 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562701269470 con 0x56270125a440 2024-09-22T08:38:30.538 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.529+0000 7f064d2a1640 1 -- 172.21.15.142:0/4130588905 <== osd.1 v2:172.21.15.142:6816/3192108003 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f0638057030 con 0x56270125a440 2024-09-22T08:38:30.538 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.529+0000 7f0651d1f800 1 -- 172.21.15.142:0/4130588905 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94725523024784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56270126baa0 con 0x56270125a440 2024-09-22T08:38:30.538 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.530+0000 7f064d2a1640 1 -- 172.21.15.142:0/4130588905 <== osd.1 v2:172.21.15.142:6816/3192108003 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94725523024784] v32'260 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f063807f040 con 0x56270125a440 2024-09-22T08:38:30.538 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.530+0000 7f04ff7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:38:30.538 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.530+0000 7f0651d1f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:38:30.538 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.530+0000 7f0651d1f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:38:30.538 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.530+0000 7f0651d1f800 5 note: GC not initialized 2024-09-22T08:38:30.539 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.530+0000 7f04fe7fc640 20 reqs_thread_entry: start 2024-09-22T08:38:30.539 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.530+0000 7f0651d1f800 20 init_complete bucket index max shards: 11 2024-09-22T08:38:30.539 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.530+0000 7f0651d1f800 20 Filter name: none 2024-09-22T08:38:30.539 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.530+0000 7f046ffff640 20 reqs_thread_entry: start 2024-09-22T08:38:30.539 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.530+0000 7f0651d1f800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-22T08:38:30.539 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.530+0000 7f0651d1f800 20 rados->read ofs=0 len=0 2024-09-22T08:38:30.539 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.530+0000 7f0651d1f800 1 -- 172.21.15.142:0/4130588905 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5627012a1a00 con 0x7f06400123c0 2024-09-22T08:38:30.539 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.534+0000 7f064d2a1640 1 -- 172.21.15.142:0/4130588905 <== osd.0 v2:172.21.15.31:6800/168281188 16 ==== osd_op_reply(62 ada [call out=48b,read 0~490 out=490b,getxattrs out=75b] v0'0 uv6 ondisk = 0) ==== 231+0+613 (crc 0 0 0) 0x7f063807f040 con 0x7f06400123c0 2024-09-22T08:38:30.539 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.534+0000 7f0651d1f800 20 rados_obj.operate() r=0 bl.length=490 2024-09-22T08:38:30.539 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.534+0000 7f0651d1f800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-22T08:38:30.539 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.534+0000 7f0651d1f800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-22T08:38:30.539 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.534+0000 7f0651d1f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:38:30.539 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.534+0000 7f0651d1f800 1 -- 172.21.15.142:0/4130588905 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~490 in=490b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5627012a8100 con 0x7f06400123c0 2024-09-22T08:38:30.541 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.536+0000 7f064d2a1640 1 -- 172.21.15.142:0/4130588905 <== osd.0 v2:172.21.15.31:6800/168281188 17 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~490] v32'7 uv7 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f063807f040 con 0x7f06400123c0 2024-09-22T08:38:30.541 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.536+0000 7f0651d1f800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-22T08:38:30.541 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.536+0000 7f0651d1f800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-22T08:38:30.541 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.536+0000 7f0651d1f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-22T08:38:30.541 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.536+0000 7f0651d1f800 1 -- 172.21.15.142:0/4130588905 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94725523274496 in=678b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5627012a3780 con 0x56270125a440 2024-09-22T08:38:30.541 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.536+0000 7f064d2a1640 1 -- 172.21.15.142:0/4130588905 <== osd.1 v2:172.21.15.142:6816/3192108003 22 ==== watch-notify(notify (1) cookie 94725523008576 notify 137438953497 ret 0) ==== 708+0+0 (crc 0 0 0) 0x5627011270e0 con 0x56270125a440 2024-09-22T08:38:30.541 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.536+0000 7f05317fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953497 cookie 94725523008576 notifier 4877 bl.length()=666 2024-09-22T08:38:30.541 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.536+0000 7f05317fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-22T08:38:30.541 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.536+0000 7f05317fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-22T08:38:30.541 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.536+0000 7f064d2a1640 1 -- 172.21.15.142:0/4130588905 <== osd.1 v2:172.21.15.142:6816/3192108003 23 ==== osd_op_reply(64 notify.4 [notify cookie 94725523274496 out=8b] v0'0 uv261 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f063807f040 con 0x56270125a440 2024-09-22T08:38:30.542 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.536+0000 7f05317fa640 1 -- 172.21.15.142:0/4130588905 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f0510003ea0 con 0x56270125a440 2024-09-22T08:38:30.542 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.536+0000 7f064d2a1640 1 -- 172.21.15.142:0/4130588905 <== osd.1 v2:172.21.15.142:6816/3192108003 24 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f063807f040 con 0x56270125a440 2024-09-22T08:38:30.542 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.537+0000 7f064d2a1640 1 -- 172.21.15.142:0/4130588905 <== osd.1 v2:172.21.15.142:6816/3192108003 25 ==== watch-notify(notify_complete (2) cookie 94725523274496 notify 137438953497 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f063805bd30 con 0x56270125a440 2024-09-22T08:38:30.542 INFO:teuthology.orchestra.run.smithi142.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-22T08:38:29.459914Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"user-info-without-keys","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-22T08:38:29.459903Z","tags":[],"group_ids":[]} 2024-09-22T08:38:30.543 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.537+0000 7f04ff7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:38:30.543 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.537+0000 7f0651d1f800 1 -- 172.21.15.142:0/4130588905 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94725523024784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56270129f730 con 0x56270125a440 2024-09-22T08:38:30.544 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.538+0000 7f064d2a1640 1 -- 172.21.15.142:0/4130588905 <== osd.1 v2:172.21.15.142:6816/3192108003 26 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94725523024784] v32'261 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f063807f040 con 0x56270125a440 2024-09-22T08:38:30.544 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.538+0000 7f0651d1f800 1 -- 172.21.15.142:0/4130588905 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94725523000336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56270129f730 con 0x7f0648021020 2024-09-22T08:38:30.544 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.540+0000 7f064daa2640 1 -- 172.21.15.142:0/4130588905 <== osd.2 v2:172.21.15.142:6808/279438927 11 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94725523000336] v32'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f064001b070 con 0x7f0648021020 2024-09-22T08:38:30.544 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.540+0000 7f0651d1f800 20 remove_watcher() i=0 2024-09-22T08:38:30.544 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.540+0000 7f0651d1f800 2 removed watcher, disabling cache 2024-09-22T08:38:30.544 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.540+0000 7f0651d1f800 1 -- 172.21.15.142:0/4130588905 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94725523007520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56270129f730 con 0x56270125a440 2024-09-22T08:38:30.544 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.541+0000 7f064d2a1640 1 -- 172.21.15.142:0/4130588905 <== osd.1 v2:172.21.15.142:6816/3192108003 27 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94725523007520] v32'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f063807f040 con 0x56270125a440 2024-09-22T08:38:30.544 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.541+0000 7f0651d1f800 20 remove_watcher() i=1 2024-09-22T08:38:30.544 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.541+0000 7f0651d1f800 1 -- 172.21.15.142:0/4130588905 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94725523010256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56270129f730 con 0x56270125ee50 2024-09-22T08:38:30.544 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.542+0000 7f064e2a3640 1 -- 172.21.15.142:0/4130588905 <== osd.3 v2:172.21.15.142:6800/1064901393 16 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94725523010256] v32'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f064803b070 con 0x56270125ee50 2024-09-22T08:38:30.544 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.542+0000 7f0651d1f800 20 remove_watcher() i=2 2024-09-22T08:38:30.544 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.542+0000 7f0651d1f800 1 -- 172.21.15.142:0/4130588905 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94725523014544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56270129f730 con 0x7f0648021020 2024-09-22T08:38:30.545 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.543+0000 7f064daa2640 1 -- 172.21.15.142:0/4130588905 <== osd.2 v2:172.21.15.142:6808/279438927 12 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94725523014544] v32'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f064001b070 con 0x7f0648021020 2024-09-22T08:38:30.545 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.543+0000 7f0651d1f800 20 remove_watcher() i=3 2024-09-22T08:38:30.545 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.543+0000 7f0651d1f800 1 -- 172.21.15.142:0/4130588905 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94725523008576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56270129f730 con 0x56270125a440 2024-09-22T08:38:30.546 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.544+0000 7f064d2a1640 1 -- 172.21.15.142:0/4130588905 <== osd.1 v2:172.21.15.142:6816/3192108003 28 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94725523008576] v32'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f063807f040 con 0x56270125a440 2024-09-22T08:38:30.546 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.544+0000 7f0651d1f800 20 remove_watcher() i=4 2024-09-22T08:38:30.546 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.544+0000 7f0651d1f800 1 -- 172.21.15.142:0/4130588905 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94725523017344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56270129f730 con 0x7f06400123c0 2024-09-22T08:38:30.547 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.546+0000 7f064d2a1640 1 -- 172.21.15.142:0/4130588905 <== osd.0 v2:172.21.15.31:6800/168281188 18 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94725523017344] v32'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f063807f040 con 0x7f06400123c0 2024-09-22T08:38:30.547 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.546+0000 7f0651d1f800 20 remove_watcher() i=5 2024-09-22T08:38:30.547 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.546+0000 7f0651d1f800 1 -- 172.21.15.142:0/4130588905 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94725523021280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56270129f730 con 0x7f06400123c0 2024-09-22T08:38:30.548 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.547+0000 7f064d2a1640 1 -- 172.21.15.142:0/4130588905 <== osd.0 v2:172.21.15.31:6800/168281188 19 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94725523021280] v32'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f063807f040 con 0x7f06400123c0 2024-09-22T08:38:30.548 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.547+0000 7f0651d1f800 20 remove_watcher() i=6 2024-09-22T08:38:30.549 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.547+0000 7f0651d1f800 1 -- 172.21.15.142:0/4130588905 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94725523023536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56270129f730 con 0x7f06400123c0 2024-09-22T08:38:30.551 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.548+0000 7f064d2a1640 1 -- 172.21.15.142:0/4130588905 <== osd.0 v2:172.21.15.31:6800/168281188 20 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94725523023536] v32'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f063807f040 con 0x7f06400123c0 2024-09-22T08:38:30.552 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.548+0000 7f0651d1f800 20 remove_watcher() i=7 2024-09-22T08:38:30.552 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.548+0000 7f0651d1f800 1 -- 172.21.15.142:0/4130588905 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f06400123c0 msgr2=0x7f06400113e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:30.552 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.548+0000 7f0651d1f800 1 --2- 172.21.15.142:0/4130588905 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f06400123c0 0x7f06400113e0 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:30.552 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.548+0000 7f0651d1f800 1 -- 172.21.15.142:0/4130588905 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x56270125a440 msgr2=0x56270125c900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:30.552 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.548+0000 7f0651d1f800 1 --2- 172.21.15.142:0/4130588905 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x56270125a440 0x56270125c900 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:30.552 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.548+0000 7f0651d1f800 1 -- 172.21.15.142:0/4130588905 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f0648021020 msgr2=0x7f0648016330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:30.552 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.548+0000 7f0651d1f800 1 --2- 172.21.15.142:0/4130588905 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f0648021020 0x7f0648016330 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:30.552 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.548+0000 7f0651d1f800 1 -- 172.21.15.142:0/4130588905 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x56270125ee50 msgr2=0x562701261240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:30.552 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.548+0000 7f0651d1f800 1 --2- 172.21.15.142:0/4130588905 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x56270125ee50 0x562701261240 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:30.552 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.549+0000 7f0651d1f800 1 -- 172.21.15.142:0/4130588905 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f051803cfb0 msgr2=0x7f051803f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:30.552 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.549+0000 7f0651d1f800 1 --2- 172.21.15.142:0/4130588905 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f051803cfb0 0x7f051803f470 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f0640014ff0 tx=0x7f0640037420 comp rx=0 tx=0).stop 2024-09-22T08:38:30.552 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.549+0000 7f0651d1f800 1 -- 172.21.15.142:0/4130588905 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562701247530 msgr2=0x56270124eb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:30.553 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.549+0000 7f0651d1f800 1 --2- 172.21.15.142:0/4130588905 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562701247530 0x56270124eb10 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f0648054070 tx=0x7f0648053dc0 comp rx=0 tx=0).stop 2024-09-22T08:38:30.553 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.549+0000 7f064d2a1640 1 -- 172.21.15.142:0/4130588905 reap_dead start 2024-09-22T08:38:30.553 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.549+0000 7f064d2a1640 1 -- 172.21.15.142:0/4130588905 reap_dead start 2024-09-22T08:38:30.553 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.549+0000 7f0651d1f800 1 -- 172.21.15.142:0/4130588905 shutdown_connections 2024-09-22T08:38:30.553 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.549+0000 7f0651d1f800 1 -- 172.21.15.142:0/4130588905 >> 172.21.15.142:0/4130588905 conn(0x562701243930 msgr2=0x562701241b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:38:30.553 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.549+0000 7f0651d1f800 1 -- 172.21.15.142:0/4130588905 shutdown_connections 2024-09-22T08:38:30.553 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.549+0000 7f0651d1f800 1 -- 172.21.15.142:0/4130588905 wait complete. 2024-09-22T08:38:30.553 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.549+0000 7f0651d1f800 1 -- 172.21.15.142:0/2817938040 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f052803cfb0 msgr2=0x7f052803f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:30.553 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.549+0000 7f0651d1f800 1 --2- 172.21.15.142:0/2817938040 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f052803cfb0 0x7f052803f470 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f0640029970 tx=0x7f0640003f60 comp rx=0 tx=0).stop 2024-09-22T08:38:30.553 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.549+0000 7f0651d1f800 1 -- 172.21.15.142:0/2817938040 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56270123aad0 msgr2=0x56270123aef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:30.553 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.549+0000 7f0651d1f800 1 --2- 172.21.15.142:0/2817938040 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56270123aad0 0x56270123aef0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x562701128160 tx=0x7f064800bf30 comp rx=0 tx=0).stop 2024-09-22T08:38:30.553 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.549+0000 7f0651d1f800 1 -- 172.21.15.142:0/2817938040 shutdown_connections 2024-09-22T08:38:30.553 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.549+0000 7f0651d1f800 1 --2- 172.21.15.142:0/2817938040 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f052803cfb0 0x7f052803f470 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:30.554 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.549+0000 7f0651d1f800 1 --2- 172.21.15.142:0/2817938040 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56270123aad0 0x56270123aef0 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:30.554 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.549+0000 7f0651d1f800 1 -- 172.21.15.142:0/2817938040 >> 172.21.15.142:0/2817938040 conn(0x56270122ee80 msgr2=0x56270122f260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:38:30.555 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.549+0000 7f0651d1f800 1 -- 172.21.15.142:0/2817938040 shutdown_connections 2024-09-22T08:38:30.555 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.549+0000 7f0651d1f800 1 -- 172.21.15.142:0/2817938040 wait complete. 2024-09-22T08:38:30.555 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.549+0000 7f0651d1f800 1 -- 172.21.15.142:0/1553162748 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x562701127cb0 msgr2=0x562701226e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:30.556 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.549+0000 7f0651d1f800 1 --2- 172.21.15.142:0/1553162748 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x562701127cb0 0x562701226e70 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:30.556 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.549+0000 7f0651d1f800 1 -- 172.21.15.142:0/1553162748 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x562701229650 msgr2=0x56270122ba40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:30.556 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.549+0000 7f0651d1f800 1 --2- 172.21.15.142:0/1553162748 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x562701229650 0x56270122ba40 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:30.556 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.549+0000 7f0651d1f800 1 -- 172.21.15.142:0/1553162748 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f053403cfb0 msgr2=0x7f053403f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:30.556 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.549+0000 7f0651d1f800 1 --2- 172.21.15.142:0/1553162748 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f053403cfb0 0x7f053403f470 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f0638057000 tx=0x7f0638052000 comp rx=0 tx=0).stop 2024-09-22T08:38:30.556 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.549+0000 7f0651d1f800 1 -- 172.21.15.142:0/1553162748 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5627011269e0 msgr2=0x56270109c260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:30.556 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.549+0000 7f0651d1f800 1 --2- 172.21.15.142:0/1553162748 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5627011269e0 0x56270109c260 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f0640001330 tx=0x7f0640001250 comp rx=0 tx=0).stop 2024-09-22T08:38:30.556 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.550+0000 7f0651d1f800 1 -- 172.21.15.142:0/1553162748 shutdown_connections 2024-09-22T08:38:30.556 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.550+0000 7f0651d1f800 1 --2- 172.21.15.142:0/1553162748 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x562701229650 0x56270122ba40 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:30.556 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.550+0000 7f0651d1f800 1 --2- 172.21.15.142:0/1553162748 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x562701127cb0 0x562701226e70 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:30.556 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.550+0000 7f0651d1f800 1 --2- 172.21.15.142:0/1553162748 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f053403cfb0 0x7f053403f470 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:30.556 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.550+0000 7f0651d1f800 1 --2- 172.21.15.142:0/1553162748 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5627011269e0 0x56270109c260 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:30.556 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.550+0000 7f0651d1f800 1 -- 172.21.15.142:0/1553162748 >> 172.21.15.142:0/1553162748 conn(0x562701121db0 msgr2=0x562701217310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:38:30.557 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.550+0000 7f0651d1f800 1 -- 172.21.15.142:0/1553162748 shutdown_connections 2024-09-22T08:38:30.557 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.550+0000 7f0651d1f800 1 -- 172.21.15.142:0/1553162748 wait complete. 2024-09-22T08:38:30.559 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-22T08:38:29.459914Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-22T08:38:29.459903Z', 'tags': [], 'group_ids': []} 2024-09-22T08:38:30.559 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-22T08:38:29.459914Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-22T08:38:29.459903Z', 'tags': [], 'group_ids': []} 2024-09-22T08:38:30.560 ERROR:root:0 2024-09-22T08:38:30.560 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-22T08:38:30.564 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-22T08:38:30.564 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-22T08:38:30.564 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-22T08:38:30.564 DEBUG:teuthology.orchestra.run.smithi142:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps 'users=read, write' 2024-09-22T08:38:30.610 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:38:30.610 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:38:30.611 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.610+0000 7f5dc5132800 1 Processor -- start 2024-09-22T08:38:30.611 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.610+0000 7f5dc5132800 1 -- start start 2024-09-22T08:38:30.611 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.610+0000 7f5dc5132800 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55d1a4b57c00 0x55d1a4b5a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:30.611 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.610+0000 7f5dc5132800 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55d1a49dca20 con 0x55d1a4ac5530 2024-09-22T08:38:30.612 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.610+0000 7f5dc5132800 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x55d1a49dc7d0 con 0x55d1a4b57c00 2024-09-22T08:38:30.612 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.611+0000 7f5dbbfff640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55d1a4b57c00 0x55d1a4b5a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:30.613 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.611+0000 7f5dc0dbc640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x55d1a4ac5530 0x55d1a4b564b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.142:50514/0 (socket says 172.21.15.142:50514) 2024-09-22T08:38:30.613 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.611+0000 7f5dbbfff640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55d1a4b57c00 0x55d1a4b5a0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:52010/0 (socket says 172.21.15.142:52010) 2024-09-22T08:38:30.613 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.611+0000 7f5dc0dbc640 1 -- 172.21.15.142:0/2401145218 learned_addr learned my addr 172.21.15.142:0/2401145218 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-09-22T08:38:30.613 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.611+0000 7f5dbb7fe640 1 -- 172.21.15.142:0/2401145218 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 579276299 0 0) 0x55d1a49dca20 con 0x55d1a4ac5530 2024-09-22T08:38:30.613 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.611+0000 7f5dbb7fe640 1 -- 172.21.15.142:0/2401145218 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5db0001e10 con 0x55d1a4ac5530 2024-09-22T08:38:30.613 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.611+0000 7f5dbbfff640 1 -- 172.21.15.142:0/2401145218 >> v1:172.21.15.31:6789/0 conn(0x55d1a4ac5530 legacy=0x55d1a4b564b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:30.613 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.611+0000 7f5dbbfff640 1 -- 172.21.15.142:0/2401145218 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d1a4b5b7d0 con 0x55d1a4b57c00 2024-09-22T08:38:30.614 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.613+0000 7f5dbbfff640 1 --2- 172.21.15.142:0/2401145218 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d1a4b57c00 0x55d1a4b5a0c0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f5dac00a470 tx=0x7f5dac045920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1357dbda8ce6b227 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:30.614 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.613+0000 7f5dbb7fe640 1 -- 172.21.15.142:0/2401145218 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5dac059070 con 0x55d1a4b57c00 2024-09-22T08:38:30.614 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.613+0000 7f5dbb7fe640 1 -- 172.21.15.142:0/2401145218 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5dac054570 con 0x55d1a4b57c00 2024-09-22T08:38:30.614 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.613+0000 7f5dbb7fe640 1 -- 172.21.15.142:0/2401145218 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5dac054870 con 0x55d1a4b57c00 2024-09-22T08:38:30.615 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.613+0000 7f5dc5132800 1 -- 172.21.15.142:0/2401145218 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d1a4b57c00 msgr2=0x55d1a4b5a0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:30.615 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.613+0000 7f5dc5132800 1 --2- 172.21.15.142:0/2401145218 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d1a4b57c00 0x55d1a4b5a0c0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f5dac00a470 tx=0x7f5dac045920 comp rx=0 tx=0).stop 2024-09-22T08:38:30.615 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.614+0000 7f5dc5132800 1 -- 172.21.15.142:0/2401145218 shutdown_connections 2024-09-22T08:38:30.615 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.614+0000 7f5dc5132800 1 --2- 172.21.15.142:0/2401145218 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d1a4b57c00 0x55d1a4b5a0c0 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:30.615 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.614+0000 7f5dc5132800 1 -- 172.21.15.142:0/2401145218 >> 172.21.15.142:0/2401145218 conn(0x55d1a4b4bbe0 msgr2=0x55d1a4b4e020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:38:30.616 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.614+0000 7f5dc5132800 1 -- 172.21.15.142:0/2401145218 shutdown_connections 2024-09-22T08:38:30.616 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.614+0000 7f5dc5132800 1 -- 172.21.15.142:0/2401145218 wait complete. 2024-09-22T08:38:30.629 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.627+0000 7f5dc5132800 1 Processor -- start 2024-09-22T08:38:30.629 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.627+0000 7f5dc5132800 1 -- start start 2024-09-22T08:38:30.630 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.627+0000 7f5dc5132800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d1a4ac5530 0x55d1a4c43090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:30.630 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.627+0000 7f5dc5132800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55d1a49e9dd0 con 0x55d1a4ac5530 2024-09-22T08:38:30.630 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.628+0000 7f5dc0dbc640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d1a4ac5530 0x55d1a4c43090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:30.630 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.628+0000 7f5dc0dbc640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d1a4ac5530 0x55d1a4c43090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:52026/0 (socket says 172.21.15.142:52026) 2024-09-22T08:38:30.630 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.628+0000 7f5dc0dbc640 1 -- 172.21.15.142:0/3902272717 learned_addr learned my addr 172.21.15.142:0/3902272717 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:38:30.630 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.628+0000 7f5dc0dbc640 1 -- 172.21.15.142:0/3902272717 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d1a4c43680 con 0x55d1a4ac5530 2024-09-22T08:38:30.630 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.628+0000 7f5dc0dbc640 1 --2- 172.21.15.142:0/3902272717 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d1a4ac5530 0x55d1a4c43090 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f5db4001e30 tx=0x7f5db400b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=655622f2dec9e1c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:30.630 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.628+0000 7f5caee05640 1 -- 172.21.15.142:0/3902272717 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5db4012020 con 0x55d1a4ac5530 2024-09-22T08:38:30.630 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.628+0000 7f5caee05640 1 -- 172.21.15.142:0/3902272717 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5db400e470 con 0x55d1a4ac5530 2024-09-22T08:38:30.630 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.628+0000 7f5caee05640 1 -- 172.21.15.142:0/3902272717 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5db400e790 con 0x55d1a4ac5530 2024-09-22T08:38:30.632 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.629+0000 7f5dc5132800 1 -- 172.21.15.142:0/3902272717 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d1a4ac5530 msgr2=0x55d1a4c43090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:30.632 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.629+0000 7f5dc5132800 1 --2- 172.21.15.142:0/3902272717 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d1a4ac5530 0x55d1a4c43090 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f5db4001e30 tx=0x7f5db400b780 comp rx=0 tx=0).stop 2024-09-22T08:38:30.632 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.629+0000 7f5dc5132800 1 -- 172.21.15.142:0/3902272717 shutdown_connections 2024-09-22T08:38:30.632 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.629+0000 7f5dc5132800 1 --2- 172.21.15.142:0/3902272717 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d1a4ac5530 0x55d1a4c43090 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:30.632 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.629+0000 7f5dc5132800 1 -- 172.21.15.142:0/3902272717 >> 172.21.15.142:0/3902272717 conn(0x55d1a4b4bbe0 msgr2=0x55d1a4c3ea10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:38:30.632 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.629+0000 7f5dc5132800 1 -- 172.21.15.142:0/3902272717 shutdown_connections 2024-09-22T08:38:30.633 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.629+0000 7f5dc5132800 1 -- 172.21.15.142:0/3902272717 wait complete. 2024-09-22T08:38:30.633 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.629+0000 7f5dc5132800 1 Processor -- start 2024-09-22T08:38:30.633 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.630+0000 7f5dc5132800 1 -- start start 2024-09-22T08:38:30.633 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.630+0000 7f5dc5132800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d1a4ac5530 0x55d1a4c4abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:30.633 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.630+0000 7f5dc5132800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55d1a4b5aa70 con 0x55d1a4ac5530 2024-09-22T08:38:30.633 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.630+0000 7f5dc0dbc640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d1a4ac5530 0x55d1a4c4abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:30.633 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.630+0000 7f5dc0dbc640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d1a4ac5530 0x55d1a4c4abb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:52028/0 (socket says 172.21.15.142:52028) 2024-09-22T08:38:30.633 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.630+0000 7f5dc0dbc640 1 -- 172.21.15.142:0/1142434597 learned_addr learned my addr 172.21.15.142:0/1142434597 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:38:30.633 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.630+0000 7f5dc0dbc640 1 -- 172.21.15.142:0/1142434597 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d1a4c4b110 con 0x55d1a4ac5530 2024-09-22T08:38:30.633 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.630+0000 7f5dc0dbc640 1 --2- 172.21.15.142:0/1142434597 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d1a4ac5530 0x55d1a4c4abb0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x55d1a4c44020 tx=0x7f5db40040e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:30.633 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.630+0000 7f5cad602640 1 -- 172.21.15.142:0/1142434597 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5db4012030 con 0x55d1a4ac5530 2024-09-22T08:38:30.633 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.631+0000 7f5cad602640 1 -- 172.21.15.142:0/1142434597 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5db401a7a0 con 0x55d1a4ac5530 2024-09-22T08:38:30.633 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.631+0000 7f5cad602640 1 -- 172.21.15.142:0/1142434597 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5db401aaa0 con 0x55d1a4ac5530 2024-09-22T08:38:30.634 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.631+0000 7f5dc5132800 1 -- 172.21.15.142:0/1142434597 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d1a4c4b3a0 con 0x55d1a4ac5530 2024-09-22T08:38:30.634 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.631+0000 7f5dc5132800 1 -- 172.21.15.142:0/1142434597 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d1a4c4bda0 con 0x55d1a4ac5530 2024-09-22T08:38:30.636 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.631+0000 7f5cad602640 1 -- 172.21.15.142:0/1142434597 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f5db4015020 con 0x55d1a4ac5530 2024-09-22T08:38:30.636 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.632+0000 7f5cad602640 1 --2- 172.21.15.142:0/1142434597 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f5ca803d000 0x7f5ca803f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:30.636 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.632+0000 7f5cad602640 1 -- 172.21.15.142:0/1142434597 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5938+0+0 (secure 0 0 0) 0x7f5db4020070 con 0x55d1a4ac5530 2024-09-22T08:38:30.636 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.632+0000 7f5dbbfff640 1 --2- 172.21.15.142:0/1142434597 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f5ca803d000 0x7f5ca803f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:30.637 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.632+0000 7f5dc5132800 1 --2- 172.21.15.142:0/1142434597 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55d1a4b57c00 0x55d1a4c52200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:30.637 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.632+0000 7f5dc5132800 1 -- 172.21.15.142:0/1142434597 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d1a4c4c990 con 0x55d1a4b57c00 2024-09-22T08:38:30.637 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.632+0000 7f5dc15bd640 1 --2- 172.21.15.142:0/1142434597 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55d1a4b57c00 0x55d1a4c52200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:30.637 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.632+0000 7f5dbbfff640 1 --2- 172.21.15.142:0/1142434597 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f5ca803d000 0x7f5ca803f4c0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x55d1a4ac48c0 tx=0x7f5dac050000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:30.637 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.632+0000 7f5dc15bd640 1 --2- 172.21.15.142:0/1142434597 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55d1a4b57c00 0x55d1a4c52200 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:30.637 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.633+0000 7f5dc15bd640 1 -- 172.21.15.142:0/1142434597 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5dbc00a4d0 con 0x55d1a4b57c00 2024-09-22T08:38:30.637 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.633+0000 7f5dc5132800 1 -- 172.21.15.142:0/1142434597 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d1a4c4c280 con 0x55d1a4b57c00 2024-09-22T08:38:30.637 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.633+0000 7f5dc15bd640 1 -- 172.21.15.142:0/1142434597 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5dbc00a4d0 con 0x55d1a4b57c00 2024-09-22T08:38:30.637 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.633+0000 7f5dc5132800 1 --2- 172.21.15.142:0/1142434597 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55d1a4c546f0 0x55d1a4c56ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:30.637 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.633+0000 7f5dc5132800 1 -- 172.21.15.142:0/1142434597 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:3 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d1a4c571b0 con 0x55d1a4c546f0 2024-09-22T08:38:30.637 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.633+0000 7f5dc0dbc640 1 --2- 172.21.15.142:0/1142434597 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55d1a4c546f0 0x55d1a4c56ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:30.637 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.633+0000 7f5dc0dbc640 1 --2- 172.21.15.142:0/1142434597 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55d1a4c546f0 0x55d1a4c56ae0 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:30.637 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.634+0000 7f5dc0dbc640 1 -- 172.21.15.142:0/1142434597 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(3 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f5db4018950 con 0x55d1a4c546f0 2024-09-22T08:38:30.638 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.634+0000 7f5dc5132800 1 -- 172.21.15.142:0/1142434597 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d1a4c53590 con 0x55d1a4b57c00 2024-09-22T08:38:30.638 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.634+0000 7f5dc15bd640 1 -- 172.21.15.142:0/1142434597 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5dbc00a4d0 con 0x55d1a4b57c00 2024-09-22T08:38:30.638 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.634+0000 7f5dc5132800 1 -- 172.21.15.142:0/1142434597 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d1a4c53a30 con 0x55d1a4c546f0 2024-09-22T08:38:30.638 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.634+0000 7f5dc0dbc640 1 -- 172.21.15.142:0/1142434597 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(5 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f5db4018950 con 0x55d1a4c546f0 2024-09-22T08:38:30.638 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.635+0000 7f5dc5132800 1 Processor -- start 2024-09-22T08:38:30.638 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.635+0000 7f5dc5132800 1 -- start start 2024-09-22T08:38:30.638 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.635+0000 7f5dc5132800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d1a4c65b50 0x55d1a4c65f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:30.638 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.635+0000 7f5dc5132800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55d1a4a48d50 con 0x55d1a4c65b50 2024-09-22T08:38:30.638 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.635+0000 7f5dc15bd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d1a4c65b50 0x55d1a4c65f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:30.638 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.635+0000 7f5dc15bd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d1a4c65b50 0x55d1a4c65f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:52034/0 (socket says 172.21.15.142:52034) 2024-09-22T08:38:30.638 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.635+0000 7f5dc15bd640 1 -- 172.21.15.142:0/3095123938 learned_addr learned my addr 172.21.15.142:0/3095123938 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:38:30.638 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.635+0000 7f5dc15bd640 1 -- 172.21.15.142:0/3095123938 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d1a4c665b0 con 0x55d1a4c65b50 2024-09-22T08:38:30.642 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.636+0000 7f5dc15bd640 1 --2- 172.21.15.142:0/3095123938 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d1a4c65b50 0x55d1a4c65f70 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x55d1a4c4bf70 tx=0x7f5dbc0167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:30.642 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.636+0000 7f5ca67fc640 1 -- 172.21.15.142:0/3095123938 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5dbc013640 con 0x55d1a4c65b50 2024-09-22T08:38:30.643 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.636+0000 7f5ca67fc640 1 -- 172.21.15.142:0/3095123938 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5dbc0137e0 con 0x55d1a4c65b50 2024-09-22T08:38:30.643 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.636+0000 7f5dc5132800 1 -- 172.21.15.142:0/3095123938 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d1a4c66de0 con 0x55d1a4c65b50 2024-09-22T08:38:30.643 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.636+0000 7f5ca67fc640 1 -- 172.21.15.142:0/3095123938 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5dbc013ac0 con 0x55d1a4c65b50 2024-09-22T08:38:30.643 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.636+0000 7f5dc5132800 1 -- 172.21.15.142:0/3095123938 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d1a4c67380 con 0x55d1a4c65b50 2024-09-22T08:38:30.643 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.637+0000 7f5ca67fc640 1 -- 172.21.15.142:0/3095123938 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f5dbc011040 con 0x55d1a4c65b50 2024-09-22T08:38:30.643 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.637+0000 7f5ca67fc640 1 --2- 172.21.15.142:0/3095123938 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f5c9803d000 0x7f5c9803f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:30.643 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.637+0000 7f5ca67fc640 1 -- 172.21.15.142:0/3095123938 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5938+0+0 (secure 0 0 0) 0x7f5dbc00e040 con 0x55d1a4c65b50 2024-09-22T08:38:30.643 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.637+0000 7f5dc0dbc640 1 --2- 172.21.15.142:0/3095123938 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f5c9803d000 0x7f5c9803f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:30.643 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.637+0000 7f5dc5132800 1 Processor -- start 2024-09-22T08:38:30.643 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.637+0000 7f5dc0dbc640 1 --2- 172.21.15.142:0/3095123938 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f5c9803d000 0x7f5c9803f4c0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f5db4052c40 tx=0x7f5db400beb0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:30.643 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.637+0000 7f5dc5132800 1 -- start start 2024-09-22T08:38:30.643 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.637+0000 7f5dc5132800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d1a4c725d0 0x55d1a4c729d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:30.644 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.637+0000 7f5dc5132800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55d1a4c43ab0 con 0x55d1a4c725d0 2024-09-22T08:38:30.644 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.638+0000 7f5dc15bd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d1a4c725d0 0x55d1a4c729d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:30.644 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.638+0000 7f5dc15bd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d1a4c725d0 0x55d1a4c729d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:52046/0 (socket says 172.21.15.142:52046) 2024-09-22T08:38:30.644 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.638+0000 7f5dc15bd640 1 -- 172.21.15.142:0/823836498 learned_addr learned my addr 172.21.15.142:0/823836498 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:38:30.644 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.638+0000 7f5dc15bd640 1 -- 172.21.15.142:0/823836498 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d1a4c72fc0 con 0x55d1a4c725d0 2024-09-22T08:38:30.644 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.638+0000 7f5dc15bd640 1 --2- 172.21.15.142:0/823836498 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d1a4c725d0 0x55d1a4c729d0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f5dbc054890 tx=0x7f5dbc013f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9299907af57cd60 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:30.644 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.638+0000 7f5c97fff640 1 -- 172.21.15.142:0/823836498 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5dbc044030 con 0x55d1a4c725d0 2024-09-22T08:38:30.644 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.638+0000 7f5c97fff640 1 -- 172.21.15.142:0/823836498 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5dbc021a90 con 0x55d1a4c725d0 2024-09-22T08:38:30.644 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.638+0000 7f5c97fff640 1 -- 172.21.15.142:0/823836498 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5dbc021570 con 0x55d1a4c725d0 2024-09-22T08:38:30.644 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.639+0000 7f5dc5132800 1 -- 172.21.15.142:0/823836498 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d1a4c725d0 msgr2=0x55d1a4c729d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:30.644 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.639+0000 7f5dc5132800 1 --2- 172.21.15.142:0/823836498 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d1a4c725d0 0x55d1a4c729d0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f5dbc054890 tx=0x7f5dbc013f00 comp rx=0 tx=0).stop 2024-09-22T08:38:30.644 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.639+0000 7f5dc5132800 1 -- 172.21.15.142:0/823836498 shutdown_connections 2024-09-22T08:38:30.644 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.639+0000 7f5dc5132800 1 --2- 172.21.15.142:0/823836498 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d1a4c725d0 0x55d1a4c729d0 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:30.644 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.639+0000 7f5dc5132800 1 -- 172.21.15.142:0/823836498 >> 172.21.15.142:0/823836498 conn(0x55d1a4c6e9d0 msgr2=0x55d1a4c6cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:38:30.645 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.639+0000 7f5dc5132800 1 -- 172.21.15.142:0/823836498 shutdown_connections 2024-09-22T08:38:30.645 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.639+0000 7f5dc5132800 1 -- 172.21.15.142:0/823836498 wait complete. 2024-09-22T08:38:30.645 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.639+0000 7f5dc5132800 1 Processor -- start 2024-09-22T08:38:30.645 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.639+0000 7f5dc5132800 1 -- start start 2024-09-22T08:38:30.645 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.639+0000 7f5dc5132800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d1a4c725d0 0x55d1a4c79be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:30.645 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.639+0000 7f5dc5132800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55d1a4c735e0 con 0x55d1a4c725d0 2024-09-22T08:38:30.645 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.639+0000 7f5dc15bd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d1a4c725d0 0x55d1a4c79be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:30.645 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.639+0000 7f5dc15bd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d1a4c725d0 0x55d1a4c79be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:52056/0 (socket says 172.21.15.142:52056) 2024-09-22T08:38:30.645 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.639+0000 7f5dc15bd640 1 -- 172.21.15.142:0/2420788554 learned_addr learned my addr 172.21.15.142:0/2420788554 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:38:30.645 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.640+0000 7f5dc15bd640 1 -- 172.21.15.142:0/2420788554 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d1a4c7a140 con 0x55d1a4c725d0 2024-09-22T08:38:30.645 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.640+0000 7f5dc15bd640 1 --2- 172.21.15.142:0/2420788554 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d1a4c725d0 0x55d1a4c79be0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f5dbc0208e0 tx=0x7f5dbc0547f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:30.645 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.640+0000 7f5c967fc640 1 -- 172.21.15.142:0/2420788554 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5dbc020de0 con 0x55d1a4c725d0 2024-09-22T08:38:30.645 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.640+0000 7f5dc5132800 1 -- 172.21.15.142:0/2420788554 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d1a4c7a3d0 con 0x55d1a4c725d0 2024-09-22T08:38:30.646 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.640+0000 7f5c967fc640 1 -- 172.21.15.142:0/2420788554 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5dbc01fa90 con 0x55d1a4c725d0 2024-09-22T08:38:30.646 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.640+0000 7f5dc5132800 1 -- 172.21.15.142:0/2420788554 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d1a4c7af60 con 0x55d1a4c725d0 2024-09-22T08:38:30.646 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.640+0000 7f5c967fc640 1 -- 172.21.15.142:0/2420788554 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5dbc01fd70 con 0x55d1a4c725d0 2024-09-22T08:38:30.646 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.641+0000 7f5c967fc640 1 -- 172.21.15.142:0/2420788554 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f5dbc01f500 con 0x55d1a4c725d0 2024-09-22T08:38:30.646 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.641+0000 7f5c967fc640 1 --2- 172.21.15.142:0/2420788554 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f5c8c03cf60 0x7f5c8c03f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:30.646 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.641+0000 7f5c967fc640 1 -- 172.21.15.142:0/2420788554 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5938+0+0 (secure 0 0 0) 0x7f5dbc017450 con 0x55d1a4c725d0 2024-09-22T08:38:30.646 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.641+0000 7f5dc0dbc640 1 --2- 172.21.15.142:0/2420788554 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f5c8c03cf60 0x7f5c8c03f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:30.646 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.642+0000 7f5dc0dbc640 1 --2- 172.21.15.142:0/2420788554 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f5c8c03cf60 0x7f5c8c03f420 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f5db400efd0 tx=0x7f5db404f000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:30.657 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.642+0000 7f5dc5132800 20 rados->read ofs=0 len=0 2024-09-22T08:38:30.657 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.642+0000 7f5dc5132800 1 --2- 172.21.15.142:0/2420788554 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55d1a4c85560 0x55d1a4c87a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:30.657 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.642+0000 7f5dc5132800 1 -- 172.21.15.142:0/2420788554 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d1a4c88170 con 0x55d1a4c85560 2024-09-22T08:38:30.657 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.642+0000 7f5dbbfff640 1 --2- 172.21.15.142:0/2420788554 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55d1a4c85560 0x55d1a4c87a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:30.657 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.642+0000 7f5dbbfff640 1 --2- 172.21.15.142:0/2420788554 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55d1a4c85560 0x55d1a4c87a20 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:30.657 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.643+0000 7f5dbbfff640 1 -- 172.21.15.142:0/2420788554 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5dac061430 con 0x55d1a4c85560 2024-09-22T08:38:30.657 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.643+0000 7f5dc5132800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:30.657 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.643+0000 7f5dc5132800 20 realm 2024-09-22T08:38:30.657 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.643+0000 7f5dc5132800 20 rados->read ofs=0 len=0 2024-09-22T08:38:30.658 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.643+0000 7f5dc5132800 1 -- 172.21.15.142:0/2420788554 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d1a4c88540 con 0x55d1a4c85560 2024-09-22T08:38:30.658 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.643+0000 7f5dbbfff640 1 -- 172.21.15.142:0/2420788554 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5dac061430 con 0x55d1a4c85560 2024-09-22T08:38:30.658 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.643+0000 7f5dc5132800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:30.658 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.643+0000 7f5dc5132800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:38:30.658 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.643+0000 7f5dc5132800 20 rados->read ofs=0 len=0 2024-09-22T08:38:30.658 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.643+0000 7f5dc5132800 1 -- 172.21.15.142:0/2420788554 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d1a4c88e10 con 0x55d1a4c85560 2024-09-22T08:38:30.658 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.643+0000 7f5dbbfff640 1 -- 172.21.15.142:0/2420788554 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5dac061430 con 0x55d1a4c85560 2024-09-22T08:38:30.658 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.643+0000 7f5dc5132800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:30.658 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.643+0000 7f5dc5132800 20 rados->read ofs=0 len=0 2024-09-22T08:38:30.658 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.643+0000 7f5dc5132800 1 -- 172.21.15.142:0/2420788554 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d1a4c891b0 con 0x55d1a4c85560 2024-09-22T08:38:30.658 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.643+0000 7f5dbbfff640 1 -- 172.21.15.142:0/2420788554 <== osd.1 v2:172.21.15.142:6816/3192108003 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5dac061430 con 0x55d1a4c85560 2024-09-22T08:38:30.658 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.643+0000 7f5dc5132800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:38:30.658 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.643+0000 7f5dc5132800 20 rados->read ofs=0 len=0 2024-09-22T08:38:30.658 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.643+0000 7f5dc5132800 1 --2- 172.21.15.142:0/2420788554 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55d1a4c89f10 0x55d1a4c8c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:30.659 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.643+0000 7f5dc5132800 1 -- 172.21.15.142:0/2420788554 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d1a4c8c8c0 con 0x55d1a4c89f10 2024-09-22T08:38:30.659 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.643+0000 7f5dc15bd640 1 --2- 172.21.15.142:0/2420788554 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55d1a4c89f10 0x55d1a4c8c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:30.659 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.644+0000 7f5dc15bd640 1 --2- 172.21.15.142:0/2420788554 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55d1a4c89f10 0x55d1a4c8c300 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:30.659 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.644+0000 7f5dc15bd640 1 -- 172.21.15.142:0/2420788554 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(5 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f5dbc053020 con 0x55d1a4c89f10 2024-09-22T08:38:30.659 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.644+0000 7f5dc5132800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:38:30.659 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.644+0000 7f5dc5132800 20 searching for the correct realm 2024-09-22T08:38:30.659 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.644+0000 7f5dc5132800 1 -- 172.21.15.142:0/2420788554 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d1a4c8e210 con 0x55d1a4c89f10 2024-09-22T08:38:30.659 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.644+0000 7f5dc15bd640 1 -- 172.21.15.142:0/2420788554 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5dbc053020 con 0x55d1a4c89f10 2024-09-22T08:38:30.659 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.644+0000 7f5dc15bd640 1 --2- 172.21.15.142:0/2420788554 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f5dbc04d970 0x7f5dbc033970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:30.659 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.644+0000 7f5dc15bd640 1 -- 172.21.15.142:0/2420788554 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d1a4c8e210 con 0x7f5dbc04d970 2024-09-22T08:38:30.659 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.644+0000 7f5dc0dbc640 1 --2- 172.21.15.142:0/2420788554 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f5dbc04d970 0x7f5dbc033970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:30.659 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.645+0000 7f5dc0dbc640 1 --2- 172.21.15.142:0/2420788554 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f5dbc04d970 0x7f5dbc033970 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:30.659 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.645+0000 7f5dc0dbc640 1 -- 172.21.15.142:0/2420788554 <== osd.2 v2:172.21.15.142:6808/279438927 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5db4018950 con 0x7f5dbc04d970 2024-09-22T08:38:30.660 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.645+0000 7f5dc0dbc640 1 --2- 172.21.15.142:0/2420788554 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f5db4017050 0x7f5db4054830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:30.660 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.645+0000 7f5dc0dbc640 1 -- 172.21.15.142:0/2420788554 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d1a4c8e210 con 0x7f5db4017050 2024-09-22T08:38:30.660 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.645+0000 7f5dbbfff640 1 --2- 172.21.15.142:0/2420788554 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f5db4017050 0x7f5db4054830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:30.660 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.646+0000 7f5dbbfff640 1 --2- 172.21.15.142:0/2420788554 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f5db4017050 0x7f5db4054830 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:30.660 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.646+0000 7f5dbbfff640 1 -- 172.21.15.142:0/2420788554 <== osd.0 v2:172.21.15.31:6800/168281188 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5dac061430 con 0x7f5db4017050 2024-09-22T08:38:30.660 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.646+0000 7f5dbbfff640 1 -- 172.21.15.142:0/2420788554 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d1a4c8e210 con 0x55d1a4c85560 2024-09-22T08:38:30.660 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.646+0000 7f5dbbfff640 1 -- 172.21.15.142:0/2420788554 <== osd.1 v2:172.21.15.142:6816/3192108003 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5dac061430 con 0x55d1a4c85560 2024-09-22T08:38:30.660 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.646+0000 7f5dbbfff640 1 -- 172.21.15.142:0/2420788554 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d1a4c8e210 con 0x55d1a4c85560 2024-09-22T08:38:30.660 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.646+0000 7f5dbbfff640 1 -- 172.21.15.142:0/2420788554 <== osd.1 v2:172.21.15.142:6816/3192108003 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5dac061430 con 0x55d1a4c85560 2024-09-22T08:38:30.660 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.646+0000 7f5dbbfff640 1 -- 172.21.15.142:0/2420788554 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f5dac078040 con 0x55d1a4c85560 2024-09-22T08:38:30.660 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.646+0000 7f5dbbfff640 1 -- 172.21.15.142:0/2420788554 <== osd.1 v2:172.21.15.142:6816/3192108003 7 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5dac061430 con 0x55d1a4c85560 2024-09-22T08:38:30.660 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.646+0000 7f5dbbfff640 1 -- 172.21.15.142:0/2420788554 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f5dac078040 con 0x7f5db4017050 2024-09-22T08:38:30.661 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.647+0000 7f5dbbfff640 1 -- 172.21.15.142:0/2420788554 <== osd.0 v2:172.21.15.31:6800/168281188 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5dac061430 con 0x7f5db4017050 2024-09-22T08:38:30.661 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.647+0000 7f5dbbfff640 1 -- 172.21.15.142:0/2420788554 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f5dac078040 con 0x7f5dbc04d970 2024-09-22T08:38:30.661 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.647+0000 7f5dc0dbc640 1 -- 172.21.15.142:0/2420788554 <== osd.2 v2:172.21.15.142:6808/279438927 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5db4018950 con 0x7f5dbc04d970 2024-09-22T08:38:30.661 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.647+0000 7f5dc0dbc640 1 -- 172.21.15.142:0/2420788554 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f5dac078040 con 0x55d1a4c89f10 2024-09-22T08:38:30.661 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.647+0000 7f5dc15bd640 1 -- 172.21.15.142:0/2420788554 <== osd.3 v2:172.21.15.142:6800/1064901393 3 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5dbc053020 con 0x55d1a4c89f10 2024-09-22T08:38:30.661 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.647+0000 7f5dc15bd640 1 -- 172.21.15.142:0/2420788554 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f5dac078040 con 0x55d1a4c85560 2024-09-22T08:38:30.661 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.647+0000 7f5dbbfff640 1 -- 172.21.15.142:0/2420788554 <== osd.1 v2:172.21.15.142:6816/3192108003 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5dac061430 con 0x55d1a4c85560 2024-09-22T08:38:30.661 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.647+0000 7f5dbbfff640 1 -- 172.21.15.142:0/2420788554 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f5dac078040 con 0x7f5db4017050 2024-09-22T08:38:30.661 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.648+0000 7f5dbbfff640 1 -- 172.21.15.142:0/2420788554 <== osd.0 v2:172.21.15.31:6800/168281188 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5dac061430 con 0x7f5db4017050 2024-09-22T08:38:30.661 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.648+0000 7f5dbbfff640 1 -- 172.21.15.142:0/2420788554 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f5dac078040 con 0x55d1a4c85560 2024-09-22T08:38:30.661 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.648+0000 7f5dbbfff640 1 -- 172.21.15.142:0/2420788554 <== osd.1 v2:172.21.15.142:6816/3192108003 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5dac061430 con 0x55d1a4c85560 2024-09-22T08:38:30.661 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.648+0000 7f5dbbfff640 1 -- 172.21.15.142:0/2420788554 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f5dac078040 con 0x7f5dbc04d970 2024-09-22T08:38:30.661 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.648+0000 7f5dc0dbc640 1 -- 172.21.15.142:0/2420788554 <== osd.2 v2:172.21.15.142:6808/279438927 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f5db4018950 con 0x7f5dbc04d970 2024-09-22T08:38:30.662 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.648+0000 7f5dc0dbc640 1 -- 172.21.15.142:0/2420788554 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f5dac078040 con 0x55d1a4c89f10 2024-09-22T08:38:30.662 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.648+0000 7f5dc15bd640 1 -- 172.21.15.142:0/2420788554 <== osd.3 v2:172.21.15.142:6800/1064901393 4 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5dbc053020 con 0x55d1a4c89f10 2024-09-22T08:38:30.662 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.648+0000 7f5dc15bd640 1 -- 172.21.15.142:0/2420788554 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f5dac078040 con 0x55d1a4c89f10 2024-09-22T08:38:30.662 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.649+0000 7f5dc15bd640 1 -- 172.21.15.142:0/2420788554 <== osd.3 v2:172.21.15.142:6800/1064901393 5 ==== osd_op_reply(20 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f5dbc053020 con 0x55d1a4c89f10 2024-09-22T08:38:30.662 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.649+0000 7f5dc15bd640 1 -- 172.21.15.142:0/2420788554 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f5dac078040 con 0x7f5db4017050 2024-09-22T08:38:30.662 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.649+0000 7f5dbbfff640 1 -- 172.21.15.142:0/2420788554 <== osd.0 v2:172.21.15.31:6800/168281188 4 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5dac061430 con 0x7f5db4017050 2024-09-22T08:38:30.662 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.649+0000 7f5dbbfff640 1 -- 172.21.15.142:0/2420788554 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f5dac078040 con 0x55d1a4c89f10 2024-09-22T08:38:30.662 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.649+0000 7f5dc15bd640 1 -- 172.21.15.142:0/2420788554 <== osd.3 v2:172.21.15.142:6800/1064901393 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5dbc053020 con 0x55d1a4c89f10 2024-09-22T08:38:30.662 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.649+0000 7f5dc15bd640 1 -- 172.21.15.142:0/2420788554 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f5dac078040 con 0x55d1a4c89f10 2024-09-22T08:38:30.662 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.649+0000 7f5dc15bd640 1 -- 172.21.15.142:0/2420788554 <== osd.3 v2:172.21.15.142:6800/1064901393 7 ==== osd_op_reply(23 [pgnls start_epoch 32 out=107b] v32'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f5dbc053020 con 0x55d1a4c89f10 2024-09-22T08:38:30.662 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.649+0000 7f5dc15bd640 1 -- 172.21.15.142:0/2420788554 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f5dac078040 con 0x55d1a4c85560 2024-09-22T08:38:30.662 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.649+0000 7f5dbbfff640 1 -- 172.21.15.142:0/2420788554 <== osd.1 v2:172.21.15.142:6816/3192108003 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5dac061430 con 0x55d1a4c85560 2024-09-22T08:38:30.662 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.649+0000 7f5dbbfff640 1 -- 172.21.15.142:0/2420788554 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f5dac078040 con 0x55d1a4c85560 2024-09-22T08:38:30.663 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.650+0000 7f5dbbfff640 1 -- 172.21.15.142:0/2420788554 <== osd.1 v2:172.21.15.142:6816/3192108003 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v32'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f5dac061430 con 0x55d1a4c85560 2024-09-22T08:38:30.663 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.650+0000 7f5dbbfff640 1 -- 172.21.15.142:0/2420788554 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f5dac078040 con 0x7f5db4017050 2024-09-22T08:38:30.663 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.650+0000 7f5dbbfff640 1 -- 172.21.15.142:0/2420788554 <== osd.0 v2:172.21.15.31:6800/168281188 5 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5dac061430 con 0x7f5db4017050 2024-09-22T08:38:30.663 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.650+0000 7f5dbbfff640 1 -- 172.21.15.142:0/2420788554 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f5dac078040 con 0x55d1a4c89f10 2024-09-22T08:38:30.663 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.650+0000 7f5dc15bd640 1 -- 172.21.15.142:0/2420788554 <== osd.3 v2:172.21.15.142:6800/1064901393 8 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5dbc053020 con 0x55d1a4c89f10 2024-09-22T08:38:30.663 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.650+0000 7f5dc15bd640 1 -- 172.21.15.142:0/2420788554 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f5dac078040 con 0x7f5dbc04d970 2024-09-22T08:38:30.663 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.650+0000 7f5dc0dbc640 1 -- 172.21.15.142:0/2420788554 <== osd.2 v2:172.21.15.142:6808/279438927 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5db4018950 con 0x7f5dbc04d970 2024-09-22T08:38:30.663 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.650+0000 7f5dc0dbc640 1 -- 172.21.15.142:0/2420788554 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f5dac078040 con 0x55d1a4c85560 2024-09-22T08:38:30.663 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.651+0000 7f5dbbfff640 1 -- 172.21.15.142:0/2420788554 <== osd.1 v2:172.21.15.142:6816/3192108003 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5dac061430 con 0x55d1a4c85560 2024-09-22T08:38:30.663 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.651+0000 7f5dbbfff640 1 -- 172.21.15.142:0/2420788554 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f5dac078040 con 0x7f5db4017050 2024-09-22T08:38:30.663 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.651+0000 7f5dbbfff640 1 -- 172.21.15.142:0/2420788554 <== osd.0 v2:172.21.15.31:6800/168281188 6 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5dac061430 con 0x7f5db4017050 2024-09-22T08:38:30.663 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.651+0000 7f5dbbfff640 1 -- 172.21.15.142:0/2420788554 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f5dac078040 con 0x55d1a4c89f10 2024-09-22T08:38:30.663 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.651+0000 7f5dc15bd640 1 -- 172.21.15.142:0/2420788554 <== osd.3 v2:172.21.15.142:6800/1064901393 9 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5dbc053020 con 0x55d1a4c89f10 2024-09-22T08:38:30.664 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.651+0000 7f5dc15bd640 1 -- 172.21.15.142:0/2420788554 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f5dac078040 con 0x7f5db4017050 2024-09-22T08:38:30.664 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.652+0000 7f5dbbfff640 1 -- 172.21.15.142:0/2420788554 <== osd.0 v2:172.21.15.31:6800/168281188 7 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5dac061430 con 0x7f5db4017050 2024-09-22T08:38:30.664 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.652+0000 7f5dbbfff640 1 -- 172.21.15.142:0/2420788554 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f5dac078040 con 0x7f5dbc04d970 2024-09-22T08:38:30.664 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.652+0000 7f5dc0dbc640 1 -- 172.21.15.142:0/2420788554 <== osd.2 v2:172.21.15.142:6808/279438927 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5db4018950 con 0x7f5dbc04d970 2024-09-22T08:38:30.664 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.652+0000 7f5dc0dbc640 1 -- 172.21.15.142:0/2420788554 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f5dac078040 con 0x55d1a4c89f10 2024-09-22T08:38:30.664 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.652+0000 7f5dc15bd640 1 -- 172.21.15.142:0/2420788554 <== osd.3 v2:172.21.15.142:6800/1064901393 10 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5dbc053020 con 0x55d1a4c89f10 2024-09-22T08:38:30.664 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.652+0000 7f5dc15bd640 1 -- 172.21.15.142:0/2420788554 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f5dac078040 con 0x7f5db4017050 2024-09-22T08:38:30.664 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.652+0000 7f5dbbfff640 1 -- 172.21.15.142:0/2420788554 <== osd.0 v2:172.21.15.31:6800/168281188 8 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5dac061430 con 0x7f5db4017050 2024-09-22T08:38:30.664 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.653+0000 7f5dbbfff640 1 -- 172.21.15.142:0/2420788554 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f5dac078040 con 0x55d1a4c85560 2024-09-22T08:38:30.664 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.653+0000 7f5dbbfff640 1 -- 172.21.15.142:0/2420788554 <== osd.1 v2:172.21.15.142:6816/3192108003 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v32'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f5dac061430 con 0x55d1a4c85560 2024-09-22T08:38:30.664 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.653+0000 7f5dbbfff640 1 -- 172.21.15.142:0/2420788554 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f5dac078040 con 0x7f5dbc04d970 2024-09-22T08:38:30.664 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.653+0000 7f5dc0dbc640 1 -- 172.21.15.142:0/2420788554 <== osd.2 v2:172.21.15.142:6808/279438927 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5db4018950 con 0x7f5dbc04d970 2024-09-22T08:38:30.664 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.653+0000 7f5dc5132800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:38:30.665 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.653+0000 7f5dc5132800 20 RGWRados::pool_iterate: got zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec 2024-09-22T08:38:30.665 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.653+0000 7f5dc5132800 20 RGWRados::pool_iterate: got zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f 2024-09-22T08:38:30.665 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.653+0000 7f5dc5132800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:38:30.665 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.653+0000 7f5dc5132800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:38:30.665 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.653+0000 7f5dc5132800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:38:30.665 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.653+0000 7f5dc5132800 20 rados->read ofs=0 len=0 2024-09-22T08:38:30.665 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.653+0000 7f5dc5132800 1 -- 172.21.15.142:0/2420788554 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d1a4c8d2b0 con 0x55d1a4c85560 2024-09-22T08:38:30.665 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.653+0000 7f5dbbfff640 1 -- 172.21.15.142:0/2420788554 <== osd.1 v2:172.21.15.142:6816/3192108003 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5dac061430 con 0x55d1a4c85560 2024-09-22T08:38:30.665 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.653+0000 7f5dc5132800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:30.665 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.653+0000 7f5dc5132800 20 rados->read ofs=0 len=0 2024-09-22T08:38:30.665 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.653+0000 7f5dc5132800 1 -- 172.21.15.142:0/2420788554 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d1a4c8db50 con 0x55d1a4c85560 2024-09-22T08:38:30.665 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.653+0000 7f5dbbfff640 1 -- 172.21.15.142:0/2420788554 <== osd.1 v2:172.21.15.142:6816/3192108003 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5dac061430 con 0x55d1a4c85560 2024-09-22T08:38:30.665 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.654+0000 7f5dc5132800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:38:30.665 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.654+0000 7f5dc5132800 20 rados->read ofs=0 len=0 2024-09-22T08:38:30.666 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.654+0000 7f5dc5132800 1 -- 172.21.15.142:0/2420788554 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:40 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d1a4c8e690 con 0x55d1a4c89f10 2024-09-22T08:38:30.666 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.654+0000 7f5dc15bd640 1 -- 172.21.15.142:0/2420788554 <== osd.3 v2:172.21.15.142:6800/1064901393 11 ==== osd_op_reply(40 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f5dbc053020 con 0x55d1a4c89f10 2024-09-22T08:38:30.666 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.654+0000 7f5dc5132800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:38:30.666 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.654+0000 7f5dc5132800 20 zone default found 2024-09-22T08:38:30.666 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.654+0000 7f5dc5132800 4 Realm: () 2024-09-22T08:38:30.666 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.654+0000 7f5dc5132800 4 ZoneGroup: default (d89f6f57-1007-47dd-9065-f486c7b01aec) 2024-09-22T08:38:30.666 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.654+0000 7f5dc5132800 4 Zone: default (e239248c-0bee-4e41-803a-24b288d3eb8f) 2024-09-22T08:38:30.666 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.654+0000 7f5dc5132800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:38:30.666 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.654+0000 7f5dc5132800 20 zonegroup default 2024-09-22T08:38:30.666 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.654+0000 7f5dc5132800 20 rados->read ofs=0 len=0 2024-09-22T08:38:30.666 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.654+0000 7f5dc5132800 1 -- 172.21.15.142:0/2420788554 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d1a4c8eac0 con 0x7f5db4017050 2024-09-22T08:38:30.666 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.654+0000 7f5dbbfff640 1 -- 172.21.15.142:0/2420788554 <== osd.0 v2:172.21.15.31:6800/168281188 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f5dac061430 con 0x7f5db4017050 2024-09-22T08:38:30.666 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.654+0000 7f5dc5132800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:30.667 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.654+0000 7f5dc5132800 20 rados->read ofs=0 len=0 2024-09-22T08:38:30.667 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.654+0000 7f5dc5132800 1 -- 172.21.15.142:0/2420788554 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d1a4c90920 con 0x55d1a4c89f10 2024-09-22T08:38:30.667 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.654+0000 7f5dc15bd640 1 -- 172.21.15.142:0/2420788554 <== osd.3 v2:172.21.15.142:6800/1064901393 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5dbc053020 con 0x55d1a4c89f10 2024-09-22T08:38:30.667 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.654+0000 7f5dc5132800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:30.667 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.655+0000 7f5dc5132800 20 rados->read ofs=0 len=0 2024-09-22T08:38:30.667 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.655+0000 7f5dc5132800 1 -- 172.21.15.142:0/2420788554 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d1a4c90d80 con 0x55d1a4c89f10 2024-09-22T08:38:30.667 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.655+0000 7f5dc15bd640 1 -- 172.21.15.142:0/2420788554 <== osd.3 v2:172.21.15.142:6800/1064901393 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5dbc053020 con 0x55d1a4c89f10 2024-09-22T08:38:30.667 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.655+0000 7f5dc5132800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:30.667 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.655+0000 7f5dc5132800 20 started sync module instance, tier type = 2024-09-22T08:38:30.667 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.655+0000 7f5dc5132800 20 started zone id=e239248c-0bee-4e41-803a-24b288d3eb8f (name=default) with tier type = 2024-09-22T08:38:30.667 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.655+0000 7f5dc5132800 1 -- 172.21.15.142:0/2420788554 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d1a4c8fd90 con 0x7f5dbc04d970 2024-09-22T08:38:30.667 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.656+0000 7f5dc0dbc640 1 -- 172.21.15.142:0/2420788554 <== osd.2 v2:172.21.15.142:6808/279438927 7 ==== osd_op_reply(44 notify.0 [create] v32'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5db4018950 con 0x7f5dbc04d970 2024-09-22T08:38:30.668 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.656+0000 7f5dc5132800 1 -- 172.21.15.142:0/2420788554 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94358901162368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d1a4c8f9f0 con 0x7f5dbc04d970 2024-09-22T08:38:30.668 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.656+0000 7f5dc5132800 1 -- 172.21.15.142:0/2420788554 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d1a4c91cb0 con 0x55d1a4c85560 2024-09-22T08:38:30.673 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.657+0000 7f5dc0dbc640 1 -- 172.21.15.142:0/2420788554 <== osd.2 v2:172.21.15.142:6808/279438927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94358901162368] v32'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5db4018950 con 0x7f5dbc04d970 2024-09-22T08:38:30.673 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.657+0000 7f5dbbfff640 1 -- 172.21.15.142:0/2420788554 <== osd.1 v2:172.21.15.142:6816/3192108003 16 ==== osd_op_reply(46 notify.1 [create] v32'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5dac061430 con 0x55d1a4c85560 2024-09-22T08:38:30.673 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.657+0000 7f5dc5132800 1 -- 172.21.15.142:0/2420788554 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94358901168128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d1a4c920d0 con 0x55d1a4c85560 2024-09-22T08:38:30.673 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.657+0000 7f5dc5132800 1 -- 172.21.15.142:0/2420788554 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d1a4c92a90 con 0x55d1a4c89f10 2024-09-22T08:38:30.673 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.658+0000 7f5dc15bd640 1 -- 172.21.15.142:0/2420788554 <== osd.3 v2:172.21.15.142:6800/1064901393 14 ==== osd_op_reply(48 notify.2 [create] v32'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5dbc053020 con 0x55d1a4c89f10 2024-09-22T08:38:30.673 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.658+0000 7f5dc5132800 1 -- 172.21.15.142:0/2420788554 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94358901171680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d1a4c92a40 con 0x55d1a4c89f10 2024-09-22T08:38:30.673 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.658+0000 7f5dc5132800 1 -- 172.21.15.142:0/2420788554 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d1a4c93a60 con 0x7f5dbc04d970 2024-09-22T08:38:30.673 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.659+0000 7f5dbbfff640 1 -- 172.21.15.142:0/2420788554 <== osd.1 v2:172.21.15.142:6816/3192108003 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94358901168128] v32'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5dac061430 con 0x55d1a4c85560 2024-09-22T08:38:30.673 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.659+0000 7f5dc0dbc640 1 -- 172.21.15.142:0/2420788554 <== osd.2 v2:172.21.15.142:6808/279438927 9 ==== osd_op_reply(50 notify.3 [create] v32'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5db4018950 con 0x7f5dbc04d970 2024-09-22T08:38:30.673 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.659+0000 7f5dc5132800 1 -- 172.21.15.142:0/2420788554 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94358901175632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d1a4c93e50 con 0x7f5dbc04d970 2024-09-22T08:38:30.674 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.660+0000 7f5dc5132800 1 -- 172.21.15.142:0/2420788554 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d1a4c948c0 con 0x55d1a4c85560 2024-09-22T08:38:30.674 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.660+0000 7f5dc15bd640 1 -- 172.21.15.142:0/2420788554 <== osd.3 v2:172.21.15.142:6800/1064901393 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94358901171680] v32'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5dbc053020 con 0x55d1a4c89f10 2024-09-22T08:38:30.674 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.661+0000 7f5dc0dbc640 1 -- 172.21.15.142:0/2420788554 <== osd.2 v2:172.21.15.142:6808/279438927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94358901175632] v32'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5db4018950 con 0x7f5dbc04d970 2024-09-22T08:38:30.674 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.661+0000 7f5dbbfff640 1 -- 172.21.15.142:0/2420788554 <== osd.1 v2:172.21.15.142:6816/3192108003 18 ==== osd_op_reply(52 notify.4 [create] v32'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5dac061430 con 0x55d1a4c85560 2024-09-22T08:38:30.674 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.661+0000 7f5dc5132800 1 -- 172.21.15.142:0/2420788554 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94358901169184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d1a4c92e80 con 0x55d1a4c85560 2024-09-22T08:38:30.674 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.661+0000 7f5dc5132800 1 -- 172.21.15.142:0/2420788554 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d1a4c951a0 con 0x7f5db4017050 2024-09-22T08:38:30.674 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.662+0000 7f5dbbfff640 1 -- 172.21.15.142:0/2420788554 <== osd.1 v2:172.21.15.142:6816/3192108003 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94358901169184] v32'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5dac061430 con 0x55d1a4c85560 2024-09-22T08:38:30.674 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.662+0000 7f5dbbfff640 1 -- 172.21.15.142:0/2420788554 <== osd.0 v2:172.21.15.31:6800/168281188 10 ==== osd_op_reply(54 notify.5 [create] v32'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5dac061430 con 0x7f5db4017050 2024-09-22T08:38:30.674 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.662+0000 7f5dc5132800 1 -- 172.21.15.142:0/2420788554 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94358901179280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d1a4c95110 con 0x7f5db4017050 2024-09-22T08:38:30.674 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.662+0000 7f5dc5132800 1 -- 172.21.15.142:0/2420788554 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d1a4c95bb0 con 0x7f5db4017050 2024-09-22T08:38:30.674 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.663+0000 7f5dbbfff640 1 -- 172.21.15.142:0/2420788554 <== osd.0 v2:172.21.15.31:6800/168281188 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94358901179280] v32'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5dac061430 con 0x7f5db4017050 2024-09-22T08:38:30.674 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.663+0000 7f5dbbfff640 1 -- 172.21.15.142:0/2420788554 <== osd.0 v2:172.21.15.31:6800/168281188 12 ==== osd_op_reply(56 notify.6 [create] v32'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5dac061430 con 0x7f5db4017050 2024-09-22T08:38:30.674 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.663+0000 7f5dc5132800 1 -- 172.21.15.142:0/2420788554 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94358901181536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d1a4c95d90 con 0x7f5db4017050 2024-09-22T08:38:30.675 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.663+0000 7f5dc5132800 1 -- 172.21.15.142:0/2420788554 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d1a4c965e0 con 0x7f5db4017050 2024-09-22T08:38:30.675 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.664+0000 7f5dbbfff640 1 -- 172.21.15.142:0/2420788554 <== osd.0 v2:172.21.15.31:6800/168281188 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94358901181536] v32'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5dac061430 con 0x7f5db4017050 2024-09-22T08:38:30.675 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.664+0000 7f5dbbfff640 1 -- 172.21.15.142:0/2420788554 <== osd.0 v2:172.21.15.31:6800/168281188 14 ==== osd_op_reply(58 notify.7 [create] v32'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5dac061430 con 0x7f5db4017050 2024-09-22T08:38:30.675 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.664+0000 7f5dc5132800 1 -- 172.21.15.142:0/2420788554 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94358901185216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d1a4c96430 con 0x7f5db4017050 2024-09-22T08:38:30.675 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.664+0000 7f5dc5132800 20 add_watcher() i=0 2024-09-22T08:38:30.675 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.664+0000 7f5dc5132800 20 add_watcher() i=1 2024-09-22T08:38:30.675 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.664+0000 7f5dc5132800 20 add_watcher() i=2 2024-09-22T08:38:30.675 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.664+0000 7f5dc5132800 20 add_watcher() i=3 2024-09-22T08:38:30.675 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.664+0000 7f5dc5132800 20 add_watcher() i=4 2024-09-22T08:38:30.675 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.664+0000 7f5dc5132800 20 add_watcher() i=5 2024-09-22T08:38:30.675 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.664+0000 7f5dc5132800 20 add_watcher() i=6 2024-09-22T08:38:30.675 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.665+0000 7f5dbbfff640 1 -- 172.21.15.142:0/2420788554 <== osd.0 v2:172.21.15.31:6800/168281188 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94358901185216] v32'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5dac061430 con 0x7f5db4017050 2024-09-22T08:38:30.675 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.665+0000 7f5dc5132800 20 add_watcher() i=7 2024-09-22T08:38:30.675 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.665+0000 7f5dc5132800 2 all 8 watchers are set, enabling cache 2024-09-22T08:38:30.676 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.665+0000 7f5dc5132800 1 -- 172.21.15.142:0/2420788554 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d1a4c99a70 con 0x55d1a4c85560 2024-09-22T08:38:30.676 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.666+0000 7f5dbbfff640 1 -- 172.21.15.142:0/2420788554 <== osd.1 v2:172.21.15.142:6816/3192108003 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f5dac061430 con 0x55d1a4c85560 2024-09-22T08:38:30.676 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.666+0000 7f5dc5132800 1 -- 172.21.15.142:0/2420788554 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94358901186272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d1a4c96df0 con 0x55d1a4c85560 2024-09-22T08:38:30.676 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.667+0000 7f5dbbfff640 1 -- 172.21.15.142:0/2420788554 <== osd.1 v2:172.21.15.142:6816/3192108003 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94358901186272] v32'262 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5dac061430 con 0x55d1a4c85560 2024-09-22T08:38:30.676 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.667+0000 7f5c76fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:38:30.676 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.667+0000 7f5dc5132800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:38:30.676 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.667+0000 7f5dc5132800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:38:30.676 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.667+0000 7f5dc5132800 5 note: GC not initialized 2024-09-22T08:38:30.676 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.667+0000 7f5c75fe3640 20 reqs_thread_entry: start 2024-09-22T08:38:30.676 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.667+0000 7f5dc5132800 20 init_complete bucket index max shards: 11 2024-09-22T08:38:30.676 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.667+0000 7f5dc5132800 20 Filter name: none 2024-09-22T08:38:30.676 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.667+0000 7f5be77fe640 20 reqs_thread_entry: start 2024-09-22T08:38:30.676 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.667+0000 7f5dc5132800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-22T08:38:30.676 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.667+0000 7f5dc5132800 20 rados->read ofs=0 len=0 2024-09-22T08:38:30.676 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.667+0000 7f5dc5132800 1 -- 172.21.15.142:0/2420788554 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d1a4ccce60 con 0x7f5db4017050 2024-09-22T08:38:30.677 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.668+0000 7f5dbbfff640 1 -- 172.21.15.142:0/2420788554 <== osd.0 v2:172.21.15.31:6800/168281188 16 ==== osd_op_reply(62 ada [call out=48b,read 0~490 out=490b,getxattrs out=75b] v0'0 uv7 ondisk = 0) ==== 231+0+613 (crc 0 0 0) 0x7f5dac061430 con 0x7f5db4017050 2024-09-22T08:38:30.677 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.668+0000 7f5dc5132800 20 rados_obj.operate() r=0 bl.length=490 2024-09-22T08:38:30.677 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.668+0000 7f5dc5132800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-22T08:38:30.677 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.668+0000 7f5dc5132800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-22T08:38:30.677 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.668+0000 7f5dc5132800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:38:30.677 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.668+0000 7f5dc5132800 1 -- 172.21.15.142:0/2420788554 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~503 in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d1a4cd3530 con 0x7f5db4017050 2024-09-22T08:38:30.677 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.669+0000 7f5dbbfff640 1 -- 172.21.15.142:0/2420788554 <== osd.0 v2:172.21.15.31:6800/168281188 17 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~503] v32'8 uv8 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f5dac081040 con 0x7f5db4017050 2024-09-22T08:38:30.677 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.669+0000 7f5dc5132800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-22T08:38:30.677 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.669+0000 7f5dc5132800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-22T08:38:30.677 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.669+0000 7f5dc5132800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-22T08:38:30.677 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.669+0000 7f5dc5132800 1 -- 172.21.15.142:0/2420788554 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94358901436208 in=691b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d1a4ccebb0 con 0x55d1a4c85560 2024-09-22T08:38:30.677 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.670+0000 7f5dbbfff640 1 -- 172.21.15.142:0/2420788554 <== osd.1 v2:172.21.15.142:6816/3192108003 22 ==== watch-notify(notify (1) cookie 94358901169184 notify 137438953498 ret 0) ==== 721+0+0 (crc 0 0 0) 0x55d1a4b5b7d0 con 0x55d1a4c85560 2024-09-22T08:38:30.678 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.670+0000 7f5c97fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953498 cookie 94358901169184 notifier 4884 bl.length()=679 2024-09-22T08:38:30.678 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.670+0000 7f5c97fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-22T08:38:30.678 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.670+0000 7f5c97fff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-22T08:38:30.678 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.670+0000 7f5dbbfff640 1 -- 172.21.15.142:0/2420788554 <== osd.1 v2:172.21.15.142:6816/3192108003 23 ==== osd_op_reply(64 notify.4 [notify cookie 94358901436208 out=8b] v0'0 uv264 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f5dac081040 con 0x55d1a4c85560 2024-09-22T08:38:30.678 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.670+0000 7f5c97fff640 1 -- 172.21.15.142:0/2420788554 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f5c84003ea0 con 0x55d1a4c85560 2024-09-22T08:38:30.678 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.670+0000 7f5dbbfff640 1 -- 172.21.15.142:0/2420788554 <== osd.1 v2:172.21.15.142:6816/3192108003 24 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5dac081040 con 0x55d1a4c85560 2024-09-22T08:38:30.678 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.670+0000 7f5dbbfff640 1 -- 172.21.15.142:0/2420788554 <== osd.1 v2:172.21.15.142:6816/3192108003 25 ==== watch-notify(notify_complete (2) cookie 94358901436208 notify 137438953498 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f5dac079450 con 0x55d1a4c85560 2024-09-22T08:38:30.678 INFO:teuthology.orchestra.run.smithi142.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-22T08:38:29.459914Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"user-info-without-keys","perm":"*"},{"type":"users","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-22T08:38:29.459903Z","tags":[],"group_ids":[]} 2024-09-22T08:38:30.680 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.671+0000 7f5c76fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:38:30.680 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.671+0000 7f5dc5132800 1 -- 172.21.15.142:0/2420788554 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94358901186272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d1a4ccab50 con 0x55d1a4c85560 2024-09-22T08:38:30.681 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.672+0000 7f5dbbfff640 1 -- 172.21.15.142:0/2420788554 <== osd.1 v2:172.21.15.142:6816/3192108003 26 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94358901186272] v32'263 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5dac081040 con 0x55d1a4c85560 2024-09-22T08:38:30.681 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.672+0000 7f5dc5132800 1 -- 172.21.15.142:0/2420788554 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94358901162368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d1a4ccab50 con 0x7f5dbc04d970 2024-09-22T08:38:30.681 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.673+0000 7f5dc0dbc640 1 -- 172.21.15.142:0/2420788554 <== osd.2 v2:172.21.15.142:6808/279438927 11 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94358901162368] v32'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5db4018950 con 0x7f5dbc04d970 2024-09-22T08:38:30.681 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.673+0000 7f5dc5132800 20 remove_watcher() i=0 2024-09-22T08:38:30.681 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.673+0000 7f5dc5132800 2 removed watcher, disabling cache 2024-09-22T08:38:30.681 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.673+0000 7f5dc5132800 1 -- 172.21.15.142:0/2420788554 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94358901168128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d1a4ccab50 con 0x55d1a4c85560 2024-09-22T08:38:30.681 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.674+0000 7f5dbbfff640 1 -- 172.21.15.142:0/2420788554 <== osd.1 v2:172.21.15.142:6816/3192108003 27 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94358901168128] v32'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5dac081040 con 0x55d1a4c85560 2024-09-22T08:38:30.681 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.674+0000 7f5dc5132800 20 remove_watcher() i=1 2024-09-22T08:38:30.681 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.674+0000 7f5dc5132800 1 -- 172.21.15.142:0/2420788554 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94358901171680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d1a4ccab50 con 0x55d1a4c89f10 2024-09-22T08:38:30.681 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.675+0000 7f5dc15bd640 1 -- 172.21.15.142:0/2420788554 <== osd.3 v2:172.21.15.142:6800/1064901393 16 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94358901171680] v32'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5dbc053020 con 0x55d1a4c89f10 2024-09-22T08:38:30.681 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.675+0000 7f5dc5132800 20 remove_watcher() i=2 2024-09-22T08:38:30.681 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.675+0000 7f5dc5132800 1 -- 172.21.15.142:0/2420788554 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94358901175632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d1a4ccab50 con 0x7f5dbc04d970 2024-09-22T08:38:30.681 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.676+0000 7f5dc0dbc640 1 -- 172.21.15.142:0/2420788554 <== osd.2 v2:172.21.15.142:6808/279438927 12 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94358901175632] v32'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5db4018950 con 0x7f5dbc04d970 2024-09-22T08:38:30.682 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.676+0000 7f5dc5132800 20 remove_watcher() i=3 2024-09-22T08:38:30.682 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.676+0000 7f5dc5132800 1 -- 172.21.15.142:0/2420788554 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94358901169184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d1a4ccab50 con 0x55d1a4c85560 2024-09-22T08:38:30.682 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.678+0000 7f5dbbfff640 1 -- 172.21.15.142:0/2420788554 <== osd.1 v2:172.21.15.142:6816/3192108003 28 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94358901169184] v32'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5dac081040 con 0x55d1a4c85560 2024-09-22T08:38:30.682 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.678+0000 7f5dc5132800 20 remove_watcher() i=4 2024-09-22T08:38:30.682 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.678+0000 7f5dc5132800 1 -- 172.21.15.142:0/2420788554 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94358901179280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d1a4ccab50 con 0x7f5db4017050 2024-09-22T08:38:30.682 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.679+0000 7f5dbbfff640 1 -- 172.21.15.142:0/2420788554 <== osd.0 v2:172.21.15.31:6800/168281188 18 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94358901179280] v32'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5dac081040 con 0x7f5db4017050 2024-09-22T08:38:30.682 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.679+0000 7f5dc5132800 20 remove_watcher() i=5 2024-09-22T08:38:30.682 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.679+0000 7f5dc5132800 1 -- 172.21.15.142:0/2420788554 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94358901181536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d1a4ccab50 con 0x7f5db4017050 2024-09-22T08:38:30.685 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.680+0000 7f5dbbfff640 1 -- 172.21.15.142:0/2420788554 <== osd.0 v2:172.21.15.31:6800/168281188 19 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94358901181536] v32'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5dac081040 con 0x7f5db4017050 2024-09-22T08:38:30.685 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.680+0000 7f5dc5132800 20 remove_watcher() i=6 2024-09-22T08:38:30.685 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.680+0000 7f5dc5132800 1 -- 172.21.15.142:0/2420788554 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94358901185216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d1a4ccab50 con 0x7f5db4017050 2024-09-22T08:38:30.685 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.681+0000 7f5dbbfff640 1 -- 172.21.15.142:0/2420788554 <== osd.0 v2:172.21.15.31:6800/168281188 20 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94358901185216] v32'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5dac081040 con 0x7f5db4017050 2024-09-22T08:38:30.685 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.681+0000 7f5dc5132800 20 remove_watcher() i=7 2024-09-22T08:38:30.686 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.681+0000 7f5dc5132800 1 -- 172.21.15.142:0/2420788554 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f5db4017050 msgr2=0x7f5db4054830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:30.686 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.681+0000 7f5dc5132800 1 --2- 172.21.15.142:0/2420788554 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f5db4017050 0x7f5db4054830 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:30.686 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.681+0000 7f5dc5132800 1 -- 172.21.15.142:0/2420788554 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55d1a4c85560 msgr2=0x55d1a4c87a20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:30.686 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.681+0000 7f5dc5132800 1 --2- 172.21.15.142:0/2420788554 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55d1a4c85560 0x55d1a4c87a20 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:30.686 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.681+0000 7f5dc5132800 1 -- 172.21.15.142:0/2420788554 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f5dbc04d970 msgr2=0x7f5dbc033970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:30.686 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.681+0000 7f5dc5132800 1 --2- 172.21.15.142:0/2420788554 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f5dbc04d970 0x7f5dbc033970 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:30.686 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.681+0000 7f5dc5132800 1 -- 172.21.15.142:0/2420788554 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55d1a4c89f10 msgr2=0x55d1a4c8c300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:30.686 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.681+0000 7f5dc5132800 1 --2- 172.21.15.142:0/2420788554 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55d1a4c89f10 0x55d1a4c8c300 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:30.686 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.681+0000 7f5dc5132800 1 -- 172.21.15.142:0/2420788554 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f5c8c03cf60 msgr2=0x7f5c8c03f420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:30.686 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.681+0000 7f5dc5132800 1 --2- 172.21.15.142:0/2420788554 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f5c8c03cf60 0x7f5c8c03f420 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f5db400efd0 tx=0x7f5db404f000 comp rx=0 tx=0).stop 2024-09-22T08:38:30.686 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.681+0000 7f5dc5132800 1 -- 172.21.15.142:0/2420788554 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d1a4c725d0 msgr2=0x55d1a4c79be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:30.686 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.681+0000 7f5dbbfff640 1 -- 172.21.15.142:0/2420788554 reap_dead start 2024-09-22T08:38:30.686 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.681+0000 7f5dc5132800 1 --2- 172.21.15.142:0/2420788554 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d1a4c725d0 0x55d1a4c79be0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f5dbc0208e0 tx=0x7f5dbc0547f0 comp rx=0 tx=0).stop 2024-09-22T08:38:30.686 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.681+0000 7f5dc5132800 1 -- 172.21.15.142:0/2420788554 shutdown_connections 2024-09-22T08:38:30.687 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.681+0000 7f5dc5132800 1 --2- 172.21.15.142:0/2420788554 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d1a4c725d0 0x55d1a4c79be0 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:30.687 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.681+0000 7f5dc5132800 1 -- 172.21.15.142:0/2420788554 >> 172.21.15.142:0/2420788554 conn(0x55d1a4c6e9d0 msgr2=0x55d1a4c6cbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:38:30.687 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.681+0000 7f5dc5132800 1 -- 172.21.15.142:0/2420788554 shutdown_connections 2024-09-22T08:38:30.687 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.681+0000 7f5dc5132800 1 -- 172.21.15.142:0/2420788554 wait complete. 2024-09-22T08:38:30.687 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.681+0000 7f5dc5132800 1 -- 172.21.15.142:0/3095123938 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f5c9803d000 msgr2=0x7f5c9803f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:30.687 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.681+0000 7f5dc5132800 1 --2- 172.21.15.142:0/3095123938 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f5c9803d000 0x7f5c9803f4c0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f5db4052c40 tx=0x7f5db400beb0 comp rx=0 tx=0).stop 2024-09-22T08:38:30.687 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.681+0000 7f5dc5132800 1 -- 172.21.15.142:0/3095123938 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d1a4c65b50 msgr2=0x55d1a4c65f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:30.687 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.681+0000 7f5dc5132800 1 --2- 172.21.15.142:0/3095123938 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d1a4c65b50 0x55d1a4c65f70 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x55d1a4c4bf70 tx=0x7f5dbc0167b0 comp rx=0 tx=0).stop 2024-09-22T08:38:30.687 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.681+0000 7f5dc5132800 1 -- 172.21.15.142:0/3095123938 shutdown_connections 2024-09-22T08:38:30.687 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.681+0000 7f5dc5132800 1 --2- 172.21.15.142:0/3095123938 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f5c9803d000 0x7f5c9803f4c0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:30.687 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.681+0000 7f5dc5132800 1 --2- 172.21.15.142:0/3095123938 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d1a4c65b50 0x55d1a4c65f70 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:30.687 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.681+0000 7f5dc5132800 1 -- 172.21.15.142:0/3095123938 >> 172.21.15.142:0/3095123938 conn(0x55d1a4c59f00 msgr2=0x55d1a4c5a2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:38:30.687 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.682+0000 7f5dc5132800 1 -- 172.21.15.142:0/3095123938 shutdown_connections 2024-09-22T08:38:30.687 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.682+0000 7f5dc5132800 1 -- 172.21.15.142:0/3095123938 wait complete. 2024-09-22T08:38:30.687 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.682+0000 7f5dc5132800 1 -- 172.21.15.142:0/1142434597 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55d1a4b57c00 msgr2=0x55d1a4c52200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:30.688 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.682+0000 7f5dc5132800 1 --2- 172.21.15.142:0/1142434597 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55d1a4b57c00 0x55d1a4c52200 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:30.688 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.682+0000 7f5dc5132800 1 -- 172.21.15.142:0/1142434597 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55d1a4c546f0 msgr2=0x55d1a4c56ae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:30.688 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.682+0000 7f5dc5132800 1 --2- 172.21.15.142:0/1142434597 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55d1a4c546f0 0x55d1a4c56ae0 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:30.688 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.682+0000 7f5dc5132800 1 -- 172.21.15.142:0/1142434597 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f5ca803d000 msgr2=0x7f5ca803f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:30.688 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.682+0000 7f5dc5132800 1 --2- 172.21.15.142:0/1142434597 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f5ca803d000 0x7f5ca803f4c0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x55d1a4ac48c0 tx=0x7f5dac050000 comp rx=0 tx=0).stop 2024-09-22T08:38:30.688 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.682+0000 7f5dc5132800 1 -- 172.21.15.142:0/1142434597 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d1a4ac5530 msgr2=0x55d1a4c4abb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:30.688 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.682+0000 7f5dc5132800 1 --2- 172.21.15.142:0/1142434597 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d1a4ac5530 0x55d1a4c4abb0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x55d1a4c44020 tx=0x7f5db40040e0 comp rx=0 tx=0).stop 2024-09-22T08:38:30.688 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.682+0000 7f5dc5132800 1 -- 172.21.15.142:0/1142434597 shutdown_connections 2024-09-22T08:38:30.688 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.682+0000 7f5dc5132800 1 --2- 172.21.15.142:0/1142434597 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x55d1a4c546f0 0x55d1a4c56ae0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:30.688 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.682+0000 7f5dc5132800 1 --2- 172.21.15.142:0/1142434597 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x55d1a4b57c00 0x55d1a4c52200 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:30.688 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.682+0000 7f5dc5132800 1 --2- 172.21.15.142:0/1142434597 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f5ca803d000 0x7f5ca803f4c0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:30.688 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.682+0000 7f5dc5132800 1 --2- 172.21.15.142:0/1142434597 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d1a4ac5530 0x55d1a4c4abb0 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:30.688 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.682+0000 7f5dc5132800 1 -- 172.21.15.142:0/1142434597 >> 172.21.15.142:0/1142434597 conn(0x55d1a4b4bbe0 msgr2=0x55d1a4c44580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:38:30.688 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.682+0000 7f5dc5132800 1 -- 172.21.15.142:0/1142434597 shutdown_connections 2024-09-22T08:38:30.688 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.682+0000 7f5dc5132800 1 -- 172.21.15.142:0/1142434597 wait complete. 2024-09-22T08:38:30.692 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-22T08:38:29.459914Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-22T08:38:29.459903Z', 'tags': [], 'group_ids': []} 2024-09-22T08:38:30.692 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-22T08:38:29.459914Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-22T08:38:29.459903Z', 'tags': [], 'group_ids': []} 2024-09-22T08:38:30.693 ERROR:root:0 2024-09-22T08:38:30.693 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-22T08:38:30.697 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-22T08:38:30.697 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'rm', '--uid', 'ada', '--caps', 'users=read, write; user-info-without-keys=*'] 2024-09-22T08:38:30.697 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'rm', '--uid', 'ada', '--caps', 'users=read, write; user-info-without-keys=*'] 2024-09-22T08:38:30.697 DEBUG:teuthology.orchestra.run.smithi142:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps rm --uid ada --caps 'users=read, write; user-info-without-keys=*' 2024-09-22T08:38:30.743 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:38:30.744 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:38:30.744 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.743+0000 7f7a5c530800 1 Processor -- start 2024-09-22T08:38:30.744 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.743+0000 7f7a5c530800 1 -- start start 2024-09-22T08:38:30.744 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.743+0000 7f7a5c530800 1 --2- >> v2:172.21.15.31:3300/0 conn(0x564af780ac00 0x564af780d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:30.744 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.743+0000 7f7a5c530800 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x564af768fa20 con 0x564af7778530 2024-09-22T08:38:30.745 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.743+0000 7f7a5c530800 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x564af768f7d0 con 0x564af780ac00 2024-09-22T08:38:30.745 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.744+0000 7f7a579bb640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x564af780ac00 0x564af780d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:30.745 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.744+0000 7f7a581bc640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x564af7778530 0x564af78094b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.142:50518/0 (socket says 172.21.15.142:50518) 2024-09-22T08:38:30.745 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.744+0000 7f7a581bc640 1 -- 172.21.15.142:0/2141295805 learned_addr learned my addr 172.21.15.142:0/2141295805 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-09-22T08:38:30.745 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.744+0000 7f7a579bb640 1 -- 172.21.15.142:0/2141295805 >> v1:172.21.15.31:6789/0 conn(0x564af7778530 legacy=0x564af78094b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:30.746 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.744+0000 7f7a571ba640 1 -- 172.21.15.142:0/2141295805 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3124058689 0 0) 0x564af768fa20 con 0x564af7778530 2024-09-22T08:38:30.746 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.744+0000 7f7a579bb640 1 -- 172.21.15.142:0/2141295805 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x564af780e7d0 con 0x564af780ac00 2024-09-22T08:38:30.747 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.746+0000 7f7a579bb640 1 --2- 172.21.15.142:0/2141295805 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564af780ac00 0x564af780d0c0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f7a4c00a470 tx=0x7f7a4c045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e6824f375049fe9 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:30.747 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.746+0000 7f7a571ba640 1 -- 172.21.15.142:0/2141295805 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7a4c053570 con 0x564af780ac00 2024-09-22T08:38:30.747 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.746+0000 7f7a571ba640 1 -- 172.21.15.142:0/2141295805 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a4c058070 con 0x564af780ac00 2024-09-22T08:38:30.747 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.746+0000 7f7a571ba640 1 -- 172.21.15.142:0/2141295805 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7a4c053880 con 0x564af780ac00 2024-09-22T08:38:30.748 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.746+0000 7f7a5c530800 1 -- 172.21.15.142:0/2141295805 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564af780ac00 msgr2=0x564af780d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:30.748 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.746+0000 7f7a5c530800 1 --2- 172.21.15.142:0/2141295805 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564af780ac00 0x564af780d0c0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f7a4c00a470 tx=0x7f7a4c045a20 comp rx=0 tx=0).stop 2024-09-22T08:38:30.748 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.746+0000 7f7a5c530800 1 -- 172.21.15.142:0/2141295805 shutdown_connections 2024-09-22T08:38:30.748 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.746+0000 7f7a5c530800 1 --2- 172.21.15.142:0/2141295805 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564af780ac00 0x564af780d0c0 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:30.748 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.746+0000 7f7a5c530800 1 -- 172.21.15.142:0/2141295805 >> 172.21.15.142:0/2141295805 conn(0x564af77febe0 msgr2=0x564af7801020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:38:30.748 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.746+0000 7f7a5c530800 1 -- 172.21.15.142:0/2141295805 shutdown_connections 2024-09-22T08:38:30.748 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.746+0000 7f7a5c530800 1 -- 172.21.15.142:0/2141295805 wait complete. 2024-09-22T08:38:30.761 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.760+0000 7f7a5c530800 1 Processor -- start 2024-09-22T08:38:30.762 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.760+0000 7f7a5c530800 1 -- start start 2024-09-22T08:38:30.762 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.760+0000 7f7a5c530800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564af7778530 0x564af78f60b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:30.762 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.760+0000 7f7a5c530800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x564af769cdd0 con 0x564af7778530 2024-09-22T08:38:30.762 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.761+0000 7f7a581bc640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564af7778530 0x564af78f60b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:30.762 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.761+0000 7f7a581bc640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564af7778530 0x564af78f60b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:52078/0 (socket says 172.21.15.142:52078) 2024-09-22T08:38:30.762 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.761+0000 7f7a581bc640 1 -- 172.21.15.142:0/2401458195 learned_addr learned my addr 172.21.15.142:0/2401458195 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:38:30.763 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.761+0000 7f7a581bc640 1 -- 172.21.15.142:0/2401458195 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564af78f66a0 con 0x564af7778530 2024-09-22T08:38:30.763 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.761+0000 7f7a581bc640 1 --2- 172.21.15.142:0/2401458195 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564af7778530 0x564af78f60b0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f7a48001ea0 tx=0x7f7a4800b6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39630f53c77b2872 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:30.763 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.761+0000 7f794660c640 1 -- 172.21.15.142:0/2401458195 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7a48008070 con 0x564af7778530 2024-09-22T08:38:30.763 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.761+0000 7f794660c640 1 -- 172.21.15.142:0/2401458195 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a4800d500 con 0x564af7778530 2024-09-22T08:38:30.763 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.761+0000 7f794660c640 1 -- 172.21.15.142:0/2401458195 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7a4800d880 con 0x564af7778530 2024-09-22T08:38:30.765 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.762+0000 7f7a5c530800 1 -- 172.21.15.142:0/2401458195 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564af7778530 msgr2=0x564af78f60b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:30.765 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.762+0000 7f7a5c530800 1 --2- 172.21.15.142:0/2401458195 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564af7778530 0x564af78f60b0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f7a48001ea0 tx=0x7f7a4800b6a0 comp rx=0 tx=0).stop 2024-09-22T08:38:30.765 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.762+0000 7f7a5c530800 1 -- 172.21.15.142:0/2401458195 shutdown_connections 2024-09-22T08:38:30.765 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.762+0000 7f7a5c530800 1 --2- 172.21.15.142:0/2401458195 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564af7778530 0x564af78f60b0 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:30.765 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.762+0000 7f7a5c530800 1 -- 172.21.15.142:0/2401458195 >> 172.21.15.142:0/2401458195 conn(0x564af77febe0 msgr2=0x564af78f1a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:38:30.765 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.762+0000 7f7a5c530800 1 -- 172.21.15.142:0/2401458195 shutdown_connections 2024-09-22T08:38:30.765 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.762+0000 7f7a5c530800 1 -- 172.21.15.142:0/2401458195 wait complete. 2024-09-22T08:38:30.765 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.762+0000 7f7a5c530800 1 Processor -- start 2024-09-22T08:38:30.765 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.762+0000 7f7a5c530800 1 -- start start 2024-09-22T08:38:30.765 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.763+0000 7f7a5c530800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564af780ac00 0x564af78fddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:30.765 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.763+0000 7f7a5c530800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x564af780da70 con 0x564af780ac00 2024-09-22T08:38:30.766 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.763+0000 7f7a581bc640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564af780ac00 0x564af78fddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:30.766 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.763+0000 7f7a581bc640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564af780ac00 0x564af78fddf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:52090/0 (socket says 172.21.15.142:52090) 2024-09-22T08:38:30.766 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.763+0000 7f7a581bc640 1 -- 172.21.15.142:0/1797010243 learned_addr learned my addr 172.21.15.142:0/1797010243 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:38:30.766 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.763+0000 7f7a581bc640 1 -- 172.21.15.142:0/1797010243 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564af78fe350 con 0x564af780ac00 2024-09-22T08:38:30.766 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.763+0000 7f7a581bc640 1 --2- 172.21.15.142:0/1797010243 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564af780ac00 0x564af78fddf0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f7a480012f0 tx=0x7f7a48000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:30.766 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.764+0000 7f7944e09640 1 -- 172.21.15.142:0/1797010243 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7a4800de50 con 0x564af780ac00 2024-09-22T08:38:30.766 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.764+0000 7f7944e09640 1 -- 172.21.15.142:0/1797010243 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a4800f930 con 0x564af780ac00 2024-09-22T08:38:30.766 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.764+0000 7f7944e09640 1 -- 172.21.15.142:0/1797010243 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7a4800fc30 con 0x564af780ac00 2024-09-22T08:38:30.766 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.764+0000 7f7a5c530800 1 -- 172.21.15.142:0/1797010243 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564af78fe5e0 con 0x564af780ac00 2024-09-22T08:38:30.766 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.764+0000 7f7a5c530800 1 -- 172.21.15.142:0/1797010243 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564af78fefe0 con 0x564af780ac00 2024-09-22T08:38:30.769 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.764+0000 7f7944e09640 1 -- 172.21.15.142:0/1797010243 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f7a48017040 con 0x564af780ac00 2024-09-22T08:38:30.769 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.765+0000 7f7944e09640 1 --2- 172.21.15.142:0/1797010243 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f794003d1a0 0x7f794003f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:30.769 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.765+0000 7f7944e09640 1 -- 172.21.15.142:0/1797010243 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5938+0+0 (secure 0 0 0) 0x7f7a48015020 con 0x564af780ac00 2024-09-22T08:38:30.769 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.765+0000 7f7a579bb640 1 --2- 172.21.15.142:0/1797010243 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f794003d1a0 0x7f794003f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:30.769 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.765+0000 7f7a5c530800 1 --2- 172.21.15.142:0/1797010243 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x564af78ffae0 0x564af7905440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:30.769 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.765+0000 7f7a5c530800 1 -- 172.21.15.142:0/1797010243 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564af79059c0 con 0x564af78ffae0 2024-09-22T08:38:30.769 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.765+0000 7f7a589bd640 1 --2- 172.21.15.142:0/1797010243 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x564af78ffae0 0x564af7905440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:30.769 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.765+0000 7f7a579bb640 1 --2- 172.21.15.142:0/1797010243 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f794003d1a0 0x7f794003f660 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f7a4c057000 tx=0x7f7a4c052000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:30.769 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.765+0000 7f7a589bd640 1 --2- 172.21.15.142:0/1797010243 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x564af78ffae0 0x564af7905440 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:30.769 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.766+0000 7f7a589bd640 1 -- 172.21.15.142:0/1797010243 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7a5000a4d0 con 0x564af78ffae0 2024-09-22T08:38:30.770 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.766+0000 7f7a5c530800 1 -- 172.21.15.142:0/1797010243 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564af78ff490 con 0x564af78ffae0 2024-09-22T08:38:30.770 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.766+0000 7f7a589bd640 1 -- 172.21.15.142:0/1797010243 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7a5000a4d0 con 0x564af78ffae0 2024-09-22T08:38:30.770 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.766+0000 7f7a5c530800 1 --2- 172.21.15.142:0/1797010243 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x564af7907d10 0x564af790a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:30.770 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.766+0000 7f7a5c530800 1 -- 172.21.15.142:0/1797010243 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:3 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564af790a7d0 con 0x564af7907d10 2024-09-22T08:38:30.770 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.766+0000 7f7a581bc640 1 --2- 172.21.15.142:0/1797010243 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x564af7907d10 0x564af790a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:30.770 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.766+0000 7f7a581bc640 1 --2- 172.21.15.142:0/1797010243 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x564af7907d10 0x564af790a100 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:30.770 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.767+0000 7f7a581bc640 1 -- 172.21.15.142:0/1797010243 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(3 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f7a4802d070 con 0x564af7907d10 2024-09-22T08:38:30.770 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.767+0000 7f7a5c530800 1 -- 172.21.15.142:0/1797010243 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564af7906bb0 con 0x564af78ffae0 2024-09-22T08:38:30.770 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.767+0000 7f7a589bd640 1 -- 172.21.15.142:0/1797010243 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7a5000a4d0 con 0x564af78ffae0 2024-09-22T08:38:30.770 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.767+0000 7f7a5c530800 1 -- 172.21.15.142:0/1797010243 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564af7907050 con 0x564af7907d10 2024-09-22T08:38:30.770 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.767+0000 7f7a581bc640 1 -- 172.21.15.142:0/1797010243 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(5 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f7a4802d070 con 0x564af7907d10 2024-09-22T08:38:30.770 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.768+0000 7f7a5c530800 1 Processor -- start 2024-09-22T08:38:30.770 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.768+0000 7f7a5c530800 1 -- start start 2024-09-22T08:38:30.771 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.768+0000 7f7a5c530800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564af7919190 0x564af79195b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:30.771 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.768+0000 7f7a5c530800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x564af76fbd50 con 0x564af7919190 2024-09-22T08:38:30.775 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.768+0000 7f7a589bd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564af7919190 0x564af79195b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:30.775 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.768+0000 7f7a589bd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564af7919190 0x564af79195b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:52102/0 (socket says 172.21.15.142:52102) 2024-09-22T08:38:30.775 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.768+0000 7f7a589bd640 1 -- 172.21.15.142:0/201298106 learned_addr learned my addr 172.21.15.142:0/201298106 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:38:30.776 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.769+0000 7f7a589bd640 1 -- 172.21.15.142:0/201298106 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564af7919bf0 con 0x564af7919190 2024-09-22T08:38:30.776 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.769+0000 7f7a589bd640 1 --2- 172.21.15.142:0/201298106 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564af7919190 0x564af79195b0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x564af78fec80 tx=0x7f7a500167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:30.776 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.769+0000 7f793dffb640 1 -- 172.21.15.142:0/201298106 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7a50013640 con 0x564af7919190 2024-09-22T08:38:30.776 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.769+0000 7f793dffb640 1 -- 172.21.15.142:0/201298106 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a500137e0 con 0x564af7919190 2024-09-22T08:38:30.776 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.769+0000 7f7a5c530800 1 -- 172.21.15.142:0/201298106 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564af791a420 con 0x564af7919190 2024-09-22T08:38:30.776 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.769+0000 7f793dffb640 1 -- 172.21.15.142:0/201298106 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7a50013ac0 con 0x564af7919190 2024-09-22T08:38:30.776 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.769+0000 7f7a5c530800 1 -- 172.21.15.142:0/201298106 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564af791a9c0 con 0x564af7919190 2024-09-22T08:38:30.776 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.770+0000 7f793dffb640 1 -- 172.21.15.142:0/201298106 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f7a50011040 con 0x564af7919190 2024-09-22T08:38:30.776 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.770+0000 7f793dffb640 1 --2- 172.21.15.142:0/201298106 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f793003cfb0 0x7f793003f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:30.776 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.770+0000 7f793dffb640 1 -- 172.21.15.142:0/201298106 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5938+0+0 (secure 0 0 0) 0x7f7a5000e040 con 0x564af7919190 2024-09-22T08:38:30.776 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.770+0000 7f7a581bc640 1 --2- 172.21.15.142:0/201298106 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f793003cfb0 0x7f793003f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:30.776 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.770+0000 7f7a5c530800 1 Processor -- start 2024-09-22T08:38:30.777 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.770+0000 7f7a5c530800 1 -- start start 2024-09-22T08:38:30.777 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.770+0000 7f7a581bc640 1 --2- 172.21.15.142:0/201298106 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f793003cfb0 0x7f793003f470 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x564af7905e90 tx=0x7f7a48052f30 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:30.777 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.771+0000 7f7a5c530800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564af7925c50 0x564af7926050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:30.777 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.771+0000 7f7a5c530800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x564af78f6ad0 con 0x564af7925c50 2024-09-22T08:38:30.777 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.771+0000 7f7a589bd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564af7925c50 0x564af7926050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:30.777 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.771+0000 7f7a589bd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564af7925c50 0x564af7926050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:52110/0 (socket says 172.21.15.142:52110) 2024-09-22T08:38:30.777 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.771+0000 7f7a589bd640 1 -- 172.21.15.142:0/3094378027 learned_addr learned my addr 172.21.15.142:0/3094378027 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:38:30.777 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.771+0000 7f7a589bd640 1 -- 172.21.15.142:0/3094378027 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564af7926640 con 0x564af7925c50 2024-09-22T08:38:30.777 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.771+0000 7f7a589bd640 1 --2- 172.21.15.142:0/3094378027 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564af7925c50 0x564af7926050 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f7a50020000 tx=0x7f7a500204d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5051bb688a87feb1 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:30.777 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.771+0000 7f79377fe640 1 -- 172.21.15.142:0/3094378027 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7a50051070 con 0x564af7925c50 2024-09-22T08:38:30.777 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.771+0000 7f79377fe640 1 -- 172.21.15.142:0/3094378027 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a50021a90 con 0x564af7925c50 2024-09-22T08:38:30.777 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.771+0000 7f79377fe640 1 -- 172.21.15.142:0/3094378027 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7a50021570 con 0x564af7925c50 2024-09-22T08:38:30.777 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.772+0000 7f7a5c530800 1 -- 172.21.15.142:0/3094378027 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564af7925c50 msgr2=0x564af7926050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:30.778 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.772+0000 7f7a5c530800 1 --2- 172.21.15.142:0/3094378027 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564af7925c50 0x564af7926050 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f7a50020000 tx=0x7f7a500204d0 comp rx=0 tx=0).stop 2024-09-22T08:38:30.778 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.772+0000 7f7a5c530800 1 -- 172.21.15.142:0/3094378027 shutdown_connections 2024-09-22T08:38:30.778 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.772+0000 7f7a5c530800 1 --2- 172.21.15.142:0/3094378027 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564af7925c50 0x564af7926050 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:30.778 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.772+0000 7f7a5c530800 1 -- 172.21.15.142:0/3094378027 >> 172.21.15.142:0/3094378027 conn(0x564af7922050 msgr2=0x564af7920290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:38:30.778 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.772+0000 7f7a5c530800 1 -- 172.21.15.142:0/3094378027 shutdown_connections 2024-09-22T08:38:30.778 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.772+0000 7f7a5c530800 1 -- 172.21.15.142:0/3094378027 wait complete. 2024-09-22T08:38:30.778 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.772+0000 7f7a5c530800 1 Processor -- start 2024-09-22T08:38:30.778 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.772+0000 7f7a5c530800 1 -- start start 2024-09-22T08:38:30.778 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.772+0000 7f7a5c530800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564af7925c50 0x564af792d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:30.778 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.772+0000 7f7a5c530800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x564af7926c60 con 0x564af7925c50 2024-09-22T08:38:30.778 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.772+0000 7f7a589bd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564af7925c50 0x564af792d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:30.778 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.772+0000 7f7a589bd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564af7925c50 0x564af792d230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:52120/0 (socket says 172.21.15.142:52120) 2024-09-22T08:38:30.779 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.772+0000 7f7a589bd640 1 -- 172.21.15.142:0/1134973049 learned_addr learned my addr 172.21.15.142:0/1134973049 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:38:30.779 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.773+0000 7f7a589bd640 1 -- 172.21.15.142:0/1134973049 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564af792d790 con 0x564af7925c50 2024-09-22T08:38:30.779 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.773+0000 7f7a589bd640 1 --2- 172.21.15.142:0/1134973049 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564af7925c50 0x564af792d230 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f7a50013fd0 tx=0x7f7a50054840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:30.779 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.773+0000 7f7935ffb640 1 -- 172.21.15.142:0/1134973049 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7a50020de0 con 0x564af7925c50 2024-09-22T08:38:30.779 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.773+0000 7f7935ffb640 1 -- 172.21.15.142:0/1134973049 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a5001fa90 con 0x564af7925c50 2024-09-22T08:38:30.779 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.773+0000 7f7a5c530800 1 -- 172.21.15.142:0/1134973049 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564af792da20 con 0x564af7925c50 2024-09-22T08:38:30.779 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.773+0000 7f7935ffb640 1 -- 172.21.15.142:0/1134973049 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7a5001fd70 con 0x564af7925c50 2024-09-22T08:38:30.779 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.773+0000 7f7a5c530800 1 -- 172.21.15.142:0/1134973049 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564af792e3a0 con 0x564af7925c50 2024-09-22T08:38:30.779 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.774+0000 7f7935ffb640 1 -- 172.21.15.142:0/1134973049 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f7a5001f500 con 0x564af7925c50 2024-09-22T08:38:30.779 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.774+0000 7f7935ffb640 1 --2- 172.21.15.142:0/1134973049 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f792803cf10 0x7f792803f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:30.779 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.774+0000 7f7935ffb640 1 -- 172.21.15.142:0/1134973049 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5938+0+0 (secure 0 0 0) 0x7f7a50017650 con 0x564af7925c50 2024-09-22T08:38:30.779 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.774+0000 7f7a581bc640 1 --2- 172.21.15.142:0/1134973049 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f792803cf10 0x7f792803f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:30.779 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.774+0000 7f7a581bc640 1 --2- 172.21.15.142:0/1134973049 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f792803cf10 0x7f792803f3d0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f7a4801adc0 tx=0x7f7a4804f000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:30.791 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.775+0000 7f7a5c530800 20 rados->read ofs=0 len=0 2024-09-22T08:38:30.791 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.775+0000 7f7a5c530800 1 --2- 172.21.15.142:0/1134973049 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x564af7938b60 0x564af793b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:30.791 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.775+0000 7f7a5c530800 1 -- 172.21.15.142:0/1134973049 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564af793b770 con 0x564af7938b60 2024-09-22T08:38:30.791 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.775+0000 7f7a579bb640 1 --2- 172.21.15.142:0/1134973049 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x564af7938b60 0x564af793b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:30.791 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.775+0000 7f7a579bb640 1 --2- 172.21.15.142:0/1134973049 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x564af7938b60 0x564af793b020 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:30.791 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.775+0000 7f7a579bb640 1 -- 172.21.15.142:0/1134973049 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7a4c051070 con 0x564af7938b60 2024-09-22T08:38:30.791 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.775+0000 7f7a5c530800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:30.791 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.775+0000 7f7a5c530800 20 realm 2024-09-22T08:38:30.791 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.775+0000 7f7a5c530800 20 rados->read ofs=0 len=0 2024-09-22T08:38:30.791 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.775+0000 7f7a5c530800 1 -- 172.21.15.142:0/1134973049 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564af793bba0 con 0x564af7938b60 2024-09-22T08:38:30.791 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.776+0000 7f7a579bb640 1 -- 172.21.15.142:0/1134973049 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7a4c051070 con 0x564af7938b60 2024-09-22T08:38:30.791 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.776+0000 7f7a5c530800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:30.792 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.776+0000 7f7a5c530800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:38:30.792 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.776+0000 7f7a5c530800 20 rados->read ofs=0 len=0 2024-09-22T08:38:30.792 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.776+0000 7f7a5c530800 1 -- 172.21.15.142:0/1134973049 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564af793c470 con 0x564af7938b60 2024-09-22T08:38:30.792 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.776+0000 7f7a579bb640 1 -- 172.21.15.142:0/1134973049 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7a4c051070 con 0x564af7938b60 2024-09-22T08:38:30.792 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.776+0000 7f7a5c530800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:30.792 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.776+0000 7f7a5c530800 20 rados->read ofs=0 len=0 2024-09-22T08:38:30.792 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.776+0000 7f7a5c530800 1 -- 172.21.15.142:0/1134973049 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564af793c810 con 0x564af7938b60 2024-09-22T08:38:30.792 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.776+0000 7f7a579bb640 1 -- 172.21.15.142:0/1134973049 <== osd.1 v2:172.21.15.142:6816/3192108003 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7a4c051070 con 0x564af7938b60 2024-09-22T08:38:30.792 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.776+0000 7f7a5c530800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:38:30.792 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.776+0000 7f7a5c530800 20 rados->read ofs=0 len=0 2024-09-22T08:38:30.792 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.776+0000 7f7a5c530800 1 --2- 172.21.15.142:0/1134973049 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x564af793d570 0x564af793f960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:30.792 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.776+0000 7f7a5c530800 1 -- 172.21.15.142:0/1134973049 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564af793ff70 con 0x564af793d570 2024-09-22T08:38:30.792 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.776+0000 7f7a589bd640 1 --2- 172.21.15.142:0/1134973049 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x564af793d570 0x564af793f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:30.792 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.776+0000 7f7a589bd640 1 --2- 172.21.15.142:0/1134973049 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x564af793d570 0x564af793f960 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:30.792 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.777+0000 7f7a589bd640 1 -- 172.21.15.142:0/1134973049 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(5 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f7a5000a4d0 con 0x564af793d570 2024-09-22T08:38:30.793 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.777+0000 7f7a5c530800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:38:30.793 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.777+0000 7f7a5c530800 20 searching for the correct realm 2024-09-22T08:38:30.793 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.777+0000 7f7a5c530800 1 -- 172.21.15.142:0/1134973049 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564af79418a0 con 0x564af793d570 2024-09-22T08:38:30.793 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.777+0000 7f7a589bd640 1 -- 172.21.15.142:0/1134973049 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a5000a4d0 con 0x564af793d570 2024-09-22T08:38:30.793 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.777+0000 7f7a589bd640 1 --2- 172.21.15.142:0/1134973049 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f7a50012ae0 0x7f7a50033940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:30.793 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.777+0000 7f7a589bd640 1 -- 172.21.15.142:0/1134973049 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564af79418a0 con 0x7f7a50012ae0 2024-09-22T08:38:30.793 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.777+0000 7f7a581bc640 1 --2- 172.21.15.142:0/1134973049 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f7a50012ae0 0x7f7a50033940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:30.793 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.777+0000 7f7a581bc640 1 --2- 172.21.15.142:0/1134973049 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f7a50012ae0 0x7f7a50033940 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:30.793 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.778+0000 7f7a581bc640 1 -- 172.21.15.142:0/1134973049 <== osd.2 v2:172.21.15.142:6808/279438927 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a4802d070 con 0x7f7a50012ae0 2024-09-22T08:38:30.793 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.778+0000 7f7a581bc640 1 --2- 172.21.15.142:0/1134973049 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f7a4803c070 0x7f7a48030480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:30.793 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.778+0000 7f7a581bc640 1 -- 172.21.15.142:0/1134973049 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564af79418a0 con 0x7f7a4803c070 2024-09-22T08:38:30.793 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.778+0000 7f7a579bb640 1 --2- 172.21.15.142:0/1134973049 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f7a4803c070 0x7f7a48030480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:30.793 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.778+0000 7f7a579bb640 1 --2- 172.21.15.142:0/1134973049 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f7a4803c070 0x7f7a48030480 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:30.793 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.779+0000 7f7a579bb640 1 -- 172.21.15.142:0/1134973049 <== osd.0 v2:172.21.15.31:6800/168281188 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a4c051070 con 0x7f7a4803c070 2024-09-22T08:38:30.794 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.779+0000 7f7a579bb640 1 -- 172.21.15.142:0/1134973049 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564af79418a0 con 0x564af7938b60 2024-09-22T08:38:30.794 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.779+0000 7f7a579bb640 1 -- 172.21.15.142:0/1134973049 <== osd.1 v2:172.21.15.142:6816/3192108003 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a4c051070 con 0x564af7938b60 2024-09-22T08:38:30.794 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.779+0000 7f7a579bb640 1 -- 172.21.15.142:0/1134973049 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564af79418a0 con 0x564af7938b60 2024-09-22T08:38:30.794 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.779+0000 7f7a579bb640 1 -- 172.21.15.142:0/1134973049 <== osd.1 v2:172.21.15.142:6816/3192108003 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a4c051070 con 0x564af7938b60 2024-09-22T08:38:30.794 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.779+0000 7f7a579bb640 1 -- 172.21.15.142:0/1134973049 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564af79418a0 con 0x564af7938b60 2024-09-22T08:38:30.794 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.779+0000 7f7a579bb640 1 -- 172.21.15.142:0/1134973049 <== osd.1 v2:172.21.15.142:6816/3192108003 7 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a4c051070 con 0x564af7938b60 2024-09-22T08:38:30.794 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.779+0000 7f7a579bb640 1 -- 172.21.15.142:0/1134973049 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564af79418a0 con 0x7f7a4803c070 2024-09-22T08:38:30.794 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.779+0000 7f7a579bb640 1 -- 172.21.15.142:0/1134973049 <== osd.0 v2:172.21.15.31:6800/168281188 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a4c051070 con 0x7f7a4803c070 2024-09-22T08:38:30.794 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.779+0000 7f7a579bb640 1 -- 172.21.15.142:0/1134973049 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564af79418a0 con 0x7f7a50012ae0 2024-09-22T08:38:30.794 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.780+0000 7f7a581bc640 1 -- 172.21.15.142:0/1134973049 <== osd.2 v2:172.21.15.142:6808/279438927 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a4802d070 con 0x7f7a50012ae0 2024-09-22T08:38:30.794 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.780+0000 7f7a581bc640 1 -- 172.21.15.142:0/1134973049 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564af79418a0 con 0x564af793d570 2024-09-22T08:38:30.794 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.780+0000 7f7a589bd640 1 -- 172.21.15.142:0/1134973049 <== osd.3 v2:172.21.15.142:6800/1064901393 3 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a5000a4d0 con 0x564af793d570 2024-09-22T08:38:30.794 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.780+0000 7f7a589bd640 1 -- 172.21.15.142:0/1134973049 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564af79418a0 con 0x564af7938b60 2024-09-22T08:38:30.794 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.780+0000 7f7a579bb640 1 -- 172.21.15.142:0/1134973049 <== osd.1 v2:172.21.15.142:6816/3192108003 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a4c051070 con 0x564af7938b60 2024-09-22T08:38:30.795 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.780+0000 7f7a579bb640 1 -- 172.21.15.142:0/1134973049 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564af79418a0 con 0x7f7a4803c070 2024-09-22T08:38:30.795 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.781+0000 7f7a579bb640 1 -- 172.21.15.142:0/1134973049 <== osd.0 v2:172.21.15.31:6800/168281188 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a4c051070 con 0x7f7a4803c070 2024-09-22T08:38:30.795 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.781+0000 7f7a579bb640 1 -- 172.21.15.142:0/1134973049 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564af79418a0 con 0x564af7938b60 2024-09-22T08:38:30.795 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.781+0000 7f7a579bb640 1 -- 172.21.15.142:0/1134973049 <== osd.1 v2:172.21.15.142:6816/3192108003 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a4c051070 con 0x564af7938b60 2024-09-22T08:38:30.795 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.781+0000 7f7a579bb640 1 -- 172.21.15.142:0/1134973049 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564af79418a0 con 0x7f7a50012ae0 2024-09-22T08:38:30.795 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.781+0000 7f7a581bc640 1 -- 172.21.15.142:0/1134973049 <== osd.2 v2:172.21.15.142:6808/279438927 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f7a4802d070 con 0x7f7a50012ae0 2024-09-22T08:38:30.795 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.781+0000 7f7a581bc640 1 -- 172.21.15.142:0/1134973049 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564af79418a0 con 0x564af793d570 2024-09-22T08:38:30.795 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.781+0000 7f7a589bd640 1 -- 172.21.15.142:0/1134973049 <== osd.3 v2:172.21.15.142:6800/1064901393 4 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a5000a4d0 con 0x564af793d570 2024-09-22T08:38:30.795 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.781+0000 7f7a589bd640 1 -- 172.21.15.142:0/1134973049 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564af79418a0 con 0x564af793d570 2024-09-22T08:38:30.795 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.782+0000 7f7a589bd640 1 -- 172.21.15.142:0/1134973049 <== osd.3 v2:172.21.15.142:6800/1064901393 5 ==== osd_op_reply(20 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f7a5000a4d0 con 0x564af793d570 2024-09-22T08:38:30.795 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.782+0000 7f7a589bd640 1 -- 172.21.15.142:0/1134973049 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564af79418a0 con 0x7f7a4803c070 2024-09-22T08:38:30.795 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.782+0000 7f7a579bb640 1 -- 172.21.15.142:0/1134973049 <== osd.0 v2:172.21.15.31:6800/168281188 4 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a4c051070 con 0x7f7a4803c070 2024-09-22T08:38:30.795 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.782+0000 7f7a579bb640 1 -- 172.21.15.142:0/1134973049 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564af79418a0 con 0x564af793d570 2024-09-22T08:38:30.795 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.782+0000 7f7a589bd640 1 -- 172.21.15.142:0/1134973049 <== osd.3 v2:172.21.15.142:6800/1064901393 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a5000a4d0 con 0x564af793d570 2024-09-22T08:38:30.796 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.782+0000 7f7a589bd640 1 -- 172.21.15.142:0/1134973049 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564af79418a0 con 0x564af793d570 2024-09-22T08:38:30.796 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.782+0000 7f7a589bd640 1 -- 172.21.15.142:0/1134973049 <== osd.3 v2:172.21.15.142:6800/1064901393 7 ==== osd_op_reply(23 [pgnls start_epoch 32 out=107b] v32'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f7a5000a4d0 con 0x564af793d570 2024-09-22T08:38:30.796 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.782+0000 7f7a589bd640 1 -- 172.21.15.142:0/1134973049 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564af79418a0 con 0x564af7938b60 2024-09-22T08:38:30.796 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.783+0000 7f7a579bb640 1 -- 172.21.15.142:0/1134973049 <== osd.1 v2:172.21.15.142:6816/3192108003 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a4c051070 con 0x564af7938b60 2024-09-22T08:38:30.796 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.783+0000 7f7a579bb640 1 -- 172.21.15.142:0/1134973049 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564af79418a0 con 0x564af7938b60 2024-09-22T08:38:30.796 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.783+0000 7f7a579bb640 1 -- 172.21.15.142:0/1134973049 <== osd.1 v2:172.21.15.142:6816/3192108003 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v32'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f7a4c051070 con 0x564af7938b60 2024-09-22T08:38:30.796 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.783+0000 7f7a579bb640 1 -- 172.21.15.142:0/1134973049 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564af79418a0 con 0x7f7a4803c070 2024-09-22T08:38:30.796 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.783+0000 7f7a579bb640 1 -- 172.21.15.142:0/1134973049 <== osd.0 v2:172.21.15.31:6800/168281188 5 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a4c051070 con 0x7f7a4803c070 2024-09-22T08:38:30.796 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.783+0000 7f7a579bb640 1 -- 172.21.15.142:0/1134973049 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564af79418a0 con 0x564af793d570 2024-09-22T08:38:30.796 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.783+0000 7f7a589bd640 1 -- 172.21.15.142:0/1134973049 <== osd.3 v2:172.21.15.142:6800/1064901393 8 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a5000a4d0 con 0x564af793d570 2024-09-22T08:38:30.796 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.783+0000 7f7a589bd640 1 -- 172.21.15.142:0/1134973049 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564af79418a0 con 0x7f7a50012ae0 2024-09-22T08:38:30.796 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.784+0000 7f7a581bc640 1 -- 172.21.15.142:0/1134973049 <== osd.2 v2:172.21.15.142:6808/279438927 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a4802d070 con 0x7f7a50012ae0 2024-09-22T08:38:30.796 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.784+0000 7f7a581bc640 1 -- 172.21.15.142:0/1134973049 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564af79418a0 con 0x564af7938b60 2024-09-22T08:38:30.796 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.784+0000 7f7a579bb640 1 -- 172.21.15.142:0/1134973049 <== osd.1 v2:172.21.15.142:6816/3192108003 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a4c051070 con 0x564af7938b60 2024-09-22T08:38:30.797 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.784+0000 7f7a579bb640 1 -- 172.21.15.142:0/1134973049 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564af79418a0 con 0x7f7a4803c070 2024-09-22T08:38:30.797 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.784+0000 7f7a579bb640 1 -- 172.21.15.142:0/1134973049 <== osd.0 v2:172.21.15.31:6800/168281188 6 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a4c051070 con 0x7f7a4803c070 2024-09-22T08:38:30.797 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.784+0000 7f7a579bb640 1 -- 172.21.15.142:0/1134973049 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564af79418a0 con 0x564af793d570 2024-09-22T08:38:30.797 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.784+0000 7f7a589bd640 1 -- 172.21.15.142:0/1134973049 <== osd.3 v2:172.21.15.142:6800/1064901393 9 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a5000a4d0 con 0x564af793d570 2024-09-22T08:38:30.797 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.784+0000 7f7a589bd640 1 -- 172.21.15.142:0/1134973049 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564af79418a0 con 0x7f7a4803c070 2024-09-22T08:38:30.797 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.785+0000 7f7a579bb640 1 -- 172.21.15.142:0/1134973049 <== osd.0 v2:172.21.15.31:6800/168281188 7 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a4c051070 con 0x7f7a4803c070 2024-09-22T08:38:30.797 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.785+0000 7f7a579bb640 1 -- 172.21.15.142:0/1134973049 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564af79418a0 con 0x7f7a50012ae0 2024-09-22T08:38:30.797 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.785+0000 7f7a581bc640 1 -- 172.21.15.142:0/1134973049 <== osd.2 v2:172.21.15.142:6808/279438927 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a4802d070 con 0x7f7a50012ae0 2024-09-22T08:38:30.797 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.785+0000 7f7a581bc640 1 -- 172.21.15.142:0/1134973049 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564af79418a0 con 0x564af793d570 2024-09-22T08:38:30.797 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.785+0000 7f7a589bd640 1 -- 172.21.15.142:0/1134973049 <== osd.3 v2:172.21.15.142:6800/1064901393 10 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a5000a4d0 con 0x564af793d570 2024-09-22T08:38:30.797 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.785+0000 7f7a589bd640 1 -- 172.21.15.142:0/1134973049 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564af79418a0 con 0x7f7a4803c070 2024-09-22T08:38:30.797 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.785+0000 7f7a579bb640 1 -- 172.21.15.142:0/1134973049 <== osd.0 v2:172.21.15.31:6800/168281188 8 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a4c051070 con 0x7f7a4803c070 2024-09-22T08:38:30.797 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.785+0000 7f7a579bb640 1 -- 172.21.15.142:0/1134973049 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564af79418a0 con 0x564af7938b60 2024-09-22T08:38:30.798 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.786+0000 7f7a579bb640 1 -- 172.21.15.142:0/1134973049 <== osd.1 v2:172.21.15.142:6816/3192108003 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v32'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f7a4c051070 con 0x564af7938b60 2024-09-22T08:38:30.798 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.786+0000 7f7a579bb640 1 -- 172.21.15.142:0/1134973049 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564af79418a0 con 0x7f7a50012ae0 2024-09-22T08:38:30.798 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.786+0000 7f7a581bc640 1 -- 172.21.15.142:0/1134973049 <== osd.2 v2:172.21.15.142:6808/279438927 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a4802d070 con 0x7f7a50012ae0 2024-09-22T08:38:30.798 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.786+0000 7f7a5c530800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:38:30.798 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.786+0000 7f7a5c530800 20 RGWRados::pool_iterate: got zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec 2024-09-22T08:38:30.798 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.786+0000 7f7a5c530800 20 RGWRados::pool_iterate: got zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f 2024-09-22T08:38:30.798 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.786+0000 7f7a5c530800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:38:30.798 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.786+0000 7f7a5c530800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:38:30.798 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.786+0000 7f7a5c530800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:38:30.798 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.786+0000 7f7a5c530800 20 rados->read ofs=0 len=0 2024-09-22T08:38:30.798 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.786+0000 7f7a5c530800 1 -- 172.21.15.142:0/1134973049 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564af7940930 con 0x564af7938b60 2024-09-22T08:38:30.798 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.786+0000 7f7a579bb640 1 -- 172.21.15.142:0/1134973049 <== osd.1 v2:172.21.15.142:6816/3192108003 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7a4c051070 con 0x564af7938b60 2024-09-22T08:38:30.798 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.786+0000 7f7a5c530800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:30.798 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.786+0000 7f7a5c530800 20 rados->read ofs=0 len=0 2024-09-22T08:38:30.799 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.786+0000 7f7a5c530800 1 -- 172.21.15.142:0/1134973049 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564af7941180 con 0x564af7938b60 2024-09-22T08:38:30.799 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.786+0000 7f7a579bb640 1 -- 172.21.15.142:0/1134973049 <== osd.1 v2:172.21.15.142:6816/3192108003 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7a4c051070 con 0x564af7938b60 2024-09-22T08:38:30.799 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.786+0000 7f7a5c530800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:38:30.799 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.786+0000 7f7a5c530800 20 rados->read ofs=0 len=0 2024-09-22T08:38:30.799 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.786+0000 7f7a5c530800 1 -- 172.21.15.142:0/1134973049 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:40 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564af7941d20 con 0x564af793d570 2024-09-22T08:38:30.799 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.787+0000 7f7a589bd640 1 -- 172.21.15.142:0/1134973049 <== osd.3 v2:172.21.15.142:6800/1064901393 11 ==== osd_op_reply(40 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f7a5000a4d0 con 0x564af793d570 2024-09-22T08:38:30.799 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.787+0000 7f7a5c530800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:38:30.799 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.787+0000 7f7a5c530800 20 zone default found 2024-09-22T08:38:30.799 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.787+0000 7f7a5c530800 4 Realm: () 2024-09-22T08:38:30.799 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.787+0000 7f7a5c530800 4 ZoneGroup: default (d89f6f57-1007-47dd-9065-f486c7b01aec) 2024-09-22T08:38:30.799 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.787+0000 7f7a5c530800 4 Zone: default (e239248c-0bee-4e41-803a-24b288d3eb8f) 2024-09-22T08:38:30.799 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.787+0000 7f7a5c530800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:38:30.799 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.787+0000 7f7a5c530800 20 zonegroup default 2024-09-22T08:38:30.800 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.787+0000 7f7a5c530800 20 rados->read ofs=0 len=0 2024-09-22T08:38:30.800 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.787+0000 7f7a5c530800 1 -- 172.21.15.142:0/1134973049 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564af7942120 con 0x7f7a4803c070 2024-09-22T08:38:30.800 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.787+0000 7f7a579bb640 1 -- 172.21.15.142:0/1134973049 <== osd.0 v2:172.21.15.31:6800/168281188 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f7a4c051070 con 0x7f7a4803c070 2024-09-22T08:38:30.800 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.787+0000 7f7a5c530800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:30.800 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.787+0000 7f7a5c530800 20 rados->read ofs=0 len=0 2024-09-22T08:38:30.800 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.787+0000 7f7a5c530800 1 -- 172.21.15.142:0/1134973049 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564af7944400 con 0x564af793d570 2024-09-22T08:38:30.800 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.787+0000 7f7a589bd640 1 -- 172.21.15.142:0/1134973049 <== osd.3 v2:172.21.15.142:6800/1064901393 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7a5000a4d0 con 0x564af793d570 2024-09-22T08:38:30.800 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.787+0000 7f7a5c530800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:30.800 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.787+0000 7f7a5c530800 20 rados->read ofs=0 len=0 2024-09-22T08:38:30.800 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.787+0000 7f7a5c530800 1 -- 172.21.15.142:0/1134973049 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564af79447a0 con 0x564af793d570 2024-09-22T08:38:30.800 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.788+0000 7f7a589bd640 1 -- 172.21.15.142:0/1134973049 <== osd.3 v2:172.21.15.142:6800/1064901393 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7a5000a4d0 con 0x564af793d570 2024-09-22T08:38:30.800 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.788+0000 7f7a5c530800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:30.800 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.788+0000 7f7a5c530800 20 started sync module instance, tier type = 2024-09-22T08:38:30.800 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.788+0000 7f7a5c530800 20 started zone id=e239248c-0bee-4e41-803a-24b288d3eb8f (name=default) with tier type = 2024-09-22T08:38:30.800 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.788+0000 7f7a5c530800 1 -- 172.21.15.142:0/1134973049 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564af7943890 con 0x7f7a50012ae0 2024-09-22T08:38:30.801 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.789+0000 7f7a581bc640 1 -- 172.21.15.142:0/1134973049 <== osd.2 v2:172.21.15.142:6808/279438927 7 ==== osd_op_reply(44 notify.0 [create] v32'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a4802d070 con 0x7f7a50012ae0 2024-09-22T08:38:30.801 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.789+0000 7f7a5c530800 1 -- 172.21.15.142:0/1134973049 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94879981255808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564af79434f0 con 0x7f7a50012ae0 2024-09-22T08:38:30.801 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.789+0000 7f7a5c530800 1 -- 172.21.15.142:0/1134973049 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564af7945660 con 0x564af7938b60 2024-09-22T08:38:30.806 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.790+0000 7f7a581bc640 1 -- 172.21.15.142:0/1134973049 <== osd.2 v2:172.21.15.142:6808/279438927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94879981255808] v32'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a4802d070 con 0x7f7a50012ae0 2024-09-22T08:38:30.806 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.790+0000 7f7a579bb640 1 -- 172.21.15.142:0/1134973049 <== osd.1 v2:172.21.15.142:6816/3192108003 16 ==== osd_op_reply(46 notify.1 [create] v32'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a4c051070 con 0x564af7938b60 2024-09-22T08:38:30.806 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.790+0000 7f7a5c530800 1 -- 172.21.15.142:0/1134973049 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94879981261232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564af7945a80 con 0x564af7938b60 2024-09-22T08:38:30.806 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.790+0000 7f7a5c530800 1 -- 172.21.15.142:0/1134973049 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564af7946440 con 0x564af793d570 2024-09-22T08:38:30.806 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.792+0000 7f7a589bd640 1 -- 172.21.15.142:0/1134973049 <== osd.3 v2:172.21.15.142:6800/1064901393 14 ==== osd_op_reply(48 notify.2 [create] v32'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a5000a4d0 con 0x564af793d570 2024-09-22T08:38:30.806 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.792+0000 7f7a579bb640 1 -- 172.21.15.142:0/1134973049 <== osd.1 v2:172.21.15.142:6816/3192108003 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94879981261232] v32'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a4c051070 con 0x564af7938b60 2024-09-22T08:38:30.806 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.792+0000 7f7a5c530800 1 -- 172.21.15.142:0/1134973049 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94879981262800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564af7946440 con 0x564af793d570 2024-09-22T08:38:30.806 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.792+0000 7f7a5c530800 1 -- 172.21.15.142:0/1134973049 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564af7946ed0 con 0x7f7a50012ae0 2024-09-22T08:38:30.806 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.793+0000 7f7a581bc640 1 -- 172.21.15.142:0/1134973049 <== osd.2 v2:172.21.15.142:6808/279438927 9 ==== osd_op_reply(50 notify.3 [create] v32'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a4802d070 con 0x7f7a50012ae0 2024-09-22T08:38:30.807 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.793+0000 7f7a5c530800 1 -- 172.21.15.142:0/1134973049 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94879981267360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564af7947770 con 0x7f7a50012ae0 2024-09-22T08:38:30.807 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.793+0000 7f7a5c530800 1 -- 172.21.15.142:0/1134973049 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564af7948250 con 0x564af7938b60 2024-09-22T08:38:30.807 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.793+0000 7f7a589bd640 1 -- 172.21.15.142:0/1134973049 <== osd.3 v2:172.21.15.142:6800/1064901393 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94879981262800] v32'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a5000a4d0 con 0x564af793d570 2024-09-22T08:38:30.807 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.794+0000 7f7a579bb640 1 -- 172.21.15.142:0/1134973049 <== osd.1 v2:172.21.15.142:6816/3192108003 18 ==== osd_op_reply(52 notify.4 [create] v32'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a4c051070 con 0x564af7938b60 2024-09-22T08:38:30.807 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.794+0000 7f7a5c530800 1 -- 172.21.15.142:0/1134973049 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94879981264784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564af7948670 con 0x564af7938b60 2024-09-22T08:38:30.807 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.794+0000 7f7a5c530800 1 -- 172.21.15.142:0/1134973049 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564af7949090 con 0x7f7a4803c070 2024-09-22T08:38:30.807 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.794+0000 7f7a581bc640 1 -- 172.21.15.142:0/1134973049 <== osd.2 v2:172.21.15.142:6808/279438927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94879981267360] v32'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a4802d070 con 0x7f7a50012ae0 2024-09-22T08:38:30.807 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.795+0000 7f7a579bb640 1 -- 172.21.15.142:0/1134973049 <== osd.1 v2:172.21.15.142:6816/3192108003 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94879981264784] v32'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a4c051070 con 0x564af7938b60 2024-09-22T08:38:30.807 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.795+0000 7f7a579bb640 1 -- 172.21.15.142:0/1134973049 <== osd.0 v2:172.21.15.31:6800/168281188 10 ==== osd_op_reply(54 notify.5 [create] v32'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a4c051070 con 0x7f7a4803c070 2024-09-22T08:38:30.807 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.795+0000 7f7a5c530800 1 -- 172.21.15.142:0/1134973049 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94879981272416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564af7949050 con 0x7f7a4803c070 2024-09-22T08:38:30.807 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.795+0000 7f7a5c530800 1 -- 172.21.15.142:0/1134973049 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564af7949960 con 0x7f7a4803c070 2024-09-22T08:38:30.807 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.796+0000 7f7a579bb640 1 -- 172.21.15.142:0/1134973049 <== osd.0 v2:172.21.15.31:6800/168281188 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94879981272416] v32'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a4c051070 con 0x7f7a4803c070 2024-09-22T08:38:30.807 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.796+0000 7f7a579bb640 1 -- 172.21.15.142:0/1134973049 <== osd.0 v2:172.21.15.31:6800/168281188 12 ==== osd_op_reply(56 notify.6 [create] v32'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a4c051070 con 0x7f7a4803c070 2024-09-22T08:38:30.808 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.796+0000 7f7a5c530800 1 -- 172.21.15.142:0/1134973049 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94879981276032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564af7949050 con 0x7f7a4803c070 2024-09-22T08:38:30.808 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.796+0000 7f7a5c530800 1 -- 172.21.15.142:0/1134973049 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564af7949f80 con 0x7f7a4803c070 2024-09-22T08:38:30.808 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.797+0000 7f7a579bb640 1 -- 172.21.15.142:0/1134973049 <== osd.0 v2:172.21.15.31:6800/168281188 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94879981276032] v32'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a4c051070 con 0x7f7a4803c070 2024-09-22T08:38:30.808 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.797+0000 7f7a579bb640 1 -- 172.21.15.142:0/1134973049 <== osd.0 v2:172.21.15.31:6800/168281188 14 ==== osd_op_reply(58 notify.7 [create] v32'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a4c051070 con 0x7f7a4803c070 2024-09-22T08:38:30.808 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.797+0000 7f7a5c530800 1 -- 172.21.15.142:0/1134973049 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94879981278304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564af7949f80 con 0x7f7a4803c070 2024-09-22T08:38:30.808 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.797+0000 7f7a5c530800 20 add_watcher() i=0 2024-09-22T08:38:30.808 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.797+0000 7f7a5c530800 20 add_watcher() i=1 2024-09-22T08:38:30.808 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.797+0000 7f7a5c530800 20 add_watcher() i=2 2024-09-22T08:38:30.808 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.797+0000 7f7a5c530800 20 add_watcher() i=3 2024-09-22T08:38:30.808 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.797+0000 7f7a5c530800 20 add_watcher() i=4 2024-09-22T08:38:30.808 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.797+0000 7f7a5c530800 20 add_watcher() i=5 2024-09-22T08:38:30.808 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.797+0000 7f7a5c530800 20 add_watcher() i=6 2024-09-22T08:38:30.808 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.798+0000 7f7a579bb640 1 -- 172.21.15.142:0/1134973049 <== osd.0 v2:172.21.15.31:6800/168281188 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94879981278304] v32'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a4c051070 con 0x7f7a4803c070 2024-09-22T08:38:30.809 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.798+0000 7f7a5c530800 20 add_watcher() i=7 2024-09-22T08:38:30.809 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.798+0000 7f7a5c530800 2 all 8 watchers are set, enabling cache 2024-09-22T08:38:30.809 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.798+0000 7f7a5c530800 1 -- 172.21.15.142:0/1134973049 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564af794d450 con 0x564af7938b60 2024-09-22T08:38:30.809 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.799+0000 7f7a579bb640 1 -- 172.21.15.142:0/1134973049 <== osd.1 v2:172.21.15.142:6816/3192108003 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f7a4c051070 con 0x564af7938b60 2024-09-22T08:38:30.809 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.799+0000 7f7a5c530800 1 -- 172.21.15.142:0/1134973049 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94879981280880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564af794a740 con 0x564af7938b60 2024-09-22T08:38:30.809 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.799+0000 7f7a579bb640 1 -- 172.21.15.142:0/1134973049 <== osd.1 v2:172.21.15.142:6816/3192108003 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94879981280880] v32'264 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7a4c051070 con 0x564af7938b60 2024-09-22T08:38:30.809 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.800+0000 7f790efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:38:30.809 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.800+0000 7f7a5c530800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:38:30.809 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.800+0000 7f7a5c530800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:38:30.809 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.800+0000 7f7a5c530800 5 note: GC not initialized 2024-09-22T08:38:30.809 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.800+0000 7f790dfe3640 20 reqs_thread_entry: start 2024-09-22T08:38:30.809 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.800+0000 7f7a5c530800 20 init_complete bucket index max shards: 11 2024-09-22T08:38:30.809 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.800+0000 7f7a5c530800 20 Filter name: none 2024-09-22T08:38:30.810 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.800+0000 7f7906ffd640 20 reqs_thread_entry: start 2024-09-22T08:38:30.810 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.800+0000 7f7a5c530800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-22T08:38:30.810 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.800+0000 7f7a5c530800 20 rados->read ofs=0 len=0 2024-09-22T08:38:30.810 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.800+0000 7f7a5c530800 1 -- 172.21.15.142:0/1134973049 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564af7980800 con 0x7f7a4803c070 2024-09-22T08:38:30.810 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.801+0000 7f7a579bb640 1 -- 172.21.15.142:0/1134973049 <== osd.0 v2:172.21.15.31:6800/168281188 16 ==== osd_op_reply(62 ada [call out=48b,read 0~503 out=503b,getxattrs out=75b] v0'0 uv8 ondisk = 0) ==== 231+0+626 (crc 0 0 0) 0x7f7a4c051070 con 0x7f7a4803c070 2024-09-22T08:38:30.810 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.801+0000 7f7a5c530800 20 rados_obj.operate() r=0 bl.length=503 2024-09-22T08:38:30.810 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.801+0000 7f7a5c530800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-22T08:38:30.810 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.801+0000 7f7a5c530800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-22T08:38:30.810 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.801+0000 7f7a5c530800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:38:30.810 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.801+0000 7f7a5c530800 1 -- 172.21.15.142:0/1134973049 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~460 in=460b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564af79871c0 con 0x7f7a4803c070 2024-09-22T08:38:30.810 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.802+0000 7f7a579bb640 1 -- 172.21.15.142:0/1134973049 <== osd.0 v2:172.21.15.31:6800/168281188 17 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~460] v32'9 uv9 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f7a4c051070 con 0x7f7a4803c070 2024-09-22T08:38:30.810 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.802+0000 7f7a5c530800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-22T08:38:30.811 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.802+0000 7f7a5c530800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-22T08:38:30.811 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.802+0000 7f7a5c530800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-22T08:38:30.811 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.802+0000 7f7a5c530800 1 -- 172.21.15.142:0/1134973049 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94879981530048 in=648b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564af79828a0 con 0x564af7938b60 2024-09-22T08:38:30.811 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.802+0000 7f7a579bb640 1 -- 172.21.15.142:0/1134973049 <== osd.1 v2:172.21.15.142:6816/3192108003 22 ==== watch-notify(notify (1) cookie 94879981264784 notify 137438953499 ret 0) ==== 678+0+0 (crc 0 0 0) 0x7f7a4c081040 con 0x564af7938b60 2024-09-22T08:38:30.811 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.802+0000 7f79377fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953499 cookie 94879981264784 notifier 4891 bl.length()=636 2024-09-22T08:38:30.811 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.802+0000 7f7a579bb640 1 -- 172.21.15.142:0/1134973049 <== osd.1 v2:172.21.15.142:6816/3192108003 23 ==== osd_op_reply(64 notify.4 [notify cookie 94879981530048 out=8b] v0'0 uv267 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f7a4c051070 con 0x564af7938b60 2024-09-22T08:38:30.811 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.802+0000 7f79377fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-22T08:38:30.811 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.802+0000 7f79377fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-22T08:38:30.811 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.802+0000 7f79377fe640 1 -- 172.21.15.142:0/1134973049 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f791c003ea0 con 0x564af7938b60 2024-09-22T08:38:30.811 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.803+0000 7f7a579bb640 1 -- 172.21.15.142:0/1134973049 <== osd.1 v2:172.21.15.142:6816/3192108003 24 ==== watch-notify(notify_complete (2) cookie 94879981530048 notify 137438953499 ret 0) ==== 42+0+48 (crc 0 0 0) 0x564af780e7d0 con 0x564af7938b60 2024-09-22T08:38:30.811 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.803+0000 7f7a579bb640 1 -- 172.21.15.142:0/1134973049 <== osd.1 v2:172.21.15.142:6816/3192108003 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a4c051070 con 0x564af7938b60 2024-09-22T08:38:30.811 INFO:teuthology.orchestra.run.smithi142.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-22T08:38:29.459914Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-22T08:38:29.459903Z","tags":[],"group_ids":[]} 2024-09-22T08:38:30.814 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.803+0000 7f790efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:38:30.814 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.804+0000 7f7a5c530800 1 -- 172.21.15.142:0/1134973049 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94879981280880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564af797e4e0 con 0x564af7938b60 2024-09-22T08:38:30.814 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.804+0000 7f7a579bb640 1 -- 172.21.15.142:0/1134973049 <== osd.1 v2:172.21.15.142:6816/3192108003 26 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94879981280880] v32'265 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7a4c051070 con 0x564af7938b60 2024-09-22T08:38:30.814 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.804+0000 7f7a5c530800 1 -- 172.21.15.142:0/1134973049 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94879981255808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564af797e4e0 con 0x7f7a50012ae0 2024-09-22T08:38:30.814 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.805+0000 7f7a581bc640 1 -- 172.21.15.142:0/1134973049 <== osd.2 v2:172.21.15.142:6808/279438927 11 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94879981255808] v32'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a4802d070 con 0x7f7a50012ae0 2024-09-22T08:38:30.814 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.806+0000 7f7a5c530800 20 remove_watcher() i=0 2024-09-22T08:38:30.814 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.806+0000 7f7a5c530800 2 removed watcher, disabling cache 2024-09-22T08:38:30.814 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.806+0000 7f7a5c530800 1 -- 172.21.15.142:0/1134973049 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94879981261232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564af797e4e0 con 0x564af7938b60 2024-09-22T08:38:30.815 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.807+0000 7f7a579bb640 1 -- 172.21.15.142:0/1134973049 <== osd.1 v2:172.21.15.142:6816/3192108003 27 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94879981261232] v32'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a4c051070 con 0x564af7938b60 2024-09-22T08:38:30.815 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.807+0000 7f7a5c530800 20 remove_watcher() i=1 2024-09-22T08:38:30.815 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.807+0000 7f7a5c530800 1 -- 172.21.15.142:0/1134973049 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94879981262800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564af797e4e0 con 0x564af793d570 2024-09-22T08:38:30.815 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.808+0000 7f7a589bd640 1 -- 172.21.15.142:0/1134973049 <== osd.3 v2:172.21.15.142:6800/1064901393 16 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94879981262800] v32'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a5000a4d0 con 0x564af793d570 2024-09-22T08:38:30.815 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.808+0000 7f7a5c530800 20 remove_watcher() i=2 2024-09-22T08:38:30.815 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.808+0000 7f7a5c530800 1 -- 172.21.15.142:0/1134973049 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94879981267360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564af797e4e0 con 0x7f7a50012ae0 2024-09-22T08:38:30.815 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.809+0000 7f7a581bc640 1 -- 172.21.15.142:0/1134973049 <== osd.2 v2:172.21.15.142:6808/279438927 12 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94879981267360] v32'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a4802d070 con 0x7f7a50012ae0 2024-09-22T08:38:30.815 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.809+0000 7f7a5c530800 20 remove_watcher() i=3 2024-09-22T08:38:30.815 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.809+0000 7f7a5c530800 1 -- 172.21.15.142:0/1134973049 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94879981264784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564af797e4e0 con 0x564af7938b60 2024-09-22T08:38:30.815 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.810+0000 7f7a579bb640 1 -- 172.21.15.142:0/1134973049 <== osd.1 v2:172.21.15.142:6816/3192108003 28 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94879981264784] v32'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a4c051070 con 0x564af7938b60 2024-09-22T08:38:30.815 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.810+0000 7f7a5c530800 20 remove_watcher() i=4 2024-09-22T08:38:30.815 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.810+0000 7f7a5c530800 1 -- 172.21.15.142:0/1134973049 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94879981272416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564af797e4e0 con 0x7f7a4803c070 2024-09-22T08:38:30.816 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.811+0000 7f7a579bb640 1 -- 172.21.15.142:0/1134973049 <== osd.0 v2:172.21.15.31:6800/168281188 18 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94879981272416] v32'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a4c051070 con 0x7f7a4803c070 2024-09-22T08:38:30.816 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.811+0000 7f7a5c530800 20 remove_watcher() i=5 2024-09-22T08:38:30.816 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.811+0000 7f7a5c530800 1 -- 172.21.15.142:0/1134973049 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94879981276032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564af797e4e0 con 0x7f7a4803c070 2024-09-22T08:38:30.816 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.812+0000 7f7a579bb640 1 -- 172.21.15.142:0/1134973049 <== osd.0 v2:172.21.15.31:6800/168281188 19 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94879981276032] v32'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a4c051070 con 0x7f7a4803c070 2024-09-22T08:38:30.816 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.812+0000 7f7a5c530800 20 remove_watcher() i=6 2024-09-22T08:38:30.816 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.812+0000 7f7a5c530800 1 -- 172.21.15.142:0/1134973049 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94879981278304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564af797e4e0 con 0x7f7a4803c070 2024-09-22T08:38:30.818 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.813+0000 7f7a579bb640 1 -- 172.21.15.142:0/1134973049 <== osd.0 v2:172.21.15.31:6800/168281188 20 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94879981278304] v32'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a4c051070 con 0x7f7a4803c070 2024-09-22T08:38:30.818 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.813+0000 7f7a5c530800 20 remove_watcher() i=7 2024-09-22T08:38:30.818 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.813+0000 7f7a5c530800 1 -- 172.21.15.142:0/1134973049 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f7a4803c070 msgr2=0x7f7a48030480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:30.819 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.813+0000 7f7a5c530800 1 --2- 172.21.15.142:0/1134973049 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f7a4803c070 0x7f7a48030480 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:30.819 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.813+0000 7f7a5c530800 1 -- 172.21.15.142:0/1134973049 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x564af7938b60 msgr2=0x564af793b020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:30.819 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.813+0000 7f7a5c530800 1 --2- 172.21.15.142:0/1134973049 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x564af7938b60 0x564af793b020 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:30.819 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.813+0000 7f7a5c530800 1 -- 172.21.15.142:0/1134973049 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f7a50012ae0 msgr2=0x7f7a50033940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:30.819 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.813+0000 7f7a5c530800 1 --2- 172.21.15.142:0/1134973049 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f7a50012ae0 0x7f7a50033940 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:30.819 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.813+0000 7f7a5c530800 1 -- 172.21.15.142:0/1134973049 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x564af793d570 msgr2=0x564af793f960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:30.819 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.813+0000 7f7a5c530800 1 --2- 172.21.15.142:0/1134973049 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x564af793d570 0x564af793f960 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:30.819 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.813+0000 7f7a5c530800 1 -- 172.21.15.142:0/1134973049 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f792803cf10 msgr2=0x7f792803f3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:30.819 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.813+0000 7f7a5c530800 1 --2- 172.21.15.142:0/1134973049 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f792803cf10 0x7f792803f3d0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f7a4801adc0 tx=0x7f7a4804f000 comp rx=0 tx=0).stop 2024-09-22T08:38:30.819 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.813+0000 7f7a5c530800 1 -- 172.21.15.142:0/1134973049 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564af7925c50 msgr2=0x564af792d230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:30.819 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.813+0000 7f7a579bb640 1 -- 172.21.15.142:0/1134973049 reap_dead start 2024-09-22T08:38:30.819 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.814+0000 7f7a5c530800 1 --2- 172.21.15.142:0/1134973049 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564af7925c50 0x564af792d230 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f7a50013fd0 tx=0x7f7a50054840 comp rx=0 tx=0).stop 2024-09-22T08:38:30.819 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.814+0000 7f7a5c530800 1 -- 172.21.15.142:0/1134973049 shutdown_connections 2024-09-22T08:38:30.819 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.814+0000 7f7a5c530800 1 --2- 172.21.15.142:0/1134973049 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564af7925c50 0x564af792d230 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:30.820 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.814+0000 7f7a5c530800 1 -- 172.21.15.142:0/1134973049 >> 172.21.15.142:0/1134973049 conn(0x564af7922050 msgr2=0x564af7920260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:38:30.820 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.814+0000 7f7a5c530800 1 -- 172.21.15.142:0/1134973049 shutdown_connections 2024-09-22T08:38:30.820 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.814+0000 7f7a5c530800 1 -- 172.21.15.142:0/1134973049 wait complete. 2024-09-22T08:38:30.820 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.814+0000 7f7a5c530800 1 -- 172.21.15.142:0/201298106 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f793003cfb0 msgr2=0x7f793003f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:30.820 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.814+0000 7f7a5c530800 1 --2- 172.21.15.142:0/201298106 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f793003cfb0 0x7f793003f470 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x564af7905e90 tx=0x7f7a48052f30 comp rx=0 tx=0).stop 2024-09-22T08:38:30.820 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.814+0000 7f7a5c530800 1 -- 172.21.15.142:0/201298106 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564af7919190 msgr2=0x564af79195b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:30.820 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.814+0000 7f7a5c530800 1 --2- 172.21.15.142:0/201298106 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564af7919190 0x564af79195b0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x564af78fec80 tx=0x7f7a500167b0 comp rx=0 tx=0).stop 2024-09-22T08:38:30.820 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.814+0000 7f7a5c530800 1 -- 172.21.15.142:0/201298106 shutdown_connections 2024-09-22T08:38:30.820 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.814+0000 7f7a5c530800 1 --2- 172.21.15.142:0/201298106 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f793003cfb0 0x7f793003f470 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:30.820 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.814+0000 7f7a5c530800 1 --2- 172.21.15.142:0/201298106 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564af7919190 0x564af79195b0 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:30.820 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.814+0000 7f7a5c530800 1 -- 172.21.15.142:0/201298106 >> 172.21.15.142:0/201298106 conn(0x564af790d540 msgr2=0x564af790d920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:38:30.820 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.814+0000 7f7a5c530800 1 -- 172.21.15.142:0/201298106 shutdown_connections 2024-09-22T08:38:30.820 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.814+0000 7f7a5c530800 1 -- 172.21.15.142:0/201298106 wait complete. 2024-09-22T08:38:30.820 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.814+0000 7f7a5c530800 1 -- 172.21.15.142:0/1797010243 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x564af78ffae0 msgr2=0x564af7905440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:30.821 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.814+0000 7f7a5c530800 1 --2- 172.21.15.142:0/1797010243 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x564af78ffae0 0x564af7905440 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:30.821 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.814+0000 7f7a5c530800 1 -- 172.21.15.142:0/1797010243 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x564af7907d10 msgr2=0x564af790a100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:30.821 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.814+0000 7f7a5c530800 1 --2- 172.21.15.142:0/1797010243 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x564af7907d10 0x564af790a100 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:30.821 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.814+0000 7f7a5c530800 1 -- 172.21.15.142:0/1797010243 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f794003d1a0 msgr2=0x7f794003f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:30.821 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.814+0000 7f7a5c530800 1 --2- 172.21.15.142:0/1797010243 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f794003d1a0 0x7f794003f660 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f7a4c057000 tx=0x7f7a4c052000 comp rx=0 tx=0).stop 2024-09-22T08:38:30.821 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.814+0000 7f7a5c530800 1 -- 172.21.15.142:0/1797010243 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564af780ac00 msgr2=0x564af78fddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:30.821 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.814+0000 7f7a5c530800 1 --2- 172.21.15.142:0/1797010243 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564af780ac00 0x564af78fddf0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f7a480012f0 tx=0x7f7a48000ed0 comp rx=0 tx=0).stop 2024-09-22T08:38:30.821 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.815+0000 7f7a5c530800 1 -- 172.21.15.142:0/1797010243 shutdown_connections 2024-09-22T08:38:30.821 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.815+0000 7f7a5c530800 1 --2- 172.21.15.142:0/1797010243 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x564af7907d10 0x564af790a100 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:30.821 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.815+0000 7f7a5c530800 1 --2- 172.21.15.142:0/1797010243 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x564af78ffae0 0x564af7905440 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:30.821 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.815+0000 7f7a5c530800 1 --2- 172.21.15.142:0/1797010243 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f794003d1a0 0x7f794003f660 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:30.821 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.815+0000 7f7a5c530800 1 --2- 172.21.15.142:0/1797010243 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564af780ac00 0x564af78fddf0 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:30.821 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.815+0000 7f7a5c530800 1 -- 172.21.15.142:0/1797010243 >> 172.21.15.142:0/1797010243 conn(0x564af77febe0 msgr2=0x564af78f7620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:38:30.821 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.815+0000 7f7a5c530800 1 -- 172.21.15.142:0/1797010243 shutdown_connections 2024-09-22T08:38:30.822 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.815+0000 7f7a5c530800 1 -- 172.21.15.142:0/1797010243 wait complete. 2024-09-22T08:38:30.824 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-22T08:38:29.459914Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-22T08:38:29.459903Z', 'tags': [], 'group_ids': []} 2024-09-22T08:38:30.824 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-22T08:38:29.459914Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-22T08:38:29.459903Z', 'tags': [], 'group_ids': []} 2024-09-22T08:38:30.824 ERROR:root:0 2024-09-22T08:38:30.824 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=write'] 2024-09-22T08:38:30.825 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=write'] 2024-09-22T08:38:30.825 DEBUG:teuthology.orchestra.run.smithi142:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps user-info-without-keys=write 2024-09-22T08:38:30.871 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:38:30.871 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:38:30.872 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.870+0000 7f2b9ad0c800 1 Processor -- start 2024-09-22T08:38:30.873 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.870+0000 7f2b9ad0c800 1 -- start start 2024-09-22T08:38:30.873 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.871+0000 7f2b9ad0c800 1 --2- >> v2:172.21.15.31:3300/0 conn(0x558d5f5d4bf0 0x558d5f5da580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:30.873 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.871+0000 7f2b9ad0c800 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x558d5f45fa20 con 0x558d5f5d37e0 2024-09-22T08:38:30.873 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.871+0000 7f2b9ad0c800 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x558d5f45f7d0 con 0x558d5f5d4bf0 2024-09-22T08:38:30.873 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.871+0000 7f2b97ff5640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x558d5f5d4bf0 0x558d5f5da580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:30.873 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.871+0000 7f2b97ff5640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x558d5f5d4bf0 0x558d5f5da580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:52136/0 (socket says 172.21.15.142:52136) 2024-09-22T08:38:30.873 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.871+0000 7f2b97ff5640 1 -- 172.21.15.142:0/2253317291 learned_addr learned my addr 172.21.15.142:0/2253317291 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:38:30.873 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.871+0000 7f2b97ff5640 1 -- 172.21.15.142:0/2253317291 >> v1:172.21.15.31:6789/0 conn(0x558d5f5d37e0 legacy=0x558d5f5d44e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:30.873 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.871+0000 7f2b977f4640 1 -- 172.21.15.142:0/2253317291 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2243840288 0 0) 0x558d5f45fa20 con 0x558d5f5d37e0 2024-09-22T08:38:30.873 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.871+0000 7f2b97ff5640 1 -- 172.21.15.142:0/2253317291 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x558d5f5d3ee0 con 0x558d5f5d4bf0 2024-09-22T08:38:30.874 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.873+0000 7f2b97ff5640 1 --2- 172.21.15.142:0/2253317291 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558d5f5d4bf0 0x558d5f5da580 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f2b8000a520 tx=0x7f2b80045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2c6bb8cdf6f28ec server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:30.875 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.873+0000 7f2b977f4640 1 -- 172.21.15.142:0/2253317291 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b80055070 con 0x558d5f5d4bf0 2024-09-22T08:38:30.875 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.873+0000 7f2b977f4640 1 -- 172.21.15.142:0/2253317291 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b800515b0 con 0x558d5f5d4bf0 2024-09-22T08:38:30.875 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.873+0000 7f2b977f4640 1 -- 172.21.15.142:0/2253317291 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b800518d0 con 0x558d5f5d4bf0 2024-09-22T08:38:30.875 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.874+0000 7f2b9ad0c800 1 -- 172.21.15.142:0/2253317291 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558d5f5d4bf0 msgr2=0x558d5f5da580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:30.876 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.874+0000 7f2b9ad0c800 1 --2- 172.21.15.142:0/2253317291 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558d5f5d4bf0 0x558d5f5da580 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f2b8000a520 tx=0x7f2b80045ba0 comp rx=0 tx=0).stop 2024-09-22T08:38:30.876 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.874+0000 7f2b9ad0c800 1 -- 172.21.15.142:0/2253317291 shutdown_connections 2024-09-22T08:38:30.876 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.874+0000 7f2b9ad0c800 1 --2- 172.21.15.142:0/2253317291 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558d5f5d4bf0 0x558d5f5da580 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:30.876 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.874+0000 7f2b9ad0c800 1 -- 172.21.15.142:0/2253317291 >> 172.21.15.142:0/2253317291 conn(0x558d5f5cebb0 msgr2=0x558d5f5d1010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:38:30.876 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.874+0000 7f2b9ad0c800 1 -- 172.21.15.142:0/2253317291 shutdown_connections 2024-09-22T08:38:30.876 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.874+0000 7f2b9ad0c800 1 -- 172.21.15.142:0/2253317291 wait complete. 2024-09-22T08:38:30.889 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.888+0000 7f2b9ad0c800 1 Processor -- start 2024-09-22T08:38:30.889 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.888+0000 7f2b9ad0c800 1 -- start start 2024-09-22T08:38:30.889 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.888+0000 7f2b9ad0c800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558d5f5d37e0 0x558d5f547910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:30.889 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.888+0000 7f2b9ad0c800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x558d5f46cdd0 con 0x558d5f5d37e0 2024-09-22T08:38:30.890 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.888+0000 7f2b987f6640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558d5f5d37e0 0x558d5f547910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:30.890 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.888+0000 7f2b987f6640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558d5f5d37e0 0x558d5f547910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:52148/0 (socket says 172.21.15.142:52148) 2024-09-22T08:38:30.890 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.888+0000 7f2b987f6640 1 -- 172.21.15.142:0/204483262 learned_addr learned my addr 172.21.15.142:0/204483262 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:38:30.891 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.889+0000 7f2b987f6640 1 -- 172.21.15.142:0/204483262 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558d5f547e50 con 0x558d5f5d37e0 2024-09-22T08:38:30.891 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.889+0000 7f2b987f6640 1 --2- 172.21.15.142:0/204483262 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558d5f5d37e0 0x558d5f547910 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f2b88006f70 tx=0x7f2b88001b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d38ab3e420291562 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:30.891 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.889+0000 7f2a8660c640 1 -- 172.21.15.142:0/204483262 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b88017070 con 0x558d5f5d37e0 2024-09-22T08:38:30.891 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.889+0000 7f2a8660c640 1 -- 172.21.15.142:0/204483262 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b880025e0 con 0x558d5f5d37e0 2024-09-22T08:38:30.891 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.889+0000 7f2a8660c640 1 -- 172.21.15.142:0/204483262 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b88002940 con 0x558d5f5d37e0 2024-09-22T08:38:30.894 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.890+0000 7f2b9ad0c800 1 -- 172.21.15.142:0/204483262 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558d5f5d37e0 msgr2=0x558d5f547910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:30.894 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.890+0000 7f2b9ad0c800 1 --2- 172.21.15.142:0/204483262 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558d5f5d37e0 0x558d5f547910 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f2b88006f70 tx=0x7f2b88001b00 comp rx=0 tx=0).stop 2024-09-22T08:38:30.894 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.890+0000 7f2b9ad0c800 1 -- 172.21.15.142:0/204483262 shutdown_connections 2024-09-22T08:38:30.894 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.890+0000 7f2b9ad0c800 1 --2- 172.21.15.142:0/204483262 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558d5f5d37e0 0x558d5f547910 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:30.894 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.890+0000 7f2b9ad0c800 1 -- 172.21.15.142:0/204483262 >> 172.21.15.142:0/204483262 conn(0x558d5f5cebb0 msgr2=0x558d5f6be6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:38:30.894 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.890+0000 7f2b9ad0c800 1 -- 172.21.15.142:0/204483262 shutdown_connections 2024-09-22T08:38:30.894 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.890+0000 7f2b9ad0c800 1 -- 172.21.15.142:0/204483262 wait complete. 2024-09-22T08:38:30.894 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.890+0000 7f2b9ad0c800 1 Processor -- start 2024-09-22T08:38:30.894 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.890+0000 7f2b9ad0c800 1 -- start start 2024-09-22T08:38:30.894 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.890+0000 7f2b9ad0c800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558d5f5d37e0 0x558d5f6cdc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:30.895 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.890+0000 7f2b9ad0c800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x558d5f5daac0 con 0x558d5f5d37e0 2024-09-22T08:38:30.895 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.890+0000 7f2b987f6640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558d5f5d37e0 0x558d5f6cdc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:30.895 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.890+0000 7f2b987f6640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558d5f5d37e0 0x558d5f6cdc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:52152/0 (socket says 172.21.15.142:52152) 2024-09-22T08:38:30.895 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.890+0000 7f2b987f6640 1 -- 172.21.15.142:0/3244736503 learned_addr learned my addr 172.21.15.142:0/3244736503 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:38:30.895 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.891+0000 7f2b987f6640 1 -- 172.21.15.142:0/3244736503 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558d5f6ce1a0 con 0x558d5f5d37e0 2024-09-22T08:38:30.895 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.891+0000 7f2b987f6640 1 --2- 172.21.15.142:0/3244736503 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558d5f5d37e0 0x558d5f6cdc40 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f2b88002250 tx=0x7f2b88001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:30.895 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.891+0000 7f2a84e09640 1 -- 172.21.15.142:0/3244736503 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b88022020 con 0x558d5f5d37e0 2024-09-22T08:38:30.895 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.891+0000 7f2a84e09640 1 -- 172.21.15.142:0/3244736503 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b88012790 con 0x558d5f5d37e0 2024-09-22T08:38:30.895 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.891+0000 7f2b9ad0c800 1 -- 172.21.15.142:0/3244736503 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558d5f6ce430 con 0x558d5f5d37e0 2024-09-22T08:38:30.895 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.891+0000 7f2a84e09640 1 -- 172.21.15.142:0/3244736503 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b88017040 con 0x558d5f5d37e0 2024-09-22T08:38:30.895 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.891+0000 7f2b9ad0c800 1 -- 172.21.15.142:0/3244736503 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558d5f6cee30 con 0x558d5f5d37e0 2024-09-22T08:38:30.895 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.892+0000 7f2a84e09640 1 -- 172.21.15.142:0/3244736503 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f2b88025020 con 0x558d5f5d37e0 2024-09-22T08:38:30.895 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.892+0000 7f2a84e09640 1 --2- 172.21.15.142:0/3244736503 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f2a8003d000 0x7f2a8003f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:30.896 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.892+0000 7f2a84e09640 1 -- 172.21.15.142:0/3244736503 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5938+0+0 (secure 0 0 0) 0x7f2b88053e00 con 0x558d5f5d37e0 2024-09-22T08:38:30.896 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.892+0000 7f2b97ff5640 1 --2- 172.21.15.142:0/3244736503 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f2a8003d000 0x7f2a8003f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:30.896 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.892+0000 7f2b9ad0c800 1 --2- 172.21.15.142:0/3244736503 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x558d5f5d4bf0 0x558d5f6d5290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:30.896 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.892+0000 7f2b9ad0c800 1 -- 172.21.15.142:0/3244736503 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558d5f6d57d0 con 0x558d5f5d4bf0 2024-09-22T08:38:30.896 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.893+0000 7f2b98ff7640 1 --2- 172.21.15.142:0/3244736503 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x558d5f5d4bf0 0x558d5f6d5290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:30.896 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.893+0000 7f2b97ff5640 1 --2- 172.21.15.142:0/3244736503 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f2a8003d000 0x7f2a8003f4c0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f2b80057000 tx=0x7f2b80052000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:30.896 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.893+0000 7f2b98ff7640 1 --2- 172.21.15.142:0/3244736503 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x558d5f5d4bf0 0x558d5f6d5290 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:30.901 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.893+0000 7f2b98ff7640 1 -- 172.21.15.142:0/3244736503 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2b900083e0 con 0x558d5f5d4bf0 2024-09-22T08:38:30.902 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.893+0000 7f2b9ad0c800 1 -- 172.21.15.142:0/3244736503 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558d5f6d5b70 con 0x558d5f5d4bf0 2024-09-22T08:38:30.902 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.893+0000 7f2b98ff7640 1 -- 172.21.15.142:0/3244736503 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2b900083e0 con 0x558d5f5d4bf0 2024-09-22T08:38:30.902 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.894+0000 7f2b9ad0c800 1 --2- 172.21.15.142:0/3244736503 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x558d5f6d75f0 0x558d5f6d9a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:30.902 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.894+0000 7f2b9ad0c800 1 -- 172.21.15.142:0/3244736503 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:3 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558d5f6da1f0 con 0x558d5f6d75f0 2024-09-22T08:38:30.902 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.894+0000 7f2b987f6640 1 --2- 172.21.15.142:0/3244736503 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x558d5f6d75f0 0x558d5f6d9a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:30.902 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.894+0000 7f2b987f6640 1 --2- 172.21.15.142:0/3244736503 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x558d5f6d75f0 0x558d5f6d9a60 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:30.902 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.894+0000 7f2b987f6640 1 -- 172.21.15.142:0/3244736503 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(3 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f2b8800f070 con 0x558d5f6d75f0 2024-09-22T08:38:30.902 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.894+0000 7f2b9ad0c800 1 -- 172.21.15.142:0/3244736503 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558d5f6d63c0 con 0x558d5f5d4bf0 2024-09-22T08:38:30.902 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.894+0000 7f2b98ff7640 1 -- 172.21.15.142:0/3244736503 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2b900083e0 con 0x558d5f5d4bf0 2024-09-22T08:38:30.902 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.894+0000 7f2b9ad0c800 1 -- 172.21.15.142:0/3244736503 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558d5f6d67a0 con 0x558d5f6d75f0 2024-09-22T08:38:30.902 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.895+0000 7f2b987f6640 1 -- 172.21.15.142:0/3244736503 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(5 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f2b8800f070 con 0x558d5f6d75f0 2024-09-22T08:38:30.902 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.895+0000 7f2b9ad0c800 1 Processor -- start 2024-09-22T08:38:30.903 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.895+0000 7f2b9ad0c800 1 -- start start 2024-09-22T08:38:30.903 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.895+0000 7f2b9ad0c800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558d5f6e8b80 0x558d5f6e8fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:30.903 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.895+0000 7f2b9ad0c800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x558d5f4cbd50 con 0x558d5f6e8b80 2024-09-22T08:38:30.903 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.896+0000 7f2b98ff7640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558d5f6e8b80 0x558d5f6e8fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:30.903 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.896+0000 7f2b98ff7640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558d5f6e8b80 0x558d5f6e8fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:52154/0 (socket says 172.21.15.142:52154) 2024-09-22T08:38:30.903 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.896+0000 7f2b98ff7640 1 -- 172.21.15.142:0/3168916752 learned_addr learned my addr 172.21.15.142:0/3168916752 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:38:30.903 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.896+0000 7f2b98ff7640 1 -- 172.21.15.142:0/3168916752 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558d5f6e95e0 con 0x558d5f6e8b80 2024-09-22T08:38:30.903 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.896+0000 7f2b98ff7640 1 --2- 172.21.15.142:0/3168916752 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558d5f6e8b80 0x558d5f6e8fa0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x558d5f5d50a0 tx=0x7f2b9000bf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:30.903 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.896+0000 7f2a7dffb640 1 -- 172.21.15.142:0/3168916752 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b9001c020 con 0x558d5f6e8b80 2024-09-22T08:38:30.903 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.896+0000 7f2a7dffb640 1 -- 172.21.15.142:0/3168916752 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b90007c90 con 0x558d5f6e8b80 2024-09-22T08:38:30.903 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.896+0000 7f2b9ad0c800 1 -- 172.21.15.142:0/3168916752 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558d5f6e9e10 con 0x558d5f6e8b80 2024-09-22T08:38:30.903 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.896+0000 7f2a7dffb640 1 -- 172.21.15.142:0/3168916752 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b90018440 con 0x558d5f6e8b80 2024-09-22T08:38:30.903 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.896+0000 7f2b9ad0c800 1 -- 172.21.15.142:0/3168916752 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558d5f6ea3b0 con 0x558d5f6e8b80 2024-09-22T08:38:30.904 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.897+0000 7f2a7dffb640 1 -- 172.21.15.142:0/3168916752 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f2b9001f020 con 0x558d5f6e8b80 2024-09-22T08:38:30.904 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.897+0000 7f2a7dffb640 1 --2- 172.21.15.142:0/3168916752 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f2a7003d000 0x7f2a7003f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:30.904 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.897+0000 7f2a7dffb640 1 -- 172.21.15.142:0/3168916752 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5938+0+0 (secure 0 0 0) 0x7f2b900559a0 con 0x558d5f6e8b80 2024-09-22T08:38:30.904 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.897+0000 7f2b987f6640 1 --2- 172.21.15.142:0/3168916752 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f2a7003d000 0x7f2a7003f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:30.904 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.898+0000 7f2b9ad0c800 1 Processor -- start 2024-09-22T08:38:30.904 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.898+0000 7f2b987f6640 1 --2- 172.21.15.142:0/3168916752 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f2a7003d000 0x7f2a7003f4c0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x558d5f6da590 tx=0x7f2b88052180 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:30.904 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.898+0000 7f2b9ad0c800 1 -- start start 2024-09-22T08:38:30.904 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.898+0000 7f2b9ad0c800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558d5f6f55e0 0x558d5f6f59e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:30.904 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.898+0000 7f2b9ad0c800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x558d5f6c8f20 con 0x558d5f6f55e0 2024-09-22T08:38:30.904 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.898+0000 7f2b98ff7640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558d5f6f55e0 0x558d5f6f59e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:30.904 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.898+0000 7f2b98ff7640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558d5f6f55e0 0x558d5f6f59e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:52160/0 (socket says 172.21.15.142:52160) 2024-09-22T08:38:30.904 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.898+0000 7f2b98ff7640 1 -- 172.21.15.142:0/2442509771 learned_addr learned my addr 172.21.15.142:0/2442509771 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:38:30.904 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.898+0000 7f2b98ff7640 1 -- 172.21.15.142:0/2442509771 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558d5f6f5fd0 con 0x558d5f6f55e0 2024-09-22T08:38:30.905 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.898+0000 7f2b98ff7640 1 --2- 172.21.15.142:0/2442509771 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558d5f6f55e0 0x558d5f6f59e0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f2b90017f90 tx=0x7f2b90017510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3b2049aa9d3bd62 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:30.905 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.899+0000 7f2a777fe640 1 -- 172.21.15.142:0/2442509771 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b90052070 con 0x558d5f6f55e0 2024-09-22T08:38:30.905 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.899+0000 7f2a777fe640 1 -- 172.21.15.142:0/2442509771 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b90016c50 con 0x558d5f6f55e0 2024-09-22T08:38:30.905 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.899+0000 7f2a777fe640 1 -- 172.21.15.142:0/2442509771 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b900156f0 con 0x558d5f6f55e0 2024-09-22T08:38:30.905 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.899+0000 7f2b9ad0c800 1 -- 172.21.15.142:0/2442509771 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558d5f6f55e0 msgr2=0x558d5f6f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:30.905 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.899+0000 7f2b9ad0c800 1 --2- 172.21.15.142:0/2442509771 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558d5f6f55e0 0x558d5f6f59e0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f2b90017f90 tx=0x7f2b90017510 comp rx=0 tx=0).stop 2024-09-22T08:38:30.905 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.899+0000 7f2b9ad0c800 1 -- 172.21.15.142:0/2442509771 shutdown_connections 2024-09-22T08:38:30.905 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.899+0000 7f2b9ad0c800 1 --2- 172.21.15.142:0/2442509771 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558d5f6f55e0 0x558d5f6f59e0 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:30.905 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.899+0000 7f2b9ad0c800 1 -- 172.21.15.142:0/2442509771 >> 172.21.15.142:0/2442509771 conn(0x558d5f6f1a00 msgr2=0x558d5f6efc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:38:30.905 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.899+0000 7f2b9ad0c800 1 -- 172.21.15.142:0/2442509771 shutdown_connections 2024-09-22T08:38:30.905 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.899+0000 7f2b9ad0c800 1 -- 172.21.15.142:0/2442509771 wait complete. 2024-09-22T08:38:30.905 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.899+0000 7f2b9ad0c800 1 Processor -- start 2024-09-22T08:38:30.905 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.899+0000 7f2b9ad0c800 1 -- start start 2024-09-22T08:38:30.906 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.900+0000 7f2b9ad0c800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558d5f6f55e0 0x558d5f6fcb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:30.906 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.900+0000 7f2b9ad0c800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x558d5f6f65c0 con 0x558d5f6f55e0 2024-09-22T08:38:30.906 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.900+0000 7f2b98ff7640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558d5f6f55e0 0x558d5f6fcb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:30.906 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.900+0000 7f2b98ff7640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558d5f6f55e0 0x558d5f6fcb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:52176/0 (socket says 172.21.15.142:52176) 2024-09-22T08:38:30.906 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.900+0000 7f2b98ff7640 1 -- 172.21.15.142:0/3412692443 learned_addr learned my addr 172.21.15.142:0/3412692443 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:38:30.906 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.900+0000 7f2b98ff7640 1 -- 172.21.15.142:0/3412692443 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558d5f6fd0f0 con 0x558d5f6f55e0 2024-09-22T08:38:30.906 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.900+0000 7f2b98ff7640 1 --2- 172.21.15.142:0/3412692443 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558d5f6f55e0 0x558d5f6fcb90 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f2b90017f90 tx=0x7f2b90053d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:30.906 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.900+0000 7f2a75ffb640 1 -- 172.21.15.142:0/3412692443 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b90016e00 con 0x558d5f6f55e0 2024-09-22T08:38:30.906 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.900+0000 7f2a75ffb640 1 -- 172.21.15.142:0/3412692443 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b90055210 con 0x558d5f6f55e0 2024-09-22T08:38:30.906 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.900+0000 7f2b9ad0c800 1 -- 172.21.15.142:0/3412692443 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558d5f6fd380 con 0x558d5f6f55e0 2024-09-22T08:38:30.906 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.900+0000 7f2a75ffb640 1 -- 172.21.15.142:0/3412692443 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b90055510 con 0x558d5f6f55e0 2024-09-22T08:38:30.906 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.900+0000 7f2b9ad0c800 1 -- 172.21.15.142:0/3412692443 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558d5f6fd380 con 0x558d5f6f55e0 2024-09-22T08:38:30.917 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.901+0000 7f2a75ffb640 1 -- 172.21.15.142:0/3412692443 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f2b90016040 con 0x558d5f6f55e0 2024-09-22T08:38:30.917 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.901+0000 7f2a75ffb640 1 --2- 172.21.15.142:0/3412692443 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f2a6803cfb0 0x7f2a6803f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:30.918 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.901+0000 7f2a75ffb640 1 -- 172.21.15.142:0/3412692443 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5938+0+0 (secure 0 0 0) 0x7f2b9004b040 con 0x558d5f6f55e0 2024-09-22T08:38:30.918 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.902+0000 7f2b987f6640 1 --2- 172.21.15.142:0/3412692443 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f2a6803cfb0 0x7f2a6803f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:30.918 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.902+0000 7f2b987f6640 1 --2- 172.21.15.142:0/3412692443 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f2a6803cfb0 0x7f2a6803f470 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f2b880522b0 tx=0x7f2b88050000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:30.918 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.902+0000 7f2b9ad0c800 20 rados->read ofs=0 len=0 2024-09-22T08:38:30.918 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.902+0000 7f2b9ad0c800 1 --2- 172.21.15.142:0/3412692443 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x558d5f708340 0x558d5f70a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:30.918 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.902+0000 7f2b9ad0c800 1 -- 172.21.15.142:0/3412692443 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558d5f70af50 con 0x558d5f708340 2024-09-22T08:38:30.918 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.902+0000 7f2b97ff5640 1 --2- 172.21.15.142:0/3412692443 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x558d5f708340 0x558d5f70a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:30.918 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.902+0000 7f2b97ff5640 1 --2- 172.21.15.142:0/3412692443 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x558d5f708340 0x558d5f70a800 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:30.918 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.903+0000 7f2b97ff5640 1 -- 172.21.15.142:0/3412692443 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2b80057030 con 0x558d5f708340 2024-09-22T08:38:30.918 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.903+0000 7f2b9ad0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:30.918 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.903+0000 7f2b9ad0c800 20 realm 2024-09-22T08:38:30.919 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.903+0000 7f2b9ad0c800 20 rados->read ofs=0 len=0 2024-09-22T08:38:30.919 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.903+0000 7f2b9ad0c800 1 -- 172.21.15.142:0/3412692443 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558d5f70b380 con 0x558d5f708340 2024-09-22T08:38:30.919 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.903+0000 7f2b97ff5640 1 -- 172.21.15.142:0/3412692443 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2b80057030 con 0x558d5f708340 2024-09-22T08:38:30.919 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.903+0000 7f2b9ad0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:30.919 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.903+0000 7f2b9ad0c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:38:30.919 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.903+0000 7f2b9ad0c800 20 rados->read ofs=0 len=0 2024-09-22T08:38:30.919 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.903+0000 7f2b9ad0c800 1 -- 172.21.15.142:0/3412692443 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558d5f70bc50 con 0x558d5f708340 2024-09-22T08:38:30.919 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.903+0000 7f2b97ff5640 1 -- 172.21.15.142:0/3412692443 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2b80057030 con 0x558d5f708340 2024-09-22T08:38:30.919 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.903+0000 7f2b9ad0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:30.919 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.903+0000 7f2b9ad0c800 20 rados->read ofs=0 len=0 2024-09-22T08:38:30.919 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.903+0000 7f2b9ad0c800 1 -- 172.21.15.142:0/3412692443 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558d5f70bff0 con 0x558d5f708340 2024-09-22T08:38:30.919 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.903+0000 7f2b97ff5640 1 -- 172.21.15.142:0/3412692443 <== osd.1 v2:172.21.15.142:6816/3192108003 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2b80057030 con 0x558d5f708340 2024-09-22T08:38:30.919 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.903+0000 7f2b9ad0c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:38:30.919 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.903+0000 7f2b9ad0c800 20 rados->read ofs=0 len=0 2024-09-22T08:38:30.920 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.903+0000 7f2b9ad0c800 1 --2- 172.21.15.142:0/3412692443 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x558d5f70cd50 0x558d5f70f140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:30.920 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.903+0000 7f2b9ad0c800 1 -- 172.21.15.142:0/3412692443 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558d5f70f750 con 0x558d5f70cd50 2024-09-22T08:38:30.920 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.904+0000 7f2b98ff7640 1 --2- 172.21.15.142:0/3412692443 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x558d5f70cd50 0x558d5f70f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:30.920 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.904+0000 7f2b98ff7640 1 --2- 172.21.15.142:0/3412692443 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x558d5f70cd50 0x558d5f70f140 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:30.920 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.904+0000 7f2b98ff7640 1 -- 172.21.15.142:0/3412692443 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(5 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f2b900083e0 con 0x558d5f70cd50 2024-09-22T08:38:30.920 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.904+0000 7f2b9ad0c800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:38:30.920 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.904+0000 7f2b9ad0c800 20 searching for the correct realm 2024-09-22T08:38:30.920 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.904+0000 7f2b9ad0c800 1 -- 172.21.15.142:0/3412692443 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558d5f711080 con 0x558d5f70cd50 2024-09-22T08:38:30.920 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.904+0000 7f2b98ff7640 1 -- 172.21.15.142:0/3412692443 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b900083e0 con 0x558d5f70cd50 2024-09-22T08:38:30.920 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.904+0000 7f2b98ff7640 1 --2- 172.21.15.142:0/3412692443 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f2b90021020 0x7f2b90052070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:30.920 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.904+0000 7f2b98ff7640 1 -- 172.21.15.142:0/3412692443 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558d5f711080 con 0x7f2b90021020 2024-09-22T08:38:30.920 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.904+0000 7f2b987f6640 1 --2- 172.21.15.142:0/3412692443 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f2b90021020 0x7f2b90052070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:30.920 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.905+0000 7f2b987f6640 1 --2- 172.21.15.142:0/3412692443 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f2b90021020 0x7f2b90052070 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:30.921 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.905+0000 7f2b987f6640 1 -- 172.21.15.142:0/3412692443 <== osd.2 v2:172.21.15.142:6808/279438927 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b8800f070 con 0x7f2b90021020 2024-09-22T08:38:30.921 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.905+0000 7f2b987f6640 1 --2- 172.21.15.142:0/3412692443 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f2b88027020 0x7f2b88028410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:30.921 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.905+0000 7f2b987f6640 1 -- 172.21.15.142:0/3412692443 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558d5f711080 con 0x7f2b88027020 2024-09-22T08:38:30.921 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.905+0000 7f2b97ff5640 1 --2- 172.21.15.142:0/3412692443 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f2b88027020 0x7f2b88028410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:30.921 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.906+0000 7f2b97ff5640 1 --2- 172.21.15.142:0/3412692443 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f2b88027020 0x7f2b88028410 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:30.921 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.906+0000 7f2b97ff5640 1 -- 172.21.15.142:0/3412692443 <== osd.0 v2:172.21.15.31:6800/168281188 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b80057030 con 0x7f2b88027020 2024-09-22T08:38:30.921 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.906+0000 7f2b97ff5640 1 -- 172.21.15.142:0/3412692443 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558d5f711080 con 0x558d5f708340 2024-09-22T08:38:30.921 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.906+0000 7f2b97ff5640 1 -- 172.21.15.142:0/3412692443 <== osd.1 v2:172.21.15.142:6816/3192108003 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b80057030 con 0x558d5f708340 2024-09-22T08:38:30.921 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.906+0000 7f2b97ff5640 1 -- 172.21.15.142:0/3412692443 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558d5f711080 con 0x558d5f708340 2024-09-22T08:38:30.921 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.906+0000 7f2b97ff5640 1 -- 172.21.15.142:0/3412692443 <== osd.1 v2:172.21.15.142:6816/3192108003 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b80057030 con 0x558d5f708340 2024-09-22T08:38:30.921 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.906+0000 7f2b97ff5640 1 -- 172.21.15.142:0/3412692443 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558d5f711080 con 0x558d5f708340 2024-09-22T08:38:30.921 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.907+0000 7f2b97ff5640 1 -- 172.21.15.142:0/3412692443 <== osd.1 v2:172.21.15.142:6816/3192108003 7 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b80057030 con 0x558d5f708340 2024-09-22T08:38:30.921 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.907+0000 7f2b97ff5640 1 -- 172.21.15.142:0/3412692443 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558d5f711080 con 0x7f2b88027020 2024-09-22T08:38:30.922 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.907+0000 7f2b97ff5640 1 -- 172.21.15.142:0/3412692443 <== osd.0 v2:172.21.15.31:6800/168281188 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b80057030 con 0x7f2b88027020 2024-09-22T08:38:30.922 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.907+0000 7f2b97ff5640 1 -- 172.21.15.142:0/3412692443 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558d5f711080 con 0x7f2b90021020 2024-09-22T08:38:30.922 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.907+0000 7f2b987f6640 1 -- 172.21.15.142:0/3412692443 <== osd.2 v2:172.21.15.142:6808/279438927 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b8800f070 con 0x7f2b90021020 2024-09-22T08:38:30.922 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.907+0000 7f2b987f6640 1 -- 172.21.15.142:0/3412692443 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558d5f711080 con 0x558d5f70cd50 2024-09-22T08:38:30.922 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.907+0000 7f2b98ff7640 1 -- 172.21.15.142:0/3412692443 <== osd.3 v2:172.21.15.142:6800/1064901393 3 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b900083e0 con 0x558d5f70cd50 2024-09-22T08:38:30.922 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.907+0000 7f2b98ff7640 1 -- 172.21.15.142:0/3412692443 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558d5f711080 con 0x558d5f708340 2024-09-22T08:38:30.922 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.908+0000 7f2b97ff5640 1 -- 172.21.15.142:0/3412692443 <== osd.1 v2:172.21.15.142:6816/3192108003 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b80057030 con 0x558d5f708340 2024-09-22T08:38:30.922 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.908+0000 7f2b97ff5640 1 -- 172.21.15.142:0/3412692443 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558d5f711080 con 0x7f2b88027020 2024-09-22T08:38:30.922 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.908+0000 7f2b97ff5640 1 -- 172.21.15.142:0/3412692443 <== osd.0 v2:172.21.15.31:6800/168281188 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b80057030 con 0x7f2b88027020 2024-09-22T08:38:30.922 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.908+0000 7f2b97ff5640 1 -- 172.21.15.142:0/3412692443 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558d5f711080 con 0x558d5f708340 2024-09-22T08:38:30.922 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.908+0000 7f2b97ff5640 1 -- 172.21.15.142:0/3412692443 <== osd.1 v2:172.21.15.142:6816/3192108003 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b80057030 con 0x558d5f708340 2024-09-22T08:38:30.922 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.908+0000 7f2b97ff5640 1 -- 172.21.15.142:0/3412692443 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558d5f711080 con 0x7f2b90021020 2024-09-22T08:38:30.922 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.908+0000 7f2b987f6640 1 -- 172.21.15.142:0/3412692443 <== osd.2 v2:172.21.15.142:6808/279438927 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f2b8800f070 con 0x7f2b90021020 2024-09-22T08:38:30.923 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.908+0000 7f2b987f6640 1 -- 172.21.15.142:0/3412692443 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558d5f711080 con 0x558d5f70cd50 2024-09-22T08:38:30.923 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.908+0000 7f2b98ff7640 1 -- 172.21.15.142:0/3412692443 <== osd.3 v2:172.21.15.142:6800/1064901393 4 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b900083e0 con 0x558d5f70cd50 2024-09-22T08:38:30.923 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.908+0000 7f2b98ff7640 1 -- 172.21.15.142:0/3412692443 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558d5f711080 con 0x558d5f70cd50 2024-09-22T08:38:30.923 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.909+0000 7f2b98ff7640 1 -- 172.21.15.142:0/3412692443 <== osd.3 v2:172.21.15.142:6800/1064901393 5 ==== osd_op_reply(20 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f2b900083e0 con 0x558d5f70cd50 2024-09-22T08:38:30.923 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.909+0000 7f2b98ff7640 1 -- 172.21.15.142:0/3412692443 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558d5f711080 con 0x7f2b88027020 2024-09-22T08:38:30.923 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.909+0000 7f2b97ff5640 1 -- 172.21.15.142:0/3412692443 <== osd.0 v2:172.21.15.31:6800/168281188 4 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b80057030 con 0x7f2b88027020 2024-09-22T08:38:30.923 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.909+0000 7f2b97ff5640 1 -- 172.21.15.142:0/3412692443 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558d5f711080 con 0x558d5f70cd50 2024-09-22T08:38:30.923 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.909+0000 7f2b98ff7640 1 -- 172.21.15.142:0/3412692443 <== osd.3 v2:172.21.15.142:6800/1064901393 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b900083e0 con 0x558d5f70cd50 2024-09-22T08:38:30.923 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.909+0000 7f2b98ff7640 1 -- 172.21.15.142:0/3412692443 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558d5f711080 con 0x558d5f70cd50 2024-09-22T08:38:30.923 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.909+0000 7f2b98ff7640 1 -- 172.21.15.142:0/3412692443 <== osd.3 v2:172.21.15.142:6800/1064901393 7 ==== osd_op_reply(23 [pgnls start_epoch 32 out=107b] v32'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f2b900083e0 con 0x558d5f70cd50 2024-09-22T08:38:30.923 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.909+0000 7f2b98ff7640 1 -- 172.21.15.142:0/3412692443 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558d5f711080 con 0x558d5f708340 2024-09-22T08:38:30.923 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.910+0000 7f2b97ff5640 1 -- 172.21.15.142:0/3412692443 <== osd.1 v2:172.21.15.142:6816/3192108003 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b80057030 con 0x558d5f708340 2024-09-22T08:38:30.924 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.910+0000 7f2b97ff5640 1 -- 172.21.15.142:0/3412692443 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558d5f711080 con 0x558d5f708340 2024-09-22T08:38:30.924 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.910+0000 7f2b97ff5640 1 -- 172.21.15.142:0/3412692443 <== osd.1 v2:172.21.15.142:6816/3192108003 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v32'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f2b80057030 con 0x558d5f708340 2024-09-22T08:38:30.924 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.910+0000 7f2b97ff5640 1 -- 172.21.15.142:0/3412692443 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558d5f711080 con 0x7f2b88027020 2024-09-22T08:38:30.924 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.910+0000 7f2b97ff5640 1 -- 172.21.15.142:0/3412692443 <== osd.0 v2:172.21.15.31:6800/168281188 5 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b80057030 con 0x7f2b88027020 2024-09-22T08:38:30.924 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.910+0000 7f2b97ff5640 1 -- 172.21.15.142:0/3412692443 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558d5f711080 con 0x558d5f70cd50 2024-09-22T08:38:30.924 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.910+0000 7f2b98ff7640 1 -- 172.21.15.142:0/3412692443 <== osd.3 v2:172.21.15.142:6800/1064901393 8 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b900083e0 con 0x558d5f70cd50 2024-09-22T08:38:30.924 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.910+0000 7f2b98ff7640 1 -- 172.21.15.142:0/3412692443 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558d5f711080 con 0x7f2b90021020 2024-09-22T08:38:30.924 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.910+0000 7f2b987f6640 1 -- 172.21.15.142:0/3412692443 <== osd.2 v2:172.21.15.142:6808/279438927 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b8800f070 con 0x7f2b90021020 2024-09-22T08:38:30.924 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.910+0000 7f2b987f6640 1 -- 172.21.15.142:0/3412692443 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558d5f711080 con 0x558d5f708340 2024-09-22T08:38:30.924 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.911+0000 7f2b97ff5640 1 -- 172.21.15.142:0/3412692443 <== osd.1 v2:172.21.15.142:6816/3192108003 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b80057030 con 0x558d5f708340 2024-09-22T08:38:30.924 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.911+0000 7f2b97ff5640 1 -- 172.21.15.142:0/3412692443 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558d5f711080 con 0x7f2b88027020 2024-09-22T08:38:30.924 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.911+0000 7f2b97ff5640 1 -- 172.21.15.142:0/3412692443 <== osd.0 v2:172.21.15.31:6800/168281188 6 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b80057030 con 0x7f2b88027020 2024-09-22T08:38:30.924 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.911+0000 7f2b97ff5640 1 -- 172.21.15.142:0/3412692443 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558d5f711080 con 0x558d5f70cd50 2024-09-22T08:38:30.925 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.911+0000 7f2b98ff7640 1 -- 172.21.15.142:0/3412692443 <== osd.3 v2:172.21.15.142:6800/1064901393 9 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b900083e0 con 0x558d5f70cd50 2024-09-22T08:38:30.925 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.911+0000 7f2b98ff7640 1 -- 172.21.15.142:0/3412692443 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558d5f711080 con 0x7f2b88027020 2024-09-22T08:38:30.925 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.911+0000 7f2b97ff5640 1 -- 172.21.15.142:0/3412692443 <== osd.0 v2:172.21.15.31:6800/168281188 7 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b80057030 con 0x7f2b88027020 2024-09-22T08:38:30.925 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.911+0000 7f2b97ff5640 1 -- 172.21.15.142:0/3412692443 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558d5f711080 con 0x7f2b90021020 2024-09-22T08:38:30.925 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.912+0000 7f2b987f6640 1 -- 172.21.15.142:0/3412692443 <== osd.2 v2:172.21.15.142:6808/279438927 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b8800f070 con 0x7f2b90021020 2024-09-22T08:38:30.925 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.912+0000 7f2b987f6640 1 -- 172.21.15.142:0/3412692443 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558d5f711080 con 0x558d5f70cd50 2024-09-22T08:38:30.925 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.912+0000 7f2b98ff7640 1 -- 172.21.15.142:0/3412692443 <== osd.3 v2:172.21.15.142:6800/1064901393 10 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b900083e0 con 0x558d5f70cd50 2024-09-22T08:38:30.925 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.912+0000 7f2b98ff7640 1 -- 172.21.15.142:0/3412692443 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558d5f711080 con 0x7f2b88027020 2024-09-22T08:38:30.925 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.912+0000 7f2b97ff5640 1 -- 172.21.15.142:0/3412692443 <== osd.0 v2:172.21.15.31:6800/168281188 8 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b80057030 con 0x7f2b88027020 2024-09-22T08:38:30.925 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.912+0000 7f2b97ff5640 1 -- 172.21.15.142:0/3412692443 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558d5f711080 con 0x558d5f708340 2024-09-22T08:38:30.925 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.912+0000 7f2b97ff5640 1 -- 172.21.15.142:0/3412692443 <== osd.1 v2:172.21.15.142:6816/3192108003 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v32'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f2b80057030 con 0x558d5f708340 2024-09-22T08:38:30.925 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.912+0000 7f2b97ff5640 1 -- 172.21.15.142:0/3412692443 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558d5f711080 con 0x7f2b90021020 2024-09-22T08:38:30.925 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.913+0000 7f2b987f6640 1 -- 172.21.15.142:0/3412692443 <== osd.2 v2:172.21.15.142:6808/279438927 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b8800f070 con 0x7f2b90021020 2024-09-22T08:38:30.926 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.913+0000 7f2b9ad0c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:38:30.926 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.913+0000 7f2b9ad0c800 20 RGWRados::pool_iterate: got zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec 2024-09-22T08:38:30.926 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.913+0000 7f2b9ad0c800 20 RGWRados::pool_iterate: got zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f 2024-09-22T08:38:30.926 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.913+0000 7f2b9ad0c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:38:30.926 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.913+0000 7f2b9ad0c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:38:30.926 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.913+0000 7f2b9ad0c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:38:30.926 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.913+0000 7f2b9ad0c800 20 rados->read ofs=0 len=0 2024-09-22T08:38:30.926 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.913+0000 7f2b9ad0c800 1 -- 172.21.15.142:0/3412692443 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558d5f710110 con 0x558d5f708340 2024-09-22T08:38:30.926 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.913+0000 7f2b97ff5640 1 -- 172.21.15.142:0/3412692443 <== osd.1 v2:172.21.15.142:6816/3192108003 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2b80057030 con 0x558d5f708340 2024-09-22T08:38:30.926 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.913+0000 7f2b9ad0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:30.926 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.913+0000 7f2b9ad0c800 20 rados->read ofs=0 len=0 2024-09-22T08:38:30.926 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.913+0000 7f2b9ad0c800 1 -- 172.21.15.142:0/3412692443 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558d5f710960 con 0x558d5f708340 2024-09-22T08:38:30.926 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.913+0000 7f2b97ff5640 1 -- 172.21.15.142:0/3412692443 <== osd.1 v2:172.21.15.142:6816/3192108003 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2b80057030 con 0x558d5f708340 2024-09-22T08:38:30.927 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.913+0000 7f2b9ad0c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:38:30.927 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.913+0000 7f2b9ad0c800 20 rados->read ofs=0 len=0 2024-09-22T08:38:30.927 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.913+0000 7f2b9ad0c800 1 -- 172.21.15.142:0/3412692443 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:40 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558d5f711500 con 0x558d5f70cd50 2024-09-22T08:38:30.927 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.914+0000 7f2b98ff7640 1 -- 172.21.15.142:0/3412692443 <== osd.3 v2:172.21.15.142:6800/1064901393 11 ==== osd_op_reply(40 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f2b900083e0 con 0x558d5f70cd50 2024-09-22T08:38:30.927 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.914+0000 7f2b9ad0c800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:38:30.927 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.914+0000 7f2b9ad0c800 20 zone default found 2024-09-22T08:38:30.927 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.914+0000 7f2b9ad0c800 4 Realm: () 2024-09-22T08:38:30.927 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.914+0000 7f2b9ad0c800 4 ZoneGroup: default (d89f6f57-1007-47dd-9065-f486c7b01aec) 2024-09-22T08:38:30.927 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.914+0000 7f2b9ad0c800 4 Zone: default (e239248c-0bee-4e41-803a-24b288d3eb8f) 2024-09-22T08:38:30.927 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.914+0000 7f2b9ad0c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:38:30.927 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.914+0000 7f2b9ad0c800 20 zonegroup default 2024-09-22T08:38:30.927 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.914+0000 7f2b9ad0c800 20 rados->read ofs=0 len=0 2024-09-22T08:38:30.927 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.914+0000 7f2b9ad0c800 1 -- 172.21.15.142:0/3412692443 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558d5f7118c0 con 0x7f2b88027020 2024-09-22T08:38:30.928 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.914+0000 7f2b97ff5640 1 -- 172.21.15.142:0/3412692443 <== osd.0 v2:172.21.15.31:6800/168281188 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f2b80057030 con 0x7f2b88027020 2024-09-22T08:38:30.928 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.914+0000 7f2b9ad0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:30.928 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.914+0000 7f2b9ad0c800 20 rados->read ofs=0 len=0 2024-09-22T08:38:30.928 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.914+0000 7f2b9ad0c800 1 -- 172.21.15.142:0/3412692443 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558d5f713ba0 con 0x558d5f70cd50 2024-09-22T08:38:30.928 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.914+0000 7f2b98ff7640 1 -- 172.21.15.142:0/3412692443 <== osd.3 v2:172.21.15.142:6800/1064901393 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2b900083e0 con 0x558d5f70cd50 2024-09-22T08:38:30.928 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.914+0000 7f2b9ad0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:30.928 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.914+0000 7f2b9ad0c800 20 rados->read ofs=0 len=0 2024-09-22T08:38:30.928 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.914+0000 7f2b9ad0c800 1 -- 172.21.15.142:0/3412692443 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558d5f713f40 con 0x558d5f70cd50 2024-09-22T08:38:30.928 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.914+0000 7f2b98ff7640 1 -- 172.21.15.142:0/3412692443 <== osd.3 v2:172.21.15.142:6800/1064901393 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2b900083e0 con 0x558d5f70cd50 2024-09-22T08:38:30.928 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.914+0000 7f2b9ad0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:30.928 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.914+0000 7f2b9ad0c800 20 started sync module instance, tier type = 2024-09-22T08:38:30.928 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.914+0000 7f2b9ad0c800 20 started zone id=e239248c-0bee-4e41-803a-24b288d3eb8f (name=default) with tier type = 2024-09-22T08:38:30.928 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.914+0000 7f2b9ad0c800 1 -- 172.21.15.142:0/3412692443 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558d5f712fe0 con 0x7f2b90021020 2024-09-22T08:38:30.929 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.915+0000 7f2b987f6640 1 -- 172.21.15.142:0/3412692443 <== osd.2 v2:172.21.15.142:6808/279438927 7 ==== osd_op_reply(44 notify.0 [create] v32'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b8800f070 con 0x7f2b90021020 2024-09-22T08:38:30.929 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.915+0000 7f2b9ad0c800 1 -- 172.21.15.142:0/3412692443 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94065680001840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558d5f714370 con 0x7f2b90021020 2024-09-22T08:38:30.929 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.915+0000 7f2b9ad0c800 1 -- 172.21.15.142:0/3412692443 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558d5f714bc0 con 0x558d5f708340 2024-09-22T08:38:30.929 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.916+0000 7f2b987f6640 1 -- 172.21.15.142:0/3412692443 <== osd.2 v2:172.21.15.142:6808/279438927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94065680001840] v32'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b8800f070 con 0x7f2b90021020 2024-09-22T08:38:30.934 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.917+0000 7f2b97ff5640 1 -- 172.21.15.142:0/3412692443 <== osd.1 v2:172.21.15.142:6816/3192108003 16 ==== osd_op_reply(46 notify.1 [create] v32'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b80057030 con 0x558d5f708340 2024-09-22T08:38:30.934 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.917+0000 7f2b9ad0c800 1 -- 172.21.15.142:0/3412692443 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94065680008976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558d5f714fe0 con 0x558d5f708340 2024-09-22T08:38:30.934 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.917+0000 7f2b9ad0c800 1 -- 172.21.15.142:0/3412692443 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558d5f715830 con 0x558d5f70cd50 2024-09-22T08:38:30.934 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.918+0000 7f2b98ff7640 1 -- 172.21.15.142:0/3412692443 <== osd.3 v2:172.21.15.142:6800/1064901393 14 ==== osd_op_reply(48 notify.2 [create] v32'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b900083e0 con 0x558d5f70cd50 2024-09-22T08:38:30.934 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.918+0000 7f2b9ad0c800 1 -- 172.21.15.142:0/3412692443 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94065680011712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558d5f715ce0 con 0x558d5f70cd50 2024-09-22T08:38:30.935 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.918+0000 7f2b9ad0c800 1 -- 172.21.15.142:0/3412692443 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558d5f7167e0 con 0x7f2b90021020 2024-09-22T08:38:30.935 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.918+0000 7f2b97ff5640 1 -- 172.21.15.142:0/3412692443 <== osd.1 v2:172.21.15.142:6816/3192108003 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94065680008976] v32'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b80057030 con 0x558d5f708340 2024-09-22T08:38:30.935 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.919+0000 7f2b98ff7640 1 -- 172.21.15.142:0/3412692443 <== osd.3 v2:172.21.15.142:6800/1064901393 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94065680011712] v32'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b900083e0 con 0x558d5f70cd50 2024-09-22T08:38:30.935 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.919+0000 7f2b987f6640 1 -- 172.21.15.142:0/3412692443 <== osd.2 v2:172.21.15.142:6808/279438927 9 ==== osd_op_reply(50 notify.3 [create] v32'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b8800f070 con 0x7f2b90021020 2024-09-22T08:38:30.935 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.919+0000 7f2b9ad0c800 1 -- 172.21.15.142:0/3412692443 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94065680016080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558d5f7156e0 con 0x7f2b90021020 2024-09-22T08:38:30.935 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.919+0000 7f2b9ad0c800 1 -- 172.21.15.142:0/3412692443 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558d5f717220 con 0x558d5f708340 2024-09-22T08:38:30.935 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.920+0000 7f2b987f6640 1 -- 172.21.15.142:0/3412692443 <== osd.2 v2:172.21.15.142:6808/279438927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94065680016080] v32'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b8800f070 con 0x7f2b90021020 2024-09-22T08:38:30.935 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.920+0000 7f2b97ff5640 1 -- 172.21.15.142:0/3412692443 <== osd.1 v2:172.21.15.142:6816/3192108003 18 ==== osd_op_reply(52 notify.4 [create] v32'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b80057030 con 0x558d5f708340 2024-09-22T08:38:30.935 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.920+0000 7f2b9ad0c800 1 -- 172.21.15.142:0/3412692443 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94065680018800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558d5f717640 con 0x558d5f708340 2024-09-22T08:38:30.935 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.920+0000 7f2b9ad0c800 1 -- 172.21.15.142:0/3412692443 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558d5f718000 con 0x7f2b88027020 2024-09-22T08:38:30.935 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.921+0000 7f2b97ff5640 1 -- 172.21.15.142:0/3412692443 <== osd.1 v2:172.21.15.142:6816/3192108003 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94065680018800] v32'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b80057030 con 0x558d5f708340 2024-09-22T08:38:30.935 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.921+0000 7f2b97ff5640 1 -- 172.21.15.142:0/3412692443 <== osd.0 v2:172.21.15.31:6800/168281188 10 ==== osd_op_reply(54 notify.5 [create] v32'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b80057030 con 0x7f2b88027020 2024-09-22T08:38:30.935 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.921+0000 7f2b9ad0c800 1 -- 172.21.15.142:0/3412692443 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94065680020336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558d5f718000 con 0x7f2b88027020 2024-09-22T08:38:30.936 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.921+0000 7f2b9ad0c800 1 -- 172.21.15.142:0/3412692443 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558d5f7189c0 con 0x7f2b88027020 2024-09-22T08:38:30.936 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.922+0000 7f2b97ff5640 1 -- 172.21.15.142:0/3412692443 <== osd.0 v2:172.21.15.31:6800/168281188 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94065680020336] v32'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b80057030 con 0x7f2b88027020 2024-09-22T08:38:30.936 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.922+0000 7f2b97ff5640 1 -- 172.21.15.142:0/3412692443 <== osd.0 v2:172.21.15.31:6800/168281188 12 ==== osd_op_reply(56 notify.6 [create] v32'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b80057030 con 0x7f2b88027020 2024-09-22T08:38:30.936 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.922+0000 7f2b9ad0c800 1 -- 172.21.15.142:0/3412692443 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94065680025328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558d5f718000 con 0x7f2b88027020 2024-09-22T08:38:30.936 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.922+0000 7f2b9ad0c800 1 -- 172.21.15.142:0/3412692443 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558d5f7193d0 con 0x7f2b88027020 2024-09-22T08:38:30.936 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.923+0000 7f2b97ff5640 1 -- 172.21.15.142:0/3412692443 <== osd.0 v2:172.21.15.31:6800/168281188 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94065680025328] v32'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b80057030 con 0x7f2b88027020 2024-09-22T08:38:30.936 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.923+0000 7f2b97ff5640 1 -- 172.21.15.142:0/3412692443 <== osd.0 v2:172.21.15.31:6800/168281188 14 ==== osd_op_reply(58 notify.7 [create] v32'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b80057030 con 0x7f2b88027020 2024-09-22T08:38:30.936 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.923+0000 7f2b9ad0c800 1 -- 172.21.15.142:0/3412692443 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94065680022832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558d5f7193d0 con 0x7f2b88027020 2024-09-22T08:38:30.936 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.924+0000 7f2b9ad0c800 20 add_watcher() i=0 2024-09-22T08:38:30.936 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.924+0000 7f2b9ad0c800 20 add_watcher() i=1 2024-09-22T08:38:30.936 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.924+0000 7f2b9ad0c800 20 add_watcher() i=2 2024-09-22T08:38:30.936 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.924+0000 7f2b9ad0c800 20 add_watcher() i=3 2024-09-22T08:38:30.936 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.924+0000 7f2b9ad0c800 20 add_watcher() i=4 2024-09-22T08:38:30.936 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.924+0000 7f2b9ad0c800 20 add_watcher() i=5 2024-09-22T08:38:30.937 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.924+0000 7f2b9ad0c800 20 add_watcher() i=6 2024-09-22T08:38:30.937 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.924+0000 7f2b97ff5640 1 -- 172.21.15.142:0/3412692443 <== osd.0 v2:172.21.15.31:6800/168281188 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94065680022832] v32'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b80057030 con 0x7f2b88027020 2024-09-22T08:38:30.937 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.924+0000 7f2b9ad0c800 20 add_watcher() i=7 2024-09-22T08:38:30.937 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.924+0000 7f2b9ad0c800 2 all 8 watchers are set, enabling cache 2024-09-22T08:38:30.937 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.924+0000 7f2b9ad0c800 1 -- 172.21.15.142:0/3412692443 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558d5f71c870 con 0x558d5f708340 2024-09-22T08:38:30.937 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.925+0000 7f2b97ff5640 1 -- 172.21.15.142:0/3412692443 <== osd.1 v2:172.21.15.142:6816/3192108003 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f2b80057030 con 0x558d5f708340 2024-09-22T08:38:30.937 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.925+0000 7f2b9ad0c800 1 -- 172.21.15.142:0/3412692443 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94065680040480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558d5f719540 con 0x558d5f708340 2024-09-22T08:38:30.937 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.926+0000 7f2b97ff5640 1 -- 172.21.15.142:0/3412692443 <== osd.1 v2:172.21.15.142:6816/3192108003 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94065680040480] v32'266 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2b8007f040 con 0x558d5f708340 2024-09-22T08:38:30.937 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.926+0000 7f2a4e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:38:30.937 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.926+0000 7f2b9ad0c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:38:30.937 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.926+0000 7f2b9ad0c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:38:30.937 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.926+0000 7f2b9ad0c800 5 note: GC not initialized 2024-09-22T08:38:30.937 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.926+0000 7f2a4d7e2640 20 reqs_thread_entry: start 2024-09-22T08:38:30.938 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.926+0000 7f2b9ad0c800 20 init_complete bucket index max shards: 11 2024-09-22T08:38:30.938 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.926+0000 7f2b9ad0c800 20 Filter name: none 2024-09-22T08:38:30.938 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.927+0000 7f29beffd640 20 reqs_thread_entry: start 2024-09-22T08:38:30.938 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.927+0000 7f2b9ad0c800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-22T08:38:30.938 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.927+0000 7f2b9ad0c800 20 rados->read ofs=0 len=0 2024-09-22T08:38:30.938 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.927+0000 7f2b9ad0c800 1 -- 172.21.15.142:0/3412692443 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558d5f74fc70 con 0x7f2b88027020 2024-09-22T08:38:30.938 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.927+0000 7f2b97ff5640 1 -- 172.21.15.142:0/3412692443 <== osd.0 v2:172.21.15.31:6800/168281188 16 ==== osd_op_reply(62 ada [call out=48b,read 0~460 out=460b,getxattrs out=75b] v0'0 uv9 ondisk = 0) ==== 231+0+583 (crc 0 0 0) 0x7f2b8007f040 con 0x7f2b88027020 2024-09-22T08:38:30.938 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.927+0000 7f2b9ad0c800 20 rados_obj.operate() r=0 bl.length=460 2024-09-22T08:38:30.938 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.927+0000 7f2b9ad0c800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-22T08:38:30.938 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.927+0000 7f2b9ad0c800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-22T08:38:30.938 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.927+0000 7f2b9ad0c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:38:30.938 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.928+0000 7f2b9ad0c800 1 -- 172.21.15.142:0/3412692443 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~490 in=490b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558d5f756260 con 0x7f2b88027020 2024-09-22T08:38:30.938 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.929+0000 7f2b97ff5640 1 -- 172.21.15.142:0/3412692443 <== osd.0 v2:172.21.15.31:6800/168281188 17 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~490] v32'10 uv10 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f2b8007f040 con 0x7f2b88027020 2024-09-22T08:38:30.939 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.929+0000 7f2b9ad0c800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-22T08:38:30.939 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.929+0000 7f2b9ad0c800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-22T08:38:30.939 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.929+0000 7f2b9ad0c800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-22T08:38:30.939 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.929+0000 7f2b9ad0c800 1 -- 172.21.15.142:0/3412692443 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94065680276576 in=678b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558d5f751900 con 0x558d5f708340 2024-09-22T08:38:30.939 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.929+0000 7f2b97ff5640 1 -- 172.21.15.142:0/3412692443 <== osd.1 v2:172.21.15.142:6816/3192108003 22 ==== watch-notify(notify (1) cookie 94065680018800 notify 137438953500 ret 0) ==== 708+0+0 (crc 0 0 0) 0x558d5f5d3ee0 con 0x558d5f708340 2024-09-22T08:38:30.939 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.929+0000 7f2a777fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953500 cookie 94065680018800 notifier 4898 bl.length()=666 2024-09-22T08:38:30.939 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.929+0000 7f2a777fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-22T08:38:30.939 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.929+0000 7f2a777fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-22T08:38:30.939 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.929+0000 7f2b97ff5640 1 -- 172.21.15.142:0/3412692443 <== osd.1 v2:172.21.15.142:6816/3192108003 23 ==== osd_op_reply(64 notify.4 [notify cookie 94065680276576 out=8b] v0'0 uv270 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f2b8007f040 con 0x558d5f708340 2024-09-22T08:38:30.939 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.929+0000 7f2a777fe640 1 -- 172.21.15.142:0/3412692443 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f2a5c003ea0 con 0x558d5f708340 2024-09-22T08:38:30.939 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.929+0000 7f2b97ff5640 1 -- 172.21.15.142:0/3412692443 <== osd.1 v2:172.21.15.142:6816/3192108003 24 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b8007f040 con 0x558d5f708340 2024-09-22T08:38:30.939 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.929+0000 7f2b97ff5640 1 -- 172.21.15.142:0/3412692443 <== osd.1 v2:172.21.15.142:6816/3192108003 25 ==== watch-notify(notify_complete (2) cookie 94065680276576 notify 137438953500 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f2b8005bd30 con 0x558d5f708340 2024-09-22T08:38:30.940 INFO:teuthology.orchestra.run.smithi142.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-22T08:38:29.459914Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"user-info-without-keys","perm":"write"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-22T08:38:29.459903Z","tags":[],"group_ids":[]} 2024-09-22T08:38:30.944 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.930+0000 7f2a4e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:38:30.945 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.930+0000 7f2b9ad0c800 1 -- 172.21.15.142:0/3412692443 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94065680040480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558d5f74d9c0 con 0x558d5f708340 2024-09-22T08:38:30.945 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.931+0000 7f2b97ff5640 1 -- 172.21.15.142:0/3412692443 <== osd.1 v2:172.21.15.142:6816/3192108003 26 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94065680040480] v32'267 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2b8007f040 con 0x558d5f708340 2024-09-22T08:38:30.945 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.931+0000 7f2b9ad0c800 1 -- 172.21.15.142:0/3412692443 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94065680001840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558d5f74d9c0 con 0x7f2b90021020 2024-09-22T08:38:30.945 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.932+0000 7f2b987f6640 1 -- 172.21.15.142:0/3412692443 <== osd.2 v2:172.21.15.142:6808/279438927 11 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94065680001840] v32'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b8800f070 con 0x7f2b90021020 2024-09-22T08:38:30.945 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.932+0000 7f2b9ad0c800 20 remove_watcher() i=0 2024-09-22T08:38:30.945 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.932+0000 7f2b9ad0c800 2 removed watcher, disabling cache 2024-09-22T08:38:30.945 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.932+0000 7f2b9ad0c800 1 -- 172.21.15.142:0/3412692443 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94065680008976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558d5f74d9c0 con 0x558d5f708340 2024-09-22T08:38:30.945 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.933+0000 7f2b97ff5640 1 -- 172.21.15.142:0/3412692443 <== osd.1 v2:172.21.15.142:6816/3192108003 27 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94065680008976] v32'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b8007f040 con 0x558d5f708340 2024-09-22T08:38:30.945 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.933+0000 7f2b9ad0c800 20 remove_watcher() i=1 2024-09-22T08:38:30.945 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.933+0000 7f2b9ad0c800 1 -- 172.21.15.142:0/3412692443 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94065680011712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558d5f74d9c0 con 0x558d5f70cd50 2024-09-22T08:38:30.945 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.934+0000 7f2b98ff7640 1 -- 172.21.15.142:0/3412692443 <== osd.3 v2:172.21.15.142:6800/1064901393 16 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94065680011712] v32'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b900083e0 con 0x558d5f70cd50 2024-09-22T08:38:30.945 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.934+0000 7f2b9ad0c800 20 remove_watcher() i=2 2024-09-22T08:38:30.946 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.934+0000 7f2b9ad0c800 1 -- 172.21.15.142:0/3412692443 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94065680016080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558d5f74d9c0 con 0x7f2b90021020 2024-09-22T08:38:30.946 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.935+0000 7f2b987f6640 1 -- 172.21.15.142:0/3412692443 <== osd.2 v2:172.21.15.142:6808/279438927 12 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94065680016080] v32'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b8800f070 con 0x7f2b90021020 2024-09-22T08:38:30.946 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.935+0000 7f2b9ad0c800 20 remove_watcher() i=3 2024-09-22T08:38:30.946 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.935+0000 7f2b9ad0c800 1 -- 172.21.15.142:0/3412692443 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94065680018800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558d5f74d9c0 con 0x558d5f708340 2024-09-22T08:38:30.946 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.936+0000 7f2b97ff5640 1 -- 172.21.15.142:0/3412692443 <== osd.1 v2:172.21.15.142:6816/3192108003 28 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94065680018800] v32'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b8007f040 con 0x558d5f708340 2024-09-22T08:38:30.946 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.936+0000 7f2b9ad0c800 20 remove_watcher() i=4 2024-09-22T08:38:30.946 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.936+0000 7f2b9ad0c800 1 -- 172.21.15.142:0/3412692443 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94065680020336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558d5f74d9c0 con 0x7f2b88027020 2024-09-22T08:38:30.946 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.938+0000 7f2b97ff5640 1 -- 172.21.15.142:0/3412692443 <== osd.0 v2:172.21.15.31:6800/168281188 18 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94065680020336] v32'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b8007f040 con 0x7f2b88027020 2024-09-22T08:38:30.946 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.938+0000 7f2b9ad0c800 20 remove_watcher() i=5 2024-09-22T08:38:30.946 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.938+0000 7f2b9ad0c800 1 -- 172.21.15.142:0/3412692443 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94065680025328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558d5f74d9c0 con 0x7f2b88027020 2024-09-22T08:38:30.946 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.939+0000 7f2b97ff5640 1 -- 172.21.15.142:0/3412692443 <== osd.0 v2:172.21.15.31:6800/168281188 19 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94065680025328] v32'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b8007f040 con 0x7f2b88027020 2024-09-22T08:38:30.946 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.939+0000 7f2b9ad0c800 20 remove_watcher() i=6 2024-09-22T08:38:30.947 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.939+0000 7f2b9ad0c800 1 -- 172.21.15.142:0/3412692443 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94065680022832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558d5f74d9c0 con 0x7f2b88027020 2024-09-22T08:38:30.947 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.940+0000 7f2b97ff5640 1 -- 172.21.15.142:0/3412692443 <== osd.0 v2:172.21.15.31:6800/168281188 20 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94065680022832] v32'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b8007f040 con 0x7f2b88027020 2024-09-22T08:38:30.947 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.940+0000 7f2b9ad0c800 20 remove_watcher() i=7 2024-09-22T08:38:30.947 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.940+0000 7f2b9ad0c800 1 -- 172.21.15.142:0/3412692443 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f2b88027020 msgr2=0x7f2b88028410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:30.947 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.940+0000 7f2b9ad0c800 1 --2- 172.21.15.142:0/3412692443 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f2b88027020 0x7f2b88028410 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:30.947 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.940+0000 7f2b9ad0c800 1 -- 172.21.15.142:0/3412692443 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x558d5f708340 msgr2=0x558d5f70a800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:30.947 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.940+0000 7f2b9ad0c800 1 --2- 172.21.15.142:0/3412692443 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x558d5f708340 0x558d5f70a800 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:30.947 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.940+0000 7f2b9ad0c800 1 -- 172.21.15.142:0/3412692443 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f2b90021020 msgr2=0x7f2b90052070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:30.947 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.940+0000 7f2b9ad0c800 1 --2- 172.21.15.142:0/3412692443 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f2b90021020 0x7f2b90052070 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:30.947 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.940+0000 7f2b9ad0c800 1 -- 172.21.15.142:0/3412692443 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x558d5f70cd50 msgr2=0x558d5f70f140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:30.947 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.940+0000 7f2b9ad0c800 1 --2- 172.21.15.142:0/3412692443 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x558d5f70cd50 0x558d5f70f140 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:30.947 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.940+0000 7f2b9ad0c800 1 -- 172.21.15.142:0/3412692443 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f2a6803cfb0 msgr2=0x7f2a6803f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:30.948 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.940+0000 7f2b9ad0c800 1 --2- 172.21.15.142:0/3412692443 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f2a6803cfb0 0x7f2a6803f470 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f2b880522b0 tx=0x7f2b88050000 comp rx=0 tx=0).stop 2024-09-22T08:38:30.948 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.940+0000 7f2b97ff5640 1 -- 172.21.15.142:0/3412692443 reap_dead start 2024-09-22T08:38:30.948 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.940+0000 7f2b9ad0c800 1 -- 172.21.15.142:0/3412692443 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558d5f6f55e0 msgr2=0x558d5f6fcb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:30.948 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.940+0000 7f2b9ad0c800 1 --2- 172.21.15.142:0/3412692443 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558d5f6f55e0 0x558d5f6fcb90 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f2b90017f90 tx=0x7f2b90053d20 comp rx=0 tx=0).stop 2024-09-22T08:38:30.948 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.940+0000 7f2b9ad0c800 1 -- 172.21.15.142:0/3412692443 shutdown_connections 2024-09-22T08:38:30.948 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.940+0000 7f2b9ad0c800 1 --2- 172.21.15.142:0/3412692443 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558d5f6f55e0 0x558d5f6fcb90 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:30.948 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.940+0000 7f2b9ad0c800 1 -- 172.21.15.142:0/3412692443 >> 172.21.15.142:0/3412692443 conn(0x558d5f6f1a00 msgr2=0x558d5f6efc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:38:30.948 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.940+0000 7f2b9ad0c800 1 -- 172.21.15.142:0/3412692443 shutdown_connections 2024-09-22T08:38:30.948 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.940+0000 7f2b9ad0c800 1 -- 172.21.15.142:0/3412692443 wait complete. 2024-09-22T08:38:30.948 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.940+0000 7f2b9ad0c800 1 -- 172.21.15.142:0/3168916752 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f2a7003d000 msgr2=0x7f2a7003f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:30.948 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.940+0000 7f2b9ad0c800 1 --2- 172.21.15.142:0/3168916752 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f2a7003d000 0x7f2a7003f4c0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x558d5f6da590 tx=0x7f2b88052180 comp rx=0 tx=0).stop 2024-09-22T08:38:30.948 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.940+0000 7f2b9ad0c800 1 -- 172.21.15.142:0/3168916752 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558d5f6e8b80 msgr2=0x558d5f6e8fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:30.948 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.940+0000 7f2b9ad0c800 1 --2- 172.21.15.142:0/3168916752 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558d5f6e8b80 0x558d5f6e8fa0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x558d5f5d50a0 tx=0x7f2b9000bf30 comp rx=0 tx=0).stop 2024-09-22T08:38:30.949 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.940+0000 7f2b9ad0c800 1 -- 172.21.15.142:0/3168916752 shutdown_connections 2024-09-22T08:38:30.949 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.940+0000 7f2b9ad0c800 1 --2- 172.21.15.142:0/3168916752 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f2a7003d000 0x7f2a7003f4c0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:30.949 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.940+0000 7f2b9ad0c800 1 --2- 172.21.15.142:0/3168916752 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558d5f6e8b80 0x558d5f6e8fa0 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:30.949 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.940+0000 7f2b9ad0c800 1 -- 172.21.15.142:0/3168916752 >> 172.21.15.142:0/3168916752 conn(0x558d5f6dcf30 msgr2=0x558d5f6dd310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:38:30.949 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.941+0000 7f2b9ad0c800 1 -- 172.21.15.142:0/3168916752 shutdown_connections 2024-09-22T08:38:30.949 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.941+0000 7f2b9ad0c800 1 -- 172.21.15.142:0/3168916752 wait complete. 2024-09-22T08:38:30.949 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.941+0000 7f2b9ad0c800 1 -- 172.21.15.142:0/3244736503 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x558d5f5d4bf0 msgr2=0x558d5f6d5290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:30.949 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.941+0000 7f2b9ad0c800 1 --2- 172.21.15.142:0/3244736503 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x558d5f5d4bf0 0x558d5f6d5290 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:30.949 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.941+0000 7f2b9ad0c800 1 -- 172.21.15.142:0/3244736503 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x558d5f6d75f0 msgr2=0x558d5f6d9a60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:30.949 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.941+0000 7f2b9ad0c800 1 --2- 172.21.15.142:0/3244736503 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x558d5f6d75f0 0x558d5f6d9a60 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:30.949 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.941+0000 7f2b9ad0c800 1 -- 172.21.15.142:0/3244736503 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f2a8003d000 msgr2=0x7f2a8003f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:30.949 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.941+0000 7f2b9ad0c800 1 --2- 172.21.15.142:0/3244736503 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f2a8003d000 0x7f2a8003f4c0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f2b80057000 tx=0x7f2b80052000 comp rx=0 tx=0).stop 2024-09-22T08:38:30.949 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.941+0000 7f2b9ad0c800 1 -- 172.21.15.142:0/3244736503 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558d5f5d37e0 msgr2=0x558d5f6cdc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:30.950 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.941+0000 7f2b9ad0c800 1 --2- 172.21.15.142:0/3244736503 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558d5f5d37e0 0x558d5f6cdc40 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f2b88002250 tx=0x7f2b88001250 comp rx=0 tx=0).stop 2024-09-22T08:38:30.950 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.941+0000 7f2b9ad0c800 1 -- 172.21.15.142:0/3244736503 shutdown_connections 2024-09-22T08:38:30.950 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.941+0000 7f2b9ad0c800 1 --2- 172.21.15.142:0/3244736503 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x558d5f6d75f0 0x558d5f6d9a60 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:30.950 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.941+0000 7f2b9ad0c800 1 --2- 172.21.15.142:0/3244736503 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x558d5f5d4bf0 0x558d5f6d5290 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:30.950 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.941+0000 7f2b9ad0c800 1 --2- 172.21.15.142:0/3244736503 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f2a8003d000 0x7f2a8003f4c0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:30.950 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.941+0000 7f2b9ad0c800 1 --2- 172.21.15.142:0/3244736503 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558d5f5d37e0 0x558d5f6cdc40 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:30.950 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.941+0000 7f2b9ad0c800 1 -- 172.21.15.142:0/3244736503 >> 172.21.15.142:0/3244736503 conn(0x558d5f5cebb0 msgr2=0x558d5f6bcec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:38:30.950 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.941+0000 7f2b9ad0c800 1 -- 172.21.15.142:0/3244736503 shutdown_connections 2024-09-22T08:38:30.950 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:30.941+0000 7f2b9ad0c800 1 -- 172.21.15.142:0/3244736503 wait complete. 2024-09-22T08:38:30.951 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-22T08:38:29.459914Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': 'write'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-22T08:38:29.459903Z', 'tags': [], 'group_ids': []} 2024-09-22T08:38:30.951 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-22T08:38:29.459914Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': 'write'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-22T08:38:29.459903Z', 'tags': [], 'group_ids': []} 2024-09-22T08:38:30.951 ERROR:root:0 2024-09-22T08:38:30.951 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-22T08:38:30.956 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'AccessDenied', 'Message': '', 'RequestId': 'tx00000ba3c90e353a9187b-0066efd786-4226-default', 'HostId': '4226-default-default'} 2024-09-22T08:38:30.956 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'rm', '--uid', 'ada', '--caps', 'user-info-without-keys=write'] 2024-09-22T08:38:30.956 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'rm', '--uid', 'ada', '--caps', 'user-info-without-keys=write'] 2024-09-22T08:38:30.956 DEBUG:teuthology.orchestra.run.smithi142:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps rm --uid ada --caps user-info-without-keys=write 2024-09-22T08:38:31.003 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:38:31.003 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:38:31.004 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.002+0000 7f66ecbaf800 1 Processor -- start 2024-09-22T08:38:31.004 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.002+0000 7f66ecbaf800 1 -- start start 2024-09-22T08:38:31.004 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.002+0000 7f66ecbaf800 1 --2- >> v2:172.21.15.31:3300/0 conn(0x5613c30f65b0 0x5613c30f4b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:31.004 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.002+0000 7f66ecbaf800 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5613c300ba20 con 0x5613c30f50d0 2024-09-22T08:38:31.004 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.002+0000 7f66ecbaf800 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x5613c300b7d0 con 0x5613c30f65b0 2024-09-22T08:38:31.004 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.003+0000 7f66ea6a0640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x5613c30f65b0 0x5613c30f4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:31.004 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.003+0000 7f66e9e9f640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x5613c30f50d0 0x5613c318cca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.142:50538/0 (socket says 172.21.15.142:50538) 2024-09-22T08:38:31.004 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.003+0000 7f66e9e9f640 1 -- 172.21.15.142:0/50374602 learned_addr learned my addr 172.21.15.142:0/50374602 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-09-22T08:38:31.005 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.003+0000 7f66ea6a0640 1 -- 172.21.15.142:0/50374602 >> v1:172.21.15.31:6789/0 conn(0x5613c30f50d0 legacy=0x5613c318cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:31.005 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.003+0000 7f66ea6a0640 1 -- 172.21.15.142:0/50374602 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5613c3184230 con 0x5613c30f65b0 2024-09-22T08:38:31.005 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.003+0000 7f66e969e640 1 -- 172.21.15.142:0/50374602 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 822445967 0 0) 0x5613c300ba20 con 0x5613c30f50d0 2024-09-22T08:38:31.006 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.005+0000 7f66ea6a0640 1 --2- 172.21.15.142:0/50374602 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5613c30f65b0 0x5613c30f4b90 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f66dc005fd0 tx=0x7f66dc045c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aaf79c01a06a997e server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:31.006 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.005+0000 7f66e969e640 1 -- 172.21.15.142:0/50374602 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f66dc058530 con 0x5613c30f65b0 2024-09-22T08:38:31.007 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.005+0000 7f66e969e640 1 -- 172.21.15.142:0/50374602 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66dc0586d0 con 0x5613c30f65b0 2024-09-22T08:38:31.007 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.005+0000 7f66e969e640 1 -- 172.21.15.142:0/50374602 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f66dc0589d0 con 0x5613c30f65b0 2024-09-22T08:38:31.007 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.006+0000 7f66ecbaf800 1 -- 172.21.15.142:0/50374602 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5613c30f65b0 msgr2=0x5613c30f4b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:31.007 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.006+0000 7f66ecbaf800 1 --2- 172.21.15.142:0/50374602 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5613c30f65b0 0x5613c30f4b90 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f66dc005fd0 tx=0x7f66dc045c30 comp rx=0 tx=0).stop 2024-09-22T08:38:31.008 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.006+0000 7f66ecbaf800 1 -- 172.21.15.142:0/50374602 shutdown_connections 2024-09-22T08:38:31.008 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.006+0000 7f66ecbaf800 1 --2- 172.21.15.142:0/50374602 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5613c30f65b0 0x5613c30f4b90 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:31.008 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.006+0000 7f66ecbaf800 1 -- 172.21.15.142:0/50374602 >> 172.21.15.142:0/50374602 conn(0x5613c317bdb0 msgr2=0x5613c317e210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:38:31.008 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.006+0000 7f66ecbaf800 1 -- 172.21.15.142:0/50374602 shutdown_connections 2024-09-22T08:38:31.008 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.006+0000 7f66ecbaf800 1 -- 172.21.15.142:0/50374602 wait complete. 2024-09-22T08:38:31.021 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.020+0000 7f66ecbaf800 1 Processor -- start 2024-09-22T08:38:31.021 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.020+0000 7f66ecbaf800 1 -- start start 2024-09-22T08:38:31.021 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.020+0000 7f66ecbaf800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5613c30f50d0 0x5613c32764b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:31.022 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.020+0000 7f66ecbaf800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5613c3018dd0 con 0x5613c30f50d0 2024-09-22T08:38:31.022 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.020+0000 7f66ea6a0640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5613c30f50d0 0x5613c32764b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:31.022 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.020+0000 7f66ea6a0640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5613c30f50d0 0x5613c32764b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:52192/0 (socket says 172.21.15.142:52192) 2024-09-22T08:38:31.022 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.020+0000 7f66ea6a0640 1 -- 172.21.15.142:0/3905420951 learned_addr learned my addr 172.21.15.142:0/3905420951 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:38:31.024 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.021+0000 7f66ea6a0640 1 -- 172.21.15.142:0/3905420951 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5613c3276aa0 con 0x5613c30f50d0 2024-09-22T08:38:31.024 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.021+0000 7f66ea6a0640 1 --2- 172.21.15.142:0/3905420951 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5613c30f50d0 0x5613c32764b0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f66dc005fd0 tx=0x7f66dc051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13dee540cdbeddd3 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:31.024 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.021+0000 7f65d8608640 1 -- 172.21.15.142:0/3905420951 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f66dc068070 con 0x5613c30f50d0 2024-09-22T08:38:31.024 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.021+0000 7f65d8608640 1 -- 172.21.15.142:0/3905420951 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66dc058880 con 0x5613c30f50d0 2024-09-22T08:38:31.024 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.021+0000 7f65d8608640 1 -- 172.21.15.142:0/3905420951 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f66dc058b80 con 0x5613c30f50d0 2024-09-22T08:38:31.025 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.022+0000 7f66ecbaf800 1 -- 172.21.15.142:0/3905420951 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5613c30f50d0 msgr2=0x5613c32764b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:31.025 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.022+0000 7f66ecbaf800 1 --2- 172.21.15.142:0/3905420951 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5613c30f50d0 0x5613c32764b0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f66dc005fd0 tx=0x7f66dc051000 comp rx=0 tx=0).stop 2024-09-22T08:38:31.025 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.022+0000 7f66ecbaf800 1 -- 172.21.15.142:0/3905420951 shutdown_connections 2024-09-22T08:38:31.025 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.022+0000 7f66ecbaf800 1 --2- 172.21.15.142:0/3905420951 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5613c30f50d0 0x5613c32764b0 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:31.025 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.022+0000 7f66ecbaf800 1 -- 172.21.15.142:0/3905420951 >> 172.21.15.142:0/3905420951 conn(0x5613c317bdb0 msgr2=0x5613c3271e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:38:31.025 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.022+0000 7f66ecbaf800 1 -- 172.21.15.142:0/3905420951 shutdown_connections 2024-09-22T08:38:31.025 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.022+0000 7f66ecbaf800 1 -- 172.21.15.142:0/3905420951 wait complete. 2024-09-22T08:38:31.025 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.022+0000 7f66ecbaf800 1 Processor -- start 2024-09-22T08:38:31.025 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.022+0000 7f66ecbaf800 1 -- start start 2024-09-22T08:38:31.025 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.022+0000 7f66ecbaf800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5613c30f50d0 0x5613c327df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:31.025 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.022+0000 7f66ecbaf800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5613c30f5890 con 0x5613c30f50d0 2024-09-22T08:38:31.025 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.022+0000 7f66ea6a0640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5613c30f50d0 0x5613c327df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:31.025 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.022+0000 7f66ea6a0640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5613c30f50d0 0x5613c327df20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:52196/0 (socket says 172.21.15.142:52196) 2024-09-22T08:38:31.026 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.022+0000 7f66ea6a0640 1 -- 172.21.15.142:0/1451547613 learned_addr learned my addr 172.21.15.142:0/1451547613 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:38:31.026 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.023+0000 7f66ea6a0640 1 -- 172.21.15.142:0/1451547613 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5613c327e480 con 0x5613c30f50d0 2024-09-22T08:38:31.026 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.023+0000 7f66ea6a0640 1 --2- 172.21.15.142:0/1451547613 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5613c30f50d0 0x5613c327df20 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f66dc066040 tx=0x7f66dc003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:31.026 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.023+0000 7f65d6e05640 1 -- 172.21.15.142:0/1451547613 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f66dc071070 con 0x5613c30f50d0 2024-09-22T08:38:31.026 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.023+0000 7f65d6e05640 1 -- 172.21.15.142:0/1451547613 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66dc063780 con 0x5613c30f50d0 2024-09-22T08:38:31.026 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.023+0000 7f66ecbaf800 1 -- 172.21.15.142:0/1451547613 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5613c327e710 con 0x5613c30f50d0 2024-09-22T08:38:31.026 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.023+0000 7f65d6e05640 1 -- 172.21.15.142:0/1451547613 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f66dc068040 con 0x5613c30f50d0 2024-09-22T08:38:31.026 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.023+0000 7f66ecbaf800 1 -- 172.21.15.142:0/1451547613 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5613c327f110 con 0x5613c30f50d0 2024-09-22T08:38:31.029 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.024+0000 7f65d6e05640 1 -- 172.21.15.142:0/1451547613 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f66dc074070 con 0x5613c30f50d0 2024-09-22T08:38:31.029 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.024+0000 7f65d6e05640 1 --2- 172.21.15.142:0/1451547613 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f65d003d000 0x7f65d003f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:31.029 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.024+0000 7f65d6e05640 1 -- 172.21.15.142:0/1451547613 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5938+0+0 (secure 0 0 0) 0x7f66dc097360 con 0x5613c30f50d0 2024-09-22T08:38:31.030 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.024+0000 7f66e9e9f640 1 --2- 172.21.15.142:0/1451547613 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f65d003d000 0x7f65d003f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:31.030 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.024+0000 7f66ecbaf800 1 --2- 172.21.15.142:0/1451547613 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5613c30f65b0 0x5613c3285570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:31.030 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.024+0000 7f66ecbaf800 1 -- 172.21.15.142:0/1451547613 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5613c327fcf0 con 0x5613c30f65b0 2024-09-22T08:38:31.030 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.025+0000 7f66eaea1640 1 --2- 172.21.15.142:0/1451547613 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5613c30f65b0 0x5613c3285570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:31.030 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.025+0000 7f66e9e9f640 1 --2- 172.21.15.142:0/1451547613 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f65d003d000 0x7f65d003f4c0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f66d4000c00 tx=0x7f66d40013b0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:31.030 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.025+0000 7f66eaea1640 1 --2- 172.21.15.142:0/1451547613 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5613c30f65b0 0x5613c3285570 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:31.030 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.025+0000 7f66eaea1640 1 -- 172.21.15.142:0/1451547613 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f66e40083e0 con 0x5613c30f65b0 2024-09-22T08:38:31.030 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.025+0000 7f66ecbaf800 1 -- 172.21.15.142:0/1451547613 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5613c327f5a0 con 0x5613c30f65b0 2024-09-22T08:38:31.030 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.025+0000 7f66eaea1640 1 -- 172.21.15.142:0/1451547613 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f66e40083e0 con 0x5613c30f65b0 2024-09-22T08:38:31.030 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.025+0000 7f66ecbaf800 1 --2- 172.21.15.142:0/1451547613 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5613c3287a40 0x5613c3289e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:31.030 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.025+0000 7f66ecbaf800 1 -- 172.21.15.142:0/1451547613 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:3 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5613c328a500 con 0x5613c3287a40 2024-09-22T08:38:31.030 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.026+0000 7f66ea6a0640 1 --2- 172.21.15.142:0/1451547613 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5613c3287a40 0x5613c3289e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:31.031 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.026+0000 7f66ea6a0640 1 --2- 172.21.15.142:0/1451547613 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5613c3287a40 0x5613c3289e30 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:31.031 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.026+0000 7f66ea6a0640 1 -- 172.21.15.142:0/1451547613 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(3 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f66dc073030 con 0x5613c3287a40 2024-09-22T08:38:31.031 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.026+0000 7f66ecbaf800 1 -- 172.21.15.142:0/1451547613 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5613c32868e0 con 0x5613c30f65b0 2024-09-22T08:38:31.031 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.026+0000 7f66eaea1640 1 -- 172.21.15.142:0/1451547613 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f66e40083e0 con 0x5613c30f65b0 2024-09-22T08:38:31.031 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.026+0000 7f66ecbaf800 1 -- 172.21.15.142:0/1451547613 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5613c3286dc0 con 0x5613c3287a40 2024-09-22T08:38:31.031 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.027+0000 7f66ea6a0640 1 -- 172.21.15.142:0/1451547613 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(5 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f66dc073030 con 0x5613c3287a40 2024-09-22T08:38:31.031 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.027+0000 7f66ecbaf800 1 Processor -- start 2024-09-22T08:38:31.031 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.027+0000 7f66ecbaf800 1 -- start start 2024-09-22T08:38:31.031 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.027+0000 7f66ecbaf800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5613c3298ea0 0x5613c32992c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:31.031 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.027+0000 7f66ecbaf800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5613c3077d50 con 0x5613c3298ea0 2024-09-22T08:38:31.031 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.027+0000 7f66eaea1640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5613c3298ea0 0x5613c32992c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:31.031 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.028+0000 7f66eaea1640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5613c3298ea0 0x5613c32992c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:52198/0 (socket says 172.21.15.142:52198) 2024-09-22T08:38:31.031 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.028+0000 7f66eaea1640 1 -- 172.21.15.142:0/625101904 learned_addr learned my addr 172.21.15.142:0/625101904 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:38:31.031 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.028+0000 7f66eaea1640 1 -- 172.21.15.142:0/625101904 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5613c3299900 con 0x5613c3298ea0 2024-09-22T08:38:31.032 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.028+0000 7f66eaea1640 1 --2- 172.21.15.142:0/625101904 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5613c3298ea0 0x5613c32992c0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x5613c327ef20 tx=0x7f66e400bf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:31.032 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.028+0000 7f65cffff640 1 -- 172.21.15.142:0/625101904 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f66e401c020 con 0x5613c3298ea0 2024-09-22T08:38:31.032 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.028+0000 7f65cffff640 1 -- 172.21.15.142:0/625101904 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66e4007c90 con 0x5613c3298ea0 2024-09-22T08:38:31.032 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.028+0000 7f66ecbaf800 1 -- 172.21.15.142:0/625101904 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5613c329a130 con 0x5613c3298ea0 2024-09-22T08:38:31.032 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.028+0000 7f65cffff640 1 -- 172.21.15.142:0/625101904 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f66e4018440 con 0x5613c3298ea0 2024-09-22T08:38:31.032 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.028+0000 7f66ecbaf800 1 -- 172.21.15.142:0/625101904 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5613c329a6d0 con 0x5613c3298ea0 2024-09-22T08:38:31.038 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.029+0000 7f65cffff640 1 -- 172.21.15.142:0/625101904 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f66e401f020 con 0x5613c3298ea0 2024-09-22T08:38:31.039 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.029+0000 7f65cffff640 1 --2- 172.21.15.142:0/625101904 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f65c403cfb0 0x7f65c403f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:31.039 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.029+0000 7f65cffff640 1 -- 172.21.15.142:0/625101904 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5938+0+0 (secure 0 0 0) 0x7f66e4055910 con 0x5613c3298ea0 2024-09-22T08:38:31.039 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.029+0000 7f66ea6a0640 1 --2- 172.21.15.142:0/625101904 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f65c403cfb0 0x7f65c403f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:31.039 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.030+0000 7f66ecbaf800 1 Processor -- start 2024-09-22T08:38:31.039 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.030+0000 7f66ea6a0640 1 --2- 172.21.15.142:0/625101904 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f65c403cfb0 0x7f65c403f470 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f66dc06c5b0 tx=0x7f66dc095720 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:31.039 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.030+0000 7f66ecbaf800 1 -- start start 2024-09-22T08:38:31.039 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.030+0000 7f66ecbaf800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5613c32a5900 0x5613c32a5d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:31.039 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.030+0000 7f66ecbaf800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5613c3276e10 con 0x5613c32a5900 2024-09-22T08:38:31.039 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.030+0000 7f66eaea1640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5613c32a5900 0x5613c32a5d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:31.039 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.030+0000 7f66eaea1640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5613c32a5900 0x5613c32a5d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:52206/0 (socket says 172.21.15.142:52206) 2024-09-22T08:38:31.039 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.030+0000 7f66eaea1640 1 -- 172.21.15.142:0/1763177302 learned_addr learned my addr 172.21.15.142:0/1763177302 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:38:31.039 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.030+0000 7f66eaea1640 1 -- 172.21.15.142:0/1763177302 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5613c32a62f0 con 0x5613c32a5900 2024-09-22T08:38:31.040 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.031+0000 7f66eaea1640 1 --2- 172.21.15.142:0/1763177302 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5613c32a5900 0x5613c32a5d00 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f66e4053df0 tx=0x7f66e4015820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f6a5dda62c748b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:31.040 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.031+0000 7f65cdffb640 1 -- 172.21.15.142:0/1763177302 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f66e40174d0 con 0x5613c32a5900 2024-09-22T08:38:31.040 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.031+0000 7f65cdffb640 1 -- 172.21.15.142:0/1763177302 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66e4052070 con 0x5613c32a5900 2024-09-22T08:38:31.040 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.031+0000 7f65cdffb640 1 -- 172.21.15.142:0/1763177302 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f66e4016d80 con 0x5613c32a5900 2024-09-22T08:38:31.040 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.031+0000 7f66ecbaf800 1 -- 172.21.15.142:0/1763177302 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5613c32a5900 msgr2=0x5613c32a5d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:31.040 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.031+0000 7f66ecbaf800 1 --2- 172.21.15.142:0/1763177302 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5613c32a5900 0x5613c32a5d00 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f66e4053df0 tx=0x7f66e4015820 comp rx=0 tx=0).stop 2024-09-22T08:38:31.040 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.031+0000 7f66ecbaf800 1 -- 172.21.15.142:0/1763177302 shutdown_connections 2024-09-22T08:38:31.040 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.031+0000 7f66ecbaf800 1 --2- 172.21.15.142:0/1763177302 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5613c32a5900 0x5613c32a5d00 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:31.040 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.031+0000 7f66ecbaf800 1 -- 172.21.15.142:0/1763177302 >> 172.21.15.142:0/1763177302 conn(0x5613c32a1d00 msgr2=0x5613c329ff40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:38:31.040 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.031+0000 7f66ecbaf800 1 -- 172.21.15.142:0/1763177302 shutdown_connections 2024-09-22T08:38:31.040 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.031+0000 7f66ecbaf800 1 -- 172.21.15.142:0/1763177302 wait complete. 2024-09-22T08:38:31.040 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.031+0000 7f66ecbaf800 1 Processor -- start 2024-09-22T08:38:31.040 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.032+0000 7f66ecbaf800 1 -- start start 2024-09-22T08:38:31.041 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.032+0000 7f66ecbaf800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5613c32a5900 0x5613c32ace70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:31.041 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.032+0000 7f66ecbaf800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5613c32a6910 con 0x5613c32a5900 2024-09-22T08:38:31.041 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.032+0000 7f66eaea1640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5613c32a5900 0x5613c32ace70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:31.041 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.032+0000 7f66eaea1640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5613c32a5900 0x5613c32ace70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:52214/0 (socket says 172.21.15.142:52214) 2024-09-22T08:38:31.041 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.032+0000 7f66eaea1640 1 -- 172.21.15.142:0/2089914608 learned_addr learned my addr 172.21.15.142:0/2089914608 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:38:31.041 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.032+0000 7f66eaea1640 1 -- 172.21.15.142:0/2089914608 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5613c32ad3d0 con 0x5613c32a5900 2024-09-22T08:38:31.041 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.032+0000 7f66eaea1640 1 --2- 172.21.15.142:0/2089914608 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5613c32a5900 0x5613c32ace70 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f66e40206f0 tx=0x7f66e40088f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:31.041 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.032+0000 7f65bbfff640 1 -- 172.21.15.142:0/2089914608 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f66e4013d20 con 0x5613c32a5900 2024-09-22T08:38:31.041 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.033+0000 7f66ecbaf800 1 -- 172.21.15.142:0/2089914608 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5613c32ad660 con 0x5613c32a5900 2024-09-22T08:38:31.041 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.033+0000 7f65bbfff640 1 -- 172.21.15.142:0/2089914608 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66e40187c0 con 0x5613c32a5900 2024-09-22T08:38:31.041 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.033+0000 7f65bbfff640 1 -- 172.21.15.142:0/2089914608 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f66e4018aa0 con 0x5613c32a5900 2024-09-22T08:38:31.041 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.033+0000 7f66ecbaf800 1 -- 172.21.15.142:0/2089914608 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5613c32ad660 con 0x5613c32a5900 2024-09-22T08:38:31.041 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.033+0000 7f65bbfff640 1 -- 172.21.15.142:0/2089914608 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f66e4031060 con 0x5613c32a5900 2024-09-22T08:38:31.042 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.034+0000 7f65bbfff640 1 --2- 172.21.15.142:0/2089914608 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f65b403cfb0 0x7f65b403f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:31.042 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.034+0000 7f65bbfff640 1 -- 172.21.15.142:0/2089914608 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5938+0+0 (secure 0 0 0) 0x7f66e403b670 con 0x5613c32a5900 2024-09-22T08:38:31.042 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.034+0000 7f66ea6a0640 1 --2- 172.21.15.142:0/2089914608 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f65b403cfb0 0x7f65b403f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:31.042 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.034+0000 7f66ea6a0640 1 --2- 172.21.15.142:0/2089914608 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f65b403cfb0 0x7f65b403f470 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f66dc095fd0 tx=0x7f66dc08b000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:31.042 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.034+0000 7f66ecbaf800 20 rados->read ofs=0 len=0 2024-09-22T08:38:31.042 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.034+0000 7f66ecbaf800 1 --2- 172.21.15.142:0/2089914608 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5613c32b8600 0x5613c32baac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:31.042 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.034+0000 7f66ecbaf800 1 -- 172.21.15.142:0/2089914608 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5613c32bb210 con 0x5613c32b8600 2024-09-22T08:38:31.042 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.034+0000 7f66e9e9f640 1 --2- 172.21.15.142:0/2089914608 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5613c32b8600 0x5613c32baac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:31.042 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.035+0000 7f66e9e9f640 1 --2- 172.21.15.142:0/2089914608 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5613c32b8600 0x5613c32baac0 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:31.042 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.035+0000 7f66e9e9f640 1 -- 172.21.15.142:0/2089914608 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f66d400f5f0 con 0x5613c32b8600 2024-09-22T08:38:31.042 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.035+0000 7f66ecbaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:31.042 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.035+0000 7f66ecbaf800 20 realm 2024-09-22T08:38:31.042 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.035+0000 7f66ecbaf800 20 rados->read ofs=0 len=0 2024-09-22T08:38:31.043 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.035+0000 7f66ecbaf800 1 -- 172.21.15.142:0/2089914608 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5613c32b7990 con 0x5613c32b8600 2024-09-22T08:38:31.043 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.035+0000 7f66e9e9f640 1 -- 172.21.15.142:0/2089914608 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f66d400f5f0 con 0x5613c32b8600 2024-09-22T08:38:31.043 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.035+0000 7f66ecbaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:31.043 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.035+0000 7f66ecbaf800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:38:31.043 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.035+0000 7f66ecbaf800 20 rados->read ofs=0 len=0 2024-09-22T08:38:31.043 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.035+0000 7f66ecbaf800 1 -- 172.21.15.142:0/2089914608 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5613c32bbd00 con 0x5613c32b8600 2024-09-22T08:38:31.043 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.035+0000 7f66e9e9f640 1 -- 172.21.15.142:0/2089914608 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f66d400f5f0 con 0x5613c32b8600 2024-09-22T08:38:31.043 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.035+0000 7f66ecbaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:31.043 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.035+0000 7f66ecbaf800 20 rados->read ofs=0 len=0 2024-09-22T08:38:31.043 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.035+0000 7f66ecbaf800 1 -- 172.21.15.142:0/2089914608 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5613c32bc5d0 con 0x5613c32b8600 2024-09-22T08:38:31.043 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.035+0000 7f66e9e9f640 1 -- 172.21.15.142:0/2089914608 <== osd.1 v2:172.21.15.142:6816/3192108003 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f66d400f5f0 con 0x5613c32b8600 2024-09-22T08:38:31.043 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.035+0000 7f66ecbaf800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:38:31.044 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.035+0000 7f66ecbaf800 20 rados->read ofs=0 len=0 2024-09-22T08:38:31.044 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.035+0000 7f66ecbaf800 1 --2- 172.21.15.142:0/2089914608 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5613c32bcff0 0x5613c32bf3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:31.044 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.035+0000 7f66ecbaf800 1 -- 172.21.15.142:0/2089914608 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5613c32bfb50 con 0x5613c32bcff0 2024-09-22T08:38:31.044 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.036+0000 7f66eaea1640 1 --2- 172.21.15.142:0/2089914608 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5613c32bcff0 0x5613c32bf3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:31.044 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.036+0000 7f66eaea1640 1 --2- 172.21.15.142:0/2089914608 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5613c32bcff0 0x5613c32bf3e0 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:31.044 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.036+0000 7f66eaea1640 1 -- 172.21.15.142:0/2089914608 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(5 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f66e40083e0 con 0x5613c32bcff0 2024-09-22T08:38:31.044 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.036+0000 7f66ecbaf800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:38:31.044 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.036+0000 7f66ecbaf800 20 searching for the correct realm 2024-09-22T08:38:31.044 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.036+0000 7f66ecbaf800 1 -- 172.21.15.142:0/2089914608 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5613c32c1480 con 0x5613c32bcff0 2024-09-22T08:38:31.044 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.036+0000 7f66eaea1640 1 -- 172.21.15.142:0/2089914608 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66e40083e0 con 0x5613c32bcff0 2024-09-22T08:38:31.044 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.036+0000 7f66eaea1640 1 --2- 172.21.15.142:0/2089914608 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f66e4033070 0x7f66e4029390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:31.044 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.036+0000 7f66eaea1640 1 -- 172.21.15.142:0/2089914608 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5613c32c1480 con 0x7f66e4033070 2024-09-22T08:38:31.045 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.036+0000 7f66ea6a0640 1 --2- 172.21.15.142:0/2089914608 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f66e4033070 0x7f66e4029390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:31.045 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.037+0000 7f66ea6a0640 1 --2- 172.21.15.142:0/2089914608 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f66e4033070 0x7f66e4029390 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:31.045 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.037+0000 7f66ea6a0640 1 -- 172.21.15.142:0/2089914608 <== osd.2 v2:172.21.15.142:6808/279438927 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66dc083050 con 0x7f66e4033070 2024-09-22T08:38:31.045 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.037+0000 7f66ea6a0640 1 --2- 172.21.15.142:0/2089914608 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f66dc076060 0x7f66dc0753b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:31.045 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.037+0000 7f66ea6a0640 1 -- 172.21.15.142:0/2089914608 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5613c32c1480 con 0x7f66dc076060 2024-09-22T08:38:31.045 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.037+0000 7f66e9e9f640 1 --2- 172.21.15.142:0/2089914608 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f66dc076060 0x7f66dc0753b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:31.054 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.038+0000 7f66e9e9f640 1 --2- 172.21.15.142:0/2089914608 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f66dc076060 0x7f66dc0753b0 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:31.054 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.038+0000 7f66e9e9f640 1 -- 172.21.15.142:0/2089914608 <== osd.0 v2:172.21.15.31:6800/168281188 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66d400f5f0 con 0x7f66dc076060 2024-09-22T08:38:31.054 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.038+0000 7f66e9e9f640 1 -- 172.21.15.142:0/2089914608 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5613c32c1480 con 0x5613c32b8600 2024-09-22T08:38:31.055 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.038+0000 7f66e9e9f640 1 -- 172.21.15.142:0/2089914608 <== osd.1 v2:172.21.15.142:6816/3192108003 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66d400f5f0 con 0x5613c32b8600 2024-09-22T08:38:31.055 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.038+0000 7f66e9e9f640 1 -- 172.21.15.142:0/2089914608 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5613c32c1480 con 0x5613c32b8600 2024-09-22T08:38:31.055 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.039+0000 7f66e9e9f640 1 -- 172.21.15.142:0/2089914608 <== osd.1 v2:172.21.15.142:6816/3192108003 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66d402b040 con 0x5613c32b8600 2024-09-22T08:38:31.055 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.039+0000 7f66e9e9f640 1 -- 172.21.15.142:0/2089914608 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5613c32c1480 con 0x5613c32b8600 2024-09-22T08:38:31.055 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.039+0000 7f66e9e9f640 1 -- 172.21.15.142:0/2089914608 <== osd.1 v2:172.21.15.142:6816/3192108003 7 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66d402b040 con 0x5613c32b8600 2024-09-22T08:38:31.055 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.039+0000 7f66e9e9f640 1 -- 172.21.15.142:0/2089914608 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5613c32c1480 con 0x7f66dc076060 2024-09-22T08:38:31.055 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.039+0000 7f66e9e9f640 1 -- 172.21.15.142:0/2089914608 <== osd.0 v2:172.21.15.31:6800/168281188 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66d402b040 con 0x7f66dc076060 2024-09-22T08:38:31.055 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.039+0000 7f66e9e9f640 1 -- 172.21.15.142:0/2089914608 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5613c32c1480 con 0x7f66e4033070 2024-09-22T08:38:31.055 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.039+0000 7f66ea6a0640 1 -- 172.21.15.142:0/2089914608 <== osd.2 v2:172.21.15.142:6808/279438927 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66dc083050 con 0x7f66e4033070 2024-09-22T08:38:31.055 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.039+0000 7f66ea6a0640 1 -- 172.21.15.142:0/2089914608 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5613c32c1480 con 0x5613c32bcff0 2024-09-22T08:38:31.055 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.039+0000 7f66eaea1640 1 -- 172.21.15.142:0/2089914608 <== osd.3 v2:172.21.15.142:6800/1064901393 3 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66e40083e0 con 0x5613c32bcff0 2024-09-22T08:38:31.055 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.039+0000 7f66eaea1640 1 -- 172.21.15.142:0/2089914608 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5613c32c1480 con 0x5613c32b8600 2024-09-22T08:38:31.055 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.040+0000 7f66e9e9f640 1 -- 172.21.15.142:0/2089914608 <== osd.1 v2:172.21.15.142:6816/3192108003 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66d402b040 con 0x5613c32b8600 2024-09-22T08:38:31.056 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.040+0000 7f66e9e9f640 1 -- 172.21.15.142:0/2089914608 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5613c32c1480 con 0x7f66dc076060 2024-09-22T08:38:31.056 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.040+0000 7f66e9e9f640 1 -- 172.21.15.142:0/2089914608 <== osd.0 v2:172.21.15.31:6800/168281188 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66d402b040 con 0x7f66dc076060 2024-09-22T08:38:31.056 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.040+0000 7f66e9e9f640 1 -- 172.21.15.142:0/2089914608 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5613c32c1480 con 0x5613c32b8600 2024-09-22T08:38:31.056 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.040+0000 7f66e9e9f640 1 -- 172.21.15.142:0/2089914608 <== osd.1 v2:172.21.15.142:6816/3192108003 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66d402b040 con 0x5613c32b8600 2024-09-22T08:38:31.056 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.040+0000 7f66e9e9f640 1 -- 172.21.15.142:0/2089914608 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5613c32c1480 con 0x7f66e4033070 2024-09-22T08:38:31.056 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.040+0000 7f66ea6a0640 1 -- 172.21.15.142:0/2089914608 <== osd.2 v2:172.21.15.142:6808/279438927 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f66dc083050 con 0x7f66e4033070 2024-09-22T08:38:31.056 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.040+0000 7f66ea6a0640 1 -- 172.21.15.142:0/2089914608 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5613c32c1480 con 0x5613c32bcff0 2024-09-22T08:38:31.056 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.041+0000 7f66eaea1640 1 -- 172.21.15.142:0/2089914608 <== osd.3 v2:172.21.15.142:6800/1064901393 4 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66e40083e0 con 0x5613c32bcff0 2024-09-22T08:38:31.056 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.041+0000 7f66eaea1640 1 -- 172.21.15.142:0/2089914608 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5613c32c1480 con 0x5613c32bcff0 2024-09-22T08:38:31.056 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.041+0000 7f66eaea1640 1 -- 172.21.15.142:0/2089914608 <== osd.3 v2:172.21.15.142:6800/1064901393 5 ==== osd_op_reply(20 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f66e40083e0 con 0x5613c32bcff0 2024-09-22T08:38:31.056 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.041+0000 7f66eaea1640 1 -- 172.21.15.142:0/2089914608 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5613c32c1480 con 0x7f66dc076060 2024-09-22T08:38:31.056 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.041+0000 7f66e9e9f640 1 -- 172.21.15.142:0/2089914608 <== osd.0 v2:172.21.15.31:6800/168281188 4 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66d402b040 con 0x7f66dc076060 2024-09-22T08:38:31.057 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.041+0000 7f66e9e9f640 1 -- 172.21.15.142:0/2089914608 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5613c32c1480 con 0x5613c32bcff0 2024-09-22T08:38:31.057 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.041+0000 7f66eaea1640 1 -- 172.21.15.142:0/2089914608 <== osd.3 v2:172.21.15.142:6800/1064901393 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66e40083e0 con 0x5613c32bcff0 2024-09-22T08:38:31.057 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.041+0000 7f66eaea1640 1 -- 172.21.15.142:0/2089914608 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5613c32c1480 con 0x5613c32bcff0 2024-09-22T08:38:31.057 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.042+0000 7f66eaea1640 1 -- 172.21.15.142:0/2089914608 <== osd.3 v2:172.21.15.142:6800/1064901393 7 ==== osd_op_reply(23 [pgnls start_epoch 32 out=107b] v32'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f66e40083e0 con 0x5613c32bcff0 2024-09-22T08:38:31.057 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.042+0000 7f66eaea1640 1 -- 172.21.15.142:0/2089914608 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5613c32c1480 con 0x5613c32b8600 2024-09-22T08:38:31.057 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.042+0000 7f66e9e9f640 1 -- 172.21.15.142:0/2089914608 <== osd.1 v2:172.21.15.142:6816/3192108003 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66d402b040 con 0x5613c32b8600 2024-09-22T08:38:31.057 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.042+0000 7f66e9e9f640 1 -- 172.21.15.142:0/2089914608 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5613c32c1480 con 0x5613c32b8600 2024-09-22T08:38:31.057 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.042+0000 7f66e9e9f640 1 -- 172.21.15.142:0/2089914608 <== osd.1 v2:172.21.15.142:6816/3192108003 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v32'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f66d402b040 con 0x5613c32b8600 2024-09-22T08:38:31.057 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.042+0000 7f66e9e9f640 1 -- 172.21.15.142:0/2089914608 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5613c32c1480 con 0x7f66dc076060 2024-09-22T08:38:31.057 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.042+0000 7f66e9e9f640 1 -- 172.21.15.142:0/2089914608 <== osd.0 v2:172.21.15.31:6800/168281188 5 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66d402b040 con 0x7f66dc076060 2024-09-22T08:38:31.057 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.042+0000 7f66e9e9f640 1 -- 172.21.15.142:0/2089914608 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5613c32c1480 con 0x5613c32bcff0 2024-09-22T08:38:31.057 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.042+0000 7f66eaea1640 1 -- 172.21.15.142:0/2089914608 <== osd.3 v2:172.21.15.142:6800/1064901393 8 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66e40083e0 con 0x5613c32bcff0 2024-09-22T08:38:31.058 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.042+0000 7f66eaea1640 1 -- 172.21.15.142:0/2089914608 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5613c32c1480 con 0x7f66e4033070 2024-09-22T08:38:31.058 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.043+0000 7f66ea6a0640 1 -- 172.21.15.142:0/2089914608 <== osd.2 v2:172.21.15.142:6808/279438927 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66dc083050 con 0x7f66e4033070 2024-09-22T08:38:31.058 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.043+0000 7f66ea6a0640 1 -- 172.21.15.142:0/2089914608 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5613c32c1480 con 0x5613c32b8600 2024-09-22T08:38:31.058 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.043+0000 7f66e9e9f640 1 -- 172.21.15.142:0/2089914608 <== osd.1 v2:172.21.15.142:6816/3192108003 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66d402b040 con 0x5613c32b8600 2024-09-22T08:38:31.058 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.043+0000 7f66e9e9f640 1 -- 172.21.15.142:0/2089914608 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5613c32c1480 con 0x7f66dc076060 2024-09-22T08:38:31.058 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.043+0000 7f66e9e9f640 1 -- 172.21.15.142:0/2089914608 <== osd.0 v2:172.21.15.31:6800/168281188 6 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66d403b040 con 0x7f66dc076060 2024-09-22T08:38:31.058 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.043+0000 7f66e9e9f640 1 -- 172.21.15.142:0/2089914608 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5613c32c1480 con 0x5613c32bcff0 2024-09-22T08:38:31.058 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.043+0000 7f66eaea1640 1 -- 172.21.15.142:0/2089914608 <== osd.3 v2:172.21.15.142:6800/1064901393 9 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66e40083e0 con 0x5613c32bcff0 2024-09-22T08:38:31.058 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.043+0000 7f66eaea1640 1 -- 172.21.15.142:0/2089914608 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f66e4060040 con 0x7f66dc076060 2024-09-22T08:38:31.058 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.044+0000 7f66e9e9f640 1 -- 172.21.15.142:0/2089914608 <== osd.0 v2:172.21.15.31:6800/168281188 7 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66d403b040 con 0x7f66dc076060 2024-09-22T08:38:31.058 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.044+0000 7f66e9e9f640 1 -- 172.21.15.142:0/2089914608 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f66e4060040 con 0x7f66e4033070 2024-09-22T08:38:31.058 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.044+0000 7f66ea6a0640 1 -- 172.21.15.142:0/2089914608 <== osd.2 v2:172.21.15.142:6808/279438927 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66dc083050 con 0x7f66e4033070 2024-09-22T08:38:31.058 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.044+0000 7f66ea6a0640 1 -- 172.21.15.142:0/2089914608 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f66e4060040 con 0x5613c32bcff0 2024-09-22T08:38:31.059 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.044+0000 7f66eaea1640 1 -- 172.21.15.142:0/2089914608 <== osd.3 v2:172.21.15.142:6800/1064901393 10 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66e40083e0 con 0x5613c32bcff0 2024-09-22T08:38:31.059 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.044+0000 7f66eaea1640 1 -- 172.21.15.142:0/2089914608 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f66e4060040 con 0x7f66dc076060 2024-09-22T08:38:31.059 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.045+0000 7f66e9e9f640 1 -- 172.21.15.142:0/2089914608 <== osd.0 v2:172.21.15.31:6800/168281188 8 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66d403b040 con 0x7f66dc076060 2024-09-22T08:38:31.059 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.045+0000 7f66e9e9f640 1 -- 172.21.15.142:0/2089914608 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f66e4060040 con 0x5613c32b8600 2024-09-22T08:38:31.059 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.045+0000 7f66e9e9f640 1 -- 172.21.15.142:0/2089914608 <== osd.1 v2:172.21.15.142:6816/3192108003 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v32'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f66d403b040 con 0x5613c32b8600 2024-09-22T08:38:31.059 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.045+0000 7f66e9e9f640 1 -- 172.21.15.142:0/2089914608 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f66e4060040 con 0x7f66e4033070 2024-09-22T08:38:31.059 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.045+0000 7f66ea6a0640 1 -- 172.21.15.142:0/2089914608 <== osd.2 v2:172.21.15.142:6808/279438927 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66dc083050 con 0x7f66e4033070 2024-09-22T08:38:31.059 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.045+0000 7f66ecbaf800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:38:31.059 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.045+0000 7f66ecbaf800 20 RGWRados::pool_iterate: got zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec 2024-09-22T08:38:31.059 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.045+0000 7f66ecbaf800 20 RGWRados::pool_iterate: got zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f 2024-09-22T08:38:31.059 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.045+0000 7f66ecbaf800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:38:31.060 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.045+0000 7f66ecbaf800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:38:31.060 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.045+0000 7f66ecbaf800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:38:31.060 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.045+0000 7f66ecbaf800 20 rados->read ofs=0 len=0 2024-09-22T08:38:31.060 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.045+0000 7f66ecbaf800 1 -- 172.21.15.142:0/2089914608 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5613c32c0510 con 0x5613c32b8600 2024-09-22T08:38:31.060 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.045+0000 7f66e9e9f640 1 -- 172.21.15.142:0/2089914608 <== osd.1 v2:172.21.15.142:6816/3192108003 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f66d403b040 con 0x5613c32b8600 2024-09-22T08:38:31.060 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.045+0000 7f66ecbaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:31.060 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.045+0000 7f66ecbaf800 20 rados->read ofs=0 len=0 2024-09-22T08:38:31.060 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.045+0000 7f66ecbaf800 1 -- 172.21.15.142:0/2089914608 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5613c32c0db0 con 0x5613c32b8600 2024-09-22T08:38:31.060 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.045+0000 7f66e9e9f640 1 -- 172.21.15.142:0/2089914608 <== osd.1 v2:172.21.15.142:6816/3192108003 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f66d403b040 con 0x5613c32b8600 2024-09-22T08:38:31.060 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.046+0000 7f66ecbaf800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:38:31.060 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.046+0000 7f66ecbaf800 20 rados->read ofs=0 len=0 2024-09-22T08:38:31.060 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.046+0000 7f66ecbaf800 1 -- 172.21.15.142:0/2089914608 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:40 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5613c32c1900 con 0x5613c32bcff0 2024-09-22T08:38:31.060 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.046+0000 7f66eaea1640 1 -- 172.21.15.142:0/2089914608 <== osd.3 v2:172.21.15.142:6800/1064901393 11 ==== osd_op_reply(40 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f66e40083e0 con 0x5613c32bcff0 2024-09-22T08:38:31.061 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.046+0000 7f66ecbaf800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:38:31.061 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.046+0000 7f66ecbaf800 20 zone default found 2024-09-22T08:38:31.061 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.046+0000 7f66ecbaf800 4 Realm: () 2024-09-22T08:38:31.061 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.046+0000 7f66ecbaf800 4 ZoneGroup: default (d89f6f57-1007-47dd-9065-f486c7b01aec) 2024-09-22T08:38:31.061 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.046+0000 7f66ecbaf800 4 Zone: default (e239248c-0bee-4e41-803a-24b288d3eb8f) 2024-09-22T08:38:31.061 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.046+0000 7f66ecbaf800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:38:31.061 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.046+0000 7f66ecbaf800 20 zonegroup default 2024-09-22T08:38:31.061 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.046+0000 7f66ecbaf800 20 rados->read ofs=0 len=0 2024-09-22T08:38:31.061 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.046+0000 7f66ecbaf800 1 -- 172.21.15.142:0/2089914608 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5613c32c1ca0 con 0x7f66dc076060 2024-09-22T08:38:31.061 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.046+0000 7f66e9e9f640 1 -- 172.21.15.142:0/2089914608 <== osd.0 v2:172.21.15.31:6800/168281188 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f66d403b040 con 0x7f66dc076060 2024-09-22T08:38:31.061 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.046+0000 7f66ecbaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:31.061 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.046+0000 7f66ecbaf800 20 rados->read ofs=0 len=0 2024-09-22T08:38:31.061 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.046+0000 7f66ecbaf800 1 -- 172.21.15.142:0/2089914608 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5613c32c3ab0 con 0x5613c32bcff0 2024-09-22T08:38:31.061 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.046+0000 7f66eaea1640 1 -- 172.21.15.142:0/2089914608 <== osd.3 v2:172.21.15.142:6800/1064901393 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f66e40083e0 con 0x5613c32bcff0 2024-09-22T08:38:31.062 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.046+0000 7f66ecbaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:31.062 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.046+0000 7f66ecbaf800 20 rados->read ofs=0 len=0 2024-09-22T08:38:31.062 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.046+0000 7f66ecbaf800 1 -- 172.21.15.142:0/2089914608 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5613c32c3f40 con 0x5613c32bcff0 2024-09-22T08:38:31.062 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.047+0000 7f66eaea1640 1 -- 172.21.15.142:0/2089914608 <== osd.3 v2:172.21.15.142:6800/1064901393 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f66e40083e0 con 0x5613c32bcff0 2024-09-22T08:38:31.062 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.047+0000 7f66ecbaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:31.062 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.047+0000 7f66ecbaf800 20 started sync module instance, tier type = 2024-09-22T08:38:31.062 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.047+0000 7f66ecbaf800 20 started zone id=e239248c-0bee-4e41-803a-24b288d3eb8f (name=default) with tier type = 2024-09-22T08:38:31.062 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.047+0000 7f66ecbaf800 1 -- 172.21.15.142:0/2089914608 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5613c32c2f50 con 0x7f66e4033070 2024-09-22T08:38:31.062 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.048+0000 7f66ea6a0640 1 -- 172.21.15.142:0/2089914608 <== osd.2 v2:172.21.15.142:6808/279438927 7 ==== osd_op_reply(44 notify.0 [create] v32'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f66dc083050 con 0x7f66e4033070 2024-09-22T08:38:31.062 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.048+0000 7f66ecbaf800 1 -- 172.21.15.142:0/2089914608 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94642878818976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5613c32c43a0 con 0x7f66e4033070 2024-09-22T08:38:31.062 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.048+0000 7f66ecbaf800 1 -- 172.21.15.142:0/2089914608 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5613c32c4bf0 con 0x5613c32b8600 2024-09-22T08:38:31.062 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.049+0000 7f66ea6a0640 1 -- 172.21.15.142:0/2089914608 <== osd.2 v2:172.21.15.142:6808/279438927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94642878818976] v32'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f66dc083050 con 0x7f66e4033070 2024-09-22T08:38:31.062 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.049+0000 7f66e9e9f640 1 -- 172.21.15.142:0/2089914608 <== osd.1 v2:172.21.15.142:6816/3192108003 16 ==== osd_op_reply(46 notify.1 [create] v32'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f66d403b040 con 0x5613c32b8600 2024-09-22T08:38:31.063 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.049+0000 7f66ecbaf800 1 -- 172.21.15.142:0/2089914608 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94642878821232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5613c32c4c90 con 0x5613c32b8600 2024-09-22T08:38:31.063 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.049+0000 7f66ecbaf800 1 -- 172.21.15.142:0/2089914608 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5613c32c57b0 con 0x5613c32bcff0 2024-09-22T08:38:31.063 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.050+0000 7f66e9e9f640 1 -- 172.21.15.142:0/2089914608 <== osd.1 v2:172.21.15.142:6816/3192108003 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94642878821232] v32'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f66d403b040 con 0x5613c32b8600 2024-09-22T08:38:31.063 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.050+0000 7f66eaea1640 1 -- 172.21.15.142:0/2089914608 <== osd.3 v2:172.21.15.142:6800/1064901393 14 ==== osd_op_reply(48 notify.2 [create] v32'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f66e40083e0 con 0x5613c32bcff0 2024-09-22T08:38:31.063 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.050+0000 7f66ecbaf800 1 -- 172.21.15.142:0/2089914608 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94642878829184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5613c32c5770 con 0x5613c32bcff0 2024-09-22T08:38:31.063 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.051+0000 7f66ecbaf800 1 -- 172.21.15.142:0/2089914608 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5613c32c6260 con 0x7f66e4033070 2024-09-22T08:38:31.063 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.052+0000 7f66eaea1640 1 -- 172.21.15.142:0/2089914608 <== osd.3 v2:172.21.15.142:6800/1064901393 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94642878829184] v32'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f66e40083e0 con 0x5613c32bcff0 2024-09-22T08:38:31.063 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.053+0000 7f66ea6a0640 1 -- 172.21.15.142:0/2089914608 <== osd.2 v2:172.21.15.142:6808/279438927 9 ==== osd_op_reply(50 notify.3 [create] v32'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f66dc083050 con 0x7f66e4033070 2024-09-22T08:38:31.063 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.053+0000 7f66ecbaf800 1 -- 172.21.15.142:0/2089914608 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94642878831984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5613c32c6680 con 0x7f66e4033070 2024-09-22T08:38:31.063 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.053+0000 7f66ecbaf800 1 -- 172.21.15.142:0/2089914608 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5613c32c7080 con 0x5613c32b8600 2024-09-22T08:38:31.067 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.054+0000 7f66ea6a0640 1 -- 172.21.15.142:0/2089914608 <== osd.2 v2:172.21.15.142:6808/279438927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94642878831984] v32'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f66dc083050 con 0x7f66e4033070 2024-09-22T08:38:31.067 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.054+0000 7f66e9e9f640 1 -- 172.21.15.142:0/2089914608 <== osd.1 v2:172.21.15.142:6816/3192108003 18 ==== osd_op_reply(52 notify.4 [create] v32'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f66d403b040 con 0x5613c32b8600 2024-09-22T08:38:31.068 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.054+0000 7f66ecbaf800 1 -- 172.21.15.142:0/2089914608 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94642878826304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5613c32c7040 con 0x5613c32b8600 2024-09-22T08:38:31.068 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.054+0000 7f66ecbaf800 1 -- 172.21.15.142:0/2089914608 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5613c32c7b30 con 0x7f66dc076060 2024-09-22T08:38:31.068 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.055+0000 7f66e9e9f640 1 -- 172.21.15.142:0/2089914608 <== osd.1 v2:172.21.15.142:6816/3192108003 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94642878826304] v32'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f66d403b040 con 0x5613c32b8600 2024-09-22T08:38:31.068 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.055+0000 7f66e9e9f640 1 -- 172.21.15.142:0/2089914608 <== osd.0 v2:172.21.15.31:6800/168281188 10 ==== osd_op_reply(54 notify.5 [create] v32'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f66d403b040 con 0x7f66dc076060 2024-09-22T08:38:31.068 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.055+0000 7f66ecbaf800 1 -- 172.21.15.142:0/2089914608 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94642878838336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5613c32c7040 con 0x7f66dc076060 2024-09-22T08:38:31.068 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.055+0000 7f66ecbaf800 1 -- 172.21.15.142:0/2089914608 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5613c32c8540 con 0x7f66dc076060 2024-09-22T08:38:31.068 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.056+0000 7f66e9e9f640 1 -- 172.21.15.142:0/2089914608 <== osd.0 v2:172.21.15.31:6800/168281188 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94642878838336] v32'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f66d403b040 con 0x7f66dc076060 2024-09-22T08:38:31.068 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.056+0000 7f66e9e9f640 1 -- 172.21.15.142:0/2089914608 <== osd.0 v2:172.21.15.31:6800/168281188 12 ==== osd_op_reply(56 notify.6 [create] v32'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f66d403b040 con 0x7f66dc076060 2024-09-22T08:38:31.068 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.056+0000 7f66ecbaf800 1 -- 172.21.15.142:0/2089914608 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94642878835600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5613c32c8720 con 0x7f66dc076060 2024-09-22T08:38:31.068 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.056+0000 7f66ecbaf800 1 -- 172.21.15.142:0/2089914608 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5613c32c8f70 con 0x7f66dc076060 2024-09-22T08:38:31.068 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.057+0000 7f66e9e9f640 1 -- 172.21.15.142:0/2089914608 <== osd.0 v2:172.21.15.31:6800/168281188 13 ==== osd_op_reply(58 notify.7 [create] v32'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f66d403b040 con 0x7f66dc076060 2024-09-22T08:38:31.068 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.057+0000 7f66e9e9f640 1 -- 172.21.15.142:0/2089914608 <== osd.0 v2:172.21.15.31:6800/168281188 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94642878835600] v32'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f66d403b040 con 0x7f66dc076060 2024-09-22T08:38:31.069 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.057+0000 7f66ecbaf800 1 -- 172.21.15.142:0/2089914608 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94642878843136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5613c32c8370 con 0x7f66dc076060 2024-09-22T08:38:31.069 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.057+0000 7f66ecbaf800 20 add_watcher() i=0 2024-09-22T08:38:31.069 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.057+0000 7f66ecbaf800 20 add_watcher() i=1 2024-09-22T08:38:31.069 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.057+0000 7f66ecbaf800 20 add_watcher() i=2 2024-09-22T08:38:31.069 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.057+0000 7f66ecbaf800 20 add_watcher() i=3 2024-09-22T08:38:31.069 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.057+0000 7f66ecbaf800 20 add_watcher() i=4 2024-09-22T08:38:31.069 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.057+0000 7f66ecbaf800 20 add_watcher() i=5 2024-09-22T08:38:31.069 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.057+0000 7f66ecbaf800 20 add_watcher() i=6 2024-09-22T08:38:31.069 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.059+0000 7f66e9e9f640 1 -- 172.21.15.142:0/2089914608 <== osd.0 v2:172.21.15.31:6800/168281188 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94642878843136] v32'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f66d403b040 con 0x7f66dc076060 2024-09-22T08:38:31.069 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.059+0000 7f66ecbaf800 20 add_watcher() i=7 2024-09-22T08:38:31.069 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.059+0000 7f66ecbaf800 2 all 8 watchers are set, enabling cache 2024-09-22T08:38:31.069 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.060+0000 7f66ecbaf800 1 -- 172.21.15.142:0/2089914608 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5613c32cc850 con 0x5613c32b8600 2024-09-22T08:38:31.070 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.060+0000 7f66e9e9f640 1 -- 172.21.15.142:0/2089914608 <== osd.1 v2:172.21.15.142:6816/3192108003 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f66d403b040 con 0x5613c32b8600 2024-09-22T08:38:31.070 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.060+0000 7f66ecbaf800 1 -- 172.21.15.142:0/2089914608 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94642878845808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5613c32c9d10 con 0x5613c32b8600 2024-09-22T08:38:31.070 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.061+0000 7f66e9e9f640 1 -- 172.21.15.142:0/2089914608 <== osd.1 v2:172.21.15.142:6816/3192108003 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94642878845808] v32'268 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f66d403b040 con 0x5613c32b8600 2024-09-22T08:38:31.070 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.061+0000 7f65a0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:38:31.070 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.061+0000 7f66ecbaf800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:38:31.070 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.061+0000 7f66ecbaf800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:38:31.070 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.061+0000 7f66ecbaf800 5 note: GC not initialized 2024-09-22T08:38:31.070 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.061+0000 7f651b7fe640 20 reqs_thread_entry: start 2024-09-22T08:38:31.070 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.061+0000 7f66ecbaf800 20 init_complete bucket index max shards: 11 2024-09-22T08:38:31.070 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.061+0000 7f66ecbaf800 20 Filter name: none 2024-09-22T08:38:31.070 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.062+0000 7f65197fa640 20 reqs_thread_entry: start 2024-09-22T08:38:31.070 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.062+0000 7f66ecbaf800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-22T08:38:31.070 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.062+0000 7f66ecbaf800 20 rados->read ofs=0 len=0 2024-09-22T08:38:31.070 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.062+0000 7f66ecbaf800 1 -- 172.21.15.142:0/2089914608 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5613c32ffbf0 con 0x7f66dc076060 2024-09-22T08:38:31.070 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.062+0000 7f66e9e9f640 1 -- 172.21.15.142:0/2089914608 <== osd.0 v2:172.21.15.31:6800/168281188 16 ==== osd_op_reply(62 ada [call out=48b,read 0~490 out=490b,getxattrs out=75b] v0'0 uv10 ondisk = 0) ==== 231+0+613 (crc 0 0 0) 0x7f66d403b040 con 0x7f66dc076060 2024-09-22T08:38:31.071 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.062+0000 7f66ecbaf800 20 rados_obj.operate() r=0 bl.length=490 2024-09-22T08:38:31.071 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.062+0000 7f66ecbaf800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-22T08:38:31.071 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.062+0000 7f66ecbaf800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-22T08:38:31.071 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.062+0000 7f66ecbaf800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:38:31.071 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.062+0000 7f66ecbaf800 1 -- 172.21.15.142:0/2089914608 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~460 in=460b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5613c3306310 con 0x7f66dc076060 2024-09-22T08:38:31.071 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.064+0000 7f66e9e9f640 1 -- 172.21.15.142:0/2089914608 <== osd.0 v2:172.21.15.31:6800/168281188 17 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~460] v32'11 uv11 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f66d403b040 con 0x7f66dc076060 2024-09-22T08:38:31.071 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.064+0000 7f66ecbaf800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-22T08:38:31.071 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.064+0000 7f66ecbaf800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-22T08:38:31.071 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.064+0000 7f66ecbaf800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-22T08:38:31.071 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.064+0000 7f66ecbaf800 1 -- 172.21.15.142:0/2089914608 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94642879094032 in=648b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5613c3301970 con 0x5613c32b8600 2024-09-22T08:38:31.071 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.064+0000 7f66e9e9f640 1 -- 172.21.15.142:0/2089914608 <== osd.1 v2:172.21.15.142:6816/3192108003 22 ==== watch-notify(notify (1) cookie 94642878826304 notify 137438953501 ret 0) ==== 678+0+0 (crc 0 0 0) 0x7f66d4018040 con 0x5613c32b8600 2024-09-22T08:38:31.071 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.064+0000 7f65cdffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953501 cookie 94642878826304 notifier 4905 bl.length()=636 2024-09-22T08:38:31.071 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.064+0000 7f65cdffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-22T08:38:31.071 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.064+0000 7f65cdffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-22T08:38:31.072 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.064+0000 7f65cdffb640 1 -- 172.21.15.142:0/2089914608 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f65b0003ea0 con 0x5613c32b8600 2024-09-22T08:38:31.072 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.064+0000 7f66e9e9f640 1 -- 172.21.15.142:0/2089914608 <== osd.1 v2:172.21.15.142:6816/3192108003 23 ==== osd_op_reply(64 notify.4 [notify cookie 94642879094032 out=8b] v0'0 uv273 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f66d403b040 con 0x5613c32b8600 2024-09-22T08:38:31.072 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.064+0000 7f66e9e9f640 1 -- 172.21.15.142:0/2089914608 <== osd.1 v2:172.21.15.142:6816/3192108003 24 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f66d403b040 con 0x5613c32b8600 2024-09-22T08:38:31.072 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.064+0000 7f66e9e9f640 1 -- 172.21.15.142:0/2089914608 <== osd.1 v2:172.21.15.142:6816/3192108003 25 ==== watch-notify(notify_complete (2) cookie 94642879094032 notify 137438953501 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f66d401d810 con 0x5613c32b8600 2024-09-22T08:38:31.072 INFO:teuthology.orchestra.run.smithi142.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-22T08:38:29.459914Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-22T08:38:29.459903Z","tags":[],"group_ids":[]} 2024-09-22T08:38:31.074 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.065+0000 7f65a0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:38:31.074 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.065+0000 7f66ecbaf800 1 -- 172.21.15.142:0/2089914608 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94642878845808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5613c32fd8e0 con 0x5613c32b8600 2024-09-22T08:38:31.074 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.066+0000 7f66e9e9f640 1 -- 172.21.15.142:0/2089914608 <== osd.1 v2:172.21.15.142:6816/3192108003 26 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94642878845808] v32'269 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f66d403b040 con 0x5613c32b8600 2024-09-22T08:38:31.074 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.066+0000 7f66ecbaf800 1 -- 172.21.15.142:0/2089914608 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94642878818976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5613c32fd8e0 con 0x7f66e4033070 2024-09-22T08:38:31.074 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.067+0000 7f66ea6a0640 1 -- 172.21.15.142:0/2089914608 <== osd.2 v2:172.21.15.142:6808/279438927 11 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94642878818976] v32'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f66dc083050 con 0x7f66e4033070 2024-09-22T08:38:31.075 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.067+0000 7f66ecbaf800 20 remove_watcher() i=0 2024-09-22T08:38:31.075 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.067+0000 7f66ecbaf800 2 removed watcher, disabling cache 2024-09-22T08:38:31.075 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.067+0000 7f66ecbaf800 1 -- 172.21.15.142:0/2089914608 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94642878821232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5613c32fd8e0 con 0x5613c32b8600 2024-09-22T08:38:31.075 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.069+0000 7f66e9e9f640 1 -- 172.21.15.142:0/2089914608 <== osd.1 v2:172.21.15.142:6816/3192108003 27 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94642878821232] v32'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f66d403b040 con 0x5613c32b8600 2024-09-22T08:38:31.075 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.069+0000 7f66ecbaf800 20 remove_watcher() i=1 2024-09-22T08:38:31.075 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.069+0000 7f66ecbaf800 1 -- 172.21.15.142:0/2089914608 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94642878829184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5613c32fd8e0 con 0x5613c32bcff0 2024-09-22T08:38:31.075 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.070+0000 7f66eaea1640 1 -- 172.21.15.142:0/2089914608 <== osd.3 v2:172.21.15.142:6800/1064901393 16 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94642878829184] v32'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f66e40083e0 con 0x5613c32bcff0 2024-09-22T08:38:31.075 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.070+0000 7f66ecbaf800 20 remove_watcher() i=2 2024-09-22T08:38:31.075 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.070+0000 7f66ecbaf800 1 -- 172.21.15.142:0/2089914608 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94642878831984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5613c32fd8e0 con 0x7f66e4033070 2024-09-22T08:38:31.075 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.071+0000 7f66ea6a0640 1 -- 172.21.15.142:0/2089914608 <== osd.2 v2:172.21.15.142:6808/279438927 12 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94642878831984] v32'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f66dc083050 con 0x7f66e4033070 2024-09-22T08:38:31.075 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.071+0000 7f66ecbaf800 20 remove_watcher() i=3 2024-09-22T08:38:31.075 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.071+0000 7f66ecbaf800 1 -- 172.21.15.142:0/2089914608 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94642878826304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5613c32fd8e0 con 0x5613c32b8600 2024-09-22T08:38:31.075 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.072+0000 7f66e9e9f640 1 -- 172.21.15.142:0/2089914608 <== osd.1 v2:172.21.15.142:6816/3192108003 28 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94642878826304] v32'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f66d403b040 con 0x5613c32b8600 2024-09-22T08:38:31.075 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.072+0000 7f66ecbaf800 20 remove_watcher() i=4 2024-09-22T08:38:31.076 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.072+0000 7f66ecbaf800 1 -- 172.21.15.142:0/2089914608 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94642878838336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5613c32fd8e0 con 0x7f66dc076060 2024-09-22T08:38:31.076 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.073+0000 7f66e9e9f640 1 -- 172.21.15.142:0/2089914608 <== osd.0 v2:172.21.15.31:6800/168281188 18 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94642878838336] v32'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f66d403b040 con 0x7f66dc076060 2024-09-22T08:38:31.076 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.073+0000 7f66ecbaf800 20 remove_watcher() i=5 2024-09-22T08:38:31.076 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.073+0000 7f66ecbaf800 1 -- 172.21.15.142:0/2089914608 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94642878835600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5613c32fd8e0 con 0x7f66dc076060 2024-09-22T08:38:31.079 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.074+0000 7f66e9e9f640 1 -- 172.21.15.142:0/2089914608 <== osd.0 v2:172.21.15.31:6800/168281188 19 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94642878835600] v32'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f66d403b040 con 0x7f66dc076060 2024-09-22T08:38:31.079 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.074+0000 7f66ecbaf800 20 remove_watcher() i=6 2024-09-22T08:38:31.079 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.074+0000 7f66ecbaf800 1 -- 172.21.15.142:0/2089914608 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94642878843136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5613c32fd8e0 con 0x7f66dc076060 2024-09-22T08:38:31.079 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.075+0000 7f66e9e9f640 1 -- 172.21.15.142:0/2089914608 <== osd.0 v2:172.21.15.31:6800/168281188 20 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94642878843136] v32'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f66d403b040 con 0x7f66dc076060 2024-09-22T08:38:31.079 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.075+0000 7f66ecbaf800 20 remove_watcher() i=7 2024-09-22T08:38:31.079 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.075+0000 7f66ecbaf800 1 -- 172.21.15.142:0/2089914608 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f66dc076060 msgr2=0x7f66dc0753b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:31.079 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.075+0000 7f66ecbaf800 1 --2- 172.21.15.142:0/2089914608 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f66dc076060 0x7f66dc0753b0 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:31.079 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.075+0000 7f66ecbaf800 1 -- 172.21.15.142:0/2089914608 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5613c32b8600 msgr2=0x5613c32baac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:31.079 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.075+0000 7f66ecbaf800 1 --2- 172.21.15.142:0/2089914608 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5613c32b8600 0x5613c32baac0 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:31.080 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.075+0000 7f66ecbaf800 1 -- 172.21.15.142:0/2089914608 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f66e4033070 msgr2=0x7f66e4029390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:31.080 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.075+0000 7f66ecbaf800 1 --2- 172.21.15.142:0/2089914608 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f66e4033070 0x7f66e4029390 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:31.080 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.075+0000 7f66ecbaf800 1 -- 172.21.15.142:0/2089914608 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5613c32bcff0 msgr2=0x5613c32bf3e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:31.080 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.075+0000 7f66ecbaf800 1 --2- 172.21.15.142:0/2089914608 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5613c32bcff0 0x5613c32bf3e0 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:31.080 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.075+0000 7f66ecbaf800 1 -- 172.21.15.142:0/2089914608 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f65b403cfb0 msgr2=0x7f65b403f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:31.080 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.075+0000 7f66ecbaf800 1 --2- 172.21.15.142:0/2089914608 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f65b403cfb0 0x7f65b403f470 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f66dc095fd0 tx=0x7f66dc08b000 comp rx=0 tx=0).stop 2024-09-22T08:38:31.080 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.075+0000 7f66ecbaf800 1 -- 172.21.15.142:0/2089914608 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5613c32a5900 msgr2=0x5613c32ace70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:31.080 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.075+0000 7f66ecbaf800 1 --2- 172.21.15.142:0/2089914608 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5613c32a5900 0x5613c32ace70 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f66e40206f0 tx=0x7f66e40088f0 comp rx=0 tx=0).stop 2024-09-22T08:38:31.080 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.075+0000 7f66e9e9f640 1 -- 172.21.15.142:0/2089914608 reap_dead start 2024-09-22T08:38:31.080 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.075+0000 7f66e9e9f640 1 -- 172.21.15.142:0/2089914608 reap_dead start 2024-09-22T08:38:31.080 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.075+0000 7f66ecbaf800 1 -- 172.21.15.142:0/2089914608 shutdown_connections 2024-09-22T08:38:31.080 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.075+0000 7f66ecbaf800 1 -- 172.21.15.142:0/2089914608 >> 172.21.15.142:0/2089914608 conn(0x5613c32a1d00 msgr2=0x5613c329ff10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:38:31.080 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.075+0000 7f66ecbaf800 1 -- 172.21.15.142:0/2089914608 shutdown_connections 2024-09-22T08:38:31.080 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.075+0000 7f66ecbaf800 1 -- 172.21.15.142:0/2089914608 wait complete. 2024-09-22T08:38:31.080 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.076+0000 7f66ecbaf800 1 -- 172.21.15.142:0/625101904 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f65c403cfb0 msgr2=0x7f65c403f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:31.081 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.076+0000 7f66ecbaf800 1 --2- 172.21.15.142:0/625101904 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f65c403cfb0 0x7f65c403f470 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f66dc06c5b0 tx=0x7f66dc095720 comp rx=0 tx=0).stop 2024-09-22T08:38:31.081 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.076+0000 7f66ecbaf800 1 -- 172.21.15.142:0/625101904 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5613c3298ea0 msgr2=0x5613c32992c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:31.081 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.076+0000 7f66ecbaf800 1 --2- 172.21.15.142:0/625101904 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5613c3298ea0 0x5613c32992c0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x5613c327ef20 tx=0x7f66e400bf30 comp rx=0 tx=0).stop 2024-09-22T08:38:31.081 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.076+0000 7f66ecbaf800 1 -- 172.21.15.142:0/625101904 shutdown_connections 2024-09-22T08:38:31.081 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.076+0000 7f66ecbaf800 1 --2- 172.21.15.142:0/625101904 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f65c403cfb0 0x7f65c403f470 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:31.081 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.076+0000 7f66ecbaf800 1 --2- 172.21.15.142:0/625101904 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5613c3298ea0 0x5613c32992c0 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:31.081 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.076+0000 7f66ecbaf800 1 -- 172.21.15.142:0/625101904 >> 172.21.15.142:0/625101904 conn(0x5613c328d250 msgr2=0x5613c328d630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:38:31.081 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.076+0000 7f66ecbaf800 1 -- 172.21.15.142:0/625101904 shutdown_connections 2024-09-22T08:38:31.081 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.076+0000 7f66ecbaf800 1 -- 172.21.15.142:0/625101904 wait complete. 2024-09-22T08:38:31.081 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.076+0000 7f66ecbaf800 1 -- 172.21.15.142:0/1451547613 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5613c30f65b0 msgr2=0x5613c3285570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:31.081 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.076+0000 7f66ecbaf800 1 --2- 172.21.15.142:0/1451547613 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5613c30f65b0 0x5613c3285570 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:31.081 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.076+0000 7f66ecbaf800 1 -- 172.21.15.142:0/1451547613 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5613c3287a40 msgr2=0x5613c3289e30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:31.081 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.076+0000 7f66ecbaf800 1 --2- 172.21.15.142:0/1451547613 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5613c3287a40 0x5613c3289e30 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:31.081 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.076+0000 7f66ecbaf800 1 -- 172.21.15.142:0/1451547613 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f65d003d000 msgr2=0x7f65d003f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:31.081 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.076+0000 7f66ecbaf800 1 --2- 172.21.15.142:0/1451547613 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f65d003d000 0x7f65d003f4c0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f66d4000c00 tx=0x7f66d40013b0 comp rx=0 tx=0).stop 2024-09-22T08:38:31.082 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.076+0000 7f66ecbaf800 1 -- 172.21.15.142:0/1451547613 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5613c30f50d0 msgr2=0x5613c327df20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:31.082 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.076+0000 7f66ecbaf800 1 --2- 172.21.15.142:0/1451547613 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5613c30f50d0 0x5613c327df20 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f66dc066040 tx=0x7f66dc003330 comp rx=0 tx=0).stop 2024-09-22T08:38:31.082 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.076+0000 7f66ecbaf800 1 -- 172.21.15.142:0/1451547613 shutdown_connections 2024-09-22T08:38:31.082 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.076+0000 7f66ecbaf800 1 --2- 172.21.15.142:0/1451547613 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5613c3287a40 0x5613c3289e30 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:31.082 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.076+0000 7f66ecbaf800 1 --2- 172.21.15.142:0/1451547613 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5613c30f65b0 0x5613c3285570 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:31.082 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.076+0000 7f66ecbaf800 1 --2- 172.21.15.142:0/1451547613 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f65d003d000 0x7f65d003f4c0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:31.082 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.076+0000 7f66ecbaf800 1 --2- 172.21.15.142:0/1451547613 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5613c30f50d0 0x5613c327df20 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:31.082 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.076+0000 7f66ecbaf800 1 -- 172.21.15.142:0/1451547613 >> 172.21.15.142:0/1451547613 conn(0x5613c317bdb0 msgr2=0x5613c32778a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:38:31.082 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.076+0000 7f66ecbaf800 1 -- 172.21.15.142:0/1451547613 shutdown_connections 2024-09-22T08:38:31.082 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.076+0000 7f66ecbaf800 1 -- 172.21.15.142:0/1451547613 wait complete. 2024-09-22T08:38:31.086 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-22T08:38:29.459914Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-22T08:38:29.459903Z', 'tags': [], 'group_ids': []} 2024-09-22T08:38:31.086 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-22T08:38:29.459914Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-22T08:38:29.459903Z', 'tags': [], 'group_ids': []} 2024-09-22T08:38:31.086 ERROR:root:0 2024-09-22T08:38:31.086 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-22T08:38:31.087 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-22T08:38:31.087 DEBUG:teuthology.orchestra.run.smithi142:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps 'users=read, write' 2024-09-22T08:38:31.133 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:38:31.134 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:38:31.135 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.133+0000 7fa5cd519800 1 Processor -- start 2024-09-22T08:38:31.135 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.133+0000 7fa5cd519800 1 -- start start 2024-09-22T08:38:31.135 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.133+0000 7fa5cd519800 1 --2- >> v2:172.21.15.31:3300/0 conn(0x5561c74e3af0 0x5561c74e5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:31.135 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.133+0000 7fa5cd519800 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5561c736aa20 con 0x5561c74dffe0 2024-09-22T08:38:31.135 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.133+0000 7fa5cd519800 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x5561c736a7d0 con 0x5561c74e3af0 2024-09-22T08:38:31.135 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.133+0000 7fa5ca809640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x5561c74e3af0 0x5561c74e5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:31.135 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.133+0000 7fa5cb00a640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x5561c74dffe0 0x5561c74e23d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.142:50540/0 (socket says 172.21.15.142:50540) 2024-09-22T08:38:31.135 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.133+0000 7fa5cb00a640 1 -- 172.21.15.142:0/1866103950 learned_addr learned my addr 172.21.15.142:0/1866103950 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-09-22T08:38:31.136 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.134+0000 7fa5ca008640 1 -- 172.21.15.142:0/1866103950 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1086218604 0 0) 0x5561c736aa20 con 0x5561c74dffe0 2024-09-22T08:38:31.136 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.134+0000 7fa5ca008640 1 -- 172.21.15.142:0/1866103950 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa5b8001e10 con 0x5561c74dffe0 2024-09-22T08:38:31.136 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.134+0000 7fa5ca809640 1 -- 172.21.15.142:0/1866103950 >> v1:172.21.15.31:6789/0 conn(0x5561c74dffe0 legacy=0x5561c74e23d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:31.136 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.134+0000 7fa5ca809640 1 -- 172.21.15.142:0/1866103950 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5561c74e7570 con 0x5561c74e3af0 2024-09-22T08:38:31.136 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.136+0000 7fa5ca809640 1 --2- 172.21.15.142:0/1866103950 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5561c74e3af0 0x5561c74e5ee0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fa5b400a470 tx=0x7fa5b4045920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae6395ddde7cac3e server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:31.137 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.136+0000 7fa5ca008640 1 -- 172.21.15.142:0/1866103950 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa5b4059070 con 0x5561c74e3af0 2024-09-22T08:38:31.137 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.136+0000 7fa5ca008640 1 -- 172.21.15.142:0/1866103950 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5b4054570 con 0x5561c74e3af0 2024-09-22T08:38:31.137 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.136+0000 7fa5ca008640 1 -- 172.21.15.142:0/1866103950 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa5b4054870 con 0x5561c74e3af0 2024-09-22T08:38:31.138 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.136+0000 7fa5cd519800 1 -- 172.21.15.142:0/1866103950 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5561c74e3af0 msgr2=0x5561c74e5ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:31.138 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.136+0000 7fa5cd519800 1 --2- 172.21.15.142:0/1866103950 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5561c74e3af0 0x5561c74e5ee0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fa5b400a470 tx=0x7fa5b4045920 comp rx=0 tx=0).stop 2024-09-22T08:38:31.138 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.137+0000 7fa5cd519800 1 -- 172.21.15.142:0/1866103950 shutdown_connections 2024-09-22T08:38:31.138 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.137+0000 7fa5cd519800 1 --2- 172.21.15.142:0/1866103950 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5561c74e3af0 0x5561c74e5ee0 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:31.138 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.137+0000 7fa5cd519800 1 -- 172.21.15.142:0/1866103950 >> 172.21.15.142:0/1866103950 conn(0x5561c74d9ba0 msgr2=0x5561c74dc000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:38:31.138 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.137+0000 7fa5cd519800 1 -- 172.21.15.142:0/1866103950 shutdown_connections 2024-09-22T08:38:31.139 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.137+0000 7fa5cd519800 1 -- 172.21.15.142:0/1866103950 wait complete. 2024-09-22T08:38:31.152 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.150+0000 7fa5cd519800 1 Processor -- start 2024-09-22T08:38:31.152 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.150+0000 7fa5cd519800 1 -- start start 2024-09-22T08:38:31.152 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.151+0000 7fa5cd519800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5561c74dffe0 0x5561c75cef00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:31.152 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.151+0000 7fa5cd519800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5561c7377dd0 con 0x5561c74dffe0 2024-09-22T08:38:31.152 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.151+0000 7fa5cb00a640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5561c74dffe0 0x5561c75cef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:31.152 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.151+0000 7fa5cb00a640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5561c74dffe0 0x5561c75cef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:52224/0 (socket says 172.21.15.142:52224) 2024-09-22T08:38:31.152 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.151+0000 7fa5cb00a640 1 -- 172.21.15.142:0/2802460049 learned_addr learned my addr 172.21.15.142:0/2802460049 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:38:31.152 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.151+0000 7fa5cb00a640 1 -- 172.21.15.142:0/2802460049 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5561c75cf4f0 con 0x5561c74dffe0 2024-09-22T08:38:31.154 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.151+0000 7fa5cb00a640 1 --2- 172.21.15.142:0/2802460049 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5561c74dffe0 0x5561c75cef00 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7fa5c4001e30 tx=0x7fa5c400b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2659a25ef42731b server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:31.154 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.151+0000 7fa4b960a640 1 -- 172.21.15.142:0/2802460049 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa5c4012020 con 0x5561c74dffe0 2024-09-22T08:38:31.154 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.152+0000 7fa4b960a640 1 -- 172.21.15.142:0/2802460049 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5c400e470 con 0x5561c74dffe0 2024-09-22T08:38:31.154 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.152+0000 7fa4b960a640 1 -- 172.21.15.142:0/2802460049 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa5c400e790 con 0x5561c74dffe0 2024-09-22T08:38:31.154 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.152+0000 7fa5cd519800 1 -- 172.21.15.142:0/2802460049 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5561c74dffe0 msgr2=0x5561c75cef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:31.154 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.152+0000 7fa5cd519800 1 --2- 172.21.15.142:0/2802460049 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5561c74dffe0 0x5561c75cef00 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7fa5c4001e30 tx=0x7fa5c400b780 comp rx=0 tx=0).stop 2024-09-22T08:38:31.154 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.152+0000 7fa5cd519800 1 -- 172.21.15.142:0/2802460049 shutdown_connections 2024-09-22T08:38:31.155 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.152+0000 7fa5cd519800 1 --2- 172.21.15.142:0/2802460049 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5561c74dffe0 0x5561c75cef00 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:31.155 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.152+0000 7fa5cd519800 1 -- 172.21.15.142:0/2802460049 >> 172.21.15.142:0/2802460049 conn(0x5561c74d9ba0 msgr2=0x5561c75ca880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:38:31.155 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.152+0000 7fa5cd519800 1 -- 172.21.15.142:0/2802460049 shutdown_connections 2024-09-22T08:38:31.155 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.152+0000 7fa5cd519800 1 -- 172.21.15.142:0/2802460049 wait complete. 2024-09-22T08:38:31.155 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.153+0000 7fa5cd519800 1 Processor -- start 2024-09-22T08:38:31.155 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.153+0000 7fa5cd519800 1 -- start start 2024-09-22T08:38:31.155 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.153+0000 7fa5cd519800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5561c74dffe0 0x5561c75d6a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:31.155 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.153+0000 7fa5cd519800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5561c74e6810 con 0x5561c74dffe0 2024-09-22T08:38:31.155 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.153+0000 7fa5cb00a640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5561c74dffe0 0x5561c75d6a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:31.155 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.153+0000 7fa5cb00a640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5561c74dffe0 0x5561c75d6a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:52238/0 (socket says 172.21.15.142:52238) 2024-09-22T08:38:31.155 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.153+0000 7fa5cb00a640 1 -- 172.21.15.142:0/421099511 learned_addr learned my addr 172.21.15.142:0/421099511 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:38:31.158 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.153+0000 7fa5cb00a640 1 -- 172.21.15.142:0/421099511 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5561c75d6f70 con 0x5561c74dffe0 2024-09-22T08:38:31.158 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.153+0000 7fa5cb00a640 1 --2- 172.21.15.142:0/421099511 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5561c74dffe0 0x5561c75d6a10 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x5561c75cfe90 tx=0x7fa5c40040e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:31.158 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.154+0000 7fa4b7e07640 1 -- 172.21.15.142:0/421099511 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa5c4012030 con 0x5561c74dffe0 2024-09-22T08:38:31.158 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.154+0000 7fa4b7e07640 1 -- 172.21.15.142:0/421099511 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5c401a7a0 con 0x5561c74dffe0 2024-09-22T08:38:31.158 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.154+0000 7fa5cd519800 1 -- 172.21.15.142:0/421099511 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5561c75d7200 con 0x5561c74dffe0 2024-09-22T08:38:31.158 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.154+0000 7fa4b7e07640 1 -- 172.21.15.142:0/421099511 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa5c401aaa0 con 0x5561c74dffe0 2024-09-22T08:38:31.159 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.154+0000 7fa5cd519800 1 -- 172.21.15.142:0/421099511 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5561c75d7c00 con 0x5561c74dffe0 2024-09-22T08:38:31.159 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.155+0000 7fa4b7e07640 1 -- 172.21.15.142:0/421099511 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fa5c4015020 con 0x5561c74dffe0 2024-09-22T08:38:31.159 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.155+0000 7fa4b7e07640 1 --2- 172.21.15.142:0/421099511 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fa4b003d000 0x7fa4b003f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:31.159 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.155+0000 7fa4b7e07640 1 -- 172.21.15.142:0/421099511 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5938+0+0 (secure 0 0 0) 0x7fa5c4020070 con 0x5561c74dffe0 2024-09-22T08:38:31.159 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.155+0000 7fa5ca809640 1 --2- 172.21.15.142:0/421099511 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fa4b003d000 0x7fa4b003f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:31.159 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.155+0000 7fa5cd519800 1 --2- 172.21.15.142:0/421099511 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5561c74e3af0 0x5561c75de060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:31.159 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.155+0000 7fa5cd519800 1 -- 172.21.15.142:0/421099511 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5561c75d87f0 con 0x5561c74e3af0 2024-09-22T08:38:31.159 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.155+0000 7fa5cb80b640 1 --2- 172.21.15.142:0/421099511 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5561c74e3af0 0x5561c75de060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:31.159 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.155+0000 7fa5ca809640 1 --2- 172.21.15.142:0/421099511 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fa4b003d000 0x7fa4b003f4c0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x5561c7452960 tx=0x7fa5b4050000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:31.159 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.155+0000 7fa5cb80b640 1 --2- 172.21.15.142:0/421099511 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5561c74e3af0 0x5561c75de060 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:31.159 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.156+0000 7fa5cb80b640 1 -- 172.21.15.142:0/421099511 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa5bc00a4d0 con 0x5561c74e3af0 2024-09-22T08:38:31.159 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.156+0000 7fa5cd519800 1 -- 172.21.15.142:0/421099511 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5561c75d80e0 con 0x5561c74e3af0 2024-09-22T08:38:31.159 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.156+0000 7fa5cb80b640 1 -- 172.21.15.142:0/421099511 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa5bc00a4d0 con 0x5561c74e3af0 2024-09-22T08:38:31.160 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.156+0000 7fa5cd519800 1 --2- 172.21.15.142:0/421099511 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5561c75e0550 0x5561c75e2940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:31.160 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.156+0000 7fa5cd519800 1 -- 172.21.15.142:0/421099511 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:3 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5561c75e3010 con 0x5561c75e0550 2024-09-22T08:38:31.160 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.156+0000 7fa5cb00a640 1 --2- 172.21.15.142:0/421099511 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5561c75e0550 0x5561c75e2940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:31.160 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.156+0000 7fa5cb00a640 1 --2- 172.21.15.142:0/421099511 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5561c75e0550 0x5561c75e2940 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:31.160 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.157+0000 7fa5cb00a640 1 -- 172.21.15.142:0/421099511 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(3 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fa5c4018950 con 0x5561c75e0550 2024-09-22T08:38:31.160 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.157+0000 7fa5cd519800 1 -- 172.21.15.142:0/421099511 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5561c75df3f0 con 0x5561c74e3af0 2024-09-22T08:38:31.160 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.157+0000 7fa5cb80b640 1 -- 172.21.15.142:0/421099511 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa5bc00a4d0 con 0x5561c74e3af0 2024-09-22T08:38:31.160 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.157+0000 7fa5cd519800 1 -- 172.21.15.142:0/421099511 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5561c75df890 con 0x5561c75e0550 2024-09-22T08:38:31.160 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.157+0000 7fa5cb00a640 1 -- 172.21.15.142:0/421099511 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(5 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fa5c4018950 con 0x5561c75e0550 2024-09-22T08:38:31.165 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.157+0000 7fa5cd519800 1 Processor -- start 2024-09-22T08:38:31.165 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.158+0000 7fa5cd519800 1 -- start start 2024-09-22T08:38:31.165 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.158+0000 7fa5cd519800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5561c75f19b0 0x5561c75f1dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:31.165 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.158+0000 7fa5cd519800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5561c73d6d50 con 0x5561c75f19b0 2024-09-22T08:38:31.165 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.158+0000 7fa5cb80b640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5561c75f19b0 0x5561c75f1dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:31.165 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.158+0000 7fa5cb80b640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5561c75f19b0 0x5561c75f1dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:52244/0 (socket says 172.21.15.142:52244) 2024-09-22T08:38:31.165 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.158+0000 7fa5cb80b640 1 -- 172.21.15.142:0/898743334 learned_addr learned my addr 172.21.15.142:0/898743334 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:38:31.165 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.158+0000 7fa5cb80b640 1 -- 172.21.15.142:0/898743334 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5561c75f2410 con 0x5561c75f19b0 2024-09-22T08:38:31.166 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.159+0000 7fa5cb80b640 1 --2- 172.21.15.142:0/898743334 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5561c75f19b0 0x5561c75f1dd0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x5561c75d7dd0 tx=0x7fa5bc0167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:31.166 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.159+0000 7fa4b5602640 1 -- 172.21.15.142:0/898743334 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa5bc013640 con 0x5561c75f19b0 2024-09-22T08:38:31.166 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.159+0000 7fa4b5602640 1 -- 172.21.15.142:0/898743334 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5bc0137e0 con 0x5561c75f19b0 2024-09-22T08:38:31.166 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.159+0000 7fa5cd519800 1 -- 172.21.15.142:0/898743334 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5561c75f2c40 con 0x5561c75f19b0 2024-09-22T08:38:31.166 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.159+0000 7fa4b5602640 1 -- 172.21.15.142:0/898743334 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa5bc013ac0 con 0x5561c75f19b0 2024-09-22T08:38:31.166 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.159+0000 7fa5cd519800 1 -- 172.21.15.142:0/898743334 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5561c75f31e0 con 0x5561c75f19b0 2024-09-22T08:38:31.166 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.160+0000 7fa4b5602640 1 -- 172.21.15.142:0/898743334 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fa5bc011040 con 0x5561c75f19b0 2024-09-22T08:38:31.166 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.160+0000 7fa4b5602640 1 --2- 172.21.15.142:0/898743334 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fa4a403cfb0 0x7fa4a403f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:31.166 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.160+0000 7fa4b5602640 1 -- 172.21.15.142:0/898743334 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5938+0+0 (secure 0 0 0) 0x7fa5bc00e040 con 0x5561c75f19b0 2024-09-22T08:38:31.166 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.160+0000 7fa5cb00a640 1 --2- 172.21.15.142:0/898743334 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fa4a403cfb0 0x7fa4a403f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:31.166 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.160+0000 7fa5cd519800 1 Processor -- start 2024-09-22T08:38:31.167 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.160+0000 7fa5cd519800 1 -- start start 2024-09-22T08:38:31.167 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.160+0000 7fa5cb00a640 1 --2- 172.21.15.142:0/898743334 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fa4a403cfb0 0x7fa4a403f470 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fa5c4052c40 tx=0x7fa5c400beb0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:31.167 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.160+0000 7fa5cd519800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5561c75fe470 0x5561c75fe870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:31.167 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.160+0000 7fa5cd519800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5561c75cf920 con 0x5561c75fe470 2024-09-22T08:38:31.167 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.161+0000 7fa5cb80b640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5561c75fe470 0x5561c75fe870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:31.167 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.161+0000 7fa5cb80b640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5561c75fe470 0x5561c75fe870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:52260/0 (socket says 172.21.15.142:52260) 2024-09-22T08:38:31.167 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.161+0000 7fa5cb80b640 1 -- 172.21.15.142:0/1363306754 learned_addr learned my addr 172.21.15.142:0/1363306754 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:38:31.167 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.161+0000 7fa5cb80b640 1 -- 172.21.15.142:0/1363306754 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5561c75fee60 con 0x5561c75fe470 2024-09-22T08:38:31.167 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.161+0000 7fa5cb80b640 1 --2- 172.21.15.142:0/1363306754 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5561c75fe470 0x5561c75fe870 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fa5bc020000 tx=0x7fa5bc0204d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d54adf9e78162a97 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:31.167 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.161+0000 7fa4aeffd640 1 -- 172.21.15.142:0/1363306754 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa5bc021960 con 0x5561c75fe470 2024-09-22T08:38:31.167 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.161+0000 7fa4aeffd640 1 -- 172.21.15.142:0/1363306754 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5bc052070 con 0x5561c75fe470 2024-09-22T08:38:31.167 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.161+0000 7fa4aeffd640 1 -- 172.21.15.142:0/1363306754 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa5bc021440 con 0x5561c75fe470 2024-09-22T08:38:31.167 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.162+0000 7fa5cd519800 1 -- 172.21.15.142:0/1363306754 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5561c75fe470 msgr2=0x5561c75fe870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:31.168 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.162+0000 7fa5cd519800 1 --2- 172.21.15.142:0/1363306754 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5561c75fe470 0x5561c75fe870 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fa5bc020000 tx=0x7fa5bc0204d0 comp rx=0 tx=0).stop 2024-09-22T08:38:31.168 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.162+0000 7fa5cd519800 1 -- 172.21.15.142:0/1363306754 shutdown_connections 2024-09-22T08:38:31.168 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.162+0000 7fa5cd519800 1 --2- 172.21.15.142:0/1363306754 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5561c75fe470 0x5561c75fe870 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:31.168 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.162+0000 7fa5cd519800 1 -- 172.21.15.142:0/1363306754 >> 172.21.15.142:0/1363306754 conn(0x5561c75fa870 msgr2=0x5561c75f8ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:38:31.168 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.162+0000 7fa5cd519800 1 -- 172.21.15.142:0/1363306754 shutdown_connections 2024-09-22T08:38:31.168 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.162+0000 7fa5cd519800 1 -- 172.21.15.142:0/1363306754 wait complete. 2024-09-22T08:38:31.168 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.162+0000 7fa5cd519800 1 Processor -- start 2024-09-22T08:38:31.168 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.162+0000 7fa5cd519800 1 -- start start 2024-09-22T08:38:31.168 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.162+0000 7fa5cd519800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5561c75fe470 0x5561c7605a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:31.168 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.162+0000 7fa5cd519800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5561c75ff480 con 0x5561c75fe470 2024-09-22T08:38:31.168 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.162+0000 7fa5cb80b640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5561c75fe470 0x5561c7605a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:31.168 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.162+0000 7fa5cb80b640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5561c75fe470 0x5561c7605a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:52274/0 (socket says 172.21.15.142:52274) 2024-09-22T08:38:31.168 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.162+0000 7fa5cb80b640 1 -- 172.21.15.142:0/609811732 learned_addr learned my addr 172.21.15.142:0/609811732 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:38:31.168 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.163+0000 7fa5cb80b640 1 -- 172.21.15.142:0/609811732 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5561c7605fb0 con 0x5561c75fe470 2024-09-22T08:38:31.169 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.163+0000 7fa5cb80b640 1 --2- 172.21.15.142:0/609811732 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5561c75fe470 0x5561c7605a50 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fa5bc013fd0 tx=0x7fa5bc054840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:31.169 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.163+0000 7fa4ad7fa640 1 -- 172.21.15.142:0/609811732 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa5bc020de0 con 0x5561c75fe470 2024-09-22T08:38:31.169 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.163+0000 7fa4ad7fa640 1 -- 172.21.15.142:0/609811732 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5bc01fa90 con 0x5561c75fe470 2024-09-22T08:38:31.169 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.163+0000 7fa5cd519800 1 -- 172.21.15.142:0/609811732 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5561c7606240 con 0x5561c75fe470 2024-09-22T08:38:31.169 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.163+0000 7fa4ad7fa640 1 -- 172.21.15.142:0/609811732 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa5bc01fd90 con 0x5561c75fe470 2024-09-22T08:38:31.169 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.163+0000 7fa5cd519800 1 -- 172.21.15.142:0/609811732 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5561c7606dd0 con 0x5561c75fe470 2024-09-22T08:38:31.169 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.164+0000 7fa4ad7fa640 1 -- 172.21.15.142:0/609811732 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fa5bc01f500 con 0x5561c75fe470 2024-09-22T08:38:31.169 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.164+0000 7fa4ad7fa640 1 --2- 172.21.15.142:0/609811732 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fa49403cfb0 0x7fa49403f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:31.169 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.164+0000 7fa4ad7fa640 1 -- 172.21.15.142:0/609811732 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5938+0+0 (secure 0 0 0) 0x7fa5bc053920 con 0x5561c75fe470 2024-09-22T08:38:31.169 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.164+0000 7fa5cb00a640 1 --2- 172.21.15.142:0/609811732 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fa49403cfb0 0x7fa49403f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:31.181 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.164+0000 7fa5cb00a640 1 --2- 172.21.15.142:0/609811732 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fa49403cfb0 0x7fa49403f470 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fa5c4018c60 tx=0x7fa5c404f000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:31.181 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.164+0000 7fa5cd519800 20 rados->read ofs=0 len=0 2024-09-22T08:38:31.181 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.164+0000 7fa5cd519800 1 --2- 172.21.15.142:0/609811732 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5561c76113a0 0x5561c7613860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:31.181 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.164+0000 7fa5cd519800 1 -- 172.21.15.142:0/609811732 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5561c7613fb0 con 0x5561c76113a0 2024-09-22T08:38:31.181 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.165+0000 7fa5ca809640 1 --2- 172.21.15.142:0/609811732 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5561c76113a0 0x5561c7613860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:31.181 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.165+0000 7fa5ca809640 1 --2- 172.21.15.142:0/609811732 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5561c76113a0 0x5561c7613860 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:31.181 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.165+0000 7fa5ca809640 1 -- 172.21.15.142:0/609811732 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa5b4061430 con 0x5561c76113a0 2024-09-22T08:38:31.182 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.165+0000 7fa5cd519800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:31.182 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.165+0000 7fa5cd519800 20 realm 2024-09-22T08:38:31.182 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.165+0000 7fa5cd519800 20 rados->read ofs=0 len=0 2024-09-22T08:38:31.182 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.165+0000 7fa5cd519800 1 -- 172.21.15.142:0/609811732 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5561c7614380 con 0x5561c76113a0 2024-09-22T08:38:31.182 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.165+0000 7fa5ca809640 1 -- 172.21.15.142:0/609811732 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa5b4061430 con 0x5561c76113a0 2024-09-22T08:38:31.182 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.165+0000 7fa5cd519800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:31.182 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.165+0000 7fa5cd519800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:38:31.182 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.165+0000 7fa5cd519800 20 rados->read ofs=0 len=0 2024-09-22T08:38:31.182 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.165+0000 7fa5cd519800 1 -- 172.21.15.142:0/609811732 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5561c7614c50 con 0x5561c76113a0 2024-09-22T08:38:31.182 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.166+0000 7fa5ca809640 1 -- 172.21.15.142:0/609811732 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa5b4061430 con 0x5561c76113a0 2024-09-22T08:38:31.182 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.166+0000 7fa5cd519800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:31.183 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.166+0000 7fa5cd519800 20 rados->read ofs=0 len=0 2024-09-22T08:38:31.183 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.166+0000 7fa5cd519800 1 -- 172.21.15.142:0/609811732 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5561c7614ff0 con 0x5561c76113a0 2024-09-22T08:38:31.183 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.166+0000 7fa5ca809640 1 -- 172.21.15.142:0/609811732 <== osd.1 v2:172.21.15.142:6816/3192108003 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa5b4061430 con 0x5561c76113a0 2024-09-22T08:38:31.183 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.166+0000 7fa5cd519800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:38:31.183 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.166+0000 7fa5cd519800 20 rados->read ofs=0 len=0 2024-09-22T08:38:31.183 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.166+0000 7fa5cd519800 1 --2- 172.21.15.142:0/609811732 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5561c7615d50 0x5561c7618140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:31.183 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.166+0000 7fa5cd519800 1 -- 172.21.15.142:0/609811732 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5561c7618700 con 0x5561c7615d50 2024-09-22T08:38:31.183 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.166+0000 7fa5cb80b640 1 --2- 172.21.15.142:0/609811732 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5561c7615d50 0x5561c7618140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:31.183 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.166+0000 7fa5cb80b640 1 --2- 172.21.15.142:0/609811732 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5561c7615d50 0x5561c7618140 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:31.183 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.166+0000 7fa5cb80b640 1 -- 172.21.15.142:0/609811732 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(5 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fa5bc00a4d0 con 0x5561c7615d50 2024-09-22T08:38:31.183 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.166+0000 7fa5cd519800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:38:31.183 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.166+0000 7fa5cd519800 20 searching for the correct realm 2024-09-22T08:38:31.183 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.166+0000 7fa5cd519800 1 -- 172.21.15.142:0/609811732 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5561c761a050 con 0x5561c7615d50 2024-09-22T08:38:31.183 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.167+0000 7fa5cb80b640 1 -- 172.21.15.142:0/609811732 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa5bc00a4d0 con 0x5561c7615d50 2024-09-22T08:38:31.184 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.167+0000 7fa5cb80b640 1 --2- 172.21.15.142:0/609811732 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7fa5bc012c00 0x7fa5bc0565a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:31.184 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.167+0000 7fa5cb80b640 1 -- 172.21.15.142:0/609811732 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5561c761a050 con 0x7fa5bc012c00 2024-09-22T08:38:31.184 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.167+0000 7fa5cb00a640 1 --2- 172.21.15.142:0/609811732 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7fa5bc012c00 0x7fa5bc0565a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:31.184 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.167+0000 7fa5cb00a640 1 --2- 172.21.15.142:0/609811732 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7fa5bc012c00 0x7fa5bc0565a0 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:31.184 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.167+0000 7fa5cb00a640 1 -- 172.21.15.142:0/609811732 <== osd.2 v2:172.21.15.142:6808/279438927 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa5c4018950 con 0x7fa5bc012c00 2024-09-22T08:38:31.184 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.167+0000 7fa5cb00a640 1 --2- 172.21.15.142:0/609811732 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7fa5c4017050 0x7fa5c4054830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:31.184 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.167+0000 7fa5cb00a640 1 -- 172.21.15.142:0/609811732 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5561c761a050 con 0x7fa5c4017050 2024-09-22T08:38:31.184 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.168+0000 7fa5ca809640 1 --2- 172.21.15.142:0/609811732 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7fa5c4017050 0x7fa5c4054830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:31.184 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.168+0000 7fa5ca809640 1 --2- 172.21.15.142:0/609811732 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7fa5c4017050 0x7fa5c4054830 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:31.184 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.168+0000 7fa5ca809640 1 -- 172.21.15.142:0/609811732 <== osd.0 v2:172.21.15.31:6800/168281188 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa5b4061430 con 0x7fa5c4017050 2024-09-22T08:38:31.184 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.168+0000 7fa5ca809640 1 -- 172.21.15.142:0/609811732 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5561c761a050 con 0x5561c76113a0 2024-09-22T08:38:31.184 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.168+0000 7fa5ca809640 1 -- 172.21.15.142:0/609811732 <== osd.1 v2:172.21.15.142:6816/3192108003 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa5b4061430 con 0x5561c76113a0 2024-09-22T08:38:31.184 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.168+0000 7fa5ca809640 1 -- 172.21.15.142:0/609811732 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5561c761a050 con 0x5561c76113a0 2024-09-22T08:38:31.184 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.169+0000 7fa5ca809640 1 -- 172.21.15.142:0/609811732 <== osd.1 v2:172.21.15.142:6816/3192108003 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa5b4061430 con 0x5561c76113a0 2024-09-22T08:38:31.185 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.169+0000 7fa5ca809640 1 -- 172.21.15.142:0/609811732 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fa5b4078040 con 0x5561c76113a0 2024-09-22T08:38:31.185 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.169+0000 7fa5ca809640 1 -- 172.21.15.142:0/609811732 <== osd.1 v2:172.21.15.142:6816/3192108003 7 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa5b4061430 con 0x5561c76113a0 2024-09-22T08:38:31.185 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.169+0000 7fa5ca809640 1 -- 172.21.15.142:0/609811732 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fa5b4078040 con 0x7fa5c4017050 2024-09-22T08:38:31.185 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.169+0000 7fa5ca809640 1 -- 172.21.15.142:0/609811732 <== osd.0 v2:172.21.15.31:6800/168281188 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa5b4061430 con 0x7fa5c4017050 2024-09-22T08:38:31.185 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.169+0000 7fa5ca809640 1 -- 172.21.15.142:0/609811732 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fa5b4078040 con 0x7fa5bc012c00 2024-09-22T08:38:31.185 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.169+0000 7fa5cb00a640 1 -- 172.21.15.142:0/609811732 <== osd.2 v2:172.21.15.142:6808/279438927 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa5c4018950 con 0x7fa5bc012c00 2024-09-22T08:38:31.185 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.169+0000 7fa5cb00a640 1 -- 172.21.15.142:0/609811732 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fa5b4078040 con 0x5561c7615d50 2024-09-22T08:38:31.185 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.170+0000 7fa5cb80b640 1 -- 172.21.15.142:0/609811732 <== osd.3 v2:172.21.15.142:6800/1064901393 3 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa5bc00a4d0 con 0x5561c7615d50 2024-09-22T08:38:31.185 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.170+0000 7fa5cb80b640 1 -- 172.21.15.142:0/609811732 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fa5b4078040 con 0x5561c76113a0 2024-09-22T08:38:31.185 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.170+0000 7fa5ca809640 1 -- 172.21.15.142:0/609811732 <== osd.1 v2:172.21.15.142:6816/3192108003 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa5b4061430 con 0x5561c76113a0 2024-09-22T08:38:31.185 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.170+0000 7fa5ca809640 1 -- 172.21.15.142:0/609811732 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fa5b4078040 con 0x7fa5c4017050 2024-09-22T08:38:31.185 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.170+0000 7fa5ca809640 1 -- 172.21.15.142:0/609811732 <== osd.0 v2:172.21.15.31:6800/168281188 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa5b4061430 con 0x7fa5c4017050 2024-09-22T08:38:31.185 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.170+0000 7fa5ca809640 1 -- 172.21.15.142:0/609811732 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fa5b4078040 con 0x5561c76113a0 2024-09-22T08:38:31.186 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.170+0000 7fa5ca809640 1 -- 172.21.15.142:0/609811732 <== osd.1 v2:172.21.15.142:6816/3192108003 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa5b4061430 con 0x5561c76113a0 2024-09-22T08:38:31.186 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.170+0000 7fa5ca809640 1 -- 172.21.15.142:0/609811732 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fa5b4078040 con 0x7fa5bc012c00 2024-09-22T08:38:31.186 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.171+0000 7fa5cb00a640 1 -- 172.21.15.142:0/609811732 <== osd.2 v2:172.21.15.142:6808/279438927 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fa5c4018950 con 0x7fa5bc012c00 2024-09-22T08:38:31.186 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.171+0000 7fa5cb00a640 1 -- 172.21.15.142:0/609811732 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fa5b4078040 con 0x5561c7615d50 2024-09-22T08:38:31.186 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.171+0000 7fa5cb80b640 1 -- 172.21.15.142:0/609811732 <== osd.3 v2:172.21.15.142:6800/1064901393 4 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa5bc00a4d0 con 0x5561c7615d50 2024-09-22T08:38:31.186 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.171+0000 7fa5cb80b640 1 -- 172.21.15.142:0/609811732 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fa5b4078040 con 0x5561c7615d50 2024-09-22T08:38:31.186 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.171+0000 7fa5cb80b640 1 -- 172.21.15.142:0/609811732 <== osd.3 v2:172.21.15.142:6800/1064901393 5 ==== osd_op_reply(20 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fa5bc00a4d0 con 0x5561c7615d50 2024-09-22T08:38:31.186 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.171+0000 7fa5cb80b640 1 -- 172.21.15.142:0/609811732 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fa5b4078040 con 0x7fa5c4017050 2024-09-22T08:38:31.186 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.171+0000 7fa5ca809640 1 -- 172.21.15.142:0/609811732 <== osd.0 v2:172.21.15.31:6800/168281188 4 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa5b4061430 con 0x7fa5c4017050 2024-09-22T08:38:31.186 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.171+0000 7fa5ca809640 1 -- 172.21.15.142:0/609811732 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fa5b4078040 con 0x5561c7615d50 2024-09-22T08:38:31.186 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.172+0000 7fa5cb80b640 1 -- 172.21.15.142:0/609811732 <== osd.3 v2:172.21.15.142:6800/1064901393 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa5bc00a4d0 con 0x5561c7615d50 2024-09-22T08:38:31.186 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.172+0000 7fa5cb80b640 1 -- 172.21.15.142:0/609811732 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fa5b4078040 con 0x5561c7615d50 2024-09-22T08:38:31.186 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.172+0000 7fa5cb80b640 1 -- 172.21.15.142:0/609811732 <== osd.3 v2:172.21.15.142:6800/1064901393 7 ==== osd_op_reply(23 [pgnls start_epoch 32 out=107b] v32'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fa5bc00a4d0 con 0x5561c7615d50 2024-09-22T08:38:31.187 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.172+0000 7fa5cb80b640 1 -- 172.21.15.142:0/609811732 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fa5b4078040 con 0x5561c76113a0 2024-09-22T08:38:31.187 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.172+0000 7fa5ca809640 1 -- 172.21.15.142:0/609811732 <== osd.1 v2:172.21.15.142:6816/3192108003 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa5b4061430 con 0x5561c76113a0 2024-09-22T08:38:31.187 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.172+0000 7fa5ca809640 1 -- 172.21.15.142:0/609811732 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fa5b4078040 con 0x5561c76113a0 2024-09-22T08:38:31.187 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.172+0000 7fa5ca809640 1 -- 172.21.15.142:0/609811732 <== osd.1 v2:172.21.15.142:6816/3192108003 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v32'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fa5b4061430 con 0x5561c76113a0 2024-09-22T08:38:31.187 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.172+0000 7fa5ca809640 1 -- 172.21.15.142:0/609811732 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fa5b4078040 con 0x7fa5c4017050 2024-09-22T08:38:31.187 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.172+0000 7fa5ca809640 1 -- 172.21.15.142:0/609811732 <== osd.0 v2:172.21.15.31:6800/168281188 5 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa5b4061430 con 0x7fa5c4017050 2024-09-22T08:38:31.187 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.172+0000 7fa5ca809640 1 -- 172.21.15.142:0/609811732 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fa5b4078040 con 0x5561c7615d50 2024-09-22T08:38:31.187 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.173+0000 7fa5cb80b640 1 -- 172.21.15.142:0/609811732 <== osd.3 v2:172.21.15.142:6800/1064901393 8 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa5bc00a4d0 con 0x5561c7615d50 2024-09-22T08:38:31.187 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.173+0000 7fa5cb80b640 1 -- 172.21.15.142:0/609811732 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fa5b4078040 con 0x7fa5bc012c00 2024-09-22T08:38:31.187 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.173+0000 7fa5cb00a640 1 -- 172.21.15.142:0/609811732 <== osd.2 v2:172.21.15.142:6808/279438927 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa5c4018950 con 0x7fa5bc012c00 2024-09-22T08:38:31.187 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.173+0000 7fa5cb00a640 1 -- 172.21.15.142:0/609811732 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fa5b4078040 con 0x5561c76113a0 2024-09-22T08:38:31.187 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.173+0000 7fa5ca809640 1 -- 172.21.15.142:0/609811732 <== osd.1 v2:172.21.15.142:6816/3192108003 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa5b4061430 con 0x5561c76113a0 2024-09-22T08:38:31.187 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.173+0000 7fa5ca809640 1 -- 172.21.15.142:0/609811732 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fa5b4078040 con 0x7fa5c4017050 2024-09-22T08:38:31.187 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.173+0000 7fa5ca809640 1 -- 172.21.15.142:0/609811732 <== osd.0 v2:172.21.15.31:6800/168281188 6 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa5b4061430 con 0x7fa5c4017050 2024-09-22T08:38:31.188 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.173+0000 7fa5ca809640 1 -- 172.21.15.142:0/609811732 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fa5b4078040 con 0x5561c7615d50 2024-09-22T08:38:31.188 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.174+0000 7fa5cb80b640 1 -- 172.21.15.142:0/609811732 <== osd.3 v2:172.21.15.142:6800/1064901393 9 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa5bc00a4d0 con 0x5561c7615d50 2024-09-22T08:38:31.188 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.174+0000 7fa5cb80b640 1 -- 172.21.15.142:0/609811732 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fa5b4078040 con 0x7fa5c4017050 2024-09-22T08:38:31.188 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.174+0000 7fa5ca809640 1 -- 172.21.15.142:0/609811732 <== osd.0 v2:172.21.15.31:6800/168281188 7 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa5b4061430 con 0x7fa5c4017050 2024-09-22T08:38:31.188 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.174+0000 7fa5ca809640 1 -- 172.21.15.142:0/609811732 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fa5b4078040 con 0x7fa5bc012c00 2024-09-22T08:38:31.188 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.174+0000 7fa5cb00a640 1 -- 172.21.15.142:0/609811732 <== osd.2 v2:172.21.15.142:6808/279438927 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa5c4018950 con 0x7fa5bc012c00 2024-09-22T08:38:31.188 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.174+0000 7fa5cb00a640 1 -- 172.21.15.142:0/609811732 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fa5b4078040 con 0x5561c7615d50 2024-09-22T08:38:31.188 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.174+0000 7fa5cb80b640 1 -- 172.21.15.142:0/609811732 <== osd.3 v2:172.21.15.142:6800/1064901393 10 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa5bc00a4d0 con 0x5561c7615d50 2024-09-22T08:38:31.188 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.174+0000 7fa5cb80b640 1 -- 172.21.15.142:0/609811732 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fa5b4078040 con 0x7fa5c4017050 2024-09-22T08:38:31.188 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.175+0000 7fa5ca809640 1 -- 172.21.15.142:0/609811732 <== osd.0 v2:172.21.15.31:6800/168281188 8 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa5b4061430 con 0x7fa5c4017050 2024-09-22T08:38:31.188 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.175+0000 7fa5ca809640 1 -- 172.21.15.142:0/609811732 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fa5b4078040 con 0x5561c76113a0 2024-09-22T08:38:31.188 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.175+0000 7fa5ca809640 1 -- 172.21.15.142:0/609811732 <== osd.1 v2:172.21.15.142:6816/3192108003 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v32'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fa5b4061430 con 0x5561c76113a0 2024-09-22T08:38:31.188 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.175+0000 7fa5ca809640 1 -- 172.21.15.142:0/609811732 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fa5b4078040 con 0x7fa5bc012c00 2024-09-22T08:38:31.189 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.175+0000 7fa5cb00a640 1 -- 172.21.15.142:0/609811732 <== osd.2 v2:172.21.15.142:6808/279438927 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa5c4018950 con 0x7fa5bc012c00 2024-09-22T08:38:31.189 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.175+0000 7fa5cd519800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:38:31.189 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.175+0000 7fa5cd519800 20 RGWRados::pool_iterate: got zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec 2024-09-22T08:38:31.189 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.175+0000 7fa5cd519800 20 RGWRados::pool_iterate: got zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f 2024-09-22T08:38:31.189 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.175+0000 7fa5cd519800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:38:31.189 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.175+0000 7fa5cd519800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:38:31.189 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.175+0000 7fa5cd519800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:38:31.189 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.175+0000 7fa5cd519800 20 rados->read ofs=0 len=0 2024-09-22T08:38:31.189 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.175+0000 7fa5cd519800 1 -- 172.21.15.142:0/609811732 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5561c76190c0 con 0x5561c76113a0 2024-09-22T08:38:31.189 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.175+0000 7fa5ca809640 1 -- 172.21.15.142:0/609811732 <== osd.1 v2:172.21.15.142:6816/3192108003 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa5b4061430 con 0x5561c76113a0 2024-09-22T08:38:31.189 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.175+0000 7fa5cd519800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:31.189 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.175+0000 7fa5cd519800 20 rados->read ofs=0 len=0 2024-09-22T08:38:31.189 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.175+0000 7fa5cd519800 1 -- 172.21.15.142:0/609811732 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5561c7619960 con 0x5561c76113a0 2024-09-22T08:38:31.189 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.176+0000 7fa5ca809640 1 -- 172.21.15.142:0/609811732 <== osd.1 v2:172.21.15.142:6816/3192108003 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa5b4061430 con 0x5561c76113a0 2024-09-22T08:38:31.190 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.176+0000 7fa5cd519800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:38:31.190 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.176+0000 7fa5cd519800 20 rados->read ofs=0 len=0 2024-09-22T08:38:31.190 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.176+0000 7fa5cd519800 1 -- 172.21.15.142:0/609811732 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:40 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5561c761a4d0 con 0x5561c7615d50 2024-09-22T08:38:31.190 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.176+0000 7fa5cb80b640 1 -- 172.21.15.142:0/609811732 <== osd.3 v2:172.21.15.142:6800/1064901393 11 ==== osd_op_reply(40 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fa5bc00a4d0 con 0x5561c7615d50 2024-09-22T08:38:31.190 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.176+0000 7fa5cd519800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:38:31.190 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.176+0000 7fa5cd519800 20 zone default found 2024-09-22T08:38:31.190 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.176+0000 7fa5cd519800 4 Realm: () 2024-09-22T08:38:31.190 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.176+0000 7fa5cd519800 4 ZoneGroup: default (d89f6f57-1007-47dd-9065-f486c7b01aec) 2024-09-22T08:38:31.190 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.176+0000 7fa5cd519800 4 Zone: default (e239248c-0bee-4e41-803a-24b288d3eb8f) 2024-09-22T08:38:31.190 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.176+0000 7fa5cd519800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:38:31.190 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.176+0000 7fa5cd519800 20 zonegroup default 2024-09-22T08:38:31.190 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.176+0000 7fa5cd519800 20 rados->read ofs=0 len=0 2024-09-22T08:38:31.190 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.176+0000 7fa5cd519800 1 -- 172.21.15.142:0/609811732 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5561c761a8d0 con 0x7fa5c4017050 2024-09-22T08:38:31.191 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.176+0000 7fa5ca809640 1 -- 172.21.15.142:0/609811732 <== osd.0 v2:172.21.15.31:6800/168281188 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fa5b4061430 con 0x7fa5c4017050 2024-09-22T08:38:31.191 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.176+0000 7fa5cd519800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:31.191 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.176+0000 7fa5cd519800 20 rados->read ofs=0 len=0 2024-09-22T08:38:31.191 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.176+0000 7fa5cd519800 1 -- 172.21.15.142:0/609811732 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5561c761c700 con 0x5561c7615d50 2024-09-22T08:38:31.191 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.177+0000 7fa5cb80b640 1 -- 172.21.15.142:0/609811732 <== osd.3 v2:172.21.15.142:6800/1064901393 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa5bc00a4d0 con 0x5561c7615d50 2024-09-22T08:38:31.191 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.177+0000 7fa5cd519800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:31.191 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.177+0000 7fa5cd519800 20 rados->read ofs=0 len=0 2024-09-22T08:38:31.191 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.177+0000 7fa5cd519800 1 -- 172.21.15.142:0/609811732 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5561c761cb50 con 0x5561c7615d50 2024-09-22T08:38:31.191 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.177+0000 7fa5cb80b640 1 -- 172.21.15.142:0/609811732 <== osd.3 v2:172.21.15.142:6800/1064901393 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa5bc00a4d0 con 0x5561c7615d50 2024-09-22T08:38:31.191 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.177+0000 7fa5cd519800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:31.191 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.177+0000 7fa5cd519800 20 started sync module instance, tier type = 2024-09-22T08:38:31.191 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.177+0000 7fa5cd519800 20 started zone id=e239248c-0bee-4e41-803a-24b288d3eb8f (name=default) with tier type = 2024-09-22T08:38:31.191 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.177+0000 7fa5cd519800 1 -- 172.21.15.142:0/609811732 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561c761bba0 con 0x7fa5bc012c00 2024-09-22T08:38:31.191 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.178+0000 7fa5cb00a640 1 -- 172.21.15.142:0/609811732 <== osd.2 v2:172.21.15.142:6808/279438927 7 ==== osd_op_reply(44 notify.0 [create] v32'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa5c4018950 con 0x7fa5bc012c00 2024-09-22T08:38:31.192 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.178+0000 7fa5cd519800 1 -- 172.21.15.142:0/609811732 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93878445260688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561c761b800 con 0x7fa5bc012c00 2024-09-22T08:38:31.192 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.178+0000 7fa5cd519800 1 -- 172.21.15.142:0/609811732 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561c761da80 con 0x5561c76113a0 2024-09-22T08:38:31.192 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.179+0000 7fa5cb00a640 1 -- 172.21.15.142:0/609811732 <== osd.2 v2:172.21.15.142:6808/279438927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93878445260688] v32'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa5c4018950 con 0x7fa5bc012c00 2024-09-22T08:38:31.192 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.179+0000 7fa5ca809640 1 -- 172.21.15.142:0/609811732 <== osd.1 v2:172.21.15.142:6816/3192108003 16 ==== osd_op_reply(46 notify.1 [create] v32'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa5b4061430 con 0x5561c76113a0 2024-09-22T08:38:31.192 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.179+0000 7fa5cd519800 1 -- 172.21.15.142:0/609811732 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93878445266384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561c761dea0 con 0x5561c76113a0 2024-09-22T08:38:31.192 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.179+0000 7fa5cd519800 1 -- 172.21.15.142:0/609811732 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561c761e860 con 0x5561c7615d50 2024-09-22T08:38:31.197 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.180+0000 7fa5ca809640 1 -- 172.21.15.142:0/609811732 <== osd.1 v2:172.21.15.142:6816/3192108003 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93878445266384] v32'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa5b4061430 con 0x5561c76113a0 2024-09-22T08:38:31.197 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.180+0000 7fa5cb80b640 1 -- 172.21.15.142:0/609811732 <== osd.3 v2:172.21.15.142:6800/1064901393 14 ==== osd_op_reply(48 notify.2 [create] v32'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa5bc00a4d0 con 0x5561c7615d50 2024-09-22T08:38:31.197 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.181+0000 7fa5cd519800 1 -- 172.21.15.142:0/609811732 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93878445267920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561c761e860 con 0x5561c7615d50 2024-09-22T08:38:31.197 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.181+0000 7fa5cd519800 1 -- 172.21.15.142:0/609811732 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561c761f280 con 0x7fa5bc012c00 2024-09-22T08:38:31.197 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.182+0000 7fa5cb00a640 1 -- 172.21.15.142:0/609811732 <== osd.2 v2:172.21.15.142:6808/279438927 9 ==== osd_op_reply(50 notify.3 [create] v32'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa5c4018950 con 0x7fa5bc012c00 2024-09-22T08:38:31.197 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.182+0000 7fa5cb80b640 1 -- 172.21.15.142:0/609811732 <== osd.3 v2:172.21.15.142:6800/1064901393 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 93878445267920] v32'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa5bc00a4d0 con 0x5561c7615d50 2024-09-22T08:38:31.197 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.182+0000 7fa5cd519800 1 -- 172.21.15.142:0/609811732 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93878445269936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561c761e7d0 con 0x7fa5bc012c00 2024-09-22T08:38:31.197 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.182+0000 7fa5cd519800 1 -- 172.21.15.142:0/609811732 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561c7620170 con 0x5561c76113a0 2024-09-22T08:38:31.197 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.183+0000 7fa5cb00a640 1 -- 172.21.15.142:0/609811732 <== osd.2 v2:172.21.15.142:6808/279438927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93878445269936] v32'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa5c4018950 con 0x7fa5bc012c00 2024-09-22T08:38:31.197 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.183+0000 7fa5ca809640 1 -- 172.21.15.142:0/609811732 <== osd.1 v2:172.21.15.142:6816/3192108003 18 ==== osd_op_reply(52 notify.4 [create] v32'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa5b4061430 con 0x5561c76113a0 2024-09-22T08:38:31.197 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.183+0000 7fa5cd519800 1 -- 172.21.15.142:0/609811732 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93878445276352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561c7620590 con 0x5561c76113a0 2024-09-22T08:38:31.198 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.183+0000 7fa5cd519800 1 -- 172.21.15.142:0/609811732 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561c7620f50 con 0x7fa5c4017050 2024-09-22T08:38:31.198 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.184+0000 7fa5ca809640 1 -- 172.21.15.142:0/609811732 <== osd.0 v2:172.21.15.31:6800/168281188 10 ==== osd_op_reply(54 notify.5 [create] v32'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa5b4061430 con 0x7fa5c4017050 2024-09-22T08:38:31.198 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.184+0000 7fa5cd519800 1 -- 172.21.15.142:0/609811732 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93878445279904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561c7621370 con 0x7fa5c4017050 2024-09-22T08:38:31.198 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.184+0000 7fa5cd519800 1 -- 172.21.15.142:0/609811732 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561c7621e70 con 0x7fa5c4017050 2024-09-22T08:38:31.198 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.184+0000 7fa5ca809640 1 -- 172.21.15.142:0/609811732 <== osd.1 v2:172.21.15.142:6816/3192108003 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93878445276352] v32'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa5b4061430 con 0x5561c76113a0 2024-09-22T08:38:31.198 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.185+0000 7fa5ca809640 1 -- 172.21.15.142:0/609811732 <== osd.0 v2:172.21.15.31:6800/168281188 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 93878445279904] v32'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa5b4061430 con 0x7fa5c4017050 2024-09-22T08:38:31.198 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.185+0000 7fa5ca809640 1 -- 172.21.15.142:0/609811732 <== osd.0 v2:172.21.15.31:6800/168281188 12 ==== osd_op_reply(56 notify.6 [create] v32'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa5b4061430 con 0x7fa5c4017050 2024-09-22T08:38:31.198 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.185+0000 7fa5cd519800 1 -- 172.21.15.142:0/609811732 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93878445277408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561c7621370 con 0x7fa5c4017050 2024-09-22T08:38:31.198 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.185+0000 7fa5cd519800 1 -- 172.21.15.142:0/609811732 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561c7622320 con 0x7fa5c4017050 2024-09-22T08:38:31.198 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.188+0000 7fa5ca809640 1 -- 172.21.15.142:0/609811732 <== osd.0 v2:172.21.15.31:6800/168281188 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 93878445277408] v32'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa5b4061430 con 0x7fa5c4017050 2024-09-22T08:38:31.198 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.188+0000 7fa5ca809640 1 -- 172.21.15.142:0/609811732 <== osd.0 v2:172.21.15.31:6800/168281188 14 ==== osd_op_reply(58 notify.7 [create] v32'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa5b4061430 con 0x7fa5c4017050 2024-09-22T08:38:31.198 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.188+0000 7fa5cd519800 1 -- 172.21.15.142:0/609811732 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93878445284912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561c7622500 con 0x7fa5c4017050 2024-09-22T08:38:31.199 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.188+0000 7fa5cd519800 20 add_watcher() i=0 2024-09-22T08:38:31.199 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.188+0000 7fa5cd519800 20 add_watcher() i=1 2024-09-22T08:38:31.199 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.188+0000 7fa5cd519800 20 add_watcher() i=2 2024-09-22T08:38:31.199 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.188+0000 7fa5cd519800 20 add_watcher() i=3 2024-09-22T08:38:31.199 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.188+0000 7fa5cd519800 20 add_watcher() i=4 2024-09-22T08:38:31.199 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.188+0000 7fa5cd519800 20 add_watcher() i=5 2024-09-22T08:38:31.199 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.188+0000 7fa5cd519800 20 add_watcher() i=6 2024-09-22T08:38:31.199 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.190+0000 7fa5ca809640 1 -- 172.21.15.142:0/609811732 <== osd.0 v2:172.21.15.31:6800/168281188 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 93878445284912] v32'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa5b4061430 con 0x7fa5c4017050 2024-09-22T08:38:31.199 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.190+0000 7fa5cd519800 20 add_watcher() i=7 2024-09-22T08:38:31.199 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.190+0000 7fa5cd519800 2 all 8 watchers are set, enabling cache 2024-09-22T08:38:31.199 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.190+0000 7fa5cd519800 1 -- 172.21.15.142:0/609811732 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5561c76258d0 con 0x5561c76113a0 2024-09-22T08:38:31.199 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.190+0000 7fa5ca809640 1 -- 172.21.15.142:0/609811732 <== osd.1 v2:172.21.15.142:6816/3192108003 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fa5b4061430 con 0x5561c76113a0 2024-09-22T08:38:31.199 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.190+0000 7fa5cd519800 1 -- 172.21.15.142:0/609811732 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93878445286384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561c7622dd0 con 0x5561c76113a0 2024-09-22T08:38:31.199 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.191+0000 7fa5ca809640 1 -- 172.21.15.142:0/609811732 <== osd.1 v2:172.21.15.142:6816/3192108003 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93878445286384] v32'270 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa5b4061430 con 0x5561c76113a0 2024-09-22T08:38:31.199 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.191+0000 7fa481fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:38:31.200 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.191+0000 7fa5cd519800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:38:31.200 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.191+0000 7fa5cd519800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:38:31.200 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.191+0000 7fa5cd519800 5 note: GC not initialized 2024-09-22T08:38:31.200 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.191+0000 7fa480fe1640 20 reqs_thread_entry: start 2024-09-22T08:38:31.200 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.191+0000 7fa5cd519800 20 init_complete bucket index max shards: 11 2024-09-22T08:38:31.200 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.192+0000 7fa5cd519800 20 Filter name: none 2024-09-22T08:38:31.200 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.192+0000 7fa3fa7fc640 20 reqs_thread_entry: start 2024-09-22T08:38:31.200 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.192+0000 7fa5cd519800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-22T08:38:31.200 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.192+0000 7fa5cd519800 20 rados->read ofs=0 len=0 2024-09-22T08:38:31.200 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.192+0000 7fa5cd519800 1 -- 172.21.15.142:0/609811732 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5561c7658b50 con 0x7fa5c4017050 2024-09-22T08:38:31.200 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.193+0000 7fa5ca809640 1 -- 172.21.15.142:0/609811732 <== osd.0 v2:172.21.15.31:6800/168281188 16 ==== osd_op_reply(62 ada [call out=48b,read 0~460 out=460b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+583 (crc 0 0 0) 0x7fa5b4061430 con 0x7fa5c4017050 2024-09-22T08:38:31.200 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.193+0000 7fa5cd519800 20 rados_obj.operate() r=0 bl.length=460 2024-09-22T08:38:31.200 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.193+0000 7fa5cd519800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-22T08:38:31.201 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.193+0000 7fa5cd519800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-22T08:38:31.201 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.193+0000 7fa5cd519800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:38:31.201 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.193+0000 7fa5cd519800 1 -- 172.21.15.142:0/609811732 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~473 in=473b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561c765f0f0 con 0x7fa5c4017050 2024-09-22T08:38:31.201 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.194+0000 7fa5ca809640 1 -- 172.21.15.142:0/609811732 <== osd.0 v2:172.21.15.31:6800/168281188 17 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~473] v32'12 uv12 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fa5b4081040 con 0x7fa5c4017050 2024-09-22T08:38:31.201 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.194+0000 7fa5cd519800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-22T08:38:31.201 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.194+0000 7fa5cd519800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-22T08:38:31.201 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.194+0000 7fa5cd519800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-22T08:38:31.201 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.194+0000 7fa5cd519800 1 -- 172.21.15.142:0/609811732 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 93878445533936 in=661b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5561c765a7b0 con 0x5561c76113a0 2024-09-22T08:38:31.201 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.194+0000 7fa5ca809640 1 -- 172.21.15.142:0/609811732 <== osd.1 v2:172.21.15.142:6816/3192108003 22 ==== watch-notify(notify (1) cookie 93878445276352 notify 137438953502 ret 0) ==== 691+0+0 (crc 0 0 0) 0x5561c74e7570 con 0x5561c76113a0 2024-09-22T08:38:31.201 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.194+0000 7fa4aeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953502 cookie 93878445276352 notifier 4912 bl.length()=649 2024-09-22T08:38:31.201 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.194+0000 7fa4aeffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-22T08:38:31.201 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.194+0000 7fa4aeffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-22T08:38:31.201 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.194+0000 7fa5ca809640 1 -- 172.21.15.142:0/609811732 <== osd.1 v2:172.21.15.142:6816/3192108003 23 ==== osd_op_reply(64 notify.4 [notify cookie 93878445533936 out=8b] v0'0 uv276 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fa5b4081040 con 0x5561c76113a0 2024-09-22T08:38:31.202 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.194+0000 7fa4aeffd640 1 -- 172.21.15.142:0/609811732 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fa490003ea0 con 0x5561c76113a0 2024-09-22T08:38:31.202 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.194+0000 7fa5ca809640 1 -- 172.21.15.142:0/609811732 <== osd.1 v2:172.21.15.142:6816/3192108003 24 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa5b4081040 con 0x5561c76113a0 2024-09-22T08:38:31.202 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.194+0000 7fa5ca809640 1 -- 172.21.15.142:0/609811732 <== osd.1 v2:172.21.15.142:6816/3192108003 25 ==== watch-notify(notify_complete (2) cookie 93878445533936 notify 137438953502 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fa5b4079770 con 0x5561c76113a0 2024-09-22T08:38:31.202 INFO:teuthology.orchestra.run.smithi142.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-22T08:38:29.459914Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"users","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-22T08:38:29.459903Z","tags":[],"group_ids":[]} 2024-09-22T08:38:31.204 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.195+0000 7fa481fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:38:31.204 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.195+0000 7fa5cd519800 1 -- 172.21.15.142:0/609811732 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93878445286384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561c765af70 con 0x5561c76113a0 2024-09-22T08:38:31.204 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.196+0000 7fa5ca809640 1 -- 172.21.15.142:0/609811732 <== osd.1 v2:172.21.15.142:6816/3192108003 26 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 93878445286384] v32'271 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa5b4081040 con 0x5561c76113a0 2024-09-22T08:38:31.204 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.196+0000 7fa5cd519800 1 -- 172.21.15.142:0/609811732 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93878445260688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561c765af70 con 0x7fa5bc012c00 2024-09-22T08:38:31.204 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.197+0000 7fa5cb00a640 1 -- 172.21.15.142:0/609811732 <== osd.2 v2:172.21.15.142:6808/279438927 11 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 93878445260688] v32'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa5c4018950 con 0x7fa5bc012c00 2024-09-22T08:38:31.204 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.197+0000 7fa5cd519800 20 remove_watcher() i=0 2024-09-22T08:38:31.204 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.197+0000 7fa5cd519800 2 removed watcher, disabling cache 2024-09-22T08:38:31.204 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.197+0000 7fa5cd519800 1 -- 172.21.15.142:0/609811732 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93878445266384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561c765af70 con 0x5561c76113a0 2024-09-22T08:38:31.205 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.199+0000 7fa5ca809640 1 -- 172.21.15.142:0/609811732 <== osd.1 v2:172.21.15.142:6816/3192108003 27 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 93878445266384] v32'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa5b4081040 con 0x5561c76113a0 2024-09-22T08:38:31.205 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.199+0000 7fa5cd519800 20 remove_watcher() i=1 2024-09-22T08:38:31.205 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.199+0000 7fa5cd519800 1 -- 172.21.15.142:0/609811732 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93878445267920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561c765af70 con 0x5561c7615d50 2024-09-22T08:38:31.205 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.200+0000 7fa5cb80b640 1 -- 172.21.15.142:0/609811732 <== osd.3 v2:172.21.15.142:6800/1064901393 16 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 93878445267920] v32'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa5bc00a4d0 con 0x5561c7615d50 2024-09-22T08:38:31.205 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.200+0000 7fa5cd519800 20 remove_watcher() i=2 2024-09-22T08:38:31.205 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.200+0000 7fa5cd519800 1 -- 172.21.15.142:0/609811732 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93878445269936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561c765af70 con 0x7fa5bc012c00 2024-09-22T08:38:31.205 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.201+0000 7fa5cb00a640 1 -- 172.21.15.142:0/609811732 <== osd.2 v2:172.21.15.142:6808/279438927 12 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 93878445269936] v32'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa5c4018950 con 0x7fa5bc012c00 2024-09-22T08:38:31.205 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.201+0000 7fa5cd519800 20 remove_watcher() i=3 2024-09-22T08:38:31.205 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.201+0000 7fa5cd519800 1 -- 172.21.15.142:0/609811732 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93878445276352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561c7656880 con 0x5561c76113a0 2024-09-22T08:38:31.205 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.202+0000 7fa5ca809640 1 -- 172.21.15.142:0/609811732 <== osd.1 v2:172.21.15.142:6816/3192108003 28 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 93878445276352] v32'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa5b4081040 con 0x5561c76113a0 2024-09-22T08:38:31.205 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.202+0000 7fa5cd519800 20 remove_watcher() i=4 2024-09-22T08:38:31.205 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.202+0000 7fa5cd519800 1 -- 172.21.15.142:0/609811732 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93878445279904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561c7656880 con 0x7fa5c4017050 2024-09-22T08:38:31.209 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.203+0000 7fa5ca809640 1 -- 172.21.15.142:0/609811732 <== osd.0 v2:172.21.15.31:6800/168281188 18 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 93878445279904] v32'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa5b4081040 con 0x7fa5c4017050 2024-09-22T08:38:31.209 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.203+0000 7fa5cd519800 20 remove_watcher() i=5 2024-09-22T08:38:31.209 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.203+0000 7fa5cd519800 1 -- 172.21.15.142:0/609811732 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93878445277408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561c7656880 con 0x7fa5c4017050 2024-09-22T08:38:31.209 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.204+0000 7fa5ca809640 1 -- 172.21.15.142:0/609811732 <== osd.0 v2:172.21.15.31:6800/168281188 19 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 93878445277408] v32'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa5b4081040 con 0x7fa5c4017050 2024-09-22T08:38:31.209 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.204+0000 7fa5cd519800 20 remove_watcher() i=6 2024-09-22T08:38:31.209 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.204+0000 7fa5cd519800 1 -- 172.21.15.142:0/609811732 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93878445284912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561c7656880 con 0x7fa5c4017050 2024-09-22T08:38:31.209 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.205+0000 7fa5ca809640 1 -- 172.21.15.142:0/609811732 <== osd.0 v2:172.21.15.31:6800/168281188 20 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 93878445284912] v32'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa5b4081040 con 0x7fa5c4017050 2024-09-22T08:38:31.209 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.205+0000 7fa5cd519800 20 remove_watcher() i=7 2024-09-22T08:38:31.209 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.205+0000 7fa5cd519800 1 -- 172.21.15.142:0/609811732 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7fa5c4017050 msgr2=0x7fa5c4054830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:31.209 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.205+0000 7fa5cd519800 1 --2- 172.21.15.142:0/609811732 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7fa5c4017050 0x7fa5c4054830 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:31.209 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.205+0000 7fa5cd519800 1 -- 172.21.15.142:0/609811732 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5561c76113a0 msgr2=0x5561c7613860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:31.209 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.205+0000 7fa5cd519800 1 --2- 172.21.15.142:0/609811732 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5561c76113a0 0x5561c7613860 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:31.209 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.205+0000 7fa5cd519800 1 -- 172.21.15.142:0/609811732 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7fa5bc012c00 msgr2=0x7fa5bc0565a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:31.210 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.205+0000 7fa5cd519800 1 --2- 172.21.15.142:0/609811732 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7fa5bc012c00 0x7fa5bc0565a0 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:31.210 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.205+0000 7fa5cd519800 1 -- 172.21.15.142:0/609811732 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5561c7615d50 msgr2=0x5561c7618140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:31.210 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.205+0000 7fa5cd519800 1 --2- 172.21.15.142:0/609811732 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5561c7615d50 0x5561c7618140 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:31.210 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.205+0000 7fa5cd519800 1 -- 172.21.15.142:0/609811732 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fa49403cfb0 msgr2=0x7fa49403f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:31.210 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.205+0000 7fa5cd519800 1 --2- 172.21.15.142:0/609811732 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fa49403cfb0 0x7fa49403f470 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fa5c4018c60 tx=0x7fa5c404f000 comp rx=0 tx=0).stop 2024-09-22T08:38:31.210 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.205+0000 7fa5cd519800 1 -- 172.21.15.142:0/609811732 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5561c75fe470 msgr2=0x5561c7605a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:31.210 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.205+0000 7fa5ca809640 1 -- 172.21.15.142:0/609811732 reap_dead start 2024-09-22T08:38:31.210 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.205+0000 7fa5cd519800 1 --2- 172.21.15.142:0/609811732 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5561c75fe470 0x5561c7605a50 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fa5bc013fd0 tx=0x7fa5bc054840 comp rx=0 tx=0).stop 2024-09-22T08:38:31.210 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.206+0000 7fa5cd519800 1 -- 172.21.15.142:0/609811732 shutdown_connections 2024-09-22T08:38:31.210 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.206+0000 7fa5cd519800 1 --2- 172.21.15.142:0/609811732 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5561c75fe470 0x5561c7605a50 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:31.210 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.206+0000 7fa5cd519800 1 -- 172.21.15.142:0/609811732 >> 172.21.15.142:0/609811732 conn(0x5561c75fa870 msgr2=0x5561c75f8a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:38:31.210 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.206+0000 7fa5cd519800 1 -- 172.21.15.142:0/609811732 shutdown_connections 2024-09-22T08:38:31.210 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.206+0000 7fa5cd519800 1 -- 172.21.15.142:0/609811732 wait complete. 2024-09-22T08:38:31.211 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.206+0000 7fa5cd519800 1 -- 172.21.15.142:0/898743334 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fa4a403cfb0 msgr2=0x7fa4a403f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:31.211 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.206+0000 7fa5cd519800 1 --2- 172.21.15.142:0/898743334 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fa4a403cfb0 0x7fa4a403f470 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fa5c4052c40 tx=0x7fa5c400beb0 comp rx=0 tx=0).stop 2024-09-22T08:38:31.211 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.206+0000 7fa5cd519800 1 -- 172.21.15.142:0/898743334 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5561c75f19b0 msgr2=0x5561c75f1dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:31.211 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.206+0000 7fa5cd519800 1 --2- 172.21.15.142:0/898743334 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5561c75f19b0 0x5561c75f1dd0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x5561c75d7dd0 tx=0x7fa5bc0167b0 comp rx=0 tx=0).stop 2024-09-22T08:38:31.211 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.206+0000 7fa5cd519800 1 -- 172.21.15.142:0/898743334 shutdown_connections 2024-09-22T08:38:31.211 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.206+0000 7fa5cd519800 1 --2- 172.21.15.142:0/898743334 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fa4a403cfb0 0x7fa4a403f470 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:31.211 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.206+0000 7fa5cd519800 1 --2- 172.21.15.142:0/898743334 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5561c75f19b0 0x5561c75f1dd0 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:31.211 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.206+0000 7fa5cd519800 1 -- 172.21.15.142:0/898743334 >> 172.21.15.142:0/898743334 conn(0x5561c75e5d60 msgr2=0x5561c75e6140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:38:31.211 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.206+0000 7fa5cd519800 1 -- 172.21.15.142:0/898743334 shutdown_connections 2024-09-22T08:38:31.211 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.206+0000 7fa5cd519800 1 -- 172.21.15.142:0/898743334 wait complete. 2024-09-22T08:38:31.211 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.206+0000 7fa5cd519800 1 -- 172.21.15.142:0/421099511 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5561c74e3af0 msgr2=0x5561c75de060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:31.211 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.206+0000 7fa5cd519800 1 --2- 172.21.15.142:0/421099511 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5561c74e3af0 0x5561c75de060 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:31.211 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.206+0000 7fa5cd519800 1 -- 172.21.15.142:0/421099511 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5561c75e0550 msgr2=0x5561c75e2940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:31.212 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.206+0000 7fa5cd519800 1 --2- 172.21.15.142:0/421099511 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5561c75e0550 0x5561c75e2940 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:31.212 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.206+0000 7fa5cd519800 1 -- 172.21.15.142:0/421099511 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fa4b003d000 msgr2=0x7fa4b003f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:31.212 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.206+0000 7fa5cd519800 1 --2- 172.21.15.142:0/421099511 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fa4b003d000 0x7fa4b003f4c0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x5561c7452960 tx=0x7fa5b4050000 comp rx=0 tx=0).stop 2024-09-22T08:38:31.212 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.206+0000 7fa5cd519800 1 -- 172.21.15.142:0/421099511 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5561c74dffe0 msgr2=0x5561c75d6a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:31.212 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.206+0000 7fa5cd519800 1 --2- 172.21.15.142:0/421099511 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5561c74dffe0 0x5561c75d6a10 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x5561c75cfe90 tx=0x7fa5c40040e0 comp rx=0 tx=0).stop 2024-09-22T08:38:31.212 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.206+0000 7fa5cd519800 1 -- 172.21.15.142:0/421099511 shutdown_connections 2024-09-22T08:38:31.212 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.206+0000 7fa5cd519800 1 --2- 172.21.15.142:0/421099511 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5561c75e0550 0x5561c75e2940 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:31.212 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.206+0000 7fa5cd519800 1 --2- 172.21.15.142:0/421099511 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5561c74e3af0 0x5561c75de060 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:31.212 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.206+0000 7fa5cd519800 1 --2- 172.21.15.142:0/421099511 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fa4b003d000 0x7fa4b003f4c0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:31.212 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.206+0000 7fa5cd519800 1 --2- 172.21.15.142:0/421099511 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5561c74dffe0 0x5561c75d6a10 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:31.212 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.206+0000 7fa5cd519800 1 -- 172.21.15.142:0/421099511 >> 172.21.15.142:0/421099511 conn(0x5561c74d9ba0 msgr2=0x5561c75d03f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:38:31.212 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.207+0000 7fa5cd519800 1 -- 172.21.15.142:0/421099511 shutdown_connections 2024-09-22T08:38:31.212 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.207+0000 7fa5cd519800 1 -- 172.21.15.142:0/421099511 wait complete. 2024-09-22T08:38:31.216 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-22T08:38:29.459914Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-22T08:38:29.459903Z', 'tags': [], 'group_ids': []} 2024-09-22T08:38:31.216 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-22T08:38:29.459914Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-22T08:38:29.459903Z', 'tags': [], 'group_ids': []} 2024-09-22T08:38:31.217 ERROR:root:0 2024-09-22T08:38:31.217 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-22T08:38:31.217 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-22T08:38:31.217 DEBUG:teuthology.orchestra.run.smithi142:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps 'users=read, write' 2024-09-22T08:38:31.263 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:38:31.263 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:38:31.265 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.263+0000 7efd3c72c800 1 Processor -- start 2024-09-22T08:38:31.265 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.263+0000 7efd3c72c800 1 -- start start 2024-09-22T08:38:31.265 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.263+0000 7efd3c72c800 1 --2- >> v2:172.21.15.31:3300/0 conn(0x5629aca46d30 0x5629acad6140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:31.265 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.263+0000 7efd3c72c800 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5629ac95ea20 con 0x5629acad67f0 2024-09-22T08:38:31.265 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.263+0000 7efd3c72c800 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x5629ac95e7d0 con 0x5629aca46d30 2024-09-22T08:38:31.265 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.263+0000 7efd3844f640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x5629aca46d30 0x5629acad6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:31.265 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.263+0000 7efd2ffff640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x5629acad67f0 0x5629acad8cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.142:50548/0 (socket says 172.21.15.142:50548) 2024-09-22T08:38:31.265 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.264+0000 7efd2ffff640 1 -- 172.21.15.142:0/3614197307 learned_addr learned my addr 172.21.15.142:0/3614197307 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-09-22T08:38:31.265 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.264+0000 7efd3844f640 1 -- 172.21.15.142:0/3614197307 >> v1:172.21.15.31:6789/0 conn(0x5629acad67f0 legacy=0x5629acad8cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:31.265 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.264+0000 7efd3844f640 1 -- 172.21.15.142:0/3614197307 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5629acadb570 con 0x5629aca46d30 2024-09-22T08:38:31.267 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.266+0000 7efd3844f640 1 --2- 172.21.15.142:0/3614197307 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5629aca46d30 0x5629acad6140 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7efd2800a470 tx=0x7efd28045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fff793bd2e2e85f9 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:31.267 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.266+0000 7efd37c4e640 1 -- 172.21.15.142:0/3614197307 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd28053570 con 0x5629aca46d30 2024-09-22T08:38:31.267 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.266+0000 7efd37c4e640 1 -- 172.21.15.142:0/3614197307 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd28058070 con 0x5629aca46d30 2024-09-22T08:38:31.268 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.266+0000 7efd37c4e640 1 -- 172.21.15.142:0/3614197307 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd28053880 con 0x5629aca46d30 2024-09-22T08:38:31.268 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.266+0000 7efd3c72c800 1 -- 172.21.15.142:0/3614197307 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5629aca46d30 msgr2=0x5629acad6140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:31.268 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.266+0000 7efd3c72c800 1 --2- 172.21.15.142:0/3614197307 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5629aca46d30 0x5629acad6140 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7efd2800a470 tx=0x7efd28045a20 comp rx=0 tx=0).stop 2024-09-22T08:38:31.268 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.266+0000 7efd3c72c800 1 -- 172.21.15.142:0/3614197307 shutdown_connections 2024-09-22T08:38:31.268 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.266+0000 7efd3c72c800 1 --2- 172.21.15.142:0/3614197307 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5629aca46d30 0x5629acad6140 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:31.268 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.266+0000 7efd3c72c800 1 -- 172.21.15.142:0/3614197307 >> 172.21.15.142:0/3614197307 conn(0x5629acacdbb0 msgr2=0x5629acad0010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:38:31.268 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.266+0000 7efd3c72c800 1 -- 172.21.15.142:0/3614197307 shutdown_connections 2024-09-22T08:38:31.268 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.266+0000 7efd3c72c800 1 -- 172.21.15.142:0/3614197307 wait complete. 2024-09-22T08:38:31.282 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.280+0000 7efd3c72c800 1 Processor -- start 2024-09-22T08:38:31.282 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.280+0000 7efd3c72c800 1 -- start start 2024-09-22T08:38:31.282 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.280+0000 7efd3c72c800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5629aca46d30 0x5629acad38a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:31.282 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.280+0000 7efd3c72c800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5629ac96bdd0 con 0x5629aca46d30 2024-09-22T08:38:31.282 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.280+0000 7efd3844f640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5629aca46d30 0x5629acad38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:31.282 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.280+0000 7efd3844f640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5629aca46d30 0x5629acad38a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:52288/0 (socket says 172.21.15.142:52288) 2024-09-22T08:38:31.282 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.280+0000 7efd3844f640 1 -- 172.21.15.142:0/2835747593 learned_addr learned my addr 172.21.15.142:0/2835747593 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:38:31.282 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.281+0000 7efd3844f640 1 -- 172.21.15.142:0/2835747593 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5629acad3e90 con 0x5629aca46d30 2024-09-22T08:38:31.282 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.281+0000 7efd3844f640 1 --2- 172.21.15.142:0/2835747593 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5629aca46d30 0x5629acad38a0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7efd28025c20 tx=0x7efd28051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fdd5bc4dbf3ae77 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:31.284 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.281+0000 7efc2660c640 1 -- 172.21.15.142:0/2835747593 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd28053a20 con 0x5629aca46d30 2024-09-22T08:38:31.284 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.281+0000 7efc2660c640 1 -- 172.21.15.142:0/2835747593 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd28063070 con 0x5629aca46d30 2024-09-22T08:38:31.284 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.281+0000 7efc2660c640 1 -- 172.21.15.142:0/2835747593 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd28053cf0 con 0x5629aca46d30 2024-09-22T08:38:31.284 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.282+0000 7efd3c72c800 1 -- 172.21.15.142:0/2835747593 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5629aca46d30 msgr2=0x5629acad38a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:31.284 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.282+0000 7efd3c72c800 1 --2- 172.21.15.142:0/2835747593 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5629aca46d30 0x5629acad38a0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7efd28025c20 tx=0x7efd28051000 comp rx=0 tx=0).stop 2024-09-22T08:38:31.284 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.282+0000 7efd3c72c800 1 -- 172.21.15.142:0/2835747593 shutdown_connections 2024-09-22T08:38:31.284 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.282+0000 7efd3c72c800 1 --2- 172.21.15.142:0/2835747593 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5629aca46d30 0x5629acad38a0 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:31.284 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.282+0000 7efd3c72c800 1 -- 172.21.15.142:0/2835747593 >> 172.21.15.142:0/2835747593 conn(0x5629acacdbb0 msgr2=0x5629acbbea20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:38:31.285 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.282+0000 7efd3c72c800 1 -- 172.21.15.142:0/2835747593 shutdown_connections 2024-09-22T08:38:31.285 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.282+0000 7efd3c72c800 1 -- 172.21.15.142:0/2835747593 wait complete. 2024-09-22T08:38:31.285 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.282+0000 7efd3c72c800 1 Processor -- start 2024-09-22T08:38:31.285 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.282+0000 7efd3c72c800 1 -- start start 2024-09-22T08:38:31.285 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.282+0000 7efd3c72c800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5629aca46d30 0x5629acbcccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:31.285 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.282+0000 7efd3c72c800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5629acada810 con 0x5629aca46d30 2024-09-22T08:38:31.285 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.282+0000 7efd3844f640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5629aca46d30 0x5629acbcccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:31.285 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.283+0000 7efd3844f640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5629aca46d30 0x5629acbcccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:52300/0 (socket says 172.21.15.142:52300) 2024-09-22T08:38:31.285 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.283+0000 7efd3844f640 1 -- 172.21.15.142:0/2493967913 learned_addr learned my addr 172.21.15.142:0/2493967913 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:38:31.285 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.283+0000 7efd3844f640 1 -- 172.21.15.142:0/2493967913 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5629acbcd220 con 0x5629aca46d30 2024-09-22T08:38:31.288 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.283+0000 7efd3844f640 1 --2- 172.21.15.142:0/2493967913 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5629aca46d30 0x5629acbcccc0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7efd28025c20 tx=0x7efd28002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:31.288 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.283+0000 7efc24e09640 1 -- 172.21.15.142:0/2493967913 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd2806c030 con 0x5629aca46d30 2024-09-22T08:38:31.288 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.283+0000 7efc24e09640 1 -- 172.21.15.142:0/2493967913 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd28068660 con 0x5629aca46d30 2024-09-22T08:38:31.288 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.283+0000 7efd3c72c800 1 -- 172.21.15.142:0/2493967913 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5629acbcd4b0 con 0x5629aca46d30 2024-09-22T08:38:31.288 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.283+0000 7efc24e09640 1 -- 172.21.15.142:0/2493967913 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd28068940 con 0x5629aca46d30 2024-09-22T08:38:31.288 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.284+0000 7efd3c72c800 1 -- 172.21.15.142:0/2493967913 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5629acbcdeb0 con 0x5629aca46d30 2024-09-22T08:38:31.288 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.284+0000 7efc24e09640 1 -- 172.21.15.142:0/2493967913 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7efd28068ae0 con 0x5629aca46d30 2024-09-22T08:38:31.288 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.285+0000 7efc24e09640 1 --2- 172.21.15.142:0/2493967913 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7efc2003cfb0 0x7efc2003f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:31.288 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.285+0000 7efc24e09640 1 -- 172.21.15.142:0/2493967913 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5938+0+0 (secure 0 0 0) 0x7efd280989f0 con 0x5629aca46d30 2024-09-22T08:38:31.288 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.285+0000 7efd2ffff640 1 --2- 172.21.15.142:0/2493967913 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7efc2003cfb0 0x7efc2003f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:31.288 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.285+0000 7efd3c72c800 1 --2- 172.21.15.142:0/2493967913 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5629acad67f0 0x5629acbd4310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:31.288 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.285+0000 7efd3c72c800 1 -- 172.21.15.142:0/2493967913 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5629acbd4850 con 0x5629acad67f0 2024-09-22T08:38:31.289 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.285+0000 7efd38c50640 1 --2- 172.21.15.142:0/2493967913 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5629acad67f0 0x5629acbd4310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:31.289 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.285+0000 7efd2ffff640 1 --2- 172.21.15.142:0/2493967913 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7efc2003cfb0 0x7efc2003f470 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7efd20001d70 tx=0x7efd200012d0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:31.289 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.285+0000 7efd38c50640 1 --2- 172.21.15.142:0/2493967913 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5629acad67f0 0x5629acbd4310 crc :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:31.289 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.285+0000 7efd38c50640 1 -- 172.21.15.142:0/2493967913 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efd3000a4d0 con 0x5629acad67f0 2024-09-22T08:38:31.289 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.285+0000 7efd3c72c800 1 -- 172.21.15.142:0/2493967913 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5629acbd4bf0 con 0x5629acad67f0 2024-09-22T08:38:31.289 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.286+0000 7efd38c50640 1 -- 172.21.15.142:0/2493967913 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7efd3000a4d0 con 0x5629acad67f0 2024-09-22T08:38:31.289 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.286+0000 7efd3c72c800 1 --2- 172.21.15.142:0/2493967913 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5629acbd66f0 0x5629acbd8b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:31.289 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.286+0000 7efd3c72c800 1 -- 172.21.15.142:0/2493967913 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:3 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5629acbd9300 con 0x5629acbd66f0 2024-09-22T08:38:31.289 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.286+0000 7efd3844f640 1 --2- 172.21.15.142:0/2493967913 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5629acbd66f0 0x5629acbd8b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:31.289 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.286+0000 7efd3844f640 1 --2- 172.21.15.142:0/2493967913 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5629acbd66f0 0x5629acbd8b70 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:31.289 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.286+0000 7efd3844f640 1 -- 172.21.15.142:0/2493967913 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(3 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7efd28051070 con 0x5629acbd66f0 2024-09-22T08:38:31.289 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.286+0000 7efd3c72c800 1 -- 172.21.15.142:0/2493967913 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5629acbd5440 con 0x5629acad67f0 2024-09-22T08:38:31.289 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.287+0000 7efd38c50640 1 -- 172.21.15.142:0/2493967913 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7efd3000a4d0 con 0x5629acad67f0 2024-09-22T08:38:31.290 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.287+0000 7efd3c72c800 1 -- 172.21.15.142:0/2493967913 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5629acbd5890 con 0x5629acbd66f0 2024-09-22T08:38:31.294 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.287+0000 7efd3844f640 1 -- 172.21.15.142:0/2493967913 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(5 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7efd28051070 con 0x5629acbd66f0 2024-09-22T08:38:31.294 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.287+0000 7efd3c72c800 1 Processor -- start 2024-09-22T08:38:31.294 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.287+0000 7efd3c72c800 1 -- start start 2024-09-22T08:38:31.294 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.287+0000 7efd3c72c800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5629acbe7ce0 0x5629acbe8100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:31.294 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.287+0000 7efd3c72c800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5629ac9cad50 con 0x5629acbe7ce0 2024-09-22T08:38:31.294 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.288+0000 7efd38c50640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5629acbe7ce0 0x5629acbe8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:31.294 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.288+0000 7efd38c50640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5629acbe7ce0 0x5629acbe8100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:52302/0 (socket says 172.21.15.142:52302) 2024-09-22T08:38:31.295 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.288+0000 7efd38c50640 1 -- 172.21.15.142:0/1018406617 learned_addr learned my addr 172.21.15.142:0/1018406617 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:38:31.295 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.288+0000 7efd38c50640 1 -- 172.21.15.142:0/1018406617 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5629acbe8740 con 0x5629acbe7ce0 2024-09-22T08:38:31.295 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.288+0000 7efd38c50640 1 --2- 172.21.15.142:0/1018406617 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5629acbe7ce0 0x5629acbe8100 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x5629acbcdcc0 tx=0x7efd300167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:31.295 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.288+0000 7efc1dffb640 1 -- 172.21.15.142:0/1018406617 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd30013640 con 0x5629acbe7ce0 2024-09-22T08:38:31.295 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.288+0000 7efc1dffb640 1 -- 172.21.15.142:0/1018406617 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd300137e0 con 0x5629acbe7ce0 2024-09-22T08:38:31.295 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.288+0000 7efd3c72c800 1 -- 172.21.15.142:0/1018406617 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5629acbe8f70 con 0x5629acbe7ce0 2024-09-22T08:38:31.295 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.288+0000 7efc1dffb640 1 -- 172.21.15.142:0/1018406617 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd30013ae0 con 0x5629acbe7ce0 2024-09-22T08:38:31.295 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.288+0000 7efd3c72c800 1 -- 172.21.15.142:0/1018406617 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5629acbe9510 con 0x5629acbe7ce0 2024-09-22T08:38:31.295 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.289+0000 7efc1dffb640 1 -- 172.21.15.142:0/1018406617 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7efd30011040 con 0x5629acbe7ce0 2024-09-22T08:38:31.295 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.289+0000 7efc1dffb640 1 --2- 172.21.15.142:0/1018406617 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7efc1003d000 0x7efc1003f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:31.295 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.289+0000 7efc1dffb640 1 -- 172.21.15.142:0/1018406617 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5938+0+0 (secure 0 0 0) 0x7efd3000e040 con 0x5629acbe7ce0 2024-09-22T08:38:31.295 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.289+0000 7efd3844f640 1 --2- 172.21.15.142:0/1018406617 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7efc1003d000 0x7efc1003f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:31.295 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.290+0000 7efd3c72c800 1 Processor -- start 2024-09-22T08:38:31.295 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.290+0000 7efd3844f640 1 --2- 172.21.15.142:0/1018406617 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7efc1003d000 0x7efc1003f4c0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7efd2806c000 tx=0x7efd2807cf90 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:31.296 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.290+0000 7efd3c72c800 1 -- start start 2024-09-22T08:38:31.296 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.290+0000 7efd3c72c800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5629acbf4740 0x5629acbf4b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:31.296 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.290+0000 7efd3c72c800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5629acad2290 con 0x5629acbf4740 2024-09-22T08:38:31.296 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.290+0000 7efd38c50640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5629acbf4740 0x5629acbf4b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:31.296 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.290+0000 7efd38c50640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5629acbf4740 0x5629acbf4b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:52304/0 (socket says 172.21.15.142:52304) 2024-09-22T08:38:31.296 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.290+0000 7efd38c50640 1 -- 172.21.15.142:0/827563517 learned_addr learned my addr 172.21.15.142:0/827563517 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:38:31.296 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.290+0000 7efd38c50640 1 -- 172.21.15.142:0/827563517 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5629acbf5130 con 0x5629acbf4740 2024-09-22T08:38:31.296 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.290+0000 7efd38c50640 1 --2- 172.21.15.142:0/827563517 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5629acbf4740 0x5629acbf4b40 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7efd30054810 tx=0x7efd300143c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3a16ab5e6477497 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:31.296 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.291+0000 7efc177fe640 1 -- 172.21.15.142:0/827563517 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd30044030 con 0x5629acbf4740 2024-09-22T08:38:31.296 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.291+0000 7efc177fe640 1 -- 172.21.15.142:0/827563517 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd30056070 con 0x5629acbf4740 2024-09-22T08:38:31.296 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.291+0000 7efc177fe640 1 -- 172.21.15.142:0/827563517 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd30021910 con 0x5629acbf4740 2024-09-22T08:38:31.296 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.291+0000 7efd3c72c800 1 -- 172.21.15.142:0/827563517 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5629acbf4740 msgr2=0x5629acbf4b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:31.296 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.291+0000 7efd3c72c800 1 --2- 172.21.15.142:0/827563517 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5629acbf4740 0x5629acbf4b40 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7efd30054810 tx=0x7efd300143c0 comp rx=0 tx=0).stop 2024-09-22T08:38:31.296 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.291+0000 7efd3c72c800 1 -- 172.21.15.142:0/827563517 shutdown_connections 2024-09-22T08:38:31.297 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.291+0000 7efd3c72c800 1 --2- 172.21.15.142:0/827563517 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5629acbf4740 0x5629acbf4b40 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:31.297 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.291+0000 7efd3c72c800 1 -- 172.21.15.142:0/827563517 >> 172.21.15.142:0/827563517 conn(0x5629acbf0b60 msgr2=0x5629acbeeda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:38:31.297 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.291+0000 7efd3c72c800 1 -- 172.21.15.142:0/827563517 shutdown_connections 2024-09-22T08:38:31.297 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.291+0000 7efd3c72c800 1 -- 172.21.15.142:0/827563517 wait complete. 2024-09-22T08:38:31.297 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.291+0000 7efd3c72c800 1 Processor -- start 2024-09-22T08:38:31.297 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.291+0000 7efd3c72c800 1 -- start start 2024-09-22T08:38:31.297 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.292+0000 7efd3c72c800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5629acbf4740 0x5629acbfbd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:31.297 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.292+0000 7efd3c72c800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5629acbf5750 con 0x5629acbf4740 2024-09-22T08:38:31.297 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.292+0000 7efd38c50640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5629acbf4740 0x5629acbfbd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:31.297 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.292+0000 7efd38c50640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5629acbf4740 0x5629acbfbd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:52320/0 (socket says 172.21.15.142:52320) 2024-09-22T08:38:31.297 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.292+0000 7efd38c50640 1 -- 172.21.15.142:0/309311818 learned_addr learned my addr 172.21.15.142:0/309311818 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:38:31.297 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.292+0000 7efd38c50640 1 -- 172.21.15.142:0/309311818 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5629acbfc290 con 0x5629acbf4740 2024-09-22T08:38:31.297 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.292+0000 7efd38c50640 1 --2- 172.21.15.142:0/309311818 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5629acbf4740 0x5629acbfbd30 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7efd3001fd40 tx=0x7efd3004e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:31.298 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.292+0000 7efc15ffb640 1 -- 172.21.15.142:0/309311818 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd30021910 con 0x5629acbf4740 2024-09-22T08:38:31.298 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.292+0000 7efc15ffb640 1 -- 172.21.15.142:0/309311818 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd30013c80 con 0x5629acbf4740 2024-09-22T08:38:31.298 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.292+0000 7efc15ffb640 1 -- 172.21.15.142:0/309311818 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd30021ab0 con 0x5629acbf4740 2024-09-22T08:38:31.298 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.292+0000 7efd3c72c800 1 -- 172.21.15.142:0/309311818 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5629acbfc520 con 0x5629acbf4740 2024-09-22T08:38:31.298 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.292+0000 7efd3c72c800 1 -- 172.21.15.142:0/309311818 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5629acbfc520 con 0x5629acbf4740 2024-09-22T08:38:31.309 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.293+0000 7efc15ffb640 1 -- 172.21.15.142:0/309311818 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7efd30045130 con 0x5629acbf4740 2024-09-22T08:38:31.309 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.293+0000 7efc15ffb640 1 --2- 172.21.15.142:0/309311818 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7efc0803cfb0 0x7efc0803f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:31.309 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.294+0000 7efc15ffb640 1 -- 172.21.15.142:0/309311818 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5938+0+0 (secure 0 0 0) 0x7efd30017450 con 0x5629acbf4740 2024-09-22T08:38:31.309 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.294+0000 7efd3844f640 1 --2- 172.21.15.142:0/309311818 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7efc0803cfb0 0x7efc0803f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:31.309 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.294+0000 7efd3844f640 1 --2- 172.21.15.142:0/309311818 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7efc0803cfb0 0x7efc0803f470 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7efd28053ca0 tx=0x7efd28088000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:31.309 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.294+0000 7efd3c72c800 20 rados->read ofs=0 len=0 2024-09-22T08:38:31.309 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.294+0000 7efd3c72c800 1 --2- 172.21.15.142:0/309311818 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5629acc07530 0x5629acc099f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:31.309 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.294+0000 7efd3c72c800 1 -- 172.21.15.142:0/309311818 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5629acc0a140 con 0x5629acc07530 2024-09-22T08:38:31.309 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.294+0000 7efd2ffff640 1 --2- 172.21.15.142:0/309311818 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5629acc07530 0x5629acc099f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:31.309 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.295+0000 7efd2ffff640 1 --2- 172.21.15.142:0/309311818 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5629acc07530 0x5629acc099f0 crc :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:31.309 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.295+0000 7efd2ffff640 1 -- 172.21.15.142:0/309311818 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efd20009050 con 0x5629acc07530 2024-09-22T08:38:31.310 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.295+0000 7efd3c72c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:31.310 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.295+0000 7efd3c72c800 20 realm 2024-09-22T08:38:31.310 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.295+0000 7efd3c72c800 20 rados->read ofs=0 len=0 2024-09-22T08:38:31.310 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.295+0000 7efd3c72c800 1 -- 172.21.15.142:0/309311818 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5629acc06880 con 0x5629acc07530 2024-09-22T08:38:31.310 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.295+0000 7efd2ffff640 1 -- 172.21.15.142:0/309311818 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efd20009050 con 0x5629acc07530 2024-09-22T08:38:31.310 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.295+0000 7efd3c72c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:31.310 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.295+0000 7efd3c72c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:38:31.310 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.295+0000 7efd3c72c800 20 rados->read ofs=0 len=0 2024-09-22T08:38:31.310 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.295+0000 7efd3c72c800 1 -- 172.21.15.142:0/309311818 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5629acc0ac30 con 0x5629acc07530 2024-09-22T08:38:31.310 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.295+0000 7efd2ffff640 1 -- 172.21.15.142:0/309311818 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efd20009050 con 0x5629acc07530 2024-09-22T08:38:31.310 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.295+0000 7efd3c72c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:31.310 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.295+0000 7efd3c72c800 20 rados->read ofs=0 len=0 2024-09-22T08:38:31.310 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.295+0000 7efd3c72c800 1 -- 172.21.15.142:0/309311818 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5629acc0b500 con 0x5629acc07530 2024-09-22T08:38:31.311 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.295+0000 7efd2ffff640 1 -- 172.21.15.142:0/309311818 <== osd.1 v2:172.21.15.142:6816/3192108003 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7efd20009050 con 0x5629acc07530 2024-09-22T08:38:31.311 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.295+0000 7efd3c72c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:38:31.311 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.295+0000 7efd3c72c800 20 rados->read ofs=0 len=0 2024-09-22T08:38:31.311 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.295+0000 7efd3c72c800 1 --2- 172.21.15.142:0/309311818 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5629acc0bf20 0x5629acc0e310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:31.311 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.296+0000 7efd3c72c800 1 -- 172.21.15.142:0/309311818 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5629acc0ea50 con 0x5629acc0bf20 2024-09-22T08:38:31.311 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.296+0000 7efd38c50640 1 --2- 172.21.15.142:0/309311818 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5629acc0bf20 0x5629acc0e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:31.311 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.296+0000 7efd38c50640 1 --2- 172.21.15.142:0/309311818 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5629acc0bf20 0x5629acc0e310 crc :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:31.311 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.296+0000 7efd38c50640 1 -- 172.21.15.142:0/309311818 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(5 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7efd30053020 con 0x5629acc0bf20 2024-09-22T08:38:31.311 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.296+0000 7efd3c72c800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:38:31.311 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.296+0000 7efd3c72c800 20 searching for the correct realm 2024-09-22T08:38:31.311 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.296+0000 7efd3c72c800 1 -- 172.21.15.142:0/309311818 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5629acc10380 con 0x5629acc0bf20 2024-09-22T08:38:31.311 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.296+0000 7efd38c50640 1 -- 172.21.15.142:0/309311818 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd30053020 con 0x5629acc0bf20 2024-09-22T08:38:31.311 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.296+0000 7efd38c50640 1 --2- 172.21.15.142:0/309311818 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7efd3004d850 0x7efd3003d000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:31.312 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.296+0000 7efd38c50640 1 -- 172.21.15.142:0/309311818 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5629acc10380 con 0x7efd3004d850 2024-09-22T08:38:31.312 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.296+0000 7efd3844f640 1 --2- 172.21.15.142:0/309311818 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7efd3004d850 0x7efd3003d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:31.312 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.297+0000 7efd3844f640 1 --2- 172.21.15.142:0/309311818 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7efd3004d850 0x7efd3003d000 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:31.312 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.297+0000 7efd3844f640 1 -- 172.21.15.142:0/309311818 <== osd.2 v2:172.21.15.142:6808/279438927 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd28051070 con 0x7efd3004d850 2024-09-22T08:38:31.312 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.297+0000 7efd3844f640 1 --2- 172.21.15.142:0/309311818 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7efd2805f040 0x7efd2805f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:38:31.312 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.297+0000 7efd3844f640 1 -- 172.21.15.142:0/309311818 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5629acc10380 con 0x7efd2805f040 2024-09-22T08:38:31.312 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.297+0000 7efd2ffff640 1 --2- 172.21.15.142:0/309311818 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7efd2805f040 0x7efd2805f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:38:31.312 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.298+0000 7efd2ffff640 1 --2- 172.21.15.142:0/309311818 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7efd2805f040 0x7efd2805f420 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:38:31.312 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.298+0000 7efd2ffff640 1 -- 172.21.15.142:0/309311818 <== osd.0 v2:172.21.15.31:6800/168281188 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd20009050 con 0x7efd2805f040 2024-09-22T08:38:31.312 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.298+0000 7efd2ffff640 1 -- 172.21.15.142:0/309311818 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5629acc10380 con 0x5629acc07530 2024-09-22T08:38:31.312 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.298+0000 7efd2ffff640 1 -- 172.21.15.142:0/309311818 <== osd.1 v2:172.21.15.142:6816/3192108003 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd20009050 con 0x5629acc07530 2024-09-22T08:38:31.312 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.298+0000 7efd2ffff640 1 -- 172.21.15.142:0/309311818 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5629acc10380 con 0x5629acc07530 2024-09-22T08:38:31.312 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.298+0000 7efd2ffff640 1 -- 172.21.15.142:0/309311818 <== osd.1 v2:172.21.15.142:6816/3192108003 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd20029040 con 0x5629acc07530 2024-09-22T08:38:31.313 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.299+0000 7efd2ffff640 1 -- 172.21.15.142:0/309311818 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5629acc10380 con 0x5629acc07530 2024-09-22T08:38:31.313 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.299+0000 7efd2ffff640 1 -- 172.21.15.142:0/309311818 <== osd.1 v2:172.21.15.142:6816/3192108003 7 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd20029040 con 0x5629acc07530 2024-09-22T08:38:31.313 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.299+0000 7efd2ffff640 1 -- 172.21.15.142:0/309311818 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5629acc10380 con 0x7efd2805f040 2024-09-22T08:38:31.313 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.299+0000 7efd2ffff640 1 -- 172.21.15.142:0/309311818 <== osd.0 v2:172.21.15.31:6800/168281188 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd20029040 con 0x7efd2805f040 2024-09-22T08:38:31.313 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.299+0000 7efd2ffff640 1 -- 172.21.15.142:0/309311818 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5629acc10380 con 0x7efd3004d850 2024-09-22T08:38:31.313 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.299+0000 7efd3844f640 1 -- 172.21.15.142:0/309311818 <== osd.2 v2:172.21.15.142:6808/279438927 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd28051070 con 0x7efd3004d850 2024-09-22T08:38:31.313 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.299+0000 7efd3844f640 1 -- 172.21.15.142:0/309311818 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5629acc10380 con 0x5629acc0bf20 2024-09-22T08:38:31.313 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.300+0000 7efd38c50640 1 -- 172.21.15.142:0/309311818 <== osd.3 v2:172.21.15.142:6800/1064901393 3 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd30053020 con 0x5629acc0bf20 2024-09-22T08:38:31.313 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.300+0000 7efd38c50640 1 -- 172.21.15.142:0/309311818 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5629acc10380 con 0x5629acc07530 2024-09-22T08:38:31.313 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.300+0000 7efd2ffff640 1 -- 172.21.15.142:0/309311818 <== osd.1 v2:172.21.15.142:6816/3192108003 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd20029040 con 0x5629acc07530 2024-09-22T08:38:31.313 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.300+0000 7efd2ffff640 1 -- 172.21.15.142:0/309311818 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5629acc10380 con 0x7efd2805f040 2024-09-22T08:38:31.313 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.300+0000 7efd2ffff640 1 -- 172.21.15.142:0/309311818 <== osd.0 v2:172.21.15.31:6800/168281188 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd20029040 con 0x7efd2805f040 2024-09-22T08:38:31.313 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.300+0000 7efd2ffff640 1 -- 172.21.15.142:0/309311818 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5629acc10380 con 0x5629acc07530 2024-09-22T08:38:31.314 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.300+0000 7efd2ffff640 1 -- 172.21.15.142:0/309311818 <== osd.1 v2:172.21.15.142:6816/3192108003 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd20029040 con 0x5629acc07530 2024-09-22T08:38:31.314 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.300+0000 7efd2ffff640 1 -- 172.21.15.142:0/309311818 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5629acc10380 con 0x7efd3004d850 2024-09-22T08:38:31.314 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.301+0000 7efd3844f640 1 -- 172.21.15.142:0/309311818 <== osd.2 v2:172.21.15.142:6808/279438927 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7efd28051070 con 0x7efd3004d850 2024-09-22T08:38:31.314 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.301+0000 7efd3844f640 1 -- 172.21.15.142:0/309311818 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5629acc10380 con 0x5629acc0bf20 2024-09-22T08:38:31.314 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.301+0000 7efd38c50640 1 -- 172.21.15.142:0/309311818 <== osd.3 v2:172.21.15.142:6800/1064901393 4 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd30053020 con 0x5629acc0bf20 2024-09-22T08:38:31.314 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.301+0000 7efd38c50640 1 -- 172.21.15.142:0/309311818 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5629acc10380 con 0x5629acc0bf20 2024-09-22T08:38:31.314 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.301+0000 7efd38c50640 1 -- 172.21.15.142:0/309311818 <== osd.3 v2:172.21.15.142:6800/1064901393 5 ==== osd_op_reply(20 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7efd30053020 con 0x5629acc0bf20 2024-09-22T08:38:31.314 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.301+0000 7efd38c50640 1 -- 172.21.15.142:0/309311818 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5629acc10380 con 0x7efd2805f040 2024-09-22T08:38:31.314 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.301+0000 7efd2ffff640 1 -- 172.21.15.142:0/309311818 <== osd.0 v2:172.21.15.31:6800/168281188 4 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd20029040 con 0x7efd2805f040 2024-09-22T08:38:31.314 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.301+0000 7efd2ffff640 1 -- 172.21.15.142:0/309311818 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5629acc10380 con 0x5629acc0bf20 2024-09-22T08:38:31.314 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.301+0000 7efd38c50640 1 -- 172.21.15.142:0/309311818 <== osd.3 v2:172.21.15.142:6800/1064901393 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd30053020 con 0x5629acc0bf20 2024-09-22T08:38:31.314 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.301+0000 7efd38c50640 1 -- 172.21.15.142:0/309311818 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5629acc10380 con 0x5629acc0bf20 2024-09-22T08:38:31.314 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.302+0000 7efd38c50640 1 -- 172.21.15.142:0/309311818 <== osd.3 v2:172.21.15.142:6800/1064901393 7 ==== osd_op_reply(23 [pgnls start_epoch 32 out=107b] v32'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7efd30053020 con 0x5629acc0bf20 2024-09-22T08:38:31.315 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.302+0000 7efd38c50640 1 -- 172.21.15.142:0/309311818 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5629acc10380 con 0x5629acc07530 2024-09-22T08:38:31.315 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.302+0000 7efd2ffff640 1 -- 172.21.15.142:0/309311818 <== osd.1 v2:172.21.15.142:6816/3192108003 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd20029040 con 0x5629acc07530 2024-09-22T08:38:31.315 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.302+0000 7efd2ffff640 1 -- 172.21.15.142:0/309311818 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5629acc10380 con 0x5629acc07530 2024-09-22T08:38:31.315 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.302+0000 7efd2ffff640 1 -- 172.21.15.142:0/309311818 <== osd.1 v2:172.21.15.142:6816/3192108003 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v32'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7efd20029040 con 0x5629acc07530 2024-09-22T08:38:31.315 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.302+0000 7efd2ffff640 1 -- 172.21.15.142:0/309311818 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5629acc10380 con 0x7efd2805f040 2024-09-22T08:38:31.315 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.302+0000 7efd2ffff640 1 -- 172.21.15.142:0/309311818 <== osd.0 v2:172.21.15.31:6800/168281188 5 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd20029040 con 0x7efd2805f040 2024-09-22T08:38:31.315 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.302+0000 7efd2ffff640 1 -- 172.21.15.142:0/309311818 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5629acc10380 con 0x5629acc0bf20 2024-09-22T08:38:31.315 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.303+0000 7efd38c50640 1 -- 172.21.15.142:0/309311818 <== osd.3 v2:172.21.15.142:6800/1064901393 8 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd30053020 con 0x5629acc0bf20 2024-09-22T08:38:31.315 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.303+0000 7efd38c50640 1 -- 172.21.15.142:0/309311818 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5629acc10380 con 0x7efd3004d850 2024-09-22T08:38:31.315 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.303+0000 7efd3844f640 1 -- 172.21.15.142:0/309311818 <== osd.2 v2:172.21.15.142:6808/279438927 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd28051070 con 0x7efd3004d850 2024-09-22T08:38:31.315 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.303+0000 7efd3844f640 1 -- 172.21.15.142:0/309311818 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5629acc10380 con 0x5629acc07530 2024-09-22T08:38:31.315 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.303+0000 7efd2ffff640 1 -- 172.21.15.142:0/309311818 <== osd.1 v2:172.21.15.142:6816/3192108003 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd20029040 con 0x5629acc07530 2024-09-22T08:38:31.315 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.303+0000 7efd2ffff640 1 -- 172.21.15.142:0/309311818 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5629acc10380 con 0x7efd2805f040 2024-09-22T08:38:31.316 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.303+0000 7efd2ffff640 1 -- 172.21.15.142:0/309311818 <== osd.0 v2:172.21.15.31:6800/168281188 6 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd20029040 con 0x7efd2805f040 2024-09-22T08:38:31.316 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.303+0000 7efd2ffff640 1 -- 172.21.15.142:0/309311818 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5629acc10380 con 0x5629acc0bf20 2024-09-22T08:38:31.316 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.304+0000 7efd38c50640 1 -- 172.21.15.142:0/309311818 <== osd.3 v2:172.21.15.142:6800/1064901393 9 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd30053020 con 0x5629acc0bf20 2024-09-22T08:38:31.316 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.304+0000 7efd38c50640 1 -- 172.21.15.142:0/309311818 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5629acc10380 con 0x7efd2805f040 2024-09-22T08:38:31.316 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.304+0000 7efd2ffff640 1 -- 172.21.15.142:0/309311818 <== osd.0 v2:172.21.15.31:6800/168281188 7 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd20029040 con 0x7efd2805f040 2024-09-22T08:38:31.316 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.304+0000 7efd2ffff640 1 -- 172.21.15.142:0/309311818 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5629acc10380 con 0x7efd3004d850 2024-09-22T08:38:31.316 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.304+0000 7efd3844f640 1 -- 172.21.15.142:0/309311818 <== osd.2 v2:172.21.15.142:6808/279438927 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd28051070 con 0x7efd3004d850 2024-09-22T08:38:31.316 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.304+0000 7efd3844f640 1 -- 172.21.15.142:0/309311818 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5629acc10380 con 0x5629acc0bf20 2024-09-22T08:38:31.316 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.304+0000 7efd38c50640 1 -- 172.21.15.142:0/309311818 <== osd.3 v2:172.21.15.142:6800/1064901393 10 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd30053020 con 0x5629acc0bf20 2024-09-22T08:38:31.316 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.304+0000 7efd38c50640 1 -- 172.21.15.142:0/309311818 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5629acc10380 con 0x7efd2805f040 2024-09-22T08:38:31.316 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.305+0000 7efd2ffff640 1 -- 172.21.15.142:0/309311818 <== osd.0 v2:172.21.15.31:6800/168281188 8 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd20029040 con 0x7efd2805f040 2024-09-22T08:38:31.316 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.305+0000 7efd2ffff640 1 -- 172.21.15.142:0/309311818 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5629acc10380 con 0x5629acc07530 2024-09-22T08:38:31.316 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.305+0000 7efd2ffff640 1 -- 172.21.15.142:0/309311818 <== osd.1 v2:172.21.15.142:6816/3192108003 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v32'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7efd20029040 con 0x5629acc07530 2024-09-22T08:38:31.316 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.305+0000 7efd2ffff640 1 -- 172.21.15.142:0/309311818 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5629acc10380 con 0x7efd3004d850 2024-09-22T08:38:31.317 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.305+0000 7efd3844f640 1 -- 172.21.15.142:0/309311818 <== osd.2 v2:172.21.15.142:6808/279438927 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd28051070 con 0x7efd3004d850 2024-09-22T08:38:31.317 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.305+0000 7efd3c72c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:38:31.317 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.305+0000 7efd3c72c800 20 RGWRados::pool_iterate: got zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec 2024-09-22T08:38:31.317 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.305+0000 7efd3c72c800 20 RGWRados::pool_iterate: got zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f 2024-09-22T08:38:31.317 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.305+0000 7efd3c72c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:38:31.317 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.305+0000 7efd3c72c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:38:31.317 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.305+0000 7efd3c72c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:38:31.317 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.305+0000 7efd3c72c800 20 rados->read ofs=0 len=0 2024-09-22T08:38:31.317 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.305+0000 7efd3c72c800 1 -- 172.21.15.142:0/309311818 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5629acc0f410 con 0x5629acc07530 2024-09-22T08:38:31.317 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.305+0000 7efd2ffff640 1 -- 172.21.15.142:0/309311818 <== osd.1 v2:172.21.15.142:6816/3192108003 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efd20029040 con 0x5629acc07530 2024-09-22T08:38:31.317 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.305+0000 7efd3c72c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:31.317 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.305+0000 7efd3c72c800 20 rados->read ofs=0 len=0 2024-09-22T08:38:31.317 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.305+0000 7efd3c72c800 1 -- 172.21.15.142:0/309311818 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5629acc0fc60 con 0x5629acc07530 2024-09-22T08:38:31.317 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.306+0000 7efd2ffff640 1 -- 172.21.15.142:0/309311818 <== osd.1 v2:172.21.15.142:6816/3192108003 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7efd20029040 con 0x5629acc07530 2024-09-22T08:38:31.318 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.306+0000 7efd3c72c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:38:31.318 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.306+0000 7efd3c72c800 20 rados->read ofs=0 len=0 2024-09-22T08:38:31.318 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.306+0000 7efd3c72c800 1 -- 172.21.15.142:0/309311818 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:40 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5629acc10800 con 0x5629acc0bf20 2024-09-22T08:38:31.318 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.306+0000 7efd38c50640 1 -- 172.21.15.142:0/309311818 <== osd.3 v2:172.21.15.142:6800/1064901393 11 ==== osd_op_reply(40 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7efd30053020 con 0x5629acc0bf20 2024-09-22T08:38:31.318 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.306+0000 7efd3c72c800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:38:31.318 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.306+0000 7efd3c72c800 20 zone default found 2024-09-22T08:38:31.318 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.306+0000 7efd3c72c800 4 Realm: () 2024-09-22T08:38:31.318 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.306+0000 7efd3c72c800 4 ZoneGroup: default (d89f6f57-1007-47dd-9065-f486c7b01aec) 2024-09-22T08:38:31.318 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.306+0000 7efd3c72c800 4 Zone: default (e239248c-0bee-4e41-803a-24b288d3eb8f) 2024-09-22T08:38:31.318 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.306+0000 7efd3c72c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:38:31.318 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.306+0000 7efd3c72c800 20 zonegroup default 2024-09-22T08:38:31.318 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.306+0000 7efd3c72c800 20 rados->read ofs=0 len=0 2024-09-22T08:38:31.318 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.306+0000 7efd3c72c800 1 -- 172.21.15.142:0/309311818 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5629acc10ba0 con 0x7efd2805f040 2024-09-22T08:38:31.318 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.306+0000 7efd2ffff640 1 -- 172.21.15.142:0/309311818 <== osd.0 v2:172.21.15.31:6800/168281188 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7efd20029040 con 0x7efd2805f040 2024-09-22T08:38:31.319 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.306+0000 7efd3c72c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:31.319 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.306+0000 7efd3c72c800 20 rados->read ofs=0 len=0 2024-09-22T08:38:31.319 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.306+0000 7efd3c72c800 1 -- 172.21.15.142:0/309311818 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5629acc12e30 con 0x5629acc0bf20 2024-09-22T08:38:31.319 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.307+0000 7efd38c50640 1 -- 172.21.15.142:0/309311818 <== osd.3 v2:172.21.15.142:6800/1064901393 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7efd30053020 con 0x5629acc0bf20 2024-09-22T08:38:31.319 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.307+0000 7efd3c72c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:31.319 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.307+0000 7efd3c72c800 20 rados->read ofs=0 len=0 2024-09-22T08:38:31.319 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.307+0000 7efd3c72c800 1 -- 172.21.15.142:0/309311818 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5629acc131d0 con 0x5629acc0bf20 2024-09-22T08:38:31.319 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.307+0000 7efd38c50640 1 -- 172.21.15.142:0/309311818 <== osd.3 v2:172.21.15.142:6800/1064901393 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7efd30053020 con 0x5629acc0bf20 2024-09-22T08:38:31.319 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.307+0000 7efd3c72c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:31.319 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.307+0000 7efd3c72c800 20 started sync module instance, tier type = 2024-09-22T08:38:31.319 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.307+0000 7efd3c72c800 20 started zone id=e239248c-0bee-4e41-803a-24b288d3eb8f (name=default) with tier type = 2024-09-22T08:38:31.319 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.307+0000 7efd3c72c800 1 -- 172.21.15.142:0/309311818 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5629acc122c0 con 0x7efd3004d850 2024-09-22T08:38:31.325 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.308+0000 7efd3844f640 1 -- 172.21.15.142:0/309311818 <== osd.2 v2:172.21.15.142:6808/279438927 7 ==== osd_op_reply(44 notify.0 [create] v32'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd28051070 con 0x7efd3004d850 2024-09-22T08:38:31.325 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.308+0000 7efd3c72c800 1 -- 172.21.15.142:0/309311818 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94736991987376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5629acc11f20 con 0x7efd3004d850 2024-09-22T08:38:31.325 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.308+0000 7efd3c72c800 1 -- 172.21.15.142:0/309311818 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5629acc140d0 con 0x5629acc07530 2024-09-22T08:38:31.325 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.309+0000 7efd3844f640 1 -- 172.21.15.142:0/309311818 <== osd.2 v2:172.21.15.142:6808/279438927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94736991987376] v32'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd28051070 con 0x7efd3004d850 2024-09-22T08:38:31.325 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.309+0000 7efd2ffff640 1 -- 172.21.15.142:0/309311818 <== osd.1 v2:172.21.15.142:6816/3192108003 16 ==== osd_op_reply(46 notify.1 [create] v32'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd20029040 con 0x5629acc07530 2024-09-22T08:38:31.325 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.309+0000 7efd3c72c800 1 -- 172.21.15.142:0/309311818 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94736991992864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5629acc144f0 con 0x5629acc07530 2024-09-22T08:38:31.325 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.309+0000 7efd3c72c800 1 -- 172.21.15.142:0/309311818 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5629acc14eb0 con 0x5629acc0bf20 2024-09-22T08:38:31.325 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.310+0000 7efd2ffff640 1 -- 172.21.15.142:0/309311818 <== osd.1 v2:172.21.15.142:6816/3192108003 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94736991992864] v32'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd20029040 con 0x5629acc07530 2024-09-22T08:38:31.325 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.310+0000 7efd38c50640 1 -- 172.21.15.142:0/309311818 <== osd.3 v2:172.21.15.142:6800/1064901393 14 ==== osd_op_reply(48 notify.2 [create] v32'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd30053020 con 0x5629acc0bf20 2024-09-22T08:38:31.325 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.310+0000 7efd3c72c800 1 -- 172.21.15.142:0/309311818 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94736991996896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5629acc144f0 con 0x5629acc0bf20 2024-09-22T08:38:31.325 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.311+0000 7efd3c72c800 1 -- 172.21.15.142:0/309311818 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5629acc15920 con 0x7efd3004d850 2024-09-22T08:38:31.325 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.312+0000 7efd38c50640 1 -- 172.21.15.142:0/309311818 <== osd.3 v2:172.21.15.142:6800/1064901393 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94736991996896] v32'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd30053020 con 0x5629acc0bf20 2024-09-22T08:38:31.326 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.312+0000 7efd3844f640 1 -- 172.21.15.142:0/309311818 <== osd.2 v2:172.21.15.142:6808/279438927 9 ==== osd_op_reply(50 notify.3 [create] v32'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd28051070 con 0x7efd3004d850 2024-09-22T08:38:31.326 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.312+0000 7efd3c72c800 1 -- 172.21.15.142:0/309311818 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94736991998992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5629acc144f0 con 0x7efd3004d850 2024-09-22T08:38:31.326 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.312+0000 7efd3c72c800 1 -- 172.21.15.142:0/309311818 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5629acc16390 con 0x5629acc07530 2024-09-22T08:38:31.326 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.313+0000 7efd3844f640 1 -- 172.21.15.142:0/309311818 <== osd.2 v2:172.21.15.142:6808/279438927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94736991998992] v32'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd28051070 con 0x7efd3004d850 2024-09-22T08:38:31.326 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.313+0000 7efd2ffff640 1 -- 172.21.15.142:0/309311818 <== osd.1 v2:172.21.15.142:6816/3192108003 18 ==== osd_op_reply(52 notify.4 [create] v32'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd20029040 con 0x5629acc07530 2024-09-22T08:38:31.326 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.313+0000 7efd3c72c800 1 -- 172.21.15.142:0/309311818 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94736992001664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5629acc144f0 con 0x5629acc07530 2024-09-22T08:38:31.326 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.313+0000 7efd3c72c800 1 -- 172.21.15.142:0/309311818 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5629acc16de0 con 0x7efd2805f040 2024-09-22T08:38:31.326 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.314+0000 7efd2ffff640 1 -- 172.21.15.142:0/309311818 <== osd.0 v2:172.21.15.31:6800/168281188 10 ==== osd_op_reply(54 notify.5 [create] v32'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd20029040 con 0x7efd2805f040 2024-09-22T08:38:31.326 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.314+0000 7efd3c72c800 1 -- 172.21.15.142:0/309311818 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94736992004336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5629acc16d90 con 0x7efd2805f040 2024-09-22T08:38:31.326 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.314+0000 7efd2ffff640 1 -- 172.21.15.142:0/309311818 <== osd.1 v2:172.21.15.142:6816/3192108003 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94736992001664] v32'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd20029040 con 0x5629acc07530 2024-09-22T08:38:31.326 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.314+0000 7efd3c72c800 1 -- 172.21.15.142:0/309311818 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5629acc178c0 con 0x7efd2805f040 2024-09-22T08:38:31.326 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.315+0000 7efd2ffff640 1 -- 172.21.15.142:0/309311818 <== osd.0 v2:172.21.15.31:6800/168281188 11 ==== osd_op_reply(56 notify.6 [create] v32'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd20029040 con 0x7efd2805f040 2024-09-22T08:38:31.326 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.315+0000 7efd3c72c800 1 -- 172.21.15.142:0/309311818 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94736991993920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5629acc17d30 con 0x7efd2805f040 2024-09-22T08:38:31.327 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.315+0000 7efd3c72c800 1 -- 172.21.15.142:0/309311818 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5629acc187a0 con 0x7efd2805f040 2024-09-22T08:38:31.327 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.315+0000 7efd2ffff640 1 -- 172.21.15.142:0/309311818 <== osd.0 v2:172.21.15.31:6800/168281188 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94736992004336] v32'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd20029040 con 0x7efd2805f040 2024-09-22T08:38:31.327 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.316+0000 7efd2ffff640 1 -- 172.21.15.142:0/309311818 <== osd.0 v2:172.21.15.31:6800/168281188 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94736991993920] v32'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd20029040 con 0x7efd2805f040 2024-09-22T08:38:31.327 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.316+0000 7efd2ffff640 1 -- 172.21.15.142:0/309311818 <== osd.0 v2:172.21.15.31:6800/168281188 14 ==== osd_op_reply(58 notify.7 [create] v32'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd20029040 con 0x7efd2805f040 2024-09-22T08:38:31.327 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.316+0000 7efd3c72c800 1 -- 172.21.15.142:0/309311818 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94736992010864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5629acc17880 con 0x7efd2805f040 2024-09-22T08:38:31.327 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.316+0000 7efd3c72c800 20 add_watcher() i=0 2024-09-22T08:38:31.327 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.316+0000 7efd3c72c800 20 add_watcher() i=1 2024-09-22T08:38:31.327 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.316+0000 7efd3c72c800 20 add_watcher() i=2 2024-09-22T08:38:31.327 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.316+0000 7efd3c72c800 20 add_watcher() i=3 2024-09-22T08:38:31.327 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.316+0000 7efd3c72c800 20 add_watcher() i=4 2024-09-22T08:38:31.327 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.316+0000 7efd3c72c800 20 add_watcher() i=5 2024-09-22T08:38:31.327 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.316+0000 7efd3c72c800 20 add_watcher() i=6 2024-09-22T08:38:31.327 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.317+0000 7efd2ffff640 1 -- 172.21.15.142:0/309311818 <== osd.0 v2:172.21.15.31:6800/168281188 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94736992010864] v32'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd20029040 con 0x7efd2805f040 2024-09-22T08:38:31.327 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.317+0000 7efd3c72c800 20 add_watcher() i=7 2024-09-22T08:38:31.328 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.317+0000 7efd3c72c800 2 all 8 watchers are set, enabling cache 2024-09-22T08:38:31.328 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.317+0000 7efd3c72c800 1 -- 172.21.15.142:0/309311818 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5629acc17880 con 0x5629acc07530 2024-09-22T08:38:31.328 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.317+0000 7efd2ffff640 1 -- 172.21.15.142:0/309311818 <== osd.1 v2:172.21.15.142:6816/3192108003 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7efd20029040 con 0x5629acc07530 2024-09-22T08:38:31.328 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.317+0000 7efd3c72c800 1 -- 172.21.15.142:0/309311818 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94736992006448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5629acc18ff0 con 0x5629acc07530 2024-09-22T08:38:31.328 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.318+0000 7efd2ffff640 1 -- 172.21.15.142:0/309311818 <== osd.1 v2:172.21.15.142:6816/3192108003 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94736992006448] v32'272 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7efd20029040 con 0x5629acc07530 2024-09-22T08:38:31.328 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.318+0000 7efbee7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:38:31.328 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.319+0000 7efd3c72c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:38:31.328 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.319+0000 7efd3c72c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:38:31.328 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.319+0000 7efd3c72c800 5 note: GC not initialized 2024-09-22T08:38:31.328 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.319+0000 7efbed7e2640 20 reqs_thread_entry: start 2024-09-22T08:38:31.328 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.319+0000 7efd3c72c800 20 init_complete bucket index max shards: 11 2024-09-22T08:38:31.328 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.319+0000 7efd3c72c800 20 Filter name: none 2024-09-22T08:38:31.328 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.319+0000 7efb5effd640 20 reqs_thread_entry: start 2024-09-22T08:38:31.328 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.319+0000 7efd3c72c800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-22T08:38:31.329 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.319+0000 7efd3c72c800 20 rados->read ofs=0 len=0 2024-09-22T08:38:31.329 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.319+0000 7efd3c72c800 1 -- 172.21.15.142:0/309311818 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5629acc4ead0 con 0x7efd2805f040 2024-09-22T08:38:31.329 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.320+0000 7efd2ffff640 1 -- 172.21.15.142:0/309311818 <== osd.0 v2:172.21.15.31:6800/168281188 16 ==== osd_op_reply(62 ada [call out=48b,read 0~473 out=473b,getxattrs out=75b] v0'0 uv12 ondisk = 0) ==== 231+0+596 (crc 0 0 0) 0x7efd20029040 con 0x7efd2805f040 2024-09-22T08:38:31.329 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.320+0000 7efd3c72c800 20 rados_obj.operate() r=0 bl.length=473 2024-09-22T08:38:31.329 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.320+0000 7efd3c72c800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-22T08:38:31.329 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.320+0000 7efd3c72c800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-22T08:38:31.329 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.320+0000 7efd3c72c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:38:31.329 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.320+0000 7efd3c72c800 1 -- 172.21.15.142:0/309311818 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~473 in=473b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5629acc553a0 con 0x7efd2805f040 2024-09-22T08:38:31.329 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.321+0000 7efd2ffff640 1 -- 172.21.15.142:0/309311818 <== osd.0 v2:172.21.15.31:6800/168281188 17 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~473] v32'13 uv13 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7efd20029040 con 0x7efd2805f040 2024-09-22T08:38:31.329 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.321+0000 7efd3c72c800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-22T08:38:31.329 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.321+0000 7efd3c72c800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-22T08:38:31.329 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.321+0000 7efd3c72c800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-22T08:38:31.329 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.321+0000 7efd3c72c800 1 -- 172.21.15.142:0/309311818 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94736992259488 in=661b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5629acc50aa0 con 0x5629acc07530 2024-09-22T08:38:31.329 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.321+0000 7efd2ffff640 1 -- 172.21.15.142:0/309311818 <== osd.1 v2:172.21.15.142:6816/3192108003 22 ==== watch-notify(notify (1) cookie 94736992001664 notify 137438953503 ret 0) ==== 691+0+0 (crc 0 0 0) 0x5629ac95ea20 con 0x5629acc07530 2024-09-22T08:38:31.330 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.321+0000 7efc177fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953503 cookie 94736992001664 notifier 4919 bl.length()=649 2024-09-22T08:38:31.330 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.321+0000 7efc177fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-22T08:38:31.330 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.321+0000 7efd2ffff640 1 -- 172.21.15.142:0/309311818 <== osd.1 v2:172.21.15.142:6816/3192108003 23 ==== osd_op_reply(64 notify.4 [notify cookie 94736992259488 out=8b] v0'0 uv279 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7efd20029040 con 0x5629acc07530 2024-09-22T08:38:31.330 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.321+0000 7efc177fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-22T08:38:31.330 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.321+0000 7efc177fe640 1 -- 172.21.15.142:0/309311818 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7efbfc003ea0 con 0x5629acc07530 2024-09-22T08:38:31.330 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.321+0000 7efd2ffff640 1 -- 172.21.15.142:0/309311818 <== osd.1 v2:172.21.15.142:6816/3192108003 24 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd20029040 con 0x5629acc07530 2024-09-22T08:38:31.330 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.322+0000 7efd2ffff640 1 -- 172.21.15.142:0/309311818 <== osd.1 v2:172.21.15.142:6816/3192108003 25 ==== watch-notify(notify_complete (2) cookie 94736992259488 notify 137438953503 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7efd2002d5d0 con 0x5629acc07530 2024-09-22T08:38:31.330 INFO:teuthology.orchestra.run.smithi142.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-22T08:38:29.459914Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"users","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-22T08:38:29.459903Z","tags":[],"group_ids":[]} 2024-09-22T08:38:31.336 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.322+0000 7efbee7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:38:31.336 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.322+0000 7efd3c72c800 1 -- 172.21.15.142:0/309311818 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94736992006448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5629acc54680 con 0x5629acc07530 2024-09-22T08:38:31.336 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.323+0000 7efd2ffff640 1 -- 172.21.15.142:0/309311818 <== osd.1 v2:172.21.15.142:6816/3192108003 26 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94736992006448] v32'273 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7efd20029040 con 0x5629acc07530 2024-09-22T08:38:31.336 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.323+0000 7efd3c72c800 1 -- 172.21.15.142:0/309311818 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94736991987376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5629acc54680 con 0x7efd3004d850 2024-09-22T08:38:31.336 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.324+0000 7efd3844f640 1 -- 172.21.15.142:0/309311818 <== osd.2 v2:172.21.15.142:6808/279438927 11 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94736991987376] v32'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd28051070 con 0x7efd3004d850 2024-09-22T08:38:31.336 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.324+0000 7efd3c72c800 20 remove_watcher() i=0 2024-09-22T08:38:31.336 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.324+0000 7efd3c72c800 2 removed watcher, disabling cache 2024-09-22T08:38:31.336 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.324+0000 7efd3c72c800 1 -- 172.21.15.142:0/309311818 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94736991992864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5629acc4c7e0 con 0x5629acc07530 2024-09-22T08:38:31.336 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.326+0000 7efd2ffff640 1 -- 172.21.15.142:0/309311818 <== osd.1 v2:172.21.15.142:6816/3192108003 27 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94736991992864] v32'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd20029040 con 0x5629acc07530 2024-09-22T08:38:31.336 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.326+0000 7efd3c72c800 20 remove_watcher() i=1 2024-09-22T08:38:31.336 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.326+0000 7efd3c72c800 1 -- 172.21.15.142:0/309311818 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94736991996896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5629acc4c7e0 con 0x5629acc0bf20 2024-09-22T08:38:31.337 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.327+0000 7efd38c50640 1 -- 172.21.15.142:0/309311818 <== osd.3 v2:172.21.15.142:6800/1064901393 16 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94736991996896] v32'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd30053020 con 0x5629acc0bf20 2024-09-22T08:38:31.337 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.327+0000 7efd3c72c800 20 remove_watcher() i=2 2024-09-22T08:38:31.337 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.327+0000 7efd3c72c800 1 -- 172.21.15.142:0/309311818 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94736991998992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5629acc4c7e0 con 0x7efd3004d850 2024-09-22T08:38:31.337 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.328+0000 7efd3844f640 1 -- 172.21.15.142:0/309311818 <== osd.2 v2:172.21.15.142:6808/279438927 12 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94736991998992] v32'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd28051070 con 0x7efd3004d850 2024-09-22T08:38:31.337 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.328+0000 7efd3c72c800 20 remove_watcher() i=3 2024-09-22T08:38:31.337 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.328+0000 7efd3c72c800 1 -- 172.21.15.142:0/309311818 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94736992001664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5629acc4c7e0 con 0x5629acc07530 2024-09-22T08:38:31.337 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.329+0000 7efd2ffff640 1 -- 172.21.15.142:0/309311818 <== osd.1 v2:172.21.15.142:6816/3192108003 28 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94736992001664] v32'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd20029040 con 0x5629acc07530 2024-09-22T08:38:31.337 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.329+0000 7efd3c72c800 20 remove_watcher() i=4 2024-09-22T08:38:31.337 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.329+0000 7efd3c72c800 1 -- 172.21.15.142:0/309311818 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94736992004336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5629acc4c7e0 con 0x7efd2805f040 2024-09-22T08:38:31.337 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.330+0000 7efd2ffff640 1 -- 172.21.15.142:0/309311818 <== osd.0 v2:172.21.15.31:6800/168281188 18 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94736992004336] v32'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd20029040 con 0x7efd2805f040 2024-09-22T08:38:31.337 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.330+0000 7efd3c72c800 20 remove_watcher() i=5 2024-09-22T08:38:31.337 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.330+0000 7efd3c72c800 1 -- 172.21.15.142:0/309311818 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94736991993920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5629acc4c7e0 con 0x7efd2805f040 2024-09-22T08:38:31.337 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.331+0000 7efd2ffff640 1 -- 172.21.15.142:0/309311818 <== osd.0 v2:172.21.15.31:6800/168281188 19 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94736991993920] v32'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd20029040 con 0x7efd2805f040 2024-09-22T08:38:31.337 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.331+0000 7efd3c72c800 20 remove_watcher() i=6 2024-09-22T08:38:31.338 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.331+0000 7efd3c72c800 1 -- 172.21.15.142:0/309311818 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94736992010864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5629acc4c7e0 con 0x7efd2805f040 2024-09-22T08:38:31.338 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.332+0000 7efd2ffff640 1 -- 172.21.15.142:0/309311818 <== osd.0 v2:172.21.15.31:6800/168281188 20 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94736992010864] v32'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd20029040 con 0x7efd2805f040 2024-09-22T08:38:31.338 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.332+0000 7efd3c72c800 20 remove_watcher() i=7 2024-09-22T08:38:31.338 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.332+0000 7efd3c72c800 1 -- 172.21.15.142:0/309311818 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7efd2805f040 msgr2=0x7efd2805f420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:31.338 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.332+0000 7efd3c72c800 1 --2- 172.21.15.142:0/309311818 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7efd2805f040 0x7efd2805f420 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:31.338 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.332+0000 7efd3c72c800 1 -- 172.21.15.142:0/309311818 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5629acc07530 msgr2=0x5629acc099f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:31.338 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.332+0000 7efd3c72c800 1 --2- 172.21.15.142:0/309311818 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5629acc07530 0x5629acc099f0 crc :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:31.338 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.332+0000 7efd3c72c800 1 -- 172.21.15.142:0/309311818 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7efd3004d850 msgr2=0x7efd3003d000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:31.338 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.332+0000 7efd3c72c800 1 --2- 172.21.15.142:0/309311818 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7efd3004d850 0x7efd3003d000 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:31.338 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.332+0000 7efd3c72c800 1 -- 172.21.15.142:0/309311818 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5629acc0bf20 msgr2=0x5629acc0e310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:31.338 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.332+0000 7efd3c72c800 1 --2- 172.21.15.142:0/309311818 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5629acc0bf20 0x5629acc0e310 crc :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:31.338 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.332+0000 7efd3c72c800 1 -- 172.21.15.142:0/309311818 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7efc0803cfb0 msgr2=0x7efc0803f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:31.338 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.332+0000 7efd3c72c800 1 --2- 172.21.15.142:0/309311818 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7efc0803cfb0 0x7efc0803f470 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7efd28053ca0 tx=0x7efd28088000 comp rx=0 tx=0).stop 2024-09-22T08:38:31.339 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.332+0000 7efd3c72c800 1 -- 172.21.15.142:0/309311818 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5629acbf4740 msgr2=0x5629acbfbd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:31.339 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.332+0000 7efd2ffff640 1 -- 172.21.15.142:0/309311818 reap_dead start 2024-09-22T08:38:31.339 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.332+0000 7efd3c72c800 1 --2- 172.21.15.142:0/309311818 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5629acbf4740 0x5629acbfbd30 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7efd3001fd40 tx=0x7efd3004e000 comp rx=0 tx=0).stop 2024-09-22T08:38:31.339 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.332+0000 7efd3c72c800 1 -- 172.21.15.142:0/309311818 shutdown_connections 2024-09-22T08:38:31.339 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.332+0000 7efd3c72c800 1 --2- 172.21.15.142:0/309311818 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5629acbf4740 0x5629acbfbd30 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:31.339 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.332+0000 7efd3c72c800 1 -- 172.21.15.142:0/309311818 >> 172.21.15.142:0/309311818 conn(0x5629acbf0b60 msgr2=0x5629acbeed70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:38:31.339 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.332+0000 7efd3c72c800 1 -- 172.21.15.142:0/309311818 shutdown_connections 2024-09-22T08:38:31.339 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.332+0000 7efd3c72c800 1 -- 172.21.15.142:0/309311818 wait complete. 2024-09-22T08:38:31.339 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.333+0000 7efd3c72c800 1 -- 172.21.15.142:0/1018406617 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7efc1003d000 msgr2=0x7efc1003f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:31.339 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.333+0000 7efd3c72c800 1 --2- 172.21.15.142:0/1018406617 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7efc1003d000 0x7efc1003f4c0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7efd2806c000 tx=0x7efd2807cf90 comp rx=0 tx=0).stop 2024-09-22T08:38:31.339 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.333+0000 7efd3c72c800 1 -- 172.21.15.142:0/1018406617 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5629acbe7ce0 msgr2=0x5629acbe8100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:31.339 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.333+0000 7efd3c72c800 1 --2- 172.21.15.142:0/1018406617 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5629acbe7ce0 0x5629acbe8100 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x5629acbcdcc0 tx=0x7efd300167b0 comp rx=0 tx=0).stop 2024-09-22T08:38:31.339 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.333+0000 7efd3c72c800 1 -- 172.21.15.142:0/1018406617 shutdown_connections 2024-09-22T08:38:31.339 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.333+0000 7efd3c72c800 1 --2- 172.21.15.142:0/1018406617 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7efc1003d000 0x7efc1003f4c0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:31.340 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.333+0000 7efd3c72c800 1 --2- 172.21.15.142:0/1018406617 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5629acbe7ce0 0x5629acbe8100 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:31.340 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.333+0000 7efd3c72c800 1 -- 172.21.15.142:0/1018406617 >> 172.21.15.142:0/1018406617 conn(0x5629acbdc090 msgr2=0x5629acbdc470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:38:31.340 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.333+0000 7efd3c72c800 1 -- 172.21.15.142:0/1018406617 shutdown_connections 2024-09-22T08:38:31.340 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.333+0000 7efd3c72c800 1 -- 172.21.15.142:0/1018406617 wait complete. 2024-09-22T08:38:31.340 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.333+0000 7efd3c72c800 1 -- 172.21.15.142:0/2493967913 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5629acad67f0 msgr2=0x5629acbd4310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:31.340 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.333+0000 7efd3c72c800 1 --2- 172.21.15.142:0/2493967913 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5629acad67f0 0x5629acbd4310 crc :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:31.340 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.333+0000 7efd3c72c800 1 -- 172.21.15.142:0/2493967913 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5629acbd66f0 msgr2=0x5629acbd8b70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:31.340 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.333+0000 7efd3c72c800 1 --2- 172.21.15.142:0/2493967913 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5629acbd66f0 0x5629acbd8b70 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:31.340 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.333+0000 7efd3c72c800 1 -- 172.21.15.142:0/2493967913 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7efc2003cfb0 msgr2=0x7efc2003f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:31.340 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.333+0000 7efd3c72c800 1 --2- 172.21.15.142:0/2493967913 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7efc2003cfb0 0x7efc2003f470 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7efd20001d70 tx=0x7efd200012d0 comp rx=0 tx=0).stop 2024-09-22T08:38:31.340 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.333+0000 7efd3c72c800 1 -- 172.21.15.142:0/2493967913 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5629aca46d30 msgr2=0x5629acbcccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:38:31.340 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.333+0000 7efd3c72c800 1 --2- 172.21.15.142:0/2493967913 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5629aca46d30 0x5629acbcccc0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7efd28025c20 tx=0x7efd28002fb0 comp rx=0 tx=0).stop 2024-09-22T08:38:31.340 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.333+0000 7efd3c72c800 1 -- 172.21.15.142:0/2493967913 shutdown_connections 2024-09-22T08:38:31.341 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.333+0000 7efd3c72c800 1 --2- 172.21.15.142:0/2493967913 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x5629acbd66f0 0x5629acbd8b70 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:31.341 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.333+0000 7efd3c72c800 1 --2- 172.21.15.142:0/2493967913 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x5629acad67f0 0x5629acbd4310 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:31.341 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.333+0000 7efd3c72c800 1 --2- 172.21.15.142:0/2493967913 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7efc2003cfb0 0x7efc2003f470 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:31.341 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.333+0000 7efd3c72c800 1 --2- 172.21.15.142:0/2493967913 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5629aca46d30 0x5629acbcccc0 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:38:31.341 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.333+0000 7efd3c72c800 1 -- 172.21.15.142:0/2493967913 >> 172.21.15.142:0/2493967913 conn(0x5629acacdbb0 msgr2=0x5629acbbe570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:38:31.341 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.333+0000 7efd3c72c800 1 -- 172.21.15.142:0/2493967913 shutdown_connections 2024-09-22T08:38:31.341 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:38:31.333+0000 7efd3c72c800 1 -- 172.21.15.142:0/2493967913 wait complete. 2024-09-22T08:38:31.343 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-22T08:38:29.459914Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-22T08:38:29.459903Z', 'tags': [], 'group_ids': []} 2024-09-22T08:38:31.343 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-22T08:38:29.459914Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-22T08:38:29.459903Z', 'tags': [], 'group_ids': []} 2024-09-22T08:38:31.343 ERROR:root:0 2024-09-22T08:38:31.343 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'modify'] {'uid': 'foo', 'suspended': True} 2024-09-22T08:38:31.350 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-22T08:38:31.350 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-22T08:38:31.354 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-22T08:38:31.354 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'modify'] {'uid': 'foo', 'suspended': 'false'} 2024-09-22T08:38:31.359 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-22T08:38:31.360 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-22T08:38:31.363 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-22T08:38:31.363 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['key', 'create'] {'uid': 'foo', 'access-key': 'p5YnriCv1nAtykxBrupQ', 'secret-key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'} 2024-09-22T08:38:31.371 INFO:tasks.radosgw_admin_rest: json result: [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True}] 2024-09-22T08:38:31.371 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-22T08:38:31.375 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-22T08:38:31.375 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['key', 'rm'] {'uid': 'foo', 'access-key': 'p5YnriCv1nAtykxBrupQ'} 2024-09-22T08:38:31.382 INFO:tasks.radosgw_admin_rest: empty result 2024-09-22T08:38:31.383 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-22T08:38:31.386 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-22T08:38:31.386 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['subuser', 'create'] {'subuser': 'foo:foo1', 'secret-key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'key-type': 'swift'} 2024-09-22T08:38:31.393 INFO:tasks.radosgw_admin_rest: json result: [{'id': 'foo:foo1', 'permissions': ''}] 2024-09-22T08:38:31.393 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-22T08:38:31.397 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-22T08:38:31.397 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['subuser', 'create'] {'subuser': 'foo:foo2', 'secret-key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'key-type': 'swift'} 2024-09-22T08:38:31.404 INFO:tasks.radosgw_admin_rest: json result: [{'id': 'foo:foo1', 'permissions': ''}, {'id': 'foo:foo2', 'permissions': ''}] 2024-09-22T08:38:31.404 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-22T08:38:31.407 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': ''}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True}, {'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-22T08:38:31.408 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['key', 'rm'] {'subuser': 'foo:foo1', 'key-type': 'swift'} 2024-09-22T08:38:31.414 INFO:tasks.radosgw_admin_rest: empty result 2024-09-22T08:38:31.414 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-22T08:38:31.417 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': ''}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-22T08:38:31.418 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['subuser', 'rm'] {'subuser': 'foo:foo1'} 2024-09-22T08:38:31.422 INFO:tasks.radosgw_admin_rest: empty result 2024-09-22T08:38:31.423 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-22T08:38:31.426 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-22T08:38:31.426 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['subuser', 'rm'] {'subuser': 'foo:foo2', 'key-type': 'swift', '{purge-keys': True} 2024-09-22T08:38:31.433 INFO:tasks.radosgw_admin_rest: empty result 2024-09-22T08:38:31.434 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-22T08:38:31.437 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-22T08:38:31.437 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'uid': 'foo'} 2024-09-22T08:38:31.441 INFO:tasks.radosgw_admin_rest: json result: [] 2024-09-22T08:38:31.442 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'uid': 'foo', 'stats': True} 2024-09-22T08:38:31.445 INFO:tasks.radosgw_admin_rest: json result: [] 2024-09-22T08:38:31.457 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'uid': 'foo'} 2024-09-22T08:38:31.461 INFO:tasks.radosgw_admin_rest: json result: ['myfoo'] 2024-09-22T08:38:31.461 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'bucket': 'myfoo', 'stats': True} 2024-09-22T08:38:31.465 INFO:tasks.radosgw_admin_rest: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': 'd89f6f57-1007-47dd-9065-f486c7b01aec', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': 'e239248c-0bee-4e41-803a-24b288d3eb8f.4226.11', 'marker': 'e239248c-0bee-4e41-803a-24b288d3eb8f.4226.11', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'reshard_status': 'None', 'judge_reshard_lock_time': '0.000000', 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-22T08:38:31.452633Z', 'creation_time': '2024-09-22T08:38:31.449245Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'read_tracker': 1} 2024-09-22T08:38:31.465 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'uid': 'foo', 'stats': True} 2024-09-22T08:38:31.470 INFO:tasks.radosgw_admin_rest: json result: [{'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': 'd89f6f57-1007-47dd-9065-f486c7b01aec', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': 'e239248c-0bee-4e41-803a-24b288d3eb8f.4226.11', 'marker': 'e239248c-0bee-4e41-803a-24b288d3eb8f.4226.11', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'reshard_status': 'None', 'judge_reshard_lock_time': '0.000000', 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-22T08:38:31.452633Z', 'creation_time': '2024-09-22T08:38:31.449245Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'read_tracker': 1}] 2024-09-22T08:38:31.474 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'bucket': 'myfoo', 'stats': True} 2024-09-22T08:38:31.478 INFO:tasks.radosgw_admin_rest: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': 'd89f6f57-1007-47dd-9065-f486c7b01aec', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': 'e239248c-0bee-4e41-803a-24b288d3eb8f.4226.11', 'marker': 'e239248c-0bee-4e41-803a-24b288d3eb8f.4226.11', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'reshard_status': 'None', 'judge_reshard_lock_time': '0.000000', 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#2,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-22T08:38:31.452633Z', 'creation_time': '2024-09-22T08:38:31.449245Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 3, 'size_actual': 4096, 'size_utilized': 3, 'size_kb': 1, 'size_kb_actual': 4, 'size_kb_utilized': 1, 'num_objects': 1}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'read_tracker': 1} 2024-09-22T08:38:31.479 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'bucket': 'doesnotexist'} 2024-09-22T08:38:31.486 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchBucket', 'Message': '', 'RequestId': 'tx000007dbfdcea8783a483-0066efd787-4226-default', 'HostId': '4226-default-default'} 2024-09-22T08:38:31.490 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'unlink'] {'uid': 'foo', 'bucket': 'myfoo'} 2024-09-22T08:38:31.497 INFO:tasks.radosgw_admin_rest: empty result 2024-09-22T08:38:31.497 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'create'] {'uid': 'fud', 'display-name': 'Fud', 'access-key': 'p5YnriCv1nAtykxBrupQ', 'secret-key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'max-buckets': '1'} 2024-09-22T08:38:31.505 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'fud', 'tenant': '', 'user_id': 'fud', 'display_name': 'Fud', 'email': '', 'suspended': 0, 'max_buckets': 1, 'subusers': [], 'keys': [{'user': 'fud', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-22T08:38:31.513 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'link'] {'uid': 'fud', 'bucket': 'myfoo', 'bucket-id': 'e239248c-0bee-4e41-803a-24b288d3eb8f.4226.11'} 2024-09-22T08:38:31.522 INFO:tasks.radosgw_admin_rest: empty result 2024-09-22T08:38:31.571 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'link'] {'uid': 'foo', 'bucket': 'myfoo', 'bucket-id': 'e239248c-0bee-4e41-803a-24b288d3eb8f.4226.11'} 2024-09-22T08:38:31.581 INFO:tasks.radosgw_admin_rest: empty result 2024-09-22T08:38:31.582 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'rm'] {'uid': 'fud'} 2024-09-22T08:38:31.590 INFO:tasks.radosgw_admin_rest: empty result 2024-09-22T08:38:31.597 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['object', 'rm'] {'bucket': 'myfoo', 'object': 'four'} 2024-09-22T08:38:31.602 INFO:tasks.radosgw_admin_rest: empty result 2024-09-22T08:38:31.602 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'bucket': 'myfoo', 'stats': True} 2024-09-22T08:38:31.607 INFO:tasks.radosgw_admin_rest: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': 'd89f6f57-1007-47dd-9065-f486c7b01aec', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': 'e239248c-0bee-4e41-803a-24b288d3eb8f.4226.11', 'marker': 'e239248c-0bee-4e41-803a-24b288d3eb8f.4226.11', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'reshard_status': 'None', 'judge_reshard_lock_time': '0.000000', 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#3,6#3,7#1,8#3,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-22T08:38:31.576518Z', 'creation_time': '2024-09-22T08:38:31.449245Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'read_tracker': 3} 2024-09-22T08:39:31.653 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'categories': 'delete_obj'} 2024-09-22T08:39:31.670 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-09-22T08:00:00.000000Z', 'epoch': 1726992000, 'owner': 'anonymous', 'categories': [], 's3select': {}}]}, {'user': 'bar', 'buckets': [{'bucket': 'myfoo6', 'time': '2024-09-22T08:00:00.000000Z', 'epoch': 1726992000, 'owner': 'bar', 'categories': [], 's3select': {}}]}, {'user': 'bud', 'buckets': [{'bucket': 'myfoo6', 'time': '2024-09-22T08:00:00.000000Z', 'epoch': 1726992000, 'owner': 'bud', 'categories': [], 's3select': {}}]}, {'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-22T08:00:00.000000Z', 'epoch': 1726992000, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}], 's3select': {}}, {'bucket': 'useless-bucket', 'time': '2024-09-22T08:00:00.000000Z', 'epoch': 1726992000, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}]}, {'user': 'fud', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-22T08:00:00.000000Z', 'epoch': 1726992000, 'owner': 'fud', 'categories': [], 's3select': {}}, {'bucket': 'myfoo7', 'time': '2024-09-22T08:00:00.000000Z', 'epoch': 1726992000, 'owner': 'fud', 'categories': [], 's3select': {}}]}], 'summary': [{'user': 'anonymous', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'bar', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'bud', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'fud', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-22T08:39:31.670 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] None 2024-09-22T08:39:31.685 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-09-22T08:00:00.000000Z', 'epoch': 1726992000, 'owner': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}, {'user': 'bar', 'buckets': [{'bucket': 'myfoo6', 'time': '2024-09-22T08:00:00.000000Z', 'epoch': 1726992000, 'owner': 'bar', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 8, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}, {'user': 'bud', 'buckets': [{'bucket': 'myfoo6', 'time': '2024-09-22T08:00:00.000000Z', 'epoch': 1726992000, 'owner': 'bud', 'categories': [{'category': 'get_obj', 'bytes_sent': 16, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'stat_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}, {'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-22T08:00:00.000000Z', 'epoch': 1726992000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 10, 'ops': 3, 'successful_ops': 3}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'useless-bucket', 'time': '2024-09-22T08:00:00.000000Z', 'epoch': 1726992000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 14, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}, {'user': 'fud', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-22T08:00:00.000000Z', 'epoch': 1726992000, 'owner': 'fud', 'categories': [{'category': 'put_obj', 'bytes_sent': 234, 'bytes_received': 0, 'ops': 1, 'successful_ops': 0}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo7', 'time': '2024-09-22T08:00:00.000000Z', 'epoch': 1726992000, 'owner': 'fud', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'get_obj', 'bytes_sent': 8, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 8, 'ops': 1, 'successful_ops': 1}, {'category': 'stat_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}], 'summary': [{'user': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'bar', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 8, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 0, 'bytes_received': 8, 'ops': 2, 'successful_ops': 2, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'bud', 'categories': [{'category': 'get_obj', 'bytes_sent': 16, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'stat_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}], 'total': {'bytes_sent': 16, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 24, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 24, 'ops': 10, 'successful_ops': 10, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'fud', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'get_obj', 'bytes_sent': 8, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 234, 'bytes_received': 8, 'ops': 2, 'successful_ops': 1}, {'category': 'stat_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 242, 'bytes_received': 8, 'ops': 5, 'successful_ops': 4, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-22T08:39:31.685 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo'} 2024-09-22T08:39:31.690 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-22T08:00:00.000000Z', 'epoch': 1726992000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 10, 'ops': 3, 'successful_ops': 3}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'useless-bucket', 'time': '2024-09-22T08:00:00.000000Z', 'epoch': 1726992000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 14, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 24, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 24, 'ops': 10, 'successful_ops': 10, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-22T08:39:31.691 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo', 'categories': 'create_bucket'} 2024-09-22T08:39:31.695 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-22T08:00:00.000000Z', 'epoch': 1726992000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}, {'bucket': 'useless-bucket', 'time': '2024-09-22T08:00:00.000000Z', 'epoch': 1726992000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-22T08:39:31.695 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo', 'categories': 'put_obj'} 2024-09-22T08:39:31.699 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-22T08:00:00.000000Z', 'epoch': 1726992000, 'owner': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 10, 'ops': 3, 'successful_ops': 3}], 's3select': {}}, {'bucket': 'useless-bucket', 'time': '2024-09-22T08:00:00.000000Z', 'epoch': 1726992000, 'owner': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 14, 'ops': 1, 'successful_ops': 1}], 's3select': {}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 24, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 24, 'ops': 4, 'successful_ops': 4, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-22T08:39:31.699 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo', 'categories': 'delete_obj'} 2024-09-22T08:39:31.703 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-22T08:00:00.000000Z', 'epoch': 1726992000, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}], 's3select': {}}, {'bucket': 'useless-bucket', 'time': '2024-09-22T08:00:00.000000Z', 'epoch': 1726992000, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-22T08:39:31.704 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo', 'categories': 'delete_bucket'} 2024-09-22T08:39:31.708 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-22T08:00:00.000000Z', 'epoch': 1726992000, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'useless-bucket', 'time': '2024-09-22T08:00:00.000000Z', 'epoch': 1726992000, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-22T08:39:31.708 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'trim'] {'uid': 'foo'} 2024-09-22T08:39:31.715 INFO:tasks.radosgw_admin_rest: empty result 2024-09-22T08:39:31.715 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo'} 2024-09-22T08:39:31.719 INFO:tasks.radosgw_admin_rest: json result: {'entries': [], 'summary': []} 2024-09-22T08:39:31.719 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'modify'] {'uid': 'foo', 'suspended': True} 2024-09-22T08:39:31.728 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-22T08:39:31.732 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'modify'] {'uid': 'foo', 'suspended': 'false'} 2024-09-22T08:39:31.741 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-22T08:39:31.963 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'rm'] {'uid': 'foo'} 2024-09-22T08:39:31.968 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'BucketAlreadyExists', 'Message': '', 'RequestId': 'tx00000ef56221c425df7b9-0066efd7c3-4226-default', 'HostId': '4226-default-default'} 2024-09-22T08:39:32.063 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['policy', 'show'] {'bucket': 'myfoo', 'object': b'bb3aec0fdcdbc2974890f805c585d432'} 2024-09-22T08:39:32.067 INFO:tasks.radosgw_admin_rest: json result: {'acl': {'acl_user_map': [{'user': 'foo', 'acl': 15}], 'acl_group_map': [], 'grant_map': [{'id': 'foo', 'grant': {'type': {'type': 0}, 'id': 'foo', 'name': 'Foo', 'permission': {'flags': 15}}}]}, 'owner': {'id': 'foo', 'display_name': 'Foo'}} 2024-09-22T08:39:32.071 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['policy', 'show'] {'bucket': 'myfoo', 'object': b'bb3aec0fdcdbc2974890f805c585d432'} 2024-09-22T08:39:32.075 INFO:tasks.radosgw_admin_rest: json result: {'acl': {'acl_user_map': [{'user': 'foo', 'acl': 15}], 'acl_group_map': [{'group': 1, 'acl': 1}], 'grant_map': [{'id': '', 'grant': {'type': {'type': 2}, 'group': 1, 'permission': {'flags': 1}}}, {'id': 'foo', 'grant': {'type': {'type': 0}, 'id': 'foo', 'name': 'Foo', 'permission': {'flags': 15}}}]}, 'owner': {'id': 'foo', 'display_name': 'Foo'}} 2024-09-22T08:39:32.191 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'rm'] {'bucket': 'myfoo', 'purge-objects': True} 2024-09-22T08:39:32.227 INFO:tasks.radosgw_admin_rest: empty result 2024-09-22T08:39:32.227 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['caps', 'add'] {'uid': 'foo', 'user-caps': 'usage=read'} 2024-09-22T08:39:32.233 INFO:tasks.radosgw_admin_rest: json result: [{'type': 'usage', 'perm': 'read'}] 2024-09-22T08:39:32.233 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['caps', 'rm'] {'uid': 'foo', 'user-caps': 'usage=read'} 2024-09-22T08:39:32.239 INFO:tasks.radosgw_admin_rest: json result: [] 2024-09-22T08:39:32.252 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'rm'] {'uid': 'foo'} 2024-09-22T08:39:32.256 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'BucketAlreadyExists', 'Message': '', 'RequestId': 'tx000007abc5fc4df774415-0066efd7c4-4226-default', 'HostId': '4226-default-default'} 2024-09-22T08:39:32.277 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'rm'] {'uid': 'foo', 'purge-data': True} 2024-09-22T08:39:32.308 INFO:tasks.radosgw_admin_rest: empty result 2024-09-22T08:39:32.309 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-22T08:39:32.313 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchUser', 'Message': '', 'RequestId': 'tx000008df65993190e7aa6-0066efd7c4-4226-default', 'HostId': '4226-default-default'} 2024-09-22T08:39:32.313 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['info', ''] None 2024-09-22T08:39:32.316 INFO:tasks.radosgw_admin_rest: json result: {'info': {'storage_backends': [{'name': 'rados', 'cluster_id': 'd3faaa46-a06c-404a-b783-532e7c90ea63'}]}} 2024-09-22T08:39:32.316 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'create'] {'uid': 'ratelimit_user', 'display-name': 'Foo', 'email': 'foo@foo.com', 'access-key': '9te6NH5mcdcq0Tc5i8i1', 'secret-key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'max-buckets': '1000'} 2024-09-22T08:39:32.326 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'ratelimit_user', 'tenant': '', 'user_id': 'ratelimit_user', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'ratelimit_user', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-22T08:39:32.326 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_user'} 2024-09-22T08:39:32.330 INFO:tasks.radosgw_admin_rest: json result: {'user_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}} 2024-09-22T08:39:32.330 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_userstring'} 2024-09-22T08:39:32.335 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchKey', 'Message': '', 'RequestId': 'tx00000b4f83c8f56c1b6cc-0066efd7c4-4226-default', 'HostId': '4226-default-default'} 2024-09-22T08:39:32.335 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'user'} 2024-09-22T08:39:32.338 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'InvalidArgument', 'Message': '', 'RequestId': 'tx000002fa4ffc0b492234f-0066efd7c4-4226-default', 'HostId': '4226-default-default'} 2024-09-22T08:39:32.348 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucket'} 2024-09-22T08:39:32.352 INFO:tasks.radosgw_admin_rest: json result: {'bucket_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}} 2024-09-22T08:39:32.353 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucketstring'} 2024-09-22T08:39:32.356 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchKey', 'Message': '', 'RequestId': 'tx00000dd8d1bbb3ffe6a71-0066efd7c4-4226-default', 'HostId': '4226-default-default'} 2024-09-22T08:39:32.357 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'bucket'} 2024-09-22T08:39:32.360 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'InvalidArgument', 'Message': '', 'RequestId': 'tx0000085c99238d219829a-0066efd7c4-4226-default', 'HostId': '4226-default-default'} 2024-09-22T08:39:32.360 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'global': 'true'} 2024-09-22T08:39:32.364 INFO:tasks.radosgw_admin_rest: json result: {'bucket_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}, 'user_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}, 'anonymous_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}} 2024-09-22T08:39:32.365 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_userstring', 'enabled': 'true'} 2024-09-22T08:39:32.368 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchKey', 'Message': '', 'RequestId': 'tx00000e6850eff3926914c-0066efd7c4-4226-default', 'HostId': '4226-default-default'} 2024-09-22T08:39:32.368 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'user'} 2024-09-22T08:39:32.371 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'InvalidArgument', 'Message': '', 'RequestId': 'tx0000057d73cb2884843cb-0066efd7c4-4226-default', 'HostId': '4226-default-default'} 2024-09-22T08:39:32.372 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucketstring', 'enabled': 'true'} 2024-09-22T08:39:32.375 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchKey', 'Message': '', 'RequestId': 'tx00000668b0d3bcbf8f71f-0066efd7c4-4226-default', 'HostId': '4226-default-default'} 2024-09-22T08:39:32.375 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'bucket', 'enabled': 'true'} 2024-09-22T08:39:32.378 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'InvalidArgument', 'Message': '', 'RequestId': 'tx0000077a4f2df7df85612-0066efd7c4-4226-default', 'HostId': '4226-default-default'} 2024-09-22T08:39:32.379 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_user', 'enabled': 'true', 'max-read-bytes': '2'} 2024-09-22T08:39:32.387 INFO:tasks.radosgw_admin_rest: empty result 2024-09-22T08:39:32.388 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_user'} 2024-09-22T08:39:32.391 INFO:tasks.radosgw_admin_rest: json result: {'user_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 2, 'max_write_bytes': 0, 'enabled': True}} 2024-09-22T08:39:32.391 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucket', 'enabled': 'true', 'max-write-bytes': '2'} 2024-09-22T08:39:32.396 INFO:tasks.radosgw_admin_rest: empty result 2024-09-22T08:39:32.397 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucket'} 2024-09-22T08:39:32.400 INFO:tasks.radosgw_admin_rest: json result: {'bucket_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 2, 'enabled': True}} 2024-09-22T08:39:32.400 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'bucket', 'global': 'true', 'enabled': 'true'} 2024-09-22T08:39:32.405 INFO:tasks.radosgw_admin_rest: empty result 2024-09-22T08:39:32.410 DEBUG:teuthology.run_tasks:Unwinding manager rgw 2024-09-22T08:39:32.419 DEBUG:tasks.rgw.client.0:waiting for process to exit 2024-09-22T08:39:32.419 INFO:teuthology.orchestra.run:waiting for 300 2024-09-22T08:39:32.420 INFO:tasks.rgw.client.0.smithi142.stdout:2024-09-22T08:39:32.419+0000 7f6bfd5cd640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term radosgw --rgw-frontends beast port=80 -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground (PID: 35916) UID: 0 2024-09-22T08:39:32.420 INFO:tasks.rgw.client.0.smithi142.stdout:2024-09-22T08:39:32.419+0000 7f6c02f22880 -1 shutting down 2024-09-22T08:39:38.520 INFO:tasks.rgw.client.0:Stopped 2024-09-22T08:39:38.521 DEBUG:teuthology.orchestra.run.smithi142:> rm -f /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock 2024-09-22T08:39:38.540 DEBUG:teuthology.orchestra.run.smithi142:> sudo rm -f /etc/ceph/vault-root-token 2024-09-22T08:39:38.609 DEBUG:teuthology.orchestra.run.smithi142:> sudo rm -f /home/ubuntu/cephtest/url_file 2024-09-22T08:39:38.679 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process', '--include-all'] 2024-09-22T08:39:38.679 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process', '--include-all'] 2024-09-22T08:39:38.679 DEBUG:teuthology.orchestra.run.smithi142:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process --include-all 2024-09-22T08:39:38.768 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:39:38.768 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:39:38.769 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.768+0000 7fa64b920800 1 Processor -- start 2024-09-22T08:39:38.769 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.768+0000 7fa64b920800 1 -- start start 2024-09-22T08:39:38.769 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.768+0000 7fa64b920800 1 --2- >> v2:172.21.15.31:3300/0 conn(0x561a957d2c10 0x561a957d50b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:39:38.769 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.768+0000 7fa64b920800 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x561a95657a20 con 0x561a957404f0 2024-09-22T08:39:38.769 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.768+0000 7fa64b920800 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x561a956577d0 con 0x561a957d2c10 2024-09-22T08:39:38.770 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.768+0000 7fa646d01640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x561a957d2c10 0x561a957d50b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:39:38.770 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.768+0000 7fa646d01640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x561a957d2c10 0x561a957d50b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:45622/0 (socket says 172.21.15.142:45622) 2024-09-22T08:39:38.770 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.768+0000 7fa646d01640 1 -- 172.21.15.142:0/3183504801 learned_addr learned my addr 172.21.15.142:0/3183504801 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:39:38.770 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.768+0000 7fa647502640 1 --1- 172.21.15.142:0/3183504801 >> v1:172.21.15.31:6789/0 conn(0x561a957404f0 0x561a957d14f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.142:54252/0 (socket says 172.21.15.142:54252) 2024-09-22T08:39:38.770 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.769+0000 7fa646d01640 1 -- 172.21.15.142:0/3183504801 >> v1:172.21.15.31:6789/0 conn(0x561a957404f0 legacy=0x561a957d14f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:39:38.770 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.769+0000 7fa646d01640 1 -- 172.21.15.142:0/3183504801 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x561a957d6790 con 0x561a957d2c10 2024-09-22T08:39:38.772 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.771+0000 7fa646d01640 1 --2- 172.21.15.142:0/3183504801 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561a957d2c10 0x561a957d50b0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7fa63000a520 tx=0x7fa630045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7809d97b3d24d393 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:39:38.772 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.771+0000 7fa646500640 1 -- 172.21.15.142:0/3183504801 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa630055070 con 0x561a957d2c10 2024-09-22T08:39:38.772 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.771+0000 7fa646500640 1 -- 172.21.15.142:0/3183504801 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6300515b0 con 0x561a957d2c10 2024-09-22T08:39:38.772 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.771+0000 7fa646500640 1 -- 172.21.15.142:0/3183504801 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa6300518d0 con 0x561a957d2c10 2024-09-22T08:39:38.773 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.771+0000 7fa64b920800 1 -- 172.21.15.142:0/3183504801 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561a957d2c10 msgr2=0x561a957d50b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:39:38.773 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.771+0000 7fa64b920800 1 --2- 172.21.15.142:0/3183504801 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561a957d2c10 0x561a957d50b0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7fa63000a520 tx=0x7fa630045ba0 comp rx=0 tx=0).stop 2024-09-22T08:39:38.773 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.771+0000 7fa64b920800 1 -- 172.21.15.142:0/3183504801 shutdown_connections 2024-09-22T08:39:38.773 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.771+0000 7fa64b920800 1 --2- 172.21.15.142:0/3183504801 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561a957d2c10 0x561a957d50b0 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:39:38.773 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.771+0000 7fa64b920800 1 -- 172.21.15.142:0/3183504801 >> 172.21.15.142:0/3183504801 conn(0x561a957c6be0 msgr2=0x561a957c9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:39:38.773 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.771+0000 7fa64b920800 1 -- 172.21.15.142:0/3183504801 shutdown_connections 2024-09-22T08:39:38.773 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.771+0000 7fa64b920800 1 -- 172.21.15.142:0/3183504801 wait complete. 2024-09-22T08:39:38.788 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.787+0000 7fa64b920800 1 Processor -- start 2024-09-22T08:39:38.788 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.787+0000 7fa64b920800 1 -- start start 2024-09-22T08:39:38.788 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.787+0000 7fa64b920800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561a957404f0 0x561a958be1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:39:38.788 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.787+0000 7fa64b920800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x561a95664dd0 con 0x561a957404f0 2024-09-22T08:39:38.789 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.787+0000 7fa647502640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561a957404f0 0x561a958be1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:39:38.789 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.788+0000 7fa647502640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561a957404f0 0x561a958be1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:45636/0 (socket says 172.21.15.142:45636) 2024-09-22T08:39:38.789 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.788+0000 7fa647502640 1 -- 172.21.15.142:0/3392600857 learned_addr learned my addr 172.21.15.142:0/3392600857 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:39:38.789 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.788+0000 7fa647502640 1 -- 172.21.15.142:0/3392600857 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561a958be7c0 con 0x561a957404f0 2024-09-22T08:39:38.790 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.788+0000 7fa647502640 1 --2- 172.21.15.142:0/3392600857 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561a957404f0 0x561a958be1d0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7fa6380016e0 tx=0x7fa638001ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d06e834acd406d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:39:38.790 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.788+0000 7fa53560a640 1 -- 172.21.15.142:0/3392600857 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa638013420 con 0x561a957404f0 2024-09-22T08:39:38.790 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.788+0000 7fa53560a640 1 -- 172.21.15.142:0/3392600857 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6380135e0 con 0x561a957404f0 2024-09-22T08:39:38.790 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.788+0000 7fa53560a640 1 -- 172.21.15.142:0/3392600857 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa638013900 con 0x561a957404f0 2024-09-22T08:39:38.791 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.789+0000 7fa64b920800 1 -- 172.21.15.142:0/3392600857 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561a957404f0 msgr2=0x561a958be1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:39:38.791 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.789+0000 7fa64b920800 1 --2- 172.21.15.142:0/3392600857 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561a957404f0 0x561a958be1d0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7fa6380016e0 tx=0x7fa638001ba0 comp rx=0 tx=0).stop 2024-09-22T08:39:38.791 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.789+0000 7fa64b920800 1 -- 172.21.15.142:0/3392600857 shutdown_connections 2024-09-22T08:39:38.792 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.789+0000 7fa64b920800 1 --2- 172.21.15.142:0/3392600857 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561a957404f0 0x561a958be1d0 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:39:38.792 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.789+0000 7fa64b920800 1 -- 172.21.15.142:0/3392600857 >> 172.21.15.142:0/3392600857 conn(0x561a957c6be0 msgr2=0x561a958b9b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:39:38.792 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.789+0000 7fa64b920800 1 -- 172.21.15.142:0/3392600857 shutdown_connections 2024-09-22T08:39:38.792 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.789+0000 7fa64b920800 1 -- 172.21.15.142:0/3392600857 wait complete. 2024-09-22T08:39:38.792 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.789+0000 7fa64b920800 1 Processor -- start 2024-09-22T08:39:38.792 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.789+0000 7fa64b920800 1 -- start start 2024-09-22T08:39:38.792 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.790+0000 7fa64b920800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561a957404f0 0x561a958c5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:39:38.792 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.790+0000 7fa64b920800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x561a957d5a30 con 0x561a957404f0 2024-09-22T08:39:38.792 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.790+0000 7fa647502640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561a957404f0 0x561a958c5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:39:38.792 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.790+0000 7fa647502640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561a957404f0 0x561a958c5ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:45638/0 (socket says 172.21.15.142:45638) 2024-09-22T08:39:38.792 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.790+0000 7fa647502640 1 -- 172.21.15.142:0/2933065137 learned_addr learned my addr 172.21.15.142:0/2933065137 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:39:38.792 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.790+0000 7fa647502640 1 -- 172.21.15.142:0/2933065137 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561a958c6240 con 0x561a957404f0 2024-09-22T08:39:38.792 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.790+0000 7fa647502640 1 --2- 172.21.15.142:0/2933065137 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561a957404f0 0x561a958c5ce0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7fa638000f80 tx=0x7fa638001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:39:38.794 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.790+0000 7fa533e07640 1 -- 172.21.15.142:0/2933065137 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa638022020 con 0x561a957404f0 2024-09-22T08:39:38.794 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.791+0000 7fa533e07640 1 -- 172.21.15.142:0/2933065137 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa638019040 con 0x561a957404f0 2024-09-22T08:39:38.795 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.791+0000 7fa64b920800 1 -- 172.21.15.142:0/2933065137 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561a958c64d0 con 0x561a957404f0 2024-09-22T08:39:38.795 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.791+0000 7fa533e07640 1 -- 172.21.15.142:0/2933065137 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa638004a40 con 0x561a957404f0 2024-09-22T08:39:38.795 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.791+0000 7fa64b920800 1 -- 172.21.15.142:0/2933065137 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561a958c6ed0 con 0x561a957404f0 2024-09-22T08:39:38.795 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.792+0000 7fa533e07640 1 -- 172.21.15.142:0/2933065137 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fa638025020 con 0x561a957404f0 2024-09-22T08:39:38.795 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.792+0000 7fa533e07640 1 --2- 172.21.15.142:0/2933065137 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fa52c03cfb0 0x7fa52c03f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:39:38.795 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.792+0000 7fa533e07640 1 -- 172.21.15.142:0/2933065137 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5938+0+0 (secure 0 0 0) 0x7fa6380543c0 con 0x561a957404f0 2024-09-22T08:39:38.795 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.792+0000 7fa646d01640 1 --2- 172.21.15.142:0/2933065137 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fa52c03cfb0 0x7fa52c03f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:39:38.795 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.792+0000 7fa64b920800 1 --2- 172.21.15.142:0/2933065137 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x561a957d2c10 0x561a958cd330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:39:38.795 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.792+0000 7fa64b920800 1 -- 172.21.15.142:0/2933065137 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a958cd870 con 0x561a957d2c10 2024-09-22T08:39:38.795 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.792+0000 7fa647d03640 1 --2- 172.21.15.142:0/2933065137 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x561a957d2c10 0x561a958cd330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:39:38.795 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.792+0000 7fa646d01640 1 --2- 172.21.15.142:0/2933065137 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fa52c03cfb0 0x7fa52c03f470 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fa630057000 tx=0x7fa630052000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:39:38.795 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.793+0000 7fa647d03640 1 --2- 172.21.15.142:0/2933065137 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x561a957d2c10 0x561a958cd330 crc :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:39:38.795 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.793+0000 7fa647d03640 1 -- 172.21.15.142:0/2933065137 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa6400083e0 con 0x561a957d2c10 2024-09-22T08:39:38.796 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.793+0000 7fa64b920800 1 -- 172.21.15.142:0/2933065137 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a958cdc10 con 0x561a957d2c10 2024-09-22T08:39:38.796 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.793+0000 7fa647d03640 1 -- 172.21.15.142:0/2933065137 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa6400083e0 con 0x561a957d2c10 2024-09-22T08:39:38.796 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.793+0000 7fa64b920800 1 --2- 172.21.15.142:0/2933065137 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x561a958cf710 0x561a958d1bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:39:38.796 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.793+0000 7fa64b920800 1 -- 172.21.15.142:0/2933065137 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:3 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a958d2340 con 0x561a958cf710 2024-09-22T08:39:38.796 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.793+0000 7fa647502640 1 --2- 172.21.15.142:0/2933065137 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x561a958cf710 0x561a958d1bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:39:38.796 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.793+0000 7fa647502640 1 --2- 172.21.15.142:0/2933065137 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x561a958cf710 0x561a958d1bb0 crc :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:39:38.798 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.794+0000 7fa647502640 1 -- 172.21.15.142:0/2933065137 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(3 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fa63800f030 con 0x561a958cf710 2024-09-22T08:39:38.798 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.794+0000 7fa64b920800 1 -- 172.21.15.142:0/2933065137 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a958ce460 con 0x561a957d2c10 2024-09-22T08:39:38.798 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.794+0000 7fa647d03640 1 -- 172.21.15.142:0/2933065137 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa6400083e0 con 0x561a957d2c10 2024-09-22T08:39:38.798 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.794+0000 7fa64b920800 1 -- 172.21.15.142:0/2933065137 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a958ce8b0 con 0x561a958cf710 2024-09-22T08:39:38.798 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.795+0000 7fa647502640 1 -- 172.21.15.142:0/2933065137 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(5 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fa63800f030 con 0x561a958cf710 2024-09-22T08:39:38.798 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.795+0000 7fa64b920800 1 Processor -- start 2024-09-22T08:39:38.798 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.795+0000 7fa64b920800 1 -- start start 2024-09-22T08:39:38.798 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.795+0000 7fa64b920800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561a958e0d60 0x561a958e1180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:39:38.798 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.795+0000 7fa64b920800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x561a956c3d50 con 0x561a958e0d60 2024-09-22T08:39:38.798 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.796+0000 7fa647d03640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561a958e0d60 0x561a958e1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:39:38.799 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.796+0000 7fa647d03640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561a958e0d60 0x561a958e1180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:45652/0 (socket says 172.21.15.142:45652) 2024-09-22T08:39:38.799 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.796+0000 7fa647d03640 1 -- 172.21.15.142:0/3280978012 learned_addr learned my addr 172.21.15.142:0/3280978012 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:39:38.799 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.796+0000 7fa647d03640 1 -- 172.21.15.142:0/3280978012 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561a958e17c0 con 0x561a958e0d60 2024-09-22T08:39:38.799 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.796+0000 7fa647d03640 1 --2- 172.21.15.142:0/3280978012 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561a958e0d60 0x561a958e1180 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x561a958c6ce0 tx=0x7fa64000bf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:39:38.799 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.796+0000 7fa531602640 1 -- 172.21.15.142:0/3280978012 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa64001c020 con 0x561a958e0d60 2024-09-22T08:39:38.799 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.796+0000 7fa531602640 1 -- 172.21.15.142:0/3280978012 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa640007c90 con 0x561a958e0d60 2024-09-22T08:39:38.799 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.796+0000 7fa64b920800 1 -- 172.21.15.142:0/3280978012 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561a958e1ff0 con 0x561a958e0d60 2024-09-22T08:39:38.799 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.796+0000 7fa531602640 1 -- 172.21.15.142:0/3280978012 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa640018440 con 0x561a958e0d60 2024-09-22T08:39:38.799 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.797+0000 7fa64b920800 1 -- 172.21.15.142:0/3280978012 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561a958e2590 con 0x561a958e0d60 2024-09-22T08:39:38.804 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.797+0000 7fa531602640 1 -- 172.21.15.142:0/3280978012 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fa64001f020 con 0x561a958e0d60 2024-09-22T08:39:38.804 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.798+0000 7fa531602640 1 --2- 172.21.15.142:0/3280978012 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fa52003cfb0 0x7fa52003f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:39:38.805 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.798+0000 7fa531602640 1 -- 172.21.15.142:0/3280978012 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5938+0+0 (secure 0 0 0) 0x7fa640055910 con 0x561a958e0d60 2024-09-22T08:39:38.805 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.798+0000 7fa647502640 1 --2- 172.21.15.142:0/3280978012 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fa52003cfb0 0x7fa52003f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:39:38.805 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.798+0000 7fa64b920800 1 Processor -- start 2024-09-22T08:39:38.805 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.798+0000 7fa647502640 1 --2- 172.21.15.142:0/3280978012 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fa52003cfb0 0x7fa52003f470 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x561a958ce800 tx=0x7fa638052800 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:39:38.805 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.798+0000 7fa64b920800 1 -- start start 2024-09-22T08:39:38.805 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.798+0000 7fa64b920800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561a958ed7c0 0x561a958edbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:39:38.805 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.798+0000 7fa64b920800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x561a958bebf0 con 0x561a958ed7c0 2024-09-22T08:39:38.805 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.799+0000 7fa647d03640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561a958ed7c0 0x561a958edbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:39:38.805 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.799+0000 7fa647d03640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561a958ed7c0 0x561a958edbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:45654/0 (socket says 172.21.15.142:45654) 2024-09-22T08:39:38.805 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.799+0000 7fa647d03640 1 -- 172.21.15.142:0/1858039100 learned_addr learned my addr 172.21.15.142:0/1858039100 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:39:38.805 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.799+0000 7fa647d03640 1 -- 172.21.15.142:0/1858039100 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561a958ee1b0 con 0x561a958ed7c0 2024-09-22T08:39:38.805 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.799+0000 7fa647d03640 1 --2- 172.21.15.142:0/1858039100 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561a958ed7c0 0x561a958edbc0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7fa640053df0 tx=0x7fa640015820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5a593803c5a2c29 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:39:38.805 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.799+0000 7fa52affd640 1 -- 172.21.15.142:0/1858039100 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa6400174d0 con 0x561a958ed7c0 2024-09-22T08:39:38.805 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.799+0000 7fa52affd640 1 -- 172.21.15.142:0/1858039100 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa640052070 con 0x561a958ed7c0 2024-09-22T08:39:38.806 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.799+0000 7fa52affd640 1 -- 172.21.15.142:0/1858039100 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa640016d80 con 0x561a958ed7c0 2024-09-22T08:39:38.806 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.800+0000 7fa64b920800 1 -- 172.21.15.142:0/1858039100 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561a958ed7c0 msgr2=0x561a958edbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:39:38.806 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.800+0000 7fa64b920800 1 --2- 172.21.15.142:0/1858039100 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561a958ed7c0 0x561a958edbc0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7fa640053df0 tx=0x7fa640015820 comp rx=0 tx=0).stop 2024-09-22T08:39:38.806 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.800+0000 7fa64b920800 1 -- 172.21.15.142:0/1858039100 shutdown_connections 2024-09-22T08:39:38.806 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.800+0000 7fa64b920800 1 --2- 172.21.15.142:0/1858039100 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561a958ed7c0 0x561a958edbc0 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:39:38.806 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.800+0000 7fa64b920800 1 -- 172.21.15.142:0/1858039100 >> 172.21.15.142:0/1858039100 conn(0x561a958e9bc0 msgr2=0x561a958e7e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:39:38.806 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.800+0000 7fa64b920800 1 -- 172.21.15.142:0/1858039100 shutdown_connections 2024-09-22T08:39:38.806 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.800+0000 7fa64b920800 1 -- 172.21.15.142:0/1858039100 wait complete. 2024-09-22T08:39:38.806 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.800+0000 7fa64b920800 1 Processor -- start 2024-09-22T08:39:38.806 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.800+0000 7fa64b920800 1 -- start start 2024-09-22T08:39:38.806 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.800+0000 7fa64b920800 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561a958ed7c0 0x561a958f4d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:39:38.806 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.801+0000 7fa64b920800 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x561a958ee7d0 con 0x561a958ed7c0 2024-09-22T08:39:38.806 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.801+0000 7fa647d03640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561a958ed7c0 0x561a958f4d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:39:38.806 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.801+0000 7fa647d03640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561a958ed7c0 0x561a958f4d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.142:45664/0 (socket says 172.21.15.142:45664) 2024-09-22T08:39:38.806 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.801+0000 7fa647d03640 1 -- 172.21.15.142:0/2392704388 learned_addr learned my addr 172.21.15.142:0/2392704388 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-22T08:39:38.807 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.801+0000 7fa647d03640 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561a958f5290 con 0x561a958ed7c0 2024-09-22T08:39:38.807 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.801+0000 7fa647d03640 1 --2- 172.21.15.142:0/2392704388 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561a958ed7c0 0x561a958f4d30 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7fa6400206f0 tx=0x7fa6400088f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:39:38.807 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.801+0000 7fa5297fa640 1 -- 172.21.15.142:0/2392704388 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa640013e80 con 0x561a958ed7c0 2024-09-22T08:39:38.807 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.801+0000 7fa5297fa640 1 -- 172.21.15.142:0/2392704388 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6400189d0 con 0x561a958ed7c0 2024-09-22T08:39:38.807 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.801+0000 7fa5297fa640 1 -- 172.21.15.142:0/2392704388 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa640018cb0 con 0x561a958ed7c0 2024-09-22T08:39:38.807 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.801+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561a958f5520 con 0x561a958ed7c0 2024-09-22T08:39:38.807 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.801+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561a958f5520 con 0x561a958ed7c0 2024-09-22T08:39:38.807 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.802+0000 7fa5297fa640 1 -- 172.21.15.142:0/2392704388 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fa640031060 con 0x561a958ed7c0 2024-09-22T08:39:38.807 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.802+0000 7fa5297fa640 1 --2- 172.21.15.142:0/2392704388 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fa51003d000 0x7fa51003f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:39:38.807 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.803+0000 7fa5297fa640 1 -- 172.21.15.142:0/2392704388 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5938+0+0 (secure 0 0 0) 0x7fa64003bac0 con 0x561a958ed7c0 2024-09-22T08:39:38.807 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.803+0000 7fa647502640 1 --2- 172.21.15.142:0/2392704388 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fa51003d000 0x7fa51003f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:39:38.807 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.803+0000 7fa647502640 1 --2- 172.21.15.142:0/2392704388 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fa51003d000 0x7fa51003f4c0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fa63801db50 tx=0x7fa63804f000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:39:38.807 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.803+0000 7fa64b920800 20 rados->read ofs=0 len=0 2024-09-22T08:39:38.807 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.803+0000 7fa64b920800 1 --2- 172.21.15.142:0/2392704388 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x561a959004c0 0x561a95902980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:39:38.808 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.803+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a959030d0 con 0x561a959004c0 2024-09-22T08:39:38.808 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.803+0000 7fa646d01640 1 --2- 172.21.15.142:0/2392704388 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x561a959004c0 0x561a95902980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:39:38.813 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.804+0000 7fa646d01640 1 --2- 172.21.15.142:0/2392704388 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x561a959004c0 0x561a95902980 crc :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:39:38.813 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.804+0000 7fa646d01640 1 -- 172.21.15.142:0/2392704388 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa630057030 con 0x561a959004c0 2024-09-22T08:39:38.813 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.804+0000 7fa64b920800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:38.813 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.804+0000 7fa64b920800 20 realm 2024-09-22T08:39:38.814 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.804+0000 7fa64b920800 20 rados->read ofs=0 len=0 2024-09-22T08:39:38.814 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.804+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a95903500 con 0x561a959004c0 2024-09-22T08:39:38.814 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.804+0000 7fa646d01640 1 -- 172.21.15.142:0/2392704388 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa630057030 con 0x561a959004c0 2024-09-22T08:39:38.814 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.804+0000 7fa64b920800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:38.814 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.804+0000 7fa64b920800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:39:38.814 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.804+0000 7fa64b920800 20 rados->read ofs=0 len=0 2024-09-22T08:39:38.814 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.804+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a95903dd0 con 0x561a959004c0 2024-09-22T08:39:38.814 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.804+0000 7fa646d01640 1 -- 172.21.15.142:0/2392704388 <== osd.1 v2:172.21.15.142:6816/3192108003 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa630057030 con 0x561a959004c0 2024-09-22T08:39:38.814 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.804+0000 7fa64b920800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:38.814 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.804+0000 7fa64b920800 20 rados->read ofs=0 len=0 2024-09-22T08:39:38.814 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.804+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a95904170 con 0x561a959004c0 2024-09-22T08:39:38.814 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.805+0000 7fa646d01640 1 -- 172.21.15.142:0/2392704388 <== osd.1 v2:172.21.15.142:6816/3192108003 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa630057030 con 0x561a959004c0 2024-09-22T08:39:38.814 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.805+0000 7fa64b920800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:39:38.815 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.805+0000 7fa64b920800 20 rados->read ofs=0 len=0 2024-09-22T08:39:38.815 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.805+0000 7fa64b920800 1 --2- 172.21.15.142:0/2392704388 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x561a95904ed0 0x561a959072c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:39:38.815 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.805+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:5 5.11 5:8a324317:::zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a959078d0 con 0x561a95904ed0 2024-09-22T08:39:38.815 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.805+0000 7fa647d03640 1 --2- 172.21.15.142:0/2392704388 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x561a95904ed0 0x561a959072c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:39:38.815 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.805+0000 7fa647d03640 1 --2- 172.21.15.142:0/2392704388 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x561a95904ed0 0x561a959072c0 crc :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:39:38.815 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.805+0000 7fa647d03640 1 -- 172.21.15.142:0/2392704388 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== osd_op_reply(5 zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fa64003cd70 con 0x561a95904ed0 2024-09-22T08:39:38.815 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.805+0000 7fa64b920800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:39:38.815 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.805+0000 7fa64b920800 20 searching for the correct realm 2024-09-22T08:39:38.815 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.806+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561a95909200 con 0x561a95904ed0 2024-09-22T08:39:38.815 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.806+0000 7fa647d03640 1 -- 172.21.15.142:0/2392704388 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa64003cd70 con 0x561a95904ed0 2024-09-22T08:39:38.815 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.806+0000 7fa647d03640 1 --2- 172.21.15.142:0/2392704388 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7fa640021020 0x7fa64003b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:39:38.815 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.806+0000 7fa647d03640 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561a95909200 con 0x7fa640021020 2024-09-22T08:39:38.815 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.806+0000 7fa647502640 1 --2- 172.21.15.142:0/2392704388 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7fa640021020 0x7fa64003b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:39:38.816 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.806+0000 7fa647502640 1 --2- 172.21.15.142:0/2392704388 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7fa640021020 0x7fa64003b390 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:39:38.816 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.806+0000 7fa647502640 1 -- 172.21.15.142:0/2392704388 <== osd.2 v2:172.21.15.142:6808/279438927 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa63800f030 con 0x7fa640021020 2024-09-22T08:39:38.816 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.806+0000 7fa647502640 1 --2- 172.21.15.142:0/2392704388 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7fa638027020 0x7fa63804b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:39:38.816 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.806+0000 7fa647502640 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561a95909200 con 0x7fa638027020 2024-09-22T08:39:38.816 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.807+0000 7fa646d01640 1 --2- 172.21.15.142:0/2392704388 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7fa638027020 0x7fa63804b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:39:38.816 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.807+0000 7fa646d01640 1 --2- 172.21.15.142:0/2392704388 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7fa638027020 0x7fa63804b6d0 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:39:38.816 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.808+0000 7fa646d01640 1 -- 172.21.15.142:0/2392704388 <== osd.0 v2:172.21.15.31:6800/168281188 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa630057030 con 0x7fa638027020 2024-09-22T08:39:38.816 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.808+0000 7fa646d01640 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561a95909200 con 0x561a959004c0 2024-09-22T08:39:38.816 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.808+0000 7fa646d01640 1 -- 172.21.15.142:0/2392704388 <== osd.1 v2:172.21.15.142:6816/3192108003 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa630057030 con 0x561a959004c0 2024-09-22T08:39:38.816 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.808+0000 7fa646d01640 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561a95909200 con 0x561a959004c0 2024-09-22T08:39:38.816 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.808+0000 7fa646d01640 1 -- 172.21.15.142:0/2392704388 <== osd.1 v2:172.21.15.142:6816/3192108003 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa630057030 con 0x561a959004c0 2024-09-22T08:39:38.816 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.808+0000 7fa646d01640 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561a95909200 con 0x561a959004c0 2024-09-22T08:39:38.816 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.808+0000 7fa646d01640 1 -- 172.21.15.142:0/2392704388 <== osd.1 v2:172.21.15.142:6816/3192108003 7 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa630057030 con 0x561a959004c0 2024-09-22T08:39:38.816 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.808+0000 7fa646d01640 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561a95909200 con 0x7fa638027020 2024-09-22T08:39:38.817 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.809+0000 7fa646d01640 1 -- 172.21.15.142:0/2392704388 <== osd.0 v2:172.21.15.31:6800/168281188 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa630057030 con 0x7fa638027020 2024-09-22T08:39:38.817 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.809+0000 7fa646d01640 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561a95909200 con 0x7fa640021020 2024-09-22T08:39:38.817 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.809+0000 7fa647502640 1 -- 172.21.15.142:0/2392704388 <== osd.2 v2:172.21.15.142:6808/279438927 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa63800f030 con 0x7fa640021020 2024-09-22T08:39:38.817 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.809+0000 7fa647502640 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561a95909200 con 0x561a95904ed0 2024-09-22T08:39:38.817 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.809+0000 7fa647d03640 1 -- 172.21.15.142:0/2392704388 <== osd.3 v2:172.21.15.142:6800/1064901393 3 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa64003cd70 con 0x561a95904ed0 2024-09-22T08:39:38.817 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.809+0000 7fa647d03640 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561a95909200 con 0x561a959004c0 2024-09-22T08:39:38.817 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.809+0000 7fa646d01640 1 -- 172.21.15.142:0/2392704388 <== osd.1 v2:172.21.15.142:6816/3192108003 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa630057030 con 0x561a959004c0 2024-09-22T08:39:38.817 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.809+0000 7fa646d01640 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561a95909200 con 0x7fa638027020 2024-09-22T08:39:38.817 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.810+0000 7fa646d01640 1 -- 172.21.15.142:0/2392704388 <== osd.0 v2:172.21.15.31:6800/168281188 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa630057030 con 0x7fa638027020 2024-09-22T08:39:38.817 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.810+0000 7fa646d01640 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561a95909200 con 0x561a959004c0 2024-09-22T08:39:38.817 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.810+0000 7fa646d01640 1 -- 172.21.15.142:0/2392704388 <== osd.1 v2:172.21.15.142:6816/3192108003 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa630057030 con 0x561a959004c0 2024-09-22T08:39:38.817 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.810+0000 7fa646d01640 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561a95909200 con 0x7fa640021020 2024-09-22T08:39:38.817 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.810+0000 7fa647502640 1 -- 172.21.15.142:0/2392704388 <== osd.2 v2:172.21.15.142:6808/279438927 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fa63800f030 con 0x7fa640021020 2024-09-22T08:39:38.817 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.810+0000 7fa647502640 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561a95909200 con 0x561a95904ed0 2024-09-22T08:39:38.817 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.810+0000 7fa647d03640 1 -- 172.21.15.142:0/2392704388 <== osd.3 v2:172.21.15.142:6800/1064901393 4 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa64003cd70 con 0x561a95904ed0 2024-09-22T08:39:38.818 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.810+0000 7fa647d03640 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561a95909200 con 0x561a95904ed0 2024-09-22T08:39:38.818 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.811+0000 7fa647d03640 1 -- 172.21.15.142:0/2392704388 <== osd.3 v2:172.21.15.142:6800/1064901393 5 ==== osd_op_reply(20 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fa64003cd70 con 0x561a95904ed0 2024-09-22T08:39:38.818 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.811+0000 7fa647d03640 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561a95909200 con 0x7fa638027020 2024-09-22T08:39:38.818 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.811+0000 7fa646d01640 1 -- 172.21.15.142:0/2392704388 <== osd.0 v2:172.21.15.31:6800/168281188 4 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa630057030 con 0x7fa638027020 2024-09-22T08:39:38.818 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.811+0000 7fa646d01640 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561a95909200 con 0x561a95904ed0 2024-09-22T08:39:38.818 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.811+0000 7fa647d03640 1 -- 172.21.15.142:0/2392704388 <== osd.3 v2:172.21.15.142:6800/1064901393 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa64003cd70 con 0x561a95904ed0 2024-09-22T08:39:38.818 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.811+0000 7fa647d03640 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561a95909200 con 0x561a95904ed0 2024-09-22T08:39:38.818 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.811+0000 7fa647d03640 1 -- 172.21.15.142:0/2392704388 <== osd.3 v2:172.21.15.142:6800/1064901393 7 ==== osd_op_reply(23 [pgnls start_epoch 32 out=107b] v32'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fa64003cd70 con 0x561a95904ed0 2024-09-22T08:39:38.818 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.811+0000 7fa647d03640 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561a95909200 con 0x561a959004c0 2024-09-22T08:39:38.818 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.812+0000 7fa646d01640 1 -- 172.21.15.142:0/2392704388 <== osd.1 v2:172.21.15.142:6816/3192108003 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa630057030 con 0x561a959004c0 2024-09-22T08:39:38.818 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.812+0000 7fa646d01640 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561a95909200 con 0x561a959004c0 2024-09-22T08:39:38.818 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.812+0000 7fa646d01640 1 -- 172.21.15.142:0/2392704388 <== osd.1 v2:172.21.15.142:6816/3192108003 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v32'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fa630057030 con 0x561a959004c0 2024-09-22T08:39:38.818 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.812+0000 7fa646d01640 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561a95909200 con 0x7fa638027020 2024-09-22T08:39:38.819 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.812+0000 7fa646d01640 1 -- 172.21.15.142:0/2392704388 <== osd.0 v2:172.21.15.31:6800/168281188 5 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa630057030 con 0x7fa638027020 2024-09-22T08:39:38.819 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.812+0000 7fa646d01640 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561a95909200 con 0x561a95904ed0 2024-09-22T08:39:38.823 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.813+0000 7fa647d03640 1 -- 172.21.15.142:0/2392704388 <== osd.3 v2:172.21.15.142:6800/1064901393 8 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa64003cd70 con 0x561a95904ed0 2024-09-22T08:39:38.823 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.813+0000 7fa647d03640 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561a95909200 con 0x7fa640021020 2024-09-22T08:39:38.823 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.813+0000 7fa647502640 1 -- 172.21.15.142:0/2392704388 <== osd.2 v2:172.21.15.142:6808/279438927 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa63800f030 con 0x7fa640021020 2024-09-22T08:39:38.823 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.813+0000 7fa647502640 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561a95909200 con 0x561a959004c0 2024-09-22T08:39:38.823 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.813+0000 7fa646d01640 1 -- 172.21.15.142:0/2392704388 <== osd.1 v2:172.21.15.142:6816/3192108003 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa630057030 con 0x561a959004c0 2024-09-22T08:39:38.823 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.813+0000 7fa646d01640 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561a95909200 con 0x7fa638027020 2024-09-22T08:39:38.823 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.813+0000 7fa646d01640 1 -- 172.21.15.142:0/2392704388 <== osd.0 v2:172.21.15.31:6800/168281188 6 ==== osd_op_reply(30 [pgnls start_epoch 32 out=82b] v32'1 uv1 ondisk = 1) ==== 144+0+82 (crc 0 0 0) 0x7fa630057030 con 0x7fa638027020 2024-09-22T08:39:38.824 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.814+0000 7fa646d01640 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561a95909200 con 0x561a95904ed0 2024-09-22T08:39:38.824 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.814+0000 7fa647d03640 1 -- 172.21.15.142:0/2392704388 <== osd.3 v2:172.21.15.142:6800/1064901393 9 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa64003cd70 con 0x561a95904ed0 2024-09-22T08:39:38.824 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.814+0000 7fa647d03640 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561a95909200 con 0x7fa638027020 2024-09-22T08:39:38.824 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.814+0000 7fa646d01640 1 -- 172.21.15.142:0/2392704388 <== osd.0 v2:172.21.15.31:6800/168281188 7 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa630057030 con 0x7fa638027020 2024-09-22T08:39:38.824 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.814+0000 7fa646d01640 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561a95909200 con 0x7fa640021020 2024-09-22T08:39:38.824 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.814+0000 7fa647502640 1 -- 172.21.15.142:0/2392704388 <== osd.2 v2:172.21.15.142:6808/279438927 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa63800f030 con 0x7fa640021020 2024-09-22T08:39:38.824 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.814+0000 7fa647502640 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561a95909200 con 0x561a95904ed0 2024-09-22T08:39:38.824 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.815+0000 7fa647d03640 1 -- 172.21.15.142:0/2392704388 <== osd.3 v2:172.21.15.142:6800/1064901393 10 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa64003cd70 con 0x561a95904ed0 2024-09-22T08:39:38.824 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.815+0000 7fa647d03640 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561a95909200 con 0x7fa638027020 2024-09-22T08:39:38.824 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.815+0000 7fa646d01640 1 -- 172.21.15.142:0/2392704388 <== osd.0 v2:172.21.15.31:6800/168281188 8 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa630057030 con 0x7fa638027020 2024-09-22T08:39:38.824 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.815+0000 7fa646d01640 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561a95909200 con 0x561a959004c0 2024-09-22T08:39:38.824 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.815+0000 7fa646d01640 1 -- 172.21.15.142:0/2392704388 <== osd.1 v2:172.21.15.142:6816/3192108003 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v32'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fa630057030 con 0x561a959004c0 2024-09-22T08:39:38.824 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.815+0000 7fa646d01640 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561a95909200 con 0x7fa640021020 2024-09-22T08:39:38.824 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.816+0000 7fa647502640 1 -- 172.21.15.142:0/2392704388 <== osd.2 v2:172.21.15.142:6808/279438927 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa63800f030 con 0x7fa640021020 2024-09-22T08:39:38.824 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.816+0000 7fa64b920800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:39:38.824 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.816+0000 7fa64b920800 20 RGWRados::pool_iterate: got zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec 2024-09-22T08:39:38.825 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.816+0000 7fa64b920800 20 RGWRados::pool_iterate: got zone_info.e239248c-0bee-4e41-803a-24b288d3eb8f 2024-09-22T08:39:38.825 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.816+0000 7fa64b920800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:39:38.825 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.816+0000 7fa64b920800 20 RGWRados::pool_iterate: got period_config.default 2024-09-22T08:39:38.825 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.816+0000 7fa64b920800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:39:38.825 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.816+0000 7fa64b920800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:39:38.825 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.816+0000 7fa64b920800 20 rados->read ofs=0 len=0 2024-09-22T08:39:38.825 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.816+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a959082c0 con 0x561a959004c0 2024-09-22T08:39:38.825 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.816+0000 7fa646d01640 1 -- 172.21.15.142:0/2392704388 <== osd.1 v2:172.21.15.142:6816/3192108003 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa630057030 con 0x561a959004c0 2024-09-22T08:39:38.825 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.816+0000 7fa64b920800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:38.825 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.816+0000 7fa64b920800 20 rados->read ofs=0 len=0 2024-09-22T08:39:38.825 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.816+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a95908b10 con 0x561a959004c0 2024-09-22T08:39:38.825 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.816+0000 7fa646d01640 1 -- 172.21.15.142:0/2392704388 <== osd.1 v2:172.21.15.142:6816/3192108003 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa630089040 con 0x561a959004c0 2024-09-22T08:39:38.825 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.816+0000 7fa64b920800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:39:38.825 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.816+0000 7fa64b920800 20 rados->read ofs=0 len=0 2024-09-22T08:39:38.825 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.816+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:40 5.e 5:728dd5de:::zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a95909680 con 0x561a95904ed0 2024-09-22T08:39:38.826 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.816+0000 7fa647d03640 1 -- 172.21.15.142:0/2392704388 <== osd.3 v2:172.21.15.142:6800/1064901393 11 ==== osd_op_reply(40 zonegroup_info.d89f6f57-1007-47dd-9065-f486c7b01aec [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fa64003cd70 con 0x561a95904ed0 2024-09-22T08:39:38.826 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.816+0000 7fa64b920800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:39:38.826 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.816+0000 7fa64b920800 20 zone default found 2024-09-22T08:39:38.826 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.816+0000 7fa64b920800 4 Realm: () 2024-09-22T08:39:38.826 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.816+0000 7fa64b920800 4 ZoneGroup: default (d89f6f57-1007-47dd-9065-f486c7b01aec) 2024-09-22T08:39:38.826 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.816+0000 7fa64b920800 4 Zone: default (e239248c-0bee-4e41-803a-24b288d3eb8f) 2024-09-22T08:39:38.826 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.816+0000 7fa64b920800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:39:38.826 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.816+0000 7fa64b920800 20 zonegroup default 2024-09-22T08:39:38.826 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.816+0000 7fa64b920800 20 rados->read ofs=0 len=0 2024-09-22T08:39:38.826 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.816+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a95909a20 con 0x7fa638027020 2024-09-22T08:39:38.826 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.817+0000 7fa646d01640 1 -- 172.21.15.142:0/2392704388 <== osd.0 v2:172.21.15.31:6800/168281188 9 ==== osd_op_reply(41 period_config.default [read 0~187 out=187b] v0'0 uv1 ondisk = 0) ==== 165+0+187 (crc 0 0 0) 0x7fa630089040 con 0x7fa638027020 2024-09-22T08:39:38.826 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.817+0000 7fa64b920800 20 rados_obj.operate() r=0 bl.length=187 2024-09-22T08:39:38.826 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.817+0000 7fa64b920800 20 rados->read ofs=0 len=0 2024-09-22T08:39:38.827 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.817+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a9590bd30 con 0x561a95904ed0 2024-09-22T08:39:38.827 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.818+0000 7fa647d03640 1 -- 172.21.15.142:0/2392704388 <== osd.3 v2:172.21.15.142:6800/1064901393 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa64003cd70 con 0x561a95904ed0 2024-09-22T08:39:38.827 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.818+0000 7fa64b920800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:38.827 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.818+0000 7fa64b920800 20 rados->read ofs=0 len=0 2024-09-22T08:39:38.827 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.818+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a9590c180 con 0x561a95904ed0 2024-09-22T08:39:38.827 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.818+0000 7fa647d03640 1 -- 172.21.15.142:0/2392704388 <== osd.3 v2:172.21.15.142:6800/1064901393 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa64003cd70 con 0x561a95904ed0 2024-09-22T08:39:38.827 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.818+0000 7fa64b920800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:38.827 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.818+0000 7fa64b920800 20 started sync module instance, tier type = 2024-09-22T08:39:38.827 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.818+0000 7fa64b920800 20 started zone id=e239248c-0bee-4e41-803a-24b288d3eb8f (name=default) with tier type = 2024-09-22T08:39:38.827 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.818+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a9590b140 con 0x7fa640021020 2024-09-22T08:39:38.827 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.819+0000 7fa647502640 1 -- 172.21.15.142:0/2392704388 <== osd.2 v2:172.21.15.142:6808/279438927 7 ==== osd_op_reply(44 notify.0 [create] v32'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa63800f030 con 0x7fa640021020 2024-09-22T08:39:38.827 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.819+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94672178424976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a9590c5c0 con 0x7fa640021020 2024-09-22T08:39:38.827 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.819+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a9590ce10 con 0x561a959004c0 2024-09-22T08:39:38.827 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.820+0000 7fa647502640 1 -- 172.21.15.142:0/2392704388 <== osd.2 v2:172.21.15.142:6808/279438927 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94672178424976] v32'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa63800f030 con 0x7fa640021020 2024-09-22T08:39:38.827 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.820+0000 7fa646d01640 1 -- 172.21.15.142:0/2392704388 <== osd.1 v2:172.21.15.142:6816/3192108003 16 ==== osd_op_reply(46 notify.1 [create] v32'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa630089040 con 0x561a959004c0 2024-09-22T08:39:38.828 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.820+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94672178427184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a9590cf30 con 0x561a959004c0 2024-09-22T08:39:38.828 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.820+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a9590da50 con 0x561a95904ed0 2024-09-22T08:39:38.828 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.822+0000 7fa647d03640 1 -- 172.21.15.142:0/2392704388 <== osd.3 v2:172.21.15.142:6800/1064901393 14 ==== osd_op_reply(48 notify.2 [create] v32'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa64003cd70 con 0x561a95904ed0 2024-09-22T08:39:38.828 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.822+0000 7fa646d01640 1 -- 172.21.15.142:0/2392704388 <== osd.1 v2:172.21.15.142:6816/3192108003 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94672178427184] v32'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa630089040 con 0x561a959004c0 2024-09-22T08:39:38.828 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.822+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94672178435360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a9590da10 con 0x561a95904ed0 2024-09-22T08:39:38.828 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.822+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a9590ca00 con 0x7fa640021020 2024-09-22T08:39:38.830 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.823+0000 7fa647502640 1 -- 172.21.15.142:0/2392704388 <== osd.2 v2:172.21.15.142:6808/279438927 9 ==== osd_op_reply(50 notify.3 [create] v32'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa63800f030 con 0x7fa640021020 2024-09-22T08:39:38.830 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.823+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94672178439488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a9590ee10 con 0x7fa640021020 2024-09-22T08:39:38.830 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.823+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a9590f850 con 0x561a959004c0 2024-09-22T08:39:38.830 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.823+0000 7fa647d03640 1 -- 172.21.15.142:0/2392704388 <== osd.3 v2:172.21.15.142:6800/1064901393 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94672178435360] v32'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa64003cd70 con 0x561a95904ed0 2024-09-22T08:39:38.830 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.824+0000 7fa646d01640 1 -- 172.21.15.142:0/2392704388 <== osd.1 v2:172.21.15.142:6816/3192108003 18 ==== osd_op_reply(52 notify.4 [create] v32'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa630089040 con 0x561a959004c0 2024-09-22T08:39:38.830 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.824+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94672178443040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a9590f810 con 0x561a959004c0 2024-09-22T08:39:38.830 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.824+0000 7fa647502640 1 -- 172.21.15.142:0/2392704388 <== osd.2 v2:172.21.15.142:6808/279438927 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94672178439488] v32'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa63800f030 con 0x7fa640021020 2024-09-22T08:39:38.830 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.824+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a959102a0 con 0x7fa638027020 2024-09-22T08:39:38.831 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.825+0000 7fa646d01640 1 -- 172.21.15.142:0/2392704388 <== osd.1 v2:172.21.15.142:6816/3192108003 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94672178443040] v32'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa630089040 con 0x561a959004c0 2024-09-22T08:39:38.831 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.825+0000 7fa646d01640 1 -- 172.21.15.142:0/2392704388 <== osd.0 v2:172.21.15.31:6800/168281188 10 ==== osd_op_reply(54 notify.5 [create] v32'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa630089040 con 0x7fa638027020 2024-09-22T08:39:38.831 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.826+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94672178437696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a959102a0 con 0x7fa638027020 2024-09-22T08:39:38.831 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.826+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a95910b40 con 0x7fa638027020 2024-09-22T08:39:38.831 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.827+0000 7fa646d01640 1 -- 172.21.15.142:0/2392704388 <== osd.0 v2:172.21.15.31:6800/168281188 11 ==== osd_op_reply(56 notify.6 [create] v32'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa630089040 con 0x7fa638027020 2024-09-22T08:39:38.831 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.827+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94672178448016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a959102a0 con 0x7fa638027020 2024-09-22T08:39:38.831 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.827+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a95911640 con 0x7fa638027020 2024-09-22T08:39:38.831 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.827+0000 7fa646d01640 1 -- 172.21.15.142:0/2392704388 <== osd.0 v2:172.21.15.31:6800/168281188 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94672178437696] v32'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa630089040 con 0x7fa638027020 2024-09-22T08:39:38.831 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.828+0000 7fa646d01640 1 -- 172.21.15.142:0/2392704388 <== osd.0 v2:172.21.15.31:6800/168281188 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94672178448016] v32'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa630089040 con 0x7fa638027020 2024-09-22T08:39:38.831 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.828+0000 7fa646d01640 1 -- 172.21.15.142:0/2392704388 <== osd.0 v2:172.21.15.31:6800/168281188 14 ==== osd_op_reply(58 notify.7 [create] v32'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa630089040 con 0x7fa638027020 2024-09-22T08:39:38.831 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.828+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94672178449072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a9590fdb0 con 0x7fa638027020 2024-09-22T08:39:38.831 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.828+0000 7fa64b920800 20 add_watcher() i=0 2024-09-22T08:39:38.831 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.828+0000 7fa64b920800 20 add_watcher() i=1 2024-09-22T08:39:38.831 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.828+0000 7fa64b920800 20 add_watcher() i=2 2024-09-22T08:39:38.832 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.828+0000 7fa64b920800 20 add_watcher() i=3 2024-09-22T08:39:38.832 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.828+0000 7fa64b920800 20 add_watcher() i=4 2024-09-22T08:39:38.832 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.828+0000 7fa64b920800 20 add_watcher() i=5 2024-09-22T08:39:38.832 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.828+0000 7fa64b920800 20 add_watcher() i=6 2024-09-22T08:39:38.832 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.829+0000 7fa646d01640 1 -- 172.21.15.142:0/2392704388 <== osd.0 v2:172.21.15.31:6800/168281188 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94672178449072] v32'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa630089040 con 0x7fa638027020 2024-09-22T08:39:38.832 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.829+0000 7fa64b920800 20 add_watcher() i=7 2024-09-22T08:39:38.832 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.829+0000 7fa64b920800 2 all 8 watchers are set, enabling cache 2024-09-22T08:39:38.832 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.829+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a95914670 con 0x561a959004c0 2024-09-22T08:39:38.833 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.829+0000 7fa646d01640 1 -- 172.21.15.142:0/2392704388 <== osd.1 v2:172.21.15.142:6816/3192108003 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fa630089040 con 0x561a959004c0 2024-09-22T08:39:38.833 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.829+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94672178450768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a95911b60 con 0x561a959004c0 2024-09-22T08:39:38.833 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.830+0000 7fa646d01640 1 -- 172.21.15.142:0/2392704388 <== osd.1 v2:172.21.15.142:6816/3192108003 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94672178450768] v32'275 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa630089040 con 0x561a959004c0 2024-09-22T08:39:38.833 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.831+0000 7fa4fe7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:39:38.833 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.831+0000 7fa64b920800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:39:38.833 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.831+0000 7fa64b920800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:39:38.833 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.831+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a9591d000 con 0x561a959004c0 2024-09-22T08:39:38.833 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.832+0000 7fa646d01640 1 -- 172.21.15.142:0/2392704388 <== osd.1 v2:172.21.15.142:6816/3192108003 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'37 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa630089040 con 0x561a959004c0 2024-09-22T08:39:38.834 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.832+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a9591d690 con 0x7fa638027020 2024-09-22T08:39:38.834 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.833+0000 7fa646d01640 1 -- 172.21.15.142:0/2392704388 <== osd.0 v2:172.21.15.31:6800/168281188 16 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'31 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa630089040 con 0x7fa638027020 2024-09-22T08:39:38.834 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.833+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a9591dc00 con 0x561a95904ed0 2024-09-22T08:39:38.835 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.834+0000 7fa647d03640 1 -- 172.21.15.142:0/2392704388 <== osd.3 v2:172.21.15.142:6800/1064901393 16 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'32 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa64003cd70 con 0x561a95904ed0 2024-09-22T08:39:38.835 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.834+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a9591dc00 con 0x561a959004c0 2024-09-22T08:39:38.836 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.835+0000 7fa646d01640 1 -- 172.21.15.142:0/2392704388 <== osd.1 v2:172.21.15.142:6816/3192108003 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'276 uv162 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa630089040 con 0x561a959004c0 2024-09-22T08:39:38.837 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.835+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a9591dfc0 con 0x7fa640021020 2024-09-22T08:39:38.837 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.836+0000 7fa647502640 1 -- 172.21.15.142:0/2392704388 <== osd.2 v2:172.21.15.142:6808/279438927 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'85 uv53 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa63800f030 con 0x7fa640021020 2024-09-22T08:39:38.838 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.836+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a9591e3b0 con 0x561a95904ed0 2024-09-22T08:39:38.839 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.837+0000 7fa647d03640 1 -- 172.21.15.142:0/2392704388 <== osd.3 v2:172.21.15.142:6800/1064901393 17 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'56 uv34 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa64003cd70 con 0x561a95904ed0 2024-09-22T08:39:38.839 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.837+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a9591e3b0 con 0x561a959004c0 2024-09-22T08:39:38.840 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.839+0000 7fa646d01640 1 -- 172.21.15.142:0/2392704388 <== osd.1 v2:172.21.15.142:6816/3192108003 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'33 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa630089040 con 0x561a959004c0 2024-09-22T08:39:38.840 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.839+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a9591e3b0 con 0x7fa638027020 2024-09-22T08:39:38.841 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.840+0000 7fa646d01640 1 -- 172.21.15.142:0/2392704388 <== osd.0 v2:172.21.15.31:6800/168281188 17 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'56 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa630089040 con 0x7fa638027020 2024-09-22T08:39:38.841 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.840+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a9591e3b0 con 0x7fa640021020 2024-09-22T08:39:38.842 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.841+0000 7fa647502640 1 -- 172.21.15.142:0/2392704388 <== osd.2 v2:172.21.15.142:6808/279438927 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'32 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa63800f030 con 0x7fa640021020 2024-09-22T08:39:38.843 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.841+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a9591e580 con 0x561a95904ed0 2024-09-22T08:39:38.843 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.842+0000 7fa647d03640 1 -- 172.21.15.142:0/2392704388 <== osd.3 v2:172.21.15.142:6800/1064901393 18 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'37 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa64003cd70 con 0x561a95904ed0 2024-09-22T08:39:38.843 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.842+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a9591e610 con 0x7fa640021020 2024-09-22T08:39:38.845 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.843+0000 7fa647502640 1 -- 172.21.15.142:0/2392704388 <== osd.2 v2:172.21.15.142:6808/279438927 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'86 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa63800f030 con 0x7fa640021020 2024-09-22T08:39:38.845 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.844+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a9591eac0 con 0x7fa638027020 2024-09-22T08:39:38.846 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.845+0000 7fa646d01640 1 -- 172.21.15.142:0/2392704388 <== osd.0 v2:172.21.15.31:6800/168281188 18 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'41 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa630089040 con 0x7fa638027020 2024-09-22T08:39:38.846 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.845+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a9591eac0 con 0x7fa640021020 2024-09-22T08:39:38.847 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.846+0000 7fa647502640 1 -- 172.21.15.142:0/2392704388 <== osd.2 v2:172.21.15.142:6808/279438927 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'31 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa63800f030 con 0x7fa640021020 2024-09-22T08:39:38.847 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.846+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a9591eac0 con 0x7fa638027020 2024-09-22T08:39:38.848 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.847+0000 7fa646d01640 1 -- 172.21.15.142:0/2392704388 <== osd.0 v2:172.21.15.31:6800/168281188 19 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'64 uv44 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa630089040 con 0x7fa638027020 2024-09-22T08:39:38.848 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.847+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a9591ea10 con 0x561a959004c0 2024-09-22T08:39:38.849 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.848+0000 7fa646d01640 1 -- 172.21.15.142:0/2392704388 <== osd.1 v2:172.21.15.142:6816/3192108003 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'277 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa630089040 con 0x561a959004c0 2024-09-22T08:39:38.849 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.848+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a9591e810 con 0x561a95904ed0 2024-09-22T08:39:38.851 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.850+0000 7fa647d03640 1 -- 172.21.15.142:0/2392704388 <== osd.3 v2:172.21.15.142:6800/1064901393 19 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'77 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa64003cd70 con 0x561a95904ed0 2024-09-22T08:39:38.851 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.850+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a9591e870 con 0x7fa640021020 2024-09-22T08:39:38.852 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.851+0000 7fa647502640 1 -- 172.21.15.142:0/2392704388 <== osd.2 v2:172.21.15.142:6808/279438927 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'87 uv57 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa63800f030 con 0x7fa640021020 2024-09-22T08:39:38.852 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.851+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a9591e870 con 0x561a95904ed0 2024-09-22T08:39:38.852 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.851+0000 7fa647d03640 1 -- 172.21.15.142:0/2392704388 <== osd.3 v2:172.21.15.142:6800/1064901393 20 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'31 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa64003cd70 con 0x561a95904ed0 2024-09-22T08:39:38.853 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.852+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a9591e870 con 0x561a959004c0 2024-09-22T08:39:38.854 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.853+0000 7fa646d01640 1 -- 172.21.15.142:0/2392704388 <== osd.1 v2:172.21.15.142:6816/3192108003 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'39 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa630089040 con 0x561a959004c0 2024-09-22T08:39:38.854 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.853+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a9591e870 con 0x561a959004c0 2024-09-22T08:39:38.855 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.854+0000 7fa646d01640 1 -- 172.21.15.142:0/2392704388 <== osd.1 v2:172.21.15.142:6816/3192108003 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'278 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa630089040 con 0x561a959004c0 2024-09-22T08:39:38.855 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.854+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a9591e870 con 0x561a95904ed0 2024-09-22T08:39:38.856 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.855+0000 7fa647d03640 1 -- 172.21.15.142:0/2392704388 <== osd.3 v2:172.21.15.142:6800/1064901393 21 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'78 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa64003cd70 con 0x561a95904ed0 2024-09-22T08:39:38.856 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.855+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a9591e8b0 con 0x7fa640021020 2024-09-22T08:39:38.857 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.856+0000 7fa647502640 1 -- 172.21.15.142:0/2392704388 <== osd.2 v2:172.21.15.142:6808/279438927 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'41 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa63800f030 con 0x7fa640021020 2024-09-22T08:39:38.857 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.856+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a9591e8b0 con 0x561a95904ed0 2024-09-22T08:39:38.858 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.857+0000 7fa647d03640 1 -- 172.21.15.142:0/2392704388 <== osd.3 v2:172.21.15.142:6800/1064901393 22 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'34 uv33 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa64003cd70 con 0x561a95904ed0 2024-09-22T08:39:38.858 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.857+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a9591e8b0 con 0x561a95904ed0 2024-09-22T08:39:38.859 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.858+0000 7fa647d03640 1 -- 172.21.15.142:0/2392704388 <== osd.3 v2:172.21.15.142:6800/1064901393 23 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'39 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa64003cd70 con 0x561a95904ed0 2024-09-22T08:39:38.859 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.858+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a9591e8f0 con 0x561a95904ed0 2024-09-22T08:39:38.860 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.859+0000 7fa647d03640 1 -- 172.21.15.142:0/2392704388 <== osd.3 v2:172.21.15.142:6800/1064901393 24 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'27 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa64003cd70 con 0x561a95904ed0 2024-09-22T08:39:38.860 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.859+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a9591e8b0 con 0x561a95904ed0 2024-09-22T08:39:38.861 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.860+0000 7fa647d03640 1 -- 172.21.15.142:0/2392704388 <== osd.3 v2:172.21.15.142:6800/1064901393 25 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'57 uv36 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa64003cd70 con 0x561a95904ed0 2024-09-22T08:39:38.861 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.860+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a9591e8f0 con 0x7fa638027020 2024-09-22T08:39:38.862 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.861+0000 7fa646d01640 1 -- 172.21.15.142:0/2392704388 <== osd.0 v2:172.21.15.31:6800/168281188 20 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'33 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa630089040 con 0x7fa638027020 2024-09-22T08:39:38.862 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.861+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a9591e930 con 0x561a95904ed0 2024-09-22T08:39:38.863 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.862+0000 7fa647d03640 1 -- 172.21.15.142:0/2392704388 <== osd.3 v2:172.21.15.142:6800/1064901393 26 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'33 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa64003cd70 con 0x561a95904ed0 2024-09-22T08:39:38.863 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.862+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a9591e930 con 0x7fa638027020 2024-09-22T08:39:38.864 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.863+0000 7fa646d01640 1 -- 172.21.15.142:0/2392704388 <== osd.0 v2:172.21.15.31:6800/168281188 21 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'57 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa630089040 con 0x7fa638027020 2024-09-22T08:39:38.864 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.863+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a9591e930 con 0x561a95904ed0 2024-09-22T08:39:38.865 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.864+0000 7fa647d03640 1 -- 172.21.15.142:0/2392704388 <== osd.3 v2:172.21.15.142:6800/1064901393 27 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'79 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa64003cd70 con 0x561a95904ed0 2024-09-22T08:39:38.865 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.864+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a9591e930 con 0x7fa638027020 2024-09-22T08:39:38.867 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.865+0000 7fa646d01640 1 -- 172.21.15.142:0/2392704388 <== osd.0 v2:172.21.15.31:6800/168281188 22 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'65 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa630089040 con 0x7fa638027020 2024-09-22T08:39:38.867 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.865+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a9591e970 con 0x7fa640021020 2024-09-22T08:39:38.868 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.867+0000 7fa647502640 1 -- 172.21.15.142:0/2392704388 <== osd.2 v2:172.21.15.142:6808/279438927 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'37 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa63800f030 con 0x7fa640021020 2024-09-22T08:39:38.868 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.867+0000 7fa4fd7e2640 20 reqs_thread_entry: start 2024-09-22T08:39:38.868 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.867+0000 7fa64b920800 20 init_complete bucket index max shards: 11 2024-09-22T08:39:38.869 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.867+0000 7fa64b920800 20 Filter name: none 2024-09-22T08:39:38.869 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.867+0000 7fa4f67fc640 20 reqs_thread_entry: start 2024-09-22T08:39:38.869 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.867+0000 7fa64b920800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-22T08:39:38.869 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.867+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:94 6.9 6:921ecdb1:gc::gc.25:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a9594aa00 con 0x561a95904ed0 2024-09-22T08:39:38.870 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.868+0000 7fa647d03640 1 -- 172.21.15.142:0/2392704388 <== osd.3 v2:172.21.15.142:6800/1064901393 28 ==== osd_op_reply(94 gc.25 [call] v32'58 uv58 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fa64003cd70 con 0x561a95904ed0 2024-09-22T08:39:38.870 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.868+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:95 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a9594aa00 con 0x561a95904ed0 2024-09-22T08:39:38.870 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.869+0000 7fa647d03640 1 -- 172.21.15.142:0/2392704388 <== osd.3 v2:172.21.15.142:6800/1064901393 29 ==== osd_op_reply(95 gc.25 [call out=15b] v0'0 uv58 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa64003cd70 con 0x561a95904ed0 2024-09-22T08:39:38.870 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.869+0000 7fa64b920800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:39:38.870 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.869+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:96 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a959499f0 con 0x561a95904ed0 2024-09-22T08:39:38.870 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.869+0000 7fa647d03640 1 -- 172.21.15.142:0/2392704388 <== osd.3 v2:172.21.15.142:6800/1064901393 30 ==== osd_op_reply(96 gc.25 [call out=24b] v0'0 uv58 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fa64003cd70 con 0x561a95904ed0 2024-09-22T08:39:38.871 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.869+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:97 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a9594aa00 con 0x561a95904ed0 2024-09-22T08:39:38.871 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.869+0000 7fa647d03640 1 -- 172.21.15.142:0/2392704388 <== osd.3 v2:172.21.15.142:6800/1064901393 31 ==== osd_op_reply(97 gc.25 [call out=15b] v0'0 uv58 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa64003cd70 con 0x561a95904ed0 2024-09-22T08:39:38.871 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.869+0000 7fa64b920800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:39:38.871 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.869+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:98 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a9594aa00 con 0x561a95904ed0 2024-09-22T08:39:38.871 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.869+0000 7fa647d03640 1 -- 172.21.15.142:0/2392704388 <== osd.3 v2:172.21.15.142:6800/1064901393 32 ==== osd_op_reply(98 gc.25 [call out=15b] v0'0 uv58 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa64003cd70 con 0x561a95904ed0 2024-09-22T08:39:38.872 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.869+0000 7fa64b920800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:39:38.872 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.869+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:99 6.9 6:921ecdb1:gc::gc.25:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a9594aa00 con 0x561a95904ed0 2024-09-22T08:39:38.872 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.870+0000 7fa647d03640 1 -- 172.21.15.142:0/2392704388 <== osd.3 v2:172.21.15.142:6800/1064901393 33 ==== osd_op_reply(99 gc.25 [call] v32'59 uv59 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fa64003cd70 con 0x561a95904ed0 2024-09-22T08:39:38.872 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.870+0000 7fa64b920800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-22T08:39:38.872 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.870+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:100 6.1f 6:fde4dd55:gc::gc.26:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a9594aa00 con 0x7fa638027020 2024-09-22T08:39:38.873 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.871+0000 7fa646d01640 1 -- 172.21.15.142:0/2392704388 <== osd.0 v2:172.21.15.31:6800/168281188 23 ==== osd_op_reply(100 gc.26 [call] v32'34 uv34 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fa630089040 con 0x7fa638027020 2024-09-22T08:39:38.873 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.871+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:101 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a9594aa00 con 0x7fa638027020 2024-09-22T08:39:38.873 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.872+0000 7fa646d01640 1 -- 172.21.15.142:0/2392704388 <== osd.0 v2:172.21.15.31:6800/168281188 24 ==== osd_op_reply(101 gc.26 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa630089040 con 0x7fa638027020 2024-09-22T08:39:38.873 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.872+0000 7fa64b920800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:39:38.873 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.872+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:102 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a959499f0 con 0x7fa638027020 2024-09-22T08:39:38.874 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.872+0000 7fa646d01640 1 -- 172.21.15.142:0/2392704388 <== osd.0 v2:172.21.15.31:6800/168281188 25 ==== osd_op_reply(102 gc.26 [call out=24b] v0'0 uv34 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fa630089040 con 0x7fa638027020 2024-09-22T08:39:38.874 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.872+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:103 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a9594aa00 con 0x7fa638027020 2024-09-22T08:39:38.874 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.872+0000 7fa646d01640 1 -- 172.21.15.142:0/2392704388 <== osd.0 v2:172.21.15.31:6800/168281188 26 ==== osd_op_reply(103 gc.26 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa630089040 con 0x7fa638027020 2024-09-22T08:39:38.874 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.872+0000 7fa64b920800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:39:38.874 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.872+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:104 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a9594aa00 con 0x7fa638027020 2024-09-22T08:39:38.874 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.873+0000 7fa646d01640 1 -- 172.21.15.142:0/2392704388 <== osd.0 v2:172.21.15.31:6800/168281188 27 ==== osd_op_reply(104 gc.26 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa630089040 con 0x7fa638027020 2024-09-22T08:39:38.875 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.873+0000 7fa64b920800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:39:38.875 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.873+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:105 6.1f 6:fde4dd55:gc::gc.26:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a9594aa00 con 0x7fa638027020 2024-09-22T08:39:38.875 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.874+0000 7fa646d01640 1 -- 172.21.15.142:0/2392704388 <== osd.0 v2:172.21.15.31:6800/168281188 28 ==== osd_op_reply(105 gc.26 [call] v32'35 uv35 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fa630089040 con 0x7fa638027020 2024-09-22T08:39:38.875 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.874+0000 7fa64b920800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-22T08:39:38.875 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.874+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:106 6.1a 6:5909e671:gc::gc.27:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a9594aa00 con 0x561a95904ed0 2024-09-22T08:39:38.876 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.875+0000 7fa647d03640 1 -- 172.21.15.142:0/2392704388 <== osd.3 v2:172.21.15.142:6800/1064901393 34 ==== osd_op_reply(106 gc.27 [call] v32'34 uv34 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fa64003cd70 con 0x561a95904ed0 2024-09-22T08:39:38.877 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.875+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:107 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a9594aa00 con 0x561a95904ed0 2024-09-22T08:39:38.877 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.875+0000 7fa647d03640 1 -- 172.21.15.142:0/2392704388 <== osd.3 v2:172.21.15.142:6800/1064901393 35 ==== osd_op_reply(107 gc.27 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa64003cd70 con 0x561a95904ed0 2024-09-22T08:39:38.877 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.875+0000 7fa64b920800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:39:38.877 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.875+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:108 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a959499f0 con 0x561a95904ed0 2024-09-22T08:39:38.877 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.875+0000 7fa647d03640 1 -- 172.21.15.142:0/2392704388 <== osd.3 v2:172.21.15.142:6800/1064901393 36 ==== osd_op_reply(108 gc.27 [call out=24b] v0'0 uv34 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fa64003cd70 con 0x561a95904ed0 2024-09-22T08:39:38.877 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.875+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:109 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a9594aa00 con 0x561a95904ed0 2024-09-22T08:39:38.877 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.876+0000 7fa647d03640 1 -- 172.21.15.142:0/2392704388 <== osd.3 v2:172.21.15.142:6800/1064901393 37 ==== osd_op_reply(109 gc.27 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa64003cd70 con 0x561a95904ed0 2024-09-22T08:39:38.877 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.876+0000 7fa64b920800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:39:38.877 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.876+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:110 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a9594aa00 con 0x561a95904ed0 2024-09-22T08:39:38.878 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.876+0000 7fa647d03640 1 -- 172.21.15.142:0/2392704388 <== osd.3 v2:172.21.15.142:6800/1064901393 38 ==== osd_op_reply(110 gc.27 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa64003cd70 con 0x561a95904ed0 2024-09-22T08:39:38.878 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.876+0000 7fa64b920800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:39:38.878 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.876+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:111 6.1a 6:5909e671:gc::gc.27:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a9594aa00 con 0x561a95904ed0 2024-09-22T08:39:38.878 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.877+0000 7fa647d03640 1 -- 172.21.15.142:0/2392704388 <== osd.3 v2:172.21.15.142:6800/1064901393 39 ==== osd_op_reply(111 gc.27 [call] v32'35 uv35 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fa64003cd70 con 0x561a95904ed0 2024-09-22T08:39:38.878 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.877+0000 7fa64b920800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-22T08:39:38.878 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.877+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:112 6.1d 6:b88e3271:gc::gc.28:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a9594aa00 con 0x7fa638027020 2024-09-22T08:39:38.880 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.878+0000 7fa646d01640 1 -- 172.21.15.142:0/2392704388 <== osd.0 v2:172.21.15.31:6800/168281188 29 ==== osd_op_reply(112 gc.28 [call] v32'58 uv58 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fa630089040 con 0x7fa638027020 2024-09-22T08:39:38.880 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.878+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:113 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a9594aa00 con 0x7fa638027020 2024-09-22T08:39:38.880 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.879+0000 7fa646d01640 1 -- 172.21.15.142:0/2392704388 <== osd.0 v2:172.21.15.31:6800/168281188 30 ==== osd_op_reply(113 gc.28 [call out=15b] v0'0 uv58 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa630089040 con 0x7fa638027020 2024-09-22T08:39:38.880 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.879+0000 7fa64b920800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:39:38.880 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.879+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:114 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a959499f0 con 0x7fa638027020 2024-09-22T08:39:38.880 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.879+0000 7fa646d01640 1 -- 172.21.15.142:0/2392704388 <== osd.0 v2:172.21.15.31:6800/168281188 31 ==== osd_op_reply(114 gc.28 [call out=24b] v0'0 uv58 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fa630089040 con 0x7fa638027020 2024-09-22T08:39:38.880 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.879+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:115 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a9594aa00 con 0x7fa638027020 2024-09-22T08:39:38.881 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.879+0000 7fa646d01640 1 -- 172.21.15.142:0/2392704388 <== osd.0 v2:172.21.15.31:6800/168281188 32 ==== osd_op_reply(115 gc.28 [call out=15b] v0'0 uv58 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa630089040 con 0x7fa638027020 2024-09-22T08:39:38.881 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.879+0000 7fa64b920800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:39:38.881 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.879+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:116 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a9594aa00 con 0x7fa638027020 2024-09-22T08:39:38.881 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.879+0000 7fa646d01640 1 -- 172.21.15.142:0/2392704388 <== osd.0 v2:172.21.15.31:6800/168281188 33 ==== osd_op_reply(116 gc.28 [call out=15b] v0'0 uv58 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa630089040 con 0x7fa638027020 2024-09-22T08:39:38.881 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.879+0000 7fa64b920800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:39:38.881 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.879+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:117 6.1d 6:b88e3271:gc::gc.28:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a9594aa00 con 0x7fa638027020 2024-09-22T08:39:38.882 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.880+0000 7fa646d01640 1 -- 172.21.15.142:0/2392704388 <== osd.0 v2:172.21.15.31:6800/168281188 34 ==== osd_op_reply(117 gc.28 [call] v32'59 uv59 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fa630089040 con 0x7fa638027020 2024-09-22T08:39:38.882 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.880+0000 7fa64b920800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-22T08:39:38.882 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.880+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:118 6.7 6:e47c9322:gc::gc.29:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a9594aa00 con 0x561a95904ed0 2024-09-22T08:39:38.884 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.882+0000 7fa647d03640 1 -- 172.21.15.142:0/2392704388 <== osd.3 v2:172.21.15.142:6800/1064901393 40 ==== osd_op_reply(118 gc.29 [call] v32'80 uv80 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fa64003cd70 con 0x561a95904ed0 2024-09-22T08:39:38.884 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.882+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:119 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a9594aa00 con 0x561a95904ed0 2024-09-22T08:39:38.884 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.882+0000 7fa647d03640 1 -- 172.21.15.142:0/2392704388 <== osd.3 v2:172.21.15.142:6800/1064901393 41 ==== osd_op_reply(119 gc.29 [call out=15b] v0'0 uv80 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa64003cd70 con 0x561a95904ed0 2024-09-22T08:39:38.884 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.882+0000 7fa64b920800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:39:38.884 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.882+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:120 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a959499f0 con 0x561a95904ed0 2024-09-22T08:39:38.884 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.882+0000 7fa647d03640 1 -- 172.21.15.142:0/2392704388 <== osd.3 v2:172.21.15.142:6800/1064901393 42 ==== osd_op_reply(120 gc.29 [call out=24b] v0'0 uv80 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fa64003cd70 con 0x561a95904ed0 2024-09-22T08:39:38.884 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.882+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:121 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a9594aa00 con 0x561a95904ed0 2024-09-22T08:39:38.884 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.882+0000 7fa647d03640 1 -- 172.21.15.142:0/2392704388 <== osd.3 v2:172.21.15.142:6800/1064901393 43 ==== osd_op_reply(121 gc.29 [call out=15b] v0'0 uv80 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa64003cd70 con 0x561a95904ed0 2024-09-22T08:39:38.884 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.882+0000 7fa64b920800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:39:38.884 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.882+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:122 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a9594aa00 con 0x561a95904ed0 2024-09-22T08:39:38.884 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.883+0000 7fa647d03640 1 -- 172.21.15.142:0/2392704388 <== osd.3 v2:172.21.15.142:6800/1064901393 44 ==== osd_op_reply(122 gc.29 [call out=15b] v0'0 uv80 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa64003cd70 con 0x561a95904ed0 2024-09-22T08:39:38.884 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.883+0000 7fa64b920800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:39:38.885 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.883+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:123 6.7 6:e47c9322:gc::gc.29:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a9594aa00 con 0x561a95904ed0 2024-09-22T08:39:38.885 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.884+0000 7fa647d03640 1 -- 172.21.15.142:0/2392704388 <== osd.3 v2:172.21.15.142:6800/1064901393 45 ==== osd_op_reply(123 gc.29 [call] v32'81 uv81 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fa64003cd70 con 0x561a95904ed0 2024-09-22T08:39:38.885 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.884+0000 7fa64b920800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-22T08:39:38.885 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.884+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:124 6.0 6:013d6c33:gc::gc.30:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a9594aa00 con 0x7fa638027020 2024-09-22T08:39:38.887 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.885+0000 7fa646d01640 1 -- 172.21.15.142:0/2392704388 <== osd.0 v2:172.21.15.31:6800/168281188 35 ==== osd_op_reply(124 gc.30 [call] v32'66 uv66 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fa630089040 con 0x7fa638027020 2024-09-22T08:39:38.887 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.885+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:125 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a9594aa00 con 0x7fa638027020 2024-09-22T08:39:38.887 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.885+0000 7fa646d01640 1 -- 172.21.15.142:0/2392704388 <== osd.0 v2:172.21.15.31:6800/168281188 36 ==== osd_op_reply(125 gc.30 [call out=15b] v0'0 uv66 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa630089040 con 0x7fa638027020 2024-09-22T08:39:38.887 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.885+0000 7fa64b920800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:39:38.887 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.885+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:126 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a959499f0 con 0x7fa638027020 2024-09-22T08:39:38.887 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.885+0000 7fa646d01640 1 -- 172.21.15.142:0/2392704388 <== osd.0 v2:172.21.15.31:6800/168281188 37 ==== osd_op_reply(126 gc.30 [call out=24b] v0'0 uv66 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fa630089040 con 0x7fa638027020 2024-09-22T08:39:38.887 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.885+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:127 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a9594aa00 con 0x7fa638027020 2024-09-22T08:39:38.887 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.885+0000 7fa646d01640 1 -- 172.21.15.142:0/2392704388 <== osd.0 v2:172.21.15.31:6800/168281188 38 ==== osd_op_reply(127 gc.30 [call out=15b] v0'0 uv66 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa630089040 con 0x7fa638027020 2024-09-22T08:39:38.887 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.885+0000 7fa64b920800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:39:38.887 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.886+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:128 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a9594aa00 con 0x7fa638027020 2024-09-22T08:39:38.888 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.886+0000 7fa646d01640 1 -- 172.21.15.142:0/2392704388 <== osd.0 v2:172.21.15.31:6800/168281188 39 ==== osd_op_reply(128 gc.30 [call out=15b] v0'0 uv66 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa630089040 con 0x7fa638027020 2024-09-22T08:39:38.888 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.886+0000 7fa64b920800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:39:38.888 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.886+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:129 6.0 6:013d6c33:gc::gc.30:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a9594aa00 con 0x7fa638027020 2024-09-22T08:39:38.888 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.887+0000 7fa646d01640 1 -- 172.21.15.142:0/2392704388 <== osd.0 v2:172.21.15.31:6800/168281188 40 ==== osd_op_reply(129 gc.30 [call] v32'67 uv67 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fa630089040 con 0x7fa638027020 2024-09-22T08:39:38.888 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.887+0000 7fa64b920800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-22T08:39:38.888 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.887+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:130 6.f 6:f24cb4a8:gc::gc.31:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a9594aa00 con 0x7fa640021020 2024-09-22T08:39:38.890 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.888+0000 7fa647502640 1 -- 172.21.15.142:0/2392704388 <== osd.2 v2:172.21.15.142:6808/279438927 18 ==== osd_op_reply(130 gc.31 [call] v32'38 uv38 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fa63800f030 con 0x7fa640021020 2024-09-22T08:39:38.890 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.888+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:131 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a9594aa00 con 0x7fa640021020 2024-09-22T08:39:38.890 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.888+0000 7fa647502640 1 -- 172.21.15.142:0/2392704388 <== osd.2 v2:172.21.15.142:6808/279438927 19 ==== osd_op_reply(131 gc.31 [call out=15b] v0'0 uv38 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa63800f030 con 0x7fa640021020 2024-09-22T08:39:38.890 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.888+0000 7fa64b920800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:39:38.890 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.888+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:132 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a959499f0 con 0x7fa640021020 2024-09-22T08:39:38.890 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.888+0000 7fa647502640 1 -- 172.21.15.142:0/2392704388 <== osd.2 v2:172.21.15.142:6808/279438927 20 ==== osd_op_reply(132 gc.31 [call out=24b] v0'0 uv38 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fa63800f030 con 0x7fa640021020 2024-09-22T08:39:38.890 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.888+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:133 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a9594aa00 con 0x7fa640021020 2024-09-22T08:39:38.890 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.889+0000 7fa647502640 1 -- 172.21.15.142:0/2392704388 <== osd.2 v2:172.21.15.142:6808/279438927 21 ==== osd_op_reply(133 gc.31 [call out=15b] v0'0 uv38 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa63800f030 con 0x7fa640021020 2024-09-22T08:39:38.891 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.889+0000 7fa64b920800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:39:38.891 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.889+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:134 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a9594aa00 con 0x7fa640021020 2024-09-22T08:39:38.891 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.889+0000 7fa647502640 1 -- 172.21.15.142:0/2392704388 <== osd.2 v2:172.21.15.142:6808/279438927 22 ==== osd_op_reply(134 gc.31 [call out=15b] v0'0 uv38 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa63800f030 con 0x7fa640021020 2024-09-22T08:39:38.891 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.889+0000 7fa64b920800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:39:38.891 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.889+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:135 6.f 6:f24cb4a8:gc::gc.31:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a9594aa00 con 0x7fa640021020 2024-09-22T08:39:38.891 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.890+0000 7fa647502640 1 -- 172.21.15.142:0/2392704388 <== osd.2 v2:172.21.15.142:6808/279438927 23 ==== osd_op_reply(135 gc.31 [call] v32'39 uv39 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fa63800f030 con 0x7fa640021020 2024-09-22T08:39:38.891 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.890+0000 7fa64b920800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-22T08:39:38.891 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.890+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:136 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a9594aa00 con 0x561a959004c0 2024-09-22T08:39:38.893 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.891+0000 7fa646d01640 1 -- 172.21.15.142:0/2392704388 <== osd.1 v2:172.21.15.142:6816/3192108003 28 ==== osd_op_reply(136 gc.0 [call] v32'38 uv38 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fa630089040 con 0x561a959004c0 2024-09-22T08:39:38.893 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.891+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:137 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a9594aa00 con 0x561a959004c0 2024-09-22T08:39:38.893 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.891+0000 7fa646d01640 1 -- 172.21.15.142:0/2392704388 <== osd.1 v2:172.21.15.142:6816/3192108003 29 ==== osd_op_reply(137 gc.0 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fa630089040 con 0x561a959004c0 2024-09-22T08:39:38.893 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.891+0000 7fa64b920800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:39:38.893 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.891+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:138 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a959499f0 con 0x561a959004c0 2024-09-22T08:39:38.893 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.891+0000 7fa646d01640 1 -- 172.21.15.142:0/2392704388 <== osd.1 v2:172.21.15.142:6816/3192108003 30 ==== osd_op_reply(138 gc.0 [call out=24b] v0'0 uv38 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fa630089040 con 0x561a959004c0 2024-09-22T08:39:38.893 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.891+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:139 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a9594aa00 con 0x561a959004c0 2024-09-22T08:39:38.893 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.892+0000 7fa646d01640 1 -- 172.21.15.142:0/2392704388 <== osd.1 v2:172.21.15.142:6816/3192108003 31 ==== osd_op_reply(139 gc.0 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fa630089040 con 0x561a959004c0 2024-09-22T08:39:38.893 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.892+0000 7fa64b920800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:39:38.893 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.892+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:140 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a9594aa00 con 0x561a959004c0 2024-09-22T08:39:38.893 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.892+0000 7fa646d01640 1 -- 172.21.15.142:0/2392704388 <== osd.1 v2:172.21.15.142:6816/3192108003 32 ==== osd_op_reply(140 gc.0 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fa630089040 con 0x561a959004c0 2024-09-22T08:39:38.893 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.892+0000 7fa64b920800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:39:38.894 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.892+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:141 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a9594aa00 con 0x561a959004c0 2024-09-22T08:39:38.894 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.893+0000 7fa646d01640 1 -- 172.21.15.142:0/2392704388 <== osd.1 v2:172.21.15.142:6816/3192108003 33 ==== osd_op_reply(141 gc.0 [call] v32'39 uv39 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fa630089040 con 0x561a959004c0 2024-09-22T08:39:38.894 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.893+0000 7fa64b920800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-22T08:39:38.894 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.893+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:142 6.18 6:1e85421f:gc::gc.1:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a9594aa00 con 0x7fa638027020 2024-09-22T08:39:38.895 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.894+0000 7fa646d01640 1 -- 172.21.15.142:0/2392704388 <== osd.0 v2:172.21.15.31:6800/168281188 41 ==== osd_op_reply(142 gc.1 [call] v32'32 uv32 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fa630089040 con 0x7fa638027020 2024-09-22T08:39:38.895 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.894+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:143 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a9594aa00 con 0x7fa638027020 2024-09-22T08:39:38.896 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.894+0000 7fa646d01640 1 -- 172.21.15.142:0/2392704388 <== osd.0 v2:172.21.15.31:6800/168281188 42 ==== osd_op_reply(143 gc.1 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fa630089040 con 0x7fa638027020 2024-09-22T08:39:38.896 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.894+0000 7fa64b920800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:39:38.896 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.894+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:144 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a959499f0 con 0x7fa638027020 2024-09-22T08:39:38.896 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.895+0000 7fa646d01640 1 -- 172.21.15.142:0/2392704388 <== osd.0 v2:172.21.15.31:6800/168281188 43 ==== osd_op_reply(144 gc.1 [call out=24b] v0'0 uv32 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fa630089040 con 0x7fa638027020 2024-09-22T08:39:38.896 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.895+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:145 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a9594aa00 con 0x7fa638027020 2024-09-22T08:39:38.896 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.895+0000 7fa646d01640 1 -- 172.21.15.142:0/2392704388 <== osd.0 v2:172.21.15.31:6800/168281188 44 ==== osd_op_reply(145 gc.1 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fa630089040 con 0x7fa638027020 2024-09-22T08:39:38.896 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.895+0000 7fa64b920800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:39:38.896 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.895+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:146 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a9594aa00 con 0x7fa638027020 2024-09-22T08:39:38.897 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.895+0000 7fa646d01640 1 -- 172.21.15.142:0/2392704388 <== osd.0 v2:172.21.15.31:6800/168281188 45 ==== osd_op_reply(146 gc.1 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fa630089040 con 0x7fa638027020 2024-09-22T08:39:38.897 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.895+0000 7fa64b920800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:39:38.897 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.895+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:147 6.18 6:1e85421f:gc::gc.1:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a9594aa00 con 0x7fa638027020 2024-09-22T08:39:38.898 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.896+0000 7fa646d01640 1 -- 172.21.15.142:0/2392704388 <== osd.0 v2:172.21.15.31:6800/168281188 46 ==== osd_op_reply(147 gc.1 [call] v32'33 uv33 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fa630089040 con 0x7fa638027020 2024-09-22T08:39:38.898 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.896+0000 7fa64b920800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-22T08:39:38.898 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.896+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:148 6.b 6:d242335b:gc::gc.2:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a9594aa00 con 0x561a95904ed0 2024-09-22T08:39:38.899 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.897+0000 7fa647d03640 1 -- 172.21.15.142:0/2392704388 <== osd.3 v2:172.21.15.142:6800/1064901393 46 ==== osd_op_reply(148 gc.2 [call] v32'33 uv33 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fa64003cd70 con 0x561a95904ed0 2024-09-22T08:39:38.899 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.897+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:149 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a9594aa00 con 0x561a95904ed0 2024-09-22T08:39:38.899 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.897+0000 7fa647d03640 1 -- 172.21.15.142:0/2392704388 <== osd.3 v2:172.21.15.142:6800/1064901393 47 ==== osd_op_reply(149 gc.2 [call out=15b] v0'0 uv33 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fa64003cd70 con 0x561a95904ed0 2024-09-22T08:39:38.899 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.897+0000 7fa64b920800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:39:38.899 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.897+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:150 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a959499f0 con 0x561a95904ed0 2024-09-22T08:39:38.899 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.898+0000 7fa647d03640 1 -- 172.21.15.142:0/2392704388 <== osd.3 v2:172.21.15.142:6800/1064901393 48 ==== osd_op_reply(150 gc.2 [call out=24b] v0'0 uv33 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fa64003cd70 con 0x561a95904ed0 2024-09-22T08:39:38.899 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.898+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:151 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a9594aa00 con 0x561a95904ed0 2024-09-22T08:39:38.900 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.898+0000 7fa647d03640 1 -- 172.21.15.142:0/2392704388 <== osd.3 v2:172.21.15.142:6800/1064901393 49 ==== osd_op_reply(151 gc.2 [call out=15b] v0'0 uv33 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fa64003cd70 con 0x561a95904ed0 2024-09-22T08:39:38.900 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.898+0000 7fa64b920800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:39:38.900 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.898+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:152 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a9594aa00 con 0x561a95904ed0 2024-09-22T08:39:38.900 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.898+0000 7fa647d03640 1 -- 172.21.15.142:0/2392704388 <== osd.3 v2:172.21.15.142:6800/1064901393 50 ==== osd_op_reply(152 gc.2 [call out=15b] v0'0 uv33 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fa64003cd70 con 0x561a95904ed0 2024-09-22T08:39:38.900 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.898+0000 7fa64b920800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:39:38.900 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.898+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:153 6.b 6:d242335b:gc::gc.2:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a9594aa00 con 0x561a95904ed0 2024-09-22T08:39:38.900 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.899+0000 7fa647d03640 1 -- 172.21.15.142:0/2392704388 <== osd.3 v2:172.21.15.142:6800/1064901393 51 ==== osd_op_reply(153 gc.2 [call] v32'34 uv34 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fa64003cd70 con 0x561a95904ed0 2024-09-22T08:39:38.900 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.899+0000 7fa64b920800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-22T08:39:38.900 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.899+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:154 6.4 6:2166d8e1:gc::gc.3:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a9594aa00 con 0x561a959004c0 2024-09-22T08:39:38.902 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.900+0000 7fa646d01640 1 -- 172.21.15.142:0/2392704388 <== osd.1 v2:172.21.15.142:6816/3192108003 34 ==== osd_op_reply(154 gc.3 [call] v32'279 uv279 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fa630089040 con 0x561a959004c0 2024-09-22T08:39:38.902 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.900+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:155 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a9594aa00 con 0x561a959004c0 2024-09-22T08:39:38.902 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.900+0000 7fa646d01640 1 -- 172.21.15.142:0/2392704388 <== osd.1 v2:172.21.15.142:6816/3192108003 35 ==== osd_op_reply(155 gc.3 [call out=15b] v0'0 uv279 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fa630089040 con 0x561a959004c0 2024-09-22T08:39:38.902 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.900+0000 7fa64b920800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:39:38.902 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.900+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:156 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a959499f0 con 0x561a959004c0 2024-09-22T08:39:38.902 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.900+0000 7fa646d01640 1 -- 172.21.15.142:0/2392704388 <== osd.1 v2:172.21.15.142:6816/3192108003 36 ==== osd_op_reply(156 gc.3 [call out=24b] v0'0 uv279 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fa630089040 con 0x561a959004c0 2024-09-22T08:39:38.902 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.900+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:157 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a9594aa00 con 0x561a959004c0 2024-09-22T08:39:38.902 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.901+0000 7fa646d01640 1 -- 172.21.15.142:0/2392704388 <== osd.1 v2:172.21.15.142:6816/3192108003 37 ==== osd_op_reply(157 gc.3 [call out=15b] v0'0 uv279 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fa630089040 con 0x561a959004c0 2024-09-22T08:39:38.902 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.901+0000 7fa64b920800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:39:38.902 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.901+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:158 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a9594aa00 con 0x561a959004c0 2024-09-22T08:39:38.903 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.901+0000 7fa646d01640 1 -- 172.21.15.142:0/2392704388 <== osd.1 v2:172.21.15.142:6816/3192108003 38 ==== osd_op_reply(158 gc.3 [call out=15b] v0'0 uv279 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fa630089040 con 0x561a959004c0 2024-09-22T08:39:38.903 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.901+0000 7fa64b920800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:39:38.903 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.901+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:159 6.4 6:2166d8e1:gc::gc.3:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a9594aa00 con 0x561a959004c0 2024-09-22T08:39:38.903 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.902+0000 7fa646d01640 1 -- 172.21.15.142:0/2392704388 <== osd.1 v2:172.21.15.142:6816/3192108003 39 ==== osd_op_reply(159 gc.3 [call] v32'280 uv280 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fa630089040 con 0x561a959004c0 2024-09-22T08:39:38.903 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.902+0000 7fa64b920800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-22T08:39:38.903 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.902+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:160 6.3 6:c60da066:gc::gc.4:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a9594aa00 con 0x7fa640021020 2024-09-22T08:39:38.904 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.903+0000 7fa647502640 1 -- 172.21.15.142:0/2392704388 <== osd.2 v2:172.21.15.142:6808/279438927 24 ==== osd_op_reply(160 gc.4 [call] v32'88 uv88 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fa63800f030 con 0x7fa640021020 2024-09-22T08:39:38.905 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.903+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:161 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a9594aa00 con 0x7fa640021020 2024-09-22T08:39:38.905 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.903+0000 7fa647502640 1 -- 172.21.15.142:0/2392704388 <== osd.2 v2:172.21.15.142:6808/279438927 25 ==== osd_op_reply(161 gc.4 [call out=15b] v0'0 uv88 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fa63800f030 con 0x7fa640021020 2024-09-22T08:39:38.905 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.903+0000 7fa64b920800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:39:38.905 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.903+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:162 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a959499f0 con 0x7fa640021020 2024-09-22T08:39:38.905 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.903+0000 7fa647502640 1 -- 172.21.15.142:0/2392704388 <== osd.2 v2:172.21.15.142:6808/279438927 26 ==== osd_op_reply(162 gc.4 [call out=24b] v0'0 uv88 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fa63800f030 con 0x7fa640021020 2024-09-22T08:39:38.905 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.903+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:163 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a9594aa00 con 0x7fa640021020 2024-09-22T08:39:38.905 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.904+0000 7fa647502640 1 -- 172.21.15.142:0/2392704388 <== osd.2 v2:172.21.15.142:6808/279438927 27 ==== osd_op_reply(163 gc.4 [call out=15b] v0'0 uv88 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fa63800f030 con 0x7fa640021020 2024-09-22T08:39:38.905 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.904+0000 7fa64b920800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:39:38.905 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.904+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:164 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a9594aa00 con 0x7fa640021020 2024-09-22T08:39:38.906 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.904+0000 7fa647502640 1 -- 172.21.15.142:0/2392704388 <== osd.2 v2:172.21.15.142:6808/279438927 28 ==== osd_op_reply(164 gc.4 [call out=15b] v0'0 uv88 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fa63800f030 con 0x7fa640021020 2024-09-22T08:39:38.906 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.904+0000 7fa64b920800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:39:38.906 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.904+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:165 6.3 6:c60da066:gc::gc.4:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a9594aa00 con 0x7fa640021020 2024-09-22T08:39:38.906 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.905+0000 7fa647502640 1 -- 172.21.15.142:0/2392704388 <== osd.2 v2:172.21.15.142:6808/279438927 29 ==== osd_op_reply(165 gc.4 [call] v32'89 uv89 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fa63800f030 con 0x7fa640021020 2024-09-22T08:39:38.906 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.905+0000 7fa64b920800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-22T08:39:38.906 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.905+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:166 6.9 6:954be8d2:gc::gc.5:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a9594aa00 con 0x561a95904ed0 2024-09-22T08:39:38.907 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.906+0000 7fa647d03640 1 -- 172.21.15.142:0/2392704388 <== osd.3 v2:172.21.15.142:6800/1064901393 52 ==== osd_op_reply(166 gc.5 [call] v32'60 uv60 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fa64003cd70 con 0x561a95904ed0 2024-09-22T08:39:38.908 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.906+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:167 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a9594aa00 con 0x561a95904ed0 2024-09-22T08:39:38.908 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.906+0000 7fa647d03640 1 -- 172.21.15.142:0/2392704388 <== osd.3 v2:172.21.15.142:6800/1064901393 53 ==== osd_op_reply(167 gc.5 [call out=15b] v0'0 uv60 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fa64003cd70 con 0x561a95904ed0 2024-09-22T08:39:38.908 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.906+0000 7fa64b920800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:39:38.908 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.906+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:168 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a959499f0 con 0x561a95904ed0 2024-09-22T08:39:38.908 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.906+0000 7fa647d03640 1 -- 172.21.15.142:0/2392704388 <== osd.3 v2:172.21.15.142:6800/1064901393 54 ==== osd_op_reply(168 gc.5 [call out=24b] v0'0 uv60 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fa64003cd70 con 0x561a95904ed0 2024-09-22T08:39:38.908 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.906+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:169 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a9594aa00 con 0x561a95904ed0 2024-09-22T08:39:38.908 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.906+0000 7fa647d03640 1 -- 172.21.15.142:0/2392704388 <== osd.3 v2:172.21.15.142:6800/1064901393 55 ==== osd_op_reply(169 gc.5 [call out=15b] v0'0 uv60 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fa64003cd70 con 0x561a95904ed0 2024-09-22T08:39:38.908 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.906+0000 7fa64b920800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:39:38.908 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.906+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:170 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a9594aa00 con 0x561a95904ed0 2024-09-22T08:39:38.908 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.907+0000 7fa647d03640 1 -- 172.21.15.142:0/2392704388 <== osd.3 v2:172.21.15.142:6800/1064901393 56 ==== osd_op_reply(170 gc.5 [call out=15b] v0'0 uv60 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fa64003cd70 con 0x561a95904ed0 2024-09-22T08:39:38.908 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.907+0000 7fa64b920800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:39:38.908 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.907+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:171 6.9 6:954be8d2:gc::gc.5:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a9594aa00 con 0x561a95904ed0 2024-09-22T08:39:38.909 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.907+0000 7fa647d03640 1 -- 172.21.15.142:0/2392704388 <== osd.3 v2:172.21.15.142:6800/1064901393 57 ==== osd_op_reply(171 gc.5 [call] v32'61 uv61 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fa64003cd70 con 0x561a95904ed0 2024-09-22T08:39:38.909 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.907+0000 7fa64b920800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-22T08:39:38.909 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.907+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:172 6.e 6:748722ff:gc::gc.6:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a9594aa00 con 0x561a959004c0 2024-09-22T08:39:38.910 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.909+0000 7fa646d01640 1 -- 172.21.15.142:0/2392704388 <== osd.1 v2:172.21.15.142:6816/3192108003 40 ==== osd_op_reply(172 gc.6 [call] v32'34 uv34 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fa630089040 con 0x561a959004c0 2024-09-22T08:39:38.910 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.909+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:173 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a9594aa00 con 0x561a959004c0 2024-09-22T08:39:38.910 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.909+0000 7fa646d01640 1 -- 172.21.15.142:0/2392704388 <== osd.1 v2:172.21.15.142:6816/3192108003 41 ==== osd_op_reply(173 gc.6 [call out=15b] v0'0 uv34 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fa630089040 con 0x561a959004c0 2024-09-22T08:39:38.910 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.909+0000 7fa64b920800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:39:38.910 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.909+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:174 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a959499f0 con 0x561a959004c0 2024-09-22T08:39:38.910 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.909+0000 7fa646d01640 1 -- 172.21.15.142:0/2392704388 <== osd.1 v2:172.21.15.142:6816/3192108003 42 ==== osd_op_reply(174 gc.6 [call out=24b] v0'0 uv34 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fa630089040 con 0x561a959004c0 2024-09-22T08:39:38.911 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.909+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:175 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a9594aa00 con 0x561a959004c0 2024-09-22T08:39:38.911 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.909+0000 7fa646d01640 1 -- 172.21.15.142:0/2392704388 <== osd.1 v2:172.21.15.142:6816/3192108003 43 ==== osd_op_reply(175 gc.6 [call out=15b] v0'0 uv34 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fa630089040 con 0x561a959004c0 2024-09-22T08:39:38.911 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.909+0000 7fa64b920800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:39:38.911 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.909+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:176 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a9594aa00 con 0x561a959004c0 2024-09-22T08:39:38.911 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.910+0000 7fa646d01640 1 -- 172.21.15.142:0/2392704388 <== osd.1 v2:172.21.15.142:6816/3192108003 44 ==== osd_op_reply(176 gc.6 [call out=15b] v0'0 uv34 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fa630089040 con 0x561a959004c0 2024-09-22T08:39:38.911 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.910+0000 7fa64b920800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:39:38.912 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.910+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:177 6.e 6:748722ff:gc::gc.6:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a9594aa00 con 0x561a959004c0 2024-09-22T08:39:38.912 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.911+0000 7fa646d01640 1 -- 172.21.15.142:0/2392704388 <== osd.1 v2:172.21.15.142:6816/3192108003 45 ==== osd_op_reply(177 gc.6 [call] v32'35 uv35 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fa630089040 con 0x561a959004c0 2024-09-22T08:39:38.912 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.911+0000 7fa64b920800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-22T08:39:38.912 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.911+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:178 6.1d 6:beaa4be4:gc::gc.7:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a9594aa00 con 0x7fa638027020 2024-09-22T08:39:38.913 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.912+0000 7fa646d01640 1 -- 172.21.15.142:0/2392704388 <== osd.0 v2:172.21.15.31:6800/168281188 47 ==== osd_op_reply(178 gc.7 [call] v32'60 uv60 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fa630089040 con 0x7fa638027020 2024-09-22T08:39:38.913 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.912+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:179 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a9594aa00 con 0x7fa638027020 2024-09-22T08:39:38.913 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.912+0000 7fa646d01640 1 -- 172.21.15.142:0/2392704388 <== osd.0 v2:172.21.15.31:6800/168281188 48 ==== osd_op_reply(179 gc.7 [call out=15b] v0'0 uv60 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fa630089040 con 0x7fa638027020 2024-09-22T08:39:38.913 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.912+0000 7fa64b920800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:39:38.913 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.912+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:180 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a959499f0 con 0x7fa638027020 2024-09-22T08:39:38.914 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.913+0000 7fa646d01640 1 -- 172.21.15.142:0/2392704388 <== osd.0 v2:172.21.15.31:6800/168281188 49 ==== osd_op_reply(180 gc.7 [call out=24b] v0'0 uv60 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fa630089040 con 0x7fa638027020 2024-09-22T08:39:38.914 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.913+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:181 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a9594aa00 con 0x7fa638027020 2024-09-22T08:39:38.915 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.913+0000 7fa646d01640 1 -- 172.21.15.142:0/2392704388 <== osd.0 v2:172.21.15.31:6800/168281188 50 ==== osd_op_reply(181 gc.7 [call out=15b] v0'0 uv60 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fa630089040 con 0x7fa638027020 2024-09-22T08:39:38.915 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.913+0000 7fa64b920800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:39:38.915 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.913+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:182 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a9594aa00 con 0x7fa638027020 2024-09-22T08:39:38.915 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.913+0000 7fa646d01640 1 -- 172.21.15.142:0/2392704388 <== osd.0 v2:172.21.15.31:6800/168281188 51 ==== osd_op_reply(182 gc.7 [call out=15b] v0'0 uv60 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fa630089040 con 0x7fa638027020 2024-09-22T08:39:38.915 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.913+0000 7fa64b920800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:39:38.915 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.913+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:183 6.1d 6:beaa4be4:gc::gc.7:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a9594aa00 con 0x7fa638027020 2024-09-22T08:39:38.915 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.914+0000 7fa646d01640 1 -- 172.21.15.142:0/2392704388 <== osd.0 v2:172.21.15.31:6800/168281188 52 ==== osd_op_reply(183 gc.7 [call] v32'61 uv61 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fa630089040 con 0x7fa638027020 2024-09-22T08:39:38.915 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.914+0000 7fa64b920800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-22T08:39:38.916 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.914+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:184 6.12 6:4f78e9a2:gc::gc.8:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a9594aa00 con 0x7fa640021020 2024-09-22T08:39:38.918 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.915+0000 7fa647502640 1 -- 172.21.15.142:0/2392704388 <== osd.2 v2:172.21.15.142:6808/279438927 30 ==== osd_op_reply(184 gc.8 [call] v32'33 uv33 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fa63800f030 con 0x7fa640021020 2024-09-22T08:39:38.918 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.915+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:185 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a9594aa00 con 0x7fa640021020 2024-09-22T08:39:38.918 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.916+0000 7fa647502640 1 -- 172.21.15.142:0/2392704388 <== osd.2 v2:172.21.15.142:6808/279438927 31 ==== osd_op_reply(185 gc.8 [call out=15b] v0'0 uv33 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fa63800f030 con 0x7fa640021020 2024-09-22T08:39:38.918 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.916+0000 7fa64b920800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:39:38.918 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.916+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:186 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a959499f0 con 0x7fa640021020 2024-09-22T08:39:38.918 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.916+0000 7fa647502640 1 -- 172.21.15.142:0/2392704388 <== osd.2 v2:172.21.15.142:6808/279438927 32 ==== osd_op_reply(186 gc.8 [call out=24b] v0'0 uv33 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fa63800f030 con 0x7fa640021020 2024-09-22T08:39:38.918 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.916+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:187 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a9594aa00 con 0x7fa640021020 2024-09-22T08:39:38.919 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.916+0000 7fa647502640 1 -- 172.21.15.142:0/2392704388 <== osd.2 v2:172.21.15.142:6808/279438927 33 ==== osd_op_reply(187 gc.8 [call out=15b] v0'0 uv33 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fa63800f030 con 0x7fa640021020 2024-09-22T08:39:38.919 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.916+0000 7fa64b920800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:39:38.919 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.916+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:188 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a9594aa00 con 0x7fa640021020 2024-09-22T08:39:38.919 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.916+0000 7fa647502640 1 -- 172.21.15.142:0/2392704388 <== osd.2 v2:172.21.15.142:6808/279438927 34 ==== osd_op_reply(188 gc.8 [call out=15b] v0'0 uv33 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fa63800f030 con 0x7fa640021020 2024-09-22T08:39:38.919 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.916+0000 7fa64b920800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:39:38.919 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.916+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:189 6.12 6:4f78e9a2:gc::gc.8:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a9594aa00 con 0x7fa640021020 2024-09-22T08:39:38.921 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.918+0000 7fa647502640 1 -- 172.21.15.142:0/2392704388 <== osd.2 v2:172.21.15.142:6808/279438927 35 ==== osd_op_reply(189 gc.8 [call] v32'34 uv34 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fa63800f030 con 0x7fa640021020 2024-09-22T08:39:38.921 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.918+0000 7fa64b920800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-22T08:39:38.921 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.918+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:190 6.1c 6:3e426232:gc::gc.9:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a9594aa00 con 0x561a95904ed0 2024-09-22T08:39:38.921 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.918+0000 7fa647d03640 1 -- 172.21.15.142:0/2392704388 <== osd.3 v2:172.21.15.142:6800/1064901393 58 ==== osd_op_reply(190 gc.9 [call] v32'38 uv38 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fa64003cd70 con 0x561a95904ed0 2024-09-22T08:39:38.921 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.919+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:191 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a9594aa00 con 0x561a95904ed0 2024-09-22T08:39:38.921 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.919+0000 7fa647d03640 1 -- 172.21.15.142:0/2392704388 <== osd.3 v2:172.21.15.142:6800/1064901393 59 ==== osd_op_reply(191 gc.9 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fa64003cd70 con 0x561a95904ed0 2024-09-22T08:39:38.921 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.919+0000 7fa64b920800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:39:38.921 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.919+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:192 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a959499f0 con 0x561a95904ed0 2024-09-22T08:39:38.921 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.919+0000 7fa647d03640 1 -- 172.21.15.142:0/2392704388 <== osd.3 v2:172.21.15.142:6800/1064901393 60 ==== osd_op_reply(192 gc.9 [call out=24b] v0'0 uv38 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fa64003cd70 con 0x561a95904ed0 2024-09-22T08:39:38.921 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.919+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:193 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a9594aa00 con 0x561a95904ed0 2024-09-22T08:39:38.921 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.919+0000 7fa647d03640 1 -- 172.21.15.142:0/2392704388 <== osd.3 v2:172.21.15.142:6800/1064901393 61 ==== osd_op_reply(193 gc.9 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fa64003cd70 con 0x561a95904ed0 2024-09-22T08:39:38.922 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.919+0000 7fa64b920800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:39:38.922 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.919+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:194 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a9594aa00 con 0x561a95904ed0 2024-09-22T08:39:38.922 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.919+0000 7fa647d03640 1 -- 172.21.15.142:0/2392704388 <== osd.3 v2:172.21.15.142:6800/1064901393 62 ==== osd_op_reply(194 gc.9 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fa64003cd70 con 0x561a95904ed0 2024-09-22T08:39:38.922 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.919+0000 7fa64b920800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:39:38.922 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.919+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:195 6.1c 6:3e426232:gc::gc.9:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a9594aa00 con 0x561a95904ed0 2024-09-22T08:39:38.924 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.920+0000 7fa647d03640 1 -- 172.21.15.142:0/2392704388 <== osd.3 v2:172.21.15.142:6800/1064901393 63 ==== osd_op_reply(195 gc.9 [call] v32'39 uv39 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fa64003cd70 con 0x561a95904ed0 2024-09-22T08:39:38.924 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.920+0000 7fa64b920800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-22T08:39:38.924 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.920+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:196 6.3 6:c31f41d7:gc::gc.10:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a9594aa00 con 0x7fa640021020 2024-09-22T08:39:38.924 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.921+0000 7fa647502640 1 -- 172.21.15.142:0/2392704388 <== osd.2 v2:172.21.15.142:6808/279438927 36 ==== osd_op_reply(196 gc.10 [call] v32'90 uv90 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fa63800f030 con 0x7fa640021020 2024-09-22T08:39:38.924 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.921+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:197 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a9594aa00 con 0x7fa640021020 2024-09-22T08:39:38.924 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.922+0000 7fa647502640 1 -- 172.21.15.142:0/2392704388 <== osd.2 v2:172.21.15.142:6808/279438927 37 ==== osd_op_reply(197 gc.10 [call out=15b] v0'0 uv90 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa63800f030 con 0x7fa640021020 2024-09-22T08:39:38.924 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.922+0000 7fa64b920800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:39:38.924 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.922+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:198 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a959499f0 con 0x7fa640021020 2024-09-22T08:39:38.924 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.922+0000 7fa647502640 1 -- 172.21.15.142:0/2392704388 <== osd.2 v2:172.21.15.142:6808/279438927 38 ==== osd_op_reply(198 gc.10 [call out=24b] v0'0 uv90 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fa63800f030 con 0x7fa640021020 2024-09-22T08:39:38.925 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.922+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:199 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a9594aa00 con 0x7fa640021020 2024-09-22T08:39:38.925 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.922+0000 7fa647502640 1 -- 172.21.15.142:0/2392704388 <== osd.2 v2:172.21.15.142:6808/279438927 39 ==== osd_op_reply(199 gc.10 [call out=15b] v0'0 uv90 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa63800f030 con 0x7fa640021020 2024-09-22T08:39:38.925 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.922+0000 7fa64b920800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:39:38.925 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.922+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:200 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a9594aa00 con 0x7fa640021020 2024-09-22T08:39:38.925 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.922+0000 7fa647502640 1 -- 172.21.15.142:0/2392704388 <== osd.2 v2:172.21.15.142:6808/279438927 40 ==== osd_op_reply(200 gc.10 [call out=15b] v0'0 uv90 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa63800f030 con 0x7fa640021020 2024-09-22T08:39:38.925 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.922+0000 7fa64b920800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:39:38.925 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.922+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:201 6.3 6:c31f41d7:gc::gc.10:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a9594aa00 con 0x7fa640021020 2024-09-22T08:39:38.926 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.923+0000 7fa647502640 1 -- 172.21.15.142:0/2392704388 <== osd.2 v2:172.21.15.142:6808/279438927 41 ==== osd_op_reply(201 gc.10 [call] v32'91 uv91 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fa63800f030 con 0x7fa640021020 2024-09-22T08:39:38.926 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.923+0000 7fa64b920800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-22T08:39:38.926 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.923+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:202 6.13 6:c8333aab:gc::gc.11:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a9594aa00 con 0x7fa638027020 2024-09-22T08:39:38.927 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.924+0000 7fa646d01640 1 -- 172.21.15.142:0/2392704388 <== osd.0 v2:172.21.15.31:6800/168281188 53 ==== osd_op_reply(202 gc.11 [call] v32'42 uv42 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fa630089040 con 0x7fa638027020 2024-09-22T08:39:38.927 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.924+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:203 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a9594aa00 con 0x7fa638027020 2024-09-22T08:39:38.927 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.925+0000 7fa646d01640 1 -- 172.21.15.142:0/2392704388 <== osd.0 v2:172.21.15.31:6800/168281188 54 ==== osd_op_reply(203 gc.11 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa630089040 con 0x7fa638027020 2024-09-22T08:39:38.927 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.925+0000 7fa64b920800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:39:38.927 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.925+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:204 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a959499f0 con 0x7fa638027020 2024-09-22T08:39:38.927 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.925+0000 7fa646d01640 1 -- 172.21.15.142:0/2392704388 <== osd.0 v2:172.21.15.31:6800/168281188 55 ==== osd_op_reply(204 gc.11 [call out=24b] v0'0 uv42 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fa630089040 con 0x7fa638027020 2024-09-22T08:39:38.927 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.925+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:205 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a9594aa00 con 0x7fa638027020 2024-09-22T08:39:38.927 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.925+0000 7fa646d01640 1 -- 172.21.15.142:0/2392704388 <== osd.0 v2:172.21.15.31:6800/168281188 56 ==== osd_op_reply(205 gc.11 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa630089040 con 0x7fa638027020 2024-09-22T08:39:38.927 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.925+0000 7fa64b920800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:39:38.927 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.925+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:206 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a9594aa00 con 0x7fa638027020 2024-09-22T08:39:38.928 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.926+0000 7fa646d01640 1 -- 172.21.15.142:0/2392704388 <== osd.0 v2:172.21.15.31:6800/168281188 57 ==== osd_op_reply(206 gc.11 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa630089040 con 0x7fa638027020 2024-09-22T08:39:38.928 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.926+0000 7fa64b920800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:39:38.928 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.926+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:207 6.13 6:c8333aab:gc::gc.11:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a9594aa00 con 0x7fa638027020 2024-09-22T08:39:38.928 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.927+0000 7fa646d01640 1 -- 172.21.15.142:0/2392704388 <== osd.0 v2:172.21.15.31:6800/168281188 58 ==== osd_op_reply(207 gc.11 [call] v32'43 uv43 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fa630089040 con 0x7fa638027020 2024-09-22T08:39:38.928 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.927+0000 7fa64b920800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-22T08:39:38.928 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.927+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:208 6.15 6:ab569f81:gc::gc.12:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a9594aa00 con 0x7fa640021020 2024-09-22T08:39:38.930 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.928+0000 7fa647502640 1 -- 172.21.15.142:0/2392704388 <== osd.2 v2:172.21.15.142:6808/279438927 42 ==== osd_op_reply(208 gc.12 [call] v32'32 uv32 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fa63800f030 con 0x7fa640021020 2024-09-22T08:39:38.930 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.928+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:209 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a9594aa00 con 0x7fa640021020 2024-09-22T08:39:38.930 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.928+0000 7fa647502640 1 -- 172.21.15.142:0/2392704388 <== osd.2 v2:172.21.15.142:6808/279438927 43 ==== osd_op_reply(209 gc.12 [call out=15b] v0'0 uv32 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa63800f030 con 0x7fa640021020 2024-09-22T08:39:38.930 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.928+0000 7fa64b920800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:39:38.930 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.928+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:210 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a959499f0 con 0x7fa640021020 2024-09-22T08:39:38.930 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.928+0000 7fa647502640 1 -- 172.21.15.142:0/2392704388 <== osd.2 v2:172.21.15.142:6808/279438927 44 ==== osd_op_reply(210 gc.12 [call out=24b] v0'0 uv32 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fa63800f030 con 0x7fa640021020 2024-09-22T08:39:38.930 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.928+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:211 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a9594aa00 con 0x7fa640021020 2024-09-22T08:39:38.930 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.928+0000 7fa647502640 1 -- 172.21.15.142:0/2392704388 <== osd.2 v2:172.21.15.142:6808/279438927 45 ==== osd_op_reply(211 gc.12 [call out=15b] v0'0 uv32 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa63800f030 con 0x7fa640021020 2024-09-22T08:39:38.930 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.928+0000 7fa64b920800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:39:38.930 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.928+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:212 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a9594aa00 con 0x7fa640021020 2024-09-22T08:39:38.930 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.929+0000 7fa647502640 1 -- 172.21.15.142:0/2392704388 <== osd.2 v2:172.21.15.142:6808/279438927 46 ==== osd_op_reply(212 gc.12 [call out=15b] v0'0 uv32 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa63800f030 con 0x7fa640021020 2024-09-22T08:39:38.931 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.929+0000 7fa64b920800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:39:38.931 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.929+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:213 6.15 6:ab569f81:gc::gc.12:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a9594aa00 con 0x7fa640021020 2024-09-22T08:39:38.931 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.929+0000 7fa647502640 1 -- 172.21.15.142:0/2392704388 <== osd.2 v2:172.21.15.142:6808/279438927 47 ==== osd_op_reply(213 gc.12 [call] v32'33 uv33 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fa63800f030 con 0x7fa640021020 2024-09-22T08:39:38.931 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.930+0000 7fa64b920800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-22T08:39:38.931 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.930+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:214 6.0 6:0667bb13:gc::gc.13:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a9594aa00 con 0x7fa638027020 2024-09-22T08:39:38.933 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.931+0000 7fa646d01640 1 -- 172.21.15.142:0/2392704388 <== osd.0 v2:172.21.15.31:6800/168281188 59 ==== osd_op_reply(214 gc.13 [call] v32'68 uv68 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fa630089040 con 0x7fa638027020 2024-09-22T08:39:38.933 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.931+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:215 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a9594aa00 con 0x7fa638027020 2024-09-22T08:39:38.933 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.931+0000 7fa646d01640 1 -- 172.21.15.142:0/2392704388 <== osd.0 v2:172.21.15.31:6800/168281188 60 ==== osd_op_reply(215 gc.13 [call out=15b] v0'0 uv68 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa630089040 con 0x7fa638027020 2024-09-22T08:39:38.933 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.931+0000 7fa64b920800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:39:38.933 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.931+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:216 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a959499f0 con 0x7fa638027020 2024-09-22T08:39:38.933 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.931+0000 7fa646d01640 1 -- 172.21.15.142:0/2392704388 <== osd.0 v2:172.21.15.31:6800/168281188 61 ==== osd_op_reply(216 gc.13 [call out=24b] v0'0 uv68 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fa630089040 con 0x7fa638027020 2024-09-22T08:39:38.934 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.931+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:217 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a9594aa00 con 0x7fa638027020 2024-09-22T08:39:38.934 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.931+0000 7fa646d01640 1 -- 172.21.15.142:0/2392704388 <== osd.0 v2:172.21.15.31:6800/168281188 62 ==== osd_op_reply(217 gc.13 [call out=15b] v0'0 uv68 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa630089040 con 0x7fa638027020 2024-09-22T08:39:38.934 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.932+0000 7fa64b920800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:39:38.934 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.932+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:218 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a9594aa00 con 0x7fa638027020 2024-09-22T08:39:38.934 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.932+0000 7fa646d01640 1 -- 172.21.15.142:0/2392704388 <== osd.0 v2:172.21.15.31:6800/168281188 63 ==== osd_op_reply(218 gc.13 [call out=15b] v0'0 uv68 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa630089040 con 0x7fa638027020 2024-09-22T08:39:38.934 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.932+0000 7fa64b920800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:39:38.934 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.932+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:219 6.0 6:0667bb13:gc::gc.13:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a9594aa00 con 0x7fa638027020 2024-09-22T08:39:38.935 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.933+0000 7fa646d01640 1 -- 172.21.15.142:0/2392704388 <== osd.0 v2:172.21.15.31:6800/168281188 64 ==== osd_op_reply(219 gc.13 [call] v32'69 uv69 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fa630089040 con 0x7fa638027020 2024-09-22T08:39:38.935 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.933+0000 7fa64b920800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-22T08:39:38.935 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.933+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:220 6.4 6:227f63b5:gc::gc.14:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a9594aa00 con 0x561a959004c0 2024-09-22T08:39:38.936 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.934+0000 7fa646d01640 1 -- 172.21.15.142:0/2392704388 <== osd.1 v2:172.21.15.142:6816/3192108003 46 ==== osd_op_reply(220 gc.14 [call] v32'281 uv281 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fa630089040 con 0x561a959004c0 2024-09-22T08:39:38.937 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.934+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:221 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a9594aa00 con 0x561a959004c0 2024-09-22T08:39:38.937 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.934+0000 7fa646d01640 1 -- 172.21.15.142:0/2392704388 <== osd.1 v2:172.21.15.142:6816/3192108003 47 ==== osd_op_reply(221 gc.14 [call out=15b] v0'0 uv281 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa630089040 con 0x561a959004c0 2024-09-22T08:39:38.937 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.934+0000 7fa64b920800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:39:38.937 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.934+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:222 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a959499f0 con 0x561a959004c0 2024-09-22T08:39:38.937 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.935+0000 7fa646d01640 1 -- 172.21.15.142:0/2392704388 <== osd.1 v2:172.21.15.142:6816/3192108003 48 ==== osd_op_reply(222 gc.14 [call out=24b] v0'0 uv281 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fa630089040 con 0x561a959004c0 2024-09-22T08:39:38.937 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.935+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:223 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a9594aa00 con 0x561a959004c0 2024-09-22T08:39:38.937 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.935+0000 7fa646d01640 1 -- 172.21.15.142:0/2392704388 <== osd.1 v2:172.21.15.142:6816/3192108003 49 ==== osd_op_reply(223 gc.14 [call out=15b] v0'0 uv281 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa630089040 con 0x561a959004c0 2024-09-22T08:39:38.937 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.935+0000 7fa64b920800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:39:38.937 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.935+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:224 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a9594aa00 con 0x561a959004c0 2024-09-22T08:39:38.937 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.935+0000 7fa646d01640 1 -- 172.21.15.142:0/2392704388 <== osd.1 v2:172.21.15.142:6816/3192108003 50 ==== osd_op_reply(224 gc.14 [call out=15b] v0'0 uv281 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa630089040 con 0x561a959004c0 2024-09-22T08:39:38.938 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.935+0000 7fa64b920800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:39:38.938 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.935+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:225 6.4 6:227f63b5:gc::gc.14:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a9594aa00 con 0x561a959004c0 2024-09-22T08:39:38.939 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.936+0000 7fa646d01640 1 -- 172.21.15.142:0/2392704388 <== osd.1 v2:172.21.15.142:6816/3192108003 51 ==== osd_op_reply(225 gc.14 [call] v32'282 uv282 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fa630089040 con 0x561a959004c0 2024-09-22T08:39:38.939 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.936+0000 7fa64b920800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-22T08:39:38.939 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.936+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:226 6.7 6:e07a6548:gc::gc.15:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a9594aa00 con 0x561a95904ed0 2024-09-22T08:39:38.939 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.937+0000 7fa647d03640 1 -- 172.21.15.142:0/2392704388 <== osd.3 v2:172.21.15.142:6800/1064901393 64 ==== osd_op_reply(226 gc.15 [call] v32'82 uv82 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fa64003cd70 con 0x561a95904ed0 2024-09-22T08:39:38.939 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.938+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:227 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a9594aa00 con 0x561a95904ed0 2024-09-22T08:39:38.939 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.938+0000 7fa647d03640 1 -- 172.21.15.142:0/2392704388 <== osd.3 v2:172.21.15.142:6800/1064901393 65 ==== osd_op_reply(227 gc.15 [call out=15b] v0'0 uv82 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa64003cd70 con 0x561a95904ed0 2024-09-22T08:39:38.939 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.938+0000 7fa64b920800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:39:38.939 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.938+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:228 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a959499f0 con 0x561a95904ed0 2024-09-22T08:39:38.940 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.938+0000 7fa647d03640 1 -- 172.21.15.142:0/2392704388 <== osd.3 v2:172.21.15.142:6800/1064901393 66 ==== osd_op_reply(228 gc.15 [call out=24b] v0'0 uv82 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fa64003cd70 con 0x561a95904ed0 2024-09-22T08:39:38.940 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.938+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:229 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a9594aa00 con 0x561a95904ed0 2024-09-22T08:39:38.940 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.938+0000 7fa647d03640 1 -- 172.21.15.142:0/2392704388 <== osd.3 v2:172.21.15.142:6800/1064901393 67 ==== osd_op_reply(229 gc.15 [call out=15b] v0'0 uv82 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa64003cd70 con 0x561a95904ed0 2024-09-22T08:39:38.941 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.938+0000 7fa64b920800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:39:38.941 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.938+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:230 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a9594aa00 con 0x561a95904ed0 2024-09-22T08:39:38.941 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.938+0000 7fa647d03640 1 -- 172.21.15.142:0/2392704388 <== osd.3 v2:172.21.15.142:6800/1064901393 68 ==== osd_op_reply(230 gc.15 [call out=15b] v0'0 uv82 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa64003cd70 con 0x561a95904ed0 2024-09-22T08:39:38.941 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.938+0000 7fa64b920800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:39:38.941 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.938+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:231 6.7 6:e07a6548:gc::gc.15:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a9594aa00 con 0x561a95904ed0 2024-09-22T08:39:38.943 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.940+0000 7fa647d03640 1 -- 172.21.15.142:0/2392704388 <== osd.3 v2:172.21.15.142:6800/1064901393 69 ==== osd_op_reply(231 gc.15 [call] v32'83 uv83 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fa64003cd70 con 0x561a95904ed0 2024-09-22T08:39:38.943 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.940+0000 7fa64b920800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-22T08:39:38.943 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.940+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:232 6.3 6:c623b173:gc::gc.16:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a9594aa00 con 0x7fa640021020 2024-09-22T08:39:38.943 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.941+0000 7fa647502640 1 -- 172.21.15.142:0/2392704388 <== osd.2 v2:172.21.15.142:6808/279438927 48 ==== osd_op_reply(232 gc.16 [call] v32'92 uv92 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fa63800f030 con 0x7fa640021020 2024-09-22T08:39:38.943 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.941+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:233 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a9594aa00 con 0x7fa640021020 2024-09-22T08:39:38.943 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.941+0000 7fa647502640 1 -- 172.21.15.142:0/2392704388 <== osd.2 v2:172.21.15.142:6808/279438927 49 ==== osd_op_reply(233 gc.16 [call out=15b] v0'0 uv92 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa63800f030 con 0x7fa640021020 2024-09-22T08:39:38.943 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.941+0000 7fa64b920800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:39:38.943 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.941+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:234 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a959499f0 con 0x7fa640021020 2024-09-22T08:39:38.943 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.941+0000 7fa647502640 1 -- 172.21.15.142:0/2392704388 <== osd.2 v2:172.21.15.142:6808/279438927 50 ==== osd_op_reply(234 gc.16 [call out=24b] v0'0 uv92 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fa63800f030 con 0x7fa640021020 2024-09-22T08:39:38.943 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.941+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:235 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a9594aa00 con 0x7fa640021020 2024-09-22T08:39:38.943 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.941+0000 7fa647502640 1 -- 172.21.15.142:0/2392704388 <== osd.2 v2:172.21.15.142:6808/279438927 51 ==== osd_op_reply(235 gc.16 [call out=15b] v0'0 uv92 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa63800f030 con 0x7fa640021020 2024-09-22T08:39:38.944 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.941+0000 7fa64b920800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:39:38.944 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.941+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:236 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a9594aa00 con 0x7fa640021020 2024-09-22T08:39:38.944 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.941+0000 7fa647502640 1 -- 172.21.15.142:0/2392704388 <== osd.2 v2:172.21.15.142:6808/279438927 52 ==== osd_op_reply(236 gc.16 [call out=15b] v0'0 uv92 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa63800f030 con 0x7fa640021020 2024-09-22T08:39:38.944 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.941+0000 7fa64b920800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:39:38.944 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.941+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:237 6.3 6:c623b173:gc::gc.16:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a9594aa00 con 0x7fa640021020 2024-09-22T08:39:38.945 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.942+0000 7fa647502640 1 -- 172.21.15.142:0/2392704388 <== osd.2 v2:172.21.15.142:6808/279438927 53 ==== osd_op_reply(237 gc.16 [call] v32'93 uv93 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fa63800f030 con 0x7fa640021020 2024-09-22T08:39:38.946 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.942+0000 7fa64b920800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-22T08:39:38.946 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.942+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:238 6.16 6:6849fd06:gc::gc.17:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a9594aa00 con 0x561a95904ed0 2024-09-22T08:39:38.946 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.943+0000 7fa647d03640 1 -- 172.21.15.142:0/2392704388 <== osd.3 v2:172.21.15.142:6800/1064901393 70 ==== osd_op_reply(238 gc.17 [call] v32'32 uv32 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fa64003cd70 con 0x561a95904ed0 2024-09-22T08:39:38.946 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.943+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:239 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a9594aa00 con 0x561a95904ed0 2024-09-22T08:39:38.946 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.943+0000 7fa647d03640 1 -- 172.21.15.142:0/2392704388 <== osd.3 v2:172.21.15.142:6800/1064901393 71 ==== osd_op_reply(239 gc.17 [call out=15b] v0'0 uv32 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa64003cd70 con 0x561a95904ed0 2024-09-22T08:39:38.946 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.943+0000 7fa64b920800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:39:38.946 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.943+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:240 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a959499f0 con 0x561a95904ed0 2024-09-22T08:39:38.946 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.944+0000 7fa647d03640 1 -- 172.21.15.142:0/2392704388 <== osd.3 v2:172.21.15.142:6800/1064901393 72 ==== osd_op_reply(240 gc.17 [call out=24b] v0'0 uv32 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fa64003cd70 con 0x561a95904ed0 2024-09-22T08:39:38.946 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.944+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:241 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a9594aa00 con 0x561a95904ed0 2024-09-22T08:39:38.946 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.944+0000 7fa647d03640 1 -- 172.21.15.142:0/2392704388 <== osd.3 v2:172.21.15.142:6800/1064901393 73 ==== osd_op_reply(241 gc.17 [call out=15b] v0'0 uv32 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa64003cd70 con 0x561a95904ed0 2024-09-22T08:39:38.946 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.944+0000 7fa64b920800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:39:38.947 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.944+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:242 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a9594aa00 con 0x561a95904ed0 2024-09-22T08:39:38.947 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.944+0000 7fa647d03640 1 -- 172.21.15.142:0/2392704388 <== osd.3 v2:172.21.15.142:6800/1064901393 74 ==== osd_op_reply(242 gc.17 [call out=15b] v0'0 uv32 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa64003cd70 con 0x561a95904ed0 2024-09-22T08:39:38.947 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.944+0000 7fa64b920800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:39:38.947 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.944+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:243 6.16 6:6849fd06:gc::gc.17:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a9594aa00 con 0x561a95904ed0 2024-09-22T08:39:38.949 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.945+0000 7fa647d03640 1 -- 172.21.15.142:0/2392704388 <== osd.3 v2:172.21.15.142:6800/1064901393 75 ==== osd_op_reply(243 gc.17 [call] v32'33 uv33 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fa64003cd70 con 0x561a95904ed0 2024-09-22T08:39:38.949 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.945+0000 7fa64b920800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-22T08:39:38.949 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.945+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:244 6.d 6:b019ea83:gc::gc.18:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a9594aa00 con 0x561a959004c0 2024-09-22T08:39:38.949 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.946+0000 7fa646d01640 1 -- 172.21.15.142:0/2392704388 <== osd.1 v2:172.21.15.142:6816/3192108003 52 ==== osd_op_reply(244 gc.18 [call] v32'40 uv40 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fa630089040 con 0x561a959004c0 2024-09-22T08:39:38.949 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.946+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:245 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a9594aa00 con 0x561a959004c0 2024-09-22T08:39:38.949 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.946+0000 7fa646d01640 1 -- 172.21.15.142:0/2392704388 <== osd.1 v2:172.21.15.142:6816/3192108003 53 ==== osd_op_reply(245 gc.18 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa630089040 con 0x561a959004c0 2024-09-22T08:39:38.949 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.946+0000 7fa64b920800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:39:38.949 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.946+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:246 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a959499f0 con 0x561a959004c0 2024-09-22T08:39:38.949 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.947+0000 7fa646d01640 1 -- 172.21.15.142:0/2392704388 <== osd.1 v2:172.21.15.142:6816/3192108003 54 ==== osd_op_reply(246 gc.18 [call out=24b] v0'0 uv40 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fa630089040 con 0x561a959004c0 2024-09-22T08:39:38.949 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.947+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:247 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a9594aa00 con 0x561a959004c0 2024-09-22T08:39:38.949 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.947+0000 7fa646d01640 1 -- 172.21.15.142:0/2392704388 <== osd.1 v2:172.21.15.142:6816/3192108003 55 ==== osd_op_reply(247 gc.18 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa630089040 con 0x561a959004c0 2024-09-22T08:39:38.950 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.947+0000 7fa64b920800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:39:38.950 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.947+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:248 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a9594aa00 con 0x561a959004c0 2024-09-22T08:39:38.950 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.947+0000 7fa646d01640 1 -- 172.21.15.142:0/2392704388 <== osd.1 v2:172.21.15.142:6816/3192108003 56 ==== osd_op_reply(248 gc.18 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa630089040 con 0x561a959004c0 2024-09-22T08:39:38.950 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.947+0000 7fa64b920800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:39:38.950 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.947+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:249 6.d 6:b019ea83:gc::gc.18:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a9594aa00 con 0x561a959004c0 2024-09-22T08:39:38.952 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.948+0000 7fa646d01640 1 -- 172.21.15.142:0/2392704388 <== osd.1 v2:172.21.15.142:6816/3192108003 57 ==== osd_op_reply(249 gc.18 [call] v32'41 uv41 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fa630089040 con 0x561a959004c0 2024-09-22T08:39:38.952 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.948+0000 7fa64b920800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-22T08:39:38.952 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.948+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:250 6.4 6:24c8e1ae:gc::gc.19:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a9594aa00 con 0x561a959004c0 2024-09-22T08:39:38.952 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.949+0000 7fa646d01640 1 -- 172.21.15.142:0/2392704388 <== osd.1 v2:172.21.15.142:6816/3192108003 58 ==== osd_op_reply(250 gc.19 [call] v32'283 uv283 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fa630089040 con 0x561a959004c0 2024-09-22T08:39:38.952 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.949+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:251 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a9594aa00 con 0x561a959004c0 2024-09-22T08:39:38.952 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.949+0000 7fa646d01640 1 -- 172.21.15.142:0/2392704388 <== osd.1 v2:172.21.15.142:6816/3192108003 59 ==== osd_op_reply(251 gc.19 [call out=15b] v0'0 uv283 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa630089040 con 0x561a959004c0 2024-09-22T08:39:38.952 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.950+0000 7fa64b920800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:39:38.952 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.950+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:252 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a959499f0 con 0x561a959004c0 2024-09-22T08:39:38.952 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.950+0000 7fa646d01640 1 -- 172.21.15.142:0/2392704388 <== osd.1 v2:172.21.15.142:6816/3192108003 60 ==== osd_op_reply(252 gc.19 [call out=24b] v0'0 uv283 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fa630089040 con 0x561a959004c0 2024-09-22T08:39:38.952 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.950+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:253 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a9594aa00 con 0x561a959004c0 2024-09-22T08:39:38.952 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.950+0000 7fa646d01640 1 -- 172.21.15.142:0/2392704388 <== osd.1 v2:172.21.15.142:6816/3192108003 61 ==== osd_op_reply(253 gc.19 [call out=15b] v0'0 uv283 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa630089040 con 0x561a959004c0 2024-09-22T08:39:38.953 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.950+0000 7fa64b920800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:39:38.953 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.950+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:254 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a9594aa00 con 0x561a959004c0 2024-09-22T08:39:38.953 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.950+0000 7fa646d01640 1 -- 172.21.15.142:0/2392704388 <== osd.1 v2:172.21.15.142:6816/3192108003 62 ==== osd_op_reply(254 gc.19 [call out=15b] v0'0 uv283 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa630089040 con 0x561a959004c0 2024-09-22T08:39:38.953 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.950+0000 7fa64b920800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:39:38.953 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.950+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:255 6.4 6:24c8e1ae:gc::gc.19:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a9594aa00 con 0x561a959004c0 2024-09-22T08:39:38.955 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.951+0000 7fa646d01640 1 -- 172.21.15.142:0/2392704388 <== osd.1 v2:172.21.15.142:6816/3192108003 63 ==== osd_op_reply(255 gc.19 [call] v32'284 uv284 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fa630089040 con 0x561a959004c0 2024-09-22T08:39:38.955 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.951+0000 7fa64b920800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-22T08:39:38.955 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.951+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:256 6.7 6:e622f76a:gc::gc.20:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a9594aa00 con 0x561a95904ed0 2024-09-22T08:39:38.955 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.952+0000 7fa647d03640 1 -- 172.21.15.142:0/2392704388 <== osd.3 v2:172.21.15.142:6800/1064901393 76 ==== osd_op_reply(256 gc.20 [call] v32'84 uv84 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fa64003cd70 con 0x561a95904ed0 2024-09-22T08:39:38.955 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.953+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:257 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a9594aa00 con 0x561a95904ed0 2024-09-22T08:39:38.955 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.953+0000 7fa647d03640 1 -- 172.21.15.142:0/2392704388 <== osd.3 v2:172.21.15.142:6800/1064901393 77 ==== osd_op_reply(257 gc.20 [call out=15b] v0'0 uv84 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa64003cd70 con 0x561a95904ed0 2024-09-22T08:39:38.955 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.953+0000 7fa64b920800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:39:38.955 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.953+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:258 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a959499f0 con 0x561a95904ed0 2024-09-22T08:39:38.955 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.953+0000 7fa647d03640 1 -- 172.21.15.142:0/2392704388 <== osd.3 v2:172.21.15.142:6800/1064901393 78 ==== osd_op_reply(258 gc.20 [call out=24b] v0'0 uv84 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fa64003cd70 con 0x561a95904ed0 2024-09-22T08:39:38.956 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.953+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:259 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a9594aa00 con 0x561a95904ed0 2024-09-22T08:39:38.956 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.953+0000 7fa647d03640 1 -- 172.21.15.142:0/2392704388 <== osd.3 v2:172.21.15.142:6800/1064901393 79 ==== osd_op_reply(259 gc.20 [call out=15b] v0'0 uv84 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa64003cd70 con 0x561a95904ed0 2024-09-22T08:39:38.956 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.953+0000 7fa64b920800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:39:38.956 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.953+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:260 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a9594aa00 con 0x561a95904ed0 2024-09-22T08:39:38.956 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.953+0000 7fa647d03640 1 -- 172.21.15.142:0/2392704388 <== osd.3 v2:172.21.15.142:6800/1064901393 80 ==== osd_op_reply(260 gc.20 [call out=15b] v0'0 uv84 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa64003cd70 con 0x561a95904ed0 2024-09-22T08:39:38.956 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.953+0000 7fa64b920800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:39:38.956 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.953+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:261 6.7 6:e622f76a:gc::gc.20:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a9594aa00 con 0x561a95904ed0 2024-09-22T08:39:38.958 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.955+0000 7fa647d03640 1 -- 172.21.15.142:0/2392704388 <== osd.3 v2:172.21.15.142:6800/1064901393 81 ==== osd_op_reply(261 gc.20 [call] v32'85 uv85 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fa64003cd70 con 0x561a95904ed0 2024-09-22T08:39:38.958 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.955+0000 7fa64b920800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-22T08:39:38.958 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.955+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:262 6.a 6:5127e642:gc::gc.21:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a9594aa00 con 0x7fa640021020 2024-09-22T08:39:38.958 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.956+0000 7fa647502640 1 -- 172.21.15.142:0/2392704388 <== osd.2 v2:172.21.15.142:6808/279438927 54 ==== osd_op_reply(262 gc.21 [call] v32'42 uv42 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fa63800f030 con 0x7fa640021020 2024-09-22T08:39:38.958 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.956+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:263 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a9594aa00 con 0x7fa640021020 2024-09-22T08:39:38.958 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.956+0000 7fa647502640 1 -- 172.21.15.142:0/2392704388 <== osd.2 v2:172.21.15.142:6808/279438927 55 ==== osd_op_reply(263 gc.21 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa63800f030 con 0x7fa640021020 2024-09-22T08:39:38.958 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.956+0000 7fa64b920800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:39:38.958 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.956+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:264 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a959499f0 con 0x7fa640021020 2024-09-22T08:39:38.959 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.956+0000 7fa647502640 1 -- 172.21.15.142:0/2392704388 <== osd.2 v2:172.21.15.142:6808/279438927 56 ==== osd_op_reply(264 gc.21 [call out=24b] v0'0 uv42 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fa63800f030 con 0x7fa640021020 2024-09-22T08:39:38.959 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.956+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:265 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a9594aa00 con 0x7fa640021020 2024-09-22T08:39:38.959 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.956+0000 7fa647502640 1 -- 172.21.15.142:0/2392704388 <== osd.2 v2:172.21.15.142:6808/279438927 57 ==== osd_op_reply(265 gc.21 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa63800f030 con 0x7fa640021020 2024-09-22T08:39:38.959 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.956+0000 7fa64b920800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:39:38.959 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.956+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:266 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a9594aa00 con 0x7fa640021020 2024-09-22T08:39:38.959 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.957+0000 7fa647502640 1 -- 172.21.15.142:0/2392704388 <== osd.2 v2:172.21.15.142:6808/279438927 58 ==== osd_op_reply(266 gc.21 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa63800f030 con 0x7fa640021020 2024-09-22T08:39:38.959 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.957+0000 7fa64b920800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:39:38.959 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.957+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:267 6.a 6:5127e642:gc::gc.21:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a9594aa00 con 0x7fa640021020 2024-09-22T08:39:38.962 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.957+0000 7fa647502640 1 -- 172.21.15.142:0/2392704388 <== osd.2 v2:172.21.15.142:6808/279438927 59 ==== osd_op_reply(267 gc.21 [call] v32'43 uv43 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fa63800f030 con 0x7fa640021020 2024-09-22T08:39:38.962 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.957+0000 7fa64b920800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-22T08:39:38.962 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.958+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:268 6.11 6:8eb99c53:gc::gc.22:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a9594aa00 con 0x561a95904ed0 2024-09-22T08:39:38.963 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.958+0000 7fa647d03640 1 -- 172.21.15.142:0/2392704388 <== osd.3 v2:172.21.15.142:6800/1064901393 82 ==== osd_op_reply(268 gc.22 [call] v32'35 uv35 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fa64003cd70 con 0x561a95904ed0 2024-09-22T08:39:38.963 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.959+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:269 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a9594aa00 con 0x561a95904ed0 2024-09-22T08:39:38.963 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.959+0000 7fa647d03640 1 -- 172.21.15.142:0/2392704388 <== osd.3 v2:172.21.15.142:6800/1064901393 83 ==== osd_op_reply(269 gc.22 [call out=15b] v0'0 uv35 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa64003cd70 con 0x561a95904ed0 2024-09-22T08:39:38.963 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.959+0000 7fa64b920800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:39:38.963 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.959+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:270 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a959499f0 con 0x561a95904ed0 2024-09-22T08:39:38.963 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.959+0000 7fa647d03640 1 -- 172.21.15.142:0/2392704388 <== osd.3 v2:172.21.15.142:6800/1064901393 84 ==== osd_op_reply(270 gc.22 [call out=24b] v0'0 uv35 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fa64003cd70 con 0x561a95904ed0 2024-09-22T08:39:38.963 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.959+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:271 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a9594aa00 con 0x561a95904ed0 2024-09-22T08:39:38.963 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.959+0000 7fa647d03640 1 -- 172.21.15.142:0/2392704388 <== osd.3 v2:172.21.15.142:6800/1064901393 85 ==== osd_op_reply(271 gc.22 [call out=15b] v0'0 uv35 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa64003cd70 con 0x561a95904ed0 2024-09-22T08:39:38.963 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.959+0000 7fa64b920800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:39:38.963 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.959+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:272 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a9594aa00 con 0x561a95904ed0 2024-09-22T08:39:38.963 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.960+0000 7fa647d03640 1 -- 172.21.15.142:0/2392704388 <== osd.3 v2:172.21.15.142:6800/1064901393 86 ==== osd_op_reply(272 gc.22 [call out=1716b] v0'0 uv35 ondisk = 0) ==== 149+0+1716 (crc 0 0 0) 0x7fa64003cd70 con 0x561a95904ed0 2024-09-22T08:39:38.963 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.960+0000 7fa64b920800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-22T08:39:38.964 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.960+0000 7fa64b920800 20 garbage collection: RGWGC::process iterating over entry tag='e239248c-0bee-4e41-803a-24b288d3eb8f.4226.11677250877738572534', time=2024-09-22T08:39:46.962828+0000, chain.objs.size()=7 2024-09-22T08:39:38.964 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.960+0000 7fa64b920800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e239248c-0bee-4e41-803a-24b288d3eb8f.4226.11__shadow_.E4Lqf1wNqg4xvoHP0fwBQ3ZtA7UnzcN_1 2024-09-22T08:39:38.964 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.960+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:273 3.32 3:4cccf38d:::e239248c-0bee-4e41-803a-24b288d3eb8f.4226.11__shadow_.E4Lqf1wNqg4xvoHP0fwBQ3ZtA7UnzcN_1:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a9594b0e0 con 0x561a95904ed0 2024-09-22T08:39:38.964 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.960+0000 7fa64b920800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e239248c-0bee-4e41-803a-24b288d3eb8f.4226.11__shadow_.E4Lqf1wNqg4xvoHP0fwBQ3ZtA7UnzcN_2 2024-09-22T08:39:38.964 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.960+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:274 3.36 3:6cb86e8c:::e239248c-0bee-4e41-803a-24b288d3eb8f.4226.11__shadow_.E4Lqf1wNqg4xvoHP0fwBQ3ZtA7UnzcN_2:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a9594dd40 con 0x7fa640021020 2024-09-22T08:39:38.964 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.960+0000 7fa64b920800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e239248c-0bee-4e41-803a-24b288d3eb8f.4226.11__shadow_.E4Lqf1wNqg4xvoHP0fwBQ3ZtA7UnzcN_3 2024-09-22T08:39:38.964 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.960+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:275 3.1d 3:bbd8955d:::e239248c-0bee-4e41-803a-24b288d3eb8f.4226.11__shadow_.E4Lqf1wNqg4xvoHP0fwBQ3ZtA7UnzcN_3:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a9594dd40 con 0x561a95904ed0 2024-09-22T08:39:38.964 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.960+0000 7fa64b920800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e239248c-0bee-4e41-803a-24b288d3eb8f.4226.11__shadow_.E4Lqf1wNqg4xvoHP0fwBQ3ZtA7UnzcN_4 2024-09-22T08:39:38.964 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.960+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:276 3.12 3:48e3f6f9:::e239248c-0bee-4e41-803a-24b288d3eb8f.4226.11__shadow_.E4Lqf1wNqg4xvoHP0fwBQ3ZtA7UnzcN_4:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a95952cc0 con 0x7fa640021020 2024-09-22T08:39:38.964 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.960+0000 7fa64b920800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e239248c-0bee-4e41-803a-24b288d3eb8f.4226.11__shadow_.E4Lqf1wNqg4xvoHP0fwBQ3ZtA7UnzcN_5 2024-09-22T08:39:38.964 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.960+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:277 3.2 3:41c29f2a:::e239248c-0bee-4e41-803a-24b288d3eb8f.4226.11__shadow_.E4Lqf1wNqg4xvoHP0fwBQ3ZtA7UnzcN_5:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a9594dd40 con 0x561a95904ed0 2024-09-22T08:39:38.964 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.960+0000 7fa64b920800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e239248c-0bee-4e41-803a-24b288d3eb8f.4226.11__shadow_.E4Lqf1wNqg4xvoHP0fwBQ3ZtA7UnzcN_6 2024-09-22T08:39:38.965 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.960+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:278 3.2f 3:f7962d3b:::e239248c-0bee-4e41-803a-24b288d3eb8f.4226.11__shadow_.E4Lqf1wNqg4xvoHP0fwBQ3ZtA7UnzcN_6:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a95957c80 con 0x561a95904ed0 2024-09-22T08:39:38.965 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.960+0000 7fa64b920800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e239248c-0bee-4e41-803a-24b288d3eb8f.4226.11__shadow_.E4Lqf1wNqg4xvoHP0fwBQ3ZtA7UnzcN_7 2024-09-22T08:39:38.965 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.960+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:279 3.0 3:02e77763:::e239248c-0bee-4e41-803a-24b288d3eb8f.4226.11__shadow_.E4Lqf1wNqg4xvoHP0fwBQ3ZtA7UnzcN_7:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a9595a890 con 0x7fa638027020 2024-09-22T08:39:38.966 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.962+0000 7fa646d01640 1 -- 172.21.15.142:0/2392704388 <== osd.0 v2:172.21.15.31:6800/168281188 65 ==== osd_op_reply(279 e239248c-0bee-4e41-803a-24b288d3eb8f.4226.11__shadow_.E4Lqf1wNqg4xvoHP0fwBQ3ZtA7UnzcN_7 [call] v32'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7fa630089040 con 0x7fa638027020 2024-09-22T08:39:38.966 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.963+0000 7fa647d03640 1 -- 172.21.15.142:0/2392704388 <== osd.3 v2:172.21.15.142:6800/1064901393 87 ==== osd_op_reply(273 e239248c-0bee-4e41-803a-24b288d3eb8f.4226.11__shadow_.E4Lqf1wNqg4xvoHP0fwBQ3ZtA7UnzcN_1 [call] v32'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7fa64003cd70 con 0x561a95904ed0 2024-09-22T08:39:38.966 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.963+0000 7fa647d03640 1 -- 172.21.15.142:0/2392704388 <== osd.3 v2:172.21.15.142:6800/1064901393 88 ==== osd_op_reply(275 e239248c-0bee-4e41-803a-24b288d3eb8f.4226.11__shadow_.E4Lqf1wNqg4xvoHP0fwBQ3ZtA7UnzcN_3 [call] v32'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7fa64003cd70 con 0x561a95904ed0 2024-09-22T08:39:38.966 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.963+0000 7fa647502640 1 -- 172.21.15.142:0/2392704388 <== osd.2 v2:172.21.15.142:6808/279438927 60 ==== osd_op_reply(274 e239248c-0bee-4e41-803a-24b288d3eb8f.4226.11__shadow_.E4Lqf1wNqg4xvoHP0fwBQ3ZtA7UnzcN_2 [call] v32'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7fa63800f030 con 0x7fa640021020 2024-09-22T08:39:38.966 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.963+0000 7fa647d03640 1 -- 172.21.15.142:0/2392704388 <== osd.3 v2:172.21.15.142:6800/1064901393 89 ==== osd_op_reply(277 e239248c-0bee-4e41-803a-24b288d3eb8f.4226.11__shadow_.E4Lqf1wNqg4xvoHP0fwBQ3ZtA7UnzcN_5 [call] v32'6 uv6 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7fa64003cd70 con 0x561a95904ed0 2024-09-22T08:39:38.966 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.963+0000 7fa647d03640 1 -- 172.21.15.142:0/2392704388 <== osd.3 v2:172.21.15.142:6800/1064901393 90 ==== osd_op_reply(278 e239248c-0bee-4e41-803a-24b288d3eb8f.4226.11__shadow_.E4Lqf1wNqg4xvoHP0fwBQ3ZtA7UnzcN_6 [call] v32'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7fa64003cd70 con 0x561a95904ed0 2024-09-22T08:39:38.967 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.964+0000 7fa647502640 1 -- 172.21.15.142:0/2392704388 <== osd.2 v2:172.21.15.142:6808/279438927 61 ==== osd_op_reply(276 e239248c-0bee-4e41-803a-24b288d3eb8f.4226.11__shadow_.E4Lqf1wNqg4xvoHP0fwBQ3ZtA7UnzcN_4 [call] v32'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7fa63800f030 con 0x7fa640021020 2024-09-22T08:39:38.967 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.964+0000 7fa64b920800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T08:39:38.967 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.964+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:280 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_remove_entries in=47b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a9594dd40 con 0x561a95904ed0 2024-09-22T08:39:38.967 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.965+0000 7fa647d03640 1 -- 172.21.15.142:0/2392704388 <== osd.3 v2:172.21.15.142:6800/1064901393 91 ==== osd_op_reply(280 gc.22 [call] v32'36 uv36 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fa64003cd70 con 0x561a95904ed0 2024-09-22T08:39:38.967 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.965+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:281 6.11 6:8eb99c53:gc::gc.22:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a9595a890 con 0x561a95904ed0 2024-09-22T08:39:38.969 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.966+0000 7fa647d03640 1 -- 172.21.15.142:0/2392704388 <== osd.3 v2:172.21.15.142:6800/1064901393 92 ==== osd_op_reply(281 gc.22 [call] v32'37 uv37 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fa64003cd70 con 0x561a95904ed0 2024-09-22T08:39:38.969 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.966+0000 7fa64b920800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-22T08:39:38.969 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.966+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:282 6.8 6:17d7e8ed:gc::gc.23:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a9594dd40 con 0x561a95904ed0 2024-09-22T08:39:38.969 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.966+0000 7fa647d03640 1 -- 172.21.15.142:0/2392704388 <== osd.3 v2:172.21.15.142:6800/1064901393 93 ==== osd_op_reply(282 gc.23 [call] v32'40 uv40 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fa64003cd70 con 0x561a95904ed0 2024-09-22T08:39:38.969 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.966+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:283 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a9595a890 con 0x561a95904ed0 2024-09-22T08:39:38.969 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.967+0000 7fa647d03640 1 -- 172.21.15.142:0/2392704388 <== osd.3 v2:172.21.15.142:6800/1064901393 94 ==== osd_op_reply(283 gc.23 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa64003cd70 con 0x561a95904ed0 2024-09-22T08:39:38.969 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.967+0000 7fa64b920800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:39:38.969 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.967+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:284 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a9594dd40 con 0x561a95904ed0 2024-09-22T08:39:38.969 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.967+0000 7fa647d03640 1 -- 172.21.15.142:0/2392704388 <== osd.3 v2:172.21.15.142:6800/1064901393 95 ==== osd_op_reply(284 gc.23 [call out=24b] v0'0 uv40 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fa64003cd70 con 0x561a95904ed0 2024-09-22T08:39:38.970 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.967+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:285 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a9595a890 con 0x561a95904ed0 2024-09-22T08:39:38.970 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.967+0000 7fa647d03640 1 -- 172.21.15.142:0/2392704388 <== osd.3 v2:172.21.15.142:6800/1064901393 96 ==== osd_op_reply(285 gc.23 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa64003cd70 con 0x561a95904ed0 2024-09-22T08:39:38.970 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.967+0000 7fa64b920800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:39:38.970 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.967+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:286 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a9594dd40 con 0x561a95904ed0 2024-09-22T08:39:38.970 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.967+0000 7fa647d03640 1 -- 172.21.15.142:0/2392704388 <== osd.3 v2:172.21.15.142:6800/1064901393 97 ==== osd_op_reply(286 gc.23 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa64003cd70 con 0x561a95904ed0 2024-09-22T08:39:38.970 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.967+0000 7fa64b920800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:39:38.970 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.967+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:287 6.8 6:17d7e8ed:gc::gc.23:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a9595a890 con 0x561a95904ed0 2024-09-22T08:39:38.972 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.968+0000 7fa647d03640 1 -- 172.21.15.142:0/2392704388 <== osd.3 v2:172.21.15.142:6800/1064901393 98 ==== osd_op_reply(287 gc.23 [call] v32'41 uv41 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fa64003cd70 con 0x561a95904ed0 2024-09-22T08:39:38.972 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.968+0000 7fa64b920800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-22T08:39:38.972 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.968+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:288 6.1b 6:db9d130d:gc::gc.24:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a9594dd40 con 0x561a95904ed0 2024-09-22T08:39:38.972 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.969+0000 7fa647d03640 1 -- 172.21.15.142:0/2392704388 <== osd.3 v2:172.21.15.142:6800/1064901393 99 ==== osd_op_reply(288 gc.24 [call] v32'28 uv28 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fa64003cd70 con 0x561a95904ed0 2024-09-22T08:39:38.972 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.969+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:289 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a9595a890 con 0x561a95904ed0 2024-09-22T08:39:38.972 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.969+0000 7fa647d03640 1 -- 172.21.15.142:0/2392704388 <== osd.3 v2:172.21.15.142:6800/1064901393 100 ==== osd_op_reply(289 gc.24 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa64003cd70 con 0x561a95904ed0 2024-09-22T08:39:38.973 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.969+0000 7fa64b920800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:39:38.973 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.969+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:290 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a9594dd40 con 0x561a95904ed0 2024-09-22T08:39:38.973 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.970+0000 7fa647d03640 1 -- 172.21.15.142:0/2392704388 <== osd.3 v2:172.21.15.142:6800/1064901393 101 ==== osd_op_reply(290 gc.24 [call out=24b] v0'0 uv28 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fa64003cd70 con 0x561a95904ed0 2024-09-22T08:39:38.973 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.970+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:291 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a9595a890 con 0x561a95904ed0 2024-09-22T08:39:38.973 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.970+0000 7fa647d03640 1 -- 172.21.15.142:0/2392704388 <== osd.3 v2:172.21.15.142:6800/1064901393 102 ==== osd_op_reply(291 gc.24 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa64003cd70 con 0x561a95904ed0 2024-09-22T08:39:38.973 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.970+0000 7fa64b920800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:39:38.973 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.970+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:292 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a9594dd40 con 0x561a95904ed0 2024-09-22T08:39:38.973 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.970+0000 7fa647d03640 1 -- 172.21.15.142:0/2392704388 <== osd.3 v2:172.21.15.142:6800/1064901393 103 ==== osd_op_reply(292 gc.24 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa64003cd70 con 0x561a95904ed0 2024-09-22T08:39:38.973 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.970+0000 7fa64b920800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:39:38.973 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.970+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:293 6.1b 6:db9d130d:gc::gc.24:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a9595a890 con 0x561a95904ed0 2024-09-22T08:39:38.973 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.971+0000 7fa647d03640 1 -- 172.21.15.142:0/2392704388 <== osd.3 v2:172.21.15.142:6800/1064901393 104 ==== osd_op_reply(293 gc.24 [call] v32'29 uv29 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fa64003cd70 con 0x561a95904ed0 2024-09-22T08:39:38.974 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.972+0000 7fa4fe7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:39:38.974 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.972+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:294 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94672178450768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a9594dd40 con 0x561a959004c0 2024-09-22T08:39:38.974 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.973+0000 7fa646d01640 1 -- 172.21.15.142:0/2392704388 <== osd.1 v2:172.21.15.142:6816/3192108003 64 ==== osd_op_reply(294 data_loggenerations_metadata [watch unwatch cookie 94672178450768] v32'285 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa630089040 con 0x561a959004c0 2024-09-22T08:39:38.974 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.973+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:295 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94672178424976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a9595a890 con 0x7fa640021020 2024-09-22T08:39:38.975 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.974+0000 7fa647502640 1 -- 172.21.15.142:0/2392704388 <== osd.2 v2:172.21.15.142:6808/279438927 62 ==== osd_op_reply(295 notify.0 [watch unwatch cookie 94672178424976] v32'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa63800f030 con 0x7fa640021020 2024-09-22T08:39:38.975 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.974+0000 7fa64b920800 20 remove_watcher() i=0 2024-09-22T08:39:38.975 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.974+0000 7fa64b920800 2 removed watcher, disabling cache 2024-09-22T08:39:38.975 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.974+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:296 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94672178427184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a9594dd40 con 0x561a959004c0 2024-09-22T08:39:38.976 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.975+0000 7fa646d01640 1 -- 172.21.15.142:0/2392704388 <== osd.1 v2:172.21.15.142:6816/3192108003 65 ==== osd_op_reply(296 notify.1 [watch unwatch cookie 94672178427184] v32'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa630089040 con 0x561a959004c0 2024-09-22T08:39:38.976 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.975+0000 7fa64b920800 20 remove_watcher() i=1 2024-09-22T08:39:38.976 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.975+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- osd_op(unknown.0.0:297 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94672178435360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a9595a890 con 0x561a95904ed0 2024-09-22T08:39:38.977 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.976+0000 7fa647d03640 1 -- 172.21.15.142:0/2392704388 <== osd.3 v2:172.21.15.142:6800/1064901393 105 ==== osd_op_reply(297 notify.2 [watch unwatch cookie 94672178435360] v32'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa64003cd70 con 0x561a95904ed0 2024-09-22T08:39:38.978 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.976+0000 7fa64b920800 20 remove_watcher() i=2 2024-09-22T08:39:38.978 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.976+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- osd_op(unknown.0.0:298 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94672178439488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a9594dd40 con 0x7fa640021020 2024-09-22T08:39:38.978 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.977+0000 7fa647502640 1 -- 172.21.15.142:0/2392704388 <== osd.2 v2:172.21.15.142:6808/279438927 63 ==== osd_op_reply(298 notify.3 [watch unwatch cookie 94672178439488] v32'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa63800f030 con 0x7fa640021020 2024-09-22T08:39:38.978 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.977+0000 7fa64b920800 20 remove_watcher() i=3 2024-09-22T08:39:38.978 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.977+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- osd_op(unknown.0.0:299 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94672178443040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a9595a890 con 0x561a959004c0 2024-09-22T08:39:38.980 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.979+0000 7fa646d01640 1 -- 172.21.15.142:0/2392704388 <== osd.1 v2:172.21.15.142:6816/3192108003 66 ==== osd_op_reply(299 notify.4 [watch unwatch cookie 94672178443040] v32'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa630089040 con 0x561a959004c0 2024-09-22T08:39:38.980 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.979+0000 7fa64b920800 20 remove_watcher() i=4 2024-09-22T08:39:38.980 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.979+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:300 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94672178437696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a9594dd40 con 0x7fa638027020 2024-09-22T08:39:38.981 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.980+0000 7fa646d01640 1 -- 172.21.15.142:0/2392704388 <== osd.0 v2:172.21.15.31:6800/168281188 66 ==== osd_op_reply(300 notify.5 [watch unwatch cookie 94672178437696] v32'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa630089040 con 0x7fa638027020 2024-09-22T08:39:38.981 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.980+0000 7fa64b920800 20 remove_watcher() i=5 2024-09-22T08:39:38.981 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.980+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:301 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94672178448016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a9595a890 con 0x7fa638027020 2024-09-22T08:39:38.982 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.981+0000 7fa646d01640 1 -- 172.21.15.142:0/2392704388 <== osd.0 v2:172.21.15.31:6800/168281188 67 ==== osd_op_reply(301 notify.6 [watch unwatch cookie 94672178448016] v32'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa630089040 con 0x7fa638027020 2024-09-22T08:39:38.982 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.981+0000 7fa64b920800 20 remove_watcher() i=6 2024-09-22T08:39:38.982 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.981+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- osd_op(unknown.0.0:302 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94672178449072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a9594dd40 con 0x7fa638027020 2024-09-22T08:39:38.985 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.982+0000 7fa646d01640 1 -- 172.21.15.142:0/2392704388 <== osd.0 v2:172.21.15.31:6800/168281188 68 ==== osd_op_reply(302 notify.7 [watch unwatch cookie 94672178449072] v32'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa630089040 con 0x7fa638027020 2024-09-22T08:39:38.985 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.982+0000 7fa64b920800 20 remove_watcher() i=7 2024-09-22T08:39:38.985 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.982+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7fa638027020 msgr2=0x7fa63804b6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:39:38.986 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.982+0000 7fa64b920800 1 --2- 172.21.15.142:0/2392704388 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7fa638027020 0x7fa63804b6d0 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:39:38.986 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.982+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x561a959004c0 msgr2=0x561a95902980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:39:38.986 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.982+0000 7fa64b920800 1 --2- 172.21.15.142:0/2392704388 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x561a959004c0 0x561a95902980 crc :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:39:38.986 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.982+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7fa640021020 msgr2=0x7fa64003b390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:39:38.986 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.982+0000 7fa64b920800 1 --2- 172.21.15.142:0/2392704388 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7fa640021020 0x7fa64003b390 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:39:38.986 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.982+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x561a95904ed0 msgr2=0x561a959072c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:39:38.986 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.982+0000 7fa64b920800 1 --2- 172.21.15.142:0/2392704388 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x561a95904ed0 0x561a959072c0 crc :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:39:38.986 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.982+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fa51003d000 msgr2=0x7fa51003f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:39:38.986 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.982+0000 7fa64b920800 1 --2- 172.21.15.142:0/2392704388 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fa51003d000 0x7fa51003f4c0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fa63801db50 tx=0x7fa63804f000 comp rx=0 tx=0).stop 2024-09-22T08:39:38.986 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.982+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561a958ed7c0 msgr2=0x561a958f4d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:39:38.986 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.982+0000 7fa646d01640 1 -- 172.21.15.142:0/2392704388 reap_dead start 2024-09-22T08:39:38.987 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.982+0000 7fa64b920800 1 --2- 172.21.15.142:0/2392704388 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561a958ed7c0 0x561a958f4d30 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7fa6400206f0 tx=0x7fa6400088f0 comp rx=0 tx=0).stop 2024-09-22T08:39:38.987 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.982+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 shutdown_connections 2024-09-22T08:39:38.987 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.982+0000 7fa64b920800 1 --2- 172.21.15.142:0/2392704388 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561a958ed7c0 0x561a958f4d30 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:39:38.987 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.982+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 >> 172.21.15.142:0/2392704388 conn(0x561a958e9bc0 msgr2=0x561a958e7dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:39:38.987 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.982+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 shutdown_connections 2024-09-22T08:39:38.987 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.982+0000 7fa64b920800 1 -- 172.21.15.142:0/2392704388 wait complete. 2024-09-22T08:39:38.987 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.983+0000 7fa64b920800 1 -- 172.21.15.142:0/3280978012 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fa52003cfb0 msgr2=0x7fa52003f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:39:38.987 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.983+0000 7fa64b920800 1 --2- 172.21.15.142:0/3280978012 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fa52003cfb0 0x7fa52003f470 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x561a958ce800 tx=0x7fa638052800 comp rx=0 tx=0).stop 2024-09-22T08:39:38.987 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.983+0000 7fa64b920800 1 -- 172.21.15.142:0/3280978012 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561a958e0d60 msgr2=0x561a958e1180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:39:38.987 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.983+0000 7fa64b920800 1 --2- 172.21.15.142:0/3280978012 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561a958e0d60 0x561a958e1180 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x561a958c6ce0 tx=0x7fa64000bf30 comp rx=0 tx=0).stop 2024-09-22T08:39:38.987 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.983+0000 7fa64b920800 1 -- 172.21.15.142:0/3280978012 shutdown_connections 2024-09-22T08:39:38.987 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.983+0000 7fa64b920800 1 --2- 172.21.15.142:0/3280978012 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fa52003cfb0 0x7fa52003f470 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:39:38.987 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.983+0000 7fa64b920800 1 --2- 172.21.15.142:0/3280978012 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561a958e0d60 0x561a958e1180 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:39:38.987 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.983+0000 7fa64b920800 1 -- 172.21.15.142:0/3280978012 >> 172.21.15.142:0/3280978012 conn(0x561a958d5110 msgr2=0x561a958d54f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:39:38.988 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.983+0000 7fa64b920800 1 -- 172.21.15.142:0/3280978012 shutdown_connections 2024-09-22T08:39:38.988 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.983+0000 7fa64b920800 1 -- 172.21.15.142:0/3280978012 wait complete. 2024-09-22T08:39:38.988 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.983+0000 7fa64b920800 1 -- 172.21.15.142:0/2933065137 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x561a957d2c10 msgr2=0x561a958cd330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:39:38.988 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.983+0000 7fa64b920800 1 --2- 172.21.15.142:0/2933065137 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x561a957d2c10 0x561a958cd330 crc :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:39:38.988 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.983+0000 7fa64b920800 1 -- 172.21.15.142:0/2933065137 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x561a958cf710 msgr2=0x561a958d1bb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:39:38.988 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.983+0000 7fa64b920800 1 --2- 172.21.15.142:0/2933065137 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x561a958cf710 0x561a958d1bb0 crc :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:39:38.988 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.983+0000 7fa64b920800 1 -- 172.21.15.142:0/2933065137 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fa52c03cfb0 msgr2=0x7fa52c03f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:39:38.988 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.983+0000 7fa64b920800 1 --2- 172.21.15.142:0/2933065137 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fa52c03cfb0 0x7fa52c03f470 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fa630057000 tx=0x7fa630052000 comp rx=0 tx=0).stop 2024-09-22T08:39:38.988 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.983+0000 7fa64b920800 1 -- 172.21.15.142:0/2933065137 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561a957404f0 msgr2=0x561a958c5ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:39:38.988 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.983+0000 7fa64b920800 1 --2- 172.21.15.142:0/2933065137 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561a957404f0 0x561a958c5ce0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7fa638000f80 tx=0x7fa638001250 comp rx=0 tx=0).stop 2024-09-22T08:39:38.988 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.983+0000 7fa64b920800 1 -- 172.21.15.142:0/2933065137 shutdown_connections 2024-09-22T08:39:38.988 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.983+0000 7fa64b920800 1 --2- 172.21.15.142:0/2933065137 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x561a958cf710 0x561a958d1bb0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:39:38.988 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.983+0000 7fa64b920800 1 --2- 172.21.15.142:0/2933065137 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x561a957d2c10 0x561a958cd330 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:39:38.989 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.983+0000 7fa64b920800 1 --2- 172.21.15.142:0/2933065137 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fa52c03cfb0 0x7fa52c03f470 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:39:38.989 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.983+0000 7fa64b920800 1 --2- 172.21.15.142:0/2933065137 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561a957404f0 0x561a958c5ce0 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:39:38.989 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.983+0000 7fa64b920800 1 -- 172.21.15.142:0/2933065137 >> 172.21.15.142:0/2933065137 conn(0x561a957c6be0 msgr2=0x561a958bf6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:39:38.989 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.983+0000 7fa64b920800 1 -- 172.21.15.142:0/2933065137 shutdown_connections 2024-09-22T08:39:38.989 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-22T08:39:38.983+0000 7fa64b920800 1 -- 172.21.15.142:0/2933065137 wait complete. 2024-09-22T08:39:38.993 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-22T08:39:39.010 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-22T08:39:39.010 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T08:39:39.117 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:39.115+0000 7fbe75216640 1 Processor -- start 2024-09-22T08:39:39.117 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:39.115+0000 7fbe75216640 1 -- start start 2024-09-22T08:39:39.117 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:39.115+0000 7fbe75216640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fbe7006e170 0x7fbe7006e550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:39:39.117 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:39.115+0000 7fbe75216640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe70071770 con 0x7fbe70071e30 2024-09-22T08:39:39.117 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:39.115+0000 7fbe75216640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7fbe70099ee0 con 0x7fbe7006e170 2024-09-22T08:39:39.117 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:39.115+0000 7fbe6ed9d640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fbe7006e170 0x7fbe7006e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:39:39.117 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:39.115+0000 7fbe6e59c640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fbe70071e30 0x7fbe70097100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:60576/0 (socket says 172.21.15.31:60576) 2024-09-22T08:39:39.117 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:39.115+0000 7fbe6e59c640 1 -- 172.21.15.31:0/2055857631 learned_addr learned my addr 172.21.15.31:0/2055857631 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-22T08:39:39.117 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:39.116+0000 7fbe6ed9d640 1 -- 172.21.15.31:0/2055857631 >> v1:172.21.15.31:6789/0 conn(0x7fbe70071e30 legacy=0x7fbe70097100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:39:39.117 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:39.116+0000 7fbe6ed9d640 1 -- 172.21.15.31:0/2055857631 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe70072530 con 0x7fbe7006e170 2024-09-22T08:39:39.117 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:39.116+0000 7fbe6dd9b640 1 -- 172.21.15.31:0/2055857631 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3546467963 0 0) 0x7fbe70071770 con 0x7fbe70071e30 2024-09-22T08:39:39.118 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:39.116+0000 7fbe6ed9d640 1 --2- 172.21.15.31:0/2055857631 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbe7006e170 0x7fbe7006e550 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7fbe60009dc0 tx=0x7fbe6002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24c4f364697b2feb server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:39:39.118 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:39.116+0000 7fbe6dd9b640 1 -- 172.21.15.31:0/2055857631 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe60007670 con 0x7fbe7006e170 2024-09-22T08:39:39.119 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:39.116+0000 7fbe6dd9b640 1 -- 172.21.15.31:0/2055857631 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe60007810 con 0x7fbe7006e170 2024-09-22T08:39:39.119 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:39.116+0000 7fbe6dd9b640 1 -- 172.21.15.31:0/2055857631 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe60007b10 con 0x7fbe7006e170 2024-09-22T08:39:39.119 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:39.117+0000 7fbe75216640 1 -- 172.21.15.31:0/2055857631 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbe7006e170 msgr2=0x7fbe7006e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:39:39.119 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:39.117+0000 7fbe75216640 1 --2- 172.21.15.31:0/2055857631 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbe7006e170 0x7fbe7006e550 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7fbe60009dc0 tx=0x7fbe6002a6a0 comp rx=0 tx=0).stop 2024-09-22T08:39:39.119 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:39.117+0000 7fbe75216640 1 -- 172.21.15.31:0/2055857631 shutdown_connections 2024-09-22T08:39:39.119 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:39.117+0000 7fbe75216640 1 --2- 172.21.15.31:0/2055857631 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbe7006e170 0x7fbe7006e550 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:39:39.119 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:39.117+0000 7fbe75216640 1 -- 172.21.15.31:0/2055857631 >> 172.21.15.31:0/2055857631 conn(0x7fbe7009ac80 msgr2=0x7fbe70098550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:39:39.119 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:39.117+0000 7fbe75216640 1 -- 172.21.15.31:0/2055857631 shutdown_connections 2024-09-22T08:39:39.119 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:39.117+0000 7fbe75216640 1 -- 172.21.15.31:0/2055857631 wait complete. 2024-09-22T08:39:39.120 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:39.118+0000 7fbe75216640 1 Processor -- start 2024-09-22T08:39:39.120 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:39.118+0000 7fbe75216640 1 -- start start 2024-09-22T08:39:39.120 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:39.119+0000 7fbe75216640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbe7006e170 0x7fbe701c4800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:39:39.121 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:39.119+0000 7fbe75216640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fbe7006ee20 con 0x7fbe7006e170 2024-09-22T08:39:39.121 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:39.119+0000 7fbe6ed9d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbe7006e170 0x7fbe701c4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:39:39.121 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:39.119+0000 7fbe6ed9d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbe7006e170 0x7fbe701c4800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:48176/0 (socket says 172.21.15.31:48176) 2024-09-22T08:39:39.121 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:39.119+0000 7fbe6ed9d640 1 -- 172.21.15.31:0/841935503 learned_addr learned my addr 172.21.15.31:0/841935503 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-22T08:39:39.121 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:39.119+0000 7fbe6ed9d640 1 -- 172.21.15.31:0/841935503 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe70074170 con 0x7fbe7006e170 2024-09-22T08:39:39.121 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:39.119+0000 7fbe6ed9d640 1 --2- 172.21.15.31:0/841935503 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbe7006e170 0x7fbe701c4800 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7fbe60009dc0 tx=0x7fbe60004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:39:39.121 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:39.119+0000 7fbe577fe640 1 -- 172.21.15.31:0/841935503 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe60040070 con 0x7fbe7006e170 2024-09-22T08:39:39.121 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:39.119+0000 7fbe577fe640 1 -- 172.21.15.31:0/841935503 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe60007af0 con 0x7fbe7006e170 2024-09-22T08:39:39.121 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:39.119+0000 7fbe577fe640 1 -- 172.21.15.31:0/841935503 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe60007e30 con 0x7fbe7006e170 2024-09-22T08:39:39.121 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:39.119+0000 7fbe75216640 1 -- 172.21.15.31:0/841935503 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe7006f3f0 con 0x7fbe7006e170 2024-09-22T08:39:39.121 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:39.119+0000 7fbe75216640 1 -- 172.21.15.31:0/841935503 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe70070700 con 0x7fbe7006e170 2024-09-22T08:39:39.122 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:39.120+0000 7fbe577fe640 1 -- 172.21.15.31:0/841935503 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fbe60039040 con 0x7fbe7006e170 2024-09-22T08:39:39.122 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:39.120+0000 7fbe75216640 1 -- 172.21.15.31:0/841935503 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe70070be0 con 0x7fbe7006e170 2024-09-22T08:39:39.122 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:39.121+0000 7fbe577fe640 1 --2- 172.21.15.31:0/841935503 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fbe5c03e6c0 0x7fbe5c040b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:39:39.122 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:39.121+0000 7fbe577fe640 1 -- 172.21.15.31:0/841935503 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5938+0+0 (secure 0 0 0) 0x7fbe6002ae00 con 0x7fbe7006e170 2024-09-22T08:39:39.122 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:39.121+0000 7fbe6e59c640 1 --2- 172.21.15.31:0/841935503 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fbe5c03e6c0 0x7fbe5c040b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:39:39.123 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:39.121+0000 7fbe6e59c640 1 --2- 172.21.15.31:0/841935503 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fbe5c03e6c0 0x7fbe5c040b80 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fbe64000c00 tx=0x7fbe640078f0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:39:39.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:39.125+0000 7fbe577fe640 1 -- 172.21.15.31:0/841935503 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fbe600303a0 con 0x7fbe7006e170 2024-09-22T08:39:39.311 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:39.310+0000 7fbe75216640 1 -- 172.21.15.31:0/841935503 --> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fbe7006e550 con 0x7fbe5c03e6c0 2024-09-22T08:39:39.321 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:39.320+0000 7fbe577fe640 1 -- 172.21.15.31:0/841935503 <== mgr.4099 v2:172.21.15.142:6824/99931088 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665590 (secure 0 0 0) 0x7fbe7006e550 con 0x7fbe5c03e6c0 2024-09-22T08:39:39.328 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-22T08:39:39.333 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2024-09-22T08:39:39.335 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:39.326+0000 7fbe75216640 1 -- 172.21.15.31:0/841935503 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fbe5c03e6c0 msgr2=0x7fbe5c040b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:39:39.335 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:39.326+0000 7fbe75216640 1 --2- 172.21.15.31:0/841935503 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fbe5c03e6c0 0x7fbe5c040b80 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fbe64000c00 tx=0x7fbe640078f0 comp rx=0 tx=0).stop 2024-09-22T08:39:39.336 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:39.326+0000 7fbe75216640 1 -- 172.21.15.31:0/841935503 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbe7006e170 msgr2=0x7fbe701c4800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:39:39.336 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:39.326+0000 7fbe75216640 1 --2- 172.21.15.31:0/841935503 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbe7006e170 0x7fbe701c4800 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7fbe60009dc0 tx=0x7fbe60004a40 comp rx=0 tx=0).stop 2024-09-22T08:39:39.336 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:39.326+0000 7fbe75216640 1 -- 172.21.15.31:0/841935503 shutdown_connections 2024-09-22T08:39:39.336 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:39.326+0000 7fbe75216640 1 --2- 172.21.15.31:0/841935503 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fbe5c03e6c0 0x7fbe5c040b80 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:39:39.336 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:39.326+0000 7fbe75216640 1 --2- 172.21.15.31:0/841935503 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbe7006e170 0x7fbe701c4800 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:39:39.336 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:39.326+0000 7fbe75216640 1 -- 172.21.15.31:0/841935503 >> 172.21.15.31:0/841935503 conn(0x7fbe7009ac80 msgr2=0x7fbe70098d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:39:39.336 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:39.326+0000 7fbe75216640 1 -- 172.21.15.31:0/841935503 shutdown_connections 2024-09-22T08:39:39.336 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:39.326+0000 7fbe75216640 1 -- 172.21.15.31:0/841935503 wait complete. 2024-09-22T08:39:39.338 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":135,"stamp":"2024-09-22T08:39:39.205490+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":26412817,"num_objects":229,"num_object_clones":0,"num_object_copies":458,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":229,"num_whiteouts":0,"num_read":4961,"num_read_kb":4507,"num_write":2048,"num_write_kb":60586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4434,"ondisk_log_size":4434,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":202928,"kb_used_data":53232,"kb_used_omap":6,"kb_used_meta":149625,"kb_avail":377284432,"statfs":{"total":386547056640,"available":386339258368,"internally_reserved":0,"allocated":54509568,"data_stored":53338878,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":153216790},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":25811688,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":534,"num_read_kb":477,"num_write":384,"num_write_kb":29371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003720"},"pg_stats":[{"pgid":"3.3f","version":"30'4","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.229185+0000","last_change":"2024-09-22T08:36:23.978702+0000","last_active":"2024-09-22T08:37:04.229185+0000","last_peered":"2024-09-22T08:37:04.229185+0000","last_clean":"2024-09-22T08:37:04.229185+0000","last_became_active":"2024-09-22T08:36:23.978473+0000","last_became_peered":"2024-09-22T08:36:23.978473+0000","last_unstale":"2024-09-22T08:37:04.229185+0000","last_undegraded":"2024-09-22T08:37:04.229185+0000","last_fullsized":"2024-09-22T08:37:04.229185+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:47:35.557013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":7,"num_write":20,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"30'4","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.221771+0000","last_change":"2024-09-22T08:36:25.982137+0000","last_active":"2024-09-22T08:37:04.221771+0000","last_peered":"2024-09-22T08:37:04.221771+0000","last_clean":"2024-09-22T08:37:04.221771+0000","last_became_active":"2024-09-22T08:36:25.981849+0000","last_became_peered":"2024-09-22T08:36:25.981849+0000","last_unstale":"2024-09-22T08:37:04.221771+0000","last_undegraded":"2024-09-22T08:37:04.221771+0000","last_fullsized":"2024-09-22T08:37:04.221771+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:15:58.403427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.225549+0000","last_change":"2024-09-22T08:36:23.973967+0000","last_active":"2024-09-22T08:37:04.225549+0000","last_peered":"2024-09-22T08:37:04.225549+0000","last_clean":"2024-09-22T08:37:04.225549+0000","last_became_active":"2024-09-22T08:36:23.973596+0000","last_became_peered":"2024-09-22T08:36:23.973596+0000","last_unstale":"2024-09-22T08:37:04.225549+0000","last_undegraded":"2024-09-22T08:37:04.225549+0000","last_fullsized":"2024-09-22T08:37:04.225549+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:25:55.158227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"32'2","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.081639+0000","last_change":"2024-09-22T08:36:25.992482+0000","last_active":"2024-09-22T08:39:32.081639+0000","last_peered":"2024-09-22T08:39:32.081639+0000","last_clean":"2024-09-22T08:39:32.081639+0000","last_became_active":"2024-09-22T08:36:25.992150+0000","last_became_peered":"2024-09-22T08:36:25.992150+0000","last_unstale":"2024-09-22T08:39:32.081639+0000","last_undegraded":"2024-09-22T08:39:32.081639+0000","last_fullsized":"2024-09-22T08:39:32.081639+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:39:29.442096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.232004+0000","last_change":"2024-09-22T08:36:23.983138+0000","last_active":"2024-09-22T08:37:04.232004+0000","last_peered":"2024-09-22T08:37:04.232004+0000","last_clean":"2024-09-22T08:37:04.232004+0000","last_became_active":"2024-09-22T08:36:23.982860+0000","last_became_peered":"2024-09-22T08:36:23.982860+0000","last_unstale":"2024-09-22T08:37:04.232004+0000","last_undegraded":"2024-09-22T08:37:04.232004+0000","last_fullsized":"2024-09-22T08:37:04.232004+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:22:39.595954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.228436+0000","last_change":"2024-09-22T08:36:25.992618+0000","last_active":"2024-09-22T08:37:04.228436+0000","last_peered":"2024-09-22T08:37:04.228436+0000","last_clean":"2024-09-22T08:37:04.228436+0000","last_became_active":"2024-09-22T08:36:25.992356+0000","last_became_peered":"2024-09-22T08:36:25.992356+0000","last_unstale":"2024-09-22T08:37:04.228436+0000","last_undegraded":"2024-09-22T08:37:04.228436+0000","last_fullsized":"2024-09-22T08:37:04.228436+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:54:42.310988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.225810+0000","last_change":"2024-09-22T08:36:23.967353+0000","last_active":"2024-09-22T08:37:04.225810+0000","last_peered":"2024-09-22T08:37:04.225810+0000","last_clean":"2024-09-22T08:37:04.225810+0000","last_became_active":"2024-09-22T08:36:23.967096+0000","last_became_peered":"2024-09-22T08:36:23.967096+0000","last_unstale":"2024-09-22T08:37:04.225810+0000","last_undegraded":"2024-09-22T08:37:04.225810+0000","last_fullsized":"2024-09-22T08:37:04.225810+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:22:30.703594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"32'22","reported_seq":95,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.214709+0000","last_change":"2024-09-22T08:36:25.989569+0000","last_active":"2024-09-22T08:39:32.214709+0000","last_peered":"2024-09-22T08:39:32.214709+0000","last_clean":"2024-09-22T08:39:32.214709+0000","last_became_active":"2024-09-22T08:36:25.989065+0000","last_became_peered":"2024-09-22T08:36:25.989065+0000","last_unstale":"2024-09-22T08:39:32.214709+0000","last_undegraded":"2024-09-22T08:39:32.214709+0000","last_fullsized":"2024-09-22T08:39:32.214709+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:18:58.915284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":82,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.229849+0000","last_change":"2024-09-22T08:36:23.979014+0000","last_active":"2024-09-22T08:37:04.229849+0000","last_peered":"2024-09-22T08:37:04.229849+0000","last_clean":"2024-09-22T08:37:04.229849+0000","last_became_active":"2024-09-22T08:36:23.978766+0000","last_became_peered":"2024-09-22T08:36:23.978766+0000","last_unstale":"2024-09-22T08:37:04.229849+0000","last_undegraded":"2024-09-22T08:37:04.229849+0000","last_fullsized":"2024-09-22T08:37:04.229849+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:46:08.557989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"32'8","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.215083+0000","last_change":"2024-09-22T08:36:25.979188+0000","last_active":"2024-09-22T08:39:32.215083+0000","last_peered":"2024-09-22T08:39:32.215083+0000","last_clean":"2024-09-22T08:39:32.215083+0000","last_became_active":"2024-09-22T08:36:25.978937+0000","last_became_peered":"2024-09-22T08:36:25.978937+0000","last_unstale":"2024-09-22T08:39:32.215083+0000","last_undegraded":"2024-09-22T08:39:32.215083+0000","last_fullsized":"2024-09-22T08:39:32.215083+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:36:02.118103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":23,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"32'4","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:05.711611+0000","last_change":"2024-09-22T08:36:23.967446+0000","last_active":"2024-09-22T08:37:05.711611+0000","last_peered":"2024-09-22T08:37:05.711611+0000","last_clean":"2024-09-22T08:37:05.711611+0000","last_became_active":"2024-09-22T08:36:23.967168+0000","last_became_peered":"2024-09-22T08:36:23.967168+0000","last_unstale":"2024-09-22T08:37:05.711611+0000","last_undegraded":"2024-09-22T08:37:05.711611+0000","last_fullsized":"2024-09-22T08:37:05.711611+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:51:18.438115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":10,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"32'6","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:48.130983+0000","last_change":"2024-09-22T08:36:25.992986+0000","last_active":"2024-09-22T08:37:48.130983+0000","last_peered":"2024-09-22T08:37:48.130983+0000","last_clean":"2024-09-22T08:37:48.130983+0000","last_became_active":"2024-09-22T08:36:25.990727+0000","last_became_peered":"2024-09-22T08:36:25.990727+0000","last_unstale":"2024-09-22T08:37:48.130983+0000","last_undegraded":"2024-09-22T08:37:48.130983+0000","last_fullsized":"2024-09-22T08:37:48.130983+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:05:42.869702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.228480+0000","last_change":"2024-09-22T08:36:23.980714+0000","last_active":"2024-09-22T08:37:04.228480+0000","last_peered":"2024-09-22T08:37:04.228480+0000","last_clean":"2024-09-22T08:37:04.228480+0000","last_became_active":"2024-09-22T08:36:23.980446+0000","last_became_peered":"2024-09-22T08:36:23.980446+0000","last_unstale":"2024-09-22T08:37:04.228480+0000","last_undegraded":"2024-09-22T08:37:04.228480+0000","last_fullsized":"2024-09-22T08:37:04.228480+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:18:20.665486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"32'8","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.289670+0000","last_change":"2024-09-22T08:36:25.982503+0000","last_active":"2024-09-22T08:39:32.289670+0000","last_peered":"2024-09-22T08:39:32.289670+0000","last_clean":"2024-09-22T08:39:32.289670+0000","last_became_active":"2024-09-22T08:36:25.982217+0000","last_became_peered":"2024-09-22T08:36:25.982217+0000","last_unstale":"2024-09-22T08:39:32.289670+0000","last_undegraded":"2024-09-22T08:39:32.289670+0000","last_fullsized":"2024-09-22T08:39:32.289670+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:38:39.281465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":27,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:31.512962+0000","last_change":"2024-09-22T08:36:23.978037+0000","last_active":"2024-09-22T08:38:31.512962+0000","last_peered":"2024-09-22T08:38:31.512962+0000","last_clean":"2024-09-22T08:38:31.512962+0000","last_became_active":"2024-09-22T08:36:23.977715+0000","last_became_peered":"2024-09-22T08:36:23.977715+0000","last_unstale":"2024-09-22T08:38:31.512962+0000","last_undegraded":"2024-09-22T08:38:31.512962+0000","last_fullsized":"2024-09-22T08:38:31.512962+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:43:08.069293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"32'7","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:30.181492+0000","last_change":"2024-09-22T08:36:25.975203+0000","last_active":"2024-09-22T08:38:30.181492+0000","last_peered":"2024-09-22T08:38:30.181492+0000","last_clean":"2024-09-22T08:38:30.181492+0000","last_became_active":"2024-09-22T08:36:25.974930+0000","last_became_peered":"2024-09-22T08:36:25.974930+0000","last_unstale":"2024-09-22T08:38:30.181492+0000","last_undegraded":"2024-09-22T08:38:30.181492+0000","last_fullsized":"2024-09-22T08:38:30.181492+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:14:58.055122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"32'3","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:48.185367+0000","last_change":"2024-09-22T08:36:25.992134+0000","last_active":"2024-09-22T08:38:48.185367+0000","last_peered":"2024-09-22T08:38:48.185367+0000","last_clean":"2024-09-22T08:38:48.185367+0000","last_became_active":"2024-09-22T08:36:25.991870+0000","last_became_peered":"2024-09-22T08:36:25.991870+0000","last_unstale":"2024-09-22T08:38:48.185367+0000","last_undegraded":"2024-09-22T08:38:48.185367+0000","last_fullsized":"2024-09-22T08:38:48.185367+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:22:14.904895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.224532+0000","last_change":"2024-09-22T08:36:23.977802+0000","last_active":"2024-09-22T08:37:04.224532+0000","last_peered":"2024-09-22T08:37:04.224532+0000","last_clean":"2024-09-22T08:37:04.224532+0000","last_became_active":"2024-09-22T08:36:23.977556+0000","last_became_peered":"2024-09-22T08:36:23.977556+0000","last_unstale":"2024-09-22T08:37:04.224532+0000","last_undegraded":"2024-09-22T08:37:04.224532+0000","last_fullsized":"2024-09-22T08:37:04.224532+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:29:17.802189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"32'14","reported_seq":72,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.290010+0000","last_change":"2024-09-22T08:36:25.977178+0000","last_active":"2024-09-22T08:39:32.290010+0000","last_peered":"2024-09-22T08:39:32.290010+0000","last_clean":"2024-09-22T08:39:32.290010+0000","last_became_active":"2024-09-22T08:36:25.976389+0000","last_became_peered":"2024-09-22T08:36:25.976389+0000","last_unstale":"2024-09-22T08:39:32.290010+0000","last_undegraded":"2024-09-22T08:39:32.290010+0000","last_fullsized":"2024-09-22T08:39:32.290010+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:33:17.028140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":49,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"32'1","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:50.183843+0000","last_change":"2024-09-22T08:36:23.974839+0000","last_active":"2024-09-22T08:38:50.183843+0000","last_peered":"2024-09-22T08:38:50.183843+0000","last_clean":"2024-09-22T08:38:50.183843+0000","last_became_active":"2024-09-22T08:36:23.974275+0000","last_became_peered":"2024-09-22T08:36:23.974275+0000","last_unstale":"2024-09-22T08:38:50.183843+0000","last_undegraded":"2024-09-22T08:38:50.183843+0000","last_fullsized":"2024-09-22T08:38:50.183843+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:00:39.104995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"32'12","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.343172+0000","last_change":"2024-09-22T08:36:25.977283+0000","last_active":"2024-09-22T08:39:32.343172+0000","last_peered":"2024-09-22T08:39:32.343172+0000","last_clean":"2024-09-22T08:39:32.343172+0000","last_became_active":"2024-09-22T08:36:25.977015+0000","last_became_peered":"2024-09-22T08:36:25.977015+0000","last_unstale":"2024-09-22T08:39:32.343172+0000","last_undegraded":"2024-09-22T08:39:32.343172+0000","last_fullsized":"2024-09-22T08:39:32.343172+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:25:20.428891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":43,"num_read_kb":39,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:05.096438+0000","last_change":"2024-09-22T08:36:23.984666+0000","last_active":"2024-09-22T08:37:05.096438+0000","last_peered":"2024-09-22T08:37:05.096438+0000","last_clean":"2024-09-22T08:37:05.096438+0000","last_became_active":"2024-09-22T08:36:23.984411+0000","last_became_peered":"2024-09-22T08:36:23.984411+0000","last_unstale":"2024-09-22T08:37:05.096438+0000","last_undegraded":"2024-09-22T08:37:05.096438+0000","last_fullsized":"2024-09-22T08:37:05.096438+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:22:30.703594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"32'2","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:28.582905+0000","last_change":"2024-09-22T08:36:25.984342+0000","last_active":"2024-09-22T08:38:28.582905+0000","last_peered":"2024-09-22T08:38:28.582905+0000","last_clean":"2024-09-22T08:38:28.582905+0000","last_became_active":"2024-09-22T08:36:25.984037+0000","last_became_peered":"2024-09-22T08:36:25.984037+0000","last_unstale":"2024-09-22T08:38:28.582905+0000","last_undegraded":"2024-09-22T08:38:28.582905+0000","last_fullsized":"2024-09-22T08:38:28.582905+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:08:22.313520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.613492+0000","last_change":"2024-09-22T08:36:23.969670+0000","last_active":"2024-09-22T08:37:04.613492+0000","last_peered":"2024-09-22T08:37:04.613492+0000","last_clean":"2024-09-22T08:37:04.613492+0000","last_became_active":"2024-09-22T08:36:23.969183+0000","last_became_peered":"2024-09-22T08:36:23.969183+0000","last_unstale":"2024-09-22T08:37:04.613492+0000","last_undegraded":"2024-09-22T08:37:04.613492+0000","last_fullsized":"2024-09-22T08:37:04.613492+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:27:04.674711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"32'18","reported_seq":67,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.214977+0000","last_change":"2024-09-22T08:36:25.986078+0000","last_active":"2024-09-22T08:39:32.214977+0000","last_peered":"2024-09-22T08:39:32.214977+0000","last_clean":"2024-09-22T08:39:32.214977+0000","last_became_active":"2024-09-22T08:36:25.985797+0000","last_became_peered":"2024-09-22T08:36:25.985797+0000","last_unstale":"2024-09-22T08:39:32.214977+0000","last_undegraded":"2024-09-22T08:39:32.214977+0000","last_fullsized":"2024-09-22T08:39:32.214977+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:55:58.281586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":61,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.205171+0000","last_change":"2024-09-22T08:36:23.974737+0000","last_active":"2024-09-22T08:39:32.205171+0000","last_peered":"2024-09-22T08:39:32.205171+0000","last_clean":"2024-09-22T08:39:32.205171+0000","last_became_active":"2024-09-22T08:36:23.974359+0000","last_became_peered":"2024-09-22T08:36:23.974359+0000","last_unstale":"2024-09-22T08:39:32.205171+0000","last_undegraded":"2024-09-22T08:39:32.205171+0000","last_fullsized":"2024-09-22T08:39:32.205171+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:27:54.535865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"32'16","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.296886+0000","last_change":"2024-09-22T08:36:25.978419+0000","last_active":"2024-09-22T08:39:32.296886+0000","last_peered":"2024-09-22T08:39:32.296886+0000","last_clean":"2024-09-22T08:39:32.296886+0000","last_became_active":"2024-09-22T08:36:25.977320+0000","last_became_peered":"2024-09-22T08:36:25.977320+0000","last_unstale":"2024-09-22T08:39:32.296886+0000","last_undegraded":"2024-09-22T08:39:32.296886+0000","last_fullsized":"2024-09-22T08:39:32.296886+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:45:06.683427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":49,"num_write":21,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"32'1","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:48.185452+0000","last_change":"2024-09-22T08:36:23.980577+0000","last_active":"2024-09-22T08:38:48.185452+0000","last_peered":"2024-09-22T08:38:48.185452+0000","last_clean":"2024-09-22T08:38:48.185452+0000","last_became_active":"2024-09-22T08:36:23.980189+0000","last_became_peered":"2024-09-22T08:36:23.980189+0000","last_unstale":"2024-09-22T08:38:48.185452+0000","last_undegraded":"2024-09-22T08:38:48.185452+0000","last_fullsized":"2024-09-22T08:38:48.185452+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:45:54.958427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"32'35","reported_seq":100,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.238012+0000","last_change":"2024-09-22T08:36:34.015950+0000","last_active":"2024-09-22T08:39:32.238012+0000","last_peered":"2024-09-22T08:39:32.238012+0000","last_clean":"2024-09-22T08:39:32.238012+0000","last_became_active":"2024-09-22T08:36:34.015696+0000","last_became_peered":"2024-09-22T08:36:34.015696+0000","last_unstale":"2024-09-22T08:39:32.238012+0000","last_undegraded":"2024-09-22T08:39:32.238012+0000","last_fullsized":"2024-09-22T08:39:32.238012+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:48:07.077185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":173,"num_read_kb":173,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"32'6","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.214715+0000","last_change":"2024-09-22T08:36:25.988079+0000","last_active":"2024-09-22T08:39:32.214715+0000","last_peered":"2024-09-22T08:39:32.214715+0000","last_clean":"2024-09-22T08:39:32.214715+0000","last_became_active":"2024-09-22T08:36:25.987811+0000","last_became_peered":"2024-09-22T08:36:25.987811+0000","last_unstale":"2024-09-22T08:39:32.214715+0000","last_undegraded":"2024-09-22T08:39:32.214715+0000","last_fullsized":"2024-09-22T08:39:32.214715+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:09:47.627357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.229385+0000","last_change":"2024-09-22T08:36:23.982670+0000","last_active":"2024-09-22T08:37:04.229385+0000","last_peered":"2024-09-22T08:37:04.229385+0000","last_clean":"2024-09-22T08:37:04.229385+0000","last_became_active":"2024-09-22T08:36:23.982423+0000","last_became_peered":"2024-09-22T08:36:23.982423+0000","last_unstale":"2024-09-22T08:37:04.229385+0000","last_undegraded":"2024-09-22T08:37:04.229385+0000","last_fullsized":"2024-09-22T08:37:04.229385+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:36:21.966120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.230626+0000","last_change":"2024-09-22T08:36:27.988469+0000","last_active":"2024-09-22T08:37:04.230626+0000","last_peered":"2024-09-22T08:37:04.230626+0000","last_clean":"2024-09-22T08:37:04.230626+0000","last_became_active":"2024-09-22T08:36:27.988057+0000","last_became_peered":"2024-09-22T08:36:27.988057+0000","last_unstale":"2024-09-22T08:37:04.230626+0000","last_undegraded":"2024-09-22T08:37:04.230626+0000","last_fullsized":"2024-09-22T08:37:04.230626+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_clean_scrub_stamp":"2024-09-22T08:36:26.962226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:51:33.578609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"32'30","reported_seq":73,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:30.249449+0000","last_change":"2024-09-22T08:36:29.995218+0000","last_active":"2024-09-22T08:38:30.249449+0000","last_peered":"2024-09-22T08:38:30.249449+0000","last_clean":"2024-09-22T08:38:30.249449+0000","last_became_active":"2024-09-22T08:36:29.994881+0000","last_became_peered":"2024-09-22T08:36:29.994881+0000","last_unstale":"2024-09-22T08:38:30.249449+0000","last_undegraded":"2024-09-22T08:38:30.249449+0000","last_fullsized":"2024-09-22T08:38:30.249449+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:46:41.834484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.223889+0000","last_change":"2024-09-22T08:36:32.013521+0000","last_active":"2024-09-22T08:37:04.223889+0000","last_peered":"2024-09-22T08:37:04.223889+0000","last_clean":"2024-09-22T08:37:04.223889+0000","last_became_active":"2024-09-22T08:36:32.013249+0000","last_became_peered":"2024-09-22T08:36:32.013249+0000","last_unstale":"2024-09-22T08:37:04.223889+0000","last_undegraded":"2024-09-22T08:37:04.223889+0000","last_fullsized":"2024-09-22T08:37:04.223889+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:35:20.008672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"32'7","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:47.949724+0000","last_change":"2024-09-22T08:36:34.015432+0000","last_active":"2024-09-22T08:37:47.949724+0000","last_peered":"2024-09-22T08:37:47.949724+0000","last_clean":"2024-09-22T08:37:47.949724+0000","last_became_active":"2024-09-22T08:36:34.015170+0000","last_became_peered":"2024-09-22T08:36:34.015170+0000","last_unstale":"2024-09-22T08:37:47.949724+0000","last_undegraded":"2024-09-22T08:37:47.949724+0000","last_fullsized":"2024-09-22T08:37:47.949724+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:45:21.601440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:48.129237+0000","last_change":"2024-09-22T08:36:25.989960+0000","last_active":"2024-09-22T08:37:48.129237+0000","last_peered":"2024-09-22T08:37:48.129237+0000","last_clean":"2024-09-22T08:37:48.129237+0000","last_became_active":"2024-09-22T08:36:25.989583+0000","last_became_peered":"2024-09-22T08:36:25.989583+0000","last_unstale":"2024-09-22T08:37:48.129237+0000","last_undegraded":"2024-09-22T08:37:48.129237+0000","last_fullsized":"2024-09-22T08:37:48.129237+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:42:22.082860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"32'1","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:45.183153+0000","last_change":"2024-09-22T08:36:23.973951+0000","last_active":"2024-09-22T08:38:45.183153+0000","last_peered":"2024-09-22T08:38:45.183153+0000","last_clean":"2024-09-22T08:38:45.183153+0000","last_became_active":"2024-09-22T08:36:23.973716+0000","last_became_peered":"2024-09-22T08:36:23.973716+0000","last_unstale":"2024-09-22T08:38:45.183153+0000","last_undegraded":"2024-09-22T08:38:45.183153+0000","last_fullsized":"2024-09-22T08:38:45.183153+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:06:35.921272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:05.167417+0000","last_change":"2024-09-22T08:37:04.229482+0000","last_active":"2024-09-22T08:37:05.167417+0000","last_peered":"2024-09-22T08:37:05.167417+0000","last_clean":"2024-09-22T08:37:05.167417+0000","last_became_active":"2024-09-22T08:37:04.229132+0000","last_became_peered":"2024-09-22T08:37:04.229132+0000","last_unstale":"2024-09-22T08:37:05.167417+0000","last_undegraded":"2024-09-22T08:37:05.167417+0000","last_fullsized":"2024-09-22T08:37:05.167417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_clean_scrub_stamp":"2024-09-22T08:36:26.962226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:30:09.128950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"30'6","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.223977+0000","last_change":"2024-09-22T08:36:29.991280+0000","last_active":"2024-09-22T08:37:04.223977+0000","last_peered":"2024-09-22T08:37:04.223977+0000","last_clean":"2024-09-22T08:37:04.223977+0000","last_became_active":"2024-09-22T08:36:29.990998+0000","last_became_peered":"2024-09-22T08:36:29.990998+0000","last_unstale":"2024-09-22T08:37:04.223977+0000","last_undegraded":"2024-09-22T08:37:04.223977+0000","last_fullsized":"2024-09-22T08:37:04.223977+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:36:37.998945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.222725+0000","last_change":"2024-09-22T08:36:32.006443+0000","last_active":"2024-09-22T08:37:04.222725+0000","last_peered":"2024-09-22T08:37:04.222725+0000","last_clean":"2024-09-22T08:37:04.222725+0000","last_became_active":"2024-09-22T08:36:32.006161+0000","last_became_peered":"2024-09-22T08:36:32.006161+0000","last_unstale":"2024-09-22T08:37:04.222725+0000","last_undegraded":"2024-09-22T08:37:04.222725+0000","last_fullsized":"2024-09-22T08:37:04.222725+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:39:07.614953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"30'2","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.223331+0000","last_change":"2024-09-22T08:36:34.017093+0000","last_active":"2024-09-22T08:37:04.223331+0000","last_peered":"2024-09-22T08:37:04.223331+0000","last_clean":"2024-09-22T08:37:04.223331+0000","last_became_active":"2024-09-22T08:36:34.016749+0000","last_became_peered":"2024-09-22T08:36:34.016749+0000","last_unstale":"2024-09-22T08:37:04.223331+0000","last_undegraded":"2024-09-22T08:37:04.223331+0000","last_fullsized":"2024-09-22T08:37:04.223331+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:18:00.649317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"32'7","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.088571+0000","last_change":"2024-09-22T08:36:25.988432+0000","last_active":"2024-09-22T08:39:32.088571+0000","last_peered":"2024-09-22T08:39:32.088571+0000","last_clean":"2024-09-22T08:39:32.088571+0000","last_became_active":"2024-09-22T08:36:25.987860+0000","last_became_peered":"2024-09-22T08:36:25.987860+0000","last_unstale":"2024-09-22T08:39:32.088571+0000","last_undegraded":"2024-09-22T08:39:32.088571+0000","last_fullsized":"2024-09-22T08:39:32.088571+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:07:23.439560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.228129+0000","last_change":"2024-09-22T08:36:23.979437+0000","last_active":"2024-09-22T08:37:04.228129+0000","last_peered":"2024-09-22T08:37:04.228129+0000","last_clean":"2024-09-22T08:37:04.228129+0000","last_became_active":"2024-09-22T08:36:23.979201+0000","last_became_peered":"2024-09-22T08:36:23.979201+0000","last_unstale":"2024-09-22T08:37:04.228129+0000","last_undegraded":"2024-09-22T08:37:04.228129+0000","last_fullsized":"2024-09-22T08:37:04.228129+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:05:30.127896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.226652+0000","last_change":"2024-09-22T08:36:27.987816+0000","last_active":"2024-09-22T08:37:04.226652+0000","last_peered":"2024-09-22T08:37:04.226652+0000","last_clean":"2024-09-22T08:37:04.226652+0000","last_became_active":"2024-09-22T08:36:27.987410+0000","last_became_peered":"2024-09-22T08:36:27.987410+0000","last_unstale":"2024-09-22T08:37:04.226652+0000","last_undegraded":"2024-09-22T08:37:04.226652+0000","last_fullsized":"2024-09-22T08:37:04.226652+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_clean_scrub_stamp":"2024-09-22T08:36:26.962226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:14:29.717295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"30'10","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.227501+0000","last_change":"2024-09-22T08:36:29.999655+0000","last_active":"2024-09-22T08:37:04.227501+0000","last_peered":"2024-09-22T08:37:04.227501+0000","last_clean":"2024-09-22T08:37:04.227501+0000","last_became_active":"2024-09-22T08:36:29.999306+0000","last_became_peered":"2024-09-22T08:36:29.999306+0000","last_unstale":"2024-09-22T08:37:04.227501+0000","last_undegraded":"2024-09-22T08:37:04.227501+0000","last_fullsized":"2024-09-22T08:37:04.227501+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:27:58.333399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"32'282","reported_seq":415,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.294718+0000","last_change":"2024-09-22T08:36:32.014175+0000","last_active":"2024-09-22T08:39:32.294718+0000","last_peered":"2024-09-22T08:39:32.294718+0000","last_clean":"2024-09-22T08:39:32.294718+0000","last_became_active":"2024-09-22T08:36:32.013869+0000","last_became_peered":"2024-09-22T08:36:32.013869+0000","last_unstale":"2024-09-22T08:39:32.294718+0000","last_undegraded":"2024-09-22T08:39:32.294718+0000","last_fullsized":"2024-09-22T08:39:32.294718+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:23:53.788685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.224121+0000","last_change":"2024-09-22T08:36:34.016273+0000","last_active":"2024-09-22T08:37:04.224121+0000","last_peered":"2024-09-22T08:37:04.224121+0000","last_clean":"2024-09-22T08:37:04.224121+0000","last_became_active":"2024-09-22T08:36:34.015999+0000","last_became_peered":"2024-09-22T08:36:34.015999+0000","last_unstale":"2024-09-22T08:37:04.224121+0000","last_undegraded":"2024-09-22T08:37:04.224121+0000","last_fullsized":"2024-09-22T08:37:04.224121+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:19:59.334082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"30'4","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.226266+0000","last_change":"2024-09-22T08:36:25.979874+0000","last_active":"2024-09-22T08:37:04.226266+0000","last_peered":"2024-09-22T08:37:04.226266+0000","last_clean":"2024-09-22T08:37:04.226266+0000","last_became_active":"2024-09-22T08:36:25.979320+0000","last_became_peered":"2024-09-22T08:36:25.979320+0000","last_unstale":"2024-09-22T08:37:04.226266+0000","last_undegraded":"2024-09-22T08:37:04.226266+0000","last_fullsized":"2024-09-22T08:37:04.226266+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:22:30.226253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.221148+0000","last_change":"2024-09-22T08:36:23.975661+0000","last_active":"2024-09-22T08:37:04.221148+0000","last_peered":"2024-09-22T08:37:04.221148+0000","last_clean":"2024-09-22T08:37:04.221148+0000","last_became_active":"2024-09-22T08:36:23.975428+0000","last_became_peered":"2024-09-22T08:36:23.975428+0000","last_unstale":"2024-09-22T08:37:04.221148+0000","last_undegraded":"2024-09-22T08:37:04.221148+0000","last_fullsized":"2024-09-22T08:37:04.221148+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:09:41.970933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.227129+0000","last_change":"2024-09-22T08:36:27.985020+0000","last_active":"2024-09-22T08:37:04.227129+0000","last_peered":"2024-09-22T08:37:04.227129+0000","last_clean":"2024-09-22T08:37:04.227129+0000","last_became_active":"2024-09-22T08:36:27.984658+0000","last_became_peered":"2024-09-22T08:36:27.984658+0000","last_unstale":"2024-09-22T08:37:04.227129+0000","last_undegraded":"2024-09-22T08:37:04.227129+0000","last_fullsized":"2024-09-22T08:37:04.227129+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_clean_scrub_stamp":"2024-09-22T08:36:26.962226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:55:24.622399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"32'30","reported_seq":73,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:30.243330+0000","last_change":"2024-09-22T08:36:30.000958+0000","last_active":"2024-09-22T08:38:30.243330+0000","last_peered":"2024-09-22T08:38:30.243330+0000","last_clean":"2024-09-22T08:38:30.243330+0000","last_became_active":"2024-09-22T08:36:30.000641+0000","last_became_peered":"2024-09-22T08:36:30.000641+0000","last_unstale":"2024-09-22T08:38:30.243330+0000","last_undegraded":"2024-09-22T08:38:30.243330+0000","last_fullsized":"2024-09-22T08:38:30.243330+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:44:23.505173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"32'282","reported_seq":424,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.293167+0000","last_change":"2024-09-22T08:36:32.005447+0000","last_active":"2024-09-22T08:39:32.293167+0000","last_peered":"2024-09-22T08:39:32.293167+0000","last_clean":"2024-09-22T08:39:32.293167+0000","last_became_active":"2024-09-22T08:36:32.005012+0000","last_became_peered":"2024-09-22T08:36:32.005012+0000","last_unstale":"2024-09-22T08:39:32.293167+0000","last_undegraded":"2024-09-22T08:39:32.293167+0000","last_fullsized":"2024-09-22T08:39:32.293167+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:31:41.609654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"32'4","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:05.720809+0000","last_change":"2024-09-22T08:36:25.990731+0000","last_active":"2024-09-22T08:37:05.720809+0000","last_peered":"2024-09-22T08:37:05.720809+0000","last_clean":"2024-09-22T08:37:05.720809+0000","last_became_active":"2024-09-22T08:36:25.989940+0000","last_became_peered":"2024-09-22T08:36:25.989940+0000","last_unstale":"2024-09-22T08:37:05.720809+0000","last_undegraded":"2024-09-22T08:37:05.720809+0000","last_fullsized":"2024-09-22T08:37:05.720809+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:12:49.808186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.229286+0000","last_change":"2024-09-22T08:36:23.970335+0000","last_active":"2024-09-22T08:37:04.229286+0000","last_peered":"2024-09-22T08:37:04.229286+0000","last_clean":"2024-09-22T08:37:04.229286+0000","last_became_active":"2024-09-22T08:36:23.970093+0000","last_became_peered":"2024-09-22T08:36:23.970093+0000","last_unstale":"2024-09-22T08:37:04.229286+0000","last_undegraded":"2024-09-22T08:37:04.229286+0000","last_fullsized":"2024-09-22T08:37:04.229286+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:59:04.308788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.221669+0000","last_change":"2024-09-22T08:36:27.987025+0000","last_active":"2024-09-22T08:37:04.221669+0000","last_peered":"2024-09-22T08:37:04.221669+0000","last_clean":"2024-09-22T08:37:04.221669+0000","last_became_active":"2024-09-22T08:36:27.986734+0000","last_became_peered":"2024-09-22T08:36:27.986734+0000","last_unstale":"2024-09-22T08:37:04.221669+0000","last_undegraded":"2024-09-22T08:37:04.221669+0000","last_fullsized":"2024-09-22T08:37:04.221669+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_clean_scrub_stamp":"2024-09-22T08:36:26.962226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:17:49.747383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"32'40","reported_seq":88,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:30.253763+0000","last_change":"2024-09-22T08:36:29.991107+0000","last_active":"2024-09-22T08:38:30.253763+0000","last_peered":"2024-09-22T08:38:30.253763+0000","last_clean":"2024-09-22T08:38:30.253763+0000","last_became_active":"2024-09-22T08:36:29.990809+0000","last_became_peered":"2024-09-22T08:36:29.990809+0000","last_unstale":"2024-09-22T08:38:30.253763+0000","last_undegraded":"2024-09-22T08:38:30.253763+0000","last_fullsized":"2024-09-22T08:38:30.253763+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:58:25.003982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":44,"num_read_kb":33,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.224144+0000","last_change":"2024-09-22T08:36:32.004096+0000","last_active":"2024-09-22T08:37:04.224144+0000","last_peered":"2024-09-22T08:37:04.224144+0000","last_clean":"2024-09-22T08:37:04.224144+0000","last_became_active":"2024-09-22T08:36:32.003726+0000","last_became_peered":"2024-09-22T08:36:32.003726+0000","last_unstale":"2024-09-22T08:37:04.224144+0000","last_undegraded":"2024-09-22T08:37:04.224144+0000","last_fullsized":"2024-09-22T08:37:04.224144+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:58:37.810092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"32'5","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:48.125865+0000","last_change":"2024-09-22T08:36:34.022748+0000","last_active":"2024-09-22T08:37:48.125865+0000","last_peered":"2024-09-22T08:37:48.125865+0000","last_clean":"2024-09-22T08:37:48.125865+0000","last_became_active":"2024-09-22T08:36:34.022448+0000","last_became_peered":"2024-09-22T08:36:34.022448+0000","last_unstale":"2024-09-22T08:37:48.125865+0000","last_undegraded":"2024-09-22T08:37:48.125865+0000","last_fullsized":"2024-09-22T08:37:48.125865+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:39:09.622561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":13,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"32'10","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:31.647489+0000","last_change":"2024-09-22T08:36:25.976027+0000","last_active":"2024-09-22T08:38:31.647489+0000","last_peered":"2024-09-22T08:38:31.647489+0000","last_clean":"2024-09-22T08:38:31.647489+0000","last_became_active":"2024-09-22T08:36:25.975728+0000","last_became_peered":"2024-09-22T08:36:25.975728+0000","last_unstale":"2024-09-22T08:38:31.647489+0000","last_undegraded":"2024-09-22T08:38:31.647489+0000","last_fullsized":"2024-09-22T08:38:31.647489+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:22:27.923443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:31.959475+0000","last_change":"2024-09-22T08:36:23.969160+0000","last_active":"2024-09-22T08:39:31.959475+0000","last_peered":"2024-09-22T08:39:31.959475+0000","last_clean":"2024-09-22T08:39:31.959475+0000","last_became_active":"2024-09-22T08:36:23.968836+0000","last_became_peered":"2024-09-22T08:36:23.968836+0000","last_unstale":"2024-09-22T08:39:31.959475+0000","last_undegraded":"2024-09-22T08:39:31.959475+0000","last_fullsized":"2024-09-22T08:39:31.959475+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:24:33.546187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.223645+0000","last_change":"2024-09-22T08:36:27.987971+0000","last_active":"2024-09-22T08:37:04.223645+0000","last_peered":"2024-09-22T08:37:04.223645+0000","last_clean":"2024-09-22T08:37:04.223645+0000","last_became_active":"2024-09-22T08:36:27.987577+0000","last_became_peered":"2024-09-22T08:36:27.987577+0000","last_unstale":"2024-09-22T08:37:04.223645+0000","last_undegraded":"2024-09-22T08:37:04.223645+0000","last_fullsized":"2024-09-22T08:37:04.223645+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_clean_scrub_stamp":"2024-09-22T08:36:26.962226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:17:33.045316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"32'31","reported_seq":74,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:30.233003+0000","last_change":"2024-09-22T08:36:29.995394+0000","last_active":"2024-09-22T08:38:30.233003+0000","last_peered":"2024-09-22T08:38:30.233003+0000","last_clean":"2024-09-22T08:38:30.233003+0000","last_became_active":"2024-09-22T08:36:29.994921+0000","last_became_peered":"2024-09-22T08:36:29.994921+0000","last_unstale":"2024-09-22T08:38:30.233003+0000","last_undegraded":"2024-09-22T08:38:30.233003+0000","last_fullsized":"2024-09-22T08:38:30.233003+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:00:36.656901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.223384+0000","last_change":"2024-09-22T08:36:32.004634+0000","last_active":"2024-09-22T08:37:04.223384+0000","last_peered":"2024-09-22T08:37:04.223384+0000","last_clean":"2024-09-22T08:37:04.223384+0000","last_became_active":"2024-09-22T08:36:32.004269+0000","last_became_peered":"2024-09-22T08:36:32.004269+0000","last_unstale":"2024-09-22T08:37:04.223384+0000","last_undegraded":"2024-09-22T08:37:04.223384+0000","last_fullsized":"2024-09-22T08:37:04.223384+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:51:32.910644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"32'3","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:42.431386+0000","last_change":"2024-09-22T08:36:34.018431+0000","last_active":"2024-09-22T08:37:42.431386+0000","last_peered":"2024-09-22T08:37:42.431386+0000","last_clean":"2024-09-22T08:37:42.431386+0000","last_became_active":"2024-09-22T08:36:34.018190+0000","last_became_peered":"2024-09-22T08:36:34.018190+0000","last_unstale":"2024-09-22T08:37:42.431386+0000","last_undegraded":"2024-09-22T08:37:42.431386+0000","last_fullsized":"2024-09-22T08:37:42.431386+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:09:42.876400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"32'4","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.289565+0000","last_change":"2024-09-22T08:36:25.983379+0000","last_active":"2024-09-22T08:39:32.289565+0000","last_peered":"2024-09-22T08:39:32.289565+0000","last_clean":"2024-09-22T08:39:32.289565+0000","last_became_active":"2024-09-22T08:36:25.983073+0000","last_became_peered":"2024-09-22T08:36:25.983073+0000","last_unstale":"2024-09-22T08:39:32.289565+0000","last_undegraded":"2024-09-22T08:39:32.289565+0000","last_fullsized":"2024-09-22T08:39:32.289565+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:34:22.104673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:05.708471+0000","last_change":"2024-09-22T08:36:23.981302+0000","last_active":"2024-09-22T08:37:05.708471+0000","last_peered":"2024-09-22T08:37:05.708471+0000","last_clean":"2024-09-22T08:37:05.708471+0000","last_became_active":"2024-09-22T08:36:23.980682+0000","last_became_peered":"2024-09-22T08:36:23.980682+0000","last_unstale":"2024-09-22T08:37:05.708471+0000","last_undegraded":"2024-09-22T08:37:05.708471+0000","last_fullsized":"2024-09-22T08:37:05.708471+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:36:38.072840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.225234+0000","last_change":"2024-09-22T08:36:27.985983+0000","last_active":"2024-09-22T08:37:04.225234+0000","last_peered":"2024-09-22T08:37:04.225234+0000","last_clean":"2024-09-22T08:37:04.225234+0000","last_became_active":"2024-09-22T08:36:27.985675+0000","last_became_peered":"2024-09-22T08:36:27.985675+0000","last_unstale":"2024-09-22T08:37:04.225234+0000","last_undegraded":"2024-09-22T08:37:04.225234+0000","last_fullsized":"2024-09-22T08:37:04.225234+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_clean_scrub_stamp":"2024-09-22T08:36:26.962226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:18:38.325978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"32'38","reported_seq":84,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:43.184361+0000","last_change":"2024-09-22T08:36:29.998080+0000","last_active":"2024-09-22T08:38:43.184361+0000","last_peered":"2024-09-22T08:38:43.184361+0000","last_clean":"2024-09-22T08:38:43.184361+0000","last_became_active":"2024-09-22T08:36:29.997542+0000","last_became_peered":"2024-09-22T08:36:29.997542+0000","last_unstale":"2024-09-22T08:38:43.184361+0000","last_undegraded":"2024-09-22T08:38:43.184361+0000","last_fullsized":"2024-09-22T08:38:43.184361+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:42:31.088070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"32'282","reported_seq":348,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.405444+0000","last_change":"2024-09-22T08:36:32.005012+0000","last_active":"2024-09-22T08:39:32.405444+0000","last_peered":"2024-09-22T08:39:32.405444+0000","last_clean":"2024-09-22T08:39:32.405444+0000","last_became_active":"2024-09-22T08:36:32.004441+0000","last_became_peered":"2024-09-22T08:36:32.004441+0000","last_unstale":"2024-09-22T08:39:32.405444+0000","last_undegraded":"2024-09-22T08:39:32.405444+0000","last_fullsized":"2024-09-22T08:39:32.405444+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:10:54.748229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.225164+0000","last_change":"2024-09-22T08:36:34.017600+0000","last_active":"2024-09-22T08:37:04.225164+0000","last_peered":"2024-09-22T08:37:04.225164+0000","last_clean":"2024-09-22T08:37:04.225164+0000","last_became_active":"2024-09-22T08:36:34.017217+0000","last_became_peered":"2024-09-22T08:36:34.017217+0000","last_unstale":"2024-09-22T08:37:04.225164+0000","last_undegraded":"2024-09-22T08:37:04.225164+0000","last_fullsized":"2024-09-22T08:37:04.225164+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:43:08.076327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:47.943350+0000","last_change":"2024-09-22T08:36:25.972507+0000","last_active":"2024-09-22T08:37:47.943350+0000","last_peered":"2024-09-22T08:37:47.943350+0000","last_clean":"2024-09-22T08:37:47.943350+0000","last_became_active":"2024-09-22T08:36:25.972198+0000","last_became_peered":"2024-09-22T08:36:25.972198+0000","last_unstale":"2024-09-22T08:37:47.943350+0000","last_undegraded":"2024-09-22T08:37:47.943350+0000","last_fullsized":"2024-09-22T08:37:47.943350+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:41:22.703676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.224935+0000","last_change":"2024-09-22T08:36:23.978560+0000","last_active":"2024-09-22T08:37:04.224935+0000","last_peered":"2024-09-22T08:37:04.224935+0000","last_clean":"2024-09-22T08:37:04.224935+0000","last_became_active":"2024-09-22T08:36:23.978306+0000","last_became_peered":"2024-09-22T08:36:23.978306+0000","last_unstale":"2024-09-22T08:37:04.224935+0000","last_undegraded":"2024-09-22T08:37:04.224935+0000","last_fullsized":"2024-09-22T08:37:04.224935+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:26:33.317627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.224012+0000","last_change":"2024-09-22T08:36:27.986048+0000","last_active":"2024-09-22T08:37:04.224012+0000","last_peered":"2024-09-22T08:37:04.224012+0000","last_clean":"2024-09-22T08:37:04.224012+0000","last_became_active":"2024-09-22T08:36:27.985751+0000","last_became_peered":"2024-09-22T08:36:27.985751+0000","last_unstale":"2024-09-22T08:37:04.224012+0000","last_undegraded":"2024-09-22T08:37:04.224012+0000","last_fullsized":"2024-09-22T08:37:04.224012+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_clean_scrub_stamp":"2024-09-22T08:36:26.962226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:05:30.441634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"32'55","reported_seq":112,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:30.257382+0000","last_change":"2024-09-22T08:36:29.995500+0000","last_active":"2024-09-22T08:38:30.257382+0000","last_peered":"2024-09-22T08:38:30.257382+0000","last_clean":"2024-09-22T08:38:30.257382+0000","last_became_active":"2024-09-22T08:36:29.995225+0000","last_became_peered":"2024-09-22T08:36:29.995225+0000","last_unstale":"2024-09-22T08:38:30.257382+0000","last_undegraded":"2024-09-22T08:38:30.257382+0000","last_fullsized":"2024-09-22T08:38:30.257382+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:06:45.130197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.223232+0000","last_change":"2024-09-22T08:36:32.003118+0000","last_active":"2024-09-22T08:37:04.223232+0000","last_peered":"2024-09-22T08:37:04.223232+0000","last_clean":"2024-09-22T08:37:04.223232+0000","last_became_active":"2024-09-22T08:36:32.002833+0000","last_became_peered":"2024-09-22T08:36:32.002833+0000","last_unstale":"2024-09-22T08:37:04.223232+0000","last_undegraded":"2024-09-22T08:37:04.223232+0000","last_fullsized":"2024-09-22T08:37:04.223232+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:35:19.477576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"32'18","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.383653+0000","last_change":"2024-09-22T08:36:34.015160+0000","last_active":"2024-09-22T08:39:32.383653+0000","last_peered":"2024-09-22T08:39:32.383653+0000","last_clean":"2024-09-22T08:39:32.383653+0000","last_became_active":"2024-09-22T08:36:34.014853+0000","last_became_peered":"2024-09-22T08:36:34.014853+0000","last_unstale":"2024-09-22T08:39:32.383653+0000","last_undegraded":"2024-09-22T08:39:32.383653+0000","last_fullsized":"2024-09-22T08:39:32.383653+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:14:47.722976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"32'12","reported_seq":70,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:48.128311+0000","last_change":"2024-09-22T08:36:25.977939+0000","last_active":"2024-09-22T08:37:48.128311+0000","last_peered":"2024-09-22T08:37:48.128311+0000","last_clean":"2024-09-22T08:37:48.128311+0000","last_became_active":"2024-09-22T08:36:25.977682+0000","last_became_peered":"2024-09-22T08:36:25.977682+0000","last_unstale":"2024-09-22T08:37:48.128311+0000","last_undegraded":"2024-09-22T08:37:48.128311+0000","last_fullsized":"2024-09-22T08:37:48.128311+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:13:46.550224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":47,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.224398+0000","last_change":"2024-09-22T08:36:23.973186+0000","last_active":"2024-09-22T08:37:04.224398+0000","last_peered":"2024-09-22T08:37:04.224398+0000","last_clean":"2024-09-22T08:37:04.224398+0000","last_became_active":"2024-09-22T08:36:23.972822+0000","last_became_peered":"2024-09-22T08:36:23.972822+0000","last_unstale":"2024-09-22T08:37:04.224398+0000","last_undegraded":"2024-09-22T08:37:04.224398+0000","last_fullsized":"2024-09-22T08:37:04.224398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:47:13.913539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.227778+0000","last_change":"2024-09-22T08:36:27.992047+0000","last_active":"2024-09-22T08:37:04.227778+0000","last_peered":"2024-09-22T08:37:04.227778+0000","last_clean":"2024-09-22T08:37:04.227778+0000","last_became_active":"2024-09-22T08:36:27.991761+0000","last_became_peered":"2024-09-22T08:36:27.991761+0000","last_unstale":"2024-09-22T08:37:04.227778+0000","last_undegraded":"2024-09-22T08:37:04.227778+0000","last_fullsized":"2024-09-22T08:37:04.227778+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_clean_scrub_stamp":"2024-09-22T08:36:26.962226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:45:08.688857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"32'32","reported_seq":76,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:30.237179+0000","last_change":"2024-09-22T08:36:29.988696+0000","last_active":"2024-09-22T08:38:30.237179+0000","last_peered":"2024-09-22T08:38:30.237179+0000","last_clean":"2024-09-22T08:38:30.237179+0000","last_became_active":"2024-09-22T08:36:29.988363+0000","last_became_peered":"2024-09-22T08:36:29.988363+0000","last_unstale":"2024-09-22T08:38:30.237179+0000","last_undegraded":"2024-09-22T08:38:30.237179+0000","last_fullsized":"2024-09-22T08:38:30.237179+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:20:15.843523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.229572+0000","last_change":"2024-09-22T08:36:32.012753+0000","last_active":"2024-09-22T08:37:04.229572+0000","last_peered":"2024-09-22T08:37:04.229572+0000","last_clean":"2024-09-22T08:37:04.229572+0000","last_became_active":"2024-09-22T08:36:32.011923+0000","last_became_peered":"2024-09-22T08:36:32.011923+0000","last_unstale":"2024-09-22T08:37:04.229572+0000","last_undegraded":"2024-09-22T08:37:04.229572+0000","last_fullsized":"2024-09-22T08:37:04.229572+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:27:01.625975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"32'3","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:33.182535+0000","last_change":"2024-09-22T08:36:34.013810+0000","last_active":"2024-09-22T08:38:33.182535+0000","last_peered":"2024-09-22T08:38:33.182535+0000","last_clean":"2024-09-22T08:38:33.182535+0000","last_became_active":"2024-09-22T08:36:34.013308+0000","last_became_peered":"2024-09-22T08:36:34.013308+0000","last_unstale":"2024-09-22T08:38:33.182535+0000","last_undegraded":"2024-09-22T08:38:33.182535+0000","last_fullsized":"2024-09-22T08:38:33.182535+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:08:44.619221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"32'6","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.214676+0000","last_change":"2024-09-22T08:36:25.993564+0000","last_active":"2024-09-22T08:39:32.214676+0000","last_peered":"2024-09-22T08:39:32.214676+0000","last_clean":"2024-09-22T08:39:32.214676+0000","last_became_active":"2024-09-22T08:36:25.992167+0000","last_became_peered":"2024-09-22T08:36:25.992167+0000","last_unstale":"2024-09-22T08:39:32.214676+0000","last_undegraded":"2024-09-22T08:39:32.214676+0000","last_fullsized":"2024-09-22T08:39:32.214676+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:39:40.006672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"32'4","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:31.977133+0000","last_change":"2024-09-22T08:36:23.980852+0000","last_active":"2024-09-22T08:39:31.977133+0000","last_peered":"2024-09-22T08:39:31.977133+0000","last_clean":"2024-09-22T08:39:31.977133+0000","last_became_active":"2024-09-22T08:36:23.980560+0000","last_became_peered":"2024-09-22T08:36:23.980560+0000","last_unstale":"2024-09-22T08:39:31.977133+0000","last_undegraded":"2024-09-22T08:39:31.977133+0000","last_fullsized":"2024-09-22T08:39:31.977133+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:21:04.119270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":6,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.226238+0000","last_change":"2024-09-22T08:36:27.984977+0000","last_active":"2024-09-22T08:37:04.226238+0000","last_peered":"2024-09-22T08:37:04.226238+0000","last_clean":"2024-09-22T08:37:04.226238+0000","last_became_active":"2024-09-22T08:36:27.984699+0000","last_became_peered":"2024-09-22T08:36:27.984699+0000","last_unstale":"2024-09-22T08:37:04.226238+0000","last_undegraded":"2024-09-22T08:37:04.226238+0000","last_fullsized":"2024-09-22T08:37:04.226238+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_clean_scrub_stamp":"2024-09-22T08:36:26.962226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:30:42.385182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"32'36","reported_seq":82,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:30.264969+0000","last_change":"2024-09-22T08:36:29.989330+0000","last_active":"2024-09-22T08:38:30.264969+0000","last_peered":"2024-09-22T08:38:30.264969+0000","last_clean":"2024-09-22T08:38:30.264969+0000","last_became_active":"2024-09-22T08:36:29.989049+0000","last_became_peered":"2024-09-22T08:36:29.989049+0000","last_unstale":"2024-09-22T08:38:30.264969+0000","last_undegraded":"2024-09-22T08:38:30.264969+0000","last_fullsized":"2024-09-22T08:38:30.264969+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:25:38.846675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"32'282","reported_seq":452,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.387667+0000","last_change":"2024-09-22T08:36:32.003714+0000","last_active":"2024-09-22T08:39:32.387667+0000","last_peered":"2024-09-22T08:39:32.387667+0000","last_clean":"2024-09-22T08:39:32.387667+0000","last_became_active":"2024-09-22T08:36:32.003451+0000","last_became_peered":"2024-09-22T08:36:32.003451+0000","last_unstale":"2024-09-22T08:39:32.387667+0000","last_undegraded":"2024-09-22T08:39:32.387667+0000","last_fullsized":"2024-09-22T08:39:32.387667+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:36:40.009194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"32'12","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:38.177618+0000","last_change":"2024-09-22T08:36:34.017932+0000","last_active":"2024-09-22T08:38:38.177618+0000","last_peered":"2024-09-22T08:38:38.177618+0000","last_clean":"2024-09-22T08:38:38.177618+0000","last_became_active":"2024-09-22T08:36:34.017586+0000","last_became_peered":"2024-09-22T08:36:34.017586+0000","last_unstale":"2024-09-22T08:38:38.177618+0000","last_undegraded":"2024-09-22T08:38:38.177618+0000","last_fullsized":"2024-09-22T08:38:38.177618+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:03:46.243863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"32'6","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:31.996687+0000","last_change":"2024-09-22T08:36:25.984089+0000","last_active":"2024-09-22T08:39:31.996687+0000","last_peered":"2024-09-22T08:39:31.996687+0000","last_clean":"2024-09-22T08:39:31.996687+0000","last_became_active":"2024-09-22T08:36:25.983836+0000","last_became_peered":"2024-09-22T08:36:25.983836+0000","last_unstale":"2024-09-22T08:39:31.996687+0000","last_undegraded":"2024-09-22T08:39:31.996687+0000","last_fullsized":"2024-09-22T08:39:31.996687+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:55:24.968571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":29,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.228027+0000","last_change":"2024-09-22T08:36:23.981996+0000","last_active":"2024-09-22T08:37:04.228027+0000","last_peered":"2024-09-22T08:37:04.228027+0000","last_clean":"2024-09-22T08:37:04.228027+0000","last_became_active":"2024-09-22T08:36:23.981453+0000","last_became_peered":"2024-09-22T08:36:23.981453+0000","last_unstale":"2024-09-22T08:37:04.228027+0000","last_undegraded":"2024-09-22T08:37:04.228027+0000","last_fullsized":"2024-09-22T08:37:04.228027+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:48:13.371475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"32'3","reported_seq":414,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:31.306941+0000","last_change":"2024-09-22T08:36:27.990966+0000","last_active":"2024-09-22T08:38:31.306941+0000","last_peered":"2024-09-22T08:38:31.306941+0000","last_clean":"2024-09-22T08:38:31.306941+0000","last_became_active":"2024-09-22T08:36:27.990658+0000","last_became_peered":"2024-09-22T08:36:27.990658+0000","last_unstale":"2024-09-22T08:38:31.306941+0000","last_undegraded":"2024-09-22T08:38:31.306941+0000","last_fullsized":"2024-09-22T08:38:31.306941+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_clean_scrub_stamp":"2024-09-22T08:36:26.962226+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:46:19.841645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":381,"num_read_kb":381,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"30'10","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.225133+0000","last_change":"2024-09-22T08:36:29.994653+0000","last_active":"2024-09-22T08:37:04.225133+0000","last_peered":"2024-09-22T08:37:04.225133+0000","last_clean":"2024-09-22T08:37:04.225133+0000","last_became_active":"2024-09-22T08:36:29.994352+0000","last_became_peered":"2024-09-22T08:36:29.994352+0000","last_unstale":"2024-09-22T08:37:04.225133+0000","last_undegraded":"2024-09-22T08:37:04.225133+0000","last_fullsized":"2024-09-22T08:37:04.225133+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:29:42.839928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"32'282","reported_seq":463,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.396459+0000","last_change":"2024-09-22T08:36:32.002508+0000","last_active":"2024-09-22T08:39:32.396459+0000","last_peered":"2024-09-22T08:39:32.396459+0000","last_clean":"2024-09-22T08:39:32.396459+0000","last_became_active":"2024-09-22T08:36:32.002222+0000","last_became_peered":"2024-09-22T08:36:32.002222+0000","last_unstale":"2024-09-22T08:39:32.396459+0000","last_undegraded":"2024-09-22T08:39:32.396459+0000","last_fullsized":"2024-09-22T08:39:32.396459+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:01:40.774076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"32'4","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:31.432921+0000","last_change":"2024-09-22T08:36:34.016126+0000","last_active":"2024-09-22T08:38:31.432921+0000","last_peered":"2024-09-22T08:38:31.432921+0000","last_clean":"2024-09-22T08:38:31.432921+0000","last_became_active":"2024-09-22T08:36:34.015833+0000","last_became_peered":"2024-09-22T08:36:34.015833+0000","last_unstale":"2024-09-22T08:38:31.432921+0000","last_undegraded":"2024-09-22T08:38:31.432921+0000","last_fullsized":"2024-09-22T08:38:31.432921+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:08:38.502068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"32'6","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.214644+0000","last_change":"2024-09-22T08:36:25.978129+0000","last_active":"2024-09-22T08:39:32.214644+0000","last_peered":"2024-09-22T08:39:32.214644+0000","last_clean":"2024-09-22T08:39:32.214644+0000","last_became_active":"2024-09-22T08:36:25.977184+0000","last_became_peered":"2024-09-22T08:36:25.977184+0000","last_unstale":"2024-09-22T08:39:32.214644+0000","last_undegraded":"2024-09-22T08:39:32.214644+0000","last_fullsized":"2024-09-22T08:39:32.214644+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:04:17.169545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"32'8","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.210634+0000","last_change":"2024-09-22T08:36:23.976950+0000","last_active":"2024-09-22T08:39:32.210634+0000","last_peered":"2024-09-22T08:39:32.210634+0000","last_clean":"2024-09-22T08:39:32.210634+0000","last_became_active":"2024-09-22T08:36:23.976129+0000","last_became_peered":"2024-09-22T08:36:23.976129+0000","last_unstale":"2024-09-22T08:39:32.210634+0000","last_undegraded":"2024-09-22T08:39:32.210634+0000","last_fullsized":"2024-09-22T08:39:32.210634+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:08:20.789789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":14,"num_write":48,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"23'1","reported_seq":219,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:31.307278+0000","last_change":"2024-09-22T08:36:27.988301+0000","last_active":"2024-09-22T08:38:31.307278+0000","last_peered":"2024-09-22T08:38:31.307278+0000","last_clean":"2024-09-22T08:38:31.307278+0000","last_became_active":"2024-09-22T08:36:27.987999+0000","last_became_peered":"2024-09-22T08:36:27.987999+0000","last_unstale":"2024-09-22T08:38:31.307278+0000","last_undegraded":"2024-09-22T08:38:31.307278+0000","last_fullsized":"2024-09-22T08:38:31.307278+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_clean_scrub_stamp":"2024-09-22T08:36:26.962226+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:18:39.538565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":282,"num_read_kb":282,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"32'38","reported_seq":85,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:30.250729+0000","last_change":"2024-09-22T08:36:29.992044+0000","last_active":"2024-09-22T08:38:30.250729+0000","last_peered":"2024-09-22T08:38:30.250729+0000","last_clean":"2024-09-22T08:38:30.250729+0000","last_became_active":"2024-09-22T08:36:29.991671+0000","last_became_peered":"2024-09-22T08:36:29.991671+0000","last_unstale":"2024-09-22T08:38:30.250729+0000","last_undegraded":"2024-09-22T08:38:30.250729+0000","last_fullsized":"2024-09-22T08:38:30.250729+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:30:17.519164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":41,"num_read_kb":31,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.225831+0000","last_change":"2024-09-22T08:36:32.012136+0000","last_active":"2024-09-22T08:37:04.225831+0000","last_peered":"2024-09-22T08:37:04.225831+0000","last_clean":"2024-09-22T08:37:04.225831+0000","last_became_active":"2024-09-22T08:36:32.011845+0000","last_became_peered":"2024-09-22T08:36:32.011845+0000","last_unstale":"2024-09-22T08:37:04.225831+0000","last_undegraded":"2024-09-22T08:37:04.225831+0000","last_fullsized":"2024-09-22T08:37:04.225831+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:30:19.290881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"32'6","reported_seq":25,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.324008+0000","last_change":"2024-09-22T08:36:34.008672+0000","last_active":"2024-09-22T08:39:32.324008+0000","last_peered":"2024-09-22T08:39:32.324008+0000","last_clean":"2024-09-22T08:39:32.324008+0000","last_became_active":"2024-09-22T08:36:34.008374+0000","last_became_peered":"2024-09-22T08:36:34.008374+0000","last_unstale":"2024-09-22T08:39:32.324008+0000","last_undegraded":"2024-09-22T08:39:32.324008+0000","last_fullsized":"2024-09-22T08:39:32.324008+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:58:45.659504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"32'15","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.221742+0000","last_change":"2024-09-22T08:37:04.234725+0000","last_active":"2024-09-22T08:39:32.221742+0000","last_peered":"2024-09-22T08:39:32.221742+0000","last_clean":"2024-09-22T08:39:32.221742+0000","last_became_active":"2024-09-22T08:37:04.228680+0000","last_became_peered":"2024-09-22T08:37:04.228680+0000","last_unstale":"2024-09-22T08:39:32.221742+0000","last_undegraded":"2024-09-22T08:39:32.221742+0000","last_fullsized":"2024-09-22T08:39:32.221742+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:38:57.809846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":62,"num_read_kb":54,"num_write":19,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"12'72","reported_seq":142,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.220993+0000","last_change":"2024-09-22T08:36:10.737141+0000","last_active":"2024-09-22T08:37:04.220993+0000","last_peered":"2024-09-22T08:37:04.220993+0000","last_clean":"2024-09-22T08:37:04.220993+0000","last_became_active":"2024-09-22T08:36:10.736221+0000","last_became_peered":"2024-09-22T08:36:10.736221+0000","last_unstale":"2024-09-22T08:37:04.220993+0000","last_undegraded":"2024-09-22T08:37:04.220993+0000","last_fullsized":"2024-09-22T08:37:04.220993+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:09.401562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:09.401562+0000","last_clean_scrub_stamp":"2024-09-22T08:36:09.401562+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:14:13.135964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.229293+0000","last_change":"2024-09-22T08:36:18.431832+0000","last_active":"2024-09-22T08:37:04.229293+0000","last_peered":"2024-09-22T08:37:04.229293+0000","last_clean":"2024-09-22T08:37:04.229293+0000","last_became_active":"2024-09-22T08:36:16.425465+0000","last_became_peered":"2024-09-22T08:36:16.425465+0000","last_unstale":"2024-09-22T08:37:04.229293+0000","last_undegraded":"2024-09-22T08:37:04.229293+0000","last_fullsized":"2024-09-22T08:37:04.229293+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:15.415268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:15.415268+0000","last_clean_scrub_stamp":"2024-09-22T08:36:15.415268+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:34:11.990226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049376300000000004,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"32'5","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:33.182613+0000","last_change":"2024-09-22T08:36:23.982423+0000","last_active":"2024-09-22T08:38:33.182613+0000","last_peered":"2024-09-22T08:38:33.182613+0000","last_clean":"2024-09-22T08:38:33.182613+0000","last_became_active":"2024-09-22T08:36:23.981576+0000","last_became_peered":"2024-09-22T08:36:23.981576+0000","last_unstale":"2024-09-22T08:38:33.182613+0000","last_undegraded":"2024-09-22T08:38:33.182613+0000","last_fullsized":"2024-09-22T08:38:33.182613+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:44:29.452126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":4,"num_write":21,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.223327+0000","last_change":"2024-09-22T08:36:27.991484+0000","last_active":"2024-09-22T08:37:04.223327+0000","last_peered":"2024-09-22T08:37:04.223327+0000","last_clean":"2024-09-22T08:37:04.223327+0000","last_became_active":"2024-09-22T08:36:27.991130+0000","last_became_peered":"2024-09-22T08:36:27.991130+0000","last_unstale":"2024-09-22T08:37:04.223327+0000","last_undegraded":"2024-09-22T08:37:04.223327+0000","last_fullsized":"2024-09-22T08:37:04.223327+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_clean_scrub_stamp":"2024-09-22T08:36:26.962226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:25:36.836271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"32'76","reported_seq":146,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:30.262305+0000","last_change":"2024-09-22T08:36:29.997752+0000","last_active":"2024-09-22T08:38:30.262305+0000","last_peered":"2024-09-22T08:38:30.262305+0000","last_clean":"2024-09-22T08:38:30.262305+0000","last_became_active":"2024-09-22T08:36:29.997294+0000","last_became_peered":"2024-09-22T08:36:29.997294+0000","last_unstale":"2024-09-22T08:38:30.262305+0000","last_undegraded":"2024-09-22T08:38:30.262305+0000","last_fullsized":"2024-09-22T08:38:30.262305+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:18:13.227210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.226456+0000","last_change":"2024-09-22T08:36:32.009096+0000","last_active":"2024-09-22T08:37:04.226456+0000","last_peered":"2024-09-22T08:37:04.226456+0000","last_clean":"2024-09-22T08:37:04.226456+0000","last_became_active":"2024-09-22T08:36:32.008793+0000","last_became_peered":"2024-09-22T08:36:32.008793+0000","last_unstale":"2024-09-22T08:37:04.226456+0000","last_undegraded":"2024-09-22T08:37:04.226456+0000","last_fullsized":"2024-09-22T08:37:04.226456+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:01:07.495676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"32'81","reported_seq":163,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.301899+0000","last_change":"2024-09-22T08:36:34.016827+0000","last_active":"2024-09-22T08:39:32.301899+0000","last_peered":"2024-09-22T08:39:32.301899+0000","last_clean":"2024-09-22T08:39:32.301899+0000","last_became_active":"2024-09-22T08:36:34.016484+0000","last_became_peered":"2024-09-22T08:36:34.016484+0000","last_unstale":"2024-09-22T08:39:32.301899+0000","last_undegraded":"2024-09-22T08:39:32.301899+0000","last_fullsized":"2024-09-22T08:39:32.301899+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:27:41.551286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":223,"num_read_kb":221,"num_write":155,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"32'6","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.289629+0000","last_change":"2024-09-22T08:36:25.988439+0000","last_active":"2024-09-22T08:39:32.289629+0000","last_peered":"2024-09-22T08:39:32.289629+0000","last_clean":"2024-09-22T08:39:32.289629+0000","last_became_active":"2024-09-22T08:36:25.988156+0000","last_became_peered":"2024-09-22T08:36:25.988156+0000","last_unstale":"2024-09-22T08:39:32.289629+0000","last_undegraded":"2024-09-22T08:39:32.289629+0000","last_fullsized":"2024-09-22T08:39:32.289629+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:02:27.083682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.225823+0000","last_change":"2024-09-22T08:36:18.431890+0000","last_active":"2024-09-22T08:37:04.225823+0000","last_peered":"2024-09-22T08:37:04.225823+0000","last_clean":"2024-09-22T08:37:04.225823+0000","last_became_active":"2024-09-22T08:36:16.427252+0000","last_became_peered":"2024-09-22T08:36:16.427252+0000","last_unstale":"2024-09-22T08:37:04.225823+0000","last_undegraded":"2024-09-22T08:37:04.225823+0000","last_fullsized":"2024-09-22T08:37:04.225823+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:15.415268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:15.415268+0000","last_clean_scrub_stamp":"2024-09-22T08:36:15.415268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:11:12.623975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055484200000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.223638+0000","last_change":"2024-09-22T08:36:23.974666+0000","last_active":"2024-09-22T08:37:04.223638+0000","last_peered":"2024-09-22T08:37:04.223638+0000","last_clean":"2024-09-22T08:37:04.223638+0000","last_became_active":"2024-09-22T08:36:23.973773+0000","last_became_peered":"2024-09-22T08:36:23.973773+0000","last_unstale":"2024-09-22T08:37:04.223638+0000","last_undegraded":"2024-09-22T08:37:04.223638+0000","last_fullsized":"2024-09-22T08:37:04.223638+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:04:51.934564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.236920+0000","last_change":"2024-09-22T08:37:04.234583+0000","last_active":"2024-09-22T08:37:04.236920+0000","last_peered":"2024-09-22T08:37:04.236920+0000","last_clean":"2024-09-22T08:37:04.236920+0000","last_became_active":"2024-09-22T08:37:04.234316+0000","last_became_peered":"2024-09-22T08:37:04.234316+0000","last_unstale":"2024-09-22T08:37:04.236920+0000","last_undegraded":"2024-09-22T08:37:04.236920+0000","last_fullsized":"2024-09-22T08:37:04.236920+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_clean_scrub_stamp":"2024-09-22T08:36:26.962226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:12:15.239608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"32'274","reported_seq":477,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:28.067633+0000","last_change":"2024-09-22T08:36:29.996545+0000","last_active":"2024-09-22T08:39:28.067633+0000","last_peered":"2024-09-22T08:39:28.067633+0000","last_clean":"2024-09-22T08:39:28.067633+0000","last_became_active":"2024-09-22T08:36:29.996025+0000","last_became_peered":"2024-09-22T08:36:29.996025+0000","last_unstale":"2024-09-22T08:39:28.067633+0000","last_undegraded":"2024-09-22T08:39:28.067633+0000","last_fullsized":"2024-09-22T08:39:28.067633+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":274,"log_dups_size":0,"ondisk_log_size":274,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:55:34.543185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":357,"num_read_kb":342,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.227773+0000","last_change":"2024-09-22T08:36:32.013929+0000","last_active":"2024-09-22T08:37:04.227773+0000","last_peered":"2024-09-22T08:37:04.227773+0000","last_clean":"2024-09-22T08:37:04.227773+0000","last_became_active":"2024-09-22T08:36:32.013220+0000","last_became_peered":"2024-09-22T08:36:32.013220+0000","last_unstale":"2024-09-22T08:37:04.227773+0000","last_undegraded":"2024-09-22T08:37:04.227773+0000","last_fullsized":"2024-09-22T08:37:04.227773+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:57:05.813999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"32'5","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:28.578046+0000","last_change":"2024-09-22T08:36:34.018385+0000","last_active":"2024-09-22T08:38:28.578046+0000","last_peered":"2024-09-22T08:38:28.578046+0000","last_clean":"2024-09-22T08:38:28.578046+0000","last_became_active":"2024-09-22T08:36:34.018138+0000","last_became_peered":"2024-09-22T08:36:34.018138+0000","last_unstale":"2024-09-22T08:38:28.578046+0000","last_undegraded":"2024-09-22T08:38:28.578046+0000","last_fullsized":"2024-09-22T08:38:28.578046+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:47:34.849746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"32'8","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.214950+0000","last_change":"2024-09-22T08:36:25.979635+0000","last_active":"2024-09-22T08:39:32.214950+0000","last_peered":"2024-09-22T08:39:32.214950+0000","last_clean":"2024-09-22T08:39:32.214950+0000","last_became_active":"2024-09-22T08:36:25.979108+0000","last_became_peered":"2024-09-22T08:36:25.979108+0000","last_unstale":"2024-09-22T08:39:32.214950+0000","last_undegraded":"2024-09-22T08:39:32.214950+0000","last_fullsized":"2024-09-22T08:39:32.214950+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:18:04.046419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.225590+0000","last_change":"2024-09-22T08:36:18.520219+0000","last_active":"2024-09-22T08:37:04.225590+0000","last_peered":"2024-09-22T08:37:04.225590+0000","last_clean":"2024-09-22T08:37:04.225590+0000","last_became_active":"2024-09-22T08:36:16.427121+0000","last_became_peered":"2024-09-22T08:36:16.427121+0000","last_unstale":"2024-09-22T08:37:04.225590+0000","last_undegraded":"2024-09-22T08:37:04.225590+0000","last_fullsized":"2024-09-22T08:37:04.225590+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:15.415268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:15.415268+0000","last_clean_scrub_stamp":"2024-09-22T08:36:15.415268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:47:57.246114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041194099999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"32'1","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:28.175943+0000","last_change":"2024-09-22T08:36:23.972065+0000","last_active":"2024-09-22T08:38:28.175943+0000","last_peered":"2024-09-22T08:38:28.175943+0000","last_clean":"2024-09-22T08:38:28.175943+0000","last_became_active":"2024-09-22T08:36:23.971688+0000","last_became_peered":"2024-09-22T08:36:23.971688+0000","last_unstale":"2024-09-22T08:38:28.175943+0000","last_undegraded":"2024-09-22T08:38:28.175943+0000","last_fullsized":"2024-09-22T08:38:28.175943+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:57:13.077784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":639872,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"23'1","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.230019+0000","last_change":"2024-09-22T08:36:27.987350+0000","last_active":"2024-09-22T08:37:04.230019+0000","last_peered":"2024-09-22T08:37:04.230019+0000","last_clean":"2024-09-22T08:37:04.230019+0000","last_became_active":"2024-09-22T08:36:27.986993+0000","last_became_peered":"2024-09-22T08:36:27.986993+0000","last_unstale":"2024-09-22T08:37:04.230019+0000","last_undegraded":"2024-09-22T08:37:04.230019+0000","last_fullsized":"2024-09-22T08:37:04.230019+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_clean_scrub_stamp":"2024-09-22T08:36:26.962226+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:04:19.174975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"32'17","reported_seq":85,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:28.067597+0000","last_change":"2024-09-22T08:36:29.991891+0000","last_active":"2024-09-22T08:39:28.067597+0000","last_peered":"2024-09-22T08:39:28.067597+0000","last_clean":"2024-09-22T08:39:28.067597+0000","last_became_active":"2024-09-22T08:36:29.991579+0000","last_became_peered":"2024-09-22T08:36:29.991579+0000","last_unstale":"2024-09-22T08:39:28.067597+0000","last_undegraded":"2024-09-22T08:39:28.067597+0000","last_fullsized":"2024-09-22T08:39:28.067597+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:17:51.757786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.224585+0000","last_change":"2024-09-22T08:36:32.011889+0000","last_active":"2024-09-22T08:37:04.224585+0000","last_peered":"2024-09-22T08:37:04.224585+0000","last_clean":"2024-09-22T08:37:04.224585+0000","last_became_active":"2024-09-22T08:36:32.011634+0000","last_became_peered":"2024-09-22T08:36:32.011634+0000","last_unstale":"2024-09-22T08:37:04.224585+0000","last_undegraded":"2024-09-22T08:37:04.224585+0000","last_fullsized":"2024-09-22T08:37:04.224585+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:56:34.615539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.226958+0000","last_change":"2024-09-22T08:36:34.012423+0000","last_active":"2024-09-22T08:37:04.226958+0000","last_peered":"2024-09-22T08:37:04.226958+0000","last_clean":"2024-09-22T08:37:04.226958+0000","last_became_active":"2024-09-22T08:36:34.011936+0000","last_became_peered":"2024-09-22T08:36:34.011936+0000","last_unstale":"2024-09-22T08:37:04.226958+0000","last_undegraded":"2024-09-22T08:37:04.226958+0000","last_fullsized":"2024-09-22T08:37:04.226958+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:29:05.565248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"32'3","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:33.176834+0000","last_change":"2024-09-22T08:36:25.977871+0000","last_active":"2024-09-22T08:38:33.176834+0000","last_peered":"2024-09-22T08:38:33.176834+0000","last_clean":"2024-09-22T08:38:33.176834+0000","last_became_active":"2024-09-22T08:36:25.977552+0000","last_became_peered":"2024-09-22T08:36:25.977552+0000","last_unstale":"2024-09-22T08:38:33.176834+0000","last_undegraded":"2024-09-22T08:38:33.176834+0000","last_fullsized":"2024-09-22T08:38:33.176834+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:22:41.119685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.227504+0000","last_change":"2024-09-22T08:36:18.432421+0000","last_active":"2024-09-22T08:37:04.227504+0000","last_peered":"2024-09-22T08:37:04.227504+0000","last_clean":"2024-09-22T08:37:04.227504+0000","last_became_active":"2024-09-22T08:36:16.427358+0000","last_became_peered":"2024-09-22T08:36:16.427358+0000","last_unstale":"2024-09-22T08:37:04.227504+0000","last_undegraded":"2024-09-22T08:37:04.227504+0000","last_fullsized":"2024-09-22T08:37:04.227504+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:15.415268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:15.415268+0000","last_clean_scrub_stamp":"2024-09-22T08:36:15.415268+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:16:15.903021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001068835,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"32'4","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.208130+0000","last_change":"2024-09-22T08:36:23.967690+0000","last_active":"2024-09-22T08:39:32.208130+0000","last_peered":"2024-09-22T08:39:32.208130+0000","last_clean":"2024-09-22T08:39:32.208130+0000","last_became_active":"2024-09-22T08:36:23.967413+0000","last_became_peered":"2024-09-22T08:36:23.967413+0000","last_unstale":"2024-09-22T08:39:32.208130+0000","last_undegraded":"2024-09-22T08:39:32.208130+0000","last_fullsized":"2024-09-22T08:39:32.208130+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:53:44.806098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.225286+0000","last_change":"2024-09-22T08:36:27.988932+0000","last_active":"2024-09-22T08:37:04.225286+0000","last_peered":"2024-09-22T08:37:04.225286+0000","last_clean":"2024-09-22T08:37:04.225286+0000","last_became_active":"2024-09-22T08:36:27.988507+0000","last_became_peered":"2024-09-22T08:36:27.988507+0000","last_unstale":"2024-09-22T08:37:04.225286+0000","last_undegraded":"2024-09-22T08:37:04.225286+0000","last_fullsized":"2024-09-22T08:37:04.225286+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_clean_scrub_stamp":"2024-09-22T08:36:26.962226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:48:06.094834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"32'13","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:31.660162+0000","last_change":"2024-09-22T08:36:29.996842+0000","last_active":"2024-09-22T08:39:31.660162+0000","last_peered":"2024-09-22T08:39:31.660162+0000","last_clean":"2024-09-22T08:39:31.660162+0000","last_became_active":"2024-09-22T08:36:29.996557+0000","last_became_peered":"2024-09-22T08:36:29.996557+0000","last_unstale":"2024-09-22T08:39:31.660162+0000","last_undegraded":"2024-09-22T08:39:31.660162+0000","last_fullsized":"2024-09-22T08:39:31.660162+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:05:26.776730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.229775+0000","last_change":"2024-09-22T08:36:32.014226+0000","last_active":"2024-09-22T08:37:04.229775+0000","last_peered":"2024-09-22T08:37:04.229775+0000","last_clean":"2024-09-22T08:37:04.229775+0000","last_became_active":"2024-09-22T08:36:32.013320+0000","last_became_peered":"2024-09-22T08:36:32.013320+0000","last_unstale":"2024-09-22T08:37:04.229775+0000","last_undegraded":"2024-09-22T08:37:04.229775+0000","last_fullsized":"2024-09-22T08:37:04.229775+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:03:21.762780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"32'4","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:31.413581+0000","last_change":"2024-09-22T08:36:34.015737+0000","last_active":"2024-09-22T08:38:31.413581+0000","last_peered":"2024-09-22T08:38:31.413581+0000","last_clean":"2024-09-22T08:38:31.413581+0000","last_became_active":"2024-09-22T08:36:34.015483+0000","last_became_peered":"2024-09-22T08:36:34.015483+0000","last_unstale":"2024-09-22T08:38:31.413581+0000","last_undegraded":"2024-09-22T08:38:31.413581+0000","last_fullsized":"2024-09-22T08:38:31.413581+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:08:04.974029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"32'8","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.078825+0000","last_change":"2024-09-22T08:36:25.986838+0000","last_active":"2024-09-22T08:39:32.078825+0000","last_peered":"2024-09-22T08:39:32.078825+0000","last_clean":"2024-09-22T08:39:32.078825+0000","last_became_active":"2024-09-22T08:36:25.986551+0000","last_became_peered":"2024-09-22T08:36:25.986551+0000","last_unstale":"2024-09-22T08:39:32.078825+0000","last_undegraded":"2024-09-22T08:39:32.078825+0000","last_fullsized":"2024-09-22T08:39:32.078825+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:52:57.511753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.225659+0000","last_change":"2024-09-22T08:36:23.968878+0000","last_active":"2024-09-22T08:37:04.225659+0000","last_peered":"2024-09-22T08:37:04.225659+0000","last_clean":"2024-09-22T08:37:04.225659+0000","last_became_active":"2024-09-22T08:36:23.968525+0000","last_became_peered":"2024-09-22T08:36:23.968525+0000","last_unstale":"2024-09-22T08:37:04.225659+0000","last_undegraded":"2024-09-22T08:37:04.225659+0000","last_fullsized":"2024-09-22T08:37:04.225659+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:02:28.926834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.224477+0000","last_change":"2024-09-22T08:36:18.434398+0000","last_active":"2024-09-22T08:37:04.224477+0000","last_peered":"2024-09-22T08:37:04.224477+0000","last_clean":"2024-09-22T08:37:04.224477+0000","last_became_active":"2024-09-22T08:36:16.424946+0000","last_became_peered":"2024-09-22T08:36:16.424946+0000","last_unstale":"2024-09-22T08:37:04.224477+0000","last_undegraded":"2024-09-22T08:37:04.224477+0000","last_fullsized":"2024-09-22T08:37:04.224477+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:15.415268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:15.415268+0000","last_clean_scrub_stamp":"2024-09-22T08:36:15.415268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:29:12.209070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045979400000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"32'1","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:33.176792+0000","last_change":"2024-09-22T08:36:27.988495+0000","last_active":"2024-09-22T08:38:33.176792+0000","last_peered":"2024-09-22T08:38:33.176792+0000","last_clean":"2024-09-22T08:38:33.176792+0000","last_became_active":"2024-09-22T08:36:27.987997+0000","last_became_peered":"2024-09-22T08:36:27.987997+0000","last_unstale":"2024-09-22T08:38:33.176792+0000","last_undegraded":"2024-09-22T08:38:33.176792+0000","last_fullsized":"2024-09-22T08:38:33.176792+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_clean_scrub_stamp":"2024-09-22T08:36:26.962226+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:35:11.843511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"32'63","reported_seq":123,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:33.176707+0000","last_change":"2024-09-22T08:36:29.994493+0000","last_active":"2024-09-22T08:38:33.176707+0000","last_peered":"2024-09-22T08:38:33.176707+0000","last_clean":"2024-09-22T08:38:33.176707+0000","last_became_active":"2024-09-22T08:36:29.994186+0000","last_became_peered":"2024-09-22T08:36:29.994186+0000","last_unstale":"2024-09-22T08:38:33.176707+0000","last_undegraded":"2024-09-22T08:38:33.176707+0000","last_fullsized":"2024-09-22T08:38:33.176707+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:18:59.702792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":59,"num_read_kb":47,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.228168+0000","last_change":"2024-09-22T08:36:32.003689+0000","last_active":"2024-09-22T08:37:04.228168+0000","last_peered":"2024-09-22T08:37:04.228168+0000","last_clean":"2024-09-22T08:37:04.228168+0000","last_became_active":"2024-09-22T08:36:32.003409+0000","last_became_peered":"2024-09-22T08:36:32.003409+0000","last_unstale":"2024-09-22T08:37:04.228168+0000","last_undegraded":"2024-09-22T08:37:04.228168+0000","last_fullsized":"2024-09-22T08:37:04.228168+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:27:05.933480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"32'13","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:31.589959+0000","last_change":"2024-09-22T08:36:34.013068+0000","last_active":"2024-09-22T08:38:31.589959+0000","last_peered":"2024-09-22T08:38:31.589959+0000","last_clean":"2024-09-22T08:38:31.589959+0000","last_became_active":"2024-09-22T08:36:34.012782+0000","last_became_peered":"2024-09-22T08:36:34.012782+0000","last_unstale":"2024-09-22T08:38:31.589959+0000","last_undegraded":"2024-09-22T08:38:31.589959+0000","last_fullsized":"2024-09-22T08:38:31.589959+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:16:13.410088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":25,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"32'6","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:31.996095+0000","last_change":"2024-09-22T08:36:25.985097+0000","last_active":"2024-09-22T08:39:31.996095+0000","last_peered":"2024-09-22T08:39:31.996095+0000","last_clean":"2024-09-22T08:39:31.996095+0000","last_became_active":"2024-09-22T08:36:25.984820+0000","last_became_peered":"2024-09-22T08:36:25.984820+0000","last_unstale":"2024-09-22T08:39:31.996095+0000","last_undegraded":"2024-09-22T08:39:31.996095+0000","last_fullsized":"2024-09-22T08:39:31.996095+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:42:09.685963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":29,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.613983+0000","last_change":"2024-09-22T08:36:23.974058+0000","last_active":"2024-09-22T08:37:04.613983+0000","last_peered":"2024-09-22T08:37:04.613983+0000","last_clean":"2024-09-22T08:37:04.613983+0000","last_became_active":"2024-09-22T08:36:23.973672+0000","last_became_peered":"2024-09-22T08:36:23.973672+0000","last_unstale":"2024-09-22T08:37:04.613983+0000","last_undegraded":"2024-09-22T08:37:04.613983+0000","last_fullsized":"2024-09-22T08:37:04.613983+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:01:29.462654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.231504+0000","last_change":"2024-09-22T08:36:18.432154+0000","last_active":"2024-09-22T08:37:04.231504+0000","last_peered":"2024-09-22T08:37:04.231504+0000","last_clean":"2024-09-22T08:37:04.231504+0000","last_became_active":"2024-09-22T08:36:16.427154+0000","last_became_peered":"2024-09-22T08:36:16.427154+0000","last_unstale":"2024-09-22T08:37:04.231504+0000","last_undegraded":"2024-09-22T08:37:04.231504+0000","last_fullsized":"2024-09-22T08:37:04.231504+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:15.415268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:15.415268+0000","last_clean_scrub_stamp":"2024-09-22T08:36:15.415268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:44:41.260462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081028899999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.236919+0000","last_change":"2024-09-22T08:37:04.234588+0000","last_active":"2024-09-22T08:37:04.236919+0000","last_peered":"2024-09-22T08:37:04.236919+0000","last_clean":"2024-09-22T08:37:04.236919+0000","last_became_active":"2024-09-22T08:37:04.233981+0000","last_became_peered":"2024-09-22T08:37:04.233981+0000","last_unstale":"2024-09-22T08:37:04.236919+0000","last_undegraded":"2024-09-22T08:37:04.236919+0000","last_fullsized":"2024-09-22T08:37:04.236919+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_clean_scrub_stamp":"2024-09-22T08:36:26.962226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:01:06.235869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"32'15","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:28.585360+0000","last_change":"2024-09-22T08:36:29.995560+0000","last_active":"2024-09-22T08:38:28.585360+0000","last_peered":"2024-09-22T08:38:28.585360+0000","last_clean":"2024-09-22T08:38:28.585360+0000","last_became_active":"2024-09-22T08:36:29.995173+0000","last_became_peered":"2024-09-22T08:36:29.995173+0000","last_unstale":"2024-09-22T08:38:28.585360+0000","last_undegraded":"2024-09-22T08:38:28.585360+0000","last_fullsized":"2024-09-22T08:38:28.585360+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:37:47.696313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"32'282","reported_seq":346,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:28.067667+0000","last_change":"2024-09-22T08:36:32.003255+0000","last_active":"2024-09-22T08:39:28.067667+0000","last_peered":"2024-09-22T08:39:28.067667+0000","last_clean":"2024-09-22T08:39:28.067667+0000","last_became_active":"2024-09-22T08:36:32.002985+0000","last_became_peered":"2024-09-22T08:36:32.002985+0000","last_unstale":"2024-09-22T08:39:28.067667+0000","last_undegraded":"2024-09-22T08:39:28.067667+0000","last_fullsized":"2024-09-22T08:39:28.067667+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:27:39.543678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.227398+0000","last_change":"2024-09-22T08:36:34.019732+0000","last_active":"2024-09-22T08:37:04.227398+0000","last_peered":"2024-09-22T08:37:04.227398+0000","last_clean":"2024-09-22T08:37:04.227398+0000","last_became_active":"2024-09-22T08:36:34.019438+0000","last_became_peered":"2024-09-22T08:36:34.019438+0000","last_unstale":"2024-09-22T08:37:04.227398+0000","last_undegraded":"2024-09-22T08:37:04.227398+0000","last_fullsized":"2024-09-22T08:37:04.227398+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:29:22.767417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"32'3","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.267975+0000","last_change":"2024-09-22T08:36:25.992413+0000","last_active":"2024-09-22T08:39:32.267975+0000","last_peered":"2024-09-22T08:39:32.267975+0000","last_clean":"2024-09-22T08:39:32.267975+0000","last_became_active":"2024-09-22T08:36:25.991480+0000","last_became_peered":"2024-09-22T08:36:25.991480+0000","last_unstale":"2024-09-22T08:39:32.267975+0000","last_undegraded":"2024-09-22T08:39:32.267975+0000","last_fullsized":"2024-09-22T08:39:32.267975+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:10:58.578162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:05.167463+0000","last_change":"2024-09-22T08:37:04.227877+0000","last_active":"2024-09-22T08:37:05.167463+0000","last_peered":"2024-09-22T08:37:05.167463+0000","last_clean":"2024-09-22T08:37:05.167463+0000","last_became_active":"2024-09-22T08:37:04.227561+0000","last_became_peered":"2024-09-22T08:37:04.227561+0000","last_unstale":"2024-09-22T08:37:05.167463+0000","last_undegraded":"2024-09-22T08:37:05.167463+0000","last_fullsized":"2024-09-22T08:37:05.167463+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:00:14.486207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.225363+0000","last_change":"2024-09-22T08:36:18.434431+0000","last_active":"2024-09-22T08:37:04.225363+0000","last_peered":"2024-09-22T08:37:04.225363+0000","last_clean":"2024-09-22T08:37:04.225363+0000","last_became_active":"2024-09-22T08:36:16.425549+0000","last_became_peered":"2024-09-22T08:36:16.425549+0000","last_unstale":"2024-09-22T08:37:04.225363+0000","last_undegraded":"2024-09-22T08:37:04.225363+0000","last_fullsized":"2024-09-22T08:37:04.225363+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:15.415268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:15.415268+0000","last_clean_scrub_stamp":"2024-09-22T08:36:15.415268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:59:01.714308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045809600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.229558+0000","last_change":"2024-09-22T08:36:27.987430+0000","last_active":"2024-09-22T08:37:04.229558+0000","last_peered":"2024-09-22T08:37:04.229558+0000","last_clean":"2024-09-22T08:37:04.229558+0000","last_became_active":"2024-09-22T08:36:27.987074+0000","last_became_peered":"2024-09-22T08:36:27.987074+0000","last_unstale":"2024-09-22T08:37:04.229558+0000","last_undegraded":"2024-09-22T08:37:04.229558+0000","last_fullsized":"2024-09-22T08:37:04.229558+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_clean_scrub_stamp":"2024-09-22T08:36:26.962226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:08:31.905654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"30'10","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.228539+0000","last_change":"2024-09-22T08:36:30.000809+0000","last_active":"2024-09-22T08:37:04.228539+0000","last_peered":"2024-09-22T08:37:04.228539+0000","last_clean":"2024-09-22T08:37:04.228539+0000","last_became_active":"2024-09-22T08:36:29.999965+0000","last_became_peered":"2024-09-22T08:36:29.999965+0000","last_unstale":"2024-09-22T08:37:04.228539+0000","last_undegraded":"2024-09-22T08:37:04.228539+0000","last_fullsized":"2024-09-22T08:37:04.228539+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:05:54.815446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"32'282","reported_seq":389,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.384270+0000","last_change":"2024-09-22T08:36:32.005583+0000","last_active":"2024-09-22T08:39:32.384270+0000","last_peered":"2024-09-22T08:39:32.384270+0000","last_clean":"2024-09-22T08:39:32.384270+0000","last_became_active":"2024-09-22T08:36:32.005155+0000","last_became_peered":"2024-09-22T08:36:32.005155+0000","last_unstale":"2024-09-22T08:39:32.384270+0000","last_undegraded":"2024-09-22T08:39:32.384270+0000","last_fullsized":"2024-09-22T08:39:32.384270+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:01:17.946935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"30'5","reported_seq":25,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.223266+0000","last_change":"2024-09-22T08:36:34.022617+0000","last_active":"2024-09-22T08:37:04.223266+0000","last_peered":"2024-09-22T08:37:04.223266+0000","last_clean":"2024-09-22T08:37:04.223266+0000","last_became_active":"2024-09-22T08:36:34.022313+0000","last_became_peered":"2024-09-22T08:36:34.022313+0000","last_unstale":"2024-09-22T08:37:04.223266+0000","last_undegraded":"2024-09-22T08:37:04.223266+0000","last_fullsized":"2024-09-22T08:37:04.223266+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:42:55.182851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":11,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"32'4","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:06.180363+0000","last_change":"2024-09-22T08:36:25.975148+0000","last_active":"2024-09-22T08:37:06.180363+0000","last_peered":"2024-09-22T08:37:06.180363+0000","last_clean":"2024-09-22T08:37:06.180363+0000","last_became_active":"2024-09-22T08:36:25.974884+0000","last_became_peered":"2024-09-22T08:36:25.974884+0000","last_unstale":"2024-09-22T08:37:06.180363+0000","last_undegraded":"2024-09-22T08:37:06.180363+0000","last_fullsized":"2024-09-22T08:37:06.180363+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:22:54.131230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"32'5","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:47.933891+0000","last_change":"2024-09-22T08:36:23.976867+0000","last_active":"2024-09-22T08:37:47.933891+0000","last_peered":"2024-09-22T08:37:47.933891+0000","last_clean":"2024-09-22T08:37:47.933891+0000","last_became_active":"2024-09-22T08:36:23.976646+0000","last_became_peered":"2024-09-22T08:36:23.976646+0000","last_unstale":"2024-09-22T08:37:47.933891+0000","last_undegraded":"2024-09-22T08:37:47.933891+0000","last_fullsized":"2024-09-22T08:37:47.933891+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:26:49.921857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":11,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.229890+0000","last_change":"2024-09-22T08:36:18.432491+0000","last_active":"2024-09-22T08:37:04.229890+0000","last_peered":"2024-09-22T08:37:04.229890+0000","last_clean":"2024-09-22T08:37:04.229890+0000","last_became_active":"2024-09-22T08:36:16.638610+0000","last_became_peered":"2024-09-22T08:36:16.638610+0000","last_unstale":"2024-09-22T08:37:04.229890+0000","last_undegraded":"2024-09-22T08:37:04.229890+0000","last_fullsized":"2024-09-22T08:37:04.229890+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:15.415268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:15.415268+0000","last_clean_scrub_stamp":"2024-09-22T08:36:15.415268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:36:49.729872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001119264,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.226781+0000","last_change":"2024-09-22T08:36:27.985127+0000","last_active":"2024-09-22T08:37:04.226781+0000","last_peered":"2024-09-22T08:37:04.226781+0000","last_clean":"2024-09-22T08:37:04.226781+0000","last_became_active":"2024-09-22T08:36:27.984803+0000","last_became_peered":"2024-09-22T08:36:27.984803+0000","last_unstale":"2024-09-22T08:37:04.226781+0000","last_undegraded":"2024-09-22T08:37:04.226781+0000","last_fullsized":"2024-09-22T08:37:04.226781+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_clean_scrub_stamp":"2024-09-22T08:36:26.962226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:51:28.889992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"32'84","reported_seq":157,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:30.248529+0000","last_change":"2024-09-22T08:36:30.000659+0000","last_active":"2024-09-22T08:38:30.248529+0000","last_peered":"2024-09-22T08:38:30.248529+0000","last_clean":"2024-09-22T08:38:30.248529+0000","last_became_active":"2024-09-22T08:36:30.000270+0000","last_became_peered":"2024-09-22T08:36:30.000270+0000","last_unstale":"2024-09-22T08:38:30.248529+0000","last_undegraded":"2024-09-22T08:38:30.248529+0000","last_fullsized":"2024-09-22T08:38:30.248529+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:27:22.890604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4316,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":81,"num_read_kb":82,"num_write":32,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.223565+0000","last_change":"2024-09-22T08:36:32.003206+0000","last_active":"2024-09-22T08:37:04.223565+0000","last_peered":"2024-09-22T08:37:04.223565+0000","last_clean":"2024-09-22T08:37:04.223565+0000","last_became_active":"2024-09-22T08:36:32.002876+0000","last_became_peered":"2024-09-22T08:36:32.002876+0000","last_unstale":"2024-09-22T08:37:04.223565+0000","last_undegraded":"2024-09-22T08:37:04.223565+0000","last_fullsized":"2024-09-22T08:37:04.223565+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:07:07.136733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"30'2","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.228242+0000","last_change":"2024-09-22T08:36:34.016952+0000","last_active":"2024-09-22T08:37:04.228242+0000","last_peered":"2024-09-22T08:37:04.228242+0000","last_clean":"2024-09-22T08:37:04.228242+0000","last_became_active":"2024-09-22T08:36:34.016659+0000","last_became_peered":"2024-09-22T08:36:34.016659+0000","last_unstale":"2024-09-22T08:37:04.228242+0000","last_undegraded":"2024-09-22T08:37:04.228242+0000","last_fullsized":"2024-09-22T08:37:04.228242+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:01:42.781684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.229370+0000","last_change":"2024-09-22T08:36:34.015661+0000","last_active":"2024-09-22T08:37:04.229370+0000","last_peered":"2024-09-22T08:37:04.229370+0000","last_clean":"2024-09-22T08:37:04.229370+0000","last_became_active":"2024-09-22T08:36:34.015241+0000","last_became_peered":"2024-09-22T08:36:34.015241+0000","last_unstale":"2024-09-22T08:37:04.229370+0000","last_undegraded":"2024-09-22T08:37:04.229370+0000","last_fullsized":"2024-09-22T08:37:04.229370+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:13:28.913225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"32'4","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.259199+0000","last_change":"2024-09-22T08:36:25.987431+0000","last_active":"2024-09-22T08:39:32.259199+0000","last_peered":"2024-09-22T08:39:32.259199+0000","last_clean":"2024-09-22T08:39:32.259199+0000","last_became_active":"2024-09-22T08:36:25.987153+0000","last_became_peered":"2024-09-22T08:36:25.987153+0000","last_unstale":"2024-09-22T08:39:32.259199+0000","last_undegraded":"2024-09-22T08:39:32.259199+0000","last_fullsized":"2024-09-22T08:39:32.259199+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:33:37.909896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.225028+0000","last_change":"2024-09-22T08:36:23.982772+0000","last_active":"2024-09-22T08:37:04.225028+0000","last_peered":"2024-09-22T08:37:04.225028+0000","last_clean":"2024-09-22T08:37:04.225028+0000","last_became_active":"2024-09-22T08:36:23.981927+0000","last_became_peered":"2024-09-22T08:36:23.981927+0000","last_unstale":"2024-09-22T08:37:04.225028+0000","last_undegraded":"2024-09-22T08:37:04.225028+0000","last_fullsized":"2024-09-22T08:37:04.225028+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:12:33.585769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.222089+0000","last_change":"2024-09-22T08:36:27.990795+0000","last_active":"2024-09-22T08:37:04.222089+0000","last_peered":"2024-09-22T08:37:04.222089+0000","last_clean":"2024-09-22T08:37:04.222089+0000","last_became_active":"2024-09-22T08:36:27.990153+0000","last_became_peered":"2024-09-22T08:36:27.990153+0000","last_unstale":"2024-09-22T08:37:04.222089+0000","last_undegraded":"2024-09-22T08:37:04.222089+0000","last_fullsized":"2024-09-22T08:37:04.222089+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_clean_scrub_stamp":"2024-09-22T08:36:26.962226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:44:21.494770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"32'33","reported_seq":77,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:53.186450+0000","last_change":"2024-09-22T08:36:29.998789+0000","last_active":"2024-09-22T08:38:53.186450+0000","last_peered":"2024-09-22T08:38:53.186450+0000","last_clean":"2024-09-22T08:38:53.186450+0000","last_became_active":"2024-09-22T08:36:29.997814+0000","last_became_peered":"2024-09-22T08:36:29.997814+0000","last_unstale":"2024-09-22T08:38:53.186450+0000","last_undegraded":"2024-09-22T08:38:53.186450+0000","last_fullsized":"2024-09-22T08:38:53.186450+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:38:57.806502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5807,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":27,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.226536+0000","last_change":"2024-09-22T08:36:32.012924+0000","last_active":"2024-09-22T08:37:04.226536+0000","last_peered":"2024-09-22T08:37:04.226536+0000","last_clean":"2024-09-22T08:37:04.226536+0000","last_became_active":"2024-09-22T08:36:32.012453+0000","last_became_peered":"2024-09-22T08:36:32.012453+0000","last_unstale":"2024-09-22T08:37:04.226536+0000","last_undegraded":"2024-09-22T08:37:04.226536+0000","last_fullsized":"2024-09-22T08:37:04.226536+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:07:18.464448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"32'3","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:29.962024+0000","last_change":"2024-09-22T08:36:34.022519+0000","last_active":"2024-09-22T08:38:29.962024+0000","last_peered":"2024-09-22T08:38:29.962024+0000","last_clean":"2024-09-22T08:38:29.962024+0000","last_became_active":"2024-09-22T08:36:34.022267+0000","last_became_peered":"2024-09-22T08:36:34.022267+0000","last_unstale":"2024-09-22T08:38:29.962024+0000","last_undegraded":"2024-09-22T08:38:29.962024+0000","last_fullsized":"2024-09-22T08:38:29.962024+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:48:06.628364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"32'6","reported_seq":82,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:05.120194+0000","last_change":"2024-09-22T08:36:25.986871+0000","last_active":"2024-09-22T08:37:05.120194+0000","last_peered":"2024-09-22T08:37:05.120194+0000","last_clean":"2024-09-22T08:37:05.120194+0000","last_became_active":"2024-09-22T08:36:25.986613+0000","last_became_peered":"2024-09-22T08:36:25.986613+0000","last_unstale":"2024-09-22T08:37:05.120194+0000","last_undegraded":"2024-09-22T08:37:05.120194+0000","last_fullsized":"2024-09-22T08:37:05.120194+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:34:39.892614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":60,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.225905+0000","last_change":"2024-09-22T08:36:23.978519+0000","last_active":"2024-09-22T08:37:04.225905+0000","last_peered":"2024-09-22T08:37:04.225905+0000","last_clean":"2024-09-22T08:37:04.225905+0000","last_became_active":"2024-09-22T08:36:23.978282+0000","last_became_peered":"2024-09-22T08:36:23.978282+0000","last_unstale":"2024-09-22T08:37:04.225905+0000","last_undegraded":"2024-09-22T08:37:04.225905+0000","last_fullsized":"2024-09-22T08:37:04.225905+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:27:04.674711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.230277+0000","last_change":"2024-09-22T08:36:27.986336+0000","last_active":"2024-09-22T08:37:04.230277+0000","last_peered":"2024-09-22T08:37:04.230277+0000","last_clean":"2024-09-22T08:37:04.230277+0000","last_became_active":"2024-09-22T08:36:27.986033+0000","last_became_peered":"2024-09-22T08:36:27.986033+0000","last_unstale":"2024-09-22T08:37:04.230277+0000","last_undegraded":"2024-09-22T08:37:04.230277+0000","last_fullsized":"2024-09-22T08:37:04.230277+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_clean_scrub_stamp":"2024-09-22T08:36:26.962226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:54:43.939868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"32'6","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:31.680000+0000","last_change":"2024-09-22T08:36:29.990307+0000","last_active":"2024-09-22T08:39:31.680000+0000","last_peered":"2024-09-22T08:39:31.680000+0000","last_clean":"2024-09-22T08:39:31.680000+0000","last_became_active":"2024-09-22T08:36:29.990057+0000","last_became_peered":"2024-09-22T08:36:29.990057+0000","last_unstale":"2024-09-22T08:39:31.680000+0000","last_undegraded":"2024-09-22T08:39:31.680000+0000","last_fullsized":"2024-09-22T08:39:31.680000+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:20:39.541039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.228183+0000","last_change":"2024-09-22T08:36:32.010964+0000","last_active":"2024-09-22T08:37:04.228183+0000","last_peered":"2024-09-22T08:37:04.228183+0000","last_clean":"2024-09-22T08:37:04.228183+0000","last_became_active":"2024-09-22T08:36:32.010692+0000","last_became_peered":"2024-09-22T08:36:32.010692+0000","last_unstale":"2024-09-22T08:37:04.228183+0000","last_undegraded":"2024-09-22T08:37:04.228183+0000","last_fullsized":"2024-09-22T08:37:04.228183+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:42:56.003470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"32'8","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:31.738292+0000","last_change":"2024-09-22T08:36:34.017610+0000","last_active":"2024-09-22T08:39:31.738292+0000","last_peered":"2024-09-22T08:39:31.738292+0000","last_clean":"2024-09-22T08:39:31.738292+0000","last_became_active":"2024-09-22T08:36:34.017181+0000","last_became_peered":"2024-09-22T08:36:34.017181+0000","last_unstale":"2024-09-22T08:39:31.738292+0000","last_undegraded":"2024-09-22T08:39:31.738292+0000","last_fullsized":"2024-09-22T08:39:31.738292+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:00:36.254978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":21,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"32'6","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.214871+0000","last_change":"2024-09-22T08:36:25.975177+0000","last_active":"2024-09-22T08:39:32.214871+0000","last_peered":"2024-09-22T08:39:32.214871+0000","last_clean":"2024-09-22T08:39:32.214871+0000","last_became_active":"2024-09-22T08:36:25.974797+0000","last_became_peered":"2024-09-22T08:36:25.974797+0000","last_unstale":"2024-09-22T08:39:32.214871+0000","last_undegraded":"2024-09-22T08:39:32.214871+0000","last_fullsized":"2024-09-22T08:39:32.214871+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:45:56.482158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.613051+0000","last_change":"2024-09-22T08:36:23.974236+0000","last_active":"2024-09-22T08:37:04.613051+0000","last_peered":"2024-09-22T08:37:04.613051+0000","last_clean":"2024-09-22T08:37:04.613051+0000","last_became_active":"2024-09-22T08:36:23.973601+0000","last_became_peered":"2024-09-22T08:36:23.973601+0000","last_unstale":"2024-09-22T08:37:04.613051+0000","last_undegraded":"2024-09-22T08:37:04.613051+0000","last_fullsized":"2024-09-22T08:37:04.613051+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:39:33.026572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.222812+0000","last_change":"2024-09-22T08:36:27.986446+0000","last_active":"2024-09-22T08:37:04.222812+0000","last_peered":"2024-09-22T08:37:04.222812+0000","last_clean":"2024-09-22T08:37:04.222812+0000","last_became_active":"2024-09-22T08:36:27.986100+0000","last_became_peered":"2024-09-22T08:36:27.986100+0000","last_unstale":"2024-09-22T08:37:04.222812+0000","last_undegraded":"2024-09-22T08:37:04.222812+0000","last_fullsized":"2024-09-22T08:37:04.222812+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_clean_scrub_stamp":"2024-09-22T08:36:26.962226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:23:06.708649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"32'40","reported_seq":100,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:31.718665+0000","last_change":"2024-09-22T08:36:29.992078+0000","last_active":"2024-09-22T08:39:31.718665+0000","last_peered":"2024-09-22T08:39:31.718665+0000","last_clean":"2024-09-22T08:39:31.718665+0000","last_became_active":"2024-09-22T08:36:29.991732+0000","last_became_peered":"2024-09-22T08:36:29.991732+0000","last_unstale":"2024-09-22T08:39:31.718665+0000","last_undegraded":"2024-09-22T08:39:31.718665+0000","last_fullsized":"2024-09-22T08:39:31.718665+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:54:46.326822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":61,"num_read_kb":64,"num_write":46,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.221450+0000","last_change":"2024-09-22T08:36:32.003244+0000","last_active":"2024-09-22T08:37:04.221450+0000","last_peered":"2024-09-22T08:37:04.221450+0000","last_clean":"2024-09-22T08:37:04.221450+0000","last_became_active":"2024-09-22T08:36:32.002970+0000","last_became_peered":"2024-09-22T08:36:32.002970+0000","last_unstale":"2024-09-22T08:37:04.221450+0000","last_undegraded":"2024-09-22T08:37:04.221450+0000","last_fullsized":"2024-09-22T08:37:04.221450+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:19:57.326474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"32'4","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.344891+0000","last_change":"2024-09-22T08:36:34.016939+0000","last_active":"2024-09-22T08:39:32.344891+0000","last_peered":"2024-09-22T08:39:32.344891+0000","last_clean":"2024-09-22T08:39:32.344891+0000","last_became_active":"2024-09-22T08:36:34.016379+0000","last_became_peered":"2024-09-22T08:36:34.016379+0000","last_unstale":"2024-09-22T08:39:32.344891+0000","last_undegraded":"2024-09-22T08:39:32.344891+0000","last_fullsized":"2024-09-22T08:39:32.344891+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:50:54.870215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":421,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"32'6","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:28.582884+0000","last_change":"2024-09-22T08:36:25.988849+0000","last_active":"2024-09-22T08:38:28.582884+0000","last_peered":"2024-09-22T08:38:28.582884+0000","last_clean":"2024-09-22T08:38:28.582884+0000","last_became_active":"2024-09-22T08:36:25.988569+0000","last_became_peered":"2024-09-22T08:36:25.988569+0000","last_unstale":"2024-09-22T08:38:28.582884+0000","last_undegraded":"2024-09-22T08:38:28.582884+0000","last_fullsized":"2024-09-22T08:38:28.582884+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:18:26.519986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.224287+0000","last_change":"2024-09-22T08:36:23.977609+0000","last_active":"2024-09-22T08:37:04.224287+0000","last_peered":"2024-09-22T08:37:04.224287+0000","last_clean":"2024-09-22T08:37:04.224287+0000","last_became_active":"2024-09-22T08:36:23.977355+0000","last_became_peered":"2024-09-22T08:36:23.977355+0000","last_unstale":"2024-09-22T08:37:04.224287+0000","last_undegraded":"2024-09-22T08:37:04.224287+0000","last_fullsized":"2024-09-22T08:37:04.224287+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:58:35.337314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"32'4","reported_seq":227,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:31.297357+0000","last_change":"2024-09-22T08:36:27.987952+0000","last_active":"2024-09-22T08:38:31.297357+0000","last_peered":"2024-09-22T08:38:31.297357+0000","last_clean":"2024-09-22T08:38:31.297357+0000","last_became_active":"2024-09-22T08:36:27.987561+0000","last_became_peered":"2024-09-22T08:36:27.987561+0000","last_unstale":"2024-09-22T08:38:31.297357+0000","last_undegraded":"2024-09-22T08:38:31.297357+0000","last_fullsized":"2024-09-22T08:38:31.297357+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_clean_scrub_stamp":"2024-09-22T08:36:26.962226+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:59:38.794944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":298,"num_read_kb":298,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"32'31","reported_seq":74,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:31.651146+0000","last_change":"2024-09-22T08:36:29.989156+0000","last_active":"2024-09-22T08:38:31.651146+0000","last_peered":"2024-09-22T08:38:31.651146+0000","last_clean":"2024-09-22T08:38:31.651146+0000","last_became_active":"2024-09-22T08:36:29.988607+0000","last_became_peered":"2024-09-22T08:36:29.988607+0000","last_unstale":"2024-09-22T08:38:31.651146+0000","last_undegraded":"2024-09-22T08:38:31.651146+0000","last_fullsized":"2024-09-22T08:38:31.651146+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:59:53.178494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.225600+0000","last_change":"2024-09-22T08:36:32.003908+0000","last_active":"2024-09-22T08:37:04.225600+0000","last_peered":"2024-09-22T08:37:04.225600+0000","last_clean":"2024-09-22T08:37:04.225600+0000","last_became_active":"2024-09-22T08:36:32.003651+0000","last_became_peered":"2024-09-22T08:36:32.003651+0000","last_unstale":"2024-09-22T08:37:04.225600+0000","last_undegraded":"2024-09-22T08:37:04.225600+0000","last_fullsized":"2024-09-22T08:37:04.225600+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:39:25.611419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"32'10","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.259871+0000","last_change":"2024-09-22T08:36:25.990717+0000","last_active":"2024-09-22T08:39:32.259871+0000","last_peered":"2024-09-22T08:39:32.259871+0000","last_clean":"2024-09-22T08:39:32.259871+0000","last_became_active":"2024-09-22T08:36:25.989711+0000","last_became_peered":"2024-09-22T08:36:25.989711+0000","last_unstale":"2024-09-22T08:39:32.259871+0000","last_undegraded":"2024-09-22T08:39:32.259871+0000","last_fullsized":"2024-09-22T08:39:32.259871+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:59:02.745529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.226013+0000","last_change":"2024-09-22T08:36:23.976596+0000","last_active":"2024-09-22T08:37:04.226013+0000","last_peered":"2024-09-22T08:37:04.226013+0000","last_clean":"2024-09-22T08:37:04.226013+0000","last_became_active":"2024-09-22T08:36:23.976361+0000","last_became_peered":"2024-09-22T08:36:23.976361+0000","last_unstale":"2024-09-22T08:37:04.226013+0000","last_undegraded":"2024-09-22T08:37:04.226013+0000","last_fullsized":"2024-09-22T08:37:04.226013+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:18:29.806715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.226375+0000","last_change":"2024-09-22T08:36:27.988289+0000","last_active":"2024-09-22T08:37:04.226375+0000","last_peered":"2024-09-22T08:37:04.226375+0000","last_clean":"2024-09-22T08:37:04.226375+0000","last_became_active":"2024-09-22T08:36:27.987981+0000","last_became_peered":"2024-09-22T08:36:27.987981+0000","last_unstale":"2024-09-22T08:37:04.226375+0000","last_undegraded":"2024-09-22T08:37:04.226375+0000","last_fullsized":"2024-09-22T08:37:04.226375+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_clean_scrub_stamp":"2024-09-22T08:36:26.962226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:43:32.535149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"32'55","reported_seq":112,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:03.181425+0000","last_change":"2024-09-22T08:36:29.990823+0000","last_active":"2024-09-22T08:39:03.181425+0000","last_peered":"2024-09-22T08:39:03.181425+0000","last_clean":"2024-09-22T08:39:03.181425+0000","last_became_active":"2024-09-22T08:36:29.990585+0000","last_became_peered":"2024-09-22T08:36:29.990585+0000","last_unstale":"2024-09-22T08:39:03.181425+0000","last_undegraded":"2024-09-22T08:39:03.181425+0000","last_fullsized":"2024-09-22T08:39:03.181425+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:09:56.176060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.226461+0000","last_change":"2024-09-22T08:36:32.007693+0000","last_active":"2024-09-22T08:37:04.226461+0000","last_peered":"2024-09-22T08:37:04.226461+0000","last_clean":"2024-09-22T08:37:04.226461+0000","last_became_active":"2024-09-22T08:36:32.007448+0000","last_became_peered":"2024-09-22T08:36:32.007448+0000","last_unstale":"2024-09-22T08:37:04.226461+0000","last_undegraded":"2024-09-22T08:37:04.226461+0000","last_fullsized":"2024-09-22T08:37:04.226461+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:30:19.529413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"32'16","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.263979+0000","last_change":"2024-09-22T08:36:34.017989+0000","last_active":"2024-09-22T08:39:32.263979+0000","last_peered":"2024-09-22T08:39:32.263979+0000","last_clean":"2024-09-22T08:39:32.263979+0000","last_became_active":"2024-09-22T08:36:34.017689+0000","last_became_peered":"2024-09-22T08:36:34.017689+0000","last_unstale":"2024-09-22T08:39:32.263979+0000","last_undegraded":"2024-09-22T08:39:32.263979+0000","last_fullsized":"2024-09-22T08:39:32.263979+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:59:28.875467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":21,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"32'2","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.260499+0000","last_change":"2024-09-22T08:36:25.978215+0000","last_active":"2024-09-22T08:39:32.260499+0000","last_peered":"2024-09-22T08:39:32.260499+0000","last_clean":"2024-09-22T08:39:32.260499+0000","last_became_active":"2024-09-22T08:36:25.977881+0000","last_became_peered":"2024-09-22T08:36:25.977881+0000","last_unstale":"2024-09-22T08:39:32.260499+0000","last_undegraded":"2024-09-22T08:39:32.260499+0000","last_fullsized":"2024-09-22T08:39:32.260499+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:49:05.012514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.221193+0000","last_change":"2024-09-22T08:36:23.975068+0000","last_active":"2024-09-22T08:37:04.221193+0000","last_peered":"2024-09-22T08:37:04.221193+0000","last_clean":"2024-09-22T08:37:04.221193+0000","last_became_active":"2024-09-22T08:36:23.974809+0000","last_became_peered":"2024-09-22T08:36:23.974809+0000","last_unstale":"2024-09-22T08:37:04.221193+0000","last_undegraded":"2024-09-22T08:37:04.221193+0000","last_fullsized":"2024-09-22T08:37:04.221193+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:07:03.805843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.228600+0000","last_change":"2024-09-22T08:36:27.987444+0000","last_active":"2024-09-22T08:37:04.228600+0000","last_peered":"2024-09-22T08:37:04.228600+0000","last_clean":"2024-09-22T08:37:04.228600+0000","last_became_active":"2024-09-22T08:36:27.986957+0000","last_became_peered":"2024-09-22T08:36:27.986957+0000","last_unstale":"2024-09-22T08:37:04.228600+0000","last_undegraded":"2024-09-22T08:37:04.228600+0000","last_fullsized":"2024-09-22T08:37:04.228600+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_clean_scrub_stamp":"2024-09-22T08:36:26.962226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:12:16.352882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"32'36","reported_seq":82,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:30.240401+0000","last_change":"2024-09-22T08:36:29.998426+0000","last_active":"2024-09-22T08:38:30.240401+0000","last_peered":"2024-09-22T08:38:30.240401+0000","last_clean":"2024-09-22T08:38:30.240401+0000","last_became_active":"2024-09-22T08:36:29.997527+0000","last_became_peered":"2024-09-22T08:36:29.997527+0000","last_unstale":"2024-09-22T08:38:30.240401+0000","last_undegraded":"2024-09-22T08:38:30.240401+0000","last_fullsized":"2024-09-22T08:38:30.240401+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:26:30.343603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.224280+0000","last_change":"2024-09-22T08:36:32.005672+0000","last_active":"2024-09-22T08:37:04.224280+0000","last_peered":"2024-09-22T08:37:04.224280+0000","last_clean":"2024-09-22T08:37:04.224280+0000","last_became_active":"2024-09-22T08:36:32.005383+0000","last_became_peered":"2024-09-22T08:36:32.005383+0000","last_unstale":"2024-09-22T08:37:04.224280+0000","last_undegraded":"2024-09-22T08:37:04.224280+0000","last_fullsized":"2024-09-22T08:37:04.224280+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:13:26.905617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.227134+0000","last_change":"2024-09-22T08:36:34.013499+0000","last_active":"2024-09-22T08:37:04.227134+0000","last_peered":"2024-09-22T08:37:04.227134+0000","last_clean":"2024-09-22T08:37:04.227134+0000","last_became_active":"2024-09-22T08:36:34.013204+0000","last_became_peered":"2024-09-22T08:36:34.013204+0000","last_unstale":"2024-09-22T08:37:04.227134+0000","last_undegraded":"2024-09-22T08:37:04.227134+0000","last_fullsized":"2024-09-22T08:37:04.227134+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:37:55.724456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"32'14","reported_seq":66,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.268386+0000","last_change":"2024-09-22T08:36:25.993915+0000","last_active":"2024-09-22T08:39:32.268386+0000","last_peered":"2024-09-22T08:39:32.268386+0000","last_clean":"2024-09-22T08:39:32.268386+0000","last_became_active":"2024-09-22T08:36:25.993170+0000","last_became_peered":"2024-09-22T08:36:25.993170+0000","last_unstale":"2024-09-22T08:39:32.268386+0000","last_undegraded":"2024-09-22T08:39:32.268386+0000","last_fullsized":"2024-09-22T08:39:32.268386+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:39:33.156873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":38,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.221803+0000","last_change":"2024-09-22T08:36:23.968477+0000","last_active":"2024-09-22T08:37:04.221803+0000","last_peered":"2024-09-22T08:37:04.221803+0000","last_clean":"2024-09-22T08:37:04.221803+0000","last_became_active":"2024-09-22T08:36:23.968207+0000","last_became_peered":"2024-09-22T08:36:23.968207+0000","last_unstale":"2024-09-22T08:37:04.221803+0000","last_undegraded":"2024-09-22T08:37:04.221803+0000","last_fullsized":"2024-09-22T08:37:04.221803+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:13:42.558254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.226357+0000","last_change":"2024-09-22T08:36:27.986023+0000","last_active":"2024-09-22T08:37:04.226357+0000","last_peered":"2024-09-22T08:37:04.226357+0000","last_clean":"2024-09-22T08:37:04.226357+0000","last_became_active":"2024-09-22T08:36:27.985679+0000","last_became_peered":"2024-09-22T08:36:27.985679+0000","last_unstale":"2024-09-22T08:37:04.226357+0000","last_undegraded":"2024-09-22T08:37:04.226357+0000","last_fullsized":"2024-09-22T08:37:04.226357+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_clean_scrub_stamp":"2024-09-22T08:36:26.962226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:14:11.716507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"32'32","reported_seq":76,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:30.258654+0000","last_change":"2024-09-22T08:36:29.994386+0000","last_active":"2024-09-22T08:38:30.258654+0000","last_peered":"2024-09-22T08:38:30.258654+0000","last_clean":"2024-09-22T08:38:30.258654+0000","last_became_active":"2024-09-22T08:36:29.994075+0000","last_became_peered":"2024-09-22T08:36:29.994075+0000","last_unstale":"2024-09-22T08:38:30.258654+0000","last_undegraded":"2024-09-22T08:38:30.258654+0000","last_fullsized":"2024-09-22T08:38:30.258654+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:01:51.899745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.225288+0000","last_change":"2024-09-22T08:36:32.005675+0000","last_active":"2024-09-22T08:37:04.225288+0000","last_peered":"2024-09-22T08:37:04.225288+0000","last_clean":"2024-09-22T08:37:04.225288+0000","last_became_active":"2024-09-22T08:36:32.005166+0000","last_became_peered":"2024-09-22T08:36:32.005166+0000","last_unstale":"2024-09-22T08:37:04.225288+0000","last_undegraded":"2024-09-22T08:37:04.225288+0000","last_fullsized":"2024-09-22T08:37:04.225288+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:04:54.919867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"32'7","reported_seq":25,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.093378+0000","last_change":"2024-09-22T08:36:34.014540+0000","last_active":"2024-09-22T08:39:32.093378+0000","last_peered":"2024-09-22T08:39:32.093378+0000","last_clean":"2024-09-22T08:39:32.093378+0000","last_became_active":"2024-09-22T08:36:34.014255+0000","last_became_peered":"2024-09-22T08:36:34.014255+0000","last_unstale":"2024-09-22T08:39:32.093378+0000","last_undegraded":"2024-09-22T08:39:32.093378+0000","last_fullsized":"2024-09-22T08:39:32.093378+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:47:25.081359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"32'4","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.078924+0000","last_change":"2024-09-22T08:36:25.978994+0000","last_active":"2024-09-22T08:39:32.078924+0000","last_peered":"2024-09-22T08:39:32.078924+0000","last_clean":"2024-09-22T08:39:32.078924+0000","last_became_active":"2024-09-22T08:36:25.978577+0000","last_became_peered":"2024-09-22T08:36:25.978577+0000","last_unstale":"2024-09-22T08:39:32.078924+0000","last_undegraded":"2024-09-22T08:39:32.078924+0000","last_fullsized":"2024-09-22T08:39:32.078924+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:02:49.260377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"32'2","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:08.164913+0000","last_change":"2024-09-22T08:37:04.226650+0000","last_active":"2024-09-22T08:37:08.164913+0000","last_peered":"2024-09-22T08:37:08.164913+0000","last_clean":"2024-09-22T08:37:08.164913+0000","last_became_active":"2024-09-22T08:37:04.226169+0000","last_became_peered":"2024-09-22T08:37:04.226169+0000","last_unstale":"2024-09-22T08:37:08.164913+0000","last_undegraded":"2024-09-22T08:37:08.164913+0000","last_fullsized":"2024-09-22T08:37:08.164913+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:34:07.480067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.223988+0000","last_change":"2024-09-22T08:36:27.990314+0000","last_active":"2024-09-22T08:37:04.223988+0000","last_peered":"2024-09-22T08:37:04.223988+0000","last_clean":"2024-09-22T08:37:04.223988+0000","last_became_active":"2024-09-22T08:36:27.990038+0000","last_became_peered":"2024-09-22T08:36:27.990038+0000","last_unstale":"2024-09-22T08:37:04.223988+0000","last_undegraded":"2024-09-22T08:37:04.223988+0000","last_fullsized":"2024-09-22T08:37:04.223988+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_clean_scrub_stamp":"2024-09-22T08:36:26.962226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:42:33.084977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"30'10","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.227216+0000","last_change":"2024-09-22T08:36:29.997480+0000","last_active":"2024-09-22T08:37:04.227216+0000","last_peered":"2024-09-22T08:37:04.227216+0000","last_clean":"2024-09-22T08:37:04.227216+0000","last_became_active":"2024-09-22T08:36:29.997179+0000","last_became_peered":"2024-09-22T08:36:29.997179+0000","last_unstale":"2024-09-22T08:37:04.227216+0000","last_undegraded":"2024-09-22T08:37:04.227216+0000","last_fullsized":"2024-09-22T08:37:04.227216+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:42:36.332989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"32'282","reported_seq":366,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:28.067529+0000","last_change":"2024-09-22T08:36:32.012171+0000","last_active":"2024-09-22T08:39:28.067529+0000","last_peered":"2024-09-22T08:39:28.067529+0000","last_clean":"2024-09-22T08:39:28.067529+0000","last_became_active":"2024-09-22T08:36:32.011870+0000","last_became_peered":"2024-09-22T08:36:32.011870+0000","last_unstale":"2024-09-22T08:39:28.067529+0000","last_undegraded":"2024-09-22T08:39:28.067529+0000","last_fullsized":"2024-09-22T08:39:28.067529+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:20:17.853772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"32'2","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.248674+0000","last_change":"2024-09-22T08:36:34.013756+0000","last_active":"2024-09-22T08:39:32.248674+0000","last_peered":"2024-09-22T08:39:32.248674+0000","last_clean":"2024-09-22T08:39:32.248674+0000","last_became_active":"2024-09-22T08:36:34.013380+0000","last_became_peered":"2024-09-22T08:36:34.013380+0000","last_unstale":"2024-09-22T08:39:32.248674+0000","last_undegraded":"2024-09-22T08:39:32.248674+0000","last_fullsized":"2024-09-22T08:39:32.248674+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:26:36.228816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"32'8","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:31.647867+0000","last_change":"2024-09-22T08:36:25.971626+0000","last_active":"2024-09-22T08:38:31.647867+0000","last_peered":"2024-09-22T08:38:31.647867+0000","last_clean":"2024-09-22T08:38:31.647867+0000","last_became_active":"2024-09-22T08:36:25.971327+0000","last_became_peered":"2024-09-22T08:36:25.971327+0000","last_unstale":"2024-09-22T08:38:31.647867+0000","last_undegraded":"2024-09-22T08:38:31.647867+0000","last_fullsized":"2024-09-22T08:38:31.647867+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:06:32.443392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.284576+0000","last_change":"2024-09-22T08:36:23.978262+0000","last_active":"2024-09-22T08:39:32.284576+0000","last_peered":"2024-09-22T08:39:32.284576+0000","last_clean":"2024-09-22T08:39:32.284576+0000","last_became_active":"2024-09-22T08:36:23.978006+0000","last_became_peered":"2024-09-22T08:36:23.978006+0000","last_unstale":"2024-09-22T08:39:32.284576+0000","last_undegraded":"2024-09-22T08:39:32.284576+0000","last_fullsized":"2024-09-22T08:39:32.284576+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:02:28.926834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.222677+0000","last_change":"2024-09-22T08:36:27.991045+0000","last_active":"2024-09-22T08:37:04.222677+0000","last_peered":"2024-09-22T08:37:04.222677+0000","last_clean":"2024-09-22T08:37:04.222677+0000","last_became_active":"2024-09-22T08:36:27.990729+0000","last_became_peered":"2024-09-22T08:36:27.990729+0000","last_unstale":"2024-09-22T08:37:04.222677+0000","last_undegraded":"2024-09-22T08:37:04.222677+0000","last_fullsized":"2024-09-22T08:37:04.222677+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_clean_scrub_stamp":"2024-09-22T08:36:26.962226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:27:20.880200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"32'36","reported_seq":82,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:30.230410+0000","last_change":"2024-09-22T08:36:29.987777+0000","last_active":"2024-09-22T08:38:30.230410+0000","last_peered":"2024-09-22T08:38:30.230410+0000","last_clean":"2024-09-22T08:38:30.230410+0000","last_became_active":"2024-09-22T08:36:29.987459+0000","last_became_peered":"2024-09-22T08:36:29.987459+0000","last_unstale":"2024-09-22T08:38:30.230410+0000","last_undegraded":"2024-09-22T08:38:30.230410+0000","last_fullsized":"2024-09-22T08:38:30.230410+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:30:17.280632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.222754+0000","last_change":"2024-09-22T08:36:32.003472+0000","last_active":"2024-09-22T08:37:04.222754+0000","last_peered":"2024-09-22T08:37:04.222754+0000","last_clean":"2024-09-22T08:37:04.222754+0000","last_became_active":"2024-09-22T08:36:32.003196+0000","last_became_peered":"2024-09-22T08:36:32.003196+0000","last_unstale":"2024-09-22T08:37:04.222754+0000","last_undegraded":"2024-09-22T08:37:04.222754+0000","last_fullsized":"2024-09-22T08:37:04.222754+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:42:54.487167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.223793+0000","last_change":"2024-09-22T08:36:34.016292+0000","last_active":"2024-09-22T08:37:04.223793+0000","last_peered":"2024-09-22T08:37:04.223793+0000","last_clean":"2024-09-22T08:37:04.223793+0000","last_became_active":"2024-09-22T08:36:34.015988+0000","last_became_peered":"2024-09-22T08:36:34.015988+0000","last_unstale":"2024-09-22T08:37:04.223793+0000","last_undegraded":"2024-09-22T08:37:04.223793+0000","last_fullsized":"2024-09-22T08:37:04.223793+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:16:42.030515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"32'4","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:31.648006+0000","last_change":"2024-09-22T08:36:25.972487+0000","last_active":"2024-09-22T08:38:31.648006+0000","last_peered":"2024-09-22T08:38:31.648006+0000","last_clean":"2024-09-22T08:38:31.648006+0000","last_became_active":"2024-09-22T08:36:25.972149+0000","last_became_peered":"2024-09-22T08:36:25.972149+0000","last_unstale":"2024-09-22T08:38:31.648006+0000","last_undegraded":"2024-09-22T08:38:31.648006+0000","last_fullsized":"2024-09-22T08:38:31.648006+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:06:31.006207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"32'1","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:58.187460+0000","last_change":"2024-09-22T08:36:23.983004+0000","last_active":"2024-09-22T08:38:58.187460+0000","last_peered":"2024-09-22T08:38:58.187460+0000","last_clean":"2024-09-22T08:38:58.187460+0000","last_became_active":"2024-09-22T08:36:23.982545+0000","last_became_peered":"2024-09-22T08:36:23.982545+0000","last_unstale":"2024-09-22T08:38:58.187460+0000","last_undegraded":"2024-09-22T08:38:58.187460+0000","last_fullsized":"2024-09-22T08:38:58.187460+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:02:24.513946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.225495+0000","last_change":"2024-09-22T08:36:27.989826+0000","last_active":"2024-09-22T08:37:04.225495+0000","last_peered":"2024-09-22T08:37:04.225495+0000","last_clean":"2024-09-22T08:37:04.225495+0000","last_became_active":"2024-09-22T08:36:27.989495+0000","last_became_peered":"2024-09-22T08:36:27.989495+0000","last_unstale":"2024-09-22T08:37:04.225495+0000","last_undegraded":"2024-09-22T08:37:04.225495+0000","last_fullsized":"2024-09-22T08:37:04.225495+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_clean_scrub_stamp":"2024-09-22T08:36:26.962226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:36:51.183212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"32'30","reported_seq":73,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:30.231982+0000","last_change":"2024-09-22T08:36:29.994337+0000","last_active":"2024-09-22T08:38:30.231982+0000","last_peered":"2024-09-22T08:38:30.231982+0000","last_clean":"2024-09-22T08:38:30.231982+0000","last_became_active":"2024-09-22T08:36:29.994101+0000","last_became_peered":"2024-09-22T08:36:29.994101+0000","last_unstale":"2024-09-22T08:38:30.231982+0000","last_undegraded":"2024-09-22T08:38:30.231982+0000","last_fullsized":"2024-09-22T08:38:30.231982+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:40:06.073383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.230375+0000","last_change":"2024-09-22T08:36:32.012960+0000","last_active":"2024-09-22T08:37:04.230375+0000","last_peered":"2024-09-22T08:37:04.230375+0000","last_clean":"2024-09-22T08:37:04.230375+0000","last_became_active":"2024-09-22T08:36:32.011811+0000","last_became_peered":"2024-09-22T08:36:32.011811+0000","last_unstale":"2024-09-22T08:37:04.230375+0000","last_undegraded":"2024-09-22T08:37:04.230375+0000","last_fullsized":"2024-09-22T08:37:04.230375+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:13:22.789596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"32'2","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:05.456749+0000","last_change":"2024-09-22T08:36:34.020146+0000","last_active":"2024-09-22T08:37:05.456749+0000","last_peered":"2024-09-22T08:37:05.456749+0000","last_clean":"2024-09-22T08:37:05.456749+0000","last_became_active":"2024-09-22T08:36:34.019866+0000","last_became_peered":"2024-09-22T08:36:34.019866+0000","last_unstale":"2024-09-22T08:37:05.456749+0000","last_undegraded":"2024-09-22T08:37:05.456749+0000","last_fullsized":"2024-09-22T08:37:05.456749+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:56:15.623151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:31.647295+0000","last_change":"2024-09-22T08:36:25.989899+0000","last_active":"2024-09-22T08:38:31.647295+0000","last_peered":"2024-09-22T08:38:31.647295+0000","last_clean":"2024-09-22T08:38:31.647295+0000","last_became_active":"2024-09-22T08:36:25.989572+0000","last_became_peered":"2024-09-22T08:36:25.989572+0000","last_unstale":"2024-09-22T08:38:31.647295+0000","last_undegraded":"2024-09-22T08:38:31.647295+0000","last_fullsized":"2024-09-22T08:38:31.647295+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:11:07.278941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.225893+0000","last_change":"2024-09-22T08:36:23.971403+0000","last_active":"2024-09-22T08:37:04.225893+0000","last_peered":"2024-09-22T08:37:04.225893+0000","last_clean":"2024-09-22T08:37:04.225893+0000","last_became_active":"2024-09-22T08:36:23.971012+0000","last_became_peered":"2024-09-22T08:36:23.971012+0000","last_unstale":"2024-09-22T08:37:04.225893+0000","last_undegraded":"2024-09-22T08:37:04.225893+0000","last_fullsized":"2024-09-22T08:37:04.225893+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:38:20.349572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.222066+0000","last_change":"2024-09-22T08:36:27.987755+0000","last_active":"2024-09-22T08:37:04.222066+0000","last_peered":"2024-09-22T08:37:04.222066+0000","last_clean":"2024-09-22T08:37:04.222066+0000","last_became_active":"2024-09-22T08:36:27.987504+0000","last_became_peered":"2024-09-22T08:36:27.987504+0000","last_unstale":"2024-09-22T08:37:04.222066+0000","last_undegraded":"2024-09-22T08:37:04.222066+0000","last_fullsized":"2024-09-22T08:37:04.222066+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_clean_scrub_stamp":"2024-09-22T08:36:26.962226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:39:03.985092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"32'26","reported_seq":67,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:30.256486+0000","last_change":"2024-09-22T08:36:29.998167+0000","last_active":"2024-09-22T08:38:30.256486+0000","last_peered":"2024-09-22T08:38:30.256486+0000","last_clean":"2024-09-22T08:38:30.256486+0000","last_became_active":"2024-09-22T08:36:29.997853+0000","last_became_peered":"2024-09-22T08:36:29.997853+0000","last_unstale":"2024-09-22T08:38:30.256486+0000","last_undegraded":"2024-09-22T08:38:30.256486+0000","last_fullsized":"2024-09-22T08:38:30.256486+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:34:13.019632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":23,"num_read_kb":19,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.227451+0000","last_change":"2024-09-22T08:36:32.012262+0000","last_active":"2024-09-22T08:37:04.227451+0000","last_peered":"2024-09-22T08:37:04.227451+0000","last_clean":"2024-09-22T08:37:04.227451+0000","last_became_active":"2024-09-22T08:36:32.011960+0000","last_became_peered":"2024-09-22T08:36:32.011960+0000","last_unstale":"2024-09-22T08:37:04.227451+0000","last_undegraded":"2024-09-22T08:37:04.227451+0000","last_fullsized":"2024-09-22T08:37:04.227451+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:58:25.357801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"32'16","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:30.267408+0000","last_change":"2024-09-22T08:36:34.018605+0000","last_active":"2024-09-22T08:38:30.267408+0000","last_peered":"2024-09-22T08:38:30.267408+0000","last_clean":"2024-09-22T08:38:30.267408+0000","last_became_active":"2024-09-22T08:36:34.018365+0000","last_became_peered":"2024-09-22T08:36:34.018365+0000","last_unstale":"2024-09-22T08:38:30.267408+0000","last_undegraded":"2024-09-22T08:38:30.267408+0000","last_fullsized":"2024-09-22T08:38:30.267408+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:01:49.722849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":96,"num_read_kb":76,"num_write":46,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"32'8","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.081475+0000","last_change":"2024-09-22T08:36:25.973362+0000","last_active":"2024-09-22T08:39:32.081475+0000","last_peered":"2024-09-22T08:39:32.081475+0000","last_clean":"2024-09-22T08:39:32.081475+0000","last_became_active":"2024-09-22T08:36:25.973089+0000","last_became_peered":"2024-09-22T08:36:25.973089+0000","last_unstale":"2024-09-22T08:39:32.081475+0000","last_undegraded":"2024-09-22T08:39:32.081475+0000","last_fullsized":"2024-09-22T08:39:32.081475+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:11:06.136833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.612779+0000","last_change":"2024-09-22T08:36:23.968591+0000","last_active":"2024-09-22T08:37:04.612779+0000","last_peered":"2024-09-22T08:37:04.612779+0000","last_clean":"2024-09-22T08:37:04.612779+0000","last_became_active":"2024-09-22T08:36:23.968249+0000","last_became_peered":"2024-09-22T08:36:23.968249+0000","last_unstale":"2024-09-22T08:37:04.612779+0000","last_undegraded":"2024-09-22T08:37:04.612779+0000","last_fullsized":"2024-09-22T08:37:04.612779+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:00:39.104995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"32'2","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:28.952357+0000","last_change":"2024-09-22T08:36:27.988537+0000","last_active":"2024-09-22T08:38:28.952357+0000","last_peered":"2024-09-22T08:38:28.952357+0000","last_clean":"2024-09-22T08:38:28.952357+0000","last_became_active":"2024-09-22T08:36:27.988262+0000","last_became_peered":"2024-09-22T08:36:27.988262+0000","last_unstale":"2024-09-22T08:38:28.952357+0000","last_undegraded":"2024-09-22T08:38:28.952357+0000","last_fullsized":"2024-09-22T08:38:28.952357+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_clean_scrub_stamp":"2024-09-22T08:36:26.962226+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:27:56.322995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"32'32","reported_seq":77,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:31.665631+0000","last_change":"2024-09-22T08:36:29.997925+0000","last_active":"2024-09-22T08:39:31.665631+0000","last_peered":"2024-09-22T08:39:31.665631+0000","last_clean":"2024-09-22T08:39:31.665631+0000","last_became_active":"2024-09-22T08:36:29.997231+0000","last_became_peered":"2024-09-22T08:36:29.997231+0000","last_unstale":"2024-09-22T08:39:31.665631+0000","last_undegraded":"2024-09-22T08:39:31.665631+0000","last_fullsized":"2024-09-22T08:39:31.665631+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:37:27.208598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.224156+0000","last_change":"2024-09-22T08:36:32.004965+0000","last_active":"2024-09-22T08:37:04.224156+0000","last_peered":"2024-09-22T08:37:04.224156+0000","last_clean":"2024-09-22T08:37:04.224156+0000","last_became_active":"2024-09-22T08:36:32.004365+0000","last_became_peered":"2024-09-22T08:36:32.004365+0000","last_unstale":"2024-09-22T08:37:04.224156+0000","last_undegraded":"2024-09-22T08:37:04.224156+0000","last_fullsized":"2024-09-22T08:37:04.224156+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:02:38.800242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"32'4","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:30.270088+0000","last_change":"2024-09-22T08:36:34.016625+0000","last_active":"2024-09-22T08:38:30.270088+0000","last_peered":"2024-09-22T08:38:30.270088+0000","last_clean":"2024-09-22T08:38:30.270088+0000","last_became_active":"2024-09-22T08:36:34.016106+0000","last_became_peered":"2024-09-22T08:36:34.016106+0000","last_unstale":"2024-09-22T08:38:30.270088+0000","last_undegraded":"2024-09-22T08:38:30.270088+0000","last_fullsized":"2024-09-22T08:38:30.270088+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:10:10.424019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"32'12","reported_seq":70,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.290031+0000","last_change":"2024-09-22T08:36:25.987436+0000","last_active":"2024-09-22T08:39:32.290031+0000","last_peered":"2024-09-22T08:39:32.290031+0000","last_clean":"2024-09-22T08:39:32.290031+0000","last_became_active":"2024-09-22T08:36:25.987161+0000","last_became_peered":"2024-09-22T08:36:25.987161+0000","last_unstale":"2024-09-22T08:39:32.290031+0000","last_undegraded":"2024-09-22T08:39:32.290031+0000","last_fullsized":"2024-09-22T08:39:32.290031+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:12:14.347452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.223210+0000","last_change":"2024-09-22T08:36:23.970780+0000","last_active":"2024-09-22T08:37:04.223210+0000","last_peered":"2024-09-22T08:37:04.223210+0000","last_clean":"2024-09-22T08:37:04.223210+0000","last_became_active":"2024-09-22T08:36:23.969515+0000","last_became_peered":"2024-09-22T08:36:23.969515+0000","last_unstale":"2024-09-22T08:37:04.223210+0000","last_undegraded":"2024-09-22T08:37:04.223210+0000","last_fullsized":"2024-09-22T08:37:04.223210+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:26:49.921857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"32'12","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:47.943562+0000","last_change":"2024-09-22T08:36:25.979243+0000","last_active":"2024-09-22T08:37:47.943562+0000","last_peered":"2024-09-22T08:37:47.943562+0000","last_clean":"2024-09-22T08:37:47.943562+0000","last_became_active":"2024-09-22T08:36:25.978679+0000","last_became_peered":"2024-09-22T08:36:25.978679+0000","last_unstale":"2024-09-22T08:37:47.943562+0000","last_undegraded":"2024-09-22T08:37:47.943562+0000","last_fullsized":"2024-09-22T08:37:47.943562+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:02:33.743436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.612648+0000","last_change":"2024-09-22T08:36:23.970625+0000","last_active":"2024-09-22T08:37:04.612648+0000","last_peered":"2024-09-22T08:37:04.612648+0000","last_clean":"2024-09-22T08:37:04.612648+0000","last_became_active":"2024-09-22T08:36:23.970218+0000","last_became_peered":"2024-09-22T08:36:23.970218+0000","last_unstale":"2024-09-22T08:37:04.612648+0000","last_undegraded":"2024-09-22T08:37:04.612648+0000","last_fullsized":"2024-09-22T08:37:04.612648+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:19:30.438078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"32'12","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.079200+0000","last_change":"2024-09-22T08:36:25.991808+0000","last_active":"2024-09-22T08:39:32.079200+0000","last_peered":"2024-09-22T08:39:32.079200+0000","last_clean":"2024-09-22T08:39:32.079200+0000","last_became_active":"2024-09-22T08:36:25.989638+0000","last_became_peered":"2024-09-22T08:36:25.989638+0000","last_unstale":"2024-09-22T08:39:32.079200+0000","last_undegraded":"2024-09-22T08:39:32.079200+0000","last_fullsized":"2024-09-22T08:39:32.079200+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:50:01.017587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":33,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.228337+0000","last_change":"2024-09-22T08:36:23.973468+0000","last_active":"2024-09-22T08:37:04.228337+0000","last_peered":"2024-09-22T08:37:04.228337+0000","last_clean":"2024-09-22T08:37:04.228337+0000","last_became_active":"2024-09-22T08:36:23.972582+0000","last_became_peered":"2024-09-22T08:36:23.972582+0000","last_unstale":"2024-09-22T08:37:04.228337+0000","last_undegraded":"2024-09-22T08:37:04.228337+0000","last_fullsized":"2024-09-22T08:37:04.228337+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:49:03.488783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.224675+0000","last_change":"2024-09-22T08:36:25.978968+0000","last_active":"2024-09-22T08:37:04.224675+0000","last_peered":"2024-09-22T08:37:04.224675+0000","last_clean":"2024-09-22T08:37:04.224675+0000","last_became_active":"2024-09-22T08:36:25.978538+0000","last_became_peered":"2024-09-22T08:36:25.978538+0000","last_unstale":"2024-09-22T08:37:04.224675+0000","last_undegraded":"2024-09-22T08:37:04.224675+0000","last_fullsized":"2024-09-22T08:37:04.224675+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:36:39.596571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.224450+0000","last_change":"2024-09-22T08:36:23.974287+0000","last_active":"2024-09-22T08:37:04.224450+0000","last_peered":"2024-09-22T08:37:04.224450+0000","last_clean":"2024-09-22T08:37:04.224450+0000","last_became_active":"2024-09-22T08:36:23.973945+0000","last_became_peered":"2024-09-22T08:36:23.973945+0000","last_unstale":"2024-09-22T08:37:04.224450+0000","last_undegraded":"2024-09-22T08:37:04.224450+0000","last_fullsized":"2024-09-22T08:37:04.224450+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:15:18.572430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:47.943513+0000","last_change":"2024-09-22T08:36:25.984379+0000","last_active":"2024-09-22T08:37:47.943513+0000","last_peered":"2024-09-22T08:37:47.943513+0000","last_clean":"2024-09-22T08:37:47.943513+0000","last_became_active":"2024-09-22T08:36:25.984094+0000","last_became_peered":"2024-09-22T08:36:25.984094+0000","last_unstale":"2024-09-22T08:37:47.943513+0000","last_undegraded":"2024-09-22T08:37:47.943513+0000","last_fullsized":"2024-09-22T08:37:47.943513+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:55:15.332178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.614002+0000","last_change":"2024-09-22T08:36:23.971443+0000","last_active":"2024-09-22T08:37:04.614002+0000","last_peered":"2024-09-22T08:37:04.614002+0000","last_clean":"2024-09-22T08:37:04.614002+0000","last_became_active":"2024-09-22T08:36:23.970920+0000","last_became_peered":"2024-09-22T08:36:23.970920+0000","last_unstale":"2024-09-22T08:37:04.614002+0000","last_undegraded":"2024-09-22T08:37:04.614002+0000","last_fullsized":"2024-09-22T08:37:04.614002+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:03:35.613648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"32'11","reported_seq":68,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.221583+0000","last_change":"2024-09-22T08:36:25.986221+0000","last_active":"2024-09-22T08:39:32.221583+0000","last_peered":"2024-09-22T08:39:32.221583+0000","last_clean":"2024-09-22T08:39:32.221583+0000","last_became_active":"2024-09-22T08:36:25.985965+0000","last_became_peered":"2024-09-22T08:36:25.985965+0000","last_unstale":"2024-09-22T08:39:32.221583+0000","last_undegraded":"2024-09-22T08:39:32.221583+0000","last_fullsized":"2024-09-22T08:39:32.221583+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:14:09.711077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":11,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.223827+0000","last_change":"2024-09-22T08:36:23.983975+0000","last_active":"2024-09-22T08:37:04.223827+0000","last_peered":"2024-09-22T08:37:04.223827+0000","last_clean":"2024-09-22T08:37:04.223827+0000","last_became_active":"2024-09-22T08:36:23.983722+0000","last_became_peered":"2024-09-22T08:36:23.983722+0000","last_unstale":"2024-09-22T08:37:04.223827+0000","last_undegraded":"2024-09-22T08:37:04.223827+0000","last_fullsized":"2024-09-22T08:37:04.223827+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:06:35.921272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"32'4","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.259710+0000","last_change":"2024-09-22T08:36:25.983403+0000","last_active":"2024-09-22T08:39:32.259710+0000","last_peered":"2024-09-22T08:39:32.259710+0000","last_clean":"2024-09-22T08:39:32.259710+0000","last_became_active":"2024-09-22T08:36:25.983061+0000","last_became_peered":"2024-09-22T08:36:25.983061+0000","last_unstale":"2024-09-22T08:39:32.259710+0000","last_undegraded":"2024-09-22T08:39:32.259710+0000","last_fullsized":"2024-09-22T08:39:32.259710+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:36:23.489851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.229632+0000","last_change":"2024-09-22T08:36:23.974503+0000","last_active":"2024-09-22T08:37:04.229632+0000","last_peered":"2024-09-22T08:37:04.229632+0000","last_clean":"2024-09-22T08:37:04.229632+0000","last_became_active":"2024-09-22T08:36:23.973924+0000","last_became_peered":"2024-09-22T08:36:23.973924+0000","last_unstale":"2024-09-22T08:37:04.229632+0000","last_undegraded":"2024-09-22T08:37:04.229632+0000","last_fullsized":"2024-09-22T08:37:04.229632+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:29:02.171378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"32'18","reported_seq":79,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.259032+0000","last_change":"2024-09-22T08:36:25.979450+0000","last_active":"2024-09-22T08:39:32.259032+0000","last_peered":"2024-09-22T08:39:32.259032+0000","last_clean":"2024-09-22T08:39:32.259032+0000","last_became_active":"2024-09-22T08:36:25.979151+0000","last_became_peered":"2024-09-22T08:36:25.979151+0000","last_unstale":"2024-09-22T08:39:32.259032+0000","last_undegraded":"2024-09-22T08:39:32.259032+0000","last_fullsized":"2024-09-22T08:39:32.259032+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:36:49.177782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":64,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.225651+0000","last_change":"2024-09-22T08:36:23.970979+0000","last_active":"2024-09-22T08:37:04.225651+0000","last_peered":"2024-09-22T08:37:04.225651+0000","last_clean":"2024-09-22T08:37:04.225651+0000","last_became_active":"2024-09-22T08:36:23.970584+0000","last_became_peered":"2024-09-22T08:36:23.970584+0000","last_unstale":"2024-09-22T08:37:04.225651+0000","last_undegraded":"2024-09-22T08:37:04.225651+0000","last_fullsized":"2024-09-22T08:37:04.225651+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:36:27.840945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"32'16","reported_seq":89,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.081622+0000","last_change":"2024-09-22T08:36:25.979007+0000","last_active":"2024-09-22T08:39:32.081622+0000","last_peered":"2024-09-22T08:39:32.081622+0000","last_clean":"2024-09-22T08:39:32.081622+0000","last_became_active":"2024-09-22T08:36:25.978730+0000","last_became_peered":"2024-09-22T08:36:25.978730+0000","last_unstale":"2024-09-22T08:39:32.081622+0000","last_undegraded":"2024-09-22T08:39:32.081622+0000","last_fullsized":"2024-09-22T08:39:32.081622+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:17:07.393345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":70,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:31.490293+0000","last_change":"2024-09-22T08:36:23.973434+0000","last_active":"2024-09-22T08:38:31.490293+0000","last_peered":"2024-09-22T08:38:31.490293+0000","last_clean":"2024-09-22T08:38:31.490293+0000","last_became_active":"2024-09-22T08:36:23.973175+0000","last_became_peered":"2024-09-22T08:36:23.973175+0000","last_unstale":"2024-09-22T08:38:31.490293+0000","last_undegraded":"2024-09-22T08:38:31.490293+0000","last_fullsized":"2024-09-22T08:38:31.490293+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:49:52.164007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"32'6","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.289546+0000","last_change":"2024-09-22T08:36:25.991941+0000","last_active":"2024-09-22T08:39:32.289546+0000","last_peered":"2024-09-22T08:39:32.289546+0000","last_clean":"2024-09-22T08:39:32.289546+0000","last_became_active":"2024-09-22T08:36:25.991611+0000","last_became_peered":"2024-09-22T08:36:25.991611+0000","last_unstale":"2024-09-22T08:39:32.289546+0000","last_undegraded":"2024-09-22T08:39:32.289546+0000","last_fullsized":"2024-09-22T08:39:32.289546+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:09:42.836164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"32'6","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.202264+0000","last_change":"2024-09-22T08:36:23.974290+0000","last_active":"2024-09-22T08:39:32.202264+0000","last_peered":"2024-09-22T08:39:32.202264+0000","last_clean":"2024-09-22T08:39:32.202264+0000","last_became_active":"2024-09-22T08:36:23.973721+0000","last_became_peered":"2024-09-22T08:36:23.973721+0000","last_unstale":"2024-09-22T08:39:32.202264+0000","last_undegraded":"2024-09-22T08:39:32.202264+0000","last_fullsized":"2024-09-22T08:39:32.202264+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:03:35.497917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4,"num_write":22,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"32'8","reported_seq":69,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:05.720316+0000","last_change":"2024-09-22T08:37:04.234401+0000","last_active":"2024-09-22T08:37:05.720316+0000","last_peered":"2024-09-22T08:37:05.720316+0000","last_clean":"2024-09-22T08:37:05.720316+0000","last_became_active":"2024-09-22T08:37:04.231342+0000","last_became_peered":"2024-09-22T08:37:04.231342+0000","last_unstale":"2024-09-22T08:37:05.720316+0000","last_undegraded":"2024-09-22T08:37:05.720316+0000","last_fullsized":"2024-09-22T08:37:05.720316+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:00:32.641067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.221634+0000","last_change":"2024-09-22T08:36:23.975576+0000","last_active":"2024-09-22T08:37:04.221634+0000","last_peered":"2024-09-22T08:37:04.221634+0000","last_clean":"2024-09-22T08:37:04.221634+0000","last_became_active":"2024-09-22T08:36:23.975352+0000","last_became_peered":"2024-09-22T08:36:23.975352+0000","last_unstale":"2024-09-22T08:37:04.221634+0000","last_undegraded":"2024-09-22T08:37:04.221634+0000","last_fullsized":"2024-09-22T08:37:04.221634+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:46:26.551014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.223362+0000","last_change":"2024-09-22T08:36:25.978610+0000","last_active":"2024-09-22T08:37:04.223362+0000","last_peered":"2024-09-22T08:37:04.223362+0000","last_clean":"2024-09-22T08:37:04.223362+0000","last_became_active":"2024-09-22T08:36:25.977732+0000","last_became_peered":"2024-09-22T08:36:25.977732+0000","last_unstale":"2024-09-22T08:37:04.223362+0000","last_undegraded":"2024-09-22T08:37:04.223362+0000","last_fullsized":"2024-09-22T08:37:04.223362+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:38:39.281465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.222399+0000","last_change":"2024-09-22T08:36:23.976230+0000","last_active":"2024-09-22T08:37:04.222399+0000","last_peered":"2024-09-22T08:37:04.222399+0000","last_clean":"2024-09-22T08:37:04.222399+0000","last_became_active":"2024-09-22T08:36:23.975986+0000","last_became_peered":"2024-09-22T08:36:23.975986+0000","last_unstale":"2024-09-22T08:37:04.222399+0000","last_undegraded":"2024-09-22T08:37:04.222399+0000","last_fullsized":"2024-09-22T08:37:04.222399+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:51:18.438115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"32'9","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.299156+0000","last_change":"2024-09-22T08:36:25.984592+0000","last_active":"2024-09-22T08:39:32.299156+0000","last_peered":"2024-09-22T08:39:32.299156+0000","last_clean":"2024-09-22T08:39:32.299156+0000","last_became_active":"2024-09-22T08:36:25.984258+0000","last_became_peered":"2024-09-22T08:36:25.984258+0000","last_unstale":"2024-09-22T08:39:32.299156+0000","last_undegraded":"2024-09-22T08:39:32.299156+0000","last_fullsized":"2024-09-22T08:39:32.299156+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:55:58.281586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.225389+0000","last_change":"2024-09-22T08:36:23.979781+0000","last_active":"2024-09-22T08:37:04.225389+0000","last_peered":"2024-09-22T08:37:04.225389+0000","last_clean":"2024-09-22T08:37:04.225389+0000","last_became_active":"2024-09-22T08:36:23.979548+0000","last_became_peered":"2024-09-22T08:36:23.979548+0000","last_unstale":"2024-09-22T08:37:04.225389+0000","last_undegraded":"2024-09-22T08:37:04.225389+0000","last_fullsized":"2024-09-22T08:37:04.225389+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:09:58.448384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"32'16","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:05.722031+0000","last_change":"2024-09-22T08:36:25.980204+0000","last_active":"2024-09-22T08:37:05.722031+0000","last_peered":"2024-09-22T08:37:05.722031+0000","last_clean":"2024-09-22T08:37:05.722031+0000","last_became_active":"2024-09-22T08:36:25.979965+0000","last_became_peered":"2024-09-22T08:36:25.979965+0000","last_unstale":"2024-09-22T08:37:05.722031+0000","last_undegraded":"2024-09-22T08:37:05.722031+0000","last_fullsized":"2024-09-22T08:37:05.722031+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:42:38.878214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":51,"num_write":22,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.199364+0000","last_change":"2024-09-22T08:36:23.978481+0000","last_active":"2024-09-22T08:39:32.199364+0000","last_peered":"2024-09-22T08:39:32.199364+0000","last_clean":"2024-09-22T08:39:32.199364+0000","last_became_active":"2024-09-22T08:36:23.978225+0000","last_became_peered":"2024-09-22T08:36:23.978225+0000","last_unstale":"2024-09-22T08:39:32.199364+0000","last_undegraded":"2024-09-22T08:39:32.199364+0000","last_fullsized":"2024-09-22T08:39:32.199364+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:22:28.702522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"32'6","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:31.994598+0000","last_change":"2024-09-22T08:36:25.990975+0000","last_active":"2024-09-22T08:39:31.994598+0000","last_peered":"2024-09-22T08:39:31.994598+0000","last_clean":"2024-09-22T08:39:31.994598+0000","last_became_active":"2024-09-22T08:36:25.990690+0000","last_became_peered":"2024-09-22T08:36:25.990690+0000","last_unstale":"2024-09-22T08:39:31.994598+0000","last_undegraded":"2024-09-22T08:39:31.994598+0000","last_fullsized":"2024-09-22T08:39:31.994598+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:09:20.176753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.229731+0000","last_change":"2024-09-22T08:36:23.974565+0000","last_active":"2024-09-22T08:37:04.229731+0000","last_peered":"2024-09-22T08:37:04.229731+0000","last_clean":"2024-09-22T08:37:04.229731+0000","last_became_active":"2024-09-22T08:36:23.973976+0000","last_became_peered":"2024-09-22T08:36:23.973976+0000","last_unstale":"2024-09-22T08:37:04.229731+0000","last_undegraded":"2024-09-22T08:37:04.229731+0000","last_fullsized":"2024-09-22T08:37:04.229731+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:58:35.337314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"32'2","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.289981+0000","last_change":"2024-09-22T08:36:25.976107+0000","last_active":"2024-09-22T08:39:32.289981+0000","last_peered":"2024-09-22T08:39:32.289981+0000","last_clean":"2024-09-22T08:39:32.289981+0000","last_became_active":"2024-09-22T08:36:25.975794+0000","last_became_peered":"2024-09-22T08:36:25.975794+0000","last_unstale":"2024-09-22T08:39:32.289981+0000","last_undegraded":"2024-09-22T08:39:32.289981+0000","last_fullsized":"2024-09-22T08:39:32.289981+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:38:51.254477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"32'1","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:48.185676+0000","last_change":"2024-09-22T08:36:23.982786+0000","last_active":"2024-09-22T08:38:48.185676+0000","last_peered":"2024-09-22T08:38:48.185676+0000","last_clean":"2024-09-22T08:38:48.185676+0000","last_became_active":"2024-09-22T08:36:23.982376+0000","last_became_peered":"2024-09-22T08:36:23.982376+0000","last_unstale":"2024-09-22T08:38:48.185676+0000","last_undegraded":"2024-09-22T08:38:48.185676+0000","last_fullsized":"2024-09-22T08:38:48.185676+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:18:02.522688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.226198+0000","last_change":"2024-09-22T08:36:23.979035+0000","last_active":"2024-09-22T08:37:04.226198+0000","last_peered":"2024-09-22T08:37:04.226198+0000","last_clean":"2024-09-22T08:37:04.226198+0000","last_became_active":"2024-09-22T08:36:23.978787+0000","last_became_peered":"2024-09-22T08:36:23.978787+0000","last_unstale":"2024-09-22T08:37:04.226198+0000","last_undegraded":"2024-09-22T08:37:04.226198+0000","last_fullsized":"2024-09-22T08:37:04.226198+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:59:46.639082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"32'8","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.081622+0000","last_change":"2024-09-22T08:36:25.979863+0000","last_active":"2024-09-22T08:39:32.081622+0000","last_peered":"2024-09-22T08:39:32.081622+0000","last_clean":"2024-09-22T08:39:32.081622+0000","last_became_active":"2024-09-22T08:36:25.979593+0000","last_became_peered":"2024-09-22T08:36:25.979593+0000","last_unstale":"2024-09-22T08:39:32.081622+0000","last_undegraded":"2024-09-22T08:39:32.081622+0000","last_fullsized":"2024-09-22T08:39:32.081622+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:44:30.975858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.223261+0000","last_change":"2024-09-22T08:36:23.974913+0000","last_active":"2024-09-22T08:37:04.223261+0000","last_peered":"2024-09-22T08:37:04.223261+0000","last_clean":"2024-09-22T08:37:04.223261+0000","last_became_active":"2024-09-22T08:36:23.974202+0000","last_became_peered":"2024-09-22T08:36:23.974202+0000","last_unstale":"2024-09-22T08:37:04.223261+0000","last_undegraded":"2024-09-22T08:37:04.223261+0000","last_fullsized":"2024-09-22T08:37:04.223261+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:39:58.245871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"32'13","reported_seq":78,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:50.182446+0000","last_change":"2024-09-22T08:37:04.240925+0000","last_active":"2024-09-22T08:38:50.182446+0000","last_peered":"2024-09-22T08:38:50.182446+0000","last_clean":"2024-09-22T08:38:50.182446+0000","last_became_active":"2024-09-22T08:37:04.233241+0000","last_became_peered":"2024-09-22T08:37:04.233241+0000","last_unstale":"2024-09-22T08:38:50.182446+0000","last_undegraded":"2024-09-22T08:38:50.182446+0000","last_fullsized":"2024-09-22T08:38:50.182446+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:13:02.072699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":47,"num_read_kb":43,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1549,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":690,"num_read_kb":658,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":267,"ondisk_log_size":267,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2256,"ondisk_log_size":2256,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":13385,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1402,"num_read_kb":1188,"num_write":531,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":286720,"data_stored":10826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1275,"ondisk_log_size":1275,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":961,"num_read_kb":961,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1672,"num_read_kb":1562,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":25805696,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":170,"num_read_kb":83,"num_write":309,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":51617792,"data_stored":51611392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":128,"acting":128,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":11,"seq":47244640302,"num_pgs":124,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":57420,"kb_used_data":22076,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94314420,"statfs":{"total":96636764160,"available":96577966080,"internally_reserved":0,"allocated":22605824,"data_stored":22337537,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640302,"num_pgs":119,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40424,"kb_used_data":5080,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94331416,"statfs":{"total":96636764160,"available":96595369984,"internally_reserved":0,"allocated":5201920,"data_stored":4920654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":9,"seq":38654705709,"num_pgs":152,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":64540,"kb_used_data":25036,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94307300,"statfs":{"total":96636764160,"available":96570675200,"internally_reserved":0,"allocated":25636864,"data_stored":25305602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705709,"num_pgs":135,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40544,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331296,"statfs":{"total":96636764160,"available":96595247104,"internally_reserved":0,"allocated":1064960,"data_stored":775085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":643072,"data_stored":639872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4194304,"data_stored":4194304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":21614592,"data_stored":21611392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":25165824,"data_stored":25165824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":325,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":4269,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":421,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T08:39:39.347 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T08:39:39.479 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:39.478+0000 7f79ae808640 1 Processor -- start 2024-09-22T08:39:39.479 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:39.478+0000 7f79ae808640 1 -- start start 2024-09-22T08:39:39.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:39.478+0000 7f79ae808640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f79a8071e30 0x7f79a8132790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:39:39.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:39.478+0000 7f79ae808640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f79a8071770 con 0x7f79a806e170 2024-09-22T08:39:39.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:39.478+0000 7f79ae808640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f79a8099ee0 con 0x7f79a8071e30 2024-09-22T08:39:39.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:39.478+0000 7f79a77fe640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f79a8071e30 0x7f79a8132790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:39:39.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:39.478+0000 7f79a7fff640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f79a806e170 0x7f79a806e550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:60588/0 (socket says 172.21.15.31:60588) 2024-09-22T08:39:39.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:39.478+0000 7f79a7fff640 1 -- 172.21.15.31:0/2024320263 learned_addr learned my addr 172.21.15.31:0/2024320263 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-22T08:39:39.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:39.479+0000 7f79a77fe640 1 -- 172.21.15.31:0/2024320263 >> v1:172.21.15.31:6789/0 conn(0x7f79a806e170 legacy=0x7f79a806e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:39:39.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:39.479+0000 7f79a77fe640 1 -- 172.21.15.31:0/2024320263 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79a8072530 con 0x7f79a8071e30 2024-09-22T08:39:39.481 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:39.479+0000 7f79a77fe640 1 --2- 172.21.15.31:0/2024320263 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f79a8071e30 0x7f79a8132790 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f799c009750 tx=0x7f799c02a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=124186b04edd94e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:39:39.481 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:39.479+0000 7f79a6ffd640 1 -- 172.21.15.31:0/2024320263 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f799c037070 con 0x7f79a8071e30 2024-09-22T08:39:39.481 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:39.479+0000 7f79a6ffd640 1 -- 172.21.15.31:0/2024320263 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f799c02ad80 con 0x7f79a8071e30 2024-09-22T08:39:39.481 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:39.479+0000 7f79a6ffd640 1 -- 172.21.15.31:0/2024320263 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f799c032590 con 0x7f79a8071e30 2024-09-22T08:39:39.481 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:39.480+0000 7f79ae808640 1 -- 172.21.15.31:0/2024320263 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f79a8071e30 msgr2=0x7f79a8132790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:39:39.481 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:39.480+0000 7f79ae808640 1 --2- 172.21.15.31:0/2024320263 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f79a8071e30 0x7f79a8132790 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f799c009750 tx=0x7f799c02a140 comp rx=0 tx=0).stop 2024-09-22T08:39:39.482 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:39.480+0000 7f79ae808640 1 -- 172.21.15.31:0/2024320263 shutdown_connections 2024-09-22T08:39:39.482 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:39.480+0000 7f79ae808640 1 --2- 172.21.15.31:0/2024320263 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f79a8071e30 0x7f79a8132790 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:39:39.482 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:39.480+0000 7f79ae808640 1 -- 172.21.15.31:0/2024320263 >> 172.21.15.31:0/2024320263 conn(0x7f79a809ac80 msgr2=0x7f79a8098550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:39:39.482 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:39.480+0000 7f79ae808640 1 -- 172.21.15.31:0/2024320263 shutdown_connections 2024-09-22T08:39:39.482 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:39.480+0000 7f79ae808640 1 -- 172.21.15.31:0/2024320263 wait complete. 2024-09-22T08:39:39.483 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:39.481+0000 7f79ae808640 1 Processor -- start 2024-09-22T08:39:39.483 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:39.481+0000 7f79ae808640 1 -- start start 2024-09-22T08:39:39.483 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:39.481+0000 7f79ae808640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f79a806e170 0x7f79a81250f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:39:39.483 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:39.481+0000 7f79ae808640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f79a806ee70 con 0x7f79a806e170 2024-09-22T08:39:39.483 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:39.481+0000 7f79a7fff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f79a806e170 0x7f79a81250f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:39:39.484 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:39.481+0000 7f79a7fff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f79a806e170 0x7f79a81250f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:48194/0 (socket says 172.21.15.31:48194) 2024-09-22T08:39:39.484 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:39.481+0000 7f79a7fff640 1 -- 172.21.15.31:0/3809535891 learned_addr learned my addr 172.21.15.31:0/3809535891 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-22T08:39:39.484 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:39.482+0000 7f79a7fff640 1 -- 172.21.15.31:0/3809535891 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79a8074170 con 0x7f79a806e170 2024-09-22T08:39:39.484 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:39.482+0000 7f79a7fff640 1 --2- 172.21.15.31:0/3809535891 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f79a806e170 0x7f79a81250f0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f799800c450 tx=0x7f799800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:39:39.484 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:39.482+0000 7f79a4ff9640 1 -- 172.21.15.31:0/3809535891 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7998017070 con 0x7f79a806e170 2024-09-22T08:39:39.484 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:39.482+0000 7f79a4ff9640 1 -- 172.21.15.31:0/3809535891 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7998005c10 con 0x7f79a806e170 2024-09-22T08:39:39.484 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:39.482+0000 7f79a4ff9640 1 -- 172.21.15.31:0/3809535891 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f79980070d0 con 0x7f79a806e170 2024-09-22T08:39:39.484 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:39.482+0000 7f79ae808640 1 -- 172.21.15.31:0/3809535891 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79a81279b0 con 0x7f79a806e170 2024-09-22T08:39:39.484 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:39.482+0000 7f79ae808640 1 -- 172.21.15.31:0/3809535891 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79a8125630 con 0x7f79a806e170 2024-09-22T08:39:39.485 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:39.483+0000 7f79ae808640 1 -- 172.21.15.31:0/3809535891 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79a806e550 con 0x7f79a806e170 2024-09-22T08:39:39.485 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:39.483+0000 7f79a4ff9640 1 -- 172.21.15.31:0/3809535891 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f799801a070 con 0x7f79a806e170 2024-09-22T08:39:39.485 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:39.483+0000 7f79a4ff9640 1 --2- 172.21.15.31:0/3809535891 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f799403e710 0x7f7994040bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:39:39.485 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:39.483+0000 7f79a4ff9640 1 -- 172.21.15.31:0/3809535891 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5938+0+0 (secure 0 0 0) 0x7f7998052a30 con 0x7f79a806e170 2024-09-22T08:39:39.485 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:39.484+0000 7f79a77fe640 1 --2- 172.21.15.31:0/3809535891 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f799403e710 0x7f7994040bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:39:39.485 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:39.484+0000 7f79a77fe640 1 --2- 172.21.15.31:0/3809535891 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f799403e710 0x7f7994040bd0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f799c034000 tx=0x7f799c02e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:39:39.489 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:39.488+0000 7f79a4ff9640 1 -- 172.21.15.31:0/3809535891 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f799801ad80 con 0x7f79a806e170 2024-09-22T08:39:39.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:39.671+0000 7f79ae808640 1 -- 172.21.15.31:0/3809535891 --> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f79a8126880 con 0x7f799403e710 2024-09-22T08:39:39.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:39.681+0000 7f79a4ff9640 1 -- 172.21.15.31:0/3809535891 <== mgr.4099 v2:172.21.15.142:6824/99931088 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665590 (secure 0 0 0) 0x7f79a8126880 con 0x7f799403e710 2024-09-22T08:39:39.690 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-22T08:39:39.695 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2024-09-22T08:39:39.697 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:39.686+0000 7f79ae808640 1 -- 172.21.15.31:0/3809535891 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f799403e710 msgr2=0x7f7994040bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:39:39.697 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:39.686+0000 7f79ae808640 1 --2- 172.21.15.31:0/3809535891 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f799403e710 0x7f7994040bd0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f799c034000 tx=0x7f799c02e000 comp rx=0 tx=0).stop 2024-09-22T08:39:39.697 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:39.686+0000 7f79ae808640 1 -- 172.21.15.31:0/3809535891 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f79a806e170 msgr2=0x7f79a81250f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:39:39.697 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:39.686+0000 7f79ae808640 1 --2- 172.21.15.31:0/3809535891 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f79a806e170 0x7f79a81250f0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f799800c450 tx=0x7f799800c910 comp rx=0 tx=0).stop 2024-09-22T08:39:39.698 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:39.686+0000 7f79ae808640 1 -- 172.21.15.31:0/3809535891 shutdown_connections 2024-09-22T08:39:39.698 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:39.686+0000 7f79ae808640 1 --2- 172.21.15.31:0/3809535891 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f799403e710 0x7f7994040bd0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:39:39.698 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:39.686+0000 7f79ae808640 1 --2- 172.21.15.31:0/3809535891 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f79a806e170 0x7f79a81250f0 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:39:39.698 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:39.686+0000 7f79ae808640 1 -- 172.21.15.31:0/3809535891 >> 172.21.15.31:0/3809535891 conn(0x7f79a809ac80 msgr2=0x7f79a8097280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:39:39.698 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:39.687+0000 7f79ae808640 1 -- 172.21.15.31:0/3809535891 shutdown_connections 2024-09-22T08:39:39.698 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:39.687+0000 7f79ae808640 1 -- 172.21.15.31:0/3809535891 wait complete. 2024-09-22T08:39:39.699 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":135,"stamp":"2024-09-22T08:39:39.205490+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":26412817,"num_objects":229,"num_object_clones":0,"num_object_copies":458,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":229,"num_whiteouts":0,"num_read":4961,"num_read_kb":4507,"num_write":2048,"num_write_kb":60586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4434,"ondisk_log_size":4434,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":202928,"kb_used_data":53232,"kb_used_omap":6,"kb_used_meta":149625,"kb_avail":377284432,"statfs":{"total":386547056640,"available":386339258368,"internally_reserved":0,"allocated":54509568,"data_stored":53338878,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":153216790},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":25811688,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":534,"num_read_kb":477,"num_write":384,"num_write_kb":29371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003720"},"pg_stats":[{"pgid":"3.3f","version":"30'4","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.229185+0000","last_change":"2024-09-22T08:36:23.978702+0000","last_active":"2024-09-22T08:37:04.229185+0000","last_peered":"2024-09-22T08:37:04.229185+0000","last_clean":"2024-09-22T08:37:04.229185+0000","last_became_active":"2024-09-22T08:36:23.978473+0000","last_became_peered":"2024-09-22T08:36:23.978473+0000","last_unstale":"2024-09-22T08:37:04.229185+0000","last_undegraded":"2024-09-22T08:37:04.229185+0000","last_fullsized":"2024-09-22T08:37:04.229185+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:47:35.557013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":7,"num_write":20,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"30'4","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.221771+0000","last_change":"2024-09-22T08:36:25.982137+0000","last_active":"2024-09-22T08:37:04.221771+0000","last_peered":"2024-09-22T08:37:04.221771+0000","last_clean":"2024-09-22T08:37:04.221771+0000","last_became_active":"2024-09-22T08:36:25.981849+0000","last_became_peered":"2024-09-22T08:36:25.981849+0000","last_unstale":"2024-09-22T08:37:04.221771+0000","last_undegraded":"2024-09-22T08:37:04.221771+0000","last_fullsized":"2024-09-22T08:37:04.221771+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:15:58.403427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.225549+0000","last_change":"2024-09-22T08:36:23.973967+0000","last_active":"2024-09-22T08:37:04.225549+0000","last_peered":"2024-09-22T08:37:04.225549+0000","last_clean":"2024-09-22T08:37:04.225549+0000","last_became_active":"2024-09-22T08:36:23.973596+0000","last_became_peered":"2024-09-22T08:36:23.973596+0000","last_unstale":"2024-09-22T08:37:04.225549+0000","last_undegraded":"2024-09-22T08:37:04.225549+0000","last_fullsized":"2024-09-22T08:37:04.225549+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:25:55.158227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"32'2","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.081639+0000","last_change":"2024-09-22T08:36:25.992482+0000","last_active":"2024-09-22T08:39:32.081639+0000","last_peered":"2024-09-22T08:39:32.081639+0000","last_clean":"2024-09-22T08:39:32.081639+0000","last_became_active":"2024-09-22T08:36:25.992150+0000","last_became_peered":"2024-09-22T08:36:25.992150+0000","last_unstale":"2024-09-22T08:39:32.081639+0000","last_undegraded":"2024-09-22T08:39:32.081639+0000","last_fullsized":"2024-09-22T08:39:32.081639+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:39:29.442096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.232004+0000","last_change":"2024-09-22T08:36:23.983138+0000","last_active":"2024-09-22T08:37:04.232004+0000","last_peered":"2024-09-22T08:37:04.232004+0000","last_clean":"2024-09-22T08:37:04.232004+0000","last_became_active":"2024-09-22T08:36:23.982860+0000","last_became_peered":"2024-09-22T08:36:23.982860+0000","last_unstale":"2024-09-22T08:37:04.232004+0000","last_undegraded":"2024-09-22T08:37:04.232004+0000","last_fullsized":"2024-09-22T08:37:04.232004+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:22:39.595954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.228436+0000","last_change":"2024-09-22T08:36:25.992618+0000","last_active":"2024-09-22T08:37:04.228436+0000","last_peered":"2024-09-22T08:37:04.228436+0000","last_clean":"2024-09-22T08:37:04.228436+0000","last_became_active":"2024-09-22T08:36:25.992356+0000","last_became_peered":"2024-09-22T08:36:25.992356+0000","last_unstale":"2024-09-22T08:37:04.228436+0000","last_undegraded":"2024-09-22T08:37:04.228436+0000","last_fullsized":"2024-09-22T08:37:04.228436+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:54:42.310988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.225810+0000","last_change":"2024-09-22T08:36:23.967353+0000","last_active":"2024-09-22T08:37:04.225810+0000","last_peered":"2024-09-22T08:37:04.225810+0000","last_clean":"2024-09-22T08:37:04.225810+0000","last_became_active":"2024-09-22T08:36:23.967096+0000","last_became_peered":"2024-09-22T08:36:23.967096+0000","last_unstale":"2024-09-22T08:37:04.225810+0000","last_undegraded":"2024-09-22T08:37:04.225810+0000","last_fullsized":"2024-09-22T08:37:04.225810+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:22:30.703594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"32'22","reported_seq":95,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.214709+0000","last_change":"2024-09-22T08:36:25.989569+0000","last_active":"2024-09-22T08:39:32.214709+0000","last_peered":"2024-09-22T08:39:32.214709+0000","last_clean":"2024-09-22T08:39:32.214709+0000","last_became_active":"2024-09-22T08:36:25.989065+0000","last_became_peered":"2024-09-22T08:36:25.989065+0000","last_unstale":"2024-09-22T08:39:32.214709+0000","last_undegraded":"2024-09-22T08:39:32.214709+0000","last_fullsized":"2024-09-22T08:39:32.214709+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:18:58.915284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":82,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.229849+0000","last_change":"2024-09-22T08:36:23.979014+0000","last_active":"2024-09-22T08:37:04.229849+0000","last_peered":"2024-09-22T08:37:04.229849+0000","last_clean":"2024-09-22T08:37:04.229849+0000","last_became_active":"2024-09-22T08:36:23.978766+0000","last_became_peered":"2024-09-22T08:36:23.978766+0000","last_unstale":"2024-09-22T08:37:04.229849+0000","last_undegraded":"2024-09-22T08:37:04.229849+0000","last_fullsized":"2024-09-22T08:37:04.229849+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:46:08.557989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"32'8","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.215083+0000","last_change":"2024-09-22T08:36:25.979188+0000","last_active":"2024-09-22T08:39:32.215083+0000","last_peered":"2024-09-22T08:39:32.215083+0000","last_clean":"2024-09-22T08:39:32.215083+0000","last_became_active":"2024-09-22T08:36:25.978937+0000","last_became_peered":"2024-09-22T08:36:25.978937+0000","last_unstale":"2024-09-22T08:39:32.215083+0000","last_undegraded":"2024-09-22T08:39:32.215083+0000","last_fullsized":"2024-09-22T08:39:32.215083+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:36:02.118103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":23,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"32'4","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:05.711611+0000","last_change":"2024-09-22T08:36:23.967446+0000","last_active":"2024-09-22T08:37:05.711611+0000","last_peered":"2024-09-22T08:37:05.711611+0000","last_clean":"2024-09-22T08:37:05.711611+0000","last_became_active":"2024-09-22T08:36:23.967168+0000","last_became_peered":"2024-09-22T08:36:23.967168+0000","last_unstale":"2024-09-22T08:37:05.711611+0000","last_undegraded":"2024-09-22T08:37:05.711611+0000","last_fullsized":"2024-09-22T08:37:05.711611+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:51:18.438115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":10,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"32'6","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:48.130983+0000","last_change":"2024-09-22T08:36:25.992986+0000","last_active":"2024-09-22T08:37:48.130983+0000","last_peered":"2024-09-22T08:37:48.130983+0000","last_clean":"2024-09-22T08:37:48.130983+0000","last_became_active":"2024-09-22T08:36:25.990727+0000","last_became_peered":"2024-09-22T08:36:25.990727+0000","last_unstale":"2024-09-22T08:37:48.130983+0000","last_undegraded":"2024-09-22T08:37:48.130983+0000","last_fullsized":"2024-09-22T08:37:48.130983+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:05:42.869702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.228480+0000","last_change":"2024-09-22T08:36:23.980714+0000","last_active":"2024-09-22T08:37:04.228480+0000","last_peered":"2024-09-22T08:37:04.228480+0000","last_clean":"2024-09-22T08:37:04.228480+0000","last_became_active":"2024-09-22T08:36:23.980446+0000","last_became_peered":"2024-09-22T08:36:23.980446+0000","last_unstale":"2024-09-22T08:37:04.228480+0000","last_undegraded":"2024-09-22T08:37:04.228480+0000","last_fullsized":"2024-09-22T08:37:04.228480+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:18:20.665486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"32'8","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.289670+0000","last_change":"2024-09-22T08:36:25.982503+0000","last_active":"2024-09-22T08:39:32.289670+0000","last_peered":"2024-09-22T08:39:32.289670+0000","last_clean":"2024-09-22T08:39:32.289670+0000","last_became_active":"2024-09-22T08:36:25.982217+0000","last_became_peered":"2024-09-22T08:36:25.982217+0000","last_unstale":"2024-09-22T08:39:32.289670+0000","last_undegraded":"2024-09-22T08:39:32.289670+0000","last_fullsized":"2024-09-22T08:39:32.289670+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:38:39.281465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":27,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:31.512962+0000","last_change":"2024-09-22T08:36:23.978037+0000","last_active":"2024-09-22T08:38:31.512962+0000","last_peered":"2024-09-22T08:38:31.512962+0000","last_clean":"2024-09-22T08:38:31.512962+0000","last_became_active":"2024-09-22T08:36:23.977715+0000","last_became_peered":"2024-09-22T08:36:23.977715+0000","last_unstale":"2024-09-22T08:38:31.512962+0000","last_undegraded":"2024-09-22T08:38:31.512962+0000","last_fullsized":"2024-09-22T08:38:31.512962+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:43:08.069293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"32'7","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:30.181492+0000","last_change":"2024-09-22T08:36:25.975203+0000","last_active":"2024-09-22T08:38:30.181492+0000","last_peered":"2024-09-22T08:38:30.181492+0000","last_clean":"2024-09-22T08:38:30.181492+0000","last_became_active":"2024-09-22T08:36:25.974930+0000","last_became_peered":"2024-09-22T08:36:25.974930+0000","last_unstale":"2024-09-22T08:38:30.181492+0000","last_undegraded":"2024-09-22T08:38:30.181492+0000","last_fullsized":"2024-09-22T08:38:30.181492+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:14:58.055122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"32'3","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:48.185367+0000","last_change":"2024-09-22T08:36:25.992134+0000","last_active":"2024-09-22T08:38:48.185367+0000","last_peered":"2024-09-22T08:38:48.185367+0000","last_clean":"2024-09-22T08:38:48.185367+0000","last_became_active":"2024-09-22T08:36:25.991870+0000","last_became_peered":"2024-09-22T08:36:25.991870+0000","last_unstale":"2024-09-22T08:38:48.185367+0000","last_undegraded":"2024-09-22T08:38:48.185367+0000","last_fullsized":"2024-09-22T08:38:48.185367+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:22:14.904895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.224532+0000","last_change":"2024-09-22T08:36:23.977802+0000","last_active":"2024-09-22T08:37:04.224532+0000","last_peered":"2024-09-22T08:37:04.224532+0000","last_clean":"2024-09-22T08:37:04.224532+0000","last_became_active":"2024-09-22T08:36:23.977556+0000","last_became_peered":"2024-09-22T08:36:23.977556+0000","last_unstale":"2024-09-22T08:37:04.224532+0000","last_undegraded":"2024-09-22T08:37:04.224532+0000","last_fullsized":"2024-09-22T08:37:04.224532+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:29:17.802189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"32'14","reported_seq":72,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.290010+0000","last_change":"2024-09-22T08:36:25.977178+0000","last_active":"2024-09-22T08:39:32.290010+0000","last_peered":"2024-09-22T08:39:32.290010+0000","last_clean":"2024-09-22T08:39:32.290010+0000","last_became_active":"2024-09-22T08:36:25.976389+0000","last_became_peered":"2024-09-22T08:36:25.976389+0000","last_unstale":"2024-09-22T08:39:32.290010+0000","last_undegraded":"2024-09-22T08:39:32.290010+0000","last_fullsized":"2024-09-22T08:39:32.290010+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:33:17.028140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":49,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"32'1","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:50.183843+0000","last_change":"2024-09-22T08:36:23.974839+0000","last_active":"2024-09-22T08:38:50.183843+0000","last_peered":"2024-09-22T08:38:50.183843+0000","last_clean":"2024-09-22T08:38:50.183843+0000","last_became_active":"2024-09-22T08:36:23.974275+0000","last_became_peered":"2024-09-22T08:36:23.974275+0000","last_unstale":"2024-09-22T08:38:50.183843+0000","last_undegraded":"2024-09-22T08:38:50.183843+0000","last_fullsized":"2024-09-22T08:38:50.183843+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:00:39.104995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"32'12","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.343172+0000","last_change":"2024-09-22T08:36:25.977283+0000","last_active":"2024-09-22T08:39:32.343172+0000","last_peered":"2024-09-22T08:39:32.343172+0000","last_clean":"2024-09-22T08:39:32.343172+0000","last_became_active":"2024-09-22T08:36:25.977015+0000","last_became_peered":"2024-09-22T08:36:25.977015+0000","last_unstale":"2024-09-22T08:39:32.343172+0000","last_undegraded":"2024-09-22T08:39:32.343172+0000","last_fullsized":"2024-09-22T08:39:32.343172+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:25:20.428891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":43,"num_read_kb":39,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:05.096438+0000","last_change":"2024-09-22T08:36:23.984666+0000","last_active":"2024-09-22T08:37:05.096438+0000","last_peered":"2024-09-22T08:37:05.096438+0000","last_clean":"2024-09-22T08:37:05.096438+0000","last_became_active":"2024-09-22T08:36:23.984411+0000","last_became_peered":"2024-09-22T08:36:23.984411+0000","last_unstale":"2024-09-22T08:37:05.096438+0000","last_undegraded":"2024-09-22T08:37:05.096438+0000","last_fullsized":"2024-09-22T08:37:05.096438+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:22:30.703594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"32'2","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:28.582905+0000","last_change":"2024-09-22T08:36:25.984342+0000","last_active":"2024-09-22T08:38:28.582905+0000","last_peered":"2024-09-22T08:38:28.582905+0000","last_clean":"2024-09-22T08:38:28.582905+0000","last_became_active":"2024-09-22T08:36:25.984037+0000","last_became_peered":"2024-09-22T08:36:25.984037+0000","last_unstale":"2024-09-22T08:38:28.582905+0000","last_undegraded":"2024-09-22T08:38:28.582905+0000","last_fullsized":"2024-09-22T08:38:28.582905+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:08:22.313520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.613492+0000","last_change":"2024-09-22T08:36:23.969670+0000","last_active":"2024-09-22T08:37:04.613492+0000","last_peered":"2024-09-22T08:37:04.613492+0000","last_clean":"2024-09-22T08:37:04.613492+0000","last_became_active":"2024-09-22T08:36:23.969183+0000","last_became_peered":"2024-09-22T08:36:23.969183+0000","last_unstale":"2024-09-22T08:37:04.613492+0000","last_undegraded":"2024-09-22T08:37:04.613492+0000","last_fullsized":"2024-09-22T08:37:04.613492+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:27:04.674711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"32'18","reported_seq":67,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.214977+0000","last_change":"2024-09-22T08:36:25.986078+0000","last_active":"2024-09-22T08:39:32.214977+0000","last_peered":"2024-09-22T08:39:32.214977+0000","last_clean":"2024-09-22T08:39:32.214977+0000","last_became_active":"2024-09-22T08:36:25.985797+0000","last_became_peered":"2024-09-22T08:36:25.985797+0000","last_unstale":"2024-09-22T08:39:32.214977+0000","last_undegraded":"2024-09-22T08:39:32.214977+0000","last_fullsized":"2024-09-22T08:39:32.214977+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:55:58.281586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":61,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.205171+0000","last_change":"2024-09-22T08:36:23.974737+0000","last_active":"2024-09-22T08:39:32.205171+0000","last_peered":"2024-09-22T08:39:32.205171+0000","last_clean":"2024-09-22T08:39:32.205171+0000","last_became_active":"2024-09-22T08:36:23.974359+0000","last_became_peered":"2024-09-22T08:36:23.974359+0000","last_unstale":"2024-09-22T08:39:32.205171+0000","last_undegraded":"2024-09-22T08:39:32.205171+0000","last_fullsized":"2024-09-22T08:39:32.205171+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:27:54.535865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"32'16","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.296886+0000","last_change":"2024-09-22T08:36:25.978419+0000","last_active":"2024-09-22T08:39:32.296886+0000","last_peered":"2024-09-22T08:39:32.296886+0000","last_clean":"2024-09-22T08:39:32.296886+0000","last_became_active":"2024-09-22T08:36:25.977320+0000","last_became_peered":"2024-09-22T08:36:25.977320+0000","last_unstale":"2024-09-22T08:39:32.296886+0000","last_undegraded":"2024-09-22T08:39:32.296886+0000","last_fullsized":"2024-09-22T08:39:32.296886+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:45:06.683427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":49,"num_write":21,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"32'1","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:48.185452+0000","last_change":"2024-09-22T08:36:23.980577+0000","last_active":"2024-09-22T08:38:48.185452+0000","last_peered":"2024-09-22T08:38:48.185452+0000","last_clean":"2024-09-22T08:38:48.185452+0000","last_became_active":"2024-09-22T08:36:23.980189+0000","last_became_peered":"2024-09-22T08:36:23.980189+0000","last_unstale":"2024-09-22T08:38:48.185452+0000","last_undegraded":"2024-09-22T08:38:48.185452+0000","last_fullsized":"2024-09-22T08:38:48.185452+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:45:54.958427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"32'35","reported_seq":100,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.238012+0000","last_change":"2024-09-22T08:36:34.015950+0000","last_active":"2024-09-22T08:39:32.238012+0000","last_peered":"2024-09-22T08:39:32.238012+0000","last_clean":"2024-09-22T08:39:32.238012+0000","last_became_active":"2024-09-22T08:36:34.015696+0000","last_became_peered":"2024-09-22T08:36:34.015696+0000","last_unstale":"2024-09-22T08:39:32.238012+0000","last_undegraded":"2024-09-22T08:39:32.238012+0000","last_fullsized":"2024-09-22T08:39:32.238012+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:48:07.077185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":173,"num_read_kb":173,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"32'6","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.214715+0000","last_change":"2024-09-22T08:36:25.988079+0000","last_active":"2024-09-22T08:39:32.214715+0000","last_peered":"2024-09-22T08:39:32.214715+0000","last_clean":"2024-09-22T08:39:32.214715+0000","last_became_active":"2024-09-22T08:36:25.987811+0000","last_became_peered":"2024-09-22T08:36:25.987811+0000","last_unstale":"2024-09-22T08:39:32.214715+0000","last_undegraded":"2024-09-22T08:39:32.214715+0000","last_fullsized":"2024-09-22T08:39:32.214715+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:09:47.627357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.229385+0000","last_change":"2024-09-22T08:36:23.982670+0000","last_active":"2024-09-22T08:37:04.229385+0000","last_peered":"2024-09-22T08:37:04.229385+0000","last_clean":"2024-09-22T08:37:04.229385+0000","last_became_active":"2024-09-22T08:36:23.982423+0000","last_became_peered":"2024-09-22T08:36:23.982423+0000","last_unstale":"2024-09-22T08:37:04.229385+0000","last_undegraded":"2024-09-22T08:37:04.229385+0000","last_fullsized":"2024-09-22T08:37:04.229385+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:36:21.966120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.230626+0000","last_change":"2024-09-22T08:36:27.988469+0000","last_active":"2024-09-22T08:37:04.230626+0000","last_peered":"2024-09-22T08:37:04.230626+0000","last_clean":"2024-09-22T08:37:04.230626+0000","last_became_active":"2024-09-22T08:36:27.988057+0000","last_became_peered":"2024-09-22T08:36:27.988057+0000","last_unstale":"2024-09-22T08:37:04.230626+0000","last_undegraded":"2024-09-22T08:37:04.230626+0000","last_fullsized":"2024-09-22T08:37:04.230626+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_clean_scrub_stamp":"2024-09-22T08:36:26.962226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:51:33.578609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"32'30","reported_seq":73,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:30.249449+0000","last_change":"2024-09-22T08:36:29.995218+0000","last_active":"2024-09-22T08:38:30.249449+0000","last_peered":"2024-09-22T08:38:30.249449+0000","last_clean":"2024-09-22T08:38:30.249449+0000","last_became_active":"2024-09-22T08:36:29.994881+0000","last_became_peered":"2024-09-22T08:36:29.994881+0000","last_unstale":"2024-09-22T08:38:30.249449+0000","last_undegraded":"2024-09-22T08:38:30.249449+0000","last_fullsized":"2024-09-22T08:38:30.249449+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:46:41.834484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.223889+0000","last_change":"2024-09-22T08:36:32.013521+0000","last_active":"2024-09-22T08:37:04.223889+0000","last_peered":"2024-09-22T08:37:04.223889+0000","last_clean":"2024-09-22T08:37:04.223889+0000","last_became_active":"2024-09-22T08:36:32.013249+0000","last_became_peered":"2024-09-22T08:36:32.013249+0000","last_unstale":"2024-09-22T08:37:04.223889+0000","last_undegraded":"2024-09-22T08:37:04.223889+0000","last_fullsized":"2024-09-22T08:37:04.223889+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:35:20.008672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"32'7","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:47.949724+0000","last_change":"2024-09-22T08:36:34.015432+0000","last_active":"2024-09-22T08:37:47.949724+0000","last_peered":"2024-09-22T08:37:47.949724+0000","last_clean":"2024-09-22T08:37:47.949724+0000","last_became_active":"2024-09-22T08:36:34.015170+0000","last_became_peered":"2024-09-22T08:36:34.015170+0000","last_unstale":"2024-09-22T08:37:47.949724+0000","last_undegraded":"2024-09-22T08:37:47.949724+0000","last_fullsized":"2024-09-22T08:37:47.949724+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:45:21.601440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:48.129237+0000","last_change":"2024-09-22T08:36:25.989960+0000","last_active":"2024-09-22T08:37:48.129237+0000","last_peered":"2024-09-22T08:37:48.129237+0000","last_clean":"2024-09-22T08:37:48.129237+0000","last_became_active":"2024-09-22T08:36:25.989583+0000","last_became_peered":"2024-09-22T08:36:25.989583+0000","last_unstale":"2024-09-22T08:37:48.129237+0000","last_undegraded":"2024-09-22T08:37:48.129237+0000","last_fullsized":"2024-09-22T08:37:48.129237+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:42:22.082860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"32'1","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:45.183153+0000","last_change":"2024-09-22T08:36:23.973951+0000","last_active":"2024-09-22T08:38:45.183153+0000","last_peered":"2024-09-22T08:38:45.183153+0000","last_clean":"2024-09-22T08:38:45.183153+0000","last_became_active":"2024-09-22T08:36:23.973716+0000","last_became_peered":"2024-09-22T08:36:23.973716+0000","last_unstale":"2024-09-22T08:38:45.183153+0000","last_undegraded":"2024-09-22T08:38:45.183153+0000","last_fullsized":"2024-09-22T08:38:45.183153+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:06:35.921272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:05.167417+0000","last_change":"2024-09-22T08:37:04.229482+0000","last_active":"2024-09-22T08:37:05.167417+0000","last_peered":"2024-09-22T08:37:05.167417+0000","last_clean":"2024-09-22T08:37:05.167417+0000","last_became_active":"2024-09-22T08:37:04.229132+0000","last_became_peered":"2024-09-22T08:37:04.229132+0000","last_unstale":"2024-09-22T08:37:05.167417+0000","last_undegraded":"2024-09-22T08:37:05.167417+0000","last_fullsized":"2024-09-22T08:37:05.167417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_clean_scrub_stamp":"2024-09-22T08:36:26.962226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:30:09.128950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"30'6","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.223977+0000","last_change":"2024-09-22T08:36:29.991280+0000","last_active":"2024-09-22T08:37:04.223977+0000","last_peered":"2024-09-22T08:37:04.223977+0000","last_clean":"2024-09-22T08:37:04.223977+0000","last_became_active":"2024-09-22T08:36:29.990998+0000","last_became_peered":"2024-09-22T08:36:29.990998+0000","last_unstale":"2024-09-22T08:37:04.223977+0000","last_undegraded":"2024-09-22T08:37:04.223977+0000","last_fullsized":"2024-09-22T08:37:04.223977+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:36:37.998945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.222725+0000","last_change":"2024-09-22T08:36:32.006443+0000","last_active":"2024-09-22T08:37:04.222725+0000","last_peered":"2024-09-22T08:37:04.222725+0000","last_clean":"2024-09-22T08:37:04.222725+0000","last_became_active":"2024-09-22T08:36:32.006161+0000","last_became_peered":"2024-09-22T08:36:32.006161+0000","last_unstale":"2024-09-22T08:37:04.222725+0000","last_undegraded":"2024-09-22T08:37:04.222725+0000","last_fullsized":"2024-09-22T08:37:04.222725+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:39:07.614953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"30'2","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.223331+0000","last_change":"2024-09-22T08:36:34.017093+0000","last_active":"2024-09-22T08:37:04.223331+0000","last_peered":"2024-09-22T08:37:04.223331+0000","last_clean":"2024-09-22T08:37:04.223331+0000","last_became_active":"2024-09-22T08:36:34.016749+0000","last_became_peered":"2024-09-22T08:36:34.016749+0000","last_unstale":"2024-09-22T08:37:04.223331+0000","last_undegraded":"2024-09-22T08:37:04.223331+0000","last_fullsized":"2024-09-22T08:37:04.223331+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:18:00.649317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"32'7","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.088571+0000","last_change":"2024-09-22T08:36:25.988432+0000","last_active":"2024-09-22T08:39:32.088571+0000","last_peered":"2024-09-22T08:39:32.088571+0000","last_clean":"2024-09-22T08:39:32.088571+0000","last_became_active":"2024-09-22T08:36:25.987860+0000","last_became_peered":"2024-09-22T08:36:25.987860+0000","last_unstale":"2024-09-22T08:39:32.088571+0000","last_undegraded":"2024-09-22T08:39:32.088571+0000","last_fullsized":"2024-09-22T08:39:32.088571+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:07:23.439560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.228129+0000","last_change":"2024-09-22T08:36:23.979437+0000","last_active":"2024-09-22T08:37:04.228129+0000","last_peered":"2024-09-22T08:37:04.228129+0000","last_clean":"2024-09-22T08:37:04.228129+0000","last_became_active":"2024-09-22T08:36:23.979201+0000","last_became_peered":"2024-09-22T08:36:23.979201+0000","last_unstale":"2024-09-22T08:37:04.228129+0000","last_undegraded":"2024-09-22T08:37:04.228129+0000","last_fullsized":"2024-09-22T08:37:04.228129+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:05:30.127896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.226652+0000","last_change":"2024-09-22T08:36:27.987816+0000","last_active":"2024-09-22T08:37:04.226652+0000","last_peered":"2024-09-22T08:37:04.226652+0000","last_clean":"2024-09-22T08:37:04.226652+0000","last_became_active":"2024-09-22T08:36:27.987410+0000","last_became_peered":"2024-09-22T08:36:27.987410+0000","last_unstale":"2024-09-22T08:37:04.226652+0000","last_undegraded":"2024-09-22T08:37:04.226652+0000","last_fullsized":"2024-09-22T08:37:04.226652+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_clean_scrub_stamp":"2024-09-22T08:36:26.962226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:14:29.717295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"30'10","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.227501+0000","last_change":"2024-09-22T08:36:29.999655+0000","last_active":"2024-09-22T08:37:04.227501+0000","last_peered":"2024-09-22T08:37:04.227501+0000","last_clean":"2024-09-22T08:37:04.227501+0000","last_became_active":"2024-09-22T08:36:29.999306+0000","last_became_peered":"2024-09-22T08:36:29.999306+0000","last_unstale":"2024-09-22T08:37:04.227501+0000","last_undegraded":"2024-09-22T08:37:04.227501+0000","last_fullsized":"2024-09-22T08:37:04.227501+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:27:58.333399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"32'282","reported_seq":415,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.294718+0000","last_change":"2024-09-22T08:36:32.014175+0000","last_active":"2024-09-22T08:39:32.294718+0000","last_peered":"2024-09-22T08:39:32.294718+0000","last_clean":"2024-09-22T08:39:32.294718+0000","last_became_active":"2024-09-22T08:36:32.013869+0000","last_became_peered":"2024-09-22T08:36:32.013869+0000","last_unstale":"2024-09-22T08:39:32.294718+0000","last_undegraded":"2024-09-22T08:39:32.294718+0000","last_fullsized":"2024-09-22T08:39:32.294718+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:23:53.788685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.224121+0000","last_change":"2024-09-22T08:36:34.016273+0000","last_active":"2024-09-22T08:37:04.224121+0000","last_peered":"2024-09-22T08:37:04.224121+0000","last_clean":"2024-09-22T08:37:04.224121+0000","last_became_active":"2024-09-22T08:36:34.015999+0000","last_became_peered":"2024-09-22T08:36:34.015999+0000","last_unstale":"2024-09-22T08:37:04.224121+0000","last_undegraded":"2024-09-22T08:37:04.224121+0000","last_fullsized":"2024-09-22T08:37:04.224121+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:19:59.334082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"30'4","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.226266+0000","last_change":"2024-09-22T08:36:25.979874+0000","last_active":"2024-09-22T08:37:04.226266+0000","last_peered":"2024-09-22T08:37:04.226266+0000","last_clean":"2024-09-22T08:37:04.226266+0000","last_became_active":"2024-09-22T08:36:25.979320+0000","last_became_peered":"2024-09-22T08:36:25.979320+0000","last_unstale":"2024-09-22T08:37:04.226266+0000","last_undegraded":"2024-09-22T08:37:04.226266+0000","last_fullsized":"2024-09-22T08:37:04.226266+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:22:30.226253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.221148+0000","last_change":"2024-09-22T08:36:23.975661+0000","last_active":"2024-09-22T08:37:04.221148+0000","last_peered":"2024-09-22T08:37:04.221148+0000","last_clean":"2024-09-22T08:37:04.221148+0000","last_became_active":"2024-09-22T08:36:23.975428+0000","last_became_peered":"2024-09-22T08:36:23.975428+0000","last_unstale":"2024-09-22T08:37:04.221148+0000","last_undegraded":"2024-09-22T08:37:04.221148+0000","last_fullsized":"2024-09-22T08:37:04.221148+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:09:41.970933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.227129+0000","last_change":"2024-09-22T08:36:27.985020+0000","last_active":"2024-09-22T08:37:04.227129+0000","last_peered":"2024-09-22T08:37:04.227129+0000","last_clean":"2024-09-22T08:37:04.227129+0000","last_became_active":"2024-09-22T08:36:27.984658+0000","last_became_peered":"2024-09-22T08:36:27.984658+0000","last_unstale":"2024-09-22T08:37:04.227129+0000","last_undegraded":"2024-09-22T08:37:04.227129+0000","last_fullsized":"2024-09-22T08:37:04.227129+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_clean_scrub_stamp":"2024-09-22T08:36:26.962226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:55:24.622399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"32'30","reported_seq":73,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:30.243330+0000","last_change":"2024-09-22T08:36:30.000958+0000","last_active":"2024-09-22T08:38:30.243330+0000","last_peered":"2024-09-22T08:38:30.243330+0000","last_clean":"2024-09-22T08:38:30.243330+0000","last_became_active":"2024-09-22T08:36:30.000641+0000","last_became_peered":"2024-09-22T08:36:30.000641+0000","last_unstale":"2024-09-22T08:38:30.243330+0000","last_undegraded":"2024-09-22T08:38:30.243330+0000","last_fullsized":"2024-09-22T08:38:30.243330+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:44:23.505173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"32'282","reported_seq":424,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.293167+0000","last_change":"2024-09-22T08:36:32.005447+0000","last_active":"2024-09-22T08:39:32.293167+0000","last_peered":"2024-09-22T08:39:32.293167+0000","last_clean":"2024-09-22T08:39:32.293167+0000","last_became_active":"2024-09-22T08:36:32.005012+0000","last_became_peered":"2024-09-22T08:36:32.005012+0000","last_unstale":"2024-09-22T08:39:32.293167+0000","last_undegraded":"2024-09-22T08:39:32.293167+0000","last_fullsized":"2024-09-22T08:39:32.293167+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:31:41.609654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"32'4","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:05.720809+0000","last_change":"2024-09-22T08:36:25.990731+0000","last_active":"2024-09-22T08:37:05.720809+0000","last_peered":"2024-09-22T08:37:05.720809+0000","last_clean":"2024-09-22T08:37:05.720809+0000","last_became_active":"2024-09-22T08:36:25.989940+0000","last_became_peered":"2024-09-22T08:36:25.989940+0000","last_unstale":"2024-09-22T08:37:05.720809+0000","last_undegraded":"2024-09-22T08:37:05.720809+0000","last_fullsized":"2024-09-22T08:37:05.720809+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:12:49.808186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.229286+0000","last_change":"2024-09-22T08:36:23.970335+0000","last_active":"2024-09-22T08:37:04.229286+0000","last_peered":"2024-09-22T08:37:04.229286+0000","last_clean":"2024-09-22T08:37:04.229286+0000","last_became_active":"2024-09-22T08:36:23.970093+0000","last_became_peered":"2024-09-22T08:36:23.970093+0000","last_unstale":"2024-09-22T08:37:04.229286+0000","last_undegraded":"2024-09-22T08:37:04.229286+0000","last_fullsized":"2024-09-22T08:37:04.229286+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:59:04.308788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.221669+0000","last_change":"2024-09-22T08:36:27.987025+0000","last_active":"2024-09-22T08:37:04.221669+0000","last_peered":"2024-09-22T08:37:04.221669+0000","last_clean":"2024-09-22T08:37:04.221669+0000","last_became_active":"2024-09-22T08:36:27.986734+0000","last_became_peered":"2024-09-22T08:36:27.986734+0000","last_unstale":"2024-09-22T08:37:04.221669+0000","last_undegraded":"2024-09-22T08:37:04.221669+0000","last_fullsized":"2024-09-22T08:37:04.221669+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_clean_scrub_stamp":"2024-09-22T08:36:26.962226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:17:49.747383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"32'40","reported_seq":88,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:30.253763+0000","last_change":"2024-09-22T08:36:29.991107+0000","last_active":"2024-09-22T08:38:30.253763+0000","last_peered":"2024-09-22T08:38:30.253763+0000","last_clean":"2024-09-22T08:38:30.253763+0000","last_became_active":"2024-09-22T08:36:29.990809+0000","last_became_peered":"2024-09-22T08:36:29.990809+0000","last_unstale":"2024-09-22T08:38:30.253763+0000","last_undegraded":"2024-09-22T08:38:30.253763+0000","last_fullsized":"2024-09-22T08:38:30.253763+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:58:25.003982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":44,"num_read_kb":33,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.224144+0000","last_change":"2024-09-22T08:36:32.004096+0000","last_active":"2024-09-22T08:37:04.224144+0000","last_peered":"2024-09-22T08:37:04.224144+0000","last_clean":"2024-09-22T08:37:04.224144+0000","last_became_active":"2024-09-22T08:36:32.003726+0000","last_became_peered":"2024-09-22T08:36:32.003726+0000","last_unstale":"2024-09-22T08:37:04.224144+0000","last_undegraded":"2024-09-22T08:37:04.224144+0000","last_fullsized":"2024-09-22T08:37:04.224144+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:58:37.810092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"32'5","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:48.125865+0000","last_change":"2024-09-22T08:36:34.022748+0000","last_active":"2024-09-22T08:37:48.125865+0000","last_peered":"2024-09-22T08:37:48.125865+0000","last_clean":"2024-09-22T08:37:48.125865+0000","last_became_active":"2024-09-22T08:36:34.022448+0000","last_became_peered":"2024-09-22T08:36:34.022448+0000","last_unstale":"2024-09-22T08:37:48.125865+0000","last_undegraded":"2024-09-22T08:37:48.125865+0000","last_fullsized":"2024-09-22T08:37:48.125865+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:39:09.622561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":13,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"32'10","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:31.647489+0000","last_change":"2024-09-22T08:36:25.976027+0000","last_active":"2024-09-22T08:38:31.647489+0000","last_peered":"2024-09-22T08:38:31.647489+0000","last_clean":"2024-09-22T08:38:31.647489+0000","last_became_active":"2024-09-22T08:36:25.975728+0000","last_became_peered":"2024-09-22T08:36:25.975728+0000","last_unstale":"2024-09-22T08:38:31.647489+0000","last_undegraded":"2024-09-22T08:38:31.647489+0000","last_fullsized":"2024-09-22T08:38:31.647489+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:22:27.923443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:31.959475+0000","last_change":"2024-09-22T08:36:23.969160+0000","last_active":"2024-09-22T08:39:31.959475+0000","last_peered":"2024-09-22T08:39:31.959475+0000","last_clean":"2024-09-22T08:39:31.959475+0000","last_became_active":"2024-09-22T08:36:23.968836+0000","last_became_peered":"2024-09-22T08:36:23.968836+0000","last_unstale":"2024-09-22T08:39:31.959475+0000","last_undegraded":"2024-09-22T08:39:31.959475+0000","last_fullsized":"2024-09-22T08:39:31.959475+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:24:33.546187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.223645+0000","last_change":"2024-09-22T08:36:27.987971+0000","last_active":"2024-09-22T08:37:04.223645+0000","last_peered":"2024-09-22T08:37:04.223645+0000","last_clean":"2024-09-22T08:37:04.223645+0000","last_became_active":"2024-09-22T08:36:27.987577+0000","last_became_peered":"2024-09-22T08:36:27.987577+0000","last_unstale":"2024-09-22T08:37:04.223645+0000","last_undegraded":"2024-09-22T08:37:04.223645+0000","last_fullsized":"2024-09-22T08:37:04.223645+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_clean_scrub_stamp":"2024-09-22T08:36:26.962226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:17:33.045316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"32'31","reported_seq":74,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:30.233003+0000","last_change":"2024-09-22T08:36:29.995394+0000","last_active":"2024-09-22T08:38:30.233003+0000","last_peered":"2024-09-22T08:38:30.233003+0000","last_clean":"2024-09-22T08:38:30.233003+0000","last_became_active":"2024-09-22T08:36:29.994921+0000","last_became_peered":"2024-09-22T08:36:29.994921+0000","last_unstale":"2024-09-22T08:38:30.233003+0000","last_undegraded":"2024-09-22T08:38:30.233003+0000","last_fullsized":"2024-09-22T08:38:30.233003+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:00:36.656901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.223384+0000","last_change":"2024-09-22T08:36:32.004634+0000","last_active":"2024-09-22T08:37:04.223384+0000","last_peered":"2024-09-22T08:37:04.223384+0000","last_clean":"2024-09-22T08:37:04.223384+0000","last_became_active":"2024-09-22T08:36:32.004269+0000","last_became_peered":"2024-09-22T08:36:32.004269+0000","last_unstale":"2024-09-22T08:37:04.223384+0000","last_undegraded":"2024-09-22T08:37:04.223384+0000","last_fullsized":"2024-09-22T08:37:04.223384+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:51:32.910644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"32'3","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:42.431386+0000","last_change":"2024-09-22T08:36:34.018431+0000","last_active":"2024-09-22T08:37:42.431386+0000","last_peered":"2024-09-22T08:37:42.431386+0000","last_clean":"2024-09-22T08:37:42.431386+0000","last_became_active":"2024-09-22T08:36:34.018190+0000","last_became_peered":"2024-09-22T08:36:34.018190+0000","last_unstale":"2024-09-22T08:37:42.431386+0000","last_undegraded":"2024-09-22T08:37:42.431386+0000","last_fullsized":"2024-09-22T08:37:42.431386+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:09:42.876400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"32'4","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.289565+0000","last_change":"2024-09-22T08:36:25.983379+0000","last_active":"2024-09-22T08:39:32.289565+0000","last_peered":"2024-09-22T08:39:32.289565+0000","last_clean":"2024-09-22T08:39:32.289565+0000","last_became_active":"2024-09-22T08:36:25.983073+0000","last_became_peered":"2024-09-22T08:36:25.983073+0000","last_unstale":"2024-09-22T08:39:32.289565+0000","last_undegraded":"2024-09-22T08:39:32.289565+0000","last_fullsized":"2024-09-22T08:39:32.289565+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:34:22.104673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:05.708471+0000","last_change":"2024-09-22T08:36:23.981302+0000","last_active":"2024-09-22T08:37:05.708471+0000","last_peered":"2024-09-22T08:37:05.708471+0000","last_clean":"2024-09-22T08:37:05.708471+0000","last_became_active":"2024-09-22T08:36:23.980682+0000","last_became_peered":"2024-09-22T08:36:23.980682+0000","last_unstale":"2024-09-22T08:37:05.708471+0000","last_undegraded":"2024-09-22T08:37:05.708471+0000","last_fullsized":"2024-09-22T08:37:05.708471+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:36:38.072840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.225234+0000","last_change":"2024-09-22T08:36:27.985983+0000","last_active":"2024-09-22T08:37:04.225234+0000","last_peered":"2024-09-22T08:37:04.225234+0000","last_clean":"2024-09-22T08:37:04.225234+0000","last_became_active":"2024-09-22T08:36:27.985675+0000","last_became_peered":"2024-09-22T08:36:27.985675+0000","last_unstale":"2024-09-22T08:37:04.225234+0000","last_undegraded":"2024-09-22T08:37:04.225234+0000","last_fullsized":"2024-09-22T08:37:04.225234+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_clean_scrub_stamp":"2024-09-22T08:36:26.962226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:18:38.325978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"32'38","reported_seq":84,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:43.184361+0000","last_change":"2024-09-22T08:36:29.998080+0000","last_active":"2024-09-22T08:38:43.184361+0000","last_peered":"2024-09-22T08:38:43.184361+0000","last_clean":"2024-09-22T08:38:43.184361+0000","last_became_active":"2024-09-22T08:36:29.997542+0000","last_became_peered":"2024-09-22T08:36:29.997542+0000","last_unstale":"2024-09-22T08:38:43.184361+0000","last_undegraded":"2024-09-22T08:38:43.184361+0000","last_fullsized":"2024-09-22T08:38:43.184361+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:42:31.088070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"32'282","reported_seq":348,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.405444+0000","last_change":"2024-09-22T08:36:32.005012+0000","last_active":"2024-09-22T08:39:32.405444+0000","last_peered":"2024-09-22T08:39:32.405444+0000","last_clean":"2024-09-22T08:39:32.405444+0000","last_became_active":"2024-09-22T08:36:32.004441+0000","last_became_peered":"2024-09-22T08:36:32.004441+0000","last_unstale":"2024-09-22T08:39:32.405444+0000","last_undegraded":"2024-09-22T08:39:32.405444+0000","last_fullsized":"2024-09-22T08:39:32.405444+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:10:54.748229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.225164+0000","last_change":"2024-09-22T08:36:34.017600+0000","last_active":"2024-09-22T08:37:04.225164+0000","last_peered":"2024-09-22T08:37:04.225164+0000","last_clean":"2024-09-22T08:37:04.225164+0000","last_became_active":"2024-09-22T08:36:34.017217+0000","last_became_peered":"2024-09-22T08:36:34.017217+0000","last_unstale":"2024-09-22T08:37:04.225164+0000","last_undegraded":"2024-09-22T08:37:04.225164+0000","last_fullsized":"2024-09-22T08:37:04.225164+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:43:08.076327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:47.943350+0000","last_change":"2024-09-22T08:36:25.972507+0000","last_active":"2024-09-22T08:37:47.943350+0000","last_peered":"2024-09-22T08:37:47.943350+0000","last_clean":"2024-09-22T08:37:47.943350+0000","last_became_active":"2024-09-22T08:36:25.972198+0000","last_became_peered":"2024-09-22T08:36:25.972198+0000","last_unstale":"2024-09-22T08:37:47.943350+0000","last_undegraded":"2024-09-22T08:37:47.943350+0000","last_fullsized":"2024-09-22T08:37:47.943350+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:41:22.703676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.224935+0000","last_change":"2024-09-22T08:36:23.978560+0000","last_active":"2024-09-22T08:37:04.224935+0000","last_peered":"2024-09-22T08:37:04.224935+0000","last_clean":"2024-09-22T08:37:04.224935+0000","last_became_active":"2024-09-22T08:36:23.978306+0000","last_became_peered":"2024-09-22T08:36:23.978306+0000","last_unstale":"2024-09-22T08:37:04.224935+0000","last_undegraded":"2024-09-22T08:37:04.224935+0000","last_fullsized":"2024-09-22T08:37:04.224935+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:26:33.317627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.224012+0000","last_change":"2024-09-22T08:36:27.986048+0000","last_active":"2024-09-22T08:37:04.224012+0000","last_peered":"2024-09-22T08:37:04.224012+0000","last_clean":"2024-09-22T08:37:04.224012+0000","last_became_active":"2024-09-22T08:36:27.985751+0000","last_became_peered":"2024-09-22T08:36:27.985751+0000","last_unstale":"2024-09-22T08:37:04.224012+0000","last_undegraded":"2024-09-22T08:37:04.224012+0000","last_fullsized":"2024-09-22T08:37:04.224012+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_clean_scrub_stamp":"2024-09-22T08:36:26.962226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:05:30.441634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"32'55","reported_seq":112,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:30.257382+0000","last_change":"2024-09-22T08:36:29.995500+0000","last_active":"2024-09-22T08:38:30.257382+0000","last_peered":"2024-09-22T08:38:30.257382+0000","last_clean":"2024-09-22T08:38:30.257382+0000","last_became_active":"2024-09-22T08:36:29.995225+0000","last_became_peered":"2024-09-22T08:36:29.995225+0000","last_unstale":"2024-09-22T08:38:30.257382+0000","last_undegraded":"2024-09-22T08:38:30.257382+0000","last_fullsized":"2024-09-22T08:38:30.257382+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:06:45.130197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.223232+0000","last_change":"2024-09-22T08:36:32.003118+0000","last_active":"2024-09-22T08:37:04.223232+0000","last_peered":"2024-09-22T08:37:04.223232+0000","last_clean":"2024-09-22T08:37:04.223232+0000","last_became_active":"2024-09-22T08:36:32.002833+0000","last_became_peered":"2024-09-22T08:36:32.002833+0000","last_unstale":"2024-09-22T08:37:04.223232+0000","last_undegraded":"2024-09-22T08:37:04.223232+0000","last_fullsized":"2024-09-22T08:37:04.223232+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:35:19.477576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"32'18","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.383653+0000","last_change":"2024-09-22T08:36:34.015160+0000","last_active":"2024-09-22T08:39:32.383653+0000","last_peered":"2024-09-22T08:39:32.383653+0000","last_clean":"2024-09-22T08:39:32.383653+0000","last_became_active":"2024-09-22T08:36:34.014853+0000","last_became_peered":"2024-09-22T08:36:34.014853+0000","last_unstale":"2024-09-22T08:39:32.383653+0000","last_undegraded":"2024-09-22T08:39:32.383653+0000","last_fullsized":"2024-09-22T08:39:32.383653+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:14:47.722976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"32'12","reported_seq":70,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:48.128311+0000","last_change":"2024-09-22T08:36:25.977939+0000","last_active":"2024-09-22T08:37:48.128311+0000","last_peered":"2024-09-22T08:37:48.128311+0000","last_clean":"2024-09-22T08:37:48.128311+0000","last_became_active":"2024-09-22T08:36:25.977682+0000","last_became_peered":"2024-09-22T08:36:25.977682+0000","last_unstale":"2024-09-22T08:37:48.128311+0000","last_undegraded":"2024-09-22T08:37:48.128311+0000","last_fullsized":"2024-09-22T08:37:48.128311+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:13:46.550224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":47,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.224398+0000","last_change":"2024-09-22T08:36:23.973186+0000","last_active":"2024-09-22T08:37:04.224398+0000","last_peered":"2024-09-22T08:37:04.224398+0000","last_clean":"2024-09-22T08:37:04.224398+0000","last_became_active":"2024-09-22T08:36:23.972822+0000","last_became_peered":"2024-09-22T08:36:23.972822+0000","last_unstale":"2024-09-22T08:37:04.224398+0000","last_undegraded":"2024-09-22T08:37:04.224398+0000","last_fullsized":"2024-09-22T08:37:04.224398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:47:13.913539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.227778+0000","last_change":"2024-09-22T08:36:27.992047+0000","last_active":"2024-09-22T08:37:04.227778+0000","last_peered":"2024-09-22T08:37:04.227778+0000","last_clean":"2024-09-22T08:37:04.227778+0000","last_became_active":"2024-09-22T08:36:27.991761+0000","last_became_peered":"2024-09-22T08:36:27.991761+0000","last_unstale":"2024-09-22T08:37:04.227778+0000","last_undegraded":"2024-09-22T08:37:04.227778+0000","last_fullsized":"2024-09-22T08:37:04.227778+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_clean_scrub_stamp":"2024-09-22T08:36:26.962226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:45:08.688857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"32'32","reported_seq":76,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:30.237179+0000","last_change":"2024-09-22T08:36:29.988696+0000","last_active":"2024-09-22T08:38:30.237179+0000","last_peered":"2024-09-22T08:38:30.237179+0000","last_clean":"2024-09-22T08:38:30.237179+0000","last_became_active":"2024-09-22T08:36:29.988363+0000","last_became_peered":"2024-09-22T08:36:29.988363+0000","last_unstale":"2024-09-22T08:38:30.237179+0000","last_undegraded":"2024-09-22T08:38:30.237179+0000","last_fullsized":"2024-09-22T08:38:30.237179+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:20:15.843523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.229572+0000","last_change":"2024-09-22T08:36:32.012753+0000","last_active":"2024-09-22T08:37:04.229572+0000","last_peered":"2024-09-22T08:37:04.229572+0000","last_clean":"2024-09-22T08:37:04.229572+0000","last_became_active":"2024-09-22T08:36:32.011923+0000","last_became_peered":"2024-09-22T08:36:32.011923+0000","last_unstale":"2024-09-22T08:37:04.229572+0000","last_undegraded":"2024-09-22T08:37:04.229572+0000","last_fullsized":"2024-09-22T08:37:04.229572+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:27:01.625975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"32'3","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:33.182535+0000","last_change":"2024-09-22T08:36:34.013810+0000","last_active":"2024-09-22T08:38:33.182535+0000","last_peered":"2024-09-22T08:38:33.182535+0000","last_clean":"2024-09-22T08:38:33.182535+0000","last_became_active":"2024-09-22T08:36:34.013308+0000","last_became_peered":"2024-09-22T08:36:34.013308+0000","last_unstale":"2024-09-22T08:38:33.182535+0000","last_undegraded":"2024-09-22T08:38:33.182535+0000","last_fullsized":"2024-09-22T08:38:33.182535+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:08:44.619221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"32'6","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.214676+0000","last_change":"2024-09-22T08:36:25.993564+0000","last_active":"2024-09-22T08:39:32.214676+0000","last_peered":"2024-09-22T08:39:32.214676+0000","last_clean":"2024-09-22T08:39:32.214676+0000","last_became_active":"2024-09-22T08:36:25.992167+0000","last_became_peered":"2024-09-22T08:36:25.992167+0000","last_unstale":"2024-09-22T08:39:32.214676+0000","last_undegraded":"2024-09-22T08:39:32.214676+0000","last_fullsized":"2024-09-22T08:39:32.214676+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:39:40.006672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"32'4","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:31.977133+0000","last_change":"2024-09-22T08:36:23.980852+0000","last_active":"2024-09-22T08:39:31.977133+0000","last_peered":"2024-09-22T08:39:31.977133+0000","last_clean":"2024-09-22T08:39:31.977133+0000","last_became_active":"2024-09-22T08:36:23.980560+0000","last_became_peered":"2024-09-22T08:36:23.980560+0000","last_unstale":"2024-09-22T08:39:31.977133+0000","last_undegraded":"2024-09-22T08:39:31.977133+0000","last_fullsized":"2024-09-22T08:39:31.977133+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:21:04.119270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":6,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.226238+0000","last_change":"2024-09-22T08:36:27.984977+0000","last_active":"2024-09-22T08:37:04.226238+0000","last_peered":"2024-09-22T08:37:04.226238+0000","last_clean":"2024-09-22T08:37:04.226238+0000","last_became_active":"2024-09-22T08:36:27.984699+0000","last_became_peered":"2024-09-22T08:36:27.984699+0000","last_unstale":"2024-09-22T08:37:04.226238+0000","last_undegraded":"2024-09-22T08:37:04.226238+0000","last_fullsized":"2024-09-22T08:37:04.226238+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_clean_scrub_stamp":"2024-09-22T08:36:26.962226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:30:42.385182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"32'36","reported_seq":82,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:30.264969+0000","last_change":"2024-09-22T08:36:29.989330+0000","last_active":"2024-09-22T08:38:30.264969+0000","last_peered":"2024-09-22T08:38:30.264969+0000","last_clean":"2024-09-22T08:38:30.264969+0000","last_became_active":"2024-09-22T08:36:29.989049+0000","last_became_peered":"2024-09-22T08:36:29.989049+0000","last_unstale":"2024-09-22T08:38:30.264969+0000","last_undegraded":"2024-09-22T08:38:30.264969+0000","last_fullsized":"2024-09-22T08:38:30.264969+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:25:38.846675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"32'282","reported_seq":452,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.387667+0000","last_change":"2024-09-22T08:36:32.003714+0000","last_active":"2024-09-22T08:39:32.387667+0000","last_peered":"2024-09-22T08:39:32.387667+0000","last_clean":"2024-09-22T08:39:32.387667+0000","last_became_active":"2024-09-22T08:36:32.003451+0000","last_became_peered":"2024-09-22T08:36:32.003451+0000","last_unstale":"2024-09-22T08:39:32.387667+0000","last_undegraded":"2024-09-22T08:39:32.387667+0000","last_fullsized":"2024-09-22T08:39:32.387667+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:36:40.009194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"32'12","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:38.177618+0000","last_change":"2024-09-22T08:36:34.017932+0000","last_active":"2024-09-22T08:38:38.177618+0000","last_peered":"2024-09-22T08:38:38.177618+0000","last_clean":"2024-09-22T08:38:38.177618+0000","last_became_active":"2024-09-22T08:36:34.017586+0000","last_became_peered":"2024-09-22T08:36:34.017586+0000","last_unstale":"2024-09-22T08:38:38.177618+0000","last_undegraded":"2024-09-22T08:38:38.177618+0000","last_fullsized":"2024-09-22T08:38:38.177618+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:03:46.243863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"32'6","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:31.996687+0000","last_change":"2024-09-22T08:36:25.984089+0000","last_active":"2024-09-22T08:39:31.996687+0000","last_peered":"2024-09-22T08:39:31.996687+0000","last_clean":"2024-09-22T08:39:31.996687+0000","last_became_active":"2024-09-22T08:36:25.983836+0000","last_became_peered":"2024-09-22T08:36:25.983836+0000","last_unstale":"2024-09-22T08:39:31.996687+0000","last_undegraded":"2024-09-22T08:39:31.996687+0000","last_fullsized":"2024-09-22T08:39:31.996687+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:55:24.968571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":29,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.228027+0000","last_change":"2024-09-22T08:36:23.981996+0000","last_active":"2024-09-22T08:37:04.228027+0000","last_peered":"2024-09-22T08:37:04.228027+0000","last_clean":"2024-09-22T08:37:04.228027+0000","last_became_active":"2024-09-22T08:36:23.981453+0000","last_became_peered":"2024-09-22T08:36:23.981453+0000","last_unstale":"2024-09-22T08:37:04.228027+0000","last_undegraded":"2024-09-22T08:37:04.228027+0000","last_fullsized":"2024-09-22T08:37:04.228027+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:48:13.371475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"32'3","reported_seq":414,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:31.306941+0000","last_change":"2024-09-22T08:36:27.990966+0000","last_active":"2024-09-22T08:38:31.306941+0000","last_peered":"2024-09-22T08:38:31.306941+0000","last_clean":"2024-09-22T08:38:31.306941+0000","last_became_active":"2024-09-22T08:36:27.990658+0000","last_became_peered":"2024-09-22T08:36:27.990658+0000","last_unstale":"2024-09-22T08:38:31.306941+0000","last_undegraded":"2024-09-22T08:38:31.306941+0000","last_fullsized":"2024-09-22T08:38:31.306941+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_clean_scrub_stamp":"2024-09-22T08:36:26.962226+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:46:19.841645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":381,"num_read_kb":381,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"30'10","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.225133+0000","last_change":"2024-09-22T08:36:29.994653+0000","last_active":"2024-09-22T08:37:04.225133+0000","last_peered":"2024-09-22T08:37:04.225133+0000","last_clean":"2024-09-22T08:37:04.225133+0000","last_became_active":"2024-09-22T08:36:29.994352+0000","last_became_peered":"2024-09-22T08:36:29.994352+0000","last_unstale":"2024-09-22T08:37:04.225133+0000","last_undegraded":"2024-09-22T08:37:04.225133+0000","last_fullsized":"2024-09-22T08:37:04.225133+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:29:42.839928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"32'282","reported_seq":463,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.396459+0000","last_change":"2024-09-22T08:36:32.002508+0000","last_active":"2024-09-22T08:39:32.396459+0000","last_peered":"2024-09-22T08:39:32.396459+0000","last_clean":"2024-09-22T08:39:32.396459+0000","last_became_active":"2024-09-22T08:36:32.002222+0000","last_became_peered":"2024-09-22T08:36:32.002222+0000","last_unstale":"2024-09-22T08:39:32.396459+0000","last_undegraded":"2024-09-22T08:39:32.396459+0000","last_fullsized":"2024-09-22T08:39:32.396459+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:01:40.774076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"32'4","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:31.432921+0000","last_change":"2024-09-22T08:36:34.016126+0000","last_active":"2024-09-22T08:38:31.432921+0000","last_peered":"2024-09-22T08:38:31.432921+0000","last_clean":"2024-09-22T08:38:31.432921+0000","last_became_active":"2024-09-22T08:36:34.015833+0000","last_became_peered":"2024-09-22T08:36:34.015833+0000","last_unstale":"2024-09-22T08:38:31.432921+0000","last_undegraded":"2024-09-22T08:38:31.432921+0000","last_fullsized":"2024-09-22T08:38:31.432921+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:08:38.502068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"32'6","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.214644+0000","last_change":"2024-09-22T08:36:25.978129+0000","last_active":"2024-09-22T08:39:32.214644+0000","last_peered":"2024-09-22T08:39:32.214644+0000","last_clean":"2024-09-22T08:39:32.214644+0000","last_became_active":"2024-09-22T08:36:25.977184+0000","last_became_peered":"2024-09-22T08:36:25.977184+0000","last_unstale":"2024-09-22T08:39:32.214644+0000","last_undegraded":"2024-09-22T08:39:32.214644+0000","last_fullsized":"2024-09-22T08:39:32.214644+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:04:17.169545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"32'8","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.210634+0000","last_change":"2024-09-22T08:36:23.976950+0000","last_active":"2024-09-22T08:39:32.210634+0000","last_peered":"2024-09-22T08:39:32.210634+0000","last_clean":"2024-09-22T08:39:32.210634+0000","last_became_active":"2024-09-22T08:36:23.976129+0000","last_became_peered":"2024-09-22T08:36:23.976129+0000","last_unstale":"2024-09-22T08:39:32.210634+0000","last_undegraded":"2024-09-22T08:39:32.210634+0000","last_fullsized":"2024-09-22T08:39:32.210634+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:08:20.789789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":14,"num_write":48,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"23'1","reported_seq":219,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:31.307278+0000","last_change":"2024-09-22T08:36:27.988301+0000","last_active":"2024-09-22T08:38:31.307278+0000","last_peered":"2024-09-22T08:38:31.307278+0000","last_clean":"2024-09-22T08:38:31.307278+0000","last_became_active":"2024-09-22T08:36:27.987999+0000","last_became_peered":"2024-09-22T08:36:27.987999+0000","last_unstale":"2024-09-22T08:38:31.307278+0000","last_undegraded":"2024-09-22T08:38:31.307278+0000","last_fullsized":"2024-09-22T08:38:31.307278+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_clean_scrub_stamp":"2024-09-22T08:36:26.962226+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:18:39.538565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":282,"num_read_kb":282,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"32'38","reported_seq":85,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:30.250729+0000","last_change":"2024-09-22T08:36:29.992044+0000","last_active":"2024-09-22T08:38:30.250729+0000","last_peered":"2024-09-22T08:38:30.250729+0000","last_clean":"2024-09-22T08:38:30.250729+0000","last_became_active":"2024-09-22T08:36:29.991671+0000","last_became_peered":"2024-09-22T08:36:29.991671+0000","last_unstale":"2024-09-22T08:38:30.250729+0000","last_undegraded":"2024-09-22T08:38:30.250729+0000","last_fullsized":"2024-09-22T08:38:30.250729+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:30:17.519164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":41,"num_read_kb":31,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.225831+0000","last_change":"2024-09-22T08:36:32.012136+0000","last_active":"2024-09-22T08:37:04.225831+0000","last_peered":"2024-09-22T08:37:04.225831+0000","last_clean":"2024-09-22T08:37:04.225831+0000","last_became_active":"2024-09-22T08:36:32.011845+0000","last_became_peered":"2024-09-22T08:36:32.011845+0000","last_unstale":"2024-09-22T08:37:04.225831+0000","last_undegraded":"2024-09-22T08:37:04.225831+0000","last_fullsized":"2024-09-22T08:37:04.225831+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:30:19.290881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"32'6","reported_seq":25,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.324008+0000","last_change":"2024-09-22T08:36:34.008672+0000","last_active":"2024-09-22T08:39:32.324008+0000","last_peered":"2024-09-22T08:39:32.324008+0000","last_clean":"2024-09-22T08:39:32.324008+0000","last_became_active":"2024-09-22T08:36:34.008374+0000","last_became_peered":"2024-09-22T08:36:34.008374+0000","last_unstale":"2024-09-22T08:39:32.324008+0000","last_undegraded":"2024-09-22T08:39:32.324008+0000","last_fullsized":"2024-09-22T08:39:32.324008+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:58:45.659504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"32'15","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.221742+0000","last_change":"2024-09-22T08:37:04.234725+0000","last_active":"2024-09-22T08:39:32.221742+0000","last_peered":"2024-09-22T08:39:32.221742+0000","last_clean":"2024-09-22T08:39:32.221742+0000","last_became_active":"2024-09-22T08:37:04.228680+0000","last_became_peered":"2024-09-22T08:37:04.228680+0000","last_unstale":"2024-09-22T08:39:32.221742+0000","last_undegraded":"2024-09-22T08:39:32.221742+0000","last_fullsized":"2024-09-22T08:39:32.221742+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:38:57.809846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":62,"num_read_kb":54,"num_write":19,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"12'72","reported_seq":142,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.220993+0000","last_change":"2024-09-22T08:36:10.737141+0000","last_active":"2024-09-22T08:37:04.220993+0000","last_peered":"2024-09-22T08:37:04.220993+0000","last_clean":"2024-09-22T08:37:04.220993+0000","last_became_active":"2024-09-22T08:36:10.736221+0000","last_became_peered":"2024-09-22T08:36:10.736221+0000","last_unstale":"2024-09-22T08:37:04.220993+0000","last_undegraded":"2024-09-22T08:37:04.220993+0000","last_fullsized":"2024-09-22T08:37:04.220993+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:09.401562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:09.401562+0000","last_clean_scrub_stamp":"2024-09-22T08:36:09.401562+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:14:13.135964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.229293+0000","last_change":"2024-09-22T08:36:18.431832+0000","last_active":"2024-09-22T08:37:04.229293+0000","last_peered":"2024-09-22T08:37:04.229293+0000","last_clean":"2024-09-22T08:37:04.229293+0000","last_became_active":"2024-09-22T08:36:16.425465+0000","last_became_peered":"2024-09-22T08:36:16.425465+0000","last_unstale":"2024-09-22T08:37:04.229293+0000","last_undegraded":"2024-09-22T08:37:04.229293+0000","last_fullsized":"2024-09-22T08:37:04.229293+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:15.415268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:15.415268+0000","last_clean_scrub_stamp":"2024-09-22T08:36:15.415268+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:34:11.990226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049376300000000004,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"32'5","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:33.182613+0000","last_change":"2024-09-22T08:36:23.982423+0000","last_active":"2024-09-22T08:38:33.182613+0000","last_peered":"2024-09-22T08:38:33.182613+0000","last_clean":"2024-09-22T08:38:33.182613+0000","last_became_active":"2024-09-22T08:36:23.981576+0000","last_became_peered":"2024-09-22T08:36:23.981576+0000","last_unstale":"2024-09-22T08:38:33.182613+0000","last_undegraded":"2024-09-22T08:38:33.182613+0000","last_fullsized":"2024-09-22T08:38:33.182613+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:44:29.452126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":4,"num_write":21,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.223327+0000","last_change":"2024-09-22T08:36:27.991484+0000","last_active":"2024-09-22T08:37:04.223327+0000","last_peered":"2024-09-22T08:37:04.223327+0000","last_clean":"2024-09-22T08:37:04.223327+0000","last_became_active":"2024-09-22T08:36:27.991130+0000","last_became_peered":"2024-09-22T08:36:27.991130+0000","last_unstale":"2024-09-22T08:37:04.223327+0000","last_undegraded":"2024-09-22T08:37:04.223327+0000","last_fullsized":"2024-09-22T08:37:04.223327+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_clean_scrub_stamp":"2024-09-22T08:36:26.962226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:25:36.836271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"32'76","reported_seq":146,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:30.262305+0000","last_change":"2024-09-22T08:36:29.997752+0000","last_active":"2024-09-22T08:38:30.262305+0000","last_peered":"2024-09-22T08:38:30.262305+0000","last_clean":"2024-09-22T08:38:30.262305+0000","last_became_active":"2024-09-22T08:36:29.997294+0000","last_became_peered":"2024-09-22T08:36:29.997294+0000","last_unstale":"2024-09-22T08:38:30.262305+0000","last_undegraded":"2024-09-22T08:38:30.262305+0000","last_fullsized":"2024-09-22T08:38:30.262305+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:18:13.227210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.226456+0000","last_change":"2024-09-22T08:36:32.009096+0000","last_active":"2024-09-22T08:37:04.226456+0000","last_peered":"2024-09-22T08:37:04.226456+0000","last_clean":"2024-09-22T08:37:04.226456+0000","last_became_active":"2024-09-22T08:36:32.008793+0000","last_became_peered":"2024-09-22T08:36:32.008793+0000","last_unstale":"2024-09-22T08:37:04.226456+0000","last_undegraded":"2024-09-22T08:37:04.226456+0000","last_fullsized":"2024-09-22T08:37:04.226456+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:01:07.495676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"32'81","reported_seq":163,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.301899+0000","last_change":"2024-09-22T08:36:34.016827+0000","last_active":"2024-09-22T08:39:32.301899+0000","last_peered":"2024-09-22T08:39:32.301899+0000","last_clean":"2024-09-22T08:39:32.301899+0000","last_became_active":"2024-09-22T08:36:34.016484+0000","last_became_peered":"2024-09-22T08:36:34.016484+0000","last_unstale":"2024-09-22T08:39:32.301899+0000","last_undegraded":"2024-09-22T08:39:32.301899+0000","last_fullsized":"2024-09-22T08:39:32.301899+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:27:41.551286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":223,"num_read_kb":221,"num_write":155,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"32'6","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.289629+0000","last_change":"2024-09-22T08:36:25.988439+0000","last_active":"2024-09-22T08:39:32.289629+0000","last_peered":"2024-09-22T08:39:32.289629+0000","last_clean":"2024-09-22T08:39:32.289629+0000","last_became_active":"2024-09-22T08:36:25.988156+0000","last_became_peered":"2024-09-22T08:36:25.988156+0000","last_unstale":"2024-09-22T08:39:32.289629+0000","last_undegraded":"2024-09-22T08:39:32.289629+0000","last_fullsized":"2024-09-22T08:39:32.289629+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:02:27.083682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.225823+0000","last_change":"2024-09-22T08:36:18.431890+0000","last_active":"2024-09-22T08:37:04.225823+0000","last_peered":"2024-09-22T08:37:04.225823+0000","last_clean":"2024-09-22T08:37:04.225823+0000","last_became_active":"2024-09-22T08:36:16.427252+0000","last_became_peered":"2024-09-22T08:36:16.427252+0000","last_unstale":"2024-09-22T08:37:04.225823+0000","last_undegraded":"2024-09-22T08:37:04.225823+0000","last_fullsized":"2024-09-22T08:37:04.225823+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:15.415268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:15.415268+0000","last_clean_scrub_stamp":"2024-09-22T08:36:15.415268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:11:12.623975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055484200000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.223638+0000","last_change":"2024-09-22T08:36:23.974666+0000","last_active":"2024-09-22T08:37:04.223638+0000","last_peered":"2024-09-22T08:37:04.223638+0000","last_clean":"2024-09-22T08:37:04.223638+0000","last_became_active":"2024-09-22T08:36:23.973773+0000","last_became_peered":"2024-09-22T08:36:23.973773+0000","last_unstale":"2024-09-22T08:37:04.223638+0000","last_undegraded":"2024-09-22T08:37:04.223638+0000","last_fullsized":"2024-09-22T08:37:04.223638+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:04:51.934564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.236920+0000","last_change":"2024-09-22T08:37:04.234583+0000","last_active":"2024-09-22T08:37:04.236920+0000","last_peered":"2024-09-22T08:37:04.236920+0000","last_clean":"2024-09-22T08:37:04.236920+0000","last_became_active":"2024-09-22T08:37:04.234316+0000","last_became_peered":"2024-09-22T08:37:04.234316+0000","last_unstale":"2024-09-22T08:37:04.236920+0000","last_undegraded":"2024-09-22T08:37:04.236920+0000","last_fullsized":"2024-09-22T08:37:04.236920+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_clean_scrub_stamp":"2024-09-22T08:36:26.962226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:12:15.239608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"32'274","reported_seq":477,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:28.067633+0000","last_change":"2024-09-22T08:36:29.996545+0000","last_active":"2024-09-22T08:39:28.067633+0000","last_peered":"2024-09-22T08:39:28.067633+0000","last_clean":"2024-09-22T08:39:28.067633+0000","last_became_active":"2024-09-22T08:36:29.996025+0000","last_became_peered":"2024-09-22T08:36:29.996025+0000","last_unstale":"2024-09-22T08:39:28.067633+0000","last_undegraded":"2024-09-22T08:39:28.067633+0000","last_fullsized":"2024-09-22T08:39:28.067633+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":274,"log_dups_size":0,"ondisk_log_size":274,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:55:34.543185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":357,"num_read_kb":342,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.227773+0000","last_change":"2024-09-22T08:36:32.013929+0000","last_active":"2024-09-22T08:37:04.227773+0000","last_peered":"2024-09-22T08:37:04.227773+0000","last_clean":"2024-09-22T08:37:04.227773+0000","last_became_active":"2024-09-22T08:36:32.013220+0000","last_became_peered":"2024-09-22T08:36:32.013220+0000","last_unstale":"2024-09-22T08:37:04.227773+0000","last_undegraded":"2024-09-22T08:37:04.227773+0000","last_fullsized":"2024-09-22T08:37:04.227773+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:57:05.813999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"32'5","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:28.578046+0000","last_change":"2024-09-22T08:36:34.018385+0000","last_active":"2024-09-22T08:38:28.578046+0000","last_peered":"2024-09-22T08:38:28.578046+0000","last_clean":"2024-09-22T08:38:28.578046+0000","last_became_active":"2024-09-22T08:36:34.018138+0000","last_became_peered":"2024-09-22T08:36:34.018138+0000","last_unstale":"2024-09-22T08:38:28.578046+0000","last_undegraded":"2024-09-22T08:38:28.578046+0000","last_fullsized":"2024-09-22T08:38:28.578046+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:47:34.849746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"32'8","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.214950+0000","last_change":"2024-09-22T08:36:25.979635+0000","last_active":"2024-09-22T08:39:32.214950+0000","last_peered":"2024-09-22T08:39:32.214950+0000","last_clean":"2024-09-22T08:39:32.214950+0000","last_became_active":"2024-09-22T08:36:25.979108+0000","last_became_peered":"2024-09-22T08:36:25.979108+0000","last_unstale":"2024-09-22T08:39:32.214950+0000","last_undegraded":"2024-09-22T08:39:32.214950+0000","last_fullsized":"2024-09-22T08:39:32.214950+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:18:04.046419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.225590+0000","last_change":"2024-09-22T08:36:18.520219+0000","last_active":"2024-09-22T08:37:04.225590+0000","last_peered":"2024-09-22T08:37:04.225590+0000","last_clean":"2024-09-22T08:37:04.225590+0000","last_became_active":"2024-09-22T08:36:16.427121+0000","last_became_peered":"2024-09-22T08:36:16.427121+0000","last_unstale":"2024-09-22T08:37:04.225590+0000","last_undegraded":"2024-09-22T08:37:04.225590+0000","last_fullsized":"2024-09-22T08:37:04.225590+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:15.415268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:15.415268+0000","last_clean_scrub_stamp":"2024-09-22T08:36:15.415268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:47:57.246114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041194099999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"32'1","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:28.175943+0000","last_change":"2024-09-22T08:36:23.972065+0000","last_active":"2024-09-22T08:38:28.175943+0000","last_peered":"2024-09-22T08:38:28.175943+0000","last_clean":"2024-09-22T08:38:28.175943+0000","last_became_active":"2024-09-22T08:36:23.971688+0000","last_became_peered":"2024-09-22T08:36:23.971688+0000","last_unstale":"2024-09-22T08:38:28.175943+0000","last_undegraded":"2024-09-22T08:38:28.175943+0000","last_fullsized":"2024-09-22T08:38:28.175943+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:57:13.077784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":639872,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"23'1","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.230019+0000","last_change":"2024-09-22T08:36:27.987350+0000","last_active":"2024-09-22T08:37:04.230019+0000","last_peered":"2024-09-22T08:37:04.230019+0000","last_clean":"2024-09-22T08:37:04.230019+0000","last_became_active":"2024-09-22T08:36:27.986993+0000","last_became_peered":"2024-09-22T08:36:27.986993+0000","last_unstale":"2024-09-22T08:37:04.230019+0000","last_undegraded":"2024-09-22T08:37:04.230019+0000","last_fullsized":"2024-09-22T08:37:04.230019+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_clean_scrub_stamp":"2024-09-22T08:36:26.962226+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:04:19.174975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"32'17","reported_seq":85,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:28.067597+0000","last_change":"2024-09-22T08:36:29.991891+0000","last_active":"2024-09-22T08:39:28.067597+0000","last_peered":"2024-09-22T08:39:28.067597+0000","last_clean":"2024-09-22T08:39:28.067597+0000","last_became_active":"2024-09-22T08:36:29.991579+0000","last_became_peered":"2024-09-22T08:36:29.991579+0000","last_unstale":"2024-09-22T08:39:28.067597+0000","last_undegraded":"2024-09-22T08:39:28.067597+0000","last_fullsized":"2024-09-22T08:39:28.067597+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:17:51.757786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.224585+0000","last_change":"2024-09-22T08:36:32.011889+0000","last_active":"2024-09-22T08:37:04.224585+0000","last_peered":"2024-09-22T08:37:04.224585+0000","last_clean":"2024-09-22T08:37:04.224585+0000","last_became_active":"2024-09-22T08:36:32.011634+0000","last_became_peered":"2024-09-22T08:36:32.011634+0000","last_unstale":"2024-09-22T08:37:04.224585+0000","last_undegraded":"2024-09-22T08:37:04.224585+0000","last_fullsized":"2024-09-22T08:37:04.224585+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:56:34.615539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.226958+0000","last_change":"2024-09-22T08:36:34.012423+0000","last_active":"2024-09-22T08:37:04.226958+0000","last_peered":"2024-09-22T08:37:04.226958+0000","last_clean":"2024-09-22T08:37:04.226958+0000","last_became_active":"2024-09-22T08:36:34.011936+0000","last_became_peered":"2024-09-22T08:36:34.011936+0000","last_unstale":"2024-09-22T08:37:04.226958+0000","last_undegraded":"2024-09-22T08:37:04.226958+0000","last_fullsized":"2024-09-22T08:37:04.226958+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:29:05.565248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"32'3","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:33.176834+0000","last_change":"2024-09-22T08:36:25.977871+0000","last_active":"2024-09-22T08:38:33.176834+0000","last_peered":"2024-09-22T08:38:33.176834+0000","last_clean":"2024-09-22T08:38:33.176834+0000","last_became_active":"2024-09-22T08:36:25.977552+0000","last_became_peered":"2024-09-22T08:36:25.977552+0000","last_unstale":"2024-09-22T08:38:33.176834+0000","last_undegraded":"2024-09-22T08:38:33.176834+0000","last_fullsized":"2024-09-22T08:38:33.176834+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:22:41.119685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.227504+0000","last_change":"2024-09-22T08:36:18.432421+0000","last_active":"2024-09-22T08:37:04.227504+0000","last_peered":"2024-09-22T08:37:04.227504+0000","last_clean":"2024-09-22T08:37:04.227504+0000","last_became_active":"2024-09-22T08:36:16.427358+0000","last_became_peered":"2024-09-22T08:36:16.427358+0000","last_unstale":"2024-09-22T08:37:04.227504+0000","last_undegraded":"2024-09-22T08:37:04.227504+0000","last_fullsized":"2024-09-22T08:37:04.227504+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:15.415268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:15.415268+0000","last_clean_scrub_stamp":"2024-09-22T08:36:15.415268+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:16:15.903021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001068835,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"32'4","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.208130+0000","last_change":"2024-09-22T08:36:23.967690+0000","last_active":"2024-09-22T08:39:32.208130+0000","last_peered":"2024-09-22T08:39:32.208130+0000","last_clean":"2024-09-22T08:39:32.208130+0000","last_became_active":"2024-09-22T08:36:23.967413+0000","last_became_peered":"2024-09-22T08:36:23.967413+0000","last_unstale":"2024-09-22T08:39:32.208130+0000","last_undegraded":"2024-09-22T08:39:32.208130+0000","last_fullsized":"2024-09-22T08:39:32.208130+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:53:44.806098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.225286+0000","last_change":"2024-09-22T08:36:27.988932+0000","last_active":"2024-09-22T08:37:04.225286+0000","last_peered":"2024-09-22T08:37:04.225286+0000","last_clean":"2024-09-22T08:37:04.225286+0000","last_became_active":"2024-09-22T08:36:27.988507+0000","last_became_peered":"2024-09-22T08:36:27.988507+0000","last_unstale":"2024-09-22T08:37:04.225286+0000","last_undegraded":"2024-09-22T08:37:04.225286+0000","last_fullsized":"2024-09-22T08:37:04.225286+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_clean_scrub_stamp":"2024-09-22T08:36:26.962226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:48:06.094834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"32'13","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:31.660162+0000","last_change":"2024-09-22T08:36:29.996842+0000","last_active":"2024-09-22T08:39:31.660162+0000","last_peered":"2024-09-22T08:39:31.660162+0000","last_clean":"2024-09-22T08:39:31.660162+0000","last_became_active":"2024-09-22T08:36:29.996557+0000","last_became_peered":"2024-09-22T08:36:29.996557+0000","last_unstale":"2024-09-22T08:39:31.660162+0000","last_undegraded":"2024-09-22T08:39:31.660162+0000","last_fullsized":"2024-09-22T08:39:31.660162+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:05:26.776730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.229775+0000","last_change":"2024-09-22T08:36:32.014226+0000","last_active":"2024-09-22T08:37:04.229775+0000","last_peered":"2024-09-22T08:37:04.229775+0000","last_clean":"2024-09-22T08:37:04.229775+0000","last_became_active":"2024-09-22T08:36:32.013320+0000","last_became_peered":"2024-09-22T08:36:32.013320+0000","last_unstale":"2024-09-22T08:37:04.229775+0000","last_undegraded":"2024-09-22T08:37:04.229775+0000","last_fullsized":"2024-09-22T08:37:04.229775+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:03:21.762780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"32'4","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:31.413581+0000","last_change":"2024-09-22T08:36:34.015737+0000","last_active":"2024-09-22T08:38:31.413581+0000","last_peered":"2024-09-22T08:38:31.413581+0000","last_clean":"2024-09-22T08:38:31.413581+0000","last_became_active":"2024-09-22T08:36:34.015483+0000","last_became_peered":"2024-09-22T08:36:34.015483+0000","last_unstale":"2024-09-22T08:38:31.413581+0000","last_undegraded":"2024-09-22T08:38:31.413581+0000","last_fullsized":"2024-09-22T08:38:31.413581+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:08:04.974029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"32'8","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.078825+0000","last_change":"2024-09-22T08:36:25.986838+0000","last_active":"2024-09-22T08:39:32.078825+0000","last_peered":"2024-09-22T08:39:32.078825+0000","last_clean":"2024-09-22T08:39:32.078825+0000","last_became_active":"2024-09-22T08:36:25.986551+0000","last_became_peered":"2024-09-22T08:36:25.986551+0000","last_unstale":"2024-09-22T08:39:32.078825+0000","last_undegraded":"2024-09-22T08:39:32.078825+0000","last_fullsized":"2024-09-22T08:39:32.078825+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:52:57.511753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.225659+0000","last_change":"2024-09-22T08:36:23.968878+0000","last_active":"2024-09-22T08:37:04.225659+0000","last_peered":"2024-09-22T08:37:04.225659+0000","last_clean":"2024-09-22T08:37:04.225659+0000","last_became_active":"2024-09-22T08:36:23.968525+0000","last_became_peered":"2024-09-22T08:36:23.968525+0000","last_unstale":"2024-09-22T08:37:04.225659+0000","last_undegraded":"2024-09-22T08:37:04.225659+0000","last_fullsized":"2024-09-22T08:37:04.225659+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:02:28.926834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.224477+0000","last_change":"2024-09-22T08:36:18.434398+0000","last_active":"2024-09-22T08:37:04.224477+0000","last_peered":"2024-09-22T08:37:04.224477+0000","last_clean":"2024-09-22T08:37:04.224477+0000","last_became_active":"2024-09-22T08:36:16.424946+0000","last_became_peered":"2024-09-22T08:36:16.424946+0000","last_unstale":"2024-09-22T08:37:04.224477+0000","last_undegraded":"2024-09-22T08:37:04.224477+0000","last_fullsized":"2024-09-22T08:37:04.224477+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:15.415268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:15.415268+0000","last_clean_scrub_stamp":"2024-09-22T08:36:15.415268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:29:12.209070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045979400000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"32'1","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:33.176792+0000","last_change":"2024-09-22T08:36:27.988495+0000","last_active":"2024-09-22T08:38:33.176792+0000","last_peered":"2024-09-22T08:38:33.176792+0000","last_clean":"2024-09-22T08:38:33.176792+0000","last_became_active":"2024-09-22T08:36:27.987997+0000","last_became_peered":"2024-09-22T08:36:27.987997+0000","last_unstale":"2024-09-22T08:38:33.176792+0000","last_undegraded":"2024-09-22T08:38:33.176792+0000","last_fullsized":"2024-09-22T08:38:33.176792+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_clean_scrub_stamp":"2024-09-22T08:36:26.962226+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:35:11.843511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"32'63","reported_seq":123,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:33.176707+0000","last_change":"2024-09-22T08:36:29.994493+0000","last_active":"2024-09-22T08:38:33.176707+0000","last_peered":"2024-09-22T08:38:33.176707+0000","last_clean":"2024-09-22T08:38:33.176707+0000","last_became_active":"2024-09-22T08:36:29.994186+0000","last_became_peered":"2024-09-22T08:36:29.994186+0000","last_unstale":"2024-09-22T08:38:33.176707+0000","last_undegraded":"2024-09-22T08:38:33.176707+0000","last_fullsized":"2024-09-22T08:38:33.176707+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:18:59.702792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":59,"num_read_kb":47,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.228168+0000","last_change":"2024-09-22T08:36:32.003689+0000","last_active":"2024-09-22T08:37:04.228168+0000","last_peered":"2024-09-22T08:37:04.228168+0000","last_clean":"2024-09-22T08:37:04.228168+0000","last_became_active":"2024-09-22T08:36:32.003409+0000","last_became_peered":"2024-09-22T08:36:32.003409+0000","last_unstale":"2024-09-22T08:37:04.228168+0000","last_undegraded":"2024-09-22T08:37:04.228168+0000","last_fullsized":"2024-09-22T08:37:04.228168+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:27:05.933480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"32'13","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:31.589959+0000","last_change":"2024-09-22T08:36:34.013068+0000","last_active":"2024-09-22T08:38:31.589959+0000","last_peered":"2024-09-22T08:38:31.589959+0000","last_clean":"2024-09-22T08:38:31.589959+0000","last_became_active":"2024-09-22T08:36:34.012782+0000","last_became_peered":"2024-09-22T08:36:34.012782+0000","last_unstale":"2024-09-22T08:38:31.589959+0000","last_undegraded":"2024-09-22T08:38:31.589959+0000","last_fullsized":"2024-09-22T08:38:31.589959+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:16:13.410088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":25,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"32'6","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:31.996095+0000","last_change":"2024-09-22T08:36:25.985097+0000","last_active":"2024-09-22T08:39:31.996095+0000","last_peered":"2024-09-22T08:39:31.996095+0000","last_clean":"2024-09-22T08:39:31.996095+0000","last_became_active":"2024-09-22T08:36:25.984820+0000","last_became_peered":"2024-09-22T08:36:25.984820+0000","last_unstale":"2024-09-22T08:39:31.996095+0000","last_undegraded":"2024-09-22T08:39:31.996095+0000","last_fullsized":"2024-09-22T08:39:31.996095+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:42:09.685963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":29,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.613983+0000","last_change":"2024-09-22T08:36:23.974058+0000","last_active":"2024-09-22T08:37:04.613983+0000","last_peered":"2024-09-22T08:37:04.613983+0000","last_clean":"2024-09-22T08:37:04.613983+0000","last_became_active":"2024-09-22T08:36:23.973672+0000","last_became_peered":"2024-09-22T08:36:23.973672+0000","last_unstale":"2024-09-22T08:37:04.613983+0000","last_undegraded":"2024-09-22T08:37:04.613983+0000","last_fullsized":"2024-09-22T08:37:04.613983+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:01:29.462654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.231504+0000","last_change":"2024-09-22T08:36:18.432154+0000","last_active":"2024-09-22T08:37:04.231504+0000","last_peered":"2024-09-22T08:37:04.231504+0000","last_clean":"2024-09-22T08:37:04.231504+0000","last_became_active":"2024-09-22T08:36:16.427154+0000","last_became_peered":"2024-09-22T08:36:16.427154+0000","last_unstale":"2024-09-22T08:37:04.231504+0000","last_undegraded":"2024-09-22T08:37:04.231504+0000","last_fullsized":"2024-09-22T08:37:04.231504+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:15.415268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:15.415268+0000","last_clean_scrub_stamp":"2024-09-22T08:36:15.415268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:44:41.260462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081028899999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.236919+0000","last_change":"2024-09-22T08:37:04.234588+0000","last_active":"2024-09-22T08:37:04.236919+0000","last_peered":"2024-09-22T08:37:04.236919+0000","last_clean":"2024-09-22T08:37:04.236919+0000","last_became_active":"2024-09-22T08:37:04.233981+0000","last_became_peered":"2024-09-22T08:37:04.233981+0000","last_unstale":"2024-09-22T08:37:04.236919+0000","last_undegraded":"2024-09-22T08:37:04.236919+0000","last_fullsized":"2024-09-22T08:37:04.236919+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_clean_scrub_stamp":"2024-09-22T08:36:26.962226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:01:06.235869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"32'15","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:28.585360+0000","last_change":"2024-09-22T08:36:29.995560+0000","last_active":"2024-09-22T08:38:28.585360+0000","last_peered":"2024-09-22T08:38:28.585360+0000","last_clean":"2024-09-22T08:38:28.585360+0000","last_became_active":"2024-09-22T08:36:29.995173+0000","last_became_peered":"2024-09-22T08:36:29.995173+0000","last_unstale":"2024-09-22T08:38:28.585360+0000","last_undegraded":"2024-09-22T08:38:28.585360+0000","last_fullsized":"2024-09-22T08:38:28.585360+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:37:47.696313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"32'282","reported_seq":346,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:28.067667+0000","last_change":"2024-09-22T08:36:32.003255+0000","last_active":"2024-09-22T08:39:28.067667+0000","last_peered":"2024-09-22T08:39:28.067667+0000","last_clean":"2024-09-22T08:39:28.067667+0000","last_became_active":"2024-09-22T08:36:32.002985+0000","last_became_peered":"2024-09-22T08:36:32.002985+0000","last_unstale":"2024-09-22T08:39:28.067667+0000","last_undegraded":"2024-09-22T08:39:28.067667+0000","last_fullsized":"2024-09-22T08:39:28.067667+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:27:39.543678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.227398+0000","last_change":"2024-09-22T08:36:34.019732+0000","last_active":"2024-09-22T08:37:04.227398+0000","last_peered":"2024-09-22T08:37:04.227398+0000","last_clean":"2024-09-22T08:37:04.227398+0000","last_became_active":"2024-09-22T08:36:34.019438+0000","last_became_peered":"2024-09-22T08:36:34.019438+0000","last_unstale":"2024-09-22T08:37:04.227398+0000","last_undegraded":"2024-09-22T08:37:04.227398+0000","last_fullsized":"2024-09-22T08:37:04.227398+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:29:22.767417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"32'3","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.267975+0000","last_change":"2024-09-22T08:36:25.992413+0000","last_active":"2024-09-22T08:39:32.267975+0000","last_peered":"2024-09-22T08:39:32.267975+0000","last_clean":"2024-09-22T08:39:32.267975+0000","last_became_active":"2024-09-22T08:36:25.991480+0000","last_became_peered":"2024-09-22T08:36:25.991480+0000","last_unstale":"2024-09-22T08:39:32.267975+0000","last_undegraded":"2024-09-22T08:39:32.267975+0000","last_fullsized":"2024-09-22T08:39:32.267975+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:10:58.578162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:05.167463+0000","last_change":"2024-09-22T08:37:04.227877+0000","last_active":"2024-09-22T08:37:05.167463+0000","last_peered":"2024-09-22T08:37:05.167463+0000","last_clean":"2024-09-22T08:37:05.167463+0000","last_became_active":"2024-09-22T08:37:04.227561+0000","last_became_peered":"2024-09-22T08:37:04.227561+0000","last_unstale":"2024-09-22T08:37:05.167463+0000","last_undegraded":"2024-09-22T08:37:05.167463+0000","last_fullsized":"2024-09-22T08:37:05.167463+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:00:14.486207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.225363+0000","last_change":"2024-09-22T08:36:18.434431+0000","last_active":"2024-09-22T08:37:04.225363+0000","last_peered":"2024-09-22T08:37:04.225363+0000","last_clean":"2024-09-22T08:37:04.225363+0000","last_became_active":"2024-09-22T08:36:16.425549+0000","last_became_peered":"2024-09-22T08:36:16.425549+0000","last_unstale":"2024-09-22T08:37:04.225363+0000","last_undegraded":"2024-09-22T08:37:04.225363+0000","last_fullsized":"2024-09-22T08:37:04.225363+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:15.415268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:15.415268+0000","last_clean_scrub_stamp":"2024-09-22T08:36:15.415268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:59:01.714308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045809600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.229558+0000","last_change":"2024-09-22T08:36:27.987430+0000","last_active":"2024-09-22T08:37:04.229558+0000","last_peered":"2024-09-22T08:37:04.229558+0000","last_clean":"2024-09-22T08:37:04.229558+0000","last_became_active":"2024-09-22T08:36:27.987074+0000","last_became_peered":"2024-09-22T08:36:27.987074+0000","last_unstale":"2024-09-22T08:37:04.229558+0000","last_undegraded":"2024-09-22T08:37:04.229558+0000","last_fullsized":"2024-09-22T08:37:04.229558+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_clean_scrub_stamp":"2024-09-22T08:36:26.962226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:08:31.905654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"30'10","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.228539+0000","last_change":"2024-09-22T08:36:30.000809+0000","last_active":"2024-09-22T08:37:04.228539+0000","last_peered":"2024-09-22T08:37:04.228539+0000","last_clean":"2024-09-22T08:37:04.228539+0000","last_became_active":"2024-09-22T08:36:29.999965+0000","last_became_peered":"2024-09-22T08:36:29.999965+0000","last_unstale":"2024-09-22T08:37:04.228539+0000","last_undegraded":"2024-09-22T08:37:04.228539+0000","last_fullsized":"2024-09-22T08:37:04.228539+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:05:54.815446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"32'282","reported_seq":389,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.384270+0000","last_change":"2024-09-22T08:36:32.005583+0000","last_active":"2024-09-22T08:39:32.384270+0000","last_peered":"2024-09-22T08:39:32.384270+0000","last_clean":"2024-09-22T08:39:32.384270+0000","last_became_active":"2024-09-22T08:36:32.005155+0000","last_became_peered":"2024-09-22T08:36:32.005155+0000","last_unstale":"2024-09-22T08:39:32.384270+0000","last_undegraded":"2024-09-22T08:39:32.384270+0000","last_fullsized":"2024-09-22T08:39:32.384270+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:01:17.946935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"30'5","reported_seq":25,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.223266+0000","last_change":"2024-09-22T08:36:34.022617+0000","last_active":"2024-09-22T08:37:04.223266+0000","last_peered":"2024-09-22T08:37:04.223266+0000","last_clean":"2024-09-22T08:37:04.223266+0000","last_became_active":"2024-09-22T08:36:34.022313+0000","last_became_peered":"2024-09-22T08:36:34.022313+0000","last_unstale":"2024-09-22T08:37:04.223266+0000","last_undegraded":"2024-09-22T08:37:04.223266+0000","last_fullsized":"2024-09-22T08:37:04.223266+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:42:55.182851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":11,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"32'4","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:06.180363+0000","last_change":"2024-09-22T08:36:25.975148+0000","last_active":"2024-09-22T08:37:06.180363+0000","last_peered":"2024-09-22T08:37:06.180363+0000","last_clean":"2024-09-22T08:37:06.180363+0000","last_became_active":"2024-09-22T08:36:25.974884+0000","last_became_peered":"2024-09-22T08:36:25.974884+0000","last_unstale":"2024-09-22T08:37:06.180363+0000","last_undegraded":"2024-09-22T08:37:06.180363+0000","last_fullsized":"2024-09-22T08:37:06.180363+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:22:54.131230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"32'5","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:47.933891+0000","last_change":"2024-09-22T08:36:23.976867+0000","last_active":"2024-09-22T08:37:47.933891+0000","last_peered":"2024-09-22T08:37:47.933891+0000","last_clean":"2024-09-22T08:37:47.933891+0000","last_became_active":"2024-09-22T08:36:23.976646+0000","last_became_peered":"2024-09-22T08:36:23.976646+0000","last_unstale":"2024-09-22T08:37:47.933891+0000","last_undegraded":"2024-09-22T08:37:47.933891+0000","last_fullsized":"2024-09-22T08:37:47.933891+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:26:49.921857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":11,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.229890+0000","last_change":"2024-09-22T08:36:18.432491+0000","last_active":"2024-09-22T08:37:04.229890+0000","last_peered":"2024-09-22T08:37:04.229890+0000","last_clean":"2024-09-22T08:37:04.229890+0000","last_became_active":"2024-09-22T08:36:16.638610+0000","last_became_peered":"2024-09-22T08:36:16.638610+0000","last_unstale":"2024-09-22T08:37:04.229890+0000","last_undegraded":"2024-09-22T08:37:04.229890+0000","last_fullsized":"2024-09-22T08:37:04.229890+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:15.415268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:15.415268+0000","last_clean_scrub_stamp":"2024-09-22T08:36:15.415268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:36:49.729872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001119264,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.226781+0000","last_change":"2024-09-22T08:36:27.985127+0000","last_active":"2024-09-22T08:37:04.226781+0000","last_peered":"2024-09-22T08:37:04.226781+0000","last_clean":"2024-09-22T08:37:04.226781+0000","last_became_active":"2024-09-22T08:36:27.984803+0000","last_became_peered":"2024-09-22T08:36:27.984803+0000","last_unstale":"2024-09-22T08:37:04.226781+0000","last_undegraded":"2024-09-22T08:37:04.226781+0000","last_fullsized":"2024-09-22T08:37:04.226781+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_clean_scrub_stamp":"2024-09-22T08:36:26.962226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:51:28.889992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"32'84","reported_seq":157,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:30.248529+0000","last_change":"2024-09-22T08:36:30.000659+0000","last_active":"2024-09-22T08:38:30.248529+0000","last_peered":"2024-09-22T08:38:30.248529+0000","last_clean":"2024-09-22T08:38:30.248529+0000","last_became_active":"2024-09-22T08:36:30.000270+0000","last_became_peered":"2024-09-22T08:36:30.000270+0000","last_unstale":"2024-09-22T08:38:30.248529+0000","last_undegraded":"2024-09-22T08:38:30.248529+0000","last_fullsized":"2024-09-22T08:38:30.248529+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:27:22.890604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4316,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":81,"num_read_kb":82,"num_write":32,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.223565+0000","last_change":"2024-09-22T08:36:32.003206+0000","last_active":"2024-09-22T08:37:04.223565+0000","last_peered":"2024-09-22T08:37:04.223565+0000","last_clean":"2024-09-22T08:37:04.223565+0000","last_became_active":"2024-09-22T08:36:32.002876+0000","last_became_peered":"2024-09-22T08:36:32.002876+0000","last_unstale":"2024-09-22T08:37:04.223565+0000","last_undegraded":"2024-09-22T08:37:04.223565+0000","last_fullsized":"2024-09-22T08:37:04.223565+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:07:07.136733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"30'2","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.228242+0000","last_change":"2024-09-22T08:36:34.016952+0000","last_active":"2024-09-22T08:37:04.228242+0000","last_peered":"2024-09-22T08:37:04.228242+0000","last_clean":"2024-09-22T08:37:04.228242+0000","last_became_active":"2024-09-22T08:36:34.016659+0000","last_became_peered":"2024-09-22T08:36:34.016659+0000","last_unstale":"2024-09-22T08:37:04.228242+0000","last_undegraded":"2024-09-22T08:37:04.228242+0000","last_fullsized":"2024-09-22T08:37:04.228242+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:01:42.781684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.229370+0000","last_change":"2024-09-22T08:36:34.015661+0000","last_active":"2024-09-22T08:37:04.229370+0000","last_peered":"2024-09-22T08:37:04.229370+0000","last_clean":"2024-09-22T08:37:04.229370+0000","last_became_active":"2024-09-22T08:36:34.015241+0000","last_became_peered":"2024-09-22T08:36:34.015241+0000","last_unstale":"2024-09-22T08:37:04.229370+0000","last_undegraded":"2024-09-22T08:37:04.229370+0000","last_fullsized":"2024-09-22T08:37:04.229370+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:13:28.913225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"32'4","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.259199+0000","last_change":"2024-09-22T08:36:25.987431+0000","last_active":"2024-09-22T08:39:32.259199+0000","last_peered":"2024-09-22T08:39:32.259199+0000","last_clean":"2024-09-22T08:39:32.259199+0000","last_became_active":"2024-09-22T08:36:25.987153+0000","last_became_peered":"2024-09-22T08:36:25.987153+0000","last_unstale":"2024-09-22T08:39:32.259199+0000","last_undegraded":"2024-09-22T08:39:32.259199+0000","last_fullsized":"2024-09-22T08:39:32.259199+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:33:37.909896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.225028+0000","last_change":"2024-09-22T08:36:23.982772+0000","last_active":"2024-09-22T08:37:04.225028+0000","last_peered":"2024-09-22T08:37:04.225028+0000","last_clean":"2024-09-22T08:37:04.225028+0000","last_became_active":"2024-09-22T08:36:23.981927+0000","last_became_peered":"2024-09-22T08:36:23.981927+0000","last_unstale":"2024-09-22T08:37:04.225028+0000","last_undegraded":"2024-09-22T08:37:04.225028+0000","last_fullsized":"2024-09-22T08:37:04.225028+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:12:33.585769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.222089+0000","last_change":"2024-09-22T08:36:27.990795+0000","last_active":"2024-09-22T08:37:04.222089+0000","last_peered":"2024-09-22T08:37:04.222089+0000","last_clean":"2024-09-22T08:37:04.222089+0000","last_became_active":"2024-09-22T08:36:27.990153+0000","last_became_peered":"2024-09-22T08:36:27.990153+0000","last_unstale":"2024-09-22T08:37:04.222089+0000","last_undegraded":"2024-09-22T08:37:04.222089+0000","last_fullsized":"2024-09-22T08:37:04.222089+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_clean_scrub_stamp":"2024-09-22T08:36:26.962226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:44:21.494770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"32'33","reported_seq":77,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:53.186450+0000","last_change":"2024-09-22T08:36:29.998789+0000","last_active":"2024-09-22T08:38:53.186450+0000","last_peered":"2024-09-22T08:38:53.186450+0000","last_clean":"2024-09-22T08:38:53.186450+0000","last_became_active":"2024-09-22T08:36:29.997814+0000","last_became_peered":"2024-09-22T08:36:29.997814+0000","last_unstale":"2024-09-22T08:38:53.186450+0000","last_undegraded":"2024-09-22T08:38:53.186450+0000","last_fullsized":"2024-09-22T08:38:53.186450+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:38:57.806502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5807,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":27,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.226536+0000","last_change":"2024-09-22T08:36:32.012924+0000","last_active":"2024-09-22T08:37:04.226536+0000","last_peered":"2024-09-22T08:37:04.226536+0000","last_clean":"2024-09-22T08:37:04.226536+0000","last_became_active":"2024-09-22T08:36:32.012453+0000","last_became_peered":"2024-09-22T08:36:32.012453+0000","last_unstale":"2024-09-22T08:37:04.226536+0000","last_undegraded":"2024-09-22T08:37:04.226536+0000","last_fullsized":"2024-09-22T08:37:04.226536+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:07:18.464448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"32'3","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:29.962024+0000","last_change":"2024-09-22T08:36:34.022519+0000","last_active":"2024-09-22T08:38:29.962024+0000","last_peered":"2024-09-22T08:38:29.962024+0000","last_clean":"2024-09-22T08:38:29.962024+0000","last_became_active":"2024-09-22T08:36:34.022267+0000","last_became_peered":"2024-09-22T08:36:34.022267+0000","last_unstale":"2024-09-22T08:38:29.962024+0000","last_undegraded":"2024-09-22T08:38:29.962024+0000","last_fullsized":"2024-09-22T08:38:29.962024+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:48:06.628364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"32'6","reported_seq":82,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:05.120194+0000","last_change":"2024-09-22T08:36:25.986871+0000","last_active":"2024-09-22T08:37:05.120194+0000","last_peered":"2024-09-22T08:37:05.120194+0000","last_clean":"2024-09-22T08:37:05.120194+0000","last_became_active":"2024-09-22T08:36:25.986613+0000","last_became_peered":"2024-09-22T08:36:25.986613+0000","last_unstale":"2024-09-22T08:37:05.120194+0000","last_undegraded":"2024-09-22T08:37:05.120194+0000","last_fullsized":"2024-09-22T08:37:05.120194+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:34:39.892614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":60,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.225905+0000","last_change":"2024-09-22T08:36:23.978519+0000","last_active":"2024-09-22T08:37:04.225905+0000","last_peered":"2024-09-22T08:37:04.225905+0000","last_clean":"2024-09-22T08:37:04.225905+0000","last_became_active":"2024-09-22T08:36:23.978282+0000","last_became_peered":"2024-09-22T08:36:23.978282+0000","last_unstale":"2024-09-22T08:37:04.225905+0000","last_undegraded":"2024-09-22T08:37:04.225905+0000","last_fullsized":"2024-09-22T08:37:04.225905+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:27:04.674711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.230277+0000","last_change":"2024-09-22T08:36:27.986336+0000","last_active":"2024-09-22T08:37:04.230277+0000","last_peered":"2024-09-22T08:37:04.230277+0000","last_clean":"2024-09-22T08:37:04.230277+0000","last_became_active":"2024-09-22T08:36:27.986033+0000","last_became_peered":"2024-09-22T08:36:27.986033+0000","last_unstale":"2024-09-22T08:37:04.230277+0000","last_undegraded":"2024-09-22T08:37:04.230277+0000","last_fullsized":"2024-09-22T08:37:04.230277+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_clean_scrub_stamp":"2024-09-22T08:36:26.962226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:54:43.939868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"32'6","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:31.680000+0000","last_change":"2024-09-22T08:36:29.990307+0000","last_active":"2024-09-22T08:39:31.680000+0000","last_peered":"2024-09-22T08:39:31.680000+0000","last_clean":"2024-09-22T08:39:31.680000+0000","last_became_active":"2024-09-22T08:36:29.990057+0000","last_became_peered":"2024-09-22T08:36:29.990057+0000","last_unstale":"2024-09-22T08:39:31.680000+0000","last_undegraded":"2024-09-22T08:39:31.680000+0000","last_fullsized":"2024-09-22T08:39:31.680000+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:20:39.541039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.228183+0000","last_change":"2024-09-22T08:36:32.010964+0000","last_active":"2024-09-22T08:37:04.228183+0000","last_peered":"2024-09-22T08:37:04.228183+0000","last_clean":"2024-09-22T08:37:04.228183+0000","last_became_active":"2024-09-22T08:36:32.010692+0000","last_became_peered":"2024-09-22T08:36:32.010692+0000","last_unstale":"2024-09-22T08:37:04.228183+0000","last_undegraded":"2024-09-22T08:37:04.228183+0000","last_fullsized":"2024-09-22T08:37:04.228183+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:42:56.003470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"32'8","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:31.738292+0000","last_change":"2024-09-22T08:36:34.017610+0000","last_active":"2024-09-22T08:39:31.738292+0000","last_peered":"2024-09-22T08:39:31.738292+0000","last_clean":"2024-09-22T08:39:31.738292+0000","last_became_active":"2024-09-22T08:36:34.017181+0000","last_became_peered":"2024-09-22T08:36:34.017181+0000","last_unstale":"2024-09-22T08:39:31.738292+0000","last_undegraded":"2024-09-22T08:39:31.738292+0000","last_fullsized":"2024-09-22T08:39:31.738292+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:00:36.254978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":21,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"32'6","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.214871+0000","last_change":"2024-09-22T08:36:25.975177+0000","last_active":"2024-09-22T08:39:32.214871+0000","last_peered":"2024-09-22T08:39:32.214871+0000","last_clean":"2024-09-22T08:39:32.214871+0000","last_became_active":"2024-09-22T08:36:25.974797+0000","last_became_peered":"2024-09-22T08:36:25.974797+0000","last_unstale":"2024-09-22T08:39:32.214871+0000","last_undegraded":"2024-09-22T08:39:32.214871+0000","last_fullsized":"2024-09-22T08:39:32.214871+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:45:56.482158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.613051+0000","last_change":"2024-09-22T08:36:23.974236+0000","last_active":"2024-09-22T08:37:04.613051+0000","last_peered":"2024-09-22T08:37:04.613051+0000","last_clean":"2024-09-22T08:37:04.613051+0000","last_became_active":"2024-09-22T08:36:23.973601+0000","last_became_peered":"2024-09-22T08:36:23.973601+0000","last_unstale":"2024-09-22T08:37:04.613051+0000","last_undegraded":"2024-09-22T08:37:04.613051+0000","last_fullsized":"2024-09-22T08:37:04.613051+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:39:33.026572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.222812+0000","last_change":"2024-09-22T08:36:27.986446+0000","last_active":"2024-09-22T08:37:04.222812+0000","last_peered":"2024-09-22T08:37:04.222812+0000","last_clean":"2024-09-22T08:37:04.222812+0000","last_became_active":"2024-09-22T08:36:27.986100+0000","last_became_peered":"2024-09-22T08:36:27.986100+0000","last_unstale":"2024-09-22T08:37:04.222812+0000","last_undegraded":"2024-09-22T08:37:04.222812+0000","last_fullsized":"2024-09-22T08:37:04.222812+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_clean_scrub_stamp":"2024-09-22T08:36:26.962226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:23:06.708649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"32'40","reported_seq":100,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:31.718665+0000","last_change":"2024-09-22T08:36:29.992078+0000","last_active":"2024-09-22T08:39:31.718665+0000","last_peered":"2024-09-22T08:39:31.718665+0000","last_clean":"2024-09-22T08:39:31.718665+0000","last_became_active":"2024-09-22T08:36:29.991732+0000","last_became_peered":"2024-09-22T08:36:29.991732+0000","last_unstale":"2024-09-22T08:39:31.718665+0000","last_undegraded":"2024-09-22T08:39:31.718665+0000","last_fullsized":"2024-09-22T08:39:31.718665+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:54:46.326822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":61,"num_read_kb":64,"num_write":46,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.221450+0000","last_change":"2024-09-22T08:36:32.003244+0000","last_active":"2024-09-22T08:37:04.221450+0000","last_peered":"2024-09-22T08:37:04.221450+0000","last_clean":"2024-09-22T08:37:04.221450+0000","last_became_active":"2024-09-22T08:36:32.002970+0000","last_became_peered":"2024-09-22T08:36:32.002970+0000","last_unstale":"2024-09-22T08:37:04.221450+0000","last_undegraded":"2024-09-22T08:37:04.221450+0000","last_fullsized":"2024-09-22T08:37:04.221450+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:19:57.326474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"32'4","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.344891+0000","last_change":"2024-09-22T08:36:34.016939+0000","last_active":"2024-09-22T08:39:32.344891+0000","last_peered":"2024-09-22T08:39:32.344891+0000","last_clean":"2024-09-22T08:39:32.344891+0000","last_became_active":"2024-09-22T08:36:34.016379+0000","last_became_peered":"2024-09-22T08:36:34.016379+0000","last_unstale":"2024-09-22T08:39:32.344891+0000","last_undegraded":"2024-09-22T08:39:32.344891+0000","last_fullsized":"2024-09-22T08:39:32.344891+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:50:54.870215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":421,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"32'6","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:28.582884+0000","last_change":"2024-09-22T08:36:25.988849+0000","last_active":"2024-09-22T08:38:28.582884+0000","last_peered":"2024-09-22T08:38:28.582884+0000","last_clean":"2024-09-22T08:38:28.582884+0000","last_became_active":"2024-09-22T08:36:25.988569+0000","last_became_peered":"2024-09-22T08:36:25.988569+0000","last_unstale":"2024-09-22T08:38:28.582884+0000","last_undegraded":"2024-09-22T08:38:28.582884+0000","last_fullsized":"2024-09-22T08:38:28.582884+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:18:26.519986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.224287+0000","last_change":"2024-09-22T08:36:23.977609+0000","last_active":"2024-09-22T08:37:04.224287+0000","last_peered":"2024-09-22T08:37:04.224287+0000","last_clean":"2024-09-22T08:37:04.224287+0000","last_became_active":"2024-09-22T08:36:23.977355+0000","last_became_peered":"2024-09-22T08:36:23.977355+0000","last_unstale":"2024-09-22T08:37:04.224287+0000","last_undegraded":"2024-09-22T08:37:04.224287+0000","last_fullsized":"2024-09-22T08:37:04.224287+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:58:35.337314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"32'4","reported_seq":227,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:31.297357+0000","last_change":"2024-09-22T08:36:27.987952+0000","last_active":"2024-09-22T08:38:31.297357+0000","last_peered":"2024-09-22T08:38:31.297357+0000","last_clean":"2024-09-22T08:38:31.297357+0000","last_became_active":"2024-09-22T08:36:27.987561+0000","last_became_peered":"2024-09-22T08:36:27.987561+0000","last_unstale":"2024-09-22T08:38:31.297357+0000","last_undegraded":"2024-09-22T08:38:31.297357+0000","last_fullsized":"2024-09-22T08:38:31.297357+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_clean_scrub_stamp":"2024-09-22T08:36:26.962226+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:59:38.794944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":298,"num_read_kb":298,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"32'31","reported_seq":74,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:31.651146+0000","last_change":"2024-09-22T08:36:29.989156+0000","last_active":"2024-09-22T08:38:31.651146+0000","last_peered":"2024-09-22T08:38:31.651146+0000","last_clean":"2024-09-22T08:38:31.651146+0000","last_became_active":"2024-09-22T08:36:29.988607+0000","last_became_peered":"2024-09-22T08:36:29.988607+0000","last_unstale":"2024-09-22T08:38:31.651146+0000","last_undegraded":"2024-09-22T08:38:31.651146+0000","last_fullsized":"2024-09-22T08:38:31.651146+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:59:53.178494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.225600+0000","last_change":"2024-09-22T08:36:32.003908+0000","last_active":"2024-09-22T08:37:04.225600+0000","last_peered":"2024-09-22T08:37:04.225600+0000","last_clean":"2024-09-22T08:37:04.225600+0000","last_became_active":"2024-09-22T08:36:32.003651+0000","last_became_peered":"2024-09-22T08:36:32.003651+0000","last_unstale":"2024-09-22T08:37:04.225600+0000","last_undegraded":"2024-09-22T08:37:04.225600+0000","last_fullsized":"2024-09-22T08:37:04.225600+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:39:25.611419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"32'10","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.259871+0000","last_change":"2024-09-22T08:36:25.990717+0000","last_active":"2024-09-22T08:39:32.259871+0000","last_peered":"2024-09-22T08:39:32.259871+0000","last_clean":"2024-09-22T08:39:32.259871+0000","last_became_active":"2024-09-22T08:36:25.989711+0000","last_became_peered":"2024-09-22T08:36:25.989711+0000","last_unstale":"2024-09-22T08:39:32.259871+0000","last_undegraded":"2024-09-22T08:39:32.259871+0000","last_fullsized":"2024-09-22T08:39:32.259871+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:59:02.745529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.226013+0000","last_change":"2024-09-22T08:36:23.976596+0000","last_active":"2024-09-22T08:37:04.226013+0000","last_peered":"2024-09-22T08:37:04.226013+0000","last_clean":"2024-09-22T08:37:04.226013+0000","last_became_active":"2024-09-22T08:36:23.976361+0000","last_became_peered":"2024-09-22T08:36:23.976361+0000","last_unstale":"2024-09-22T08:37:04.226013+0000","last_undegraded":"2024-09-22T08:37:04.226013+0000","last_fullsized":"2024-09-22T08:37:04.226013+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:18:29.806715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.226375+0000","last_change":"2024-09-22T08:36:27.988289+0000","last_active":"2024-09-22T08:37:04.226375+0000","last_peered":"2024-09-22T08:37:04.226375+0000","last_clean":"2024-09-22T08:37:04.226375+0000","last_became_active":"2024-09-22T08:36:27.987981+0000","last_became_peered":"2024-09-22T08:36:27.987981+0000","last_unstale":"2024-09-22T08:37:04.226375+0000","last_undegraded":"2024-09-22T08:37:04.226375+0000","last_fullsized":"2024-09-22T08:37:04.226375+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_clean_scrub_stamp":"2024-09-22T08:36:26.962226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:43:32.535149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"32'55","reported_seq":112,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:03.181425+0000","last_change":"2024-09-22T08:36:29.990823+0000","last_active":"2024-09-22T08:39:03.181425+0000","last_peered":"2024-09-22T08:39:03.181425+0000","last_clean":"2024-09-22T08:39:03.181425+0000","last_became_active":"2024-09-22T08:36:29.990585+0000","last_became_peered":"2024-09-22T08:36:29.990585+0000","last_unstale":"2024-09-22T08:39:03.181425+0000","last_undegraded":"2024-09-22T08:39:03.181425+0000","last_fullsized":"2024-09-22T08:39:03.181425+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:09:56.176060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.226461+0000","last_change":"2024-09-22T08:36:32.007693+0000","last_active":"2024-09-22T08:37:04.226461+0000","last_peered":"2024-09-22T08:37:04.226461+0000","last_clean":"2024-09-22T08:37:04.226461+0000","last_became_active":"2024-09-22T08:36:32.007448+0000","last_became_peered":"2024-09-22T08:36:32.007448+0000","last_unstale":"2024-09-22T08:37:04.226461+0000","last_undegraded":"2024-09-22T08:37:04.226461+0000","last_fullsized":"2024-09-22T08:37:04.226461+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:30:19.529413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"32'16","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.263979+0000","last_change":"2024-09-22T08:36:34.017989+0000","last_active":"2024-09-22T08:39:32.263979+0000","last_peered":"2024-09-22T08:39:32.263979+0000","last_clean":"2024-09-22T08:39:32.263979+0000","last_became_active":"2024-09-22T08:36:34.017689+0000","last_became_peered":"2024-09-22T08:36:34.017689+0000","last_unstale":"2024-09-22T08:39:32.263979+0000","last_undegraded":"2024-09-22T08:39:32.263979+0000","last_fullsized":"2024-09-22T08:39:32.263979+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:59:28.875467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":21,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"32'2","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.260499+0000","last_change":"2024-09-22T08:36:25.978215+0000","last_active":"2024-09-22T08:39:32.260499+0000","last_peered":"2024-09-22T08:39:32.260499+0000","last_clean":"2024-09-22T08:39:32.260499+0000","last_became_active":"2024-09-22T08:36:25.977881+0000","last_became_peered":"2024-09-22T08:36:25.977881+0000","last_unstale":"2024-09-22T08:39:32.260499+0000","last_undegraded":"2024-09-22T08:39:32.260499+0000","last_fullsized":"2024-09-22T08:39:32.260499+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:49:05.012514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.221193+0000","last_change":"2024-09-22T08:36:23.975068+0000","last_active":"2024-09-22T08:37:04.221193+0000","last_peered":"2024-09-22T08:37:04.221193+0000","last_clean":"2024-09-22T08:37:04.221193+0000","last_became_active":"2024-09-22T08:36:23.974809+0000","last_became_peered":"2024-09-22T08:36:23.974809+0000","last_unstale":"2024-09-22T08:37:04.221193+0000","last_undegraded":"2024-09-22T08:37:04.221193+0000","last_fullsized":"2024-09-22T08:37:04.221193+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:07:03.805843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.228600+0000","last_change":"2024-09-22T08:36:27.987444+0000","last_active":"2024-09-22T08:37:04.228600+0000","last_peered":"2024-09-22T08:37:04.228600+0000","last_clean":"2024-09-22T08:37:04.228600+0000","last_became_active":"2024-09-22T08:36:27.986957+0000","last_became_peered":"2024-09-22T08:36:27.986957+0000","last_unstale":"2024-09-22T08:37:04.228600+0000","last_undegraded":"2024-09-22T08:37:04.228600+0000","last_fullsized":"2024-09-22T08:37:04.228600+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_clean_scrub_stamp":"2024-09-22T08:36:26.962226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:12:16.352882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"32'36","reported_seq":82,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:30.240401+0000","last_change":"2024-09-22T08:36:29.998426+0000","last_active":"2024-09-22T08:38:30.240401+0000","last_peered":"2024-09-22T08:38:30.240401+0000","last_clean":"2024-09-22T08:38:30.240401+0000","last_became_active":"2024-09-22T08:36:29.997527+0000","last_became_peered":"2024-09-22T08:36:29.997527+0000","last_unstale":"2024-09-22T08:38:30.240401+0000","last_undegraded":"2024-09-22T08:38:30.240401+0000","last_fullsized":"2024-09-22T08:38:30.240401+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:26:30.343603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.224280+0000","last_change":"2024-09-22T08:36:32.005672+0000","last_active":"2024-09-22T08:37:04.224280+0000","last_peered":"2024-09-22T08:37:04.224280+0000","last_clean":"2024-09-22T08:37:04.224280+0000","last_became_active":"2024-09-22T08:36:32.005383+0000","last_became_peered":"2024-09-22T08:36:32.005383+0000","last_unstale":"2024-09-22T08:37:04.224280+0000","last_undegraded":"2024-09-22T08:37:04.224280+0000","last_fullsized":"2024-09-22T08:37:04.224280+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:13:26.905617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.227134+0000","last_change":"2024-09-22T08:36:34.013499+0000","last_active":"2024-09-22T08:37:04.227134+0000","last_peered":"2024-09-22T08:37:04.227134+0000","last_clean":"2024-09-22T08:37:04.227134+0000","last_became_active":"2024-09-22T08:36:34.013204+0000","last_became_peered":"2024-09-22T08:36:34.013204+0000","last_unstale":"2024-09-22T08:37:04.227134+0000","last_undegraded":"2024-09-22T08:37:04.227134+0000","last_fullsized":"2024-09-22T08:37:04.227134+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:37:55.724456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"32'14","reported_seq":66,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.268386+0000","last_change":"2024-09-22T08:36:25.993915+0000","last_active":"2024-09-22T08:39:32.268386+0000","last_peered":"2024-09-22T08:39:32.268386+0000","last_clean":"2024-09-22T08:39:32.268386+0000","last_became_active":"2024-09-22T08:36:25.993170+0000","last_became_peered":"2024-09-22T08:36:25.993170+0000","last_unstale":"2024-09-22T08:39:32.268386+0000","last_undegraded":"2024-09-22T08:39:32.268386+0000","last_fullsized":"2024-09-22T08:39:32.268386+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:39:33.156873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":38,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.221803+0000","last_change":"2024-09-22T08:36:23.968477+0000","last_active":"2024-09-22T08:37:04.221803+0000","last_peered":"2024-09-22T08:37:04.221803+0000","last_clean":"2024-09-22T08:37:04.221803+0000","last_became_active":"2024-09-22T08:36:23.968207+0000","last_became_peered":"2024-09-22T08:36:23.968207+0000","last_unstale":"2024-09-22T08:37:04.221803+0000","last_undegraded":"2024-09-22T08:37:04.221803+0000","last_fullsized":"2024-09-22T08:37:04.221803+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:13:42.558254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.226357+0000","last_change":"2024-09-22T08:36:27.986023+0000","last_active":"2024-09-22T08:37:04.226357+0000","last_peered":"2024-09-22T08:37:04.226357+0000","last_clean":"2024-09-22T08:37:04.226357+0000","last_became_active":"2024-09-22T08:36:27.985679+0000","last_became_peered":"2024-09-22T08:36:27.985679+0000","last_unstale":"2024-09-22T08:37:04.226357+0000","last_undegraded":"2024-09-22T08:37:04.226357+0000","last_fullsized":"2024-09-22T08:37:04.226357+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_clean_scrub_stamp":"2024-09-22T08:36:26.962226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:14:11.716507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"32'32","reported_seq":76,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:30.258654+0000","last_change":"2024-09-22T08:36:29.994386+0000","last_active":"2024-09-22T08:38:30.258654+0000","last_peered":"2024-09-22T08:38:30.258654+0000","last_clean":"2024-09-22T08:38:30.258654+0000","last_became_active":"2024-09-22T08:36:29.994075+0000","last_became_peered":"2024-09-22T08:36:29.994075+0000","last_unstale":"2024-09-22T08:38:30.258654+0000","last_undegraded":"2024-09-22T08:38:30.258654+0000","last_fullsized":"2024-09-22T08:38:30.258654+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:01:51.899745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.225288+0000","last_change":"2024-09-22T08:36:32.005675+0000","last_active":"2024-09-22T08:37:04.225288+0000","last_peered":"2024-09-22T08:37:04.225288+0000","last_clean":"2024-09-22T08:37:04.225288+0000","last_became_active":"2024-09-22T08:36:32.005166+0000","last_became_peered":"2024-09-22T08:36:32.005166+0000","last_unstale":"2024-09-22T08:37:04.225288+0000","last_undegraded":"2024-09-22T08:37:04.225288+0000","last_fullsized":"2024-09-22T08:37:04.225288+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:04:54.919867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"32'7","reported_seq":25,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.093378+0000","last_change":"2024-09-22T08:36:34.014540+0000","last_active":"2024-09-22T08:39:32.093378+0000","last_peered":"2024-09-22T08:39:32.093378+0000","last_clean":"2024-09-22T08:39:32.093378+0000","last_became_active":"2024-09-22T08:36:34.014255+0000","last_became_peered":"2024-09-22T08:36:34.014255+0000","last_unstale":"2024-09-22T08:39:32.093378+0000","last_undegraded":"2024-09-22T08:39:32.093378+0000","last_fullsized":"2024-09-22T08:39:32.093378+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:47:25.081359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"32'4","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.078924+0000","last_change":"2024-09-22T08:36:25.978994+0000","last_active":"2024-09-22T08:39:32.078924+0000","last_peered":"2024-09-22T08:39:32.078924+0000","last_clean":"2024-09-22T08:39:32.078924+0000","last_became_active":"2024-09-22T08:36:25.978577+0000","last_became_peered":"2024-09-22T08:36:25.978577+0000","last_unstale":"2024-09-22T08:39:32.078924+0000","last_undegraded":"2024-09-22T08:39:32.078924+0000","last_fullsized":"2024-09-22T08:39:32.078924+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:02:49.260377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"32'2","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:08.164913+0000","last_change":"2024-09-22T08:37:04.226650+0000","last_active":"2024-09-22T08:37:08.164913+0000","last_peered":"2024-09-22T08:37:08.164913+0000","last_clean":"2024-09-22T08:37:08.164913+0000","last_became_active":"2024-09-22T08:37:04.226169+0000","last_became_peered":"2024-09-22T08:37:04.226169+0000","last_unstale":"2024-09-22T08:37:08.164913+0000","last_undegraded":"2024-09-22T08:37:08.164913+0000","last_fullsized":"2024-09-22T08:37:08.164913+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:34:07.480067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.223988+0000","last_change":"2024-09-22T08:36:27.990314+0000","last_active":"2024-09-22T08:37:04.223988+0000","last_peered":"2024-09-22T08:37:04.223988+0000","last_clean":"2024-09-22T08:37:04.223988+0000","last_became_active":"2024-09-22T08:36:27.990038+0000","last_became_peered":"2024-09-22T08:36:27.990038+0000","last_unstale":"2024-09-22T08:37:04.223988+0000","last_undegraded":"2024-09-22T08:37:04.223988+0000","last_fullsized":"2024-09-22T08:37:04.223988+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_clean_scrub_stamp":"2024-09-22T08:36:26.962226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:42:33.084977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"30'10","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.227216+0000","last_change":"2024-09-22T08:36:29.997480+0000","last_active":"2024-09-22T08:37:04.227216+0000","last_peered":"2024-09-22T08:37:04.227216+0000","last_clean":"2024-09-22T08:37:04.227216+0000","last_became_active":"2024-09-22T08:36:29.997179+0000","last_became_peered":"2024-09-22T08:36:29.997179+0000","last_unstale":"2024-09-22T08:37:04.227216+0000","last_undegraded":"2024-09-22T08:37:04.227216+0000","last_fullsized":"2024-09-22T08:37:04.227216+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:42:36.332989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"32'282","reported_seq":366,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:28.067529+0000","last_change":"2024-09-22T08:36:32.012171+0000","last_active":"2024-09-22T08:39:28.067529+0000","last_peered":"2024-09-22T08:39:28.067529+0000","last_clean":"2024-09-22T08:39:28.067529+0000","last_became_active":"2024-09-22T08:36:32.011870+0000","last_became_peered":"2024-09-22T08:36:32.011870+0000","last_unstale":"2024-09-22T08:39:28.067529+0000","last_undegraded":"2024-09-22T08:39:28.067529+0000","last_fullsized":"2024-09-22T08:39:28.067529+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:20:17.853772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"32'2","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.248674+0000","last_change":"2024-09-22T08:36:34.013756+0000","last_active":"2024-09-22T08:39:32.248674+0000","last_peered":"2024-09-22T08:39:32.248674+0000","last_clean":"2024-09-22T08:39:32.248674+0000","last_became_active":"2024-09-22T08:36:34.013380+0000","last_became_peered":"2024-09-22T08:36:34.013380+0000","last_unstale":"2024-09-22T08:39:32.248674+0000","last_undegraded":"2024-09-22T08:39:32.248674+0000","last_fullsized":"2024-09-22T08:39:32.248674+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:26:36.228816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"32'8","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:31.647867+0000","last_change":"2024-09-22T08:36:25.971626+0000","last_active":"2024-09-22T08:38:31.647867+0000","last_peered":"2024-09-22T08:38:31.647867+0000","last_clean":"2024-09-22T08:38:31.647867+0000","last_became_active":"2024-09-22T08:36:25.971327+0000","last_became_peered":"2024-09-22T08:36:25.971327+0000","last_unstale":"2024-09-22T08:38:31.647867+0000","last_undegraded":"2024-09-22T08:38:31.647867+0000","last_fullsized":"2024-09-22T08:38:31.647867+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:06:32.443392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.284576+0000","last_change":"2024-09-22T08:36:23.978262+0000","last_active":"2024-09-22T08:39:32.284576+0000","last_peered":"2024-09-22T08:39:32.284576+0000","last_clean":"2024-09-22T08:39:32.284576+0000","last_became_active":"2024-09-22T08:36:23.978006+0000","last_became_peered":"2024-09-22T08:36:23.978006+0000","last_unstale":"2024-09-22T08:39:32.284576+0000","last_undegraded":"2024-09-22T08:39:32.284576+0000","last_fullsized":"2024-09-22T08:39:32.284576+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:02:28.926834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.222677+0000","last_change":"2024-09-22T08:36:27.991045+0000","last_active":"2024-09-22T08:37:04.222677+0000","last_peered":"2024-09-22T08:37:04.222677+0000","last_clean":"2024-09-22T08:37:04.222677+0000","last_became_active":"2024-09-22T08:36:27.990729+0000","last_became_peered":"2024-09-22T08:36:27.990729+0000","last_unstale":"2024-09-22T08:37:04.222677+0000","last_undegraded":"2024-09-22T08:37:04.222677+0000","last_fullsized":"2024-09-22T08:37:04.222677+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_clean_scrub_stamp":"2024-09-22T08:36:26.962226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:27:20.880200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"32'36","reported_seq":82,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:30.230410+0000","last_change":"2024-09-22T08:36:29.987777+0000","last_active":"2024-09-22T08:38:30.230410+0000","last_peered":"2024-09-22T08:38:30.230410+0000","last_clean":"2024-09-22T08:38:30.230410+0000","last_became_active":"2024-09-22T08:36:29.987459+0000","last_became_peered":"2024-09-22T08:36:29.987459+0000","last_unstale":"2024-09-22T08:38:30.230410+0000","last_undegraded":"2024-09-22T08:38:30.230410+0000","last_fullsized":"2024-09-22T08:38:30.230410+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:30:17.280632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.222754+0000","last_change":"2024-09-22T08:36:32.003472+0000","last_active":"2024-09-22T08:37:04.222754+0000","last_peered":"2024-09-22T08:37:04.222754+0000","last_clean":"2024-09-22T08:37:04.222754+0000","last_became_active":"2024-09-22T08:36:32.003196+0000","last_became_peered":"2024-09-22T08:36:32.003196+0000","last_unstale":"2024-09-22T08:37:04.222754+0000","last_undegraded":"2024-09-22T08:37:04.222754+0000","last_fullsized":"2024-09-22T08:37:04.222754+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:42:54.487167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.223793+0000","last_change":"2024-09-22T08:36:34.016292+0000","last_active":"2024-09-22T08:37:04.223793+0000","last_peered":"2024-09-22T08:37:04.223793+0000","last_clean":"2024-09-22T08:37:04.223793+0000","last_became_active":"2024-09-22T08:36:34.015988+0000","last_became_peered":"2024-09-22T08:36:34.015988+0000","last_unstale":"2024-09-22T08:37:04.223793+0000","last_undegraded":"2024-09-22T08:37:04.223793+0000","last_fullsized":"2024-09-22T08:37:04.223793+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:16:42.030515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"32'4","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:31.648006+0000","last_change":"2024-09-22T08:36:25.972487+0000","last_active":"2024-09-22T08:38:31.648006+0000","last_peered":"2024-09-22T08:38:31.648006+0000","last_clean":"2024-09-22T08:38:31.648006+0000","last_became_active":"2024-09-22T08:36:25.972149+0000","last_became_peered":"2024-09-22T08:36:25.972149+0000","last_unstale":"2024-09-22T08:38:31.648006+0000","last_undegraded":"2024-09-22T08:38:31.648006+0000","last_fullsized":"2024-09-22T08:38:31.648006+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:06:31.006207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"32'1","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:58.187460+0000","last_change":"2024-09-22T08:36:23.983004+0000","last_active":"2024-09-22T08:38:58.187460+0000","last_peered":"2024-09-22T08:38:58.187460+0000","last_clean":"2024-09-22T08:38:58.187460+0000","last_became_active":"2024-09-22T08:36:23.982545+0000","last_became_peered":"2024-09-22T08:36:23.982545+0000","last_unstale":"2024-09-22T08:38:58.187460+0000","last_undegraded":"2024-09-22T08:38:58.187460+0000","last_fullsized":"2024-09-22T08:38:58.187460+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:02:24.513946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.225495+0000","last_change":"2024-09-22T08:36:27.989826+0000","last_active":"2024-09-22T08:37:04.225495+0000","last_peered":"2024-09-22T08:37:04.225495+0000","last_clean":"2024-09-22T08:37:04.225495+0000","last_became_active":"2024-09-22T08:36:27.989495+0000","last_became_peered":"2024-09-22T08:36:27.989495+0000","last_unstale":"2024-09-22T08:37:04.225495+0000","last_undegraded":"2024-09-22T08:37:04.225495+0000","last_fullsized":"2024-09-22T08:37:04.225495+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_clean_scrub_stamp":"2024-09-22T08:36:26.962226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:36:51.183212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"32'30","reported_seq":73,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:30.231982+0000","last_change":"2024-09-22T08:36:29.994337+0000","last_active":"2024-09-22T08:38:30.231982+0000","last_peered":"2024-09-22T08:38:30.231982+0000","last_clean":"2024-09-22T08:38:30.231982+0000","last_became_active":"2024-09-22T08:36:29.994101+0000","last_became_peered":"2024-09-22T08:36:29.994101+0000","last_unstale":"2024-09-22T08:38:30.231982+0000","last_undegraded":"2024-09-22T08:38:30.231982+0000","last_fullsized":"2024-09-22T08:38:30.231982+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:40:06.073383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.230375+0000","last_change":"2024-09-22T08:36:32.012960+0000","last_active":"2024-09-22T08:37:04.230375+0000","last_peered":"2024-09-22T08:37:04.230375+0000","last_clean":"2024-09-22T08:37:04.230375+0000","last_became_active":"2024-09-22T08:36:32.011811+0000","last_became_peered":"2024-09-22T08:36:32.011811+0000","last_unstale":"2024-09-22T08:37:04.230375+0000","last_undegraded":"2024-09-22T08:37:04.230375+0000","last_fullsized":"2024-09-22T08:37:04.230375+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:13:22.789596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"32'2","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:05.456749+0000","last_change":"2024-09-22T08:36:34.020146+0000","last_active":"2024-09-22T08:37:05.456749+0000","last_peered":"2024-09-22T08:37:05.456749+0000","last_clean":"2024-09-22T08:37:05.456749+0000","last_became_active":"2024-09-22T08:36:34.019866+0000","last_became_peered":"2024-09-22T08:36:34.019866+0000","last_unstale":"2024-09-22T08:37:05.456749+0000","last_undegraded":"2024-09-22T08:37:05.456749+0000","last_fullsized":"2024-09-22T08:37:05.456749+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:56:15.623151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:31.647295+0000","last_change":"2024-09-22T08:36:25.989899+0000","last_active":"2024-09-22T08:38:31.647295+0000","last_peered":"2024-09-22T08:38:31.647295+0000","last_clean":"2024-09-22T08:38:31.647295+0000","last_became_active":"2024-09-22T08:36:25.989572+0000","last_became_peered":"2024-09-22T08:36:25.989572+0000","last_unstale":"2024-09-22T08:38:31.647295+0000","last_undegraded":"2024-09-22T08:38:31.647295+0000","last_fullsized":"2024-09-22T08:38:31.647295+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:11:07.278941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.225893+0000","last_change":"2024-09-22T08:36:23.971403+0000","last_active":"2024-09-22T08:37:04.225893+0000","last_peered":"2024-09-22T08:37:04.225893+0000","last_clean":"2024-09-22T08:37:04.225893+0000","last_became_active":"2024-09-22T08:36:23.971012+0000","last_became_peered":"2024-09-22T08:36:23.971012+0000","last_unstale":"2024-09-22T08:37:04.225893+0000","last_undegraded":"2024-09-22T08:37:04.225893+0000","last_fullsized":"2024-09-22T08:37:04.225893+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:38:20.349572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.222066+0000","last_change":"2024-09-22T08:36:27.987755+0000","last_active":"2024-09-22T08:37:04.222066+0000","last_peered":"2024-09-22T08:37:04.222066+0000","last_clean":"2024-09-22T08:37:04.222066+0000","last_became_active":"2024-09-22T08:36:27.987504+0000","last_became_peered":"2024-09-22T08:36:27.987504+0000","last_unstale":"2024-09-22T08:37:04.222066+0000","last_undegraded":"2024-09-22T08:37:04.222066+0000","last_fullsized":"2024-09-22T08:37:04.222066+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_clean_scrub_stamp":"2024-09-22T08:36:26.962226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:39:03.985092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"32'26","reported_seq":67,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:30.256486+0000","last_change":"2024-09-22T08:36:29.998167+0000","last_active":"2024-09-22T08:38:30.256486+0000","last_peered":"2024-09-22T08:38:30.256486+0000","last_clean":"2024-09-22T08:38:30.256486+0000","last_became_active":"2024-09-22T08:36:29.997853+0000","last_became_peered":"2024-09-22T08:36:29.997853+0000","last_unstale":"2024-09-22T08:38:30.256486+0000","last_undegraded":"2024-09-22T08:38:30.256486+0000","last_fullsized":"2024-09-22T08:38:30.256486+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:34:13.019632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":23,"num_read_kb":19,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.227451+0000","last_change":"2024-09-22T08:36:32.012262+0000","last_active":"2024-09-22T08:37:04.227451+0000","last_peered":"2024-09-22T08:37:04.227451+0000","last_clean":"2024-09-22T08:37:04.227451+0000","last_became_active":"2024-09-22T08:36:32.011960+0000","last_became_peered":"2024-09-22T08:36:32.011960+0000","last_unstale":"2024-09-22T08:37:04.227451+0000","last_undegraded":"2024-09-22T08:37:04.227451+0000","last_fullsized":"2024-09-22T08:37:04.227451+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:58:25.357801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"32'16","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:30.267408+0000","last_change":"2024-09-22T08:36:34.018605+0000","last_active":"2024-09-22T08:38:30.267408+0000","last_peered":"2024-09-22T08:38:30.267408+0000","last_clean":"2024-09-22T08:38:30.267408+0000","last_became_active":"2024-09-22T08:36:34.018365+0000","last_became_peered":"2024-09-22T08:36:34.018365+0000","last_unstale":"2024-09-22T08:38:30.267408+0000","last_undegraded":"2024-09-22T08:38:30.267408+0000","last_fullsized":"2024-09-22T08:38:30.267408+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:01:49.722849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":96,"num_read_kb":76,"num_write":46,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"32'8","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.081475+0000","last_change":"2024-09-22T08:36:25.973362+0000","last_active":"2024-09-22T08:39:32.081475+0000","last_peered":"2024-09-22T08:39:32.081475+0000","last_clean":"2024-09-22T08:39:32.081475+0000","last_became_active":"2024-09-22T08:36:25.973089+0000","last_became_peered":"2024-09-22T08:36:25.973089+0000","last_unstale":"2024-09-22T08:39:32.081475+0000","last_undegraded":"2024-09-22T08:39:32.081475+0000","last_fullsized":"2024-09-22T08:39:32.081475+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:11:06.136833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.612779+0000","last_change":"2024-09-22T08:36:23.968591+0000","last_active":"2024-09-22T08:37:04.612779+0000","last_peered":"2024-09-22T08:37:04.612779+0000","last_clean":"2024-09-22T08:37:04.612779+0000","last_became_active":"2024-09-22T08:36:23.968249+0000","last_became_peered":"2024-09-22T08:36:23.968249+0000","last_unstale":"2024-09-22T08:37:04.612779+0000","last_undegraded":"2024-09-22T08:37:04.612779+0000","last_fullsized":"2024-09-22T08:37:04.612779+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:00:39.104995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"32'2","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:28.952357+0000","last_change":"2024-09-22T08:36:27.988537+0000","last_active":"2024-09-22T08:38:28.952357+0000","last_peered":"2024-09-22T08:38:28.952357+0000","last_clean":"2024-09-22T08:38:28.952357+0000","last_became_active":"2024-09-22T08:36:27.988262+0000","last_became_peered":"2024-09-22T08:36:27.988262+0000","last_unstale":"2024-09-22T08:38:28.952357+0000","last_undegraded":"2024-09-22T08:38:28.952357+0000","last_fullsized":"2024-09-22T08:38:28.952357+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_clean_scrub_stamp":"2024-09-22T08:36:26.962226+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:27:56.322995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"32'32","reported_seq":77,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:31.665631+0000","last_change":"2024-09-22T08:36:29.997925+0000","last_active":"2024-09-22T08:39:31.665631+0000","last_peered":"2024-09-22T08:39:31.665631+0000","last_clean":"2024-09-22T08:39:31.665631+0000","last_became_active":"2024-09-22T08:36:29.997231+0000","last_became_peered":"2024-09-22T08:36:29.997231+0000","last_unstale":"2024-09-22T08:39:31.665631+0000","last_undegraded":"2024-09-22T08:39:31.665631+0000","last_fullsized":"2024-09-22T08:39:31.665631+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:37:27.208598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.224156+0000","last_change":"2024-09-22T08:36:32.004965+0000","last_active":"2024-09-22T08:37:04.224156+0000","last_peered":"2024-09-22T08:37:04.224156+0000","last_clean":"2024-09-22T08:37:04.224156+0000","last_became_active":"2024-09-22T08:36:32.004365+0000","last_became_peered":"2024-09-22T08:36:32.004365+0000","last_unstale":"2024-09-22T08:37:04.224156+0000","last_undegraded":"2024-09-22T08:37:04.224156+0000","last_fullsized":"2024-09-22T08:37:04.224156+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:02:38.800242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"32'4","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:30.270088+0000","last_change":"2024-09-22T08:36:34.016625+0000","last_active":"2024-09-22T08:38:30.270088+0000","last_peered":"2024-09-22T08:38:30.270088+0000","last_clean":"2024-09-22T08:38:30.270088+0000","last_became_active":"2024-09-22T08:36:34.016106+0000","last_became_peered":"2024-09-22T08:36:34.016106+0000","last_unstale":"2024-09-22T08:38:30.270088+0000","last_undegraded":"2024-09-22T08:38:30.270088+0000","last_fullsized":"2024-09-22T08:38:30.270088+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:10:10.424019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"32'12","reported_seq":70,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.290031+0000","last_change":"2024-09-22T08:36:25.987436+0000","last_active":"2024-09-22T08:39:32.290031+0000","last_peered":"2024-09-22T08:39:32.290031+0000","last_clean":"2024-09-22T08:39:32.290031+0000","last_became_active":"2024-09-22T08:36:25.987161+0000","last_became_peered":"2024-09-22T08:36:25.987161+0000","last_unstale":"2024-09-22T08:39:32.290031+0000","last_undegraded":"2024-09-22T08:39:32.290031+0000","last_fullsized":"2024-09-22T08:39:32.290031+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:12:14.347452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.223210+0000","last_change":"2024-09-22T08:36:23.970780+0000","last_active":"2024-09-22T08:37:04.223210+0000","last_peered":"2024-09-22T08:37:04.223210+0000","last_clean":"2024-09-22T08:37:04.223210+0000","last_became_active":"2024-09-22T08:36:23.969515+0000","last_became_peered":"2024-09-22T08:36:23.969515+0000","last_unstale":"2024-09-22T08:37:04.223210+0000","last_undegraded":"2024-09-22T08:37:04.223210+0000","last_fullsized":"2024-09-22T08:37:04.223210+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:26:49.921857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"32'12","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:47.943562+0000","last_change":"2024-09-22T08:36:25.979243+0000","last_active":"2024-09-22T08:37:47.943562+0000","last_peered":"2024-09-22T08:37:47.943562+0000","last_clean":"2024-09-22T08:37:47.943562+0000","last_became_active":"2024-09-22T08:36:25.978679+0000","last_became_peered":"2024-09-22T08:36:25.978679+0000","last_unstale":"2024-09-22T08:37:47.943562+0000","last_undegraded":"2024-09-22T08:37:47.943562+0000","last_fullsized":"2024-09-22T08:37:47.943562+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:02:33.743436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.612648+0000","last_change":"2024-09-22T08:36:23.970625+0000","last_active":"2024-09-22T08:37:04.612648+0000","last_peered":"2024-09-22T08:37:04.612648+0000","last_clean":"2024-09-22T08:37:04.612648+0000","last_became_active":"2024-09-22T08:36:23.970218+0000","last_became_peered":"2024-09-22T08:36:23.970218+0000","last_unstale":"2024-09-22T08:37:04.612648+0000","last_undegraded":"2024-09-22T08:37:04.612648+0000","last_fullsized":"2024-09-22T08:37:04.612648+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:19:30.438078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"32'12","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.079200+0000","last_change":"2024-09-22T08:36:25.991808+0000","last_active":"2024-09-22T08:39:32.079200+0000","last_peered":"2024-09-22T08:39:32.079200+0000","last_clean":"2024-09-22T08:39:32.079200+0000","last_became_active":"2024-09-22T08:36:25.989638+0000","last_became_peered":"2024-09-22T08:36:25.989638+0000","last_unstale":"2024-09-22T08:39:32.079200+0000","last_undegraded":"2024-09-22T08:39:32.079200+0000","last_fullsized":"2024-09-22T08:39:32.079200+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:50:01.017587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":33,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.228337+0000","last_change":"2024-09-22T08:36:23.973468+0000","last_active":"2024-09-22T08:37:04.228337+0000","last_peered":"2024-09-22T08:37:04.228337+0000","last_clean":"2024-09-22T08:37:04.228337+0000","last_became_active":"2024-09-22T08:36:23.972582+0000","last_became_peered":"2024-09-22T08:36:23.972582+0000","last_unstale":"2024-09-22T08:37:04.228337+0000","last_undegraded":"2024-09-22T08:37:04.228337+0000","last_fullsized":"2024-09-22T08:37:04.228337+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:49:03.488783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.224675+0000","last_change":"2024-09-22T08:36:25.978968+0000","last_active":"2024-09-22T08:37:04.224675+0000","last_peered":"2024-09-22T08:37:04.224675+0000","last_clean":"2024-09-22T08:37:04.224675+0000","last_became_active":"2024-09-22T08:36:25.978538+0000","last_became_peered":"2024-09-22T08:36:25.978538+0000","last_unstale":"2024-09-22T08:37:04.224675+0000","last_undegraded":"2024-09-22T08:37:04.224675+0000","last_fullsized":"2024-09-22T08:37:04.224675+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:36:39.596571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.224450+0000","last_change":"2024-09-22T08:36:23.974287+0000","last_active":"2024-09-22T08:37:04.224450+0000","last_peered":"2024-09-22T08:37:04.224450+0000","last_clean":"2024-09-22T08:37:04.224450+0000","last_became_active":"2024-09-22T08:36:23.973945+0000","last_became_peered":"2024-09-22T08:36:23.973945+0000","last_unstale":"2024-09-22T08:37:04.224450+0000","last_undegraded":"2024-09-22T08:37:04.224450+0000","last_fullsized":"2024-09-22T08:37:04.224450+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:15:18.572430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:47.943513+0000","last_change":"2024-09-22T08:36:25.984379+0000","last_active":"2024-09-22T08:37:47.943513+0000","last_peered":"2024-09-22T08:37:47.943513+0000","last_clean":"2024-09-22T08:37:47.943513+0000","last_became_active":"2024-09-22T08:36:25.984094+0000","last_became_peered":"2024-09-22T08:36:25.984094+0000","last_unstale":"2024-09-22T08:37:47.943513+0000","last_undegraded":"2024-09-22T08:37:47.943513+0000","last_fullsized":"2024-09-22T08:37:47.943513+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:55:15.332178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.614002+0000","last_change":"2024-09-22T08:36:23.971443+0000","last_active":"2024-09-22T08:37:04.614002+0000","last_peered":"2024-09-22T08:37:04.614002+0000","last_clean":"2024-09-22T08:37:04.614002+0000","last_became_active":"2024-09-22T08:36:23.970920+0000","last_became_peered":"2024-09-22T08:36:23.970920+0000","last_unstale":"2024-09-22T08:37:04.614002+0000","last_undegraded":"2024-09-22T08:37:04.614002+0000","last_fullsized":"2024-09-22T08:37:04.614002+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:03:35.613648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"32'11","reported_seq":68,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.221583+0000","last_change":"2024-09-22T08:36:25.986221+0000","last_active":"2024-09-22T08:39:32.221583+0000","last_peered":"2024-09-22T08:39:32.221583+0000","last_clean":"2024-09-22T08:39:32.221583+0000","last_became_active":"2024-09-22T08:36:25.985965+0000","last_became_peered":"2024-09-22T08:36:25.985965+0000","last_unstale":"2024-09-22T08:39:32.221583+0000","last_undegraded":"2024-09-22T08:39:32.221583+0000","last_fullsized":"2024-09-22T08:39:32.221583+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:14:09.711077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":11,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.223827+0000","last_change":"2024-09-22T08:36:23.983975+0000","last_active":"2024-09-22T08:37:04.223827+0000","last_peered":"2024-09-22T08:37:04.223827+0000","last_clean":"2024-09-22T08:37:04.223827+0000","last_became_active":"2024-09-22T08:36:23.983722+0000","last_became_peered":"2024-09-22T08:36:23.983722+0000","last_unstale":"2024-09-22T08:37:04.223827+0000","last_undegraded":"2024-09-22T08:37:04.223827+0000","last_fullsized":"2024-09-22T08:37:04.223827+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:06:35.921272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"32'4","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.259710+0000","last_change":"2024-09-22T08:36:25.983403+0000","last_active":"2024-09-22T08:39:32.259710+0000","last_peered":"2024-09-22T08:39:32.259710+0000","last_clean":"2024-09-22T08:39:32.259710+0000","last_became_active":"2024-09-22T08:36:25.983061+0000","last_became_peered":"2024-09-22T08:36:25.983061+0000","last_unstale":"2024-09-22T08:39:32.259710+0000","last_undegraded":"2024-09-22T08:39:32.259710+0000","last_fullsized":"2024-09-22T08:39:32.259710+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:36:23.489851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.229632+0000","last_change":"2024-09-22T08:36:23.974503+0000","last_active":"2024-09-22T08:37:04.229632+0000","last_peered":"2024-09-22T08:37:04.229632+0000","last_clean":"2024-09-22T08:37:04.229632+0000","last_became_active":"2024-09-22T08:36:23.973924+0000","last_became_peered":"2024-09-22T08:36:23.973924+0000","last_unstale":"2024-09-22T08:37:04.229632+0000","last_undegraded":"2024-09-22T08:37:04.229632+0000","last_fullsized":"2024-09-22T08:37:04.229632+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:29:02.171378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"32'18","reported_seq":79,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.259032+0000","last_change":"2024-09-22T08:36:25.979450+0000","last_active":"2024-09-22T08:39:32.259032+0000","last_peered":"2024-09-22T08:39:32.259032+0000","last_clean":"2024-09-22T08:39:32.259032+0000","last_became_active":"2024-09-22T08:36:25.979151+0000","last_became_peered":"2024-09-22T08:36:25.979151+0000","last_unstale":"2024-09-22T08:39:32.259032+0000","last_undegraded":"2024-09-22T08:39:32.259032+0000","last_fullsized":"2024-09-22T08:39:32.259032+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:36:49.177782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":64,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.225651+0000","last_change":"2024-09-22T08:36:23.970979+0000","last_active":"2024-09-22T08:37:04.225651+0000","last_peered":"2024-09-22T08:37:04.225651+0000","last_clean":"2024-09-22T08:37:04.225651+0000","last_became_active":"2024-09-22T08:36:23.970584+0000","last_became_peered":"2024-09-22T08:36:23.970584+0000","last_unstale":"2024-09-22T08:37:04.225651+0000","last_undegraded":"2024-09-22T08:37:04.225651+0000","last_fullsized":"2024-09-22T08:37:04.225651+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:36:27.840945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"32'16","reported_seq":89,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.081622+0000","last_change":"2024-09-22T08:36:25.979007+0000","last_active":"2024-09-22T08:39:32.081622+0000","last_peered":"2024-09-22T08:39:32.081622+0000","last_clean":"2024-09-22T08:39:32.081622+0000","last_became_active":"2024-09-22T08:36:25.978730+0000","last_became_peered":"2024-09-22T08:36:25.978730+0000","last_unstale":"2024-09-22T08:39:32.081622+0000","last_undegraded":"2024-09-22T08:39:32.081622+0000","last_fullsized":"2024-09-22T08:39:32.081622+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:17:07.393345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":70,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:31.490293+0000","last_change":"2024-09-22T08:36:23.973434+0000","last_active":"2024-09-22T08:38:31.490293+0000","last_peered":"2024-09-22T08:38:31.490293+0000","last_clean":"2024-09-22T08:38:31.490293+0000","last_became_active":"2024-09-22T08:36:23.973175+0000","last_became_peered":"2024-09-22T08:36:23.973175+0000","last_unstale":"2024-09-22T08:38:31.490293+0000","last_undegraded":"2024-09-22T08:38:31.490293+0000","last_fullsized":"2024-09-22T08:38:31.490293+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:49:52.164007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"32'6","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.289546+0000","last_change":"2024-09-22T08:36:25.991941+0000","last_active":"2024-09-22T08:39:32.289546+0000","last_peered":"2024-09-22T08:39:32.289546+0000","last_clean":"2024-09-22T08:39:32.289546+0000","last_became_active":"2024-09-22T08:36:25.991611+0000","last_became_peered":"2024-09-22T08:36:25.991611+0000","last_unstale":"2024-09-22T08:39:32.289546+0000","last_undegraded":"2024-09-22T08:39:32.289546+0000","last_fullsized":"2024-09-22T08:39:32.289546+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:09:42.836164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"32'6","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.202264+0000","last_change":"2024-09-22T08:36:23.974290+0000","last_active":"2024-09-22T08:39:32.202264+0000","last_peered":"2024-09-22T08:39:32.202264+0000","last_clean":"2024-09-22T08:39:32.202264+0000","last_became_active":"2024-09-22T08:36:23.973721+0000","last_became_peered":"2024-09-22T08:36:23.973721+0000","last_unstale":"2024-09-22T08:39:32.202264+0000","last_undegraded":"2024-09-22T08:39:32.202264+0000","last_fullsized":"2024-09-22T08:39:32.202264+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:03:35.497917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4,"num_write":22,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"32'8","reported_seq":69,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:05.720316+0000","last_change":"2024-09-22T08:37:04.234401+0000","last_active":"2024-09-22T08:37:05.720316+0000","last_peered":"2024-09-22T08:37:05.720316+0000","last_clean":"2024-09-22T08:37:05.720316+0000","last_became_active":"2024-09-22T08:37:04.231342+0000","last_became_peered":"2024-09-22T08:37:04.231342+0000","last_unstale":"2024-09-22T08:37:05.720316+0000","last_undegraded":"2024-09-22T08:37:05.720316+0000","last_fullsized":"2024-09-22T08:37:05.720316+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:00:32.641067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.221634+0000","last_change":"2024-09-22T08:36:23.975576+0000","last_active":"2024-09-22T08:37:04.221634+0000","last_peered":"2024-09-22T08:37:04.221634+0000","last_clean":"2024-09-22T08:37:04.221634+0000","last_became_active":"2024-09-22T08:36:23.975352+0000","last_became_peered":"2024-09-22T08:36:23.975352+0000","last_unstale":"2024-09-22T08:37:04.221634+0000","last_undegraded":"2024-09-22T08:37:04.221634+0000","last_fullsized":"2024-09-22T08:37:04.221634+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:46:26.551014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.223362+0000","last_change":"2024-09-22T08:36:25.978610+0000","last_active":"2024-09-22T08:37:04.223362+0000","last_peered":"2024-09-22T08:37:04.223362+0000","last_clean":"2024-09-22T08:37:04.223362+0000","last_became_active":"2024-09-22T08:36:25.977732+0000","last_became_peered":"2024-09-22T08:36:25.977732+0000","last_unstale":"2024-09-22T08:37:04.223362+0000","last_undegraded":"2024-09-22T08:37:04.223362+0000","last_fullsized":"2024-09-22T08:37:04.223362+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:38:39.281465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.222399+0000","last_change":"2024-09-22T08:36:23.976230+0000","last_active":"2024-09-22T08:37:04.222399+0000","last_peered":"2024-09-22T08:37:04.222399+0000","last_clean":"2024-09-22T08:37:04.222399+0000","last_became_active":"2024-09-22T08:36:23.975986+0000","last_became_peered":"2024-09-22T08:36:23.975986+0000","last_unstale":"2024-09-22T08:37:04.222399+0000","last_undegraded":"2024-09-22T08:37:04.222399+0000","last_fullsized":"2024-09-22T08:37:04.222399+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:51:18.438115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"32'9","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.299156+0000","last_change":"2024-09-22T08:36:25.984592+0000","last_active":"2024-09-22T08:39:32.299156+0000","last_peered":"2024-09-22T08:39:32.299156+0000","last_clean":"2024-09-22T08:39:32.299156+0000","last_became_active":"2024-09-22T08:36:25.984258+0000","last_became_peered":"2024-09-22T08:36:25.984258+0000","last_unstale":"2024-09-22T08:39:32.299156+0000","last_undegraded":"2024-09-22T08:39:32.299156+0000","last_fullsized":"2024-09-22T08:39:32.299156+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:55:58.281586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.225389+0000","last_change":"2024-09-22T08:36:23.979781+0000","last_active":"2024-09-22T08:37:04.225389+0000","last_peered":"2024-09-22T08:37:04.225389+0000","last_clean":"2024-09-22T08:37:04.225389+0000","last_became_active":"2024-09-22T08:36:23.979548+0000","last_became_peered":"2024-09-22T08:36:23.979548+0000","last_unstale":"2024-09-22T08:37:04.225389+0000","last_undegraded":"2024-09-22T08:37:04.225389+0000","last_fullsized":"2024-09-22T08:37:04.225389+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:09:58.448384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"32'16","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:05.722031+0000","last_change":"2024-09-22T08:36:25.980204+0000","last_active":"2024-09-22T08:37:05.722031+0000","last_peered":"2024-09-22T08:37:05.722031+0000","last_clean":"2024-09-22T08:37:05.722031+0000","last_became_active":"2024-09-22T08:36:25.979965+0000","last_became_peered":"2024-09-22T08:36:25.979965+0000","last_unstale":"2024-09-22T08:37:05.722031+0000","last_undegraded":"2024-09-22T08:37:05.722031+0000","last_fullsized":"2024-09-22T08:37:05.722031+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:42:38.878214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":51,"num_write":22,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.199364+0000","last_change":"2024-09-22T08:36:23.978481+0000","last_active":"2024-09-22T08:39:32.199364+0000","last_peered":"2024-09-22T08:39:32.199364+0000","last_clean":"2024-09-22T08:39:32.199364+0000","last_became_active":"2024-09-22T08:36:23.978225+0000","last_became_peered":"2024-09-22T08:36:23.978225+0000","last_unstale":"2024-09-22T08:39:32.199364+0000","last_undegraded":"2024-09-22T08:39:32.199364+0000","last_fullsized":"2024-09-22T08:39:32.199364+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:22:28.702522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"32'6","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:31.994598+0000","last_change":"2024-09-22T08:36:25.990975+0000","last_active":"2024-09-22T08:39:31.994598+0000","last_peered":"2024-09-22T08:39:31.994598+0000","last_clean":"2024-09-22T08:39:31.994598+0000","last_became_active":"2024-09-22T08:36:25.990690+0000","last_became_peered":"2024-09-22T08:36:25.990690+0000","last_unstale":"2024-09-22T08:39:31.994598+0000","last_undegraded":"2024-09-22T08:39:31.994598+0000","last_fullsized":"2024-09-22T08:39:31.994598+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:09:20.176753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.229731+0000","last_change":"2024-09-22T08:36:23.974565+0000","last_active":"2024-09-22T08:37:04.229731+0000","last_peered":"2024-09-22T08:37:04.229731+0000","last_clean":"2024-09-22T08:37:04.229731+0000","last_became_active":"2024-09-22T08:36:23.973976+0000","last_became_peered":"2024-09-22T08:36:23.973976+0000","last_unstale":"2024-09-22T08:37:04.229731+0000","last_undegraded":"2024-09-22T08:37:04.229731+0000","last_fullsized":"2024-09-22T08:37:04.229731+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:58:35.337314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"32'2","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.289981+0000","last_change":"2024-09-22T08:36:25.976107+0000","last_active":"2024-09-22T08:39:32.289981+0000","last_peered":"2024-09-22T08:39:32.289981+0000","last_clean":"2024-09-22T08:39:32.289981+0000","last_became_active":"2024-09-22T08:36:25.975794+0000","last_became_peered":"2024-09-22T08:36:25.975794+0000","last_unstale":"2024-09-22T08:39:32.289981+0000","last_undegraded":"2024-09-22T08:39:32.289981+0000","last_fullsized":"2024-09-22T08:39:32.289981+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:38:51.254477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"32'1","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:48.185676+0000","last_change":"2024-09-22T08:36:23.982786+0000","last_active":"2024-09-22T08:38:48.185676+0000","last_peered":"2024-09-22T08:38:48.185676+0000","last_clean":"2024-09-22T08:38:48.185676+0000","last_became_active":"2024-09-22T08:36:23.982376+0000","last_became_peered":"2024-09-22T08:36:23.982376+0000","last_unstale":"2024-09-22T08:38:48.185676+0000","last_undegraded":"2024-09-22T08:38:48.185676+0000","last_fullsized":"2024-09-22T08:38:48.185676+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:18:02.522688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.226198+0000","last_change":"2024-09-22T08:36:23.979035+0000","last_active":"2024-09-22T08:37:04.226198+0000","last_peered":"2024-09-22T08:37:04.226198+0000","last_clean":"2024-09-22T08:37:04.226198+0000","last_became_active":"2024-09-22T08:36:23.978787+0000","last_became_peered":"2024-09-22T08:36:23.978787+0000","last_unstale":"2024-09-22T08:37:04.226198+0000","last_undegraded":"2024-09-22T08:37:04.226198+0000","last_fullsized":"2024-09-22T08:37:04.226198+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:59:46.639082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"32'8","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.081622+0000","last_change":"2024-09-22T08:36:25.979863+0000","last_active":"2024-09-22T08:39:32.081622+0000","last_peered":"2024-09-22T08:39:32.081622+0000","last_clean":"2024-09-22T08:39:32.081622+0000","last_became_active":"2024-09-22T08:36:25.979593+0000","last_became_peered":"2024-09-22T08:36:25.979593+0000","last_unstale":"2024-09-22T08:39:32.081622+0000","last_undegraded":"2024-09-22T08:39:32.081622+0000","last_fullsized":"2024-09-22T08:39:32.081622+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:44:30.975858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.223261+0000","last_change":"2024-09-22T08:36:23.974913+0000","last_active":"2024-09-22T08:37:04.223261+0000","last_peered":"2024-09-22T08:37:04.223261+0000","last_clean":"2024-09-22T08:37:04.223261+0000","last_became_active":"2024-09-22T08:36:23.974202+0000","last_became_peered":"2024-09-22T08:36:23.974202+0000","last_unstale":"2024-09-22T08:37:04.223261+0000","last_undegraded":"2024-09-22T08:37:04.223261+0000","last_fullsized":"2024-09-22T08:37:04.223261+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:39:58.245871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"32'13","reported_seq":78,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:50.182446+0000","last_change":"2024-09-22T08:37:04.240925+0000","last_active":"2024-09-22T08:38:50.182446+0000","last_peered":"2024-09-22T08:38:50.182446+0000","last_clean":"2024-09-22T08:38:50.182446+0000","last_became_active":"2024-09-22T08:37:04.233241+0000","last_became_peered":"2024-09-22T08:37:04.233241+0000","last_unstale":"2024-09-22T08:38:50.182446+0000","last_undegraded":"2024-09-22T08:38:50.182446+0000","last_fullsized":"2024-09-22T08:38:50.182446+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:13:02.072699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":47,"num_read_kb":43,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1549,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":690,"num_read_kb":658,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":267,"ondisk_log_size":267,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2256,"ondisk_log_size":2256,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":13385,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1402,"num_read_kb":1188,"num_write":531,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":286720,"data_stored":10826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1275,"ondisk_log_size":1275,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":961,"num_read_kb":961,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1672,"num_read_kb":1562,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":25805696,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":170,"num_read_kb":83,"num_write":309,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":51617792,"data_stored":51611392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":128,"acting":128,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":11,"seq":47244640302,"num_pgs":124,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":57420,"kb_used_data":22076,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94314420,"statfs":{"total":96636764160,"available":96577966080,"internally_reserved":0,"allocated":22605824,"data_stored":22337537,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640302,"num_pgs":119,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40424,"kb_used_data":5080,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94331416,"statfs":{"total":96636764160,"available":96595369984,"internally_reserved":0,"allocated":5201920,"data_stored":4920654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":9,"seq":38654705709,"num_pgs":152,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":64540,"kb_used_data":25036,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94307300,"statfs":{"total":96636764160,"available":96570675200,"internally_reserved":0,"allocated":25636864,"data_stored":25305602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705709,"num_pgs":135,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40544,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331296,"statfs":{"total":96636764160,"available":96595247104,"internally_reserved":0,"allocated":1064960,"data_stored":775085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":643072,"data_stored":639872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4194304,"data_stored":4194304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":21614592,"data_stored":21611392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":25165824,"data_stored":25165824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":325,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":4269,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":421,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T08:39:39.707 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-22T08:39:39.707 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T08:39:39.840 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:39.839+0000 7fd022e60640 1 Processor -- start 2024-09-22T08:39:39.840 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:39.839+0000 7fd022e60640 1 -- start start 2024-09-22T08:39:39.841 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:39.839+0000 7fd022e60640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fd01c071e30 0x7fd01c132790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:39:39.841 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:39.839+0000 7fd022e60640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd01c071770 con 0x7fd01c06e170 2024-09-22T08:39:39.841 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:39.839+0000 7fd022e60640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7fd01c099ee0 con 0x7fd01c071e30 2024-09-22T08:39:39.841 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:39.840+0000 7fd020bfc640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fd01c06e170 0x7fd01c06e550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:60590/0 (socket says 172.21.15.31:60590) 2024-09-22T08:39:39.841 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:39.840+0000 7fd020bfc640 1 -- 172.21.15.31:0/549126636 learned_addr learned my addr 172.21.15.31:0/549126636 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-22T08:39:39.842 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:39.840+0000 7fd01bfff640 1 --2- 172.21.15.31:0/549126636 >> v2:172.21.15.31:3300/0 conn(0x7fd01c071e30 0x7fd01c132790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:39:39.842 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:39.840+0000 7fd01b7fe640 1 -- 172.21.15.31:0/549126636 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1752959039 0 0) 0x7fd01c071770 con 0x7fd01c06e170 2024-09-22T08:39:39.842 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:39.840+0000 7fd01b7fe640 1 -- 172.21.15.31:0/549126636 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd00c003520 con 0x7fd01c06e170 2024-09-22T08:39:39.842 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:39.840+0000 7fd01bfff640 1 -- 172.21.15.31:0/549126636 >> v1:172.21.15.31:6789/0 conn(0x7fd01c06e170 legacy=0x7fd01c06e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:39:39.842 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:39.840+0000 7fd01bfff640 1 -- 172.21.15.31:0/549126636 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd01c072530 con 0x7fd01c071e30 2024-09-22T08:39:39.843 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:39.841+0000 7fd01bfff640 1 --2- 172.21.15.31:0/549126636 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd01c071e30 0x7fd01c132790 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7fd008009750 tx=0x7fd00802a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96e355017238bd40 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:39:39.843 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:39.841+0000 7fd01b7fe640 1 -- 172.21.15.31:0/549126636 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd008037070 con 0x7fd01c071e30 2024-09-22T08:39:39.843 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:39.841+0000 7fd01b7fe640 1 -- 172.21.15.31:0/549126636 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd00802ad80 con 0x7fd01c071e30 2024-09-22T08:39:39.843 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:39.841+0000 7fd01b7fe640 1 -- 172.21.15.31:0/549126636 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd008032590 con 0x7fd01c071e30 2024-09-22T08:39:39.843 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:39.841+0000 7fd022e60640 1 -- 172.21.15.31:0/549126636 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd01c071e30 msgr2=0x7fd01c132790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:39:39.843 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:39.841+0000 7fd022e60640 1 --2- 172.21.15.31:0/549126636 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd01c071e30 0x7fd01c132790 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7fd008009750 tx=0x7fd00802a140 comp rx=0 tx=0).stop 2024-09-22T08:39:39.844 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:39.841+0000 7fd022e60640 1 -- 172.21.15.31:0/549126636 shutdown_connections 2024-09-22T08:39:39.844 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:39.841+0000 7fd022e60640 1 --2- 172.21.15.31:0/549126636 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd01c071e30 0x7fd01c132790 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:39:39.844 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:39.841+0000 7fd022e60640 1 -- 172.21.15.31:0/549126636 >> 172.21.15.31:0/549126636 conn(0x7fd01c09ac80 msgr2=0x7fd01c098550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:39:39.844 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:39.841+0000 7fd022e60640 1 -- 172.21.15.31:0/549126636 shutdown_connections 2024-09-22T08:39:39.844 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:39.841+0000 7fd022e60640 1 -- 172.21.15.31:0/549126636 wait complete. 2024-09-22T08:39:39.844 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:39.842+0000 7fd022e60640 1 Processor -- start 2024-09-22T08:39:39.844 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:39.842+0000 7fd022e60640 1 -- start start 2024-09-22T08:39:39.845 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:39.843+0000 7fd022e60640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd01c06e170 0x7fd01c129950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:39:39.845 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:39.843+0000 7fd022e60640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fd01c06ee70 con 0x7fd01c06e170 2024-09-22T08:39:39.845 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:39.843+0000 7fd020bfc640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd01c06e170 0x7fd01c129950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:39:39.845 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:39.843+0000 7fd020bfc640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd01c06e170 0x7fd01c129950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:48218/0 (socket says 172.21.15.31:48218) 2024-09-22T08:39:39.845 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:39.843+0000 7fd020bfc640 1 -- 172.21.15.31:0/2597261404 learned_addr learned my addr 172.21.15.31:0/2597261404 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-22T08:39:39.845 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:39.843+0000 7fd020bfc640 1 -- 172.21.15.31:0/2597261404 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd01c128400 con 0x7fd01c06e170 2024-09-22T08:39:39.845 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:39.843+0000 7fd020bfc640 1 --2- 172.21.15.31:0/2597261404 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd01c06e170 0x7fd01c129950 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7fd01000c480 tx=0x7fd01000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:39:39.846 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:39.843+0000 7fd0197fa640 1 -- 172.21.15.31:0/2597261404 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd010017070 con 0x7fd01c06e170 2024-09-22T08:39:39.846 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:39.843+0000 7fd0197fa640 1 -- 172.21.15.31:0/2597261404 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd010005cd0 con 0x7fd01c06e170 2024-09-22T08:39:39.846 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:39.843+0000 7fd022e60640 1 -- 172.21.15.31:0/2597261404 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd01c1276f0 con 0x7fd01c06e170 2024-09-22T08:39:39.846 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:39.843+0000 7fd0197fa640 1 -- 172.21.15.31:0/2597261404 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd010007200 con 0x7fd01c06e170 2024-09-22T08:39:39.846 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:39.843+0000 7fd022e60640 1 -- 172.21.15.31:0/2597261404 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd01c128820 con 0x7fd01c06e170 2024-09-22T08:39:39.847 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:39.844+0000 7fd0197fa640 1 -- 172.21.15.31:0/2597261404 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fd01001a070 con 0x7fd01c06e170 2024-09-22T08:39:39.847 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:39.844+0000 7fd022e60640 1 -- 172.21.15.31:0/2597261404 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd01c06e550 con 0x7fd01c06e170 2024-09-22T08:39:39.847 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:39.845+0000 7fd0197fa640 1 --2- 172.21.15.31:0/2597261404 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fd00003e6c0 0x7fd000040b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:39:39.847 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:39.845+0000 7fd0197fa640 1 -- 172.21.15.31:0/2597261404 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5938+0+0 (secure 0 0 0) 0x7fd010052a90 con 0x7fd01c06e170 2024-09-22T08:39:39.847 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:39.845+0000 7fd01bfff640 1 --2- 172.21.15.31:0/2597261404 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fd00003e6c0 0x7fd000040b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:39:39.847 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:39.845+0000 7fd01bfff640 1 --2- 172.21.15.31:0/2597261404 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fd00003e6c0 0x7fd000040b80 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fd008034000 tx=0x7fd00802e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:39:39.850 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:39.849+0000 7fd0197fa640 1 -- 172.21.15.31:0/2597261404 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fd01001b3b0 con 0x7fd01c06e170 2024-09-22T08:39:40.038 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:40.037+0000 7fd022e60640 1 -- 172.21.15.31:0/2597261404 --> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd01c128b10 con 0x7fd00003e6c0 2024-09-22T08:39:40.169 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:40.048+0000 7fd0197fa640 1 -- 172.21.15.31:0/2597261404 <== mgr.4099 v2:172.21.15.142:6824/99931088 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665590 (secure 0 0 0) 0x7fd01c128b10 con 0x7fd00003e6c0 2024-09-22T08:39:40.173 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-22T08:39:40.175 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2024-09-22T08:39:40.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:40.053+0000 7fd022e60640 1 -- 172.21.15.31:0/2597261404 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fd00003e6c0 msgr2=0x7fd000040b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:39:40.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:40.053+0000 7fd022e60640 1 --2- 172.21.15.31:0/2597261404 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fd00003e6c0 0x7fd000040b80 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fd008034000 tx=0x7fd00802e000 comp rx=0 tx=0).stop 2024-09-22T08:39:40.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:40.053+0000 7fd022e60640 1 -- 172.21.15.31:0/2597261404 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd01c06e170 msgr2=0x7fd01c129950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:39:40.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:40.053+0000 7fd022e60640 1 --2- 172.21.15.31:0/2597261404 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd01c06e170 0x7fd01c129950 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7fd01000c480 tx=0x7fd01000c940 comp rx=0 tx=0).stop 2024-09-22T08:39:40.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:40.053+0000 7fd022e60640 1 -- 172.21.15.31:0/2597261404 shutdown_connections 2024-09-22T08:39:40.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:40.053+0000 7fd022e60640 1 --2- 172.21.15.31:0/2597261404 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fd00003e6c0 0x7fd000040b80 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:39:40.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:40.053+0000 7fd022e60640 1 --2- 172.21.15.31:0/2597261404 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd01c06e170 0x7fd01c129950 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:39:40.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:40.053+0000 7fd022e60640 1 -- 172.21.15.31:0/2597261404 >> 172.21.15.31:0/2597261404 conn(0x7fd01c09ac80 msgr2=0x7fd01c12e770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:39:40.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:40.053+0000 7fd022e60640 1 -- 172.21.15.31:0/2597261404 shutdown_connections 2024-09-22T08:39:40.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:40.053+0000 7fd022e60640 1 -- 172.21.15.31:0/2597261404 wait complete. 2024-09-22T08:39:40.181 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":135,"stamp":"2024-09-22T08:39:39.205490+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":26412817,"num_objects":229,"num_object_clones":0,"num_object_copies":458,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":229,"num_whiteouts":0,"num_read":4961,"num_read_kb":4507,"num_write":2048,"num_write_kb":60586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4434,"ondisk_log_size":4434,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":202928,"kb_used_data":53232,"kb_used_omap":6,"kb_used_meta":149625,"kb_avail":377284432,"statfs":{"total":386547056640,"available":386339258368,"internally_reserved":0,"allocated":54509568,"data_stored":53338878,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":153216790},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":25811688,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":534,"num_read_kb":477,"num_write":384,"num_write_kb":29371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003720"},"pg_stats":[{"pgid":"3.3f","version":"30'4","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.229185+0000","last_change":"2024-09-22T08:36:23.978702+0000","last_active":"2024-09-22T08:37:04.229185+0000","last_peered":"2024-09-22T08:37:04.229185+0000","last_clean":"2024-09-22T08:37:04.229185+0000","last_became_active":"2024-09-22T08:36:23.978473+0000","last_became_peered":"2024-09-22T08:36:23.978473+0000","last_unstale":"2024-09-22T08:37:04.229185+0000","last_undegraded":"2024-09-22T08:37:04.229185+0000","last_fullsized":"2024-09-22T08:37:04.229185+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:47:35.557013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":7,"num_write":20,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"30'4","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.221771+0000","last_change":"2024-09-22T08:36:25.982137+0000","last_active":"2024-09-22T08:37:04.221771+0000","last_peered":"2024-09-22T08:37:04.221771+0000","last_clean":"2024-09-22T08:37:04.221771+0000","last_became_active":"2024-09-22T08:36:25.981849+0000","last_became_peered":"2024-09-22T08:36:25.981849+0000","last_unstale":"2024-09-22T08:37:04.221771+0000","last_undegraded":"2024-09-22T08:37:04.221771+0000","last_fullsized":"2024-09-22T08:37:04.221771+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:15:58.403427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.225549+0000","last_change":"2024-09-22T08:36:23.973967+0000","last_active":"2024-09-22T08:37:04.225549+0000","last_peered":"2024-09-22T08:37:04.225549+0000","last_clean":"2024-09-22T08:37:04.225549+0000","last_became_active":"2024-09-22T08:36:23.973596+0000","last_became_peered":"2024-09-22T08:36:23.973596+0000","last_unstale":"2024-09-22T08:37:04.225549+0000","last_undegraded":"2024-09-22T08:37:04.225549+0000","last_fullsized":"2024-09-22T08:37:04.225549+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:25:55.158227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"32'2","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.081639+0000","last_change":"2024-09-22T08:36:25.992482+0000","last_active":"2024-09-22T08:39:32.081639+0000","last_peered":"2024-09-22T08:39:32.081639+0000","last_clean":"2024-09-22T08:39:32.081639+0000","last_became_active":"2024-09-22T08:36:25.992150+0000","last_became_peered":"2024-09-22T08:36:25.992150+0000","last_unstale":"2024-09-22T08:39:32.081639+0000","last_undegraded":"2024-09-22T08:39:32.081639+0000","last_fullsized":"2024-09-22T08:39:32.081639+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:39:29.442096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.232004+0000","last_change":"2024-09-22T08:36:23.983138+0000","last_active":"2024-09-22T08:37:04.232004+0000","last_peered":"2024-09-22T08:37:04.232004+0000","last_clean":"2024-09-22T08:37:04.232004+0000","last_became_active":"2024-09-22T08:36:23.982860+0000","last_became_peered":"2024-09-22T08:36:23.982860+0000","last_unstale":"2024-09-22T08:37:04.232004+0000","last_undegraded":"2024-09-22T08:37:04.232004+0000","last_fullsized":"2024-09-22T08:37:04.232004+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:22:39.595954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.228436+0000","last_change":"2024-09-22T08:36:25.992618+0000","last_active":"2024-09-22T08:37:04.228436+0000","last_peered":"2024-09-22T08:37:04.228436+0000","last_clean":"2024-09-22T08:37:04.228436+0000","last_became_active":"2024-09-22T08:36:25.992356+0000","last_became_peered":"2024-09-22T08:36:25.992356+0000","last_unstale":"2024-09-22T08:37:04.228436+0000","last_undegraded":"2024-09-22T08:37:04.228436+0000","last_fullsized":"2024-09-22T08:37:04.228436+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:54:42.310988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.225810+0000","last_change":"2024-09-22T08:36:23.967353+0000","last_active":"2024-09-22T08:37:04.225810+0000","last_peered":"2024-09-22T08:37:04.225810+0000","last_clean":"2024-09-22T08:37:04.225810+0000","last_became_active":"2024-09-22T08:36:23.967096+0000","last_became_peered":"2024-09-22T08:36:23.967096+0000","last_unstale":"2024-09-22T08:37:04.225810+0000","last_undegraded":"2024-09-22T08:37:04.225810+0000","last_fullsized":"2024-09-22T08:37:04.225810+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:22:30.703594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"32'22","reported_seq":95,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.214709+0000","last_change":"2024-09-22T08:36:25.989569+0000","last_active":"2024-09-22T08:39:32.214709+0000","last_peered":"2024-09-22T08:39:32.214709+0000","last_clean":"2024-09-22T08:39:32.214709+0000","last_became_active":"2024-09-22T08:36:25.989065+0000","last_became_peered":"2024-09-22T08:36:25.989065+0000","last_unstale":"2024-09-22T08:39:32.214709+0000","last_undegraded":"2024-09-22T08:39:32.214709+0000","last_fullsized":"2024-09-22T08:39:32.214709+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:18:58.915284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":82,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.229849+0000","last_change":"2024-09-22T08:36:23.979014+0000","last_active":"2024-09-22T08:37:04.229849+0000","last_peered":"2024-09-22T08:37:04.229849+0000","last_clean":"2024-09-22T08:37:04.229849+0000","last_became_active":"2024-09-22T08:36:23.978766+0000","last_became_peered":"2024-09-22T08:36:23.978766+0000","last_unstale":"2024-09-22T08:37:04.229849+0000","last_undegraded":"2024-09-22T08:37:04.229849+0000","last_fullsized":"2024-09-22T08:37:04.229849+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:46:08.557989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"32'8","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.215083+0000","last_change":"2024-09-22T08:36:25.979188+0000","last_active":"2024-09-22T08:39:32.215083+0000","last_peered":"2024-09-22T08:39:32.215083+0000","last_clean":"2024-09-22T08:39:32.215083+0000","last_became_active":"2024-09-22T08:36:25.978937+0000","last_became_peered":"2024-09-22T08:36:25.978937+0000","last_unstale":"2024-09-22T08:39:32.215083+0000","last_undegraded":"2024-09-22T08:39:32.215083+0000","last_fullsized":"2024-09-22T08:39:32.215083+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:36:02.118103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":23,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"32'4","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:05.711611+0000","last_change":"2024-09-22T08:36:23.967446+0000","last_active":"2024-09-22T08:37:05.711611+0000","last_peered":"2024-09-22T08:37:05.711611+0000","last_clean":"2024-09-22T08:37:05.711611+0000","last_became_active":"2024-09-22T08:36:23.967168+0000","last_became_peered":"2024-09-22T08:36:23.967168+0000","last_unstale":"2024-09-22T08:37:05.711611+0000","last_undegraded":"2024-09-22T08:37:05.711611+0000","last_fullsized":"2024-09-22T08:37:05.711611+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:51:18.438115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":10,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"32'6","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:48.130983+0000","last_change":"2024-09-22T08:36:25.992986+0000","last_active":"2024-09-22T08:37:48.130983+0000","last_peered":"2024-09-22T08:37:48.130983+0000","last_clean":"2024-09-22T08:37:48.130983+0000","last_became_active":"2024-09-22T08:36:25.990727+0000","last_became_peered":"2024-09-22T08:36:25.990727+0000","last_unstale":"2024-09-22T08:37:48.130983+0000","last_undegraded":"2024-09-22T08:37:48.130983+0000","last_fullsized":"2024-09-22T08:37:48.130983+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:05:42.869702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.228480+0000","last_change":"2024-09-22T08:36:23.980714+0000","last_active":"2024-09-22T08:37:04.228480+0000","last_peered":"2024-09-22T08:37:04.228480+0000","last_clean":"2024-09-22T08:37:04.228480+0000","last_became_active":"2024-09-22T08:36:23.980446+0000","last_became_peered":"2024-09-22T08:36:23.980446+0000","last_unstale":"2024-09-22T08:37:04.228480+0000","last_undegraded":"2024-09-22T08:37:04.228480+0000","last_fullsized":"2024-09-22T08:37:04.228480+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:18:20.665486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"32'8","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.289670+0000","last_change":"2024-09-22T08:36:25.982503+0000","last_active":"2024-09-22T08:39:32.289670+0000","last_peered":"2024-09-22T08:39:32.289670+0000","last_clean":"2024-09-22T08:39:32.289670+0000","last_became_active":"2024-09-22T08:36:25.982217+0000","last_became_peered":"2024-09-22T08:36:25.982217+0000","last_unstale":"2024-09-22T08:39:32.289670+0000","last_undegraded":"2024-09-22T08:39:32.289670+0000","last_fullsized":"2024-09-22T08:39:32.289670+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:38:39.281465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":27,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:31.512962+0000","last_change":"2024-09-22T08:36:23.978037+0000","last_active":"2024-09-22T08:38:31.512962+0000","last_peered":"2024-09-22T08:38:31.512962+0000","last_clean":"2024-09-22T08:38:31.512962+0000","last_became_active":"2024-09-22T08:36:23.977715+0000","last_became_peered":"2024-09-22T08:36:23.977715+0000","last_unstale":"2024-09-22T08:38:31.512962+0000","last_undegraded":"2024-09-22T08:38:31.512962+0000","last_fullsized":"2024-09-22T08:38:31.512962+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:43:08.069293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"32'7","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:30.181492+0000","last_change":"2024-09-22T08:36:25.975203+0000","last_active":"2024-09-22T08:38:30.181492+0000","last_peered":"2024-09-22T08:38:30.181492+0000","last_clean":"2024-09-22T08:38:30.181492+0000","last_became_active":"2024-09-22T08:36:25.974930+0000","last_became_peered":"2024-09-22T08:36:25.974930+0000","last_unstale":"2024-09-22T08:38:30.181492+0000","last_undegraded":"2024-09-22T08:38:30.181492+0000","last_fullsized":"2024-09-22T08:38:30.181492+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:14:58.055122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"32'3","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:48.185367+0000","last_change":"2024-09-22T08:36:25.992134+0000","last_active":"2024-09-22T08:38:48.185367+0000","last_peered":"2024-09-22T08:38:48.185367+0000","last_clean":"2024-09-22T08:38:48.185367+0000","last_became_active":"2024-09-22T08:36:25.991870+0000","last_became_peered":"2024-09-22T08:36:25.991870+0000","last_unstale":"2024-09-22T08:38:48.185367+0000","last_undegraded":"2024-09-22T08:38:48.185367+0000","last_fullsized":"2024-09-22T08:38:48.185367+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:22:14.904895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.224532+0000","last_change":"2024-09-22T08:36:23.977802+0000","last_active":"2024-09-22T08:37:04.224532+0000","last_peered":"2024-09-22T08:37:04.224532+0000","last_clean":"2024-09-22T08:37:04.224532+0000","last_became_active":"2024-09-22T08:36:23.977556+0000","last_became_peered":"2024-09-22T08:36:23.977556+0000","last_unstale":"2024-09-22T08:37:04.224532+0000","last_undegraded":"2024-09-22T08:37:04.224532+0000","last_fullsized":"2024-09-22T08:37:04.224532+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:29:17.802189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"32'14","reported_seq":72,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.290010+0000","last_change":"2024-09-22T08:36:25.977178+0000","last_active":"2024-09-22T08:39:32.290010+0000","last_peered":"2024-09-22T08:39:32.290010+0000","last_clean":"2024-09-22T08:39:32.290010+0000","last_became_active":"2024-09-22T08:36:25.976389+0000","last_became_peered":"2024-09-22T08:36:25.976389+0000","last_unstale":"2024-09-22T08:39:32.290010+0000","last_undegraded":"2024-09-22T08:39:32.290010+0000","last_fullsized":"2024-09-22T08:39:32.290010+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:33:17.028140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":49,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"32'1","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:50.183843+0000","last_change":"2024-09-22T08:36:23.974839+0000","last_active":"2024-09-22T08:38:50.183843+0000","last_peered":"2024-09-22T08:38:50.183843+0000","last_clean":"2024-09-22T08:38:50.183843+0000","last_became_active":"2024-09-22T08:36:23.974275+0000","last_became_peered":"2024-09-22T08:36:23.974275+0000","last_unstale":"2024-09-22T08:38:50.183843+0000","last_undegraded":"2024-09-22T08:38:50.183843+0000","last_fullsized":"2024-09-22T08:38:50.183843+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:00:39.104995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"32'12","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.343172+0000","last_change":"2024-09-22T08:36:25.977283+0000","last_active":"2024-09-22T08:39:32.343172+0000","last_peered":"2024-09-22T08:39:32.343172+0000","last_clean":"2024-09-22T08:39:32.343172+0000","last_became_active":"2024-09-22T08:36:25.977015+0000","last_became_peered":"2024-09-22T08:36:25.977015+0000","last_unstale":"2024-09-22T08:39:32.343172+0000","last_undegraded":"2024-09-22T08:39:32.343172+0000","last_fullsized":"2024-09-22T08:39:32.343172+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:25:20.428891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":43,"num_read_kb":39,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:05.096438+0000","last_change":"2024-09-22T08:36:23.984666+0000","last_active":"2024-09-22T08:37:05.096438+0000","last_peered":"2024-09-22T08:37:05.096438+0000","last_clean":"2024-09-22T08:37:05.096438+0000","last_became_active":"2024-09-22T08:36:23.984411+0000","last_became_peered":"2024-09-22T08:36:23.984411+0000","last_unstale":"2024-09-22T08:37:05.096438+0000","last_undegraded":"2024-09-22T08:37:05.096438+0000","last_fullsized":"2024-09-22T08:37:05.096438+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:22:30.703594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"32'2","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:28.582905+0000","last_change":"2024-09-22T08:36:25.984342+0000","last_active":"2024-09-22T08:38:28.582905+0000","last_peered":"2024-09-22T08:38:28.582905+0000","last_clean":"2024-09-22T08:38:28.582905+0000","last_became_active":"2024-09-22T08:36:25.984037+0000","last_became_peered":"2024-09-22T08:36:25.984037+0000","last_unstale":"2024-09-22T08:38:28.582905+0000","last_undegraded":"2024-09-22T08:38:28.582905+0000","last_fullsized":"2024-09-22T08:38:28.582905+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:08:22.313520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.613492+0000","last_change":"2024-09-22T08:36:23.969670+0000","last_active":"2024-09-22T08:37:04.613492+0000","last_peered":"2024-09-22T08:37:04.613492+0000","last_clean":"2024-09-22T08:37:04.613492+0000","last_became_active":"2024-09-22T08:36:23.969183+0000","last_became_peered":"2024-09-22T08:36:23.969183+0000","last_unstale":"2024-09-22T08:37:04.613492+0000","last_undegraded":"2024-09-22T08:37:04.613492+0000","last_fullsized":"2024-09-22T08:37:04.613492+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:27:04.674711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"32'18","reported_seq":67,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.214977+0000","last_change":"2024-09-22T08:36:25.986078+0000","last_active":"2024-09-22T08:39:32.214977+0000","last_peered":"2024-09-22T08:39:32.214977+0000","last_clean":"2024-09-22T08:39:32.214977+0000","last_became_active":"2024-09-22T08:36:25.985797+0000","last_became_peered":"2024-09-22T08:36:25.985797+0000","last_unstale":"2024-09-22T08:39:32.214977+0000","last_undegraded":"2024-09-22T08:39:32.214977+0000","last_fullsized":"2024-09-22T08:39:32.214977+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:55:58.281586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":61,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.205171+0000","last_change":"2024-09-22T08:36:23.974737+0000","last_active":"2024-09-22T08:39:32.205171+0000","last_peered":"2024-09-22T08:39:32.205171+0000","last_clean":"2024-09-22T08:39:32.205171+0000","last_became_active":"2024-09-22T08:36:23.974359+0000","last_became_peered":"2024-09-22T08:36:23.974359+0000","last_unstale":"2024-09-22T08:39:32.205171+0000","last_undegraded":"2024-09-22T08:39:32.205171+0000","last_fullsized":"2024-09-22T08:39:32.205171+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:27:54.535865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"32'16","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.296886+0000","last_change":"2024-09-22T08:36:25.978419+0000","last_active":"2024-09-22T08:39:32.296886+0000","last_peered":"2024-09-22T08:39:32.296886+0000","last_clean":"2024-09-22T08:39:32.296886+0000","last_became_active":"2024-09-22T08:36:25.977320+0000","last_became_peered":"2024-09-22T08:36:25.977320+0000","last_unstale":"2024-09-22T08:39:32.296886+0000","last_undegraded":"2024-09-22T08:39:32.296886+0000","last_fullsized":"2024-09-22T08:39:32.296886+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:45:06.683427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":49,"num_write":21,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"32'1","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:48.185452+0000","last_change":"2024-09-22T08:36:23.980577+0000","last_active":"2024-09-22T08:38:48.185452+0000","last_peered":"2024-09-22T08:38:48.185452+0000","last_clean":"2024-09-22T08:38:48.185452+0000","last_became_active":"2024-09-22T08:36:23.980189+0000","last_became_peered":"2024-09-22T08:36:23.980189+0000","last_unstale":"2024-09-22T08:38:48.185452+0000","last_undegraded":"2024-09-22T08:38:48.185452+0000","last_fullsized":"2024-09-22T08:38:48.185452+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:45:54.958427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"32'35","reported_seq":100,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.238012+0000","last_change":"2024-09-22T08:36:34.015950+0000","last_active":"2024-09-22T08:39:32.238012+0000","last_peered":"2024-09-22T08:39:32.238012+0000","last_clean":"2024-09-22T08:39:32.238012+0000","last_became_active":"2024-09-22T08:36:34.015696+0000","last_became_peered":"2024-09-22T08:36:34.015696+0000","last_unstale":"2024-09-22T08:39:32.238012+0000","last_undegraded":"2024-09-22T08:39:32.238012+0000","last_fullsized":"2024-09-22T08:39:32.238012+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:48:07.077185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":173,"num_read_kb":173,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"32'6","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.214715+0000","last_change":"2024-09-22T08:36:25.988079+0000","last_active":"2024-09-22T08:39:32.214715+0000","last_peered":"2024-09-22T08:39:32.214715+0000","last_clean":"2024-09-22T08:39:32.214715+0000","last_became_active":"2024-09-22T08:36:25.987811+0000","last_became_peered":"2024-09-22T08:36:25.987811+0000","last_unstale":"2024-09-22T08:39:32.214715+0000","last_undegraded":"2024-09-22T08:39:32.214715+0000","last_fullsized":"2024-09-22T08:39:32.214715+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:09:47.627357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.229385+0000","last_change":"2024-09-22T08:36:23.982670+0000","last_active":"2024-09-22T08:37:04.229385+0000","last_peered":"2024-09-22T08:37:04.229385+0000","last_clean":"2024-09-22T08:37:04.229385+0000","last_became_active":"2024-09-22T08:36:23.982423+0000","last_became_peered":"2024-09-22T08:36:23.982423+0000","last_unstale":"2024-09-22T08:37:04.229385+0000","last_undegraded":"2024-09-22T08:37:04.229385+0000","last_fullsized":"2024-09-22T08:37:04.229385+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:36:21.966120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.230626+0000","last_change":"2024-09-22T08:36:27.988469+0000","last_active":"2024-09-22T08:37:04.230626+0000","last_peered":"2024-09-22T08:37:04.230626+0000","last_clean":"2024-09-22T08:37:04.230626+0000","last_became_active":"2024-09-22T08:36:27.988057+0000","last_became_peered":"2024-09-22T08:36:27.988057+0000","last_unstale":"2024-09-22T08:37:04.230626+0000","last_undegraded":"2024-09-22T08:37:04.230626+0000","last_fullsized":"2024-09-22T08:37:04.230626+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_clean_scrub_stamp":"2024-09-22T08:36:26.962226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:51:33.578609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"32'30","reported_seq":73,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:30.249449+0000","last_change":"2024-09-22T08:36:29.995218+0000","last_active":"2024-09-22T08:38:30.249449+0000","last_peered":"2024-09-22T08:38:30.249449+0000","last_clean":"2024-09-22T08:38:30.249449+0000","last_became_active":"2024-09-22T08:36:29.994881+0000","last_became_peered":"2024-09-22T08:36:29.994881+0000","last_unstale":"2024-09-22T08:38:30.249449+0000","last_undegraded":"2024-09-22T08:38:30.249449+0000","last_fullsized":"2024-09-22T08:38:30.249449+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:46:41.834484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.223889+0000","last_change":"2024-09-22T08:36:32.013521+0000","last_active":"2024-09-22T08:37:04.223889+0000","last_peered":"2024-09-22T08:37:04.223889+0000","last_clean":"2024-09-22T08:37:04.223889+0000","last_became_active":"2024-09-22T08:36:32.013249+0000","last_became_peered":"2024-09-22T08:36:32.013249+0000","last_unstale":"2024-09-22T08:37:04.223889+0000","last_undegraded":"2024-09-22T08:37:04.223889+0000","last_fullsized":"2024-09-22T08:37:04.223889+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:35:20.008672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"32'7","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:47.949724+0000","last_change":"2024-09-22T08:36:34.015432+0000","last_active":"2024-09-22T08:37:47.949724+0000","last_peered":"2024-09-22T08:37:47.949724+0000","last_clean":"2024-09-22T08:37:47.949724+0000","last_became_active":"2024-09-22T08:36:34.015170+0000","last_became_peered":"2024-09-22T08:36:34.015170+0000","last_unstale":"2024-09-22T08:37:47.949724+0000","last_undegraded":"2024-09-22T08:37:47.949724+0000","last_fullsized":"2024-09-22T08:37:47.949724+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:45:21.601440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:48.129237+0000","last_change":"2024-09-22T08:36:25.989960+0000","last_active":"2024-09-22T08:37:48.129237+0000","last_peered":"2024-09-22T08:37:48.129237+0000","last_clean":"2024-09-22T08:37:48.129237+0000","last_became_active":"2024-09-22T08:36:25.989583+0000","last_became_peered":"2024-09-22T08:36:25.989583+0000","last_unstale":"2024-09-22T08:37:48.129237+0000","last_undegraded":"2024-09-22T08:37:48.129237+0000","last_fullsized":"2024-09-22T08:37:48.129237+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:42:22.082860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"32'1","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:45.183153+0000","last_change":"2024-09-22T08:36:23.973951+0000","last_active":"2024-09-22T08:38:45.183153+0000","last_peered":"2024-09-22T08:38:45.183153+0000","last_clean":"2024-09-22T08:38:45.183153+0000","last_became_active":"2024-09-22T08:36:23.973716+0000","last_became_peered":"2024-09-22T08:36:23.973716+0000","last_unstale":"2024-09-22T08:38:45.183153+0000","last_undegraded":"2024-09-22T08:38:45.183153+0000","last_fullsized":"2024-09-22T08:38:45.183153+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:06:35.921272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:05.167417+0000","last_change":"2024-09-22T08:37:04.229482+0000","last_active":"2024-09-22T08:37:05.167417+0000","last_peered":"2024-09-22T08:37:05.167417+0000","last_clean":"2024-09-22T08:37:05.167417+0000","last_became_active":"2024-09-22T08:37:04.229132+0000","last_became_peered":"2024-09-22T08:37:04.229132+0000","last_unstale":"2024-09-22T08:37:05.167417+0000","last_undegraded":"2024-09-22T08:37:05.167417+0000","last_fullsized":"2024-09-22T08:37:05.167417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_clean_scrub_stamp":"2024-09-22T08:36:26.962226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:30:09.128950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"30'6","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.223977+0000","last_change":"2024-09-22T08:36:29.991280+0000","last_active":"2024-09-22T08:37:04.223977+0000","last_peered":"2024-09-22T08:37:04.223977+0000","last_clean":"2024-09-22T08:37:04.223977+0000","last_became_active":"2024-09-22T08:36:29.990998+0000","last_became_peered":"2024-09-22T08:36:29.990998+0000","last_unstale":"2024-09-22T08:37:04.223977+0000","last_undegraded":"2024-09-22T08:37:04.223977+0000","last_fullsized":"2024-09-22T08:37:04.223977+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:36:37.998945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.222725+0000","last_change":"2024-09-22T08:36:32.006443+0000","last_active":"2024-09-22T08:37:04.222725+0000","last_peered":"2024-09-22T08:37:04.222725+0000","last_clean":"2024-09-22T08:37:04.222725+0000","last_became_active":"2024-09-22T08:36:32.006161+0000","last_became_peered":"2024-09-22T08:36:32.006161+0000","last_unstale":"2024-09-22T08:37:04.222725+0000","last_undegraded":"2024-09-22T08:37:04.222725+0000","last_fullsized":"2024-09-22T08:37:04.222725+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:39:07.614953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"30'2","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.223331+0000","last_change":"2024-09-22T08:36:34.017093+0000","last_active":"2024-09-22T08:37:04.223331+0000","last_peered":"2024-09-22T08:37:04.223331+0000","last_clean":"2024-09-22T08:37:04.223331+0000","last_became_active":"2024-09-22T08:36:34.016749+0000","last_became_peered":"2024-09-22T08:36:34.016749+0000","last_unstale":"2024-09-22T08:37:04.223331+0000","last_undegraded":"2024-09-22T08:37:04.223331+0000","last_fullsized":"2024-09-22T08:37:04.223331+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:18:00.649317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"32'7","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.088571+0000","last_change":"2024-09-22T08:36:25.988432+0000","last_active":"2024-09-22T08:39:32.088571+0000","last_peered":"2024-09-22T08:39:32.088571+0000","last_clean":"2024-09-22T08:39:32.088571+0000","last_became_active":"2024-09-22T08:36:25.987860+0000","last_became_peered":"2024-09-22T08:36:25.987860+0000","last_unstale":"2024-09-22T08:39:32.088571+0000","last_undegraded":"2024-09-22T08:39:32.088571+0000","last_fullsized":"2024-09-22T08:39:32.088571+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:07:23.439560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.228129+0000","last_change":"2024-09-22T08:36:23.979437+0000","last_active":"2024-09-22T08:37:04.228129+0000","last_peered":"2024-09-22T08:37:04.228129+0000","last_clean":"2024-09-22T08:37:04.228129+0000","last_became_active":"2024-09-22T08:36:23.979201+0000","last_became_peered":"2024-09-22T08:36:23.979201+0000","last_unstale":"2024-09-22T08:37:04.228129+0000","last_undegraded":"2024-09-22T08:37:04.228129+0000","last_fullsized":"2024-09-22T08:37:04.228129+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:05:30.127896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.226652+0000","last_change":"2024-09-22T08:36:27.987816+0000","last_active":"2024-09-22T08:37:04.226652+0000","last_peered":"2024-09-22T08:37:04.226652+0000","last_clean":"2024-09-22T08:37:04.226652+0000","last_became_active":"2024-09-22T08:36:27.987410+0000","last_became_peered":"2024-09-22T08:36:27.987410+0000","last_unstale":"2024-09-22T08:37:04.226652+0000","last_undegraded":"2024-09-22T08:37:04.226652+0000","last_fullsized":"2024-09-22T08:37:04.226652+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_clean_scrub_stamp":"2024-09-22T08:36:26.962226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:14:29.717295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"30'10","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.227501+0000","last_change":"2024-09-22T08:36:29.999655+0000","last_active":"2024-09-22T08:37:04.227501+0000","last_peered":"2024-09-22T08:37:04.227501+0000","last_clean":"2024-09-22T08:37:04.227501+0000","last_became_active":"2024-09-22T08:36:29.999306+0000","last_became_peered":"2024-09-22T08:36:29.999306+0000","last_unstale":"2024-09-22T08:37:04.227501+0000","last_undegraded":"2024-09-22T08:37:04.227501+0000","last_fullsized":"2024-09-22T08:37:04.227501+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:27:58.333399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"32'282","reported_seq":415,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.294718+0000","last_change":"2024-09-22T08:36:32.014175+0000","last_active":"2024-09-22T08:39:32.294718+0000","last_peered":"2024-09-22T08:39:32.294718+0000","last_clean":"2024-09-22T08:39:32.294718+0000","last_became_active":"2024-09-22T08:36:32.013869+0000","last_became_peered":"2024-09-22T08:36:32.013869+0000","last_unstale":"2024-09-22T08:39:32.294718+0000","last_undegraded":"2024-09-22T08:39:32.294718+0000","last_fullsized":"2024-09-22T08:39:32.294718+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:23:53.788685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.224121+0000","last_change":"2024-09-22T08:36:34.016273+0000","last_active":"2024-09-22T08:37:04.224121+0000","last_peered":"2024-09-22T08:37:04.224121+0000","last_clean":"2024-09-22T08:37:04.224121+0000","last_became_active":"2024-09-22T08:36:34.015999+0000","last_became_peered":"2024-09-22T08:36:34.015999+0000","last_unstale":"2024-09-22T08:37:04.224121+0000","last_undegraded":"2024-09-22T08:37:04.224121+0000","last_fullsized":"2024-09-22T08:37:04.224121+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:19:59.334082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"30'4","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.226266+0000","last_change":"2024-09-22T08:36:25.979874+0000","last_active":"2024-09-22T08:37:04.226266+0000","last_peered":"2024-09-22T08:37:04.226266+0000","last_clean":"2024-09-22T08:37:04.226266+0000","last_became_active":"2024-09-22T08:36:25.979320+0000","last_became_peered":"2024-09-22T08:36:25.979320+0000","last_unstale":"2024-09-22T08:37:04.226266+0000","last_undegraded":"2024-09-22T08:37:04.226266+0000","last_fullsized":"2024-09-22T08:37:04.226266+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:22:30.226253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.221148+0000","last_change":"2024-09-22T08:36:23.975661+0000","last_active":"2024-09-22T08:37:04.221148+0000","last_peered":"2024-09-22T08:37:04.221148+0000","last_clean":"2024-09-22T08:37:04.221148+0000","last_became_active":"2024-09-22T08:36:23.975428+0000","last_became_peered":"2024-09-22T08:36:23.975428+0000","last_unstale":"2024-09-22T08:37:04.221148+0000","last_undegraded":"2024-09-22T08:37:04.221148+0000","last_fullsized":"2024-09-22T08:37:04.221148+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:09:41.970933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.227129+0000","last_change":"2024-09-22T08:36:27.985020+0000","last_active":"2024-09-22T08:37:04.227129+0000","last_peered":"2024-09-22T08:37:04.227129+0000","last_clean":"2024-09-22T08:37:04.227129+0000","last_became_active":"2024-09-22T08:36:27.984658+0000","last_became_peered":"2024-09-22T08:36:27.984658+0000","last_unstale":"2024-09-22T08:37:04.227129+0000","last_undegraded":"2024-09-22T08:37:04.227129+0000","last_fullsized":"2024-09-22T08:37:04.227129+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_clean_scrub_stamp":"2024-09-22T08:36:26.962226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:55:24.622399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"32'30","reported_seq":73,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:30.243330+0000","last_change":"2024-09-22T08:36:30.000958+0000","last_active":"2024-09-22T08:38:30.243330+0000","last_peered":"2024-09-22T08:38:30.243330+0000","last_clean":"2024-09-22T08:38:30.243330+0000","last_became_active":"2024-09-22T08:36:30.000641+0000","last_became_peered":"2024-09-22T08:36:30.000641+0000","last_unstale":"2024-09-22T08:38:30.243330+0000","last_undegraded":"2024-09-22T08:38:30.243330+0000","last_fullsized":"2024-09-22T08:38:30.243330+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:44:23.505173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"32'282","reported_seq":424,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.293167+0000","last_change":"2024-09-22T08:36:32.005447+0000","last_active":"2024-09-22T08:39:32.293167+0000","last_peered":"2024-09-22T08:39:32.293167+0000","last_clean":"2024-09-22T08:39:32.293167+0000","last_became_active":"2024-09-22T08:36:32.005012+0000","last_became_peered":"2024-09-22T08:36:32.005012+0000","last_unstale":"2024-09-22T08:39:32.293167+0000","last_undegraded":"2024-09-22T08:39:32.293167+0000","last_fullsized":"2024-09-22T08:39:32.293167+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:31:41.609654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"32'4","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:05.720809+0000","last_change":"2024-09-22T08:36:25.990731+0000","last_active":"2024-09-22T08:37:05.720809+0000","last_peered":"2024-09-22T08:37:05.720809+0000","last_clean":"2024-09-22T08:37:05.720809+0000","last_became_active":"2024-09-22T08:36:25.989940+0000","last_became_peered":"2024-09-22T08:36:25.989940+0000","last_unstale":"2024-09-22T08:37:05.720809+0000","last_undegraded":"2024-09-22T08:37:05.720809+0000","last_fullsized":"2024-09-22T08:37:05.720809+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:12:49.808186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.229286+0000","last_change":"2024-09-22T08:36:23.970335+0000","last_active":"2024-09-22T08:37:04.229286+0000","last_peered":"2024-09-22T08:37:04.229286+0000","last_clean":"2024-09-22T08:37:04.229286+0000","last_became_active":"2024-09-22T08:36:23.970093+0000","last_became_peered":"2024-09-22T08:36:23.970093+0000","last_unstale":"2024-09-22T08:37:04.229286+0000","last_undegraded":"2024-09-22T08:37:04.229286+0000","last_fullsized":"2024-09-22T08:37:04.229286+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:59:04.308788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.221669+0000","last_change":"2024-09-22T08:36:27.987025+0000","last_active":"2024-09-22T08:37:04.221669+0000","last_peered":"2024-09-22T08:37:04.221669+0000","last_clean":"2024-09-22T08:37:04.221669+0000","last_became_active":"2024-09-22T08:36:27.986734+0000","last_became_peered":"2024-09-22T08:36:27.986734+0000","last_unstale":"2024-09-22T08:37:04.221669+0000","last_undegraded":"2024-09-22T08:37:04.221669+0000","last_fullsized":"2024-09-22T08:37:04.221669+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_clean_scrub_stamp":"2024-09-22T08:36:26.962226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:17:49.747383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"32'40","reported_seq":88,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:30.253763+0000","last_change":"2024-09-22T08:36:29.991107+0000","last_active":"2024-09-22T08:38:30.253763+0000","last_peered":"2024-09-22T08:38:30.253763+0000","last_clean":"2024-09-22T08:38:30.253763+0000","last_became_active":"2024-09-22T08:36:29.990809+0000","last_became_peered":"2024-09-22T08:36:29.990809+0000","last_unstale":"2024-09-22T08:38:30.253763+0000","last_undegraded":"2024-09-22T08:38:30.253763+0000","last_fullsized":"2024-09-22T08:38:30.253763+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:58:25.003982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":44,"num_read_kb":33,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.224144+0000","last_change":"2024-09-22T08:36:32.004096+0000","last_active":"2024-09-22T08:37:04.224144+0000","last_peered":"2024-09-22T08:37:04.224144+0000","last_clean":"2024-09-22T08:37:04.224144+0000","last_became_active":"2024-09-22T08:36:32.003726+0000","last_became_peered":"2024-09-22T08:36:32.003726+0000","last_unstale":"2024-09-22T08:37:04.224144+0000","last_undegraded":"2024-09-22T08:37:04.224144+0000","last_fullsized":"2024-09-22T08:37:04.224144+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:58:37.810092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"32'5","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:48.125865+0000","last_change":"2024-09-22T08:36:34.022748+0000","last_active":"2024-09-22T08:37:48.125865+0000","last_peered":"2024-09-22T08:37:48.125865+0000","last_clean":"2024-09-22T08:37:48.125865+0000","last_became_active":"2024-09-22T08:36:34.022448+0000","last_became_peered":"2024-09-22T08:36:34.022448+0000","last_unstale":"2024-09-22T08:37:48.125865+0000","last_undegraded":"2024-09-22T08:37:48.125865+0000","last_fullsized":"2024-09-22T08:37:48.125865+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:39:09.622561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":13,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"32'10","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:31.647489+0000","last_change":"2024-09-22T08:36:25.976027+0000","last_active":"2024-09-22T08:38:31.647489+0000","last_peered":"2024-09-22T08:38:31.647489+0000","last_clean":"2024-09-22T08:38:31.647489+0000","last_became_active":"2024-09-22T08:36:25.975728+0000","last_became_peered":"2024-09-22T08:36:25.975728+0000","last_unstale":"2024-09-22T08:38:31.647489+0000","last_undegraded":"2024-09-22T08:38:31.647489+0000","last_fullsized":"2024-09-22T08:38:31.647489+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:22:27.923443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:31.959475+0000","last_change":"2024-09-22T08:36:23.969160+0000","last_active":"2024-09-22T08:39:31.959475+0000","last_peered":"2024-09-22T08:39:31.959475+0000","last_clean":"2024-09-22T08:39:31.959475+0000","last_became_active":"2024-09-22T08:36:23.968836+0000","last_became_peered":"2024-09-22T08:36:23.968836+0000","last_unstale":"2024-09-22T08:39:31.959475+0000","last_undegraded":"2024-09-22T08:39:31.959475+0000","last_fullsized":"2024-09-22T08:39:31.959475+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:24:33.546187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.223645+0000","last_change":"2024-09-22T08:36:27.987971+0000","last_active":"2024-09-22T08:37:04.223645+0000","last_peered":"2024-09-22T08:37:04.223645+0000","last_clean":"2024-09-22T08:37:04.223645+0000","last_became_active":"2024-09-22T08:36:27.987577+0000","last_became_peered":"2024-09-22T08:36:27.987577+0000","last_unstale":"2024-09-22T08:37:04.223645+0000","last_undegraded":"2024-09-22T08:37:04.223645+0000","last_fullsized":"2024-09-22T08:37:04.223645+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_clean_scrub_stamp":"2024-09-22T08:36:26.962226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:17:33.045316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"32'31","reported_seq":74,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:30.233003+0000","last_change":"2024-09-22T08:36:29.995394+0000","last_active":"2024-09-22T08:38:30.233003+0000","last_peered":"2024-09-22T08:38:30.233003+0000","last_clean":"2024-09-22T08:38:30.233003+0000","last_became_active":"2024-09-22T08:36:29.994921+0000","last_became_peered":"2024-09-22T08:36:29.994921+0000","last_unstale":"2024-09-22T08:38:30.233003+0000","last_undegraded":"2024-09-22T08:38:30.233003+0000","last_fullsized":"2024-09-22T08:38:30.233003+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:00:36.656901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.223384+0000","last_change":"2024-09-22T08:36:32.004634+0000","last_active":"2024-09-22T08:37:04.223384+0000","last_peered":"2024-09-22T08:37:04.223384+0000","last_clean":"2024-09-22T08:37:04.223384+0000","last_became_active":"2024-09-22T08:36:32.004269+0000","last_became_peered":"2024-09-22T08:36:32.004269+0000","last_unstale":"2024-09-22T08:37:04.223384+0000","last_undegraded":"2024-09-22T08:37:04.223384+0000","last_fullsized":"2024-09-22T08:37:04.223384+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:51:32.910644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"32'3","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:42.431386+0000","last_change":"2024-09-22T08:36:34.018431+0000","last_active":"2024-09-22T08:37:42.431386+0000","last_peered":"2024-09-22T08:37:42.431386+0000","last_clean":"2024-09-22T08:37:42.431386+0000","last_became_active":"2024-09-22T08:36:34.018190+0000","last_became_peered":"2024-09-22T08:36:34.018190+0000","last_unstale":"2024-09-22T08:37:42.431386+0000","last_undegraded":"2024-09-22T08:37:42.431386+0000","last_fullsized":"2024-09-22T08:37:42.431386+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:09:42.876400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"32'4","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.289565+0000","last_change":"2024-09-22T08:36:25.983379+0000","last_active":"2024-09-22T08:39:32.289565+0000","last_peered":"2024-09-22T08:39:32.289565+0000","last_clean":"2024-09-22T08:39:32.289565+0000","last_became_active":"2024-09-22T08:36:25.983073+0000","last_became_peered":"2024-09-22T08:36:25.983073+0000","last_unstale":"2024-09-22T08:39:32.289565+0000","last_undegraded":"2024-09-22T08:39:32.289565+0000","last_fullsized":"2024-09-22T08:39:32.289565+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:34:22.104673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:05.708471+0000","last_change":"2024-09-22T08:36:23.981302+0000","last_active":"2024-09-22T08:37:05.708471+0000","last_peered":"2024-09-22T08:37:05.708471+0000","last_clean":"2024-09-22T08:37:05.708471+0000","last_became_active":"2024-09-22T08:36:23.980682+0000","last_became_peered":"2024-09-22T08:36:23.980682+0000","last_unstale":"2024-09-22T08:37:05.708471+0000","last_undegraded":"2024-09-22T08:37:05.708471+0000","last_fullsized":"2024-09-22T08:37:05.708471+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:36:38.072840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.225234+0000","last_change":"2024-09-22T08:36:27.985983+0000","last_active":"2024-09-22T08:37:04.225234+0000","last_peered":"2024-09-22T08:37:04.225234+0000","last_clean":"2024-09-22T08:37:04.225234+0000","last_became_active":"2024-09-22T08:36:27.985675+0000","last_became_peered":"2024-09-22T08:36:27.985675+0000","last_unstale":"2024-09-22T08:37:04.225234+0000","last_undegraded":"2024-09-22T08:37:04.225234+0000","last_fullsized":"2024-09-22T08:37:04.225234+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_clean_scrub_stamp":"2024-09-22T08:36:26.962226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:18:38.325978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"32'38","reported_seq":84,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:43.184361+0000","last_change":"2024-09-22T08:36:29.998080+0000","last_active":"2024-09-22T08:38:43.184361+0000","last_peered":"2024-09-22T08:38:43.184361+0000","last_clean":"2024-09-22T08:38:43.184361+0000","last_became_active":"2024-09-22T08:36:29.997542+0000","last_became_peered":"2024-09-22T08:36:29.997542+0000","last_unstale":"2024-09-22T08:38:43.184361+0000","last_undegraded":"2024-09-22T08:38:43.184361+0000","last_fullsized":"2024-09-22T08:38:43.184361+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:42:31.088070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"32'282","reported_seq":348,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.405444+0000","last_change":"2024-09-22T08:36:32.005012+0000","last_active":"2024-09-22T08:39:32.405444+0000","last_peered":"2024-09-22T08:39:32.405444+0000","last_clean":"2024-09-22T08:39:32.405444+0000","last_became_active":"2024-09-22T08:36:32.004441+0000","last_became_peered":"2024-09-22T08:36:32.004441+0000","last_unstale":"2024-09-22T08:39:32.405444+0000","last_undegraded":"2024-09-22T08:39:32.405444+0000","last_fullsized":"2024-09-22T08:39:32.405444+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:10:54.748229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.225164+0000","last_change":"2024-09-22T08:36:34.017600+0000","last_active":"2024-09-22T08:37:04.225164+0000","last_peered":"2024-09-22T08:37:04.225164+0000","last_clean":"2024-09-22T08:37:04.225164+0000","last_became_active":"2024-09-22T08:36:34.017217+0000","last_became_peered":"2024-09-22T08:36:34.017217+0000","last_unstale":"2024-09-22T08:37:04.225164+0000","last_undegraded":"2024-09-22T08:37:04.225164+0000","last_fullsized":"2024-09-22T08:37:04.225164+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:43:08.076327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:47.943350+0000","last_change":"2024-09-22T08:36:25.972507+0000","last_active":"2024-09-22T08:37:47.943350+0000","last_peered":"2024-09-22T08:37:47.943350+0000","last_clean":"2024-09-22T08:37:47.943350+0000","last_became_active":"2024-09-22T08:36:25.972198+0000","last_became_peered":"2024-09-22T08:36:25.972198+0000","last_unstale":"2024-09-22T08:37:47.943350+0000","last_undegraded":"2024-09-22T08:37:47.943350+0000","last_fullsized":"2024-09-22T08:37:47.943350+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:41:22.703676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.224935+0000","last_change":"2024-09-22T08:36:23.978560+0000","last_active":"2024-09-22T08:37:04.224935+0000","last_peered":"2024-09-22T08:37:04.224935+0000","last_clean":"2024-09-22T08:37:04.224935+0000","last_became_active":"2024-09-22T08:36:23.978306+0000","last_became_peered":"2024-09-22T08:36:23.978306+0000","last_unstale":"2024-09-22T08:37:04.224935+0000","last_undegraded":"2024-09-22T08:37:04.224935+0000","last_fullsized":"2024-09-22T08:37:04.224935+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:26:33.317627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.224012+0000","last_change":"2024-09-22T08:36:27.986048+0000","last_active":"2024-09-22T08:37:04.224012+0000","last_peered":"2024-09-22T08:37:04.224012+0000","last_clean":"2024-09-22T08:37:04.224012+0000","last_became_active":"2024-09-22T08:36:27.985751+0000","last_became_peered":"2024-09-22T08:36:27.985751+0000","last_unstale":"2024-09-22T08:37:04.224012+0000","last_undegraded":"2024-09-22T08:37:04.224012+0000","last_fullsized":"2024-09-22T08:37:04.224012+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_clean_scrub_stamp":"2024-09-22T08:36:26.962226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:05:30.441634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"32'55","reported_seq":112,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:30.257382+0000","last_change":"2024-09-22T08:36:29.995500+0000","last_active":"2024-09-22T08:38:30.257382+0000","last_peered":"2024-09-22T08:38:30.257382+0000","last_clean":"2024-09-22T08:38:30.257382+0000","last_became_active":"2024-09-22T08:36:29.995225+0000","last_became_peered":"2024-09-22T08:36:29.995225+0000","last_unstale":"2024-09-22T08:38:30.257382+0000","last_undegraded":"2024-09-22T08:38:30.257382+0000","last_fullsized":"2024-09-22T08:38:30.257382+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:06:45.130197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.223232+0000","last_change":"2024-09-22T08:36:32.003118+0000","last_active":"2024-09-22T08:37:04.223232+0000","last_peered":"2024-09-22T08:37:04.223232+0000","last_clean":"2024-09-22T08:37:04.223232+0000","last_became_active":"2024-09-22T08:36:32.002833+0000","last_became_peered":"2024-09-22T08:36:32.002833+0000","last_unstale":"2024-09-22T08:37:04.223232+0000","last_undegraded":"2024-09-22T08:37:04.223232+0000","last_fullsized":"2024-09-22T08:37:04.223232+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:35:19.477576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"32'18","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.383653+0000","last_change":"2024-09-22T08:36:34.015160+0000","last_active":"2024-09-22T08:39:32.383653+0000","last_peered":"2024-09-22T08:39:32.383653+0000","last_clean":"2024-09-22T08:39:32.383653+0000","last_became_active":"2024-09-22T08:36:34.014853+0000","last_became_peered":"2024-09-22T08:36:34.014853+0000","last_unstale":"2024-09-22T08:39:32.383653+0000","last_undegraded":"2024-09-22T08:39:32.383653+0000","last_fullsized":"2024-09-22T08:39:32.383653+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:14:47.722976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"32'12","reported_seq":70,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:48.128311+0000","last_change":"2024-09-22T08:36:25.977939+0000","last_active":"2024-09-22T08:37:48.128311+0000","last_peered":"2024-09-22T08:37:48.128311+0000","last_clean":"2024-09-22T08:37:48.128311+0000","last_became_active":"2024-09-22T08:36:25.977682+0000","last_became_peered":"2024-09-22T08:36:25.977682+0000","last_unstale":"2024-09-22T08:37:48.128311+0000","last_undegraded":"2024-09-22T08:37:48.128311+0000","last_fullsized":"2024-09-22T08:37:48.128311+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:13:46.550224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":47,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.224398+0000","last_change":"2024-09-22T08:36:23.973186+0000","last_active":"2024-09-22T08:37:04.224398+0000","last_peered":"2024-09-22T08:37:04.224398+0000","last_clean":"2024-09-22T08:37:04.224398+0000","last_became_active":"2024-09-22T08:36:23.972822+0000","last_became_peered":"2024-09-22T08:36:23.972822+0000","last_unstale":"2024-09-22T08:37:04.224398+0000","last_undegraded":"2024-09-22T08:37:04.224398+0000","last_fullsized":"2024-09-22T08:37:04.224398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:47:13.913539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.227778+0000","last_change":"2024-09-22T08:36:27.992047+0000","last_active":"2024-09-22T08:37:04.227778+0000","last_peered":"2024-09-22T08:37:04.227778+0000","last_clean":"2024-09-22T08:37:04.227778+0000","last_became_active":"2024-09-22T08:36:27.991761+0000","last_became_peered":"2024-09-22T08:36:27.991761+0000","last_unstale":"2024-09-22T08:37:04.227778+0000","last_undegraded":"2024-09-22T08:37:04.227778+0000","last_fullsized":"2024-09-22T08:37:04.227778+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_clean_scrub_stamp":"2024-09-22T08:36:26.962226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:45:08.688857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"32'32","reported_seq":76,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:30.237179+0000","last_change":"2024-09-22T08:36:29.988696+0000","last_active":"2024-09-22T08:38:30.237179+0000","last_peered":"2024-09-22T08:38:30.237179+0000","last_clean":"2024-09-22T08:38:30.237179+0000","last_became_active":"2024-09-22T08:36:29.988363+0000","last_became_peered":"2024-09-22T08:36:29.988363+0000","last_unstale":"2024-09-22T08:38:30.237179+0000","last_undegraded":"2024-09-22T08:38:30.237179+0000","last_fullsized":"2024-09-22T08:38:30.237179+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:20:15.843523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.229572+0000","last_change":"2024-09-22T08:36:32.012753+0000","last_active":"2024-09-22T08:37:04.229572+0000","last_peered":"2024-09-22T08:37:04.229572+0000","last_clean":"2024-09-22T08:37:04.229572+0000","last_became_active":"2024-09-22T08:36:32.011923+0000","last_became_peered":"2024-09-22T08:36:32.011923+0000","last_unstale":"2024-09-22T08:37:04.229572+0000","last_undegraded":"2024-09-22T08:37:04.229572+0000","last_fullsized":"2024-09-22T08:37:04.229572+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:27:01.625975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"32'3","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:33.182535+0000","last_change":"2024-09-22T08:36:34.013810+0000","last_active":"2024-09-22T08:38:33.182535+0000","last_peered":"2024-09-22T08:38:33.182535+0000","last_clean":"2024-09-22T08:38:33.182535+0000","last_became_active":"2024-09-22T08:36:34.013308+0000","last_became_peered":"2024-09-22T08:36:34.013308+0000","last_unstale":"2024-09-22T08:38:33.182535+0000","last_undegraded":"2024-09-22T08:38:33.182535+0000","last_fullsized":"2024-09-22T08:38:33.182535+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:08:44.619221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"32'6","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.214676+0000","last_change":"2024-09-22T08:36:25.993564+0000","last_active":"2024-09-22T08:39:32.214676+0000","last_peered":"2024-09-22T08:39:32.214676+0000","last_clean":"2024-09-22T08:39:32.214676+0000","last_became_active":"2024-09-22T08:36:25.992167+0000","last_became_peered":"2024-09-22T08:36:25.992167+0000","last_unstale":"2024-09-22T08:39:32.214676+0000","last_undegraded":"2024-09-22T08:39:32.214676+0000","last_fullsized":"2024-09-22T08:39:32.214676+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:39:40.006672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"32'4","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:31.977133+0000","last_change":"2024-09-22T08:36:23.980852+0000","last_active":"2024-09-22T08:39:31.977133+0000","last_peered":"2024-09-22T08:39:31.977133+0000","last_clean":"2024-09-22T08:39:31.977133+0000","last_became_active":"2024-09-22T08:36:23.980560+0000","last_became_peered":"2024-09-22T08:36:23.980560+0000","last_unstale":"2024-09-22T08:39:31.977133+0000","last_undegraded":"2024-09-22T08:39:31.977133+0000","last_fullsized":"2024-09-22T08:39:31.977133+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:21:04.119270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":6,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.226238+0000","last_change":"2024-09-22T08:36:27.984977+0000","last_active":"2024-09-22T08:37:04.226238+0000","last_peered":"2024-09-22T08:37:04.226238+0000","last_clean":"2024-09-22T08:37:04.226238+0000","last_became_active":"2024-09-22T08:36:27.984699+0000","last_became_peered":"2024-09-22T08:36:27.984699+0000","last_unstale":"2024-09-22T08:37:04.226238+0000","last_undegraded":"2024-09-22T08:37:04.226238+0000","last_fullsized":"2024-09-22T08:37:04.226238+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_clean_scrub_stamp":"2024-09-22T08:36:26.962226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:30:42.385182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"32'36","reported_seq":82,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:30.264969+0000","last_change":"2024-09-22T08:36:29.989330+0000","last_active":"2024-09-22T08:38:30.264969+0000","last_peered":"2024-09-22T08:38:30.264969+0000","last_clean":"2024-09-22T08:38:30.264969+0000","last_became_active":"2024-09-22T08:36:29.989049+0000","last_became_peered":"2024-09-22T08:36:29.989049+0000","last_unstale":"2024-09-22T08:38:30.264969+0000","last_undegraded":"2024-09-22T08:38:30.264969+0000","last_fullsized":"2024-09-22T08:38:30.264969+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:25:38.846675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"32'282","reported_seq":452,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.387667+0000","last_change":"2024-09-22T08:36:32.003714+0000","last_active":"2024-09-22T08:39:32.387667+0000","last_peered":"2024-09-22T08:39:32.387667+0000","last_clean":"2024-09-22T08:39:32.387667+0000","last_became_active":"2024-09-22T08:36:32.003451+0000","last_became_peered":"2024-09-22T08:36:32.003451+0000","last_unstale":"2024-09-22T08:39:32.387667+0000","last_undegraded":"2024-09-22T08:39:32.387667+0000","last_fullsized":"2024-09-22T08:39:32.387667+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:36:40.009194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"32'12","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:38.177618+0000","last_change":"2024-09-22T08:36:34.017932+0000","last_active":"2024-09-22T08:38:38.177618+0000","last_peered":"2024-09-22T08:38:38.177618+0000","last_clean":"2024-09-22T08:38:38.177618+0000","last_became_active":"2024-09-22T08:36:34.017586+0000","last_became_peered":"2024-09-22T08:36:34.017586+0000","last_unstale":"2024-09-22T08:38:38.177618+0000","last_undegraded":"2024-09-22T08:38:38.177618+0000","last_fullsized":"2024-09-22T08:38:38.177618+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:03:46.243863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"32'6","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:31.996687+0000","last_change":"2024-09-22T08:36:25.984089+0000","last_active":"2024-09-22T08:39:31.996687+0000","last_peered":"2024-09-22T08:39:31.996687+0000","last_clean":"2024-09-22T08:39:31.996687+0000","last_became_active":"2024-09-22T08:36:25.983836+0000","last_became_peered":"2024-09-22T08:36:25.983836+0000","last_unstale":"2024-09-22T08:39:31.996687+0000","last_undegraded":"2024-09-22T08:39:31.996687+0000","last_fullsized":"2024-09-22T08:39:31.996687+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:55:24.968571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":29,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.228027+0000","last_change":"2024-09-22T08:36:23.981996+0000","last_active":"2024-09-22T08:37:04.228027+0000","last_peered":"2024-09-22T08:37:04.228027+0000","last_clean":"2024-09-22T08:37:04.228027+0000","last_became_active":"2024-09-22T08:36:23.981453+0000","last_became_peered":"2024-09-22T08:36:23.981453+0000","last_unstale":"2024-09-22T08:37:04.228027+0000","last_undegraded":"2024-09-22T08:37:04.228027+0000","last_fullsized":"2024-09-22T08:37:04.228027+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:48:13.371475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"32'3","reported_seq":414,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:31.306941+0000","last_change":"2024-09-22T08:36:27.990966+0000","last_active":"2024-09-22T08:38:31.306941+0000","last_peered":"2024-09-22T08:38:31.306941+0000","last_clean":"2024-09-22T08:38:31.306941+0000","last_became_active":"2024-09-22T08:36:27.990658+0000","last_became_peered":"2024-09-22T08:36:27.990658+0000","last_unstale":"2024-09-22T08:38:31.306941+0000","last_undegraded":"2024-09-22T08:38:31.306941+0000","last_fullsized":"2024-09-22T08:38:31.306941+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_clean_scrub_stamp":"2024-09-22T08:36:26.962226+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:46:19.841645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":381,"num_read_kb":381,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"30'10","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.225133+0000","last_change":"2024-09-22T08:36:29.994653+0000","last_active":"2024-09-22T08:37:04.225133+0000","last_peered":"2024-09-22T08:37:04.225133+0000","last_clean":"2024-09-22T08:37:04.225133+0000","last_became_active":"2024-09-22T08:36:29.994352+0000","last_became_peered":"2024-09-22T08:36:29.994352+0000","last_unstale":"2024-09-22T08:37:04.225133+0000","last_undegraded":"2024-09-22T08:37:04.225133+0000","last_fullsized":"2024-09-22T08:37:04.225133+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:29:42.839928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"32'282","reported_seq":463,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.396459+0000","last_change":"2024-09-22T08:36:32.002508+0000","last_active":"2024-09-22T08:39:32.396459+0000","last_peered":"2024-09-22T08:39:32.396459+0000","last_clean":"2024-09-22T08:39:32.396459+0000","last_became_active":"2024-09-22T08:36:32.002222+0000","last_became_peered":"2024-09-22T08:36:32.002222+0000","last_unstale":"2024-09-22T08:39:32.396459+0000","last_undegraded":"2024-09-22T08:39:32.396459+0000","last_fullsized":"2024-09-22T08:39:32.396459+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:01:40.774076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"32'4","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:31.432921+0000","last_change":"2024-09-22T08:36:34.016126+0000","last_active":"2024-09-22T08:38:31.432921+0000","last_peered":"2024-09-22T08:38:31.432921+0000","last_clean":"2024-09-22T08:38:31.432921+0000","last_became_active":"2024-09-22T08:36:34.015833+0000","last_became_peered":"2024-09-22T08:36:34.015833+0000","last_unstale":"2024-09-22T08:38:31.432921+0000","last_undegraded":"2024-09-22T08:38:31.432921+0000","last_fullsized":"2024-09-22T08:38:31.432921+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:08:38.502068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"32'6","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.214644+0000","last_change":"2024-09-22T08:36:25.978129+0000","last_active":"2024-09-22T08:39:32.214644+0000","last_peered":"2024-09-22T08:39:32.214644+0000","last_clean":"2024-09-22T08:39:32.214644+0000","last_became_active":"2024-09-22T08:36:25.977184+0000","last_became_peered":"2024-09-22T08:36:25.977184+0000","last_unstale":"2024-09-22T08:39:32.214644+0000","last_undegraded":"2024-09-22T08:39:32.214644+0000","last_fullsized":"2024-09-22T08:39:32.214644+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:04:17.169545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"32'8","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.210634+0000","last_change":"2024-09-22T08:36:23.976950+0000","last_active":"2024-09-22T08:39:32.210634+0000","last_peered":"2024-09-22T08:39:32.210634+0000","last_clean":"2024-09-22T08:39:32.210634+0000","last_became_active":"2024-09-22T08:36:23.976129+0000","last_became_peered":"2024-09-22T08:36:23.976129+0000","last_unstale":"2024-09-22T08:39:32.210634+0000","last_undegraded":"2024-09-22T08:39:32.210634+0000","last_fullsized":"2024-09-22T08:39:32.210634+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:08:20.789789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":14,"num_write":48,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"23'1","reported_seq":219,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:31.307278+0000","last_change":"2024-09-22T08:36:27.988301+0000","last_active":"2024-09-22T08:38:31.307278+0000","last_peered":"2024-09-22T08:38:31.307278+0000","last_clean":"2024-09-22T08:38:31.307278+0000","last_became_active":"2024-09-22T08:36:27.987999+0000","last_became_peered":"2024-09-22T08:36:27.987999+0000","last_unstale":"2024-09-22T08:38:31.307278+0000","last_undegraded":"2024-09-22T08:38:31.307278+0000","last_fullsized":"2024-09-22T08:38:31.307278+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_clean_scrub_stamp":"2024-09-22T08:36:26.962226+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:18:39.538565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":282,"num_read_kb":282,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"32'38","reported_seq":85,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:30.250729+0000","last_change":"2024-09-22T08:36:29.992044+0000","last_active":"2024-09-22T08:38:30.250729+0000","last_peered":"2024-09-22T08:38:30.250729+0000","last_clean":"2024-09-22T08:38:30.250729+0000","last_became_active":"2024-09-22T08:36:29.991671+0000","last_became_peered":"2024-09-22T08:36:29.991671+0000","last_unstale":"2024-09-22T08:38:30.250729+0000","last_undegraded":"2024-09-22T08:38:30.250729+0000","last_fullsized":"2024-09-22T08:38:30.250729+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:30:17.519164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":41,"num_read_kb":31,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.225831+0000","last_change":"2024-09-22T08:36:32.012136+0000","last_active":"2024-09-22T08:37:04.225831+0000","last_peered":"2024-09-22T08:37:04.225831+0000","last_clean":"2024-09-22T08:37:04.225831+0000","last_became_active":"2024-09-22T08:36:32.011845+0000","last_became_peered":"2024-09-22T08:36:32.011845+0000","last_unstale":"2024-09-22T08:37:04.225831+0000","last_undegraded":"2024-09-22T08:37:04.225831+0000","last_fullsized":"2024-09-22T08:37:04.225831+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:30:19.290881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"32'6","reported_seq":25,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.324008+0000","last_change":"2024-09-22T08:36:34.008672+0000","last_active":"2024-09-22T08:39:32.324008+0000","last_peered":"2024-09-22T08:39:32.324008+0000","last_clean":"2024-09-22T08:39:32.324008+0000","last_became_active":"2024-09-22T08:36:34.008374+0000","last_became_peered":"2024-09-22T08:36:34.008374+0000","last_unstale":"2024-09-22T08:39:32.324008+0000","last_undegraded":"2024-09-22T08:39:32.324008+0000","last_fullsized":"2024-09-22T08:39:32.324008+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:58:45.659504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"32'15","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.221742+0000","last_change":"2024-09-22T08:37:04.234725+0000","last_active":"2024-09-22T08:39:32.221742+0000","last_peered":"2024-09-22T08:39:32.221742+0000","last_clean":"2024-09-22T08:39:32.221742+0000","last_became_active":"2024-09-22T08:37:04.228680+0000","last_became_peered":"2024-09-22T08:37:04.228680+0000","last_unstale":"2024-09-22T08:39:32.221742+0000","last_undegraded":"2024-09-22T08:39:32.221742+0000","last_fullsized":"2024-09-22T08:39:32.221742+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:38:57.809846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":62,"num_read_kb":54,"num_write":19,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"12'72","reported_seq":142,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.220993+0000","last_change":"2024-09-22T08:36:10.737141+0000","last_active":"2024-09-22T08:37:04.220993+0000","last_peered":"2024-09-22T08:37:04.220993+0000","last_clean":"2024-09-22T08:37:04.220993+0000","last_became_active":"2024-09-22T08:36:10.736221+0000","last_became_peered":"2024-09-22T08:36:10.736221+0000","last_unstale":"2024-09-22T08:37:04.220993+0000","last_undegraded":"2024-09-22T08:37:04.220993+0000","last_fullsized":"2024-09-22T08:37:04.220993+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:09.401562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:09.401562+0000","last_clean_scrub_stamp":"2024-09-22T08:36:09.401562+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:14:13.135964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.229293+0000","last_change":"2024-09-22T08:36:18.431832+0000","last_active":"2024-09-22T08:37:04.229293+0000","last_peered":"2024-09-22T08:37:04.229293+0000","last_clean":"2024-09-22T08:37:04.229293+0000","last_became_active":"2024-09-22T08:36:16.425465+0000","last_became_peered":"2024-09-22T08:36:16.425465+0000","last_unstale":"2024-09-22T08:37:04.229293+0000","last_undegraded":"2024-09-22T08:37:04.229293+0000","last_fullsized":"2024-09-22T08:37:04.229293+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:15.415268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:15.415268+0000","last_clean_scrub_stamp":"2024-09-22T08:36:15.415268+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:34:11.990226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049376300000000004,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"32'5","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:33.182613+0000","last_change":"2024-09-22T08:36:23.982423+0000","last_active":"2024-09-22T08:38:33.182613+0000","last_peered":"2024-09-22T08:38:33.182613+0000","last_clean":"2024-09-22T08:38:33.182613+0000","last_became_active":"2024-09-22T08:36:23.981576+0000","last_became_peered":"2024-09-22T08:36:23.981576+0000","last_unstale":"2024-09-22T08:38:33.182613+0000","last_undegraded":"2024-09-22T08:38:33.182613+0000","last_fullsized":"2024-09-22T08:38:33.182613+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:44:29.452126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":4,"num_write":21,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.223327+0000","last_change":"2024-09-22T08:36:27.991484+0000","last_active":"2024-09-22T08:37:04.223327+0000","last_peered":"2024-09-22T08:37:04.223327+0000","last_clean":"2024-09-22T08:37:04.223327+0000","last_became_active":"2024-09-22T08:36:27.991130+0000","last_became_peered":"2024-09-22T08:36:27.991130+0000","last_unstale":"2024-09-22T08:37:04.223327+0000","last_undegraded":"2024-09-22T08:37:04.223327+0000","last_fullsized":"2024-09-22T08:37:04.223327+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_clean_scrub_stamp":"2024-09-22T08:36:26.962226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:25:36.836271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"32'76","reported_seq":146,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:30.262305+0000","last_change":"2024-09-22T08:36:29.997752+0000","last_active":"2024-09-22T08:38:30.262305+0000","last_peered":"2024-09-22T08:38:30.262305+0000","last_clean":"2024-09-22T08:38:30.262305+0000","last_became_active":"2024-09-22T08:36:29.997294+0000","last_became_peered":"2024-09-22T08:36:29.997294+0000","last_unstale":"2024-09-22T08:38:30.262305+0000","last_undegraded":"2024-09-22T08:38:30.262305+0000","last_fullsized":"2024-09-22T08:38:30.262305+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:18:13.227210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.226456+0000","last_change":"2024-09-22T08:36:32.009096+0000","last_active":"2024-09-22T08:37:04.226456+0000","last_peered":"2024-09-22T08:37:04.226456+0000","last_clean":"2024-09-22T08:37:04.226456+0000","last_became_active":"2024-09-22T08:36:32.008793+0000","last_became_peered":"2024-09-22T08:36:32.008793+0000","last_unstale":"2024-09-22T08:37:04.226456+0000","last_undegraded":"2024-09-22T08:37:04.226456+0000","last_fullsized":"2024-09-22T08:37:04.226456+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:01:07.495676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"32'81","reported_seq":163,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.301899+0000","last_change":"2024-09-22T08:36:34.016827+0000","last_active":"2024-09-22T08:39:32.301899+0000","last_peered":"2024-09-22T08:39:32.301899+0000","last_clean":"2024-09-22T08:39:32.301899+0000","last_became_active":"2024-09-22T08:36:34.016484+0000","last_became_peered":"2024-09-22T08:36:34.016484+0000","last_unstale":"2024-09-22T08:39:32.301899+0000","last_undegraded":"2024-09-22T08:39:32.301899+0000","last_fullsized":"2024-09-22T08:39:32.301899+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:27:41.551286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":223,"num_read_kb":221,"num_write":155,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"32'6","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.289629+0000","last_change":"2024-09-22T08:36:25.988439+0000","last_active":"2024-09-22T08:39:32.289629+0000","last_peered":"2024-09-22T08:39:32.289629+0000","last_clean":"2024-09-22T08:39:32.289629+0000","last_became_active":"2024-09-22T08:36:25.988156+0000","last_became_peered":"2024-09-22T08:36:25.988156+0000","last_unstale":"2024-09-22T08:39:32.289629+0000","last_undegraded":"2024-09-22T08:39:32.289629+0000","last_fullsized":"2024-09-22T08:39:32.289629+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:02:27.083682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.225823+0000","last_change":"2024-09-22T08:36:18.431890+0000","last_active":"2024-09-22T08:37:04.225823+0000","last_peered":"2024-09-22T08:37:04.225823+0000","last_clean":"2024-09-22T08:37:04.225823+0000","last_became_active":"2024-09-22T08:36:16.427252+0000","last_became_peered":"2024-09-22T08:36:16.427252+0000","last_unstale":"2024-09-22T08:37:04.225823+0000","last_undegraded":"2024-09-22T08:37:04.225823+0000","last_fullsized":"2024-09-22T08:37:04.225823+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:15.415268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:15.415268+0000","last_clean_scrub_stamp":"2024-09-22T08:36:15.415268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:11:12.623975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055484200000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.223638+0000","last_change":"2024-09-22T08:36:23.974666+0000","last_active":"2024-09-22T08:37:04.223638+0000","last_peered":"2024-09-22T08:37:04.223638+0000","last_clean":"2024-09-22T08:37:04.223638+0000","last_became_active":"2024-09-22T08:36:23.973773+0000","last_became_peered":"2024-09-22T08:36:23.973773+0000","last_unstale":"2024-09-22T08:37:04.223638+0000","last_undegraded":"2024-09-22T08:37:04.223638+0000","last_fullsized":"2024-09-22T08:37:04.223638+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:04:51.934564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.236920+0000","last_change":"2024-09-22T08:37:04.234583+0000","last_active":"2024-09-22T08:37:04.236920+0000","last_peered":"2024-09-22T08:37:04.236920+0000","last_clean":"2024-09-22T08:37:04.236920+0000","last_became_active":"2024-09-22T08:37:04.234316+0000","last_became_peered":"2024-09-22T08:37:04.234316+0000","last_unstale":"2024-09-22T08:37:04.236920+0000","last_undegraded":"2024-09-22T08:37:04.236920+0000","last_fullsized":"2024-09-22T08:37:04.236920+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_clean_scrub_stamp":"2024-09-22T08:36:26.962226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:12:15.239608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"32'274","reported_seq":477,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:28.067633+0000","last_change":"2024-09-22T08:36:29.996545+0000","last_active":"2024-09-22T08:39:28.067633+0000","last_peered":"2024-09-22T08:39:28.067633+0000","last_clean":"2024-09-22T08:39:28.067633+0000","last_became_active":"2024-09-22T08:36:29.996025+0000","last_became_peered":"2024-09-22T08:36:29.996025+0000","last_unstale":"2024-09-22T08:39:28.067633+0000","last_undegraded":"2024-09-22T08:39:28.067633+0000","last_fullsized":"2024-09-22T08:39:28.067633+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":274,"log_dups_size":0,"ondisk_log_size":274,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:55:34.543185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":357,"num_read_kb":342,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.227773+0000","last_change":"2024-09-22T08:36:32.013929+0000","last_active":"2024-09-22T08:37:04.227773+0000","last_peered":"2024-09-22T08:37:04.227773+0000","last_clean":"2024-09-22T08:37:04.227773+0000","last_became_active":"2024-09-22T08:36:32.013220+0000","last_became_peered":"2024-09-22T08:36:32.013220+0000","last_unstale":"2024-09-22T08:37:04.227773+0000","last_undegraded":"2024-09-22T08:37:04.227773+0000","last_fullsized":"2024-09-22T08:37:04.227773+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:57:05.813999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"32'5","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:28.578046+0000","last_change":"2024-09-22T08:36:34.018385+0000","last_active":"2024-09-22T08:38:28.578046+0000","last_peered":"2024-09-22T08:38:28.578046+0000","last_clean":"2024-09-22T08:38:28.578046+0000","last_became_active":"2024-09-22T08:36:34.018138+0000","last_became_peered":"2024-09-22T08:36:34.018138+0000","last_unstale":"2024-09-22T08:38:28.578046+0000","last_undegraded":"2024-09-22T08:38:28.578046+0000","last_fullsized":"2024-09-22T08:38:28.578046+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:47:34.849746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"32'8","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.214950+0000","last_change":"2024-09-22T08:36:25.979635+0000","last_active":"2024-09-22T08:39:32.214950+0000","last_peered":"2024-09-22T08:39:32.214950+0000","last_clean":"2024-09-22T08:39:32.214950+0000","last_became_active":"2024-09-22T08:36:25.979108+0000","last_became_peered":"2024-09-22T08:36:25.979108+0000","last_unstale":"2024-09-22T08:39:32.214950+0000","last_undegraded":"2024-09-22T08:39:32.214950+0000","last_fullsized":"2024-09-22T08:39:32.214950+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:18:04.046419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.225590+0000","last_change":"2024-09-22T08:36:18.520219+0000","last_active":"2024-09-22T08:37:04.225590+0000","last_peered":"2024-09-22T08:37:04.225590+0000","last_clean":"2024-09-22T08:37:04.225590+0000","last_became_active":"2024-09-22T08:36:16.427121+0000","last_became_peered":"2024-09-22T08:36:16.427121+0000","last_unstale":"2024-09-22T08:37:04.225590+0000","last_undegraded":"2024-09-22T08:37:04.225590+0000","last_fullsized":"2024-09-22T08:37:04.225590+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:15.415268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:15.415268+0000","last_clean_scrub_stamp":"2024-09-22T08:36:15.415268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:47:57.246114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041194099999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"32'1","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:28.175943+0000","last_change":"2024-09-22T08:36:23.972065+0000","last_active":"2024-09-22T08:38:28.175943+0000","last_peered":"2024-09-22T08:38:28.175943+0000","last_clean":"2024-09-22T08:38:28.175943+0000","last_became_active":"2024-09-22T08:36:23.971688+0000","last_became_peered":"2024-09-22T08:36:23.971688+0000","last_unstale":"2024-09-22T08:38:28.175943+0000","last_undegraded":"2024-09-22T08:38:28.175943+0000","last_fullsized":"2024-09-22T08:38:28.175943+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:57:13.077784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":639872,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"23'1","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.230019+0000","last_change":"2024-09-22T08:36:27.987350+0000","last_active":"2024-09-22T08:37:04.230019+0000","last_peered":"2024-09-22T08:37:04.230019+0000","last_clean":"2024-09-22T08:37:04.230019+0000","last_became_active":"2024-09-22T08:36:27.986993+0000","last_became_peered":"2024-09-22T08:36:27.986993+0000","last_unstale":"2024-09-22T08:37:04.230019+0000","last_undegraded":"2024-09-22T08:37:04.230019+0000","last_fullsized":"2024-09-22T08:37:04.230019+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_clean_scrub_stamp":"2024-09-22T08:36:26.962226+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:04:19.174975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"32'17","reported_seq":85,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:28.067597+0000","last_change":"2024-09-22T08:36:29.991891+0000","last_active":"2024-09-22T08:39:28.067597+0000","last_peered":"2024-09-22T08:39:28.067597+0000","last_clean":"2024-09-22T08:39:28.067597+0000","last_became_active":"2024-09-22T08:36:29.991579+0000","last_became_peered":"2024-09-22T08:36:29.991579+0000","last_unstale":"2024-09-22T08:39:28.067597+0000","last_undegraded":"2024-09-22T08:39:28.067597+0000","last_fullsized":"2024-09-22T08:39:28.067597+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:17:51.757786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.224585+0000","last_change":"2024-09-22T08:36:32.011889+0000","last_active":"2024-09-22T08:37:04.224585+0000","last_peered":"2024-09-22T08:37:04.224585+0000","last_clean":"2024-09-22T08:37:04.224585+0000","last_became_active":"2024-09-22T08:36:32.011634+0000","last_became_peered":"2024-09-22T08:36:32.011634+0000","last_unstale":"2024-09-22T08:37:04.224585+0000","last_undegraded":"2024-09-22T08:37:04.224585+0000","last_fullsized":"2024-09-22T08:37:04.224585+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:56:34.615539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.226958+0000","last_change":"2024-09-22T08:36:34.012423+0000","last_active":"2024-09-22T08:37:04.226958+0000","last_peered":"2024-09-22T08:37:04.226958+0000","last_clean":"2024-09-22T08:37:04.226958+0000","last_became_active":"2024-09-22T08:36:34.011936+0000","last_became_peered":"2024-09-22T08:36:34.011936+0000","last_unstale":"2024-09-22T08:37:04.226958+0000","last_undegraded":"2024-09-22T08:37:04.226958+0000","last_fullsized":"2024-09-22T08:37:04.226958+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:29:05.565248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"32'3","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:33.176834+0000","last_change":"2024-09-22T08:36:25.977871+0000","last_active":"2024-09-22T08:38:33.176834+0000","last_peered":"2024-09-22T08:38:33.176834+0000","last_clean":"2024-09-22T08:38:33.176834+0000","last_became_active":"2024-09-22T08:36:25.977552+0000","last_became_peered":"2024-09-22T08:36:25.977552+0000","last_unstale":"2024-09-22T08:38:33.176834+0000","last_undegraded":"2024-09-22T08:38:33.176834+0000","last_fullsized":"2024-09-22T08:38:33.176834+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:22:41.119685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.227504+0000","last_change":"2024-09-22T08:36:18.432421+0000","last_active":"2024-09-22T08:37:04.227504+0000","last_peered":"2024-09-22T08:37:04.227504+0000","last_clean":"2024-09-22T08:37:04.227504+0000","last_became_active":"2024-09-22T08:36:16.427358+0000","last_became_peered":"2024-09-22T08:36:16.427358+0000","last_unstale":"2024-09-22T08:37:04.227504+0000","last_undegraded":"2024-09-22T08:37:04.227504+0000","last_fullsized":"2024-09-22T08:37:04.227504+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:15.415268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:15.415268+0000","last_clean_scrub_stamp":"2024-09-22T08:36:15.415268+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:16:15.903021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001068835,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"32'4","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.208130+0000","last_change":"2024-09-22T08:36:23.967690+0000","last_active":"2024-09-22T08:39:32.208130+0000","last_peered":"2024-09-22T08:39:32.208130+0000","last_clean":"2024-09-22T08:39:32.208130+0000","last_became_active":"2024-09-22T08:36:23.967413+0000","last_became_peered":"2024-09-22T08:36:23.967413+0000","last_unstale":"2024-09-22T08:39:32.208130+0000","last_undegraded":"2024-09-22T08:39:32.208130+0000","last_fullsized":"2024-09-22T08:39:32.208130+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:53:44.806098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.225286+0000","last_change":"2024-09-22T08:36:27.988932+0000","last_active":"2024-09-22T08:37:04.225286+0000","last_peered":"2024-09-22T08:37:04.225286+0000","last_clean":"2024-09-22T08:37:04.225286+0000","last_became_active":"2024-09-22T08:36:27.988507+0000","last_became_peered":"2024-09-22T08:36:27.988507+0000","last_unstale":"2024-09-22T08:37:04.225286+0000","last_undegraded":"2024-09-22T08:37:04.225286+0000","last_fullsized":"2024-09-22T08:37:04.225286+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_clean_scrub_stamp":"2024-09-22T08:36:26.962226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:48:06.094834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"32'13","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:31.660162+0000","last_change":"2024-09-22T08:36:29.996842+0000","last_active":"2024-09-22T08:39:31.660162+0000","last_peered":"2024-09-22T08:39:31.660162+0000","last_clean":"2024-09-22T08:39:31.660162+0000","last_became_active":"2024-09-22T08:36:29.996557+0000","last_became_peered":"2024-09-22T08:36:29.996557+0000","last_unstale":"2024-09-22T08:39:31.660162+0000","last_undegraded":"2024-09-22T08:39:31.660162+0000","last_fullsized":"2024-09-22T08:39:31.660162+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:05:26.776730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.229775+0000","last_change":"2024-09-22T08:36:32.014226+0000","last_active":"2024-09-22T08:37:04.229775+0000","last_peered":"2024-09-22T08:37:04.229775+0000","last_clean":"2024-09-22T08:37:04.229775+0000","last_became_active":"2024-09-22T08:36:32.013320+0000","last_became_peered":"2024-09-22T08:36:32.013320+0000","last_unstale":"2024-09-22T08:37:04.229775+0000","last_undegraded":"2024-09-22T08:37:04.229775+0000","last_fullsized":"2024-09-22T08:37:04.229775+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:03:21.762780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"32'4","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:31.413581+0000","last_change":"2024-09-22T08:36:34.015737+0000","last_active":"2024-09-22T08:38:31.413581+0000","last_peered":"2024-09-22T08:38:31.413581+0000","last_clean":"2024-09-22T08:38:31.413581+0000","last_became_active":"2024-09-22T08:36:34.015483+0000","last_became_peered":"2024-09-22T08:36:34.015483+0000","last_unstale":"2024-09-22T08:38:31.413581+0000","last_undegraded":"2024-09-22T08:38:31.413581+0000","last_fullsized":"2024-09-22T08:38:31.413581+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:08:04.974029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"32'8","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.078825+0000","last_change":"2024-09-22T08:36:25.986838+0000","last_active":"2024-09-22T08:39:32.078825+0000","last_peered":"2024-09-22T08:39:32.078825+0000","last_clean":"2024-09-22T08:39:32.078825+0000","last_became_active":"2024-09-22T08:36:25.986551+0000","last_became_peered":"2024-09-22T08:36:25.986551+0000","last_unstale":"2024-09-22T08:39:32.078825+0000","last_undegraded":"2024-09-22T08:39:32.078825+0000","last_fullsized":"2024-09-22T08:39:32.078825+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:52:57.511753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.225659+0000","last_change":"2024-09-22T08:36:23.968878+0000","last_active":"2024-09-22T08:37:04.225659+0000","last_peered":"2024-09-22T08:37:04.225659+0000","last_clean":"2024-09-22T08:37:04.225659+0000","last_became_active":"2024-09-22T08:36:23.968525+0000","last_became_peered":"2024-09-22T08:36:23.968525+0000","last_unstale":"2024-09-22T08:37:04.225659+0000","last_undegraded":"2024-09-22T08:37:04.225659+0000","last_fullsized":"2024-09-22T08:37:04.225659+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:02:28.926834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.224477+0000","last_change":"2024-09-22T08:36:18.434398+0000","last_active":"2024-09-22T08:37:04.224477+0000","last_peered":"2024-09-22T08:37:04.224477+0000","last_clean":"2024-09-22T08:37:04.224477+0000","last_became_active":"2024-09-22T08:36:16.424946+0000","last_became_peered":"2024-09-22T08:36:16.424946+0000","last_unstale":"2024-09-22T08:37:04.224477+0000","last_undegraded":"2024-09-22T08:37:04.224477+0000","last_fullsized":"2024-09-22T08:37:04.224477+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:15.415268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:15.415268+0000","last_clean_scrub_stamp":"2024-09-22T08:36:15.415268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:29:12.209070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045979400000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"32'1","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:33.176792+0000","last_change":"2024-09-22T08:36:27.988495+0000","last_active":"2024-09-22T08:38:33.176792+0000","last_peered":"2024-09-22T08:38:33.176792+0000","last_clean":"2024-09-22T08:38:33.176792+0000","last_became_active":"2024-09-22T08:36:27.987997+0000","last_became_peered":"2024-09-22T08:36:27.987997+0000","last_unstale":"2024-09-22T08:38:33.176792+0000","last_undegraded":"2024-09-22T08:38:33.176792+0000","last_fullsized":"2024-09-22T08:38:33.176792+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_clean_scrub_stamp":"2024-09-22T08:36:26.962226+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:35:11.843511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"32'63","reported_seq":123,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:33.176707+0000","last_change":"2024-09-22T08:36:29.994493+0000","last_active":"2024-09-22T08:38:33.176707+0000","last_peered":"2024-09-22T08:38:33.176707+0000","last_clean":"2024-09-22T08:38:33.176707+0000","last_became_active":"2024-09-22T08:36:29.994186+0000","last_became_peered":"2024-09-22T08:36:29.994186+0000","last_unstale":"2024-09-22T08:38:33.176707+0000","last_undegraded":"2024-09-22T08:38:33.176707+0000","last_fullsized":"2024-09-22T08:38:33.176707+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:18:59.702792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":59,"num_read_kb":47,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.228168+0000","last_change":"2024-09-22T08:36:32.003689+0000","last_active":"2024-09-22T08:37:04.228168+0000","last_peered":"2024-09-22T08:37:04.228168+0000","last_clean":"2024-09-22T08:37:04.228168+0000","last_became_active":"2024-09-22T08:36:32.003409+0000","last_became_peered":"2024-09-22T08:36:32.003409+0000","last_unstale":"2024-09-22T08:37:04.228168+0000","last_undegraded":"2024-09-22T08:37:04.228168+0000","last_fullsized":"2024-09-22T08:37:04.228168+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:27:05.933480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"32'13","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:31.589959+0000","last_change":"2024-09-22T08:36:34.013068+0000","last_active":"2024-09-22T08:38:31.589959+0000","last_peered":"2024-09-22T08:38:31.589959+0000","last_clean":"2024-09-22T08:38:31.589959+0000","last_became_active":"2024-09-22T08:36:34.012782+0000","last_became_peered":"2024-09-22T08:36:34.012782+0000","last_unstale":"2024-09-22T08:38:31.589959+0000","last_undegraded":"2024-09-22T08:38:31.589959+0000","last_fullsized":"2024-09-22T08:38:31.589959+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:16:13.410088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":25,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"32'6","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:31.996095+0000","last_change":"2024-09-22T08:36:25.985097+0000","last_active":"2024-09-22T08:39:31.996095+0000","last_peered":"2024-09-22T08:39:31.996095+0000","last_clean":"2024-09-22T08:39:31.996095+0000","last_became_active":"2024-09-22T08:36:25.984820+0000","last_became_peered":"2024-09-22T08:36:25.984820+0000","last_unstale":"2024-09-22T08:39:31.996095+0000","last_undegraded":"2024-09-22T08:39:31.996095+0000","last_fullsized":"2024-09-22T08:39:31.996095+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:42:09.685963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":29,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.613983+0000","last_change":"2024-09-22T08:36:23.974058+0000","last_active":"2024-09-22T08:37:04.613983+0000","last_peered":"2024-09-22T08:37:04.613983+0000","last_clean":"2024-09-22T08:37:04.613983+0000","last_became_active":"2024-09-22T08:36:23.973672+0000","last_became_peered":"2024-09-22T08:36:23.973672+0000","last_unstale":"2024-09-22T08:37:04.613983+0000","last_undegraded":"2024-09-22T08:37:04.613983+0000","last_fullsized":"2024-09-22T08:37:04.613983+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:01:29.462654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.231504+0000","last_change":"2024-09-22T08:36:18.432154+0000","last_active":"2024-09-22T08:37:04.231504+0000","last_peered":"2024-09-22T08:37:04.231504+0000","last_clean":"2024-09-22T08:37:04.231504+0000","last_became_active":"2024-09-22T08:36:16.427154+0000","last_became_peered":"2024-09-22T08:36:16.427154+0000","last_unstale":"2024-09-22T08:37:04.231504+0000","last_undegraded":"2024-09-22T08:37:04.231504+0000","last_fullsized":"2024-09-22T08:37:04.231504+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:15.415268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:15.415268+0000","last_clean_scrub_stamp":"2024-09-22T08:36:15.415268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:44:41.260462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081028899999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.236919+0000","last_change":"2024-09-22T08:37:04.234588+0000","last_active":"2024-09-22T08:37:04.236919+0000","last_peered":"2024-09-22T08:37:04.236919+0000","last_clean":"2024-09-22T08:37:04.236919+0000","last_became_active":"2024-09-22T08:37:04.233981+0000","last_became_peered":"2024-09-22T08:37:04.233981+0000","last_unstale":"2024-09-22T08:37:04.236919+0000","last_undegraded":"2024-09-22T08:37:04.236919+0000","last_fullsized":"2024-09-22T08:37:04.236919+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_clean_scrub_stamp":"2024-09-22T08:36:26.962226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:01:06.235869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"32'15","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:28.585360+0000","last_change":"2024-09-22T08:36:29.995560+0000","last_active":"2024-09-22T08:38:28.585360+0000","last_peered":"2024-09-22T08:38:28.585360+0000","last_clean":"2024-09-22T08:38:28.585360+0000","last_became_active":"2024-09-22T08:36:29.995173+0000","last_became_peered":"2024-09-22T08:36:29.995173+0000","last_unstale":"2024-09-22T08:38:28.585360+0000","last_undegraded":"2024-09-22T08:38:28.585360+0000","last_fullsized":"2024-09-22T08:38:28.585360+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:37:47.696313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"32'282","reported_seq":346,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:28.067667+0000","last_change":"2024-09-22T08:36:32.003255+0000","last_active":"2024-09-22T08:39:28.067667+0000","last_peered":"2024-09-22T08:39:28.067667+0000","last_clean":"2024-09-22T08:39:28.067667+0000","last_became_active":"2024-09-22T08:36:32.002985+0000","last_became_peered":"2024-09-22T08:36:32.002985+0000","last_unstale":"2024-09-22T08:39:28.067667+0000","last_undegraded":"2024-09-22T08:39:28.067667+0000","last_fullsized":"2024-09-22T08:39:28.067667+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:27:39.543678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.227398+0000","last_change":"2024-09-22T08:36:34.019732+0000","last_active":"2024-09-22T08:37:04.227398+0000","last_peered":"2024-09-22T08:37:04.227398+0000","last_clean":"2024-09-22T08:37:04.227398+0000","last_became_active":"2024-09-22T08:36:34.019438+0000","last_became_peered":"2024-09-22T08:36:34.019438+0000","last_unstale":"2024-09-22T08:37:04.227398+0000","last_undegraded":"2024-09-22T08:37:04.227398+0000","last_fullsized":"2024-09-22T08:37:04.227398+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:29:22.767417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"32'3","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.267975+0000","last_change":"2024-09-22T08:36:25.992413+0000","last_active":"2024-09-22T08:39:32.267975+0000","last_peered":"2024-09-22T08:39:32.267975+0000","last_clean":"2024-09-22T08:39:32.267975+0000","last_became_active":"2024-09-22T08:36:25.991480+0000","last_became_peered":"2024-09-22T08:36:25.991480+0000","last_unstale":"2024-09-22T08:39:32.267975+0000","last_undegraded":"2024-09-22T08:39:32.267975+0000","last_fullsized":"2024-09-22T08:39:32.267975+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:10:58.578162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:05.167463+0000","last_change":"2024-09-22T08:37:04.227877+0000","last_active":"2024-09-22T08:37:05.167463+0000","last_peered":"2024-09-22T08:37:05.167463+0000","last_clean":"2024-09-22T08:37:05.167463+0000","last_became_active":"2024-09-22T08:37:04.227561+0000","last_became_peered":"2024-09-22T08:37:04.227561+0000","last_unstale":"2024-09-22T08:37:05.167463+0000","last_undegraded":"2024-09-22T08:37:05.167463+0000","last_fullsized":"2024-09-22T08:37:05.167463+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:00:14.486207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.225363+0000","last_change":"2024-09-22T08:36:18.434431+0000","last_active":"2024-09-22T08:37:04.225363+0000","last_peered":"2024-09-22T08:37:04.225363+0000","last_clean":"2024-09-22T08:37:04.225363+0000","last_became_active":"2024-09-22T08:36:16.425549+0000","last_became_peered":"2024-09-22T08:36:16.425549+0000","last_unstale":"2024-09-22T08:37:04.225363+0000","last_undegraded":"2024-09-22T08:37:04.225363+0000","last_fullsized":"2024-09-22T08:37:04.225363+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:15.415268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:15.415268+0000","last_clean_scrub_stamp":"2024-09-22T08:36:15.415268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:59:01.714308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045809600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.229558+0000","last_change":"2024-09-22T08:36:27.987430+0000","last_active":"2024-09-22T08:37:04.229558+0000","last_peered":"2024-09-22T08:37:04.229558+0000","last_clean":"2024-09-22T08:37:04.229558+0000","last_became_active":"2024-09-22T08:36:27.987074+0000","last_became_peered":"2024-09-22T08:36:27.987074+0000","last_unstale":"2024-09-22T08:37:04.229558+0000","last_undegraded":"2024-09-22T08:37:04.229558+0000","last_fullsized":"2024-09-22T08:37:04.229558+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_clean_scrub_stamp":"2024-09-22T08:36:26.962226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:08:31.905654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"30'10","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.228539+0000","last_change":"2024-09-22T08:36:30.000809+0000","last_active":"2024-09-22T08:37:04.228539+0000","last_peered":"2024-09-22T08:37:04.228539+0000","last_clean":"2024-09-22T08:37:04.228539+0000","last_became_active":"2024-09-22T08:36:29.999965+0000","last_became_peered":"2024-09-22T08:36:29.999965+0000","last_unstale":"2024-09-22T08:37:04.228539+0000","last_undegraded":"2024-09-22T08:37:04.228539+0000","last_fullsized":"2024-09-22T08:37:04.228539+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:05:54.815446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"32'282","reported_seq":389,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.384270+0000","last_change":"2024-09-22T08:36:32.005583+0000","last_active":"2024-09-22T08:39:32.384270+0000","last_peered":"2024-09-22T08:39:32.384270+0000","last_clean":"2024-09-22T08:39:32.384270+0000","last_became_active":"2024-09-22T08:36:32.005155+0000","last_became_peered":"2024-09-22T08:36:32.005155+0000","last_unstale":"2024-09-22T08:39:32.384270+0000","last_undegraded":"2024-09-22T08:39:32.384270+0000","last_fullsized":"2024-09-22T08:39:32.384270+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:01:17.946935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"30'5","reported_seq":25,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.223266+0000","last_change":"2024-09-22T08:36:34.022617+0000","last_active":"2024-09-22T08:37:04.223266+0000","last_peered":"2024-09-22T08:37:04.223266+0000","last_clean":"2024-09-22T08:37:04.223266+0000","last_became_active":"2024-09-22T08:36:34.022313+0000","last_became_peered":"2024-09-22T08:36:34.022313+0000","last_unstale":"2024-09-22T08:37:04.223266+0000","last_undegraded":"2024-09-22T08:37:04.223266+0000","last_fullsized":"2024-09-22T08:37:04.223266+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:42:55.182851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":11,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"32'4","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:06.180363+0000","last_change":"2024-09-22T08:36:25.975148+0000","last_active":"2024-09-22T08:37:06.180363+0000","last_peered":"2024-09-22T08:37:06.180363+0000","last_clean":"2024-09-22T08:37:06.180363+0000","last_became_active":"2024-09-22T08:36:25.974884+0000","last_became_peered":"2024-09-22T08:36:25.974884+0000","last_unstale":"2024-09-22T08:37:06.180363+0000","last_undegraded":"2024-09-22T08:37:06.180363+0000","last_fullsized":"2024-09-22T08:37:06.180363+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:22:54.131230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"32'5","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:47.933891+0000","last_change":"2024-09-22T08:36:23.976867+0000","last_active":"2024-09-22T08:37:47.933891+0000","last_peered":"2024-09-22T08:37:47.933891+0000","last_clean":"2024-09-22T08:37:47.933891+0000","last_became_active":"2024-09-22T08:36:23.976646+0000","last_became_peered":"2024-09-22T08:36:23.976646+0000","last_unstale":"2024-09-22T08:37:47.933891+0000","last_undegraded":"2024-09-22T08:37:47.933891+0000","last_fullsized":"2024-09-22T08:37:47.933891+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:26:49.921857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":11,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.229890+0000","last_change":"2024-09-22T08:36:18.432491+0000","last_active":"2024-09-22T08:37:04.229890+0000","last_peered":"2024-09-22T08:37:04.229890+0000","last_clean":"2024-09-22T08:37:04.229890+0000","last_became_active":"2024-09-22T08:36:16.638610+0000","last_became_peered":"2024-09-22T08:36:16.638610+0000","last_unstale":"2024-09-22T08:37:04.229890+0000","last_undegraded":"2024-09-22T08:37:04.229890+0000","last_fullsized":"2024-09-22T08:37:04.229890+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:15.415268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:15.415268+0000","last_clean_scrub_stamp":"2024-09-22T08:36:15.415268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:36:49.729872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001119264,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.226781+0000","last_change":"2024-09-22T08:36:27.985127+0000","last_active":"2024-09-22T08:37:04.226781+0000","last_peered":"2024-09-22T08:37:04.226781+0000","last_clean":"2024-09-22T08:37:04.226781+0000","last_became_active":"2024-09-22T08:36:27.984803+0000","last_became_peered":"2024-09-22T08:36:27.984803+0000","last_unstale":"2024-09-22T08:37:04.226781+0000","last_undegraded":"2024-09-22T08:37:04.226781+0000","last_fullsized":"2024-09-22T08:37:04.226781+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_clean_scrub_stamp":"2024-09-22T08:36:26.962226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:51:28.889992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"32'84","reported_seq":157,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:30.248529+0000","last_change":"2024-09-22T08:36:30.000659+0000","last_active":"2024-09-22T08:38:30.248529+0000","last_peered":"2024-09-22T08:38:30.248529+0000","last_clean":"2024-09-22T08:38:30.248529+0000","last_became_active":"2024-09-22T08:36:30.000270+0000","last_became_peered":"2024-09-22T08:36:30.000270+0000","last_unstale":"2024-09-22T08:38:30.248529+0000","last_undegraded":"2024-09-22T08:38:30.248529+0000","last_fullsized":"2024-09-22T08:38:30.248529+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:27:22.890604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4316,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":81,"num_read_kb":82,"num_write":32,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.223565+0000","last_change":"2024-09-22T08:36:32.003206+0000","last_active":"2024-09-22T08:37:04.223565+0000","last_peered":"2024-09-22T08:37:04.223565+0000","last_clean":"2024-09-22T08:37:04.223565+0000","last_became_active":"2024-09-22T08:36:32.002876+0000","last_became_peered":"2024-09-22T08:36:32.002876+0000","last_unstale":"2024-09-22T08:37:04.223565+0000","last_undegraded":"2024-09-22T08:37:04.223565+0000","last_fullsized":"2024-09-22T08:37:04.223565+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:07:07.136733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"30'2","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.228242+0000","last_change":"2024-09-22T08:36:34.016952+0000","last_active":"2024-09-22T08:37:04.228242+0000","last_peered":"2024-09-22T08:37:04.228242+0000","last_clean":"2024-09-22T08:37:04.228242+0000","last_became_active":"2024-09-22T08:36:34.016659+0000","last_became_peered":"2024-09-22T08:36:34.016659+0000","last_unstale":"2024-09-22T08:37:04.228242+0000","last_undegraded":"2024-09-22T08:37:04.228242+0000","last_fullsized":"2024-09-22T08:37:04.228242+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:01:42.781684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.229370+0000","last_change":"2024-09-22T08:36:34.015661+0000","last_active":"2024-09-22T08:37:04.229370+0000","last_peered":"2024-09-22T08:37:04.229370+0000","last_clean":"2024-09-22T08:37:04.229370+0000","last_became_active":"2024-09-22T08:36:34.015241+0000","last_became_peered":"2024-09-22T08:36:34.015241+0000","last_unstale":"2024-09-22T08:37:04.229370+0000","last_undegraded":"2024-09-22T08:37:04.229370+0000","last_fullsized":"2024-09-22T08:37:04.229370+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:13:28.913225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"32'4","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.259199+0000","last_change":"2024-09-22T08:36:25.987431+0000","last_active":"2024-09-22T08:39:32.259199+0000","last_peered":"2024-09-22T08:39:32.259199+0000","last_clean":"2024-09-22T08:39:32.259199+0000","last_became_active":"2024-09-22T08:36:25.987153+0000","last_became_peered":"2024-09-22T08:36:25.987153+0000","last_unstale":"2024-09-22T08:39:32.259199+0000","last_undegraded":"2024-09-22T08:39:32.259199+0000","last_fullsized":"2024-09-22T08:39:32.259199+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:33:37.909896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.225028+0000","last_change":"2024-09-22T08:36:23.982772+0000","last_active":"2024-09-22T08:37:04.225028+0000","last_peered":"2024-09-22T08:37:04.225028+0000","last_clean":"2024-09-22T08:37:04.225028+0000","last_became_active":"2024-09-22T08:36:23.981927+0000","last_became_peered":"2024-09-22T08:36:23.981927+0000","last_unstale":"2024-09-22T08:37:04.225028+0000","last_undegraded":"2024-09-22T08:37:04.225028+0000","last_fullsized":"2024-09-22T08:37:04.225028+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:12:33.585769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.222089+0000","last_change":"2024-09-22T08:36:27.990795+0000","last_active":"2024-09-22T08:37:04.222089+0000","last_peered":"2024-09-22T08:37:04.222089+0000","last_clean":"2024-09-22T08:37:04.222089+0000","last_became_active":"2024-09-22T08:36:27.990153+0000","last_became_peered":"2024-09-22T08:36:27.990153+0000","last_unstale":"2024-09-22T08:37:04.222089+0000","last_undegraded":"2024-09-22T08:37:04.222089+0000","last_fullsized":"2024-09-22T08:37:04.222089+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_clean_scrub_stamp":"2024-09-22T08:36:26.962226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:44:21.494770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"32'33","reported_seq":77,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:53.186450+0000","last_change":"2024-09-22T08:36:29.998789+0000","last_active":"2024-09-22T08:38:53.186450+0000","last_peered":"2024-09-22T08:38:53.186450+0000","last_clean":"2024-09-22T08:38:53.186450+0000","last_became_active":"2024-09-22T08:36:29.997814+0000","last_became_peered":"2024-09-22T08:36:29.997814+0000","last_unstale":"2024-09-22T08:38:53.186450+0000","last_undegraded":"2024-09-22T08:38:53.186450+0000","last_fullsized":"2024-09-22T08:38:53.186450+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:38:57.806502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5807,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":27,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.226536+0000","last_change":"2024-09-22T08:36:32.012924+0000","last_active":"2024-09-22T08:37:04.226536+0000","last_peered":"2024-09-22T08:37:04.226536+0000","last_clean":"2024-09-22T08:37:04.226536+0000","last_became_active":"2024-09-22T08:36:32.012453+0000","last_became_peered":"2024-09-22T08:36:32.012453+0000","last_unstale":"2024-09-22T08:37:04.226536+0000","last_undegraded":"2024-09-22T08:37:04.226536+0000","last_fullsized":"2024-09-22T08:37:04.226536+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:07:18.464448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"32'3","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:29.962024+0000","last_change":"2024-09-22T08:36:34.022519+0000","last_active":"2024-09-22T08:38:29.962024+0000","last_peered":"2024-09-22T08:38:29.962024+0000","last_clean":"2024-09-22T08:38:29.962024+0000","last_became_active":"2024-09-22T08:36:34.022267+0000","last_became_peered":"2024-09-22T08:36:34.022267+0000","last_unstale":"2024-09-22T08:38:29.962024+0000","last_undegraded":"2024-09-22T08:38:29.962024+0000","last_fullsized":"2024-09-22T08:38:29.962024+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:48:06.628364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"32'6","reported_seq":82,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:05.120194+0000","last_change":"2024-09-22T08:36:25.986871+0000","last_active":"2024-09-22T08:37:05.120194+0000","last_peered":"2024-09-22T08:37:05.120194+0000","last_clean":"2024-09-22T08:37:05.120194+0000","last_became_active":"2024-09-22T08:36:25.986613+0000","last_became_peered":"2024-09-22T08:36:25.986613+0000","last_unstale":"2024-09-22T08:37:05.120194+0000","last_undegraded":"2024-09-22T08:37:05.120194+0000","last_fullsized":"2024-09-22T08:37:05.120194+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:34:39.892614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":60,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.225905+0000","last_change":"2024-09-22T08:36:23.978519+0000","last_active":"2024-09-22T08:37:04.225905+0000","last_peered":"2024-09-22T08:37:04.225905+0000","last_clean":"2024-09-22T08:37:04.225905+0000","last_became_active":"2024-09-22T08:36:23.978282+0000","last_became_peered":"2024-09-22T08:36:23.978282+0000","last_unstale":"2024-09-22T08:37:04.225905+0000","last_undegraded":"2024-09-22T08:37:04.225905+0000","last_fullsized":"2024-09-22T08:37:04.225905+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:27:04.674711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.230277+0000","last_change":"2024-09-22T08:36:27.986336+0000","last_active":"2024-09-22T08:37:04.230277+0000","last_peered":"2024-09-22T08:37:04.230277+0000","last_clean":"2024-09-22T08:37:04.230277+0000","last_became_active":"2024-09-22T08:36:27.986033+0000","last_became_peered":"2024-09-22T08:36:27.986033+0000","last_unstale":"2024-09-22T08:37:04.230277+0000","last_undegraded":"2024-09-22T08:37:04.230277+0000","last_fullsized":"2024-09-22T08:37:04.230277+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_clean_scrub_stamp":"2024-09-22T08:36:26.962226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:54:43.939868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"32'6","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:31.680000+0000","last_change":"2024-09-22T08:36:29.990307+0000","last_active":"2024-09-22T08:39:31.680000+0000","last_peered":"2024-09-22T08:39:31.680000+0000","last_clean":"2024-09-22T08:39:31.680000+0000","last_became_active":"2024-09-22T08:36:29.990057+0000","last_became_peered":"2024-09-22T08:36:29.990057+0000","last_unstale":"2024-09-22T08:39:31.680000+0000","last_undegraded":"2024-09-22T08:39:31.680000+0000","last_fullsized":"2024-09-22T08:39:31.680000+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:20:39.541039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.228183+0000","last_change":"2024-09-22T08:36:32.010964+0000","last_active":"2024-09-22T08:37:04.228183+0000","last_peered":"2024-09-22T08:37:04.228183+0000","last_clean":"2024-09-22T08:37:04.228183+0000","last_became_active":"2024-09-22T08:36:32.010692+0000","last_became_peered":"2024-09-22T08:36:32.010692+0000","last_unstale":"2024-09-22T08:37:04.228183+0000","last_undegraded":"2024-09-22T08:37:04.228183+0000","last_fullsized":"2024-09-22T08:37:04.228183+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:42:56.003470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"32'8","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:31.738292+0000","last_change":"2024-09-22T08:36:34.017610+0000","last_active":"2024-09-22T08:39:31.738292+0000","last_peered":"2024-09-22T08:39:31.738292+0000","last_clean":"2024-09-22T08:39:31.738292+0000","last_became_active":"2024-09-22T08:36:34.017181+0000","last_became_peered":"2024-09-22T08:36:34.017181+0000","last_unstale":"2024-09-22T08:39:31.738292+0000","last_undegraded":"2024-09-22T08:39:31.738292+0000","last_fullsized":"2024-09-22T08:39:31.738292+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:00:36.254978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":21,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"32'6","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.214871+0000","last_change":"2024-09-22T08:36:25.975177+0000","last_active":"2024-09-22T08:39:32.214871+0000","last_peered":"2024-09-22T08:39:32.214871+0000","last_clean":"2024-09-22T08:39:32.214871+0000","last_became_active":"2024-09-22T08:36:25.974797+0000","last_became_peered":"2024-09-22T08:36:25.974797+0000","last_unstale":"2024-09-22T08:39:32.214871+0000","last_undegraded":"2024-09-22T08:39:32.214871+0000","last_fullsized":"2024-09-22T08:39:32.214871+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:45:56.482158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.613051+0000","last_change":"2024-09-22T08:36:23.974236+0000","last_active":"2024-09-22T08:37:04.613051+0000","last_peered":"2024-09-22T08:37:04.613051+0000","last_clean":"2024-09-22T08:37:04.613051+0000","last_became_active":"2024-09-22T08:36:23.973601+0000","last_became_peered":"2024-09-22T08:36:23.973601+0000","last_unstale":"2024-09-22T08:37:04.613051+0000","last_undegraded":"2024-09-22T08:37:04.613051+0000","last_fullsized":"2024-09-22T08:37:04.613051+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:39:33.026572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.222812+0000","last_change":"2024-09-22T08:36:27.986446+0000","last_active":"2024-09-22T08:37:04.222812+0000","last_peered":"2024-09-22T08:37:04.222812+0000","last_clean":"2024-09-22T08:37:04.222812+0000","last_became_active":"2024-09-22T08:36:27.986100+0000","last_became_peered":"2024-09-22T08:36:27.986100+0000","last_unstale":"2024-09-22T08:37:04.222812+0000","last_undegraded":"2024-09-22T08:37:04.222812+0000","last_fullsized":"2024-09-22T08:37:04.222812+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_clean_scrub_stamp":"2024-09-22T08:36:26.962226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:23:06.708649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"32'40","reported_seq":100,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:31.718665+0000","last_change":"2024-09-22T08:36:29.992078+0000","last_active":"2024-09-22T08:39:31.718665+0000","last_peered":"2024-09-22T08:39:31.718665+0000","last_clean":"2024-09-22T08:39:31.718665+0000","last_became_active":"2024-09-22T08:36:29.991732+0000","last_became_peered":"2024-09-22T08:36:29.991732+0000","last_unstale":"2024-09-22T08:39:31.718665+0000","last_undegraded":"2024-09-22T08:39:31.718665+0000","last_fullsized":"2024-09-22T08:39:31.718665+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:54:46.326822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":61,"num_read_kb":64,"num_write":46,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.221450+0000","last_change":"2024-09-22T08:36:32.003244+0000","last_active":"2024-09-22T08:37:04.221450+0000","last_peered":"2024-09-22T08:37:04.221450+0000","last_clean":"2024-09-22T08:37:04.221450+0000","last_became_active":"2024-09-22T08:36:32.002970+0000","last_became_peered":"2024-09-22T08:36:32.002970+0000","last_unstale":"2024-09-22T08:37:04.221450+0000","last_undegraded":"2024-09-22T08:37:04.221450+0000","last_fullsized":"2024-09-22T08:37:04.221450+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:19:57.326474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"32'4","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.344891+0000","last_change":"2024-09-22T08:36:34.016939+0000","last_active":"2024-09-22T08:39:32.344891+0000","last_peered":"2024-09-22T08:39:32.344891+0000","last_clean":"2024-09-22T08:39:32.344891+0000","last_became_active":"2024-09-22T08:36:34.016379+0000","last_became_peered":"2024-09-22T08:36:34.016379+0000","last_unstale":"2024-09-22T08:39:32.344891+0000","last_undegraded":"2024-09-22T08:39:32.344891+0000","last_fullsized":"2024-09-22T08:39:32.344891+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:50:54.870215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":421,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"32'6","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:28.582884+0000","last_change":"2024-09-22T08:36:25.988849+0000","last_active":"2024-09-22T08:38:28.582884+0000","last_peered":"2024-09-22T08:38:28.582884+0000","last_clean":"2024-09-22T08:38:28.582884+0000","last_became_active":"2024-09-22T08:36:25.988569+0000","last_became_peered":"2024-09-22T08:36:25.988569+0000","last_unstale":"2024-09-22T08:38:28.582884+0000","last_undegraded":"2024-09-22T08:38:28.582884+0000","last_fullsized":"2024-09-22T08:38:28.582884+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:18:26.519986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.224287+0000","last_change":"2024-09-22T08:36:23.977609+0000","last_active":"2024-09-22T08:37:04.224287+0000","last_peered":"2024-09-22T08:37:04.224287+0000","last_clean":"2024-09-22T08:37:04.224287+0000","last_became_active":"2024-09-22T08:36:23.977355+0000","last_became_peered":"2024-09-22T08:36:23.977355+0000","last_unstale":"2024-09-22T08:37:04.224287+0000","last_undegraded":"2024-09-22T08:37:04.224287+0000","last_fullsized":"2024-09-22T08:37:04.224287+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:58:35.337314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"32'4","reported_seq":227,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:31.297357+0000","last_change":"2024-09-22T08:36:27.987952+0000","last_active":"2024-09-22T08:38:31.297357+0000","last_peered":"2024-09-22T08:38:31.297357+0000","last_clean":"2024-09-22T08:38:31.297357+0000","last_became_active":"2024-09-22T08:36:27.987561+0000","last_became_peered":"2024-09-22T08:36:27.987561+0000","last_unstale":"2024-09-22T08:38:31.297357+0000","last_undegraded":"2024-09-22T08:38:31.297357+0000","last_fullsized":"2024-09-22T08:38:31.297357+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_clean_scrub_stamp":"2024-09-22T08:36:26.962226+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:59:38.794944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":298,"num_read_kb":298,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"32'31","reported_seq":74,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:31.651146+0000","last_change":"2024-09-22T08:36:29.989156+0000","last_active":"2024-09-22T08:38:31.651146+0000","last_peered":"2024-09-22T08:38:31.651146+0000","last_clean":"2024-09-22T08:38:31.651146+0000","last_became_active":"2024-09-22T08:36:29.988607+0000","last_became_peered":"2024-09-22T08:36:29.988607+0000","last_unstale":"2024-09-22T08:38:31.651146+0000","last_undegraded":"2024-09-22T08:38:31.651146+0000","last_fullsized":"2024-09-22T08:38:31.651146+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:59:53.178494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.225600+0000","last_change":"2024-09-22T08:36:32.003908+0000","last_active":"2024-09-22T08:37:04.225600+0000","last_peered":"2024-09-22T08:37:04.225600+0000","last_clean":"2024-09-22T08:37:04.225600+0000","last_became_active":"2024-09-22T08:36:32.003651+0000","last_became_peered":"2024-09-22T08:36:32.003651+0000","last_unstale":"2024-09-22T08:37:04.225600+0000","last_undegraded":"2024-09-22T08:37:04.225600+0000","last_fullsized":"2024-09-22T08:37:04.225600+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:39:25.611419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"32'10","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.259871+0000","last_change":"2024-09-22T08:36:25.990717+0000","last_active":"2024-09-22T08:39:32.259871+0000","last_peered":"2024-09-22T08:39:32.259871+0000","last_clean":"2024-09-22T08:39:32.259871+0000","last_became_active":"2024-09-22T08:36:25.989711+0000","last_became_peered":"2024-09-22T08:36:25.989711+0000","last_unstale":"2024-09-22T08:39:32.259871+0000","last_undegraded":"2024-09-22T08:39:32.259871+0000","last_fullsized":"2024-09-22T08:39:32.259871+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:59:02.745529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.226013+0000","last_change":"2024-09-22T08:36:23.976596+0000","last_active":"2024-09-22T08:37:04.226013+0000","last_peered":"2024-09-22T08:37:04.226013+0000","last_clean":"2024-09-22T08:37:04.226013+0000","last_became_active":"2024-09-22T08:36:23.976361+0000","last_became_peered":"2024-09-22T08:36:23.976361+0000","last_unstale":"2024-09-22T08:37:04.226013+0000","last_undegraded":"2024-09-22T08:37:04.226013+0000","last_fullsized":"2024-09-22T08:37:04.226013+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:18:29.806715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.226375+0000","last_change":"2024-09-22T08:36:27.988289+0000","last_active":"2024-09-22T08:37:04.226375+0000","last_peered":"2024-09-22T08:37:04.226375+0000","last_clean":"2024-09-22T08:37:04.226375+0000","last_became_active":"2024-09-22T08:36:27.987981+0000","last_became_peered":"2024-09-22T08:36:27.987981+0000","last_unstale":"2024-09-22T08:37:04.226375+0000","last_undegraded":"2024-09-22T08:37:04.226375+0000","last_fullsized":"2024-09-22T08:37:04.226375+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_clean_scrub_stamp":"2024-09-22T08:36:26.962226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:43:32.535149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"32'55","reported_seq":112,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:03.181425+0000","last_change":"2024-09-22T08:36:29.990823+0000","last_active":"2024-09-22T08:39:03.181425+0000","last_peered":"2024-09-22T08:39:03.181425+0000","last_clean":"2024-09-22T08:39:03.181425+0000","last_became_active":"2024-09-22T08:36:29.990585+0000","last_became_peered":"2024-09-22T08:36:29.990585+0000","last_unstale":"2024-09-22T08:39:03.181425+0000","last_undegraded":"2024-09-22T08:39:03.181425+0000","last_fullsized":"2024-09-22T08:39:03.181425+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:09:56.176060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.226461+0000","last_change":"2024-09-22T08:36:32.007693+0000","last_active":"2024-09-22T08:37:04.226461+0000","last_peered":"2024-09-22T08:37:04.226461+0000","last_clean":"2024-09-22T08:37:04.226461+0000","last_became_active":"2024-09-22T08:36:32.007448+0000","last_became_peered":"2024-09-22T08:36:32.007448+0000","last_unstale":"2024-09-22T08:37:04.226461+0000","last_undegraded":"2024-09-22T08:37:04.226461+0000","last_fullsized":"2024-09-22T08:37:04.226461+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:30:19.529413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"32'16","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.263979+0000","last_change":"2024-09-22T08:36:34.017989+0000","last_active":"2024-09-22T08:39:32.263979+0000","last_peered":"2024-09-22T08:39:32.263979+0000","last_clean":"2024-09-22T08:39:32.263979+0000","last_became_active":"2024-09-22T08:36:34.017689+0000","last_became_peered":"2024-09-22T08:36:34.017689+0000","last_unstale":"2024-09-22T08:39:32.263979+0000","last_undegraded":"2024-09-22T08:39:32.263979+0000","last_fullsized":"2024-09-22T08:39:32.263979+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:59:28.875467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":21,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"32'2","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.260499+0000","last_change":"2024-09-22T08:36:25.978215+0000","last_active":"2024-09-22T08:39:32.260499+0000","last_peered":"2024-09-22T08:39:32.260499+0000","last_clean":"2024-09-22T08:39:32.260499+0000","last_became_active":"2024-09-22T08:36:25.977881+0000","last_became_peered":"2024-09-22T08:36:25.977881+0000","last_unstale":"2024-09-22T08:39:32.260499+0000","last_undegraded":"2024-09-22T08:39:32.260499+0000","last_fullsized":"2024-09-22T08:39:32.260499+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:49:05.012514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.221193+0000","last_change":"2024-09-22T08:36:23.975068+0000","last_active":"2024-09-22T08:37:04.221193+0000","last_peered":"2024-09-22T08:37:04.221193+0000","last_clean":"2024-09-22T08:37:04.221193+0000","last_became_active":"2024-09-22T08:36:23.974809+0000","last_became_peered":"2024-09-22T08:36:23.974809+0000","last_unstale":"2024-09-22T08:37:04.221193+0000","last_undegraded":"2024-09-22T08:37:04.221193+0000","last_fullsized":"2024-09-22T08:37:04.221193+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:07:03.805843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.228600+0000","last_change":"2024-09-22T08:36:27.987444+0000","last_active":"2024-09-22T08:37:04.228600+0000","last_peered":"2024-09-22T08:37:04.228600+0000","last_clean":"2024-09-22T08:37:04.228600+0000","last_became_active":"2024-09-22T08:36:27.986957+0000","last_became_peered":"2024-09-22T08:36:27.986957+0000","last_unstale":"2024-09-22T08:37:04.228600+0000","last_undegraded":"2024-09-22T08:37:04.228600+0000","last_fullsized":"2024-09-22T08:37:04.228600+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_clean_scrub_stamp":"2024-09-22T08:36:26.962226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:12:16.352882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"32'36","reported_seq":82,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:30.240401+0000","last_change":"2024-09-22T08:36:29.998426+0000","last_active":"2024-09-22T08:38:30.240401+0000","last_peered":"2024-09-22T08:38:30.240401+0000","last_clean":"2024-09-22T08:38:30.240401+0000","last_became_active":"2024-09-22T08:36:29.997527+0000","last_became_peered":"2024-09-22T08:36:29.997527+0000","last_unstale":"2024-09-22T08:38:30.240401+0000","last_undegraded":"2024-09-22T08:38:30.240401+0000","last_fullsized":"2024-09-22T08:38:30.240401+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:26:30.343603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.224280+0000","last_change":"2024-09-22T08:36:32.005672+0000","last_active":"2024-09-22T08:37:04.224280+0000","last_peered":"2024-09-22T08:37:04.224280+0000","last_clean":"2024-09-22T08:37:04.224280+0000","last_became_active":"2024-09-22T08:36:32.005383+0000","last_became_peered":"2024-09-22T08:36:32.005383+0000","last_unstale":"2024-09-22T08:37:04.224280+0000","last_undegraded":"2024-09-22T08:37:04.224280+0000","last_fullsized":"2024-09-22T08:37:04.224280+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:13:26.905617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.227134+0000","last_change":"2024-09-22T08:36:34.013499+0000","last_active":"2024-09-22T08:37:04.227134+0000","last_peered":"2024-09-22T08:37:04.227134+0000","last_clean":"2024-09-22T08:37:04.227134+0000","last_became_active":"2024-09-22T08:36:34.013204+0000","last_became_peered":"2024-09-22T08:36:34.013204+0000","last_unstale":"2024-09-22T08:37:04.227134+0000","last_undegraded":"2024-09-22T08:37:04.227134+0000","last_fullsized":"2024-09-22T08:37:04.227134+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:37:55.724456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"32'14","reported_seq":66,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.268386+0000","last_change":"2024-09-22T08:36:25.993915+0000","last_active":"2024-09-22T08:39:32.268386+0000","last_peered":"2024-09-22T08:39:32.268386+0000","last_clean":"2024-09-22T08:39:32.268386+0000","last_became_active":"2024-09-22T08:36:25.993170+0000","last_became_peered":"2024-09-22T08:36:25.993170+0000","last_unstale":"2024-09-22T08:39:32.268386+0000","last_undegraded":"2024-09-22T08:39:32.268386+0000","last_fullsized":"2024-09-22T08:39:32.268386+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:39:33.156873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":38,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.221803+0000","last_change":"2024-09-22T08:36:23.968477+0000","last_active":"2024-09-22T08:37:04.221803+0000","last_peered":"2024-09-22T08:37:04.221803+0000","last_clean":"2024-09-22T08:37:04.221803+0000","last_became_active":"2024-09-22T08:36:23.968207+0000","last_became_peered":"2024-09-22T08:36:23.968207+0000","last_unstale":"2024-09-22T08:37:04.221803+0000","last_undegraded":"2024-09-22T08:37:04.221803+0000","last_fullsized":"2024-09-22T08:37:04.221803+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:13:42.558254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.226357+0000","last_change":"2024-09-22T08:36:27.986023+0000","last_active":"2024-09-22T08:37:04.226357+0000","last_peered":"2024-09-22T08:37:04.226357+0000","last_clean":"2024-09-22T08:37:04.226357+0000","last_became_active":"2024-09-22T08:36:27.985679+0000","last_became_peered":"2024-09-22T08:36:27.985679+0000","last_unstale":"2024-09-22T08:37:04.226357+0000","last_undegraded":"2024-09-22T08:37:04.226357+0000","last_fullsized":"2024-09-22T08:37:04.226357+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_clean_scrub_stamp":"2024-09-22T08:36:26.962226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:14:11.716507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"32'32","reported_seq":76,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:30.258654+0000","last_change":"2024-09-22T08:36:29.994386+0000","last_active":"2024-09-22T08:38:30.258654+0000","last_peered":"2024-09-22T08:38:30.258654+0000","last_clean":"2024-09-22T08:38:30.258654+0000","last_became_active":"2024-09-22T08:36:29.994075+0000","last_became_peered":"2024-09-22T08:36:29.994075+0000","last_unstale":"2024-09-22T08:38:30.258654+0000","last_undegraded":"2024-09-22T08:38:30.258654+0000","last_fullsized":"2024-09-22T08:38:30.258654+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:01:51.899745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.225288+0000","last_change":"2024-09-22T08:36:32.005675+0000","last_active":"2024-09-22T08:37:04.225288+0000","last_peered":"2024-09-22T08:37:04.225288+0000","last_clean":"2024-09-22T08:37:04.225288+0000","last_became_active":"2024-09-22T08:36:32.005166+0000","last_became_peered":"2024-09-22T08:36:32.005166+0000","last_unstale":"2024-09-22T08:37:04.225288+0000","last_undegraded":"2024-09-22T08:37:04.225288+0000","last_fullsized":"2024-09-22T08:37:04.225288+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:04:54.919867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"32'7","reported_seq":25,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.093378+0000","last_change":"2024-09-22T08:36:34.014540+0000","last_active":"2024-09-22T08:39:32.093378+0000","last_peered":"2024-09-22T08:39:32.093378+0000","last_clean":"2024-09-22T08:39:32.093378+0000","last_became_active":"2024-09-22T08:36:34.014255+0000","last_became_peered":"2024-09-22T08:36:34.014255+0000","last_unstale":"2024-09-22T08:39:32.093378+0000","last_undegraded":"2024-09-22T08:39:32.093378+0000","last_fullsized":"2024-09-22T08:39:32.093378+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:47:25.081359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"32'4","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.078924+0000","last_change":"2024-09-22T08:36:25.978994+0000","last_active":"2024-09-22T08:39:32.078924+0000","last_peered":"2024-09-22T08:39:32.078924+0000","last_clean":"2024-09-22T08:39:32.078924+0000","last_became_active":"2024-09-22T08:36:25.978577+0000","last_became_peered":"2024-09-22T08:36:25.978577+0000","last_unstale":"2024-09-22T08:39:32.078924+0000","last_undegraded":"2024-09-22T08:39:32.078924+0000","last_fullsized":"2024-09-22T08:39:32.078924+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:02:49.260377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"32'2","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:08.164913+0000","last_change":"2024-09-22T08:37:04.226650+0000","last_active":"2024-09-22T08:37:08.164913+0000","last_peered":"2024-09-22T08:37:08.164913+0000","last_clean":"2024-09-22T08:37:08.164913+0000","last_became_active":"2024-09-22T08:37:04.226169+0000","last_became_peered":"2024-09-22T08:37:04.226169+0000","last_unstale":"2024-09-22T08:37:08.164913+0000","last_undegraded":"2024-09-22T08:37:08.164913+0000","last_fullsized":"2024-09-22T08:37:08.164913+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:34:07.480067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.223988+0000","last_change":"2024-09-22T08:36:27.990314+0000","last_active":"2024-09-22T08:37:04.223988+0000","last_peered":"2024-09-22T08:37:04.223988+0000","last_clean":"2024-09-22T08:37:04.223988+0000","last_became_active":"2024-09-22T08:36:27.990038+0000","last_became_peered":"2024-09-22T08:36:27.990038+0000","last_unstale":"2024-09-22T08:37:04.223988+0000","last_undegraded":"2024-09-22T08:37:04.223988+0000","last_fullsized":"2024-09-22T08:37:04.223988+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_clean_scrub_stamp":"2024-09-22T08:36:26.962226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:42:33.084977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"30'10","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.227216+0000","last_change":"2024-09-22T08:36:29.997480+0000","last_active":"2024-09-22T08:37:04.227216+0000","last_peered":"2024-09-22T08:37:04.227216+0000","last_clean":"2024-09-22T08:37:04.227216+0000","last_became_active":"2024-09-22T08:36:29.997179+0000","last_became_peered":"2024-09-22T08:36:29.997179+0000","last_unstale":"2024-09-22T08:37:04.227216+0000","last_undegraded":"2024-09-22T08:37:04.227216+0000","last_fullsized":"2024-09-22T08:37:04.227216+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:42:36.332989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"32'282","reported_seq":366,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:28.067529+0000","last_change":"2024-09-22T08:36:32.012171+0000","last_active":"2024-09-22T08:39:28.067529+0000","last_peered":"2024-09-22T08:39:28.067529+0000","last_clean":"2024-09-22T08:39:28.067529+0000","last_became_active":"2024-09-22T08:36:32.011870+0000","last_became_peered":"2024-09-22T08:36:32.011870+0000","last_unstale":"2024-09-22T08:39:28.067529+0000","last_undegraded":"2024-09-22T08:39:28.067529+0000","last_fullsized":"2024-09-22T08:39:28.067529+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:20:17.853772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"32'2","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.248674+0000","last_change":"2024-09-22T08:36:34.013756+0000","last_active":"2024-09-22T08:39:32.248674+0000","last_peered":"2024-09-22T08:39:32.248674+0000","last_clean":"2024-09-22T08:39:32.248674+0000","last_became_active":"2024-09-22T08:36:34.013380+0000","last_became_peered":"2024-09-22T08:36:34.013380+0000","last_unstale":"2024-09-22T08:39:32.248674+0000","last_undegraded":"2024-09-22T08:39:32.248674+0000","last_fullsized":"2024-09-22T08:39:32.248674+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:26:36.228816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"32'8","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:31.647867+0000","last_change":"2024-09-22T08:36:25.971626+0000","last_active":"2024-09-22T08:38:31.647867+0000","last_peered":"2024-09-22T08:38:31.647867+0000","last_clean":"2024-09-22T08:38:31.647867+0000","last_became_active":"2024-09-22T08:36:25.971327+0000","last_became_peered":"2024-09-22T08:36:25.971327+0000","last_unstale":"2024-09-22T08:38:31.647867+0000","last_undegraded":"2024-09-22T08:38:31.647867+0000","last_fullsized":"2024-09-22T08:38:31.647867+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:06:32.443392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.284576+0000","last_change":"2024-09-22T08:36:23.978262+0000","last_active":"2024-09-22T08:39:32.284576+0000","last_peered":"2024-09-22T08:39:32.284576+0000","last_clean":"2024-09-22T08:39:32.284576+0000","last_became_active":"2024-09-22T08:36:23.978006+0000","last_became_peered":"2024-09-22T08:36:23.978006+0000","last_unstale":"2024-09-22T08:39:32.284576+0000","last_undegraded":"2024-09-22T08:39:32.284576+0000","last_fullsized":"2024-09-22T08:39:32.284576+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:02:28.926834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.222677+0000","last_change":"2024-09-22T08:36:27.991045+0000","last_active":"2024-09-22T08:37:04.222677+0000","last_peered":"2024-09-22T08:37:04.222677+0000","last_clean":"2024-09-22T08:37:04.222677+0000","last_became_active":"2024-09-22T08:36:27.990729+0000","last_became_peered":"2024-09-22T08:36:27.990729+0000","last_unstale":"2024-09-22T08:37:04.222677+0000","last_undegraded":"2024-09-22T08:37:04.222677+0000","last_fullsized":"2024-09-22T08:37:04.222677+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_clean_scrub_stamp":"2024-09-22T08:36:26.962226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:27:20.880200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"32'36","reported_seq":82,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:30.230410+0000","last_change":"2024-09-22T08:36:29.987777+0000","last_active":"2024-09-22T08:38:30.230410+0000","last_peered":"2024-09-22T08:38:30.230410+0000","last_clean":"2024-09-22T08:38:30.230410+0000","last_became_active":"2024-09-22T08:36:29.987459+0000","last_became_peered":"2024-09-22T08:36:29.987459+0000","last_unstale":"2024-09-22T08:38:30.230410+0000","last_undegraded":"2024-09-22T08:38:30.230410+0000","last_fullsized":"2024-09-22T08:38:30.230410+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:30:17.280632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.222754+0000","last_change":"2024-09-22T08:36:32.003472+0000","last_active":"2024-09-22T08:37:04.222754+0000","last_peered":"2024-09-22T08:37:04.222754+0000","last_clean":"2024-09-22T08:37:04.222754+0000","last_became_active":"2024-09-22T08:36:32.003196+0000","last_became_peered":"2024-09-22T08:36:32.003196+0000","last_unstale":"2024-09-22T08:37:04.222754+0000","last_undegraded":"2024-09-22T08:37:04.222754+0000","last_fullsized":"2024-09-22T08:37:04.222754+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:42:54.487167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.223793+0000","last_change":"2024-09-22T08:36:34.016292+0000","last_active":"2024-09-22T08:37:04.223793+0000","last_peered":"2024-09-22T08:37:04.223793+0000","last_clean":"2024-09-22T08:37:04.223793+0000","last_became_active":"2024-09-22T08:36:34.015988+0000","last_became_peered":"2024-09-22T08:36:34.015988+0000","last_unstale":"2024-09-22T08:37:04.223793+0000","last_undegraded":"2024-09-22T08:37:04.223793+0000","last_fullsized":"2024-09-22T08:37:04.223793+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:16:42.030515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"32'4","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:31.648006+0000","last_change":"2024-09-22T08:36:25.972487+0000","last_active":"2024-09-22T08:38:31.648006+0000","last_peered":"2024-09-22T08:38:31.648006+0000","last_clean":"2024-09-22T08:38:31.648006+0000","last_became_active":"2024-09-22T08:36:25.972149+0000","last_became_peered":"2024-09-22T08:36:25.972149+0000","last_unstale":"2024-09-22T08:38:31.648006+0000","last_undegraded":"2024-09-22T08:38:31.648006+0000","last_fullsized":"2024-09-22T08:38:31.648006+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:06:31.006207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"32'1","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:58.187460+0000","last_change":"2024-09-22T08:36:23.983004+0000","last_active":"2024-09-22T08:38:58.187460+0000","last_peered":"2024-09-22T08:38:58.187460+0000","last_clean":"2024-09-22T08:38:58.187460+0000","last_became_active":"2024-09-22T08:36:23.982545+0000","last_became_peered":"2024-09-22T08:36:23.982545+0000","last_unstale":"2024-09-22T08:38:58.187460+0000","last_undegraded":"2024-09-22T08:38:58.187460+0000","last_fullsized":"2024-09-22T08:38:58.187460+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:02:24.513946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.225495+0000","last_change":"2024-09-22T08:36:27.989826+0000","last_active":"2024-09-22T08:37:04.225495+0000","last_peered":"2024-09-22T08:37:04.225495+0000","last_clean":"2024-09-22T08:37:04.225495+0000","last_became_active":"2024-09-22T08:36:27.989495+0000","last_became_peered":"2024-09-22T08:36:27.989495+0000","last_unstale":"2024-09-22T08:37:04.225495+0000","last_undegraded":"2024-09-22T08:37:04.225495+0000","last_fullsized":"2024-09-22T08:37:04.225495+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_clean_scrub_stamp":"2024-09-22T08:36:26.962226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:36:51.183212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"32'30","reported_seq":73,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:30.231982+0000","last_change":"2024-09-22T08:36:29.994337+0000","last_active":"2024-09-22T08:38:30.231982+0000","last_peered":"2024-09-22T08:38:30.231982+0000","last_clean":"2024-09-22T08:38:30.231982+0000","last_became_active":"2024-09-22T08:36:29.994101+0000","last_became_peered":"2024-09-22T08:36:29.994101+0000","last_unstale":"2024-09-22T08:38:30.231982+0000","last_undegraded":"2024-09-22T08:38:30.231982+0000","last_fullsized":"2024-09-22T08:38:30.231982+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:40:06.073383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.230375+0000","last_change":"2024-09-22T08:36:32.012960+0000","last_active":"2024-09-22T08:37:04.230375+0000","last_peered":"2024-09-22T08:37:04.230375+0000","last_clean":"2024-09-22T08:37:04.230375+0000","last_became_active":"2024-09-22T08:36:32.011811+0000","last_became_peered":"2024-09-22T08:36:32.011811+0000","last_unstale":"2024-09-22T08:37:04.230375+0000","last_undegraded":"2024-09-22T08:37:04.230375+0000","last_fullsized":"2024-09-22T08:37:04.230375+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:13:22.789596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"32'2","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:05.456749+0000","last_change":"2024-09-22T08:36:34.020146+0000","last_active":"2024-09-22T08:37:05.456749+0000","last_peered":"2024-09-22T08:37:05.456749+0000","last_clean":"2024-09-22T08:37:05.456749+0000","last_became_active":"2024-09-22T08:36:34.019866+0000","last_became_peered":"2024-09-22T08:36:34.019866+0000","last_unstale":"2024-09-22T08:37:05.456749+0000","last_undegraded":"2024-09-22T08:37:05.456749+0000","last_fullsized":"2024-09-22T08:37:05.456749+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:56:15.623151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:31.647295+0000","last_change":"2024-09-22T08:36:25.989899+0000","last_active":"2024-09-22T08:38:31.647295+0000","last_peered":"2024-09-22T08:38:31.647295+0000","last_clean":"2024-09-22T08:38:31.647295+0000","last_became_active":"2024-09-22T08:36:25.989572+0000","last_became_peered":"2024-09-22T08:36:25.989572+0000","last_unstale":"2024-09-22T08:38:31.647295+0000","last_undegraded":"2024-09-22T08:38:31.647295+0000","last_fullsized":"2024-09-22T08:38:31.647295+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:11:07.278941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.225893+0000","last_change":"2024-09-22T08:36:23.971403+0000","last_active":"2024-09-22T08:37:04.225893+0000","last_peered":"2024-09-22T08:37:04.225893+0000","last_clean":"2024-09-22T08:37:04.225893+0000","last_became_active":"2024-09-22T08:36:23.971012+0000","last_became_peered":"2024-09-22T08:36:23.971012+0000","last_unstale":"2024-09-22T08:37:04.225893+0000","last_undegraded":"2024-09-22T08:37:04.225893+0000","last_fullsized":"2024-09-22T08:37:04.225893+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:38:20.349572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.222066+0000","last_change":"2024-09-22T08:36:27.987755+0000","last_active":"2024-09-22T08:37:04.222066+0000","last_peered":"2024-09-22T08:37:04.222066+0000","last_clean":"2024-09-22T08:37:04.222066+0000","last_became_active":"2024-09-22T08:36:27.987504+0000","last_became_peered":"2024-09-22T08:36:27.987504+0000","last_unstale":"2024-09-22T08:37:04.222066+0000","last_undegraded":"2024-09-22T08:37:04.222066+0000","last_fullsized":"2024-09-22T08:37:04.222066+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_clean_scrub_stamp":"2024-09-22T08:36:26.962226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:39:03.985092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"32'26","reported_seq":67,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:30.256486+0000","last_change":"2024-09-22T08:36:29.998167+0000","last_active":"2024-09-22T08:38:30.256486+0000","last_peered":"2024-09-22T08:38:30.256486+0000","last_clean":"2024-09-22T08:38:30.256486+0000","last_became_active":"2024-09-22T08:36:29.997853+0000","last_became_peered":"2024-09-22T08:36:29.997853+0000","last_unstale":"2024-09-22T08:38:30.256486+0000","last_undegraded":"2024-09-22T08:38:30.256486+0000","last_fullsized":"2024-09-22T08:38:30.256486+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:34:13.019632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":23,"num_read_kb":19,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.227451+0000","last_change":"2024-09-22T08:36:32.012262+0000","last_active":"2024-09-22T08:37:04.227451+0000","last_peered":"2024-09-22T08:37:04.227451+0000","last_clean":"2024-09-22T08:37:04.227451+0000","last_became_active":"2024-09-22T08:36:32.011960+0000","last_became_peered":"2024-09-22T08:36:32.011960+0000","last_unstale":"2024-09-22T08:37:04.227451+0000","last_undegraded":"2024-09-22T08:37:04.227451+0000","last_fullsized":"2024-09-22T08:37:04.227451+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:58:25.357801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"32'16","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:30.267408+0000","last_change":"2024-09-22T08:36:34.018605+0000","last_active":"2024-09-22T08:38:30.267408+0000","last_peered":"2024-09-22T08:38:30.267408+0000","last_clean":"2024-09-22T08:38:30.267408+0000","last_became_active":"2024-09-22T08:36:34.018365+0000","last_became_peered":"2024-09-22T08:36:34.018365+0000","last_unstale":"2024-09-22T08:38:30.267408+0000","last_undegraded":"2024-09-22T08:38:30.267408+0000","last_fullsized":"2024-09-22T08:38:30.267408+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:01:49.722849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":96,"num_read_kb":76,"num_write":46,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"32'8","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.081475+0000","last_change":"2024-09-22T08:36:25.973362+0000","last_active":"2024-09-22T08:39:32.081475+0000","last_peered":"2024-09-22T08:39:32.081475+0000","last_clean":"2024-09-22T08:39:32.081475+0000","last_became_active":"2024-09-22T08:36:25.973089+0000","last_became_peered":"2024-09-22T08:36:25.973089+0000","last_unstale":"2024-09-22T08:39:32.081475+0000","last_undegraded":"2024-09-22T08:39:32.081475+0000","last_fullsized":"2024-09-22T08:39:32.081475+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:11:06.136833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.612779+0000","last_change":"2024-09-22T08:36:23.968591+0000","last_active":"2024-09-22T08:37:04.612779+0000","last_peered":"2024-09-22T08:37:04.612779+0000","last_clean":"2024-09-22T08:37:04.612779+0000","last_became_active":"2024-09-22T08:36:23.968249+0000","last_became_peered":"2024-09-22T08:36:23.968249+0000","last_unstale":"2024-09-22T08:37:04.612779+0000","last_undegraded":"2024-09-22T08:37:04.612779+0000","last_fullsized":"2024-09-22T08:37:04.612779+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:00:39.104995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"32'2","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:28.952357+0000","last_change":"2024-09-22T08:36:27.988537+0000","last_active":"2024-09-22T08:38:28.952357+0000","last_peered":"2024-09-22T08:38:28.952357+0000","last_clean":"2024-09-22T08:38:28.952357+0000","last_became_active":"2024-09-22T08:36:27.988262+0000","last_became_peered":"2024-09-22T08:36:27.988262+0000","last_unstale":"2024-09-22T08:38:28.952357+0000","last_undegraded":"2024-09-22T08:38:28.952357+0000","last_fullsized":"2024-09-22T08:38:28.952357+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_clean_scrub_stamp":"2024-09-22T08:36:26.962226+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:27:56.322995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"32'32","reported_seq":77,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:31.665631+0000","last_change":"2024-09-22T08:36:29.997925+0000","last_active":"2024-09-22T08:39:31.665631+0000","last_peered":"2024-09-22T08:39:31.665631+0000","last_clean":"2024-09-22T08:39:31.665631+0000","last_became_active":"2024-09-22T08:36:29.997231+0000","last_became_peered":"2024-09-22T08:36:29.997231+0000","last_unstale":"2024-09-22T08:39:31.665631+0000","last_undegraded":"2024-09-22T08:39:31.665631+0000","last_fullsized":"2024-09-22T08:39:31.665631+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:37:27.208598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.224156+0000","last_change":"2024-09-22T08:36:32.004965+0000","last_active":"2024-09-22T08:37:04.224156+0000","last_peered":"2024-09-22T08:37:04.224156+0000","last_clean":"2024-09-22T08:37:04.224156+0000","last_became_active":"2024-09-22T08:36:32.004365+0000","last_became_peered":"2024-09-22T08:36:32.004365+0000","last_unstale":"2024-09-22T08:37:04.224156+0000","last_undegraded":"2024-09-22T08:37:04.224156+0000","last_fullsized":"2024-09-22T08:37:04.224156+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:02:38.800242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"32'4","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:30.270088+0000","last_change":"2024-09-22T08:36:34.016625+0000","last_active":"2024-09-22T08:38:30.270088+0000","last_peered":"2024-09-22T08:38:30.270088+0000","last_clean":"2024-09-22T08:38:30.270088+0000","last_became_active":"2024-09-22T08:36:34.016106+0000","last_became_peered":"2024-09-22T08:36:34.016106+0000","last_unstale":"2024-09-22T08:38:30.270088+0000","last_undegraded":"2024-09-22T08:38:30.270088+0000","last_fullsized":"2024-09-22T08:38:30.270088+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:10:10.424019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"32'12","reported_seq":70,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.290031+0000","last_change":"2024-09-22T08:36:25.987436+0000","last_active":"2024-09-22T08:39:32.290031+0000","last_peered":"2024-09-22T08:39:32.290031+0000","last_clean":"2024-09-22T08:39:32.290031+0000","last_became_active":"2024-09-22T08:36:25.987161+0000","last_became_peered":"2024-09-22T08:36:25.987161+0000","last_unstale":"2024-09-22T08:39:32.290031+0000","last_undegraded":"2024-09-22T08:39:32.290031+0000","last_fullsized":"2024-09-22T08:39:32.290031+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:12:14.347452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.223210+0000","last_change":"2024-09-22T08:36:23.970780+0000","last_active":"2024-09-22T08:37:04.223210+0000","last_peered":"2024-09-22T08:37:04.223210+0000","last_clean":"2024-09-22T08:37:04.223210+0000","last_became_active":"2024-09-22T08:36:23.969515+0000","last_became_peered":"2024-09-22T08:36:23.969515+0000","last_unstale":"2024-09-22T08:37:04.223210+0000","last_undegraded":"2024-09-22T08:37:04.223210+0000","last_fullsized":"2024-09-22T08:37:04.223210+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:26:49.921857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"32'12","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:47.943562+0000","last_change":"2024-09-22T08:36:25.979243+0000","last_active":"2024-09-22T08:37:47.943562+0000","last_peered":"2024-09-22T08:37:47.943562+0000","last_clean":"2024-09-22T08:37:47.943562+0000","last_became_active":"2024-09-22T08:36:25.978679+0000","last_became_peered":"2024-09-22T08:36:25.978679+0000","last_unstale":"2024-09-22T08:37:47.943562+0000","last_undegraded":"2024-09-22T08:37:47.943562+0000","last_fullsized":"2024-09-22T08:37:47.943562+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:02:33.743436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.612648+0000","last_change":"2024-09-22T08:36:23.970625+0000","last_active":"2024-09-22T08:37:04.612648+0000","last_peered":"2024-09-22T08:37:04.612648+0000","last_clean":"2024-09-22T08:37:04.612648+0000","last_became_active":"2024-09-22T08:36:23.970218+0000","last_became_peered":"2024-09-22T08:36:23.970218+0000","last_unstale":"2024-09-22T08:37:04.612648+0000","last_undegraded":"2024-09-22T08:37:04.612648+0000","last_fullsized":"2024-09-22T08:37:04.612648+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:19:30.438078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"32'12","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.079200+0000","last_change":"2024-09-22T08:36:25.991808+0000","last_active":"2024-09-22T08:39:32.079200+0000","last_peered":"2024-09-22T08:39:32.079200+0000","last_clean":"2024-09-22T08:39:32.079200+0000","last_became_active":"2024-09-22T08:36:25.989638+0000","last_became_peered":"2024-09-22T08:36:25.989638+0000","last_unstale":"2024-09-22T08:39:32.079200+0000","last_undegraded":"2024-09-22T08:39:32.079200+0000","last_fullsized":"2024-09-22T08:39:32.079200+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:50:01.017587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":33,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.228337+0000","last_change":"2024-09-22T08:36:23.973468+0000","last_active":"2024-09-22T08:37:04.228337+0000","last_peered":"2024-09-22T08:37:04.228337+0000","last_clean":"2024-09-22T08:37:04.228337+0000","last_became_active":"2024-09-22T08:36:23.972582+0000","last_became_peered":"2024-09-22T08:36:23.972582+0000","last_unstale":"2024-09-22T08:37:04.228337+0000","last_undegraded":"2024-09-22T08:37:04.228337+0000","last_fullsized":"2024-09-22T08:37:04.228337+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:49:03.488783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.224675+0000","last_change":"2024-09-22T08:36:25.978968+0000","last_active":"2024-09-22T08:37:04.224675+0000","last_peered":"2024-09-22T08:37:04.224675+0000","last_clean":"2024-09-22T08:37:04.224675+0000","last_became_active":"2024-09-22T08:36:25.978538+0000","last_became_peered":"2024-09-22T08:36:25.978538+0000","last_unstale":"2024-09-22T08:37:04.224675+0000","last_undegraded":"2024-09-22T08:37:04.224675+0000","last_fullsized":"2024-09-22T08:37:04.224675+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:36:39.596571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.224450+0000","last_change":"2024-09-22T08:36:23.974287+0000","last_active":"2024-09-22T08:37:04.224450+0000","last_peered":"2024-09-22T08:37:04.224450+0000","last_clean":"2024-09-22T08:37:04.224450+0000","last_became_active":"2024-09-22T08:36:23.973945+0000","last_became_peered":"2024-09-22T08:36:23.973945+0000","last_unstale":"2024-09-22T08:37:04.224450+0000","last_undegraded":"2024-09-22T08:37:04.224450+0000","last_fullsized":"2024-09-22T08:37:04.224450+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:15:18.572430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:47.943513+0000","last_change":"2024-09-22T08:36:25.984379+0000","last_active":"2024-09-22T08:37:47.943513+0000","last_peered":"2024-09-22T08:37:47.943513+0000","last_clean":"2024-09-22T08:37:47.943513+0000","last_became_active":"2024-09-22T08:36:25.984094+0000","last_became_peered":"2024-09-22T08:36:25.984094+0000","last_unstale":"2024-09-22T08:37:47.943513+0000","last_undegraded":"2024-09-22T08:37:47.943513+0000","last_fullsized":"2024-09-22T08:37:47.943513+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:55:15.332178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.614002+0000","last_change":"2024-09-22T08:36:23.971443+0000","last_active":"2024-09-22T08:37:04.614002+0000","last_peered":"2024-09-22T08:37:04.614002+0000","last_clean":"2024-09-22T08:37:04.614002+0000","last_became_active":"2024-09-22T08:36:23.970920+0000","last_became_peered":"2024-09-22T08:36:23.970920+0000","last_unstale":"2024-09-22T08:37:04.614002+0000","last_undegraded":"2024-09-22T08:37:04.614002+0000","last_fullsized":"2024-09-22T08:37:04.614002+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:03:35.613648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"32'11","reported_seq":68,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.221583+0000","last_change":"2024-09-22T08:36:25.986221+0000","last_active":"2024-09-22T08:39:32.221583+0000","last_peered":"2024-09-22T08:39:32.221583+0000","last_clean":"2024-09-22T08:39:32.221583+0000","last_became_active":"2024-09-22T08:36:25.985965+0000","last_became_peered":"2024-09-22T08:36:25.985965+0000","last_unstale":"2024-09-22T08:39:32.221583+0000","last_undegraded":"2024-09-22T08:39:32.221583+0000","last_fullsized":"2024-09-22T08:39:32.221583+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:14:09.711077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":11,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.223827+0000","last_change":"2024-09-22T08:36:23.983975+0000","last_active":"2024-09-22T08:37:04.223827+0000","last_peered":"2024-09-22T08:37:04.223827+0000","last_clean":"2024-09-22T08:37:04.223827+0000","last_became_active":"2024-09-22T08:36:23.983722+0000","last_became_peered":"2024-09-22T08:36:23.983722+0000","last_unstale":"2024-09-22T08:37:04.223827+0000","last_undegraded":"2024-09-22T08:37:04.223827+0000","last_fullsized":"2024-09-22T08:37:04.223827+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:06:35.921272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"32'4","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.259710+0000","last_change":"2024-09-22T08:36:25.983403+0000","last_active":"2024-09-22T08:39:32.259710+0000","last_peered":"2024-09-22T08:39:32.259710+0000","last_clean":"2024-09-22T08:39:32.259710+0000","last_became_active":"2024-09-22T08:36:25.983061+0000","last_became_peered":"2024-09-22T08:36:25.983061+0000","last_unstale":"2024-09-22T08:39:32.259710+0000","last_undegraded":"2024-09-22T08:39:32.259710+0000","last_fullsized":"2024-09-22T08:39:32.259710+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:36:23.489851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.229632+0000","last_change":"2024-09-22T08:36:23.974503+0000","last_active":"2024-09-22T08:37:04.229632+0000","last_peered":"2024-09-22T08:37:04.229632+0000","last_clean":"2024-09-22T08:37:04.229632+0000","last_became_active":"2024-09-22T08:36:23.973924+0000","last_became_peered":"2024-09-22T08:36:23.973924+0000","last_unstale":"2024-09-22T08:37:04.229632+0000","last_undegraded":"2024-09-22T08:37:04.229632+0000","last_fullsized":"2024-09-22T08:37:04.229632+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:29:02.171378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"32'18","reported_seq":79,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.259032+0000","last_change":"2024-09-22T08:36:25.979450+0000","last_active":"2024-09-22T08:39:32.259032+0000","last_peered":"2024-09-22T08:39:32.259032+0000","last_clean":"2024-09-22T08:39:32.259032+0000","last_became_active":"2024-09-22T08:36:25.979151+0000","last_became_peered":"2024-09-22T08:36:25.979151+0000","last_unstale":"2024-09-22T08:39:32.259032+0000","last_undegraded":"2024-09-22T08:39:32.259032+0000","last_fullsized":"2024-09-22T08:39:32.259032+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:36:49.177782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":64,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.225651+0000","last_change":"2024-09-22T08:36:23.970979+0000","last_active":"2024-09-22T08:37:04.225651+0000","last_peered":"2024-09-22T08:37:04.225651+0000","last_clean":"2024-09-22T08:37:04.225651+0000","last_became_active":"2024-09-22T08:36:23.970584+0000","last_became_peered":"2024-09-22T08:36:23.970584+0000","last_unstale":"2024-09-22T08:37:04.225651+0000","last_undegraded":"2024-09-22T08:37:04.225651+0000","last_fullsized":"2024-09-22T08:37:04.225651+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:36:27.840945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"32'16","reported_seq":89,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.081622+0000","last_change":"2024-09-22T08:36:25.979007+0000","last_active":"2024-09-22T08:39:32.081622+0000","last_peered":"2024-09-22T08:39:32.081622+0000","last_clean":"2024-09-22T08:39:32.081622+0000","last_became_active":"2024-09-22T08:36:25.978730+0000","last_became_peered":"2024-09-22T08:36:25.978730+0000","last_unstale":"2024-09-22T08:39:32.081622+0000","last_undegraded":"2024-09-22T08:39:32.081622+0000","last_fullsized":"2024-09-22T08:39:32.081622+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:17:07.393345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":70,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:31.490293+0000","last_change":"2024-09-22T08:36:23.973434+0000","last_active":"2024-09-22T08:38:31.490293+0000","last_peered":"2024-09-22T08:38:31.490293+0000","last_clean":"2024-09-22T08:38:31.490293+0000","last_became_active":"2024-09-22T08:36:23.973175+0000","last_became_peered":"2024-09-22T08:36:23.973175+0000","last_unstale":"2024-09-22T08:38:31.490293+0000","last_undegraded":"2024-09-22T08:38:31.490293+0000","last_fullsized":"2024-09-22T08:38:31.490293+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:49:52.164007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"32'6","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.289546+0000","last_change":"2024-09-22T08:36:25.991941+0000","last_active":"2024-09-22T08:39:32.289546+0000","last_peered":"2024-09-22T08:39:32.289546+0000","last_clean":"2024-09-22T08:39:32.289546+0000","last_became_active":"2024-09-22T08:36:25.991611+0000","last_became_peered":"2024-09-22T08:36:25.991611+0000","last_unstale":"2024-09-22T08:39:32.289546+0000","last_undegraded":"2024-09-22T08:39:32.289546+0000","last_fullsized":"2024-09-22T08:39:32.289546+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:09:42.836164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"32'6","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.202264+0000","last_change":"2024-09-22T08:36:23.974290+0000","last_active":"2024-09-22T08:39:32.202264+0000","last_peered":"2024-09-22T08:39:32.202264+0000","last_clean":"2024-09-22T08:39:32.202264+0000","last_became_active":"2024-09-22T08:36:23.973721+0000","last_became_peered":"2024-09-22T08:36:23.973721+0000","last_unstale":"2024-09-22T08:39:32.202264+0000","last_undegraded":"2024-09-22T08:39:32.202264+0000","last_fullsized":"2024-09-22T08:39:32.202264+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:03:35.497917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4,"num_write":22,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"32'8","reported_seq":69,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:05.720316+0000","last_change":"2024-09-22T08:37:04.234401+0000","last_active":"2024-09-22T08:37:05.720316+0000","last_peered":"2024-09-22T08:37:05.720316+0000","last_clean":"2024-09-22T08:37:05.720316+0000","last_became_active":"2024-09-22T08:37:04.231342+0000","last_became_peered":"2024-09-22T08:37:04.231342+0000","last_unstale":"2024-09-22T08:37:05.720316+0000","last_undegraded":"2024-09-22T08:37:05.720316+0000","last_fullsized":"2024-09-22T08:37:05.720316+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:00:32.641067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.221634+0000","last_change":"2024-09-22T08:36:23.975576+0000","last_active":"2024-09-22T08:37:04.221634+0000","last_peered":"2024-09-22T08:37:04.221634+0000","last_clean":"2024-09-22T08:37:04.221634+0000","last_became_active":"2024-09-22T08:36:23.975352+0000","last_became_peered":"2024-09-22T08:36:23.975352+0000","last_unstale":"2024-09-22T08:37:04.221634+0000","last_undegraded":"2024-09-22T08:37:04.221634+0000","last_fullsized":"2024-09-22T08:37:04.221634+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:46:26.551014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.223362+0000","last_change":"2024-09-22T08:36:25.978610+0000","last_active":"2024-09-22T08:37:04.223362+0000","last_peered":"2024-09-22T08:37:04.223362+0000","last_clean":"2024-09-22T08:37:04.223362+0000","last_became_active":"2024-09-22T08:36:25.977732+0000","last_became_peered":"2024-09-22T08:36:25.977732+0000","last_unstale":"2024-09-22T08:37:04.223362+0000","last_undegraded":"2024-09-22T08:37:04.223362+0000","last_fullsized":"2024-09-22T08:37:04.223362+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:38:39.281465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.222399+0000","last_change":"2024-09-22T08:36:23.976230+0000","last_active":"2024-09-22T08:37:04.222399+0000","last_peered":"2024-09-22T08:37:04.222399+0000","last_clean":"2024-09-22T08:37:04.222399+0000","last_became_active":"2024-09-22T08:36:23.975986+0000","last_became_peered":"2024-09-22T08:36:23.975986+0000","last_unstale":"2024-09-22T08:37:04.222399+0000","last_undegraded":"2024-09-22T08:37:04.222399+0000","last_fullsized":"2024-09-22T08:37:04.222399+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:51:18.438115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"32'9","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.299156+0000","last_change":"2024-09-22T08:36:25.984592+0000","last_active":"2024-09-22T08:39:32.299156+0000","last_peered":"2024-09-22T08:39:32.299156+0000","last_clean":"2024-09-22T08:39:32.299156+0000","last_became_active":"2024-09-22T08:36:25.984258+0000","last_became_peered":"2024-09-22T08:36:25.984258+0000","last_unstale":"2024-09-22T08:39:32.299156+0000","last_undegraded":"2024-09-22T08:39:32.299156+0000","last_fullsized":"2024-09-22T08:39:32.299156+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:55:58.281586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.225389+0000","last_change":"2024-09-22T08:36:23.979781+0000","last_active":"2024-09-22T08:37:04.225389+0000","last_peered":"2024-09-22T08:37:04.225389+0000","last_clean":"2024-09-22T08:37:04.225389+0000","last_became_active":"2024-09-22T08:36:23.979548+0000","last_became_peered":"2024-09-22T08:36:23.979548+0000","last_unstale":"2024-09-22T08:37:04.225389+0000","last_undegraded":"2024-09-22T08:37:04.225389+0000","last_fullsized":"2024-09-22T08:37:04.225389+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:09:58.448384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"32'16","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:05.722031+0000","last_change":"2024-09-22T08:36:25.980204+0000","last_active":"2024-09-22T08:37:05.722031+0000","last_peered":"2024-09-22T08:37:05.722031+0000","last_clean":"2024-09-22T08:37:05.722031+0000","last_became_active":"2024-09-22T08:36:25.979965+0000","last_became_peered":"2024-09-22T08:36:25.979965+0000","last_unstale":"2024-09-22T08:37:05.722031+0000","last_undegraded":"2024-09-22T08:37:05.722031+0000","last_fullsized":"2024-09-22T08:37:05.722031+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:42:38.878214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":51,"num_write":22,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.199364+0000","last_change":"2024-09-22T08:36:23.978481+0000","last_active":"2024-09-22T08:39:32.199364+0000","last_peered":"2024-09-22T08:39:32.199364+0000","last_clean":"2024-09-22T08:39:32.199364+0000","last_became_active":"2024-09-22T08:36:23.978225+0000","last_became_peered":"2024-09-22T08:36:23.978225+0000","last_unstale":"2024-09-22T08:39:32.199364+0000","last_undegraded":"2024-09-22T08:39:32.199364+0000","last_fullsized":"2024-09-22T08:39:32.199364+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:22:28.702522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"32'6","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:31.994598+0000","last_change":"2024-09-22T08:36:25.990975+0000","last_active":"2024-09-22T08:39:31.994598+0000","last_peered":"2024-09-22T08:39:31.994598+0000","last_clean":"2024-09-22T08:39:31.994598+0000","last_became_active":"2024-09-22T08:36:25.990690+0000","last_became_peered":"2024-09-22T08:36:25.990690+0000","last_unstale":"2024-09-22T08:39:31.994598+0000","last_undegraded":"2024-09-22T08:39:31.994598+0000","last_fullsized":"2024-09-22T08:39:31.994598+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:09:20.176753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.229731+0000","last_change":"2024-09-22T08:36:23.974565+0000","last_active":"2024-09-22T08:37:04.229731+0000","last_peered":"2024-09-22T08:37:04.229731+0000","last_clean":"2024-09-22T08:37:04.229731+0000","last_became_active":"2024-09-22T08:36:23.973976+0000","last_became_peered":"2024-09-22T08:36:23.973976+0000","last_unstale":"2024-09-22T08:37:04.229731+0000","last_undegraded":"2024-09-22T08:37:04.229731+0000","last_fullsized":"2024-09-22T08:37:04.229731+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:58:35.337314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"32'2","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.289981+0000","last_change":"2024-09-22T08:36:25.976107+0000","last_active":"2024-09-22T08:39:32.289981+0000","last_peered":"2024-09-22T08:39:32.289981+0000","last_clean":"2024-09-22T08:39:32.289981+0000","last_became_active":"2024-09-22T08:36:25.975794+0000","last_became_peered":"2024-09-22T08:36:25.975794+0000","last_unstale":"2024-09-22T08:39:32.289981+0000","last_undegraded":"2024-09-22T08:39:32.289981+0000","last_fullsized":"2024-09-22T08:39:32.289981+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:38:51.254477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"32'1","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:48.185676+0000","last_change":"2024-09-22T08:36:23.982786+0000","last_active":"2024-09-22T08:38:48.185676+0000","last_peered":"2024-09-22T08:38:48.185676+0000","last_clean":"2024-09-22T08:38:48.185676+0000","last_became_active":"2024-09-22T08:36:23.982376+0000","last_became_peered":"2024-09-22T08:36:23.982376+0000","last_unstale":"2024-09-22T08:38:48.185676+0000","last_undegraded":"2024-09-22T08:38:48.185676+0000","last_fullsized":"2024-09-22T08:38:48.185676+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:18:02.522688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.226198+0000","last_change":"2024-09-22T08:36:23.979035+0000","last_active":"2024-09-22T08:37:04.226198+0000","last_peered":"2024-09-22T08:37:04.226198+0000","last_clean":"2024-09-22T08:37:04.226198+0000","last_became_active":"2024-09-22T08:36:23.978787+0000","last_became_peered":"2024-09-22T08:36:23.978787+0000","last_unstale":"2024-09-22T08:37:04.226198+0000","last_undegraded":"2024-09-22T08:37:04.226198+0000","last_fullsized":"2024-09-22T08:37:04.226198+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:59:46.639082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"32'8","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.081622+0000","last_change":"2024-09-22T08:36:25.979863+0000","last_active":"2024-09-22T08:39:32.081622+0000","last_peered":"2024-09-22T08:39:32.081622+0000","last_clean":"2024-09-22T08:39:32.081622+0000","last_became_active":"2024-09-22T08:36:25.979593+0000","last_became_peered":"2024-09-22T08:36:25.979593+0000","last_unstale":"2024-09-22T08:39:32.081622+0000","last_undegraded":"2024-09-22T08:39:32.081622+0000","last_fullsized":"2024-09-22T08:39:32.081622+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:44:30.975858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.223261+0000","last_change":"2024-09-22T08:36:23.974913+0000","last_active":"2024-09-22T08:37:04.223261+0000","last_peered":"2024-09-22T08:37:04.223261+0000","last_clean":"2024-09-22T08:37:04.223261+0000","last_became_active":"2024-09-22T08:36:23.974202+0000","last_became_peered":"2024-09-22T08:36:23.974202+0000","last_unstale":"2024-09-22T08:37:04.223261+0000","last_undegraded":"2024-09-22T08:37:04.223261+0000","last_fullsized":"2024-09-22T08:37:04.223261+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:39:58.245871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"32'13","reported_seq":78,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:50.182446+0000","last_change":"2024-09-22T08:37:04.240925+0000","last_active":"2024-09-22T08:38:50.182446+0000","last_peered":"2024-09-22T08:38:50.182446+0000","last_clean":"2024-09-22T08:38:50.182446+0000","last_became_active":"2024-09-22T08:37:04.233241+0000","last_became_peered":"2024-09-22T08:37:04.233241+0000","last_unstale":"2024-09-22T08:38:50.182446+0000","last_undegraded":"2024-09-22T08:38:50.182446+0000","last_fullsized":"2024-09-22T08:38:50.182446+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:13:02.072699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":47,"num_read_kb":43,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1549,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":690,"num_read_kb":658,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":267,"ondisk_log_size":267,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2256,"ondisk_log_size":2256,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":13385,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1402,"num_read_kb":1188,"num_write":531,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":286720,"data_stored":10826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1275,"ondisk_log_size":1275,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":961,"num_read_kb":961,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1672,"num_read_kb":1562,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":25805696,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":170,"num_read_kb":83,"num_write":309,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":51617792,"data_stored":51611392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":128,"acting":128,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":11,"seq":47244640302,"num_pgs":124,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":57420,"kb_used_data":22076,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94314420,"statfs":{"total":96636764160,"available":96577966080,"internally_reserved":0,"allocated":22605824,"data_stored":22337537,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640302,"num_pgs":119,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40424,"kb_used_data":5080,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94331416,"statfs":{"total":96636764160,"available":96595369984,"internally_reserved":0,"allocated":5201920,"data_stored":4920654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":9,"seq":38654705709,"num_pgs":152,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":64540,"kb_used_data":25036,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94307300,"statfs":{"total":96636764160,"available":96570675200,"internally_reserved":0,"allocated":25636864,"data_stored":25305602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705709,"num_pgs":135,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40544,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331296,"statfs":{"total":96636764160,"available":96595247104,"internally_reserved":0,"allocated":1064960,"data_stored":775085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":643072,"data_stored":639872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4194304,"data_stored":4194304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":21614592,"data_stored":21611392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":25165824,"data_stored":25165824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":325,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":4269,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":421,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T08:39:40.189 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-22T08:39:40.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:40.289+0000 7f803f13d640 1 Processor -- start 2024-09-22T08:39:40.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:40.289+0000 7f803f13d640 1 -- start start 2024-09-22T08:39:40.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:40.289+0000 7f803f13d640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f8038071e30 0x7f8038132790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:39:40.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:40.289+0000 7f803f13d640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8038071770 con 0x7f803806e170 2024-09-22T08:39:40.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:40.289+0000 7f803f13d640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f8038099ee0 con 0x7f8038071e30 2024-09-22T08:39:40.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:40.289+0000 7f8037fff640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f8038071e30 0x7f8038132790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:39:40.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:40.289+0000 7f803ced9640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f803806e170 0x7f803806e550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:60594/0 (socket says 172.21.15.31:60594) 2024-09-22T08:39:40.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:40.290+0000 7f803ced9640 1 -- 172.21.15.31:0/3034816154 learned_addr learned my addr 172.21.15.31:0/3034816154 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-22T08:39:40.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:40.290+0000 7f8037fff640 1 -- 172.21.15.31:0/3034816154 >> v1:172.21.15.31:6789/0 conn(0x7f803806e170 legacy=0x7f803806e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:39:40.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:40.290+0000 7f8037fff640 1 -- 172.21.15.31:0/3034816154 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8038072530 con 0x7f8038071e30 2024-09-22T08:39:40.292 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:40.290+0000 7f8037fff640 1 --2- 172.21.15.31:0/3034816154 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8038071e30 0x7f8038132790 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f8024009750 tx=0x7f802402a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=903f289504085993 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:39:40.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:40.291+0000 7f80377fe640 1 -- 172.21.15.31:0/3034816154 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8024037070 con 0x7f8038071e30 2024-09-22T08:39:40.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:40.291+0000 7f80377fe640 1 -- 172.21.15.31:0/3034816154 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f802402ad80 con 0x7f8038071e30 2024-09-22T08:39:40.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:40.291+0000 7f80377fe640 1 -- 172.21.15.31:0/3034816154 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8024032590 con 0x7f8038071e30 2024-09-22T08:39:40.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:40.291+0000 7f803f13d640 1 -- 172.21.15.31:0/3034816154 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8038071e30 msgr2=0x7f8038132790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:39:40.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:40.291+0000 7f803f13d640 1 --2- 172.21.15.31:0/3034816154 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8038071e30 0x7f8038132790 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f8024009750 tx=0x7f802402a140 comp rx=0 tx=0).stop 2024-09-22T08:39:40.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:40.291+0000 7f803f13d640 1 -- 172.21.15.31:0/3034816154 shutdown_connections 2024-09-22T08:39:40.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:40.291+0000 7f803f13d640 1 --2- 172.21.15.31:0/3034816154 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8038071e30 0x7f8038132790 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:39:40.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:40.291+0000 7f803f13d640 1 -- 172.21.15.31:0/3034816154 >> 172.21.15.31:0/3034816154 conn(0x7f803809ac80 msgr2=0x7f8038098550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:39:40.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:40.291+0000 7f803f13d640 1 -- 172.21.15.31:0/3034816154 shutdown_connections 2024-09-22T08:39:40.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:40.291+0000 7f803f13d640 1 -- 172.21.15.31:0/3034816154 wait complete. 2024-09-22T08:39:40.294 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:40.292+0000 7f803f13d640 1 Processor -- start 2024-09-22T08:39:40.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:40.292+0000 7f803f13d640 1 -- start start 2024-09-22T08:39:40.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:40.293+0000 7f803f13d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f803806e170 0x7f80381294d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:39:40.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:40.293+0000 7f803f13d640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f803806ee70 con 0x7f803806e170 2024-09-22T08:39:40.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:40.293+0000 7f803ced9640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f803806e170 0x7f80381294d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:39:40.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:40.293+0000 7f803ced9640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f803806e170 0x7f80381294d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:48224/0 (socket says 172.21.15.31:48224) 2024-09-22T08:39:40.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:40.293+0000 7f803ced9640 1 -- 172.21.15.31:0/1195341632 learned_addr learned my addr 172.21.15.31:0/1195341632 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-22T08:39:40.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:40.293+0000 7f803ced9640 1 -- 172.21.15.31:0/1195341632 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f803806fa50 con 0x7f803806e170 2024-09-22T08:39:40.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:40.293+0000 7f803ced9640 1 --2- 172.21.15.31:0/1195341632 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f803806e170 0x7f80381294d0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f802c00c450 tx=0x7f802c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:39:40.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:40.293+0000 7f80357fa640 1 -- 172.21.15.31:0/1195341632 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f802c017070 con 0x7f803806e170 2024-09-22T08:39:40.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:40.293+0000 7f80357fa640 1 -- 172.21.15.31:0/1195341632 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f802c005c10 con 0x7f803806e170 2024-09-22T08:39:40.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:40.293+0000 7f803f13d640 1 -- 172.21.15.31:0/1195341632 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8038070580 con 0x7f803806e170 2024-09-22T08:39:40.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:40.293+0000 7f80357fa640 1 -- 172.21.15.31:0/1195341632 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f802c0070d0 con 0x7f803806e170 2024-09-22T08:39:40.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:40.293+0000 7f803f13d640 1 -- 172.21.15.31:0/1195341632 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8038070e50 con 0x7f803806e170 2024-09-22T08:39:40.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:40.294+0000 7f80357fa640 1 -- 172.21.15.31:0/1195341632 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f802c01a070 con 0x7f803806e170 2024-09-22T08:39:40.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:40.294+0000 7f803f13d640 1 -- 172.21.15.31:0/1195341632 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f803806e550 con 0x7f803806e170 2024-09-22T08:39:40.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:40.295+0000 7f80357fa640 1 --2- 172.21.15.31:0/1195341632 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f801c03e710 0x7f801c040bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:39:40.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:40.295+0000 7f80357fa640 1 -- 172.21.15.31:0/1195341632 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5938+0+0 (secure 0 0 0) 0x7f802c0529a0 con 0x7f803806e170 2024-09-22T08:39:40.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:40.295+0000 7f8037fff640 1 --2- 172.21.15.31:0/1195341632 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f801c03e710 0x7f801c040bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:39:40.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:40.295+0000 7f8037fff640 1 --2- 172.21.15.31:0/1195341632 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f801c03e710 0x7f801c040bd0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f8024034000 tx=0x7f802402e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:39:40.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:40.299+0000 7f80357fa640 1 -- 172.21.15.31:0/1195341632 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f802c01ad80 con 0x7f803806e170 2024-09-22T08:39:40.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:40.491+0000 7f803f13d640 1 -- 172.21.15.31:0/1195341632 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8038076560 con 0x7f803806e170 2024-09-22T08:39:40.494 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:40.493+0000 7f80357fa640 1 -- 172.21.15.31:0/1195341632 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) ==== 74+0+21236 (secure 0 0 0) 0x7f802c01b8d0 con 0x7f803806e170 2024-09-22T08:39:40.494 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-22T08:39:40.494 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":32,"fsid":"d3faaa46-a06c-404a-b783-532e7c90ea63","created":"2024-09-22T08:35:58.970523+0000","modified":"2024-09-22T08:37:04.218037+0000","last_up_change":"2024-09-22T08:36:09.401562+0000","last_in_change":"2024-09-22T08:36:00.023066+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-22T08:36:09.158554+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-22T08:36:14.551376+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":17,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"default.rgw.buckets.data","create_time":"2024-09-22T08:36:23.022478+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.309999942779541,"score_stable":1.309999942779541,"optimal_score":1,"raw_score_acting":1.309999942779541,"raw_score_stable":1.309999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"default.rgw.buckets.index","create_time":"2024-09-22T08:36:24.267389+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":".rgw.root","create_time":"2024-09-22T08:36:26.261160+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.log","create_time":"2024-09-22T08:36:28.056195+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"default.rgw.control","create_time":"2024-09-22T08:36:30.005138+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"default.rgw.meta","create_time":"2024-09-22T08:36:32.073493+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b564b56d-77a0-4258-b683-62460f71da28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":168281188},{"type":"v1","addr":"172.21.15.31:6801","nonce":168281188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":168281188},{"type":"v1","addr":"172.21.15.31:6803","nonce":168281188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":168281188},{"type":"v1","addr":"172.21.15.31:6807","nonce":168281188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":168281188},{"type":"v1","addr":"172.21.15.31:6805","nonce":168281188}]},"public_addr":"172.21.15.31:6801/168281188","cluster_addr":"172.21.15.31:6803/168281188","heartbeat_back_addr":"172.21.15.31:6807/168281188","heartbeat_front_addr":"172.21.15.31:6805/168281188","state":["exists","up"]},{"osd":1,"uuid":"8f501a52-02aa-4ddf-ae21-83fc468e2e35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3192108003},{"type":"v1","addr":"172.21.15.142:6817","nonce":3192108003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":3192108003},{"type":"v1","addr":"172.21.15.142:6819","nonce":3192108003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":3192108003},{"type":"v1","addr":"172.21.15.142:6823","nonce":3192108003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":3192108003},{"type":"v1","addr":"172.21.15.142:6821","nonce":3192108003}]},"public_addr":"172.21.15.142:6817/3192108003","cluster_addr":"172.21.15.142:6819/3192108003","heartbeat_back_addr":"172.21.15.142:6823/3192108003","heartbeat_front_addr":"172.21.15.142:6821/3192108003","state":["exists","up"]},{"osd":2,"uuid":"3dad5d00-e406-4917-9476-7f79fdf2e276","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":279438927},{"type":"v1","addr":"172.21.15.142:6809","nonce":279438927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":279438927},{"type":"v1","addr":"172.21.15.142:6811","nonce":279438927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":279438927},{"type":"v1","addr":"172.21.15.142:6815","nonce":279438927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":279438927},{"type":"v1","addr":"172.21.15.142:6813","nonce":279438927}]},"public_addr":"172.21.15.142:6809/279438927","cluster_addr":"172.21.15.142:6811/279438927","heartbeat_back_addr":"172.21.15.142:6815/279438927","heartbeat_front_addr":"172.21.15.142:6813/279438927","state":["exists","up"]},{"osd":3,"uuid":"3eea2de4-b487-4110-b798-495fa09ef2d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":1064901393},{"type":"v1","addr":"172.21.15.142:6801","nonce":1064901393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":1064901393},{"type":"v1","addr":"172.21.15.142:6803","nonce":1064901393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":1064901393},{"type":"v1","addr":"172.21.15.142:6807","nonce":1064901393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":1064901393},{"type":"v1","addr":"172.21.15.142:6805","nonce":1064901393}]},"public_addr":"172.21.15.142:6801/1064901393","cluster_addr":"172.21.15.142:6803/1064901393","heartbeat_back_addr":"172.21.15.142:6807/1064901393","heartbeat_front_addr":"172.21.15.142:6805/1064901393","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-22T08:36:06.000852+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-22T08:36:06.991262+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-22T08:36:06.415953+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-22T08:36:05.868062+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.7","mappings":[{"from":3,"to":1}]},{"pgid":"3.1b","mappings":[{"from":3,"to":0}]},{"pgid":"4.5","mappings":[{"from":3,"to":2}]},{"pgid":"4.2d","mappings":[{"from":3,"to":2}]},{"pgid":"4.36","mappings":[{"from":3,"to":2}]},{"pgid":"5.2","mappings":[{"from":0,"to":2}]},{"pgid":"5.7","mappings":[{"from":0,"to":2}]},{"pgid":"5.14","mappings":[{"from":0,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-22T08:39:40.496 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:40.495+0000 7f803f13d640 1 -- 172.21.15.31:0/1195341632 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f801c03e710 msgr2=0x7f801c040bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:39:40.496 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:40.495+0000 7f803f13d640 1 --2- 172.21.15.31:0/1195341632 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f801c03e710 0x7f801c040bd0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f8024034000 tx=0x7f802402e000 comp rx=0 tx=0).stop 2024-09-22T08:39:40.497 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:40.495+0000 7f803f13d640 1 -- 172.21.15.31:0/1195341632 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f803806e170 msgr2=0x7f80381294d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:39:40.497 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:40.495+0000 7f803f13d640 1 --2- 172.21.15.31:0/1195341632 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f803806e170 0x7f80381294d0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f802c00c450 tx=0x7f802c00c910 comp rx=0 tx=0).stop 2024-09-22T08:39:40.497 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:40.495+0000 7f803f13d640 1 -- 172.21.15.31:0/1195341632 shutdown_connections 2024-09-22T08:39:40.497 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:40.495+0000 7f803f13d640 1 --2- 172.21.15.31:0/1195341632 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f801c03e710 0x7f801c040bd0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:39:40.497 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:40.495+0000 7f803f13d640 1 --2- 172.21.15.31:0/1195341632 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f803806e170 0x7f80381294d0 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:39:40.497 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:40.495+0000 7f803f13d640 1 -- 172.21.15.31:0/1195341632 >> 172.21.15.31:0/1195341632 conn(0x7f803809ac80 msgr2=0x7f8038097280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:39:40.497 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:40.495+0000 7f803f13d640 1 -- 172.21.15.31:0/1195341632 shutdown_connections 2024-09-22T08:39:40.497 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:40.495+0000 7f803f13d640 1 -- 172.21.15.31:0/1195341632 wait complete. 2024-09-22T08:39:41.508 INFO:tasks.ceph:Scrubbing osd.0 2024-09-22T08:39:41.508 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-22T08:39:41.627 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:41.626+0000 7f47eeba0640 1 Processor -- start 2024-09-22T08:39:41.627 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:41.626+0000 7f47eeba0640 1 -- start start 2024-09-22T08:39:41.628 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:41.627+0000 7f47eeba0640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f47e812f3a0 0x7f47e8131790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:39:41.628 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:41.627+0000 7f47eeba0640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47e806e5f0 con 0x7f47e8094420 2024-09-22T08:39:41.628 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:41.627+0000 7f47eeba0640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f47e809a4b0 con 0x7f47e812f3a0 2024-09-22T08:39:41.628 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:41.627+0000 7f47e7fff640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f47e812f3a0 0x7f47e8131790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:39:41.628 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:41.627+0000 7f47ec93c640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f47e8094420 0x7f47e8094800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:60600/0 (socket says 172.21.15.31:60600) 2024-09-22T08:39:41.629 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:41.627+0000 7f47ec93c640 1 -- 172.21.15.31:0/4016875 learned_addr learned my addr 172.21.15.31:0/4016875 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-22T08:39:41.629 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:41.627+0000 7f47e7fff640 1 -- 172.21.15.31:0/4016875 >> v1:172.21.15.31:6789/0 conn(0x7f47e8094420 legacy=0x7f47e8094800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:39:41.629 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:41.627+0000 7f47e7fff640 1 -- 172.21.15.31:0/4016875 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47e8099e00 con 0x7f47e812f3a0 2024-09-22T08:39:41.629 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:41.627+0000 7f47e77fe640 1 -- 172.21.15.31:0/4016875 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4224563032 0 0) 0x7f47d8001110 con 0x7f47e8094420 2024-09-22T08:39:41.630 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:41.628+0000 7f47e7fff640 1 --2- 172.21.15.31:0/4016875 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f47e812f3a0 0x7f47e8131790 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f47d0009720 tx=0x7f47d002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94cfefa56bbf5a87 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:39:41.630 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:41.628+0000 7f47e77fe640 1 -- 172.21.15.31:0/4016875 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f47d0037070 con 0x7f47e812f3a0 2024-09-22T08:39:41.630 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:41.628+0000 7f47e77fe640 1 -- 172.21.15.31:0/4016875 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47d002ae20 con 0x7f47e812f3a0 2024-09-22T08:39:41.630 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:41.628+0000 7f47e77fe640 1 -- 172.21.15.31:0/4016875 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f47d0032590 con 0x7f47e812f3a0 2024-09-22T08:39:41.630 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:41.629+0000 7f47eeba0640 1 -- 172.21.15.31:0/4016875 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f47e812f3a0 msgr2=0x7f47e8131790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:39:41.630 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:41.629+0000 7f47eeba0640 1 --2- 172.21.15.31:0/4016875 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f47e812f3a0 0x7f47e8131790 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f47d0009720 tx=0x7f47d002a1a0 comp rx=0 tx=0).stop 2024-09-22T08:39:41.630 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:41.629+0000 7f47eeba0640 1 -- 172.21.15.31:0/4016875 shutdown_connections 2024-09-22T08:39:41.630 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:41.629+0000 7f47eeba0640 1 --2- 172.21.15.31:0/4016875 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f47e812f3a0 0x7f47e8131790 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:39:41.630 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:41.629+0000 7f47eeba0640 1 -- 172.21.15.31:0/4016875 >> 172.21.15.31:0/4016875 conn(0x7f47e809ac80 msgr2=0x7f47e809b090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:39:41.630 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:41.629+0000 7f47eeba0640 1 -- 172.21.15.31:0/4016875 shutdown_connections 2024-09-22T08:39:41.630 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:41.629+0000 7f47eeba0640 1 -- 172.21.15.31:0/4016875 wait complete. 2024-09-22T08:39:41.631 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:41.630+0000 7f47eeba0640 1 Processor -- start 2024-09-22T08:39:41.631 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:41.630+0000 7f47eeba0640 1 -- start start 2024-09-22T08:39:41.632 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:41.630+0000 7f47eeba0640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f47e8094420 0x7f47e81c0e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:39:41.632 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:41.630+0000 7f47eeba0640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f47e8097bd0 con 0x7f47e8094420 2024-09-22T08:39:41.632 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:41.630+0000 7f47ec93c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f47e8094420 0x7f47e81c0e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:39:41.632 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:41.630+0000 7f47ec93c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f47e8094420 0x7f47e81c0e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:48248/0 (socket says 172.21.15.31:48248) 2024-09-22T08:39:41.632 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:41.630+0000 7f47ec93c640 1 -- 172.21.15.31:0/1277667389 learned_addr learned my addr 172.21.15.31:0/1277667389 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-22T08:39:41.632 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:41.631+0000 7f47ec93c640 1 -- 172.21.15.31:0/1277667389 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47e8073e80 con 0x7f47e8094420 2024-09-22T08:39:41.632 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:41.631+0000 7f47ec93c640 1 --2- 172.21.15.31:0/1277667389 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f47e8094420 0x7f47e81c0e80 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f47d800e8c0 tx=0x7f47d800ed80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:39:41.632 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:41.631+0000 7f47e57fa640 1 -- 172.21.15.31:0/1277667389 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f47d80072e0 con 0x7f47e8094420 2024-09-22T08:39:41.633 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:41.631+0000 7f47e57fa640 1 -- 172.21.15.31:0/1277667389 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47d8016020 con 0x7f47e8094420 2024-09-22T08:39:41.633 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:41.631+0000 7f47e57fa640 1 -- 172.21.15.31:0/1277667389 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f47d8007610 con 0x7f47e8094420 2024-09-22T08:39:41.633 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:41.631+0000 7f47eeba0640 1 -- 172.21.15.31:0/1277667389 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47e808fc10 con 0x7f47e8094420 2024-09-22T08:39:41.633 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:41.631+0000 7f47eeba0640 1 -- 172.21.15.31:0/1277667389 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47e81c15a0 con 0x7f47e8094420 2024-09-22T08:39:41.634 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:41.632+0000 7f47eeba0640 1 -- 172.21.15.31:0/1277667389 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f47e80902a0 con 0x7f47e8094420 2024-09-22T08:39:41.634 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:41.632+0000 7f47e57fa640 1 -- 172.21.15.31:0/1277667389 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f47d800c870 con 0x7f47e8094420 2024-09-22T08:39:41.634 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:41.632+0000 7f47e57fa640 1 --2- 172.21.15.31:0/1277667389 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f47c803e710 0x7f47c8040bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:39:41.634 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:41.632+0000 7f47e57fa640 1 -- 172.21.15.31:0/1277667389 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5938+0+0 (secure 0 0 0) 0x7f47d8017030 con 0x7f47e8094420 2024-09-22T08:39:41.634 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:41.632+0000 7f47e57fa640 1 --2- 172.21.15.31:0/1277667389 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f47c804a490 0x7f47c804c930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:39:41.634 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:41.632+0000 7f47e57fa640 1 -- 172.21.15.31:0/1277667389 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f47d8016e50 con 0x7f47c804a490 2024-09-22T08:39:41.634 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:41.632+0000 7f47e57fa640 1 -- 172.21.15.31:0/1277667389 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f47d805a2a0 con 0x7f47e8094420 2024-09-22T08:39:41.634 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:41.632+0000 7f47ed13d640 1 --2- 172.21.15.31:0/1277667389 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f47c804a490 0x7f47c804c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:39:41.634 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:41.633+0000 7f47e7fff640 1 --2- 172.21.15.31:0/1277667389 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f47c803e710 0x7f47c8040bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:39:41.634 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:41.633+0000 7f47ed13d640 1 --2- 172.21.15.31:0/1277667389 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f47c804a490 0x7f47c804c930 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:39:41.635 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:41.633+0000 7f47e7fff640 1 --2- 172.21.15.31:0/1277667389 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f47c803e710 0x7f47c8040bd0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f47d0034000 tx=0x7f47d002e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:39:41.635 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:41.633+0000 7f47e57fa640 1 -- 172.21.15.31:0/1277667389 <== osd.0 v2:172.21.15.31:6800/168281188 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f47d8016e50 con 0x7f47c804a490 2024-09-22T08:39:41.647 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:41.646+0000 7f47eeba0640 1 -- 172.21.15.31:0/1277667389 --> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f47e8094800 con 0x7f47c804a490 2024-09-22T08:39:41.647 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:41.646+0000 7f47e57fa640 1 -- 172.21.15.31:0/1277667389 <== osd.0 v2:172.21.15.31:6800/168281188 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f47e8094800 con 0x7f47c804a490 2024-09-22T08:39:41.648 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-09-22T08:39:41.648 INFO:teuthology.orchestra.run.smithi031.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-22T08:39:41.648 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-09-22T08:39:41.649 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:41.647+0000 7f47eeba0640 1 -- 172.21.15.31:0/1277667389 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f47c804a490 msgr2=0x7f47c804c930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:39:41.649 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:41.647+0000 7f47eeba0640 1 --2- 172.21.15.31:0/1277667389 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f47c804a490 0x7f47c804c930 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:39:41.649 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:41.647+0000 7f47eeba0640 1 -- 172.21.15.31:0/1277667389 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f47c803e710 msgr2=0x7f47c8040bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:39:41.649 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:41.647+0000 7f47eeba0640 1 --2- 172.21.15.31:0/1277667389 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f47c803e710 0x7f47c8040bd0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f47d0034000 tx=0x7f47d002e000 comp rx=0 tx=0).stop 2024-09-22T08:39:41.649 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:41.647+0000 7f47eeba0640 1 -- 172.21.15.31:0/1277667389 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f47e8094420 msgr2=0x7f47e81c0e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:39:41.649 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:41.647+0000 7f47eeba0640 1 --2- 172.21.15.31:0/1277667389 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f47e8094420 0x7f47e81c0e80 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f47d800e8c0 tx=0x7f47d800ed80 comp rx=0 tx=0).stop 2024-09-22T08:39:41.649 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:41.647+0000 7f47eeba0640 1 -- 172.21.15.31:0/1277667389 shutdown_connections 2024-09-22T08:39:41.649 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:41.647+0000 7f47eeba0640 1 --2- 172.21.15.31:0/1277667389 >> [v2:172.21.15.31:6800/168281188,v1:172.21.15.31:6801/168281188] conn(0x7f47c804a490 0x7f47c804c930 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:39:41.649 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:41.647+0000 7f47eeba0640 1 --2- 172.21.15.31:0/1277667389 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f47c803e710 0x7f47c8040bd0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:39:41.649 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:41.647+0000 7f47eeba0640 1 --2- 172.21.15.31:0/1277667389 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f47e8094420 0x7f47e81c0e80 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:39:41.649 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:41.647+0000 7f47eeba0640 1 -- 172.21.15.31:0/1277667389 >> 172.21.15.31:0/1277667389 conn(0x7f47e809ac80 msgr2=0x7f47e809bb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:39:41.649 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:41.647+0000 7f47eeba0640 1 -- 172.21.15.31:0/1277667389 shutdown_connections 2024-09-22T08:39:41.649 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:41.647+0000 7f47eeba0640 1 -- 172.21.15.31:0/1277667389 wait complete. 2024-09-22T08:39:41.658 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-22T08:39:41.760 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:41.759+0000 7f46238bd640 1 Processor -- start 2024-09-22T08:39:41.760 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:41.759+0000 7f46238bd640 1 -- start start 2024-09-22T08:39:41.761 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:41.760+0000 7f46238bd640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f461c132960 0x7f461c134d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:39:41.761 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:41.760+0000 7f46238bd640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f461c06ff50 con 0x7f461c06e8e0 2024-09-22T08:39:41.762 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:41.760+0000 7f46238bd640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f461c099c10 con 0x7f461c132960 2024-09-22T08:39:41.762 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:41.760+0000 7f4621659640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f461c06e8e0 0x7f461c06ecc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:60610/0 (socket says 172.21.15.31:60610) 2024-09-22T08:39:41.762 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:41.760+0000 7f4621659640 1 -- 172.21.15.31:0/3866022725 learned_addr learned my addr 172.21.15.31:0/3866022725 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-22T08:39:41.762 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:41.760+0000 7f4620e58640 1 --2- 172.21.15.31:0/3866022725 >> v2:172.21.15.31:3300/0 conn(0x7f461c132960 0x7f461c134d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:39:41.762 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:41.760+0000 7f4613fff640 1 -- 172.21.15.31:0/3866022725 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4216222500 0 0) 0x7f461c06ff50 con 0x7f461c06e8e0 2024-09-22T08:39:41.762 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:41.760+0000 7f4613fff640 1 -- 172.21.15.31:0/3866022725 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4608003520 con 0x7f461c06e8e0 2024-09-22T08:39:41.762 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:41.760+0000 7f4620e58640 1 -- 172.21.15.31:0/3866022725 >> v1:172.21.15.31:6789/0 conn(0x7f461c06e8e0 legacy=0x7f461c06ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:39:41.762 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:41.760+0000 7f4620e58640 1 -- 172.21.15.31:0/3866022725 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f461c06f3d0 con 0x7f461c132960 2024-09-22T08:39:41.763 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:41.761+0000 7f4620e58640 1 --2- 172.21.15.31:0/3866022725 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f461c132960 0x7f461c134d50 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f460c009720 tx=0x7f460c02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=858e31bfde91b464 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:39:41.763 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:41.761+0000 7f4613fff640 1 -- 172.21.15.31:0/3866022725 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f460c037070 con 0x7f461c132960 2024-09-22T08:39:41.763 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:41.761+0000 7f4613fff640 1 -- 172.21.15.31:0/3866022725 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f460c02ad90 con 0x7f461c132960 2024-09-22T08:39:41.763 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:41.761+0000 7f4613fff640 1 -- 172.21.15.31:0/3866022725 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f460c032590 con 0x7f461c132960 2024-09-22T08:39:41.763 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:41.762+0000 7f46238bd640 1 -- 172.21.15.31:0/3866022725 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f461c132960 msgr2=0x7f461c134d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:39:41.763 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:41.762+0000 7f46238bd640 1 --2- 172.21.15.31:0/3866022725 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f461c132960 0x7f461c134d50 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f460c009720 tx=0x7f460c02a110 comp rx=0 tx=0).stop 2024-09-22T08:39:41.764 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:41.762+0000 7f46238bd640 1 -- 172.21.15.31:0/3866022725 shutdown_connections 2024-09-22T08:39:41.764 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:41.762+0000 7f46238bd640 1 --2- 172.21.15.31:0/3866022725 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f461c132960 0x7f461c134d50 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:39:41.764 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:41.762+0000 7f46238bd640 1 -- 172.21.15.31:0/3866022725 >> 172.21.15.31:0/3866022725 conn(0x7f461c0a01c0 msgr2=0x7f461c0a05d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:39:41.764 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:41.762+0000 7f46238bd640 1 -- 172.21.15.31:0/3866022725 shutdown_connections 2024-09-22T08:39:41.764 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:41.762+0000 7f46238bd640 1 -- 172.21.15.31:0/3866022725 wait complete. 2024-09-22T08:39:41.765 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:41.763+0000 7f46238bd640 1 Processor -- start 2024-09-22T08:39:41.765 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:41.763+0000 7f46238bd640 1 -- start start 2024-09-22T08:39:41.765 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:41.763+0000 7f46238bd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f461c06e8e0 0x7f461c12d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:39:41.765 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:41.763+0000 7f46238bd640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f461c135410 con 0x7f461c06e8e0 2024-09-22T08:39:41.765 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:41.763+0000 7f4621659640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f461c06e8e0 0x7f461c12d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:39:41.766 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:41.763+0000 7f4621659640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f461c06e8e0 0x7f461c12d450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:48254/0 (socket says 172.21.15.31:48254) 2024-09-22T08:39:41.766 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:41.763+0000 7f4621659640 1 -- 172.21.15.31:0/3060780087 learned_addr learned my addr 172.21.15.31:0/3060780087 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-22T08:39:41.766 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:41.764+0000 7f4621659640 1 -- 172.21.15.31:0/3060780087 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f461c12c0e0 con 0x7f461c06e8e0 2024-09-22T08:39:41.766 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:41.764+0000 7f4621659640 1 --2- 172.21.15.31:0/3060780087 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f461c06e8e0 0x7f461c12d450 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f461800c390 tx=0x7f461800c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:39:41.766 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:41.764+0000 7f4611ffb640 1 -- 172.21.15.31:0/3060780087 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4618017070 con 0x7f461c06e8e0 2024-09-22T08:39:41.766 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:41.764+0000 7f4611ffb640 1 -- 172.21.15.31:0/3060780087 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4618005cd0 con 0x7f461c06e8e0 2024-09-22T08:39:41.766 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:41.764+0000 7f4611ffb640 1 -- 172.21.15.31:0/3060780087 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4618007200 con 0x7f461c06e8e0 2024-09-22T08:39:41.766 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:41.764+0000 7f46238bd640 1 -- 172.21.15.31:0/3060780087 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f461c129f90 con 0x7f461c06e8e0 2024-09-22T08:39:41.766 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:41.764+0000 7f46238bd640 1 -- 172.21.15.31:0/3060780087 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f461c12eab0 con 0x7f461c06e8e0 2024-09-22T08:39:41.767 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:41.765+0000 7f4611ffb640 1 -- 172.21.15.31:0/3060780087 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f461801a070 con 0x7f461c06e8e0 2024-09-22T08:39:41.767 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:41.765+0000 7f46238bd640 1 -- 172.21.15.31:0/3060780087 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f461c06ecc0 con 0x7f461c06e8e0 2024-09-22T08:39:41.767 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:41.765+0000 7f4611ffb640 1 --2- 172.21.15.31:0/3060780087 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f460003e710 0x7f4600040bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:39:41.767 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:41.765+0000 7f4611ffb640 1 -- 172.21.15.31:0/3060780087 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5938+0+0 (secure 0 0 0) 0x7f46180528a0 con 0x7f461c06e8e0 2024-09-22T08:39:41.767 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:41.765+0000 7f4620e58640 1 --2- 172.21.15.31:0/3060780087 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f460003e710 0x7f4600040bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:39:41.767 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:41.766+0000 7f4620e58640 1 --2- 172.21.15.31:0/3060780087 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f460003e710 0x7f4600040bd0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f460c034000 tx=0x7f460c02e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:39:41.771 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:41.770+0000 7f4611ffb640 1 -- 172.21.15.31:0/3060780087 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f461801b3b0 con 0x7f461c06e8e0 2024-09-22T08:39:41.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:41.959+0000 7f46238bd640 1 -- 172.21.15.31:0/3060780087 --> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7f461c12c6c0 con 0x7f460003e710 2024-09-22T08:39:41.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:41.960+0000 7f4611ffb640 1 -- 172.21.15.31:0/3060780087 <== mgr.4099 v2:172.21.15.142:6824/99931088 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f461c12c6c0 con 0x7f460003e710 2024-09-22T08:39:41.961 INFO:teuthology.orchestra.run.smithi031.stderr:instructed osd(s) 0 to deep-scrub 2024-09-22T08:39:41.964 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:41.963+0000 7f46238bd640 1 -- 172.21.15.31:0/3060780087 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f460003e710 msgr2=0x7f4600040bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:39:41.965 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:41.963+0000 7f46238bd640 1 --2- 172.21.15.31:0/3060780087 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f460003e710 0x7f4600040bd0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f460c034000 tx=0x7f460c02e000 comp rx=0 tx=0).stop 2024-09-22T08:39:41.965 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:41.963+0000 7f46238bd640 1 -- 172.21.15.31:0/3060780087 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f461c06e8e0 msgr2=0x7f461c12d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:39:41.965 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:41.963+0000 7f46238bd640 1 --2- 172.21.15.31:0/3060780087 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f461c06e8e0 0x7f461c12d450 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f461800c390 tx=0x7f461800c850 comp rx=0 tx=0).stop 2024-09-22T08:39:41.965 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:41.963+0000 7f46238bd640 1 -- 172.21.15.31:0/3060780087 shutdown_connections 2024-09-22T08:39:41.965 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:41.963+0000 7f46238bd640 1 --2- 172.21.15.31:0/3060780087 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f460003e710 0x7f4600040bd0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:39:41.965 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:41.963+0000 7f46238bd640 1 --2- 172.21.15.31:0/3060780087 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f461c06e8e0 0x7f461c12d450 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:39:41.965 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:41.963+0000 7f46238bd640 1 -- 172.21.15.31:0/3060780087 >> 172.21.15.31:0/3060780087 conn(0x7f461c0a01c0 msgr2=0x7f461c134310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:39:41.965 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:41.963+0000 7f46238bd640 1 -- 172.21.15.31:0/3060780087 shutdown_connections 2024-09-22T08:39:41.965 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:41.963+0000 7f46238bd640 1 -- 172.21.15.31:0/3060780087 wait complete. 2024-09-22T08:39:41.974 INFO:tasks.ceph:Scrubbing osd.1 2024-09-22T08:39:41.975 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-22T08:39:42.079 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.078+0000 7f7e75a8c640 1 Processor -- start 2024-09-22T08:39:42.079 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.078+0000 7f7e75a8c640 1 -- start start 2024-09-22T08:39:42.080 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.079+0000 7f7e75a8c640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f7e70096630 0x7f7e70130b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:39:42.080 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.079+0000 7f7e75a8c640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e70096aa0 con 0x7f7e7012bd40 2024-09-22T08:39:42.080 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.079+0000 7f7e75a8c640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f7e70097f10 con 0x7f7e70096630 2024-09-22T08:39:42.080 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.079+0000 7f7e6effd640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f7e70096630 0x7f7e70130b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:39:42.080 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.079+0000 7f7e6f7fe640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f7e7012bd40 0x7f7e7012c120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:60624/0 (socket says 172.21.15.31:60624) 2024-09-22T08:39:42.081 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.079+0000 7f7e6f7fe640 1 -- 172.21.15.31:0/2960858008 learned_addr learned my addr 172.21.15.31:0/2960858008 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-22T08:39:42.081 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.079+0000 7f7e6effd640 1 -- 172.21.15.31:0/2960858008 >> v1:172.21.15.31:6789/0 conn(0x7f7e7012bd40 legacy=0x7f7e7012c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:39:42.081 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.079+0000 7f7e6effd640 1 -- 172.21.15.31:0/2960858008 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e7012ba50 con 0x7f7e70096630 2024-09-22T08:39:42.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.080+0000 7f7e6effd640 1 --2- 172.21.15.31:0/2960858008 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7e70096630 0x7f7e70130b60 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f7e64009720 tx=0x7f7e6402b220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9163815571f483e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:39:42.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.080+0000 7f7e6e7fc640 1 -- 172.21.15.31:0/2960858008 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7e64038070 con 0x7f7e70096630 2024-09-22T08:39:42.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.080+0000 7f7e6e7fc640 1 -- 172.21.15.31:0/2960858008 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e64033440 con 0x7f7e70096630 2024-09-22T08:39:42.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.080+0000 7f7e6e7fc640 1 -- 172.21.15.31:0/2960858008 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7e64033740 con 0x7f7e70096630 2024-09-22T08:39:42.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.080+0000 7f7e75a8c640 1 -- 172.21.15.31:0/2960858008 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7e70096630 msgr2=0x7f7e70130b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:39:42.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.080+0000 7f7e75a8c640 1 --2- 172.21.15.31:0/2960858008 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7e70096630 0x7f7e70130b60 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f7e64009720 tx=0x7f7e6402b220 comp rx=0 tx=0).stop 2024-09-22T08:39:42.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.081+0000 7f7e75a8c640 1 -- 172.21.15.31:0/2960858008 shutdown_connections 2024-09-22T08:39:42.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.081+0000 7f7e75a8c640 1 --2- 172.21.15.31:0/2960858008 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7e70096630 0x7f7e70130b60 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:39:42.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.081+0000 7f7e75a8c640 1 -- 172.21.15.31:0/2960858008 >> 172.21.15.31:0/2960858008 conn(0x7f7e7009ac80 msgr2=0x7f7e7009b090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:39:42.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.081+0000 7f7e75a8c640 1 -- 172.21.15.31:0/2960858008 shutdown_connections 2024-09-22T08:39:42.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.081+0000 7f7e75a8c640 1 -- 172.21.15.31:0/2960858008 wait complete. 2024-09-22T08:39:42.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.081+0000 7f7e75a8c640 1 Processor -- start 2024-09-22T08:39:42.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.082+0000 7f7e75a8c640 1 -- start start 2024-09-22T08:39:42.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.082+0000 7f7e75a8c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7e70096630 0x7f7e701bfc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:39:42.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.082+0000 7f7e75a8c640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f7e70099f20 con 0x7f7e70096630 2024-09-22T08:39:42.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.082+0000 7f7e6f7fe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7e70096630 0x7f7e701bfc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:39:42.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.082+0000 7f7e6f7fe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7e70096630 0x7f7e701bfc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:48272/0 (socket says 172.21.15.31:48272) 2024-09-22T08:39:42.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.082+0000 7f7e6f7fe640 1 -- 172.21.15.31:0/3810719261 learned_addr learned my addr 172.21.15.31:0/3810719261 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-22T08:39:42.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.082+0000 7f7e6f7fe640 1 -- 172.21.15.31:0/3810719261 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e70128eb0 con 0x7f7e70096630 2024-09-22T08:39:42.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.082+0000 7f7e6f7fe640 1 --2- 172.21.15.31:0/3810719261 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7e70096630 0x7f7e701bfc70 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f7e6000e8c0 tx=0x7f7e6000ed80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:39:42.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.083+0000 7f7e57fff640 1 -- 172.21.15.31:0/3810719261 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7e60015070 con 0x7f7e70096630 2024-09-22T08:39:42.085 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.083+0000 7f7e57fff640 1 -- 172.21.15.31:0/3810719261 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e60005c10 con 0x7f7e70096630 2024-09-22T08:39:42.085 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.083+0000 7f7e75a8c640 1 -- 172.21.15.31:0/3810719261 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e700701d0 con 0x7f7e70096630 2024-09-22T08:39:42.085 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.083+0000 7f7e57fff640 1 -- 172.21.15.31:0/3810719261 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7e6000c7a0 con 0x7f7e70096630 2024-09-22T08:39:42.085 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.083+0000 7f7e75a8c640 1 -- 172.21.15.31:0/3810719261 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e70128890 con 0x7f7e70096630 2024-09-22T08:39:42.086 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.083+0000 7f7e75a8c640 1 -- 172.21.15.31:0/3810719261 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7e70125f30 con 0x7f7e70096630 2024-09-22T08:39:42.086 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.084+0000 7f7e57fff640 1 -- 172.21.15.31:0/3810719261 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f7e60018070 con 0x7f7e70096630 2024-09-22T08:39:42.086 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.084+0000 7f7e57fff640 1 --2- 172.21.15.31:0/3810719261 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f7e5c03e710 0x7f7e5c040bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:39:42.086 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.084+0000 7f7e57fff640 1 -- 172.21.15.31:0/3810719261 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5938+0+0 (secure 0 0 0) 0x7f7e60055a80 con 0x7f7e70096630 2024-09-22T08:39:42.086 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.084+0000 7f7e57fff640 1 --2- 172.21.15.31:0/3810719261 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x7f7e5c04a4f0 0x7f7e5c04c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:39:42.086 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.084+0000 7f7e57fff640 1 -- 172.21.15.31:0/3810719261 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7e60007740 con 0x7f7e5c04a4f0 2024-09-22T08:39:42.086 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.084+0000 7f7e57fff640 1 -- 172.21.15.31:0/3810719261 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f7e6005a2a0 con 0x7f7e70096630 2024-09-22T08:39:42.086 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.084+0000 7f7e6effd640 1 --2- 172.21.15.31:0/3810719261 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f7e5c03e710 0x7f7e5c040bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:39:42.087 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.084+0000 7f7e6ffff640 1 --2- 172.21.15.31:0/3810719261 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x7f7e5c04a4f0 0x7f7e5c04c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:39:42.087 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.085+0000 7f7e6ffff640 1 --2- 172.21.15.31:0/3810719261 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x7f7e5c04a4f0 0x7f7e5c04c990 crc :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:39:42.087 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.085+0000 7f7e6effd640 1 --2- 172.21.15.31:0/3810719261 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f7e5c03e710 0x7f7e5c040bd0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f7e64035000 tx=0x7f7e6402f000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:39:42.087 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.086+0000 7f7e57fff640 1 -- 172.21.15.31:0/3810719261 <== osd.1 v2:172.21.15.142:6816/3192108003 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7e60007740 con 0x7f7e5c04a4f0 2024-09-22T08:39:42.099 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.098+0000 7f7e75a8c640 1 -- 172.21.15.31:0/3810719261 --> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f7e7006fda0 con 0x7f7e5c04a4f0 2024-09-22T08:39:42.100 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.099+0000 7f7e57fff640 1 -- 172.21.15.31:0/3810719261 <== osd.1 v2:172.21.15.142:6816/3192108003 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f7e6800ad10 con 0x7f7e5c04a4f0 2024-09-22T08:39:42.100 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-09-22T08:39:42.100 INFO:teuthology.orchestra.run.smithi031.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-22T08:39:42.100 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-09-22T08:39:42.101 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.099+0000 7f7e75a8c640 1 -- 172.21.15.31:0/3810719261 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x7f7e5c04a4f0 msgr2=0x7f7e5c04c990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:39:42.101 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.099+0000 7f7e75a8c640 1 --2- 172.21.15.31:0/3810719261 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x7f7e5c04a4f0 0x7f7e5c04c990 crc :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:39:42.101 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.099+0000 7f7e75a8c640 1 -- 172.21.15.31:0/3810719261 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f7e5c03e710 msgr2=0x7f7e5c040bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:39:42.101 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.099+0000 7f7e75a8c640 1 --2- 172.21.15.31:0/3810719261 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f7e5c03e710 0x7f7e5c040bd0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f7e64035000 tx=0x7f7e6402f000 comp rx=0 tx=0).stop 2024-09-22T08:39:42.101 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.099+0000 7f7e75a8c640 1 -- 172.21.15.31:0/3810719261 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7e70096630 msgr2=0x7f7e701bfc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:39:42.101 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.099+0000 7f7e75a8c640 1 --2- 172.21.15.31:0/3810719261 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7e70096630 0x7f7e701bfc70 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f7e6000e8c0 tx=0x7f7e6000ed80 comp rx=0 tx=0).stop 2024-09-22T08:39:42.101 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.099+0000 7f7e75a8c640 1 -- 172.21.15.31:0/3810719261 shutdown_connections 2024-09-22T08:39:42.101 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.099+0000 7f7e75a8c640 1 --2- 172.21.15.31:0/3810719261 >> [v2:172.21.15.142:6816/3192108003,v1:172.21.15.142:6817/3192108003] conn(0x7f7e5c04a4f0 0x7f7e5c04c990 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:39:42.101 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.099+0000 7f7e75a8c640 1 --2- 172.21.15.31:0/3810719261 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f7e5c03e710 0x7f7e5c040bd0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:39:42.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.099+0000 7f7e75a8c640 1 --2- 172.21.15.31:0/3810719261 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7e70096630 0x7f7e701bfc70 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:39:42.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.099+0000 7f7e75a8c640 1 -- 172.21.15.31:0/3810719261 >> 172.21.15.31:0/3810719261 conn(0x7f7e7009ac80 msgr2=0x7f7e7009bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:39:42.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.099+0000 7f7e75a8c640 1 -- 172.21.15.31:0/3810719261 shutdown_connections 2024-09-22T08:39:42.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.099+0000 7f7e75a8c640 1 -- 172.21.15.31:0/3810719261 wait complete. 2024-09-22T08:39:42.110 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-22T08:39:42.212 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.211+0000 7f502335d640 1 Processor -- start 2024-09-22T08:39:42.212 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.211+0000 7f502335d640 1 -- start start 2024-09-22T08:39:42.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.212+0000 7f502335d640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f501c12bf10 0x7f501c12c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:39:42.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.212+0000 7f502335d640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f501c06fdd0 con 0x7f501c12c830 2024-09-22T08:39:42.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.212+0000 7f502335d640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f501c070bb0 con 0x7f501c12bf10 2024-09-22T08:39:42.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.212+0000 7f50210f9640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f501c12bf10 0x7f501c12c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:39:42.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.212+0000 7f50208f8640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f501c12c830 0x7f501c06e170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:60636/0 (socket says 172.21.15.31:60636) 2024-09-22T08:39:42.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.212+0000 7f50208f8640 1 -- 172.21.15.31:0/1089416150 learned_addr learned my addr 172.21.15.31:0/1089416150 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-22T08:39:42.214 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.212+0000 7f50210f9640 1 -- 172.21.15.31:0/1089416150 >> v1:172.21.15.31:6789/0 conn(0x7f501c12c830 legacy=0x7f501c06e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:39:42.214 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.212+0000 7f50210f9640 1 -- 172.21.15.31:0/1089416150 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f501c06f8b0 con 0x7f501c12bf10 2024-09-22T08:39:42.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.213+0000 7f50210f9640 1 --2- 172.21.15.31:0/1089416150 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f501c12bf10 0x7f501c12c2f0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f501800a8c0 tx=0x7f501802b4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22a7f26ff59c0b39 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:39:42.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.213+0000 7f5013fff640 1 -- 172.21.15.31:0/1089416150 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f501800b040 con 0x7f501c12bf10 2024-09-22T08:39:42.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.213+0000 7f5013fff640 1 -- 172.21.15.31:0/1089416150 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5018030640 con 0x7f501c12bf10 2024-09-22T08:39:42.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.213+0000 7f5013fff640 1 -- 172.21.15.31:0/1089416150 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5018030940 con 0x7f501c12bf10 2024-09-22T08:39:42.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.213+0000 7f502335d640 1 -- 172.21.15.31:0/1089416150 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f501c12bf10 msgr2=0x7f501c12c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:39:42.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.213+0000 7f502335d640 1 --2- 172.21.15.31:0/1089416150 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f501c12bf10 0x7f501c12c2f0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f501800a8c0 tx=0x7f501802b4d0 comp rx=0 tx=0).stop 2024-09-22T08:39:42.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.214+0000 7f502335d640 1 -- 172.21.15.31:0/1089416150 shutdown_connections 2024-09-22T08:39:42.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.214+0000 7f502335d640 1 --2- 172.21.15.31:0/1089416150 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f501c12bf10 0x7f501c12c2f0 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:39:42.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.214+0000 7f502335d640 1 -- 172.21.15.31:0/1089416150 >> 172.21.15.31:0/1089416150 conn(0x7f501c09ac80 msgr2=0x7f501c098550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:39:42.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.214+0000 7f502335d640 1 -- 172.21.15.31:0/1089416150 shutdown_connections 2024-09-22T08:39:42.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.214+0000 7f502335d640 1 -- 172.21.15.31:0/1089416150 wait complete. 2024-09-22T08:39:42.217 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.214+0000 7f502335d640 1 Processor -- start 2024-09-22T08:39:42.217 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.214+0000 7f502335d640 1 -- start start 2024-09-22T08:39:42.217 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.215+0000 7f502335d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f501c12bf10 0x7f501c1bfe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:39:42.217 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.215+0000 7f502335d640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f501c099df0 con 0x7f501c12bf10 2024-09-22T08:39:42.217 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.215+0000 7f50210f9640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f501c12bf10 0x7f501c1bfe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:39:42.217 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.215+0000 7f50210f9640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f501c12bf10 0x7f501c1bfe90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:48288/0 (socket says 172.21.15.31:48288) 2024-09-22T08:39:42.217 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.215+0000 7f50210f9640 1 -- 172.21.15.31:0/1929150480 learned_addr learned my addr 172.21.15.31:0/1929150480 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-22T08:39:42.217 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.215+0000 7f50210f9640 1 -- 172.21.15.31:0/1929150480 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f501c08e2b0 con 0x7f501c12bf10 2024-09-22T08:39:42.218 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.215+0000 7f50210f9640 1 --2- 172.21.15.31:0/1929150480 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f501c12bf10 0x7f501c1bfe90 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f501800a8c0 tx=0x7f50180046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:39:42.218 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.215+0000 7f5011ffb640 1 -- 172.21.15.31:0/1929150480 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5018041070 con 0x7f501c12bf10 2024-09-22T08:39:42.218 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.215+0000 7f5011ffb640 1 -- 172.21.15.31:0/1929150480 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5018033b40 con 0x7f501c12bf10 2024-09-22T08:39:42.218 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.215+0000 7f502335d640 1 -- 172.21.15.31:0/1929150480 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f501c12af60 con 0x7f501c12bf10 2024-09-22T08:39:42.218 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.216+0000 7f5011ffb640 1 -- 172.21.15.31:0/1929150480 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5018033e60 con 0x7f501c12bf10 2024-09-22T08:39:42.218 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.216+0000 7f502335d640 1 -- 172.21.15.31:0/1929150480 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f501c08d680 con 0x7f501c12bf10 2024-09-22T08:39:42.219 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.217+0000 7f502335d640 1 -- 172.21.15.31:0/1929150480 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f501c09a2e0 con 0x7f501c12bf10 2024-09-22T08:39:42.219 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.217+0000 7f5011ffb640 1 -- 172.21.15.31:0/1929150480 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f5018044070 con 0x7f501c12bf10 2024-09-22T08:39:42.219 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.217+0000 7f5011ffb640 1 --2- 172.21.15.31:0/1929150480 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f500003e710 0x7f5000040bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:39:42.219 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.217+0000 7f5011ffb640 1 -- 172.21.15.31:0/1929150480 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5938+0+0 (secure 0 0 0) 0x7f50180743b0 con 0x7f501c12bf10 2024-09-22T08:39:42.219 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.217+0000 7f50208f8640 1 --2- 172.21.15.31:0/1929150480 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f500003e710 0x7f5000040bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:39:42.219 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.218+0000 7f50208f8640 1 --2- 172.21.15.31:0/1929150480 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f500003e710 0x7f5000040bd0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f500c000f60 tx=0x7f500c007ae0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:39:42.223 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.222+0000 7f5011ffb640 1 -- 172.21.15.31:0/1929150480 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f501804e350 con 0x7f501c12bf10 2024-09-22T08:39:42.411 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.410+0000 7f502335d640 1 -- 172.21.15.31:0/1929150480 --> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f501c08dc60 con 0x7f500003e710 2024-09-22T08:39:42.412 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.411+0000 7f5011ffb640 1 -- 172.21.15.31:0/1929150480 <== mgr.4099 v2:172.21.15.142:6824/99931088 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f500c005870 con 0x7f500003e710 2024-09-22T08:39:42.412 INFO:teuthology.orchestra.run.smithi031.stderr:instructed osd(s) 1 to deep-scrub 2024-09-22T08:39:42.414 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.413+0000 7f502335d640 1 -- 172.21.15.31:0/1929150480 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f500003e710 msgr2=0x7f5000040bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:39:42.414 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.413+0000 7f502335d640 1 --2- 172.21.15.31:0/1929150480 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f500003e710 0x7f5000040bd0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f500c000f60 tx=0x7f500c007ae0 comp rx=0 tx=0).stop 2024-09-22T08:39:42.415 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.413+0000 7f502335d640 1 -- 172.21.15.31:0/1929150480 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f501c12bf10 msgr2=0x7f501c1bfe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:39:42.415 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.413+0000 7f502335d640 1 --2- 172.21.15.31:0/1929150480 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f501c12bf10 0x7f501c1bfe90 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f501800a8c0 tx=0x7f50180046c0 comp rx=0 tx=0).stop 2024-09-22T08:39:42.415 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.413+0000 7f502335d640 1 -- 172.21.15.31:0/1929150480 shutdown_connections 2024-09-22T08:39:42.415 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.413+0000 7f502335d640 1 --2- 172.21.15.31:0/1929150480 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f500003e710 0x7f5000040bd0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:39:42.415 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.413+0000 7f502335d640 1 --2- 172.21.15.31:0/1929150480 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f501c12bf10 0x7f501c1bfe90 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:39:42.415 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.413+0000 7f502335d640 1 -- 172.21.15.31:0/1929150480 >> 172.21.15.31:0/1929150480 conn(0x7f501c09ac80 msgr2=0x7f501c09ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:39:42.415 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.413+0000 7f502335d640 1 -- 172.21.15.31:0/1929150480 shutdown_connections 2024-09-22T08:39:42.415 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.413+0000 7f502335d640 1 -- 172.21.15.31:0/1929150480 wait complete. 2024-09-22T08:39:42.424 INFO:tasks.ceph:Scrubbing osd.2 2024-09-22T08:39:42.424 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-22T08:39:42.530 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.528+0000 7f109d6cd640 1 Processor -- start 2024-09-22T08:39:42.530 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.528+0000 7f109d6cd640 1 -- start start 2024-09-22T08:39:42.530 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.529+0000 7f109d6cd640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f1098099770 0x7f1098099b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:39:42.530 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.529+0000 7f109d6cd640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f109809e520 con 0x7f109809ae60 2024-09-22T08:39:42.530 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.529+0000 7f109d6cd640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f109809a810 con 0x7f1098099770 2024-09-22T08:39:42.530 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.529+0000 7f1096ffd640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f1098099770 0x7f1098099b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:39:42.531 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.529+0000 7f10967fc640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f109809ae60 0x7f1098098450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:60652/0 (socket says 172.21.15.31:60652) 2024-09-22T08:39:42.531 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.529+0000 7f10967fc640 1 -- 172.21.15.31:0/1936491797 learned_addr learned my addr 172.21.15.31:0/1936491797 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-22T08:39:42.531 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.529+0000 7f1096ffd640 1 -- 172.21.15.31:0/1936491797 >> v1:172.21.15.31:6789/0 conn(0x7f109809ae60 legacy=0x7f1098098450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:39:42.531 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.529+0000 7f1096ffd640 1 -- 172.21.15.31:0/1936491797 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f109809e7e0 con 0x7f1098099770 2024-09-22T08:39:42.532 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.530+0000 7f1096ffd640 1 --2- 172.21.15.31:0/1936491797 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1098099770 0x7f1098099b50 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f1088009dc0 tx=0x7f108802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa55f6d8ba2cdffe server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:39:42.532 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.530+0000 7f1095ffb640 1 -- 172.21.15.31:0/1936491797 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1088007670 con 0x7f1098099770 2024-09-22T08:39:42.532 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.530+0000 7f1095ffb640 1 -- 172.21.15.31:0/1936491797 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1088007810 con 0x7f1098099770 2024-09-22T08:39:42.532 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.530+0000 7f1095ffb640 1 -- 172.21.15.31:0/1936491797 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1088007b10 con 0x7f1098099770 2024-09-22T08:39:42.532 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.530+0000 7f109d6cd640 1 -- 172.21.15.31:0/1936491797 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1098099770 msgr2=0x7f1098099b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:39:42.532 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.530+0000 7f109d6cd640 1 --2- 172.21.15.31:0/1936491797 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1098099770 0x7f1098099b50 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f1088009dc0 tx=0x7f108802a6a0 comp rx=0 tx=0).stop 2024-09-22T08:39:42.532 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.531+0000 7f109d6cd640 1 -- 172.21.15.31:0/1936491797 shutdown_connections 2024-09-22T08:39:42.532 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.531+0000 7f109d6cd640 1 --2- 172.21.15.31:0/1936491797 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1098099770 0x7f1098099b50 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:39:42.532 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.531+0000 7f109d6cd640 1 -- 172.21.15.31:0/1936491797 >> 172.21.15.31:0/1936491797 conn(0x7f109809f2c0 msgr2=0x7f109809cb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:39:42.532 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.531+0000 7f109d6cd640 1 -- 172.21.15.31:0/1936491797 shutdown_connections 2024-09-22T08:39:42.532 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.531+0000 7f109d6cd640 1 -- 172.21.15.31:0/1936491797 wait complete. 2024-09-22T08:39:42.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.532+0000 7f109d6cd640 1 Processor -- start 2024-09-22T08:39:42.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.532+0000 7f109d6cd640 1 -- start start 2024-09-22T08:39:42.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.532+0000 7f109d6cd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1098099770 0x7f10981295c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:39:42.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.532+0000 7f109d6cd640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f109809a420 con 0x7f1098099770 2024-09-22T08:39:42.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.532+0000 7f1096ffd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1098099770 0x7f10981295c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:39:42.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.532+0000 7f1096ffd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1098099770 0x7f10981295c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:48302/0 (socket says 172.21.15.31:48302) 2024-09-22T08:39:42.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.532+0000 7f1096ffd640 1 -- 172.21.15.31:0/1335196611 learned_addr learned my addr 172.21.15.31:0/1335196611 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-22T08:39:42.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.532+0000 7f1096ffd640 1 -- 172.21.15.31:0/1335196611 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f109812b910 con 0x7f1098099770 2024-09-22T08:39:42.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.532+0000 7f1096ffd640 1 --2- 172.21.15.31:0/1335196611 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1098099770 0x7f10981295c0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f1088009ee0 tx=0x7f1088004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:39:42.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.533+0000 7f107f7fe640 1 -- 172.21.15.31:0/1335196611 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1088040070 con 0x7f1098099770 2024-09-22T08:39:42.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.533+0000 7f107f7fe640 1 -- 172.21.15.31:0/1335196611 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10880079c0 con 0x7f1098099770 2024-09-22T08:39:42.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.533+0000 7f109d6cd640 1 -- 172.21.15.31:0/1335196611 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f109812c910 con 0x7f1098099770 2024-09-22T08:39:42.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.533+0000 7f107f7fe640 1 -- 172.21.15.31:0/1335196611 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1088007670 con 0x7f1098099770 2024-09-22T08:39:42.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.533+0000 7f109d6cd640 1 -- 172.21.15.31:0/1335196611 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f109812bd60 con 0x7f1098099770 2024-09-22T08:39:42.536 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.533+0000 7f109d6cd640 1 -- 172.21.15.31:0/1335196611 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1098099b50 con 0x7f1098099770 2024-09-22T08:39:42.536 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.534+0000 7f107f7fe640 1 -- 172.21.15.31:0/1335196611 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f1088039040 con 0x7f1098099770 2024-09-22T08:39:42.536 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.534+0000 7f107f7fe640 1 --2- 172.21.15.31:0/1335196611 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f108403e6a0 0x7f1084040b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:39:42.536 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.534+0000 7f107f7fe640 1 -- 172.21.15.31:0/1335196611 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5938+0+0 (secure 0 0 0) 0x7f108802ae00 con 0x7f1098099770 2024-09-22T08:39:42.536 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.534+0000 7f107f7fe640 1 --2- 172.21.15.31:0/1335196611 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f108404a420 0x7f108404c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:39:42.536 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.534+0000 7f107f7fe640 1 -- 172.21.15.31:0/1335196611 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1088047e80 con 0x7f108404a420 2024-09-22T08:39:42.536 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.534+0000 7f107f7fe640 1 -- 172.21.15.31:0/1335196611 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f108807c050 con 0x7f1098099770 2024-09-22T08:39:42.536 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.534+0000 7f10967fc640 1 --2- 172.21.15.31:0/1335196611 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f108403e6a0 0x7f1084040b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:39:42.536 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.534+0000 7f10977fe640 1 --2- 172.21.15.31:0/1335196611 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f108404a420 0x7f108404c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:39:42.536 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.535+0000 7f10967fc640 1 --2- 172.21.15.31:0/1335196611 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f108403e6a0 0x7f1084040b60 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f108c000f60 tx=0x7f108c007ae0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:39:42.537 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.535+0000 7f10977fe640 1 --2- 172.21.15.31:0/1335196611 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f108404a420 0x7f108404c8c0 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:39:42.537 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.536+0000 7f107f7fe640 1 -- 172.21.15.31:0/1335196611 <== osd.2 v2:172.21.15.142:6808/279438927 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f1088047e80 con 0x7f108404a420 2024-09-22T08:39:42.549 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.548+0000 7f109d6cd640 1 -- 172.21.15.31:0/1335196611 --> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f109809c240 con 0x7f108404a420 2024-09-22T08:39:42.549 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.548+0000 7f107f7fe640 1 -- 172.21.15.31:0/1335196611 <== osd.2 v2:172.21.15.142:6808/279438927 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f10900097a0 con 0x7f108404a420 2024-09-22T08:39:42.550 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-09-22T08:39:42.550 INFO:teuthology.orchestra.run.smithi031.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-22T08:39:42.550 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-09-22T08:39:42.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.549+0000 7f109d6cd640 1 -- 172.21.15.31:0/1335196611 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f108404a420 msgr2=0x7f108404c8c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:39:42.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.549+0000 7f109d6cd640 1 --2- 172.21.15.31:0/1335196611 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f108404a420 0x7f108404c8c0 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:39:42.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.549+0000 7f109d6cd640 1 -- 172.21.15.31:0/1335196611 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f108403e6a0 msgr2=0x7f1084040b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:39:42.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.549+0000 7f109d6cd640 1 --2- 172.21.15.31:0/1335196611 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f108403e6a0 0x7f1084040b60 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f108c000f60 tx=0x7f108c007ae0 comp rx=0 tx=0).stop 2024-09-22T08:39:42.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.549+0000 7f109d6cd640 1 -- 172.21.15.31:0/1335196611 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1098099770 msgr2=0x7f10981295c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:39:42.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.549+0000 7f109d6cd640 1 --2- 172.21.15.31:0/1335196611 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1098099770 0x7f10981295c0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f1088009ee0 tx=0x7f1088004a40 comp rx=0 tx=0).stop 2024-09-22T08:39:42.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.549+0000 7f109d6cd640 1 -- 172.21.15.31:0/1335196611 shutdown_connections 2024-09-22T08:39:42.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.549+0000 7f109d6cd640 1 --2- 172.21.15.31:0/1335196611 >> [v2:172.21.15.142:6808/279438927,v1:172.21.15.142:6809/279438927] conn(0x7f108404a420 0x7f108404c8c0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:39:42.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.549+0000 7f109d6cd640 1 --2- 172.21.15.31:0/1335196611 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f108403e6a0 0x7f1084040b60 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:39:42.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.549+0000 7f109d6cd640 1 --2- 172.21.15.31:0/1335196611 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1098099770 0x7f10981295c0 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:39:42.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.549+0000 7f109d6cd640 1 -- 172.21.15.31:0/1335196611 >> 172.21.15.31:0/1335196611 conn(0x7f109809f2c0 msgr2=0x7f109812fa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:39:42.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.549+0000 7f109d6cd640 1 -- 172.21.15.31:0/1335196611 shutdown_connections 2024-09-22T08:39:42.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.549+0000 7f109d6cd640 1 -- 172.21.15.31:0/1335196611 wait complete. 2024-09-22T08:39:42.560 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-22T08:39:42.662 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.660+0000 7f0d2ade8640 1 Processor -- start 2024-09-22T08:39:42.662 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.660+0000 7f0d2ade8640 1 -- start start 2024-09-22T08:39:42.662 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.661+0000 7f0d2ade8640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f0d24071e30 0x7f0d24132790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:39:42.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.661+0000 7f0d2ade8640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d24071770 con 0x7f0d2406e170 2024-09-22T08:39:42.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.661+0000 7f0d2ade8640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f0d24099ee0 con 0x7f0d24071e30 2024-09-22T08:39:42.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.661+0000 7f0d23fff640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f0d24071e30 0x7f0d24132790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:39:42.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.661+0000 7f0d28b84640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f0d2406e170 0x7f0d2406e550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:60656/0 (socket says 172.21.15.31:60656) 2024-09-22T08:39:42.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.661+0000 7f0d28b84640 1 -- 172.21.15.31:0/201516055 learned_addr learned my addr 172.21.15.31:0/201516055 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-22T08:39:42.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.661+0000 7f0d23fff640 1 -- 172.21.15.31:0/201516055 >> v1:172.21.15.31:6789/0 conn(0x7f0d2406e170 legacy=0x7f0d2406e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:39:42.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.661+0000 7f0d23fff640 1 -- 172.21.15.31:0/201516055 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d24072530 con 0x7f0d24071e30 2024-09-22T08:39:42.664 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.662+0000 7f0d23fff640 1 --2- 172.21.15.31:0/201516055 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d24071e30 0x7f0d24132790 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f0d10009750 tx=0x7f0d1002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8dca0fdf628ce2a server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:39:42.664 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.662+0000 7f0d237fe640 1 -- 172.21.15.31:0/201516055 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d10037070 con 0x7f0d24071e30 2024-09-22T08:39:42.664 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.662+0000 7f0d237fe640 1 -- 172.21.15.31:0/201516055 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d1002ad80 con 0x7f0d24071e30 2024-09-22T08:39:42.664 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.662+0000 7f0d237fe640 1 -- 172.21.15.31:0/201516055 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d10032590 con 0x7f0d24071e30 2024-09-22T08:39:42.664 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.663+0000 7f0d2ade8640 1 -- 172.21.15.31:0/201516055 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d24071e30 msgr2=0x7f0d24132790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:39:42.665 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.663+0000 7f0d2ade8640 1 --2- 172.21.15.31:0/201516055 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d24071e30 0x7f0d24132790 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f0d10009750 tx=0x7f0d1002a140 comp rx=0 tx=0).stop 2024-09-22T08:39:42.665 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.663+0000 7f0d2ade8640 1 -- 172.21.15.31:0/201516055 shutdown_connections 2024-09-22T08:39:42.665 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.663+0000 7f0d2ade8640 1 --2- 172.21.15.31:0/201516055 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d24071e30 0x7f0d24132790 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:39:42.665 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.663+0000 7f0d2ade8640 1 -- 172.21.15.31:0/201516055 >> 172.21.15.31:0/201516055 conn(0x7f0d2409ac80 msgr2=0x7f0d24098550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:39:42.665 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.663+0000 7f0d2ade8640 1 -- 172.21.15.31:0/201516055 shutdown_connections 2024-09-22T08:39:42.665 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.663+0000 7f0d2ade8640 1 -- 172.21.15.31:0/201516055 wait complete. 2024-09-22T08:39:42.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.664+0000 7f0d2ade8640 1 Processor -- start 2024-09-22T08:39:42.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.664+0000 7f0d2ade8640 1 -- start start 2024-09-22T08:39:42.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.664+0000 7f0d2ade8640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d2406e170 0x7f0d24129380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:39:42.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.664+0000 7f0d2ade8640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f0d2406ee70 con 0x7f0d2406e170 2024-09-22T08:39:42.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.664+0000 7f0d28b84640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d2406e170 0x7f0d24129380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:39:42.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.664+0000 7f0d28b84640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d2406e170 0x7f0d24129380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:48310/0 (socket says 172.21.15.31:48310) 2024-09-22T08:39:42.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.664+0000 7f0d28b84640 1 -- 172.21.15.31:0/1119440811 learned_addr learned my addr 172.21.15.31:0/1119440811 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-22T08:39:42.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.664+0000 7f0d28b84640 1 -- 172.21.15.31:0/1119440811 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d24074170 con 0x7f0d2406e170 2024-09-22T08:39:42.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.665+0000 7f0d28b84640 1 --2- 172.21.15.31:0/1119440811 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d2406e170 0x7f0d24129380 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f0d1800c480 tx=0x7f0d1800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:39:42.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.665+0000 7f0d217fa640 1 -- 172.21.15.31:0/1119440811 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d18017070 con 0x7f0d2406e170 2024-09-22T08:39:42.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.665+0000 7f0d217fa640 1 -- 172.21.15.31:0/1119440811 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d18005c10 con 0x7f0d2406e170 2024-09-22T08:39:42.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.665+0000 7f0d2ade8640 1 -- 172.21.15.31:0/1119440811 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d240711a0 con 0x7f0d2406e170 2024-09-22T08:39:42.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.665+0000 7f0d217fa640 1 -- 172.21.15.31:0/1119440811 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d18007070 con 0x7f0d2406e170 2024-09-22T08:39:42.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.665+0000 7f0d2ade8640 1 -- 172.21.15.31:0/1119440811 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d241298c0 con 0x7f0d2406e170 2024-09-22T08:39:42.668 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.666+0000 7f0d217fa640 1 -- 172.21.15.31:0/1119440811 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f0d1801a070 con 0x7f0d2406e170 2024-09-22T08:39:42.668 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.666+0000 7f0d2ade8640 1 -- 172.21.15.31:0/1119440811 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d24070f90 con 0x7f0d2406e170 2024-09-22T08:39:42.668 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.666+0000 7f0d217fa640 1 --2- 172.21.15.31:0/1119440811 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f0d0803e710 0x7f0d08040bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:39:42.668 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.666+0000 7f0d217fa640 1 -- 172.21.15.31:0/1119440811 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5938+0+0 (secure 0 0 0) 0x7f0d18052990 con 0x7f0d2406e170 2024-09-22T08:39:42.668 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.666+0000 7f0d23fff640 1 --2- 172.21.15.31:0/1119440811 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f0d0803e710 0x7f0d08040bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:39:42.668 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.667+0000 7f0d23fff640 1 --2- 172.21.15.31:0/1119440811 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f0d0803e710 0x7f0d08040bd0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f0d10034000 tx=0x7f0d1002e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:39:42.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.670+0000 7f0d217fa640 1 -- 172.21.15.31:0/1119440811 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f0d18019cd0 con 0x7f0d2406e170 2024-09-22T08:39:42.857 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.856+0000 7f0d2ade8640 1 -- 172.21.15.31:0/1119440811 --> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7f0d2406e550 con 0x7f0d0803e710 2024-09-22T08:39:42.858 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.857+0000 7f0d217fa640 1 -- 172.21.15.31:0/1119440811 <== mgr.4099 v2:172.21.15.142:6824/99931088 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f0d2406e550 con 0x7f0d0803e710 2024-09-22T08:39:42.858 INFO:teuthology.orchestra.run.smithi031.stderr:instructed osd(s) 2 to deep-scrub 2024-09-22T08:39:42.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.859+0000 7f0d2ade8640 1 -- 172.21.15.31:0/1119440811 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f0d0803e710 msgr2=0x7f0d08040bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:39:42.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.859+0000 7f0d2ade8640 1 --2- 172.21.15.31:0/1119440811 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f0d0803e710 0x7f0d08040bd0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f0d10034000 tx=0x7f0d1002e000 comp rx=0 tx=0).stop 2024-09-22T08:39:42.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.859+0000 7f0d2ade8640 1 -- 172.21.15.31:0/1119440811 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d2406e170 msgr2=0x7f0d24129380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:39:42.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.859+0000 7f0d2ade8640 1 --2- 172.21.15.31:0/1119440811 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d2406e170 0x7f0d24129380 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f0d1800c480 tx=0x7f0d1800c940 comp rx=0 tx=0).stop 2024-09-22T08:39:42.861 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.859+0000 7f0d2ade8640 1 -- 172.21.15.31:0/1119440811 shutdown_connections 2024-09-22T08:39:42.861 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.859+0000 7f0d2ade8640 1 --2- 172.21.15.31:0/1119440811 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f0d0803e710 0x7f0d08040bd0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:39:42.861 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.859+0000 7f0d2ade8640 1 --2- 172.21.15.31:0/1119440811 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d2406e170 0x7f0d24129380 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:39:42.861 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.859+0000 7f0d2ade8640 1 -- 172.21.15.31:0/1119440811 >> 172.21.15.31:0/1119440811 conn(0x7f0d2409ac80 msgr2=0x7f0d24097280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:39:42.861 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.859+0000 7f0d2ade8640 1 -- 172.21.15.31:0/1119440811 shutdown_connections 2024-09-22T08:39:42.861 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.859+0000 7f0d2ade8640 1 -- 172.21.15.31:0/1119440811 wait complete. 2024-09-22T08:39:42.871 INFO:tasks.ceph:Scrubbing osd.3 2024-09-22T08:39:42.871 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-22T08:39:42.976 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.975+0000 7f02a1bc6640 1 Processor -- start 2024-09-22T08:39:42.976 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.975+0000 7f02a1bc6640 1 -- start start 2024-09-22T08:39:42.977 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.975+0000 7f02a1bc6640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f029c094420 0x7f029c094800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:39:42.977 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.975+0000 7f02a1bc6640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f029c06e5f0 con 0x7f029c12c090 2024-09-22T08:39:42.977 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.975+0000 7f02a1bc6640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f029c09a4b0 con 0x7f029c094420 2024-09-22T08:39:42.977 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.975+0000 7f029b7fe640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f029c094420 0x7f029c094800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:39:42.977 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.975+0000 7f029affd640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f029c12c090 0x7f029c12c520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:60664/0 (socket says 172.21.15.31:60664) 2024-09-22T08:39:42.977 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.975+0000 7f029affd640 1 -- 172.21.15.31:0/763584841 learned_addr learned my addr 172.21.15.31:0/763584841 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-22T08:39:42.977 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.976+0000 7f029b7fe640 1 -- 172.21.15.31:0/763584841 >> v1:172.21.15.31:6789/0 conn(0x7f029c12c090 legacy=0x7f029c12c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:39:42.977 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.976+0000 7f029b7fe640 1 -- 172.21.15.31:0/763584841 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f029c099e00 con 0x7f029c094420 2024-09-22T08:39:42.978 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.976+0000 7f029b7fe640 1 --2- 172.21.15.31:0/763584841 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f029c094420 0x7f029c094800 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f028c009720 tx=0x7f028c02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bec630eb9055b919 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:39:42.978 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.976+0000 7f029a7fc640 1 -- 172.21.15.31:0/763584841 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f028c037070 con 0x7f029c094420 2024-09-22T08:39:42.978 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.976+0000 7f029a7fc640 1 -- 172.21.15.31:0/763584841 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f028c02ae20 con 0x7f029c094420 2024-09-22T08:39:42.978 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.976+0000 7f029a7fc640 1 -- 172.21.15.31:0/763584841 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f028c032590 con 0x7f029c094420 2024-09-22T08:39:42.978 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.977+0000 7f02a1bc6640 1 -- 172.21.15.31:0/763584841 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f029c094420 msgr2=0x7f029c094800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:39:42.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.977+0000 7f02a1bc6640 1 --2- 172.21.15.31:0/763584841 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f029c094420 0x7f029c094800 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f028c009720 tx=0x7f028c02a1a0 comp rx=0 tx=0).stop 2024-09-22T08:39:42.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.977+0000 7f02a1bc6640 1 -- 172.21.15.31:0/763584841 shutdown_connections 2024-09-22T08:39:42.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.977+0000 7f02a1bc6640 1 --2- 172.21.15.31:0/763584841 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f029c094420 0x7f029c094800 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:39:42.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.977+0000 7f02a1bc6640 1 -- 172.21.15.31:0/763584841 >> 172.21.15.31:0/763584841 conn(0x7f029c09ac80 msgr2=0x7f029c09b090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:39:42.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.977+0000 7f02a1bc6640 1 -- 172.21.15.31:0/763584841 shutdown_connections 2024-09-22T08:39:42.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.977+0000 7f02a1bc6640 1 -- 172.21.15.31:0/763584841 wait complete. 2024-09-22T08:39:42.980 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.978+0000 7f02a1bc6640 1 Processor -- start 2024-09-22T08:39:42.980 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.978+0000 7f02a1bc6640 1 -- start start 2024-09-22T08:39:42.980 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.978+0000 7f02a1bc6640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f029c094420 0x7f029c1c2200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:39:42.980 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.978+0000 7f02a1bc6640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f029c094d40 con 0x7f029c094420 2024-09-22T08:39:42.981 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.978+0000 7f029b7fe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f029c094420 0x7f029c1c2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:39:42.981 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.979+0000 7f029b7fe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f029c094420 0x7f029c1c2200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:48330/0 (socket says 172.21.15.31:48330) 2024-09-22T08:39:42.981 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.979+0000 7f029b7fe640 1 -- 172.21.15.31:0/3729348564 learned_addr learned my addr 172.21.15.31:0/3729348564 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-22T08:39:42.981 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.979+0000 7f029b7fe640 1 -- 172.21.15.31:0/3729348564 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f029c073e80 con 0x7f029c094420 2024-09-22T08:39:42.981 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.979+0000 7f029b7fe640 1 --2- 172.21.15.31:0/3729348564 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f029c094420 0x7f029c1c2200 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f028c02adf0 tx=0x7f028c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:39:42.981 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.979+0000 7f0283fff640 1 -- 172.21.15.31:0/3729348564 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f028c041070 con 0x7f029c094420 2024-09-22T08:39:42.981 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.979+0000 7f0283fff640 1 -- 172.21.15.31:0/3729348564 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f028c03c590 con 0x7f029c094420 2024-09-22T08:39:42.981 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.979+0000 7f02a1bc6640 1 -- 172.21.15.31:0/3729348564 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f029c123fe0 con 0x7f029c094420 2024-09-22T08:39:42.981 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.979+0000 7f0283fff640 1 -- 172.21.15.31:0/3729348564 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f028c037040 con 0x7f029c094420 2024-09-22T08:39:42.981 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.979+0000 7f02a1bc6640 1 -- 172.21.15.31:0/3729348564 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f029c1c2920 con 0x7f029c094420 2024-09-22T08:39:42.982 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.980+0000 7f02a1bc6640 1 -- 172.21.15.31:0/3729348564 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f029c1231a0 con 0x7f029c094420 2024-09-22T08:39:42.982 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.980+0000 7f0283fff640 1 -- 172.21.15.31:0/3729348564 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f028c044070 con 0x7f029c094420 2024-09-22T08:39:42.982 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.980+0000 7f0283fff640 1 --2- 172.21.15.31:0/3729348564 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f028803e740 0x7f0288040c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:39:42.982 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.980+0000 7f0283fff640 1 -- 172.21.15.31:0/3729348564 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5938+0+0 (secure 0 0 0) 0x7f028c074080 con 0x7f029c094420 2024-09-22T08:39:42.983 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.980+0000 7f0283fff640 1 --2- 172.21.15.31:0/3729348564 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x7f028804a520 0x7f028804c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:39:42.983 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.980+0000 7f0283fff640 1 -- 172.21.15.31:0/3729348564 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f028804d090 con 0x7f028804a520 2024-09-22T08:39:42.983 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.980+0000 7f0283fff640 1 -- 172.21.15.31:0/3729348564 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f028c07b050 con 0x7f029c094420 2024-09-22T08:39:42.983 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.981+0000 7f029affd640 1 --2- 172.21.15.31:0/3729348564 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f028803e740 0x7f0288040c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:39:42.983 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.981+0000 7f029bfff640 1 --2- 172.21.15.31:0/3729348564 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x7f028804a520 0x7f028804c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:39:42.983 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.981+0000 7f029bfff640 1 --2- 172.21.15.31:0/3729348564 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x7f028804a520 0x7f028804c9c0 crc :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:39:42.983 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.981+0000 7f029affd640 1 --2- 172.21.15.31:0/3729348564 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f028803e740 0x7f0288040c00 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f0290007fd0 tx=0x7f0290007aa0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:39:42.983 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.982+0000 7f0283fff640 1 -- 172.21.15.31:0/3729348564 <== osd.3 v2:172.21.15.142:6800/1064901393 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f028804d090 con 0x7f028804a520 2024-09-22T08:39:42.995 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.994+0000 7f02a1bc6640 1 -- 172.21.15.31:0/3729348564 --> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f029c094800 con 0x7f028804a520 2024-09-22T08:39:42.996 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.995+0000 7f0283fff640 1 -- 172.21.15.31:0/3729348564 <== osd.3 v2:172.21.15.142:6800/1064901393 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f029c094800 con 0x7f028804a520 2024-09-22T08:39:42.996 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-09-22T08:39:42.996 INFO:teuthology.orchestra.run.smithi031.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-22T08:39:42.996 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-09-22T08:39:42.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.995+0000 7f02a1bc6640 1 -- 172.21.15.31:0/3729348564 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x7f028804a520 msgr2=0x7f028804c9c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:39:42.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.995+0000 7f02a1bc6640 1 --2- 172.21.15.31:0/3729348564 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x7f028804a520 0x7f028804c9c0 crc :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:39:42.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.995+0000 7f02a1bc6640 1 -- 172.21.15.31:0/3729348564 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f028803e740 msgr2=0x7f0288040c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:39:42.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.995+0000 7f02a1bc6640 1 --2- 172.21.15.31:0/3729348564 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f028803e740 0x7f0288040c00 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f0290007fd0 tx=0x7f0290007aa0 comp rx=0 tx=0).stop 2024-09-22T08:39:42.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.995+0000 7f02a1bc6640 1 -- 172.21.15.31:0/3729348564 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f029c094420 msgr2=0x7f029c1c2200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:39:42.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.995+0000 7f02a1bc6640 1 --2- 172.21.15.31:0/3729348564 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f029c094420 0x7f029c1c2200 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f028c02adf0 tx=0x7f028c0046c0 comp rx=0 tx=0).stop 2024-09-22T08:39:42.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.995+0000 7f02a1bc6640 1 -- 172.21.15.31:0/3729348564 shutdown_connections 2024-09-22T08:39:42.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.995+0000 7f02a1bc6640 1 --2- 172.21.15.31:0/3729348564 >> [v2:172.21.15.142:6800/1064901393,v1:172.21.15.142:6801/1064901393] conn(0x7f028804a520 0x7f028804c9c0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:39:42.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.995+0000 7f02a1bc6640 1 --2- 172.21.15.31:0/3729348564 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f028803e740 0x7f0288040c00 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:39:42.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.995+0000 7f02a1bc6640 1 --2- 172.21.15.31:0/3729348564 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f029c094420 0x7f029c1c2200 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:39:42.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.995+0000 7f02a1bc6640 1 -- 172.21.15.31:0/3729348564 >> 172.21.15.31:0/3729348564 conn(0x7f029c09ac80 msgr2=0x7f029c095a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:39:42.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.995+0000 7f02a1bc6640 1 -- 172.21.15.31:0/3729348564 shutdown_connections 2024-09-22T08:39:42.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:42.995+0000 7f02a1bc6640 1 -- 172.21.15.31:0/3729348564 wait complete. 2024-09-22T08:39:43.006 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-22T08:39:43.108 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:43.107+0000 7fbe649fb640 1 Processor -- start 2024-09-22T08:39:43.109 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:43.107+0000 7fbe649fb640 1 -- start start 2024-09-22T08:39:43.109 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:43.107+0000 7fbe649fb640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fbe6006f280 0x7fbe6006f660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:39:43.109 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:43.107+0000 7fbe649fb640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe60099ee0 con 0x7fbe6006fba0 2024-09-22T08:39:43.109 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:43.107+0000 7fbe649fb640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7fbe60070d00 con 0x7fbe6006f280 2024-09-22T08:39:43.109 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:43.107+0000 7fbe5e59c640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fbe6006f280 0x7fbe6006f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:39:43.109 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:43.107+0000 7fbe55d9b640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fbe6006fba0 0x7fbe60097070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:60676/0 (socket says 172.21.15.31:60676) 2024-09-22T08:39:43.109 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:43.107+0000 7fbe55d9b640 1 -- 172.21.15.31:0/494727987 learned_addr learned my addr 172.21.15.31:0/494727987 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-22T08:39:43.109 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:43.108+0000 7fbe5e59c640 1 -- 172.21.15.31:0/494727987 >> v1:172.21.15.31:6789/0 conn(0x7fbe6006fba0 legacy=0x7fbe60097070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:39:43.109 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:43.108+0000 7fbe5e59c640 1 -- 172.21.15.31:0/494727987 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe60070f40 con 0x7fbe6006f280 2024-09-22T08:39:43.110 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:43.108+0000 7fbe5e59c640 1 --2- 172.21.15.31:0/494727987 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbe6006f280 0x7fbe6006f660 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7fbe50009720 tx=0x7fbe5002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2c5c1983f3e78af server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:39:43.110 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:43.108+0000 7fbe5dd9b640 1 -- 172.21.15.31:0/494727987 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe50037070 con 0x7fbe6006f280 2024-09-22T08:39:43.111 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:43.108+0000 7fbe5dd9b640 1 -- 172.21.15.31:0/494727987 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe5002ad90 con 0x7fbe6006f280 2024-09-22T08:39:43.111 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:43.108+0000 7fbe5dd9b640 1 -- 172.21.15.31:0/494727987 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe50032590 con 0x7fbe6006f280 2024-09-22T08:39:43.111 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:43.109+0000 7fbe649fb640 1 -- 172.21.15.31:0/494727987 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbe6006f280 msgr2=0x7fbe6006f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:39:43.111 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:43.109+0000 7fbe649fb640 1 --2- 172.21.15.31:0/494727987 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbe6006f280 0x7fbe6006f660 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7fbe50009720 tx=0x7fbe5002a110 comp rx=0 tx=0).stop 2024-09-22T08:39:43.111 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:43.109+0000 7fbe649fb640 1 -- 172.21.15.31:0/494727987 shutdown_connections 2024-09-22T08:39:43.111 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:43.109+0000 7fbe649fb640 1 --2- 172.21.15.31:0/494727987 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbe6006f280 0x7fbe6006f660 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:39:43.111 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:43.109+0000 7fbe649fb640 1 -- 172.21.15.31:0/494727987 >> 172.21.15.31:0/494727987 conn(0x7fbe6009ac80 msgr2=0x7fbe60098550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:39:43.111 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:43.109+0000 7fbe649fb640 1 -- 172.21.15.31:0/494727987 shutdown_connections 2024-09-22T08:39:43.111 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:43.109+0000 7fbe649fb640 1 -- 172.21.15.31:0/494727987 wait complete. 2024-09-22T08:39:43.113 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:43.110+0000 7fbe649fb640 1 Processor -- start 2024-09-22T08:39:43.113 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:43.110+0000 7fbe649fb640 1 -- start start 2024-09-22T08:39:43.113 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:43.111+0000 7fbe649fb640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbe6006f280 0x7fbe601c4aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:39:43.113 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:43.111+0000 7fbe649fb640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fbe60097780 con 0x7fbe6006f280 2024-09-22T08:39:43.113 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:43.111+0000 7fbe5e59c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbe6006f280 0x7fbe601c4aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:39:43.113 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:43.111+0000 7fbe5e59c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbe6006f280 0x7fbe601c4aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:48344/0 (socket says 172.21.15.31:48344) 2024-09-22T08:39:43.113 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:43.111+0000 7fbe5e59c640 1 -- 172.21.15.31:0/1035953158 learned_addr learned my addr 172.21.15.31:0/1035953158 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-22T08:39:43.113 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:43.111+0000 7fbe5e59c640 1 -- 172.21.15.31:0/1035953158 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe600910b0 con 0x7fbe6006f280 2024-09-22T08:39:43.113 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:43.111+0000 7fbe5e59c640 1 --2- 172.21.15.31:0/1035953158 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbe6006f280 0x7fbe601c4aa0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7fbe50009840 tx=0x7fbe500046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:39:43.113 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:43.111+0000 7fbe577fe640 1 -- 172.21.15.31:0/1035953158 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe50041070 con 0x7fbe6006f280 2024-09-22T08:39:43.113 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:43.111+0000 7fbe577fe640 1 -- 172.21.15.31:0/1035953158 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe5003c460 con 0x7fbe6006f280 2024-09-22T08:39:43.113 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:43.111+0000 7fbe649fb640 1 -- 172.21.15.31:0/1035953158 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe60124210 con 0x7fbe6006f280 2024-09-22T08:39:43.113 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:43.111+0000 7fbe577fe640 1 -- 172.21.15.31:0/1035953158 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe50037040 con 0x7fbe6006f280 2024-09-22T08:39:43.114 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:43.111+0000 7fbe649fb640 1 -- 172.21.15.31:0/1035953158 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe601c4fe0 con 0x7fbe6006f280 2024-09-22T08:39:43.114 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:43.112+0000 7fbe577fe640 1 -- 172.21.15.31:0/1035953158 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fbe50044070 con 0x7fbe6006f280 2024-09-22T08:39:43.114 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:43.112+0000 7fbe649fb640 1 -- 172.21.15.31:0/1035953158 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe6012cb80 con 0x7fbe6006f280 2024-09-22T08:39:43.115 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:43.113+0000 7fbe577fe640 1 --2- 172.21.15.31:0/1035953158 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fbe4003e710 0x7fbe40040bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:39:43.115 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:43.113+0000 7fbe577fe640 1 -- 172.21.15.31:0/1035953158 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5938+0+0 (secure 0 0 0) 0x7fbe50073f20 con 0x7fbe6006f280 2024-09-22T08:39:43.115 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:43.113+0000 7fbe55d9b640 1 --2- 172.21.15.31:0/1035953158 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fbe4003e710 0x7fbe40040bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:39:43.115 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:43.113+0000 7fbe55d9b640 1 --2- 172.21.15.31:0/1035953158 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fbe4003e710 0x7fbe40040bd0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fbe48007fd0 tx=0x7fbe48007aa0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:39:43.118 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:43.117+0000 7fbe577fe640 1 -- 172.21.15.31:0/1035953158 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fbe6012cb80 con 0x7fbe6006f280 2024-09-22T08:39:43.305 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:43.304+0000 7fbe649fb640 1 -- 172.21.15.31:0/1035953158 --> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7fbe6006f990 con 0x7fbe4003e710 2024-09-22T08:39:43.306 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:43.305+0000 7fbe577fe640 1 -- 172.21.15.31:0/1035953158 <== mgr.4099 v2:172.21.15.142:6824/99931088 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fbe6006f990 con 0x7fbe4003e710 2024-09-22T08:39:43.306 INFO:teuthology.orchestra.run.smithi031.stderr:instructed osd(s) 3 to deep-scrub 2024-09-22T08:39:43.309 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:43.307+0000 7fbe649fb640 1 -- 172.21.15.31:0/1035953158 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fbe4003e710 msgr2=0x7fbe40040bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:39:43.309 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:43.307+0000 7fbe649fb640 1 --2- 172.21.15.31:0/1035953158 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fbe4003e710 0x7fbe40040bd0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fbe48007fd0 tx=0x7fbe48007aa0 comp rx=0 tx=0).stop 2024-09-22T08:39:43.309 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:43.308+0000 7fbe649fb640 1 -- 172.21.15.31:0/1035953158 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbe6006f280 msgr2=0x7fbe601c4aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:39:43.309 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:43.308+0000 7fbe649fb640 1 --2- 172.21.15.31:0/1035953158 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbe6006f280 0x7fbe601c4aa0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7fbe50009840 tx=0x7fbe500046c0 comp rx=0 tx=0).stop 2024-09-22T08:39:43.309 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:43.308+0000 7fbe649fb640 1 -- 172.21.15.31:0/1035953158 shutdown_connections 2024-09-22T08:39:43.309 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:43.308+0000 7fbe649fb640 1 --2- 172.21.15.31:0/1035953158 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fbe4003e710 0x7fbe40040bd0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:39:43.309 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:43.308+0000 7fbe649fb640 1 --2- 172.21.15.31:0/1035953158 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbe6006f280 0x7fbe601c4aa0 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:39:43.310 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:43.308+0000 7fbe649fb640 1 -- 172.21.15.31:0/1035953158 >> 172.21.15.31:0/1035953158 conn(0x7fbe6009ac80 msgr2=0x7fbe6006e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:39:43.310 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:43.308+0000 7fbe649fb640 1 -- 172.21.15.31:0/1035953158 shutdown_connections 2024-09-22T08:39:43.310 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:43.308+0000 7fbe649fb640 1 -- 172.21.15.31:0/1035953158 wait complete. 2024-09-22T08:39:43.319 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T08:39:43.421 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:43.419+0000 7f57a4abd640 1 Processor -- start 2024-09-22T08:39:43.421 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:43.419+0000 7f57a4abd640 1 -- start start 2024-09-22T08:39:43.421 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:43.420+0000 7f57a4abd640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f57a0132960 0x7f57a0134d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:39:43.421 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:43.420+0000 7f57a4abd640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f57a006ff50 con 0x7f57a006e8e0 2024-09-22T08:39:43.421 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:43.420+0000 7f57a4abd640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f57a0099c10 con 0x7f57a0132960 2024-09-22T08:39:43.421 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:43.420+0000 7f579dd9b640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f57a0132960 0x7f57a0134d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:39:43.421 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:43.420+0000 7f579e59c640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f57a006e8e0 0x7f57a006ecc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:60680/0 (socket says 172.21.15.31:60680) 2024-09-22T08:39:43.422 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:43.420+0000 7f579e59c640 1 -- 172.21.15.31:0/3459879164 learned_addr learned my addr 172.21.15.31:0/3459879164 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-22T08:39:43.423 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:43.420+0000 7f579dd9b640 1 -- 172.21.15.31:0/3459879164 >> v1:172.21.15.31:6789/0 conn(0x7f57a006e8e0 legacy=0x7f57a006ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:39:43.423 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:43.420+0000 7f579dd9b640 1 -- 172.21.15.31:0/3459879164 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57a006f3d0 con 0x7f57a0132960 2024-09-22T08:39:43.423 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:43.421+0000 7f579dd9b640 1 --2- 172.21.15.31:0/3459879164 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f57a0132960 0x7f57a0134d50 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f5794009d90 tx=0x7f579402a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53c9fc129461b164 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:39:43.423 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:43.421+0000 7f579d59a640 1 -- 172.21.15.31:0/3459879164 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5794007670 con 0x7f57a0132960 2024-09-22T08:39:43.423 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:43.421+0000 7f579d59a640 1 -- 172.21.15.31:0/3459879164 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5794007810 con 0x7f57a0132960 2024-09-22T08:39:43.423 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:43.421+0000 7f579d59a640 1 -- 172.21.15.31:0/3459879164 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5794007b10 con 0x7f57a0132960 2024-09-22T08:39:43.423 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:43.422+0000 7f57a4abd640 1 -- 172.21.15.31:0/3459879164 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f57a0132960 msgr2=0x7f57a0134d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:39:43.423 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:43.422+0000 7f57a4abd640 1 --2- 172.21.15.31:0/3459879164 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f57a0132960 0x7f57a0134d50 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f5794009d90 tx=0x7f579402a660 comp rx=0 tx=0).stop 2024-09-22T08:39:43.423 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:43.422+0000 7f57a4abd640 1 -- 172.21.15.31:0/3459879164 shutdown_connections 2024-09-22T08:39:43.423 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:43.422+0000 7f57a4abd640 1 --2- 172.21.15.31:0/3459879164 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f57a0132960 0x7f57a0134d50 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:39:43.424 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:43.422+0000 7f57a4abd640 1 -- 172.21.15.31:0/3459879164 >> 172.21.15.31:0/3459879164 conn(0x7f57a00a01c0 msgr2=0x7f57a00a05d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:39:43.424 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:43.422+0000 7f57a4abd640 1 -- 172.21.15.31:0/3459879164 shutdown_connections 2024-09-22T08:39:43.424 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:43.422+0000 7f57a4abd640 1 -- 172.21.15.31:0/3459879164 wait complete. 2024-09-22T08:39:43.425 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:43.423+0000 7f57a4abd640 1 Processor -- start 2024-09-22T08:39:43.425 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:43.423+0000 7f57a4abd640 1 -- start start 2024-09-22T08:39:43.425 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:43.423+0000 7f57a4abd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f57a006e8e0 0x7f57a012bf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:39:43.425 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:43.423+0000 7f57a4abd640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f57a0135410 con 0x7f57a006e8e0 2024-09-22T08:39:43.425 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:43.423+0000 7f579e59c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f57a006e8e0 0x7f57a012bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:39:43.425 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:43.423+0000 7f579e59c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f57a006e8e0 0x7f57a012bf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:48366/0 (socket says 172.21.15.31:48366) 2024-09-22T08:39:43.425 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:43.423+0000 7f579e59c640 1 -- 172.21.15.31:0/2535888187 learned_addr learned my addr 172.21.15.31:0/2535888187 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-22T08:39:43.426 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:43.424+0000 7f579e59c640 1 -- 172.21.15.31:0/2535888187 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57a012e480 con 0x7f57a006e8e0 2024-09-22T08:39:43.426 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:43.424+0000 7f579e59c640 1 --2- 172.21.15.31:0/2535888187 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f57a006e8e0 0x7f57a012bf10 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f579000c380 tx=0x7f579000c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:39:43.426 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:43.424+0000 7f578effd640 1 -- 172.21.15.31:0/2535888187 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5790017070 con 0x7f57a006e8e0 2024-09-22T08:39:43.426 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:43.424+0000 7f578effd640 1 -- 172.21.15.31:0/2535888187 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5790005c10 con 0x7f57a006e8e0 2024-09-22T08:39:43.426 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:43.424+0000 7f57a4abd640 1 -- 172.21.15.31:0/2535888187 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57a012eaf0 con 0x7f57a006e8e0 2024-09-22T08:39:43.426 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:43.424+0000 7f578effd640 1 -- 172.21.15.31:0/2535888187 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f57900070d0 con 0x7f57a006e8e0 2024-09-22T08:39:43.426 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:43.424+0000 7f57a4abd640 1 -- 172.21.15.31:0/2535888187 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57a012c630 con 0x7f57a006e8e0 2024-09-22T08:39:43.427 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:43.425+0000 7f578effd640 1 -- 172.21.15.31:0/2535888187 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f579001a070 con 0x7f57a006e8e0 2024-09-22T08:39:43.427 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:43.425+0000 7f57a4abd640 1 -- 172.21.15.31:0/2535888187 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f57a006ecc0 con 0x7f57a006e8e0 2024-09-22T08:39:43.427 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:43.425+0000 7f578effd640 1 --2- 172.21.15.31:0/2535888187 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f578003e710 0x7f5780040bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:39:43.427 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:43.425+0000 7f578effd640 1 -- 172.21.15.31:0/2535888187 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5938+0+0 (secure 0 0 0) 0x7f5790052930 con 0x7f57a006e8e0 2024-09-22T08:39:43.427 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:43.426+0000 7f579dd9b640 1 --2- 172.21.15.31:0/2535888187 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f578003e710 0x7f5780040bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:39:43.427 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:43.426+0000 7f579dd9b640 1 --2- 172.21.15.31:0/2535888187 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f578003e710 0x7f5780040bd0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f5794034000 tx=0x7f579402f000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:39:43.431 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:43.430+0000 7f578effd640 1 -- 172.21.15.31:0/2535888187 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f5790012400 con 0x7f57a006e8e0 2024-09-22T08:39:43.616 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:43.615+0000 7f57a4abd640 1 -- 172.21.15.31:0/2535888187 --> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f57a0130350 con 0x7f578003e710 2024-09-22T08:39:43.626 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:43.625+0000 7f578effd640 1 -- 172.21.15.31:0/2535888187 <== mgr.4099 v2:172.21.15.142:6824/99931088 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665427 (secure 0 0 0) 0x7f57a0130350 con 0x7f578003e710 2024-09-22T08:39:43.633 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-22T08:39:43.638 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2024-09-22T08:39:43.640 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:43.630+0000 7f57a4abd640 1 -- 172.21.15.31:0/2535888187 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f578003e710 msgr2=0x7f5780040bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:39:43.640 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:43.630+0000 7f57a4abd640 1 --2- 172.21.15.31:0/2535888187 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f578003e710 0x7f5780040bd0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f5794034000 tx=0x7f579402f000 comp rx=0 tx=0).stop 2024-09-22T08:39:43.640 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:43.630+0000 7f57a4abd640 1 -- 172.21.15.31:0/2535888187 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f57a006e8e0 msgr2=0x7f57a012bf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:39:43.640 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:43.630+0000 7f57a4abd640 1 --2- 172.21.15.31:0/2535888187 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f57a006e8e0 0x7f57a012bf10 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f579000c380 tx=0x7f579000c840 comp rx=0 tx=0).stop 2024-09-22T08:39:43.640 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:43.630+0000 7f57a4abd640 1 -- 172.21.15.31:0/2535888187 shutdown_connections 2024-09-22T08:39:43.640 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:43.630+0000 7f57a4abd640 1 --2- 172.21.15.31:0/2535888187 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f578003e710 0x7f5780040bd0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:39:43.640 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:43.630+0000 7f57a4abd640 1 --2- 172.21.15.31:0/2535888187 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f57a006e8e0 0x7f57a012bf10 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:39:43.640 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:43.630+0000 7f57a4abd640 1 -- 172.21.15.31:0/2535888187 >> 172.21.15.31:0/2535888187 conn(0x7f57a00a01c0 msgr2=0x7f57a0132d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:39:43.640 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:43.630+0000 7f57a4abd640 1 -- 172.21.15.31:0/2535888187 shutdown_connections 2024-09-22T08:39:43.641 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:39:43.630+0000 7f57a4abd640 1 -- 172.21.15.31:0/2535888187 wait complete. 2024-09-22T08:39:43.642 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":137,"stamp":"2024-09-22T08:39:43.206844+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605410,"num_objects":222,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":222,"num_whiteouts":0,"num_read":5177,"num_read_kb":4727,"num_write":2121,"num_write_kb":60587,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4564,"ondisk_log_size":4564,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":152520,"kb_used_data":2816,"kb_used_omap":6,"kb_used_meta":149625,"kb_avail":377334840,"statfs":{"total":386547056640,"available":386390876160,"internally_reserved":0,"allocated":2883584,"data_stored":1724064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":153216790},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":4281,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":750,"num_read_kb":697,"num_write":457,"num_write_kb":29372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003844"},"pg_stats":[{"pgid":"3.3f","version":"30'4","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.229185+0000","last_change":"2024-09-22T08:36:23.978702+0000","last_active":"2024-09-22T08:37:04.229185+0000","last_peered":"2024-09-22T08:37:04.229185+0000","last_clean":"2024-09-22T08:37:04.229185+0000","last_became_active":"2024-09-22T08:36:23.978473+0000","last_became_peered":"2024-09-22T08:36:23.978473+0000","last_unstale":"2024-09-22T08:37:04.229185+0000","last_undegraded":"2024-09-22T08:37:04.229185+0000","last_fullsized":"2024-09-22T08:37:04.229185+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:47:35.557013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":7,"num_write":20,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"30'4","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.221771+0000","last_change":"2024-09-22T08:36:25.982137+0000","last_active":"2024-09-22T08:37:04.221771+0000","last_peered":"2024-09-22T08:37:04.221771+0000","last_clean":"2024-09-22T08:37:04.221771+0000","last_became_active":"2024-09-22T08:36:25.981849+0000","last_became_peered":"2024-09-22T08:36:25.981849+0000","last_unstale":"2024-09-22T08:37:04.221771+0000","last_undegraded":"2024-09-22T08:37:04.221771+0000","last_fullsized":"2024-09-22T08:37:04.221771+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:15:58.403427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.225549+0000","last_change":"2024-09-22T08:36:23.973967+0000","last_active":"2024-09-22T08:37:04.225549+0000","last_peered":"2024-09-22T08:37:04.225549+0000","last_clean":"2024-09-22T08:37:04.225549+0000","last_became_active":"2024-09-22T08:36:23.973596+0000","last_became_peered":"2024-09-22T08:36:23.973596+0000","last_unstale":"2024-09-22T08:37:04.225549+0000","last_undegraded":"2024-09-22T08:37:04.225549+0000","last_fullsized":"2024-09-22T08:37:04.225549+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:25:55.158227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"32'2","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.081639+0000","last_change":"2024-09-22T08:36:25.992482+0000","last_active":"2024-09-22T08:39:32.081639+0000","last_peered":"2024-09-22T08:39:32.081639+0000","last_clean":"2024-09-22T08:39:32.081639+0000","last_became_active":"2024-09-22T08:36:25.992150+0000","last_became_peered":"2024-09-22T08:36:25.992150+0000","last_unstale":"2024-09-22T08:39:32.081639+0000","last_undegraded":"2024-09-22T08:39:32.081639+0000","last_fullsized":"2024-09-22T08:39:32.081639+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:39:29.442096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.232004+0000","last_change":"2024-09-22T08:36:23.983138+0000","last_active":"2024-09-22T08:37:04.232004+0000","last_peered":"2024-09-22T08:37:04.232004+0000","last_clean":"2024-09-22T08:37:04.232004+0000","last_became_active":"2024-09-22T08:36:23.982860+0000","last_became_peered":"2024-09-22T08:36:23.982860+0000","last_unstale":"2024-09-22T08:37:04.232004+0000","last_undegraded":"2024-09-22T08:37:04.232004+0000","last_fullsized":"2024-09-22T08:37:04.232004+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:22:39.595954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.228436+0000","last_change":"2024-09-22T08:36:25.992618+0000","last_active":"2024-09-22T08:37:04.228436+0000","last_peered":"2024-09-22T08:37:04.228436+0000","last_clean":"2024-09-22T08:37:04.228436+0000","last_became_active":"2024-09-22T08:36:25.992356+0000","last_became_peered":"2024-09-22T08:36:25.992356+0000","last_unstale":"2024-09-22T08:37:04.228436+0000","last_undegraded":"2024-09-22T08:37:04.228436+0000","last_fullsized":"2024-09-22T08:37:04.228436+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:54:42.310988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.225810+0000","last_change":"2024-09-22T08:36:23.967353+0000","last_active":"2024-09-22T08:37:04.225810+0000","last_peered":"2024-09-22T08:37:04.225810+0000","last_clean":"2024-09-22T08:37:04.225810+0000","last_became_active":"2024-09-22T08:36:23.967096+0000","last_became_peered":"2024-09-22T08:36:23.967096+0000","last_unstale":"2024-09-22T08:37:04.225810+0000","last_undegraded":"2024-09-22T08:37:04.225810+0000","last_fullsized":"2024-09-22T08:37:04.225810+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:22:30.703594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"32'22","reported_seq":95,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.214709+0000","last_change":"2024-09-22T08:36:25.989569+0000","last_active":"2024-09-22T08:39:32.214709+0000","last_peered":"2024-09-22T08:39:32.214709+0000","last_clean":"2024-09-22T08:39:32.214709+0000","last_became_active":"2024-09-22T08:36:25.989065+0000","last_became_peered":"2024-09-22T08:36:25.989065+0000","last_unstale":"2024-09-22T08:39:32.214709+0000","last_undegraded":"2024-09-22T08:39:32.214709+0000","last_fullsized":"2024-09-22T08:39:32.214709+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:18:58.915284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":82,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.229849+0000","last_change":"2024-09-22T08:36:23.979014+0000","last_active":"2024-09-22T08:37:04.229849+0000","last_peered":"2024-09-22T08:37:04.229849+0000","last_clean":"2024-09-22T08:37:04.229849+0000","last_became_active":"2024-09-22T08:36:23.978766+0000","last_became_peered":"2024-09-22T08:36:23.978766+0000","last_unstale":"2024-09-22T08:37:04.229849+0000","last_undegraded":"2024-09-22T08:37:04.229849+0000","last_fullsized":"2024-09-22T08:37:04.229849+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:46:08.557989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"32'8","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.215083+0000","last_change":"2024-09-22T08:36:25.979188+0000","last_active":"2024-09-22T08:39:32.215083+0000","last_peered":"2024-09-22T08:39:32.215083+0000","last_clean":"2024-09-22T08:39:32.215083+0000","last_became_active":"2024-09-22T08:36:25.978937+0000","last_became_peered":"2024-09-22T08:36:25.978937+0000","last_unstale":"2024-09-22T08:39:32.215083+0000","last_undegraded":"2024-09-22T08:39:32.215083+0000","last_fullsized":"2024-09-22T08:39:32.215083+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:36:02.118103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":23,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"32'4","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:05.711611+0000","last_change":"2024-09-22T08:36:23.967446+0000","last_active":"2024-09-22T08:37:05.711611+0000","last_peered":"2024-09-22T08:37:05.711611+0000","last_clean":"2024-09-22T08:37:05.711611+0000","last_became_active":"2024-09-22T08:36:23.967168+0000","last_became_peered":"2024-09-22T08:36:23.967168+0000","last_unstale":"2024-09-22T08:37:05.711611+0000","last_undegraded":"2024-09-22T08:37:05.711611+0000","last_fullsized":"2024-09-22T08:37:05.711611+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:51:18.438115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":10,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"32'6","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:48.130983+0000","last_change":"2024-09-22T08:36:25.992986+0000","last_active":"2024-09-22T08:37:48.130983+0000","last_peered":"2024-09-22T08:37:48.130983+0000","last_clean":"2024-09-22T08:37:48.130983+0000","last_became_active":"2024-09-22T08:36:25.990727+0000","last_became_peered":"2024-09-22T08:36:25.990727+0000","last_unstale":"2024-09-22T08:37:48.130983+0000","last_undegraded":"2024-09-22T08:37:48.130983+0000","last_fullsized":"2024-09-22T08:37:48.130983+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:05:42.869702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.228480+0000","last_change":"2024-09-22T08:36:23.980714+0000","last_active":"2024-09-22T08:37:04.228480+0000","last_peered":"2024-09-22T08:37:04.228480+0000","last_clean":"2024-09-22T08:37:04.228480+0000","last_became_active":"2024-09-22T08:36:23.980446+0000","last_became_peered":"2024-09-22T08:36:23.980446+0000","last_unstale":"2024-09-22T08:37:04.228480+0000","last_undegraded":"2024-09-22T08:37:04.228480+0000","last_fullsized":"2024-09-22T08:37:04.228480+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:18:20.665486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"32'8","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.289670+0000","last_change":"2024-09-22T08:36:25.982503+0000","last_active":"2024-09-22T08:39:32.289670+0000","last_peered":"2024-09-22T08:39:32.289670+0000","last_clean":"2024-09-22T08:39:32.289670+0000","last_became_active":"2024-09-22T08:36:25.982217+0000","last_became_peered":"2024-09-22T08:36:25.982217+0000","last_unstale":"2024-09-22T08:39:32.289670+0000","last_undegraded":"2024-09-22T08:39:32.289670+0000","last_fullsized":"2024-09-22T08:39:32.289670+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:38:39.281465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":27,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:31.512962+0000","last_change":"2024-09-22T08:36:23.978037+0000","last_active":"2024-09-22T08:38:31.512962+0000","last_peered":"2024-09-22T08:38:31.512962+0000","last_clean":"2024-09-22T08:38:31.512962+0000","last_became_active":"2024-09-22T08:36:23.977715+0000","last_became_peered":"2024-09-22T08:36:23.977715+0000","last_unstale":"2024-09-22T08:38:31.512962+0000","last_undegraded":"2024-09-22T08:38:31.512962+0000","last_fullsized":"2024-09-22T08:38:31.512962+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:43:08.069293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"32'7","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:30.181492+0000","last_change":"2024-09-22T08:36:25.975203+0000","last_active":"2024-09-22T08:38:30.181492+0000","last_peered":"2024-09-22T08:38:30.181492+0000","last_clean":"2024-09-22T08:38:30.181492+0000","last_became_active":"2024-09-22T08:36:25.974930+0000","last_became_peered":"2024-09-22T08:36:25.974930+0000","last_unstale":"2024-09-22T08:38:30.181492+0000","last_undegraded":"2024-09-22T08:38:30.181492+0000","last_fullsized":"2024-09-22T08:38:30.181492+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:14:58.055122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"32'3","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:48.185367+0000","last_change":"2024-09-22T08:36:25.992134+0000","last_active":"2024-09-22T08:38:48.185367+0000","last_peered":"2024-09-22T08:38:48.185367+0000","last_clean":"2024-09-22T08:38:48.185367+0000","last_became_active":"2024-09-22T08:36:25.991870+0000","last_became_peered":"2024-09-22T08:36:25.991870+0000","last_unstale":"2024-09-22T08:38:48.185367+0000","last_undegraded":"2024-09-22T08:38:48.185367+0000","last_fullsized":"2024-09-22T08:38:48.185367+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:22:14.904895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.224532+0000","last_change":"2024-09-22T08:36:23.977802+0000","last_active":"2024-09-22T08:37:04.224532+0000","last_peered":"2024-09-22T08:37:04.224532+0000","last_clean":"2024-09-22T08:37:04.224532+0000","last_became_active":"2024-09-22T08:36:23.977556+0000","last_became_peered":"2024-09-22T08:36:23.977556+0000","last_unstale":"2024-09-22T08:37:04.224532+0000","last_undegraded":"2024-09-22T08:37:04.224532+0000","last_fullsized":"2024-09-22T08:37:04.224532+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:29:17.802189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"32'14","reported_seq":72,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.290010+0000","last_change":"2024-09-22T08:36:25.977178+0000","last_active":"2024-09-22T08:39:32.290010+0000","last_peered":"2024-09-22T08:39:32.290010+0000","last_clean":"2024-09-22T08:39:32.290010+0000","last_became_active":"2024-09-22T08:36:25.976389+0000","last_became_peered":"2024-09-22T08:36:25.976389+0000","last_unstale":"2024-09-22T08:39:32.290010+0000","last_undegraded":"2024-09-22T08:39:32.290010+0000","last_fullsized":"2024-09-22T08:39:32.290010+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:33:17.028140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":49,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:31.901706+0000","last_change":"2024-09-22T08:36:23.974839+0000","last_active":"2024-09-22T08:39:31.901706+0000","last_peered":"2024-09-22T08:39:31.901706+0000","last_clean":"2024-09-22T08:39:31.901706+0000","last_became_active":"2024-09-22T08:36:23.974275+0000","last_became_peered":"2024-09-22T08:36:23.974275+0000","last_unstale":"2024-09-22T08:39:31.901706+0000","last_undegraded":"2024-09-22T08:39:31.901706+0000","last_fullsized":"2024-09-22T08:39:31.901706+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:00:39.104995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"32'12","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.343172+0000","last_change":"2024-09-22T08:36:25.977283+0000","last_active":"2024-09-22T08:39:32.343172+0000","last_peered":"2024-09-22T08:39:32.343172+0000","last_clean":"2024-09-22T08:39:32.343172+0000","last_became_active":"2024-09-22T08:36:25.977015+0000","last_became_peered":"2024-09-22T08:36:25.977015+0000","last_unstale":"2024-09-22T08:39:32.343172+0000","last_undegraded":"2024-09-22T08:39:32.343172+0000","last_fullsized":"2024-09-22T08:39:32.343172+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:25:20.428891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":43,"num_read_kb":39,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:05.096438+0000","last_change":"2024-09-22T08:36:23.984666+0000","last_active":"2024-09-22T08:37:05.096438+0000","last_peered":"2024-09-22T08:37:05.096438+0000","last_clean":"2024-09-22T08:37:05.096438+0000","last_became_active":"2024-09-22T08:36:23.984411+0000","last_became_peered":"2024-09-22T08:36:23.984411+0000","last_unstale":"2024-09-22T08:37:05.096438+0000","last_undegraded":"2024-09-22T08:37:05.096438+0000","last_fullsized":"2024-09-22T08:37:05.096438+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:22:30.703594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"32'2","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:28.582905+0000","last_change":"2024-09-22T08:36:25.984342+0000","last_active":"2024-09-22T08:38:28.582905+0000","last_peered":"2024-09-22T08:38:28.582905+0000","last_clean":"2024-09-22T08:38:28.582905+0000","last_became_active":"2024-09-22T08:36:25.984037+0000","last_became_peered":"2024-09-22T08:36:25.984037+0000","last_unstale":"2024-09-22T08:38:28.582905+0000","last_undegraded":"2024-09-22T08:38:28.582905+0000","last_fullsized":"2024-09-22T08:38:28.582905+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:08:22.313520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.613492+0000","last_change":"2024-09-22T08:36:23.969670+0000","last_active":"2024-09-22T08:37:04.613492+0000","last_peered":"2024-09-22T08:37:04.613492+0000","last_clean":"2024-09-22T08:37:04.613492+0000","last_became_active":"2024-09-22T08:36:23.969183+0000","last_became_peered":"2024-09-22T08:36:23.969183+0000","last_unstale":"2024-09-22T08:37:04.613492+0000","last_undegraded":"2024-09-22T08:37:04.613492+0000","last_fullsized":"2024-09-22T08:37:04.613492+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:27:04.674711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"32'18","reported_seq":67,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.214977+0000","last_change":"2024-09-22T08:36:25.986078+0000","last_active":"2024-09-22T08:39:32.214977+0000","last_peered":"2024-09-22T08:39:32.214977+0000","last_clean":"2024-09-22T08:39:32.214977+0000","last_became_active":"2024-09-22T08:36:25.985797+0000","last_became_peered":"2024-09-22T08:36:25.985797+0000","last_unstale":"2024-09-22T08:39:32.214977+0000","last_undegraded":"2024-09-22T08:39:32.214977+0000","last_fullsized":"2024-09-22T08:39:32.214977+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:55:58.281586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":61,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.205171+0000","last_change":"2024-09-22T08:36:23.974737+0000","last_active":"2024-09-22T08:39:32.205171+0000","last_peered":"2024-09-22T08:39:32.205171+0000","last_clean":"2024-09-22T08:39:32.205171+0000","last_became_active":"2024-09-22T08:36:23.974359+0000","last_became_peered":"2024-09-22T08:36:23.974359+0000","last_unstale":"2024-09-22T08:39:32.205171+0000","last_undegraded":"2024-09-22T08:39:32.205171+0000","last_fullsized":"2024-09-22T08:39:32.205171+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:27:54.535865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"32'16","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.296886+0000","last_change":"2024-09-22T08:36:25.978419+0000","last_active":"2024-09-22T08:39:32.296886+0000","last_peered":"2024-09-22T08:39:32.296886+0000","last_clean":"2024-09-22T08:39:32.296886+0000","last_became_active":"2024-09-22T08:36:25.977320+0000","last_became_peered":"2024-09-22T08:36:25.977320+0000","last_unstale":"2024-09-22T08:39:32.296886+0000","last_undegraded":"2024-09-22T08:39:32.296886+0000","last_fullsized":"2024-09-22T08:39:32.296886+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:45:06.683427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":49,"num_write":21,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:31.890230+0000","last_change":"2024-09-22T08:36:23.980577+0000","last_active":"2024-09-22T08:39:31.890230+0000","last_peered":"2024-09-22T08:39:31.890230+0000","last_clean":"2024-09-22T08:39:31.890230+0000","last_became_active":"2024-09-22T08:36:23.980189+0000","last_became_peered":"2024-09-22T08:36:23.980189+0000","last_unstale":"2024-09-22T08:39:31.890230+0000","last_undegraded":"2024-09-22T08:39:31.890230+0000","last_fullsized":"2024-09-22T08:39:31.890230+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:45:54.958427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"32'35","reported_seq":100,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.238012+0000","last_change":"2024-09-22T08:36:34.015950+0000","last_active":"2024-09-22T08:39:32.238012+0000","last_peered":"2024-09-22T08:39:32.238012+0000","last_clean":"2024-09-22T08:39:32.238012+0000","last_became_active":"2024-09-22T08:36:34.015696+0000","last_became_peered":"2024-09-22T08:36:34.015696+0000","last_unstale":"2024-09-22T08:39:32.238012+0000","last_undegraded":"2024-09-22T08:39:32.238012+0000","last_fullsized":"2024-09-22T08:39:32.238012+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:48:07.077185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":173,"num_read_kb":173,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"32'6","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.214715+0000","last_change":"2024-09-22T08:36:25.988079+0000","last_active":"2024-09-22T08:39:32.214715+0000","last_peered":"2024-09-22T08:39:32.214715+0000","last_clean":"2024-09-22T08:39:32.214715+0000","last_became_active":"2024-09-22T08:36:25.987811+0000","last_became_peered":"2024-09-22T08:36:25.987811+0000","last_unstale":"2024-09-22T08:39:32.214715+0000","last_undegraded":"2024-09-22T08:39:32.214715+0000","last_fullsized":"2024-09-22T08:39:32.214715+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:09:47.627357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.229385+0000","last_change":"2024-09-22T08:36:23.982670+0000","last_active":"2024-09-22T08:37:04.229385+0000","last_peered":"2024-09-22T08:37:04.229385+0000","last_clean":"2024-09-22T08:37:04.229385+0000","last_became_active":"2024-09-22T08:36:23.982423+0000","last_became_peered":"2024-09-22T08:36:23.982423+0000","last_unstale":"2024-09-22T08:37:04.229385+0000","last_undegraded":"2024-09-22T08:37:04.229385+0000","last_fullsized":"2024-09-22T08:37:04.229385+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:36:21.966120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.230626+0000","last_change":"2024-09-22T08:36:27.988469+0000","last_active":"2024-09-22T08:37:04.230626+0000","last_peered":"2024-09-22T08:37:04.230626+0000","last_clean":"2024-09-22T08:37:04.230626+0000","last_became_active":"2024-09-22T08:36:27.988057+0000","last_became_peered":"2024-09-22T08:36:27.988057+0000","last_unstale":"2024-09-22T08:37:04.230626+0000","last_undegraded":"2024-09-22T08:37:04.230626+0000","last_fullsized":"2024-09-22T08:37:04.230626+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_clean_scrub_stamp":"2024-09-22T08:36:26.962226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:51:33.578609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"32'33","reported_seq":80,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:38.945435+0000","last_change":"2024-09-22T08:36:29.995218+0000","last_active":"2024-09-22T08:39:38.945435+0000","last_peered":"2024-09-22T08:39:38.945435+0000","last_clean":"2024-09-22T08:39:38.945435+0000","last_became_active":"2024-09-22T08:36:29.994881+0000","last_became_peered":"2024-09-22T08:36:29.994881+0000","last_unstale":"2024-09-22T08:39:38.945435+0000","last_undegraded":"2024-09-22T08:39:38.945435+0000","last_fullsized":"2024-09-22T08:39:38.945435+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:46:41.834484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.223889+0000","last_change":"2024-09-22T08:36:32.013521+0000","last_active":"2024-09-22T08:37:04.223889+0000","last_peered":"2024-09-22T08:37:04.223889+0000","last_clean":"2024-09-22T08:37:04.223889+0000","last_became_active":"2024-09-22T08:36:32.013249+0000","last_became_peered":"2024-09-22T08:36:32.013249+0000","last_unstale":"2024-09-22T08:37:04.223889+0000","last_undegraded":"2024-09-22T08:37:04.223889+0000","last_fullsized":"2024-09-22T08:37:04.223889+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:35:20.008672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"32'7","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:47.949724+0000","last_change":"2024-09-22T08:36:34.015432+0000","last_active":"2024-09-22T08:37:47.949724+0000","last_peered":"2024-09-22T08:37:47.949724+0000","last_clean":"2024-09-22T08:37:47.949724+0000","last_became_active":"2024-09-22T08:36:34.015170+0000","last_became_peered":"2024-09-22T08:36:34.015170+0000","last_unstale":"2024-09-22T08:37:47.949724+0000","last_undegraded":"2024-09-22T08:37:47.949724+0000","last_fullsized":"2024-09-22T08:37:47.949724+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:45:21.601440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:48.129237+0000","last_change":"2024-09-22T08:36:25.989960+0000","last_active":"2024-09-22T08:37:48.129237+0000","last_peered":"2024-09-22T08:37:48.129237+0000","last_clean":"2024-09-22T08:37:48.129237+0000","last_became_active":"2024-09-22T08:36:25.989583+0000","last_became_peered":"2024-09-22T08:36:25.989583+0000","last_unstale":"2024-09-22T08:37:48.129237+0000","last_undegraded":"2024-09-22T08:37:48.129237+0000","last_fullsized":"2024-09-22T08:37:48.129237+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:42:22.082860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:31.921817+0000","last_change":"2024-09-22T08:36:23.973951+0000","last_active":"2024-09-22T08:39:31.921817+0000","last_peered":"2024-09-22T08:39:31.921817+0000","last_clean":"2024-09-22T08:39:31.921817+0000","last_became_active":"2024-09-22T08:36:23.973716+0000","last_became_peered":"2024-09-22T08:36:23.973716+0000","last_unstale":"2024-09-22T08:39:31.921817+0000","last_undegraded":"2024-09-22T08:39:31.921817+0000","last_fullsized":"2024-09-22T08:39:31.921817+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:06:35.921272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:05.167417+0000","last_change":"2024-09-22T08:37:04.229482+0000","last_active":"2024-09-22T08:37:05.167417+0000","last_peered":"2024-09-22T08:37:05.167417+0000","last_clean":"2024-09-22T08:37:05.167417+0000","last_became_active":"2024-09-22T08:37:04.229132+0000","last_became_peered":"2024-09-22T08:37:04.229132+0000","last_unstale":"2024-09-22T08:37:05.167417+0000","last_undegraded":"2024-09-22T08:37:05.167417+0000","last_fullsized":"2024-09-22T08:37:05.167417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_clean_scrub_stamp":"2024-09-22T08:36:26.962226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:30:09.128950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"30'6","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.223977+0000","last_change":"2024-09-22T08:36:29.991280+0000","last_active":"2024-09-22T08:37:04.223977+0000","last_peered":"2024-09-22T08:37:04.223977+0000","last_clean":"2024-09-22T08:37:04.223977+0000","last_became_active":"2024-09-22T08:36:29.990998+0000","last_became_peered":"2024-09-22T08:36:29.990998+0000","last_unstale":"2024-09-22T08:37:04.223977+0000","last_undegraded":"2024-09-22T08:37:04.223977+0000","last_fullsized":"2024-09-22T08:37:04.223977+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:36:37.998945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.222725+0000","last_change":"2024-09-22T08:36:32.006443+0000","last_active":"2024-09-22T08:37:04.222725+0000","last_peered":"2024-09-22T08:37:04.222725+0000","last_clean":"2024-09-22T08:37:04.222725+0000","last_became_active":"2024-09-22T08:36:32.006161+0000","last_became_peered":"2024-09-22T08:36:32.006161+0000","last_unstale":"2024-09-22T08:37:04.222725+0000","last_undegraded":"2024-09-22T08:37:04.222725+0000","last_fullsized":"2024-09-22T08:37:04.222725+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:39:07.614953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"30'2","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.223331+0000","last_change":"2024-09-22T08:36:34.017093+0000","last_active":"2024-09-22T08:37:04.223331+0000","last_peered":"2024-09-22T08:37:04.223331+0000","last_clean":"2024-09-22T08:37:04.223331+0000","last_became_active":"2024-09-22T08:36:34.016749+0000","last_became_peered":"2024-09-22T08:36:34.016749+0000","last_unstale":"2024-09-22T08:37:04.223331+0000","last_undegraded":"2024-09-22T08:37:04.223331+0000","last_fullsized":"2024-09-22T08:37:04.223331+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:18:00.649317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"32'7","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.088571+0000","last_change":"2024-09-22T08:36:25.988432+0000","last_active":"2024-09-22T08:39:32.088571+0000","last_peered":"2024-09-22T08:39:32.088571+0000","last_clean":"2024-09-22T08:39:32.088571+0000","last_became_active":"2024-09-22T08:36:25.987860+0000","last_became_peered":"2024-09-22T08:36:25.987860+0000","last_unstale":"2024-09-22T08:39:32.088571+0000","last_undegraded":"2024-09-22T08:39:32.088571+0000","last_fullsized":"2024-09-22T08:39:32.088571+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:07:23.439560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.228129+0000","last_change":"2024-09-22T08:36:23.979437+0000","last_active":"2024-09-22T08:37:04.228129+0000","last_peered":"2024-09-22T08:37:04.228129+0000","last_clean":"2024-09-22T08:37:04.228129+0000","last_became_active":"2024-09-22T08:36:23.979201+0000","last_became_peered":"2024-09-22T08:36:23.979201+0000","last_unstale":"2024-09-22T08:37:04.228129+0000","last_undegraded":"2024-09-22T08:37:04.228129+0000","last_fullsized":"2024-09-22T08:37:04.228129+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:05:30.127896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.226652+0000","last_change":"2024-09-22T08:36:27.987816+0000","last_active":"2024-09-22T08:37:04.226652+0000","last_peered":"2024-09-22T08:37:04.226652+0000","last_clean":"2024-09-22T08:37:04.226652+0000","last_became_active":"2024-09-22T08:36:27.987410+0000","last_became_peered":"2024-09-22T08:36:27.987410+0000","last_unstale":"2024-09-22T08:37:04.226652+0000","last_undegraded":"2024-09-22T08:37:04.226652+0000","last_fullsized":"2024-09-22T08:37:04.226652+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_clean_scrub_stamp":"2024-09-22T08:36:26.962226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:14:29.717295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"30'10","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.227501+0000","last_change":"2024-09-22T08:36:29.999655+0000","last_active":"2024-09-22T08:37:04.227501+0000","last_peered":"2024-09-22T08:37:04.227501+0000","last_clean":"2024-09-22T08:37:04.227501+0000","last_became_active":"2024-09-22T08:36:29.999306+0000","last_became_peered":"2024-09-22T08:36:29.999306+0000","last_unstale":"2024-09-22T08:37:04.227501+0000","last_undegraded":"2024-09-22T08:37:04.227501+0000","last_fullsized":"2024-09-22T08:37:04.227501+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:27:58.333399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"32'285","reported_seq":418,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:38.824267+0000","last_change":"2024-09-22T08:36:32.014175+0000","last_active":"2024-09-22T08:39:38.824267+0000","last_peered":"2024-09-22T08:39:38.824267+0000","last_clean":"2024-09-22T08:39:38.824267+0000","last_became_active":"2024-09-22T08:36:32.013869+0000","last_became_peered":"2024-09-22T08:36:32.013869+0000","last_unstale":"2024-09-22T08:39:38.824267+0000","last_undegraded":"2024-09-22T08:39:38.824267+0000","last_fullsized":"2024-09-22T08:39:38.824267+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:23:53.788685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.224121+0000","last_change":"2024-09-22T08:36:34.016273+0000","last_active":"2024-09-22T08:37:04.224121+0000","last_peered":"2024-09-22T08:37:04.224121+0000","last_clean":"2024-09-22T08:37:04.224121+0000","last_became_active":"2024-09-22T08:36:34.015999+0000","last_became_peered":"2024-09-22T08:36:34.015999+0000","last_unstale":"2024-09-22T08:37:04.224121+0000","last_undegraded":"2024-09-22T08:37:04.224121+0000","last_fullsized":"2024-09-22T08:37:04.224121+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:19:59.334082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"30'4","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.226266+0000","last_change":"2024-09-22T08:36:25.979874+0000","last_active":"2024-09-22T08:37:04.226266+0000","last_peered":"2024-09-22T08:37:04.226266+0000","last_clean":"2024-09-22T08:37:04.226266+0000","last_became_active":"2024-09-22T08:36:25.979320+0000","last_became_peered":"2024-09-22T08:36:25.979320+0000","last_unstale":"2024-09-22T08:37:04.226266+0000","last_undegraded":"2024-09-22T08:37:04.226266+0000","last_fullsized":"2024-09-22T08:37:04.226266+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:22:30.226253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.221148+0000","last_change":"2024-09-22T08:36:23.975661+0000","last_active":"2024-09-22T08:37:04.221148+0000","last_peered":"2024-09-22T08:37:04.221148+0000","last_clean":"2024-09-22T08:37:04.221148+0000","last_became_active":"2024-09-22T08:36:23.975428+0000","last_became_peered":"2024-09-22T08:36:23.975428+0000","last_unstale":"2024-09-22T08:37:04.221148+0000","last_undegraded":"2024-09-22T08:37:04.221148+0000","last_fullsized":"2024-09-22T08:37:04.221148+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:09:41.970933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.227129+0000","last_change":"2024-09-22T08:36:27.985020+0000","last_active":"2024-09-22T08:37:04.227129+0000","last_peered":"2024-09-22T08:37:04.227129+0000","last_clean":"2024-09-22T08:37:04.227129+0000","last_became_active":"2024-09-22T08:36:27.984658+0000","last_became_peered":"2024-09-22T08:36:27.984658+0000","last_unstale":"2024-09-22T08:37:04.227129+0000","last_undegraded":"2024-09-22T08:37:04.227129+0000","last_fullsized":"2024-09-22T08:37:04.227129+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_clean_scrub_stamp":"2024-09-22T08:36:26.962226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:55:24.622399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"32'33","reported_seq":80,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:38.929884+0000","last_change":"2024-09-22T08:36:30.000958+0000","last_active":"2024-09-22T08:39:38.929884+0000","last_peered":"2024-09-22T08:39:38.929884+0000","last_clean":"2024-09-22T08:39:38.929884+0000","last_became_active":"2024-09-22T08:36:30.000641+0000","last_became_peered":"2024-09-22T08:36:30.000641+0000","last_unstale":"2024-09-22T08:39:38.929884+0000","last_undegraded":"2024-09-22T08:39:38.929884+0000","last_fullsized":"2024-09-22T08:39:38.929884+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:44:23.505173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"32'285","reported_seq":427,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:38.829148+0000","last_change":"2024-09-22T08:36:32.005447+0000","last_active":"2024-09-22T08:39:38.829148+0000","last_peered":"2024-09-22T08:39:38.829148+0000","last_clean":"2024-09-22T08:39:38.829148+0000","last_became_active":"2024-09-22T08:36:32.005012+0000","last_became_peered":"2024-09-22T08:36:32.005012+0000","last_unstale":"2024-09-22T08:39:38.829148+0000","last_undegraded":"2024-09-22T08:39:38.829148+0000","last_fullsized":"2024-09-22T08:39:38.829148+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:31:41.609654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"32'4","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:05.720809+0000","last_change":"2024-09-22T08:36:25.990731+0000","last_active":"2024-09-22T08:37:05.720809+0000","last_peered":"2024-09-22T08:37:05.720809+0000","last_clean":"2024-09-22T08:37:05.720809+0000","last_became_active":"2024-09-22T08:36:25.989940+0000","last_became_peered":"2024-09-22T08:36:25.989940+0000","last_unstale":"2024-09-22T08:37:05.720809+0000","last_undegraded":"2024-09-22T08:37:05.720809+0000","last_fullsized":"2024-09-22T08:37:05.720809+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:12:49.808186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.229286+0000","last_change":"2024-09-22T08:36:23.970335+0000","last_active":"2024-09-22T08:37:04.229286+0000","last_peered":"2024-09-22T08:37:04.229286+0000","last_clean":"2024-09-22T08:37:04.229286+0000","last_became_active":"2024-09-22T08:36:23.970093+0000","last_became_peered":"2024-09-22T08:36:23.970093+0000","last_unstale":"2024-09-22T08:37:04.229286+0000","last_undegraded":"2024-09-22T08:37:04.229286+0000","last_fullsized":"2024-09-22T08:37:04.229286+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:59:04.308788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.221669+0000","last_change":"2024-09-22T08:36:27.987025+0000","last_active":"2024-09-22T08:37:04.221669+0000","last_peered":"2024-09-22T08:37:04.221669+0000","last_clean":"2024-09-22T08:37:04.221669+0000","last_became_active":"2024-09-22T08:36:27.986734+0000","last_became_peered":"2024-09-22T08:36:27.986734+0000","last_unstale":"2024-09-22T08:37:04.221669+0000","last_undegraded":"2024-09-22T08:37:04.221669+0000","last_fullsized":"2024-09-22T08:37:04.221669+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_clean_scrub_stamp":"2024-09-22T08:36:26.962226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:17:49.747383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"32'43","reported_seq":95,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:38.957908+0000","last_change":"2024-09-22T08:36:29.991107+0000","last_active":"2024-09-22T08:39:38.957908+0000","last_peered":"2024-09-22T08:39:38.957908+0000","last_clean":"2024-09-22T08:39:38.957908+0000","last_became_active":"2024-09-22T08:36:29.990809+0000","last_became_peered":"2024-09-22T08:36:29.990809+0000","last_unstale":"2024-09-22T08:39:38.957908+0000","last_undegraded":"2024-09-22T08:39:38.957908+0000","last_fullsized":"2024-09-22T08:39:38.957908+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:58:25.003982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.224144+0000","last_change":"2024-09-22T08:36:32.004096+0000","last_active":"2024-09-22T08:37:04.224144+0000","last_peered":"2024-09-22T08:37:04.224144+0000","last_clean":"2024-09-22T08:37:04.224144+0000","last_became_active":"2024-09-22T08:36:32.003726+0000","last_became_peered":"2024-09-22T08:36:32.003726+0000","last_unstale":"2024-09-22T08:37:04.224144+0000","last_undegraded":"2024-09-22T08:37:04.224144+0000","last_fullsized":"2024-09-22T08:37:04.224144+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:58:37.810092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"32'5","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:48.125865+0000","last_change":"2024-09-22T08:36:34.022748+0000","last_active":"2024-09-22T08:37:48.125865+0000","last_peered":"2024-09-22T08:37:48.125865+0000","last_clean":"2024-09-22T08:37:48.125865+0000","last_became_active":"2024-09-22T08:36:34.022448+0000","last_became_peered":"2024-09-22T08:36:34.022448+0000","last_unstale":"2024-09-22T08:37:48.125865+0000","last_undegraded":"2024-09-22T08:37:48.125865+0000","last_fullsized":"2024-09-22T08:37:48.125865+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:39:09.622561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":13,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"32'10","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:31.647489+0000","last_change":"2024-09-22T08:36:25.976027+0000","last_active":"2024-09-22T08:38:31.647489+0000","last_peered":"2024-09-22T08:38:31.647489+0000","last_clean":"2024-09-22T08:38:31.647489+0000","last_became_active":"2024-09-22T08:36:25.975728+0000","last_became_peered":"2024-09-22T08:36:25.975728+0000","last_unstale":"2024-09-22T08:38:31.647489+0000","last_undegraded":"2024-09-22T08:38:31.647489+0000","last_fullsized":"2024-09-22T08:38:31.647489+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:22:27.923443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:31.959475+0000","last_change":"2024-09-22T08:36:23.969160+0000","last_active":"2024-09-22T08:39:31.959475+0000","last_peered":"2024-09-22T08:39:31.959475+0000","last_clean":"2024-09-22T08:39:31.959475+0000","last_became_active":"2024-09-22T08:36:23.968836+0000","last_became_peered":"2024-09-22T08:36:23.968836+0000","last_unstale":"2024-09-22T08:39:31.959475+0000","last_undegraded":"2024-09-22T08:39:31.959475+0000","last_fullsized":"2024-09-22T08:39:31.959475+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:24:33.546187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.223645+0000","last_change":"2024-09-22T08:36:27.987971+0000","last_active":"2024-09-22T08:37:04.223645+0000","last_peered":"2024-09-22T08:37:04.223645+0000","last_clean":"2024-09-22T08:37:04.223645+0000","last_became_active":"2024-09-22T08:36:27.987577+0000","last_became_peered":"2024-09-22T08:36:27.987577+0000","last_unstale":"2024-09-22T08:37:04.223645+0000","last_undegraded":"2024-09-22T08:37:04.223645+0000","last_fullsized":"2024-09-22T08:37:04.223645+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_clean_scrub_stamp":"2024-09-22T08:36:26.962226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:17:33.045316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"32'34","reported_seq":81,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:38.899450+0000","last_change":"2024-09-22T08:36:29.995394+0000","last_active":"2024-09-22T08:39:38.899450+0000","last_peered":"2024-09-22T08:39:38.899450+0000","last_clean":"2024-09-22T08:39:38.899450+0000","last_became_active":"2024-09-22T08:36:29.994921+0000","last_became_peered":"2024-09-22T08:36:29.994921+0000","last_unstale":"2024-09-22T08:39:38.899450+0000","last_undegraded":"2024-09-22T08:39:38.899450+0000","last_fullsized":"2024-09-22T08:39:38.899450+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:00:36.656901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.223384+0000","last_change":"2024-09-22T08:36:32.004634+0000","last_active":"2024-09-22T08:37:04.223384+0000","last_peered":"2024-09-22T08:37:04.223384+0000","last_clean":"2024-09-22T08:37:04.223384+0000","last_became_active":"2024-09-22T08:36:32.004269+0000","last_became_peered":"2024-09-22T08:36:32.004269+0000","last_unstale":"2024-09-22T08:37:04.223384+0000","last_undegraded":"2024-09-22T08:37:04.223384+0000","last_fullsized":"2024-09-22T08:37:04.223384+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:51:32.910644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"32'3","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:42.431386+0000","last_change":"2024-09-22T08:36:34.018431+0000","last_active":"2024-09-22T08:37:42.431386+0000","last_peered":"2024-09-22T08:37:42.431386+0000","last_clean":"2024-09-22T08:37:42.431386+0000","last_became_active":"2024-09-22T08:36:34.018190+0000","last_became_peered":"2024-09-22T08:36:34.018190+0000","last_unstale":"2024-09-22T08:37:42.431386+0000","last_undegraded":"2024-09-22T08:37:42.431386+0000","last_fullsized":"2024-09-22T08:37:42.431386+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:09:42.876400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"32'4","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.289565+0000","last_change":"2024-09-22T08:36:25.983379+0000","last_active":"2024-09-22T08:39:32.289565+0000","last_peered":"2024-09-22T08:39:32.289565+0000","last_clean":"2024-09-22T08:39:32.289565+0000","last_became_active":"2024-09-22T08:36:25.983073+0000","last_became_peered":"2024-09-22T08:36:25.983073+0000","last_unstale":"2024-09-22T08:39:32.289565+0000","last_undegraded":"2024-09-22T08:39:32.289565+0000","last_fullsized":"2024-09-22T08:39:32.289565+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:34:22.104673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:05.708471+0000","last_change":"2024-09-22T08:36:23.981302+0000","last_active":"2024-09-22T08:37:05.708471+0000","last_peered":"2024-09-22T08:37:05.708471+0000","last_clean":"2024-09-22T08:37:05.708471+0000","last_became_active":"2024-09-22T08:36:23.980682+0000","last_became_peered":"2024-09-22T08:36:23.980682+0000","last_unstale":"2024-09-22T08:37:05.708471+0000","last_undegraded":"2024-09-22T08:37:05.708471+0000","last_fullsized":"2024-09-22T08:37:05.708471+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:36:38.072840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.225234+0000","last_change":"2024-09-22T08:36:27.985983+0000","last_active":"2024-09-22T08:37:04.225234+0000","last_peered":"2024-09-22T08:37:04.225234+0000","last_clean":"2024-09-22T08:37:04.225234+0000","last_became_active":"2024-09-22T08:36:27.985675+0000","last_became_peered":"2024-09-22T08:36:27.985675+0000","last_unstale":"2024-09-22T08:37:04.225234+0000","last_undegraded":"2024-09-22T08:37:04.225234+0000","last_fullsized":"2024-09-22T08:37:04.225234+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_clean_scrub_stamp":"2024-09-22T08:36:26.962226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:18:38.325978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"32'41","reported_seq":91,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:38.968651+0000","last_change":"2024-09-22T08:36:29.998080+0000","last_active":"2024-09-22T08:39:38.968651+0000","last_peered":"2024-09-22T08:39:38.968651+0000","last_clean":"2024-09-22T08:39:38.968651+0000","last_became_active":"2024-09-22T08:36:29.997542+0000","last_became_peered":"2024-09-22T08:36:29.997542+0000","last_unstale":"2024-09-22T08:39:38.968651+0000","last_undegraded":"2024-09-22T08:39:38.968651+0000","last_fullsized":"2024-09-22T08:39:38.968651+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:42:31.088070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"32'285","reported_seq":351,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:38.830255+0000","last_change":"2024-09-22T08:36:32.005012+0000","last_active":"2024-09-22T08:39:38.830255+0000","last_peered":"2024-09-22T08:39:38.830255+0000","last_clean":"2024-09-22T08:39:38.830255+0000","last_became_active":"2024-09-22T08:36:32.004441+0000","last_became_peered":"2024-09-22T08:36:32.004441+0000","last_unstale":"2024-09-22T08:39:38.830255+0000","last_undegraded":"2024-09-22T08:39:38.830255+0000","last_fullsized":"2024-09-22T08:39:38.830255+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:10:54.748229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.225164+0000","last_change":"2024-09-22T08:36:34.017600+0000","last_active":"2024-09-22T08:37:04.225164+0000","last_peered":"2024-09-22T08:37:04.225164+0000","last_clean":"2024-09-22T08:37:04.225164+0000","last_became_active":"2024-09-22T08:36:34.017217+0000","last_became_peered":"2024-09-22T08:36:34.017217+0000","last_unstale":"2024-09-22T08:37:04.225164+0000","last_undegraded":"2024-09-22T08:37:04.225164+0000","last_fullsized":"2024-09-22T08:37:04.225164+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:43:08.076327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:47.943350+0000","last_change":"2024-09-22T08:36:25.972507+0000","last_active":"2024-09-22T08:37:47.943350+0000","last_peered":"2024-09-22T08:37:47.943350+0000","last_clean":"2024-09-22T08:37:47.943350+0000","last_became_active":"2024-09-22T08:36:25.972198+0000","last_became_peered":"2024-09-22T08:36:25.972198+0000","last_unstale":"2024-09-22T08:37:47.943350+0000","last_undegraded":"2024-09-22T08:37:47.943350+0000","last_fullsized":"2024-09-22T08:37:47.943350+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:41:22.703676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.224935+0000","last_change":"2024-09-22T08:36:23.978560+0000","last_active":"2024-09-22T08:37:04.224935+0000","last_peered":"2024-09-22T08:37:04.224935+0000","last_clean":"2024-09-22T08:37:04.224935+0000","last_became_active":"2024-09-22T08:36:23.978306+0000","last_became_peered":"2024-09-22T08:36:23.978306+0000","last_unstale":"2024-09-22T08:37:04.224935+0000","last_undegraded":"2024-09-22T08:37:04.224935+0000","last_fullsized":"2024-09-22T08:37:04.224935+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:26:33.317627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.224012+0000","last_change":"2024-09-22T08:36:27.986048+0000","last_active":"2024-09-22T08:37:04.224012+0000","last_peered":"2024-09-22T08:37:04.224012+0000","last_clean":"2024-09-22T08:37:04.224012+0000","last_became_active":"2024-09-22T08:36:27.985751+0000","last_became_peered":"2024-09-22T08:36:27.985751+0000","last_unstale":"2024-09-22T08:37:04.224012+0000","last_undegraded":"2024-09-22T08:37:04.224012+0000","last_fullsized":"2024-09-22T08:37:04.224012+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_clean_scrub_stamp":"2024-09-22T08:36:26.962226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:05:30.441634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"32'61","reported_seq":126,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:38.907852+0000","last_change":"2024-09-22T08:36:29.995500+0000","last_active":"2024-09-22T08:39:38.907852+0000","last_peered":"2024-09-22T08:39:38.907852+0000","last_clean":"2024-09-22T08:39:38.907852+0000","last_became_active":"2024-09-22T08:36:29.995225+0000","last_became_peered":"2024-09-22T08:36:29.995225+0000","last_unstale":"2024-09-22T08:39:38.907852+0000","last_undegraded":"2024-09-22T08:39:38.907852+0000","last_fullsized":"2024-09-22T08:39:38.907852+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:06:45.130197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.223232+0000","last_change":"2024-09-22T08:36:32.003118+0000","last_active":"2024-09-22T08:37:04.223232+0000","last_peered":"2024-09-22T08:37:04.223232+0000","last_clean":"2024-09-22T08:37:04.223232+0000","last_became_active":"2024-09-22T08:36:32.002833+0000","last_became_peered":"2024-09-22T08:36:32.002833+0000","last_unstale":"2024-09-22T08:37:04.223232+0000","last_undegraded":"2024-09-22T08:37:04.223232+0000","last_fullsized":"2024-09-22T08:37:04.223232+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:35:19.477576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"32'18","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.383653+0000","last_change":"2024-09-22T08:36:34.015160+0000","last_active":"2024-09-22T08:39:32.383653+0000","last_peered":"2024-09-22T08:39:32.383653+0000","last_clean":"2024-09-22T08:39:32.383653+0000","last_became_active":"2024-09-22T08:36:34.014853+0000","last_became_peered":"2024-09-22T08:36:34.014853+0000","last_unstale":"2024-09-22T08:39:32.383653+0000","last_undegraded":"2024-09-22T08:39:32.383653+0000","last_fullsized":"2024-09-22T08:39:32.383653+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:14:47.722976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"32'12","reported_seq":70,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:48.128311+0000","last_change":"2024-09-22T08:36:25.977939+0000","last_active":"2024-09-22T08:37:48.128311+0000","last_peered":"2024-09-22T08:37:48.128311+0000","last_clean":"2024-09-22T08:37:48.128311+0000","last_became_active":"2024-09-22T08:36:25.977682+0000","last_became_peered":"2024-09-22T08:36:25.977682+0000","last_unstale":"2024-09-22T08:37:48.128311+0000","last_undegraded":"2024-09-22T08:37:48.128311+0000","last_fullsized":"2024-09-22T08:37:48.128311+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:13:46.550224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":47,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.224398+0000","last_change":"2024-09-22T08:36:23.973186+0000","last_active":"2024-09-22T08:37:04.224398+0000","last_peered":"2024-09-22T08:37:04.224398+0000","last_clean":"2024-09-22T08:37:04.224398+0000","last_became_active":"2024-09-22T08:36:23.972822+0000","last_became_peered":"2024-09-22T08:36:23.972822+0000","last_unstale":"2024-09-22T08:37:04.224398+0000","last_undegraded":"2024-09-22T08:37:04.224398+0000","last_fullsized":"2024-09-22T08:37:04.224398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:47:13.913539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.227778+0000","last_change":"2024-09-22T08:36:27.992047+0000","last_active":"2024-09-22T08:37:04.227778+0000","last_peered":"2024-09-22T08:37:04.227778+0000","last_clean":"2024-09-22T08:37:04.227778+0000","last_became_active":"2024-09-22T08:36:27.991761+0000","last_became_peered":"2024-09-22T08:36:27.991761+0000","last_unstale":"2024-09-22T08:37:04.227778+0000","last_undegraded":"2024-09-22T08:37:04.227778+0000","last_fullsized":"2024-09-22T08:37:04.227778+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_clean_scrub_stamp":"2024-09-22T08:36:26.962226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:45:08.688857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"32'35","reported_seq":83,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:38.910893+0000","last_change":"2024-09-22T08:36:29.988696+0000","last_active":"2024-09-22T08:39:38.910893+0000","last_peered":"2024-09-22T08:39:38.910893+0000","last_clean":"2024-09-22T08:39:38.910893+0000","last_became_active":"2024-09-22T08:36:29.988363+0000","last_became_peered":"2024-09-22T08:36:29.988363+0000","last_unstale":"2024-09-22T08:39:38.910893+0000","last_undegraded":"2024-09-22T08:39:38.910893+0000","last_fullsized":"2024-09-22T08:39:38.910893+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:20:15.843523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.229572+0000","last_change":"2024-09-22T08:36:32.012753+0000","last_active":"2024-09-22T08:37:04.229572+0000","last_peered":"2024-09-22T08:37:04.229572+0000","last_clean":"2024-09-22T08:37:04.229572+0000","last_became_active":"2024-09-22T08:36:32.011923+0000","last_became_peered":"2024-09-22T08:36:32.011923+0000","last_unstale":"2024-09-22T08:37:04.229572+0000","last_undegraded":"2024-09-22T08:37:04.229572+0000","last_fullsized":"2024-09-22T08:37:04.229572+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:27:01.625975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"32'3","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:33.182535+0000","last_change":"2024-09-22T08:36:34.013810+0000","last_active":"2024-09-22T08:38:33.182535+0000","last_peered":"2024-09-22T08:38:33.182535+0000","last_clean":"2024-09-22T08:38:33.182535+0000","last_became_active":"2024-09-22T08:36:34.013308+0000","last_became_peered":"2024-09-22T08:36:34.013308+0000","last_unstale":"2024-09-22T08:38:33.182535+0000","last_undegraded":"2024-09-22T08:38:33.182535+0000","last_fullsized":"2024-09-22T08:38:33.182535+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:08:44.619221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"32'6","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.214676+0000","last_change":"2024-09-22T08:36:25.993564+0000","last_active":"2024-09-22T08:39:32.214676+0000","last_peered":"2024-09-22T08:39:32.214676+0000","last_clean":"2024-09-22T08:39:32.214676+0000","last_became_active":"2024-09-22T08:36:25.992167+0000","last_became_peered":"2024-09-22T08:36:25.992167+0000","last_unstale":"2024-09-22T08:39:32.214676+0000","last_undegraded":"2024-09-22T08:39:32.214676+0000","last_fullsized":"2024-09-22T08:39:32.214676+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:39:40.006672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"32'4","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:31.977133+0000","last_change":"2024-09-22T08:36:23.980852+0000","last_active":"2024-09-22T08:39:31.977133+0000","last_peered":"2024-09-22T08:39:31.977133+0000","last_clean":"2024-09-22T08:39:31.977133+0000","last_became_active":"2024-09-22T08:36:23.980560+0000","last_became_peered":"2024-09-22T08:36:23.980560+0000","last_unstale":"2024-09-22T08:39:31.977133+0000","last_undegraded":"2024-09-22T08:39:31.977133+0000","last_fullsized":"2024-09-22T08:39:31.977133+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:21:04.119270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":6,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.226238+0000","last_change":"2024-09-22T08:36:27.984977+0000","last_active":"2024-09-22T08:37:04.226238+0000","last_peered":"2024-09-22T08:37:04.226238+0000","last_clean":"2024-09-22T08:37:04.226238+0000","last_became_active":"2024-09-22T08:36:27.984699+0000","last_became_peered":"2024-09-22T08:36:27.984699+0000","last_unstale":"2024-09-22T08:37:04.226238+0000","last_undegraded":"2024-09-22T08:37:04.226238+0000","last_fullsized":"2024-09-22T08:37:04.226238+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_clean_scrub_stamp":"2024-09-22T08:36:26.962226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:30:42.385182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"32'39","reported_seq":89,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:38.890183+0000","last_change":"2024-09-22T08:36:29.989330+0000","last_active":"2024-09-22T08:39:38.890183+0000","last_peered":"2024-09-22T08:39:38.890183+0000","last_clean":"2024-09-22T08:39:38.890183+0000","last_became_active":"2024-09-22T08:36:29.989049+0000","last_became_peered":"2024-09-22T08:36:29.989049+0000","last_unstale":"2024-09-22T08:39:38.890183+0000","last_undegraded":"2024-09-22T08:39:38.890183+0000","last_fullsized":"2024-09-22T08:39:38.890183+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:25:38.846675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"32'285","reported_seq":455,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:38.825419+0000","last_change":"2024-09-22T08:36:32.003714+0000","last_active":"2024-09-22T08:39:38.825419+0000","last_peered":"2024-09-22T08:39:38.825419+0000","last_clean":"2024-09-22T08:39:38.825419+0000","last_became_active":"2024-09-22T08:36:32.003451+0000","last_became_peered":"2024-09-22T08:36:32.003451+0000","last_unstale":"2024-09-22T08:39:38.825419+0000","last_undegraded":"2024-09-22T08:39:38.825419+0000","last_fullsized":"2024-09-22T08:39:38.825419+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:36:40.009194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"32'12","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:38.177618+0000","last_change":"2024-09-22T08:36:34.017932+0000","last_active":"2024-09-22T08:38:38.177618+0000","last_peered":"2024-09-22T08:38:38.177618+0000","last_clean":"2024-09-22T08:38:38.177618+0000","last_became_active":"2024-09-22T08:36:34.017586+0000","last_became_peered":"2024-09-22T08:36:34.017586+0000","last_unstale":"2024-09-22T08:38:38.177618+0000","last_undegraded":"2024-09-22T08:38:38.177618+0000","last_fullsized":"2024-09-22T08:38:38.177618+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:03:46.243863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"32'6","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:31.996687+0000","last_change":"2024-09-22T08:36:25.984089+0000","last_active":"2024-09-22T08:39:31.996687+0000","last_peered":"2024-09-22T08:39:31.996687+0000","last_clean":"2024-09-22T08:39:31.996687+0000","last_became_active":"2024-09-22T08:36:25.983836+0000","last_became_peered":"2024-09-22T08:36:25.983836+0000","last_unstale":"2024-09-22T08:39:31.996687+0000","last_undegraded":"2024-09-22T08:39:31.996687+0000","last_fullsized":"2024-09-22T08:39:31.996687+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:55:24.968571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":29,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.228027+0000","last_change":"2024-09-22T08:36:23.981996+0000","last_active":"2024-09-22T08:37:04.228027+0000","last_peered":"2024-09-22T08:37:04.228027+0000","last_clean":"2024-09-22T08:37:04.228027+0000","last_became_active":"2024-09-22T08:36:23.981453+0000","last_became_peered":"2024-09-22T08:36:23.981453+0000","last_unstale":"2024-09-22T08:37:04.228027+0000","last_undegraded":"2024-09-22T08:37:04.228027+0000","last_fullsized":"2024-09-22T08:37:04.228027+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:48:13.371475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"32'3","reported_seq":418,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:38.806077+0000","last_change":"2024-09-22T08:36:27.990966+0000","last_active":"2024-09-22T08:39:38.806077+0000","last_peered":"2024-09-22T08:39:38.806077+0000","last_clean":"2024-09-22T08:39:38.806077+0000","last_became_active":"2024-09-22T08:36:27.990658+0000","last_became_peered":"2024-09-22T08:36:27.990658+0000","last_unstale":"2024-09-22T08:39:38.806077+0000","last_undegraded":"2024-09-22T08:39:38.806077+0000","last_fullsized":"2024-09-22T08:39:38.806077+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_clean_scrub_stamp":"2024-09-22T08:36:26.962226+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:46:19.841645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"30'10","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.225133+0000","last_change":"2024-09-22T08:36:29.994653+0000","last_active":"2024-09-22T08:37:04.225133+0000","last_peered":"2024-09-22T08:37:04.225133+0000","last_clean":"2024-09-22T08:37:04.225133+0000","last_became_active":"2024-09-22T08:36:29.994352+0000","last_became_peered":"2024-09-22T08:36:29.994352+0000","last_unstale":"2024-09-22T08:37:04.225133+0000","last_undegraded":"2024-09-22T08:37:04.225133+0000","last_fullsized":"2024-09-22T08:37:04.225133+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:29:42.839928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"32'285","reported_seq":466,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:38.826525+0000","last_change":"2024-09-22T08:36:32.002508+0000","last_active":"2024-09-22T08:39:38.826525+0000","last_peered":"2024-09-22T08:39:38.826525+0000","last_clean":"2024-09-22T08:39:38.826525+0000","last_became_active":"2024-09-22T08:36:32.002222+0000","last_became_peered":"2024-09-22T08:36:32.002222+0000","last_unstale":"2024-09-22T08:39:38.826525+0000","last_undegraded":"2024-09-22T08:39:38.826525+0000","last_fullsized":"2024-09-22T08:39:38.826525+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:01:40.774076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"32'4","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:31.432921+0000","last_change":"2024-09-22T08:36:34.016126+0000","last_active":"2024-09-22T08:38:31.432921+0000","last_peered":"2024-09-22T08:38:31.432921+0000","last_clean":"2024-09-22T08:38:31.432921+0000","last_became_active":"2024-09-22T08:36:34.015833+0000","last_became_peered":"2024-09-22T08:36:34.015833+0000","last_unstale":"2024-09-22T08:38:31.432921+0000","last_undegraded":"2024-09-22T08:38:31.432921+0000","last_fullsized":"2024-09-22T08:38:31.432921+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:08:38.502068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"32'6","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.214644+0000","last_change":"2024-09-22T08:36:25.978129+0000","last_active":"2024-09-22T08:39:32.214644+0000","last_peered":"2024-09-22T08:39:32.214644+0000","last_clean":"2024-09-22T08:39:32.214644+0000","last_became_active":"2024-09-22T08:36:25.977184+0000","last_became_peered":"2024-09-22T08:36:25.977184+0000","last_unstale":"2024-09-22T08:39:32.214644+0000","last_undegraded":"2024-09-22T08:39:32.214644+0000","last_fullsized":"2024-09-22T08:39:32.214644+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:04:17.169545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"32'8","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.210634+0000","last_change":"2024-09-22T08:36:23.976950+0000","last_active":"2024-09-22T08:39:32.210634+0000","last_peered":"2024-09-22T08:39:32.210634+0000","last_clean":"2024-09-22T08:39:32.210634+0000","last_became_active":"2024-09-22T08:36:23.976129+0000","last_became_peered":"2024-09-22T08:36:23.976129+0000","last_unstale":"2024-09-22T08:39:32.210634+0000","last_undegraded":"2024-09-22T08:39:32.210634+0000","last_fullsized":"2024-09-22T08:39:32.210634+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:08:20.789789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":14,"num_write":48,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"23'1","reported_seq":221,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:38.795945+0000","last_change":"2024-09-22T08:36:27.988301+0000","last_active":"2024-09-22T08:39:38.795945+0000","last_peered":"2024-09-22T08:39:38.795945+0000","last_clean":"2024-09-22T08:39:38.795945+0000","last_became_active":"2024-09-22T08:36:27.987999+0000","last_became_peered":"2024-09-22T08:36:27.987999+0000","last_unstale":"2024-09-22T08:39:38.795945+0000","last_undegraded":"2024-09-22T08:39:38.795945+0000","last_fullsized":"2024-09-22T08:39:38.795945+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_clean_scrub_stamp":"2024-09-22T08:36:26.962226+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:18:39.538565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"32'41","reported_seq":92,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:38.948410+0000","last_change":"2024-09-22T08:36:29.992044+0000","last_active":"2024-09-22T08:39:38.948410+0000","last_peered":"2024-09-22T08:39:38.948410+0000","last_clean":"2024-09-22T08:39:38.948410+0000","last_became_active":"2024-09-22T08:36:29.991671+0000","last_became_peered":"2024-09-22T08:36:29.991671+0000","last_unstale":"2024-09-22T08:39:38.948410+0000","last_undegraded":"2024-09-22T08:39:38.948410+0000","last_fullsized":"2024-09-22T08:39:38.948410+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:30:17.519164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.225831+0000","last_change":"2024-09-22T08:36:32.012136+0000","last_active":"2024-09-22T08:37:04.225831+0000","last_peered":"2024-09-22T08:37:04.225831+0000","last_clean":"2024-09-22T08:37:04.225831+0000","last_became_active":"2024-09-22T08:36:32.011845+0000","last_became_peered":"2024-09-22T08:36:32.011845+0000","last_unstale":"2024-09-22T08:37:04.225831+0000","last_undegraded":"2024-09-22T08:37:04.225831+0000","last_fullsized":"2024-09-22T08:37:04.225831+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:30:19.290881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"32'6","reported_seq":25,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.324008+0000","last_change":"2024-09-22T08:36:34.008672+0000","last_active":"2024-09-22T08:39:32.324008+0000","last_peered":"2024-09-22T08:39:32.324008+0000","last_clean":"2024-09-22T08:39:32.324008+0000","last_became_active":"2024-09-22T08:36:34.008374+0000","last_became_peered":"2024-09-22T08:36:34.008374+0000","last_unstale":"2024-09-22T08:39:32.324008+0000","last_undegraded":"2024-09-22T08:39:32.324008+0000","last_fullsized":"2024-09-22T08:39:32.324008+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:58:45.659504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"32'15","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.221742+0000","last_change":"2024-09-22T08:37:04.234725+0000","last_active":"2024-09-22T08:39:32.221742+0000","last_peered":"2024-09-22T08:39:32.221742+0000","last_clean":"2024-09-22T08:39:32.221742+0000","last_became_active":"2024-09-22T08:37:04.228680+0000","last_became_peered":"2024-09-22T08:37:04.228680+0000","last_unstale":"2024-09-22T08:39:32.221742+0000","last_undegraded":"2024-09-22T08:39:32.221742+0000","last_fullsized":"2024-09-22T08:39:32.221742+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:38:57.809846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":62,"num_read_kb":54,"num_write":19,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"12'72","reported_seq":142,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.220993+0000","last_change":"2024-09-22T08:36:10.737141+0000","last_active":"2024-09-22T08:37:04.220993+0000","last_peered":"2024-09-22T08:37:04.220993+0000","last_clean":"2024-09-22T08:37:04.220993+0000","last_became_active":"2024-09-22T08:36:10.736221+0000","last_became_peered":"2024-09-22T08:36:10.736221+0000","last_unstale":"2024-09-22T08:37:04.220993+0000","last_undegraded":"2024-09-22T08:37:04.220993+0000","last_fullsized":"2024-09-22T08:37:04.220993+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:09.401562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:09.401562+0000","last_clean_scrub_stamp":"2024-09-22T08:36:09.401562+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:14:13.135964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.229293+0000","last_change":"2024-09-22T08:36:18.431832+0000","last_active":"2024-09-22T08:37:04.229293+0000","last_peered":"2024-09-22T08:37:04.229293+0000","last_clean":"2024-09-22T08:37:04.229293+0000","last_became_active":"2024-09-22T08:36:16.425465+0000","last_became_peered":"2024-09-22T08:36:16.425465+0000","last_unstale":"2024-09-22T08:37:04.229293+0000","last_undegraded":"2024-09-22T08:37:04.229293+0000","last_fullsized":"2024-09-22T08:37:04.229293+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:15.415268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:15.415268+0000","last_clean_scrub_stamp":"2024-09-22T08:36:15.415268+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:34:11.990226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049376300000000004,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"32'6","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:31.934330+0000","last_change":"2024-09-22T08:36:23.982423+0000","last_active":"2024-09-22T08:39:31.934330+0000","last_peered":"2024-09-22T08:39:31.934330+0000","last_clean":"2024-09-22T08:39:31.934330+0000","last_became_active":"2024-09-22T08:36:23.981576+0000","last_became_peered":"2024-09-22T08:36:23.981576+0000","last_unstale":"2024-09-22T08:39:31.934330+0000","last_undegraded":"2024-09-22T08:39:31.934330+0000","last_fullsized":"2024-09-22T08:39:31.934330+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:44:29.452126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4,"num_write":22,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.223327+0000","last_change":"2024-09-22T08:36:27.991484+0000","last_active":"2024-09-22T08:37:04.223327+0000","last_peered":"2024-09-22T08:37:04.223327+0000","last_clean":"2024-09-22T08:37:04.223327+0000","last_became_active":"2024-09-22T08:36:27.991130+0000","last_became_peered":"2024-09-22T08:36:27.991130+0000","last_unstale":"2024-09-22T08:37:04.223327+0000","last_undegraded":"2024-09-22T08:37:04.223327+0000","last_fullsized":"2024-09-22T08:37:04.223327+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_clean_scrub_stamp":"2024-09-22T08:36:26.962226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:25:36.836271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"32'85","reported_seq":167,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:38.954786+0000","last_change":"2024-09-22T08:36:29.997752+0000","last_active":"2024-09-22T08:39:38.954786+0000","last_peered":"2024-09-22T08:39:38.954786+0000","last_clean":"2024-09-22T08:39:38.954786+0000","last_became_active":"2024-09-22T08:36:29.997294+0000","last_became_peered":"2024-09-22T08:36:29.997294+0000","last_unstale":"2024-09-22T08:39:38.954786+0000","last_undegraded":"2024-09-22T08:39:38.954786+0000","last_fullsized":"2024-09-22T08:39:38.954786+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:18:13.227210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.226456+0000","last_change":"2024-09-22T08:36:32.009096+0000","last_active":"2024-09-22T08:37:04.226456+0000","last_peered":"2024-09-22T08:37:04.226456+0000","last_clean":"2024-09-22T08:37:04.226456+0000","last_became_active":"2024-09-22T08:36:32.008793+0000","last_became_peered":"2024-09-22T08:36:32.008793+0000","last_unstale":"2024-09-22T08:37:04.226456+0000","last_undegraded":"2024-09-22T08:37:04.226456+0000","last_fullsized":"2024-09-22T08:37:04.226456+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:01:07.495676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"32'81","reported_seq":163,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.301899+0000","last_change":"2024-09-22T08:36:34.016827+0000","last_active":"2024-09-22T08:39:32.301899+0000","last_peered":"2024-09-22T08:39:32.301899+0000","last_clean":"2024-09-22T08:39:32.301899+0000","last_became_active":"2024-09-22T08:36:34.016484+0000","last_became_peered":"2024-09-22T08:36:34.016484+0000","last_unstale":"2024-09-22T08:39:32.301899+0000","last_undegraded":"2024-09-22T08:39:32.301899+0000","last_fullsized":"2024-09-22T08:39:32.301899+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:27:41.551286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":223,"num_read_kb":221,"num_write":155,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"32'6","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.289629+0000","last_change":"2024-09-22T08:36:25.988439+0000","last_active":"2024-09-22T08:39:32.289629+0000","last_peered":"2024-09-22T08:39:32.289629+0000","last_clean":"2024-09-22T08:39:32.289629+0000","last_became_active":"2024-09-22T08:36:25.988156+0000","last_became_peered":"2024-09-22T08:36:25.988156+0000","last_unstale":"2024-09-22T08:39:32.289629+0000","last_undegraded":"2024-09-22T08:39:32.289629+0000","last_fullsized":"2024-09-22T08:39:32.289629+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:02:27.083682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.225823+0000","last_change":"2024-09-22T08:36:18.431890+0000","last_active":"2024-09-22T08:37:04.225823+0000","last_peered":"2024-09-22T08:37:04.225823+0000","last_clean":"2024-09-22T08:37:04.225823+0000","last_became_active":"2024-09-22T08:36:16.427252+0000","last_became_peered":"2024-09-22T08:36:16.427252+0000","last_unstale":"2024-09-22T08:37:04.225823+0000","last_undegraded":"2024-09-22T08:37:04.225823+0000","last_fullsized":"2024-09-22T08:37:04.225823+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:15.415268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:15.415268+0000","last_clean_scrub_stamp":"2024-09-22T08:36:15.415268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:11:12.623975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055484200000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.223638+0000","last_change":"2024-09-22T08:36:23.974666+0000","last_active":"2024-09-22T08:37:04.223638+0000","last_peered":"2024-09-22T08:37:04.223638+0000","last_clean":"2024-09-22T08:37:04.223638+0000","last_became_active":"2024-09-22T08:36:23.973773+0000","last_became_peered":"2024-09-22T08:36:23.973773+0000","last_unstale":"2024-09-22T08:37:04.223638+0000","last_undegraded":"2024-09-22T08:37:04.223638+0000","last_fullsized":"2024-09-22T08:37:04.223638+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:04:51.934564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.236920+0000","last_change":"2024-09-22T08:37:04.234583+0000","last_active":"2024-09-22T08:37:04.236920+0000","last_peered":"2024-09-22T08:37:04.236920+0000","last_clean":"2024-09-22T08:37:04.236920+0000","last_became_active":"2024-09-22T08:37:04.234316+0000","last_became_peered":"2024-09-22T08:37:04.234316+0000","last_unstale":"2024-09-22T08:37:04.236920+0000","last_undegraded":"2024-09-22T08:37:04.236920+0000","last_fullsized":"2024-09-22T08:37:04.236920+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_clean_scrub_stamp":"2024-09-22T08:36:26.962226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:12:15.239608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"32'285","reported_seq":501,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:38.952535+0000","last_change":"2024-09-22T08:36:29.996545+0000","last_active":"2024-09-22T08:39:38.952535+0000","last_peered":"2024-09-22T08:39:38.952535+0000","last_clean":"2024-09-22T08:39:38.952535+0000","last_became_active":"2024-09-22T08:36:29.996025+0000","last_became_peered":"2024-09-22T08:36:29.996025+0000","last_unstale":"2024-09-22T08:39:38.952535+0000","last_undegraded":"2024-09-22T08:39:38.952535+0000","last_fullsized":"2024-09-22T08:39:38.952535+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:55:34.543185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":378,"num_read_kb":363,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.227773+0000","last_change":"2024-09-22T08:36:32.013929+0000","last_active":"2024-09-22T08:37:04.227773+0000","last_peered":"2024-09-22T08:37:04.227773+0000","last_clean":"2024-09-22T08:37:04.227773+0000","last_became_active":"2024-09-22T08:36:32.013220+0000","last_became_peered":"2024-09-22T08:36:32.013220+0000","last_unstale":"2024-09-22T08:37:04.227773+0000","last_undegraded":"2024-09-22T08:37:04.227773+0000","last_fullsized":"2024-09-22T08:37:04.227773+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:57:05.813999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"32'5","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:28.578046+0000","last_change":"2024-09-22T08:36:34.018385+0000","last_active":"2024-09-22T08:38:28.578046+0000","last_peered":"2024-09-22T08:38:28.578046+0000","last_clean":"2024-09-22T08:38:28.578046+0000","last_became_active":"2024-09-22T08:36:34.018138+0000","last_became_peered":"2024-09-22T08:36:34.018138+0000","last_unstale":"2024-09-22T08:38:28.578046+0000","last_undegraded":"2024-09-22T08:38:28.578046+0000","last_fullsized":"2024-09-22T08:38:28.578046+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:47:34.849746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"32'8","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.214950+0000","last_change":"2024-09-22T08:36:25.979635+0000","last_active":"2024-09-22T08:39:32.214950+0000","last_peered":"2024-09-22T08:39:32.214950+0000","last_clean":"2024-09-22T08:39:32.214950+0000","last_became_active":"2024-09-22T08:36:25.979108+0000","last_became_peered":"2024-09-22T08:36:25.979108+0000","last_unstale":"2024-09-22T08:39:32.214950+0000","last_undegraded":"2024-09-22T08:39:32.214950+0000","last_fullsized":"2024-09-22T08:39:32.214950+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:18:04.046419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.225590+0000","last_change":"2024-09-22T08:36:18.520219+0000","last_active":"2024-09-22T08:37:04.225590+0000","last_peered":"2024-09-22T08:37:04.225590+0000","last_clean":"2024-09-22T08:37:04.225590+0000","last_became_active":"2024-09-22T08:36:16.427121+0000","last_became_peered":"2024-09-22T08:36:16.427121+0000","last_unstale":"2024-09-22T08:37:04.225590+0000","last_undegraded":"2024-09-22T08:37:04.225590+0000","last_fullsized":"2024-09-22T08:37:04.225590+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:15.415268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:15.415268+0000","last_clean_scrub_stamp":"2024-09-22T08:36:15.415268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:47:57.246114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041194099999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:31.944757+0000","last_change":"2024-09-22T08:36:23.972065+0000","last_active":"2024-09-22T08:39:31.944757+0000","last_peered":"2024-09-22T08:39:31.944757+0000","last_clean":"2024-09-22T08:39:31.944757+0000","last_became_active":"2024-09-22T08:36:23.971688+0000","last_became_peered":"2024-09-22T08:36:23.971688+0000","last_unstale":"2024-09-22T08:39:31.944757+0000","last_undegraded":"2024-09-22T08:39:31.944757+0000","last_fullsized":"2024-09-22T08:39:31.944757+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:57:13.077784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"23'1","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.230019+0000","last_change":"2024-09-22T08:36:27.987350+0000","last_active":"2024-09-22T08:37:04.230019+0000","last_peered":"2024-09-22T08:37:04.230019+0000","last_clean":"2024-09-22T08:37:04.230019+0000","last_became_active":"2024-09-22T08:36:27.986993+0000","last_became_peered":"2024-09-22T08:36:27.986993+0000","last_unstale":"2024-09-22T08:37:04.230019+0000","last_undegraded":"2024-09-22T08:37:04.230019+0000","last_fullsized":"2024-09-22T08:37:04.230019+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_clean_scrub_stamp":"2024-09-22T08:36:26.962226+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:04:19.174975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"32'17","reported_seq":85,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:28.067597+0000","last_change":"2024-09-22T08:36:29.991891+0000","last_active":"2024-09-22T08:39:28.067597+0000","last_peered":"2024-09-22T08:39:28.067597+0000","last_clean":"2024-09-22T08:39:28.067597+0000","last_became_active":"2024-09-22T08:36:29.991579+0000","last_became_peered":"2024-09-22T08:36:29.991579+0000","last_unstale":"2024-09-22T08:39:28.067597+0000","last_undegraded":"2024-09-22T08:39:28.067597+0000","last_fullsized":"2024-09-22T08:39:28.067597+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:17:51.757786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.224585+0000","last_change":"2024-09-22T08:36:32.011889+0000","last_active":"2024-09-22T08:37:04.224585+0000","last_peered":"2024-09-22T08:37:04.224585+0000","last_clean":"2024-09-22T08:37:04.224585+0000","last_became_active":"2024-09-22T08:36:32.011634+0000","last_became_peered":"2024-09-22T08:36:32.011634+0000","last_unstale":"2024-09-22T08:37:04.224585+0000","last_undegraded":"2024-09-22T08:37:04.224585+0000","last_fullsized":"2024-09-22T08:37:04.224585+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:56:34.615539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.226958+0000","last_change":"2024-09-22T08:36:34.012423+0000","last_active":"2024-09-22T08:37:04.226958+0000","last_peered":"2024-09-22T08:37:04.226958+0000","last_clean":"2024-09-22T08:37:04.226958+0000","last_became_active":"2024-09-22T08:36:34.011936+0000","last_became_peered":"2024-09-22T08:36:34.011936+0000","last_unstale":"2024-09-22T08:37:04.226958+0000","last_undegraded":"2024-09-22T08:37:04.226958+0000","last_fullsized":"2024-09-22T08:37:04.226958+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:29:05.565248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"32'3","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:33.176834+0000","last_change":"2024-09-22T08:36:25.977871+0000","last_active":"2024-09-22T08:38:33.176834+0000","last_peered":"2024-09-22T08:38:33.176834+0000","last_clean":"2024-09-22T08:38:33.176834+0000","last_became_active":"2024-09-22T08:36:25.977552+0000","last_became_peered":"2024-09-22T08:36:25.977552+0000","last_unstale":"2024-09-22T08:38:33.176834+0000","last_undegraded":"2024-09-22T08:38:33.176834+0000","last_fullsized":"2024-09-22T08:38:33.176834+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:22:41.119685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.227504+0000","last_change":"2024-09-22T08:36:18.432421+0000","last_active":"2024-09-22T08:37:04.227504+0000","last_peered":"2024-09-22T08:37:04.227504+0000","last_clean":"2024-09-22T08:37:04.227504+0000","last_became_active":"2024-09-22T08:36:16.427358+0000","last_became_peered":"2024-09-22T08:36:16.427358+0000","last_unstale":"2024-09-22T08:37:04.227504+0000","last_undegraded":"2024-09-22T08:37:04.227504+0000","last_fullsized":"2024-09-22T08:37:04.227504+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:15.415268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:15.415268+0000","last_clean_scrub_stamp":"2024-09-22T08:36:15.415268+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:16:15.903021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001068835,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"32'4","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.208130+0000","last_change":"2024-09-22T08:36:23.967690+0000","last_active":"2024-09-22T08:39:32.208130+0000","last_peered":"2024-09-22T08:39:32.208130+0000","last_clean":"2024-09-22T08:39:32.208130+0000","last_became_active":"2024-09-22T08:36:23.967413+0000","last_became_peered":"2024-09-22T08:36:23.967413+0000","last_unstale":"2024-09-22T08:39:32.208130+0000","last_undegraded":"2024-09-22T08:39:32.208130+0000","last_fullsized":"2024-09-22T08:39:32.208130+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:53:44.806098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.225286+0000","last_change":"2024-09-22T08:36:27.988932+0000","last_active":"2024-09-22T08:37:04.225286+0000","last_peered":"2024-09-22T08:37:04.225286+0000","last_clean":"2024-09-22T08:37:04.225286+0000","last_became_active":"2024-09-22T08:36:27.988507+0000","last_became_peered":"2024-09-22T08:36:27.988507+0000","last_unstale":"2024-09-22T08:37:04.225286+0000","last_undegraded":"2024-09-22T08:37:04.225286+0000","last_fullsized":"2024-09-22T08:37:04.225286+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_clean_scrub_stamp":"2024-09-22T08:36:26.962226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:48:06.094834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"32'13","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:31.660162+0000","last_change":"2024-09-22T08:36:29.996842+0000","last_active":"2024-09-22T08:39:31.660162+0000","last_peered":"2024-09-22T08:39:31.660162+0000","last_clean":"2024-09-22T08:39:31.660162+0000","last_became_active":"2024-09-22T08:36:29.996557+0000","last_became_peered":"2024-09-22T08:36:29.996557+0000","last_unstale":"2024-09-22T08:39:31.660162+0000","last_undegraded":"2024-09-22T08:39:31.660162+0000","last_fullsized":"2024-09-22T08:39:31.660162+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:05:26.776730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.229775+0000","last_change":"2024-09-22T08:36:32.014226+0000","last_active":"2024-09-22T08:37:04.229775+0000","last_peered":"2024-09-22T08:37:04.229775+0000","last_clean":"2024-09-22T08:37:04.229775+0000","last_became_active":"2024-09-22T08:36:32.013320+0000","last_became_peered":"2024-09-22T08:36:32.013320+0000","last_unstale":"2024-09-22T08:37:04.229775+0000","last_undegraded":"2024-09-22T08:37:04.229775+0000","last_fullsized":"2024-09-22T08:37:04.229775+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:03:21.762780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"32'4","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:31.413581+0000","last_change":"2024-09-22T08:36:34.015737+0000","last_active":"2024-09-22T08:38:31.413581+0000","last_peered":"2024-09-22T08:38:31.413581+0000","last_clean":"2024-09-22T08:38:31.413581+0000","last_became_active":"2024-09-22T08:36:34.015483+0000","last_became_peered":"2024-09-22T08:36:34.015483+0000","last_unstale":"2024-09-22T08:38:31.413581+0000","last_undegraded":"2024-09-22T08:38:31.413581+0000","last_fullsized":"2024-09-22T08:38:31.413581+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:08:04.974029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"32'8","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.078825+0000","last_change":"2024-09-22T08:36:25.986838+0000","last_active":"2024-09-22T08:39:32.078825+0000","last_peered":"2024-09-22T08:39:32.078825+0000","last_clean":"2024-09-22T08:39:32.078825+0000","last_became_active":"2024-09-22T08:36:25.986551+0000","last_became_peered":"2024-09-22T08:36:25.986551+0000","last_unstale":"2024-09-22T08:39:32.078825+0000","last_undegraded":"2024-09-22T08:39:32.078825+0000","last_fullsized":"2024-09-22T08:39:32.078825+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:52:57.511753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.225659+0000","last_change":"2024-09-22T08:36:23.968878+0000","last_active":"2024-09-22T08:37:04.225659+0000","last_peered":"2024-09-22T08:37:04.225659+0000","last_clean":"2024-09-22T08:37:04.225659+0000","last_became_active":"2024-09-22T08:36:23.968525+0000","last_became_peered":"2024-09-22T08:36:23.968525+0000","last_unstale":"2024-09-22T08:37:04.225659+0000","last_undegraded":"2024-09-22T08:37:04.225659+0000","last_fullsized":"2024-09-22T08:37:04.225659+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:02:28.926834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.224477+0000","last_change":"2024-09-22T08:36:18.434398+0000","last_active":"2024-09-22T08:37:04.224477+0000","last_peered":"2024-09-22T08:37:04.224477+0000","last_clean":"2024-09-22T08:37:04.224477+0000","last_became_active":"2024-09-22T08:36:16.424946+0000","last_became_peered":"2024-09-22T08:36:16.424946+0000","last_unstale":"2024-09-22T08:37:04.224477+0000","last_undegraded":"2024-09-22T08:37:04.224477+0000","last_fullsized":"2024-09-22T08:37:04.224477+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:15.415268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:15.415268+0000","last_clean_scrub_stamp":"2024-09-22T08:36:15.415268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:29:12.209070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045979400000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"32'1","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.404660+0000","last_change":"2024-09-22T08:36:27.988495+0000","last_active":"2024-09-22T08:39:32.404660+0000","last_peered":"2024-09-22T08:39:32.404660+0000","last_clean":"2024-09-22T08:39:32.404660+0000","last_became_active":"2024-09-22T08:36:27.987997+0000","last_became_peered":"2024-09-22T08:36:27.987997+0000","last_unstale":"2024-09-22T08:39:32.404660+0000","last_undegraded":"2024-09-22T08:39:32.404660+0000","last_fullsized":"2024-09-22T08:39:32.404660+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_clean_scrub_stamp":"2024-09-22T08:36:26.962226+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:35:11.843511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"32'69","reported_seq":137,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:38.933063+0000","last_change":"2024-09-22T08:36:29.994493+0000","last_active":"2024-09-22T08:39:38.933063+0000","last_peered":"2024-09-22T08:39:38.933063+0000","last_clean":"2024-09-22T08:39:38.933063+0000","last_became_active":"2024-09-22T08:36:29.994186+0000","last_became_peered":"2024-09-22T08:36:29.994186+0000","last_unstale":"2024-09-22T08:39:38.933063+0000","last_undegraded":"2024-09-22T08:39:38.933063+0000","last_fullsized":"2024-09-22T08:39:38.933063+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:18:59.702792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.228168+0000","last_change":"2024-09-22T08:36:32.003689+0000","last_active":"2024-09-22T08:37:04.228168+0000","last_peered":"2024-09-22T08:37:04.228168+0000","last_clean":"2024-09-22T08:37:04.228168+0000","last_became_active":"2024-09-22T08:36:32.003409+0000","last_became_peered":"2024-09-22T08:36:32.003409+0000","last_unstale":"2024-09-22T08:37:04.228168+0000","last_undegraded":"2024-09-22T08:37:04.228168+0000","last_fullsized":"2024-09-22T08:37:04.228168+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:27:05.933480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"32'13","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:31.589959+0000","last_change":"2024-09-22T08:36:34.013068+0000","last_active":"2024-09-22T08:38:31.589959+0000","last_peered":"2024-09-22T08:38:31.589959+0000","last_clean":"2024-09-22T08:38:31.589959+0000","last_became_active":"2024-09-22T08:36:34.012782+0000","last_became_peered":"2024-09-22T08:36:34.012782+0000","last_unstale":"2024-09-22T08:38:31.589959+0000","last_undegraded":"2024-09-22T08:38:31.589959+0000","last_fullsized":"2024-09-22T08:38:31.589959+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:16:13.410088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":25,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"32'6","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:31.996095+0000","last_change":"2024-09-22T08:36:25.985097+0000","last_active":"2024-09-22T08:39:31.996095+0000","last_peered":"2024-09-22T08:39:31.996095+0000","last_clean":"2024-09-22T08:39:31.996095+0000","last_became_active":"2024-09-22T08:36:25.984820+0000","last_became_peered":"2024-09-22T08:36:25.984820+0000","last_unstale":"2024-09-22T08:39:31.996095+0000","last_undegraded":"2024-09-22T08:39:31.996095+0000","last_fullsized":"2024-09-22T08:39:31.996095+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:42:09.685963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":29,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.613983+0000","last_change":"2024-09-22T08:36:23.974058+0000","last_active":"2024-09-22T08:37:04.613983+0000","last_peered":"2024-09-22T08:37:04.613983+0000","last_clean":"2024-09-22T08:37:04.613983+0000","last_became_active":"2024-09-22T08:36:23.973672+0000","last_became_peered":"2024-09-22T08:36:23.973672+0000","last_unstale":"2024-09-22T08:37:04.613983+0000","last_undegraded":"2024-09-22T08:37:04.613983+0000","last_fullsized":"2024-09-22T08:37:04.613983+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:01:29.462654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.231504+0000","last_change":"2024-09-22T08:36:18.432154+0000","last_active":"2024-09-22T08:37:04.231504+0000","last_peered":"2024-09-22T08:37:04.231504+0000","last_clean":"2024-09-22T08:37:04.231504+0000","last_became_active":"2024-09-22T08:36:16.427154+0000","last_became_peered":"2024-09-22T08:36:16.427154+0000","last_unstale":"2024-09-22T08:37:04.231504+0000","last_undegraded":"2024-09-22T08:37:04.231504+0000","last_fullsized":"2024-09-22T08:37:04.231504+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:15.415268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:15.415268+0000","last_clean_scrub_stamp":"2024-09-22T08:36:15.415268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:44:41.260462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081028899999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.236919+0000","last_change":"2024-09-22T08:37:04.234588+0000","last_active":"2024-09-22T08:37:04.236919+0000","last_peered":"2024-09-22T08:37:04.236919+0000","last_clean":"2024-09-22T08:37:04.236919+0000","last_became_active":"2024-09-22T08:37:04.233981+0000","last_became_peered":"2024-09-22T08:37:04.233981+0000","last_unstale":"2024-09-22T08:37:04.236919+0000","last_undegraded":"2024-09-22T08:37:04.236919+0000","last_fullsized":"2024-09-22T08:37:04.236919+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_clean_scrub_stamp":"2024-09-22T08:36:26.962226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:01:06.235869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"32'15","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:28.585360+0000","last_change":"2024-09-22T08:36:29.995560+0000","last_active":"2024-09-22T08:38:28.585360+0000","last_peered":"2024-09-22T08:38:28.585360+0000","last_clean":"2024-09-22T08:38:28.585360+0000","last_became_active":"2024-09-22T08:36:29.995173+0000","last_became_peered":"2024-09-22T08:36:29.995173+0000","last_unstale":"2024-09-22T08:38:28.585360+0000","last_undegraded":"2024-09-22T08:38:28.585360+0000","last_fullsized":"2024-09-22T08:38:28.585360+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:37:47.696313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"32'285","reported_seq":349,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:38.823080+0000","last_change":"2024-09-22T08:36:32.003255+0000","last_active":"2024-09-22T08:39:38.823080+0000","last_peered":"2024-09-22T08:39:38.823080+0000","last_clean":"2024-09-22T08:39:38.823080+0000","last_became_active":"2024-09-22T08:36:32.002985+0000","last_became_peered":"2024-09-22T08:36:32.002985+0000","last_unstale":"2024-09-22T08:39:38.823080+0000","last_undegraded":"2024-09-22T08:39:38.823080+0000","last_fullsized":"2024-09-22T08:39:38.823080+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:27:39.543678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.227398+0000","last_change":"2024-09-22T08:36:34.019732+0000","last_active":"2024-09-22T08:37:04.227398+0000","last_peered":"2024-09-22T08:37:04.227398+0000","last_clean":"2024-09-22T08:37:04.227398+0000","last_became_active":"2024-09-22T08:36:34.019438+0000","last_became_peered":"2024-09-22T08:36:34.019438+0000","last_unstale":"2024-09-22T08:37:04.227398+0000","last_undegraded":"2024-09-22T08:37:04.227398+0000","last_fullsized":"2024-09-22T08:37:04.227398+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:29:22.767417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"32'3","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.267975+0000","last_change":"2024-09-22T08:36:25.992413+0000","last_active":"2024-09-22T08:39:32.267975+0000","last_peered":"2024-09-22T08:39:32.267975+0000","last_clean":"2024-09-22T08:39:32.267975+0000","last_became_active":"2024-09-22T08:36:25.991480+0000","last_became_peered":"2024-09-22T08:36:25.991480+0000","last_unstale":"2024-09-22T08:39:32.267975+0000","last_undegraded":"2024-09-22T08:39:32.267975+0000","last_fullsized":"2024-09-22T08:39:32.267975+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:10:58.578162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:05.167463+0000","last_change":"2024-09-22T08:37:04.227877+0000","last_active":"2024-09-22T08:37:05.167463+0000","last_peered":"2024-09-22T08:37:05.167463+0000","last_clean":"2024-09-22T08:37:05.167463+0000","last_became_active":"2024-09-22T08:37:04.227561+0000","last_became_peered":"2024-09-22T08:37:04.227561+0000","last_unstale":"2024-09-22T08:37:05.167463+0000","last_undegraded":"2024-09-22T08:37:05.167463+0000","last_fullsized":"2024-09-22T08:37:05.167463+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:00:14.486207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:42.871788+0000","last_change":"2024-09-22T08:39:42.871788+0000","last_active":"2024-09-22T08:39:42.871788+0000","last_peered":"2024-09-22T08:39:42.871788+0000","last_clean":"2024-09-22T08:39:42.871788+0000","last_became_active":"2024-09-22T08:36:16.425549+0000","last_became_peered":"2024-09-22T08:36:16.425549+0000","last_unstale":"2024-09-22T08:39:42.871788+0000","last_undegraded":"2024-09-22T08:39:42.871788+0000","last_fullsized":"2024-09-22T08:39:42.871788+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:39:42.871712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:39:42.871712+0000","last_clean_scrub_stamp":"2024-09-22T08:39:42.871712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:11:04.345633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045809600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.229558+0000","last_change":"2024-09-22T08:36:27.987430+0000","last_active":"2024-09-22T08:37:04.229558+0000","last_peered":"2024-09-22T08:37:04.229558+0000","last_clean":"2024-09-22T08:37:04.229558+0000","last_became_active":"2024-09-22T08:36:27.987074+0000","last_became_peered":"2024-09-22T08:36:27.987074+0000","last_unstale":"2024-09-22T08:37:04.229558+0000","last_undegraded":"2024-09-22T08:37:04.229558+0000","last_fullsized":"2024-09-22T08:37:04.229558+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_clean_scrub_stamp":"2024-09-22T08:36:26.962226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:08:31.905654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"30'10","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.228539+0000","last_change":"2024-09-22T08:36:30.000809+0000","last_active":"2024-09-22T08:37:04.228539+0000","last_peered":"2024-09-22T08:37:04.228539+0000","last_clean":"2024-09-22T08:37:04.228539+0000","last_became_active":"2024-09-22T08:36:29.999965+0000","last_became_peered":"2024-09-22T08:36:29.999965+0000","last_unstale":"2024-09-22T08:37:04.228539+0000","last_undegraded":"2024-09-22T08:37:04.228539+0000","last_fullsized":"2024-09-22T08:37:04.228539+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:05:54.815446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"32'285","reported_seq":392,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:38.828153+0000","last_change":"2024-09-22T08:36:32.005583+0000","last_active":"2024-09-22T08:39:38.828153+0000","last_peered":"2024-09-22T08:39:38.828153+0000","last_clean":"2024-09-22T08:39:38.828153+0000","last_became_active":"2024-09-22T08:36:32.005155+0000","last_became_peered":"2024-09-22T08:36:32.005155+0000","last_unstale":"2024-09-22T08:39:38.828153+0000","last_undegraded":"2024-09-22T08:39:38.828153+0000","last_fullsized":"2024-09-22T08:39:38.828153+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:01:17.946935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"30'5","reported_seq":25,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.223266+0000","last_change":"2024-09-22T08:36:34.022617+0000","last_active":"2024-09-22T08:37:04.223266+0000","last_peered":"2024-09-22T08:37:04.223266+0000","last_clean":"2024-09-22T08:37:04.223266+0000","last_became_active":"2024-09-22T08:36:34.022313+0000","last_became_peered":"2024-09-22T08:36:34.022313+0000","last_unstale":"2024-09-22T08:37:04.223266+0000","last_undegraded":"2024-09-22T08:37:04.223266+0000","last_fullsized":"2024-09-22T08:37:04.223266+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:42:55.182851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":11,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"32'4","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:06.180363+0000","last_change":"2024-09-22T08:36:25.975148+0000","last_active":"2024-09-22T08:37:06.180363+0000","last_peered":"2024-09-22T08:37:06.180363+0000","last_clean":"2024-09-22T08:37:06.180363+0000","last_became_active":"2024-09-22T08:36:25.974884+0000","last_became_peered":"2024-09-22T08:36:25.974884+0000","last_unstale":"2024-09-22T08:37:06.180363+0000","last_undegraded":"2024-09-22T08:37:06.180363+0000","last_fullsized":"2024-09-22T08:37:06.180363+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:22:54.131230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"32'5","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:47.933891+0000","last_change":"2024-09-22T08:36:23.976867+0000","last_active":"2024-09-22T08:37:47.933891+0000","last_peered":"2024-09-22T08:37:47.933891+0000","last_clean":"2024-09-22T08:37:47.933891+0000","last_became_active":"2024-09-22T08:36:23.976646+0000","last_became_peered":"2024-09-22T08:36:23.976646+0000","last_unstale":"2024-09-22T08:37:47.933891+0000","last_undegraded":"2024-09-22T08:37:47.933891+0000","last_fullsized":"2024-09-22T08:37:47.933891+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:26:49.921857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":11,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.229890+0000","last_change":"2024-09-22T08:36:18.432491+0000","last_active":"2024-09-22T08:37:04.229890+0000","last_peered":"2024-09-22T08:37:04.229890+0000","last_clean":"2024-09-22T08:37:04.229890+0000","last_became_active":"2024-09-22T08:36:16.638610+0000","last_became_peered":"2024-09-22T08:36:16.638610+0000","last_unstale":"2024-09-22T08:37:04.229890+0000","last_undegraded":"2024-09-22T08:37:04.229890+0000","last_fullsized":"2024-09-22T08:37:04.229890+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:15.415268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:15.415268+0000","last_clean_scrub_stamp":"2024-09-22T08:36:15.415268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:36:49.729872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001119264,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.226781+0000","last_change":"2024-09-22T08:36:27.985127+0000","last_active":"2024-09-22T08:37:04.226781+0000","last_peered":"2024-09-22T08:37:04.226781+0000","last_clean":"2024-09-22T08:37:04.226781+0000","last_became_active":"2024-09-22T08:36:27.984803+0000","last_became_peered":"2024-09-22T08:36:27.984803+0000","last_unstale":"2024-09-22T08:37:04.226781+0000","last_undegraded":"2024-09-22T08:37:04.226781+0000","last_fullsized":"2024-09-22T08:37:04.226781+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_clean_scrub_stamp":"2024-09-22T08:36:26.962226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:51:28.889992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"32'93","reported_seq":178,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:38.942702+0000","last_change":"2024-09-22T08:36:30.000659+0000","last_active":"2024-09-22T08:39:38.942702+0000","last_peered":"2024-09-22T08:39:38.942702+0000","last_clean":"2024-09-22T08:39:38.942702+0000","last_became_active":"2024-09-22T08:36:30.000270+0000","last_became_peered":"2024-09-22T08:36:30.000270+0000","last_unstale":"2024-09-22T08:39:38.942702+0000","last_undegraded":"2024-09-22T08:39:38.942702+0000","last_fullsized":"2024-09-22T08:39:38.942702+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:27:22.890604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4316,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":99,"num_read_kb":103,"num_write":38,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.223565+0000","last_change":"2024-09-22T08:36:32.003206+0000","last_active":"2024-09-22T08:37:04.223565+0000","last_peered":"2024-09-22T08:37:04.223565+0000","last_clean":"2024-09-22T08:37:04.223565+0000","last_became_active":"2024-09-22T08:36:32.002876+0000","last_became_peered":"2024-09-22T08:36:32.002876+0000","last_unstale":"2024-09-22T08:37:04.223565+0000","last_undegraded":"2024-09-22T08:37:04.223565+0000","last_fullsized":"2024-09-22T08:37:04.223565+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:07:07.136733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"30'2","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.228242+0000","last_change":"2024-09-22T08:36:34.016952+0000","last_active":"2024-09-22T08:37:04.228242+0000","last_peered":"2024-09-22T08:37:04.228242+0000","last_clean":"2024-09-22T08:37:04.228242+0000","last_became_active":"2024-09-22T08:36:34.016659+0000","last_became_peered":"2024-09-22T08:36:34.016659+0000","last_unstale":"2024-09-22T08:37:04.228242+0000","last_undegraded":"2024-09-22T08:37:04.228242+0000","last_fullsized":"2024-09-22T08:37:04.228242+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:01:42.781684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.229370+0000","last_change":"2024-09-22T08:36:34.015661+0000","last_active":"2024-09-22T08:37:04.229370+0000","last_peered":"2024-09-22T08:37:04.229370+0000","last_clean":"2024-09-22T08:37:04.229370+0000","last_became_active":"2024-09-22T08:36:34.015241+0000","last_became_peered":"2024-09-22T08:36:34.015241+0000","last_unstale":"2024-09-22T08:37:04.229370+0000","last_undegraded":"2024-09-22T08:37:04.229370+0000","last_fullsized":"2024-09-22T08:37:04.229370+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:13:28.913225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"32'4","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.259199+0000","last_change":"2024-09-22T08:36:25.987431+0000","last_active":"2024-09-22T08:39:32.259199+0000","last_peered":"2024-09-22T08:39:32.259199+0000","last_clean":"2024-09-22T08:39:32.259199+0000","last_became_active":"2024-09-22T08:36:25.987153+0000","last_became_peered":"2024-09-22T08:36:25.987153+0000","last_unstale":"2024-09-22T08:39:32.259199+0000","last_undegraded":"2024-09-22T08:39:32.259199+0000","last_fullsized":"2024-09-22T08:39:32.259199+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:33:37.909896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.225028+0000","last_change":"2024-09-22T08:36:23.982772+0000","last_active":"2024-09-22T08:37:04.225028+0000","last_peered":"2024-09-22T08:37:04.225028+0000","last_clean":"2024-09-22T08:37:04.225028+0000","last_became_active":"2024-09-22T08:36:23.981927+0000","last_became_peered":"2024-09-22T08:36:23.981927+0000","last_unstale":"2024-09-22T08:37:04.225028+0000","last_undegraded":"2024-09-22T08:37:04.225028+0000","last_fullsized":"2024-09-22T08:37:04.225028+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:12:33.585769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.222089+0000","last_change":"2024-09-22T08:36:27.990795+0000","last_active":"2024-09-22T08:37:04.222089+0000","last_peered":"2024-09-22T08:37:04.222089+0000","last_clean":"2024-09-22T08:37:04.222089+0000","last_became_active":"2024-09-22T08:36:27.990153+0000","last_became_peered":"2024-09-22T08:36:27.990153+0000","last_unstale":"2024-09-22T08:37:04.222089+0000","last_undegraded":"2024-09-22T08:37:04.222089+0000","last_fullsized":"2024-09-22T08:37:04.222089+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_clean_scrub_stamp":"2024-09-22T08:36:26.962226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:44:21.494770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"32'37","reported_seq":85,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:38.965959+0000","last_change":"2024-09-22T08:36:29.998789+0000","last_active":"2024-09-22T08:39:38.965959+0000","last_peered":"2024-09-22T08:39:38.965959+0000","last_clean":"2024-09-22T08:39:38.965959+0000","last_became_active":"2024-09-22T08:36:29.997814+0000","last_became_peered":"2024-09-22T08:36:29.997814+0000","last_unstale":"2024-09-22T08:39:38.965959+0000","last_undegraded":"2024-09-22T08:39:38.965959+0000","last_fullsized":"2024-09-22T08:39:38.965959+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:38:57.806502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":43,"num_read_kb":44,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.226536+0000","last_change":"2024-09-22T08:36:32.012924+0000","last_active":"2024-09-22T08:37:04.226536+0000","last_peered":"2024-09-22T08:37:04.226536+0000","last_clean":"2024-09-22T08:37:04.226536+0000","last_became_active":"2024-09-22T08:36:32.012453+0000","last_became_peered":"2024-09-22T08:36:32.012453+0000","last_unstale":"2024-09-22T08:37:04.226536+0000","last_undegraded":"2024-09-22T08:37:04.226536+0000","last_fullsized":"2024-09-22T08:37:04.226536+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:07:18.464448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"32'3","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:29.962024+0000","last_change":"2024-09-22T08:36:34.022519+0000","last_active":"2024-09-22T08:38:29.962024+0000","last_peered":"2024-09-22T08:38:29.962024+0000","last_clean":"2024-09-22T08:38:29.962024+0000","last_became_active":"2024-09-22T08:36:34.022267+0000","last_became_peered":"2024-09-22T08:36:34.022267+0000","last_unstale":"2024-09-22T08:38:29.962024+0000","last_undegraded":"2024-09-22T08:38:29.962024+0000","last_fullsized":"2024-09-22T08:38:29.962024+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:48:06.628364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"32'6","reported_seq":82,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:05.120194+0000","last_change":"2024-09-22T08:36:25.986871+0000","last_active":"2024-09-22T08:37:05.120194+0000","last_peered":"2024-09-22T08:37:05.120194+0000","last_clean":"2024-09-22T08:37:05.120194+0000","last_became_active":"2024-09-22T08:36:25.986613+0000","last_became_peered":"2024-09-22T08:36:25.986613+0000","last_unstale":"2024-09-22T08:37:05.120194+0000","last_undegraded":"2024-09-22T08:37:05.120194+0000","last_fullsized":"2024-09-22T08:37:05.120194+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:34:39.892614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":60,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.225905+0000","last_change":"2024-09-22T08:36:23.978519+0000","last_active":"2024-09-22T08:37:04.225905+0000","last_peered":"2024-09-22T08:37:04.225905+0000","last_clean":"2024-09-22T08:37:04.225905+0000","last_became_active":"2024-09-22T08:36:23.978282+0000","last_became_peered":"2024-09-22T08:36:23.978282+0000","last_unstale":"2024-09-22T08:37:04.225905+0000","last_undegraded":"2024-09-22T08:37:04.225905+0000","last_fullsized":"2024-09-22T08:37:04.225905+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:27:04.674711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.230277+0000","last_change":"2024-09-22T08:36:27.986336+0000","last_active":"2024-09-22T08:37:04.230277+0000","last_peered":"2024-09-22T08:37:04.230277+0000","last_clean":"2024-09-22T08:37:04.230277+0000","last_became_active":"2024-09-22T08:36:27.986033+0000","last_became_peered":"2024-09-22T08:36:27.986033+0000","last_unstale":"2024-09-22T08:37:04.230277+0000","last_undegraded":"2024-09-22T08:37:04.230277+0000","last_fullsized":"2024-09-22T08:37:04.230277+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_clean_scrub_stamp":"2024-09-22T08:36:26.962226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:54:43.939868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"32'6","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:31.680000+0000","last_change":"2024-09-22T08:36:29.990307+0000","last_active":"2024-09-22T08:39:31.680000+0000","last_peered":"2024-09-22T08:39:31.680000+0000","last_clean":"2024-09-22T08:39:31.680000+0000","last_became_active":"2024-09-22T08:36:29.990057+0000","last_became_peered":"2024-09-22T08:36:29.990057+0000","last_unstale":"2024-09-22T08:39:31.680000+0000","last_undegraded":"2024-09-22T08:39:31.680000+0000","last_fullsized":"2024-09-22T08:39:31.680000+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:20:39.541039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.228183+0000","last_change":"2024-09-22T08:36:32.010964+0000","last_active":"2024-09-22T08:37:04.228183+0000","last_peered":"2024-09-22T08:37:04.228183+0000","last_clean":"2024-09-22T08:37:04.228183+0000","last_became_active":"2024-09-22T08:36:32.010692+0000","last_became_peered":"2024-09-22T08:36:32.010692+0000","last_unstale":"2024-09-22T08:37:04.228183+0000","last_undegraded":"2024-09-22T08:37:04.228183+0000","last_fullsized":"2024-09-22T08:37:04.228183+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:42:56.003470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"32'8","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:31.738292+0000","last_change":"2024-09-22T08:36:34.017610+0000","last_active":"2024-09-22T08:39:31.738292+0000","last_peered":"2024-09-22T08:39:31.738292+0000","last_clean":"2024-09-22T08:39:31.738292+0000","last_became_active":"2024-09-22T08:36:34.017181+0000","last_became_peered":"2024-09-22T08:36:34.017181+0000","last_unstale":"2024-09-22T08:39:31.738292+0000","last_undegraded":"2024-09-22T08:39:31.738292+0000","last_fullsized":"2024-09-22T08:39:31.738292+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:00:36.254978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":21,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"32'6","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.214871+0000","last_change":"2024-09-22T08:36:25.975177+0000","last_active":"2024-09-22T08:39:32.214871+0000","last_peered":"2024-09-22T08:39:32.214871+0000","last_clean":"2024-09-22T08:39:32.214871+0000","last_became_active":"2024-09-22T08:36:25.974797+0000","last_became_peered":"2024-09-22T08:36:25.974797+0000","last_unstale":"2024-09-22T08:39:32.214871+0000","last_undegraded":"2024-09-22T08:39:32.214871+0000","last_fullsized":"2024-09-22T08:39:32.214871+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:45:56.482158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.613051+0000","last_change":"2024-09-22T08:36:23.974236+0000","last_active":"2024-09-22T08:37:04.613051+0000","last_peered":"2024-09-22T08:37:04.613051+0000","last_clean":"2024-09-22T08:37:04.613051+0000","last_became_active":"2024-09-22T08:36:23.973601+0000","last_became_peered":"2024-09-22T08:36:23.973601+0000","last_unstale":"2024-09-22T08:37:04.613051+0000","last_undegraded":"2024-09-22T08:37:04.613051+0000","last_fullsized":"2024-09-22T08:37:04.613051+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:39:33.026572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.222812+0000","last_change":"2024-09-22T08:36:27.986446+0000","last_active":"2024-09-22T08:37:04.222812+0000","last_peered":"2024-09-22T08:37:04.222812+0000","last_clean":"2024-09-22T08:37:04.222812+0000","last_became_active":"2024-09-22T08:36:27.986100+0000","last_became_peered":"2024-09-22T08:36:27.986100+0000","last_unstale":"2024-09-22T08:37:04.222812+0000","last_undegraded":"2024-09-22T08:37:04.222812+0000","last_fullsized":"2024-09-22T08:37:04.222812+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_clean_scrub_stamp":"2024-09-22T08:36:26.962226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:23:06.708649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"32'43","reported_seq":107,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:38.926827+0000","last_change":"2024-09-22T08:36:29.992078+0000","last_active":"2024-09-22T08:39:38.926827+0000","last_peered":"2024-09-22T08:39:38.926827+0000","last_clean":"2024-09-22T08:39:38.926827+0000","last_became_active":"2024-09-22T08:36:29.991732+0000","last_became_peered":"2024-09-22T08:36:29.991732+0000","last_unstale":"2024-09-22T08:39:38.926827+0000","last_undegraded":"2024-09-22T08:39:38.926827+0000","last_fullsized":"2024-09-22T08:39:38.926827+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:54:46.326822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.221450+0000","last_change":"2024-09-22T08:36:32.003244+0000","last_active":"2024-09-22T08:37:04.221450+0000","last_peered":"2024-09-22T08:37:04.221450+0000","last_clean":"2024-09-22T08:37:04.221450+0000","last_became_active":"2024-09-22T08:36:32.002970+0000","last_became_peered":"2024-09-22T08:36:32.002970+0000","last_unstale":"2024-09-22T08:37:04.221450+0000","last_undegraded":"2024-09-22T08:37:04.221450+0000","last_fullsized":"2024-09-22T08:37:04.221450+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:19:57.326474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"32'4","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.344891+0000","last_change":"2024-09-22T08:36:34.016939+0000","last_active":"2024-09-22T08:39:32.344891+0000","last_peered":"2024-09-22T08:39:32.344891+0000","last_clean":"2024-09-22T08:39:32.344891+0000","last_became_active":"2024-09-22T08:36:34.016379+0000","last_became_peered":"2024-09-22T08:36:34.016379+0000","last_unstale":"2024-09-22T08:39:32.344891+0000","last_undegraded":"2024-09-22T08:39:32.344891+0000","last_fullsized":"2024-09-22T08:39:32.344891+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:50:54.870215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":421,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"32'6","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:28.582884+0000","last_change":"2024-09-22T08:36:25.988849+0000","last_active":"2024-09-22T08:38:28.582884+0000","last_peered":"2024-09-22T08:38:28.582884+0000","last_clean":"2024-09-22T08:38:28.582884+0000","last_became_active":"2024-09-22T08:36:25.988569+0000","last_became_peered":"2024-09-22T08:36:25.988569+0000","last_unstale":"2024-09-22T08:38:28.582884+0000","last_undegraded":"2024-09-22T08:38:28.582884+0000","last_fullsized":"2024-09-22T08:38:28.582884+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:18:26.519986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.224287+0000","last_change":"2024-09-22T08:36:23.977609+0000","last_active":"2024-09-22T08:37:04.224287+0000","last_peered":"2024-09-22T08:37:04.224287+0000","last_clean":"2024-09-22T08:37:04.224287+0000","last_became_active":"2024-09-22T08:36:23.977355+0000","last_became_peered":"2024-09-22T08:36:23.977355+0000","last_unstale":"2024-09-22T08:37:04.224287+0000","last_undegraded":"2024-09-22T08:37:04.224287+0000","last_fullsized":"2024-09-22T08:37:04.224287+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:58:35.337314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"32'4","reported_seq":229,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:38.795223+0000","last_change":"2024-09-22T08:36:27.987952+0000","last_active":"2024-09-22T08:39:38.795223+0000","last_peered":"2024-09-22T08:39:38.795223+0000","last_clean":"2024-09-22T08:39:38.795223+0000","last_became_active":"2024-09-22T08:36:27.987561+0000","last_became_peered":"2024-09-22T08:36:27.987561+0000","last_unstale":"2024-09-22T08:39:38.795223+0000","last_undegraded":"2024-09-22T08:39:38.795223+0000","last_fullsized":"2024-09-22T08:39:38.795223+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_clean_scrub_stamp":"2024-09-22T08:36:26.962226+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:59:38.794944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"32'34","reported_seq":81,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:38.917623+0000","last_change":"2024-09-22T08:36:29.989156+0000","last_active":"2024-09-22T08:39:38.917623+0000","last_peered":"2024-09-22T08:39:38.917623+0000","last_clean":"2024-09-22T08:39:38.917623+0000","last_became_active":"2024-09-22T08:36:29.988607+0000","last_became_peered":"2024-09-22T08:36:29.988607+0000","last_unstale":"2024-09-22T08:39:38.917623+0000","last_undegraded":"2024-09-22T08:39:38.917623+0000","last_fullsized":"2024-09-22T08:39:38.917623+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:59:53.178494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.225600+0000","last_change":"2024-09-22T08:36:32.003908+0000","last_active":"2024-09-22T08:37:04.225600+0000","last_peered":"2024-09-22T08:37:04.225600+0000","last_clean":"2024-09-22T08:37:04.225600+0000","last_became_active":"2024-09-22T08:36:32.003651+0000","last_became_peered":"2024-09-22T08:36:32.003651+0000","last_unstale":"2024-09-22T08:37:04.225600+0000","last_undegraded":"2024-09-22T08:37:04.225600+0000","last_fullsized":"2024-09-22T08:37:04.225600+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:39:25.611419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"32'10","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.259871+0000","last_change":"2024-09-22T08:36:25.990717+0000","last_active":"2024-09-22T08:39:32.259871+0000","last_peered":"2024-09-22T08:39:32.259871+0000","last_clean":"2024-09-22T08:39:32.259871+0000","last_became_active":"2024-09-22T08:36:25.989711+0000","last_became_peered":"2024-09-22T08:36:25.989711+0000","last_unstale":"2024-09-22T08:39:32.259871+0000","last_undegraded":"2024-09-22T08:39:32.259871+0000","last_fullsized":"2024-09-22T08:39:32.259871+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:59:02.745529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.226013+0000","last_change":"2024-09-22T08:36:23.976596+0000","last_active":"2024-09-22T08:37:04.226013+0000","last_peered":"2024-09-22T08:37:04.226013+0000","last_clean":"2024-09-22T08:37:04.226013+0000","last_became_active":"2024-09-22T08:36:23.976361+0000","last_became_peered":"2024-09-22T08:36:23.976361+0000","last_unstale":"2024-09-22T08:37:04.226013+0000","last_undegraded":"2024-09-22T08:37:04.226013+0000","last_fullsized":"2024-09-22T08:37:04.226013+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:18:29.806715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.226375+0000","last_change":"2024-09-22T08:36:27.988289+0000","last_active":"2024-09-22T08:37:04.226375+0000","last_peered":"2024-09-22T08:37:04.226375+0000","last_clean":"2024-09-22T08:37:04.226375+0000","last_became_active":"2024-09-22T08:36:27.987981+0000","last_became_peered":"2024-09-22T08:36:27.987981+0000","last_unstale":"2024-09-22T08:37:04.226375+0000","last_undegraded":"2024-09-22T08:37:04.226375+0000","last_fullsized":"2024-09-22T08:37:04.226375+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_clean_scrub_stamp":"2024-09-22T08:36:26.962226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:43:32.535149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"32'61","reported_seq":126,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:38.914421+0000","last_change":"2024-09-22T08:36:29.990823+0000","last_active":"2024-09-22T08:39:38.914421+0000","last_peered":"2024-09-22T08:39:38.914421+0000","last_clean":"2024-09-22T08:39:38.914421+0000","last_became_active":"2024-09-22T08:36:29.990585+0000","last_became_peered":"2024-09-22T08:36:29.990585+0000","last_unstale":"2024-09-22T08:39:38.914421+0000","last_undegraded":"2024-09-22T08:39:38.914421+0000","last_fullsized":"2024-09-22T08:39:38.914421+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:09:56.176060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.226461+0000","last_change":"2024-09-22T08:36:32.007693+0000","last_active":"2024-09-22T08:37:04.226461+0000","last_peered":"2024-09-22T08:37:04.226461+0000","last_clean":"2024-09-22T08:37:04.226461+0000","last_became_active":"2024-09-22T08:36:32.007448+0000","last_became_peered":"2024-09-22T08:36:32.007448+0000","last_unstale":"2024-09-22T08:37:04.226461+0000","last_undegraded":"2024-09-22T08:37:04.226461+0000","last_fullsized":"2024-09-22T08:37:04.226461+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:30:19.529413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"32'16","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.263979+0000","last_change":"2024-09-22T08:36:34.017989+0000","last_active":"2024-09-22T08:39:32.263979+0000","last_peered":"2024-09-22T08:39:32.263979+0000","last_clean":"2024-09-22T08:39:32.263979+0000","last_became_active":"2024-09-22T08:36:34.017689+0000","last_became_peered":"2024-09-22T08:36:34.017689+0000","last_unstale":"2024-09-22T08:39:32.263979+0000","last_undegraded":"2024-09-22T08:39:32.263979+0000","last_fullsized":"2024-09-22T08:39:32.263979+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:59:28.875467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":21,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"32'2","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.260499+0000","last_change":"2024-09-22T08:36:25.978215+0000","last_active":"2024-09-22T08:39:32.260499+0000","last_peered":"2024-09-22T08:39:32.260499+0000","last_clean":"2024-09-22T08:39:32.260499+0000","last_became_active":"2024-09-22T08:36:25.977881+0000","last_became_peered":"2024-09-22T08:36:25.977881+0000","last_unstale":"2024-09-22T08:39:32.260499+0000","last_undegraded":"2024-09-22T08:39:32.260499+0000","last_fullsized":"2024-09-22T08:39:32.260499+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:49:05.012514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.221193+0000","last_change":"2024-09-22T08:36:23.975068+0000","last_active":"2024-09-22T08:37:04.221193+0000","last_peered":"2024-09-22T08:37:04.221193+0000","last_clean":"2024-09-22T08:37:04.221193+0000","last_became_active":"2024-09-22T08:36:23.974809+0000","last_became_peered":"2024-09-22T08:36:23.974809+0000","last_unstale":"2024-09-22T08:37:04.221193+0000","last_undegraded":"2024-09-22T08:37:04.221193+0000","last_fullsized":"2024-09-22T08:37:04.221193+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:07:03.805843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.228600+0000","last_change":"2024-09-22T08:36:27.987444+0000","last_active":"2024-09-22T08:37:04.228600+0000","last_peered":"2024-09-22T08:37:04.228600+0000","last_clean":"2024-09-22T08:37:04.228600+0000","last_became_active":"2024-09-22T08:36:27.986957+0000","last_became_peered":"2024-09-22T08:36:27.986957+0000","last_unstale":"2024-09-22T08:37:04.228600+0000","last_undegraded":"2024-09-22T08:37:04.228600+0000","last_fullsized":"2024-09-22T08:37:04.228600+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_clean_scrub_stamp":"2024-09-22T08:36:26.962226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:12:16.352882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"32'39","reported_seq":89,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:38.920740+0000","last_change":"2024-09-22T08:36:29.998426+0000","last_active":"2024-09-22T08:39:38.920740+0000","last_peered":"2024-09-22T08:39:38.920740+0000","last_clean":"2024-09-22T08:39:38.920740+0000","last_became_active":"2024-09-22T08:36:29.997527+0000","last_became_peered":"2024-09-22T08:36:29.997527+0000","last_unstale":"2024-09-22T08:39:38.920740+0000","last_undegraded":"2024-09-22T08:39:38.920740+0000","last_fullsized":"2024-09-22T08:39:38.920740+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:26:30.343603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.224280+0000","last_change":"2024-09-22T08:36:32.005672+0000","last_active":"2024-09-22T08:37:04.224280+0000","last_peered":"2024-09-22T08:37:04.224280+0000","last_clean":"2024-09-22T08:37:04.224280+0000","last_became_active":"2024-09-22T08:36:32.005383+0000","last_became_peered":"2024-09-22T08:36:32.005383+0000","last_unstale":"2024-09-22T08:37:04.224280+0000","last_undegraded":"2024-09-22T08:37:04.224280+0000","last_fullsized":"2024-09-22T08:37:04.224280+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:13:26.905617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.227134+0000","last_change":"2024-09-22T08:36:34.013499+0000","last_active":"2024-09-22T08:37:04.227134+0000","last_peered":"2024-09-22T08:37:04.227134+0000","last_clean":"2024-09-22T08:37:04.227134+0000","last_became_active":"2024-09-22T08:36:34.013204+0000","last_became_peered":"2024-09-22T08:36:34.013204+0000","last_unstale":"2024-09-22T08:37:04.227134+0000","last_undegraded":"2024-09-22T08:37:04.227134+0000","last_fullsized":"2024-09-22T08:37:04.227134+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:37:55.724456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"32'14","reported_seq":66,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.268386+0000","last_change":"2024-09-22T08:36:25.993915+0000","last_active":"2024-09-22T08:39:32.268386+0000","last_peered":"2024-09-22T08:39:32.268386+0000","last_clean":"2024-09-22T08:39:32.268386+0000","last_became_active":"2024-09-22T08:36:25.993170+0000","last_became_peered":"2024-09-22T08:36:25.993170+0000","last_unstale":"2024-09-22T08:39:32.268386+0000","last_undegraded":"2024-09-22T08:39:32.268386+0000","last_fullsized":"2024-09-22T08:39:32.268386+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:39:33.156873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":38,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.221803+0000","last_change":"2024-09-22T08:36:23.968477+0000","last_active":"2024-09-22T08:37:04.221803+0000","last_peered":"2024-09-22T08:37:04.221803+0000","last_clean":"2024-09-22T08:37:04.221803+0000","last_became_active":"2024-09-22T08:36:23.968207+0000","last_became_peered":"2024-09-22T08:36:23.968207+0000","last_unstale":"2024-09-22T08:37:04.221803+0000","last_undegraded":"2024-09-22T08:37:04.221803+0000","last_fullsized":"2024-09-22T08:37:04.221803+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:13:42.558254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.226357+0000","last_change":"2024-09-22T08:36:27.986023+0000","last_active":"2024-09-22T08:37:04.226357+0000","last_peered":"2024-09-22T08:37:04.226357+0000","last_clean":"2024-09-22T08:37:04.226357+0000","last_became_active":"2024-09-22T08:36:27.985679+0000","last_became_peered":"2024-09-22T08:36:27.985679+0000","last_unstale":"2024-09-22T08:37:04.226357+0000","last_undegraded":"2024-09-22T08:37:04.226357+0000","last_fullsized":"2024-09-22T08:37:04.226357+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_clean_scrub_stamp":"2024-09-22T08:36:26.962226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:14:11.716507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"32'35","reported_seq":83,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:38.874031+0000","last_change":"2024-09-22T08:36:29.994386+0000","last_active":"2024-09-22T08:39:38.874031+0000","last_peered":"2024-09-22T08:39:38.874031+0000","last_clean":"2024-09-22T08:39:38.874031+0000","last_became_active":"2024-09-22T08:36:29.994075+0000","last_became_peered":"2024-09-22T08:36:29.994075+0000","last_unstale":"2024-09-22T08:39:38.874031+0000","last_undegraded":"2024-09-22T08:39:38.874031+0000","last_fullsized":"2024-09-22T08:39:38.874031+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:01:51.899745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.225288+0000","last_change":"2024-09-22T08:36:32.005675+0000","last_active":"2024-09-22T08:37:04.225288+0000","last_peered":"2024-09-22T08:37:04.225288+0000","last_clean":"2024-09-22T08:37:04.225288+0000","last_became_active":"2024-09-22T08:36:32.005166+0000","last_became_peered":"2024-09-22T08:36:32.005166+0000","last_unstale":"2024-09-22T08:37:04.225288+0000","last_undegraded":"2024-09-22T08:37:04.225288+0000","last_fullsized":"2024-09-22T08:37:04.225288+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:04:54.919867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"32'7","reported_seq":25,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.093378+0000","last_change":"2024-09-22T08:36:34.014540+0000","last_active":"2024-09-22T08:39:32.093378+0000","last_peered":"2024-09-22T08:39:32.093378+0000","last_clean":"2024-09-22T08:39:32.093378+0000","last_became_active":"2024-09-22T08:36:34.014255+0000","last_became_peered":"2024-09-22T08:36:34.014255+0000","last_unstale":"2024-09-22T08:39:32.093378+0000","last_undegraded":"2024-09-22T08:39:32.093378+0000","last_fullsized":"2024-09-22T08:39:32.093378+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:47:25.081359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"32'4","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.078924+0000","last_change":"2024-09-22T08:36:25.978994+0000","last_active":"2024-09-22T08:39:32.078924+0000","last_peered":"2024-09-22T08:39:32.078924+0000","last_clean":"2024-09-22T08:39:32.078924+0000","last_became_active":"2024-09-22T08:36:25.978577+0000","last_became_peered":"2024-09-22T08:36:25.978577+0000","last_unstale":"2024-09-22T08:39:32.078924+0000","last_undegraded":"2024-09-22T08:39:32.078924+0000","last_fullsized":"2024-09-22T08:39:32.078924+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:02:49.260377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"32'2","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:08.164913+0000","last_change":"2024-09-22T08:37:04.226650+0000","last_active":"2024-09-22T08:37:08.164913+0000","last_peered":"2024-09-22T08:37:08.164913+0000","last_clean":"2024-09-22T08:37:08.164913+0000","last_became_active":"2024-09-22T08:37:04.226169+0000","last_became_peered":"2024-09-22T08:37:04.226169+0000","last_unstale":"2024-09-22T08:37:08.164913+0000","last_undegraded":"2024-09-22T08:37:08.164913+0000","last_fullsized":"2024-09-22T08:37:08.164913+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:34:07.480067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.223988+0000","last_change":"2024-09-22T08:36:27.990314+0000","last_active":"2024-09-22T08:37:04.223988+0000","last_peered":"2024-09-22T08:37:04.223988+0000","last_clean":"2024-09-22T08:37:04.223988+0000","last_became_active":"2024-09-22T08:36:27.990038+0000","last_became_peered":"2024-09-22T08:36:27.990038+0000","last_unstale":"2024-09-22T08:37:04.223988+0000","last_undegraded":"2024-09-22T08:37:04.223988+0000","last_fullsized":"2024-09-22T08:37:04.223988+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_clean_scrub_stamp":"2024-09-22T08:36:26.962226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:42:33.084977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"30'10","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.227216+0000","last_change":"2024-09-22T08:36:29.997480+0000","last_active":"2024-09-22T08:37:04.227216+0000","last_peered":"2024-09-22T08:37:04.227216+0000","last_clean":"2024-09-22T08:37:04.227216+0000","last_became_active":"2024-09-22T08:36:29.997179+0000","last_became_peered":"2024-09-22T08:36:29.997179+0000","last_unstale":"2024-09-22T08:37:04.227216+0000","last_undegraded":"2024-09-22T08:37:04.227216+0000","last_fullsized":"2024-09-22T08:37:04.227216+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:42:36.332989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"32'285","reported_seq":369,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:38.821270+0000","last_change":"2024-09-22T08:36:32.012171+0000","last_active":"2024-09-22T08:39:38.821270+0000","last_peered":"2024-09-22T08:39:38.821270+0000","last_clean":"2024-09-22T08:39:38.821270+0000","last_became_active":"2024-09-22T08:36:32.011870+0000","last_became_peered":"2024-09-22T08:36:32.011870+0000","last_unstale":"2024-09-22T08:39:38.821270+0000","last_undegraded":"2024-09-22T08:39:38.821270+0000","last_fullsized":"2024-09-22T08:39:38.821270+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:20:17.853772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"32'2","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.248674+0000","last_change":"2024-09-22T08:36:34.013756+0000","last_active":"2024-09-22T08:39:32.248674+0000","last_peered":"2024-09-22T08:39:32.248674+0000","last_clean":"2024-09-22T08:39:32.248674+0000","last_became_active":"2024-09-22T08:36:34.013380+0000","last_became_peered":"2024-09-22T08:36:34.013380+0000","last_unstale":"2024-09-22T08:39:32.248674+0000","last_undegraded":"2024-09-22T08:39:32.248674+0000","last_fullsized":"2024-09-22T08:39:32.248674+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:26:36.228816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"32'8","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:31.647867+0000","last_change":"2024-09-22T08:36:25.971626+0000","last_active":"2024-09-22T08:38:31.647867+0000","last_peered":"2024-09-22T08:38:31.647867+0000","last_clean":"2024-09-22T08:38:31.647867+0000","last_became_active":"2024-09-22T08:36:25.971327+0000","last_became_peered":"2024-09-22T08:36:25.971327+0000","last_unstale":"2024-09-22T08:38:31.647867+0000","last_undegraded":"2024-09-22T08:38:31.647867+0000","last_fullsized":"2024-09-22T08:38:31.647867+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:06:32.443392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.284576+0000","last_change":"2024-09-22T08:36:23.978262+0000","last_active":"2024-09-22T08:39:32.284576+0000","last_peered":"2024-09-22T08:39:32.284576+0000","last_clean":"2024-09-22T08:39:32.284576+0000","last_became_active":"2024-09-22T08:36:23.978006+0000","last_became_peered":"2024-09-22T08:36:23.978006+0000","last_unstale":"2024-09-22T08:39:32.284576+0000","last_undegraded":"2024-09-22T08:39:32.284576+0000","last_fullsized":"2024-09-22T08:39:32.284576+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:02:28.926834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.222677+0000","last_change":"2024-09-22T08:36:27.991045+0000","last_active":"2024-09-22T08:37:04.222677+0000","last_peered":"2024-09-22T08:37:04.222677+0000","last_clean":"2024-09-22T08:37:04.222677+0000","last_became_active":"2024-09-22T08:36:27.990729+0000","last_became_peered":"2024-09-22T08:36:27.990729+0000","last_unstale":"2024-09-22T08:37:04.222677+0000","last_undegraded":"2024-09-22T08:37:04.222677+0000","last_fullsized":"2024-09-22T08:37:04.222677+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_clean_scrub_stamp":"2024-09-22T08:36:26.962226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:27:20.880200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"32'39","reported_seq":89,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:38.893091+0000","last_change":"2024-09-22T08:36:29.987777+0000","last_active":"2024-09-22T08:39:38.893091+0000","last_peered":"2024-09-22T08:39:38.893091+0000","last_clean":"2024-09-22T08:39:38.893091+0000","last_became_active":"2024-09-22T08:36:29.987459+0000","last_became_peered":"2024-09-22T08:36:29.987459+0000","last_unstale":"2024-09-22T08:39:38.893091+0000","last_undegraded":"2024-09-22T08:39:38.893091+0000","last_fullsized":"2024-09-22T08:39:38.893091+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:30:17.280632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.222754+0000","last_change":"2024-09-22T08:36:32.003472+0000","last_active":"2024-09-22T08:37:04.222754+0000","last_peered":"2024-09-22T08:37:04.222754+0000","last_clean":"2024-09-22T08:37:04.222754+0000","last_became_active":"2024-09-22T08:36:32.003196+0000","last_became_peered":"2024-09-22T08:36:32.003196+0000","last_unstale":"2024-09-22T08:37:04.222754+0000","last_undegraded":"2024-09-22T08:37:04.222754+0000","last_fullsized":"2024-09-22T08:37:04.222754+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:42:54.487167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.223793+0000","last_change":"2024-09-22T08:36:34.016292+0000","last_active":"2024-09-22T08:37:04.223793+0000","last_peered":"2024-09-22T08:37:04.223793+0000","last_clean":"2024-09-22T08:37:04.223793+0000","last_became_active":"2024-09-22T08:36:34.015988+0000","last_became_peered":"2024-09-22T08:36:34.015988+0000","last_unstale":"2024-09-22T08:37:04.223793+0000","last_undegraded":"2024-09-22T08:37:04.223793+0000","last_fullsized":"2024-09-22T08:37:04.223793+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:16:42.030515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"32'4","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:31.648006+0000","last_change":"2024-09-22T08:36:25.972487+0000","last_active":"2024-09-22T08:38:31.648006+0000","last_peered":"2024-09-22T08:38:31.648006+0000","last_clean":"2024-09-22T08:38:31.648006+0000","last_became_active":"2024-09-22T08:36:25.972149+0000","last_became_peered":"2024-09-22T08:36:25.972149+0000","last_unstale":"2024-09-22T08:38:31.648006+0000","last_undegraded":"2024-09-22T08:38:31.648006+0000","last_fullsized":"2024-09-22T08:38:31.648006+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:06:31.006207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:31.910942+0000","last_change":"2024-09-22T08:36:23.983004+0000","last_active":"2024-09-22T08:39:31.910942+0000","last_peered":"2024-09-22T08:39:31.910942+0000","last_clean":"2024-09-22T08:39:31.910942+0000","last_became_active":"2024-09-22T08:36:23.982545+0000","last_became_peered":"2024-09-22T08:36:23.982545+0000","last_unstale":"2024-09-22T08:39:31.910942+0000","last_undegraded":"2024-09-22T08:39:31.910942+0000","last_fullsized":"2024-09-22T08:39:31.910942+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:02:24.513946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.225495+0000","last_change":"2024-09-22T08:36:27.989826+0000","last_active":"2024-09-22T08:37:04.225495+0000","last_peered":"2024-09-22T08:37:04.225495+0000","last_clean":"2024-09-22T08:37:04.225495+0000","last_became_active":"2024-09-22T08:36:27.989495+0000","last_became_peered":"2024-09-22T08:36:27.989495+0000","last_unstale":"2024-09-22T08:37:04.225495+0000","last_undegraded":"2024-09-22T08:37:04.225495+0000","last_fullsized":"2024-09-22T08:37:04.225495+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_clean_scrub_stamp":"2024-09-22T08:36:26.962226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:36:51.183212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"32'33","reported_seq":80,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:38.896594+0000","last_change":"2024-09-22T08:36:29.994337+0000","last_active":"2024-09-22T08:39:38.896594+0000","last_peered":"2024-09-22T08:39:38.896594+0000","last_clean":"2024-09-22T08:39:38.896594+0000","last_became_active":"2024-09-22T08:36:29.994101+0000","last_became_peered":"2024-09-22T08:36:29.994101+0000","last_unstale":"2024-09-22T08:39:38.896594+0000","last_undegraded":"2024-09-22T08:39:38.896594+0000","last_fullsized":"2024-09-22T08:39:38.896594+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:40:06.073383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.230375+0000","last_change":"2024-09-22T08:36:32.012960+0000","last_active":"2024-09-22T08:37:04.230375+0000","last_peered":"2024-09-22T08:37:04.230375+0000","last_clean":"2024-09-22T08:37:04.230375+0000","last_became_active":"2024-09-22T08:36:32.011811+0000","last_became_peered":"2024-09-22T08:36:32.011811+0000","last_unstale":"2024-09-22T08:37:04.230375+0000","last_undegraded":"2024-09-22T08:37:04.230375+0000","last_fullsized":"2024-09-22T08:37:04.230375+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:13:22.789596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"32'2","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:05.456749+0000","last_change":"2024-09-22T08:36:34.020146+0000","last_active":"2024-09-22T08:37:05.456749+0000","last_peered":"2024-09-22T08:37:05.456749+0000","last_clean":"2024-09-22T08:37:05.456749+0000","last_became_active":"2024-09-22T08:36:34.019866+0000","last_became_peered":"2024-09-22T08:36:34.019866+0000","last_unstale":"2024-09-22T08:37:05.456749+0000","last_undegraded":"2024-09-22T08:37:05.456749+0000","last_fullsized":"2024-09-22T08:37:05.456749+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:56:15.623151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:31.647295+0000","last_change":"2024-09-22T08:36:25.989899+0000","last_active":"2024-09-22T08:38:31.647295+0000","last_peered":"2024-09-22T08:38:31.647295+0000","last_clean":"2024-09-22T08:38:31.647295+0000","last_became_active":"2024-09-22T08:36:25.989572+0000","last_became_peered":"2024-09-22T08:36:25.989572+0000","last_unstale":"2024-09-22T08:38:31.647295+0000","last_undegraded":"2024-09-22T08:38:31.647295+0000","last_fullsized":"2024-09-22T08:38:31.647295+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:11:07.278941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.225893+0000","last_change":"2024-09-22T08:36:23.971403+0000","last_active":"2024-09-22T08:37:04.225893+0000","last_peered":"2024-09-22T08:37:04.225893+0000","last_clean":"2024-09-22T08:37:04.225893+0000","last_became_active":"2024-09-22T08:36:23.971012+0000","last_became_peered":"2024-09-22T08:36:23.971012+0000","last_unstale":"2024-09-22T08:37:04.225893+0000","last_undegraded":"2024-09-22T08:37:04.225893+0000","last_fullsized":"2024-09-22T08:37:04.225893+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:38:20.349572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.222066+0000","last_change":"2024-09-22T08:36:27.987755+0000","last_active":"2024-09-22T08:37:04.222066+0000","last_peered":"2024-09-22T08:37:04.222066+0000","last_clean":"2024-09-22T08:37:04.222066+0000","last_became_active":"2024-09-22T08:36:27.987504+0000","last_became_peered":"2024-09-22T08:36:27.987504+0000","last_unstale":"2024-09-22T08:37:04.222066+0000","last_undegraded":"2024-09-22T08:37:04.222066+0000","last_fullsized":"2024-09-22T08:37:04.222066+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_clean_scrub_stamp":"2024-09-22T08:36:26.962226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:39:03.985092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"32'29","reported_seq":74,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:38.971363+0000","last_change":"2024-09-22T08:36:29.998167+0000","last_active":"2024-09-22T08:39:38.971363+0000","last_peered":"2024-09-22T08:39:38.971363+0000","last_clean":"2024-09-22T08:39:38.971363+0000","last_became_active":"2024-09-22T08:36:29.997853+0000","last_became_peered":"2024-09-22T08:36:29.997853+0000","last_unstale":"2024-09-22T08:39:38.971363+0000","last_undegraded":"2024-09-22T08:39:38.971363+0000","last_fullsized":"2024-09-22T08:39:38.971363+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:34:13.019632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.227451+0000","last_change":"2024-09-22T08:36:32.012262+0000","last_active":"2024-09-22T08:37:04.227451+0000","last_peered":"2024-09-22T08:37:04.227451+0000","last_clean":"2024-09-22T08:37:04.227451+0000","last_became_active":"2024-09-22T08:36:32.011960+0000","last_became_peered":"2024-09-22T08:36:32.011960+0000","last_unstale":"2024-09-22T08:37:04.227451+0000","last_undegraded":"2024-09-22T08:37:04.227451+0000","last_fullsized":"2024-09-22T08:37:04.227451+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:58:25.357801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"32'16","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:30.267408+0000","last_change":"2024-09-22T08:36:34.018605+0000","last_active":"2024-09-22T08:38:30.267408+0000","last_peered":"2024-09-22T08:38:30.267408+0000","last_clean":"2024-09-22T08:38:30.267408+0000","last_became_active":"2024-09-22T08:36:34.018365+0000","last_became_peered":"2024-09-22T08:36:34.018365+0000","last_unstale":"2024-09-22T08:38:30.267408+0000","last_undegraded":"2024-09-22T08:38:30.267408+0000","last_fullsized":"2024-09-22T08:38:30.267408+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:01:49.722849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":96,"num_read_kb":76,"num_write":46,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"32'8","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.081475+0000","last_change":"2024-09-22T08:36:25.973362+0000","last_active":"2024-09-22T08:39:32.081475+0000","last_peered":"2024-09-22T08:39:32.081475+0000","last_clean":"2024-09-22T08:39:32.081475+0000","last_became_active":"2024-09-22T08:36:25.973089+0000","last_became_peered":"2024-09-22T08:36:25.973089+0000","last_unstale":"2024-09-22T08:39:32.081475+0000","last_undegraded":"2024-09-22T08:39:32.081475+0000","last_fullsized":"2024-09-22T08:39:32.081475+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:11:06.136833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.612779+0000","last_change":"2024-09-22T08:36:23.968591+0000","last_active":"2024-09-22T08:37:04.612779+0000","last_peered":"2024-09-22T08:37:04.612779+0000","last_clean":"2024-09-22T08:37:04.612779+0000","last_became_active":"2024-09-22T08:36:23.968249+0000","last_became_peered":"2024-09-22T08:36:23.968249+0000","last_unstale":"2024-09-22T08:37:04.612779+0000","last_undegraded":"2024-09-22T08:37:04.612779+0000","last_fullsized":"2024-09-22T08:37:04.612779+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:00:39.104995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"32'2","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:28.952357+0000","last_change":"2024-09-22T08:36:27.988537+0000","last_active":"2024-09-22T08:38:28.952357+0000","last_peered":"2024-09-22T08:38:28.952357+0000","last_clean":"2024-09-22T08:38:28.952357+0000","last_became_active":"2024-09-22T08:36:27.988262+0000","last_became_peered":"2024-09-22T08:36:27.988262+0000","last_unstale":"2024-09-22T08:38:28.952357+0000","last_undegraded":"2024-09-22T08:38:28.952357+0000","last_fullsized":"2024-09-22T08:38:28.952357+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_clean_scrub_stamp":"2024-09-22T08:36:26.962226+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:27:56.322995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"32'35","reported_seq":84,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:38.877181+0000","last_change":"2024-09-22T08:36:29.997925+0000","last_active":"2024-09-22T08:39:38.877181+0000","last_peered":"2024-09-22T08:39:38.877181+0000","last_clean":"2024-09-22T08:39:38.877181+0000","last_became_active":"2024-09-22T08:36:29.997231+0000","last_became_peered":"2024-09-22T08:36:29.997231+0000","last_unstale":"2024-09-22T08:39:38.877181+0000","last_undegraded":"2024-09-22T08:39:38.877181+0000","last_fullsized":"2024-09-22T08:39:38.877181+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:37:27.208598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.224156+0000","last_change":"2024-09-22T08:36:32.004965+0000","last_active":"2024-09-22T08:37:04.224156+0000","last_peered":"2024-09-22T08:37:04.224156+0000","last_clean":"2024-09-22T08:37:04.224156+0000","last_became_active":"2024-09-22T08:36:32.004365+0000","last_became_peered":"2024-09-22T08:36:32.004365+0000","last_unstale":"2024-09-22T08:37:04.224156+0000","last_undegraded":"2024-09-22T08:37:04.224156+0000","last_fullsized":"2024-09-22T08:37:04.224156+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:02:38.800242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"32'4","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:30.270088+0000","last_change":"2024-09-22T08:36:34.016625+0000","last_active":"2024-09-22T08:38:30.270088+0000","last_peered":"2024-09-22T08:38:30.270088+0000","last_clean":"2024-09-22T08:38:30.270088+0000","last_became_active":"2024-09-22T08:36:34.016106+0000","last_became_peered":"2024-09-22T08:36:34.016106+0000","last_unstale":"2024-09-22T08:38:30.270088+0000","last_undegraded":"2024-09-22T08:38:30.270088+0000","last_fullsized":"2024-09-22T08:38:30.270088+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:10:10.424019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"32'12","reported_seq":70,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.290031+0000","last_change":"2024-09-22T08:36:25.987436+0000","last_active":"2024-09-22T08:39:32.290031+0000","last_peered":"2024-09-22T08:39:32.290031+0000","last_clean":"2024-09-22T08:39:32.290031+0000","last_became_active":"2024-09-22T08:36:25.987161+0000","last_became_peered":"2024-09-22T08:36:25.987161+0000","last_unstale":"2024-09-22T08:39:32.290031+0000","last_undegraded":"2024-09-22T08:39:32.290031+0000","last_fullsized":"2024-09-22T08:39:32.290031+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:12:14.347452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.223210+0000","last_change":"2024-09-22T08:36:23.970780+0000","last_active":"2024-09-22T08:37:04.223210+0000","last_peered":"2024-09-22T08:37:04.223210+0000","last_clean":"2024-09-22T08:37:04.223210+0000","last_became_active":"2024-09-22T08:36:23.969515+0000","last_became_peered":"2024-09-22T08:36:23.969515+0000","last_unstale":"2024-09-22T08:37:04.223210+0000","last_undegraded":"2024-09-22T08:37:04.223210+0000","last_fullsized":"2024-09-22T08:37:04.223210+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:26:49.921857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"32'12","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:47.943562+0000","last_change":"2024-09-22T08:36:25.979243+0000","last_active":"2024-09-22T08:37:47.943562+0000","last_peered":"2024-09-22T08:37:47.943562+0000","last_clean":"2024-09-22T08:37:47.943562+0000","last_became_active":"2024-09-22T08:36:25.978679+0000","last_became_peered":"2024-09-22T08:36:25.978679+0000","last_unstale":"2024-09-22T08:37:47.943562+0000","last_undegraded":"2024-09-22T08:37:47.943562+0000","last_fullsized":"2024-09-22T08:37:47.943562+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:02:33.743436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.612648+0000","last_change":"2024-09-22T08:36:23.970625+0000","last_active":"2024-09-22T08:37:04.612648+0000","last_peered":"2024-09-22T08:37:04.612648+0000","last_clean":"2024-09-22T08:37:04.612648+0000","last_became_active":"2024-09-22T08:36:23.970218+0000","last_became_peered":"2024-09-22T08:36:23.970218+0000","last_unstale":"2024-09-22T08:37:04.612648+0000","last_undegraded":"2024-09-22T08:37:04.612648+0000","last_fullsized":"2024-09-22T08:37:04.612648+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:19:30.438078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"32'12","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.079200+0000","last_change":"2024-09-22T08:36:25.991808+0000","last_active":"2024-09-22T08:39:32.079200+0000","last_peered":"2024-09-22T08:39:32.079200+0000","last_clean":"2024-09-22T08:39:32.079200+0000","last_became_active":"2024-09-22T08:36:25.989638+0000","last_became_peered":"2024-09-22T08:36:25.989638+0000","last_unstale":"2024-09-22T08:39:32.079200+0000","last_undegraded":"2024-09-22T08:39:32.079200+0000","last_fullsized":"2024-09-22T08:39:32.079200+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:50:01.017587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":33,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.228337+0000","last_change":"2024-09-22T08:36:23.973468+0000","last_active":"2024-09-22T08:37:04.228337+0000","last_peered":"2024-09-22T08:37:04.228337+0000","last_clean":"2024-09-22T08:37:04.228337+0000","last_became_active":"2024-09-22T08:36:23.972582+0000","last_became_peered":"2024-09-22T08:36:23.972582+0000","last_unstale":"2024-09-22T08:37:04.228337+0000","last_undegraded":"2024-09-22T08:37:04.228337+0000","last_fullsized":"2024-09-22T08:37:04.228337+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:49:03.488783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.224675+0000","last_change":"2024-09-22T08:36:25.978968+0000","last_active":"2024-09-22T08:37:04.224675+0000","last_peered":"2024-09-22T08:37:04.224675+0000","last_clean":"2024-09-22T08:37:04.224675+0000","last_became_active":"2024-09-22T08:36:25.978538+0000","last_became_peered":"2024-09-22T08:36:25.978538+0000","last_unstale":"2024-09-22T08:37:04.224675+0000","last_undegraded":"2024-09-22T08:37:04.224675+0000","last_fullsized":"2024-09-22T08:37:04.224675+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:36:39.596571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.224450+0000","last_change":"2024-09-22T08:36:23.974287+0000","last_active":"2024-09-22T08:37:04.224450+0000","last_peered":"2024-09-22T08:37:04.224450+0000","last_clean":"2024-09-22T08:37:04.224450+0000","last_became_active":"2024-09-22T08:36:23.973945+0000","last_became_peered":"2024-09-22T08:36:23.973945+0000","last_unstale":"2024-09-22T08:37:04.224450+0000","last_undegraded":"2024-09-22T08:37:04.224450+0000","last_fullsized":"2024-09-22T08:37:04.224450+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:15:18.572430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:47.943513+0000","last_change":"2024-09-22T08:36:25.984379+0000","last_active":"2024-09-22T08:37:47.943513+0000","last_peered":"2024-09-22T08:37:47.943513+0000","last_clean":"2024-09-22T08:37:47.943513+0000","last_became_active":"2024-09-22T08:36:25.984094+0000","last_became_peered":"2024-09-22T08:36:25.984094+0000","last_unstale":"2024-09-22T08:37:47.943513+0000","last_undegraded":"2024-09-22T08:37:47.943513+0000","last_fullsized":"2024-09-22T08:37:47.943513+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:55:15.332178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.614002+0000","last_change":"2024-09-22T08:36:23.971443+0000","last_active":"2024-09-22T08:37:04.614002+0000","last_peered":"2024-09-22T08:37:04.614002+0000","last_clean":"2024-09-22T08:37:04.614002+0000","last_became_active":"2024-09-22T08:36:23.970920+0000","last_became_peered":"2024-09-22T08:36:23.970920+0000","last_unstale":"2024-09-22T08:37:04.614002+0000","last_undegraded":"2024-09-22T08:37:04.614002+0000","last_fullsized":"2024-09-22T08:37:04.614002+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:03:35.613648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"32'11","reported_seq":68,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.221583+0000","last_change":"2024-09-22T08:36:25.986221+0000","last_active":"2024-09-22T08:39:32.221583+0000","last_peered":"2024-09-22T08:39:32.221583+0000","last_clean":"2024-09-22T08:39:32.221583+0000","last_became_active":"2024-09-22T08:36:25.985965+0000","last_became_peered":"2024-09-22T08:36:25.985965+0000","last_unstale":"2024-09-22T08:39:32.221583+0000","last_undegraded":"2024-09-22T08:39:32.221583+0000","last_fullsized":"2024-09-22T08:39:32.221583+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:14:09.711077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":11,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.223827+0000","last_change":"2024-09-22T08:36:23.983975+0000","last_active":"2024-09-22T08:37:04.223827+0000","last_peered":"2024-09-22T08:37:04.223827+0000","last_clean":"2024-09-22T08:37:04.223827+0000","last_became_active":"2024-09-22T08:36:23.983722+0000","last_became_peered":"2024-09-22T08:36:23.983722+0000","last_unstale":"2024-09-22T08:37:04.223827+0000","last_undegraded":"2024-09-22T08:37:04.223827+0000","last_fullsized":"2024-09-22T08:37:04.223827+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:06:35.921272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"32'4","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.259710+0000","last_change":"2024-09-22T08:36:25.983403+0000","last_active":"2024-09-22T08:39:32.259710+0000","last_peered":"2024-09-22T08:39:32.259710+0000","last_clean":"2024-09-22T08:39:32.259710+0000","last_became_active":"2024-09-22T08:36:25.983061+0000","last_became_peered":"2024-09-22T08:36:25.983061+0000","last_unstale":"2024-09-22T08:39:32.259710+0000","last_undegraded":"2024-09-22T08:39:32.259710+0000","last_fullsized":"2024-09-22T08:39:32.259710+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:36:23.489851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.229632+0000","last_change":"2024-09-22T08:36:23.974503+0000","last_active":"2024-09-22T08:37:04.229632+0000","last_peered":"2024-09-22T08:37:04.229632+0000","last_clean":"2024-09-22T08:37:04.229632+0000","last_became_active":"2024-09-22T08:36:23.973924+0000","last_became_peered":"2024-09-22T08:36:23.973924+0000","last_unstale":"2024-09-22T08:37:04.229632+0000","last_undegraded":"2024-09-22T08:37:04.229632+0000","last_fullsized":"2024-09-22T08:37:04.229632+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:29:02.171378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"32'18","reported_seq":79,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.259032+0000","last_change":"2024-09-22T08:36:25.979450+0000","last_active":"2024-09-22T08:39:32.259032+0000","last_peered":"2024-09-22T08:39:32.259032+0000","last_clean":"2024-09-22T08:39:32.259032+0000","last_became_active":"2024-09-22T08:36:25.979151+0000","last_became_peered":"2024-09-22T08:36:25.979151+0000","last_unstale":"2024-09-22T08:39:32.259032+0000","last_undegraded":"2024-09-22T08:39:32.259032+0000","last_fullsized":"2024-09-22T08:39:32.259032+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:36:49.177782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":64,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.225651+0000","last_change":"2024-09-22T08:36:23.970979+0000","last_active":"2024-09-22T08:37:04.225651+0000","last_peered":"2024-09-22T08:37:04.225651+0000","last_clean":"2024-09-22T08:37:04.225651+0000","last_became_active":"2024-09-22T08:36:23.970584+0000","last_became_peered":"2024-09-22T08:36:23.970584+0000","last_unstale":"2024-09-22T08:37:04.225651+0000","last_undegraded":"2024-09-22T08:37:04.225651+0000","last_fullsized":"2024-09-22T08:37:04.225651+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:36:27.840945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"32'16","reported_seq":89,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.081622+0000","last_change":"2024-09-22T08:36:25.979007+0000","last_active":"2024-09-22T08:39:32.081622+0000","last_peered":"2024-09-22T08:39:32.081622+0000","last_clean":"2024-09-22T08:39:32.081622+0000","last_became_active":"2024-09-22T08:36:25.978730+0000","last_became_peered":"2024-09-22T08:36:25.978730+0000","last_unstale":"2024-09-22T08:39:32.081622+0000","last_undegraded":"2024-09-22T08:39:32.081622+0000","last_fullsized":"2024-09-22T08:39:32.081622+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:17:07.393345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":70,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:31.490293+0000","last_change":"2024-09-22T08:36:23.973434+0000","last_active":"2024-09-22T08:38:31.490293+0000","last_peered":"2024-09-22T08:38:31.490293+0000","last_clean":"2024-09-22T08:38:31.490293+0000","last_became_active":"2024-09-22T08:36:23.973175+0000","last_became_peered":"2024-09-22T08:36:23.973175+0000","last_unstale":"2024-09-22T08:38:31.490293+0000","last_undegraded":"2024-09-22T08:38:31.490293+0000","last_fullsized":"2024-09-22T08:38:31.490293+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:49:52.164007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"32'6","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.289546+0000","last_change":"2024-09-22T08:36:25.991941+0000","last_active":"2024-09-22T08:39:32.289546+0000","last_peered":"2024-09-22T08:39:32.289546+0000","last_clean":"2024-09-22T08:39:32.289546+0000","last_became_active":"2024-09-22T08:36:25.991611+0000","last_became_peered":"2024-09-22T08:36:25.991611+0000","last_unstale":"2024-09-22T08:39:32.289546+0000","last_undegraded":"2024-09-22T08:39:32.289546+0000","last_fullsized":"2024-09-22T08:39:32.289546+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:09:42.836164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"32'6","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.202264+0000","last_change":"2024-09-22T08:36:23.974290+0000","last_active":"2024-09-22T08:39:32.202264+0000","last_peered":"2024-09-22T08:39:32.202264+0000","last_clean":"2024-09-22T08:39:32.202264+0000","last_became_active":"2024-09-22T08:36:23.973721+0000","last_became_peered":"2024-09-22T08:36:23.973721+0000","last_unstale":"2024-09-22T08:39:32.202264+0000","last_undegraded":"2024-09-22T08:39:32.202264+0000","last_fullsized":"2024-09-22T08:39:32.202264+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:03:35.497917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4,"num_write":22,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"32'8","reported_seq":69,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:05.720316+0000","last_change":"2024-09-22T08:37:04.234401+0000","last_active":"2024-09-22T08:37:05.720316+0000","last_peered":"2024-09-22T08:37:05.720316+0000","last_clean":"2024-09-22T08:37:05.720316+0000","last_became_active":"2024-09-22T08:37:04.231342+0000","last_became_peered":"2024-09-22T08:37:04.231342+0000","last_unstale":"2024-09-22T08:37:05.720316+0000","last_undegraded":"2024-09-22T08:37:05.720316+0000","last_fullsized":"2024-09-22T08:37:05.720316+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:00:32.641067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.221634+0000","last_change":"2024-09-22T08:36:23.975576+0000","last_active":"2024-09-22T08:37:04.221634+0000","last_peered":"2024-09-22T08:37:04.221634+0000","last_clean":"2024-09-22T08:37:04.221634+0000","last_became_active":"2024-09-22T08:36:23.975352+0000","last_became_peered":"2024-09-22T08:36:23.975352+0000","last_unstale":"2024-09-22T08:37:04.221634+0000","last_undegraded":"2024-09-22T08:37:04.221634+0000","last_fullsized":"2024-09-22T08:37:04.221634+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:46:26.551014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.223362+0000","last_change":"2024-09-22T08:36:25.978610+0000","last_active":"2024-09-22T08:37:04.223362+0000","last_peered":"2024-09-22T08:37:04.223362+0000","last_clean":"2024-09-22T08:37:04.223362+0000","last_became_active":"2024-09-22T08:36:25.977732+0000","last_became_peered":"2024-09-22T08:36:25.977732+0000","last_unstale":"2024-09-22T08:37:04.223362+0000","last_undegraded":"2024-09-22T08:37:04.223362+0000","last_fullsized":"2024-09-22T08:37:04.223362+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:38:39.281465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.222399+0000","last_change":"2024-09-22T08:36:23.976230+0000","last_active":"2024-09-22T08:37:04.222399+0000","last_peered":"2024-09-22T08:37:04.222399+0000","last_clean":"2024-09-22T08:37:04.222399+0000","last_became_active":"2024-09-22T08:36:23.975986+0000","last_became_peered":"2024-09-22T08:36:23.975986+0000","last_unstale":"2024-09-22T08:37:04.222399+0000","last_undegraded":"2024-09-22T08:37:04.222399+0000","last_fullsized":"2024-09-22T08:37:04.222399+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:51:18.438115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"32'9","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.299156+0000","last_change":"2024-09-22T08:36:25.984592+0000","last_active":"2024-09-22T08:39:32.299156+0000","last_peered":"2024-09-22T08:39:32.299156+0000","last_clean":"2024-09-22T08:39:32.299156+0000","last_became_active":"2024-09-22T08:36:25.984258+0000","last_became_peered":"2024-09-22T08:36:25.984258+0000","last_unstale":"2024-09-22T08:39:32.299156+0000","last_undegraded":"2024-09-22T08:39:32.299156+0000","last_fullsized":"2024-09-22T08:39:32.299156+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:55:58.281586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.225389+0000","last_change":"2024-09-22T08:36:23.979781+0000","last_active":"2024-09-22T08:37:04.225389+0000","last_peered":"2024-09-22T08:37:04.225389+0000","last_clean":"2024-09-22T08:37:04.225389+0000","last_became_active":"2024-09-22T08:36:23.979548+0000","last_became_peered":"2024-09-22T08:36:23.979548+0000","last_unstale":"2024-09-22T08:37:04.225389+0000","last_undegraded":"2024-09-22T08:37:04.225389+0000","last_fullsized":"2024-09-22T08:37:04.225389+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:09:58.448384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"32'16","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:05.722031+0000","last_change":"2024-09-22T08:36:25.980204+0000","last_active":"2024-09-22T08:37:05.722031+0000","last_peered":"2024-09-22T08:37:05.722031+0000","last_clean":"2024-09-22T08:37:05.722031+0000","last_became_active":"2024-09-22T08:36:25.979965+0000","last_became_peered":"2024-09-22T08:36:25.979965+0000","last_unstale":"2024-09-22T08:37:05.722031+0000","last_undegraded":"2024-09-22T08:37:05.722031+0000","last_fullsized":"2024-09-22T08:37:05.722031+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:42:38.878214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":51,"num_write":22,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.199364+0000","last_change":"2024-09-22T08:36:23.978481+0000","last_active":"2024-09-22T08:39:32.199364+0000","last_peered":"2024-09-22T08:39:32.199364+0000","last_clean":"2024-09-22T08:39:32.199364+0000","last_became_active":"2024-09-22T08:36:23.978225+0000","last_became_peered":"2024-09-22T08:36:23.978225+0000","last_unstale":"2024-09-22T08:39:32.199364+0000","last_undegraded":"2024-09-22T08:39:32.199364+0000","last_fullsized":"2024-09-22T08:39:32.199364+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:22:28.702522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"32'6","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:31.994598+0000","last_change":"2024-09-22T08:36:25.990975+0000","last_active":"2024-09-22T08:39:31.994598+0000","last_peered":"2024-09-22T08:39:31.994598+0000","last_clean":"2024-09-22T08:39:31.994598+0000","last_became_active":"2024-09-22T08:36:25.990690+0000","last_became_peered":"2024-09-22T08:36:25.990690+0000","last_unstale":"2024-09-22T08:39:31.994598+0000","last_undegraded":"2024-09-22T08:39:31.994598+0000","last_fullsized":"2024-09-22T08:39:31.994598+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:09:20.176753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.229731+0000","last_change":"2024-09-22T08:36:23.974565+0000","last_active":"2024-09-22T08:37:04.229731+0000","last_peered":"2024-09-22T08:37:04.229731+0000","last_clean":"2024-09-22T08:37:04.229731+0000","last_became_active":"2024-09-22T08:36:23.973976+0000","last_became_peered":"2024-09-22T08:36:23.973976+0000","last_unstale":"2024-09-22T08:37:04.229731+0000","last_undegraded":"2024-09-22T08:37:04.229731+0000","last_fullsized":"2024-09-22T08:37:04.229731+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:58:35.337314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"32'2","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.289981+0000","last_change":"2024-09-22T08:36:25.976107+0000","last_active":"2024-09-22T08:39:32.289981+0000","last_peered":"2024-09-22T08:39:32.289981+0000","last_clean":"2024-09-22T08:39:32.289981+0000","last_became_active":"2024-09-22T08:36:25.975794+0000","last_became_peered":"2024-09-22T08:36:25.975794+0000","last_unstale":"2024-09-22T08:39:32.289981+0000","last_undegraded":"2024-09-22T08:39:32.289981+0000","last_fullsized":"2024-09-22T08:39:32.289981+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:38:51.254477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:31.945275+0000","last_change":"2024-09-22T08:36:23.982786+0000","last_active":"2024-09-22T08:39:31.945275+0000","last_peered":"2024-09-22T08:39:31.945275+0000","last_clean":"2024-09-22T08:39:31.945275+0000","last_became_active":"2024-09-22T08:36:23.982376+0000","last_became_peered":"2024-09-22T08:36:23.982376+0000","last_unstale":"2024-09-22T08:39:31.945275+0000","last_undegraded":"2024-09-22T08:39:31.945275+0000","last_fullsized":"2024-09-22T08:39:31.945275+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:18:02.522688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.226198+0000","last_change":"2024-09-22T08:36:23.979035+0000","last_active":"2024-09-22T08:37:04.226198+0000","last_peered":"2024-09-22T08:37:04.226198+0000","last_clean":"2024-09-22T08:37:04.226198+0000","last_became_active":"2024-09-22T08:36:23.978787+0000","last_became_peered":"2024-09-22T08:36:23.978787+0000","last_unstale":"2024-09-22T08:37:04.226198+0000","last_undegraded":"2024-09-22T08:37:04.226198+0000","last_fullsized":"2024-09-22T08:37:04.226198+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:59:46.639082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"32'8","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.081622+0000","last_change":"2024-09-22T08:36:25.979863+0000","last_active":"2024-09-22T08:39:32.081622+0000","last_peered":"2024-09-22T08:39:32.081622+0000","last_clean":"2024-09-22T08:39:32.081622+0000","last_became_active":"2024-09-22T08:36:25.979593+0000","last_became_peered":"2024-09-22T08:36:25.979593+0000","last_unstale":"2024-09-22T08:39:32.081622+0000","last_undegraded":"2024-09-22T08:39:32.081622+0000","last_fullsized":"2024-09-22T08:39:32.081622+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:44:30.975858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.223261+0000","last_change":"2024-09-22T08:36:23.974913+0000","last_active":"2024-09-22T08:37:04.223261+0000","last_peered":"2024-09-22T08:37:04.223261+0000","last_clean":"2024-09-22T08:37:04.223261+0000","last_became_active":"2024-09-22T08:36:23.974202+0000","last_became_peered":"2024-09-22T08:36:23.974202+0000","last_unstale":"2024-09-22T08:37:04.223261+0000","last_undegraded":"2024-09-22T08:37:04.223261+0000","last_fullsized":"2024-09-22T08:37:04.223261+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:39:58.245871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"32'13","reported_seq":78,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:50.182446+0000","last_change":"2024-09-22T08:37:04.240925+0000","last_active":"2024-09-22T08:38:50.182446+0000","last_peered":"2024-09-22T08:38:50.182446+0000","last_clean":"2024-09-22T08:38:50.182446+0000","last_became_active":"2024-09-22T08:37:04.233241+0000","last_became_peered":"2024-09-22T08:37:04.233241+0000","last_unstale":"2024-09-22T08:38:50.182446+0000","last_undegraded":"2024-09-22T08:38:50.182446+0000","last_fullsized":"2024-09-22T08:38:50.182446+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:13:02.072699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":47,"num_read_kb":43,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1549,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":690,"num_read_kb":658,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":267,"ondisk_log_size":267,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2280,"ondisk_log_size":2280,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1600,"num_read_kb":1397,"num_write":597,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1374,"ondisk_log_size":1374,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1672,"num_read_kb":1562,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":177,"num_read_kb":83,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":128,"acting":128,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":11,"seq":47244640303,"num_pgs":124,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36312,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335528,"statfs":{"total":96636764160,"available":96599580672,"internally_reserved":0,"allocated":991232,"data_stored":726145,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640303,"num_pgs":119,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36328,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335512,"statfs":{"total":96636764160,"available":96599564288,"internally_reserved":0,"allocated":1003520,"data_stored":724639,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":9,"seq":38654705710,"num_pgs":152,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39964,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331876,"statfs":{"total":96636764160,"available":96595841024,"internally_reserved":0,"allocated":466944,"data_stored":138067,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705710,"num_pgs":135,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39916,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331924,"statfs":{"total":96636764160,"available":96595890176,"internally_reserved":0,"allocated":421888,"data_stored":135213,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":325,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":421,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T08:39:43.694 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-09-22T08:36:23.433065+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=23, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.694 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-09-22T08:36:24.956796+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=24, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.694 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-09-22T08:36:23.433065+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=23, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.694 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-09-22T08:36:24.956796+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=24, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.694 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-09-22T08:36:23.433065+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=23, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.695 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-22T08:36:24.956796+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=24, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.695 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-09-22T08:36:23.433065+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=23, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.695 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-09-22T08:36:24.956796+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=24, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.695 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-09-22T08:36:23.433065+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=23, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.695 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-09-22T08:36:24.956796+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=24, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.695 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-09-22T08:36:23.433065+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=23, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.695 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-09-22T08:36:24.956796+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=24, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.695 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-09-22T08:36:23.433065+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=23, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.695 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-09-22T08:36:24.956796+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=24, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.696 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-09-22T08:36:23.433065+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=23, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.696 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-09-22T08:36:24.956796+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=24, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.696 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-09-22T08:36:24.956796+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=24, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.696 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-09-22T08:36:23.433065+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=23, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.696 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-09-22T08:36:24.956796+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=24, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.696 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-09-22T08:36:23.433065+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=23, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.696 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-09-22T08:36:24.956796+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=24, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.696 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-09-22T08:36:23.433065+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=23, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.696 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-09-22T08:36:24.956796+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=24, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.696 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-09-22T08:36:23.433065+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=23, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.697 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-09-22T08:36:24.956796+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=24, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.697 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-09-22T08:36:23.433065+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=23, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.697 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-09-22T08:36:24.956796+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=24, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.697 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-09-22T08:36:23.433065+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=23, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.697 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-22T08:36:32.990486+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.697 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-09-22T08:36:24.956796+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=24, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.697 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-22T08:36:23.433065+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=23, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.697 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-09-22T08:36:26.962226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=26, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.697 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-09-22T08:36:28.972630+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=28, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.697 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-09-22T08:36:30.982878+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=30, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.697 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-22T08:36:32.990486+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.698 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-09-22T08:36:24.956796+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=24, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.698 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-09-22T08:36:23.433065+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=23, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.698 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-09-22T08:36:26.962226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=26, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.698 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-09-22T08:36:28.972630+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=28, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.698 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-09-22T08:36:30.982878+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=30, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.698 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-22T08:36:32.990486+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.698 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-09-22T08:36:24.956796+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=24, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.698 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-22T08:36:23.433065+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=23, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.698 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-09-22T08:36:26.962226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=26, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.698 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-09-22T08:36:28.972630+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=28, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.699 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-22T08:36:30.982878+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=30, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.699 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-09-22T08:36:32.990486+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.699 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-09-22T08:36:24.956796+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=24, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.699 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-09-22T08:36:23.433065+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=23, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.699 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-09-22T08:36:26.962226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=26, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.699 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-09-22T08:36:28.972630+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=28, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.699 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-09-22T08:36:30.982878+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=30, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.699 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-09-22T08:36:24.956796+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=24, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.699 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-09-22T08:36:23.433065+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=23, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.700 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-09-22T08:36:26.962226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=26, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.700 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-09-22T08:36:28.972630+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=28, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.700 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-09-22T08:36:30.982878+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=30, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.700 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-09-22T08:36:32.990486+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.700 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-09-22T08:36:24.956796+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=24, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.700 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-09-22T08:36:23.433065+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=23, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.700 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-09-22T08:36:26.962226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=26, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.700 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-09-22T08:36:28.972630+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=28, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.700 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-09-22T08:36:30.982878+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=30, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.701 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-09-22T08:36:32.990486+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.701 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-09-22T08:36:24.956796+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=24, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.701 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-22T08:36:23.433065+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=23, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.701 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-09-22T08:36:26.962226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=26, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.701 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-09-22T08:36:28.972630+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=28, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.701 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-09-22T08:36:30.982878+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=30, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.701 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-22T08:36:32.990486+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.701 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-09-22T08:36:24.956796+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=24, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.701 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-09-22T08:36:23.433065+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=23, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.701 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-09-22T08:36:26.962226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=26, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.702 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-09-22T08:36:28.972630+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=28, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.702 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-09-22T08:36:30.982878+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=30, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.702 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-22T08:36:32.990486+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.702 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-09-22T08:36:24.956796+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=24, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.702 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-09-22T08:36:23.433065+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=23, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.702 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-09-22T08:36:26.962226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=26, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.702 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-09-22T08:36:28.972630+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=28, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.702 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-09-22T08:36:30.982878+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=30, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.702 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-22T08:36:32.990486+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.703 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-09-22T08:36:24.956796+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=24, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.703 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-09-22T08:36:23.433065+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=23, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.703 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-09-22T08:36:26.962226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=26, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.703 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-09-22T08:36:28.972630+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=28, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.703 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2024-09-22T08:36:30.982878+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=30, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.703 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-22T08:36:32.990486+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.703 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-09-22T08:36:24.956796+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=24, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.703 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-09-22T08:36:23.433065+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=23, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.703 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-09-22T08:36:26.962226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=26, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.704 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-09-22T08:36:28.972630+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=28, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.704 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-09-22T08:36:30.982878+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=30, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.704 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-09-22T08:36:32.990486+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.704 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-09-22T08:36:24.956796+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=24, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.704 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-09-22T08:36:23.433065+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=23, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.704 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-09-22T08:36:26.962226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=26, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.704 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-09-22T08:36:28.972630+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=28, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.704 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-09-22T08:36:30.982878+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=30, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.704 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-09-22T08:36:32.990486+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.704 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-09-22T08:36:24.956796+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=24, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.705 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-22T08:36:09.401562+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=9, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.705 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-22T08:36:15.415268+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=15, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.705 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-22T08:36:23.433065+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=23, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.705 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-09-22T08:36:26.962226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=26, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.705 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-09-22T08:36:28.972630+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=28, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.705 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-09-22T08:36:30.982878+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=30, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.705 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-09-22T08:36:32.990486+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.705 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-09-22T08:36:24.956796+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=24, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.705 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-22T08:36:15.415268+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=15, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.706 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-22T08:36:23.433065+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=23, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.706 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-09-22T08:36:26.962226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=26, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.706 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-09-22T08:36:28.972630+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=28, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.706 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-22T08:36:30.982878+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=30, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.706 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-22T08:36:32.990486+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.706 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-09-22T08:36:24.956796+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=24, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.706 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-22T08:36:15.415268+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=15, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.706 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-09-22T08:36:23.433065+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=23, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.706 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-09-22T08:36:26.962226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=26, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.706 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-09-22T08:36:28.972630+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=28, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.707 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-09-22T08:36:30.982878+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=30, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.707 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-22T08:36:32.990486+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.707 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-09-22T08:36:24.956796+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=24, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.707 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-22T08:36:15.415268+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=15, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.707 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-22T08:36:23.433065+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=23, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.707 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-09-22T08:36:26.962226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=26, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.707 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-09-22T08:36:28.972630+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=28, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.707 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-09-22T08:36:30.982878+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=30, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.707 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-22T08:36:32.990486+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.708 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-09-22T08:36:24.956796+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=24, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.708 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-09-22T08:36:23.433065+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=23, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.708 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-22T08:36:15.415268+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=15, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.708 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-09-22T08:36:26.962226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=26, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.708 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-09-22T08:36:28.972630+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=28, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.708 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-09-22T08:36:30.982878+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=30, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.708 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-22T08:36:32.990486+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.708 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-09-22T08:36:24.956796+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=24, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.708 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-09-22T08:36:23.433065+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=23, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.708 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-22T08:36:15.415268+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=15, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.708 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-09-22T08:36:26.962226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=26, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.709 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-09-22T08:36:28.972630+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=28, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.709 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-09-22T08:36:30.982878+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=30, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.709 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-22T08:36:32.990486+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.709 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-09-22T08:36:24.956796+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=24, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.709 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-22T08:36:23.433065+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=23, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.709 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-09-22T08:36:26.962226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=26, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.709 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-09-22T08:36:28.972630+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=28, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.709 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-09-22T08:36:30.982878+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=30, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.709 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-22T08:36:32.990486+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.709 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-09-22T08:36:24.956796+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=24, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.710 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-09-22T08:36:23.433065+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=23, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.710 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-22T08:36:15.415268+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=15, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.710 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-09-22T08:36:26.962226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=26, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.710 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-09-22T08:36:28.972630+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=28, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.710 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-09-22T08:36:30.982878+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=30, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.710 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-09-22T08:36:32.990486+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.710 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-09-22T08:36:32.990486+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.710 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-09-22T08:36:24.956796+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=24, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.710 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-22T08:36:23.433065+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=23, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.711 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-09-22T08:36:26.962226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=26, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.711 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-09-22T08:36:28.972630+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=28, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.711 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-09-22T08:36:30.982878+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=30, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.711 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-22T08:36:32.990486+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.711 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-09-22T08:36:24.956796+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=24, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.711 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-09-22T08:36:23.433065+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=23, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.711 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-09-22T08:36:26.962226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=26, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.711 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-09-22T08:36:28.972630+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=28, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.711 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-09-22T08:36:30.982878+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=30, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.711 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-22T08:36:32.990486+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.712 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-09-22T08:36:24.956796+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=24, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.712 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-09-22T08:36:23.433065+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=23, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.712 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-09-22T08:36:26.962226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=26, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.712 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-09-22T08:36:28.972630+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=28, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.712 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-09-22T08:36:30.982878+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=30, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.712 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-22T08:36:32.990486+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.712 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-09-22T08:36:24.956796+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=24, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.712 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-09-22T08:36:23.433065+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=23, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.712 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-09-22T08:36:26.962226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=26, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.712 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-09-22T08:36:28.972630+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=28, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.712 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-09-22T08:36:30.982878+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=30, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.713 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-22T08:36:24.956796+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=24, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.713 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-09-22T08:36:23.433065+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=23, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.713 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-09-22T08:36:26.962226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=26, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.713 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-09-22T08:36:28.972630+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=28, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.713 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-09-22T08:36:30.982878+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=30, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.713 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-22T08:36:32.990486+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.713 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-09-22T08:36:24.956796+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=24, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.713 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-09-22T08:36:23.433065+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=23, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.713 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-09-22T08:36:26.962226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=26, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.714 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-09-22T08:36:28.972630+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=28, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.714 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-09-22T08:36:30.982878+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=30, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.714 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-22T08:36:32.990486+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.714 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-09-22T08:36:24.956796+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=24, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.714 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-09-22T08:36:23.433065+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=23, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.714 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-09-22T08:36:26.962226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=26, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.714 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-09-22T08:36:28.972630+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=28, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.714 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-09-22T08:36:30.982878+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=30, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.714 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-22T08:36:32.990486+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.715 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-09-22T08:36:24.956796+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=24, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.715 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-22T08:36:23.433065+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=23, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.715 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-09-22T08:36:26.962226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=26, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.715 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-09-22T08:36:28.972630+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=28, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.715 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-09-22T08:36:30.982878+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=30, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.715 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-22T08:36:32.990486+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.715 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-09-22T08:36:24.956796+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=24, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.715 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-09-22T08:36:23.433065+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=23, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.715 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-09-22T08:36:26.962226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=26, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.715 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-09-22T08:36:28.972630+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=28, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.715 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-09-22T08:36:30.982878+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=30, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.716 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-22T08:36:32.990486+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.716 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-09-22T08:36:24.956796+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=24, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.716 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-22T08:36:23.433065+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=23, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.716 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-09-22T08:36:26.962226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=26, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.716 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-09-22T08:36:28.972630+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=28, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.716 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-22T08:36:30.982878+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=30, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.716 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-22T08:36:32.990486+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.716 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-09-22T08:36:24.956796+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=24, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.716 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-09-22T08:36:23.433065+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=23, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.716 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-09-22T08:36:26.962226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=26, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.716 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-09-22T08:36:28.972630+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=28, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.717 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-22T08:36:30.982878+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=30, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.717 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-22T08:36:32.990486+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.717 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-09-22T08:36:24.956796+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=24, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.717 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-09-22T08:36:23.433065+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=23, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.717 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-09-22T08:36:26.962226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=26, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.717 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-09-22T08:36:28.972630+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=28, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.717 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-09-22T08:36:30.982878+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=30, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.717 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-22T08:36:32.990486+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.717 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-09-22T08:36:24.956796+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=24, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.717 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-09-22T08:36:23.433065+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=23, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.717 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-09-22T08:36:24.956796+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=24, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.718 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-09-22T08:36:23.433065+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=23, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.718 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-09-22T08:36:24.956796+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=24, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.718 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-09-22T08:36:23.433065+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=23, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.718 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-09-22T08:36:24.956796+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=24, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.718 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-09-22T08:36:23.433065+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=23, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.718 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-09-22T08:36:24.956796+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=24, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.718 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-09-22T08:36:23.433065+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=23, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.718 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-09-22T08:36:24.956796+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=24, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.718 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-09-22T08:36:23.433065+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=23, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.719 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-09-22T08:36:24.956796+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=24, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.719 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-09-22T08:36:23.433065+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=23, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.719 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-09-22T08:36:24.956796+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=24, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.719 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-09-22T08:36:23.433065+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=23, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.719 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-09-22T08:36:24.956796+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=24, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.719 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-09-22T08:36:23.433065+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=23, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.719 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-09-22T08:36:24.956796+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=24, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.719 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-09-22T08:36:23.433065+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=23, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.719 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-09-22T08:36:24.956796+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=24, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.719 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-09-22T08:36:23.433065+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=23, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.720 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-09-22T08:36:24.956796+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=24, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.720 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-09-22T08:36:23.433065+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=23, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.720 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-09-22T08:36:24.956796+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=24, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.720 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-09-22T08:36:23.433065+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=23, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.720 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-09-22T08:36:24.956796+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=24, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.720 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-09-22T08:36:23.433065+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=23, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.720 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-09-22T08:36:24.956796+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=24, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.720 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-09-22T08:36:23.433065+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=23, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.720 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-09-22T08:36:24.956796+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=24, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.720 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-09-22T08:36:23.433065+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=23, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.720 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-09-22T08:36:23.433065+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=23, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.721 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-09-22T08:36:24.956796+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=24, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.721 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-09-22T08:36:23.433065+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=23, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.721 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-09-22T08:36:24.956796+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=24, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:39:43.721 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-22T08:40:03.722 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T08:40:03.840 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:40:03.838+0000 7f6f47952640 1 Processor -- start 2024-09-22T08:40:03.840 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:40:03.838+0000 7f6f47952640 1 -- start start 2024-09-22T08:40:03.840 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:40:03.839+0000 7f6f47952640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f6f40071e30 0x7f6f40132790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:40:03.840 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:40:03.839+0000 7f6f47952640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f40071770 con 0x7f6f4006e170 2024-09-22T08:40:03.840 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:40:03.839+0000 7f6f47952640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f6f40099ee0 con 0x7f6f40071e30 2024-09-22T08:40:03.841 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:40:03.839+0000 7f6f44eed640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f6f40071e30 0x7f6f40132790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:40:03.841 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:40:03.839+0000 7f6f456ee640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f6f4006e170 0x7f6f4006e550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:55210/0 (socket says 172.21.15.31:55210) 2024-09-22T08:40:03.841 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:40:03.839+0000 7f6f456ee640 1 -- 172.21.15.31:0/2000681189 learned_addr learned my addr 172.21.15.31:0/2000681189 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-22T08:40:03.841 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:40:03.839+0000 7f6f44eed640 1 -- 172.21.15.31:0/2000681189 >> v1:172.21.15.31:6789/0 conn(0x7f6f4006e170 legacy=0x7f6f4006e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:40:03.841 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:40:03.839+0000 7f6f44eed640 1 -- 172.21.15.31:0/2000681189 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f40072530 con 0x7f6f40071e30 2024-09-22T08:40:03.842 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:40:03.840+0000 7f6f44eed640 1 --2- 172.21.15.31:0/2000681189 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6f40071e30 0x7f6f40132790 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f6f30009750 tx=0x7f6f3002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5bfd2def2608a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:40:03.842 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:40:03.840+0000 7f6f37fff640 1 -- 172.21.15.31:0/2000681189 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6f30037070 con 0x7f6f40071e30 2024-09-22T08:40:03.842 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:40:03.840+0000 7f6f37fff640 1 -- 172.21.15.31:0/2000681189 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f3002ad80 con 0x7f6f40071e30 2024-09-22T08:40:03.842 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:40:03.840+0000 7f6f37fff640 1 -- 172.21.15.31:0/2000681189 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6f30032590 con 0x7f6f40071e30 2024-09-22T08:40:03.842 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:40:03.841+0000 7f6f47952640 1 -- 172.21.15.31:0/2000681189 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6f40071e30 msgr2=0x7f6f40132790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:40:03.842 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:40:03.841+0000 7f6f47952640 1 --2- 172.21.15.31:0/2000681189 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6f40071e30 0x7f6f40132790 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f6f30009750 tx=0x7f6f3002a140 comp rx=0 tx=0).stop 2024-09-22T08:40:03.842 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:40:03.841+0000 7f6f47952640 1 -- 172.21.15.31:0/2000681189 shutdown_connections 2024-09-22T08:40:03.842 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:40:03.841+0000 7f6f47952640 1 --2- 172.21.15.31:0/2000681189 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6f40071e30 0x7f6f40132790 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:40:03.843 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:40:03.841+0000 7f6f47952640 1 -- 172.21.15.31:0/2000681189 >> 172.21.15.31:0/2000681189 conn(0x7f6f4009ac80 msgr2=0x7f6f40098550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:40:03.843 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:40:03.841+0000 7f6f47952640 1 -- 172.21.15.31:0/2000681189 shutdown_connections 2024-09-22T08:40:03.843 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:40:03.841+0000 7f6f47952640 1 -- 172.21.15.31:0/2000681189 wait complete. 2024-09-22T08:40:03.844 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:40:03.842+0000 7f6f47952640 1 Processor -- start 2024-09-22T08:40:03.844 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:40:03.842+0000 7f6f47952640 1 -- start start 2024-09-22T08:40:03.844 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:40:03.842+0000 7f6f47952640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6f4006e170 0x7f6f401c4080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:40:03.844 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:40:03.842+0000 7f6f47952640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f6f4006ee70 con 0x7f6f4006e170 2024-09-22T08:40:03.845 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:40:03.842+0000 7f6f456ee640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6f4006e170 0x7f6f401c4080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:40:03.845 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:40:03.842+0000 7f6f456ee640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6f4006e170 0x7f6f401c4080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:59372/0 (socket says 172.21.15.31:59372) 2024-09-22T08:40:03.845 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:40:03.842+0000 7f6f456ee640 1 -- 172.21.15.31:0/2388492793 learned_addr learned my addr 172.21.15.31:0/2388492793 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-22T08:40:03.845 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:40:03.842+0000 7f6f456ee640 1 -- 172.21.15.31:0/2388492793 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f40074170 con 0x7f6f4006e170 2024-09-22T08:40:03.845 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:40:03.843+0000 7f6f456ee640 1 --2- 172.21.15.31:0/2388492793 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6f4006e170 0x7f6f401c4080 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f6f3c00c480 tx=0x7f6f3c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:40:03.845 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:40:03.843+0000 7f6f35ffb640 1 -- 172.21.15.31:0/2388492793 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6f3c017070 con 0x7f6f4006e170 2024-09-22T08:40:03.845 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:40:03.843+0000 7f6f35ffb640 1 -- 172.21.15.31:0/2388492793 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f3c005c10 con 0x7f6f4006e170 2024-09-22T08:40:03.845 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:40:03.843+0000 7f6f35ffb640 1 -- 172.21.15.31:0/2388492793 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6f3c007070 con 0x7f6f4006e170 2024-09-22T08:40:03.845 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:40:03.843+0000 7f6f47952640 1 -- 172.21.15.31:0/2388492793 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f4012a7d0 con 0x7f6f4006e170 2024-09-22T08:40:03.845 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:40:03.843+0000 7f6f47952640 1 -- 172.21.15.31:0/2388492793 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f401c45c0 con 0x7f6f4006e170 2024-09-22T08:40:03.846 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:40:03.844+0000 7f6f35ffb640 1 -- 172.21.15.31:0/2388492793 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f6f3c01a070 con 0x7f6f4006e170 2024-09-22T08:40:03.846 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:40:03.844+0000 7f6f47952640 1 -- 172.21.15.31:0/2388492793 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f4006e550 con 0x7f6f4006e170 2024-09-22T08:40:03.846 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:40:03.844+0000 7f6f35ffb640 1 --2- 172.21.15.31:0/2388492793 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f6f2403e710 0x7f6f24040bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:40:03.846 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:40:03.844+0000 7f6f35ffb640 1 -- 172.21.15.31:0/2388492793 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5938+0+0 (secure 0 0 0) 0x7f6f3c052910 con 0x7f6f4006e170 2024-09-22T08:40:03.846 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:40:03.845+0000 7f6f44eed640 1 --2- 172.21.15.31:0/2388492793 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f6f2403e710 0x7f6f24040bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:40:03.846 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:40:03.845+0000 7f6f44eed640 1 --2- 172.21.15.31:0/2388492793 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f6f2403e710 0x7f6f24040bd0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f6f30034000 tx=0x7f6f3002e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:40:03.850 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:40:03.849+0000 7f6f35ffb640 1 -- 172.21.15.31:0/2388492793 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f6f40074170 con 0x7f6f4006e170 2024-09-22T08:40:04.035 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:40:04.034+0000 7f6f47952640 1 -- 172.21.15.31:0/2388492793 --> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6f400709e0 con 0x7f6f2403e710 2024-09-22T08:40:04.045 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:40:04.045+0000 7f6f35ffb640 1 -- 172.21.15.31:0/2388492793 <== mgr.4099 v2:172.21.15.142:6824/99931088 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665494 (secure 0 0 0) 0x7f6f400709e0 con 0x7f6f2403e710 2024-09-22T08:40:04.052 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-22T08:40:04.058 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2024-09-22T08:40:04.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:40:04.049+0000 7f6f47952640 1 -- 172.21.15.31:0/2388492793 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f6f2403e710 msgr2=0x7f6f24040bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:40:04.060 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:40:04.049+0000 7f6f47952640 1 --2- 172.21.15.31:0/2388492793 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f6f2403e710 0x7f6f24040bd0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f6f30034000 tx=0x7f6f3002e000 comp rx=0 tx=0).stop 2024-09-22T08:40:04.060 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:40:04.049+0000 7f6f47952640 1 -- 172.21.15.31:0/2388492793 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6f4006e170 msgr2=0x7f6f401c4080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:40:04.060 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:40:04.049+0000 7f6f47952640 1 --2- 172.21.15.31:0/2388492793 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6f4006e170 0x7f6f401c4080 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f6f3c00c480 tx=0x7f6f3c00c940 comp rx=0 tx=0).stop 2024-09-22T08:40:04.060 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:40:04.049+0000 7f6f47952640 1 -- 172.21.15.31:0/2388492793 shutdown_connections 2024-09-22T08:40:04.060 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:40:04.049+0000 7f6f47952640 1 --2- 172.21.15.31:0/2388492793 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f6f2403e710 0x7f6f24040bd0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:40:04.060 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:40:04.049+0000 7f6f47952640 1 --2- 172.21.15.31:0/2388492793 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6f4006e170 0x7f6f401c4080 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:40:04.060 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:40:04.049+0000 7f6f47952640 1 -- 172.21.15.31:0/2388492793 >> 172.21.15.31:0/2388492793 conn(0x7f6f4009ac80 msgr2=0x7f6f4012b1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:40:04.060 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:40:04.049+0000 7f6f47952640 1 -- 172.21.15.31:0/2388492793 shutdown_connections 2024-09-22T08:40:04.060 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:40:04.049+0000 7f6f47952640 1 -- 172.21.15.31:0/2388492793 wait complete. 2024-09-22T08:40:04.061 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":147,"stamp":"2024-09-22T08:40:03.213427+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605410,"num_objects":222,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":222,"num_whiteouts":0,"num_read":5177,"num_read_kb":4727,"num_write":2121,"num_write_kb":60587,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4568,"ondisk_log_size":4568,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":152512,"kb_used_data":2816,"kb_used_omap":6,"kb_used_meta":149625,"kb_avail":377334848,"statfs":{"total":386547056640,"available":386390884352,"internally_reserved":0,"allocated":2883584,"data_stored":1724064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":153216790},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003861"},"pg_stats":[{"pgid":"3.3f","version":"30'4","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.229185+0000","last_change":"2024-09-22T08:36:23.978702+0000","last_active":"2024-09-22T08:37:04.229185+0000","last_peered":"2024-09-22T08:37:04.229185+0000","last_clean":"2024-09-22T08:37:04.229185+0000","last_became_active":"2024-09-22T08:36:23.978473+0000","last_became_peered":"2024-09-22T08:36:23.978473+0000","last_unstale":"2024-09-22T08:37:04.229185+0000","last_undegraded":"2024-09-22T08:37:04.229185+0000","last_fullsized":"2024-09-22T08:37:04.229185+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:47:35.557013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":7,"num_write":20,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"30'4","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.221771+0000","last_change":"2024-09-22T08:36:25.982137+0000","last_active":"2024-09-22T08:37:04.221771+0000","last_peered":"2024-09-22T08:37:04.221771+0000","last_clean":"2024-09-22T08:37:04.221771+0000","last_became_active":"2024-09-22T08:36:25.981849+0000","last_became_peered":"2024-09-22T08:36:25.981849+0000","last_unstale":"2024-09-22T08:37:04.221771+0000","last_undegraded":"2024-09-22T08:37:04.221771+0000","last_fullsized":"2024-09-22T08:37:04.221771+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:15:58.403427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:58.826192+0000","last_change":"2024-09-22T08:39:58.826192+0000","last_active":"2024-09-22T08:39:58.826192+0000","last_peered":"2024-09-22T08:39:58.826192+0000","last_clean":"2024-09-22T08:39:58.826192+0000","last_became_active":"2024-09-22T08:36:23.973596+0000","last_became_peered":"2024-09-22T08:36:23.973596+0000","last_unstale":"2024-09-22T08:39:58.826192+0000","last_undegraded":"2024-09-22T08:39:58.826192+0000","last_fullsized":"2024-09-22T08:39:58.826192+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:39:58.826106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:39:58.826106+0000","last_clean_scrub_stamp":"2024-09-22T08:39:58.826106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:25:37.176757+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"32'2","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.081639+0000","last_change":"2024-09-22T08:36:25.992482+0000","last_active":"2024-09-22T08:39:32.081639+0000","last_peered":"2024-09-22T08:39:32.081639+0000","last_clean":"2024-09-22T08:39:32.081639+0000","last_became_active":"2024-09-22T08:36:25.992150+0000","last_became_peered":"2024-09-22T08:36:25.992150+0000","last_unstale":"2024-09-22T08:39:32.081639+0000","last_undegraded":"2024-09-22T08:39:32.081639+0000","last_fullsized":"2024-09-22T08:39:32.081639+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:39:29.442096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.232004+0000","last_change":"2024-09-22T08:36:23.983138+0000","last_active":"2024-09-22T08:37:04.232004+0000","last_peered":"2024-09-22T08:37:04.232004+0000","last_clean":"2024-09-22T08:37:04.232004+0000","last_became_active":"2024-09-22T08:36:23.982860+0000","last_became_peered":"2024-09-22T08:36:23.982860+0000","last_unstale":"2024-09-22T08:37:04.232004+0000","last_undegraded":"2024-09-22T08:37:04.232004+0000","last_fullsized":"2024-09-22T08:37:04.232004+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:22:39.595954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.228436+0000","last_change":"2024-09-22T08:36:25.992618+0000","last_active":"2024-09-22T08:37:04.228436+0000","last_peered":"2024-09-22T08:37:04.228436+0000","last_clean":"2024-09-22T08:37:04.228436+0000","last_became_active":"2024-09-22T08:36:25.992356+0000","last_became_peered":"2024-09-22T08:36:25.992356+0000","last_unstale":"2024-09-22T08:37:04.228436+0000","last_undegraded":"2024-09-22T08:37:04.228436+0000","last_fullsized":"2024-09-22T08:37:04.228436+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:54:42.310988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:58.533060+0000","last_change":"2024-09-22T08:39:58.533060+0000","last_active":"2024-09-22T08:39:58.533060+0000","last_peered":"2024-09-22T08:39:58.533060+0000","last_clean":"2024-09-22T08:39:58.533060+0000","last_became_active":"2024-09-22T08:36:23.967096+0000","last_became_peered":"2024-09-22T08:36:23.967096+0000","last_unstale":"2024-09-22T08:39:58.533060+0000","last_undegraded":"2024-09-22T08:39:58.533060+0000","last_fullsized":"2024-09-22T08:39:58.533060+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:39:58.532978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:39:58.532978+0000","last_clean_scrub_stamp":"2024-09-22T08:39:58.532978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:58:12.874966+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"32'22","reported_seq":95,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.214709+0000","last_change":"2024-09-22T08:36:25.989569+0000","last_active":"2024-09-22T08:39:32.214709+0000","last_peered":"2024-09-22T08:39:32.214709+0000","last_clean":"2024-09-22T08:39:32.214709+0000","last_became_active":"2024-09-22T08:36:25.989065+0000","last_became_peered":"2024-09-22T08:36:25.989065+0000","last_unstale":"2024-09-22T08:39:32.214709+0000","last_undegraded":"2024-09-22T08:39:32.214709+0000","last_fullsized":"2024-09-22T08:39:32.214709+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:18:58.915284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":82,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.229849+0000","last_change":"2024-09-22T08:36:23.979014+0000","last_active":"2024-09-22T08:37:04.229849+0000","last_peered":"2024-09-22T08:37:04.229849+0000","last_clean":"2024-09-22T08:37:04.229849+0000","last_became_active":"2024-09-22T08:36:23.978766+0000","last_became_peered":"2024-09-22T08:36:23.978766+0000","last_unstale":"2024-09-22T08:37:04.229849+0000","last_undegraded":"2024-09-22T08:37:04.229849+0000","last_fullsized":"2024-09-22T08:37:04.229849+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:46:08.557989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"32'8","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.215083+0000","last_change":"2024-09-22T08:36:25.979188+0000","last_active":"2024-09-22T08:39:32.215083+0000","last_peered":"2024-09-22T08:39:32.215083+0000","last_clean":"2024-09-22T08:39:32.215083+0000","last_became_active":"2024-09-22T08:36:25.978937+0000","last_became_peered":"2024-09-22T08:36:25.978937+0000","last_unstale":"2024-09-22T08:39:32.215083+0000","last_undegraded":"2024-09-22T08:39:32.215083+0000","last_fullsized":"2024-09-22T08:39:32.215083+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:36:02.118103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":23,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"32'4","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:05.711611+0000","last_change":"2024-09-22T08:36:23.967446+0000","last_active":"2024-09-22T08:37:05.711611+0000","last_peered":"2024-09-22T08:37:05.711611+0000","last_clean":"2024-09-22T08:37:05.711611+0000","last_became_active":"2024-09-22T08:36:23.967168+0000","last_became_peered":"2024-09-22T08:36:23.967168+0000","last_unstale":"2024-09-22T08:37:05.711611+0000","last_undegraded":"2024-09-22T08:37:05.711611+0000","last_fullsized":"2024-09-22T08:37:05.711611+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:51:18.438115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":10,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"32'6","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:48.130983+0000","last_change":"2024-09-22T08:36:25.992986+0000","last_active":"2024-09-22T08:37:48.130983+0000","last_peered":"2024-09-22T08:37:48.130983+0000","last_clean":"2024-09-22T08:37:48.130983+0000","last_became_active":"2024-09-22T08:36:25.990727+0000","last_became_peered":"2024-09-22T08:36:25.990727+0000","last_unstale":"2024-09-22T08:37:48.130983+0000","last_undegraded":"2024-09-22T08:37:48.130983+0000","last_fullsized":"2024-09-22T08:37:48.130983+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:05:42.869702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.228480+0000","last_change":"2024-09-22T08:36:23.980714+0000","last_active":"2024-09-22T08:37:04.228480+0000","last_peered":"2024-09-22T08:37:04.228480+0000","last_clean":"2024-09-22T08:37:04.228480+0000","last_became_active":"2024-09-22T08:36:23.980446+0000","last_became_peered":"2024-09-22T08:36:23.980446+0000","last_unstale":"2024-09-22T08:37:04.228480+0000","last_undegraded":"2024-09-22T08:37:04.228480+0000","last_fullsized":"2024-09-22T08:37:04.228480+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:18:20.665486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"32'8","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.289670+0000","last_change":"2024-09-22T08:36:25.982503+0000","last_active":"2024-09-22T08:39:32.289670+0000","last_peered":"2024-09-22T08:39:32.289670+0000","last_clean":"2024-09-22T08:39:32.289670+0000","last_became_active":"2024-09-22T08:36:25.982217+0000","last_became_peered":"2024-09-22T08:36:25.982217+0000","last_unstale":"2024-09-22T08:39:32.289670+0000","last_undegraded":"2024-09-22T08:39:32.289670+0000","last_fullsized":"2024-09-22T08:39:32.289670+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:38:39.281465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":27,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:57.845968+0000","last_change":"2024-09-22T08:39:57.845968+0000","last_active":"2024-09-22T08:39:57.845968+0000","last_peered":"2024-09-22T08:39:57.845968+0000","last_clean":"2024-09-22T08:39:57.845968+0000","last_became_active":"2024-09-22T08:36:23.977715+0000","last_became_peered":"2024-09-22T08:36:23.977715+0000","last_unstale":"2024-09-22T08:39:57.845968+0000","last_undegraded":"2024-09-22T08:39:57.845968+0000","last_fullsized":"2024-09-22T08:39:57.845968+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-22T08:39:57.845879+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-22T08:39:57.845879+0000","last_clean_scrub_stamp":"2024-09-22T08:39:57.845879+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:42:05.377364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"32'7","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:30.181492+0000","last_change":"2024-09-22T08:36:25.975203+0000","last_active":"2024-09-22T08:38:30.181492+0000","last_peered":"2024-09-22T08:38:30.181492+0000","last_clean":"2024-09-22T08:38:30.181492+0000","last_became_active":"2024-09-22T08:36:25.974930+0000","last_became_peered":"2024-09-22T08:36:25.974930+0000","last_unstale":"2024-09-22T08:38:30.181492+0000","last_undegraded":"2024-09-22T08:38:30.181492+0000","last_fullsized":"2024-09-22T08:38:30.181492+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:14:58.055122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"32'3","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:48.185367+0000","last_change":"2024-09-22T08:36:25.992134+0000","last_active":"2024-09-22T08:38:48.185367+0000","last_peered":"2024-09-22T08:38:48.185367+0000","last_clean":"2024-09-22T08:38:48.185367+0000","last_became_active":"2024-09-22T08:36:25.991870+0000","last_became_peered":"2024-09-22T08:36:25.991870+0000","last_unstale":"2024-09-22T08:38:48.185367+0000","last_undegraded":"2024-09-22T08:38:48.185367+0000","last_fullsized":"2024-09-22T08:38:48.185367+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:22:14.904895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:57.283661+0000","last_change":"2024-09-22T08:39:57.283661+0000","last_active":"2024-09-22T08:39:57.283661+0000","last_peered":"2024-09-22T08:39:57.283661+0000","last_clean":"2024-09-22T08:39:57.283661+0000","last_became_active":"2024-09-22T08:36:23.977556+0000","last_became_peered":"2024-09-22T08:36:23.977556+0000","last_unstale":"2024-09-22T08:39:57.283661+0000","last_undegraded":"2024-09-22T08:39:57.283661+0000","last_fullsized":"2024-09-22T08:39:57.283661+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:39:57.283537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:39:57.283537+0000","last_clean_scrub_stamp":"2024-09-22T08:39:57.283537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:31:33.140772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"32'14","reported_seq":72,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.290010+0000","last_change":"2024-09-22T08:36:25.977178+0000","last_active":"2024-09-22T08:39:32.290010+0000","last_peered":"2024-09-22T08:39:32.290010+0000","last_clean":"2024-09-22T08:39:32.290010+0000","last_became_active":"2024-09-22T08:36:25.976389+0000","last_became_peered":"2024-09-22T08:36:25.976389+0000","last_unstale":"2024-09-22T08:39:32.290010+0000","last_undegraded":"2024-09-22T08:39:32.290010+0000","last_fullsized":"2024-09-22T08:39:32.290010+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:33:17.028140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":49,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"32'2","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:57.549716+0000","last_change":"2024-09-22T08:39:57.549716+0000","last_active":"2024-09-22T08:39:57.549716+0000","last_peered":"2024-09-22T08:39:57.549716+0000","last_clean":"2024-09-22T08:39:57.549716+0000","last_became_active":"2024-09-22T08:36:23.974275+0000","last_became_peered":"2024-09-22T08:36:23.974275+0000","last_unstale":"2024-09-22T08:39:57.549716+0000","last_undegraded":"2024-09-22T08:39:57.549716+0000","last_fullsized":"2024-09-22T08:39:57.549716+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-22T08:39:57.549604+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-22T08:39:57.549604+0000","last_clean_scrub_stamp":"2024-09-22T08:39:57.549604+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:02:09.510635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"32'12","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.343172+0000","last_change":"2024-09-22T08:36:25.977283+0000","last_active":"2024-09-22T08:39:32.343172+0000","last_peered":"2024-09-22T08:39:32.343172+0000","last_clean":"2024-09-22T08:39:32.343172+0000","last_became_active":"2024-09-22T08:36:25.977015+0000","last_became_peered":"2024-09-22T08:36:25.977015+0000","last_unstale":"2024-09-22T08:39:32.343172+0000","last_undegraded":"2024-09-22T08:39:32.343172+0000","last_fullsized":"2024-09-22T08:39:32.343172+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:25:20.428891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":43,"num_read_kb":39,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:55.220138+0000","last_change":"2024-09-22T08:39:55.220138+0000","last_active":"2024-09-22T08:39:55.220138+0000","last_peered":"2024-09-22T08:39:55.220138+0000","last_clean":"2024-09-22T08:39:55.220138+0000","last_became_active":"2024-09-22T08:36:23.984411+0000","last_became_peered":"2024-09-22T08:36:23.984411+0000","last_unstale":"2024-09-22T08:39:55.220138+0000","last_undegraded":"2024-09-22T08:39:55.220138+0000","last_fullsized":"2024-09-22T08:39:55.220138+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-22T08:39:55.220017+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-22T08:39:55.220017+0000","last_clean_scrub_stamp":"2024-09-22T08:39:55.220017+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:52:34.074155+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"32'2","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:28.582905+0000","last_change":"2024-09-22T08:36:25.984342+0000","last_active":"2024-09-22T08:38:28.582905+0000","last_peered":"2024-09-22T08:38:28.582905+0000","last_clean":"2024-09-22T08:38:28.582905+0000","last_became_active":"2024-09-22T08:36:25.984037+0000","last_became_peered":"2024-09-22T08:36:25.984037+0000","last_unstale":"2024-09-22T08:38:28.582905+0000","last_undegraded":"2024-09-22T08:38:28.582905+0000","last_fullsized":"2024-09-22T08:38:28.582905+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:08:22.313520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"32'2","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:56.237269+0000","last_change":"2024-09-22T08:39:56.237269+0000","last_active":"2024-09-22T08:39:56.237269+0000","last_peered":"2024-09-22T08:39:56.237269+0000","last_clean":"2024-09-22T08:39:56.237269+0000","last_became_active":"2024-09-22T08:36:23.969183+0000","last_became_peered":"2024-09-22T08:36:23.969183+0000","last_unstale":"2024-09-22T08:39:56.237269+0000","last_undegraded":"2024-09-22T08:39:56.237269+0000","last_fullsized":"2024-09-22T08:39:56.237269+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-22T08:39:56.237185+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-22T08:39:56.237185+0000","last_clean_scrub_stamp":"2024-09-22T08:39:56.237185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:26:53.537080+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"32'18","reported_seq":67,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.214977+0000","last_change":"2024-09-22T08:36:25.986078+0000","last_active":"2024-09-22T08:39:32.214977+0000","last_peered":"2024-09-22T08:39:32.214977+0000","last_clean":"2024-09-22T08:39:32.214977+0000","last_became_active":"2024-09-22T08:36:25.985797+0000","last_became_peered":"2024-09-22T08:36:25.985797+0000","last_unstale":"2024-09-22T08:39:32.214977+0000","last_undegraded":"2024-09-22T08:39:32.214977+0000","last_fullsized":"2024-09-22T08:39:32.214977+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:55:58.281586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":61,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:56.863666+0000","last_change":"2024-09-22T08:39:56.863666+0000","last_active":"2024-09-22T08:39:56.863666+0000","last_peered":"2024-09-22T08:39:56.863666+0000","last_clean":"2024-09-22T08:39:56.863666+0000","last_became_active":"2024-09-22T08:36:23.974359+0000","last_became_peered":"2024-09-22T08:36:23.974359+0000","last_unstale":"2024-09-22T08:39:56.863666+0000","last_undegraded":"2024-09-22T08:39:56.863666+0000","last_fullsized":"2024-09-22T08:39:56.863666+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-22T08:39:56.863584+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-22T08:39:56.863584+0000","last_clean_scrub_stamp":"2024-09-22T08:39:56.863584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:41:23.122061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"32'16","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.296886+0000","last_change":"2024-09-22T08:36:25.978419+0000","last_active":"2024-09-22T08:39:32.296886+0000","last_peered":"2024-09-22T08:39:32.296886+0000","last_clean":"2024-09-22T08:39:32.296886+0000","last_became_active":"2024-09-22T08:36:25.977320+0000","last_became_peered":"2024-09-22T08:36:25.977320+0000","last_unstale":"2024-09-22T08:39:32.296886+0000","last_undegraded":"2024-09-22T08:39:32.296886+0000","last_fullsized":"2024-09-22T08:39:32.296886+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:45:06.683427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":49,"num_write":21,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:31.890230+0000","last_change":"2024-09-22T08:36:23.980577+0000","last_active":"2024-09-22T08:39:31.890230+0000","last_peered":"2024-09-22T08:39:31.890230+0000","last_clean":"2024-09-22T08:39:31.890230+0000","last_became_active":"2024-09-22T08:36:23.980189+0000","last_became_peered":"2024-09-22T08:36:23.980189+0000","last_unstale":"2024-09-22T08:39:31.890230+0000","last_undegraded":"2024-09-22T08:39:31.890230+0000","last_fullsized":"2024-09-22T08:39:31.890230+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:45:54.958427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"32'35","reported_seq":100,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.238012+0000","last_change":"2024-09-22T08:36:34.015950+0000","last_active":"2024-09-22T08:39:32.238012+0000","last_peered":"2024-09-22T08:39:32.238012+0000","last_clean":"2024-09-22T08:39:32.238012+0000","last_became_active":"2024-09-22T08:36:34.015696+0000","last_became_peered":"2024-09-22T08:36:34.015696+0000","last_unstale":"2024-09-22T08:39:32.238012+0000","last_undegraded":"2024-09-22T08:39:32.238012+0000","last_fullsized":"2024-09-22T08:39:32.238012+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:48:07.077185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":173,"num_read_kb":173,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"32'6","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.214715+0000","last_change":"2024-09-22T08:36:25.988079+0000","last_active":"2024-09-22T08:39:32.214715+0000","last_peered":"2024-09-22T08:39:32.214715+0000","last_clean":"2024-09-22T08:39:32.214715+0000","last_became_active":"2024-09-22T08:36:25.987811+0000","last_became_peered":"2024-09-22T08:36:25.987811+0000","last_unstale":"2024-09-22T08:39:32.214715+0000","last_undegraded":"2024-09-22T08:39:32.214715+0000","last_fullsized":"2024-09-22T08:39:32.214715+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:09:47.627357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:52.378512+0000","last_change":"2024-09-22T08:39:52.378512+0000","last_active":"2024-09-22T08:39:52.378512+0000","last_peered":"2024-09-22T08:39:52.378512+0000","last_clean":"2024-09-22T08:39:52.378512+0000","last_became_active":"2024-09-22T08:36:23.982423+0000","last_became_peered":"2024-09-22T08:36:23.982423+0000","last_unstale":"2024-09-22T08:39:52.378512+0000","last_undegraded":"2024-09-22T08:39:52.378512+0000","last_fullsized":"2024-09-22T08:39:52.378512+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:39:52.378424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:39:52.378424+0000","last_clean_scrub_stamp":"2024-09-22T08:39:52.378424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:48:16.834018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.230626+0000","last_change":"2024-09-22T08:36:27.988469+0000","last_active":"2024-09-22T08:37:04.230626+0000","last_peered":"2024-09-22T08:37:04.230626+0000","last_clean":"2024-09-22T08:37:04.230626+0000","last_became_active":"2024-09-22T08:36:27.988057+0000","last_became_peered":"2024-09-22T08:36:27.988057+0000","last_unstale":"2024-09-22T08:37:04.230626+0000","last_undegraded":"2024-09-22T08:37:04.230626+0000","last_fullsized":"2024-09-22T08:37:04.230626+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_clean_scrub_stamp":"2024-09-22T08:36:26.962226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:51:33.578609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"32'33","reported_seq":80,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:38.945435+0000","last_change":"2024-09-22T08:36:29.995218+0000","last_active":"2024-09-22T08:39:38.945435+0000","last_peered":"2024-09-22T08:39:38.945435+0000","last_clean":"2024-09-22T08:39:38.945435+0000","last_became_active":"2024-09-22T08:36:29.994881+0000","last_became_peered":"2024-09-22T08:36:29.994881+0000","last_unstale":"2024-09-22T08:39:38.945435+0000","last_undegraded":"2024-09-22T08:39:38.945435+0000","last_fullsized":"2024-09-22T08:39:38.945435+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:46:41.834484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.223889+0000","last_change":"2024-09-22T08:36:32.013521+0000","last_active":"2024-09-22T08:37:04.223889+0000","last_peered":"2024-09-22T08:37:04.223889+0000","last_clean":"2024-09-22T08:37:04.223889+0000","last_became_active":"2024-09-22T08:36:32.013249+0000","last_became_peered":"2024-09-22T08:36:32.013249+0000","last_unstale":"2024-09-22T08:37:04.223889+0000","last_undegraded":"2024-09-22T08:37:04.223889+0000","last_fullsized":"2024-09-22T08:37:04.223889+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:35:20.008672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"32'7","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:47.949724+0000","last_change":"2024-09-22T08:36:34.015432+0000","last_active":"2024-09-22T08:37:47.949724+0000","last_peered":"2024-09-22T08:37:47.949724+0000","last_clean":"2024-09-22T08:37:47.949724+0000","last_became_active":"2024-09-22T08:36:34.015170+0000","last_became_peered":"2024-09-22T08:36:34.015170+0000","last_unstale":"2024-09-22T08:37:47.949724+0000","last_undegraded":"2024-09-22T08:37:47.949724+0000","last_fullsized":"2024-09-22T08:37:47.949724+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:45:21.601440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:48.129237+0000","last_change":"2024-09-22T08:36:25.989960+0000","last_active":"2024-09-22T08:37:48.129237+0000","last_peered":"2024-09-22T08:37:48.129237+0000","last_clean":"2024-09-22T08:37:48.129237+0000","last_became_active":"2024-09-22T08:36:25.989583+0000","last_became_peered":"2024-09-22T08:36:25.989583+0000","last_unstale":"2024-09-22T08:37:48.129237+0000","last_undegraded":"2024-09-22T08:37:48.129237+0000","last_fullsized":"2024-09-22T08:37:48.129237+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:42:22.082860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"32'2","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:50.670046+0000","last_change":"2024-09-22T08:39:50.670046+0000","last_active":"2024-09-22T08:39:50.670046+0000","last_peered":"2024-09-22T08:39:50.670046+0000","last_clean":"2024-09-22T08:39:50.670046+0000","last_became_active":"2024-09-22T08:36:23.973716+0000","last_became_peered":"2024-09-22T08:36:23.973716+0000","last_unstale":"2024-09-22T08:39:50.670046+0000","last_undegraded":"2024-09-22T08:39:50.670046+0000","last_fullsized":"2024-09-22T08:39:50.670046+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-22T08:39:50.669969+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-22T08:39:50.669969+0000","last_clean_scrub_stamp":"2024-09-22T08:39:50.669969+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:51:53.477798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:05.167417+0000","last_change":"2024-09-22T08:37:04.229482+0000","last_active":"2024-09-22T08:37:05.167417+0000","last_peered":"2024-09-22T08:37:05.167417+0000","last_clean":"2024-09-22T08:37:05.167417+0000","last_became_active":"2024-09-22T08:37:04.229132+0000","last_became_peered":"2024-09-22T08:37:04.229132+0000","last_unstale":"2024-09-22T08:37:05.167417+0000","last_undegraded":"2024-09-22T08:37:05.167417+0000","last_fullsized":"2024-09-22T08:37:05.167417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_clean_scrub_stamp":"2024-09-22T08:36:26.962226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:30:09.128950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"30'6","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.223977+0000","last_change":"2024-09-22T08:36:29.991280+0000","last_active":"2024-09-22T08:37:04.223977+0000","last_peered":"2024-09-22T08:37:04.223977+0000","last_clean":"2024-09-22T08:37:04.223977+0000","last_became_active":"2024-09-22T08:36:29.990998+0000","last_became_peered":"2024-09-22T08:36:29.990998+0000","last_unstale":"2024-09-22T08:37:04.223977+0000","last_undegraded":"2024-09-22T08:37:04.223977+0000","last_fullsized":"2024-09-22T08:37:04.223977+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:36:37.998945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.222725+0000","last_change":"2024-09-22T08:36:32.006443+0000","last_active":"2024-09-22T08:37:04.222725+0000","last_peered":"2024-09-22T08:37:04.222725+0000","last_clean":"2024-09-22T08:37:04.222725+0000","last_became_active":"2024-09-22T08:36:32.006161+0000","last_became_peered":"2024-09-22T08:36:32.006161+0000","last_unstale":"2024-09-22T08:37:04.222725+0000","last_undegraded":"2024-09-22T08:37:04.222725+0000","last_fullsized":"2024-09-22T08:37:04.222725+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:39:07.614953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"30'2","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.223331+0000","last_change":"2024-09-22T08:36:34.017093+0000","last_active":"2024-09-22T08:37:04.223331+0000","last_peered":"2024-09-22T08:37:04.223331+0000","last_clean":"2024-09-22T08:37:04.223331+0000","last_became_active":"2024-09-22T08:36:34.016749+0000","last_became_peered":"2024-09-22T08:36:34.016749+0000","last_unstale":"2024-09-22T08:37:04.223331+0000","last_undegraded":"2024-09-22T08:37:04.223331+0000","last_fullsized":"2024-09-22T08:37:04.223331+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:18:00.649317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"32'7","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.088571+0000","last_change":"2024-09-22T08:36:25.988432+0000","last_active":"2024-09-22T08:39:32.088571+0000","last_peered":"2024-09-22T08:39:32.088571+0000","last_clean":"2024-09-22T08:39:32.088571+0000","last_became_active":"2024-09-22T08:36:25.987860+0000","last_became_peered":"2024-09-22T08:36:25.987860+0000","last_unstale":"2024-09-22T08:39:32.088571+0000","last_undegraded":"2024-09-22T08:39:32.088571+0000","last_fullsized":"2024-09-22T08:39:32.088571+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:07:23.439560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:54.365627+0000","last_change":"2024-09-22T08:39:54.365627+0000","last_active":"2024-09-22T08:39:54.365627+0000","last_peered":"2024-09-22T08:39:54.365627+0000","last_clean":"2024-09-22T08:39:54.365627+0000","last_became_active":"2024-09-22T08:36:23.979201+0000","last_became_peered":"2024-09-22T08:36:23.979201+0000","last_unstale":"2024-09-22T08:39:54.365627+0000","last_undegraded":"2024-09-22T08:39:54.365627+0000","last_fullsized":"2024-09-22T08:39:54.365627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:39:54.365537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:39:54.365537+0000","last_clean_scrub_stamp":"2024-09-22T08:39:54.365537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:12:06.963553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.226652+0000","last_change":"2024-09-22T08:36:27.987816+0000","last_active":"2024-09-22T08:37:04.226652+0000","last_peered":"2024-09-22T08:37:04.226652+0000","last_clean":"2024-09-22T08:37:04.226652+0000","last_became_active":"2024-09-22T08:36:27.987410+0000","last_became_peered":"2024-09-22T08:36:27.987410+0000","last_unstale":"2024-09-22T08:37:04.226652+0000","last_undegraded":"2024-09-22T08:37:04.226652+0000","last_fullsized":"2024-09-22T08:37:04.226652+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_clean_scrub_stamp":"2024-09-22T08:36:26.962226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:14:29.717295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"30'10","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.227501+0000","last_change":"2024-09-22T08:36:29.999655+0000","last_active":"2024-09-22T08:37:04.227501+0000","last_peered":"2024-09-22T08:37:04.227501+0000","last_clean":"2024-09-22T08:37:04.227501+0000","last_became_active":"2024-09-22T08:36:29.999306+0000","last_became_peered":"2024-09-22T08:36:29.999306+0000","last_unstale":"2024-09-22T08:37:04.227501+0000","last_undegraded":"2024-09-22T08:37:04.227501+0000","last_fullsized":"2024-09-22T08:37:04.227501+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:27:58.333399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"32'285","reported_seq":418,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:38.824267+0000","last_change":"2024-09-22T08:36:32.014175+0000","last_active":"2024-09-22T08:39:38.824267+0000","last_peered":"2024-09-22T08:39:38.824267+0000","last_clean":"2024-09-22T08:39:38.824267+0000","last_became_active":"2024-09-22T08:36:32.013869+0000","last_became_peered":"2024-09-22T08:36:32.013869+0000","last_unstale":"2024-09-22T08:39:38.824267+0000","last_undegraded":"2024-09-22T08:39:38.824267+0000","last_fullsized":"2024-09-22T08:39:38.824267+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:23:53.788685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.224121+0000","last_change":"2024-09-22T08:36:34.016273+0000","last_active":"2024-09-22T08:37:04.224121+0000","last_peered":"2024-09-22T08:37:04.224121+0000","last_clean":"2024-09-22T08:37:04.224121+0000","last_became_active":"2024-09-22T08:36:34.015999+0000","last_became_peered":"2024-09-22T08:36:34.015999+0000","last_unstale":"2024-09-22T08:37:04.224121+0000","last_undegraded":"2024-09-22T08:37:04.224121+0000","last_fullsized":"2024-09-22T08:37:04.224121+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:19:59.334082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"30'4","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:02.829539+0000","last_change":"2024-09-22T08:40:02.829539+0000","last_active":"2024-09-22T08:40:02.829539+0000","last_peered":"2024-09-22T08:40:02.829539+0000","last_clean":"2024-09-22T08:40:02.829539+0000","last_became_active":"2024-09-22T08:36:25.979320+0000","last_became_peered":"2024-09-22T08:36:25.979320+0000","last_unstale":"2024-09-22T08:40:02.829539+0000","last_undegraded":"2024-09-22T08:40:02.829539+0000","last_fullsized":"2024-09-22T08:40:02.829539+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'4","last_scrub_stamp":"2024-09-22T08:40:02.829450+0000","last_deep_scrub":"30'4","last_deep_scrub_stamp":"2024-09-22T08:40:02.829450+0000","last_clean_scrub_stamp":"2024-09-22T08:40:02.829450+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:25:40.999415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:45.068211+0000","last_change":"2024-09-22T08:39:45.068211+0000","last_active":"2024-09-22T08:39:45.068211+0000","last_peered":"2024-09-22T08:39:45.068211+0000","last_clean":"2024-09-22T08:39:45.068211+0000","last_became_active":"2024-09-22T08:36:23.975428+0000","last_became_peered":"2024-09-22T08:36:23.975428+0000","last_unstale":"2024-09-22T08:39:45.068211+0000","last_undegraded":"2024-09-22T08:39:45.068211+0000","last_fullsized":"2024-09-22T08:39:45.068211+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:39:45.068115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:39:45.068115+0000","last_clean_scrub_stamp":"2024-09-22T08:39:45.068115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:04:18.711452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.227129+0000","last_change":"2024-09-22T08:36:27.985020+0000","last_active":"2024-09-22T08:37:04.227129+0000","last_peered":"2024-09-22T08:37:04.227129+0000","last_clean":"2024-09-22T08:37:04.227129+0000","last_became_active":"2024-09-22T08:36:27.984658+0000","last_became_peered":"2024-09-22T08:36:27.984658+0000","last_unstale":"2024-09-22T08:37:04.227129+0000","last_undegraded":"2024-09-22T08:37:04.227129+0000","last_fullsized":"2024-09-22T08:37:04.227129+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_clean_scrub_stamp":"2024-09-22T08:36:26.962226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:55:24.622399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"32'33","reported_seq":80,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:38.929884+0000","last_change":"2024-09-22T08:36:30.000958+0000","last_active":"2024-09-22T08:39:38.929884+0000","last_peered":"2024-09-22T08:39:38.929884+0000","last_clean":"2024-09-22T08:39:38.929884+0000","last_became_active":"2024-09-22T08:36:30.000641+0000","last_became_peered":"2024-09-22T08:36:30.000641+0000","last_unstale":"2024-09-22T08:39:38.929884+0000","last_undegraded":"2024-09-22T08:39:38.929884+0000","last_fullsized":"2024-09-22T08:39:38.929884+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:44:23.505173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"32'285","reported_seq":427,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:38.829148+0000","last_change":"2024-09-22T08:36:32.005447+0000","last_active":"2024-09-22T08:39:38.829148+0000","last_peered":"2024-09-22T08:39:38.829148+0000","last_clean":"2024-09-22T08:39:38.829148+0000","last_became_active":"2024-09-22T08:36:32.005012+0000","last_became_peered":"2024-09-22T08:36:32.005012+0000","last_unstale":"2024-09-22T08:39:38.829148+0000","last_undegraded":"2024-09-22T08:39:38.829148+0000","last_fullsized":"2024-09-22T08:39:38.829148+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:31:41.609654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"32'4","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:05.720809+0000","last_change":"2024-09-22T08:36:25.990731+0000","last_active":"2024-09-22T08:37:05.720809+0000","last_peered":"2024-09-22T08:37:05.720809+0000","last_clean":"2024-09-22T08:37:05.720809+0000","last_became_active":"2024-09-22T08:36:25.989940+0000","last_became_peered":"2024-09-22T08:36:25.989940+0000","last_unstale":"2024-09-22T08:37:05.720809+0000","last_undegraded":"2024-09-22T08:37:05.720809+0000","last_fullsized":"2024-09-22T08:37:05.720809+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:12:49.808186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:46.601168+0000","last_change":"2024-09-22T08:39:46.601168+0000","last_active":"2024-09-22T08:39:46.601168+0000","last_peered":"2024-09-22T08:39:46.601168+0000","last_clean":"2024-09-22T08:39:46.601168+0000","last_became_active":"2024-09-22T08:36:23.970093+0000","last_became_peered":"2024-09-22T08:36:23.970093+0000","last_unstale":"2024-09-22T08:39:46.601168+0000","last_undegraded":"2024-09-22T08:39:46.601168+0000","last_fullsized":"2024-09-22T08:39:46.601168+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:39:46.601074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:39:46.601074+0000","last_clean_scrub_stamp":"2024-09-22T08:39:46.601074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:08:12.326140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.221669+0000","last_change":"2024-09-22T08:36:27.987025+0000","last_active":"2024-09-22T08:37:04.221669+0000","last_peered":"2024-09-22T08:37:04.221669+0000","last_clean":"2024-09-22T08:37:04.221669+0000","last_became_active":"2024-09-22T08:36:27.986734+0000","last_became_peered":"2024-09-22T08:36:27.986734+0000","last_unstale":"2024-09-22T08:37:04.221669+0000","last_undegraded":"2024-09-22T08:37:04.221669+0000","last_fullsized":"2024-09-22T08:37:04.221669+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_clean_scrub_stamp":"2024-09-22T08:36:26.962226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:17:49.747383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"32'43","reported_seq":95,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:38.957908+0000","last_change":"2024-09-22T08:36:29.991107+0000","last_active":"2024-09-22T08:39:38.957908+0000","last_peered":"2024-09-22T08:39:38.957908+0000","last_clean":"2024-09-22T08:39:38.957908+0000","last_became_active":"2024-09-22T08:36:29.990809+0000","last_became_peered":"2024-09-22T08:36:29.990809+0000","last_unstale":"2024-09-22T08:39:38.957908+0000","last_undegraded":"2024-09-22T08:39:38.957908+0000","last_fullsized":"2024-09-22T08:39:38.957908+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:58:25.003982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.224144+0000","last_change":"2024-09-22T08:36:32.004096+0000","last_active":"2024-09-22T08:37:04.224144+0000","last_peered":"2024-09-22T08:37:04.224144+0000","last_clean":"2024-09-22T08:37:04.224144+0000","last_became_active":"2024-09-22T08:36:32.003726+0000","last_became_peered":"2024-09-22T08:36:32.003726+0000","last_unstale":"2024-09-22T08:37:04.224144+0000","last_undegraded":"2024-09-22T08:37:04.224144+0000","last_fullsized":"2024-09-22T08:37:04.224144+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:58:37.810092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"32'5","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:48.125865+0000","last_change":"2024-09-22T08:36:34.022748+0000","last_active":"2024-09-22T08:37:48.125865+0000","last_peered":"2024-09-22T08:37:48.125865+0000","last_clean":"2024-09-22T08:37:48.125865+0000","last_became_active":"2024-09-22T08:36:34.022448+0000","last_became_peered":"2024-09-22T08:36:34.022448+0000","last_unstale":"2024-09-22T08:37:48.125865+0000","last_undegraded":"2024-09-22T08:37:48.125865+0000","last_fullsized":"2024-09-22T08:37:48.125865+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:39:09.622561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":13,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"32'10","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:31.647489+0000","last_change":"2024-09-22T08:36:25.976027+0000","last_active":"2024-09-22T08:38:31.647489+0000","last_peered":"2024-09-22T08:38:31.647489+0000","last_clean":"2024-09-22T08:38:31.647489+0000","last_became_active":"2024-09-22T08:36:25.975728+0000","last_became_peered":"2024-09-22T08:36:25.975728+0000","last_unstale":"2024-09-22T08:38:31.647489+0000","last_undegraded":"2024-09-22T08:38:31.647489+0000","last_fullsized":"2024-09-22T08:38:31.647489+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:22:27.923443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:47.621398+0000","last_change":"2024-09-22T08:39:47.621398+0000","last_active":"2024-09-22T08:39:47.621398+0000","last_peered":"2024-09-22T08:39:47.621398+0000","last_clean":"2024-09-22T08:39:47.621398+0000","last_became_active":"2024-09-22T08:36:23.968836+0000","last_became_peered":"2024-09-22T08:36:23.968836+0000","last_unstale":"2024-09-22T08:39:47.621398+0000","last_undegraded":"2024-09-22T08:39:47.621398+0000","last_fullsized":"2024-09-22T08:39:47.621398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-22T08:39:47.621313+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-22T08:39:47.621313+0000","last_clean_scrub_stamp":"2024-09-22T08:39:47.621313+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:26:56.822278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.223645+0000","last_change":"2024-09-22T08:36:27.987971+0000","last_active":"2024-09-22T08:37:04.223645+0000","last_peered":"2024-09-22T08:37:04.223645+0000","last_clean":"2024-09-22T08:37:04.223645+0000","last_became_active":"2024-09-22T08:36:27.987577+0000","last_became_peered":"2024-09-22T08:36:27.987577+0000","last_unstale":"2024-09-22T08:37:04.223645+0000","last_undegraded":"2024-09-22T08:37:04.223645+0000","last_fullsized":"2024-09-22T08:37:04.223645+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_clean_scrub_stamp":"2024-09-22T08:36:26.962226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:17:33.045316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"32'34","reported_seq":81,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:38.899450+0000","last_change":"2024-09-22T08:36:29.995394+0000","last_active":"2024-09-22T08:39:38.899450+0000","last_peered":"2024-09-22T08:39:38.899450+0000","last_clean":"2024-09-22T08:39:38.899450+0000","last_became_active":"2024-09-22T08:36:29.994921+0000","last_became_peered":"2024-09-22T08:36:29.994921+0000","last_unstale":"2024-09-22T08:39:38.899450+0000","last_undegraded":"2024-09-22T08:39:38.899450+0000","last_fullsized":"2024-09-22T08:39:38.899450+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:00:36.656901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.223384+0000","last_change":"2024-09-22T08:36:32.004634+0000","last_active":"2024-09-22T08:37:04.223384+0000","last_peered":"2024-09-22T08:37:04.223384+0000","last_clean":"2024-09-22T08:37:04.223384+0000","last_became_active":"2024-09-22T08:36:32.004269+0000","last_became_peered":"2024-09-22T08:36:32.004269+0000","last_unstale":"2024-09-22T08:37:04.223384+0000","last_undegraded":"2024-09-22T08:37:04.223384+0000","last_fullsized":"2024-09-22T08:37:04.223384+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:51:32.910644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"32'3","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:42.431386+0000","last_change":"2024-09-22T08:36:34.018431+0000","last_active":"2024-09-22T08:37:42.431386+0000","last_peered":"2024-09-22T08:37:42.431386+0000","last_clean":"2024-09-22T08:37:42.431386+0000","last_became_active":"2024-09-22T08:36:34.018190+0000","last_became_peered":"2024-09-22T08:36:34.018190+0000","last_unstale":"2024-09-22T08:37:42.431386+0000","last_undegraded":"2024-09-22T08:37:42.431386+0000","last_fullsized":"2024-09-22T08:37:42.431386+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:09:42.876400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"32'4","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:55.624374+0000","last_change":"2024-09-22T08:39:55.624374+0000","last_active":"2024-09-22T08:39:55.624374+0000","last_peered":"2024-09-22T08:39:55.624374+0000","last_clean":"2024-09-22T08:39:55.624374+0000","last_became_active":"2024-09-22T08:36:25.983073+0000","last_became_peered":"2024-09-22T08:36:25.983073+0000","last_unstale":"2024-09-22T08:39:55.624374+0000","last_undegraded":"2024-09-22T08:39:55.624374+0000","last_fullsized":"2024-09-22T08:39:55.624374+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-22T08:39:55.624297+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-22T08:39:55.624297+0000","last_clean_scrub_stamp":"2024-09-22T08:39:55.624297+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:20:43.093379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:53.406759+0000","last_change":"2024-09-22T08:39:53.406759+0000","last_active":"2024-09-22T08:39:53.406759+0000","last_peered":"2024-09-22T08:39:53.406759+0000","last_clean":"2024-09-22T08:39:53.406759+0000","last_became_active":"2024-09-22T08:36:23.980682+0000","last_became_peered":"2024-09-22T08:36:23.980682+0000","last_unstale":"2024-09-22T08:39:53.406759+0000","last_undegraded":"2024-09-22T08:39:53.406759+0000","last_fullsized":"2024-09-22T08:39:53.406759+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-22T08:39:53.406674+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-22T08:39:53.406674+0000","last_clean_scrub_stamp":"2024-09-22T08:39:53.406674+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:08:41.063816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.225234+0000","last_change":"2024-09-22T08:36:27.985983+0000","last_active":"2024-09-22T08:37:04.225234+0000","last_peered":"2024-09-22T08:37:04.225234+0000","last_clean":"2024-09-22T08:37:04.225234+0000","last_became_active":"2024-09-22T08:36:27.985675+0000","last_became_peered":"2024-09-22T08:36:27.985675+0000","last_unstale":"2024-09-22T08:37:04.225234+0000","last_undegraded":"2024-09-22T08:37:04.225234+0000","last_fullsized":"2024-09-22T08:37:04.225234+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_clean_scrub_stamp":"2024-09-22T08:36:26.962226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:18:38.325978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"32'41","reported_seq":91,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:38.968651+0000","last_change":"2024-09-22T08:36:29.998080+0000","last_active":"2024-09-22T08:39:38.968651+0000","last_peered":"2024-09-22T08:39:38.968651+0000","last_clean":"2024-09-22T08:39:38.968651+0000","last_became_active":"2024-09-22T08:36:29.997542+0000","last_became_peered":"2024-09-22T08:36:29.997542+0000","last_unstale":"2024-09-22T08:39:38.968651+0000","last_undegraded":"2024-09-22T08:39:38.968651+0000","last_fullsized":"2024-09-22T08:39:38.968651+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:42:31.088070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"32'285","reported_seq":351,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:38.830255+0000","last_change":"2024-09-22T08:36:32.005012+0000","last_active":"2024-09-22T08:39:38.830255+0000","last_peered":"2024-09-22T08:39:38.830255+0000","last_clean":"2024-09-22T08:39:38.830255+0000","last_became_active":"2024-09-22T08:36:32.004441+0000","last_became_peered":"2024-09-22T08:36:32.004441+0000","last_unstale":"2024-09-22T08:39:38.830255+0000","last_undegraded":"2024-09-22T08:39:38.830255+0000","last_fullsized":"2024-09-22T08:39:38.830255+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:10:54.748229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.225164+0000","last_change":"2024-09-22T08:36:34.017600+0000","last_active":"2024-09-22T08:37:04.225164+0000","last_peered":"2024-09-22T08:37:04.225164+0000","last_clean":"2024-09-22T08:37:04.225164+0000","last_became_active":"2024-09-22T08:36:34.017217+0000","last_became_peered":"2024-09-22T08:36:34.017217+0000","last_unstale":"2024-09-22T08:37:04.225164+0000","last_undegraded":"2024-09-22T08:37:04.225164+0000","last_fullsized":"2024-09-22T08:37:04.225164+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:43:08.076327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"32'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:56.576672+0000","last_change":"2024-09-22T08:39:56.576672+0000","last_active":"2024-09-22T08:39:56.576672+0000","last_peered":"2024-09-22T08:39:56.576672+0000","last_clean":"2024-09-22T08:39:56.576672+0000","last_became_active":"2024-09-22T08:36:25.972198+0000","last_became_peered":"2024-09-22T08:36:25.972198+0000","last_unstale":"2024-09-22T08:39:56.576672+0000","last_undegraded":"2024-09-22T08:39:56.576672+0000","last_fullsized":"2024-09-22T08:39:56.576672+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-22T08:39:56.576591+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-22T08:39:56.576591+0000","last_clean_scrub_stamp":"2024-09-22T08:39:56.576591+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:19:21.946421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:55.322922+0000","last_change":"2024-09-22T08:39:55.322922+0000","last_active":"2024-09-22T08:39:55.322922+0000","last_peered":"2024-09-22T08:39:55.322922+0000","last_clean":"2024-09-22T08:39:55.322922+0000","last_became_active":"2024-09-22T08:36:23.978306+0000","last_became_peered":"2024-09-22T08:36:23.978306+0000","last_unstale":"2024-09-22T08:39:55.322922+0000","last_undegraded":"2024-09-22T08:39:55.322922+0000","last_fullsized":"2024-09-22T08:39:55.322922+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:39:55.322811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:39:55.322811+0000","last_clean_scrub_stamp":"2024-09-22T08:39:55.322811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:44:43.243059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.224012+0000","last_change":"2024-09-22T08:36:27.986048+0000","last_active":"2024-09-22T08:37:04.224012+0000","last_peered":"2024-09-22T08:37:04.224012+0000","last_clean":"2024-09-22T08:37:04.224012+0000","last_became_active":"2024-09-22T08:36:27.985751+0000","last_became_peered":"2024-09-22T08:36:27.985751+0000","last_unstale":"2024-09-22T08:37:04.224012+0000","last_undegraded":"2024-09-22T08:37:04.224012+0000","last_fullsized":"2024-09-22T08:37:04.224012+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_clean_scrub_stamp":"2024-09-22T08:36:26.962226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:05:30.441634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"32'61","reported_seq":126,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:38.907852+0000","last_change":"2024-09-22T08:36:29.995500+0000","last_active":"2024-09-22T08:39:38.907852+0000","last_peered":"2024-09-22T08:39:38.907852+0000","last_clean":"2024-09-22T08:39:38.907852+0000","last_became_active":"2024-09-22T08:36:29.995225+0000","last_became_peered":"2024-09-22T08:36:29.995225+0000","last_unstale":"2024-09-22T08:39:38.907852+0000","last_undegraded":"2024-09-22T08:39:38.907852+0000","last_fullsized":"2024-09-22T08:39:38.907852+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:06:45.130197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.223232+0000","last_change":"2024-09-22T08:36:32.003118+0000","last_active":"2024-09-22T08:37:04.223232+0000","last_peered":"2024-09-22T08:37:04.223232+0000","last_clean":"2024-09-22T08:37:04.223232+0000","last_became_active":"2024-09-22T08:36:32.002833+0000","last_became_peered":"2024-09-22T08:36:32.002833+0000","last_unstale":"2024-09-22T08:37:04.223232+0000","last_undegraded":"2024-09-22T08:37:04.223232+0000","last_fullsized":"2024-09-22T08:37:04.223232+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:35:19.477576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"32'18","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.383653+0000","last_change":"2024-09-22T08:36:34.015160+0000","last_active":"2024-09-22T08:39:32.383653+0000","last_peered":"2024-09-22T08:39:32.383653+0000","last_clean":"2024-09-22T08:39:32.383653+0000","last_became_active":"2024-09-22T08:36:34.014853+0000","last_became_peered":"2024-09-22T08:36:34.014853+0000","last_unstale":"2024-09-22T08:39:32.383653+0000","last_undegraded":"2024-09-22T08:39:32.383653+0000","last_fullsized":"2024-09-22T08:39:32.383653+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:14:47.722976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"32'12","reported_seq":70,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:48.128311+0000","last_change":"2024-09-22T08:36:25.977939+0000","last_active":"2024-09-22T08:37:48.128311+0000","last_peered":"2024-09-22T08:37:48.128311+0000","last_clean":"2024-09-22T08:37:48.128311+0000","last_became_active":"2024-09-22T08:36:25.977682+0000","last_became_peered":"2024-09-22T08:36:25.977682+0000","last_unstale":"2024-09-22T08:37:48.128311+0000","last_undegraded":"2024-09-22T08:37:48.128311+0000","last_fullsized":"2024-09-22T08:37:48.128311+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:13:46.550224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":47,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:46.788116+0000","last_change":"2024-09-22T08:39:46.788116+0000","last_active":"2024-09-22T08:39:46.788116+0000","last_peered":"2024-09-22T08:39:46.788116+0000","last_clean":"2024-09-22T08:39:46.788116+0000","last_became_active":"2024-09-22T08:36:23.972822+0000","last_became_peered":"2024-09-22T08:36:23.972822+0000","last_unstale":"2024-09-22T08:39:46.788116+0000","last_undegraded":"2024-09-22T08:39:46.788116+0000","last_fullsized":"2024-09-22T08:39:46.788116+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:39:46.788026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:39:46.788026+0000","last_clean_scrub_stamp":"2024-09-22T08:39:46.788026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:10:40.958015+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.227778+0000","last_change":"2024-09-22T08:36:27.992047+0000","last_active":"2024-09-22T08:37:04.227778+0000","last_peered":"2024-09-22T08:37:04.227778+0000","last_clean":"2024-09-22T08:37:04.227778+0000","last_became_active":"2024-09-22T08:36:27.991761+0000","last_became_peered":"2024-09-22T08:36:27.991761+0000","last_unstale":"2024-09-22T08:37:04.227778+0000","last_undegraded":"2024-09-22T08:37:04.227778+0000","last_fullsized":"2024-09-22T08:37:04.227778+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_clean_scrub_stamp":"2024-09-22T08:36:26.962226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:45:08.688857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"32'35","reported_seq":83,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:38.910893+0000","last_change":"2024-09-22T08:36:29.988696+0000","last_active":"2024-09-22T08:39:38.910893+0000","last_peered":"2024-09-22T08:39:38.910893+0000","last_clean":"2024-09-22T08:39:38.910893+0000","last_became_active":"2024-09-22T08:36:29.988363+0000","last_became_peered":"2024-09-22T08:36:29.988363+0000","last_unstale":"2024-09-22T08:39:38.910893+0000","last_undegraded":"2024-09-22T08:39:38.910893+0000","last_fullsized":"2024-09-22T08:39:38.910893+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:20:15.843523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.229572+0000","last_change":"2024-09-22T08:36:32.012753+0000","last_active":"2024-09-22T08:37:04.229572+0000","last_peered":"2024-09-22T08:37:04.229572+0000","last_clean":"2024-09-22T08:37:04.229572+0000","last_became_active":"2024-09-22T08:36:32.011923+0000","last_became_peered":"2024-09-22T08:36:32.011923+0000","last_unstale":"2024-09-22T08:37:04.229572+0000","last_undegraded":"2024-09-22T08:37:04.229572+0000","last_fullsized":"2024-09-22T08:37:04.229572+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:27:01.625975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"32'3","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:33.182535+0000","last_change":"2024-09-22T08:36:34.013810+0000","last_active":"2024-09-22T08:38:33.182535+0000","last_peered":"2024-09-22T08:38:33.182535+0000","last_clean":"2024-09-22T08:38:33.182535+0000","last_became_active":"2024-09-22T08:36:34.013308+0000","last_became_peered":"2024-09-22T08:36:34.013308+0000","last_unstale":"2024-09-22T08:38:33.182535+0000","last_undegraded":"2024-09-22T08:38:33.182535+0000","last_fullsized":"2024-09-22T08:38:33.182535+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:08:44.619221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"32'6","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.214676+0000","last_change":"2024-09-22T08:36:25.993564+0000","last_active":"2024-09-22T08:39:32.214676+0000","last_peered":"2024-09-22T08:39:32.214676+0000","last_clean":"2024-09-22T08:39:32.214676+0000","last_became_active":"2024-09-22T08:36:25.992167+0000","last_became_peered":"2024-09-22T08:36:25.992167+0000","last_unstale":"2024-09-22T08:39:32.214676+0000","last_undegraded":"2024-09-22T08:39:32.214676+0000","last_fullsized":"2024-09-22T08:39:32.214676+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:39:40.006672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"32'4","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:51.418486+0000","last_change":"2024-09-22T08:39:51.418486+0000","last_active":"2024-09-22T08:39:51.418486+0000","last_peered":"2024-09-22T08:39:51.418486+0000","last_clean":"2024-09-22T08:39:51.418486+0000","last_became_active":"2024-09-22T08:36:23.980560+0000","last_became_peered":"2024-09-22T08:36:23.980560+0000","last_unstale":"2024-09-22T08:39:51.418486+0000","last_undegraded":"2024-09-22T08:39:51.418486+0000","last_fullsized":"2024-09-22T08:39:51.418486+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-22T08:39:51.418401+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-22T08:39:51.418401+0000","last_clean_scrub_stamp":"2024-09-22T08:39:51.418401+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:39:01.093268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":6,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.226238+0000","last_change":"2024-09-22T08:36:27.984977+0000","last_active":"2024-09-22T08:37:04.226238+0000","last_peered":"2024-09-22T08:37:04.226238+0000","last_clean":"2024-09-22T08:37:04.226238+0000","last_became_active":"2024-09-22T08:36:27.984699+0000","last_became_peered":"2024-09-22T08:36:27.984699+0000","last_unstale":"2024-09-22T08:37:04.226238+0000","last_undegraded":"2024-09-22T08:37:04.226238+0000","last_fullsized":"2024-09-22T08:37:04.226238+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_clean_scrub_stamp":"2024-09-22T08:36:26.962226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:30:42.385182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"32'39","reported_seq":89,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:38.890183+0000","last_change":"2024-09-22T08:36:29.989330+0000","last_active":"2024-09-22T08:39:38.890183+0000","last_peered":"2024-09-22T08:39:38.890183+0000","last_clean":"2024-09-22T08:39:38.890183+0000","last_became_active":"2024-09-22T08:36:29.989049+0000","last_became_peered":"2024-09-22T08:36:29.989049+0000","last_unstale":"2024-09-22T08:39:38.890183+0000","last_undegraded":"2024-09-22T08:39:38.890183+0000","last_fullsized":"2024-09-22T08:39:38.890183+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:25:38.846675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"32'285","reported_seq":455,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:38.825419+0000","last_change":"2024-09-22T08:36:32.003714+0000","last_active":"2024-09-22T08:39:38.825419+0000","last_peered":"2024-09-22T08:39:38.825419+0000","last_clean":"2024-09-22T08:39:38.825419+0000","last_became_active":"2024-09-22T08:36:32.003451+0000","last_became_peered":"2024-09-22T08:36:32.003451+0000","last_unstale":"2024-09-22T08:39:38.825419+0000","last_undegraded":"2024-09-22T08:39:38.825419+0000","last_fullsized":"2024-09-22T08:39:38.825419+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:36:40.009194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"32'12","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:38.177618+0000","last_change":"2024-09-22T08:36:34.017932+0000","last_active":"2024-09-22T08:38:38.177618+0000","last_peered":"2024-09-22T08:38:38.177618+0000","last_clean":"2024-09-22T08:38:38.177618+0000","last_became_active":"2024-09-22T08:36:34.017586+0000","last_became_peered":"2024-09-22T08:36:34.017586+0000","last_unstale":"2024-09-22T08:38:38.177618+0000","last_undegraded":"2024-09-22T08:38:38.177618+0000","last_fullsized":"2024-09-22T08:38:38.177618+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:03:46.243863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"32'6","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:31.996687+0000","last_change":"2024-09-22T08:36:25.984089+0000","last_active":"2024-09-22T08:39:31.996687+0000","last_peered":"2024-09-22T08:39:31.996687+0000","last_clean":"2024-09-22T08:39:31.996687+0000","last_became_active":"2024-09-22T08:36:25.983836+0000","last_became_peered":"2024-09-22T08:36:25.983836+0000","last_unstale":"2024-09-22T08:39:31.996687+0000","last_undegraded":"2024-09-22T08:39:31.996687+0000","last_fullsized":"2024-09-22T08:39:31.996687+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:55:24.968571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":29,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:50.428805+0000","last_change":"2024-09-22T08:39:50.428805+0000","last_active":"2024-09-22T08:39:50.428805+0000","last_peered":"2024-09-22T08:39:50.428805+0000","last_clean":"2024-09-22T08:39:50.428805+0000","last_became_active":"2024-09-22T08:36:23.981453+0000","last_became_peered":"2024-09-22T08:36:23.981453+0000","last_unstale":"2024-09-22T08:39:50.428805+0000","last_undegraded":"2024-09-22T08:39:50.428805+0000","last_fullsized":"2024-09-22T08:39:50.428805+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:39:50.428713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:39:50.428713+0000","last_clean_scrub_stamp":"2024-09-22T08:39:50.428713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:18:15.418827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"32'3","reported_seq":418,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:38.806077+0000","last_change":"2024-09-22T08:36:27.990966+0000","last_active":"2024-09-22T08:39:38.806077+0000","last_peered":"2024-09-22T08:39:38.806077+0000","last_clean":"2024-09-22T08:39:38.806077+0000","last_became_active":"2024-09-22T08:36:27.990658+0000","last_became_peered":"2024-09-22T08:36:27.990658+0000","last_unstale":"2024-09-22T08:39:38.806077+0000","last_undegraded":"2024-09-22T08:39:38.806077+0000","last_fullsized":"2024-09-22T08:39:38.806077+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_clean_scrub_stamp":"2024-09-22T08:36:26.962226+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:46:19.841645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"30'10","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.225133+0000","last_change":"2024-09-22T08:36:29.994653+0000","last_active":"2024-09-22T08:37:04.225133+0000","last_peered":"2024-09-22T08:37:04.225133+0000","last_clean":"2024-09-22T08:37:04.225133+0000","last_became_active":"2024-09-22T08:36:29.994352+0000","last_became_peered":"2024-09-22T08:36:29.994352+0000","last_unstale":"2024-09-22T08:37:04.225133+0000","last_undegraded":"2024-09-22T08:37:04.225133+0000","last_fullsized":"2024-09-22T08:37:04.225133+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:29:42.839928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"32'285","reported_seq":466,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:38.826525+0000","last_change":"2024-09-22T08:36:32.002508+0000","last_active":"2024-09-22T08:39:38.826525+0000","last_peered":"2024-09-22T08:39:38.826525+0000","last_clean":"2024-09-22T08:39:38.826525+0000","last_became_active":"2024-09-22T08:36:32.002222+0000","last_became_peered":"2024-09-22T08:36:32.002222+0000","last_unstale":"2024-09-22T08:39:38.826525+0000","last_undegraded":"2024-09-22T08:39:38.826525+0000","last_fullsized":"2024-09-22T08:39:38.826525+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:01:40.774076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"32'4","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:31.432921+0000","last_change":"2024-09-22T08:36:34.016126+0000","last_active":"2024-09-22T08:38:31.432921+0000","last_peered":"2024-09-22T08:38:31.432921+0000","last_clean":"2024-09-22T08:38:31.432921+0000","last_became_active":"2024-09-22T08:36:34.015833+0000","last_became_peered":"2024-09-22T08:36:34.015833+0000","last_unstale":"2024-09-22T08:38:31.432921+0000","last_undegraded":"2024-09-22T08:38:31.432921+0000","last_fullsized":"2024-09-22T08:38:31.432921+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:08:38.502068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"32'6","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.214644+0000","last_change":"2024-09-22T08:36:25.978129+0000","last_active":"2024-09-22T08:39:32.214644+0000","last_peered":"2024-09-22T08:39:32.214644+0000","last_clean":"2024-09-22T08:39:32.214644+0000","last_became_active":"2024-09-22T08:36:25.977184+0000","last_became_peered":"2024-09-22T08:36:25.977184+0000","last_unstale":"2024-09-22T08:39:32.214644+0000","last_undegraded":"2024-09-22T08:39:32.214644+0000","last_fullsized":"2024-09-22T08:39:32.214644+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:04:17.169545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"32'8","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:46.401339+0000","last_change":"2024-09-22T08:39:46.401339+0000","last_active":"2024-09-22T08:39:46.401339+0000","last_peered":"2024-09-22T08:39:46.401339+0000","last_clean":"2024-09-22T08:39:46.401339+0000","last_became_active":"2024-09-22T08:36:23.976129+0000","last_became_peered":"2024-09-22T08:36:23.976129+0000","last_unstale":"2024-09-22T08:39:46.401339+0000","last_undegraded":"2024-09-22T08:39:46.401339+0000","last_fullsized":"2024-09-22T08:39:46.401339+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-22T08:39:46.401243+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-22T08:39:46.401243+0000","last_clean_scrub_stamp":"2024-09-22T08:39:46.401243+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:53:00.898981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":14,"num_write":48,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"23'1","reported_seq":221,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:38.795945+0000","last_change":"2024-09-22T08:36:27.988301+0000","last_active":"2024-09-22T08:39:38.795945+0000","last_peered":"2024-09-22T08:39:38.795945+0000","last_clean":"2024-09-22T08:39:38.795945+0000","last_became_active":"2024-09-22T08:36:27.987999+0000","last_became_peered":"2024-09-22T08:36:27.987999+0000","last_unstale":"2024-09-22T08:39:38.795945+0000","last_undegraded":"2024-09-22T08:39:38.795945+0000","last_fullsized":"2024-09-22T08:39:38.795945+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_clean_scrub_stamp":"2024-09-22T08:36:26.962226+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:18:39.538565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"32'41","reported_seq":92,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:38.948410+0000","last_change":"2024-09-22T08:36:29.992044+0000","last_active":"2024-09-22T08:39:38.948410+0000","last_peered":"2024-09-22T08:39:38.948410+0000","last_clean":"2024-09-22T08:39:38.948410+0000","last_became_active":"2024-09-22T08:36:29.991671+0000","last_became_peered":"2024-09-22T08:36:29.991671+0000","last_unstale":"2024-09-22T08:39:38.948410+0000","last_undegraded":"2024-09-22T08:39:38.948410+0000","last_fullsized":"2024-09-22T08:39:38.948410+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:30:17.519164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.225831+0000","last_change":"2024-09-22T08:36:32.012136+0000","last_active":"2024-09-22T08:37:04.225831+0000","last_peered":"2024-09-22T08:37:04.225831+0000","last_clean":"2024-09-22T08:37:04.225831+0000","last_became_active":"2024-09-22T08:36:32.011845+0000","last_became_peered":"2024-09-22T08:36:32.011845+0000","last_unstale":"2024-09-22T08:37:04.225831+0000","last_undegraded":"2024-09-22T08:37:04.225831+0000","last_fullsized":"2024-09-22T08:37:04.225831+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:30:19.290881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"32'6","reported_seq":25,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.324008+0000","last_change":"2024-09-22T08:36:34.008672+0000","last_active":"2024-09-22T08:39:32.324008+0000","last_peered":"2024-09-22T08:39:32.324008+0000","last_clean":"2024-09-22T08:39:32.324008+0000","last_became_active":"2024-09-22T08:36:34.008374+0000","last_became_peered":"2024-09-22T08:36:34.008374+0000","last_unstale":"2024-09-22T08:39:32.324008+0000","last_undegraded":"2024-09-22T08:39:32.324008+0000","last_fullsized":"2024-09-22T08:39:32.324008+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:58:45.659504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"32'15","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:54.643440+0000","last_change":"2024-09-22T08:39:54.643440+0000","last_active":"2024-09-22T08:39:54.643440+0000","last_peered":"2024-09-22T08:39:54.643440+0000","last_clean":"2024-09-22T08:39:54.643440+0000","last_became_active":"2024-09-22T08:37:04.228680+0000","last_became_peered":"2024-09-22T08:37:04.228680+0000","last_unstale":"2024-09-22T08:39:54.643440+0000","last_undegraded":"2024-09-22T08:39:54.643440+0000","last_fullsized":"2024-09-22T08:39:54.643440+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'15","last_scrub_stamp":"2024-09-22T08:39:54.643331+0000","last_deep_scrub":"32'15","last_deep_scrub_stamp":"2024-09-22T08:39:54.643331+0000","last_clean_scrub_stamp":"2024-09-22T08:39:54.643331+0000","objects_scrubbed":1,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:10:02.228729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":62,"num_read_kb":54,"num_write":19,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"32'74","reported_seq":152,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:43.060183+0000","last_change":"2024-09-22T08:39:43.060183+0000","last_active":"2024-09-22T08:39:43.060183+0000","last_peered":"2024-09-22T08:39:43.060183+0000","last_clean":"2024-09-22T08:39:43.060183+0000","last_became_active":"2024-09-22T08:36:10.736221+0000","last_became_peered":"2024-09-22T08:36:10.736221+0000","last_unstale":"2024-09-22T08:39:43.060183+0000","last_undegraded":"2024-09-22T08:39:43.060183+0000","last_fullsized":"2024-09-22T08:39:43.060183+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'74","last_scrub_stamp":"2024-09-22T08:39:43.060088+0000","last_deep_scrub":"32'74","last_deep_scrub_stamp":"2024-09-22T08:39:43.060088+0000","last_clean_scrub_stamp":"2024-09-22T08:39:43.060088+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:47:30.182707+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"32'2","reported_seq":61,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:45.437270+0000","last_change":"2024-09-22T08:39:45.437270+0000","last_active":"2024-09-22T08:39:45.437270+0000","last_peered":"2024-09-22T08:39:45.437270+0000","last_clean":"2024-09-22T08:39:45.437270+0000","last_became_active":"2024-09-22T08:36:16.425465+0000","last_became_peered":"2024-09-22T08:36:16.425465+0000","last_unstale":"2024-09-22T08:39:45.437270+0000","last_undegraded":"2024-09-22T08:39:45.437270+0000","last_fullsized":"2024-09-22T08:39:45.437270+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-22T08:39:45.437175+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-22T08:39:45.437175+0000","last_clean_scrub_stamp":"2024-09-22T08:39:45.437175+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:50:58.216244+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00049376300000000004,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"32'6","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:48.401375+0000","last_change":"2024-09-22T08:39:48.401375+0000","last_active":"2024-09-22T08:39:48.401375+0000","last_peered":"2024-09-22T08:39:48.401375+0000","last_clean":"2024-09-22T08:39:48.401375+0000","last_became_active":"2024-09-22T08:36:23.981576+0000","last_became_peered":"2024-09-22T08:36:23.981576+0000","last_unstale":"2024-09-22T08:39:48.401375+0000","last_undegraded":"2024-09-22T08:39:48.401375+0000","last_fullsized":"2024-09-22T08:39:48.401375+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-22T08:39:48.401293+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-22T08:39:48.401293+0000","last_clean_scrub_stamp":"2024-09-22T08:39:48.401293+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:49:36.460213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4,"num_write":22,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.223327+0000","last_change":"2024-09-22T08:36:27.991484+0000","last_active":"2024-09-22T08:37:04.223327+0000","last_peered":"2024-09-22T08:37:04.223327+0000","last_clean":"2024-09-22T08:37:04.223327+0000","last_became_active":"2024-09-22T08:36:27.991130+0000","last_became_peered":"2024-09-22T08:36:27.991130+0000","last_unstale":"2024-09-22T08:37:04.223327+0000","last_undegraded":"2024-09-22T08:37:04.223327+0000","last_fullsized":"2024-09-22T08:37:04.223327+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_clean_scrub_stamp":"2024-09-22T08:36:26.962226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:25:36.836271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"32'85","reported_seq":167,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:38.954786+0000","last_change":"2024-09-22T08:36:29.997752+0000","last_active":"2024-09-22T08:39:38.954786+0000","last_peered":"2024-09-22T08:39:38.954786+0000","last_clean":"2024-09-22T08:39:38.954786+0000","last_became_active":"2024-09-22T08:36:29.997294+0000","last_became_peered":"2024-09-22T08:36:29.997294+0000","last_unstale":"2024-09-22T08:39:38.954786+0000","last_undegraded":"2024-09-22T08:39:38.954786+0000","last_fullsized":"2024-09-22T08:39:38.954786+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:18:13.227210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.226456+0000","last_change":"2024-09-22T08:36:32.009096+0000","last_active":"2024-09-22T08:37:04.226456+0000","last_peered":"2024-09-22T08:37:04.226456+0000","last_clean":"2024-09-22T08:37:04.226456+0000","last_became_active":"2024-09-22T08:36:32.008793+0000","last_became_peered":"2024-09-22T08:36:32.008793+0000","last_unstale":"2024-09-22T08:37:04.226456+0000","last_undegraded":"2024-09-22T08:37:04.226456+0000","last_fullsized":"2024-09-22T08:37:04.226456+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:01:07.495676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"32'81","reported_seq":163,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.301899+0000","last_change":"2024-09-22T08:36:34.016827+0000","last_active":"2024-09-22T08:39:32.301899+0000","last_peered":"2024-09-22T08:39:32.301899+0000","last_clean":"2024-09-22T08:39:32.301899+0000","last_became_active":"2024-09-22T08:36:34.016484+0000","last_became_peered":"2024-09-22T08:36:34.016484+0000","last_unstale":"2024-09-22T08:39:32.301899+0000","last_undegraded":"2024-09-22T08:39:32.301899+0000","last_fullsized":"2024-09-22T08:39:32.301899+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:27:41.551286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":223,"num_read_kb":221,"num_write":155,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"32'6","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.289629+0000","last_change":"2024-09-22T08:36:25.988439+0000","last_active":"2024-09-22T08:39:32.289629+0000","last_peered":"2024-09-22T08:39:32.289629+0000","last_clean":"2024-09-22T08:39:32.289629+0000","last_became_active":"2024-09-22T08:36:25.988156+0000","last_became_peered":"2024-09-22T08:36:25.988156+0000","last_unstale":"2024-09-22T08:39:32.289629+0000","last_undegraded":"2024-09-22T08:39:32.289629+0000","last_fullsized":"2024-09-22T08:39:32.289629+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:02:27.083682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:43.491476+0000","last_change":"2024-09-22T08:39:43.491476+0000","last_active":"2024-09-22T08:39:43.491476+0000","last_peered":"2024-09-22T08:39:43.491476+0000","last_clean":"2024-09-22T08:39:43.491476+0000","last_became_active":"2024-09-22T08:36:16.427252+0000","last_became_peered":"2024-09-22T08:36:16.427252+0000","last_unstale":"2024-09-22T08:39:43.491476+0000","last_undegraded":"2024-09-22T08:39:43.491476+0000","last_fullsized":"2024-09-22T08:39:43.491476+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:39:43.491364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:39:43.491364+0000","last_clean_scrub_stamp":"2024-09-22T08:39:43.491364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:29:57.540388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055484200000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:43.847049+0000","last_change":"2024-09-22T08:39:43.847049+0000","last_active":"2024-09-22T08:39:43.847049+0000","last_peered":"2024-09-22T08:39:43.847049+0000","last_clean":"2024-09-22T08:39:43.847049+0000","last_became_active":"2024-09-22T08:36:23.973773+0000","last_became_peered":"2024-09-22T08:36:23.973773+0000","last_unstale":"2024-09-22T08:39:43.847049+0000","last_undegraded":"2024-09-22T08:39:43.847049+0000","last_fullsized":"2024-09-22T08:39:43.847049+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:39:43.846973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:39:43.846973+0000","last_clean_scrub_stamp":"2024-09-22T08:39:43.846973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:25:33.678376+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.236920+0000","last_change":"2024-09-22T08:37:04.234583+0000","last_active":"2024-09-22T08:37:04.236920+0000","last_peered":"2024-09-22T08:37:04.236920+0000","last_clean":"2024-09-22T08:37:04.236920+0000","last_became_active":"2024-09-22T08:37:04.234316+0000","last_became_peered":"2024-09-22T08:37:04.234316+0000","last_unstale":"2024-09-22T08:37:04.236920+0000","last_undegraded":"2024-09-22T08:37:04.236920+0000","last_fullsized":"2024-09-22T08:37:04.236920+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_clean_scrub_stamp":"2024-09-22T08:36:26.962226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:12:15.239608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"32'285","reported_seq":501,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:38.952535+0000","last_change":"2024-09-22T08:36:29.996545+0000","last_active":"2024-09-22T08:39:38.952535+0000","last_peered":"2024-09-22T08:39:38.952535+0000","last_clean":"2024-09-22T08:39:38.952535+0000","last_became_active":"2024-09-22T08:36:29.996025+0000","last_became_peered":"2024-09-22T08:36:29.996025+0000","last_unstale":"2024-09-22T08:39:38.952535+0000","last_undegraded":"2024-09-22T08:39:38.952535+0000","last_fullsized":"2024-09-22T08:39:38.952535+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:55:34.543185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":378,"num_read_kb":363,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.227773+0000","last_change":"2024-09-22T08:36:32.013929+0000","last_active":"2024-09-22T08:37:04.227773+0000","last_peered":"2024-09-22T08:37:04.227773+0000","last_clean":"2024-09-22T08:37:04.227773+0000","last_became_active":"2024-09-22T08:36:32.013220+0000","last_became_peered":"2024-09-22T08:36:32.013220+0000","last_unstale":"2024-09-22T08:37:04.227773+0000","last_undegraded":"2024-09-22T08:37:04.227773+0000","last_fullsized":"2024-09-22T08:37:04.227773+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:57:05.813999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"32'5","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:28.578046+0000","last_change":"2024-09-22T08:36:34.018385+0000","last_active":"2024-09-22T08:38:28.578046+0000","last_peered":"2024-09-22T08:38:28.578046+0000","last_clean":"2024-09-22T08:38:28.578046+0000","last_became_active":"2024-09-22T08:36:34.018138+0000","last_became_peered":"2024-09-22T08:36:34.018138+0000","last_unstale":"2024-09-22T08:38:28.578046+0000","last_undegraded":"2024-09-22T08:38:28.578046+0000","last_fullsized":"2024-09-22T08:38:28.578046+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:47:34.849746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"32'8","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:01.792896+0000","last_change":"2024-09-22T08:40:01.792896+0000","last_active":"2024-09-22T08:40:01.792896+0000","last_peered":"2024-09-22T08:40:01.792896+0000","last_clean":"2024-09-22T08:40:01.792896+0000","last_became_active":"2024-09-22T08:36:25.979108+0000","last_became_peered":"2024-09-22T08:36:25.979108+0000","last_unstale":"2024-09-22T08:40:01.792896+0000","last_undegraded":"2024-09-22T08:40:01.792896+0000","last_fullsized":"2024-09-22T08:40:01.792896+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-22T08:40:01.792800+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-22T08:40:01.792800+0000","last_clean_scrub_stamp":"2024-09-22T08:40:01.792800+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:15:50.070182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:43.605309+0000","last_change":"2024-09-22T08:39:43.605309+0000","last_active":"2024-09-22T08:39:43.605309+0000","last_peered":"2024-09-22T08:39:43.605309+0000","last_clean":"2024-09-22T08:39:43.605309+0000","last_became_active":"2024-09-22T08:36:16.427121+0000","last_became_peered":"2024-09-22T08:36:16.427121+0000","last_unstale":"2024-09-22T08:39:43.605309+0000","last_undegraded":"2024-09-22T08:39:43.605309+0000","last_fullsized":"2024-09-22T08:39:43.605309+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:39:43.605211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:39:43.605211+0000","last_clean_scrub_stamp":"2024-09-22T08:39:43.605211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:07:42.970630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041194099999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"32'2","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:44.811985+0000","last_change":"2024-09-22T08:39:44.811985+0000","last_active":"2024-09-22T08:39:44.811985+0000","last_peered":"2024-09-22T08:39:44.811985+0000","last_clean":"2024-09-22T08:39:44.811985+0000","last_became_active":"2024-09-22T08:36:23.971688+0000","last_became_peered":"2024-09-22T08:36:23.971688+0000","last_unstale":"2024-09-22T08:39:44.811985+0000","last_undegraded":"2024-09-22T08:39:44.811985+0000","last_fullsized":"2024-09-22T08:39:44.811985+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-22T08:39:44.811892+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-22T08:39:44.811892+0000","last_clean_scrub_stamp":"2024-09-22T08:39:44.811892+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:25:37.511699+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"23'1","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.230019+0000","last_change":"2024-09-22T08:36:27.987350+0000","last_active":"2024-09-22T08:37:04.230019+0000","last_peered":"2024-09-22T08:37:04.230019+0000","last_clean":"2024-09-22T08:37:04.230019+0000","last_became_active":"2024-09-22T08:36:27.986993+0000","last_became_peered":"2024-09-22T08:36:27.986993+0000","last_unstale":"2024-09-22T08:37:04.230019+0000","last_undegraded":"2024-09-22T08:37:04.230019+0000","last_fullsized":"2024-09-22T08:37:04.230019+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_clean_scrub_stamp":"2024-09-22T08:36:26.962226+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:04:19.174975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"32'17","reported_seq":85,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:28.067597+0000","last_change":"2024-09-22T08:36:29.991891+0000","last_active":"2024-09-22T08:39:28.067597+0000","last_peered":"2024-09-22T08:39:28.067597+0000","last_clean":"2024-09-22T08:39:28.067597+0000","last_became_active":"2024-09-22T08:36:29.991579+0000","last_became_peered":"2024-09-22T08:36:29.991579+0000","last_unstale":"2024-09-22T08:39:28.067597+0000","last_undegraded":"2024-09-22T08:39:28.067597+0000","last_fullsized":"2024-09-22T08:39:28.067597+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:17:51.757786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.224585+0000","last_change":"2024-09-22T08:36:32.011889+0000","last_active":"2024-09-22T08:37:04.224585+0000","last_peered":"2024-09-22T08:37:04.224585+0000","last_clean":"2024-09-22T08:37:04.224585+0000","last_became_active":"2024-09-22T08:36:32.011634+0000","last_became_peered":"2024-09-22T08:36:32.011634+0000","last_unstale":"2024-09-22T08:37:04.224585+0000","last_undegraded":"2024-09-22T08:37:04.224585+0000","last_fullsized":"2024-09-22T08:37:04.224585+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:56:34.615539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.226958+0000","last_change":"2024-09-22T08:36:34.012423+0000","last_active":"2024-09-22T08:37:04.226958+0000","last_peered":"2024-09-22T08:37:04.226958+0000","last_clean":"2024-09-22T08:37:04.226958+0000","last_became_active":"2024-09-22T08:36:34.011936+0000","last_became_peered":"2024-09-22T08:36:34.011936+0000","last_unstale":"2024-09-22T08:37:04.226958+0000","last_undegraded":"2024-09-22T08:37:04.226958+0000","last_fullsized":"2024-09-22T08:37:04.226958+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:29:05.565248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"32'3","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:59.876252+0000","last_change":"2024-09-22T08:39:59.876252+0000","last_active":"2024-09-22T08:39:59.876252+0000","last_peered":"2024-09-22T08:39:59.876252+0000","last_clean":"2024-09-22T08:39:59.876252+0000","last_became_active":"2024-09-22T08:36:25.977552+0000","last_became_peered":"2024-09-22T08:36:25.977552+0000","last_unstale":"2024-09-22T08:39:59.876252+0000","last_undegraded":"2024-09-22T08:39:59.876252+0000","last_fullsized":"2024-09-22T08:39:59.876252+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2024-09-22T08:39:59.876163+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2024-09-22T08:39:59.876163+0000","last_clean_scrub_stamp":"2024-09-22T08:39:59.876163+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:26:06.074309+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"32'3","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:44.485607+0000","last_change":"2024-09-22T08:39:44.485607+0000","last_active":"2024-09-22T08:39:44.485607+0000","last_peered":"2024-09-22T08:39:44.485607+0000","last_clean":"2024-09-22T08:39:44.485607+0000","last_became_active":"2024-09-22T08:36:16.427358+0000","last_became_peered":"2024-09-22T08:36:16.427358+0000","last_unstale":"2024-09-22T08:39:44.485607+0000","last_undegraded":"2024-09-22T08:39:44.485607+0000","last_fullsized":"2024-09-22T08:39:44.485607+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2024-09-22T08:39:44.485523+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2024-09-22T08:39:44.485523+0000","last_clean_scrub_stamp":"2024-09-22T08:39:44.485523+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:22:57.579671+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.001068835,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"32'4","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:45.577394+0000","last_change":"2024-09-22T08:39:45.577394+0000","last_active":"2024-09-22T08:39:45.577394+0000","last_peered":"2024-09-22T08:39:45.577394+0000","last_clean":"2024-09-22T08:39:45.577394+0000","last_became_active":"2024-09-22T08:36:23.967413+0000","last_became_peered":"2024-09-22T08:36:23.967413+0000","last_unstale":"2024-09-22T08:39:45.577394+0000","last_undegraded":"2024-09-22T08:39:45.577394+0000","last_fullsized":"2024-09-22T08:39:45.577394+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-22T08:39:45.577315+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-22T08:39:45.577315+0000","last_clean_scrub_stamp":"2024-09-22T08:39:45.577315+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:36:05.444054+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.225286+0000","last_change":"2024-09-22T08:36:27.988932+0000","last_active":"2024-09-22T08:37:04.225286+0000","last_peered":"2024-09-22T08:37:04.225286+0000","last_clean":"2024-09-22T08:37:04.225286+0000","last_became_active":"2024-09-22T08:36:27.988507+0000","last_became_peered":"2024-09-22T08:36:27.988507+0000","last_unstale":"2024-09-22T08:37:04.225286+0000","last_undegraded":"2024-09-22T08:37:04.225286+0000","last_fullsized":"2024-09-22T08:37:04.225286+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_clean_scrub_stamp":"2024-09-22T08:36:26.962226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:48:06.094834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"32'13","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:31.660162+0000","last_change":"2024-09-22T08:36:29.996842+0000","last_active":"2024-09-22T08:39:31.660162+0000","last_peered":"2024-09-22T08:39:31.660162+0000","last_clean":"2024-09-22T08:39:31.660162+0000","last_became_active":"2024-09-22T08:36:29.996557+0000","last_became_peered":"2024-09-22T08:36:29.996557+0000","last_unstale":"2024-09-22T08:39:31.660162+0000","last_undegraded":"2024-09-22T08:39:31.660162+0000","last_fullsized":"2024-09-22T08:39:31.660162+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:05:26.776730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.229775+0000","last_change":"2024-09-22T08:36:32.014226+0000","last_active":"2024-09-22T08:37:04.229775+0000","last_peered":"2024-09-22T08:37:04.229775+0000","last_clean":"2024-09-22T08:37:04.229775+0000","last_became_active":"2024-09-22T08:36:32.013320+0000","last_became_peered":"2024-09-22T08:36:32.013320+0000","last_unstale":"2024-09-22T08:37:04.229775+0000","last_undegraded":"2024-09-22T08:37:04.229775+0000","last_fullsized":"2024-09-22T08:37:04.229775+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:03:21.762780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"32'4","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:31.413581+0000","last_change":"2024-09-22T08:36:34.015737+0000","last_active":"2024-09-22T08:38:31.413581+0000","last_peered":"2024-09-22T08:38:31.413581+0000","last_clean":"2024-09-22T08:38:31.413581+0000","last_became_active":"2024-09-22T08:36:34.015483+0000","last_became_peered":"2024-09-22T08:36:34.015483+0000","last_unstale":"2024-09-22T08:38:31.413581+0000","last_undegraded":"2024-09-22T08:38:31.413581+0000","last_fullsized":"2024-09-22T08:38:31.413581+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:08:04.974029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"32'8","reported_seq":70,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:58.302415+0000","last_change":"2024-09-22T08:39:58.302415+0000","last_active":"2024-09-22T08:39:58.302415+0000","last_peered":"2024-09-22T08:39:58.302415+0000","last_clean":"2024-09-22T08:39:58.302415+0000","last_became_active":"2024-09-22T08:36:25.986551+0000","last_became_peered":"2024-09-22T08:36:25.986551+0000","last_unstale":"2024-09-22T08:39:58.302415+0000","last_undegraded":"2024-09-22T08:39:58.302415+0000","last_fullsized":"2024-09-22T08:39:58.302415+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-22T08:39:58.302310+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-22T08:39:58.302310+0000","last_clean_scrub_stamp":"2024-09-22T08:39:58.302310+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:59:40.615258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:44.562216+0000","last_change":"2024-09-22T08:39:44.562216+0000","last_active":"2024-09-22T08:39:44.562216+0000","last_peered":"2024-09-22T08:39:44.562216+0000","last_clean":"2024-09-22T08:39:44.562216+0000","last_became_active":"2024-09-22T08:36:23.968525+0000","last_became_peered":"2024-09-22T08:36:23.968525+0000","last_unstale":"2024-09-22T08:39:44.562216+0000","last_undegraded":"2024-09-22T08:39:44.562216+0000","last_fullsized":"2024-09-22T08:39:44.562216+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:39:44.562132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:39:44.562132+0000","last_clean_scrub_stamp":"2024-09-22T08:39:44.562132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:35:46.943109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:47.806728+0000","last_change":"2024-09-22T08:39:47.806728+0000","last_active":"2024-09-22T08:39:47.806728+0000","last_peered":"2024-09-22T08:39:47.806728+0000","last_clean":"2024-09-22T08:39:47.806728+0000","last_became_active":"2024-09-22T08:36:16.424946+0000","last_became_peered":"2024-09-22T08:36:16.424946+0000","last_unstale":"2024-09-22T08:39:47.806728+0000","last_undegraded":"2024-09-22T08:39:47.806728+0000","last_fullsized":"2024-09-22T08:39:47.806728+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:39:47.806631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:39:47.806631+0000","last_clean_scrub_stamp":"2024-09-22T08:39:47.806631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:54:30.955543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045979400000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"32'1","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.404660+0000","last_change":"2024-09-22T08:36:27.988495+0000","last_active":"2024-09-22T08:39:32.404660+0000","last_peered":"2024-09-22T08:39:32.404660+0000","last_clean":"2024-09-22T08:39:32.404660+0000","last_became_active":"2024-09-22T08:36:27.987997+0000","last_became_peered":"2024-09-22T08:36:27.987997+0000","last_unstale":"2024-09-22T08:39:32.404660+0000","last_undegraded":"2024-09-22T08:39:32.404660+0000","last_fullsized":"2024-09-22T08:39:32.404660+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_clean_scrub_stamp":"2024-09-22T08:36:26.962226+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:35:11.843511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"32'69","reported_seq":137,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:38.933063+0000","last_change":"2024-09-22T08:36:29.994493+0000","last_active":"2024-09-22T08:39:38.933063+0000","last_peered":"2024-09-22T08:39:38.933063+0000","last_clean":"2024-09-22T08:39:38.933063+0000","last_became_active":"2024-09-22T08:36:29.994186+0000","last_became_peered":"2024-09-22T08:36:29.994186+0000","last_unstale":"2024-09-22T08:39:38.933063+0000","last_undegraded":"2024-09-22T08:39:38.933063+0000","last_fullsized":"2024-09-22T08:39:38.933063+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:18:59.702792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.228168+0000","last_change":"2024-09-22T08:36:32.003689+0000","last_active":"2024-09-22T08:37:04.228168+0000","last_peered":"2024-09-22T08:37:04.228168+0000","last_clean":"2024-09-22T08:37:04.228168+0000","last_became_active":"2024-09-22T08:36:32.003409+0000","last_became_peered":"2024-09-22T08:36:32.003409+0000","last_unstale":"2024-09-22T08:37:04.228168+0000","last_undegraded":"2024-09-22T08:37:04.228168+0000","last_fullsized":"2024-09-22T08:37:04.228168+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:27:05.933480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"32'13","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:31.589959+0000","last_change":"2024-09-22T08:36:34.013068+0000","last_active":"2024-09-22T08:38:31.589959+0000","last_peered":"2024-09-22T08:38:31.589959+0000","last_clean":"2024-09-22T08:38:31.589959+0000","last_became_active":"2024-09-22T08:36:34.012782+0000","last_became_peered":"2024-09-22T08:36:34.012782+0000","last_unstale":"2024-09-22T08:38:31.589959+0000","last_undegraded":"2024-09-22T08:38:31.589959+0000","last_fullsized":"2024-09-22T08:38:31.589959+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:16:13.410088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":25,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"32'6","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:59.335942+0000","last_change":"2024-09-22T08:39:59.335942+0000","last_active":"2024-09-22T08:39:59.335942+0000","last_peered":"2024-09-22T08:39:59.335942+0000","last_clean":"2024-09-22T08:39:59.335942+0000","last_became_active":"2024-09-22T08:36:25.984820+0000","last_became_peered":"2024-09-22T08:36:25.984820+0000","last_unstale":"2024-09-22T08:39:59.335942+0000","last_undegraded":"2024-09-22T08:39:59.335942+0000","last_fullsized":"2024-09-22T08:39:59.335942+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-22T08:39:59.335838+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-22T08:39:59.335838+0000","last_clean_scrub_stamp":"2024-09-22T08:39:59.335838+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:19:14.131941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":29,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"32'2","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:45.773739+0000","last_change":"2024-09-22T08:39:45.773739+0000","last_active":"2024-09-22T08:39:45.773739+0000","last_peered":"2024-09-22T08:39:45.773739+0000","last_clean":"2024-09-22T08:39:45.773739+0000","last_became_active":"2024-09-22T08:36:23.973672+0000","last_became_peered":"2024-09-22T08:36:23.973672+0000","last_unstale":"2024-09-22T08:39:45.773739+0000","last_undegraded":"2024-09-22T08:39:45.773739+0000","last_fullsized":"2024-09-22T08:39:45.773739+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-22T08:39:45.773661+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-22T08:39:45.773661+0000","last_clean_scrub_stamp":"2024-09-22T08:39:45.773661+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:51:32.967955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:49.427484+0000","last_change":"2024-09-22T08:39:49.427484+0000","last_active":"2024-09-22T08:39:49.427484+0000","last_peered":"2024-09-22T08:39:49.427484+0000","last_clean":"2024-09-22T08:39:49.427484+0000","last_became_active":"2024-09-22T08:36:16.427154+0000","last_became_peered":"2024-09-22T08:36:16.427154+0000","last_unstale":"2024-09-22T08:39:49.427484+0000","last_undegraded":"2024-09-22T08:39:49.427484+0000","last_fullsized":"2024-09-22T08:39:49.427484+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:39:49.427383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:39:49.427383+0000","last_clean_scrub_stamp":"2024-09-22T08:39:49.427383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:57:58.108684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081028899999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.236919+0000","last_change":"2024-09-22T08:37:04.234588+0000","last_active":"2024-09-22T08:37:04.236919+0000","last_peered":"2024-09-22T08:37:04.236919+0000","last_clean":"2024-09-22T08:37:04.236919+0000","last_became_active":"2024-09-22T08:37:04.233981+0000","last_became_peered":"2024-09-22T08:37:04.233981+0000","last_unstale":"2024-09-22T08:37:04.236919+0000","last_undegraded":"2024-09-22T08:37:04.236919+0000","last_fullsized":"2024-09-22T08:37:04.236919+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_clean_scrub_stamp":"2024-09-22T08:36:26.962226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:01:06.235869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"32'15","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:28.585360+0000","last_change":"2024-09-22T08:36:29.995560+0000","last_active":"2024-09-22T08:38:28.585360+0000","last_peered":"2024-09-22T08:38:28.585360+0000","last_clean":"2024-09-22T08:38:28.585360+0000","last_became_active":"2024-09-22T08:36:29.995173+0000","last_became_peered":"2024-09-22T08:36:29.995173+0000","last_unstale":"2024-09-22T08:38:28.585360+0000","last_undegraded":"2024-09-22T08:38:28.585360+0000","last_fullsized":"2024-09-22T08:38:28.585360+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:37:47.696313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"32'285","reported_seq":349,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:38.823080+0000","last_change":"2024-09-22T08:36:32.003255+0000","last_active":"2024-09-22T08:39:38.823080+0000","last_peered":"2024-09-22T08:39:38.823080+0000","last_clean":"2024-09-22T08:39:38.823080+0000","last_became_active":"2024-09-22T08:36:32.002985+0000","last_became_peered":"2024-09-22T08:36:32.002985+0000","last_unstale":"2024-09-22T08:39:38.823080+0000","last_undegraded":"2024-09-22T08:39:38.823080+0000","last_fullsized":"2024-09-22T08:39:38.823080+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:27:39.543678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.227398+0000","last_change":"2024-09-22T08:36:34.019732+0000","last_active":"2024-09-22T08:37:04.227398+0000","last_peered":"2024-09-22T08:37:04.227398+0000","last_clean":"2024-09-22T08:37:04.227398+0000","last_became_active":"2024-09-22T08:36:34.019438+0000","last_became_peered":"2024-09-22T08:36:34.019438+0000","last_unstale":"2024-09-22T08:37:04.227398+0000","last_undegraded":"2024-09-22T08:37:04.227398+0000","last_fullsized":"2024-09-22T08:37:04.227398+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:29:22.767417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"32'3","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.267975+0000","last_change":"2024-09-22T08:36:25.992413+0000","last_active":"2024-09-22T08:39:32.267975+0000","last_peered":"2024-09-22T08:39:32.267975+0000","last_clean":"2024-09-22T08:39:32.267975+0000","last_became_active":"2024-09-22T08:36:25.991480+0000","last_became_peered":"2024-09-22T08:36:25.991480+0000","last_unstale":"2024-09-22T08:39:32.267975+0000","last_undegraded":"2024-09-22T08:39:32.267975+0000","last_fullsized":"2024-09-22T08:39:32.267975+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:10:58.578162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:46.106194+0000","last_change":"2024-09-22T08:39:46.106194+0000","last_active":"2024-09-22T08:39:46.106194+0000","last_peered":"2024-09-22T08:39:46.106194+0000","last_clean":"2024-09-22T08:39:46.106194+0000","last_became_active":"2024-09-22T08:37:04.227561+0000","last_became_peered":"2024-09-22T08:37:04.227561+0000","last_unstale":"2024-09-22T08:39:46.106194+0000","last_undegraded":"2024-09-22T08:39:46.106194+0000","last_fullsized":"2024-09-22T08:39:46.106194+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:39:46.106091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:39:46.106091+0000","last_clean_scrub_stamp":"2024-09-22T08:39:46.106091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:00:33.266036+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:42.871788+0000","last_change":"2024-09-22T08:39:42.871788+0000","last_active":"2024-09-22T08:39:42.871788+0000","last_peered":"2024-09-22T08:39:42.871788+0000","last_clean":"2024-09-22T08:39:42.871788+0000","last_became_active":"2024-09-22T08:36:16.425549+0000","last_became_peered":"2024-09-22T08:36:16.425549+0000","last_unstale":"2024-09-22T08:39:42.871788+0000","last_undegraded":"2024-09-22T08:39:42.871788+0000","last_fullsized":"2024-09-22T08:39:42.871788+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:39:42.871712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:39:42.871712+0000","last_clean_scrub_stamp":"2024-09-22T08:39:42.871712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:11:04.345633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045809600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.229558+0000","last_change":"2024-09-22T08:36:27.987430+0000","last_active":"2024-09-22T08:37:04.229558+0000","last_peered":"2024-09-22T08:37:04.229558+0000","last_clean":"2024-09-22T08:37:04.229558+0000","last_became_active":"2024-09-22T08:36:27.987074+0000","last_became_peered":"2024-09-22T08:36:27.987074+0000","last_unstale":"2024-09-22T08:37:04.229558+0000","last_undegraded":"2024-09-22T08:37:04.229558+0000","last_fullsized":"2024-09-22T08:37:04.229558+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_clean_scrub_stamp":"2024-09-22T08:36:26.962226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:08:31.905654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"30'10","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.228539+0000","last_change":"2024-09-22T08:36:30.000809+0000","last_active":"2024-09-22T08:37:04.228539+0000","last_peered":"2024-09-22T08:37:04.228539+0000","last_clean":"2024-09-22T08:37:04.228539+0000","last_became_active":"2024-09-22T08:36:29.999965+0000","last_became_peered":"2024-09-22T08:36:29.999965+0000","last_unstale":"2024-09-22T08:37:04.228539+0000","last_undegraded":"2024-09-22T08:37:04.228539+0000","last_fullsized":"2024-09-22T08:37:04.228539+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:05:54.815446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"32'285","reported_seq":392,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:38.828153+0000","last_change":"2024-09-22T08:36:32.005583+0000","last_active":"2024-09-22T08:39:38.828153+0000","last_peered":"2024-09-22T08:39:38.828153+0000","last_clean":"2024-09-22T08:39:38.828153+0000","last_became_active":"2024-09-22T08:36:32.005155+0000","last_became_peered":"2024-09-22T08:36:32.005155+0000","last_unstale":"2024-09-22T08:39:38.828153+0000","last_undegraded":"2024-09-22T08:39:38.828153+0000","last_fullsized":"2024-09-22T08:39:38.828153+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:01:17.946935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"30'5","reported_seq":25,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.223266+0000","last_change":"2024-09-22T08:36:34.022617+0000","last_active":"2024-09-22T08:37:04.223266+0000","last_peered":"2024-09-22T08:37:04.223266+0000","last_clean":"2024-09-22T08:37:04.223266+0000","last_became_active":"2024-09-22T08:36:34.022313+0000","last_became_peered":"2024-09-22T08:36:34.022313+0000","last_unstale":"2024-09-22T08:37:04.223266+0000","last_undegraded":"2024-09-22T08:37:04.223266+0000","last_fullsized":"2024-09-22T08:37:04.223266+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:42:55.182851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":11,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"32'4","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:06.180363+0000","last_change":"2024-09-22T08:36:25.975148+0000","last_active":"2024-09-22T08:37:06.180363+0000","last_peered":"2024-09-22T08:37:06.180363+0000","last_clean":"2024-09-22T08:37:06.180363+0000","last_became_active":"2024-09-22T08:36:25.974884+0000","last_became_peered":"2024-09-22T08:36:25.974884+0000","last_unstale":"2024-09-22T08:37:06.180363+0000","last_undegraded":"2024-09-22T08:37:06.180363+0000","last_fullsized":"2024-09-22T08:37:06.180363+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:22:54.131230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"32'5","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:44.099885+0000","last_change":"2024-09-22T08:39:44.099885+0000","last_active":"2024-09-22T08:39:44.099885+0000","last_peered":"2024-09-22T08:39:44.099885+0000","last_clean":"2024-09-22T08:39:44.099885+0000","last_became_active":"2024-09-22T08:36:23.976646+0000","last_became_peered":"2024-09-22T08:36:23.976646+0000","last_unstale":"2024-09-22T08:39:44.099885+0000","last_undegraded":"2024-09-22T08:39:44.099885+0000","last_fullsized":"2024-09-22T08:39:44.099885+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'5","last_scrub_stamp":"2024-09-22T08:39:44.099774+0000","last_deep_scrub":"32'5","last_deep_scrub_stamp":"2024-09-22T08:39:44.099774+0000","last_clean_scrub_stamp":"2024-09-22T08:39:44.099774+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:33:07.255708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":11,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:47.415905+0000","last_change":"2024-09-22T08:39:47.415905+0000","last_active":"2024-09-22T08:39:47.415905+0000","last_peered":"2024-09-22T08:39:47.415905+0000","last_clean":"2024-09-22T08:39:47.415905+0000","last_became_active":"2024-09-22T08:36:16.638610+0000","last_became_peered":"2024-09-22T08:36:16.638610+0000","last_unstale":"2024-09-22T08:39:47.415905+0000","last_undegraded":"2024-09-22T08:39:47.415905+0000","last_fullsized":"2024-09-22T08:39:47.415905+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:39:47.415799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:39:47.415799+0000","last_clean_scrub_stamp":"2024-09-22T08:39:47.415799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:04:14.345231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001119264,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.226781+0000","last_change":"2024-09-22T08:36:27.985127+0000","last_active":"2024-09-22T08:37:04.226781+0000","last_peered":"2024-09-22T08:37:04.226781+0000","last_clean":"2024-09-22T08:37:04.226781+0000","last_became_active":"2024-09-22T08:36:27.984803+0000","last_became_peered":"2024-09-22T08:36:27.984803+0000","last_unstale":"2024-09-22T08:37:04.226781+0000","last_undegraded":"2024-09-22T08:37:04.226781+0000","last_fullsized":"2024-09-22T08:37:04.226781+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_clean_scrub_stamp":"2024-09-22T08:36:26.962226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:51:28.889992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"32'93","reported_seq":178,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:38.942702+0000","last_change":"2024-09-22T08:36:30.000659+0000","last_active":"2024-09-22T08:39:38.942702+0000","last_peered":"2024-09-22T08:39:38.942702+0000","last_clean":"2024-09-22T08:39:38.942702+0000","last_became_active":"2024-09-22T08:36:30.000270+0000","last_became_peered":"2024-09-22T08:36:30.000270+0000","last_unstale":"2024-09-22T08:39:38.942702+0000","last_undegraded":"2024-09-22T08:39:38.942702+0000","last_fullsized":"2024-09-22T08:39:38.942702+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:27:22.890604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4316,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":99,"num_read_kb":103,"num_write":38,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.223565+0000","last_change":"2024-09-22T08:36:32.003206+0000","last_active":"2024-09-22T08:37:04.223565+0000","last_peered":"2024-09-22T08:37:04.223565+0000","last_clean":"2024-09-22T08:37:04.223565+0000","last_became_active":"2024-09-22T08:36:32.002876+0000","last_became_peered":"2024-09-22T08:36:32.002876+0000","last_unstale":"2024-09-22T08:37:04.223565+0000","last_undegraded":"2024-09-22T08:37:04.223565+0000","last_fullsized":"2024-09-22T08:37:04.223565+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:07:07.136733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"30'2","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.228242+0000","last_change":"2024-09-22T08:36:34.016952+0000","last_active":"2024-09-22T08:37:04.228242+0000","last_peered":"2024-09-22T08:37:04.228242+0000","last_clean":"2024-09-22T08:37:04.228242+0000","last_became_active":"2024-09-22T08:36:34.016659+0000","last_became_peered":"2024-09-22T08:36:34.016659+0000","last_unstale":"2024-09-22T08:37:04.228242+0000","last_undegraded":"2024-09-22T08:37:04.228242+0000","last_fullsized":"2024-09-22T08:37:04.228242+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:01:42.781684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.229370+0000","last_change":"2024-09-22T08:36:34.015661+0000","last_active":"2024-09-22T08:37:04.229370+0000","last_peered":"2024-09-22T08:37:04.229370+0000","last_clean":"2024-09-22T08:37:04.229370+0000","last_became_active":"2024-09-22T08:36:34.015241+0000","last_became_peered":"2024-09-22T08:36:34.015241+0000","last_unstale":"2024-09-22T08:37:04.229370+0000","last_undegraded":"2024-09-22T08:37:04.229370+0000","last_fullsized":"2024-09-22T08:37:04.229370+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:13:28.913225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"32'4","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:59.521660+0000","last_change":"2024-09-22T08:39:59.521660+0000","last_active":"2024-09-22T08:39:59.521660+0000","last_peered":"2024-09-22T08:39:59.521660+0000","last_clean":"2024-09-22T08:39:59.521660+0000","last_became_active":"2024-09-22T08:36:25.987153+0000","last_became_peered":"2024-09-22T08:36:25.987153+0000","last_unstale":"2024-09-22T08:39:59.521660+0000","last_undegraded":"2024-09-22T08:39:59.521660+0000","last_fullsized":"2024-09-22T08:39:59.521660+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-22T08:39:59.521563+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-22T08:39:59.521563+0000","last_clean_scrub_stamp":"2024-09-22T08:39:59.521563+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:30:31.166918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:56.287922+0000","last_change":"2024-09-22T08:39:56.287922+0000","last_active":"2024-09-22T08:39:56.287922+0000","last_peered":"2024-09-22T08:39:56.287922+0000","last_clean":"2024-09-22T08:39:56.287922+0000","last_became_active":"2024-09-22T08:36:23.981927+0000","last_became_peered":"2024-09-22T08:36:23.981927+0000","last_unstale":"2024-09-22T08:39:56.287922+0000","last_undegraded":"2024-09-22T08:39:56.287922+0000","last_fullsized":"2024-09-22T08:39:56.287922+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:39:56.287818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:39:56.287818+0000","last_clean_scrub_stamp":"2024-09-22T08:39:56.287818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:00:09.674228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.222089+0000","last_change":"2024-09-22T08:36:27.990795+0000","last_active":"2024-09-22T08:37:04.222089+0000","last_peered":"2024-09-22T08:37:04.222089+0000","last_clean":"2024-09-22T08:37:04.222089+0000","last_became_active":"2024-09-22T08:36:27.990153+0000","last_became_peered":"2024-09-22T08:36:27.990153+0000","last_unstale":"2024-09-22T08:37:04.222089+0000","last_undegraded":"2024-09-22T08:37:04.222089+0000","last_fullsized":"2024-09-22T08:37:04.222089+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_clean_scrub_stamp":"2024-09-22T08:36:26.962226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:44:21.494770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"32'37","reported_seq":85,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:38.965959+0000","last_change":"2024-09-22T08:36:29.998789+0000","last_active":"2024-09-22T08:39:38.965959+0000","last_peered":"2024-09-22T08:39:38.965959+0000","last_clean":"2024-09-22T08:39:38.965959+0000","last_became_active":"2024-09-22T08:36:29.997814+0000","last_became_peered":"2024-09-22T08:36:29.997814+0000","last_unstale":"2024-09-22T08:39:38.965959+0000","last_undegraded":"2024-09-22T08:39:38.965959+0000","last_fullsized":"2024-09-22T08:39:38.965959+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:38:57.806502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":43,"num_read_kb":44,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.226536+0000","last_change":"2024-09-22T08:36:32.012924+0000","last_active":"2024-09-22T08:37:04.226536+0000","last_peered":"2024-09-22T08:37:04.226536+0000","last_clean":"2024-09-22T08:37:04.226536+0000","last_became_active":"2024-09-22T08:36:32.012453+0000","last_became_peered":"2024-09-22T08:36:32.012453+0000","last_unstale":"2024-09-22T08:37:04.226536+0000","last_undegraded":"2024-09-22T08:37:04.226536+0000","last_fullsized":"2024-09-22T08:37:04.226536+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:07:18.464448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"32'3","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:29.962024+0000","last_change":"2024-09-22T08:36:34.022519+0000","last_active":"2024-09-22T08:38:29.962024+0000","last_peered":"2024-09-22T08:38:29.962024+0000","last_clean":"2024-09-22T08:38:29.962024+0000","last_became_active":"2024-09-22T08:36:34.022267+0000","last_became_peered":"2024-09-22T08:36:34.022267+0000","last_unstale":"2024-09-22T08:38:29.962024+0000","last_undegraded":"2024-09-22T08:38:29.962024+0000","last_fullsized":"2024-09-22T08:38:29.962024+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:48:06.628364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"32'6","reported_seq":82,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:05.120194+0000","last_change":"2024-09-22T08:36:25.986871+0000","last_active":"2024-09-22T08:37:05.120194+0000","last_peered":"2024-09-22T08:37:05.120194+0000","last_clean":"2024-09-22T08:37:05.120194+0000","last_became_active":"2024-09-22T08:36:25.986613+0000","last_became_peered":"2024-09-22T08:36:25.986613+0000","last_unstale":"2024-09-22T08:37:05.120194+0000","last_undegraded":"2024-09-22T08:37:05.120194+0000","last_fullsized":"2024-09-22T08:37:05.120194+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:34:39.892614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":60,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:49.648410+0000","last_change":"2024-09-22T08:39:49.648410+0000","last_active":"2024-09-22T08:39:49.648410+0000","last_peered":"2024-09-22T08:39:49.648410+0000","last_clean":"2024-09-22T08:39:49.648410+0000","last_became_active":"2024-09-22T08:36:23.978282+0000","last_became_peered":"2024-09-22T08:36:23.978282+0000","last_unstale":"2024-09-22T08:39:49.648410+0000","last_undegraded":"2024-09-22T08:39:49.648410+0000","last_fullsized":"2024-09-22T08:39:49.648410+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:39:49.648317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:39:49.648317+0000","last_clean_scrub_stamp":"2024-09-22T08:39:49.648317+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:38:27.168524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.230277+0000","last_change":"2024-09-22T08:36:27.986336+0000","last_active":"2024-09-22T08:37:04.230277+0000","last_peered":"2024-09-22T08:37:04.230277+0000","last_clean":"2024-09-22T08:37:04.230277+0000","last_became_active":"2024-09-22T08:36:27.986033+0000","last_became_peered":"2024-09-22T08:36:27.986033+0000","last_unstale":"2024-09-22T08:37:04.230277+0000","last_undegraded":"2024-09-22T08:37:04.230277+0000","last_fullsized":"2024-09-22T08:37:04.230277+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_clean_scrub_stamp":"2024-09-22T08:36:26.962226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:54:43.939868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"32'6","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:31.680000+0000","last_change":"2024-09-22T08:36:29.990307+0000","last_active":"2024-09-22T08:39:31.680000+0000","last_peered":"2024-09-22T08:39:31.680000+0000","last_clean":"2024-09-22T08:39:31.680000+0000","last_became_active":"2024-09-22T08:36:29.990057+0000","last_became_peered":"2024-09-22T08:36:29.990057+0000","last_unstale":"2024-09-22T08:39:31.680000+0000","last_undegraded":"2024-09-22T08:39:31.680000+0000","last_fullsized":"2024-09-22T08:39:31.680000+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:20:39.541039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.228183+0000","last_change":"2024-09-22T08:36:32.010964+0000","last_active":"2024-09-22T08:37:04.228183+0000","last_peered":"2024-09-22T08:37:04.228183+0000","last_clean":"2024-09-22T08:37:04.228183+0000","last_became_active":"2024-09-22T08:36:32.010692+0000","last_became_peered":"2024-09-22T08:36:32.010692+0000","last_unstale":"2024-09-22T08:37:04.228183+0000","last_undegraded":"2024-09-22T08:37:04.228183+0000","last_fullsized":"2024-09-22T08:37:04.228183+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:42:56.003470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"32'8","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:31.738292+0000","last_change":"2024-09-22T08:36:34.017610+0000","last_active":"2024-09-22T08:39:31.738292+0000","last_peered":"2024-09-22T08:39:31.738292+0000","last_clean":"2024-09-22T08:39:31.738292+0000","last_became_active":"2024-09-22T08:36:34.017181+0000","last_became_peered":"2024-09-22T08:36:34.017181+0000","last_unstale":"2024-09-22T08:39:31.738292+0000","last_undegraded":"2024-09-22T08:39:31.738292+0000","last_fullsized":"2024-09-22T08:39:31.738292+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:00:36.254978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":21,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"32'6","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:00.828058+0000","last_change":"2024-09-22T08:40:00.828058+0000","last_active":"2024-09-22T08:40:00.828058+0000","last_peered":"2024-09-22T08:40:00.828058+0000","last_clean":"2024-09-22T08:40:00.828058+0000","last_became_active":"2024-09-22T08:36:25.974797+0000","last_became_peered":"2024-09-22T08:36:25.974797+0000","last_unstale":"2024-09-22T08:40:00.828058+0000","last_undegraded":"2024-09-22T08:40:00.828058+0000","last_fullsized":"2024-09-22T08:40:00.828058+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-22T08:40:00.827940+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-22T08:40:00.827940+0000","last_clean_scrub_stamp":"2024-09-22T08:40:00.827940+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:40:56.353569+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"32'2","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:48.649611+0000","last_change":"2024-09-22T08:39:48.649611+0000","last_active":"2024-09-22T08:39:48.649611+0000","last_peered":"2024-09-22T08:39:48.649611+0000","last_clean":"2024-09-22T08:39:48.649611+0000","last_became_active":"2024-09-22T08:36:23.973601+0000","last_became_peered":"2024-09-22T08:36:23.973601+0000","last_unstale":"2024-09-22T08:39:48.649611+0000","last_undegraded":"2024-09-22T08:39:48.649611+0000","last_fullsized":"2024-09-22T08:39:48.649611+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-22T08:39:48.649523+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-22T08:39:48.649523+0000","last_clean_scrub_stamp":"2024-09-22T08:39:48.649523+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:10:59.136925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.222812+0000","last_change":"2024-09-22T08:36:27.986446+0000","last_active":"2024-09-22T08:37:04.222812+0000","last_peered":"2024-09-22T08:37:04.222812+0000","last_clean":"2024-09-22T08:37:04.222812+0000","last_became_active":"2024-09-22T08:36:27.986100+0000","last_became_peered":"2024-09-22T08:36:27.986100+0000","last_unstale":"2024-09-22T08:37:04.222812+0000","last_undegraded":"2024-09-22T08:37:04.222812+0000","last_fullsized":"2024-09-22T08:37:04.222812+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_clean_scrub_stamp":"2024-09-22T08:36:26.962226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:23:06.708649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"32'43","reported_seq":107,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:38.926827+0000","last_change":"2024-09-22T08:36:29.992078+0000","last_active":"2024-09-22T08:39:38.926827+0000","last_peered":"2024-09-22T08:39:38.926827+0000","last_clean":"2024-09-22T08:39:38.926827+0000","last_became_active":"2024-09-22T08:36:29.991732+0000","last_became_peered":"2024-09-22T08:36:29.991732+0000","last_unstale":"2024-09-22T08:39:38.926827+0000","last_undegraded":"2024-09-22T08:39:38.926827+0000","last_fullsized":"2024-09-22T08:39:38.926827+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:54:46.326822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.221450+0000","last_change":"2024-09-22T08:36:32.003244+0000","last_active":"2024-09-22T08:37:04.221450+0000","last_peered":"2024-09-22T08:37:04.221450+0000","last_clean":"2024-09-22T08:37:04.221450+0000","last_became_active":"2024-09-22T08:36:32.002970+0000","last_became_peered":"2024-09-22T08:36:32.002970+0000","last_unstale":"2024-09-22T08:37:04.221450+0000","last_undegraded":"2024-09-22T08:37:04.221450+0000","last_fullsized":"2024-09-22T08:37:04.221450+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:19:57.326474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"32'4","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.344891+0000","last_change":"2024-09-22T08:36:34.016939+0000","last_active":"2024-09-22T08:39:32.344891+0000","last_peered":"2024-09-22T08:39:32.344891+0000","last_clean":"2024-09-22T08:39:32.344891+0000","last_became_active":"2024-09-22T08:36:34.016379+0000","last_became_peered":"2024-09-22T08:36:34.016379+0000","last_unstale":"2024-09-22T08:39:32.344891+0000","last_undegraded":"2024-09-22T08:39:32.344891+0000","last_fullsized":"2024-09-22T08:39:32.344891+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:50:54.870215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":421,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"32'6","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:28.582884+0000","last_change":"2024-09-22T08:36:25.988849+0000","last_active":"2024-09-22T08:38:28.582884+0000","last_peered":"2024-09-22T08:38:28.582884+0000","last_clean":"2024-09-22T08:38:28.582884+0000","last_became_active":"2024-09-22T08:36:25.988569+0000","last_became_peered":"2024-09-22T08:36:25.988569+0000","last_unstale":"2024-09-22T08:38:28.582884+0000","last_undegraded":"2024-09-22T08:38:28.582884+0000","last_fullsized":"2024-09-22T08:38:28.582884+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:18:26.519986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:47.114544+0000","last_change":"2024-09-22T08:39:47.114544+0000","last_active":"2024-09-22T08:39:47.114544+0000","last_peered":"2024-09-22T08:39:47.114544+0000","last_clean":"2024-09-22T08:39:47.114544+0000","last_became_active":"2024-09-22T08:36:23.977355+0000","last_became_peered":"2024-09-22T08:36:23.977355+0000","last_unstale":"2024-09-22T08:39:47.114544+0000","last_undegraded":"2024-09-22T08:39:47.114544+0000","last_fullsized":"2024-09-22T08:39:47.114544+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:39:47.114458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:39:47.114458+0000","last_clean_scrub_stamp":"2024-09-22T08:39:47.114458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:39:28.221096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"32'4","reported_seq":229,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:38.795223+0000","last_change":"2024-09-22T08:36:27.987952+0000","last_active":"2024-09-22T08:39:38.795223+0000","last_peered":"2024-09-22T08:39:38.795223+0000","last_clean":"2024-09-22T08:39:38.795223+0000","last_became_active":"2024-09-22T08:36:27.987561+0000","last_became_peered":"2024-09-22T08:36:27.987561+0000","last_unstale":"2024-09-22T08:39:38.795223+0000","last_undegraded":"2024-09-22T08:39:38.795223+0000","last_fullsized":"2024-09-22T08:39:38.795223+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_clean_scrub_stamp":"2024-09-22T08:36:26.962226+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:59:38.794944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"32'34","reported_seq":81,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:38.917623+0000","last_change":"2024-09-22T08:36:29.989156+0000","last_active":"2024-09-22T08:39:38.917623+0000","last_peered":"2024-09-22T08:39:38.917623+0000","last_clean":"2024-09-22T08:39:38.917623+0000","last_became_active":"2024-09-22T08:36:29.988607+0000","last_became_peered":"2024-09-22T08:36:29.988607+0000","last_unstale":"2024-09-22T08:39:38.917623+0000","last_undegraded":"2024-09-22T08:39:38.917623+0000","last_fullsized":"2024-09-22T08:39:38.917623+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:59:53.178494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.225600+0000","last_change":"2024-09-22T08:36:32.003908+0000","last_active":"2024-09-22T08:37:04.225600+0000","last_peered":"2024-09-22T08:37:04.225600+0000","last_clean":"2024-09-22T08:37:04.225600+0000","last_became_active":"2024-09-22T08:36:32.003651+0000","last_became_peered":"2024-09-22T08:36:32.003651+0000","last_unstale":"2024-09-22T08:37:04.225600+0000","last_undegraded":"2024-09-22T08:37:04.225600+0000","last_fullsized":"2024-09-22T08:37:04.225600+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:39:25.611419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"32'10","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.259871+0000","last_change":"2024-09-22T08:36:25.990717+0000","last_active":"2024-09-22T08:39:32.259871+0000","last_peered":"2024-09-22T08:39:32.259871+0000","last_clean":"2024-09-22T08:39:32.259871+0000","last_became_active":"2024-09-22T08:36:25.989711+0000","last_became_peered":"2024-09-22T08:36:25.989711+0000","last_unstale":"2024-09-22T08:39:32.259871+0000","last_undegraded":"2024-09-22T08:39:32.259871+0000","last_fullsized":"2024-09-22T08:39:32.259871+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:59:02.745529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:57.304514+0000","last_change":"2024-09-22T08:39:57.304514+0000","last_active":"2024-09-22T08:39:57.304514+0000","last_peered":"2024-09-22T08:39:57.304514+0000","last_clean":"2024-09-22T08:39:57.304514+0000","last_became_active":"2024-09-22T08:36:23.976361+0000","last_became_peered":"2024-09-22T08:36:23.976361+0000","last_unstale":"2024-09-22T08:39:57.304514+0000","last_undegraded":"2024-09-22T08:39:57.304514+0000","last_fullsized":"2024-09-22T08:39:57.304514+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:39:57.304420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:39:57.304420+0000","last_clean_scrub_stamp":"2024-09-22T08:39:57.304420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:50:11.471353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.226375+0000","last_change":"2024-09-22T08:36:27.988289+0000","last_active":"2024-09-22T08:37:04.226375+0000","last_peered":"2024-09-22T08:37:04.226375+0000","last_clean":"2024-09-22T08:37:04.226375+0000","last_became_active":"2024-09-22T08:36:27.987981+0000","last_became_peered":"2024-09-22T08:36:27.987981+0000","last_unstale":"2024-09-22T08:37:04.226375+0000","last_undegraded":"2024-09-22T08:37:04.226375+0000","last_fullsized":"2024-09-22T08:37:04.226375+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_clean_scrub_stamp":"2024-09-22T08:36:26.962226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:43:32.535149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"32'61","reported_seq":126,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:38.914421+0000","last_change":"2024-09-22T08:36:29.990823+0000","last_active":"2024-09-22T08:39:38.914421+0000","last_peered":"2024-09-22T08:39:38.914421+0000","last_clean":"2024-09-22T08:39:38.914421+0000","last_became_active":"2024-09-22T08:36:29.990585+0000","last_became_peered":"2024-09-22T08:36:29.990585+0000","last_unstale":"2024-09-22T08:39:38.914421+0000","last_undegraded":"2024-09-22T08:39:38.914421+0000","last_fullsized":"2024-09-22T08:39:38.914421+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:09:56.176060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.226461+0000","last_change":"2024-09-22T08:36:32.007693+0000","last_active":"2024-09-22T08:37:04.226461+0000","last_peered":"2024-09-22T08:37:04.226461+0000","last_clean":"2024-09-22T08:37:04.226461+0000","last_became_active":"2024-09-22T08:36:32.007448+0000","last_became_peered":"2024-09-22T08:36:32.007448+0000","last_unstale":"2024-09-22T08:37:04.226461+0000","last_undegraded":"2024-09-22T08:37:04.226461+0000","last_fullsized":"2024-09-22T08:37:04.226461+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:30:19.529413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"32'16","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.263979+0000","last_change":"2024-09-22T08:36:34.017989+0000","last_active":"2024-09-22T08:39:32.263979+0000","last_peered":"2024-09-22T08:39:32.263979+0000","last_clean":"2024-09-22T08:39:32.263979+0000","last_became_active":"2024-09-22T08:36:34.017689+0000","last_became_peered":"2024-09-22T08:36:34.017689+0000","last_unstale":"2024-09-22T08:39:32.263979+0000","last_undegraded":"2024-09-22T08:39:32.263979+0000","last_fullsized":"2024-09-22T08:39:32.263979+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:59:28.875467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":21,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"32'2","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.260499+0000","last_change":"2024-09-22T08:36:25.978215+0000","last_active":"2024-09-22T08:39:32.260499+0000","last_peered":"2024-09-22T08:39:32.260499+0000","last_clean":"2024-09-22T08:39:32.260499+0000","last_became_active":"2024-09-22T08:36:25.977881+0000","last_became_peered":"2024-09-22T08:36:25.977881+0000","last_unstale":"2024-09-22T08:39:32.260499+0000","last_undegraded":"2024-09-22T08:39:32.260499+0000","last_fullsized":"2024-09-22T08:39:32.260499+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:49:05.012514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:48.136157+0000","last_change":"2024-09-22T08:39:48.136157+0000","last_active":"2024-09-22T08:39:48.136157+0000","last_peered":"2024-09-22T08:39:48.136157+0000","last_clean":"2024-09-22T08:39:48.136157+0000","last_became_active":"2024-09-22T08:36:23.974809+0000","last_became_peered":"2024-09-22T08:36:23.974809+0000","last_unstale":"2024-09-22T08:39:48.136157+0000","last_undegraded":"2024-09-22T08:39:48.136157+0000","last_fullsized":"2024-09-22T08:39:48.136157+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:39:48.136054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:39:48.136054+0000","last_clean_scrub_stamp":"2024-09-22T08:39:48.136054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:46:14.769669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.228600+0000","last_change":"2024-09-22T08:36:27.987444+0000","last_active":"2024-09-22T08:37:04.228600+0000","last_peered":"2024-09-22T08:37:04.228600+0000","last_clean":"2024-09-22T08:37:04.228600+0000","last_became_active":"2024-09-22T08:36:27.986957+0000","last_became_peered":"2024-09-22T08:36:27.986957+0000","last_unstale":"2024-09-22T08:37:04.228600+0000","last_undegraded":"2024-09-22T08:37:04.228600+0000","last_fullsized":"2024-09-22T08:37:04.228600+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_clean_scrub_stamp":"2024-09-22T08:36:26.962226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:12:16.352882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"32'39","reported_seq":89,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:38.920740+0000","last_change":"2024-09-22T08:36:29.998426+0000","last_active":"2024-09-22T08:39:38.920740+0000","last_peered":"2024-09-22T08:39:38.920740+0000","last_clean":"2024-09-22T08:39:38.920740+0000","last_became_active":"2024-09-22T08:36:29.997527+0000","last_became_peered":"2024-09-22T08:36:29.997527+0000","last_unstale":"2024-09-22T08:39:38.920740+0000","last_undegraded":"2024-09-22T08:39:38.920740+0000","last_fullsized":"2024-09-22T08:39:38.920740+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:26:30.343603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.224280+0000","last_change":"2024-09-22T08:36:32.005672+0000","last_active":"2024-09-22T08:37:04.224280+0000","last_peered":"2024-09-22T08:37:04.224280+0000","last_clean":"2024-09-22T08:37:04.224280+0000","last_became_active":"2024-09-22T08:36:32.005383+0000","last_became_peered":"2024-09-22T08:36:32.005383+0000","last_unstale":"2024-09-22T08:37:04.224280+0000","last_undegraded":"2024-09-22T08:37:04.224280+0000","last_fullsized":"2024-09-22T08:37:04.224280+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:13:26.905617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.227134+0000","last_change":"2024-09-22T08:36:34.013499+0000","last_active":"2024-09-22T08:37:04.227134+0000","last_peered":"2024-09-22T08:37:04.227134+0000","last_clean":"2024-09-22T08:37:04.227134+0000","last_became_active":"2024-09-22T08:36:34.013204+0000","last_became_peered":"2024-09-22T08:36:34.013204+0000","last_unstale":"2024-09-22T08:37:04.227134+0000","last_undegraded":"2024-09-22T08:37:04.227134+0000","last_fullsized":"2024-09-22T08:37:04.227134+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:37:55.724456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"32'14","reported_seq":66,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.268386+0000","last_change":"2024-09-22T08:36:25.993915+0000","last_active":"2024-09-22T08:39:32.268386+0000","last_peered":"2024-09-22T08:39:32.268386+0000","last_clean":"2024-09-22T08:39:32.268386+0000","last_became_active":"2024-09-22T08:36:25.993170+0000","last_became_peered":"2024-09-22T08:36:25.993170+0000","last_unstale":"2024-09-22T08:39:32.268386+0000","last_undegraded":"2024-09-22T08:39:32.268386+0000","last_fullsized":"2024-09-22T08:39:32.268386+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:39:33.156873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":38,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:49.125470+0000","last_change":"2024-09-22T08:39:49.125470+0000","last_active":"2024-09-22T08:39:49.125470+0000","last_peered":"2024-09-22T08:39:49.125470+0000","last_clean":"2024-09-22T08:39:49.125470+0000","last_became_active":"2024-09-22T08:36:23.968207+0000","last_became_peered":"2024-09-22T08:36:23.968207+0000","last_unstale":"2024-09-22T08:39:49.125470+0000","last_undegraded":"2024-09-22T08:39:49.125470+0000","last_fullsized":"2024-09-22T08:39:49.125470+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:39:49.125386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:39:49.125386+0000","last_clean_scrub_stamp":"2024-09-22T08:39:49.125386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:25:13.108318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.226357+0000","last_change":"2024-09-22T08:36:27.986023+0000","last_active":"2024-09-22T08:37:04.226357+0000","last_peered":"2024-09-22T08:37:04.226357+0000","last_clean":"2024-09-22T08:37:04.226357+0000","last_became_active":"2024-09-22T08:36:27.985679+0000","last_became_peered":"2024-09-22T08:36:27.985679+0000","last_unstale":"2024-09-22T08:37:04.226357+0000","last_undegraded":"2024-09-22T08:37:04.226357+0000","last_fullsized":"2024-09-22T08:37:04.226357+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_clean_scrub_stamp":"2024-09-22T08:36:26.962226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:14:11.716507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"32'35","reported_seq":83,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:38.874031+0000","last_change":"2024-09-22T08:36:29.994386+0000","last_active":"2024-09-22T08:39:38.874031+0000","last_peered":"2024-09-22T08:39:38.874031+0000","last_clean":"2024-09-22T08:39:38.874031+0000","last_became_active":"2024-09-22T08:36:29.994075+0000","last_became_peered":"2024-09-22T08:36:29.994075+0000","last_unstale":"2024-09-22T08:39:38.874031+0000","last_undegraded":"2024-09-22T08:39:38.874031+0000","last_fullsized":"2024-09-22T08:39:38.874031+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:01:51.899745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.225288+0000","last_change":"2024-09-22T08:36:32.005675+0000","last_active":"2024-09-22T08:37:04.225288+0000","last_peered":"2024-09-22T08:37:04.225288+0000","last_clean":"2024-09-22T08:37:04.225288+0000","last_became_active":"2024-09-22T08:36:32.005166+0000","last_became_peered":"2024-09-22T08:36:32.005166+0000","last_unstale":"2024-09-22T08:37:04.225288+0000","last_undegraded":"2024-09-22T08:37:04.225288+0000","last_fullsized":"2024-09-22T08:37:04.225288+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:04:54.919867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"32'7","reported_seq":25,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.093378+0000","last_change":"2024-09-22T08:36:34.014540+0000","last_active":"2024-09-22T08:39:32.093378+0000","last_peered":"2024-09-22T08:39:32.093378+0000","last_clean":"2024-09-22T08:39:32.093378+0000","last_became_active":"2024-09-22T08:36:34.014255+0000","last_became_peered":"2024-09-22T08:36:34.014255+0000","last_unstale":"2024-09-22T08:39:32.093378+0000","last_undegraded":"2024-09-22T08:39:32.093378+0000","last_fullsized":"2024-09-22T08:39:32.093378+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:47:25.081359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"32'4","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.078924+0000","last_change":"2024-09-22T08:36:25.978994+0000","last_active":"2024-09-22T08:39:32.078924+0000","last_peered":"2024-09-22T08:39:32.078924+0000","last_clean":"2024-09-22T08:39:32.078924+0000","last_became_active":"2024-09-22T08:36:25.978577+0000","last_became_peered":"2024-09-22T08:36:25.978577+0000","last_unstale":"2024-09-22T08:39:32.078924+0000","last_undegraded":"2024-09-22T08:39:32.078924+0000","last_fullsized":"2024-09-22T08:39:32.078924+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:02:49.260377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"32'2","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:48.833986+0000","last_change":"2024-09-22T08:39:48.833986+0000","last_active":"2024-09-22T08:39:48.833986+0000","last_peered":"2024-09-22T08:39:48.833986+0000","last_clean":"2024-09-22T08:39:48.833986+0000","last_became_active":"2024-09-22T08:37:04.226169+0000","last_became_peered":"2024-09-22T08:37:04.226169+0000","last_unstale":"2024-09-22T08:39:48.833986+0000","last_undegraded":"2024-09-22T08:39:48.833986+0000","last_fullsized":"2024-09-22T08:39:48.833986+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-22T08:39:48.833881+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-22T08:39:48.833881+0000","last_clean_scrub_stamp":"2024-09-22T08:39:48.833881+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:03:32.581894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.223988+0000","last_change":"2024-09-22T08:36:27.990314+0000","last_active":"2024-09-22T08:37:04.223988+0000","last_peered":"2024-09-22T08:37:04.223988+0000","last_clean":"2024-09-22T08:37:04.223988+0000","last_became_active":"2024-09-22T08:36:27.990038+0000","last_became_peered":"2024-09-22T08:36:27.990038+0000","last_unstale":"2024-09-22T08:37:04.223988+0000","last_undegraded":"2024-09-22T08:37:04.223988+0000","last_fullsized":"2024-09-22T08:37:04.223988+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_clean_scrub_stamp":"2024-09-22T08:36:26.962226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:42:33.084977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"30'10","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.227216+0000","last_change":"2024-09-22T08:36:29.997480+0000","last_active":"2024-09-22T08:37:04.227216+0000","last_peered":"2024-09-22T08:37:04.227216+0000","last_clean":"2024-09-22T08:37:04.227216+0000","last_became_active":"2024-09-22T08:36:29.997179+0000","last_became_peered":"2024-09-22T08:36:29.997179+0000","last_unstale":"2024-09-22T08:37:04.227216+0000","last_undegraded":"2024-09-22T08:37:04.227216+0000","last_fullsized":"2024-09-22T08:37:04.227216+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:42:36.332989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"32'285","reported_seq":369,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:38.821270+0000","last_change":"2024-09-22T08:36:32.012171+0000","last_active":"2024-09-22T08:39:38.821270+0000","last_peered":"2024-09-22T08:39:38.821270+0000","last_clean":"2024-09-22T08:39:38.821270+0000","last_became_active":"2024-09-22T08:36:32.011870+0000","last_became_peered":"2024-09-22T08:36:32.011870+0000","last_unstale":"2024-09-22T08:39:38.821270+0000","last_undegraded":"2024-09-22T08:39:38.821270+0000","last_fullsized":"2024-09-22T08:39:38.821270+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:20:17.853772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"32'2","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.248674+0000","last_change":"2024-09-22T08:36:34.013756+0000","last_active":"2024-09-22T08:39:32.248674+0000","last_peered":"2024-09-22T08:39:32.248674+0000","last_clean":"2024-09-22T08:39:32.248674+0000","last_became_active":"2024-09-22T08:36:34.013380+0000","last_became_peered":"2024-09-22T08:36:34.013380+0000","last_unstale":"2024-09-22T08:39:32.248674+0000","last_undegraded":"2024-09-22T08:39:32.248674+0000","last_fullsized":"2024-09-22T08:39:32.248674+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:26:36.228816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"32'8","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:31.647867+0000","last_change":"2024-09-22T08:36:25.971626+0000","last_active":"2024-09-22T08:38:31.647867+0000","last_peered":"2024-09-22T08:38:31.647867+0000","last_clean":"2024-09-22T08:38:31.647867+0000","last_became_active":"2024-09-22T08:36:25.971327+0000","last_became_peered":"2024-09-22T08:36:25.971327+0000","last_unstale":"2024-09-22T08:38:31.647867+0000","last_undegraded":"2024-09-22T08:38:31.647867+0000","last_fullsized":"2024-09-22T08:38:31.647867+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:06:32.443392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:50.109978+0000","last_change":"2024-09-22T08:39:50.109978+0000","last_active":"2024-09-22T08:39:50.109978+0000","last_peered":"2024-09-22T08:39:50.109978+0000","last_clean":"2024-09-22T08:39:50.109978+0000","last_became_active":"2024-09-22T08:36:23.978006+0000","last_became_peered":"2024-09-22T08:36:23.978006+0000","last_unstale":"2024-09-22T08:39:50.109978+0000","last_undegraded":"2024-09-22T08:39:50.109978+0000","last_fullsized":"2024-09-22T08:39:50.109978+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-22T08:39:50.109878+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-22T08:39:50.109878+0000","last_clean_scrub_stamp":"2024-09-22T08:39:50.109878+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:37:09.798548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.222677+0000","last_change":"2024-09-22T08:36:27.991045+0000","last_active":"2024-09-22T08:37:04.222677+0000","last_peered":"2024-09-22T08:37:04.222677+0000","last_clean":"2024-09-22T08:37:04.222677+0000","last_became_active":"2024-09-22T08:36:27.990729+0000","last_became_peered":"2024-09-22T08:36:27.990729+0000","last_unstale":"2024-09-22T08:37:04.222677+0000","last_undegraded":"2024-09-22T08:37:04.222677+0000","last_fullsized":"2024-09-22T08:37:04.222677+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_clean_scrub_stamp":"2024-09-22T08:36:26.962226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:27:20.880200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"32'39","reported_seq":89,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:38.893091+0000","last_change":"2024-09-22T08:36:29.987777+0000","last_active":"2024-09-22T08:39:38.893091+0000","last_peered":"2024-09-22T08:39:38.893091+0000","last_clean":"2024-09-22T08:39:38.893091+0000","last_became_active":"2024-09-22T08:36:29.987459+0000","last_became_peered":"2024-09-22T08:36:29.987459+0000","last_unstale":"2024-09-22T08:39:38.893091+0000","last_undegraded":"2024-09-22T08:39:38.893091+0000","last_fullsized":"2024-09-22T08:39:38.893091+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:30:17.280632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.222754+0000","last_change":"2024-09-22T08:36:32.003472+0000","last_active":"2024-09-22T08:37:04.222754+0000","last_peered":"2024-09-22T08:37:04.222754+0000","last_clean":"2024-09-22T08:37:04.222754+0000","last_became_active":"2024-09-22T08:36:32.003196+0000","last_became_peered":"2024-09-22T08:36:32.003196+0000","last_unstale":"2024-09-22T08:37:04.222754+0000","last_undegraded":"2024-09-22T08:37:04.222754+0000","last_fullsized":"2024-09-22T08:37:04.222754+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:42:54.487167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.223793+0000","last_change":"2024-09-22T08:36:34.016292+0000","last_active":"2024-09-22T08:37:04.223793+0000","last_peered":"2024-09-22T08:37:04.223793+0000","last_clean":"2024-09-22T08:37:04.223793+0000","last_became_active":"2024-09-22T08:36:34.015988+0000","last_became_peered":"2024-09-22T08:36:34.015988+0000","last_unstale":"2024-09-22T08:37:04.223793+0000","last_undegraded":"2024-09-22T08:37:04.223793+0000","last_fullsized":"2024-09-22T08:37:04.223793+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:16:42.030515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"32'4","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:31.648006+0000","last_change":"2024-09-22T08:36:25.972487+0000","last_active":"2024-09-22T08:38:31.648006+0000","last_peered":"2024-09-22T08:38:31.648006+0000","last_clean":"2024-09-22T08:38:31.648006+0000","last_became_active":"2024-09-22T08:36:25.972149+0000","last_became_peered":"2024-09-22T08:36:25.972149+0000","last_unstale":"2024-09-22T08:38:31.648006+0000","last_undegraded":"2024-09-22T08:38:31.648006+0000","last_fullsized":"2024-09-22T08:38:31.648006+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:06:31.006207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"32'2","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:59.302310+0000","last_change":"2024-09-22T08:39:59.302310+0000","last_active":"2024-09-22T08:39:59.302310+0000","last_peered":"2024-09-22T08:39:59.302310+0000","last_clean":"2024-09-22T08:39:59.302310+0000","last_became_active":"2024-09-22T08:36:23.982545+0000","last_became_peered":"2024-09-22T08:36:23.982545+0000","last_unstale":"2024-09-22T08:39:59.302310+0000","last_undegraded":"2024-09-22T08:39:59.302310+0000","last_fullsized":"2024-09-22T08:39:59.302310+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-22T08:39:59.302226+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-22T08:39:59.302226+0000","last_clean_scrub_stamp":"2024-09-22T08:39:59.302226+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:17:21.833960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.225495+0000","last_change":"2024-09-22T08:36:27.989826+0000","last_active":"2024-09-22T08:37:04.225495+0000","last_peered":"2024-09-22T08:37:04.225495+0000","last_clean":"2024-09-22T08:37:04.225495+0000","last_became_active":"2024-09-22T08:36:27.989495+0000","last_became_peered":"2024-09-22T08:36:27.989495+0000","last_unstale":"2024-09-22T08:37:04.225495+0000","last_undegraded":"2024-09-22T08:37:04.225495+0000","last_fullsized":"2024-09-22T08:37:04.225495+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_clean_scrub_stamp":"2024-09-22T08:36:26.962226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:36:51.183212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"32'33","reported_seq":80,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:38.896594+0000","last_change":"2024-09-22T08:36:29.994337+0000","last_active":"2024-09-22T08:39:38.896594+0000","last_peered":"2024-09-22T08:39:38.896594+0000","last_clean":"2024-09-22T08:39:38.896594+0000","last_became_active":"2024-09-22T08:36:29.994101+0000","last_became_peered":"2024-09-22T08:36:29.994101+0000","last_unstale":"2024-09-22T08:39:38.896594+0000","last_undegraded":"2024-09-22T08:39:38.896594+0000","last_fullsized":"2024-09-22T08:39:38.896594+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:40:06.073383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.230375+0000","last_change":"2024-09-22T08:36:32.012960+0000","last_active":"2024-09-22T08:37:04.230375+0000","last_peered":"2024-09-22T08:37:04.230375+0000","last_clean":"2024-09-22T08:37:04.230375+0000","last_became_active":"2024-09-22T08:36:32.011811+0000","last_became_peered":"2024-09-22T08:36:32.011811+0000","last_unstale":"2024-09-22T08:37:04.230375+0000","last_undegraded":"2024-09-22T08:37:04.230375+0000","last_fullsized":"2024-09-22T08:37:04.230375+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:13:22.789596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"32'2","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:05.456749+0000","last_change":"2024-09-22T08:36:34.020146+0000","last_active":"2024-09-22T08:37:05.456749+0000","last_peered":"2024-09-22T08:37:05.456749+0000","last_clean":"2024-09-22T08:37:05.456749+0000","last_became_active":"2024-09-22T08:36:34.019866+0000","last_became_peered":"2024-09-22T08:36:34.019866+0000","last_unstale":"2024-09-22T08:37:05.456749+0000","last_undegraded":"2024-09-22T08:37:05.456749+0000","last_fullsized":"2024-09-22T08:37:05.456749+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:56:15.623151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:31.647295+0000","last_change":"2024-09-22T08:36:25.989899+0000","last_active":"2024-09-22T08:38:31.647295+0000","last_peered":"2024-09-22T08:38:31.647295+0000","last_clean":"2024-09-22T08:38:31.647295+0000","last_became_active":"2024-09-22T08:36:25.989572+0000","last_became_peered":"2024-09-22T08:36:25.989572+0000","last_unstale":"2024-09-22T08:38:31.647295+0000","last_undegraded":"2024-09-22T08:38:31.647295+0000","last_fullsized":"2024-09-22T08:38:31.647295+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:11:07.278941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:49.815491+0000","last_change":"2024-09-22T08:39:49.815491+0000","last_active":"2024-09-22T08:39:49.815491+0000","last_peered":"2024-09-22T08:39:49.815491+0000","last_clean":"2024-09-22T08:39:49.815491+0000","last_became_active":"2024-09-22T08:36:23.971012+0000","last_became_peered":"2024-09-22T08:36:23.971012+0000","last_unstale":"2024-09-22T08:39:49.815491+0000","last_undegraded":"2024-09-22T08:39:49.815491+0000","last_fullsized":"2024-09-22T08:39:49.815491+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:39:49.815399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:39:49.815399+0000","last_clean_scrub_stamp":"2024-09-22T08:39:49.815399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:29:53.053729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.222066+0000","last_change":"2024-09-22T08:36:27.987755+0000","last_active":"2024-09-22T08:37:04.222066+0000","last_peered":"2024-09-22T08:37:04.222066+0000","last_clean":"2024-09-22T08:37:04.222066+0000","last_became_active":"2024-09-22T08:36:27.987504+0000","last_became_peered":"2024-09-22T08:36:27.987504+0000","last_unstale":"2024-09-22T08:37:04.222066+0000","last_undegraded":"2024-09-22T08:37:04.222066+0000","last_fullsized":"2024-09-22T08:37:04.222066+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_clean_scrub_stamp":"2024-09-22T08:36:26.962226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:39:03.985092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"32'29","reported_seq":74,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:38.971363+0000","last_change":"2024-09-22T08:36:29.998167+0000","last_active":"2024-09-22T08:39:38.971363+0000","last_peered":"2024-09-22T08:39:38.971363+0000","last_clean":"2024-09-22T08:39:38.971363+0000","last_became_active":"2024-09-22T08:36:29.997853+0000","last_became_peered":"2024-09-22T08:36:29.997853+0000","last_unstale":"2024-09-22T08:39:38.971363+0000","last_undegraded":"2024-09-22T08:39:38.971363+0000","last_fullsized":"2024-09-22T08:39:38.971363+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:34:13.019632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.227451+0000","last_change":"2024-09-22T08:36:32.012262+0000","last_active":"2024-09-22T08:37:04.227451+0000","last_peered":"2024-09-22T08:37:04.227451+0000","last_clean":"2024-09-22T08:37:04.227451+0000","last_became_active":"2024-09-22T08:36:32.011960+0000","last_became_peered":"2024-09-22T08:36:32.011960+0000","last_unstale":"2024-09-22T08:37:04.227451+0000","last_undegraded":"2024-09-22T08:37:04.227451+0000","last_fullsized":"2024-09-22T08:37:04.227451+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:58:25.357801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"32'16","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:30.267408+0000","last_change":"2024-09-22T08:36:34.018605+0000","last_active":"2024-09-22T08:38:30.267408+0000","last_peered":"2024-09-22T08:38:30.267408+0000","last_clean":"2024-09-22T08:38:30.267408+0000","last_became_active":"2024-09-22T08:36:34.018365+0000","last_became_peered":"2024-09-22T08:36:34.018365+0000","last_unstale":"2024-09-22T08:38:30.267408+0000","last_undegraded":"2024-09-22T08:38:30.267408+0000","last_fullsized":"2024-09-22T08:38:30.267408+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:01:49.722849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":96,"num_read_kb":76,"num_write":46,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"32'8","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.081475+0000","last_change":"2024-09-22T08:36:25.973362+0000","last_active":"2024-09-22T08:39:32.081475+0000","last_peered":"2024-09-22T08:39:32.081475+0000","last_clean":"2024-09-22T08:39:32.081475+0000","last_became_active":"2024-09-22T08:36:25.973089+0000","last_became_peered":"2024-09-22T08:36:25.973089+0000","last_unstale":"2024-09-22T08:39:32.081475+0000","last_undegraded":"2024-09-22T08:39:32.081475+0000","last_fullsized":"2024-09-22T08:39:32.081475+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:11:06.136833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"32'2","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:51.156994+0000","last_change":"2024-09-22T08:39:51.156994+0000","last_active":"2024-09-22T08:39:51.156994+0000","last_peered":"2024-09-22T08:39:51.156994+0000","last_clean":"2024-09-22T08:39:51.156994+0000","last_became_active":"2024-09-22T08:36:23.968249+0000","last_became_peered":"2024-09-22T08:36:23.968249+0000","last_unstale":"2024-09-22T08:39:51.156994+0000","last_undegraded":"2024-09-22T08:39:51.156994+0000","last_fullsized":"2024-09-22T08:39:51.156994+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-22T08:39:51.156910+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-22T08:39:51.156910+0000","last_clean_scrub_stamp":"2024-09-22T08:39:51.156910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:55:37.836983+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"32'2","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:28.952357+0000","last_change":"2024-09-22T08:36:27.988537+0000","last_active":"2024-09-22T08:38:28.952357+0000","last_peered":"2024-09-22T08:38:28.952357+0000","last_clean":"2024-09-22T08:38:28.952357+0000","last_became_active":"2024-09-22T08:36:27.988262+0000","last_became_peered":"2024-09-22T08:36:27.988262+0000","last_unstale":"2024-09-22T08:38:28.952357+0000","last_undegraded":"2024-09-22T08:38:28.952357+0000","last_fullsized":"2024-09-22T08:38:28.952357+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_clean_scrub_stamp":"2024-09-22T08:36:26.962226+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:27:56.322995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"32'35","reported_seq":84,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:38.877181+0000","last_change":"2024-09-22T08:36:29.997925+0000","last_active":"2024-09-22T08:39:38.877181+0000","last_peered":"2024-09-22T08:39:38.877181+0000","last_clean":"2024-09-22T08:39:38.877181+0000","last_became_active":"2024-09-22T08:36:29.997231+0000","last_became_peered":"2024-09-22T08:36:29.997231+0000","last_unstale":"2024-09-22T08:39:38.877181+0000","last_undegraded":"2024-09-22T08:39:38.877181+0000","last_fullsized":"2024-09-22T08:39:38.877181+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:37:27.208598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.224156+0000","last_change":"2024-09-22T08:36:32.004965+0000","last_active":"2024-09-22T08:37:04.224156+0000","last_peered":"2024-09-22T08:37:04.224156+0000","last_clean":"2024-09-22T08:37:04.224156+0000","last_became_active":"2024-09-22T08:36:32.004365+0000","last_became_peered":"2024-09-22T08:36:32.004365+0000","last_unstale":"2024-09-22T08:37:04.224156+0000","last_undegraded":"2024-09-22T08:37:04.224156+0000","last_fullsized":"2024-09-22T08:37:04.224156+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:02:38.800242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"32'4","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:30.270088+0000","last_change":"2024-09-22T08:36:34.016625+0000","last_active":"2024-09-22T08:38:30.270088+0000","last_peered":"2024-09-22T08:38:30.270088+0000","last_clean":"2024-09-22T08:38:30.270088+0000","last_became_active":"2024-09-22T08:36:34.016106+0000","last_became_peered":"2024-09-22T08:36:34.016106+0000","last_unstale":"2024-09-22T08:38:30.270088+0000","last_undegraded":"2024-09-22T08:38:30.270088+0000","last_fullsized":"2024-09-22T08:38:30.270088+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:10:10.424019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"32'12","reported_seq":70,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.290031+0000","last_change":"2024-09-22T08:36:25.987436+0000","last_active":"2024-09-22T08:39:32.290031+0000","last_peered":"2024-09-22T08:39:32.290031+0000","last_clean":"2024-09-22T08:39:32.290031+0000","last_became_active":"2024-09-22T08:36:25.987161+0000","last_became_peered":"2024-09-22T08:36:25.987161+0000","last_unstale":"2024-09-22T08:39:32.290031+0000","last_undegraded":"2024-09-22T08:39:32.290031+0000","last_fullsized":"2024-09-22T08:39:32.290031+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:12:14.347452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:51.626242+0000","last_change":"2024-09-22T08:39:51.626242+0000","last_active":"2024-09-22T08:39:51.626242+0000","last_peered":"2024-09-22T08:39:51.626242+0000","last_clean":"2024-09-22T08:39:51.626242+0000","last_became_active":"2024-09-22T08:36:23.969515+0000","last_became_peered":"2024-09-22T08:36:23.969515+0000","last_unstale":"2024-09-22T08:39:51.626242+0000","last_undegraded":"2024-09-22T08:39:51.626242+0000","last_fullsized":"2024-09-22T08:39:51.626242+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:39:51.626108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:39:51.626108+0000","last_clean_scrub_stamp":"2024-09-22T08:39:51.626108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:12:42.258599+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"32'12","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:47.943562+0000","last_change":"2024-09-22T08:36:25.979243+0000","last_active":"2024-09-22T08:37:47.943562+0000","last_peered":"2024-09-22T08:37:47.943562+0000","last_clean":"2024-09-22T08:37:47.943562+0000","last_became_active":"2024-09-22T08:36:25.978679+0000","last_became_peered":"2024-09-22T08:36:25.978679+0000","last_unstale":"2024-09-22T08:37:47.943562+0000","last_undegraded":"2024-09-22T08:37:47.943562+0000","last_fullsized":"2024-09-22T08:37:47.943562+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:02:33.743436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"32'2","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:50.767473+0000","last_change":"2024-09-22T08:39:50.767473+0000","last_active":"2024-09-22T08:39:50.767473+0000","last_peered":"2024-09-22T08:39:50.767473+0000","last_clean":"2024-09-22T08:39:50.767473+0000","last_became_active":"2024-09-22T08:36:23.970218+0000","last_became_peered":"2024-09-22T08:36:23.970218+0000","last_unstale":"2024-09-22T08:39:50.767473+0000","last_undegraded":"2024-09-22T08:39:50.767473+0000","last_fullsized":"2024-09-22T08:39:50.767473+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-22T08:39:50.767366+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-22T08:39:50.767366+0000","last_clean_scrub_stamp":"2024-09-22T08:39:50.767366+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:50:42.858238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"32'12","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.079200+0000","last_change":"2024-09-22T08:36:25.991808+0000","last_active":"2024-09-22T08:39:32.079200+0000","last_peered":"2024-09-22T08:39:32.079200+0000","last_clean":"2024-09-22T08:39:32.079200+0000","last_became_active":"2024-09-22T08:36:25.989638+0000","last_became_peered":"2024-09-22T08:36:25.989638+0000","last_unstale":"2024-09-22T08:39:32.079200+0000","last_undegraded":"2024-09-22T08:39:32.079200+0000","last_fullsized":"2024-09-22T08:39:32.079200+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:50:01.017587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":33,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:58.317577+0000","last_change":"2024-09-22T08:39:58.317577+0000","last_active":"2024-09-22T08:39:58.317577+0000","last_peered":"2024-09-22T08:39:58.317577+0000","last_clean":"2024-09-22T08:39:58.317577+0000","last_became_active":"2024-09-22T08:36:23.972582+0000","last_became_peered":"2024-09-22T08:36:23.972582+0000","last_unstale":"2024-09-22T08:39:58.317577+0000","last_undegraded":"2024-09-22T08:39:58.317577+0000","last_fullsized":"2024-09-22T08:39:58.317577+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:39:58.317493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:39:58.317493+0000","last_clean_scrub_stamp":"2024-09-22T08:39:58.317493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:30:33.805756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.224675+0000","last_change":"2024-09-22T08:36:25.978968+0000","last_active":"2024-09-22T08:37:04.224675+0000","last_peered":"2024-09-22T08:37:04.224675+0000","last_clean":"2024-09-22T08:37:04.224675+0000","last_became_active":"2024-09-22T08:36:25.978538+0000","last_became_peered":"2024-09-22T08:36:25.978538+0000","last_unstale":"2024-09-22T08:37:04.224675+0000","last_undegraded":"2024-09-22T08:37:04.224675+0000","last_fullsized":"2024-09-22T08:37:04.224675+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:36:39.596571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:51.809249+0000","last_change":"2024-09-22T08:39:51.809249+0000","last_active":"2024-09-22T08:39:51.809249+0000","last_peered":"2024-09-22T08:39:51.809249+0000","last_clean":"2024-09-22T08:39:51.809249+0000","last_became_active":"2024-09-22T08:36:23.973945+0000","last_became_peered":"2024-09-22T08:36:23.973945+0000","last_unstale":"2024-09-22T08:39:51.809249+0000","last_undegraded":"2024-09-22T08:39:51.809249+0000","last_fullsized":"2024-09-22T08:39:51.809249+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:39:51.809165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:39:51.809165+0000","last_clean_scrub_stamp":"2024-09-22T08:39:51.809165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:41:14.543135+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:47.943513+0000","last_change":"2024-09-22T08:36:25.984379+0000","last_active":"2024-09-22T08:37:47.943513+0000","last_peered":"2024-09-22T08:37:47.943513+0000","last_clean":"2024-09-22T08:37:47.943513+0000","last_became_active":"2024-09-22T08:36:25.984094+0000","last_became_peered":"2024-09-22T08:36:25.984094+0000","last_unstale":"2024-09-22T08:37:47.943513+0000","last_undegraded":"2024-09-22T08:37:47.943513+0000","last_fullsized":"2024-09-22T08:37:47.943513+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:55:15.332178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"32'2","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:52.813867+0000","last_change":"2024-09-22T08:39:52.813867+0000","last_active":"2024-09-22T08:39:52.813867+0000","last_peered":"2024-09-22T08:39:52.813867+0000","last_clean":"2024-09-22T08:39:52.813867+0000","last_became_active":"2024-09-22T08:36:23.970920+0000","last_became_peered":"2024-09-22T08:36:23.970920+0000","last_unstale":"2024-09-22T08:39:52.813867+0000","last_undegraded":"2024-09-22T08:39:52.813867+0000","last_fullsized":"2024-09-22T08:39:52.813867+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-22T08:39:52.813773+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-22T08:39:52.813773+0000","last_clean_scrub_stamp":"2024-09-22T08:39:52.813773+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:32:25.388534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"32'11","reported_seq":68,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.221583+0000","last_change":"2024-09-22T08:36:25.986221+0000","last_active":"2024-09-22T08:39:32.221583+0000","last_peered":"2024-09-22T08:39:32.221583+0000","last_clean":"2024-09-22T08:39:32.221583+0000","last_became_active":"2024-09-22T08:36:25.985965+0000","last_became_peered":"2024-09-22T08:36:25.985965+0000","last_unstale":"2024-09-22T08:39:32.221583+0000","last_undegraded":"2024-09-22T08:39:32.221583+0000","last_fullsized":"2024-09-22T08:39:32.221583+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:14:09.711077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":11,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:52.189228+0000","last_change":"2024-09-22T08:39:52.189228+0000","last_active":"2024-09-22T08:39:52.189228+0000","last_peered":"2024-09-22T08:39:52.189228+0000","last_clean":"2024-09-22T08:39:52.189228+0000","last_became_active":"2024-09-22T08:36:23.983722+0000","last_became_peered":"2024-09-22T08:36:23.983722+0000","last_unstale":"2024-09-22T08:39:52.189228+0000","last_undegraded":"2024-09-22T08:39:52.189228+0000","last_fullsized":"2024-09-22T08:39:52.189228+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:39:52.189117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:39:52.189117+0000","last_clean_scrub_stamp":"2024-09-22T08:39:52.189117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:49:51.464801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"32'4","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.259710+0000","last_change":"2024-09-22T08:36:25.983403+0000","last_active":"2024-09-22T08:39:32.259710+0000","last_peered":"2024-09-22T08:39:32.259710+0000","last_clean":"2024-09-22T08:39:32.259710+0000","last_became_active":"2024-09-22T08:36:25.983061+0000","last_became_peered":"2024-09-22T08:36:25.983061+0000","last_unstale":"2024-09-22T08:39:32.259710+0000","last_undegraded":"2024-09-22T08:39:32.259710+0000","last_fullsized":"2024-09-22T08:39:32.259710+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:36:23.489851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:52.621578+0000","last_change":"2024-09-22T08:39:52.621578+0000","last_active":"2024-09-22T08:39:52.621578+0000","last_peered":"2024-09-22T08:39:52.621578+0000","last_clean":"2024-09-22T08:39:52.621578+0000","last_became_active":"2024-09-22T08:36:23.973924+0000","last_became_peered":"2024-09-22T08:36:23.973924+0000","last_unstale":"2024-09-22T08:39:52.621578+0000","last_undegraded":"2024-09-22T08:39:52.621578+0000","last_fullsized":"2024-09-22T08:39:52.621578+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:39:52.621486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:39:52.621486+0000","last_clean_scrub_stamp":"2024-09-22T08:39:52.621486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:10:20.959216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"32'18","reported_seq":79,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.259032+0000","last_change":"2024-09-22T08:36:25.979450+0000","last_active":"2024-09-22T08:39:32.259032+0000","last_peered":"2024-09-22T08:39:32.259032+0000","last_clean":"2024-09-22T08:39:32.259032+0000","last_became_active":"2024-09-22T08:36:25.979151+0000","last_became_peered":"2024-09-22T08:36:25.979151+0000","last_unstale":"2024-09-22T08:39:32.259032+0000","last_undegraded":"2024-09-22T08:39:32.259032+0000","last_fullsized":"2024-09-22T08:39:32.259032+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:36:49.177782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":64,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:53.864259+0000","last_change":"2024-09-22T08:39:53.864259+0000","last_active":"2024-09-22T08:39:53.864259+0000","last_peered":"2024-09-22T08:39:53.864259+0000","last_clean":"2024-09-22T08:39:53.864259+0000","last_became_active":"2024-09-22T08:36:23.970584+0000","last_became_peered":"2024-09-22T08:36:23.970584+0000","last_unstale":"2024-09-22T08:39:53.864259+0000","last_undegraded":"2024-09-22T08:39:53.864259+0000","last_fullsized":"2024-09-22T08:39:53.864259+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:39:53.864171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:39:53.864171+0000","last_clean_scrub_stamp":"2024-09-22T08:39:53.864171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:54:15.743899+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"32'16","reported_seq":89,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.081622+0000","last_change":"2024-09-22T08:36:25.979007+0000","last_active":"2024-09-22T08:39:32.081622+0000","last_peered":"2024-09-22T08:39:32.081622+0000","last_clean":"2024-09-22T08:39:32.081622+0000","last_became_active":"2024-09-22T08:36:25.978730+0000","last_became_peered":"2024-09-22T08:36:25.978730+0000","last_unstale":"2024-09-22T08:39:32.081622+0000","last_undegraded":"2024-09-22T08:39:32.081622+0000","last_fullsized":"2024-09-22T08:39:32.081622+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:17:07.393345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":70,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:00.269799+0000","last_change":"2024-09-22T08:40:00.269799+0000","last_active":"2024-09-22T08:40:00.269799+0000","last_peered":"2024-09-22T08:40:00.269799+0000","last_clean":"2024-09-22T08:40:00.269799+0000","last_became_active":"2024-09-22T08:36:23.973175+0000","last_became_peered":"2024-09-22T08:36:23.973175+0000","last_unstale":"2024-09-22T08:40:00.269799+0000","last_undegraded":"2024-09-22T08:40:00.269799+0000","last_fullsized":"2024-09-22T08:40:00.269799+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-22T08:40:00.269709+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-22T08:40:00.269709+0000","last_clean_scrub_stamp":"2024-09-22T08:40:00.269709+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:41:49.730855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"32'6","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.289546+0000","last_change":"2024-09-22T08:36:25.991941+0000","last_active":"2024-09-22T08:39:32.289546+0000","last_peered":"2024-09-22T08:39:32.289546+0000","last_clean":"2024-09-22T08:39:32.289546+0000","last_became_active":"2024-09-22T08:36:25.991611+0000","last_became_peered":"2024-09-22T08:36:25.991611+0000","last_unstale":"2024-09-22T08:39:32.289546+0000","last_undegraded":"2024-09-22T08:39:32.289546+0000","last_fullsized":"2024-09-22T08:39:32.289546+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:09:42.836164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"32'6","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:54.860397+0000","last_change":"2024-09-22T08:39:54.860397+0000","last_active":"2024-09-22T08:39:54.860397+0000","last_peered":"2024-09-22T08:39:54.860397+0000","last_clean":"2024-09-22T08:39:54.860397+0000","last_became_active":"2024-09-22T08:36:23.973721+0000","last_became_peered":"2024-09-22T08:36:23.973721+0000","last_unstale":"2024-09-22T08:39:54.860397+0000","last_undegraded":"2024-09-22T08:39:54.860397+0000","last_fullsized":"2024-09-22T08:39:54.860397+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-22T08:39:54.860314+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-22T08:39:54.860314+0000","last_clean_scrub_stamp":"2024-09-22T08:39:54.860314+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:19:21.761274+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4,"num_write":22,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"32'8","reported_seq":69,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:05.720316+0000","last_change":"2024-09-22T08:37:04.234401+0000","last_active":"2024-09-22T08:37:05.720316+0000","last_peered":"2024-09-22T08:37:05.720316+0000","last_clean":"2024-09-22T08:37:05.720316+0000","last_became_active":"2024-09-22T08:37:04.231342+0000","last_became_peered":"2024-09-22T08:37:04.231342+0000","last_unstale":"2024-09-22T08:37:05.720316+0000","last_undegraded":"2024-09-22T08:37:05.720316+0000","last_fullsized":"2024-09-22T08:37:05.720316+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:00:32.641067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:53.142490+0000","last_change":"2024-09-22T08:39:53.142490+0000","last_active":"2024-09-22T08:39:53.142490+0000","last_peered":"2024-09-22T08:39:53.142490+0000","last_clean":"2024-09-22T08:39:53.142490+0000","last_became_active":"2024-09-22T08:36:23.975352+0000","last_became_peered":"2024-09-22T08:36:23.975352+0000","last_unstale":"2024-09-22T08:39:53.142490+0000","last_undegraded":"2024-09-22T08:39:53.142490+0000","last_fullsized":"2024-09-22T08:39:53.142490+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:39:53.142406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:39:53.142406+0000","last_clean_scrub_stamp":"2024-09-22T08:39:53.142406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:12:04.379120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.223362+0000","last_change":"2024-09-22T08:36:25.978610+0000","last_active":"2024-09-22T08:37:04.223362+0000","last_peered":"2024-09-22T08:37:04.223362+0000","last_clean":"2024-09-22T08:37:04.223362+0000","last_became_active":"2024-09-22T08:36:25.977732+0000","last_became_peered":"2024-09-22T08:36:25.977732+0000","last_unstale":"2024-09-22T08:37:04.223362+0000","last_undegraded":"2024-09-22T08:37:04.223362+0000","last_fullsized":"2024-09-22T08:37:04.223362+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:38:39.281465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:54.171493+0000","last_change":"2024-09-22T08:39:54.171493+0000","last_active":"2024-09-22T08:39:54.171493+0000","last_peered":"2024-09-22T08:39:54.171493+0000","last_clean":"2024-09-22T08:39:54.171493+0000","last_became_active":"2024-09-22T08:36:23.975986+0000","last_became_peered":"2024-09-22T08:36:23.975986+0000","last_unstale":"2024-09-22T08:39:54.171493+0000","last_undegraded":"2024-09-22T08:39:54.171493+0000","last_fullsized":"2024-09-22T08:39:54.171493+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:39:54.171402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:39:54.171402+0000","last_clean_scrub_stamp":"2024-09-22T08:39:54.171402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:30:19.750104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"32'9","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.299156+0000","last_change":"2024-09-22T08:36:25.984592+0000","last_active":"2024-09-22T08:39:32.299156+0000","last_peered":"2024-09-22T08:39:32.299156+0000","last_clean":"2024-09-22T08:39:32.299156+0000","last_became_active":"2024-09-22T08:36:25.984258+0000","last_became_peered":"2024-09-22T08:36:25.984258+0000","last_unstale":"2024-09-22T08:39:32.299156+0000","last_undegraded":"2024-09-22T08:39:32.299156+0000","last_fullsized":"2024-09-22T08:39:32.299156+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:55:58.281586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:01.295930+0000","last_change":"2024-09-22T08:40:01.295930+0000","last_active":"2024-09-22T08:40:01.295930+0000","last_peered":"2024-09-22T08:40:01.295930+0000","last_clean":"2024-09-22T08:40:01.295930+0000","last_became_active":"2024-09-22T08:36:23.979548+0000","last_became_peered":"2024-09-22T08:36:23.979548+0000","last_unstale":"2024-09-22T08:40:01.295930+0000","last_undegraded":"2024-09-22T08:40:01.295930+0000","last_fullsized":"2024-09-22T08:40:01.295930+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:01.295827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:01.295827+0000","last_clean_scrub_stamp":"2024-09-22T08:40:01.295827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:46:58.524286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"32'16","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:05.722031+0000","last_change":"2024-09-22T08:36:25.980204+0000","last_active":"2024-09-22T08:37:05.722031+0000","last_peered":"2024-09-22T08:37:05.722031+0000","last_clean":"2024-09-22T08:37:05.722031+0000","last_became_active":"2024-09-22T08:36:25.979965+0000","last_became_peered":"2024-09-22T08:36:25.979965+0000","last_unstale":"2024-09-22T08:37:05.722031+0000","last_undegraded":"2024-09-22T08:37:05.722031+0000","last_fullsized":"2024-09-22T08:37:05.722031+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:42:38.878214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":51,"num_write":22,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:02.303092+0000","last_change":"2024-09-22T08:40:02.303092+0000","last_active":"2024-09-22T08:40:02.303092+0000","last_peered":"2024-09-22T08:40:02.303092+0000","last_clean":"2024-09-22T08:40:02.303092+0000","last_became_active":"2024-09-22T08:36:23.978225+0000","last_became_peered":"2024-09-22T08:36:23.978225+0000","last_unstale":"2024-09-22T08:40:02.303092+0000","last_undegraded":"2024-09-22T08:40:02.303092+0000","last_fullsized":"2024-09-22T08:40:02.303092+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-22T08:40:02.302998+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-22T08:40:02.302998+0000","last_clean_scrub_stamp":"2024-09-22T08:40:02.302998+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:19:57.676393+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"32'6","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:31.994598+0000","last_change":"2024-09-22T08:36:25.990975+0000","last_active":"2024-09-22T08:39:31.994598+0000","last_peered":"2024-09-22T08:39:31.994598+0000","last_clean":"2024-09-22T08:39:31.994598+0000","last_became_active":"2024-09-22T08:36:25.990690+0000","last_became_peered":"2024-09-22T08:36:25.990690+0000","last_unstale":"2024-09-22T08:39:31.994598+0000","last_undegraded":"2024-09-22T08:39:31.994598+0000","last_fullsized":"2024-09-22T08:39:31.994598+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:09:20.176753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:53.617208+0000","last_change":"2024-09-22T08:39:53.617208+0000","last_active":"2024-09-22T08:39:53.617208+0000","last_peered":"2024-09-22T08:39:53.617208+0000","last_clean":"2024-09-22T08:39:53.617208+0000","last_became_active":"2024-09-22T08:36:23.973976+0000","last_became_peered":"2024-09-22T08:36:23.973976+0000","last_unstale":"2024-09-22T08:39:53.617208+0000","last_undegraded":"2024-09-22T08:39:53.617208+0000","last_fullsized":"2024-09-22T08:39:53.617208+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:39:53.617119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:39:53.617119+0000","last_clean_scrub_stamp":"2024-09-22T08:39:53.617119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:07:03.861422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"32'2","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.289981+0000","last_change":"2024-09-22T08:36:25.976107+0000","last_active":"2024-09-22T08:39:32.289981+0000","last_peered":"2024-09-22T08:39:32.289981+0000","last_clean":"2024-09-22T08:39:32.289981+0000","last_became_active":"2024-09-22T08:36:25.975794+0000","last_became_peered":"2024-09-22T08:36:25.975794+0000","last_unstale":"2024-09-22T08:39:32.289981+0000","last_undegraded":"2024-09-22T08:39:32.289981+0000","last_fullsized":"2024-09-22T08:39:32.289981+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:38:51.254477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:31.945275+0000","last_change":"2024-09-22T08:36:23.982786+0000","last_active":"2024-09-22T08:39:31.945275+0000","last_peered":"2024-09-22T08:39:31.945275+0000","last_clean":"2024-09-22T08:39:31.945275+0000","last_became_active":"2024-09-22T08:36:23.982376+0000","last_became_peered":"2024-09-22T08:36:23.982376+0000","last_unstale":"2024-09-22T08:39:31.945275+0000","last_undegraded":"2024-09-22T08:39:31.945275+0000","last_fullsized":"2024-09-22T08:39:31.945275+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:18:02.522688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.226198+0000","last_change":"2024-09-22T08:36:23.979035+0000","last_active":"2024-09-22T08:37:04.226198+0000","last_peered":"2024-09-22T08:37:04.226198+0000","last_clean":"2024-09-22T08:37:04.226198+0000","last_became_active":"2024-09-22T08:36:23.978787+0000","last_became_peered":"2024-09-22T08:36:23.978787+0000","last_unstale":"2024-09-22T08:37:04.226198+0000","last_undegraded":"2024-09-22T08:37:04.226198+0000","last_fullsized":"2024-09-22T08:37:04.226198+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:23.433065+0000","last_clean_scrub_stamp":"2024-09-22T08:36:23.433065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:59:46.639082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"32'8","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.081622+0000","last_change":"2024-09-22T08:36:25.979863+0000","last_active":"2024-09-22T08:39:32.081622+0000","last_peered":"2024-09-22T08:39:32.081622+0000","last_clean":"2024-09-22T08:39:32.081622+0000","last_became_active":"2024-09-22T08:36:25.979593+0000","last_became_peered":"2024-09-22T08:36:25.979593+0000","last_unstale":"2024-09-22T08:39:32.081622+0000","last_undegraded":"2024-09-22T08:39:32.081622+0000","last_fullsized":"2024-09-22T08:39:32.081622+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:44:30.975858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:55.878768+0000","last_change":"2024-09-22T08:39:55.878768+0000","last_active":"2024-09-22T08:39:55.878768+0000","last_peered":"2024-09-22T08:39:55.878768+0000","last_clean":"2024-09-22T08:39:55.878768+0000","last_became_active":"2024-09-22T08:36:23.974202+0000","last_became_peered":"2024-09-22T08:36:23.974202+0000","last_unstale":"2024-09-22T08:39:55.878768+0000","last_undegraded":"2024-09-22T08:39:55.878768+0000","last_fullsized":"2024-09-22T08:39:55.878768+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:39:55.878679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:39:55.878679+0000","last_clean_scrub_stamp":"2024-09-22T08:39:55.878679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:42:02.792761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"32'13","reported_seq":78,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:50.182446+0000","last_change":"2024-09-22T08:37:04.240925+0000","last_active":"2024-09-22T08:38:50.182446+0000","last_peered":"2024-09-22T08:38:50.182446+0000","last_clean":"2024-09-22T08:38:50.182446+0000","last_became_active":"2024-09-22T08:37:04.233241+0000","last_became_peered":"2024-09-22T08:37:04.233241+0000","last_unstale":"2024-09-22T08:38:50.182446+0000","last_undegraded":"2024-09-22T08:38:50.182446+0000","last_fullsized":"2024-09-22T08:38:50.182446+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:13:02.072699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":47,"num_read_kb":43,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1549,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":690,"num_read_kb":658,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":267,"ondisk_log_size":267,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2280,"ondisk_log_size":2280,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1600,"num_read_kb":1397,"num_write":597,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1374,"ondisk_log_size":1374,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1672,"num_read_kb":1562,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":177,"num_read_kb":83,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":128,"acting":128,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":11,"seq":47244640307,"num_pgs":124,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36312,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335528,"statfs":{"total":96636764160,"available":96599580672,"internally_reserved":0,"allocated":991232,"data_stored":726145,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640307,"num_pgs":119,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36324,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335516,"statfs":{"total":96636764160,"available":96599568384,"internally_reserved":0,"allocated":1003520,"data_stored":724639,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":9,"seq":38654705714,"num_pgs":152,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39960,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331880,"statfs":{"total":96636764160,"available":96595845120,"internally_reserved":0,"allocated":466944,"data_stored":138067,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705714,"num_pgs":135,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39916,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331924,"statfs":{"total":96636764160,"available":96595890176,"internally_reserved":0,"allocated":421888,"data_stored":135213,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":325,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":421,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T08:40:04.071 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-09-22T08:36:23.433065+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=23, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.071 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-09-22T08:36:24.956796+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=24, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.071 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-09-22T08:36:24.956796+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=24, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.071 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-09-22T08:36:23.433065+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=23, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.071 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-22T08:36:24.956796+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=24, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.072 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-09-22T08:36:24.956796+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=24, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.072 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-09-22T08:36:23.433065+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=23, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.072 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-09-22T08:36:24.956796+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=24, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.072 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-09-22T08:36:23.433065+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=23, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.072 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-09-22T08:36:24.956796+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=24, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.072 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-09-22T08:36:23.433065+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=23, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.072 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-09-22T08:36:24.956796+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=24, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.072 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-09-22T08:36:24.956796+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=24, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.072 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-09-22T08:36:24.956796+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=24, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.073 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-09-22T08:36:24.956796+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=24, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.073 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-09-22T08:36:24.956796+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=24, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.073 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-09-22T08:36:24.956796+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=24, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.073 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-09-22T08:36:24.956796+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=24, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.073 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-09-22T08:36:24.956796+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=24, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.073 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-09-22T08:36:23.433065+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=23, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.073 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-22T08:36:32.990486+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.073 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-09-22T08:36:24.956796+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=24, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.073 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-09-22T08:36:26.962226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=26, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.074 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-09-22T08:36:28.972630+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=28, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.074 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-09-22T08:36:30.982878+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=30, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.074 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-22T08:36:32.990486+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.074 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-09-22T08:36:24.956796+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=24, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.074 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-09-22T08:36:26.962226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=26, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.074 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-09-22T08:36:28.972630+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=28, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.074 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-09-22T08:36:30.982878+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=30, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.074 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-22T08:36:32.990486+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.075 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-09-22T08:36:24.956796+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=24, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.075 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-09-22T08:36:26.962226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=26, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.075 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-09-22T08:36:28.972630+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=28, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.075 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-22T08:36:30.982878+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=30, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.075 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-09-22T08:36:32.990486+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.075 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-09-22T08:36:26.962226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=26, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.075 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-09-22T08:36:28.972630+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=28, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.075 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-09-22T08:36:30.982878+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=30, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.075 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-09-22T08:36:24.956796+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=24, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.075 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-09-22T08:36:26.962226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=26, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.076 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-09-22T08:36:28.972630+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=28, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.076 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-09-22T08:36:30.982878+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=30, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.076 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-09-22T08:36:32.990486+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.076 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-09-22T08:36:24.956796+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=24, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.076 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-09-22T08:36:26.962226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=26, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.076 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-09-22T08:36:28.972630+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=28, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.076 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-09-22T08:36:30.982878+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=30, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.076 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-09-22T08:36:32.990486+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.076 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-09-22T08:36:26.962226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=26, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.077 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-09-22T08:36:28.972630+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=28, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.077 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-09-22T08:36:30.982878+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=30, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.077 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-22T08:36:32.990486+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.077 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-09-22T08:36:26.962226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=26, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.077 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-09-22T08:36:28.972630+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=28, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.077 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-09-22T08:36:30.982878+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=30, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.077 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-22T08:36:32.990486+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.077 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-09-22T08:36:24.956796+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=24, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.077 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-09-22T08:36:26.962226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=26, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.078 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-09-22T08:36:28.972630+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=28, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.078 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-09-22T08:36:30.982878+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=30, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.078 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-22T08:36:32.990486+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.078 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-09-22T08:36:24.956796+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=24, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.078 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-09-22T08:36:26.962226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=26, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.078 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-09-22T08:36:28.972630+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=28, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.078 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2024-09-22T08:36:30.982878+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=30, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.078 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-22T08:36:32.990486+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.078 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-09-22T08:36:24.956796+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=24, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.079 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-09-22T08:36:26.962226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=26, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.079 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-09-22T08:36:28.972630+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=28, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.079 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-09-22T08:36:30.982878+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=30, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.079 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-09-22T08:36:32.990486+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.079 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-09-22T08:36:24.956796+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=24, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.079 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-09-22T08:36:26.962226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=26, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.079 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-09-22T08:36:28.972630+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=28, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.079 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-09-22T08:36:30.982878+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=30, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.079 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-09-22T08:36:32.990486+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.080 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-09-22T08:36:26.962226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=26, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.080 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-09-22T08:36:28.972630+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=28, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.080 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-09-22T08:36:30.982878+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=30, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.080 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-09-22T08:36:32.990486+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.080 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-09-22T08:36:24.956796+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=24, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.080 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-09-22T08:36:26.962226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=26, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.080 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-09-22T08:36:28.972630+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=28, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.080 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-22T08:36:30.982878+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=30, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.080 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-22T08:36:32.990486+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.081 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-09-22T08:36:26.962226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=26, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.081 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-09-22T08:36:28.972630+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=28, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.081 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-09-22T08:36:30.982878+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=30, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.081 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-22T08:36:32.990486+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.081 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-09-22T08:36:26.962226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=26, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.081 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-09-22T08:36:28.972630+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=28, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.081 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-09-22T08:36:30.982878+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=30, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.081 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-22T08:36:32.990486+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.082 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-09-22T08:36:26.962226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=26, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.082 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-09-22T08:36:28.972630+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=28, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.082 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-09-22T08:36:30.982878+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=30, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.082 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-22T08:36:32.990486+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.082 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-09-22T08:36:26.962226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=26, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.082 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-09-22T08:36:28.972630+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=28, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.082 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-09-22T08:36:30.982878+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=30, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.082 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-22T08:36:32.990486+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.083 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-09-22T08:36:24.956796+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=24, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.083 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-09-22T08:36:26.962226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=26, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.083 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-09-22T08:36:28.972630+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=28, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.083 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-09-22T08:36:30.982878+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=30, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.083 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-22T08:36:32.990486+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.083 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-09-22T08:36:24.956796+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=24, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.083 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-09-22T08:36:26.962226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=26, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.083 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-09-22T08:36:28.972630+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=28, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.083 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-09-22T08:36:30.982878+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=30, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.084 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-09-22T08:36:32.990486+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.084 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-09-22T08:36:32.990486+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.084 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-09-22T08:36:26.962226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=26, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.084 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-09-22T08:36:28.972630+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=28, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.084 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-09-22T08:36:30.982878+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=30, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.084 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-22T08:36:32.990486+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.084 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-09-22T08:36:24.956796+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=24, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.084 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-09-22T08:36:26.962226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=26, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.084 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-09-22T08:36:28.972630+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=28, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.085 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-09-22T08:36:30.982878+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=30, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.085 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-22T08:36:32.990486+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.085 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-09-22T08:36:26.962226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=26, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.085 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-09-22T08:36:28.972630+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=28, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.085 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-09-22T08:36:30.982878+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=30, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.085 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-22T08:36:32.990486+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.085 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-09-22T08:36:24.956796+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=24, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.085 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-09-22T08:36:26.962226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=26, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.085 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-09-22T08:36:28.972630+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=28, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.085 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-09-22T08:36:30.982878+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=30, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.086 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-22T08:36:24.956796+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=24, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.086 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-09-22T08:36:26.962226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=26, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.086 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-09-22T08:36:28.972630+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=28, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.086 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-09-22T08:36:30.982878+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=30, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.086 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-22T08:36:32.990486+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.086 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-09-22T08:36:24.956796+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=24, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.086 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-09-22T08:36:26.962226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=26, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.086 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-09-22T08:36:28.972630+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=28, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.086 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-09-22T08:36:30.982878+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=30, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.087 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-22T08:36:32.990486+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.087 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-09-22T08:36:24.956796+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=24, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.087 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-09-22T08:36:26.962226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=26, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.087 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-09-22T08:36:28.972630+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=28, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.087 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-09-22T08:36:30.982878+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=30, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.087 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-22T08:36:32.990486+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.087 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-09-22T08:36:24.956796+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=24, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.087 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-09-22T08:36:26.962226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=26, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.087 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-09-22T08:36:28.972630+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=28, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.087 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-09-22T08:36:30.982878+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=30, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.088 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-22T08:36:32.990486+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.088 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-09-22T08:36:24.956796+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=24, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.088 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-09-22T08:36:26.962226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=26, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.088 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-09-22T08:36:28.972630+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=28, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.088 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-09-22T08:36:30.982878+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=30, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.088 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-22T08:36:32.990486+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.088 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-09-22T08:36:24.956796+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=24, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.088 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-09-22T08:36:26.962226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=26, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.088 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-09-22T08:36:28.972630+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=28, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.088 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-22T08:36:30.982878+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=30, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.089 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-22T08:36:32.990486+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.089 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-09-22T08:36:24.956796+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=24, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.089 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-09-22T08:36:26.962226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=26, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.089 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-09-22T08:36:28.972630+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=28, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.089 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-22T08:36:30.982878+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=30, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.089 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-22T08:36:32.990486+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.089 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-09-22T08:36:24.956796+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=24, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.089 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-09-22T08:36:26.962226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=26, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.089 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-09-22T08:36:28.972630+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=28, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.089 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-09-22T08:36:30.982878+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=30, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.090 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-22T08:36:32.990486+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.090 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-09-22T08:36:24.956796+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=24, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.090 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-09-22T08:36:24.956796+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=24, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.090 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-09-22T08:36:24.956796+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=24, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.090 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-09-22T08:36:24.956796+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=24, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.090 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-09-22T08:36:24.956796+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=24, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.090 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-09-22T08:36:24.956796+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=24, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.090 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-09-22T08:36:24.956796+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=24, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.090 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-09-22T08:36:24.956796+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=24, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.091 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-09-22T08:36:24.956796+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=24, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.091 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-09-22T08:36:24.956796+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=24, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.091 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-09-22T08:36:24.956796+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=24, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.091 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-09-22T08:36:24.956796+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=24, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.091 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-09-22T08:36:24.956796+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=24, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.091 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-09-22T08:36:24.956796+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=24, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.091 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-09-22T08:36:24.956796+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=24, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.091 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-09-22T08:36:24.956796+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=24, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.091 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-09-22T08:36:23.433065+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=23, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.092 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-09-22T08:36:23.433065+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=23, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.092 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-09-22T08:36:24.956796+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=24, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.092 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-09-22T08:36:24.956796+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=24, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:04.092 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-22T08:40:24.093 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T08:40:24.209 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:40:24.207+0000 7f9861871640 1 Processor -- start 2024-09-22T08:40:24.209 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:40:24.207+0000 7f9861871640 1 -- start start 2024-09-22T08:40:24.209 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:40:24.207+0000 7f9861871640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f985c06f280 0x7f985c06f660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:40:24.209 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:40:24.208+0000 7f9861871640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f985c099ee0 con 0x7f985c06fba0 2024-09-22T08:40:24.209 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:40:24.208+0000 7f9861871640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f985c070d00 con 0x7f985c06f280 2024-09-22T08:40:24.210 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:40:24.208+0000 7f985affd640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f985c06f280 0x7f985c06f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:40:24.210 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:40:24.208+0000 7f985a7fc640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f985c06fba0 0x7f985c097070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:58102/0 (socket says 172.21.15.31:58102) 2024-09-22T08:40:24.210 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:40:24.208+0000 7f985a7fc640 1 -- 172.21.15.31:0/3794249253 learned_addr learned my addr 172.21.15.31:0/3794249253 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-22T08:40:24.210 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:40:24.208+0000 7f985affd640 1 -- 172.21.15.31:0/3794249253 >> v1:172.21.15.31:6789/0 conn(0x7f985c06fba0 legacy=0x7f985c097070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:40:24.210 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:40:24.208+0000 7f985affd640 1 -- 172.21.15.31:0/3794249253 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f985c070f40 con 0x7f985c06f280 2024-09-22T08:40:24.211 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:40:24.209+0000 7f985affd640 1 --2- 172.21.15.31:0/3794249253 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f985c06f280 0x7f985c06f660 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f984c009720 tx=0x7f984c02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d9f8cf955442550 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:40:24.211 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:40:24.209+0000 7f9859ffb640 1 -- 172.21.15.31:0/3794249253 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f984c037070 con 0x7f985c06f280 2024-09-22T08:40:24.211 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:40:24.209+0000 7f9859ffb640 1 -- 172.21.15.31:0/3794249253 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f984c02ad90 con 0x7f985c06f280 2024-09-22T08:40:24.211 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:40:24.209+0000 7f9859ffb640 1 -- 172.21.15.31:0/3794249253 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f984c032590 con 0x7f985c06f280 2024-09-22T08:40:24.211 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:40:24.209+0000 7f9861871640 1 -- 172.21.15.31:0/3794249253 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f985c06f280 msgr2=0x7f985c06f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:40:24.211 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:40:24.209+0000 7f9861871640 1 --2- 172.21.15.31:0/3794249253 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f985c06f280 0x7f985c06f660 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f984c009720 tx=0x7f984c02a110 comp rx=0 tx=0).stop 2024-09-22T08:40:24.211 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:40:24.210+0000 7f9861871640 1 -- 172.21.15.31:0/3794249253 shutdown_connections 2024-09-22T08:40:24.211 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:40:24.210+0000 7f9861871640 1 --2- 172.21.15.31:0/3794249253 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f985c06f280 0x7f985c06f660 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:40:24.212 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:40:24.210+0000 7f9861871640 1 -- 172.21.15.31:0/3794249253 >> 172.21.15.31:0/3794249253 conn(0x7f985c09ac80 msgr2=0x7f985c098550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:40:24.212 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:40:24.210+0000 7f9861871640 1 -- 172.21.15.31:0/3794249253 shutdown_connections 2024-09-22T08:40:24.212 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:40:24.210+0000 7f9861871640 1 -- 172.21.15.31:0/3794249253 wait complete. 2024-09-22T08:40:24.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:40:24.210+0000 7f9861871640 1 Processor -- start 2024-09-22T08:40:24.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:40:24.211+0000 7f9861871640 1 -- start start 2024-09-22T08:40:24.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:40:24.211+0000 7f9861871640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f985c06f280 0x7f985c1c46e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:40:24.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:40:24.211+0000 7f9861871640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f985c097780 con 0x7f985c06f280 2024-09-22T08:40:24.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:40:24.211+0000 7f985affd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f985c06f280 0x7f985c1c46e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:40:24.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:40:24.211+0000 7f985affd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f985c06f280 0x7f985c1c46e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:46504/0 (socket says 172.21.15.31:46504) 2024-09-22T08:40:24.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:40:24.211+0000 7f985affd640 1 -- 172.21.15.31:0/3796100854 learned_addr learned my addr 172.21.15.31:0/3796100854 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-22T08:40:24.214 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:40:24.211+0000 7f985affd640 1 -- 172.21.15.31:0/3796100854 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f985c073fb0 con 0x7f985c06f280 2024-09-22T08:40:24.214 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:40:24.212+0000 7f985affd640 1 --2- 172.21.15.31:0/3796100854 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f985c06f280 0x7f985c1c46e0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f984c009840 tx=0x7f984c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:40:24.214 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:40:24.212+0000 7f9843fff640 1 -- 172.21.15.31:0/3796100854 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f984c041070 con 0x7f985c06f280 2024-09-22T08:40:24.214 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:40:24.212+0000 7f9843fff640 1 -- 172.21.15.31:0/3796100854 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f984c03c460 con 0x7f985c06f280 2024-09-22T08:40:24.214 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:40:24.212+0000 7f9861871640 1 -- 172.21.15.31:0/3796100854 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f985c0900c0 con 0x7f985c06f280 2024-09-22T08:40:24.214 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:40:24.212+0000 7f9843fff640 1 -- 172.21.15.31:0/3796100854 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f984c037040 con 0x7f985c06f280 2024-09-22T08:40:24.214 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:40:24.212+0000 7f9861871640 1 -- 172.21.15.31:0/3796100854 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f985c090cf0 con 0x7f985c06f280 2024-09-22T08:40:24.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:40:24.213+0000 7f9843fff640 1 -- 172.21.15.31:0/3796100854 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f984c044070 con 0x7f985c06f280 2024-09-22T08:40:24.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:40:24.213+0000 7f9861871640 1 -- 172.21.15.31:0/3796100854 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f985c08f9e0 con 0x7f985c06f280 2024-09-22T08:40:24.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:40:24.213+0000 7f9843fff640 1 --2- 172.21.15.31:0/3796100854 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f984803e740 0x7f9848040c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:40:24.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:40:24.213+0000 7f9843fff640 1 -- 172.21.15.31:0/3796100854 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5938+0+0 (secure 0 0 0) 0x7f984c073f20 con 0x7f985c06f280 2024-09-22T08:40:24.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:40:24.213+0000 7f985a7fc640 1 --2- 172.21.15.31:0/3796100854 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f984803e740 0x7f9848040c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:40:24.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:40:24.214+0000 7f985a7fc640 1 --2- 172.21.15.31:0/3796100854 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f984803e740 0x7f9848040c00 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f9850007fd0 tx=0x7f9850007aa0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:40:24.219 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:40:24.218+0000 7f9843fff640 1 -- 172.21.15.31:0/3796100854 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f985c073fb0 con 0x7f985c06f280 2024-09-22T08:40:24.404 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:40:24.403+0000 7f9861871640 1 -- 172.21.15.31:0/3796100854 --> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f985c097cb0 con 0x7f984803e740 2024-09-22T08:40:24.415 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:40:24.414+0000 7f9843fff640 1 -- 172.21.15.31:0/3796100854 <== mgr.4099 v2:172.21.15.142:6824/99931088 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665710 (secure 0 0 0) 0x7f985c097cb0 con 0x7f984803e740 2024-09-22T08:40:24.422 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-22T08:40:24.428 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2024-09-22T08:40:24.429 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:40:24.419+0000 7f9861871640 1 -- 172.21.15.31:0/3796100854 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f984803e740 msgr2=0x7f9848040c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:40:24.430 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:40:24.419+0000 7f9861871640 1 --2- 172.21.15.31:0/3796100854 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f984803e740 0x7f9848040c00 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f9850007fd0 tx=0x7f9850007aa0 comp rx=0 tx=0).stop 2024-09-22T08:40:24.430 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:40:24.419+0000 7f9861871640 1 -- 172.21.15.31:0/3796100854 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f985c06f280 msgr2=0x7f985c1c46e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:40:24.430 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:40:24.419+0000 7f9861871640 1 --2- 172.21.15.31:0/3796100854 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f985c06f280 0x7f985c1c46e0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f984c009840 tx=0x7f984c0046c0 comp rx=0 tx=0).stop 2024-09-22T08:40:24.430 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:40:24.419+0000 7f9861871640 1 -- 172.21.15.31:0/3796100854 shutdown_connections 2024-09-22T08:40:24.430 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:40:24.419+0000 7f9861871640 1 --2- 172.21.15.31:0/3796100854 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f984803e740 0x7f9848040c00 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:40:24.430 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:40:24.419+0000 7f9861871640 1 --2- 172.21.15.31:0/3796100854 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f985c06f280 0x7f985c1c46e0 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:40:24.430 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:40:24.419+0000 7f9861871640 1 -- 172.21.15.31:0/3796100854 >> 172.21.15.31:0/3796100854 conn(0x7f985c09ac80 msgr2=0x7f985c09c740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:40:24.430 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:40:24.420+0000 7f9861871640 1 -- 172.21.15.31:0/3796100854 shutdown_connections 2024-09-22T08:40:24.430 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:40:24.420+0000 7f9861871640 1 -- 172.21.15.31:0/3796100854 wait complete. 2024-09-22T08:40:24.432 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":157,"stamp":"2024-09-22T08:40:23.219977+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605410,"num_objects":222,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":222,"num_whiteouts":0,"num_read":5177,"num_read_kb":4727,"num_write":2121,"num_write_kb":60587,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1336,"num_omap_keys":6,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4628,"ondisk_log_size":4628,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":156672,"kb_used_data":2816,"kb_used_omap":6,"kb_used_meta":153785,"kb_avail":377330688,"statfs":{"total":386547056640,"available":386386624512,"internally_reserved":0,"allocated":2883584,"data_stored":1724064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":157476630},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1336,"num_omap_keys":6,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003947"},"pg_stats":[{"pgid":"3.3f","version":"30'4","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:04.369118+0000","last_change":"2024-09-22T08:40:04.369118+0000","last_active":"2024-09-22T08:40:04.369118+0000","last_peered":"2024-09-22T08:40:04.369118+0000","last_clean":"2024-09-22T08:40:04.369118+0000","last_became_active":"2024-09-22T08:36:23.978473+0000","last_became_peered":"2024-09-22T08:36:23.978473+0000","last_unstale":"2024-09-22T08:40:04.369118+0000","last_undegraded":"2024-09-22T08:40:04.369118+0000","last_fullsized":"2024-09-22T08:40:04.369118+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'4","last_scrub_stamp":"2024-09-22T08:40:04.369030+0000","last_deep_scrub":"30'4","last_deep_scrub_stamp":"2024-09-22T08:40:04.369030+0000","last_clean_scrub_stamp":"2024-09-22T08:40:04.369030+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:39:45.475667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":7,"num_write":20,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"30'4","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:15.337474+0000","last_change":"2024-09-22T08:40:15.337474+0000","last_active":"2024-09-22T08:40:15.337474+0000","last_peered":"2024-09-22T08:40:15.337474+0000","last_clean":"2024-09-22T08:40:15.337474+0000","last_became_active":"2024-09-22T08:36:25.981849+0000","last_became_peered":"2024-09-22T08:36:25.981849+0000","last_unstale":"2024-09-22T08:40:15.337474+0000","last_undegraded":"2024-09-22T08:40:15.337474+0000","last_fullsized":"2024-09-22T08:40:15.337474+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'4","last_scrub_stamp":"2024-09-22T08:40:15.337386+0000","last_deep_scrub":"30'4","last_deep_scrub_stamp":"2024-09-22T08:40:15.337386+0000","last_clean_scrub_stamp":"2024-09-22T08:40:15.337386+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:47:30.055490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:58.826192+0000","last_change":"2024-09-22T08:39:58.826192+0000","last_active":"2024-09-22T08:39:58.826192+0000","last_peered":"2024-09-22T08:39:58.826192+0000","last_clean":"2024-09-22T08:39:58.826192+0000","last_became_active":"2024-09-22T08:36:23.973596+0000","last_became_peered":"2024-09-22T08:36:23.973596+0000","last_unstale":"2024-09-22T08:39:58.826192+0000","last_undegraded":"2024-09-22T08:39:58.826192+0000","last_fullsized":"2024-09-22T08:39:58.826192+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:39:58.826106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:39:58.826106+0000","last_clean_scrub_stamp":"2024-09-22T08:39:58.826106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:25:37.176757+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"32'2","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.081639+0000","last_change":"2024-09-22T08:36:25.992482+0000","last_active":"2024-09-22T08:39:32.081639+0000","last_peered":"2024-09-22T08:39:32.081639+0000","last_clean":"2024-09-22T08:39:32.081639+0000","last_became_active":"2024-09-22T08:36:25.992150+0000","last_became_peered":"2024-09-22T08:36:25.992150+0000","last_unstale":"2024-09-22T08:39:32.081639+0000","last_undegraded":"2024-09-22T08:39:32.081639+0000","last_fullsized":"2024-09-22T08:39:32.081639+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:39:29.442096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:08.374230+0000","last_change":"2024-09-22T08:40:08.374230+0000","last_active":"2024-09-22T08:40:08.374230+0000","last_peered":"2024-09-22T08:40:08.374230+0000","last_clean":"2024-09-22T08:40:08.374230+0000","last_became_active":"2024-09-22T08:36:23.982860+0000","last_became_peered":"2024-09-22T08:36:23.982860+0000","last_unstale":"2024-09-22T08:40:08.374230+0000","last_undegraded":"2024-09-22T08:40:08.374230+0000","last_fullsized":"2024-09-22T08:40:08.374230+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:08.374142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:08.374142+0000","last_clean_scrub_stamp":"2024-09-22T08:40:08.374142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:54:23.652205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.228436+0000","last_change":"2024-09-22T08:36:25.992618+0000","last_active":"2024-09-22T08:37:04.228436+0000","last_peered":"2024-09-22T08:37:04.228436+0000","last_clean":"2024-09-22T08:37:04.228436+0000","last_became_active":"2024-09-22T08:36:25.992356+0000","last_became_peered":"2024-09-22T08:36:25.992356+0000","last_unstale":"2024-09-22T08:37:04.228436+0000","last_undegraded":"2024-09-22T08:37:04.228436+0000","last_fullsized":"2024-09-22T08:37:04.228436+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:54:42.310988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:58.533060+0000","last_change":"2024-09-22T08:39:58.533060+0000","last_active":"2024-09-22T08:39:58.533060+0000","last_peered":"2024-09-22T08:39:58.533060+0000","last_clean":"2024-09-22T08:39:58.533060+0000","last_became_active":"2024-09-22T08:36:23.967096+0000","last_became_peered":"2024-09-22T08:36:23.967096+0000","last_unstale":"2024-09-22T08:39:58.533060+0000","last_undegraded":"2024-09-22T08:39:58.533060+0000","last_fullsized":"2024-09-22T08:39:58.533060+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:39:58.532978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:39:58.532978+0000","last_clean_scrub_stamp":"2024-09-22T08:39:58.532978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:58:12.874966+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"32'22","reported_seq":95,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.214709+0000","last_change":"2024-09-22T08:36:25.989569+0000","last_active":"2024-09-22T08:39:32.214709+0000","last_peered":"2024-09-22T08:39:32.214709+0000","last_clean":"2024-09-22T08:39:32.214709+0000","last_became_active":"2024-09-22T08:36:25.989065+0000","last_became_peered":"2024-09-22T08:36:25.989065+0000","last_unstale":"2024-09-22T08:39:32.214709+0000","last_undegraded":"2024-09-22T08:39:32.214709+0000","last_fullsized":"2024-09-22T08:39:32.214709+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:18:58.915284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":82,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:06.332632+0000","last_change":"2024-09-22T08:40:06.332632+0000","last_active":"2024-09-22T08:40:06.332632+0000","last_peered":"2024-09-22T08:40:06.332632+0000","last_clean":"2024-09-22T08:40:06.332632+0000","last_became_active":"2024-09-22T08:36:23.978766+0000","last_became_peered":"2024-09-22T08:36:23.978766+0000","last_unstale":"2024-09-22T08:40:06.332632+0000","last_undegraded":"2024-09-22T08:40:06.332632+0000","last_fullsized":"2024-09-22T08:40:06.332632+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:06.332545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:06.332545+0000","last_clean_scrub_stamp":"2024-09-22T08:40:06.332545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:25:05.583350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"32'8","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:17.301230+0000","last_change":"2024-09-22T08:40:17.301230+0000","last_active":"2024-09-22T08:40:17.301230+0000","last_peered":"2024-09-22T08:40:17.301230+0000","last_clean":"2024-09-22T08:40:17.301230+0000","last_became_active":"2024-09-22T08:36:25.978937+0000","last_became_peered":"2024-09-22T08:36:25.978937+0000","last_unstale":"2024-09-22T08:40:17.301230+0000","last_undegraded":"2024-09-22T08:40:17.301230+0000","last_fullsized":"2024-09-22T08:40:17.301230+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-22T08:40:17.301118+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-22T08:40:17.301118+0000","last_clean_scrub_stamp":"2024-09-22T08:40:17.301118+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:02:08.767907+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":23,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"32'4","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:01.435460+0000","last_change":"2024-09-22T08:40:01.435460+0000","last_active":"2024-09-22T08:40:01.435460+0000","last_peered":"2024-09-22T08:40:01.435460+0000","last_clean":"2024-09-22T08:40:01.435460+0000","last_became_active":"2024-09-22T08:36:23.967168+0000","last_became_peered":"2024-09-22T08:36:23.967168+0000","last_unstale":"2024-09-22T08:40:01.435460+0000","last_undegraded":"2024-09-22T08:40:01.435460+0000","last_fullsized":"2024-09-22T08:40:01.435460+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-22T08:40:01.435370+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-22T08:40:01.435370+0000","last_clean_scrub_stamp":"2024-09-22T08:40:01.435370+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:31:33.320075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":10,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"32'6","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:48.130983+0000","last_change":"2024-09-22T08:36:25.992986+0000","last_active":"2024-09-22T08:37:48.130983+0000","last_peered":"2024-09-22T08:37:48.130983+0000","last_clean":"2024-09-22T08:37:48.130983+0000","last_became_active":"2024-09-22T08:36:25.990727+0000","last_became_peered":"2024-09-22T08:36:25.990727+0000","last_unstale":"2024-09-22T08:37:48.130983+0000","last_undegraded":"2024-09-22T08:37:48.130983+0000","last_fullsized":"2024-09-22T08:37:48.130983+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:05:42.869702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:04.247350+0000","last_change":"2024-09-22T08:40:04.247350+0000","last_active":"2024-09-22T08:40:04.247350+0000","last_peered":"2024-09-22T08:40:04.247350+0000","last_clean":"2024-09-22T08:40:04.247350+0000","last_became_active":"2024-09-22T08:36:23.980446+0000","last_became_peered":"2024-09-22T08:36:23.980446+0000","last_unstale":"2024-09-22T08:40:04.247350+0000","last_undegraded":"2024-09-22T08:40:04.247350+0000","last_fullsized":"2024-09-22T08:40:04.247350+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:04.247231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:04.247231+0000","last_clean_scrub_stamp":"2024-09-22T08:40:04.247231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:03:00.194431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"32'8","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:06.366446+0000","last_change":"2024-09-22T08:40:06.366446+0000","last_active":"2024-09-22T08:40:06.366446+0000","last_peered":"2024-09-22T08:40:06.366446+0000","last_clean":"2024-09-22T08:40:06.366446+0000","last_became_active":"2024-09-22T08:36:25.982217+0000","last_became_peered":"2024-09-22T08:36:25.982217+0000","last_unstale":"2024-09-22T08:40:06.366446+0000","last_undegraded":"2024-09-22T08:40:06.366446+0000","last_fullsized":"2024-09-22T08:40:06.366446+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-22T08:40:06.366369+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-22T08:40:06.366369+0000","last_clean_scrub_stamp":"2024-09-22T08:40:06.366369+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:25:30.349302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":27,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:57.845968+0000","last_change":"2024-09-22T08:39:57.845968+0000","last_active":"2024-09-22T08:39:57.845968+0000","last_peered":"2024-09-22T08:39:57.845968+0000","last_clean":"2024-09-22T08:39:57.845968+0000","last_became_active":"2024-09-22T08:36:23.977715+0000","last_became_peered":"2024-09-22T08:36:23.977715+0000","last_unstale":"2024-09-22T08:39:57.845968+0000","last_undegraded":"2024-09-22T08:39:57.845968+0000","last_fullsized":"2024-09-22T08:39:57.845968+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-22T08:39:57.845879+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-22T08:39:57.845879+0000","last_clean_scrub_stamp":"2024-09-22T08:39:57.845879+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:42:05.377364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"32'8","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:09.396278+0000","last_change":"2024-09-22T08:40:09.396278+0000","last_active":"2024-09-22T08:40:09.396278+0000","last_peered":"2024-09-22T08:40:09.396278+0000","last_clean":"2024-09-22T08:40:09.396278+0000","last_became_active":"2024-09-22T08:36:25.974930+0000","last_became_peered":"2024-09-22T08:36:25.974930+0000","last_unstale":"2024-09-22T08:40:09.396278+0000","last_undegraded":"2024-09-22T08:40:09.396278+0000","last_fullsized":"2024-09-22T08:40:09.396278+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-22T08:40:09.396197+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-22T08:40:09.396197+0000","last_clean_scrub_stamp":"2024-09-22T08:40:09.396197+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:50:08.671881+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"32'3","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:48.185367+0000","last_change":"2024-09-22T08:36:25.992134+0000","last_active":"2024-09-22T08:38:48.185367+0000","last_peered":"2024-09-22T08:38:48.185367+0000","last_clean":"2024-09-22T08:38:48.185367+0000","last_became_active":"2024-09-22T08:36:25.991870+0000","last_became_peered":"2024-09-22T08:36:25.991870+0000","last_unstale":"2024-09-22T08:38:48.185367+0000","last_undegraded":"2024-09-22T08:38:48.185367+0000","last_fullsized":"2024-09-22T08:38:48.185367+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:24.956796+0000","last_clean_scrub_stamp":"2024-09-22T08:36:24.956796+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:22:14.904895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:57.283661+0000","last_change":"2024-09-22T08:39:57.283661+0000","last_active":"2024-09-22T08:39:57.283661+0000","last_peered":"2024-09-22T08:39:57.283661+0000","last_clean":"2024-09-22T08:39:57.283661+0000","last_became_active":"2024-09-22T08:36:23.977556+0000","last_became_peered":"2024-09-22T08:36:23.977556+0000","last_unstale":"2024-09-22T08:39:57.283661+0000","last_undegraded":"2024-09-22T08:39:57.283661+0000","last_fullsized":"2024-09-22T08:39:57.283661+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:39:57.283537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:39:57.283537+0000","last_clean_scrub_stamp":"2024-09-22T08:39:57.283537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:31:33.140772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"32'14","reported_seq":80,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:11.433190+0000","last_change":"2024-09-22T08:40:11.433190+0000","last_active":"2024-09-22T08:40:11.433190+0000","last_peered":"2024-09-22T08:40:11.433190+0000","last_clean":"2024-09-22T08:40:11.433190+0000","last_became_active":"2024-09-22T08:36:25.976389+0000","last_became_peered":"2024-09-22T08:36:25.976389+0000","last_unstale":"2024-09-22T08:40:11.433190+0000","last_undegraded":"2024-09-22T08:40:11.433190+0000","last_fullsized":"2024-09-22T08:40:11.433190+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'14","last_scrub_stamp":"2024-09-22T08:40:11.433107+0000","last_deep_scrub":"32'14","last_deep_scrub_stamp":"2024-09-22T08:40:11.433107+0000","last_clean_scrub_stamp":"2024-09-22T08:40:11.433107+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:20:10.105300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":49,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"32'2","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:57.549716+0000","last_change":"2024-09-22T08:39:57.549716+0000","last_active":"2024-09-22T08:39:57.549716+0000","last_peered":"2024-09-22T08:39:57.549716+0000","last_clean":"2024-09-22T08:39:57.549716+0000","last_became_active":"2024-09-22T08:36:23.974275+0000","last_became_peered":"2024-09-22T08:36:23.974275+0000","last_unstale":"2024-09-22T08:39:57.549716+0000","last_undegraded":"2024-09-22T08:39:57.549716+0000","last_fullsized":"2024-09-22T08:39:57.549716+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-22T08:39:57.549604+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-22T08:39:57.549604+0000","last_clean_scrub_stamp":"2024-09-22T08:39:57.549604+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:02:09.510635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"32'14","reported_seq":74,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:12.409862+0000","last_change":"2024-09-22T08:40:12.409862+0000","last_active":"2024-09-22T08:40:12.409862+0000","last_peered":"2024-09-22T08:40:12.409862+0000","last_clean":"2024-09-22T08:40:12.409862+0000","last_became_active":"2024-09-22T08:36:25.977015+0000","last_became_peered":"2024-09-22T08:36:25.977015+0000","last_unstale":"2024-09-22T08:40:12.409862+0000","last_undegraded":"2024-09-22T08:40:12.409862+0000","last_fullsized":"2024-09-22T08:40:12.409862+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'14","last_scrub_stamp":"2024-09-22T08:40:12.409763+0000","last_deep_scrub":"32'14","last_deep_scrub_stamp":"2024-09-22T08:40:12.409763+0000","last_clean_scrub_stamp":"2024-09-22T08:40:12.409763+0000","objects_scrubbed":2,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:14:30.930010+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":43,"num_read_kb":39,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:55.220138+0000","last_change":"2024-09-22T08:39:55.220138+0000","last_active":"2024-09-22T08:39:55.220138+0000","last_peered":"2024-09-22T08:39:55.220138+0000","last_clean":"2024-09-22T08:39:55.220138+0000","last_became_active":"2024-09-22T08:36:23.984411+0000","last_became_peered":"2024-09-22T08:36:23.984411+0000","last_unstale":"2024-09-22T08:39:55.220138+0000","last_undegraded":"2024-09-22T08:39:55.220138+0000","last_fullsized":"2024-09-22T08:39:55.220138+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-22T08:39:55.220017+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-22T08:39:55.220017+0000","last_clean_scrub_stamp":"2024-09-22T08:39:55.220017+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:52:34.074155+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"32'2","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:11.833416+0000","last_change":"2024-09-22T08:40:11.833416+0000","last_active":"2024-09-22T08:40:11.833416+0000","last_peered":"2024-09-22T08:40:11.833416+0000","last_clean":"2024-09-22T08:40:11.833416+0000","last_became_active":"2024-09-22T08:36:25.984037+0000","last_became_peered":"2024-09-22T08:36:25.984037+0000","last_unstale":"2024-09-22T08:40:11.833416+0000","last_undegraded":"2024-09-22T08:40:11.833416+0000","last_fullsized":"2024-09-22T08:40:11.833416+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-22T08:40:11.833329+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-22T08:40:11.833329+0000","last_clean_scrub_stamp":"2024-09-22T08:40:11.833329+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:13:05.009738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"32'2","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:56.237269+0000","last_change":"2024-09-22T08:39:56.237269+0000","last_active":"2024-09-22T08:39:56.237269+0000","last_peered":"2024-09-22T08:39:56.237269+0000","last_clean":"2024-09-22T08:39:56.237269+0000","last_became_active":"2024-09-22T08:36:23.969183+0000","last_became_peered":"2024-09-22T08:36:23.969183+0000","last_unstale":"2024-09-22T08:39:56.237269+0000","last_undegraded":"2024-09-22T08:39:56.237269+0000","last_fullsized":"2024-09-22T08:39:56.237269+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-22T08:39:56.237185+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-22T08:39:56.237185+0000","last_clean_scrub_stamp":"2024-09-22T08:39:56.237185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:26:53.537080+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"32'18","reported_seq":75,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:08.416216+0000","last_change":"2024-09-22T08:40:08.416216+0000","last_active":"2024-09-22T08:40:08.416216+0000","last_peered":"2024-09-22T08:40:08.416216+0000","last_clean":"2024-09-22T08:40:08.416216+0000","last_became_active":"2024-09-22T08:36:25.985797+0000","last_became_peered":"2024-09-22T08:36:25.985797+0000","last_unstale":"2024-09-22T08:40:08.416216+0000","last_undegraded":"2024-09-22T08:40:08.416216+0000","last_fullsized":"2024-09-22T08:40:08.416216+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'18","last_scrub_stamp":"2024-09-22T08:40:08.416117+0000","last_deep_scrub":"32'18","last_deep_scrub_stamp":"2024-09-22T08:40:08.416117+0000","last_clean_scrub_stamp":"2024-09-22T08:40:08.416117+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:55:55.096190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":61,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:56.863666+0000","last_change":"2024-09-22T08:39:56.863666+0000","last_active":"2024-09-22T08:39:56.863666+0000","last_peered":"2024-09-22T08:39:56.863666+0000","last_clean":"2024-09-22T08:39:56.863666+0000","last_became_active":"2024-09-22T08:36:23.974359+0000","last_became_peered":"2024-09-22T08:36:23.974359+0000","last_unstale":"2024-09-22T08:39:56.863666+0000","last_undegraded":"2024-09-22T08:39:56.863666+0000","last_fullsized":"2024-09-22T08:39:56.863666+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-22T08:39:56.863584+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-22T08:39:56.863584+0000","last_clean_scrub_stamp":"2024-09-22T08:39:56.863584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:41:23.122061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"32'16","reported_seq":70,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:13.382482+0000","last_change":"2024-09-22T08:40:13.382482+0000","last_active":"2024-09-22T08:40:13.382482+0000","last_peered":"2024-09-22T08:40:13.382482+0000","last_clean":"2024-09-22T08:40:13.382482+0000","last_became_active":"2024-09-22T08:36:25.977320+0000","last_became_peered":"2024-09-22T08:36:25.977320+0000","last_unstale":"2024-09-22T08:40:13.382482+0000","last_undegraded":"2024-09-22T08:40:13.382482+0000","last_fullsized":"2024-09-22T08:40:13.382482+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'16","last_scrub_stamp":"2024-09-22T08:40:13.382400+0000","last_deep_scrub":"32'16","last_deep_scrub_stamp":"2024-09-22T08:40:13.382400+0000","last_clean_scrub_stamp":"2024-09-22T08:40:13.382400+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:13:53.645578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":49,"num_write":21,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"32'2","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:07.381293+0000","last_change":"2024-09-22T08:40:07.381293+0000","last_active":"2024-09-22T08:40:07.381293+0000","last_peered":"2024-09-22T08:40:07.381293+0000","last_clean":"2024-09-22T08:40:07.381293+0000","last_became_active":"2024-09-22T08:36:23.980189+0000","last_became_peered":"2024-09-22T08:36:23.980189+0000","last_unstale":"2024-09-22T08:40:07.381293+0000","last_undegraded":"2024-09-22T08:40:07.381293+0000","last_fullsized":"2024-09-22T08:40:07.381293+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-22T08:40:07.381185+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-22T08:40:07.381185+0000","last_clean_scrub_stamp":"2024-09-22T08:40:07.381185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:45:20.018380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"32'35","reported_seq":100,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.238012+0000","last_change":"2024-09-22T08:36:34.015950+0000","last_active":"2024-09-22T08:39:32.238012+0000","last_peered":"2024-09-22T08:39:32.238012+0000","last_clean":"2024-09-22T08:39:32.238012+0000","last_became_active":"2024-09-22T08:36:34.015696+0000","last_became_peered":"2024-09-22T08:36:34.015696+0000","last_unstale":"2024-09-22T08:39:32.238012+0000","last_undegraded":"2024-09-22T08:39:32.238012+0000","last_fullsized":"2024-09-22T08:39:32.238012+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:48:07.077185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":173,"num_read_kb":173,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"32'6","reported_seq":61,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:13.437831+0000","last_change":"2024-09-22T08:40:13.437831+0000","last_active":"2024-09-22T08:40:13.437831+0000","last_peered":"2024-09-22T08:40:13.437831+0000","last_clean":"2024-09-22T08:40:13.437831+0000","last_became_active":"2024-09-22T08:36:25.987811+0000","last_became_peered":"2024-09-22T08:36:25.987811+0000","last_unstale":"2024-09-22T08:40:13.437831+0000","last_undegraded":"2024-09-22T08:40:13.437831+0000","last_fullsized":"2024-09-22T08:40:13.437831+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-22T08:40:13.437749+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-22T08:40:13.437749+0000","last_clean_scrub_stamp":"2024-09-22T08:40:13.437749+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:42:52.209301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:52.378512+0000","last_change":"2024-09-22T08:39:52.378512+0000","last_active":"2024-09-22T08:39:52.378512+0000","last_peered":"2024-09-22T08:39:52.378512+0000","last_clean":"2024-09-22T08:39:52.378512+0000","last_became_active":"2024-09-22T08:36:23.982423+0000","last_became_peered":"2024-09-22T08:36:23.982423+0000","last_unstale":"2024-09-22T08:39:52.378512+0000","last_undegraded":"2024-09-22T08:39:52.378512+0000","last_fullsized":"2024-09-22T08:39:52.378512+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:39:52.378424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:39:52.378424+0000","last_clean_scrub_stamp":"2024-09-22T08:39:52.378424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:48:16.834018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.230626+0000","last_change":"2024-09-22T08:36:27.988469+0000","last_active":"2024-09-22T08:37:04.230626+0000","last_peered":"2024-09-22T08:37:04.230626+0000","last_clean":"2024-09-22T08:37:04.230626+0000","last_became_active":"2024-09-22T08:36:27.988057+0000","last_became_peered":"2024-09-22T08:36:27.988057+0000","last_unstale":"2024-09-22T08:37:04.230626+0000","last_undegraded":"2024-09-22T08:37:04.230626+0000","last_fullsized":"2024-09-22T08:37:04.230626+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_clean_scrub_stamp":"2024-09-22T08:36:26.962226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:51:33.578609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"32'33","reported_seq":80,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:38.945435+0000","last_change":"2024-09-22T08:36:29.995218+0000","last_active":"2024-09-22T08:39:38.945435+0000","last_peered":"2024-09-22T08:39:38.945435+0000","last_clean":"2024-09-22T08:39:38.945435+0000","last_became_active":"2024-09-22T08:36:29.994881+0000","last_became_peered":"2024-09-22T08:36:29.994881+0000","last_unstale":"2024-09-22T08:39:38.945435+0000","last_undegraded":"2024-09-22T08:39:38.945435+0000","last_fullsized":"2024-09-22T08:39:38.945435+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:46:41.834484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.223889+0000","last_change":"2024-09-22T08:36:32.013521+0000","last_active":"2024-09-22T08:37:04.223889+0000","last_peered":"2024-09-22T08:37:04.223889+0000","last_clean":"2024-09-22T08:37:04.223889+0000","last_became_active":"2024-09-22T08:36:32.013249+0000","last_became_peered":"2024-09-22T08:36:32.013249+0000","last_unstale":"2024-09-22T08:37:04.223889+0000","last_undegraded":"2024-09-22T08:37:04.223889+0000","last_fullsized":"2024-09-22T08:37:04.223889+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:35:20.008672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"32'7","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:47.949724+0000","last_change":"2024-09-22T08:36:34.015432+0000","last_active":"2024-09-22T08:37:47.949724+0000","last_peered":"2024-09-22T08:37:47.949724+0000","last_clean":"2024-09-22T08:37:47.949724+0000","last_became_active":"2024-09-22T08:36:34.015170+0000","last_became_peered":"2024-09-22T08:36:34.015170+0000","last_unstale":"2024-09-22T08:37:47.949724+0000","last_undegraded":"2024-09-22T08:37:47.949724+0000","last_fullsized":"2024-09-22T08:37:47.949724+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:45:21.601440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"32'2","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:14.450214+0000","last_change":"2024-09-22T08:40:14.450214+0000","last_active":"2024-09-22T08:40:14.450214+0000","last_peered":"2024-09-22T08:40:14.450214+0000","last_clean":"2024-09-22T08:40:14.450214+0000","last_became_active":"2024-09-22T08:36:25.989583+0000","last_became_peered":"2024-09-22T08:36:25.989583+0000","last_unstale":"2024-09-22T08:40:14.450214+0000","last_undegraded":"2024-09-22T08:40:14.450214+0000","last_fullsized":"2024-09-22T08:40:14.450214+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-22T08:40:14.450079+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-22T08:40:14.450079+0000","last_clean_scrub_stamp":"2024-09-22T08:40:14.450079+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:50:05.715618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"32'2","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:50.670046+0000","last_change":"2024-09-22T08:39:50.670046+0000","last_active":"2024-09-22T08:39:50.670046+0000","last_peered":"2024-09-22T08:39:50.670046+0000","last_clean":"2024-09-22T08:39:50.670046+0000","last_became_active":"2024-09-22T08:36:23.973716+0000","last_became_peered":"2024-09-22T08:36:23.973716+0000","last_unstale":"2024-09-22T08:39:50.670046+0000","last_undegraded":"2024-09-22T08:39:50.670046+0000","last_fullsized":"2024-09-22T08:39:50.670046+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-22T08:39:50.669969+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-22T08:39:50.669969+0000","last_clean_scrub_stamp":"2024-09-22T08:39:50.669969+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:51:53.477798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:05.167417+0000","last_change":"2024-09-22T08:37:04.229482+0000","last_active":"2024-09-22T08:37:05.167417+0000","last_peered":"2024-09-22T08:37:05.167417+0000","last_clean":"2024-09-22T08:37:05.167417+0000","last_became_active":"2024-09-22T08:37:04.229132+0000","last_became_peered":"2024-09-22T08:37:04.229132+0000","last_unstale":"2024-09-22T08:37:05.167417+0000","last_undegraded":"2024-09-22T08:37:05.167417+0000","last_fullsized":"2024-09-22T08:37:05.167417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_clean_scrub_stamp":"2024-09-22T08:36:26.962226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:30:09.128950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"30'6","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.223977+0000","last_change":"2024-09-22T08:36:29.991280+0000","last_active":"2024-09-22T08:37:04.223977+0000","last_peered":"2024-09-22T08:37:04.223977+0000","last_clean":"2024-09-22T08:37:04.223977+0000","last_became_active":"2024-09-22T08:36:29.990998+0000","last_became_peered":"2024-09-22T08:36:29.990998+0000","last_unstale":"2024-09-22T08:37:04.223977+0000","last_undegraded":"2024-09-22T08:37:04.223977+0000","last_fullsized":"2024-09-22T08:37:04.223977+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:36:37.998945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.222725+0000","last_change":"2024-09-22T08:36:32.006443+0000","last_active":"2024-09-22T08:37:04.222725+0000","last_peered":"2024-09-22T08:37:04.222725+0000","last_clean":"2024-09-22T08:37:04.222725+0000","last_became_active":"2024-09-22T08:36:32.006161+0000","last_became_peered":"2024-09-22T08:36:32.006161+0000","last_unstale":"2024-09-22T08:37:04.222725+0000","last_undegraded":"2024-09-22T08:37:04.222725+0000","last_fullsized":"2024-09-22T08:37:04.222725+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:39:07.614953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"30'2","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.223331+0000","last_change":"2024-09-22T08:36:34.017093+0000","last_active":"2024-09-22T08:37:04.223331+0000","last_peered":"2024-09-22T08:37:04.223331+0000","last_clean":"2024-09-22T08:37:04.223331+0000","last_became_active":"2024-09-22T08:36:34.016749+0000","last_became_peered":"2024-09-22T08:36:34.016749+0000","last_unstale":"2024-09-22T08:37:04.223331+0000","last_undegraded":"2024-09-22T08:37:04.223331+0000","last_fullsized":"2024-09-22T08:37:04.223331+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:18:00.649317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"32'8","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:16.461402+0000","last_change":"2024-09-22T08:40:16.461402+0000","last_active":"2024-09-22T08:40:16.461402+0000","last_peered":"2024-09-22T08:40:16.461402+0000","last_clean":"2024-09-22T08:40:16.461402+0000","last_became_active":"2024-09-22T08:36:25.987860+0000","last_became_peered":"2024-09-22T08:36:25.987860+0000","last_unstale":"2024-09-22T08:40:16.461402+0000","last_undegraded":"2024-09-22T08:40:16.461402+0000","last_fullsized":"2024-09-22T08:40:16.461402+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-22T08:40:16.461252+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-22T08:40:16.461252+0000","last_clean_scrub_stamp":"2024-09-22T08:40:16.461252+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:08:26.205157+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:54.365627+0000","last_change":"2024-09-22T08:39:54.365627+0000","last_active":"2024-09-22T08:39:54.365627+0000","last_peered":"2024-09-22T08:39:54.365627+0000","last_clean":"2024-09-22T08:39:54.365627+0000","last_became_active":"2024-09-22T08:36:23.979201+0000","last_became_peered":"2024-09-22T08:36:23.979201+0000","last_unstale":"2024-09-22T08:39:54.365627+0000","last_undegraded":"2024-09-22T08:39:54.365627+0000","last_fullsized":"2024-09-22T08:39:54.365627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:39:54.365537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:39:54.365537+0000","last_clean_scrub_stamp":"2024-09-22T08:39:54.365537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:12:06.963553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:18.892804+0000","last_change":"2024-09-22T08:40:18.892804+0000","last_active":"2024-09-22T08:40:18.892804+0000","last_peered":"2024-09-22T08:40:18.892804+0000","last_clean":"2024-09-22T08:40:18.892804+0000","last_became_active":"2024-09-22T08:36:27.987410+0000","last_became_peered":"2024-09-22T08:36:27.987410+0000","last_unstale":"2024-09-22T08:40:18.892804+0000","last_undegraded":"2024-09-22T08:40:18.892804+0000","last_fullsized":"2024-09-22T08:40:18.892804+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:18.892720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:18.892720+0000","last_clean_scrub_stamp":"2024-09-22T08:40:18.892720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:35:19.353672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"30'10","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.227501+0000","last_change":"2024-09-22T08:36:29.999655+0000","last_active":"2024-09-22T08:37:04.227501+0000","last_peered":"2024-09-22T08:37:04.227501+0000","last_clean":"2024-09-22T08:37:04.227501+0000","last_became_active":"2024-09-22T08:36:29.999306+0000","last_became_peered":"2024-09-22T08:36:29.999306+0000","last_unstale":"2024-09-22T08:37:04.227501+0000","last_undegraded":"2024-09-22T08:37:04.227501+0000","last_fullsized":"2024-09-22T08:37:04.227501+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:27:58.333399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"32'285","reported_seq":418,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:38.824267+0000","last_change":"2024-09-22T08:36:32.014175+0000","last_active":"2024-09-22T08:39:38.824267+0000","last_peered":"2024-09-22T08:39:38.824267+0000","last_clean":"2024-09-22T08:39:38.824267+0000","last_became_active":"2024-09-22T08:36:32.013869+0000","last_became_peered":"2024-09-22T08:36:32.013869+0000","last_unstale":"2024-09-22T08:39:38.824267+0000","last_undegraded":"2024-09-22T08:39:38.824267+0000","last_fullsized":"2024-09-22T08:39:38.824267+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:23:53.788685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.224121+0000","last_change":"2024-09-22T08:36:34.016273+0000","last_active":"2024-09-22T08:37:04.224121+0000","last_peered":"2024-09-22T08:37:04.224121+0000","last_clean":"2024-09-22T08:37:04.224121+0000","last_became_active":"2024-09-22T08:36:34.015999+0000","last_became_peered":"2024-09-22T08:36:34.015999+0000","last_unstale":"2024-09-22T08:37:04.224121+0000","last_undegraded":"2024-09-22T08:37:04.224121+0000","last_fullsized":"2024-09-22T08:37:04.224121+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:19:59.334082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"30'4","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:02.829539+0000","last_change":"2024-09-22T08:40:02.829539+0000","last_active":"2024-09-22T08:40:02.829539+0000","last_peered":"2024-09-22T08:40:02.829539+0000","last_clean":"2024-09-22T08:40:02.829539+0000","last_became_active":"2024-09-22T08:36:25.979320+0000","last_became_peered":"2024-09-22T08:36:25.979320+0000","last_unstale":"2024-09-22T08:40:02.829539+0000","last_undegraded":"2024-09-22T08:40:02.829539+0000","last_fullsized":"2024-09-22T08:40:02.829539+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'4","last_scrub_stamp":"2024-09-22T08:40:02.829450+0000","last_deep_scrub":"30'4","last_deep_scrub_stamp":"2024-09-22T08:40:02.829450+0000","last_clean_scrub_stamp":"2024-09-22T08:40:02.829450+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:25:40.999415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:45.068211+0000","last_change":"2024-09-22T08:39:45.068211+0000","last_active":"2024-09-22T08:39:45.068211+0000","last_peered":"2024-09-22T08:39:45.068211+0000","last_clean":"2024-09-22T08:39:45.068211+0000","last_became_active":"2024-09-22T08:36:23.975428+0000","last_became_peered":"2024-09-22T08:36:23.975428+0000","last_unstale":"2024-09-22T08:39:45.068211+0000","last_undegraded":"2024-09-22T08:39:45.068211+0000","last_fullsized":"2024-09-22T08:39:45.068211+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:39:45.068115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:39:45.068115+0000","last_clean_scrub_stamp":"2024-09-22T08:39:45.068115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:04:18.711452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.227129+0000","last_change":"2024-09-22T08:36:27.985020+0000","last_active":"2024-09-22T08:37:04.227129+0000","last_peered":"2024-09-22T08:37:04.227129+0000","last_clean":"2024-09-22T08:37:04.227129+0000","last_became_active":"2024-09-22T08:36:27.984658+0000","last_became_peered":"2024-09-22T08:36:27.984658+0000","last_unstale":"2024-09-22T08:37:04.227129+0000","last_undegraded":"2024-09-22T08:37:04.227129+0000","last_fullsized":"2024-09-22T08:37:04.227129+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_clean_scrub_stamp":"2024-09-22T08:36:26.962226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:55:24.622399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"32'33","reported_seq":80,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:38.929884+0000","last_change":"2024-09-22T08:36:30.000958+0000","last_active":"2024-09-22T08:39:38.929884+0000","last_peered":"2024-09-22T08:39:38.929884+0000","last_clean":"2024-09-22T08:39:38.929884+0000","last_became_active":"2024-09-22T08:36:30.000641+0000","last_became_peered":"2024-09-22T08:36:30.000641+0000","last_unstale":"2024-09-22T08:39:38.929884+0000","last_undegraded":"2024-09-22T08:39:38.929884+0000","last_fullsized":"2024-09-22T08:39:38.929884+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:44:23.505173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"32'285","reported_seq":427,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:38.829148+0000","last_change":"2024-09-22T08:36:32.005447+0000","last_active":"2024-09-22T08:39:38.829148+0000","last_peered":"2024-09-22T08:39:38.829148+0000","last_clean":"2024-09-22T08:39:38.829148+0000","last_became_active":"2024-09-22T08:36:32.005012+0000","last_became_peered":"2024-09-22T08:36:32.005012+0000","last_unstale":"2024-09-22T08:39:38.829148+0000","last_undegraded":"2024-09-22T08:39:38.829148+0000","last_fullsized":"2024-09-22T08:39:38.829148+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:31:41.609654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"32'4","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:12.437028+0000","last_change":"2024-09-22T08:40:12.437028+0000","last_active":"2024-09-22T08:40:12.437028+0000","last_peered":"2024-09-22T08:40:12.437028+0000","last_clean":"2024-09-22T08:40:12.437028+0000","last_became_active":"2024-09-22T08:36:25.989940+0000","last_became_peered":"2024-09-22T08:36:25.989940+0000","last_unstale":"2024-09-22T08:40:12.437028+0000","last_undegraded":"2024-09-22T08:40:12.437028+0000","last_fullsized":"2024-09-22T08:40:12.437028+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-22T08:40:12.436939+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-22T08:40:12.436939+0000","last_clean_scrub_stamp":"2024-09-22T08:40:12.436939+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:59:47.804661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:46.601168+0000","last_change":"2024-09-22T08:39:46.601168+0000","last_active":"2024-09-22T08:39:46.601168+0000","last_peered":"2024-09-22T08:39:46.601168+0000","last_clean":"2024-09-22T08:39:46.601168+0000","last_became_active":"2024-09-22T08:36:23.970093+0000","last_became_peered":"2024-09-22T08:36:23.970093+0000","last_unstale":"2024-09-22T08:39:46.601168+0000","last_undegraded":"2024-09-22T08:39:46.601168+0000","last_fullsized":"2024-09-22T08:39:46.601168+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:39:46.601074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:39:46.601074+0000","last_clean_scrub_stamp":"2024-09-22T08:39:46.601074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:08:12.326140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:18.296552+0000","last_change":"2024-09-22T08:40:18.296552+0000","last_active":"2024-09-22T08:40:18.296552+0000","last_peered":"2024-09-22T08:40:18.296552+0000","last_clean":"2024-09-22T08:40:18.296552+0000","last_became_active":"2024-09-22T08:36:27.986734+0000","last_became_peered":"2024-09-22T08:36:27.986734+0000","last_unstale":"2024-09-22T08:40:18.296552+0000","last_undegraded":"2024-09-22T08:40:18.296552+0000","last_fullsized":"2024-09-22T08:40:18.296552+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:18.296463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:18.296463+0000","last_clean_scrub_stamp":"2024-09-22T08:40:18.296463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:16:18.206096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"32'52","reported_seq":112,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:17.437571+0000","last_change":"2024-09-22T08:40:17.437571+0000","last_active":"2024-09-22T08:40:17.437571+0000","last_peered":"2024-09-22T08:40:17.437571+0000","last_clean":"2024-09-22T08:40:17.437571+0000","last_became_active":"2024-09-22T08:36:29.990809+0000","last_became_peered":"2024-09-22T08:36:29.990809+0000","last_unstale":"2024-09-22T08:40:17.437571+0000","last_undegraded":"2024-09-22T08:40:17.437571+0000","last_fullsized":"2024-09-22T08:40:17.437571+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'52","last_scrub_stamp":"2024-09-22T08:40:17.437457+0000","last_deep_scrub":"32'52","last_deep_scrub_stamp":"2024-09-22T08:40:17.437457+0000","last_clean_scrub_stamp":"2024-09-22T08:40:17.437457+0000","objects_scrubbed":9,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:50:34.481525+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.224144+0000","last_change":"2024-09-22T08:36:32.004096+0000","last_active":"2024-09-22T08:37:04.224144+0000","last_peered":"2024-09-22T08:37:04.224144+0000","last_clean":"2024-09-22T08:37:04.224144+0000","last_became_active":"2024-09-22T08:36:32.003726+0000","last_became_peered":"2024-09-22T08:36:32.003726+0000","last_unstale":"2024-09-22T08:37:04.224144+0000","last_undegraded":"2024-09-22T08:37:04.224144+0000","last_fullsized":"2024-09-22T08:37:04.224144+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:58:37.810092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"32'5","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:48.125865+0000","last_change":"2024-09-22T08:36:34.022748+0000","last_active":"2024-09-22T08:37:48.125865+0000","last_peered":"2024-09-22T08:37:48.125865+0000","last_clean":"2024-09-22T08:37:48.125865+0000","last_became_active":"2024-09-22T08:36:34.022448+0000","last_became_peered":"2024-09-22T08:36:34.022448+0000","last_unstale":"2024-09-22T08:37:48.125865+0000","last_undegraded":"2024-09-22T08:37:48.125865+0000","last_fullsized":"2024-09-22T08:37:48.125865+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:39:09.622561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":13,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"32'10","reported_seq":67,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:00.348098+0000","last_change":"2024-09-22T08:40:00.348098+0000","last_active":"2024-09-22T08:40:00.348098+0000","last_peered":"2024-09-22T08:40:00.348098+0000","last_clean":"2024-09-22T08:40:00.348098+0000","last_became_active":"2024-09-22T08:36:25.975728+0000","last_became_peered":"2024-09-22T08:36:25.975728+0000","last_unstale":"2024-09-22T08:40:00.348098+0000","last_undegraded":"2024-09-22T08:40:00.348098+0000","last_fullsized":"2024-09-22T08:40:00.348098+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-09-22T08:40:00.348005+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-09-22T08:40:00.348005+0000","last_clean_scrub_stamp":"2024-09-22T08:40:00.348005+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:50:17.392073+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:47.621398+0000","last_change":"2024-09-22T08:39:47.621398+0000","last_active":"2024-09-22T08:39:47.621398+0000","last_peered":"2024-09-22T08:39:47.621398+0000","last_clean":"2024-09-22T08:39:47.621398+0000","last_became_active":"2024-09-22T08:36:23.968836+0000","last_became_peered":"2024-09-22T08:36:23.968836+0000","last_unstale":"2024-09-22T08:39:47.621398+0000","last_undegraded":"2024-09-22T08:39:47.621398+0000","last_fullsized":"2024-09-22T08:39:47.621398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-22T08:39:47.621313+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-22T08:39:47.621313+0000","last_clean_scrub_stamp":"2024-09-22T08:39:47.621313+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:26:56.822278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:14.829193+0000","last_change":"2024-09-22T08:40:14.829193+0000","last_active":"2024-09-22T08:40:14.829193+0000","last_peered":"2024-09-22T08:40:14.829193+0000","last_clean":"2024-09-22T08:40:14.829193+0000","last_became_active":"2024-09-22T08:36:27.987577+0000","last_became_peered":"2024-09-22T08:36:27.987577+0000","last_unstale":"2024-09-22T08:40:14.829193+0000","last_undegraded":"2024-09-22T08:40:14.829193+0000","last_fullsized":"2024-09-22T08:40:14.829193+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:14.829090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:14.829090+0000","last_clean_scrub_stamp":"2024-09-22T08:40:14.829090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:13:09.683686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"32'34","reported_seq":81,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:38.899450+0000","last_change":"2024-09-22T08:36:29.995394+0000","last_active":"2024-09-22T08:39:38.899450+0000","last_peered":"2024-09-22T08:39:38.899450+0000","last_clean":"2024-09-22T08:39:38.899450+0000","last_became_active":"2024-09-22T08:36:29.994921+0000","last_became_peered":"2024-09-22T08:36:29.994921+0000","last_unstale":"2024-09-22T08:39:38.899450+0000","last_undegraded":"2024-09-22T08:39:38.899450+0000","last_fullsized":"2024-09-22T08:39:38.899450+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:00:36.656901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.223384+0000","last_change":"2024-09-22T08:36:32.004634+0000","last_active":"2024-09-22T08:37:04.223384+0000","last_peered":"2024-09-22T08:37:04.223384+0000","last_clean":"2024-09-22T08:37:04.223384+0000","last_became_active":"2024-09-22T08:36:32.004269+0000","last_became_peered":"2024-09-22T08:36:32.004269+0000","last_unstale":"2024-09-22T08:37:04.223384+0000","last_undegraded":"2024-09-22T08:37:04.223384+0000","last_fullsized":"2024-09-22T08:37:04.223384+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:51:32.910644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"32'3","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:42.431386+0000","last_change":"2024-09-22T08:36:34.018431+0000","last_active":"2024-09-22T08:37:42.431386+0000","last_peered":"2024-09-22T08:37:42.431386+0000","last_clean":"2024-09-22T08:37:42.431386+0000","last_became_active":"2024-09-22T08:36:34.018190+0000","last_became_peered":"2024-09-22T08:36:34.018190+0000","last_unstale":"2024-09-22T08:37:42.431386+0000","last_undegraded":"2024-09-22T08:37:42.431386+0000","last_fullsized":"2024-09-22T08:37:42.431386+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:09:42.876400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"32'4","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:55.624374+0000","last_change":"2024-09-22T08:39:55.624374+0000","last_active":"2024-09-22T08:39:55.624374+0000","last_peered":"2024-09-22T08:39:55.624374+0000","last_clean":"2024-09-22T08:39:55.624374+0000","last_became_active":"2024-09-22T08:36:25.983073+0000","last_became_peered":"2024-09-22T08:36:25.983073+0000","last_unstale":"2024-09-22T08:39:55.624374+0000","last_undegraded":"2024-09-22T08:39:55.624374+0000","last_fullsized":"2024-09-22T08:39:55.624374+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-22T08:39:55.624297+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-22T08:39:55.624297+0000","last_clean_scrub_stamp":"2024-09-22T08:39:55.624297+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:20:43.093379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:53.406759+0000","last_change":"2024-09-22T08:39:53.406759+0000","last_active":"2024-09-22T08:39:53.406759+0000","last_peered":"2024-09-22T08:39:53.406759+0000","last_clean":"2024-09-22T08:39:53.406759+0000","last_became_active":"2024-09-22T08:36:23.980682+0000","last_became_peered":"2024-09-22T08:36:23.980682+0000","last_unstale":"2024-09-22T08:39:53.406759+0000","last_undegraded":"2024-09-22T08:39:53.406759+0000","last_fullsized":"2024-09-22T08:39:53.406759+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-22T08:39:53.406674+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-22T08:39:53.406674+0000","last_clean_scrub_stamp":"2024-09-22T08:39:53.406674+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:08:41.063816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:16.832193+0000","last_change":"2024-09-22T08:40:16.832193+0000","last_active":"2024-09-22T08:40:16.832193+0000","last_peered":"2024-09-22T08:40:16.832193+0000","last_clean":"2024-09-22T08:40:16.832193+0000","last_became_active":"2024-09-22T08:36:27.985675+0000","last_became_peered":"2024-09-22T08:36:27.985675+0000","last_unstale":"2024-09-22T08:40:16.832193+0000","last_undegraded":"2024-09-22T08:40:16.832193+0000","last_fullsized":"2024-09-22T08:40:16.832193+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:16.832115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:16.832115+0000","last_clean_scrub_stamp":"2024-09-22T08:40:16.832115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:49:05.088114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"32'41","reported_seq":91,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:38.968651+0000","last_change":"2024-09-22T08:36:29.998080+0000","last_active":"2024-09-22T08:39:38.968651+0000","last_peered":"2024-09-22T08:39:38.968651+0000","last_clean":"2024-09-22T08:39:38.968651+0000","last_became_active":"2024-09-22T08:36:29.997542+0000","last_became_peered":"2024-09-22T08:36:29.997542+0000","last_unstale":"2024-09-22T08:39:38.968651+0000","last_undegraded":"2024-09-22T08:39:38.968651+0000","last_fullsized":"2024-09-22T08:39:38.968651+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:42:31.088070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"32'285","reported_seq":351,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:38.830255+0000","last_change":"2024-09-22T08:36:32.005012+0000","last_active":"2024-09-22T08:39:38.830255+0000","last_peered":"2024-09-22T08:39:38.830255+0000","last_clean":"2024-09-22T08:39:38.830255+0000","last_became_active":"2024-09-22T08:36:32.004441+0000","last_became_peered":"2024-09-22T08:36:32.004441+0000","last_unstale":"2024-09-22T08:39:38.830255+0000","last_undegraded":"2024-09-22T08:39:38.830255+0000","last_fullsized":"2024-09-22T08:39:38.830255+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:10:54.748229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.225164+0000","last_change":"2024-09-22T08:36:34.017600+0000","last_active":"2024-09-22T08:37:04.225164+0000","last_peered":"2024-09-22T08:37:04.225164+0000","last_clean":"2024-09-22T08:37:04.225164+0000","last_became_active":"2024-09-22T08:36:34.017217+0000","last_became_peered":"2024-09-22T08:36:34.017217+0000","last_unstale":"2024-09-22T08:37:04.225164+0000","last_undegraded":"2024-09-22T08:37:04.225164+0000","last_fullsized":"2024-09-22T08:37:04.225164+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:43:08.076327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"32'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:56.576672+0000","last_change":"2024-09-22T08:39:56.576672+0000","last_active":"2024-09-22T08:39:56.576672+0000","last_peered":"2024-09-22T08:39:56.576672+0000","last_clean":"2024-09-22T08:39:56.576672+0000","last_became_active":"2024-09-22T08:36:25.972198+0000","last_became_peered":"2024-09-22T08:36:25.972198+0000","last_unstale":"2024-09-22T08:39:56.576672+0000","last_undegraded":"2024-09-22T08:39:56.576672+0000","last_fullsized":"2024-09-22T08:39:56.576672+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-22T08:39:56.576591+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-22T08:39:56.576591+0000","last_clean_scrub_stamp":"2024-09-22T08:39:56.576591+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:19:21.946421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:55.322922+0000","last_change":"2024-09-22T08:39:55.322922+0000","last_active":"2024-09-22T08:39:55.322922+0000","last_peered":"2024-09-22T08:39:55.322922+0000","last_clean":"2024-09-22T08:39:55.322922+0000","last_became_active":"2024-09-22T08:36:23.978306+0000","last_became_peered":"2024-09-22T08:36:23.978306+0000","last_unstale":"2024-09-22T08:39:55.322922+0000","last_undegraded":"2024-09-22T08:39:55.322922+0000","last_fullsized":"2024-09-22T08:39:55.322922+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:39:55.322811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:39:55.322811+0000","last_clean_scrub_stamp":"2024-09-22T08:39:55.322811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:44:43.243059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:15.861620+0000","last_change":"2024-09-22T08:40:15.861620+0000","last_active":"2024-09-22T08:40:15.861620+0000","last_peered":"2024-09-22T08:40:15.861620+0000","last_clean":"2024-09-22T08:40:15.861620+0000","last_became_active":"2024-09-22T08:36:27.985751+0000","last_became_peered":"2024-09-22T08:36:27.985751+0000","last_unstale":"2024-09-22T08:40:15.861620+0000","last_undegraded":"2024-09-22T08:40:15.861620+0000","last_fullsized":"2024-09-22T08:40:15.861620+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:15.861527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:15.861527+0000","last_clean_scrub_stamp":"2024-09-22T08:40:15.861527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:35:09.030569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"32'61","reported_seq":126,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:38.907852+0000","last_change":"2024-09-22T08:36:29.995500+0000","last_active":"2024-09-22T08:39:38.907852+0000","last_peered":"2024-09-22T08:39:38.907852+0000","last_clean":"2024-09-22T08:39:38.907852+0000","last_became_active":"2024-09-22T08:36:29.995225+0000","last_became_peered":"2024-09-22T08:36:29.995225+0000","last_unstale":"2024-09-22T08:39:38.907852+0000","last_undegraded":"2024-09-22T08:39:38.907852+0000","last_fullsized":"2024-09-22T08:39:38.907852+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:06:45.130197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.223232+0000","last_change":"2024-09-22T08:36:32.003118+0000","last_active":"2024-09-22T08:37:04.223232+0000","last_peered":"2024-09-22T08:37:04.223232+0000","last_clean":"2024-09-22T08:37:04.223232+0000","last_became_active":"2024-09-22T08:36:32.002833+0000","last_became_peered":"2024-09-22T08:36:32.002833+0000","last_unstale":"2024-09-22T08:37:04.223232+0000","last_undegraded":"2024-09-22T08:37:04.223232+0000","last_fullsized":"2024-09-22T08:37:04.223232+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:35:19.477576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"32'18","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.383653+0000","last_change":"2024-09-22T08:36:34.015160+0000","last_active":"2024-09-22T08:39:32.383653+0000","last_peered":"2024-09-22T08:39:32.383653+0000","last_clean":"2024-09-22T08:39:32.383653+0000","last_became_active":"2024-09-22T08:36:34.014853+0000","last_became_peered":"2024-09-22T08:36:34.014853+0000","last_unstale":"2024-09-22T08:39:32.383653+0000","last_undegraded":"2024-09-22T08:39:32.383653+0000","last_fullsized":"2024-09-22T08:39:32.383653+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:14:47.722976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"32'12","reported_seq":78,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:01.359189+0000","last_change":"2024-09-22T08:40:01.359189+0000","last_active":"2024-09-22T08:40:01.359189+0000","last_peered":"2024-09-22T08:40:01.359189+0000","last_clean":"2024-09-22T08:40:01.359189+0000","last_became_active":"2024-09-22T08:36:25.977682+0000","last_became_peered":"2024-09-22T08:36:25.977682+0000","last_unstale":"2024-09-22T08:40:01.359189+0000","last_undegraded":"2024-09-22T08:40:01.359189+0000","last_fullsized":"2024-09-22T08:40:01.359189+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-09-22T08:40:01.359074+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-09-22T08:40:01.359074+0000","last_clean_scrub_stamp":"2024-09-22T08:40:01.359074+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:56:45.036758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":47,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:46.788116+0000","last_change":"2024-09-22T08:39:46.788116+0000","last_active":"2024-09-22T08:39:46.788116+0000","last_peered":"2024-09-22T08:39:46.788116+0000","last_clean":"2024-09-22T08:39:46.788116+0000","last_became_active":"2024-09-22T08:36:23.972822+0000","last_became_peered":"2024-09-22T08:36:23.972822+0000","last_unstale":"2024-09-22T08:39:46.788116+0000","last_undegraded":"2024-09-22T08:39:46.788116+0000","last_fullsized":"2024-09-22T08:39:46.788116+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:39:46.788026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:39:46.788026+0000","last_clean_scrub_stamp":"2024-09-22T08:39:46.788026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:10:40.958015+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:11.369383+0000","last_change":"2024-09-22T08:40:11.369383+0000","last_active":"2024-09-22T08:40:11.369383+0000","last_peered":"2024-09-22T08:40:11.369383+0000","last_clean":"2024-09-22T08:40:11.369383+0000","last_became_active":"2024-09-22T08:36:27.991761+0000","last_became_peered":"2024-09-22T08:36:27.991761+0000","last_unstale":"2024-09-22T08:40:11.369383+0000","last_undegraded":"2024-09-22T08:40:11.369383+0000","last_fullsized":"2024-09-22T08:40:11.369383+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:11.369297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:11.369297+0000","last_clean_scrub_stamp":"2024-09-22T08:40:11.369297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:02:18.578080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"32'35","reported_seq":83,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:38.910893+0000","last_change":"2024-09-22T08:36:29.988696+0000","last_active":"2024-09-22T08:39:38.910893+0000","last_peered":"2024-09-22T08:39:38.910893+0000","last_clean":"2024-09-22T08:39:38.910893+0000","last_became_active":"2024-09-22T08:36:29.988363+0000","last_became_peered":"2024-09-22T08:36:29.988363+0000","last_unstale":"2024-09-22T08:39:38.910893+0000","last_undegraded":"2024-09-22T08:39:38.910893+0000","last_fullsized":"2024-09-22T08:39:38.910893+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:20:15.843523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.229572+0000","last_change":"2024-09-22T08:36:32.012753+0000","last_active":"2024-09-22T08:37:04.229572+0000","last_peered":"2024-09-22T08:37:04.229572+0000","last_clean":"2024-09-22T08:37:04.229572+0000","last_became_active":"2024-09-22T08:36:32.011923+0000","last_became_peered":"2024-09-22T08:36:32.011923+0000","last_unstale":"2024-09-22T08:37:04.229572+0000","last_undegraded":"2024-09-22T08:37:04.229572+0000","last_fullsized":"2024-09-22T08:37:04.229572+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:27:01.625975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"32'3","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:33.182535+0000","last_change":"2024-09-22T08:36:34.013810+0000","last_active":"2024-09-22T08:38:33.182535+0000","last_peered":"2024-09-22T08:38:33.182535+0000","last_clean":"2024-09-22T08:38:33.182535+0000","last_became_active":"2024-09-22T08:36:34.013308+0000","last_became_peered":"2024-09-22T08:36:34.013308+0000","last_unstale":"2024-09-22T08:38:33.182535+0000","last_undegraded":"2024-09-22T08:38:33.182535+0000","last_fullsized":"2024-09-22T08:38:33.182535+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:08:44.619221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"32'6","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:11.403703+0000","last_change":"2024-09-22T08:40:11.403703+0000","last_active":"2024-09-22T08:40:11.403703+0000","last_peered":"2024-09-22T08:40:11.403703+0000","last_clean":"2024-09-22T08:40:11.403703+0000","last_became_active":"2024-09-22T08:36:25.992167+0000","last_became_peered":"2024-09-22T08:36:25.992167+0000","last_unstale":"2024-09-22T08:40:11.403703+0000","last_undegraded":"2024-09-22T08:40:11.403703+0000","last_fullsized":"2024-09-22T08:40:11.403703+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-22T08:40:11.403607+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-22T08:40:11.403607+0000","last_clean_scrub_stamp":"2024-09-22T08:40:11.403607+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:48:41.981330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"32'4","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:51.418486+0000","last_change":"2024-09-22T08:39:51.418486+0000","last_active":"2024-09-22T08:39:51.418486+0000","last_peered":"2024-09-22T08:39:51.418486+0000","last_clean":"2024-09-22T08:39:51.418486+0000","last_became_active":"2024-09-22T08:36:23.980560+0000","last_became_peered":"2024-09-22T08:36:23.980560+0000","last_unstale":"2024-09-22T08:39:51.418486+0000","last_undegraded":"2024-09-22T08:39:51.418486+0000","last_fullsized":"2024-09-22T08:39:51.418486+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-22T08:39:51.418401+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-22T08:39:51.418401+0000","last_clean_scrub_stamp":"2024-09-22T08:39:51.418401+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:39:01.093268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":6,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:17.865031+0000","last_change":"2024-09-22T08:40:17.865031+0000","last_active":"2024-09-22T08:40:17.865031+0000","last_peered":"2024-09-22T08:40:17.865031+0000","last_clean":"2024-09-22T08:40:17.865031+0000","last_became_active":"2024-09-22T08:36:27.984699+0000","last_became_peered":"2024-09-22T08:36:27.984699+0000","last_unstale":"2024-09-22T08:40:17.865031+0000","last_undegraded":"2024-09-22T08:40:17.865031+0000","last_fullsized":"2024-09-22T08:40:17.865031+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:17.864935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:17.864935+0000","last_clean_scrub_stamp":"2024-09-22T08:40:17.864935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:06:55.919594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"32'46","reported_seq":104,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:19.415050+0000","last_change":"2024-09-22T08:40:19.415050+0000","last_active":"2024-09-22T08:40:19.415050+0000","last_peered":"2024-09-22T08:40:19.415050+0000","last_clean":"2024-09-22T08:40:19.415050+0000","last_became_active":"2024-09-22T08:36:29.989049+0000","last_became_peered":"2024-09-22T08:36:29.989049+0000","last_unstale":"2024-09-22T08:40:19.415050+0000","last_undegraded":"2024-09-22T08:40:19.415050+0000","last_fullsized":"2024-09-22T08:40:19.415050+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'46","last_scrub_stamp":"2024-09-22T08:40:19.414959+0000","last_deep_scrub":"32'46","last_deep_scrub_stamp":"2024-09-22T08:40:19.414959+0000","last_clean_scrub_stamp":"2024-09-22T08:40:19.414959+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:49:24.762046+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"32'285","reported_seq":455,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:38.825419+0000","last_change":"2024-09-22T08:36:32.003714+0000","last_active":"2024-09-22T08:39:38.825419+0000","last_peered":"2024-09-22T08:39:38.825419+0000","last_clean":"2024-09-22T08:39:38.825419+0000","last_became_active":"2024-09-22T08:36:32.003451+0000","last_became_peered":"2024-09-22T08:36:32.003451+0000","last_unstale":"2024-09-22T08:39:38.825419+0000","last_undegraded":"2024-09-22T08:39:38.825419+0000","last_fullsized":"2024-09-22T08:39:38.825419+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:36:40.009194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"32'12","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:38.177618+0000","last_change":"2024-09-22T08:36:34.017932+0000","last_active":"2024-09-22T08:38:38.177618+0000","last_peered":"2024-09-22T08:38:38.177618+0000","last_clean":"2024-09-22T08:38:38.177618+0000","last_became_active":"2024-09-22T08:36:34.017586+0000","last_became_peered":"2024-09-22T08:36:34.017586+0000","last_unstale":"2024-09-22T08:38:38.177618+0000","last_undegraded":"2024-09-22T08:38:38.177618+0000","last_fullsized":"2024-09-22T08:38:38.177618+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:03:46.243863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"32'6","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:00.479916+0000","last_change":"2024-09-22T08:40:00.479916+0000","last_active":"2024-09-22T08:40:00.479916+0000","last_peered":"2024-09-22T08:40:00.479916+0000","last_clean":"2024-09-22T08:40:00.479916+0000","last_became_active":"2024-09-22T08:36:25.983836+0000","last_became_peered":"2024-09-22T08:36:25.983836+0000","last_unstale":"2024-09-22T08:40:00.479916+0000","last_undegraded":"2024-09-22T08:40:00.479916+0000","last_fullsized":"2024-09-22T08:40:00.479916+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-22T08:40:00.479800+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-22T08:40:00.479800+0000","last_clean_scrub_stamp":"2024-09-22T08:40:00.479800+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:26:08.975683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":29,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:50.428805+0000","last_change":"2024-09-22T08:39:50.428805+0000","last_active":"2024-09-22T08:39:50.428805+0000","last_peered":"2024-09-22T08:39:50.428805+0000","last_clean":"2024-09-22T08:39:50.428805+0000","last_became_active":"2024-09-22T08:36:23.981453+0000","last_became_peered":"2024-09-22T08:36:23.981453+0000","last_unstale":"2024-09-22T08:39:50.428805+0000","last_undegraded":"2024-09-22T08:39:50.428805+0000","last_fullsized":"2024-09-22T08:39:50.428805+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:39:50.428713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:39:50.428713+0000","last_clean_scrub_stamp":"2024-09-22T08:39:50.428713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:18:15.418827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"32'3","reported_seq":418,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:38.806077+0000","last_change":"2024-09-22T08:36:27.990966+0000","last_active":"2024-09-22T08:39:38.806077+0000","last_peered":"2024-09-22T08:39:38.806077+0000","last_clean":"2024-09-22T08:39:38.806077+0000","last_became_active":"2024-09-22T08:36:27.990658+0000","last_became_peered":"2024-09-22T08:36:27.990658+0000","last_unstale":"2024-09-22T08:39:38.806077+0000","last_undegraded":"2024-09-22T08:39:38.806077+0000","last_fullsized":"2024-09-22T08:39:38.806077+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_clean_scrub_stamp":"2024-09-22T08:36:26.962226+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:46:19.841645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"30'10","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.225133+0000","last_change":"2024-09-22T08:36:29.994653+0000","last_active":"2024-09-22T08:37:04.225133+0000","last_peered":"2024-09-22T08:37:04.225133+0000","last_clean":"2024-09-22T08:37:04.225133+0000","last_became_active":"2024-09-22T08:36:29.994352+0000","last_became_peered":"2024-09-22T08:36:29.994352+0000","last_unstale":"2024-09-22T08:37:04.225133+0000","last_undegraded":"2024-09-22T08:37:04.225133+0000","last_fullsized":"2024-09-22T08:37:04.225133+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:29:42.839928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"32'285","reported_seq":466,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:38.826525+0000","last_change":"2024-09-22T08:36:32.002508+0000","last_active":"2024-09-22T08:39:38.826525+0000","last_peered":"2024-09-22T08:39:38.826525+0000","last_clean":"2024-09-22T08:39:38.826525+0000","last_became_active":"2024-09-22T08:36:32.002222+0000","last_became_peered":"2024-09-22T08:36:32.002222+0000","last_unstale":"2024-09-22T08:39:38.826525+0000","last_undegraded":"2024-09-22T08:39:38.826525+0000","last_fullsized":"2024-09-22T08:39:38.826525+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:01:40.774076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"32'4","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:31.432921+0000","last_change":"2024-09-22T08:36:34.016126+0000","last_active":"2024-09-22T08:38:31.432921+0000","last_peered":"2024-09-22T08:38:31.432921+0000","last_clean":"2024-09-22T08:38:31.432921+0000","last_became_active":"2024-09-22T08:36:34.015833+0000","last_became_peered":"2024-09-22T08:36:34.015833+0000","last_unstale":"2024-09-22T08:38:31.432921+0000","last_undegraded":"2024-09-22T08:38:31.432921+0000","last_fullsized":"2024-09-22T08:38:31.432921+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:08:38.502068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"32'6","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:02.310213+0000","last_change":"2024-09-22T08:40:02.310213+0000","last_active":"2024-09-22T08:40:02.310213+0000","last_peered":"2024-09-22T08:40:02.310213+0000","last_clean":"2024-09-22T08:40:02.310213+0000","last_became_active":"2024-09-22T08:36:25.977184+0000","last_became_peered":"2024-09-22T08:36:25.977184+0000","last_unstale":"2024-09-22T08:40:02.310213+0000","last_undegraded":"2024-09-22T08:40:02.310213+0000","last_fullsized":"2024-09-22T08:40:02.310213+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-22T08:40:02.310094+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-22T08:40:02.310094+0000","last_clean_scrub_stamp":"2024-09-22T08:40:02.310094+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:42:25.082452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"32'8","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:46.401339+0000","last_change":"2024-09-22T08:39:46.401339+0000","last_active":"2024-09-22T08:39:46.401339+0000","last_peered":"2024-09-22T08:39:46.401339+0000","last_clean":"2024-09-22T08:39:46.401339+0000","last_became_active":"2024-09-22T08:36:23.976129+0000","last_became_peered":"2024-09-22T08:36:23.976129+0000","last_unstale":"2024-09-22T08:39:46.401339+0000","last_undegraded":"2024-09-22T08:39:46.401339+0000","last_fullsized":"2024-09-22T08:39:46.401339+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-22T08:39:46.401243+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-22T08:39:46.401243+0000","last_clean_scrub_stamp":"2024-09-22T08:39:46.401243+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:53:00.898981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":14,"num_write":48,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"23'1","reported_seq":221,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:38.795945+0000","last_change":"2024-09-22T08:36:27.988301+0000","last_active":"2024-09-22T08:39:38.795945+0000","last_peered":"2024-09-22T08:39:38.795945+0000","last_clean":"2024-09-22T08:39:38.795945+0000","last_became_active":"2024-09-22T08:36:27.987999+0000","last_became_peered":"2024-09-22T08:36:27.987999+0000","last_unstale":"2024-09-22T08:39:38.795945+0000","last_undegraded":"2024-09-22T08:39:38.795945+0000","last_fullsized":"2024-09-22T08:39:38.795945+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_clean_scrub_stamp":"2024-09-22T08:36:26.962226+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:18:39.538565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"32'41","reported_seq":92,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:38.948410+0000","last_change":"2024-09-22T08:36:29.992044+0000","last_active":"2024-09-22T08:39:38.948410+0000","last_peered":"2024-09-22T08:39:38.948410+0000","last_clean":"2024-09-22T08:39:38.948410+0000","last_became_active":"2024-09-22T08:36:29.991671+0000","last_became_peered":"2024-09-22T08:36:29.991671+0000","last_unstale":"2024-09-22T08:39:38.948410+0000","last_undegraded":"2024-09-22T08:39:38.948410+0000","last_fullsized":"2024-09-22T08:39:38.948410+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:30:17.519164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.225831+0000","last_change":"2024-09-22T08:36:32.012136+0000","last_active":"2024-09-22T08:37:04.225831+0000","last_peered":"2024-09-22T08:37:04.225831+0000","last_clean":"2024-09-22T08:37:04.225831+0000","last_became_active":"2024-09-22T08:36:32.011845+0000","last_became_peered":"2024-09-22T08:36:32.011845+0000","last_unstale":"2024-09-22T08:37:04.225831+0000","last_undegraded":"2024-09-22T08:37:04.225831+0000","last_fullsized":"2024-09-22T08:37:04.225831+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:30:19.290881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"32'6","reported_seq":25,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.324008+0000","last_change":"2024-09-22T08:36:34.008672+0000","last_active":"2024-09-22T08:39:32.324008+0000","last_peered":"2024-09-22T08:39:32.324008+0000","last_clean":"2024-09-22T08:39:32.324008+0000","last_became_active":"2024-09-22T08:36:34.008374+0000","last_became_peered":"2024-09-22T08:36:34.008374+0000","last_unstale":"2024-09-22T08:39:32.324008+0000","last_undegraded":"2024-09-22T08:39:32.324008+0000","last_fullsized":"2024-09-22T08:39:32.324008+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:58:45.659504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"32'15","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:54.643440+0000","last_change":"2024-09-22T08:39:54.643440+0000","last_active":"2024-09-22T08:39:54.643440+0000","last_peered":"2024-09-22T08:39:54.643440+0000","last_clean":"2024-09-22T08:39:54.643440+0000","last_became_active":"2024-09-22T08:37:04.228680+0000","last_became_peered":"2024-09-22T08:37:04.228680+0000","last_unstale":"2024-09-22T08:39:54.643440+0000","last_undegraded":"2024-09-22T08:39:54.643440+0000","last_fullsized":"2024-09-22T08:39:54.643440+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'15","last_scrub_stamp":"2024-09-22T08:39:54.643331+0000","last_deep_scrub":"32'15","last_deep_scrub_stamp":"2024-09-22T08:39:54.643331+0000","last_clean_scrub_stamp":"2024-09-22T08:39:54.643331+0000","objects_scrubbed":1,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:10:02.228729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":62,"num_read_kb":54,"num_write":19,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"32'74","reported_seq":153,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:43.060244+0000","last_change":"2024-09-22T08:39:43.060183+0000","last_active":"2024-09-22T08:39:43.060244+0000","last_peered":"2024-09-22T08:39:43.060244+0000","last_clean":"2024-09-22T08:39:43.060244+0000","last_became_active":"2024-09-22T08:36:10.736221+0000","last_became_peered":"2024-09-22T08:36:10.736221+0000","last_unstale":"2024-09-22T08:39:43.060244+0000","last_undegraded":"2024-09-22T08:39:43.060244+0000","last_fullsized":"2024-09-22T08:39:43.060244+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'74","last_scrub_stamp":"2024-09-22T08:39:43.060088+0000","last_deep_scrub":"32'74","last_deep_scrub_stamp":"2024-09-22T08:39:43.060088+0000","last_clean_scrub_stamp":"2024-09-22T08:39:43.060088+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:47:30.182707+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"32'2","reported_seq":61,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:45.437270+0000","last_change":"2024-09-22T08:39:45.437270+0000","last_active":"2024-09-22T08:39:45.437270+0000","last_peered":"2024-09-22T08:39:45.437270+0000","last_clean":"2024-09-22T08:39:45.437270+0000","last_became_active":"2024-09-22T08:36:16.425465+0000","last_became_peered":"2024-09-22T08:36:16.425465+0000","last_unstale":"2024-09-22T08:39:45.437270+0000","last_undegraded":"2024-09-22T08:39:45.437270+0000","last_fullsized":"2024-09-22T08:39:45.437270+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-22T08:39:45.437175+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-22T08:39:45.437175+0000","last_clean_scrub_stamp":"2024-09-22T08:39:45.437175+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:50:58.216244+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00049376300000000004,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"32'6","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:48.401375+0000","last_change":"2024-09-22T08:39:48.401375+0000","last_active":"2024-09-22T08:39:48.401375+0000","last_peered":"2024-09-22T08:39:48.401375+0000","last_clean":"2024-09-22T08:39:48.401375+0000","last_became_active":"2024-09-22T08:36:23.981576+0000","last_became_peered":"2024-09-22T08:36:23.981576+0000","last_unstale":"2024-09-22T08:39:48.401375+0000","last_undegraded":"2024-09-22T08:39:48.401375+0000","last_fullsized":"2024-09-22T08:39:48.401375+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-22T08:39:48.401293+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-22T08:39:48.401293+0000","last_clean_scrub_stamp":"2024-09-22T08:39:48.401293+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:49:36.460213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4,"num_write":22,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:19.267513+0000","last_change":"2024-09-22T08:40:19.267513+0000","last_active":"2024-09-22T08:40:19.267513+0000","last_peered":"2024-09-22T08:40:19.267513+0000","last_clean":"2024-09-22T08:40:19.267513+0000","last_became_active":"2024-09-22T08:36:27.991130+0000","last_became_peered":"2024-09-22T08:36:27.991130+0000","last_unstale":"2024-09-22T08:40:19.267513+0000","last_undegraded":"2024-09-22T08:40:19.267513+0000","last_fullsized":"2024-09-22T08:40:19.267513+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:19.267432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:19.267432+0000","last_clean_scrub_stamp":"2024-09-22T08:40:19.267432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:24:25.931908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"32'85","reported_seq":167,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:38.954786+0000","last_change":"2024-09-22T08:36:29.997752+0000","last_active":"2024-09-22T08:39:38.954786+0000","last_peered":"2024-09-22T08:39:38.954786+0000","last_clean":"2024-09-22T08:39:38.954786+0000","last_became_active":"2024-09-22T08:36:29.997294+0000","last_became_peered":"2024-09-22T08:36:29.997294+0000","last_unstale":"2024-09-22T08:39:38.954786+0000","last_undegraded":"2024-09-22T08:39:38.954786+0000","last_fullsized":"2024-09-22T08:39:38.954786+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:18:13.227210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.226456+0000","last_change":"2024-09-22T08:36:32.009096+0000","last_active":"2024-09-22T08:37:04.226456+0000","last_peered":"2024-09-22T08:37:04.226456+0000","last_clean":"2024-09-22T08:37:04.226456+0000","last_became_active":"2024-09-22T08:36:32.008793+0000","last_became_peered":"2024-09-22T08:36:32.008793+0000","last_unstale":"2024-09-22T08:37:04.226456+0000","last_undegraded":"2024-09-22T08:37:04.226456+0000","last_fullsized":"2024-09-22T08:37:04.226456+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:01:07.495676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"32'81","reported_seq":163,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.301899+0000","last_change":"2024-09-22T08:36:34.016827+0000","last_active":"2024-09-22T08:39:32.301899+0000","last_peered":"2024-09-22T08:39:32.301899+0000","last_clean":"2024-09-22T08:39:32.301899+0000","last_became_active":"2024-09-22T08:36:34.016484+0000","last_became_peered":"2024-09-22T08:36:34.016484+0000","last_unstale":"2024-09-22T08:39:32.301899+0000","last_undegraded":"2024-09-22T08:39:32.301899+0000","last_fullsized":"2024-09-22T08:39:32.301899+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:27:41.551286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":223,"num_read_kb":221,"num_write":155,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"32'6","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:10.409088+0000","last_change":"2024-09-22T08:40:10.409088+0000","last_active":"2024-09-22T08:40:10.409088+0000","last_peered":"2024-09-22T08:40:10.409088+0000","last_clean":"2024-09-22T08:40:10.409088+0000","last_became_active":"2024-09-22T08:36:25.988156+0000","last_became_peered":"2024-09-22T08:36:25.988156+0000","last_unstale":"2024-09-22T08:40:10.409088+0000","last_undegraded":"2024-09-22T08:40:10.409088+0000","last_fullsized":"2024-09-22T08:40:10.409088+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-22T08:40:10.409006+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-22T08:40:10.409006+0000","last_clean_scrub_stamp":"2024-09-22T08:40:10.409006+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:49:55.381873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:43.491544+0000","last_change":"2024-09-22T08:39:43.491476+0000","last_active":"2024-09-22T08:39:43.491544+0000","last_peered":"2024-09-22T08:39:43.491544+0000","last_clean":"2024-09-22T08:39:43.491544+0000","last_became_active":"2024-09-22T08:36:16.427252+0000","last_became_peered":"2024-09-22T08:36:16.427252+0000","last_unstale":"2024-09-22T08:39:43.491544+0000","last_undegraded":"2024-09-22T08:39:43.491544+0000","last_fullsized":"2024-09-22T08:39:43.491544+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:39:43.491364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:39:43.491364+0000","last_clean_scrub_stamp":"2024-09-22T08:39:43.491364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:29:57.540388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055484200000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:43.847049+0000","last_change":"2024-09-22T08:39:43.847049+0000","last_active":"2024-09-22T08:39:43.847049+0000","last_peered":"2024-09-22T08:39:43.847049+0000","last_clean":"2024-09-22T08:39:43.847049+0000","last_became_active":"2024-09-22T08:36:23.973773+0000","last_became_peered":"2024-09-22T08:36:23.973773+0000","last_unstale":"2024-09-22T08:39:43.847049+0000","last_undegraded":"2024-09-22T08:39:43.847049+0000","last_fullsized":"2024-09-22T08:39:43.847049+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:39:43.846973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:39:43.846973+0000","last_clean_scrub_stamp":"2024-09-22T08:39:43.846973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:25:33.678376+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.236920+0000","last_change":"2024-09-22T08:37:04.234583+0000","last_active":"2024-09-22T08:37:04.236920+0000","last_peered":"2024-09-22T08:37:04.236920+0000","last_clean":"2024-09-22T08:37:04.236920+0000","last_became_active":"2024-09-22T08:37:04.234316+0000","last_became_peered":"2024-09-22T08:37:04.234316+0000","last_unstale":"2024-09-22T08:37:04.236920+0000","last_undegraded":"2024-09-22T08:37:04.236920+0000","last_fullsized":"2024-09-22T08:37:04.236920+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_clean_scrub_stamp":"2024-09-22T08:36:26.962226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:12:15.239608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"32'285","reported_seq":501,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:38.952535+0000","last_change":"2024-09-22T08:36:29.996545+0000","last_active":"2024-09-22T08:39:38.952535+0000","last_peered":"2024-09-22T08:39:38.952535+0000","last_clean":"2024-09-22T08:39:38.952535+0000","last_became_active":"2024-09-22T08:36:29.996025+0000","last_became_peered":"2024-09-22T08:36:29.996025+0000","last_unstale":"2024-09-22T08:39:38.952535+0000","last_undegraded":"2024-09-22T08:39:38.952535+0000","last_fullsized":"2024-09-22T08:39:38.952535+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:55:34.543185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":378,"num_read_kb":363,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.227773+0000","last_change":"2024-09-22T08:36:32.013929+0000","last_active":"2024-09-22T08:37:04.227773+0000","last_peered":"2024-09-22T08:37:04.227773+0000","last_clean":"2024-09-22T08:37:04.227773+0000","last_became_active":"2024-09-22T08:36:32.013220+0000","last_became_peered":"2024-09-22T08:36:32.013220+0000","last_unstale":"2024-09-22T08:37:04.227773+0000","last_undegraded":"2024-09-22T08:37:04.227773+0000","last_fullsized":"2024-09-22T08:37:04.227773+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:57:05.813999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"32'5","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:28.578046+0000","last_change":"2024-09-22T08:36:34.018385+0000","last_active":"2024-09-22T08:38:28.578046+0000","last_peered":"2024-09-22T08:38:28.578046+0000","last_clean":"2024-09-22T08:38:28.578046+0000","last_became_active":"2024-09-22T08:36:34.018138+0000","last_became_peered":"2024-09-22T08:36:34.018138+0000","last_unstale":"2024-09-22T08:38:28.578046+0000","last_undegraded":"2024-09-22T08:38:28.578046+0000","last_fullsized":"2024-09-22T08:38:28.578046+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:47:34.849746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"32'8","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:01.792896+0000","last_change":"2024-09-22T08:40:01.792896+0000","last_active":"2024-09-22T08:40:01.792896+0000","last_peered":"2024-09-22T08:40:01.792896+0000","last_clean":"2024-09-22T08:40:01.792896+0000","last_became_active":"2024-09-22T08:36:25.979108+0000","last_became_peered":"2024-09-22T08:36:25.979108+0000","last_unstale":"2024-09-22T08:40:01.792896+0000","last_undegraded":"2024-09-22T08:40:01.792896+0000","last_fullsized":"2024-09-22T08:40:01.792896+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-22T08:40:01.792800+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-22T08:40:01.792800+0000","last_clean_scrub_stamp":"2024-09-22T08:40:01.792800+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:15:50.070182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:43.605309+0000","last_change":"2024-09-22T08:39:43.605309+0000","last_active":"2024-09-22T08:39:43.605309+0000","last_peered":"2024-09-22T08:39:43.605309+0000","last_clean":"2024-09-22T08:39:43.605309+0000","last_became_active":"2024-09-22T08:36:16.427121+0000","last_became_peered":"2024-09-22T08:36:16.427121+0000","last_unstale":"2024-09-22T08:39:43.605309+0000","last_undegraded":"2024-09-22T08:39:43.605309+0000","last_fullsized":"2024-09-22T08:39:43.605309+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:39:43.605211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:39:43.605211+0000","last_clean_scrub_stamp":"2024-09-22T08:39:43.605211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:07:42.970630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041194099999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"32'2","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:44.811985+0000","last_change":"2024-09-22T08:39:44.811985+0000","last_active":"2024-09-22T08:39:44.811985+0000","last_peered":"2024-09-22T08:39:44.811985+0000","last_clean":"2024-09-22T08:39:44.811985+0000","last_became_active":"2024-09-22T08:36:23.971688+0000","last_became_peered":"2024-09-22T08:36:23.971688+0000","last_unstale":"2024-09-22T08:39:44.811985+0000","last_undegraded":"2024-09-22T08:39:44.811985+0000","last_fullsized":"2024-09-22T08:39:44.811985+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-22T08:39:44.811892+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-22T08:39:44.811892+0000","last_clean_scrub_stamp":"2024-09-22T08:39:44.811892+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:25:37.511699+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:10.368238+0000","last_change":"2024-09-22T08:40:10.368238+0000","last_active":"2024-09-22T08:40:10.368238+0000","last_peered":"2024-09-22T08:40:10.368238+0000","last_clean":"2024-09-22T08:40:10.368238+0000","last_became_active":"2024-09-22T08:36:27.986993+0000","last_became_peered":"2024-09-22T08:36:27.986993+0000","last_unstale":"2024-09-22T08:40:10.368238+0000","last_undegraded":"2024-09-22T08:40:10.368238+0000","last_fullsized":"2024-09-22T08:40:10.368238+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-22T08:40:10.368133+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-22T08:40:10.368133+0000","last_clean_scrub_stamp":"2024-09-22T08:40:10.368133+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:08:05.798320+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"32'25","reported_seq":101,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:18.403402+0000","last_change":"2024-09-22T08:40:18.403402+0000","last_active":"2024-09-22T08:40:18.403402+0000","last_peered":"2024-09-22T08:40:18.403402+0000","last_clean":"2024-09-22T08:40:18.403402+0000","last_became_active":"2024-09-22T08:36:29.991579+0000","last_became_peered":"2024-09-22T08:36:29.991579+0000","last_unstale":"2024-09-22T08:40:18.403402+0000","last_undegraded":"2024-09-22T08:40:18.403402+0000","last_fullsized":"2024-09-22T08:40:18.403402+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'25","last_scrub_stamp":"2024-09-22T08:40:18.403282+0000","last_deep_scrub":"32'25","last_deep_scrub_stamp":"2024-09-22T08:40:18.403282+0000","last_clean_scrub_stamp":"2024-09-22T08:40:18.403282+0000","objects_scrubbed":8,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:10:52.856214+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.224585+0000","last_change":"2024-09-22T08:36:32.011889+0000","last_active":"2024-09-22T08:37:04.224585+0000","last_peered":"2024-09-22T08:37:04.224585+0000","last_clean":"2024-09-22T08:37:04.224585+0000","last_became_active":"2024-09-22T08:36:32.011634+0000","last_became_peered":"2024-09-22T08:36:32.011634+0000","last_unstale":"2024-09-22T08:37:04.224585+0000","last_undegraded":"2024-09-22T08:37:04.224585+0000","last_fullsized":"2024-09-22T08:37:04.224585+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:56:34.615539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.226958+0000","last_change":"2024-09-22T08:36:34.012423+0000","last_active":"2024-09-22T08:37:04.226958+0000","last_peered":"2024-09-22T08:37:04.226958+0000","last_clean":"2024-09-22T08:37:04.226958+0000","last_became_active":"2024-09-22T08:36:34.011936+0000","last_became_peered":"2024-09-22T08:36:34.011936+0000","last_unstale":"2024-09-22T08:37:04.226958+0000","last_undegraded":"2024-09-22T08:37:04.226958+0000","last_fullsized":"2024-09-22T08:37:04.226958+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:29:05.565248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"32'3","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:59.876252+0000","last_change":"2024-09-22T08:39:59.876252+0000","last_active":"2024-09-22T08:39:59.876252+0000","last_peered":"2024-09-22T08:39:59.876252+0000","last_clean":"2024-09-22T08:39:59.876252+0000","last_became_active":"2024-09-22T08:36:25.977552+0000","last_became_peered":"2024-09-22T08:36:25.977552+0000","last_unstale":"2024-09-22T08:39:59.876252+0000","last_undegraded":"2024-09-22T08:39:59.876252+0000","last_fullsized":"2024-09-22T08:39:59.876252+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2024-09-22T08:39:59.876163+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2024-09-22T08:39:59.876163+0000","last_clean_scrub_stamp":"2024-09-22T08:39:59.876163+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:26:06.074309+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"32'3","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:44.485607+0000","last_change":"2024-09-22T08:39:44.485607+0000","last_active":"2024-09-22T08:39:44.485607+0000","last_peered":"2024-09-22T08:39:44.485607+0000","last_clean":"2024-09-22T08:39:44.485607+0000","last_became_active":"2024-09-22T08:36:16.427358+0000","last_became_peered":"2024-09-22T08:36:16.427358+0000","last_unstale":"2024-09-22T08:39:44.485607+0000","last_undegraded":"2024-09-22T08:39:44.485607+0000","last_fullsized":"2024-09-22T08:39:44.485607+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2024-09-22T08:39:44.485523+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2024-09-22T08:39:44.485523+0000","last_clean_scrub_stamp":"2024-09-22T08:39:44.485523+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:22:57.579671+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.001068835,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"32'4","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:45.577394+0000","last_change":"2024-09-22T08:39:45.577394+0000","last_active":"2024-09-22T08:39:45.577394+0000","last_peered":"2024-09-22T08:39:45.577394+0000","last_clean":"2024-09-22T08:39:45.577394+0000","last_became_active":"2024-09-22T08:36:23.967413+0000","last_became_peered":"2024-09-22T08:36:23.967413+0000","last_unstale":"2024-09-22T08:39:45.577394+0000","last_undegraded":"2024-09-22T08:39:45.577394+0000","last_fullsized":"2024-09-22T08:39:45.577394+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-22T08:39:45.577315+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-22T08:39:45.577315+0000","last_clean_scrub_stamp":"2024-09-22T08:39:45.577315+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:36:05.444054+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:13.869191+0000","last_change":"2024-09-22T08:40:13.869191+0000","last_active":"2024-09-22T08:40:13.869191+0000","last_peered":"2024-09-22T08:40:13.869191+0000","last_clean":"2024-09-22T08:40:13.869191+0000","last_became_active":"2024-09-22T08:36:27.988507+0000","last_became_peered":"2024-09-22T08:36:27.988507+0000","last_unstale":"2024-09-22T08:40:13.869191+0000","last_undegraded":"2024-09-22T08:40:13.869191+0000","last_fullsized":"2024-09-22T08:40:13.869191+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:13.869104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:13.869104+0000","last_clean_scrub_stamp":"2024-09-22T08:40:13.869104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:02:34.608102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"32'13","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:31.660162+0000","last_change":"2024-09-22T08:36:29.996842+0000","last_active":"2024-09-22T08:39:31.660162+0000","last_peered":"2024-09-22T08:39:31.660162+0000","last_clean":"2024-09-22T08:39:31.660162+0000","last_became_active":"2024-09-22T08:36:29.996557+0000","last_became_peered":"2024-09-22T08:36:29.996557+0000","last_unstale":"2024-09-22T08:39:31.660162+0000","last_undegraded":"2024-09-22T08:39:31.660162+0000","last_fullsized":"2024-09-22T08:39:31.660162+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:05:26.776730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.229775+0000","last_change":"2024-09-22T08:36:32.014226+0000","last_active":"2024-09-22T08:37:04.229775+0000","last_peered":"2024-09-22T08:37:04.229775+0000","last_clean":"2024-09-22T08:37:04.229775+0000","last_became_active":"2024-09-22T08:36:32.013320+0000","last_became_peered":"2024-09-22T08:36:32.013320+0000","last_unstale":"2024-09-22T08:37:04.229775+0000","last_undegraded":"2024-09-22T08:37:04.229775+0000","last_fullsized":"2024-09-22T08:37:04.229775+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:03:21.762780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"32'4","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:31.413581+0000","last_change":"2024-09-22T08:36:34.015737+0000","last_active":"2024-09-22T08:38:31.413581+0000","last_peered":"2024-09-22T08:38:31.413581+0000","last_clean":"2024-09-22T08:38:31.413581+0000","last_became_active":"2024-09-22T08:36:34.015483+0000","last_became_peered":"2024-09-22T08:36:34.015483+0000","last_unstale":"2024-09-22T08:38:31.413581+0000","last_undegraded":"2024-09-22T08:38:31.413581+0000","last_fullsized":"2024-09-22T08:38:31.413581+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:08:04.974029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"32'8","reported_seq":70,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:58.302415+0000","last_change":"2024-09-22T08:39:58.302415+0000","last_active":"2024-09-22T08:39:58.302415+0000","last_peered":"2024-09-22T08:39:58.302415+0000","last_clean":"2024-09-22T08:39:58.302415+0000","last_became_active":"2024-09-22T08:36:25.986551+0000","last_became_peered":"2024-09-22T08:36:25.986551+0000","last_unstale":"2024-09-22T08:39:58.302415+0000","last_undegraded":"2024-09-22T08:39:58.302415+0000","last_fullsized":"2024-09-22T08:39:58.302415+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-22T08:39:58.302310+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-22T08:39:58.302310+0000","last_clean_scrub_stamp":"2024-09-22T08:39:58.302310+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:59:40.615258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:44.562216+0000","last_change":"2024-09-22T08:39:44.562216+0000","last_active":"2024-09-22T08:39:44.562216+0000","last_peered":"2024-09-22T08:39:44.562216+0000","last_clean":"2024-09-22T08:39:44.562216+0000","last_became_active":"2024-09-22T08:36:23.968525+0000","last_became_peered":"2024-09-22T08:36:23.968525+0000","last_unstale":"2024-09-22T08:39:44.562216+0000","last_undegraded":"2024-09-22T08:39:44.562216+0000","last_fullsized":"2024-09-22T08:39:44.562216+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:39:44.562132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:39:44.562132+0000","last_clean_scrub_stamp":"2024-09-22T08:39:44.562132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:35:46.943109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:47.806728+0000","last_change":"2024-09-22T08:39:47.806728+0000","last_active":"2024-09-22T08:39:47.806728+0000","last_peered":"2024-09-22T08:39:47.806728+0000","last_clean":"2024-09-22T08:39:47.806728+0000","last_became_active":"2024-09-22T08:36:16.424946+0000","last_became_peered":"2024-09-22T08:36:16.424946+0000","last_unstale":"2024-09-22T08:39:47.806728+0000","last_undegraded":"2024-09-22T08:39:47.806728+0000","last_fullsized":"2024-09-22T08:39:47.806728+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:39:47.806631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:39:47.806631+0000","last_clean_scrub_stamp":"2024-09-22T08:39:47.806631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:54:30.955543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045979400000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:12.856795+0000","last_change":"2024-09-22T08:40:12.856795+0000","last_active":"2024-09-22T08:40:12.856795+0000","last_peered":"2024-09-22T08:40:12.856795+0000","last_clean":"2024-09-22T08:40:12.856795+0000","last_became_active":"2024-09-22T08:36:27.987997+0000","last_became_peered":"2024-09-22T08:36:27.987997+0000","last_unstale":"2024-09-22T08:40:12.856795+0000","last_undegraded":"2024-09-22T08:40:12.856795+0000","last_fullsized":"2024-09-22T08:40:12.856795+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-22T08:40:12.856666+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-22T08:40:12.856666+0000","last_clean_scrub_stamp":"2024-09-22T08:40:12.856666+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:42:45.227704+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"32'78","reported_seq":154,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:20.854705+0000","last_change":"2024-09-22T08:40:20.854705+0000","last_active":"2024-09-22T08:40:20.854705+0000","last_peered":"2024-09-22T08:40:20.854705+0000","last_clean":"2024-09-22T08:40:20.854705+0000","last_became_active":"2024-09-22T08:36:29.994186+0000","last_became_peered":"2024-09-22T08:36:29.994186+0000","last_unstale":"2024-09-22T08:40:20.854705+0000","last_undegraded":"2024-09-22T08:40:20.854705+0000","last_fullsized":"2024-09-22T08:40:20.854705+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'78","last_scrub_stamp":"2024-09-22T08:40:20.854613+0000","last_deep_scrub":"32'78","last_deep_scrub_stamp":"2024-09-22T08:40:20.854613+0000","last_clean_scrub_stamp":"2024-09-22T08:40:20.854613+0000","objects_scrubbed":9,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:26:34.671090+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":336,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.228168+0000","last_change":"2024-09-22T08:36:32.003689+0000","last_active":"2024-09-22T08:37:04.228168+0000","last_peered":"2024-09-22T08:37:04.228168+0000","last_clean":"2024-09-22T08:37:04.228168+0000","last_became_active":"2024-09-22T08:36:32.003409+0000","last_became_peered":"2024-09-22T08:36:32.003409+0000","last_unstale":"2024-09-22T08:37:04.228168+0000","last_undegraded":"2024-09-22T08:37:04.228168+0000","last_fullsized":"2024-09-22T08:37:04.228168+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:27:05.933480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"32'13","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:31.589959+0000","last_change":"2024-09-22T08:36:34.013068+0000","last_active":"2024-09-22T08:38:31.589959+0000","last_peered":"2024-09-22T08:38:31.589959+0000","last_clean":"2024-09-22T08:38:31.589959+0000","last_became_active":"2024-09-22T08:36:34.012782+0000","last_became_peered":"2024-09-22T08:36:34.012782+0000","last_unstale":"2024-09-22T08:38:31.589959+0000","last_undegraded":"2024-09-22T08:38:31.589959+0000","last_fullsized":"2024-09-22T08:38:31.589959+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:16:13.410088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":25,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"32'6","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:59.335942+0000","last_change":"2024-09-22T08:39:59.335942+0000","last_active":"2024-09-22T08:39:59.335942+0000","last_peered":"2024-09-22T08:39:59.335942+0000","last_clean":"2024-09-22T08:39:59.335942+0000","last_became_active":"2024-09-22T08:36:25.984820+0000","last_became_peered":"2024-09-22T08:36:25.984820+0000","last_unstale":"2024-09-22T08:39:59.335942+0000","last_undegraded":"2024-09-22T08:39:59.335942+0000","last_fullsized":"2024-09-22T08:39:59.335942+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-22T08:39:59.335838+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-22T08:39:59.335838+0000","last_clean_scrub_stamp":"2024-09-22T08:39:59.335838+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:19:14.131941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":29,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"32'2","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:45.773739+0000","last_change":"2024-09-22T08:39:45.773739+0000","last_active":"2024-09-22T08:39:45.773739+0000","last_peered":"2024-09-22T08:39:45.773739+0000","last_clean":"2024-09-22T08:39:45.773739+0000","last_became_active":"2024-09-22T08:36:23.973672+0000","last_became_peered":"2024-09-22T08:36:23.973672+0000","last_unstale":"2024-09-22T08:39:45.773739+0000","last_undegraded":"2024-09-22T08:39:45.773739+0000","last_fullsized":"2024-09-22T08:39:45.773739+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-22T08:39:45.773661+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-22T08:39:45.773661+0000","last_clean_scrub_stamp":"2024-09-22T08:39:45.773661+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:51:32.967955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:49.427484+0000","last_change":"2024-09-22T08:39:49.427484+0000","last_active":"2024-09-22T08:39:49.427484+0000","last_peered":"2024-09-22T08:39:49.427484+0000","last_clean":"2024-09-22T08:39:49.427484+0000","last_became_active":"2024-09-22T08:36:16.427154+0000","last_became_peered":"2024-09-22T08:36:16.427154+0000","last_unstale":"2024-09-22T08:39:49.427484+0000","last_undegraded":"2024-09-22T08:39:49.427484+0000","last_fullsized":"2024-09-22T08:39:49.427484+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:39:49.427383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:39:49.427383+0000","last_clean_scrub_stamp":"2024-09-22T08:39:49.427383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:57:58.108684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081028899999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.236919+0000","last_change":"2024-09-22T08:37:04.234588+0000","last_active":"2024-09-22T08:37:04.236919+0000","last_peered":"2024-09-22T08:37:04.236919+0000","last_clean":"2024-09-22T08:37:04.236919+0000","last_became_active":"2024-09-22T08:37:04.233981+0000","last_became_peered":"2024-09-22T08:37:04.233981+0000","last_unstale":"2024-09-22T08:37:04.236919+0000","last_undegraded":"2024-09-22T08:37:04.236919+0000","last_fullsized":"2024-09-22T08:37:04.236919+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_clean_scrub_stamp":"2024-09-22T08:36:26.962226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:01:06.235869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"32'15","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:28.585360+0000","last_change":"2024-09-22T08:36:29.995560+0000","last_active":"2024-09-22T08:38:28.585360+0000","last_peered":"2024-09-22T08:38:28.585360+0000","last_clean":"2024-09-22T08:38:28.585360+0000","last_became_active":"2024-09-22T08:36:29.995173+0000","last_became_peered":"2024-09-22T08:36:29.995173+0000","last_unstale":"2024-09-22T08:38:28.585360+0000","last_undegraded":"2024-09-22T08:38:28.585360+0000","last_fullsized":"2024-09-22T08:38:28.585360+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:37:47.696313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"32'285","reported_seq":349,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:38.823080+0000","last_change":"2024-09-22T08:36:32.003255+0000","last_active":"2024-09-22T08:39:38.823080+0000","last_peered":"2024-09-22T08:39:38.823080+0000","last_clean":"2024-09-22T08:39:38.823080+0000","last_became_active":"2024-09-22T08:36:32.002985+0000","last_became_peered":"2024-09-22T08:36:32.002985+0000","last_unstale":"2024-09-22T08:39:38.823080+0000","last_undegraded":"2024-09-22T08:39:38.823080+0000","last_fullsized":"2024-09-22T08:39:38.823080+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:27:39.543678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.227398+0000","last_change":"2024-09-22T08:36:34.019732+0000","last_active":"2024-09-22T08:37:04.227398+0000","last_peered":"2024-09-22T08:37:04.227398+0000","last_clean":"2024-09-22T08:37:04.227398+0000","last_became_active":"2024-09-22T08:36:34.019438+0000","last_became_peered":"2024-09-22T08:36:34.019438+0000","last_unstale":"2024-09-22T08:37:04.227398+0000","last_undegraded":"2024-09-22T08:37:04.227398+0000","last_fullsized":"2024-09-22T08:37:04.227398+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:29:22.767417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"32'4","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:09.397318+0000","last_change":"2024-09-22T08:40:09.397318+0000","last_active":"2024-09-22T08:40:09.397318+0000","last_peered":"2024-09-22T08:40:09.397318+0000","last_clean":"2024-09-22T08:40:09.397318+0000","last_became_active":"2024-09-22T08:36:25.991480+0000","last_became_peered":"2024-09-22T08:36:25.991480+0000","last_unstale":"2024-09-22T08:40:09.397318+0000","last_undegraded":"2024-09-22T08:40:09.397318+0000","last_fullsized":"2024-09-22T08:40:09.397318+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-22T08:40:09.397220+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-22T08:40:09.397220+0000","last_clean_scrub_stamp":"2024-09-22T08:40:09.397220+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:59:18.881844+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:46.106194+0000","last_change":"2024-09-22T08:39:46.106194+0000","last_active":"2024-09-22T08:39:46.106194+0000","last_peered":"2024-09-22T08:39:46.106194+0000","last_clean":"2024-09-22T08:39:46.106194+0000","last_became_active":"2024-09-22T08:37:04.227561+0000","last_became_peered":"2024-09-22T08:37:04.227561+0000","last_unstale":"2024-09-22T08:39:46.106194+0000","last_undegraded":"2024-09-22T08:39:46.106194+0000","last_fullsized":"2024-09-22T08:39:46.106194+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:39:46.106091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:39:46.106091+0000","last_clean_scrub_stamp":"2024-09-22T08:39:46.106091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:00:33.266036+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:42.871788+0000","last_change":"2024-09-22T08:39:42.871788+0000","last_active":"2024-09-22T08:39:42.871788+0000","last_peered":"2024-09-22T08:39:42.871788+0000","last_clean":"2024-09-22T08:39:42.871788+0000","last_became_active":"2024-09-22T08:36:16.425549+0000","last_became_peered":"2024-09-22T08:36:16.425549+0000","last_unstale":"2024-09-22T08:39:42.871788+0000","last_undegraded":"2024-09-22T08:39:42.871788+0000","last_fullsized":"2024-09-22T08:39:42.871788+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:39:42.871712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:39:42.871712+0000","last_clean_scrub_stamp":"2024-09-22T08:39:42.871712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:11:04.345633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045809600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.229558+0000","last_change":"2024-09-22T08:36:27.987430+0000","last_active":"2024-09-22T08:37:04.229558+0000","last_peered":"2024-09-22T08:37:04.229558+0000","last_clean":"2024-09-22T08:37:04.229558+0000","last_became_active":"2024-09-22T08:36:27.987074+0000","last_became_peered":"2024-09-22T08:36:27.987074+0000","last_unstale":"2024-09-22T08:37:04.229558+0000","last_undegraded":"2024-09-22T08:37:04.229558+0000","last_fullsized":"2024-09-22T08:37:04.229558+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_clean_scrub_stamp":"2024-09-22T08:36:26.962226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:08:31.905654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"30'10","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.228539+0000","last_change":"2024-09-22T08:36:30.000809+0000","last_active":"2024-09-22T08:37:04.228539+0000","last_peered":"2024-09-22T08:37:04.228539+0000","last_clean":"2024-09-22T08:37:04.228539+0000","last_became_active":"2024-09-22T08:36:29.999965+0000","last_became_peered":"2024-09-22T08:36:29.999965+0000","last_unstale":"2024-09-22T08:37:04.228539+0000","last_undegraded":"2024-09-22T08:37:04.228539+0000","last_fullsized":"2024-09-22T08:37:04.228539+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:05:54.815446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"32'285","reported_seq":392,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:38.828153+0000","last_change":"2024-09-22T08:36:32.005583+0000","last_active":"2024-09-22T08:39:38.828153+0000","last_peered":"2024-09-22T08:39:38.828153+0000","last_clean":"2024-09-22T08:39:38.828153+0000","last_became_active":"2024-09-22T08:36:32.005155+0000","last_became_peered":"2024-09-22T08:36:32.005155+0000","last_unstale":"2024-09-22T08:39:38.828153+0000","last_undegraded":"2024-09-22T08:39:38.828153+0000","last_fullsized":"2024-09-22T08:39:38.828153+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:01:17.946935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"30'5","reported_seq":25,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.223266+0000","last_change":"2024-09-22T08:36:34.022617+0000","last_active":"2024-09-22T08:37:04.223266+0000","last_peered":"2024-09-22T08:37:04.223266+0000","last_clean":"2024-09-22T08:37:04.223266+0000","last_became_active":"2024-09-22T08:36:34.022313+0000","last_became_peered":"2024-09-22T08:36:34.022313+0000","last_unstale":"2024-09-22T08:37:04.223266+0000","last_undegraded":"2024-09-22T08:37:04.223266+0000","last_fullsized":"2024-09-22T08:37:04.223266+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:42:55.182851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":11,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"32'4","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:05.384685+0000","last_change":"2024-09-22T08:40:05.384685+0000","last_active":"2024-09-22T08:40:05.384685+0000","last_peered":"2024-09-22T08:40:05.384685+0000","last_clean":"2024-09-22T08:40:05.384685+0000","last_became_active":"2024-09-22T08:36:25.974884+0000","last_became_peered":"2024-09-22T08:36:25.974884+0000","last_unstale":"2024-09-22T08:40:05.384685+0000","last_undegraded":"2024-09-22T08:40:05.384685+0000","last_fullsized":"2024-09-22T08:40:05.384685+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-22T08:40:05.384591+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-22T08:40:05.384591+0000","last_clean_scrub_stamp":"2024-09-22T08:40:05.384591+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:46:32.018206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"32'5","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:44.099885+0000","last_change":"2024-09-22T08:39:44.099885+0000","last_active":"2024-09-22T08:39:44.099885+0000","last_peered":"2024-09-22T08:39:44.099885+0000","last_clean":"2024-09-22T08:39:44.099885+0000","last_became_active":"2024-09-22T08:36:23.976646+0000","last_became_peered":"2024-09-22T08:36:23.976646+0000","last_unstale":"2024-09-22T08:39:44.099885+0000","last_undegraded":"2024-09-22T08:39:44.099885+0000","last_fullsized":"2024-09-22T08:39:44.099885+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'5","last_scrub_stamp":"2024-09-22T08:39:44.099774+0000","last_deep_scrub":"32'5","last_deep_scrub_stamp":"2024-09-22T08:39:44.099774+0000","last_clean_scrub_stamp":"2024-09-22T08:39:44.099774+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:33:07.255708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":11,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:47.415905+0000","last_change":"2024-09-22T08:39:47.415905+0000","last_active":"2024-09-22T08:39:47.415905+0000","last_peered":"2024-09-22T08:39:47.415905+0000","last_clean":"2024-09-22T08:39:47.415905+0000","last_became_active":"2024-09-22T08:36:16.638610+0000","last_became_peered":"2024-09-22T08:36:16.638610+0000","last_unstale":"2024-09-22T08:39:47.415905+0000","last_undegraded":"2024-09-22T08:39:47.415905+0000","last_fullsized":"2024-09-22T08:39:47.415905+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:39:47.415799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:39:47.415799+0000","last_clean_scrub_stamp":"2024-09-22T08:39:47.415799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:04:14.345231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001119264,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.226781+0000","last_change":"2024-09-22T08:36:27.985127+0000","last_active":"2024-09-22T08:37:04.226781+0000","last_peered":"2024-09-22T08:37:04.226781+0000","last_clean":"2024-09-22T08:37:04.226781+0000","last_became_active":"2024-09-22T08:36:27.984803+0000","last_became_peered":"2024-09-22T08:36:27.984803+0000","last_unstale":"2024-09-22T08:37:04.226781+0000","last_undegraded":"2024-09-22T08:37:04.226781+0000","last_fullsized":"2024-09-22T08:37:04.226781+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_clean_scrub_stamp":"2024-09-22T08:36:26.962226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:51:28.889992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"32'101","reported_seq":194,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:16.435220+0000","last_change":"2024-09-22T08:40:16.435220+0000","last_active":"2024-09-22T08:40:16.435220+0000","last_peered":"2024-09-22T08:40:16.435220+0000","last_clean":"2024-09-22T08:40:16.435220+0000","last_became_active":"2024-09-22T08:36:30.000270+0000","last_became_peered":"2024-09-22T08:36:30.000270+0000","last_unstale":"2024-09-22T08:40:16.435220+0000","last_undegraded":"2024-09-22T08:40:16.435220+0000","last_fullsized":"2024-09-22T08:40:16.435220+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'101","last_scrub_stamp":"2024-09-22T08:40:16.435123+0000","last_deep_scrub":"32'101","last_deep_scrub_stamp":"2024-09-22T08:40:16.435123+0000","last_clean_scrub_stamp":"2024-09-22T08:40:16.435123+0000","objects_scrubbed":8,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:28:38.145552+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4316,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":99,"num_read_kb":103,"num_write":38,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.223565+0000","last_change":"2024-09-22T08:36:32.003206+0000","last_active":"2024-09-22T08:37:04.223565+0000","last_peered":"2024-09-22T08:37:04.223565+0000","last_clean":"2024-09-22T08:37:04.223565+0000","last_became_active":"2024-09-22T08:36:32.002876+0000","last_became_peered":"2024-09-22T08:36:32.002876+0000","last_unstale":"2024-09-22T08:37:04.223565+0000","last_undegraded":"2024-09-22T08:37:04.223565+0000","last_fullsized":"2024-09-22T08:37:04.223565+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:07:07.136733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"30'2","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.228242+0000","last_change":"2024-09-22T08:36:34.016952+0000","last_active":"2024-09-22T08:37:04.228242+0000","last_peered":"2024-09-22T08:37:04.228242+0000","last_clean":"2024-09-22T08:37:04.228242+0000","last_became_active":"2024-09-22T08:36:34.016659+0000","last_became_peered":"2024-09-22T08:36:34.016659+0000","last_unstale":"2024-09-22T08:37:04.228242+0000","last_undegraded":"2024-09-22T08:37:04.228242+0000","last_fullsized":"2024-09-22T08:37:04.228242+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:01:42.781684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.229370+0000","last_change":"2024-09-22T08:36:34.015661+0000","last_active":"2024-09-22T08:37:04.229370+0000","last_peered":"2024-09-22T08:37:04.229370+0000","last_clean":"2024-09-22T08:37:04.229370+0000","last_became_active":"2024-09-22T08:36:34.015241+0000","last_became_peered":"2024-09-22T08:36:34.015241+0000","last_unstale":"2024-09-22T08:37:04.229370+0000","last_undegraded":"2024-09-22T08:37:04.229370+0000","last_fullsized":"2024-09-22T08:37:04.229370+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:13:28.913225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"32'4","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:59.521660+0000","last_change":"2024-09-22T08:39:59.521660+0000","last_active":"2024-09-22T08:39:59.521660+0000","last_peered":"2024-09-22T08:39:59.521660+0000","last_clean":"2024-09-22T08:39:59.521660+0000","last_became_active":"2024-09-22T08:36:25.987153+0000","last_became_peered":"2024-09-22T08:36:25.987153+0000","last_unstale":"2024-09-22T08:39:59.521660+0000","last_undegraded":"2024-09-22T08:39:59.521660+0000","last_fullsized":"2024-09-22T08:39:59.521660+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-22T08:39:59.521563+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-22T08:39:59.521563+0000","last_clean_scrub_stamp":"2024-09-22T08:39:59.521563+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:30:31.166918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:56.287922+0000","last_change":"2024-09-22T08:39:56.287922+0000","last_active":"2024-09-22T08:39:56.287922+0000","last_peered":"2024-09-22T08:39:56.287922+0000","last_clean":"2024-09-22T08:39:56.287922+0000","last_became_active":"2024-09-22T08:36:23.981927+0000","last_became_peered":"2024-09-22T08:36:23.981927+0000","last_unstale":"2024-09-22T08:39:56.287922+0000","last_undegraded":"2024-09-22T08:39:56.287922+0000","last_fullsized":"2024-09-22T08:39:56.287922+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:39:56.287818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:39:56.287818+0000","last_clean_scrub_stamp":"2024-09-22T08:39:56.287818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:00:09.674228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.222089+0000","last_change":"2024-09-22T08:36:27.990795+0000","last_active":"2024-09-22T08:37:04.222089+0000","last_peered":"2024-09-22T08:37:04.222089+0000","last_clean":"2024-09-22T08:37:04.222089+0000","last_became_active":"2024-09-22T08:36:27.990153+0000","last_became_peered":"2024-09-22T08:36:27.990153+0000","last_unstale":"2024-09-22T08:37:04.222089+0000","last_undegraded":"2024-09-22T08:37:04.222089+0000","last_fullsized":"2024-09-22T08:37:04.222089+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_clean_scrub_stamp":"2024-09-22T08:36:26.962226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:44:21.494770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"32'37","reported_seq":85,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:38.965959+0000","last_change":"2024-09-22T08:36:29.998789+0000","last_active":"2024-09-22T08:39:38.965959+0000","last_peered":"2024-09-22T08:39:38.965959+0000","last_clean":"2024-09-22T08:39:38.965959+0000","last_became_active":"2024-09-22T08:36:29.997814+0000","last_became_peered":"2024-09-22T08:36:29.997814+0000","last_unstale":"2024-09-22T08:39:38.965959+0000","last_undegraded":"2024-09-22T08:39:38.965959+0000","last_fullsized":"2024-09-22T08:39:38.965959+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:38:57.806502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":43,"num_read_kb":44,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.226536+0000","last_change":"2024-09-22T08:36:32.012924+0000","last_active":"2024-09-22T08:37:04.226536+0000","last_peered":"2024-09-22T08:37:04.226536+0000","last_clean":"2024-09-22T08:37:04.226536+0000","last_became_active":"2024-09-22T08:36:32.012453+0000","last_became_peered":"2024-09-22T08:36:32.012453+0000","last_unstale":"2024-09-22T08:37:04.226536+0000","last_undegraded":"2024-09-22T08:37:04.226536+0000","last_fullsized":"2024-09-22T08:37:04.226536+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:07:18.464448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"32'3","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:29.962024+0000","last_change":"2024-09-22T08:36:34.022519+0000","last_active":"2024-09-22T08:38:29.962024+0000","last_peered":"2024-09-22T08:38:29.962024+0000","last_clean":"2024-09-22T08:38:29.962024+0000","last_became_active":"2024-09-22T08:36:34.022267+0000","last_became_peered":"2024-09-22T08:36:34.022267+0000","last_unstale":"2024-09-22T08:38:29.962024+0000","last_undegraded":"2024-09-22T08:38:29.962024+0000","last_fullsized":"2024-09-22T08:38:29.962024+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:48:06.628364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"32'6","reported_seq":90,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:03.316706+0000","last_change":"2024-09-22T08:40:03.316706+0000","last_active":"2024-09-22T08:40:03.316706+0000","last_peered":"2024-09-22T08:40:03.316706+0000","last_clean":"2024-09-22T08:40:03.316706+0000","last_became_active":"2024-09-22T08:36:25.986613+0000","last_became_peered":"2024-09-22T08:36:25.986613+0000","last_unstale":"2024-09-22T08:40:03.316706+0000","last_undegraded":"2024-09-22T08:40:03.316706+0000","last_fullsized":"2024-09-22T08:40:03.316706+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-22T08:40:03.316589+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-22T08:40:03.316589+0000","last_clean_scrub_stamp":"2024-09-22T08:40:03.316589+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:37:02.558069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":60,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:49.648410+0000","last_change":"2024-09-22T08:39:49.648410+0000","last_active":"2024-09-22T08:39:49.648410+0000","last_peered":"2024-09-22T08:39:49.648410+0000","last_clean":"2024-09-22T08:39:49.648410+0000","last_became_active":"2024-09-22T08:36:23.978282+0000","last_became_peered":"2024-09-22T08:36:23.978282+0000","last_unstale":"2024-09-22T08:39:49.648410+0000","last_undegraded":"2024-09-22T08:39:49.648410+0000","last_fullsized":"2024-09-22T08:39:49.648410+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:39:49.648317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:39:49.648317+0000","last_clean_scrub_stamp":"2024-09-22T08:39:49.648317+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:38:27.168524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.230277+0000","last_change":"2024-09-22T08:36:27.986336+0000","last_active":"2024-09-22T08:37:04.230277+0000","last_peered":"2024-09-22T08:37:04.230277+0000","last_clean":"2024-09-22T08:37:04.230277+0000","last_became_active":"2024-09-22T08:36:27.986033+0000","last_became_peered":"2024-09-22T08:36:27.986033+0000","last_unstale":"2024-09-22T08:37:04.230277+0000","last_undegraded":"2024-09-22T08:37:04.230277+0000","last_fullsized":"2024-09-22T08:37:04.230277+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_clean_scrub_stamp":"2024-09-22T08:36:26.962226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:54:43.939868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"32'9","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:21.859767+0000","last_change":"2024-09-22T08:40:21.859767+0000","last_active":"2024-09-22T08:40:21.859767+0000","last_peered":"2024-09-22T08:40:21.859767+0000","last_clean":"2024-09-22T08:40:21.859767+0000","last_became_active":"2024-09-22T08:36:29.990057+0000","last_became_peered":"2024-09-22T08:36:29.990057+0000","last_unstale":"2024-09-22T08:40:21.859767+0000","last_undegraded":"2024-09-22T08:40:21.859767+0000","last_fullsized":"2024-09-22T08:40:21.859767+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'9","last_scrub_stamp":"2024-09-22T08:40:21.859640+0000","last_deep_scrub":"32'9","last_deep_scrub_stamp":"2024-09-22T08:40:21.859640+0000","last_clean_scrub_stamp":"2024-09-22T08:40:21.859640+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:41:06.152084+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":294,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.228183+0000","last_change":"2024-09-22T08:36:32.010964+0000","last_active":"2024-09-22T08:37:04.228183+0000","last_peered":"2024-09-22T08:37:04.228183+0000","last_clean":"2024-09-22T08:37:04.228183+0000","last_became_active":"2024-09-22T08:36:32.010692+0000","last_became_peered":"2024-09-22T08:36:32.010692+0000","last_unstale":"2024-09-22T08:37:04.228183+0000","last_undegraded":"2024-09-22T08:37:04.228183+0000","last_fullsized":"2024-09-22T08:37:04.228183+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:42:56.003470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"32'8","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:31.738292+0000","last_change":"2024-09-22T08:36:34.017610+0000","last_active":"2024-09-22T08:39:31.738292+0000","last_peered":"2024-09-22T08:39:31.738292+0000","last_clean":"2024-09-22T08:39:31.738292+0000","last_became_active":"2024-09-22T08:36:34.017181+0000","last_became_peered":"2024-09-22T08:36:34.017181+0000","last_unstale":"2024-09-22T08:39:31.738292+0000","last_undegraded":"2024-09-22T08:39:31.738292+0000","last_fullsized":"2024-09-22T08:39:31.738292+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:00:36.254978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":21,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"32'6","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:00.828058+0000","last_change":"2024-09-22T08:40:00.828058+0000","last_active":"2024-09-22T08:40:00.828058+0000","last_peered":"2024-09-22T08:40:00.828058+0000","last_clean":"2024-09-22T08:40:00.828058+0000","last_became_active":"2024-09-22T08:36:25.974797+0000","last_became_peered":"2024-09-22T08:36:25.974797+0000","last_unstale":"2024-09-22T08:40:00.828058+0000","last_undegraded":"2024-09-22T08:40:00.828058+0000","last_fullsized":"2024-09-22T08:40:00.828058+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-22T08:40:00.827940+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-22T08:40:00.827940+0000","last_clean_scrub_stamp":"2024-09-22T08:40:00.827940+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:40:56.353569+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"32'2","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:48.649611+0000","last_change":"2024-09-22T08:39:48.649611+0000","last_active":"2024-09-22T08:39:48.649611+0000","last_peered":"2024-09-22T08:39:48.649611+0000","last_clean":"2024-09-22T08:39:48.649611+0000","last_became_active":"2024-09-22T08:36:23.973601+0000","last_became_peered":"2024-09-22T08:36:23.973601+0000","last_unstale":"2024-09-22T08:39:48.649611+0000","last_undegraded":"2024-09-22T08:39:48.649611+0000","last_fullsized":"2024-09-22T08:39:48.649611+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-22T08:39:48.649523+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-22T08:39:48.649523+0000","last_clean_scrub_stamp":"2024-09-22T08:39:48.649523+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:10:59.136925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:12.389179+0000","last_change":"2024-09-22T08:40:12.389179+0000","last_active":"2024-09-22T08:40:12.389179+0000","last_peered":"2024-09-22T08:40:12.389179+0000","last_clean":"2024-09-22T08:40:12.389179+0000","last_became_active":"2024-09-22T08:36:27.986100+0000","last_became_peered":"2024-09-22T08:36:27.986100+0000","last_unstale":"2024-09-22T08:40:12.389179+0000","last_undegraded":"2024-09-22T08:40:12.389179+0000","last_fullsized":"2024-09-22T08:40:12.389179+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:12.389091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:12.389091+0000","last_clean_scrub_stamp":"2024-09-22T08:40:12.389091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:52:51.243229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"32'49","reported_seq":121,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:22.891970+0000","last_change":"2024-09-22T08:40:22.891970+0000","last_active":"2024-09-22T08:40:22.891970+0000","last_peered":"2024-09-22T08:40:22.891970+0000","last_clean":"2024-09-22T08:40:22.891970+0000","last_became_active":"2024-09-22T08:36:29.991732+0000","last_became_peered":"2024-09-22T08:36:29.991732+0000","last_unstale":"2024-09-22T08:40:22.891970+0000","last_undegraded":"2024-09-22T08:40:22.891970+0000","last_fullsized":"2024-09-22T08:40:22.891970+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'49","last_scrub_stamp":"2024-09-22T08:40:22.891866+0000","last_deep_scrub":"32'49","last_deep_scrub_stamp":"2024-09-22T08:40:22.891866+0000","last_clean_scrub_stamp":"2024-09-22T08:40:22.891866+0000","objects_scrubbed":6,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:30:36.940890+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":706,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.221450+0000","last_change":"2024-09-22T08:36:32.003244+0000","last_active":"2024-09-22T08:37:04.221450+0000","last_peered":"2024-09-22T08:37:04.221450+0000","last_clean":"2024-09-22T08:37:04.221450+0000","last_became_active":"2024-09-22T08:36:32.002970+0000","last_became_peered":"2024-09-22T08:36:32.002970+0000","last_unstale":"2024-09-22T08:37:04.221450+0000","last_undegraded":"2024-09-22T08:37:04.221450+0000","last_fullsized":"2024-09-22T08:37:04.221450+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:19:57.326474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"32'4","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.344891+0000","last_change":"2024-09-22T08:36:34.016939+0000","last_active":"2024-09-22T08:39:32.344891+0000","last_peered":"2024-09-22T08:39:32.344891+0000","last_clean":"2024-09-22T08:39:32.344891+0000","last_became_active":"2024-09-22T08:36:34.016379+0000","last_became_peered":"2024-09-22T08:36:34.016379+0000","last_unstale":"2024-09-22T08:39:32.344891+0000","last_undegraded":"2024-09-22T08:39:32.344891+0000","last_fullsized":"2024-09-22T08:39:32.344891+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:50:54.870215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":421,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"32'6","reported_seq":71,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:15.475301+0000","last_change":"2024-09-22T08:40:15.475301+0000","last_active":"2024-09-22T08:40:15.475301+0000","last_peered":"2024-09-22T08:40:15.475301+0000","last_clean":"2024-09-22T08:40:15.475301+0000","last_became_active":"2024-09-22T08:36:25.988569+0000","last_became_peered":"2024-09-22T08:36:25.988569+0000","last_unstale":"2024-09-22T08:40:15.475301+0000","last_undegraded":"2024-09-22T08:40:15.475301+0000","last_fullsized":"2024-09-22T08:40:15.475301+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-22T08:40:15.475202+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-22T08:40:15.475202+0000","last_clean_scrub_stamp":"2024-09-22T08:40:15.475202+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:59:43.068621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:47.114544+0000","last_change":"2024-09-22T08:39:47.114544+0000","last_active":"2024-09-22T08:39:47.114544+0000","last_peered":"2024-09-22T08:39:47.114544+0000","last_clean":"2024-09-22T08:39:47.114544+0000","last_became_active":"2024-09-22T08:36:23.977355+0000","last_became_peered":"2024-09-22T08:36:23.977355+0000","last_unstale":"2024-09-22T08:39:47.114544+0000","last_undegraded":"2024-09-22T08:39:47.114544+0000","last_fullsized":"2024-09-22T08:39:47.114544+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:39:47.114458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:39:47.114458+0000","last_clean_scrub_stamp":"2024-09-22T08:39:47.114458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:39:28.221096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"32'4","reported_seq":229,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:38.795223+0000","last_change":"2024-09-22T08:36:27.987952+0000","last_active":"2024-09-22T08:39:38.795223+0000","last_peered":"2024-09-22T08:39:38.795223+0000","last_clean":"2024-09-22T08:39:38.795223+0000","last_became_active":"2024-09-22T08:36:27.987561+0000","last_became_peered":"2024-09-22T08:36:27.987561+0000","last_unstale":"2024-09-22T08:39:38.795223+0000","last_undegraded":"2024-09-22T08:39:38.795223+0000","last_fullsized":"2024-09-22T08:39:38.795223+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_clean_scrub_stamp":"2024-09-22T08:36:26.962226+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:59:38.794944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"32'34","reported_seq":81,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:38.917623+0000","last_change":"2024-09-22T08:36:29.989156+0000","last_active":"2024-09-22T08:39:38.917623+0000","last_peered":"2024-09-22T08:39:38.917623+0000","last_clean":"2024-09-22T08:39:38.917623+0000","last_became_active":"2024-09-22T08:36:29.988607+0000","last_became_peered":"2024-09-22T08:36:29.988607+0000","last_unstale":"2024-09-22T08:39:38.917623+0000","last_undegraded":"2024-09-22T08:39:38.917623+0000","last_fullsized":"2024-09-22T08:39:38.917623+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:59:53.178494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.225600+0000","last_change":"2024-09-22T08:36:32.003908+0000","last_active":"2024-09-22T08:37:04.225600+0000","last_peered":"2024-09-22T08:37:04.225600+0000","last_clean":"2024-09-22T08:37:04.225600+0000","last_became_active":"2024-09-22T08:36:32.003651+0000","last_became_peered":"2024-09-22T08:36:32.003651+0000","last_unstale":"2024-09-22T08:37:04.225600+0000","last_undegraded":"2024-09-22T08:37:04.225600+0000","last_fullsized":"2024-09-22T08:37:04.225600+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:39:25.611419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"32'10","reported_seq":73,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:19.534441+0000","last_change":"2024-09-22T08:40:19.534441+0000","last_active":"2024-09-22T08:40:19.534441+0000","last_peered":"2024-09-22T08:40:19.534441+0000","last_clean":"2024-09-22T08:40:19.534441+0000","last_became_active":"2024-09-22T08:36:25.989711+0000","last_became_peered":"2024-09-22T08:36:25.989711+0000","last_unstale":"2024-09-22T08:40:19.534441+0000","last_undegraded":"2024-09-22T08:40:19.534441+0000","last_fullsized":"2024-09-22T08:40:19.534441+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-09-22T08:40:19.534321+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-09-22T08:40:19.534321+0000","last_clean_scrub_stamp":"2024-09-22T08:40:19.534321+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:34:03.499705+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:57.304514+0000","last_change":"2024-09-22T08:39:57.304514+0000","last_active":"2024-09-22T08:39:57.304514+0000","last_peered":"2024-09-22T08:39:57.304514+0000","last_clean":"2024-09-22T08:39:57.304514+0000","last_became_active":"2024-09-22T08:36:23.976361+0000","last_became_peered":"2024-09-22T08:36:23.976361+0000","last_unstale":"2024-09-22T08:39:57.304514+0000","last_undegraded":"2024-09-22T08:39:57.304514+0000","last_fullsized":"2024-09-22T08:39:57.304514+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:39:57.304420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:39:57.304420+0000","last_clean_scrub_stamp":"2024-09-22T08:39:57.304420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:50:11.471353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:19.885352+0000","last_change":"2024-09-22T08:40:19.885352+0000","last_active":"2024-09-22T08:40:19.885352+0000","last_peered":"2024-09-22T08:40:19.885352+0000","last_clean":"2024-09-22T08:40:19.885352+0000","last_became_active":"2024-09-22T08:36:27.987981+0000","last_became_peered":"2024-09-22T08:36:27.987981+0000","last_unstale":"2024-09-22T08:40:19.885352+0000","last_undegraded":"2024-09-22T08:40:19.885352+0000","last_fullsized":"2024-09-22T08:40:19.885352+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:19.885257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:19.885257+0000","last_clean_scrub_stamp":"2024-09-22T08:40:19.885257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:15:54.517108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"32'61","reported_seq":126,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:38.914421+0000","last_change":"2024-09-22T08:36:29.990823+0000","last_active":"2024-09-22T08:39:38.914421+0000","last_peered":"2024-09-22T08:39:38.914421+0000","last_clean":"2024-09-22T08:39:38.914421+0000","last_became_active":"2024-09-22T08:36:29.990585+0000","last_became_peered":"2024-09-22T08:36:29.990585+0000","last_unstale":"2024-09-22T08:39:38.914421+0000","last_undegraded":"2024-09-22T08:39:38.914421+0000","last_fullsized":"2024-09-22T08:39:38.914421+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:09:56.176060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.226461+0000","last_change":"2024-09-22T08:36:32.007693+0000","last_active":"2024-09-22T08:37:04.226461+0000","last_peered":"2024-09-22T08:37:04.226461+0000","last_clean":"2024-09-22T08:37:04.226461+0000","last_became_active":"2024-09-22T08:36:32.007448+0000","last_became_peered":"2024-09-22T08:36:32.007448+0000","last_unstale":"2024-09-22T08:37:04.226461+0000","last_undegraded":"2024-09-22T08:37:04.226461+0000","last_fullsized":"2024-09-22T08:37:04.226461+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:30:19.529413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"32'16","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.263979+0000","last_change":"2024-09-22T08:36:34.017989+0000","last_active":"2024-09-22T08:39:32.263979+0000","last_peered":"2024-09-22T08:39:32.263979+0000","last_clean":"2024-09-22T08:39:32.263979+0000","last_became_active":"2024-09-22T08:36:34.017689+0000","last_became_peered":"2024-09-22T08:36:34.017689+0000","last_unstale":"2024-09-22T08:39:32.263979+0000","last_undegraded":"2024-09-22T08:39:32.263979+0000","last_fullsized":"2024-09-22T08:39:32.263979+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:59:28.875467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":21,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"32'2","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:05.795366+0000","last_change":"2024-09-22T08:40:05.795366+0000","last_active":"2024-09-22T08:40:05.795366+0000","last_peered":"2024-09-22T08:40:05.795366+0000","last_clean":"2024-09-22T08:40:05.795366+0000","last_became_active":"2024-09-22T08:36:25.977881+0000","last_became_peered":"2024-09-22T08:36:25.977881+0000","last_unstale":"2024-09-22T08:40:05.795366+0000","last_undegraded":"2024-09-22T08:40:05.795366+0000","last_fullsized":"2024-09-22T08:40:05.795366+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-22T08:40:05.795277+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-22T08:40:05.795277+0000","last_clean_scrub_stamp":"2024-09-22T08:40:05.795277+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:18:12.135810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:48.136157+0000","last_change":"2024-09-22T08:39:48.136157+0000","last_active":"2024-09-22T08:39:48.136157+0000","last_peered":"2024-09-22T08:39:48.136157+0000","last_clean":"2024-09-22T08:39:48.136157+0000","last_became_active":"2024-09-22T08:36:23.974809+0000","last_became_peered":"2024-09-22T08:36:23.974809+0000","last_unstale":"2024-09-22T08:39:48.136157+0000","last_undegraded":"2024-09-22T08:39:48.136157+0000","last_fullsized":"2024-09-22T08:39:48.136157+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:39:48.136054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:39:48.136054+0000","last_clean_scrub_stamp":"2024-09-22T08:39:48.136054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:46:14.769669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:15.386312+0000","last_change":"2024-09-22T08:40:15.386312+0000","last_active":"2024-09-22T08:40:15.386312+0000","last_peered":"2024-09-22T08:40:15.386312+0000","last_clean":"2024-09-22T08:40:15.386312+0000","last_became_active":"2024-09-22T08:36:27.986957+0000","last_became_peered":"2024-09-22T08:36:27.986957+0000","last_unstale":"2024-09-22T08:40:15.386312+0000","last_undegraded":"2024-09-22T08:40:15.386312+0000","last_fullsized":"2024-09-22T08:40:15.386312+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:15.386197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:15.386197+0000","last_clean_scrub_stamp":"2024-09-22T08:40:15.386197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:59:57.699145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"32'39","reported_seq":89,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:38.920740+0000","last_change":"2024-09-22T08:36:29.998426+0000","last_active":"2024-09-22T08:39:38.920740+0000","last_peered":"2024-09-22T08:39:38.920740+0000","last_clean":"2024-09-22T08:39:38.920740+0000","last_became_active":"2024-09-22T08:36:29.997527+0000","last_became_peered":"2024-09-22T08:36:29.997527+0000","last_unstale":"2024-09-22T08:39:38.920740+0000","last_undegraded":"2024-09-22T08:39:38.920740+0000","last_fullsized":"2024-09-22T08:39:38.920740+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:26:30.343603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.224280+0000","last_change":"2024-09-22T08:36:32.005672+0000","last_active":"2024-09-22T08:37:04.224280+0000","last_peered":"2024-09-22T08:37:04.224280+0000","last_clean":"2024-09-22T08:37:04.224280+0000","last_became_active":"2024-09-22T08:36:32.005383+0000","last_became_peered":"2024-09-22T08:36:32.005383+0000","last_unstale":"2024-09-22T08:37:04.224280+0000","last_undegraded":"2024-09-22T08:37:04.224280+0000","last_fullsized":"2024-09-22T08:37:04.224280+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:13:26.905617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.227134+0000","last_change":"2024-09-22T08:36:34.013499+0000","last_active":"2024-09-22T08:37:04.227134+0000","last_peered":"2024-09-22T08:37:04.227134+0000","last_clean":"2024-09-22T08:37:04.227134+0000","last_became_active":"2024-09-22T08:36:34.013204+0000","last_became_peered":"2024-09-22T08:36:34.013204+0000","last_unstale":"2024-09-22T08:37:04.227134+0000","last_undegraded":"2024-09-22T08:37:04.227134+0000","last_fullsized":"2024-09-22T08:37:04.227134+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:37:55.724456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"32'14","reported_seq":74,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:18.502364+0000","last_change":"2024-09-22T08:40:18.502364+0000","last_active":"2024-09-22T08:40:18.502364+0000","last_peered":"2024-09-22T08:40:18.502364+0000","last_clean":"2024-09-22T08:40:18.502364+0000","last_became_active":"2024-09-22T08:36:25.993170+0000","last_became_peered":"2024-09-22T08:36:25.993170+0000","last_unstale":"2024-09-22T08:40:18.502364+0000","last_undegraded":"2024-09-22T08:40:18.502364+0000","last_fullsized":"2024-09-22T08:40:18.502364+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'14","last_scrub_stamp":"2024-09-22T08:40:18.502275+0000","last_deep_scrub":"32'14","last_deep_scrub_stamp":"2024-09-22T08:40:18.502275+0000","last_clean_scrub_stamp":"2024-09-22T08:40:18.502275+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:35:17.727896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":38,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:49.125470+0000","last_change":"2024-09-22T08:39:49.125470+0000","last_active":"2024-09-22T08:39:49.125470+0000","last_peered":"2024-09-22T08:39:49.125470+0000","last_clean":"2024-09-22T08:39:49.125470+0000","last_became_active":"2024-09-22T08:36:23.968207+0000","last_became_peered":"2024-09-22T08:36:23.968207+0000","last_unstale":"2024-09-22T08:39:49.125470+0000","last_undegraded":"2024-09-22T08:39:49.125470+0000","last_fullsized":"2024-09-22T08:39:49.125470+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:39:49.125386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:39:49.125386+0000","last_clean_scrub_stamp":"2024-09-22T08:39:49.125386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:25:13.108318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:14.421686+0000","last_change":"2024-09-22T08:40:14.421686+0000","last_active":"2024-09-22T08:40:14.421686+0000","last_peered":"2024-09-22T08:40:14.421686+0000","last_clean":"2024-09-22T08:40:14.421686+0000","last_became_active":"2024-09-22T08:36:27.985679+0000","last_became_peered":"2024-09-22T08:36:27.985679+0000","last_unstale":"2024-09-22T08:40:14.421686+0000","last_undegraded":"2024-09-22T08:40:14.421686+0000","last_fullsized":"2024-09-22T08:40:14.421686+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:14.421600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:14.421600+0000","last_clean_scrub_stamp":"2024-09-22T08:40:14.421600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:31:50.278835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"32'35","reported_seq":83,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:38.874031+0000","last_change":"2024-09-22T08:36:29.994386+0000","last_active":"2024-09-22T08:39:38.874031+0000","last_peered":"2024-09-22T08:39:38.874031+0000","last_clean":"2024-09-22T08:39:38.874031+0000","last_became_active":"2024-09-22T08:36:29.994075+0000","last_became_peered":"2024-09-22T08:36:29.994075+0000","last_unstale":"2024-09-22T08:39:38.874031+0000","last_undegraded":"2024-09-22T08:39:38.874031+0000","last_fullsized":"2024-09-22T08:39:38.874031+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:01:51.899745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.225288+0000","last_change":"2024-09-22T08:36:32.005675+0000","last_active":"2024-09-22T08:37:04.225288+0000","last_peered":"2024-09-22T08:37:04.225288+0000","last_clean":"2024-09-22T08:37:04.225288+0000","last_became_active":"2024-09-22T08:36:32.005166+0000","last_became_peered":"2024-09-22T08:36:32.005166+0000","last_unstale":"2024-09-22T08:37:04.225288+0000","last_undegraded":"2024-09-22T08:37:04.225288+0000","last_fullsized":"2024-09-22T08:37:04.225288+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:04:54.919867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"32'7","reported_seq":25,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.093378+0000","last_change":"2024-09-22T08:36:34.014540+0000","last_active":"2024-09-22T08:39:32.093378+0000","last_peered":"2024-09-22T08:39:32.093378+0000","last_clean":"2024-09-22T08:39:32.093378+0000","last_became_active":"2024-09-22T08:36:34.014255+0000","last_became_peered":"2024-09-22T08:36:34.014255+0000","last_unstale":"2024-09-22T08:39:32.093378+0000","last_undegraded":"2024-09-22T08:39:32.093378+0000","last_fullsized":"2024-09-22T08:39:32.093378+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:47:25.081359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"32'4","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:03.793636+0000","last_change":"2024-09-22T08:40:03.793636+0000","last_active":"2024-09-22T08:40:03.793636+0000","last_peered":"2024-09-22T08:40:03.793636+0000","last_clean":"2024-09-22T08:40:03.793636+0000","last_became_active":"2024-09-22T08:36:25.978577+0000","last_became_peered":"2024-09-22T08:36:25.978577+0000","last_unstale":"2024-09-22T08:40:03.793636+0000","last_undegraded":"2024-09-22T08:40:03.793636+0000","last_fullsized":"2024-09-22T08:40:03.793636+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-22T08:40:03.793512+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-22T08:40:03.793512+0000","last_clean_scrub_stamp":"2024-09-22T08:40:03.793512+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:00:34.051924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"32'2","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:48.833986+0000","last_change":"2024-09-22T08:39:48.833986+0000","last_active":"2024-09-22T08:39:48.833986+0000","last_peered":"2024-09-22T08:39:48.833986+0000","last_clean":"2024-09-22T08:39:48.833986+0000","last_became_active":"2024-09-22T08:37:04.226169+0000","last_became_peered":"2024-09-22T08:37:04.226169+0000","last_unstale":"2024-09-22T08:39:48.833986+0000","last_undegraded":"2024-09-22T08:39:48.833986+0000","last_fullsized":"2024-09-22T08:39:48.833986+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-22T08:39:48.833881+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-22T08:39:48.833881+0000","last_clean_scrub_stamp":"2024-09-22T08:39:48.833881+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:03:32.581894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.223988+0000","last_change":"2024-09-22T08:36:27.990314+0000","last_active":"2024-09-22T08:37:04.223988+0000","last_peered":"2024-09-22T08:37:04.223988+0000","last_clean":"2024-09-22T08:37:04.223988+0000","last_became_active":"2024-09-22T08:36:27.990038+0000","last_became_peered":"2024-09-22T08:36:27.990038+0000","last_unstale":"2024-09-22T08:37:04.223988+0000","last_undegraded":"2024-09-22T08:37:04.223988+0000","last_fullsized":"2024-09-22T08:37:04.223988+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_clean_scrub_stamp":"2024-09-22T08:36:26.962226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:42:33.084977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"30'10","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.227216+0000","last_change":"2024-09-22T08:36:29.997480+0000","last_active":"2024-09-22T08:37:04.227216+0000","last_peered":"2024-09-22T08:37:04.227216+0000","last_clean":"2024-09-22T08:37:04.227216+0000","last_became_active":"2024-09-22T08:36:29.997179+0000","last_became_peered":"2024-09-22T08:36:29.997179+0000","last_unstale":"2024-09-22T08:37:04.227216+0000","last_undegraded":"2024-09-22T08:37:04.227216+0000","last_fullsized":"2024-09-22T08:37:04.227216+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:42:36.332989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"32'285","reported_seq":369,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:38.821270+0000","last_change":"2024-09-22T08:36:32.012171+0000","last_active":"2024-09-22T08:39:38.821270+0000","last_peered":"2024-09-22T08:39:38.821270+0000","last_clean":"2024-09-22T08:39:38.821270+0000","last_became_active":"2024-09-22T08:36:32.011870+0000","last_became_peered":"2024-09-22T08:36:32.011870+0000","last_unstale":"2024-09-22T08:39:38.821270+0000","last_undegraded":"2024-09-22T08:39:38.821270+0000","last_fullsized":"2024-09-22T08:39:38.821270+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:20:17.853772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"32'2","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.248674+0000","last_change":"2024-09-22T08:36:34.013756+0000","last_active":"2024-09-22T08:39:32.248674+0000","last_peered":"2024-09-22T08:39:32.248674+0000","last_clean":"2024-09-22T08:39:32.248674+0000","last_became_active":"2024-09-22T08:36:34.013380+0000","last_became_peered":"2024-09-22T08:36:34.013380+0000","last_unstale":"2024-09-22T08:39:32.248674+0000","last_undegraded":"2024-09-22T08:39:32.248674+0000","last_fullsized":"2024-09-22T08:39:32.248674+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:26:36.228816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"32'8","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:07.397444+0000","last_change":"2024-09-22T08:40:07.397444+0000","last_active":"2024-09-22T08:40:07.397444+0000","last_peered":"2024-09-22T08:40:07.397444+0000","last_clean":"2024-09-22T08:40:07.397444+0000","last_became_active":"2024-09-22T08:36:25.971327+0000","last_became_peered":"2024-09-22T08:36:25.971327+0000","last_unstale":"2024-09-22T08:40:07.397444+0000","last_undegraded":"2024-09-22T08:40:07.397444+0000","last_fullsized":"2024-09-22T08:40:07.397444+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-22T08:40:07.397356+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-22T08:40:07.397356+0000","last_clean_scrub_stamp":"2024-09-22T08:40:07.397356+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:37:27.086026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:50.109978+0000","last_change":"2024-09-22T08:39:50.109978+0000","last_active":"2024-09-22T08:39:50.109978+0000","last_peered":"2024-09-22T08:39:50.109978+0000","last_clean":"2024-09-22T08:39:50.109978+0000","last_became_active":"2024-09-22T08:36:23.978006+0000","last_became_peered":"2024-09-22T08:36:23.978006+0000","last_unstale":"2024-09-22T08:39:50.109978+0000","last_undegraded":"2024-09-22T08:39:50.109978+0000","last_fullsized":"2024-09-22T08:39:50.109978+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-22T08:39:50.109878+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-22T08:39:50.109878+0000","last_clean_scrub_stamp":"2024-09-22T08:39:50.109878+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:37:09.798548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.222677+0000","last_change":"2024-09-22T08:36:27.991045+0000","last_active":"2024-09-22T08:37:04.222677+0000","last_peered":"2024-09-22T08:37:04.222677+0000","last_clean":"2024-09-22T08:37:04.222677+0000","last_became_active":"2024-09-22T08:36:27.990729+0000","last_became_peered":"2024-09-22T08:36:27.990729+0000","last_unstale":"2024-09-22T08:37:04.222677+0000","last_undegraded":"2024-09-22T08:37:04.222677+0000","last_fullsized":"2024-09-22T08:37:04.222677+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_clean_scrub_stamp":"2024-09-22T08:36:26.962226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:27:20.880200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"32'39","reported_seq":89,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:38.893091+0000","last_change":"2024-09-22T08:36:29.987777+0000","last_active":"2024-09-22T08:39:38.893091+0000","last_peered":"2024-09-22T08:39:38.893091+0000","last_clean":"2024-09-22T08:39:38.893091+0000","last_became_active":"2024-09-22T08:36:29.987459+0000","last_became_peered":"2024-09-22T08:36:29.987459+0000","last_unstale":"2024-09-22T08:39:38.893091+0000","last_undegraded":"2024-09-22T08:39:38.893091+0000","last_fullsized":"2024-09-22T08:39:38.893091+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:30:17.280632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.222754+0000","last_change":"2024-09-22T08:36:32.003472+0000","last_active":"2024-09-22T08:37:04.222754+0000","last_peered":"2024-09-22T08:37:04.222754+0000","last_clean":"2024-09-22T08:37:04.222754+0000","last_became_active":"2024-09-22T08:36:32.003196+0000","last_became_peered":"2024-09-22T08:36:32.003196+0000","last_unstale":"2024-09-22T08:37:04.222754+0000","last_undegraded":"2024-09-22T08:37:04.222754+0000","last_fullsized":"2024-09-22T08:37:04.222754+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:42:54.487167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.223793+0000","last_change":"2024-09-22T08:36:34.016292+0000","last_active":"2024-09-22T08:37:04.223793+0000","last_peered":"2024-09-22T08:37:04.223793+0000","last_clean":"2024-09-22T08:37:04.223793+0000","last_became_active":"2024-09-22T08:36:34.015988+0000","last_became_peered":"2024-09-22T08:36:34.015988+0000","last_unstale":"2024-09-22T08:37:04.223793+0000","last_undegraded":"2024-09-22T08:37:04.223793+0000","last_fullsized":"2024-09-22T08:37:04.223793+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:16:42.030515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"32'4","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:03.357413+0000","last_change":"2024-09-22T08:40:03.357413+0000","last_active":"2024-09-22T08:40:03.357413+0000","last_peered":"2024-09-22T08:40:03.357413+0000","last_clean":"2024-09-22T08:40:03.357413+0000","last_became_active":"2024-09-22T08:36:25.972149+0000","last_became_peered":"2024-09-22T08:36:25.972149+0000","last_unstale":"2024-09-22T08:40:03.357413+0000","last_undegraded":"2024-09-22T08:40:03.357413+0000","last_fullsized":"2024-09-22T08:40:03.357413+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-22T08:40:03.357323+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-22T08:40:03.357323+0000","last_clean_scrub_stamp":"2024-09-22T08:40:03.357323+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:00:50.517267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"32'2","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:59.302310+0000","last_change":"2024-09-22T08:39:59.302310+0000","last_active":"2024-09-22T08:39:59.302310+0000","last_peered":"2024-09-22T08:39:59.302310+0000","last_clean":"2024-09-22T08:39:59.302310+0000","last_became_active":"2024-09-22T08:36:23.982545+0000","last_became_peered":"2024-09-22T08:36:23.982545+0000","last_unstale":"2024-09-22T08:39:59.302310+0000","last_undegraded":"2024-09-22T08:39:59.302310+0000","last_fullsized":"2024-09-22T08:39:59.302310+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-22T08:39:59.302226+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-22T08:39:59.302226+0000","last_clean_scrub_stamp":"2024-09-22T08:39:59.302226+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:17:21.833960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:13.410180+0000","last_change":"2024-09-22T08:40:13.410180+0000","last_active":"2024-09-22T08:40:13.410180+0000","last_peered":"2024-09-22T08:40:13.410180+0000","last_clean":"2024-09-22T08:40:13.410180+0000","last_became_active":"2024-09-22T08:36:27.989495+0000","last_became_peered":"2024-09-22T08:36:27.989495+0000","last_unstale":"2024-09-22T08:40:13.410180+0000","last_undegraded":"2024-09-22T08:40:13.410180+0000","last_fullsized":"2024-09-22T08:40:13.410180+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:13.410093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:13.410093+0000","last_clean_scrub_stamp":"2024-09-22T08:40:13.410093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:27:10.709987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"32'33","reported_seq":80,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:38.896594+0000","last_change":"2024-09-22T08:36:29.994337+0000","last_active":"2024-09-22T08:39:38.896594+0000","last_peered":"2024-09-22T08:39:38.896594+0000","last_clean":"2024-09-22T08:39:38.896594+0000","last_became_active":"2024-09-22T08:36:29.994101+0000","last_became_peered":"2024-09-22T08:36:29.994101+0000","last_unstale":"2024-09-22T08:39:38.896594+0000","last_undegraded":"2024-09-22T08:39:38.896594+0000","last_fullsized":"2024-09-22T08:39:38.896594+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:40:06.073383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.230375+0000","last_change":"2024-09-22T08:36:32.012960+0000","last_active":"2024-09-22T08:37:04.230375+0000","last_peered":"2024-09-22T08:37:04.230375+0000","last_clean":"2024-09-22T08:37:04.230375+0000","last_became_active":"2024-09-22T08:36:32.011811+0000","last_became_peered":"2024-09-22T08:36:32.011811+0000","last_unstale":"2024-09-22T08:37:04.230375+0000","last_undegraded":"2024-09-22T08:37:04.230375+0000","last_fullsized":"2024-09-22T08:37:04.230375+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:13:22.789596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"32'2","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:05.456749+0000","last_change":"2024-09-22T08:36:34.020146+0000","last_active":"2024-09-22T08:37:05.456749+0000","last_peered":"2024-09-22T08:37:05.456749+0000","last_clean":"2024-09-22T08:37:05.456749+0000","last_became_active":"2024-09-22T08:36:34.019866+0000","last_became_peered":"2024-09-22T08:36:34.019866+0000","last_unstale":"2024-09-22T08:37:05.456749+0000","last_undegraded":"2024-09-22T08:37:05.456749+0000","last_fullsized":"2024-09-22T08:37:05.456749+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:56:15.623151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"32'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:17.499349+0000","last_change":"2024-09-22T08:40:17.499349+0000","last_active":"2024-09-22T08:40:17.499349+0000","last_peered":"2024-09-22T08:40:17.499349+0000","last_clean":"2024-09-22T08:40:17.499349+0000","last_became_active":"2024-09-22T08:36:25.989572+0000","last_became_peered":"2024-09-22T08:36:25.989572+0000","last_unstale":"2024-09-22T08:40:17.499349+0000","last_undegraded":"2024-09-22T08:40:17.499349+0000","last_fullsized":"2024-09-22T08:40:17.499349+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-22T08:40:17.499263+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-22T08:40:17.499263+0000","last_clean_scrub_stamp":"2024-09-22T08:40:17.499263+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:38:33.473092+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:49.815491+0000","last_change":"2024-09-22T08:39:49.815491+0000","last_active":"2024-09-22T08:39:49.815491+0000","last_peered":"2024-09-22T08:39:49.815491+0000","last_clean":"2024-09-22T08:39:49.815491+0000","last_became_active":"2024-09-22T08:36:23.971012+0000","last_became_peered":"2024-09-22T08:36:23.971012+0000","last_unstale":"2024-09-22T08:39:49.815491+0000","last_undegraded":"2024-09-22T08:39:49.815491+0000","last_fullsized":"2024-09-22T08:39:49.815491+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:39:49.815399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:39:49.815399+0000","last_clean_scrub_stamp":"2024-09-22T08:39:49.815399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:29:53.053729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.222066+0000","last_change":"2024-09-22T08:36:27.987755+0000","last_active":"2024-09-22T08:37:04.222066+0000","last_peered":"2024-09-22T08:37:04.222066+0000","last_clean":"2024-09-22T08:37:04.222066+0000","last_became_active":"2024-09-22T08:36:27.987504+0000","last_became_peered":"2024-09-22T08:36:27.987504+0000","last_unstale":"2024-09-22T08:37:04.222066+0000","last_undegraded":"2024-09-22T08:37:04.222066+0000","last_fullsized":"2024-09-22T08:37:04.222066+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_clean_scrub_stamp":"2024-09-22T08:36:26.962226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:39:03.985092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"32'29","reported_seq":74,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:38.971363+0000","last_change":"2024-09-22T08:36:29.998167+0000","last_active":"2024-09-22T08:39:38.971363+0000","last_peered":"2024-09-22T08:39:38.971363+0000","last_clean":"2024-09-22T08:39:38.971363+0000","last_became_active":"2024-09-22T08:36:29.997853+0000","last_became_peered":"2024-09-22T08:36:29.997853+0000","last_unstale":"2024-09-22T08:39:38.971363+0000","last_undegraded":"2024-09-22T08:39:38.971363+0000","last_fullsized":"2024-09-22T08:39:38.971363+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:34:13.019632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.227451+0000","last_change":"2024-09-22T08:36:32.012262+0000","last_active":"2024-09-22T08:37:04.227451+0000","last_peered":"2024-09-22T08:37:04.227451+0000","last_clean":"2024-09-22T08:37:04.227451+0000","last_became_active":"2024-09-22T08:36:32.011960+0000","last_became_peered":"2024-09-22T08:36:32.011960+0000","last_unstale":"2024-09-22T08:37:04.227451+0000","last_undegraded":"2024-09-22T08:37:04.227451+0000","last_fullsized":"2024-09-22T08:37:04.227451+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:58:25.357801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"32'16","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:30.267408+0000","last_change":"2024-09-22T08:36:34.018605+0000","last_active":"2024-09-22T08:38:30.267408+0000","last_peered":"2024-09-22T08:38:30.267408+0000","last_clean":"2024-09-22T08:38:30.267408+0000","last_became_active":"2024-09-22T08:36:34.018365+0000","last_became_peered":"2024-09-22T08:36:34.018365+0000","last_unstale":"2024-09-22T08:38:30.267408+0000","last_undegraded":"2024-09-22T08:38:30.267408+0000","last_fullsized":"2024-09-22T08:38:30.267408+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:01:49.722849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":96,"num_read_kb":76,"num_write":46,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"32'8","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:02.399251+0000","last_change":"2024-09-22T08:40:02.399251+0000","last_active":"2024-09-22T08:40:02.399251+0000","last_peered":"2024-09-22T08:40:02.399251+0000","last_clean":"2024-09-22T08:40:02.399251+0000","last_became_active":"2024-09-22T08:36:25.973089+0000","last_became_peered":"2024-09-22T08:36:25.973089+0000","last_unstale":"2024-09-22T08:40:02.399251+0000","last_undegraded":"2024-09-22T08:40:02.399251+0000","last_fullsized":"2024-09-22T08:40:02.399251+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-22T08:40:02.399133+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-22T08:40:02.399133+0000","last_clean_scrub_stamp":"2024-09-22T08:40:02.399133+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:04:36.042470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"32'2","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:51.156994+0000","last_change":"2024-09-22T08:39:51.156994+0000","last_active":"2024-09-22T08:39:51.156994+0000","last_peered":"2024-09-22T08:39:51.156994+0000","last_clean":"2024-09-22T08:39:51.156994+0000","last_became_active":"2024-09-22T08:36:23.968249+0000","last_became_peered":"2024-09-22T08:36:23.968249+0000","last_unstale":"2024-09-22T08:39:51.156994+0000","last_undegraded":"2024-09-22T08:39:51.156994+0000","last_fullsized":"2024-09-22T08:39:51.156994+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-22T08:39:51.156910+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-22T08:39:51.156910+0000","last_clean_scrub_stamp":"2024-09-22T08:39:51.156910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:55:37.836983+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"32'2","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:28.952357+0000","last_change":"2024-09-22T08:36:27.988537+0000","last_active":"2024-09-22T08:38:28.952357+0000","last_peered":"2024-09-22T08:38:28.952357+0000","last_clean":"2024-09-22T08:38:28.952357+0000","last_became_active":"2024-09-22T08:36:27.988262+0000","last_became_peered":"2024-09-22T08:36:27.988262+0000","last_unstale":"2024-09-22T08:38:28.952357+0000","last_undegraded":"2024-09-22T08:38:28.952357+0000","last_fullsized":"2024-09-22T08:38:28.952357+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:26.962226+0000","last_clean_scrub_stamp":"2024-09-22T08:36:26.962226+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:27:56.322995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"32'35","reported_seq":84,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:38.877181+0000","last_change":"2024-09-22T08:36:29.997925+0000","last_active":"2024-09-22T08:39:38.877181+0000","last_peered":"2024-09-22T08:39:38.877181+0000","last_clean":"2024-09-22T08:39:38.877181+0000","last_became_active":"2024-09-22T08:36:29.997231+0000","last_became_peered":"2024-09-22T08:36:29.997231+0000","last_unstale":"2024-09-22T08:39:38.877181+0000","last_undegraded":"2024-09-22T08:39:38.877181+0000","last_fullsized":"2024-09-22T08:39:38.877181+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:37:27.208598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.224156+0000","last_change":"2024-09-22T08:36:32.004965+0000","last_active":"2024-09-22T08:37:04.224156+0000","last_peered":"2024-09-22T08:37:04.224156+0000","last_clean":"2024-09-22T08:37:04.224156+0000","last_became_active":"2024-09-22T08:36:32.004365+0000","last_became_peered":"2024-09-22T08:36:32.004365+0000","last_unstale":"2024-09-22T08:37:04.224156+0000","last_undegraded":"2024-09-22T08:37:04.224156+0000","last_fullsized":"2024-09-22T08:37:04.224156+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:02:38.800242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"32'4","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:30.270088+0000","last_change":"2024-09-22T08:36:34.016625+0000","last_active":"2024-09-22T08:38:30.270088+0000","last_peered":"2024-09-22T08:38:30.270088+0000","last_clean":"2024-09-22T08:38:30.270088+0000","last_became_active":"2024-09-22T08:36:34.016106+0000","last_became_peered":"2024-09-22T08:36:34.016106+0000","last_unstale":"2024-09-22T08:38:30.270088+0000","last_undegraded":"2024-09-22T08:38:30.270088+0000","last_fullsized":"2024-09-22T08:38:30.270088+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:10:10.424019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"32'12","reported_seq":78,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:06.403598+0000","last_change":"2024-09-22T08:40:06.403598+0000","last_active":"2024-09-22T08:40:06.403598+0000","last_peered":"2024-09-22T08:40:06.403598+0000","last_clean":"2024-09-22T08:40:06.403598+0000","last_became_active":"2024-09-22T08:36:25.987161+0000","last_became_peered":"2024-09-22T08:36:25.987161+0000","last_unstale":"2024-09-22T08:40:06.403598+0000","last_undegraded":"2024-09-22T08:40:06.403598+0000","last_fullsized":"2024-09-22T08:40:06.403598+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-09-22T08:40:06.403521+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-09-22T08:40:06.403521+0000","last_clean_scrub_stamp":"2024-09-22T08:40:06.403521+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:26:49.349866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:51.626242+0000","last_change":"2024-09-22T08:39:51.626242+0000","last_active":"2024-09-22T08:39:51.626242+0000","last_peered":"2024-09-22T08:39:51.626242+0000","last_clean":"2024-09-22T08:39:51.626242+0000","last_became_active":"2024-09-22T08:36:23.969515+0000","last_became_peered":"2024-09-22T08:36:23.969515+0000","last_unstale":"2024-09-22T08:39:51.626242+0000","last_undegraded":"2024-09-22T08:39:51.626242+0000","last_fullsized":"2024-09-22T08:39:51.626242+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:39:51.626108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:39:51.626108+0000","last_clean_scrub_stamp":"2024-09-22T08:39:51.626108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:12:42.258599+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"32'12","reported_seq":72,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:07.850074+0000","last_change":"2024-09-22T08:40:07.850074+0000","last_active":"2024-09-22T08:40:07.850074+0000","last_peered":"2024-09-22T08:40:07.850074+0000","last_clean":"2024-09-22T08:40:07.850074+0000","last_became_active":"2024-09-22T08:36:25.978679+0000","last_became_peered":"2024-09-22T08:36:25.978679+0000","last_unstale":"2024-09-22T08:40:07.850074+0000","last_undegraded":"2024-09-22T08:40:07.850074+0000","last_fullsized":"2024-09-22T08:40:07.850074+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-09-22T08:40:07.849968+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-09-22T08:40:07.849968+0000","last_clean_scrub_stamp":"2024-09-22T08:40:07.849968+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:50:10.705568+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"32'2","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:50.767473+0000","last_change":"2024-09-22T08:39:50.767473+0000","last_active":"2024-09-22T08:39:50.767473+0000","last_peered":"2024-09-22T08:39:50.767473+0000","last_clean":"2024-09-22T08:39:50.767473+0000","last_became_active":"2024-09-22T08:36:23.970218+0000","last_became_peered":"2024-09-22T08:36:23.970218+0000","last_unstale":"2024-09-22T08:39:50.767473+0000","last_undegraded":"2024-09-22T08:39:50.767473+0000","last_fullsized":"2024-09-22T08:39:50.767473+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-22T08:39:50.767366+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-22T08:39:50.767366+0000","last_clean_scrub_stamp":"2024-09-22T08:39:50.767366+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:50:42.858238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"32'12","reported_seq":67,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:20.546264+0000","last_change":"2024-09-22T08:40:20.546264+0000","last_active":"2024-09-22T08:40:20.546264+0000","last_peered":"2024-09-22T08:40:20.546264+0000","last_clean":"2024-09-22T08:40:20.546264+0000","last_became_active":"2024-09-22T08:36:25.989638+0000","last_became_peered":"2024-09-22T08:36:25.989638+0000","last_unstale":"2024-09-22T08:40:20.546264+0000","last_undegraded":"2024-09-22T08:40:20.546264+0000","last_fullsized":"2024-09-22T08:40:20.546264+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-09-22T08:40:20.546161+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-09-22T08:40:20.546161+0000","last_clean_scrub_stamp":"2024-09-22T08:40:20.546161+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:20:45.107609+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":33,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:58.317577+0000","last_change":"2024-09-22T08:39:58.317577+0000","last_active":"2024-09-22T08:39:58.317577+0000","last_peered":"2024-09-22T08:39:58.317577+0000","last_clean":"2024-09-22T08:39:58.317577+0000","last_became_active":"2024-09-22T08:36:23.972582+0000","last_became_peered":"2024-09-22T08:36:23.972582+0000","last_unstale":"2024-09-22T08:39:58.317577+0000","last_undegraded":"2024-09-22T08:39:58.317577+0000","last_fullsized":"2024-09-22T08:39:58.317577+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:39:58.317493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:39:58.317493+0000","last_clean_scrub_stamp":"2024-09-22T08:39:58.317493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:30:33.805756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:06.836804+0000","last_change":"2024-09-22T08:40:06.836804+0000","last_active":"2024-09-22T08:40:06.836804+0000","last_peered":"2024-09-22T08:40:06.836804+0000","last_clean":"2024-09-22T08:40:06.836804+0000","last_became_active":"2024-09-22T08:36:25.978538+0000","last_became_peered":"2024-09-22T08:36:25.978538+0000","last_unstale":"2024-09-22T08:40:06.836804+0000","last_undegraded":"2024-09-22T08:40:06.836804+0000","last_fullsized":"2024-09-22T08:40:06.836804+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:06.836699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:06.836699+0000","last_clean_scrub_stamp":"2024-09-22T08:40:06.836699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:16:11.004999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:51.809249+0000","last_change":"2024-09-22T08:39:51.809249+0000","last_active":"2024-09-22T08:39:51.809249+0000","last_peered":"2024-09-22T08:39:51.809249+0000","last_clean":"2024-09-22T08:39:51.809249+0000","last_became_active":"2024-09-22T08:36:23.973945+0000","last_became_peered":"2024-09-22T08:36:23.973945+0000","last_unstale":"2024-09-22T08:39:51.809249+0000","last_undegraded":"2024-09-22T08:39:51.809249+0000","last_fullsized":"2024-09-22T08:39:51.809249+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:39:51.809165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:39:51.809165+0000","last_clean_scrub_stamp":"2024-09-22T08:39:51.809165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:41:14.543135+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"32'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:09.879440+0000","last_change":"2024-09-22T08:40:09.879440+0000","last_active":"2024-09-22T08:40:09.879440+0000","last_peered":"2024-09-22T08:40:09.879440+0000","last_clean":"2024-09-22T08:40:09.879440+0000","last_became_active":"2024-09-22T08:36:25.984094+0000","last_became_peered":"2024-09-22T08:36:25.984094+0000","last_unstale":"2024-09-22T08:40:09.879440+0000","last_undegraded":"2024-09-22T08:40:09.879440+0000","last_fullsized":"2024-09-22T08:40:09.879440+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-22T08:40:09.879355+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-22T08:40:09.879355+0000","last_clean_scrub_stamp":"2024-09-22T08:40:09.879355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:15:19.787347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"32'2","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:52.813867+0000","last_change":"2024-09-22T08:39:52.813867+0000","last_active":"2024-09-22T08:39:52.813867+0000","last_peered":"2024-09-22T08:39:52.813867+0000","last_clean":"2024-09-22T08:39:52.813867+0000","last_became_active":"2024-09-22T08:36:23.970920+0000","last_became_peered":"2024-09-22T08:36:23.970920+0000","last_unstale":"2024-09-22T08:39:52.813867+0000","last_undegraded":"2024-09-22T08:39:52.813867+0000","last_fullsized":"2024-09-22T08:39:52.813867+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-22T08:39:52.813773+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-22T08:39:52.813773+0000","last_clean_scrub_stamp":"2024-09-22T08:39:52.813773+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:32:25.388534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"32'12","reported_seq":77,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:05.355078+0000","last_change":"2024-09-22T08:40:05.355078+0000","last_active":"2024-09-22T08:40:05.355078+0000","last_peered":"2024-09-22T08:40:05.355078+0000","last_clean":"2024-09-22T08:40:05.355078+0000","last_became_active":"2024-09-22T08:36:25.985965+0000","last_became_peered":"2024-09-22T08:36:25.985965+0000","last_unstale":"2024-09-22T08:40:05.355078+0000","last_undegraded":"2024-09-22T08:40:05.355078+0000","last_fullsized":"2024-09-22T08:40:05.355078+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-09-22T08:40:05.354995+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-09-22T08:40:05.354995+0000","last_clean_scrub_stamp":"2024-09-22T08:40:05.354995+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:08:14.083131+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":11,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:52.189228+0000","last_change":"2024-09-22T08:39:52.189228+0000","last_active":"2024-09-22T08:39:52.189228+0000","last_peered":"2024-09-22T08:39:52.189228+0000","last_clean":"2024-09-22T08:39:52.189228+0000","last_became_active":"2024-09-22T08:36:23.983722+0000","last_became_peered":"2024-09-22T08:36:23.983722+0000","last_unstale":"2024-09-22T08:39:52.189228+0000","last_undegraded":"2024-09-22T08:39:52.189228+0000","last_fullsized":"2024-09-22T08:39:52.189228+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:39:52.189117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:39:52.189117+0000","last_clean_scrub_stamp":"2024-09-22T08:39:52.189117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:49:51.464801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"32'4","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:04.756446+0000","last_change":"2024-09-22T08:40:04.756446+0000","last_active":"2024-09-22T08:40:04.756446+0000","last_peered":"2024-09-22T08:40:04.756446+0000","last_clean":"2024-09-22T08:40:04.756446+0000","last_became_active":"2024-09-22T08:36:25.983061+0000","last_became_peered":"2024-09-22T08:36:25.983061+0000","last_unstale":"2024-09-22T08:40:04.756446+0000","last_undegraded":"2024-09-22T08:40:04.756446+0000","last_fullsized":"2024-09-22T08:40:04.756446+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-22T08:40:04.756359+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-22T08:40:04.756359+0000","last_clean_scrub_stamp":"2024-09-22T08:40:04.756359+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:17:00.830661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:52.621578+0000","last_change":"2024-09-22T08:39:52.621578+0000","last_active":"2024-09-22T08:39:52.621578+0000","last_peered":"2024-09-22T08:39:52.621578+0000","last_clean":"2024-09-22T08:39:52.621578+0000","last_became_active":"2024-09-22T08:36:23.973924+0000","last_became_peered":"2024-09-22T08:36:23.973924+0000","last_unstale":"2024-09-22T08:39:52.621578+0000","last_undegraded":"2024-09-22T08:39:52.621578+0000","last_fullsized":"2024-09-22T08:39:52.621578+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:39:52.621486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:39:52.621486+0000","last_clean_scrub_stamp":"2024-09-22T08:39:52.621486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:10:20.959216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"32'18","reported_seq":87,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:04.305270+0000","last_change":"2024-09-22T08:40:04.305270+0000","last_active":"2024-09-22T08:40:04.305270+0000","last_peered":"2024-09-22T08:40:04.305270+0000","last_clean":"2024-09-22T08:40:04.305270+0000","last_became_active":"2024-09-22T08:36:25.979151+0000","last_became_peered":"2024-09-22T08:36:25.979151+0000","last_unstale":"2024-09-22T08:40:04.305270+0000","last_undegraded":"2024-09-22T08:40:04.305270+0000","last_fullsized":"2024-09-22T08:40:04.305270+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'18","last_scrub_stamp":"2024-09-22T08:40:04.305175+0000","last_deep_scrub":"32'18","last_deep_scrub_stamp":"2024-09-22T08:40:04.305175+0000","last_clean_scrub_stamp":"2024-09-22T08:40:04.305175+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:39:13.164022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":64,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:53.864259+0000","last_change":"2024-09-22T08:39:53.864259+0000","last_active":"2024-09-22T08:39:53.864259+0000","last_peered":"2024-09-22T08:39:53.864259+0000","last_clean":"2024-09-22T08:39:53.864259+0000","last_became_active":"2024-09-22T08:36:23.970584+0000","last_became_peered":"2024-09-22T08:36:23.970584+0000","last_unstale":"2024-09-22T08:39:53.864259+0000","last_undegraded":"2024-09-22T08:39:53.864259+0000","last_fullsized":"2024-09-22T08:39:53.864259+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:39:53.864171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:39:53.864171+0000","last_clean_scrub_stamp":"2024-09-22T08:39:53.864171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:54:15.743899+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"32'16","reported_seq":97,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:10.444682+0000","last_change":"2024-09-22T08:40:10.444682+0000","last_active":"2024-09-22T08:40:10.444682+0000","last_peered":"2024-09-22T08:40:10.444682+0000","last_clean":"2024-09-22T08:40:10.444682+0000","last_became_active":"2024-09-22T08:36:25.978730+0000","last_became_peered":"2024-09-22T08:36:25.978730+0000","last_unstale":"2024-09-22T08:40:10.444682+0000","last_undegraded":"2024-09-22T08:40:10.444682+0000","last_fullsized":"2024-09-22T08:40:10.444682+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'16","last_scrub_stamp":"2024-09-22T08:40:10.444585+0000","last_deep_scrub":"32'16","last_deep_scrub_stamp":"2024-09-22T08:40:10.444585+0000","last_clean_scrub_stamp":"2024-09-22T08:40:10.444585+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:20:44.546694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":70,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:00.269799+0000","last_change":"2024-09-22T08:40:00.269799+0000","last_active":"2024-09-22T08:40:00.269799+0000","last_peered":"2024-09-22T08:40:00.269799+0000","last_clean":"2024-09-22T08:40:00.269799+0000","last_became_active":"2024-09-22T08:36:23.973175+0000","last_became_peered":"2024-09-22T08:36:23.973175+0000","last_unstale":"2024-09-22T08:40:00.269799+0000","last_undegraded":"2024-09-22T08:40:00.269799+0000","last_fullsized":"2024-09-22T08:40:00.269799+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-22T08:40:00.269709+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-22T08:40:00.269709+0000","last_clean_scrub_stamp":"2024-09-22T08:40:00.269709+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:41:49.730855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"32'6","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:22.563038+0000","last_change":"2024-09-22T08:40:22.563038+0000","last_active":"2024-09-22T08:40:22.563038+0000","last_peered":"2024-09-22T08:40:22.563038+0000","last_clean":"2024-09-22T08:40:22.563038+0000","last_became_active":"2024-09-22T08:36:25.991611+0000","last_became_peered":"2024-09-22T08:36:25.991611+0000","last_unstale":"2024-09-22T08:40:22.563038+0000","last_undegraded":"2024-09-22T08:40:22.563038+0000","last_fullsized":"2024-09-22T08:40:22.563038+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-22T08:40:22.562955+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-22T08:40:22.562955+0000","last_clean_scrub_stamp":"2024-09-22T08:40:22.562955+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:47:21.108045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"32'6","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:54.860397+0000","last_change":"2024-09-22T08:39:54.860397+0000","last_active":"2024-09-22T08:39:54.860397+0000","last_peered":"2024-09-22T08:39:54.860397+0000","last_clean":"2024-09-22T08:39:54.860397+0000","last_became_active":"2024-09-22T08:36:23.973721+0000","last_became_peered":"2024-09-22T08:36:23.973721+0000","last_unstale":"2024-09-22T08:39:54.860397+0000","last_undegraded":"2024-09-22T08:39:54.860397+0000","last_fullsized":"2024-09-22T08:39:54.860397+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-22T08:39:54.860314+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-22T08:39:54.860314+0000","last_clean_scrub_stamp":"2024-09-22T08:39:54.860314+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:19:21.761274+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4,"num_write":22,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"32'8","reported_seq":77,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:08.879975+0000","last_change":"2024-09-22T08:40:08.879975+0000","last_active":"2024-09-22T08:40:08.879975+0000","last_peered":"2024-09-22T08:40:08.879975+0000","last_clean":"2024-09-22T08:40:08.879975+0000","last_became_active":"2024-09-22T08:37:04.231342+0000","last_became_peered":"2024-09-22T08:37:04.231342+0000","last_unstale":"2024-09-22T08:40:08.879975+0000","last_undegraded":"2024-09-22T08:40:08.879975+0000","last_fullsized":"2024-09-22T08:40:08.879975+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-22T08:40:08.879881+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-22T08:40:08.879881+0000","last_clean_scrub_stamp":"2024-09-22T08:40:08.879881+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:29:38.636460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:53.142490+0000","last_change":"2024-09-22T08:39:53.142490+0000","last_active":"2024-09-22T08:39:53.142490+0000","last_peered":"2024-09-22T08:39:53.142490+0000","last_clean":"2024-09-22T08:39:53.142490+0000","last_became_active":"2024-09-22T08:36:23.975352+0000","last_became_peered":"2024-09-22T08:36:23.975352+0000","last_unstale":"2024-09-22T08:39:53.142490+0000","last_undegraded":"2024-09-22T08:39:53.142490+0000","last_fullsized":"2024-09-22T08:39:53.142490+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:39:53.142406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:39:53.142406+0000","last_clean_scrub_stamp":"2024-09-22T08:39:53.142406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:12:04.379120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:09.423304+0000","last_change":"2024-09-22T08:40:09.423304+0000","last_active":"2024-09-22T08:40:09.423304+0000","last_peered":"2024-09-22T08:40:09.423304+0000","last_clean":"2024-09-22T08:40:09.423304+0000","last_became_active":"2024-09-22T08:36:25.977732+0000","last_became_peered":"2024-09-22T08:36:25.977732+0000","last_unstale":"2024-09-22T08:40:09.423304+0000","last_undegraded":"2024-09-22T08:40:09.423304+0000","last_fullsized":"2024-09-22T08:40:09.423304+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:09.423216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:09.423216+0000","last_clean_scrub_stamp":"2024-09-22T08:40:09.423216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:29:07.668069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:54.171493+0000","last_change":"2024-09-22T08:39:54.171493+0000","last_active":"2024-09-22T08:39:54.171493+0000","last_peered":"2024-09-22T08:39:54.171493+0000","last_clean":"2024-09-22T08:39:54.171493+0000","last_became_active":"2024-09-22T08:36:23.975986+0000","last_became_peered":"2024-09-22T08:36:23.975986+0000","last_unstale":"2024-09-22T08:39:54.171493+0000","last_undegraded":"2024-09-22T08:39:54.171493+0000","last_fullsized":"2024-09-22T08:39:54.171493+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:39:54.171402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:39:54.171402+0000","last_clean_scrub_stamp":"2024-09-22T08:39:54.171402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:30:19.750104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"32'10","reported_seq":61,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:14.385913+0000","last_change":"2024-09-22T08:40:14.385913+0000","last_active":"2024-09-22T08:40:14.385913+0000","last_peered":"2024-09-22T08:40:14.385913+0000","last_clean":"2024-09-22T08:40:14.385913+0000","last_became_active":"2024-09-22T08:36:25.984258+0000","last_became_peered":"2024-09-22T08:36:25.984258+0000","last_unstale":"2024-09-22T08:40:14.385913+0000","last_undegraded":"2024-09-22T08:40:14.385913+0000","last_fullsized":"2024-09-22T08:40:14.385913+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-09-22T08:40:14.385812+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-09-22T08:40:14.385812+0000","last_clean_scrub_stamp":"2024-09-22T08:40:14.385812+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:44:29.101922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:01.295930+0000","last_change":"2024-09-22T08:40:01.295930+0000","last_active":"2024-09-22T08:40:01.295930+0000","last_peered":"2024-09-22T08:40:01.295930+0000","last_clean":"2024-09-22T08:40:01.295930+0000","last_became_active":"2024-09-22T08:36:23.979548+0000","last_became_peered":"2024-09-22T08:36:23.979548+0000","last_unstale":"2024-09-22T08:40:01.295930+0000","last_undegraded":"2024-09-22T08:40:01.295930+0000","last_fullsized":"2024-09-22T08:40:01.295930+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:01.295827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:01.295827+0000","last_clean_scrub_stamp":"2024-09-22T08:40:01.295827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:46:58.524286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"32'16","reported_seq":67,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:08.426849+0000","last_change":"2024-09-22T08:40:08.426849+0000","last_active":"2024-09-22T08:40:08.426849+0000","last_peered":"2024-09-22T08:40:08.426849+0000","last_clean":"2024-09-22T08:40:08.426849+0000","last_became_active":"2024-09-22T08:36:25.979965+0000","last_became_peered":"2024-09-22T08:36:25.979965+0000","last_unstale":"2024-09-22T08:40:08.426849+0000","last_undegraded":"2024-09-22T08:40:08.426849+0000","last_fullsized":"2024-09-22T08:40:08.426849+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'16","last_scrub_stamp":"2024-09-22T08:40:08.426756+0000","last_deep_scrub":"32'16","last_deep_scrub_stamp":"2024-09-22T08:40:08.426756+0000","last_clean_scrub_stamp":"2024-09-22T08:40:08.426756+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:00:38.752121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":51,"num_write":22,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:02.303092+0000","last_change":"2024-09-22T08:40:02.303092+0000","last_active":"2024-09-22T08:40:02.303092+0000","last_peered":"2024-09-22T08:40:02.303092+0000","last_clean":"2024-09-22T08:40:02.303092+0000","last_became_active":"2024-09-22T08:36:23.978225+0000","last_became_peered":"2024-09-22T08:36:23.978225+0000","last_unstale":"2024-09-22T08:40:02.303092+0000","last_undegraded":"2024-09-22T08:40:02.303092+0000","last_fullsized":"2024-09-22T08:40:02.303092+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-22T08:40:02.302998+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-22T08:40:02.302998+0000","last_clean_scrub_stamp":"2024-09-22T08:40:02.302998+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:19:57.676393+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"32'6","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:21.569303+0000","last_change":"2024-09-22T08:40:21.569303+0000","last_active":"2024-09-22T08:40:21.569303+0000","last_peered":"2024-09-22T08:40:21.569303+0000","last_clean":"2024-09-22T08:40:21.569303+0000","last_became_active":"2024-09-22T08:36:25.990690+0000","last_became_peered":"2024-09-22T08:36:25.990690+0000","last_unstale":"2024-09-22T08:40:21.569303+0000","last_undegraded":"2024-09-22T08:40:21.569303+0000","last_fullsized":"2024-09-22T08:40:21.569303+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-22T08:40:21.569206+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-22T08:40:21.569206+0000","last_clean_scrub_stamp":"2024-09-22T08:40:21.569206+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:25:32.682806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:53.617208+0000","last_change":"2024-09-22T08:39:53.617208+0000","last_active":"2024-09-22T08:39:53.617208+0000","last_peered":"2024-09-22T08:39:53.617208+0000","last_clean":"2024-09-22T08:39:53.617208+0000","last_became_active":"2024-09-22T08:36:23.973976+0000","last_became_peered":"2024-09-22T08:36:23.973976+0000","last_unstale":"2024-09-22T08:39:53.617208+0000","last_undegraded":"2024-09-22T08:39:53.617208+0000","last_fullsized":"2024-09-22T08:39:53.617208+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:39:53.617119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:39:53.617119+0000","last_clean_scrub_stamp":"2024-09-22T08:39:53.617119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:07:03.861422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"32'2","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:07.399420+0000","last_change":"2024-09-22T08:40:07.399420+0000","last_active":"2024-09-22T08:40:07.399420+0000","last_peered":"2024-09-22T08:40:07.399420+0000","last_clean":"2024-09-22T08:40:07.399420+0000","last_became_active":"2024-09-22T08:36:25.975794+0000","last_became_peered":"2024-09-22T08:36:25.975794+0000","last_unstale":"2024-09-22T08:40:07.399420+0000","last_undegraded":"2024-09-22T08:40:07.399420+0000","last_fullsized":"2024-09-22T08:40:07.399420+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-22T08:40:07.399339+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-22T08:40:07.399339+0000","last_clean_scrub_stamp":"2024-09-22T08:40:07.399339+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:48:57.554466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"32'2","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:03.266087+0000","last_change":"2024-09-22T08:40:03.266087+0000","last_active":"2024-09-22T08:40:03.266087+0000","last_peered":"2024-09-22T08:40:03.266087+0000","last_clean":"2024-09-22T08:40:03.266087+0000","last_became_active":"2024-09-22T08:36:23.982376+0000","last_became_peered":"2024-09-22T08:36:23.982376+0000","last_unstale":"2024-09-22T08:40:03.266087+0000","last_undegraded":"2024-09-22T08:40:03.266087+0000","last_fullsized":"2024-09-22T08:40:03.266087+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-22T08:40:03.265985+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-22T08:40:03.265985+0000","last_clean_scrub_stamp":"2024-09-22T08:40:03.265985+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:02:58.569511+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:05.287659+0000","last_change":"2024-09-22T08:40:05.287659+0000","last_active":"2024-09-22T08:40:05.287659+0000","last_peered":"2024-09-22T08:40:05.287659+0000","last_clean":"2024-09-22T08:40:05.287659+0000","last_became_active":"2024-09-22T08:36:23.978787+0000","last_became_peered":"2024-09-22T08:36:23.978787+0000","last_unstale":"2024-09-22T08:40:05.287659+0000","last_undegraded":"2024-09-22T08:40:05.287659+0000","last_fullsized":"2024-09-22T08:40:05.287659+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:05.287568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:05.287568+0000","last_clean_scrub_stamp":"2024-09-22T08:40:05.287568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:59:39.200932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"32'8","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:10.872172+0000","last_change":"2024-09-22T08:40:10.872172+0000","last_active":"2024-09-22T08:40:10.872172+0000","last_peered":"2024-09-22T08:40:10.872172+0000","last_clean":"2024-09-22T08:40:10.872172+0000","last_became_active":"2024-09-22T08:36:25.979593+0000","last_became_peered":"2024-09-22T08:36:25.979593+0000","last_unstale":"2024-09-22T08:40:10.872172+0000","last_undegraded":"2024-09-22T08:40:10.872172+0000","last_fullsized":"2024-09-22T08:40:10.872172+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-22T08:40:10.872074+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-22T08:40:10.872074+0000","last_clean_scrub_stamp":"2024-09-22T08:40:10.872074+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:25:45.090218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:55.878768+0000","last_change":"2024-09-22T08:39:55.878768+0000","last_active":"2024-09-22T08:39:55.878768+0000","last_peered":"2024-09-22T08:39:55.878768+0000","last_clean":"2024-09-22T08:39:55.878768+0000","last_became_active":"2024-09-22T08:36:23.974202+0000","last_became_peered":"2024-09-22T08:36:23.974202+0000","last_unstale":"2024-09-22T08:39:55.878768+0000","last_undegraded":"2024-09-22T08:39:55.878768+0000","last_fullsized":"2024-09-22T08:39:55.878768+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:39:55.878679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:39:55.878679+0000","last_clean_scrub_stamp":"2024-09-22T08:39:55.878679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:42:02.792761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"32'14","reported_seq":87,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:16.311548+0000","last_change":"2024-09-22T08:40:16.311548+0000","last_active":"2024-09-22T08:40:16.311548+0000","last_peered":"2024-09-22T08:40:16.311548+0000","last_clean":"2024-09-22T08:40:16.311548+0000","last_became_active":"2024-09-22T08:37:04.233241+0000","last_became_peered":"2024-09-22T08:37:04.233241+0000","last_unstale":"2024-09-22T08:40:16.311548+0000","last_undegraded":"2024-09-22T08:40:16.311548+0000","last_fullsized":"2024-09-22T08:40:16.311548+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'14","last_scrub_stamp":"2024-09-22T08:40:16.311459+0000","last_deep_scrub":"32'14","last_deep_scrub_stamp":"2024-09-22T08:40:16.311459+0000","last_clean_scrub_stamp":"2024-09-22T08:40:16.311459+0000","objects_scrubbed":1,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:43:58.325817+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":47,"num_read_kb":43,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1549,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":690,"num_read_kb":658,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":267,"ondisk_log_size":267,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2280,"ondisk_log_size":2280,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1600,"num_read_kb":1397,"num_write":597,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1336,"num_omap_keys":6,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1424,"ondisk_log_size":1424,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14,"ondisk_log_size":14,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1672,"num_read_kb":1562,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":481,"ondisk_log_size":481,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":177,"num_read_kb":83,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":128,"acting":128,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":11,"seq":47244640311,"num_pgs":124,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40472,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331368,"statfs":{"total":96636764160,"available":96595320832,"internally_reserved":0,"allocated":991232,"data_stored":726145,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640311,"num_pgs":119,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36324,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335516,"statfs":{"total":96636764160,"available":96599568384,"internally_reserved":0,"allocated":1003520,"data_stored":724639,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":9,"seq":38654705718,"num_pgs":152,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39960,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331880,"statfs":{"total":96636764160,"available":96595845120,"internally_reserved":0,"allocated":466944,"data_stored":138067,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705718,"num_pgs":135,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39916,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331924,"statfs":{"total":96636764160,"available":96595890176,"internally_reserved":0,"allocated":421888,"data_stored":135213,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":325,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":421,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T08:40:24.441 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-09-22T08:36:24.956796+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=24, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:24.442 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-22T08:36:24.956796+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=24, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:24.442 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-09-22T08:36:24.956796+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=24, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:24.442 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-09-22T08:36:24.956796+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=24, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:24.442 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-09-22T08:36:24.956796+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=24, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:24.442 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-22T08:36:32.990486+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:24.443 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-09-22T08:36:26.962226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=26, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:24.443 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-09-22T08:36:28.972630+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=28, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:24.443 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-09-22T08:36:30.982878+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=30, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:24.443 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-22T08:36:32.990486+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:24.443 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-09-22T08:36:26.962226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=26, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:24.443 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-09-22T08:36:28.972630+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=28, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:24.443 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-09-22T08:36:30.982878+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=30, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:24.443 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-22T08:36:32.990486+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:24.443 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-09-22T08:36:28.972630+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=28, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:24.444 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-22T08:36:30.982878+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=30, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:24.444 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-09-22T08:36:32.990486+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:24.444 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-09-22T08:36:26.962226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=26, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:24.444 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-09-22T08:36:28.972630+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=28, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:24.444 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-09-22T08:36:30.982878+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=30, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:24.444 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-09-22T08:36:30.982878+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=30, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:24.444 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-09-22T08:36:32.990486+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:24.444 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-09-22T08:36:28.972630+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=28, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:24.445 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-09-22T08:36:30.982878+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=30, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:24.445 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-09-22T08:36:32.990486+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:24.445 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-09-22T08:36:28.972630+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=28, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:24.445 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-09-22T08:36:30.982878+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=30, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:24.445 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-22T08:36:32.990486+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:24.445 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-09-22T08:36:28.972630+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=28, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:24.445 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-09-22T08:36:30.982878+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=30, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:24.445 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-22T08:36:32.990486+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:24.446 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-09-22T08:36:28.972630+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=28, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:24.446 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-09-22T08:36:30.982878+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=30, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:24.446 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-22T08:36:32.990486+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:24.446 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2024-09-22T08:36:30.982878+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=30, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:24.446 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-22T08:36:32.990486+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:24.446 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-09-22T08:36:26.962226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=26, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:24.446 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-09-22T08:36:28.972630+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=28, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:24.446 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-09-22T08:36:30.982878+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=30, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:24.446 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-09-22T08:36:32.990486+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:24.447 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-09-22T08:36:26.962226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=26, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:24.447 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-09-22T08:36:28.972630+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=28, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:24.447 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-09-22T08:36:30.982878+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=30, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:24.447 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-09-22T08:36:32.990486+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:24.447 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-09-22T08:36:28.972630+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=28, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:24.447 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-09-22T08:36:30.982878+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=30, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:24.447 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-09-22T08:36:32.990486+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:24.447 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-09-22T08:36:26.962226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=26, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:24.448 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-09-22T08:36:28.972630+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=28, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:24.448 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-22T08:36:30.982878+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=30, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:24.448 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-22T08:36:32.990486+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:24.448 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-09-22T08:36:30.982878+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=30, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:24.448 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-22T08:36:32.990486+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:24.448 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-09-22T08:36:28.972630+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=28, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:24.448 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-09-22T08:36:30.982878+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=30, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:24.448 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-22T08:36:32.990486+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:24.449 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-09-22T08:36:30.982878+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=30, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:24.449 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-22T08:36:32.990486+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:24.449 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-09-22T08:36:26.962226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=26, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:24.449 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-09-22T08:36:28.972630+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=28, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:24.449 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-09-22T08:36:30.982878+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=30, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:24.449 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-22T08:36:32.990486+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:24.449 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-09-22T08:36:26.962226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=26, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:24.449 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-09-22T08:36:28.972630+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=28, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:24.450 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-09-22T08:36:30.982878+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=30, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:24.450 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-22T08:36:32.990486+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:24.450 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-09-22T08:36:26.962226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=26, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:24.450 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-09-22T08:36:30.982878+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=30, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:24.450 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-09-22T08:36:32.990486+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:24.450 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-09-22T08:36:32.990486+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:24.450 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-09-22T08:36:26.962226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=26, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:24.450 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-09-22T08:36:28.972630+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=28, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:24.451 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-09-22T08:36:30.982878+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=30, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:24.451 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-22T08:36:32.990486+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:24.451 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-09-22T08:36:26.962226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=26, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:24.451 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-09-22T08:36:30.982878+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=30, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:24.451 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-22T08:36:32.990486+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:24.451 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-09-22T08:36:30.982878+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=30, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:24.451 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-22T08:36:32.990486+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:24.451 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-09-22T08:36:26.962226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=26, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:24.452 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-09-22T08:36:28.972630+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=28, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:24.452 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-09-22T08:36:30.982878+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=30, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:24.452 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-09-22T08:36:28.972630+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=28, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:24.452 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-09-22T08:36:30.982878+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=30, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:24.452 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-22T08:36:32.990486+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:24.452 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-09-22T08:36:28.972630+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=28, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:24.452 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-09-22T08:36:30.982878+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=30, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:24.452 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-22T08:36:32.990486+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:24.453 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-09-22T08:36:28.972630+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=28, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:24.453 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-09-22T08:36:30.982878+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=30, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:24.453 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-22T08:36:32.990486+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:24.453 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-09-22T08:36:26.962226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=26, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:24.453 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-09-22T08:36:28.972630+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=28, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:24.453 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-09-22T08:36:30.982878+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=30, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:24.453 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-22T08:36:32.990486+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:24.453 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-09-22T08:36:26.962226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=26, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:24.453 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-09-22T08:36:28.972630+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=28, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:24.454 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-09-22T08:36:30.982878+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=30, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:24.454 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-22T08:36:32.990486+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:24.454 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-09-22T08:36:28.972630+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=28, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:24.454 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-22T08:36:30.982878+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=30, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:24.454 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-22T08:36:32.990486+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:24.454 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-09-22T08:36:26.962226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=26, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:24.454 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-09-22T08:36:28.972630+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=28, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:24.454 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-22T08:36:30.982878+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=30, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:24.455 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-22T08:36:32.990486+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:24.455 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-09-22T08:36:26.962226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=26, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:24.455 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-09-22T08:36:28.972630+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=28, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:24.455 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-09-22T08:36:30.982878+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=30, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:24.455 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-22T08:36:32.990486+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:24.455 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-22T08:40:44.456 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T08:40:44.570 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:40:44.569+0000 7f6932c8e640 1 Processor -- start 2024-09-22T08:40:44.571 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:40:44.569+0000 7f6932c8e640 1 -- start start 2024-09-22T08:40:44.572 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:40:44.570+0000 7f6932c8e640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f692c071e30 0x7f692c132790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:40:44.572 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:40:44.570+0000 7f6932c8e640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f692c071770 con 0x7f692c06e170 2024-09-22T08:40:44.572 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:40:44.570+0000 7f6932c8e640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f692c099ee0 con 0x7f692c071e30 2024-09-22T08:40:44.572 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:40:44.570+0000 7f6930a2a640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f692c06e170 0x7f692c06e550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:54618/0 (socket says 172.21.15.31:54618) 2024-09-22T08:40:44.572 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:40:44.570+0000 7f6930a2a640 1 -- 172.21.15.31:0/2897944145 learned_addr learned my addr 172.21.15.31:0/2897944145 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-22T08:40:44.572 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:40:44.570+0000 7f692bfff640 1 --2- 172.21.15.31:0/2897944145 >> v2:172.21.15.31:3300/0 conn(0x7f692c071e30 0x7f692c132790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:40:44.572 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:40:44.570+0000 7f692b7fe640 1 -- 172.21.15.31:0/2897944145 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2051246595 0 0) 0x7f692c071770 con 0x7f692c06e170 2024-09-22T08:40:44.572 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:40:44.570+0000 7f692b7fe640 1 -- 172.21.15.31:0/2897944145 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6914003520 con 0x7f692c06e170 2024-09-22T08:40:44.573 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:40:44.570+0000 7f692bfff640 1 -- 172.21.15.31:0/2897944145 >> v1:172.21.15.31:6789/0 conn(0x7f692c06e170 legacy=0x7f692c06e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:40:44.573 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:40:44.570+0000 7f692bfff640 1 -- 172.21.15.31:0/2897944145 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f692c072530 con 0x7f692c071e30 2024-09-22T08:40:44.573 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:40:44.571+0000 7f692bfff640 1 --2- 172.21.15.31:0/2897944145 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f692c071e30 0x7f692c132790 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f6920009750 tx=0x7f692002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=762d92de7b561148 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:40:44.574 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:40:44.571+0000 7f692b7fe640 1 -- 172.21.15.31:0/2897944145 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6920037070 con 0x7f692c071e30 2024-09-22T08:40:44.574 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:40:44.571+0000 7f692b7fe640 1 -- 172.21.15.31:0/2897944145 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f692002ad80 con 0x7f692c071e30 2024-09-22T08:40:44.574 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:40:44.571+0000 7f692b7fe640 1 -- 172.21.15.31:0/2897944145 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6920032590 con 0x7f692c071e30 2024-09-22T08:40:44.574 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:40:44.572+0000 7f6932c8e640 1 -- 172.21.15.31:0/2897944145 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f692c071e30 msgr2=0x7f692c132790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:40:44.574 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:40:44.572+0000 7f6932c8e640 1 --2- 172.21.15.31:0/2897944145 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f692c071e30 0x7f692c132790 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f6920009750 tx=0x7f692002a140 comp rx=0 tx=0).stop 2024-09-22T08:40:44.574 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:40:44.572+0000 7f6932c8e640 1 -- 172.21.15.31:0/2897944145 shutdown_connections 2024-09-22T08:40:44.574 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:40:44.572+0000 7f6932c8e640 1 --2- 172.21.15.31:0/2897944145 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f692c071e30 0x7f692c132790 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:40:44.574 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:40:44.572+0000 7f6932c8e640 1 -- 172.21.15.31:0/2897944145 >> 172.21.15.31:0/2897944145 conn(0x7f692c09ac80 msgr2=0x7f692c098550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:40:44.575 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:40:44.572+0000 7f6932c8e640 1 -- 172.21.15.31:0/2897944145 shutdown_connections 2024-09-22T08:40:44.575 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:40:44.572+0000 7f6932c8e640 1 -- 172.21.15.31:0/2897944145 wait complete. 2024-09-22T08:40:44.575 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:40:44.573+0000 7f6932c8e640 1 Processor -- start 2024-09-22T08:40:44.575 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:40:44.573+0000 7f6932c8e640 1 -- start start 2024-09-22T08:40:44.576 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:40:44.573+0000 7f6932c8e640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f692c06e170 0x7f692c129950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:40:44.577 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:40:44.573+0000 7f6932c8e640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f692c06ee70 con 0x7f692c06e170 2024-09-22T08:40:44.577 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:40:44.573+0000 7f6930a2a640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f692c06e170 0x7f692c129950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:40:44.577 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:40:44.573+0000 7f6930a2a640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f692c06e170 0x7f692c129950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:45164/0 (socket says 172.21.15.31:45164) 2024-09-22T08:40:44.577 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:40:44.573+0000 7f6930a2a640 1 -- 172.21.15.31:0/2306991315 learned_addr learned my addr 172.21.15.31:0/2306991315 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-22T08:40:44.577 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:40:44.574+0000 7f6930a2a640 1 -- 172.21.15.31:0/2306991315 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f692c128400 con 0x7f692c06e170 2024-09-22T08:40:44.577 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:40:44.574+0000 7f6930a2a640 1 --2- 172.21.15.31:0/2306991315 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f692c06e170 0x7f692c129950 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f691c00c480 tx=0x7f691c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:40:44.577 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:40:44.574+0000 7f69297fa640 1 -- 172.21.15.31:0/2306991315 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f691c017070 con 0x7f692c06e170 2024-09-22T08:40:44.577 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:40:44.574+0000 7f69297fa640 1 -- 172.21.15.31:0/2306991315 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f691c005cd0 con 0x7f692c06e170 2024-09-22T08:40:44.577 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:40:44.574+0000 7f6932c8e640 1 -- 172.21.15.31:0/2306991315 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f692c1276f0 con 0x7f692c06e170 2024-09-22T08:40:44.577 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:40:44.574+0000 7f69297fa640 1 -- 172.21.15.31:0/2306991315 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f691c007200 con 0x7f692c06e170 2024-09-22T08:40:44.577 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:40:44.574+0000 7f6932c8e640 1 -- 172.21.15.31:0/2306991315 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f692c128820 con 0x7f692c06e170 2024-09-22T08:40:44.577 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:40:44.575+0000 7f6932c8e640 1 -- 172.21.15.31:0/2306991315 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f692c06e550 con 0x7f692c06e170 2024-09-22T08:40:44.577 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:40:44.575+0000 7f69297fa640 1 -- 172.21.15.31:0/2306991315 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f691c01a070 con 0x7f692c06e170 2024-09-22T08:40:44.578 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:40:44.576+0000 7f69297fa640 1 --2- 172.21.15.31:0/2306991315 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f691803e710 0x7f6918040bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:40:44.578 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:40:44.576+0000 7f69297fa640 1 -- 172.21.15.31:0/2306991315 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5938+0+0 (secure 0 0 0) 0x7f691c0529e0 con 0x7f692c06e170 2024-09-22T08:40:44.578 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:40:44.576+0000 7f692bfff640 1 --2- 172.21.15.31:0/2306991315 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f691803e710 0x7f6918040bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:40:44.578 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:40:44.576+0000 7f692bfff640 1 --2- 172.21.15.31:0/2306991315 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f691803e710 0x7f6918040bd0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f6920034000 tx=0x7f692002e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:40:44.581 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:40:44.580+0000 7f69297fa640 1 -- 172.21.15.31:0/2306991315 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f691c01b3b0 con 0x7f692c06e170 2024-09-22T08:40:44.764 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:40:44.763+0000 7f6932c8e640 1 -- 172.21.15.31:0/2306991315 --> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f692c128b10 con 0x7f691803e710 2024-09-22T08:40:44.775 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:40:44.774+0000 7f69297fa640 1 -- 172.21.15.31:0/2306991315 <== mgr.4099 v2:172.21.15.142:6824/99931088 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665708 (secure 0 0 0) 0x7f692c128b10 con 0x7f691803e710 2024-09-22T08:40:44.782 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-22T08:40:44.787 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2024-09-22T08:40:44.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:40:44.779+0000 7f6932c8e640 1 -- 172.21.15.31:0/2306991315 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f691803e710 msgr2=0x7f6918040bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:40:44.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:40:44.779+0000 7f6932c8e640 1 --2- 172.21.15.31:0/2306991315 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f691803e710 0x7f6918040bd0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f6920034000 tx=0x7f692002e000 comp rx=0 tx=0).stop 2024-09-22T08:40:44.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:40:44.779+0000 7f6932c8e640 1 -- 172.21.15.31:0/2306991315 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f692c06e170 msgr2=0x7f692c129950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:40:44.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:40:44.779+0000 7f6932c8e640 1 --2- 172.21.15.31:0/2306991315 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f692c06e170 0x7f692c129950 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f691c00c480 tx=0x7f691c00c940 comp rx=0 tx=0).stop 2024-09-22T08:40:44.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:40:44.779+0000 7f6932c8e640 1 -- 172.21.15.31:0/2306991315 shutdown_connections 2024-09-22T08:40:44.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:40:44.779+0000 7f6932c8e640 1 --2- 172.21.15.31:0/2306991315 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7f691803e710 0x7f6918040bd0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:40:44.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:40:44.779+0000 7f6932c8e640 1 --2- 172.21.15.31:0/2306991315 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f692c06e170 0x7f692c129950 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:40:44.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:40:44.779+0000 7f6932c8e640 1 -- 172.21.15.31:0/2306991315 >> 172.21.15.31:0/2306991315 conn(0x7f692c09ac80 msgr2=0x7f692c12e770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:40:44.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:40:44.779+0000 7f6932c8e640 1 -- 172.21.15.31:0/2306991315 shutdown_connections 2024-09-22T08:40:44.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:40:44.779+0000 7f6932c8e640 1 -- 172.21.15.31:0/2306991315 wait complete. 2024-09-22T08:40:44.791 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":167,"stamp":"2024-09-22T08:40:43.226629+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605410,"num_objects":222,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":222,"num_whiteouts":0,"num_read":5177,"num_read_kb":4727,"num_write":2121,"num_write_kb":60587,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1910,"num_omap_keys":9,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4746,"ondisk_log_size":4746,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":156672,"kb_used_data":2816,"kb_used_omap":6,"kb_used_meta":153785,"kb_avail":377330688,"statfs":{"total":386547056640,"available":386386624512,"internally_reserved":0,"allocated":2883584,"data_stored":1724064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":157476630},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":574,"num_omap_keys":3,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004017"},"pg_stats":[{"pgid":"3.3f","version":"30'4","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:04.369185+0000","last_change":"2024-09-22T08:40:04.369118+0000","last_active":"2024-09-22T08:40:04.369185+0000","last_peered":"2024-09-22T08:40:04.369185+0000","last_clean":"2024-09-22T08:40:04.369185+0000","last_became_active":"2024-09-22T08:36:23.978473+0000","last_became_peered":"2024-09-22T08:36:23.978473+0000","last_unstale":"2024-09-22T08:40:04.369185+0000","last_undegraded":"2024-09-22T08:40:04.369185+0000","last_fullsized":"2024-09-22T08:40:04.369185+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'4","last_scrub_stamp":"2024-09-22T08:40:04.369030+0000","last_deep_scrub":"30'4","last_deep_scrub_stamp":"2024-09-22T08:40:04.369030+0000","last_clean_scrub_stamp":"2024-09-22T08:40:04.369030+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:39:45.475667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":7,"num_write":20,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"30'4","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:15.337474+0000","last_change":"2024-09-22T08:40:15.337474+0000","last_active":"2024-09-22T08:40:15.337474+0000","last_peered":"2024-09-22T08:40:15.337474+0000","last_clean":"2024-09-22T08:40:15.337474+0000","last_became_active":"2024-09-22T08:36:25.981849+0000","last_became_peered":"2024-09-22T08:36:25.981849+0000","last_unstale":"2024-09-22T08:40:15.337474+0000","last_undegraded":"2024-09-22T08:40:15.337474+0000","last_fullsized":"2024-09-22T08:40:15.337474+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'4","last_scrub_stamp":"2024-09-22T08:40:15.337386+0000","last_deep_scrub":"30'4","last_deep_scrub_stamp":"2024-09-22T08:40:15.337386+0000","last_clean_scrub_stamp":"2024-09-22T08:40:15.337386+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:47:30.055490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:58.826260+0000","last_change":"2024-09-22T08:39:58.826192+0000","last_active":"2024-09-22T08:39:58.826260+0000","last_peered":"2024-09-22T08:39:58.826260+0000","last_clean":"2024-09-22T08:39:58.826260+0000","last_became_active":"2024-09-22T08:36:23.973596+0000","last_became_peered":"2024-09-22T08:36:23.973596+0000","last_unstale":"2024-09-22T08:39:58.826260+0000","last_undegraded":"2024-09-22T08:39:58.826260+0000","last_fullsized":"2024-09-22T08:39:58.826260+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:39:58.826106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:39:58.826106+0000","last_clean_scrub_stamp":"2024-09-22T08:39:58.826106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:25:37.176757+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"32'2","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:24.586403+0000","last_change":"2024-09-22T08:40:24.586403+0000","last_active":"2024-09-22T08:40:24.586403+0000","last_peered":"2024-09-22T08:40:24.586403+0000","last_clean":"2024-09-22T08:40:24.586403+0000","last_became_active":"2024-09-22T08:36:25.992150+0000","last_became_peered":"2024-09-22T08:36:25.992150+0000","last_unstale":"2024-09-22T08:40:24.586403+0000","last_undegraded":"2024-09-22T08:40:24.586403+0000","last_fullsized":"2024-09-22T08:40:24.586403+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-22T08:40:24.586282+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-22T08:40:24.586282+0000","last_clean_scrub_stamp":"2024-09-22T08:40:24.586282+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:58:38.922872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:08.374304+0000","last_change":"2024-09-22T08:40:08.374230+0000","last_active":"2024-09-22T08:40:08.374304+0000","last_peered":"2024-09-22T08:40:08.374304+0000","last_clean":"2024-09-22T08:40:08.374304+0000","last_became_active":"2024-09-22T08:36:23.982860+0000","last_became_peered":"2024-09-22T08:36:23.982860+0000","last_unstale":"2024-09-22T08:40:08.374304+0000","last_undegraded":"2024-09-22T08:40:08.374304+0000","last_fullsized":"2024-09-22T08:40:08.374304+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:08.374142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:08.374142+0000","last_clean_scrub_stamp":"2024-09-22T08:40:08.374142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:54:23.652205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:26.577931+0000","last_change":"2024-09-22T08:40:26.577931+0000","last_active":"2024-09-22T08:40:26.577931+0000","last_peered":"2024-09-22T08:40:26.577931+0000","last_clean":"2024-09-22T08:40:26.577931+0000","last_became_active":"2024-09-22T08:36:25.992356+0000","last_became_peered":"2024-09-22T08:36:25.992356+0000","last_unstale":"2024-09-22T08:40:26.577931+0000","last_undegraded":"2024-09-22T08:40:26.577931+0000","last_fullsized":"2024-09-22T08:40:26.577931+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:26.577817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:26.577817+0000","last_clean_scrub_stamp":"2024-09-22T08:40:26.577817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:42:11.037421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:58.533124+0000","last_change":"2024-09-22T08:39:58.533060+0000","last_active":"2024-09-22T08:39:58.533124+0000","last_peered":"2024-09-22T08:39:58.533124+0000","last_clean":"2024-09-22T08:39:58.533124+0000","last_became_active":"2024-09-22T08:36:23.967096+0000","last_became_peered":"2024-09-22T08:36:23.967096+0000","last_unstale":"2024-09-22T08:39:58.533124+0000","last_undegraded":"2024-09-22T08:39:58.533124+0000","last_fullsized":"2024-09-22T08:39:58.533124+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:39:58.532978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:39:58.532978+0000","last_clean_scrub_stamp":"2024-09-22T08:39:58.532978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:58:12.874966+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"32'22","reported_seq":103,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:25.549835+0000","last_change":"2024-09-22T08:40:25.549835+0000","last_active":"2024-09-22T08:40:25.549835+0000","last_peered":"2024-09-22T08:40:25.549835+0000","last_clean":"2024-09-22T08:40:25.549835+0000","last_became_active":"2024-09-22T08:36:25.989065+0000","last_became_peered":"2024-09-22T08:36:25.989065+0000","last_unstale":"2024-09-22T08:40:25.549835+0000","last_undegraded":"2024-09-22T08:40:25.549835+0000","last_fullsized":"2024-09-22T08:40:25.549835+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'22","last_scrub_stamp":"2024-09-22T08:40:25.549736+0000","last_deep_scrub":"32'22","last_deep_scrub_stamp":"2024-09-22T08:40:25.549736+0000","last_clean_scrub_stamp":"2024-09-22T08:40:25.549736+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:20:55.359657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":82,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:06.332632+0000","last_change":"2024-09-22T08:40:06.332632+0000","last_active":"2024-09-22T08:40:06.332632+0000","last_peered":"2024-09-22T08:40:06.332632+0000","last_clean":"2024-09-22T08:40:06.332632+0000","last_became_active":"2024-09-22T08:36:23.978766+0000","last_became_peered":"2024-09-22T08:36:23.978766+0000","last_unstale":"2024-09-22T08:40:06.332632+0000","last_undegraded":"2024-09-22T08:40:06.332632+0000","last_fullsized":"2024-09-22T08:40:06.332632+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:06.332545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:06.332545+0000","last_clean_scrub_stamp":"2024-09-22T08:40:06.332545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:25:05.583350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"32'8","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:17.301333+0000","last_change":"2024-09-22T08:40:17.301230+0000","last_active":"2024-09-22T08:40:17.301333+0000","last_peered":"2024-09-22T08:40:17.301333+0000","last_clean":"2024-09-22T08:40:17.301333+0000","last_became_active":"2024-09-22T08:36:25.978937+0000","last_became_peered":"2024-09-22T08:36:25.978937+0000","last_unstale":"2024-09-22T08:40:17.301333+0000","last_undegraded":"2024-09-22T08:40:17.301333+0000","last_fullsized":"2024-09-22T08:40:17.301333+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-22T08:40:17.301118+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-22T08:40:17.301118+0000","last_clean_scrub_stamp":"2024-09-22T08:40:17.301118+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:02:08.767907+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":23,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"32'4","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:01.435460+0000","last_change":"2024-09-22T08:40:01.435460+0000","last_active":"2024-09-22T08:40:01.435460+0000","last_peered":"2024-09-22T08:40:01.435460+0000","last_clean":"2024-09-22T08:40:01.435460+0000","last_became_active":"2024-09-22T08:36:23.967168+0000","last_became_peered":"2024-09-22T08:36:23.967168+0000","last_unstale":"2024-09-22T08:40:01.435460+0000","last_undegraded":"2024-09-22T08:40:01.435460+0000","last_fullsized":"2024-09-22T08:40:01.435460+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-22T08:40:01.435370+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-22T08:40:01.435370+0000","last_clean_scrub_stamp":"2024-09-22T08:40:01.435370+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:31:33.320075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":10,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"32'6","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:27.601737+0000","last_change":"2024-09-22T08:40:27.601635+0000","last_active":"2024-09-22T08:40:27.601737+0000","last_peered":"2024-09-22T08:40:27.601737+0000","last_clean":"2024-09-22T08:40:27.601737+0000","last_became_active":"2024-09-22T08:36:25.990727+0000","last_became_peered":"2024-09-22T08:36:25.990727+0000","last_unstale":"2024-09-22T08:40:27.601737+0000","last_undegraded":"2024-09-22T08:40:27.601737+0000","last_fullsized":"2024-09-22T08:40:27.601737+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-22T08:40:27.601539+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-22T08:40:27.601539+0000","last_clean_scrub_stamp":"2024-09-22T08:40:27.601539+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:14:55.668548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:04.247350+0000","last_change":"2024-09-22T08:40:04.247350+0000","last_active":"2024-09-22T08:40:04.247350+0000","last_peered":"2024-09-22T08:40:04.247350+0000","last_clean":"2024-09-22T08:40:04.247350+0000","last_became_active":"2024-09-22T08:36:23.980446+0000","last_became_peered":"2024-09-22T08:36:23.980446+0000","last_unstale":"2024-09-22T08:40:04.247350+0000","last_undegraded":"2024-09-22T08:40:04.247350+0000","last_fullsized":"2024-09-22T08:40:04.247350+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:04.247231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:04.247231+0000","last_clean_scrub_stamp":"2024-09-22T08:40:04.247231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:03:00.194431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"32'8","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:06.366503+0000","last_change":"2024-09-22T08:40:06.366446+0000","last_active":"2024-09-22T08:40:06.366503+0000","last_peered":"2024-09-22T08:40:06.366503+0000","last_clean":"2024-09-22T08:40:06.366503+0000","last_became_active":"2024-09-22T08:36:25.982217+0000","last_became_peered":"2024-09-22T08:36:25.982217+0000","last_unstale":"2024-09-22T08:40:06.366503+0000","last_undegraded":"2024-09-22T08:40:06.366503+0000","last_fullsized":"2024-09-22T08:40:06.366503+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-22T08:40:06.366369+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-22T08:40:06.366369+0000","last_clean_scrub_stamp":"2024-09-22T08:40:06.366369+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:25:30.349302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":27,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:57.845968+0000","last_change":"2024-09-22T08:39:57.845968+0000","last_active":"2024-09-22T08:39:57.845968+0000","last_peered":"2024-09-22T08:39:57.845968+0000","last_clean":"2024-09-22T08:39:57.845968+0000","last_became_active":"2024-09-22T08:36:23.977715+0000","last_became_peered":"2024-09-22T08:36:23.977715+0000","last_unstale":"2024-09-22T08:39:57.845968+0000","last_undegraded":"2024-09-22T08:39:57.845968+0000","last_fullsized":"2024-09-22T08:39:57.845968+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-22T08:39:57.845879+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-22T08:39:57.845879+0000","last_clean_scrub_stamp":"2024-09-22T08:39:57.845879+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:42:05.377364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"32'8","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:09.396348+0000","last_change":"2024-09-22T08:40:09.396278+0000","last_active":"2024-09-22T08:40:09.396348+0000","last_peered":"2024-09-22T08:40:09.396348+0000","last_clean":"2024-09-22T08:40:09.396348+0000","last_became_active":"2024-09-22T08:36:25.974930+0000","last_became_peered":"2024-09-22T08:36:25.974930+0000","last_unstale":"2024-09-22T08:40:09.396348+0000","last_undegraded":"2024-09-22T08:40:09.396348+0000","last_fullsized":"2024-09-22T08:40:09.396348+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-22T08:40:09.396197+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-22T08:40:09.396197+0000","last_clean_scrub_stamp":"2024-09-22T08:40:09.396197+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:50:08.671881+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"32'4","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:23.597042+0000","last_change":"2024-09-22T08:40:23.597042+0000","last_active":"2024-09-22T08:40:23.597042+0000","last_peered":"2024-09-22T08:40:23.597042+0000","last_clean":"2024-09-22T08:40:23.597042+0000","last_became_active":"2024-09-22T08:36:25.991870+0000","last_became_peered":"2024-09-22T08:36:25.991870+0000","last_unstale":"2024-09-22T08:40:23.597042+0000","last_undegraded":"2024-09-22T08:40:23.597042+0000","last_fullsized":"2024-09-22T08:40:23.597042+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-22T08:40:23.596954+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-22T08:40:23.596954+0000","last_clean_scrub_stamp":"2024-09-22T08:40:23.596954+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:00:06.490632+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:57.283661+0000","last_change":"2024-09-22T08:39:57.283661+0000","last_active":"2024-09-22T08:39:57.283661+0000","last_peered":"2024-09-22T08:39:57.283661+0000","last_clean":"2024-09-22T08:39:57.283661+0000","last_became_active":"2024-09-22T08:36:23.977556+0000","last_became_peered":"2024-09-22T08:36:23.977556+0000","last_unstale":"2024-09-22T08:39:57.283661+0000","last_undegraded":"2024-09-22T08:39:57.283661+0000","last_fullsized":"2024-09-22T08:39:57.283661+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:39:57.283537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:39:57.283537+0000","last_clean_scrub_stamp":"2024-09-22T08:39:57.283537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:31:33.140772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"32'14","reported_seq":80,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:11.433190+0000","last_change":"2024-09-22T08:40:11.433190+0000","last_active":"2024-09-22T08:40:11.433190+0000","last_peered":"2024-09-22T08:40:11.433190+0000","last_clean":"2024-09-22T08:40:11.433190+0000","last_became_active":"2024-09-22T08:36:25.976389+0000","last_became_peered":"2024-09-22T08:36:25.976389+0000","last_unstale":"2024-09-22T08:40:11.433190+0000","last_undegraded":"2024-09-22T08:40:11.433190+0000","last_fullsized":"2024-09-22T08:40:11.433190+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'14","last_scrub_stamp":"2024-09-22T08:40:11.433107+0000","last_deep_scrub":"32'14","last_deep_scrub_stamp":"2024-09-22T08:40:11.433107+0000","last_clean_scrub_stamp":"2024-09-22T08:40:11.433107+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:20:10.105300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":49,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"32'2","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:57.549716+0000","last_change":"2024-09-22T08:39:57.549716+0000","last_active":"2024-09-22T08:39:57.549716+0000","last_peered":"2024-09-22T08:39:57.549716+0000","last_clean":"2024-09-22T08:39:57.549716+0000","last_became_active":"2024-09-22T08:36:23.974275+0000","last_became_peered":"2024-09-22T08:36:23.974275+0000","last_unstale":"2024-09-22T08:39:57.549716+0000","last_undegraded":"2024-09-22T08:39:57.549716+0000","last_fullsized":"2024-09-22T08:39:57.549716+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-22T08:39:57.549604+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-22T08:39:57.549604+0000","last_clean_scrub_stamp":"2024-09-22T08:39:57.549604+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:02:09.510635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"32'14","reported_seq":74,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:12.409862+0000","last_change":"2024-09-22T08:40:12.409862+0000","last_active":"2024-09-22T08:40:12.409862+0000","last_peered":"2024-09-22T08:40:12.409862+0000","last_clean":"2024-09-22T08:40:12.409862+0000","last_became_active":"2024-09-22T08:36:25.977015+0000","last_became_peered":"2024-09-22T08:36:25.977015+0000","last_unstale":"2024-09-22T08:40:12.409862+0000","last_undegraded":"2024-09-22T08:40:12.409862+0000","last_fullsized":"2024-09-22T08:40:12.409862+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'14","last_scrub_stamp":"2024-09-22T08:40:12.409763+0000","last_deep_scrub":"32'14","last_deep_scrub_stamp":"2024-09-22T08:40:12.409763+0000","last_clean_scrub_stamp":"2024-09-22T08:40:12.409763+0000","objects_scrubbed":2,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:14:30.930010+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":43,"num_read_kb":39,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:55.220138+0000","last_change":"2024-09-22T08:39:55.220138+0000","last_active":"2024-09-22T08:39:55.220138+0000","last_peered":"2024-09-22T08:39:55.220138+0000","last_clean":"2024-09-22T08:39:55.220138+0000","last_became_active":"2024-09-22T08:36:23.984411+0000","last_became_peered":"2024-09-22T08:36:23.984411+0000","last_unstale":"2024-09-22T08:39:55.220138+0000","last_undegraded":"2024-09-22T08:39:55.220138+0000","last_fullsized":"2024-09-22T08:39:55.220138+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-22T08:39:55.220017+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-22T08:39:55.220017+0000","last_clean_scrub_stamp":"2024-09-22T08:39:55.220017+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:52:34.074155+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"32'2","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:11.833416+0000","last_change":"2024-09-22T08:40:11.833416+0000","last_active":"2024-09-22T08:40:11.833416+0000","last_peered":"2024-09-22T08:40:11.833416+0000","last_clean":"2024-09-22T08:40:11.833416+0000","last_became_active":"2024-09-22T08:36:25.984037+0000","last_became_peered":"2024-09-22T08:36:25.984037+0000","last_unstale":"2024-09-22T08:40:11.833416+0000","last_undegraded":"2024-09-22T08:40:11.833416+0000","last_fullsized":"2024-09-22T08:40:11.833416+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-22T08:40:11.833329+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-22T08:40:11.833329+0000","last_clean_scrub_stamp":"2024-09-22T08:40:11.833329+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:13:05.009738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"32'2","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:56.237269+0000","last_change":"2024-09-22T08:39:56.237269+0000","last_active":"2024-09-22T08:39:56.237269+0000","last_peered":"2024-09-22T08:39:56.237269+0000","last_clean":"2024-09-22T08:39:56.237269+0000","last_became_active":"2024-09-22T08:36:23.969183+0000","last_became_peered":"2024-09-22T08:36:23.969183+0000","last_unstale":"2024-09-22T08:39:56.237269+0000","last_undegraded":"2024-09-22T08:39:56.237269+0000","last_fullsized":"2024-09-22T08:39:56.237269+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-22T08:39:56.237185+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-22T08:39:56.237185+0000","last_clean_scrub_stamp":"2024-09-22T08:39:56.237185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:26:53.537080+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"32'18","reported_seq":75,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:08.416216+0000","last_change":"2024-09-22T08:40:08.416216+0000","last_active":"2024-09-22T08:40:08.416216+0000","last_peered":"2024-09-22T08:40:08.416216+0000","last_clean":"2024-09-22T08:40:08.416216+0000","last_became_active":"2024-09-22T08:36:25.985797+0000","last_became_peered":"2024-09-22T08:36:25.985797+0000","last_unstale":"2024-09-22T08:40:08.416216+0000","last_undegraded":"2024-09-22T08:40:08.416216+0000","last_fullsized":"2024-09-22T08:40:08.416216+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'18","last_scrub_stamp":"2024-09-22T08:40:08.416117+0000","last_deep_scrub":"32'18","last_deep_scrub_stamp":"2024-09-22T08:40:08.416117+0000","last_clean_scrub_stamp":"2024-09-22T08:40:08.416117+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:55:55.096190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":61,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:56.863666+0000","last_change":"2024-09-22T08:39:56.863666+0000","last_active":"2024-09-22T08:39:56.863666+0000","last_peered":"2024-09-22T08:39:56.863666+0000","last_clean":"2024-09-22T08:39:56.863666+0000","last_became_active":"2024-09-22T08:36:23.974359+0000","last_became_peered":"2024-09-22T08:36:23.974359+0000","last_unstale":"2024-09-22T08:39:56.863666+0000","last_undegraded":"2024-09-22T08:39:56.863666+0000","last_fullsized":"2024-09-22T08:39:56.863666+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-22T08:39:56.863584+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-22T08:39:56.863584+0000","last_clean_scrub_stamp":"2024-09-22T08:39:56.863584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:41:23.122061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"32'16","reported_seq":70,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:13.382482+0000","last_change":"2024-09-22T08:40:13.382482+0000","last_active":"2024-09-22T08:40:13.382482+0000","last_peered":"2024-09-22T08:40:13.382482+0000","last_clean":"2024-09-22T08:40:13.382482+0000","last_became_active":"2024-09-22T08:36:25.977320+0000","last_became_peered":"2024-09-22T08:36:25.977320+0000","last_unstale":"2024-09-22T08:40:13.382482+0000","last_undegraded":"2024-09-22T08:40:13.382482+0000","last_fullsized":"2024-09-22T08:40:13.382482+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'16","last_scrub_stamp":"2024-09-22T08:40:13.382400+0000","last_deep_scrub":"32'16","last_deep_scrub_stamp":"2024-09-22T08:40:13.382400+0000","last_clean_scrub_stamp":"2024-09-22T08:40:13.382400+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:13:53.645578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":49,"num_write":21,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"32'2","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:07.381293+0000","last_change":"2024-09-22T08:40:07.381293+0000","last_active":"2024-09-22T08:40:07.381293+0000","last_peered":"2024-09-22T08:40:07.381293+0000","last_clean":"2024-09-22T08:40:07.381293+0000","last_became_active":"2024-09-22T08:36:23.980189+0000","last_became_peered":"2024-09-22T08:36:23.980189+0000","last_unstale":"2024-09-22T08:40:07.381293+0000","last_undegraded":"2024-09-22T08:40:07.381293+0000","last_fullsized":"2024-09-22T08:40:07.381293+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-22T08:40:07.381185+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-22T08:40:07.381185+0000","last_clean_scrub_stamp":"2024-09-22T08:40:07.381185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:45:20.018380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"32'35","reported_seq":100,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.238012+0000","last_change":"2024-09-22T08:36:34.015950+0000","last_active":"2024-09-22T08:39:32.238012+0000","last_peered":"2024-09-22T08:39:32.238012+0000","last_clean":"2024-09-22T08:39:32.238012+0000","last_became_active":"2024-09-22T08:36:34.015696+0000","last_became_peered":"2024-09-22T08:36:34.015696+0000","last_unstale":"2024-09-22T08:39:32.238012+0000","last_undegraded":"2024-09-22T08:39:32.238012+0000","last_fullsized":"2024-09-22T08:39:32.238012+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:48:07.077185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":173,"num_read_kb":173,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"32'6","reported_seq":61,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:13.437831+0000","last_change":"2024-09-22T08:40:13.437831+0000","last_active":"2024-09-22T08:40:13.437831+0000","last_peered":"2024-09-22T08:40:13.437831+0000","last_clean":"2024-09-22T08:40:13.437831+0000","last_became_active":"2024-09-22T08:36:25.987811+0000","last_became_peered":"2024-09-22T08:36:25.987811+0000","last_unstale":"2024-09-22T08:40:13.437831+0000","last_undegraded":"2024-09-22T08:40:13.437831+0000","last_fullsized":"2024-09-22T08:40:13.437831+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-22T08:40:13.437749+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-22T08:40:13.437749+0000","last_clean_scrub_stamp":"2024-09-22T08:40:13.437749+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:42:52.209301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:52.378512+0000","last_change":"2024-09-22T08:39:52.378512+0000","last_active":"2024-09-22T08:39:52.378512+0000","last_peered":"2024-09-22T08:39:52.378512+0000","last_clean":"2024-09-22T08:39:52.378512+0000","last_became_active":"2024-09-22T08:36:23.982423+0000","last_became_peered":"2024-09-22T08:36:23.982423+0000","last_unstale":"2024-09-22T08:39:52.378512+0000","last_undegraded":"2024-09-22T08:39:52.378512+0000","last_fullsized":"2024-09-22T08:39:52.378512+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:39:52.378424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:39:52.378424+0000","last_clean_scrub_stamp":"2024-09-22T08:39:52.378424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:48:16.834018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:34.483277+0000","last_change":"2024-09-22T08:40:34.483277+0000","last_active":"2024-09-22T08:40:34.483277+0000","last_peered":"2024-09-22T08:40:34.483277+0000","last_clean":"2024-09-22T08:40:34.483277+0000","last_became_active":"2024-09-22T08:36:27.988057+0000","last_became_peered":"2024-09-22T08:36:27.988057+0000","last_unstale":"2024-09-22T08:40:34.483277+0000","last_undegraded":"2024-09-22T08:40:34.483277+0000","last_fullsized":"2024-09-22T08:40:34.483277+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:34.483200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:34.483200+0000","last_clean_scrub_stamp":"2024-09-22T08:40:34.483200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:17:21.473508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"32'33","reported_seq":80,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:38.945435+0000","last_change":"2024-09-22T08:36:29.995218+0000","last_active":"2024-09-22T08:39:38.945435+0000","last_peered":"2024-09-22T08:39:38.945435+0000","last_clean":"2024-09-22T08:39:38.945435+0000","last_became_active":"2024-09-22T08:36:29.994881+0000","last_became_peered":"2024-09-22T08:36:29.994881+0000","last_unstale":"2024-09-22T08:39:38.945435+0000","last_undegraded":"2024-09-22T08:39:38.945435+0000","last_fullsized":"2024-09-22T08:39:38.945435+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:46:41.834484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:37.369943+0000","last_change":"2024-09-22T08:40:37.369943+0000","last_active":"2024-09-22T08:40:37.369943+0000","last_peered":"2024-09-22T08:40:37.369943+0000","last_clean":"2024-09-22T08:40:37.369943+0000","last_became_active":"2024-09-22T08:36:32.013249+0000","last_became_peered":"2024-09-22T08:36:32.013249+0000","last_unstale":"2024-09-22T08:40:37.369943+0000","last_undegraded":"2024-09-22T08:40:37.369943+0000","last_fullsized":"2024-09-22T08:40:37.369943+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:37.369829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:37.369829+0000","last_clean_scrub_stamp":"2024-09-22T08:40:37.369829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:03:42.407066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"32'7","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:47.949724+0000","last_change":"2024-09-22T08:36:34.015432+0000","last_active":"2024-09-22T08:37:47.949724+0000","last_peered":"2024-09-22T08:37:47.949724+0000","last_clean":"2024-09-22T08:37:47.949724+0000","last_became_active":"2024-09-22T08:36:34.015170+0000","last_became_peered":"2024-09-22T08:36:34.015170+0000","last_unstale":"2024-09-22T08:37:47.949724+0000","last_undegraded":"2024-09-22T08:37:47.949724+0000","last_fullsized":"2024-09-22T08:37:47.949724+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:45:21.601440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"32'2","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:14.450214+0000","last_change":"2024-09-22T08:40:14.450214+0000","last_active":"2024-09-22T08:40:14.450214+0000","last_peered":"2024-09-22T08:40:14.450214+0000","last_clean":"2024-09-22T08:40:14.450214+0000","last_became_active":"2024-09-22T08:36:25.989583+0000","last_became_peered":"2024-09-22T08:36:25.989583+0000","last_unstale":"2024-09-22T08:40:14.450214+0000","last_undegraded":"2024-09-22T08:40:14.450214+0000","last_fullsized":"2024-09-22T08:40:14.450214+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-22T08:40:14.450079+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-22T08:40:14.450079+0000","last_clean_scrub_stamp":"2024-09-22T08:40:14.450079+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:50:05.715618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"32'2","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:50.670046+0000","last_change":"2024-09-22T08:39:50.670046+0000","last_active":"2024-09-22T08:39:50.670046+0000","last_peered":"2024-09-22T08:39:50.670046+0000","last_clean":"2024-09-22T08:39:50.670046+0000","last_became_active":"2024-09-22T08:36:23.973716+0000","last_became_peered":"2024-09-22T08:36:23.973716+0000","last_unstale":"2024-09-22T08:39:50.670046+0000","last_undegraded":"2024-09-22T08:39:50.670046+0000","last_fullsized":"2024-09-22T08:39:50.670046+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-22T08:39:50.669969+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-22T08:39:50.669969+0000","last_clean_scrub_stamp":"2024-09-22T08:39:50.669969+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:51:53.477798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:21.357079+0000","last_change":"2024-09-22T08:40:21.357079+0000","last_active":"2024-09-22T08:40:21.357079+0000","last_peered":"2024-09-22T08:40:21.357079+0000","last_clean":"2024-09-22T08:40:21.357079+0000","last_became_active":"2024-09-22T08:37:04.229132+0000","last_became_peered":"2024-09-22T08:37:04.229132+0000","last_unstale":"2024-09-22T08:40:21.357079+0000","last_undegraded":"2024-09-22T08:40:21.357079+0000","last_fullsized":"2024-09-22T08:40:21.357079+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:21.356998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:21.356998+0000","last_clean_scrub_stamp":"2024-09-22T08:40:21.356998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:11:54.368083+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"32'9","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:31.392908+0000","last_change":"2024-09-22T08:40:31.392908+0000","last_active":"2024-09-22T08:40:31.392908+0000","last_peered":"2024-09-22T08:40:31.392908+0000","last_clean":"2024-09-22T08:40:31.392908+0000","last_became_active":"2024-09-22T08:36:29.990998+0000","last_became_peered":"2024-09-22T08:36:29.990998+0000","last_unstale":"2024-09-22T08:40:31.392908+0000","last_undegraded":"2024-09-22T08:40:31.392908+0000","last_fullsized":"2024-09-22T08:40:31.392908+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'9","last_scrub_stamp":"2024-09-22T08:40:31.392802+0000","last_deep_scrub":"32'9","last_deep_scrub_stamp":"2024-09-22T08:40:31.392802+0000","last_clean_scrub_stamp":"2024-09-22T08:40:31.392802+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:03:13.570471+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:36.364189+0000","last_change":"2024-09-22T08:40:36.364189+0000","last_active":"2024-09-22T08:40:36.364189+0000","last_peered":"2024-09-22T08:40:36.364189+0000","last_clean":"2024-09-22T08:40:36.364189+0000","last_became_active":"2024-09-22T08:36:32.006161+0000","last_became_peered":"2024-09-22T08:36:32.006161+0000","last_unstale":"2024-09-22T08:40:36.364189+0000","last_undegraded":"2024-09-22T08:40:36.364189+0000","last_fullsized":"2024-09-22T08:40:36.364189+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:36.364094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:36.364094+0000","last_clean_scrub_stamp":"2024-09-22T08:40:36.364094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:26:36.338748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"30'2","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.223331+0000","last_change":"2024-09-22T08:36:34.017093+0000","last_active":"2024-09-22T08:37:04.223331+0000","last_peered":"2024-09-22T08:37:04.223331+0000","last_clean":"2024-09-22T08:37:04.223331+0000","last_became_active":"2024-09-22T08:36:34.016749+0000","last_became_peered":"2024-09-22T08:36:34.016749+0000","last_unstale":"2024-09-22T08:37:04.223331+0000","last_undegraded":"2024-09-22T08:37:04.223331+0000","last_fullsized":"2024-09-22T08:37:04.223331+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:18:00.649317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"32'8","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:16.461402+0000","last_change":"2024-09-22T08:40:16.461402+0000","last_active":"2024-09-22T08:40:16.461402+0000","last_peered":"2024-09-22T08:40:16.461402+0000","last_clean":"2024-09-22T08:40:16.461402+0000","last_became_active":"2024-09-22T08:36:25.987860+0000","last_became_peered":"2024-09-22T08:36:25.987860+0000","last_unstale":"2024-09-22T08:40:16.461402+0000","last_undegraded":"2024-09-22T08:40:16.461402+0000","last_fullsized":"2024-09-22T08:40:16.461402+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-22T08:40:16.461252+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-22T08:40:16.461252+0000","last_clean_scrub_stamp":"2024-09-22T08:40:16.461252+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:08:26.205157+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:54.365627+0000","last_change":"2024-09-22T08:39:54.365627+0000","last_active":"2024-09-22T08:39:54.365627+0000","last_peered":"2024-09-22T08:39:54.365627+0000","last_clean":"2024-09-22T08:39:54.365627+0000","last_became_active":"2024-09-22T08:36:23.979201+0000","last_became_peered":"2024-09-22T08:36:23.979201+0000","last_unstale":"2024-09-22T08:39:54.365627+0000","last_undegraded":"2024-09-22T08:39:54.365627+0000","last_fullsized":"2024-09-22T08:39:54.365627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:39:54.365537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:39:54.365537+0000","last_clean_scrub_stamp":"2024-09-22T08:39:54.365537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:12:06.963553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:18.892804+0000","last_change":"2024-09-22T08:40:18.892804+0000","last_active":"2024-09-22T08:40:18.892804+0000","last_peered":"2024-09-22T08:40:18.892804+0000","last_clean":"2024-09-22T08:40:18.892804+0000","last_became_active":"2024-09-22T08:36:27.987410+0000","last_became_peered":"2024-09-22T08:36:27.987410+0000","last_unstale":"2024-09-22T08:40:18.892804+0000","last_undegraded":"2024-09-22T08:40:18.892804+0000","last_fullsized":"2024-09-22T08:40:18.892804+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:18.892720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:18.892720+0000","last_clean_scrub_stamp":"2024-09-22T08:40:18.892720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:35:19.353672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"32'15","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:21.443057+0000","last_change":"2024-09-22T08:40:21.443057+0000","last_active":"2024-09-22T08:40:21.443057+0000","last_peered":"2024-09-22T08:40:21.443057+0000","last_clean":"2024-09-22T08:40:21.443057+0000","last_became_active":"2024-09-22T08:36:29.999306+0000","last_became_peered":"2024-09-22T08:36:29.999306+0000","last_unstale":"2024-09-22T08:40:21.443057+0000","last_undegraded":"2024-09-22T08:40:21.443057+0000","last_fullsized":"2024-09-22T08:40:21.443057+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'15","last_scrub_stamp":"2024-09-22T08:40:21.442962+0000","last_deep_scrub":"32'15","last_deep_scrub_stamp":"2024-09-22T08:40:21.442962+0000","last_clean_scrub_stamp":"2024-09-22T08:40:21.442962+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:58:30.895413+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"32'285","reported_seq":418,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:38.824267+0000","last_change":"2024-09-22T08:36:32.014175+0000","last_active":"2024-09-22T08:39:38.824267+0000","last_peered":"2024-09-22T08:39:38.824267+0000","last_clean":"2024-09-22T08:39:38.824267+0000","last_became_active":"2024-09-22T08:36:32.013869+0000","last_became_peered":"2024-09-22T08:36:32.013869+0000","last_unstale":"2024-09-22T08:39:38.824267+0000","last_undegraded":"2024-09-22T08:39:38.824267+0000","last_fullsized":"2024-09-22T08:39:38.824267+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:23:53.788685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:34.533590+0000","last_change":"2024-09-22T08:40:34.533590+0000","last_active":"2024-09-22T08:40:34.533590+0000","last_peered":"2024-09-22T08:40:34.533590+0000","last_clean":"2024-09-22T08:40:34.533590+0000","last_became_active":"2024-09-22T08:36:34.015999+0000","last_became_peered":"2024-09-22T08:36:34.015999+0000","last_unstale":"2024-09-22T08:40:34.533590+0000","last_undegraded":"2024-09-22T08:40:34.533590+0000","last_fullsized":"2024-09-22T08:40:34.533590+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:34.533498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:34.533498+0000","last_clean_scrub_stamp":"2024-09-22T08:40:34.533498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:54:14.287340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"30'4","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:02.829539+0000","last_change":"2024-09-22T08:40:02.829539+0000","last_active":"2024-09-22T08:40:02.829539+0000","last_peered":"2024-09-22T08:40:02.829539+0000","last_clean":"2024-09-22T08:40:02.829539+0000","last_became_active":"2024-09-22T08:36:25.979320+0000","last_became_peered":"2024-09-22T08:36:25.979320+0000","last_unstale":"2024-09-22T08:40:02.829539+0000","last_undegraded":"2024-09-22T08:40:02.829539+0000","last_fullsized":"2024-09-22T08:40:02.829539+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'4","last_scrub_stamp":"2024-09-22T08:40:02.829450+0000","last_deep_scrub":"30'4","last_deep_scrub_stamp":"2024-09-22T08:40:02.829450+0000","last_clean_scrub_stamp":"2024-09-22T08:40:02.829450+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:25:40.999415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:45.068211+0000","last_change":"2024-09-22T08:39:45.068211+0000","last_active":"2024-09-22T08:39:45.068211+0000","last_peered":"2024-09-22T08:39:45.068211+0000","last_clean":"2024-09-22T08:39:45.068211+0000","last_became_active":"2024-09-22T08:36:23.975428+0000","last_became_peered":"2024-09-22T08:36:23.975428+0000","last_unstale":"2024-09-22T08:39:45.068211+0000","last_undegraded":"2024-09-22T08:39:45.068211+0000","last_fullsized":"2024-09-22T08:39:45.068211+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:39:45.068115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:39:45.068115+0000","last_clean_scrub_stamp":"2024-09-22T08:39:45.068115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:04:18.711452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:36.500599+0000","last_change":"2024-09-22T08:40:36.500599+0000","last_active":"2024-09-22T08:40:36.500599+0000","last_peered":"2024-09-22T08:40:36.500599+0000","last_clean":"2024-09-22T08:40:36.500599+0000","last_became_active":"2024-09-22T08:36:27.984658+0000","last_became_peered":"2024-09-22T08:36:27.984658+0000","last_unstale":"2024-09-22T08:40:36.500599+0000","last_undegraded":"2024-09-22T08:40:36.500599+0000","last_fullsized":"2024-09-22T08:40:36.500599+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:36.500515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:36.500515+0000","last_clean_scrub_stamp":"2024-09-22T08:40:36.500515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:48:11.472744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"32'37","reported_seq":92,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:22.432096+0000","last_change":"2024-09-22T08:40:22.432096+0000","last_active":"2024-09-22T08:40:22.432096+0000","last_peered":"2024-09-22T08:40:22.432096+0000","last_clean":"2024-09-22T08:40:22.432096+0000","last_became_active":"2024-09-22T08:36:30.000641+0000","last_became_peered":"2024-09-22T08:36:30.000641+0000","last_unstale":"2024-09-22T08:40:22.432096+0000","last_undegraded":"2024-09-22T08:40:22.432096+0000","last_fullsized":"2024-09-22T08:40:22.432096+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'37","last_scrub_stamp":"2024-09-22T08:40:22.432008+0000","last_deep_scrub":"32'37","last_deep_scrub_stamp":"2024-09-22T08:40:22.432008+0000","last_clean_scrub_stamp":"2024-09-22T08:40:22.432008+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:59:09.948186+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"32'286","reported_seq":436,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:33.836032+0000","last_change":"2024-09-22T08:40:33.836032+0000","last_active":"2024-09-22T08:40:33.836032+0000","last_peered":"2024-09-22T08:40:33.836032+0000","last_clean":"2024-09-22T08:40:33.836032+0000","last_became_active":"2024-09-22T08:36:32.005012+0000","last_became_peered":"2024-09-22T08:36:32.005012+0000","last_unstale":"2024-09-22T08:40:33.836032+0000","last_undegraded":"2024-09-22T08:40:33.836032+0000","last_fullsized":"2024-09-22T08:40:33.836032+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'286","last_scrub_stamp":"2024-09-22T08:40:33.835941+0000","last_deep_scrub":"32'286","last_deep_scrub_stamp":"2024-09-22T08:40:33.835941+0000","last_clean_scrub_stamp":"2024-09-22T08:40:33.835941+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:45:21.756190+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"32'4","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:12.437028+0000","last_change":"2024-09-22T08:40:12.437028+0000","last_active":"2024-09-22T08:40:12.437028+0000","last_peered":"2024-09-22T08:40:12.437028+0000","last_clean":"2024-09-22T08:40:12.437028+0000","last_became_active":"2024-09-22T08:36:25.989940+0000","last_became_peered":"2024-09-22T08:36:25.989940+0000","last_unstale":"2024-09-22T08:40:12.437028+0000","last_undegraded":"2024-09-22T08:40:12.437028+0000","last_fullsized":"2024-09-22T08:40:12.437028+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-22T08:40:12.436939+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-22T08:40:12.436939+0000","last_clean_scrub_stamp":"2024-09-22T08:40:12.436939+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:59:47.804661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:46.601168+0000","last_change":"2024-09-22T08:39:46.601168+0000","last_active":"2024-09-22T08:39:46.601168+0000","last_peered":"2024-09-22T08:39:46.601168+0000","last_clean":"2024-09-22T08:39:46.601168+0000","last_became_active":"2024-09-22T08:36:23.970093+0000","last_became_peered":"2024-09-22T08:36:23.970093+0000","last_unstale":"2024-09-22T08:39:46.601168+0000","last_undegraded":"2024-09-22T08:39:46.601168+0000","last_fullsized":"2024-09-22T08:39:46.601168+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:39:46.601074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:39:46.601074+0000","last_clean_scrub_stamp":"2024-09-22T08:39:46.601074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:08:12.326140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:18.296552+0000","last_change":"2024-09-22T08:40:18.296552+0000","last_active":"2024-09-22T08:40:18.296552+0000","last_peered":"2024-09-22T08:40:18.296552+0000","last_clean":"2024-09-22T08:40:18.296552+0000","last_became_active":"2024-09-22T08:36:27.986734+0000","last_became_peered":"2024-09-22T08:36:27.986734+0000","last_unstale":"2024-09-22T08:40:18.296552+0000","last_undegraded":"2024-09-22T08:40:18.296552+0000","last_fullsized":"2024-09-22T08:40:18.296552+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:18.296463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:18.296463+0000","last_clean_scrub_stamp":"2024-09-22T08:40:18.296463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:16:18.206096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"32'52","reported_seq":112,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:17.437571+0000","last_change":"2024-09-22T08:40:17.437571+0000","last_active":"2024-09-22T08:40:17.437571+0000","last_peered":"2024-09-22T08:40:17.437571+0000","last_clean":"2024-09-22T08:40:17.437571+0000","last_became_active":"2024-09-22T08:36:29.990809+0000","last_became_peered":"2024-09-22T08:36:29.990809+0000","last_unstale":"2024-09-22T08:40:17.437571+0000","last_undegraded":"2024-09-22T08:40:17.437571+0000","last_fullsized":"2024-09-22T08:40:17.437571+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'52","last_scrub_stamp":"2024-09-22T08:40:17.437457+0000","last_deep_scrub":"32'52","last_deep_scrub_stamp":"2024-09-22T08:40:17.437457+0000","last_clean_scrub_stamp":"2024-09-22T08:40:17.437457+0000","objects_scrubbed":9,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:50:34.481525+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:34.812776+0000","last_change":"2024-09-22T08:40:34.812776+0000","last_active":"2024-09-22T08:40:34.812776+0000","last_peered":"2024-09-22T08:40:34.812776+0000","last_clean":"2024-09-22T08:40:34.812776+0000","last_became_active":"2024-09-22T08:36:32.003726+0000","last_became_peered":"2024-09-22T08:36:32.003726+0000","last_unstale":"2024-09-22T08:40:34.812776+0000","last_undegraded":"2024-09-22T08:40:34.812776+0000","last_fullsized":"2024-09-22T08:40:34.812776+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:34.812691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:34.812691+0000","last_clean_scrub_stamp":"2024-09-22T08:40:34.812691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:00:48.199101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"32'5","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:31.465514+0000","last_change":"2024-09-22T08:40:31.465514+0000","last_active":"2024-09-22T08:40:31.465514+0000","last_peered":"2024-09-22T08:40:31.465514+0000","last_clean":"2024-09-22T08:40:31.465514+0000","last_became_active":"2024-09-22T08:36:34.022448+0000","last_became_peered":"2024-09-22T08:36:34.022448+0000","last_unstale":"2024-09-22T08:40:31.465514+0000","last_undegraded":"2024-09-22T08:40:31.465514+0000","last_fullsized":"2024-09-22T08:40:31.465514+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'5","last_scrub_stamp":"2024-09-22T08:40:31.465423+0000","last_deep_scrub":"32'5","last_deep_scrub_stamp":"2024-09-22T08:40:31.465423+0000","last_clean_scrub_stamp":"2024-09-22T08:40:31.465423+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:38:40.836439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":13,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"32'10","reported_seq":67,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:00.348098+0000","last_change":"2024-09-22T08:40:00.348098+0000","last_active":"2024-09-22T08:40:00.348098+0000","last_peered":"2024-09-22T08:40:00.348098+0000","last_clean":"2024-09-22T08:40:00.348098+0000","last_became_active":"2024-09-22T08:36:25.975728+0000","last_became_peered":"2024-09-22T08:36:25.975728+0000","last_unstale":"2024-09-22T08:40:00.348098+0000","last_undegraded":"2024-09-22T08:40:00.348098+0000","last_fullsized":"2024-09-22T08:40:00.348098+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-09-22T08:40:00.348005+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-09-22T08:40:00.348005+0000","last_clean_scrub_stamp":"2024-09-22T08:40:00.348005+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:50:17.392073+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:47.621398+0000","last_change":"2024-09-22T08:39:47.621398+0000","last_active":"2024-09-22T08:39:47.621398+0000","last_peered":"2024-09-22T08:39:47.621398+0000","last_clean":"2024-09-22T08:39:47.621398+0000","last_became_active":"2024-09-22T08:36:23.968836+0000","last_became_peered":"2024-09-22T08:36:23.968836+0000","last_unstale":"2024-09-22T08:39:47.621398+0000","last_undegraded":"2024-09-22T08:39:47.621398+0000","last_fullsized":"2024-09-22T08:39:47.621398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-22T08:39:47.621313+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-22T08:39:47.621313+0000","last_clean_scrub_stamp":"2024-09-22T08:39:47.621313+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:26:56.822278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:14.829193+0000","last_change":"2024-09-22T08:40:14.829193+0000","last_active":"2024-09-22T08:40:14.829193+0000","last_peered":"2024-09-22T08:40:14.829193+0000","last_clean":"2024-09-22T08:40:14.829193+0000","last_became_active":"2024-09-22T08:36:27.987577+0000","last_became_peered":"2024-09-22T08:36:27.987577+0000","last_unstale":"2024-09-22T08:40:14.829193+0000","last_undegraded":"2024-09-22T08:40:14.829193+0000","last_fullsized":"2024-09-22T08:40:14.829193+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:14.829090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:14.829090+0000","last_clean_scrub_stamp":"2024-09-22T08:40:14.829090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:13:09.683686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"32'38","reported_seq":93,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:41.488447+0000","last_change":"2024-09-22T08:40:41.488447+0000","last_active":"2024-09-22T08:40:41.488447+0000","last_peered":"2024-09-22T08:40:41.488447+0000","last_clean":"2024-09-22T08:40:41.488447+0000","last_became_active":"2024-09-22T08:36:29.994921+0000","last_became_peered":"2024-09-22T08:36:29.994921+0000","last_unstale":"2024-09-22T08:40:41.488447+0000","last_undegraded":"2024-09-22T08:40:41.488447+0000","last_fullsized":"2024-09-22T08:40:41.488447+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'38","last_scrub_stamp":"2024-09-22T08:40:41.488340+0000","last_deep_scrub":"32'38","last_deep_scrub_stamp":"2024-09-22T08:40:41.488340+0000","last_clean_scrub_stamp":"2024-09-22T08:40:41.488340+0000","objects_scrubbed":4,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:15:53.374710+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:32.802601+0000","last_change":"2024-09-22T08:40:32.802601+0000","last_active":"2024-09-22T08:40:32.802601+0000","last_peered":"2024-09-22T08:40:32.802601+0000","last_clean":"2024-09-22T08:40:32.802601+0000","last_became_active":"2024-09-22T08:36:32.004269+0000","last_became_peered":"2024-09-22T08:36:32.004269+0000","last_unstale":"2024-09-22T08:40:32.802601+0000","last_undegraded":"2024-09-22T08:40:32.802601+0000","last_fullsized":"2024-09-22T08:40:32.802601+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:32.802512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:32.802512+0000","last_clean_scrub_stamp":"2024-09-22T08:40:32.802512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:59:06.906283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"32'3","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:42.431386+0000","last_change":"2024-09-22T08:36:34.018431+0000","last_active":"2024-09-22T08:37:42.431386+0000","last_peered":"2024-09-22T08:37:42.431386+0000","last_clean":"2024-09-22T08:37:42.431386+0000","last_became_active":"2024-09-22T08:36:34.018190+0000","last_became_peered":"2024-09-22T08:36:34.018190+0000","last_unstale":"2024-09-22T08:37:42.431386+0000","last_undegraded":"2024-09-22T08:37:42.431386+0000","last_fullsized":"2024-09-22T08:37:42.431386+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:09:42.876400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"32'4","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:55.624374+0000","last_change":"2024-09-22T08:39:55.624374+0000","last_active":"2024-09-22T08:39:55.624374+0000","last_peered":"2024-09-22T08:39:55.624374+0000","last_clean":"2024-09-22T08:39:55.624374+0000","last_became_active":"2024-09-22T08:36:25.983073+0000","last_became_peered":"2024-09-22T08:36:25.983073+0000","last_unstale":"2024-09-22T08:39:55.624374+0000","last_undegraded":"2024-09-22T08:39:55.624374+0000","last_fullsized":"2024-09-22T08:39:55.624374+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-22T08:39:55.624297+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-22T08:39:55.624297+0000","last_clean_scrub_stamp":"2024-09-22T08:39:55.624297+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:20:43.093379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:53.406759+0000","last_change":"2024-09-22T08:39:53.406759+0000","last_active":"2024-09-22T08:39:53.406759+0000","last_peered":"2024-09-22T08:39:53.406759+0000","last_clean":"2024-09-22T08:39:53.406759+0000","last_became_active":"2024-09-22T08:36:23.980682+0000","last_became_peered":"2024-09-22T08:36:23.980682+0000","last_unstale":"2024-09-22T08:39:53.406759+0000","last_undegraded":"2024-09-22T08:39:53.406759+0000","last_fullsized":"2024-09-22T08:39:53.406759+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-22T08:39:53.406674+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-22T08:39:53.406674+0000","last_clean_scrub_stamp":"2024-09-22T08:39:53.406674+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:08:41.063816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:16.832193+0000","last_change":"2024-09-22T08:40:16.832193+0000","last_active":"2024-09-22T08:40:16.832193+0000","last_peered":"2024-09-22T08:40:16.832193+0000","last_clean":"2024-09-22T08:40:16.832193+0000","last_became_active":"2024-09-22T08:36:27.985675+0000","last_became_peered":"2024-09-22T08:36:27.985675+0000","last_unstale":"2024-09-22T08:40:16.832193+0000","last_undegraded":"2024-09-22T08:40:16.832193+0000","last_fullsized":"2024-09-22T08:40:16.832193+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:16.832115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:16.832115+0000","last_clean_scrub_stamp":"2024-09-22T08:40:16.832115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:49:05.088114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"32'48","reported_seq":106,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:40.440652+0000","last_change":"2024-09-22T08:40:40.440652+0000","last_active":"2024-09-22T08:40:40.440652+0000","last_peered":"2024-09-22T08:40:40.440652+0000","last_clean":"2024-09-22T08:40:40.440652+0000","last_became_active":"2024-09-22T08:36:29.997542+0000","last_became_peered":"2024-09-22T08:36:29.997542+0000","last_unstale":"2024-09-22T08:40:40.440652+0000","last_undegraded":"2024-09-22T08:40:40.440652+0000","last_fullsized":"2024-09-22T08:40:40.440652+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'48","last_scrub_stamp":"2024-09-22T08:40:40.440544+0000","last_deep_scrub":"32'48","last_deep_scrub_stamp":"2024-09-22T08:40:40.440544+0000","last_clean_scrub_stamp":"2024-09-22T08:40:40.440544+0000","objects_scrubbed":7,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:56:19.476851+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"32'286","reported_seq":360,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:30.869290+0000","last_change":"2024-09-22T08:40:30.869290+0000","last_active":"2024-09-22T08:40:30.869290+0000","last_peered":"2024-09-22T08:40:30.869290+0000","last_clean":"2024-09-22T08:40:30.869290+0000","last_became_active":"2024-09-22T08:36:32.004441+0000","last_became_peered":"2024-09-22T08:36:32.004441+0000","last_unstale":"2024-09-22T08:40:30.869290+0000","last_undegraded":"2024-09-22T08:40:30.869290+0000","last_fullsized":"2024-09-22T08:40:30.869290+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'286","last_scrub_stamp":"2024-09-22T08:40:30.869201+0000","last_deep_scrub":"32'286","last_deep_scrub_stamp":"2024-09-22T08:40:30.869201+0000","last_clean_scrub_stamp":"2024-09-22T08:40:30.869201+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:14:18.065392+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:38.811852+0000","last_change":"2024-09-22T08:40:38.811852+0000","last_active":"2024-09-22T08:40:38.811852+0000","last_peered":"2024-09-22T08:40:38.811852+0000","last_clean":"2024-09-22T08:40:38.811852+0000","last_became_active":"2024-09-22T08:36:34.017217+0000","last_became_peered":"2024-09-22T08:36:34.017217+0000","last_unstale":"2024-09-22T08:40:38.811852+0000","last_undegraded":"2024-09-22T08:40:38.811852+0000","last_fullsized":"2024-09-22T08:40:38.811852+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:38.811743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:38.811743+0000","last_clean_scrub_stamp":"2024-09-22T08:40:38.811743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:50:20.661338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"32'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:56.576672+0000","last_change":"2024-09-22T08:39:56.576672+0000","last_active":"2024-09-22T08:39:56.576672+0000","last_peered":"2024-09-22T08:39:56.576672+0000","last_clean":"2024-09-22T08:39:56.576672+0000","last_became_active":"2024-09-22T08:36:25.972198+0000","last_became_peered":"2024-09-22T08:36:25.972198+0000","last_unstale":"2024-09-22T08:39:56.576672+0000","last_undegraded":"2024-09-22T08:39:56.576672+0000","last_fullsized":"2024-09-22T08:39:56.576672+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-22T08:39:56.576591+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-22T08:39:56.576591+0000","last_clean_scrub_stamp":"2024-09-22T08:39:56.576591+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:19:21.946421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:55.322922+0000","last_change":"2024-09-22T08:39:55.322922+0000","last_active":"2024-09-22T08:39:55.322922+0000","last_peered":"2024-09-22T08:39:55.322922+0000","last_clean":"2024-09-22T08:39:55.322922+0000","last_became_active":"2024-09-22T08:36:23.978306+0000","last_became_peered":"2024-09-22T08:36:23.978306+0000","last_unstale":"2024-09-22T08:39:55.322922+0000","last_undegraded":"2024-09-22T08:39:55.322922+0000","last_fullsized":"2024-09-22T08:39:55.322922+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:39:55.322811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:39:55.322811+0000","last_clean_scrub_stamp":"2024-09-22T08:39:55.322811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:44:43.243059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:15.861620+0000","last_change":"2024-09-22T08:40:15.861620+0000","last_active":"2024-09-22T08:40:15.861620+0000","last_peered":"2024-09-22T08:40:15.861620+0000","last_clean":"2024-09-22T08:40:15.861620+0000","last_became_active":"2024-09-22T08:36:27.985751+0000","last_became_peered":"2024-09-22T08:36:27.985751+0000","last_unstale":"2024-09-22T08:40:15.861620+0000","last_undegraded":"2024-09-22T08:40:15.861620+0000","last_fullsized":"2024-09-22T08:40:15.861620+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:15.861527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:15.861527+0000","last_clean_scrub_stamp":"2024-09-22T08:40:15.861527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:35:09.030569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"32'61","reported_seq":126,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:38.907852+0000","last_change":"2024-09-22T08:36:29.995500+0000","last_active":"2024-09-22T08:39:38.907852+0000","last_peered":"2024-09-22T08:39:38.907852+0000","last_clean":"2024-09-22T08:39:38.907852+0000","last_became_active":"2024-09-22T08:36:29.995225+0000","last_became_peered":"2024-09-22T08:36:29.995225+0000","last_unstale":"2024-09-22T08:39:38.907852+0000","last_undegraded":"2024-09-22T08:39:38.907852+0000","last_fullsized":"2024-09-22T08:39:38.907852+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:06:45.130197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:29.873423+0000","last_change":"2024-09-22T08:40:29.873423+0000","last_active":"2024-09-22T08:40:29.873423+0000","last_peered":"2024-09-22T08:40:29.873423+0000","last_clean":"2024-09-22T08:40:29.873423+0000","last_became_active":"2024-09-22T08:36:32.002833+0000","last_became_peered":"2024-09-22T08:36:32.002833+0000","last_unstale":"2024-09-22T08:40:29.873423+0000","last_undegraded":"2024-09-22T08:40:29.873423+0000","last_fullsized":"2024-09-22T08:40:29.873423+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:29.873335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:29.873335+0000","last_clean_scrub_stamp":"2024-09-22T08:40:29.873335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:22:16.274271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"32'21","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:42.827463+0000","last_change":"2024-09-22T08:40:42.827463+0000","last_active":"2024-09-22T08:40:42.827463+0000","last_peered":"2024-09-22T08:40:42.827463+0000","last_clean":"2024-09-22T08:40:42.827463+0000","last_became_active":"2024-09-22T08:36:34.014853+0000","last_became_peered":"2024-09-22T08:36:34.014853+0000","last_unstale":"2024-09-22T08:40:42.827463+0000","last_undegraded":"2024-09-22T08:40:42.827463+0000","last_fullsized":"2024-09-22T08:40:42.827463+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'21","last_scrub_stamp":"2024-09-22T08:40:42.827372+0000","last_deep_scrub":"32'21","last_deep_scrub_stamp":"2024-09-22T08:40:42.827372+0000","last_clean_scrub_stamp":"2024-09-22T08:40:42.827372+0000","objects_scrubbed":3,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:20:38.200767+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"32'12","reported_seq":78,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:01.359189+0000","last_change":"2024-09-22T08:40:01.359189+0000","last_active":"2024-09-22T08:40:01.359189+0000","last_peered":"2024-09-22T08:40:01.359189+0000","last_clean":"2024-09-22T08:40:01.359189+0000","last_became_active":"2024-09-22T08:36:25.977682+0000","last_became_peered":"2024-09-22T08:36:25.977682+0000","last_unstale":"2024-09-22T08:40:01.359189+0000","last_undegraded":"2024-09-22T08:40:01.359189+0000","last_fullsized":"2024-09-22T08:40:01.359189+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-09-22T08:40:01.359074+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-09-22T08:40:01.359074+0000","last_clean_scrub_stamp":"2024-09-22T08:40:01.359074+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:56:45.036758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":47,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:46.788116+0000","last_change":"2024-09-22T08:39:46.788116+0000","last_active":"2024-09-22T08:39:46.788116+0000","last_peered":"2024-09-22T08:39:46.788116+0000","last_clean":"2024-09-22T08:39:46.788116+0000","last_became_active":"2024-09-22T08:36:23.972822+0000","last_became_peered":"2024-09-22T08:36:23.972822+0000","last_unstale":"2024-09-22T08:39:46.788116+0000","last_undegraded":"2024-09-22T08:39:46.788116+0000","last_fullsized":"2024-09-22T08:39:46.788116+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:39:46.788026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:39:46.788026+0000","last_clean_scrub_stamp":"2024-09-22T08:39:46.788026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:10:40.958015+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:11.369383+0000","last_change":"2024-09-22T08:40:11.369383+0000","last_active":"2024-09-22T08:40:11.369383+0000","last_peered":"2024-09-22T08:40:11.369383+0000","last_clean":"2024-09-22T08:40:11.369383+0000","last_became_active":"2024-09-22T08:36:27.991761+0000","last_became_peered":"2024-09-22T08:36:27.991761+0000","last_unstale":"2024-09-22T08:40:11.369383+0000","last_undegraded":"2024-09-22T08:40:11.369383+0000","last_fullsized":"2024-09-22T08:40:11.369383+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:11.369297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:11.369297+0000","last_clean_scrub_stamp":"2024-09-22T08:40:11.369297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:02:18.578080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"32'40","reported_seq":96,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:30.347233+0000","last_change":"2024-09-22T08:40:30.347233+0000","last_active":"2024-09-22T08:40:30.347233+0000","last_peered":"2024-09-22T08:40:30.347233+0000","last_clean":"2024-09-22T08:40:30.347233+0000","last_became_active":"2024-09-22T08:36:29.988363+0000","last_became_peered":"2024-09-22T08:36:29.988363+0000","last_unstale":"2024-09-22T08:40:30.347233+0000","last_undegraded":"2024-09-22T08:40:30.347233+0000","last_fullsized":"2024-09-22T08:40:30.347233+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'40","last_scrub_stamp":"2024-09-22T08:40:30.347131+0000","last_deep_scrub":"32'40","last_deep_scrub_stamp":"2024-09-22T08:40:30.347131+0000","last_clean_scrub_stamp":"2024-09-22T08:40:30.347131+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:40:22.822120+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.229572+0000","last_change":"2024-09-22T08:36:32.012753+0000","last_active":"2024-09-22T08:37:04.229572+0000","last_peered":"2024-09-22T08:37:04.229572+0000","last_clean":"2024-09-22T08:37:04.229572+0000","last_became_active":"2024-09-22T08:36:32.011923+0000","last_became_peered":"2024-09-22T08:36:32.011923+0000","last_unstale":"2024-09-22T08:37:04.229572+0000","last_undegraded":"2024-09-22T08:37:04.229572+0000","last_fullsized":"2024-09-22T08:37:04.229572+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:27:01.625975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"32'3","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.346448+0000","last_change":"2024-09-22T08:36:34.013810+0000","last_active":"2024-09-22T08:39:32.346448+0000","last_peered":"2024-09-22T08:39:32.346448+0000","last_clean":"2024-09-22T08:39:32.346448+0000","last_became_active":"2024-09-22T08:36:34.013308+0000","last_became_peered":"2024-09-22T08:36:34.013308+0000","last_unstale":"2024-09-22T08:39:32.346448+0000","last_undegraded":"2024-09-22T08:39:32.346448+0000","last_fullsized":"2024-09-22T08:39:32.346448+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"32'6","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:11.403703+0000","last_change":"2024-09-22T08:40:11.403703+0000","last_active":"2024-09-22T08:40:11.403703+0000","last_peered":"2024-09-22T08:40:11.403703+0000","last_clean":"2024-09-22T08:40:11.403703+0000","last_became_active":"2024-09-22T08:36:25.992167+0000","last_became_peered":"2024-09-22T08:36:25.992167+0000","last_unstale":"2024-09-22T08:40:11.403703+0000","last_undegraded":"2024-09-22T08:40:11.403703+0000","last_fullsized":"2024-09-22T08:40:11.403703+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-22T08:40:11.403607+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-22T08:40:11.403607+0000","last_clean_scrub_stamp":"2024-09-22T08:40:11.403607+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:48:41.981330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"32'4","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:51.418486+0000","last_change":"2024-09-22T08:39:51.418486+0000","last_active":"2024-09-22T08:39:51.418486+0000","last_peered":"2024-09-22T08:39:51.418486+0000","last_clean":"2024-09-22T08:39:51.418486+0000","last_became_active":"2024-09-22T08:36:23.980560+0000","last_became_peered":"2024-09-22T08:36:23.980560+0000","last_unstale":"2024-09-22T08:39:51.418486+0000","last_undegraded":"2024-09-22T08:39:51.418486+0000","last_fullsized":"2024-09-22T08:39:51.418486+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-22T08:39:51.418401+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-22T08:39:51.418401+0000","last_clean_scrub_stamp":"2024-09-22T08:39:51.418401+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:39:01.093268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":6,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:17.865031+0000","last_change":"2024-09-22T08:40:17.865031+0000","last_active":"2024-09-22T08:40:17.865031+0000","last_peered":"2024-09-22T08:40:17.865031+0000","last_clean":"2024-09-22T08:40:17.865031+0000","last_became_active":"2024-09-22T08:36:27.984699+0000","last_became_peered":"2024-09-22T08:36:27.984699+0000","last_unstale":"2024-09-22T08:40:17.865031+0000","last_undegraded":"2024-09-22T08:40:17.865031+0000","last_fullsized":"2024-09-22T08:40:17.865031+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:17.864935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:17.864935+0000","last_clean_scrub_stamp":"2024-09-22T08:40:17.864935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:06:55.919594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"32'46","reported_seq":104,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:19.415050+0000","last_change":"2024-09-22T08:40:19.415050+0000","last_active":"2024-09-22T08:40:19.415050+0000","last_peered":"2024-09-22T08:40:19.415050+0000","last_clean":"2024-09-22T08:40:19.415050+0000","last_became_active":"2024-09-22T08:36:29.989049+0000","last_became_peered":"2024-09-22T08:36:29.989049+0000","last_unstale":"2024-09-22T08:40:19.415050+0000","last_undegraded":"2024-09-22T08:40:19.415050+0000","last_fullsized":"2024-09-22T08:40:19.415050+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'46","last_scrub_stamp":"2024-09-22T08:40:19.414959+0000","last_deep_scrub":"32'46","last_deep_scrub_stamp":"2024-09-22T08:40:19.414959+0000","last_clean_scrub_stamp":"2024-09-22T08:40:19.414959+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:49:24.762046+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"32'286","reported_seq":464,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:25.421430+0000","last_change":"2024-09-22T08:40:25.421430+0000","last_active":"2024-09-22T08:40:25.421430+0000","last_peered":"2024-09-22T08:40:25.421430+0000","last_clean":"2024-09-22T08:40:25.421430+0000","last_became_active":"2024-09-22T08:36:32.003451+0000","last_became_peered":"2024-09-22T08:36:32.003451+0000","last_unstale":"2024-09-22T08:40:25.421430+0000","last_undegraded":"2024-09-22T08:40:25.421430+0000","last_fullsized":"2024-09-22T08:40:25.421430+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'286","last_scrub_stamp":"2024-09-22T08:40:25.421346+0000","last_deep_scrub":"32'286","last_deep_scrub_stamp":"2024-09-22T08:40:25.421346+0000","last_clean_scrub_stamp":"2024-09-22T08:40:25.421346+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:49:15.576473+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"32'13","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:37.800064+0000","last_change":"2024-09-22T08:40:37.800013+0000","last_active":"2024-09-22T08:40:37.800064+0000","last_peered":"2024-09-22T08:40:37.800064+0000","last_clean":"2024-09-22T08:40:37.800064+0000","last_became_active":"2024-09-22T08:36:34.017586+0000","last_became_peered":"2024-09-22T08:36:34.017586+0000","last_unstale":"2024-09-22T08:40:37.800064+0000","last_undegraded":"2024-09-22T08:40:37.800064+0000","last_fullsized":"2024-09-22T08:40:37.800064+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'13","last_scrub_stamp":"2024-09-22T08:40:37.799919+0000","last_deep_scrub":"32'13","last_deep_scrub_stamp":"2024-09-22T08:40:37.799919+0000","last_clean_scrub_stamp":"2024-09-22T08:40:37.799919+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:56:05.773299+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":180,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"32'6","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:00.479916+0000","last_change":"2024-09-22T08:40:00.479916+0000","last_active":"2024-09-22T08:40:00.479916+0000","last_peered":"2024-09-22T08:40:00.479916+0000","last_clean":"2024-09-22T08:40:00.479916+0000","last_became_active":"2024-09-22T08:36:25.983836+0000","last_became_peered":"2024-09-22T08:36:25.983836+0000","last_unstale":"2024-09-22T08:40:00.479916+0000","last_undegraded":"2024-09-22T08:40:00.479916+0000","last_fullsized":"2024-09-22T08:40:00.479916+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-22T08:40:00.479800+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-22T08:40:00.479800+0000","last_clean_scrub_stamp":"2024-09-22T08:40:00.479800+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:26:08.975683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":29,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:50.428805+0000","last_change":"2024-09-22T08:39:50.428805+0000","last_active":"2024-09-22T08:39:50.428805+0000","last_peered":"2024-09-22T08:39:50.428805+0000","last_clean":"2024-09-22T08:39:50.428805+0000","last_became_active":"2024-09-22T08:36:23.981453+0000","last_became_peered":"2024-09-22T08:36:23.981453+0000","last_unstale":"2024-09-22T08:39:50.428805+0000","last_undegraded":"2024-09-22T08:39:50.428805+0000","last_fullsized":"2024-09-22T08:39:50.428805+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:39:50.428713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:39:50.428713+0000","last_clean_scrub_stamp":"2024-09-22T08:39:50.428713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:18:15.418827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"32'5","reported_seq":428,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:20.318827+0000","last_change":"2024-09-22T08:40:20.318827+0000","last_active":"2024-09-22T08:40:20.318827+0000","last_peered":"2024-09-22T08:40:20.318827+0000","last_clean":"2024-09-22T08:40:20.318827+0000","last_became_active":"2024-09-22T08:36:27.990658+0000","last_became_peered":"2024-09-22T08:36:27.990658+0000","last_unstale":"2024-09-22T08:40:20.318827+0000","last_undegraded":"2024-09-22T08:40:20.318827+0000","last_fullsized":"2024-09-22T08:40:20.318827+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'5","last_scrub_stamp":"2024-09-22T08:40:20.318746+0000","last_deep_scrub":"32'5","last_deep_scrub_stamp":"2024-09-22T08:40:20.318746+0000","last_clean_scrub_stamp":"2024-09-22T08:40:20.318746+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:30:40.478521+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"32'15","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:42.464842+0000","last_change":"2024-09-22T08:40:42.464842+0000","last_active":"2024-09-22T08:40:42.464842+0000","last_peered":"2024-09-22T08:40:42.464842+0000","last_clean":"2024-09-22T08:40:42.464842+0000","last_became_active":"2024-09-22T08:36:29.994352+0000","last_became_peered":"2024-09-22T08:36:29.994352+0000","last_unstale":"2024-09-22T08:40:42.464842+0000","last_undegraded":"2024-09-22T08:40:42.464842+0000","last_fullsized":"2024-09-22T08:40:42.464842+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'15","last_scrub_stamp":"2024-09-22T08:40:42.464741+0000","last_deep_scrub":"32'15","last_deep_scrub_stamp":"2024-09-22T08:40:42.464741+0000","last_clean_scrub_stamp":"2024-09-22T08:40:42.464741+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:44:06.261050+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"32'286","reported_seq":475,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:34.428565+0000","last_change":"2024-09-22T08:40:34.428565+0000","last_active":"2024-09-22T08:40:34.428565+0000","last_peered":"2024-09-22T08:40:34.428565+0000","last_clean":"2024-09-22T08:40:34.428565+0000","last_became_active":"2024-09-22T08:36:32.002222+0000","last_became_peered":"2024-09-22T08:36:32.002222+0000","last_unstale":"2024-09-22T08:40:34.428565+0000","last_undegraded":"2024-09-22T08:40:34.428565+0000","last_fullsized":"2024-09-22T08:40:34.428565+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'286","last_scrub_stamp":"2024-09-22T08:40:34.428477+0000","last_deep_scrub":"32'286","last_deep_scrub_stamp":"2024-09-22T08:40:34.428477+0000","last_clean_scrub_stamp":"2024-09-22T08:40:34.428477+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:31:06.442355+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"32'4","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:30.423936+0000","last_change":"2024-09-22T08:40:30.423936+0000","last_active":"2024-09-22T08:40:30.423936+0000","last_peered":"2024-09-22T08:40:30.423936+0000","last_clean":"2024-09-22T08:40:30.423936+0000","last_became_active":"2024-09-22T08:36:34.015833+0000","last_became_peered":"2024-09-22T08:36:34.015833+0000","last_unstale":"2024-09-22T08:40:30.423936+0000","last_undegraded":"2024-09-22T08:40:30.423936+0000","last_fullsized":"2024-09-22T08:40:30.423936+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-22T08:40:30.423809+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-22T08:40:30.423809+0000","last_clean_scrub_stamp":"2024-09-22T08:40:30.423809+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:59:43.892086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"32'6","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:02.310213+0000","last_change":"2024-09-22T08:40:02.310213+0000","last_active":"2024-09-22T08:40:02.310213+0000","last_peered":"2024-09-22T08:40:02.310213+0000","last_clean":"2024-09-22T08:40:02.310213+0000","last_became_active":"2024-09-22T08:36:25.977184+0000","last_became_peered":"2024-09-22T08:36:25.977184+0000","last_unstale":"2024-09-22T08:40:02.310213+0000","last_undegraded":"2024-09-22T08:40:02.310213+0000","last_fullsized":"2024-09-22T08:40:02.310213+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-22T08:40:02.310094+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-22T08:40:02.310094+0000","last_clean_scrub_stamp":"2024-09-22T08:40:02.310094+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:42:25.082452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"32'8","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:46.401339+0000","last_change":"2024-09-22T08:39:46.401339+0000","last_active":"2024-09-22T08:39:46.401339+0000","last_peered":"2024-09-22T08:39:46.401339+0000","last_clean":"2024-09-22T08:39:46.401339+0000","last_became_active":"2024-09-22T08:36:23.976129+0000","last_became_peered":"2024-09-22T08:36:23.976129+0000","last_unstale":"2024-09-22T08:39:46.401339+0000","last_undegraded":"2024-09-22T08:39:46.401339+0000","last_fullsized":"2024-09-22T08:39:46.401339+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-22T08:39:46.401243+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-22T08:39:46.401243+0000","last_clean_scrub_stamp":"2024-09-22T08:39:46.401243+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:53:00.898981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":14,"num_write":48,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"32'2","reported_seq":230,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:32.464599+0000","last_change":"2024-09-22T08:40:32.464599+0000","last_active":"2024-09-22T08:40:32.464599+0000","last_peered":"2024-09-22T08:40:32.464599+0000","last_clean":"2024-09-22T08:40:32.464599+0000","last_became_active":"2024-09-22T08:36:27.987999+0000","last_became_peered":"2024-09-22T08:36:27.987999+0000","last_unstale":"2024-09-22T08:40:32.464599+0000","last_undegraded":"2024-09-22T08:40:32.464599+0000","last_fullsized":"2024-09-22T08:40:32.464599+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-22T08:40:32.464497+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-22T08:40:32.464497+0000","last_clean_scrub_stamp":"2024-09-22T08:40:32.464497+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:22:06.660471+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"32'49","reported_seq":108,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:29.327491+0000","last_change":"2024-09-22T08:40:29.327491+0000","last_active":"2024-09-22T08:40:29.327491+0000","last_peered":"2024-09-22T08:40:29.327491+0000","last_clean":"2024-09-22T08:40:29.327491+0000","last_became_active":"2024-09-22T08:36:29.991671+0000","last_became_peered":"2024-09-22T08:36:29.991671+0000","last_unstale":"2024-09-22T08:40:29.327491+0000","last_undegraded":"2024-09-22T08:40:29.327491+0000","last_fullsized":"2024-09-22T08:40:29.327491+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'49","last_scrub_stamp":"2024-09-22T08:40:29.327390+0000","last_deep_scrub":"32'49","last_deep_scrub_stamp":"2024-09-22T08:40:29.327390+0000","last_clean_scrub_stamp":"2024-09-22T08:40:29.327390+0000","objects_scrubbed":8,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:58:23.936556+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:23.395412+0000","last_change":"2024-09-22T08:40:23.395412+0000","last_active":"2024-09-22T08:40:23.395412+0000","last_peered":"2024-09-22T08:40:23.395412+0000","last_clean":"2024-09-22T08:40:23.395412+0000","last_became_active":"2024-09-22T08:36:32.011845+0000","last_became_peered":"2024-09-22T08:36:32.011845+0000","last_unstale":"2024-09-22T08:40:23.395412+0000","last_undegraded":"2024-09-22T08:40:23.395412+0000","last_fullsized":"2024-09-22T08:40:23.395412+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:23.395314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:23.395314+0000","last_clean_scrub_stamp":"2024-09-22T08:40:23.395314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:11:41.447101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"32'7","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:39.357094+0000","last_change":"2024-09-22T08:40:39.357094+0000","last_active":"2024-09-22T08:40:39.357094+0000","last_peered":"2024-09-22T08:40:39.357094+0000","last_clean":"2024-09-22T08:40:39.357094+0000","last_became_active":"2024-09-22T08:36:34.008374+0000","last_became_peered":"2024-09-22T08:36:34.008374+0000","last_unstale":"2024-09-22T08:40:39.357094+0000","last_undegraded":"2024-09-22T08:40:39.357094+0000","last_fullsized":"2024-09-22T08:40:39.357094+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'7","last_scrub_stamp":"2024-09-22T08:40:39.356998+0000","last_deep_scrub":"32'7","last_deep_scrub_stamp":"2024-09-22T08:40:39.356998+0000","last_clean_scrub_stamp":"2024-09-22T08:40:39.356998+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:11:53.008163+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"32'15","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:54.643440+0000","last_change":"2024-09-22T08:39:54.643440+0000","last_active":"2024-09-22T08:39:54.643440+0000","last_peered":"2024-09-22T08:39:54.643440+0000","last_clean":"2024-09-22T08:39:54.643440+0000","last_became_active":"2024-09-22T08:37:04.228680+0000","last_became_peered":"2024-09-22T08:37:04.228680+0000","last_unstale":"2024-09-22T08:39:54.643440+0000","last_undegraded":"2024-09-22T08:39:54.643440+0000","last_fullsized":"2024-09-22T08:39:54.643440+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'15","last_scrub_stamp":"2024-09-22T08:39:54.643331+0000","last_deep_scrub":"32'15","last_deep_scrub_stamp":"2024-09-22T08:39:54.643331+0000","last_clean_scrub_stamp":"2024-09-22T08:39:54.643331+0000","objects_scrubbed":1,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:10:02.228729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":62,"num_read_kb":54,"num_write":19,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"32'74","reported_seq":153,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:43.060244+0000","last_change":"2024-09-22T08:39:43.060183+0000","last_active":"2024-09-22T08:39:43.060244+0000","last_peered":"2024-09-22T08:39:43.060244+0000","last_clean":"2024-09-22T08:39:43.060244+0000","last_became_active":"2024-09-22T08:36:10.736221+0000","last_became_peered":"2024-09-22T08:36:10.736221+0000","last_unstale":"2024-09-22T08:39:43.060244+0000","last_undegraded":"2024-09-22T08:39:43.060244+0000","last_fullsized":"2024-09-22T08:39:43.060244+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'74","last_scrub_stamp":"2024-09-22T08:39:43.060088+0000","last_deep_scrub":"32'74","last_deep_scrub_stamp":"2024-09-22T08:39:43.060088+0000","last_clean_scrub_stamp":"2024-09-22T08:39:43.060088+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:47:30.182707+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"32'2","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:45.437361+0000","last_change":"2024-09-22T08:39:45.437270+0000","last_active":"2024-09-22T08:39:45.437361+0000","last_peered":"2024-09-22T08:39:45.437361+0000","last_clean":"2024-09-22T08:39:45.437361+0000","last_became_active":"2024-09-22T08:36:16.425465+0000","last_became_peered":"2024-09-22T08:36:16.425465+0000","last_unstale":"2024-09-22T08:39:45.437361+0000","last_undegraded":"2024-09-22T08:39:45.437361+0000","last_fullsized":"2024-09-22T08:39:45.437361+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-22T08:39:45.437175+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-22T08:39:45.437175+0000","last_clean_scrub_stamp":"2024-09-22T08:39:45.437175+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:50:58.216244+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00049376300000000004,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"32'6","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:48.401446+0000","last_change":"2024-09-22T08:39:48.401375+0000","last_active":"2024-09-22T08:39:48.401446+0000","last_peered":"2024-09-22T08:39:48.401446+0000","last_clean":"2024-09-22T08:39:48.401446+0000","last_became_active":"2024-09-22T08:36:23.981576+0000","last_became_peered":"2024-09-22T08:36:23.981576+0000","last_unstale":"2024-09-22T08:39:48.401446+0000","last_undegraded":"2024-09-22T08:39:48.401446+0000","last_fullsized":"2024-09-22T08:39:48.401446+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-22T08:39:48.401293+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-22T08:39:48.401293+0000","last_clean_scrub_stamp":"2024-09-22T08:39:48.401293+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:49:36.460213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4,"num_write":22,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:19.267565+0000","last_change":"2024-09-22T08:40:19.267513+0000","last_active":"2024-09-22T08:40:19.267565+0000","last_peered":"2024-09-22T08:40:19.267565+0000","last_clean":"2024-09-22T08:40:19.267565+0000","last_became_active":"2024-09-22T08:36:27.991130+0000","last_became_peered":"2024-09-22T08:36:27.991130+0000","last_unstale":"2024-09-22T08:40:19.267565+0000","last_undegraded":"2024-09-22T08:40:19.267565+0000","last_fullsized":"2024-09-22T08:40:19.267565+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:19.267432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:19.267432+0000","last_clean_scrub_stamp":"2024-09-22T08:40:19.267432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:24:25.931908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"32'90","reported_seq":180,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:39.437157+0000","last_change":"2024-09-22T08:40:39.437157+0000","last_active":"2024-09-22T08:40:39.437157+0000","last_peered":"2024-09-22T08:40:39.437157+0000","last_clean":"2024-09-22T08:40:39.437157+0000","last_became_active":"2024-09-22T08:36:29.997294+0000","last_became_peered":"2024-09-22T08:36:29.997294+0000","last_unstale":"2024-09-22T08:40:39.437157+0000","last_undegraded":"2024-09-22T08:40:39.437157+0000","last_fullsized":"2024-09-22T08:40:39.437157+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'90","last_scrub_stamp":"2024-09-22T08:40:39.437041+0000","last_deep_scrub":"32'90","last_deep_scrub_stamp":"2024-09-22T08:40:39.437041+0000","last_clean_scrub_stamp":"2024-09-22T08:40:39.437041+0000","objects_scrubbed":5,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:28:01.417583+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:28.901745+0000","last_change":"2024-09-22T08:40:28.901745+0000","last_active":"2024-09-22T08:40:28.901745+0000","last_peered":"2024-09-22T08:40:28.901745+0000","last_clean":"2024-09-22T08:40:28.901745+0000","last_became_active":"2024-09-22T08:36:32.008793+0000","last_became_peered":"2024-09-22T08:36:32.008793+0000","last_unstale":"2024-09-22T08:40:28.901745+0000","last_undegraded":"2024-09-22T08:40:28.901745+0000","last_fullsized":"2024-09-22T08:40:28.901745+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:28.901664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:28.901664+0000","last_clean_scrub_stamp":"2024-09-22T08:40:28.901664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:13:27.046620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"32'81","reported_seq":171,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:32.515709+0000","last_change":"2024-09-22T08:40:32.515709+0000","last_active":"2024-09-22T08:40:32.515709+0000","last_peered":"2024-09-22T08:40:32.515709+0000","last_clean":"2024-09-22T08:40:32.515709+0000","last_became_active":"2024-09-22T08:36:34.016484+0000","last_became_peered":"2024-09-22T08:36:34.016484+0000","last_unstale":"2024-09-22T08:40:32.515709+0000","last_undegraded":"2024-09-22T08:40:32.515709+0000","last_fullsized":"2024-09-22T08:40:32.515709+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'81","last_scrub_stamp":"2024-09-22T08:40:32.515595+0000","last_deep_scrub":"32'81","last_deep_scrub_stamp":"2024-09-22T08:40:32.515595+0000","last_clean_scrub_stamp":"2024-09-22T08:40:32.515595+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:41:51.757595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":223,"num_read_kb":221,"num_write":155,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"32'6","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:10.409088+0000","last_change":"2024-09-22T08:40:10.409088+0000","last_active":"2024-09-22T08:40:10.409088+0000","last_peered":"2024-09-22T08:40:10.409088+0000","last_clean":"2024-09-22T08:40:10.409088+0000","last_became_active":"2024-09-22T08:36:25.988156+0000","last_became_peered":"2024-09-22T08:36:25.988156+0000","last_unstale":"2024-09-22T08:40:10.409088+0000","last_undegraded":"2024-09-22T08:40:10.409088+0000","last_fullsized":"2024-09-22T08:40:10.409088+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-22T08:40:10.409006+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-22T08:40:10.409006+0000","last_clean_scrub_stamp":"2024-09-22T08:40:10.409006+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:49:55.381873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:43.491544+0000","last_change":"2024-09-22T08:39:43.491476+0000","last_active":"2024-09-22T08:39:43.491544+0000","last_peered":"2024-09-22T08:39:43.491544+0000","last_clean":"2024-09-22T08:39:43.491544+0000","last_became_active":"2024-09-22T08:36:16.427252+0000","last_became_peered":"2024-09-22T08:36:16.427252+0000","last_unstale":"2024-09-22T08:39:43.491544+0000","last_undegraded":"2024-09-22T08:39:43.491544+0000","last_fullsized":"2024-09-22T08:39:43.491544+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:39:43.491364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:39:43.491364+0000","last_clean_scrub_stamp":"2024-09-22T08:39:43.491364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:29:57.540388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055484200000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:43.847108+0000","last_change":"2024-09-22T08:39:43.847049+0000","last_active":"2024-09-22T08:39:43.847108+0000","last_peered":"2024-09-22T08:39:43.847108+0000","last_clean":"2024-09-22T08:39:43.847108+0000","last_became_active":"2024-09-22T08:36:23.973773+0000","last_became_peered":"2024-09-22T08:36:23.973773+0000","last_unstale":"2024-09-22T08:39:43.847108+0000","last_undegraded":"2024-09-22T08:39:43.847108+0000","last_fullsized":"2024-09-22T08:39:43.847108+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:39:43.846973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:39:43.846973+0000","last_clean_scrub_stamp":"2024-09-22T08:39:43.846973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:25:33.678376+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:31.496770+0000","last_change":"2024-09-22T08:40:31.496770+0000","last_active":"2024-09-22T08:40:31.496770+0000","last_peered":"2024-09-22T08:40:31.496770+0000","last_clean":"2024-09-22T08:40:31.496770+0000","last_became_active":"2024-09-22T08:37:04.234316+0000","last_became_peered":"2024-09-22T08:37:04.234316+0000","last_unstale":"2024-09-22T08:40:31.496770+0000","last_undegraded":"2024-09-22T08:40:31.496770+0000","last_fullsized":"2024-09-22T08:40:31.496770+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:31.496690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:31.496690+0000","last_clean_scrub_stamp":"2024-09-22T08:40:31.496690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:41:42.239723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"32'295","reported_seq":520,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:28.302291+0000","last_change":"2024-09-22T08:40:28.302225+0000","last_active":"2024-09-22T08:40:28.302291+0000","last_peered":"2024-09-22T08:40:28.302291+0000","last_clean":"2024-09-22T08:40:28.302291+0000","last_became_active":"2024-09-22T08:36:29.996025+0000","last_became_peered":"2024-09-22T08:36:29.996025+0000","last_unstale":"2024-09-22T08:40:28.302291+0000","last_undegraded":"2024-09-22T08:40:28.302291+0000","last_fullsized":"2024-09-22T08:40:28.302291+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'295","last_scrub_stamp":"2024-09-22T08:40:28.302127+0000","last_deep_scrub":"32'295","last_deep_scrub_stamp":"2024-09-22T08:40:28.302127+0000","last_clean_scrub_stamp":"2024-09-22T08:40:28.302127+0000","objects_scrubbed":10,"log_size":295,"log_dups_size":0,"ondisk_log_size":295,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:25:44.934346+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":378,"num_read_kb":363,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:38.183558+0000","last_change":"2024-09-22T08:36:32.013929+0000","last_active":"2024-09-22T08:38:38.183558+0000","last_peered":"2024-09-22T08:38:38.183558+0000","last_clean":"2024-09-22T08:38:38.183558+0000","last_became_active":"2024-09-22T08:36:32.013220+0000","last_became_peered":"2024-09-22T08:36:32.013220+0000","last_unstale":"2024-09-22T08:38:38.183558+0000","last_undegraded":"2024-09-22T08:38:38.183558+0000","last_fullsized":"2024-09-22T08:38:38.183558+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"32'5","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:28.578046+0000","last_change":"2024-09-22T08:36:34.018385+0000","last_active":"2024-09-22T08:38:28.578046+0000","last_peered":"2024-09-22T08:38:28.578046+0000","last_clean":"2024-09-22T08:38:28.578046+0000","last_became_active":"2024-09-22T08:36:34.018138+0000","last_became_peered":"2024-09-22T08:36:34.018138+0000","last_unstale":"2024-09-22T08:38:28.578046+0000","last_undegraded":"2024-09-22T08:38:28.578046+0000","last_fullsized":"2024-09-22T08:38:28.578046+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:47:34.849746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"32'8","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:01.792896+0000","last_change":"2024-09-22T08:40:01.792896+0000","last_active":"2024-09-22T08:40:01.792896+0000","last_peered":"2024-09-22T08:40:01.792896+0000","last_clean":"2024-09-22T08:40:01.792896+0000","last_became_active":"2024-09-22T08:36:25.979108+0000","last_became_peered":"2024-09-22T08:36:25.979108+0000","last_unstale":"2024-09-22T08:40:01.792896+0000","last_undegraded":"2024-09-22T08:40:01.792896+0000","last_fullsized":"2024-09-22T08:40:01.792896+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-22T08:40:01.792800+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-22T08:40:01.792800+0000","last_clean_scrub_stamp":"2024-09-22T08:40:01.792800+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:15:50.070182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:43.605375+0000","last_change":"2024-09-22T08:39:43.605309+0000","last_active":"2024-09-22T08:39:43.605375+0000","last_peered":"2024-09-22T08:39:43.605375+0000","last_clean":"2024-09-22T08:39:43.605375+0000","last_became_active":"2024-09-22T08:36:16.427121+0000","last_became_peered":"2024-09-22T08:36:16.427121+0000","last_unstale":"2024-09-22T08:39:43.605375+0000","last_undegraded":"2024-09-22T08:39:43.605375+0000","last_fullsized":"2024-09-22T08:39:43.605375+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:39:43.605211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:39:43.605211+0000","last_clean_scrub_stamp":"2024-09-22T08:39:43.605211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:07:42.970630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041194099999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:44.812049+0000","last_change":"2024-09-22T08:39:44.811985+0000","last_active":"2024-09-22T08:39:44.812049+0000","last_peered":"2024-09-22T08:39:44.812049+0000","last_clean":"2024-09-22T08:39:44.812049+0000","last_became_active":"2024-09-22T08:36:23.971688+0000","last_became_peered":"2024-09-22T08:36:23.971688+0000","last_unstale":"2024-09-22T08:39:44.812049+0000","last_undegraded":"2024-09-22T08:39:44.812049+0000","last_fullsized":"2024-09-22T08:39:44.812049+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-22T08:39:44.811892+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-22T08:39:44.811892+0000","last_clean_scrub_stamp":"2024-09-22T08:39:44.811892+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:25:37.511699+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:10.368238+0000","last_change":"2024-09-22T08:40:10.368238+0000","last_active":"2024-09-22T08:40:10.368238+0000","last_peered":"2024-09-22T08:40:10.368238+0000","last_clean":"2024-09-22T08:40:10.368238+0000","last_became_active":"2024-09-22T08:36:27.986993+0000","last_became_peered":"2024-09-22T08:36:27.986993+0000","last_unstale":"2024-09-22T08:40:10.368238+0000","last_undegraded":"2024-09-22T08:40:10.368238+0000","last_fullsized":"2024-09-22T08:40:10.368238+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-22T08:40:10.368133+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-22T08:40:10.368133+0000","last_clean_scrub_stamp":"2024-09-22T08:40:10.368133+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:08:05.798320+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"32'25","reported_seq":102,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:18.403483+0000","last_change":"2024-09-22T08:40:18.403402+0000","last_active":"2024-09-22T08:40:18.403483+0000","last_peered":"2024-09-22T08:40:18.403483+0000","last_clean":"2024-09-22T08:40:18.403483+0000","last_became_active":"2024-09-22T08:36:29.991579+0000","last_became_peered":"2024-09-22T08:36:29.991579+0000","last_unstale":"2024-09-22T08:40:18.403483+0000","last_undegraded":"2024-09-22T08:40:18.403483+0000","last_fullsized":"2024-09-22T08:40:18.403483+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'25","last_scrub_stamp":"2024-09-22T08:40:18.403282+0000","last_deep_scrub":"32'25","last_deep_scrub_stamp":"2024-09-22T08:40:18.403282+0000","last_clean_scrub_stamp":"2024-09-22T08:40:18.403282+0000","objects_scrubbed":8,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:10:52.856214+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:27.890107+0000","last_change":"2024-09-22T08:40:27.890053+0000","last_active":"2024-09-22T08:40:27.890107+0000","last_peered":"2024-09-22T08:40:27.890107+0000","last_clean":"2024-09-22T08:40:27.890107+0000","last_became_active":"2024-09-22T08:36:32.011634+0000","last_became_peered":"2024-09-22T08:36:32.011634+0000","last_unstale":"2024-09-22T08:40:27.890107+0000","last_undegraded":"2024-09-22T08:40:27.890107+0000","last_fullsized":"2024-09-22T08:40:27.890107+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:27.889962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:27.889962+0000","last_clean_scrub_stamp":"2024-09-22T08:40:27.889962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:50:15.948882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.226958+0000","last_change":"2024-09-22T08:36:34.012423+0000","last_active":"2024-09-22T08:37:04.226958+0000","last_peered":"2024-09-22T08:37:04.226958+0000","last_clean":"2024-09-22T08:37:04.226958+0000","last_became_active":"2024-09-22T08:36:34.011936+0000","last_became_peered":"2024-09-22T08:36:34.011936+0000","last_unstale":"2024-09-22T08:37:04.226958+0000","last_undegraded":"2024-09-22T08:37:04.226958+0000","last_fullsized":"2024-09-22T08:37:04.226958+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:29:05.565248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"32'3","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:59.876344+0000","last_change":"2024-09-22T08:39:59.876252+0000","last_active":"2024-09-22T08:39:59.876344+0000","last_peered":"2024-09-22T08:39:59.876344+0000","last_clean":"2024-09-22T08:39:59.876344+0000","last_became_active":"2024-09-22T08:36:25.977552+0000","last_became_peered":"2024-09-22T08:36:25.977552+0000","last_unstale":"2024-09-22T08:39:59.876344+0000","last_undegraded":"2024-09-22T08:39:59.876344+0000","last_fullsized":"2024-09-22T08:39:59.876344+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2024-09-22T08:39:59.876163+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2024-09-22T08:39:59.876163+0000","last_clean_scrub_stamp":"2024-09-22T08:39:59.876163+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:26:06.074309+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"32'3","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:44.485676+0000","last_change":"2024-09-22T08:39:44.485607+0000","last_active":"2024-09-22T08:39:44.485676+0000","last_peered":"2024-09-22T08:39:44.485676+0000","last_clean":"2024-09-22T08:39:44.485676+0000","last_became_active":"2024-09-22T08:36:16.427358+0000","last_became_peered":"2024-09-22T08:36:16.427358+0000","last_unstale":"2024-09-22T08:39:44.485676+0000","last_undegraded":"2024-09-22T08:39:44.485676+0000","last_fullsized":"2024-09-22T08:39:44.485676+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2024-09-22T08:39:44.485523+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2024-09-22T08:39:44.485523+0000","last_clean_scrub_stamp":"2024-09-22T08:39:44.485523+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:22:57.579671+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.001068835,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"32'4","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:45.577448+0000","last_change":"2024-09-22T08:39:45.577394+0000","last_active":"2024-09-22T08:39:45.577448+0000","last_peered":"2024-09-22T08:39:45.577448+0000","last_clean":"2024-09-22T08:39:45.577448+0000","last_became_active":"2024-09-22T08:36:23.967413+0000","last_became_peered":"2024-09-22T08:36:23.967413+0000","last_unstale":"2024-09-22T08:39:45.577448+0000","last_undegraded":"2024-09-22T08:39:45.577448+0000","last_fullsized":"2024-09-22T08:39:45.577448+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-22T08:39:45.577315+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-22T08:39:45.577315+0000","last_clean_scrub_stamp":"2024-09-22T08:39:45.577315+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:36:05.444054+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:13.869243+0000","last_change":"2024-09-22T08:40:13.869191+0000","last_active":"2024-09-22T08:40:13.869243+0000","last_peered":"2024-09-22T08:40:13.869243+0000","last_clean":"2024-09-22T08:40:13.869243+0000","last_became_active":"2024-09-22T08:36:27.988507+0000","last_became_peered":"2024-09-22T08:36:27.988507+0000","last_unstale":"2024-09-22T08:40:13.869243+0000","last_undegraded":"2024-09-22T08:40:13.869243+0000","last_fullsized":"2024-09-22T08:40:13.869243+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:13.869104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:13.869104+0000","last_clean_scrub_stamp":"2024-09-22T08:40:13.869104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:02:34.608102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"32'20","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:38.468919+0000","last_change":"2024-09-22T08:40:38.468919+0000","last_active":"2024-09-22T08:40:38.468919+0000","last_peered":"2024-09-22T08:40:38.468919+0000","last_clean":"2024-09-22T08:40:38.468919+0000","last_became_active":"2024-09-22T08:36:29.996557+0000","last_became_peered":"2024-09-22T08:36:29.996557+0000","last_unstale":"2024-09-22T08:40:38.468919+0000","last_undegraded":"2024-09-22T08:40:38.468919+0000","last_fullsized":"2024-09-22T08:40:38.468919+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'20","last_scrub_stamp":"2024-09-22T08:40:38.468792+0000","last_deep_scrub":"32'20","last_deep_scrub_stamp":"2024-09-22T08:40:38.468792+0000","last_clean_scrub_stamp":"2024-09-22T08:40:38.468792+0000","objects_scrubbed":7,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:26:15.989751+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":394,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.229775+0000","last_change":"2024-09-22T08:36:32.014226+0000","last_active":"2024-09-22T08:37:04.229775+0000","last_peered":"2024-09-22T08:37:04.229775+0000","last_clean":"2024-09-22T08:37:04.229775+0000","last_became_active":"2024-09-22T08:36:32.013320+0000","last_became_peered":"2024-09-22T08:36:32.013320+0000","last_unstale":"2024-09-22T08:37:04.229775+0000","last_undegraded":"2024-09-22T08:37:04.229775+0000","last_fullsized":"2024-09-22T08:37:04.229775+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:03:21.762780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"32'4","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:31.413581+0000","last_change":"2024-09-22T08:36:34.015737+0000","last_active":"2024-09-22T08:38:31.413581+0000","last_peered":"2024-09-22T08:38:31.413581+0000","last_clean":"2024-09-22T08:38:31.413581+0000","last_became_active":"2024-09-22T08:36:34.015483+0000","last_became_peered":"2024-09-22T08:36:34.015483+0000","last_unstale":"2024-09-22T08:38:31.413581+0000","last_undegraded":"2024-09-22T08:38:31.413581+0000","last_fullsized":"2024-09-22T08:38:31.413581+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:08:04.974029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"32'8","reported_seq":71,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:58.302503+0000","last_change":"2024-09-22T08:39:58.302415+0000","last_active":"2024-09-22T08:39:58.302503+0000","last_peered":"2024-09-22T08:39:58.302503+0000","last_clean":"2024-09-22T08:39:58.302503+0000","last_became_active":"2024-09-22T08:36:25.986551+0000","last_became_peered":"2024-09-22T08:36:25.986551+0000","last_unstale":"2024-09-22T08:39:58.302503+0000","last_undegraded":"2024-09-22T08:39:58.302503+0000","last_fullsized":"2024-09-22T08:39:58.302503+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-22T08:39:58.302310+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-22T08:39:58.302310+0000","last_clean_scrub_stamp":"2024-09-22T08:39:58.302310+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:59:40.615258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:44.562290+0000","last_change":"2024-09-22T08:39:44.562216+0000","last_active":"2024-09-22T08:39:44.562290+0000","last_peered":"2024-09-22T08:39:44.562290+0000","last_clean":"2024-09-22T08:39:44.562290+0000","last_became_active":"2024-09-22T08:36:23.968525+0000","last_became_peered":"2024-09-22T08:36:23.968525+0000","last_unstale":"2024-09-22T08:39:44.562290+0000","last_undegraded":"2024-09-22T08:39:44.562290+0000","last_fullsized":"2024-09-22T08:39:44.562290+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:39:44.562132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:39:44.562132+0000","last_clean_scrub_stamp":"2024-09-22T08:39:44.562132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:35:46.943109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:47.806794+0000","last_change":"2024-09-22T08:39:47.806728+0000","last_active":"2024-09-22T08:39:47.806794+0000","last_peered":"2024-09-22T08:39:47.806794+0000","last_clean":"2024-09-22T08:39:47.806794+0000","last_became_active":"2024-09-22T08:36:16.424946+0000","last_became_peered":"2024-09-22T08:36:16.424946+0000","last_unstale":"2024-09-22T08:39:47.806794+0000","last_undegraded":"2024-09-22T08:39:47.806794+0000","last_fullsized":"2024-09-22T08:39:47.806794+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:39:47.806631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:39:47.806631+0000","last_clean_scrub_stamp":"2024-09-22T08:39:47.806631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:54:30.955543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045979400000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:12.856893+0000","last_change":"2024-09-22T08:40:12.856795+0000","last_active":"2024-09-22T08:40:12.856893+0000","last_peered":"2024-09-22T08:40:12.856893+0000","last_clean":"2024-09-22T08:40:12.856893+0000","last_became_active":"2024-09-22T08:36:27.987997+0000","last_became_peered":"2024-09-22T08:36:27.987997+0000","last_unstale":"2024-09-22T08:40:12.856893+0000","last_undegraded":"2024-09-22T08:40:12.856893+0000","last_fullsized":"2024-09-22T08:40:12.856893+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-22T08:40:12.856666+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-22T08:40:12.856666+0000","last_clean_scrub_stamp":"2024-09-22T08:40:12.856666+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:42:45.227704+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"32'78","reported_seq":155,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:20.854794+0000","last_change":"2024-09-22T08:40:20.854705+0000","last_active":"2024-09-22T08:40:20.854794+0000","last_peered":"2024-09-22T08:40:20.854794+0000","last_clean":"2024-09-22T08:40:20.854794+0000","last_became_active":"2024-09-22T08:36:29.994186+0000","last_became_peered":"2024-09-22T08:36:29.994186+0000","last_unstale":"2024-09-22T08:40:20.854794+0000","last_undegraded":"2024-09-22T08:40:20.854794+0000","last_fullsized":"2024-09-22T08:40:20.854794+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'78","last_scrub_stamp":"2024-09-22T08:40:20.854613+0000","last_deep_scrub":"32'78","last_deep_scrub_stamp":"2024-09-22T08:40:20.854613+0000","last_clean_scrub_stamp":"2024-09-22T08:40:20.854613+0000","objects_scrubbed":9,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:26:34.671090+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":336,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:24.430143+0000","last_change":"2024-09-22T08:40:24.430143+0000","last_active":"2024-09-22T08:40:24.430143+0000","last_peered":"2024-09-22T08:40:24.430143+0000","last_clean":"2024-09-22T08:40:24.430143+0000","last_became_active":"2024-09-22T08:36:32.003409+0000","last_became_peered":"2024-09-22T08:36:32.003409+0000","last_unstale":"2024-09-22T08:40:24.430143+0000","last_undegraded":"2024-09-22T08:40:24.430143+0000","last_fullsized":"2024-09-22T08:40:24.430143+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:24.430063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:24.430063+0000","last_clean_scrub_stamp":"2024-09-22T08:40:24.430063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:40:44.394913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"32'13","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:40.819162+0000","last_change":"2024-09-22T08:40:40.819162+0000","last_active":"2024-09-22T08:40:40.819162+0000","last_peered":"2024-09-22T08:40:40.819162+0000","last_clean":"2024-09-22T08:40:40.819162+0000","last_became_active":"2024-09-22T08:36:34.012782+0000","last_became_peered":"2024-09-22T08:36:34.012782+0000","last_unstale":"2024-09-22T08:40:40.819162+0000","last_undegraded":"2024-09-22T08:40:40.819162+0000","last_fullsized":"2024-09-22T08:40:40.819162+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'13","last_scrub_stamp":"2024-09-22T08:40:40.819048+0000","last_deep_scrub":"32'13","last_deep_scrub_stamp":"2024-09-22T08:40:40.819048+0000","last_clean_scrub_stamp":"2024-09-22T08:40:40.819048+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:29:44.631733+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":25,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"32'6","reported_seq":61,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:59.336001+0000","last_change":"2024-09-22T08:39:59.335942+0000","last_active":"2024-09-22T08:39:59.336001+0000","last_peered":"2024-09-22T08:39:59.336001+0000","last_clean":"2024-09-22T08:39:59.336001+0000","last_became_active":"2024-09-22T08:36:25.984820+0000","last_became_peered":"2024-09-22T08:36:25.984820+0000","last_unstale":"2024-09-22T08:39:59.336001+0000","last_undegraded":"2024-09-22T08:39:59.336001+0000","last_fullsized":"2024-09-22T08:39:59.336001+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-22T08:39:59.335838+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-22T08:39:59.335838+0000","last_clean_scrub_stamp":"2024-09-22T08:39:59.335838+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:19:14.131941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":29,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:45.773799+0000","last_change":"2024-09-22T08:39:45.773739+0000","last_active":"2024-09-22T08:39:45.773799+0000","last_peered":"2024-09-22T08:39:45.773799+0000","last_clean":"2024-09-22T08:39:45.773799+0000","last_became_active":"2024-09-22T08:36:23.973672+0000","last_became_peered":"2024-09-22T08:36:23.973672+0000","last_unstale":"2024-09-22T08:39:45.773799+0000","last_undegraded":"2024-09-22T08:39:45.773799+0000","last_fullsized":"2024-09-22T08:39:45.773799+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-22T08:39:45.773661+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-22T08:39:45.773661+0000","last_clean_scrub_stamp":"2024-09-22T08:39:45.773661+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:51:32.967955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:49.427544+0000","last_change":"2024-09-22T08:39:49.427484+0000","last_active":"2024-09-22T08:39:49.427544+0000","last_peered":"2024-09-22T08:39:49.427544+0000","last_clean":"2024-09-22T08:39:49.427544+0000","last_became_active":"2024-09-22T08:36:16.427154+0000","last_became_peered":"2024-09-22T08:36:16.427154+0000","last_unstale":"2024-09-22T08:39:49.427544+0000","last_undegraded":"2024-09-22T08:39:49.427544+0000","last_fullsized":"2024-09-22T08:39:49.427544+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:39:49.427383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:39:49.427383+0000","last_clean_scrub_stamp":"2024-09-22T08:39:49.427383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:57:58.108684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081028899999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:30.533866+0000","last_change":"2024-09-22T08:40:30.533806+0000","last_active":"2024-09-22T08:40:30.533866+0000","last_peered":"2024-09-22T08:40:30.533866+0000","last_clean":"2024-09-22T08:40:30.533866+0000","last_became_active":"2024-09-22T08:37:04.233981+0000","last_became_peered":"2024-09-22T08:37:04.233981+0000","last_unstale":"2024-09-22T08:40:30.533866+0000","last_undegraded":"2024-09-22T08:40:30.533866+0000","last_fullsized":"2024-09-22T08:40:30.533866+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:30.533727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:30.533727+0000","last_clean_scrub_stamp":"2024-09-22T08:40:30.533727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:28:52.837641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"32'22","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:27.335977+0000","last_change":"2024-09-22T08:40:27.335921+0000","last_active":"2024-09-22T08:40:27.335977+0000","last_peered":"2024-09-22T08:40:27.335977+0000","last_clean":"2024-09-22T08:40:27.335977+0000","last_became_active":"2024-09-22T08:36:29.995173+0000","last_became_peered":"2024-09-22T08:36:29.995173+0000","last_unstale":"2024-09-22T08:40:27.335977+0000","last_undegraded":"2024-09-22T08:40:27.335977+0000","last_fullsized":"2024-09-22T08:40:27.335977+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'22","last_scrub_stamp":"2024-09-22T08:40:27.335811+0000","last_deep_scrub":"32'22","last_deep_scrub_stamp":"2024-09-22T08:40:27.335811+0000","last_clean_scrub_stamp":"2024-09-22T08:40:27.335811+0000","objects_scrubbed":7,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:35:18.554483+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"32'286","reported_seq":359,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:33.450070+0000","last_change":"2024-09-22T08:40:33.450012+0000","last_active":"2024-09-22T08:40:33.450070+0000","last_peered":"2024-09-22T08:40:33.450070+0000","last_clean":"2024-09-22T08:40:33.450070+0000","last_became_active":"2024-09-22T08:36:32.002985+0000","last_became_peered":"2024-09-22T08:36:32.002985+0000","last_unstale":"2024-09-22T08:40:33.450070+0000","last_undegraded":"2024-09-22T08:40:33.450070+0000","last_fullsized":"2024-09-22T08:40:33.450070+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'286","last_scrub_stamp":"2024-09-22T08:40:33.449925+0000","last_deep_scrub":"32'286","last_deep_scrub_stamp":"2024-09-22T08:40:33.449925+0000","last_clean_scrub_stamp":"2024-09-22T08:40:33.449925+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:01:58.393144+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.227398+0000","last_change":"2024-09-22T08:36:34.019732+0000","last_active":"2024-09-22T08:37:04.227398+0000","last_peered":"2024-09-22T08:37:04.227398+0000","last_clean":"2024-09-22T08:37:04.227398+0000","last_became_active":"2024-09-22T08:36:34.019438+0000","last_became_peered":"2024-09-22T08:36:34.019438+0000","last_unstale":"2024-09-22T08:37:04.227398+0000","last_undegraded":"2024-09-22T08:37:04.227398+0000","last_fullsized":"2024-09-22T08:37:04.227398+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:29:22.767417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"32'4","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:09.397384+0000","last_change":"2024-09-22T08:40:09.397318+0000","last_active":"2024-09-22T08:40:09.397384+0000","last_peered":"2024-09-22T08:40:09.397384+0000","last_clean":"2024-09-22T08:40:09.397384+0000","last_became_active":"2024-09-22T08:36:25.991480+0000","last_became_peered":"2024-09-22T08:36:25.991480+0000","last_unstale":"2024-09-22T08:40:09.397384+0000","last_undegraded":"2024-09-22T08:40:09.397384+0000","last_fullsized":"2024-09-22T08:40:09.397384+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-22T08:40:09.397220+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-22T08:40:09.397220+0000","last_clean_scrub_stamp":"2024-09-22T08:40:09.397220+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:59:18.881844+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:46.106194+0000","last_change":"2024-09-22T08:39:46.106194+0000","last_active":"2024-09-22T08:39:46.106194+0000","last_peered":"2024-09-22T08:39:46.106194+0000","last_clean":"2024-09-22T08:39:46.106194+0000","last_became_active":"2024-09-22T08:37:04.227561+0000","last_became_peered":"2024-09-22T08:37:04.227561+0000","last_unstale":"2024-09-22T08:39:46.106194+0000","last_undegraded":"2024-09-22T08:39:46.106194+0000","last_fullsized":"2024-09-22T08:39:46.106194+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:39:46.106091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:39:46.106091+0000","last_clean_scrub_stamp":"2024-09-22T08:39:46.106091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:00:33.266036+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:42.871847+0000","last_change":"2024-09-22T08:39:42.871788+0000","last_active":"2024-09-22T08:39:42.871847+0000","last_peered":"2024-09-22T08:39:42.871847+0000","last_clean":"2024-09-22T08:39:42.871847+0000","last_became_active":"2024-09-22T08:36:16.425549+0000","last_became_peered":"2024-09-22T08:36:16.425549+0000","last_unstale":"2024-09-22T08:39:42.871847+0000","last_undegraded":"2024-09-22T08:39:42.871847+0000","last_fullsized":"2024-09-22T08:39:42.871847+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:39:42.871712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:39:42.871712+0000","last_clean_scrub_stamp":"2024-09-22T08:39:42.871712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:11:04.345633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045809600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:29.561024+0000","last_change":"2024-09-22T08:40:29.560965+0000","last_active":"2024-09-22T08:40:29.561024+0000","last_peered":"2024-09-22T08:40:29.561024+0000","last_clean":"2024-09-22T08:40:29.561024+0000","last_became_active":"2024-09-22T08:36:27.987074+0000","last_became_peered":"2024-09-22T08:36:27.987074+0000","last_unstale":"2024-09-22T08:40:29.561024+0000","last_undegraded":"2024-09-22T08:40:29.561024+0000","last_fullsized":"2024-09-22T08:40:29.561024+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:29.560881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:29.560881+0000","last_clean_scrub_stamp":"2024-09-22T08:40:29.560881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:57:35.462473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"32'15","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:37.456201+0000","last_change":"2024-09-22T08:40:37.456149+0000","last_active":"2024-09-22T08:40:37.456201+0000","last_peered":"2024-09-22T08:40:37.456201+0000","last_clean":"2024-09-22T08:40:37.456201+0000","last_became_active":"2024-09-22T08:36:29.999965+0000","last_became_peered":"2024-09-22T08:36:29.999965+0000","last_unstale":"2024-09-22T08:40:37.456201+0000","last_undegraded":"2024-09-22T08:40:37.456201+0000","last_fullsized":"2024-09-22T08:40:37.456201+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'15","last_scrub_stamp":"2024-09-22T08:40:37.456059+0000","last_deep_scrub":"32'15","last_deep_scrub_stamp":"2024-09-22T08:40:37.456059+0000","last_clean_scrub_stamp":"2024-09-22T08:40:37.456059+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:20:11.660486+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"32'286","reported_seq":402,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:31.826692+0000","last_change":"2024-09-22T08:40:31.826634+0000","last_active":"2024-09-22T08:40:31.826692+0000","last_peered":"2024-09-22T08:40:31.826692+0000","last_clean":"2024-09-22T08:40:31.826692+0000","last_became_active":"2024-09-22T08:36:32.005155+0000","last_became_peered":"2024-09-22T08:36:32.005155+0000","last_unstale":"2024-09-22T08:40:31.826692+0000","last_undegraded":"2024-09-22T08:40:31.826692+0000","last_fullsized":"2024-09-22T08:40:31.826692+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'286","last_scrub_stamp":"2024-09-22T08:40:31.826545+0000","last_deep_scrub":"32'286","last_deep_scrub_stamp":"2024-09-22T08:40:31.826545+0000","last_clean_scrub_stamp":"2024-09-22T08:40:31.826545+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:37:09.792730+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"30'5","reported_seq":25,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.223266+0000","last_change":"2024-09-22T08:36:34.022617+0000","last_active":"2024-09-22T08:37:04.223266+0000","last_peered":"2024-09-22T08:37:04.223266+0000","last_clean":"2024-09-22T08:37:04.223266+0000","last_became_active":"2024-09-22T08:36:34.022313+0000","last_became_peered":"2024-09-22T08:36:34.022313+0000","last_unstale":"2024-09-22T08:37:04.223266+0000","last_undegraded":"2024-09-22T08:37:04.223266+0000","last_fullsized":"2024-09-22T08:37:04.223266+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:42:55.182851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":11,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"32'4","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:05.384747+0000","last_change":"2024-09-22T08:40:05.384685+0000","last_active":"2024-09-22T08:40:05.384747+0000","last_peered":"2024-09-22T08:40:05.384747+0000","last_clean":"2024-09-22T08:40:05.384747+0000","last_became_active":"2024-09-22T08:36:25.974884+0000","last_became_peered":"2024-09-22T08:36:25.974884+0000","last_unstale":"2024-09-22T08:40:05.384747+0000","last_undegraded":"2024-09-22T08:40:05.384747+0000","last_fullsized":"2024-09-22T08:40:05.384747+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-22T08:40:05.384591+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-22T08:40:05.384591+0000","last_clean_scrub_stamp":"2024-09-22T08:40:05.384591+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:46:32.018206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"32'5","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:44.099885+0000","last_change":"2024-09-22T08:39:44.099885+0000","last_active":"2024-09-22T08:39:44.099885+0000","last_peered":"2024-09-22T08:39:44.099885+0000","last_clean":"2024-09-22T08:39:44.099885+0000","last_became_active":"2024-09-22T08:36:23.976646+0000","last_became_peered":"2024-09-22T08:36:23.976646+0000","last_unstale":"2024-09-22T08:39:44.099885+0000","last_undegraded":"2024-09-22T08:39:44.099885+0000","last_fullsized":"2024-09-22T08:39:44.099885+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'5","last_scrub_stamp":"2024-09-22T08:39:44.099774+0000","last_deep_scrub":"32'5","last_deep_scrub_stamp":"2024-09-22T08:39:44.099774+0000","last_clean_scrub_stamp":"2024-09-22T08:39:44.099774+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:33:07.255708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":11,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:47.416000+0000","last_change":"2024-09-22T08:39:47.415905+0000","last_active":"2024-09-22T08:39:47.416000+0000","last_peered":"2024-09-22T08:39:47.416000+0000","last_clean":"2024-09-22T08:39:47.416000+0000","last_became_active":"2024-09-22T08:36:16.638610+0000","last_became_peered":"2024-09-22T08:36:16.638610+0000","last_unstale":"2024-09-22T08:39:47.416000+0000","last_undegraded":"2024-09-22T08:39:47.416000+0000","last_fullsized":"2024-09-22T08:39:47.416000+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:39:47.415799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:39:47.415799+0000","last_clean_scrub_stamp":"2024-09-22T08:39:47.415799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:04:14.345231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001119264,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:28.591522+0000","last_change":"2024-09-22T08:40:28.591522+0000","last_active":"2024-09-22T08:40:28.591522+0000","last_peered":"2024-09-22T08:40:28.591522+0000","last_clean":"2024-09-22T08:40:28.591522+0000","last_became_active":"2024-09-22T08:36:27.984803+0000","last_became_peered":"2024-09-22T08:36:27.984803+0000","last_unstale":"2024-09-22T08:40:28.591522+0000","last_undegraded":"2024-09-22T08:40:28.591522+0000","last_fullsized":"2024-09-22T08:40:28.591522+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:28.591437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:28.591437+0000","last_clean_scrub_stamp":"2024-09-22T08:40:28.591437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:24:47.923964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"32'101","reported_seq":195,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:16.435274+0000","last_change":"2024-09-22T08:40:16.435220+0000","last_active":"2024-09-22T08:40:16.435274+0000","last_peered":"2024-09-22T08:40:16.435274+0000","last_clean":"2024-09-22T08:40:16.435274+0000","last_became_active":"2024-09-22T08:36:30.000270+0000","last_became_peered":"2024-09-22T08:36:30.000270+0000","last_unstale":"2024-09-22T08:40:16.435274+0000","last_undegraded":"2024-09-22T08:40:16.435274+0000","last_fullsized":"2024-09-22T08:40:16.435274+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'101","last_scrub_stamp":"2024-09-22T08:40:16.435123+0000","last_deep_scrub":"32'101","last_deep_scrub_stamp":"2024-09-22T08:40:16.435123+0000","last_clean_scrub_stamp":"2024-09-22T08:40:16.435123+0000","objects_scrubbed":8,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:28:38.145552+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4316,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":99,"num_read_kb":103,"num_write":38,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:26.915018+0000","last_change":"2024-09-22T08:40:26.914963+0000","last_active":"2024-09-22T08:40:26.915018+0000","last_peered":"2024-09-22T08:40:26.915018+0000","last_clean":"2024-09-22T08:40:26.915018+0000","last_became_active":"2024-09-22T08:36:32.002876+0000","last_became_peered":"2024-09-22T08:36:32.002876+0000","last_unstale":"2024-09-22T08:40:26.915018+0000","last_undegraded":"2024-09-22T08:40:26.915018+0000","last_fullsized":"2024-09-22T08:40:26.915018+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:26.914877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:26.914877+0000","last_clean_scrub_stamp":"2024-09-22T08:40:26.914877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:04:53.844309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"30'2","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:33.538060+0000","last_change":"2024-09-22T08:40:33.538060+0000","last_active":"2024-09-22T08:40:33.538060+0000","last_peered":"2024-09-22T08:40:33.538060+0000","last_clean":"2024-09-22T08:40:33.538060+0000","last_became_active":"2024-09-22T08:36:34.016659+0000","last_became_peered":"2024-09-22T08:36:34.016659+0000","last_unstale":"2024-09-22T08:40:33.538060+0000","last_undegraded":"2024-09-22T08:40:33.538060+0000","last_fullsized":"2024-09-22T08:40:33.538060+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-09-22T08:40:33.537969+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-09-22T08:40:33.537969+0000","last_clean_scrub_stamp":"2024-09-22T08:40:33.537969+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:00:46.689965+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:35.489685+0000","last_change":"2024-09-22T08:40:35.489685+0000","last_active":"2024-09-22T08:40:35.489685+0000","last_peered":"2024-09-22T08:40:35.489685+0000","last_clean":"2024-09-22T08:40:35.489685+0000","last_became_active":"2024-09-22T08:36:34.015241+0000","last_became_peered":"2024-09-22T08:36:34.015241+0000","last_unstale":"2024-09-22T08:40:35.489685+0000","last_undegraded":"2024-09-22T08:40:35.489685+0000","last_fullsized":"2024-09-22T08:40:35.489685+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:35.489579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:35.489579+0000","last_clean_scrub_stamp":"2024-09-22T08:40:35.489579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:02:26.956368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"32'4","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:59.521660+0000","last_change":"2024-09-22T08:39:59.521660+0000","last_active":"2024-09-22T08:39:59.521660+0000","last_peered":"2024-09-22T08:39:59.521660+0000","last_clean":"2024-09-22T08:39:59.521660+0000","last_became_active":"2024-09-22T08:36:25.987153+0000","last_became_peered":"2024-09-22T08:36:25.987153+0000","last_unstale":"2024-09-22T08:39:59.521660+0000","last_undegraded":"2024-09-22T08:39:59.521660+0000","last_fullsized":"2024-09-22T08:39:59.521660+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-22T08:39:59.521563+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-22T08:39:59.521563+0000","last_clean_scrub_stamp":"2024-09-22T08:39:59.521563+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:30:31.166918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:56.287922+0000","last_change":"2024-09-22T08:39:56.287922+0000","last_active":"2024-09-22T08:39:56.287922+0000","last_peered":"2024-09-22T08:39:56.287922+0000","last_clean":"2024-09-22T08:39:56.287922+0000","last_became_active":"2024-09-22T08:36:23.981927+0000","last_became_peered":"2024-09-22T08:36:23.981927+0000","last_unstale":"2024-09-22T08:39:56.287922+0000","last_undegraded":"2024-09-22T08:39:56.287922+0000","last_fullsized":"2024-09-22T08:39:56.287922+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:39:56.287818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:39:56.287818+0000","last_clean_scrub_stamp":"2024-09-22T08:39:56.287818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:00:09.674228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:22.364803+0000","last_change":"2024-09-22T08:40:22.364803+0000","last_active":"2024-09-22T08:40:22.364803+0000","last_peered":"2024-09-22T08:40:22.364803+0000","last_clean":"2024-09-22T08:40:22.364803+0000","last_became_active":"2024-09-22T08:36:27.990153+0000","last_became_peered":"2024-09-22T08:36:27.990153+0000","last_unstale":"2024-09-22T08:40:22.364803+0000","last_undegraded":"2024-09-22T08:40:22.364803+0000","last_fullsized":"2024-09-22T08:40:22.364803+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:22.364686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:22.364686+0000","last_clean_scrub_stamp":"2024-09-22T08:40:22.364686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:33:24.385016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"32'37","reported_seq":85,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:38.965959+0000","last_change":"2024-09-22T08:36:29.998789+0000","last_active":"2024-09-22T08:39:38.965959+0000","last_peered":"2024-09-22T08:39:38.965959+0000","last_clean":"2024-09-22T08:39:38.965959+0000","last_became_active":"2024-09-22T08:36:29.997814+0000","last_became_peered":"2024-09-22T08:36:29.997814+0000","last_unstale":"2024-09-22T08:39:38.965959+0000","last_undegraded":"2024-09-22T08:39:38.965959+0000","last_fullsized":"2024-09-22T08:39:38.965959+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:38:57.806502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":43,"num_read_kb":44,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.226536+0000","last_change":"2024-09-22T08:36:32.012924+0000","last_active":"2024-09-22T08:37:04.226536+0000","last_peered":"2024-09-22T08:37:04.226536+0000","last_clean":"2024-09-22T08:37:04.226536+0000","last_became_active":"2024-09-22T08:36:32.012453+0000","last_became_peered":"2024-09-22T08:36:32.012453+0000","last_unstale":"2024-09-22T08:37:04.226536+0000","last_undegraded":"2024-09-22T08:37:04.226536+0000","last_fullsized":"2024-09-22T08:37:04.226536+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:07:18.464448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"32'3","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:33.176872+0000","last_change":"2024-09-22T08:36:34.022519+0000","last_active":"2024-09-22T08:38:33.176872+0000","last_peered":"2024-09-22T08:38:33.176872+0000","last_clean":"2024-09-22T08:38:33.176872+0000","last_became_active":"2024-09-22T08:36:34.022267+0000","last_became_peered":"2024-09-22T08:36:34.022267+0000","last_unstale":"2024-09-22T08:38:33.176872+0000","last_undegraded":"2024-09-22T08:38:33.176872+0000","last_fullsized":"2024-09-22T08:38:33.176872+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"32'6","reported_seq":90,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:03.316706+0000","last_change":"2024-09-22T08:40:03.316706+0000","last_active":"2024-09-22T08:40:03.316706+0000","last_peered":"2024-09-22T08:40:03.316706+0000","last_clean":"2024-09-22T08:40:03.316706+0000","last_became_active":"2024-09-22T08:36:25.986613+0000","last_became_peered":"2024-09-22T08:36:25.986613+0000","last_unstale":"2024-09-22T08:40:03.316706+0000","last_undegraded":"2024-09-22T08:40:03.316706+0000","last_fullsized":"2024-09-22T08:40:03.316706+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-22T08:40:03.316589+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-22T08:40:03.316589+0000","last_clean_scrub_stamp":"2024-09-22T08:40:03.316589+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:37:02.558069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":60,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:49.648410+0000","last_change":"2024-09-22T08:39:49.648410+0000","last_active":"2024-09-22T08:39:49.648410+0000","last_peered":"2024-09-22T08:39:49.648410+0000","last_clean":"2024-09-22T08:39:49.648410+0000","last_became_active":"2024-09-22T08:36:23.978282+0000","last_became_peered":"2024-09-22T08:36:23.978282+0000","last_unstale":"2024-09-22T08:39:49.648410+0000","last_undegraded":"2024-09-22T08:39:49.648410+0000","last_fullsized":"2024-09-22T08:39:49.648410+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:39:49.648317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:39:49.648317+0000","last_clean_scrub_stamp":"2024-09-22T08:39:49.648317+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:38:27.168524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:35.532711+0000","last_change":"2024-09-22T08:40:35.532711+0000","last_active":"2024-09-22T08:40:35.532711+0000","last_peered":"2024-09-22T08:40:35.532711+0000","last_clean":"2024-09-22T08:40:35.532711+0000","last_became_active":"2024-09-22T08:36:27.986033+0000","last_became_peered":"2024-09-22T08:36:27.986033+0000","last_unstale":"2024-09-22T08:40:35.532711+0000","last_undegraded":"2024-09-22T08:40:35.532711+0000","last_fullsized":"2024-09-22T08:40:35.532711+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:35.532623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:35.532623+0000","last_clean_scrub_stamp":"2024-09-22T08:40:35.532623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:58:27.023727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"32'9","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:21.859767+0000","last_change":"2024-09-22T08:40:21.859767+0000","last_active":"2024-09-22T08:40:21.859767+0000","last_peered":"2024-09-22T08:40:21.859767+0000","last_clean":"2024-09-22T08:40:21.859767+0000","last_became_active":"2024-09-22T08:36:29.990057+0000","last_became_peered":"2024-09-22T08:36:29.990057+0000","last_unstale":"2024-09-22T08:40:21.859767+0000","last_undegraded":"2024-09-22T08:40:21.859767+0000","last_fullsized":"2024-09-22T08:40:21.859767+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'9","last_scrub_stamp":"2024-09-22T08:40:21.859640+0000","last_deep_scrub":"32'9","last_deep_scrub_stamp":"2024-09-22T08:40:21.859640+0000","last_clean_scrub_stamp":"2024-09-22T08:40:21.859640+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:41:06.152084+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":294,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:26.441341+0000","last_change":"2024-09-22T08:40:26.441341+0000","last_active":"2024-09-22T08:40:26.441341+0000","last_peered":"2024-09-22T08:40:26.441341+0000","last_clean":"2024-09-22T08:40:26.441341+0000","last_became_active":"2024-09-22T08:36:32.010692+0000","last_became_peered":"2024-09-22T08:36:32.010692+0000","last_unstale":"2024-09-22T08:40:26.441341+0000","last_undegraded":"2024-09-22T08:40:26.441341+0000","last_fullsized":"2024-09-22T08:40:26.441341+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:26.441238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:26.441238+0000","last_clean_scrub_stamp":"2024-09-22T08:40:26.441238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:01:55.450483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"32'8","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:31.738292+0000","last_change":"2024-09-22T08:36:34.017610+0000","last_active":"2024-09-22T08:39:31.738292+0000","last_peered":"2024-09-22T08:39:31.738292+0000","last_clean":"2024-09-22T08:39:31.738292+0000","last_became_active":"2024-09-22T08:36:34.017181+0000","last_became_peered":"2024-09-22T08:36:34.017181+0000","last_unstale":"2024-09-22T08:39:31.738292+0000","last_undegraded":"2024-09-22T08:39:31.738292+0000","last_fullsized":"2024-09-22T08:39:31.738292+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:00:36.254978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":21,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"32'6","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:00.828058+0000","last_change":"2024-09-22T08:40:00.828058+0000","last_active":"2024-09-22T08:40:00.828058+0000","last_peered":"2024-09-22T08:40:00.828058+0000","last_clean":"2024-09-22T08:40:00.828058+0000","last_became_active":"2024-09-22T08:36:25.974797+0000","last_became_peered":"2024-09-22T08:36:25.974797+0000","last_unstale":"2024-09-22T08:40:00.828058+0000","last_undegraded":"2024-09-22T08:40:00.828058+0000","last_fullsized":"2024-09-22T08:40:00.828058+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-22T08:40:00.827940+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-22T08:40:00.827940+0000","last_clean_scrub_stamp":"2024-09-22T08:40:00.827940+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:40:56.353569+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"32'2","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:48.649611+0000","last_change":"2024-09-22T08:39:48.649611+0000","last_active":"2024-09-22T08:39:48.649611+0000","last_peered":"2024-09-22T08:39:48.649611+0000","last_clean":"2024-09-22T08:39:48.649611+0000","last_became_active":"2024-09-22T08:36:23.973601+0000","last_became_peered":"2024-09-22T08:36:23.973601+0000","last_unstale":"2024-09-22T08:39:48.649611+0000","last_undegraded":"2024-09-22T08:39:48.649611+0000","last_fullsized":"2024-09-22T08:39:48.649611+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-22T08:39:48.649523+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-22T08:39:48.649523+0000","last_clean_scrub_stamp":"2024-09-22T08:39:48.649523+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:10:59.136925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:12.389179+0000","last_change":"2024-09-22T08:40:12.389179+0000","last_active":"2024-09-22T08:40:12.389179+0000","last_peered":"2024-09-22T08:40:12.389179+0000","last_clean":"2024-09-22T08:40:12.389179+0000","last_became_active":"2024-09-22T08:36:27.986100+0000","last_became_peered":"2024-09-22T08:36:27.986100+0000","last_unstale":"2024-09-22T08:40:12.389179+0000","last_undegraded":"2024-09-22T08:40:12.389179+0000","last_fullsized":"2024-09-22T08:40:12.389179+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:12.389091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:12.389091+0000","last_clean_scrub_stamp":"2024-09-22T08:40:12.389091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:52:51.243229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"32'49","reported_seq":121,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:22.891970+0000","last_change":"2024-09-22T08:40:22.891970+0000","last_active":"2024-09-22T08:40:22.891970+0000","last_peered":"2024-09-22T08:40:22.891970+0000","last_clean":"2024-09-22T08:40:22.891970+0000","last_became_active":"2024-09-22T08:36:29.991732+0000","last_became_peered":"2024-09-22T08:36:29.991732+0000","last_unstale":"2024-09-22T08:40:22.891970+0000","last_undegraded":"2024-09-22T08:40:22.891970+0000","last_fullsized":"2024-09-22T08:40:22.891970+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'49","last_scrub_stamp":"2024-09-22T08:40:22.891866+0000","last_deep_scrub":"32'49","last_deep_scrub_stamp":"2024-09-22T08:40:22.891866+0000","last_clean_scrub_stamp":"2024-09-22T08:40:22.891866+0000","objects_scrubbed":6,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:30:36.940890+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":706,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:35.406404+0000","last_change":"2024-09-22T08:40:35.406404+0000","last_active":"2024-09-22T08:40:35.406404+0000","last_peered":"2024-09-22T08:40:35.406404+0000","last_clean":"2024-09-22T08:40:35.406404+0000","last_became_active":"2024-09-22T08:36:32.002970+0000","last_became_peered":"2024-09-22T08:36:32.002970+0000","last_unstale":"2024-09-22T08:40:35.406404+0000","last_undegraded":"2024-09-22T08:40:35.406404+0000","last_fullsized":"2024-09-22T08:40:35.406404+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:35.406305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:35.406305+0000","last_clean_scrub_stamp":"2024-09-22T08:40:35.406305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:23:45.406110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"32'4","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.344891+0000","last_change":"2024-09-22T08:36:34.016939+0000","last_active":"2024-09-22T08:39:32.344891+0000","last_peered":"2024-09-22T08:39:32.344891+0000","last_clean":"2024-09-22T08:39:32.344891+0000","last_became_active":"2024-09-22T08:36:34.016379+0000","last_became_peered":"2024-09-22T08:36:34.016379+0000","last_unstale":"2024-09-22T08:39:32.344891+0000","last_undegraded":"2024-09-22T08:39:32.344891+0000","last_fullsized":"2024-09-22T08:39:32.344891+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:50:54.870215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":421,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"32'6","reported_seq":71,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:15.475301+0000","last_change":"2024-09-22T08:40:15.475301+0000","last_active":"2024-09-22T08:40:15.475301+0000","last_peered":"2024-09-22T08:40:15.475301+0000","last_clean":"2024-09-22T08:40:15.475301+0000","last_became_active":"2024-09-22T08:36:25.988569+0000","last_became_peered":"2024-09-22T08:36:25.988569+0000","last_unstale":"2024-09-22T08:40:15.475301+0000","last_undegraded":"2024-09-22T08:40:15.475301+0000","last_fullsized":"2024-09-22T08:40:15.475301+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-22T08:40:15.475202+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-22T08:40:15.475202+0000","last_clean_scrub_stamp":"2024-09-22T08:40:15.475202+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:59:43.068621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:47.114544+0000","last_change":"2024-09-22T08:39:47.114544+0000","last_active":"2024-09-22T08:39:47.114544+0000","last_peered":"2024-09-22T08:39:47.114544+0000","last_clean":"2024-09-22T08:39:47.114544+0000","last_became_active":"2024-09-22T08:36:23.977355+0000","last_became_peered":"2024-09-22T08:36:23.977355+0000","last_unstale":"2024-09-22T08:39:47.114544+0000","last_undegraded":"2024-09-22T08:39:47.114544+0000","last_fullsized":"2024-09-22T08:39:47.114544+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:39:47.114458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:39:47.114458+0000","last_clean_scrub_stamp":"2024-09-22T08:39:47.114458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:39:28.221096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"32'5","reported_seq":238,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:33.452454+0000","last_change":"2024-09-22T08:40:33.452454+0000","last_active":"2024-09-22T08:40:33.452454+0000","last_peered":"2024-09-22T08:40:33.452454+0000","last_clean":"2024-09-22T08:40:33.452454+0000","last_became_active":"2024-09-22T08:36:27.987561+0000","last_became_peered":"2024-09-22T08:36:27.987561+0000","last_unstale":"2024-09-22T08:40:33.452454+0000","last_undegraded":"2024-09-22T08:40:33.452454+0000","last_fullsized":"2024-09-22T08:40:33.452454+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'5","last_scrub_stamp":"2024-09-22T08:40:33.452370+0000","last_deep_scrub":"32'5","last_deep_scrub_stamp":"2024-09-22T08:40:33.452370+0000","last_clean_scrub_stamp":"2024-09-22T08:40:33.452370+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:24:37.175651+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"32'38","reported_seq":93,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:20.438365+0000","last_change":"2024-09-22T08:40:20.438365+0000","last_active":"2024-09-22T08:40:20.438365+0000","last_peered":"2024-09-22T08:40:20.438365+0000","last_clean":"2024-09-22T08:40:20.438365+0000","last_became_active":"2024-09-22T08:36:29.988607+0000","last_became_peered":"2024-09-22T08:36:29.988607+0000","last_unstale":"2024-09-22T08:40:20.438365+0000","last_undegraded":"2024-09-22T08:40:20.438365+0000","last_fullsized":"2024-09-22T08:40:20.438365+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'38","last_scrub_stamp":"2024-09-22T08:40:20.438226+0000","last_deep_scrub":"32'38","last_deep_scrub_stamp":"2024-09-22T08:40:20.438226+0000","last_clean_scrub_stamp":"2024-09-22T08:40:20.438226+0000","objects_scrubbed":4,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:42:43.210584+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:27.448372+0000","last_change":"2024-09-22T08:40:27.448372+0000","last_active":"2024-09-22T08:40:27.448372+0000","last_peered":"2024-09-22T08:40:27.448372+0000","last_clean":"2024-09-22T08:40:27.448372+0000","last_became_active":"2024-09-22T08:36:32.003651+0000","last_became_peered":"2024-09-22T08:36:32.003651+0000","last_unstale":"2024-09-22T08:40:27.448372+0000","last_undegraded":"2024-09-22T08:40:27.448372+0000","last_fullsized":"2024-09-22T08:40:27.448372+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:27.448253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:27.448253+0000","last_clean_scrub_stamp":"2024-09-22T08:40:27.448253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:47:55.073492+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"32'10","reported_seq":74,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:19.534515+0000","last_change":"2024-09-22T08:40:19.534441+0000","last_active":"2024-09-22T08:40:19.534515+0000","last_peered":"2024-09-22T08:40:19.534515+0000","last_clean":"2024-09-22T08:40:19.534515+0000","last_became_active":"2024-09-22T08:36:25.989711+0000","last_became_peered":"2024-09-22T08:36:25.989711+0000","last_unstale":"2024-09-22T08:40:19.534515+0000","last_undegraded":"2024-09-22T08:40:19.534515+0000","last_fullsized":"2024-09-22T08:40:19.534515+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-09-22T08:40:19.534321+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-09-22T08:40:19.534321+0000","last_clean_scrub_stamp":"2024-09-22T08:40:19.534321+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:34:03.499705+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:57.304514+0000","last_change":"2024-09-22T08:39:57.304514+0000","last_active":"2024-09-22T08:39:57.304514+0000","last_peered":"2024-09-22T08:39:57.304514+0000","last_clean":"2024-09-22T08:39:57.304514+0000","last_became_active":"2024-09-22T08:36:23.976361+0000","last_became_peered":"2024-09-22T08:36:23.976361+0000","last_unstale":"2024-09-22T08:39:57.304514+0000","last_undegraded":"2024-09-22T08:39:57.304514+0000","last_fullsized":"2024-09-22T08:39:57.304514+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:39:57.304420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:39:57.304420+0000","last_clean_scrub_stamp":"2024-09-22T08:39:57.304420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:50:11.471353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:19.885446+0000","last_change":"2024-09-22T08:40:19.885352+0000","last_active":"2024-09-22T08:40:19.885446+0000","last_peered":"2024-09-22T08:40:19.885446+0000","last_clean":"2024-09-22T08:40:19.885446+0000","last_became_active":"2024-09-22T08:36:27.987981+0000","last_became_peered":"2024-09-22T08:36:27.987981+0000","last_unstale":"2024-09-22T08:40:19.885446+0000","last_undegraded":"2024-09-22T08:40:19.885446+0000","last_fullsized":"2024-09-22T08:40:19.885446+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:19.885257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:19.885257+0000","last_clean_scrub_stamp":"2024-09-22T08:40:19.885257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:15:54.517108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"32'66","reported_seq":139,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:24.955120+0000","last_change":"2024-09-22T08:40:24.955120+0000","last_active":"2024-09-22T08:40:24.955120+0000","last_peered":"2024-09-22T08:40:24.955120+0000","last_clean":"2024-09-22T08:40:24.955120+0000","last_became_active":"2024-09-22T08:36:29.990585+0000","last_became_peered":"2024-09-22T08:36:29.990585+0000","last_unstale":"2024-09-22T08:40:24.955120+0000","last_undegraded":"2024-09-22T08:40:24.955120+0000","last_fullsized":"2024-09-22T08:40:24.955120+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'66","last_scrub_stamp":"2024-09-22T08:40:24.955006+0000","last_deep_scrub":"32'66","last_deep_scrub_stamp":"2024-09-22T08:40:24.955006+0000","last_clean_scrub_stamp":"2024-09-22T08:40:24.955006+0000","objects_scrubbed":5,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:20:46.276335+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:28.404072+0000","last_change":"2024-09-22T08:40:28.404072+0000","last_active":"2024-09-22T08:40:28.404072+0000","last_peered":"2024-09-22T08:40:28.404072+0000","last_clean":"2024-09-22T08:40:28.404072+0000","last_became_active":"2024-09-22T08:36:32.007448+0000","last_became_peered":"2024-09-22T08:36:32.007448+0000","last_unstale":"2024-09-22T08:40:28.404072+0000","last_undegraded":"2024-09-22T08:40:28.404072+0000","last_fullsized":"2024-09-22T08:40:28.404072+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:28.403992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:28.403992+0000","last_clean_scrub_stamp":"2024-09-22T08:40:28.403992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:26:25.213830+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"32'16","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:41.820871+0000","last_change":"2024-09-22T08:40:41.820871+0000","last_active":"2024-09-22T08:40:41.820871+0000","last_peered":"2024-09-22T08:40:41.820871+0000","last_clean":"2024-09-22T08:40:41.820871+0000","last_became_active":"2024-09-22T08:36:34.017689+0000","last_became_peered":"2024-09-22T08:36:34.017689+0000","last_unstale":"2024-09-22T08:40:41.820871+0000","last_undegraded":"2024-09-22T08:40:41.820871+0000","last_fullsized":"2024-09-22T08:40:41.820871+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'16","last_scrub_stamp":"2024-09-22T08:40:41.820768+0000","last_deep_scrub":"32'16","last_deep_scrub_stamp":"2024-09-22T08:40:41.820768+0000","last_clean_scrub_stamp":"2024-09-22T08:40:41.820768+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:26:03.103006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":21,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"32'2","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:05.795426+0000","last_change":"2024-09-22T08:40:05.795366+0000","last_active":"2024-09-22T08:40:05.795426+0000","last_peered":"2024-09-22T08:40:05.795426+0000","last_clean":"2024-09-22T08:40:05.795426+0000","last_became_active":"2024-09-22T08:36:25.977881+0000","last_became_peered":"2024-09-22T08:36:25.977881+0000","last_unstale":"2024-09-22T08:40:05.795426+0000","last_undegraded":"2024-09-22T08:40:05.795426+0000","last_fullsized":"2024-09-22T08:40:05.795426+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-22T08:40:05.795277+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-22T08:40:05.795277+0000","last_clean_scrub_stamp":"2024-09-22T08:40:05.795277+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:18:12.135810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:48.136157+0000","last_change":"2024-09-22T08:39:48.136157+0000","last_active":"2024-09-22T08:39:48.136157+0000","last_peered":"2024-09-22T08:39:48.136157+0000","last_clean":"2024-09-22T08:39:48.136157+0000","last_became_active":"2024-09-22T08:36:23.974809+0000","last_became_peered":"2024-09-22T08:36:23.974809+0000","last_unstale":"2024-09-22T08:39:48.136157+0000","last_undegraded":"2024-09-22T08:39:48.136157+0000","last_fullsized":"2024-09-22T08:39:48.136157+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:39:48.136054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:39:48.136054+0000","last_clean_scrub_stamp":"2024-09-22T08:39:48.136054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:46:14.769669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:15.386385+0000","last_change":"2024-09-22T08:40:15.386312+0000","last_active":"2024-09-22T08:40:15.386385+0000","last_peered":"2024-09-22T08:40:15.386385+0000","last_clean":"2024-09-22T08:40:15.386385+0000","last_became_active":"2024-09-22T08:36:27.986957+0000","last_became_peered":"2024-09-22T08:36:27.986957+0000","last_unstale":"2024-09-22T08:40:15.386385+0000","last_undegraded":"2024-09-22T08:40:15.386385+0000","last_fullsized":"2024-09-22T08:40:15.386385+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:15.386197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:15.386197+0000","last_clean_scrub_stamp":"2024-09-22T08:40:15.386197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:59:57.699145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"32'39","reported_seq":89,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:38.920740+0000","last_change":"2024-09-22T08:36:29.998426+0000","last_active":"2024-09-22T08:39:38.920740+0000","last_peered":"2024-09-22T08:39:38.920740+0000","last_clean":"2024-09-22T08:39:38.920740+0000","last_became_active":"2024-09-22T08:36:29.997527+0000","last_became_peered":"2024-09-22T08:36:29.997527+0000","last_unstale":"2024-09-22T08:39:38.920740+0000","last_undegraded":"2024-09-22T08:39:38.920740+0000","last_fullsized":"2024-09-22T08:39:38.920740+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:26:30.343603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:38.374915+0000","last_change":"2024-09-22T08:40:38.374915+0000","last_active":"2024-09-22T08:40:38.374915+0000","last_peered":"2024-09-22T08:40:38.374915+0000","last_clean":"2024-09-22T08:40:38.374915+0000","last_became_active":"2024-09-22T08:36:32.005383+0000","last_became_peered":"2024-09-22T08:36:32.005383+0000","last_unstale":"2024-09-22T08:40:38.374915+0000","last_undegraded":"2024-09-22T08:40:38.374915+0000","last_fullsized":"2024-09-22T08:40:38.374915+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:38.374794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:38.374794+0000","last_clean_scrub_stamp":"2024-09-22T08:40:38.374794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:39:40.546159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.227134+0000","last_change":"2024-09-22T08:36:34.013499+0000","last_active":"2024-09-22T08:37:04.227134+0000","last_peered":"2024-09-22T08:37:04.227134+0000","last_clean":"2024-09-22T08:37:04.227134+0000","last_became_active":"2024-09-22T08:36:34.013204+0000","last_became_peered":"2024-09-22T08:36:34.013204+0000","last_unstale":"2024-09-22T08:37:04.227134+0000","last_undegraded":"2024-09-22T08:37:04.227134+0000","last_fullsized":"2024-09-22T08:37:04.227134+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:37:55.724456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"32'14","reported_seq":74,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:18.502364+0000","last_change":"2024-09-22T08:40:18.502364+0000","last_active":"2024-09-22T08:40:18.502364+0000","last_peered":"2024-09-22T08:40:18.502364+0000","last_clean":"2024-09-22T08:40:18.502364+0000","last_became_active":"2024-09-22T08:36:25.993170+0000","last_became_peered":"2024-09-22T08:36:25.993170+0000","last_unstale":"2024-09-22T08:40:18.502364+0000","last_undegraded":"2024-09-22T08:40:18.502364+0000","last_fullsized":"2024-09-22T08:40:18.502364+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'14","last_scrub_stamp":"2024-09-22T08:40:18.502275+0000","last_deep_scrub":"32'14","last_deep_scrub_stamp":"2024-09-22T08:40:18.502275+0000","last_clean_scrub_stamp":"2024-09-22T08:40:18.502275+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:35:17.727896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":38,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:49.125470+0000","last_change":"2024-09-22T08:39:49.125470+0000","last_active":"2024-09-22T08:39:49.125470+0000","last_peered":"2024-09-22T08:39:49.125470+0000","last_clean":"2024-09-22T08:39:49.125470+0000","last_became_active":"2024-09-22T08:36:23.968207+0000","last_became_peered":"2024-09-22T08:36:23.968207+0000","last_unstale":"2024-09-22T08:39:49.125470+0000","last_undegraded":"2024-09-22T08:39:49.125470+0000","last_fullsized":"2024-09-22T08:39:49.125470+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:39:49.125386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:39:49.125386+0000","last_clean_scrub_stamp":"2024-09-22T08:39:49.125386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:25:13.108318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:14.421686+0000","last_change":"2024-09-22T08:40:14.421686+0000","last_active":"2024-09-22T08:40:14.421686+0000","last_peered":"2024-09-22T08:40:14.421686+0000","last_clean":"2024-09-22T08:40:14.421686+0000","last_became_active":"2024-09-22T08:36:27.985679+0000","last_became_peered":"2024-09-22T08:36:27.985679+0000","last_unstale":"2024-09-22T08:40:14.421686+0000","last_undegraded":"2024-09-22T08:40:14.421686+0000","last_fullsized":"2024-09-22T08:40:14.421686+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:14.421600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:14.421600+0000","last_clean_scrub_stamp":"2024-09-22T08:40:14.421600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:31:50.278835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"32'40","reported_seq":97,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:25.947666+0000","last_change":"2024-09-22T08:40:25.947562+0000","last_active":"2024-09-22T08:40:25.947666+0000","last_peered":"2024-09-22T08:40:25.947666+0000","last_clean":"2024-09-22T08:40:25.947666+0000","last_became_active":"2024-09-22T08:36:29.994075+0000","last_became_peered":"2024-09-22T08:36:29.994075+0000","last_unstale":"2024-09-22T08:40:25.947666+0000","last_undegraded":"2024-09-22T08:40:25.947666+0000","last_fullsized":"2024-09-22T08:40:25.947666+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'40","last_scrub_stamp":"2024-09-22T08:40:25.947455+0000","last_deep_scrub":"32'40","last_deep_scrub_stamp":"2024-09-22T08:40:25.947455+0000","last_clean_scrub_stamp":"2024-09-22T08:40:25.947455+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:02:20.505829+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:36.806341+0000","last_change":"2024-09-22T08:40:36.806341+0000","last_active":"2024-09-22T08:40:36.806341+0000","last_peered":"2024-09-22T08:40:36.806341+0000","last_clean":"2024-09-22T08:40:36.806341+0000","last_became_active":"2024-09-22T08:36:32.005166+0000","last_became_peered":"2024-09-22T08:36:32.005166+0000","last_unstale":"2024-09-22T08:40:36.806341+0000","last_undegraded":"2024-09-22T08:40:36.806341+0000","last_fullsized":"2024-09-22T08:40:36.806341+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:36.806254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:36.806254+0000","last_clean_scrub_stamp":"2024-09-22T08:40:36.806254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:50:50.973187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"32'7","reported_seq":25,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.093378+0000","last_change":"2024-09-22T08:36:34.014540+0000","last_active":"2024-09-22T08:39:32.093378+0000","last_peered":"2024-09-22T08:39:32.093378+0000","last_clean":"2024-09-22T08:39:32.093378+0000","last_became_active":"2024-09-22T08:36:34.014255+0000","last_became_peered":"2024-09-22T08:36:34.014255+0000","last_unstale":"2024-09-22T08:39:32.093378+0000","last_undegraded":"2024-09-22T08:39:32.093378+0000","last_fullsized":"2024-09-22T08:39:32.093378+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:47:25.081359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"32'4","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:03.793636+0000","last_change":"2024-09-22T08:40:03.793636+0000","last_active":"2024-09-22T08:40:03.793636+0000","last_peered":"2024-09-22T08:40:03.793636+0000","last_clean":"2024-09-22T08:40:03.793636+0000","last_became_active":"2024-09-22T08:36:25.978577+0000","last_became_peered":"2024-09-22T08:36:25.978577+0000","last_unstale":"2024-09-22T08:40:03.793636+0000","last_undegraded":"2024-09-22T08:40:03.793636+0000","last_fullsized":"2024-09-22T08:40:03.793636+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-22T08:40:03.793512+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-22T08:40:03.793512+0000","last_clean_scrub_stamp":"2024-09-22T08:40:03.793512+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:00:34.051924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"32'2","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:48.833986+0000","last_change":"2024-09-22T08:39:48.833986+0000","last_active":"2024-09-22T08:39:48.833986+0000","last_peered":"2024-09-22T08:39:48.833986+0000","last_clean":"2024-09-22T08:39:48.833986+0000","last_became_active":"2024-09-22T08:37:04.226169+0000","last_became_peered":"2024-09-22T08:37:04.226169+0000","last_unstale":"2024-09-22T08:39:48.833986+0000","last_undegraded":"2024-09-22T08:39:48.833986+0000","last_fullsized":"2024-09-22T08:39:48.833986+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-22T08:39:48.833881+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-22T08:39:48.833881+0000","last_clean_scrub_stamp":"2024-09-22T08:39:48.833881+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:03:32.581894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:26.336878+0000","last_change":"2024-09-22T08:40:26.336878+0000","last_active":"2024-09-22T08:40:26.336878+0000","last_peered":"2024-09-22T08:40:26.336878+0000","last_clean":"2024-09-22T08:40:26.336878+0000","last_became_active":"2024-09-22T08:36:27.990038+0000","last_became_peered":"2024-09-22T08:36:27.990038+0000","last_unstale":"2024-09-22T08:40:26.336878+0000","last_undegraded":"2024-09-22T08:40:26.336878+0000","last_fullsized":"2024-09-22T08:40:26.336878+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:26.336763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:26.336763+0000","last_clean_scrub_stamp":"2024-09-22T08:40:26.336763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:50:41.991119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"30'10","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:33.182744+0000","last_change":"2024-09-22T08:36:29.997480+0000","last_active":"2024-09-22T08:38:33.182744+0000","last_peered":"2024-09-22T08:38:33.182744+0000","last_clean":"2024-09-22T08:38:33.182744+0000","last_became_active":"2024-09-22T08:36:29.997179+0000","last_became_peered":"2024-09-22T08:36:29.997179+0000","last_unstale":"2024-09-22T08:38:33.182744+0000","last_undegraded":"2024-09-22T08:38:33.182744+0000","last_fullsized":"2024-09-22T08:38:33.182744+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"32'286","reported_seq":378,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:29.435880+0000","last_change":"2024-09-22T08:40:29.435880+0000","last_active":"2024-09-22T08:40:29.435880+0000","last_peered":"2024-09-22T08:40:29.435880+0000","last_clean":"2024-09-22T08:40:29.435880+0000","last_became_active":"2024-09-22T08:36:32.011870+0000","last_became_peered":"2024-09-22T08:36:32.011870+0000","last_unstale":"2024-09-22T08:40:29.435880+0000","last_undegraded":"2024-09-22T08:40:29.435880+0000","last_fullsized":"2024-09-22T08:40:29.435880+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'286","last_scrub_stamp":"2024-09-22T08:40:29.435778+0000","last_deep_scrub":"32'286","last_deep_scrub_stamp":"2024-09-22T08:40:29.435778+0000","last_clean_scrub_stamp":"2024-09-22T08:40:29.435778+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:37:13.038460+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"32'2","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.248674+0000","last_change":"2024-09-22T08:36:34.013756+0000","last_active":"2024-09-22T08:39:32.248674+0000","last_peered":"2024-09-22T08:39:32.248674+0000","last_clean":"2024-09-22T08:39:32.248674+0000","last_became_active":"2024-09-22T08:36:34.013380+0000","last_became_peered":"2024-09-22T08:36:34.013380+0000","last_unstale":"2024-09-22T08:39:32.248674+0000","last_undegraded":"2024-09-22T08:39:32.248674+0000","last_fullsized":"2024-09-22T08:39:32.248674+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:26:36.228816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"32'8","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:07.397444+0000","last_change":"2024-09-22T08:40:07.397444+0000","last_active":"2024-09-22T08:40:07.397444+0000","last_peered":"2024-09-22T08:40:07.397444+0000","last_clean":"2024-09-22T08:40:07.397444+0000","last_became_active":"2024-09-22T08:36:25.971327+0000","last_became_peered":"2024-09-22T08:36:25.971327+0000","last_unstale":"2024-09-22T08:40:07.397444+0000","last_undegraded":"2024-09-22T08:40:07.397444+0000","last_fullsized":"2024-09-22T08:40:07.397444+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-22T08:40:07.397356+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-22T08:40:07.397356+0000","last_clean_scrub_stamp":"2024-09-22T08:40:07.397356+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:37:27.086026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:50.109978+0000","last_change":"2024-09-22T08:39:50.109978+0000","last_active":"2024-09-22T08:39:50.109978+0000","last_peered":"2024-09-22T08:39:50.109978+0000","last_clean":"2024-09-22T08:39:50.109978+0000","last_became_active":"2024-09-22T08:36:23.978006+0000","last_became_peered":"2024-09-22T08:36:23.978006+0000","last_unstale":"2024-09-22T08:39:50.109978+0000","last_undegraded":"2024-09-22T08:39:50.109978+0000","last_fullsized":"2024-09-22T08:39:50.109978+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-22T08:39:50.109878+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-22T08:39:50.109878+0000","last_clean_scrub_stamp":"2024-09-22T08:39:50.109878+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:37:09.798548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:25.344973+0000","last_change":"2024-09-22T08:40:25.344973+0000","last_active":"2024-09-22T08:40:25.344973+0000","last_peered":"2024-09-22T08:40:25.344973+0000","last_clean":"2024-09-22T08:40:25.344973+0000","last_became_active":"2024-09-22T08:36:27.990729+0000","last_became_peered":"2024-09-22T08:36:27.990729+0000","last_unstale":"2024-09-22T08:40:25.344973+0000","last_undegraded":"2024-09-22T08:40:25.344973+0000","last_fullsized":"2024-09-22T08:40:25.344973+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:25.344883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:25.344883+0000","last_clean_scrub_stamp":"2024-09-22T08:40:25.344883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:33:42.396651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"32'46","reported_seq":104,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:32.421298+0000","last_change":"2024-09-22T08:40:32.421298+0000","last_active":"2024-09-22T08:40:32.421298+0000","last_peered":"2024-09-22T08:40:32.421298+0000","last_clean":"2024-09-22T08:40:32.421298+0000","last_became_active":"2024-09-22T08:36:29.987459+0000","last_became_peered":"2024-09-22T08:36:29.987459+0000","last_unstale":"2024-09-22T08:40:32.421298+0000","last_undegraded":"2024-09-22T08:40:32.421298+0000","last_fullsized":"2024-09-22T08:40:32.421298+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'46","last_scrub_stamp":"2024-09-22T08:40:32.421206+0000","last_deep_scrub":"32'46","last_deep_scrub_stamp":"2024-09-22T08:40:32.421206+0000","last_clean_scrub_stamp":"2024-09-22T08:40:32.421206+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:39:14.508488+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:35.766418+0000","last_change":"2024-09-22T08:40:35.766418+0000","last_active":"2024-09-22T08:40:35.766418+0000","last_peered":"2024-09-22T08:40:35.766418+0000","last_clean":"2024-09-22T08:40:35.766418+0000","last_became_active":"2024-09-22T08:36:32.003196+0000","last_became_peered":"2024-09-22T08:36:32.003196+0000","last_unstale":"2024-09-22T08:40:35.766418+0000","last_undegraded":"2024-09-22T08:40:35.766418+0000","last_fullsized":"2024-09-22T08:40:35.766418+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:35.766331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:35.766331+0000","last_clean_scrub_stamp":"2024-09-22T08:40:35.766331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:55:51.742750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.223793+0000","last_change":"2024-09-22T08:36:34.016292+0000","last_active":"2024-09-22T08:37:04.223793+0000","last_peered":"2024-09-22T08:37:04.223793+0000","last_clean":"2024-09-22T08:37:04.223793+0000","last_became_active":"2024-09-22T08:36:34.015988+0000","last_became_peered":"2024-09-22T08:36:34.015988+0000","last_unstale":"2024-09-22T08:37:04.223793+0000","last_undegraded":"2024-09-22T08:37:04.223793+0000","last_fullsized":"2024-09-22T08:37:04.223793+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:16:42.030515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"32'4","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:03.357413+0000","last_change":"2024-09-22T08:40:03.357413+0000","last_active":"2024-09-22T08:40:03.357413+0000","last_peered":"2024-09-22T08:40:03.357413+0000","last_clean":"2024-09-22T08:40:03.357413+0000","last_became_active":"2024-09-22T08:36:25.972149+0000","last_became_peered":"2024-09-22T08:36:25.972149+0000","last_unstale":"2024-09-22T08:40:03.357413+0000","last_undegraded":"2024-09-22T08:40:03.357413+0000","last_fullsized":"2024-09-22T08:40:03.357413+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-22T08:40:03.357323+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-22T08:40:03.357323+0000","last_clean_scrub_stamp":"2024-09-22T08:40:03.357323+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:00:50.517267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"32'2","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:59.302310+0000","last_change":"2024-09-22T08:39:59.302310+0000","last_active":"2024-09-22T08:39:59.302310+0000","last_peered":"2024-09-22T08:39:59.302310+0000","last_clean":"2024-09-22T08:39:59.302310+0000","last_became_active":"2024-09-22T08:36:23.982545+0000","last_became_peered":"2024-09-22T08:36:23.982545+0000","last_unstale":"2024-09-22T08:39:59.302310+0000","last_undegraded":"2024-09-22T08:39:59.302310+0000","last_fullsized":"2024-09-22T08:39:59.302310+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-22T08:39:59.302226+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-22T08:39:59.302226+0000","last_clean_scrub_stamp":"2024-09-22T08:39:59.302226+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:17:21.833960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:13.410180+0000","last_change":"2024-09-22T08:40:13.410180+0000","last_active":"2024-09-22T08:40:13.410180+0000","last_peered":"2024-09-22T08:40:13.410180+0000","last_clean":"2024-09-22T08:40:13.410180+0000","last_became_active":"2024-09-22T08:36:27.989495+0000","last_became_peered":"2024-09-22T08:36:27.989495+0000","last_unstale":"2024-09-22T08:40:13.410180+0000","last_undegraded":"2024-09-22T08:40:13.410180+0000","last_fullsized":"2024-09-22T08:40:13.410180+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:13.410093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:13.410093+0000","last_clean_scrub_stamp":"2024-09-22T08:40:13.410093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:27:10.709987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"32'37","reported_seq":92,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:23.938924+0000","last_change":"2024-09-22T08:40:23.938924+0000","last_active":"2024-09-22T08:40:23.938924+0000","last_peered":"2024-09-22T08:40:23.938924+0000","last_clean":"2024-09-22T08:40:23.938924+0000","last_became_active":"2024-09-22T08:36:29.994101+0000","last_became_peered":"2024-09-22T08:36:29.994101+0000","last_unstale":"2024-09-22T08:40:23.938924+0000","last_undegraded":"2024-09-22T08:40:23.938924+0000","last_fullsized":"2024-09-22T08:40:23.938924+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'37","last_scrub_stamp":"2024-09-22T08:40:23.938814+0000","last_deep_scrub":"32'37","last_deep_scrub_stamp":"2024-09-22T08:40:23.938814+0000","last_clean_scrub_stamp":"2024-09-22T08:40:23.938814+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:23:37.032961+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.230375+0000","last_change":"2024-09-22T08:36:32.012960+0000","last_active":"2024-09-22T08:37:04.230375+0000","last_peered":"2024-09-22T08:37:04.230375+0000","last_clean":"2024-09-22T08:37:04.230375+0000","last_became_active":"2024-09-22T08:36:32.011811+0000","last_became_peered":"2024-09-22T08:36:32.011811+0000","last_unstale":"2024-09-22T08:37:04.230375+0000","last_undegraded":"2024-09-22T08:37:04.230375+0000","last_fullsized":"2024-09-22T08:37:04.230375+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:13:22.789596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"32'2","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:05.456749+0000","last_change":"2024-09-22T08:36:34.020146+0000","last_active":"2024-09-22T08:37:05.456749+0000","last_peered":"2024-09-22T08:37:05.456749+0000","last_clean":"2024-09-22T08:37:05.456749+0000","last_became_active":"2024-09-22T08:36:34.019866+0000","last_became_peered":"2024-09-22T08:36:34.019866+0000","last_unstale":"2024-09-22T08:37:05.456749+0000","last_undegraded":"2024-09-22T08:37:05.456749+0000","last_fullsized":"2024-09-22T08:37:05.456749+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:56:15.623151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"32'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:17.499349+0000","last_change":"2024-09-22T08:40:17.499349+0000","last_active":"2024-09-22T08:40:17.499349+0000","last_peered":"2024-09-22T08:40:17.499349+0000","last_clean":"2024-09-22T08:40:17.499349+0000","last_became_active":"2024-09-22T08:36:25.989572+0000","last_became_peered":"2024-09-22T08:36:25.989572+0000","last_unstale":"2024-09-22T08:40:17.499349+0000","last_undegraded":"2024-09-22T08:40:17.499349+0000","last_fullsized":"2024-09-22T08:40:17.499349+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-22T08:40:17.499263+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-22T08:40:17.499263+0000","last_clean_scrub_stamp":"2024-09-22T08:40:17.499263+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:38:33.473092+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:49.815548+0000","last_change":"2024-09-22T08:39:49.815491+0000","last_active":"2024-09-22T08:39:49.815548+0000","last_peered":"2024-09-22T08:39:49.815548+0000","last_clean":"2024-09-22T08:39:49.815548+0000","last_became_active":"2024-09-22T08:36:23.971012+0000","last_became_peered":"2024-09-22T08:36:23.971012+0000","last_unstale":"2024-09-22T08:39:49.815548+0000","last_undegraded":"2024-09-22T08:39:49.815548+0000","last_fullsized":"2024-09-22T08:39:49.815548+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:39:49.815399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:39:49.815399+0000","last_clean_scrub_stamp":"2024-09-22T08:39:49.815399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:29:53.053729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:23.378577+0000","last_change":"2024-09-22T08:40:23.378577+0000","last_active":"2024-09-22T08:40:23.378577+0000","last_peered":"2024-09-22T08:40:23.378577+0000","last_clean":"2024-09-22T08:40:23.378577+0000","last_became_active":"2024-09-22T08:36:27.987504+0000","last_became_peered":"2024-09-22T08:36:27.987504+0000","last_unstale":"2024-09-22T08:40:23.378577+0000","last_undegraded":"2024-09-22T08:40:23.378577+0000","last_fullsized":"2024-09-22T08:40:23.378577+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:23.378462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:23.378462+0000","last_clean_scrub_stamp":"2024-09-22T08:40:23.378462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:30:23.702772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"32'29","reported_seq":74,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:38.971363+0000","last_change":"2024-09-22T08:36:29.998167+0000","last_active":"2024-09-22T08:39:38.971363+0000","last_peered":"2024-09-22T08:39:38.971363+0000","last_clean":"2024-09-22T08:39:38.971363+0000","last_became_active":"2024-09-22T08:36:29.997853+0000","last_became_peered":"2024-09-22T08:36:29.997853+0000","last_unstale":"2024-09-22T08:39:38.971363+0000","last_undegraded":"2024-09-22T08:39:38.971363+0000","last_fullsized":"2024-09-22T08:39:38.971363+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:34:13.019632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:04.227451+0000","last_change":"2024-09-22T08:36:32.012262+0000","last_active":"2024-09-22T08:37:04.227451+0000","last_peered":"2024-09-22T08:37:04.227451+0000","last_clean":"2024-09-22T08:37:04.227451+0000","last_became_active":"2024-09-22T08:36:32.011960+0000","last_became_peered":"2024-09-22T08:36:32.011960+0000","last_unstale":"2024-09-22T08:37:04.227451+0000","last_undegraded":"2024-09-22T08:37:04.227451+0000","last_fullsized":"2024-09-22T08:37:04.227451+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:30.982878+0000","last_clean_scrub_stamp":"2024-09-22T08:36:30.982878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:58:25.357801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"32'16","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:30.267408+0000","last_change":"2024-09-22T08:36:34.018605+0000","last_active":"2024-09-22T08:38:30.267408+0000","last_peered":"2024-09-22T08:38:30.267408+0000","last_clean":"2024-09-22T08:38:30.267408+0000","last_became_active":"2024-09-22T08:36:34.018365+0000","last_became_peered":"2024-09-22T08:36:34.018365+0000","last_unstale":"2024-09-22T08:38:30.267408+0000","last_undegraded":"2024-09-22T08:38:30.267408+0000","last_fullsized":"2024-09-22T08:38:30.267408+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:01:49.722849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":96,"num_read_kb":76,"num_write":46,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"32'8","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:02.399251+0000","last_change":"2024-09-22T08:40:02.399251+0000","last_active":"2024-09-22T08:40:02.399251+0000","last_peered":"2024-09-22T08:40:02.399251+0000","last_clean":"2024-09-22T08:40:02.399251+0000","last_became_active":"2024-09-22T08:36:25.973089+0000","last_became_peered":"2024-09-22T08:36:25.973089+0000","last_unstale":"2024-09-22T08:40:02.399251+0000","last_undegraded":"2024-09-22T08:40:02.399251+0000","last_fullsized":"2024-09-22T08:40:02.399251+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-22T08:40:02.399133+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-22T08:40:02.399133+0000","last_clean_scrub_stamp":"2024-09-22T08:40:02.399133+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:04:36.042470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:51.157044+0000","last_change":"2024-09-22T08:39:51.156994+0000","last_active":"2024-09-22T08:39:51.157044+0000","last_peered":"2024-09-22T08:39:51.157044+0000","last_clean":"2024-09-22T08:39:51.157044+0000","last_became_active":"2024-09-22T08:36:23.968249+0000","last_became_peered":"2024-09-22T08:36:23.968249+0000","last_unstale":"2024-09-22T08:39:51.157044+0000","last_undegraded":"2024-09-22T08:39:51.157044+0000","last_fullsized":"2024-09-22T08:39:51.157044+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-22T08:39:51.156910+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-22T08:39:51.156910+0000","last_clean_scrub_stamp":"2024-09-22T08:39:51.156910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:55:37.836983+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"32'3","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:24.334465+0000","last_change":"2024-09-22T08:40:24.334465+0000","last_active":"2024-09-22T08:40:24.334465+0000","last_peered":"2024-09-22T08:40:24.334465+0000","last_clean":"2024-09-22T08:40:24.334465+0000","last_became_active":"2024-09-22T08:36:27.988262+0000","last_became_peered":"2024-09-22T08:36:27.988262+0000","last_unstale":"2024-09-22T08:40:24.334465+0000","last_undegraded":"2024-09-22T08:40:24.334465+0000","last_fullsized":"2024-09-22T08:40:24.334465+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2024-09-22T08:40:24.334357+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2024-09-22T08:40:24.334357+0000","last_clean_scrub_stamp":"2024-09-22T08:40:24.334357+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:51:02.384626+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"32'35","reported_seq":84,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:38.877181+0000","last_change":"2024-09-22T08:36:29.997925+0000","last_active":"2024-09-22T08:39:38.877181+0000","last_peered":"2024-09-22T08:39:38.877181+0000","last_clean":"2024-09-22T08:39:38.877181+0000","last_became_active":"2024-09-22T08:36:29.997231+0000","last_became_peered":"2024-09-22T08:36:29.997231+0000","last_unstale":"2024-09-22T08:39:38.877181+0000","last_undegraded":"2024-09-22T08:39:38.877181+0000","last_fullsized":"2024-09-22T08:39:38.877181+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:28.972630+0000","last_clean_scrub_stamp":"2024-09-22T08:36:28.972630+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:37:27.208598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:39.811332+0000","last_change":"2024-09-22T08:40:39.811332+0000","last_active":"2024-09-22T08:40:39.811332+0000","last_peered":"2024-09-22T08:40:39.811332+0000","last_clean":"2024-09-22T08:40:39.811332+0000","last_became_active":"2024-09-22T08:36:32.004365+0000","last_became_peered":"2024-09-22T08:36:32.004365+0000","last_unstale":"2024-09-22T08:40:39.811332+0000","last_undegraded":"2024-09-22T08:40:39.811332+0000","last_fullsized":"2024-09-22T08:40:39.811332+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:39.811245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:39.811245+0000","last_clean_scrub_stamp":"2024-09-22T08:40:39.811245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:37:48.980763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"32'4","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:30.270088+0000","last_change":"2024-09-22T08:36:34.016625+0000","last_active":"2024-09-22T08:38:30.270088+0000","last_peered":"2024-09-22T08:38:30.270088+0000","last_clean":"2024-09-22T08:38:30.270088+0000","last_became_active":"2024-09-22T08:36:34.016106+0000","last_became_peered":"2024-09-22T08:36:34.016106+0000","last_unstale":"2024-09-22T08:38:30.270088+0000","last_undegraded":"2024-09-22T08:38:30.270088+0000","last_fullsized":"2024-09-22T08:38:30.270088+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:10:10.424019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"32'12","reported_seq":78,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:06.403598+0000","last_change":"2024-09-22T08:40:06.403598+0000","last_active":"2024-09-22T08:40:06.403598+0000","last_peered":"2024-09-22T08:40:06.403598+0000","last_clean":"2024-09-22T08:40:06.403598+0000","last_became_active":"2024-09-22T08:36:25.987161+0000","last_became_peered":"2024-09-22T08:36:25.987161+0000","last_unstale":"2024-09-22T08:40:06.403598+0000","last_undegraded":"2024-09-22T08:40:06.403598+0000","last_fullsized":"2024-09-22T08:40:06.403598+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-09-22T08:40:06.403521+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-09-22T08:40:06.403521+0000","last_clean_scrub_stamp":"2024-09-22T08:40:06.403521+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:26:49.349866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:51.626331+0000","last_change":"2024-09-22T08:39:51.626242+0000","last_active":"2024-09-22T08:39:51.626331+0000","last_peered":"2024-09-22T08:39:51.626331+0000","last_clean":"2024-09-22T08:39:51.626331+0000","last_became_active":"2024-09-22T08:36:23.969515+0000","last_became_peered":"2024-09-22T08:36:23.969515+0000","last_unstale":"2024-09-22T08:39:51.626331+0000","last_undegraded":"2024-09-22T08:39:51.626331+0000","last_fullsized":"2024-09-22T08:39:51.626331+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:39:51.626108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:39:51.626108+0000","last_clean_scrub_stamp":"2024-09-22T08:39:51.626108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:12:42.258599+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"32'12","reported_seq":72,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:07.850074+0000","last_change":"2024-09-22T08:40:07.850074+0000","last_active":"2024-09-22T08:40:07.850074+0000","last_peered":"2024-09-22T08:40:07.850074+0000","last_clean":"2024-09-22T08:40:07.850074+0000","last_became_active":"2024-09-22T08:36:25.978679+0000","last_became_peered":"2024-09-22T08:36:25.978679+0000","last_unstale":"2024-09-22T08:40:07.850074+0000","last_undegraded":"2024-09-22T08:40:07.850074+0000","last_fullsized":"2024-09-22T08:40:07.850074+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-09-22T08:40:07.849968+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-09-22T08:40:07.849968+0000","last_clean_scrub_stamp":"2024-09-22T08:40:07.849968+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:50:10.705568+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:50.767547+0000","last_change":"2024-09-22T08:39:50.767473+0000","last_active":"2024-09-22T08:39:50.767547+0000","last_peered":"2024-09-22T08:39:50.767547+0000","last_clean":"2024-09-22T08:39:50.767547+0000","last_became_active":"2024-09-22T08:36:23.970218+0000","last_became_peered":"2024-09-22T08:36:23.970218+0000","last_unstale":"2024-09-22T08:39:50.767547+0000","last_undegraded":"2024-09-22T08:39:50.767547+0000","last_fullsized":"2024-09-22T08:39:50.767547+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-22T08:39:50.767366+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-22T08:39:50.767366+0000","last_clean_scrub_stamp":"2024-09-22T08:39:50.767366+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:50:42.858238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"32'12","reported_seq":67,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:20.546264+0000","last_change":"2024-09-22T08:40:20.546264+0000","last_active":"2024-09-22T08:40:20.546264+0000","last_peered":"2024-09-22T08:40:20.546264+0000","last_clean":"2024-09-22T08:40:20.546264+0000","last_became_active":"2024-09-22T08:36:25.989638+0000","last_became_peered":"2024-09-22T08:36:25.989638+0000","last_unstale":"2024-09-22T08:40:20.546264+0000","last_undegraded":"2024-09-22T08:40:20.546264+0000","last_fullsized":"2024-09-22T08:40:20.546264+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-09-22T08:40:20.546161+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-09-22T08:40:20.546161+0000","last_clean_scrub_stamp":"2024-09-22T08:40:20.546161+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:20:45.107609+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":33,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:58.317648+0000","last_change":"2024-09-22T08:39:58.317577+0000","last_active":"2024-09-22T08:39:58.317648+0000","last_peered":"2024-09-22T08:39:58.317648+0000","last_clean":"2024-09-22T08:39:58.317648+0000","last_became_active":"2024-09-22T08:36:23.972582+0000","last_became_peered":"2024-09-22T08:36:23.972582+0000","last_unstale":"2024-09-22T08:39:58.317648+0000","last_undegraded":"2024-09-22T08:39:58.317648+0000","last_fullsized":"2024-09-22T08:39:58.317648+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:39:58.317493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:39:58.317493+0000","last_clean_scrub_stamp":"2024-09-22T08:39:58.317493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:30:33.805756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:06.836804+0000","last_change":"2024-09-22T08:40:06.836804+0000","last_active":"2024-09-22T08:40:06.836804+0000","last_peered":"2024-09-22T08:40:06.836804+0000","last_clean":"2024-09-22T08:40:06.836804+0000","last_became_active":"2024-09-22T08:36:25.978538+0000","last_became_peered":"2024-09-22T08:36:25.978538+0000","last_unstale":"2024-09-22T08:40:06.836804+0000","last_undegraded":"2024-09-22T08:40:06.836804+0000","last_fullsized":"2024-09-22T08:40:06.836804+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:06.836699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:06.836699+0000","last_clean_scrub_stamp":"2024-09-22T08:40:06.836699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:16:11.004999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:51.809328+0000","last_change":"2024-09-22T08:39:51.809249+0000","last_active":"2024-09-22T08:39:51.809328+0000","last_peered":"2024-09-22T08:39:51.809328+0000","last_clean":"2024-09-22T08:39:51.809328+0000","last_became_active":"2024-09-22T08:36:23.973945+0000","last_became_peered":"2024-09-22T08:36:23.973945+0000","last_unstale":"2024-09-22T08:39:51.809328+0000","last_undegraded":"2024-09-22T08:39:51.809328+0000","last_fullsized":"2024-09-22T08:39:51.809328+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:39:51.809165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:39:51.809165+0000","last_clean_scrub_stamp":"2024-09-22T08:39:51.809165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:41:14.543135+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"32'2","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:09.879496+0000","last_change":"2024-09-22T08:40:09.879440+0000","last_active":"2024-09-22T08:40:09.879496+0000","last_peered":"2024-09-22T08:40:09.879496+0000","last_clean":"2024-09-22T08:40:09.879496+0000","last_became_active":"2024-09-22T08:36:25.984094+0000","last_became_peered":"2024-09-22T08:36:25.984094+0000","last_unstale":"2024-09-22T08:40:09.879496+0000","last_undegraded":"2024-09-22T08:40:09.879496+0000","last_fullsized":"2024-09-22T08:40:09.879496+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-22T08:40:09.879355+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-22T08:40:09.879355+0000","last_clean_scrub_stamp":"2024-09-22T08:40:09.879355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:15:19.787347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"32'2","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:52.813867+0000","last_change":"2024-09-22T08:39:52.813867+0000","last_active":"2024-09-22T08:39:52.813867+0000","last_peered":"2024-09-22T08:39:52.813867+0000","last_clean":"2024-09-22T08:39:52.813867+0000","last_became_active":"2024-09-22T08:36:23.970920+0000","last_became_peered":"2024-09-22T08:36:23.970920+0000","last_unstale":"2024-09-22T08:39:52.813867+0000","last_undegraded":"2024-09-22T08:39:52.813867+0000","last_fullsized":"2024-09-22T08:39:52.813867+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-22T08:39:52.813773+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-22T08:39:52.813773+0000","last_clean_scrub_stamp":"2024-09-22T08:39:52.813773+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:32:25.388534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"32'12","reported_seq":78,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:05.355128+0000","last_change":"2024-09-22T08:40:05.355078+0000","last_active":"2024-09-22T08:40:05.355128+0000","last_peered":"2024-09-22T08:40:05.355128+0000","last_clean":"2024-09-22T08:40:05.355128+0000","last_became_active":"2024-09-22T08:36:25.985965+0000","last_became_peered":"2024-09-22T08:36:25.985965+0000","last_unstale":"2024-09-22T08:40:05.355128+0000","last_undegraded":"2024-09-22T08:40:05.355128+0000","last_fullsized":"2024-09-22T08:40:05.355128+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-09-22T08:40:05.354995+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-09-22T08:40:05.354995+0000","last_clean_scrub_stamp":"2024-09-22T08:40:05.354995+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:08:14.083131+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":11,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:52.189228+0000","last_change":"2024-09-22T08:39:52.189228+0000","last_active":"2024-09-22T08:39:52.189228+0000","last_peered":"2024-09-22T08:39:52.189228+0000","last_clean":"2024-09-22T08:39:52.189228+0000","last_became_active":"2024-09-22T08:36:23.983722+0000","last_became_peered":"2024-09-22T08:36:23.983722+0000","last_unstale":"2024-09-22T08:39:52.189228+0000","last_undegraded":"2024-09-22T08:39:52.189228+0000","last_fullsized":"2024-09-22T08:39:52.189228+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:39:52.189117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:39:52.189117+0000","last_clean_scrub_stamp":"2024-09-22T08:39:52.189117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:49:51.464801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"32'4","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:04.756500+0000","last_change":"2024-09-22T08:40:04.756446+0000","last_active":"2024-09-22T08:40:04.756500+0000","last_peered":"2024-09-22T08:40:04.756500+0000","last_clean":"2024-09-22T08:40:04.756500+0000","last_became_active":"2024-09-22T08:36:25.983061+0000","last_became_peered":"2024-09-22T08:36:25.983061+0000","last_unstale":"2024-09-22T08:40:04.756500+0000","last_undegraded":"2024-09-22T08:40:04.756500+0000","last_fullsized":"2024-09-22T08:40:04.756500+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-22T08:40:04.756359+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-22T08:40:04.756359+0000","last_clean_scrub_stamp":"2024-09-22T08:40:04.756359+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:17:00.830661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:52.621578+0000","last_change":"2024-09-22T08:39:52.621578+0000","last_active":"2024-09-22T08:39:52.621578+0000","last_peered":"2024-09-22T08:39:52.621578+0000","last_clean":"2024-09-22T08:39:52.621578+0000","last_became_active":"2024-09-22T08:36:23.973924+0000","last_became_peered":"2024-09-22T08:36:23.973924+0000","last_unstale":"2024-09-22T08:39:52.621578+0000","last_undegraded":"2024-09-22T08:39:52.621578+0000","last_fullsized":"2024-09-22T08:39:52.621578+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:39:52.621486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:39:52.621486+0000","last_clean_scrub_stamp":"2024-09-22T08:39:52.621486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:10:20.959216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"32'18","reported_seq":88,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:04.305369+0000","last_change":"2024-09-22T08:40:04.305270+0000","last_active":"2024-09-22T08:40:04.305369+0000","last_peered":"2024-09-22T08:40:04.305369+0000","last_clean":"2024-09-22T08:40:04.305369+0000","last_became_active":"2024-09-22T08:36:25.979151+0000","last_became_peered":"2024-09-22T08:36:25.979151+0000","last_unstale":"2024-09-22T08:40:04.305369+0000","last_undegraded":"2024-09-22T08:40:04.305369+0000","last_fullsized":"2024-09-22T08:40:04.305369+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'18","last_scrub_stamp":"2024-09-22T08:40:04.305175+0000","last_deep_scrub":"32'18","last_deep_scrub_stamp":"2024-09-22T08:40:04.305175+0000","last_clean_scrub_stamp":"2024-09-22T08:40:04.305175+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:39:13.164022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":64,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:53.864259+0000","last_change":"2024-09-22T08:39:53.864259+0000","last_active":"2024-09-22T08:39:53.864259+0000","last_peered":"2024-09-22T08:39:53.864259+0000","last_clean":"2024-09-22T08:39:53.864259+0000","last_became_active":"2024-09-22T08:36:23.970584+0000","last_became_peered":"2024-09-22T08:36:23.970584+0000","last_unstale":"2024-09-22T08:39:53.864259+0000","last_undegraded":"2024-09-22T08:39:53.864259+0000","last_fullsized":"2024-09-22T08:39:53.864259+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:39:53.864171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:39:53.864171+0000","last_clean_scrub_stamp":"2024-09-22T08:39:53.864171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:54:15.743899+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"32'16","reported_seq":97,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:10.444682+0000","last_change":"2024-09-22T08:40:10.444682+0000","last_active":"2024-09-22T08:40:10.444682+0000","last_peered":"2024-09-22T08:40:10.444682+0000","last_clean":"2024-09-22T08:40:10.444682+0000","last_became_active":"2024-09-22T08:36:25.978730+0000","last_became_peered":"2024-09-22T08:36:25.978730+0000","last_unstale":"2024-09-22T08:40:10.444682+0000","last_undegraded":"2024-09-22T08:40:10.444682+0000","last_fullsized":"2024-09-22T08:40:10.444682+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'16","last_scrub_stamp":"2024-09-22T08:40:10.444585+0000","last_deep_scrub":"32'16","last_deep_scrub_stamp":"2024-09-22T08:40:10.444585+0000","last_clean_scrub_stamp":"2024-09-22T08:40:10.444585+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:20:44.546694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":70,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:00.269799+0000","last_change":"2024-09-22T08:40:00.269799+0000","last_active":"2024-09-22T08:40:00.269799+0000","last_peered":"2024-09-22T08:40:00.269799+0000","last_clean":"2024-09-22T08:40:00.269799+0000","last_became_active":"2024-09-22T08:36:23.973175+0000","last_became_peered":"2024-09-22T08:36:23.973175+0000","last_unstale":"2024-09-22T08:40:00.269799+0000","last_undegraded":"2024-09-22T08:40:00.269799+0000","last_fullsized":"2024-09-22T08:40:00.269799+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-22T08:40:00.269709+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-22T08:40:00.269709+0000","last_clean_scrub_stamp":"2024-09-22T08:40:00.269709+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:41:49.730855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"32'6","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:22.563038+0000","last_change":"2024-09-22T08:40:22.563038+0000","last_active":"2024-09-22T08:40:22.563038+0000","last_peered":"2024-09-22T08:40:22.563038+0000","last_clean":"2024-09-22T08:40:22.563038+0000","last_became_active":"2024-09-22T08:36:25.991611+0000","last_became_peered":"2024-09-22T08:36:25.991611+0000","last_unstale":"2024-09-22T08:40:22.563038+0000","last_undegraded":"2024-09-22T08:40:22.563038+0000","last_fullsized":"2024-09-22T08:40:22.563038+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-22T08:40:22.562955+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-22T08:40:22.562955+0000","last_clean_scrub_stamp":"2024-09-22T08:40:22.562955+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:47:21.108045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"32'6","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:54.860397+0000","last_change":"2024-09-22T08:39:54.860397+0000","last_active":"2024-09-22T08:39:54.860397+0000","last_peered":"2024-09-22T08:39:54.860397+0000","last_clean":"2024-09-22T08:39:54.860397+0000","last_became_active":"2024-09-22T08:36:23.973721+0000","last_became_peered":"2024-09-22T08:36:23.973721+0000","last_unstale":"2024-09-22T08:39:54.860397+0000","last_undegraded":"2024-09-22T08:39:54.860397+0000","last_fullsized":"2024-09-22T08:39:54.860397+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-22T08:39:54.860314+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-22T08:39:54.860314+0000","last_clean_scrub_stamp":"2024-09-22T08:39:54.860314+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:19:21.761274+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4,"num_write":22,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"32'8","reported_seq":77,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:08.879975+0000","last_change":"2024-09-22T08:40:08.879975+0000","last_active":"2024-09-22T08:40:08.879975+0000","last_peered":"2024-09-22T08:40:08.879975+0000","last_clean":"2024-09-22T08:40:08.879975+0000","last_became_active":"2024-09-22T08:37:04.231342+0000","last_became_peered":"2024-09-22T08:37:04.231342+0000","last_unstale":"2024-09-22T08:40:08.879975+0000","last_undegraded":"2024-09-22T08:40:08.879975+0000","last_fullsized":"2024-09-22T08:40:08.879975+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-22T08:40:08.879881+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-22T08:40:08.879881+0000","last_clean_scrub_stamp":"2024-09-22T08:40:08.879881+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:29:38.636460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:53.142490+0000","last_change":"2024-09-22T08:39:53.142490+0000","last_active":"2024-09-22T08:39:53.142490+0000","last_peered":"2024-09-22T08:39:53.142490+0000","last_clean":"2024-09-22T08:39:53.142490+0000","last_became_active":"2024-09-22T08:36:23.975352+0000","last_became_peered":"2024-09-22T08:36:23.975352+0000","last_unstale":"2024-09-22T08:39:53.142490+0000","last_undegraded":"2024-09-22T08:39:53.142490+0000","last_fullsized":"2024-09-22T08:39:53.142490+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:39:53.142406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:39:53.142406+0000","last_clean_scrub_stamp":"2024-09-22T08:39:53.142406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:12:04.379120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:09.423304+0000","last_change":"2024-09-22T08:40:09.423304+0000","last_active":"2024-09-22T08:40:09.423304+0000","last_peered":"2024-09-22T08:40:09.423304+0000","last_clean":"2024-09-22T08:40:09.423304+0000","last_became_active":"2024-09-22T08:36:25.977732+0000","last_became_peered":"2024-09-22T08:36:25.977732+0000","last_unstale":"2024-09-22T08:40:09.423304+0000","last_undegraded":"2024-09-22T08:40:09.423304+0000","last_fullsized":"2024-09-22T08:40:09.423304+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:09.423216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:09.423216+0000","last_clean_scrub_stamp":"2024-09-22T08:40:09.423216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:29:07.668069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:54.171493+0000","last_change":"2024-09-22T08:39:54.171493+0000","last_active":"2024-09-22T08:39:54.171493+0000","last_peered":"2024-09-22T08:39:54.171493+0000","last_clean":"2024-09-22T08:39:54.171493+0000","last_became_active":"2024-09-22T08:36:23.975986+0000","last_became_peered":"2024-09-22T08:36:23.975986+0000","last_unstale":"2024-09-22T08:39:54.171493+0000","last_undegraded":"2024-09-22T08:39:54.171493+0000","last_fullsized":"2024-09-22T08:39:54.171493+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:39:54.171402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:39:54.171402+0000","last_clean_scrub_stamp":"2024-09-22T08:39:54.171402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:30:19.750104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"32'10","reported_seq":61,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:14.385913+0000","last_change":"2024-09-22T08:40:14.385913+0000","last_active":"2024-09-22T08:40:14.385913+0000","last_peered":"2024-09-22T08:40:14.385913+0000","last_clean":"2024-09-22T08:40:14.385913+0000","last_became_active":"2024-09-22T08:36:25.984258+0000","last_became_peered":"2024-09-22T08:36:25.984258+0000","last_unstale":"2024-09-22T08:40:14.385913+0000","last_undegraded":"2024-09-22T08:40:14.385913+0000","last_fullsized":"2024-09-22T08:40:14.385913+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-09-22T08:40:14.385812+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-09-22T08:40:14.385812+0000","last_clean_scrub_stamp":"2024-09-22T08:40:14.385812+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:44:29.101922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:01.295930+0000","last_change":"2024-09-22T08:40:01.295930+0000","last_active":"2024-09-22T08:40:01.295930+0000","last_peered":"2024-09-22T08:40:01.295930+0000","last_clean":"2024-09-22T08:40:01.295930+0000","last_became_active":"2024-09-22T08:36:23.979548+0000","last_became_peered":"2024-09-22T08:36:23.979548+0000","last_unstale":"2024-09-22T08:40:01.295930+0000","last_undegraded":"2024-09-22T08:40:01.295930+0000","last_fullsized":"2024-09-22T08:40:01.295930+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:01.295827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:01.295827+0000","last_clean_scrub_stamp":"2024-09-22T08:40:01.295827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:46:58.524286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"32'16","reported_seq":67,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:08.426849+0000","last_change":"2024-09-22T08:40:08.426849+0000","last_active":"2024-09-22T08:40:08.426849+0000","last_peered":"2024-09-22T08:40:08.426849+0000","last_clean":"2024-09-22T08:40:08.426849+0000","last_became_active":"2024-09-22T08:36:25.979965+0000","last_became_peered":"2024-09-22T08:36:25.979965+0000","last_unstale":"2024-09-22T08:40:08.426849+0000","last_undegraded":"2024-09-22T08:40:08.426849+0000","last_fullsized":"2024-09-22T08:40:08.426849+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'16","last_scrub_stamp":"2024-09-22T08:40:08.426756+0000","last_deep_scrub":"32'16","last_deep_scrub_stamp":"2024-09-22T08:40:08.426756+0000","last_clean_scrub_stamp":"2024-09-22T08:40:08.426756+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:00:38.752121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":51,"num_write":22,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:02.303092+0000","last_change":"2024-09-22T08:40:02.303092+0000","last_active":"2024-09-22T08:40:02.303092+0000","last_peered":"2024-09-22T08:40:02.303092+0000","last_clean":"2024-09-22T08:40:02.303092+0000","last_became_active":"2024-09-22T08:36:23.978225+0000","last_became_peered":"2024-09-22T08:36:23.978225+0000","last_unstale":"2024-09-22T08:40:02.303092+0000","last_undegraded":"2024-09-22T08:40:02.303092+0000","last_fullsized":"2024-09-22T08:40:02.303092+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-22T08:40:02.302998+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-22T08:40:02.302998+0000","last_clean_scrub_stamp":"2024-09-22T08:40:02.302998+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:19:57.676393+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"32'6","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:21.569303+0000","last_change":"2024-09-22T08:40:21.569303+0000","last_active":"2024-09-22T08:40:21.569303+0000","last_peered":"2024-09-22T08:40:21.569303+0000","last_clean":"2024-09-22T08:40:21.569303+0000","last_became_active":"2024-09-22T08:36:25.990690+0000","last_became_peered":"2024-09-22T08:36:25.990690+0000","last_unstale":"2024-09-22T08:40:21.569303+0000","last_undegraded":"2024-09-22T08:40:21.569303+0000","last_fullsized":"2024-09-22T08:40:21.569303+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-22T08:40:21.569206+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-22T08:40:21.569206+0000","last_clean_scrub_stamp":"2024-09-22T08:40:21.569206+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:25:32.682806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:53.617208+0000","last_change":"2024-09-22T08:39:53.617208+0000","last_active":"2024-09-22T08:39:53.617208+0000","last_peered":"2024-09-22T08:39:53.617208+0000","last_clean":"2024-09-22T08:39:53.617208+0000","last_became_active":"2024-09-22T08:36:23.973976+0000","last_became_peered":"2024-09-22T08:36:23.973976+0000","last_unstale":"2024-09-22T08:39:53.617208+0000","last_undegraded":"2024-09-22T08:39:53.617208+0000","last_fullsized":"2024-09-22T08:39:53.617208+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:39:53.617119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:39:53.617119+0000","last_clean_scrub_stamp":"2024-09-22T08:39:53.617119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:07:03.861422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"32'2","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:07.399420+0000","last_change":"2024-09-22T08:40:07.399420+0000","last_active":"2024-09-22T08:40:07.399420+0000","last_peered":"2024-09-22T08:40:07.399420+0000","last_clean":"2024-09-22T08:40:07.399420+0000","last_became_active":"2024-09-22T08:36:25.975794+0000","last_became_peered":"2024-09-22T08:36:25.975794+0000","last_unstale":"2024-09-22T08:40:07.399420+0000","last_undegraded":"2024-09-22T08:40:07.399420+0000","last_fullsized":"2024-09-22T08:40:07.399420+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-22T08:40:07.399339+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-22T08:40:07.399339+0000","last_clean_scrub_stamp":"2024-09-22T08:40:07.399339+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:48:57.554466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"32'2","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:03.266087+0000","last_change":"2024-09-22T08:40:03.266087+0000","last_active":"2024-09-22T08:40:03.266087+0000","last_peered":"2024-09-22T08:40:03.266087+0000","last_clean":"2024-09-22T08:40:03.266087+0000","last_became_active":"2024-09-22T08:36:23.982376+0000","last_became_peered":"2024-09-22T08:36:23.982376+0000","last_unstale":"2024-09-22T08:40:03.266087+0000","last_undegraded":"2024-09-22T08:40:03.266087+0000","last_fullsized":"2024-09-22T08:40:03.266087+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-22T08:40:03.265985+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-22T08:40:03.265985+0000","last_clean_scrub_stamp":"2024-09-22T08:40:03.265985+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:02:58.569511+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:05.287659+0000","last_change":"2024-09-22T08:40:05.287659+0000","last_active":"2024-09-22T08:40:05.287659+0000","last_peered":"2024-09-22T08:40:05.287659+0000","last_clean":"2024-09-22T08:40:05.287659+0000","last_became_active":"2024-09-22T08:36:23.978787+0000","last_became_peered":"2024-09-22T08:36:23.978787+0000","last_unstale":"2024-09-22T08:40:05.287659+0000","last_undegraded":"2024-09-22T08:40:05.287659+0000","last_fullsized":"2024-09-22T08:40:05.287659+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:05.287568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:05.287568+0000","last_clean_scrub_stamp":"2024-09-22T08:40:05.287568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:59:39.200932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"32'8","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:10.872172+0000","last_change":"2024-09-22T08:40:10.872172+0000","last_active":"2024-09-22T08:40:10.872172+0000","last_peered":"2024-09-22T08:40:10.872172+0000","last_clean":"2024-09-22T08:40:10.872172+0000","last_became_active":"2024-09-22T08:36:25.979593+0000","last_became_peered":"2024-09-22T08:36:25.979593+0000","last_unstale":"2024-09-22T08:40:10.872172+0000","last_undegraded":"2024-09-22T08:40:10.872172+0000","last_fullsized":"2024-09-22T08:40:10.872172+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-22T08:40:10.872074+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-22T08:40:10.872074+0000","last_clean_scrub_stamp":"2024-09-22T08:40:10.872074+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:25:45.090218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:55.878768+0000","last_change":"2024-09-22T08:39:55.878768+0000","last_active":"2024-09-22T08:39:55.878768+0000","last_peered":"2024-09-22T08:39:55.878768+0000","last_clean":"2024-09-22T08:39:55.878768+0000","last_became_active":"2024-09-22T08:36:23.974202+0000","last_became_peered":"2024-09-22T08:36:23.974202+0000","last_unstale":"2024-09-22T08:39:55.878768+0000","last_undegraded":"2024-09-22T08:39:55.878768+0000","last_fullsized":"2024-09-22T08:39:55.878768+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:39:55.878679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:39:55.878679+0000","last_clean_scrub_stamp":"2024-09-22T08:39:55.878679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:42:02.792761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"32'14","reported_seq":87,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:16.311548+0000","last_change":"2024-09-22T08:40:16.311548+0000","last_active":"2024-09-22T08:40:16.311548+0000","last_peered":"2024-09-22T08:40:16.311548+0000","last_clean":"2024-09-22T08:40:16.311548+0000","last_became_active":"2024-09-22T08:37:04.233241+0000","last_became_peered":"2024-09-22T08:37:04.233241+0000","last_unstale":"2024-09-22T08:40:16.311548+0000","last_undegraded":"2024-09-22T08:40:16.311548+0000","last_fullsized":"2024-09-22T08:40:16.311548+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'14","last_scrub_stamp":"2024-09-22T08:40:16.311459+0000","last_deep_scrub":"32'14","last_deep_scrub_stamp":"2024-09-22T08:40:16.311459+0000","last_clean_scrub_stamp":"2024-09-22T08:40:16.311459+0000","objects_scrubbed":1,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:43:58.325817+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":47,"num_read_kb":43,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1549,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":690,"num_read_kb":658,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":180,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":272,"ondisk_log_size":272,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2287,"ondisk_log_size":2287,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1600,"num_read_kb":1397,"num_write":597,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1730,"num_omap_keys":8,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1524,"ondisk_log_size":1524,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19,"ondisk_log_size":19,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1672,"num_read_kb":1562,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":482,"ondisk_log_size":482,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":177,"num_read_kb":83,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":128,"acting":128,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":11,"seq":47244640315,"num_pgs":124,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40472,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331368,"statfs":{"total":96636764160,"available":96595320832,"internally_reserved":0,"allocated":991232,"data_stored":726145,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640315,"num_pgs":119,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36324,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335516,"statfs":{"total":96636764160,"available":96599568384,"internally_reserved":0,"allocated":1003520,"data_stored":724639,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":9,"seq":38654705722,"num_pgs":152,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39960,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331880,"statfs":{"total":96636764160,"available":96595845120,"internally_reserved":0,"allocated":466944,"data_stored":138067,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705722,"num_pgs":135,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39916,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331924,"statfs":{"total":96636764160,"available":96595890176,"internally_reserved":0,"allocated":421888,"data_stored":135213,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":325,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":421,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T08:40:44.801 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-22T08:36:32.990486+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:44.801 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-09-22T08:36:28.972630+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=28, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:44.801 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-22T08:36:32.990486+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:44.801 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-22T08:36:32.990486+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:44.802 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-22T08:36:30.982878+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=30, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:44.802 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-09-22T08:36:32.990486+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:44.802 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-09-22T08:36:28.972630+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=28, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:44.802 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-09-22T08:36:30.982878+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=30, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:44.802 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-22T08:36:32.990486+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:44.803 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-22T08:36:30.982878+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=30, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:44.803 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-22T08:36:32.990486+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:44.803 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-22T08:36:32.990486+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:44.804 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-09-22T08:36:30.982878+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=30, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:44.804 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-22T08:36:32.990486+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:44.804 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-22T08:36:32.990486+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:44.804 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-22T08:36:32.990486+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:44.804 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-09-22T08:36:28.972630+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=28, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:44.804 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-09-22T08:36:30.982878+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=30, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:44.805 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-22T08:36:32.990486+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:44.805 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-22T08:36:32.990486+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:44.805 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-22T08:36:32.990486+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:44.805 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-09-22T08:36:28.972630+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=28, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:44.805 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-22T08:36:32.990486+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:44.805 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-22T08:36:32.990486+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:44.806 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-09-22T08:36:28.972630+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=28, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:44.806 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-22T08:36:32.990486+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:44.806 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-22T08:36:32.990486+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:44.806 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-22T08:36:30.982878+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=30, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:44.806 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-22T08:36:32.990486+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:44.806 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-09-22T08:36:28.972630+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=28, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:44.806 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-22T08:36:30.982878+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=30, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:44.807 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-22T08:36:32.990486+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:44.807 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-09-22T08:36:28.972630+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=28, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:44.807 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-22T08:36:32.990486+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:40:44.808 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-22T08:41:04.808 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T08:41:04.924 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:41:04.921+0000 7fbb7515d640 1 Processor -- start 2024-09-22T08:41:04.924 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:41:04.921+0000 7fbb7515d640 1 -- start start 2024-09-22T08:41:04.924 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:41:04.922+0000 7fbb7515d640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fbb7006e8e0 0x7fbb7006ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:41:04.924 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:41:04.922+0000 7fbb7515d640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb7006ff50 con 0x7fbb7006f200 2024-09-22T08:41:04.924 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:41:04.922+0000 7fbb7515d640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7fbb70099c10 con 0x7fbb7006e8e0 2024-09-22T08:41:04.924 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:41:04.922+0000 7fbb6ed9d640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fbb7006e8e0 0x7fbb7006ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:41:04.925 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:41:04.922+0000 7fbb6e59c640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fbb7006f200 0x7fbb7012f650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:36058/0 (socket says 172.21.15.31:36058) 2024-09-22T08:41:04.925 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:41:04.922+0000 7fbb6e59c640 1 -- 172.21.15.31:0/3741139204 learned_addr learned my addr 172.21.15.31:0/3741139204 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-22T08:41:04.925 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:41:04.922+0000 7fbb6ed9d640 1 -- 172.21.15.31:0/3741139204 >> v1:172.21.15.31:6789/0 conn(0x7fbb7006f200 legacy=0x7fbb7012f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:41:04.925 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:41:04.922+0000 7fbb6ed9d640 1 -- 172.21.15.31:0/3741139204 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb70099710 con 0x7fbb7006e8e0 2024-09-22T08:41:04.925 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:41:04.922+0000 7fbb6dd9b640 1 -- 172.21.15.31:0/3741139204 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 476199889 0 0) 0x7fbb7006ff50 con 0x7fbb7006f200 2024-09-22T08:41:04.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:41:04.923+0000 7fbb6ed9d640 1 --2- 172.21.15.31:0/3741139204 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbb7006e8e0 0x7fbb7006ecc0 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7fbb60009720 tx=0x7fbb6002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43f7151b153bc11 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:41:04.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:41:04.923+0000 7fbb6dd9b640 1 -- 172.21.15.31:0/3741139204 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb60037070 con 0x7fbb7006e8e0 2024-09-22T08:41:04.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:41:04.923+0000 7fbb6dd9b640 1 -- 172.21.15.31:0/3741139204 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb6002ae20 con 0x7fbb7006e8e0 2024-09-22T08:41:04.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:41:04.923+0000 7fbb6dd9b640 1 -- 172.21.15.31:0/3741139204 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb60032590 con 0x7fbb7006e8e0 2024-09-22T08:41:04.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:41:04.924+0000 7fbb7515d640 1 -- 172.21.15.31:0/3741139204 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbb7006e8e0 msgr2=0x7fbb7006ecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:41:04.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:41:04.924+0000 7fbb7515d640 1 --2- 172.21.15.31:0/3741139204 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbb7006e8e0 0x7fbb7006ecc0 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7fbb60009720 tx=0x7fbb6002a1a0 comp rx=0 tx=0).stop 2024-09-22T08:41:04.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:41:04.924+0000 7fbb7515d640 1 -- 172.21.15.31:0/3741139204 shutdown_connections 2024-09-22T08:41:04.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:41:04.924+0000 7fbb7515d640 1 --2- 172.21.15.31:0/3741139204 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbb7006e8e0 0x7fbb7006ecc0 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:41:04.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:41:04.924+0000 7fbb7515d640 1 -- 172.21.15.31:0/3741139204 >> 172.21.15.31:0/3741139204 conn(0x7fbb700a01c0 msgr2=0x7fbb700a05d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:41:04.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:41:04.924+0000 7fbb7515d640 1 -- 172.21.15.31:0/3741139204 shutdown_connections 2024-09-22T08:41:04.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:41:04.924+0000 7fbb7515d640 1 -- 172.21.15.31:0/3741139204 wait complete. 2024-09-22T08:41:04.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:41:04.925+0000 7fbb7515d640 1 Processor -- start 2024-09-22T08:41:04.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:41:04.925+0000 7fbb7515d640 1 -- start start 2024-09-22T08:41:04.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:41:04.925+0000 7fbb7515d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbb7006e8e0 0x7fbb7008cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:41:04.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:41:04.925+0000 7fbb7515d640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fbb701300f0 con 0x7fbb7006e8e0 2024-09-22T08:41:04.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:41:04.926+0000 7fbb6ed9d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbb7006e8e0 0x7fbb7008cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:41:04.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:41:04.926+0000 7fbb6ed9d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbb7006e8e0 0x7fbb7008cb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:57818/0 (socket says 172.21.15.31:57818) 2024-09-22T08:41:04.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:41:04.926+0000 7fbb6ed9d640 1 -- 172.21.15.31:0/2750519197 learned_addr learned my addr 172.21.15.31:0/2750519197 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-22T08:41:04.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:41:04.926+0000 7fbb6ed9d640 1 -- 172.21.15.31:0/2750519197 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb7008e150 con 0x7fbb7006e8e0 2024-09-22T08:41:04.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:41:04.926+0000 7fbb6ed9d640 1 --2- 172.21.15.31:0/2750519197 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbb7006e8e0 0x7fbb7008cb90 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7fbb6002adf0 tx=0x7fbb600046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:41:04.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:41:04.926+0000 7fbb677fe640 1 -- 172.21.15.31:0/2750519197 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb60042070 con 0x7fbb7006e8e0 2024-09-22T08:41:04.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:41:04.926+0000 7fbb677fe640 1 -- 172.21.15.31:0/2750519197 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb6003e590 con 0x7fbb7006e8e0 2024-09-22T08:41:04.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:41:04.926+0000 7fbb677fe640 1 -- 172.21.15.31:0/2750519197 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb60037040 con 0x7fbb7006e8e0 2024-09-22T08:41:04.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:41:04.926+0000 7fbb7515d640 1 -- 172.21.15.31:0/2750519197 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb7008f280 con 0x7fbb7006e8e0 2024-09-22T08:41:04.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:41:04.926+0000 7fbb7515d640 1 -- 172.21.15.31:0/2750519197 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb7008d2b0 con 0x7fbb7006e8e0 2024-09-22T08:41:04.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:41:04.927+0000 7fbb677fe640 1 -- 172.21.15.31:0/2750519197 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fbb60045070 con 0x7fbb7006e8e0 2024-09-22T08:41:04.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:41:04.927+0000 7fbb7515d640 1 -- 172.21.15.31:0/2750519197 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb7006ecc0 con 0x7fbb7006e8e0 2024-09-22T08:41:04.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:41:04.928+0000 7fbb677fe640 1 --2- 172.21.15.31:0/2750519197 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fbb5003e710 0x7fbb50040bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:41:04.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:41:04.928+0000 7fbb677fe640 1 -- 172.21.15.31:0/2750519197 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5938+0+0 (secure 0 0 0) 0x7fbb60074180 con 0x7fbb7006e8e0 2024-09-22T08:41:04.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:41:04.928+0000 7fbb6e59c640 1 --2- 172.21.15.31:0/2750519197 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fbb5003e710 0x7fbb50040bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:41:04.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:41:04.928+0000 7fbb6e59c640 1 --2- 172.21.15.31:0/2750519197 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fbb5003e710 0x7fbb50040bd0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fbb58000c00 tx=0x7fbb580078d0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:41:04.933 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:41:04.932+0000 7fbb677fe640 1 -- 172.21.15.31:0/2750519197 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fbb6003c430 con 0x7fbb7006e8e0 2024-09-22T08:41:05.117 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:41:05.115+0000 7fbb7515d640 1 -- 172.21.15.31:0/2750519197 --> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fbb70129f90 con 0x7fbb5003e710 2024-09-22T08:41:05.128 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:41:05.126+0000 7fbb677fe640 1 -- 172.21.15.31:0/2750519197 <== mgr.4099 v2:172.21.15.142:6824/99931088 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665925 (secure 0 0 0) 0x7fbb70129f90 con 0x7fbb5003e710 2024-09-22T08:41:05.138 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-22T08:41:05.144 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2024-09-22T08:41:05.146 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:41:05.132+0000 7fbb7515d640 1 -- 172.21.15.31:0/2750519197 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fbb5003e710 msgr2=0x7fbb50040bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:41:05.146 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:41:05.132+0000 7fbb7515d640 1 --2- 172.21.15.31:0/2750519197 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fbb5003e710 0x7fbb50040bd0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fbb58000c00 tx=0x7fbb580078d0 comp rx=0 tx=0).stop 2024-09-22T08:41:05.146 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:41:05.132+0000 7fbb7515d640 1 -- 172.21.15.31:0/2750519197 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbb7006e8e0 msgr2=0x7fbb7008cb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:41:05.146 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:41:05.132+0000 7fbb7515d640 1 --2- 172.21.15.31:0/2750519197 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbb7006e8e0 0x7fbb7008cb90 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7fbb6002adf0 tx=0x7fbb600046c0 comp rx=0 tx=0).stop 2024-09-22T08:41:05.147 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:41:05.132+0000 7fbb7515d640 1 -- 172.21.15.31:0/2750519197 shutdown_connections 2024-09-22T08:41:05.147 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:41:05.132+0000 7fbb7515d640 1 --2- 172.21.15.31:0/2750519197 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fbb5003e710 0x7fbb50040bd0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:41:05.147 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:41:05.132+0000 7fbb7515d640 1 --2- 172.21.15.31:0/2750519197 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbb7006e8e0 0x7fbb7008cb90 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:41:05.147 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:41:05.132+0000 7fbb7515d640 1 -- 172.21.15.31:0/2750519197 >> 172.21.15.31:0/2750519197 conn(0x7fbb700a01c0 msgr2=0x7fbb7009da60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:41:05.147 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:41:05.132+0000 7fbb7515d640 1 -- 172.21.15.31:0/2750519197 shutdown_connections 2024-09-22T08:41:05.147 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:41:05.132+0000 7fbb7515d640 1 -- 172.21.15.31:0/2750519197 wait complete. 2024-09-22T08:41:05.148 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":177,"stamp":"2024-09-22T08:41:03.233208+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605410,"num_objects":222,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":222,"num_whiteouts":0,"num_read":5177,"num_read_kb":4727,"num_write":2121,"num_write_kb":60587,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3349,"num_omap_keys":16,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4783,"ondisk_log_size":4783,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":156672,"kb_used_data":2816,"kb_used_omap":6,"kb_used_meta":153785,"kb_avail":377330688,"statfs":{"total":386547056640,"available":386386624512,"internally_reserved":0,"allocated":2883584,"data_stored":1724064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":157476630},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1270,"num_omap_keys":6,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003988"},"pg_stats":[{"pgid":"3.3f","version":"30'4","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:04.369185+0000","last_change":"2024-09-22T08:40:04.369118+0000","last_active":"2024-09-22T08:40:04.369185+0000","last_peered":"2024-09-22T08:40:04.369185+0000","last_clean":"2024-09-22T08:40:04.369185+0000","last_became_active":"2024-09-22T08:36:23.978473+0000","last_became_peered":"2024-09-22T08:36:23.978473+0000","last_unstale":"2024-09-22T08:40:04.369185+0000","last_undegraded":"2024-09-22T08:40:04.369185+0000","last_fullsized":"2024-09-22T08:40:04.369185+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'4","last_scrub_stamp":"2024-09-22T08:40:04.369030+0000","last_deep_scrub":"30'4","last_deep_scrub_stamp":"2024-09-22T08:40:04.369030+0000","last_clean_scrub_stamp":"2024-09-22T08:40:04.369030+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:39:45.475667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":7,"num_write":20,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"30'4","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:15.337474+0000","last_change":"2024-09-22T08:40:15.337474+0000","last_active":"2024-09-22T08:40:15.337474+0000","last_peered":"2024-09-22T08:40:15.337474+0000","last_clean":"2024-09-22T08:40:15.337474+0000","last_became_active":"2024-09-22T08:36:25.981849+0000","last_became_peered":"2024-09-22T08:36:25.981849+0000","last_unstale":"2024-09-22T08:40:15.337474+0000","last_undegraded":"2024-09-22T08:40:15.337474+0000","last_fullsized":"2024-09-22T08:40:15.337474+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'4","last_scrub_stamp":"2024-09-22T08:40:15.337386+0000","last_deep_scrub":"30'4","last_deep_scrub_stamp":"2024-09-22T08:40:15.337386+0000","last_clean_scrub_stamp":"2024-09-22T08:40:15.337386+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:47:30.055490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:58.826260+0000","last_change":"2024-09-22T08:39:58.826192+0000","last_active":"2024-09-22T08:39:58.826260+0000","last_peered":"2024-09-22T08:39:58.826260+0000","last_clean":"2024-09-22T08:39:58.826260+0000","last_became_active":"2024-09-22T08:36:23.973596+0000","last_became_peered":"2024-09-22T08:36:23.973596+0000","last_unstale":"2024-09-22T08:39:58.826260+0000","last_undegraded":"2024-09-22T08:39:58.826260+0000","last_fullsized":"2024-09-22T08:39:58.826260+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:39:58.826106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:39:58.826106+0000","last_clean_scrub_stamp":"2024-09-22T08:39:58.826106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:25:37.176757+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"32'2","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:24.586403+0000","last_change":"2024-09-22T08:40:24.586403+0000","last_active":"2024-09-22T08:40:24.586403+0000","last_peered":"2024-09-22T08:40:24.586403+0000","last_clean":"2024-09-22T08:40:24.586403+0000","last_became_active":"2024-09-22T08:36:25.992150+0000","last_became_peered":"2024-09-22T08:36:25.992150+0000","last_unstale":"2024-09-22T08:40:24.586403+0000","last_undegraded":"2024-09-22T08:40:24.586403+0000","last_fullsized":"2024-09-22T08:40:24.586403+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-22T08:40:24.586282+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-22T08:40:24.586282+0000","last_clean_scrub_stamp":"2024-09-22T08:40:24.586282+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:58:38.922872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:08.374304+0000","last_change":"2024-09-22T08:40:08.374230+0000","last_active":"2024-09-22T08:40:08.374304+0000","last_peered":"2024-09-22T08:40:08.374304+0000","last_clean":"2024-09-22T08:40:08.374304+0000","last_became_active":"2024-09-22T08:36:23.982860+0000","last_became_peered":"2024-09-22T08:36:23.982860+0000","last_unstale":"2024-09-22T08:40:08.374304+0000","last_undegraded":"2024-09-22T08:40:08.374304+0000","last_fullsized":"2024-09-22T08:40:08.374304+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:08.374142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:08.374142+0000","last_clean_scrub_stamp":"2024-09-22T08:40:08.374142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:54:23.652205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:26.577931+0000","last_change":"2024-09-22T08:40:26.577931+0000","last_active":"2024-09-22T08:40:26.577931+0000","last_peered":"2024-09-22T08:40:26.577931+0000","last_clean":"2024-09-22T08:40:26.577931+0000","last_became_active":"2024-09-22T08:36:25.992356+0000","last_became_peered":"2024-09-22T08:36:25.992356+0000","last_unstale":"2024-09-22T08:40:26.577931+0000","last_undegraded":"2024-09-22T08:40:26.577931+0000","last_fullsized":"2024-09-22T08:40:26.577931+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:26.577817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:26.577817+0000","last_clean_scrub_stamp":"2024-09-22T08:40:26.577817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:42:11.037421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:58.533124+0000","last_change":"2024-09-22T08:39:58.533060+0000","last_active":"2024-09-22T08:39:58.533124+0000","last_peered":"2024-09-22T08:39:58.533124+0000","last_clean":"2024-09-22T08:39:58.533124+0000","last_became_active":"2024-09-22T08:36:23.967096+0000","last_became_peered":"2024-09-22T08:36:23.967096+0000","last_unstale":"2024-09-22T08:39:58.533124+0000","last_undegraded":"2024-09-22T08:39:58.533124+0000","last_fullsized":"2024-09-22T08:39:58.533124+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:39:58.532978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:39:58.532978+0000","last_clean_scrub_stamp":"2024-09-22T08:39:58.532978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:58:12.874966+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"32'22","reported_seq":103,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:25.549835+0000","last_change":"2024-09-22T08:40:25.549835+0000","last_active":"2024-09-22T08:40:25.549835+0000","last_peered":"2024-09-22T08:40:25.549835+0000","last_clean":"2024-09-22T08:40:25.549835+0000","last_became_active":"2024-09-22T08:36:25.989065+0000","last_became_peered":"2024-09-22T08:36:25.989065+0000","last_unstale":"2024-09-22T08:40:25.549835+0000","last_undegraded":"2024-09-22T08:40:25.549835+0000","last_fullsized":"2024-09-22T08:40:25.549835+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'22","last_scrub_stamp":"2024-09-22T08:40:25.549736+0000","last_deep_scrub":"32'22","last_deep_scrub_stamp":"2024-09-22T08:40:25.549736+0000","last_clean_scrub_stamp":"2024-09-22T08:40:25.549736+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:20:55.359657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":82,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:06.332632+0000","last_change":"2024-09-22T08:40:06.332632+0000","last_active":"2024-09-22T08:40:06.332632+0000","last_peered":"2024-09-22T08:40:06.332632+0000","last_clean":"2024-09-22T08:40:06.332632+0000","last_became_active":"2024-09-22T08:36:23.978766+0000","last_became_peered":"2024-09-22T08:36:23.978766+0000","last_unstale":"2024-09-22T08:40:06.332632+0000","last_undegraded":"2024-09-22T08:40:06.332632+0000","last_fullsized":"2024-09-22T08:40:06.332632+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:06.332545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:06.332545+0000","last_clean_scrub_stamp":"2024-09-22T08:40:06.332545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:25:05.583350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"32'8","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:17.301333+0000","last_change":"2024-09-22T08:40:17.301230+0000","last_active":"2024-09-22T08:40:17.301333+0000","last_peered":"2024-09-22T08:40:17.301333+0000","last_clean":"2024-09-22T08:40:17.301333+0000","last_became_active":"2024-09-22T08:36:25.978937+0000","last_became_peered":"2024-09-22T08:36:25.978937+0000","last_unstale":"2024-09-22T08:40:17.301333+0000","last_undegraded":"2024-09-22T08:40:17.301333+0000","last_fullsized":"2024-09-22T08:40:17.301333+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-22T08:40:17.301118+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-22T08:40:17.301118+0000","last_clean_scrub_stamp":"2024-09-22T08:40:17.301118+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:02:08.767907+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":23,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"32'4","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:01.435460+0000","last_change":"2024-09-22T08:40:01.435460+0000","last_active":"2024-09-22T08:40:01.435460+0000","last_peered":"2024-09-22T08:40:01.435460+0000","last_clean":"2024-09-22T08:40:01.435460+0000","last_became_active":"2024-09-22T08:36:23.967168+0000","last_became_peered":"2024-09-22T08:36:23.967168+0000","last_unstale":"2024-09-22T08:40:01.435460+0000","last_undegraded":"2024-09-22T08:40:01.435460+0000","last_fullsized":"2024-09-22T08:40:01.435460+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-22T08:40:01.435370+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-22T08:40:01.435370+0000","last_clean_scrub_stamp":"2024-09-22T08:40:01.435370+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:31:33.320075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":10,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"32'6","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:27.601737+0000","last_change":"2024-09-22T08:40:27.601635+0000","last_active":"2024-09-22T08:40:27.601737+0000","last_peered":"2024-09-22T08:40:27.601737+0000","last_clean":"2024-09-22T08:40:27.601737+0000","last_became_active":"2024-09-22T08:36:25.990727+0000","last_became_peered":"2024-09-22T08:36:25.990727+0000","last_unstale":"2024-09-22T08:40:27.601737+0000","last_undegraded":"2024-09-22T08:40:27.601737+0000","last_fullsized":"2024-09-22T08:40:27.601737+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-22T08:40:27.601539+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-22T08:40:27.601539+0000","last_clean_scrub_stamp":"2024-09-22T08:40:27.601539+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:14:55.668548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:04.247350+0000","last_change":"2024-09-22T08:40:04.247350+0000","last_active":"2024-09-22T08:40:04.247350+0000","last_peered":"2024-09-22T08:40:04.247350+0000","last_clean":"2024-09-22T08:40:04.247350+0000","last_became_active":"2024-09-22T08:36:23.980446+0000","last_became_peered":"2024-09-22T08:36:23.980446+0000","last_unstale":"2024-09-22T08:40:04.247350+0000","last_undegraded":"2024-09-22T08:40:04.247350+0000","last_fullsized":"2024-09-22T08:40:04.247350+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:04.247231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:04.247231+0000","last_clean_scrub_stamp":"2024-09-22T08:40:04.247231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:03:00.194431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"32'8","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:06.366503+0000","last_change":"2024-09-22T08:40:06.366446+0000","last_active":"2024-09-22T08:40:06.366503+0000","last_peered":"2024-09-22T08:40:06.366503+0000","last_clean":"2024-09-22T08:40:06.366503+0000","last_became_active":"2024-09-22T08:36:25.982217+0000","last_became_peered":"2024-09-22T08:36:25.982217+0000","last_unstale":"2024-09-22T08:40:06.366503+0000","last_undegraded":"2024-09-22T08:40:06.366503+0000","last_fullsized":"2024-09-22T08:40:06.366503+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-22T08:40:06.366369+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-22T08:40:06.366369+0000","last_clean_scrub_stamp":"2024-09-22T08:40:06.366369+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:25:30.349302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":27,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:57.845968+0000","last_change":"2024-09-22T08:39:57.845968+0000","last_active":"2024-09-22T08:39:57.845968+0000","last_peered":"2024-09-22T08:39:57.845968+0000","last_clean":"2024-09-22T08:39:57.845968+0000","last_became_active":"2024-09-22T08:36:23.977715+0000","last_became_peered":"2024-09-22T08:36:23.977715+0000","last_unstale":"2024-09-22T08:39:57.845968+0000","last_undegraded":"2024-09-22T08:39:57.845968+0000","last_fullsized":"2024-09-22T08:39:57.845968+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-22T08:39:57.845879+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-22T08:39:57.845879+0000","last_clean_scrub_stamp":"2024-09-22T08:39:57.845879+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:42:05.377364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"32'8","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:09.396348+0000","last_change":"2024-09-22T08:40:09.396278+0000","last_active":"2024-09-22T08:40:09.396348+0000","last_peered":"2024-09-22T08:40:09.396348+0000","last_clean":"2024-09-22T08:40:09.396348+0000","last_became_active":"2024-09-22T08:36:25.974930+0000","last_became_peered":"2024-09-22T08:36:25.974930+0000","last_unstale":"2024-09-22T08:40:09.396348+0000","last_undegraded":"2024-09-22T08:40:09.396348+0000","last_fullsized":"2024-09-22T08:40:09.396348+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-22T08:40:09.396197+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-22T08:40:09.396197+0000","last_clean_scrub_stamp":"2024-09-22T08:40:09.396197+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:50:08.671881+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"32'4","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:23.597042+0000","last_change":"2024-09-22T08:40:23.597042+0000","last_active":"2024-09-22T08:40:23.597042+0000","last_peered":"2024-09-22T08:40:23.597042+0000","last_clean":"2024-09-22T08:40:23.597042+0000","last_became_active":"2024-09-22T08:36:25.991870+0000","last_became_peered":"2024-09-22T08:36:25.991870+0000","last_unstale":"2024-09-22T08:40:23.597042+0000","last_undegraded":"2024-09-22T08:40:23.597042+0000","last_fullsized":"2024-09-22T08:40:23.597042+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-22T08:40:23.596954+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-22T08:40:23.596954+0000","last_clean_scrub_stamp":"2024-09-22T08:40:23.596954+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:00:06.490632+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:57.283661+0000","last_change":"2024-09-22T08:39:57.283661+0000","last_active":"2024-09-22T08:39:57.283661+0000","last_peered":"2024-09-22T08:39:57.283661+0000","last_clean":"2024-09-22T08:39:57.283661+0000","last_became_active":"2024-09-22T08:36:23.977556+0000","last_became_peered":"2024-09-22T08:36:23.977556+0000","last_unstale":"2024-09-22T08:39:57.283661+0000","last_undegraded":"2024-09-22T08:39:57.283661+0000","last_fullsized":"2024-09-22T08:39:57.283661+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:39:57.283537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:39:57.283537+0000","last_clean_scrub_stamp":"2024-09-22T08:39:57.283537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:31:33.140772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"32'14","reported_seq":80,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:11.433190+0000","last_change":"2024-09-22T08:40:11.433190+0000","last_active":"2024-09-22T08:40:11.433190+0000","last_peered":"2024-09-22T08:40:11.433190+0000","last_clean":"2024-09-22T08:40:11.433190+0000","last_became_active":"2024-09-22T08:36:25.976389+0000","last_became_peered":"2024-09-22T08:36:25.976389+0000","last_unstale":"2024-09-22T08:40:11.433190+0000","last_undegraded":"2024-09-22T08:40:11.433190+0000","last_fullsized":"2024-09-22T08:40:11.433190+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'14","last_scrub_stamp":"2024-09-22T08:40:11.433107+0000","last_deep_scrub":"32'14","last_deep_scrub_stamp":"2024-09-22T08:40:11.433107+0000","last_clean_scrub_stamp":"2024-09-22T08:40:11.433107+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:20:10.105300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":49,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"32'2","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:57.549716+0000","last_change":"2024-09-22T08:39:57.549716+0000","last_active":"2024-09-22T08:39:57.549716+0000","last_peered":"2024-09-22T08:39:57.549716+0000","last_clean":"2024-09-22T08:39:57.549716+0000","last_became_active":"2024-09-22T08:36:23.974275+0000","last_became_peered":"2024-09-22T08:36:23.974275+0000","last_unstale":"2024-09-22T08:39:57.549716+0000","last_undegraded":"2024-09-22T08:39:57.549716+0000","last_fullsized":"2024-09-22T08:39:57.549716+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-22T08:39:57.549604+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-22T08:39:57.549604+0000","last_clean_scrub_stamp":"2024-09-22T08:39:57.549604+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:02:09.510635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"32'14","reported_seq":74,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:12.409862+0000","last_change":"2024-09-22T08:40:12.409862+0000","last_active":"2024-09-22T08:40:12.409862+0000","last_peered":"2024-09-22T08:40:12.409862+0000","last_clean":"2024-09-22T08:40:12.409862+0000","last_became_active":"2024-09-22T08:36:25.977015+0000","last_became_peered":"2024-09-22T08:36:25.977015+0000","last_unstale":"2024-09-22T08:40:12.409862+0000","last_undegraded":"2024-09-22T08:40:12.409862+0000","last_fullsized":"2024-09-22T08:40:12.409862+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'14","last_scrub_stamp":"2024-09-22T08:40:12.409763+0000","last_deep_scrub":"32'14","last_deep_scrub_stamp":"2024-09-22T08:40:12.409763+0000","last_clean_scrub_stamp":"2024-09-22T08:40:12.409763+0000","objects_scrubbed":2,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:14:30.930010+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":43,"num_read_kb":39,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:55.220138+0000","last_change":"2024-09-22T08:39:55.220138+0000","last_active":"2024-09-22T08:39:55.220138+0000","last_peered":"2024-09-22T08:39:55.220138+0000","last_clean":"2024-09-22T08:39:55.220138+0000","last_became_active":"2024-09-22T08:36:23.984411+0000","last_became_peered":"2024-09-22T08:36:23.984411+0000","last_unstale":"2024-09-22T08:39:55.220138+0000","last_undegraded":"2024-09-22T08:39:55.220138+0000","last_fullsized":"2024-09-22T08:39:55.220138+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-22T08:39:55.220017+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-22T08:39:55.220017+0000","last_clean_scrub_stamp":"2024-09-22T08:39:55.220017+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:52:34.074155+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"32'2","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:11.833416+0000","last_change":"2024-09-22T08:40:11.833416+0000","last_active":"2024-09-22T08:40:11.833416+0000","last_peered":"2024-09-22T08:40:11.833416+0000","last_clean":"2024-09-22T08:40:11.833416+0000","last_became_active":"2024-09-22T08:36:25.984037+0000","last_became_peered":"2024-09-22T08:36:25.984037+0000","last_unstale":"2024-09-22T08:40:11.833416+0000","last_undegraded":"2024-09-22T08:40:11.833416+0000","last_fullsized":"2024-09-22T08:40:11.833416+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-22T08:40:11.833329+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-22T08:40:11.833329+0000","last_clean_scrub_stamp":"2024-09-22T08:40:11.833329+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:13:05.009738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"32'2","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:56.237269+0000","last_change":"2024-09-22T08:39:56.237269+0000","last_active":"2024-09-22T08:39:56.237269+0000","last_peered":"2024-09-22T08:39:56.237269+0000","last_clean":"2024-09-22T08:39:56.237269+0000","last_became_active":"2024-09-22T08:36:23.969183+0000","last_became_peered":"2024-09-22T08:36:23.969183+0000","last_unstale":"2024-09-22T08:39:56.237269+0000","last_undegraded":"2024-09-22T08:39:56.237269+0000","last_fullsized":"2024-09-22T08:39:56.237269+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-22T08:39:56.237185+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-22T08:39:56.237185+0000","last_clean_scrub_stamp":"2024-09-22T08:39:56.237185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:26:53.537080+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"32'18","reported_seq":75,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:08.416216+0000","last_change":"2024-09-22T08:40:08.416216+0000","last_active":"2024-09-22T08:40:08.416216+0000","last_peered":"2024-09-22T08:40:08.416216+0000","last_clean":"2024-09-22T08:40:08.416216+0000","last_became_active":"2024-09-22T08:36:25.985797+0000","last_became_peered":"2024-09-22T08:36:25.985797+0000","last_unstale":"2024-09-22T08:40:08.416216+0000","last_undegraded":"2024-09-22T08:40:08.416216+0000","last_fullsized":"2024-09-22T08:40:08.416216+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'18","last_scrub_stamp":"2024-09-22T08:40:08.416117+0000","last_deep_scrub":"32'18","last_deep_scrub_stamp":"2024-09-22T08:40:08.416117+0000","last_clean_scrub_stamp":"2024-09-22T08:40:08.416117+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:55:55.096190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":61,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:56.863666+0000","last_change":"2024-09-22T08:39:56.863666+0000","last_active":"2024-09-22T08:39:56.863666+0000","last_peered":"2024-09-22T08:39:56.863666+0000","last_clean":"2024-09-22T08:39:56.863666+0000","last_became_active":"2024-09-22T08:36:23.974359+0000","last_became_peered":"2024-09-22T08:36:23.974359+0000","last_unstale":"2024-09-22T08:39:56.863666+0000","last_undegraded":"2024-09-22T08:39:56.863666+0000","last_fullsized":"2024-09-22T08:39:56.863666+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-22T08:39:56.863584+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-22T08:39:56.863584+0000","last_clean_scrub_stamp":"2024-09-22T08:39:56.863584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:41:23.122061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"32'16","reported_seq":70,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:13.382482+0000","last_change":"2024-09-22T08:40:13.382482+0000","last_active":"2024-09-22T08:40:13.382482+0000","last_peered":"2024-09-22T08:40:13.382482+0000","last_clean":"2024-09-22T08:40:13.382482+0000","last_became_active":"2024-09-22T08:36:25.977320+0000","last_became_peered":"2024-09-22T08:36:25.977320+0000","last_unstale":"2024-09-22T08:40:13.382482+0000","last_undegraded":"2024-09-22T08:40:13.382482+0000","last_fullsized":"2024-09-22T08:40:13.382482+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'16","last_scrub_stamp":"2024-09-22T08:40:13.382400+0000","last_deep_scrub":"32'16","last_deep_scrub_stamp":"2024-09-22T08:40:13.382400+0000","last_clean_scrub_stamp":"2024-09-22T08:40:13.382400+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:13:53.645578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":49,"num_write":21,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"32'2","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:07.381293+0000","last_change":"2024-09-22T08:40:07.381293+0000","last_active":"2024-09-22T08:40:07.381293+0000","last_peered":"2024-09-22T08:40:07.381293+0000","last_clean":"2024-09-22T08:40:07.381293+0000","last_became_active":"2024-09-22T08:36:23.980189+0000","last_became_peered":"2024-09-22T08:36:23.980189+0000","last_unstale":"2024-09-22T08:40:07.381293+0000","last_undegraded":"2024-09-22T08:40:07.381293+0000","last_fullsized":"2024-09-22T08:40:07.381293+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-22T08:40:07.381185+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-22T08:40:07.381185+0000","last_clean_scrub_stamp":"2024-09-22T08:40:07.381185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:45:20.018380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"32'36","reported_seq":109,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:45.350947+0000","last_change":"2024-09-22T08:40:45.350947+0000","last_active":"2024-09-22T08:40:45.350947+0000","last_peered":"2024-09-22T08:40:45.350947+0000","last_clean":"2024-09-22T08:40:45.350947+0000","last_became_active":"2024-09-22T08:36:34.015696+0000","last_became_peered":"2024-09-22T08:36:34.015696+0000","last_unstale":"2024-09-22T08:40:45.350947+0000","last_undegraded":"2024-09-22T08:40:45.350947+0000","last_fullsized":"2024-09-22T08:40:45.350947+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'36","last_scrub_stamp":"2024-09-22T08:40:45.350853+0000","last_deep_scrub":"32'36","last_deep_scrub_stamp":"2024-09-22T08:40:45.350853+0000","last_clean_scrub_stamp":"2024-09-22T08:40:45.350853+0000","objects_scrubbed":1,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:30:23.115805+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":173,"num_read_kb":173,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"32'6","reported_seq":61,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:13.437831+0000","last_change":"2024-09-22T08:40:13.437831+0000","last_active":"2024-09-22T08:40:13.437831+0000","last_peered":"2024-09-22T08:40:13.437831+0000","last_clean":"2024-09-22T08:40:13.437831+0000","last_became_active":"2024-09-22T08:36:25.987811+0000","last_became_peered":"2024-09-22T08:36:25.987811+0000","last_unstale":"2024-09-22T08:40:13.437831+0000","last_undegraded":"2024-09-22T08:40:13.437831+0000","last_fullsized":"2024-09-22T08:40:13.437831+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-22T08:40:13.437749+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-22T08:40:13.437749+0000","last_clean_scrub_stamp":"2024-09-22T08:40:13.437749+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:42:52.209301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:52.378512+0000","last_change":"2024-09-22T08:39:52.378512+0000","last_active":"2024-09-22T08:39:52.378512+0000","last_peered":"2024-09-22T08:39:52.378512+0000","last_clean":"2024-09-22T08:39:52.378512+0000","last_became_active":"2024-09-22T08:36:23.982423+0000","last_became_peered":"2024-09-22T08:36:23.982423+0000","last_unstale":"2024-09-22T08:39:52.378512+0000","last_undegraded":"2024-09-22T08:39:52.378512+0000","last_fullsized":"2024-09-22T08:39:52.378512+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:39:52.378424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:39:52.378424+0000","last_clean_scrub_stamp":"2024-09-22T08:39:52.378424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:48:16.834018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:34.483277+0000","last_change":"2024-09-22T08:40:34.483277+0000","last_active":"2024-09-22T08:40:34.483277+0000","last_peered":"2024-09-22T08:40:34.483277+0000","last_clean":"2024-09-22T08:40:34.483277+0000","last_became_active":"2024-09-22T08:36:27.988057+0000","last_became_peered":"2024-09-22T08:36:27.988057+0000","last_unstale":"2024-09-22T08:40:34.483277+0000","last_undegraded":"2024-09-22T08:40:34.483277+0000","last_fullsized":"2024-09-22T08:40:34.483277+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:34.483200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:34.483200+0000","last_clean_scrub_stamp":"2024-09-22T08:40:34.483200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:17:21.473508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"32'37","reported_seq":92,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:45.446949+0000","last_change":"2024-09-22T08:40:45.446949+0000","last_active":"2024-09-22T08:40:45.446949+0000","last_peered":"2024-09-22T08:40:45.446949+0000","last_clean":"2024-09-22T08:40:45.446949+0000","last_became_active":"2024-09-22T08:36:29.994881+0000","last_became_peered":"2024-09-22T08:36:29.994881+0000","last_unstale":"2024-09-22T08:40:45.446949+0000","last_undegraded":"2024-09-22T08:40:45.446949+0000","last_fullsized":"2024-09-22T08:40:45.446949+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'37","last_scrub_stamp":"2024-09-22T08:40:45.446839+0000","last_deep_scrub":"32'37","last_deep_scrub_stamp":"2024-09-22T08:40:45.446839+0000","last_clean_scrub_stamp":"2024-09-22T08:40:45.446839+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:22:51.304961+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:37.369943+0000","last_change":"2024-09-22T08:40:37.369943+0000","last_active":"2024-09-22T08:40:37.369943+0000","last_peered":"2024-09-22T08:40:37.369943+0000","last_clean":"2024-09-22T08:40:37.369943+0000","last_became_active":"2024-09-22T08:36:32.013249+0000","last_became_peered":"2024-09-22T08:36:32.013249+0000","last_unstale":"2024-09-22T08:40:37.369943+0000","last_undegraded":"2024-09-22T08:40:37.369943+0000","last_fullsized":"2024-09-22T08:40:37.369943+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:37.369829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:37.369829+0000","last_clean_scrub_stamp":"2024-09-22T08:40:37.369829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:03:42.407066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"32'7","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:46.390688+0000","last_change":"2024-09-22T08:40:46.390688+0000","last_active":"2024-09-22T08:40:46.390688+0000","last_peered":"2024-09-22T08:40:46.390688+0000","last_clean":"2024-09-22T08:40:46.390688+0000","last_became_active":"2024-09-22T08:36:34.015170+0000","last_became_peered":"2024-09-22T08:36:34.015170+0000","last_unstale":"2024-09-22T08:40:46.390688+0000","last_undegraded":"2024-09-22T08:40:46.390688+0000","last_fullsized":"2024-09-22T08:40:46.390688+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'7","last_scrub_stamp":"2024-09-22T08:40:46.390603+0000","last_deep_scrub":"32'7","last_deep_scrub_stamp":"2024-09-22T08:40:46.390603+0000","last_clean_scrub_stamp":"2024-09-22T08:40:46.390603+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:14:26.449097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"32'2","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:14.450214+0000","last_change":"2024-09-22T08:40:14.450214+0000","last_active":"2024-09-22T08:40:14.450214+0000","last_peered":"2024-09-22T08:40:14.450214+0000","last_clean":"2024-09-22T08:40:14.450214+0000","last_became_active":"2024-09-22T08:36:25.989583+0000","last_became_peered":"2024-09-22T08:36:25.989583+0000","last_unstale":"2024-09-22T08:40:14.450214+0000","last_undegraded":"2024-09-22T08:40:14.450214+0000","last_fullsized":"2024-09-22T08:40:14.450214+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-22T08:40:14.450079+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-22T08:40:14.450079+0000","last_clean_scrub_stamp":"2024-09-22T08:40:14.450079+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:50:05.715618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"32'2","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:50.670046+0000","last_change":"2024-09-22T08:39:50.670046+0000","last_active":"2024-09-22T08:39:50.670046+0000","last_peered":"2024-09-22T08:39:50.670046+0000","last_clean":"2024-09-22T08:39:50.670046+0000","last_became_active":"2024-09-22T08:36:23.973716+0000","last_became_peered":"2024-09-22T08:36:23.973716+0000","last_unstale":"2024-09-22T08:39:50.670046+0000","last_undegraded":"2024-09-22T08:39:50.670046+0000","last_fullsized":"2024-09-22T08:39:50.670046+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-22T08:39:50.669969+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-22T08:39:50.669969+0000","last_clean_scrub_stamp":"2024-09-22T08:39:50.669969+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:51:53.477798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:21.357079+0000","last_change":"2024-09-22T08:40:21.357079+0000","last_active":"2024-09-22T08:40:21.357079+0000","last_peered":"2024-09-22T08:40:21.357079+0000","last_clean":"2024-09-22T08:40:21.357079+0000","last_became_active":"2024-09-22T08:37:04.229132+0000","last_became_peered":"2024-09-22T08:37:04.229132+0000","last_unstale":"2024-09-22T08:40:21.357079+0000","last_undegraded":"2024-09-22T08:40:21.357079+0000","last_fullsized":"2024-09-22T08:40:21.357079+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:21.356998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:21.356998+0000","last_clean_scrub_stamp":"2024-09-22T08:40:21.356998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:11:54.368083+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"32'9","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:31.392908+0000","last_change":"2024-09-22T08:40:31.392908+0000","last_active":"2024-09-22T08:40:31.392908+0000","last_peered":"2024-09-22T08:40:31.392908+0000","last_clean":"2024-09-22T08:40:31.392908+0000","last_became_active":"2024-09-22T08:36:29.990998+0000","last_became_peered":"2024-09-22T08:36:29.990998+0000","last_unstale":"2024-09-22T08:40:31.392908+0000","last_undegraded":"2024-09-22T08:40:31.392908+0000","last_fullsized":"2024-09-22T08:40:31.392908+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'9","last_scrub_stamp":"2024-09-22T08:40:31.392802+0000","last_deep_scrub":"32'9","last_deep_scrub_stamp":"2024-09-22T08:40:31.392802+0000","last_clean_scrub_stamp":"2024-09-22T08:40:31.392802+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:03:13.570471+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:36.364189+0000","last_change":"2024-09-22T08:40:36.364189+0000","last_active":"2024-09-22T08:40:36.364189+0000","last_peered":"2024-09-22T08:40:36.364189+0000","last_clean":"2024-09-22T08:40:36.364189+0000","last_became_active":"2024-09-22T08:36:32.006161+0000","last_became_peered":"2024-09-22T08:36:32.006161+0000","last_unstale":"2024-09-22T08:40:36.364189+0000","last_undegraded":"2024-09-22T08:40:36.364189+0000","last_fullsized":"2024-09-22T08:40:36.364189+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:36.364094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:36.364094+0000","last_clean_scrub_stamp":"2024-09-22T08:40:36.364094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:26:36.338748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"30'2","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:43.810402+0000","last_change":"2024-09-22T08:40:43.810402+0000","last_active":"2024-09-22T08:40:43.810402+0000","last_peered":"2024-09-22T08:40:43.810402+0000","last_clean":"2024-09-22T08:40:43.810402+0000","last_became_active":"2024-09-22T08:36:34.016749+0000","last_became_peered":"2024-09-22T08:36:34.016749+0000","last_unstale":"2024-09-22T08:40:43.810402+0000","last_undegraded":"2024-09-22T08:40:43.810402+0000","last_fullsized":"2024-09-22T08:40:43.810402+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-09-22T08:40:43.810306+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-09-22T08:40:43.810306+0000","last_clean_scrub_stamp":"2024-09-22T08:40:43.810306+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:03:39.113833+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"32'8","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:16.461402+0000","last_change":"2024-09-22T08:40:16.461402+0000","last_active":"2024-09-22T08:40:16.461402+0000","last_peered":"2024-09-22T08:40:16.461402+0000","last_clean":"2024-09-22T08:40:16.461402+0000","last_became_active":"2024-09-22T08:36:25.987860+0000","last_became_peered":"2024-09-22T08:36:25.987860+0000","last_unstale":"2024-09-22T08:40:16.461402+0000","last_undegraded":"2024-09-22T08:40:16.461402+0000","last_fullsized":"2024-09-22T08:40:16.461402+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-22T08:40:16.461252+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-22T08:40:16.461252+0000","last_clean_scrub_stamp":"2024-09-22T08:40:16.461252+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:08:26.205157+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:54.365627+0000","last_change":"2024-09-22T08:39:54.365627+0000","last_active":"2024-09-22T08:39:54.365627+0000","last_peered":"2024-09-22T08:39:54.365627+0000","last_clean":"2024-09-22T08:39:54.365627+0000","last_became_active":"2024-09-22T08:36:23.979201+0000","last_became_peered":"2024-09-22T08:36:23.979201+0000","last_unstale":"2024-09-22T08:39:54.365627+0000","last_undegraded":"2024-09-22T08:39:54.365627+0000","last_fullsized":"2024-09-22T08:39:54.365627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:39:54.365537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:39:54.365537+0000","last_clean_scrub_stamp":"2024-09-22T08:39:54.365537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:12:06.963553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:18.892804+0000","last_change":"2024-09-22T08:40:18.892804+0000","last_active":"2024-09-22T08:40:18.892804+0000","last_peered":"2024-09-22T08:40:18.892804+0000","last_clean":"2024-09-22T08:40:18.892804+0000","last_became_active":"2024-09-22T08:36:27.987410+0000","last_became_peered":"2024-09-22T08:36:27.987410+0000","last_unstale":"2024-09-22T08:40:18.892804+0000","last_undegraded":"2024-09-22T08:40:18.892804+0000","last_fullsized":"2024-09-22T08:40:18.892804+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:18.892720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:18.892720+0000","last_clean_scrub_stamp":"2024-09-22T08:40:18.892720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:35:19.353672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"32'15","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:21.443057+0000","last_change":"2024-09-22T08:40:21.443057+0000","last_active":"2024-09-22T08:40:21.443057+0000","last_peered":"2024-09-22T08:40:21.443057+0000","last_clean":"2024-09-22T08:40:21.443057+0000","last_became_active":"2024-09-22T08:36:29.999306+0000","last_became_peered":"2024-09-22T08:36:29.999306+0000","last_unstale":"2024-09-22T08:40:21.443057+0000","last_undegraded":"2024-09-22T08:40:21.443057+0000","last_fullsized":"2024-09-22T08:40:21.443057+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'15","last_scrub_stamp":"2024-09-22T08:40:21.442962+0000","last_deep_scrub":"32'15","last_deep_scrub_stamp":"2024-09-22T08:40:21.442962+0000","last_clean_scrub_stamp":"2024-09-22T08:40:21.442962+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:58:30.895413+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"32'286","reported_seq":427,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:52.368599+0000","last_change":"2024-09-22T08:40:52.368599+0000","last_active":"2024-09-22T08:40:52.368599+0000","last_peered":"2024-09-22T08:40:52.368599+0000","last_clean":"2024-09-22T08:40:52.368599+0000","last_became_active":"2024-09-22T08:36:32.013869+0000","last_became_peered":"2024-09-22T08:36:32.013869+0000","last_unstale":"2024-09-22T08:40:52.368599+0000","last_undegraded":"2024-09-22T08:40:52.368599+0000","last_fullsized":"2024-09-22T08:40:52.368599+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'286","last_scrub_stamp":"2024-09-22T08:40:52.368514+0000","last_deep_scrub":"32'286","last_deep_scrub_stamp":"2024-09-22T08:40:52.368514+0000","last_clean_scrub_stamp":"2024-09-22T08:40:52.368514+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:37:12.629082+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:34.533590+0000","last_change":"2024-09-22T08:40:34.533590+0000","last_active":"2024-09-22T08:40:34.533590+0000","last_peered":"2024-09-22T08:40:34.533590+0000","last_clean":"2024-09-22T08:40:34.533590+0000","last_became_active":"2024-09-22T08:36:34.015999+0000","last_became_peered":"2024-09-22T08:36:34.015999+0000","last_unstale":"2024-09-22T08:40:34.533590+0000","last_undegraded":"2024-09-22T08:40:34.533590+0000","last_fullsized":"2024-09-22T08:40:34.533590+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:34.533498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:34.533498+0000","last_clean_scrub_stamp":"2024-09-22T08:40:34.533498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:54:14.287340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"30'4","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:02.829539+0000","last_change":"2024-09-22T08:40:02.829539+0000","last_active":"2024-09-22T08:40:02.829539+0000","last_peered":"2024-09-22T08:40:02.829539+0000","last_clean":"2024-09-22T08:40:02.829539+0000","last_became_active":"2024-09-22T08:36:25.979320+0000","last_became_peered":"2024-09-22T08:36:25.979320+0000","last_unstale":"2024-09-22T08:40:02.829539+0000","last_undegraded":"2024-09-22T08:40:02.829539+0000","last_fullsized":"2024-09-22T08:40:02.829539+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'4","last_scrub_stamp":"2024-09-22T08:40:02.829450+0000","last_deep_scrub":"30'4","last_deep_scrub_stamp":"2024-09-22T08:40:02.829450+0000","last_clean_scrub_stamp":"2024-09-22T08:40:02.829450+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:25:40.999415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:45.068211+0000","last_change":"2024-09-22T08:39:45.068211+0000","last_active":"2024-09-22T08:39:45.068211+0000","last_peered":"2024-09-22T08:39:45.068211+0000","last_clean":"2024-09-22T08:39:45.068211+0000","last_became_active":"2024-09-22T08:36:23.975428+0000","last_became_peered":"2024-09-22T08:36:23.975428+0000","last_unstale":"2024-09-22T08:39:45.068211+0000","last_undegraded":"2024-09-22T08:39:45.068211+0000","last_fullsized":"2024-09-22T08:39:45.068211+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:39:45.068115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:39:45.068115+0000","last_clean_scrub_stamp":"2024-09-22T08:39:45.068115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:04:18.711452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:36.500599+0000","last_change":"2024-09-22T08:40:36.500599+0000","last_active":"2024-09-22T08:40:36.500599+0000","last_peered":"2024-09-22T08:40:36.500599+0000","last_clean":"2024-09-22T08:40:36.500599+0000","last_became_active":"2024-09-22T08:36:27.984658+0000","last_became_peered":"2024-09-22T08:36:27.984658+0000","last_unstale":"2024-09-22T08:40:36.500599+0000","last_undegraded":"2024-09-22T08:40:36.500599+0000","last_fullsized":"2024-09-22T08:40:36.500599+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:36.500515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:36.500515+0000","last_clean_scrub_stamp":"2024-09-22T08:40:36.500515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:48:11.472744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"32'37","reported_seq":92,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:22.432096+0000","last_change":"2024-09-22T08:40:22.432096+0000","last_active":"2024-09-22T08:40:22.432096+0000","last_peered":"2024-09-22T08:40:22.432096+0000","last_clean":"2024-09-22T08:40:22.432096+0000","last_became_active":"2024-09-22T08:36:30.000641+0000","last_became_peered":"2024-09-22T08:36:30.000641+0000","last_unstale":"2024-09-22T08:40:22.432096+0000","last_undegraded":"2024-09-22T08:40:22.432096+0000","last_fullsized":"2024-09-22T08:40:22.432096+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'37","last_scrub_stamp":"2024-09-22T08:40:22.432008+0000","last_deep_scrub":"32'37","last_deep_scrub_stamp":"2024-09-22T08:40:22.432008+0000","last_clean_scrub_stamp":"2024-09-22T08:40:22.432008+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:59:09.948186+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"32'286","reported_seq":436,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:33.836032+0000","last_change":"2024-09-22T08:40:33.836032+0000","last_active":"2024-09-22T08:40:33.836032+0000","last_peered":"2024-09-22T08:40:33.836032+0000","last_clean":"2024-09-22T08:40:33.836032+0000","last_became_active":"2024-09-22T08:36:32.005012+0000","last_became_peered":"2024-09-22T08:36:32.005012+0000","last_unstale":"2024-09-22T08:40:33.836032+0000","last_undegraded":"2024-09-22T08:40:33.836032+0000","last_fullsized":"2024-09-22T08:40:33.836032+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'286","last_scrub_stamp":"2024-09-22T08:40:33.835941+0000","last_deep_scrub":"32'286","last_deep_scrub_stamp":"2024-09-22T08:40:33.835941+0000","last_clean_scrub_stamp":"2024-09-22T08:40:33.835941+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:45:21.756190+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"32'4","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:12.437116+0000","last_change":"2024-09-22T08:40:12.437028+0000","last_active":"2024-09-22T08:40:12.437116+0000","last_peered":"2024-09-22T08:40:12.437116+0000","last_clean":"2024-09-22T08:40:12.437116+0000","last_became_active":"2024-09-22T08:36:25.989940+0000","last_became_peered":"2024-09-22T08:36:25.989940+0000","last_unstale":"2024-09-22T08:40:12.437116+0000","last_undegraded":"2024-09-22T08:40:12.437116+0000","last_fullsized":"2024-09-22T08:40:12.437116+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-22T08:40:12.436939+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-22T08:40:12.436939+0000","last_clean_scrub_stamp":"2024-09-22T08:40:12.436939+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:59:47.804661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:46.601262+0000","last_change":"2024-09-22T08:39:46.601168+0000","last_active":"2024-09-22T08:39:46.601262+0000","last_peered":"2024-09-22T08:39:46.601262+0000","last_clean":"2024-09-22T08:39:46.601262+0000","last_became_active":"2024-09-22T08:36:23.970093+0000","last_became_peered":"2024-09-22T08:36:23.970093+0000","last_unstale":"2024-09-22T08:39:46.601262+0000","last_undegraded":"2024-09-22T08:39:46.601262+0000","last_fullsized":"2024-09-22T08:39:46.601262+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:39:46.601074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:39:46.601074+0000","last_clean_scrub_stamp":"2024-09-22T08:39:46.601074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:08:12.326140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:18.296614+0000","last_change":"2024-09-22T08:40:18.296552+0000","last_active":"2024-09-22T08:40:18.296614+0000","last_peered":"2024-09-22T08:40:18.296614+0000","last_clean":"2024-09-22T08:40:18.296614+0000","last_became_active":"2024-09-22T08:36:27.986734+0000","last_became_peered":"2024-09-22T08:36:27.986734+0000","last_unstale":"2024-09-22T08:40:18.296614+0000","last_undegraded":"2024-09-22T08:40:18.296614+0000","last_fullsized":"2024-09-22T08:40:18.296614+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:18.296463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:18.296463+0000","last_clean_scrub_stamp":"2024-09-22T08:40:18.296463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:16:18.206096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"32'52","reported_seq":113,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:17.437652+0000","last_change":"2024-09-22T08:40:17.437571+0000","last_active":"2024-09-22T08:40:17.437652+0000","last_peered":"2024-09-22T08:40:17.437652+0000","last_clean":"2024-09-22T08:40:17.437652+0000","last_became_active":"2024-09-22T08:36:29.990809+0000","last_became_peered":"2024-09-22T08:36:29.990809+0000","last_unstale":"2024-09-22T08:40:17.437652+0000","last_undegraded":"2024-09-22T08:40:17.437652+0000","last_fullsized":"2024-09-22T08:40:17.437652+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'52","last_scrub_stamp":"2024-09-22T08:40:17.437457+0000","last_deep_scrub":"32'52","last_deep_scrub_stamp":"2024-09-22T08:40:17.437457+0000","last_clean_scrub_stamp":"2024-09-22T08:40:17.437457+0000","objects_scrubbed":9,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:50:34.481525+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:34.812829+0000","last_change":"2024-09-22T08:40:34.812776+0000","last_active":"2024-09-22T08:40:34.812829+0000","last_peered":"2024-09-22T08:40:34.812829+0000","last_clean":"2024-09-22T08:40:34.812829+0000","last_became_active":"2024-09-22T08:36:32.003726+0000","last_became_peered":"2024-09-22T08:36:32.003726+0000","last_unstale":"2024-09-22T08:40:34.812829+0000","last_undegraded":"2024-09-22T08:40:34.812829+0000","last_fullsized":"2024-09-22T08:40:34.812829+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:34.812691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:34.812691+0000","last_clean_scrub_stamp":"2024-09-22T08:40:34.812691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:00:48.199101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"32'5","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:31.465577+0000","last_change":"2024-09-22T08:40:31.465514+0000","last_active":"2024-09-22T08:40:31.465577+0000","last_peered":"2024-09-22T08:40:31.465577+0000","last_clean":"2024-09-22T08:40:31.465577+0000","last_became_active":"2024-09-22T08:36:34.022448+0000","last_became_peered":"2024-09-22T08:36:34.022448+0000","last_unstale":"2024-09-22T08:40:31.465577+0000","last_undegraded":"2024-09-22T08:40:31.465577+0000","last_fullsized":"2024-09-22T08:40:31.465577+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'5","last_scrub_stamp":"2024-09-22T08:40:31.465423+0000","last_deep_scrub":"32'5","last_deep_scrub_stamp":"2024-09-22T08:40:31.465423+0000","last_clean_scrub_stamp":"2024-09-22T08:40:31.465423+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:38:40.836439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":13,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"32'10","reported_seq":68,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:00.348157+0000","last_change":"2024-09-22T08:40:00.348098+0000","last_active":"2024-09-22T08:40:00.348157+0000","last_peered":"2024-09-22T08:40:00.348157+0000","last_clean":"2024-09-22T08:40:00.348157+0000","last_became_active":"2024-09-22T08:36:25.975728+0000","last_became_peered":"2024-09-22T08:36:25.975728+0000","last_unstale":"2024-09-22T08:40:00.348157+0000","last_undegraded":"2024-09-22T08:40:00.348157+0000","last_fullsized":"2024-09-22T08:40:00.348157+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-09-22T08:40:00.348005+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-09-22T08:40:00.348005+0000","last_clean_scrub_stamp":"2024-09-22T08:40:00.348005+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:50:17.392073+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"32'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:47.621450+0000","last_change":"2024-09-22T08:39:47.621398+0000","last_active":"2024-09-22T08:39:47.621450+0000","last_peered":"2024-09-22T08:39:47.621450+0000","last_clean":"2024-09-22T08:39:47.621450+0000","last_became_active":"2024-09-22T08:36:23.968836+0000","last_became_peered":"2024-09-22T08:36:23.968836+0000","last_unstale":"2024-09-22T08:39:47.621450+0000","last_undegraded":"2024-09-22T08:39:47.621450+0000","last_fullsized":"2024-09-22T08:39:47.621450+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-22T08:39:47.621313+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-22T08:39:47.621313+0000","last_clean_scrub_stamp":"2024-09-22T08:39:47.621313+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:26:56.822278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:14.829286+0000","last_change":"2024-09-22T08:40:14.829193+0000","last_active":"2024-09-22T08:40:14.829286+0000","last_peered":"2024-09-22T08:40:14.829286+0000","last_clean":"2024-09-22T08:40:14.829286+0000","last_became_active":"2024-09-22T08:36:27.987577+0000","last_became_peered":"2024-09-22T08:36:27.987577+0000","last_unstale":"2024-09-22T08:40:14.829286+0000","last_undegraded":"2024-09-22T08:40:14.829286+0000","last_fullsized":"2024-09-22T08:40:14.829286+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:14.829090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:14.829090+0000","last_clean_scrub_stamp":"2024-09-22T08:40:14.829090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:13:09.683686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"32'38","reported_seq":94,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:41.488509+0000","last_change":"2024-09-22T08:40:41.488447+0000","last_active":"2024-09-22T08:40:41.488509+0000","last_peered":"2024-09-22T08:40:41.488509+0000","last_clean":"2024-09-22T08:40:41.488509+0000","last_became_active":"2024-09-22T08:36:29.994921+0000","last_became_peered":"2024-09-22T08:36:29.994921+0000","last_unstale":"2024-09-22T08:40:41.488509+0000","last_undegraded":"2024-09-22T08:40:41.488509+0000","last_fullsized":"2024-09-22T08:40:41.488509+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'38","last_scrub_stamp":"2024-09-22T08:40:41.488340+0000","last_deep_scrub":"32'38","last_deep_scrub_stamp":"2024-09-22T08:40:41.488340+0000","last_clean_scrub_stamp":"2024-09-22T08:40:41.488340+0000","objects_scrubbed":4,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:15:53.374710+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:32.802706+0000","last_change":"2024-09-22T08:40:32.802601+0000","last_active":"2024-09-22T08:40:32.802706+0000","last_peered":"2024-09-22T08:40:32.802706+0000","last_clean":"2024-09-22T08:40:32.802706+0000","last_became_active":"2024-09-22T08:36:32.004269+0000","last_became_peered":"2024-09-22T08:36:32.004269+0000","last_unstale":"2024-09-22T08:40:32.802706+0000","last_undegraded":"2024-09-22T08:40:32.802706+0000","last_fullsized":"2024-09-22T08:40:32.802706+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:32.802512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:32.802512+0000","last_clean_scrub_stamp":"2024-09-22T08:40:32.802512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:59:06.906283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"32'4","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:40.368388+0000","last_change":"2024-09-22T08:40:40.368292+0000","last_active":"2024-09-22T08:40:40.368388+0000","last_peered":"2024-09-22T08:40:40.368388+0000","last_clean":"2024-09-22T08:40:40.368388+0000","last_became_active":"2024-09-22T08:36:34.018190+0000","last_became_peered":"2024-09-22T08:36:34.018190+0000","last_unstale":"2024-09-22T08:40:40.368388+0000","last_undegraded":"2024-09-22T08:40:40.368388+0000","last_fullsized":"2024-09-22T08:40:40.368388+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-22T08:40:40.368201+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-22T08:40:40.368201+0000","last_clean_scrub_stamp":"2024-09-22T08:40:40.368201+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:52:55.935475+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"32'4","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:55.624427+0000","last_change":"2024-09-22T08:39:55.624374+0000","last_active":"2024-09-22T08:39:55.624427+0000","last_peered":"2024-09-22T08:39:55.624427+0000","last_clean":"2024-09-22T08:39:55.624427+0000","last_became_active":"2024-09-22T08:36:25.983073+0000","last_became_peered":"2024-09-22T08:36:25.983073+0000","last_unstale":"2024-09-22T08:39:55.624427+0000","last_undegraded":"2024-09-22T08:39:55.624427+0000","last_fullsized":"2024-09-22T08:39:55.624427+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-22T08:39:55.624297+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-22T08:39:55.624297+0000","last_clean_scrub_stamp":"2024-09-22T08:39:55.624297+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:20:43.093379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"32'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:53.406819+0000","last_change":"2024-09-22T08:39:53.406759+0000","last_active":"2024-09-22T08:39:53.406819+0000","last_peered":"2024-09-22T08:39:53.406819+0000","last_clean":"2024-09-22T08:39:53.406819+0000","last_became_active":"2024-09-22T08:36:23.980682+0000","last_became_peered":"2024-09-22T08:36:23.980682+0000","last_unstale":"2024-09-22T08:39:53.406819+0000","last_undegraded":"2024-09-22T08:39:53.406819+0000","last_fullsized":"2024-09-22T08:39:53.406819+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-22T08:39:53.406674+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-22T08:39:53.406674+0000","last_clean_scrub_stamp":"2024-09-22T08:39:53.406674+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:08:41.063816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:16.832261+0000","last_change":"2024-09-22T08:40:16.832193+0000","last_active":"2024-09-22T08:40:16.832261+0000","last_peered":"2024-09-22T08:40:16.832261+0000","last_clean":"2024-09-22T08:40:16.832261+0000","last_became_active":"2024-09-22T08:36:27.985675+0000","last_became_peered":"2024-09-22T08:36:27.985675+0000","last_unstale":"2024-09-22T08:40:16.832261+0000","last_undegraded":"2024-09-22T08:40:16.832261+0000","last_fullsized":"2024-09-22T08:40:16.832261+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:16.832115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:16.832115+0000","last_clean_scrub_stamp":"2024-09-22T08:40:16.832115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:49:05.088114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"32'48","reported_seq":107,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:40.440754+0000","last_change":"2024-09-22T08:40:40.440652+0000","last_active":"2024-09-22T08:40:40.440754+0000","last_peered":"2024-09-22T08:40:40.440754+0000","last_clean":"2024-09-22T08:40:40.440754+0000","last_became_active":"2024-09-22T08:36:29.997542+0000","last_became_peered":"2024-09-22T08:36:29.997542+0000","last_unstale":"2024-09-22T08:40:40.440754+0000","last_undegraded":"2024-09-22T08:40:40.440754+0000","last_fullsized":"2024-09-22T08:40:40.440754+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'48","last_scrub_stamp":"2024-09-22T08:40:40.440544+0000","last_deep_scrub":"32'48","last_deep_scrub_stamp":"2024-09-22T08:40:40.440544+0000","last_clean_scrub_stamp":"2024-09-22T08:40:40.440544+0000","objects_scrubbed":7,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:56:19.476851+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"32'286","reported_seq":361,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:30.869342+0000","last_change":"2024-09-22T08:40:30.869290+0000","last_active":"2024-09-22T08:40:30.869342+0000","last_peered":"2024-09-22T08:40:30.869342+0000","last_clean":"2024-09-22T08:40:30.869342+0000","last_became_active":"2024-09-22T08:36:32.004441+0000","last_became_peered":"2024-09-22T08:36:32.004441+0000","last_unstale":"2024-09-22T08:40:30.869342+0000","last_undegraded":"2024-09-22T08:40:30.869342+0000","last_fullsized":"2024-09-22T08:40:30.869342+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'286","last_scrub_stamp":"2024-09-22T08:40:30.869201+0000","last_deep_scrub":"32'286","last_deep_scrub_stamp":"2024-09-22T08:40:30.869201+0000","last_clean_scrub_stamp":"2024-09-22T08:40:30.869201+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:14:18.065392+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:38.811921+0000","last_change":"2024-09-22T08:40:38.811852+0000","last_active":"2024-09-22T08:40:38.811921+0000","last_peered":"2024-09-22T08:40:38.811921+0000","last_clean":"2024-09-22T08:40:38.811921+0000","last_became_active":"2024-09-22T08:36:34.017217+0000","last_became_peered":"2024-09-22T08:36:34.017217+0000","last_unstale":"2024-09-22T08:40:38.811921+0000","last_undegraded":"2024-09-22T08:40:38.811921+0000","last_fullsized":"2024-09-22T08:40:38.811921+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:38.811743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:38.811743+0000","last_clean_scrub_stamp":"2024-09-22T08:40:38.811743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:50:20.661338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"32'2","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:56.576748+0000","last_change":"2024-09-22T08:39:56.576672+0000","last_active":"2024-09-22T08:39:56.576748+0000","last_peered":"2024-09-22T08:39:56.576748+0000","last_clean":"2024-09-22T08:39:56.576748+0000","last_became_active":"2024-09-22T08:36:25.972198+0000","last_became_peered":"2024-09-22T08:36:25.972198+0000","last_unstale":"2024-09-22T08:39:56.576748+0000","last_undegraded":"2024-09-22T08:39:56.576748+0000","last_fullsized":"2024-09-22T08:39:56.576748+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-22T08:39:56.576591+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-22T08:39:56.576591+0000","last_clean_scrub_stamp":"2024-09-22T08:39:56.576591+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:19:21.946421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:55.323013+0000","last_change":"2024-09-22T08:39:55.322922+0000","last_active":"2024-09-22T08:39:55.323013+0000","last_peered":"2024-09-22T08:39:55.323013+0000","last_clean":"2024-09-22T08:39:55.323013+0000","last_became_active":"2024-09-22T08:36:23.978306+0000","last_became_peered":"2024-09-22T08:36:23.978306+0000","last_unstale":"2024-09-22T08:39:55.323013+0000","last_undegraded":"2024-09-22T08:39:55.323013+0000","last_fullsized":"2024-09-22T08:39:55.323013+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:39:55.322811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:39:55.322811+0000","last_clean_scrub_stamp":"2024-09-22T08:39:55.322811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:44:43.243059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:15.861695+0000","last_change":"2024-09-22T08:40:15.861620+0000","last_active":"2024-09-22T08:40:15.861695+0000","last_peered":"2024-09-22T08:40:15.861695+0000","last_clean":"2024-09-22T08:40:15.861695+0000","last_became_active":"2024-09-22T08:36:27.985751+0000","last_became_peered":"2024-09-22T08:36:27.985751+0000","last_unstale":"2024-09-22T08:40:15.861695+0000","last_undegraded":"2024-09-22T08:40:15.861695+0000","last_fullsized":"2024-09-22T08:40:15.861695+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:15.861527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:15.861527+0000","last_clean_scrub_stamp":"2024-09-22T08:40:15.861527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:35:09.030569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"32'66","reported_seq":140,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:43.439343+0000","last_change":"2024-09-22T08:40:43.439272+0000","last_active":"2024-09-22T08:40:43.439343+0000","last_peered":"2024-09-22T08:40:43.439343+0000","last_clean":"2024-09-22T08:40:43.439343+0000","last_became_active":"2024-09-22T08:36:29.995225+0000","last_became_peered":"2024-09-22T08:36:29.995225+0000","last_unstale":"2024-09-22T08:40:43.439343+0000","last_undegraded":"2024-09-22T08:40:43.439343+0000","last_fullsized":"2024-09-22T08:40:43.439343+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'66","last_scrub_stamp":"2024-09-22T08:40:43.439173+0000","last_deep_scrub":"32'66","last_deep_scrub_stamp":"2024-09-22T08:40:43.439173+0000","last_clean_scrub_stamp":"2024-09-22T08:40:43.439173+0000","objects_scrubbed":5,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:34:02.270004+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:29.873480+0000","last_change":"2024-09-22T08:40:29.873423+0000","last_active":"2024-09-22T08:40:29.873480+0000","last_peered":"2024-09-22T08:40:29.873480+0000","last_clean":"2024-09-22T08:40:29.873480+0000","last_became_active":"2024-09-22T08:36:32.002833+0000","last_became_peered":"2024-09-22T08:36:32.002833+0000","last_unstale":"2024-09-22T08:40:29.873480+0000","last_undegraded":"2024-09-22T08:40:29.873480+0000","last_fullsized":"2024-09-22T08:40:29.873480+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:29.873335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:29.873335+0000","last_clean_scrub_stamp":"2024-09-22T08:40:29.873335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:22:16.274271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"32'21","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:42.827536+0000","last_change":"2024-09-22T08:40:42.827463+0000","last_active":"2024-09-22T08:40:42.827536+0000","last_peered":"2024-09-22T08:40:42.827536+0000","last_clean":"2024-09-22T08:40:42.827536+0000","last_became_active":"2024-09-22T08:36:34.014853+0000","last_became_peered":"2024-09-22T08:36:34.014853+0000","last_unstale":"2024-09-22T08:40:42.827536+0000","last_undegraded":"2024-09-22T08:40:42.827536+0000","last_fullsized":"2024-09-22T08:40:42.827536+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'21","last_scrub_stamp":"2024-09-22T08:40:42.827372+0000","last_deep_scrub":"32'21","last_deep_scrub_stamp":"2024-09-22T08:40:42.827372+0000","last_clean_scrub_stamp":"2024-09-22T08:40:42.827372+0000","objects_scrubbed":3,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:20:38.200767+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"32'12","reported_seq":79,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:01.359265+0000","last_change":"2024-09-22T08:40:01.359189+0000","last_active":"2024-09-22T08:40:01.359265+0000","last_peered":"2024-09-22T08:40:01.359265+0000","last_clean":"2024-09-22T08:40:01.359265+0000","last_became_active":"2024-09-22T08:36:25.977682+0000","last_became_peered":"2024-09-22T08:36:25.977682+0000","last_unstale":"2024-09-22T08:40:01.359265+0000","last_undegraded":"2024-09-22T08:40:01.359265+0000","last_fullsized":"2024-09-22T08:40:01.359265+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-09-22T08:40:01.359074+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-09-22T08:40:01.359074+0000","last_clean_scrub_stamp":"2024-09-22T08:40:01.359074+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:56:45.036758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":47,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:46.788179+0000","last_change":"2024-09-22T08:39:46.788116+0000","last_active":"2024-09-22T08:39:46.788179+0000","last_peered":"2024-09-22T08:39:46.788179+0000","last_clean":"2024-09-22T08:39:46.788179+0000","last_became_active":"2024-09-22T08:36:23.972822+0000","last_became_peered":"2024-09-22T08:36:23.972822+0000","last_unstale":"2024-09-22T08:39:46.788179+0000","last_undegraded":"2024-09-22T08:39:46.788179+0000","last_fullsized":"2024-09-22T08:39:46.788179+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:39:46.788026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:39:46.788026+0000","last_clean_scrub_stamp":"2024-09-22T08:39:46.788026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:10:40.958015+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:11.369442+0000","last_change":"2024-09-22T08:40:11.369383+0000","last_active":"2024-09-22T08:40:11.369442+0000","last_peered":"2024-09-22T08:40:11.369442+0000","last_clean":"2024-09-22T08:40:11.369442+0000","last_became_active":"2024-09-22T08:36:27.991761+0000","last_became_peered":"2024-09-22T08:36:27.991761+0000","last_unstale":"2024-09-22T08:40:11.369442+0000","last_undegraded":"2024-09-22T08:40:11.369442+0000","last_fullsized":"2024-09-22T08:40:11.369442+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:11.369297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:11.369297+0000","last_clean_scrub_stamp":"2024-09-22T08:40:11.369297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:02:18.578080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"32'40","reported_seq":97,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:30.347299+0000","last_change":"2024-09-22T08:40:30.347233+0000","last_active":"2024-09-22T08:40:30.347299+0000","last_peered":"2024-09-22T08:40:30.347299+0000","last_clean":"2024-09-22T08:40:30.347299+0000","last_became_active":"2024-09-22T08:36:29.988363+0000","last_became_peered":"2024-09-22T08:36:29.988363+0000","last_unstale":"2024-09-22T08:40:30.347299+0000","last_undegraded":"2024-09-22T08:40:30.347299+0000","last_fullsized":"2024-09-22T08:40:30.347299+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'40","last_scrub_stamp":"2024-09-22T08:40:30.347131+0000","last_deep_scrub":"32'40","last_deep_scrub_stamp":"2024-09-22T08:40:30.347131+0000","last_clean_scrub_stamp":"2024-09-22T08:40:30.347131+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:40:22.822120+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:58.343441+0000","last_change":"2024-09-22T08:40:58.343345+0000","last_active":"2024-09-22T08:40:58.343441+0000","last_peered":"2024-09-22T08:40:58.343441+0000","last_clean":"2024-09-22T08:40:58.343441+0000","last_became_active":"2024-09-22T08:36:32.011923+0000","last_became_peered":"2024-09-22T08:36:32.011923+0000","last_unstale":"2024-09-22T08:40:58.343441+0000","last_undegraded":"2024-09-22T08:40:58.343441+0000","last_fullsized":"2024-09-22T08:40:58.343441+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:58.343223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:58.343223+0000","last_clean_scrub_stamp":"2024-09-22T08:40:58.343223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:22:29.597663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"32'4","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:56.400652+0000","last_change":"2024-09-22T08:40:56.400652+0000","last_active":"2024-09-22T08:40:56.400652+0000","last_peered":"2024-09-22T08:40:56.400652+0000","last_clean":"2024-09-22T08:40:56.400652+0000","last_became_active":"2024-09-22T08:36:34.013308+0000","last_became_peered":"2024-09-22T08:36:34.013308+0000","last_unstale":"2024-09-22T08:40:56.400652+0000","last_undegraded":"2024-09-22T08:40:56.400652+0000","last_fullsized":"2024-09-22T08:40:56.400652+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-22T08:40:56.400558+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-22T08:40:56.400558+0000","last_clean_scrub_stamp":"2024-09-22T08:40:56.400558+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:03:28.367010+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"32'6","reported_seq":61,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:11.403794+0000","last_change":"2024-09-22T08:40:11.403703+0000","last_active":"2024-09-22T08:40:11.403794+0000","last_peered":"2024-09-22T08:40:11.403794+0000","last_clean":"2024-09-22T08:40:11.403794+0000","last_became_active":"2024-09-22T08:36:25.992167+0000","last_became_peered":"2024-09-22T08:36:25.992167+0000","last_unstale":"2024-09-22T08:40:11.403794+0000","last_undegraded":"2024-09-22T08:40:11.403794+0000","last_fullsized":"2024-09-22T08:40:11.403794+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-22T08:40:11.403607+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-22T08:40:11.403607+0000","last_clean_scrub_stamp":"2024-09-22T08:40:11.403607+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:48:41.981330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"32'4","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:51.418537+0000","last_change":"2024-09-22T08:39:51.418486+0000","last_active":"2024-09-22T08:39:51.418537+0000","last_peered":"2024-09-22T08:39:51.418537+0000","last_clean":"2024-09-22T08:39:51.418537+0000","last_became_active":"2024-09-22T08:36:23.980560+0000","last_became_peered":"2024-09-22T08:36:23.980560+0000","last_unstale":"2024-09-22T08:39:51.418537+0000","last_undegraded":"2024-09-22T08:39:51.418537+0000","last_fullsized":"2024-09-22T08:39:51.418537+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-22T08:39:51.418401+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-22T08:39:51.418401+0000","last_clean_scrub_stamp":"2024-09-22T08:39:51.418401+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:39:01.093268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":6,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:17.865117+0000","last_change":"2024-09-22T08:40:17.865031+0000","last_active":"2024-09-22T08:40:17.865117+0000","last_peered":"2024-09-22T08:40:17.865117+0000","last_clean":"2024-09-22T08:40:17.865117+0000","last_became_active":"2024-09-22T08:36:27.984699+0000","last_became_peered":"2024-09-22T08:36:27.984699+0000","last_unstale":"2024-09-22T08:40:17.865117+0000","last_undegraded":"2024-09-22T08:40:17.865117+0000","last_fullsized":"2024-09-22T08:40:17.865117+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:17.864935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:17.864935+0000","last_clean_scrub_stamp":"2024-09-22T08:40:17.864935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:06:55.919594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"32'46","reported_seq":105,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:19.415106+0000","last_change":"2024-09-22T08:40:19.415050+0000","last_active":"2024-09-22T08:40:19.415106+0000","last_peered":"2024-09-22T08:40:19.415106+0000","last_clean":"2024-09-22T08:40:19.415106+0000","last_became_active":"2024-09-22T08:36:29.989049+0000","last_became_peered":"2024-09-22T08:36:29.989049+0000","last_unstale":"2024-09-22T08:40:19.415106+0000","last_undegraded":"2024-09-22T08:40:19.415106+0000","last_fullsized":"2024-09-22T08:40:19.415106+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'46","last_scrub_stamp":"2024-09-22T08:40:19.414959+0000","last_deep_scrub":"32'46","last_deep_scrub_stamp":"2024-09-22T08:40:19.414959+0000","last_clean_scrub_stamp":"2024-09-22T08:40:19.414959+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:49:24.762046+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"32'286","reported_seq":464,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:25.421430+0000","last_change":"2024-09-22T08:40:25.421430+0000","last_active":"2024-09-22T08:40:25.421430+0000","last_peered":"2024-09-22T08:40:25.421430+0000","last_clean":"2024-09-22T08:40:25.421430+0000","last_became_active":"2024-09-22T08:36:32.003451+0000","last_became_peered":"2024-09-22T08:36:32.003451+0000","last_unstale":"2024-09-22T08:40:25.421430+0000","last_undegraded":"2024-09-22T08:40:25.421430+0000","last_fullsized":"2024-09-22T08:40:25.421430+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'286","last_scrub_stamp":"2024-09-22T08:40:25.421346+0000","last_deep_scrub":"32'286","last_deep_scrub_stamp":"2024-09-22T08:40:25.421346+0000","last_clean_scrub_stamp":"2024-09-22T08:40:25.421346+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:49:15.576473+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"32'13","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:37.800064+0000","last_change":"2024-09-22T08:40:37.800013+0000","last_active":"2024-09-22T08:40:37.800064+0000","last_peered":"2024-09-22T08:40:37.800064+0000","last_clean":"2024-09-22T08:40:37.800064+0000","last_became_active":"2024-09-22T08:36:34.017586+0000","last_became_peered":"2024-09-22T08:36:34.017586+0000","last_unstale":"2024-09-22T08:40:37.800064+0000","last_undegraded":"2024-09-22T08:40:37.800064+0000","last_fullsized":"2024-09-22T08:40:37.800064+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'13","last_scrub_stamp":"2024-09-22T08:40:37.799919+0000","last_deep_scrub":"32'13","last_deep_scrub_stamp":"2024-09-22T08:40:37.799919+0000","last_clean_scrub_stamp":"2024-09-22T08:40:37.799919+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:56:05.773299+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":180,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"32'6","reported_seq":61,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:00.480012+0000","last_change":"2024-09-22T08:40:00.479916+0000","last_active":"2024-09-22T08:40:00.480012+0000","last_peered":"2024-09-22T08:40:00.480012+0000","last_clean":"2024-09-22T08:40:00.480012+0000","last_became_active":"2024-09-22T08:36:25.983836+0000","last_became_peered":"2024-09-22T08:36:25.983836+0000","last_unstale":"2024-09-22T08:40:00.480012+0000","last_undegraded":"2024-09-22T08:40:00.480012+0000","last_fullsized":"2024-09-22T08:40:00.480012+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-22T08:40:00.479800+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-22T08:40:00.479800+0000","last_clean_scrub_stamp":"2024-09-22T08:40:00.479800+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:26:08.975683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":29,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:50.428866+0000","last_change":"2024-09-22T08:39:50.428805+0000","last_active":"2024-09-22T08:39:50.428866+0000","last_peered":"2024-09-22T08:39:50.428866+0000","last_clean":"2024-09-22T08:39:50.428866+0000","last_became_active":"2024-09-22T08:36:23.981453+0000","last_became_peered":"2024-09-22T08:36:23.981453+0000","last_unstale":"2024-09-22T08:39:50.428866+0000","last_undegraded":"2024-09-22T08:39:50.428866+0000","last_fullsized":"2024-09-22T08:39:50.428866+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:39:50.428713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:39:50.428713+0000","last_clean_scrub_stamp":"2024-09-22T08:39:50.428713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:18:15.418827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"32'5","reported_seq":429,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:20.318888+0000","last_change":"2024-09-22T08:40:20.318827+0000","last_active":"2024-09-22T08:40:20.318888+0000","last_peered":"2024-09-22T08:40:20.318888+0000","last_clean":"2024-09-22T08:40:20.318888+0000","last_became_active":"2024-09-22T08:36:27.990658+0000","last_became_peered":"2024-09-22T08:36:27.990658+0000","last_unstale":"2024-09-22T08:40:20.318888+0000","last_undegraded":"2024-09-22T08:40:20.318888+0000","last_fullsized":"2024-09-22T08:40:20.318888+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'5","last_scrub_stamp":"2024-09-22T08:40:20.318746+0000","last_deep_scrub":"32'5","last_deep_scrub_stamp":"2024-09-22T08:40:20.318746+0000","last_clean_scrub_stamp":"2024-09-22T08:40:20.318746+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:30:40.478521+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"32'15","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:42.464911+0000","last_change":"2024-09-22T08:40:42.464842+0000","last_active":"2024-09-22T08:40:42.464911+0000","last_peered":"2024-09-22T08:40:42.464911+0000","last_clean":"2024-09-22T08:40:42.464911+0000","last_became_active":"2024-09-22T08:36:29.994352+0000","last_became_peered":"2024-09-22T08:36:29.994352+0000","last_unstale":"2024-09-22T08:40:42.464911+0000","last_undegraded":"2024-09-22T08:40:42.464911+0000","last_fullsized":"2024-09-22T08:40:42.464911+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'15","last_scrub_stamp":"2024-09-22T08:40:42.464741+0000","last_deep_scrub":"32'15","last_deep_scrub_stamp":"2024-09-22T08:40:42.464741+0000","last_clean_scrub_stamp":"2024-09-22T08:40:42.464741+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:44:06.261050+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"32'286","reported_seq":475,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:34.428565+0000","last_change":"2024-09-22T08:40:34.428565+0000","last_active":"2024-09-22T08:40:34.428565+0000","last_peered":"2024-09-22T08:40:34.428565+0000","last_clean":"2024-09-22T08:40:34.428565+0000","last_became_active":"2024-09-22T08:36:32.002222+0000","last_became_peered":"2024-09-22T08:36:32.002222+0000","last_unstale":"2024-09-22T08:40:34.428565+0000","last_undegraded":"2024-09-22T08:40:34.428565+0000","last_fullsized":"2024-09-22T08:40:34.428565+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'286","last_scrub_stamp":"2024-09-22T08:40:34.428477+0000","last_deep_scrub":"32'286","last_deep_scrub_stamp":"2024-09-22T08:40:34.428477+0000","last_clean_scrub_stamp":"2024-09-22T08:40:34.428477+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:31:06.442355+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"32'4","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:30.424006+0000","last_change":"2024-09-22T08:40:30.423936+0000","last_active":"2024-09-22T08:40:30.424006+0000","last_peered":"2024-09-22T08:40:30.424006+0000","last_clean":"2024-09-22T08:40:30.424006+0000","last_became_active":"2024-09-22T08:36:34.015833+0000","last_became_peered":"2024-09-22T08:36:34.015833+0000","last_unstale":"2024-09-22T08:40:30.424006+0000","last_undegraded":"2024-09-22T08:40:30.424006+0000","last_fullsized":"2024-09-22T08:40:30.424006+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-22T08:40:30.423809+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-22T08:40:30.423809+0000","last_clean_scrub_stamp":"2024-09-22T08:40:30.423809+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:59:43.892086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"32'6","reported_seq":61,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:02.310305+0000","last_change":"2024-09-22T08:40:02.310213+0000","last_active":"2024-09-22T08:40:02.310305+0000","last_peered":"2024-09-22T08:40:02.310305+0000","last_clean":"2024-09-22T08:40:02.310305+0000","last_became_active":"2024-09-22T08:36:25.977184+0000","last_became_peered":"2024-09-22T08:36:25.977184+0000","last_unstale":"2024-09-22T08:40:02.310305+0000","last_undegraded":"2024-09-22T08:40:02.310305+0000","last_fullsized":"2024-09-22T08:40:02.310305+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-22T08:40:02.310094+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-22T08:40:02.310094+0000","last_clean_scrub_stamp":"2024-09-22T08:40:02.310094+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:42:25.082452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"32'8","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:46.401458+0000","last_change":"2024-09-22T08:39:46.401339+0000","last_active":"2024-09-22T08:39:46.401458+0000","last_peered":"2024-09-22T08:39:46.401458+0000","last_clean":"2024-09-22T08:39:46.401458+0000","last_became_active":"2024-09-22T08:36:23.976129+0000","last_became_peered":"2024-09-22T08:36:23.976129+0000","last_unstale":"2024-09-22T08:39:46.401458+0000","last_undegraded":"2024-09-22T08:39:46.401458+0000","last_fullsized":"2024-09-22T08:39:46.401458+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-22T08:39:46.401243+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-22T08:39:46.401243+0000","last_clean_scrub_stamp":"2024-09-22T08:39:46.401243+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:53:00.898981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":14,"num_write":48,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"32'2","reported_seq":231,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:32.464697+0000","last_change":"2024-09-22T08:40:32.464599+0000","last_active":"2024-09-22T08:40:32.464697+0000","last_peered":"2024-09-22T08:40:32.464697+0000","last_clean":"2024-09-22T08:40:32.464697+0000","last_became_active":"2024-09-22T08:36:27.987999+0000","last_became_peered":"2024-09-22T08:36:27.987999+0000","last_unstale":"2024-09-22T08:40:32.464697+0000","last_undegraded":"2024-09-22T08:40:32.464697+0000","last_fullsized":"2024-09-22T08:40:32.464697+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-22T08:40:32.464497+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-22T08:40:32.464497+0000","last_clean_scrub_stamp":"2024-09-22T08:40:32.464497+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:22:06.660471+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"32'49","reported_seq":109,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:29.327544+0000","last_change":"2024-09-22T08:40:29.327491+0000","last_active":"2024-09-22T08:40:29.327544+0000","last_peered":"2024-09-22T08:40:29.327544+0000","last_clean":"2024-09-22T08:40:29.327544+0000","last_became_active":"2024-09-22T08:36:29.991671+0000","last_became_peered":"2024-09-22T08:36:29.991671+0000","last_unstale":"2024-09-22T08:40:29.327544+0000","last_undegraded":"2024-09-22T08:40:29.327544+0000","last_fullsized":"2024-09-22T08:40:29.327544+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'49","last_scrub_stamp":"2024-09-22T08:40:29.327390+0000","last_deep_scrub":"32'49","last_deep_scrub_stamp":"2024-09-22T08:40:29.327390+0000","last_clean_scrub_stamp":"2024-09-22T08:40:29.327390+0000","objects_scrubbed":8,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:58:23.936556+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:23.395412+0000","last_change":"2024-09-22T08:40:23.395412+0000","last_active":"2024-09-22T08:40:23.395412+0000","last_peered":"2024-09-22T08:40:23.395412+0000","last_clean":"2024-09-22T08:40:23.395412+0000","last_became_active":"2024-09-22T08:36:32.011845+0000","last_became_peered":"2024-09-22T08:36:32.011845+0000","last_unstale":"2024-09-22T08:40:23.395412+0000","last_undegraded":"2024-09-22T08:40:23.395412+0000","last_fullsized":"2024-09-22T08:40:23.395412+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:23.395314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:23.395314+0000","last_clean_scrub_stamp":"2024-09-22T08:40:23.395314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:11:41.447101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"32'7","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:39.357147+0000","last_change":"2024-09-22T08:40:39.357094+0000","last_active":"2024-09-22T08:40:39.357147+0000","last_peered":"2024-09-22T08:40:39.357147+0000","last_clean":"2024-09-22T08:40:39.357147+0000","last_became_active":"2024-09-22T08:36:34.008374+0000","last_became_peered":"2024-09-22T08:36:34.008374+0000","last_unstale":"2024-09-22T08:40:39.357147+0000","last_undegraded":"2024-09-22T08:40:39.357147+0000","last_fullsized":"2024-09-22T08:40:39.357147+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'7","last_scrub_stamp":"2024-09-22T08:40:39.356998+0000","last_deep_scrub":"32'7","last_deep_scrub_stamp":"2024-09-22T08:40:39.356998+0000","last_clean_scrub_stamp":"2024-09-22T08:40:39.356998+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:11:53.008163+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"32'15","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:54.643440+0000","last_change":"2024-09-22T08:39:54.643440+0000","last_active":"2024-09-22T08:39:54.643440+0000","last_peered":"2024-09-22T08:39:54.643440+0000","last_clean":"2024-09-22T08:39:54.643440+0000","last_became_active":"2024-09-22T08:37:04.228680+0000","last_became_peered":"2024-09-22T08:37:04.228680+0000","last_unstale":"2024-09-22T08:39:54.643440+0000","last_undegraded":"2024-09-22T08:39:54.643440+0000","last_fullsized":"2024-09-22T08:39:54.643440+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'15","last_scrub_stamp":"2024-09-22T08:39:54.643331+0000","last_deep_scrub":"32'15","last_deep_scrub_stamp":"2024-09-22T08:39:54.643331+0000","last_clean_scrub_stamp":"2024-09-22T08:39:54.643331+0000","objects_scrubbed":1,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:10:02.228729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":62,"num_read_kb":54,"num_write":19,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"32'74","reported_seq":153,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:43.060244+0000","last_change":"2024-09-22T08:39:43.060183+0000","last_active":"2024-09-22T08:39:43.060244+0000","last_peered":"2024-09-22T08:39:43.060244+0000","last_clean":"2024-09-22T08:39:43.060244+0000","last_became_active":"2024-09-22T08:36:10.736221+0000","last_became_peered":"2024-09-22T08:36:10.736221+0000","last_unstale":"2024-09-22T08:39:43.060244+0000","last_undegraded":"2024-09-22T08:39:43.060244+0000","last_fullsized":"2024-09-22T08:39:43.060244+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'74","last_scrub_stamp":"2024-09-22T08:39:43.060088+0000","last_deep_scrub":"32'74","last_deep_scrub_stamp":"2024-09-22T08:39:43.060088+0000","last_clean_scrub_stamp":"2024-09-22T08:39:43.060088+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:47:30.182707+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"32'2","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:45.437361+0000","last_change":"2024-09-22T08:39:45.437270+0000","last_active":"2024-09-22T08:39:45.437361+0000","last_peered":"2024-09-22T08:39:45.437361+0000","last_clean":"2024-09-22T08:39:45.437361+0000","last_became_active":"2024-09-22T08:36:16.425465+0000","last_became_peered":"2024-09-22T08:36:16.425465+0000","last_unstale":"2024-09-22T08:39:45.437361+0000","last_undegraded":"2024-09-22T08:39:45.437361+0000","last_fullsized":"2024-09-22T08:39:45.437361+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-22T08:39:45.437175+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-22T08:39:45.437175+0000","last_clean_scrub_stamp":"2024-09-22T08:39:45.437175+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:50:58.216244+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00049376300000000004,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"32'6","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:48.401446+0000","last_change":"2024-09-22T08:39:48.401375+0000","last_active":"2024-09-22T08:39:48.401446+0000","last_peered":"2024-09-22T08:39:48.401446+0000","last_clean":"2024-09-22T08:39:48.401446+0000","last_became_active":"2024-09-22T08:36:23.981576+0000","last_became_peered":"2024-09-22T08:36:23.981576+0000","last_unstale":"2024-09-22T08:39:48.401446+0000","last_undegraded":"2024-09-22T08:39:48.401446+0000","last_fullsized":"2024-09-22T08:39:48.401446+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-22T08:39:48.401293+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-22T08:39:48.401293+0000","last_clean_scrub_stamp":"2024-09-22T08:39:48.401293+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:49:36.460213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4,"num_write":22,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:19.267565+0000","last_change":"2024-09-22T08:40:19.267513+0000","last_active":"2024-09-22T08:40:19.267565+0000","last_peered":"2024-09-22T08:40:19.267565+0000","last_clean":"2024-09-22T08:40:19.267565+0000","last_became_active":"2024-09-22T08:36:27.991130+0000","last_became_peered":"2024-09-22T08:36:27.991130+0000","last_unstale":"2024-09-22T08:40:19.267565+0000","last_undegraded":"2024-09-22T08:40:19.267565+0000","last_fullsized":"2024-09-22T08:40:19.267565+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:19.267432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:19.267432+0000","last_clean_scrub_stamp":"2024-09-22T08:40:19.267432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:24:25.931908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"32'90","reported_seq":181,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:39.437213+0000","last_change":"2024-09-22T08:40:39.437157+0000","last_active":"2024-09-22T08:40:39.437213+0000","last_peered":"2024-09-22T08:40:39.437213+0000","last_clean":"2024-09-22T08:40:39.437213+0000","last_became_active":"2024-09-22T08:36:29.997294+0000","last_became_peered":"2024-09-22T08:36:29.997294+0000","last_unstale":"2024-09-22T08:40:39.437213+0000","last_undegraded":"2024-09-22T08:40:39.437213+0000","last_fullsized":"2024-09-22T08:40:39.437213+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'90","last_scrub_stamp":"2024-09-22T08:40:39.437041+0000","last_deep_scrub":"32'90","last_deep_scrub_stamp":"2024-09-22T08:40:39.437041+0000","last_clean_scrub_stamp":"2024-09-22T08:40:39.437041+0000","objects_scrubbed":5,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:28:01.417583+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:28.901799+0000","last_change":"2024-09-22T08:40:28.901745+0000","last_active":"2024-09-22T08:40:28.901799+0000","last_peered":"2024-09-22T08:40:28.901799+0000","last_clean":"2024-09-22T08:40:28.901799+0000","last_became_active":"2024-09-22T08:36:32.008793+0000","last_became_peered":"2024-09-22T08:36:32.008793+0000","last_unstale":"2024-09-22T08:40:28.901799+0000","last_undegraded":"2024-09-22T08:40:28.901799+0000","last_fullsized":"2024-09-22T08:40:28.901799+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:28.901664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:28.901664+0000","last_clean_scrub_stamp":"2024-09-22T08:40:28.901664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:13:27.046620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"32'81","reported_seq":172,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:32.515792+0000","last_change":"2024-09-22T08:40:32.515709+0000","last_active":"2024-09-22T08:40:32.515792+0000","last_peered":"2024-09-22T08:40:32.515792+0000","last_clean":"2024-09-22T08:40:32.515792+0000","last_became_active":"2024-09-22T08:36:34.016484+0000","last_became_peered":"2024-09-22T08:36:34.016484+0000","last_unstale":"2024-09-22T08:40:32.515792+0000","last_undegraded":"2024-09-22T08:40:32.515792+0000","last_fullsized":"2024-09-22T08:40:32.515792+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'81","last_scrub_stamp":"2024-09-22T08:40:32.515595+0000","last_deep_scrub":"32'81","last_deep_scrub_stamp":"2024-09-22T08:40:32.515595+0000","last_clean_scrub_stamp":"2024-09-22T08:40:32.515595+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:41:51.757595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":223,"num_read_kb":221,"num_write":155,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"32'6","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:10.409177+0000","last_change":"2024-09-22T08:40:10.409088+0000","last_active":"2024-09-22T08:40:10.409177+0000","last_peered":"2024-09-22T08:40:10.409177+0000","last_clean":"2024-09-22T08:40:10.409177+0000","last_became_active":"2024-09-22T08:36:25.988156+0000","last_became_peered":"2024-09-22T08:36:25.988156+0000","last_unstale":"2024-09-22T08:40:10.409177+0000","last_undegraded":"2024-09-22T08:40:10.409177+0000","last_fullsized":"2024-09-22T08:40:10.409177+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-22T08:40:10.409006+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-22T08:40:10.409006+0000","last_clean_scrub_stamp":"2024-09-22T08:40:10.409006+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:49:55.381873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:43.491544+0000","last_change":"2024-09-22T08:39:43.491476+0000","last_active":"2024-09-22T08:39:43.491544+0000","last_peered":"2024-09-22T08:39:43.491544+0000","last_clean":"2024-09-22T08:39:43.491544+0000","last_became_active":"2024-09-22T08:36:16.427252+0000","last_became_peered":"2024-09-22T08:36:16.427252+0000","last_unstale":"2024-09-22T08:39:43.491544+0000","last_undegraded":"2024-09-22T08:39:43.491544+0000","last_fullsized":"2024-09-22T08:39:43.491544+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:39:43.491364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:39:43.491364+0000","last_clean_scrub_stamp":"2024-09-22T08:39:43.491364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:29:57.540388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055484200000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:43.847108+0000","last_change":"2024-09-22T08:39:43.847049+0000","last_active":"2024-09-22T08:39:43.847108+0000","last_peered":"2024-09-22T08:39:43.847108+0000","last_clean":"2024-09-22T08:39:43.847108+0000","last_became_active":"2024-09-22T08:36:23.973773+0000","last_became_peered":"2024-09-22T08:36:23.973773+0000","last_unstale":"2024-09-22T08:39:43.847108+0000","last_undegraded":"2024-09-22T08:39:43.847108+0000","last_fullsized":"2024-09-22T08:39:43.847108+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:39:43.846973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:39:43.846973+0000","last_clean_scrub_stamp":"2024-09-22T08:39:43.846973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:25:33.678376+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:31.496817+0000","last_change":"2024-09-22T08:40:31.496770+0000","last_active":"2024-09-22T08:40:31.496817+0000","last_peered":"2024-09-22T08:40:31.496817+0000","last_clean":"2024-09-22T08:40:31.496817+0000","last_became_active":"2024-09-22T08:37:04.234316+0000","last_became_peered":"2024-09-22T08:37:04.234316+0000","last_unstale":"2024-09-22T08:40:31.496817+0000","last_undegraded":"2024-09-22T08:40:31.496817+0000","last_fullsized":"2024-09-22T08:40:31.496817+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:31.496690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:31.496690+0000","last_clean_scrub_stamp":"2024-09-22T08:40:31.496690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:41:42.239723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"32'295","reported_seq":520,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:28.302291+0000","last_change":"2024-09-22T08:40:28.302225+0000","last_active":"2024-09-22T08:40:28.302291+0000","last_peered":"2024-09-22T08:40:28.302291+0000","last_clean":"2024-09-22T08:40:28.302291+0000","last_became_active":"2024-09-22T08:36:29.996025+0000","last_became_peered":"2024-09-22T08:36:29.996025+0000","last_unstale":"2024-09-22T08:40:28.302291+0000","last_undegraded":"2024-09-22T08:40:28.302291+0000","last_fullsized":"2024-09-22T08:40:28.302291+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'295","last_scrub_stamp":"2024-09-22T08:40:28.302127+0000","last_deep_scrub":"32'295","last_deep_scrub_stamp":"2024-09-22T08:40:28.302127+0000","last_clean_scrub_stamp":"2024-09-22T08:40:28.302127+0000","objects_scrubbed":10,"log_size":295,"log_dups_size":0,"ondisk_log_size":295,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:25:44.934346+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":378,"num_read_kb":363,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:50.452733+0000","last_change":"2024-09-22T08:40:50.452733+0000","last_active":"2024-09-22T08:40:50.452733+0000","last_peered":"2024-09-22T08:40:50.452733+0000","last_clean":"2024-09-22T08:40:50.452733+0000","last_became_active":"2024-09-22T08:36:32.013220+0000","last_became_peered":"2024-09-22T08:36:32.013220+0000","last_unstale":"2024-09-22T08:40:50.452733+0000","last_undegraded":"2024-09-22T08:40:50.452733+0000","last_fullsized":"2024-09-22T08:40:50.452733+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:50.452643+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:50.452643+0000","last_clean_scrub_stamp":"2024-09-22T08:40:50.452643+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:16:43.041929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"32'5","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:42.427154+0000","last_change":"2024-09-22T08:40:42.427033+0000","last_active":"2024-09-22T08:40:42.427154+0000","last_peered":"2024-09-22T08:40:42.427154+0000","last_clean":"2024-09-22T08:40:42.427154+0000","last_became_active":"2024-09-22T08:36:34.018138+0000","last_became_peered":"2024-09-22T08:36:34.018138+0000","last_unstale":"2024-09-22T08:40:42.427154+0000","last_undegraded":"2024-09-22T08:40:42.427154+0000","last_fullsized":"2024-09-22T08:40:42.427154+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'5","last_scrub_stamp":"2024-09-22T08:40:42.426938+0000","last_deep_scrub":"32'5","last_deep_scrub_stamp":"2024-09-22T08:40:42.426938+0000","last_clean_scrub_stamp":"2024-09-22T08:40:42.426938+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:41:01.931942+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"32'8","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:01.792973+0000","last_change":"2024-09-22T08:40:01.792896+0000","last_active":"2024-09-22T08:40:01.792973+0000","last_peered":"2024-09-22T08:40:01.792973+0000","last_clean":"2024-09-22T08:40:01.792973+0000","last_became_active":"2024-09-22T08:36:25.979108+0000","last_became_peered":"2024-09-22T08:36:25.979108+0000","last_unstale":"2024-09-22T08:40:01.792973+0000","last_undegraded":"2024-09-22T08:40:01.792973+0000","last_fullsized":"2024-09-22T08:40:01.792973+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-22T08:40:01.792800+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-22T08:40:01.792800+0000","last_clean_scrub_stamp":"2024-09-22T08:40:01.792800+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:15:50.070182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:43.605375+0000","last_change":"2024-09-22T08:39:43.605309+0000","last_active":"2024-09-22T08:39:43.605375+0000","last_peered":"2024-09-22T08:39:43.605375+0000","last_clean":"2024-09-22T08:39:43.605375+0000","last_became_active":"2024-09-22T08:36:16.427121+0000","last_became_peered":"2024-09-22T08:36:16.427121+0000","last_unstale":"2024-09-22T08:39:43.605375+0000","last_undegraded":"2024-09-22T08:39:43.605375+0000","last_fullsized":"2024-09-22T08:39:43.605375+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:39:43.605211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:39:43.605211+0000","last_clean_scrub_stamp":"2024-09-22T08:39:43.605211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:07:42.970630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041194099999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:44.812049+0000","last_change":"2024-09-22T08:39:44.811985+0000","last_active":"2024-09-22T08:39:44.812049+0000","last_peered":"2024-09-22T08:39:44.812049+0000","last_clean":"2024-09-22T08:39:44.812049+0000","last_became_active":"2024-09-22T08:36:23.971688+0000","last_became_peered":"2024-09-22T08:36:23.971688+0000","last_unstale":"2024-09-22T08:39:44.812049+0000","last_undegraded":"2024-09-22T08:39:44.812049+0000","last_fullsized":"2024-09-22T08:39:44.812049+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-22T08:39:44.811892+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-22T08:39:44.811892+0000","last_clean_scrub_stamp":"2024-09-22T08:39:44.811892+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:25:37.511699+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:10.368342+0000","last_change":"2024-09-22T08:40:10.368238+0000","last_active":"2024-09-22T08:40:10.368342+0000","last_peered":"2024-09-22T08:40:10.368342+0000","last_clean":"2024-09-22T08:40:10.368342+0000","last_became_active":"2024-09-22T08:36:27.986993+0000","last_became_peered":"2024-09-22T08:36:27.986993+0000","last_unstale":"2024-09-22T08:40:10.368342+0000","last_undegraded":"2024-09-22T08:40:10.368342+0000","last_fullsized":"2024-09-22T08:40:10.368342+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-22T08:40:10.368133+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-22T08:40:10.368133+0000","last_clean_scrub_stamp":"2024-09-22T08:40:10.368133+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:08:05.798320+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"32'25","reported_seq":102,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:18.403483+0000","last_change":"2024-09-22T08:40:18.403402+0000","last_active":"2024-09-22T08:40:18.403483+0000","last_peered":"2024-09-22T08:40:18.403483+0000","last_clean":"2024-09-22T08:40:18.403483+0000","last_became_active":"2024-09-22T08:36:29.991579+0000","last_became_peered":"2024-09-22T08:36:29.991579+0000","last_unstale":"2024-09-22T08:40:18.403483+0000","last_undegraded":"2024-09-22T08:40:18.403483+0000","last_fullsized":"2024-09-22T08:40:18.403483+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'25","last_scrub_stamp":"2024-09-22T08:40:18.403282+0000","last_deep_scrub":"32'25","last_deep_scrub_stamp":"2024-09-22T08:40:18.403282+0000","last_clean_scrub_stamp":"2024-09-22T08:40:18.403282+0000","objects_scrubbed":8,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:10:52.856214+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:27.890107+0000","last_change":"2024-09-22T08:40:27.890053+0000","last_active":"2024-09-22T08:40:27.890107+0000","last_peered":"2024-09-22T08:40:27.890107+0000","last_clean":"2024-09-22T08:40:27.890107+0000","last_became_active":"2024-09-22T08:36:32.011634+0000","last_became_peered":"2024-09-22T08:36:32.011634+0000","last_unstale":"2024-09-22T08:40:27.890107+0000","last_undegraded":"2024-09-22T08:40:27.890107+0000","last_fullsized":"2024-09-22T08:40:27.890107+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:27.889962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:27.889962+0000","last_clean_scrub_stamp":"2024-09-22T08:40:27.889962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:50:15.948882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:57.388473+0000","last_change":"2024-09-22T08:40:57.388420+0000","last_active":"2024-09-22T08:40:57.388473+0000","last_peered":"2024-09-22T08:40:57.388473+0000","last_clean":"2024-09-22T08:40:57.388473+0000","last_became_active":"2024-09-22T08:36:34.011936+0000","last_became_peered":"2024-09-22T08:36:34.011936+0000","last_unstale":"2024-09-22T08:40:57.388473+0000","last_undegraded":"2024-09-22T08:40:57.388473+0000","last_fullsized":"2024-09-22T08:40:57.388473+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:57.388316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:57.388316+0000","last_clean_scrub_stamp":"2024-09-22T08:40:57.388316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:34:32.635355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"32'3","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:59.876344+0000","last_change":"2024-09-22T08:39:59.876252+0000","last_active":"2024-09-22T08:39:59.876344+0000","last_peered":"2024-09-22T08:39:59.876344+0000","last_clean":"2024-09-22T08:39:59.876344+0000","last_became_active":"2024-09-22T08:36:25.977552+0000","last_became_peered":"2024-09-22T08:36:25.977552+0000","last_unstale":"2024-09-22T08:39:59.876344+0000","last_undegraded":"2024-09-22T08:39:59.876344+0000","last_fullsized":"2024-09-22T08:39:59.876344+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2024-09-22T08:39:59.876163+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2024-09-22T08:39:59.876163+0000","last_clean_scrub_stamp":"2024-09-22T08:39:59.876163+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:26:06.074309+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"32'3","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:44.485676+0000","last_change":"2024-09-22T08:39:44.485607+0000","last_active":"2024-09-22T08:39:44.485676+0000","last_peered":"2024-09-22T08:39:44.485676+0000","last_clean":"2024-09-22T08:39:44.485676+0000","last_became_active":"2024-09-22T08:36:16.427358+0000","last_became_peered":"2024-09-22T08:36:16.427358+0000","last_unstale":"2024-09-22T08:39:44.485676+0000","last_undegraded":"2024-09-22T08:39:44.485676+0000","last_fullsized":"2024-09-22T08:39:44.485676+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2024-09-22T08:39:44.485523+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2024-09-22T08:39:44.485523+0000","last_clean_scrub_stamp":"2024-09-22T08:39:44.485523+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:22:57.579671+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.001068835,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"32'4","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:45.577448+0000","last_change":"2024-09-22T08:39:45.577394+0000","last_active":"2024-09-22T08:39:45.577448+0000","last_peered":"2024-09-22T08:39:45.577448+0000","last_clean":"2024-09-22T08:39:45.577448+0000","last_became_active":"2024-09-22T08:36:23.967413+0000","last_became_peered":"2024-09-22T08:36:23.967413+0000","last_unstale":"2024-09-22T08:39:45.577448+0000","last_undegraded":"2024-09-22T08:39:45.577448+0000","last_fullsized":"2024-09-22T08:39:45.577448+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-22T08:39:45.577315+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-22T08:39:45.577315+0000","last_clean_scrub_stamp":"2024-09-22T08:39:45.577315+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:36:05.444054+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:13.869243+0000","last_change":"2024-09-22T08:40:13.869191+0000","last_active":"2024-09-22T08:40:13.869243+0000","last_peered":"2024-09-22T08:40:13.869243+0000","last_clean":"2024-09-22T08:40:13.869243+0000","last_became_active":"2024-09-22T08:36:27.988507+0000","last_became_peered":"2024-09-22T08:36:27.988507+0000","last_unstale":"2024-09-22T08:40:13.869243+0000","last_undegraded":"2024-09-22T08:40:13.869243+0000","last_fullsized":"2024-09-22T08:40:13.869243+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:13.869104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:13.869104+0000","last_clean_scrub_stamp":"2024-09-22T08:40:13.869104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:02:34.608102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"32'20","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:38.468998+0000","last_change":"2024-09-22T08:40:38.468919+0000","last_active":"2024-09-22T08:40:38.468998+0000","last_peered":"2024-09-22T08:40:38.468998+0000","last_clean":"2024-09-22T08:40:38.468998+0000","last_became_active":"2024-09-22T08:36:29.996557+0000","last_became_peered":"2024-09-22T08:36:29.996557+0000","last_unstale":"2024-09-22T08:40:38.468998+0000","last_undegraded":"2024-09-22T08:40:38.468998+0000","last_fullsized":"2024-09-22T08:40:38.468998+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'20","last_scrub_stamp":"2024-09-22T08:40:38.468792+0000","last_deep_scrub":"32'20","last_deep_scrub_stamp":"2024-09-22T08:40:38.468792+0000","last_clean_scrub_stamp":"2024-09-22T08:40:38.468792+0000","objects_scrubbed":7,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:26:15.989751+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":394,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:51.413684+0000","last_change":"2024-09-22T08:40:51.413632+0000","last_active":"2024-09-22T08:40:51.413684+0000","last_peered":"2024-09-22T08:40:51.413684+0000","last_clean":"2024-09-22T08:40:51.413684+0000","last_became_active":"2024-09-22T08:36:32.013320+0000","last_became_peered":"2024-09-22T08:36:32.013320+0000","last_unstale":"2024-09-22T08:40:51.413684+0000","last_undegraded":"2024-09-22T08:40:51.413684+0000","last_fullsized":"2024-09-22T08:40:51.413684+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:51.413543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:51.413543+0000","last_clean_scrub_stamp":"2024-09-22T08:40:51.413543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:16:39.470689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"32'4","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:41.380693+0000","last_change":"2024-09-22T08:40:41.380636+0000","last_active":"2024-09-22T08:40:41.380693+0000","last_peered":"2024-09-22T08:40:41.380693+0000","last_clean":"2024-09-22T08:40:41.380693+0000","last_became_active":"2024-09-22T08:36:34.015483+0000","last_became_peered":"2024-09-22T08:36:34.015483+0000","last_unstale":"2024-09-22T08:40:41.380693+0000","last_undegraded":"2024-09-22T08:40:41.380693+0000","last_fullsized":"2024-09-22T08:40:41.380693+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-22T08:40:41.380561+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-22T08:40:41.380561+0000","last_clean_scrub_stamp":"2024-09-22T08:40:41.380561+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:56:27.197664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"32'8","reported_seq":71,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:58.302503+0000","last_change":"2024-09-22T08:39:58.302415+0000","last_active":"2024-09-22T08:39:58.302503+0000","last_peered":"2024-09-22T08:39:58.302503+0000","last_clean":"2024-09-22T08:39:58.302503+0000","last_became_active":"2024-09-22T08:36:25.986551+0000","last_became_peered":"2024-09-22T08:36:25.986551+0000","last_unstale":"2024-09-22T08:39:58.302503+0000","last_undegraded":"2024-09-22T08:39:58.302503+0000","last_fullsized":"2024-09-22T08:39:58.302503+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-22T08:39:58.302310+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-22T08:39:58.302310+0000","last_clean_scrub_stamp":"2024-09-22T08:39:58.302310+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:59:40.615258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:44.562290+0000","last_change":"2024-09-22T08:39:44.562216+0000","last_active":"2024-09-22T08:39:44.562290+0000","last_peered":"2024-09-22T08:39:44.562290+0000","last_clean":"2024-09-22T08:39:44.562290+0000","last_became_active":"2024-09-22T08:36:23.968525+0000","last_became_peered":"2024-09-22T08:36:23.968525+0000","last_unstale":"2024-09-22T08:39:44.562290+0000","last_undegraded":"2024-09-22T08:39:44.562290+0000","last_fullsized":"2024-09-22T08:39:44.562290+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:39:44.562132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:39:44.562132+0000","last_clean_scrub_stamp":"2024-09-22T08:39:44.562132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:35:46.943109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:47.806794+0000","last_change":"2024-09-22T08:39:47.806728+0000","last_active":"2024-09-22T08:39:47.806794+0000","last_peered":"2024-09-22T08:39:47.806794+0000","last_clean":"2024-09-22T08:39:47.806794+0000","last_became_active":"2024-09-22T08:36:16.424946+0000","last_became_peered":"2024-09-22T08:36:16.424946+0000","last_unstale":"2024-09-22T08:39:47.806794+0000","last_undegraded":"2024-09-22T08:39:47.806794+0000","last_fullsized":"2024-09-22T08:39:47.806794+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:39:47.806631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:39:47.806631+0000","last_clean_scrub_stamp":"2024-09-22T08:39:47.806631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:54:30.955543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045979400000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:12.856893+0000","last_change":"2024-09-22T08:40:12.856795+0000","last_active":"2024-09-22T08:40:12.856893+0000","last_peered":"2024-09-22T08:40:12.856893+0000","last_clean":"2024-09-22T08:40:12.856893+0000","last_became_active":"2024-09-22T08:36:27.987997+0000","last_became_peered":"2024-09-22T08:36:27.987997+0000","last_unstale":"2024-09-22T08:40:12.856893+0000","last_undegraded":"2024-09-22T08:40:12.856893+0000","last_fullsized":"2024-09-22T08:40:12.856893+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-22T08:40:12.856666+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-22T08:40:12.856666+0000","last_clean_scrub_stamp":"2024-09-22T08:40:12.856666+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:42:45.227704+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"32'78","reported_seq":155,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:20.854794+0000","last_change":"2024-09-22T08:40:20.854705+0000","last_active":"2024-09-22T08:40:20.854794+0000","last_peered":"2024-09-22T08:40:20.854794+0000","last_clean":"2024-09-22T08:40:20.854794+0000","last_became_active":"2024-09-22T08:36:29.994186+0000","last_became_peered":"2024-09-22T08:36:29.994186+0000","last_unstale":"2024-09-22T08:40:20.854794+0000","last_undegraded":"2024-09-22T08:40:20.854794+0000","last_fullsized":"2024-09-22T08:40:20.854794+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'78","last_scrub_stamp":"2024-09-22T08:40:20.854613+0000","last_deep_scrub":"32'78","last_deep_scrub_stamp":"2024-09-22T08:40:20.854613+0000","last_clean_scrub_stamp":"2024-09-22T08:40:20.854613+0000","objects_scrubbed":9,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:26:34.671090+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":336,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:24.430202+0000","last_change":"2024-09-22T08:40:24.430143+0000","last_active":"2024-09-22T08:40:24.430202+0000","last_peered":"2024-09-22T08:40:24.430202+0000","last_clean":"2024-09-22T08:40:24.430202+0000","last_became_active":"2024-09-22T08:36:32.003409+0000","last_became_peered":"2024-09-22T08:36:32.003409+0000","last_unstale":"2024-09-22T08:40:24.430202+0000","last_undegraded":"2024-09-22T08:40:24.430202+0000","last_fullsized":"2024-09-22T08:40:24.430202+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:24.430063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:24.430063+0000","last_clean_scrub_stamp":"2024-09-22T08:40:24.430063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:40:44.394913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"32'13","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:40.819229+0000","last_change":"2024-09-22T08:40:40.819162+0000","last_active":"2024-09-22T08:40:40.819229+0000","last_peered":"2024-09-22T08:40:40.819229+0000","last_clean":"2024-09-22T08:40:40.819229+0000","last_became_active":"2024-09-22T08:36:34.012782+0000","last_became_peered":"2024-09-22T08:36:34.012782+0000","last_unstale":"2024-09-22T08:40:40.819229+0000","last_undegraded":"2024-09-22T08:40:40.819229+0000","last_fullsized":"2024-09-22T08:40:40.819229+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'13","last_scrub_stamp":"2024-09-22T08:40:40.819048+0000","last_deep_scrub":"32'13","last_deep_scrub_stamp":"2024-09-22T08:40:40.819048+0000","last_clean_scrub_stamp":"2024-09-22T08:40:40.819048+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:29:44.631733+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":25,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"32'6","reported_seq":61,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:59.336001+0000","last_change":"2024-09-22T08:39:59.335942+0000","last_active":"2024-09-22T08:39:59.336001+0000","last_peered":"2024-09-22T08:39:59.336001+0000","last_clean":"2024-09-22T08:39:59.336001+0000","last_became_active":"2024-09-22T08:36:25.984820+0000","last_became_peered":"2024-09-22T08:36:25.984820+0000","last_unstale":"2024-09-22T08:39:59.336001+0000","last_undegraded":"2024-09-22T08:39:59.336001+0000","last_fullsized":"2024-09-22T08:39:59.336001+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-22T08:39:59.335838+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-22T08:39:59.335838+0000","last_clean_scrub_stamp":"2024-09-22T08:39:59.335838+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:19:14.131941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":29,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:45.773799+0000","last_change":"2024-09-22T08:39:45.773739+0000","last_active":"2024-09-22T08:39:45.773799+0000","last_peered":"2024-09-22T08:39:45.773799+0000","last_clean":"2024-09-22T08:39:45.773799+0000","last_became_active":"2024-09-22T08:36:23.973672+0000","last_became_peered":"2024-09-22T08:36:23.973672+0000","last_unstale":"2024-09-22T08:39:45.773799+0000","last_undegraded":"2024-09-22T08:39:45.773799+0000","last_fullsized":"2024-09-22T08:39:45.773799+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-22T08:39:45.773661+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-22T08:39:45.773661+0000","last_clean_scrub_stamp":"2024-09-22T08:39:45.773661+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:51:32.967955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:49.427544+0000","last_change":"2024-09-22T08:39:49.427484+0000","last_active":"2024-09-22T08:39:49.427544+0000","last_peered":"2024-09-22T08:39:49.427544+0000","last_clean":"2024-09-22T08:39:49.427544+0000","last_became_active":"2024-09-22T08:36:16.427154+0000","last_became_peered":"2024-09-22T08:36:16.427154+0000","last_unstale":"2024-09-22T08:39:49.427544+0000","last_undegraded":"2024-09-22T08:39:49.427544+0000","last_fullsized":"2024-09-22T08:39:49.427544+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:39:49.427383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:39:49.427383+0000","last_clean_scrub_stamp":"2024-09-22T08:39:49.427383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:57:58.108684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081028899999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:30.533866+0000","last_change":"2024-09-22T08:40:30.533806+0000","last_active":"2024-09-22T08:40:30.533866+0000","last_peered":"2024-09-22T08:40:30.533866+0000","last_clean":"2024-09-22T08:40:30.533866+0000","last_became_active":"2024-09-22T08:37:04.233981+0000","last_became_peered":"2024-09-22T08:37:04.233981+0000","last_unstale":"2024-09-22T08:40:30.533866+0000","last_undegraded":"2024-09-22T08:40:30.533866+0000","last_fullsized":"2024-09-22T08:40:30.533866+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:30.533727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:30.533727+0000","last_clean_scrub_stamp":"2024-09-22T08:40:30.533727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:28:52.837641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"32'22","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:27.335977+0000","last_change":"2024-09-22T08:40:27.335921+0000","last_active":"2024-09-22T08:40:27.335977+0000","last_peered":"2024-09-22T08:40:27.335977+0000","last_clean":"2024-09-22T08:40:27.335977+0000","last_became_active":"2024-09-22T08:36:29.995173+0000","last_became_peered":"2024-09-22T08:36:29.995173+0000","last_unstale":"2024-09-22T08:40:27.335977+0000","last_undegraded":"2024-09-22T08:40:27.335977+0000","last_fullsized":"2024-09-22T08:40:27.335977+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'22","last_scrub_stamp":"2024-09-22T08:40:27.335811+0000","last_deep_scrub":"32'22","last_deep_scrub_stamp":"2024-09-22T08:40:27.335811+0000","last_clean_scrub_stamp":"2024-09-22T08:40:27.335811+0000","objects_scrubbed":7,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:35:18.554483+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"32'286","reported_seq":359,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:33.450070+0000","last_change":"2024-09-22T08:40:33.450012+0000","last_active":"2024-09-22T08:40:33.450070+0000","last_peered":"2024-09-22T08:40:33.450070+0000","last_clean":"2024-09-22T08:40:33.450070+0000","last_became_active":"2024-09-22T08:36:32.002985+0000","last_became_peered":"2024-09-22T08:36:32.002985+0000","last_unstale":"2024-09-22T08:40:33.450070+0000","last_undegraded":"2024-09-22T08:40:33.450070+0000","last_fullsized":"2024-09-22T08:40:33.450070+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'286","last_scrub_stamp":"2024-09-22T08:40:33.449925+0000","last_deep_scrub":"32'286","last_deep_scrub_stamp":"2024-09-22T08:40:33.449925+0000","last_clean_scrub_stamp":"2024-09-22T08:40:33.449925+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:01:58.393144+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:41:00.311227+0000","last_change":"2024-09-22T08:41:00.311167+0000","last_active":"2024-09-22T08:41:00.311227+0000","last_peered":"2024-09-22T08:41:00.311227+0000","last_clean":"2024-09-22T08:41:00.311227+0000","last_became_active":"2024-09-22T08:36:34.019438+0000","last_became_peered":"2024-09-22T08:36:34.019438+0000","last_unstale":"2024-09-22T08:41:00.311227+0000","last_undegraded":"2024-09-22T08:41:00.311227+0000","last_fullsized":"2024-09-22T08:41:00.311227+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:41:00.311051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:41:00.311051+0000","last_clean_scrub_stamp":"2024-09-22T08:41:00.311051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:51:46.712133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"32'4","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:09.397384+0000","last_change":"2024-09-22T08:40:09.397318+0000","last_active":"2024-09-22T08:40:09.397384+0000","last_peered":"2024-09-22T08:40:09.397384+0000","last_clean":"2024-09-22T08:40:09.397384+0000","last_became_active":"2024-09-22T08:36:25.991480+0000","last_became_peered":"2024-09-22T08:36:25.991480+0000","last_unstale":"2024-09-22T08:40:09.397384+0000","last_undegraded":"2024-09-22T08:40:09.397384+0000","last_fullsized":"2024-09-22T08:40:09.397384+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-22T08:40:09.397220+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-22T08:40:09.397220+0000","last_clean_scrub_stamp":"2024-09-22T08:40:09.397220+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:59:18.881844+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:46.106194+0000","last_change":"2024-09-22T08:39:46.106194+0000","last_active":"2024-09-22T08:39:46.106194+0000","last_peered":"2024-09-22T08:39:46.106194+0000","last_clean":"2024-09-22T08:39:46.106194+0000","last_became_active":"2024-09-22T08:37:04.227561+0000","last_became_peered":"2024-09-22T08:37:04.227561+0000","last_unstale":"2024-09-22T08:39:46.106194+0000","last_undegraded":"2024-09-22T08:39:46.106194+0000","last_fullsized":"2024-09-22T08:39:46.106194+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:39:46.106091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:39:46.106091+0000","last_clean_scrub_stamp":"2024-09-22T08:39:46.106091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:00:33.266036+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:42.871847+0000","last_change":"2024-09-22T08:39:42.871788+0000","last_active":"2024-09-22T08:39:42.871847+0000","last_peered":"2024-09-22T08:39:42.871847+0000","last_clean":"2024-09-22T08:39:42.871847+0000","last_became_active":"2024-09-22T08:36:16.425549+0000","last_became_peered":"2024-09-22T08:36:16.425549+0000","last_unstale":"2024-09-22T08:39:42.871847+0000","last_undegraded":"2024-09-22T08:39:42.871847+0000","last_fullsized":"2024-09-22T08:39:42.871847+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:39:42.871712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:39:42.871712+0000","last_clean_scrub_stamp":"2024-09-22T08:39:42.871712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:11:04.345633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045809600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:29.561024+0000","last_change":"2024-09-22T08:40:29.560965+0000","last_active":"2024-09-22T08:40:29.561024+0000","last_peered":"2024-09-22T08:40:29.561024+0000","last_clean":"2024-09-22T08:40:29.561024+0000","last_became_active":"2024-09-22T08:36:27.987074+0000","last_became_peered":"2024-09-22T08:36:27.987074+0000","last_unstale":"2024-09-22T08:40:29.561024+0000","last_undegraded":"2024-09-22T08:40:29.561024+0000","last_fullsized":"2024-09-22T08:40:29.561024+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:29.560881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:29.560881+0000","last_clean_scrub_stamp":"2024-09-22T08:40:29.560881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:57:35.462473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"32'15","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:37.456201+0000","last_change":"2024-09-22T08:40:37.456149+0000","last_active":"2024-09-22T08:40:37.456201+0000","last_peered":"2024-09-22T08:40:37.456201+0000","last_clean":"2024-09-22T08:40:37.456201+0000","last_became_active":"2024-09-22T08:36:29.999965+0000","last_became_peered":"2024-09-22T08:36:29.999965+0000","last_unstale":"2024-09-22T08:40:37.456201+0000","last_undegraded":"2024-09-22T08:40:37.456201+0000","last_fullsized":"2024-09-22T08:40:37.456201+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'15","last_scrub_stamp":"2024-09-22T08:40:37.456059+0000","last_deep_scrub":"32'15","last_deep_scrub_stamp":"2024-09-22T08:40:37.456059+0000","last_clean_scrub_stamp":"2024-09-22T08:40:37.456059+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:20:11.660486+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"32'286","reported_seq":402,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:31.826692+0000","last_change":"2024-09-22T08:40:31.826634+0000","last_active":"2024-09-22T08:40:31.826692+0000","last_peered":"2024-09-22T08:40:31.826692+0000","last_clean":"2024-09-22T08:40:31.826692+0000","last_became_active":"2024-09-22T08:36:32.005155+0000","last_became_peered":"2024-09-22T08:36:32.005155+0000","last_unstale":"2024-09-22T08:40:31.826692+0000","last_undegraded":"2024-09-22T08:40:31.826692+0000","last_fullsized":"2024-09-22T08:40:31.826692+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'286","last_scrub_stamp":"2024-09-22T08:40:31.826545+0000","last_deep_scrub":"32'286","last_deep_scrub_stamp":"2024-09-22T08:40:31.826545+0000","last_clean_scrub_stamp":"2024-09-22T08:40:31.826545+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:37:09.792730+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"30'5","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:43.414159+0000","last_change":"2024-09-22T08:40:43.414159+0000","last_active":"2024-09-22T08:40:43.414159+0000","last_peered":"2024-09-22T08:40:43.414159+0000","last_clean":"2024-09-22T08:40:43.414159+0000","last_became_active":"2024-09-22T08:36:34.022313+0000","last_became_peered":"2024-09-22T08:36:34.022313+0000","last_unstale":"2024-09-22T08:40:43.414159+0000","last_undegraded":"2024-09-22T08:40:43.414159+0000","last_fullsized":"2024-09-22T08:40:43.414159+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'5","last_scrub_stamp":"2024-09-22T08:40:43.414073+0000","last_deep_scrub":"30'5","last_deep_scrub_stamp":"2024-09-22T08:40:43.414073+0000","last_clean_scrub_stamp":"2024-09-22T08:40:43.414073+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:43:45.397759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":11,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"32'4","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:05.384747+0000","last_change":"2024-09-22T08:40:05.384685+0000","last_active":"2024-09-22T08:40:05.384747+0000","last_peered":"2024-09-22T08:40:05.384747+0000","last_clean":"2024-09-22T08:40:05.384747+0000","last_became_active":"2024-09-22T08:36:25.974884+0000","last_became_peered":"2024-09-22T08:36:25.974884+0000","last_unstale":"2024-09-22T08:40:05.384747+0000","last_undegraded":"2024-09-22T08:40:05.384747+0000","last_fullsized":"2024-09-22T08:40:05.384747+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-22T08:40:05.384591+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-22T08:40:05.384591+0000","last_clean_scrub_stamp":"2024-09-22T08:40:05.384591+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:46:32.018206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"32'5","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:44.099982+0000","last_change":"2024-09-22T08:39:44.099885+0000","last_active":"2024-09-22T08:39:44.099982+0000","last_peered":"2024-09-22T08:39:44.099982+0000","last_clean":"2024-09-22T08:39:44.099982+0000","last_became_active":"2024-09-22T08:36:23.976646+0000","last_became_peered":"2024-09-22T08:36:23.976646+0000","last_unstale":"2024-09-22T08:39:44.099982+0000","last_undegraded":"2024-09-22T08:39:44.099982+0000","last_fullsized":"2024-09-22T08:39:44.099982+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'5","last_scrub_stamp":"2024-09-22T08:39:44.099774+0000","last_deep_scrub":"32'5","last_deep_scrub_stamp":"2024-09-22T08:39:44.099774+0000","last_clean_scrub_stamp":"2024-09-22T08:39:44.099774+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:33:07.255708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":11,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:47.416000+0000","last_change":"2024-09-22T08:39:47.415905+0000","last_active":"2024-09-22T08:39:47.416000+0000","last_peered":"2024-09-22T08:39:47.416000+0000","last_clean":"2024-09-22T08:39:47.416000+0000","last_became_active":"2024-09-22T08:36:16.638610+0000","last_became_peered":"2024-09-22T08:36:16.638610+0000","last_unstale":"2024-09-22T08:39:47.416000+0000","last_undegraded":"2024-09-22T08:39:47.416000+0000","last_fullsized":"2024-09-22T08:39:47.416000+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:39:47.415799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:39:47.415799+0000","last_clean_scrub_stamp":"2024-09-22T08:39:47.415799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:04:14.345231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001119264,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:28.591522+0000","last_change":"2024-09-22T08:40:28.591522+0000","last_active":"2024-09-22T08:40:28.591522+0000","last_peered":"2024-09-22T08:40:28.591522+0000","last_clean":"2024-09-22T08:40:28.591522+0000","last_became_active":"2024-09-22T08:36:27.984803+0000","last_became_peered":"2024-09-22T08:36:27.984803+0000","last_unstale":"2024-09-22T08:40:28.591522+0000","last_undegraded":"2024-09-22T08:40:28.591522+0000","last_fullsized":"2024-09-22T08:40:28.591522+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:28.591437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:28.591437+0000","last_clean_scrub_stamp":"2024-09-22T08:40:28.591437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:24:47.923964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"32'101","reported_seq":195,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:16.435274+0000","last_change":"2024-09-22T08:40:16.435220+0000","last_active":"2024-09-22T08:40:16.435274+0000","last_peered":"2024-09-22T08:40:16.435274+0000","last_clean":"2024-09-22T08:40:16.435274+0000","last_became_active":"2024-09-22T08:36:30.000270+0000","last_became_peered":"2024-09-22T08:36:30.000270+0000","last_unstale":"2024-09-22T08:40:16.435274+0000","last_undegraded":"2024-09-22T08:40:16.435274+0000","last_fullsized":"2024-09-22T08:40:16.435274+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'101","last_scrub_stamp":"2024-09-22T08:40:16.435123+0000","last_deep_scrub":"32'101","last_deep_scrub_stamp":"2024-09-22T08:40:16.435123+0000","last_clean_scrub_stamp":"2024-09-22T08:40:16.435123+0000","objects_scrubbed":8,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:28:38.145552+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4316,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":99,"num_read_kb":103,"num_write":38,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:26.915018+0000","last_change":"2024-09-22T08:40:26.914963+0000","last_active":"2024-09-22T08:40:26.915018+0000","last_peered":"2024-09-22T08:40:26.915018+0000","last_clean":"2024-09-22T08:40:26.915018+0000","last_became_active":"2024-09-22T08:36:32.002876+0000","last_became_peered":"2024-09-22T08:36:32.002876+0000","last_unstale":"2024-09-22T08:40:26.915018+0000","last_undegraded":"2024-09-22T08:40:26.915018+0000","last_fullsized":"2024-09-22T08:40:26.915018+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:26.914877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:26.914877+0000","last_clean_scrub_stamp":"2024-09-22T08:40:26.914877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:04:53.844309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"30'2","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:33.538060+0000","last_change":"2024-09-22T08:40:33.538060+0000","last_active":"2024-09-22T08:40:33.538060+0000","last_peered":"2024-09-22T08:40:33.538060+0000","last_clean":"2024-09-22T08:40:33.538060+0000","last_became_active":"2024-09-22T08:36:34.016659+0000","last_became_peered":"2024-09-22T08:36:34.016659+0000","last_unstale":"2024-09-22T08:40:33.538060+0000","last_undegraded":"2024-09-22T08:40:33.538060+0000","last_fullsized":"2024-09-22T08:40:33.538060+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-09-22T08:40:33.537969+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-09-22T08:40:33.537969+0000","last_clean_scrub_stamp":"2024-09-22T08:40:33.537969+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:00:46.689965+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:35.489737+0000","last_change":"2024-09-22T08:40:35.489685+0000","last_active":"2024-09-22T08:40:35.489737+0000","last_peered":"2024-09-22T08:40:35.489737+0000","last_clean":"2024-09-22T08:40:35.489737+0000","last_became_active":"2024-09-22T08:36:34.015241+0000","last_became_peered":"2024-09-22T08:36:34.015241+0000","last_unstale":"2024-09-22T08:40:35.489737+0000","last_undegraded":"2024-09-22T08:40:35.489737+0000","last_fullsized":"2024-09-22T08:40:35.489737+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:35.489579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:35.489579+0000","last_clean_scrub_stamp":"2024-09-22T08:40:35.489579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:02:26.956368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"32'4","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:59.521660+0000","last_change":"2024-09-22T08:39:59.521660+0000","last_active":"2024-09-22T08:39:59.521660+0000","last_peered":"2024-09-22T08:39:59.521660+0000","last_clean":"2024-09-22T08:39:59.521660+0000","last_became_active":"2024-09-22T08:36:25.987153+0000","last_became_peered":"2024-09-22T08:36:25.987153+0000","last_unstale":"2024-09-22T08:39:59.521660+0000","last_undegraded":"2024-09-22T08:39:59.521660+0000","last_fullsized":"2024-09-22T08:39:59.521660+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-22T08:39:59.521563+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-22T08:39:59.521563+0000","last_clean_scrub_stamp":"2024-09-22T08:39:59.521563+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:30:31.166918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:56.287922+0000","last_change":"2024-09-22T08:39:56.287922+0000","last_active":"2024-09-22T08:39:56.287922+0000","last_peered":"2024-09-22T08:39:56.287922+0000","last_clean":"2024-09-22T08:39:56.287922+0000","last_became_active":"2024-09-22T08:36:23.981927+0000","last_became_peered":"2024-09-22T08:36:23.981927+0000","last_unstale":"2024-09-22T08:39:56.287922+0000","last_undegraded":"2024-09-22T08:39:56.287922+0000","last_fullsized":"2024-09-22T08:39:56.287922+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:39:56.287818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:39:56.287818+0000","last_clean_scrub_stamp":"2024-09-22T08:39:56.287818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:00:09.674228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:22.364803+0000","last_change":"2024-09-22T08:40:22.364803+0000","last_active":"2024-09-22T08:40:22.364803+0000","last_peered":"2024-09-22T08:40:22.364803+0000","last_clean":"2024-09-22T08:40:22.364803+0000","last_became_active":"2024-09-22T08:36:27.990153+0000","last_became_peered":"2024-09-22T08:36:27.990153+0000","last_unstale":"2024-09-22T08:40:22.364803+0000","last_undegraded":"2024-09-22T08:40:22.364803+0000","last_fullsized":"2024-09-22T08:40:22.364803+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:22.364686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:22.364686+0000","last_clean_scrub_stamp":"2024-09-22T08:40:22.364686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:33:24.385016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"32'42","reported_seq":98,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:44.411407+0000","last_change":"2024-09-22T08:40:44.411407+0000","last_active":"2024-09-22T08:40:44.411407+0000","last_peered":"2024-09-22T08:40:44.411407+0000","last_clean":"2024-09-22T08:40:44.411407+0000","last_became_active":"2024-09-22T08:36:29.997814+0000","last_became_peered":"2024-09-22T08:36:29.997814+0000","last_unstale":"2024-09-22T08:40:44.411407+0000","last_undegraded":"2024-09-22T08:40:44.411407+0000","last_fullsized":"2024-09-22T08:40:44.411407+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'42","last_scrub_stamp":"2024-09-22T08:40:44.411300+0000","last_deep_scrub":"32'42","last_deep_scrub_stamp":"2024-09-22T08:40:44.411300+0000","last_clean_scrub_stamp":"2024-09-22T08:40:44.411300+0000","objects_scrubbed":5,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:19:37.169616+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":43,"num_read_kb":44,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:55.352521+0000","last_change":"2024-09-22T08:40:55.352521+0000","last_active":"2024-09-22T08:40:55.352521+0000","last_peered":"2024-09-22T08:40:55.352521+0000","last_clean":"2024-09-22T08:40:55.352521+0000","last_became_active":"2024-09-22T08:36:32.012453+0000","last_became_peered":"2024-09-22T08:36:32.012453+0000","last_unstale":"2024-09-22T08:40:55.352521+0000","last_undegraded":"2024-09-22T08:40:55.352521+0000","last_fullsized":"2024-09-22T08:40:55.352521+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:55.352418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:55.352418+0000","last_clean_scrub_stamp":"2024-09-22T08:40:55.352418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:10:08.488040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"32'3","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:44.777714+0000","last_change":"2024-09-22T08:40:44.777714+0000","last_active":"2024-09-22T08:40:44.777714+0000","last_peered":"2024-09-22T08:40:44.777714+0000","last_clean":"2024-09-22T08:40:44.777714+0000","last_became_active":"2024-09-22T08:36:34.022267+0000","last_became_peered":"2024-09-22T08:36:34.022267+0000","last_unstale":"2024-09-22T08:40:44.777714+0000","last_undegraded":"2024-09-22T08:40:44.777714+0000","last_fullsized":"2024-09-22T08:40:44.777714+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2024-09-22T08:40:44.777628+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2024-09-22T08:40:44.777628+0000","last_clean_scrub_stamp":"2024-09-22T08:40:44.777628+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:03:40.724827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"32'6","reported_seq":90,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:03.316706+0000","last_change":"2024-09-22T08:40:03.316706+0000","last_active":"2024-09-22T08:40:03.316706+0000","last_peered":"2024-09-22T08:40:03.316706+0000","last_clean":"2024-09-22T08:40:03.316706+0000","last_became_active":"2024-09-22T08:36:25.986613+0000","last_became_peered":"2024-09-22T08:36:25.986613+0000","last_unstale":"2024-09-22T08:40:03.316706+0000","last_undegraded":"2024-09-22T08:40:03.316706+0000","last_fullsized":"2024-09-22T08:40:03.316706+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-22T08:40:03.316589+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-22T08:40:03.316589+0000","last_clean_scrub_stamp":"2024-09-22T08:40:03.316589+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:37:02.558069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":60,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:49.648410+0000","last_change":"2024-09-22T08:39:49.648410+0000","last_active":"2024-09-22T08:39:49.648410+0000","last_peered":"2024-09-22T08:39:49.648410+0000","last_clean":"2024-09-22T08:39:49.648410+0000","last_became_active":"2024-09-22T08:36:23.978282+0000","last_became_peered":"2024-09-22T08:36:23.978282+0000","last_unstale":"2024-09-22T08:39:49.648410+0000","last_undegraded":"2024-09-22T08:39:49.648410+0000","last_fullsized":"2024-09-22T08:39:49.648410+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:39:49.648317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:39:49.648317+0000","last_clean_scrub_stamp":"2024-09-22T08:39:49.648317+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:38:27.168524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:35.532711+0000","last_change":"2024-09-22T08:40:35.532711+0000","last_active":"2024-09-22T08:40:35.532711+0000","last_peered":"2024-09-22T08:40:35.532711+0000","last_clean":"2024-09-22T08:40:35.532711+0000","last_became_active":"2024-09-22T08:36:27.986033+0000","last_became_peered":"2024-09-22T08:36:27.986033+0000","last_unstale":"2024-09-22T08:40:35.532711+0000","last_undegraded":"2024-09-22T08:40:35.532711+0000","last_fullsized":"2024-09-22T08:40:35.532711+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:35.532623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:35.532623+0000","last_clean_scrub_stamp":"2024-09-22T08:40:35.532623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:58:27.023727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"32'9","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:21.859767+0000","last_change":"2024-09-22T08:40:21.859767+0000","last_active":"2024-09-22T08:40:21.859767+0000","last_peered":"2024-09-22T08:40:21.859767+0000","last_clean":"2024-09-22T08:40:21.859767+0000","last_became_active":"2024-09-22T08:36:29.990057+0000","last_became_peered":"2024-09-22T08:36:29.990057+0000","last_unstale":"2024-09-22T08:40:21.859767+0000","last_undegraded":"2024-09-22T08:40:21.859767+0000","last_fullsized":"2024-09-22T08:40:21.859767+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'9","last_scrub_stamp":"2024-09-22T08:40:21.859640+0000","last_deep_scrub":"32'9","last_deep_scrub_stamp":"2024-09-22T08:40:21.859640+0000","last_clean_scrub_stamp":"2024-09-22T08:40:21.859640+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:41:06.152084+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":294,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:26.441341+0000","last_change":"2024-09-22T08:40:26.441341+0000","last_active":"2024-09-22T08:40:26.441341+0000","last_peered":"2024-09-22T08:40:26.441341+0000","last_clean":"2024-09-22T08:40:26.441341+0000","last_became_active":"2024-09-22T08:36:32.010692+0000","last_became_peered":"2024-09-22T08:36:32.010692+0000","last_unstale":"2024-09-22T08:40:26.441341+0000","last_undegraded":"2024-09-22T08:40:26.441341+0000","last_fullsized":"2024-09-22T08:40:26.441341+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:26.441238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:26.441238+0000","last_clean_scrub_stamp":"2024-09-22T08:40:26.441238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:01:55.450483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"32'8","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:45.729869+0000","last_change":"2024-09-22T08:40:45.729869+0000","last_active":"2024-09-22T08:40:45.729869+0000","last_peered":"2024-09-22T08:40:45.729869+0000","last_clean":"2024-09-22T08:40:45.729869+0000","last_became_active":"2024-09-22T08:36:34.017181+0000","last_became_peered":"2024-09-22T08:36:34.017181+0000","last_unstale":"2024-09-22T08:40:45.729869+0000","last_undegraded":"2024-09-22T08:40:45.729869+0000","last_fullsized":"2024-09-22T08:40:45.729869+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-22T08:40:45.729766+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-22T08:40:45.729766+0000","last_clean_scrub_stamp":"2024-09-22T08:40:45.729766+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:06:15.886604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":21,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"32'6","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:00.828058+0000","last_change":"2024-09-22T08:40:00.828058+0000","last_active":"2024-09-22T08:40:00.828058+0000","last_peered":"2024-09-22T08:40:00.828058+0000","last_clean":"2024-09-22T08:40:00.828058+0000","last_became_active":"2024-09-22T08:36:25.974797+0000","last_became_peered":"2024-09-22T08:36:25.974797+0000","last_unstale":"2024-09-22T08:40:00.828058+0000","last_undegraded":"2024-09-22T08:40:00.828058+0000","last_fullsized":"2024-09-22T08:40:00.828058+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-22T08:40:00.827940+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-22T08:40:00.827940+0000","last_clean_scrub_stamp":"2024-09-22T08:40:00.827940+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:40:56.353569+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"32'2","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:48.649611+0000","last_change":"2024-09-22T08:39:48.649611+0000","last_active":"2024-09-22T08:39:48.649611+0000","last_peered":"2024-09-22T08:39:48.649611+0000","last_clean":"2024-09-22T08:39:48.649611+0000","last_became_active":"2024-09-22T08:36:23.973601+0000","last_became_peered":"2024-09-22T08:36:23.973601+0000","last_unstale":"2024-09-22T08:39:48.649611+0000","last_undegraded":"2024-09-22T08:39:48.649611+0000","last_fullsized":"2024-09-22T08:39:48.649611+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-22T08:39:48.649523+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-22T08:39:48.649523+0000","last_clean_scrub_stamp":"2024-09-22T08:39:48.649523+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:10:59.136925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:12.389179+0000","last_change":"2024-09-22T08:40:12.389179+0000","last_active":"2024-09-22T08:40:12.389179+0000","last_peered":"2024-09-22T08:40:12.389179+0000","last_clean":"2024-09-22T08:40:12.389179+0000","last_became_active":"2024-09-22T08:36:27.986100+0000","last_became_peered":"2024-09-22T08:36:27.986100+0000","last_unstale":"2024-09-22T08:40:12.389179+0000","last_undegraded":"2024-09-22T08:40:12.389179+0000","last_fullsized":"2024-09-22T08:40:12.389179+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:12.389091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:12.389091+0000","last_clean_scrub_stamp":"2024-09-22T08:40:12.389091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:52:51.243229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"32'49","reported_seq":121,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:22.891970+0000","last_change":"2024-09-22T08:40:22.891970+0000","last_active":"2024-09-22T08:40:22.891970+0000","last_peered":"2024-09-22T08:40:22.891970+0000","last_clean":"2024-09-22T08:40:22.891970+0000","last_became_active":"2024-09-22T08:36:29.991732+0000","last_became_peered":"2024-09-22T08:36:29.991732+0000","last_unstale":"2024-09-22T08:40:22.891970+0000","last_undegraded":"2024-09-22T08:40:22.891970+0000","last_fullsized":"2024-09-22T08:40:22.891970+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'49","last_scrub_stamp":"2024-09-22T08:40:22.891866+0000","last_deep_scrub":"32'49","last_deep_scrub_stamp":"2024-09-22T08:40:22.891866+0000","last_clean_scrub_stamp":"2024-09-22T08:40:22.891866+0000","objects_scrubbed":6,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:30:36.940890+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":706,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:35.406404+0000","last_change":"2024-09-22T08:40:35.406404+0000","last_active":"2024-09-22T08:40:35.406404+0000","last_peered":"2024-09-22T08:40:35.406404+0000","last_clean":"2024-09-22T08:40:35.406404+0000","last_became_active":"2024-09-22T08:36:32.002970+0000","last_became_peered":"2024-09-22T08:36:32.002970+0000","last_unstale":"2024-09-22T08:40:35.406404+0000","last_undegraded":"2024-09-22T08:40:35.406404+0000","last_fullsized":"2024-09-22T08:40:35.406404+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:35.406305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:35.406305+0000","last_clean_scrub_stamp":"2024-09-22T08:40:35.406305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:23:45.406110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"32'4","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:32.344891+0000","last_change":"2024-09-22T08:36:34.016939+0000","last_active":"2024-09-22T08:39:32.344891+0000","last_peered":"2024-09-22T08:39:32.344891+0000","last_clean":"2024-09-22T08:39:32.344891+0000","last_became_active":"2024-09-22T08:36:34.016379+0000","last_became_peered":"2024-09-22T08:36:34.016379+0000","last_unstale":"2024-09-22T08:39:32.344891+0000","last_undegraded":"2024-09-22T08:39:32.344891+0000","last_fullsized":"2024-09-22T08:39:32.344891+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:50:54.870215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":421,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"32'6","reported_seq":71,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:15.475301+0000","last_change":"2024-09-22T08:40:15.475301+0000","last_active":"2024-09-22T08:40:15.475301+0000","last_peered":"2024-09-22T08:40:15.475301+0000","last_clean":"2024-09-22T08:40:15.475301+0000","last_became_active":"2024-09-22T08:36:25.988569+0000","last_became_peered":"2024-09-22T08:36:25.988569+0000","last_unstale":"2024-09-22T08:40:15.475301+0000","last_undegraded":"2024-09-22T08:40:15.475301+0000","last_fullsized":"2024-09-22T08:40:15.475301+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-22T08:40:15.475202+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-22T08:40:15.475202+0000","last_clean_scrub_stamp":"2024-09-22T08:40:15.475202+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:59:43.068621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:47.114544+0000","last_change":"2024-09-22T08:39:47.114544+0000","last_active":"2024-09-22T08:39:47.114544+0000","last_peered":"2024-09-22T08:39:47.114544+0000","last_clean":"2024-09-22T08:39:47.114544+0000","last_became_active":"2024-09-22T08:36:23.977355+0000","last_became_peered":"2024-09-22T08:36:23.977355+0000","last_unstale":"2024-09-22T08:39:47.114544+0000","last_undegraded":"2024-09-22T08:39:47.114544+0000","last_fullsized":"2024-09-22T08:39:47.114544+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:39:47.114458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:39:47.114458+0000","last_clean_scrub_stamp":"2024-09-22T08:39:47.114458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:39:28.221096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"32'5","reported_seq":238,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:33.452454+0000","last_change":"2024-09-22T08:40:33.452454+0000","last_active":"2024-09-22T08:40:33.452454+0000","last_peered":"2024-09-22T08:40:33.452454+0000","last_clean":"2024-09-22T08:40:33.452454+0000","last_became_active":"2024-09-22T08:36:27.987561+0000","last_became_peered":"2024-09-22T08:36:27.987561+0000","last_unstale":"2024-09-22T08:40:33.452454+0000","last_undegraded":"2024-09-22T08:40:33.452454+0000","last_fullsized":"2024-09-22T08:40:33.452454+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'5","last_scrub_stamp":"2024-09-22T08:40:33.452370+0000","last_deep_scrub":"32'5","last_deep_scrub_stamp":"2024-09-22T08:40:33.452370+0000","last_clean_scrub_stamp":"2024-09-22T08:40:33.452370+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:24:37.175651+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"32'38","reported_seq":93,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:20.438365+0000","last_change":"2024-09-22T08:40:20.438365+0000","last_active":"2024-09-22T08:40:20.438365+0000","last_peered":"2024-09-22T08:40:20.438365+0000","last_clean":"2024-09-22T08:40:20.438365+0000","last_became_active":"2024-09-22T08:36:29.988607+0000","last_became_peered":"2024-09-22T08:36:29.988607+0000","last_unstale":"2024-09-22T08:40:20.438365+0000","last_undegraded":"2024-09-22T08:40:20.438365+0000","last_fullsized":"2024-09-22T08:40:20.438365+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'38","last_scrub_stamp":"2024-09-22T08:40:20.438226+0000","last_deep_scrub":"32'38","last_deep_scrub_stamp":"2024-09-22T08:40:20.438226+0000","last_clean_scrub_stamp":"2024-09-22T08:40:20.438226+0000","objects_scrubbed":4,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:42:43.210584+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:27.448372+0000","last_change":"2024-09-22T08:40:27.448372+0000","last_active":"2024-09-22T08:40:27.448372+0000","last_peered":"2024-09-22T08:40:27.448372+0000","last_clean":"2024-09-22T08:40:27.448372+0000","last_became_active":"2024-09-22T08:36:32.003651+0000","last_became_peered":"2024-09-22T08:36:32.003651+0000","last_unstale":"2024-09-22T08:40:27.448372+0000","last_undegraded":"2024-09-22T08:40:27.448372+0000","last_fullsized":"2024-09-22T08:40:27.448372+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:27.448253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:27.448253+0000","last_clean_scrub_stamp":"2024-09-22T08:40:27.448253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:47:55.073492+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"32'10","reported_seq":74,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:19.534515+0000","last_change":"2024-09-22T08:40:19.534441+0000","last_active":"2024-09-22T08:40:19.534515+0000","last_peered":"2024-09-22T08:40:19.534515+0000","last_clean":"2024-09-22T08:40:19.534515+0000","last_became_active":"2024-09-22T08:36:25.989711+0000","last_became_peered":"2024-09-22T08:36:25.989711+0000","last_unstale":"2024-09-22T08:40:19.534515+0000","last_undegraded":"2024-09-22T08:40:19.534515+0000","last_fullsized":"2024-09-22T08:40:19.534515+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-09-22T08:40:19.534321+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-09-22T08:40:19.534321+0000","last_clean_scrub_stamp":"2024-09-22T08:40:19.534321+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:34:03.499705+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:57.304514+0000","last_change":"2024-09-22T08:39:57.304514+0000","last_active":"2024-09-22T08:39:57.304514+0000","last_peered":"2024-09-22T08:39:57.304514+0000","last_clean":"2024-09-22T08:39:57.304514+0000","last_became_active":"2024-09-22T08:36:23.976361+0000","last_became_peered":"2024-09-22T08:36:23.976361+0000","last_unstale":"2024-09-22T08:39:57.304514+0000","last_undegraded":"2024-09-22T08:39:57.304514+0000","last_fullsized":"2024-09-22T08:39:57.304514+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:39:57.304420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:39:57.304420+0000","last_clean_scrub_stamp":"2024-09-22T08:39:57.304420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:50:11.471353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:19.885446+0000","last_change":"2024-09-22T08:40:19.885352+0000","last_active":"2024-09-22T08:40:19.885446+0000","last_peered":"2024-09-22T08:40:19.885446+0000","last_clean":"2024-09-22T08:40:19.885446+0000","last_became_active":"2024-09-22T08:36:27.987981+0000","last_became_peered":"2024-09-22T08:36:27.987981+0000","last_unstale":"2024-09-22T08:40:19.885446+0000","last_undegraded":"2024-09-22T08:40:19.885446+0000","last_fullsized":"2024-09-22T08:40:19.885446+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:19.885257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:19.885257+0000","last_clean_scrub_stamp":"2024-09-22T08:40:19.885257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:15:54.517108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"32'66","reported_seq":139,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:24.955120+0000","last_change":"2024-09-22T08:40:24.955120+0000","last_active":"2024-09-22T08:40:24.955120+0000","last_peered":"2024-09-22T08:40:24.955120+0000","last_clean":"2024-09-22T08:40:24.955120+0000","last_became_active":"2024-09-22T08:36:29.990585+0000","last_became_peered":"2024-09-22T08:36:29.990585+0000","last_unstale":"2024-09-22T08:40:24.955120+0000","last_undegraded":"2024-09-22T08:40:24.955120+0000","last_fullsized":"2024-09-22T08:40:24.955120+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'66","last_scrub_stamp":"2024-09-22T08:40:24.955006+0000","last_deep_scrub":"32'66","last_deep_scrub_stamp":"2024-09-22T08:40:24.955006+0000","last_clean_scrub_stamp":"2024-09-22T08:40:24.955006+0000","objects_scrubbed":5,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:20:46.276335+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:28.404072+0000","last_change":"2024-09-22T08:40:28.404072+0000","last_active":"2024-09-22T08:40:28.404072+0000","last_peered":"2024-09-22T08:40:28.404072+0000","last_clean":"2024-09-22T08:40:28.404072+0000","last_became_active":"2024-09-22T08:36:32.007448+0000","last_became_peered":"2024-09-22T08:36:32.007448+0000","last_unstale":"2024-09-22T08:40:28.404072+0000","last_undegraded":"2024-09-22T08:40:28.404072+0000","last_fullsized":"2024-09-22T08:40:28.404072+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:28.403992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:28.403992+0000","last_clean_scrub_stamp":"2024-09-22T08:40:28.403992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:26:25.213830+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"32'16","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:41.820871+0000","last_change":"2024-09-22T08:40:41.820871+0000","last_active":"2024-09-22T08:40:41.820871+0000","last_peered":"2024-09-22T08:40:41.820871+0000","last_clean":"2024-09-22T08:40:41.820871+0000","last_became_active":"2024-09-22T08:36:34.017689+0000","last_became_peered":"2024-09-22T08:36:34.017689+0000","last_unstale":"2024-09-22T08:40:41.820871+0000","last_undegraded":"2024-09-22T08:40:41.820871+0000","last_fullsized":"2024-09-22T08:40:41.820871+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'16","last_scrub_stamp":"2024-09-22T08:40:41.820768+0000","last_deep_scrub":"32'16","last_deep_scrub_stamp":"2024-09-22T08:40:41.820768+0000","last_clean_scrub_stamp":"2024-09-22T08:40:41.820768+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:26:03.103006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":21,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"32'2","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:05.795426+0000","last_change":"2024-09-22T08:40:05.795366+0000","last_active":"2024-09-22T08:40:05.795426+0000","last_peered":"2024-09-22T08:40:05.795426+0000","last_clean":"2024-09-22T08:40:05.795426+0000","last_became_active":"2024-09-22T08:36:25.977881+0000","last_became_peered":"2024-09-22T08:36:25.977881+0000","last_unstale":"2024-09-22T08:40:05.795426+0000","last_undegraded":"2024-09-22T08:40:05.795426+0000","last_fullsized":"2024-09-22T08:40:05.795426+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-22T08:40:05.795277+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-22T08:40:05.795277+0000","last_clean_scrub_stamp":"2024-09-22T08:40:05.795277+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:18:12.135810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:48.136157+0000","last_change":"2024-09-22T08:39:48.136157+0000","last_active":"2024-09-22T08:39:48.136157+0000","last_peered":"2024-09-22T08:39:48.136157+0000","last_clean":"2024-09-22T08:39:48.136157+0000","last_became_active":"2024-09-22T08:36:23.974809+0000","last_became_peered":"2024-09-22T08:36:23.974809+0000","last_unstale":"2024-09-22T08:39:48.136157+0000","last_undegraded":"2024-09-22T08:39:48.136157+0000","last_fullsized":"2024-09-22T08:39:48.136157+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:39:48.136054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:39:48.136054+0000","last_clean_scrub_stamp":"2024-09-22T08:39:48.136054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:46:14.769669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:15.386385+0000","last_change":"2024-09-22T08:40:15.386312+0000","last_active":"2024-09-22T08:40:15.386385+0000","last_peered":"2024-09-22T08:40:15.386385+0000","last_clean":"2024-09-22T08:40:15.386385+0000","last_became_active":"2024-09-22T08:36:27.986957+0000","last_became_peered":"2024-09-22T08:36:27.986957+0000","last_unstale":"2024-09-22T08:40:15.386385+0000","last_undegraded":"2024-09-22T08:40:15.386385+0000","last_fullsized":"2024-09-22T08:40:15.386385+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:15.386197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:15.386197+0000","last_clean_scrub_stamp":"2024-09-22T08:40:15.386197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:59:57.699145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"32'46","reported_seq":104,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:47.442869+0000","last_change":"2024-09-22T08:40:47.442869+0000","last_active":"2024-09-22T08:40:47.442869+0000","last_peered":"2024-09-22T08:40:47.442869+0000","last_clean":"2024-09-22T08:40:47.442869+0000","last_became_active":"2024-09-22T08:36:29.997527+0000","last_became_peered":"2024-09-22T08:36:29.997527+0000","last_unstale":"2024-09-22T08:40:47.442869+0000","last_undegraded":"2024-09-22T08:40:47.442869+0000","last_fullsized":"2024-09-22T08:40:47.442869+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'46","last_scrub_stamp":"2024-09-22T08:40:47.442752+0000","last_deep_scrub":"32'46","last_deep_scrub_stamp":"2024-09-22T08:40:47.442752+0000","last_clean_scrub_stamp":"2024-09-22T08:40:47.442752+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:29:30.855402+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:38.374915+0000","last_change":"2024-09-22T08:40:38.374915+0000","last_active":"2024-09-22T08:40:38.374915+0000","last_peered":"2024-09-22T08:40:38.374915+0000","last_clean":"2024-09-22T08:40:38.374915+0000","last_became_active":"2024-09-22T08:36:32.005383+0000","last_became_peered":"2024-09-22T08:36:32.005383+0000","last_unstale":"2024-09-22T08:40:38.374915+0000","last_undegraded":"2024-09-22T08:40:38.374915+0000","last_fullsized":"2024-09-22T08:40:38.374915+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:38.374794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:38.374794+0000","last_clean_scrub_stamp":"2024-09-22T08:40:38.374794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:39:40.546159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:41:02.248132+0000","last_change":"2024-09-22T08:41:02.248132+0000","last_active":"2024-09-22T08:41:02.248132+0000","last_peered":"2024-09-22T08:41:02.248132+0000","last_clean":"2024-09-22T08:41:02.248132+0000","last_became_active":"2024-09-22T08:36:34.013204+0000","last_became_peered":"2024-09-22T08:36:34.013204+0000","last_unstale":"2024-09-22T08:41:02.248132+0000","last_undegraded":"2024-09-22T08:41:02.248132+0000","last_fullsized":"2024-09-22T08:41:02.248132+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:41:02.248050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:41:02.248050+0000","last_clean_scrub_stamp":"2024-09-22T08:41:02.248050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:38:21.762718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"32'14","reported_seq":74,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:18.502364+0000","last_change":"2024-09-22T08:40:18.502364+0000","last_active":"2024-09-22T08:40:18.502364+0000","last_peered":"2024-09-22T08:40:18.502364+0000","last_clean":"2024-09-22T08:40:18.502364+0000","last_became_active":"2024-09-22T08:36:25.993170+0000","last_became_peered":"2024-09-22T08:36:25.993170+0000","last_unstale":"2024-09-22T08:40:18.502364+0000","last_undegraded":"2024-09-22T08:40:18.502364+0000","last_fullsized":"2024-09-22T08:40:18.502364+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'14","last_scrub_stamp":"2024-09-22T08:40:18.502275+0000","last_deep_scrub":"32'14","last_deep_scrub_stamp":"2024-09-22T08:40:18.502275+0000","last_clean_scrub_stamp":"2024-09-22T08:40:18.502275+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:35:17.727896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":38,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:49.125470+0000","last_change":"2024-09-22T08:39:49.125470+0000","last_active":"2024-09-22T08:39:49.125470+0000","last_peered":"2024-09-22T08:39:49.125470+0000","last_clean":"2024-09-22T08:39:49.125470+0000","last_became_active":"2024-09-22T08:36:23.968207+0000","last_became_peered":"2024-09-22T08:36:23.968207+0000","last_unstale":"2024-09-22T08:39:49.125470+0000","last_undegraded":"2024-09-22T08:39:49.125470+0000","last_fullsized":"2024-09-22T08:39:49.125470+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:39:49.125386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:39:49.125386+0000","last_clean_scrub_stamp":"2024-09-22T08:39:49.125386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:25:13.108318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:14.421686+0000","last_change":"2024-09-22T08:40:14.421686+0000","last_active":"2024-09-22T08:40:14.421686+0000","last_peered":"2024-09-22T08:40:14.421686+0000","last_clean":"2024-09-22T08:40:14.421686+0000","last_became_active":"2024-09-22T08:36:27.985679+0000","last_became_peered":"2024-09-22T08:36:27.985679+0000","last_unstale":"2024-09-22T08:40:14.421686+0000","last_undegraded":"2024-09-22T08:40:14.421686+0000","last_fullsized":"2024-09-22T08:40:14.421686+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:14.421600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:14.421600+0000","last_clean_scrub_stamp":"2024-09-22T08:40:14.421600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:31:50.278835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"32'40","reported_seq":97,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:25.947666+0000","last_change":"2024-09-22T08:40:25.947562+0000","last_active":"2024-09-22T08:40:25.947666+0000","last_peered":"2024-09-22T08:40:25.947666+0000","last_clean":"2024-09-22T08:40:25.947666+0000","last_became_active":"2024-09-22T08:36:29.994075+0000","last_became_peered":"2024-09-22T08:36:29.994075+0000","last_unstale":"2024-09-22T08:40:25.947666+0000","last_undegraded":"2024-09-22T08:40:25.947666+0000","last_fullsized":"2024-09-22T08:40:25.947666+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'40","last_scrub_stamp":"2024-09-22T08:40:25.947455+0000","last_deep_scrub":"32'40","last_deep_scrub_stamp":"2024-09-22T08:40:25.947455+0000","last_clean_scrub_stamp":"2024-09-22T08:40:25.947455+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:02:20.505829+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:36.806341+0000","last_change":"2024-09-22T08:40:36.806341+0000","last_active":"2024-09-22T08:40:36.806341+0000","last_peered":"2024-09-22T08:40:36.806341+0000","last_clean":"2024-09-22T08:40:36.806341+0000","last_became_active":"2024-09-22T08:36:32.005166+0000","last_became_peered":"2024-09-22T08:36:32.005166+0000","last_unstale":"2024-09-22T08:40:36.806341+0000","last_undegraded":"2024-09-22T08:40:36.806341+0000","last_fullsized":"2024-09-22T08:40:36.806341+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:36.806254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:36.806254+0000","last_clean_scrub_stamp":"2024-09-22T08:40:36.806254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:50:50.973187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"32'7","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:41:01.288745+0000","last_change":"2024-09-22T08:41:01.288745+0000","last_active":"2024-09-22T08:41:01.288745+0000","last_peered":"2024-09-22T08:41:01.288745+0000","last_clean":"2024-09-22T08:41:01.288745+0000","last_became_active":"2024-09-22T08:36:34.014255+0000","last_became_peered":"2024-09-22T08:36:34.014255+0000","last_unstale":"2024-09-22T08:41:01.288745+0000","last_undegraded":"2024-09-22T08:41:01.288745+0000","last_fullsized":"2024-09-22T08:41:01.288745+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'7","last_scrub_stamp":"2024-09-22T08:41:01.288659+0000","last_deep_scrub":"32'7","last_deep_scrub_stamp":"2024-09-22T08:41:01.288659+0000","last_clean_scrub_stamp":"2024-09-22T08:41:01.288659+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:25:46.529269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"32'4","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:03.793636+0000","last_change":"2024-09-22T08:40:03.793636+0000","last_active":"2024-09-22T08:40:03.793636+0000","last_peered":"2024-09-22T08:40:03.793636+0000","last_clean":"2024-09-22T08:40:03.793636+0000","last_became_active":"2024-09-22T08:36:25.978577+0000","last_became_peered":"2024-09-22T08:36:25.978577+0000","last_unstale":"2024-09-22T08:40:03.793636+0000","last_undegraded":"2024-09-22T08:40:03.793636+0000","last_fullsized":"2024-09-22T08:40:03.793636+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-22T08:40:03.793512+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-22T08:40:03.793512+0000","last_clean_scrub_stamp":"2024-09-22T08:40:03.793512+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:00:34.051924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"32'2","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:48.833986+0000","last_change":"2024-09-22T08:39:48.833986+0000","last_active":"2024-09-22T08:39:48.833986+0000","last_peered":"2024-09-22T08:39:48.833986+0000","last_clean":"2024-09-22T08:39:48.833986+0000","last_became_active":"2024-09-22T08:37:04.226169+0000","last_became_peered":"2024-09-22T08:37:04.226169+0000","last_unstale":"2024-09-22T08:39:48.833986+0000","last_undegraded":"2024-09-22T08:39:48.833986+0000","last_fullsized":"2024-09-22T08:39:48.833986+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-22T08:39:48.833881+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-22T08:39:48.833881+0000","last_clean_scrub_stamp":"2024-09-22T08:39:48.833881+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:03:32.581894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:26.336878+0000","last_change":"2024-09-22T08:40:26.336878+0000","last_active":"2024-09-22T08:40:26.336878+0000","last_peered":"2024-09-22T08:40:26.336878+0000","last_clean":"2024-09-22T08:40:26.336878+0000","last_became_active":"2024-09-22T08:36:27.990038+0000","last_became_peered":"2024-09-22T08:36:27.990038+0000","last_unstale":"2024-09-22T08:40:26.336878+0000","last_undegraded":"2024-09-22T08:40:26.336878+0000","last_fullsized":"2024-09-22T08:40:26.336878+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:26.336763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:26.336763+0000","last_clean_scrub_stamp":"2024-09-22T08:40:26.336763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:50:41.991119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"32'15","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:49.492228+0000","last_change":"2024-09-22T08:40:49.492228+0000","last_active":"2024-09-22T08:40:49.492228+0000","last_peered":"2024-09-22T08:40:49.492228+0000","last_clean":"2024-09-22T08:40:49.492228+0000","last_became_active":"2024-09-22T08:36:29.997179+0000","last_became_peered":"2024-09-22T08:36:29.997179+0000","last_unstale":"2024-09-22T08:40:49.492228+0000","last_undegraded":"2024-09-22T08:40:49.492228+0000","last_fullsized":"2024-09-22T08:40:49.492228+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'15","last_scrub_stamp":"2024-09-22T08:40:49.492140+0000","last_deep_scrub":"32'15","last_deep_scrub_stamp":"2024-09-22T08:40:49.492140+0000","last_clean_scrub_stamp":"2024-09-22T08:40:49.492140+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:36:10.074437+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"32'286","reported_seq":379,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:29.435937+0000","last_change":"2024-09-22T08:40:29.435880+0000","last_active":"2024-09-22T08:40:29.435937+0000","last_peered":"2024-09-22T08:40:29.435937+0000","last_clean":"2024-09-22T08:40:29.435937+0000","last_became_active":"2024-09-22T08:36:32.011870+0000","last_became_peered":"2024-09-22T08:36:32.011870+0000","last_unstale":"2024-09-22T08:40:29.435937+0000","last_undegraded":"2024-09-22T08:40:29.435937+0000","last_fullsized":"2024-09-22T08:40:29.435937+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'286","last_scrub_stamp":"2024-09-22T08:40:29.435778+0000","last_deep_scrub":"32'286","last_deep_scrub_stamp":"2024-09-22T08:40:29.435778+0000","last_clean_scrub_stamp":"2024-09-22T08:40:29.435778+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:37:13.038460+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"32'2","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:59.325117+0000","last_change":"2024-09-22T08:40:59.325117+0000","last_active":"2024-09-22T08:40:59.325117+0000","last_peered":"2024-09-22T08:40:59.325117+0000","last_clean":"2024-09-22T08:40:59.325117+0000","last_became_active":"2024-09-22T08:36:34.013380+0000","last_became_peered":"2024-09-22T08:36:34.013380+0000","last_unstale":"2024-09-22T08:40:59.325117+0000","last_undegraded":"2024-09-22T08:40:59.325117+0000","last_fullsized":"2024-09-22T08:40:59.325117+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-22T08:40:59.325010+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-22T08:40:59.325010+0000","last_clean_scrub_stamp":"2024-09-22T08:40:59.325010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:40:37.489726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"32'8","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:07.397444+0000","last_change":"2024-09-22T08:40:07.397444+0000","last_active":"2024-09-22T08:40:07.397444+0000","last_peered":"2024-09-22T08:40:07.397444+0000","last_clean":"2024-09-22T08:40:07.397444+0000","last_became_active":"2024-09-22T08:36:25.971327+0000","last_became_peered":"2024-09-22T08:36:25.971327+0000","last_unstale":"2024-09-22T08:40:07.397444+0000","last_undegraded":"2024-09-22T08:40:07.397444+0000","last_fullsized":"2024-09-22T08:40:07.397444+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-22T08:40:07.397356+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-22T08:40:07.397356+0000","last_clean_scrub_stamp":"2024-09-22T08:40:07.397356+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:37:27.086026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:50.109978+0000","last_change":"2024-09-22T08:39:50.109978+0000","last_active":"2024-09-22T08:39:50.109978+0000","last_peered":"2024-09-22T08:39:50.109978+0000","last_clean":"2024-09-22T08:39:50.109978+0000","last_became_active":"2024-09-22T08:36:23.978006+0000","last_became_peered":"2024-09-22T08:36:23.978006+0000","last_unstale":"2024-09-22T08:39:50.109978+0000","last_undegraded":"2024-09-22T08:39:50.109978+0000","last_fullsized":"2024-09-22T08:39:50.109978+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-22T08:39:50.109878+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-22T08:39:50.109878+0000","last_clean_scrub_stamp":"2024-09-22T08:39:50.109878+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:37:09.798548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:25.344973+0000","last_change":"2024-09-22T08:40:25.344973+0000","last_active":"2024-09-22T08:40:25.344973+0000","last_peered":"2024-09-22T08:40:25.344973+0000","last_clean":"2024-09-22T08:40:25.344973+0000","last_became_active":"2024-09-22T08:36:27.990729+0000","last_became_peered":"2024-09-22T08:36:27.990729+0000","last_unstale":"2024-09-22T08:40:25.344973+0000","last_undegraded":"2024-09-22T08:40:25.344973+0000","last_fullsized":"2024-09-22T08:40:25.344973+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:25.344883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:25.344883+0000","last_clean_scrub_stamp":"2024-09-22T08:40:25.344883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:33:42.396651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"32'46","reported_seq":104,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:32.421298+0000","last_change":"2024-09-22T08:40:32.421298+0000","last_active":"2024-09-22T08:40:32.421298+0000","last_peered":"2024-09-22T08:40:32.421298+0000","last_clean":"2024-09-22T08:40:32.421298+0000","last_became_active":"2024-09-22T08:36:29.987459+0000","last_became_peered":"2024-09-22T08:36:29.987459+0000","last_unstale":"2024-09-22T08:40:32.421298+0000","last_undegraded":"2024-09-22T08:40:32.421298+0000","last_fullsized":"2024-09-22T08:40:32.421298+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'46","last_scrub_stamp":"2024-09-22T08:40:32.421206+0000","last_deep_scrub":"32'46","last_deep_scrub_stamp":"2024-09-22T08:40:32.421206+0000","last_clean_scrub_stamp":"2024-09-22T08:40:32.421206+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:39:14.508488+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:35.766418+0000","last_change":"2024-09-22T08:40:35.766418+0000","last_active":"2024-09-22T08:40:35.766418+0000","last_peered":"2024-09-22T08:40:35.766418+0000","last_clean":"2024-09-22T08:40:35.766418+0000","last_became_active":"2024-09-22T08:36:32.003196+0000","last_became_peered":"2024-09-22T08:36:32.003196+0000","last_unstale":"2024-09-22T08:40:35.766418+0000","last_undegraded":"2024-09-22T08:40:35.766418+0000","last_fullsized":"2024-09-22T08:40:35.766418+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:35.766331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:35.766331+0000","last_clean_scrub_stamp":"2024-09-22T08:40:35.766331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:55:51.742750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:44.378252+0000","last_change":"2024-09-22T08:40:44.378252+0000","last_active":"2024-09-22T08:40:44.378252+0000","last_peered":"2024-09-22T08:40:44.378252+0000","last_clean":"2024-09-22T08:40:44.378252+0000","last_became_active":"2024-09-22T08:36:34.015988+0000","last_became_peered":"2024-09-22T08:36:34.015988+0000","last_unstale":"2024-09-22T08:40:44.378252+0000","last_undegraded":"2024-09-22T08:40:44.378252+0000","last_fullsized":"2024-09-22T08:40:44.378252+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:44.378167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:44.378167+0000","last_clean_scrub_stamp":"2024-09-22T08:40:44.378167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:06:28.539501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"32'4","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:03.357413+0000","last_change":"2024-09-22T08:40:03.357413+0000","last_active":"2024-09-22T08:40:03.357413+0000","last_peered":"2024-09-22T08:40:03.357413+0000","last_clean":"2024-09-22T08:40:03.357413+0000","last_became_active":"2024-09-22T08:36:25.972149+0000","last_became_peered":"2024-09-22T08:36:25.972149+0000","last_unstale":"2024-09-22T08:40:03.357413+0000","last_undegraded":"2024-09-22T08:40:03.357413+0000","last_fullsized":"2024-09-22T08:40:03.357413+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-22T08:40:03.357323+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-22T08:40:03.357323+0000","last_clean_scrub_stamp":"2024-09-22T08:40:03.357323+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:00:50.517267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"32'2","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:59.302310+0000","last_change":"2024-09-22T08:39:59.302310+0000","last_active":"2024-09-22T08:39:59.302310+0000","last_peered":"2024-09-22T08:39:59.302310+0000","last_clean":"2024-09-22T08:39:59.302310+0000","last_became_active":"2024-09-22T08:36:23.982545+0000","last_became_peered":"2024-09-22T08:36:23.982545+0000","last_unstale":"2024-09-22T08:39:59.302310+0000","last_undegraded":"2024-09-22T08:39:59.302310+0000","last_fullsized":"2024-09-22T08:39:59.302310+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-22T08:39:59.302226+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-22T08:39:59.302226+0000","last_clean_scrub_stamp":"2024-09-22T08:39:59.302226+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:17:21.833960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:13.410180+0000","last_change":"2024-09-22T08:40:13.410180+0000","last_active":"2024-09-22T08:40:13.410180+0000","last_peered":"2024-09-22T08:40:13.410180+0000","last_clean":"2024-09-22T08:40:13.410180+0000","last_became_active":"2024-09-22T08:36:27.989495+0000","last_became_peered":"2024-09-22T08:36:27.989495+0000","last_unstale":"2024-09-22T08:40:13.410180+0000","last_undegraded":"2024-09-22T08:40:13.410180+0000","last_fullsized":"2024-09-22T08:40:13.410180+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:13.410093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:13.410093+0000","last_clean_scrub_stamp":"2024-09-22T08:40:13.410093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:27:10.709987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"32'37","reported_seq":92,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:23.938924+0000","last_change":"2024-09-22T08:40:23.938924+0000","last_active":"2024-09-22T08:40:23.938924+0000","last_peered":"2024-09-22T08:40:23.938924+0000","last_clean":"2024-09-22T08:40:23.938924+0000","last_became_active":"2024-09-22T08:36:29.994101+0000","last_became_peered":"2024-09-22T08:36:29.994101+0000","last_unstale":"2024-09-22T08:40:23.938924+0000","last_undegraded":"2024-09-22T08:40:23.938924+0000","last_fullsized":"2024-09-22T08:40:23.938924+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'37","last_scrub_stamp":"2024-09-22T08:40:23.938814+0000","last_deep_scrub":"32'37","last_deep_scrub_stamp":"2024-09-22T08:40:23.938814+0000","last_clean_scrub_stamp":"2024-09-22T08:40:23.938814+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:23:37.032961+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:53.360782+0000","last_change":"2024-09-22T08:40:53.360782+0000","last_active":"2024-09-22T08:40:53.360782+0000","last_peered":"2024-09-22T08:40:53.360782+0000","last_clean":"2024-09-22T08:40:53.360782+0000","last_became_active":"2024-09-22T08:36:32.011811+0000","last_became_peered":"2024-09-22T08:36:32.011811+0000","last_unstale":"2024-09-22T08:40:53.360782+0000","last_undegraded":"2024-09-22T08:40:53.360782+0000","last_fullsized":"2024-09-22T08:40:53.360782+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:53.360697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:53.360697+0000","last_clean_scrub_stamp":"2024-09-22T08:40:53.360697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:28:06.175087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"32'2","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:37:05.456749+0000","last_change":"2024-09-22T08:36:34.020146+0000","last_active":"2024-09-22T08:37:05.456749+0000","last_peered":"2024-09-22T08:37:05.456749+0000","last_clean":"2024-09-22T08:37:05.456749+0000","last_became_active":"2024-09-22T08:36:34.019866+0000","last_became_peered":"2024-09-22T08:36:34.019866+0000","last_unstale":"2024-09-22T08:37:05.456749+0000","last_undegraded":"2024-09-22T08:37:05.456749+0000","last_fullsized":"2024-09-22T08:37:05.456749+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:56:15.623151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"32'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:17.499349+0000","last_change":"2024-09-22T08:40:17.499349+0000","last_active":"2024-09-22T08:40:17.499349+0000","last_peered":"2024-09-22T08:40:17.499349+0000","last_clean":"2024-09-22T08:40:17.499349+0000","last_became_active":"2024-09-22T08:36:25.989572+0000","last_became_peered":"2024-09-22T08:36:25.989572+0000","last_unstale":"2024-09-22T08:40:17.499349+0000","last_undegraded":"2024-09-22T08:40:17.499349+0000","last_fullsized":"2024-09-22T08:40:17.499349+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-22T08:40:17.499263+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-22T08:40:17.499263+0000","last_clean_scrub_stamp":"2024-09-22T08:40:17.499263+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:38:33.473092+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:49.815548+0000","last_change":"2024-09-22T08:39:49.815491+0000","last_active":"2024-09-22T08:39:49.815548+0000","last_peered":"2024-09-22T08:39:49.815548+0000","last_clean":"2024-09-22T08:39:49.815548+0000","last_became_active":"2024-09-22T08:36:23.971012+0000","last_became_peered":"2024-09-22T08:36:23.971012+0000","last_unstale":"2024-09-22T08:39:49.815548+0000","last_undegraded":"2024-09-22T08:39:49.815548+0000","last_fullsized":"2024-09-22T08:39:49.815548+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:39:49.815399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:39:49.815399+0000","last_clean_scrub_stamp":"2024-09-22T08:39:49.815399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:29:53.053729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:23.378577+0000","last_change":"2024-09-22T08:40:23.378577+0000","last_active":"2024-09-22T08:40:23.378577+0000","last_peered":"2024-09-22T08:40:23.378577+0000","last_clean":"2024-09-22T08:40:23.378577+0000","last_became_active":"2024-09-22T08:36:27.987504+0000","last_became_peered":"2024-09-22T08:36:27.987504+0000","last_unstale":"2024-09-22T08:40:23.378577+0000","last_undegraded":"2024-09-22T08:40:23.378577+0000","last_fullsized":"2024-09-22T08:40:23.378577+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:23.378462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:23.378462+0000","last_clean_scrub_stamp":"2024-09-22T08:40:23.378462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:30:23.702772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"32'31","reported_seq":84,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:46.458307+0000","last_change":"2024-09-22T08:40:46.458307+0000","last_active":"2024-09-22T08:40:46.458307+0000","last_peered":"2024-09-22T08:40:46.458307+0000","last_clean":"2024-09-22T08:40:46.458307+0000","last_became_active":"2024-09-22T08:36:29.997853+0000","last_became_peered":"2024-09-22T08:36:29.997853+0000","last_unstale":"2024-09-22T08:40:46.458307+0000","last_undegraded":"2024-09-22T08:40:46.458307+0000","last_fullsized":"2024-09-22T08:40:46.458307+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'31","last_scrub_stamp":"2024-09-22T08:40:46.458224+0000","last_deep_scrub":"32'31","last_deep_scrub_stamp":"2024-09-22T08:40:46.458224+0000","last_clean_scrub_stamp":"2024-09-22T08:40:46.458224+0000","objects_scrubbed":2,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:22:46.084894+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:54.395246+0000","last_change":"2024-09-22T08:40:54.395246+0000","last_active":"2024-09-22T08:40:54.395246+0000","last_peered":"2024-09-22T08:40:54.395246+0000","last_clean":"2024-09-22T08:40:54.395246+0000","last_became_active":"2024-09-22T08:36:32.011960+0000","last_became_peered":"2024-09-22T08:36:32.011960+0000","last_unstale":"2024-09-22T08:40:54.395246+0000","last_undegraded":"2024-09-22T08:40:54.395246+0000","last_fullsized":"2024-09-22T08:40:54.395246+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:54.395141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:54.395141+0000","last_clean_scrub_stamp":"2024-09-22T08:40:54.395141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:45:09.894926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"32'16","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:30.267408+0000","last_change":"2024-09-22T08:36:34.018605+0000","last_active":"2024-09-22T08:38:30.267408+0000","last_peered":"2024-09-22T08:38:30.267408+0000","last_clean":"2024-09-22T08:38:30.267408+0000","last_became_active":"2024-09-22T08:36:34.018365+0000","last_became_peered":"2024-09-22T08:36:34.018365+0000","last_unstale":"2024-09-22T08:38:30.267408+0000","last_undegraded":"2024-09-22T08:38:30.267408+0000","last_fullsized":"2024-09-22T08:38:30.267408+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:01:49.722849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":96,"num_read_kb":76,"num_write":46,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"32'8","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:02.399251+0000","last_change":"2024-09-22T08:40:02.399251+0000","last_active":"2024-09-22T08:40:02.399251+0000","last_peered":"2024-09-22T08:40:02.399251+0000","last_clean":"2024-09-22T08:40:02.399251+0000","last_became_active":"2024-09-22T08:36:25.973089+0000","last_became_peered":"2024-09-22T08:36:25.973089+0000","last_unstale":"2024-09-22T08:40:02.399251+0000","last_undegraded":"2024-09-22T08:40:02.399251+0000","last_fullsized":"2024-09-22T08:40:02.399251+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-22T08:40:02.399133+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-22T08:40:02.399133+0000","last_clean_scrub_stamp":"2024-09-22T08:40:02.399133+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:04:36.042470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:51.157044+0000","last_change":"2024-09-22T08:39:51.156994+0000","last_active":"2024-09-22T08:39:51.157044+0000","last_peered":"2024-09-22T08:39:51.157044+0000","last_clean":"2024-09-22T08:39:51.157044+0000","last_became_active":"2024-09-22T08:36:23.968249+0000","last_became_peered":"2024-09-22T08:36:23.968249+0000","last_unstale":"2024-09-22T08:39:51.157044+0000","last_undegraded":"2024-09-22T08:39:51.157044+0000","last_fullsized":"2024-09-22T08:39:51.157044+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-22T08:39:51.156910+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-22T08:39:51.156910+0000","last_clean_scrub_stamp":"2024-09-22T08:39:51.156910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:55:37.836983+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"32'3","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:24.334465+0000","last_change":"2024-09-22T08:40:24.334465+0000","last_active":"2024-09-22T08:40:24.334465+0000","last_peered":"2024-09-22T08:40:24.334465+0000","last_clean":"2024-09-22T08:40:24.334465+0000","last_became_active":"2024-09-22T08:36:27.988262+0000","last_became_peered":"2024-09-22T08:36:27.988262+0000","last_unstale":"2024-09-22T08:40:24.334465+0000","last_undegraded":"2024-09-22T08:40:24.334465+0000","last_fullsized":"2024-09-22T08:40:24.334465+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2024-09-22T08:40:24.334357+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2024-09-22T08:40:24.334357+0000","last_clean_scrub_stamp":"2024-09-22T08:40:24.334357+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:51:02.384626+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"32'40","reported_seq":97,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:48.479366+0000","last_change":"2024-09-22T08:40:48.479366+0000","last_active":"2024-09-22T08:40:48.479366+0000","last_peered":"2024-09-22T08:40:48.479366+0000","last_clean":"2024-09-22T08:40:48.479366+0000","last_became_active":"2024-09-22T08:36:29.997231+0000","last_became_peered":"2024-09-22T08:36:29.997231+0000","last_unstale":"2024-09-22T08:40:48.479366+0000","last_undegraded":"2024-09-22T08:40:48.479366+0000","last_fullsized":"2024-09-22T08:40:48.479366+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'40","last_scrub_stamp":"2024-09-22T08:40:48.479270+0000","last_deep_scrub":"32'40","last_deep_scrub_stamp":"2024-09-22T08:40:48.479270+0000","last_clean_scrub_stamp":"2024-09-22T08:40:48.479270+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:27:30.586401+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1270,"num_omap_keys":6,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:39.811332+0000","last_change":"2024-09-22T08:40:39.811332+0000","last_active":"2024-09-22T08:40:39.811332+0000","last_peered":"2024-09-22T08:40:39.811332+0000","last_clean":"2024-09-22T08:40:39.811332+0000","last_became_active":"2024-09-22T08:36:32.004365+0000","last_became_peered":"2024-09-22T08:36:32.004365+0000","last_unstale":"2024-09-22T08:40:39.811332+0000","last_undegraded":"2024-09-22T08:40:39.811332+0000","last_fullsized":"2024-09-22T08:40:39.811332+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:39.811245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:39.811245+0000","last_clean_scrub_stamp":"2024-09-22T08:40:39.811245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:37:48.980763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"32'4","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:38:30.270088+0000","last_change":"2024-09-22T08:36:34.016625+0000","last_active":"2024-09-22T08:38:30.270088+0000","last_peered":"2024-09-22T08:38:30.270088+0000","last_clean":"2024-09-22T08:38:30.270088+0000","last_became_active":"2024-09-22T08:36:34.016106+0000","last_became_peered":"2024-09-22T08:36:34.016106+0000","last_unstale":"2024-09-22T08:38:30.270088+0000","last_undegraded":"2024-09-22T08:38:30.270088+0000","last_fullsized":"2024-09-22T08:38:30.270088+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:32.990486+0000","last_clean_scrub_stamp":"2024-09-22T08:36:32.990486+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:10:10.424019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"32'12","reported_seq":79,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:06.403652+0000","last_change":"2024-09-22T08:40:06.403598+0000","last_active":"2024-09-22T08:40:06.403652+0000","last_peered":"2024-09-22T08:40:06.403652+0000","last_clean":"2024-09-22T08:40:06.403652+0000","last_became_active":"2024-09-22T08:36:25.987161+0000","last_became_peered":"2024-09-22T08:36:25.987161+0000","last_unstale":"2024-09-22T08:40:06.403652+0000","last_undegraded":"2024-09-22T08:40:06.403652+0000","last_fullsized":"2024-09-22T08:40:06.403652+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-09-22T08:40:06.403521+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-09-22T08:40:06.403521+0000","last_clean_scrub_stamp":"2024-09-22T08:40:06.403521+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:26:49.349866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:51.626331+0000","last_change":"2024-09-22T08:39:51.626242+0000","last_active":"2024-09-22T08:39:51.626331+0000","last_peered":"2024-09-22T08:39:51.626331+0000","last_clean":"2024-09-22T08:39:51.626331+0000","last_became_active":"2024-09-22T08:36:23.969515+0000","last_became_peered":"2024-09-22T08:36:23.969515+0000","last_unstale":"2024-09-22T08:39:51.626331+0000","last_undegraded":"2024-09-22T08:39:51.626331+0000","last_fullsized":"2024-09-22T08:39:51.626331+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:39:51.626108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:39:51.626108+0000","last_clean_scrub_stamp":"2024-09-22T08:39:51.626108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:12:42.258599+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"32'12","reported_seq":73,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:07.850131+0000","last_change":"2024-09-22T08:40:07.850074+0000","last_active":"2024-09-22T08:40:07.850131+0000","last_peered":"2024-09-22T08:40:07.850131+0000","last_clean":"2024-09-22T08:40:07.850131+0000","last_became_active":"2024-09-22T08:36:25.978679+0000","last_became_peered":"2024-09-22T08:36:25.978679+0000","last_unstale":"2024-09-22T08:40:07.850131+0000","last_undegraded":"2024-09-22T08:40:07.850131+0000","last_fullsized":"2024-09-22T08:40:07.850131+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-09-22T08:40:07.849968+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-09-22T08:40:07.849968+0000","last_clean_scrub_stamp":"2024-09-22T08:40:07.849968+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:50:10.705568+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:50.767547+0000","last_change":"2024-09-22T08:39:50.767473+0000","last_active":"2024-09-22T08:39:50.767547+0000","last_peered":"2024-09-22T08:39:50.767547+0000","last_clean":"2024-09-22T08:39:50.767547+0000","last_became_active":"2024-09-22T08:36:23.970218+0000","last_became_peered":"2024-09-22T08:36:23.970218+0000","last_unstale":"2024-09-22T08:39:50.767547+0000","last_undegraded":"2024-09-22T08:39:50.767547+0000","last_fullsized":"2024-09-22T08:39:50.767547+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-22T08:39:50.767366+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-22T08:39:50.767366+0000","last_clean_scrub_stamp":"2024-09-22T08:39:50.767366+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:50:42.858238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"32'12","reported_seq":68,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:20.546338+0000","last_change":"2024-09-22T08:40:20.546264+0000","last_active":"2024-09-22T08:40:20.546338+0000","last_peered":"2024-09-22T08:40:20.546338+0000","last_clean":"2024-09-22T08:40:20.546338+0000","last_became_active":"2024-09-22T08:36:25.989638+0000","last_became_peered":"2024-09-22T08:36:25.989638+0000","last_unstale":"2024-09-22T08:40:20.546338+0000","last_undegraded":"2024-09-22T08:40:20.546338+0000","last_fullsized":"2024-09-22T08:40:20.546338+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-09-22T08:40:20.546161+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-09-22T08:40:20.546161+0000","last_clean_scrub_stamp":"2024-09-22T08:40:20.546161+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:20:45.107609+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":33,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:58.317648+0000","last_change":"2024-09-22T08:39:58.317577+0000","last_active":"2024-09-22T08:39:58.317648+0000","last_peered":"2024-09-22T08:39:58.317648+0000","last_clean":"2024-09-22T08:39:58.317648+0000","last_became_active":"2024-09-22T08:36:23.972582+0000","last_became_peered":"2024-09-22T08:36:23.972582+0000","last_unstale":"2024-09-22T08:39:58.317648+0000","last_undegraded":"2024-09-22T08:39:58.317648+0000","last_fullsized":"2024-09-22T08:39:58.317648+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:39:58.317493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:39:58.317493+0000","last_clean_scrub_stamp":"2024-09-22T08:39:58.317493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:30:33.805756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:06.836874+0000","last_change":"2024-09-22T08:40:06.836804+0000","last_active":"2024-09-22T08:40:06.836874+0000","last_peered":"2024-09-22T08:40:06.836874+0000","last_clean":"2024-09-22T08:40:06.836874+0000","last_became_active":"2024-09-22T08:36:25.978538+0000","last_became_peered":"2024-09-22T08:36:25.978538+0000","last_unstale":"2024-09-22T08:40:06.836874+0000","last_undegraded":"2024-09-22T08:40:06.836874+0000","last_fullsized":"2024-09-22T08:40:06.836874+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:06.836699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:06.836699+0000","last_clean_scrub_stamp":"2024-09-22T08:40:06.836699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:16:11.004999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:51.809328+0000","last_change":"2024-09-22T08:39:51.809249+0000","last_active":"2024-09-22T08:39:51.809328+0000","last_peered":"2024-09-22T08:39:51.809328+0000","last_clean":"2024-09-22T08:39:51.809328+0000","last_became_active":"2024-09-22T08:36:23.973945+0000","last_became_peered":"2024-09-22T08:36:23.973945+0000","last_unstale":"2024-09-22T08:39:51.809328+0000","last_undegraded":"2024-09-22T08:39:51.809328+0000","last_fullsized":"2024-09-22T08:39:51.809328+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:39:51.809165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:39:51.809165+0000","last_clean_scrub_stamp":"2024-09-22T08:39:51.809165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:41:14.543135+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"32'2","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:09.879496+0000","last_change":"2024-09-22T08:40:09.879440+0000","last_active":"2024-09-22T08:40:09.879496+0000","last_peered":"2024-09-22T08:40:09.879496+0000","last_clean":"2024-09-22T08:40:09.879496+0000","last_became_active":"2024-09-22T08:36:25.984094+0000","last_became_peered":"2024-09-22T08:36:25.984094+0000","last_unstale":"2024-09-22T08:40:09.879496+0000","last_undegraded":"2024-09-22T08:40:09.879496+0000","last_fullsized":"2024-09-22T08:40:09.879496+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-22T08:40:09.879355+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-22T08:40:09.879355+0000","last_clean_scrub_stamp":"2024-09-22T08:40:09.879355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:15:19.787347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:52.813940+0000","last_change":"2024-09-22T08:39:52.813867+0000","last_active":"2024-09-22T08:39:52.813940+0000","last_peered":"2024-09-22T08:39:52.813940+0000","last_clean":"2024-09-22T08:39:52.813940+0000","last_became_active":"2024-09-22T08:36:23.970920+0000","last_became_peered":"2024-09-22T08:36:23.970920+0000","last_unstale":"2024-09-22T08:39:52.813940+0000","last_undegraded":"2024-09-22T08:39:52.813940+0000","last_fullsized":"2024-09-22T08:39:52.813940+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-22T08:39:52.813773+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-22T08:39:52.813773+0000","last_clean_scrub_stamp":"2024-09-22T08:39:52.813773+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:32:25.388534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"32'12","reported_seq":78,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:05.355128+0000","last_change":"2024-09-22T08:40:05.355078+0000","last_active":"2024-09-22T08:40:05.355128+0000","last_peered":"2024-09-22T08:40:05.355128+0000","last_clean":"2024-09-22T08:40:05.355128+0000","last_became_active":"2024-09-22T08:36:25.985965+0000","last_became_peered":"2024-09-22T08:36:25.985965+0000","last_unstale":"2024-09-22T08:40:05.355128+0000","last_undegraded":"2024-09-22T08:40:05.355128+0000","last_fullsized":"2024-09-22T08:40:05.355128+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-09-22T08:40:05.354995+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-09-22T08:40:05.354995+0000","last_clean_scrub_stamp":"2024-09-22T08:40:05.354995+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:08:14.083131+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":11,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:52.189303+0000","last_change":"2024-09-22T08:39:52.189228+0000","last_active":"2024-09-22T08:39:52.189303+0000","last_peered":"2024-09-22T08:39:52.189303+0000","last_clean":"2024-09-22T08:39:52.189303+0000","last_became_active":"2024-09-22T08:36:23.983722+0000","last_became_peered":"2024-09-22T08:36:23.983722+0000","last_unstale":"2024-09-22T08:39:52.189303+0000","last_undegraded":"2024-09-22T08:39:52.189303+0000","last_fullsized":"2024-09-22T08:39:52.189303+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:39:52.189117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:39:52.189117+0000","last_clean_scrub_stamp":"2024-09-22T08:39:52.189117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:49:51.464801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"32'4","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:04.756500+0000","last_change":"2024-09-22T08:40:04.756446+0000","last_active":"2024-09-22T08:40:04.756500+0000","last_peered":"2024-09-22T08:40:04.756500+0000","last_clean":"2024-09-22T08:40:04.756500+0000","last_became_active":"2024-09-22T08:36:25.983061+0000","last_became_peered":"2024-09-22T08:36:25.983061+0000","last_unstale":"2024-09-22T08:40:04.756500+0000","last_undegraded":"2024-09-22T08:40:04.756500+0000","last_fullsized":"2024-09-22T08:40:04.756500+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-22T08:40:04.756359+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-22T08:40:04.756359+0000","last_clean_scrub_stamp":"2024-09-22T08:40:04.756359+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:17:00.830661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:52.621679+0000","last_change":"2024-09-22T08:39:52.621578+0000","last_active":"2024-09-22T08:39:52.621679+0000","last_peered":"2024-09-22T08:39:52.621679+0000","last_clean":"2024-09-22T08:39:52.621679+0000","last_became_active":"2024-09-22T08:36:23.973924+0000","last_became_peered":"2024-09-22T08:36:23.973924+0000","last_unstale":"2024-09-22T08:39:52.621679+0000","last_undegraded":"2024-09-22T08:39:52.621679+0000","last_fullsized":"2024-09-22T08:39:52.621679+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:39:52.621486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:39:52.621486+0000","last_clean_scrub_stamp":"2024-09-22T08:39:52.621486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:10:20.959216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"32'18","reported_seq":88,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:04.305369+0000","last_change":"2024-09-22T08:40:04.305270+0000","last_active":"2024-09-22T08:40:04.305369+0000","last_peered":"2024-09-22T08:40:04.305369+0000","last_clean":"2024-09-22T08:40:04.305369+0000","last_became_active":"2024-09-22T08:36:25.979151+0000","last_became_peered":"2024-09-22T08:36:25.979151+0000","last_unstale":"2024-09-22T08:40:04.305369+0000","last_undegraded":"2024-09-22T08:40:04.305369+0000","last_fullsized":"2024-09-22T08:40:04.305369+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'18","last_scrub_stamp":"2024-09-22T08:40:04.305175+0000","last_deep_scrub":"32'18","last_deep_scrub_stamp":"2024-09-22T08:40:04.305175+0000","last_clean_scrub_stamp":"2024-09-22T08:40:04.305175+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:39:13.164022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":64,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:53.864336+0000","last_change":"2024-09-22T08:39:53.864259+0000","last_active":"2024-09-22T08:39:53.864336+0000","last_peered":"2024-09-22T08:39:53.864336+0000","last_clean":"2024-09-22T08:39:53.864336+0000","last_became_active":"2024-09-22T08:36:23.970584+0000","last_became_peered":"2024-09-22T08:36:23.970584+0000","last_unstale":"2024-09-22T08:39:53.864336+0000","last_undegraded":"2024-09-22T08:39:53.864336+0000","last_fullsized":"2024-09-22T08:39:53.864336+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:39:53.864171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:39:53.864171+0000","last_clean_scrub_stamp":"2024-09-22T08:39:53.864171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:54:15.743899+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"32'16","reported_seq":97,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:10.444682+0000","last_change":"2024-09-22T08:40:10.444682+0000","last_active":"2024-09-22T08:40:10.444682+0000","last_peered":"2024-09-22T08:40:10.444682+0000","last_clean":"2024-09-22T08:40:10.444682+0000","last_became_active":"2024-09-22T08:36:25.978730+0000","last_became_peered":"2024-09-22T08:36:25.978730+0000","last_unstale":"2024-09-22T08:40:10.444682+0000","last_undegraded":"2024-09-22T08:40:10.444682+0000","last_fullsized":"2024-09-22T08:40:10.444682+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'16","last_scrub_stamp":"2024-09-22T08:40:10.444585+0000","last_deep_scrub":"32'16","last_deep_scrub_stamp":"2024-09-22T08:40:10.444585+0000","last_clean_scrub_stamp":"2024-09-22T08:40:10.444585+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:20:44.546694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":70,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"32'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:00.269904+0000","last_change":"2024-09-22T08:40:00.269799+0000","last_active":"2024-09-22T08:40:00.269904+0000","last_peered":"2024-09-22T08:40:00.269904+0000","last_clean":"2024-09-22T08:40:00.269904+0000","last_became_active":"2024-09-22T08:36:23.973175+0000","last_became_peered":"2024-09-22T08:36:23.973175+0000","last_unstale":"2024-09-22T08:40:00.269904+0000","last_undegraded":"2024-09-22T08:40:00.269904+0000","last_fullsized":"2024-09-22T08:40:00.269904+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-22T08:40:00.269709+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-22T08:40:00.269709+0000","last_clean_scrub_stamp":"2024-09-22T08:40:00.269709+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:41:49.730855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"32'6","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:22.563038+0000","last_change":"2024-09-22T08:40:22.563038+0000","last_active":"2024-09-22T08:40:22.563038+0000","last_peered":"2024-09-22T08:40:22.563038+0000","last_clean":"2024-09-22T08:40:22.563038+0000","last_became_active":"2024-09-22T08:36:25.991611+0000","last_became_peered":"2024-09-22T08:36:25.991611+0000","last_unstale":"2024-09-22T08:40:22.563038+0000","last_undegraded":"2024-09-22T08:40:22.563038+0000","last_fullsized":"2024-09-22T08:40:22.563038+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-22T08:40:22.562955+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-22T08:40:22.562955+0000","last_clean_scrub_stamp":"2024-09-22T08:40:22.562955+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:47:21.108045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"32'6","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:54.860457+0000","last_change":"2024-09-22T08:39:54.860397+0000","last_active":"2024-09-22T08:39:54.860457+0000","last_peered":"2024-09-22T08:39:54.860457+0000","last_clean":"2024-09-22T08:39:54.860457+0000","last_became_active":"2024-09-22T08:36:23.973721+0000","last_became_peered":"2024-09-22T08:36:23.973721+0000","last_unstale":"2024-09-22T08:39:54.860457+0000","last_undegraded":"2024-09-22T08:39:54.860457+0000","last_fullsized":"2024-09-22T08:39:54.860457+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-22T08:39:54.860314+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-22T08:39:54.860314+0000","last_clean_scrub_stamp":"2024-09-22T08:39:54.860314+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:19:21.761274+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4,"num_write":22,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"32'8","reported_seq":78,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:08.880044+0000","last_change":"2024-09-22T08:40:08.879975+0000","last_active":"2024-09-22T08:40:08.880044+0000","last_peered":"2024-09-22T08:40:08.880044+0000","last_clean":"2024-09-22T08:40:08.880044+0000","last_became_active":"2024-09-22T08:37:04.231342+0000","last_became_peered":"2024-09-22T08:37:04.231342+0000","last_unstale":"2024-09-22T08:40:08.880044+0000","last_undegraded":"2024-09-22T08:40:08.880044+0000","last_fullsized":"2024-09-22T08:40:08.880044+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-22T08:40:08.879881+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-22T08:40:08.879881+0000","last_clean_scrub_stamp":"2024-09-22T08:40:08.879881+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:29:38.636460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:53.142543+0000","last_change":"2024-09-22T08:39:53.142490+0000","last_active":"2024-09-22T08:39:53.142543+0000","last_peered":"2024-09-22T08:39:53.142543+0000","last_clean":"2024-09-22T08:39:53.142543+0000","last_became_active":"2024-09-22T08:36:23.975352+0000","last_became_peered":"2024-09-22T08:36:23.975352+0000","last_unstale":"2024-09-22T08:39:53.142543+0000","last_undegraded":"2024-09-22T08:39:53.142543+0000","last_fullsized":"2024-09-22T08:39:53.142543+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:39:53.142406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:39:53.142406+0000","last_clean_scrub_stamp":"2024-09-22T08:39:53.142406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:12:04.379120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:09.423400+0000","last_change":"2024-09-22T08:40:09.423304+0000","last_active":"2024-09-22T08:40:09.423400+0000","last_peered":"2024-09-22T08:40:09.423400+0000","last_clean":"2024-09-22T08:40:09.423400+0000","last_became_active":"2024-09-22T08:36:25.977732+0000","last_became_peered":"2024-09-22T08:36:25.977732+0000","last_unstale":"2024-09-22T08:40:09.423400+0000","last_undegraded":"2024-09-22T08:40:09.423400+0000","last_fullsized":"2024-09-22T08:40:09.423400+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:09.423216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:09.423216+0000","last_clean_scrub_stamp":"2024-09-22T08:40:09.423216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:29:07.668069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:54.171543+0000","last_change":"2024-09-22T08:39:54.171493+0000","last_active":"2024-09-22T08:39:54.171543+0000","last_peered":"2024-09-22T08:39:54.171543+0000","last_clean":"2024-09-22T08:39:54.171543+0000","last_became_active":"2024-09-22T08:36:23.975986+0000","last_became_peered":"2024-09-22T08:36:23.975986+0000","last_unstale":"2024-09-22T08:39:54.171543+0000","last_undegraded":"2024-09-22T08:39:54.171543+0000","last_fullsized":"2024-09-22T08:39:54.171543+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:39:54.171402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:39:54.171402+0000","last_clean_scrub_stamp":"2024-09-22T08:39:54.171402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:30:19.750104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"32'10","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:14.385965+0000","last_change":"2024-09-22T08:40:14.385913+0000","last_active":"2024-09-22T08:40:14.385965+0000","last_peered":"2024-09-22T08:40:14.385965+0000","last_clean":"2024-09-22T08:40:14.385965+0000","last_became_active":"2024-09-22T08:36:25.984258+0000","last_became_peered":"2024-09-22T08:36:25.984258+0000","last_unstale":"2024-09-22T08:40:14.385965+0000","last_undegraded":"2024-09-22T08:40:14.385965+0000","last_fullsized":"2024-09-22T08:40:14.385965+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-09-22T08:40:14.385812+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-09-22T08:40:14.385812+0000","last_clean_scrub_stamp":"2024-09-22T08:40:14.385812+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:44:29.101922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:01.295994+0000","last_change":"2024-09-22T08:40:01.295930+0000","last_active":"2024-09-22T08:40:01.295994+0000","last_peered":"2024-09-22T08:40:01.295994+0000","last_clean":"2024-09-22T08:40:01.295994+0000","last_became_active":"2024-09-22T08:36:23.979548+0000","last_became_peered":"2024-09-22T08:36:23.979548+0000","last_unstale":"2024-09-22T08:40:01.295994+0000","last_undegraded":"2024-09-22T08:40:01.295994+0000","last_fullsized":"2024-09-22T08:40:01.295994+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:01.295827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:01.295827+0000","last_clean_scrub_stamp":"2024-09-22T08:40:01.295827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:46:58.524286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"32'16","reported_seq":68,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:08.426942+0000","last_change":"2024-09-22T08:40:08.426849+0000","last_active":"2024-09-22T08:40:08.426942+0000","last_peered":"2024-09-22T08:40:08.426942+0000","last_clean":"2024-09-22T08:40:08.426942+0000","last_became_active":"2024-09-22T08:36:25.979965+0000","last_became_peered":"2024-09-22T08:36:25.979965+0000","last_unstale":"2024-09-22T08:40:08.426942+0000","last_undegraded":"2024-09-22T08:40:08.426942+0000","last_fullsized":"2024-09-22T08:40:08.426942+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'16","last_scrub_stamp":"2024-09-22T08:40:08.426756+0000","last_deep_scrub":"32'16","last_deep_scrub_stamp":"2024-09-22T08:40:08.426756+0000","last_clean_scrub_stamp":"2024-09-22T08:40:08.426756+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:00:38.752121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":51,"num_write":22,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"32'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:02.303199+0000","last_change":"2024-09-22T08:40:02.303092+0000","last_active":"2024-09-22T08:40:02.303199+0000","last_peered":"2024-09-22T08:40:02.303199+0000","last_clean":"2024-09-22T08:40:02.303199+0000","last_became_active":"2024-09-22T08:36:23.978225+0000","last_became_peered":"2024-09-22T08:36:23.978225+0000","last_unstale":"2024-09-22T08:40:02.303199+0000","last_undegraded":"2024-09-22T08:40:02.303199+0000","last_fullsized":"2024-09-22T08:40:02.303199+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-22T08:40:02.302998+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-22T08:40:02.302998+0000","last_clean_scrub_stamp":"2024-09-22T08:40:02.302998+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:19:57.676393+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"32'6","reported_seq":61,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:21.569385+0000","last_change":"2024-09-22T08:40:21.569303+0000","last_active":"2024-09-22T08:40:21.569385+0000","last_peered":"2024-09-22T08:40:21.569385+0000","last_clean":"2024-09-22T08:40:21.569385+0000","last_became_active":"2024-09-22T08:36:25.990690+0000","last_became_peered":"2024-09-22T08:36:25.990690+0000","last_unstale":"2024-09-22T08:40:21.569385+0000","last_undegraded":"2024-09-22T08:40:21.569385+0000","last_fullsized":"2024-09-22T08:40:21.569385+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-22T08:40:21.569206+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-22T08:40:21.569206+0000","last_clean_scrub_stamp":"2024-09-22T08:40:21.569206+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:25:32.682806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:53.617208+0000","last_change":"2024-09-22T08:39:53.617208+0000","last_active":"2024-09-22T08:39:53.617208+0000","last_peered":"2024-09-22T08:39:53.617208+0000","last_clean":"2024-09-22T08:39:53.617208+0000","last_became_active":"2024-09-22T08:36:23.973976+0000","last_became_peered":"2024-09-22T08:36:23.973976+0000","last_unstale":"2024-09-22T08:39:53.617208+0000","last_undegraded":"2024-09-22T08:39:53.617208+0000","last_fullsized":"2024-09-22T08:39:53.617208+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:39:53.617119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:39:53.617119+0000","last_clean_scrub_stamp":"2024-09-22T08:39:53.617119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:07:03.861422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"32'2","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:07.399470+0000","last_change":"2024-09-22T08:40:07.399420+0000","last_active":"2024-09-22T08:40:07.399470+0000","last_peered":"2024-09-22T08:40:07.399470+0000","last_clean":"2024-09-22T08:40:07.399470+0000","last_became_active":"2024-09-22T08:36:25.975794+0000","last_became_peered":"2024-09-22T08:36:25.975794+0000","last_unstale":"2024-09-22T08:40:07.399470+0000","last_undegraded":"2024-09-22T08:40:07.399470+0000","last_fullsized":"2024-09-22T08:40:07.399470+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-22T08:40:07.399339+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-22T08:40:07.399339+0000","last_clean_scrub_stamp":"2024-09-22T08:40:07.399339+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:48:57.554466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"32'2","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:03.266087+0000","last_change":"2024-09-22T08:40:03.266087+0000","last_active":"2024-09-22T08:40:03.266087+0000","last_peered":"2024-09-22T08:40:03.266087+0000","last_clean":"2024-09-22T08:40:03.266087+0000","last_became_active":"2024-09-22T08:36:23.982376+0000","last_became_peered":"2024-09-22T08:36:23.982376+0000","last_unstale":"2024-09-22T08:40:03.266087+0000","last_undegraded":"2024-09-22T08:40:03.266087+0000","last_fullsized":"2024-09-22T08:40:03.266087+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-22T08:40:03.265985+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-22T08:40:03.265985+0000","last_clean_scrub_stamp":"2024-09-22T08:40:03.265985+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:02:58.569511+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:05.287659+0000","last_change":"2024-09-22T08:40:05.287659+0000","last_active":"2024-09-22T08:40:05.287659+0000","last_peered":"2024-09-22T08:40:05.287659+0000","last_clean":"2024-09-22T08:40:05.287659+0000","last_became_active":"2024-09-22T08:36:23.978787+0000","last_became_peered":"2024-09-22T08:36:23.978787+0000","last_unstale":"2024-09-22T08:40:05.287659+0000","last_undegraded":"2024-09-22T08:40:05.287659+0000","last_fullsized":"2024-09-22T08:40:05.287659+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:05.287568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:05.287568+0000","last_clean_scrub_stamp":"2024-09-22T08:40:05.287568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:59:39.200932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"32'8","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:10.872172+0000","last_change":"2024-09-22T08:40:10.872172+0000","last_active":"2024-09-22T08:40:10.872172+0000","last_peered":"2024-09-22T08:40:10.872172+0000","last_clean":"2024-09-22T08:40:10.872172+0000","last_became_active":"2024-09-22T08:36:25.979593+0000","last_became_peered":"2024-09-22T08:36:25.979593+0000","last_unstale":"2024-09-22T08:40:10.872172+0000","last_undegraded":"2024-09-22T08:40:10.872172+0000","last_fullsized":"2024-09-22T08:40:10.872172+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-22T08:40:10.872074+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-22T08:40:10.872074+0000","last_clean_scrub_stamp":"2024-09-22T08:40:10.872074+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:25:45.090218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:55.878768+0000","last_change":"2024-09-22T08:39:55.878768+0000","last_active":"2024-09-22T08:39:55.878768+0000","last_peered":"2024-09-22T08:39:55.878768+0000","last_clean":"2024-09-22T08:39:55.878768+0000","last_became_active":"2024-09-22T08:36:23.974202+0000","last_became_peered":"2024-09-22T08:36:23.974202+0000","last_unstale":"2024-09-22T08:39:55.878768+0000","last_undegraded":"2024-09-22T08:39:55.878768+0000","last_fullsized":"2024-09-22T08:39:55.878768+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:39:55.878679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:39:55.878679+0000","last_clean_scrub_stamp":"2024-09-22T08:39:55.878679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:42:02.792761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"32'14","reported_seq":87,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:16.311548+0000","last_change":"2024-09-22T08:40:16.311548+0000","last_active":"2024-09-22T08:40:16.311548+0000","last_peered":"2024-09-22T08:40:16.311548+0000","last_clean":"2024-09-22T08:40:16.311548+0000","last_became_active":"2024-09-22T08:37:04.233241+0000","last_became_peered":"2024-09-22T08:37:04.233241+0000","last_unstale":"2024-09-22T08:40:16.311548+0000","last_undegraded":"2024-09-22T08:40:16.311548+0000","last_fullsized":"2024-09-22T08:40:16.311548+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'14","last_scrub_stamp":"2024-09-22T08:40:16.311459+0000","last_deep_scrub":"32'14","last_deep_scrub_stamp":"2024-09-22T08:40:16.311459+0000","last_clean_scrub_stamp":"2024-09-22T08:40:16.311459+0000","objects_scrubbed":1,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:43:58.325817+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":47,"num_read_kb":43,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1549,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":690,"num_read_kb":658,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":349,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":275,"ondisk_log_size":275,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2288,"ondisk_log_size":2288,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1600,"num_read_kb":1397,"num_write":597,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3000,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1557,"ondisk_log_size":1557,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19,"ondisk_log_size":19,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1672,"num_read_kb":1562,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":482,"ondisk_log_size":482,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":177,"num_read_kb":83,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":128,"acting":128,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":11,"seq":47244640319,"num_pgs":124,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40472,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331368,"statfs":{"total":96636764160,"available":96595320832,"internally_reserved":0,"allocated":991232,"data_stored":726145,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640319,"num_pgs":119,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36324,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335516,"statfs":{"total":96636764160,"available":96599568384,"internally_reserved":0,"allocated":1003520,"data_stored":724639,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":9,"seq":38654705726,"num_pgs":152,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39960,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331880,"statfs":{"total":96636764160,"available":96595845120,"internally_reserved":0,"allocated":466944,"data_stored":138067,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705726,"num_pgs":135,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39916,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331924,"statfs":{"total":96636764160,"available":96595890176,"internally_reserved":0,"allocated":421888,"data_stored":135213,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":325,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":421,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T08:41:05.162 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-22T08:36:32.990486+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:41:05.162 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-22T08:36:32.990486+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:41:05.163 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-22T08:36:32.990486+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:41:05.163 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-22T08:36:32.990486+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=39, tm_sec=40, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:41:05.164 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-22T08:41:25.165 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T08:41:25.279 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:41:25.277+0000 7fdeb7a5a640 1 Processor -- start 2024-09-22T08:41:25.279 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:41:25.277+0000 7fdeb7a5a640 1 -- start start 2024-09-22T08:41:25.280 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:41:25.278+0000 7fdeb7a5a640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fdeb006e170 0x7fdeb006e550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:41:25.280 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:41:25.278+0000 7fdeb7a5a640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdeb0071770 con 0x7fdeb0071e30 2024-09-22T08:41:25.280 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:41:25.278+0000 7fdeb7a5a640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7fdeb0099ee0 con 0x7fdeb006e170 2024-09-22T08:41:25.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:41:25.278+0000 7fdeb57f6640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fdeb006e170 0x7fdeb006e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:41:25.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:41:25.278+0000 7fdeb4ff5640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fdeb0071e30 0x7fdeb0097100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:44576/0 (socket says 172.21.15.31:44576) 2024-09-22T08:41:25.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:41:25.278+0000 7fdeb4ff5640 1 -- 172.21.15.31:0/1637170853 learned_addr learned my addr 172.21.15.31:0/1637170853 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-22T08:41:25.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:41:25.278+0000 7fdeb57f6640 1 -- 172.21.15.31:0/1637170853 >> v1:172.21.15.31:6789/0 conn(0x7fdeb0071e30 legacy=0x7fdeb0097100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:41:25.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:41:25.278+0000 7fdeb57f6640 1 -- 172.21.15.31:0/1637170853 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdeb0072530 con 0x7fdeb006e170 2024-09-22T08:41:25.282 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:41:25.279+0000 7fdeb57f6640 1 --2- 172.21.15.31:0/1637170853 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdeb006e170 0x7fdeb006e550 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7fdea0009dc0 tx=0x7fdea002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=834e6d6196a6d4ea server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:41:25.282 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:41:25.279+0000 7fdeaffff640 1 -- 172.21.15.31:0/1637170853 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdea0007670 con 0x7fdeb006e170 2024-09-22T08:41:25.282 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:41:25.279+0000 7fdeaffff640 1 -- 172.21.15.31:0/1637170853 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdea0007810 con 0x7fdeb006e170 2024-09-22T08:41:25.282 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:41:25.279+0000 7fdeaffff640 1 -- 172.21.15.31:0/1637170853 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdea0007b10 con 0x7fdeb006e170 2024-09-22T08:41:25.282 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:41:25.280+0000 7fdeb7a5a640 1 -- 172.21.15.31:0/1637170853 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdeb006e170 msgr2=0x7fdeb006e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:41:25.282 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:41:25.280+0000 7fdeb7a5a640 1 --2- 172.21.15.31:0/1637170853 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdeb006e170 0x7fdeb006e550 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7fdea0009dc0 tx=0x7fdea002a6a0 comp rx=0 tx=0).stop 2024-09-22T08:41:25.283 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:41:25.280+0000 7fdeb7a5a640 1 -- 172.21.15.31:0/1637170853 shutdown_connections 2024-09-22T08:41:25.283 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:41:25.280+0000 7fdeb7a5a640 1 --2- 172.21.15.31:0/1637170853 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdeb006e170 0x7fdeb006e550 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:41:25.283 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:41:25.280+0000 7fdeb7a5a640 1 -- 172.21.15.31:0/1637170853 >> 172.21.15.31:0/1637170853 conn(0x7fdeb009ac80 msgr2=0x7fdeb0098550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:41:25.283 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:41:25.280+0000 7fdeb7a5a640 1 -- 172.21.15.31:0/1637170853 shutdown_connections 2024-09-22T08:41:25.283 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:41:25.280+0000 7fdeb7a5a640 1 -- 172.21.15.31:0/1637170853 wait complete. 2024-09-22T08:41:25.284 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:41:25.281+0000 7fdeb7a5a640 1 Processor -- start 2024-09-22T08:41:25.284 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:41:25.281+0000 7fdeb7a5a640 1 -- start start 2024-09-22T08:41:25.284 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:41:25.281+0000 7fdeb7a5a640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdeb006e170 0x7fdeb006f280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:41:25.284 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:41:25.281+0000 7fdeb7a5a640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fdeb006ee20 con 0x7fdeb006e170 2024-09-22T08:41:25.285 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:41:25.281+0000 7fdeb57f6640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdeb006e170 0x7fdeb006f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:41:25.285 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:41:25.281+0000 7fdeb57f6640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdeb006e170 0x7fdeb006f280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:35996/0 (socket says 172.21.15.31:35996) 2024-09-22T08:41:25.285 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:41:25.281+0000 7fdeb57f6640 1 -- 172.21.15.31:0/141289976 learned_addr learned my addr 172.21.15.31:0/141289976 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-22T08:41:25.285 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:41:25.282+0000 7fdeb57f6640 1 -- 172.21.15.31:0/141289976 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdeb0070bf0 con 0x7fdeb006e170 2024-09-22T08:41:25.285 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:41:25.282+0000 7fdeb57f6640 1 --2- 172.21.15.31:0/141289976 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdeb006e170 0x7fdeb006f280 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7fdea0009ee0 tx=0x7fdea0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:41:25.285 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:41:25.282+0000 7fdeadffb640 1 -- 172.21.15.31:0/141289976 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdea0040070 con 0x7fdeb006e170 2024-09-22T08:41:25.285 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:41:25.282+0000 7fdeadffb640 1 -- 172.21.15.31:0/141289976 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdea00079c0 con 0x7fdeb006e170 2024-09-22T08:41:25.285 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:41:25.282+0000 7fdeb7a5a640 1 -- 172.21.15.31:0/141289976 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdeb012a930 con 0x7fdeb006e170 2024-09-22T08:41:25.285 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:41:25.282+0000 7fdeadffb640 1 -- 172.21.15.31:0/141289976 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdea0007670 con 0x7fdeb006e170 2024-09-22T08:41:25.285 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:41:25.282+0000 7fdeb7a5a640 1 -- 172.21.15.31:0/141289976 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdeb006f7c0 con 0x7fdeb006e170 2024-09-22T08:41:25.286 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:41:25.283+0000 7fdeadffb640 1 -- 172.21.15.31:0/141289976 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fdea0039040 con 0x7fdeb006e170 2024-09-22T08:41:25.286 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:41:25.283+0000 7fdeb7a5a640 1 -- 172.21.15.31:0/141289976 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdeb006e550 con 0x7fdeb006e170 2024-09-22T08:41:25.286 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:41:25.283+0000 7fdeadffb640 1 --2- 172.21.15.31:0/141289976 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fde9c03e670 0x7fde9c040b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:41:25.286 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:41:25.283+0000 7fdeadffb640 1 -- 172.21.15.31:0/141289976 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5938+0+0 (secure 0 0 0) 0x7fdea002ae00 con 0x7fdeb006e170 2024-09-22T08:41:25.286 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:41:25.284+0000 7fdeb4ff5640 1 --2- 172.21.15.31:0/141289976 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fde9c03e670 0x7fde9c040b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:41:25.286 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:41:25.284+0000 7fdeb4ff5640 1 --2- 172.21.15.31:0/141289976 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fde9c03e670 0x7fde9c040b30 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fdea4000f60 tx=0x7fdea4007ae0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:41:25.290 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:41:25.288+0000 7fdeadffb640 1 -- 172.21.15.31:0/141289976 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fdea003cc20 con 0x7fdeb006e170 2024-09-22T08:41:25.474 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:41:25.471+0000 7fdeb7a5a640 1 -- 172.21.15.31:0/141289976 --> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fdeb0074170 con 0x7fde9c03e670 2024-09-22T08:41:25.484 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:41:25.482+0000 7fdeadffb640 1 -- 172.21.15.31:0/141289976 <== mgr.4099 v2:172.21.15.142:6824/99931088 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665932 (secure 0 0 0) 0x7fdeb0074170 con 0x7fde9c03e670 2024-09-22T08:41:25.491 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-22T08:41:25.496 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2024-09-22T08:41:25.497 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:41:25.486+0000 7fdeb7a5a640 1 -- 172.21.15.31:0/141289976 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fde9c03e670 msgr2=0x7fde9c040b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:41:25.497 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:41:25.486+0000 7fdeb7a5a640 1 --2- 172.21.15.31:0/141289976 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fde9c03e670 0x7fde9c040b30 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fdea4000f60 tx=0x7fdea4007ae0 comp rx=0 tx=0).stop 2024-09-22T08:41:25.497 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:41:25.486+0000 7fdeb7a5a640 1 -- 172.21.15.31:0/141289976 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdeb006e170 msgr2=0x7fdeb006f280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:41:25.498 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:41:25.486+0000 7fdeb7a5a640 1 --2- 172.21.15.31:0/141289976 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdeb006e170 0x7fdeb006f280 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7fdea0009ee0 tx=0x7fdea0004a40 comp rx=0 tx=0).stop 2024-09-22T08:41:25.498 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:41:25.487+0000 7fdeb7a5a640 1 -- 172.21.15.31:0/141289976 shutdown_connections 2024-09-22T08:41:25.498 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:41:25.487+0000 7fdeb7a5a640 1 --2- 172.21.15.31:0/141289976 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fde9c03e670 0x7fde9c040b30 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:41:25.498 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:41:25.487+0000 7fdeb7a5a640 1 --2- 172.21.15.31:0/141289976 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdeb006e170 0x7fdeb006f280 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:41:25.498 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:41:25.487+0000 7fdeb7a5a640 1 -- 172.21.15.31:0/141289976 >> 172.21.15.31:0/141289976 conn(0x7fdeb009ac80 msgr2=0x7fdeb009ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:41:25.498 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:41:25.487+0000 7fdeb7a5a640 1 -- 172.21.15.31:0/141289976 shutdown_connections 2024-09-22T08:41:25.498 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:41:25.487+0000 7fdeb7a5a640 1 -- 172.21.15.31:0/141289976 wait complete. 2024-09-22T08:41:25.499 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":188,"stamp":"2024-09-22T08:41:25.240266+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605410,"num_objects":222,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":222,"num_whiteouts":0,"num_read":5177,"num_read_kb":4727,"num_write":2121,"num_write_kb":60587,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3349,"num_omap_keys":16,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4784,"ondisk_log_size":4784,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":156672,"kb_used_data":2816,"kb_used_omap":6,"kb_used_meta":153785,"kb_avail":377330688,"statfs":{"total":386547056640,"available":386386624512,"internally_reserved":0,"allocated":2883584,"data_stored":1724064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":157476630},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003895"},"pg_stats":[{"pgid":"3.3f","version":"30'4","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:04.369185+0000","last_change":"2024-09-22T08:40:04.369118+0000","last_active":"2024-09-22T08:40:04.369185+0000","last_peered":"2024-09-22T08:40:04.369185+0000","last_clean":"2024-09-22T08:40:04.369185+0000","last_became_active":"2024-09-22T08:36:23.978473+0000","last_became_peered":"2024-09-22T08:36:23.978473+0000","last_unstale":"2024-09-22T08:40:04.369185+0000","last_undegraded":"2024-09-22T08:40:04.369185+0000","last_fullsized":"2024-09-22T08:40:04.369185+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'4","last_scrub_stamp":"2024-09-22T08:40:04.369030+0000","last_deep_scrub":"30'4","last_deep_scrub_stamp":"2024-09-22T08:40:04.369030+0000","last_clean_scrub_stamp":"2024-09-22T08:40:04.369030+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:39:45.475667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":7,"num_write":20,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"30'4","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:15.337541+0000","last_change":"2024-09-22T08:40:15.337474+0000","last_active":"2024-09-22T08:40:15.337541+0000","last_peered":"2024-09-22T08:40:15.337541+0000","last_clean":"2024-09-22T08:40:15.337541+0000","last_became_active":"2024-09-22T08:36:25.981849+0000","last_became_peered":"2024-09-22T08:36:25.981849+0000","last_unstale":"2024-09-22T08:40:15.337541+0000","last_undegraded":"2024-09-22T08:40:15.337541+0000","last_fullsized":"2024-09-22T08:40:15.337541+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'4","last_scrub_stamp":"2024-09-22T08:40:15.337386+0000","last_deep_scrub":"30'4","last_deep_scrub_stamp":"2024-09-22T08:40:15.337386+0000","last_clean_scrub_stamp":"2024-09-22T08:40:15.337386+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:47:30.055490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:58.826260+0000","last_change":"2024-09-22T08:39:58.826192+0000","last_active":"2024-09-22T08:39:58.826260+0000","last_peered":"2024-09-22T08:39:58.826260+0000","last_clean":"2024-09-22T08:39:58.826260+0000","last_became_active":"2024-09-22T08:36:23.973596+0000","last_became_peered":"2024-09-22T08:36:23.973596+0000","last_unstale":"2024-09-22T08:39:58.826260+0000","last_undegraded":"2024-09-22T08:39:58.826260+0000","last_fullsized":"2024-09-22T08:39:58.826260+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:39:58.826106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:39:58.826106+0000","last_clean_scrub_stamp":"2024-09-22T08:39:58.826106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:25:37.176757+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"32'2","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:24.586403+0000","last_change":"2024-09-22T08:40:24.586403+0000","last_active":"2024-09-22T08:40:24.586403+0000","last_peered":"2024-09-22T08:40:24.586403+0000","last_clean":"2024-09-22T08:40:24.586403+0000","last_became_active":"2024-09-22T08:36:25.992150+0000","last_became_peered":"2024-09-22T08:36:25.992150+0000","last_unstale":"2024-09-22T08:40:24.586403+0000","last_undegraded":"2024-09-22T08:40:24.586403+0000","last_fullsized":"2024-09-22T08:40:24.586403+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-22T08:40:24.586282+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-22T08:40:24.586282+0000","last_clean_scrub_stamp":"2024-09-22T08:40:24.586282+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:58:38.922872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:08.374304+0000","last_change":"2024-09-22T08:40:08.374230+0000","last_active":"2024-09-22T08:40:08.374304+0000","last_peered":"2024-09-22T08:40:08.374304+0000","last_clean":"2024-09-22T08:40:08.374304+0000","last_became_active":"2024-09-22T08:36:23.982860+0000","last_became_peered":"2024-09-22T08:36:23.982860+0000","last_unstale":"2024-09-22T08:40:08.374304+0000","last_undegraded":"2024-09-22T08:40:08.374304+0000","last_fullsized":"2024-09-22T08:40:08.374304+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:08.374142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:08.374142+0000","last_clean_scrub_stamp":"2024-09-22T08:40:08.374142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:54:23.652205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:26.577931+0000","last_change":"2024-09-22T08:40:26.577931+0000","last_active":"2024-09-22T08:40:26.577931+0000","last_peered":"2024-09-22T08:40:26.577931+0000","last_clean":"2024-09-22T08:40:26.577931+0000","last_became_active":"2024-09-22T08:36:25.992356+0000","last_became_peered":"2024-09-22T08:36:25.992356+0000","last_unstale":"2024-09-22T08:40:26.577931+0000","last_undegraded":"2024-09-22T08:40:26.577931+0000","last_fullsized":"2024-09-22T08:40:26.577931+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:26.577817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:26.577817+0000","last_clean_scrub_stamp":"2024-09-22T08:40:26.577817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:42:11.037421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:58.533124+0000","last_change":"2024-09-22T08:39:58.533060+0000","last_active":"2024-09-22T08:39:58.533124+0000","last_peered":"2024-09-22T08:39:58.533124+0000","last_clean":"2024-09-22T08:39:58.533124+0000","last_became_active":"2024-09-22T08:36:23.967096+0000","last_became_peered":"2024-09-22T08:36:23.967096+0000","last_unstale":"2024-09-22T08:39:58.533124+0000","last_undegraded":"2024-09-22T08:39:58.533124+0000","last_fullsized":"2024-09-22T08:39:58.533124+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:39:58.532978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:39:58.532978+0000","last_clean_scrub_stamp":"2024-09-22T08:39:58.532978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:58:12.874966+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"32'22","reported_seq":103,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:25.549835+0000","last_change":"2024-09-22T08:40:25.549835+0000","last_active":"2024-09-22T08:40:25.549835+0000","last_peered":"2024-09-22T08:40:25.549835+0000","last_clean":"2024-09-22T08:40:25.549835+0000","last_became_active":"2024-09-22T08:36:25.989065+0000","last_became_peered":"2024-09-22T08:36:25.989065+0000","last_unstale":"2024-09-22T08:40:25.549835+0000","last_undegraded":"2024-09-22T08:40:25.549835+0000","last_fullsized":"2024-09-22T08:40:25.549835+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'22","last_scrub_stamp":"2024-09-22T08:40:25.549736+0000","last_deep_scrub":"32'22","last_deep_scrub_stamp":"2024-09-22T08:40:25.549736+0000","last_clean_scrub_stamp":"2024-09-22T08:40:25.549736+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:20:55.359657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":82,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:06.332632+0000","last_change":"2024-09-22T08:40:06.332632+0000","last_active":"2024-09-22T08:40:06.332632+0000","last_peered":"2024-09-22T08:40:06.332632+0000","last_clean":"2024-09-22T08:40:06.332632+0000","last_became_active":"2024-09-22T08:36:23.978766+0000","last_became_peered":"2024-09-22T08:36:23.978766+0000","last_unstale":"2024-09-22T08:40:06.332632+0000","last_undegraded":"2024-09-22T08:40:06.332632+0000","last_fullsized":"2024-09-22T08:40:06.332632+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:06.332545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:06.332545+0000","last_clean_scrub_stamp":"2024-09-22T08:40:06.332545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:25:05.583350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"32'8","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:17.301333+0000","last_change":"2024-09-22T08:40:17.301230+0000","last_active":"2024-09-22T08:40:17.301333+0000","last_peered":"2024-09-22T08:40:17.301333+0000","last_clean":"2024-09-22T08:40:17.301333+0000","last_became_active":"2024-09-22T08:36:25.978937+0000","last_became_peered":"2024-09-22T08:36:25.978937+0000","last_unstale":"2024-09-22T08:40:17.301333+0000","last_undegraded":"2024-09-22T08:40:17.301333+0000","last_fullsized":"2024-09-22T08:40:17.301333+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-22T08:40:17.301118+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-22T08:40:17.301118+0000","last_clean_scrub_stamp":"2024-09-22T08:40:17.301118+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:02:08.767907+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":23,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"32'4","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:01.435530+0000","last_change":"2024-09-22T08:40:01.435460+0000","last_active":"2024-09-22T08:40:01.435530+0000","last_peered":"2024-09-22T08:40:01.435530+0000","last_clean":"2024-09-22T08:40:01.435530+0000","last_became_active":"2024-09-22T08:36:23.967168+0000","last_became_peered":"2024-09-22T08:36:23.967168+0000","last_unstale":"2024-09-22T08:40:01.435530+0000","last_undegraded":"2024-09-22T08:40:01.435530+0000","last_fullsized":"2024-09-22T08:40:01.435530+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-22T08:40:01.435370+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-22T08:40:01.435370+0000","last_clean_scrub_stamp":"2024-09-22T08:40:01.435370+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:31:33.320075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":10,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"32'6","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:27.601737+0000","last_change":"2024-09-22T08:40:27.601635+0000","last_active":"2024-09-22T08:40:27.601737+0000","last_peered":"2024-09-22T08:40:27.601737+0000","last_clean":"2024-09-22T08:40:27.601737+0000","last_became_active":"2024-09-22T08:36:25.990727+0000","last_became_peered":"2024-09-22T08:36:25.990727+0000","last_unstale":"2024-09-22T08:40:27.601737+0000","last_undegraded":"2024-09-22T08:40:27.601737+0000","last_fullsized":"2024-09-22T08:40:27.601737+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-22T08:40:27.601539+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-22T08:40:27.601539+0000","last_clean_scrub_stamp":"2024-09-22T08:40:27.601539+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:14:55.668548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:04.247350+0000","last_change":"2024-09-22T08:40:04.247350+0000","last_active":"2024-09-22T08:40:04.247350+0000","last_peered":"2024-09-22T08:40:04.247350+0000","last_clean":"2024-09-22T08:40:04.247350+0000","last_became_active":"2024-09-22T08:36:23.980446+0000","last_became_peered":"2024-09-22T08:36:23.980446+0000","last_unstale":"2024-09-22T08:40:04.247350+0000","last_undegraded":"2024-09-22T08:40:04.247350+0000","last_fullsized":"2024-09-22T08:40:04.247350+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:04.247231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:04.247231+0000","last_clean_scrub_stamp":"2024-09-22T08:40:04.247231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:03:00.194431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"32'8","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:06.366503+0000","last_change":"2024-09-22T08:40:06.366446+0000","last_active":"2024-09-22T08:40:06.366503+0000","last_peered":"2024-09-22T08:40:06.366503+0000","last_clean":"2024-09-22T08:40:06.366503+0000","last_became_active":"2024-09-22T08:36:25.982217+0000","last_became_peered":"2024-09-22T08:36:25.982217+0000","last_unstale":"2024-09-22T08:40:06.366503+0000","last_undegraded":"2024-09-22T08:40:06.366503+0000","last_fullsized":"2024-09-22T08:40:06.366503+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-22T08:40:06.366369+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-22T08:40:06.366369+0000","last_clean_scrub_stamp":"2024-09-22T08:40:06.366369+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:25:30.349302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":27,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:57.845968+0000","last_change":"2024-09-22T08:39:57.845968+0000","last_active":"2024-09-22T08:39:57.845968+0000","last_peered":"2024-09-22T08:39:57.845968+0000","last_clean":"2024-09-22T08:39:57.845968+0000","last_became_active":"2024-09-22T08:36:23.977715+0000","last_became_peered":"2024-09-22T08:36:23.977715+0000","last_unstale":"2024-09-22T08:39:57.845968+0000","last_undegraded":"2024-09-22T08:39:57.845968+0000","last_fullsized":"2024-09-22T08:39:57.845968+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-22T08:39:57.845879+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-22T08:39:57.845879+0000","last_clean_scrub_stamp":"2024-09-22T08:39:57.845879+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:42:05.377364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"32'8","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:09.396348+0000","last_change":"2024-09-22T08:40:09.396278+0000","last_active":"2024-09-22T08:40:09.396348+0000","last_peered":"2024-09-22T08:40:09.396348+0000","last_clean":"2024-09-22T08:40:09.396348+0000","last_became_active":"2024-09-22T08:36:25.974930+0000","last_became_peered":"2024-09-22T08:36:25.974930+0000","last_unstale":"2024-09-22T08:40:09.396348+0000","last_undegraded":"2024-09-22T08:40:09.396348+0000","last_fullsized":"2024-09-22T08:40:09.396348+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-22T08:40:09.396197+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-22T08:40:09.396197+0000","last_clean_scrub_stamp":"2024-09-22T08:40:09.396197+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:50:08.671881+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"32'4","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:23.597124+0000","last_change":"2024-09-22T08:40:23.597042+0000","last_active":"2024-09-22T08:40:23.597124+0000","last_peered":"2024-09-22T08:40:23.597124+0000","last_clean":"2024-09-22T08:40:23.597124+0000","last_became_active":"2024-09-22T08:36:25.991870+0000","last_became_peered":"2024-09-22T08:36:25.991870+0000","last_unstale":"2024-09-22T08:40:23.597124+0000","last_undegraded":"2024-09-22T08:40:23.597124+0000","last_fullsized":"2024-09-22T08:40:23.597124+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-22T08:40:23.596954+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-22T08:40:23.596954+0000","last_clean_scrub_stamp":"2024-09-22T08:40:23.596954+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:00:06.490632+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:57.283763+0000","last_change":"2024-09-22T08:39:57.283661+0000","last_active":"2024-09-22T08:39:57.283763+0000","last_peered":"2024-09-22T08:39:57.283763+0000","last_clean":"2024-09-22T08:39:57.283763+0000","last_became_active":"2024-09-22T08:36:23.977556+0000","last_became_peered":"2024-09-22T08:36:23.977556+0000","last_unstale":"2024-09-22T08:39:57.283763+0000","last_undegraded":"2024-09-22T08:39:57.283763+0000","last_fullsized":"2024-09-22T08:39:57.283763+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:39:57.283537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:39:57.283537+0000","last_clean_scrub_stamp":"2024-09-22T08:39:57.283537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:31:33.140772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"32'14","reported_seq":81,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:11.433244+0000","last_change":"2024-09-22T08:40:11.433190+0000","last_active":"2024-09-22T08:40:11.433244+0000","last_peered":"2024-09-22T08:40:11.433244+0000","last_clean":"2024-09-22T08:40:11.433244+0000","last_became_active":"2024-09-22T08:36:25.976389+0000","last_became_peered":"2024-09-22T08:36:25.976389+0000","last_unstale":"2024-09-22T08:40:11.433244+0000","last_undegraded":"2024-09-22T08:40:11.433244+0000","last_fullsized":"2024-09-22T08:40:11.433244+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'14","last_scrub_stamp":"2024-09-22T08:40:11.433107+0000","last_deep_scrub":"32'14","last_deep_scrub_stamp":"2024-09-22T08:40:11.433107+0000","last_clean_scrub_stamp":"2024-09-22T08:40:11.433107+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:20:10.105300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":49,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:57.549779+0000","last_change":"2024-09-22T08:39:57.549716+0000","last_active":"2024-09-22T08:39:57.549779+0000","last_peered":"2024-09-22T08:39:57.549779+0000","last_clean":"2024-09-22T08:39:57.549779+0000","last_became_active":"2024-09-22T08:36:23.974275+0000","last_became_peered":"2024-09-22T08:36:23.974275+0000","last_unstale":"2024-09-22T08:39:57.549779+0000","last_undegraded":"2024-09-22T08:39:57.549779+0000","last_fullsized":"2024-09-22T08:39:57.549779+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-22T08:39:57.549604+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-22T08:39:57.549604+0000","last_clean_scrub_stamp":"2024-09-22T08:39:57.549604+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:02:09.510635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"32'14","reported_seq":75,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:12.409927+0000","last_change":"2024-09-22T08:40:12.409862+0000","last_active":"2024-09-22T08:40:12.409927+0000","last_peered":"2024-09-22T08:40:12.409927+0000","last_clean":"2024-09-22T08:40:12.409927+0000","last_became_active":"2024-09-22T08:36:25.977015+0000","last_became_peered":"2024-09-22T08:36:25.977015+0000","last_unstale":"2024-09-22T08:40:12.409927+0000","last_undegraded":"2024-09-22T08:40:12.409927+0000","last_fullsized":"2024-09-22T08:40:12.409927+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'14","last_scrub_stamp":"2024-09-22T08:40:12.409763+0000","last_deep_scrub":"32'14","last_deep_scrub_stamp":"2024-09-22T08:40:12.409763+0000","last_clean_scrub_stamp":"2024-09-22T08:40:12.409763+0000","objects_scrubbed":2,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:14:30.930010+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":43,"num_read_kb":39,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"32'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:55.220225+0000","last_change":"2024-09-22T08:39:55.220138+0000","last_active":"2024-09-22T08:39:55.220225+0000","last_peered":"2024-09-22T08:39:55.220225+0000","last_clean":"2024-09-22T08:39:55.220225+0000","last_became_active":"2024-09-22T08:36:23.984411+0000","last_became_peered":"2024-09-22T08:36:23.984411+0000","last_unstale":"2024-09-22T08:39:55.220225+0000","last_undegraded":"2024-09-22T08:39:55.220225+0000","last_fullsized":"2024-09-22T08:39:55.220225+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-22T08:39:55.220017+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-22T08:39:55.220017+0000","last_clean_scrub_stamp":"2024-09-22T08:39:55.220017+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:52:34.074155+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"32'2","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:11.833478+0000","last_change":"2024-09-22T08:40:11.833416+0000","last_active":"2024-09-22T08:40:11.833478+0000","last_peered":"2024-09-22T08:40:11.833478+0000","last_clean":"2024-09-22T08:40:11.833478+0000","last_became_active":"2024-09-22T08:36:25.984037+0000","last_became_peered":"2024-09-22T08:36:25.984037+0000","last_unstale":"2024-09-22T08:40:11.833478+0000","last_undegraded":"2024-09-22T08:40:11.833478+0000","last_fullsized":"2024-09-22T08:40:11.833478+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-22T08:40:11.833329+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-22T08:40:11.833329+0000","last_clean_scrub_stamp":"2024-09-22T08:40:11.833329+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:13:05.009738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:56.237321+0000","last_change":"2024-09-22T08:39:56.237269+0000","last_active":"2024-09-22T08:39:56.237321+0000","last_peered":"2024-09-22T08:39:56.237321+0000","last_clean":"2024-09-22T08:39:56.237321+0000","last_became_active":"2024-09-22T08:36:23.969183+0000","last_became_peered":"2024-09-22T08:36:23.969183+0000","last_unstale":"2024-09-22T08:39:56.237321+0000","last_undegraded":"2024-09-22T08:39:56.237321+0000","last_fullsized":"2024-09-22T08:39:56.237321+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-22T08:39:56.237185+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-22T08:39:56.237185+0000","last_clean_scrub_stamp":"2024-09-22T08:39:56.237185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:26:53.537080+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"32'18","reported_seq":76,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:08.416277+0000","last_change":"2024-09-22T08:40:08.416216+0000","last_active":"2024-09-22T08:40:08.416277+0000","last_peered":"2024-09-22T08:40:08.416277+0000","last_clean":"2024-09-22T08:40:08.416277+0000","last_became_active":"2024-09-22T08:36:25.985797+0000","last_became_peered":"2024-09-22T08:36:25.985797+0000","last_unstale":"2024-09-22T08:40:08.416277+0000","last_undegraded":"2024-09-22T08:40:08.416277+0000","last_fullsized":"2024-09-22T08:40:08.416277+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'18","last_scrub_stamp":"2024-09-22T08:40:08.416117+0000","last_deep_scrub":"32'18","last_deep_scrub_stamp":"2024-09-22T08:40:08.416117+0000","last_clean_scrub_stamp":"2024-09-22T08:40:08.416117+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:55:55.096190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":61,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"32'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:56.863723+0000","last_change":"2024-09-22T08:39:56.863666+0000","last_active":"2024-09-22T08:39:56.863723+0000","last_peered":"2024-09-22T08:39:56.863723+0000","last_clean":"2024-09-22T08:39:56.863723+0000","last_became_active":"2024-09-22T08:36:23.974359+0000","last_became_peered":"2024-09-22T08:36:23.974359+0000","last_unstale":"2024-09-22T08:39:56.863723+0000","last_undegraded":"2024-09-22T08:39:56.863723+0000","last_fullsized":"2024-09-22T08:39:56.863723+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-22T08:39:56.863584+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-22T08:39:56.863584+0000","last_clean_scrub_stamp":"2024-09-22T08:39:56.863584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:41:23.122061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"32'16","reported_seq":71,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:13.382551+0000","last_change":"2024-09-22T08:40:13.382482+0000","last_active":"2024-09-22T08:40:13.382551+0000","last_peered":"2024-09-22T08:40:13.382551+0000","last_clean":"2024-09-22T08:40:13.382551+0000","last_became_active":"2024-09-22T08:36:25.977320+0000","last_became_peered":"2024-09-22T08:36:25.977320+0000","last_unstale":"2024-09-22T08:40:13.382551+0000","last_undegraded":"2024-09-22T08:40:13.382551+0000","last_fullsized":"2024-09-22T08:40:13.382551+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'16","last_scrub_stamp":"2024-09-22T08:40:13.382400+0000","last_deep_scrub":"32'16","last_deep_scrub_stamp":"2024-09-22T08:40:13.382400+0000","last_clean_scrub_stamp":"2024-09-22T08:40:13.382400+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:13:53.645578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":49,"num_write":21,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:07.381366+0000","last_change":"2024-09-22T08:40:07.381293+0000","last_active":"2024-09-22T08:40:07.381366+0000","last_peered":"2024-09-22T08:40:07.381366+0000","last_clean":"2024-09-22T08:40:07.381366+0000","last_became_active":"2024-09-22T08:36:23.980189+0000","last_became_peered":"2024-09-22T08:36:23.980189+0000","last_unstale":"2024-09-22T08:40:07.381366+0000","last_undegraded":"2024-09-22T08:40:07.381366+0000","last_fullsized":"2024-09-22T08:40:07.381366+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-22T08:40:07.381185+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-22T08:40:07.381185+0000","last_clean_scrub_stamp":"2024-09-22T08:40:07.381185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:45:20.018380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"32'36","reported_seq":110,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:45.351023+0000","last_change":"2024-09-22T08:40:45.350947+0000","last_active":"2024-09-22T08:40:45.351023+0000","last_peered":"2024-09-22T08:40:45.351023+0000","last_clean":"2024-09-22T08:40:45.351023+0000","last_became_active":"2024-09-22T08:36:34.015696+0000","last_became_peered":"2024-09-22T08:36:34.015696+0000","last_unstale":"2024-09-22T08:40:45.351023+0000","last_undegraded":"2024-09-22T08:40:45.351023+0000","last_fullsized":"2024-09-22T08:40:45.351023+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'36","last_scrub_stamp":"2024-09-22T08:40:45.350853+0000","last_deep_scrub":"32'36","last_deep_scrub_stamp":"2024-09-22T08:40:45.350853+0000","last_clean_scrub_stamp":"2024-09-22T08:40:45.350853+0000","objects_scrubbed":1,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:30:23.115805+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":173,"num_read_kb":173,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"32'6","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:13.437893+0000","last_change":"2024-09-22T08:40:13.437831+0000","last_active":"2024-09-22T08:40:13.437893+0000","last_peered":"2024-09-22T08:40:13.437893+0000","last_clean":"2024-09-22T08:40:13.437893+0000","last_became_active":"2024-09-22T08:36:25.987811+0000","last_became_peered":"2024-09-22T08:36:25.987811+0000","last_unstale":"2024-09-22T08:40:13.437893+0000","last_undegraded":"2024-09-22T08:40:13.437893+0000","last_fullsized":"2024-09-22T08:40:13.437893+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-22T08:40:13.437749+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-22T08:40:13.437749+0000","last_clean_scrub_stamp":"2024-09-22T08:40:13.437749+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:42:52.209301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:52.378578+0000","last_change":"2024-09-22T08:39:52.378512+0000","last_active":"2024-09-22T08:39:52.378578+0000","last_peered":"2024-09-22T08:39:52.378578+0000","last_clean":"2024-09-22T08:39:52.378578+0000","last_became_active":"2024-09-22T08:36:23.982423+0000","last_became_peered":"2024-09-22T08:36:23.982423+0000","last_unstale":"2024-09-22T08:39:52.378578+0000","last_undegraded":"2024-09-22T08:39:52.378578+0000","last_fullsized":"2024-09-22T08:39:52.378578+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:39:52.378424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:39:52.378424+0000","last_clean_scrub_stamp":"2024-09-22T08:39:52.378424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:48:16.834018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:34.483336+0000","last_change":"2024-09-22T08:40:34.483277+0000","last_active":"2024-09-22T08:40:34.483336+0000","last_peered":"2024-09-22T08:40:34.483336+0000","last_clean":"2024-09-22T08:40:34.483336+0000","last_became_active":"2024-09-22T08:36:27.988057+0000","last_became_peered":"2024-09-22T08:36:27.988057+0000","last_unstale":"2024-09-22T08:40:34.483336+0000","last_undegraded":"2024-09-22T08:40:34.483336+0000","last_fullsized":"2024-09-22T08:40:34.483336+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:34.483200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:34.483200+0000","last_clean_scrub_stamp":"2024-09-22T08:40:34.483200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:17:21.473508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"32'37","reported_seq":93,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:45.447006+0000","last_change":"2024-09-22T08:40:45.446949+0000","last_active":"2024-09-22T08:40:45.447006+0000","last_peered":"2024-09-22T08:40:45.447006+0000","last_clean":"2024-09-22T08:40:45.447006+0000","last_became_active":"2024-09-22T08:36:29.994881+0000","last_became_peered":"2024-09-22T08:36:29.994881+0000","last_unstale":"2024-09-22T08:40:45.447006+0000","last_undegraded":"2024-09-22T08:40:45.447006+0000","last_fullsized":"2024-09-22T08:40:45.447006+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'37","last_scrub_stamp":"2024-09-22T08:40:45.446839+0000","last_deep_scrub":"32'37","last_deep_scrub_stamp":"2024-09-22T08:40:45.446839+0000","last_clean_scrub_stamp":"2024-09-22T08:40:45.446839+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:22:51.304961+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:37.370020+0000","last_change":"2024-09-22T08:40:37.369943+0000","last_active":"2024-09-22T08:40:37.370020+0000","last_peered":"2024-09-22T08:40:37.370020+0000","last_clean":"2024-09-22T08:40:37.370020+0000","last_became_active":"2024-09-22T08:36:32.013249+0000","last_became_peered":"2024-09-22T08:36:32.013249+0000","last_unstale":"2024-09-22T08:40:37.370020+0000","last_undegraded":"2024-09-22T08:40:37.370020+0000","last_fullsized":"2024-09-22T08:40:37.370020+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:37.369829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:37.369829+0000","last_clean_scrub_stamp":"2024-09-22T08:40:37.369829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:03:42.407066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"32'7","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:46.390760+0000","last_change":"2024-09-22T08:40:46.390688+0000","last_active":"2024-09-22T08:40:46.390760+0000","last_peered":"2024-09-22T08:40:46.390760+0000","last_clean":"2024-09-22T08:40:46.390760+0000","last_became_active":"2024-09-22T08:36:34.015170+0000","last_became_peered":"2024-09-22T08:36:34.015170+0000","last_unstale":"2024-09-22T08:40:46.390760+0000","last_undegraded":"2024-09-22T08:40:46.390760+0000","last_fullsized":"2024-09-22T08:40:46.390760+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'7","last_scrub_stamp":"2024-09-22T08:40:46.390603+0000","last_deep_scrub":"32'7","last_deep_scrub_stamp":"2024-09-22T08:40:46.390603+0000","last_clean_scrub_stamp":"2024-09-22T08:40:46.390603+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:14:26.449097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:14.450304+0000","last_change":"2024-09-22T08:40:14.450214+0000","last_active":"2024-09-22T08:40:14.450304+0000","last_peered":"2024-09-22T08:40:14.450304+0000","last_clean":"2024-09-22T08:40:14.450304+0000","last_became_active":"2024-09-22T08:36:25.989583+0000","last_became_peered":"2024-09-22T08:36:25.989583+0000","last_unstale":"2024-09-22T08:40:14.450304+0000","last_undegraded":"2024-09-22T08:40:14.450304+0000","last_fullsized":"2024-09-22T08:40:14.450304+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-22T08:40:14.450079+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-22T08:40:14.450079+0000","last_clean_scrub_stamp":"2024-09-22T08:40:14.450079+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:50:05.715618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:50.670104+0000","last_change":"2024-09-22T08:39:50.670046+0000","last_active":"2024-09-22T08:39:50.670104+0000","last_peered":"2024-09-22T08:39:50.670104+0000","last_clean":"2024-09-22T08:39:50.670104+0000","last_became_active":"2024-09-22T08:36:23.973716+0000","last_became_peered":"2024-09-22T08:36:23.973716+0000","last_unstale":"2024-09-22T08:39:50.670104+0000","last_undegraded":"2024-09-22T08:39:50.670104+0000","last_fullsized":"2024-09-22T08:39:50.670104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-22T08:39:50.669969+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-22T08:39:50.669969+0000","last_clean_scrub_stamp":"2024-09-22T08:39:50.669969+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:51:53.477798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:21.357079+0000","last_change":"2024-09-22T08:40:21.357079+0000","last_active":"2024-09-22T08:40:21.357079+0000","last_peered":"2024-09-22T08:40:21.357079+0000","last_clean":"2024-09-22T08:40:21.357079+0000","last_became_active":"2024-09-22T08:37:04.229132+0000","last_became_peered":"2024-09-22T08:37:04.229132+0000","last_unstale":"2024-09-22T08:40:21.357079+0000","last_undegraded":"2024-09-22T08:40:21.357079+0000","last_fullsized":"2024-09-22T08:40:21.357079+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:21.356998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:21.356998+0000","last_clean_scrub_stamp":"2024-09-22T08:40:21.356998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:11:54.368083+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"32'9","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:31.392962+0000","last_change":"2024-09-22T08:40:31.392908+0000","last_active":"2024-09-22T08:40:31.392962+0000","last_peered":"2024-09-22T08:40:31.392962+0000","last_clean":"2024-09-22T08:40:31.392962+0000","last_became_active":"2024-09-22T08:36:29.990998+0000","last_became_peered":"2024-09-22T08:36:29.990998+0000","last_unstale":"2024-09-22T08:40:31.392962+0000","last_undegraded":"2024-09-22T08:40:31.392962+0000","last_fullsized":"2024-09-22T08:40:31.392962+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'9","last_scrub_stamp":"2024-09-22T08:40:31.392802+0000","last_deep_scrub":"32'9","last_deep_scrub_stamp":"2024-09-22T08:40:31.392802+0000","last_clean_scrub_stamp":"2024-09-22T08:40:31.392802+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:03:13.570471+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:36.364265+0000","last_change":"2024-09-22T08:40:36.364189+0000","last_active":"2024-09-22T08:40:36.364265+0000","last_peered":"2024-09-22T08:40:36.364265+0000","last_clean":"2024-09-22T08:40:36.364265+0000","last_became_active":"2024-09-22T08:36:32.006161+0000","last_became_peered":"2024-09-22T08:36:32.006161+0000","last_unstale":"2024-09-22T08:40:36.364265+0000","last_undegraded":"2024-09-22T08:40:36.364265+0000","last_fullsized":"2024-09-22T08:40:36.364265+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:36.364094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:36.364094+0000","last_clean_scrub_stamp":"2024-09-22T08:40:36.364094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:26:36.338748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"30'2","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:43.810402+0000","last_change":"2024-09-22T08:40:43.810402+0000","last_active":"2024-09-22T08:40:43.810402+0000","last_peered":"2024-09-22T08:40:43.810402+0000","last_clean":"2024-09-22T08:40:43.810402+0000","last_became_active":"2024-09-22T08:36:34.016749+0000","last_became_peered":"2024-09-22T08:36:34.016749+0000","last_unstale":"2024-09-22T08:40:43.810402+0000","last_undegraded":"2024-09-22T08:40:43.810402+0000","last_fullsized":"2024-09-22T08:40:43.810402+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-09-22T08:40:43.810306+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-09-22T08:40:43.810306+0000","last_clean_scrub_stamp":"2024-09-22T08:40:43.810306+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:03:39.113833+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"32'8","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:16.461474+0000","last_change":"2024-09-22T08:40:16.461402+0000","last_active":"2024-09-22T08:40:16.461474+0000","last_peered":"2024-09-22T08:40:16.461474+0000","last_clean":"2024-09-22T08:40:16.461474+0000","last_became_active":"2024-09-22T08:36:25.987860+0000","last_became_peered":"2024-09-22T08:36:25.987860+0000","last_unstale":"2024-09-22T08:40:16.461474+0000","last_undegraded":"2024-09-22T08:40:16.461474+0000","last_fullsized":"2024-09-22T08:40:16.461474+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-22T08:40:16.461252+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-22T08:40:16.461252+0000","last_clean_scrub_stamp":"2024-09-22T08:40:16.461252+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:08:26.205157+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:54.365718+0000","last_change":"2024-09-22T08:39:54.365627+0000","last_active":"2024-09-22T08:39:54.365718+0000","last_peered":"2024-09-22T08:39:54.365718+0000","last_clean":"2024-09-22T08:39:54.365718+0000","last_became_active":"2024-09-22T08:36:23.979201+0000","last_became_peered":"2024-09-22T08:36:23.979201+0000","last_unstale":"2024-09-22T08:39:54.365718+0000","last_undegraded":"2024-09-22T08:39:54.365718+0000","last_fullsized":"2024-09-22T08:39:54.365718+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:39:54.365537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:39:54.365537+0000","last_clean_scrub_stamp":"2024-09-22T08:39:54.365537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:12:06.963553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:18.892864+0000","last_change":"2024-09-22T08:40:18.892804+0000","last_active":"2024-09-22T08:40:18.892864+0000","last_peered":"2024-09-22T08:40:18.892864+0000","last_clean":"2024-09-22T08:40:18.892864+0000","last_became_active":"2024-09-22T08:36:27.987410+0000","last_became_peered":"2024-09-22T08:36:27.987410+0000","last_unstale":"2024-09-22T08:40:18.892864+0000","last_undegraded":"2024-09-22T08:40:18.892864+0000","last_fullsized":"2024-09-22T08:40:18.892864+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:18.892720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:18.892720+0000","last_clean_scrub_stamp":"2024-09-22T08:40:18.892720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:35:19.353672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"32'15","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:21.443116+0000","last_change":"2024-09-22T08:40:21.443057+0000","last_active":"2024-09-22T08:40:21.443116+0000","last_peered":"2024-09-22T08:40:21.443116+0000","last_clean":"2024-09-22T08:40:21.443116+0000","last_became_active":"2024-09-22T08:36:29.999306+0000","last_became_peered":"2024-09-22T08:36:29.999306+0000","last_unstale":"2024-09-22T08:40:21.443116+0000","last_undegraded":"2024-09-22T08:40:21.443116+0000","last_fullsized":"2024-09-22T08:40:21.443116+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'15","last_scrub_stamp":"2024-09-22T08:40:21.442962+0000","last_deep_scrub":"32'15","last_deep_scrub_stamp":"2024-09-22T08:40:21.442962+0000","last_clean_scrub_stamp":"2024-09-22T08:40:21.442962+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:58:30.895413+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"32'286","reported_seq":428,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:52.368658+0000","last_change":"2024-09-22T08:40:52.368599+0000","last_active":"2024-09-22T08:40:52.368658+0000","last_peered":"2024-09-22T08:40:52.368658+0000","last_clean":"2024-09-22T08:40:52.368658+0000","last_became_active":"2024-09-22T08:36:32.013869+0000","last_became_peered":"2024-09-22T08:36:32.013869+0000","last_unstale":"2024-09-22T08:40:52.368658+0000","last_undegraded":"2024-09-22T08:40:52.368658+0000","last_fullsized":"2024-09-22T08:40:52.368658+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'286","last_scrub_stamp":"2024-09-22T08:40:52.368514+0000","last_deep_scrub":"32'286","last_deep_scrub_stamp":"2024-09-22T08:40:52.368514+0000","last_clean_scrub_stamp":"2024-09-22T08:40:52.368514+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:37:12.629082+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:34.533590+0000","last_change":"2024-09-22T08:40:34.533590+0000","last_active":"2024-09-22T08:40:34.533590+0000","last_peered":"2024-09-22T08:40:34.533590+0000","last_clean":"2024-09-22T08:40:34.533590+0000","last_became_active":"2024-09-22T08:36:34.015999+0000","last_became_peered":"2024-09-22T08:36:34.015999+0000","last_unstale":"2024-09-22T08:40:34.533590+0000","last_undegraded":"2024-09-22T08:40:34.533590+0000","last_fullsized":"2024-09-22T08:40:34.533590+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:34.533498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:34.533498+0000","last_clean_scrub_stamp":"2024-09-22T08:40:34.533498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:54:14.287340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"30'4","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:02.829609+0000","last_change":"2024-09-22T08:40:02.829539+0000","last_active":"2024-09-22T08:40:02.829609+0000","last_peered":"2024-09-22T08:40:02.829609+0000","last_clean":"2024-09-22T08:40:02.829609+0000","last_became_active":"2024-09-22T08:36:25.979320+0000","last_became_peered":"2024-09-22T08:36:25.979320+0000","last_unstale":"2024-09-22T08:40:02.829609+0000","last_undegraded":"2024-09-22T08:40:02.829609+0000","last_fullsized":"2024-09-22T08:40:02.829609+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'4","last_scrub_stamp":"2024-09-22T08:40:02.829450+0000","last_deep_scrub":"30'4","last_deep_scrub_stamp":"2024-09-22T08:40:02.829450+0000","last_clean_scrub_stamp":"2024-09-22T08:40:02.829450+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:25:40.999415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:45.068268+0000","last_change":"2024-09-22T08:39:45.068211+0000","last_active":"2024-09-22T08:39:45.068268+0000","last_peered":"2024-09-22T08:39:45.068268+0000","last_clean":"2024-09-22T08:39:45.068268+0000","last_became_active":"2024-09-22T08:36:23.975428+0000","last_became_peered":"2024-09-22T08:36:23.975428+0000","last_unstale":"2024-09-22T08:39:45.068268+0000","last_undegraded":"2024-09-22T08:39:45.068268+0000","last_fullsized":"2024-09-22T08:39:45.068268+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:39:45.068115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:39:45.068115+0000","last_clean_scrub_stamp":"2024-09-22T08:39:45.068115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:04:18.711452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:36.500650+0000","last_change":"2024-09-22T08:40:36.500599+0000","last_active":"2024-09-22T08:40:36.500650+0000","last_peered":"2024-09-22T08:40:36.500650+0000","last_clean":"2024-09-22T08:40:36.500650+0000","last_became_active":"2024-09-22T08:36:27.984658+0000","last_became_peered":"2024-09-22T08:36:27.984658+0000","last_unstale":"2024-09-22T08:40:36.500650+0000","last_undegraded":"2024-09-22T08:40:36.500650+0000","last_fullsized":"2024-09-22T08:40:36.500650+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:36.500515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:36.500515+0000","last_clean_scrub_stamp":"2024-09-22T08:40:36.500515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:48:11.472744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"32'37","reported_seq":93,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:22.432150+0000","last_change":"2024-09-22T08:40:22.432096+0000","last_active":"2024-09-22T08:40:22.432150+0000","last_peered":"2024-09-22T08:40:22.432150+0000","last_clean":"2024-09-22T08:40:22.432150+0000","last_became_active":"2024-09-22T08:36:30.000641+0000","last_became_peered":"2024-09-22T08:36:30.000641+0000","last_unstale":"2024-09-22T08:40:22.432150+0000","last_undegraded":"2024-09-22T08:40:22.432150+0000","last_fullsized":"2024-09-22T08:40:22.432150+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'37","last_scrub_stamp":"2024-09-22T08:40:22.432008+0000","last_deep_scrub":"32'37","last_deep_scrub_stamp":"2024-09-22T08:40:22.432008+0000","last_clean_scrub_stamp":"2024-09-22T08:40:22.432008+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:59:09.948186+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"32'286","reported_seq":437,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:33.836089+0000","last_change":"2024-09-22T08:40:33.836032+0000","last_active":"2024-09-22T08:40:33.836089+0000","last_peered":"2024-09-22T08:40:33.836089+0000","last_clean":"2024-09-22T08:40:33.836089+0000","last_became_active":"2024-09-22T08:36:32.005012+0000","last_became_peered":"2024-09-22T08:36:32.005012+0000","last_unstale":"2024-09-22T08:40:33.836089+0000","last_undegraded":"2024-09-22T08:40:33.836089+0000","last_fullsized":"2024-09-22T08:40:33.836089+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'286","last_scrub_stamp":"2024-09-22T08:40:33.835941+0000","last_deep_scrub":"32'286","last_deep_scrub_stamp":"2024-09-22T08:40:33.835941+0000","last_clean_scrub_stamp":"2024-09-22T08:40:33.835941+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:45:21.756190+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"32'4","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:12.437116+0000","last_change":"2024-09-22T08:40:12.437028+0000","last_active":"2024-09-22T08:40:12.437116+0000","last_peered":"2024-09-22T08:40:12.437116+0000","last_clean":"2024-09-22T08:40:12.437116+0000","last_became_active":"2024-09-22T08:36:25.989940+0000","last_became_peered":"2024-09-22T08:36:25.989940+0000","last_unstale":"2024-09-22T08:40:12.437116+0000","last_undegraded":"2024-09-22T08:40:12.437116+0000","last_fullsized":"2024-09-22T08:40:12.437116+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-22T08:40:12.436939+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-22T08:40:12.436939+0000","last_clean_scrub_stamp":"2024-09-22T08:40:12.436939+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:59:47.804661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:46.601262+0000","last_change":"2024-09-22T08:39:46.601168+0000","last_active":"2024-09-22T08:39:46.601262+0000","last_peered":"2024-09-22T08:39:46.601262+0000","last_clean":"2024-09-22T08:39:46.601262+0000","last_became_active":"2024-09-22T08:36:23.970093+0000","last_became_peered":"2024-09-22T08:36:23.970093+0000","last_unstale":"2024-09-22T08:39:46.601262+0000","last_undegraded":"2024-09-22T08:39:46.601262+0000","last_fullsized":"2024-09-22T08:39:46.601262+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:39:46.601074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:39:46.601074+0000","last_clean_scrub_stamp":"2024-09-22T08:39:46.601074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:08:12.326140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:18.296614+0000","last_change":"2024-09-22T08:40:18.296552+0000","last_active":"2024-09-22T08:40:18.296614+0000","last_peered":"2024-09-22T08:40:18.296614+0000","last_clean":"2024-09-22T08:40:18.296614+0000","last_became_active":"2024-09-22T08:36:27.986734+0000","last_became_peered":"2024-09-22T08:36:27.986734+0000","last_unstale":"2024-09-22T08:40:18.296614+0000","last_undegraded":"2024-09-22T08:40:18.296614+0000","last_fullsized":"2024-09-22T08:40:18.296614+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:18.296463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:18.296463+0000","last_clean_scrub_stamp":"2024-09-22T08:40:18.296463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:16:18.206096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"32'52","reported_seq":113,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:17.437652+0000","last_change":"2024-09-22T08:40:17.437571+0000","last_active":"2024-09-22T08:40:17.437652+0000","last_peered":"2024-09-22T08:40:17.437652+0000","last_clean":"2024-09-22T08:40:17.437652+0000","last_became_active":"2024-09-22T08:36:29.990809+0000","last_became_peered":"2024-09-22T08:36:29.990809+0000","last_unstale":"2024-09-22T08:40:17.437652+0000","last_undegraded":"2024-09-22T08:40:17.437652+0000","last_fullsized":"2024-09-22T08:40:17.437652+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'52","last_scrub_stamp":"2024-09-22T08:40:17.437457+0000","last_deep_scrub":"32'52","last_deep_scrub_stamp":"2024-09-22T08:40:17.437457+0000","last_clean_scrub_stamp":"2024-09-22T08:40:17.437457+0000","objects_scrubbed":9,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:50:34.481525+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:34.812829+0000","last_change":"2024-09-22T08:40:34.812776+0000","last_active":"2024-09-22T08:40:34.812829+0000","last_peered":"2024-09-22T08:40:34.812829+0000","last_clean":"2024-09-22T08:40:34.812829+0000","last_became_active":"2024-09-22T08:36:32.003726+0000","last_became_peered":"2024-09-22T08:36:32.003726+0000","last_unstale":"2024-09-22T08:40:34.812829+0000","last_undegraded":"2024-09-22T08:40:34.812829+0000","last_fullsized":"2024-09-22T08:40:34.812829+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:34.812691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:34.812691+0000","last_clean_scrub_stamp":"2024-09-22T08:40:34.812691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:00:48.199101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"32'5","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:31.465577+0000","last_change":"2024-09-22T08:40:31.465514+0000","last_active":"2024-09-22T08:40:31.465577+0000","last_peered":"2024-09-22T08:40:31.465577+0000","last_clean":"2024-09-22T08:40:31.465577+0000","last_became_active":"2024-09-22T08:36:34.022448+0000","last_became_peered":"2024-09-22T08:36:34.022448+0000","last_unstale":"2024-09-22T08:40:31.465577+0000","last_undegraded":"2024-09-22T08:40:31.465577+0000","last_fullsized":"2024-09-22T08:40:31.465577+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'5","last_scrub_stamp":"2024-09-22T08:40:31.465423+0000","last_deep_scrub":"32'5","last_deep_scrub_stamp":"2024-09-22T08:40:31.465423+0000","last_clean_scrub_stamp":"2024-09-22T08:40:31.465423+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:38:40.836439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":13,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"32'10","reported_seq":68,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:00.348157+0000","last_change":"2024-09-22T08:40:00.348098+0000","last_active":"2024-09-22T08:40:00.348157+0000","last_peered":"2024-09-22T08:40:00.348157+0000","last_clean":"2024-09-22T08:40:00.348157+0000","last_became_active":"2024-09-22T08:36:25.975728+0000","last_became_peered":"2024-09-22T08:36:25.975728+0000","last_unstale":"2024-09-22T08:40:00.348157+0000","last_undegraded":"2024-09-22T08:40:00.348157+0000","last_fullsized":"2024-09-22T08:40:00.348157+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-09-22T08:40:00.348005+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-09-22T08:40:00.348005+0000","last_clean_scrub_stamp":"2024-09-22T08:40:00.348005+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:50:17.392073+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"32'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:47.621450+0000","last_change":"2024-09-22T08:39:47.621398+0000","last_active":"2024-09-22T08:39:47.621450+0000","last_peered":"2024-09-22T08:39:47.621450+0000","last_clean":"2024-09-22T08:39:47.621450+0000","last_became_active":"2024-09-22T08:36:23.968836+0000","last_became_peered":"2024-09-22T08:36:23.968836+0000","last_unstale":"2024-09-22T08:39:47.621450+0000","last_undegraded":"2024-09-22T08:39:47.621450+0000","last_fullsized":"2024-09-22T08:39:47.621450+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-22T08:39:47.621313+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-22T08:39:47.621313+0000","last_clean_scrub_stamp":"2024-09-22T08:39:47.621313+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:26:56.822278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:14.829286+0000","last_change":"2024-09-22T08:40:14.829193+0000","last_active":"2024-09-22T08:40:14.829286+0000","last_peered":"2024-09-22T08:40:14.829286+0000","last_clean":"2024-09-22T08:40:14.829286+0000","last_became_active":"2024-09-22T08:36:27.987577+0000","last_became_peered":"2024-09-22T08:36:27.987577+0000","last_unstale":"2024-09-22T08:40:14.829286+0000","last_undegraded":"2024-09-22T08:40:14.829286+0000","last_fullsized":"2024-09-22T08:40:14.829286+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:14.829090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:14.829090+0000","last_clean_scrub_stamp":"2024-09-22T08:40:14.829090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:13:09.683686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"32'38","reported_seq":94,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:41.488509+0000","last_change":"2024-09-22T08:40:41.488447+0000","last_active":"2024-09-22T08:40:41.488509+0000","last_peered":"2024-09-22T08:40:41.488509+0000","last_clean":"2024-09-22T08:40:41.488509+0000","last_became_active":"2024-09-22T08:36:29.994921+0000","last_became_peered":"2024-09-22T08:36:29.994921+0000","last_unstale":"2024-09-22T08:40:41.488509+0000","last_undegraded":"2024-09-22T08:40:41.488509+0000","last_fullsized":"2024-09-22T08:40:41.488509+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'38","last_scrub_stamp":"2024-09-22T08:40:41.488340+0000","last_deep_scrub":"32'38","last_deep_scrub_stamp":"2024-09-22T08:40:41.488340+0000","last_clean_scrub_stamp":"2024-09-22T08:40:41.488340+0000","objects_scrubbed":4,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:15:53.374710+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:32.802706+0000","last_change":"2024-09-22T08:40:32.802601+0000","last_active":"2024-09-22T08:40:32.802706+0000","last_peered":"2024-09-22T08:40:32.802706+0000","last_clean":"2024-09-22T08:40:32.802706+0000","last_became_active":"2024-09-22T08:36:32.004269+0000","last_became_peered":"2024-09-22T08:36:32.004269+0000","last_unstale":"2024-09-22T08:40:32.802706+0000","last_undegraded":"2024-09-22T08:40:32.802706+0000","last_fullsized":"2024-09-22T08:40:32.802706+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:32.802512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:32.802512+0000","last_clean_scrub_stamp":"2024-09-22T08:40:32.802512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:59:06.906283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"32'4","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:40.368388+0000","last_change":"2024-09-22T08:40:40.368292+0000","last_active":"2024-09-22T08:40:40.368388+0000","last_peered":"2024-09-22T08:40:40.368388+0000","last_clean":"2024-09-22T08:40:40.368388+0000","last_became_active":"2024-09-22T08:36:34.018190+0000","last_became_peered":"2024-09-22T08:36:34.018190+0000","last_unstale":"2024-09-22T08:40:40.368388+0000","last_undegraded":"2024-09-22T08:40:40.368388+0000","last_fullsized":"2024-09-22T08:40:40.368388+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-22T08:40:40.368201+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-22T08:40:40.368201+0000","last_clean_scrub_stamp":"2024-09-22T08:40:40.368201+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:52:55.935475+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"32'4","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:55.624427+0000","last_change":"2024-09-22T08:39:55.624374+0000","last_active":"2024-09-22T08:39:55.624427+0000","last_peered":"2024-09-22T08:39:55.624427+0000","last_clean":"2024-09-22T08:39:55.624427+0000","last_became_active":"2024-09-22T08:36:25.983073+0000","last_became_peered":"2024-09-22T08:36:25.983073+0000","last_unstale":"2024-09-22T08:39:55.624427+0000","last_undegraded":"2024-09-22T08:39:55.624427+0000","last_fullsized":"2024-09-22T08:39:55.624427+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-22T08:39:55.624297+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-22T08:39:55.624297+0000","last_clean_scrub_stamp":"2024-09-22T08:39:55.624297+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:20:43.093379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"32'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:53.406819+0000","last_change":"2024-09-22T08:39:53.406759+0000","last_active":"2024-09-22T08:39:53.406819+0000","last_peered":"2024-09-22T08:39:53.406819+0000","last_clean":"2024-09-22T08:39:53.406819+0000","last_became_active":"2024-09-22T08:36:23.980682+0000","last_became_peered":"2024-09-22T08:36:23.980682+0000","last_unstale":"2024-09-22T08:39:53.406819+0000","last_undegraded":"2024-09-22T08:39:53.406819+0000","last_fullsized":"2024-09-22T08:39:53.406819+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-22T08:39:53.406674+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-22T08:39:53.406674+0000","last_clean_scrub_stamp":"2024-09-22T08:39:53.406674+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:08:41.063816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:16.832261+0000","last_change":"2024-09-22T08:40:16.832193+0000","last_active":"2024-09-22T08:40:16.832261+0000","last_peered":"2024-09-22T08:40:16.832261+0000","last_clean":"2024-09-22T08:40:16.832261+0000","last_became_active":"2024-09-22T08:36:27.985675+0000","last_became_peered":"2024-09-22T08:36:27.985675+0000","last_unstale":"2024-09-22T08:40:16.832261+0000","last_undegraded":"2024-09-22T08:40:16.832261+0000","last_fullsized":"2024-09-22T08:40:16.832261+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:16.832115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:16.832115+0000","last_clean_scrub_stamp":"2024-09-22T08:40:16.832115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:49:05.088114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"32'48","reported_seq":107,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:40.440754+0000","last_change":"2024-09-22T08:40:40.440652+0000","last_active":"2024-09-22T08:40:40.440754+0000","last_peered":"2024-09-22T08:40:40.440754+0000","last_clean":"2024-09-22T08:40:40.440754+0000","last_became_active":"2024-09-22T08:36:29.997542+0000","last_became_peered":"2024-09-22T08:36:29.997542+0000","last_unstale":"2024-09-22T08:40:40.440754+0000","last_undegraded":"2024-09-22T08:40:40.440754+0000","last_fullsized":"2024-09-22T08:40:40.440754+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'48","last_scrub_stamp":"2024-09-22T08:40:40.440544+0000","last_deep_scrub":"32'48","last_deep_scrub_stamp":"2024-09-22T08:40:40.440544+0000","last_clean_scrub_stamp":"2024-09-22T08:40:40.440544+0000","objects_scrubbed":7,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:56:19.476851+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"32'286","reported_seq":361,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:30.869342+0000","last_change":"2024-09-22T08:40:30.869290+0000","last_active":"2024-09-22T08:40:30.869342+0000","last_peered":"2024-09-22T08:40:30.869342+0000","last_clean":"2024-09-22T08:40:30.869342+0000","last_became_active":"2024-09-22T08:36:32.004441+0000","last_became_peered":"2024-09-22T08:36:32.004441+0000","last_unstale":"2024-09-22T08:40:30.869342+0000","last_undegraded":"2024-09-22T08:40:30.869342+0000","last_fullsized":"2024-09-22T08:40:30.869342+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'286","last_scrub_stamp":"2024-09-22T08:40:30.869201+0000","last_deep_scrub":"32'286","last_deep_scrub_stamp":"2024-09-22T08:40:30.869201+0000","last_clean_scrub_stamp":"2024-09-22T08:40:30.869201+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:14:18.065392+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:38.811921+0000","last_change":"2024-09-22T08:40:38.811852+0000","last_active":"2024-09-22T08:40:38.811921+0000","last_peered":"2024-09-22T08:40:38.811921+0000","last_clean":"2024-09-22T08:40:38.811921+0000","last_became_active":"2024-09-22T08:36:34.017217+0000","last_became_peered":"2024-09-22T08:36:34.017217+0000","last_unstale":"2024-09-22T08:40:38.811921+0000","last_undegraded":"2024-09-22T08:40:38.811921+0000","last_fullsized":"2024-09-22T08:40:38.811921+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:38.811743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:38.811743+0000","last_clean_scrub_stamp":"2024-09-22T08:40:38.811743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:50:20.661338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"32'2","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:56.576748+0000","last_change":"2024-09-22T08:39:56.576672+0000","last_active":"2024-09-22T08:39:56.576748+0000","last_peered":"2024-09-22T08:39:56.576748+0000","last_clean":"2024-09-22T08:39:56.576748+0000","last_became_active":"2024-09-22T08:36:25.972198+0000","last_became_peered":"2024-09-22T08:36:25.972198+0000","last_unstale":"2024-09-22T08:39:56.576748+0000","last_undegraded":"2024-09-22T08:39:56.576748+0000","last_fullsized":"2024-09-22T08:39:56.576748+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-22T08:39:56.576591+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-22T08:39:56.576591+0000","last_clean_scrub_stamp":"2024-09-22T08:39:56.576591+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:19:21.946421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:55.323013+0000","last_change":"2024-09-22T08:39:55.322922+0000","last_active":"2024-09-22T08:39:55.323013+0000","last_peered":"2024-09-22T08:39:55.323013+0000","last_clean":"2024-09-22T08:39:55.323013+0000","last_became_active":"2024-09-22T08:36:23.978306+0000","last_became_peered":"2024-09-22T08:36:23.978306+0000","last_unstale":"2024-09-22T08:39:55.323013+0000","last_undegraded":"2024-09-22T08:39:55.323013+0000","last_fullsized":"2024-09-22T08:39:55.323013+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:39:55.322811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:39:55.322811+0000","last_clean_scrub_stamp":"2024-09-22T08:39:55.322811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:44:43.243059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:15.861695+0000","last_change":"2024-09-22T08:40:15.861620+0000","last_active":"2024-09-22T08:40:15.861695+0000","last_peered":"2024-09-22T08:40:15.861695+0000","last_clean":"2024-09-22T08:40:15.861695+0000","last_became_active":"2024-09-22T08:36:27.985751+0000","last_became_peered":"2024-09-22T08:36:27.985751+0000","last_unstale":"2024-09-22T08:40:15.861695+0000","last_undegraded":"2024-09-22T08:40:15.861695+0000","last_fullsized":"2024-09-22T08:40:15.861695+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:15.861527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:15.861527+0000","last_clean_scrub_stamp":"2024-09-22T08:40:15.861527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:35:09.030569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"32'66","reported_seq":140,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:43.439343+0000","last_change":"2024-09-22T08:40:43.439272+0000","last_active":"2024-09-22T08:40:43.439343+0000","last_peered":"2024-09-22T08:40:43.439343+0000","last_clean":"2024-09-22T08:40:43.439343+0000","last_became_active":"2024-09-22T08:36:29.995225+0000","last_became_peered":"2024-09-22T08:36:29.995225+0000","last_unstale":"2024-09-22T08:40:43.439343+0000","last_undegraded":"2024-09-22T08:40:43.439343+0000","last_fullsized":"2024-09-22T08:40:43.439343+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'66","last_scrub_stamp":"2024-09-22T08:40:43.439173+0000","last_deep_scrub":"32'66","last_deep_scrub_stamp":"2024-09-22T08:40:43.439173+0000","last_clean_scrub_stamp":"2024-09-22T08:40:43.439173+0000","objects_scrubbed":5,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:34:02.270004+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:29.873480+0000","last_change":"2024-09-22T08:40:29.873423+0000","last_active":"2024-09-22T08:40:29.873480+0000","last_peered":"2024-09-22T08:40:29.873480+0000","last_clean":"2024-09-22T08:40:29.873480+0000","last_became_active":"2024-09-22T08:36:32.002833+0000","last_became_peered":"2024-09-22T08:36:32.002833+0000","last_unstale":"2024-09-22T08:40:29.873480+0000","last_undegraded":"2024-09-22T08:40:29.873480+0000","last_fullsized":"2024-09-22T08:40:29.873480+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:29.873335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:29.873335+0000","last_clean_scrub_stamp":"2024-09-22T08:40:29.873335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:22:16.274271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"32'21","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:42.827536+0000","last_change":"2024-09-22T08:40:42.827463+0000","last_active":"2024-09-22T08:40:42.827536+0000","last_peered":"2024-09-22T08:40:42.827536+0000","last_clean":"2024-09-22T08:40:42.827536+0000","last_became_active":"2024-09-22T08:36:34.014853+0000","last_became_peered":"2024-09-22T08:36:34.014853+0000","last_unstale":"2024-09-22T08:40:42.827536+0000","last_undegraded":"2024-09-22T08:40:42.827536+0000","last_fullsized":"2024-09-22T08:40:42.827536+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'21","last_scrub_stamp":"2024-09-22T08:40:42.827372+0000","last_deep_scrub":"32'21","last_deep_scrub_stamp":"2024-09-22T08:40:42.827372+0000","last_clean_scrub_stamp":"2024-09-22T08:40:42.827372+0000","objects_scrubbed":3,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:20:38.200767+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"32'12","reported_seq":79,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:01.359265+0000","last_change":"2024-09-22T08:40:01.359189+0000","last_active":"2024-09-22T08:40:01.359265+0000","last_peered":"2024-09-22T08:40:01.359265+0000","last_clean":"2024-09-22T08:40:01.359265+0000","last_became_active":"2024-09-22T08:36:25.977682+0000","last_became_peered":"2024-09-22T08:36:25.977682+0000","last_unstale":"2024-09-22T08:40:01.359265+0000","last_undegraded":"2024-09-22T08:40:01.359265+0000","last_fullsized":"2024-09-22T08:40:01.359265+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-09-22T08:40:01.359074+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-09-22T08:40:01.359074+0000","last_clean_scrub_stamp":"2024-09-22T08:40:01.359074+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:56:45.036758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":47,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:46.788179+0000","last_change":"2024-09-22T08:39:46.788116+0000","last_active":"2024-09-22T08:39:46.788179+0000","last_peered":"2024-09-22T08:39:46.788179+0000","last_clean":"2024-09-22T08:39:46.788179+0000","last_became_active":"2024-09-22T08:36:23.972822+0000","last_became_peered":"2024-09-22T08:36:23.972822+0000","last_unstale":"2024-09-22T08:39:46.788179+0000","last_undegraded":"2024-09-22T08:39:46.788179+0000","last_fullsized":"2024-09-22T08:39:46.788179+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:39:46.788026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:39:46.788026+0000","last_clean_scrub_stamp":"2024-09-22T08:39:46.788026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:10:40.958015+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:11.369442+0000","last_change":"2024-09-22T08:40:11.369383+0000","last_active":"2024-09-22T08:40:11.369442+0000","last_peered":"2024-09-22T08:40:11.369442+0000","last_clean":"2024-09-22T08:40:11.369442+0000","last_became_active":"2024-09-22T08:36:27.991761+0000","last_became_peered":"2024-09-22T08:36:27.991761+0000","last_unstale":"2024-09-22T08:40:11.369442+0000","last_undegraded":"2024-09-22T08:40:11.369442+0000","last_fullsized":"2024-09-22T08:40:11.369442+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:11.369297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:11.369297+0000","last_clean_scrub_stamp":"2024-09-22T08:40:11.369297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:02:18.578080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"32'40","reported_seq":97,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:30.347299+0000","last_change":"2024-09-22T08:40:30.347233+0000","last_active":"2024-09-22T08:40:30.347299+0000","last_peered":"2024-09-22T08:40:30.347299+0000","last_clean":"2024-09-22T08:40:30.347299+0000","last_became_active":"2024-09-22T08:36:29.988363+0000","last_became_peered":"2024-09-22T08:36:29.988363+0000","last_unstale":"2024-09-22T08:40:30.347299+0000","last_undegraded":"2024-09-22T08:40:30.347299+0000","last_fullsized":"2024-09-22T08:40:30.347299+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'40","last_scrub_stamp":"2024-09-22T08:40:30.347131+0000","last_deep_scrub":"32'40","last_deep_scrub_stamp":"2024-09-22T08:40:30.347131+0000","last_clean_scrub_stamp":"2024-09-22T08:40:30.347131+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:40:22.822120+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:58.343441+0000","last_change":"2024-09-22T08:40:58.343345+0000","last_active":"2024-09-22T08:40:58.343441+0000","last_peered":"2024-09-22T08:40:58.343441+0000","last_clean":"2024-09-22T08:40:58.343441+0000","last_became_active":"2024-09-22T08:36:32.011923+0000","last_became_peered":"2024-09-22T08:36:32.011923+0000","last_unstale":"2024-09-22T08:40:58.343441+0000","last_undegraded":"2024-09-22T08:40:58.343441+0000","last_fullsized":"2024-09-22T08:40:58.343441+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:58.343223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:58.343223+0000","last_clean_scrub_stamp":"2024-09-22T08:40:58.343223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:22:29.597663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"32'4","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:56.400652+0000","last_change":"2024-09-22T08:40:56.400652+0000","last_active":"2024-09-22T08:40:56.400652+0000","last_peered":"2024-09-22T08:40:56.400652+0000","last_clean":"2024-09-22T08:40:56.400652+0000","last_became_active":"2024-09-22T08:36:34.013308+0000","last_became_peered":"2024-09-22T08:36:34.013308+0000","last_unstale":"2024-09-22T08:40:56.400652+0000","last_undegraded":"2024-09-22T08:40:56.400652+0000","last_fullsized":"2024-09-22T08:40:56.400652+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-22T08:40:56.400558+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-22T08:40:56.400558+0000","last_clean_scrub_stamp":"2024-09-22T08:40:56.400558+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:03:28.367010+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"32'6","reported_seq":61,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:11.403794+0000","last_change":"2024-09-22T08:40:11.403703+0000","last_active":"2024-09-22T08:40:11.403794+0000","last_peered":"2024-09-22T08:40:11.403794+0000","last_clean":"2024-09-22T08:40:11.403794+0000","last_became_active":"2024-09-22T08:36:25.992167+0000","last_became_peered":"2024-09-22T08:36:25.992167+0000","last_unstale":"2024-09-22T08:40:11.403794+0000","last_undegraded":"2024-09-22T08:40:11.403794+0000","last_fullsized":"2024-09-22T08:40:11.403794+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-22T08:40:11.403607+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-22T08:40:11.403607+0000","last_clean_scrub_stamp":"2024-09-22T08:40:11.403607+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:48:41.981330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"32'4","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:51.418537+0000","last_change":"2024-09-22T08:39:51.418486+0000","last_active":"2024-09-22T08:39:51.418537+0000","last_peered":"2024-09-22T08:39:51.418537+0000","last_clean":"2024-09-22T08:39:51.418537+0000","last_became_active":"2024-09-22T08:36:23.980560+0000","last_became_peered":"2024-09-22T08:36:23.980560+0000","last_unstale":"2024-09-22T08:39:51.418537+0000","last_undegraded":"2024-09-22T08:39:51.418537+0000","last_fullsized":"2024-09-22T08:39:51.418537+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-22T08:39:51.418401+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-22T08:39:51.418401+0000","last_clean_scrub_stamp":"2024-09-22T08:39:51.418401+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:39:01.093268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":6,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:17.865117+0000","last_change":"2024-09-22T08:40:17.865031+0000","last_active":"2024-09-22T08:40:17.865117+0000","last_peered":"2024-09-22T08:40:17.865117+0000","last_clean":"2024-09-22T08:40:17.865117+0000","last_became_active":"2024-09-22T08:36:27.984699+0000","last_became_peered":"2024-09-22T08:36:27.984699+0000","last_unstale":"2024-09-22T08:40:17.865117+0000","last_undegraded":"2024-09-22T08:40:17.865117+0000","last_fullsized":"2024-09-22T08:40:17.865117+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:17.864935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:17.864935+0000","last_clean_scrub_stamp":"2024-09-22T08:40:17.864935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:06:55.919594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"32'46","reported_seq":105,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:19.415106+0000","last_change":"2024-09-22T08:40:19.415050+0000","last_active":"2024-09-22T08:40:19.415106+0000","last_peered":"2024-09-22T08:40:19.415106+0000","last_clean":"2024-09-22T08:40:19.415106+0000","last_became_active":"2024-09-22T08:36:29.989049+0000","last_became_peered":"2024-09-22T08:36:29.989049+0000","last_unstale":"2024-09-22T08:40:19.415106+0000","last_undegraded":"2024-09-22T08:40:19.415106+0000","last_fullsized":"2024-09-22T08:40:19.415106+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'46","last_scrub_stamp":"2024-09-22T08:40:19.414959+0000","last_deep_scrub":"32'46","last_deep_scrub_stamp":"2024-09-22T08:40:19.414959+0000","last_clean_scrub_stamp":"2024-09-22T08:40:19.414959+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:49:24.762046+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"32'286","reported_seq":465,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:25.421491+0000","last_change":"2024-09-22T08:40:25.421430+0000","last_active":"2024-09-22T08:40:25.421491+0000","last_peered":"2024-09-22T08:40:25.421491+0000","last_clean":"2024-09-22T08:40:25.421491+0000","last_became_active":"2024-09-22T08:36:32.003451+0000","last_became_peered":"2024-09-22T08:36:32.003451+0000","last_unstale":"2024-09-22T08:40:25.421491+0000","last_undegraded":"2024-09-22T08:40:25.421491+0000","last_fullsized":"2024-09-22T08:40:25.421491+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'286","last_scrub_stamp":"2024-09-22T08:40:25.421346+0000","last_deep_scrub":"32'286","last_deep_scrub_stamp":"2024-09-22T08:40:25.421346+0000","last_clean_scrub_stamp":"2024-09-22T08:40:25.421346+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:49:15.576473+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"32'13","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:37.800064+0000","last_change":"2024-09-22T08:40:37.800013+0000","last_active":"2024-09-22T08:40:37.800064+0000","last_peered":"2024-09-22T08:40:37.800064+0000","last_clean":"2024-09-22T08:40:37.800064+0000","last_became_active":"2024-09-22T08:36:34.017586+0000","last_became_peered":"2024-09-22T08:36:34.017586+0000","last_unstale":"2024-09-22T08:40:37.800064+0000","last_undegraded":"2024-09-22T08:40:37.800064+0000","last_fullsized":"2024-09-22T08:40:37.800064+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'13","last_scrub_stamp":"2024-09-22T08:40:37.799919+0000","last_deep_scrub":"32'13","last_deep_scrub_stamp":"2024-09-22T08:40:37.799919+0000","last_clean_scrub_stamp":"2024-09-22T08:40:37.799919+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:56:05.773299+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":180,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"32'6","reported_seq":61,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:00.480012+0000","last_change":"2024-09-22T08:40:00.479916+0000","last_active":"2024-09-22T08:40:00.480012+0000","last_peered":"2024-09-22T08:40:00.480012+0000","last_clean":"2024-09-22T08:40:00.480012+0000","last_became_active":"2024-09-22T08:36:25.983836+0000","last_became_peered":"2024-09-22T08:36:25.983836+0000","last_unstale":"2024-09-22T08:40:00.480012+0000","last_undegraded":"2024-09-22T08:40:00.480012+0000","last_fullsized":"2024-09-22T08:40:00.480012+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-22T08:40:00.479800+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-22T08:40:00.479800+0000","last_clean_scrub_stamp":"2024-09-22T08:40:00.479800+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:26:08.975683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":29,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:50.428866+0000","last_change":"2024-09-22T08:39:50.428805+0000","last_active":"2024-09-22T08:39:50.428866+0000","last_peered":"2024-09-22T08:39:50.428866+0000","last_clean":"2024-09-22T08:39:50.428866+0000","last_became_active":"2024-09-22T08:36:23.981453+0000","last_became_peered":"2024-09-22T08:36:23.981453+0000","last_unstale":"2024-09-22T08:39:50.428866+0000","last_undegraded":"2024-09-22T08:39:50.428866+0000","last_fullsized":"2024-09-22T08:39:50.428866+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:39:50.428713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:39:50.428713+0000","last_clean_scrub_stamp":"2024-09-22T08:39:50.428713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:18:15.418827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"32'5","reported_seq":429,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:20.318888+0000","last_change":"2024-09-22T08:40:20.318827+0000","last_active":"2024-09-22T08:40:20.318888+0000","last_peered":"2024-09-22T08:40:20.318888+0000","last_clean":"2024-09-22T08:40:20.318888+0000","last_became_active":"2024-09-22T08:36:27.990658+0000","last_became_peered":"2024-09-22T08:36:27.990658+0000","last_unstale":"2024-09-22T08:40:20.318888+0000","last_undegraded":"2024-09-22T08:40:20.318888+0000","last_fullsized":"2024-09-22T08:40:20.318888+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'5","last_scrub_stamp":"2024-09-22T08:40:20.318746+0000","last_deep_scrub":"32'5","last_deep_scrub_stamp":"2024-09-22T08:40:20.318746+0000","last_clean_scrub_stamp":"2024-09-22T08:40:20.318746+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:30:40.478521+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"32'15","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:42.464911+0000","last_change":"2024-09-22T08:40:42.464842+0000","last_active":"2024-09-22T08:40:42.464911+0000","last_peered":"2024-09-22T08:40:42.464911+0000","last_clean":"2024-09-22T08:40:42.464911+0000","last_became_active":"2024-09-22T08:36:29.994352+0000","last_became_peered":"2024-09-22T08:36:29.994352+0000","last_unstale":"2024-09-22T08:40:42.464911+0000","last_undegraded":"2024-09-22T08:40:42.464911+0000","last_fullsized":"2024-09-22T08:40:42.464911+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'15","last_scrub_stamp":"2024-09-22T08:40:42.464741+0000","last_deep_scrub":"32'15","last_deep_scrub_stamp":"2024-09-22T08:40:42.464741+0000","last_clean_scrub_stamp":"2024-09-22T08:40:42.464741+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:44:06.261050+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"32'286","reported_seq":476,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:34.428632+0000","last_change":"2024-09-22T08:40:34.428565+0000","last_active":"2024-09-22T08:40:34.428632+0000","last_peered":"2024-09-22T08:40:34.428632+0000","last_clean":"2024-09-22T08:40:34.428632+0000","last_became_active":"2024-09-22T08:36:32.002222+0000","last_became_peered":"2024-09-22T08:36:32.002222+0000","last_unstale":"2024-09-22T08:40:34.428632+0000","last_undegraded":"2024-09-22T08:40:34.428632+0000","last_fullsized":"2024-09-22T08:40:34.428632+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'286","last_scrub_stamp":"2024-09-22T08:40:34.428477+0000","last_deep_scrub":"32'286","last_deep_scrub_stamp":"2024-09-22T08:40:34.428477+0000","last_clean_scrub_stamp":"2024-09-22T08:40:34.428477+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:31:06.442355+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"32'4","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:30.424006+0000","last_change":"2024-09-22T08:40:30.423936+0000","last_active":"2024-09-22T08:40:30.424006+0000","last_peered":"2024-09-22T08:40:30.424006+0000","last_clean":"2024-09-22T08:40:30.424006+0000","last_became_active":"2024-09-22T08:36:34.015833+0000","last_became_peered":"2024-09-22T08:36:34.015833+0000","last_unstale":"2024-09-22T08:40:30.424006+0000","last_undegraded":"2024-09-22T08:40:30.424006+0000","last_fullsized":"2024-09-22T08:40:30.424006+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-22T08:40:30.423809+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-22T08:40:30.423809+0000","last_clean_scrub_stamp":"2024-09-22T08:40:30.423809+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:59:43.892086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"32'6","reported_seq":61,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:02.310305+0000","last_change":"2024-09-22T08:40:02.310213+0000","last_active":"2024-09-22T08:40:02.310305+0000","last_peered":"2024-09-22T08:40:02.310305+0000","last_clean":"2024-09-22T08:40:02.310305+0000","last_became_active":"2024-09-22T08:36:25.977184+0000","last_became_peered":"2024-09-22T08:36:25.977184+0000","last_unstale":"2024-09-22T08:40:02.310305+0000","last_undegraded":"2024-09-22T08:40:02.310305+0000","last_fullsized":"2024-09-22T08:40:02.310305+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-22T08:40:02.310094+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-22T08:40:02.310094+0000","last_clean_scrub_stamp":"2024-09-22T08:40:02.310094+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:42:25.082452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"32'8","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:46.401458+0000","last_change":"2024-09-22T08:39:46.401339+0000","last_active":"2024-09-22T08:39:46.401458+0000","last_peered":"2024-09-22T08:39:46.401458+0000","last_clean":"2024-09-22T08:39:46.401458+0000","last_became_active":"2024-09-22T08:36:23.976129+0000","last_became_peered":"2024-09-22T08:36:23.976129+0000","last_unstale":"2024-09-22T08:39:46.401458+0000","last_undegraded":"2024-09-22T08:39:46.401458+0000","last_fullsized":"2024-09-22T08:39:46.401458+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-22T08:39:46.401243+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-22T08:39:46.401243+0000","last_clean_scrub_stamp":"2024-09-22T08:39:46.401243+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:53:00.898981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":14,"num_write":48,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"32'2","reported_seq":231,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:32.464697+0000","last_change":"2024-09-22T08:40:32.464599+0000","last_active":"2024-09-22T08:40:32.464697+0000","last_peered":"2024-09-22T08:40:32.464697+0000","last_clean":"2024-09-22T08:40:32.464697+0000","last_became_active":"2024-09-22T08:36:27.987999+0000","last_became_peered":"2024-09-22T08:36:27.987999+0000","last_unstale":"2024-09-22T08:40:32.464697+0000","last_undegraded":"2024-09-22T08:40:32.464697+0000","last_fullsized":"2024-09-22T08:40:32.464697+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-22T08:40:32.464497+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-22T08:40:32.464497+0000","last_clean_scrub_stamp":"2024-09-22T08:40:32.464497+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:22:06.660471+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"32'49","reported_seq":109,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:29.327544+0000","last_change":"2024-09-22T08:40:29.327491+0000","last_active":"2024-09-22T08:40:29.327544+0000","last_peered":"2024-09-22T08:40:29.327544+0000","last_clean":"2024-09-22T08:40:29.327544+0000","last_became_active":"2024-09-22T08:36:29.991671+0000","last_became_peered":"2024-09-22T08:36:29.991671+0000","last_unstale":"2024-09-22T08:40:29.327544+0000","last_undegraded":"2024-09-22T08:40:29.327544+0000","last_fullsized":"2024-09-22T08:40:29.327544+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'49","last_scrub_stamp":"2024-09-22T08:40:29.327390+0000","last_deep_scrub":"32'49","last_deep_scrub_stamp":"2024-09-22T08:40:29.327390+0000","last_clean_scrub_stamp":"2024-09-22T08:40:29.327390+0000","objects_scrubbed":8,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:58:23.936556+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:23.395488+0000","last_change":"2024-09-22T08:40:23.395412+0000","last_active":"2024-09-22T08:40:23.395488+0000","last_peered":"2024-09-22T08:40:23.395488+0000","last_clean":"2024-09-22T08:40:23.395488+0000","last_became_active":"2024-09-22T08:36:32.011845+0000","last_became_peered":"2024-09-22T08:36:32.011845+0000","last_unstale":"2024-09-22T08:40:23.395488+0000","last_undegraded":"2024-09-22T08:40:23.395488+0000","last_fullsized":"2024-09-22T08:40:23.395488+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:23.395314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:23.395314+0000","last_clean_scrub_stamp":"2024-09-22T08:40:23.395314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:11:41.447101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"32'7","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:39.357147+0000","last_change":"2024-09-22T08:40:39.357094+0000","last_active":"2024-09-22T08:40:39.357147+0000","last_peered":"2024-09-22T08:40:39.357147+0000","last_clean":"2024-09-22T08:40:39.357147+0000","last_became_active":"2024-09-22T08:36:34.008374+0000","last_became_peered":"2024-09-22T08:36:34.008374+0000","last_unstale":"2024-09-22T08:40:39.357147+0000","last_undegraded":"2024-09-22T08:40:39.357147+0000","last_fullsized":"2024-09-22T08:40:39.357147+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'7","last_scrub_stamp":"2024-09-22T08:40:39.356998+0000","last_deep_scrub":"32'7","last_deep_scrub_stamp":"2024-09-22T08:40:39.356998+0000","last_clean_scrub_stamp":"2024-09-22T08:40:39.356998+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:11:53.008163+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"32'15","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:54.643519+0000","last_change":"2024-09-22T08:39:54.643440+0000","last_active":"2024-09-22T08:39:54.643519+0000","last_peered":"2024-09-22T08:39:54.643519+0000","last_clean":"2024-09-22T08:39:54.643519+0000","last_became_active":"2024-09-22T08:37:04.228680+0000","last_became_peered":"2024-09-22T08:37:04.228680+0000","last_unstale":"2024-09-22T08:39:54.643519+0000","last_undegraded":"2024-09-22T08:39:54.643519+0000","last_fullsized":"2024-09-22T08:39:54.643519+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'15","last_scrub_stamp":"2024-09-22T08:39:54.643331+0000","last_deep_scrub":"32'15","last_deep_scrub_stamp":"2024-09-22T08:39:54.643331+0000","last_clean_scrub_stamp":"2024-09-22T08:39:54.643331+0000","objects_scrubbed":1,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:10:02.228729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":62,"num_read_kb":54,"num_write":19,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"32'74","reported_seq":153,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:43.060244+0000","last_change":"2024-09-22T08:39:43.060183+0000","last_active":"2024-09-22T08:39:43.060244+0000","last_peered":"2024-09-22T08:39:43.060244+0000","last_clean":"2024-09-22T08:39:43.060244+0000","last_became_active":"2024-09-22T08:36:10.736221+0000","last_became_peered":"2024-09-22T08:36:10.736221+0000","last_unstale":"2024-09-22T08:39:43.060244+0000","last_undegraded":"2024-09-22T08:39:43.060244+0000","last_fullsized":"2024-09-22T08:39:43.060244+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'74","last_scrub_stamp":"2024-09-22T08:39:43.060088+0000","last_deep_scrub":"32'74","last_deep_scrub_stamp":"2024-09-22T08:39:43.060088+0000","last_clean_scrub_stamp":"2024-09-22T08:39:43.060088+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:47:30.182707+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"32'2","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:45.437361+0000","last_change":"2024-09-22T08:39:45.437270+0000","last_active":"2024-09-22T08:39:45.437361+0000","last_peered":"2024-09-22T08:39:45.437361+0000","last_clean":"2024-09-22T08:39:45.437361+0000","last_became_active":"2024-09-22T08:36:16.425465+0000","last_became_peered":"2024-09-22T08:36:16.425465+0000","last_unstale":"2024-09-22T08:39:45.437361+0000","last_undegraded":"2024-09-22T08:39:45.437361+0000","last_fullsized":"2024-09-22T08:39:45.437361+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-22T08:39:45.437175+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-22T08:39:45.437175+0000","last_clean_scrub_stamp":"2024-09-22T08:39:45.437175+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:50:58.216244+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00049376300000000004,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"32'6","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:48.401446+0000","last_change":"2024-09-22T08:39:48.401375+0000","last_active":"2024-09-22T08:39:48.401446+0000","last_peered":"2024-09-22T08:39:48.401446+0000","last_clean":"2024-09-22T08:39:48.401446+0000","last_became_active":"2024-09-22T08:36:23.981576+0000","last_became_peered":"2024-09-22T08:36:23.981576+0000","last_unstale":"2024-09-22T08:39:48.401446+0000","last_undegraded":"2024-09-22T08:39:48.401446+0000","last_fullsized":"2024-09-22T08:39:48.401446+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-22T08:39:48.401293+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-22T08:39:48.401293+0000","last_clean_scrub_stamp":"2024-09-22T08:39:48.401293+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:49:36.460213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4,"num_write":22,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:19.267565+0000","last_change":"2024-09-22T08:40:19.267513+0000","last_active":"2024-09-22T08:40:19.267565+0000","last_peered":"2024-09-22T08:40:19.267565+0000","last_clean":"2024-09-22T08:40:19.267565+0000","last_became_active":"2024-09-22T08:36:27.991130+0000","last_became_peered":"2024-09-22T08:36:27.991130+0000","last_unstale":"2024-09-22T08:40:19.267565+0000","last_undegraded":"2024-09-22T08:40:19.267565+0000","last_fullsized":"2024-09-22T08:40:19.267565+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:19.267432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:19.267432+0000","last_clean_scrub_stamp":"2024-09-22T08:40:19.267432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:24:25.931908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"32'90","reported_seq":181,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:39.437213+0000","last_change":"2024-09-22T08:40:39.437157+0000","last_active":"2024-09-22T08:40:39.437213+0000","last_peered":"2024-09-22T08:40:39.437213+0000","last_clean":"2024-09-22T08:40:39.437213+0000","last_became_active":"2024-09-22T08:36:29.997294+0000","last_became_peered":"2024-09-22T08:36:29.997294+0000","last_unstale":"2024-09-22T08:40:39.437213+0000","last_undegraded":"2024-09-22T08:40:39.437213+0000","last_fullsized":"2024-09-22T08:40:39.437213+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'90","last_scrub_stamp":"2024-09-22T08:40:39.437041+0000","last_deep_scrub":"32'90","last_deep_scrub_stamp":"2024-09-22T08:40:39.437041+0000","last_clean_scrub_stamp":"2024-09-22T08:40:39.437041+0000","objects_scrubbed":5,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:28:01.417583+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:28.901799+0000","last_change":"2024-09-22T08:40:28.901745+0000","last_active":"2024-09-22T08:40:28.901799+0000","last_peered":"2024-09-22T08:40:28.901799+0000","last_clean":"2024-09-22T08:40:28.901799+0000","last_became_active":"2024-09-22T08:36:32.008793+0000","last_became_peered":"2024-09-22T08:36:32.008793+0000","last_unstale":"2024-09-22T08:40:28.901799+0000","last_undegraded":"2024-09-22T08:40:28.901799+0000","last_fullsized":"2024-09-22T08:40:28.901799+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:28.901664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:28.901664+0000","last_clean_scrub_stamp":"2024-09-22T08:40:28.901664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:13:27.046620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"32'81","reported_seq":172,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:32.515792+0000","last_change":"2024-09-22T08:40:32.515709+0000","last_active":"2024-09-22T08:40:32.515792+0000","last_peered":"2024-09-22T08:40:32.515792+0000","last_clean":"2024-09-22T08:40:32.515792+0000","last_became_active":"2024-09-22T08:36:34.016484+0000","last_became_peered":"2024-09-22T08:36:34.016484+0000","last_unstale":"2024-09-22T08:40:32.515792+0000","last_undegraded":"2024-09-22T08:40:32.515792+0000","last_fullsized":"2024-09-22T08:40:32.515792+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'81","last_scrub_stamp":"2024-09-22T08:40:32.515595+0000","last_deep_scrub":"32'81","last_deep_scrub_stamp":"2024-09-22T08:40:32.515595+0000","last_clean_scrub_stamp":"2024-09-22T08:40:32.515595+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:41:51.757595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":223,"num_read_kb":221,"num_write":155,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"32'6","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:10.409177+0000","last_change":"2024-09-22T08:40:10.409088+0000","last_active":"2024-09-22T08:40:10.409177+0000","last_peered":"2024-09-22T08:40:10.409177+0000","last_clean":"2024-09-22T08:40:10.409177+0000","last_became_active":"2024-09-22T08:36:25.988156+0000","last_became_peered":"2024-09-22T08:36:25.988156+0000","last_unstale":"2024-09-22T08:40:10.409177+0000","last_undegraded":"2024-09-22T08:40:10.409177+0000","last_fullsized":"2024-09-22T08:40:10.409177+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-22T08:40:10.409006+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-22T08:40:10.409006+0000","last_clean_scrub_stamp":"2024-09-22T08:40:10.409006+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:49:55.381873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:43.491544+0000","last_change":"2024-09-22T08:39:43.491476+0000","last_active":"2024-09-22T08:39:43.491544+0000","last_peered":"2024-09-22T08:39:43.491544+0000","last_clean":"2024-09-22T08:39:43.491544+0000","last_became_active":"2024-09-22T08:36:16.427252+0000","last_became_peered":"2024-09-22T08:36:16.427252+0000","last_unstale":"2024-09-22T08:39:43.491544+0000","last_undegraded":"2024-09-22T08:39:43.491544+0000","last_fullsized":"2024-09-22T08:39:43.491544+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:39:43.491364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:39:43.491364+0000","last_clean_scrub_stamp":"2024-09-22T08:39:43.491364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:29:57.540388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055484200000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:43.847108+0000","last_change":"2024-09-22T08:39:43.847049+0000","last_active":"2024-09-22T08:39:43.847108+0000","last_peered":"2024-09-22T08:39:43.847108+0000","last_clean":"2024-09-22T08:39:43.847108+0000","last_became_active":"2024-09-22T08:36:23.973773+0000","last_became_peered":"2024-09-22T08:36:23.973773+0000","last_unstale":"2024-09-22T08:39:43.847108+0000","last_undegraded":"2024-09-22T08:39:43.847108+0000","last_fullsized":"2024-09-22T08:39:43.847108+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:39:43.846973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:39:43.846973+0000","last_clean_scrub_stamp":"2024-09-22T08:39:43.846973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:25:33.678376+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:31.496817+0000","last_change":"2024-09-22T08:40:31.496770+0000","last_active":"2024-09-22T08:40:31.496817+0000","last_peered":"2024-09-22T08:40:31.496817+0000","last_clean":"2024-09-22T08:40:31.496817+0000","last_became_active":"2024-09-22T08:37:04.234316+0000","last_became_peered":"2024-09-22T08:37:04.234316+0000","last_unstale":"2024-09-22T08:40:31.496817+0000","last_undegraded":"2024-09-22T08:40:31.496817+0000","last_fullsized":"2024-09-22T08:40:31.496817+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:31.496690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:31.496690+0000","last_clean_scrub_stamp":"2024-09-22T08:40:31.496690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:41:42.239723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"32'295","reported_seq":520,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:28.302291+0000","last_change":"2024-09-22T08:40:28.302225+0000","last_active":"2024-09-22T08:40:28.302291+0000","last_peered":"2024-09-22T08:40:28.302291+0000","last_clean":"2024-09-22T08:40:28.302291+0000","last_became_active":"2024-09-22T08:36:29.996025+0000","last_became_peered":"2024-09-22T08:36:29.996025+0000","last_unstale":"2024-09-22T08:40:28.302291+0000","last_undegraded":"2024-09-22T08:40:28.302291+0000","last_fullsized":"2024-09-22T08:40:28.302291+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'295","last_scrub_stamp":"2024-09-22T08:40:28.302127+0000","last_deep_scrub":"32'295","last_deep_scrub_stamp":"2024-09-22T08:40:28.302127+0000","last_clean_scrub_stamp":"2024-09-22T08:40:28.302127+0000","objects_scrubbed":10,"log_size":295,"log_dups_size":0,"ondisk_log_size":295,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:25:44.934346+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":378,"num_read_kb":363,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:50.452733+0000","last_change":"2024-09-22T08:40:50.452733+0000","last_active":"2024-09-22T08:40:50.452733+0000","last_peered":"2024-09-22T08:40:50.452733+0000","last_clean":"2024-09-22T08:40:50.452733+0000","last_became_active":"2024-09-22T08:36:32.013220+0000","last_became_peered":"2024-09-22T08:36:32.013220+0000","last_unstale":"2024-09-22T08:40:50.452733+0000","last_undegraded":"2024-09-22T08:40:50.452733+0000","last_fullsized":"2024-09-22T08:40:50.452733+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:50.452643+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:50.452643+0000","last_clean_scrub_stamp":"2024-09-22T08:40:50.452643+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:16:43.041929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"32'5","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:42.427154+0000","last_change":"2024-09-22T08:40:42.427033+0000","last_active":"2024-09-22T08:40:42.427154+0000","last_peered":"2024-09-22T08:40:42.427154+0000","last_clean":"2024-09-22T08:40:42.427154+0000","last_became_active":"2024-09-22T08:36:34.018138+0000","last_became_peered":"2024-09-22T08:36:34.018138+0000","last_unstale":"2024-09-22T08:40:42.427154+0000","last_undegraded":"2024-09-22T08:40:42.427154+0000","last_fullsized":"2024-09-22T08:40:42.427154+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'5","last_scrub_stamp":"2024-09-22T08:40:42.426938+0000","last_deep_scrub":"32'5","last_deep_scrub_stamp":"2024-09-22T08:40:42.426938+0000","last_clean_scrub_stamp":"2024-09-22T08:40:42.426938+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:41:01.931942+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"32'8","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:01.792973+0000","last_change":"2024-09-22T08:40:01.792896+0000","last_active":"2024-09-22T08:40:01.792973+0000","last_peered":"2024-09-22T08:40:01.792973+0000","last_clean":"2024-09-22T08:40:01.792973+0000","last_became_active":"2024-09-22T08:36:25.979108+0000","last_became_peered":"2024-09-22T08:36:25.979108+0000","last_unstale":"2024-09-22T08:40:01.792973+0000","last_undegraded":"2024-09-22T08:40:01.792973+0000","last_fullsized":"2024-09-22T08:40:01.792973+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-22T08:40:01.792800+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-22T08:40:01.792800+0000","last_clean_scrub_stamp":"2024-09-22T08:40:01.792800+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:15:50.070182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:43.605375+0000","last_change":"2024-09-22T08:39:43.605309+0000","last_active":"2024-09-22T08:39:43.605375+0000","last_peered":"2024-09-22T08:39:43.605375+0000","last_clean":"2024-09-22T08:39:43.605375+0000","last_became_active":"2024-09-22T08:36:16.427121+0000","last_became_peered":"2024-09-22T08:36:16.427121+0000","last_unstale":"2024-09-22T08:39:43.605375+0000","last_undegraded":"2024-09-22T08:39:43.605375+0000","last_fullsized":"2024-09-22T08:39:43.605375+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:39:43.605211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:39:43.605211+0000","last_clean_scrub_stamp":"2024-09-22T08:39:43.605211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:07:42.970630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041194099999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:44.812049+0000","last_change":"2024-09-22T08:39:44.811985+0000","last_active":"2024-09-22T08:39:44.812049+0000","last_peered":"2024-09-22T08:39:44.812049+0000","last_clean":"2024-09-22T08:39:44.812049+0000","last_became_active":"2024-09-22T08:36:23.971688+0000","last_became_peered":"2024-09-22T08:36:23.971688+0000","last_unstale":"2024-09-22T08:39:44.812049+0000","last_undegraded":"2024-09-22T08:39:44.812049+0000","last_fullsized":"2024-09-22T08:39:44.812049+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-22T08:39:44.811892+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-22T08:39:44.811892+0000","last_clean_scrub_stamp":"2024-09-22T08:39:44.811892+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:25:37.511699+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:10.368342+0000","last_change":"2024-09-22T08:40:10.368238+0000","last_active":"2024-09-22T08:40:10.368342+0000","last_peered":"2024-09-22T08:40:10.368342+0000","last_clean":"2024-09-22T08:40:10.368342+0000","last_became_active":"2024-09-22T08:36:27.986993+0000","last_became_peered":"2024-09-22T08:36:27.986993+0000","last_unstale":"2024-09-22T08:40:10.368342+0000","last_undegraded":"2024-09-22T08:40:10.368342+0000","last_fullsized":"2024-09-22T08:40:10.368342+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-22T08:40:10.368133+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-22T08:40:10.368133+0000","last_clean_scrub_stamp":"2024-09-22T08:40:10.368133+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:08:05.798320+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"32'25","reported_seq":102,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:18.403483+0000","last_change":"2024-09-22T08:40:18.403402+0000","last_active":"2024-09-22T08:40:18.403483+0000","last_peered":"2024-09-22T08:40:18.403483+0000","last_clean":"2024-09-22T08:40:18.403483+0000","last_became_active":"2024-09-22T08:36:29.991579+0000","last_became_peered":"2024-09-22T08:36:29.991579+0000","last_unstale":"2024-09-22T08:40:18.403483+0000","last_undegraded":"2024-09-22T08:40:18.403483+0000","last_fullsized":"2024-09-22T08:40:18.403483+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'25","last_scrub_stamp":"2024-09-22T08:40:18.403282+0000","last_deep_scrub":"32'25","last_deep_scrub_stamp":"2024-09-22T08:40:18.403282+0000","last_clean_scrub_stamp":"2024-09-22T08:40:18.403282+0000","objects_scrubbed":8,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:10:52.856214+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:27.890107+0000","last_change":"2024-09-22T08:40:27.890053+0000","last_active":"2024-09-22T08:40:27.890107+0000","last_peered":"2024-09-22T08:40:27.890107+0000","last_clean":"2024-09-22T08:40:27.890107+0000","last_became_active":"2024-09-22T08:36:32.011634+0000","last_became_peered":"2024-09-22T08:36:32.011634+0000","last_unstale":"2024-09-22T08:40:27.890107+0000","last_undegraded":"2024-09-22T08:40:27.890107+0000","last_fullsized":"2024-09-22T08:40:27.890107+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:27.889962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:27.889962+0000","last_clean_scrub_stamp":"2024-09-22T08:40:27.889962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:50:15.948882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:57.388473+0000","last_change":"2024-09-22T08:40:57.388420+0000","last_active":"2024-09-22T08:40:57.388473+0000","last_peered":"2024-09-22T08:40:57.388473+0000","last_clean":"2024-09-22T08:40:57.388473+0000","last_became_active":"2024-09-22T08:36:34.011936+0000","last_became_peered":"2024-09-22T08:36:34.011936+0000","last_unstale":"2024-09-22T08:40:57.388473+0000","last_undegraded":"2024-09-22T08:40:57.388473+0000","last_fullsized":"2024-09-22T08:40:57.388473+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:57.388316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:57.388316+0000","last_clean_scrub_stamp":"2024-09-22T08:40:57.388316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:34:32.635355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"32'3","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:59.876344+0000","last_change":"2024-09-22T08:39:59.876252+0000","last_active":"2024-09-22T08:39:59.876344+0000","last_peered":"2024-09-22T08:39:59.876344+0000","last_clean":"2024-09-22T08:39:59.876344+0000","last_became_active":"2024-09-22T08:36:25.977552+0000","last_became_peered":"2024-09-22T08:36:25.977552+0000","last_unstale":"2024-09-22T08:39:59.876344+0000","last_undegraded":"2024-09-22T08:39:59.876344+0000","last_fullsized":"2024-09-22T08:39:59.876344+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2024-09-22T08:39:59.876163+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2024-09-22T08:39:59.876163+0000","last_clean_scrub_stamp":"2024-09-22T08:39:59.876163+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:26:06.074309+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"32'3","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:44.485676+0000","last_change":"2024-09-22T08:39:44.485607+0000","last_active":"2024-09-22T08:39:44.485676+0000","last_peered":"2024-09-22T08:39:44.485676+0000","last_clean":"2024-09-22T08:39:44.485676+0000","last_became_active":"2024-09-22T08:36:16.427358+0000","last_became_peered":"2024-09-22T08:36:16.427358+0000","last_unstale":"2024-09-22T08:39:44.485676+0000","last_undegraded":"2024-09-22T08:39:44.485676+0000","last_fullsized":"2024-09-22T08:39:44.485676+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2024-09-22T08:39:44.485523+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2024-09-22T08:39:44.485523+0000","last_clean_scrub_stamp":"2024-09-22T08:39:44.485523+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:22:57.579671+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.001068835,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"32'4","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:45.577448+0000","last_change":"2024-09-22T08:39:45.577394+0000","last_active":"2024-09-22T08:39:45.577448+0000","last_peered":"2024-09-22T08:39:45.577448+0000","last_clean":"2024-09-22T08:39:45.577448+0000","last_became_active":"2024-09-22T08:36:23.967413+0000","last_became_peered":"2024-09-22T08:36:23.967413+0000","last_unstale":"2024-09-22T08:39:45.577448+0000","last_undegraded":"2024-09-22T08:39:45.577448+0000","last_fullsized":"2024-09-22T08:39:45.577448+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-22T08:39:45.577315+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-22T08:39:45.577315+0000","last_clean_scrub_stamp":"2024-09-22T08:39:45.577315+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:36:05.444054+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:13.869243+0000","last_change":"2024-09-22T08:40:13.869191+0000","last_active":"2024-09-22T08:40:13.869243+0000","last_peered":"2024-09-22T08:40:13.869243+0000","last_clean":"2024-09-22T08:40:13.869243+0000","last_became_active":"2024-09-22T08:36:27.988507+0000","last_became_peered":"2024-09-22T08:36:27.988507+0000","last_unstale":"2024-09-22T08:40:13.869243+0000","last_undegraded":"2024-09-22T08:40:13.869243+0000","last_fullsized":"2024-09-22T08:40:13.869243+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:13.869104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:13.869104+0000","last_clean_scrub_stamp":"2024-09-22T08:40:13.869104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:02:34.608102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"32'20","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:38.468998+0000","last_change":"2024-09-22T08:40:38.468919+0000","last_active":"2024-09-22T08:40:38.468998+0000","last_peered":"2024-09-22T08:40:38.468998+0000","last_clean":"2024-09-22T08:40:38.468998+0000","last_became_active":"2024-09-22T08:36:29.996557+0000","last_became_peered":"2024-09-22T08:36:29.996557+0000","last_unstale":"2024-09-22T08:40:38.468998+0000","last_undegraded":"2024-09-22T08:40:38.468998+0000","last_fullsized":"2024-09-22T08:40:38.468998+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'20","last_scrub_stamp":"2024-09-22T08:40:38.468792+0000","last_deep_scrub":"32'20","last_deep_scrub_stamp":"2024-09-22T08:40:38.468792+0000","last_clean_scrub_stamp":"2024-09-22T08:40:38.468792+0000","objects_scrubbed":7,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:26:15.989751+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":394,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:51.413684+0000","last_change":"2024-09-22T08:40:51.413632+0000","last_active":"2024-09-22T08:40:51.413684+0000","last_peered":"2024-09-22T08:40:51.413684+0000","last_clean":"2024-09-22T08:40:51.413684+0000","last_became_active":"2024-09-22T08:36:32.013320+0000","last_became_peered":"2024-09-22T08:36:32.013320+0000","last_unstale":"2024-09-22T08:40:51.413684+0000","last_undegraded":"2024-09-22T08:40:51.413684+0000","last_fullsized":"2024-09-22T08:40:51.413684+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:51.413543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:51.413543+0000","last_clean_scrub_stamp":"2024-09-22T08:40:51.413543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:16:39.470689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"32'4","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:41.380693+0000","last_change":"2024-09-22T08:40:41.380636+0000","last_active":"2024-09-22T08:40:41.380693+0000","last_peered":"2024-09-22T08:40:41.380693+0000","last_clean":"2024-09-22T08:40:41.380693+0000","last_became_active":"2024-09-22T08:36:34.015483+0000","last_became_peered":"2024-09-22T08:36:34.015483+0000","last_unstale":"2024-09-22T08:40:41.380693+0000","last_undegraded":"2024-09-22T08:40:41.380693+0000","last_fullsized":"2024-09-22T08:40:41.380693+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-22T08:40:41.380561+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-22T08:40:41.380561+0000","last_clean_scrub_stamp":"2024-09-22T08:40:41.380561+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:56:27.197664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"32'8","reported_seq":71,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:58.302503+0000","last_change":"2024-09-22T08:39:58.302415+0000","last_active":"2024-09-22T08:39:58.302503+0000","last_peered":"2024-09-22T08:39:58.302503+0000","last_clean":"2024-09-22T08:39:58.302503+0000","last_became_active":"2024-09-22T08:36:25.986551+0000","last_became_peered":"2024-09-22T08:36:25.986551+0000","last_unstale":"2024-09-22T08:39:58.302503+0000","last_undegraded":"2024-09-22T08:39:58.302503+0000","last_fullsized":"2024-09-22T08:39:58.302503+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-22T08:39:58.302310+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-22T08:39:58.302310+0000","last_clean_scrub_stamp":"2024-09-22T08:39:58.302310+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:59:40.615258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:44.562290+0000","last_change":"2024-09-22T08:39:44.562216+0000","last_active":"2024-09-22T08:39:44.562290+0000","last_peered":"2024-09-22T08:39:44.562290+0000","last_clean":"2024-09-22T08:39:44.562290+0000","last_became_active":"2024-09-22T08:36:23.968525+0000","last_became_peered":"2024-09-22T08:36:23.968525+0000","last_unstale":"2024-09-22T08:39:44.562290+0000","last_undegraded":"2024-09-22T08:39:44.562290+0000","last_fullsized":"2024-09-22T08:39:44.562290+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:39:44.562132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:39:44.562132+0000","last_clean_scrub_stamp":"2024-09-22T08:39:44.562132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:35:46.943109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:47.806794+0000","last_change":"2024-09-22T08:39:47.806728+0000","last_active":"2024-09-22T08:39:47.806794+0000","last_peered":"2024-09-22T08:39:47.806794+0000","last_clean":"2024-09-22T08:39:47.806794+0000","last_became_active":"2024-09-22T08:36:16.424946+0000","last_became_peered":"2024-09-22T08:36:16.424946+0000","last_unstale":"2024-09-22T08:39:47.806794+0000","last_undegraded":"2024-09-22T08:39:47.806794+0000","last_fullsized":"2024-09-22T08:39:47.806794+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:39:47.806631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:39:47.806631+0000","last_clean_scrub_stamp":"2024-09-22T08:39:47.806631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:54:30.955543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045979400000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:12.856893+0000","last_change":"2024-09-22T08:40:12.856795+0000","last_active":"2024-09-22T08:40:12.856893+0000","last_peered":"2024-09-22T08:40:12.856893+0000","last_clean":"2024-09-22T08:40:12.856893+0000","last_became_active":"2024-09-22T08:36:27.987997+0000","last_became_peered":"2024-09-22T08:36:27.987997+0000","last_unstale":"2024-09-22T08:40:12.856893+0000","last_undegraded":"2024-09-22T08:40:12.856893+0000","last_fullsized":"2024-09-22T08:40:12.856893+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-22T08:40:12.856666+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-22T08:40:12.856666+0000","last_clean_scrub_stamp":"2024-09-22T08:40:12.856666+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:42:45.227704+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"32'78","reported_seq":155,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:20.854794+0000","last_change":"2024-09-22T08:40:20.854705+0000","last_active":"2024-09-22T08:40:20.854794+0000","last_peered":"2024-09-22T08:40:20.854794+0000","last_clean":"2024-09-22T08:40:20.854794+0000","last_became_active":"2024-09-22T08:36:29.994186+0000","last_became_peered":"2024-09-22T08:36:29.994186+0000","last_unstale":"2024-09-22T08:40:20.854794+0000","last_undegraded":"2024-09-22T08:40:20.854794+0000","last_fullsized":"2024-09-22T08:40:20.854794+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'78","last_scrub_stamp":"2024-09-22T08:40:20.854613+0000","last_deep_scrub":"32'78","last_deep_scrub_stamp":"2024-09-22T08:40:20.854613+0000","last_clean_scrub_stamp":"2024-09-22T08:40:20.854613+0000","objects_scrubbed":9,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:26:34.671090+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":336,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:24.430202+0000","last_change":"2024-09-22T08:40:24.430143+0000","last_active":"2024-09-22T08:40:24.430202+0000","last_peered":"2024-09-22T08:40:24.430202+0000","last_clean":"2024-09-22T08:40:24.430202+0000","last_became_active":"2024-09-22T08:36:32.003409+0000","last_became_peered":"2024-09-22T08:36:32.003409+0000","last_unstale":"2024-09-22T08:40:24.430202+0000","last_undegraded":"2024-09-22T08:40:24.430202+0000","last_fullsized":"2024-09-22T08:40:24.430202+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:24.430063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:24.430063+0000","last_clean_scrub_stamp":"2024-09-22T08:40:24.430063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:40:44.394913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"32'13","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:40.819229+0000","last_change":"2024-09-22T08:40:40.819162+0000","last_active":"2024-09-22T08:40:40.819229+0000","last_peered":"2024-09-22T08:40:40.819229+0000","last_clean":"2024-09-22T08:40:40.819229+0000","last_became_active":"2024-09-22T08:36:34.012782+0000","last_became_peered":"2024-09-22T08:36:34.012782+0000","last_unstale":"2024-09-22T08:40:40.819229+0000","last_undegraded":"2024-09-22T08:40:40.819229+0000","last_fullsized":"2024-09-22T08:40:40.819229+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'13","last_scrub_stamp":"2024-09-22T08:40:40.819048+0000","last_deep_scrub":"32'13","last_deep_scrub_stamp":"2024-09-22T08:40:40.819048+0000","last_clean_scrub_stamp":"2024-09-22T08:40:40.819048+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:29:44.631733+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":25,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"32'6","reported_seq":61,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:59.336001+0000","last_change":"2024-09-22T08:39:59.335942+0000","last_active":"2024-09-22T08:39:59.336001+0000","last_peered":"2024-09-22T08:39:59.336001+0000","last_clean":"2024-09-22T08:39:59.336001+0000","last_became_active":"2024-09-22T08:36:25.984820+0000","last_became_peered":"2024-09-22T08:36:25.984820+0000","last_unstale":"2024-09-22T08:39:59.336001+0000","last_undegraded":"2024-09-22T08:39:59.336001+0000","last_fullsized":"2024-09-22T08:39:59.336001+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-22T08:39:59.335838+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-22T08:39:59.335838+0000","last_clean_scrub_stamp":"2024-09-22T08:39:59.335838+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:19:14.131941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":29,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:45.773799+0000","last_change":"2024-09-22T08:39:45.773739+0000","last_active":"2024-09-22T08:39:45.773799+0000","last_peered":"2024-09-22T08:39:45.773799+0000","last_clean":"2024-09-22T08:39:45.773799+0000","last_became_active":"2024-09-22T08:36:23.973672+0000","last_became_peered":"2024-09-22T08:36:23.973672+0000","last_unstale":"2024-09-22T08:39:45.773799+0000","last_undegraded":"2024-09-22T08:39:45.773799+0000","last_fullsized":"2024-09-22T08:39:45.773799+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-22T08:39:45.773661+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-22T08:39:45.773661+0000","last_clean_scrub_stamp":"2024-09-22T08:39:45.773661+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:51:32.967955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:49.427544+0000","last_change":"2024-09-22T08:39:49.427484+0000","last_active":"2024-09-22T08:39:49.427544+0000","last_peered":"2024-09-22T08:39:49.427544+0000","last_clean":"2024-09-22T08:39:49.427544+0000","last_became_active":"2024-09-22T08:36:16.427154+0000","last_became_peered":"2024-09-22T08:36:16.427154+0000","last_unstale":"2024-09-22T08:39:49.427544+0000","last_undegraded":"2024-09-22T08:39:49.427544+0000","last_fullsized":"2024-09-22T08:39:49.427544+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:39:49.427383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:39:49.427383+0000","last_clean_scrub_stamp":"2024-09-22T08:39:49.427383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:57:58.108684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081028899999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:30.533866+0000","last_change":"2024-09-22T08:40:30.533806+0000","last_active":"2024-09-22T08:40:30.533866+0000","last_peered":"2024-09-22T08:40:30.533866+0000","last_clean":"2024-09-22T08:40:30.533866+0000","last_became_active":"2024-09-22T08:37:04.233981+0000","last_became_peered":"2024-09-22T08:37:04.233981+0000","last_unstale":"2024-09-22T08:40:30.533866+0000","last_undegraded":"2024-09-22T08:40:30.533866+0000","last_fullsized":"2024-09-22T08:40:30.533866+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:30.533727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:30.533727+0000","last_clean_scrub_stamp":"2024-09-22T08:40:30.533727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:28:52.837641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"32'22","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:27.335977+0000","last_change":"2024-09-22T08:40:27.335921+0000","last_active":"2024-09-22T08:40:27.335977+0000","last_peered":"2024-09-22T08:40:27.335977+0000","last_clean":"2024-09-22T08:40:27.335977+0000","last_became_active":"2024-09-22T08:36:29.995173+0000","last_became_peered":"2024-09-22T08:36:29.995173+0000","last_unstale":"2024-09-22T08:40:27.335977+0000","last_undegraded":"2024-09-22T08:40:27.335977+0000","last_fullsized":"2024-09-22T08:40:27.335977+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'22","last_scrub_stamp":"2024-09-22T08:40:27.335811+0000","last_deep_scrub":"32'22","last_deep_scrub_stamp":"2024-09-22T08:40:27.335811+0000","last_clean_scrub_stamp":"2024-09-22T08:40:27.335811+0000","objects_scrubbed":7,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:35:18.554483+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"32'286","reported_seq":359,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:33.450070+0000","last_change":"2024-09-22T08:40:33.450012+0000","last_active":"2024-09-22T08:40:33.450070+0000","last_peered":"2024-09-22T08:40:33.450070+0000","last_clean":"2024-09-22T08:40:33.450070+0000","last_became_active":"2024-09-22T08:36:32.002985+0000","last_became_peered":"2024-09-22T08:36:32.002985+0000","last_unstale":"2024-09-22T08:40:33.450070+0000","last_undegraded":"2024-09-22T08:40:33.450070+0000","last_fullsized":"2024-09-22T08:40:33.450070+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'286","last_scrub_stamp":"2024-09-22T08:40:33.449925+0000","last_deep_scrub":"32'286","last_deep_scrub_stamp":"2024-09-22T08:40:33.449925+0000","last_clean_scrub_stamp":"2024-09-22T08:40:33.449925+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:01:58.393144+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:41:00.311227+0000","last_change":"2024-09-22T08:41:00.311167+0000","last_active":"2024-09-22T08:41:00.311227+0000","last_peered":"2024-09-22T08:41:00.311227+0000","last_clean":"2024-09-22T08:41:00.311227+0000","last_became_active":"2024-09-22T08:36:34.019438+0000","last_became_peered":"2024-09-22T08:36:34.019438+0000","last_unstale":"2024-09-22T08:41:00.311227+0000","last_undegraded":"2024-09-22T08:41:00.311227+0000","last_fullsized":"2024-09-22T08:41:00.311227+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:41:00.311051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:41:00.311051+0000","last_clean_scrub_stamp":"2024-09-22T08:41:00.311051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:51:46.712133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"32'4","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:09.397384+0000","last_change":"2024-09-22T08:40:09.397318+0000","last_active":"2024-09-22T08:40:09.397384+0000","last_peered":"2024-09-22T08:40:09.397384+0000","last_clean":"2024-09-22T08:40:09.397384+0000","last_became_active":"2024-09-22T08:36:25.991480+0000","last_became_peered":"2024-09-22T08:36:25.991480+0000","last_unstale":"2024-09-22T08:40:09.397384+0000","last_undegraded":"2024-09-22T08:40:09.397384+0000","last_fullsized":"2024-09-22T08:40:09.397384+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-22T08:40:09.397220+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-22T08:40:09.397220+0000","last_clean_scrub_stamp":"2024-09-22T08:40:09.397220+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:59:18.881844+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:46.106244+0000","last_change":"2024-09-22T08:39:46.106194+0000","last_active":"2024-09-22T08:39:46.106244+0000","last_peered":"2024-09-22T08:39:46.106244+0000","last_clean":"2024-09-22T08:39:46.106244+0000","last_became_active":"2024-09-22T08:37:04.227561+0000","last_became_peered":"2024-09-22T08:37:04.227561+0000","last_unstale":"2024-09-22T08:39:46.106244+0000","last_undegraded":"2024-09-22T08:39:46.106244+0000","last_fullsized":"2024-09-22T08:39:46.106244+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:39:46.106091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:39:46.106091+0000","last_clean_scrub_stamp":"2024-09-22T08:39:46.106091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:00:33.266036+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:42.871847+0000","last_change":"2024-09-22T08:39:42.871788+0000","last_active":"2024-09-22T08:39:42.871847+0000","last_peered":"2024-09-22T08:39:42.871847+0000","last_clean":"2024-09-22T08:39:42.871847+0000","last_became_active":"2024-09-22T08:36:16.425549+0000","last_became_peered":"2024-09-22T08:36:16.425549+0000","last_unstale":"2024-09-22T08:39:42.871847+0000","last_undegraded":"2024-09-22T08:39:42.871847+0000","last_fullsized":"2024-09-22T08:39:42.871847+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:39:42.871712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:39:42.871712+0000","last_clean_scrub_stamp":"2024-09-22T08:39:42.871712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:11:04.345633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045809600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:29.561024+0000","last_change":"2024-09-22T08:40:29.560965+0000","last_active":"2024-09-22T08:40:29.561024+0000","last_peered":"2024-09-22T08:40:29.561024+0000","last_clean":"2024-09-22T08:40:29.561024+0000","last_became_active":"2024-09-22T08:36:27.987074+0000","last_became_peered":"2024-09-22T08:36:27.987074+0000","last_unstale":"2024-09-22T08:40:29.561024+0000","last_undegraded":"2024-09-22T08:40:29.561024+0000","last_fullsized":"2024-09-22T08:40:29.561024+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:29.560881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:29.560881+0000","last_clean_scrub_stamp":"2024-09-22T08:40:29.560881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:57:35.462473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"32'15","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:37.456201+0000","last_change":"2024-09-22T08:40:37.456149+0000","last_active":"2024-09-22T08:40:37.456201+0000","last_peered":"2024-09-22T08:40:37.456201+0000","last_clean":"2024-09-22T08:40:37.456201+0000","last_became_active":"2024-09-22T08:36:29.999965+0000","last_became_peered":"2024-09-22T08:36:29.999965+0000","last_unstale":"2024-09-22T08:40:37.456201+0000","last_undegraded":"2024-09-22T08:40:37.456201+0000","last_fullsized":"2024-09-22T08:40:37.456201+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'15","last_scrub_stamp":"2024-09-22T08:40:37.456059+0000","last_deep_scrub":"32'15","last_deep_scrub_stamp":"2024-09-22T08:40:37.456059+0000","last_clean_scrub_stamp":"2024-09-22T08:40:37.456059+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:20:11.660486+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"32'286","reported_seq":402,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:31.826692+0000","last_change":"2024-09-22T08:40:31.826634+0000","last_active":"2024-09-22T08:40:31.826692+0000","last_peered":"2024-09-22T08:40:31.826692+0000","last_clean":"2024-09-22T08:40:31.826692+0000","last_became_active":"2024-09-22T08:36:32.005155+0000","last_became_peered":"2024-09-22T08:36:32.005155+0000","last_unstale":"2024-09-22T08:40:31.826692+0000","last_undegraded":"2024-09-22T08:40:31.826692+0000","last_fullsized":"2024-09-22T08:40:31.826692+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'286","last_scrub_stamp":"2024-09-22T08:40:31.826545+0000","last_deep_scrub":"32'286","last_deep_scrub_stamp":"2024-09-22T08:40:31.826545+0000","last_clean_scrub_stamp":"2024-09-22T08:40:31.826545+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:37:09.792730+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"30'5","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:43.414214+0000","last_change":"2024-09-22T08:40:43.414159+0000","last_active":"2024-09-22T08:40:43.414214+0000","last_peered":"2024-09-22T08:40:43.414214+0000","last_clean":"2024-09-22T08:40:43.414214+0000","last_became_active":"2024-09-22T08:36:34.022313+0000","last_became_peered":"2024-09-22T08:36:34.022313+0000","last_unstale":"2024-09-22T08:40:43.414214+0000","last_undegraded":"2024-09-22T08:40:43.414214+0000","last_fullsized":"2024-09-22T08:40:43.414214+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'5","last_scrub_stamp":"2024-09-22T08:40:43.414073+0000","last_deep_scrub":"30'5","last_deep_scrub_stamp":"2024-09-22T08:40:43.414073+0000","last_clean_scrub_stamp":"2024-09-22T08:40:43.414073+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:43:45.397759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":11,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"32'4","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:05.384747+0000","last_change":"2024-09-22T08:40:05.384685+0000","last_active":"2024-09-22T08:40:05.384747+0000","last_peered":"2024-09-22T08:40:05.384747+0000","last_clean":"2024-09-22T08:40:05.384747+0000","last_became_active":"2024-09-22T08:36:25.974884+0000","last_became_peered":"2024-09-22T08:36:25.974884+0000","last_unstale":"2024-09-22T08:40:05.384747+0000","last_undegraded":"2024-09-22T08:40:05.384747+0000","last_fullsized":"2024-09-22T08:40:05.384747+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-22T08:40:05.384591+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-22T08:40:05.384591+0000","last_clean_scrub_stamp":"2024-09-22T08:40:05.384591+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:46:32.018206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"32'5","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:44.099982+0000","last_change":"2024-09-22T08:39:44.099885+0000","last_active":"2024-09-22T08:39:44.099982+0000","last_peered":"2024-09-22T08:39:44.099982+0000","last_clean":"2024-09-22T08:39:44.099982+0000","last_became_active":"2024-09-22T08:36:23.976646+0000","last_became_peered":"2024-09-22T08:36:23.976646+0000","last_unstale":"2024-09-22T08:39:44.099982+0000","last_undegraded":"2024-09-22T08:39:44.099982+0000","last_fullsized":"2024-09-22T08:39:44.099982+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'5","last_scrub_stamp":"2024-09-22T08:39:44.099774+0000","last_deep_scrub":"32'5","last_deep_scrub_stamp":"2024-09-22T08:39:44.099774+0000","last_clean_scrub_stamp":"2024-09-22T08:39:44.099774+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:33:07.255708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":11,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:47.416000+0000","last_change":"2024-09-22T08:39:47.415905+0000","last_active":"2024-09-22T08:39:47.416000+0000","last_peered":"2024-09-22T08:39:47.416000+0000","last_clean":"2024-09-22T08:39:47.416000+0000","last_became_active":"2024-09-22T08:36:16.638610+0000","last_became_peered":"2024-09-22T08:36:16.638610+0000","last_unstale":"2024-09-22T08:39:47.416000+0000","last_undegraded":"2024-09-22T08:39:47.416000+0000","last_fullsized":"2024-09-22T08:39:47.416000+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:39:47.415799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:39:47.415799+0000","last_clean_scrub_stamp":"2024-09-22T08:39:47.415799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:04:14.345231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001119264,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:28.591522+0000","last_change":"2024-09-22T08:40:28.591522+0000","last_active":"2024-09-22T08:40:28.591522+0000","last_peered":"2024-09-22T08:40:28.591522+0000","last_clean":"2024-09-22T08:40:28.591522+0000","last_became_active":"2024-09-22T08:36:27.984803+0000","last_became_peered":"2024-09-22T08:36:27.984803+0000","last_unstale":"2024-09-22T08:40:28.591522+0000","last_undegraded":"2024-09-22T08:40:28.591522+0000","last_fullsized":"2024-09-22T08:40:28.591522+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:28.591437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:28.591437+0000","last_clean_scrub_stamp":"2024-09-22T08:40:28.591437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:24:47.923964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"32'101","reported_seq":195,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:16.435274+0000","last_change":"2024-09-22T08:40:16.435220+0000","last_active":"2024-09-22T08:40:16.435274+0000","last_peered":"2024-09-22T08:40:16.435274+0000","last_clean":"2024-09-22T08:40:16.435274+0000","last_became_active":"2024-09-22T08:36:30.000270+0000","last_became_peered":"2024-09-22T08:36:30.000270+0000","last_unstale":"2024-09-22T08:40:16.435274+0000","last_undegraded":"2024-09-22T08:40:16.435274+0000","last_fullsized":"2024-09-22T08:40:16.435274+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'101","last_scrub_stamp":"2024-09-22T08:40:16.435123+0000","last_deep_scrub":"32'101","last_deep_scrub_stamp":"2024-09-22T08:40:16.435123+0000","last_clean_scrub_stamp":"2024-09-22T08:40:16.435123+0000","objects_scrubbed":8,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:28:38.145552+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4316,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":99,"num_read_kb":103,"num_write":38,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:26.915018+0000","last_change":"2024-09-22T08:40:26.914963+0000","last_active":"2024-09-22T08:40:26.915018+0000","last_peered":"2024-09-22T08:40:26.915018+0000","last_clean":"2024-09-22T08:40:26.915018+0000","last_became_active":"2024-09-22T08:36:32.002876+0000","last_became_peered":"2024-09-22T08:36:32.002876+0000","last_unstale":"2024-09-22T08:40:26.915018+0000","last_undegraded":"2024-09-22T08:40:26.915018+0000","last_fullsized":"2024-09-22T08:40:26.915018+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:26.914877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:26.914877+0000","last_clean_scrub_stamp":"2024-09-22T08:40:26.914877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:04:53.844309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"30'2","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:33.538128+0000","last_change":"2024-09-22T08:40:33.538060+0000","last_active":"2024-09-22T08:40:33.538128+0000","last_peered":"2024-09-22T08:40:33.538128+0000","last_clean":"2024-09-22T08:40:33.538128+0000","last_became_active":"2024-09-22T08:36:34.016659+0000","last_became_peered":"2024-09-22T08:36:34.016659+0000","last_unstale":"2024-09-22T08:40:33.538128+0000","last_undegraded":"2024-09-22T08:40:33.538128+0000","last_fullsized":"2024-09-22T08:40:33.538128+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-09-22T08:40:33.537969+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-09-22T08:40:33.537969+0000","last_clean_scrub_stamp":"2024-09-22T08:40:33.537969+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:00:46.689965+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:35.489737+0000","last_change":"2024-09-22T08:40:35.489685+0000","last_active":"2024-09-22T08:40:35.489737+0000","last_peered":"2024-09-22T08:40:35.489737+0000","last_clean":"2024-09-22T08:40:35.489737+0000","last_became_active":"2024-09-22T08:36:34.015241+0000","last_became_peered":"2024-09-22T08:36:34.015241+0000","last_unstale":"2024-09-22T08:40:35.489737+0000","last_undegraded":"2024-09-22T08:40:35.489737+0000","last_fullsized":"2024-09-22T08:40:35.489737+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:35.489579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:35.489579+0000","last_clean_scrub_stamp":"2024-09-22T08:40:35.489579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:02:26.956368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"32'4","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:59.521714+0000","last_change":"2024-09-22T08:39:59.521660+0000","last_active":"2024-09-22T08:39:59.521714+0000","last_peered":"2024-09-22T08:39:59.521714+0000","last_clean":"2024-09-22T08:39:59.521714+0000","last_became_active":"2024-09-22T08:36:25.987153+0000","last_became_peered":"2024-09-22T08:36:25.987153+0000","last_unstale":"2024-09-22T08:39:59.521714+0000","last_undegraded":"2024-09-22T08:39:59.521714+0000","last_fullsized":"2024-09-22T08:39:59.521714+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-22T08:39:59.521563+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-22T08:39:59.521563+0000","last_clean_scrub_stamp":"2024-09-22T08:39:59.521563+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:30:31.166918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:56.287978+0000","last_change":"2024-09-22T08:39:56.287922+0000","last_active":"2024-09-22T08:39:56.287978+0000","last_peered":"2024-09-22T08:39:56.287978+0000","last_clean":"2024-09-22T08:39:56.287978+0000","last_became_active":"2024-09-22T08:36:23.981927+0000","last_became_peered":"2024-09-22T08:36:23.981927+0000","last_unstale":"2024-09-22T08:39:56.287978+0000","last_undegraded":"2024-09-22T08:39:56.287978+0000","last_fullsized":"2024-09-22T08:39:56.287978+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:39:56.287818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:39:56.287818+0000","last_clean_scrub_stamp":"2024-09-22T08:39:56.287818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:00:09.674228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:22.364915+0000","last_change":"2024-09-22T08:40:22.364803+0000","last_active":"2024-09-22T08:40:22.364915+0000","last_peered":"2024-09-22T08:40:22.364915+0000","last_clean":"2024-09-22T08:40:22.364915+0000","last_became_active":"2024-09-22T08:36:27.990153+0000","last_became_peered":"2024-09-22T08:36:27.990153+0000","last_unstale":"2024-09-22T08:40:22.364915+0000","last_undegraded":"2024-09-22T08:40:22.364915+0000","last_fullsized":"2024-09-22T08:40:22.364915+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:22.364686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:22.364686+0000","last_clean_scrub_stamp":"2024-09-22T08:40:22.364686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:33:24.385016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"32'42","reported_seq":99,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:44.411488+0000","last_change":"2024-09-22T08:40:44.411407+0000","last_active":"2024-09-22T08:40:44.411488+0000","last_peered":"2024-09-22T08:40:44.411488+0000","last_clean":"2024-09-22T08:40:44.411488+0000","last_became_active":"2024-09-22T08:36:29.997814+0000","last_became_peered":"2024-09-22T08:36:29.997814+0000","last_unstale":"2024-09-22T08:40:44.411488+0000","last_undegraded":"2024-09-22T08:40:44.411488+0000","last_fullsized":"2024-09-22T08:40:44.411488+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'42","last_scrub_stamp":"2024-09-22T08:40:44.411300+0000","last_deep_scrub":"32'42","last_deep_scrub_stamp":"2024-09-22T08:40:44.411300+0000","last_clean_scrub_stamp":"2024-09-22T08:40:44.411300+0000","objects_scrubbed":5,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:19:37.169616+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":43,"num_read_kb":44,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:55.352626+0000","last_change":"2024-09-22T08:40:55.352521+0000","last_active":"2024-09-22T08:40:55.352626+0000","last_peered":"2024-09-22T08:40:55.352626+0000","last_clean":"2024-09-22T08:40:55.352626+0000","last_became_active":"2024-09-22T08:36:32.012453+0000","last_became_peered":"2024-09-22T08:36:32.012453+0000","last_unstale":"2024-09-22T08:40:55.352626+0000","last_undegraded":"2024-09-22T08:40:55.352626+0000","last_fullsized":"2024-09-22T08:40:55.352626+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:55.352418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:55.352418+0000","last_clean_scrub_stamp":"2024-09-22T08:40:55.352418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:10:08.488040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"32'3","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:44.777714+0000","last_change":"2024-09-22T08:40:44.777714+0000","last_active":"2024-09-22T08:40:44.777714+0000","last_peered":"2024-09-22T08:40:44.777714+0000","last_clean":"2024-09-22T08:40:44.777714+0000","last_became_active":"2024-09-22T08:36:34.022267+0000","last_became_peered":"2024-09-22T08:36:34.022267+0000","last_unstale":"2024-09-22T08:40:44.777714+0000","last_undegraded":"2024-09-22T08:40:44.777714+0000","last_fullsized":"2024-09-22T08:40:44.777714+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2024-09-22T08:40:44.777628+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2024-09-22T08:40:44.777628+0000","last_clean_scrub_stamp":"2024-09-22T08:40:44.777628+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:03:40.724827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"32'6","reported_seq":91,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:03.316786+0000","last_change":"2024-09-22T08:40:03.316706+0000","last_active":"2024-09-22T08:40:03.316786+0000","last_peered":"2024-09-22T08:40:03.316786+0000","last_clean":"2024-09-22T08:40:03.316786+0000","last_became_active":"2024-09-22T08:36:25.986613+0000","last_became_peered":"2024-09-22T08:36:25.986613+0000","last_unstale":"2024-09-22T08:40:03.316786+0000","last_undegraded":"2024-09-22T08:40:03.316786+0000","last_fullsized":"2024-09-22T08:40:03.316786+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-22T08:40:03.316589+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-22T08:40:03.316589+0000","last_clean_scrub_stamp":"2024-09-22T08:40:03.316589+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:37:02.558069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":60,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:49.648463+0000","last_change":"2024-09-22T08:39:49.648410+0000","last_active":"2024-09-22T08:39:49.648463+0000","last_peered":"2024-09-22T08:39:49.648463+0000","last_clean":"2024-09-22T08:39:49.648463+0000","last_became_active":"2024-09-22T08:36:23.978282+0000","last_became_peered":"2024-09-22T08:36:23.978282+0000","last_unstale":"2024-09-22T08:39:49.648463+0000","last_undegraded":"2024-09-22T08:39:49.648463+0000","last_fullsized":"2024-09-22T08:39:49.648463+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:39:49.648317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:39:49.648317+0000","last_clean_scrub_stamp":"2024-09-22T08:39:49.648317+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:38:27.168524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:35.532762+0000","last_change":"2024-09-22T08:40:35.532711+0000","last_active":"2024-09-22T08:40:35.532762+0000","last_peered":"2024-09-22T08:40:35.532762+0000","last_clean":"2024-09-22T08:40:35.532762+0000","last_became_active":"2024-09-22T08:36:27.986033+0000","last_became_peered":"2024-09-22T08:36:27.986033+0000","last_unstale":"2024-09-22T08:40:35.532762+0000","last_undegraded":"2024-09-22T08:40:35.532762+0000","last_fullsized":"2024-09-22T08:40:35.532762+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:35.532623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:35.532623+0000","last_clean_scrub_stamp":"2024-09-22T08:40:35.532623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:58:27.023727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"32'9","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:21.859866+0000","last_change":"2024-09-22T08:40:21.859767+0000","last_active":"2024-09-22T08:40:21.859866+0000","last_peered":"2024-09-22T08:40:21.859866+0000","last_clean":"2024-09-22T08:40:21.859866+0000","last_became_active":"2024-09-22T08:36:29.990057+0000","last_became_peered":"2024-09-22T08:36:29.990057+0000","last_unstale":"2024-09-22T08:40:21.859866+0000","last_undegraded":"2024-09-22T08:40:21.859866+0000","last_fullsized":"2024-09-22T08:40:21.859866+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'9","last_scrub_stamp":"2024-09-22T08:40:21.859640+0000","last_deep_scrub":"32'9","last_deep_scrub_stamp":"2024-09-22T08:40:21.859640+0000","last_clean_scrub_stamp":"2024-09-22T08:40:21.859640+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:41:06.152084+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":294,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:26.441392+0000","last_change":"2024-09-22T08:40:26.441341+0000","last_active":"2024-09-22T08:40:26.441392+0000","last_peered":"2024-09-22T08:40:26.441392+0000","last_clean":"2024-09-22T08:40:26.441392+0000","last_became_active":"2024-09-22T08:36:32.010692+0000","last_became_peered":"2024-09-22T08:36:32.010692+0000","last_unstale":"2024-09-22T08:40:26.441392+0000","last_undegraded":"2024-09-22T08:40:26.441392+0000","last_fullsized":"2024-09-22T08:40:26.441392+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:26.441238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:26.441238+0000","last_clean_scrub_stamp":"2024-09-22T08:40:26.441238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:01:55.450483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"32'8","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:45.729869+0000","last_change":"2024-09-22T08:40:45.729869+0000","last_active":"2024-09-22T08:40:45.729869+0000","last_peered":"2024-09-22T08:40:45.729869+0000","last_clean":"2024-09-22T08:40:45.729869+0000","last_became_active":"2024-09-22T08:36:34.017181+0000","last_became_peered":"2024-09-22T08:36:34.017181+0000","last_unstale":"2024-09-22T08:40:45.729869+0000","last_undegraded":"2024-09-22T08:40:45.729869+0000","last_fullsized":"2024-09-22T08:40:45.729869+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-22T08:40:45.729766+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-22T08:40:45.729766+0000","last_clean_scrub_stamp":"2024-09-22T08:40:45.729766+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:06:15.886604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":21,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"32'6","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:00.828149+0000","last_change":"2024-09-22T08:40:00.828058+0000","last_active":"2024-09-22T08:40:00.828149+0000","last_peered":"2024-09-22T08:40:00.828149+0000","last_clean":"2024-09-22T08:40:00.828149+0000","last_became_active":"2024-09-22T08:36:25.974797+0000","last_became_peered":"2024-09-22T08:36:25.974797+0000","last_unstale":"2024-09-22T08:40:00.828149+0000","last_undegraded":"2024-09-22T08:40:00.828149+0000","last_fullsized":"2024-09-22T08:40:00.828149+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-22T08:40:00.827940+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-22T08:40:00.827940+0000","last_clean_scrub_stamp":"2024-09-22T08:40:00.827940+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:40:56.353569+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:48.649683+0000","last_change":"2024-09-22T08:39:48.649611+0000","last_active":"2024-09-22T08:39:48.649683+0000","last_peered":"2024-09-22T08:39:48.649683+0000","last_clean":"2024-09-22T08:39:48.649683+0000","last_became_active":"2024-09-22T08:36:23.973601+0000","last_became_peered":"2024-09-22T08:36:23.973601+0000","last_unstale":"2024-09-22T08:39:48.649683+0000","last_undegraded":"2024-09-22T08:39:48.649683+0000","last_fullsized":"2024-09-22T08:39:48.649683+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-22T08:39:48.649523+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-22T08:39:48.649523+0000","last_clean_scrub_stamp":"2024-09-22T08:39:48.649523+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:10:59.136925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:12.389245+0000","last_change":"2024-09-22T08:40:12.389179+0000","last_active":"2024-09-22T08:40:12.389245+0000","last_peered":"2024-09-22T08:40:12.389245+0000","last_clean":"2024-09-22T08:40:12.389245+0000","last_became_active":"2024-09-22T08:36:27.986100+0000","last_became_peered":"2024-09-22T08:36:27.986100+0000","last_unstale":"2024-09-22T08:40:12.389245+0000","last_undegraded":"2024-09-22T08:40:12.389245+0000","last_fullsized":"2024-09-22T08:40:12.389245+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:12.389091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:12.389091+0000","last_clean_scrub_stamp":"2024-09-22T08:40:12.389091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:52:51.243229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"32'49","reported_seq":122,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:22.892064+0000","last_change":"2024-09-22T08:40:22.891970+0000","last_active":"2024-09-22T08:40:22.892064+0000","last_peered":"2024-09-22T08:40:22.892064+0000","last_clean":"2024-09-22T08:40:22.892064+0000","last_became_active":"2024-09-22T08:36:29.991732+0000","last_became_peered":"2024-09-22T08:36:29.991732+0000","last_unstale":"2024-09-22T08:40:22.892064+0000","last_undegraded":"2024-09-22T08:40:22.892064+0000","last_fullsized":"2024-09-22T08:40:22.892064+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'49","last_scrub_stamp":"2024-09-22T08:40:22.891866+0000","last_deep_scrub":"32'49","last_deep_scrub_stamp":"2024-09-22T08:40:22.891866+0000","last_clean_scrub_stamp":"2024-09-22T08:40:22.891866+0000","objects_scrubbed":6,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:30:36.940890+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":706,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:35.406473+0000","last_change":"2024-09-22T08:40:35.406404+0000","last_active":"2024-09-22T08:40:35.406473+0000","last_peered":"2024-09-22T08:40:35.406473+0000","last_clean":"2024-09-22T08:40:35.406473+0000","last_became_active":"2024-09-22T08:36:32.002970+0000","last_became_peered":"2024-09-22T08:36:32.002970+0000","last_unstale":"2024-09-22T08:40:35.406473+0000","last_undegraded":"2024-09-22T08:40:35.406473+0000","last_fullsized":"2024-09-22T08:40:35.406473+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:35.406305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:35.406305+0000","last_clean_scrub_stamp":"2024-09-22T08:40:35.406305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:23:45.406110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"32'5","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:41:06.255031+0000","last_change":"2024-09-22T08:41:06.255031+0000","last_active":"2024-09-22T08:41:06.255031+0000","last_peered":"2024-09-22T08:41:06.255031+0000","last_clean":"2024-09-22T08:41:06.255031+0000","last_became_active":"2024-09-22T08:36:34.016379+0000","last_became_peered":"2024-09-22T08:36:34.016379+0000","last_unstale":"2024-09-22T08:41:06.255031+0000","last_undegraded":"2024-09-22T08:41:06.255031+0000","last_fullsized":"2024-09-22T08:41:06.255031+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'5","last_scrub_stamp":"2024-09-22T08:41:06.254951+0000","last_deep_scrub":"32'5","last_deep_scrub_stamp":"2024-09-22T08:41:06.254951+0000","last_clean_scrub_stamp":"2024-09-22T08:41:06.254951+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:27:34.400679+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":421,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"32'6","reported_seq":72,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:15.475405+0000","last_change":"2024-09-22T08:40:15.475301+0000","last_active":"2024-09-22T08:40:15.475405+0000","last_peered":"2024-09-22T08:40:15.475405+0000","last_clean":"2024-09-22T08:40:15.475405+0000","last_became_active":"2024-09-22T08:36:25.988569+0000","last_became_peered":"2024-09-22T08:36:25.988569+0000","last_unstale":"2024-09-22T08:40:15.475405+0000","last_undegraded":"2024-09-22T08:40:15.475405+0000","last_fullsized":"2024-09-22T08:40:15.475405+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-22T08:40:15.475202+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-22T08:40:15.475202+0000","last_clean_scrub_stamp":"2024-09-22T08:40:15.475202+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:59:43.068621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:47.114598+0000","last_change":"2024-09-22T08:39:47.114544+0000","last_active":"2024-09-22T08:39:47.114598+0000","last_peered":"2024-09-22T08:39:47.114598+0000","last_clean":"2024-09-22T08:39:47.114598+0000","last_became_active":"2024-09-22T08:36:23.977355+0000","last_became_peered":"2024-09-22T08:36:23.977355+0000","last_unstale":"2024-09-22T08:39:47.114598+0000","last_undegraded":"2024-09-22T08:39:47.114598+0000","last_fullsized":"2024-09-22T08:39:47.114598+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:39:47.114458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:39:47.114458+0000","last_clean_scrub_stamp":"2024-09-22T08:39:47.114458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:39:28.221096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"32'5","reported_seq":239,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:33.452506+0000","last_change":"2024-09-22T08:40:33.452454+0000","last_active":"2024-09-22T08:40:33.452506+0000","last_peered":"2024-09-22T08:40:33.452506+0000","last_clean":"2024-09-22T08:40:33.452506+0000","last_became_active":"2024-09-22T08:36:27.987561+0000","last_became_peered":"2024-09-22T08:36:27.987561+0000","last_unstale":"2024-09-22T08:40:33.452506+0000","last_undegraded":"2024-09-22T08:40:33.452506+0000","last_fullsized":"2024-09-22T08:40:33.452506+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'5","last_scrub_stamp":"2024-09-22T08:40:33.452370+0000","last_deep_scrub":"32'5","last_deep_scrub_stamp":"2024-09-22T08:40:33.452370+0000","last_clean_scrub_stamp":"2024-09-22T08:40:33.452370+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:24:37.175651+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"32'38","reported_seq":94,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:20.438427+0000","last_change":"2024-09-22T08:40:20.438365+0000","last_active":"2024-09-22T08:40:20.438427+0000","last_peered":"2024-09-22T08:40:20.438427+0000","last_clean":"2024-09-22T08:40:20.438427+0000","last_became_active":"2024-09-22T08:36:29.988607+0000","last_became_peered":"2024-09-22T08:36:29.988607+0000","last_unstale":"2024-09-22T08:40:20.438427+0000","last_undegraded":"2024-09-22T08:40:20.438427+0000","last_fullsized":"2024-09-22T08:40:20.438427+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'38","last_scrub_stamp":"2024-09-22T08:40:20.438226+0000","last_deep_scrub":"32'38","last_deep_scrub_stamp":"2024-09-22T08:40:20.438226+0000","last_clean_scrub_stamp":"2024-09-22T08:40:20.438226+0000","objects_scrubbed":4,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:42:43.210584+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:27.448430+0000","last_change":"2024-09-22T08:40:27.448372+0000","last_active":"2024-09-22T08:40:27.448430+0000","last_peered":"2024-09-22T08:40:27.448430+0000","last_clean":"2024-09-22T08:40:27.448430+0000","last_became_active":"2024-09-22T08:36:32.003651+0000","last_became_peered":"2024-09-22T08:36:32.003651+0000","last_unstale":"2024-09-22T08:40:27.448430+0000","last_undegraded":"2024-09-22T08:40:27.448430+0000","last_fullsized":"2024-09-22T08:40:27.448430+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:27.448253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:27.448253+0000","last_clean_scrub_stamp":"2024-09-22T08:40:27.448253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:47:55.073492+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"32'10","reported_seq":74,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:19.534515+0000","last_change":"2024-09-22T08:40:19.534441+0000","last_active":"2024-09-22T08:40:19.534515+0000","last_peered":"2024-09-22T08:40:19.534515+0000","last_clean":"2024-09-22T08:40:19.534515+0000","last_became_active":"2024-09-22T08:36:25.989711+0000","last_became_peered":"2024-09-22T08:36:25.989711+0000","last_unstale":"2024-09-22T08:40:19.534515+0000","last_undegraded":"2024-09-22T08:40:19.534515+0000","last_fullsized":"2024-09-22T08:40:19.534515+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-09-22T08:40:19.534321+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-09-22T08:40:19.534321+0000","last_clean_scrub_stamp":"2024-09-22T08:40:19.534321+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:34:03.499705+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:57.304613+0000","last_change":"2024-09-22T08:39:57.304514+0000","last_active":"2024-09-22T08:39:57.304613+0000","last_peered":"2024-09-22T08:39:57.304613+0000","last_clean":"2024-09-22T08:39:57.304613+0000","last_became_active":"2024-09-22T08:36:23.976361+0000","last_became_peered":"2024-09-22T08:36:23.976361+0000","last_unstale":"2024-09-22T08:39:57.304613+0000","last_undegraded":"2024-09-22T08:39:57.304613+0000","last_fullsized":"2024-09-22T08:39:57.304613+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:39:57.304420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:39:57.304420+0000","last_clean_scrub_stamp":"2024-09-22T08:39:57.304420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:50:11.471353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:19.885446+0000","last_change":"2024-09-22T08:40:19.885352+0000","last_active":"2024-09-22T08:40:19.885446+0000","last_peered":"2024-09-22T08:40:19.885446+0000","last_clean":"2024-09-22T08:40:19.885446+0000","last_became_active":"2024-09-22T08:36:27.987981+0000","last_became_peered":"2024-09-22T08:36:27.987981+0000","last_unstale":"2024-09-22T08:40:19.885446+0000","last_undegraded":"2024-09-22T08:40:19.885446+0000","last_fullsized":"2024-09-22T08:40:19.885446+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:19.885257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:19.885257+0000","last_clean_scrub_stamp":"2024-09-22T08:40:19.885257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:15:54.517108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"32'66","reported_seq":139,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:24.955120+0000","last_change":"2024-09-22T08:40:24.955120+0000","last_active":"2024-09-22T08:40:24.955120+0000","last_peered":"2024-09-22T08:40:24.955120+0000","last_clean":"2024-09-22T08:40:24.955120+0000","last_became_active":"2024-09-22T08:36:29.990585+0000","last_became_peered":"2024-09-22T08:36:29.990585+0000","last_unstale":"2024-09-22T08:40:24.955120+0000","last_undegraded":"2024-09-22T08:40:24.955120+0000","last_fullsized":"2024-09-22T08:40:24.955120+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'66","last_scrub_stamp":"2024-09-22T08:40:24.955006+0000","last_deep_scrub":"32'66","last_deep_scrub_stamp":"2024-09-22T08:40:24.955006+0000","last_clean_scrub_stamp":"2024-09-22T08:40:24.955006+0000","objects_scrubbed":5,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:20:46.276335+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:28.404072+0000","last_change":"2024-09-22T08:40:28.404072+0000","last_active":"2024-09-22T08:40:28.404072+0000","last_peered":"2024-09-22T08:40:28.404072+0000","last_clean":"2024-09-22T08:40:28.404072+0000","last_became_active":"2024-09-22T08:36:32.007448+0000","last_became_peered":"2024-09-22T08:36:32.007448+0000","last_unstale":"2024-09-22T08:40:28.404072+0000","last_undegraded":"2024-09-22T08:40:28.404072+0000","last_fullsized":"2024-09-22T08:40:28.404072+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:28.403992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:28.403992+0000","last_clean_scrub_stamp":"2024-09-22T08:40:28.403992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:26:25.213830+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"32'16","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:41.820935+0000","last_change":"2024-09-22T08:40:41.820871+0000","last_active":"2024-09-22T08:40:41.820935+0000","last_peered":"2024-09-22T08:40:41.820935+0000","last_clean":"2024-09-22T08:40:41.820935+0000","last_became_active":"2024-09-22T08:36:34.017689+0000","last_became_peered":"2024-09-22T08:36:34.017689+0000","last_unstale":"2024-09-22T08:40:41.820935+0000","last_undegraded":"2024-09-22T08:40:41.820935+0000","last_fullsized":"2024-09-22T08:40:41.820935+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'16","last_scrub_stamp":"2024-09-22T08:40:41.820768+0000","last_deep_scrub":"32'16","last_deep_scrub_stamp":"2024-09-22T08:40:41.820768+0000","last_clean_scrub_stamp":"2024-09-22T08:40:41.820768+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:26:03.103006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":21,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"32'2","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:05.795426+0000","last_change":"2024-09-22T08:40:05.795366+0000","last_active":"2024-09-22T08:40:05.795426+0000","last_peered":"2024-09-22T08:40:05.795426+0000","last_clean":"2024-09-22T08:40:05.795426+0000","last_became_active":"2024-09-22T08:36:25.977881+0000","last_became_peered":"2024-09-22T08:36:25.977881+0000","last_unstale":"2024-09-22T08:40:05.795426+0000","last_undegraded":"2024-09-22T08:40:05.795426+0000","last_fullsized":"2024-09-22T08:40:05.795426+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-22T08:40:05.795277+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-22T08:40:05.795277+0000","last_clean_scrub_stamp":"2024-09-22T08:40:05.795277+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:18:12.135810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:48.136207+0000","last_change":"2024-09-22T08:39:48.136157+0000","last_active":"2024-09-22T08:39:48.136207+0000","last_peered":"2024-09-22T08:39:48.136207+0000","last_clean":"2024-09-22T08:39:48.136207+0000","last_became_active":"2024-09-22T08:36:23.974809+0000","last_became_peered":"2024-09-22T08:36:23.974809+0000","last_unstale":"2024-09-22T08:39:48.136207+0000","last_undegraded":"2024-09-22T08:39:48.136207+0000","last_fullsized":"2024-09-22T08:39:48.136207+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:39:48.136054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:39:48.136054+0000","last_clean_scrub_stamp":"2024-09-22T08:39:48.136054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:46:14.769669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:15.386385+0000","last_change":"2024-09-22T08:40:15.386312+0000","last_active":"2024-09-22T08:40:15.386385+0000","last_peered":"2024-09-22T08:40:15.386385+0000","last_clean":"2024-09-22T08:40:15.386385+0000","last_became_active":"2024-09-22T08:36:27.986957+0000","last_became_peered":"2024-09-22T08:36:27.986957+0000","last_unstale":"2024-09-22T08:40:15.386385+0000","last_undegraded":"2024-09-22T08:40:15.386385+0000","last_fullsized":"2024-09-22T08:40:15.386385+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:15.386197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:15.386197+0000","last_clean_scrub_stamp":"2024-09-22T08:40:15.386197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:59:57.699145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"32'46","reported_seq":104,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:47.442869+0000","last_change":"2024-09-22T08:40:47.442869+0000","last_active":"2024-09-22T08:40:47.442869+0000","last_peered":"2024-09-22T08:40:47.442869+0000","last_clean":"2024-09-22T08:40:47.442869+0000","last_became_active":"2024-09-22T08:36:29.997527+0000","last_became_peered":"2024-09-22T08:36:29.997527+0000","last_unstale":"2024-09-22T08:40:47.442869+0000","last_undegraded":"2024-09-22T08:40:47.442869+0000","last_fullsized":"2024-09-22T08:40:47.442869+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'46","last_scrub_stamp":"2024-09-22T08:40:47.442752+0000","last_deep_scrub":"32'46","last_deep_scrub_stamp":"2024-09-22T08:40:47.442752+0000","last_clean_scrub_stamp":"2024-09-22T08:40:47.442752+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:29:30.855402+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:38.374915+0000","last_change":"2024-09-22T08:40:38.374915+0000","last_active":"2024-09-22T08:40:38.374915+0000","last_peered":"2024-09-22T08:40:38.374915+0000","last_clean":"2024-09-22T08:40:38.374915+0000","last_became_active":"2024-09-22T08:36:32.005383+0000","last_became_peered":"2024-09-22T08:36:32.005383+0000","last_unstale":"2024-09-22T08:40:38.374915+0000","last_undegraded":"2024-09-22T08:40:38.374915+0000","last_fullsized":"2024-09-22T08:40:38.374915+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:38.374794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:38.374794+0000","last_clean_scrub_stamp":"2024-09-22T08:40:38.374794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:39:40.546159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:41:02.248202+0000","last_change":"2024-09-22T08:41:02.248132+0000","last_active":"2024-09-22T08:41:02.248202+0000","last_peered":"2024-09-22T08:41:02.248202+0000","last_clean":"2024-09-22T08:41:02.248202+0000","last_became_active":"2024-09-22T08:36:34.013204+0000","last_became_peered":"2024-09-22T08:36:34.013204+0000","last_unstale":"2024-09-22T08:41:02.248202+0000","last_undegraded":"2024-09-22T08:41:02.248202+0000","last_fullsized":"2024-09-22T08:41:02.248202+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:41:02.248050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:41:02.248050+0000","last_clean_scrub_stamp":"2024-09-22T08:41:02.248050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:38:21.762718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"32'14","reported_seq":74,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:18.502364+0000","last_change":"2024-09-22T08:40:18.502364+0000","last_active":"2024-09-22T08:40:18.502364+0000","last_peered":"2024-09-22T08:40:18.502364+0000","last_clean":"2024-09-22T08:40:18.502364+0000","last_became_active":"2024-09-22T08:36:25.993170+0000","last_became_peered":"2024-09-22T08:36:25.993170+0000","last_unstale":"2024-09-22T08:40:18.502364+0000","last_undegraded":"2024-09-22T08:40:18.502364+0000","last_fullsized":"2024-09-22T08:40:18.502364+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'14","last_scrub_stamp":"2024-09-22T08:40:18.502275+0000","last_deep_scrub":"32'14","last_deep_scrub_stamp":"2024-09-22T08:40:18.502275+0000","last_clean_scrub_stamp":"2024-09-22T08:40:18.502275+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:35:17.727896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":38,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:49.125528+0000","last_change":"2024-09-22T08:39:49.125470+0000","last_active":"2024-09-22T08:39:49.125528+0000","last_peered":"2024-09-22T08:39:49.125528+0000","last_clean":"2024-09-22T08:39:49.125528+0000","last_became_active":"2024-09-22T08:36:23.968207+0000","last_became_peered":"2024-09-22T08:36:23.968207+0000","last_unstale":"2024-09-22T08:39:49.125528+0000","last_undegraded":"2024-09-22T08:39:49.125528+0000","last_fullsized":"2024-09-22T08:39:49.125528+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:39:49.125386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:39:49.125386+0000","last_clean_scrub_stamp":"2024-09-22T08:39:49.125386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:25:13.108318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:14.421686+0000","last_change":"2024-09-22T08:40:14.421686+0000","last_active":"2024-09-22T08:40:14.421686+0000","last_peered":"2024-09-22T08:40:14.421686+0000","last_clean":"2024-09-22T08:40:14.421686+0000","last_became_active":"2024-09-22T08:36:27.985679+0000","last_became_peered":"2024-09-22T08:36:27.985679+0000","last_unstale":"2024-09-22T08:40:14.421686+0000","last_undegraded":"2024-09-22T08:40:14.421686+0000","last_fullsized":"2024-09-22T08:40:14.421686+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:14.421600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:14.421600+0000","last_clean_scrub_stamp":"2024-09-22T08:40:14.421600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:31:50.278835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"32'40","reported_seq":97,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:25.947666+0000","last_change":"2024-09-22T08:40:25.947562+0000","last_active":"2024-09-22T08:40:25.947666+0000","last_peered":"2024-09-22T08:40:25.947666+0000","last_clean":"2024-09-22T08:40:25.947666+0000","last_became_active":"2024-09-22T08:36:29.994075+0000","last_became_peered":"2024-09-22T08:36:29.994075+0000","last_unstale":"2024-09-22T08:40:25.947666+0000","last_undegraded":"2024-09-22T08:40:25.947666+0000","last_fullsized":"2024-09-22T08:40:25.947666+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'40","last_scrub_stamp":"2024-09-22T08:40:25.947455+0000","last_deep_scrub":"32'40","last_deep_scrub_stamp":"2024-09-22T08:40:25.947455+0000","last_clean_scrub_stamp":"2024-09-22T08:40:25.947455+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:02:20.505829+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:36.806341+0000","last_change":"2024-09-22T08:40:36.806341+0000","last_active":"2024-09-22T08:40:36.806341+0000","last_peered":"2024-09-22T08:40:36.806341+0000","last_clean":"2024-09-22T08:40:36.806341+0000","last_became_active":"2024-09-22T08:36:32.005166+0000","last_became_peered":"2024-09-22T08:36:32.005166+0000","last_unstale":"2024-09-22T08:40:36.806341+0000","last_undegraded":"2024-09-22T08:40:36.806341+0000","last_fullsized":"2024-09-22T08:40:36.806341+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:36.806254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:36.806254+0000","last_clean_scrub_stamp":"2024-09-22T08:40:36.806254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:50:50.973187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"32'7","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:41:01.288805+0000","last_change":"2024-09-22T08:41:01.288745+0000","last_active":"2024-09-22T08:41:01.288805+0000","last_peered":"2024-09-22T08:41:01.288805+0000","last_clean":"2024-09-22T08:41:01.288805+0000","last_became_active":"2024-09-22T08:36:34.014255+0000","last_became_peered":"2024-09-22T08:36:34.014255+0000","last_unstale":"2024-09-22T08:41:01.288805+0000","last_undegraded":"2024-09-22T08:41:01.288805+0000","last_fullsized":"2024-09-22T08:41:01.288805+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'7","last_scrub_stamp":"2024-09-22T08:41:01.288659+0000","last_deep_scrub":"32'7","last_deep_scrub_stamp":"2024-09-22T08:41:01.288659+0000","last_clean_scrub_stamp":"2024-09-22T08:41:01.288659+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:25:46.529269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"32'4","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:03.793636+0000","last_change":"2024-09-22T08:40:03.793636+0000","last_active":"2024-09-22T08:40:03.793636+0000","last_peered":"2024-09-22T08:40:03.793636+0000","last_clean":"2024-09-22T08:40:03.793636+0000","last_became_active":"2024-09-22T08:36:25.978577+0000","last_became_peered":"2024-09-22T08:36:25.978577+0000","last_unstale":"2024-09-22T08:40:03.793636+0000","last_undegraded":"2024-09-22T08:40:03.793636+0000","last_fullsized":"2024-09-22T08:40:03.793636+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-22T08:40:03.793512+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-22T08:40:03.793512+0000","last_clean_scrub_stamp":"2024-09-22T08:40:03.793512+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:00:34.051924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"32'2","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:48.833986+0000","last_change":"2024-09-22T08:39:48.833986+0000","last_active":"2024-09-22T08:39:48.833986+0000","last_peered":"2024-09-22T08:39:48.833986+0000","last_clean":"2024-09-22T08:39:48.833986+0000","last_became_active":"2024-09-22T08:37:04.226169+0000","last_became_peered":"2024-09-22T08:37:04.226169+0000","last_unstale":"2024-09-22T08:39:48.833986+0000","last_undegraded":"2024-09-22T08:39:48.833986+0000","last_fullsized":"2024-09-22T08:39:48.833986+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-22T08:39:48.833881+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-22T08:39:48.833881+0000","last_clean_scrub_stamp":"2024-09-22T08:39:48.833881+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:03:32.581894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:26.336878+0000","last_change":"2024-09-22T08:40:26.336878+0000","last_active":"2024-09-22T08:40:26.336878+0000","last_peered":"2024-09-22T08:40:26.336878+0000","last_clean":"2024-09-22T08:40:26.336878+0000","last_became_active":"2024-09-22T08:36:27.990038+0000","last_became_peered":"2024-09-22T08:36:27.990038+0000","last_unstale":"2024-09-22T08:40:26.336878+0000","last_undegraded":"2024-09-22T08:40:26.336878+0000","last_fullsized":"2024-09-22T08:40:26.336878+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:26.336763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:26.336763+0000","last_clean_scrub_stamp":"2024-09-22T08:40:26.336763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:50:41.991119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"32'15","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:49.492228+0000","last_change":"2024-09-22T08:40:49.492228+0000","last_active":"2024-09-22T08:40:49.492228+0000","last_peered":"2024-09-22T08:40:49.492228+0000","last_clean":"2024-09-22T08:40:49.492228+0000","last_became_active":"2024-09-22T08:36:29.997179+0000","last_became_peered":"2024-09-22T08:36:29.997179+0000","last_unstale":"2024-09-22T08:40:49.492228+0000","last_undegraded":"2024-09-22T08:40:49.492228+0000","last_fullsized":"2024-09-22T08:40:49.492228+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'15","last_scrub_stamp":"2024-09-22T08:40:49.492140+0000","last_deep_scrub":"32'15","last_deep_scrub_stamp":"2024-09-22T08:40:49.492140+0000","last_clean_scrub_stamp":"2024-09-22T08:40:49.492140+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:36:10.074437+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"32'286","reported_seq":379,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:29.435937+0000","last_change":"2024-09-22T08:40:29.435880+0000","last_active":"2024-09-22T08:40:29.435937+0000","last_peered":"2024-09-22T08:40:29.435937+0000","last_clean":"2024-09-22T08:40:29.435937+0000","last_became_active":"2024-09-22T08:36:32.011870+0000","last_became_peered":"2024-09-22T08:36:32.011870+0000","last_unstale":"2024-09-22T08:40:29.435937+0000","last_undegraded":"2024-09-22T08:40:29.435937+0000","last_fullsized":"2024-09-22T08:40:29.435937+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'286","last_scrub_stamp":"2024-09-22T08:40:29.435778+0000","last_deep_scrub":"32'286","last_deep_scrub_stamp":"2024-09-22T08:40:29.435778+0000","last_clean_scrub_stamp":"2024-09-22T08:40:29.435778+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:37:13.038460+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"32'2","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:59.325183+0000","last_change":"2024-09-22T08:40:59.325117+0000","last_active":"2024-09-22T08:40:59.325183+0000","last_peered":"2024-09-22T08:40:59.325183+0000","last_clean":"2024-09-22T08:40:59.325183+0000","last_became_active":"2024-09-22T08:36:34.013380+0000","last_became_peered":"2024-09-22T08:36:34.013380+0000","last_unstale":"2024-09-22T08:40:59.325183+0000","last_undegraded":"2024-09-22T08:40:59.325183+0000","last_fullsized":"2024-09-22T08:40:59.325183+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-22T08:40:59.325010+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-22T08:40:59.325010+0000","last_clean_scrub_stamp":"2024-09-22T08:40:59.325010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:40:37.489726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"32'8","reported_seq":66,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:07.397500+0000","last_change":"2024-09-22T08:40:07.397444+0000","last_active":"2024-09-22T08:40:07.397500+0000","last_peered":"2024-09-22T08:40:07.397500+0000","last_clean":"2024-09-22T08:40:07.397500+0000","last_became_active":"2024-09-22T08:36:25.971327+0000","last_became_peered":"2024-09-22T08:36:25.971327+0000","last_unstale":"2024-09-22T08:40:07.397500+0000","last_undegraded":"2024-09-22T08:40:07.397500+0000","last_fullsized":"2024-09-22T08:40:07.397500+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-22T08:40:07.397356+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-22T08:40:07.397356+0000","last_clean_scrub_stamp":"2024-09-22T08:40:07.397356+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:37:27.086026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"32'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:50.110088+0000","last_change":"2024-09-22T08:39:50.109978+0000","last_active":"2024-09-22T08:39:50.110088+0000","last_peered":"2024-09-22T08:39:50.110088+0000","last_clean":"2024-09-22T08:39:50.110088+0000","last_became_active":"2024-09-22T08:36:23.978006+0000","last_became_peered":"2024-09-22T08:36:23.978006+0000","last_unstale":"2024-09-22T08:39:50.110088+0000","last_undegraded":"2024-09-22T08:39:50.110088+0000","last_fullsized":"2024-09-22T08:39:50.110088+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-22T08:39:50.109878+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-22T08:39:50.109878+0000","last_clean_scrub_stamp":"2024-09-22T08:39:50.109878+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:37:09.798548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:25.344973+0000","last_change":"2024-09-22T08:40:25.344973+0000","last_active":"2024-09-22T08:40:25.344973+0000","last_peered":"2024-09-22T08:40:25.344973+0000","last_clean":"2024-09-22T08:40:25.344973+0000","last_became_active":"2024-09-22T08:36:27.990729+0000","last_became_peered":"2024-09-22T08:36:27.990729+0000","last_unstale":"2024-09-22T08:40:25.344973+0000","last_undegraded":"2024-09-22T08:40:25.344973+0000","last_fullsized":"2024-09-22T08:40:25.344973+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:25.344883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:25.344883+0000","last_clean_scrub_stamp":"2024-09-22T08:40:25.344883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:33:42.396651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"32'46","reported_seq":105,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:32.421361+0000","last_change":"2024-09-22T08:40:32.421298+0000","last_active":"2024-09-22T08:40:32.421361+0000","last_peered":"2024-09-22T08:40:32.421361+0000","last_clean":"2024-09-22T08:40:32.421361+0000","last_became_active":"2024-09-22T08:36:29.987459+0000","last_became_peered":"2024-09-22T08:36:29.987459+0000","last_unstale":"2024-09-22T08:40:32.421361+0000","last_undegraded":"2024-09-22T08:40:32.421361+0000","last_fullsized":"2024-09-22T08:40:32.421361+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'46","last_scrub_stamp":"2024-09-22T08:40:32.421206+0000","last_deep_scrub":"32'46","last_deep_scrub_stamp":"2024-09-22T08:40:32.421206+0000","last_clean_scrub_stamp":"2024-09-22T08:40:32.421206+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:39:14.508488+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:35.766486+0000","last_change":"2024-09-22T08:40:35.766418+0000","last_active":"2024-09-22T08:40:35.766486+0000","last_peered":"2024-09-22T08:40:35.766486+0000","last_clean":"2024-09-22T08:40:35.766486+0000","last_became_active":"2024-09-22T08:36:32.003196+0000","last_became_peered":"2024-09-22T08:36:32.003196+0000","last_unstale":"2024-09-22T08:40:35.766486+0000","last_undegraded":"2024-09-22T08:40:35.766486+0000","last_fullsized":"2024-09-22T08:40:35.766486+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:35.766331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:35.766331+0000","last_clean_scrub_stamp":"2024-09-22T08:40:35.766331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:55:51.742750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:44.378307+0000","last_change":"2024-09-22T08:40:44.378252+0000","last_active":"2024-09-22T08:40:44.378307+0000","last_peered":"2024-09-22T08:40:44.378307+0000","last_clean":"2024-09-22T08:40:44.378307+0000","last_became_active":"2024-09-22T08:36:34.015988+0000","last_became_peered":"2024-09-22T08:36:34.015988+0000","last_unstale":"2024-09-22T08:40:44.378307+0000","last_undegraded":"2024-09-22T08:40:44.378307+0000","last_fullsized":"2024-09-22T08:40:44.378307+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:44.378167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:44.378167+0000","last_clean_scrub_stamp":"2024-09-22T08:40:44.378167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:06:28.539501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"32'4","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:03.357477+0000","last_change":"2024-09-22T08:40:03.357413+0000","last_active":"2024-09-22T08:40:03.357477+0000","last_peered":"2024-09-22T08:40:03.357477+0000","last_clean":"2024-09-22T08:40:03.357477+0000","last_became_active":"2024-09-22T08:36:25.972149+0000","last_became_peered":"2024-09-22T08:36:25.972149+0000","last_unstale":"2024-09-22T08:40:03.357477+0000","last_undegraded":"2024-09-22T08:40:03.357477+0000","last_fullsized":"2024-09-22T08:40:03.357477+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-22T08:40:03.357323+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-22T08:40:03.357323+0000","last_clean_scrub_stamp":"2024-09-22T08:40:03.357323+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:00:50.517267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"32'2","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:59.302310+0000","last_change":"2024-09-22T08:39:59.302310+0000","last_active":"2024-09-22T08:39:59.302310+0000","last_peered":"2024-09-22T08:39:59.302310+0000","last_clean":"2024-09-22T08:39:59.302310+0000","last_became_active":"2024-09-22T08:36:23.982545+0000","last_became_peered":"2024-09-22T08:36:23.982545+0000","last_unstale":"2024-09-22T08:39:59.302310+0000","last_undegraded":"2024-09-22T08:39:59.302310+0000","last_fullsized":"2024-09-22T08:39:59.302310+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-22T08:39:59.302226+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-22T08:39:59.302226+0000","last_clean_scrub_stamp":"2024-09-22T08:39:59.302226+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:17:21.833960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:13.410180+0000","last_change":"2024-09-22T08:40:13.410180+0000","last_active":"2024-09-22T08:40:13.410180+0000","last_peered":"2024-09-22T08:40:13.410180+0000","last_clean":"2024-09-22T08:40:13.410180+0000","last_became_active":"2024-09-22T08:36:27.989495+0000","last_became_peered":"2024-09-22T08:36:27.989495+0000","last_unstale":"2024-09-22T08:40:13.410180+0000","last_undegraded":"2024-09-22T08:40:13.410180+0000","last_fullsized":"2024-09-22T08:40:13.410180+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:13.410093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:13.410093+0000","last_clean_scrub_stamp":"2024-09-22T08:40:13.410093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:27:10.709987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"32'37","reported_seq":93,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:23.938982+0000","last_change":"2024-09-22T08:40:23.938924+0000","last_active":"2024-09-22T08:40:23.938982+0000","last_peered":"2024-09-22T08:40:23.938982+0000","last_clean":"2024-09-22T08:40:23.938982+0000","last_became_active":"2024-09-22T08:36:29.994101+0000","last_became_peered":"2024-09-22T08:36:29.994101+0000","last_unstale":"2024-09-22T08:40:23.938982+0000","last_undegraded":"2024-09-22T08:40:23.938982+0000","last_fullsized":"2024-09-22T08:40:23.938982+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'37","last_scrub_stamp":"2024-09-22T08:40:23.938814+0000","last_deep_scrub":"32'37","last_deep_scrub_stamp":"2024-09-22T08:40:23.938814+0000","last_clean_scrub_stamp":"2024-09-22T08:40:23.938814+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:23:37.032961+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:53.360845+0000","last_change":"2024-09-22T08:40:53.360782+0000","last_active":"2024-09-22T08:40:53.360845+0000","last_peered":"2024-09-22T08:40:53.360845+0000","last_clean":"2024-09-22T08:40:53.360845+0000","last_became_active":"2024-09-22T08:36:32.011811+0000","last_became_peered":"2024-09-22T08:36:32.011811+0000","last_unstale":"2024-09-22T08:40:53.360845+0000","last_undegraded":"2024-09-22T08:40:53.360845+0000","last_fullsized":"2024-09-22T08:40:53.360845+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:53.360697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:53.360697+0000","last_clean_scrub_stamp":"2024-09-22T08:40:53.360697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:28:06.175087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"32'2","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:41:04.244426+0000","last_change":"2024-09-22T08:41:04.244350+0000","last_active":"2024-09-22T08:41:04.244426+0000","last_peered":"2024-09-22T08:41:04.244426+0000","last_clean":"2024-09-22T08:41:04.244426+0000","last_became_active":"2024-09-22T08:36:34.019866+0000","last_became_peered":"2024-09-22T08:36:34.019866+0000","last_unstale":"2024-09-22T08:41:04.244426+0000","last_undegraded":"2024-09-22T08:41:04.244426+0000","last_fullsized":"2024-09-22T08:41:04.244426+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-22T08:41:04.244261+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-22T08:41:04.244261+0000","last_clean_scrub_stamp":"2024-09-22T08:41:04.244261+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:58:00.459015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"32'2","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:17.499403+0000","last_change":"2024-09-22T08:40:17.499349+0000","last_active":"2024-09-22T08:40:17.499403+0000","last_peered":"2024-09-22T08:40:17.499403+0000","last_clean":"2024-09-22T08:40:17.499403+0000","last_became_active":"2024-09-22T08:36:25.989572+0000","last_became_peered":"2024-09-22T08:36:25.989572+0000","last_unstale":"2024-09-22T08:40:17.499403+0000","last_undegraded":"2024-09-22T08:40:17.499403+0000","last_fullsized":"2024-09-22T08:40:17.499403+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-22T08:40:17.499263+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-22T08:40:17.499263+0000","last_clean_scrub_stamp":"2024-09-22T08:40:17.499263+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:38:33.473092+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:49.815548+0000","last_change":"2024-09-22T08:39:49.815491+0000","last_active":"2024-09-22T08:39:49.815548+0000","last_peered":"2024-09-22T08:39:49.815548+0000","last_clean":"2024-09-22T08:39:49.815548+0000","last_became_active":"2024-09-22T08:36:23.971012+0000","last_became_peered":"2024-09-22T08:36:23.971012+0000","last_unstale":"2024-09-22T08:39:49.815548+0000","last_undegraded":"2024-09-22T08:39:49.815548+0000","last_fullsized":"2024-09-22T08:39:49.815548+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:39:49.815399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:39:49.815399+0000","last_clean_scrub_stamp":"2024-09-22T08:39:49.815399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:29:53.053729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:23.378640+0000","last_change":"2024-09-22T08:40:23.378577+0000","last_active":"2024-09-22T08:40:23.378640+0000","last_peered":"2024-09-22T08:40:23.378640+0000","last_clean":"2024-09-22T08:40:23.378640+0000","last_became_active":"2024-09-22T08:36:27.987504+0000","last_became_peered":"2024-09-22T08:36:27.987504+0000","last_unstale":"2024-09-22T08:40:23.378640+0000","last_undegraded":"2024-09-22T08:40:23.378640+0000","last_fullsized":"2024-09-22T08:40:23.378640+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:23.378462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:23.378462+0000","last_clean_scrub_stamp":"2024-09-22T08:40:23.378462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:30:23.702772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"32'31","reported_seq":84,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:46.458307+0000","last_change":"2024-09-22T08:40:46.458307+0000","last_active":"2024-09-22T08:40:46.458307+0000","last_peered":"2024-09-22T08:40:46.458307+0000","last_clean":"2024-09-22T08:40:46.458307+0000","last_became_active":"2024-09-22T08:36:29.997853+0000","last_became_peered":"2024-09-22T08:36:29.997853+0000","last_unstale":"2024-09-22T08:40:46.458307+0000","last_undegraded":"2024-09-22T08:40:46.458307+0000","last_fullsized":"2024-09-22T08:40:46.458307+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'31","last_scrub_stamp":"2024-09-22T08:40:46.458224+0000","last_deep_scrub":"32'31","last_deep_scrub_stamp":"2024-09-22T08:40:46.458224+0000","last_clean_scrub_stamp":"2024-09-22T08:40:46.458224+0000","objects_scrubbed":2,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:22:46.084894+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:54.395246+0000","last_change":"2024-09-22T08:40:54.395246+0000","last_active":"2024-09-22T08:40:54.395246+0000","last_peered":"2024-09-22T08:40:54.395246+0000","last_clean":"2024-09-22T08:40:54.395246+0000","last_became_active":"2024-09-22T08:36:32.011960+0000","last_became_peered":"2024-09-22T08:36:32.011960+0000","last_unstale":"2024-09-22T08:40:54.395246+0000","last_undegraded":"2024-09-22T08:40:54.395246+0000","last_fullsized":"2024-09-22T08:40:54.395246+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:54.395141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:54.395141+0000","last_clean_scrub_stamp":"2024-09-22T08:40:54.395141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:45:09.894926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"32'16","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:41:05.262972+0000","last_change":"2024-09-22T08:41:05.262910+0000","last_active":"2024-09-22T08:41:05.262972+0000","last_peered":"2024-09-22T08:41:05.262972+0000","last_clean":"2024-09-22T08:41:05.262972+0000","last_became_active":"2024-09-22T08:36:34.018365+0000","last_became_peered":"2024-09-22T08:36:34.018365+0000","last_unstale":"2024-09-22T08:41:05.262972+0000","last_undegraded":"2024-09-22T08:41:05.262972+0000","last_fullsized":"2024-09-22T08:41:05.262972+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'16","last_scrub_stamp":"2024-09-22T08:41:05.262811+0000","last_deep_scrub":"32'16","last_deep_scrub_stamp":"2024-09-22T08:41:05.262811+0000","last_clean_scrub_stamp":"2024-09-22T08:41:05.262811+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:53:58.081179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":96,"num_read_kb":76,"num_write":46,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"32'8","reported_seq":66,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:02.399330+0000","last_change":"2024-09-22T08:40:02.399251+0000","last_active":"2024-09-22T08:40:02.399330+0000","last_peered":"2024-09-22T08:40:02.399330+0000","last_clean":"2024-09-22T08:40:02.399330+0000","last_became_active":"2024-09-22T08:36:25.973089+0000","last_became_peered":"2024-09-22T08:36:25.973089+0000","last_unstale":"2024-09-22T08:40:02.399330+0000","last_undegraded":"2024-09-22T08:40:02.399330+0000","last_fullsized":"2024-09-22T08:40:02.399330+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-22T08:40:02.399133+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-22T08:40:02.399133+0000","last_clean_scrub_stamp":"2024-09-22T08:40:02.399133+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:04:36.042470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:51.157044+0000","last_change":"2024-09-22T08:39:51.156994+0000","last_active":"2024-09-22T08:39:51.157044+0000","last_peered":"2024-09-22T08:39:51.157044+0000","last_clean":"2024-09-22T08:39:51.157044+0000","last_became_active":"2024-09-22T08:36:23.968249+0000","last_became_peered":"2024-09-22T08:36:23.968249+0000","last_unstale":"2024-09-22T08:39:51.157044+0000","last_undegraded":"2024-09-22T08:39:51.157044+0000","last_fullsized":"2024-09-22T08:39:51.157044+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-22T08:39:51.156910+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-22T08:39:51.156910+0000","last_clean_scrub_stamp":"2024-09-22T08:39:51.156910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:55:37.836983+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"32'3","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:24.334543+0000","last_change":"2024-09-22T08:40:24.334465+0000","last_active":"2024-09-22T08:40:24.334543+0000","last_peered":"2024-09-22T08:40:24.334543+0000","last_clean":"2024-09-22T08:40:24.334543+0000","last_became_active":"2024-09-22T08:36:27.988262+0000","last_became_peered":"2024-09-22T08:36:27.988262+0000","last_unstale":"2024-09-22T08:40:24.334543+0000","last_undegraded":"2024-09-22T08:40:24.334543+0000","last_fullsized":"2024-09-22T08:40:24.334543+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2024-09-22T08:40:24.334357+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2024-09-22T08:40:24.334357+0000","last_clean_scrub_stamp":"2024-09-22T08:40:24.334357+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:51:02.384626+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"32'40","reported_seq":97,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:48.479366+0000","last_change":"2024-09-22T08:40:48.479366+0000","last_active":"2024-09-22T08:40:48.479366+0000","last_peered":"2024-09-22T08:40:48.479366+0000","last_clean":"2024-09-22T08:40:48.479366+0000","last_became_active":"2024-09-22T08:36:29.997231+0000","last_became_peered":"2024-09-22T08:36:29.997231+0000","last_unstale":"2024-09-22T08:40:48.479366+0000","last_undegraded":"2024-09-22T08:40:48.479366+0000","last_fullsized":"2024-09-22T08:40:48.479366+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'40","last_scrub_stamp":"2024-09-22T08:40:48.479270+0000","last_deep_scrub":"32'40","last_deep_scrub_stamp":"2024-09-22T08:40:48.479270+0000","last_clean_scrub_stamp":"2024-09-22T08:40:48.479270+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:27:30.586401+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1270,"num_omap_keys":6,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:39.811332+0000","last_change":"2024-09-22T08:40:39.811332+0000","last_active":"2024-09-22T08:40:39.811332+0000","last_peered":"2024-09-22T08:40:39.811332+0000","last_clean":"2024-09-22T08:40:39.811332+0000","last_became_active":"2024-09-22T08:36:32.004365+0000","last_became_peered":"2024-09-22T08:36:32.004365+0000","last_unstale":"2024-09-22T08:40:39.811332+0000","last_undegraded":"2024-09-22T08:40:39.811332+0000","last_fullsized":"2024-09-22T08:40:39.811332+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:39.811245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:39.811245+0000","last_clean_scrub_stamp":"2024-09-22T08:40:39.811245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:37:48.980763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"32'4","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:41:03.248360+0000","last_change":"2024-09-22T08:41:03.248285+0000","last_active":"2024-09-22T08:41:03.248360+0000","last_peered":"2024-09-22T08:41:03.248360+0000","last_clean":"2024-09-22T08:41:03.248360+0000","last_became_active":"2024-09-22T08:36:34.016106+0000","last_became_peered":"2024-09-22T08:36:34.016106+0000","last_unstale":"2024-09-22T08:41:03.248360+0000","last_undegraded":"2024-09-22T08:41:03.248360+0000","last_fullsized":"2024-09-22T08:41:03.248360+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-22T08:41:03.248165+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-22T08:41:03.248165+0000","last_clean_scrub_stamp":"2024-09-22T08:41:03.248165+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:16:09.959015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"32'12","reported_seq":79,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:06.403652+0000","last_change":"2024-09-22T08:40:06.403598+0000","last_active":"2024-09-22T08:40:06.403652+0000","last_peered":"2024-09-22T08:40:06.403652+0000","last_clean":"2024-09-22T08:40:06.403652+0000","last_became_active":"2024-09-22T08:36:25.987161+0000","last_became_peered":"2024-09-22T08:36:25.987161+0000","last_unstale":"2024-09-22T08:40:06.403652+0000","last_undegraded":"2024-09-22T08:40:06.403652+0000","last_fullsized":"2024-09-22T08:40:06.403652+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-09-22T08:40:06.403521+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-09-22T08:40:06.403521+0000","last_clean_scrub_stamp":"2024-09-22T08:40:06.403521+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:26:49.349866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:51.626331+0000","last_change":"2024-09-22T08:39:51.626242+0000","last_active":"2024-09-22T08:39:51.626331+0000","last_peered":"2024-09-22T08:39:51.626331+0000","last_clean":"2024-09-22T08:39:51.626331+0000","last_became_active":"2024-09-22T08:36:23.969515+0000","last_became_peered":"2024-09-22T08:36:23.969515+0000","last_unstale":"2024-09-22T08:39:51.626331+0000","last_undegraded":"2024-09-22T08:39:51.626331+0000","last_fullsized":"2024-09-22T08:39:51.626331+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:39:51.626108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:39:51.626108+0000","last_clean_scrub_stamp":"2024-09-22T08:39:51.626108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:12:42.258599+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"32'12","reported_seq":73,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:07.850131+0000","last_change":"2024-09-22T08:40:07.850074+0000","last_active":"2024-09-22T08:40:07.850131+0000","last_peered":"2024-09-22T08:40:07.850131+0000","last_clean":"2024-09-22T08:40:07.850131+0000","last_became_active":"2024-09-22T08:36:25.978679+0000","last_became_peered":"2024-09-22T08:36:25.978679+0000","last_unstale":"2024-09-22T08:40:07.850131+0000","last_undegraded":"2024-09-22T08:40:07.850131+0000","last_fullsized":"2024-09-22T08:40:07.850131+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-09-22T08:40:07.849968+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-09-22T08:40:07.849968+0000","last_clean_scrub_stamp":"2024-09-22T08:40:07.849968+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:50:10.705568+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:50.767547+0000","last_change":"2024-09-22T08:39:50.767473+0000","last_active":"2024-09-22T08:39:50.767547+0000","last_peered":"2024-09-22T08:39:50.767547+0000","last_clean":"2024-09-22T08:39:50.767547+0000","last_became_active":"2024-09-22T08:36:23.970218+0000","last_became_peered":"2024-09-22T08:36:23.970218+0000","last_unstale":"2024-09-22T08:39:50.767547+0000","last_undegraded":"2024-09-22T08:39:50.767547+0000","last_fullsized":"2024-09-22T08:39:50.767547+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-22T08:39:50.767366+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-22T08:39:50.767366+0000","last_clean_scrub_stamp":"2024-09-22T08:39:50.767366+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:50:42.858238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"32'12","reported_seq":68,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:20.546338+0000","last_change":"2024-09-22T08:40:20.546264+0000","last_active":"2024-09-22T08:40:20.546338+0000","last_peered":"2024-09-22T08:40:20.546338+0000","last_clean":"2024-09-22T08:40:20.546338+0000","last_became_active":"2024-09-22T08:36:25.989638+0000","last_became_peered":"2024-09-22T08:36:25.989638+0000","last_unstale":"2024-09-22T08:40:20.546338+0000","last_undegraded":"2024-09-22T08:40:20.546338+0000","last_fullsized":"2024-09-22T08:40:20.546338+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-09-22T08:40:20.546161+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-09-22T08:40:20.546161+0000","last_clean_scrub_stamp":"2024-09-22T08:40:20.546161+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:20:45.107609+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":33,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:58.317648+0000","last_change":"2024-09-22T08:39:58.317577+0000","last_active":"2024-09-22T08:39:58.317648+0000","last_peered":"2024-09-22T08:39:58.317648+0000","last_clean":"2024-09-22T08:39:58.317648+0000","last_became_active":"2024-09-22T08:36:23.972582+0000","last_became_peered":"2024-09-22T08:36:23.972582+0000","last_unstale":"2024-09-22T08:39:58.317648+0000","last_undegraded":"2024-09-22T08:39:58.317648+0000","last_fullsized":"2024-09-22T08:39:58.317648+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:39:58.317493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:39:58.317493+0000","last_clean_scrub_stamp":"2024-09-22T08:39:58.317493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:30:33.805756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:06.836874+0000","last_change":"2024-09-22T08:40:06.836804+0000","last_active":"2024-09-22T08:40:06.836874+0000","last_peered":"2024-09-22T08:40:06.836874+0000","last_clean":"2024-09-22T08:40:06.836874+0000","last_became_active":"2024-09-22T08:36:25.978538+0000","last_became_peered":"2024-09-22T08:36:25.978538+0000","last_unstale":"2024-09-22T08:40:06.836874+0000","last_undegraded":"2024-09-22T08:40:06.836874+0000","last_fullsized":"2024-09-22T08:40:06.836874+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:06.836699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:06.836699+0000","last_clean_scrub_stamp":"2024-09-22T08:40:06.836699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:16:11.004999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:51.809328+0000","last_change":"2024-09-22T08:39:51.809249+0000","last_active":"2024-09-22T08:39:51.809328+0000","last_peered":"2024-09-22T08:39:51.809328+0000","last_clean":"2024-09-22T08:39:51.809328+0000","last_became_active":"2024-09-22T08:36:23.973945+0000","last_became_peered":"2024-09-22T08:36:23.973945+0000","last_unstale":"2024-09-22T08:39:51.809328+0000","last_undegraded":"2024-09-22T08:39:51.809328+0000","last_fullsized":"2024-09-22T08:39:51.809328+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:39:51.809165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:39:51.809165+0000","last_clean_scrub_stamp":"2024-09-22T08:39:51.809165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:41:14.543135+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"32'2","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:09.879496+0000","last_change":"2024-09-22T08:40:09.879440+0000","last_active":"2024-09-22T08:40:09.879496+0000","last_peered":"2024-09-22T08:40:09.879496+0000","last_clean":"2024-09-22T08:40:09.879496+0000","last_became_active":"2024-09-22T08:36:25.984094+0000","last_became_peered":"2024-09-22T08:36:25.984094+0000","last_unstale":"2024-09-22T08:40:09.879496+0000","last_undegraded":"2024-09-22T08:40:09.879496+0000","last_fullsized":"2024-09-22T08:40:09.879496+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-22T08:40:09.879355+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-22T08:40:09.879355+0000","last_clean_scrub_stamp":"2024-09-22T08:40:09.879355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:15:19.787347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:52.813940+0000","last_change":"2024-09-22T08:39:52.813867+0000","last_active":"2024-09-22T08:39:52.813940+0000","last_peered":"2024-09-22T08:39:52.813940+0000","last_clean":"2024-09-22T08:39:52.813940+0000","last_became_active":"2024-09-22T08:36:23.970920+0000","last_became_peered":"2024-09-22T08:36:23.970920+0000","last_unstale":"2024-09-22T08:39:52.813940+0000","last_undegraded":"2024-09-22T08:39:52.813940+0000","last_fullsized":"2024-09-22T08:39:52.813940+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-22T08:39:52.813773+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-22T08:39:52.813773+0000","last_clean_scrub_stamp":"2024-09-22T08:39:52.813773+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:32:25.388534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"32'12","reported_seq":78,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:05.355128+0000","last_change":"2024-09-22T08:40:05.355078+0000","last_active":"2024-09-22T08:40:05.355128+0000","last_peered":"2024-09-22T08:40:05.355128+0000","last_clean":"2024-09-22T08:40:05.355128+0000","last_became_active":"2024-09-22T08:36:25.985965+0000","last_became_peered":"2024-09-22T08:36:25.985965+0000","last_unstale":"2024-09-22T08:40:05.355128+0000","last_undegraded":"2024-09-22T08:40:05.355128+0000","last_fullsized":"2024-09-22T08:40:05.355128+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-09-22T08:40:05.354995+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-09-22T08:40:05.354995+0000","last_clean_scrub_stamp":"2024-09-22T08:40:05.354995+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:08:14.083131+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":11,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:52.189303+0000","last_change":"2024-09-22T08:39:52.189228+0000","last_active":"2024-09-22T08:39:52.189303+0000","last_peered":"2024-09-22T08:39:52.189303+0000","last_clean":"2024-09-22T08:39:52.189303+0000","last_became_active":"2024-09-22T08:36:23.983722+0000","last_became_peered":"2024-09-22T08:36:23.983722+0000","last_unstale":"2024-09-22T08:39:52.189303+0000","last_undegraded":"2024-09-22T08:39:52.189303+0000","last_fullsized":"2024-09-22T08:39:52.189303+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:39:52.189117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:39:52.189117+0000","last_clean_scrub_stamp":"2024-09-22T08:39:52.189117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:49:51.464801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"32'4","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:04.756500+0000","last_change":"2024-09-22T08:40:04.756446+0000","last_active":"2024-09-22T08:40:04.756500+0000","last_peered":"2024-09-22T08:40:04.756500+0000","last_clean":"2024-09-22T08:40:04.756500+0000","last_became_active":"2024-09-22T08:36:25.983061+0000","last_became_peered":"2024-09-22T08:36:25.983061+0000","last_unstale":"2024-09-22T08:40:04.756500+0000","last_undegraded":"2024-09-22T08:40:04.756500+0000","last_fullsized":"2024-09-22T08:40:04.756500+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-22T08:40:04.756359+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-22T08:40:04.756359+0000","last_clean_scrub_stamp":"2024-09-22T08:40:04.756359+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:17:00.830661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:52.621679+0000","last_change":"2024-09-22T08:39:52.621578+0000","last_active":"2024-09-22T08:39:52.621679+0000","last_peered":"2024-09-22T08:39:52.621679+0000","last_clean":"2024-09-22T08:39:52.621679+0000","last_became_active":"2024-09-22T08:36:23.973924+0000","last_became_peered":"2024-09-22T08:36:23.973924+0000","last_unstale":"2024-09-22T08:39:52.621679+0000","last_undegraded":"2024-09-22T08:39:52.621679+0000","last_fullsized":"2024-09-22T08:39:52.621679+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:39:52.621486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:39:52.621486+0000","last_clean_scrub_stamp":"2024-09-22T08:39:52.621486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:10:20.959216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"32'18","reported_seq":88,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:04.305369+0000","last_change":"2024-09-22T08:40:04.305270+0000","last_active":"2024-09-22T08:40:04.305369+0000","last_peered":"2024-09-22T08:40:04.305369+0000","last_clean":"2024-09-22T08:40:04.305369+0000","last_became_active":"2024-09-22T08:36:25.979151+0000","last_became_peered":"2024-09-22T08:36:25.979151+0000","last_unstale":"2024-09-22T08:40:04.305369+0000","last_undegraded":"2024-09-22T08:40:04.305369+0000","last_fullsized":"2024-09-22T08:40:04.305369+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'18","last_scrub_stamp":"2024-09-22T08:40:04.305175+0000","last_deep_scrub":"32'18","last_deep_scrub_stamp":"2024-09-22T08:40:04.305175+0000","last_clean_scrub_stamp":"2024-09-22T08:40:04.305175+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:39:13.164022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":64,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:53.864336+0000","last_change":"2024-09-22T08:39:53.864259+0000","last_active":"2024-09-22T08:39:53.864336+0000","last_peered":"2024-09-22T08:39:53.864336+0000","last_clean":"2024-09-22T08:39:53.864336+0000","last_became_active":"2024-09-22T08:36:23.970584+0000","last_became_peered":"2024-09-22T08:36:23.970584+0000","last_unstale":"2024-09-22T08:39:53.864336+0000","last_undegraded":"2024-09-22T08:39:53.864336+0000","last_fullsized":"2024-09-22T08:39:53.864336+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:39:53.864171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:39:53.864171+0000","last_clean_scrub_stamp":"2024-09-22T08:39:53.864171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:54:15.743899+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"32'16","reported_seq":98,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:10.444748+0000","last_change":"2024-09-22T08:40:10.444682+0000","last_active":"2024-09-22T08:40:10.444748+0000","last_peered":"2024-09-22T08:40:10.444748+0000","last_clean":"2024-09-22T08:40:10.444748+0000","last_became_active":"2024-09-22T08:36:25.978730+0000","last_became_peered":"2024-09-22T08:36:25.978730+0000","last_unstale":"2024-09-22T08:40:10.444748+0000","last_undegraded":"2024-09-22T08:40:10.444748+0000","last_fullsized":"2024-09-22T08:40:10.444748+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'16","last_scrub_stamp":"2024-09-22T08:40:10.444585+0000","last_deep_scrub":"32'16","last_deep_scrub_stamp":"2024-09-22T08:40:10.444585+0000","last_clean_scrub_stamp":"2024-09-22T08:40:10.444585+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:20:44.546694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":70,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"32'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:00.269904+0000","last_change":"2024-09-22T08:40:00.269799+0000","last_active":"2024-09-22T08:40:00.269904+0000","last_peered":"2024-09-22T08:40:00.269904+0000","last_clean":"2024-09-22T08:40:00.269904+0000","last_became_active":"2024-09-22T08:36:23.973175+0000","last_became_peered":"2024-09-22T08:36:23.973175+0000","last_unstale":"2024-09-22T08:40:00.269904+0000","last_undegraded":"2024-09-22T08:40:00.269904+0000","last_fullsized":"2024-09-22T08:40:00.269904+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-22T08:40:00.269709+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-22T08:40:00.269709+0000","last_clean_scrub_stamp":"2024-09-22T08:40:00.269709+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:41:49.730855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"32'6","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:22.563092+0000","last_change":"2024-09-22T08:40:22.563038+0000","last_active":"2024-09-22T08:40:22.563092+0000","last_peered":"2024-09-22T08:40:22.563092+0000","last_clean":"2024-09-22T08:40:22.563092+0000","last_became_active":"2024-09-22T08:36:25.991611+0000","last_became_peered":"2024-09-22T08:36:25.991611+0000","last_unstale":"2024-09-22T08:40:22.563092+0000","last_undegraded":"2024-09-22T08:40:22.563092+0000","last_fullsized":"2024-09-22T08:40:22.563092+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-22T08:40:22.562955+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-22T08:40:22.562955+0000","last_clean_scrub_stamp":"2024-09-22T08:40:22.562955+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:47:21.108045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"32'6","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:54.860457+0000","last_change":"2024-09-22T08:39:54.860397+0000","last_active":"2024-09-22T08:39:54.860457+0000","last_peered":"2024-09-22T08:39:54.860457+0000","last_clean":"2024-09-22T08:39:54.860457+0000","last_became_active":"2024-09-22T08:36:23.973721+0000","last_became_peered":"2024-09-22T08:36:23.973721+0000","last_unstale":"2024-09-22T08:39:54.860457+0000","last_undegraded":"2024-09-22T08:39:54.860457+0000","last_fullsized":"2024-09-22T08:39:54.860457+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-22T08:39:54.860314+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-22T08:39:54.860314+0000","last_clean_scrub_stamp":"2024-09-22T08:39:54.860314+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:19:21.761274+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4,"num_write":22,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"32'8","reported_seq":78,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:08.880044+0000","last_change":"2024-09-22T08:40:08.879975+0000","last_active":"2024-09-22T08:40:08.880044+0000","last_peered":"2024-09-22T08:40:08.880044+0000","last_clean":"2024-09-22T08:40:08.880044+0000","last_became_active":"2024-09-22T08:37:04.231342+0000","last_became_peered":"2024-09-22T08:37:04.231342+0000","last_unstale":"2024-09-22T08:40:08.880044+0000","last_undegraded":"2024-09-22T08:40:08.880044+0000","last_fullsized":"2024-09-22T08:40:08.880044+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-22T08:40:08.879881+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-22T08:40:08.879881+0000","last_clean_scrub_stamp":"2024-09-22T08:40:08.879881+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:29:38.636460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:53.142543+0000","last_change":"2024-09-22T08:39:53.142490+0000","last_active":"2024-09-22T08:39:53.142543+0000","last_peered":"2024-09-22T08:39:53.142543+0000","last_clean":"2024-09-22T08:39:53.142543+0000","last_became_active":"2024-09-22T08:36:23.975352+0000","last_became_peered":"2024-09-22T08:36:23.975352+0000","last_unstale":"2024-09-22T08:39:53.142543+0000","last_undegraded":"2024-09-22T08:39:53.142543+0000","last_fullsized":"2024-09-22T08:39:53.142543+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:39:53.142406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:39:53.142406+0000","last_clean_scrub_stamp":"2024-09-22T08:39:53.142406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:12:04.379120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:09.423400+0000","last_change":"2024-09-22T08:40:09.423304+0000","last_active":"2024-09-22T08:40:09.423400+0000","last_peered":"2024-09-22T08:40:09.423400+0000","last_clean":"2024-09-22T08:40:09.423400+0000","last_became_active":"2024-09-22T08:36:25.977732+0000","last_became_peered":"2024-09-22T08:36:25.977732+0000","last_unstale":"2024-09-22T08:40:09.423400+0000","last_undegraded":"2024-09-22T08:40:09.423400+0000","last_fullsized":"2024-09-22T08:40:09.423400+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:09.423216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:09.423216+0000","last_clean_scrub_stamp":"2024-09-22T08:40:09.423216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:29:07.668069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:54.171543+0000","last_change":"2024-09-22T08:39:54.171493+0000","last_active":"2024-09-22T08:39:54.171543+0000","last_peered":"2024-09-22T08:39:54.171543+0000","last_clean":"2024-09-22T08:39:54.171543+0000","last_became_active":"2024-09-22T08:36:23.975986+0000","last_became_peered":"2024-09-22T08:36:23.975986+0000","last_unstale":"2024-09-22T08:39:54.171543+0000","last_undegraded":"2024-09-22T08:39:54.171543+0000","last_fullsized":"2024-09-22T08:39:54.171543+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:39:54.171402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:39:54.171402+0000","last_clean_scrub_stamp":"2024-09-22T08:39:54.171402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:30:19.750104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"32'10","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:14.385965+0000","last_change":"2024-09-22T08:40:14.385913+0000","last_active":"2024-09-22T08:40:14.385965+0000","last_peered":"2024-09-22T08:40:14.385965+0000","last_clean":"2024-09-22T08:40:14.385965+0000","last_became_active":"2024-09-22T08:36:25.984258+0000","last_became_peered":"2024-09-22T08:36:25.984258+0000","last_unstale":"2024-09-22T08:40:14.385965+0000","last_undegraded":"2024-09-22T08:40:14.385965+0000","last_fullsized":"2024-09-22T08:40:14.385965+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-09-22T08:40:14.385812+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-09-22T08:40:14.385812+0000","last_clean_scrub_stamp":"2024-09-22T08:40:14.385812+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:44:29.101922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:01.295994+0000","last_change":"2024-09-22T08:40:01.295930+0000","last_active":"2024-09-22T08:40:01.295994+0000","last_peered":"2024-09-22T08:40:01.295994+0000","last_clean":"2024-09-22T08:40:01.295994+0000","last_became_active":"2024-09-22T08:36:23.979548+0000","last_became_peered":"2024-09-22T08:36:23.979548+0000","last_unstale":"2024-09-22T08:40:01.295994+0000","last_undegraded":"2024-09-22T08:40:01.295994+0000","last_fullsized":"2024-09-22T08:40:01.295994+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:01.295827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:01.295827+0000","last_clean_scrub_stamp":"2024-09-22T08:40:01.295827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:46:58.524286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"32'16","reported_seq":68,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:08.426942+0000","last_change":"2024-09-22T08:40:08.426849+0000","last_active":"2024-09-22T08:40:08.426942+0000","last_peered":"2024-09-22T08:40:08.426942+0000","last_clean":"2024-09-22T08:40:08.426942+0000","last_became_active":"2024-09-22T08:36:25.979965+0000","last_became_peered":"2024-09-22T08:36:25.979965+0000","last_unstale":"2024-09-22T08:40:08.426942+0000","last_undegraded":"2024-09-22T08:40:08.426942+0000","last_fullsized":"2024-09-22T08:40:08.426942+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'16","last_scrub_stamp":"2024-09-22T08:40:08.426756+0000","last_deep_scrub":"32'16","last_deep_scrub_stamp":"2024-09-22T08:40:08.426756+0000","last_clean_scrub_stamp":"2024-09-22T08:40:08.426756+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:00:38.752121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":51,"num_write":22,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"32'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:02.303199+0000","last_change":"2024-09-22T08:40:02.303092+0000","last_active":"2024-09-22T08:40:02.303199+0000","last_peered":"2024-09-22T08:40:02.303199+0000","last_clean":"2024-09-22T08:40:02.303199+0000","last_became_active":"2024-09-22T08:36:23.978225+0000","last_became_peered":"2024-09-22T08:36:23.978225+0000","last_unstale":"2024-09-22T08:40:02.303199+0000","last_undegraded":"2024-09-22T08:40:02.303199+0000","last_fullsized":"2024-09-22T08:40:02.303199+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-22T08:40:02.302998+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-22T08:40:02.302998+0000","last_clean_scrub_stamp":"2024-09-22T08:40:02.302998+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:19:57.676393+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"32'6","reported_seq":61,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:21.569385+0000","last_change":"2024-09-22T08:40:21.569303+0000","last_active":"2024-09-22T08:40:21.569385+0000","last_peered":"2024-09-22T08:40:21.569385+0000","last_clean":"2024-09-22T08:40:21.569385+0000","last_became_active":"2024-09-22T08:36:25.990690+0000","last_became_peered":"2024-09-22T08:36:25.990690+0000","last_unstale":"2024-09-22T08:40:21.569385+0000","last_undegraded":"2024-09-22T08:40:21.569385+0000","last_fullsized":"2024-09-22T08:40:21.569385+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-22T08:40:21.569206+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-22T08:40:21.569206+0000","last_clean_scrub_stamp":"2024-09-22T08:40:21.569206+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:25:32.682806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:53.617261+0000","last_change":"2024-09-22T08:39:53.617208+0000","last_active":"2024-09-22T08:39:53.617261+0000","last_peered":"2024-09-22T08:39:53.617261+0000","last_clean":"2024-09-22T08:39:53.617261+0000","last_became_active":"2024-09-22T08:36:23.973976+0000","last_became_peered":"2024-09-22T08:36:23.973976+0000","last_unstale":"2024-09-22T08:39:53.617261+0000","last_undegraded":"2024-09-22T08:39:53.617261+0000","last_fullsized":"2024-09-22T08:39:53.617261+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:39:53.617119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:39:53.617119+0000","last_clean_scrub_stamp":"2024-09-22T08:39:53.617119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:07:03.861422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"32'2","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:07.399470+0000","last_change":"2024-09-22T08:40:07.399420+0000","last_active":"2024-09-22T08:40:07.399470+0000","last_peered":"2024-09-22T08:40:07.399470+0000","last_clean":"2024-09-22T08:40:07.399470+0000","last_became_active":"2024-09-22T08:36:25.975794+0000","last_became_peered":"2024-09-22T08:36:25.975794+0000","last_unstale":"2024-09-22T08:40:07.399470+0000","last_undegraded":"2024-09-22T08:40:07.399470+0000","last_fullsized":"2024-09-22T08:40:07.399470+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-22T08:40:07.399339+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-22T08:40:07.399339+0000","last_clean_scrub_stamp":"2024-09-22T08:40:07.399339+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:48:57.554466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:03.266180+0000","last_change":"2024-09-22T08:40:03.266087+0000","last_active":"2024-09-22T08:40:03.266180+0000","last_peered":"2024-09-22T08:40:03.266180+0000","last_clean":"2024-09-22T08:40:03.266180+0000","last_became_active":"2024-09-22T08:36:23.982376+0000","last_became_peered":"2024-09-22T08:36:23.982376+0000","last_unstale":"2024-09-22T08:40:03.266180+0000","last_undegraded":"2024-09-22T08:40:03.266180+0000","last_fullsized":"2024-09-22T08:40:03.266180+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-22T08:40:03.265985+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-22T08:40:03.265985+0000","last_clean_scrub_stamp":"2024-09-22T08:40:03.265985+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:02:58.569511+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:05.287713+0000","last_change":"2024-09-22T08:40:05.287659+0000","last_active":"2024-09-22T08:40:05.287713+0000","last_peered":"2024-09-22T08:40:05.287713+0000","last_clean":"2024-09-22T08:40:05.287713+0000","last_became_active":"2024-09-22T08:36:23.978787+0000","last_became_peered":"2024-09-22T08:36:23.978787+0000","last_unstale":"2024-09-22T08:40:05.287713+0000","last_undegraded":"2024-09-22T08:40:05.287713+0000","last_fullsized":"2024-09-22T08:40:05.287713+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:40:05.287568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:40:05.287568+0000","last_clean_scrub_stamp":"2024-09-22T08:40:05.287568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:59:39.200932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"32'8","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:10.872285+0000","last_change":"2024-09-22T08:40:10.872172+0000","last_active":"2024-09-22T08:40:10.872285+0000","last_peered":"2024-09-22T08:40:10.872285+0000","last_clean":"2024-09-22T08:40:10.872285+0000","last_became_active":"2024-09-22T08:36:25.979593+0000","last_became_peered":"2024-09-22T08:36:25.979593+0000","last_unstale":"2024-09-22T08:40:10.872285+0000","last_undegraded":"2024-09-22T08:40:10.872285+0000","last_fullsized":"2024-09-22T08:40:10.872285+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-22T08:40:10.872074+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-22T08:40:10.872074+0000","last_clean_scrub_stamp":"2024-09-22T08:40:10.872074+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:25:45.090218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:39:55.878849+0000","last_change":"2024-09-22T08:39:55.878768+0000","last_active":"2024-09-22T08:39:55.878849+0000","last_peered":"2024-09-22T08:39:55.878849+0000","last_clean":"2024-09-22T08:39:55.878849+0000","last_became_active":"2024-09-22T08:36:23.974202+0000","last_became_peered":"2024-09-22T08:36:23.974202+0000","last_unstale":"2024-09-22T08:39:55.878849+0000","last_undegraded":"2024-09-22T08:39:55.878849+0000","last_fullsized":"2024-09-22T08:39:55.878849+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:39:55.878679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:39:55.878679+0000","last_clean_scrub_stamp":"2024-09-22T08:39:55.878679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:42:02.792761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"32'14","reported_seq":88,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T08:40:16.311603+0000","last_change":"2024-09-22T08:40:16.311548+0000","last_active":"2024-09-22T08:40:16.311603+0000","last_peered":"2024-09-22T08:40:16.311603+0000","last_clean":"2024-09-22T08:40:16.311603+0000","last_became_active":"2024-09-22T08:37:04.233241+0000","last_became_peered":"2024-09-22T08:37:04.233241+0000","last_unstale":"2024-09-22T08:40:16.311603+0000","last_undegraded":"2024-09-22T08:40:16.311603+0000","last_fullsized":"2024-09-22T08:40:16.311603+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'14","last_scrub_stamp":"2024-09-22T08:40:16.311459+0000","last_deep_scrub":"32'14","last_deep_scrub_stamp":"2024-09-22T08:40:16.311459+0000","last_clean_scrub_stamp":"2024-09-22T08:40:16.311459+0000","objects_scrubbed":1,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:43:58.325817+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":47,"num_read_kb":43,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1549,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":690,"num_read_kb":658,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":349,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":276,"ondisk_log_size":276,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2288,"ondisk_log_size":2288,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1600,"num_read_kb":1397,"num_write":597,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3000,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1557,"ondisk_log_size":1557,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19,"ondisk_log_size":19,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1672,"num_read_kb":1562,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":482,"ondisk_log_size":482,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":177,"num_read_kb":83,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":128,"acting":128,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":11,"seq":47244640324,"num_pgs":124,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40472,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331368,"statfs":{"total":96636764160,"available":96595320832,"internally_reserved":0,"allocated":991232,"data_stored":726145,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640324,"num_pgs":119,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36324,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335516,"statfs":{"total":96636764160,"available":96599568384,"internally_reserved":0,"allocated":1003520,"data_stored":724639,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":9,"seq":38654705730,"num_pgs":152,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39960,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331880,"statfs":{"total":96636764160,"available":96595845120,"internally_reserved":0,"allocated":466944,"data_stored":138067,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705730,"num_pgs":135,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39916,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331924,"statfs":{"total":96636764160,"available":96595890176,"internally_reserved":0,"allocated":421888,"data_stored":135213,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":325,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":421,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T08:41:25.513 DEBUG:teuthology.orchestra.run.smithi031:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-22T08:41:25.643 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:41:25.639+0000 7fbb58bd3640 1 Processor -- start 2024-09-22T08:41:25.643 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:41:25.639+0000 7fbb58bd3640 1 -- start start 2024-09-22T08:41:25.643 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:41:25.639+0000 7fbb58bd3640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fbb5412d5b0 0x7fbb5412d990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:41:25.643 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:41:25.639+0000 7fbb58bd3640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb54071be0 con 0x7fbb5406e170 2024-09-22T08:41:25.643 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:41:25.639+0000 7fbb58bd3640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7fbb5412d1f0 con 0x7fbb5412d5b0 2024-09-22T08:41:25.643 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:41:25.640+0000 7fbb5259c640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fbb5412d5b0 0x7fbb5412d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:41:25.643 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:41:25.640+0000 7fbb4bfff640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fbb5406e170 0x7fbb5406e5c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:44584/0 (socket says 172.21.15.31:44584) 2024-09-22T08:41:25.643 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:41:25.640+0000 7fbb4bfff640 1 -- 172.21.15.31:0/1214377124 learned_addr learned my addr 172.21.15.31:0/1214377124 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-22T08:41:25.644 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:41:25.640+0000 7fbb5259c640 1 -- 172.21.15.31:0/1214377124 >> v1:172.21.15.31:6789/0 conn(0x7fbb5406e170 legacy=0x7fbb5406e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:41:25.644 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:41:25.640+0000 7fbb51d9b640 1 -- 172.21.15.31:0/1214377124 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1760369573 0 0) 0x7fbb3c001110 con 0x7fbb5406e170 2024-09-22T08:41:25.644 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:41:25.640+0000 7fbb5259c640 1 -- 172.21.15.31:0/1214377124 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb54099b50 con 0x7fbb5412d5b0 2024-09-22T08:41:25.644 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:41:25.641+0000 7fbb5259c640 1 --2- 172.21.15.31:0/1214377124 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbb5412d5b0 0x7fbb5412d990 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7fbb44009720 tx=0x7fbb4402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae77820b961a39f9 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:41:25.644 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:41:25.641+0000 7fbb51d9b640 1 -- 172.21.15.31:0/1214377124 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb44037070 con 0x7fbb5412d5b0 2024-09-22T08:41:25.644 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:41:25.641+0000 7fbb51d9b640 1 -- 172.21.15.31:0/1214377124 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb4402ad90 con 0x7fbb5412d5b0 2024-09-22T08:41:25.644 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:41:25.641+0000 7fbb51d9b640 1 -- 172.21.15.31:0/1214377124 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb44032590 con 0x7fbb5412d5b0 2024-09-22T08:41:25.646 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:41:25.641+0000 7fbb58bd3640 1 -- 172.21.15.31:0/1214377124 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbb5412d5b0 msgr2=0x7fbb5412d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:41:25.646 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:41:25.641+0000 7fbb58bd3640 1 --2- 172.21.15.31:0/1214377124 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbb5412d5b0 0x7fbb5412d990 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7fbb44009720 tx=0x7fbb4402a110 comp rx=0 tx=0).stop 2024-09-22T08:41:25.646 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:41:25.641+0000 7fbb58bd3640 1 -- 172.21.15.31:0/1214377124 shutdown_connections 2024-09-22T08:41:25.646 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:41:25.641+0000 7fbb58bd3640 1 --2- 172.21.15.31:0/1214377124 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbb5412d5b0 0x7fbb5412d990 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:41:25.646 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:41:25.641+0000 7fbb58bd3640 1 -- 172.21.15.31:0/1214377124 >> 172.21.15.31:0/1214377124 conn(0x7fbb5409aa00 msgr2=0x7fbb5409ae10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:41:25.646 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:41:25.641+0000 7fbb58bd3640 1 -- 172.21.15.31:0/1214377124 shutdown_connections 2024-09-22T08:41:25.646 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:41:25.641+0000 7fbb58bd3640 1 -- 172.21.15.31:0/1214377124 wait complete. 2024-09-22T08:41:25.647 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:41:25.642+0000 7fbb58bd3640 1 Processor -- start 2024-09-22T08:41:25.647 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:41:25.642+0000 7fbb58bd3640 1 -- start start 2024-09-22T08:41:25.647 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:41:25.643+0000 7fbb58bd3640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbb5406e170 0x7fbb541c2280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:41:25.647 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:41:25.643+0000 7fbb58bd3640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fbb54071e20 con 0x7fbb5406e170 2024-09-22T08:41:25.647 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:41:25.643+0000 7fbb5259c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbb5406e170 0x7fbb541c2280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:41:25.647 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:41:25.643+0000 7fbb5259c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbb5406e170 0x7fbb541c2280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:36004/0 (socket says 172.21.15.31:36004) 2024-09-22T08:41:25.647 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:41:25.643+0000 7fbb5259c640 1 -- 172.21.15.31:0/997464906 learned_addr learned my addr 172.21.15.31:0/997464906 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-22T08:41:25.647 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:41:25.643+0000 7fbb5259c640 1 -- 172.21.15.31:0/997464906 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb5408d5c0 con 0x7fbb5406e170 2024-09-22T08:41:25.647 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:41:25.643+0000 7fbb5259c640 1 --2- 172.21.15.31:0/997464906 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbb5406e170 0x7fbb541c2280 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7fbb44009720 tx=0x7fbb440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:41:25.647 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:41:25.643+0000 7fbb4affd640 1 -- 172.21.15.31:0/997464906 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb44037040 con 0x7fbb5406e170 2024-09-22T08:41:25.647 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:41:25.643+0000 7fbb4affd640 1 -- 172.21.15.31:0/997464906 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb44004160 con 0x7fbb5406e170 2024-09-22T08:41:25.647 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:41:25.643+0000 7fbb4affd640 1 -- 172.21.15.31:0/997464906 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb44004440 con 0x7fbb5406e170 2024-09-22T08:41:25.647 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:41:25.643+0000 7fbb58bd3640 1 -- 172.21.15.31:0/997464906 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb5408f280 con 0x7fbb5406e170 2024-09-22T08:41:25.647 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:41:25.643+0000 7fbb58bd3640 1 -- 172.21.15.31:0/997464906 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb5408e6d0 con 0x7fbb5406e170 2024-09-22T08:41:25.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:41:25.645+0000 7fbb4affd640 1 -- 172.21.15.31:0/997464906 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fbb44003610 con 0x7fbb5406e170 2024-09-22T08:41:25.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:41:25.645+0000 7fbb58bd3640 1 -- 172.21.15.31:0/997464906 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb540008d0 con 0x7fbb5406e170 2024-09-22T08:41:25.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:41:25.645+0000 7fbb4affd640 1 --2- 172.21.15.31:0/997464906 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fbb3403e710 0x7fbb34040bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:41:25.649 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:41:25.645+0000 7fbb4affd640 1 -- 172.21.15.31:0/997464906 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5938+0+0 (secure 0 0 0) 0x7fbb440746b0 con 0x7fbb5406e170 2024-09-22T08:41:25.649 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:41:25.645+0000 7fbb4bfff640 1 --2- 172.21.15.31:0/997464906 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fbb3403e710 0x7fbb34040bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:41:25.649 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:41:25.646+0000 7fbb4bfff640 1 --2- 172.21.15.31:0/997464906 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fbb3403e710 0x7fbb34040bd0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fbb3c000c00 tx=0x7fbb3c001310 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:41:25.651 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:41:25.649+0000 7fbb4affd640 1 -- 172.21.15.31:0/997464906 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fbb4403c3d0 con 0x7fbb5406e170 2024-09-22T08:41:25.838 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:41:25.836+0000 7fbb58bd3640 1 -- 172.21.15.31:0/997464906 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7fbb5408e9b0 con 0x7fbb5406e170 2024-09-22T08:41:25.841 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:41:25.839+0000 7fbb4affd640 1 -- 172.21.15.31:0/997464906 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v6)=0 v6) ==== 123+0+0 (secure 0 0 0) 0x7fbb4403d470 con 0x7fbb5406e170 2024-09-22T08:41:25.841 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:41:25.840+0000 7fbb4affd640 1 -- 172.21.15.31:0/997464906 <== mon.0 v2:172.21.15.31:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fbb4403ee40 con 0x7fbb5406e170 2024-09-22T08:41:25.844 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:41:25.841+0000 7fbb58bd3640 1 -- 172.21.15.31:0/997464906 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fbb3403e710 msgr2=0x7fbb34040bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:41:25.844 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:41:25.841+0000 7fbb58bd3640 1 --2- 172.21.15.31:0/997464906 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fbb3403e710 0x7fbb34040bd0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fbb3c000c00 tx=0x7fbb3c001310 comp rx=0 tx=0).stop 2024-09-22T08:41:25.844 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:41:25.841+0000 7fbb58bd3640 1 -- 172.21.15.31:0/997464906 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbb5406e170 msgr2=0x7fbb541c2280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:41:25.844 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:41:25.841+0000 7fbb58bd3640 1 --2- 172.21.15.31:0/997464906 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbb5406e170 0x7fbb541c2280 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7fbb44009720 tx=0x7fbb440046c0 comp rx=0 tx=0).stop 2024-09-22T08:41:25.844 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:41:25.841+0000 7fbb58bd3640 1 -- 172.21.15.31:0/997464906 shutdown_connections 2024-09-22T08:41:25.844 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:41:25.842+0000 7fbb58bd3640 1 --2- 172.21.15.31:0/997464906 >> [v2:172.21.15.142:6824/99931088,v1:172.21.15.142:6825/99931088] conn(0x7fbb3403e710 0x7fbb34040bd0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:41:25.844 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:41:25.842+0000 7fbb58bd3640 1 --2- 172.21.15.31:0/997464906 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbb5406e170 0x7fbb541c2280 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:41:25.844 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:41:25.842+0000 7fbb58bd3640 1 -- 172.21.15.31:0/997464906 >> 172.21.15.31:0/997464906 conn(0x7fbb5409aa00 msgr2=0x7fbb5412b8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:41:25.845 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:41:25.842+0000 7fbb58bd3640 1 -- 172.21.15.31:0/997464906 shutdown_connections 2024-09-22T08:41:25.845 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-22T08:41:25.842+0000 7fbb58bd3640 1 -- 172.21.15.31:0/997464906 wait complete. 2024-09-22T08:41:25.854 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-22T08:41:25.854 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-22T08:41:25.855 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-22T08:41:25.855 INFO:teuthology.orchestra.run:waiting for 300 2024-09-22T08:41:25.885 INFO:tasks.ceph.osd.0:Stopped 2024-09-22T08:41:25.885 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-22T08:41:25.885 INFO:teuthology.orchestra.run:waiting for 300 2024-09-22T08:41:25.914 INFO:tasks.ceph.osd.1:Stopped 2024-09-22T08:41:25.914 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-22T08:41:25.914 INFO:teuthology.orchestra.run:waiting for 300 2024-09-22T08:41:25.985 INFO:tasks.ceph.osd.2:Stopped 2024-09-22T08:41:25.985 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-22T08:41:25.985 INFO:teuthology.orchestra.run:waiting for 300 2024-09-22T08:41:26.058 INFO:tasks.ceph.osd.3:Stopped 2024-09-22T08:41:26.058 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-22T08:41:26.059 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-22T08:41:26.059 INFO:teuthology.orchestra.run:waiting for 300 2024-09-22T08:41:26.129 INFO:tasks.ceph.mgr.x:Stopped 2024-09-22T08:41:26.129 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-22T08:41:26.129 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-22T08:41:26.129 INFO:teuthology.orchestra.run:waiting for 300 2024-09-22T08:41:26.141 INFO:tasks.ceph.mon.a:Stopped 2024-09-22T08:41:26.141 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-22T08:41:26.141 DEBUG:teuthology.orchestra.run.smithi031:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'not have an application enabled' | head -n 1 2024-09-22T08:41:26.211 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi031.front.sepia.ceph.com 2024-09-22T08:41:26.211 DEBUG:teuthology.orchestra.run.smithi031:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-22T08:41:26.374 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi142.front.sepia.ceph.com 2024-09-22T08:41:26.374 DEBUG:teuthology.orchestra.run.smithi142:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-22T08:41:26.575 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi142.front.sepia.ceph.com 2024-09-22T08:41:26.575 DEBUG:teuthology.orchestra.run.smithi142:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-22T08:41:26.647 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi142.front.sepia.ceph.com 2024-09-22T08:41:26.647 DEBUG:teuthology.orchestra.run.smithi142:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-22T08:41:26.748 INFO:tasks.ceph:Archiving mon data... 2024-09-22T08:41:26.749 DEBUG:teuthology.misc:Transferring archived files from smithi031:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/soumyakoduri-2024-09-22_06:37:27-rgw-wip-skoduri-cloud-restore-distro-default-smithi/7915065/data/mon.a.tgz 2024-09-22T08:41:26.749 DEBUG:teuthology.orchestra.run.smithi031:> mktemp 2024-09-22T08:41:26.766 INFO:teuthology.orchestra.run.smithi031.stdout:/tmp/tmp.5X0yvJ43rq 2024-09-22T08:41:26.767 DEBUG:teuthology.orchestra.run.smithi031:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.5X0yvJ43rq 2024-09-22T08:41:26.943 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod 0666 /tmp/tmp.5X0yvJ43rq 2024-09-22T08:41:27.029 DEBUG:teuthology.orchestra.remote:smithi031:/tmp/tmp.5X0yvJ43rq is 277KB 2024-09-22T08:41:27.096 DEBUG:teuthology.orchestra.run.smithi031:> rm -fr /tmp/tmp.5X0yvJ43rq 2024-09-22T08:41:27.111 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-22T08:41:27.111 DEBUG:teuthology.orchestra.run.smithi031:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-22T08:41:27.153 DEBUG:teuthology.orchestra.run.smithi142:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-22T08:41:27.233 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-22T08:41:27.251 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-22T08:41:27.251 INFO:tasks.ceph:Archiving crash dumps... 2024-09-22T08:41:27.253 DEBUG:teuthology.misc:Transferring archived files from smithi031:/var/lib/ceph/crash to /home/teuthworker/archive/soumyakoduri-2024-09-22_06:37:27-rgw-wip-skoduri-cloud-restore-distro-default-smithi/7915065/remote/smithi031/crash 2024-09-22T08:41:27.254 DEBUG:teuthology.orchestra.run.smithi031:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-22T08:41:27.299 DEBUG:teuthology.misc:Transferring archived files from smithi142:/var/lib/ceph/crash to /home/teuthworker/archive/soumyakoduri-2024-09-22_06:37:27-rgw-wip-skoduri-cloud-restore-distro-default-smithi/7915065/remote/smithi142/crash 2024-09-22T08:41:27.300 DEBUG:teuthology.orchestra.run.smithi142:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-22T08:41:27.340 INFO:tasks.ceph:Compressing logs... 2024-09-22T08:41:27.341 DEBUG:teuthology.orchestra.run.smithi031:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-22T08:41:27.344 DEBUG:teuthology.orchestra.run.smithi142:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-22T08:41:27.366 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-22T08:41:27.366 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32122.log 2024-09-22T08:41:27.366 INFO:teuthology.orchestra.run.smithi031.stderr:gzip/var/log/ceph/ceph-osd.0.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.31540.log 2024-09-22T08:41:27.381 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.32122.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31539.log 2024-09-22T08:41:27.381 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.31540.log: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.32122.log.gz 2024-09-22T08:41:27.381 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.27641.log 2024-09-22T08:41:27.382 INFO:teuthology.orchestra.run.smithi031.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.31540.log.gz 2024-09-22T08:41:27.382 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.31539.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32332.log 2024-09-22T08:41:27.382 INFO:teuthology.orchestra.run.smithi031.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.31539.log.gz 2024-09-22T08:41:27.382 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph.tmp-client.admin.27641.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32709.log 2024-09-22T08:41:27.382 INFO:teuthology.orchestra.run.smithi031.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.27641.log.gz 2024-09-22T08:41:27.382 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.32332.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31668.log 2024-09-22T08:41:27.382 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.32709.log: gzip 85.6% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.32332.log.gz -- 2024-09-22T08:41:27.382 INFO:teuthology.orchestra.run.smithi031.stderr: /var/log/ceph/ceph-client.admin.29349.log 2024-09-22T08:41:27.382 INFO:teuthology.orchestra.run.smithi031.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.32709.log.gz 2024-09-22T08:41:27.382 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.31668.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31372.log 2024-09-22T08:41:27.382 INFO:teuthology.orchestra.run.smithi031.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.31668.log.gz 2024-09-22T08:41:27.382 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.29349.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-22T08:41:27.382 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.31372.log: gzip 87.0% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.29349.log.gz -- 2024-09-22T08:41:27.383 INFO:teuthology.orchestra.run.smithi031.stderr: /var/log/ceph/ceph-client.admin.31371.log 2024-09-22T08:41:27.383 INFO:teuthology.orchestra.run.smithi031.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.31372.log.gz 2024-09-22T08:41:27.383 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31816.log 2024-09-22T08:41:27.383 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.31371.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32543.log 2024-09-22T08:41:27.383 INFO:teuthology.orchestra.run.smithi031.stderr: 88.6% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-22T08:41:27.383 INFO:teuthology.orchestra.run.smithi031.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.31371.log.gz 2024-09-22T08:41:27.383 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.31816.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31093.log 2024-09-22T08:41:27.383 INFO:teuthology.orchestra.run.smithi031.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.31816.log.gz 2024-09-22T08:41:27.383 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.32543.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31144.log 2024-09-22T08:41:27.383 INFO:teuthology.orchestra.run.smithi031.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.32543.log.gz 2024-09-22T08:41:27.383 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.31093.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32038.log 2024-09-22T08:41:27.383 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.31144.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31667.log 2024-09-22T08:41:27.383 INFO:teuthology.orchestra.run.smithi031.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.31093.log.gz 2024-09-22T08:41:27.384 INFO:teuthology.orchestra.run.smithi031.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.31144.log.gz 2024-09-22T08:41:27.384 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.32038.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32627.log 2024-09-22T08:41:27.384 INFO:teuthology.orchestra.run.smithi031.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.32038.log.gz 2024-09-22T08:41:27.384 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.31667.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32206.log 2024-09-22T08:41:27.384 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.32627.log: gzip 86.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.31667.log.gz 2024-09-22T08:41:27.384 INFO:teuthology.orchestra.run.smithi031.stderr: --verbose -- /var/log/ceph/ceph-client.admin.31708.log 2024-09-22T08:41:27.384 INFO:teuthology.orchestra.run.smithi031.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.32627.log.gz 2024-09-22T08:41:27.384 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.32206.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31186.log 2024-09-22T08:41:27.384 INFO:teuthology.orchestra.run.smithi031.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.32206.log.gz 2024-09-22T08:41:27.384 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.31708.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-22T08:41:27.384 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.31186.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.31708.log.gz 2024-09-22T08:41:27.384 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31858.log 2024-09-22T08:41:27.384 INFO:teuthology.orchestra.run.smithi031.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.31186.log.gz 2024-09-22T08:41:27.384 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32458.log 2024-09-22T08:41:27.385 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.31858.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32164.log 2024-09-22T08:41:27.385 INFO:teuthology.orchestra.run.smithi031.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.31858.log.gz 2024-09-22T08:41:27.385 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.32458.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32585.log 2024-09-22T08:41:27.385 INFO:teuthology.orchestra.run.smithi031.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.32458.log.gz 2024-09-22T08:41:27.385 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31270.log 2024-09-22T08:41:27.385 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.32164.log: /var/log/ceph/ceph-client.admin.32585.log: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.32164.log.gz 2024-09-22T08:41:27.385 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32290.log 2024-09-22T08:41:27.385 INFO:teuthology.orchestra.run.smithi031.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.32585.log.gz 2024-09-22T08:41:27.385 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31900.log 2024-09-22T08:41:27.385 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.31270.log: /var/log/ceph/ceph-client.admin.32290.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31228.log 2024-09-22T08:41:27.385 INFO:teuthology.orchestra.run.smithi031.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.31270.log.gz 2024-09-22T08:41:27.385 INFO:teuthology.orchestra.run.smithi031.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.32290.log.gz 2024-09-22T08:41:27.385 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.31900.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31954.log 2024-09-22T08:41:27.385 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.31228.log: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.31900.log.gz 2024-09-22T08:41:27.386 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31370.log 2024-09-22T08:41:27.386 INFO:teuthology.orchestra.run.smithi031.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.31228.log.gz 2024-09-22T08:41:27.386 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.31954.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31538.log 2024-09-22T08:41:27.386 INFO:teuthology.orchestra.run.smithi031.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.31954.log.gz 2024-09-22T08:41:27.386 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.31370.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31996.log 2024-09-22T08:41:27.386 INFO:teuthology.orchestra.run.smithi031.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.31370.log.gz 2024-09-22T08:41:27.386 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-22T08:41:27.387 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.31538.log: /var/log/ceph/ceph-client.admin.31996.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31537.log 2024-09-22T08:41:27.387 INFO:teuthology.orchestra.run.smithi031.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.31538.log.gz 2024-09-22T08:41:27.387 INFO:teuthology.orchestra.run.smithi031.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.31996.log.gz 2024-09-22T08:41:27.387 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32248.log 2024-09-22T08:41:27.387 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.31537.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31068.log 2024-09-22T08:41:27.387 INFO:teuthology.orchestra.run.smithi031.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.31537.log.gz 2024-09-22T08:41:27.388 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31707.log 2024-09-22T08:41:27.388 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.32248.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29467.log 2024-09-22T08:41:27.388 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.31068.log: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.32248.log.gz 2024-09-22T08:41:27.388 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.31707.log: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.31068.log.gz 2024-09-22T08:41:27.388 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32501.log 2024-09-22T08:41:27.388 INFO:teuthology.orchestra.run.smithi031.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.31707.log.gz 2024-09-22T08:41:27.388 INFO:teuthology.orchestra.run.smithi031.stderr: 86.4% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-22T08:41:27.389 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.29467.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32374.log 2024-09-22T08:41:27.389 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.32501.log: 84.7% -- replaced with /var/log/ceph/ceph-client.admin.29467.log.gz 2024-09-22T08:41:27.389 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32416.log 2024-09-22T08:41:27.389 INFO:teuthology.orchestra.run.smithi031.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.32501.log.gz 2024-09-22T08:41:27.389 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.32374.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31369.log 2024-09-22T08:41:27.389 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32669.log 2024-09-22T08:41:27.390 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.32416.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.32374.log.gz 2024-09-22T08:41:27.390 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.31369.log: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.32416.log.gz 2024-09-22T08:41:27.390 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29508.log 2024-09-22T08:41:27.390 INFO:teuthology.orchestra.run.smithi031.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.31369.log.gz 2024-09-22T08:41:27.390 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30955.log 2024-09-22T08:41:27.390 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.32669.log: /var/log/ceph/ceph-client.admin.29508.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31012.log 2024-09-22T08:41:27.390 INFO:teuthology.orchestra.run.smithi031.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.32669.log.gz 2024-09-22T08:41:27.391 INFO:teuthology.orchestra.run.smithi031.stderr: 84.8% -- replaced with /var/log/ceph/ceph-client.admin.29508.log.gz 2024-09-22T08:41:27.391 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.30955.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32080.log 2024-09-22T08:41:27.391 INFO:teuthology.orchestra.run.smithi031.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.30955.log.gz 2024-09-22T08:41:27.391 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.31012.log: /var/log/ceph/ceph-client.admin.32080.log: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.31012.log.gz 2024-09-22T08:41:27.391 INFO:teuthology.orchestra.run.smithi031.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.32080.log.gz 2024-09-22T08:41:27.419 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.80165.log 2024-09-22T08:41:27.420 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.40235.log 2024-09-22T08:41:27.420 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.0.80165.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.57175.log 2024-09-22T08:41:27.421 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.0.40235.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.86203.log 2024-09-22T08:41:27.422 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.0.57175.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.62620.log 2024-09-22T08:41:27.422 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.63225.log 2024-09-22T08:41:27.422 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.0.86203.log: /var/log/ceph/ceph-client.0.62620.log: 91.1% -- replaced with /var/log/ceph/ceph-client.0.80165.log.gz 2024-09-22T08:41:27.422 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.78955.log 2024-09-22T08:41:27.422 INFO:teuthology.orchestra.run.smithi142.stderr: 91.8% -- replaced with /var/log/ceph/ceph-client.0.40235.log.gz 2024-09-22T08:41:27.422 INFO:teuthology.orchestra.run.smithi142.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.0.86203.log.gz 2024-09-22T08:41:27.422 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.0.63225.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.94655.log 2024-09-22T08:41:27.422 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.0.78955.log: 91.4% -- replaced with /var/log/ceph/ceph-client.0.57175.log.gz 2024-09-22T08:41:27.422 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.61410.log 2024-09-22T08:41:27.425 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.0.94655.log: 91.1% -- replaced with /var/log/ceph/ceph-client.0.62620.log.gz 2024-09-22T08:41:27.425 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.83190.log 2024-09-22T08:41:27.426 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.36611.log 2024-09-22T08:41:27.426 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.0.61410.log: 91.0% -- replaced with /var/log/ceph/ceph-client.0.63225.log.gz 2024-09-22T08:41:27.426 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.0.83190.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.69880.log 2024-09-22T08:41:27.426 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35737.log 2024-09-22T08:41:27.426 INFO:teuthology.orchestra.run.smithi142.stderr: 91.0% 91.1% -- replaced with /var/log/ceph/ceph-client.0.94655.log.gz -- replaced with /var/log/ceph/ceph-client.0.78955.log.gz 2024-09-22T08:41:27.426 INFO:teuthology.orchestra.run.smithi142.stderr: 2024-09-22T08:41:27.426 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.0.36611.log: /var/log/ceph/ceph-client.0.69880.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.81375.log 2024-09-22T08:41:27.426 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.35737.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.85604.log 2024-09-22T08:41:27.426 INFO:teuthology.orchestra.run.smithi142.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.61410.log.gz 2024-09-22T08:41:27.426 INFO:teuthology.orchestra.run.smithi142.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.35737.log.gz 2024-09-22T08:41:27.426 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.0.81375.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.83190.log.gz 2024-09-22T08:41:27.426 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.39031.log 2024-09-22T08:41:27.426 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.62015.log 2024-09-22T08:41:27.427 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.0.85604.log: 91.9% -- replaced with /var/log/ceph/ceph-client.0.36611.log.gz 2024-09-22T08:41:27.427 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.0.39031.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.68670.log 2024-09-22T08:41:27.427 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.85005.log 2024-09-22T08:41:27.427 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.0.62015.log: 91.5% -- replaced with /var/log/ceph/ceph-client.0.85604.log.gz 2024-09-22T08:41:27.427 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.0.68670.log: 92.6% -- replaced with /var/log/ceph/ceph-client.0.69880.log.gz 2024-09-22T08:41:27.427 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43260.log 2024-09-22T08:41:27.447 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.0.85005.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-22T08:41:27.447 INFO:teuthology.orchestra.run.smithi142.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.39031.log.gz 2024-09-22T08:41:27.448 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.0.43260.log: gzip -5 --verbose -- /var/log/ceph/ops-log-ceph-client.0.log 2024-09-22T08:41:27.448 INFO:teuthology.orchestra.run.smithi142.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.81375.log.gz 2024-09-22T08:41:27.448 INFO:teuthology.orchestra.run.smithi142.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.0.85005.log.gz 2024-09-22T08:41:27.448 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.93445.log 2024-09-22T08:41:27.448 INFO:teuthology.orchestra.run.smithi142.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.62015.log.gz 2024-09-22T08:41:27.448 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ops-log-ceph-client.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.49310.log 2024-09-22T08:41:27.448 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.0.93445.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.63830.log 2024-09-22T08:41:27.448 INFO:teuthology.orchestra.run.smithi142.stderr: 91.9% -- replaced with /var/log/ceph/ops-log-ceph-client.0.log.gz 2024-09-22T08:41:27.448 INFO:teuthology.orchestra.run.smithi142.stderr: 92.6% -- replaced with /var/log/ceph/ceph-client.0.68670.log.gz 2024-09-22T08:41:27.448 INFO:teuthology.orchestra.run.smithi142.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.43260.log.gz 2024-09-22T08:41:27.448 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.0.49310.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.75325.log 2024-09-22T08:41:27.448 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.0.63830.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.89210.log 2024-09-22T08:41:27.449 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.0.75325.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.58385.log 2024-09-22T08:41:27.449 INFO:teuthology.orchestra.run.smithi142.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.93445.log.gz 2024-09-22T08:41:27.449 INFO:teuthology.orchestra.run.smithi142.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.49310.log.gz 2024-09-22T08:41:27.449 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.0.89210.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.52940.log 2024-09-22T08:41:27.449 INFO:teuthology.orchestra.run.smithi142.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.63830.log.gz 2024-09-22T08:41:27.449 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.0.58385.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.54150.log 2024-09-22T08:41:27.449 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.0.52940.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31361.log 2024-09-22T08:41:27.449 INFO:teuthology.orchestra.run.smithi142.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.0.75325.log.gz 2024-09-22T08:41:27.449 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.0.54150.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.41445.log 2024-09-22T08:41:27.449 INFO:teuthology.orchestra.run.smithi142.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.89210.log.gz 2024-09-22T08:41:27.449 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.31361.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.37216.log 2024-09-22T08:41:27.449 INFO:teuthology.orchestra.run.smithi142.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.58385.log.gz 2024-09-22T08:41:27.449 INFO:teuthology.orchestra.run.smithi142.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.52940.log.gz 85.5% 2024-09-22T08:41:27.450 INFO:teuthology.orchestra.run.smithi142.stderr: -- replaced with /var/log/ceph/ceph-client.admin.31361.log.gz 2024-09-22T08:41:27.450 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.0.41445.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.73510.log 2024-09-22T08:41:27.450 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.0.37216.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31321.log 2024-09-22T08:41:27.450 INFO:teuthology.orchestra.run.smithi142.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.54150.log.gz 2024-09-22T08:41:27.450 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.0.73510.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.92840.log 2024-09-22T08:41:27.450 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.31321.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.83795.log 2024-09-22T08:41:27.450 INFO:teuthology.orchestra.run.smithi142.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.31321.log.gz 2024-09-22T08:41:27.450 INFO:teuthology.orchestra.run.smithi142.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.41445.log.gz 2024-09-22T08:41:27.450 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.0.92840.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44470.log 2024-09-22T08:41:27.450 INFO:teuthology.orchestra.run.smithi142.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.37216.log.gz 2024-09-22T08:41:27.450 INFO:teuthology.orchestra.run.smithi142.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.73510.log.gz 2024-09-22T08:41:27.451 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.0.83795.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.55965.log 2024-09-22T08:41:27.451 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.40840.log 2024-09-22T08:41:27.451 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.0.44470.log: /var/log/ceph/ceph-client.0.55965.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.67460.log 2024-09-22T08:41:27.451 INFO:teuthology.orchestra.run.smithi142.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.92840.log.gz 2024-09-22T08:41:27.451 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.0.40840.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.52335.log 2024-09-22T08:41:27.451 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.0.67460.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.60200.log 2024-09-22T08:41:27.451 INFO:teuthology.orchestra.run.smithi142.stderr: 91.1%/var/log/ceph/ceph-client.0.52335.log: -- replaced with /var/log/ceph/ceph-client.0.44470.log.gz 2024-09-22T08:41:27.451 INFO:teuthology.orchestra.run.smithi142.stderr: 91.4% 91.6% -- replaced with /var/log/ceph/ceph-client.0.83795.log.gz 2024-09-22T08:41:27.451 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.53545.log 2024-09-22T08:41:27.451 INFO:teuthology.orchestra.run.smithi142.stderr: -- replaced with /var/log/ceph/ceph-client.0.55965.log.gz 2024-09-22T08:41:27.451 INFO:teuthology.orchestra.run.smithi142.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.40840.log.gz 2024-09-22T08:41:27.451 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.71090.log 2024-09-22T08:41:27.451 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.0.60200.log: /var/log/ceph/ceph-client.0.53545.log: 91.0% -- replaced with /var/log/ceph/ceph-client.0.67460.log.gz 2024-09-22T08:41:27.452 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.92235.log 2024-09-22T08:41:27.452 INFO:teuthology.orchestra.run.smithi142.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.52335.log.gz 2024-09-22T08:41:27.452 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.66250.log 2024-09-22T08:41:27.452 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.0.71090.log: /var/log/ceph/ceph-client.0.92235.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.60805.log 2024-09-22T08:41:27.452 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.0.66250.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.50520.log 2024-09-22T08:41:27.452 INFO:teuthology.orchestra.run.smithi142.stderr: 91.4% 91.4% -- replaced with /var/log/ceph/ceph-client.0.60200.log.gz 2024-09-22T08:41:27.452 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.0.60805.log: -- replaced with /var/log/ceph/ceph-client.0.53545.log.gz 2024-09-22T08:41:27.452 INFO:teuthology.orchestra.run.smithi142.stderr: 91.1%gzip -- replaced with /var/log/ceph/ceph-client.0.71090.log.gz 2024-09-22T08:41:27.452 INFO:teuthology.orchestra.run.smithi142.stderr: -5 --verbose -- /var/log/ceph/ceph-client.0.95260.log 2024-09-22T08:41:27.452 INFO:teuthology.orchestra.run.smithi142.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.92235.log.gz 2024-09-22T08:41:27.452 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.54755.log 2024-09-22T08:41:27.453 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.0.50520.log: /var/log/ceph/ceph-client.0.95260.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.75930.log 2024-09-22T08:41:27.453 INFO:teuthology.orchestra.run.smithi142.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.66250.log.gz 2024-09-22T08:41:27.453 INFO:teuthology.orchestra.run.smithi142.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.60805.log.gz 2024-09-22T08:41:27.453 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.0.54755.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.91025.log 2024-09-22T08:41:27.453 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.0.75930.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.42050.log 2024-09-22T08:41:27.453 INFO:teuthology.orchestra.run.smithi142.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.50520.log.gz 2024-09-22T08:41:27.453 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.0.91025.log: 91.0% -- replaced with /var/log/ceph/ceph-client.0.95260.log.gz 2024-09-22T08:41:27.453 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.76535.log 2024-09-22T08:41:27.453 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.82585.log 2024-09-22T08:41:27.453 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.0.42050.log: 91.9% -- replaced with /var/log/ceph/ceph-client.0.54755.log.gz 2024-09-22T08:41:27.453 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.0.76535.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.51730.log 2024-09-22T08:41:27.453 INFO:teuthology.orchestra.run.smithi142.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.75930.log.gz 2024-09-22T08:41:27.453 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.0.82585.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.95865.log 2024-09-22T08:41:27.454 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.0.51730.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.70485.log 2024-09-22T08:41:27.454 INFO:teuthology.orchestra.run.smithi142.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.91025.log.gz 2024-09-22T08:41:27.454 INFO:teuthology.orchestra.run.smithi142.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.42050.log.gz 2024-09-22T08:41:27.454 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.0.95865.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.76535.log.gz 2024-09-22T08:41:27.454 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.58990.log 2024-09-22T08:41:27.454 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.81980.log 2024-09-22T08:41:27.454 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.0.70485.log: 91.1% -- replaced with /var/log/ceph/ceph-client.0.82585.log.gz 2024-09-22T08:41:27.454 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.0.58990.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.72300.log 91.1% -- replaced with /var/log/ceph/ceph-client.0.51730.log.gz 2024-09-22T08:41:27.454 INFO:teuthology.orchestra.run.smithi142.stderr: 2024-09-22T08:41:27.454 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.0.81980.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.96522.log 2024-09-22T08:41:27.454 INFO:teuthology.orchestra.run.smithi142.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.95865.log.gz 2024-09-22T08:41:27.454 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.0.72300.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.38426.log 2024-09-22T08:41:27.455 INFO:teuthology.orchestra.run.smithi142.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.58990.log.gz 2024-09-22T08:41:27.455 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.0.96522.log: 91.4%gzip -- replaced with /var/log/ceph/ceph-client.0.70485.log.gz 2024-09-22T08:41:27.455 INFO:teuthology.orchestra.run.smithi142.stderr: -5 --verbose -- /var/log/ceph/ceph-client.0.89815.log 2024-09-22T08:41:27.455 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.0.38426.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.88605.log 2024-09-22T08:41:27.455 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.0.89815.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.77140.log 2024-09-22T08:41:27.455 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.0.88605.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45075.log 2024-09-22T08:41:27.455 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.0.77140.log: 91.5% -- replaced with /var/log/ceph/ceph-client.0.81980.log.gz 2024-09-22T08:41:27.455 INFO:teuthology.orchestra.run.smithi142.stderr: 91.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.42655.log 2024-09-22T08:41:27.455 INFO:teuthology.orchestra.run.smithi142.stderr: -- replaced with /var/log/ceph/ceph-client.0.38426.log.gz 2024-09-22T08:41:27.455 INFO:teuthology.orchestra.run.smithi142.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.72300.log.gz 2024-09-22T08:41:27.456 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.0.45075.log: 91.2% -- replaced with /var/log/ceph/ceph-client.0.89815.log.gz 2024-09-22T08:41:27.456 INFO:teuthology.orchestra.run.smithi142.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.88605.log.gz 2024-09-22T08:41:27.456 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.80770.log 2024-09-22T08:41:27.456 INFO:teuthology.orchestra.run.smithi142.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.77140.log.gz 2024-09-22T08:41:27.456 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.0.42655.log: 93.3% -- replaced with /var/log/ceph/ceph-client.0.96522.log.gz 2024-09-22T08:41:27.456 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.86802.log 2024-09-22T08:41:27.456 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.55360.log 2024-09-22T08:41:27.456 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.0.80770.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.45075.log.gz 2024-09-22T08:41:27.456 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.0.86802.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.69275.log 2024-09-22T08:41:27.456 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.0.55360.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.46890.log 2024-09-22T08:41:27.456 INFO:teuthology.orchestra.run.smithi142.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.0.86802.log.gz 2024-09-22T08:41:27.456 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.0.69275.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.42655.log.gz 2024-09-22T08:41:27.456 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-22T08:41:27.477 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.0.46890.log: 91.2% -- replaced with /var/log/ceph/ceph-client.0.80770.log.gz 2024-09-22T08:41:27.477 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.84400.log 2024-09-22T08:41:27.478 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.71695.log 91.5% 2024-09-22T08:41:27.478 INFO:teuthology.orchestra.run.smithi142.stderr: -- replaced with /var/log/ceph/ceph-client.0.55360.log.gz 2024-09-22T08:41:27.478 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.0.84400.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.72905.log 2024-09-22T08:41:27.478 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.0.71695.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31281.log 2024-09-22T08:41:27.478 INFO:teuthology.orchestra.run.smithi142.stderr: 91.1%/var/log/ceph/ceph-client.0.72905.log: -- replaced with /var/log/ceph/ceph-client.0.46890.log.gz 2024-09-22T08:41:27.478 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.68065.log 2024-09-22T08:41:27.478 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.66855.log 2024-09-22T08:41:27.478 INFO:teuthology.orchestra.run.smithi142.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.84400.log.gz 2024-09-22T08:41:27.478 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.31281.log: 91.0%/var/log/ceph/ceph-client.0.68065.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.91630.log 2024-09-22T08:41:27.478 INFO:teuthology.orchestra.run.smithi142.stderr: -- replaced with /var/log/ceph/ceph-client.0.71695.log.gz 2024-09-22T08:41:27.478 INFO:teuthology.orchestra.run.smithi142.stderr: 93.3% -- replaced with /var/log/ceph/ceph-client.0.69275.log.gz 2024-09-22T08:41:27.478 INFO:teuthology.orchestra.run.smithi142.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.31281.log.gz 2024-09-22T08:41:27.478 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.0.66855.log: 91.0% -- replaced with /var/log/ceph/ceph-client.0.72905.log.gz 2024-09-22T08:41:27.478 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45680.log 2024-09-22T08:41:27.479 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.0.91630.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.47495.log 2024-09-22T08:41:27.479 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.0.45680.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31401.log 2024-09-22T08:41:27.479 INFO:teuthology.orchestra.run.smithi142.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.68065.log.gz 2024-09-22T08:41:27.479 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.0.47495.log: 91.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35697.log 2024-09-22T08:41:27.479 INFO:teuthology.orchestra.run.smithi142.stderr: 91.8% -- replaced with /var/log/ceph/ceph-client.0.91630.log.gz 2024-09-22T08:41:27.479 INFO:teuthology.orchestra.run.smithi142.stderr: -- replaced with /var/log/ceph/ceph-client.0.66855.log.gz 2024-09-22T08:41:27.479 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.31401.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43865.log 2024-09-22T08:41:27.479 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.35697.log: 91.1% -- replaced with /var/log/ceph/ceph-client.0.45680.log.gz 2024-09-22T08:41:27.479 INFO:teuthology.orchestra.run.smithi142.stderr:gzip 85.4% -- replaced with /var/log/ceph/ceph-client.admin.31401.log.gz 2024-09-22T08:41:27.479 INFO:teuthology.orchestra.run.smithi142.stderr: -5 --verbose -- /var/log/ceph/ceph-client.0.65040.log 2024-09-22T08:41:27.479 INFO:teuthology.orchestra.run.smithi142.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.35697.log.gz 2024-09-22T08:41:27.479 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.0.43865.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-22T08:41:27.479 INFO:teuthology.orchestra.run.smithi142.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.47495.log.gz 2024-09-22T08:41:27.480 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.0.65040.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.56570.log 2024-09-22T08:41:27.480 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.39636.log 2024-09-22T08:41:27.480 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.0.56570.log: gzip -5 --verbose 91.3% -- replaced with /var/log/ceph/ceph-client.0.43865.log.gz 2024-09-22T08:41:27.480 INFO:teuthology.orchestra.run.smithi142.stderr: -- /var/log/ceph/ceph-client.0.48100.log 2024-09-22T08:41:27.480 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.0.39636.log: gzip -5 --verbose 91.2% -- replaced with /var/log/ceph/ceph-client.0.65040.log.gz 2024-09-22T08:41:27.480 INFO:teuthology.orchestra.run.smithi142.stderr: -- /var/log/ceph/ceph-client.0.74720.log 2024-09-22T08:41:27.480 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.0.48100.log: 90.3% -- replaced with /var/log/ceph/ceph-client.0.39636.log.gz 2024-09-22T08:41:27.480 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.77745.log 2024-09-22T08:41:27.480 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.0.74720.log: 91.4% -- replaced with /var/log/ceph/ceph-client.0.56570.log.gz 2024-09-22T08:41:27.480 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.88000.log 2024-09-22T08:41:27.480 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.0.77745.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.64435.log 2024-09-22T08:41:27.480 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.0.88000.log: 91.1% -- replaced with /var/log/ceph/ceph-client.0.48100.log.gz 2024-09-22T08:41:27.480 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.65645.log 2024-09-22T08:41:27.480 INFO:teuthology.orchestra.run.smithi142.stderr:gzip 91.8% -- replaced with /var/log/ceph/ceph-client.0.74720.log.gz 2024-09-22T08:41:27.481 INFO:teuthology.orchestra.run.smithi142.stderr: -5 --verbose -- /var/log/ceph/rgw.ceph.client.0.log 2024-09-22T08:41:27.481 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.0.64435.log: /var/log/ceph/ceph-client.0.65645.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.77745.log.gz 2024-09-22T08:41:27.481 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35777.log 2024-09-22T08:41:27.481 INFO:teuthology.orchestra.run.smithi142.stderr:gzip 91.2% -- replaced with /var/log/ceph/ceph-client.0.88000.log.gz 2024-09-22T08:41:27.481 INFO:teuthology.orchestra.run.smithi142.stderr: -5/var/log/ceph/rgw.ceph.client.0.log: --verbose -- /var/log/ceph/ceph-client.0.90420.log 2024-09-22T08:41:27.481 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.57780.log 2024-09-22T08:41:27.481 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.0.90420.log: /var/log/ceph/ceph-client.admin.35777.log: 91.1% -- replaced with /var/log/ceph/ceph-client.0.64435.log.gz 2024-09-22T08:41:27.481 INFO:teuthology.orchestra.run.smithi142.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.35777.log.gz 2024-09-22T08:41:27.481 INFO:teuthology.orchestra.run.smithi142.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.65645.log.gz 2024-09-22T08:41:27.481 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.48705.log 2024-09-22T08:41:27.481 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.0.57780.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.51125.log 2024-09-22T08:41:27.481 INFO:teuthology.orchestra.run.smithi142.stderr: 91.1%/var/log/ceph/ceph-client.0.48705.log: -- replaced with /var/log/ceph/ceph-client.0.90420.log.gz 2024-09-22T08:41:27.481 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.79560.log 2024-09-22T08:41:27.481 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.87401.log 2024-09-22T08:41:27.481 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.0.79560.log: /var/log/ceph/ceph-client.0.51125.log: 91.0% -- replaced with /var/log/ceph/ceph-client.0.57780.log.gz 2024-09-22T08:41:27.482 INFO:teuthology.orchestra.run.smithi142.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.48705.log.gz 2024-09-22T08:41:27.482 INFO:teuthology.orchestra.run.smithi142.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.51125.log.gz 2024-09-22T08:41:27.482 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.78350.log 2024-09-22T08:41:27.482 INFO:teuthology.orchestra.run.smithi142.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.79560.log.gz 2024-09-22T08:41:27.482 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.0.87401.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.59595.log 2024-09-22T08:41:27.482 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.0.78350.log: gzip -5 --verbose 90.3% -- replaced with /var/log/ceph/ceph-client.0.87401.log.gz 2024-09-22T08:41:27.482 INFO:teuthology.orchestra.run.smithi142.stderr: -- /var/log/ceph/ceph-osd.3.log 2024-09-22T08:41:27.482 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.0.59595.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.94050.log 2024-09-22T08:41:27.482 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.74115.log 2024-09-22T08:41:27.482 INFO:teuthology.orchestra.run.smithi142.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.78350.log.gz 2024-09-22T08:41:27.482 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.37821.log 2024-09-22T08:41:27.482 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.0.74115.log: /var/log/ceph/ceph-client.0.94050.log: 91.0% -- replaced with /var/log/ceph/ceph-client.0.59595.log.gz 2024-09-22T08:41:27.483 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35817.log 2024-09-22T08:41:27.483 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.0.37821.log: 91.1% -- replaced with /var/log/ceph/ceph-client.0.94050.log.gz 2024-09-22T08:41:27.483 INFO:teuthology.orchestra.run.smithi142.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.74115.log.gz 2024-09-22T08:41:27.483 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.49915.log 2024-09-22T08:41:27.483 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.46285.log 2024-09-22T08:41:27.483 INFO:teuthology.orchestra.run.smithi142.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.37821.log.gz 2024-09-22T08:41:27.483 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.35817.log: /var/log/ceph/ceph-client.0.49915.log: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.35817.log.gz 2024-09-22T08:41:27.483 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.0.46285.log: 91.1% -- replaced with /var/log/ceph/ceph-client.0.49915.log.gz 2024-09-22T08:41:27.483 INFO:teuthology.orchestra.run.smithi142.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.46285.log.gz 2024-09-22T08:41:27.498 INFO:teuthology.orchestra.run.smithi142.stderr: 92.1% -- replaced with /var/log/ceph/rgw.ceph.client.0.log.gz 2024-09-22T08:41:27.514 INFO:teuthology.orchestra.run.smithi142.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-22T08:41:27.554 INFO:teuthology.orchestra.run.smithi031.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-22T08:41:28.189 INFO:teuthology.orchestra.run.smithi142.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-22T08:41:28.249 INFO:teuthology.orchestra.run.smithi031.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-22T08:41:28.250 INFO:teuthology.orchestra.run.smithi031.stderr: 2024-09-22T08:41:28.251 INFO:teuthology.orchestra.run.smithi031.stderr:real 0m0.894s 2024-09-22T08:41:28.251 INFO:teuthology.orchestra.run.smithi031.stderr:user 0m1.044s 2024-09-22T08:41:28.251 INFO:teuthology.orchestra.run.smithi031.stderr:sys 0m0.086s 2024-09-22T08:41:28.317 INFO:teuthology.orchestra.run.smithi142.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-22T08:41:28.385 INFO:teuthology.orchestra.run.smithi142.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-22T08:41:28.386 INFO:teuthology.orchestra.run.smithi142.stderr: 2024-09-22T08:41:28.386 INFO:teuthology.orchestra.run.smithi142.stderr:real 0m0.978s 2024-09-22T08:41:28.387 INFO:teuthology.orchestra.run.smithi142.stderr:user 0m2.691s 2024-09-22T08:41:28.387 INFO:teuthology.orchestra.run.smithi142.stderr:sys 0m0.214s 2024-09-22T08:41:28.387 INFO:tasks.ceph:Archiving logs... 2024-09-22T08:41:28.387 DEBUG:teuthology.misc:Transferring archived files from smithi031:/var/log/ceph to /home/teuthworker/archive/soumyakoduri-2024-09-22_06:37:27-rgw-wip-skoduri-cloud-restore-distro-default-smithi/7915065/remote/smithi031/log 2024-09-22T08:41:28.388 DEBUG:teuthology.orchestra.run.smithi031:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-22T08:41:28.622 DEBUG:teuthology.misc:Transferring archived files from smithi142:/var/log/ceph to /home/teuthworker/archive/soumyakoduri-2024-09-22_06:37:27-rgw-wip-skoduri-cloud-restore-distro-default-smithi/7915065/remote/smithi142/log 2024-09-22T08:41:28.623 DEBUG:teuthology.orchestra.run.smithi142:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-22T08:41:29.074 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-22T08:41:29.082 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-22T08:41:29.083 DEBUG:teuthology.orchestra.run.smithi031:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-22T08:41:29.085 DEBUG:teuthology.orchestra.run.smithi142:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-22T08:41:29.170 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-22T08:41:29.179 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-22T08:41:29.179 DEBUG:teuthology.orchestra.run.smithi031:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-22T08:41:29.182 DEBUG:teuthology.orchestra.run.smithi142:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-22T08:41:29.196 INFO:teuthology.orchestra.run.smithi031.stderr:bash: line 1: ntpq: command not found 2024-09-22T08:41:29.196 INFO:teuthology.orchestra.run.smithi142.stderr:bash: line 1: ntpq: command not found 2024-09-22T08:41:29.200 INFO:teuthology.orchestra.run.smithi142.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-22T08:41:29.200 INFO:teuthology.orchestra.run.smithi142.stdout:=============================================================================== 2024-09-22T08:41:29.200 INFO:teuthology.orchestra.run.smithi142.stdout:^* hv01.front.sepia.ceph.com 3 6 377 32 +372us[ +387us] +/- 52ms 2024-09-22T08:41:29.201 INFO:teuthology.orchestra.run.smithi142.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 30 -222us[ -222us] +/- 80ms 2024-09-22T08:41:29.201 INFO:teuthology.orchestra.run.smithi142.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 31 -260us[ -260us] +/- 84ms 2024-09-22T08:41:29.201 INFO:teuthology.orchestra.run.smithi142.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-22T08:41:29.202 INFO:teuthology.orchestra.run.smithi031.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-22T08:41:29.202 INFO:teuthology.orchestra.run.smithi031.stdout:=============================================================================== 2024-09-22T08:41:29.202 INFO:teuthology.orchestra.run.smithi031.stdout:^* hv01.front.sepia.ceph.com 3 6 377 31 +356us[ +381us] +/- 52ms 2024-09-22T08:41:29.202 INFO:teuthology.orchestra.run.smithi031.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 32 -233us[ -209us] +/- 80ms 2024-09-22T08:41:29.202 INFO:teuthology.orchestra.run.smithi031.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 32 -258us[ -233us] +/- 84ms 2024-09-22T08:41:29.202 INFO:teuthology.orchestra.run.smithi031.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-22T08:41:29.202 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-22T08:41:29.244 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-22T08:41:29.245 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-22T08:41:29.294 DEBUG:teuthology.orchestra.run.smithi031:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-22T08:41:29.362 DEBUG:teuthology.orchestra.run.smithi142:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-22T08:41:29.422 DEBUG:teuthology.orchestra.run.smithi031:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-22T08:41:29.452 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-22T08:41:29.453 DEBUG:teuthology.orchestra.run.smithi142:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-22T08:41:29.480 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-22T08:41:29.480 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-22T08:41:29.490 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-22T08:41:29.500 INFO:teuthology.task.internal:Duration was 717.811896 seconds 2024-09-22T08:41:29.500 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-22T08:41:29.509 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-22T08:41:29.509 DEBUG:teuthology.orchestra.run.smithi031:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-22T08:41:29.512 DEBUG:teuthology.orchestra.run.smithi142:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-22T08:41:29.552 INFO:teuthology.orchestra.run.smithi031.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-22T08:41:29.559 INFO:teuthology.orchestra.run.smithi142.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-22T08:41:29.898 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-22T08:41:29.899 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi031.front.sepia.ceph.com 2024-09-22T08:41:29.899 DEBUG:teuthology.orchestra.run.smithi031:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-22T08:41:29.930 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi142.front.sepia.ceph.com 2024-09-22T08:41:29.930 DEBUG:teuthology.orchestra.run.smithi142:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-22T08:41:29.960 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-22T08:41:29.960 DEBUG:teuthology.orchestra.run.smithi031:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-22T08:41:29.972 DEBUG:teuthology.orchestra.run.smithi142:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-22T08:41:30.027 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-22T08:41:30.027 DEBUG:teuthology.orchestra.run.smithi031:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-22T08:41:30.041 DEBUG:teuthology.orchestra.run.smithi142:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-22T08:41:30.164 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-22T08:41:30.174 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-22T08:41:30.174 DEBUG:teuthology.orchestra.run.smithi031:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-22T08:41:30.199 DEBUG:teuthology.orchestra.run.smithi142:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-22T08:41:30.223 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-22T08:41:30.234 DEBUG:teuthology.orchestra.run.smithi031:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-22T08:41:30.242 DEBUG:teuthology.orchestra.run.smithi142:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-22T08:41:30.263 INFO:teuthology.orchestra.run.smithi031.stdout:kernel.core_pattern = core 2024-09-22T08:41:30.287 INFO:teuthology.orchestra.run.smithi142.stdout:kernel.core_pattern = core 2024-09-22T08:41:30.306 DEBUG:teuthology.orchestra.run.smithi031:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-22T08:41:30.342 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-22T08:41:30.342 DEBUG:teuthology.orchestra.run.smithi142:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-22T08:41:30.362 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-22T08:41:30.362 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-22T08:41:30.379 INFO:teuthology.task.internal:Transferring archived files... 2024-09-22T08:41:30.379 DEBUG:teuthology.misc:Transferring archived files from smithi031:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/soumyakoduri-2024-09-22_06:37:27-rgw-wip-skoduri-cloud-restore-distro-default-smithi/7915065/remote/smithi031 2024-09-22T08:41:30.380 DEBUG:teuthology.orchestra.run.smithi031:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-22T08:41:30.418 DEBUG:teuthology.misc:Transferring archived files from smithi142:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/soumyakoduri-2024-09-22_06:37:27-rgw-wip-skoduri-cloud-restore-distro-default-smithi/7915065/remote/smithi142 2024-09-22T08:41:30.418 DEBUG:teuthology.orchestra.run.smithi142:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-22T08:41:30.450 INFO:teuthology.task.internal:Removing archive directory... 2024-09-22T08:41:30.450 DEBUG:teuthology.orchestra.run.smithi031:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-22T08:41:30.455 DEBUG:teuthology.orchestra.run.smithi142:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-22T08:41:30.500 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-22T08:41:30.513 INFO:teuthology.task.internal:Not uploading archives. 2024-09-22T08:41:30.513 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-22T08:41:30.522 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-22T08:41:30.522 DEBUG:teuthology.orchestra.run.smithi031:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-22T08:41:30.525 DEBUG:teuthology.orchestra.run.smithi142:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-22T08:41:30.537 INFO:teuthology.orchestra.run.smithi031.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 22 08:41 /home/ubuntu/cephtest 2024-09-22T08:41:30.555 INFO:teuthology.orchestra.run.smithi142.stdout: 265947 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 22 08:41 /home/ubuntu/cephtest 2024-09-22T08:41:30.555 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-22T08:41:30.565 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-22T08:41:30.587 INFO:teuthology.run:Summary data: description: rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/replicated supported-random-distro$/{centos_latest}} duration: 717.811895608902 flavor: default owner: scheduled_soumyakoduri@teuthology success: true 2024-09-22T08:41:30.587 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-22T08:41:30.651 INFO:teuthology.run:pass